-- Logs begin at Tue 2022-10-04 17:29:41 UTC, end at Tue 2022-10-04 20:28:26 UTC. -- Oct 04 18:16:21.610308 n-d-850501-14 systemd[1]: Starting Devstack devstack@n-api.service... Oct 04 18:16:21.619023 n-d-850501-14 devstack@n-api.service[106927]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 04 18:16:21.620994 n-d-850501-14 devstack@n-api.service[106927]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Oct 4 18:16:21 2022] *** Oct 04 18:16:21.620994 n-d-850501-14 devstack@n-api.service[106927]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 04 18:16:21.620994 n-d-850501-14 devstack@n-api.service[106927]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 04 18:16:21.620994 n-d-850501-14 devstack@n-api.service[106927]: nodename: n-d-850501-14 Oct 04 18:16:21.620994 n-d-850501-14 devstack@n-api.service[106927]: machine: x86_64 Oct 04 18:16:21.620994 n-d-850501-14 devstack@n-api.service[106927]: clock source: unix Oct 04 18:16:21.620994 n-d-850501-14 devstack@n-api.service[106927]: pcre jit disabled Oct 04 18:16:21.620994 n-d-850501-14 devstack@n-api.service[106927]: detected number of CPU cores: 4 Oct 04 18:16:21.620994 n-d-850501-14 devstack@n-api.service[106927]: current working directory: / Oct 04 18:16:21.620994 n-d-850501-14 devstack@n-api.service[106927]: detected binary path: /usr/bin/uwsgi-core Oct 04 18:16:21.621612 n-d-850501-14 devstack@n-api.service[106927]: your processes number limit is 47680 Oct 04 18:16:21.621612 n-d-850501-14 devstack@n-api.service[106927]: your memory page size is 4096 bytes Oct 04 18:16:21.621612 n-d-850501-14 devstack@n-api.service[106927]: detected max file descriptor number: 2048 Oct 04 18:16:21.621612 n-d-850501-14 devstack@n-api.service[106927]: lock engine: pthread robust mutexes Oct 04 18:16:21.621612 n-d-850501-14 devstack@n-api.service[106927]: thunder lock: enabled Oct 04 18:16:21.621612 n-d-850501-14 devstack@n-api.service[106927]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 04 18:16:21.621612 n-d-850501-14 devstack@n-api.service[106927]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 04 18:16:21.660492 n-d-850501-14 devstack@n-api.service[106927]: Python main interpreter initialized at 0x55d0dd36f9c0 Oct 04 18:16:21.660492 n-d-850501-14 devstack@n-api.service[106927]: python threads support enabled Oct 04 18:16:21.660492 n-d-850501-14 devstack@n-api.service[106927]: your server socket listen backlog is limited to 100 connections Oct 04 18:16:21.660492 n-d-850501-14 devstack@n-api.service[106927]: your mercy for graceful operations on workers is 90 seconds Oct 04 18:16:21.660858 n-d-850501-14 devstack@n-api.service[106927]: mapped 403077 bytes (393 KB) for 2 cores Oct 04 18:16:21.660943 n-d-850501-14 devstack@n-api.service[106927]: *** Operational MODE: preforking *** Oct 04 18:16:21.661165 n-d-850501-14 devstack@n-api.service[106927]: *** uWSGI is running in multiple interpreter mode *** Oct 04 18:16:21.661165 n-d-850501-14 devstack@n-api.service[106927]: spawned uWSGI master process (pid: 106927) Oct 04 18:16:21.661366 n-d-850501-14 systemd[1]: Started Devstack devstack@n-api.service. Oct 04 18:16:21.662837 n-d-850501-14 devstack@n-api.service[106927]: spawned uWSGI worker 1 (pid: 106928, cores: 1) Oct 04 18:16:21.662837 n-d-850501-14 devstack@n-api.service[106927]: spawned uWSGI worker 2 (pid: 106929, cores: 1) Oct 04 18:16:21.662837 n-d-850501-14 devstack@n-api.service[106927]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 04 18:16:22.333620 n-d-850501-14 devstack@n-api.service[106929]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 04 18:16:22.340878 n-d-850501-14 devstack@n-api.service[106928]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 04 18:16:23.417463 n-d-850501-14 devstack@n-api.service[106929]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 18:16:23.417463 n-d-850501-14 devstack@n-api.service[106929]: from cryptography.utils import int_from_bytes Oct 04 18:16:23.418059 n-d-850501-14 devstack@n-api.service[106929]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 18:16:23.418059 n-d-850501-14 devstack@n-api.service[106929]: from cryptography.utils import int_from_bytes Oct 04 18:16:23.434492 n-d-850501-14 devstack@n-api.service[106928]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 18:16:23.434492 n-d-850501-14 devstack@n-api.service[106928]: from cryptography.utils import int_from_bytes Oct 04 18:16:23.434936 n-d-850501-14 devstack@n-api.service[106928]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 18:16:23.434936 n-d-850501-14 devstack@n-api.service[106928]: from cryptography.utils import int_from_bytes Oct 04 18:16:26.011705 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 18:16:26.012262 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 18:16:26.012426 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 18:16:26.012531 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 18:16:26.012881 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 18:16:26.012955 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 18:16:26.013035 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 18:16:26.013262 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 18:16:26.013373 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.013627 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 18:16:26.013717 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.013883 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 18:16:26.013973 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.014267 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.014356 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.014594 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.014692 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.014896 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.014984 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.015224 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.015322 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.015556 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.015670 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.015869 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.015971 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.016197 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.016289 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.016508 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.016609 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.016826 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-850501-14 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.016944 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.017757 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.017848 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.018148 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.018235 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.018454 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.018549 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-850501-14 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.018767 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.018857 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.019066 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.019166 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.019384 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.019484 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.019693 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.019788 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.020049 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.020206 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.020397 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.020646 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.020774 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.020946 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.021193 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.021299 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.021550 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.021642 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.021807 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.021907 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.022120 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.022211 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.022454 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.022561 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.022771 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.022921 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.023060 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.023154 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.023365 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.023507 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.023674 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.023772 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-850501-14 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.023998 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.024156 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.024333 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.024435 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.024661 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.024751 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-850501-14 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.025036 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.025124 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.025347 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.025446 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.025648 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.025737 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.025965 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.026095 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.026280 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.026386 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.026578 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.026670 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.026900 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.027068 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.027223 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.027367 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.027509 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.027644 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.027809 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.027902 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.028130 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.028223 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.028435 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.028528 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.028738 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.028828 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.029048 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.029137 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.029346 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.029435 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.029642 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.029732 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.029887 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.030007 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.030187 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.030316 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.030499 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.030622 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.030810 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.030898 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.031124 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.031229 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.031368 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.031465 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.031612 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.031781 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.031924 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.032144 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.032253 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.032400 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.032575 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.032670 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.033038 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.033142 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.033361 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.033500 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.033673 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.033778 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.033974 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.034063 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.034278 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.034366 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.034580 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.034681 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.034881 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.034970 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.035186 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.035319 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.035491 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.035592 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.035797 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.035898 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.036118 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.036211 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.036434 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.036537 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.036800 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.036889 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.037055 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.037142 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.037356 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.037455 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.037694 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.037791 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.038043 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.038146 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.038304 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.038395 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.038615 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.038704 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.038930 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.039020 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.039234 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.039325 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.039533 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.039622 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.039834 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.039932 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.040168 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.040277 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.040477 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.040565 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.040780 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.040867 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.041027 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.041124 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.041320 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.041416 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.041619 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.041717 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.041929 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.042019 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.042228 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.042318 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.042532 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.042638 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.042830 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.042918 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.043124 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.043224 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.043424 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.043560 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.043724 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.043822 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.044021 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.044183 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.044343 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.044445 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.044643 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.044733 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.044943 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.045039 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.045241 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.045376 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.045541 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.045629 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.045841 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.045937 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.046137 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.046227 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.046439 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.046533 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.046742 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.046831 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.047040 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.047130 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.047340 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.047438 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.047646 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.047734 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.047947 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.048044 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.048324 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.048416 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.048709 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.048800 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.049011 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.049117 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.049328 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.049677 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.049888 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.049984 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.050186 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.050283 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.050497 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.050587 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.050800 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.050888 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.051099 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.051197 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.051409 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.051498 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.051703 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.051803 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.052004 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.052137 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.052339 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.052427 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.052640 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.052742 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.052938 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.053027 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.053233 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.053324 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.053526 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.053664 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.053823 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.053910 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.054122 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.054210 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.054416 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.054512 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.054711 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.054807 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.055003 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.055091 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.055300 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.055396 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.055603 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.055694 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.055901 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.055989 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.056237 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.056382 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.056536 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.056624 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.056844 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.056933 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.057147 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.057237 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.057452 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.057541 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.057768 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:16:26.057864 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.058103 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.058194 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.058426 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.058513 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.058749 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.058844 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.059060 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.059150 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.059368 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.059456 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.059674 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.059773 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.059993 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.060126 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.060324 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.060413 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.060629 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.060726 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.060934 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.061024 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.061247 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.061344 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.061556 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.061653 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.061870 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.061974 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.062176 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.062265 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.062483 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.062582 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.062796 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.062885 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.063102 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.063231 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.063415 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.063512 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.063736 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.064415 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.064640 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.064731 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.065021 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.065118 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.065360 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.065459 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.065685 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.065774 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.065994 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.066091 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.066313 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.066442 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.066627 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.066716 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.066932 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.067029 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.067251 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.067342 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.067546 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.067635 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.067879 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.067969 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.068211 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.068303 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.068518 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.068607 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.068829 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.068927 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.069134 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.069230 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.069450 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.069539 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.069756 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.069847 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.070060 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.070149 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.070367 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.070464 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.070674 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.070770 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.070977 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.071074 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.071291 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.071396 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.071599 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.071687 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.071907 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.071995 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.072240 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.072340 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.072547 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.072644 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.072858 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.072947 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.073165 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.073265 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.073470 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.073562 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.073776 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.073918 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.074076 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.074174 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.074374 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.074471 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.074672 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.074761 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.074974 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.075072 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.075271 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.075360 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.075577 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.075702 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.075888 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.075978 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.076212 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.076303 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.076534 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.076623 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.076833 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.076922 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.077137 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.077234 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.077447 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.077535 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.077749 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.077840 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.078049 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.078145 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.078355 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.078457 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.078659 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.078748 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.078958 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.079056 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.079269 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.079369 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.080313 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.080414 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.080625 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.080716 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.080947 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.081051 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.081251 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.081349 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.081555 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.081647 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.081865 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.081965 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.082172 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.082261 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.082478 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.082567 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.082788 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.082878 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.083094 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.083190 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.083409 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.083499 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.083717 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.083808 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.084023 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.084131 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.084369 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.084467 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.084686 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.084777 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.084984 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.085079 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.085301 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.085403 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.085622 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.085710 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.085932 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.086019 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.086229 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.086325 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.086533 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.086660 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.086831 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.086920 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.087127 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.087225 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.087429 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.087528 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.087731 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.087826 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.088028 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.088172 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.088351 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.088441 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.088648 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.088745 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.088944 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.089046 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.089241 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.089329 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.089539 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.089636 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.089843 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.089932 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.090140 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.090228 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.090435 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.090523 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.090732 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.090822 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.091040 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.091129 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.091344 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.091432 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.091648 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.091739 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.091987 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.092096 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.092321 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.092433 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.092637 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.092724 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.092944 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.093033 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.093253 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.093352 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.093557 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.093646 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.093863 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.093954 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.094169 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.094271 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.094473 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.094563 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.094788 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.094878 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.095119 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.095225 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.095615 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.095719 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.096033 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.096157 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.096383 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.096492 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.096698 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.096795 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.097020 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.097109 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.097327 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.097415 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.097638 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.097727 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.097978 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.098116 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.098284 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.098370 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.098570 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.098660 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.098894 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.098991 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.099203 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.099293 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.099515 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.099650 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.099818 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.099915 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.100154 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.100288 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.100463 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.100565 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.100769 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.100867 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.101083 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.101181 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.101387 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.101475 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.101697 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.101794 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.102000 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.102087 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.102315 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.102402 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.102620 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.102715 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.102933 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.103021 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.103233 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.103322 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.103541 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.103638 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.103858 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.103946 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.104191 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.104284 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.104498 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.104597 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.104805 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.104893 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.105119 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.105215 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.105426 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.105523 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.105733 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.105821 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.106037 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.106125 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.106336 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.106426 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.106634 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.106722 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.106937 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.107028 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.107242 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.107331 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.107544 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.107631 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.107846 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.107934 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.108168 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.108262 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.108478 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.108569 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.108785 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.108881 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.109083 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.109171 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.109381 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.109470 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.109687 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.109785 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.109991 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.110078 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.110295 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.110390 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.110607 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.110739 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.110970 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.111132 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.111304 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.111480 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.111696 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.111795 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.112020 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.112173 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.112351 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.112448 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.112664 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.112757 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.112987 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.113086 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.113298 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.113386 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.113604 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.113694 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.113908 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.114005 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.114214 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.114303 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.114531 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.114621 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.114847 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.114936 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.115150 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.115239 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.115459 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.115555 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.115765 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.115854 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.116081 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.116190 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.116401 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.116498 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.116713 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.116803 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.117023 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.117128 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.117345 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.117435 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.117657 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.117746 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.117964 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.118061 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.118272 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.118361 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.118583 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.118671 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.118885 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.118986 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.119191 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.119288 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.119496 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.119592 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.119797 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.119887 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.120124 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.120230 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.120438 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.120528 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.120742 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.121009 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.121107 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.121340 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.121430 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.121651 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.121909 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.121999 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.122246 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.122336 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.122566 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.122665 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.122894 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.122993 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.123219 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.123307 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.123528 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.123634 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.123827 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.123918 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.124153 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.124247 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.124457 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.124558 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.124756 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.124845 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.125060 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.125150 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.125361 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.125463 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.125658 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.125755 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.125956 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.126052 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.126762 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.126876 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.127127 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.127285 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.127431 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.127523 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.127729 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.127819 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.128027 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.128155 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.128356 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.128447 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.128654 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.128751 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.128960 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.129063 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.129261 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.129351 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.129576 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.129674 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.129879 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.129977 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.130176 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.130267 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.130475 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.130572 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.130772 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.130874 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.131078 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.131173 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.131382 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.131471 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.131686 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.131777 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.132021 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.132139 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.132350 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.132449 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.132668 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.132765 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.132967 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.133057 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.133285 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.133375 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.133585 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.133676 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.133884 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.134016 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.134183 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.134283 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.134486 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.134575 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.134787 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.134876 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.135084 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.135181 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.135389 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.135492 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.135694 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.135787 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.135994 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.136113 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.136321 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.136410 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.136619 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.136709 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.136920 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.137022 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.137220 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.137310 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.137522 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.137609 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.137824 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.137915 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.138125 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.138224 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.138420 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.138509 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.138722 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.138813 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.139023 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.139119 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.139317 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.139413 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.139619 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.139709 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.139916 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.140006 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.140241 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.140343 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.140537 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.140626 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.140833 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.140922 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.141129 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.141226 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.141431 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.141527 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.141731 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.141820 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.142663 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.142776 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.143026 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.143125 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.143336 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.143425 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.143636 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.143734 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.143932 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.144021 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.144260 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.144351 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.144559 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.144659 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.144857 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.144946 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.145159 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.145247 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.145460 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.145549 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.145766 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.145855 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.146061 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.146156 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.146362 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.146452 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.146660 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.146750 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.146957 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.147046 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.147259 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.147349 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.147560 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.147648 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.147856 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.147952 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.148175 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.148271 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.148470 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.148559 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.148766 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.148868 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.149063 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.149154 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.149363 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.149451 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.149666 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.149765 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.149963 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.150052 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.150259 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.150355 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.150556 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.150655 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.150869 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.150956 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.151172 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.151263 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.151476 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.151648 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.151808 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.151896 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.152136 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.152238 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.152448 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.152538 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.152754 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.152843 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.153061 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.153149 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.153370 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.153460 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.153669 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.153758 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.153977 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.154073 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.154283 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.154386 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.154585 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.154715 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.154881 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.154970 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.155195 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.155327 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.155507 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.155654 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.155809 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.155963 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.156127 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.156294 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.156442 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.156610 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.156754 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.156923 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.157065 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.157244 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.157386 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.157570 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.157733 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.157871 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.158131 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.158266 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.158446 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.158574 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.158757 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.158863 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.159069 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.159158 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.159377 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.159473 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.159687 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.159786 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.159997 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.160108 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.160333 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.160423 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.160648 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.160747 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.160948 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.161045 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.161252 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.161348 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.161554 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.161652 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.161854 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.161944 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.162161 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.162248 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.162462 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.162552 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.162760 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.162856 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.163063 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.163161 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.163362 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.163453 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.163665 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.163762 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.163964 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.164080 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.164304 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.164393 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.164618 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.164706 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.164925 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.165024 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.165287 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.165375 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.165593 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.165682 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.165897 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.166044 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.166209 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.166297 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.166516 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.166662 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.166812 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.166912 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.167154 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.167243 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.167472 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.167562 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.167778 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.167876 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.168126 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.168220 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.168431 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.168532 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.168731 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.168822 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.169036 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.169125 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.169353 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.169443 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.169652 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.169751 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.169949 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.170046 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.170247 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.170347 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.170564 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.170655 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.170860 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.170949 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.171169 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.171267 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.171490 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.171580 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.171798 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.171886 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.172145 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.172249 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.172571 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.172661 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.172875 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.172970 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.173706 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.173817 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.174028 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.174212 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.174661 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.174790 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.174924 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.175108 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.175206 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.175435 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.175534 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.175761 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.175850 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.176110 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.176217 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.176421 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.176512 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.176737 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.176832 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.177048 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.177148 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.177347 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.177444 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.177663 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.177757 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.177982 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.178085 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.178287 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.178377 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.178589 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.178678 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.178915 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.179014 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.179238 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.179328 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.179554 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.179645 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.179876 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.179981 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.180217 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.180308 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.180518 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.180619 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.180818 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.180909 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.181121 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.181233 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.181419 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.181560 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.181716 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.181868 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.182032 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.182175 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.182330 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.182486 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.182633 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.182793 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.182939 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.183102 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.183243 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.183424 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.183532 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.183731 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.183821 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.184044 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.184190 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.184378 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.184470 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.184690 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.184781 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.184995 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.185085 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.185300 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.185390 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.185622 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.185711 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.185920 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.186008 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.186236 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.186327 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.186538 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.186635 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.186836 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.186926 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.187134 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.187224 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.187431 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.187520 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.187764 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.187862 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.188075 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.188166 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.188391 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.188481 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.188692 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.188885 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.189073 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.189163 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.189396 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.189493 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.189721 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.189822 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.190040 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.190132 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.190351 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.190442 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.190656 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.190760 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.190967 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.191058 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.191285 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.191375 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.191586 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.191679 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.191882 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.191971 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.192219 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.192312 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.192519 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.192619 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.192815 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.192906 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.193110 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.193200 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.193412 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.193505 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.193710 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.193807 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.194006 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.194096 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.194301 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.194393 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.194618 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.194717 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.194918 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.195017 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.195221 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.195312 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.195521 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.195610 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.195819 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.195922 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.196140 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.196235 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.196440 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.196530 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.196770 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.196870 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.197064 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.197152 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.197371 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.197470 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.197677 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.197783 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.197981 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.198079 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.198292 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.198383 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.198602 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.198703 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.198913 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.199011 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.199225 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.199314 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.199537 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.199628 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.199847 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.199945 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.200181 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.200329 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.200469 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.200557 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.200781 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.200873 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.201091 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.201181 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.201401 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.201493 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.201717 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.201912 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.202013 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.202237 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.202329 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.202542 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.202631 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.202848 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.202940 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.203152 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.203443 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.203534 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.203755 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.203844 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.204089 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.204197 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.204888 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.205012 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.205262 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.205354 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.205573 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.205706 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.205893 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.206029 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.206212 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.206346 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.206531 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.206660 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.206859 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.206974 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.207170 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.207288 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.207478 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.207624 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.207786 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.207951 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.208114 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.208309 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.208471 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.208646 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.208780 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.208965 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.209082 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.209281 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.209376 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.209597 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.209686 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.209914 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.210020 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.210271 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.210371 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.210576 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.210676 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.210883 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.210983 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.211187 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.211279 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.211489 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.211579 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.211792 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.211890 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.212119 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.212214 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.212430 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.212520 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.212743 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.212833 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.213063 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.213154 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.213376 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.213466 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.213681 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.213771 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.213989 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.214078 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.214298 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.214394 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.214620 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.214811 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.214954 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.215120 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.215276 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.215446 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.215591 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.215766 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.215906 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.216103 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.216253 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.216416 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.216729 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.216817 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.217048 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.217191 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.217401 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.217500 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.217712 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.217802 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.218020 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.218110 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.218329 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.218427 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.218628 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.218717 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.218945 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.219034 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.219251 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.219342 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.219550 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.219640 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.219862 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.219950 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.220246 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.220352 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.220626 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.220946 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.221046 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.221268 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.221434 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.221578 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.221669 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.221898 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.221987 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.222207 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.222298 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.222518 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.222740 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.222831 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.223093 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.223192 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.223412 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.223502 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.223711 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.223799 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.224023 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.224197 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.224356 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.224446 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.224657 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.224748 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.224958 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.225061 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.225263 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.225361 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.225569 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.225658 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.225867 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.225957 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.226172 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.226263 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.226471 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.226568 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.226774 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.226864 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.227084 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.227172 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.227384 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.227472 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.227688 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.227777 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.227994 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.228136 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.228322 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.228419 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.228621 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.228718 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.228921 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.229011 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.229221 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.229320 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.229529 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.229621 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.229827 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.229917 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.230135 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.230271 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.230436 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.230526 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.230741 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.230833 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.231047 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.231147 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.231360 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.231450 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.231665 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.231753 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.231974 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.232105 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.232299 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.232388 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.232598 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.232688 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.232909 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.233009 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.233213 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.233304 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.233529 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.233618 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.233835 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.233925 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.234140 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.234229 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.234443 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.234538 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.234759 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.234856 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.235070 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.235290 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.235389 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.235620 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.236257 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.236485 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.236576 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.236813 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.236959 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.237138 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.237279 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.237442 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.237744 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.237834 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.238043 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.238156 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.238364 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.238459 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.238668 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.238759 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.238983 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.239082 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.239287 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.239376 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.239591 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.239687 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.239896 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.239996 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.240284 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.240435 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.240591 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.240727 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.240895 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.240987 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.241200 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.241299 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.241503 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.241593 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.241806 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.241897 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.242109 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.242198 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.242410 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.242499 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.242712 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.242804 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.243020 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.243121 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.243332 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.243434 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.243643 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.243742 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.243953 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.244043 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.244286 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.244390 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.244595 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.244685 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.244899 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.244989 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.245203 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.245302 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.245506 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.245595 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.245809 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.245912 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.246118 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.246210 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.246442 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.246540 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.246749 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.246838 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.247048 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.247138 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.247357 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.247667 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.247757 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.247984 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.248104 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.248339 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.248431 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.248654 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.248751 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.248962 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.249061 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.249280 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.249603 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.249693 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.249913 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.250017 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.250231 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.250322 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.250539 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.250628 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.250857 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.251025 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.251183 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.251334 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.251586 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.251678 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.251912 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.252015 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.252226 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.252318 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.252529 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.252619 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.252829 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.252921 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.253134 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.253226 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.253448 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.253539 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.253752 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.253852 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.254052 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.254149 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.254351 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.254440 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.254654 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.254745 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.254952 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.255041 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.255252 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.255352 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.255551 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.255640 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.255849 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.255940 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.256176 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.256282 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.256477 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.256567 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.256775 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.256864 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.257073 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.257171 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.257371 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.257462 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.257671 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.257769 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.257969 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.258068 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.258272 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.258410 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.258568 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.258657 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.258871 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.258960 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.259167 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.259263 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.259464 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.259564 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.259761 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.259852 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.260111 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.260217 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.260392 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.260482 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.260698 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.260790 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.261004 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.261101 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.261309 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.261399 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.261616 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.261750 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.261915 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.262012 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.262228 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.262333 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.262542 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.262633 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.262849 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.262946 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.263149 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.263248 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.263474 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.263563 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.263775 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.263878 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.264099 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.264205 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.264410 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.264507 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.264716 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.264805 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.265019 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.265122 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.265323 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.265414 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.265646 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.265734 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.265960 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.266059 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.266258 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.266347 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.266571 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.266659 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.267393 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.267496 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.267818 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.267908 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.268162 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.268255 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.268477 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.268577 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.268801 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.268890 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.269108 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.269211 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.269421 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.269511 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.269727 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.269859 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.270034 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.270134 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.270340 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.270430 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.270651 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.270740 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.270956 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.271055 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.271262 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.271352 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.271571 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.271660 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.271884 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.271975 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.272221 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.272324 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.272539 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.272630 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.272843 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.272935 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.273160 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.273250 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.273477 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.273565 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.273790 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.273880 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.274111 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.274201 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.274435 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.274534 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.274745 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.274836 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.275053 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.275149 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.275358 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.275458 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.275657 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.275754 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.275894 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 18:16:26.276018 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.276409 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.276742 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.277060 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.277377 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.277685 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:16:26.277929 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 18:16:26.430793 n-d-850501-14 devstack@n-api.service[106929]: INFO dbcounter [None req-658bdfa8-9a0f-4d49-aeb8-22d324493a50 None None] Registered counter for database nova_api Oct 04 18:16:26.432409 n-d-850501-14 devstack@n-api.service[106928]: INFO dbcounter [None req-4ed3b059-42c9-4bbe-89d5-7aa9017f1e79 None None] Registered counter for database nova_api Oct 04 18:16:26.451535 n-d-850501-14 devstack@n-api.service[106929]: DEBUG oslo_db.sqlalchemy.engines [None req-658bdfa8-9a0f-4d49-aeb8-22d324493a50 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106929) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 18:16:26.453340 n-d-850501-14 devstack@n-api.service[106928]: DEBUG oslo_db.sqlalchemy.engines [None req-4ed3b059-42c9-4bbe-89d5-7aa9017f1e79 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106928) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 18:16:26.458868 n-d-850501-14 devstack@n-api.service[106929]: DEBUG dbcounter [-] [106929] Writer thread running {{(pid=106929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 18:16:26.461616 n-d-850501-14 devstack@n-api.service[106928]: DEBUG dbcounter [-] [106928] Writer thread running {{(pid=106928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 18:16:26.514452 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.context [None req-658bdfa8-9a0f-4d49-aeb8-22d324493a50 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a6039a6d-a98c-44a9-819b-4eff388d8aa7(cell1) {{(pid=106929) load_cells /opt/stack/nova/nova/context.py:464}} Oct 04 18:16:26.518280 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.context [None req-4ed3b059-42c9-4bbe-89d5-7aa9017f1e79 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a6039a6d-a98c-44a9-819b-4eff388d8aa7(cell1) {{(pid=106928) load_cells /opt/stack/nova/nova/context.py:464}} Oct 04 18:16:26.518835 n-d-850501-14 devstack@n-api.service[106929]: DEBUG oslo_concurrency.lockutils [None req-658bdfa8-9a0f-4d49-aeb8-22d324493a50 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:26.519305 n-d-850501-14 devstack@n-api.service[106929]: DEBUG oslo_concurrency.lockutils [None req-658bdfa8-9a0f-4d49-aeb8-22d324493a50 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:26.520990 n-d-850501-14 devstack@n-api.service[106929]: DEBUG oslo_concurrency.lockutils [None req-658bdfa8-9a0f-4d49-aeb8-22d324493a50 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:26.521711 n-d-850501-14 devstack@n-api.service[106929]: DEBUG oslo_concurrency.lockutils [None req-658bdfa8-9a0f-4d49-aeb8-22d324493a50 None None] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:26.522116 n-d-850501-14 devstack@n-api.service[106928]: DEBUG oslo_concurrency.lockutils [None req-4ed3b059-42c9-4bbe-89d5-7aa9017f1e79 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:26.522213 n-d-850501-14 devstack@n-api.service[106929]: DEBUG oslo_concurrency.lockutils [None req-658bdfa8-9a0f-4d49-aeb8-22d324493a50 None None] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:26.522590 n-d-850501-14 devstack@n-api.service[106928]: DEBUG oslo_concurrency.lockutils [None req-4ed3b059-42c9-4bbe-89d5-7aa9017f1e79 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:26.524113 n-d-850501-14 devstack@n-api.service[106929]: DEBUG oslo_concurrency.lockutils [None req-658bdfa8-9a0f-4d49-aeb8-22d324493a50 None None] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:26.524303 n-d-850501-14 devstack@n-api.service[106928]: DEBUG oslo_concurrency.lockutils [None req-4ed3b059-42c9-4bbe-89d5-7aa9017f1e79 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:26.524906 n-d-850501-14 devstack@n-api.service[106928]: DEBUG oslo_concurrency.lockutils [None req-4ed3b059-42c9-4bbe-89d5-7aa9017f1e79 None None] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:26.525349 n-d-850501-14 devstack@n-api.service[106928]: DEBUG oslo_concurrency.lockutils [None req-4ed3b059-42c9-4bbe-89d5-7aa9017f1e79 None None] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:26.526084 n-d-850501-14 devstack@n-api.service[106929]: INFO dbcounter [None req-658bdfa8-9a0f-4d49-aeb8-22d324493a50 None None] Registered counter for database nova_cell0 Oct 04 18:16:26.527344 n-d-850501-14 devstack@n-api.service[106928]: DEBUG oslo_concurrency.lockutils [None req-4ed3b059-42c9-4bbe-89d5-7aa9017f1e79 None None] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:26.529473 n-d-850501-14 devstack@n-api.service[106928]: INFO dbcounter [None req-4ed3b059-42c9-4bbe-89d5-7aa9017f1e79 None None] Registered counter for database nova_cell0 Oct 04 18:16:26.530074 n-d-850501-14 devstack@n-api.service[106929]: INFO dbcounter [None req-658bdfa8-9a0f-4d49-aeb8-22d324493a50 None None] Registered counter for database nova_cell1 Oct 04 18:16:26.534227 n-d-850501-14 devstack@n-api.service[106928]: INFO dbcounter [None req-4ed3b059-42c9-4bbe-89d5-7aa9017f1e79 None None] Registered counter for database nova_cell1 Oct 04 18:16:26.537926 n-d-850501-14 devstack@n-api.service[106929]: DEBUG oslo_db.sqlalchemy.engines [None req-658bdfa8-9a0f-4d49-aeb8-22d324493a50 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106929) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 18:16:26.539269 n-d-850501-14 devstack@n-api.service[106929]: DEBUG oslo_db.sqlalchemy.engines [None req-658bdfa8-9a0f-4d49-aeb8-22d324493a50 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106929) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 18:16:26.541715 n-d-850501-14 devstack@n-api.service[106928]: DEBUG oslo_db.sqlalchemy.engines [None req-4ed3b059-42c9-4bbe-89d5-7aa9017f1e79 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106928) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 18:16:26.543866 n-d-850501-14 devstack@n-api.service[106928]: DEBUG oslo_db.sqlalchemy.engines [None req-4ed3b059-42c9-4bbe-89d5-7aa9017f1e79 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106928) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 18:16:26.545614 n-d-850501-14 devstack@n-api.service[106929]: DEBUG dbcounter [-] [106929] Writer thread running {{(pid=106929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 18:16:26.550084 n-d-850501-14 devstack@n-api.service[106928]: DEBUG dbcounter [-] [106928] Writer thread running {{(pid=106928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 18:16:26.551899 n-d-850501-14 devstack@n-api.service[106929]: DEBUG dbcounter [-] [106929] Writer thread running {{(pid=106929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 18:16:26.552357 n-d-850501-14 devstack@n-api.service[106928]: DEBUG dbcounter [-] [106928] Writer thread running {{(pid=106928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 18:16:26.697705 n-d-850501-14 devstack@n-api.service[106929]: INFO dbcounter [None req-658bdfa8-9a0f-4d49-aeb8-22d324493a50 None None] Registered counter for database nova_cell0 Oct 04 18:16:26.700329 n-d-850501-14 devstack@n-api.service[106928]: INFO dbcounter [None req-4ed3b059-42c9-4bbe-89d5-7aa9017f1e79 None None] Registered counter for database nova_cell0 Oct 04 18:16:26.704543 n-d-850501-14 devstack@n-api.service[106929]: DEBUG oslo_db.sqlalchemy.engines [None req-658bdfa8-9a0f-4d49-aeb8-22d324493a50 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106929) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 18:16:26.709143 n-d-850501-14 devstack@n-api.service[106929]: DEBUG dbcounter [-] [106929] Writer thread running {{(pid=106929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 18:16:26.709728 n-d-850501-14 devstack@n-api.service[106928]: DEBUG oslo_db.sqlalchemy.engines [None req-4ed3b059-42c9-4bbe-89d5-7aa9017f1e79 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106928) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 18:16:26.714120 n-d-850501-14 devstack@n-api.service[106928]: DEBUG dbcounter [-] [106928] Writer thread running {{(pid=106928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 18:16:27.140718 n-d-850501-14 devstack@n-api.service[106929]: WARNING keystonemiddleware.auth_token [None req-658bdfa8-9a0f-4d49-aeb8-22d324493a50 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 18:16:27.148796 n-d-850501-14 devstack@n-api.service[106929]: WARNING keystonemiddleware.auth_token [None req-658bdfa8-9a0f-4d49-aeb8-22d324493a50 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 18:16:27.155726 n-d-850501-14 devstack@n-api.service[106928]: WARNING keystonemiddleware.auth_token [None req-4ed3b059-42c9-4bbe-89d5-7aa9017f1e79 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 18:16:27.163782 n-d-850501-14 devstack@n-api.service[106928]: WARNING keystonemiddleware.auth_token [None req-4ed3b059-42c9-4bbe-89d5-7aa9017f1e79 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 18:16:27.497333 n-d-850501-14 devstack@n-api.service[106929]: WARNING keystonemiddleware.auth_token [None req-658bdfa8-9a0f-4d49-aeb8-22d324493a50 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 18:16:27.503854 n-d-850501-14 devstack@n-api.service[106929]: WARNING keystonemiddleware.auth_token [None req-658bdfa8-9a0f-4d49-aeb8-22d324493a50 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 18:16:27.507250 n-d-850501-14 devstack@n-api.service[106928]: WARNING keystonemiddleware.auth_token [None req-4ed3b059-42c9-4bbe-89d5-7aa9017f1e79 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 18:16:27.509133 n-d-850501-14 devstack@n-api.service[106929]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d0dd36f9c0 pid: 106929 (default app) Oct 04 18:16:27.511193 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi [None req-658bdfa8-9a0f-4d49-aeb8-22d324493a50 None None] Calling method '>' {{(pid=106929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:27.512515 n-d-850501-14 devstack@n-api.service[106929]: INFO nova.api.openstack.requestlog [None req-658bdfa8-9a0f-4d49-aeb8-22d324493a50 None None] 10.222.0.20 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001825 Oct 04 18:16:27.512933 n-d-850501-14 devstack@n-api.service[106929]: [pid: 106929|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 788 bytes} [Tue Oct 4 18:16:27 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:27.513186 n-d-850501-14 devstack@n-api.service[106928]: WARNING keystonemiddleware.auth_token [None req-4ed3b059-42c9-4bbe-89d5-7aa9017f1e79 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 18:16:27.518494 n-d-850501-14 devstack@n-api.service[106928]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d0dd36f9c0 pid: 106928 (default app) Oct 04 18:17:52.935473 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi [None req-658bdfa8-9a0f-4d49-aeb8-22d324493a50 None None] Calling method '>' {{(pid=106929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:52.937125 n-d-850501-14 devstack@n-api.service[106929]: INFO nova.api.openstack.requestlog [None req-658bdfa8-9a0f-4d49-aeb8-22d324493a50 None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002106 Oct 04 18:17:52.942800 n-d-850501-14 devstack@n-api.service[106929]: [pid: 106929|app: 0|req: 2/2] 10.222.0.20 () {54 vars in 931 bytes} [Tue Oct 4 18:17:52 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:17:52.951376 n-d-850501-14 devstack@n-api.service[106928]: DEBUG dbcounter [-] [106928] Writing DB stats nova_api:SELECT=3 {{(pid=106928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:52.952676 n-d-850501-14 devstack@n-api.service[106928]: DEBUG dbcounter [-] [106928] Writing DB stats nova_cell1:SELECT=3 {{(pid=106928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:52.953543 n-d-850501-14 devstack@n-api.service[106928]: DEBUG dbcounter [-] [106928] Writing DB stats nova_cell0:SELECT=3 {{(pid=106928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:52.954428 n-d-850501-14 devstack@n-api.service[106928]: DEBUG dbcounter [-] [106928] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:53.876836 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi [None req-cc380e00-a6a8-409f-9bcd-5a2f708f245e admin admin] Calling method '>' {{(pid=106928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:53.911291 n-d-850501-14 devstack@n-api.service[106928]: INFO nova.api.openstack.requestlog [None req-cc380e00-a6a8-409f-9bcd-5a2f708f245e admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.966512 Oct 04 18:17:53.912296 n-d-850501-14 devstack@n-api.service[106928]: [pid: 106928|app: 0|req: 1/3] 10.222.0.20 () {60 vars in 1292 bytes} [Tue Oct 4 18:17:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:17:56.570777 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi [None req-658bdfa8-9a0f-4d49-aeb8-22d324493a50 None None] Calling method '>' {{(pid=106929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:56.572753 n-d-850501-14 devstack@n-api.service[106929]: INFO nova.api.openstack.requestlog [None req-658bdfa8-9a0f-4d49-aeb8-22d324493a50 None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002392 Oct 04 18:17:56.573743 n-d-850501-14 devstack@n-api.service[106929]: [pid: 106929|app: 0|req: 3/4] 10.222.0.20 () {54 vars in 931 bytes} [Tue Oct 4 18:17:56 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:17:57.028808 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi [None req-56ac3fbb-5e9d-416c-b9b7-7a11b242ebdd admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "disk": 1, "id": "c1", "name": "cirros256"}} {{(pid=106928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:57.141782 n-d-850501-14 devstack@n-api.service[106928]: INFO nova.api.openstack.requestlog [None req-56ac3fbb-5e9d-416c-b9b7-7a11b242ebdd admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.560651 Oct 04 18:17:57.142335 n-d-850501-14 devstack@n-api.service[106928]: [pid: 106928|app: 0|req: 2/5] 10.222.0.20 () {64 vars in 1283 bytes} [Tue Oct 4 18:17:56 2022] POST /compute/v2.1/flavors => generated 407 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 18:17:57.157841 n-d-850501-14 devstack@n-api.service[106929]: DEBUG dbcounter [-] [106929] Writing DB stats nova_api:SELECT=3 {{(pid=106929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:57.159790 n-d-850501-14 devstack@n-api.service[106929]: DEBUG dbcounter [-] [106929] Writing DB stats nova_cell0:SELECT=3 {{(pid=106929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:57.159790 n-d-850501-14 devstack@n-api.service[106929]: DEBUG dbcounter [-] [106929] Writing DB stats nova_cell1:SELECT=3 {{(pid=106929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:57.161168 n-d-850501-14 devstack@n-api.service[106929]: DEBUG dbcounter [-] [106929] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:57.368317 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi [None req-b7a90c42-6d7f-4289-ab91-a3ef16bbd028 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:57.493841 n-d-850501-14 devstack@n-api.service[106929]: INFO nova.api.openstack.requestlog [None req-b7a90c42-6d7f-4289-ab91-a3ef16bbd028 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.342868 Oct 04 18:17:57.494435 n-d-850501-14 devstack@n-api.service[106929]: [pid: 106929|app: 0|req: 4/6] 10.222.0.20 () {64 vars in 1336 bytes} [Tue Oct 4 18:17:57 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:00.247402 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi [None req-56ac3fbb-5e9d-416c-b9b7-7a11b242ebdd admin admin] Calling method '>' {{(pid=106928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:00.249163 n-d-850501-14 devstack@n-api.service[106928]: INFO nova.api.openstack.requestlog [None req-56ac3fbb-5e9d-416c-b9b7-7a11b242ebdd admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.004482 Oct 04 18:18:00.249571 n-d-850501-14 devstack@n-api.service[106928]: [pid: 106928|app: 0|req: 3/7] 10.222.0.20 () {54 vars in 931 bytes} [Tue Oct 4 18:18:00 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:18:01.130703 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi [None req-dd1ee71a-45a8-421e-8019-585e58604259 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "id": "d1", "swap": 0, "rxtx_factor": 1.0, "name": "ds512M"}} {{(pid=106929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:01.288651 n-d-850501-14 devstack@n-api.service[106929]: INFO nova.api.openstack.requestlog [None req-dd1ee71a-45a8-421e-8019-585e58604259 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 1.028885 Oct 04 18:18:01.300309 n-d-850501-14 devstack@n-api.service[106929]: [pid: 106929|app: 0|req: 5/8] 10.222.0.20 () {64 vars in 1283 bytes} [Tue Oct 4 18:18:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:18:01.320583 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi [None req-4ad68d3d-17a5-490c-a597-fdc091a9b279 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:01.469580 n-d-850501-14 devstack@n-api.service[106928]: INFO nova.api.openstack.requestlog [None req-4ad68d3d-17a5-490c-a597-fdc091a9b279 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.167728 Oct 04 18:18:01.488088 n-d-850501-14 devstack@n-api.service[106928]: [pid: 106928|app: 0|req: 4/9] 10.222.0.20 () {64 vars in 1336 bytes} [Tue Oct 4 18:18:01 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:04.595569 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi [None req-dd1ee71a-45a8-421e-8019-585e58604259 admin admin] Calling method '>' {{(pid=106929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:04.596536 n-d-850501-14 devstack@n-api.service[106929]: INFO nova.api.openstack.requestlog [None req-dd1ee71a-45a8-421e-8019-585e58604259 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Oct 04 18:18:04.596933 n-d-850501-14 devstack@n-api.service[106929]: [pid: 106929|app: 0|req: 6/10] 10.222.0.20 () {54 vars in 931 bytes} [Tue Oct 4 18:18:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:18:05.047925 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi [None req-0d463f4b-759d-4bf2-a864-e6fba9ff0416 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "ds1G", "swap": 0, "disk": 10, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "vcpus": 1, "ram": 1024}} {{(pid=106928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:05.130730 n-d-850501-14 devstack@n-api.service[106928]: INFO nova.api.openstack.requestlog [None req-0d463f4b-759d-4bf2-a864-e6fba9ff0416 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.527710 Oct 04 18:18:05.131541 n-d-850501-14 devstack@n-api.service[106928]: [pid: 106928|app: 0|req: 5/11] 10.222.0.20 () {64 vars in 1283 bytes} [Tue Oct 4 18:18:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:18:05.144418 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi [None req-dce244a5-0ddc-4245-ab56-206680c957cb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:05.224369 n-d-850501-14 devstack@n-api.service[106929]: INFO nova.api.openstack.requestlog [None req-dce244a5-0ddc-4245-ab56-206680c957cb admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.082159 Oct 04 18:18:05.232320 n-d-850501-14 devstack@n-api.service[106929]: [pid: 106929|app: 0|req: 7/12] 10.222.0.20 () {64 vars in 1336 bytes} [Tue Oct 4 18:18:05 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:18:07.900474 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi [None req-0d463f4b-759d-4bf2-a864-e6fba9ff0416 admin admin] Calling method '>' {{(pid=106928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:07.902303 n-d-850501-14 devstack@n-api.service[106928]: INFO nova.api.openstack.requestlog [None req-0d463f4b-759d-4bf2-a864-e6fba9ff0416 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002566 Oct 04 18:18:07.903022 n-d-850501-14 devstack@n-api.service[106928]: [pid: 106928|app: 0|req: 6/13] 10.222.0.20 () {54 vars in 931 bytes} [Tue Oct 4 18:18:07 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:18:08.389129 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi [None req-d8c0b6cc-6e2c-42f7-acb4-66221f6b1fd4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "name": "ds2G", "id": "d3", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "disk": 10, "swap": 0}} {{(pid=106929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:08.461880 n-d-850501-14 devstack@n-api.service[106929]: INFO nova.api.openstack.requestlog [None req-d8c0b6cc-6e2c-42f7-acb4-66221f6b1fd4 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.551359 Oct 04 18:18:08.463038 n-d-850501-14 devstack@n-api.service[106929]: [pid: 106929|app: 0|req: 8/14] 10.222.0.20 () {64 vars in 1283 bytes} [Tue Oct 4 18:18:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:18:08.476740 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi [None req-b87448d6-773a-4b35-8a41-2c8d9b467f9b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:08.550849 n-d-850501-14 devstack@n-api.service[106928]: INFO nova.api.openstack.requestlog [None req-b87448d6-773a-4b35-8a41-2c8d9b467f9b admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.077532 Oct 04 18:18:08.551536 n-d-850501-14 devstack@n-api.service[106928]: [pid: 106928|app: 0|req: 7/15] 10.222.0.20 () {64 vars in 1336 bytes} [Tue Oct 4 18:18:08 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:11.323357 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi [None req-d8c0b6cc-6e2c-42f7-acb4-66221f6b1fd4 admin admin] Calling method '>' {{(pid=106929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:11.325591 n-d-850501-14 devstack@n-api.service[106929]: INFO nova.api.openstack.requestlog [None req-d8c0b6cc-6e2c-42f7-acb4-66221f6b1fd4 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002578 Oct 04 18:18:11.326172 n-d-850501-14 devstack@n-api.service[106929]: [pid: 106929|app: 0|req: 9/16] 10.222.0.20 () {54 vars in 931 bytes} [Tue Oct 4 18:18:11 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:18:11.765113 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi [None req-d7068fe7-567e-4736-a27b-0c9649d47cb6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "ram": 4096, "name": "ds4G", "id": "d4", "rxtx_factor": 1.0}} {{(pid=106928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:11.834326 n-d-850501-14 devstack@n-api.service[106928]: INFO nova.api.openstack.requestlog [None req-d7068fe7-567e-4736-a27b-0c9649d47cb6 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.501361 Oct 04 18:18:11.849799 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi [None req-e8b157b3-f736-4f52-9938-3f6ae1bf876c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:11.855819 n-d-850501-14 devstack@n-api.service[106928]: [pid: 106928|app: 0|req: 8/17] 10.222.0.20 () {64 vars in 1283 bytes} [Tue Oct 4 18:18:11 2022] POST /compute/v2.1/flavors => generated 404 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:18:11.925071 n-d-850501-14 devstack@n-api.service[106929]: INFO nova.api.openstack.requestlog [None req-e8b157b3-f736-4f52-9938-3f6ae1bf876c admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.079560 Oct 04 18:18:11.925920 n-d-850501-14 devstack@n-api.service[106929]: [pid: 106929|app: 0|req: 10/18] 10.222.0.20 () {64 vars in 1336 bytes} [Tue Oct 4 18:18:11 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:14.648339 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi [None req-d7068fe7-567e-4736-a27b-0c9649d47cb6 admin admin] Calling method '>' {{(pid=106928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:14.649458 n-d-850501-14 devstack@n-api.service[106928]: INFO nova.api.openstack.requestlog [None req-d7068fe7-567e-4736-a27b-0c9649d47cb6 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001529 Oct 04 18:18:14.649872 n-d-850501-14 devstack@n-api.service[106928]: [pid: 106928|app: 0|req: 9/19] 10.222.0.20 () {54 vars in 931 bytes} [Tue Oct 4 18:18:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:18:15.058843 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi [None req-97a12b7d-2280-4bbd-b1f0-9f29738d6d26 admin admin] Calling method '>' {{(pid=106929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:15.084114 n-d-850501-14 devstack@n-api.service[106929]: INFO nova.api.openstack.requestlog [None req-97a12b7d-2280-4bbd-b1f0-9f29738d6d26 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.427196 Oct 04 18:18:15.084665 n-d-850501-14 devstack@n-api.service[106929]: [pid: 106929|app: 0|req: 11/20] 10.222.0.20 () {60 vars in 1292 bytes} [Tue Oct 4 18:18:14 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:18:18.048304 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi [None req-d7068fe7-567e-4736-a27b-0c9649d47cb6 admin admin] Calling method '>' {{(pid=106928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:18.049883 n-d-850501-14 devstack@n-api.service[106928]: INFO nova.api.openstack.requestlog [None req-d7068fe7-567e-4736-a27b-0c9649d47cb6 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002185 Oct 04 18:18:18.050375 n-d-850501-14 devstack@n-api.service[106928]: [pid: 106928|app: 0|req: 10/21] 10.222.0.20 () {54 vars in 931 bytes} [Tue Oct 4 18:18:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:18:18.513942 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi [None req-97af43b0-7871-4544-890c-37de97cf1d66 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "disk": 1, "os-flavor-access:is_public": true, "id": "1", "swap": 0, "name": "m1.tiny"}} {{(pid=106929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:18.597313 n-d-850501-14 devstack@n-api.service[106929]: INFO nova.api.openstack.requestlog [None req-97af43b0-7871-4544-890c-37de97cf1d66 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.539249 Oct 04 18:18:18.597997 n-d-850501-14 devstack@n-api.service[106929]: [pid: 106929|app: 0|req: 12/22] 10.222.0.20 () {64 vars in 1283 bytes} [Tue Oct 4 18:18:18 2022] POST /compute/v2.1/flavors => generated 402 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:18:18.612871 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi [None req-b95008aa-ad49-4e92-8771-66e6da74002e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:18.676633 n-d-850501-14 devstack@n-api.service[106928]: INFO nova.api.openstack.requestlog [None req-b95008aa-ad49-4e92-8771-66e6da74002e admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.067358 Oct 04 18:18:18.677161 n-d-850501-14 devstack@n-api.service[106928]: [pid: 106928|app: 0|req: 11/23] 10.222.0.20 () {64 vars in 1333 bytes} [Tue Oct 4 18:18:18 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:21.492429 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi [None req-97af43b0-7871-4544-890c-37de97cf1d66 admin admin] Calling method '>' {{(pid=106929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:21.493673 n-d-850501-14 devstack@n-api.service[106929]: INFO nova.api.openstack.requestlog [None req-97af43b0-7871-4544-890c-37de97cf1d66 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001718 Oct 04 18:18:21.494161 n-d-850501-14 devstack@n-api.service[106929]: [pid: 106929|app: 0|req: 13/24] 10.222.0.20 () {54 vars in 931 bytes} [Tue Oct 4 18:18:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:18:21.908991 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi [None req-6b885aaa-536f-47d7-a777-ee136322ae3c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "id": "2", "vcpus": 1, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "disk": 20, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:21.987454 n-d-850501-14 devstack@n-api.service[106928]: INFO nova.api.openstack.requestlog [None req-6b885aaa-536f-47d7-a777-ee136322ae3c admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.485387 Oct 04 18:18:21.988205 n-d-850501-14 devstack@n-api.service[106928]: [pid: 106928|app: 0|req: 12/25] 10.222.0.20 () {64 vars in 1283 bytes} [Tue Oct 4 18:18:21 2022] POST /compute/v2.1/flavors => generated 405 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:18:22.003682 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi [None req-8c435f53-8701-4d5c-b942-113a6b00cfa6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:22.076441 n-d-850501-14 devstack@n-api.service[106929]: INFO nova.api.openstack.requestlog [None req-8c435f53-8701-4d5c-b942-113a6b00cfa6 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.077177 Oct 04 18:18:22.077019 n-d-850501-14 devstack@n-api.service[106929]: [pid: 106929|app: 0|req: 14/26] 10.222.0.20 () {64 vars in 1333 bytes} [Tue Oct 4 18:18:21 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:18:24.711424 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi [None req-6b885aaa-536f-47d7-a777-ee136322ae3c admin admin] Calling method '>' {{(pid=106928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:24.712381 n-d-850501-14 devstack@n-api.service[106928]: INFO nova.api.openstack.requestlog [None req-6b885aaa-536f-47d7-a777-ee136322ae3c admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Oct 04 18:18:24.712870 n-d-850501-14 devstack@n-api.service[106928]: [pid: 106928|app: 0|req: 13/27] 10.222.0.20 () {54 vars in 931 bytes} [Tue Oct 4 18:18:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:18:25.163247 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi [None req-2db9e2cf-fde5-4335-9c50-bad07588fb4d admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "3", "disk": 40, "rxtx_factor": 1.0, "ram": 4096, "swap": 0}} {{(pid=106929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:25.937084 n-d-850501-14 devstack@n-api.service[106929]: INFO nova.api.openstack.requestlog [None req-2db9e2cf-fde5-4335-9c50-bad07588fb4d admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 1.214530 Oct 04 18:18:25.938313 n-d-850501-14 devstack@n-api.service[106929]: [pid: 106929|app: 0|req: 15/28] 10.222.0.20 () {64 vars in 1283 bytes} [Tue Oct 4 18:18:24 2022] POST /compute/v2.1/flavors => generated 406 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:18:25.955501 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi [None req-d1e713af-487a-47ad-86f1-0a0cb16ad1fe admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:25.961878 n-d-850501-14 devstack@n-api.service[106928]: DEBUG dbcounter [-] [106928] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=106928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:18:26.036434 n-d-850501-14 devstack@n-api.service[106928]: INFO nova.api.openstack.requestlog [None req-d1e713af-487a-47ad-86f1-0a0cb16ad1fe admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.088067 Oct 04 18:18:26.044956 n-d-850501-14 devstack@n-api.service[106928]: [pid: 106928|app: 0|req: 14/29] 10.222.0.20 () {64 vars in 1333 bytes} [Tue Oct 4 18:18:25 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:28.767571 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi [None req-2db9e2cf-fde5-4335-9c50-bad07588fb4d admin admin] Calling method '>' {{(pid=106929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:28.769266 n-d-850501-14 devstack@n-api.service[106929]: INFO nova.api.openstack.requestlog [None req-2db9e2cf-fde5-4335-9c50-bad07588fb4d admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002142 Oct 04 18:18:28.769839 n-d-850501-14 devstack@n-api.service[106929]: [pid: 106929|app: 0|req: 16/30] 10.222.0.20 () {54 vars in 931 bytes} [Tue Oct 4 18:18:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:18:29.211584 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi [None req-73d4ed4c-8cc3-41c2-9785-07aee3d7a1dd admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 4, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.large", "ram": 8192}} {{(pid=106928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:29.291051 n-d-850501-14 devstack@n-api.service[106928]: INFO nova.api.openstack.requestlog [None req-73d4ed4c-8cc3-41c2-9785-07aee3d7a1dd admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.514766 Oct 04 18:18:29.292190 n-d-850501-14 devstack@n-api.service[106928]: [pid: 106928|app: 0|req: 15/31] 10.222.0.20 () {64 vars in 1283 bytes} [Tue Oct 4 18:18:28 2022] POST /compute/v2.1/flavors => generated 405 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:18:29.305049 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi [None req-0e162419-0f6b-49fd-8124-243404b008ac admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:29.405737 n-d-850501-14 devstack@n-api.service[106929]: INFO nova.api.openstack.requestlog [None req-0e162419-0f6b-49fd-8124-243404b008ac admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.104484 Oct 04 18:18:29.407098 n-d-850501-14 devstack@n-api.service[106929]: [pid: 106929|app: 0|req: 17/32] 10.222.0.20 () {64 vars in 1333 bytes} [Tue Oct 4 18:18:29 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:32.065914 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi [None req-73d4ed4c-8cc3-41c2-9785-07aee3d7a1dd admin admin] Calling method '>' {{(pid=106928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:32.066928 n-d-850501-14 devstack@n-api.service[106928]: INFO nova.api.openstack.requestlog [None req-73d4ed4c-8cc3-41c2-9785-07aee3d7a1dd admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Oct 04 18:18:32.067502 n-d-850501-14 devstack@n-api.service[106928]: [pid: 106928|app: 0|req: 16/33] 10.222.0.20 () {54 vars in 931 bytes} [Tue Oct 4 18:18:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:18:32.524149 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi [None req-e0d3f013-c6f7-429e-80aa-10b834fd9bab admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "m1.xlarge", "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "id": "5", "os-flavor-access:is_public": true, "vcpus": 8, "swap": 0}} {{(pid=106929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:32.532463 n-d-850501-14 devstack@n-api.service[106929]: DEBUG dbcounter [-] [106929] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=106929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:18:32.644831 n-d-850501-14 devstack@n-api.service[106929]: INFO nova.api.openstack.requestlog [None req-e0d3f013-c6f7-429e-80aa-10b834fd9bab admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.570016 Oct 04 18:18:32.645696 n-d-850501-14 devstack@n-api.service[106929]: [pid: 106929|app: 0|req: 18/34] 10.222.0.20 () {64 vars in 1283 bytes} [Tue Oct 4 18:18:32 2022] POST /compute/v2.1/flavors => generated 408 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 18:18:32.658723 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi [None req-81363a9d-fcd3-4b92-8edb-9196fc3dfc4b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:32.747816 n-d-850501-14 devstack@n-api.service[106928]: INFO nova.api.openstack.requestlog [None req-81363a9d-fcd3-4b92-8edb-9196fc3dfc4b admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.092899 Oct 04 18:18:32.752457 n-d-850501-14 devstack@n-api.service[106928]: [pid: 106928|app: 0|req: 17/35] 10.222.0.20 () {64 vars in 1333 bytes} [Tue Oct 4 18:18:32 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:52.783118 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi [None req-e0d3f013-c6f7-429e-80aa-10b834fd9bab admin admin] Calling method '>' {{(pid=106929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:52.784153 n-d-850501-14 devstack@n-api.service[106929]: INFO nova.api.openstack.requestlog [None req-e0d3f013-c6f7-429e-80aa-10b834fd9bab admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Oct 04 18:18:52.784547 n-d-850501-14 devstack@n-api.service[106929]: [pid: 106929|app: 0|req: 19/36] 10.222.0.20 () {54 vars in 931 bytes} [Tue Oct 4 18:18:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:18:52.795434 n-d-850501-14 devstack@n-api.service[106928]: DEBUG dbcounter [-] [106928] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=106928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:18:53.201161 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi [None req-85cbfb65-cac1-4106-a299-12b2c34e9711 admin admin] Calling method '>' {{(pid=106928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:53.218853 n-d-850501-14 devstack@n-api.service[106928]: INFO nova.api.openstack.requestlog [None req-85cbfb65-cac1-4106-a299-12b2c34e9711 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.428491 Oct 04 18:18:53.219382 n-d-850501-14 devstack@n-api.service[106928]: [pid: 106928|app: 0|req: 18/37] 10.222.0.20 () {60 vars in 1292 bytes} [Tue Oct 4 18:18:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:18:54.527163 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi [None req-e0d3f013-c6f7-429e-80aa-10b834fd9bab admin admin] Calling method '>' {{(pid=106929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:54.528317 n-d-850501-14 devstack@n-api.service[106929]: INFO nova.api.openstack.requestlog [None req-e0d3f013-c6f7-429e-80aa-10b834fd9bab admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Oct 04 18:18:54.529341 n-d-850501-14 devstack@n-api.service[106929]: [pid: 106929|app: 0|req: 20/38] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Oct 4 18:18:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:18:55.070887 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi [None req-27cc9d20-3221-48cd-a482-b25413d9ff90 admin admin] Calling method '>' {{(pid=106928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:55.076893 n-d-850501-14 devstack@n-api.service[106928]: INFO nova.api.openstack.wsgi [None req-27cc9d20-3221-48cd-a482-b25413d9ff90 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 04 18:18:55.080160 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi [None req-27cc9d20-3221-48cd-a482-b25413d9ff90 admin admin] Request method failure captured: Oct 04 18:18:55.080160 n-d-850501-14 devstack@n-api.service[106928]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 04 18:18:55.080160 n-d-850501-14 devstack@n-api.service[106928]: Accept: application/json Oct 04 18:18:55.080160 n-d-850501-14 devstack@n-api.service[106928]: Accept-Encoding: gzip, deflate Oct 04 18:18:55.080160 n-d-850501-14 devstack@n-api.service[106928]: Connection: keep-alive Oct 04 18:18:55.080160 n-d-850501-14 devstack@n-api.service[106928]: Content-Length: 0 Oct 04 18:18:55.080160 n-d-850501-14 devstack@n-api.service[106928]: Host: 10.222.0.20 Oct 04 18:18:55.080160 n-d-850501-14 devstack@n-api.service[106928]: Openstack-Api-Version: compute 2.92 Oct 04 18:18:55.080160 n-d-850501-14 devstack@n-api.service[106928]: Openstack-System-Scope: None Oct 04 18:18:55.080160 n-d-850501-14 devstack@n-api.service[106928]: User-Agent: python-novaclient Oct 04 18:18:55.080160 n-d-850501-14 devstack@n-api.service[106928]: X-Auth-Token: gAAAAABjPHkONtKB5lefNCwoBtsrjW6cL4N2JnYgpiTBxNTZyybTPP5JzHk8OFLnL43f03uzX5vUUbCq7A7PIfMRUu29Te2xUJUJpdEA69uxHlI2LhIcU7akbi8xAa9OtZpBzjKmmzBLSW5Rewv5muppzWU2CHoCJl_A9SNu2_a1Ag6RKygogvo Oct 04 18:18:55.080160 n-d-850501-14 devstack@n-api.service[106928]: X-Domain-Id: None Oct 04 18:18:55.080160 n-d-850501-14 devstack@n-api.service[106928]: X-Domain-Name: None Oct 04 18:18:55.080160 n-d-850501-14 devstack@n-api.service[106928]: X-Identity-Status: Confirmed Oct 04 18:18:55.080160 n-d-850501-14 devstack@n-api.service[106928]: X-Is-Admin-Project: True Oct 04 18:18:55.080160 n-d-850501-14 devstack@n-api.service[106928]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 18:18:55.080160 n-d-850501-14 devstack@n-api.service[106928]: X-Project-Domain-Id: default Oct 04 18:18:55.080160 n-d-850501-14 devstack@n-api.service[106928]: X-Project-Domain-Name: Default Oct 04 18:18:55.080160 n-d-850501-14 devstack@n-api.service[106928]: X-Project-Id: c19b873056ad448ebf307064eb928ab8 Oct 04 18:18:55.080160 n-d-850501-14 devstack@n-api.service[106928]: X-Project-Name: admin Oct 04 18:18:55.080160 n-d-850501-14 devstack@n-api.service[106928]: X-Role: reader,member,admin Oct 04 18:18:55.080160 n-d-850501-14 devstack@n-api.service[106928]: X-Roles: reader,member,admin Oct 04 18:18:55.081815 n-d-850501-14 devstack@n-api.service[106928]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c19b873056ad448ebf307064eb928ab8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c19b873056ad448ebf307064eb928ab8", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c19b873056ad448ebf307064eb928ab8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c19b873056ad448ebf307064eb928ab8"}]}] Oct 04 18:18:55.081815 n-d-850501-14 devstack@n-api.service[106928]: X-Tenant: admin Oct 04 18:18:55.081815 n-d-850501-14 devstack@n-api.service[106928]: X-Tenant-Id: c19b873056ad448ebf307064eb928ab8 Oct 04 18:18:55.081815 n-d-850501-14 devstack@n-api.service[106928]: X-Tenant-Name: admin Oct 04 18:18:55.081815 n-d-850501-14 devstack@n-api.service[106928]: X-User: admin Oct 04 18:18:55.081815 n-d-850501-14 devstack@n-api.service[106928]: X-User-Domain-Id: default Oct 04 18:18:55.081815 n-d-850501-14 devstack@n-api.service[106928]: X-User-Domain-Name: Default Oct 04 18:18:55.081815 n-d-850501-14 devstack@n-api.service[106928]: X-User-Id: fe7144c95a994c58b3f41f33a145b332 Oct 04 18:18:55.081815 n-d-850501-14 devstack@n-api.service[106928]: X-User-Name: admin Oct 04 18:18:55.081815 n-d-850501-14 devstack@n-api.service[106928]: method: > Oct 04 18:18:55.081815 n-d-850501-14 devstack@n-api.service[106928]: exception: Flavor 42 could not be found. Oct 04 18:18:55.081815 n-d-850501-14 devstack@n-api.service[106928]: action_args: {'id': '42'} Oct 04 18:18:55.081815 n-d-850501-14 devstack@n-api.service[106928]: {{(pid=106928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:18:55.081815 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:55.082685 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 18:18:55.082685 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 18:18:55.082685 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 18:18:55.082685 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 18:18:55.082685 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:18:55.082685 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:18:55.082685 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 18:18:55.082685 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 18:18:55.082685 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 18:18:55.082685 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:18:55.082685 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 18:18:55.082685 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 18:18:55.082685 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 04 18:18:55.082685 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi Oct 04 18:18:55.082685 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:55.082685 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi Oct 04 18:18:55.082685 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:55.082685 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:55.082685 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:55.084021 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:18:55.084021 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:18:55.084021 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:18:55.084021 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:18:55.084021 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 18:18:55.084021 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:18:55.084021 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 04 18:18:55.084021 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi Oct 04 18:18:55.084021 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:55.084021 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi Oct 04 18:18:55.084021 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:55.084021 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:55.084021 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:55.084021 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:18:55.084021 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:18:55.084021 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 04 18:18:55.084021 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi Oct 04 18:18:55.084021 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi [None req-27cc9d20-3221-48cd-a482-b25413d9ff90 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:18:55.085175 n-d-850501-14 devstack@n-api.service[106928]: INFO nova.api.openstack.requestlog [None req-27cc9d20-3221-48cd-a482-b25413d9ff90 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.394963 Oct 04 18:18:55.085175 n-d-850501-14 devstack@n-api.service[106928]: [pid: 106928|app: 0|req: 19/39] 10.222.0.20 () {60 vars in 1190 bytes} [Tue Oct 4 18:18:54 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 396 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 04 18:18:55.092105 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi [None req-a9fde93e-cc71-4a26-910e-af6f0cf6ffbd admin admin] Calling method '>' {{(pid=106929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:55.114909 n-d-850501-14 devstack@n-api.service[106929]: INFO nova.api.openstack.requestlog [None req-a9fde93e-cc71-4a26-910e-af6f0cf6ffbd admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026375 Oct 04 18:18:55.115452 n-d-850501-14 devstack@n-api.service[106929]: [pid: 106929|app: 0|req: 21/40] 10.222.0.20 () {60 vars in 1210 bytes} [Tue Oct 4 18:18:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:18:55.137924 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi [None req-6046a5cb-98cd-4894-83a6-00954e6761f0 admin admin] Calling method '>' {{(pid=106928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:55.160106 n-d-850501-14 devstack@n-api.service[106928]: INFO nova.api.openstack.requestlog [None req-6046a5cb-98cd-4894-83a6-00954e6761f0 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026783 Oct 04 18:18:55.160644 n-d-850501-14 devstack@n-api.service[106928]: [pid: 106928|app: 0|req: 20/41] 10.222.0.20 () {60 vars in 1210 bytes} [Tue Oct 4 18:18:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:18:55.173251 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi [None req-8ec90c27-405d-4165-9ae9-8d3d4f14eacf admin admin] Calling method '>' {{(pid=106929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:55.180531 n-d-850501-14 devstack@n-api.service[106929]: INFO nova.api.openstack.wsgi [None req-8ec90c27-405d-4165-9ae9-8d3d4f14eacf admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 04 18:18:55.183871 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi [None req-8ec90c27-405d-4165-9ae9-8d3d4f14eacf admin admin] Request method failure captured: Oct 04 18:18:55.183871 n-d-850501-14 devstack@n-api.service[106929]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 04 18:18:55.183871 n-d-850501-14 devstack@n-api.service[106929]: Accept: application/json Oct 04 18:18:55.183871 n-d-850501-14 devstack@n-api.service[106929]: Accept-Encoding: gzip, deflate Oct 04 18:18:55.183871 n-d-850501-14 devstack@n-api.service[106929]: Connection: keep-alive Oct 04 18:18:55.183871 n-d-850501-14 devstack@n-api.service[106929]: Content-Length: 0 Oct 04 18:18:55.183871 n-d-850501-14 devstack@n-api.service[106929]: Host: 10.222.0.20 Oct 04 18:18:55.183871 n-d-850501-14 devstack@n-api.service[106929]: Openstack-Api-Version: compute 2.92 Oct 04 18:18:55.183871 n-d-850501-14 devstack@n-api.service[106929]: Openstack-System-Scope: None Oct 04 18:18:55.183871 n-d-850501-14 devstack@n-api.service[106929]: User-Agent: python-novaclient Oct 04 18:18:55.183871 n-d-850501-14 devstack@n-api.service[106929]: X-Auth-Token: gAAAAABjPHkONtKB5lefNCwoBtsrjW6cL4N2JnYgpiTBxNTZyybTPP5JzHk8OFLnL43f03uzX5vUUbCq7A7PIfMRUu29Te2xUJUJpdEA69uxHlI2LhIcU7akbi8xAa9OtZpBzjKmmzBLSW5Rewv5muppzWU2CHoCJl_A9SNu2_a1Ag6RKygogvo Oct 04 18:18:55.183871 n-d-850501-14 devstack@n-api.service[106929]: X-Domain-Id: None Oct 04 18:18:55.183871 n-d-850501-14 devstack@n-api.service[106929]: X-Domain-Name: None Oct 04 18:18:55.183871 n-d-850501-14 devstack@n-api.service[106929]: X-Identity-Status: Confirmed Oct 04 18:18:55.183871 n-d-850501-14 devstack@n-api.service[106929]: X-Is-Admin-Project: True Oct 04 18:18:55.183871 n-d-850501-14 devstack@n-api.service[106929]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 18:18:55.183871 n-d-850501-14 devstack@n-api.service[106929]: X-Project-Domain-Id: default Oct 04 18:18:55.183871 n-d-850501-14 devstack@n-api.service[106929]: X-Project-Domain-Name: Default Oct 04 18:18:55.183871 n-d-850501-14 devstack@n-api.service[106929]: X-Project-Id: c19b873056ad448ebf307064eb928ab8 Oct 04 18:18:55.183871 n-d-850501-14 devstack@n-api.service[106929]: X-Project-Name: admin Oct 04 18:18:55.183871 n-d-850501-14 devstack@n-api.service[106929]: X-Role: reader,member,admin Oct 04 18:18:55.183871 n-d-850501-14 devstack@n-api.service[106929]: X-Roles: reader,member,admin Oct 04 18:18:55.189798 n-d-850501-14 devstack@n-api.service[106929]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c19b873056ad448ebf307064eb928ab8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c19b873056ad448ebf307064eb928ab8", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c19b873056ad448ebf307064eb928ab8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c19b873056ad448ebf307064eb928ab8"}]}] Oct 04 18:18:55.189798 n-d-850501-14 devstack@n-api.service[106929]: X-Tenant: admin Oct 04 18:18:55.189798 n-d-850501-14 devstack@n-api.service[106929]: X-Tenant-Id: c19b873056ad448ebf307064eb928ab8 Oct 04 18:18:55.189798 n-d-850501-14 devstack@n-api.service[106929]: X-Tenant-Name: admin Oct 04 18:18:55.189798 n-d-850501-14 devstack@n-api.service[106929]: X-User: admin Oct 04 18:18:55.189798 n-d-850501-14 devstack@n-api.service[106929]: X-User-Domain-Id: default Oct 04 18:18:55.189798 n-d-850501-14 devstack@n-api.service[106929]: X-User-Domain-Name: Default Oct 04 18:18:55.189798 n-d-850501-14 devstack@n-api.service[106929]: X-User-Id: fe7144c95a994c58b3f41f33a145b332 Oct 04 18:18:55.189798 n-d-850501-14 devstack@n-api.service[106929]: X-User-Name: admin Oct 04 18:18:55.189798 n-d-850501-14 devstack@n-api.service[106929]: method: > Oct 04 18:18:55.189798 n-d-850501-14 devstack@n-api.service[106929]: exception: Flavor 42 could not be found. Oct 04 18:18:55.189798 n-d-850501-14 devstack@n-api.service[106929]: action_args: {'id': '42'} Oct 04 18:18:55.189798 n-d-850501-14 devstack@n-api.service[106929]: {{(pid=106929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:18:55.189798 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:55.190650 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 18:18:55.190650 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 18:18:55.190650 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 18:18:55.190650 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 18:18:55.190650 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:18:55.190650 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:18:55.190650 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 18:18:55.190650 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 18:18:55.190650 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 18:18:55.190650 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:18:55.190650 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 18:18:55.190650 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 18:18:55.190650 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 04 18:18:55.190650 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi Oct 04 18:18:55.190650 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:55.190650 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi Oct 04 18:18:55.190650 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:55.190650 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:55.190650 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:55.191723 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:18:55.191723 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:18:55.191723 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:18:55.191723 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:18:55.191723 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 18:18:55.191723 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:18:55.191723 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 04 18:18:55.191723 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi Oct 04 18:18:55.191723 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:55.191723 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi Oct 04 18:18:55.191723 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:55.191723 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:55.191723 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:55.191723 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:18:55.191723 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:18:55.191723 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 04 18:18:55.191723 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi Oct 04 18:18:55.191723 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi [None req-8ec90c27-405d-4165-9ae9-8d3d4f14eacf admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:18:55.192786 n-d-850501-14 devstack@n-api.service[106929]: INFO nova.api.openstack.requestlog [None req-8ec90c27-405d-4165-9ae9-8d3d4f14eacf admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.018276 Oct 04 18:18:55.192786 n-d-850501-14 devstack@n-api.service[106929]: [pid: 106929|app: 0|req: 22/42] 10.222.0.20 () {60 vars in 1190 bytes} [Tue Oct 4 18:18:55 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 04 18:18:56.441100 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi [None req-6046a5cb-98cd-4894-83a6-00954e6761f0 admin admin] Calling method '>' {{(pid=106928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:56.442111 n-d-850501-14 devstack@n-api.service[106928]: INFO nova.api.openstack.requestlog [None req-6046a5cb-98cd-4894-83a6-00954e6761f0 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Oct 04 18:18:56.442512 n-d-850501-14 devstack@n-api.service[106928]: [pid: 106928|app: 0|req: 21/43] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Oct 4 18:18:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:18:56.967761 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi [None req-bd733dad-1ce9-4433-9738-3cb04c947fec admin admin] Calling method '>' {{(pid=106929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:56.973005 n-d-850501-14 devstack@n-api.service[106929]: INFO nova.api.openstack.wsgi [None req-bd733dad-1ce9-4433-9738-3cb04c947fec admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 04 18:18:56.974435 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi [None req-bd733dad-1ce9-4433-9738-3cb04c947fec admin admin] Request method failure captured: Oct 04 18:18:56.974435 n-d-850501-14 devstack@n-api.service[106929]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 04 18:18:56.974435 n-d-850501-14 devstack@n-api.service[106929]: Accept: application/json Oct 04 18:18:56.974435 n-d-850501-14 devstack@n-api.service[106929]: Accept-Encoding: gzip, deflate Oct 04 18:18:56.974435 n-d-850501-14 devstack@n-api.service[106929]: Connection: keep-alive Oct 04 18:18:56.974435 n-d-850501-14 devstack@n-api.service[106929]: Content-Length: 0 Oct 04 18:18:56.974435 n-d-850501-14 devstack@n-api.service[106929]: Host: 10.222.0.20 Oct 04 18:18:56.974435 n-d-850501-14 devstack@n-api.service[106929]: Openstack-Api-Version: compute 2.92 Oct 04 18:18:56.974435 n-d-850501-14 devstack@n-api.service[106929]: Openstack-System-Scope: None Oct 04 18:18:56.974435 n-d-850501-14 devstack@n-api.service[106929]: User-Agent: python-novaclient Oct 04 18:18:56.974435 n-d-850501-14 devstack@n-api.service[106929]: X-Auth-Token: gAAAAABjPHkQUv8v8_7gJRqBcE79vdupOGN06uefQn_pah_IzAoANohvsLxj6hZtgft-DORRgbIkNzxQZY6fOOhT4yvfszdglwq072mm-ZKrWSnTrem5ty9JYyge6aT7sYuoI8jlBOhLikweCEzxZbbB-Z_gNY9toi0u1CBU_OYGro3XQi7RwSw Oct 04 18:18:56.974435 n-d-850501-14 devstack@n-api.service[106929]: X-Domain-Id: None Oct 04 18:18:56.974435 n-d-850501-14 devstack@n-api.service[106929]: X-Domain-Name: None Oct 04 18:18:56.974435 n-d-850501-14 devstack@n-api.service[106929]: X-Identity-Status: Confirmed Oct 04 18:18:56.974435 n-d-850501-14 devstack@n-api.service[106929]: X-Is-Admin-Project: True Oct 04 18:18:56.974435 n-d-850501-14 devstack@n-api.service[106929]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 18:18:56.974435 n-d-850501-14 devstack@n-api.service[106929]: X-Project-Domain-Id: default Oct 04 18:18:56.974435 n-d-850501-14 devstack@n-api.service[106929]: X-Project-Domain-Name: Default Oct 04 18:18:56.974435 n-d-850501-14 devstack@n-api.service[106929]: X-Project-Id: c19b873056ad448ebf307064eb928ab8 Oct 04 18:18:56.974435 n-d-850501-14 devstack@n-api.service[106929]: X-Project-Name: admin Oct 04 18:18:56.974435 n-d-850501-14 devstack@n-api.service[106929]: X-Role: reader,member,admin Oct 04 18:18:56.974435 n-d-850501-14 devstack@n-api.service[106929]: X-Roles: reader,member,admin Oct 04 18:18:56.976028 n-d-850501-14 devstack@n-api.service[106929]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c19b873056ad448ebf307064eb928ab8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c19b873056ad448ebf307064eb928ab8", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c19b873056ad448ebf307064eb928ab8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c19b873056ad448ebf307064eb928ab8"}]}] Oct 04 18:18:56.976028 n-d-850501-14 devstack@n-api.service[106929]: X-Tenant: admin Oct 04 18:18:56.976028 n-d-850501-14 devstack@n-api.service[106929]: X-Tenant-Id: c19b873056ad448ebf307064eb928ab8 Oct 04 18:18:56.976028 n-d-850501-14 devstack@n-api.service[106929]: X-Tenant-Name: admin Oct 04 18:18:56.976028 n-d-850501-14 devstack@n-api.service[106929]: X-User: admin Oct 04 18:18:56.976028 n-d-850501-14 devstack@n-api.service[106929]: X-User-Domain-Id: default Oct 04 18:18:56.976028 n-d-850501-14 devstack@n-api.service[106929]: X-User-Domain-Name: Default Oct 04 18:18:56.976028 n-d-850501-14 devstack@n-api.service[106929]: X-User-Id: fe7144c95a994c58b3f41f33a145b332 Oct 04 18:18:56.976028 n-d-850501-14 devstack@n-api.service[106929]: X-User-Name: admin Oct 04 18:18:56.976028 n-d-850501-14 devstack@n-api.service[106929]: method: > Oct 04 18:18:56.976028 n-d-850501-14 devstack@n-api.service[106929]: exception: Flavor 84 could not be found. Oct 04 18:18:56.976028 n-d-850501-14 devstack@n-api.service[106929]: action_args: {'id': '84'} Oct 04 18:18:56.976028 n-d-850501-14 devstack@n-api.service[106929]: {{(pid=106929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:18:56.976028 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:56.977025 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 18:18:56.977025 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 18:18:56.977025 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 18:18:56.977025 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 18:18:56.977025 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:18:56.977025 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:18:56.977025 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 18:18:56.977025 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 18:18:56.977025 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 18:18:56.977025 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:18:56.977025 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 18:18:56.977025 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 18:18:56.977025 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 04 18:18:56.977025 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi Oct 04 18:18:56.977025 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:56.977025 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi Oct 04 18:18:56.977025 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:56.977025 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:56.977025 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:56.978388 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:18:56.978388 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:18:56.978388 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:18:56.978388 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:18:56.978388 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 18:18:56.978388 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:18:56.978388 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 04 18:18:56.978388 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi Oct 04 18:18:56.978388 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:56.978388 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi Oct 04 18:18:56.978388 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:56.978388 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:56.978388 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:56.978388 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:18:56.978388 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:18:56.978388 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 04 18:18:56.978388 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi Oct 04 18:18:56.978388 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi [None req-bd733dad-1ce9-4433-9738-3cb04c947fec admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:18:56.979716 n-d-850501-14 devstack@n-api.service[106929]: INFO nova.api.openstack.requestlog [None req-bd733dad-1ce9-4433-9738-3cb04c947fec admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.397216 Oct 04 18:18:56.979716 n-d-850501-14 devstack@n-api.service[106929]: [pid: 106929|app: 0|req: 23/44] 10.222.0.20 () {60 vars in 1190 bytes} [Tue Oct 4 18:18:56 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 398 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 04 18:18:56.985670 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi [None req-331ea897-c7fa-4219-8db2-dc91586db004 admin admin] Calling method '>' {{(pid=106928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:57.000296 n-d-850501-14 devstack@n-api.service[106928]: INFO nova.api.openstack.requestlog [None req-331ea897-c7fa-4219-8db2-dc91586db004 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018167 Oct 04 18:18:57.000827 n-d-850501-14 devstack@n-api.service[106928]: [pid: 106928|app: 0|req: 22/45] 10.222.0.20 () {60 vars in 1210 bytes} [Tue Oct 4 18:18:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:18:57.010865 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi [None req-dc65f30d-9c30-4e79-8225-36e542e8676b admin admin] Calling method '>' {{(pid=106929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:57.027166 n-d-850501-14 devstack@n-api.service[106929]: INFO nova.api.openstack.requestlog [None req-dc65f30d-9c30-4e79-8225-36e542e8676b admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020666 Oct 04 18:18:57.027697 n-d-850501-14 devstack@n-api.service[106929]: [pid: 106929|app: 0|req: 24/46] 10.222.0.20 () {60 vars in 1210 bytes} [Tue Oct 4 18:18:57 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:18:57.036887 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi [None req-d28e6311-6bef-4347-ae16-b7d1496cb23a admin admin] Calling method '>' {{(pid=106928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:57.041992 n-d-850501-14 devstack@n-api.service[106928]: INFO nova.api.openstack.wsgi [None req-d28e6311-6bef-4347-ae16-b7d1496cb23a admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 04 18:18:57.043473 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi [None req-d28e6311-6bef-4347-ae16-b7d1496cb23a admin admin] Request method failure captured: Oct 04 18:18:57.043473 n-d-850501-14 devstack@n-api.service[106928]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 04 18:18:57.043473 n-d-850501-14 devstack@n-api.service[106928]: Accept: application/json Oct 04 18:18:57.043473 n-d-850501-14 devstack@n-api.service[106928]: Accept-Encoding: gzip, deflate Oct 04 18:18:57.043473 n-d-850501-14 devstack@n-api.service[106928]: Connection: keep-alive Oct 04 18:18:57.043473 n-d-850501-14 devstack@n-api.service[106928]: Content-Length: 0 Oct 04 18:18:57.043473 n-d-850501-14 devstack@n-api.service[106928]: Host: 10.222.0.20 Oct 04 18:18:57.043473 n-d-850501-14 devstack@n-api.service[106928]: Openstack-Api-Version: compute 2.92 Oct 04 18:18:57.043473 n-d-850501-14 devstack@n-api.service[106928]: Openstack-System-Scope: None Oct 04 18:18:57.043473 n-d-850501-14 devstack@n-api.service[106928]: User-Agent: python-novaclient Oct 04 18:18:57.043473 n-d-850501-14 devstack@n-api.service[106928]: X-Auth-Token: gAAAAABjPHkQUv8v8_7gJRqBcE79vdupOGN06uefQn_pah_IzAoANohvsLxj6hZtgft-DORRgbIkNzxQZY6fOOhT4yvfszdglwq072mm-ZKrWSnTrem5ty9JYyge6aT7sYuoI8jlBOhLikweCEzxZbbB-Z_gNY9toi0u1CBU_OYGro3XQi7RwSw Oct 04 18:18:57.043473 n-d-850501-14 devstack@n-api.service[106928]: X-Domain-Id: None Oct 04 18:18:57.043473 n-d-850501-14 devstack@n-api.service[106928]: X-Domain-Name: None Oct 04 18:18:57.043473 n-d-850501-14 devstack@n-api.service[106928]: X-Identity-Status: Confirmed Oct 04 18:18:57.043473 n-d-850501-14 devstack@n-api.service[106928]: X-Is-Admin-Project: True Oct 04 18:18:57.043473 n-d-850501-14 devstack@n-api.service[106928]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 18:18:57.043473 n-d-850501-14 devstack@n-api.service[106928]: X-Project-Domain-Id: default Oct 04 18:18:57.043473 n-d-850501-14 devstack@n-api.service[106928]: X-Project-Domain-Name: Default Oct 04 18:18:57.043473 n-d-850501-14 devstack@n-api.service[106928]: X-Project-Id: c19b873056ad448ebf307064eb928ab8 Oct 04 18:18:57.043473 n-d-850501-14 devstack@n-api.service[106928]: X-Project-Name: admin Oct 04 18:18:57.043473 n-d-850501-14 devstack@n-api.service[106928]: X-Role: reader,member,admin Oct 04 18:18:57.043473 n-d-850501-14 devstack@n-api.service[106928]: X-Roles: reader,member,admin Oct 04 18:18:57.045058 n-d-850501-14 devstack@n-api.service[106928]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c19b873056ad448ebf307064eb928ab8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c19b873056ad448ebf307064eb928ab8", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c19b873056ad448ebf307064eb928ab8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c19b873056ad448ebf307064eb928ab8"}]}] Oct 04 18:18:57.045058 n-d-850501-14 devstack@n-api.service[106928]: X-Tenant: admin Oct 04 18:18:57.045058 n-d-850501-14 devstack@n-api.service[106928]: X-Tenant-Id: c19b873056ad448ebf307064eb928ab8 Oct 04 18:18:57.045058 n-d-850501-14 devstack@n-api.service[106928]: X-Tenant-Name: admin Oct 04 18:18:57.045058 n-d-850501-14 devstack@n-api.service[106928]: X-User: admin Oct 04 18:18:57.045058 n-d-850501-14 devstack@n-api.service[106928]: X-User-Domain-Id: default Oct 04 18:18:57.045058 n-d-850501-14 devstack@n-api.service[106928]: X-User-Domain-Name: Default Oct 04 18:18:57.045058 n-d-850501-14 devstack@n-api.service[106928]: X-User-Id: fe7144c95a994c58b3f41f33a145b332 Oct 04 18:18:57.045058 n-d-850501-14 devstack@n-api.service[106928]: X-User-Name: admin Oct 04 18:18:57.045058 n-d-850501-14 devstack@n-api.service[106928]: method: > Oct 04 18:18:57.045058 n-d-850501-14 devstack@n-api.service[106928]: exception: Flavor 84 could not be found. Oct 04 18:18:57.045058 n-d-850501-14 devstack@n-api.service[106928]: action_args: {'id': '84'} Oct 04 18:18:57.045058 n-d-850501-14 devstack@n-api.service[106928]: {{(pid=106928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:18:57.045058 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:57.045886 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 18:18:57.045886 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 18:18:57.045886 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 18:18:57.045886 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 18:18:57.045886 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:18:57.045886 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:18:57.045886 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 18:18:57.045886 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 18:18:57.045886 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 18:18:57.045886 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:18:57.045886 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 18:18:57.045886 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 18:18:57.045886 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 04 18:18:57.045886 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi Oct 04 18:18:57.045886 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:57.045886 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi Oct 04 18:18:57.045886 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:57.045886 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:57.045886 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:57.046954 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:18:57.046954 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:18:57.046954 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:18:57.046954 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:18:57.046954 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 18:18:57.046954 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:18:57.046954 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 04 18:18:57.046954 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi Oct 04 18:18:57.046954 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:57.046954 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi Oct 04 18:18:57.046954 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:57.046954 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:57.046954 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:57.046954 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:18:57.046954 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:18:57.046954 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 04 18:18:57.046954 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi Oct 04 18:18:57.046954 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi [None req-d28e6311-6bef-4347-ae16-b7d1496cb23a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:18:57.048009 n-d-850501-14 devstack@n-api.service[106928]: INFO nova.api.openstack.requestlog [None req-d28e6311-6bef-4347-ae16-b7d1496cb23a admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011453 Oct 04 18:18:57.048009 n-d-850501-14 devstack@n-api.service[106928]: [pid: 106928|app: 0|req: 23/47] 10.222.0.20 () {60 vars in 1190 bytes} [Tue Oct 4 18:18:57 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 04 18:18:58.268947 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi [None req-dc65f30d-9c30-4e79-8225-36e542e8676b admin admin] Calling method '>' {{(pid=106929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:58.269958 n-d-850501-14 devstack@n-api.service[106929]: INFO nova.api.openstack.requestlog [None req-dc65f30d-9c30-4e79-8225-36e542e8676b admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Oct 04 18:18:58.270353 n-d-850501-14 devstack@n-api.service[106929]: [pid: 106929|app: 0|req: 25/48] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Oct 4 18:18:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:18:58.806690 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi [None req-c00afe6a-5ad1-4595-8c85-ca1daf4e9cd3 admin admin] Calling method '>' {{(pid=106928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:58.812461 n-d-850501-14 devstack@n-api.service[106928]: INFO nova.api.openstack.wsgi [None req-c00afe6a-5ad1-4595-8c85-ca1daf4e9cd3 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 04 18:18:58.813946 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi [None req-c00afe6a-5ad1-4595-8c85-ca1daf4e9cd3 admin admin] Request method failure captured: Oct 04 18:18:58.813946 n-d-850501-14 devstack@n-api.service[106928]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 04 18:18:58.813946 n-d-850501-14 devstack@n-api.service[106928]: Accept: application/json Oct 04 18:18:58.813946 n-d-850501-14 devstack@n-api.service[106928]: Accept-Encoding: gzip, deflate Oct 04 18:18:58.813946 n-d-850501-14 devstack@n-api.service[106928]: Connection: keep-alive Oct 04 18:18:58.813946 n-d-850501-14 devstack@n-api.service[106928]: Content-Length: 0 Oct 04 18:18:58.813946 n-d-850501-14 devstack@n-api.service[106928]: Host: 10.222.0.20 Oct 04 18:18:58.813946 n-d-850501-14 devstack@n-api.service[106928]: Openstack-Api-Version: compute 2.92 Oct 04 18:18:58.813946 n-d-850501-14 devstack@n-api.service[106928]: Openstack-System-Scope: None Oct 04 18:18:58.813946 n-d-850501-14 devstack@n-api.service[106928]: User-Agent: python-novaclient Oct 04 18:18:58.813946 n-d-850501-14 devstack@n-api.service[106928]: X-Auth-Token: gAAAAABjPHkS8MXocZTmS8FyGE7V2kHDlrCpyl0_PrnPv9PG6SWfIZwclDybWfozuKmxmM-PNZgwhtqni1FPBWhJntmKHmBuRPSWNMshg31oJFlZSVzEZBMeq1sY-1I9fgrskjqCvGGx9Nhuw6Y6WTW1xuaP-BIcfjNnEv1nLwfkHRdIvWNOkLg Oct 04 18:18:58.813946 n-d-850501-14 devstack@n-api.service[106928]: X-Domain-Id: None Oct 04 18:18:58.813946 n-d-850501-14 devstack@n-api.service[106928]: X-Domain-Name: None Oct 04 18:18:58.813946 n-d-850501-14 devstack@n-api.service[106928]: X-Identity-Status: Confirmed Oct 04 18:18:58.813946 n-d-850501-14 devstack@n-api.service[106928]: X-Is-Admin-Project: True Oct 04 18:18:58.813946 n-d-850501-14 devstack@n-api.service[106928]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 18:18:58.813946 n-d-850501-14 devstack@n-api.service[106928]: X-Project-Domain-Id: default Oct 04 18:18:58.813946 n-d-850501-14 devstack@n-api.service[106928]: X-Project-Domain-Name: Default Oct 04 18:18:58.813946 n-d-850501-14 devstack@n-api.service[106928]: X-Project-Id: c19b873056ad448ebf307064eb928ab8 Oct 04 18:18:58.813946 n-d-850501-14 devstack@n-api.service[106928]: X-Project-Name: admin Oct 04 18:18:58.813946 n-d-850501-14 devstack@n-api.service[106928]: X-Role: reader,member,admin Oct 04 18:18:58.813946 n-d-850501-14 devstack@n-api.service[106928]: X-Roles: reader,member,admin Oct 04 18:18:58.815475 n-d-850501-14 devstack@n-api.service[106928]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c19b873056ad448ebf307064eb928ab8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c19b873056ad448ebf307064eb928ab8", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c19b873056ad448ebf307064eb928ab8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c19b873056ad448ebf307064eb928ab8"}]}] Oct 04 18:18:58.815475 n-d-850501-14 devstack@n-api.service[106928]: X-Tenant: admin Oct 04 18:18:58.815475 n-d-850501-14 devstack@n-api.service[106928]: X-Tenant-Id: c19b873056ad448ebf307064eb928ab8 Oct 04 18:18:58.815475 n-d-850501-14 devstack@n-api.service[106928]: X-Tenant-Name: admin Oct 04 18:18:58.815475 n-d-850501-14 devstack@n-api.service[106928]: X-User: admin Oct 04 18:18:58.815475 n-d-850501-14 devstack@n-api.service[106928]: X-User-Domain-Id: default Oct 04 18:18:58.815475 n-d-850501-14 devstack@n-api.service[106928]: X-User-Domain-Name: Default Oct 04 18:18:58.815475 n-d-850501-14 devstack@n-api.service[106928]: X-User-Id: fe7144c95a994c58b3f41f33a145b332 Oct 04 18:18:58.815475 n-d-850501-14 devstack@n-api.service[106928]: X-User-Name: admin Oct 04 18:18:58.815475 n-d-850501-14 devstack@n-api.service[106928]: method: > Oct 04 18:18:58.815475 n-d-850501-14 devstack@n-api.service[106928]: exception: Flavor 451 could not be found. Oct 04 18:18:58.815475 n-d-850501-14 devstack@n-api.service[106928]: action_args: {'id': '451'} Oct 04 18:18:58.815475 n-d-850501-14 devstack@n-api.service[106928]: {{(pid=106928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:18:58.815475 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:58.816429 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 18:18:58.816429 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 18:18:58.816429 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 18:18:58.816429 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 18:18:58.816429 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:18:58.816429 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:18:58.816429 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 18:18:58.816429 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 18:18:58.816429 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 18:18:58.816429 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:18:58.816429 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 18:18:58.816429 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 18:18:58.816429 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 04 18:18:58.816429 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi Oct 04 18:18:58.816429 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:58.816429 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi Oct 04 18:18:58.816429 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:58.816429 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:58.816429 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:58.817494 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:18:58.817494 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:18:58.817494 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:18:58.817494 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:18:58.817494 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 18:18:58.817494 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:18:58.817494 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 04 18:18:58.817494 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi Oct 04 18:18:58.817494 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:58.817494 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi Oct 04 18:18:58.817494 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:58.817494 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:58.817494 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:58.817494 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:18:58.817494 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:18:58.817494 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 04 18:18:58.817494 n-d-850501-14 devstack@n-api.service[106928]: ERROR nova.api.openstack.wsgi Oct 04 18:18:58.817494 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi [None req-c00afe6a-5ad1-4595-8c85-ca1daf4e9cd3 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:18:58.818550 n-d-850501-14 devstack@n-api.service[106928]: INFO nova.api.openstack.requestlog [None req-c00afe6a-5ad1-4595-8c85-ca1daf4e9cd3 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.400641 Oct 04 18:18:58.818550 n-d-850501-14 devstack@n-api.service[106928]: [pid: 106928|app: 0|req: 24/49] 10.222.0.20 () {60 vars in 1193 bytes} [Tue Oct 4 18:18:58 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 402 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 04 18:18:58.825380 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi [None req-f2951520-a96b-438d-a136-14a1c22662d3 admin admin] Calling method '>' {{(pid=106929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:58.840810 n-d-850501-14 devstack@n-api.service[106929]: INFO nova.api.openstack.requestlog [None req-f2951520-a96b-438d-a136-14a1c22662d3 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019116 Oct 04 18:18:58.841332 n-d-850501-14 devstack@n-api.service[106929]: [pid: 106929|app: 0|req: 26/50] 10.222.0.20 () {60 vars in 1210 bytes} [Tue Oct 4 18:18:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:18:58.852320 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi [None req-dcaa657d-a7e0-4ab1-b908-db3e77b13ddd admin admin] Calling method '>' {{(pid=106928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:58.867578 n-d-850501-14 devstack@n-api.service[106928]: INFO nova.api.openstack.requestlog [None req-dcaa657d-a7e0-4ab1-b908-db3e77b13ddd admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020294 Oct 04 18:18:58.868116 n-d-850501-14 devstack@n-api.service[106928]: [pid: 106928|app: 0|req: 25/51] 10.222.0.20 () {60 vars in 1210 bytes} [Tue Oct 4 18:18:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:18:58.877295 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi [None req-5814a165-631c-4fda-8c98-ea50b889c3ad admin admin] Calling method '>' {{(pid=106929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:58.882328 n-d-850501-14 devstack@n-api.service[106929]: INFO nova.api.openstack.wsgi [None req-5814a165-631c-4fda-8c98-ea50b889c3ad admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 04 18:18:58.883815 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi [None req-5814a165-631c-4fda-8c98-ea50b889c3ad admin admin] Request method failure captured: Oct 04 18:18:58.883815 n-d-850501-14 devstack@n-api.service[106929]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 04 18:18:58.883815 n-d-850501-14 devstack@n-api.service[106929]: Accept: application/json Oct 04 18:18:58.883815 n-d-850501-14 devstack@n-api.service[106929]: Accept-Encoding: gzip, deflate Oct 04 18:18:58.883815 n-d-850501-14 devstack@n-api.service[106929]: Connection: keep-alive Oct 04 18:18:58.883815 n-d-850501-14 devstack@n-api.service[106929]: Content-Length: 0 Oct 04 18:18:58.883815 n-d-850501-14 devstack@n-api.service[106929]: Host: 10.222.0.20 Oct 04 18:18:58.883815 n-d-850501-14 devstack@n-api.service[106929]: Openstack-Api-Version: compute 2.92 Oct 04 18:18:58.883815 n-d-850501-14 devstack@n-api.service[106929]: Openstack-System-Scope: None Oct 04 18:18:58.883815 n-d-850501-14 devstack@n-api.service[106929]: User-Agent: python-novaclient Oct 04 18:18:58.883815 n-d-850501-14 devstack@n-api.service[106929]: X-Auth-Token: gAAAAABjPHkS8MXocZTmS8FyGE7V2kHDlrCpyl0_PrnPv9PG6SWfIZwclDybWfozuKmxmM-PNZgwhtqni1FPBWhJntmKHmBuRPSWNMshg31oJFlZSVzEZBMeq1sY-1I9fgrskjqCvGGx9Nhuw6Y6WTW1xuaP-BIcfjNnEv1nLwfkHRdIvWNOkLg Oct 04 18:18:58.883815 n-d-850501-14 devstack@n-api.service[106929]: X-Domain-Id: None Oct 04 18:18:58.883815 n-d-850501-14 devstack@n-api.service[106929]: X-Domain-Name: None Oct 04 18:18:58.883815 n-d-850501-14 devstack@n-api.service[106929]: X-Identity-Status: Confirmed Oct 04 18:18:58.883815 n-d-850501-14 devstack@n-api.service[106929]: X-Is-Admin-Project: True Oct 04 18:18:58.883815 n-d-850501-14 devstack@n-api.service[106929]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 18:18:58.883815 n-d-850501-14 devstack@n-api.service[106929]: X-Project-Domain-Id: default Oct 04 18:18:58.883815 n-d-850501-14 devstack@n-api.service[106929]: X-Project-Domain-Name: Default Oct 04 18:18:58.883815 n-d-850501-14 devstack@n-api.service[106929]: X-Project-Id: c19b873056ad448ebf307064eb928ab8 Oct 04 18:18:58.883815 n-d-850501-14 devstack@n-api.service[106929]: X-Project-Name: admin Oct 04 18:18:58.883815 n-d-850501-14 devstack@n-api.service[106929]: X-Role: reader,member,admin Oct 04 18:18:58.883815 n-d-850501-14 devstack@n-api.service[106929]: X-Roles: reader,member,admin Oct 04 18:18:58.885499 n-d-850501-14 devstack@n-api.service[106929]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c19b873056ad448ebf307064eb928ab8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c19b873056ad448ebf307064eb928ab8", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c19b873056ad448ebf307064eb928ab8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c19b873056ad448ebf307064eb928ab8"}]}] Oct 04 18:18:58.885499 n-d-850501-14 devstack@n-api.service[106929]: X-Tenant: admin Oct 04 18:18:58.885499 n-d-850501-14 devstack@n-api.service[106929]: X-Tenant-Id: c19b873056ad448ebf307064eb928ab8 Oct 04 18:18:58.885499 n-d-850501-14 devstack@n-api.service[106929]: X-Tenant-Name: admin Oct 04 18:18:58.885499 n-d-850501-14 devstack@n-api.service[106929]: X-User: admin Oct 04 18:18:58.885499 n-d-850501-14 devstack@n-api.service[106929]: X-User-Domain-Id: default Oct 04 18:18:58.885499 n-d-850501-14 devstack@n-api.service[106929]: X-User-Domain-Name: Default Oct 04 18:18:58.885499 n-d-850501-14 devstack@n-api.service[106929]: X-User-Id: fe7144c95a994c58b3f41f33a145b332 Oct 04 18:18:58.885499 n-d-850501-14 devstack@n-api.service[106929]: X-User-Name: admin Oct 04 18:18:58.885499 n-d-850501-14 devstack@n-api.service[106929]: method: > Oct 04 18:18:58.885499 n-d-850501-14 devstack@n-api.service[106929]: exception: Flavor 451 could not be found. Oct 04 18:18:58.885499 n-d-850501-14 devstack@n-api.service[106929]: action_args: {'id': '451'} Oct 04 18:18:58.885499 n-d-850501-14 devstack@n-api.service[106929]: {{(pid=106929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:18:58.885499 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:58.886472 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 18:18:58.886472 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 18:18:58.886472 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 18:18:58.886472 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 18:18:58.886472 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:18:58.886472 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:18:58.886472 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 18:18:58.886472 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 18:18:58.886472 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 18:18:58.886472 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:18:58.886472 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 18:18:58.886472 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 18:18:58.886472 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 04 18:18:58.886472 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi Oct 04 18:18:58.886472 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:58.886472 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi Oct 04 18:18:58.886472 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:58.886472 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:58.886472 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:58.887760 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:18:58.887760 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:18:58.887760 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:18:58.887760 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:18:58.887760 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 18:18:58.887760 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:18:58.887760 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 04 18:18:58.887760 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi Oct 04 18:18:58.887760 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:58.887760 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi Oct 04 18:18:58.887760 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:58.887760 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:58.887760 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:58.887760 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:18:58.887760 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:18:58.887760 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 04 18:18:58.887760 n-d-850501-14 devstack@n-api.service[106929]: ERROR nova.api.openstack.wsgi Oct 04 18:18:58.887760 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi [None req-5814a165-631c-4fda-8c98-ea50b889c3ad admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:18:58.889016 n-d-850501-14 devstack@n-api.service[106929]: INFO nova.api.openstack.requestlog [None req-5814a165-631c-4fda-8c98-ea50b889c3ad admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011455 Oct 04 18:18:58.889016 n-d-850501-14 devstack@n-api.service[106929]: [pid: 106929|app: 0|req: 27/52] 10.222.0.20 () {60 vars in 1193 bytes} [Tue Oct 4 18:18:58 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 04 18:19:00.112311 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi [None req-dcaa657d-a7e0-4ab1-b908-db3e77b13ddd admin admin] Calling method '>' {{(pid=106928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:00.113318 n-d-850501-14 devstack@n-api.service[106928]: INFO nova.api.openstack.requestlog [None req-dcaa657d-a7e0-4ab1-b908-db3e77b13ddd admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Oct 04 18:19:00.113721 n-d-850501-14 devstack@n-api.service[106928]: [pid: 106928|app: 0|req: 26/53] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Oct 4 18:19:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:19:00.640375 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi [None req-05c1af4b-b52f-4835-9985-a12d06e8cde3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:00.716939 n-d-850501-14 devstack@n-api.service[106929]: INFO nova.api.openstack.requestlog [None req-05c1af4b-b52f-4835-9985-a12d06e8cde3 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.460783 Oct 04 18:19:00.717497 n-d-850501-14 devstack@n-api.service[106929]: [pid: 106929|app: 0|req: 28/54] 10.222.0.20 () {64 vars in 1235 bytes} [Tue Oct 4 18:19:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:19:01.937410 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi [None req-dcaa657d-a7e0-4ab1-b908-db3e77b13ddd admin admin] Calling method '>' {{(pid=106928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:01.938550 n-d-850501-14 devstack@n-api.service[106928]: INFO nova.api.openstack.requestlog [None req-dcaa657d-a7e0-4ab1-b908-db3e77b13ddd admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001552 Oct 04 18:19:01.939038 n-d-850501-14 devstack@n-api.service[106928]: [pid: 106928|app: 0|req: 27/55] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Oct 4 18:19:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:19:02.465007 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi [None req-1bff9d8e-6864-48e5-818c-f81857870160 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:02.550618 n-d-850501-14 devstack@n-api.service[106929]: INFO nova.api.openstack.requestlog [None req-1bff9d8e-6864-48e5-818c-f81857870160 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.472312 Oct 04 18:19:02.551162 n-d-850501-14 devstack@n-api.service[106929]: [pid: 106929|app: 0|req: 29/56] 10.222.0.20 () {64 vars in 1235 bytes} [Tue Oct 4 18:19:02 2022] POST /compute/v2.1/flavors => generated 405 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:19:03.782784 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi [None req-dcaa657d-a7e0-4ab1-b908-db3e77b13ddd admin admin] Calling method '>' {{(pid=106928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:03.783812 n-d-850501-14 devstack@n-api.service[106928]: INFO nova.api.openstack.requestlog [None req-dcaa657d-a7e0-4ab1-b908-db3e77b13ddd admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Oct 04 18:19:03.784238 n-d-850501-14 devstack@n-api.service[106928]: [pid: 106928|app: 0|req: 28/57] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Oct 4 18:19:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:19:04.321572 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi [None req-a4be822c-6b09-4a1b-8023-166925be174c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:04.396485 n-d-850501-14 devstack@n-api.service[106929]: INFO nova.api.openstack.requestlog [None req-a4be822c-6b09-4a1b-8023-166925be174c admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.470051 Oct 04 18:19:04.397036 n-d-850501-14 devstack@n-api.service[106929]: [pid: 106929|app: 0|req: 30/58] 10.222.0.20 () {64 vars in 1235 bytes} [Tue Oct 4 18:19:03 2022] POST /compute/v2.1/flavors => generated 407 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:19:05.632908 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi [None req-dcaa657d-a7e0-4ab1-b908-db3e77b13ddd admin admin] Calling method '>' {{(pid=106928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:05.633922 n-d-850501-14 devstack@n-api.service[106928]: INFO nova.api.openstack.requestlog [None req-dcaa657d-a7e0-4ab1-b908-db3e77b13ddd admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Oct 04 18:19:05.634524 n-d-850501-14 devstack@n-api.service[106928]: [pid: 106928|app: 0|req: 29/59] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Oct 4 18:19:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:19:06.151035 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi [None req-7c3f995d-6c8e-44b4-aa52-5321fa4dd19f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:06.207227 n-d-850501-14 devstack@n-api.service[106929]: INFO nova.api.openstack.requestlog [None req-7c3f995d-6c8e-44b4-aa52-5321fa4dd19f admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.437145 Oct 04 18:19:06.207881 n-d-850501-14 devstack@n-api.service[106929]: [pid: 106929|app: 0|req: 31/60] 10.222.0.20 () {64 vars in 1235 bytes} [Tue Oct 4 18:19:05 2022] POST /compute/v2.1/flavors => generated 409 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:19:07.538790 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi [None req-dcaa657d-a7e0-4ab1-b908-db3e77b13ddd admin admin] Calling method '>' {{(pid=106928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:07.539816 n-d-850501-14 devstack@n-api.service[106928]: INFO nova.api.openstack.requestlog [None req-dcaa657d-a7e0-4ab1-b908-db3e77b13ddd admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Oct 04 18:19:07.540963 n-d-850501-14 devstack@n-api.service[106928]: [pid: 106928|app: 0|req: 30/61] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Oct 4 18:19:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:19:08.073061 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi [None req-8b1fca8e-cde5-4a6c-b363-d0f8e98fa713 admin admin] Calling method '>' {{(pid=106929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:08.093639 n-d-850501-14 devstack@n-api.service[106929]: INFO nova.api.openstack.requestlog [None req-8b1fca8e-cde5-4a6c-b363-d0f8e98fa713 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.414561 Oct 04 18:19:08.094179 n-d-850501-14 devstack@n-api.service[106929]: [pid: 106929|app: 0|req: 32/62] 10.222.0.20 () {60 vars in 1202 bytes} [Tue Oct 4 18:19:07 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:20:05.674249 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi [None req-dcaa657d-a7e0-4ab1-b908-db3e77b13ddd admin admin] Calling method '>' {{(pid=106928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:05.675263 n-d-850501-14 devstack@n-api.service[106928]: INFO nova.api.openstack.requestlog [None req-dcaa657d-a7e0-4ab1-b908-db3e77b13ddd admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Oct 04 18:20:05.675690 n-d-850501-14 devstack@n-api.service[106928]: [pid: 106928|app: 0|req: 31/63] 10.222.0.20 () {54 vars in 931 bytes} [Tue Oct 4 18:20:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:20:05.686352 n-d-850501-14 devstack@n-api.service[106929]: DEBUG dbcounter [-] [106929] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=106929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:20:06.075141 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi [None req-e0146382-7a85-428f-a3cc-0fefc7564ef9 admin admin] Calling method '>' {{(pid=106929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:06.095542 n-d-850501-14 devstack@n-api.service[106929]: INFO nova.api.openstack.requestlog [None req-e0146382-7a85-428f-a3cc-0fefc7564ef9 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.413633 Oct 04 18:20:06.096097 n-d-850501-14 devstack@n-api.service[106929]: [pid: 106929|app: 0|req: 33/64] 10.222.0.20 () {60 vars in 1292 bytes} [Tue Oct 4 18:20:05 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:20:06.118211 n-d-850501-14 devstack@n-api.service[106928]: DEBUG dbcounter [-] [106928] Writing DB stats nova_api:SELECT=14 {{(pid=106928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:20:06.121913 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi [None req-3ce71520-48ad-4e28-8ede-ac6a4c9fa4d6 admin admin] Calling method '>' {{(pid=106928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:06.129210 n-d-850501-14 devstack@n-api.service[106928]: INFO nova.api.openstack.requestlog [None req-3ce71520-48ad-4e28-8ede-ac6a4c9fa4d6 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012461 Oct 04 18:20:06.129746 n-d-850501-14 devstack@n-api.service[106928]: [pid: 106928|app: 0|req: 32/65] 10.222.0.20 () {60 vars in 1283 bytes} [Tue Oct 4 18:20:06 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:06.141448 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi [None req-982718aa-7f70-46c5-82f2-314b644e6147 admin admin] Calling method '>' {{(pid=106929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:06.149175 n-d-850501-14 devstack@n-api.service[106929]: INFO nova.api.openstack.requestlog [None req-982718aa-7f70-46c5-82f2-314b644e6147 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011268 Oct 04 18:20:06.149691 n-d-850501-14 devstack@n-api.service[106929]: [pid: 106929|app: 0|req: 34/66] 10.222.0.20 () {60 vars in 1286 bytes} [Tue Oct 4 18:20:06 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:06.161049 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi [None req-33731733-a3b9-4b37-995d-ed3cdd3941c6 admin admin] Calling method '>' {{(pid=106928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:06.168704 n-d-850501-14 devstack@n-api.service[106928]: INFO nova.api.openstack.requestlog [None req-33731733-a3b9-4b37-995d-ed3cdd3941c6 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011480 Oct 04 18:20:06.169220 n-d-850501-14 devstack@n-api.service[106928]: [pid: 106928|app: 0|req: 33/67] 10.222.0.20 () {60 vars in 1286 bytes} [Tue Oct 4 18:20:06 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:06.181831 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi [None req-f8447128-18b1-4397-92e0-ac47b3e57394 admin admin] Calling method '>' {{(pid=106929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:06.188990 n-d-850501-14 devstack@n-api.service[106929]: INFO nova.api.openstack.requestlog [None req-f8447128-18b1-4397-92e0-ac47b3e57394 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011705 Oct 04 18:20:06.189495 n-d-850501-14 devstack@n-api.service[106929]: [pid: 106929|app: 0|req: 35/68] 10.222.0.20 () {60 vars in 1283 bytes} [Tue Oct 4 18:20:06 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:09.785064 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi [None req-33731733-a3b9-4b37-995d-ed3cdd3941c6 admin admin] Calling method '>' {{(pid=106928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:09.786120 n-d-850501-14 devstack@n-api.service[106928]: INFO nova.api.openstack.requestlog [None req-33731733-a3b9-4b37-995d-ed3cdd3941c6 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Oct 04 18:26:09.786516 n-d-850501-14 devstack@n-api.service[106928]: [pid: 106928|app: 0|req: 34/69] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Oct 4 18:26:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:26:09.927569 n-d-850501-14 devstack@n-api.service[106929]: DEBUG dbcounter [-] [106929] Writing DB stats nova_api:SELECT=6 {{(pid=106929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:26:10.073515 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi [None req-b6b83eac-4aab-4390-9ba5-941e27e5f736 admin admin] Calling method '>' {{(pid=106929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:10.078116 n-d-850501-14 devstack@n-api.service[106929]: DEBUG oslo_concurrency.lockutils [None req-b6b83eac-4aab-4390-9ba5-941e27e5f736 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:10.078583 n-d-850501-14 devstack@n-api.service[106929]: DEBUG oslo_concurrency.lockutils [None req-b6b83eac-4aab-4390-9ba5-941e27e5f736 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:10.079008 n-d-850501-14 devstack@n-api.service[106929]: DEBUG oslo_concurrency.lockutils [None req-b6b83eac-4aab-4390-9ba5-941e27e5f736 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:10.079823 n-d-850501-14 devstack@n-api.service[106929]: DEBUG oslo_concurrency.lockutils [None req-b6b83eac-4aab-4390-9ba5-941e27e5f736 admin admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:10.080312 n-d-850501-14 devstack@n-api.service[106929]: DEBUG oslo_concurrency.lockutils [None req-b6b83eac-4aab-4390-9ba5-941e27e5f736 admin admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:10.080727 n-d-850501-14 devstack@n-api.service[106929]: DEBUG oslo_concurrency.lockutils [None req-b6b83eac-4aab-4390-9ba5-941e27e5f736 admin admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:10.119332 n-d-850501-14 devstack@n-api.service[106929]: INFO nova.api.openstack.requestlog [None req-b6b83eac-4aab-4390-9ba5-941e27e5f736 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.92 time: 0.192899 Oct 04 18:26:10.119879 n-d-850501-14 devstack@n-api.service[106929]: [pid: 106929|app: 0|req: 36/70] 10.222.0.20 () {60 vars in 1193 bytes} [Tue Oct 4 18:26:09 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:26:11.209278 n-d-850501-14 devstack@n-api.service[106928]: DEBUG nova.api.openstack.wsgi [None req-33731733-a3b9-4b37-995d-ed3cdd3941c6 admin admin] Calling method '>' {{(pid=106928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:11.210278 n-d-850501-14 devstack@n-api.service[106928]: INFO nova.api.openstack.requestlog [None req-33731733-a3b9-4b37-995d-ed3cdd3941c6 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 Oct 04 18:26:11.210675 n-d-850501-14 devstack@n-api.service[106928]: [pid: 106928|app: 0|req: 35/71] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Oct 4 18:26:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:26:11.402717 n-d-850501-14 devstack@n-api.service[106929]: DEBUG nova.api.openstack.wsgi [None req-c53f5bee-9e21-460d-8f49-c667f11c473a admin admin] Calling method '>' {{(pid=106929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:11.406290 n-d-850501-14 devstack@n-api.service[106929]: DEBUG oslo_concurrency.lockutils [None req-c53f5bee-9e21-460d-8f49-c667f11c473a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:11.406766 n-d-850501-14 devstack@n-api.service[106929]: DEBUG oslo_concurrency.lockutils [None req-c53f5bee-9e21-460d-8f49-c667f11c473a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:11.407267 n-d-850501-14 devstack@n-api.service[106929]: DEBUG oslo_concurrency.lockutils [None req-c53f5bee-9e21-460d-8f49-c667f11c473a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:11.408105 n-d-850501-14 devstack@n-api.service[106929]: DEBUG oslo_concurrency.lockutils [None req-c53f5bee-9e21-460d-8f49-c667f11c473a admin admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:11.408585 n-d-850501-14 devstack@n-api.service[106929]: DEBUG oslo_concurrency.lockutils [None req-c53f5bee-9e21-460d-8f49-c667f11c473a admin admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:11.409007 n-d-850501-14 devstack@n-api.service[106929]: DEBUG oslo_concurrency.lockutils [None req-c53f5bee-9e21-460d-8f49-c667f11c473a admin admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:11.432869 n-d-850501-14 devstack@n-api.service[106929]: INFO nova.api.openstack.requestlog [None req-c53f5bee-9e21-460d-8f49-c667f11c473a admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.92 time: 0.082757 Oct 04 18:26:11.433357 n-d-850501-14 devstack@n-api.service[106929]: [pid: 106929|app: 0|req: 37/72] 10.222.0.20 () {60 vars in 1193 bytes} [Tue Oct 4 18:26:11 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:26:56.607776 n-d-850501-14 systemd[1]: Stopping Devstack devstack@n-api.service... Oct 04 18:26:56.610852 n-d-850501-14 devstack@n-api.service[106927]: Tue Oct 4 18:26:56 2022 - graceful shutdown triggered... Oct 04 18:26:56.611399 n-d-850501-14 devstack@n-api.service[106929]: Gracefully killing worker 2 (pid: 106929)... Oct 04 18:26:56.611779 n-d-850501-14 devstack@n-api.service[106928]: Gracefully killing worker 1 (pid: 106928)... Oct 04 18:26:56.735923 n-d-850501-14 devstack@n-api.service[106928]: DEBUG dbcounter [-] [106928] Writing DB stats nova_api:SELECT=4 {{(pid=106928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:26:57.609308 n-d-850501-14 devstack@n-api.service[106927]: worker 1 buried after 1 seconds Oct 04 18:26:57.609308 n-d-850501-14 devstack@n-api.service[106927]: worker 2 buried after 1 seconds Oct 04 18:26:57.609308 n-d-850501-14 devstack@n-api.service[106927]: goodbye to uWSGI. Oct 04 18:26:57.610910 n-d-850501-14 systemd[1]: devstack@n-api.service: Succeeded. Oct 04 18:26:57.611548 n-d-850501-14 systemd[1]: Stopped Devstack devstack@n-api.service. Oct 04 18:26:57.614341 n-d-850501-14 systemd[1]: Starting Devstack devstack@n-api.service... Oct 04 18:26:57.634926 n-d-850501-14 devstack@n-api.service[122989]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 04 18:26:57.659591 n-d-850501-14 devstack@n-api.service[122989]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Oct 4 18:26:57 2022] *** Oct 04 18:26:57.659591 n-d-850501-14 devstack@n-api.service[122989]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 04 18:26:57.659591 n-d-850501-14 devstack@n-api.service[122989]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 04 18:26:57.659591 n-d-850501-14 devstack@n-api.service[122989]: nodename: n-d-850501-14 Oct 04 18:26:57.659591 n-d-850501-14 devstack@n-api.service[122989]: machine: x86_64 Oct 04 18:26:57.659591 n-d-850501-14 devstack@n-api.service[122989]: clock source: unix Oct 04 18:26:57.659591 n-d-850501-14 devstack@n-api.service[122989]: pcre jit disabled Oct 04 18:26:57.659591 n-d-850501-14 devstack@n-api.service[122989]: detected number of CPU cores: 4 Oct 04 18:26:57.659591 n-d-850501-14 devstack@n-api.service[122989]: current working directory: / Oct 04 18:26:57.659591 n-d-850501-14 devstack@n-api.service[122989]: detected binary path: /usr/bin/uwsgi-core Oct 04 18:26:57.659591 n-d-850501-14 devstack@n-api.service[122989]: your processes number limit is 47680 Oct 04 18:26:57.660594 n-d-850501-14 devstack@n-api.service[122989]: your memory page size is 4096 bytes Oct 04 18:26:57.660594 n-d-850501-14 devstack@n-api.service[122989]: detected max file descriptor number: 2048 Oct 04 18:26:57.660594 n-d-850501-14 devstack@n-api.service[122989]: lock engine: pthread robust mutexes Oct 04 18:26:57.660594 n-d-850501-14 devstack@n-api.service[122989]: thunder lock: enabled Oct 04 18:26:57.660594 n-d-850501-14 devstack@n-api.service[122989]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 04 18:26:57.661108 n-d-850501-14 devstack@n-api.service[122989]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 04 18:26:57.707902 n-d-850501-14 devstack@n-api.service[122989]: Python main interpreter initialized at 0x55ba342a89c0 Oct 04 18:26:57.707902 n-d-850501-14 devstack@n-api.service[122989]: python threads support enabled Oct 04 18:26:57.707902 n-d-850501-14 devstack@n-api.service[122989]: your server socket listen backlog is limited to 100 connections Oct 04 18:26:57.707902 n-d-850501-14 devstack@n-api.service[122989]: your mercy for graceful operations on workers is 90 seconds Oct 04 18:26:57.708426 n-d-850501-14 devstack@n-api.service[122989]: mapped 403077 bytes (393 KB) for 2 cores Oct 04 18:26:57.708426 n-d-850501-14 devstack@n-api.service[122989]: *** Operational MODE: preforking *** Oct 04 18:26:57.708655 n-d-850501-14 devstack@n-api.service[122989]: *** uWSGI is running in multiple interpreter mode *** Oct 04 18:26:57.708655 n-d-850501-14 devstack@n-api.service[122989]: spawned uWSGI master process (pid: 122989) Oct 04 18:26:57.708861 n-d-850501-14 systemd[1]: Started Devstack devstack@n-api.service. Oct 04 18:26:57.713324 n-d-850501-14 devstack@n-api.service[122989]: spawned uWSGI worker 1 (pid: 123001, cores: 1) Oct 04 18:26:57.715190 n-d-850501-14 devstack@n-api.service[122989]: spawned uWSGI worker 2 (pid: 123002, cores: 1) Oct 04 18:26:57.715190 n-d-850501-14 devstack@n-api.service[122989]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 04 18:26:58.392808 n-d-850501-14 devstack@n-api.service[123001]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 04 18:26:58.404894 n-d-850501-14 devstack@n-api.service[123002]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 04 18:26:59.567182 n-d-850501-14 devstack@n-api.service[123001]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 18:26:59.567182 n-d-850501-14 devstack@n-api.service[123001]: from cryptography.utils import int_from_bytes Oct 04 18:26:59.567825 n-d-850501-14 devstack@n-api.service[123001]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 18:26:59.567825 n-d-850501-14 devstack@n-api.service[123001]: from cryptography.utils import int_from_bytes Oct 04 18:26:59.589098 n-d-850501-14 devstack@n-api.service[123002]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 18:26:59.589098 n-d-850501-14 devstack@n-api.service[123002]: from cryptography.utils import int_from_bytes Oct 04 18:26:59.589691 n-d-850501-14 devstack@n-api.service[123002]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 18:26:59.589691 n-d-850501-14 devstack@n-api.service[123002]: from cryptography.utils import int_from_bytes Oct 04 18:27:01.997498 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 18:27:01.998184 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 18:27:01.998326 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 18:27:01.998700 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 18:27:01.998959 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 18:27:01.999354 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:01.999680 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:01.999998 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.000507 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.000842 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.001155 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.001480 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.001804 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.002131 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.002393 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.002708 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.003033 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-850501-14 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.003353 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.003660 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.003968 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.004318 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.004624 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.004944 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.005263 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.005767 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.006221 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.006528 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.007011 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.007415 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.008457 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.008457 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.008767 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.008936 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.009224 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.009542 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.009962 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-850501-14 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.010285 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.010600 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.010917 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.011347 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.011662 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.011974 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.012331 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.012656 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.012966 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.013295 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.013618 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.013935 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.014256 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.014571 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.014856 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.015222 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.015481 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.015788 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.016205 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.016449 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.016753 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.017075 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.017464 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.017786 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.018038 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.018286 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.018609 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.018927 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.019234 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.019543 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.019866 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.020185 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.020519 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.020794 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.021097 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.021401 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.021720 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.022035 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.024100 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.024100 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.024100 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.024100 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.024422 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.024508 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.024795 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.025114 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.025596 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.026072 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.026570 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.026879 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.027188 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.027496 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.027815 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.028180 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.028492 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.028742 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.029052 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.029356 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.029671 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.029977 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.030282 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.030584 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.030884 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.031187 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.031491 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.031794 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.032144 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.032428 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.032734 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.033037 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.033340 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.033644 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.033946 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.034265 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.034584 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.034887 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.035192 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.035496 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.035799 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.036139 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.036448 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.036751 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.037072 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.037376 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.037679 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.038693 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.039124 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.039427 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.039815 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.040142 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.040458 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.040784 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.041090 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.041397 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.041704 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.042018 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.042324 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.042632 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.042936 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.043238 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.043535 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.043858 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.044203 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.044515 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.044823 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.045369 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.045701 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.046154 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.046354 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.046701 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.047016 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.047349 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.047681 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.047998 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.048345 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.048660 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.048994 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.049306 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.049615 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.049928 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.050247 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.050566 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.050898 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.051221 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.052094 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.052094 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.052463 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.052463 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.052797 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.053126 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.053440 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.053833 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 18:27:02.054264 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.054385 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 18:27:02.054521 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 18:27:02.054611 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.054785 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.054977 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 18:27:02.055142 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.055388 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 18:27:02.055503 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.055793 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.055932 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.056350 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.056501 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.056630 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.056741 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.056898 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.057103 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.057501 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.057647 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.057858 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.057962 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.058155 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.058309 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.058410 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.058505 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.058609 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.058720 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.058822 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.058991 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.059094 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.059316 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.059417 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.059636 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.059735 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-850501-14 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.059936 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.060030 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.060302 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.060430 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.060619 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.060722 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.060937 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.061143 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.061321 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.061477 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.061631 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.061781 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.061924 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.062097 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.062261 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.062414 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.062587 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.062732 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.062874 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.063037 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.063189 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.063339 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.063491 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.063644 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.063797 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.063953 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.064125 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.064277 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.064427 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.064570 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.064720 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.064875 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.065072 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.065231 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.065375 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.065517 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.065674 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.065936 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.066191 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-850501-14 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.066485 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.066648 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.066804 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.066954 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.067106 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.067249 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.067409 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.067409 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.067825 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.067972 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.068163 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.068314 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.068469 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.068612 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.068769 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.068925 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.069101 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.069794 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.070446 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.070620 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.070768 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.070913 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.071062 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.071207 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.071350 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.071527 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.071682 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.071833 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.071986 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.072191 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.072376 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.072546 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.072700 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.072844 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.072988 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.073138 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.073290 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.073434 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.073590 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.073742 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.073892 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.074037 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.074189 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.074332 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.074492 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.074636 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.074786 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.074937 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.075130 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.075290 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.075461 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.075614 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.075765 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.075943 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.076202 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.076793 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.076948 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.077104 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.077250 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.077403 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.077549 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.077713 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.077949 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.078108 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.078255 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.078415 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.078560 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.078711 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.078873 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.079018 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.079602 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.079774 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.079945 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.080275 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.080438 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.080583 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.080734 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.080894 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.081047 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.081199 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.081342 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.081504 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.081504 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.081802 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.081954 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.081954 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.082232 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.082232 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.082512 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.082670 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.082822 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.082965 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.083114 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.083114 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.083114 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.083114 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.083114 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.083114 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.083114 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.083114 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.084249 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.084249 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.084249 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.084663 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.084943 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.085784 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.085977 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.086139 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.086473 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.086867 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.087024 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.087169 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.087395 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.087551 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.087706 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.087859 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.088171 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.088325 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.088483 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.088639 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.088783 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.088934 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.089085 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.089237 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.089391 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.089542 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.089687 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.089848 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.089994 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.090137 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.090289 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.090433 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.090594 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.090745 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.090899 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.091052 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.091196 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.091354 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.091498 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.091640 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.091640 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.092565 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.092719 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.092719 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.093000 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.093159 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.093159 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.093159 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.093577 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.093718 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.093869 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.094014 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.094166 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.094323 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.094467 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.094609 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.094752 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.094895 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.095056 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.095212 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.095364 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.095514 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.095707 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.095865 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.096025 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.096255 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.096430 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.096654 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.097024 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.097188 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.097364 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.097511 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.097654 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.097806 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.097951 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.098121 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.098352 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.098502 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.098654 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.098808 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.099011 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.099175 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.099322 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.099486 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.099643 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.099802 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.099947 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.100175 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.100328 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.100513 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.100513 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.101289 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.101436 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.101580 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.101723 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.101874 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.102040 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.102184 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.102328 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.102480 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.102632 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.102775 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.102937 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.102937 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.103229 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.103372 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.103515 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.103658 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.103809 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.103964 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.104128 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.104290 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.104443 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.104600 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.104744 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.104902 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.105046 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.105198 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.105351 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.105504 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.105656 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.105848 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.106010 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.106162 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.106314 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.106472 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.106636 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.107071 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.107244 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.107390 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.107533 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.107693 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.107837 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:27:02.107981 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.108193 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.108368 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.108653 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.108814 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.108966 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.109117 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.109261 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.109412 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.109565 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.109726 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.109726 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.110019 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.110163 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.110324 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.110478 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.110630 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.110783 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.110928 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.111072 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.111215 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.111215 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.111519 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.111681 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.111834 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.111991 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.112189 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.112344 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.112506 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.112656 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.112805 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.112964 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.113124 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.113124 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.113408 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.113566 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.113729 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.113888 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.114046 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.114206 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.114364 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.114528 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.114678 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.114835 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.114835 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.115119 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.115268 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.115427 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.115577 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.115726 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.115952 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.116175 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.116842 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.117369 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.117535 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.117690 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.117843 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.120285 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.120463 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.120635 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.120783 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.120937 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.121090 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.121235 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.121396 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.121396 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.121699 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.121699 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.121977 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.122128 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.122282 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.122425 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.122569 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.122712 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.122854 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.123004 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.123177 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.123177 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.123515 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.123669 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.123821 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.123973 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.124153 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.124310 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.124464 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.124608 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.124759 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.124917 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.124917 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.125197 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.125360 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.125513 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.125664 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.125664 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.125998 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.126154 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.126154 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.126433 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.126583 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.126741 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.126891 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.127064 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.127501 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.127675 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.127835 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.127997 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.128175 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.128328 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.128489 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.128641 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.128806 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.128956 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.129114 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.129114 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.129423 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.129423 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.129756 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.129756 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.130060 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.130217 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.130473 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.130640 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.130802 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.130968 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.131120 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.131278 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.131474 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.132215 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.132876 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.133845 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.134014 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.134167 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.134327 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.134493 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.134653 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.134812 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.134812 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.135120 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.135279 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.135440 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.135591 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.135754 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.135906 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.136133 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.136301 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.136468 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.136619 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.136619 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.136619 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.137055 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.137213 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.137704 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.137868 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.138021 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.138185 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.138345 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.138507 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.138507 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.138507 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.138507 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.139080 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.139231 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.139395 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.139555 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.139783 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.139941 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.140149 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.140320 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.140496 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.140648 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.140648 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.141051 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.141212 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.141372 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.141537 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.141689 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.141840 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.141996 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.142147 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.142319 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.142470 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.142619 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.142776 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.142927 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.143078 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.143236 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.143389 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.143547 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.143697 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.143855 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.144006 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.144006 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.144363 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.144567 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.144725 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.144877 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.145035 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.145200 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.145361 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.145521 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.145680 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.145838 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.145998 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.146214 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.146371 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.146543 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.146702 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.146861 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.147055 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.147331 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.149138 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.149313 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.149467 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.149645 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.149645 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.150003 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.150156 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.150307 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.150470 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.150631 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.150804 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.150804 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.151250 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.151410 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.151572 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.151572 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.151885 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.152044 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.152226 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.152226 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.152530 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.152703 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.152854 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.153012 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.153012 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.153296 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.153453 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.153613 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.153764 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.153922 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.154073 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.154243 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.154394 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.154565 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.154716 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.154867 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.155016 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.155174 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.155341 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.155500 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.155655 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.155655 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.155949 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.156278 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.156519 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.156683 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.156858 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.157018 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.157169 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.157328 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.157487 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.157646 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.157797 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.157957 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.158116 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.158266 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.158548 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.158716 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.158916 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.159398 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.159560 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.159726 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.159726 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.161523 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.161712 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.161874 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.162026 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.162190 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.162343 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.162343 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.163408 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.164316 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.164575 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.164746 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.164931 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.165085 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.165253 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.165418 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.165570 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.167986 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.168178 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.168337 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.168508 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.168794 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.168990 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.169145 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.169145 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.169791 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.169945 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.170361 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.170605 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.170769 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.170922 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.171072 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.171223 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.171372 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.174546 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.174732 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.174887 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.175037 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.175195 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.175347 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.175506 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.175665 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.175825 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.175985 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.176165 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.176338 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.334945 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.335103 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.335103 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.335325 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.335406 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.335478 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.335560 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.335636 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.335712 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.335712 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.335955 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.336104 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.336326 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.336326 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.336326 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.336589 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.336725 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.336843 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.337018 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.337098 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.337175 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.337256 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.337381 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.337477 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.337574 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.337659 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.337750 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.337833 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.337916 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.338037 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.338126 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.338215 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.338282 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.338340 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.338446 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.338555 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.338636 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.338711 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.338772 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.338855 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.338934 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.339006 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.339075 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.339144 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.339144 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.339270 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.339347 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.339420 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.339489 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.339559 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.339627 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.339627 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.339832 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.339927 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.340000 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.340212 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.340288 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.340378 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.340452 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.340528 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.340608 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.340677 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.340755 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.340843 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.340915 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.340985 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.341053 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.341122 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.341191 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.341191 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.341323 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.341392 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.341459 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.341527 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.341594 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.341669 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.341740 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.341808 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.341876 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.341961 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.341961 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.342104 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.342173 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.342249 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.342249 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.342382 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.342466 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.342537 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.342613 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.342684 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.342774 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.342843 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.342911 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.343000 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.343084 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.343156 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.343156 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.343156 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.343156 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.343430 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.343508 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.343590 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.343672 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.343771 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.343846 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.343846 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.343988 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.343988 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.344155 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.344226 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.344294 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.344375 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.344448 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.344517 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.344598 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.344686 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.344766 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.344854 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.344952 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.345032 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.345120 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.345192 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.345272 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.345363 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.345487 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.345487 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.345613 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.345671 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.345671 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.345798 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.345896 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.345971 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.346043 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.346113 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.346184 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.346261 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.346334 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.346404 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.346484 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.346567 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.346645 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.346737 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.346812 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.346885 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.346972 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.347047 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.347118 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.347196 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.347286 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.347360 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.347430 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.347499 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.347569 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.347651 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.347739 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.347811 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.347882 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.347971 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.348093 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.348176 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.348247 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.348317 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.348406 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.348501 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.348583 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.348657 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.348740 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.348813 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.348889 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.348992 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.349098 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.349180 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.349252 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.349344 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.349435 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.349509 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.349589 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.349662 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.349758 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.349867 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.349975 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.350125 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.350221 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.350300 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.350906 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.351007 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.351242 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.351825 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.351957 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.352114 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.352204 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.352368 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.353111 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.353209 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.353285 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.353356 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.353434 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.353519 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.353604 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.353684 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.353765 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.353931 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.354021 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.354087 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.354176 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.354265 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.354265 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.354407 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.354521 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.354596 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.354657 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.354844 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.354966 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.355055 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.355152 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.355228 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.355383 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.355470 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.355605 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.355702 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.355921 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.356043 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.356189 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.356266 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.356359 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.356437 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.356538 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.356613 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.356704 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.356786 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.356882 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.356980 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.357162 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.357298 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.357363 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.357551 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.357742 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.357844 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.357927 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.358004 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.358100 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.358176 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.358259 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.358360 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.358451 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.358553 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.358633 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.358704 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.358776 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.358876 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.364221 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.364339 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.364423 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.364487 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.364548 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.364627 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.364725 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.364809 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.364875 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.364945 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.365069 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.365217 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.365288 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.365348 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.365406 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.365464 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.365573 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.365573 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.365744 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.365809 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.365868 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.365940 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.366013 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.366168 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.366821 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.366934 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.367125 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.367264 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.369031 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.369111 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.369174 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.369239 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.369299 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.369378 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.369995 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.370305 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.370382 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.370443 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.371275 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.371510 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.371725 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.372163 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.372441 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.372441 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.373041 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.373194 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.373386 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.373530 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.373661 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.373810 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.373977 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.373977 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.374326 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.374477 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.374628 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.374799 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.374968 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.375131 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.375320 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.375481 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.375481 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.375785 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.375989 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.376151 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.376284 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.376412 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.376541 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.376669 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.376910 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.377052 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.377052 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.377323 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.377492 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.377718 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.377909 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.378160 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.378432 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.378709 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.378943 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.379236 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.379380 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.379577 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.379885 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.380029 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.380233 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.380415 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.380554 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.380703 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.380859 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.380859 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.381163 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.381328 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.381482 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.381636 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.382576 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.383176 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.383375 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.383704 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.383924 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.384138 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.384326 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.385325 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.385490 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.385640 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.386601 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.386800 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.386800 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.387189 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.387426 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.387632 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.387870 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.388084 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.388261 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.388437 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.388573 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.388848 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.388988 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.389191 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.389360 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.389360 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.389738 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.389894 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.390047 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.390047 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.390356 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.390522 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.390661 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.390661 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.390950 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.391136 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.391136 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.391136 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.391136 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.391136 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.391887 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.392019 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.392019 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.392280 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.392280 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.392531 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.392650 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.392767 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.392899 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.393225 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.393225 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.393487 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.393622 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.393740 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.393869 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.393869 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.394091 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.394207 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.394324 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.394439 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.394439 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.394670 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.394786 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.394905 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.395013 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.395122 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.395242 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.395361 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.395477 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.395595 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.395712 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.395838 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.395958 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.395958 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.396238 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.396378 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.396510 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.396653 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.396787 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.396917 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.397061 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.397192 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.397192 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.398138 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.398381 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.398635 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.398985 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.399206 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.399436 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.399655 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.399930 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.400148 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.400392 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.400629 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.400867 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.401117 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.401336 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.401474 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.401606 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.401606 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.401606 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.402060 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.402194 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.402326 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.402494 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.402717 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.402898 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.403056 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.403522 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.403758 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.403902 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.404045 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.404045 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.404327 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.404327 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.404607 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.404747 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.404889 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.405061 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.405199 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.405392 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.405531 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.405671 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.405804 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.405935 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.406936 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.407288 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.407503 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.407737 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.407948 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.408171 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.408315 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.408447 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.408580 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.408580 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.408844 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.408844 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.409229 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.409363 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.409506 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.409641 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.409772 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.409949 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.410105 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.410246 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.410397 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.410531 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.410664 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.410795 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.410926 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.411124 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.411124 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.411124 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.411124 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.411124 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.411124 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.411871 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.412012 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.412012 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.412301 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.412388 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.412509 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.412597 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.412597 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.412732 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.412811 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.412811 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.413001 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.413001 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.413001 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.413001 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.413239 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.413302 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.413552 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.413681 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.413786 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.413909 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.413987 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.413987 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.414118 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.414200 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.414275 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.414348 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.414420 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.414492 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.414578 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.414655 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.414817 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.414984 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.414984 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.414984 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.414984 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.415529 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.415606 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.415669 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.415669 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.415798 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.415869 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.415869 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.416191 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.416313 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.416378 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.416439 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.424328 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.424450 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.424450 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.424637 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.424716 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.424716 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.424870 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.424946 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.425020 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.425093 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.425093 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.425234 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.425311 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.425311 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.425439 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.425513 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.425586 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.425753 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.425833 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.425907 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.425981 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.426055 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.426055 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.426196 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.426272 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.426389 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.426474 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.426474 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.426617 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.426694 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.426694 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.426826 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.426899 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.426972 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.427053 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.427128 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.427202 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.427276 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.427350 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.434712 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.434843 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.434929 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.435007 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.435073 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.435073 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.435199 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.435276 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.435349 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.435422 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.435495 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.435567 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.435648 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.435648 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.435783 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.435855 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.435927 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.435927 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.436084 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.436084 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.436261 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.436339 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.436416 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.436416 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.436566 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.436640 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.436640 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.436772 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.436844 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.436925 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.437000 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.437072 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.437144 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.437144 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.437144 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.437144 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.437401 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.437474 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.437546 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.437618 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.437691 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.437771 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.437846 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.437918 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 18:27:02.437991 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.437991 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.437991 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.437991 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.437991 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.437991 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.437991 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.437991 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.438486 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.438486 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.438486 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.438486 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.438486 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.438486 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.438486 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.438486 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.438967 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.438967 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.438967 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.438967 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.438967 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.438967 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.438967 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.439392 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.439392 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.439392 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.439392 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.439392 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.439392 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.439392 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.439392 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.439879 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.439879 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.439879 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.439879 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.439879 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.439879 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.439879 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.439879 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.443758 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.443758 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.443758 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.443758 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.443758 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.443758 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.443758 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.443758 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.445443 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.445443 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.445443 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.445443 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.445443 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.445443 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.445443 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.445443 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.446380 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.446380 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.446380 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.446380 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.446380 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.446380 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.446380 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.446380 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.448224 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.448224 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.448224 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.448224 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.448224 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.448224 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.448224 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.448224 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.448644 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.448644 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.448644 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.448644 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.448644 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.448644 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.448644 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.448644 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.449044 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.449044 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.449044 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.449194 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.449523 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.449730 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.450040 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.450348 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.450665 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.450979 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.451294 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.451604 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.451922 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.452298 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.452615 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.452924 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.453253 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.453562 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.453869 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.454193 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.454507 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.454834 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.455157 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.455470 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.455849 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.456191 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.456748 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.457200 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.457532 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.457871 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.458205 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.458519 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.458831 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.459186 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.459457 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.459776 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.460766 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.461163 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.461533 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.461791 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.462107 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.462422 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.462740 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.463057 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.463370 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.463684 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.463995 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.464339 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.464653 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.465102 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.465501 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.465838 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.466182 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.466472 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.466791 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.467235 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.467563 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.467880 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.468220 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.468540 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.468874 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.469189 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.470760 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.470760 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.470760 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.470760 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.470982 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.471159 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.471464 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.471788 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.472122 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.472631 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.472943 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.473279 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.473624 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.473958 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.474290 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.474598 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.474907 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.475222 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.475691 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.476535 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.476535 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.476814 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.477075 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.477539 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.478024 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.478340 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.478655 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.478960 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.479274 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.479583 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.479891 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.480217 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.480528 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.480837 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.481145 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.481458 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.481766 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.482075 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.482381 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.482689 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.482995 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.483333 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.483668 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.483986 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.484336 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.484652 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.484975 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.485284 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.485608 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.485934 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.486254 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.486567 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.487019 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.487201 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.487340 n-d-850501-14 devstack@n-api.service[123001]: INFO dbcounter [None req-7bca2e74-5327-40fe-bd73-eb389644fa58 None None] Registered counter for database nova_api Oct 04 18:27:02.487640 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.487968 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.488304 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.488619 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.488938 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.489331 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.489662 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.489972 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.490301 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.490620 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.490943 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.492005 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.492599 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.492789 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.493015 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.493323 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.493638 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.493952 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.494266 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.494590 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.494905 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.495223 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.495543 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.495863 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.496223 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.496550 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.496866 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.497197 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.497550 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.497899 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.498216 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.498563 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.498897 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.499213 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.499528 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.499837 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:27:02.500116 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 18:27:02.510348 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_db.sqlalchemy.engines [None req-7bca2e74-5327-40fe-bd73-eb389644fa58 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123001) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 18:27:02.518121 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writer thread running {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 18:27:02.562766 n-d-850501-14 devstack@n-api.service[123002]: INFO dbcounter [None req-82197256-5de6-4d81-aebd-8aecc1971bc9 None None] Registered counter for database nova_api Oct 04 18:27:02.579285 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.context [None req-7bca2e74-5327-40fe-bd73-eb389644fa58 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a6039a6d-a98c-44a9-819b-4eff388d8aa7(cell1) {{(pid=123001) load_cells /opt/stack/nova/nova/context.py:464}} Oct 04 18:27:02.583421 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7bca2e74-5327-40fe-bd73-eb389644fa58 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:02.583873 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_db.sqlalchemy.engines [None req-82197256-5de6-4d81-aebd-8aecc1971bc9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123002) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 18:27:02.583979 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7bca2e74-5327-40fe-bd73-eb389644fa58 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:02.586295 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7bca2e74-5327-40fe-bd73-eb389644fa58 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:02.587117 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7bca2e74-5327-40fe-bd73-eb389644fa58 None None] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:02.587500 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7bca2e74-5327-40fe-bd73-eb389644fa58 None None] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:02.589554 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7bca2e74-5327-40fe-bd73-eb389644fa58 None None] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:02.591162 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writer thread running {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 18:27:02.591621 n-d-850501-14 devstack@n-api.service[123001]: INFO dbcounter [None req-7bca2e74-5327-40fe-bd73-eb389644fa58 None None] Registered counter for database nova_cell0 Oct 04 18:27:02.596261 n-d-850501-14 devstack@n-api.service[123001]: INFO dbcounter [None req-7bca2e74-5327-40fe-bd73-eb389644fa58 None None] Registered counter for database nova_cell1 Oct 04 18:27:02.603363 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_db.sqlalchemy.engines [None req-7bca2e74-5327-40fe-bd73-eb389644fa58 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123001) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 18:27:02.607879 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_db.sqlalchemy.engines [None req-7bca2e74-5327-40fe-bd73-eb389644fa58 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123001) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 18:27:02.614163 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writer thread running {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 18:27:02.620713 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writer thread running {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 18:27:02.649139 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.context [None req-82197256-5de6-4d81-aebd-8aecc1971bc9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a6039a6d-a98c-44a9-819b-4eff388d8aa7(cell1) {{(pid=123002) load_cells /opt/stack/nova/nova/context.py:464}} Oct 04 18:27:02.653299 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-82197256-5de6-4d81-aebd-8aecc1971bc9 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:02.653785 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-82197256-5de6-4d81-aebd-8aecc1971bc9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:02.655374 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-82197256-5de6-4d81-aebd-8aecc1971bc9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:02.656144 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-82197256-5de6-4d81-aebd-8aecc1971bc9 None None] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:02.656601 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-82197256-5de6-4d81-aebd-8aecc1971bc9 None None] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:02.658603 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-82197256-5de6-4d81-aebd-8aecc1971bc9 None None] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:02.660686 n-d-850501-14 devstack@n-api.service[123002]: INFO dbcounter [None req-82197256-5de6-4d81-aebd-8aecc1971bc9 None None] Registered counter for database nova_cell0 Oct 04 18:27:02.664961 n-d-850501-14 devstack@n-api.service[123002]: INFO dbcounter [None req-82197256-5de6-4d81-aebd-8aecc1971bc9 None None] Registered counter for database nova_cell1 Oct 04 18:27:02.672815 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_db.sqlalchemy.engines [None req-82197256-5de6-4d81-aebd-8aecc1971bc9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123002) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 18:27:02.676747 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_db.sqlalchemy.engines [None req-82197256-5de6-4d81-aebd-8aecc1971bc9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123002) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 18:27:02.679778 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writer thread running {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 18:27:02.776942 n-d-850501-14 devstack@n-api.service[123001]: INFO dbcounter [None req-7bca2e74-5327-40fe-bd73-eb389644fa58 None None] Registered counter for database nova_cell0 Oct 04 18:27:02.783866 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_db.sqlalchemy.engines [None req-7bca2e74-5327-40fe-bd73-eb389644fa58 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123001) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 18:27:02.789426 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writer thread running {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 18:27:02.829538 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writer thread running {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 18:27:02.839292 n-d-850501-14 devstack@n-api.service[123002]: INFO dbcounter [None req-82197256-5de6-4d81-aebd-8aecc1971bc9 None None] Registered counter for database nova_cell0 Oct 04 18:27:02.846365 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_db.sqlalchemy.engines [None req-82197256-5de6-4d81-aebd-8aecc1971bc9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123002) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 18:27:02.850879 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writer thread running {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 18:27:03.124361 n-d-850501-14 devstack@n-api.service[123001]: WARNING keystonemiddleware.auth_token [None req-7bca2e74-5327-40fe-bd73-eb389644fa58 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 18:27:03.133011 n-d-850501-14 devstack@n-api.service[123001]: WARNING keystonemiddleware.auth_token [None req-7bca2e74-5327-40fe-bd73-eb389644fa58 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 18:27:03.176295 n-d-850501-14 devstack@n-api.service[123002]: WARNING keystonemiddleware.auth_token [None req-82197256-5de6-4d81-aebd-8aecc1971bc9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 18:27:03.184553 n-d-850501-14 devstack@n-api.service[123002]: WARNING keystonemiddleware.auth_token [None req-82197256-5de6-4d81-aebd-8aecc1971bc9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 18:27:03.498111 n-d-850501-14 devstack@n-api.service[123001]: WARNING keystonemiddleware.auth_token [None req-7bca2e74-5327-40fe-bd73-eb389644fa58 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 18:27:03.509866 n-d-850501-14 devstack@n-api.service[123001]: WARNING keystonemiddleware.auth_token [None req-7bca2e74-5327-40fe-bd73-eb389644fa58 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 18:27:03.515310 n-d-850501-14 devstack@n-api.service[123001]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ba342a89c0 pid: 123001 (default app) Oct 04 18:27:03.534781 n-d-850501-14 devstack@n-api.service[123002]: WARNING keystonemiddleware.auth_token [None req-82197256-5de6-4d81-aebd-8aecc1971bc9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 18:27:03.541507 n-d-850501-14 devstack@n-api.service[123002]: WARNING keystonemiddleware.auth_token [None req-82197256-5de6-4d81-aebd-8aecc1971bc9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 18:27:03.546885 n-d-850501-14 devstack@n-api.service[123002]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ba342a89c0 pid: 123002 (default app) Oct 04 18:27:45.159728 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=3 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:27:45.161462 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=3 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:27:45.162484 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=3 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:27:45.163138 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=3 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:27:46.492254 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=3 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:27:46.494636 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=3 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:27:46.495724 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=3 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:27:46.496713 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=3 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:27:46.832952 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-adadc1ee-dd8e-4907-b07c-a3cd77a8925f tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-765000979", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:47.693168 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-bdd2bb27-cdad-41a9-ae18-f5e4d201abeb tempest-AggregatesAdminTestV241-1520563578 tempest-AggregatesAdminTestV241-1520563578-project-admin] Calling method '.version_select at 0x7fe25aad2940>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:47.728019 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-bdd2bb27-cdad-41a9-ae18-f5e4d201abeb tempest-AggregatesAdminTestV241-1520563578 tempest-AggregatesAdminTestV241-1520563578-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a6039a6d-a98c-44a9-819b-4eff388d8aa7(cell1) {{(pid=123002) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 04 18:27:47.728796 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bdd2bb27-cdad-41a9-ae18-f5e4d201abeb tempest-AggregatesAdminTestV241-1520563578 tempest-AggregatesAdminTestV241-1520563578-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:47.729279 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bdd2bb27-cdad-41a9-ae18-f5e4d201abeb tempest-AggregatesAdminTestV241-1520563578 tempest-AggregatesAdminTestV241-1520563578-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:47.729754 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bdd2bb27-cdad-41a9-ae18-f5e4d201abeb tempest-AggregatesAdminTestV241-1520563578 tempest-AggregatesAdminTestV241-1520563578-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:47.761624 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bdd2bb27-cdad-41a9-ae18-f5e4d201abeb tempest-AggregatesAdminTestV241-1520563578 tempest-AggregatesAdminTestV241-1520563578-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:47.762308 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bdd2bb27-cdad-41a9-ae18-f5e4d201abeb tempest-AggregatesAdminTestV241-1520563578 tempest-AggregatesAdminTestV241-1520563578-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:47.762924 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bdd2bb27-cdad-41a9-ae18-f5e4d201abeb tempest-AggregatesAdminTestV241-1520563578 tempest-AggregatesAdminTestV241-1520563578-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:47.778944 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bdd2bb27-cdad-41a9-ae18-f5e4d201abeb tempest-AggregatesAdminTestV241-1520563578 tempest-AggregatesAdminTestV241-1520563578-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:47.780106 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bdd2bb27-cdad-41a9-ae18-f5e4d201abeb tempest-AggregatesAdminTestV241-1520563578 tempest-AggregatesAdminTestV241-1520563578-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:47.780691 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bdd2bb27-cdad-41a9-ae18-f5e4d201abeb tempest-AggregatesAdminTestV241-1520563578 tempest-AggregatesAdminTestV241-1520563578-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:47.788169 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-bdd2bb27-cdad-41a9-ae18-f5e4d201abeb tempest-AggregatesAdminTestV241-1520563578 tempest-AggregatesAdminTestV241-1520563578-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1427 microversion: 2.41 time: 1.306901 Oct 04 18:27:47.789922 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1/1] 10.222.0.20 () {60 vars in 1208 bytes} [Tue Oct 4 18:27:46 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1427 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:27:47.918271 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.neutron [None req-adadc1ee-dd8e-4907-b07c-a3cd77a8925f tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] validate_networks() for None {{(pid=123001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:27:48.000434 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4ff58352-9505-4771-9837-26e7f5e36b83 tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:48.006218 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4ff58352-9505-4771-9837-26e7f5e36b83 tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:48.006997 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4ff58352-9505-4771-9837-26e7f5e36b83 tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:48.008754 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4ff58352-9505-4771-9837-26e7f5e36b83 tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:48.009955 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4ff58352-9505-4771-9837-26e7f5e36b83 tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:48.010588 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4ff58352-9505-4771-9837-26e7f5e36b83 tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:48.011585 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4ff58352-9505-4771-9837-26e7f5e36b83 tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:48.082062 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4ff58352-9505-4771-9837-26e7f5e36b83 tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.290770 Oct 04 18:27:48.082891 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2/2] 10.222.0.20 () {58 vars in 1176 bytes} [Tue Oct 4 18:27:47 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:27:48.323441 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-429fe111-8f13-4d4e-b72d-7a7ace28c441 tempest-FlavorsAdminTestJSON-17563934 tempest-FlavorsAdminTestJSON-17563934-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1854414548", "id": 2052409532, "os-flavor-access:is_public": "True"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:48.491991 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-adadc1ee-dd8e-4907-b07c-a3cd77a8925f tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:27:48.493114 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-adadc1ee-dd8e-4907-b07c-a3cd77a8925f tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:27:48.493714 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-adadc1ee-dd8e-4907-b07c-a3cd77a8925f tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:27:48.496420 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-adadc1ee-dd8e-4907-b07c-a3cd77a8925f tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:27:48.496886 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-adadc1ee-dd8e-4907-b07c-a3cd77a8925f tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:27:48.502295 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-429fe111-8f13-4d4e-b72d-7a7ace28c441 tempest-FlavorsAdminTestJSON-17563934 tempest-FlavorsAdminTestJSON-17563934-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.418476 Oct 04 18:27:48.511156 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-adadc1ee-dd8e-4907-b07c-a3cd77a8925f tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:48.513716 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-adadc1ee-dd8e-4907-b07c-a3cd77a8925f tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:48.513716 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-adadc1ee-dd8e-4907-b07c-a3cd77a8925f tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:48.513917 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3/3] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:27:48 2022] POST /compute/v2.1/flavors => generated 430 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:27:48.514000 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-adadc1ee-dd8e-4907-b07c-a3cd77a8925f tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:48.514000 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-adadc1ee-dd8e-4907-b07c-a3cd77a8925f tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:48.521334 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-adadc1ee-dd8e-4907-b07c-a3cd77a8925f tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:48.566433 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-adadc1ee-dd8e-4907-b07c-a3cd77a8925f tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Getting quotas for project 1e99a0400fe947bb8907857cc4de2899. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:27:48.581701 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-adadc1ee-dd8e-4907-b07c-a3cd77a8925f tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Getting quotas for user 7f87d9eaf49545bb8effb170768bb8e7 and project 1e99a0400fe947bb8907857cc4de2899. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:27:48.609988 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-adadc1ee-dd8e-4907-b07c-a3cd77a8925f tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Going to run 1 instances... {{(pid=123001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:27:48.612917 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-adadc1ee-dd8e-4907-b07c-a3cd77a8925f tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] [instance: 6da2d407-863f-4f6a-9d71-d81e96f160fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:27:48.723715 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9f774bd0-84be-40d7-b91a-8ae7794d66b1 tempest-AZAdminV2TestJSON-1810650906 tempest-AZAdminV2TestJSON-1810650906-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:48.725341 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9f774bd0-84be-40d7-b91a-8ae7794d66b1 tempest-AZAdminV2TestJSON-1810650906 tempest-AZAdminV2TestJSON-1810650906-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:48.725818 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9f774bd0-84be-40d7-b91a-8ae7794d66b1 tempest-AZAdminV2TestJSON-1810650906 tempest-AZAdminV2TestJSON-1810650906-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:48.726249 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9f774bd0-84be-40d7-b91a-8ae7794d66b1 tempest-AZAdminV2TestJSON-1810650906 tempest-AZAdminV2TestJSON-1810650906-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:48.726999 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9f774bd0-84be-40d7-b91a-8ae7794d66b1 tempest-AZAdminV2TestJSON-1810650906 tempest-AZAdminV2TestJSON-1810650906-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:48.727557 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9f774bd0-84be-40d7-b91a-8ae7794d66b1 tempest-AZAdminV2TestJSON-1810650906 tempest-AZAdminV2TestJSON-1810650906-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:48.727974 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9f774bd0-84be-40d7-b91a-8ae7794d66b1 tempest-AZAdminV2TestJSON-1810650906 tempest-AZAdminV2TestJSON-1810650906-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:48.751277 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9f774bd0-84be-40d7-b91a-8ae7794d66b1 tempest-AZAdminV2TestJSON-1810650906 tempest-AZAdminV2TestJSON-1810650906-project-admin] 10.222.0.20 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.236726 Oct 04 18:27:48.752695 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4/4] 10.222.0.20 () {58 vars in 1164 bytes} [Tue Oct 4 18:27:48 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:27:48.765653 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-adadc1ee-dd8e-4907-b07c-a3cd77a8925f tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.611046 Oct 04 18:27:48.766694 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1/5] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:27:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 3613 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:27:48.771621 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-dbde821d-3a8b-4b69-a730-8ea370647cc7 tempest-AggregatesAdminTestV241-1520563578 tempest-AggregatesAdminTestV241-1520563578-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-999296830"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:48.777116 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.aggregate [None req-dbde821d-3a8b-4b69-a730-8ea370647cc7 tempest-AggregatesAdminTestV241-1520563578 tempest-AggregatesAdminTestV241-1520563578-project-admin] Generated uuid f699eaef-771f-4a4f-8886-86e8d6a166c6 for aggregate {{(pid=123001) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 18:27:48.896760 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-dbde821d-3a8b-4b69-a730-8ea370647cc7 tempest-AggregatesAdminTestV241-1520563578 tempest-AggregatesAdminTestV241-1520563578-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.41 time: 0.128807 Oct 04 18:27:48.897472 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2/6] 10.222.0.20 () {62 vars in 1205 bytes} [Tue Oct 4 18:27:48 2022] POST /compute/v2.1/os-aggregates => generated 245 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:27:48.981966 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8a69b055-b166-42e3-845a-e0c3439a9cc8 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Calling method '.version_select at 0x7fe25a8c1ca0>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:48.984798 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8a69b055-b166-42e3-845a-e0c3439a9cc8 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:48.985477 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8a69b055-b166-42e3-845a-e0c3439a9cc8 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:48.986194 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8a69b055-b166-42e3-845a-e0c3439a9cc8 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:49.028099 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8a69b055-b166-42e3-845a-e0c3439a9cc8 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:49.028589 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8a69b055-b166-42e3-845a-e0c3439a9cc8 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:49.029028 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8a69b055-b166-42e3-845a-e0c3439a9cc8 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:49.059344 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8a69b055-b166-42e3-845a-e0c3439a9cc8 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:49.060077 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8a69b055-b166-42e3-845a-e0c3439a9cc8 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:49.080170 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8a69b055-b166-42e3-845a-e0c3439a9cc8 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:49.080170 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8a69b055-b166-42e3-845a-e0c3439a9cc8 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1507 microversion: 2.1 time: 0.313441 Oct 04 18:27:49.081592 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 5/7] 10.222.0.20 () {58 vars in 1167 bytes} [Tue Oct 4 18:27:48 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1507 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:49.094589 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d0d06374-fab3-4e60-bc46-7864a8ddcdb1 tempest-FlavorsAdminTestJSON-17563934 tempest-FlavorsAdminTestJSON-17563934-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:49.114046 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-91042a33-b224-4b4d-9d9c-e5edb653d9c5 tempest-FlavorsAccessNegativeTestJSON-1779691288 tempest-FlavorsAccessNegativeTestJSON-1779691288-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-279489898", "id": 909357075, "os-flavor-access:is_public": "False"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:49.242305 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-91042a33-b224-4b4d-9d9c-e5edb653d9c5 tempest-FlavorsAccessNegativeTestJSON-1779691288 tempest-FlavorsAccessNegativeTestJSON-1779691288-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.335382 Oct 04 18:27:49.244010 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3/8] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:27:48 2022] POST /compute/v2.1/flavors => generated 435 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:27:49.249764 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a4ee1c21-fb90-49b6-a6da-ef8ddbea3004 tempest-AZAdminV2TestJSON-1810650906 tempest-AZAdminV2TestJSON-1810650906-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:49.251648 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a4ee1c21-fb90-49b6-a6da-ef8ddbea3004 tempest-AZAdminV2TestJSON-1810650906 tempest-AZAdminV2TestJSON-1810650906-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:49.252218 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a4ee1c21-fb90-49b6-a6da-ef8ddbea3004 tempest-AZAdminV2TestJSON-1810650906 tempest-AZAdminV2TestJSON-1810650906-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:49.252971 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a4ee1c21-fb90-49b6-a6da-ef8ddbea3004 tempest-AZAdminV2TestJSON-1810650906 tempest-AZAdminV2TestJSON-1810650906-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:49.253707 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a4ee1c21-fb90-49b6-a6da-ef8ddbea3004 tempest-AZAdminV2TestJSON-1810650906 tempest-AZAdminV2TestJSON-1810650906-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:49.254301 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a4ee1c21-fb90-49b6-a6da-ef8ddbea3004 tempest-AZAdminV2TestJSON-1810650906 tempest-AZAdminV2TestJSON-1810650906-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:49.254729 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a4ee1c21-fb90-49b6-a6da-ef8ddbea3004 tempest-AZAdminV2TestJSON-1810650906 tempest-AZAdminV2TestJSON-1810650906-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:49.256783 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d0d06374-fab3-4e60-bc46-7864a8ddcdb1 tempest-FlavorsAdminTestJSON-17563934 tempest-FlavorsAdminTestJSON-17563934-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/2052409532" status: 202 len: 0 microversion: 2.1 time: 0.173671 Oct 04 18:27:49.257902 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 6/9] 10.222.0.20 () {58 vars in 1161 bytes} [Tue Oct 4 18:27:49 2022] DELETE /compute/v2.1/flavors/2052409532 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:27:49.263591 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-105f247e-e0c8-4de1-acbe-32a9cf76e8a4 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:49.268296 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-105f247e-e0c8-4de1-acbe-32a9cf76e8a4 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] [instance: 6da2d407-863f-4f6a-9d71-d81e96f160fb] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:49.329742 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a4ee1c21-fb90-49b6-a6da-ef8ddbea3004 tempest-AZAdminV2TestJSON-1810650906 tempest-AZAdminV2TestJSON-1810650906-project-admin] 10.222.0.20 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.084115 Oct 04 18:27:49.330536 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4/10] 10.222.0.20 () {58 vars in 1185 bytes} [Tue Oct 4 18:27:49 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:27:49.336189 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1e9421dc-e982-4153-b3e3-011106d50576 tempest-AggregatesAdminTestV241-1520563578 tempest-AggregatesAdminTestV241-1520563578-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1641159807"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:49.640168 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1e9421dc-e982-4153-b3e3-011106d50576 tempest-AggregatesAdminTestV241-1520563578 tempest-AggregatesAdminTestV241-1520563578-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-aggregates/1" status: 200 len: 299 microversion: 2.41 time: 0.308334 Oct 04 18:27:49.642889 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-105f247e-e0c8-4de1-acbe-32a9cf76e8a4 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f87d9eaf49545bb8effb170768bb8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e99a0400fe947bb8907857cc4de2899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:49.643753 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 5/11] 10.222.0.20 () {62 vars in 1210 bytes} [Tue Oct 4 18:27:49 2022] PUT /compute/v2.1/os-aggregates/1 => generated 299 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:27:49.651862 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a69adfe1-851f-4dd1-92f8-e93863e815fe tempest-FlavorsAccessNegativeTestJSON-1779691288 tempest-FlavorsAccessNegativeTestJSON-1779691288-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "a59c9b12aabe4ee4ae2ad4338d0946e3"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:49.667930 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-105f247e-e0c8-4de1-acbe-32a9cf76e8a4 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] 10.222.0.20 "GET /compute/v2.1/servers/6da2d407-863f-4f6a-9d71-d81e96f160fb" status: 200 len: 1219 microversion: 2.1 time: 0.407952 Oct 04 18:27:49.688997 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 7/12] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:49 2022] GET /compute/v2.1/servers/6da2d407-863f-4f6a-9d71-d81e96f160fb => generated 1219 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:49.695131 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-84dec1d8-fe82-49f1-91c7-c565b76f5535 tempest-FlavorsAdminTestJSON-17563934 tempest-FlavorsAdminTestJSON-17563934-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:49.747541 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-84dec1d8-fe82-49f1-91c7-c565b76f5535 tempest-FlavorsAdminTestJSON-17563934 tempest-FlavorsAdminTestJSON-17563934-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.056864 Oct 04 18:27:49.764763 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 8/13] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Oct 4 18:27:49 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:49.771503 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c7a1645f-3f9f-43e6-ba08-9b613deb65c6 tempest-AggregatesAdminTestV241-1520563578 tempest-AggregatesAdminTestV241-1520563578-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:49.791525 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c7a1645f-3f9f-43e6-ba08-9b613deb65c6 tempest-AggregatesAdminTestV241-1520563578 tempest-AggregatesAdminTestV241-1520563578-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates/1" status: 200 len: 299 microversion: 2.41 time: 0.025230 Oct 04 18:27:49.792843 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 9/14] 10.222.0.20 () {60 vars in 1190 bytes} [Tue Oct 4 18:27:49 2022] GET /compute/v2.1/os-aggregates/1 => generated 299 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:27:49.806060 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3fb48c85-96f1-4051-bda9-fe0b3f5f1409 tempest-FlavorsAdminTestJSON-17563934 tempest-FlavorsAdminTestJSON-17563934-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-2085376591", "id": 837469901, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:49.931969 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a69adfe1-851f-4dd1-92f8-e93863e815fe tempest-FlavorsAccessNegativeTestJSON-1779691288 tempest-FlavorsAccessNegativeTestJSON-1779691288-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/909357075/action" status: 200 len: 96 microversion: 2.1 time: 0.287047 Oct 04 18:27:49.936959 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 6/15] 10.222.0.20 () {60 vars in 1197 bytes} [Tue Oct 4 18:27:49 2022] POST /compute/v2.1/flavors/909357075/action => generated 96 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:27:49.940388 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-35389a05-a72d-4a00-b12a-367dc8add30d tempest-AggregatesAdminTestV241-1520563578 tempest-AggregatesAdminTestV241-1520563578-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-850501-14"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:49.967846 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3fb48c85-96f1-4051-bda9-fe0b3f5f1409 tempest-FlavorsAdminTestJSON-17563934 tempest-FlavorsAdminTestJSON-17563934-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.173791 Oct 04 18:27:49.973805 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 10/16] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:27:49 2022] POST /compute/v2.1/flavors => generated 414 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:27:49.976070 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-35389a05-a72d-4a00-b12a-367dc8add30d tempest-AggregatesAdminTestV241-1520563578 tempest-AggregatesAdminTestV241-1520563578-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:49.983402 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-35389a05-a72d-4a00-b12a-367dc8add30d tempest-AggregatesAdminTestV241-1520563578 tempest-AggregatesAdminTestV241-1520563578-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:49.985935 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-35389a05-a72d-4a00-b12a-367dc8add30d tempest-AggregatesAdminTestV241-1520563578 tempest-AggregatesAdminTestV241-1520563578-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:50.000910 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-41bcfec1-2332-4758-aef6-aeed2c04e513 tempest-FlavorsAccessNegativeTestJSON-1779691288 tempest-FlavorsAccessNegativeTestJSON-1779691288-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "a59c9b12aabe4ee4ae2ad4338d0946e3"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:50.402800 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-41bcfec1-2332-4758-aef6-aeed2c04e513 tempest-FlavorsAccessNegativeTestJSON-1779691288 tempest-FlavorsAccessNegativeTestJSON-1779691288-project-admin] HTTP exception thrown: Flavor access already exists for flavor 16 and project a59c9b12aabe4ee4ae2ad4338d0946e3 combination. Oct 04 18:27:50.434258 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-41bcfec1-2332-4758-aef6-aeed2c04e513 tempest-FlavorsAccessNegativeTestJSON-1779691288 tempest-FlavorsAccessNegativeTestJSON-1779691288-project-admin] Request method failure captured: Oct 04 18:27:50.434258 n-d-850501-14 devstack@n-api.service[123002]: request: POST /compute/v2.1/flavors/909357075/action HTTP/1.1 Oct 04 18:27:50.434258 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:27:50.434258 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:27:50.434258 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:27:50.434258 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 67 Oct 04 18:27:50.434258 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:27:50.434258 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:27:50.434258 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:27:50.434258 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:27:50.434258 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPHsjF918m3OlvDiVH37HZbj3AvG1kM8g6Hf0wEW0aqyA3DCvry7OGvvqzVS5UQvByMiHlQJhn_JnKxsciGvJfU87zAqPM2n95rJnLWMQfiDDceIUiPux4Pug2ONv1FljKfWT80wklW383n62t78xAkkLAvdZoqxqbhtQulwrW7oUqUE Oct 04 18:27:50.434258 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:27:50.434258 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:27:50.434258 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:27:50.434258 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:27:50.434258 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:27:50.434258 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:27:50.434258 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 75c07803a2514e798c79d2ac6010a3fb Oct 04 18:27:50.434258 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1779691288 Oct 04 18:27:50.434258 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member,admin Oct 04 18:27:50.434258 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member,admin Oct 04 18:27:50.435425 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/75c07803a2514e798c79d2ac6010a3fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_75c07803a2514e798c79d2ac6010a3fb", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/75c07803a2514e798c79d2ac6010a3fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/75c07803a2514e798c79d2ac6010a3fb"}]}] Oct 04 18:27:50.435425 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1779691288 Oct 04 18:27:50.435425 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 75c07803a2514e798c79d2ac6010a3fb Oct 04 18:27:50.435425 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1779691288 Oct 04 18:27:50.435425 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-FlavorsAccessNegativeTestJSON-1779691288-project-admin Oct 04 18:27:50.435425 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:27:50.435425 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:27:50.435425 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: edd87db69669473dbe5f372223d9d4ec Oct 04 18:27:50.435425 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1779691288-project-admin Oct 04 18:27:50.435425 n-d-850501-14 devstack@n-api.service[123002]: Oct 04 18:27:50.435425 n-d-850501-14 devstack@n-api.service[123002]: {"addTenantAccess": {"tenant": "a59c9b12aabe4ee4ae2ad4338d0946e3"}} Oct 04 18:27:50.435425 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:27:50.440234 n-d-850501-14 devstack@n-api.service[123002]: exception: Flavor access already exists for flavor 16 and project a59c9b12aabe4ee4ae2ad4338d0946e3 combination. Oct 04 18:27:50.440234 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '909357075', 'body': {'addTenantAccess': {'tenant': 'a59c9b12aabe4ee4ae2ad4338d0946e3'}}} Oct 04 18:27:50.440234 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:27:50.440234 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:27:50.440234 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 18:27:50.440234 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 04 18:27:50.440234 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 18:27:50.440234 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 04 18:27:50.440234 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 18:27:50.440234 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 04 18:27:50.440234 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 18:27:50.440234 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 04 18:27:50.440234 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 18:27:50.440234 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 18:27:50.440234 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 18:27:50.440234 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi result.read() Oct 04 18:27:50.440234 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 18:27:50.440234 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 04 18:27:50.441505 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 18:27:50.441505 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 04 18:27:50.441505 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 18:27:50.441505 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 04 18:27:50.441505 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 18:27:50.441505 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 04 18:27:50.441505 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '16-a59c9b12aabe4ee4ae2ad4338d0946e3' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 04 18:27:50.441505 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:27:50.441505 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 04 18:27:50.441505 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:27:50.441505 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:27:50.441505 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Oct 04 18:27:50.441505 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi project.save(context.session) Oct 04 18:27:50.441505 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 04 18:27:50.441505 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi session.flush() Oct 04 18:27:50.441505 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 04 18:27:50.441505 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 04 18:27:50.441505 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 04 18:27:50.441505 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 04 18:27:50.442519 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 04 18:27:50.442519 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 04 18:27:50.442519 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 18:27:50.442519 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception Oct 04 18:27:50.442519 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 04 18:27:50.442519 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 04 18:27:50.442519 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 04 18:27:50.442519 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 04 18:27:50.442519 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 04 18:27:50.442519 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 04 18:27:50.442519 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 04 18:27:50.442519 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 04 18:27:50.442519 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 04 18:27:50.442519 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 04 18:27:50.442519 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 04 18:27:50.442519 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 04 18:27:50.442519 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 04 18:27:50.442519 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 04 18:27:50.443476 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 04 18:27:50.443476 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 04 18:27:50.443476 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 04 18:27:50.443476 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 04 18:27:50.443476 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 04 18:27:50.443476 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 04 18:27:50.443476 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 18:27:50.443476 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception Oct 04 18:27:50.443476 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 18:27:50.443476 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 04 18:27:50.443476 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 18:27:50.443476 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 04 18:27:50.443476 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 18:27:50.443476 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 04 18:27:50.443476 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 18:27:50.443476 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 04 18:27:50.443476 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 18:27:50.443476 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 18:27:50.444495 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 18:27:50.444495 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi result.read() Oct 04 18:27:50.444495 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 18:27:50.444495 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 04 18:27:50.444495 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 18:27:50.444495 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 04 18:27:50.444495 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 18:27:50.444495 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 04 18:27:50.444495 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 18:27:50.444495 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 04 18:27:50.444495 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '16-a59c9b12aabe4ee4ae2ad4338d0946e3' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 04 18:27:50.444495 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Oct 04 18:27:50.444495 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 4, 18, 27, 50, 361331), 'updated_at': None, 'flavor_id': 16, 'project_id': 'a59c9b12aabe4ee4ae2ad4338d0946e3'}] Oct 04 18:27:50.444495 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 04 18:27:50.444495 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:27:50.444495 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:27:50.444495 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:27:50.445410 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:27:50.445410 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Oct 04 18:27:50.445410 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Oct 04 18:27:50.445410 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 04 18:27:50.445410 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 04 18:27:50.445410 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Oct 04 18:27:50.445410 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Oct 04 18:27:50.445410 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Oct 04 18:27:50.445410 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Oct 04 18:27:50.445410 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Oct 04 18:27:50.445410 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Oct 04 18:27:50.445410 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:27:50.445410 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:27:50.445410 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Oct 04 18:27:50.445410 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Oct 04 18:27:50.445410 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 16 and project a59c9b12aabe4ee4ae2ad4338d0946e3 combination. Oct 04 18:27:50.445410 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:27:50.445410 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:27:50.445410 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:27:50.446832 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:27:50.446832 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:27:50.446832 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:27:50.446832 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:27:50.446832 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:27:50.446832 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:27:50.446832 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:27:50.446832 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:27:50.446832 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:27:50.446832 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Oct 04 18:27:50.446832 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Oct 04 18:27:50.446832 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 16 and project a59c9b12aabe4ee4ae2ad4338d0946e3 combination. Oct 04 18:27:50.446832 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:27:50.446832 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:27:50.446832 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:27:50.446832 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:27:50.446832 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:27:50.446832 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:27:50.446832 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:27:50.446832 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:27:50.447988 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 16 and project a59c9b12aabe4ee4ae2ad4338d0946e3 combination. Oct 04 18:27:50.447988 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:27:50.447988 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-41bcfec1-2332-4758-aef6-aeed2c04e513 tempest-FlavorsAccessNegativeTestJSON-1779691288 tempest-FlavorsAccessNegativeTestJSON-1779691288-project-admin] Returning 409 to user: Flavor access already exists for flavor 16 and project a59c9b12aabe4ee4ae2ad4338d0946e3 combination. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:27:50.447988 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-41bcfec1-2332-4758-aef6-aeed2c04e513 tempest-FlavorsAccessNegativeTestJSON-1779691288 tempest-FlavorsAccessNegativeTestJSON-1779691288-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/909357075/action" status: 409 len: 152 microversion: 2.1 time: 0.460849 Oct 04 18:27:50.447988 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 11/17] 10.222.0.20 () {60 vars in 1197 bytes} [Tue Oct 4 18:27:49 2022] POST /compute/v2.1/flavors/909357075/action => generated 152 bytes in 462 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:27:50.451336 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3c791143-3cbd-4013-a8f9-d9430b4a2efe tempest-FlavorsAdminTestJSON-17563934 tempest-FlavorsAdminTestJSON-17563934-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:50.511178 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3c791143-3cbd-4013-a8f9-d9430b4a2efe tempest-FlavorsAdminTestJSON-17563934 tempest-FlavorsAdminTestJSON-17563934-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.063397 Oct 04 18:27:50.513986 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 12/18] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Oct 4 18:27:50 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:50.525433 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8d350e9e-c255-444d-b01e-b8cbefd0be19 tempest-FlavorsAccessNegativeTestJSON-1779691288 tempest-FlavorsAccessNegativeTestJSON-1779691288-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "a59c9b12aabe4ee4ae2ad4338d0946e3"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:50.660426 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-35389a05-a72d-4a00-b12a-367dc8add30d tempest-AggregatesAdminTestV241-1520563578 tempest-AggregatesAdminTestV241-1520563578-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 315 microversion: 2.41 time: 0.723590 Oct 04 18:27:50.660426 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 7/19] 10.222.0.20 () {62 vars in 1232 bytes} [Tue Oct 4 18:27:49 2022] POST /compute/v2.1/os-aggregates/1/action => generated 315 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:27:50.673538 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0f2b3fe7-5ce8-4ab0-b519-b3f905e20462 tempest-FlavorsAdminTestJSON-17563934 tempest-FlavorsAdminTestJSON-17563934-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:50.691317 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8d350e9e-c255-444d-b01e-b8cbefd0be19 tempest-FlavorsAccessNegativeTestJSON-1779691288 tempest-FlavorsAccessNegativeTestJSON-1779691288-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/909357075/action" status: 200 len: 21 microversion: 2.1 time: 0.176143 Oct 04 18:27:50.697103 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 13/20] 10.222.0.20 () {60 vars in 1197 bytes} [Tue Oct 4 18:27:50 2022] POST /compute/v2.1/flavors/909357075/action => generated 21 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:27:50.702286 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-74c81961-ddd0-498a-9843-02e8df4f1a7c tempest-AggregatesAdminTestV241-1520563578 tempest-AggregatesAdminTestV241-1520563578-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-850501-14"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:50.762798 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-74c81961-ddd0-498a-9843-02e8df4f1a7c tempest-AggregatesAdminTestV241-1520563578 tempest-AggregatesAdminTestV241-1520563578-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:50.764157 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-74c81961-ddd0-498a-9843-02e8df4f1a7c tempest-AggregatesAdminTestV241-1520563578 tempest-AggregatesAdminTestV241-1520563578-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:50.764689 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-74c81961-ddd0-498a-9843-02e8df4f1a7c tempest-AggregatesAdminTestV241-1520563578 tempest-AggregatesAdminTestV241-1520563578-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:50.817915 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0f2b3fe7-5ce8-4ab0-b519-b3f905e20462 tempest-FlavorsAdminTestJSON-17563934 tempest-FlavorsAdminTestJSON-17563934-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/837469901" status: 202 len: 0 microversion: 2.1 time: 0.157355 Oct 04 18:27:50.825261 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 8/21] 10.222.0.20 () {58 vars in 1158 bytes} [Tue Oct 4 18:27:50 2022] DELETE /compute/v2.1/flavors/837469901 => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:27:50.825881 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3713155c-7113-43de-b874-5cfa98261002 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:50.826833 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3713155c-7113-43de-b874-5cfa98261002 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] [instance: 6da2d407-863f-4f6a-9d71-d81e96f160fb] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:50.905693 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3713155c-7113-43de-b874-5cfa98261002 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f87d9eaf49545bb8effb170768bb8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e99a0400fe947bb8907857cc4de2899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:50.922517 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3713155c-7113-43de-b874-5cfa98261002 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] 10.222.0.20 "GET /compute/v2.1/servers/6da2d407-863f-4f6a-9d71-d81e96f160fb" status: 200 len: 1219 microversion: 2.1 time: 0.101754 Oct 04 18:27:50.936528 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 9/22] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:50 2022] GET /compute/v2.1/servers/6da2d407-863f-4f6a-9d71-d81e96f160fb => generated 1219 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:50.941981 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b61e7883-7b3c-43d0-9245-7a92157be86d tempest-FlavorsAccessNegativeTestJSON-1779691288 tempest-FlavorsAccessNegativeTestJSON-1779691288-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:51.051881 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b61e7883-7b3c-43d0-9245-7a92157be86d tempest-FlavorsAccessNegativeTestJSON-1779691288 tempest-FlavorsAccessNegativeTestJSON-1779691288-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/909357075" status: 202 len: 0 microversion: 2.1 time: 0.114101 Oct 04 18:27:51.052667 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 10/23] 10.222.0.20 () {58 vars in 1158 bytes} [Tue Oct 4 18:27:50 2022] DELETE /compute/v2.1/flavors/909357075 => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:27:51.063920 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-32fc8814-99e5-4fe3-9fbd-493b6ebd1ab2 tempest-FlavorsAdminTestJSON-17563934 tempest-FlavorsAdminTestJSON-17563934-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:51.131040 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-32fc8814-99e5-4fe3-9fbd-493b6ebd1ab2 tempest-FlavorsAdminTestJSON-17563934 tempest-FlavorsAdminTestJSON-17563934-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.077127 Oct 04 18:27:51.131874 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 11/24] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Oct 4 18:27:51 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:51.137145 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-de69d576-3c74-4590-bfe2-c3a7cb9f7681 tempest-FlavorsAccessNegativeTestJSON-1779691288 tempest-FlavorsAccessNegativeTestJSON-1779691288-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:51.165607 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-de69d576-3c74-4590-bfe2-c3a7cb9f7681 tempest-FlavorsAccessNegativeTestJSON-1779691288 tempest-FlavorsAccessNegativeTestJSON-1779691288-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.032348 Oct 04 18:27:51.166436 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 12/25] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Oct 4 18:27:51 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:51.185903 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8ca1f5ff-14c8-4710-9244-4d6d2100e560 tempest-FlavorsAdminTestJSON-17563934 tempest-FlavorsAdminTestJSON-17563934-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-124292451", "id": 1640807954, "os-flavor-access:is_public": "True"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:51.288394 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8ca1f5ff-14c8-4710-9244-4d6d2100e560 tempest-FlavorsAdminTestJSON-17563934 tempest-FlavorsAdminTestJSON-17563934-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.120720 Oct 04 18:27:51.289305 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 13/26] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:27:51 2022] POST /compute/v2.1/flavors => generated 428 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:27:51.299584 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9954b16a-d0dd-4593-8779-90771c1f9abe tempest-FlavorsAccessNegativeTestJSON-1779691288 tempest-FlavorsAccessNegativeTestJSON-1779691288-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-597669338", "id": 1601483244, "os-flavor-access:is_public": "True"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:51.323858 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-74c81961-ddd0-498a-9843-02e8df4f1a7c tempest-AggregatesAdminTestV241-1520563578 tempest-AggregatesAdminTestV241-1520563578-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 299 microversion: 2.41 time: 0.630182 Oct 04 18:27:51.324694 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 14/27] 10.222.0.20 () {62 vars in 1232 bytes} [Tue Oct 4 18:27:50 2022] POST /compute/v2.1/os-aggregates/1/action => generated 299 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:27:51.344602 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e93d8537-3fe9-4bb1-a6ae-aabc9806f5d2 tempest-FlavorsAdminTestJSON-17563934 tempest-FlavorsAdminTestJSON-17563934-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:51.421480 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9954b16a-d0dd-4593-8779-90771c1f9abe tempest-FlavorsAccessNegativeTestJSON-1779691288 tempest-FlavorsAccessNegativeTestJSON-1779691288-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.130543 Oct 04 18:27:51.422345 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 14/28] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:27:51 2022] POST /compute/v2.1/flavors => generated 437 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:27:51.434727 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-913a2f78-bc58-4264-8d07-6435054d137b tempest-AggregatesAdminTestV241-1520563578 tempest-AggregatesAdminTestV241-1520563578-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:51.449489 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e93d8537-3fe9-4bb1-a6ae-aabc9806f5d2 tempest-FlavorsAdminTestJSON-17563934 tempest-FlavorsAdminTestJSON-17563934-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1640807954" status: 202 len: 0 microversion: 2.1 time: 0.113386 Oct 04 18:27:51.450315 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 15/29] 10.222.0.20 () {58 vars in 1161 bytes} [Tue Oct 4 18:27:51 2022] DELETE /compute/v2.1/flavors/1640807954 => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:27:51.460144 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-095d4125-f366-468f-820c-9c6412a67c70 tempest-FlavorsAccessNegativeTestJSON-1779691288 tempest-FlavorsAccessNegativeTestJSON-1779691288-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:51.476562 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-095d4125-f366-468f-820c-9c6412a67c70 tempest-FlavorsAccessNegativeTestJSON-1779691288 tempest-FlavorsAccessNegativeTestJSON-1779691288-project-admin] HTTP exception thrown: Access list not available for public flavors. Oct 04 18:27:51.482489 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-095d4125-f366-468f-820c-9c6412a67c70 tempest-FlavorsAccessNegativeTestJSON-1779691288 tempest-FlavorsAccessNegativeTestJSON-1779691288-project-admin] Request method failure captured: Oct 04 18:27:51.482489 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/flavors/1601483244/os-flavor-access HTTP/1.1 Oct 04 18:27:51.482489 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:27:51.482489 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:27:51.482489 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:27:51.482489 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:27:51.482489 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:27:51.482489 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:27:51.482489 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:27:51.482489 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:27:51.482489 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPHsjF918m3OlvDiVH37HZbj3AvG1kM8g6Hf0wEW0aqyA3DCvry7OGvvqzVS5UQvByMiHlQJhn_JnKxsciGvJfU87zAqPM2n95rJnLWMQfiDDceIUiPux4Pug2ONv1FljKfWT80wklW383n62t78xAkkLAvdZoqxqbhtQulwrW7oUqUE Oct 04 18:27:51.482489 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:27:51.482489 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:27:51.482489 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:27:51.482489 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:27:51.482489 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:27:51.482489 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:27:51.482489 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 75c07803a2514e798c79d2ac6010a3fb Oct 04 18:27:51.482489 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1779691288 Oct 04 18:27:51.482489 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member,admin Oct 04 18:27:51.482489 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member,admin Oct 04 18:27:51.489321 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/75c07803a2514e798c79d2ac6010a3fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_75c07803a2514e798c79d2ac6010a3fb", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/75c07803a2514e798c79d2ac6010a3fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/75c07803a2514e798c79d2ac6010a3fb"}]}] Oct 04 18:27:51.489321 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1779691288 Oct 04 18:27:51.489321 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 75c07803a2514e798c79d2ac6010a3fb Oct 04 18:27:51.489321 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1779691288 Oct 04 18:27:51.489321 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-FlavorsAccessNegativeTestJSON-1779691288-project-admin Oct 04 18:27:51.489321 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:27:51.489321 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:27:51.489321 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: edd87db69669473dbe5f372223d9d4ec Oct 04 18:27:51.489321 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1779691288-project-admin Oct 04 18:27:51.489321 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:27:51.489321 n-d-850501-14 devstack@n-api.service[123002]: exception: Access list not available for public flavors. Oct 04 18:27:51.489321 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'flavor_id': '1601483244'} Oct 04 18:27:51.490069 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:27:51.490069 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:27:51.490069 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:27:51.490069 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:27:51.490069 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:27:51.490069 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:27:51.490069 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:27:51.490069 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:27:51.490069 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Oct 04 18:27:51.490069 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 18:27:51.490069 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Oct 04 18:27:51.490069 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:27:51.490069 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:27:51.490069 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:27:51.490069 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:27:51.490069 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:27:51.490069 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:27:51.490069 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:27:51.490069 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:27:51.490069 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Oct 04 18:27:51.490069 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:27:51.491326 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-095d4125-f366-468f-820c-9c6412a67c70 tempest-FlavorsAccessNegativeTestJSON-1779691288 tempest-FlavorsAccessNegativeTestJSON-1779691288-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:27:51.491326 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-095d4125-f366-468f-820c-9c6412a67c70 tempest-FlavorsAccessNegativeTestJSON-1779691288 tempest-FlavorsAccessNegativeTestJSON-1779691288-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/1601483244/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.032741 Oct 04 18:27:51.491326 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 16/30] 10.222.0.20 () {58 vars in 1209 bytes} [Tue Oct 4 18:27:51 2022] GET /compute/v2.1/flavors/1601483244/os-flavor-access => generated 91 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:27:51.498649 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a0319b91-9126-48ce-9201-b83bc0e125ca tempest-FlavorsAdminTestJSON-17563934 tempest-FlavorsAdminTestJSON-17563934-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:51.533439 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a0319b91-9126-48ce-9201-b83bc0e125ca tempest-FlavorsAdminTestJSON-17563934 tempest-FlavorsAdminTestJSON-17563934-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5418 microversion: 2.1 time: 0.047184 Oct 04 18:27:51.536406 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 17/31] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Oct 4 18:27:51 2022] GET /compute/v2.1/flavors/detail => generated 5418 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:51.542040 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-085f03f5-2ad6-4254-a454-ae3c7a0e0931 tempest-FlavorsAccessNegativeTestJSON-1779691288 tempest-FlavorsAccessNegativeTestJSON-1779691288-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:51.584366 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-913a2f78-bc58-4264-8d07-6435054d137b tempest-AggregatesAdminTestV241-1520563578 tempest-AggregatesAdminTestV241-1520563578-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.41 time: 0.153192 Oct 04 18:27:51.585748 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 15/32] 10.222.0.20 () {60 vars in 1193 bytes} [Tue Oct 4 18:27:51 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:27:51.603433 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7506fc2a-12cd-4e60-8c02-6a439b0dc880 tempest-FlavorsAdminTestJSON-17563934 tempest-FlavorsAdminTestJSON-17563934-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1342821219", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:51.716456 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-085f03f5-2ad6-4254-a454-ae3c7a0e0931 tempest-FlavorsAccessNegativeTestJSON-1779691288 tempest-FlavorsAccessNegativeTestJSON-1779691288-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1601483244" status: 202 len: 0 microversion: 2.1 time: 0.178464 Oct 04 18:27:51.726770 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 18/33] 10.222.0.20 () {58 vars in 1161 bytes} [Tue Oct 4 18:27:51 2022] DELETE /compute/v2.1/flavors/1601483244 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:27:51.745739 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7506fc2a-12cd-4e60-8c02-6a439b0dc880 tempest-FlavorsAdminTestJSON-17563934 tempest-FlavorsAdminTestJSON-17563934-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.157407 Oct 04 18:27:51.747361 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 16/34] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:27:51 2022] POST /compute/v2.1/flavors => generated 507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:27:51.752460 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-112b4487-6acc-4ddf-bddf-1bfb19aff834 tempest-FlavorsAccessNegativeTestJSON-1779691288 tempest-FlavorsAccessNegativeTestJSON-1779691288-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:51.754582 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-095e1873-33a0-4d93-8dec-92ecd36f5902 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1843180840", "name": "tempest-test_aggregate-246455784"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:51.780939 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.aggregate [None req-095e1873-33a0-4d93-8dec-92ecd36f5902 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Generated uuid a4f3ca84-0a1d-4742-91f6-156a323d126c for aggregate {{(pid=123002) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 18:27:51.782065 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-112b4487-6acc-4ddf-bddf-1bfb19aff834 tempest-FlavorsAccessNegativeTestJSON-1779691288 tempest-FlavorsAccessNegativeTestJSON-1779691288-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5488 microversion: 2.1 time: 0.032578 Oct 04 18:27:51.784208 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 17/35] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Oct 4 18:27:51 2022] GET /compute/v2.1/flavors/detail => generated 5488 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:51.790425 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d7919c24-c59e-43f8-a5df-bc5ef16908b7 tempest-FlavorsAdminTestJSON-17563934 tempest-FlavorsAdminTestJSON-17563934-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:51.924429 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d7919c24-c59e-43f8-a5df-bc5ef16908b7 tempest-FlavorsAdminTestJSON-17563934 tempest-FlavorsAdminTestJSON-17563934-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/2b950c1e-3a47-4734-87d9-473cd9cd71e6" status: 202 len: 0 microversion: 2.1 time: 0.128031 Oct 04 18:27:51.924429 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 18/36] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:27:51 2022] DELETE /compute/v2.1/flavors/2b950c1e-3a47-4734-87d9-473cd9cd71e6 => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:27:51.925520 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ce95f205-33ff-4fae-9667-78903bf38e0a tempest-FlavorsAccessNegativeTestJSON-1779691288 tempest-FlavorsAccessNegativeTestJSON-1779691288-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1514420281", "id": 2139763807, "os-flavor-access:is_public": "False"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:51.927245 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-095e1873-33a0-4d93-8dec-92ecd36f5902 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.195294 Oct 04 18:27:51.928541 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 19/37] 10.222.0.20 () {60 vars in 1165 bytes} [Tue Oct 4 18:27:51 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:27:51.946243 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a8c16254-ca52-42b5-85cf-90aabe4b7cee tempest-FlavorsAdminTestJSON-17563934 tempest-FlavorsAdminTestJSON-17563934-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:51.978933 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a8c16254-ca52-42b5-85cf-90aabe4b7cee tempest-FlavorsAdminTestJSON-17563934 tempest-FlavorsAdminTestJSON-17563934-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.049028 Oct 04 18:27:51.979715 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 20/38] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Oct 4 18:27:51 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:51.984179 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4f44f53e-78ee-4680-9264-2364d8dbeca9 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:52.004158 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4f44f53e-78ee-4680-9264-2364d8dbeca9 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates" status: 200 len: 302 microversion: 2.1 time: 0.023173 Oct 04 18:27:52.004780 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 21/39] 10.222.0.20 () {58 vars in 1143 bytes} [Tue Oct 4 18:27:51 2022] GET /compute/v2.1/os-aggregates => generated 302 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:27:52.011359 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-47550997-4108-4fd1-a9be-419773520586 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:52.022477 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-47550997-4108-4fd1-a9be-419773520586 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] [instance: 6da2d407-863f-4f6a-9d71-d81e96f160fb] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:52.045672 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-47550997-4108-4fd1-a9be-419773520586 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:52.046179 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-47550997-4108-4fd1-a9be-419773520586 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:52.046616 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-47550997-4108-4fd1-a9be-419773520586 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:52.047604 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-47550997-4108-4fd1-a9be-419773520586 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:52.048079 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-47550997-4108-4fd1-a9be-419773520586 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:52.048528 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-47550997-4108-4fd1-a9be-419773520586 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:52.050685 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=11,nova_api:UPDATE=1,nova_api:DELETE=11 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:27:52.053238 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ce95f205-33ff-4fae-9667-78903bf38e0a tempest-FlavorsAccessNegativeTestJSON-1779691288 tempest-FlavorsAccessNegativeTestJSON-1779691288-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.133080 Oct 04 18:27:52.056606 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 19/40] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:27:51 2022] POST /compute/v2.1/flavors => generated 439 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:27:52.061008 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-df8baa2e-b3a0-464f-ab43-357e85d1fc5e tempest-FlavorsAdminTestJSON-17563934 tempest-FlavorsAdminTestJSON-17563934-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-598230554", "id": "0ace7421-3f58-4b1e-a888-f289bdbee119", "os-flavor-access:is_public": "True"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:52.189365 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-df8baa2e-b3a0-464f-ab43-357e85d1fc5e tempest-FlavorsAdminTestJSON-17563934 tempest-FlavorsAdminTestJSON-17563934-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.132246 Oct 04 18:27:52.199025 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 20/41] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:27:52 2022] POST /compute/v2.1/flavors => generated 506 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:27:52.205022 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-60e94425-ec3c-4e44-9bae-18620cfce548 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-850501-14"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:52.233238 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-60e94425-ec3c-4e44-9bae-18620cfce548 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:52.233746 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-60e94425-ec3c-4e44-9bae-18620cfce548 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:52.234249 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-60e94425-ec3c-4e44-9bae-18620cfce548 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:52.321219 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-47550997-4108-4fd1-a9be-419773520586 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f87d9eaf49545bb8effb170768bb8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e99a0400fe947bb8907857cc4de2899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:52.348340 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-47550997-4108-4fd1-a9be-419773520586 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] 10.222.0.20 "GET /compute/v2.1/servers/6da2d407-863f-4f6a-9d71-d81e96f160fb" status: 200 len: 1215 microversion: 2.1 time: 0.342252 Oct 04 18:27:52.353807 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 22/42] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:52 2022] GET /compute/v2.1/servers/6da2d407-863f-4f6a-9d71-d81e96f160fb => generated 1215 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:52.704908 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-60e94425-ec3c-4e44-9bae-18620cfce548 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 315 microversion: 2.1 time: 0.503925 Oct 04 18:27:52.707052 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 21/43] 10.222.0.20 () {60 vars in 1191 bytes} [Tue Oct 4 18:27:52 2022] POST /compute/v2.1/os-aggregates/2/action => generated 315 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:27:52.714843 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d316bac3-e32a-435b-9708-b4a157023914 tempest-FlavorsAdminTestJSON-17563934 tempest-FlavorsAdminTestJSON-17563934-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:52.856888 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d316bac3-e32a-435b-9708-b4a157023914 tempest-FlavorsAdminTestJSON-17563934 tempest-FlavorsAdminTestJSON-17563934-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/0ace7421-3f58-4b1e-a888-f289bdbee119" status: 202 len: 0 microversion: 2.1 time: 0.148100 Oct 04 18:27:52.860868 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 22/44] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:27:52 2022] DELETE /compute/v2.1/flavors/0ace7421-3f58-4b1e-a888-f289bdbee119 => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:27:52.865759 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5fa0b7d6-67e7-4085-88a6-849bcad45bdb tempest-FlavorsAdminTestJSON-17563934 tempest-FlavorsAdminTestJSON-17563934-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:52.893347 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5fa0b7d6-67e7-4085-88a6-849bcad45bdb tempest-FlavorsAdminTestJSON-17563934 tempest-FlavorsAdminTestJSON-17563934-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.031230 Oct 04 18:27:52.894333 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 23/45] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Oct 4 18:27:52 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:52.925736 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e52591f4-f0e8-4764-b3d1-206e79cfd519 tempest-FlavorsAdminTestJSON-17563934 tempest-FlavorsAdminTestJSON-17563934-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-654368690", "id": 304356214, "os-flavor-access:is_public": "True"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:52.930733 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-aad60978-f4c3-4dd3-bceb-b923e47fc112 tempest-FlavorsAccessNegativeTestJSON-1288151108 tempest-FlavorsAccessNegativeTestJSON-1288151108-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "a59c9b12aabe4ee4ae2ad4338d0946e3"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:52.934686 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-aad60978-f4c3-4dd3-bceb-b923e47fc112 tempest-FlavorsAccessNegativeTestJSON-1288151108 tempest-FlavorsAccessNegativeTestJSON-1288151108-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '533e30a11efa456ea1765f5f7dccb11e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59c9b12aabe4ee4ae2ad4338d0946e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:52.943800 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-aad60978-f4c3-4dd3-bceb-b923e47fc112 tempest-FlavorsAccessNegativeTestJSON-1288151108 tempest-FlavorsAccessNegativeTestJSON-1288151108-project] Request method failure captured: Oct 04 18:27:52.943800 n-d-850501-14 devstack@n-api.service[123002]: request: POST /compute/v2.1/flavors/2139763807/action HTTP/1.1 Oct 04 18:27:52.943800 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:27:52.943800 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:27:52.943800 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:27:52.943800 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 67 Oct 04 18:27:52.943800 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:27:52.943800 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:27:52.943800 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:27:52.943800 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:27:52.943800 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPHsgyi_tLgFMjJ5r-_3_uX6zXBQQh9my_u3mlqY4YppZy8EzzgIPGynFcAxaZ46Gh9SJIEXif5jKF-ECKBc7LHIWMqy9HpiKi5yHl_VIUgmb76BV9NmP1YmIFeQUrNRecnj_X-A7fstitLN_NmDOsBQD1mCnVzHfyoz63E5-muthdgI Oct 04 18:27:52.943800 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:27:52.943800 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:27:52.943800 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:27:52.943800 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:27:52.943800 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:27:52.943800 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:27:52.943800 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: a59c9b12aabe4ee4ae2ad4338d0946e3 Oct 04 18:27:52.943800 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1288151108 Oct 04 18:27:52.943800 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:27:52.943800 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:27:52.944991 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a59c9b12aabe4ee4ae2ad4338d0946e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a59c9b12aabe4ee4ae2ad4338d0946e3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a59c9b12aabe4ee4ae2ad4338d0946e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a59c9b12aabe4ee4ae2ad4338d0946e3"}]}] Oct 04 18:27:52.944991 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1288151108 Oct 04 18:27:52.944991 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: a59c9b12aabe4ee4ae2ad4338d0946e3 Oct 04 18:27:52.944991 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1288151108 Oct 04 18:27:52.944991 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-FlavorsAccessNegativeTestJSON-1288151108-project Oct 04 18:27:52.944991 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:27:52.944991 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:27:52.944991 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 533e30a11efa456ea1765f5f7dccb11e Oct 04 18:27:52.944991 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1288151108-project Oct 04 18:27:52.944991 n-d-850501-14 devstack@n-api.service[123002]: Oct 04 18:27:52.944991 n-d-850501-14 devstack@n-api.service[123002]: {"addTenantAccess": {"tenant": "a59c9b12aabe4ee4ae2ad4338d0946e3"}} Oct 04 18:27:52.944991 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:27:52.946408 n-d-850501-14 devstack@n-api.service[123002]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 04 18:27:52.946408 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '2139763807', 'body': {'addTenantAccess': {'tenant': 'a59c9b12aabe4ee4ae2ad4338d0946e3'}}} Oct 04 18:27:52.946408 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:27:52.946408 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:27:52.946408 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:27:52.946408 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:27:52.946408 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:27:52.946408 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:27:52.946408 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:27:52.946408 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:27:52.946408 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:27:52.946408 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:27:52.946408 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Oct 04 18:27:52.946408 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Oct 04 18:27:52.946408 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:27:52.946408 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:27:52.946408 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:27:52.946408 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:27:52.946408 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:27:52.947757 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:27:52.947757 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:27:52.947757 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:27:52.947757 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:27:52.947757 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:27:52.947757 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:27:52.947757 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:27:52.947757 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:27:52.947757 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:27:52.947757 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 04 18:27:52.947757 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:27:52.947757 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:27:52.947757 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:27:52.947757 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:27:52.947757 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:27:52.947757 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:27:52.947757 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:27:52.947757 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:27:52.947757 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 04 18:27:52.947757 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:27:52.949057 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-aad60978-f4c3-4dd3-bceb-b923e47fc112 tempest-FlavorsAccessNegativeTestJSON-1288151108 tempest-FlavorsAccessNegativeTestJSON-1288151108-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:27:52.949057 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-aad60978-f4c3-4dd3-bceb-b923e47fc112 tempest-FlavorsAccessNegativeTestJSON-1288151108 tempest-FlavorsAccessNegativeTestJSON-1288151108-project] 10.222.0.20 "POST /compute/v2.1/flavors/2139763807/action" status: 403 len: 130 microversion: 2.1 time: 0.590559 Oct 04 18:27:52.952230 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 23/46] 10.222.0.20 () {60 vars in 1200 bytes} [Tue Oct 4 18:27:52 2022] POST /compute/v2.1/flavors/2139763807/action => generated 130 bytes in 598 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:27:52.967013 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-eaf5d8e0-b19b-490f-844e-1723369ded36 tempest-FlavorsAccessNegativeTestJSON-1779691288 tempest-FlavorsAccessNegativeTestJSON-1779691288-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:53.080705 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e52591f4-f0e8-4764-b3d1-206e79cfd519 tempest-FlavorsAdminTestJSON-17563934 tempest-FlavorsAdminTestJSON-17563934-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.169309 Oct 04 18:27:53.083133 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 24/47] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:27:52 2022] POST /compute/v2.1/flavors => generated 410 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:27:53.108209 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-eaf5d8e0-b19b-490f-844e-1723369ded36 tempest-FlavorsAccessNegativeTestJSON-1779691288 tempest-FlavorsAccessNegativeTestJSON-1779691288-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/2139763807" status: 202 len: 0 microversion: 2.1 time: 0.145496 Oct 04 18:27:53.109796 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6ff8c42d-14e3-45e8-b85b-6524d3d01414 tempest-FlavorsAdminTestJSON-17563934 tempest-FlavorsAdminTestJSON-17563934-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:53.110118 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 24/48] 10.222.0.20 () {58 vars in 1161 bytes} [Tue Oct 4 18:27:52 2022] DELETE /compute/v2.1/flavors/2139763807 => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:27:53.120252 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-174cdbd5-a603-4427-8671-a839e1088a79 tempest-FlavorsAccessNegativeTestJSON-1779691288 tempest-FlavorsAccessNegativeTestJSON-1779691288-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:53.123354 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6ff8c42d-14e3-45e8-b85b-6524d3d01414 tempest-FlavorsAdminTestJSON-17563934 tempest-FlavorsAdminTestJSON-17563934-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/304356214" status: 200 len: 410 microversion: 2.1 time: 0.032200 Oct 04 18:27:53.132582 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 25/49] 10.222.0.20 () {58 vars in 1155 bytes} [Tue Oct 4 18:27:53 2022] GET /compute/v2.1/flavors/304356214 => generated 410 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:27:53.133205 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=5,nova_api:DELETE=14 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:27:53.157869 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-174cdbd5-a603-4427-8671-a839e1088a79 tempest-FlavorsAccessNegativeTestJSON-1779691288 tempest-FlavorsAccessNegativeTestJSON-1779691288-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5391 microversion: 2.1 time: 0.043481 Oct 04 18:27:53.159208 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 25/50] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Oct 4 18:27:53 2022] GET /compute/v2.1/flavors/detail => generated 5391 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:53.390591 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ec6e85b7-b560-4cf8-86c9-4b87a42be361 tempest-FlavorsAdminTestJSON-2067536755 tempest-FlavorsAdminTestJSON-2067536755-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:53.453327 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-121e76b3-2580-448a-b84f-166ec0b94ab5 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-404768142", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "availability_zone": "tempest-test_az-1843180840"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:53.479561 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ec6e85b7-b560-4cf8-86c9-4b87a42be361 tempest-FlavorsAdminTestJSON-2067536755 tempest-FlavorsAdminTestJSON-2067536755-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5391 microversion: 2.1 time: 0.344759 Oct 04 18:27:53.496581 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 26/51] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Oct 4 18:27:53 2022] GET /compute/v2.1/flavors/detail => generated 5391 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:53.502002 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-dcce4820-7d2c-4d20-a262-2de27b031ac6 tempest-FlavorsAccessNegativeTestJSON-1779691288 tempest-FlavorsAccessNegativeTestJSON-1779691288-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1364427601", "id": 1597165687, "os-flavor-access:is_public": "False"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:53.504465 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-121e76b3-2580-448a-b84f-166ec0b94ab5 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:53.504973 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-121e76b3-2580-448a-b84f-166ec0b94ab5 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:53.506471 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-121e76b3-2580-448a-b84f-166ec0b94ab5 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:53.507227 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-121e76b3-2580-448a-b84f-166ec0b94ab5 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:53.507805 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-121e76b3-2580-448a-b84f-166ec0b94ab5 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:53.508290 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-121e76b3-2580-448a-b84f-166ec0b94ab5 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:53.587333 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-dcce4820-7d2c-4d20-a262-2de27b031ac6 tempest-FlavorsAccessNegativeTestJSON-1779691288 tempest-FlavorsAccessNegativeTestJSON-1779691288-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.088256 Oct 04 18:27:53.587954 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 27/52] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:27:53 2022] POST /compute/v2.1/flavors => generated 439 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:27:53.596208 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-123901f6-4f72-43bc-a29f-edfceda44ac2 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:53.599165 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-123901f6-4f72-43bc-a29f-edfceda44ac2 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] [instance: 6da2d407-863f-4f6a-9d71-d81e96f160fb] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:53.606243 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-123901f6-4f72-43bc-a29f-edfceda44ac2 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:53.606970 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-123901f6-4f72-43bc-a29f-edfceda44ac2 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:53.607557 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-123901f6-4f72-43bc-a29f-edfceda44ac2 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:53.608524 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-123901f6-4f72-43bc-a29f-edfceda44ac2 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:53.609137 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-123901f6-4f72-43bc-a29f-edfceda44ac2 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:53.613789 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-123901f6-4f72-43bc-a29f-edfceda44ac2 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:53.631080 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-121e76b3-2580-448a-b84f-166ec0b94ab5 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] validate_networks() for None {{(pid=123002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:27:53.857015 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-123901f6-4f72-43bc-a29f-edfceda44ac2 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f87d9eaf49545bb8effb170768bb8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e99a0400fe947bb8907857cc4de2899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:53.875063 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-123901f6-4f72-43bc-a29f-edfceda44ac2 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] 10.222.0.20 "GET /compute/v2.1/servers/6da2d407-863f-4f6a-9d71-d81e96f160fb" status: 200 len: 1299 microversion: 2.1 time: 0.284005 Oct 04 18:27:53.880558 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 28/53] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:53 2022] GET /compute/v2.1/servers/6da2d407-863f-4f6a-9d71-d81e96f160fb => generated 1299 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:53.888162 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6a6f5352-28ff-41ab-b405-26089bd2e059 tempest-FlavorsAdminTestJSON-17563934 tempest-FlavorsAdminTestJSON-17563934-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:53.959524 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-121e76b3-2580-448a-b84f-166ec0b94ab5 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:27:53.961289 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-121e76b3-2580-448a-b84f-166ec0b94ab5 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:27:53.961289 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-121e76b3-2580-448a-b84f-166ec0b94ab5 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:27:53.961289 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-121e76b3-2580-448a-b84f-166ec0b94ab5 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:27:53.961526 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-121e76b3-2580-448a-b84f-166ec0b94ab5 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:27:53.975949 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-121e76b3-2580-448a-b84f-166ec0b94ab5 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:53.976481 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-121e76b3-2580-448a-b84f-166ec0b94ab5 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:53.977457 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-121e76b3-2580-448a-b84f-166ec0b94ab5 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:53.978481 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-121e76b3-2580-448a-b84f-166ec0b94ab5 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:53.978947 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-121e76b3-2580-448a-b84f-166ec0b94ab5 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:53.979381 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-121e76b3-2580-448a-b84f-166ec0b94ab5 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:54.010591 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-121e76b3-2580-448a-b84f-166ec0b94ab5 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Getting quotas for project 126dad7acaf44f909302eac21c4aafcb. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:27:54.017343 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6a6f5352-28ff-41ab-b405-26089bd2e059 tempest-FlavorsAdminTestJSON-17563934 tempest-FlavorsAdminTestJSON-17563934-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/304356214" status: 202 len: 0 microversion: 2.1 time: 0.135464 Oct 04 18:27:54.020688 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-121e76b3-2580-448a-b84f-166ec0b94ab5 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Getting quotas for user f86a8d114fbc4eb584934904d8f2ef56 and project 126dad7acaf44f909302eac21c4aafcb. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:27:54.021834 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 29/54] 10.222.0.20 () {58 vars in 1158 bytes} [Tue Oct 4 18:27:53 2022] DELETE /compute/v2.1/flavors/304356214 => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:27:54.027488 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-fc224e19-dd67-4805-88d4-6c43b4911ec6 tempest-FlavorsAccessNegativeTestJSON-1779691288 tempest-FlavorsAccessNegativeTestJSON-1779691288-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "a59c9b12aabe4ee4ae2ad4338d0946e3"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:54.041407 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-121e76b3-2580-448a-b84f-166ec0b94ab5 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Going to run 1 instances... {{(pid=123002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:27:54.044628 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-121e76b3-2580-448a-b84f-166ec0b94ab5 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] [instance: 31110a13-e556-40c8-8d78-5243794ff095] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:27:54.231300 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-121e76b3-2580-448a-b84f-166ec0b94ab5 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.070709 Oct 04 18:27:54.238760 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 26/55] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:27:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1079 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:27:54.245647 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5726f3c9-4102-4dc6-a1b0-b24cc31ea79e tempest-FlavorsAdminTestJSON-17563934 tempest-FlavorsAdminTestJSON-17563934-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:54.280428 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5726f3c9-4102-4dc6-a1b0-b24cc31ea79e tempest-FlavorsAdminTestJSON-17563934 tempest-FlavorsAdminTestJSON-17563934-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.040100 Oct 04 18:27:54.281831 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 27/56] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Oct 4 18:27:54 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:54.287276 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-27bc5fb2-afff-47ff-8129-c4da4fada81e tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:54.288138 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-27bc5fb2-afff-47ff-8129-c4da4fada81e tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] [instance: 31110a13-e556-40c8-8d78-5243794ff095] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:54.406233 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-27bc5fb2-afff-47ff-8129-c4da4fada81e tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86a8d114fbc4eb584934904d8f2ef56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126dad7acaf44f909302eac21c4aafcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:54.421089 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-27bc5fb2-afff-47ff-8129-c4da4fada81e tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] 10.222.0.20 "GET /compute/v2.1/servers/31110a13-e556-40c8-8d78-5243794ff095" status: 200 len: 1242 microversion: 2.1 time: 0.137761 Oct 04 18:27:54.421995 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 28/57] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:54 2022] GET /compute/v2.1/servers/31110a13-e556-40c8-8d78-5243794ff095 => generated 1242 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:54.435753 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-20f4ce40-5c41-4164-9e78-9cc0f1a95913 tempest-FlavorsAdminTestJSON-17563934 tempest-FlavorsAdminTestJSON-17563934-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1841861306", "id": 1620775223, "os-flavor-access:is_public": "False"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:54.557638 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-20f4ce40-5c41-4164-9e78-9cc0f1a95913 tempest-FlavorsAdminTestJSON-17563934 tempest-FlavorsAdminTestJSON-17563934-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.134232 Oct 04 18:27:54.560337 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 29/58] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:27:54 2022] POST /compute/v2.1/flavors => generated 430 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:27:54.573760 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2e63614b-ba17-4d5c-93d5-188d49ce7b4e tempest-FlavorsAdminTestJSON-2067536755 tempest-FlavorsAdminTestJSON-2067536755-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "1620775223"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:54.608887 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-2e63614b-ba17-4d5c-93d5-188d49ce7b4e tempest-FlavorsAdminTestJSON-2067536755 tempest-FlavorsAdminTestJSON-2067536755-project] HTTP exception thrown: Flavor 1620775223 could not be found. Oct 04 18:27:54.615347 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2e63614b-ba17-4d5c-93d5-188d49ce7b4e tempest-FlavorsAdminTestJSON-2067536755 tempest-FlavorsAdminTestJSON-2067536755-project] Request method failure captured: Oct 04 18:27:54.615347 n-d-850501-14 devstack@n-api.service[123002]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:27:54.615347 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:27:54.615347 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:27:54.615347 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:27:54.615347 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 107 Oct 04 18:27:54.615347 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:27:54.615347 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:27:54.615347 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:27:54.615347 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:27:54.615347 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPHsgKwIO2VQtVpaYRt0RUIklcP3F1ML1p-1iH0asaSfo6j-cWl9oMB4NevyzNETsem-cVI8S5htNUGLD5LnqJTXUwMmp4H12USjQp1WEGU0yRgO8uw8S7Qg4VGIIbANqUyJs77xQJgiIMaRBa5Tbvaas_J5bbRVYVYo3JpsDP_6Ctys Oct 04 18:27:54.615347 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:27:54.615347 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:27:54.615347 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:27:54.615347 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:27:54.615347 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:27:54.615347 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:27:54.615347 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 6fa63d4bb7e14cf8b6dfc681966e0ce1 Oct 04 18:27:54.615347 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-FlavorsAdminTestJSON-2067536755 Oct 04 18:27:54.615347 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:27:54.615347 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:27:54.616482 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6fa63d4bb7e14cf8b6dfc681966e0ce1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6fa63d4bb7e14cf8b6dfc681966e0ce1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6fa63d4bb7e14cf8b6dfc681966e0ce1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6fa63d4bb7e14cf8b6dfc681966e0ce1"}]}] Oct 04 18:27:54.616482 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-FlavorsAdminTestJSON-2067536755 Oct 04 18:27:54.616482 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 6fa63d4bb7e14cf8b6dfc681966e0ce1 Oct 04 18:27:54.616482 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-2067536755 Oct 04 18:27:54.616482 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-FlavorsAdminTestJSON-2067536755-project Oct 04 18:27:54.616482 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:27:54.616482 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:27:54.616482 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 87aeea417a734ad7b4df232793a154e1 Oct 04 18:27:54.616482 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-FlavorsAdminTestJSON-2067536755-project Oct 04 18:27:54.616482 n-d-850501-14 devstack@n-api.service[123002]: Oct 04 18:27:54.616482 n-d-850501-14 devstack@n-api.service[123002]: {"server": {"name": "test", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "1620775223"}} Oct 04 18:27:54.616482 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:27:54.616482 n-d-850501-14 devstack@n-api.service[123002]: exception: Flavor 1620775223 could not be found. Oct 04 18:27:54.617170 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'body': {'server': {'name': 'test', 'imageRef': 'f545e662-10b3-46b1-88bb-6e66dd294559', 'flavorRef': '1620775223'}}} Oct 04 18:27:54.617170 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:27:54.617170 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:27:54.617170 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 04 18:27:54.617170 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 04 18:27:54.617170 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 18:27:54.617170 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 18:27:54.617170 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:27:54.617170 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:27:54.617170 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 18:27:54.617170 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 18:27:54.617170 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 18:27:54.617170 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:27:54.617170 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 18:27:54.617170 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 18:27:54.617170 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1620775223 could not be found. Oct 04 18:27:54.617170 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:27:54.617170 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:27:54.617170 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:27:54.617170 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:27:54.618695 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:27:54.618695 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:27:54.618695 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:27:54.618695 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:27:54.618695 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:27:54.618695 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:27:54.618695 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:27:54.618695 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:27:54.618695 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:27:54.618695 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:27:54.618695 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:27:54.618695 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:27:54.618695 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 18:27:54.618695 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 04 18:27:54.618695 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 04 18:27:54.618695 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 1620775223 could not be found. Oct 04 18:27:54.618695 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:27:54.618695 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:27:54.618695 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:27:54.618695 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:27:54.618695 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:27:54.619815 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:27:54.619815 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:27:54.619815 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:27:54.619815 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1620775223 could not be found. Oct 04 18:27:54.619815 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:27:54.639911 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2e63614b-ba17-4d5c-93d5-188d49ce7b4e tempest-FlavorsAdminTestJSON-2067536755 tempest-FlavorsAdminTestJSON-2067536755-project] Returning 400 to user: Flavor 1620775223 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:27:54.641672 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2e63614b-ba17-4d5c-93d5-188d49ce7b4e tempest-FlavorsAdminTestJSON-2067536755 tempest-FlavorsAdminTestJSON-2067536755-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.072670 Oct 04 18:27:54.646567 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 30/59] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:27:54 2022] POST /compute/v2.1/servers => generated 81 bytes in 79 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 04 18:27:54.662819 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-088625bc-62dd-4216-8181-8492d85026d5 tempest-FlavorsAdminTestJSON-17563934 tempest-FlavorsAdminTestJSON-17563934-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:54.760668 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-088625bc-62dd-4216-8181-8492d85026d5 tempest-FlavorsAdminTestJSON-17563934 tempest-FlavorsAdminTestJSON-17563934-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1620775223" status: 202 len: 0 microversion: 2.1 time: 0.111489 Oct 04 18:27:54.765072 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 31/60] 10.222.0.20 () {58 vars in 1161 bytes} [Tue Oct 4 18:27:54 2022] DELETE /compute/v2.1/flavors/1620775223 => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:27:54.770211 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f92cd1d1-109f-4493-95f9-f8675ade2442 tempest-FlavorsAdminTestJSON-17563934 tempest-FlavorsAdminTestJSON-17563934-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:54.822172 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f92cd1d1-109f-4493-95f9-f8675ade2442 tempest-FlavorsAdminTestJSON-17563934 tempest-FlavorsAdminTestJSON-17563934-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.055625 Oct 04 18:27:54.837814 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 32/61] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Oct 4 18:27:54 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:54.855241 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f03a62ae-2842-4091-a644-b3164ddc8c58 tempest-FlavorsAdminTestJSON-17563934 tempest-FlavorsAdminTestJSON-17563934-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1364144584", "id": 921881397, "os-flavor-access:is_public": "False"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:54.962438 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f03a62ae-2842-4091-a644-b3164ddc8c58 tempest-FlavorsAdminTestJSON-17563934 tempest-FlavorsAdminTestJSON-17563934-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.118322 Oct 04 18:27:54.972183 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 33/62] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:27:54 2022] POST /compute/v2.1/flavors => generated 412 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:27:54.978259 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5f59bfc8-17db-493a-a553-25eddb4e4f17 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:54.979212 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5f59bfc8-17db-493a-a553-25eddb4e4f17 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] [instance: 6da2d407-863f-4f6a-9d71-d81e96f160fb] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:54.987581 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5f59bfc8-17db-493a-a553-25eddb4e4f17 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:54.988568 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5f59bfc8-17db-493a-a553-25eddb4e4f17 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:54.989252 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5f59bfc8-17db-493a-a553-25eddb4e4f17 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:54.990158 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5f59bfc8-17db-493a-a553-25eddb4e4f17 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:54.990833 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5f59bfc8-17db-493a-a553-25eddb4e4f17 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:54.991529 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5f59bfc8-17db-493a-a553-25eddb4e4f17 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:55.021580 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-fc224e19-dd67-4805-88d4-6c43b4911ec6 tempest-FlavorsAccessNegativeTestJSON-1779691288 tempest-FlavorsAccessNegativeTestJSON-1779691288-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/1597165687/action" status: 200 len: 97 microversion: 2.1 time: 0.998580 Oct 04 18:27:55.023550 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 30/63] 10.222.0.20 () {60 vars in 1200 bytes} [Tue Oct 4 18:27:54 2022] POST /compute/v2.1/flavors/1597165687/action => generated 97 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:27:55.029474 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a94b6c68-9230-4064-ad0f-e59354fe78f9 tempest-FlavorsAdminTestJSON-17563934 tempest-FlavorsAdminTestJSON-17563934-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-963095270", "id": 1193971683, "os-flavor-access:is_public": "True"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:55.128746 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5f59bfc8-17db-493a-a553-25eddb4e4f17 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f87d9eaf49545bb8effb170768bb8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e99a0400fe947bb8907857cc4de2899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:55.137473 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5f59bfc8-17db-493a-a553-25eddb4e4f17 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] 10.222.0.20 "GET /compute/v2.1/servers/6da2d407-863f-4f6a-9d71-d81e96f160fb" status: 200 len: 1299 microversion: 2.1 time: 0.163914 Oct 04 18:27:55.139115 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 34/64] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:54 2022] GET /compute/v2.1/servers/6da2d407-863f-4f6a-9d71-d81e96f160fb => generated 1299 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:55.156289 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a94b6c68-9230-4064-ad0f-e59354fe78f9 tempest-FlavorsAdminTestJSON-17563934 tempest-FlavorsAdminTestJSON-17563934-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.130791 Oct 04 18:27:55.158693 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 31/65] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:27:55 2022] POST /compute/v2.1/flavors => generated 413 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:27:55.164125 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3017288a-2f45-43ba-bb17-76fdab6f5df7 tempest-FlavorsAccessNegativeTestJSON-1288151108 tempest-FlavorsAccessNegativeTestJSON-1288151108-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "a59c9b12aabe4ee4ae2ad4338d0946e3"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:55.168395 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3017288a-2f45-43ba-bb17-76fdab6f5df7 tempest-FlavorsAccessNegativeTestJSON-1288151108 tempest-FlavorsAccessNegativeTestJSON-1288151108-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '533e30a11efa456ea1765f5f7dccb11e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59c9b12aabe4ee4ae2ad4338d0946e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:55.174837 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2fb1e673-7ec6-491e-af4f-e2c20819fdc1 tempest-FlavorsAdminTestJSON-17563934 tempest-FlavorsAdminTestJSON-17563934-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:55.185576 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3017288a-2f45-43ba-bb17-76fdab6f5df7 tempest-FlavorsAccessNegativeTestJSON-1288151108 tempest-FlavorsAccessNegativeTestJSON-1288151108-project] Request method failure captured: Oct 04 18:27:55.185576 n-d-850501-14 devstack@n-api.service[123002]: request: POST /compute/v2.1/flavors/1597165687/action HTTP/1.1 Oct 04 18:27:55.185576 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:27:55.185576 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:27:55.185576 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:27:55.185576 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 70 Oct 04 18:27:55.185576 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:27:55.185576 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:27:55.185576 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:27:55.185576 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:27:55.185576 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPHsgyi_tLgFMjJ5r-_3_uX6zXBQQh9my_u3mlqY4YppZy8EzzgIPGynFcAxaZ46Gh9SJIEXif5jKF-ECKBc7LHIWMqy9HpiKi5yHl_VIUgmb76BV9NmP1YmIFeQUrNRecnj_X-A7fstitLN_NmDOsBQD1mCnVzHfyoz63E5-muthdgI Oct 04 18:27:55.185576 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:27:55.185576 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:27:55.185576 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:27:55.185576 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:27:55.185576 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:27:55.185576 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:27:55.185576 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: a59c9b12aabe4ee4ae2ad4338d0946e3 Oct 04 18:27:55.185576 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1288151108 Oct 04 18:27:55.185576 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:27:55.185576 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:27:55.194265 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a59c9b12aabe4ee4ae2ad4338d0946e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a59c9b12aabe4ee4ae2ad4338d0946e3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a59c9b12aabe4ee4ae2ad4338d0946e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a59c9b12aabe4ee4ae2ad4338d0946e3"}]}] Oct 04 18:27:55.194265 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1288151108 Oct 04 18:27:55.194265 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: a59c9b12aabe4ee4ae2ad4338d0946e3 Oct 04 18:27:55.194265 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1288151108 Oct 04 18:27:55.194265 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-FlavorsAccessNegativeTestJSON-1288151108-project Oct 04 18:27:55.194265 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:27:55.194265 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:27:55.194265 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 533e30a11efa456ea1765f5f7dccb11e Oct 04 18:27:55.194265 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1288151108-project Oct 04 18:27:55.194265 n-d-850501-14 devstack@n-api.service[123002]: Oct 04 18:27:55.194265 n-d-850501-14 devstack@n-api.service[123002]: {"removeTenantAccess": {"tenant": "a59c9b12aabe4ee4ae2ad4338d0946e3"}} Oct 04 18:27:55.194265 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:27:55.194907 n-d-850501-14 devstack@n-api.service[123002]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 04 18:27:55.194907 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '1597165687', 'body': {'removeTenantAccess': {'tenant': 'a59c9b12aabe4ee4ae2ad4338d0946e3'}}} Oct 04 18:27:55.194907 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:27:55.194907 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:27:55.194907 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:27:55.194907 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:27:55.194907 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:27:55.194907 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:27:55.194907 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:27:55.194907 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:27:55.194907 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:27:55.194907 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:27:55.194907 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Oct 04 18:27:55.194907 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi context.can( Oct 04 18:27:55.194907 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:27:55.194907 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:27:55.194907 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:27:55.194907 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:27:55.194907 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:27:55.194907 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:27:55.196711 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:27:55.196711 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:27:55.196711 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:27:55.196711 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:27:55.196711 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:27:55.196711 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:27:55.196711 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:27:55.196711 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:27:55.196711 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 04 18:27:55.196711 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:27:55.196711 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:27:55.196711 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:27:55.196711 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:27:55.196711 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:27:55.196711 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:27:55.196711 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:27:55.196711 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:27:55.196711 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 04 18:27:55.196711 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:27:55.197867 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3017288a-2f45-43ba-bb17-76fdab6f5df7 tempest-FlavorsAccessNegativeTestJSON-1288151108 tempest-FlavorsAccessNegativeTestJSON-1288151108-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:27:55.197867 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3017288a-2f45-43ba-bb17-76fdab6f5df7 tempest-FlavorsAccessNegativeTestJSON-1288151108 tempest-FlavorsAccessNegativeTestJSON-1288151108-project] 10.222.0.20 "POST /compute/v2.1/flavors/1597165687/action" status: 403 len: 133 microversion: 2.1 time: 0.046961 Oct 04 18:27:55.197867 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 35/66] 10.222.0.20 () {60 vars in 1200 bytes} [Tue Oct 4 18:27:55 2022] POST /compute/v2.1/flavors/1597165687/action => generated 133 bytes in 50 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:27:55.210839 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3f113c7b-8643-4444-997e-6af72d435d31 tempest-FlavorsAccessNegativeTestJSON-1779691288 tempest-FlavorsAccessNegativeTestJSON-1779691288-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "a59c9b12aabe4ee4ae2ad4338d0946e3"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:55.231885 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2fb1e673-7ec6-491e-af4f-e2c20819fdc1 tempest-FlavorsAdminTestJSON-17563934 tempest-FlavorsAdminTestJSON-17563934-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 844 microversion: 2.1 time: 0.060783 Oct 04 18:27:55.239176 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 32/67] 10.222.0.20 () {58 vars in 1169 bytes} [Tue Oct 4 18:27:55 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 844 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:27:55.255148 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-fd3910aa-8150-40ad-b357-d377d300aca6 tempest-FlavorsAdminTestJSON-17563934 tempest-FlavorsAdminTestJSON-17563934-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:55.268345 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-fd3910aa-8150-40ad-b357-d377d300aca6 tempest-FlavorsAdminTestJSON-17563934 tempest-FlavorsAdminTestJSON-17563934-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 844 microversion: 2.1 time: 0.017959 Oct 04 18:27:55.268730 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 33/68] 10.222.0.20 () {58 vars in 1177 bytes} [Tue Oct 4 18:27:55 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 844 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:27:55.287004 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e69b4f50-2f86-4f81-b94e-6ce6c8fa0028 tempest-FlavorsAdminTestJSON-17563934 tempest-FlavorsAdminTestJSON-17563934-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:55.300090 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e69b4f50-2f86-4f81-b94e-6ce6c8fa0028 tempest-FlavorsAdminTestJSON-17563934 tempest-FlavorsAdminTestJSON-17563934-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 844 microversion: 2.1 time: 0.016754 Oct 04 18:27:55.335280 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 34/69] 10.222.0.20 () {58 vars in 1171 bytes} [Tue Oct 4 18:27:55 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 844 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:27:55.353992 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b1cd8126-d9b7-43cc-9651-122b5c3cb5fa tempest-FlavorsAdminTestJSON-17563934 tempest-FlavorsAdminTestJSON-17563934-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:55.392919 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b1cd8126-d9b7-43cc-9651-122b5c3cb5fa tempest-FlavorsAdminTestJSON-17563934 tempest-FlavorsAdminTestJSON-17563934-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 844 microversion: 2.1 time: 0.045689 Oct 04 18:27:55.398278 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 35/70] 10.222.0.20 () {58 vars in 1169 bytes} [Tue Oct 4 18:27:55 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 844 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:27:55.418426 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d1b02972-d282-400a-af17-3c4dd8421dc1 tempest-FlavorsAdminTestJSON-17563934 tempest-FlavorsAdminTestJSON-17563934-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:55.483777 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d1b02972-d282-400a-af17-3c4dd8421dc1 tempest-FlavorsAdminTestJSON-17563934 tempest-FlavorsAdminTestJSON-17563934-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5394 microversion: 2.1 time: 0.075527 Oct 04 18:27:55.485728 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 36/71] 10.222.0.20 () {58 vars in 1169 bytes} [Tue Oct 4 18:27:55 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5394 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:55.503265 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6702f453-be2f-4d42-b4c5-a17066e59384 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:55.504156 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6702f453-be2f-4d42-b4c5-a17066e59384 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] [instance: 31110a13-e556-40c8-8d78-5243794ff095] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:55.755655 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6702f453-be2f-4d42-b4c5-a17066e59384 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86a8d114fbc4eb584934904d8f2ef56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126dad7acaf44f909302eac21c4aafcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:55.764743 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6702f453-be2f-4d42-b4c5-a17066e59384 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] 10.222.0.20 "GET /compute/v2.1/servers/31110a13-e556-40c8-8d78-5243794ff095" status: 200 len: 1242 microversion: 2.1 time: 0.271649 Oct 04 18:27:55.769038 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 37/72] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:55 2022] GET /compute/v2.1/servers/31110a13-e556-40c8-8d78-5243794ff095 => generated 1242 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:55.800644 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9ef0bd2f-bf1f-4813-88eb-2506d852db62 tempest-FlavorsAdminTestJSON-17563934 tempest-FlavorsAdminTestJSON-17563934-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:55.889538 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9ef0bd2f-bf1f-4813-88eb-2506d852db62 tempest-FlavorsAdminTestJSON-17563934 tempest-FlavorsAdminTestJSON-17563934-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5394 microversion: 2.1 time: 0.123283 Oct 04 18:27:55.904667 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 38/73] 10.222.0.20 () {58 vars in 1175 bytes} [Tue Oct 4 18:27:55 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5394 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:55.924632 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9a4efd32-9a9e-4348-8c2c-e92324ce5fb6 tempest-FlavorsAdminTestJSON-17563934 tempest-FlavorsAdminTestJSON-17563934-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:55.958629 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9a4efd32-9a9e-4348-8c2c-e92324ce5fb6 tempest-FlavorsAdminTestJSON-17563934 tempest-FlavorsAdminTestJSON-17563934-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5394 microversion: 2.1 time: 0.052084 Oct 04 18:27:55.960791 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 39/74] 10.222.0.20 () {58 vars in 1173 bytes} [Tue Oct 4 18:27:55 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5394 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:55.983939 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-204c4913-1216-48a1-83bd-4033d6395741 tempest-FlavorsAdminTestJSON-17563934 tempest-FlavorsAdminTestJSON-17563934-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:56.018194 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-204c4913-1216-48a1-83bd-4033d6395741 tempest-FlavorsAdminTestJSON-17563934 tempest-FlavorsAdminTestJSON-17563934-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5394 microversion: 2.1 time: 0.038423 Oct 04 18:27:56.019522 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 40/75] 10.222.0.20 () {58 vars in 1169 bytes} [Tue Oct 4 18:27:55 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5394 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:56.035889 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3f113c7b-8643-4444-997e-6af72d435d31 tempest-FlavorsAccessNegativeTestJSON-1779691288 tempest-FlavorsAccessNegativeTestJSON-1779691288-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/1597165687/action" status: 200 len: 21 microversion: 2.1 time: 0.836370 Oct 04 18:27:56.036882 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 36/76] 10.222.0.20 () {60 vars in 1200 bytes} [Tue Oct 4 18:27:55 2022] POST /compute/v2.1/flavors/1597165687/action => generated 21 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:27:56.051994 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-89f5b3c2-af32-4243-a278-fc69e754e92f tempest-FlavorsAccessNegativeTestJSON-1779691288 tempest-FlavorsAccessNegativeTestJSON-1779691288-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:56.055623 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-33debc27-ff7d-42ba-8e55-21b50b243054 tempest-FlavorsAdminTestJSON-17563934 tempest-FlavorsAdminTestJSON-17563934-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:56.187944 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-89f5b3c2-af32-4243-a278-fc69e754e92f tempest-FlavorsAccessNegativeTestJSON-1779691288 tempest-FlavorsAccessNegativeTestJSON-1779691288-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1597165687" status: 202 len: 0 microversion: 2.1 time: 0.141804 Oct 04 18:27:56.190615 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-33debc27-ff7d-42ba-8e55-21b50b243054 tempest-FlavorsAdminTestJSON-17563934 tempest-FlavorsAdminTestJSON-17563934-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1193971683" status: 202 len: 0 microversion: 2.1 time: 0.147216 Oct 04 18:27:56.192587 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 41/77] 10.222.0.20 () {58 vars in 1161 bytes} [Tue Oct 4 18:27:56 2022] DELETE /compute/v2.1/flavors/1193971683 => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:27:56.195089 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 37/78] 10.222.0.20 () {58 vars in 1161 bytes} [Tue Oct 4 18:27:56 2022] DELETE /compute/v2.1/flavors/1597165687 => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:27:56.201694 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-37b5594f-df49-4e02-8316-1f96e1734012 tempest-FlavorsAdminTestJSON-17563934 tempest-FlavorsAdminTestJSON-17563934-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:56.204356 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0475a11a-ba4b-464c-b67e-f1fb328d24bf tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:56.209850 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0475a11a-ba4b-464c-b67e-f1fb328d24bf tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] [instance: 6da2d407-863f-4f6a-9d71-d81e96f160fb] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:56.230135 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0475a11a-ba4b-464c-b67e-f1fb328d24bf tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:56.237240 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0475a11a-ba4b-464c-b67e-f1fb328d24bf tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:56.237744 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0475a11a-ba4b-464c-b67e-f1fb328d24bf tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:56.238786 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0475a11a-ba4b-464c-b67e-f1fb328d24bf tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:56.239264 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0475a11a-ba4b-464c-b67e-f1fb328d24bf tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:56.239701 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0475a11a-ba4b-464c-b67e-f1fb328d24bf tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:56.250848 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-37b5594f-df49-4e02-8316-1f96e1734012 tempest-FlavorsAdminTestJSON-17563934 tempest-FlavorsAdminTestJSON-17563934-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.053545 Oct 04 18:27:56.266607 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 38/79] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Oct 4 18:27:56 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:56.273436 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-eb6cc8db-d7c8-4e51-9440-b7084dac4d00 tempest-FlavorsAccessNegativeTestJSON-1779691288 tempest-FlavorsAccessNegativeTestJSON-1779691288-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:56.369887 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-eb6cc8db-d7c8-4e51-9440-b7084dac4d00 tempest-FlavorsAccessNegativeTestJSON-1779691288 tempest-FlavorsAccessNegativeTestJSON-1779691288-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.033387 Oct 04 18:27:56.369887 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 39/80] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Oct 4 18:27:56 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:56.369887 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-fcf1b588-50b3-4b0a-9880-e0c903b51d3a tempest-FlavorsAdminTestJSON-17563934 tempest-FlavorsAdminTestJSON-17563934-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:56.691207 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0475a11a-ba4b-464c-b67e-f1fb328d24bf tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f87d9eaf49545bb8effb170768bb8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e99a0400fe947bb8907857cc4de2899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:56.720612 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0475a11a-ba4b-464c-b67e-f1fb328d24bf tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] 10.222.0.20 "GET /compute/v2.1/servers/6da2d407-863f-4f6a-9d71-d81e96f160fb" status: 200 len: 1341 microversion: 2.1 time: 0.526675 Oct 04 18:27:56.729345 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 42/81] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:56 2022] GET /compute/v2.1/servers/6da2d407-863f-4f6a-9d71-d81e96f160fb => generated 1341 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:56.736253 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3296e6f2-0359-473f-a862-82cd97b14a0e tempest-FlavorsAccessNegativeTestJSON-1779691288 tempest-FlavorsAccessNegativeTestJSON-1779691288-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-132055767", "id": 1189314469, "os-flavor-access:is_public": "False"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:56.803577 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-fcf1b588-50b3-4b0a-9880-e0c903b51d3a tempest-FlavorsAdminTestJSON-17563934 tempest-FlavorsAdminTestJSON-17563934-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/921881397" status: 202 len: 0 microversion: 2.1 time: 0.470023 Oct 04 18:27:56.808271 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 40/82] 10.222.0.20 () {58 vars in 1158 bytes} [Tue Oct 4 18:27:56 2022] DELETE /compute/v2.1/flavors/921881397 => generated 0 bytes in 471 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:27:56.809441 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5eb9ac69-f30d-453c-b3ce-a0463cd6ad42 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:56.810294 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5eb9ac69-f30d-453c-b3ce-a0463cd6ad42 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] [instance: 31110a13-e556-40c8-8d78-5243794ff095] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:56.878996 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5eb9ac69-f30d-453c-b3ce-a0463cd6ad42 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86a8d114fbc4eb584934904d8f2ef56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126dad7acaf44f909302eac21c4aafcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:56.888542 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5eb9ac69-f30d-453c-b3ce-a0463cd6ad42 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] 10.222.0.20 "GET /compute/v2.1/servers/31110a13-e556-40c8-8d78-5243794ff095" status: 200 len: 1242 microversion: 2.1 time: 0.083220 Oct 04 18:27:56.905233 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 41/83] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:56 2022] GET /compute/v2.1/servers/31110a13-e556-40c8-8d78-5243794ff095 => generated 1242 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:56.905233 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a03c620a-ee3e-487f-96f7-a84646248a1b tempest-FlavorsAdminTestJSON-17563934 tempest-FlavorsAdminTestJSON-17563934-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:56.937121 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3296e6f2-0359-473f-a862-82cd97b14a0e tempest-FlavorsAccessNegativeTestJSON-1779691288 tempest-FlavorsAccessNegativeTestJSON-1779691288-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.205830 Oct 04 18:27:56.956906 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 43/84] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:27:56 2022] POST /compute/v2.1/flavors => generated 438 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:27:56.985700 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d25539a3-20fe-4f08-803e-0310d3ad5b16 tempest-FlavorsAccessNegativeTestJSON-1779691288 tempest-FlavorsAccessNegativeTestJSON-1779691288-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "9a984369bf0343e9a70f9a15318c822b"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:56.998205 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a03c620a-ee3e-487f-96f7-a84646248a1b tempest-FlavorsAdminTestJSON-17563934 tempest-FlavorsAdminTestJSON-17563934-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.105130 Oct 04 18:27:57.001288 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 42/85] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Oct 4 18:27:56 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:57.025897 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7103860c-b6b8-492d-8040-e22e5528a0f3 tempest-FlavorsAdminTestJSON-17563934 tempest-FlavorsAdminTestJSON-17563934-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1667222522", "id": 629339213, "os-flavor-access:is_public": "False"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:57.159149 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7103860c-b6b8-492d-8040-e22e5528a0f3 tempest-FlavorsAdminTestJSON-17563934 tempest-FlavorsAdminTestJSON-17563934-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.140209 Oct 04 18:27:57.160725 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 43/86] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:27:57 2022] POST /compute/v2.1/flavors => generated 412 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:27:57.176591 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5acfbd37-405c-4f06-91ee-b67566d63ad4 tempest-FlavorsAdminTestJSON-17563934 tempest-FlavorsAdminTestJSON-17563934-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:57.229871 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5acfbd37-405c-4f06-91ee-b67566d63ad4 tempest-FlavorsAdminTestJSON-17563934 tempest-FlavorsAdminTestJSON-17563934-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.058049 Oct 04 18:27:57.234392 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 44/87] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Oct 4 18:27:57 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:57.264570 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-744099f1-e9ce-4b22-a19a-088f9b9b91ae tempest-FlavorsAdminTestJSON-2067536755 tempest-FlavorsAdminTestJSON-2067536755-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:57.339356 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-744099f1-e9ce-4b22-a19a-088f9b9b91ae tempest-FlavorsAdminTestJSON-2067536755 tempest-FlavorsAdminTestJSON-2067536755-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.084851 Oct 04 18:27:57.340410 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 45/88] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Oct 4 18:27:57 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:27:57.370215 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9290e8c0-a185-4769-b523-7cfcdf70ca06 tempest-FlavorsAdminTestJSON-17563934 tempest-FlavorsAdminTestJSON-17563934-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:57.480374 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9290e8c0-a185-4769-b523-7cfcdf70ca06 tempest-FlavorsAdminTestJSON-17563934 tempest-FlavorsAdminTestJSON-17563934-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/629339213" status: 202 len: 0 microversion: 2.1 time: 0.120495 Oct 04 18:27:57.485685 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 46/89] 10.222.0.20 () {58 vars in 1158 bytes} [Tue Oct 4 18:27:57 2022] DELETE /compute/v2.1/flavors/629339213 => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:27:57.493558 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-20dd3fc3-865f-4880-8a9e-cf157f034fec tempest-FlavorsAdminTestJSON-17563934 tempest-FlavorsAdminTestJSON-17563934-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:57.530490 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-20dd3fc3-865f-4880-8a9e-cf157f034fec tempest-FlavorsAdminTestJSON-17563934 tempest-FlavorsAdminTestJSON-17563934-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.041374 Oct 04 18:27:57.531707 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 47/90] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Oct 4 18:27:57 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:27:57.552920 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5b4b1f37-21f4-49f8-93db-805a18e8b419 tempest-FlavorsAdminTestJSON-17563934 tempest-FlavorsAdminTestJSON-17563934-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1310480386", "id": 323819680, "os-flavor-access:is_public": "True"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:57.638545 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=7,nova_api:DELETE=13 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:27:57.648577 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5b4b1f37-21f4-49f8-93db-805a18e8b419 tempest-FlavorsAdminTestJSON-17563934 tempest-FlavorsAdminTestJSON-17563934-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.100338 Oct 04 18:27:57.656271 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 48/91] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:27:57 2022] POST /compute/v2.1/flavors => generated 411 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:27:57.668379 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c6f8d923-7b82-47af-a784-03d651ad41e4 tempest-FlavorsAdminTestJSON-2067536755 tempest-FlavorsAdminTestJSON-2067536755-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:57.699732 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c6f8d923-7b82-47af-a784-03d651ad41e4 tempest-FlavorsAdminTestJSON-2067536755 tempest-FlavorsAdminTestJSON-2067536755-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5392 microversion: 2.1 time: 0.038281 Oct 04 18:27:57.705314 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 49/92] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Oct 4 18:27:57 2022] GET /compute/v2.1/flavors/detail => generated 5392 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:57.723694 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-123cddeb-207a-4d0d-9a56-8a19615a0a14 tempest-FlavorsAdminTestJSON-17563934 tempest-FlavorsAdminTestJSON-17563934-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:57.851301 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-123cddeb-207a-4d0d-9a56-8a19615a0a14 tempest-FlavorsAdminTestJSON-17563934 tempest-FlavorsAdminTestJSON-17563934-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/323819680" status: 202 len: 0 microversion: 2.1 time: 0.132350 Oct 04 18:27:57.857192 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 50/93] 10.222.0.20 () {58 vars in 1158 bytes} [Tue Oct 4 18:27:57 2022] DELETE /compute/v2.1/flavors/323819680 => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:27:57.874546 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-d25539a3-20fe-4f08-803e-0310d3ad5b16 tempest-FlavorsAccessNegativeTestJSON-1779691288 tempest-FlavorsAccessNegativeTestJSON-1779691288-project-admin] HTTP exception thrown: Flavor access not found for 28 / 9a984369bf0343e9a70f9a15318c822b combination. Oct 04 18:27:57.877314 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-92667c86-30a0-4fda-acca-20d798f944db tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:57.886261 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-92667c86-30a0-4fda-acca-20d798f944db tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] [instance: 6da2d407-863f-4f6a-9d71-d81e96f160fb] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:57.886400 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d25539a3-20fe-4f08-803e-0310d3ad5b16 tempest-FlavorsAccessNegativeTestJSON-1779691288 tempest-FlavorsAccessNegativeTestJSON-1779691288-project-admin] Request method failure captured: Oct 04 18:27:57.886400 n-d-850501-14 devstack@n-api.service[123001]: request: POST /compute/v2.1/flavors/1189314469/action HTTP/1.1 Oct 04 18:27:57.886400 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:27:57.886400 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:27:57.886400 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:27:57.886400 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 70 Oct 04 18:27:57.886400 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:27:57.886400 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:27:57.886400 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:27:57.886400 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:27:57.886400 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPHsjF918m3OlvDiVH37HZbj3AvG1kM8g6Hf0wEW0aqyA3DCvry7OGvvqzVS5UQvByMiHlQJhn_JnKxsciGvJfU87zAqPM2n95rJnLWMQfiDDceIUiPux4Pug2ONv1FljKfWT80wklW383n62t78xAkkLAvdZoqxqbhtQulwrW7oUqUE Oct 04 18:27:57.886400 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:27:57.886400 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:27:57.886400 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:27:57.886400 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:27:57.886400 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:27:57.886400 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:27:57.886400 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 75c07803a2514e798c79d2ac6010a3fb Oct 04 18:27:57.886400 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1779691288 Oct 04 18:27:57.886400 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member,admin Oct 04 18:27:57.886400 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member,admin Oct 04 18:27:57.887636 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/75c07803a2514e798c79d2ac6010a3fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_75c07803a2514e798c79d2ac6010a3fb", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/75c07803a2514e798c79d2ac6010a3fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/75c07803a2514e798c79d2ac6010a3fb"}]}] Oct 04 18:27:57.887636 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1779691288 Oct 04 18:27:57.887636 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 75c07803a2514e798c79d2ac6010a3fb Oct 04 18:27:57.887636 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1779691288 Oct 04 18:27:57.887636 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-FlavorsAccessNegativeTestJSON-1779691288-project-admin Oct 04 18:27:57.887636 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:27:57.887636 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:27:57.887636 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: edd87db69669473dbe5f372223d9d4ec Oct 04 18:27:57.887636 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1779691288-project-admin Oct 04 18:27:57.887636 n-d-850501-14 devstack@n-api.service[123001]: Oct 04 18:27:57.887636 n-d-850501-14 devstack@n-api.service[123001]: {"removeTenantAccess": {"tenant": "9a984369bf0343e9a70f9a15318c822b"}} Oct 04 18:27:57.887636 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:27:57.888314 n-d-850501-14 devstack@n-api.service[123001]: exception: Flavor access not found for 28 / 9a984369bf0343e9a70f9a15318c822b combination. Oct 04 18:27:57.888314 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '1189314469', 'body': {'removeTenantAccess': {'tenant': '9a984369bf0343e9a70f9a15318c822b'}}} Oct 04 18:27:57.888314 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:27:57.888314 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:27:57.888314 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Oct 04 18:27:57.888314 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Oct 04 18:27:57.888314 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 04 18:27:57.888314 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 04 18:27:57.888314 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Oct 04 18:27:57.888314 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Oct 04 18:27:57.888314 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Oct 04 18:27:57.888314 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Oct 04 18:27:57.888314 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Oct 04 18:27:57.888314 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Oct 04 18:27:57.888314 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:27:57.888314 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:27:57.888314 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Oct 04 18:27:57.888314 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Oct 04 18:27:57.891745 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 28 / 9a984369bf0343e9a70f9a15318c822b combination. Oct 04 18:27:57.891745 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:27:57.891745 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:27:57.891745 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:27:57.891745 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:27:57.891745 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:27:57.891745 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:27:57.891745 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:27:57.891745 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:27:57.891745 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:27:57.891745 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:27:57.891745 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:27:57.891745 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:27:57.891745 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Oct 04 18:27:57.891745 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:27:57.891745 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 28 / 9a984369bf0343e9a70f9a15318c822b combination. Oct 04 18:27:57.891745 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:27:57.891745 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:27:57.891745 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:27:57.891745 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:27:57.895271 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:27:57.895271 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:27:57.895271 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:27:57.895271 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:27:57.895271 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 28 / 9a984369bf0343e9a70f9a15318c822b combination. Oct 04 18:27:57.895271 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:27:57.895271 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d25539a3-20fe-4f08-803e-0310d3ad5b16 tempest-FlavorsAccessNegativeTestJSON-1779691288 tempest-FlavorsAccessNegativeTestJSON-1779691288-project-admin] Returning 404 to user: Flavor access not found for 28 / 9a984369bf0343e9a70f9a15318c822b combination. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:27:57.895271 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d25539a3-20fe-4f08-803e-0310d3ad5b16 tempest-FlavorsAccessNegativeTestJSON-1779691288 tempest-FlavorsAccessNegativeTestJSON-1779691288-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/1189314469/action" status: 404 len: 124 microversion: 2.1 time: 0.925745 Oct 04 18:27:57.896398 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 44/94] 10.222.0.20 () {60 vars in 1200 bytes} [Tue Oct 4 18:27:56 2022] POST /compute/v2.1/flavors/1189314469/action => generated 124 bytes in 938 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:27:57.900611 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-92667c86-30a0-4fda-acca-20d798f944db tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:57.901132 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-92667c86-30a0-4fda-acca-20d798f944db tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:57.901460 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-92667c86-30a0-4fda-acca-20d798f944db tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:57.902165 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-92667c86-30a0-4fda-acca-20d798f944db tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:57.903311 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-de8b506f-73d6-4c68-9333-6b3382fb8093 tempest-FlavorsAdminTestJSON-17563934 tempest-FlavorsAdminTestJSON-17563934-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:57.911078 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-92667c86-30a0-4fda-acca-20d798f944db tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:57.911078 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-92667c86-30a0-4fda-acca-20d798f944db tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:57.949083 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-de8b506f-73d6-4c68-9333-6b3382fb8093 tempest-FlavorsAdminTestJSON-17563934 tempest-FlavorsAdminTestJSON-17563934-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.052324 Oct 04 18:27:57.953319 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 45/95] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Oct 4 18:27:57 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:57.965706 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1287c27a-9510-4637-a8ba-1c8f76145832 tempest-FlavorsAccessNegativeTestJSON-1779691288 tempest-FlavorsAccessNegativeTestJSON-1779691288-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:57.969966 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=7,nova_api:DELETE=10 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:27:58.060198 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1287c27a-9510-4637-a8ba-1c8f76145832 tempest-FlavorsAccessNegativeTestJSON-1779691288 tempest-FlavorsAccessNegativeTestJSON-1779691288-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1189314469" status: 202 len: 0 microversion: 2.1 time: 0.104257 Oct 04 18:27:58.066617 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 46/96] 10.222.0.20 () {58 vars in 1161 bytes} [Tue Oct 4 18:27:57 2022] DELETE /compute/v2.1/flavors/1189314469 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:27:58.069574 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0f2cd4bb-404f-4470-926d-1e4dff26f8c8 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:58.073133 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0f2cd4bb-404f-4470-926d-1e4dff26f8c8 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] [instance: 31110a13-e556-40c8-8d78-5243794ff095] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:58.086030 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0f2cd4bb-404f-4470-926d-1e4dff26f8c8 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:58.086030 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0f2cd4bb-404f-4470-926d-1e4dff26f8c8 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:58.091814 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0f2cd4bb-404f-4470-926d-1e4dff26f8c8 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:58.092847 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0f2cd4bb-404f-4470-926d-1e4dff26f8c8 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:58.093562 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0f2cd4bb-404f-4470-926d-1e4dff26f8c8 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:58.094207 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0f2cd4bb-404f-4470-926d-1e4dff26f8c8 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:58.259891 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0f2cd4bb-404f-4470-926d-1e4dff26f8c8 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86a8d114fbc4eb584934904d8f2ef56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126dad7acaf44f909302eac21c4aafcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:58.280233 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-92667c86-30a0-4fda-acca-20d798f944db tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f87d9eaf49545bb8effb170768bb8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e99a0400fe947bb8907857cc4de2899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:58.285503 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0f2cd4bb-404f-4470-926d-1e4dff26f8c8 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] 10.222.0.20 "GET /compute/v2.1/servers/31110a13-e556-40c8-8d78-5243794ff095" status: 200 len: 1234 microversion: 2.1 time: 0.220039 Oct 04 18:27:58.286111 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 47/97] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:58 2022] GET /compute/v2.1/servers/31110a13-e556-40c8-8d78-5243794ff095 => generated 1234 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:58.301861 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-92667c86-30a0-4fda-acca-20d798f944db tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] 10.222.0.20 "GET /compute/v2.1/servers/6da2d407-863f-4f6a-9d71-d81e96f160fb" status: 200 len: 1341 microversion: 2.1 time: 0.419069 Oct 04 18:27:58.303312 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 51/98] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:57 2022] GET /compute/v2.1/servers/6da2d407-863f-4f6a-9d71-d81e96f160fb => generated 1341 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:58.307094 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-570e71c5-5d53-41c9-bd85-3d07803a4554 tempest-FlavorsAccessNegativeTestJSON-1779691288 tempest-FlavorsAccessNegativeTestJSON-1779691288-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:58.341142 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-570e71c5-5d53-41c9-bd85-3d07803a4554 tempest-FlavorsAccessNegativeTestJSON-1779691288 tempest-FlavorsAccessNegativeTestJSON-1779691288-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.048768 Oct 04 18:27:58.353675 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 48/99] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Oct 4 18:27:58 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:59.312515 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-988f2dac-630f-40b4-8157-fb1862f38253 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:59.329820 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-988f2dac-630f-40b4-8157-fb1862f38253 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] [instance: 31110a13-e556-40c8-8d78-5243794ff095] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:59.330471 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-cc28ab2c-ed24-479e-966a-2c62666d73df tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:59.332920 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-cc28ab2c-ed24-479e-966a-2c62666d73df tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] [instance: 6da2d407-863f-4f6a-9d71-d81e96f160fb] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:59.372948 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=4 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:27:59.405019 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-988f2dac-630f-40b4-8157-fb1862f38253 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:59.411247 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-988f2dac-630f-40b4-8157-fb1862f38253 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:59.412905 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cc28ab2c-ed24-479e-966a-2c62666d73df tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:59.416175 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-988f2dac-630f-40b4-8157-fb1862f38253 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:59.416648 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cc28ab2c-ed24-479e-966a-2c62666d73df tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:59.418143 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cc28ab2c-ed24-479e-966a-2c62666d73df tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:59.418143 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cc28ab2c-ed24-479e-966a-2c62666d73df tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:59.418316 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cc28ab2c-ed24-479e-966a-2c62666d73df tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:59.418849 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cc28ab2c-ed24-479e-966a-2c62666d73df tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:59.419654 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-988f2dac-630f-40b4-8157-fb1862f38253 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:59.421757 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-988f2dac-630f-40b4-8157-fb1862f38253 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:59.425360 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-988f2dac-630f-40b4-8157-fb1862f38253 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:59.764238 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-988f2dac-630f-40b4-8157-fb1862f38253 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86a8d114fbc4eb584934904d8f2ef56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126dad7acaf44f909302eac21c4aafcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:59.783259 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-988f2dac-630f-40b4-8157-fb1862f38253 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] 10.222.0.20 "GET /compute/v2.1/servers/31110a13-e556-40c8-8d78-5243794ff095" status: 200 len: 1298 microversion: 2.1 time: 0.476787 Oct 04 18:27:59.798471 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 52/100] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:59 2022] GET /compute/v2.1/servers/31110a13-e556-40c8-8d78-5243794ff095 => generated 1298 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:00.311642 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-cc28ab2c-ed24-479e-966a-2c62666d73df tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f87d9eaf49545bb8effb170768bb8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e99a0400fe947bb8907857cc4de2899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:00.329309 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-274f7526-3d13-4680-af88-60b6c0631cc8 req-6639f489-7fe0-48b6-ad33-cad3efcc2b15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6da2d407-863f-4f6a-9d71-d81e96f160fb", "tag": "f94fc47a-1b3f-41f3-85fc-e4179bc59d55"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:00.330160 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-cc28ab2c-ed24-479e-966a-2c62666d73df tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] 10.222.0.20 "GET /compute/v2.1/servers/6da2d407-863f-4f6a-9d71-d81e96f160fb" status: 200 len: 1341 microversion: 2.1 time: 1.012358 Oct 04 18:28:00.335420 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 49/101] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:59 2022] GET /compute/v2.1/servers/6da2d407-863f-4f6a-9d71-d81e96f160fb => generated 1341 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:28:00.369574 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-274f7526-3d13-4680-af88-60b6c0631cc8 req-6639f489-7fe0-48b6-ad33-cad3efcc2b15 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:00.370149 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-274f7526-3d13-4680-af88-60b6c0631cc8 req-6639f489-7fe0-48b6-ad33-cad3efcc2b15 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:00.370833 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-274f7526-3d13-4680-af88-60b6c0631cc8 req-6639f489-7fe0-48b6-ad33-cad3efcc2b15 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:00.470671 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-205c2aa2-442e-4115-9f3f-f08273db0a8d tempest-HypervisorAdminTestJSON-1633761200 tempest-HypervisorAdminTestJSON-1633761200-project-admin] Calling method '.version_select at 0x7fe259dd9a60>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:00.491004 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-274f7526-3d13-4680-af88-60b6c0631cc8 req-6639f489-7fe0-48b6-ad33-cad3efcc2b15 service nova] Creating event network-changed:f94fc47a-1b3f-41f3-85fc-e4179bc59d55 for instance 6da2d407-863f-4f6a-9d71-d81e96f160fb on n-h1-850501-14 Oct 04 18:28:00.493145 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-274f7526-3d13-4680-af88-60b6c0631cc8 req-6639f489-7fe0-48b6-ad33-cad3efcc2b15 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=123002) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 18:28:00.495937 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-274f7526-3d13-4680-af88-60b6c0631cc8 req-6639f489-7fe0-48b6-ad33-cad3efcc2b15 service nova] Acquired lock "compute-rpcapi-router" {{(pid=123002) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 18:28:00.497313 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-36d012fa-da71-4704-af6c-f116a026c323 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:00.497788 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-36d012fa-da71-4704-af6c-f116a026c323 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:00.498233 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-36d012fa-da71-4704-af6c-f116a026c323 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:00.498957 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-36d012fa-da71-4704-af6c-f116a026c323 None None] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:00.499810 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-205c2aa2-442e-4115-9f3f-f08273db0a8d tempest-HypervisorAdminTestJSON-1633761200 tempest-HypervisorAdminTestJSON-1633761200-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a6039a6d-a98c-44a9-819b-4eff388d8aa7(cell1) {{(pid=123001) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 04 18:28:00.500593 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-205c2aa2-442e-4115-9f3f-f08273db0a8d tempest-HypervisorAdminTestJSON-1633761200 tempest-HypervisorAdminTestJSON-1633761200-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:00.501253 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-205c2aa2-442e-4115-9f3f-f08273db0a8d tempest-HypervisorAdminTestJSON-1633761200 tempest-HypervisorAdminTestJSON-1633761200-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:00.505423 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-36d012fa-da71-4704-af6c-f116a026c323 None None] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:00.506194 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-36d012fa-da71-4704-af6c-f116a026c323 None None] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:00.508743 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-205c2aa2-442e-4115-9f3f-f08273db0a8d tempest-HypervisorAdminTestJSON-1633761200 tempest-HypervisorAdminTestJSON-1633761200-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:00.527664 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.compute.rpcapi [None req-36d012fa-da71-4704-af6c-f116a026c323 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 04 18:28:00.528877 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-36d012fa-da71-4704-af6c-f116a026c323 None None] Releasing lock "compute-rpcapi-router" {{(pid=123002) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 18:28:00.568806 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-36d012fa-da71-4704-af6c-f116a026c323 None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.564498 Oct 04 18:28:00.571499 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 53/102] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:28:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:28:00.594053 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-205c2aa2-442e-4115-9f3f-f08273db0a8d tempest-HypervisorAdminTestJSON-1633761200 tempest-HypervisorAdminTestJSON-1633761200-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:00.595700 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-205c2aa2-442e-4115-9f3f-f08273db0a8d tempest-HypervisorAdminTestJSON-1633761200 tempest-HypervisorAdminTestJSON-1633761200-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:00.609022 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-205c2aa2-442e-4115-9f3f-f08273db0a8d tempest-HypervisorAdminTestJSON-1633761200 tempest-HypervisorAdminTestJSON-1633761200-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:00.646439 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-205c2aa2-442e-4115-9f3f-f08273db0a8d tempest-HypervisorAdminTestJSON-1633761200 tempest-HypervisorAdminTestJSON-1633761200-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:00.647089 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-205c2aa2-442e-4115-9f3f-f08273db0a8d tempest-HypervisorAdminTestJSON-1633761200 tempest-HypervisorAdminTestJSON-1633761200-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:00.649833 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-205c2aa2-442e-4115-9f3f-f08273db0a8d tempest-HypervisorAdminTestJSON-1633761200 tempest-HypervisorAdminTestJSON-1633761200-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:00.671418 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-205c2aa2-442e-4115-9f3f-f08273db0a8d tempest-HypervisorAdminTestJSON-1633761200 tempest-HypervisorAdminTestJSON-1633761200-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.332586 Oct 04 18:28:00.673975 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 50/103] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Oct 4 18:28:00 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:28:00.688653 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f22846f1-8be2-4fb3-9a4e-3784497dbea1 tempest-HypervisorAdminTestJSON-1633761200 tempest-HypervisorAdminTestJSON-1633761200-project-admin] Calling method '.version_select at 0x7fe259b32940>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:00.691180 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f22846f1-8be2-4fb3-9a4e-3784497dbea1 tempest-HypervisorAdminTestJSON-1633761200 tempest-HypervisorAdminTestJSON-1633761200-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:00.691840 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f22846f1-8be2-4fb3-9a4e-3784497dbea1 tempest-HypervisorAdminTestJSON-1633761200 tempest-HypervisorAdminTestJSON-1633761200-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:00.692641 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f22846f1-8be2-4fb3-9a4e-3784497dbea1 tempest-HypervisorAdminTestJSON-1633761200 tempest-HypervisorAdminTestJSON-1633761200-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:00.787158 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f22846f1-8be2-4fb3-9a4e-3784497dbea1 tempest-HypervisorAdminTestJSON-1633761200 tempest-HypervisorAdminTestJSON-1633761200-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:00.787664 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f22846f1-8be2-4fb3-9a4e-3784497dbea1 tempest-HypervisorAdminTestJSON-1633761200 tempest-HypervisorAdminTestJSON-1633761200-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:00.788129 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f22846f1-8be2-4fb3-9a4e-3784497dbea1 tempest-HypervisorAdminTestJSON-1633761200 tempest-HypervisorAdminTestJSON-1633761200-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:00.833198 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f22846f1-8be2-4fb3-9a4e-3784497dbea1 tempest-HypervisorAdminTestJSON-1633761200 tempest-HypervisorAdminTestJSON-1633761200-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:00.833666 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f22846f1-8be2-4fb3-9a4e-3784497dbea1 tempest-HypervisorAdminTestJSON-1633761200 tempest-HypervisorAdminTestJSON-1633761200-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:00.834107 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f22846f1-8be2-4fb3-9a4e-3784497dbea1 tempest-HypervisorAdminTestJSON-1633761200 tempest-HypervisorAdminTestJSON-1633761200-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:00.834520 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-531a4785-9a61-4c40-807f-cb35c7b514ab tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:00.838621 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-531a4785-9a61-4c40-807f-cb35c7b514ab tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] [instance: 31110a13-e556-40c8-8d78-5243794ff095] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:00.857075 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-531a4785-9a61-4c40-807f-cb35c7b514ab tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:00.860592 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-531a4785-9a61-4c40-807f-cb35c7b514ab tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:00.864634 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f22846f1-8be2-4fb3-9a4e-3784497dbea1 tempest-HypervisorAdminTestJSON-1633761200 tempest-HypervisorAdminTestJSON-1633761200-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1508 microversion: 2.1 time: 0.177048 Oct 04 18:28:00.864634 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 54/104] 10.222.0.20 () {58 vars in 1167 bytes} [Tue Oct 4 18:28:00 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1508 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:00.864959 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-531a4785-9a61-4c40-807f-cb35c7b514ab tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:00.864959 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-531a4785-9a61-4c40-807f-cb35c7b514ab tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:00.864959 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-531a4785-9a61-4c40-807f-cb35c7b514ab tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:00.869104 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-531a4785-9a61-4c40-807f-cb35c7b514ab tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:00.879176 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-544862d9-2443-4a70-adff-d6234068c2ad tempest-HypervisorAdminTestJSON-1633761200 tempest-HypervisorAdminTestJSON-1633761200-project-admin] Calling method '.version_select at 0x7fe259b329d0>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:00.884653 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-544862d9-2443-4a70-adff-d6234068c2ad tempest-HypervisorAdminTestJSON-1633761200 tempest-HypervisorAdminTestJSON-1633761200-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:00.885152 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-544862d9-2443-4a70-adff-d6234068c2ad tempest-HypervisorAdminTestJSON-1633761200 tempest-HypervisorAdminTestJSON-1633761200-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:00.885593 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-544862d9-2443-4a70-adff-d6234068c2ad tempest-HypervisorAdminTestJSON-1633761200 tempest-HypervisorAdminTestJSON-1633761200-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:00.927160 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-544862d9-2443-4a70-adff-d6234068c2ad tempest-HypervisorAdminTestJSON-1633761200 tempest-HypervisorAdminTestJSON-1633761200-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:00.927679 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-544862d9-2443-4a70-adff-d6234068c2ad tempest-HypervisorAdminTestJSON-1633761200 tempest-HypervisorAdminTestJSON-1633761200-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:00.928244 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-544862d9-2443-4a70-adff-d6234068c2ad tempest-HypervisorAdminTestJSON-1633761200 tempest-HypervisorAdminTestJSON-1633761200-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:00.966843 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-544862d9-2443-4a70-adff-d6234068c2ad tempest-HypervisorAdminTestJSON-1633761200 tempest-HypervisorAdminTestJSON-1633761200-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:00.969599 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-544862d9-2443-4a70-adff-d6234068c2ad tempest-HypervisorAdminTestJSON-1633761200 tempest-HypervisorAdminTestJSON-1633761200-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:00.972118 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-544862d9-2443-4a70-adff-d6234068c2ad tempest-HypervisorAdminTestJSON-1633761200 tempest-HypervisorAdminTestJSON-1633761200-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:00.980382 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-544862d9-2443-4a70-adff-d6234068c2ad tempest-HypervisorAdminTestJSON-1633761200 tempest-HypervisorAdminTestJSON-1633761200-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.104780 Oct 04 18:28:00.981553 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 55/105] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Oct 4 18:28:00 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:28:01.006699 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6affd6d3-d22a-4184-b35c-39270468cd25 tempest-HypervisorAdminTestJSON-1633761200 tempest-HypervisorAdminTestJSON-1633761200-project-admin] Calling method '.version_select at 0x7fe259ae7550>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:01.017971 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6affd6d3-d22a-4184-b35c-39270468cd25 tempest-HypervisorAdminTestJSON-1633761200 tempest-HypervisorAdminTestJSON-1633761200-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:01.018637 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6affd6d3-d22a-4184-b35c-39270468cd25 tempest-HypervisorAdminTestJSON-1633761200 tempest-HypervisorAdminTestJSON-1633761200-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:01.019346 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6affd6d3-d22a-4184-b35c-39270468cd25 tempest-HypervisorAdminTestJSON-1633761200 tempest-HypervisorAdminTestJSON-1633761200-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:01.078725 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6affd6d3-d22a-4184-b35c-39270468cd25 tempest-HypervisorAdminTestJSON-1633761200 tempest-HypervisorAdminTestJSON-1633761200-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:01.079526 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6affd6d3-d22a-4184-b35c-39270468cd25 tempest-HypervisorAdminTestJSON-1633761200 tempest-HypervisorAdminTestJSON-1633761200-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:01.080910 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6affd6d3-d22a-4184-b35c-39270468cd25 tempest-HypervisorAdminTestJSON-1633761200 tempest-HypervisorAdminTestJSON-1633761200-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:01.097224 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6affd6d3-d22a-4184-b35c-39270468cd25 tempest-HypervisorAdminTestJSON-1633761200 tempest-HypervisorAdminTestJSON-1633761200-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 760 microversion: 2.1 time: 0.101371 Oct 04 18:28:01.100171 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 56/106] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Oct 4 18:28:00 2022] GET /compute/v2.1/os-hypervisors/1 => generated 760 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:28:01.126042 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4d5b7aa1-4ca7-4e98-9faa-912b4aa0e7c3 tempest-HypervisorAdminTestJSON-1633761200 tempest-HypervisorAdminTestJSON-1633761200-project-admin] Calling method '.version_select at 0x7fe259b324c0>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:01.132276 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4d5b7aa1-4ca7-4e98-9faa-912b4aa0e7c3 tempest-HypervisorAdminTestJSON-1633761200 tempest-HypervisorAdminTestJSON-1633761200-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:01.135965 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4d5b7aa1-4ca7-4e98-9faa-912b4aa0e7c3 tempest-HypervisorAdminTestJSON-1633761200 tempest-HypervisorAdminTestJSON-1633761200-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:01.136891 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4d5b7aa1-4ca7-4e98-9faa-912b4aa0e7c3 tempest-HypervisorAdminTestJSON-1633761200 tempest-HypervisorAdminTestJSON-1633761200-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:01.201633 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4d5b7aa1-4ca7-4e98-9faa-912b4aa0e7c3 tempest-HypervisorAdminTestJSON-1633761200 tempest-HypervisorAdminTestJSON-1633761200-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.088058 Oct 04 18:28:01.202614 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 57/107] 10.222.0.20 () {58 vars in 1179 bytes} [Tue Oct 4 18:28:01 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:28:01.234692 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7c612411-1062-4907-9ce1-df4bc0fe5da3 tempest-HypervisorAdminTestJSON-1633761200 tempest-HypervisorAdminTestJSON-1633761200-project-admin] Calling method '.version_select at 0x7fe259b32430>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:01.241231 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c612411-1062-4907-9ce1-df4bc0fe5da3 tempest-HypervisorAdminTestJSON-1633761200 tempest-HypervisorAdminTestJSON-1633761200-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:01.243856 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c612411-1062-4907-9ce1-df4bc0fe5da3 tempest-HypervisorAdminTestJSON-1633761200 tempest-HypervisorAdminTestJSON-1633761200-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:01.244733 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c612411-1062-4907-9ce1-df4bc0fe5da3 tempest-HypervisorAdminTestJSON-1633761200 tempest-HypervisorAdminTestJSON-1633761200-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:01.269226 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-531a4785-9a61-4c40-807f-cb35c7b514ab tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86a8d114fbc4eb584934904d8f2ef56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126dad7acaf44f909302eac21c4aafcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:01.281658 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-531a4785-9a61-4c40-807f-cb35c7b514ab tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] 10.222.0.20 "GET /compute/v2.1/servers/31110a13-e556-40c8-8d78-5243794ff095" status: 200 len: 1296 microversion: 2.1 time: 0.467147 Oct 04 18:28:01.295152 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 51/108] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:00 2022] GET /compute/v2.1/servers/31110a13-e556-40c8-8d78-5243794ff095 => generated 1296 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:01.316270 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c612411-1062-4907-9ce1-df4bc0fe5da3 tempest-HypervisorAdminTestJSON-1633761200 tempest-HypervisorAdminTestJSON-1633761200-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:01.316799 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c612411-1062-4907-9ce1-df4bc0fe5da3 tempest-HypervisorAdminTestJSON-1633761200 tempest-HypervisorAdminTestJSON-1633761200-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:01.318566 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c612411-1062-4907-9ce1-df4bc0fe5da3 tempest-HypervisorAdminTestJSON-1633761200 tempest-HypervisorAdminTestJSON-1633761200-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:01.357374 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c612411-1062-4907-9ce1-df4bc0fe5da3 tempest-HypervisorAdminTestJSON-1633761200 tempest-HypervisorAdminTestJSON-1633761200-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:01.358011 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c612411-1062-4907-9ce1-df4bc0fe5da3 tempest-HypervisorAdminTestJSON-1633761200 tempest-HypervisorAdminTestJSON-1633761200-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:01.358301 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c612411-1062-4907-9ce1-df4bc0fe5da3 tempest-HypervisorAdminTestJSON-1633761200 tempest-HypervisorAdminTestJSON-1633761200-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:01.384827 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7c612411-1062-4907-9ce1-df4bc0fe5da3 tempest-HypervisorAdminTestJSON-1633761200 tempest-HypervisorAdminTestJSON-1633761200-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.165837 Oct 04 18:28:01.392897 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 58/109] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Oct 4 18:28:01 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:28:01.398340 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e1ecd3b3-714f-4969-9f51-26a5e1ddfc07 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:01.399877 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e1ecd3b3-714f-4969-9f51-26a5e1ddfc07 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] [instance: 6da2d407-863f-4f6a-9d71-d81e96f160fb] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:01.409892 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e1ecd3b3-714f-4969-9f51-26a5e1ddfc07 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:01.415297 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e1ecd3b3-714f-4969-9f51-26a5e1ddfc07 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:01.419335 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e1ecd3b3-714f-4969-9f51-26a5e1ddfc07 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:01.419335 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e1ecd3b3-714f-4969-9f51-26a5e1ddfc07 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:01.419538 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e1ecd3b3-714f-4969-9f51-26a5e1ddfc07 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:01.419855 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e1ecd3b3-714f-4969-9f51-26a5e1ddfc07 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:01.600647 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-24f5846a-62d6-43ff-bbe6-a01e71af21d3 tempest-HostsAdminNegativeTestJSON-656157928 tempest-HostsAdminNegativeTestJSON-656157928-project-admin] Calling method '.version_select at 0x7fe259deb3a0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:01.600647 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-24f5846a-62d6-43ff-bbe6-a01e71af21d3 tempest-HostsAdminNegativeTestJSON-656157928 tempest-HostsAdminNegativeTestJSON-656157928-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:01.600647 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-24f5846a-62d6-43ff-bbe6-a01e71af21d3 tempest-HostsAdminNegativeTestJSON-656157928 tempest-HostsAdminNegativeTestJSON-656157928-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:01.600647 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-24f5846a-62d6-43ff-bbe6-a01e71af21d3 tempest-HostsAdminNegativeTestJSON-656157928 tempest-HostsAdminNegativeTestJSON-656157928-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:01.605756 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-24f5846a-62d6-43ff-bbe6-a01e71af21d3 tempest-HostsAdminNegativeTestJSON-656157928 tempest-HostsAdminNegativeTestJSON-656157928-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:01.606574 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-24f5846a-62d6-43ff-bbe6-a01e71af21d3 tempest-HostsAdminNegativeTestJSON-656157928 tempest-HostsAdminNegativeTestJSON-656157928-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:01.610675 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-24f5846a-62d6-43ff-bbe6-a01e71af21d3 tempest-HostsAdminNegativeTestJSON-656157928 tempest-HostsAdminNegativeTestJSON-656157928-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:01.654754 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-24f5846a-62d6-43ff-bbe6-a01e71af21d3 tempest-HostsAdminNegativeTestJSON-656157928 tempest-HostsAdminNegativeTestJSON-656157928-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts" status: 200 len: 403 microversion: 2.1 time: 0.322187 Oct 04 18:28:01.656128 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 52/110] 10.222.0.20 () {58 vars in 1128 bytes} [Tue Oct 4 18:28:01 2022] GET /compute/v2.1/os-hosts => generated 403 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:28:01.669806 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2a6830d6-7bdd-464c-b597-14c1ae3d4c57 tempest-HypervisorAdminTestJSON-1633761200 tempest-HypervisorAdminTestJSON-1633761200-project-admin] Calling method '.version_select at 0x7fe259e58dc0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:01.673119 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2a6830d6-7bdd-464c-b597-14c1ae3d4c57 tempest-HypervisorAdminTestJSON-1633761200 tempest-HypervisorAdminTestJSON-1633761200-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:01.674044 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2a6830d6-7bdd-464c-b597-14c1ae3d4c57 tempest-HypervisorAdminTestJSON-1633761200 tempest-HypervisorAdminTestJSON-1633761200-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:01.675306 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2a6830d6-7bdd-464c-b597-14c1ae3d4c57 tempest-HypervisorAdminTestJSON-1633761200 tempest-HypervisorAdminTestJSON-1633761200-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:01.698790 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2a6830d6-7bdd-464c-b597-14c1ae3d4c57 tempest-HypervisorAdminTestJSON-1633761200 tempest-HypervisorAdminTestJSON-1633761200-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:01.699846 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2a6830d6-7bdd-464c-b597-14c1ae3d4c57 tempest-HypervisorAdminTestJSON-1633761200 tempest-HypervisorAdminTestJSON-1633761200-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:01.701490 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2a6830d6-7bdd-464c-b597-14c1ae3d4c57 tempest-HypervisorAdminTestJSON-1633761200 tempest-HypervisorAdminTestJSON-1633761200-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:01.739129 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2a6830d6-7bdd-464c-b597-14c1ae3d4c57 tempest-HypervisorAdminTestJSON-1633761200 tempest-HypervisorAdminTestJSON-1633761200-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 760 microversion: 2.1 time: 0.081509 Oct 04 18:28:01.740401 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 53/111] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Oct 4 18:28:01 2022] GET /compute/v2.1/os-hypervisors/1 => generated 760 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:28:01.986114 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-cb3573cf-506b-4fde-a19a-4203bcf1f929 tempest-HostsAdminNegativeTestJSON-67283217 tempest-HostsAdminNegativeTestJSON-67283217-project] Calling method '.version_select at 0x7fe259dd9c10>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:01.997173 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-cb3573cf-506b-4fde-a19a-4203bcf1f929 tempest-HostsAdminNegativeTestJSON-67283217 tempest-HostsAdminNegativeTestJSON-67283217-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '9cfd9c9ccc0b4cfb9a7926e2191a56b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc1a95fb7c34b409c938a80f741d229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:02.006993 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-cb3573cf-506b-4fde-a19a-4203bcf1f929 tempest-HostsAdminNegativeTestJSON-67283217 tempest-HostsAdminNegativeTestJSON-67283217-project] Request method failure captured: Oct 04 18:28:02.006993 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Oct 04 18:28:02.006993 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:28:02.006993 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:28:02.006993 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:28:02.006993 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:28:02.006993 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:28:02.006993 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:28:02.006993 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:28:02.006993 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:28:02.006993 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPHsuzeRcahzkEQR2IaPDbN0RnOxG3Q1n6UWbho0H0xZZv6bwHg21xvvR4tUCQ-m9W27rMxhm2pEyBvEgpoMbcM5P_-I5gfxr5GcIN-4H7tAUlPFI_sj_QENJ9gh9cOfQHMd0R0fyvKOMrpUUxHh-3WmMjnEHwgpI64BhOPRfIbUCyzo Oct 04 18:28:02.006993 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:28:02.006993 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:28:02.006993 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:28:02.006993 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:28:02.006993 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:28:02.006993 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:28:02.006993 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 5fc1a95fb7c34b409c938a80f741d229 Oct 04 18:28:02.006993 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-67283217 Oct 04 18:28:02.006993 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:28:02.006993 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:28:02.008775 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5fc1a95fb7c34b409c938a80f741d229"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5fc1a95fb7c34b409c938a80f741d229", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5fc1a95fb7c34b409c938a80f741d229"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5fc1a95fb7c34b409c938a80f741d229"}]}] Oct 04 18:28:02.008775 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-HostsAdminNegativeTestJSON-67283217 Oct 04 18:28:02.008775 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 5fc1a95fb7c34b409c938a80f741d229 Oct 04 18:28:02.008775 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-67283217 Oct 04 18:28:02.008775 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-HostsAdminNegativeTestJSON-67283217-project Oct 04 18:28:02.008775 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:28:02.008775 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:28:02.008775 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 9cfd9c9ccc0b4cfb9a7926e2191a56b1 Oct 04 18:28:02.008775 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-HostsAdminNegativeTestJSON-67283217-project Oct 04 18:28:02.008775 n-d-850501-14 devstack@n-api.service[123001]: method: Oct 04 18:28:02.008775 n-d-850501-14 devstack@n-api.service[123001]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 04 18:28:02.008775 n-d-850501-14 devstack@n-api.service[123001]: action_args: {} Oct 04 18:28:02.008775 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:28:02.009584 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:02.009584 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:02.009584 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:02.009584 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:28:02.009584 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:28:02.009584 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:28:02.009584 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:28:02.009584 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:28:02.009584 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:28:02.009584 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:28:02.009584 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:28:02.009584 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Oct 04 18:28:02.009584 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Oct 04 18:28:02.009584 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:28:02.009584 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:28:02.009584 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:28:02.009584 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:28:02.009584 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:28:02.009584 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:28:02.010621 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:28:02.010621 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:28:02.010621 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:28:02.010621 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:28:02.010621 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:28:02.010621 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:28:02.010621 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:28:02.010621 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:28:02.010621 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 04 18:28:02.010621 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:02.010621 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:02.010621 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:02.010621 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:02.010621 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:02.010621 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:02.010621 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:28:02.010621 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:28:02.010621 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 04 18:28:02.010621 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:02.015418 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-cb3573cf-506b-4fde-a19a-4203bcf1f929 tempest-HostsAdminNegativeTestJSON-67283217 tempest-HostsAdminNegativeTestJSON-67283217-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:28:02.016648 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-cb3573cf-506b-4fde-a19a-4203bcf1f929 tempest-HostsAdminNegativeTestJSON-67283217 tempest-HostsAdminNegativeTestJSON-67283217-project] 10.222.0.20 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.274827 Oct 04 18:28:02.018243 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 54/112] 10.222.0.20 () {58 vars in 1128 bytes} [Tue Oct 4 18:28:01 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 277 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:28:02.031098 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-aa5a1c42-8655-4e4e-88d2-018447890b62 tempest-HypervisorAdminTestJSON-1633761200 tempest-HypervisorAdminTestJSON-1633761200-project-admin] Calling method '.version_select at 0x7fe259cda040>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:02.034345 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aa5a1c42-8655-4e4e-88d2-018447890b62 tempest-HypervisorAdminTestJSON-1633761200 tempest-HypervisorAdminTestJSON-1633761200-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:02.037037 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aa5a1c42-8655-4e4e-88d2-018447890b62 tempest-HypervisorAdminTestJSON-1633761200 tempest-HypervisorAdminTestJSON-1633761200-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:02.037705 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aa5a1c42-8655-4e4e-88d2-018447890b62 tempest-HypervisorAdminTestJSON-1633761200 tempest-HypervisorAdminTestJSON-1633761200-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:02.043799 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e1ecd3b3-714f-4969-9f51-26a5e1ddfc07 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f87d9eaf49545bb8effb170768bb8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e99a0400fe947bb8907857cc4de2899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:02.063571 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aa5a1c42-8655-4e4e-88d2-018447890b62 tempest-HypervisorAdminTestJSON-1633761200 tempest-HypervisorAdminTestJSON-1633761200-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:02.064623 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aa5a1c42-8655-4e4e-88d2-018447890b62 tempest-HypervisorAdminTestJSON-1633761200 tempest-HypervisorAdminTestJSON-1633761200-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:02.065289 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aa5a1c42-8655-4e4e-88d2-018447890b62 tempest-HypervisorAdminTestJSON-1633761200 tempest-HypervisorAdminTestJSON-1633761200-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:02.067909 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e1ecd3b3-714f-4969-9f51-26a5e1ddfc07 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] 10.222.0.20 "GET /compute/v2.1/servers/6da2d407-863f-4f6a-9d71-d81e96f160fb" status: 200 len: 1341 microversion: 2.1 time: 0.670118 Oct 04 18:28:02.073924 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-aa5a1c42-8655-4e4e-88d2-018447890b62 tempest-HypervisorAdminTestJSON-1633761200 tempest-HypervisorAdminTestJSON-1633761200-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 759 microversion: 2.1 time: 0.054336 Oct 04 18:28:02.088286 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 55/113] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Oct 4 18:28:02 2022] GET /compute/v2.1/os-hypervisors/2 => generated 759 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:28:02.088509 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 59/114] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:01 2022] GET /compute/v2.1/servers/6da2d407-863f-4f6a-9d71-d81e96f160fb => generated 1341 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:02.091677 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-801704f1-9765-42b2-9aa3-5e02f0eb3c5c tempest-HostsAdminNegativeTestJSON-67283217 tempest-HostsAdminNegativeTestJSON-67283217-project] Calling method '.version_select at 0x7fe259ee6700>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:02.094023 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-801704f1-9765-42b2-9aa3-5e02f0eb3c5c tempest-HostsAdminNegativeTestJSON-67283217 tempest-HostsAdminNegativeTestJSON-67283217-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '9cfd9c9ccc0b4cfb9a7926e2191a56b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc1a95fb7c34b409c938a80f741d229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:02.095860 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-801704f1-9765-42b2-9aa3-5e02f0eb3c5c tempest-HostsAdminNegativeTestJSON-67283217 tempest-HostsAdminNegativeTestJSON-67283217-project] Request method failure captured: Oct 04 18:28:02.095860 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/os-hosts/n-d-850501-14/reboot HTTP/1.1 Oct 04 18:28:02.095860 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:28:02.095860 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:28:02.095860 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:28:02.095860 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:28:02.095860 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:28:02.095860 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:28:02.095860 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:28:02.095860 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:28:02.095860 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPHsuzeRcahzkEQR2IaPDbN0RnOxG3Q1n6UWbho0H0xZZv6bwHg21xvvR4tUCQ-m9W27rMxhm2pEyBvEgpoMbcM5P_-I5gfxr5GcIN-4H7tAUlPFI_sj_QENJ9gh9cOfQHMd0R0fyvKOMrpUUxHh-3WmMjnEHwgpI64BhOPRfIbUCyzo Oct 04 18:28:02.095860 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:28:02.095860 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:28:02.095860 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:28:02.095860 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:28:02.095860 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:28:02.095860 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:28:02.095860 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 5fc1a95fb7c34b409c938a80f741d229 Oct 04 18:28:02.095860 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-67283217 Oct 04 18:28:02.095860 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:28:02.095860 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:28:02.096992 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5fc1a95fb7c34b409c938a80f741d229"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5fc1a95fb7c34b409c938a80f741d229", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5fc1a95fb7c34b409c938a80f741d229"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5fc1a95fb7c34b409c938a80f741d229"}]}] Oct 04 18:28:02.096992 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-HostsAdminNegativeTestJSON-67283217 Oct 04 18:28:02.096992 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 5fc1a95fb7c34b409c938a80f741d229 Oct 04 18:28:02.096992 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-67283217 Oct 04 18:28:02.096992 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-HostsAdminNegativeTestJSON-67283217-project Oct 04 18:28:02.096992 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:28:02.096992 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:28:02.096992 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 9cfd9c9ccc0b4cfb9a7926e2191a56b1 Oct 04 18:28:02.096992 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-HostsAdminNegativeTestJSON-67283217-project Oct 04 18:28:02.096992 n-d-850501-14 devstack@n-api.service[123001]: method: Oct 04 18:28:02.096992 n-d-850501-14 devstack@n-api.service[123001]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 04 18:28:02.096992 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': 'n-d-850501-14'} Oct 04 18:28:02.096992 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:28:02.097818 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:02.097818 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:02.097818 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:02.097818 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:28:02.097818 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:28:02.097818 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:28:02.097818 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:28:02.097818 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:28:02.097818 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:28:02.097818 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Oct 04 18:28:02.097818 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Oct 04 18:28:02.097818 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:28:02.097818 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:28:02.097818 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:28:02.097818 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:28:02.097818 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:28:02.097818 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:28:02.097818 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:28:02.097818 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:28:02.098822 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:28:02.098822 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:28:02.098822 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:28:02.098822 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:28:02.098822 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:28:02.098822 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:28:02.098822 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 04 18:28:02.098822 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:02.098822 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:02.098822 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:02.098822 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:02.098822 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:02.098822 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:02.098822 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:28:02.098822 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:28:02.098822 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 04 18:28:02.098822 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:02.101344 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-801704f1-9765-42b2-9aa3-5e02f0eb3c5c tempest-HostsAdminNegativeTestJSON-67283217 tempest-HostsAdminNegativeTestJSON-67283217-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:28:02.101468 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f365f3de-4dad-489f-899b-93303bbe3fc4 tempest-HypervisorAdminTestJSON-1633761200 tempest-HypervisorAdminTestJSON-1633761200-project-admin] Calling method '.version_select at 0x7fe259b84d30>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:02.103735 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-801704f1-9765-42b2-9aa3-5e02f0eb3c5c tempest-HostsAdminNegativeTestJSON-67283217 tempest-HostsAdminNegativeTestJSON-67283217-project] 10.222.0.20 "GET /compute/v2.1/os-hosts/n-d-850501-14/reboot" status: 403 len: 111 microversion: 2.1 time: 0.026393 Oct 04 18:28:02.104691 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f365f3de-4dad-489f-899b-93303bbe3fc4 tempest-HypervisorAdminTestJSON-1633761200 tempest-HypervisorAdminTestJSON-1633761200-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:02.108193 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 56/115] 10.222.0.20 () {58 vars in 1191 bytes} [Tue Oct 4 18:28:02 2022] GET /compute/v2.1/os-hosts/n-d-850501-14/reboot => generated 111 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:28:02.108295 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f365f3de-4dad-489f-899b-93303bbe3fc4 tempest-HypervisorAdminTestJSON-1633761200 tempest-HypervisorAdminTestJSON-1633761200-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:02.108295 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f365f3de-4dad-489f-899b-93303bbe3fc4 tempest-HypervisorAdminTestJSON-1633761200 tempest-HypervisorAdminTestJSON-1633761200-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:02.122599 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-34fe3bcc-6b00-42e3-a669-dcec472a95d8 tempest-HostsAdminNegativeTestJSON-656157928 tempest-HostsAdminNegativeTestJSON-656157928-project-admin] Calling method '.version_select at 0x7fe259deb8b0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:02.140104 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-34fe3bcc-6b00-42e3-a669-dcec472a95d8 tempest-HostsAdminNegativeTestJSON-656157928 tempest-HostsAdminNegativeTestJSON-656157928-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:28:02.150284 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-34fe3bcc-6b00-42e3-a669-dcec472a95d8 tempest-HostsAdminNegativeTestJSON-656157928 tempest-HostsAdminNegativeTestJSON-656157928-project-admin] Request method failure captured: Oct 04 18:28:02.150284 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Oct 04 18:28:02.150284 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:28:02.150284 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:28:02.150284 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:28:02.150284 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:28:02.150284 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:28:02.150284 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:28:02.150284 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:28:02.150284 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:28:02.150284 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPHswVB4iELHTKyO-WWYCWyXL7Xvy-PQHJj7ZVir9ihZ9l__VPZOpQu4ybx9gx1eE3JdjUhJMGQ9HYq32XMQUpEQl587iKcGplbQfJlkJLdNAEa5hqbSMyCz_IZnt3DpJX8bnuJLMnUAko6_EYOPDBPX9cvKOXTI6xhZLqS3xumktcUQ Oct 04 18:28:02.150284 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:28:02.150284 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:28:02.150284 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:28:02.150284 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:28:02.150284 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:28:02.150284 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:28:02.150284 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 72ccb71cb3144b358ea17d5864034eeb Oct 04 18:28:02.150284 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-656157928 Oct 04 18:28:02.150284 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member,admin Oct 04 18:28:02.150284 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member,admin Oct 04 18:28:02.151445 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/72ccb71cb3144b358ea17d5864034eeb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_72ccb71cb3144b358ea17d5864034eeb", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/72ccb71cb3144b358ea17d5864034eeb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/72ccb71cb3144b358ea17d5864034eeb"}]}] Oct 04 18:28:02.151445 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-HostsAdminNegativeTestJSON-656157928 Oct 04 18:28:02.151445 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 72ccb71cb3144b358ea17d5864034eeb Oct 04 18:28:02.151445 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-656157928 Oct 04 18:28:02.151445 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-HostsAdminNegativeTestJSON-656157928-project-admin Oct 04 18:28:02.151445 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:28:02.151445 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:28:02.151445 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: c87fe3b755b3484b96a5590b4819f95b Oct 04 18:28:02.151445 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-HostsAdminNegativeTestJSON-656157928-project-admin Oct 04 18:28:02.151445 n-d-850501-14 devstack@n-api.service[123001]: method: Oct 04 18:28:02.151445 n-d-850501-14 devstack@n-api.service[123001]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:28:02.151445 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': 'nonexistent_hostname'} Oct 04 18:28:02.151445 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:28:02.152382 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:02.152382 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 04 18:28:02.152382 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 04 18:28:02.152382 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 18:28:02.152382 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 18:28:02.152382 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:28:02.152382 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:28:02.152382 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:28:02.152382 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:28:02.152382 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 18:28:02.152382 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 18:28:02.152382 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 04 18:28:02.152382 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 04 18:28:02.152382 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:28:02.152382 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:28:02.152382 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 04 18:28:02.152382 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 04 18:28:02.152382 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:28:02.152382 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:28:02.153449 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 04 18:28:02.153449 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 04 18:28:02.153449 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:28:02.153449 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:02.153449 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:02.153449 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:02.153449 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:02.153449 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:02.153449 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:02.153449 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:28:02.153449 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:28:02.153449 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:28:02.153449 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:28:02.153449 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:28:02.153449 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:28:02.153449 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Oct 04 18:28:02.153449 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Oct 04 18:28:02.153449 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 04 18:28:02.153449 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:28:02.154391 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:28:02.154391 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:02.154391 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:02.154391 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:02.154391 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:02.154391 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:02.154391 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:02.154391 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:28:02.154391 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:28:02.154391 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:28:02.154391 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:02.154950 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f365f3de-4dad-489f-899b-93303bbe3fc4 tempest-HypervisorAdminTestJSON-1633761200 tempest-HypervisorAdminTestJSON-1633761200-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:02.157763 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-34fe3bcc-6b00-42e3-a669-dcec472a95d8 tempest-HostsAdminNegativeTestJSON-656157928 tempest-HostsAdminNegativeTestJSON-656157928-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:28:02.158992 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-34fe3bcc-6b00-42e3-a669-dcec472a95d8 tempest-HostsAdminNegativeTestJSON-656157928 tempest-HostsAdminNegativeTestJSON-656157928-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.042329 Oct 04 18:28:02.160273 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 57/116] 10.222.0.20 () {58 vars in 1212 bytes} [Tue Oct 4 18:28:02 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:28:02.163121 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f365f3de-4dad-489f-899b-93303bbe3fc4 tempest-HypervisorAdminTestJSON-1633761200 tempest-HypervisorAdminTestJSON-1633761200-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:02.163963 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f365f3de-4dad-489f-899b-93303bbe3fc4 tempest-HypervisorAdminTestJSON-1633761200 tempest-HypervisorAdminTestJSON-1633761200-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:02.202683 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f365f3de-4dad-489f-899b-93303bbe3fc4 tempest-HypervisorAdminTestJSON-1633761200 tempest-HypervisorAdminTestJSON-1633761200-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:02.202683 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f365f3de-4dad-489f-899b-93303bbe3fc4 tempest-HypervisorAdminTestJSON-1633761200 tempest-HypervisorAdminTestJSON-1633761200-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:02.202683 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f365f3de-4dad-489f-899b-93303bbe3fc4 tempest-HypervisorAdminTestJSON-1633761200 tempest-HypervisorAdminTestJSON-1633761200-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:02.209907 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4d31deb3-1f90-4fdf-b776-a87d80830130 tempest-HostsAdminNegativeTestJSON-67283217 tempest-HostsAdminNegativeTestJSON-67283217-project] Calling method '.version_select at 0x7fe259e58ee0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:02.212889 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-4d31deb3-1f90-4fdf-b776-a87d80830130 tempest-HostsAdminNegativeTestJSON-67283217 tempest-HostsAdminNegativeTestJSON-67283217-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '9cfd9c9ccc0b4cfb9a7926e2191a56b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc1a95fb7c34b409c938a80f741d229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:02.214515 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4d31deb3-1f90-4fdf-b776-a87d80830130 tempest-HostsAdminNegativeTestJSON-67283217 tempest-HostsAdminNegativeTestJSON-67283217-project] Request method failure captured: Oct 04 18:28:02.214515 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/os-hosts/n-d-850501-14 HTTP/1.1 Oct 04 18:28:02.214515 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:28:02.214515 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:28:02.214515 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:28:02.214515 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:28:02.214515 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:28:02.214515 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:28:02.214515 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:28:02.214515 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:28:02.214515 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPHsuzeRcahzkEQR2IaPDbN0RnOxG3Q1n6UWbho0H0xZZv6bwHg21xvvR4tUCQ-m9W27rMxhm2pEyBvEgpoMbcM5P_-I5gfxr5GcIN-4H7tAUlPFI_sj_QENJ9gh9cOfQHMd0R0fyvKOMrpUUxHh-3WmMjnEHwgpI64BhOPRfIbUCyzo Oct 04 18:28:02.214515 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:28:02.214515 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:28:02.214515 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:28:02.214515 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:28:02.214515 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:28:02.214515 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:28:02.214515 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 5fc1a95fb7c34b409c938a80f741d229 Oct 04 18:28:02.214515 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-67283217 Oct 04 18:28:02.214515 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:28:02.214515 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:28:02.215612 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5fc1a95fb7c34b409c938a80f741d229"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5fc1a95fb7c34b409c938a80f741d229", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5fc1a95fb7c34b409c938a80f741d229"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5fc1a95fb7c34b409c938a80f741d229"}]}] Oct 04 18:28:02.215612 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-HostsAdminNegativeTestJSON-67283217 Oct 04 18:28:02.215612 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 5fc1a95fb7c34b409c938a80f741d229 Oct 04 18:28:02.215612 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-67283217 Oct 04 18:28:02.215612 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-HostsAdminNegativeTestJSON-67283217-project Oct 04 18:28:02.215612 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:28:02.215612 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:28:02.215612 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 9cfd9c9ccc0b4cfb9a7926e2191a56b1 Oct 04 18:28:02.215612 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-HostsAdminNegativeTestJSON-67283217-project Oct 04 18:28:02.215612 n-d-850501-14 devstack@n-api.service[123001]: method: Oct 04 18:28:02.215612 n-d-850501-14 devstack@n-api.service[123001]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 04 18:28:02.215612 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': 'n-d-850501-14'} Oct 04 18:28:02.215612 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:28:02.216301 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:02.216301 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:02.216301 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:02.216301 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:28:02.216301 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:28:02.216301 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:28:02.216301 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:28:02.216301 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:28:02.216301 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:28:02.216301 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Oct 04 18:28:02.216301 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Oct 04 18:28:02.216301 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:28:02.216301 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:28:02.216301 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:28:02.216301 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:28:02.216301 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:28:02.216301 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:28:02.216301 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:28:02.216301 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:28:02.217234 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:28:02.217234 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:28:02.217234 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:28:02.217234 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:28:02.217234 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:28:02.217234 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:28:02.217234 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 04 18:28:02.217234 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:02.217234 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:02.217234 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:02.217234 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:02.217234 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:02.217234 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:02.217234 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:28:02.217234 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:28:02.217234 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 04 18:28:02.217234 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:02.218083 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4d31deb3-1f90-4fdf-b776-a87d80830130 tempest-HostsAdminNegativeTestJSON-67283217 tempest-HostsAdminNegativeTestJSON-67283217-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:28:02.218083 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-4d31deb3-1f90-4fdf-b776-a87d80830130 tempest-HostsAdminNegativeTestJSON-67283217 tempest-HostsAdminNegativeTestJSON-67283217-project] 10.222.0.20 "GET /compute/v2.1/os-hosts/n-d-850501-14" status: 403 len: 109 microversion: 2.1 time: 0.024139 Oct 04 18:28:02.218704 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 58/117] 10.222.0.20 () {58 vars in 1170 bytes} [Tue Oct 4 18:28:02 2022] GET /compute/v2.1/os-hosts/n-d-850501-14 => generated 109 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:28:02.226784 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-89600b0e-8b9c-461f-9a20-e699612dc0a1 tempest-HostsAdminNegativeTestJSON-656157928 tempest-HostsAdminNegativeTestJSON-656157928-project-admin] Calling method '.version_select at 0x7fe259deb550>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:02.234306 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-89600b0e-8b9c-461f-9a20-e699612dc0a1 tempest-HostsAdminNegativeTestJSON-656157928 tempest-HostsAdminNegativeTestJSON-656157928-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:28:02.253236 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-89600b0e-8b9c-461f-9a20-e699612dc0a1 tempest-HostsAdminNegativeTestJSON-656157928 tempest-HostsAdminNegativeTestJSON-656157928-project-admin] Request method failure captured: Oct 04 18:28:02.253236 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 04 18:28:02.253236 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:28:02.253236 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:28:02.253236 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:28:02.253236 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:28:02.253236 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:28:02.253236 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:28:02.253236 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:28:02.253236 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:28:02.253236 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPHswVB4iELHTKyO-WWYCWyXL7Xvy-PQHJj7ZVir9ihZ9l__VPZOpQu4ybx9gx1eE3JdjUhJMGQ9HYq32XMQUpEQl587iKcGplbQfJlkJLdNAEa5hqbSMyCz_IZnt3DpJX8bnuJLMnUAko6_EYOPDBPX9cvKOXTI6xhZLqS3xumktcUQ Oct 04 18:28:02.253236 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:28:02.253236 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:28:02.253236 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:28:02.253236 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:28:02.253236 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:28:02.253236 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:28:02.253236 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 72ccb71cb3144b358ea17d5864034eeb Oct 04 18:28:02.253236 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-656157928 Oct 04 18:28:02.253236 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member,admin Oct 04 18:28:02.253236 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member,admin Oct 04 18:28:02.254725 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/72ccb71cb3144b358ea17d5864034eeb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_72ccb71cb3144b358ea17d5864034eeb", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/72ccb71cb3144b358ea17d5864034eeb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/72ccb71cb3144b358ea17d5864034eeb"}]}] Oct 04 18:28:02.254725 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-HostsAdminNegativeTestJSON-656157928 Oct 04 18:28:02.254725 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 72ccb71cb3144b358ea17d5864034eeb Oct 04 18:28:02.254725 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-656157928 Oct 04 18:28:02.254725 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-HostsAdminNegativeTestJSON-656157928-project-admin Oct 04 18:28:02.254725 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:28:02.254725 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:28:02.254725 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: c87fe3b755b3484b96a5590b4819f95b Oct 04 18:28:02.254725 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-HostsAdminNegativeTestJSON-656157928-project-admin Oct 04 18:28:02.254725 n-d-850501-14 devstack@n-api.service[123001]: method: Oct 04 18:28:02.254725 n-d-850501-14 devstack@n-api.service[123001]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:28:02.254725 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': 'nonexistent_hostname'} Oct 04 18:28:02.254725 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:28:02.255609 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:02.255609 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Oct 04 18:28:02.255609 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 04 18:28:02.255609 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:28:02.255609 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:28:02.255609 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 04 18:28:02.255609 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 04 18:28:02.255609 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:28:02.255609 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:28:02.255609 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 04 18:28:02.255609 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 04 18:28:02.255609 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:28:02.255609 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:02.255609 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:02.255609 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:02.255609 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:02.255609 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:02.255609 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:02.255609 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:28:02.256925 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:28:02.256925 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:28:02.256925 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:28:02.256925 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:28:02.256925 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:28:02.256925 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Oct 04 18:28:02.256925 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:28:02.256925 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:28:02.256925 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:02.256925 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:02.256925 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:02.256925 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:02.256925 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:02.256925 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:02.256925 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:28:02.256925 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:28:02.256925 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:28:02.256925 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:02.260405 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-89600b0e-8b9c-461f-9a20-e699612dc0a1 tempest-HostsAdminNegativeTestJSON-656157928 tempest-HostsAdminNegativeTestJSON-656157928-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:28:02.261640 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-89600b0e-8b9c-461f-9a20-e699612dc0a1 tempest-HostsAdminNegativeTestJSON-656157928 tempest-HostsAdminNegativeTestJSON-656157928-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.038545 Oct 04 18:28:02.267184 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 59/118] 10.222.0.20 () {58 vars in 1191 bytes} [Tue Oct 4 18:28:02 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:28:02.277045 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f365f3de-4dad-489f-899b-93303bbe3fc4 tempest-HypervisorAdminTestJSON-1633761200 tempest-HypervisorAdminTestJSON-1633761200-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 176 microversion: 2.1 time: 0.182512 Oct 04 18:28:02.281421 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 60/119] 10.222.0.20 () {58 vars in 1173 bytes} [Tue Oct 4 18:28:02 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 176 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:28:02.283710 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7f683eca-7070-4845-8941-08b7714452eb tempest-HostsAdminNegativeTestJSON-67283217 tempest-HostsAdminNegativeTestJSON-67283217-project] Calling method '.version_select at 0x7fe259cfcdc0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:02.294719 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7f683eca-7070-4845-8941-08b7714452eb tempest-HostsAdminNegativeTestJSON-67283217 tempest-HostsAdminNegativeTestJSON-67283217-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '9cfd9c9ccc0b4cfb9a7926e2191a56b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc1a95fb7c34b409c938a80f741d229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:02.311389 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7f683eca-7070-4845-8941-08b7714452eb tempest-HostsAdminNegativeTestJSON-67283217 tempest-HostsAdminNegativeTestJSON-67283217-project] Request method failure captured: Oct 04 18:28:02.311389 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/os-hosts/n-d-850501-14/shutdown HTTP/1.1 Oct 04 18:28:02.311389 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:28:02.311389 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:28:02.311389 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:28:02.311389 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:28:02.311389 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:28:02.311389 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:28:02.311389 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:28:02.311389 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:28:02.311389 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPHsuzeRcahzkEQR2IaPDbN0RnOxG3Q1n6UWbho0H0xZZv6bwHg21xvvR4tUCQ-m9W27rMxhm2pEyBvEgpoMbcM5P_-I5gfxr5GcIN-4H7tAUlPFI_sj_QENJ9gh9cOfQHMd0R0fyvKOMrpUUxHh-3WmMjnEHwgpI64BhOPRfIbUCyzo Oct 04 18:28:02.311389 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:28:02.311389 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:28:02.311389 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:28:02.311389 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:28:02.311389 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:28:02.311389 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:28:02.311389 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 5fc1a95fb7c34b409c938a80f741d229 Oct 04 18:28:02.311389 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-67283217 Oct 04 18:28:02.311389 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:28:02.311389 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:28:02.312789 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5fc1a95fb7c34b409c938a80f741d229"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5fc1a95fb7c34b409c938a80f741d229", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5fc1a95fb7c34b409c938a80f741d229"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5fc1a95fb7c34b409c938a80f741d229"}]}] Oct 04 18:28:02.312789 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-HostsAdminNegativeTestJSON-67283217 Oct 04 18:28:02.312789 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 5fc1a95fb7c34b409c938a80f741d229 Oct 04 18:28:02.312789 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-67283217 Oct 04 18:28:02.312789 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-HostsAdminNegativeTestJSON-67283217-project Oct 04 18:28:02.312789 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:28:02.312789 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:28:02.312789 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 9cfd9c9ccc0b4cfb9a7926e2191a56b1 Oct 04 18:28:02.312789 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-HostsAdminNegativeTestJSON-67283217-project Oct 04 18:28:02.312789 n-d-850501-14 devstack@n-api.service[123001]: method: Oct 04 18:28:02.312789 n-d-850501-14 devstack@n-api.service[123001]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 04 18:28:02.312789 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': 'n-d-850501-14'} Oct 04 18:28:02.312789 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:28:02.313513 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:02.313513 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:02.313513 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:02.313513 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:28:02.313513 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:28:02.313513 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:28:02.313513 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:28:02.313513 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:28:02.313513 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:28:02.313513 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Oct 04 18:28:02.313513 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Oct 04 18:28:02.313513 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:28:02.313513 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:28:02.313513 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:28:02.313513 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:28:02.313513 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:28:02.313513 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:28:02.313513 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:28:02.313513 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:28:02.314681 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:28:02.314681 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:28:02.314681 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:28:02.314681 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:28:02.314681 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:28:02.314681 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:28:02.314681 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 04 18:28:02.314681 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:02.314681 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:02.314681 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:02.314681 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:02.314681 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:02.314681 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:02.314681 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:28:02.314681 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:28:02.314681 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 04 18:28:02.314681 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:02.315673 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-40b38b81-a1fa-456c-8cce-50be11ff9e71 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:02.316643 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-40b38b81-a1fa-456c-8cce-50be11ff9e71 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] [instance: 31110a13-e556-40c8-8d78-5243794ff095] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:02.317596 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7f683eca-7070-4845-8941-08b7714452eb tempest-HostsAdminNegativeTestJSON-67283217 tempest-HostsAdminNegativeTestJSON-67283217-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:28:02.320254 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7f683eca-7070-4845-8941-08b7714452eb tempest-HostsAdminNegativeTestJSON-67283217 tempest-HostsAdminNegativeTestJSON-67283217-project] 10.222.0.20 "GET /compute/v2.1/os-hosts/n-d-850501-14/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.045011 Oct 04 18:28:02.325382 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 60/120] 10.222.0.20 () {58 vars in 1197 bytes} [Tue Oct 4 18:28:02 2022] GET /compute/v2.1/os-hosts/n-d-850501-14/shutdown => generated 113 bytes in 52 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:28:02.331153 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-40b38b81-a1fa-456c-8cce-50be11ff9e71 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:02.334753 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-40b38b81-a1fa-456c-8cce-50be11ff9e71 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:02.334753 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-40b38b81-a1fa-456c-8cce-50be11ff9e71 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:02.334753 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-40b38b81-a1fa-456c-8cce-50be11ff9e71 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:02.334753 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-40b38b81-a1fa-456c-8cce-50be11ff9e71 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:02.335596 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-cc0f1a56-c023-4ccb-931d-34317803d6ab tempest-HostsAdminNegativeTestJSON-656157928 tempest-HostsAdminNegativeTestJSON-656157928-project-admin] Calling method '.version_select at 0x7fe259cda430>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:02.358377 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-cc0f1a56-c023-4ccb-931d-34317803d6ab tempest-HostsAdminNegativeTestJSON-656157928 tempest-HostsAdminNegativeTestJSON-656157928-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:28:02.360971 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-cc0f1a56-c023-4ccb-931d-34317803d6ab tempest-HostsAdminNegativeTestJSON-656157928 tempest-HostsAdminNegativeTestJSON-656157928-project-admin] Request method failure captured: Oct 04 18:28:02.360971 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Oct 04 18:28:02.360971 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:28:02.360971 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:28:02.360971 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:28:02.360971 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:28:02.360971 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:28:02.360971 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:28:02.360971 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:28:02.360971 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:28:02.360971 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPHswVB4iELHTKyO-WWYCWyXL7Xvy-PQHJj7ZVir9ihZ9l__VPZOpQu4ybx9gx1eE3JdjUhJMGQ9HYq32XMQUpEQl587iKcGplbQfJlkJLdNAEa5hqbSMyCz_IZnt3DpJX8bnuJLMnUAko6_EYOPDBPX9cvKOXTI6xhZLqS3xumktcUQ Oct 04 18:28:02.360971 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:28:02.360971 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:28:02.360971 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:28:02.360971 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:28:02.360971 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:28:02.360971 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:28:02.360971 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 72ccb71cb3144b358ea17d5864034eeb Oct 04 18:28:02.360971 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-656157928 Oct 04 18:28:02.360971 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member,admin Oct 04 18:28:02.360971 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member,admin Oct 04 18:28:02.363942 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/72ccb71cb3144b358ea17d5864034eeb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_72ccb71cb3144b358ea17d5864034eeb", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/72ccb71cb3144b358ea17d5864034eeb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/72ccb71cb3144b358ea17d5864034eeb"}]}] Oct 04 18:28:02.363942 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-HostsAdminNegativeTestJSON-656157928 Oct 04 18:28:02.363942 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 72ccb71cb3144b358ea17d5864034eeb Oct 04 18:28:02.363942 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-656157928 Oct 04 18:28:02.363942 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-HostsAdminNegativeTestJSON-656157928-project-admin Oct 04 18:28:02.363942 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:28:02.363942 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:28:02.363942 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: c87fe3b755b3484b96a5590b4819f95b Oct 04 18:28:02.363942 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-HostsAdminNegativeTestJSON-656157928-project-admin Oct 04 18:28:02.363942 n-d-850501-14 devstack@n-api.service[123001]: method: Oct 04 18:28:02.363942 n-d-850501-14 devstack@n-api.service[123001]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:28:02.363942 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': 'nonexistent_hostname'} Oct 04 18:28:02.363942 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:28:02.364765 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:02.364765 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 04 18:28:02.364765 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 04 18:28:02.364765 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 18:28:02.364765 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 18:28:02.364765 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:28:02.364765 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:28:02.364765 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:28:02.364765 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:28:02.364765 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 18:28:02.364765 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 18:28:02.364765 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 04 18:28:02.364765 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 04 18:28:02.364765 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:28:02.364765 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:28:02.364765 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 04 18:28:02.364765 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 04 18:28:02.364765 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:28:02.364765 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:28:02.365961 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 04 18:28:02.365961 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 04 18:28:02.365961 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:28:02.365961 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:02.365961 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:02.365961 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:02.365961 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:02.365961 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:02.365961 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:02.365961 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:28:02.365961 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:28:02.365961 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:28:02.365961 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:28:02.365961 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:28:02.365961 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:28:02.365961 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Oct 04 18:28:02.365961 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Oct 04 18:28:02.365961 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 04 18:28:02.365961 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:28:02.367112 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:28:02.367112 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:02.367112 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:02.367112 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:02.367112 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:02.367112 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:02.367112 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:02.367112 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:28:02.367112 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:28:02.367112 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:28:02.367112 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:02.367112 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-cc0f1a56-c023-4ccb-931d-34317803d6ab tempest-HostsAdminNegativeTestJSON-656157928 tempest-HostsAdminNegativeTestJSON-656157928-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:28:02.367112 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-cc0f1a56-c023-4ccb-931d-34317803d6ab tempest-HostsAdminNegativeTestJSON-656157928 tempest-HostsAdminNegativeTestJSON-656157928-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.031073 Oct 04 18:28:02.368640 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-40b38b81-a1fa-456c-8cce-50be11ff9e71 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:02.373083 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 61/121] 10.222.0.20 () {58 vars in 1218 bytes} [Tue Oct 4 18:28:02 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:28:02.381887 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b163d117-a921-4d26-ab56-f4fa8df3c5e2 tempest-HostsAdminNegativeTestJSON-67283217 tempest-HostsAdminNegativeTestJSON-67283217-project] Calling method '.version_select at 0x7fe259deb9d0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:02.391774 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b163d117-a921-4d26-ab56-f4fa8df3c5e2 tempest-HostsAdminNegativeTestJSON-67283217 tempest-HostsAdminNegativeTestJSON-67283217-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '9cfd9c9ccc0b4cfb9a7926e2191a56b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc1a95fb7c34b409c938a80f741d229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:02.391774 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b163d117-a921-4d26-ab56-f4fa8df3c5e2 tempest-HostsAdminNegativeTestJSON-67283217 tempest-HostsAdminNegativeTestJSON-67283217-project] Request method failure captured: Oct 04 18:28:02.391774 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/os-hosts/n-d-850501-14/startup HTTP/1.1 Oct 04 18:28:02.391774 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:28:02.391774 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:28:02.391774 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:28:02.391774 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:28:02.391774 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:28:02.391774 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:28:02.391774 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:28:02.391774 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:28:02.391774 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPHsuzeRcahzkEQR2IaPDbN0RnOxG3Q1n6UWbho0H0xZZv6bwHg21xvvR4tUCQ-m9W27rMxhm2pEyBvEgpoMbcM5P_-I5gfxr5GcIN-4H7tAUlPFI_sj_QENJ9gh9cOfQHMd0R0fyvKOMrpUUxHh-3WmMjnEHwgpI64BhOPRfIbUCyzo Oct 04 18:28:02.391774 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:28:02.391774 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:28:02.391774 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:28:02.391774 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:28:02.391774 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:28:02.391774 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:28:02.391774 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 5fc1a95fb7c34b409c938a80f741d229 Oct 04 18:28:02.391774 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-67283217 Oct 04 18:28:02.391774 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:28:02.391774 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:28:02.393099 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5fc1a95fb7c34b409c938a80f741d229"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5fc1a95fb7c34b409c938a80f741d229", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5fc1a95fb7c34b409c938a80f741d229"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5fc1a95fb7c34b409c938a80f741d229"}]}] Oct 04 18:28:02.393099 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-HostsAdminNegativeTestJSON-67283217 Oct 04 18:28:02.393099 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 5fc1a95fb7c34b409c938a80f741d229 Oct 04 18:28:02.393099 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-67283217 Oct 04 18:28:02.393099 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-HostsAdminNegativeTestJSON-67283217-project Oct 04 18:28:02.393099 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:28:02.393099 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:28:02.393099 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 9cfd9c9ccc0b4cfb9a7926e2191a56b1 Oct 04 18:28:02.393099 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-HostsAdminNegativeTestJSON-67283217-project Oct 04 18:28:02.393099 n-d-850501-14 devstack@n-api.service[123001]: method: Oct 04 18:28:02.393099 n-d-850501-14 devstack@n-api.service[123001]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 04 18:28:02.393099 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': 'n-d-850501-14'} Oct 04 18:28:02.393099 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:28:02.393741 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:02.393741 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:02.393741 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:02.393741 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:28:02.393741 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:28:02.393741 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:28:02.393741 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:28:02.393741 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:28:02.393741 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:28:02.393741 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Oct 04 18:28:02.393741 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Oct 04 18:28:02.393741 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:28:02.393741 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:28:02.393741 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:28:02.393741 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:28:02.393741 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:28:02.393741 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:28:02.393741 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:28:02.393741 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:28:02.394659 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:28:02.394659 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:28:02.394659 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:28:02.394659 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:28:02.394659 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:28:02.394659 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:28:02.394659 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 04 18:28:02.394659 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:02.394659 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:02.394659 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:02.394659 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:02.394659 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:02.394659 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:02.394659 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:28:02.394659 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:28:02.394659 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 04 18:28:02.394659 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:02.395515 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b163d117-a921-4d26-ab56-f4fa8df3c5e2 tempest-HostsAdminNegativeTestJSON-67283217 tempest-HostsAdminNegativeTestJSON-67283217-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:28:02.395515 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b163d117-a921-4d26-ab56-f4fa8df3c5e2 tempest-HostsAdminNegativeTestJSON-67283217 tempest-HostsAdminNegativeTestJSON-67283217-project] 10.222.0.20 "GET /compute/v2.1/os-hosts/n-d-850501-14/startup" status: 403 len: 110 microversion: 2.1 time: 0.016480 Oct 04 18:28:02.397854 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 62/122] 10.222.0.20 () {58 vars in 1194 bytes} [Tue Oct 4 18:28:02 2022] GET /compute/v2.1/os-hosts/n-d-850501-14/startup => generated 110 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:28:02.406300 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ed158008-29da-4644-b7db-5c685bef9e0b tempest-HostsAdminNegativeTestJSON-656157928 tempest-HostsAdminNegativeTestJSON-656157928-project-admin] Calling method '.version_select at 0x7fe259bfd700>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:02.435980 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-ed158008-29da-4644-b7db-5c685bef9e0b tempest-HostsAdminNegativeTestJSON-656157928 tempest-HostsAdminNegativeTestJSON-656157928-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:28:02.439407 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ed158008-29da-4644-b7db-5c685bef9e0b tempest-HostsAdminNegativeTestJSON-656157928 tempest-HostsAdminNegativeTestJSON-656157928-project-admin] Request method failure captured: Oct 04 18:28:02.439407 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Oct 04 18:28:02.439407 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:28:02.439407 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:28:02.439407 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:28:02.439407 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:28:02.439407 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:28:02.439407 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:28:02.439407 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:28:02.439407 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:28:02.439407 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPHswVB4iELHTKyO-WWYCWyXL7Xvy-PQHJj7ZVir9ihZ9l__VPZOpQu4ybx9gx1eE3JdjUhJMGQ9HYq32XMQUpEQl587iKcGplbQfJlkJLdNAEa5hqbSMyCz_IZnt3DpJX8bnuJLMnUAko6_EYOPDBPX9cvKOXTI6xhZLqS3xumktcUQ Oct 04 18:28:02.439407 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:28:02.439407 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:28:02.439407 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:28:02.439407 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:28:02.439407 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:28:02.439407 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:28:02.439407 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 72ccb71cb3144b358ea17d5864034eeb Oct 04 18:28:02.439407 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-656157928 Oct 04 18:28:02.439407 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member,admin Oct 04 18:28:02.439407 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member,admin Oct 04 18:28:02.440749 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/72ccb71cb3144b358ea17d5864034eeb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_72ccb71cb3144b358ea17d5864034eeb", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/72ccb71cb3144b358ea17d5864034eeb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/72ccb71cb3144b358ea17d5864034eeb"}]}] Oct 04 18:28:02.440749 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-HostsAdminNegativeTestJSON-656157928 Oct 04 18:28:02.440749 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 72ccb71cb3144b358ea17d5864034eeb Oct 04 18:28:02.440749 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-656157928 Oct 04 18:28:02.440749 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-HostsAdminNegativeTestJSON-656157928-project-admin Oct 04 18:28:02.440749 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:28:02.440749 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:28:02.440749 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: c87fe3b755b3484b96a5590b4819f95b Oct 04 18:28:02.440749 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-HostsAdminNegativeTestJSON-656157928-project-admin Oct 04 18:28:02.440749 n-d-850501-14 devstack@n-api.service[123001]: method: Oct 04 18:28:02.440749 n-d-850501-14 devstack@n-api.service[123001]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:28:02.440749 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': 'nonexistent_hostname'} Oct 04 18:28:02.440749 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:28:02.441572 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:02.441572 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 04 18:28:02.441572 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 04 18:28:02.441572 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 18:28:02.441572 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 18:28:02.441572 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:28:02.441572 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:28:02.441572 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:28:02.441572 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:28:02.441572 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 18:28:02.441572 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 18:28:02.441572 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 04 18:28:02.441572 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 04 18:28:02.441572 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:28:02.441572 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:28:02.441572 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 04 18:28:02.441572 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 04 18:28:02.441572 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:28:02.441572 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:28:02.442730 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 04 18:28:02.442730 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 04 18:28:02.442730 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:28:02.442730 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:02.442730 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:02.442730 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:02.442730 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:02.442730 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:02.442730 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:02.442730 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:28:02.442730 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:28:02.442730 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:28:02.442730 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:28:02.442730 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:28:02.442730 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:28:02.442730 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Oct 04 18:28:02.442730 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Oct 04 18:28:02.442730 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 04 18:28:02.442730 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:28:02.443971 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:28:02.443971 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:02.443971 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:02.443971 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:02.443971 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:02.443971 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:02.443971 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:02.443971 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:28:02.443971 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:28:02.443971 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:28:02.443971 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:02.448742 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ed158008-29da-4644-b7db-5c685bef9e0b tempest-HostsAdminNegativeTestJSON-656157928 tempest-HostsAdminNegativeTestJSON-656157928-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:28:02.451886 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ed158008-29da-4644-b7db-5c685bef9e0b tempest-HostsAdminNegativeTestJSON-656157928 tempest-HostsAdminNegativeTestJSON-656157928-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.048889 Oct 04 18:28:02.457161 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 63/123] 10.222.0.20 () {58 vars in 1215 bytes} [Tue Oct 4 18:28:02 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:28:02.463274 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4dfa23ab-8c1d-4af2-becb-1e6be42b918b tempest-HostsAdminNegativeTestJSON-656157928 tempest-HostsAdminNegativeTestJSON-656157928-project-admin] Action: 'update', calling method: .version_select at 0x7fe259deb820>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:02.470760 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4dfa23ab-8c1d-4af2-becb-1e6be42b918b tempest-HostsAdminNegativeTestJSON-656157928 tempest-HostsAdminNegativeTestJSON-656157928-project-admin] Request method failure captured: Oct 04 18:28:02.470760 n-d-850501-14 devstack@n-api.service[123001]: request: PUT /compute/v2.1/os-hosts/n-d-850501-14 HTTP/1.1 Oct 04 18:28:02.470760 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:28:02.470760 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:28:02.470760 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:28:02.470760 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 51 Oct 04 18:28:02.470760 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:28:02.470760 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:28:02.470760 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:28:02.470760 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:28:02.470760 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPHswVB4iELHTKyO-WWYCWyXL7Xvy-PQHJj7ZVir9ihZ9l__VPZOpQu4ybx9gx1eE3JdjUhJMGQ9HYq32XMQUpEQl587iKcGplbQfJlkJLdNAEa5hqbSMyCz_IZnt3DpJX8bnuJLMnUAko6_EYOPDBPX9cvKOXTI6xhZLqS3xumktcUQ Oct 04 18:28:02.470760 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:28:02.470760 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:28:02.470760 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:28:02.470760 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:28:02.470760 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:28:02.470760 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:28:02.470760 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 72ccb71cb3144b358ea17d5864034eeb Oct 04 18:28:02.470760 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-656157928 Oct 04 18:28:02.470760 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member,admin Oct 04 18:28:02.470760 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member,admin Oct 04 18:28:02.473422 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/72ccb71cb3144b358ea17d5864034eeb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_72ccb71cb3144b358ea17d5864034eeb", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/72ccb71cb3144b358ea17d5864034eeb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/72ccb71cb3144b358ea17d5864034eeb"}]}] Oct 04 18:28:02.473422 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-HostsAdminNegativeTestJSON-656157928 Oct 04 18:28:02.473422 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 72ccb71cb3144b358ea17d5864034eeb Oct 04 18:28:02.473422 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-656157928 Oct 04 18:28:02.473422 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-HostsAdminNegativeTestJSON-656157928-project-admin Oct 04 18:28:02.473422 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:28:02.473422 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:28:02.473422 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: c87fe3b755b3484b96a5590b4819f95b Oct 04 18:28:02.473422 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-HostsAdminNegativeTestJSON-656157928-project-admin Oct 04 18:28:02.473422 n-d-850501-14 devstack@n-api.service[123001]: Oct 04 18:28:02.473422 n-d-850501-14 devstack@n-api.service[123001]: {"status": "enable", "maintenance_mode": "invalid"} Oct 04 18:28:02.473422 n-d-850501-14 devstack@n-api.service[123001]: method: Oct 04 18:28:02.473422 n-d-850501-14 devstack@n-api.service[123001]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 18:28:02.474520 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': 'n-d-850501-14', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Oct 04 18:28:02.474520 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:28:02.474520 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:02.474520 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:28:02.474520 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:28:02.474520 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:28:02.474520 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:28:02.474520 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 18:28:02.474520 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:02.474520 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Oct 04 18:28:02.474520 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 04 18:28:02.474520 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi 'disable', Oct 04 18:28:02.474520 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi 'Enable', Oct 04 18:28:02.474520 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi 'Disable', Oct 04 18:28:02.474520 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 04 18:28:02.474520 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 04 18:28:02.474520 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 04 18:28:02.474520 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:02.474520 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi On instance: Oct 04 18:28:02.474520 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi 'invalid' Oct 04 18:28:02.474520 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:02.474520 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:02.474520 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:02.474520 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:02.474520 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:02.475986 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:02.475986 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:28:02.475986 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:28:02.475986 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:28:02.475986 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:28:02.475986 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:28:02.475986 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:28:02.475986 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:28:02.475986 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:28:02.475986 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:28:02.475986 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:28:02.475986 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:28:02.475986 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:28:02.475986 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 18:28:02.475986 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:02.475986 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:02.475986 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:02.475986 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:02.475986 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:02.477949 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:02.477949 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:28:02.477949 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:28:02.477949 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 18:28:02.477949 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:02.479298 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4dfa23ab-8c1d-4af2-becb-1e6be42b918b tempest-HostsAdminNegativeTestJSON-656157928 tempest-HostsAdminNegativeTestJSON-656157928-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:28:02.480372 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-4dfa23ab-8c1d-4af2-becb-1e6be42b918b tempest-HostsAdminNegativeTestJSON-656157928 tempest-HostsAdminNegativeTestJSON-656157928-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-hosts/n-d-850501-14" status: 400 len: 199 microversion: 2.1 time: 0.021759 Oct 04 18:28:02.486504 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 64/124] 10.222.0.20 () {60 vars in 1190 bytes} [Tue Oct 4 18:28:02 2022] PUT /compute/v2.1/os-hosts/n-d-850501-14 => generated 199 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:28:02.493269 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-224e8a05-7d22-4561-824d-0c0c65e515e3 tempest-HostsAdminNegativeTestJSON-656157928 tempest-HostsAdminNegativeTestJSON-656157928-project-admin] Action: 'update', calling method: .version_select at 0x7fe259bfdc10>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:02.498177 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-224e8a05-7d22-4561-824d-0c0c65e515e3 tempest-HostsAdminNegativeTestJSON-656157928 tempest-HostsAdminNegativeTestJSON-656157928-project-admin] Request method failure captured: Oct 04 18:28:02.498177 n-d-850501-14 devstack@n-api.service[123001]: request: PUT /compute/v2.1/os-hosts/n-d-850501-14 HTTP/1.1 Oct 04 18:28:02.498177 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:28:02.498177 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:28:02.498177 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:28:02.498177 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 51 Oct 04 18:28:02.498177 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:28:02.498177 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:28:02.498177 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:28:02.498177 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:28:02.498177 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPHswVB4iELHTKyO-WWYCWyXL7Xvy-PQHJj7ZVir9ihZ9l__VPZOpQu4ybx9gx1eE3JdjUhJMGQ9HYq32XMQUpEQl587iKcGplbQfJlkJLdNAEa5hqbSMyCz_IZnt3DpJX8bnuJLMnUAko6_EYOPDBPX9cvKOXTI6xhZLqS3xumktcUQ Oct 04 18:28:02.498177 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:28:02.498177 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:28:02.498177 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:28:02.498177 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:28:02.498177 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:28:02.498177 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:28:02.498177 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 72ccb71cb3144b358ea17d5864034eeb Oct 04 18:28:02.498177 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-656157928 Oct 04 18:28:02.498177 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member,admin Oct 04 18:28:02.498177 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member,admin Oct 04 18:28:02.499693 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/72ccb71cb3144b358ea17d5864034eeb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_72ccb71cb3144b358ea17d5864034eeb", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/72ccb71cb3144b358ea17d5864034eeb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/72ccb71cb3144b358ea17d5864034eeb"}]}] Oct 04 18:28:02.499693 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-HostsAdminNegativeTestJSON-656157928 Oct 04 18:28:02.499693 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 72ccb71cb3144b358ea17d5864034eeb Oct 04 18:28:02.499693 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-656157928 Oct 04 18:28:02.499693 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-HostsAdminNegativeTestJSON-656157928-project-admin Oct 04 18:28:02.499693 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:28:02.499693 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:28:02.499693 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: c87fe3b755b3484b96a5590b4819f95b Oct 04 18:28:02.499693 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-HostsAdminNegativeTestJSON-656157928-project-admin Oct 04 18:28:02.499693 n-d-850501-14 devstack@n-api.service[123001]: Oct 04 18:28:02.499693 n-d-850501-14 devstack@n-api.service[123001]: {"status": "invalid", "maintenance_mode": "enable"} Oct 04 18:28:02.499693 n-d-850501-14 devstack@n-api.service[123001]: method: Oct 04 18:28:02.499693 n-d-850501-14 devstack@n-api.service[123001]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 18:28:02.500743 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': 'n-d-850501-14', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Oct 04 18:28:02.500743 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:28:02.500743 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:02.500743 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:28:02.500743 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:28:02.500743 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:28:02.500743 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:28:02.500743 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 18:28:02.500743 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:02.500743 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Oct 04 18:28:02.500743 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 04 18:28:02.500743 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi 'disable', Oct 04 18:28:02.500743 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi 'Enable', Oct 04 18:28:02.500743 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi 'Disable', Oct 04 18:28:02.500743 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 04 18:28:02.500743 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 04 18:28:02.500743 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 04 18:28:02.500743 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:02.500743 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi On instance: Oct 04 18:28:02.500743 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi 'invalid' Oct 04 18:28:02.500743 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:02.500743 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:02.500743 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:02.500743 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:02.500743 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:02.502118 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:02.502118 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:28:02.502118 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:28:02.502118 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:28:02.502118 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:28:02.502118 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:28:02.502118 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:28:02.502118 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:28:02.502118 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:28:02.502118 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:28:02.502118 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:28:02.502118 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:28:02.502118 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:28:02.502118 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 18:28:02.502118 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:02.502118 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:02.502118 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:02.502118 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:02.502118 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:02.503197 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:02.503197 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:28:02.503197 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:28:02.503197 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 18:28:02.503197 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:02.504742 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-224e8a05-7d22-4561-824d-0c0c65e515e3 tempest-HostsAdminNegativeTestJSON-656157928 tempest-HostsAdminNegativeTestJSON-656157928-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:28:02.506073 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-224e8a05-7d22-4561-824d-0c0c65e515e3 tempest-HostsAdminNegativeTestJSON-656157928 tempest-HostsAdminNegativeTestJSON-656157928-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-hosts/n-d-850501-14" status: 400 len: 189 microversion: 2.1 time: 0.018084 Oct 04 18:28:02.506944 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 65/125] 10.222.0.20 () {60 vars in 1190 bytes} [Tue Oct 4 18:28:02 2022] PUT /compute/v2.1/os-hosts/n-d-850501-14 => generated 189 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:28:02.519723 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e6c72609-8ec9-4325-b3d4-184923b2e31e tempest-HostsAdminNegativeTestJSON-67283217 tempest-HostsAdminNegativeTestJSON-67283217-project] Action: 'update', calling method: .version_select at 0x7fe259dd9310>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:02.523341 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e6c72609-8ec9-4325-b3d4-184923b2e31e tempest-HostsAdminNegativeTestJSON-67283217 tempest-HostsAdminNegativeTestJSON-67283217-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '9cfd9c9ccc0b4cfb9a7926e2191a56b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc1a95fb7c34b409c938a80f741d229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:02.525313 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e6c72609-8ec9-4325-b3d4-184923b2e31e tempest-HostsAdminNegativeTestJSON-67283217 tempest-HostsAdminNegativeTestJSON-67283217-project] Request method failure captured: Oct 04 18:28:02.525313 n-d-850501-14 devstack@n-api.service[123001]: request: PUT /compute/v2.1/os-hosts/n-d-850501-14 HTTP/1.1 Oct 04 18:28:02.525313 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:28:02.525313 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:28:02.525313 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:28:02.525313 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 50 Oct 04 18:28:02.525313 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:28:02.525313 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:28:02.525313 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:28:02.525313 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:28:02.525313 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPHsuzeRcahzkEQR2IaPDbN0RnOxG3Q1n6UWbho0H0xZZv6bwHg21xvvR4tUCQ-m9W27rMxhm2pEyBvEgpoMbcM5P_-I5gfxr5GcIN-4H7tAUlPFI_sj_QENJ9gh9cOfQHMd0R0fyvKOMrpUUxHh-3WmMjnEHwgpI64BhOPRfIbUCyzo Oct 04 18:28:02.525313 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:28:02.525313 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:28:02.525313 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:28:02.525313 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:28:02.525313 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:28:02.525313 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:28:02.525313 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 5fc1a95fb7c34b409c938a80f741d229 Oct 04 18:28:02.525313 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-67283217 Oct 04 18:28:02.525313 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:28:02.525313 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:28:02.526775 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5fc1a95fb7c34b409c938a80f741d229"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5fc1a95fb7c34b409c938a80f741d229", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5fc1a95fb7c34b409c938a80f741d229"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5fc1a95fb7c34b409c938a80f741d229"}]}] Oct 04 18:28:02.526775 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-HostsAdminNegativeTestJSON-67283217 Oct 04 18:28:02.526775 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 5fc1a95fb7c34b409c938a80f741d229 Oct 04 18:28:02.526775 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-67283217 Oct 04 18:28:02.526775 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-HostsAdminNegativeTestJSON-67283217-project Oct 04 18:28:02.526775 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:28:02.526775 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:28:02.526775 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 9cfd9c9ccc0b4cfb9a7926e2191a56b1 Oct 04 18:28:02.526775 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-HostsAdminNegativeTestJSON-67283217-project Oct 04 18:28:02.526775 n-d-850501-14 devstack@n-api.service[123001]: Oct 04 18:28:02.526775 n-d-850501-14 devstack@n-api.service[123001]: {"status": "enable", "maintenance_mode": "enable"} Oct 04 18:28:02.526775 n-d-850501-14 devstack@n-api.service[123001]: method: Oct 04 18:28:02.526775 n-d-850501-14 devstack@n-api.service[123001]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 04 18:28:02.526775 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': 'n-d-850501-14', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 04 18:28:02.527637 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:28:02.527637 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:02.527637 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:02.527637 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:02.527637 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:28:02.527637 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:28:02.527637 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:28:02.527637 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:28:02.527637 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:28:02.527637 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:28:02.527637 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:28:02.527637 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:28:02.527637 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Oct 04 18:28:02.527637 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Oct 04 18:28:02.527637 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:28:02.527637 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:28:02.527637 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:28:02.527637 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:28:02.527637 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:28:02.527637 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:28:02.529339 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:28:02.529339 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:28:02.529339 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:28:02.529339 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:28:02.529339 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:28:02.529339 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:28:02.529339 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:28:02.529339 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:28:02.529339 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 04 18:28:02.529339 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:02.529339 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:02.529339 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:02.529339 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:02.529339 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:02.529339 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:02.529339 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:28:02.529339 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:28:02.529339 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 04 18:28:02.529339 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:02.531236 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e6c72609-8ec9-4325-b3d4-184923b2e31e tempest-HostsAdminNegativeTestJSON-67283217 tempest-HostsAdminNegativeTestJSON-67283217-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:28:02.532584 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e6c72609-8ec9-4325-b3d4-184923b2e31e tempest-HostsAdminNegativeTestJSON-67283217 tempest-HostsAdminNegativeTestJSON-67283217-project] 10.222.0.20 "PUT /compute/v2.1/os-hosts/n-d-850501-14" status: 403 len: 111 microversion: 2.1 time: 0.019193 Oct 04 18:28:02.538602 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 66/126] 10.222.0.20 () {60 vars in 1190 bytes} [Tue Oct 4 18:28:02 2022] PUT /compute/v2.1/os-hosts/n-d-850501-14 => generated 111 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:28:02.544621 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6ca06d60-e5ce-41d6-bc19-9f531b0ccd52 tempest-HostsAdminNegativeTestJSON-656157928 tempest-HostsAdminNegativeTestJSON-656157928-project-admin] Action: 'update', calling method: .version_select at 0x7fe259ba4b80>, body: {"status": null, "maintenance_mode": null} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:02.548972 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6ca06d60-e5ce-41d6-bc19-9f531b0ccd52 tempest-HostsAdminNegativeTestJSON-656157928 tempest-HostsAdminNegativeTestJSON-656157928-project-admin] Request method failure captured: Oct 04 18:28:02.548972 n-d-850501-14 devstack@n-api.service[123001]: request: PUT /compute/v2.1/os-hosts/n-d-850501-14 HTTP/1.1 Oct 04 18:28:02.548972 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:28:02.548972 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:28:02.548972 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:28:02.548972 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 42 Oct 04 18:28:02.548972 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:28:02.548972 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:28:02.548972 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:28:02.548972 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:28:02.548972 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPHswVB4iELHTKyO-WWYCWyXL7Xvy-PQHJj7ZVir9ihZ9l__VPZOpQu4ybx9gx1eE3JdjUhJMGQ9HYq32XMQUpEQl587iKcGplbQfJlkJLdNAEa5hqbSMyCz_IZnt3DpJX8bnuJLMnUAko6_EYOPDBPX9cvKOXTI6xhZLqS3xumktcUQ Oct 04 18:28:02.548972 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:28:02.548972 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:28:02.548972 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:28:02.548972 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:28:02.548972 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:28:02.548972 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:28:02.548972 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 72ccb71cb3144b358ea17d5864034eeb Oct 04 18:28:02.548972 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-656157928 Oct 04 18:28:02.548972 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member,admin Oct 04 18:28:02.548972 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member,admin Oct 04 18:28:02.550070 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/72ccb71cb3144b358ea17d5864034eeb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_72ccb71cb3144b358ea17d5864034eeb", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/72ccb71cb3144b358ea17d5864034eeb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/72ccb71cb3144b358ea17d5864034eeb"}]}] Oct 04 18:28:02.550070 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-HostsAdminNegativeTestJSON-656157928 Oct 04 18:28:02.550070 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 72ccb71cb3144b358ea17d5864034eeb Oct 04 18:28:02.550070 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-656157928 Oct 04 18:28:02.550070 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-HostsAdminNegativeTestJSON-656157928-project-admin Oct 04 18:28:02.550070 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:28:02.550070 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:28:02.550070 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: c87fe3b755b3484b96a5590b4819f95b Oct 04 18:28:02.550070 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-HostsAdminNegativeTestJSON-656157928-project-admin Oct 04 18:28:02.550070 n-d-850501-14 devstack@n-api.service[123001]: Oct 04 18:28:02.550070 n-d-850501-14 devstack@n-api.service[123001]: {"status": null, "maintenance_mode": null} Oct 04 18:28:02.550070 n-d-850501-14 devstack@n-api.service[123001]: method: Oct 04 18:28:02.550070 n-d-850501-14 devstack@n-api.service[123001]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 04 18:28:02.550070 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': 'n-d-850501-14', 'body': {'status': None, 'maintenance_mode': None}} Oct 04 18:28:02.551473 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:28:02.551473 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:02.551473 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:28:02.551473 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:28:02.551473 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:28:02.551473 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:28:02.551473 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Oct 04 18:28:02.551473 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:02.551473 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Oct 04 18:28:02.551473 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 04 18:28:02.551473 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi 'disable', Oct 04 18:28:02.551473 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi 'Enable', Oct 04 18:28:02.551473 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi 'Disable', Oct 04 18:28:02.551473 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 04 18:28:02.551473 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 04 18:28:02.551473 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 04 18:28:02.551473 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:02.551473 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi On instance: Oct 04 18:28:02.551473 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi None Oct 04 18:28:02.551473 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:02.551473 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:02.551473 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:02.551473 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:02.551473 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:02.551473 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:02.552735 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:28:02.552735 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:28:02.552735 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:28:02.552735 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:28:02.552735 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:28:02.552735 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:28:02.552735 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:28:02.552735 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:28:02.552735 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:28:02.552735 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:28:02.552735 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:28:02.552735 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:28:02.552735 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 04 18:28:02.552735 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:02.552735 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:02.552735 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:02.552735 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:02.552735 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:02.552735 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:02.554028 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:28:02.554028 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:28:02.554028 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 04 18:28:02.554028 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:02.554028 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6ca06d60-e5ce-41d6-bc19-9f531b0ccd52 tempest-HostsAdminNegativeTestJSON-656157928 tempest-HostsAdminNegativeTestJSON-656157928-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:28:02.554028 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6ca06d60-e5ce-41d6-bc19-9f531b0ccd52 tempest-HostsAdminNegativeTestJSON-656157928 tempest-HostsAdminNegativeTestJSON-656157928-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-hosts/n-d-850501-14" status: 400 len: 127 microversion: 2.1 time: 0.010900 Oct 04 18:28:02.556732 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 67/127] 10.222.0.20 () {60 vars in 1190 bytes} [Tue Oct 4 18:28:02 2022] PUT /compute/v2.1/os-hosts/n-d-850501-14 => generated 127 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:28:02.565167 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-17a5a67e-8310-4e16-8a84-9f6627f8018a tempest-HostsAdminNegativeTestJSON-656157928 tempest-HostsAdminNegativeTestJSON-656157928-project-admin] Action: 'update', calling method: .version_select at 0x7fe259ba4f70>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:02.568623 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.hosts [None req-17a5a67e-8310-4e16-8a84-9f6627f8018a tempest-HostsAdminNegativeTestJSON-656157928 tempest-HostsAdminNegativeTestJSON-656157928-project-admin] Enabling host nonexistent_hostname. Oct 04 18:28:02.580184 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-17a5a67e-8310-4e16-8a84-9f6627f8018a tempest-HostsAdminNegativeTestJSON-656157928 tempest-HostsAdminNegativeTestJSON-656157928-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:28:02.582190 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-17a5a67e-8310-4e16-8a84-9f6627f8018a tempest-HostsAdminNegativeTestJSON-656157928 tempest-HostsAdminNegativeTestJSON-656157928-project-admin] Request method failure captured: Oct 04 18:28:02.582190 n-d-850501-14 devstack@n-api.service[123001]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 04 18:28:02.582190 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:28:02.582190 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:28:02.582190 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:28:02.582190 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 50 Oct 04 18:28:02.582190 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:28:02.582190 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:28:02.582190 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:28:02.582190 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:28:02.582190 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPHswVB4iELHTKyO-WWYCWyXL7Xvy-PQHJj7ZVir9ihZ9l__VPZOpQu4ybx9gx1eE3JdjUhJMGQ9HYq32XMQUpEQl587iKcGplbQfJlkJLdNAEa5hqbSMyCz_IZnt3DpJX8bnuJLMnUAko6_EYOPDBPX9cvKOXTI6xhZLqS3xumktcUQ Oct 04 18:28:02.582190 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:28:02.582190 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:28:02.582190 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:28:02.582190 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:28:02.582190 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:28:02.582190 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:28:02.582190 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 72ccb71cb3144b358ea17d5864034eeb Oct 04 18:28:02.582190 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-656157928 Oct 04 18:28:02.582190 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member,admin Oct 04 18:28:02.582190 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member,admin Oct 04 18:28:02.583975 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/72ccb71cb3144b358ea17d5864034eeb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_72ccb71cb3144b358ea17d5864034eeb", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/72ccb71cb3144b358ea17d5864034eeb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/72ccb71cb3144b358ea17d5864034eeb"}]}] Oct 04 18:28:02.583975 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-HostsAdminNegativeTestJSON-656157928 Oct 04 18:28:02.583975 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 72ccb71cb3144b358ea17d5864034eeb Oct 04 18:28:02.583975 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-656157928 Oct 04 18:28:02.583975 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-HostsAdminNegativeTestJSON-656157928-project-admin Oct 04 18:28:02.583975 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:28:02.583975 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:28:02.583975 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: c87fe3b755b3484b96a5590b4819f95b Oct 04 18:28:02.583975 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-HostsAdminNegativeTestJSON-656157928-project-admin Oct 04 18:28:02.583975 n-d-850501-14 devstack@n-api.service[123001]: Oct 04 18:28:02.583975 n-d-850501-14 devstack@n-api.service[123001]: {"status": "enable", "maintenance_mode": "enable"} Oct 04 18:28:02.583975 n-d-850501-14 devstack@n-api.service[123001]: method: Oct 04 18:28:02.583975 n-d-850501-14 devstack@n-api.service[123001]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:28:02.583975 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 04 18:28:02.585213 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:28:02.585213 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:02.585213 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Oct 04 18:28:02.585213 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Oct 04 18:28:02.585213 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 18:28:02.585213 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 18:28:02.585213 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:28:02.585213 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:28:02.585213 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:28:02.585213 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:28:02.585213 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 18:28:02.585213 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 18:28:02.585213 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 04 18:28:02.585213 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 04 18:28:02.585213 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:28:02.585213 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:28:02.585213 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 04 18:28:02.585213 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 04 18:28:02.586423 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:28:02.586423 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:28:02.586423 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 04 18:28:02.586423 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 04 18:28:02.586423 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:28:02.586423 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:02.586423 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:02.586423 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:02.586423 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:02.586423 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:02.586423 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:02.586423 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:28:02.586423 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:28:02.586423 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:28:02.586423 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:28:02.586423 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:28:02.586423 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:28:02.586423 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:28:02.586423 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:28:02.586423 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Oct 04 18:28:02.587629 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Oct 04 18:28:02.587629 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Oct 04 18:28:02.587629 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:28:02.587629 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:28:02.587629 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:02.587629 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:02.587629 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:02.587629 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:02.587629 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:02.587629 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:02.587629 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:28:02.587629 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:28:02.587629 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:28:02.587629 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:02.587629 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-17a5a67e-8310-4e16-8a84-9f6627f8018a tempest-HostsAdminNegativeTestJSON-656157928 tempest-HostsAdminNegativeTestJSON-656157928-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:28:02.588453 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-17a5a67e-8310-4e16-8a84-9f6627f8018a tempest-HostsAdminNegativeTestJSON-656157928 tempest-HostsAdminNegativeTestJSON-656157928-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.025164 Oct 04 18:28:02.592933 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 68/128] 10.222.0.20 () {60 vars in 1211 bytes} [Tue Oct 4 18:28:02 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:28:02.816568 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-40b38b81-a1fa-456c-8cce-50be11ff9e71 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86a8d114fbc4eb584934904d8f2ef56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126dad7acaf44f909302eac21c4aafcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:02.826173 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-40b38b81-a1fa-456c-8cce-50be11ff9e71 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] 10.222.0.20 "GET /compute/v2.1/servers/31110a13-e556-40c8-8d78-5243794ff095" status: 200 len: 1296 microversion: 2.1 time: 0.514362 Oct 04 18:28:02.854271 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 61/129] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:02 2022] GET /compute/v2.1/servers/31110a13-e556-40c8-8d78-5243794ff095 => generated 1296 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:03.101296 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-28d6989e-f64c-47be-b6f4-26d6f7b04434 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:03.105841 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-28d6989e-f64c-47be-b6f4-26d6f7b04434 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] [instance: 6da2d407-863f-4f6a-9d71-d81e96f160fb] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:03.113837 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-28d6989e-f64c-47be-b6f4-26d6f7b04434 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:03.121010 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-28d6989e-f64c-47be-b6f4-26d6f7b04434 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:03.121482 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-28d6989e-f64c-47be-b6f4-26d6f7b04434 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:03.122246 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-28d6989e-f64c-47be-b6f4-26d6f7b04434 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:03.122719 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-28d6989e-f64c-47be-b6f4-26d6f7b04434 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:03.123164 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-28d6989e-f64c-47be-b6f4-26d6f7b04434 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:03.870343 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b248cbaf-a00e-44c2-83bd-881a953f60de tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:03.870993 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b248cbaf-a00e-44c2-83bd-881a953f60de tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] [instance: 31110a13-e556-40c8-8d78-5243794ff095] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:03.881362 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b248cbaf-a00e-44c2-83bd-881a953f60de tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:03.882131 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b248cbaf-a00e-44c2-83bd-881a953f60de tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:03.882853 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b248cbaf-a00e-44c2-83bd-881a953f60de tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:03.885727 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b248cbaf-a00e-44c2-83bd-881a953f60de tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:03.886416 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b248cbaf-a00e-44c2-83bd-881a953f60de tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:03.887039 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b248cbaf-a00e-44c2-83bd-881a953f60de tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:04.251370 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-28d6989e-f64c-47be-b6f4-26d6f7b04434 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f87d9eaf49545bb8effb170768bb8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e99a0400fe947bb8907857cc4de2899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:04.264181 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-28d6989e-f64c-47be-b6f4-26d6f7b04434 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] 10.222.0.20 "GET /compute/v2.1/servers/6da2d407-863f-4f6a-9d71-d81e96f160fb" status: 200 len: 1341 microversion: 2.1 time: 1.168851 Oct 04 18:28:04.287928 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 69/130] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:03 2022] GET /compute/v2.1/servers/6da2d407-863f-4f6a-9d71-d81e96f160fb => generated 1341 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:04.317595 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b248cbaf-a00e-44c2-83bd-881a953f60de tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86a8d114fbc4eb584934904d8f2ef56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126dad7acaf44f909302eac21c4aafcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:04.328475 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=100 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:28:04.331023 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b248cbaf-a00e-44c2-83bd-881a953f60de tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] 10.222.0.20 "GET /compute/v2.1/servers/31110a13-e556-40c8-8d78-5243794ff095" status: 200 len: 1296 microversion: 2.1 time: 0.471327 Oct 04 18:28:04.332751 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 62/131] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:03 2022] GET /compute/v2.1/servers/31110a13-e556-40c8-8d78-5243794ff095 => generated 1296 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:05.298910 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-aac02f97-75c1-4990-a2df-54732da25774 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:05.302554 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-aac02f97-75c1-4990-a2df-54732da25774 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] [instance: 6da2d407-863f-4f6a-9d71-d81e96f160fb] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:05.331399 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aac02f97-75c1-4990-a2df-54732da25774 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:05.331399 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aac02f97-75c1-4990-a2df-54732da25774 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:05.331399 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aac02f97-75c1-4990-a2df-54732da25774 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:05.344245 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aac02f97-75c1-4990-a2df-54732da25774 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:05.347990 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aac02f97-75c1-4990-a2df-54732da25774 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:05.349841 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aac02f97-75c1-4990-a2df-54732da25774 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:05.360847 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-dcf1e823-71c0-4d14-82e7-9d7c549a1e66 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:05.360847 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-dcf1e823-71c0-4d14-82e7-9d7c549a1e66 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] [instance: 31110a13-e556-40c8-8d78-5243794ff095] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:05.385582 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dcf1e823-71c0-4d14-82e7-9d7c549a1e66 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:05.387698 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dcf1e823-71c0-4d14-82e7-9d7c549a1e66 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:05.389353 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dcf1e823-71c0-4d14-82e7-9d7c549a1e66 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:05.392302 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dcf1e823-71c0-4d14-82e7-9d7c549a1e66 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:05.393858 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dcf1e823-71c0-4d14-82e7-9d7c549a1e66 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:05.394807 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dcf1e823-71c0-4d14-82e7-9d7c549a1e66 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:05.763042 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=10 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:28:06.033817 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-aac02f97-75c1-4990-a2df-54732da25774 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f87d9eaf49545bb8effb170768bb8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e99a0400fe947bb8907857cc4de2899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:06.045176 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-aac02f97-75c1-4990-a2df-54732da25774 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] 10.222.0.20 "GET /compute/v2.1/servers/6da2d407-863f-4f6a-9d71-d81e96f160fb" status: 200 len: 1341 microversion: 2.1 time: 0.759274 Oct 04 18:28:06.046060 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 70/132] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:05 2022] GET /compute/v2.1/servers/6da2d407-863f-4f6a-9d71-d81e96f160fb => generated 1341 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:06.135101 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-dcf1e823-71c0-4d14-82e7-9d7c549a1e66 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86a8d114fbc4eb584934904d8f2ef56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126dad7acaf44f909302eac21c4aafcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:06.151806 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-dcf1e823-71c0-4d14-82e7-9d7c549a1e66 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] 10.222.0.20 "GET /compute/v2.1/servers/31110a13-e556-40c8-8d78-5243794ff095" status: 200 len: 1338 microversion: 2.1 time: 0.797604 Oct 04 18:28:06.154381 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 63/133] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:05 2022] GET /compute/v2.1/servers/31110a13-e556-40c8-8d78-5243794ff095 => generated 1338 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:06.974279 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-83fbcd73-eceb-47b4-a434-7715166f0068 req-1811fde0-9c38-4b43-bd95-7ee6645d6bc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31110a13-e556-40c8-8d78-5243794ff095", "tag": "a42dbecd-d6e2-4ab5-b9b2-a4bb5001da71"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:07.003944 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-83fbcd73-eceb-47b4-a434-7715166f0068 req-1811fde0-9c38-4b43-bd95-7ee6645d6bc4 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:07.007609 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-83fbcd73-eceb-47b4-a434-7715166f0068 req-1811fde0-9c38-4b43-bd95-7ee6645d6bc4 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:07.008611 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-83fbcd73-eceb-47b4-a434-7715166f0068 req-1811fde0-9c38-4b43-bd95-7ee6645d6bc4 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:07.077806 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-83fbcd73-eceb-47b4-a434-7715166f0068 req-1811fde0-9c38-4b43-bd95-7ee6645d6bc4 service nova] Creating event network-changed:a42dbecd-d6e2-4ab5-b9b2-a4bb5001da71 for instance 31110a13-e556-40c8-8d78-5243794ff095 on n-h1-850501-14 Oct 04 18:28:07.078253 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-31b9ea23-470b-43e4-bbda-da13ac5d3b14 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:07.078758 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-83fbcd73-eceb-47b4-a434-7715166f0068 req-1811fde0-9c38-4b43-bd95-7ee6645d6bc4 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=123001) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 18:28:07.082509 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-31b9ea23-470b-43e4-bbda-da13ac5d3b14 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] [instance: 6da2d407-863f-4f6a-9d71-d81e96f160fb] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:07.088777 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-83fbcd73-eceb-47b4-a434-7715166f0068 req-1811fde0-9c38-4b43-bd95-7ee6645d6bc4 service nova] Acquired lock "compute-rpcapi-router" {{(pid=123001) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 18:28:07.090065 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f06823ca-1e57-4494-b255-ea94030743e5 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:07.090561 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f06823ca-1e57-4494-b255-ea94030743e5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:07.091007 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f06823ca-1e57-4494-b255-ea94030743e5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:07.091737 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f06823ca-1e57-4494-b255-ea94030743e5 None None] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:07.092226 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f06823ca-1e57-4494-b255-ea94030743e5 None None] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:07.095872 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f06823ca-1e57-4494-b255-ea94030743e5 None None] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:07.099723 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=12 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:28:07.109918 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.compute.rpcapi [None req-f06823ca-1e57-4494-b255-ea94030743e5 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 04 18:28:07.110819 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f06823ca-1e57-4494-b255-ea94030743e5 None None] Releasing lock "compute-rpcapi-router" {{(pid=123001) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 18:28:07.111500 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-31b9ea23-470b-43e4-bbda-da13ac5d3b14 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:07.113009 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-31b9ea23-470b-43e4-bbda-da13ac5d3b14 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:07.115931 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-31b9ea23-470b-43e4-bbda-da13ac5d3b14 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:07.120950 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-31b9ea23-470b-43e4-bbda-da13ac5d3b14 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:07.122941 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-31b9ea23-470b-43e4-bbda-da13ac5d3b14 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:07.124329 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-31b9ea23-470b-43e4-bbda-da13ac5d3b14 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:07.154723 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f06823ca-1e57-4494-b255-ea94030743e5 None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.181077 Oct 04 18:28:07.164714 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 71/134] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:28:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:28:07.185655 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b0d2c5ee-cf24-411a-97f8-ddbabacc4cf9 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:07.186732 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b0d2c5ee-cf24-411a-97f8-ddbabacc4cf9 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] [instance: 31110a13-e556-40c8-8d78-5243794ff095] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:07.211716 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b0d2c5ee-cf24-411a-97f8-ddbabacc4cf9 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:07.212608 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b0d2c5ee-cf24-411a-97f8-ddbabacc4cf9 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:07.213291 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b0d2c5ee-cf24-411a-97f8-ddbabacc4cf9 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:07.214417 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b0d2c5ee-cf24-411a-97f8-ddbabacc4cf9 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:07.221659 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b0d2c5ee-cf24-411a-97f8-ddbabacc4cf9 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:07.222355 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b0d2c5ee-cf24-411a-97f8-ddbabacc4cf9 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:07.907044 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b0d2c5ee-cf24-411a-97f8-ddbabacc4cf9 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86a8d114fbc4eb584934904d8f2ef56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126dad7acaf44f909302eac21c4aafcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:07.917534 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b0d2c5ee-cf24-411a-97f8-ddbabacc4cf9 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] 10.222.0.20 "GET /compute/v2.1/servers/31110a13-e556-40c8-8d78-5243794ff095" status: 200 len: 1338 microversion: 2.1 time: 0.737470 Oct 04 18:28:07.924286 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 72/135] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:07 2022] GET /compute/v2.1/servers/31110a13-e556-40c8-8d78-5243794ff095 => generated 1338 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:08.028404 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-31b9ea23-470b-43e4-bbda-da13ac5d3b14 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f87d9eaf49545bb8effb170768bb8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e99a0400fe947bb8907857cc4de2899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:08.043636 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-31b9ea23-470b-43e4-bbda-da13ac5d3b14 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] 10.222.0.20 "GET /compute/v2.1/servers/6da2d407-863f-4f6a-9d71-d81e96f160fb" status: 200 len: 1341 microversion: 2.1 time: 0.965517 Oct 04 18:28:08.057187 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 64/136] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:07 2022] GET /compute/v2.1/servers/6da2d407-863f-4f6a-9d71-d81e96f160fb => generated 1341 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:08.951993 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-28122752-4fe6-45aa-b09a-431e7d00de1e tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:08.952588 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-28122752-4fe6-45aa-b09a-431e7d00de1e tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] [instance: 31110a13-e556-40c8-8d78-5243794ff095] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:08.971621 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-28122752-4fe6-45aa-b09a-431e7d00de1e tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:08.972136 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-28122752-4fe6-45aa-b09a-431e7d00de1e tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:08.972575 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-28122752-4fe6-45aa-b09a-431e7d00de1e tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:08.973281 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-28122752-4fe6-45aa-b09a-431e7d00de1e tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:08.973730 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-28122752-4fe6-45aa-b09a-431e7d00de1e tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:08.974149 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-28122752-4fe6-45aa-b09a-431e7d00de1e tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:09.076226 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-cecf8949-cc10-47b8-957f-6c06c3ccaca2 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:09.076949 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-cecf8949-cc10-47b8-957f-6c06c3ccaca2 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] [instance: 6da2d407-863f-4f6a-9d71-d81e96f160fb] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:09.090497 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cecf8949-cc10-47b8-957f-6c06c3ccaca2 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:09.090995 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cecf8949-cc10-47b8-957f-6c06c3ccaca2 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:09.091428 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cecf8949-cc10-47b8-957f-6c06c3ccaca2 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:09.092171 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cecf8949-cc10-47b8-957f-6c06c3ccaca2 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:09.092630 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cecf8949-cc10-47b8-957f-6c06c3ccaca2 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:09.093051 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cecf8949-cc10-47b8-957f-6c06c3ccaca2 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:09.235087 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-28122752-4fe6-45aa-b09a-431e7d00de1e tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86a8d114fbc4eb584934904d8f2ef56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126dad7acaf44f909302eac21c4aafcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:09.256634 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-28122752-4fe6-45aa-b09a-431e7d00de1e tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] 10.222.0.20 "GET /compute/v2.1/servers/31110a13-e556-40c8-8d78-5243794ff095" status: 200 len: 1338 microversion: 2.1 time: 0.312562 Oct 04 18:28:09.264953 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 73/137] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:08 2022] GET /compute/v2.1/servers/31110a13-e556-40c8-8d78-5243794ff095 => generated 1338 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:09.337288 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-cecf8949-cc10-47b8-957f-6c06c3ccaca2 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f87d9eaf49545bb8effb170768bb8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e99a0400fe947bb8907857cc4de2899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:09.351031 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-cecf8949-cc10-47b8-957f-6c06c3ccaca2 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] 10.222.0.20 "GET /compute/v2.1/servers/6da2d407-863f-4f6a-9d71-d81e96f160fb" status: 200 len: 1341 microversion: 2.1 time: 0.282764 Oct 04 18:28:09.352557 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 65/138] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:09 2022] GET /compute/v2.1/servers/6da2d407-863f-4f6a-9d71-d81e96f160fb => generated 1341 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:10.288355 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-86e2394e-56dd-48cb-b306-be46da81423f tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:10.290237 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-86e2394e-56dd-48cb-b306-be46da81423f tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] [instance: 31110a13-e556-40c8-8d78-5243794ff095] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:10.306122 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-86e2394e-56dd-48cb-b306-be46da81423f tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:10.306122 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-86e2394e-56dd-48cb-b306-be46da81423f tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:10.306419 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-86e2394e-56dd-48cb-b306-be46da81423f tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:10.307366 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-86e2394e-56dd-48cb-b306-be46da81423f tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:10.308017 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-86e2394e-56dd-48cb-b306-be46da81423f tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:10.309584 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-86e2394e-56dd-48cb-b306-be46da81423f tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:10.377664 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b927032a-4857-480c-9940-bb66b95ce58b tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:10.379013 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b927032a-4857-480c-9940-bb66b95ce58b tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] [instance: 6da2d407-863f-4f6a-9d71-d81e96f160fb] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:10.392341 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b927032a-4857-480c-9940-bb66b95ce58b tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:10.392341 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b927032a-4857-480c-9940-bb66b95ce58b tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:10.392341 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b927032a-4857-480c-9940-bb66b95ce58b tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:10.392341 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b927032a-4857-480c-9940-bb66b95ce58b tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:10.392647 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b927032a-4857-480c-9940-bb66b95ce58b tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:10.392647 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b927032a-4857-480c-9940-bb66b95ce58b tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:10.516664 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=10 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:28:10.690782 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-86e2394e-56dd-48cb-b306-be46da81423f tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86a8d114fbc4eb584934904d8f2ef56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126dad7acaf44f909302eac21c4aafcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:10.703827 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-86e2394e-56dd-48cb-b306-be46da81423f tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] 10.222.0.20 "GET /compute/v2.1/servers/31110a13-e556-40c8-8d78-5243794ff095" status: 200 len: 1338 microversion: 2.1 time: 0.419022 Oct 04 18:28:10.718452 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 74/139] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:10 2022] GET /compute/v2.1/servers/31110a13-e556-40c8-8d78-5243794ff095 => generated 1338 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:10.789088 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b927032a-4857-480c-9940-bb66b95ce58b tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f87d9eaf49545bb8effb170768bb8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e99a0400fe947bb8907857cc4de2899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:10.798370 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b927032a-4857-480c-9940-bb66b95ce58b tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] 10.222.0.20 "GET /compute/v2.1/servers/6da2d407-863f-4f6a-9d71-d81e96f160fb" status: 200 len: 1341 microversion: 2.1 time: 0.426449 Oct 04 18:28:10.812707 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 66/140] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:10 2022] GET /compute/v2.1/servers/6da2d407-863f-4f6a-9d71-d81e96f160fb => generated 1341 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:11.393515 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-be5a916a-ffe8-4ef3-80c5-df479a15a9f3 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:11.405588 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-be5a916a-ffe8-4ef3-80c5-df479a15a9f3 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.655977 Oct 04 18:28:11.406298 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 75/141] 10.222.0.20 () {58 vars in 1137 bytes} [Tue Oct 4 18:28:10 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:28:11.716614 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a3730d7c-3127-4896-ba80-40b8c8523649 tempest-ServersWithSpecificFlavorTestJSON-755179089 tempest-ServersWithSpecificFlavorTestJSON-755179089-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-51504063", "id": 1799497983, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:11.762403 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e9f0cca3-5c88-40eb-b7d2-862c548232e7 tempest-FlavorsExtraSpecsNegativeTestJSON-685207055 tempest-FlavorsExtraSpecsNegativeTestJSON-685207055-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1688199108", "ram": 512, "vcpus": 1, "disk": 10, "id": 1253098700, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:11.824495 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a3730d7c-3127-4896-ba80-40b8c8523649 tempest-ServersWithSpecificFlavorTestJSON-755179089 tempest-ServersWithSpecificFlavorTestJSON-755179089-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 423 microversion: 2.1 time: 0.407564 Oct 04 18:28:11.832182 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 67/142] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:28:11 2022] POST /compute/v2.1/flavors => generated 423 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:28:11.835652 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-dd267737-8bd3-441f-890f-ca2e5938a0a1 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:11.836327 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-dd267737-8bd3-441f-890f-ca2e5938a0a1 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] [instance: 31110a13-e556-40c8-8d78-5243794ff095] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:11.843238 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dd267737-8bd3-441f-890f-ca2e5938a0a1 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:11.843726 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dd267737-8bd3-441f-890f-ca2e5938a0a1 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:11.844190 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dd267737-8bd3-441f-890f-ca2e5938a0a1 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:11.844888 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dd267737-8bd3-441f-890f-ca2e5938a0a1 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:11.845344 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dd267737-8bd3-441f-890f-ca2e5938a0a1 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:11.845761 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dd267737-8bd3-441f-890f-ca2e5938a0a1 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:11.887139 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e9f0cca3-5c88-40eb-b7d2-862c548232e7 tempest-FlavorsExtraSpecsNegativeTestJSON-685207055 tempest-FlavorsExtraSpecsNegativeTestJSON-685207055-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.315374 Oct 04 18:28:11.895760 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 76/143] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:28:11 2022] POST /compute/v2.1/flavors => generated 416 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:28:11.896296 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6e69cfbd-718d-4d9b-8a3f-fe6a8700eede tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:11.896928 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6e69cfbd-718d-4d9b-8a3f-fe6a8700eede tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] [instance: 6da2d407-863f-4f6a-9d71-d81e96f160fb] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:11.903649 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6e69cfbd-718d-4d9b-8a3f-fe6a8700eede tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:11.904649 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6e69cfbd-718d-4d9b-8a3f-fe6a8700eede tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:11.904777 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6e69cfbd-718d-4d9b-8a3f-fe6a8700eede tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:11.905422 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6e69cfbd-718d-4d9b-8a3f-fe6a8700eede tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:11.905881 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6e69cfbd-718d-4d9b-8a3f-fe6a8700eede tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:11.906307 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6e69cfbd-718d-4d9b-8a3f-fe6a8700eede tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:12.041587 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-dd267737-8bd3-441f-890f-ca2e5938a0a1 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86a8d114fbc4eb584934904d8f2ef56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126dad7acaf44f909302eac21c4aafcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:12.056645 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-dd267737-8bd3-441f-890f-ca2e5938a0a1 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] 10.222.0.20 "GET /compute/v2.1/servers/31110a13-e556-40c8-8d78-5243794ff095" status: 200 len: 1338 microversion: 2.1 time: 0.227677 Oct 04 18:28:12.057273 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 68/144] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:11 2022] GET /compute/v2.1/servers/31110a13-e556-40c8-8d78-5243794ff095 => generated 1338 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:12.070307 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-46a489c4-28ad-4c26-9de8-72322430fa5f tempest-ServersWithSpecificFlavorTestJSON-755179089 tempest-ServersWithSpecificFlavorTestJSON-755179089-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:12.080991 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-46a489c4-28ad-4c26-9de8-72322430fa5f tempest-ServersWithSpecificFlavorTestJSON-755179089 tempest-ServersWithSpecificFlavorTestJSON-755179089-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.021109 Oct 04 18:28:12.082347 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 69/145] 10.222.0.20 () {58 vars in 1182 bytes} [Tue Oct 4 18:28:12 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:28:12.106568 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6e69cfbd-718d-4d9b-8a3f-fe6a8700eede tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f87d9eaf49545bb8effb170768bb8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e99a0400fe947bb8907857cc4de2899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:12.114014 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6e69cfbd-718d-4d9b-8a3f-fe6a8700eede tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] 10.222.0.20 "GET /compute/v2.1/servers/6da2d407-863f-4f6a-9d71-d81e96f160fb" status: 200 len: 1341 microversion: 2.1 time: 0.222075 Oct 04 18:28:12.115202 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 77/146] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:11 2022] GET /compute/v2.1/servers/6da2d407-863f-4f6a-9d71-d81e96f160fb => generated 1341 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:12.120456 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-dbff0f8d-6d31-4d32-ab22-b45baaee36d1 tempest-ServersWithSpecificFlavorTestJSON-755179089 tempest-ServersWithSpecificFlavorTestJSON-755179089-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1278173593", "id": 1102270088, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:12.200101 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-dbff0f8d-6d31-4d32-ab22-b45baaee36d1 tempest-ServersWithSpecificFlavorTestJSON-755179089 tempest-ServersWithSpecificFlavorTestJSON-755179089-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.083691 Oct 04 18:28:12.200899 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 78/147] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:28:12 2022] POST /compute/v2.1/flavors => generated 425 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:28:12.212323 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1e3dabde-e28a-4642-99a7-407e72a7f823 tempest-ServersWithSpecificFlavorTestJSON-755179089 tempest-ServersWithSpecificFlavorTestJSON-755179089-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:12.219608 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1e3dabde-e28a-4642-99a7-407e72a7f823 tempest-ServersWithSpecificFlavorTestJSON-755179089 tempest-ServersWithSpecificFlavorTestJSON-755179089-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.011030 Oct 04 18:28:12.220194 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 79/148] 10.222.0.20 () {58 vars in 1182 bytes} [Tue Oct 4 18:28:12 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 18:28:12.233113 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-aad66c1e-6e21-4e7f-bf0b-b47bb573a700 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Action: 'create', calling method: .version_select at 0x7fe259ba4670>, body: {"keypair": {"name": "tempest-keypair-1365947858", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTSZ1slE/oUO+peI4NmVYP5stGayB7rfe48fYhfGARxxUHkHw24tLkq2y9RUJZh1i8GD8DF/5UgQrqY3rx5z5e6jAcSdoO534kPYRDFOYwuNV6wCsj5yu4PPykmNcOvsg=="}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:12.263646 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-aad66c1e-6e21-4e7f-bf0b-b47bb573a700 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Getting quotas for project 25214dec3ef24597be8e5acde61de3eb. Resources: {'key_pairs'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:28:12.268916 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-aad66c1e-6e21-4e7f-bf0b-b47bb573a700 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Getting quotas for user 8675d7d8bab840f3a221fdf2ee4c9b5c and project 25214dec3ef24597be8e5acde61de3eb. Resources: {'key_pairs'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:28:12.395499 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-aad66c1e-6e21-4e7f-bf0b-b47bb573a700 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.165771 Oct 04 18:28:12.396923 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 80/149] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Oct 4 18:28:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:28:12.471859 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d8d9fb59-7b63-4141-ad72-59631c09c70f tempest-FlavorsExtraSpecsNegativeTestJSON-242129891 tempest-FlavorsExtraSpecsNegativeTestJSON-242129891-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:12.490011 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-d8d9fb59-7b63-4141-ad72-59631c09c70f tempest-FlavorsExtraSpecsNegativeTestJSON-242129891 tempest-FlavorsExtraSpecsNegativeTestJSON-242129891-project] HTTP exception thrown: Flavor 1253098700 has no extra specs with key hw:cpu_thread_policy. Oct 04 18:28:12.497240 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d8d9fb59-7b63-4141-ad72-59631c09c70f tempest-FlavorsExtraSpecsNegativeTestJSON-242129891 tempest-FlavorsExtraSpecsNegativeTestJSON-242129891-project] Request method failure captured: Oct 04 18:28:12.497240 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/flavors/1253098700/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 04 18:28:12.497240 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:28:12.497240 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:28:12.497240 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:28:12.497240 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:28:12.497240 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:28:12.497240 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:28:12.497240 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:28:12.497240 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:28:12.497240 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPHs5_zrexU6JlkcM3LZx792i6cBxPZrYJquOrrLbg8XWpYtQr4pFz2jvqLYXJxS6sOVhpxmoe0lzgAdQVNOExbAruWZG0bYB16wsA9P6SvmSW_H19cQmgCBLpeQzWvfD0mj9A3N3M7h_EczSmklpVexeM1at9YxvN8YugSbmsvoPCnE Oct 04 18:28:12.497240 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:28:12.497240 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:28:12.497240 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:28:12.497240 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:28:12.497240 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:28:12.497240 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:28:12.497240 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: c857ebe4d2b14cd0abd6af3c30960969 Oct 04 18:28:12.497240 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-242129891 Oct 04 18:28:12.497240 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:28:12.497240 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:28:12.500036 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c857ebe4d2b14cd0abd6af3c30960969"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c857ebe4d2b14cd0abd6af3c30960969", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c857ebe4d2b14cd0abd6af3c30960969"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c857ebe4d2b14cd0abd6af3c30960969"}]}] Oct 04 18:28:12.500036 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-242129891 Oct 04 18:28:12.500036 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: c857ebe4d2b14cd0abd6af3c30960969 Oct 04 18:28:12.500036 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-242129891 Oct 04 18:28:12.500036 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-242129891-project Oct 04 18:28:12.500036 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:28:12.500036 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:28:12.500036 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 01c80554d0f543a28ce5b382cdfa56b5 Oct 04 18:28:12.500036 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-242129891-project Oct 04 18:28:12.500036 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:28:12.500036 n-d-850501-14 devstack@n-api.service[123002]: exception: Flavor 1253098700 has no extra specs with key hw:cpu_thread_policy. Oct 04 18:28:12.501029 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'flavor_id': '1253098700', 'id': 'hw:cpu_thread_policy'} Oct 04 18:28:12.501029 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:28:12.501029 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:12.501029 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Oct 04 18:28:12.501029 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Oct 04 18:28:12.501029 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 04 18:28:12.501029 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:12.501029 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:12.501029 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:12.501029 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:12.501029 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:12.501029 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:12.501029 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:28:12.501029 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:28:12.501029 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:28:12.501029 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:28:12.501029 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Oct 04 18:28:12.501029 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 18:28:12.501029 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1253098700 has no extra specs with key hw:cpu_thread_policy. Oct 04 18:28:12.501029 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:12.501029 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:12.501029 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:12.502272 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:12.502272 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:12.502272 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:12.502272 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:28:12.502272 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:28:12.502272 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1253098700 has no extra specs with key hw:cpu_thread_policy. Oct 04 18:28:12.502272 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:12.504383 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d8d9fb59-7b63-4141-ad72-59631c09c70f tempest-FlavorsExtraSpecsNegativeTestJSON-242129891 tempest-FlavorsExtraSpecsNegativeTestJSON-242129891-project] Returning 404 to user: Flavor 1253098700 has no extra specs with key hw:cpu_thread_policy. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:28:12.506439 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d8d9fb59-7b63-4141-ad72-59631c09c70f tempest-FlavorsExtraSpecsNegativeTestJSON-242129891 tempest-FlavorsExtraSpecsNegativeTestJSON-242129891-project] 10.222.0.20 "GET /compute/v2.1/flavors/1253098700/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.422841 Oct 04 18:28:12.522272 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 70/150] 10.222.0.20 () {58 vars in 1266 bytes} [Tue Oct 4 18:28:12 2022] GET /compute/v2.1/flavors/1253098700/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 439 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:28:12.533693 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-aa335b4d-ad0a-41da-b864-7b45123fdd4a tempest-FlavorsExtraSpecsNegativeTestJSON-242129891 tempest-FlavorsExtraSpecsNegativeTestJSON-242129891-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:12.538008 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-aa335b4d-ad0a-41da-b864-7b45123fdd4a tempest-FlavorsExtraSpecsNegativeTestJSON-242129891 tempest-FlavorsExtraSpecsNegativeTestJSON-242129891-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '01c80554d0f543a28ce5b382cdfa56b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c857ebe4d2b14cd0abd6af3c30960969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:12.543900 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-aa335b4d-ad0a-41da-b864-7b45123fdd4a tempest-FlavorsExtraSpecsNegativeTestJSON-242129891 tempest-FlavorsExtraSpecsNegativeTestJSON-242129891-project] Request method failure captured: Oct 04 18:28:12.543900 n-d-850501-14 devstack@n-api.service[123001]: request: POST /compute/v2.1/flavors/1253098700/os-extra_specs HTTP/1.1 Oct 04 18:28:12.543900 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:28:12.543900 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:28:12.543900 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:28:12.543900 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 66 Oct 04 18:28:12.543900 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:28:12.543900 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:28:12.543900 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:28:12.543900 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:28:12.543900 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPHs5_zrexU6JlkcM3LZx792i6cBxPZrYJquOrrLbg8XWpYtQr4pFz2jvqLYXJxS6sOVhpxmoe0lzgAdQVNOExbAruWZG0bYB16wsA9P6SvmSW_H19cQmgCBLpeQzWvfD0mj9A3N3M7h_EczSmklpVexeM1at9YxvN8YugSbmsvoPCnE Oct 04 18:28:12.543900 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:28:12.543900 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:28:12.543900 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:28:12.543900 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:28:12.543900 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:28:12.543900 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:28:12.543900 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: c857ebe4d2b14cd0abd6af3c30960969 Oct 04 18:28:12.543900 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-242129891 Oct 04 18:28:12.543900 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:28:12.543900 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:28:12.545148 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c857ebe4d2b14cd0abd6af3c30960969"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c857ebe4d2b14cd0abd6af3c30960969", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c857ebe4d2b14cd0abd6af3c30960969"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c857ebe4d2b14cd0abd6af3c30960969"}]}] Oct 04 18:28:12.545148 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-242129891 Oct 04 18:28:12.545148 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: c857ebe4d2b14cd0abd6af3c30960969 Oct 04 18:28:12.545148 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-242129891 Oct 04 18:28:12.545148 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-242129891-project Oct 04 18:28:12.545148 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:28:12.545148 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:28:12.545148 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 01c80554d0f543a28ce5b382cdfa56b5 Oct 04 18:28:12.545148 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-242129891-project Oct 04 18:28:12.545148 n-d-850501-14 devstack@n-api.service[123001]: Oct 04 18:28:12.545148 n-d-850501-14 devstack@n-api.service[123001]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Oct 04 18:28:12.545148 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:28:12.545862 n-d-850501-14 devstack@n-api.service[123001]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 04 18:28:12.545862 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'flavor_id': '1253098700', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Oct 04 18:28:12.545862 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:28:12.545862 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:12.545862 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:12.545862 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:12.545862 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:28:12.545862 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:28:12.545862 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:28:12.545862 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:28:12.545862 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:28:12.545862 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:28:12.545862 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Oct 04 18:28:12.545862 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Oct 04 18:28:12.545862 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:28:12.545862 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:28:12.545862 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:28:12.545862 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:28:12.545862 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:28:12.546912 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:28:12.546912 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:28:12.546912 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:28:12.546912 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:28:12.546912 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:28:12.546912 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:28:12.546912 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:28:12.546912 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:28:12.546912 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:28:12.546912 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 04 18:28:12.546912 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:12.546912 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:12.546912 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:12.546912 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:12.546912 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:12.546912 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:12.546912 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:28:12.546912 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:28:12.546912 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 04 18:28:12.546912 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:12.547961 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-aa335b4d-ad0a-41da-b864-7b45123fdd4a tempest-FlavorsExtraSpecsNegativeTestJSON-242129891 tempest-FlavorsExtraSpecsNegativeTestJSON-242129891-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:28:12.547961 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-aa335b4d-ad0a-41da-b864-7b45123fdd4a tempest-FlavorsExtraSpecsNegativeTestJSON-242129891 tempest-FlavorsExtraSpecsNegativeTestJSON-242129891-project] 10.222.0.20 "POST /compute/v2.1/flavors/1253098700/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.013753 Oct 04 18:28:12.547961 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 81/151] 10.222.0.20 () {60 vars in 1224 bytes} [Tue Oct 4 18:28:12 2022] POST /compute/v2.1/flavors/1253098700/os-extra_specs => generated 124 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:28:12.555382 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4b1a2b9a-adf2-44f9-92c6-5d1dbbe7844f tempest-FlavorsExtraSpecsNegativeTestJSON-685207055 tempest-FlavorsExtraSpecsNegativeTestJSON-685207055-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:12.717647 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4b1a2b9a-adf2-44f9-92c6-5d1dbbe7844f tempest-FlavorsExtraSpecsNegativeTestJSON-685207055 tempest-FlavorsExtraSpecsNegativeTestJSON-685207055-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/1253098700/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.166294 Oct 04 18:28:12.723471 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 71/152] 10.222.0.20 () {60 vars in 1224 bytes} [Tue Oct 4 18:28:12 2022] POST /compute/v2.1/flavors/1253098700/os-extra_specs => generated 66 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:28:12.729481 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ee5ed5fb-4de8-494b-8e1f-6277f4f16c50 tempest-FlavorsExtraSpecsNegativeTestJSON-242129891 tempest-FlavorsExtraSpecsNegativeTestJSON-242129891-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:12.731096 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ee5ed5fb-4de8-494b-8e1f-6277f4f16c50 tempest-FlavorsExtraSpecsNegativeTestJSON-242129891 tempest-FlavorsExtraSpecsNegativeTestJSON-242129891-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '01c80554d0f543a28ce5b382cdfa56b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c857ebe4d2b14cd0abd6af3c30960969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:12.732730 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ee5ed5fb-4de8-494b-8e1f-6277f4f16c50 tempest-FlavorsExtraSpecsNegativeTestJSON-242129891 tempest-FlavorsExtraSpecsNegativeTestJSON-242129891-project] Request method failure captured: Oct 04 18:28:12.732730 n-d-850501-14 devstack@n-api.service[123001]: request: DELETE /compute/v2.1/flavors/1253098700/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 04 18:28:12.732730 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:28:12.732730 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:28:12.732730 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:28:12.732730 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:28:12.732730 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:28:12.732730 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:28:12.732730 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:28:12.732730 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:28:12.732730 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPHs5_zrexU6JlkcM3LZx792i6cBxPZrYJquOrrLbg8XWpYtQr4pFz2jvqLYXJxS6sOVhpxmoe0lzgAdQVNOExbAruWZG0bYB16wsA9P6SvmSW_H19cQmgCBLpeQzWvfD0mj9A3N3M7h_EczSmklpVexeM1at9YxvN8YugSbmsvoPCnE Oct 04 18:28:12.732730 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:28:12.732730 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:28:12.732730 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:28:12.732730 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:28:12.732730 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:28:12.732730 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:28:12.732730 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: c857ebe4d2b14cd0abd6af3c30960969 Oct 04 18:28:12.732730 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-242129891 Oct 04 18:28:12.732730 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:28:12.732730 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:28:12.734056 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c857ebe4d2b14cd0abd6af3c30960969"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c857ebe4d2b14cd0abd6af3c30960969", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c857ebe4d2b14cd0abd6af3c30960969"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c857ebe4d2b14cd0abd6af3c30960969"}]}] Oct 04 18:28:12.734056 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-242129891 Oct 04 18:28:12.734056 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: c857ebe4d2b14cd0abd6af3c30960969 Oct 04 18:28:12.734056 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-242129891 Oct 04 18:28:12.734056 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-242129891-project Oct 04 18:28:12.734056 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:28:12.734056 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:28:12.734056 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 01c80554d0f543a28ce5b382cdfa56b5 Oct 04 18:28:12.734056 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-242129891-project Oct 04 18:28:12.734056 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:28:12.734056 n-d-850501-14 devstack@n-api.service[123001]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 04 18:28:12.734648 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'flavor_id': '1253098700', 'id': 'hw:numa_nodes'} Oct 04 18:28:12.734648 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:28:12.734648 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:12.734648 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:12.734648 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:12.734648 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:28:12.734648 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:28:12.734648 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:28:12.734648 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:28:12.734648 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Oct 04 18:28:12.734648 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Oct 04 18:28:12.734648 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:28:12.734648 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:28:12.734648 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:28:12.734648 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:28:12.734648 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:28:12.734648 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:28:12.734648 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:28:12.734648 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:28:12.734648 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:28:12.735686 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:28:12.735686 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:28:12.735686 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:28:12.735686 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:28:12.735686 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:28:12.735686 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 04 18:28:12.735686 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:12.735686 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:12.735686 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:12.735686 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:12.735686 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:12.735686 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:12.735686 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:28:12.735686 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:28:12.735686 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 04 18:28:12.735686 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:12.735686 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ee5ed5fb-4de8-494b-8e1f-6277f4f16c50 tempest-FlavorsExtraSpecsNegativeTestJSON-242129891 tempest-FlavorsExtraSpecsNegativeTestJSON-242129891-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:28:12.736616 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ee5ed5fb-4de8-494b-8e1f-6277f4f16c50 tempest-FlavorsExtraSpecsNegativeTestJSON-242129891 tempest-FlavorsExtraSpecsNegativeTestJSON-242129891-project] 10.222.0.20 "DELETE /compute/v2.1/flavors/1253098700/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.009968 Oct 04 18:28:12.748023 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0dc43f5b-134d-4990-8a36-c5849d0fc723 tempest-FlavorsExtraSpecsNegativeTestJSON-685207055 tempest-FlavorsExtraSpecsNegativeTestJSON-685207055-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:12.751813 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 82/153] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Oct 4 18:28:12 2022] DELETE /compute/v2.1/flavors/1253098700/os-extra_specs/hw:numa_nodes => generated 124 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:28:12.771815 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0dc43f5b-134d-4990-8a36-c5849d0fc723 tempest-FlavorsExtraSpecsNegativeTestJSON-685207055 tempest-FlavorsExtraSpecsNegativeTestJSON-685207055-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/1253098700/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.027710 Oct 04 18:28:12.776102 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 72/154] 10.222.0.20 () {60 vars in 1224 bytes} [Tue Oct 4 18:28:12 2022] POST /compute/v2.1/flavors/1253098700/os-extra_specs => generated 66 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:28:12.782913 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-261301d6-435a-442f-bad0-e043862dfa9d tempest-FlavorsExtraSpecsNegativeTestJSON-242129891 tempest-FlavorsExtraSpecsNegativeTestJSON-242129891-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:12.786278 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-261301d6-435a-442f-bad0-e043862dfa9d tempest-FlavorsExtraSpecsNegativeTestJSON-242129891 tempest-FlavorsExtraSpecsNegativeTestJSON-242129891-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '01c80554d0f543a28ce5b382cdfa56b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c857ebe4d2b14cd0abd6af3c30960969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:12.797146 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-261301d6-435a-442f-bad0-e043862dfa9d tempest-FlavorsExtraSpecsNegativeTestJSON-242129891 tempest-FlavorsExtraSpecsNegativeTestJSON-242129891-project] Request method failure captured: Oct 04 18:28:12.797146 n-d-850501-14 devstack@n-api.service[123001]: request: PUT /compute/v2.1/flavors/1253098700/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 04 18:28:12.797146 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:28:12.797146 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:28:12.797146 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:28:12.797146 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 22 Oct 04 18:28:12.797146 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:28:12.797146 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:28:12.797146 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:28:12.797146 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:28:12.797146 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPHs5_zrexU6JlkcM3LZx792i6cBxPZrYJquOrrLbg8XWpYtQr4pFz2jvqLYXJxS6sOVhpxmoe0lzgAdQVNOExbAruWZG0bYB16wsA9P6SvmSW_H19cQmgCBLpeQzWvfD0mj9A3N3M7h_EczSmklpVexeM1at9YxvN8YugSbmsvoPCnE Oct 04 18:28:12.797146 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:28:12.797146 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:28:12.797146 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:28:12.797146 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:28:12.797146 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:28:12.797146 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:28:12.797146 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: c857ebe4d2b14cd0abd6af3c30960969 Oct 04 18:28:12.797146 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-242129891 Oct 04 18:28:12.797146 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:28:12.797146 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:28:12.798694 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c857ebe4d2b14cd0abd6af3c30960969"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c857ebe4d2b14cd0abd6af3c30960969", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c857ebe4d2b14cd0abd6af3c30960969"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c857ebe4d2b14cd0abd6af3c30960969"}]}] Oct 04 18:28:12.798694 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-242129891 Oct 04 18:28:12.798694 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: c857ebe4d2b14cd0abd6af3c30960969 Oct 04 18:28:12.798694 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-242129891 Oct 04 18:28:12.798694 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-242129891-project Oct 04 18:28:12.798694 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:28:12.798694 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:28:12.798694 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 01c80554d0f543a28ce5b382cdfa56b5 Oct 04 18:28:12.798694 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-242129891-project Oct 04 18:28:12.798694 n-d-850501-14 devstack@n-api.service[123001]: Oct 04 18:28:12.798694 n-d-850501-14 devstack@n-api.service[123001]: {"hw:numa_nodes": "1"} Oct 04 18:28:12.798694 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:28:12.798694 n-d-850501-14 devstack@n-api.service[123001]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 04 18:28:12.799397 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'flavor_id': '1253098700', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Oct 04 18:28:12.799397 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:28:12.799397 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:12.799397 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:12.799397 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:12.799397 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:28:12.799397 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:28:12.799397 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:28:12.799397 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:28:12.799397 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:28:12.799397 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:28:12.799397 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Oct 04 18:28:12.799397 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Oct 04 18:28:12.799397 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:28:12.799397 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:28:12.799397 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:28:12.799397 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:28:12.799397 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:28:12.799397 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:28:12.800459 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:28:12.800459 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:28:12.800459 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:28:12.800459 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:28:12.800459 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:28:12.800459 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:28:12.800459 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:28:12.800459 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:28:12.800459 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 04 18:28:12.800459 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:12.800459 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:12.800459 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:12.800459 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:12.800459 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:12.800459 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:12.800459 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:28:12.800459 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:28:12.800459 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 04 18:28:12.800459 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:12.801482 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-261301d6-435a-442f-bad0-e043862dfa9d tempest-FlavorsExtraSpecsNegativeTestJSON-242129891 tempest-FlavorsExtraSpecsNegativeTestJSON-242129891-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:28:12.801482 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-261301d6-435a-442f-bad0-e043862dfa9d tempest-FlavorsExtraSpecsNegativeTestJSON-242129891 tempest-FlavorsExtraSpecsNegativeTestJSON-242129891-project] 10.222.0.20 "PUT /compute/v2.1/flavors/1253098700/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.020242 Oct 04 18:28:12.801482 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 83/155] 10.222.0.20 () {60 vars in 1265 bytes} [Tue Oct 4 18:28:12 2022] PUT /compute/v2.1/flavors/1253098700/os-extra_specs/hw:numa_nodes => generated 124 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:28:12.810806 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a3dd9a5a-a9a0-4fb8-af0a-467b60b5bc2f tempest-FlavorsExtraSpecsNegativeTestJSON-685207055 tempest-FlavorsExtraSpecsNegativeTestJSON-685207055-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:12.819538 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-a3dd9a5a-a9a0-4fb8-af0a-467b60b5bc2f tempest-FlavorsExtraSpecsNegativeTestJSON-685207055 tempest-FlavorsExtraSpecsNegativeTestJSON-685207055-project-admin] HTTP exception thrown: Flavor 1253098700 has no extra specs with key hw:cpu_thread_policy. Oct 04 18:28:12.821156 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a3dd9a5a-a9a0-4fb8-af0a-467b60b5bc2f tempest-FlavorsExtraSpecsNegativeTestJSON-685207055 tempest-FlavorsExtraSpecsNegativeTestJSON-685207055-project-admin] Request method failure captured: Oct 04 18:28:12.821156 n-d-850501-14 devstack@n-api.service[123002]: request: DELETE /compute/v2.1/flavors/1253098700/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 04 18:28:12.821156 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:28:12.821156 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:28:12.821156 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:28:12.821156 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:28:12.821156 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:28:12.821156 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:28:12.821156 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:28:12.821156 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:28:12.821156 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPHs7cIOLxd9FspJSkbRbTVBX5ocJGSG9mygrReRlzH-CO88Ddkj8-lj-KXgkOVnsP4iqUR-VZ_lMpvGT3HTCRZHGJdIN6ELQrdszfrIBZxCjvoppVHEU0kHOOVfV_cJ3K_jgIB_I-U-aB7FY_14u5d9IldCbrg5bh538GbZZ-SkXf0U Oct 04 18:28:12.821156 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:28:12.821156 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:28:12.821156 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:28:12.821156 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:28:12.821156 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:28:12.821156 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:28:12.821156 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 892b4c39296a460e98490d971e8659e7 Oct 04 18:28:12.821156 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-685207055 Oct 04 18:28:12.821156 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member,admin Oct 04 18:28:12.821156 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member,admin Oct 04 18:28:12.822565 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/892b4c39296a460e98490d971e8659e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_892b4c39296a460e98490d971e8659e7", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/892b4c39296a460e98490d971e8659e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/892b4c39296a460e98490d971e8659e7"}]}] Oct 04 18:28:12.822565 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-685207055 Oct 04 18:28:12.822565 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 892b4c39296a460e98490d971e8659e7 Oct 04 18:28:12.822565 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-685207055 Oct 04 18:28:12.822565 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-685207055-project-admin Oct 04 18:28:12.822565 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:28:12.822565 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:28:12.822565 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 141eab954d84430bb845171040f4f16d Oct 04 18:28:12.822565 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-685207055-project-admin Oct 04 18:28:12.822565 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:28:12.822565 n-d-850501-14 devstack@n-api.service[123002]: exception: Flavor 1253098700 has no extra specs with key hw:cpu_thread_policy. Oct 04 18:28:12.823188 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'flavor_id': '1253098700', 'id': 'hw:cpu_thread_policy'} Oct 04 18:28:12.823188 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:28:12.823188 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:12.823188 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Oct 04 18:28:12.823188 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Oct 04 18:28:12.823188 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 04 18:28:12.823188 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:12.823188 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:12.823188 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:12.823188 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:12.823188 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:12.823188 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:12.823188 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:28:12.823188 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:28:12.823188 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:28:12.823188 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:28:12.823188 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Oct 04 18:28:12.823188 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 18:28:12.823188 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1253098700 has no extra specs with key hw:cpu_thread_policy. Oct 04 18:28:12.823188 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:12.823188 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:12.823188 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:12.824369 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:12.824369 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:12.824369 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:12.824369 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:28:12.824369 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:28:12.824369 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1253098700 has no extra specs with key hw:cpu_thread_policy. Oct 04 18:28:12.824369 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:12.824369 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a3dd9a5a-a9a0-4fb8-af0a-467b60b5bc2f tempest-FlavorsExtraSpecsNegativeTestJSON-685207055 tempest-FlavorsExtraSpecsNegativeTestJSON-685207055-project-admin] Returning 404 to user: Flavor 1253098700 has no extra specs with key hw:cpu_thread_policy. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:28:12.824369 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a3dd9a5a-a9a0-4fb8-af0a-467b60b5bc2f tempest-FlavorsExtraSpecsNegativeTestJSON-685207055 tempest-FlavorsExtraSpecsNegativeTestJSON-685207055-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1253098700/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.017328 Oct 04 18:28:12.824854 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 73/156] 10.222.0.20 () {58 vars in 1269 bytes} [Tue Oct 4 18:28:12 2022] DELETE /compute/v2.1/flavors/1253098700/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:28:12.833110 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-afc2ad25-7586-444e-b555-7e5d8b520272 tempest-FlavorsExtraSpecsNegativeTestJSON-685207055 tempest-FlavorsExtraSpecsNegativeTestJSON-685207055-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:12.837982 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-afc2ad25-7586-444e-b555-7e5d8b520272 tempest-FlavorsExtraSpecsNegativeTestJSON-685207055 tempest-FlavorsExtraSpecsNegativeTestJSON-685207055-project-admin] HTTP exception thrown: Request body and URI mismatch Oct 04 18:28:12.839304 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-afc2ad25-7586-444e-b555-7e5d8b520272 tempest-FlavorsExtraSpecsNegativeTestJSON-685207055 tempest-FlavorsExtraSpecsNegativeTestJSON-685207055-project-admin] Request method failure captured: Oct 04 18:28:12.839304 n-d-850501-14 devstack@n-api.service[123001]: request: PUT /compute/v2.1/flavors/1253098700/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 04 18:28:12.839304 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:28:12.839304 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:28:12.839304 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:28:12.839304 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 27 Oct 04 18:28:12.839304 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:28:12.839304 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:28:12.839304 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:28:12.839304 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:28:12.839304 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPHs7cIOLxd9FspJSkbRbTVBX5ocJGSG9mygrReRlzH-CO88Ddkj8-lj-KXgkOVnsP4iqUR-VZ_lMpvGT3HTCRZHGJdIN6ELQrdszfrIBZxCjvoppVHEU0kHOOVfV_cJ3K_jgIB_I-U-aB7FY_14u5d9IldCbrg5bh538GbZZ-SkXf0U Oct 04 18:28:12.839304 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:28:12.839304 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:28:12.839304 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:28:12.839304 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:28:12.839304 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:28:12.839304 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:28:12.839304 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 892b4c39296a460e98490d971e8659e7 Oct 04 18:28:12.839304 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-685207055 Oct 04 18:28:12.839304 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member,admin Oct 04 18:28:12.839304 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member,admin Oct 04 18:28:12.840522 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/892b4c39296a460e98490d971e8659e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_892b4c39296a460e98490d971e8659e7", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/892b4c39296a460e98490d971e8659e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/892b4c39296a460e98490d971e8659e7"}]}] Oct 04 18:28:12.840522 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-685207055 Oct 04 18:28:12.840522 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 892b4c39296a460e98490d971e8659e7 Oct 04 18:28:12.840522 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-685207055 Oct 04 18:28:12.840522 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-685207055-project-admin Oct 04 18:28:12.840522 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:28:12.840522 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:28:12.840522 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 141eab954d84430bb845171040f4f16d Oct 04 18:28:12.840522 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-685207055-project-admin Oct 04 18:28:12.840522 n-d-850501-14 devstack@n-api.service[123001]: Oct 04 18:28:12.840522 n-d-850501-14 devstack@n-api.service[123001]: {"hw:cpu_policy": "shared"} Oct 04 18:28:12.840522 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:28:12.840522 n-d-850501-14 devstack@n-api.service[123001]: exception: Request body and URI mismatch Oct 04 18:28:12.841212 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'flavor_id': '1253098700', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Oct 04 18:28:12.841212 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:28:12.841212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:12.841212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:12.841212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:12.841212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:28:12.841212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:28:12.841212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:28:12.841212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:28:12.841212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:28:12.841212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:28:12.841212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Oct 04 18:28:12.841212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Oct 04 18:28:12.841212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Oct 04 18:28:12.841212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:12.841212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:12.841212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:12.841212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:12.841212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:12.841212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:12.842276 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:28:12.842276 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:28:12.842276 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Oct 04 18:28:12.842276 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:12.842276 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-afc2ad25-7586-444e-b555-7e5d8b520272 tempest-FlavorsExtraSpecsNegativeTestJSON-685207055 tempest-FlavorsExtraSpecsNegativeTestJSON-685207055-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:28:12.842276 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-afc2ad25-7586-444e-b555-7e5d8b520272 tempest-FlavorsExtraSpecsNegativeTestJSON-685207055 tempest-FlavorsExtraSpecsNegativeTestJSON-685207055-project-admin] 10.222.0.20 "PUT /compute/v2.1/flavors/1253098700/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.011811 Oct 04 18:28:12.842276 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 84/157] 10.222.0.20 () {60 vars in 1265 bytes} [Tue Oct 4 18:28:12 2022] PUT /compute/v2.1/flavors/1253098700/os-extra_specs/hw:numa_nodes => generated 73 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 04 18:28:12.850872 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-161d66c4-c82e-4d6e-8f76-ed4afa846e9e tempest-FlavorsExtraSpecsNegativeTestJSON-685207055 tempest-FlavorsExtraSpecsNegativeTestJSON-685207055-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:12.883611 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-161d66c4-c82e-4d6e-8f76-ed4afa846e9e tempest-FlavorsExtraSpecsNegativeTestJSON-685207055 tempest-FlavorsExtraSpecsNegativeTestJSON-685207055-project-admin] Request method failure captured: Oct 04 18:28:12.883611 n-d-850501-14 devstack@n-api.service[123002]: request: PUT /compute/v2.1/flavors/1253098700/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 04 18:28:12.883611 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:28:12.883611 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:28:12.883611 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:28:12.883611 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 49 Oct 04 18:28:12.883611 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:28:12.883611 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:28:12.883611 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:28:12.883611 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:28:12.883611 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPHs7cIOLxd9FspJSkbRbTVBX5ocJGSG9mygrReRlzH-CO88Ddkj8-lj-KXgkOVnsP4iqUR-VZ_lMpvGT3HTCRZHGJdIN6ELQrdszfrIBZxCjvoppVHEU0kHOOVfV_cJ3K_jgIB_I-U-aB7FY_14u5d9IldCbrg5bh538GbZZ-SkXf0U Oct 04 18:28:12.883611 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:28:12.883611 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:28:12.883611 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:28:12.883611 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:28:12.883611 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:28:12.883611 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:28:12.883611 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 892b4c39296a460e98490d971e8659e7 Oct 04 18:28:12.883611 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-685207055 Oct 04 18:28:12.883611 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member,admin Oct 04 18:28:12.883611 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member,admin Oct 04 18:28:12.885735 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/892b4c39296a460e98490d971e8659e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_892b4c39296a460e98490d971e8659e7", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/892b4c39296a460e98490d971e8659e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/892b4c39296a460e98490d971e8659e7"}]}] Oct 04 18:28:12.885735 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-685207055 Oct 04 18:28:12.885735 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 892b4c39296a460e98490d971e8659e7 Oct 04 18:28:12.885735 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-685207055 Oct 04 18:28:12.885735 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-685207055-project-admin Oct 04 18:28:12.885735 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:28:12.885735 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:28:12.885735 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 141eab954d84430bb845171040f4f16d Oct 04 18:28:12.885735 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-685207055-project-admin Oct 04 18:28:12.885735 n-d-850501-14 devstack@n-api.service[123002]: Oct 04 18:28:12.885735 n-d-850501-14 devstack@n-api.service[123002]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Oct 04 18:28:12.885735 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:28:12.886472 n-d-850501-14 devstack@n-api.service[123002]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 04 18:28:12.886472 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'flavor_id': '1253098700', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Oct 04 18:28:12.886472 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:28:12.886472 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:12.886472 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:28:12.886472 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:28:12.886472 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:28:12.886472 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:28:12.886472 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 04 18:28:12.886472 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:12.886472 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Oct 04 18:28:12.886472 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 04 18:28:12.886472 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Oct 04 18:28:12.886472 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Oct 04 18:28:12.886472 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 04 18:28:12.886472 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi 'type': ['string', Oct 04 18:28:12.886472 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi 'number']}}, Oct 04 18:28:12.886472 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 04 18:28:12.886472 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:12.886472 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi On instance: Oct 04 18:28:12.886472 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Oct 04 18:28:12.886472 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:12.887916 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:12.887916 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:12.887916 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:12.887916 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:12.887916 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:12.887916 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:28:12.887916 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:28:12.887916 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:28:12.887916 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:28:12.887916 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:28:12.887916 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:28:12.887916 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:28:12.887916 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:28:12.887916 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:28:12.887916 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:28:12.887916 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 04 18:28:12.887916 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:12.887916 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:12.887916 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:12.887916 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:12.889073 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:12.889073 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:12.889073 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:28:12.889073 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:28:12.889073 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 04 18:28:12.889073 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:12.889073 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-161d66c4-c82e-4d6e-8f76-ed4afa846e9e tempest-FlavorsExtraSpecsNegativeTestJSON-685207055 tempest-FlavorsExtraSpecsNegativeTestJSON-685207055-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:28:12.889073 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-161d66c4-c82e-4d6e-8f76-ed4afa846e9e tempest-FlavorsExtraSpecsNegativeTestJSON-685207055 tempest-FlavorsExtraSpecsNegativeTestJSON-685207055-project-admin] 10.222.0.20 "PUT /compute/v2.1/flavors/1253098700/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.038421 Oct 04 18:28:12.889073 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 74/158] 10.222.0.20 () {60 vars in 1265 bytes} [Tue Oct 4 18:28:12 2022] PUT /compute/v2.1/flavors/1253098700/os-extra_specs/hw:numa_nodes => generated 117 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:28:12.904255 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9dcd7221-5697-4623-9959-e2e55bda3903 tempest-FlavorsExtraSpecsNegativeTestJSON-685207055 tempest-FlavorsExtraSpecsNegativeTestJSON-685207055-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:13.023527 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9dcd7221-5697-4623-9959-e2e55bda3903 tempest-FlavorsExtraSpecsNegativeTestJSON-685207055 tempest-FlavorsExtraSpecsNegativeTestJSON-685207055-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1253098700" status: 202 len: 0 microversion: 2.1 time: 0.119238 Oct 04 18:28:13.023527 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 85/159] 10.222.0.20 () {58 vars in 1161 bytes} [Tue Oct 4 18:28:12 2022] DELETE /compute/v2.1/flavors/1253098700 => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:28:13.029361 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-91d33963-9dd5-4e55-a8ff-385e709b1bb1 tempest-FlavorsExtraSpecsNegativeTestJSON-685207055 tempest-FlavorsExtraSpecsNegativeTestJSON-685207055-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:13.061729 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-91d33963-9dd5-4e55-a8ff-385e709b1bb1 tempest-FlavorsExtraSpecsNegativeTestJSON-685207055 tempest-FlavorsExtraSpecsNegativeTestJSON-685207055-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.035687 Oct 04 18:28:13.062330 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 75/160] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Oct 4 18:28:13 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:13.084505 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-07e6f10c-a5de-4e68-b131-d45f3ce7cedc tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:13.085444 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-07e6f10c-a5de-4e68-b131-d45f3ce7cedc tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] [instance: 31110a13-e556-40c8-8d78-5243794ff095] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:13.105769 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-07e6f10c-a5de-4e68-b131-d45f3ce7cedc tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:13.106577 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-07e6f10c-a5de-4e68-b131-d45f3ce7cedc tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:13.107085 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-07e6f10c-a5de-4e68-b131-d45f3ce7cedc tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:13.108574 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-07e6f10c-a5de-4e68-b131-d45f3ce7cedc tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:13.109124 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-07e6f10c-a5de-4e68-b131-d45f3ce7cedc tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:13.109635 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-07e6f10c-a5de-4e68-b131-d45f3ce7cedc tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:13.137884 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-860ddc0d-f69f-4c0a-8b93-26c907cc2439 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:13.138496 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-860ddc0d-f69f-4c0a-8b93-26c907cc2439 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] [instance: 6da2d407-863f-4f6a-9d71-d81e96f160fb] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:13.140863 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=100 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:28:13.148087 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-860ddc0d-f69f-4c0a-8b93-26c907cc2439 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:13.150528 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-860ddc0d-f69f-4c0a-8b93-26c907cc2439 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:13.151953 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-860ddc0d-f69f-4c0a-8b93-26c907cc2439 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:13.153337 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-860ddc0d-f69f-4c0a-8b93-26c907cc2439 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:13.153816 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-860ddc0d-f69f-4c0a-8b93-26c907cc2439 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:13.154251 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-860ddc0d-f69f-4c0a-8b93-26c907cc2439 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:13.348163 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-07e6f10c-a5de-4e68-b131-d45f3ce7cedc tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86a8d114fbc4eb584934904d8f2ef56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126dad7acaf44f909302eac21c4aafcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:13.357299 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-07e6f10c-a5de-4e68-b131-d45f3ce7cedc tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] 10.222.0.20 "GET /compute/v2.1/servers/31110a13-e556-40c8-8d78-5243794ff095" status: 200 len: 1338 microversion: 2.1 time: 0.279395 Oct 04 18:28:13.375876 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 86/161] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:13 2022] GET /compute/v2.1/servers/31110a13-e556-40c8-8d78-5243794ff095 => generated 1338 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:13.556643 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-860ddc0d-f69f-4c0a-8b93-26c907cc2439 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f87d9eaf49545bb8effb170768bb8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e99a0400fe947bb8907857cc4de2899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:13.565003 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-860ddc0d-f69f-4c0a-8b93-26c907cc2439 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] 10.222.0.20 "GET /compute/v2.1/servers/6da2d407-863f-4f6a-9d71-d81e96f160fb" status: 200 len: 1341 microversion: 2.1 time: 0.431766 Oct 04 18:28:13.565577 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 76/162] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:13 2022] GET /compute/v2.1/servers/6da2d407-863f-4f6a-9d71-d81e96f160fb => generated 1341 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:28:14.379904 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-61bf4e99-7337-41e6-b016-0c549836b55c tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:14.381110 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-61bf4e99-7337-41e6-b016-0c549836b55c tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] [instance: 31110a13-e556-40c8-8d78-5243794ff095] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:14.389134 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-61bf4e99-7337-41e6-b016-0c549836b55c tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:14.389850 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-61bf4e99-7337-41e6-b016-0c549836b55c tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:14.390367 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-61bf4e99-7337-41e6-b016-0c549836b55c tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:14.391283 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-61bf4e99-7337-41e6-b016-0c549836b55c tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:14.392024 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-61bf4e99-7337-41e6-b016-0c549836b55c tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:14.392764 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-61bf4e99-7337-41e6-b016-0c549836b55c tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:14.683296 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-110b4590-0c4c-4175-a103-1a0501a9a799 tempest-KeyPairsV210TestJSON-68585979 tempest-KeyPairsV210TestJSON-68585979-project-admin] Action: 'create', calling method: .version_select at 0x7fe259a7aee0>, body: {"keypair": {"name": "tempest-keypair-321473353", "type": "ssh", "user_id": "ef57b9acb84342248707a5662c704e09", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ7XrL7sFqC504LRFYLGDUBjecMkZln6WeV+nBDDMFng3MMV4M/hCwcH+xcMaRu6/rdlltfTp/1LRFrsern5OHKEfPgZbXmc9O3IuWq9YWS69/drFkBoDdcMbfMTrFeIFg=="}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:14.714941 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=3,nova_api:INSERT=3,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:28:14.730264 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-110b4590-0c4c-4175-a103-1a0501a9a799 tempest-KeyPairsV210TestJSON-68585979 tempest-KeyPairsV210TestJSON-68585979-project-admin] Getting quotas for project bb2c36c9fe5b4d44820314ff81fddba1. Resources: {'key_pairs'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:28:14.737054 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-110b4590-0c4c-4175-a103-1a0501a9a799 tempest-KeyPairsV210TestJSON-68585979 tempest-KeyPairsV210TestJSON-68585979-project-admin] Getting quotas for user 41042b547b8b43138e7905ea348601b6 and project bb2c36c9fe5b4d44820314ff81fddba1. Resources: {'key_pairs'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:28:14.816826 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-61bf4e99-7337-41e6-b016-0c549836b55c tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86a8d114fbc4eb584934904d8f2ef56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126dad7acaf44f909302eac21c4aafcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:14.825582 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-61bf4e99-7337-41e6-b016-0c549836b55c tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] 10.222.0.20 "GET /compute/v2.1/servers/31110a13-e556-40c8-8d78-5243794ff095" status: 200 len: 1338 microversion: 2.1 time: 0.449304 Oct 04 18:28:14.826813 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 87/163] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:14 2022] GET /compute/v2.1/servers/31110a13-e556-40c8-8d78-5243794ff095 => generated 1338 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:14.832464 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-77965f44-9d1b-4fbf-8835-3a563c93d57d tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:14.833321 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-77965f44-9d1b-4fbf-8835-3a563c93d57d tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] [instance: 6da2d407-863f-4f6a-9d71-d81e96f160fb] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:14.845735 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-77965f44-9d1b-4fbf-8835-3a563c93d57d tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:14.846234 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-77965f44-9d1b-4fbf-8835-3a563c93d57d tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:14.848669 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-77965f44-9d1b-4fbf-8835-3a563c93d57d tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:14.852555 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-77965f44-9d1b-4fbf-8835-3a563c93d57d tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:14.853634 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-77965f44-9d1b-4fbf-8835-3a563c93d57d tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:14.854277 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-110b4590-0c4c-4175-a103-1a0501a9a799 tempest-KeyPairsV210TestJSON-68585979 tempest-KeyPairsV210TestJSON-68585979-project-admin] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.429754 Oct 04 18:28:14.855153 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-77965f44-9d1b-4fbf-8835-3a563c93d57d tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:14.855351 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 77/164] 10.222.0.20 () {62 vars in 1200 bytes} [Tue Oct 4 18:28:14 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 435 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 04 18:28:14.879999 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ee56a05d-c598-4190-a0c8-76fa43fdf91e tempest-KeyPairsV210TestJSON-68585979 tempest-KeyPairsV210TestJSON-68585979-project-admin] Action: 'create', calling method: .version_select at 0x7fe259b2edc0>, body: {"keypair": {"name": "tempest-keypair-144840009", "type": "ssh", "user_id": "ef57b9acb84342248707a5662c704e09", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEvTsL42v4FffPv9QhAGN9ioJDhj127YrajlQROYQELpLzxLKeX+34sG0YRco5D666BaTzwpMsoNY3ZMH3FD0OSSBJkh9x1xjlegnaCfAF5bFjF01CDCL/tes3sG8jytQw=="}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:14.910149 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-ee56a05d-c598-4190-a0c8-76fa43fdf91e tempest-KeyPairsV210TestJSON-68585979 tempest-KeyPairsV210TestJSON-68585979-project-admin] Getting quotas for project bb2c36c9fe5b4d44820314ff81fddba1. Resources: {'key_pairs'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:28:14.919338 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-ee56a05d-c598-4190-a0c8-76fa43fdf91e tempest-KeyPairsV210TestJSON-68585979 tempest-KeyPairsV210TestJSON-68585979-project-admin] Getting quotas for user 41042b547b8b43138e7905ea348601b6 and project bb2c36c9fe5b4d44820314ff81fddba1. Resources: {'key_pairs'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:28:15.010937 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ee56a05d-c598-4190-a0c8-76fa43fdf91e tempest-KeyPairsV210TestJSON-68585979 tempest-KeyPairsV210TestJSON-68585979-project-admin] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.136227 Oct 04 18:28:15.011587 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 78/165] 10.222.0.20 () {62 vars in 1200 bytes} [Tue Oct 4 18:28:14 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 138 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 04 18:28:15.022138 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3352a5a2-10fe-41d5-ab18-80f2f85ec023 tempest-KeyPairsV210TestJSON-68585979 tempest-KeyPairsV210TestJSON-68585979-project-admin] Calling method '.version_select at 0x7fe259a41310>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:15.036600 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3352a5a2-10fe-41d5-ab18-80f2f85ec023 tempest-KeyPairsV210TestJSON-68585979 tempest-KeyPairsV210TestJSON-68585979-project-admin] 10.222.0.20 "GET /compute/v2.1/os-keypairs/tempest-keypair-321473353?user_id=ef57b9acb84342248707a5662c704e09" status: 200 len: 511 microversion: 2.10 time: 0.014000 Oct 04 18:28:15.036600 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 79/166] 10.222.0.20 () {60 vars in 1337 bytes} [Tue Oct 4 18:28:15 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-321473353?user_id=ef57b9acb84342248707a5662c704e09 => generated 511 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:28:15.125044 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-77965f44-9d1b-4fbf-8835-3a563c93d57d tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f87d9eaf49545bb8effb170768bb8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e99a0400fe947bb8907857cc4de2899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:15.134210 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-77965f44-9d1b-4fbf-8835-3a563c93d57d tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] 10.222.0.20 "GET /compute/v2.1/servers/6da2d407-863f-4f6a-9d71-d81e96f160fb" status: 200 len: 1341 microversion: 2.1 time: 0.306086 Oct 04 18:28:15.135105 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 88/167] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:14 2022] GET /compute/v2.1/servers/6da2d407-863f-4f6a-9d71-d81e96f160fb => generated 1341 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:15.146818 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-853c298d-9e61-4c85-af03-cd9c9d95a6c1 tempest-KeyPairsV210TestJSON-68585979 tempest-KeyPairsV210TestJSON-68585979-project-admin] Action: 'create', calling method: .version_select at 0x7fe259deb5e0>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-840540818", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBALaJz1TXYiTQSSFxQlZcc6MnXZp9JkGPPP0NYdK/zNdpG/eVYP/uTWgldGtA4shkXXdRJd4YyovGdUiAbK/12+xk4O4jPa19V15d0QDVWqkqHcLMVK8rHpFHk4loM3yVw=="}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:15.155135 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:DELETE=6,nova_api:SELECT=91,nova_api:INSERT=3 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:28:15.164100 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-853c298d-9e61-4c85-af03-cd9c9d95a6c1 tempest-KeyPairsV210TestJSON-68585979 tempest-KeyPairsV210TestJSON-68585979-project-admin] Getting quotas for project bb2c36c9fe5b4d44820314ff81fddba1. Resources: {'key_pairs'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:28:15.168463 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-853c298d-9e61-4c85-af03-cd9c9d95a6c1 tempest-KeyPairsV210TestJSON-68585979 tempest-KeyPairsV210TestJSON-68585979-project-admin] Getting quotas for user 41042b547b8b43138e7905ea348601b6 and project bb2c36c9fe5b4d44820314ff81fddba1. Resources: {'key_pairs'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:28:15.252958 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-853c298d-9e61-4c85-af03-cd9c9d95a6c1 tempest-KeyPairsV210TestJSON-68585979 tempest-KeyPairsV210TestJSON-68585979-project-admin] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.10 time: 0.116604 Oct 04 18:28:15.253563 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 89/168] 10.222.0.20 () {62 vars in 1200 bytes} [Tue Oct 4 18:28:15 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 118 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 18:28:15.264362 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-16699828-0d1d-4e93-a2bd-097dfe16e843 tempest-KeyPairsV210TestJSON-68585979 tempest-KeyPairsV210TestJSON-68585979-project-admin] Calling method '.version_select at 0x7fe259ba4940>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:15.268188 n-d-850501-14 devstack@n-api.service[123001]: WARNING oslo_db.sqlalchemy.utils [None req-16699828-0d1d-4e93-a2bd-097dfe16e843 tempest-KeyPairsV210TestJSON-68585979 tempest-KeyPairsV210TestJSON-68585979-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Oct 04 18:28:15.281333 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-16699828-0d1d-4e93-a2bd-097dfe16e843 tempest-KeyPairsV210TestJSON-68585979 tempest-KeyPairsV210TestJSON-68585979-project-admin] 10.222.0.20 "GET /compute/v2.1/os-keypairs?user_id=ef57b9acb84342248707a5662c704e09" status: 200 len: 724 microversion: 2.10 time: 0.020612 Oct 04 18:28:15.288283 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 90/169] 10.222.0.20 () {60 vars in 1259 bytes} [Tue Oct 4 18:28:15 2022] GET /compute/v2.1/os-keypairs?user_id=ef57b9acb84342248707a5662c704e09 => generated 724 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 18:28:15.297703 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a5ace86c-ef3e-41c1-9d56-f0b6d3b610c6 tempest-KeyPairsV210TestJSON-68585979 tempest-KeyPairsV210TestJSON-68585979-project-admin] Calling method '.version_select at 0x7fe259bfdee0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:15.364714 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-21888820-6cea-43d5-87a8-47fdc63ee2e8 tempest-InstanceUsageAuditLogNegativeTestJSON-1886116299 tempest-InstanceUsageAuditLogNegativeTestJSON-1886116299-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:15.367412 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-21888820-6cea-43d5-87a8-47fdc63ee2e8 tempest-InstanceUsageAuditLogNegativeTestJSON-1886116299 tempest-InstanceUsageAuditLogNegativeTestJSON-1886116299-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Oct 04 18:28:15.377212 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-21888820-6cea-43d5-87a8-47fdc63ee2e8 tempest-InstanceUsageAuditLogNegativeTestJSON-1886116299 tempest-InstanceUsageAuditLogNegativeTestJSON-1886116299-project-admin] Request method failure captured: Oct 04 18:28:15.377212 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Oct 04 18:28:15.377212 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:28:15.377212 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:28:15.377212 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:28:15.377212 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:28:15.377212 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:28:15.377212 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:28:15.377212 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:28:15.377212 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:28:15.377212 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPHs-cQULQo2FDtzduFhFz9EG2vGUaeLrjiKyRRvJ-wtbvyJtNM8pNm_OqtaOY4vnleLguXCY6QorQbDHkRejazBkXRMBwKAaH1NxYeWIMUOtok_PGE99rrHuTr-ah0kPCdOWM2jmKe3WqrzbE6uITpGxXKP68UE4cYvuP_e3emR3_no Oct 04 18:28:15.377212 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:28:15.377212 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:28:15.377212 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:28:15.377212 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:28:15.377212 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:28:15.377212 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:28:15.377212 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 8fce18722be746f5b786626f1a5197ef Oct 04 18:28:15.377212 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1886116299 Oct 04 18:28:15.377212 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member,admin Oct 04 18:28:15.377212 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member,admin Oct 04 18:28:15.378684 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8fce18722be746f5b786626f1a5197ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8fce18722be746f5b786626f1a5197ef", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8fce18722be746f5b786626f1a5197ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8fce18722be746f5b786626f1a5197ef"}]}] Oct 04 18:28:15.378684 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1886116299 Oct 04 18:28:15.378684 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 8fce18722be746f5b786626f1a5197ef Oct 04 18:28:15.378684 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1886116299 Oct 04 18:28:15.378684 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1886116299-project-admin Oct 04 18:28:15.378684 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:28:15.378684 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:28:15.378684 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 051816d7b8214030b51960b9d067e430 Oct 04 18:28:15.378684 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1886116299-project-admin Oct 04 18:28:15.378684 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:28:15.378684 n-d-850501-14 devstack@n-api.service[123002]: exception: Invalid timestamp for date invalid_time Oct 04 18:28:15.379430 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'invalid_time'} Oct 04 18:28:15.379430 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:28:15.379430 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:15.379430 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Oct 04 18:28:15.379430 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Oct 04 18:28:15.379430 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Oct 04 18:28:15.379430 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Oct 04 18:28:15.379430 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Oct 04 18:28:15.379430 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Oct 04 18:28:15.379430 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Oct 04 18:28:15.379430 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:15.379430 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:15.379430 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:15.379430 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:15.379430 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:15.379430 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:15.379430 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:28:15.379430 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:28:15.379430 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:28:15.379430 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:28:15.380591 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Oct 04 18:28:15.380591 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Oct 04 18:28:15.380591 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Oct 04 18:28:15.380591 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:15.380591 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:15.380591 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:15.380591 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:15.380591 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:15.380591 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:15.380591 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:28:15.380591 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:28:15.380591 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Oct 04 18:28:15.380591 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:15.380591 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-21888820-6cea-43d5-87a8-47fdc63ee2e8 tempest-InstanceUsageAuditLogNegativeTestJSON-1886116299 tempest-InstanceUsageAuditLogNegativeTestJSON-1886116299-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:28:15.380591 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-21888820-6cea-43d5-87a8-47fdc63ee2e8 tempest-InstanceUsageAuditLogNegativeTestJSON-1886116299 tempest-InstanceUsageAuditLogNegativeTestJSON-1886116299-project-admin] 10.222.0.20 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.333376 Oct 04 18:28:15.381545 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 80/170] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Oct 4 18:28:15 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 335 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 04 18:28:15.396047 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a5ace86c-ef3e-41c1-9d56-f0b6d3b610c6 tempest-KeyPairsV210TestJSON-68585979 tempest-KeyPairsV210TestJSON-68585979-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-840540818" status: 204 len: 0 microversion: 2.10 time: 0.106322 Oct 04 18:28:15.396943 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 91/171] 10.222.0.20 () {60 vars in 1322 bytes} [Tue Oct 4 18:28:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-840540818 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:28:15.406189 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ef9dfe72-9370-490e-8e5c-5fbca81b91a8 tempest-KeyPairsV210TestJSON-68585979 tempest-KeyPairsV210TestJSON-68585979-project-admin] Calling method '.version_select at 0x7fe259ba4040>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:15.504073 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ef9dfe72-9370-490e-8e5c-5fbca81b91a8 tempest-KeyPairsV210TestJSON-68585979 tempest-KeyPairsV210TestJSON-68585979-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-144840009?user_id=ef57b9acb84342248707a5662c704e09" status: 204 len: 0 microversion: 2.10 time: 0.102193 Oct 04 18:28:15.504682 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 92/172] 10.222.0.20 () {60 vars in 1340 bytes} [Tue Oct 4 18:28:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-144840009?user_id=ef57b9acb84342248707a5662c704e09 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:28:15.532375 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ea56ccc9-cedb-44c1-8119-a6f5419a8f0f tempest-InstanceUsageAuditLogNegativeTestJSON-379425435 tempest-InstanceUsageAuditLogNegativeTestJSON-379425435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:15.534369 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ea56ccc9-cedb-44c1-8119-a6f5419a8f0f tempest-InstanceUsageAuditLogNegativeTestJSON-379425435 tempest-InstanceUsageAuditLogNegativeTestJSON-379425435-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '375b32310dca4b3999ed0720dabf5b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd928525bf2984cd19e1ebd035b749172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:15.536045 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ea56ccc9-cedb-44c1-8119-a6f5419a8f0f tempest-InstanceUsageAuditLogNegativeTestJSON-379425435 tempest-InstanceUsageAuditLogNegativeTestJSON-379425435-project] Request method failure captured: Oct 04 18:28:15.536045 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Oct 04 18:28:15.536045 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:28:15.536045 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:28:15.536045 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:28:15.536045 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:28:15.536045 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:28:15.536045 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:28:15.536045 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:28:15.536045 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:28:15.536045 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPHs8bEw3Z4iY5J6nDIPpy-ivXBnWVvN8Bwh3gBvkCcOPw7waDmbTl-N1gZtBTzm76x6f0-gDuVqBaONZEGPdjis7j3J22h-E0wgDY2wELttOelDEXkRkA07AdQBlJrzldh8t_akHAKhS7xDM1ZENwOJfB8zGHbAihEGptq8W6JEBeBU Oct 04 18:28:15.536045 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:28:15.536045 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:28:15.536045 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:28:15.536045 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:28:15.536045 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:28:15.536045 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:28:15.536045 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: d928525bf2984cd19e1ebd035b749172 Oct 04 18:28:15.536045 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-379425435 Oct 04 18:28:15.536045 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:28:15.536045 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:28:15.537291 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d928525bf2984cd19e1ebd035b749172"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d928525bf2984cd19e1ebd035b749172", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d928525bf2984cd19e1ebd035b749172"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d928525bf2984cd19e1ebd035b749172"}]}] Oct 04 18:28:15.537291 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-379425435 Oct 04 18:28:15.537291 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: d928525bf2984cd19e1ebd035b749172 Oct 04 18:28:15.537291 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-379425435 Oct 04 18:28:15.537291 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-379425435-project Oct 04 18:28:15.537291 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:28:15.537291 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:28:15.537291 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 375b32310dca4b3999ed0720dabf5b71 Oct 04 18:28:15.537291 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-379425435-project Oct 04 18:28:15.537291 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:28:15.537847 n-d-850501-14 devstack@n-api.service[123002]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 04 18:28:15.537847 n-d-850501-14 devstack@n-api.service[123002]: action_args: {} Oct 04 18:28:15.537847 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:28:15.537847 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:15.537847 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:15.537847 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:15.537847 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:28:15.537847 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:28:15.537847 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:28:15.537847 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:28:15.537847 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Oct 04 18:28:15.537847 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Oct 04 18:28:15.537847 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:28:15.537847 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:28:15.537847 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:28:15.537847 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:28:15.537847 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:28:15.537847 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:28:15.537847 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:28:15.537847 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:28:15.539555 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:28:15.539555 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:28:15.539555 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:28:15.539555 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:28:15.539555 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:28:15.539555 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:28:15.539555 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 04 18:28:15.539555 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:15.539555 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:15.539555 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:15.539555 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:15.539555 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:15.539555 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:15.539555 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:28:15.539555 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:28:15.539555 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 04 18:28:15.539555 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:15.541445 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ea56ccc9-cedb-44c1-8119-a6f5419a8f0f tempest-InstanceUsageAuditLogNegativeTestJSON-379425435 tempest-InstanceUsageAuditLogNegativeTestJSON-379425435-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:28:15.541445 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ea56ccc9-cedb-44c1-8119-a6f5419a8f0f tempest-InstanceUsageAuditLogNegativeTestJSON-379425435 tempest-InstanceUsageAuditLogNegativeTestJSON-379425435-project] 10.222.0.20 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.152040 Oct 04 18:28:15.541445 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 81/173] 10.222.0.20 () {58 vars in 1185 bytes} [Tue Oct 4 18:28:15 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 153 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:28:15.543385 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-be5f43d2-baa1-4c4b-b487-1ae93cc8feac tempest-KeyPairsV210TestJSON-68585979 tempest-KeyPairsV210TestJSON-68585979-project-admin] Calling method '.version_select at 0x7fe259a41280>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:15.621932 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-be5f43d2-baa1-4c4b-b487-1ae93cc8feac tempest-KeyPairsV210TestJSON-68585979 tempest-KeyPairsV210TestJSON-68585979-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-321473353?user_id=ef57b9acb84342248707a5662c704e09" status: 204 len: 0 microversion: 2.10 time: 0.082971 Oct 04 18:28:15.622509 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 82/174] 10.222.0.20 () {60 vars in 1340 bytes} [Tue Oct 4 18:28:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-321473353?user_id=ef57b9acb84342248707a5662c704e09 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:28:15.627055 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-86abf644-4ba6-4cb9-9481-d22cec5ada6f tempest-InstanceUsageAuditLogNegativeTestJSON-379425435 tempest-InstanceUsageAuditLogNegativeTestJSON-379425435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:15.628845 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-86abf644-4ba6-4cb9-9481-d22cec5ada6f tempest-InstanceUsageAuditLogNegativeTestJSON-379425435 tempest-InstanceUsageAuditLogNegativeTestJSON-379425435-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '375b32310dca4b3999ed0720dabf5b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd928525bf2984cd19e1ebd035b749172', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:15.631049 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-86abf644-4ba6-4cb9-9481-d22cec5ada6f tempest-InstanceUsageAuditLogNegativeTestJSON-379425435 tempest-InstanceUsageAuditLogNegativeTestJSON-379425435-project] Request method failure captured: Oct 04 18:28:15.631049 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-10-04%2018:28:15 HTTP/1.1 Oct 04 18:28:15.631049 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:28:15.631049 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:28:15.631049 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:28:15.631049 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:28:15.631049 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:28:15.631049 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:28:15.631049 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:28:15.631049 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:28:15.631049 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPHs8bEw3Z4iY5J6nDIPpy-ivXBnWVvN8Bwh3gBvkCcOPw7waDmbTl-N1gZtBTzm76x6f0-gDuVqBaONZEGPdjis7j3J22h-E0wgDY2wELttOelDEXkRkA07AdQBlJrzldh8t_akHAKhS7xDM1ZENwOJfB8zGHbAihEGptq8W6JEBeBU Oct 04 18:28:15.631049 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:28:15.631049 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:28:15.631049 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:28:15.631049 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:28:15.631049 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:28:15.631049 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:28:15.631049 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: d928525bf2984cd19e1ebd035b749172 Oct 04 18:28:15.631049 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-379425435 Oct 04 18:28:15.631049 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:28:15.631049 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:28:15.632256 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d928525bf2984cd19e1ebd035b749172"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d928525bf2984cd19e1ebd035b749172", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d928525bf2984cd19e1ebd035b749172"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d928525bf2984cd19e1ebd035b749172"}]}] Oct 04 18:28:15.632256 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-379425435 Oct 04 18:28:15.632256 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: d928525bf2984cd19e1ebd035b749172 Oct 04 18:28:15.632256 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-379425435 Oct 04 18:28:15.632256 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-379425435-project Oct 04 18:28:15.632256 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:28:15.632256 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:28:15.632256 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 375b32310dca4b3999ed0720dabf5b71 Oct 04 18:28:15.632256 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-379425435-project Oct 04 18:28:15.632256 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:28:15.633448 n-d-850501-14 devstack@n-api.service[123002]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 04 18:28:15.633448 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '2022-10-04 18:28:15'} Oct 04 18:28:15.633448 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:28:15.633448 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:15.633448 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:15.633448 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:15.633448 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:28:15.633448 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:28:15.633448 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:28:15.633448 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:28:15.633448 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Oct 04 18:28:15.633448 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Oct 04 18:28:15.633448 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:28:15.633448 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:28:15.633448 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:28:15.633448 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:28:15.633448 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:28:15.633448 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:28:15.633448 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:28:15.633448 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:28:15.634788 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:28:15.634788 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:28:15.634788 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:28:15.634788 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:28:15.634788 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:28:15.634788 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:28:15.634788 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 04 18:28:15.634788 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:15.634788 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:15.634788 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:15.634788 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:15.634788 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:15.634788 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:15.634788 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:28:15.634788 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:28:15.634788 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 04 18:28:15.634788 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:15.635863 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-86abf644-4ba6-4cb9-9481-d22cec5ada6f tempest-InstanceUsageAuditLogNegativeTestJSON-379425435 tempest-InstanceUsageAuditLogNegativeTestJSON-379425435-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:28:15.635863 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-86abf644-4ba6-4cb9-9481-d22cec5ada6f tempest-InstanceUsageAuditLogNegativeTestJSON-379425435 tempest-InstanceUsageAuditLogNegativeTestJSON-379425435-project] 10.222.0.20 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-04 18:28:15" status: 403 len: 128 microversion: 2.1 time: 0.009244 Oct 04 18:28:15.637837 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 83/175] 10.222.0.20 () {58 vars in 1251 bytes} [Tue Oct 4 18:28:15 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-04%2018%3A28%3A15 => generated 128 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:28:15.643103 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-33a2e0ad-1e51-4e48-9e32-292f53995784 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-675540627", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "1102270088", "adminPass": "***", "networks": [{"uuid": "efe063a4-9cbc-4160-9e09-9b7d773c6a3e"}], "security_groups": [{"name": "tempest-securitygroup--1053507296"}], "key_name": "tempest-keypair-1365947858", "user_data": "}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:15.729559 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7b98f8be-9462-43a2-8a91-349750213a7f tempest-HypervisorAdminNegativeTestJSON-1598704735 tempest-HypervisorAdminNegativeTestJSON-1598704735-project] Calling method '.version_select at 0x7fe259ba7a60>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:15.731363 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7b98f8be-9462-43a2-8a91-349750213a7f tempest-HypervisorAdminNegativeTestJSON-1598704735 tempest-HypervisorAdminNegativeTestJSON-1598704735-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': 'b94a0315d1a34c01bdc0be9baa5573fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0831f3ccc74479bca5420a7cf797b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:15.733381 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7b98f8be-9462-43a2-8a91-349750213a7f tempest-HypervisorAdminNegativeTestJSON-1598704735 tempest-HypervisorAdminNegativeTestJSON-1598704735-project] Request method failure captured: Oct 04 18:28:15.733381 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Oct 04 18:28:15.733381 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:28:15.733381 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:28:15.733381 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:28:15.733381 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:28:15.733381 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:28:15.733381 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:28:15.733381 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:28:15.733381 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:28:15.733381 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPHs9PPWLclC3z8gQrM69wYaJ1UfasHxCBxhBiyL6K0fBSSFaSSQ80YKdhgI9CJIRs0LorfmZOLL8k9HOYnbWk20ju7fw-nOHGXCyNP3Fn8nDYj51wNz21Iqfn7ZBCPjvY72pjpF1IlVOdGjAzz6MD9-ixTkpufcssVHOKe7GW47zjAc Oct 04 18:28:15.733381 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:28:15.733381 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:28:15.733381 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:28:15.733381 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:28:15.733381 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:28:15.733381 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:28:15.733381 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 1e0831f3ccc74479bca5420a7cf797b3 Oct 04 18:28:15.733381 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1598704735 Oct 04 18:28:15.733381 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:28:15.733381 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:28:15.734778 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1e0831f3ccc74479bca5420a7cf797b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1e0831f3ccc74479bca5420a7cf797b3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1e0831f3ccc74479bca5420a7cf797b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1e0831f3ccc74479bca5420a7cf797b3"}]}] Oct 04 18:28:15.734778 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1598704735 Oct 04 18:28:15.734778 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 1e0831f3ccc74479bca5420a7cf797b3 Oct 04 18:28:15.734778 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1598704735 Oct 04 18:28:15.734778 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-HypervisorAdminNegativeTestJSON-1598704735-project Oct 04 18:28:15.734778 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:28:15.734778 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:28:15.734778 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: b94a0315d1a34c01bdc0be9baa5573fa Oct 04 18:28:15.734778 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1598704735-project Oct 04 18:28:15.734778 n-d-850501-14 devstack@n-api.service[123001]: method: Oct 04 18:28:15.734778 n-d-850501-14 devstack@n-api.service[123001]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 04 18:28:15.734778 n-d-850501-14 devstack@n-api.service[123001]: action_args: {} Oct 04 18:28:15.734778 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:28:15.735513 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:15.735513 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:15.735513 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:15.735513 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:28:15.735513 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:28:15.735513 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:28:15.735513 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:28:15.735513 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:28:15.735513 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:28:15.735513 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Oct 04 18:28:15.735513 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self._detail(req) Oct 04 18:28:15.735513 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Oct 04 18:28:15.735513 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Oct 04 18:28:15.735513 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:28:15.735513 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:28:15.735513 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:28:15.735513 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:28:15.735513 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:28:15.735513 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:28:15.736609 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:28:15.736609 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:28:15.736609 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:28:15.736609 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:28:15.736609 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:28:15.736609 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:28:15.736609 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:28:15.736609 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:28:15.736609 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 04 18:28:15.736609 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:15.736609 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:15.736609 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:15.736609 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:15.736609 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:15.736609 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:15.736609 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:28:15.736609 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:28:15.736609 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 04 18:28:15.736609 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:15.739321 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7b98f8be-9462-43a2-8a91-349750213a7f tempest-HypervisorAdminNegativeTestJSON-1598704735 tempest-HypervisorAdminNegativeTestJSON-1598704735-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:28:15.739321 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7b98f8be-9462-43a2-8a91-349750213a7f tempest-HypervisorAdminNegativeTestJSON-1598704735 tempest-HypervisorAdminNegativeTestJSON-1598704735-project] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.229175 Oct 04 18:28:15.739321 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 93/176] 10.222.0.20 () {58 vars in 1167 bytes} [Tue Oct 4 18:28:15 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 231 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:28:15.745992 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-235ca2ef-64d3-42c7-a0ea-9d883f146248 tempest-HypervisorAdminNegativeTestJSON-1598704735 tempest-HypervisorAdminNegativeTestJSON-1598704735-project] Calling method '.version_select at 0x7fe259dd9e50>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:15.749577 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-235ca2ef-64d3-42c7-a0ea-9d883f146248 tempest-HypervisorAdminNegativeTestJSON-1598704735 tempest-HypervisorAdminNegativeTestJSON-1598704735-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': 'b94a0315d1a34c01bdc0be9baa5573fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0831f3ccc74479bca5420a7cf797b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:15.750871 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-235ca2ef-64d3-42c7-a0ea-9d883f146248 tempest-HypervisorAdminNegativeTestJSON-1598704735 tempest-HypervisorAdminNegativeTestJSON-1598704735-project] Request method failure captured: Oct 04 18:28:15.750871 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Oct 04 18:28:15.750871 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:28:15.750871 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:28:15.750871 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:28:15.750871 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:28:15.750871 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:28:15.750871 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:28:15.750871 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:28:15.750871 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:28:15.750871 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPHs9PPWLclC3z8gQrM69wYaJ1UfasHxCBxhBiyL6K0fBSSFaSSQ80YKdhgI9CJIRs0LorfmZOLL8k9HOYnbWk20ju7fw-nOHGXCyNP3Fn8nDYj51wNz21Iqfn7ZBCPjvY72pjpF1IlVOdGjAzz6MD9-ixTkpufcssVHOKe7GW47zjAc Oct 04 18:28:15.750871 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:28:15.750871 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:28:15.750871 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:28:15.750871 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:28:15.750871 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:28:15.750871 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:28:15.750871 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 1e0831f3ccc74479bca5420a7cf797b3 Oct 04 18:28:15.750871 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1598704735 Oct 04 18:28:15.750871 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:28:15.750871 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:28:15.753299 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1e0831f3ccc74479bca5420a7cf797b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1e0831f3ccc74479bca5420a7cf797b3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1e0831f3ccc74479bca5420a7cf797b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1e0831f3ccc74479bca5420a7cf797b3"}]}] Oct 04 18:28:15.753299 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1598704735 Oct 04 18:28:15.753299 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 1e0831f3ccc74479bca5420a7cf797b3 Oct 04 18:28:15.753299 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1598704735 Oct 04 18:28:15.753299 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-HypervisorAdminNegativeTestJSON-1598704735-project Oct 04 18:28:15.753299 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:28:15.753299 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:28:15.753299 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: b94a0315d1a34c01bdc0be9baa5573fa Oct 04 18:28:15.753299 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1598704735-project Oct 04 18:28:15.753299 n-d-850501-14 devstack@n-api.service[123001]: method: Oct 04 18:28:15.753299 n-d-850501-14 devstack@n-api.service[123001]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 04 18:28:15.753299 n-d-850501-14 devstack@n-api.service[123001]: action_args: {} Oct 04 18:28:15.753299 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:28:15.754337 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:15.754337 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:15.754337 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:15.754337 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:28:15.754337 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:28:15.754337 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:28:15.754337 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:28:15.754337 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:28:15.754337 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:28:15.754337 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Oct 04 18:28:15.754337 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 04 18:28:15.754337 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Oct 04 18:28:15.754337 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Oct 04 18:28:15.754337 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:28:15.754337 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:28:15.754337 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:28:15.754337 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:28:15.754337 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:28:15.754337 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:28:15.755658 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:28:15.755658 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:28:15.755658 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:28:15.755658 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:28:15.755658 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:28:15.755658 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:28:15.755658 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:28:15.755658 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:28:15.755658 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 04 18:28:15.755658 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:15.755658 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:15.755658 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:15.755658 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:15.755658 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:15.755658 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:15.755658 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:28:15.755658 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:28:15.755658 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 04 18:28:15.755658 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:15.759030 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-235ca2ef-64d3-42c7-a0ea-9d883f146248 tempest-HypervisorAdminNegativeTestJSON-1598704735 tempest-HypervisorAdminNegativeTestJSON-1598704735-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:28:15.759030 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-235ca2ef-64d3-42c7-a0ea-9d883f146248 tempest-HypervisorAdminNegativeTestJSON-1598704735 tempest-HypervisorAdminNegativeTestJSON-1598704735-project] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.014715 Oct 04 18:28:15.759649 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 94/177] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Oct 4 18:28:15 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:28:15.765899 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-33a2e0ad-1e51-4e48-9e32-292f53995784 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] validate_networks() for [('efe063a4-9cbc-4160-9e09-9b7d773c6a3e', None, None, None, None, None)] {{(pid=123002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:28:15.770220 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0f3f5301-ca70-4006-b6a3-76d22d4c15ba tempest-HypervisorAdminNegativeTestJSON-1598704735 tempest-HypervisorAdminNegativeTestJSON-1598704735-project] Calling method '.version_select at 0x7fe259ebc0d0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:15.772154 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0f3f5301-ca70-4006-b6a3-76d22d4c15ba tempest-HypervisorAdminNegativeTestJSON-1598704735 tempest-HypervisorAdminNegativeTestJSON-1598704735-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': 'b94a0315d1a34c01bdc0be9baa5573fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0831f3ccc74479bca5420a7cf797b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:15.774502 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0f3f5301-ca70-4006-b6a3-76d22d4c15ba tempest-HypervisorAdminNegativeTestJSON-1598704735 tempest-HypervisorAdminNegativeTestJSON-1598704735-project] Request method failure captured: Oct 04 18:28:15.774502 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Oct 04 18:28:15.774502 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:28:15.774502 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:28:15.774502 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:28:15.774502 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:28:15.774502 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:28:15.774502 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:28:15.774502 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:28:15.774502 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:28:15.774502 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPHs9PPWLclC3z8gQrM69wYaJ1UfasHxCBxhBiyL6K0fBSSFaSSQ80YKdhgI9CJIRs0LorfmZOLL8k9HOYnbWk20ju7fw-nOHGXCyNP3Fn8nDYj51wNz21Iqfn7ZBCPjvY72pjpF1IlVOdGjAzz6MD9-ixTkpufcssVHOKe7GW47zjAc Oct 04 18:28:15.774502 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:28:15.774502 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:28:15.774502 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:28:15.774502 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:28:15.774502 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:28:15.774502 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:28:15.774502 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 1e0831f3ccc74479bca5420a7cf797b3 Oct 04 18:28:15.774502 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1598704735 Oct 04 18:28:15.774502 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:28:15.774502 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:28:15.781665 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1e0831f3ccc74479bca5420a7cf797b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1e0831f3ccc74479bca5420a7cf797b3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1e0831f3ccc74479bca5420a7cf797b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1e0831f3ccc74479bca5420a7cf797b3"}]}] Oct 04 18:28:15.781665 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1598704735 Oct 04 18:28:15.781665 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 1e0831f3ccc74479bca5420a7cf797b3 Oct 04 18:28:15.781665 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1598704735 Oct 04 18:28:15.781665 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-HypervisorAdminNegativeTestJSON-1598704735-project Oct 04 18:28:15.781665 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:28:15.781665 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:28:15.781665 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: b94a0315d1a34c01bdc0be9baa5573fa Oct 04 18:28:15.781665 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1598704735-project Oct 04 18:28:15.781665 n-d-850501-14 devstack@n-api.service[123001]: method: Oct 04 18:28:15.781665 n-d-850501-14 devstack@n-api.service[123001]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 04 18:28:15.781665 n-d-850501-14 devstack@n-api.service[123001]: action_args: {} Oct 04 18:28:15.781665 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:28:15.782448 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:15.782448 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:15.782448 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:15.782448 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:28:15.782448 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:28:15.782448 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:28:15.782448 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:28:15.782448 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:28:15.782448 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:28:15.782448 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Oct 04 18:28:15.782448 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Oct 04 18:28:15.782448 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:28:15.782448 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:28:15.782448 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:28:15.782448 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:28:15.782448 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:28:15.782448 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:28:15.782448 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:28:15.782448 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:28:15.783440 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:28:15.783440 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:28:15.783440 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:28:15.783440 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:28:15.783440 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:28:15.783440 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:28:15.783440 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 04 18:28:15.783440 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:15.783440 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:15.783440 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:15.783440 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:15.783440 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:15.783440 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:15.783440 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:28:15.783440 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:28:15.783440 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 04 18:28:15.783440 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:15.784673 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0f3f5301-ca70-4006-b6a3-76d22d4c15ba tempest-HypervisorAdminNegativeTestJSON-1598704735 tempest-HypervisorAdminNegativeTestJSON-1598704735-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:28:15.784673 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0f3f5301-ca70-4006-b6a3-76d22d4c15ba tempest-HypervisorAdminNegativeTestJSON-1598704735 tempest-HypervisorAdminNegativeTestJSON-1598704735-project] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.010707 Oct 04 18:28:15.801736 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 95/178] 10.222.0.20 () {58 vars in 1179 bytes} [Tue Oct 4 18:28:15 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 37 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:28:16.295281 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ae95358f-ce83-4ca5-a77c-e0070f4399ed tempest-HypervisorAdminNegativeTestJSON-1819481870 tempest-HypervisorAdminNegativeTestJSON-1819481870-project-admin] Calling method '.version_select at 0x7fe259ba4820>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:16.297098 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ae95358f-ce83-4ca5-a77c-e0070f4399ed tempest-HypervisorAdminNegativeTestJSON-1819481870 tempest-HypervisorAdminNegativeTestJSON-1819481870-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:16.297839 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ae95358f-ce83-4ca5-a77c-e0070f4399ed tempest-HypervisorAdminNegativeTestJSON-1819481870 tempest-HypervisorAdminNegativeTestJSON-1819481870-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:16.298749 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ae95358f-ce83-4ca5-a77c-e0070f4399ed tempest-HypervisorAdminNegativeTestJSON-1819481870 tempest-HypervisorAdminNegativeTestJSON-1819481870-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:16.317508 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ae95358f-ce83-4ca5-a77c-e0070f4399ed tempest-HypervisorAdminNegativeTestJSON-1819481870 tempest-HypervisorAdminNegativeTestJSON-1819481870-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:16.318461 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ae95358f-ce83-4ca5-a77c-e0070f4399ed tempest-HypervisorAdminNegativeTestJSON-1819481870 tempest-HypervisorAdminNegativeTestJSON-1819481870-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:16.319103 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ae95358f-ce83-4ca5-a77c-e0070f4399ed tempest-HypervisorAdminNegativeTestJSON-1819481870 tempest-HypervisorAdminNegativeTestJSON-1819481870-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:16.333202 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ae95358f-ce83-4ca5-a77c-e0070f4399ed tempest-HypervisorAdminNegativeTestJSON-1819481870 tempest-HypervisorAdminNegativeTestJSON-1819481870-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:16.335139 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ae95358f-ce83-4ca5-a77c-e0070f4399ed tempest-HypervisorAdminNegativeTestJSON-1819481870 tempest-HypervisorAdminNegativeTestJSON-1819481870-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:16.335766 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ae95358f-ce83-4ca5-a77c-e0070f4399ed tempest-HypervisorAdminNegativeTestJSON-1819481870 tempest-HypervisorAdminNegativeTestJSON-1819481870-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:16.345351 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ae95358f-ce83-4ca5-a77c-e0070f4399ed tempest-HypervisorAdminNegativeTestJSON-1819481870 tempest-HypervisorAdminNegativeTestJSON-1819481870-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.541425 Oct 04 18:28:16.346336 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 96/179] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Oct 4 18:28:15 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:28:16.353320 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-94a8bb12-5e40-4287-b207-38c8c45b7d89 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:16.354098 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-94a8bb12-5e40-4287-b207-38c8c45b7d89 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] [instance: 31110a13-e556-40c8-8d78-5243794ff095] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:16.360839 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-94a8bb12-5e40-4287-b207-38c8c45b7d89 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:16.362916 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-94a8bb12-5e40-4287-b207-38c8c45b7d89 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:16.363896 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-94a8bb12-5e40-4287-b207-38c8c45b7d89 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:16.365321 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-94a8bb12-5e40-4287-b207-38c8c45b7d89 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:16.366277 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-94a8bb12-5e40-4287-b207-38c8c45b7d89 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:16.367484 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-94a8bb12-5e40-4287-b207-38c8c45b7d89 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:16.548862 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-94a8bb12-5e40-4287-b207-38c8c45b7d89 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86a8d114fbc4eb584934904d8f2ef56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126dad7acaf44f909302eac21c4aafcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:16.564508 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-94a8bb12-5e40-4287-b207-38c8c45b7d89 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] 10.222.0.20 "GET /compute/v2.1/servers/31110a13-e556-40c8-8d78-5243794ff095" status: 200 len: 1338 microversion: 2.1 time: 0.216903 Oct 04 18:28:16.565601 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 97/180] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:16 2022] GET /compute/v2.1/servers/31110a13-e556-40c8-8d78-5243794ff095 => generated 1338 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:16.570824 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d8bac861-747b-44e8-a5ae-2704e533fb68 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:16.572555 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d8bac861-747b-44e8-a5ae-2704e533fb68 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] [instance: 6da2d407-863f-4f6a-9d71-d81e96f160fb] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:16.583208 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d8bac861-747b-44e8-a5ae-2704e533fb68 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:16.593856 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d8bac861-747b-44e8-a5ae-2704e533fb68 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:16.593856 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d8bac861-747b-44e8-a5ae-2704e533fb68 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:16.596907 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d8bac861-747b-44e8-a5ae-2704e533fb68 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:16.597391 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d8bac861-747b-44e8-a5ae-2704e533fb68 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:16.597996 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d8bac861-747b-44e8-a5ae-2704e533fb68 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:16.821762 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d8bac861-747b-44e8-a5ae-2704e533fb68 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f87d9eaf49545bb8effb170768bb8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e99a0400fe947bb8907857cc4de2899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:16.833669 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d8bac861-747b-44e8-a5ae-2704e533fb68 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] 10.222.0.20 "GET /compute/v2.1/servers/6da2d407-863f-4f6a-9d71-d81e96f160fb" status: 200 len: 1341 microversion: 2.1 time: 0.265840 Oct 04 18:28:16.842227 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 98/181] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:16 2022] GET /compute/v2.1/servers/6da2d407-863f-4f6a-9d71-d81e96f160fb => generated 1341 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:16.842227 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-64967df8-ee6e-4a38-9531-b298eef18834 tempest-HypervisorAdminNegativeTestJSON-1598704735 tempest-HypervisorAdminNegativeTestJSON-1598704735-project] Calling method '.version_select at 0x7fe259ba4280>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:16.843493 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-64967df8-ee6e-4a38-9531-b298eef18834 tempest-HypervisorAdminNegativeTestJSON-1598704735 tempest-HypervisorAdminNegativeTestJSON-1598704735-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': 'b94a0315d1a34c01bdc0be9baa5573fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0831f3ccc74479bca5420a7cf797b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:16.845631 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-64967df8-ee6e-4a38-9531-b298eef18834 tempest-HypervisorAdminNegativeTestJSON-1598704735 tempest-HypervisorAdminNegativeTestJSON-1598704735-project] Request method failure captured: Oct 04 18:28:16.845631 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Oct 04 18:28:16.845631 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:28:16.845631 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:28:16.845631 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:28:16.845631 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:28:16.845631 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:28:16.845631 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:28:16.845631 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:28:16.845631 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:28:16.845631 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPHs9PPWLclC3z8gQrM69wYaJ1UfasHxCBxhBiyL6K0fBSSFaSSQ80YKdhgI9CJIRs0LorfmZOLL8k9HOYnbWk20ju7fw-nOHGXCyNP3Fn8nDYj51wNz21Iqfn7ZBCPjvY72pjpF1IlVOdGjAzz6MD9-ixTkpufcssVHOKe7GW47zjAc Oct 04 18:28:16.845631 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:28:16.845631 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:28:16.845631 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:28:16.845631 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:28:16.845631 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:28:16.845631 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:28:16.845631 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 1e0831f3ccc74479bca5420a7cf797b3 Oct 04 18:28:16.845631 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1598704735 Oct 04 18:28:16.845631 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:28:16.845631 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:28:16.846829 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1e0831f3ccc74479bca5420a7cf797b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1e0831f3ccc74479bca5420a7cf797b3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1e0831f3ccc74479bca5420a7cf797b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1e0831f3ccc74479bca5420a7cf797b3"}]}] Oct 04 18:28:16.846829 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1598704735 Oct 04 18:28:16.846829 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 1e0831f3ccc74479bca5420a7cf797b3 Oct 04 18:28:16.846829 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1598704735 Oct 04 18:28:16.846829 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-HypervisorAdminNegativeTestJSON-1598704735-project Oct 04 18:28:16.846829 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:28:16.846829 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:28:16.846829 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: b94a0315d1a34c01bdc0be9baa5573fa Oct 04 18:28:16.846829 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1598704735-project Oct 04 18:28:16.846829 n-d-850501-14 devstack@n-api.service[123001]: method: Oct 04 18:28:16.846829 n-d-850501-14 devstack@n-api.service[123001]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 04 18:28:16.846829 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '1'} Oct 04 18:28:16.846829 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:28:16.847574 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:16.847574 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:16.847574 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:16.847574 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:28:16.847574 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:28:16.847574 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:28:16.847574 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:28:16.847574 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:28:16.847574 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:28:16.847574 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Oct 04 18:28:16.847574 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Oct 04 18:28:16.847574 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:28:16.847574 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:28:16.847574 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:28:16.847574 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:28:16.847574 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:28:16.847574 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:28:16.847574 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:28:16.847574 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:28:16.848740 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:28:16.848740 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:28:16.848740 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:28:16.848740 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:28:16.848740 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:28:16.848740 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:28:16.848740 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 04 18:28:16.848740 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:16.848740 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:16.848740 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:16.848740 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:16.848740 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:16.848740 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:16.848740 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:28:16.848740 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:28:16.848740 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 04 18:28:16.848740 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:16.852804 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-64967df8-ee6e-4a38-9531-b298eef18834 tempest-HypervisorAdminNegativeTestJSON-1598704735 tempest-HypervisorAdminNegativeTestJSON-1598704735-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:28:16.855355 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-64967df8-ee6e-4a38-9531-b298eef18834 tempest-HypervisorAdminNegativeTestJSON-1598704735 tempest-HypervisorAdminNegativeTestJSON-1598704735-project] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.019288 Oct 04 18:28:16.856377 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 99/182] 10.222.0.20 () {58 vars in 1173 bytes} [Tue Oct 4 18:28:16 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:28:16.954285 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-6b134ed5-d32d-4b05-a036-341b22ffceea req-eaf14fcd-1690-41e7-b4fb-115199d785ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31110a13-e556-40c8-8d78-5243794ff095", "name": "network-vif-plugged", "status": "completed", "tag": "a42dbecd-d6e2-4ab5-b9b2-a4bb5001da71"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:16.966679 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-6b134ed5-d32d-4b05-a036-341b22ffceea req-eaf14fcd-1690-41e7-b4fb-115199d785ab service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:16.967498 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-6b134ed5-d32d-4b05-a036-341b22ffceea req-eaf14fcd-1690-41e7-b4fb-115199d785ab service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:16.968046 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-6b134ed5-d32d-4b05-a036-341b22ffceea req-eaf14fcd-1690-41e7-b4fb-115199d785ab service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:16.982115 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-6b134ed5-d32d-4b05-a036-341b22ffceea req-eaf14fcd-1690-41e7-b4fb-115199d785ab service nova] Creating event network-vif-plugged:a42dbecd-d6e2-4ab5-b9b2-a4bb5001da71 for instance 31110a13-e556-40c8-8d78-5243794ff095 on n-h1-850501-14 Oct 04 18:28:16.988155 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-6b134ed5-d32d-4b05-a036-341b22ffceea req-eaf14fcd-1690-41e7-b4fb-115199d785ab service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129846 Oct 04 18:28:16.989097 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 100/183] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:28:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:28:16.994422 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e9cb1207-3736-4d36-b93e-0fb273713176 tempest-HypervisorAdminNegativeTestJSON-1819481870 tempest-HypervisorAdminNegativeTestJSON-1819481870-project-admin] Calling method '.version_select at 0x7fe259bfdca0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:16.996308 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-e9cb1207-3736-4d36-b93e-0fb273713176 tempest-HypervisorAdminNegativeTestJSON-1819481870 tempest-HypervisorAdminNegativeTestJSON-1819481870-project-admin] HTTP exception thrown: Hypervisor with ID 'e4ccdc3f-7717-475f-87ca-993f416f24ad' could not be found. Oct 04 18:28:17.016333 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e9cb1207-3736-4d36-b93e-0fb273713176 tempest-HypervisorAdminNegativeTestJSON-1819481870 tempest-HypervisorAdminNegativeTestJSON-1819481870-project-admin] Request method failure captured: Oct 04 18:28:17.016333 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/os-hypervisors/e4ccdc3f-7717-475f-87ca-993f416f24ad/uptime HTTP/1.1 Oct 04 18:28:17.016333 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:28:17.016333 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:28:17.016333 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:28:17.016333 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:28:17.016333 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:28:17.016333 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:28:17.016333 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:28:17.016333 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:28:17.016333 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPHs_sLj3FSNAD8kLPAN6i4qS-ilpacFJvv-AtR45h7W_A-kFMK7KWigNip5rdkXwHxtouqXyHG_XJGwd7aj3vkojLuWYnU2Wfx_8WuplBniW3pnwT0MQZtV8Q2FOX3nUHm35bTeWBKR9k67zfEmqyE3iBLCY8noQuW6xU1fsYw_JXDo Oct 04 18:28:17.016333 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:28:17.016333 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:28:17.016333 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:28:17.016333 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:28:17.016333 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:28:17.016333 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:28:17.016333 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 0fe4c916f89d4e67a682fe1497704acf Oct 04 18:28:17.016333 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1819481870 Oct 04 18:28:17.016333 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member,admin Oct 04 18:28:17.016333 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member,admin Oct 04 18:28:17.017818 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0fe4c916f89d4e67a682fe1497704acf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0fe4c916f89d4e67a682fe1497704acf", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0fe4c916f89d4e67a682fe1497704acf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0fe4c916f89d4e67a682fe1497704acf"}]}] Oct 04 18:28:17.017818 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1819481870 Oct 04 18:28:17.017818 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 0fe4c916f89d4e67a682fe1497704acf Oct 04 18:28:17.017818 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1819481870 Oct 04 18:28:17.017818 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-HypervisorAdminNegativeTestJSON-1819481870-project-admin Oct 04 18:28:17.017818 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:28:17.017818 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:28:17.017818 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 09a071ca4c7c489d84e3de853dda4af2 Oct 04 18:28:17.017818 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1819481870-project-admin Oct 04 18:28:17.017818 n-d-850501-14 devstack@n-api.service[123001]: method: Oct 04 18:28:17.017818 n-d-850501-14 devstack@n-api.service[123001]: exception: Hypervisor with ID 'e4ccdc3f-7717-475f-87ca-993f416f24ad' could not be found. Oct 04 18:28:17.017818 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': 'e4ccdc3f-7717-475f-87ca-993f416f24ad'} Oct 04 18:28:17.018755 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:28:17.018755 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:17.018755 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 04 18:28:17.018755 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 04 18:28:17.018755 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'e4ccdc3f-7717-475f-87ca-993f416f24ad' Oct 04 18:28:17.018755 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:17.018755 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:17.018755 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:17.018755 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:17.018755 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 04 18:28:17.018755 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 04 18:28:17.018755 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 04 18:28:17.018755 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 04 18:28:17.018755 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 04 18:28:17.018755 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:17.018755 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:17.018755 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:17.018755 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:17.018755 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 04 18:28:17.018755 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 04 18:28:17.018755 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 04 18:28:17.018755 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 04 18:28:17.020151 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 04 18:28:17.020151 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:17.020151 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:17.020151 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:17.020151 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:17.020151 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:17.020151 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:17.020151 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:28:17.020151 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:28:17.020151 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:28:17.020151 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:28:17.020151 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:28:17.020151 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:28:17.020151 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Oct 04 18:28:17.020151 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 04 18:28:17.020151 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 04 18:28:17.020151 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 18:28:17.020151 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'e4ccdc3f-7717-475f-87ca-993f416f24ad' could not be found. Oct 04 18:28:17.020151 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:17.020151 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:17.020151 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:17.021486 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:17.021486 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:17.021486 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:17.021486 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:28:17.021486 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:28:17.021486 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'e4ccdc3f-7717-475f-87ca-993f416f24ad' could not be found. Oct 04 18:28:17.021486 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:17.023265 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e9cb1207-3736-4d36-b93e-0fb273713176 tempest-HypervisorAdminNegativeTestJSON-1819481870 tempest-HypervisorAdminNegativeTestJSON-1819481870-project-admin] Returning 404 to user: Hypervisor with ID 'e4ccdc3f-7717-475f-87ca-993f416f24ad' could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:28:17.025075 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e9cb1207-3736-4d36-b93e-0fb273713176 tempest-HypervisorAdminNegativeTestJSON-1819481870 tempest-HypervisorAdminNegativeTestJSON-1819481870-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/e4ccdc3f-7717-475f-87ca-993f416f24ad/uptime" status: 404 len: 123 microversion: 2.1 time: 0.034892 Oct 04 18:28:17.026249 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 101/184] 10.222.0.20 () {58 vars in 1278 bytes} [Tue Oct 4 18:28:16 2022] GET /compute/v2.1/os-hypervisors/e4ccdc3f-7717-475f-87ca-993f416f24ad/uptime => generated 123 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:28:17.037009 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6502e413-93f6-46eb-b3d0-0a0304cad0a0 tempest-HypervisorAdminNegativeTestJSON-1819481870 tempest-HypervisorAdminNegativeTestJSON-1819481870-project-admin] Calling method '.version_select at 0x7fe259b67b80>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:17.039602 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6502e413-93f6-46eb-b3d0-0a0304cad0a0 tempest-HypervisorAdminNegativeTestJSON-1819481870 tempest-HypervisorAdminNegativeTestJSON-1819481870-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:17.040410 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6502e413-93f6-46eb-b3d0-0a0304cad0a0 tempest-HypervisorAdminNegativeTestJSON-1819481870 tempest-HypervisorAdminNegativeTestJSON-1819481870-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:17.043353 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6502e413-93f6-46eb-b3d0-0a0304cad0a0 tempest-HypervisorAdminNegativeTestJSON-1819481870 tempest-HypervisorAdminNegativeTestJSON-1819481870-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:17.074053 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6502e413-93f6-46eb-b3d0-0a0304cad0a0 tempest-HypervisorAdminNegativeTestJSON-1819481870 tempest-HypervisorAdminNegativeTestJSON-1819481870-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:17.074801 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6502e413-93f6-46eb-b3d0-0a0304cad0a0 tempest-HypervisorAdminNegativeTestJSON-1819481870 tempest-HypervisorAdminNegativeTestJSON-1819481870-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:17.075372 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6502e413-93f6-46eb-b3d0-0a0304cad0a0 tempest-HypervisorAdminNegativeTestJSON-1819481870 tempest-HypervisorAdminNegativeTestJSON-1819481870-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:17.094574 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6502e413-93f6-46eb-b3d0-0a0304cad0a0 tempest-HypervisorAdminNegativeTestJSON-1819481870 tempest-HypervisorAdminNegativeTestJSON-1819481870-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:17.099729 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6502e413-93f6-46eb-b3d0-0a0304cad0a0 tempest-HypervisorAdminNegativeTestJSON-1819481870 tempest-HypervisorAdminNegativeTestJSON-1819481870-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:17.103479 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6502e413-93f6-46eb-b3d0-0a0304cad0a0 tempest-HypervisorAdminNegativeTestJSON-1819481870 tempest-HypervisorAdminNegativeTestJSON-1819481870-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:17.108570 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=4 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:28:17.112510 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6502e413-93f6-46eb-b3d0-0a0304cad0a0 tempest-HypervisorAdminNegativeTestJSON-1819481870 tempest-HypervisorAdminNegativeTestJSON-1819481870-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.079683 Oct 04 18:28:17.117947 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 102/185] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Oct 4 18:28:17 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:28:17.125972 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7640c406-a948-4c4f-89f2-64ceaafa3bd7 tempest-HypervisorAdminNegativeTestJSON-1598704735 tempest-HypervisorAdminNegativeTestJSON-1598704735-project] Calling method '.version_select at 0x7fe259bfdaf0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:17.128732 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7640c406-a948-4c4f-89f2-64ceaafa3bd7 tempest-HypervisorAdminNegativeTestJSON-1598704735 tempest-HypervisorAdminNegativeTestJSON-1598704735-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': 'b94a0315d1a34c01bdc0be9baa5573fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0831f3ccc74479bca5420a7cf797b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:17.130501 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7640c406-a948-4c4f-89f2-64ceaafa3bd7 tempest-HypervisorAdminNegativeTestJSON-1598704735 tempest-HypervisorAdminNegativeTestJSON-1598704735-project] Request method failure captured: Oct 04 18:28:17.130501 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Oct 04 18:28:17.130501 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:28:17.130501 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:28:17.130501 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:28:17.130501 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:28:17.130501 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:28:17.130501 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:28:17.130501 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:28:17.130501 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:28:17.130501 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPHs9PPWLclC3z8gQrM69wYaJ1UfasHxCBxhBiyL6K0fBSSFaSSQ80YKdhgI9CJIRs0LorfmZOLL8k9HOYnbWk20ju7fw-nOHGXCyNP3Fn8nDYj51wNz21Iqfn7ZBCPjvY72pjpF1IlVOdGjAzz6MD9-ixTkpufcssVHOKe7GW47zjAc Oct 04 18:28:17.130501 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:28:17.130501 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:28:17.130501 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:28:17.130501 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:28:17.130501 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:28:17.130501 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:28:17.130501 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 1e0831f3ccc74479bca5420a7cf797b3 Oct 04 18:28:17.130501 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1598704735 Oct 04 18:28:17.130501 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:28:17.130501 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:28:17.132010 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1e0831f3ccc74479bca5420a7cf797b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1e0831f3ccc74479bca5420a7cf797b3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1e0831f3ccc74479bca5420a7cf797b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1e0831f3ccc74479bca5420a7cf797b3"}]}] Oct 04 18:28:17.132010 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1598704735 Oct 04 18:28:17.132010 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 1e0831f3ccc74479bca5420a7cf797b3 Oct 04 18:28:17.132010 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1598704735 Oct 04 18:28:17.132010 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-HypervisorAdminNegativeTestJSON-1598704735-project Oct 04 18:28:17.132010 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:28:17.132010 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:28:17.132010 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: b94a0315d1a34c01bdc0be9baa5573fa Oct 04 18:28:17.132010 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1598704735-project Oct 04 18:28:17.132010 n-d-850501-14 devstack@n-api.service[123001]: method: Oct 04 18:28:17.132010 n-d-850501-14 devstack@n-api.service[123001]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 04 18:28:17.132010 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '1'} Oct 04 18:28:17.132010 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:28:17.132894 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:17.132894 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:17.132894 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:17.132894 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:28:17.132894 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:28:17.132894 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:28:17.132894 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:28:17.132894 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:28:17.132894 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:28:17.132894 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 04 18:28:17.132894 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 04 18:28:17.132894 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Oct 04 18:28:17.132894 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Oct 04 18:28:17.132894 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:28:17.132894 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:28:17.132894 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:28:17.132894 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:28:17.132894 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:28:17.132894 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:28:17.137927 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:28:17.137927 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:28:17.137927 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:28:17.137927 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:28:17.137927 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:28:17.137927 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:28:17.137927 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:28:17.137927 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:28:17.137927 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 04 18:28:17.137927 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:17.137927 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:17.137927 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:17.137927 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:17.137927 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:17.137927 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:17.137927 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:28:17.137927 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:28:17.137927 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 04 18:28:17.137927 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:17.140142 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7640c406-a948-4c4f-89f2-64ceaafa3bd7 tempest-HypervisorAdminNegativeTestJSON-1598704735 tempest-HypervisorAdminNegativeTestJSON-1598704735-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:28:17.140142 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7640c406-a948-4c4f-89f2-64ceaafa3bd7 tempest-HypervisorAdminNegativeTestJSON-1598704735 tempest-HypervisorAdminNegativeTestJSON-1598704735-project] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.009808 Oct 04 18:28:17.140142 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 103/186] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Oct 4 18:28:17 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:28:17.142298 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-54538ae6-904f-42a3-a862-aab29d8e3ae2 tempest-HypervisorAdminNegativeTestJSON-1819481870 tempest-HypervisorAdminNegativeTestJSON-1819481870-project-admin] Calling method '.version_select at 0x7fe259b67280>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:17.143648 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-54538ae6-904f-42a3-a862-aab29d8e3ae2 tempest-HypervisorAdminNegativeTestJSON-1819481870 tempest-HypervisorAdminNegativeTestJSON-1819481870-project-admin] HTTP exception thrown: Hypervisor with ID '1e839d7f-f937-472b-bd30-6c846902fa70' could not be found. Oct 04 18:28:17.145332 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-54538ae6-904f-42a3-a862-aab29d8e3ae2 tempest-HypervisorAdminNegativeTestJSON-1819481870 tempest-HypervisorAdminNegativeTestJSON-1819481870-project-admin] Request method failure captured: Oct 04 18:28:17.145332 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/os-hypervisors/1e839d7f-f937-472b-bd30-6c846902fa70 HTTP/1.1 Oct 04 18:28:17.145332 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:28:17.145332 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:28:17.145332 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:28:17.145332 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:28:17.145332 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:28:17.145332 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:28:17.145332 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:28:17.145332 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:28:17.145332 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPHs_sLj3FSNAD8kLPAN6i4qS-ilpacFJvv-AtR45h7W_A-kFMK7KWigNip5rdkXwHxtouqXyHG_XJGwd7aj3vkojLuWYnU2Wfx_8WuplBniW3pnwT0MQZtV8Q2FOX3nUHm35bTeWBKR9k67zfEmqyE3iBLCY8noQuW6xU1fsYw_JXDo Oct 04 18:28:17.145332 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:28:17.145332 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:28:17.145332 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:28:17.145332 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:28:17.145332 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:28:17.145332 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:28:17.145332 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 0fe4c916f89d4e67a682fe1497704acf Oct 04 18:28:17.145332 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1819481870 Oct 04 18:28:17.145332 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member,admin Oct 04 18:28:17.145332 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member,admin Oct 04 18:28:17.146745 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0fe4c916f89d4e67a682fe1497704acf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0fe4c916f89d4e67a682fe1497704acf", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0fe4c916f89d4e67a682fe1497704acf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0fe4c916f89d4e67a682fe1497704acf"}]}] Oct 04 18:28:17.146745 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1819481870 Oct 04 18:28:17.146745 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 0fe4c916f89d4e67a682fe1497704acf Oct 04 18:28:17.146745 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1819481870 Oct 04 18:28:17.146745 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-HypervisorAdminNegativeTestJSON-1819481870-project-admin Oct 04 18:28:17.146745 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:28:17.146745 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:28:17.146745 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 09a071ca4c7c489d84e3de853dda4af2 Oct 04 18:28:17.146745 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1819481870-project-admin Oct 04 18:28:17.146745 n-d-850501-14 devstack@n-api.service[123001]: method: Oct 04 18:28:17.146745 n-d-850501-14 devstack@n-api.service[123001]: exception: Hypervisor with ID '1e839d7f-f937-472b-bd30-6c846902fa70' could not be found. Oct 04 18:28:17.146745 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '1e839d7f-f937-472b-bd30-6c846902fa70'} Oct 04 18:28:17.147543 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:28:17.147543 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:17.147543 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 04 18:28:17.147543 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 04 18:28:17.147543 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '1e839d7f-f937-472b-bd30-6c846902fa70' Oct 04 18:28:17.147543 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:17.147543 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:17.147543 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:17.147543 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:17.147543 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 04 18:28:17.147543 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 04 18:28:17.147543 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 04 18:28:17.147543 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 04 18:28:17.147543 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 04 18:28:17.147543 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:17.147543 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:17.147543 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:17.147543 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:17.147543 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 04 18:28:17.147543 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 04 18:28:17.147543 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 04 18:28:17.147543 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 04 18:28:17.149481 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 04 18:28:17.149481 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:17.149481 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:17.149481 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:17.149481 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:17.149481 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:17.149481 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:17.149481 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:28:17.149481 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:28:17.149481 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:28:17.149481 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:28:17.149481 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:28:17.149481 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:28:17.149481 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 04 18:28:17.149481 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 04 18:28:17.149481 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Oct 04 18:28:17.149481 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 04 18:28:17.149481 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 04 18:28:17.149481 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 18:28:17.149481 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '1e839d7f-f937-472b-bd30-6c846902fa70' could not be found. Oct 04 18:28:17.150759 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:17.150759 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:17.150759 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:17.150759 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:17.150759 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:17.150759 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:17.150759 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:28:17.150759 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:28:17.150759 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '1e839d7f-f937-472b-bd30-6c846902fa70' could not be found. Oct 04 18:28:17.150759 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:17.152004 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-54538ae6-904f-42a3-a862-aab29d8e3ae2 tempest-HypervisorAdminNegativeTestJSON-1819481870 tempest-HypervisorAdminNegativeTestJSON-1819481870-project-admin] Returning 404 to user: Hypervisor with ID '1e839d7f-f937-472b-bd30-6c846902fa70' could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:28:17.153031 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-54538ae6-904f-42a3-a862-aab29d8e3ae2 tempest-HypervisorAdminNegativeTestJSON-1819481870 tempest-HypervisorAdminNegativeTestJSON-1819481870-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/1e839d7f-f937-472b-bd30-6c846902fa70" status: 404 len: 123 microversion: 2.1 time: 0.014686 Oct 04 18:28:17.162022 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 104/187] 10.222.0.20 () {58 vars in 1257 bytes} [Tue Oct 4 18:28:17 2022] GET /compute/v2.1/os-hypervisors/1e839d7f-f937-472b-bd30-6c846902fa70 => generated 123 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:28:17.429748 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-33a2e0ad-1e51-4e48-9e32-292f53995784 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:28:17.430776 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-33a2e0ad-1e51-4e48-9e32-292f53995784 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:28:17.431259 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-33a2e0ad-1e51-4e48-9e32-292f53995784 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:28:17.431985 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-33a2e0ad-1e51-4e48-9e32-292f53995784 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:28:17.432554 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-33a2e0ad-1e51-4e48-9e32-292f53995784 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:28:17.443316 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-33a2e0ad-1e51-4e48-9e32-292f53995784 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:17.444147 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-33a2e0ad-1e51-4e48-9e32-292f53995784 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:17.444950 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-33a2e0ad-1e51-4e48-9e32-292f53995784 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:17.446291 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-33a2e0ad-1e51-4e48-9e32-292f53995784 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:17.446927 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-33a2e0ad-1e51-4e48-9e32-292f53995784 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:17.447535 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-33a2e0ad-1e51-4e48-9e32-292f53995784 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:17.468222 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-33a2e0ad-1e51-4e48-9e32-292f53995784 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Getting quotas for project 25214dec3ef24597be8e5acde61de3eb. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:28:17.473318 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-33a2e0ad-1e51-4e48-9e32-292f53995784 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Getting quotas for user 8675d7d8bab840f3a221fdf2ee4c9b5c and project 25214dec3ef24597be8e5acde61de3eb. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:28:17.486234 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-33a2e0ad-1e51-4e48-9e32-292f53995784 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Going to run 1 instances... {{(pid=123002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:28:17.488867 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-33a2e0ad-1e51-4e48-9e32-292f53995784 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] [instance: ff1c16fb-1167-4285-8d0c-c0fbb78a2883] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:28:17.591728 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5588ba3e-3521-4e40-82cc-d6542bd30650 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:17.593017 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5588ba3e-3521-4e40-82cc-d6542bd30650 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] [instance: 31110a13-e556-40c8-8d78-5243794ff095] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:17.622425 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5588ba3e-3521-4e40-82cc-d6542bd30650 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:17.622950 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5588ba3e-3521-4e40-82cc-d6542bd30650 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:17.623378 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5588ba3e-3521-4e40-82cc-d6542bd30650 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:17.625218 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5588ba3e-3521-4e40-82cc-d6542bd30650 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:17.625717 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5588ba3e-3521-4e40-82cc-d6542bd30650 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:17.626140 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5588ba3e-3521-4e40-82cc-d6542bd30650 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:17.633911 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-33a2e0ad-1e51-4e48-9e32-292f53995784 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.994313 Oct 04 18:28:17.639837 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 84/188] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:28:15 2022] POST /compute/v2.1/servers => generated 402 bytes in 2001 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:28:17.648695 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4037a409-9df4-4a9b-991b-38f9f78d2a7d tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:17.648695 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4037a409-9df4-4a9b-991b-38f9f78d2a7d tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] [instance: ff1c16fb-1167-4285-8d0c-c0fbb78a2883] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:17.731430 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4037a409-9df4-4a9b-991b-38f9f78d2a7d tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8675d7d8bab840f3a221fdf2ee4c9b5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25214dec3ef24597be8e5acde61de3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:17.738863 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4037a409-9df4-4a9b-991b-38f9f78d2a7d tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] 10.222.0.20 "GET /compute/v2.1/servers/ff1c16fb-1167-4285-8d0c-c0fbb78a2883" status: 200 len: 1264 microversion: 2.1 time: 0.096621 Oct 04 18:28:17.742950 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 85/189] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:17 2022] GET /compute/v2.1/servers/ff1c16fb-1167-4285-8d0c-c0fbb78a2883 => generated 1264 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:17.837834 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5588ba3e-3521-4e40-82cc-d6542bd30650 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86a8d114fbc4eb584934904d8f2ef56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126dad7acaf44f909302eac21c4aafcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:17.848529 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5588ba3e-3521-4e40-82cc-d6542bd30650 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] 10.222.0.20 "GET /compute/v2.1/servers/31110a13-e556-40c8-8d78-5243794ff095" status: 200 len: 1338 microversion: 2.1 time: 0.261487 Oct 04 18:28:17.852955 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 105/190] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:17 2022] GET /compute/v2.1/servers/31110a13-e556-40c8-8d78-5243794ff095 => generated 1338 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:17.858004 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-907087b7-7ce8-449a-ba01-82cd78bb8f10 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:17.858654 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-907087b7-7ce8-449a-ba01-82cd78bb8f10 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] [instance: 6da2d407-863f-4f6a-9d71-d81e96f160fb] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:17.865431 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-907087b7-7ce8-449a-ba01-82cd78bb8f10 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:17.865930 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-907087b7-7ce8-449a-ba01-82cd78bb8f10 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:17.866368 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-907087b7-7ce8-449a-ba01-82cd78bb8f10 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:17.867971 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-907087b7-7ce8-449a-ba01-82cd78bb8f10 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:17.868749 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-907087b7-7ce8-449a-ba01-82cd78bb8f10 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:17.870050 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-907087b7-7ce8-449a-ba01-82cd78bb8f10 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:18.027598 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-907087b7-7ce8-449a-ba01-82cd78bb8f10 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f87d9eaf49545bb8effb170768bb8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e99a0400fe947bb8907857cc4de2899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:18.037704 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-907087b7-7ce8-449a-ba01-82cd78bb8f10 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] 10.222.0.20 "GET /compute/v2.1/servers/6da2d407-863f-4f6a-9d71-d81e96f160fb" status: 200 len: 1341 microversion: 2.1 time: 0.183467 Oct 04 18:28:18.052520 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 86/191] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:17 2022] GET /compute/v2.1/servers/6da2d407-863f-4f6a-9d71-d81e96f160fb => generated 1341 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:18.763513 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-49a1cd95-18b2-4e0a-9961-b8be26972250 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:18.764176 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-49a1cd95-18b2-4e0a-9961-b8be26972250 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] [instance: ff1c16fb-1167-4285-8d0c-c0fbb78a2883] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:18.831884 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-49a1cd95-18b2-4e0a-9961-b8be26972250 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8675d7d8bab840f3a221fdf2ee4c9b5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25214dec3ef24597be8e5acde61de3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:18.844477 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-49a1cd95-18b2-4e0a-9961-b8be26972250 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] 10.222.0.20 "GET /compute/v2.1/servers/ff1c16fb-1167-4285-8d0c-c0fbb78a2883" status: 200 len: 1264 microversion: 2.1 time: 0.084676 Oct 04 18:28:18.845045 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 106/192] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:18 2022] GET /compute/v2.1/servers/ff1c16fb-1167-4285-8d0c-c0fbb78a2883 => generated 1264 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:18.878782 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f5e1360f-d486-4e89-93df-133154e113ac tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:18.880108 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f5e1360f-d486-4e89-93df-133154e113ac tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] [instance: 31110a13-e556-40c8-8d78-5243794ff095] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:18.892078 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f5e1360f-d486-4e89-93df-133154e113ac tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:18.897105 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f5e1360f-d486-4e89-93df-133154e113ac tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:18.898973 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f5e1360f-d486-4e89-93df-133154e113ac tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:18.900230 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f5e1360f-d486-4e89-93df-133154e113ac tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:18.902110 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f5e1360f-d486-4e89-93df-133154e113ac tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:18.903329 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f5e1360f-d486-4e89-93df-133154e113ac tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:19.008392 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-ef1a6269-af06-45d0-b685-3a928f3ea137 req-9bb2fbce-730f-4116-90e2-9a7b89c2a8ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6da2d407-863f-4f6a-9d71-d81e96f160fb", "name": "network-vif-plugged", "status": "completed", "tag": "f94fc47a-1b3f-41f3-85fc-e4179bc59d55"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:19.020125 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-ef1a6269-af06-45d0-b685-3a928f3ea137 req-9bb2fbce-730f-4116-90e2-9a7b89c2a8ca service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:19.020853 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-ef1a6269-af06-45d0-b685-3a928f3ea137 req-9bb2fbce-730f-4116-90e2-9a7b89c2a8ca service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:19.021680 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-ef1a6269-af06-45d0-b685-3a928f3ea137 req-9bb2fbce-730f-4116-90e2-9a7b89c2a8ca service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:19.036437 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-ef1a6269-af06-45d0-b685-3a928f3ea137 req-9bb2fbce-730f-4116-90e2-9a7b89c2a8ca service nova] Creating event network-vif-plugged:f94fc47a-1b3f-41f3-85fc-e4179bc59d55 for instance 6da2d407-863f-4f6a-9d71-d81e96f160fb on n-h1-850501-14 Oct 04 18:28:19.044681 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-ef1a6269-af06-45d0-b685-3a928f3ea137 req-9bb2fbce-730f-4116-90e2-9a7b89c2a8ca service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040013 Oct 04 18:28:19.050080 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 107/193] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:28:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:28:19.075317 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2bcac2eb-7161-4f35-8aff-c44ce1a6bde9 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:19.076991 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2bcac2eb-7161-4f35-8aff-c44ce1a6bde9 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] [instance: 6da2d407-863f-4f6a-9d71-d81e96f160fb] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:19.120982 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2bcac2eb-7161-4f35-8aff-c44ce1a6bde9 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:19.123577 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2bcac2eb-7161-4f35-8aff-c44ce1a6bde9 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:19.124608 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2bcac2eb-7161-4f35-8aff-c44ce1a6bde9 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:19.129348 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2bcac2eb-7161-4f35-8aff-c44ce1a6bde9 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:19.130903 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2bcac2eb-7161-4f35-8aff-c44ce1a6bde9 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:19.132100 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2bcac2eb-7161-4f35-8aff-c44ce1a6bde9 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:19.234706 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f5e1360f-d486-4e89-93df-133154e113ac tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86a8d114fbc4eb584934904d8f2ef56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126dad7acaf44f909302eac21c4aafcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:19.248397 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f5e1360f-d486-4e89-93df-133154e113ac tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] 10.222.0.20 "GET /compute/v2.1/servers/31110a13-e556-40c8-8d78-5243794ff095" status: 200 len: 1338 microversion: 2.1 time: 0.370603 Oct 04 18:28:19.249370 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 87/194] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:18 2022] GET /compute/v2.1/servers/31110a13-e556-40c8-8d78-5243794ff095 => generated 1338 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:19.494727 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-2bcac2eb-7161-4f35-8aff-c44ce1a6bde9 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f87d9eaf49545bb8effb170768bb8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e99a0400fe947bb8907857cc4de2899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:19.507279 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2bcac2eb-7161-4f35-8aff-c44ce1a6bde9 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] 10.222.0.20 "GET /compute/v2.1/servers/6da2d407-863f-4f6a-9d71-d81e96f160fb" status: 200 len: 1341 microversion: 2.1 time: 0.441775 Oct 04 18:28:19.520779 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 108/195] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:19 2022] GET /compute/v2.1/servers/6da2d407-863f-4f6a-9d71-d81e96f160fb => generated 1341 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:19.867020 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-bc56bfcd-e574-4880-9c20-9095d656eeff tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:19.869666 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-bc56bfcd-e574-4880-9c20-9095d656eeff tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] [instance: ff1c16fb-1167-4285-8d0c-c0fbb78a2883] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:19.877783 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bc56bfcd-e574-4880-9c20-9095d656eeff tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:19.878271 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bc56bfcd-e574-4880-9c20-9095d656eeff tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:19.878851 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bc56bfcd-e574-4880-9c20-9095d656eeff tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:19.879548 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bc56bfcd-e574-4880-9c20-9095d656eeff tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:19.897728 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bc56bfcd-e574-4880-9c20-9095d656eeff tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:19.898506 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bc56bfcd-e574-4880-9c20-9095d656eeff tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:19.973309 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-bc56bfcd-e574-4880-9c20-9095d656eeff tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8675d7d8bab840f3a221fdf2ee4c9b5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25214dec3ef24597be8e5acde61de3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:19.982530 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-bc56bfcd-e574-4880-9c20-9095d656eeff tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] 10.222.0.20 "GET /compute/v2.1/servers/ff1c16fb-1167-4285-8d0c-c0fbb78a2883" status: 200 len: 1316 microversion: 2.1 time: 0.119493 Oct 04 18:28:19.983314 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 88/196] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:19 2022] GET /compute/v2.1/servers/ff1c16fb-1167-4285-8d0c-c0fbb78a2883 => generated 1316 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:20.275406 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-72ce0138-1086-41b4-b3fd-3efc1f250da3 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:20.276627 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-72ce0138-1086-41b4-b3fd-3efc1f250da3 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] [instance: 31110a13-e556-40c8-8d78-5243794ff095] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:20.283978 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-72ce0138-1086-41b4-b3fd-3efc1f250da3 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:20.284494 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-72ce0138-1086-41b4-b3fd-3efc1f250da3 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:20.287890 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-72ce0138-1086-41b4-b3fd-3efc1f250da3 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:20.287890 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-72ce0138-1086-41b4-b3fd-3efc1f250da3 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:20.287890 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-72ce0138-1086-41b4-b3fd-3efc1f250da3 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:20.287890 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-72ce0138-1086-41b4-b3fd-3efc1f250da3 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:20.447399 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-72ce0138-1086-41b4-b3fd-3efc1f250da3 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86a8d114fbc4eb584934904d8f2ef56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126dad7acaf44f909302eac21c4aafcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:20.452925 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-72ce0138-1086-41b4-b3fd-3efc1f250da3 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] 10.222.0.20 "GET /compute/v2.1/servers/31110a13-e556-40c8-8d78-5243794ff095" status: 200 len: 1488 microversion: 2.1 time: 0.182057 Oct 04 18:28:20.453673 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 109/197] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:20 2022] GET /compute/v2.1/servers/31110a13-e556-40c8-8d78-5243794ff095 => generated 1488 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:20.478922 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d1a3a8df-a1af-4623-b807-82c73756c107 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:20.479639 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d1a3a8df-a1af-4623-b807-82c73756c107 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] [instance: 31110a13-e556-40c8-8d78-5243794ff095] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:20.492232 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d1a3a8df-a1af-4623-b807-82c73756c107 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:20.493318 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d1a3a8df-a1af-4623-b807-82c73756c107 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:20.498084 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d1a3a8df-a1af-4623-b807-82c73756c107 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:20.498998 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d1a3a8df-a1af-4623-b807-82c73756c107 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:20.499439 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d1a3a8df-a1af-4623-b807-82c73756c107 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:20.499877 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d1a3a8df-a1af-4623-b807-82c73756c107 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:20.512976 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-72ce0138-1086-41b4-b3fd-3efc1f250da3 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:20.514617 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-72ce0138-1086-41b4-b3fd-3efc1f250da3 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] 10.222.0.20 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001847 Oct 04 18:28:20.522903 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 110/198] 10.222.0.20 () {56 vars in 886 bytes} [Tue Oct 4 18:28:20 2022] GET /compute/ => generated 377 bytes in 11 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 04 18:28:20.532162 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-bb6df64e-25d4-46d5-8278-6327f0a36894 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:20.534690 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-bb6df64e-25d4-46d5-8278-6327f0a36894 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] [instance: 6da2d407-863f-4f6a-9d71-d81e96f160fb] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:20.542756 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bb6df64e-25d4-46d5-8278-6327f0a36894 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:20.543455 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bb6df64e-25d4-46d5-8278-6327f0a36894 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:20.544801 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bb6df64e-25d4-46d5-8278-6327f0a36894 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:20.546128 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bb6df64e-25d4-46d5-8278-6327f0a36894 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:20.546884 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bb6df64e-25d4-46d5-8278-6327f0a36894 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:20.548776 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bb6df64e-25d4-46d5-8278-6327f0a36894 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:20.885138 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-bb6df64e-25d4-46d5-8278-6327f0a36894 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f87d9eaf49545bb8effb170768bb8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e99a0400fe947bb8907857cc4de2899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:20.893141 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-bb6df64e-25d4-46d5-8278-6327f0a36894 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] 10.222.0.20 "GET /compute/v2.1/servers/6da2d407-863f-4f6a-9d71-d81e96f160fb" status: 200 len: 1341 microversion: 2.1 time: 0.365286 Oct 04 18:28:20.893871 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 111/199] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:20 2022] GET /compute/v2.1/servers/6da2d407-863f-4f6a-9d71-d81e96f160fb => generated 1341 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:28:21.008814 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9fd7bd09-89e8-4390-a75c-1d98340982cb tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:21.009497 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-9fd7bd09-89e8-4390-a75c-1d98340982cb tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] [instance: ff1c16fb-1167-4285-8d0c-c0fbb78a2883] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:21.015537 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9fd7bd09-89e8-4390-a75c-1d98340982cb tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:21.016080 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9fd7bd09-89e8-4390-a75c-1d98340982cb tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:21.016524 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9fd7bd09-89e8-4390-a75c-1d98340982cb tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:21.017251 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9fd7bd09-89e8-4390-a75c-1d98340982cb tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:21.017707 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9fd7bd09-89e8-4390-a75c-1d98340982cb tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:21.018131 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9fd7bd09-89e8-4390-a75c-1d98340982cb tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:21.145581 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9fd7bd09-89e8-4390-a75c-1d98340982cb tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8675d7d8bab840f3a221fdf2ee4c9b5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25214dec3ef24597be8e5acde61de3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:21.160025 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9fd7bd09-89e8-4390-a75c-1d98340982cb tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] 10.222.0.20 "GET /compute/v2.1/servers/ff1c16fb-1167-4285-8d0c-c0fbb78a2883" status: 200 len: 1334 microversion: 2.1 time: 0.155962 Oct 04 18:28:21.171793 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 112/200] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:21 2022] GET /compute/v2.1/servers/ff1c16fb-1167-4285-8d0c-c0fbb78a2883 => generated 1334 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:21.184379 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d1a3a8df-a1af-4623-b807-82c73756c107 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/31110a13-e556-40c8-8d78-5243794ff095" status: 200 len: 1641 microversion: 2.1 time: 0.711123 Oct 04 18:28:21.184965 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 89/201] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:20 2022] GET /compute/v2.1/servers/31110a13-e556-40c8-8d78-5243794ff095 => generated 1641 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:28:21.212655 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-753fd3ef-b3e6-4a2a-b810-19e5f3813a66 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:21.213629 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-753fd3ef-b3e6-4a2a-b810-19e5f3813a66 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] [instance: 31110a13-e556-40c8-8d78-5243794ff095] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:21.232029 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-753fd3ef-b3e6-4a2a-b810-19e5f3813a66 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:21.232029 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-753fd3ef-b3e6-4a2a-b810-19e5f3813a66 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:21.232029 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-753fd3ef-b3e6-4a2a-b810-19e5f3813a66 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:21.232029 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-753fd3ef-b3e6-4a2a-b810-19e5f3813a66 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:21.232412 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-753fd3ef-b3e6-4a2a-b810-19e5f3813a66 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:21.232412 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-753fd3ef-b3e6-4a2a-b810-19e5f3813a66 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:21.262330 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-753fd3ef-b3e6-4a2a-b810-19e5f3813a66 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] [instance: 31110a13-e556-40c8-8d78-5243794ff095] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:28:21.743047 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-753fd3ef-b3e6-4a2a-b810-19e5f3813a66 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] 10.222.0.20 "DELETE /compute/v2.1/servers/31110a13-e556-40c8-8d78-5243794ff095" status: 204 len: 0 microversion: 2.1 time: 0.535962 Oct 04 18:28:21.743928 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 113/202] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:28:21 2022] DELETE /compute/v2.1/servers/31110a13-e556-40c8-8d78-5243794ff095 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:28:21.753872 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-18c4b890-5027-49ff-b997-06de986edabb tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:21.754842 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-18c4b890-5027-49ff-b997-06de986edabb tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] [instance: 31110a13-e556-40c8-8d78-5243794ff095] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:21.766018 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-18c4b890-5027-49ff-b997-06de986edabb tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:21.766018 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-18c4b890-5027-49ff-b997-06de986edabb tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:21.766018 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-18c4b890-5027-49ff-b997-06de986edabb tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:21.768583 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-18c4b890-5027-49ff-b997-06de986edabb tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:21.770190 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-18c4b890-5027-49ff-b997-06de986edabb tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:21.770984 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-18c4b890-5027-49ff-b997-06de986edabb tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:21.918632 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b17c8b10-4135-45db-9ad7-1ad9834f53bf tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:21.919344 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b17c8b10-4135-45db-9ad7-1ad9834f53bf tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] [instance: 6da2d407-863f-4f6a-9d71-d81e96f160fb] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:21.932415 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b17c8b10-4135-45db-9ad7-1ad9834f53bf tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:21.933103 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b17c8b10-4135-45db-9ad7-1ad9834f53bf tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:21.933647 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b17c8b10-4135-45db-9ad7-1ad9834f53bf tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:21.934471 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b17c8b10-4135-45db-9ad7-1ad9834f53bf tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:21.935194 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b17c8b10-4135-45db-9ad7-1ad9834f53bf tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:21.935717 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b17c8b10-4135-45db-9ad7-1ad9834f53bf tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:22.272128 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-18c4b890-5027-49ff-b997-06de986edabb tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86a8d114fbc4eb584934904d8f2ef56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126dad7acaf44f909302eac21c4aafcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:22.283615 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-18c4b890-5027-49ff-b997-06de986edabb tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] 10.222.0.20 "GET /compute/v2.1/servers/31110a13-e556-40c8-8d78-5243794ff095" status: 200 len: 1494 microversion: 2.1 time: 0.534763 Oct 04 18:28:22.284226 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 90/203] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:21 2022] GET /compute/v2.1/servers/31110a13-e556-40c8-8d78-5243794ff095 => generated 1494 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:22.290967 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-93a85c1b-bb2f-4d29-bc25-71e5cc1c3bb7 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:22.291972 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-93a85c1b-bb2f-4d29-bc25-71e5cc1c3bb7 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] [instance: ff1c16fb-1167-4285-8d0c-c0fbb78a2883] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:22.310550 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-93a85c1b-bb2f-4d29-bc25-71e5cc1c3bb7 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:22.311131 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-93a85c1b-bb2f-4d29-bc25-71e5cc1c3bb7 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:22.311576 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-93a85c1b-bb2f-4d29-bc25-71e5cc1c3bb7 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:22.312376 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-93a85c1b-bb2f-4d29-bc25-71e5cc1c3bb7 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:22.313434 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-93a85c1b-bb2f-4d29-bc25-71e5cc1c3bb7 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:22.314024 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-93a85c1b-bb2f-4d29-bc25-71e5cc1c3bb7 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:22.368784 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b17c8b10-4135-45db-9ad7-1ad9834f53bf tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f87d9eaf49545bb8effb170768bb8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e99a0400fe947bb8907857cc4de2899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:22.379016 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b17c8b10-4135-45db-9ad7-1ad9834f53bf tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] 10.222.0.20 "GET /compute/v2.1/servers/6da2d407-863f-4f6a-9d71-d81e96f160fb" status: 200 len: 1491 microversion: 2.1 time: 0.467340 Oct 04 18:28:22.380907 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 114/204] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:21 2022] GET /compute/v2.1/servers/6da2d407-863f-4f6a-9d71-d81e96f160fb => generated 1491 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:28:22.709450 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-93a85c1b-bb2f-4d29-bc25-71e5cc1c3bb7 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8675d7d8bab840f3a221fdf2ee4c9b5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25214dec3ef24597be8e5acde61de3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:22.723958 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-93a85c1b-bb2f-4d29-bc25-71e5cc1c3bb7 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] 10.222.0.20 "GET /compute/v2.1/servers/ff1c16fb-1167-4285-8d0c-c0fbb78a2883" status: 200 len: 1390 microversion: 2.1 time: 0.438458 Oct 04 18:28:22.740087 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 91/205] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:22 2022] GET /compute/v2.1/servers/ff1c16fb-1167-4285-8d0c-c0fbb78a2883 => generated 1390 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:22.844749 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3511caf6-0c8b-4dea-a16b-251d4d08cb54 tempest-DeleteServersAdminTestJSON-1422669194 tempest-DeleteServersAdminTestJSON-1422669194-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:22.845409 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3511caf6-0c8b-4dea-a16b-251d4d08cb54 tempest-DeleteServersAdminTestJSON-1422669194 tempest-DeleteServersAdminTestJSON-1422669194-project-admin] [instance: 6da2d407-863f-4f6a-9d71-d81e96f160fb] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:22.854322 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3511caf6-0c8b-4dea-a16b-251d4d08cb54 tempest-DeleteServersAdminTestJSON-1422669194 tempest-DeleteServersAdminTestJSON-1422669194-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:22.855074 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3511caf6-0c8b-4dea-a16b-251d4d08cb54 tempest-DeleteServersAdminTestJSON-1422669194 tempest-DeleteServersAdminTestJSON-1422669194-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:22.856714 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3511caf6-0c8b-4dea-a16b-251d4d08cb54 tempest-DeleteServersAdminTestJSON-1422669194 tempest-DeleteServersAdminTestJSON-1422669194-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:22.857836 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3511caf6-0c8b-4dea-a16b-251d4d08cb54 tempest-DeleteServersAdminTestJSON-1422669194 tempest-DeleteServersAdminTestJSON-1422669194-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:22.858565 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3511caf6-0c8b-4dea-a16b-251d4d08cb54 tempest-DeleteServersAdminTestJSON-1422669194 tempest-DeleteServersAdminTestJSON-1422669194-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:22.859236 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3511caf6-0c8b-4dea-a16b-251d4d08cb54 tempest-DeleteServersAdminTestJSON-1422669194 tempest-DeleteServersAdminTestJSON-1422669194-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:22.946841 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:28:22.951958 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3511caf6-0c8b-4dea-a16b-251d4d08cb54 tempest-DeleteServersAdminTestJSON-1422669194 tempest-DeleteServersAdminTestJSON-1422669194-project-admin] [instance: 6da2d407-863f-4f6a-9d71-d81e96f160fb] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:28:23.308247 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3a41f1e0-51e9-4d9b-a54d-17a6c2c27eb0 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:23.308914 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3a41f1e0-51e9-4d9b-a54d-17a6c2c27eb0 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] [instance: 31110a13-e556-40c8-8d78-5243794ff095] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:23.315669 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3a41f1e0-51e9-4d9b-a54d-17a6c2c27eb0 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:23.316177 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3a41f1e0-51e9-4d9b-a54d-17a6c2c27eb0 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:23.316607 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3a41f1e0-51e9-4d9b-a54d-17a6c2c27eb0 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:23.317300 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3a41f1e0-51e9-4d9b-a54d-17a6c2c27eb0 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:23.317769 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3a41f1e0-51e9-4d9b-a54d-17a6c2c27eb0 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:23.318209 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3a41f1e0-51e9-4d9b-a54d-17a6c2c27eb0 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:23.496868 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3511caf6-0c8b-4dea-a16b-251d4d08cb54 tempest-DeleteServersAdminTestJSON-1422669194 tempest-DeleteServersAdminTestJSON-1422669194-project-admin] 10.222.0.20 "DELETE /compute/v2.1/servers/6da2d407-863f-4f6a-9d71-d81e96f160fb" status: 204 len: 0 microversion: 2.1 time: 1.096366 Oct 04 18:28:23.498432 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 115/206] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:28:22 2022] DELETE /compute/v2.1/servers/6da2d407-863f-4f6a-9d71-d81e96f160fb => generated 0 bytes in 1099 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:28:23.509192 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2664d0a9-f59b-4da6-9376-fa907995a185 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:23.510749 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2664d0a9-f59b-4da6-9376-fa907995a185 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] [instance: 6da2d407-863f-4f6a-9d71-d81e96f160fb] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:23.521123 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3a41f1e0-51e9-4d9b-a54d-17a6c2c27eb0 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86a8d114fbc4eb584934904d8f2ef56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126dad7acaf44f909302eac21c4aafcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:23.525952 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2664d0a9-f59b-4da6-9376-fa907995a185 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:23.526759 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2664d0a9-f59b-4da6-9376-fa907995a185 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:23.529449 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2664d0a9-f59b-4da6-9376-fa907995a185 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:23.530639 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2664d0a9-f59b-4da6-9376-fa907995a185 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:23.543105 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2664d0a9-f59b-4da6-9376-fa907995a185 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:23.543105 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2664d0a9-f59b-4da6-9376-fa907995a185 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:23.543401 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3a41f1e0-51e9-4d9b-a54d-17a6c2c27eb0 tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] 10.222.0.20 "GET /compute/v2.1/servers/31110a13-e556-40c8-8d78-5243794ff095" status: 200 len: 1494 microversion: 2.1 time: 0.228054 Oct 04 18:28:23.543401 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 92/207] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:23 2022] GET /compute/v2.1/servers/31110a13-e556-40c8-8d78-5243794ff095 => generated 1494 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:28:23.719613 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-2664d0a9-f59b-4da6-9376-fa907995a185 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f87d9eaf49545bb8effb170768bb8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e99a0400fe947bb8907857cc4de2899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:23.733262 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2664d0a9-f59b-4da6-9376-fa907995a185 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] 10.222.0.20 "GET /compute/v2.1/servers/6da2d407-863f-4f6a-9d71-d81e96f160fb" status: 200 len: 1497 microversion: 2.1 time: 0.230156 Oct 04 18:28:23.734185 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 116/208] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:23 2022] GET /compute/v2.1/servers/6da2d407-863f-4f6a-9d71-d81e96f160fb => generated 1497 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:23.755041 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-89841e56-e6e9-4eed-ad87-b4d8226610b9 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:23.755656 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-89841e56-e6e9-4eed-ad87-b4d8226610b9 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] [instance: ff1c16fb-1167-4285-8d0c-c0fbb78a2883] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:23.768119 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-89841e56-e6e9-4eed-ad87-b4d8226610b9 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:23.769608 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-89841e56-e6e9-4eed-ad87-b4d8226610b9 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:23.770249 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-89841e56-e6e9-4eed-ad87-b4d8226610b9 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:23.771275 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-89841e56-e6e9-4eed-ad87-b4d8226610b9 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:23.771895 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-89841e56-e6e9-4eed-ad87-b4d8226610b9 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:23.772693 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-89841e56-e6e9-4eed-ad87-b4d8226610b9 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:23.967373 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-89841e56-e6e9-4eed-ad87-b4d8226610b9 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8675d7d8bab840f3a221fdf2ee4c9b5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25214dec3ef24597be8e5acde61de3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:23.987048 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-89841e56-e6e9-4eed-ad87-b4d8226610b9 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] 10.222.0.20 "GET /compute/v2.1/servers/ff1c16fb-1167-4285-8d0c-c0fbb78a2883" status: 200 len: 1390 microversion: 2.1 time: 0.238372 Oct 04 18:28:23.990381 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 93/209] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:23 2022] GET /compute/v2.1/servers/ff1c16fb-1167-4285-8d0c-c0fbb78a2883 => generated 1390 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:24.351453 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-4b7f52b5-f1f9-4576-9fd9-bafe49164d61 req-8f6b44e7-8d0e-45b6-82eb-d66cdb5ccf83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31110a13-e556-40c8-8d78-5243794ff095", "name": "network-vif-deleted", "tag": "a42dbecd-d6e2-4ab5-b9b2-a4bb5001da71"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:24.363506 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-4b7f52b5-f1f9-4576-9fd9-bafe49164d61 req-8f6b44e7-8d0e-45b6-82eb-d66cdb5ccf83 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:24.364278 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-4b7f52b5-f1f9-4576-9fd9-bafe49164d61 req-8f6b44e7-8d0e-45b6-82eb-d66cdb5ccf83 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:24.364902 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-4b7f52b5-f1f9-4576-9fd9-bafe49164d61 req-8f6b44e7-8d0e-45b6-82eb-d66cdb5ccf83 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:24.384083 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-4b7f52b5-f1f9-4576-9fd9-bafe49164d61 req-8f6b44e7-8d0e-45b6-82eb-d66cdb5ccf83 service nova] Creating event network-vif-deleted:a42dbecd-d6e2-4ab5-b9b2-a4bb5001da71 for instance 31110a13-e556-40c8-8d78-5243794ff095 on n-h1-850501-14 Oct 04 18:28:24.391938 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-4b7f52b5-f1f9-4576-9fd9-bafe49164d61 req-8f6b44e7-8d0e-45b6-82eb-d66cdb5ccf83 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044165 Oct 04 18:28:24.392824 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 117/210] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:28:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:28:24.580474 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e4b0d355-952b-42eb-b24a-461cbeaff05b tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:24.586215 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e4b0d355-952b-42eb-b24a-461cbeaff05b tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] [instance: 31110a13-e556-40c8-8d78-5243794ff095] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:24.597099 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e4b0d355-952b-42eb-b24a-461cbeaff05b tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:24.599247 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e4b0d355-952b-42eb-b24a-461cbeaff05b tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:24.602941 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e4b0d355-952b-42eb-b24a-461cbeaff05b tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:24.602941 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e4b0d355-952b-42eb-b24a-461cbeaff05b tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:24.602941 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e4b0d355-952b-42eb-b24a-461cbeaff05b tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:24.602941 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e4b0d355-952b-42eb-b24a-461cbeaff05b tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:24.765033 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-85251fa1-e0c0-46ea-b62b-20e5b32a1f53 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:24.765895 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-85251fa1-e0c0-46ea-b62b-20e5b32a1f53 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] [instance: 6da2d407-863f-4f6a-9d71-d81e96f160fb] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:24.782644 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-85251fa1-e0c0-46ea-b62b-20e5b32a1f53 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:24.783594 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-85251fa1-e0c0-46ea-b62b-20e5b32a1f53 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:24.784518 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-85251fa1-e0c0-46ea-b62b-20e5b32a1f53 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:24.786000 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-85251fa1-e0c0-46ea-b62b-20e5b32a1f53 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:24.786874 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-85251fa1-e0c0-46ea-b62b-20e5b32a1f53 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:24.787537 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-85251fa1-e0c0-46ea-b62b-20e5b32a1f53 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:25.128896 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e4b0d355-952b-42eb-b24a-461cbeaff05b tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86a8d114fbc4eb584934904d8f2ef56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126dad7acaf44f909302eac21c4aafcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:25.139384 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e4b0d355-952b-42eb-b24a-461cbeaff05b tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] 10.222.0.20 "GET /compute/v2.1/servers/31110a13-e556-40c8-8d78-5243794ff095" status: 200 len: 1452 microversion: 2.1 time: 0.576349 Oct 04 18:28:25.163143 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 94/211] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:24 2022] GET /compute/v2.1/servers/31110a13-e556-40c8-8d78-5243794ff095 => generated 1452 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:25.182039 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-58fb3662-4a88-47be-90b9-d18665abce65 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:25.182039 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-58fb3662-4a88-47be-90b9-d18665abce65 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] [instance: ff1c16fb-1167-4285-8d0c-c0fbb78a2883] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:25.200219 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-58fb3662-4a88-47be-90b9-d18665abce65 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:25.200822 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-58fb3662-4a88-47be-90b9-d18665abce65 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:25.201373 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-58fb3662-4a88-47be-90b9-d18665abce65 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:25.202308 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-58fb3662-4a88-47be-90b9-d18665abce65 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:25.202778 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-58fb3662-4a88-47be-90b9-d18665abce65 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:25.203299 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-58fb3662-4a88-47be-90b9-d18665abce65 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:25.487495 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-85251fa1-e0c0-46ea-b62b-20e5b32a1f53 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f87d9eaf49545bb8effb170768bb8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e99a0400fe947bb8907857cc4de2899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:25.496821 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-85251fa1-e0c0-46ea-b62b-20e5b32a1f53 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] 10.222.0.20 "GET /compute/v2.1/servers/6da2d407-863f-4f6a-9d71-d81e96f160fb" status: 200 len: 1497 microversion: 2.1 time: 0.741784 Oct 04 18:28:25.509527 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 118/212] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:24 2022] GET /compute/v2.1/servers/6da2d407-863f-4f6a-9d71-d81e96f160fb => generated 1497 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:25.558235 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-58fb3662-4a88-47be-90b9-d18665abce65 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8675d7d8bab840f3a221fdf2ee4c9b5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25214dec3ef24597be8e5acde61de3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:25.576638 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-58fb3662-4a88-47be-90b9-d18665abce65 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] 10.222.0.20 "GET /compute/v2.1/servers/ff1c16fb-1167-4285-8d0c-c0fbb78a2883" status: 200 len: 1390 microversion: 2.1 time: 0.411507 Oct 04 18:28:25.594848 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 95/213] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:25 2022] GET /compute/v2.1/servers/ff1c16fb-1167-4285-8d0c-c0fbb78a2883 => generated 1390 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:26.180883 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-db536d29-372b-43a4-8dd5-c73eb4923d9e tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:26.184304 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-db536d29-372b-43a4-8dd5-c73eb4923d9e tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] [instance: 31110a13-e556-40c8-8d78-5243794ff095] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:26.198265 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8c32af23-031a-43e2-a9fb-a9a8e539f9c4 tempest-QuotasAdminNegativeTest-76304858 tempest-QuotasAdminNegativeTest-76304858-project-admin] Calling method '.version_select at 0x7fe259ba70d0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:26.209806 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-db536d29-372b-43a4-8dd5-c73eb4923d9e tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:26.210308 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-db536d29-372b-43a4-8dd5-c73eb4923d9e tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:26.210742 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-db536d29-372b-43a4-8dd5-c73eb4923d9e tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:26.213740 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-db536d29-372b-43a4-8dd5-c73eb4923d9e tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:26.213962 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-db536d29-372b-43a4-8dd5-c73eb4923d9e tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:26.214392 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-db536d29-372b-43a4-8dd5-c73eb4923d9e tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:26.222916 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=100 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:28:26.236889 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-db536d29-372b-43a4-8dd5-c73eb4923d9e tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] HTTP exception thrown: Instance 31110a13-e556-40c8-8d78-5243794ff095 could not be found. Oct 04 18:28:26.242063 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-db536d29-372b-43a4-8dd5-c73eb4923d9e tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Request method failure captured: Oct 04 18:28:26.242063 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/31110a13-e556-40c8-8d78-5243794ff095 HTTP/1.1 Oct 04 18:28:26.242063 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:28:26.242063 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:28:26.242063 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:28:26.242063 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:28:26.242063 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:28:26.242063 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:28:26.242063 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:28:26.242063 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:28:26.242063 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPHsgVJDqxxp4glyHgr5PdPkHYojrGsp7WPEuiQVyVjZZ0FfcS0XijguTGCYQoFbrsIuTR7h6UJ1zdYpeTrYWC-E9Q3Th8SWNtIQhS9n2qLubF2zIuchUY33Y0SXsUUfqVlmPm7KYJ0f_CLFfDYUAE0B2v6kiZl_So4IuDbYudYCovrc Oct 04 18:28:26.242063 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:28:26.242063 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:28:26.242063 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:28:26.242063 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:28:26.242063 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:28:26.242063 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:28:26.242063 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 126dad7acaf44f909302eac21c4aafcb Oct 04 18:28:26.242063 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-AggregatesAdminTestJSON-1929223191 Oct 04 18:28:26.242063 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:28:26.242063 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:28:26.244191 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/126dad7acaf44f909302eac21c4aafcb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_126dad7acaf44f909302eac21c4aafcb", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/126dad7acaf44f909302eac21c4aafcb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/126dad7acaf44f909302eac21c4aafcb"}]}] Oct 04 18:28:26.244191 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-AggregatesAdminTestJSON-1929223191 Oct 04 18:28:26.244191 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 126dad7acaf44f909302eac21c4aafcb Oct 04 18:28:26.244191 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1929223191 Oct 04 18:28:26.244191 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-AggregatesAdminTestJSON-1929223191-project Oct 04 18:28:26.244191 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:28:26.244191 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:28:26.244191 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: f86a8d114fbc4eb584934904d8f2ef56 Oct 04 18:28:26.244191 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-AggregatesAdminTestJSON-1929223191-project Oct 04 18:28:26.244191 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:28:26.244191 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 31110a13-e556-40c8-8d78-5243794ff095 could not be found. Oct 04 18:28:26.244191 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '31110a13-e556-40c8-8d78-5243794ff095'} Oct 04 18:28:26.244884 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:28:26.244884 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:26.244884 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:28:26.244884 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:28:26.244884 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:28:26.244884 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:28:26.244884 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:28:26.244884 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:28:26.244884 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:28:26.244884 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:28:26.244884 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31110a13-e556-40c8-8d78-5243794ff095 could not be found. Oct 04 18:28:26.244884 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:26.244884 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:26.244884 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:26.244884 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:26.244884 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:26.244884 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:26.244884 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:28:26.244884 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:28:26.244884 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:28:26.245917 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:28:26.245917 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:28:26.245917 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:28:26.245917 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:28:26.245917 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:28:26.245917 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:28:26.245917 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:28:26.245917 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31110a13-e556-40c8-8d78-5243794ff095 could not be found. Oct 04 18:28:26.245917 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:26.245917 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:26.245917 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:26.245917 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:26.245917 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:26.245917 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:26.245917 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:28:26.245917 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:28:26.245917 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31110a13-e556-40c8-8d78-5243794ff095 could not be found. Oct 04 18:28:26.245917 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:26.249338 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-db536d29-372b-43a4-8dd5-c73eb4923d9e tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Returning 404 to user: Instance 31110a13-e556-40c8-8d78-5243794ff095 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:28:26.250738 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-db536d29-372b-43a4-8dd5-c73eb4923d9e tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] 10.222.0.20 "GET /compute/v2.1/servers/31110a13-e556-40c8-8d78-5243794ff095" status: 404 len: 111 microversion: 2.1 time: 0.075648 Oct 04 18:28:26.251752 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 96/214] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:26 2022] GET /compute/v2.1/servers/31110a13-e556-40c8-8d78-5243794ff095 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:28:26.260189 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-cf6b897a-d12d-453b-8342-0709f053046d tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-850501-14"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:26.270984 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cf6b897a-d12d-453b-8342-0709f053046d tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:26.271470 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cf6b897a-d12d-453b-8342-0709f053046d tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:26.271893 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cf6b897a-d12d-453b-8342-0709f053046d tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:26.604534 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-cf6b897a-d12d-453b-8342-0709f053046d tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 299 microversion: 2.1 time: 0.348014 Oct 04 18:28:26.613461 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 97/215] 10.222.0.20 () {60 vars in 1191 bytes} [Tue Oct 4 18:28:26 2022] POST /compute/v2.1/os-aggregates/2/action => generated 299 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:28:26.622074 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-121bd497-2606-4fcf-9d3b-95eec429318b req-d33ef41c-acde-4539-8b2a-abe3cc3288ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6da2d407-863f-4f6a-9d71-d81e96f160fb", "name": "network-vif-deleted", "tag": "f94fc47a-1b3f-41f3-85fc-e4179bc59d55"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:26.637149 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-121bd497-2606-4fcf-9d3b-95eec429318b req-d33ef41c-acde-4539-8b2a-abe3cc3288ee service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:26.637587 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-121bd497-2606-4fcf-9d3b-95eec429318b req-d33ef41c-acde-4539-8b2a-abe3cc3288ee service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:26.638478 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-121bd497-2606-4fcf-9d3b-95eec429318b req-d33ef41c-acde-4539-8b2a-abe3cc3288ee service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:26.665544 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-121bd497-2606-4fcf-9d3b-95eec429318b req-d33ef41c-acde-4539-8b2a-abe3cc3288ee service nova] Creating event network-vif-deleted:f94fc47a-1b3f-41f3-85fc-e4179bc59d55 for instance 6da2d407-863f-4f6a-9d71-d81e96f160fb on n-h1-850501-14 Oct 04 18:28:26.672292 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-121bd497-2606-4fcf-9d3b-95eec429318b req-d33ef41c-acde-4539-8b2a-abe3cc3288ee service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056596 Oct 04 18:28:26.677407 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 98/216] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:28:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:28:26.685295 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-38bd5691-1e39-4cb1-8837-916769e59dd5 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:26.694327 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-38bd5691-1e39-4cb1-8837-916769e59dd5 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] [instance: 6da2d407-863f-4f6a-9d71-d81e96f160fb] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:26.701223 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8c32af23-031a-43e2-a9fb-a9a8e539f9c4 tempest-QuotasAdminNegativeTest-76304858 tempest-QuotasAdminNegativeTest-76304858-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/e74fd308b33b4e9a8fc4a4635320a05d" status: 200 len: 371 microversion: 2.1 time: 1.190152 Oct 04 18:28:26.701827 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 119/217] 10.222.0.20 () {58 vars in 1242 bytes} [Tue Oct 4 18:28:25 2022] GET /compute/v2.1/os-quota-sets/e74fd308b33b4e9a8fc4a4635320a05d => generated 371 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:28:26.701976 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-38bd5691-1e39-4cb1-8837-916769e59dd5 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:26.702669 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-38bd5691-1e39-4cb1-8837-916769e59dd5 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:26.703889 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-38bd5691-1e39-4cb1-8837-916769e59dd5 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:26.705780 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-38bd5691-1e39-4cb1-8837-916769e59dd5 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:26.707379 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-38bd5691-1e39-4cb1-8837-916769e59dd5 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:26.708184 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-38bd5691-1e39-4cb1-8837-916769e59dd5 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:26.773705 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-38bd5691-1e39-4cb1-8837-916769e59dd5 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:26.773705 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-38bd5691-1e39-4cb1-8837-916769e59dd5 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:26.773705 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-38bd5691-1e39-4cb1-8837-916769e59dd5 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:26.773705 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-38bd5691-1e39-4cb1-8837-916769e59dd5 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lazy-loading 'fault' on Instance uuid 6da2d407-863f-4f6a-9d71-d81e96f160fb {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:28:26.799918 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-539b8a6f-d6c0-4606-a216-4e394d71809c req-655a667c-d29d-4014-82c6-413eb2b3c218 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff1c16fb-1167-4285-8d0c-c0fbb78a2883", "tag": "afa1da21-3240-4ddb-b1d7-ec031e238dee"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:26.819977 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-539b8a6f-d6c0-4606-a216-4e394d71809c req-655a667c-d29d-4014-82c6-413eb2b3c218 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:26.821565 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-539b8a6f-d6c0-4606-a216-4e394d71809c req-655a667c-d29d-4014-82c6-413eb2b3c218 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:26.822005 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-539b8a6f-d6c0-4606-a216-4e394d71809c req-655a667c-d29d-4014-82c6-413eb2b3c218 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:26.837590 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-539b8a6f-d6c0-4606-a216-4e394d71809c req-655a667c-d29d-4014-82c6-413eb2b3c218 service nova] Creating event network-changed:afa1da21-3240-4ddb-b1d7-ec031e238dee for instance ff1c16fb-1167-4285-8d0c-c0fbb78a2883 on n-h2-850501-14 Oct 04 18:28:26.845044 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-539b8a6f-d6c0-4606-a216-4e394d71809c req-655a667c-d29d-4014-82c6-413eb2b3c218 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141928 Oct 04 18:28:26.846332 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 120/218] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:28:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:28:26.853557 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d87766f4-0bdd-4860-a97c-e7f36fed5b3e tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:26.979121 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d87766f4-0bdd-4860-a97c-e7f36fed5b3e tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.130723 Oct 04 18:28:26.989650 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 121/219] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Oct 4 18:28:26 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 18:28:26.999955 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-329dff50-5974-40ef-9f19-bb4dea0bf98c tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:27.001321 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-329dff50-5974-40ef-9f19-bb4dea0bf98c tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] [instance: ff1c16fb-1167-4285-8d0c-c0fbb78a2883] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:27.005721 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-38bd5691-1e39-4cb1-8837-916769e59dd5 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f87d9eaf49545bb8effb170768bb8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e99a0400fe947bb8907857cc4de2899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:27.012303 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-329dff50-5974-40ef-9f19-bb4dea0bf98c tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:27.012802 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-329dff50-5974-40ef-9f19-bb4dea0bf98c tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:27.013239 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-329dff50-5974-40ef-9f19-bb4dea0bf98c tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:27.014264 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-329dff50-5974-40ef-9f19-bb4dea0bf98c tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:27.014720 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-329dff50-5974-40ef-9f19-bb4dea0bf98c tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:27.015308 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-329dff50-5974-40ef-9f19-bb4dea0bf98c tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:27.015885 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-38bd5691-1e39-4cb1-8837-916769e59dd5 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] 10.222.0.20 "GET /compute/v2.1/servers/6da2d407-863f-4f6a-9d71-d81e96f160fb" status: 200 len: 1309 microversion: 2.1 time: 0.336770 Oct 04 18:28:27.016501 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 99/220] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:26 2022] GET /compute/v2.1/servers/6da2d407-863f-4f6a-9d71-d81e96f160fb => generated 1309 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:27.319546 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-329dff50-5974-40ef-9f19-bb4dea0bf98c tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8675d7d8bab840f3a221fdf2ee4c9b5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25214dec3ef24597be8e5acde61de3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:27.327864 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-329dff50-5974-40ef-9f19-bb4dea0bf98c tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] 10.222.0.20 "GET /compute/v2.1/servers/ff1c16fb-1167-4285-8d0c-c0fbb78a2883" status: 200 len: 1390 microversion: 2.1 time: 0.334734 Oct 04 18:28:27.343886 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 122/221] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:26 2022] GET /compute/v2.1/servers/ff1c16fb-1167-4285-8d0c-c0fbb78a2883 => generated 1390 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:27.348549 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-61b2836f-d080-4829-8513-03f1795bb01d tempest-QuotasAdminNegativeTest-76304858 tempest-QuotasAdminNegativeTest-76304858-project-admin] Action: 'update', calling method: .version_select at 0x7fe259ac81f0>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:27.396387 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8d80ba55-c9c9-4833-8e24-247c78f8530d tempest-QuotasAdminTestV236-1813444335 tempest-QuotasAdminTestV236-1813444335-project-admin] Action: 'update', calling method: .version_select at 0x7fe2598d2700>, body: {"quota_set": {"ram": "5120"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:27.457089 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:28:27.498423 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=1,nova_api:DELETE=4,nova_api:UPDATE=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:28:27.506027 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-61b2836f-d080-4829-8513-03f1795bb01d tempest-QuotasAdminNegativeTest-76304858 tempest-QuotasAdminNegativeTest-76304858-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:27.506502 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-61b2836f-d080-4829-8513-03f1795bb01d tempest-QuotasAdminNegativeTest-76304858 tempest-QuotasAdminNegativeTest-76304858-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:27.506936 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-61b2836f-d080-4829-8513-03f1795bb01d tempest-QuotasAdminNegativeTest-76304858 tempest-QuotasAdminNegativeTest-76304858-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:27.507669 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-61b2836f-d080-4829-8513-03f1795bb01d tempest-QuotasAdminNegativeTest-76304858 tempest-QuotasAdminNegativeTest-76304858-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:27.508149 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-61b2836f-d080-4829-8513-03f1795bb01d tempest-QuotasAdminNegativeTest-76304858 tempest-QuotasAdminNegativeTest-76304858-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:27.508569 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-61b2836f-d080-4829-8513-03f1795bb01d tempest-QuotasAdminNegativeTest-76304858 tempest-QuotasAdminNegativeTest-76304858-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:27.612994 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8d80ba55-c9c9-4833-8e24-247c78f8530d tempest-QuotasAdminTestV236-1813444335 tempest-QuotasAdminTestV236-1813444335-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:27.613501 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8d80ba55-c9c9-4833-8e24-247c78f8530d tempest-QuotasAdminTestV236-1813444335 tempest-QuotasAdminTestV236-1813444335-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:27.613942 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8d80ba55-c9c9-4833-8e24-247c78f8530d tempest-QuotasAdminTestV236-1813444335 tempest-QuotasAdminTestV236-1813444335-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:27.614721 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8d80ba55-c9c9-4833-8e24-247c78f8530d tempest-QuotasAdminTestV236-1813444335 tempest-QuotasAdminTestV236-1813444335-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:27.615178 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8d80ba55-c9c9-4833-8e24-247c78f8530d tempest-QuotasAdminTestV236-1813444335 tempest-QuotasAdminTestV236-1813444335-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:27.615608 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8d80ba55-c9c9-4833-8e24-247c78f8530d tempest-QuotasAdminTestV236-1813444335 tempest-QuotasAdminTestV236-1813444335-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:27.635907 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-61b2836f-d080-4829-8513-03f1795bb01d tempest-QuotasAdminNegativeTest-76304858 tempest-QuotasAdminNegativeTest-76304858-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/e74fd308b33b4e9a8fc4a4635320a05d" status: 200 len: 328 microversion: 2.1 time: 0.301324 Oct 04 18:28:27.646212 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 123/222] 10.222.0.20 () {60 vars in 1262 bytes} [Tue Oct 4 18:28:27 2022] PUT /compute/v2.1/os-quota-sets/e74fd308b33b4e9a8fc4a4635320a05d => generated 328 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:28:27.646212 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9083241c-29d9-47f7-94d3-3550a3ee9c34 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2142799035"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:27.646212 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.aggregate [None req-9083241c-29d9-47f7-94d3-3550a3ee9c34 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Generated uuid 54b63b70-c0cf-4d35-a866-4fc10a31cd6b for aggregate {{(pid=123001) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 18:28:27.784907 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:DELETE=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:28:27.786937 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9083241c-29d9-47f7-94d3-3550a3ee9c34 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.149302 Oct 04 18:28:27.789916 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 124/223] 10.222.0.20 () {60 vars in 1164 bytes} [Tue Oct 4 18:28:27 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:28:27.798582 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8d80ba55-c9c9-4833-8e24-247c78f8530d tempest-QuotasAdminTestV236-1813444335 tempest-QuotasAdminTestV236-1813444335-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/40a9f11ff7c246fc88701cadc2ab6d80" status: 200 len: 240 microversion: 2.36 time: 0.780387 Oct 04 18:28:27.799688 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 100/224] 10.222.0.20 () {62 vars in 1303 bytes} [Tue Oct 4 18:28:27 2022] PUT /compute/v2.1/os-quota-sets/40a9f11ff7c246fc88701cadc2ab6d80 => generated 240 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:28:28.033295 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-904d21bc-378f-4947-bfc9-8702dc82d32c tempest-InstanceUsageAuditLogTestJSON-1231515965 tempest-InstanceUsageAuditLogTestJSON-1231515965-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:28.033813 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a9e7e4b6-978b-4df9-8124-9c45e4f41e58 tempest-QuotasAdminNegativeTest-1520574321 tempest-QuotasAdminNegativeTest-1520574321-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1914973511", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:28.058874 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-904d21bc-378f-4947-bfc9-8702dc82d32c tempest-InstanceUsageAuditLogTestJSON-1231515965 tempest-InstanceUsageAuditLogTestJSON-1231515965-project-admin] 10.222.0.20 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-04 18:28:27" status: 200 len: 318 microversion: 2.1 time: 0.269566 Oct 04 18:28:28.064479 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 125/225] 10.222.0.20 () {58 vars in 1251 bytes} [Tue Oct 4 18:28:27 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-04%2018%3A28%3A27 => generated 318 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:28:28.064479 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-40cbb335-7852-4517-b325-e448d85ab804 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-850501-14"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:28.076779 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-40cbb335-7852-4517-b325-e448d85ab804 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:28.077274 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-40cbb335-7852-4517-b325-e448d85ab804 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:28.077708 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-40cbb335-7852-4517-b325-e448d85ab804 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:28.093904 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-a9e7e4b6-978b-4df9-8124-9c45e4f41e58 tempest-QuotasAdminNegativeTest-1520574321 tempest-QuotasAdminNegativeTest-1520574321-project] validate_networks() for None {{(pid=123002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:28:28.305991 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-a9e7e4b6-978b-4df9-8124-9c45e4f41e58 tempest-QuotasAdminNegativeTest-1520574321 tempest-QuotasAdminNegativeTest-1520574321-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:28:28.306405 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-a9e7e4b6-978b-4df9-8124-9c45e4f41e58 tempest-QuotasAdminNegativeTest-1520574321 tempest-QuotasAdminNegativeTest-1520574321-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:28:28.306872 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-a9e7e4b6-978b-4df9-8124-9c45e4f41e58 tempest-QuotasAdminNegativeTest-1520574321 tempest-QuotasAdminNegativeTest-1520574321-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:28:28.307271 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-a9e7e4b6-978b-4df9-8124-9c45e4f41e58 tempest-QuotasAdminNegativeTest-1520574321 tempest-QuotasAdminNegativeTest-1520574321-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:28:28.307700 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-a9e7e4b6-978b-4df9-8124-9c45e4f41e58 tempest-QuotasAdminNegativeTest-1520574321 tempest-QuotasAdminNegativeTest-1520574321-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:28:28.316515 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a9e7e4b6-978b-4df9-8124-9c45e4f41e58 tempest-QuotasAdminNegativeTest-1520574321 tempest-QuotasAdminNegativeTest-1520574321-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:28.316986 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a9e7e4b6-978b-4df9-8124-9c45e4f41e58 tempest-QuotasAdminNegativeTest-1520574321 tempest-QuotasAdminNegativeTest-1520574321-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:28.317521 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a9e7e4b6-978b-4df9-8124-9c45e4f41e58 tempest-QuotasAdminNegativeTest-1520574321 tempest-QuotasAdminNegativeTest-1520574321-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:28.318179 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a9e7e4b6-978b-4df9-8124-9c45e4f41e58 tempest-QuotasAdminNegativeTest-1520574321 tempest-QuotasAdminNegativeTest-1520574321-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:28.318757 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a9e7e4b6-978b-4df9-8124-9c45e4f41e58 tempest-QuotasAdminNegativeTest-1520574321 tempest-QuotasAdminNegativeTest-1520574321-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:28.319164 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a9e7e4b6-978b-4df9-8124-9c45e4f41e58 tempest-QuotasAdminNegativeTest-1520574321 tempest-QuotasAdminNegativeTest-1520574321-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:28.337329 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-a9e7e4b6-978b-4df9-8124-9c45e4f41e58 tempest-QuotasAdminNegativeTest-1520574321 tempest-QuotasAdminNegativeTest-1520574321-project] Getting quotas for project e74fd308b33b4e9a8fc4a4635320a05d. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:28:28.341246 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-a9e7e4b6-978b-4df9-8124-9c45e4f41e58 tempest-QuotasAdminNegativeTest-1520574321 tempest-QuotasAdminNegativeTest-1520574321-project] Getting quotas for user 8dc1baf76c4a40faa0b260da2310c73b and project e74fd308b33b4e9a8fc4a4635320a05d. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:28:28.352186 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.utils [None req-a9e7e4b6-978b-4df9-8124-9c45e4f41e58 tempest-QuotasAdminNegativeTest-1520574321 tempest-QuotasAdminNegativeTest-1520574321-project] cores quota exceeded for e74fd308b33b4e9a8fc4a4635320a05d, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=123002) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 04 18:28:28.352862 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-a9e7e4b6-978b-4df9-8124-9c45e4f41e58 tempest-QuotasAdminNegativeTest-1520574321 tempest-QuotasAdminNegativeTest-1520574321-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 04 18:28:28.356431 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a9e7e4b6-978b-4df9-8124-9c45e4f41e58 tempest-QuotasAdminNegativeTest-1520574321 tempest-QuotasAdminNegativeTest-1520574321-project] Request method failure captured: Oct 04 18:28:28.356431 n-d-850501-14 devstack@n-api.service[123002]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:28:28.356431 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:28:28.356431 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:28:28.356431 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:28:28.356431 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 145 Oct 04 18:28:28.356431 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:28:28.356431 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:28:28.356431 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:28:28.356431 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:28:28.356431 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPHtGsvGTFmwxKKJo-VRINCgXFPRhR2Qmq8tfbfiBjOItMA9uZ5rUCls4nnDLnv2ku4cVH-f8_Dkippr3UThiwg6DxS3nfylNTEwbE2USHSYIyJhUY043fi4iwD3DOtaL_ZLluuPyAOKvDFazQUqZJlz_OCisUUjZzt19T8kF5xojyOw Oct 04 18:28:28.356431 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:28:28.356431 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:28:28.356431 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:28:28.356431 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:28:28.356431 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:28:28.356431 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:28:28.356431 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: e74fd308b33b4e9a8fc4a4635320a05d Oct 04 18:28:28.356431 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-QuotasAdminNegativeTest-1520574321 Oct 04 18:28:28.356431 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:28:28.356431 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:28:28.357848 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e74fd308b33b4e9a8fc4a4635320a05d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e74fd308b33b4e9a8fc4a4635320a05d", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e74fd308b33b4e9a8fc4a4635320a05d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e74fd308b33b4e9a8fc4a4635320a05d"}]}] Oct 04 18:28:28.357848 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-QuotasAdminNegativeTest-1520574321 Oct 04 18:28:28.357848 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: e74fd308b33b4e9a8fc4a4635320a05d Oct 04 18:28:28.357848 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1520574321 Oct 04 18:28:28.357848 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-QuotasAdminNegativeTest-1520574321-project Oct 04 18:28:28.357848 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:28:28.357848 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:28:28.357848 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 8dc1baf76c4a40faa0b260da2310c73b Oct 04 18:28:28.357848 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-QuotasAdminNegativeTest-1520574321-project Oct 04 18:28:28.357848 n-d-850501-14 devstack@n-api.service[123002]: Oct 04 18:28:28.357848 n-d-850501-14 devstack@n-api.service[123002]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1914973511", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452"}} Oct 04 18:28:28.357848 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:28:28.358572 n-d-850501-14 devstack@n-api.service[123002]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 04 18:28:28.358572 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1914973511', 'imageRef': 'f545e662-10b3-46b1-88bb-6e66dd294559', 'flavorRef': '452'}}} Oct 04 18:28:28.358572 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:28:28.358572 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:28.358572 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 04 18:28:28.358572 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 04 18:28:28.358572 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:28:28.358572 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:28:28.358572 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 04 18:28:28.358572 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc Oct 04 18:28:28.358572 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 04 18:28:28.358572 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 04 18:28:28.358572 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:28:28.358572 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:28:28.358572 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 04 18:28:28.358572 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 04 18:28:28.358572 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 04 18:28:28.358572 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 04 18:28:28.359601 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 04 18:28:28.359601 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 04 18:28:28.359601 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 04 18:28:28.359601 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:28.359601 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:28.359601 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:28.359601 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:28.359601 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 18:28:28.359601 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 18:28:28.359601 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 18:28:28.359601 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 18:28:28.359601 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 04 18:28:28.359601 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 04 18:28:28.359601 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 04 18:28:28.359601 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 04 18:28:28.359601 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 04 18:28:28.359601 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 04 18:28:28.359601 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 04 18:28:28.359601 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:28.359601 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:28.359601 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:28.360727 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:28.360727 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:28.360727 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:28.360727 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:28:28.360727 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:28:28.360727 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:28:28.360727 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:28:28.360727 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:28:28.360727 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:28:28.360727 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:28:28.360727 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:28:28.360727 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:28:28.360727 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:28:28.360727 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 18:28:28.360727 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 04 18:28:28.360727 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 04 18:28:28.360727 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 04 18:28:28.360727 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:28.360727 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:28.360727 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:28.360727 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:28.361861 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:28.361861 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:28.361861 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:28:28.361861 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:28:28.361861 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 04 18:28:28.361861 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:28.361861 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a9e7e4b6-978b-4df9-8124-9c45e4f41e58 tempest-QuotasAdminNegativeTest-1520574321 tempest-QuotasAdminNegativeTest-1520574321-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:28:28.361861 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a9e7e4b6-978b-4df9-8124-9c45e4f41e58 tempest-QuotasAdminNegativeTest-1520574321 tempest-QuotasAdminNegativeTest-1520574321-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.557127 Oct 04 18:28:28.361861 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 101/226] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:28:27 2022] POST /compute/v2.1/servers => generated 111 bytes in 558 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:28:28.363273 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-998fdf42-b7c7-49b5-9ba9-10d53a315b88 tempest-QuotasAdminTestV236-1813444335 tempest-QuotasAdminTestV236-1813444335-project-admin] Calling method '.version_select at 0x7fe25982de50>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:28.382445 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-40cbb335-7852-4517-b325-e448d85ab804 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 243 microversion: 2.1 time: 0.321308 Oct 04 18:28:28.384913 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 126/227] 10.222.0.20 () {60 vars in 1191 bytes} [Tue Oct 4 18:28:28 2022] POST /compute/v2.1/os-aggregates/3/action => generated 243 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:28:28.392277 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-35a31f6a-a89b-43d6-82fb-cb25cf630188 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:28.392964 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-35a31f6a-a89b-43d6-82fb-cb25cf630188 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] [instance: 6da2d407-863f-4f6a-9d71-d81e96f160fb] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:28.401881 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-35a31f6a-a89b-43d6-82fb-cb25cf630188 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:28.402360 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-35a31f6a-a89b-43d6-82fb-cb25cf630188 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:28.402797 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-35a31f6a-a89b-43d6-82fb-cb25cf630188 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:28.403499 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-35a31f6a-a89b-43d6-82fb-cb25cf630188 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:28.404020 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-35a31f6a-a89b-43d6-82fb-cb25cf630188 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:28.404499 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-35a31f6a-a89b-43d6-82fb-cb25cf630188 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:28.420354 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-35a31f6a-a89b-43d6-82fb-cb25cf630188 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] HTTP exception thrown: Instance 6da2d407-863f-4f6a-9d71-d81e96f160fb could not be found. Oct 04 18:28:28.422896 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-35a31f6a-a89b-43d6-82fb-cb25cf630188 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Request method failure captured: Oct 04 18:28:28.422896 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/6da2d407-863f-4f6a-9d71-d81e96f160fb HTTP/1.1 Oct 04 18:28:28.422896 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:28:28.422896 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:28:28.422896 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:28:28.422896 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:28:28.422896 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:28:28.422896 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:28:28.422896 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:28:28.422896 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:28:28.422896 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPHsdGC86QKxox70z4N6mdNeGYL7dredhlk2BhDAD-uwBFDVahMgnolZoWnH_4aas_hl9crqH58IGaAkwMPM89IzrLE60fTzB30CTpzyJSbZR5P0nQpNuVXKahgoGR0K-HTryT-g0_4i5mJelfqXttjQDjtkrm4kn1uUjW_Ask3a7wOE Oct 04 18:28:28.422896 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:28:28.422896 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:28:28.422896 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:28:28.422896 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:28:28.422896 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:28:28.422896 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:28:28.422896 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 1e99a0400fe947bb8907857cc4de2899 Oct 04 18:28:28.422896 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1376130247 Oct 04 18:28:28.422896 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:28:28.422896 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:28:28.426056 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1e99a0400fe947bb8907857cc4de2899"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1e99a0400fe947bb8907857cc4de2899", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1e99a0400fe947bb8907857cc4de2899"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1e99a0400fe947bb8907857cc4de2899"}]}] Oct 04 18:28:28.426056 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-DeleteServersAdminTestJSON-1376130247 Oct 04 18:28:28.426056 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 1e99a0400fe947bb8907857cc4de2899 Oct 04 18:28:28.426056 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1376130247 Oct 04 18:28:28.426056 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-DeleteServersAdminTestJSON-1376130247-project Oct 04 18:28:28.426056 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:28:28.426056 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:28:28.426056 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 7f87d9eaf49545bb8effb170768bb8e7 Oct 04 18:28:28.426056 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-DeleteServersAdminTestJSON-1376130247-project Oct 04 18:28:28.426056 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:28:28.426056 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 6da2d407-863f-4f6a-9d71-d81e96f160fb could not be found. Oct 04 18:28:28.426056 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '6da2d407-863f-4f6a-9d71-d81e96f160fb'} Oct 04 18:28:28.427103 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:28:28.427103 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:28.427103 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:28:28.427103 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:28:28.427103 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:28:28.427103 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:28:28.427103 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:28:28.427103 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:28:28.427103 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:28:28.427103 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:28:28.427103 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6da2d407-863f-4f6a-9d71-d81e96f160fb could not be found. Oct 04 18:28:28.427103 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:28.427103 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:28.427103 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:28.427103 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:28.427103 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:28.427103 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:28.427103 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:28:28.427103 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:28:28.427103 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:28:28.429045 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:28:28.429045 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:28:28.429045 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:28:28.429045 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:28:28.429045 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:28:28.429045 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:28:28.429045 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:28:28.429045 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6da2d407-863f-4f6a-9d71-d81e96f160fb could not be found. Oct 04 18:28:28.429045 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:28.429045 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:28.429045 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:28.429045 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:28.429045 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:28.429045 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:28.429045 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:28:28.429045 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:28:28.429045 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6da2d407-863f-4f6a-9d71-d81e96f160fb could not be found. Oct 04 18:28:28.429045 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:28.432186 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-35a31f6a-a89b-43d6-82fb-cb25cf630188 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Returning 404 to user: Instance 6da2d407-863f-4f6a-9d71-d81e96f160fb could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:28:28.432186 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-35a31f6a-a89b-43d6-82fb-cb25cf630188 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] 10.222.0.20 "GET /compute/v2.1/servers/6da2d407-863f-4f6a-9d71-d81e96f160fb" status: 404 len: 111 microversion: 2.1 time: 0.038567 Oct 04 18:28:28.432186 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 127/228] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:28 2022] GET /compute/v2.1/servers/6da2d407-863f-4f6a-9d71-d81e96f160fb => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:28:28.445557 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7984765b-8700-4d0b-8e41-99ba064cbbd1 tempest-InstanceUsageAuditLogTestJSON-1231515965 tempest-InstanceUsageAuditLogTestJSON-1231515965-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:28.457994 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7984765b-8700-4d0b-8e41-99ba064cbbd1 tempest-InstanceUsageAuditLogTestJSON-1231515965 tempest-InstanceUsageAuditLogTestJSON-1231515965-project-admin] 10.222.0.20 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.021025 Oct 04 18:28:28.458561 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 128/229] 10.222.0.20 () {58 vars in 1185 bytes} [Tue Oct 4 18:28:28 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:28:28.463369 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-409bcc88-0eac-472a-a337-30dfc88b0c05 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:28.464208 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-409bcc88-0eac-472a-a337-30dfc88b0c05 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] [instance: ff1c16fb-1167-4285-8d0c-c0fbb78a2883] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:28.470634 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-409bcc88-0eac-472a-a337-30dfc88b0c05 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:28.471123 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-409bcc88-0eac-472a-a337-30dfc88b0c05 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:28.471562 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-409bcc88-0eac-472a-a337-30dfc88b0c05 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:28.472288 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-409bcc88-0eac-472a-a337-30dfc88b0c05 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:28.472747 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-409bcc88-0eac-472a-a337-30dfc88b0c05 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:28.473178 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-409bcc88-0eac-472a-a337-30dfc88b0c05 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:28.580708 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-998fdf42-b7c7-49b5-9ba9-10d53a315b88 tempest-QuotasAdminTestV236-1813444335 tempest-QuotasAdminTestV236-1813444335-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:28.582021 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-998fdf42-b7c7-49b5-9ba9-10d53a315b88 tempest-QuotasAdminTestV236-1813444335 tempest-QuotasAdminTestV236-1813444335-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:28.582599 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-998fdf42-b7c7-49b5-9ba9-10d53a315b88 tempest-QuotasAdminTestV236-1813444335 tempest-QuotasAdminTestV236-1813444335-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:28.584122 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-998fdf42-b7c7-49b5-9ba9-10d53a315b88 tempest-QuotasAdminTestV236-1813444335 tempest-QuotasAdminTestV236-1813444335-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:28.585168 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-998fdf42-b7c7-49b5-9ba9-10d53a315b88 tempest-QuotasAdminTestV236-1813444335 tempest-QuotasAdminTestV236-1813444335-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:28.587577 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-998fdf42-b7c7-49b5-9ba9-10d53a315b88 tempest-QuotasAdminTestV236-1813444335 tempest-QuotasAdminTestV236-1813444335-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:28.622772 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-998fdf42-b7c7-49b5-9ba9-10d53a315b88 tempest-QuotasAdminTestV236-1813444335 tempest-QuotasAdminTestV236-1813444335-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/40a9f11ff7c246fc88701cadc2ab6d80/detail" status: 200 len: 672 microversion: 2.36 time: 0.263170 Oct 04 18:28:28.628267 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 102/230] 10.222.0.20 () {60 vars in 1304 bytes} [Tue Oct 4 18:28:28 2022] GET /compute/v2.1/os-quota-sets/40a9f11ff7c246fc88701cadc2ab6d80/detail => generated 672 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:28:28.632145 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-409bcc88-0eac-472a-a337-30dfc88b0c05 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8675d7d8bab840f3a221fdf2ee4c9b5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25214dec3ef24597be8e5acde61de3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:28.642062 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-409bcc88-0eac-472a-a337-30dfc88b0c05 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] 10.222.0.20 "GET /compute/v2.1/servers/ff1c16fb-1167-4285-8d0c-c0fbb78a2883" status: 200 len: 1390 microversion: 2.1 time: 0.182281 Oct 04 18:28:28.642962 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 129/231] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:28 2022] GET /compute/v2.1/servers/ff1c16fb-1167-4285-8d0c-c0fbb78a2883 => generated 1390 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:28.644223 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ea8848ea-52bf-4b7d-ae37-2bf2f05b0e0c tempest-QuotasAdminNegativeTest-76304858 tempest-QuotasAdminNegativeTest-76304858-project-admin] Action: 'update', calling method: .version_select at 0x7fe259a41ca0>, body: {"quota_set": {"cores": 20}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:28.652203 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6e5eb960-96c0-4dc5-b2fd-21a42cb4cf1d tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:28.661249 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6e5eb960-96c0-4dc5-b2fd-21a42cb4cf1d tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates/3" status: 200 len: 243 microversion: 2.1 time: 0.016788 Oct 04 18:28:28.661864 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 130/232] 10.222.0.20 () {58 vars in 1149 bytes} [Tue Oct 4 18:28:28 2022] GET /compute/v2.1/os-aggregates/3 => generated 243 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:28:28.666971 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2eae5ecc-ef82-47ed-b34c-6e972f3299bc tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-321651039", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:28.736196 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.neutron [None req-2eae5ecc-ef82-47ed-b34c-6e972f3299bc tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] validate_networks() for None {{(pid=123001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:28:28.960488 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-2eae5ecc-ef82-47ed-b34c-6e972f3299bc tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:28:28.961112 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-2eae5ecc-ef82-47ed-b34c-6e972f3299bc tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:28:28.967793 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-2eae5ecc-ef82-47ed-b34c-6e972f3299bc tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:28:28.967793 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-2eae5ecc-ef82-47ed-b34c-6e972f3299bc tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:28:28.967793 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-2eae5ecc-ef82-47ed-b34c-6e972f3299bc tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:28:28.973099 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2eae5ecc-ef82-47ed-b34c-6e972f3299bc tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:28.973597 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2eae5ecc-ef82-47ed-b34c-6e972f3299bc tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:28.974182 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2eae5ecc-ef82-47ed-b34c-6e972f3299bc tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:28.974915 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2eae5ecc-ef82-47ed-b34c-6e972f3299bc tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:28.975568 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2eae5ecc-ef82-47ed-b34c-6e972f3299bc tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:28.976004 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2eae5ecc-ef82-47ed-b34c-6e972f3299bc tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:28.995453 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-2eae5ecc-ef82-47ed-b34c-6e972f3299bc tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Getting quotas for project 1e99a0400fe947bb8907857cc4de2899. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:28:28.999372 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-2eae5ecc-ef82-47ed-b34c-6e972f3299bc tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Getting quotas for user 7f87d9eaf49545bb8effb170768bb8e7 and project 1e99a0400fe947bb8907857cc4de2899. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:28:29.010830 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2eae5ecc-ef82-47ed-b34c-6e972f3299bc tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Going to run 1 instances... {{(pid=123001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:28:29.013238 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2eae5ecc-ef82-47ed-b34c-6e972f3299bc tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] [instance: a8ce9cb7-6601-4d8a-9052-f29620bff27c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:28:29.198788 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ea8848ea-52bf-4b7d-ae37-2bf2f05b0e0c tempest-QuotasAdminNegativeTest-76304858 tempest-QuotasAdminNegativeTest-76304858-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:29.199506 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ea8848ea-52bf-4b7d-ae37-2bf2f05b0e0c tempest-QuotasAdminNegativeTest-76304858 tempest-QuotasAdminNegativeTest-76304858-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:29.200219 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ea8848ea-52bf-4b7d-ae37-2bf2f05b0e0c tempest-QuotasAdminNegativeTest-76304858 tempest-QuotasAdminNegativeTest-76304858-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:29.201102 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ea8848ea-52bf-4b7d-ae37-2bf2f05b0e0c tempest-QuotasAdminNegativeTest-76304858 tempest-QuotasAdminNegativeTest-76304858-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:29.201703 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ea8848ea-52bf-4b7d-ae37-2bf2f05b0e0c tempest-QuotasAdminNegativeTest-76304858 tempest-QuotasAdminNegativeTest-76304858-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:29.202278 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ea8848ea-52bf-4b7d-ae37-2bf2f05b0e0c tempest-QuotasAdminNegativeTest-76304858 tempest-QuotasAdminNegativeTest-76304858-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:29.209858 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2eae5ecc-ef82-47ed-b34c-6e972f3299bc tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.546692 Oct 04 18:28:29.210497 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 131/233] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:28:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 548 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:28:29.222802 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-dc994a6c-6900-416e-9fd6-3803fce41980 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-850501-14"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:29.254462 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dc994a6c-6900-416e-9fd6-3803fce41980 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:29.254953 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dc994a6c-6900-416e-9fd6-3803fce41980 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:29.255392 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dc994a6c-6900-416e-9fd6-3803fce41980 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:29.373730 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ea8848ea-52bf-4b7d-ae37-2bf2f05b0e0c tempest-QuotasAdminNegativeTest-76304858 tempest-QuotasAdminNegativeTest-76304858-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/e74fd308b33b4e9a8fc4a4635320a05d" status: 200 len: 329 microversion: 2.1 time: 0.734983 Oct 04 18:28:29.375374 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 103/234] 10.222.0.20 () {60 vars in 1262 bytes} [Tue Oct 4 18:28:28 2022] PUT /compute/v2.1/os-quota-sets/e74fd308b33b4e9a8fc4a4635320a05d => generated 329 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:28:29.578639 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-dc994a6c-6900-416e-9fd6-3803fce41980 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 227 microversion: 2.1 time: 0.363521 Oct 04 18:28:29.580341 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 132/235] 10.222.0.20 () {60 vars in 1191 bytes} [Tue Oct 4 18:28:29 2022] POST /compute/v2.1/os-aggregates/3/action => generated 227 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:28:29.585604 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-bc483ca4-7ed9-461d-9b85-0bf4737a17bc tempest-HypervisorAdminV253TestBase-838131807 tempest-HypervisorAdminV253TestBase-838131807-project-admin] Calling method '.version_select at 0x7fe259a15c10>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:29.586815 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-37458b31-4430-4c2f-a7f9-c737b4f91b92 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:29.587733 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-37458b31-4430-4c2f-a7f9-c737b4f91b92 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] [instance: a8ce9cb7-6601-4d8a-9052-f29620bff27c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:29.590345 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bc483ca4-7ed9-461d-9b85-0bf4737a17bc tempest-HypervisorAdminV253TestBase-838131807 tempest-HypervisorAdminV253TestBase-838131807-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:29.590835 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bc483ca4-7ed9-461d-9b85-0bf4737a17bc tempest-HypervisorAdminV253TestBase-838131807 tempest-HypervisorAdminV253TestBase-838131807-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:29.591274 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bc483ca4-7ed9-461d-9b85-0bf4737a17bc tempest-HypervisorAdminV253TestBase-838131807 tempest-HypervisorAdminV253TestBase-838131807-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:29.607139 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bc483ca4-7ed9-461d-9b85-0bf4737a17bc tempest-HypervisorAdminV253TestBase-838131807 tempest-HypervisorAdminV253TestBase-838131807-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:29.607979 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bc483ca4-7ed9-461d-9b85-0bf4737a17bc tempest-HypervisorAdminV253TestBase-838131807 tempest-HypervisorAdminV253TestBase-838131807-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:29.608605 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bc483ca4-7ed9-461d-9b85-0bf4737a17bc tempest-HypervisorAdminV253TestBase-838131807 tempest-HypervisorAdminV253TestBase-838131807-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:29.632819 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bc483ca4-7ed9-461d-9b85-0bf4737a17bc tempest-HypervisorAdminV253TestBase-838131807 tempest-HypervisorAdminV253TestBase-838131807-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:29.633666 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bc483ca4-7ed9-461d-9b85-0bf4737a17bc tempest-HypervisorAdminV253TestBase-838131807 tempest-HypervisorAdminV253TestBase-838131807-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:29.634067 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bc483ca4-7ed9-461d-9b85-0bf4737a17bc tempest-HypervisorAdminV253TestBase-838131807 tempest-HypervisorAdminV253TestBase-838131807-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:29.651474 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bc483ca4-7ed9-461d-9b85-0bf4737a17bc tempest-HypervisorAdminV253TestBase-838131807 tempest-HypervisorAdminV253TestBase-838131807-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:29.651971 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bc483ca4-7ed9-461d-9b85-0bf4737a17bc tempest-HypervisorAdminV253TestBase-838131807 tempest-HypervisorAdminV253TestBase-838131807-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:29.652442 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bc483ca4-7ed9-461d-9b85-0bf4737a17bc tempest-HypervisorAdminV253TestBase-838131807 tempest-HypervisorAdminV253TestBase-838131807-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:29.675427 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bc483ca4-7ed9-461d-9b85-0bf4737a17bc tempest-HypervisorAdminV253TestBase-838131807 tempest-HypervisorAdminV253TestBase-838131807-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:29.675939 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bc483ca4-7ed9-461d-9b85-0bf4737a17bc tempest-HypervisorAdminV253TestBase-838131807 tempest-HypervisorAdminV253TestBase-838131807-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:29.676405 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bc483ca4-7ed9-461d-9b85-0bf4737a17bc tempest-HypervisorAdminV253TestBase-838131807 tempest-HypervisorAdminV253TestBase-838131807-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:29.676826 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-37458b31-4430-4c2f-a7f9-c737b4f91b92 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f87d9eaf49545bb8effb170768bb8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e99a0400fe947bb8907857cc4de2899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:29.685089 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-bc483ca4-7ed9-461d-9b85-0bf4737a17bc tempest-HypervisorAdminV253TestBase-838131807 tempest-HypervisorAdminV253TestBase-838131807-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1668 microversion: 2.53 time: 0.308382 Oct 04 18:28:29.685693 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 104/236] 10.222.0.20 () {60 vars in 1243 bytes} [Tue Oct 4 18:28:29 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1668 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:28:29.688521 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-37458b31-4430-4c2f-a7f9-c737b4f91b92 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] 10.222.0.20 "GET /compute/v2.1/servers/a8ce9cb7-6601-4d8a-9052-f29620bff27c" status: 200 len: 1219 microversion: 2.1 time: 0.106474 Oct 04 18:28:29.689366 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 133/237] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:29 2022] GET /compute/v2.1/servers/a8ce9cb7-6601-4d8a-9052-f29620bff27c => generated 1219 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:29.690789 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-cc7c3316-50cc-4cf7-a27f-577b81d12656 tempest-QuotasAdminTestV236-1813444335 tempest-QuotasAdminTestV236-1813444335-project-admin] Action: 'update', calling method: .version_select at 0x7fe259d11790>, body: {"quota_set": {"ram": "2048"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:29.694739 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0c30f77a-4db1-4bd1-93ea-7152dc39512f tempest-QuotasAdminNegativeTest-76304858 tempest-QuotasAdminNegativeTest-76304858-project-admin] Calling method '.version_select at 0x7fe259a213a0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:29.813275 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cc7c3316-50cc-4cf7-a27f-577b81d12656 tempest-QuotasAdminTestV236-1813444335 tempest-QuotasAdminTestV236-1813444335-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:29.814740 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cc7c3316-50cc-4cf7-a27f-577b81d12656 tempest-QuotasAdminTestV236-1813444335 tempest-QuotasAdminTestV236-1813444335-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:29.817203 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cc7c3316-50cc-4cf7-a27f-577b81d12656 tempest-QuotasAdminTestV236-1813444335 tempest-QuotasAdminTestV236-1813444335-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:29.818219 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cc7c3316-50cc-4cf7-a27f-577b81d12656 tempest-QuotasAdminTestV236-1813444335 tempest-QuotasAdminTestV236-1813444335-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:29.819857 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cc7c3316-50cc-4cf7-a27f-577b81d12656 tempest-QuotasAdminTestV236-1813444335 tempest-QuotasAdminTestV236-1813444335-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:29.822579 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cc7c3316-50cc-4cf7-a27f-577b81d12656 tempest-QuotasAdminTestV236-1813444335 tempest-QuotasAdminTestV236-1813444335-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:29.846847 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0c30f77a-4db1-4bd1-93ea-7152dc39512f tempest-QuotasAdminNegativeTest-76304858 tempest-QuotasAdminNegativeTest-76304858-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/e74fd308b33b4e9a8fc4a4635320a05d" status: 200 len: 371 microversion: 2.1 time: 0.150480 Oct 04 18:28:29.848376 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 134/238] 10.222.0.20 () {58 vars in 1242 bytes} [Tue Oct 4 18:28:29 2022] GET /compute/v2.1/os-quota-sets/e74fd308b33b4e9a8fc4a4635320a05d => generated 371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:28:29.853946 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-07645113-8a9d-4c4c-8fdd-0199a9f7b75c tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:29.890064 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cc7c3316-50cc-4cf7-a27f-577b81d12656 tempest-QuotasAdminTestV236-1813444335 tempest-QuotasAdminTestV236-1813444335-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:29.890649 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cc7c3316-50cc-4cf7-a27f-577b81d12656 tempest-QuotasAdminTestV236-1813444335 tempest-QuotasAdminTestV236-1813444335-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:29.894315 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cc7c3316-50cc-4cf7-a27f-577b81d12656 tempest-QuotasAdminTestV236-1813444335 tempest-QuotasAdminTestV236-1813444335-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:29.895162 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cc7c3316-50cc-4cf7-a27f-577b81d12656 tempest-QuotasAdminTestV236-1813444335 tempest-QuotasAdminTestV236-1813444335-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:29.895699 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cc7c3316-50cc-4cf7-a27f-577b81d12656 tempest-QuotasAdminTestV236-1813444335 tempest-QuotasAdminTestV236-1813444335-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:29.896270 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cc7c3316-50cc-4cf7-a27f-577b81d12656 tempest-QuotasAdminTestV236-1813444335 tempest-QuotasAdminTestV236-1813444335-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:30.005244 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-07645113-8a9d-4c4c-8fdd-0199a9f7b75c tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.155553 Oct 04 18:28:30.013794 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 135/239] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Oct 4 18:28:29 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 18:28:30.036191 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-300b4f50-ca0e-43bb-9ce2-8f79405f43c9 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:30.037557 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-300b4f50-ca0e-43bb-9ce2-8f79405f43c9 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] [instance: ff1c16fb-1167-4285-8d0c-c0fbb78a2883] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:30.065430 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-cc7c3316-50cc-4cf7-a27f-577b81d12656 tempest-QuotasAdminTestV236-1813444335 tempest-QuotasAdminTestV236-1813444335-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/40a9f11ff7c246fc88701cadc2ab6d80?user_id=b9f0776a7608409c859257a90988e359" status: 200 len: 240 microversion: 2.36 time: 0.378403 Oct 04 18:28:30.072274 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 105/240] 10.222.0.20 () {62 vars in 1384 bytes} [Tue Oct 4 18:28:29 2022] PUT /compute/v2.1/os-quota-sets/40a9f11ff7c246fc88701cadc2ab6d80?user_id=b9f0776a7608409c859257a90988e359 => generated 240 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:28:30.078439 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-300b4f50-ca0e-43bb-9ce2-8f79405f43c9 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:30.079327 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-756e4349-61f9-4ebd-abb5-116ebbf2abe7 tempest-HypervisorAdminV253TestBase-838131807 tempest-HypervisorAdminV253TestBase-838131807-project-admin] Calling method '.version_select at 0x7fe259870820>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:30.079445 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-300b4f50-ca0e-43bb-9ce2-8f79405f43c9 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:30.080215 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-300b4f50-ca0e-43bb-9ce2-8f79405f43c9 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:30.081737 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-300b4f50-ca0e-43bb-9ce2-8f79405f43c9 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:30.082723 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-300b4f50-ca0e-43bb-9ce2-8f79405f43c9 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:30.084485 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-300b4f50-ca0e-43bb-9ce2-8f79405f43c9 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:30.085172 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-756e4349-61f9-4ebd-abb5-116ebbf2abe7 tempest-HypervisorAdminV253TestBase-838131807 tempest-HypervisorAdminV253TestBase-838131807-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:30.085673 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-756e4349-61f9-4ebd-abb5-116ebbf2abe7 tempest-HypervisorAdminV253TestBase-838131807 tempest-HypervisorAdminV253TestBase-838131807-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:30.086284 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-756e4349-61f9-4ebd-abb5-116ebbf2abe7 tempest-HypervisorAdminV253TestBase-838131807 tempest-HypervisorAdminV253TestBase-838131807-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:30.102739 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-756e4349-61f9-4ebd-abb5-116ebbf2abe7 tempest-HypervisorAdminV253TestBase-838131807 tempest-HypervisorAdminV253TestBase-838131807-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:30.103244 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-756e4349-61f9-4ebd-abb5-116ebbf2abe7 tempest-HypervisorAdminV253TestBase-838131807 tempest-HypervisorAdminV253TestBase-838131807-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:30.103670 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-756e4349-61f9-4ebd-abb5-116ebbf2abe7 tempest-HypervisorAdminV253TestBase-838131807 tempest-HypervisorAdminV253TestBase-838131807-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:30.117893 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-756e4349-61f9-4ebd-abb5-116ebbf2abe7 tempest-HypervisorAdminV253TestBase-838131807 tempest-HypervisorAdminV253TestBase-838131807-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:30.118376 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-756e4349-61f9-4ebd-abb5-116ebbf2abe7 tempest-HypervisorAdminV253TestBase-838131807 tempest-HypervisorAdminV253TestBase-838131807-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:30.119004 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-756e4349-61f9-4ebd-abb5-116ebbf2abe7 tempest-HypervisorAdminV253TestBase-838131807 tempest-HypervisorAdminV253TestBase-838131807-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:30.129842 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-756e4349-61f9-4ebd-abb5-116ebbf2abe7 tempest-HypervisorAdminV253TestBase-838131807 tempest-HypervisorAdminV253TestBase-838131807-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:30.130356 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-756e4349-61f9-4ebd-abb5-116ebbf2abe7 tempest-HypervisorAdminV253TestBase-838131807 tempest-HypervisorAdminV253TestBase-838131807-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:30.130793 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-756e4349-61f9-4ebd-abb5-116ebbf2abe7 tempest-HypervisorAdminV253TestBase-838131807 tempest-HypervisorAdminV253TestBase-838131807-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:30.156297 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-756e4349-61f9-4ebd-abb5-116ebbf2abe7 tempest-HypervisorAdminV253TestBase-838131807 tempest-HypervisorAdminV253TestBase-838131807-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:30.156785 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-756e4349-61f9-4ebd-abb5-116ebbf2abe7 tempest-HypervisorAdminV253TestBase-838131807 tempest-HypervisorAdminV253TestBase-838131807-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:30.157222 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-756e4349-61f9-4ebd-abb5-116ebbf2abe7 tempest-HypervisorAdminV253TestBase-838131807 tempest-HypervisorAdminV253TestBase-838131807-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:30.163239 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-756e4349-61f9-4ebd-abb5-116ebbf2abe7 tempest-HypervisorAdminV253TestBase-838131807 tempest-HypervisorAdminV253TestBase-838131807-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 359 microversion: 2.53 time: 0.089298 Oct 04 18:28:30.166060 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 106/241] 10.222.0.20 () {60 vars in 1222 bytes} [Tue Oct 4 18:28:30 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 359 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:28:30.169642 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0afd9244-8192-4386-accb-33cd3785149f tempest-QuotasAdminNegativeTest-76304858 tempest-QuotasAdminNegativeTest-76304858-project-admin] Action: 'update', calling method: .version_select at 0x7fe25982d9d0>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:30.241465 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-300b4f50-ca0e-43bb-9ce2-8f79405f43c9 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8675d7d8bab840f3a221fdf2ee4c9b5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25214dec3ef24597be8e5acde61de3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:30.246588 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0afd9244-8192-4386-accb-33cd3785149f tempest-QuotasAdminNegativeTest-76304858 tempest-QuotasAdminNegativeTest-76304858-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:30.247076 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0afd9244-8192-4386-accb-33cd3785149f tempest-QuotasAdminNegativeTest-76304858 tempest-QuotasAdminNegativeTest-76304858-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:30.247537 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0afd9244-8192-4386-accb-33cd3785149f tempest-QuotasAdminNegativeTest-76304858 tempest-QuotasAdminNegativeTest-76304858-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:30.248303 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0afd9244-8192-4386-accb-33cd3785149f tempest-QuotasAdminNegativeTest-76304858 tempest-QuotasAdminNegativeTest-76304858-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:30.248865 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0afd9244-8192-4386-accb-33cd3785149f tempest-QuotasAdminNegativeTest-76304858 tempest-QuotasAdminNegativeTest-76304858-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:30.249291 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0afd9244-8192-4386-accb-33cd3785149f tempest-QuotasAdminNegativeTest-76304858 tempest-QuotasAdminNegativeTest-76304858-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:30.249565 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-300b4f50-ca0e-43bb-9ce2-8f79405f43c9 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] 10.222.0.20 "GET /compute/v2.1/servers/ff1c16fb-1167-4285-8d0c-c0fbb78a2883" status: 200 len: 1390 microversion: 2.1 time: 0.234509 Oct 04 18:28:30.250145 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 136/242] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:30 2022] GET /compute/v2.1/servers/ff1c16fb-1167-4285-8d0c-c0fbb78a2883 => generated 1390 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:30.254492 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e75f1bd9-3f2a-44ad-87d7-f027bbc63208 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-561833202"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:30.257996 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.aggregate [None req-e75f1bd9-3f2a-44ad-87d7-f027bbc63208 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Generated uuid dee65a5c-98eb-43ff-becc-761e6cf936e9 for aggregate {{(pid=123001) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 18:28:30.361381 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e75f1bd9-3f2a-44ad-87d7-f027bbc63208 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.110009 Oct 04 18:28:30.366179 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 137/243] 10.222.0.20 () {60 vars in 1164 bytes} [Tue Oct 4 18:28:30 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:28:30.367776 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3874d66d-de16-4f22-becd-530027d4fd43 tempest-QuotasAdminTestV236-1813444335 tempest-QuotasAdminTestV236-1813444335-project-admin] Calling method '.version_select at 0x7fe2599d9e50>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:30.387837 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0afd9244-8192-4386-accb-33cd3785149f tempest-QuotasAdminNegativeTest-76304858 tempest-QuotasAdminNegativeTest-76304858-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/e74fd308b33b4e9a8fc4a4635320a05d" status: 200 len: 328 microversion: 2.1 time: 0.222286 Oct 04 18:28:30.388496 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 107/244] 10.222.0.20 () {60 vars in 1262 bytes} [Tue Oct 4 18:28:30 2022] PUT /compute/v2.1/os-quota-sets/e74fd308b33b4e9a8fc4a4635320a05d => generated 328 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:28:30.397894 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4981f4d0-f7f2-49ab-8a3b-e83ebd77e70a tempest-HypervisorAdminV253TestBase-838131807 tempest-HypervisorAdminV253TestBase-838131807-project-admin] Calling method '.version_select at 0x7fe2597f7550>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:30.402272 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4981f4d0-f7f2-49ab-8a3b-e83ebd77e70a tempest-HypervisorAdminV253TestBase-838131807 tempest-HypervisorAdminV253TestBase-838131807-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:30.402814 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4981f4d0-f7f2-49ab-8a3b-e83ebd77e70a tempest-HypervisorAdminV253TestBase-838131807 tempest-HypervisorAdminV253TestBase-838131807-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:30.403242 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4981f4d0-f7f2-49ab-8a3b-e83ebd77e70a tempest-HypervisorAdminV253TestBase-838131807 tempest-HypervisorAdminV253TestBase-838131807-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:30.422880 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4981f4d0-f7f2-49ab-8a3b-e83ebd77e70a tempest-HypervisorAdminV253TestBase-838131807 tempest-HypervisorAdminV253TestBase-838131807-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:30.423360 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4981f4d0-f7f2-49ab-8a3b-e83ebd77e70a tempest-HypervisorAdminV253TestBase-838131807 tempest-HypervisorAdminV253TestBase-838131807-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:30.424099 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4981f4d0-f7f2-49ab-8a3b-e83ebd77e70a tempest-HypervisorAdminV253TestBase-838131807 tempest-HypervisorAdminV253TestBase-838131807-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:30.441516 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4981f4d0-f7f2-49ab-8a3b-e83ebd77e70a tempest-HypervisorAdminV253TestBase-838131807 tempest-HypervisorAdminV253TestBase-838131807-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/b19bbdfd-bf78-4251-8e58-8f126d8c89cd" status: 200 len: 793 microversion: 2.53 time: 0.051306 Oct 04 18:28:30.441610 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 108/245] 10.222.0.20 () {60 vars in 1298 bytes} [Tue Oct 4 18:28:30 2022] GET /compute/v2.1/os-hypervisors/b19bbdfd-bf78-4251-8e58-8f126d8c89cd => generated 793 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:28:30.458488 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-244a6fd8-b3fa-478e-93d8-f8071bb16267 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-850501-14"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:30.469582 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-244a6fd8-b3fa-478e-93d8-f8071bb16267 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:30.470073 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-244a6fd8-b3fa-478e-93d8-f8071bb16267 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:30.470485 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-244a6fd8-b3fa-478e-93d8-f8071bb16267 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:30.594815 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3874d66d-de16-4f22-becd-530027d4fd43 tempest-QuotasAdminTestV236-1813444335 tempest-QuotasAdminTestV236-1813444335-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/40a9f11ff7c246fc88701cadc2ab6d80?user_id=b9f0776a7608409c859257a90988e359" status: 200 len: 282 microversion: 2.36 time: 0.231550 Oct 04 18:28:30.595691 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 138/246] 10.222.0.20 () {60 vars in 1364 bytes} [Tue Oct 4 18:28:30 2022] GET /compute/v2.1/os-quota-sets/40a9f11ff7c246fc88701cadc2ab6d80?user_id=b9f0776a7608409c859257a90988e359 => generated 282 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:28:30.667711 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0fd253fe-f87d-46da-b55f-981adbd5132e tempest-QuotasAdminNegativeTest-1520574321 tempest-QuotasAdminNegativeTest-1520574321-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-393042704", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:30.730063 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.neutron [None req-0fd253fe-f87d-46da-b55f-981adbd5132e tempest-QuotasAdminNegativeTest-1520574321 tempest-QuotasAdminNegativeTest-1520574321-project] validate_networks() for None {{(pid=123001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:28:30.779882 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-244a6fd8-b3fa-478e-93d8-f8071bb16267 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 242 microversion: 2.1 time: 0.325338 Oct 04 18:28:30.781861 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 109/247] 10.222.0.20 () {60 vars in 1191 bytes} [Tue Oct 4 18:28:30 2022] POST /compute/v2.1/os-aggregates/4/action => generated 242 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:28:30.785048 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9e35577f-cb7c-406b-91d1-e204066569d3 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:30.785654 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9e35577f-cb7c-406b-91d1-e204066569d3 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] [instance: a8ce9cb7-6601-4d8a-9052-f29620bff27c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:30.787519 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:28:30.792432 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9e35577f-cb7c-406b-91d1-e204066569d3 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:30.792919 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9e35577f-cb7c-406b-91d1-e204066569d3 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:30.793414 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9e35577f-cb7c-406b-91d1-e204066569d3 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:30.794110 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9e35577f-cb7c-406b-91d1-e204066569d3 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:30.794574 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9e35577f-cb7c-406b-91d1-e204066569d3 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:30.794979 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9e35577f-cb7c-406b-91d1-e204066569d3 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:30.884128 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9e35577f-cb7c-406b-91d1-e204066569d3 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f87d9eaf49545bb8effb170768bb8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e99a0400fe947bb8907857cc4de2899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:30.894304 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9e35577f-cb7c-406b-91d1-e204066569d3 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] 10.222.0.20 "GET /compute/v2.1/servers/a8ce9cb7-6601-4d8a-9052-f29620bff27c" status: 200 len: 1215 microversion: 2.1 time: 0.112731 Oct 04 18:28:30.895231 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 110/248] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:30 2022] GET /compute/v2.1/servers/a8ce9cb7-6601-4d8a-9052-f29620bff27c => generated 1215 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:30.901455 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b6968dd3-3116-41d9-9ff5-fd03b0667362 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:30.927497 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b6968dd3-3116-41d9-9ff5-fd03b0667362 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.1 time: 0.031220 Oct 04 18:28:30.928280 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 111/249] 10.222.0.20 () {58 vars in 1143 bytes} [Tue Oct 4 18:28:30 2022] GET /compute/v2.1/os-aggregates => generated 245 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:28:30.941810 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e017add3-b809-45c6-9b16-5029e6cd8ef5 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-850501-14"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:30.955972 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e017add3-b809-45c6-9b16-5029e6cd8ef5 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:30.958696 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e017add3-b809-45c6-9b16-5029e6cd8ef5 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:30.959127 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e017add3-b809-45c6-9b16-5029e6cd8ef5 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:30.997356 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-0fd253fe-f87d-46da-b55f-981adbd5132e tempest-QuotasAdminNegativeTest-1520574321 tempest-QuotasAdminNegativeTest-1520574321-project] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:28:31.002371 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-0fd253fe-f87d-46da-b55f-981adbd5132e tempest-QuotasAdminNegativeTest-1520574321 tempest-QuotasAdminNegativeTest-1520574321-project] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:28:31.006140 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-0fd253fe-f87d-46da-b55f-981adbd5132e tempest-QuotasAdminNegativeTest-1520574321 tempest-QuotasAdminNegativeTest-1520574321-project] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:28:31.006720 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-0fd253fe-f87d-46da-b55f-981adbd5132e tempest-QuotasAdminNegativeTest-1520574321 tempest-QuotasAdminNegativeTest-1520574321-project] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:28:31.006893 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-0fd253fe-f87d-46da-b55f-981adbd5132e tempest-QuotasAdminNegativeTest-1520574321 tempest-QuotasAdminNegativeTest-1520574321-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:28:31.029288 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0fd253fe-f87d-46da-b55f-981adbd5132e tempest-QuotasAdminNegativeTest-1520574321 tempest-QuotasAdminNegativeTest-1520574321-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:31.035971 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0fd253fe-f87d-46da-b55f-981adbd5132e tempest-QuotasAdminNegativeTest-1520574321 tempest-QuotasAdminNegativeTest-1520574321-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:31.035971 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0fd253fe-f87d-46da-b55f-981adbd5132e tempest-QuotasAdminNegativeTest-1520574321 tempest-QuotasAdminNegativeTest-1520574321-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:31.035971 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0fd253fe-f87d-46da-b55f-981adbd5132e tempest-QuotasAdminNegativeTest-1520574321 tempest-QuotasAdminNegativeTest-1520574321-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:31.035971 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0fd253fe-f87d-46da-b55f-981adbd5132e tempest-QuotasAdminNegativeTest-1520574321 tempest-QuotasAdminNegativeTest-1520574321-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:31.036316 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0fd253fe-f87d-46da-b55f-981adbd5132e tempest-QuotasAdminNegativeTest-1520574321 tempest-QuotasAdminNegativeTest-1520574321-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:31.052985 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-0fd253fe-f87d-46da-b55f-981adbd5132e tempest-QuotasAdminNegativeTest-1520574321 tempest-QuotasAdminNegativeTest-1520574321-project] Getting quotas for project e74fd308b33b4e9a8fc4a4635320a05d. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:28:31.058039 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-0fd253fe-f87d-46da-b55f-981adbd5132e tempest-QuotasAdminNegativeTest-1520574321 tempest-QuotasAdminNegativeTest-1520574321-project] Getting quotas for user 8dc1baf76c4a40faa0b260da2310c73b and project e74fd308b33b4e9a8fc4a4635320a05d. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:28:31.073987 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.utils [None req-0fd253fe-f87d-46da-b55f-981adbd5132e tempest-QuotasAdminNegativeTest-1520574321 tempest-QuotasAdminNegativeTest-1520574321-project] instances quota exceeded for e74fd308b33b4e9a8fc4a4635320a05d, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=123001) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 04 18:28:31.075236 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-0fd253fe-f87d-46da-b55f-981adbd5132e tempest-QuotasAdminNegativeTest-1520574321 tempest-QuotasAdminNegativeTest-1520574321-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 04 18:28:31.079959 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0fd253fe-f87d-46da-b55f-981adbd5132e tempest-QuotasAdminNegativeTest-1520574321 tempest-QuotasAdminNegativeTest-1520574321-project] Request method failure captured: Oct 04 18:28:31.079959 n-d-850501-14 devstack@n-api.service[123001]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:28:31.079959 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:28:31.079959 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:28:31.079959 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:28:31.079959 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 144 Oct 04 18:28:31.079959 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:28:31.079959 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:28:31.079959 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:28:31.079959 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:28:31.079959 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPHtGsvGTFmwxKKJo-VRINCgXFPRhR2Qmq8tfbfiBjOItMA9uZ5rUCls4nnDLnv2ku4cVH-f8_Dkippr3UThiwg6DxS3nfylNTEwbE2USHSYIyJhUY043fi4iwD3DOtaL_ZLluuPyAOKvDFazQUqZJlz_OCisUUjZzt19T8kF5xojyOw Oct 04 18:28:31.079959 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:28:31.079959 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:28:31.079959 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:28:31.079959 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:28:31.079959 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:28:31.079959 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:28:31.079959 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: e74fd308b33b4e9a8fc4a4635320a05d Oct 04 18:28:31.079959 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-QuotasAdminNegativeTest-1520574321 Oct 04 18:28:31.079959 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:28:31.079959 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:28:31.081463 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e74fd308b33b4e9a8fc4a4635320a05d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e74fd308b33b4e9a8fc4a4635320a05d", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e74fd308b33b4e9a8fc4a4635320a05d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e74fd308b33b4e9a8fc4a4635320a05d"}]}] Oct 04 18:28:31.081463 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-QuotasAdminNegativeTest-1520574321 Oct 04 18:28:31.081463 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: e74fd308b33b4e9a8fc4a4635320a05d Oct 04 18:28:31.081463 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1520574321 Oct 04 18:28:31.081463 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-QuotasAdminNegativeTest-1520574321-project Oct 04 18:28:31.081463 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:28:31.081463 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:28:31.081463 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 8dc1baf76c4a40faa0b260da2310c73b Oct 04 18:28:31.081463 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-QuotasAdminNegativeTest-1520574321-project Oct 04 18:28:31.081463 n-d-850501-14 devstack@n-api.service[123001]: Oct 04 18:28:31.081463 n-d-850501-14 devstack@n-api.service[123001]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-393042704", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452"}} Oct 04 18:28:31.081463 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:28:31.082270 n-d-850501-14 devstack@n-api.service[123001]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 04 18:28:31.082270 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-393042704', 'imageRef': 'f545e662-10b3-46b1-88bb-6e66dd294559', 'flavorRef': '452'}}} Oct 04 18:28:31.082270 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:28:31.082270 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:31.082270 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 04 18:28:31.082270 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 04 18:28:31.082270 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:28:31.082270 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:28:31.082270 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 04 18:28:31.082270 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc Oct 04 18:28:31.082270 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 04 18:28:31.082270 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 04 18:28:31.082270 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:28:31.082270 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:28:31.082270 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 04 18:28:31.082270 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 04 18:28:31.082270 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 04 18:28:31.082270 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 04 18:28:31.083453 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 04 18:28:31.083453 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 04 18:28:31.083453 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Oct 04 18:28:31.083453 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:31.083453 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:31.083453 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:31.083453 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:31.083453 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 18:28:31.083453 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 18:28:31.083453 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 18:28:31.083453 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 18:28:31.083453 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 04 18:28:31.083453 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 04 18:28:31.083453 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 04 18:28:31.083453 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 04 18:28:31.083453 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 04 18:28:31.083453 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 04 18:28:31.083453 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 04 18:28:31.083453 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:31.083453 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:31.083453 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:31.084972 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:31.084972 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:31.084972 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:31.084972 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:28:31.084972 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:28:31.084972 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:28:31.084972 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:28:31.084972 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:28:31.084972 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:28:31.084972 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:28:31.084972 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:28:31.084972 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:28:31.084972 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:28:31.084972 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 18:28:31.084972 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 04 18:28:31.084972 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 04 18:28:31.084972 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 04 18:28:31.084972 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:31.084972 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:31.084972 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:31.084972 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:31.087129 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:31.087129 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:31.087129 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:28:31.087129 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:28:31.087129 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 04 18:28:31.087129 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:31.087129 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0fd253fe-f87d-46da-b55f-981adbd5132e tempest-QuotasAdminNegativeTest-1520574321 tempest-QuotasAdminNegativeTest-1520574321-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:28:31.087129 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0fd253fe-f87d-46da-b55f-981adbd5132e tempest-QuotasAdminNegativeTest-1520574321 tempest-QuotasAdminNegativeTest-1520574321-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.423887 Oct 04 18:28:31.087802 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 139/250] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:28:30 2022] POST /compute/v2.1/servers => generated 119 bytes in 430 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:28:31.095054 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8dd92850-5c95-4e71-b96e-b3365fbf034f tempest-QuotasAdminNegativeTest-76304858 tempest-QuotasAdminNegativeTest-76304858-project-admin] Action: 'update', calling method: .version_select at 0x7fe259a05af0>, body: {"quota_set": {"instances": 10}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:31.366983 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e017add3-b809-45c6-9b16-5029e6cd8ef5 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 226 microversion: 2.1 time: 0.430032 Oct 04 18:28:31.370159 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 112/251] 10.222.0.20 () {60 vars in 1191 bytes} [Tue Oct 4 18:28:30 2022] POST /compute/v2.1/os-aggregates/4/action => generated 226 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:28:31.380382 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f5613880-498c-496e-b1c5-0b3e9eeb00eb tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:31.381230 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f5613880-498c-496e-b1c5-0b3e9eeb00eb tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] [instance: ff1c16fb-1167-4285-8d0c-c0fbb78a2883] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:31.388984 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f5613880-498c-496e-b1c5-0b3e9eeb00eb tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:31.389468 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f5613880-498c-496e-b1c5-0b3e9eeb00eb tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:31.390160 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f5613880-498c-496e-b1c5-0b3e9eeb00eb tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:31.390873 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f5613880-498c-496e-b1c5-0b3e9eeb00eb tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:31.391324 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f5613880-498c-496e-b1c5-0b3e9eeb00eb tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:31.391914 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f5613880-498c-496e-b1c5-0b3e9eeb00eb tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:31.516626 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8dd92850-5c95-4e71-b96e-b3365fbf034f tempest-QuotasAdminNegativeTest-76304858 tempest-QuotasAdminNegativeTest-76304858-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:31.517119 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8dd92850-5c95-4e71-b96e-b3365fbf034f tempest-QuotasAdminNegativeTest-76304858 tempest-QuotasAdminNegativeTest-76304858-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:31.517632 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8dd92850-5c95-4e71-b96e-b3365fbf034f tempest-QuotasAdminNegativeTest-76304858 tempest-QuotasAdminNegativeTest-76304858-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:31.518370 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8dd92850-5c95-4e71-b96e-b3365fbf034f tempest-QuotasAdminNegativeTest-76304858 tempest-QuotasAdminNegativeTest-76304858-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:31.518823 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8dd92850-5c95-4e71-b96e-b3365fbf034f tempest-QuotasAdminNegativeTest-76304858 tempest-QuotasAdminNegativeTest-76304858-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:31.519243 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8dd92850-5c95-4e71-b96e-b3365fbf034f tempest-QuotasAdminNegativeTest-76304858 tempest-QuotasAdminNegativeTest-76304858-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:31.565686 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=7,nova_api:DELETE=3 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:28:31.634167 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f5613880-498c-496e-b1c5-0b3e9eeb00eb tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8675d7d8bab840f3a221fdf2ee4c9b5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25214dec3ef24597be8e5acde61de3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:31.643724 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f5613880-498c-496e-b1c5-0b3e9eeb00eb tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] 10.222.0.20 "GET /compute/v2.1/servers/ff1c16fb-1167-4285-8d0c-c0fbb78a2883" status: 200 len: 1390 microversion: 2.1 time: 0.272381 Oct 04 18:28:31.644317 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 113/252] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:31 2022] GET /compute/v2.1/servers/ff1c16fb-1167-4285-8d0c-c0fbb78a2883 => generated 1390 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:31.658382 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-15781427-16a2-4363-b96d-f0e6ffe93d53 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:31.737166 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8dd92850-5c95-4e71-b96e-b3365fbf034f tempest-QuotasAdminNegativeTest-76304858 tempest-QuotasAdminNegativeTest-76304858-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/e74fd308b33b4e9a8fc4a4635320a05d" status: 200 len: 329 microversion: 2.1 time: 0.647727 Oct 04 18:28:31.738031 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 140/253] 10.222.0.20 () {60 vars in 1262 bytes} [Tue Oct 4 18:28:31 2022] PUT /compute/v2.1/os-quota-sets/e74fd308b33b4e9a8fc4a4635320a05d => generated 329 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:28:31.753845 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-15781427-16a2-4363-b96d-f0e6ffe93d53 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.108277 Oct 04 18:28:31.754760 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 114/254] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Oct 4 18:28:31 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 18:28:31.767470 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-46d70613-557d-4951-b63e-44d7b25db6f0 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1860914471"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:31.769466 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2532dec4-e0f9-46f4-95d5-2cc4de497cac tempest-QuotasAdminNegativeTest-76304858 tempest-QuotasAdminNegativeTest-76304858-project-admin] Calling method '.version_select at 0x7fe259a051f0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:31.775892 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.aggregate [None req-46d70613-557d-4951-b63e-44d7b25db6f0 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Generated uuid c9367d5e-4997-42ba-a554-292456f8bda4 for aggregate {{(pid=123002) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 18:28:31.905818 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-46d70613-557d-4951-b63e-44d7b25db6f0 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.142892 Oct 04 18:28:31.907992 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 115/255] 10.222.0.20 () {60 vars in 1164 bytes} [Tue Oct 4 18:28:31 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:28:31.938677 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f74c7cee-ab76-48f2-af26-8b5c1dd64848 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-850501-14"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:31.949288 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f74c7cee-ab76-48f2-af26-8b5c1dd64848 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:31.949792 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f74c7cee-ab76-48f2-af26-8b5c1dd64848 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:31.950229 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f74c7cee-ab76-48f2-af26-8b5c1dd64848 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:32.253111 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2532dec4-e0f9-46f4-95d5-2cc4de497cac tempest-QuotasAdminNegativeTest-76304858 tempest-QuotasAdminNegativeTest-76304858-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/e74fd308b33b4e9a8fc4a4635320a05d" status: 200 len: 371 microversion: 2.1 time: 0.487759 Oct 04 18:28:32.253111 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 141/256] 10.222.0.20 () {58 vars in 1242 bytes} [Tue Oct 4 18:28:31 2022] GET /compute/v2.1/os-quota-sets/e74fd308b33b4e9a8fc4a4635320a05d => generated 371 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:28:32.257658 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-274f5438-4b48-4bd4-ac40-e6b3a34f9a92 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:32.259665 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-274f5438-4b48-4bd4-ac40-e6b3a34f9a92 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] [instance: a8ce9cb7-6601-4d8a-9052-f29620bff27c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:32.265686 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-274f5438-4b48-4bd4-ac40-e6b3a34f9a92 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:32.266176 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-274f5438-4b48-4bd4-ac40-e6b3a34f9a92 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:32.266610 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-274f5438-4b48-4bd4-ac40-e6b3a34f9a92 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:32.267317 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-274f5438-4b48-4bd4-ac40-e6b3a34f9a92 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:32.267769 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-274f5438-4b48-4bd4-ac40-e6b3a34f9a92 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:32.268384 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-274f5438-4b48-4bd4-ac40-e6b3a34f9a92 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:32.278468 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f74c7cee-ab76-48f2-af26-8b5c1dd64848 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 243 microversion: 2.1 time: 0.362833 Oct 04 18:28:32.279828 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 116/257] 10.222.0.20 () {60 vars in 1191 bytes} [Tue Oct 4 18:28:31 2022] POST /compute/v2.1/os-aggregates/5/action => generated 243 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:28:32.285203 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4978c385-b2fb-4848-91b7-bcb69f021b9c tempest-QuotasAdminNegativeTest-76304858 tempest-QuotasAdminNegativeTest-76304858-project-admin] Action: 'update', calling method: .version_select at 0x7fe2598129d0>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:32.343847 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-274f5438-4b48-4bd4-ac40-e6b3a34f9a92 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f87d9eaf49545bb8effb170768bb8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e99a0400fe947bb8907857cc4de2899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:32.352663 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-274f5438-4b48-4bd4-ac40-e6b3a34f9a92 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] 10.222.0.20 "GET /compute/v2.1/servers/a8ce9cb7-6601-4d8a-9052-f29620bff27c" status: 200 len: 1277 microversion: 2.1 time: 0.098724 Oct 04 18:28:32.360117 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 142/258] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:32 2022] GET /compute/v2.1/servers/a8ce9cb7-6601-4d8a-9052-f29620bff27c => generated 1277 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:32.360117 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e8f704ef-62af-42db-b1d4-dc19c42e2955 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-850501-14"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:32.370292 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e8f704ef-62af-42db-b1d4-dc19c42e2955 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:32.370783 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e8f704ef-62af-42db-b1d4-dc19c42e2955 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:32.371340 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e8f704ef-62af-42db-b1d4-dc19c42e2955 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:32.678434 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e8f704ef-62af-42db-b1d4-dc19c42e2955 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 227 microversion: 2.1 time: 0.323381 Oct 04 18:28:32.687212 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 143/259] 10.222.0.20 () {60 vars in 1191 bytes} [Tue Oct 4 18:28:32 2022] POST /compute/v2.1/os-aggregates/5/action => generated 227 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:28:32.687212 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-fe2269b6-1dff-4902-bd2b-494cf996bac7 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:32.687212 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-fe2269b6-1dff-4902-bd2b-494cf996bac7 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] [instance: ff1c16fb-1167-4285-8d0c-c0fbb78a2883] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:32.693318 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fe2269b6-1dff-4902-bd2b-494cf996bac7 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:32.693885 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fe2269b6-1dff-4902-bd2b-494cf996bac7 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:32.694327 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fe2269b6-1dff-4902-bd2b-494cf996bac7 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:32.696071 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fe2269b6-1dff-4902-bd2b-494cf996bac7 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:32.696961 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fe2269b6-1dff-4902-bd2b-494cf996bac7 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:32.697690 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fe2269b6-1dff-4902-bd2b-494cf996bac7 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:32.857174 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-fe2269b6-1dff-4902-bd2b-494cf996bac7 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8675d7d8bab840f3a221fdf2ee4c9b5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25214dec3ef24597be8e5acde61de3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:32.864789 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-fe2269b6-1dff-4902-bd2b-494cf996bac7 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] 10.222.0.20 "GET /compute/v2.1/servers/ff1c16fb-1167-4285-8d0c-c0fbb78a2883" status: 200 len: 1390 microversion: 2.1 time: 0.182607 Oct 04 18:28:32.865587 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 144/260] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:32 2022] GET /compute/v2.1/servers/ff1c16fb-1167-4285-8d0c-c0fbb78a2883 => generated 1390 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:32.880896 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4978c385-b2fb-4848-91b7-bcb69f021b9c tempest-QuotasAdminNegativeTest-76304858 tempest-QuotasAdminNegativeTest-76304858-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:32.880896 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4978c385-b2fb-4848-91b7-bcb69f021b9c tempest-QuotasAdminNegativeTest-76304858 tempest-QuotasAdminNegativeTest-76304858-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:32.880896 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4978c385-b2fb-4848-91b7-bcb69f021b9c tempest-QuotasAdminNegativeTest-76304858 tempest-QuotasAdminNegativeTest-76304858-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:32.880896 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4978c385-b2fb-4848-91b7-bcb69f021b9c tempest-QuotasAdminNegativeTest-76304858 tempest-QuotasAdminNegativeTest-76304858-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:32.881638 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-afbf6598-2db0-4ec8-a799-4816f337adbd tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:32.882018 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4978c385-b2fb-4848-91b7-bcb69f021b9c tempest-QuotasAdminNegativeTest-76304858 tempest-QuotasAdminNegativeTest-76304858-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:32.882018 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4978c385-b2fb-4848-91b7-bcb69f021b9c tempest-QuotasAdminNegativeTest-76304858 tempest-QuotasAdminNegativeTest-76304858-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:32.962874 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-afbf6598-2db0-4ec8-a799-4816f337adbd tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.095247 Oct 04 18:28:32.963812 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 145/261] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Oct 4 18:28:32 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 18:28:32.982415 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d16859f4-b6cb-4eff-9db4-9552e5f282d5 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1260181724"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:32.992468 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.aggregate [None req-d16859f4-b6cb-4eff-9db4-9552e5f282d5 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Generated uuid 787703e5-c5cd-4117-857a-48c2fa6c602b for aggregate {{(pid=123001) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 18:28:33.053150 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4978c385-b2fb-4848-91b7-bcb69f021b9c tempest-QuotasAdminNegativeTest-76304858 tempest-QuotasAdminNegativeTest-76304858-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/e74fd308b33b4e9a8fc4a4635320a05d" status: 200 len: 325 microversion: 2.1 time: 0.771641 Oct 04 18:28:33.054289 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 117/262] 10.222.0.20 () {60 vars in 1262 bytes} [Tue Oct 4 18:28:32 2022] PUT /compute/v2.1/os-quota-sets/e74fd308b33b4e9a8fc4a4635320a05d => generated 325 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:28:33.059297 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ff843138-d950-4232-b4e8-7382876fa793 tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-101545360"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:33.063597 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.aggregate [None req-ff843138-d950-4232-b4e8-7382876fa793 tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] Generated uuid e070471a-3271-4124-b613-24797c542dc3 for aggregate {{(pid=123002) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 18:28:33.128791 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d16859f4-b6cb-4eff-9db4-9552e5f282d5 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.155309 Oct 04 18:28:33.129955 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 146/263] 10.222.0.20 () {60 vars in 1164 bytes} [Tue Oct 4 18:28:32 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:28:33.141646 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1e6de43f-cc1b-41ec-aa5e-eb956e5c0507 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:33.186351 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ff843138-d950-4232-b4e8-7382876fa793 tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.130807 Oct 04 18:28:33.186951 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 118/264] 10.222.0.20 () {60 vars in 1164 bytes} [Tue Oct 4 18:28:33 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:28:33.198864 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-690457d8-77a6-450a-ba79-3d2c0cfa2b72 tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-850501-14"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:33.214893 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-690457d8-77a6-450a-ba79-3d2c0cfa2b72 tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:33.217039 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-690457d8-77a6-450a-ba79-3d2c0cfa2b72 tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:33.217039 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-690457d8-77a6-450a-ba79-3d2c0cfa2b72 tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:33.276724 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1e6de43f-cc1b-41ec-aa5e-eb956e5c0507 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.139311 Oct 04 18:28:33.281254 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 147/265] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Oct 4 18:28:33 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 04 18:28:33.285897 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5ddb0d39-13a0-44dc-b232-960b01e0f41b tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:33.293760 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-5ddb0d39-13a0-44dc-b232-960b01e0f41b tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Oct 04 18:28:33.296344 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5ddb0d39-13a0-44dc-b232-960b01e0f41b tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Request method failure captured: Oct 04 18:28:33.296344 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/os-aggregates/6 HTTP/1.1 Oct 04 18:28:33.296344 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:28:33.296344 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:28:33.296344 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:28:33.296344 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:28:33.296344 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:28:33.296344 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:28:33.296344 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:28:33.296344 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:28:33.296344 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPHsjLxSozoiTL-mMDoe7JGk0DYXnX_5mTszog0W2wPjfzhKyTTXqHwp4SxuEQoxoSf2qXtI6CrwunhqbUkWnj-rCSj_jEBBUiy7ROZXJql0kjd-U78DnazGZgXvC0JOrHM0w272K8jfaBOgPcibqkMCWIq2HnPukUXxb5du6AkHrzhU Oct 04 18:28:33.296344 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:28:33.296344 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:28:33.296344 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:28:33.296344 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:28:33.296344 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:28:33.296344 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:28:33.296344 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 026d601faaae44b68de5701e02af3656 Oct 04 18:28:33.296344 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-AggregatesAdminTestJSON-1145487060 Oct 04 18:28:33.296344 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member,admin Oct 04 18:28:33.296344 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member,admin Oct 04 18:28:33.297555 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/026d601faaae44b68de5701e02af3656"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_026d601faaae44b68de5701e02af3656", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/026d601faaae44b68de5701e02af3656"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/026d601faaae44b68de5701e02af3656"}]}] Oct 04 18:28:33.297555 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-AggregatesAdminTestJSON-1145487060 Oct 04 18:28:33.297555 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 026d601faaae44b68de5701e02af3656 Oct 04 18:28:33.297555 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1145487060 Oct 04 18:28:33.297555 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-AggregatesAdminTestJSON-1145487060-project-admin Oct 04 18:28:33.297555 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:28:33.297555 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:28:33.297555 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: c6344d9f5eae453b87336192e99dc4e6 Oct 04 18:28:33.297555 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-AggregatesAdminTestJSON-1145487060-project-admin Oct 04 18:28:33.297555 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:28:33.297555 n-d-850501-14 devstack@n-api.service[123001]: exception: Aggregate 6 could not be found. Oct 04 18:28:33.297555 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '6'} Oct 04 18:28:33.297555 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:28:33.298282 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:33.298282 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 04 18:28:33.298282 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 04 18:28:33.298282 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 04 18:28:33.298282 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 04 18:28:33.298282 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:28:33.298282 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:28:33.298282 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 04 18:28:33.298282 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 04 18:28:33.298282 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:28:33.298282 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:28:33.298282 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 04 18:28:33.298282 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 04 18:28:33.298282 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 6 could not be found. Oct 04 18:28:33.298282 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:33.298282 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:33.298282 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:33.298282 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:33.298282 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:33.299590 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:33.299590 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:28:33.299590 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:28:33.299590 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:28:33.299590 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:28:33.299590 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 04 18:28:33.299590 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:28:33.299590 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 6 could not be found. Oct 04 18:28:33.299590 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:33.299590 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:33.299590 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:33.299590 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:33.299590 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:33.299590 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:33.299590 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:28:33.299590 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:28:33.299590 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 could not be found. Oct 04 18:28:33.299590 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:33.302087 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5ddb0d39-13a0-44dc-b232-960b01e0f41b tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:28:33.303141 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5ddb0d39-13a0-44dc-b232-960b01e0f41b tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.020786 Oct 04 18:28:33.315108 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 148/266] 10.222.0.20 () {58 vars in 1149 bytes} [Tue Oct 4 18:28:33 2022] GET /compute/v2.1/os-aggregates/6 => generated 77 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:28:33.332196 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-152fa1b4-e594-410c-9965-7d15a75dce92 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:33.360546 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-152fa1b4-e594-410c-9965-7d15a75dce92 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Oct 04 18:28:33.365454 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-152fa1b4-e594-410c-9965-7d15a75dce92 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Request method failure captured: Oct 04 18:28:33.365454 n-d-850501-14 devstack@n-api.service[123001]: request: DELETE /compute/v2.1/os-aggregates/6 HTTP/1.1 Oct 04 18:28:33.365454 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:28:33.365454 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:28:33.365454 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:28:33.365454 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:28:33.365454 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:28:33.365454 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:28:33.365454 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:28:33.365454 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:28:33.365454 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPHsjLxSozoiTL-mMDoe7JGk0DYXnX_5mTszog0W2wPjfzhKyTTXqHwp4SxuEQoxoSf2qXtI6CrwunhqbUkWnj-rCSj_jEBBUiy7ROZXJql0kjd-U78DnazGZgXvC0JOrHM0w272K8jfaBOgPcibqkMCWIq2HnPukUXxb5du6AkHrzhU Oct 04 18:28:33.365454 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:28:33.365454 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:28:33.365454 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:28:33.365454 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:28:33.365454 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:28:33.365454 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:28:33.365454 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 026d601faaae44b68de5701e02af3656 Oct 04 18:28:33.365454 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-AggregatesAdminTestJSON-1145487060 Oct 04 18:28:33.365454 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member,admin Oct 04 18:28:33.365454 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member,admin Oct 04 18:28:33.366969 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/026d601faaae44b68de5701e02af3656"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_026d601faaae44b68de5701e02af3656", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/026d601faaae44b68de5701e02af3656"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/026d601faaae44b68de5701e02af3656"}]}] Oct 04 18:28:33.366969 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-AggregatesAdminTestJSON-1145487060 Oct 04 18:28:33.366969 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 026d601faaae44b68de5701e02af3656 Oct 04 18:28:33.366969 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1145487060 Oct 04 18:28:33.366969 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-AggregatesAdminTestJSON-1145487060-project-admin Oct 04 18:28:33.366969 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:28:33.366969 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:28:33.366969 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: c6344d9f5eae453b87336192e99dc4e6 Oct 04 18:28:33.366969 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-AggregatesAdminTestJSON-1145487060-project-admin Oct 04 18:28:33.366969 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:28:33.366969 n-d-850501-14 devstack@n-api.service[123001]: exception: Aggregate 6 could not be found. Oct 04 18:28:33.366969 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '6'} Oct 04 18:28:33.366969 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:28:33.367701 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:33.367701 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 04 18:28:33.367701 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 04 18:28:33.367701 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 18:28:33.367701 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 18:28:33.367701 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:28:33.367701 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:28:33.367701 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:28:33.367701 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:28:33.367701 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 18:28:33.367701 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 18:28:33.367701 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 04 18:28:33.367701 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 04 18:28:33.367701 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:28:33.367701 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:28:33.367701 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 04 18:28:33.367701 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 04 18:28:33.367701 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:28:33.367701 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:28:33.368977 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 04 18:28:33.368977 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 04 18:28:33.368977 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 6 could not be found. Oct 04 18:28:33.368977 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:33.368977 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:33.368977 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:33.368977 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:33.368977 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:33.368977 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:33.368977 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:28:33.368977 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:28:33.368977 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:28:33.368977 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:28:33.368977 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 04 18:28:33.368977 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:28:33.368977 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 6 could not be found. Oct 04 18:28:33.368977 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:33.368977 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:33.368977 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:33.368977 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:33.368977 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:33.370297 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:33.370297 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:28:33.370297 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:28:33.370297 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 could not be found. Oct 04 18:28:33.370297 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:33.374885 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-152fa1b4-e594-410c-9965-7d15a75dce92 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:28:33.375839 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-152fa1b4-e594-410c-9965-7d15a75dce92 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.054807 Oct 04 18:28:33.378661 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 149/267] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Oct 4 18:28:33 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 77 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:28:33.397442 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-cc70f334-a750-444e-9467-b835831efe8b tempest-QuotasAdminNegativeTest-1520574321 tempest-QuotasAdminNegativeTest-1520574321-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-2051288170", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:33.468787 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.neutron [None req-cc70f334-a750-444e-9467-b835831efe8b tempest-QuotasAdminNegativeTest-1520574321 tempest-QuotasAdminNegativeTest-1520574321-project] validate_networks() for None {{(pid=123001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:28:33.546983 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-690457d8-77a6-450a-ba79-3d2c0cfa2b72 tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/7/action" status: 200 len: 242 microversion: 2.1 time: 0.352005 Oct 04 18:28:33.547511 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 119/268] 10.222.0.20 () {60 vars in 1191 bytes} [Tue Oct 4 18:28:33 2022] POST /compute/v2.1/os-aggregates/7/action => generated 242 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:28:33.552926 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-18dd9f8a-cda1-477e-91f9-70874edafa54 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:33.553775 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-18dd9f8a-cda1-477e-91f9-70874edafa54 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] [instance: a8ce9cb7-6601-4d8a-9052-f29620bff27c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:33.562513 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-18dd9f8a-cda1-477e-91f9-70874edafa54 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:33.563367 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-18dd9f8a-cda1-477e-91f9-70874edafa54 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:33.564021 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-18dd9f8a-cda1-477e-91f9-70874edafa54 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:33.564996 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-18dd9f8a-cda1-477e-91f9-70874edafa54 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:33.565655 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-18dd9f8a-cda1-477e-91f9-70874edafa54 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:33.566273 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-18dd9f8a-cda1-477e-91f9-70874edafa54 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:33.782219 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-cc70f334-a750-444e-9467-b835831efe8b tempest-QuotasAdminNegativeTest-1520574321 tempest-QuotasAdminNegativeTest-1520574321-project] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:28:33.783137 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-cc70f334-a750-444e-9467-b835831efe8b tempest-QuotasAdminNegativeTest-1520574321 tempest-QuotasAdminNegativeTest-1520574321-project] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:28:33.786060 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-cc70f334-a750-444e-9467-b835831efe8b tempest-QuotasAdminNegativeTest-1520574321 tempest-QuotasAdminNegativeTest-1520574321-project] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:28:33.786724 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-cc70f334-a750-444e-9467-b835831efe8b tempest-QuotasAdminNegativeTest-1520574321 tempest-QuotasAdminNegativeTest-1520574321-project] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:28:33.787833 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-cc70f334-a750-444e-9467-b835831efe8b tempest-QuotasAdminNegativeTest-1520574321 tempest-QuotasAdminNegativeTest-1520574321-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:28:33.810875 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cc70f334-a750-444e-9467-b835831efe8b tempest-QuotasAdminNegativeTest-1520574321 tempest-QuotasAdminNegativeTest-1520574321-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:33.811966 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cc70f334-a750-444e-9467-b835831efe8b tempest-QuotasAdminNegativeTest-1520574321 tempest-QuotasAdminNegativeTest-1520574321-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:33.815692 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cc70f334-a750-444e-9467-b835831efe8b tempest-QuotasAdminNegativeTest-1520574321 tempest-QuotasAdminNegativeTest-1520574321-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:33.815692 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cc70f334-a750-444e-9467-b835831efe8b tempest-QuotasAdminNegativeTest-1520574321 tempest-QuotasAdminNegativeTest-1520574321-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:33.815692 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cc70f334-a750-444e-9467-b835831efe8b tempest-QuotasAdminNegativeTest-1520574321 tempest-QuotasAdminNegativeTest-1520574321-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:33.815692 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cc70f334-a750-444e-9467-b835831efe8b tempest-QuotasAdminNegativeTest-1520574321 tempest-QuotasAdminNegativeTest-1520574321-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:33.835884 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-cc70f334-a750-444e-9467-b835831efe8b tempest-QuotasAdminNegativeTest-1520574321 tempest-QuotasAdminNegativeTest-1520574321-project] Getting quotas for project e74fd308b33b4e9a8fc4a4635320a05d. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:28:33.842264 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-cc70f334-a750-444e-9467-b835831efe8b tempest-QuotasAdminNegativeTest-1520574321 tempest-QuotasAdminNegativeTest-1520574321-project] Getting quotas for user 8dc1baf76c4a40faa0b260da2310c73b and project e74fd308b33b4e9a8fc4a4635320a05d. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:28:33.846020 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-18dd9f8a-cda1-477e-91f9-70874edafa54 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f87d9eaf49545bb8effb170768bb8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e99a0400fe947bb8907857cc4de2899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:33.858290 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.utils [None req-cc70f334-a750-444e-9467-b835831efe8b tempest-QuotasAdminNegativeTest-1520574321 tempest-QuotasAdminNegativeTest-1520574321-project] ram quota exceeded for e74fd308b33b4e9a8fc4a4635320a05d, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=123001) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 04 18:28:33.858690 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-cc70f334-a750-444e-9467-b835831efe8b tempest-QuotasAdminNegativeTest-1520574321 tempest-QuotasAdminNegativeTest-1520574321-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 04 18:28:33.861580 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-cc70f334-a750-444e-9467-b835831efe8b tempest-QuotasAdminNegativeTest-1520574321 tempest-QuotasAdminNegativeTest-1520574321-project] Request method failure captured: Oct 04 18:28:33.861580 n-d-850501-14 devstack@n-api.service[123001]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:28:33.861580 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:28:33.861580 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:28:33.861580 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:28:33.861580 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 145 Oct 04 18:28:33.861580 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:28:33.861580 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:28:33.861580 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:28:33.861580 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:28:33.861580 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPHtGsvGTFmwxKKJo-VRINCgXFPRhR2Qmq8tfbfiBjOItMA9uZ5rUCls4nnDLnv2ku4cVH-f8_Dkippr3UThiwg6DxS3nfylNTEwbE2USHSYIyJhUY043fi4iwD3DOtaL_ZLluuPyAOKvDFazQUqZJlz_OCisUUjZzt19T8kF5xojyOw Oct 04 18:28:33.861580 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:28:33.861580 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:28:33.861580 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:28:33.861580 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:28:33.861580 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:28:33.861580 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:28:33.861580 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: e74fd308b33b4e9a8fc4a4635320a05d Oct 04 18:28:33.861580 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-QuotasAdminNegativeTest-1520574321 Oct 04 18:28:33.861580 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:28:33.861580 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:28:33.862741 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e74fd308b33b4e9a8fc4a4635320a05d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e74fd308b33b4e9a8fc4a4635320a05d", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e74fd308b33b4e9a8fc4a4635320a05d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e74fd308b33b4e9a8fc4a4635320a05d"}]}] Oct 04 18:28:33.862741 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-QuotasAdminNegativeTest-1520574321 Oct 04 18:28:33.862741 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: e74fd308b33b4e9a8fc4a4635320a05d Oct 04 18:28:33.862741 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1520574321 Oct 04 18:28:33.862741 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-QuotasAdminNegativeTest-1520574321-project Oct 04 18:28:33.862741 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:28:33.862741 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:28:33.862741 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 8dc1baf76c4a40faa0b260da2310c73b Oct 04 18:28:33.862741 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-QuotasAdminNegativeTest-1520574321-project Oct 04 18:28:33.862741 n-d-850501-14 devstack@n-api.service[123001]: Oct 04 18:28:33.862741 n-d-850501-14 devstack@n-api.service[123001]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-2051288170", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452"}} Oct 04 18:28:33.862741 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:28:33.863427 n-d-850501-14 devstack@n-api.service[123001]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 04 18:28:33.863427 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-2051288170', 'imageRef': 'f545e662-10b3-46b1-88bb-6e66dd294559', 'flavorRef': '452'}}} Oct 04 18:28:33.863427 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:28:33.863427 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:33.863427 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 04 18:28:33.863427 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 04 18:28:33.863427 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:28:33.863427 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:28:33.863427 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 04 18:28:33.863427 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc Oct 04 18:28:33.863427 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 04 18:28:33.863427 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 04 18:28:33.863427 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:28:33.863427 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:28:33.863427 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 04 18:28:33.863427 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 04 18:28:33.863427 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 04 18:28:33.863427 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 04 18:28:33.864977 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 04 18:28:33.864977 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 04 18:28:33.864977 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 04 18:28:33.864977 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:33.864977 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:33.864977 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:33.864977 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:33.864977 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 18:28:33.864977 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 18:28:33.864977 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 18:28:33.864977 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 18:28:33.864977 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 04 18:28:33.864977 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 04 18:28:33.864977 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 04 18:28:33.864977 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 04 18:28:33.864977 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 04 18:28:33.864977 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 04 18:28:33.864977 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 04 18:28:33.864977 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:33.864977 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:33.864977 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:33.866126 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:33.866126 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:33.866126 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:33.866126 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:28:33.866126 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:28:33.866126 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:28:33.866126 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:28:33.866126 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:28:33.866126 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:28:33.866126 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:28:33.866126 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:28:33.866126 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:28:33.866126 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:28:33.866126 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 18:28:33.866126 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 04 18:28:33.866126 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 04 18:28:33.866126 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 04 18:28:33.866126 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:33.866126 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:33.866126 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:33.866126 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:33.867974 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:33.867974 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:33.867974 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:28:33.867974 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:28:33.867974 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 04 18:28:33.867974 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:33.867974 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-cc70f334-a750-444e-9467-b835831efe8b tempest-QuotasAdminNegativeTest-1520574321 tempest-QuotasAdminNegativeTest-1520574321-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:28:33.870717 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-18dd9f8a-cda1-477e-91f9-70874edafa54 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] 10.222.0.20 "GET /compute/v2.1/servers/a8ce9cb7-6601-4d8a-9052-f29620bff27c" status: 200 len: 1319 microversion: 2.1 time: 0.314150 Oct 04 18:28:33.870865 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-cc70f334-a750-444e-9467-b835831efe8b tempest-QuotasAdminNegativeTest-1520574321 tempest-QuotasAdminNegativeTest-1520574321-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.476709 Oct 04 18:28:33.870865 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 150/269] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:28:33 2022] POST /compute/v2.1/servers => generated 110 bytes in 491 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:28:33.875319 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f039dd83-457e-4de8-b2dd-32891f6b7275 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-289827689", "name": "tempest-test_aggregate-678285992"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:33.885073 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 120/270] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:33 2022] GET /compute/v2.1/servers/a8ce9cb7-6601-4d8a-9052-f29620bff27c => generated 1319 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:33.898970 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e77e6faf-67aa-43ba-bb87-12ddc6cb3f11 tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-850501-14"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:33.907483 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.aggregate [None req-f039dd83-457e-4de8-b2dd-32891f6b7275 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Generated uuid 4bb8e955-f83d-4b4e-96f6-d90fed6c7db2 for aggregate {{(pid=123001) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 18:28:33.931604 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e77e6faf-67aa-43ba-bb87-12ddc6cb3f11 tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:33.937299 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e77e6faf-67aa-43ba-bb87-12ddc6cb3f11 tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:33.940303 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e77e6faf-67aa-43ba-bb87-12ddc6cb3f11 tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:34.046261 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f039dd83-457e-4de8-b2dd-32891f6b7275 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.174497 Oct 04 18:28:34.048287 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-e77e6faf-67aa-43ba-bb87-12ddc6cb3f11 tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] HTTP exception thrown: Aggregate 7 already has host n-h1-850501-14. Oct 04 18:28:34.055668 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 151/271] 10.222.0.20 () {60 vars in 1165 bytes} [Tue Oct 4 18:28:33 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:28:34.065922 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e77e6faf-67aa-43ba-bb87-12ddc6cb3f11 tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] Request method failure captured: Oct 04 18:28:34.065922 n-d-850501-14 devstack@n-api.service[123002]: request: POST /compute/v2.1/os-aggregates/7/action HTTP/1.1 Oct 04 18:28:34.065922 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:28:34.065922 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:28:34.065922 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:28:34.065922 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 40 Oct 04 18:28:34.065922 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:28:34.065922 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:28:34.065922 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:28:34.065922 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:28:34.065922 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPHsj9nOZ9ioO_efPq3nbDeMPU7oCAYiQMAUFnpAJqRUYWFcj0nO-Vc0rDXFFlNyHWs48QMwNACr4oauXko1gOAqr_7UWOM5Y1zL9Pn_-dp3toI9V46knq8PVOo4nzA_LKdJ6Cds3JRE8UOaG-Bg_oE1iHYmD4wltFvr-dMq30vCrVhs Oct 04 18:28:34.065922 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:28:34.065922 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:28:34.065922 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:28:34.065922 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:28:34.065922 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:28:34.065922 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:28:34.065922 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 3aa0a4867ac0403daa3a5a65747c8b93 Oct 04 18:28:34.065922 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-260413230 Oct 04 18:28:34.065922 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member,admin Oct 04 18:28:34.065922 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member,admin Oct 04 18:28:34.068517 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3aa0a4867ac0403daa3a5a65747c8b93"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3aa0a4867ac0403daa3a5a65747c8b93", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3aa0a4867ac0403daa3a5a65747c8b93"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3aa0a4867ac0403daa3a5a65747c8b93"}]}] Oct 04 18:28:34.068517 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-260413230 Oct 04 18:28:34.068517 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 3aa0a4867ac0403daa3a5a65747c8b93 Oct 04 18:28:34.068517 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-260413230 Oct 04 18:28:34.068517 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin Oct 04 18:28:34.068517 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:28:34.068517 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:28:34.068517 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 5fe40de42fd949d69e11128751c04f60 Oct 04 18:28:34.068517 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin Oct 04 18:28:34.068517 n-d-850501-14 devstack@n-api.service[123002]: Oct 04 18:28:34.068517 n-d-850501-14 devstack@n-api.service[123002]: {"add_host": {"host": "n-h1-850501-14"}} Oct 04 18:28:34.068517 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:28:34.068517 n-d-850501-14 devstack@n-api.service[123002]: exception: Aggregate 7 already has host n-h1-850501-14. Oct 04 18:28:34.070027 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '7', 'body': {'add_host': {'host': 'n-h1-850501-14'}}} Oct 04 18:28:34.070027 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:28:34.070027 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:34.070027 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 18:28:34.070027 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 04 18:28:34.070027 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 18:28:34.070027 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 04 18:28:34.070027 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 18:28:34.070027 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 04 18:28:34.070027 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 18:28:34.070027 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 04 18:28:34.070027 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 18:28:34.070027 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 18:28:34.070027 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 18:28:34.070027 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi result.read() Oct 04 18:28:34.070027 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 18:28:34.070027 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 04 18:28:34.070027 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 18:28:34.070027 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 04 18:28:34.071768 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 18:28:34.071768 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 04 18:28:34.071768 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 18:28:34.071768 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 04 18:28:34.071768 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h1-850501-14-7' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 04 18:28:34.071768 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:34.071768 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 04 18:28:34.071768 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:34.071768 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:34.071768 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Oct 04 18:28:34.071768 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Oct 04 18:28:34.071768 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 04 18:28:34.071768 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi session.flush() Oct 04 18:28:34.071768 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 04 18:28:34.071768 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 04 18:28:34.071768 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 04 18:28:34.071768 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 04 18:28:34.071768 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 04 18:28:34.071768 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 04 18:28:34.074995 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 18:28:34.074995 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception Oct 04 18:28:34.074995 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 04 18:28:34.074995 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 04 18:28:34.074995 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 04 18:28:34.074995 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 04 18:28:34.074995 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 04 18:28:34.074995 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 04 18:28:34.074995 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 04 18:28:34.074995 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 04 18:28:34.074995 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 04 18:28:34.074995 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 04 18:28:34.074995 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 04 18:28:34.074995 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 04 18:28:34.074995 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 04 18:28:34.074995 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 04 18:28:34.074995 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 04 18:28:34.074995 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 04 18:28:34.076260 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 04 18:28:34.076260 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 04 18:28:34.076260 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 04 18:28:34.076260 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 04 18:28:34.076260 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 18:28:34.076260 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception Oct 04 18:28:34.076260 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 18:28:34.076260 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 04 18:28:34.076260 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 18:28:34.076260 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 04 18:28:34.076260 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 18:28:34.076260 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 04 18:28:34.076260 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 18:28:34.076260 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 04 18:28:34.076260 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 18:28:34.076260 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 18:28:34.076260 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 18:28:34.076260 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi result.read() Oct 04 18:28:34.077743 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 18:28:34.077743 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 04 18:28:34.077743 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 18:28:34.077743 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 04 18:28:34.077743 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 18:28:34.077743 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 04 18:28:34.077743 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 18:28:34.077743 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 04 18:28:34.077743 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h1-850501-14-7' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 04 18:28:34.077743 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Oct 04 18:28:34.077743 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 4, 18, 28, 33, 979343), 'updated_at': None, 'host': 'n-h1-850501-14', 'aggregate_id': 7}] Oct 04 18:28:34.077743 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 04 18:28:34.077743 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:34.077743 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:34.077743 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:34.077743 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:34.077743 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 04 18:28:34.078849 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 04 18:28:34.078849 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 18:28:34.078849 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 18:28:34.078849 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:28:34.078849 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:28:34.078849 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:28:34.078849 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:28:34.078849 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 18:28:34.078849 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 18:28:34.078849 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in add_host_to_aggregate Oct 04 18:28:34.078849 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Oct 04 18:28:34.078849 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 04 18:28:34.078849 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 04 18:28:34.078849 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Oct 04 18:28:34.078849 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Oct 04 18:28:34.078849 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Oct 04 18:28:34.078849 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Oct 04 18:28:34.078849 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 7 already has host n-h1-850501-14. Oct 04 18:28:34.078849 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:34.078849 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:34.080153 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:34.080153 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:34.080153 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:34.080153 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:34.080153 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:28:34.080153 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:28:34.080153 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:28:34.080153 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:28:34.080153 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:28:34.080153 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:28:34.080153 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Oct 04 18:28:34.080153 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 04 18:28:34.080153 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 7 already has host n-h1-850501-14. Oct 04 18:28:34.080153 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:34.080153 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:34.080153 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:34.080153 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:34.080153 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:34.080153 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:34.080153 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:28:34.080153 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:28:34.081319 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 already has host n-h1-850501-14. Oct 04 18:28:34.081319 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:34.081665 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-944f5d81-392d-4813-b7b2-8a000f8b1d25 tempest-QuotasAdminNegativeTest-76304858 tempest-QuotasAdminNegativeTest-76304858-project-admin] Action: 'update', calling method: .version_select at 0x7fe259a05160>, body: {"quota_set": {"ram": 51200}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:34.081753 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e77e6faf-67aa-43ba-bb87-12ddc6cb3f11 tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] Returning 409 to user: Aggregate 7 already has host n-h1-850501-14. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:28:34.081753 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e77e6faf-67aa-43ba-bb87-12ddc6cb3f11 tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/7/action" status: 409 len: 96 microversion: 2.1 time: 0.189965 Oct 04 18:28:34.081753 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 121/272] 10.222.0.20 () {60 vars in 1191 bytes} [Tue Oct 4 18:28:33 2022] POST /compute/v2.1/os-aggregates/7/action => generated 96 bytes in 202 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Oct 04 18:28:34.100922 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-23ea0298-ee10-4d7c-9fd5-286e41ac5803 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:34.109400 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-23ea0298-ee10-4d7c-9fd5-286e41ac5803 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] [instance: ff1c16fb-1167-4285-8d0c-c0fbb78a2883] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:34.121727 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-23ea0298-ee10-4d7c-9fd5-286e41ac5803 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:34.122276 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-23ea0298-ee10-4d7c-9fd5-286e41ac5803 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:34.122705 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-23ea0298-ee10-4d7c-9fd5-286e41ac5803 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:34.123425 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-23ea0298-ee10-4d7c-9fd5-286e41ac5803 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:34.124006 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-23ea0298-ee10-4d7c-9fd5-286e41ac5803 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:34.124450 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-23ea0298-ee10-4d7c-9fd5-286e41ac5803 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:34.306046 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-23ea0298-ee10-4d7c-9fd5-286e41ac5803 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8675d7d8bab840f3a221fdf2ee4c9b5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25214dec3ef24597be8e5acde61de3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:34.308731 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=100 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:28:34.317723 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-23ea0298-ee10-4d7c-9fd5-286e41ac5803 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] 10.222.0.20 "GET /compute/v2.1/servers/ff1c16fb-1167-4285-8d0c-c0fbb78a2883" status: 200 len: 1390 microversion: 2.1 time: 0.231366 Oct 04 18:28:34.332033 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 122/273] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:34 2022] GET /compute/v2.1/servers/ff1c16fb-1167-4285-8d0c-c0fbb78a2883 => generated 1390 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:34.332033 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-08e27f9b-c1b1-4bcf-bccd-ed3ecc732c1b tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:34.424469 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-08e27f9b-c1b1-4bcf-bccd-ed3ecc732c1b tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.103187 Oct 04 18:28:34.428765 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 123/274] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Oct 4 18:28:34 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 18:28:34.438850 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a41b6330-ef1f-489c-abe5-52dbb146da2c tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-850501-14"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:34.456590 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a41b6330-ef1f-489c-abe5-52dbb146da2c tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:34.457873 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a41b6330-ef1f-489c-abe5-52dbb146da2c tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:34.462678 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a41b6330-ef1f-489c-abe5-52dbb146da2c tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:34.746849 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-944f5d81-392d-4813-b7b2-8a000f8b1d25 tempest-QuotasAdminNegativeTest-76304858 tempest-QuotasAdminNegativeTest-76304858-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:34.747420 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-944f5d81-392d-4813-b7b2-8a000f8b1d25 tempest-QuotasAdminNegativeTest-76304858 tempest-QuotasAdminNegativeTest-76304858-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:34.747757 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-944f5d81-392d-4813-b7b2-8a000f8b1d25 tempest-QuotasAdminNegativeTest-76304858 tempest-QuotasAdminNegativeTest-76304858-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:34.748538 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-944f5d81-392d-4813-b7b2-8a000f8b1d25 tempest-QuotasAdminNegativeTest-76304858 tempest-QuotasAdminNegativeTest-76304858-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:34.749095 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-944f5d81-392d-4813-b7b2-8a000f8b1d25 tempest-QuotasAdminNegativeTest-76304858 tempest-QuotasAdminNegativeTest-76304858-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:34.749521 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-944f5d81-392d-4813-b7b2-8a000f8b1d25 tempest-QuotasAdminNegativeTest-76304858 tempest-QuotasAdminNegativeTest-76304858-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:34.902721 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a41b6330-ef1f-489c-abe5-52dbb146da2c tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/7/action" status: 200 len: 226 microversion: 2.1 time: 0.475274 Oct 04 18:28:34.903228 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 124/275] 10.222.0.20 () {60 vars in 1191 bytes} [Tue Oct 4 18:28:34 2022] POST /compute/v2.1/os-aggregates/7/action => generated 226 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:28:34.909790 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-feaa6afc-62d1-44b9-96e2-1a8496a50575 req-425eb5be-c7cc-4017-bca9-4a6482d092a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8ce9cb7-6601-4d8a-9052-f29620bff27c", "tag": "5cc09ec0-dc36-4aa6-81fd-e58c3844e0d1"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:34.922680 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-feaa6afc-62d1-44b9-96e2-1a8496a50575 req-425eb5be-c7cc-4017-bca9-4a6482d092a8 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:34.923501 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-feaa6afc-62d1-44b9-96e2-1a8496a50575 req-425eb5be-c7cc-4017-bca9-4a6482d092a8 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:34.924446 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-feaa6afc-62d1-44b9-96e2-1a8496a50575 req-425eb5be-c7cc-4017-bca9-4a6482d092a8 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:34.936283 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-feaa6afc-62d1-44b9-96e2-1a8496a50575 req-425eb5be-c7cc-4017-bca9-4a6482d092a8 service nova] Creating event network-changed:5cc09ec0-dc36-4aa6-81fd-e58c3844e0d1 for instance a8ce9cb7-6601-4d8a-9052-f29620bff27c on n-h1-850501-14 Oct 04 18:28:34.942063 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-feaa6afc-62d1-44b9-96e2-1a8496a50575 req-425eb5be-c7cc-4017-bca9-4a6482d092a8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037167 Oct 04 18:28:34.942807 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 125/276] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:28:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:28:34.947981 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4a1aca07-6632-4a4f-86ca-1644ee724c8f tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:34.956198 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-4a1aca07-6632-4a4f-86ca-1644ee724c8f tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] HTTP exception thrown: Aggregate 8 could not be found. Oct 04 18:28:34.958139 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4a1aca07-6632-4a4f-86ca-1644ee724c8f tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Request method failure captured: Oct 04 18:28:34.958139 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/os-aggregates/8 HTTP/1.1 Oct 04 18:28:34.958139 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:28:34.958139 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:28:34.958139 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:28:34.958139 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:28:34.958139 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:28:34.958139 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:28:34.958139 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:28:34.958139 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:28:34.958139 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPHsjLxSozoiTL-mMDoe7JGk0DYXnX_5mTszog0W2wPjfzhKyTTXqHwp4SxuEQoxoSf2qXtI6CrwunhqbUkWnj-rCSj_jEBBUiy7ROZXJql0kjd-U78DnazGZgXvC0JOrHM0w272K8jfaBOgPcibqkMCWIq2HnPukUXxb5du6AkHrzhU Oct 04 18:28:34.958139 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:28:34.958139 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:28:34.958139 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:28:34.958139 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:28:34.958139 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:28:34.958139 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:28:34.958139 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 026d601faaae44b68de5701e02af3656 Oct 04 18:28:34.958139 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-AggregatesAdminTestJSON-1145487060 Oct 04 18:28:34.958139 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member,admin Oct 04 18:28:34.958139 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member,admin Oct 04 18:28:34.967352 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/026d601faaae44b68de5701e02af3656"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_026d601faaae44b68de5701e02af3656", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/026d601faaae44b68de5701e02af3656"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/026d601faaae44b68de5701e02af3656"}]}] Oct 04 18:28:34.967352 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-AggregatesAdminTestJSON-1145487060 Oct 04 18:28:34.967352 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 026d601faaae44b68de5701e02af3656 Oct 04 18:28:34.967352 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1145487060 Oct 04 18:28:34.967352 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-AggregatesAdminTestJSON-1145487060-project-admin Oct 04 18:28:34.967352 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:28:34.967352 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:28:34.967352 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: c6344d9f5eae453b87336192e99dc4e6 Oct 04 18:28:34.967352 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-AggregatesAdminTestJSON-1145487060-project-admin Oct 04 18:28:34.967352 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:28:34.967352 n-d-850501-14 devstack@n-api.service[123002]: exception: Aggregate 8 could not be found. Oct 04 18:28:34.967352 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '8'} Oct 04 18:28:34.967352 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:28:34.968394 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:34.968394 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 04 18:28:34.968394 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 04 18:28:34.968394 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 04 18:28:34.968394 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 04 18:28:34.968394 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:28:34.968394 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:28:34.968394 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 04 18:28:34.968394 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 04 18:28:34.968394 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:28:34.968394 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:28:34.968394 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 04 18:28:34.968394 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 04 18:28:34.968394 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 8 could not be found. Oct 04 18:28:34.968394 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:34.968394 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:34.968394 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:34.968394 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:34.968394 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:34.969548 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:34.969548 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:28:34.969548 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:28:34.969548 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:28:34.969548 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:28:34.969548 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 04 18:28:34.969548 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:28:34.969548 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 8 could not be found. Oct 04 18:28:34.969548 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:34.969548 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:34.969548 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:34.969548 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:34.969548 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:34.969548 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:34.969548 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:28:34.969548 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:28:34.969548 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 8 could not be found. Oct 04 18:28:34.969548 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:34.970510 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4a1aca07-6632-4a4f-86ca-1644ee724c8f tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Returning 404 to user: Aggregate 8 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:28:34.970510 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4a1aca07-6632-4a4f-86ca-1644ee724c8f tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates/8" status: 404 len: 77 microversion: 2.1 time: 0.016341 Oct 04 18:28:34.970510 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 126/277] 10.222.0.20 () {58 vars in 1149 bytes} [Tue Oct 4 18:28:34 2022] GET /compute/v2.1/os-aggregates/8 => generated 77 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:28:34.971518 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-af11a995-d4fa-4b5b-aa0e-fd69fe86e2c3 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:34.972589 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-af11a995-d4fa-4b5b-aa0e-fd69fe86e2c3 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] [instance: a8ce9cb7-6601-4d8a-9052-f29620bff27c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:34.980963 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-af11a995-d4fa-4b5b-aa0e-fd69fe86e2c3 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:34.981906 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-944f5d81-392d-4813-b7b2-8a000f8b1d25 tempest-QuotasAdminNegativeTest-76304858 tempest-QuotasAdminNegativeTest-76304858-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/e74fd308b33b4e9a8fc4a4635320a05d" status: 200 len: 329 microversion: 2.1 time: 0.923901 Oct 04 18:28:34.982030 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-af11a995-d4fa-4b5b-aa0e-fd69fe86e2c3 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:34.982488 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 152/278] 10.222.0.20 () {60 vars in 1262 bytes} [Tue Oct 4 18:28:34 2022] PUT /compute/v2.1/os-quota-sets/e74fd308b33b4e9a8fc4a4635320a05d => generated 329 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:28:34.982765 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-af11a995-d4fa-4b5b-aa0e-fd69fe86e2c3 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:34.983765 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-af11a995-d4fa-4b5b-aa0e-fd69fe86e2c3 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:34.984406 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-af11a995-d4fa-4b5b-aa0e-fd69fe86e2c3 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:34.984847 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-af11a995-d4fa-4b5b-aa0e-fd69fe86e2c3 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:34.987632 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-82ea86c6-b1de-45fa-b8a3-c5e036472a8a tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:35.142863 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-82ea86c6-b1de-45fa-b8a3-c5e036472a8a tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.158333 Oct 04 18:28:35.143904 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 153/279] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Oct 4 18:28:34 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 18:28:35.149028 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b6b4ec61-001a-48c5-a5b9-6b27c9fc0795 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:35.171444 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-b6b4ec61-001a-48c5-a5b9-6b27c9fc0795 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] HTTP exception thrown: Aggregate 8 could not be found. Oct 04 18:28:35.177399 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b6b4ec61-001a-48c5-a5b9-6b27c9fc0795 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Request method failure captured: Oct 04 18:28:35.177399 n-d-850501-14 devstack@n-api.service[123001]: request: DELETE /compute/v2.1/os-aggregates/8 HTTP/1.1 Oct 04 18:28:35.177399 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:28:35.177399 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:28:35.177399 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:28:35.177399 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:28:35.177399 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:28:35.177399 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:28:35.177399 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:28:35.177399 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:28:35.177399 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPHsjLxSozoiTL-mMDoe7JGk0DYXnX_5mTszog0W2wPjfzhKyTTXqHwp4SxuEQoxoSf2qXtI6CrwunhqbUkWnj-rCSj_jEBBUiy7ROZXJql0kjd-U78DnazGZgXvC0JOrHM0w272K8jfaBOgPcibqkMCWIq2HnPukUXxb5du6AkHrzhU Oct 04 18:28:35.177399 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:28:35.177399 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:28:35.177399 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:28:35.177399 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:28:35.177399 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:28:35.177399 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:28:35.177399 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 026d601faaae44b68de5701e02af3656 Oct 04 18:28:35.177399 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-AggregatesAdminTestJSON-1145487060 Oct 04 18:28:35.177399 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member,admin Oct 04 18:28:35.177399 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member,admin Oct 04 18:28:35.179495 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/026d601faaae44b68de5701e02af3656"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_026d601faaae44b68de5701e02af3656", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/026d601faaae44b68de5701e02af3656"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/026d601faaae44b68de5701e02af3656"}]}] Oct 04 18:28:35.179495 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-AggregatesAdminTestJSON-1145487060 Oct 04 18:28:35.179495 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 026d601faaae44b68de5701e02af3656 Oct 04 18:28:35.179495 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1145487060 Oct 04 18:28:35.179495 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-AggregatesAdminTestJSON-1145487060-project-admin Oct 04 18:28:35.179495 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:28:35.179495 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:28:35.179495 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: c6344d9f5eae453b87336192e99dc4e6 Oct 04 18:28:35.179495 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-AggregatesAdminTestJSON-1145487060-project-admin Oct 04 18:28:35.179495 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:28:35.179495 n-d-850501-14 devstack@n-api.service[123001]: exception: Aggregate 8 could not be found. Oct 04 18:28:35.179495 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '8'} Oct 04 18:28:35.179495 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:28:35.181155 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:35.181155 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 04 18:28:35.181155 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 04 18:28:35.181155 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 18:28:35.181155 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 18:28:35.181155 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:28:35.181155 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:28:35.181155 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:28:35.181155 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:28:35.181155 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 18:28:35.181155 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 18:28:35.181155 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 04 18:28:35.181155 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 04 18:28:35.181155 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:28:35.181155 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:28:35.181155 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 04 18:28:35.181155 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 04 18:28:35.181155 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:28:35.181155 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:28:35.182155 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 04 18:28:35.182155 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 04 18:28:35.182155 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 8 could not be found. Oct 04 18:28:35.182155 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:35.182155 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:35.182155 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:35.182155 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:35.182155 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:35.182155 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:35.182155 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:28:35.182155 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:28:35.182155 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:28:35.182155 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:28:35.182155 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 04 18:28:35.182155 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:28:35.182155 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 8 could not be found. Oct 04 18:28:35.182155 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:35.182155 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:35.182155 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:35.182155 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:35.182155 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:35.183240 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:35.183240 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:28:35.183240 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:28:35.183240 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 8 could not be found. Oct 04 18:28:35.183240 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:35.185694 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b6b4ec61-001a-48c5-a5b9-6b27c9fc0795 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Returning 404 to user: Aggregate 8 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:28:35.186941 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b6b4ec61-001a-48c5-a5b9-6b27c9fc0795 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/8" status: 404 len: 77 microversion: 2.1 time: 0.041918 Oct 04 18:28:35.192348 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 154/280] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Oct 4 18:28:35 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 77 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:28:35.199783 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a04e0db1-2a90-4515-ae4a-f347a12f0c37 tempest-QuotasAdminNegativeTest-1520574321 tempest-QuotasAdminNegativeTest-1520574321-project] Action: 'update', calling method: .version_select at 0x7fe2599d9b80>, body: {"quota_set": {"ram": 0}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:35.208625 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a04e0db1-2a90-4515-ae4a-f347a12f0c37 tempest-QuotasAdminNegativeTest-1520574321 tempest-QuotasAdminNegativeTest-1520574321-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '8dc1baf76c4a40faa0b260da2310c73b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74fd308b33b4e9a8fc4a4635320a05d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:35.210850 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a04e0db1-2a90-4515-ae4a-f347a12f0c37 tempest-QuotasAdminNegativeTest-1520574321 tempest-QuotasAdminNegativeTest-1520574321-project] Request method failure captured: Oct 04 18:28:35.210850 n-d-850501-14 devstack@n-api.service[123001]: request: PUT /compute/v2.1/os-quota-sets/e74fd308b33b4e9a8fc4a4635320a05d HTTP/1.1 Oct 04 18:28:35.210850 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:28:35.210850 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:28:35.210850 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:28:35.210850 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 25 Oct 04 18:28:35.210850 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:28:35.210850 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:28:35.210850 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:28:35.210850 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:28:35.210850 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPHtGsvGTFmwxKKJo-VRINCgXFPRhR2Qmq8tfbfiBjOItMA9uZ5rUCls4nnDLnv2ku4cVH-f8_Dkippr3UThiwg6DxS3nfylNTEwbE2USHSYIyJhUY043fi4iwD3DOtaL_ZLluuPyAOKvDFazQUqZJlz_OCisUUjZzt19T8kF5xojyOw Oct 04 18:28:35.210850 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:28:35.210850 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:28:35.210850 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:28:35.210850 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:28:35.210850 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:28:35.210850 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:28:35.210850 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: e74fd308b33b4e9a8fc4a4635320a05d Oct 04 18:28:35.210850 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-QuotasAdminNegativeTest-1520574321 Oct 04 18:28:35.210850 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:28:35.210850 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:28:35.212616 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e74fd308b33b4e9a8fc4a4635320a05d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e74fd308b33b4e9a8fc4a4635320a05d", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e74fd308b33b4e9a8fc4a4635320a05d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e74fd308b33b4e9a8fc4a4635320a05d"}]}] Oct 04 18:28:35.212616 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-QuotasAdminNegativeTest-1520574321 Oct 04 18:28:35.212616 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: e74fd308b33b4e9a8fc4a4635320a05d Oct 04 18:28:35.212616 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1520574321 Oct 04 18:28:35.212616 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-QuotasAdminNegativeTest-1520574321-project Oct 04 18:28:35.212616 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:28:35.212616 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:28:35.212616 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 8dc1baf76c4a40faa0b260da2310c73b Oct 04 18:28:35.212616 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-QuotasAdminNegativeTest-1520574321-project Oct 04 18:28:35.212616 n-d-850501-14 devstack@n-api.service[123001]: Oct 04 18:28:35.212616 n-d-850501-14 devstack@n-api.service[123001]: {"quota_set": {"ram": 0}} Oct 04 18:28:35.212616 n-d-850501-14 devstack@n-api.service[123001]: method: Oct 04 18:28:35.212616 n-d-850501-14 devstack@n-api.service[123001]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 04 18:28:35.212616 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': 'e74fd308b33b4e9a8fc4a4635320a05d', 'body': {'quota_set': {'ram': 0}}} Oct 04 18:28:35.213534 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:28:35.213534 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:35.213534 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:35.213534 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:35.213534 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:28:35.213534 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:28:35.213534 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:28:35.213534 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:28:35.213534 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:28:35.213534 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:28:35.213534 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:28:35.213534 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:28:35.213534 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Oct 04 18:28:35.213534 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Oct 04 18:28:35.213534 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:28:35.213534 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:28:35.213534 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:28:35.213534 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:28:35.213534 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Oct 04 18:28:35.214715 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Oct 04 18:28:35.214715 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:28:35.214715 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:28:35.214715 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:28:35.214715 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:28:35.214715 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:28:35.214715 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:28:35.214715 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:28:35.214715 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:28:35.214715 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:28:35.214715 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:28:35.214715 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:28:35.214715 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:28:35.214715 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:28:35.214715 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:28:35.214715 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 04 18:28:35.214715 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:35.214715 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:35.214715 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:35.214715 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:35.216015 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:35.216015 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:35.216015 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:28:35.216015 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:28:35.216015 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 04 18:28:35.216015 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:35.219207 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a04e0db1-2a90-4515-ae4a-f347a12f0c37 tempest-QuotasAdminNegativeTest-1520574321 tempest-QuotasAdminNegativeTest-1520574321-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:28:35.220621 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a04e0db1-2a90-4515-ae4a-f347a12f0c37 tempest-QuotasAdminNegativeTest-1520574321 tempest-QuotasAdminNegativeTest-1520574321-project] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/e74fd308b33b4e9a8fc4a4635320a05d" status: 403 len: 116 microversion: 2.1 time: 0.027075 Oct 04 18:28:35.221492 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 155/281] 10.222.0.20 () {60 vars in 1262 bytes} [Tue Oct 4 18:28:35 2022] PUT /compute/v2.1/os-quota-sets/e74fd308b33b4e9a8fc4a4635320a05d => generated 116 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:28:35.226217 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a3192b31-50c5-4f64-a44c-f759ad3b08be tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1720205130"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:35.231118 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.aggregate [None req-a3192b31-50c5-4f64-a44c-f759ad3b08be tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] Generated uuid d00124f5-0bf4-4fe9-a307-cc0d97c49dfc for aggregate {{(pid=123001) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 18:28:35.324047 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-af11a995-d4fa-4b5b-aa0e-fd69fe86e2c3 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f87d9eaf49545bb8effb170768bb8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e99a0400fe947bb8907857cc4de2899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:35.334606 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-af11a995-d4fa-4b5b-aa0e-fd69fe86e2c3 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] 10.222.0.20 "GET /compute/v2.1/servers/a8ce9cb7-6601-4d8a-9052-f29620bff27c" status: 200 len: 1319 microversion: 2.1 time: 0.372209 Oct 04 18:28:35.344438 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 127/282] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:34 2022] GET /compute/v2.1/servers/a8ce9cb7-6601-4d8a-9052-f29620bff27c => generated 1319 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:35.359080 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1d050e47-e68d-41bf-9ddc-a3d3011f108d tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1880406778"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:35.362861 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.aggregate [None req-1d050e47-e68d-41bf-9ddc-a3d3011f108d tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Generated uuid 0f7ac768-0104-46de-8518-7f1360c7c63d for aggregate {{(pid=123002) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 18:28:35.373528 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a3192b31-50c5-4f64-a44c-f759ad3b08be tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.150807 Oct 04 18:28:35.374968 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 156/283] 10.222.0.20 () {60 vars in 1164 bytes} [Tue Oct 4 18:28:35 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:28:35.382856 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-20c59f60-d720-48ac-8d06-7aa4c3f5e859 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:35.384373 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-20c59f60-d720-48ac-8d06-7aa4c3f5e859 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] [instance: ff1c16fb-1167-4285-8d0c-c0fbb78a2883] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:35.391933 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-20c59f60-d720-48ac-8d06-7aa4c3f5e859 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:35.392453 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-20c59f60-d720-48ac-8d06-7aa4c3f5e859 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:35.392893 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-20c59f60-d720-48ac-8d06-7aa4c3f5e859 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:35.393624 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-20c59f60-d720-48ac-8d06-7aa4c3f5e859 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:35.394084 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-20c59f60-d720-48ac-8d06-7aa4c3f5e859 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:35.394674 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-20c59f60-d720-48ac-8d06-7aa4c3f5e859 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:35.510576 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1d050e47-e68d-41bf-9ddc-a3d3011f108d tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.155393 Oct 04 18:28:35.511372 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 128/284] 10.222.0.20 () {60 vars in 1164 bytes} [Tue Oct 4 18:28:35 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:28:35.645449 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-20c59f60-d720-48ac-8d06-7aa4c3f5e859 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8675d7d8bab840f3a221fdf2ee4c9b5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25214dec3ef24597be8e5acde61de3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:35.658305 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-20c59f60-d720-48ac-8d06-7aa4c3f5e859 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] 10.222.0.20 "GET /compute/v2.1/servers/ff1c16fb-1167-4285-8d0c-c0fbb78a2883" status: 200 len: 1390 microversion: 2.1 time: 0.279006 Oct 04 18:28:35.658305 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 157/285] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:35 2022] GET /compute/v2.1/servers/ff1c16fb-1167-4285-8d0c-c0fbb78a2883 => generated 1390 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:35.661908 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b55d419f-7be3-445d-90a9-63015d06794d tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:35.672310 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b55d419f-7be3-445d-90a9-63015d06794d tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates/10" status: 200 len: 228 microversion: 2.1 time: 0.015247 Oct 04 18:28:35.673208 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 158/286] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Oct 4 18:28:35 2022] GET /compute/v2.1/os-aggregates/10 => generated 228 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:28:35.686617 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f80ca443-c094-4f90-8b08-78aa38cc063f tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:35.866854 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f80ca443-c094-4f90-8b08-78aa38cc063f tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 266 microversion: 2.1 time: 0.184755 Oct 04 18:28:35.875097 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 159/287] 10.222.0.20 () {60 vars in 1194 bytes} [Tue Oct 4 18:28:35 2022] POST /compute/v2.1/os-aggregates/10/action => generated 266 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:28:35.888314 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3dd2c2c6-e09d-476f-b0a4-097eca274a4c tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:35.901381 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=7,nova_api:UPDATE=2,nova_api:DELETE=7 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:28:35.912464 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3dd2c2c6-e09d-476f-b0a4-097eca274a4c tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates/10" status: 200 len: 242 microversion: 2.1 time: 0.036033 Oct 04 18:28:35.913187 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 160/288] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Oct 4 18:28:35 2022] GET /compute/v2.1/os-aggregates/10 => generated 242 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:28:35.914470 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ff503edb-0ade-498e-afdb-e0fad3b90fe4 tempest-AggregatesAdminNegativeTestJSON-632590997 tempest-AggregatesAdminNegativeTestJSON-632590997-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-850501-14"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:35.925097 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ff503edb-0ade-498e-afdb-e0fad3b90fe4 tempest-AggregatesAdminNegativeTestJSON-632590997 tempest-AggregatesAdminNegativeTestJSON-632590997-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': 'd9be3f569b1a4539a011774d5e8bb2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d1b2a26945d4dc8b5392a9e4256be6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:35.925655 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ff503edb-0ade-498e-afdb-e0fad3b90fe4 tempest-AggregatesAdminNegativeTestJSON-632590997 tempest-AggregatesAdminNegativeTestJSON-632590997-project] Request method failure captured: Oct 04 18:28:35.925655 n-d-850501-14 devstack@n-api.service[123002]: request: POST /compute/v2.1/os-aggregates/9/action HTTP/1.1 Oct 04 18:28:35.925655 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:28:35.925655 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:28:35.925655 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:28:35.925655 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 40 Oct 04 18:28:35.925655 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:28:35.925655 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:28:35.925655 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:28:35.925655 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:28:35.925655 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPHsgCFA9WfbKdTas7v4stPJJv-UCFak8NPPbTdqZBCupF5uM8fmvMa_tqXmrxAXrhGgBMVFIGt7_UxB2QsLWxKrKkOyTQ74eBJUMq4xCIJQqbPci2WxPA2_zCE7djqjGa0XvibmJRRsMHM4NSc0GX82_5_x2ELvBxti0vRF_HjdjJho Oct 04 18:28:35.925655 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:28:35.925655 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:28:35.925655 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:28:35.925655 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:28:35.925655 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:28:35.925655 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:28:35.925655 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 4d1b2a26945d4dc8b5392a9e4256be6f Oct 04 18:28:35.925655 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-632590997 Oct 04 18:28:35.925655 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:28:35.925655 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:28:35.927335 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4d1b2a26945d4dc8b5392a9e4256be6f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4d1b2a26945d4dc8b5392a9e4256be6f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4d1b2a26945d4dc8b5392a9e4256be6f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4d1b2a26945d4dc8b5392a9e4256be6f"}]}] Oct 04 18:28:35.927335 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-632590997 Oct 04 18:28:35.927335 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 4d1b2a26945d4dc8b5392a9e4256be6f Oct 04 18:28:35.927335 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-632590997 Oct 04 18:28:35.927335 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-AggregatesAdminNegativeTestJSON-632590997-project Oct 04 18:28:35.927335 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:28:35.927335 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:28:35.927335 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: d9be3f569b1a4539a011774d5e8bb2cd Oct 04 18:28:35.927335 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-632590997-project Oct 04 18:28:35.927335 n-d-850501-14 devstack@n-api.service[123002]: Oct 04 18:28:35.927335 n-d-850501-14 devstack@n-api.service[123002]: {"add_host": {"host": "n-h1-850501-14"}} Oct 04 18:28:35.927335 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:28:35.927335 n-d-850501-14 devstack@n-api.service[123002]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 04 18:28:35.928170 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '9', 'body': {'add_host': {'host': 'n-h1-850501-14'}}} Oct 04 18:28:35.928170 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:28:35.928170 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:35.928170 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:35.928170 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:35.928170 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:28:35.928170 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:28:35.928170 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:28:35.928170 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:28:35.928170 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:28:35.928170 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:28:35.928170 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Oct 04 18:28:35.928170 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Oct 04 18:28:35.928170 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:28:35.928170 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:28:35.928170 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:28:35.928170 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:28:35.928170 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:28:35.928170 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:28:35.929171 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:28:35.929171 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:28:35.929171 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:28:35.929171 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:28:35.929171 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:28:35.929171 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:28:35.929171 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:28:35.929171 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:28:35.929171 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 04 18:28:35.929171 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:35.929171 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:35.929171 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:35.929171 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:35.929171 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:35.929171 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:35.929171 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:28:35.929171 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:28:35.929171 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 04 18:28:35.929171 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:35.930355 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ff503edb-0ade-498e-afdb-e0fad3b90fe4 tempest-AggregatesAdminNegativeTestJSON-632590997 tempest-AggregatesAdminNegativeTestJSON-632590997-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:28:35.930355 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ff503edb-0ade-498e-afdb-e0fad3b90fe4 tempest-AggregatesAdminNegativeTestJSON-632590997 tempest-AggregatesAdminNegativeTestJSON-632590997-project] 10.222.0.20 "POST /compute/v2.1/os-aggregates/9/action" status: 403 len: 118 microversion: 2.1 time: 0.414718 Oct 04 18:28:35.933997 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 129/289] 10.222.0.20 () {60 vars in 1191 bytes} [Tue Oct 4 18:28:35 2022] POST /compute/v2.1/os-aggregates/9/action => generated 118 bytes in 422 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:28:35.940614 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-bcd7e746-a086-413e-8be4-6771cffd6b0c tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:35.944165 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d8f51922-ed2a-4f78-b304-13bcc8e5e9ab tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:36.065466 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-bcd7e746-a086-413e-8be4-6771cffd6b0c tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.137103 Oct 04 18:28:36.066747 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d8f51922-ed2a-4f78-b304-13bcc8e5e9ab tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.128817 Oct 04 18:28:36.067456 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 161/290] 10.222.0.20 () {58 vars in 1155 bytes} [Tue Oct 4 18:28:35 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 18:28:36.079688 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f373d3ed-feab-460c-8dd7-ee8ebfd9ba81 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1965813735", "availability_zone": "tempest-test_az-670001610"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:36.080279 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 130/291] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Oct 4 18:28:35 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 18:28:36.082183 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.aggregate [None req-f373d3ed-feab-460c-8dd7-ee8ebfd9ba81 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Generated uuid 468e6f12-61a1-43ae-8b40-d0acbd41c7e4 for aggregate {{(pid=123001) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 18:28:36.087850 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d936eaa9-0ed1-4f5e-87ce-18dc3272d9ed tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1947405605"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:36.093819 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.aggregate [None req-d936eaa9-0ed1-4f5e-87ce-18dc3272d9ed tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] Generated uuid 5af8101c-ad79-460e-8e47-765a1188ba7a for aggregate {{(pid=123002) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 18:28:36.203882 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d936eaa9-0ed1-4f5e-87ce-18dc3272d9ed tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.121103 Oct 04 18:28:36.204335 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f373d3ed-feab-460c-8dd7-ee8ebfd9ba81 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.131598 Oct 04 18:28:36.205148 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 162/292] 10.222.0.20 () {60 vars in 1165 bytes} [Tue Oct 4 18:28:36 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:28:36.206086 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 131/293] 10.222.0.20 () {60 vars in 1164 bytes} [Tue Oct 4 18:28:36 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:28:36.226237 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2ca9d0eb-8526-421f-8807-08a48410042b tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1965813735_new", "availability_zone": "tempest-test_az-670001610_new"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:36.233805 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f25b81bb-ef6d-4d5b-b5ca-aaed6df45c17 tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-1898208455"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:36.248944 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=8,nova_api:INSERT=8 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:28:36.260276 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f25b81bb-ef6d-4d5b-b5ca-aaed6df45c17 tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:36.262402 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f25b81bb-ef6d-4d5b-b5ca-aaed6df45c17 tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:36.262864 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f25b81bb-ef6d-4d5b-b5ca-aaed6df45c17 tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:36.286416 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f25b81bb-ef6d-4d5b-b5ca-aaed6df45c17 tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:36.287155 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f25b81bb-ef6d-4d5b-b5ca-aaed6df45c17 tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:36.287758 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f25b81bb-ef6d-4d5b-b5ca-aaed6df45c17 tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:36.297496 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-f25b81bb-ef6d-4d5b-b5ca-aaed6df45c17 tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-1898208455 could not be found. Oct 04 18:28:36.302466 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f25b81bb-ef6d-4d5b-b5ca-aaed6df45c17 tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] Request method failure captured: Oct 04 18:28:36.302466 n-d-850501-14 devstack@n-api.service[123002]: request: POST /compute/v2.1/os-aggregates/12/action HTTP/1.1 Oct 04 18:28:36.302466 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:28:36.302466 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:28:36.302466 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:28:36.302466 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 58 Oct 04 18:28:36.302466 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:28:36.302466 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:28:36.302466 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:28:36.302466 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:28:36.302466 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPHsj9nOZ9ioO_efPq3nbDeMPU7oCAYiQMAUFnpAJqRUYWFcj0nO-Vc0rDXFFlNyHWs48QMwNACr4oauXko1gOAqr_7UWOM5Y1zL9Pn_-dp3toI9V46knq8PVOo4nzA_LKdJ6Cds3JRE8UOaG-Bg_oE1iHYmD4wltFvr-dMq30vCrVhs Oct 04 18:28:36.302466 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:28:36.302466 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:28:36.302466 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:28:36.302466 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:28:36.302466 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:28:36.302466 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:28:36.302466 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 3aa0a4867ac0403daa3a5a65747c8b93 Oct 04 18:28:36.302466 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-260413230 Oct 04 18:28:36.302466 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member,admin Oct 04 18:28:36.302466 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member,admin Oct 04 18:28:36.303923 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3aa0a4867ac0403daa3a5a65747c8b93"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3aa0a4867ac0403daa3a5a65747c8b93", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3aa0a4867ac0403daa3a5a65747c8b93"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3aa0a4867ac0403daa3a5a65747c8b93"}]}] Oct 04 18:28:36.303923 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-260413230 Oct 04 18:28:36.303923 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 3aa0a4867ac0403daa3a5a65747c8b93 Oct 04 18:28:36.303923 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-260413230 Oct 04 18:28:36.303923 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin Oct 04 18:28:36.303923 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:28:36.303923 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:28:36.303923 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 5fe40de42fd949d69e11128751c04f60 Oct 04 18:28:36.303923 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin Oct 04 18:28:36.303923 n-d-850501-14 devstack@n-api.service[123002]: Oct 04 18:28:36.303923 n-d-850501-14 devstack@n-api.service[123002]: {"add_host": {"host": "tempest-nonexist_host-1898208455"}} Oct 04 18:28:36.303923 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:28:36.303923 n-d-850501-14 devstack@n-api.service[123002]: exception: Compute host tempest-nonexist_host-1898208455 could not be found. Oct 04 18:28:36.305853 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '12', 'body': {'add_host': {'host': 'tempest-nonexist_host-1898208455'}}} Oct 04 18:28:36.305853 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:28:36.305853 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:36.305853 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 04 18:28:36.305853 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 04 18:28:36.305853 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:28:36.305853 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:28:36.305853 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 04 18:28:36.305853 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 04 18:28:36.305853 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:28:36.305853 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:28:36.305853 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 04 18:28:36.305853 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 04 18:28:36.305853 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-1898208455' is not mapped to any cell Oct 04 18:28:36.305853 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:36.305853 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:36.305853 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:36.305853 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:36.305853 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 04 18:28:36.307778 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 04 18:28:36.307778 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 04 18:28:36.307778 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 04 18:28:36.307778 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 04 18:28:36.307778 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:36.307778 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:36.307778 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:36.307778 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:36.307778 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 04 18:28:36.307778 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 04 18:28:36.307778 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 18:28:36.307778 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 18:28:36.307778 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:28:36.307778 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:28:36.307778 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:28:36.307778 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:28:36.307778 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 18:28:36.307778 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 18:28:36.307778 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6621, in add_host_to_aggregate Oct 04 18:28:36.307778 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Oct 04 18:28:36.309213 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 04 18:28:36.309213 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 04 18:28:36.309213 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-1898208455 could not be found. Oct 04 18:28:36.309213 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:36.309213 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:36.309213 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:36.309213 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:36.309213 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:36.309213 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:36.309213 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:28:36.309213 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:28:36.309213 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:28:36.309213 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:28:36.309213 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:28:36.309213 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:28:36.309213 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Oct 04 18:28:36.309213 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:28:36.309213 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-1898208455 could not be found. Oct 04 18:28:36.309213 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:36.309213 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:36.309213 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:36.310867 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:36.310867 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:36.310867 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:36.310867 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:28:36.310867 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:28:36.310867 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-1898208455 could not be found. Oct 04 18:28:36.310867 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:36.310867 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f25b81bb-ef6d-4d5b-b5ca-aaed6df45c17 tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-1898208455 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:28:36.312753 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f25b81bb-ef6d-4d5b-b5ca-aaed6df45c17 tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/12/action" status: 404 len: 111 microversion: 2.1 time: 0.081088 Oct 04 18:28:36.312753 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 132/294] 10.222.0.20 () {60 vars in 1194 bytes} [Tue Oct 4 18:28:36 2022] POST /compute/v2.1/os-aggregates/12/action => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:28:36.321265 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-eafd488a-4241-4c71-94cc-2e0e7bbf0ac2 tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:36.365680 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2ca9d0eb-8526-421f-8807-08a48410042b tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:36.366187 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2ca9d0eb-8526-421f-8807-08a48410042b tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:36.366628 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2ca9d0eb-8526-421f-8807-08a48410042b tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:36.448616 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-eafd488a-4241-4c71-94cc-2e0e7bbf0ac2 tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.131280 Oct 04 18:28:36.457268 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 133/295] 10.222.0.20 () {58 vars in 1155 bytes} [Tue Oct 4 18:28:36 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 18:28:36.462816 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-42c761de-82e6-47bf-879c-575453868445 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:36.463744 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-42c761de-82e6-47bf-879c-575453868445 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] [instance: a8ce9cb7-6601-4d8a-9052-f29620bff27c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:36.474016 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-42c761de-82e6-47bf-879c-575453868445 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:36.474827 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-42c761de-82e6-47bf-879c-575453868445 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:36.475568 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-42c761de-82e6-47bf-879c-575453868445 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:36.477422 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-42c761de-82e6-47bf-879c-575453868445 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:36.478323 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-42c761de-82e6-47bf-879c-575453868445 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:36.478981 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-42c761de-82e6-47bf-879c-575453868445 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:36.513346 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2ca9d0eb-8526-421f-8807-08a48410042b tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-aggregates/11" status: 200 len: 335 microversion: 2.1 time: 0.292908 Oct 04 18:28:36.514263 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 163/296] 10.222.0.20 () {60 vars in 1173 bytes} [Tue Oct 4 18:28:36 2022] PUT /compute/v2.1/os-aggregates/11 => generated 335 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:28:36.525706 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-fa1ca12a-341c-485c-926b-5640e27696a9 tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:36.534397 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-fa1ca12a-341c-485c-926b-5640e27696a9 tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] Request method failure captured: Oct 04 18:28:36.534397 n-d-850501-14 devstack@n-api.service[123001]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 04 18:28:36.534397 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:28:36.534397 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:28:36.534397 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:28:36.534397 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 283 Oct 04 18:28:36.534397 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:28:36.534397 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:28:36.534397 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:28:36.534397 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:28:36.534397 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPHsj9nOZ9ioO_efPq3nbDeMPU7oCAYiQMAUFnpAJqRUYWFcj0nO-Vc0rDXFFlNyHWs48QMwNACr4oauXko1gOAqr_7UWOM5Y1zL9Pn_-dp3toI9V46knq8PVOo4nzA_LKdJ6Cds3JRE8UOaG-Bg_oE1iHYmD4wltFvr-dMq30vCrVhs Oct 04 18:28:36.534397 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:28:36.534397 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:28:36.534397 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:28:36.534397 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:28:36.534397 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:28:36.534397 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:28:36.534397 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 3aa0a4867ac0403daa3a5a65747c8b93 Oct 04 18:28:36.534397 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-260413230 Oct 04 18:28:36.534397 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member,admin Oct 04 18:28:36.534397 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member,admin Oct 04 18:28:36.535879 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3aa0a4867ac0403daa3a5a65747c8b93"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3aa0a4867ac0403daa3a5a65747c8b93", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3aa0a4867ac0403daa3a5a65747c8b93"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3aa0a4867ac0403daa3a5a65747c8b93"}]}] Oct 04 18:28:36.535879 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-260413230 Oct 04 18:28:36.535879 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 3aa0a4867ac0403daa3a5a65747c8b93 Oct 04 18:28:36.535879 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-260413230 Oct 04 18:28:36.535879 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin Oct 04 18:28:36.535879 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:28:36.535879 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:28:36.535879 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 5fe40de42fd949d69e11128751c04f60 Oct 04 18:28:36.535879 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin Oct 04 18:28:36.535879 n-d-850501-14 devstack@n-api.service[123001]: Oct 04 18:28:36.536514 n-d-850501-14 devstack@n-api.service[123001]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 04 18:28:36.536514 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:28:36.536514 n-d-850501-14 devstack@n-api.service[123001]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 18:28:36.536514 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 04 18:28:36.536514 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:28:36.536514 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:36.536514 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:28:36.536514 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:28:36.536514 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:28:36.536514 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:28:36.537167 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 18:28:36.537167 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:36.537167 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Oct 04 18:28:36.537167 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 18:28:36.537167 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:36.537167 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 04 18:28:36.537167 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 04 18:28:36.537167 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:36.537167 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:36.537167 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:36.537167 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:36.537167 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:36.537167 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:36.537167 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:28:36.537167 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:28:36.537167 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:28:36.537167 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:28:36.538127 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:28:36.538127 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:28:36.538127 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:28:36.538127 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:28:36.538127 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:28:36.538127 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:28:36.538127 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:28:36.538127 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:28:36.538127 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 18:28:36.538127 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:36.538127 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:36.538127 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:36.538127 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:36.538127 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:36.538127 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:36.538999 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:28:36.538999 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:28:36.538999 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 18:28:36.538999 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:36.542072 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-fa1ca12a-341c-485c-926b-5640e27696a9 tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:28:36.544940 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-fa1ca12a-341c-485c-926b-5640e27696a9 tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.029645 Oct 04 18:28:36.549423 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 164/297] 10.222.0.20 () {60 vars in 1165 bytes} [Tue Oct 4 18:28:36 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:28:36.559834 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1af55271-b9c2-465b-8851-98531c57eba7 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:36.576383 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1af55271-b9c2-465b-8851-98531c57eba7 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates" status: 200 len: 338 microversion: 2.1 time: 0.029038 Oct 04 18:28:36.577758 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 165/298] 10.222.0.20 () {58 vars in 1143 bytes} [Tue Oct 4 18:28:36 2022] GET /compute/v2.1/os-aggregates => generated 338 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:28:36.588630 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-24d60968-17aa-40ee-94a0-632a08a01cb9 tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:36.594500 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-24d60968-17aa-40ee-94a0-632a08a01cb9 tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] Request method failure captured: Oct 04 18:28:36.594500 n-d-850501-14 devstack@n-api.service[123001]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 04 18:28:36.594500 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:28:36.594500 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:28:36.594500 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:28:36.594500 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 27 Oct 04 18:28:36.594500 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:28:36.594500 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:28:36.594500 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:28:36.594500 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:28:36.594500 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPHsj9nOZ9ioO_efPq3nbDeMPU7oCAYiQMAUFnpAJqRUYWFcj0nO-Vc0rDXFFlNyHWs48QMwNACr4oauXko1gOAqr_7UWOM5Y1zL9Pn_-dp3toI9V46knq8PVOo4nzA_LKdJ6Cds3JRE8UOaG-Bg_oE1iHYmD4wltFvr-dMq30vCrVhs Oct 04 18:28:36.594500 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:28:36.594500 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:28:36.594500 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:28:36.594500 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:28:36.594500 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:28:36.594500 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:28:36.594500 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 3aa0a4867ac0403daa3a5a65747c8b93 Oct 04 18:28:36.594500 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-260413230 Oct 04 18:28:36.594500 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member,admin Oct 04 18:28:36.594500 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member,admin Oct 04 18:28:36.595785 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3aa0a4867ac0403daa3a5a65747c8b93"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3aa0a4867ac0403daa3a5a65747c8b93", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3aa0a4867ac0403daa3a5a65747c8b93"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3aa0a4867ac0403daa3a5a65747c8b93"}]}] Oct 04 18:28:36.595785 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-260413230 Oct 04 18:28:36.595785 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 3aa0a4867ac0403daa3a5a65747c8b93 Oct 04 18:28:36.595785 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-260413230 Oct 04 18:28:36.595785 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin Oct 04 18:28:36.595785 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:28:36.595785 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:28:36.595785 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 5fe40de42fd949d69e11128751c04f60 Oct 04 18:28:36.595785 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin Oct 04 18:28:36.595785 n-d-850501-14 devstack@n-api.service[123001]: Oct 04 18:28:36.595785 n-d-850501-14 devstack@n-api.service[123001]: {"aggregate": {"name": ""}} Oct 04 18:28:36.595785 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:28:36.595785 n-d-850501-14 devstack@n-api.service[123001]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 04 18:28:36.596683 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'body': {'aggregate': {'name': ''}}} Oct 04 18:28:36.596683 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:28:36.596683 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:36.596683 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:28:36.596683 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:28:36.596683 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:28:36.596683 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:28:36.596683 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 04 18:28:36.596683 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:36.596683 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Oct 04 18:28:36.596683 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 18:28:36.596683 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:36.596683 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 04 18:28:36.596683 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi '' Oct 04 18:28:36.596683 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:36.596683 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:36.596683 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:36.596683 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:36.596683 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:36.596683 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:36.596683 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:28:36.596683 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:28:36.596683 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:28:36.598004 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:28:36.598004 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:28:36.598004 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:28:36.598004 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:28:36.598004 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:28:36.598004 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:28:36.598004 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:28:36.598004 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:28:36.598004 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:28:36.598004 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 04 18:28:36.598004 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:36.598004 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:36.598004 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:36.598004 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:36.598004 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:36.598004 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:36.598004 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:28:36.598004 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:28:36.598004 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 04 18:28:36.598004 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:36.604591 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-24d60968-17aa-40ee-94a0-632a08a01cb9 tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:28:36.605702 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-24d60968-17aa-40ee-94a0-632a08a01cb9 tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.026706 Oct 04 18:28:36.607578 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 166/299] 10.222.0.20 () {60 vars in 1164 bytes} [Tue Oct 4 18:28:36 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:28:36.615790 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8a683dbb-f5fa-4895-bbb2-d265a99d36a2 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:36.808502 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8a683dbb-f5fa-4895-bbb2-d265a99d36a2 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.198987 Oct 04 18:28:36.811006 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 167/300] 10.222.0.20 () {58 vars in 1155 bytes} [Tue Oct 4 18:28:36 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 18:28:36.824872 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e13cf066-1d1b-420c-aec7-99966defc0c8 tempest-AggregatesAdminNegativeTestJSON-632590997 tempest-AggregatesAdminNegativeTestJSON-632590997-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1425139359"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:36.831358 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e13cf066-1d1b-420c-aec7-99966defc0c8 tempest-AggregatesAdminNegativeTestJSON-632590997 tempest-AggregatesAdminNegativeTestJSON-632590997-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': 'd9be3f569b1a4539a011774d5e8bb2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d1b2a26945d4dc8b5392a9e4256be6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:36.834518 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e13cf066-1d1b-420c-aec7-99966defc0c8 tempest-AggregatesAdminNegativeTestJSON-632590997 tempest-AggregatesAdminNegativeTestJSON-632590997-project] Request method failure captured: Oct 04 18:28:36.834518 n-d-850501-14 devstack@n-api.service[123001]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 04 18:28:36.834518 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:28:36.834518 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:28:36.834518 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:28:36.834518 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 60 Oct 04 18:28:36.834518 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:28:36.834518 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:28:36.834518 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:28:36.834518 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:28:36.834518 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPHsgCFA9WfbKdTas7v4stPJJv-UCFak8NPPbTdqZBCupF5uM8fmvMa_tqXmrxAXrhGgBMVFIGt7_UxB2QsLWxKrKkOyTQ74eBJUMq4xCIJQqbPci2WxPA2_zCE7djqjGa0XvibmJRRsMHM4NSc0GX82_5_x2ELvBxti0vRF_HjdjJho Oct 04 18:28:36.834518 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:28:36.834518 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:28:36.834518 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:28:36.834518 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:28:36.834518 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:28:36.834518 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:28:36.834518 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 4d1b2a26945d4dc8b5392a9e4256be6f Oct 04 18:28:36.834518 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-632590997 Oct 04 18:28:36.834518 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:28:36.834518 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:28:36.835826 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4d1b2a26945d4dc8b5392a9e4256be6f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4d1b2a26945d4dc8b5392a9e4256be6f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4d1b2a26945d4dc8b5392a9e4256be6f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4d1b2a26945d4dc8b5392a9e4256be6f"}]}] Oct 04 18:28:36.835826 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-632590997 Oct 04 18:28:36.835826 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 4d1b2a26945d4dc8b5392a9e4256be6f Oct 04 18:28:36.835826 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-632590997 Oct 04 18:28:36.835826 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-AggregatesAdminNegativeTestJSON-632590997-project Oct 04 18:28:36.835826 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:28:36.835826 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:28:36.835826 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: d9be3f569b1a4539a011774d5e8bb2cd Oct 04 18:28:36.835826 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-632590997-project Oct 04 18:28:36.835826 n-d-850501-14 devstack@n-api.service[123001]: Oct 04 18:28:36.835826 n-d-850501-14 devstack@n-api.service[123001]: {"aggregate": {"name": "tempest-test_aggregate-1425139359"}} Oct 04 18:28:36.835826 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:28:36.835826 n-d-850501-14 devstack@n-api.service[123001]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 04 18:28:36.836986 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1425139359'}}} Oct 04 18:28:36.836986 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:28:36.836986 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:36.836986 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:36.836986 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:36.836986 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:28:36.836986 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:28:36.836986 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:28:36.836986 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:28:36.836986 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:28:36.836986 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:28:36.836986 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:28:36.836986 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:28:36.836986 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Oct 04 18:28:36.836986 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Oct 04 18:28:36.836986 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:28:36.836986 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:28:36.836986 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:28:36.836986 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:28:36.838575 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:28:36.838575 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:28:36.838575 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:28:36.838575 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:28:36.838575 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:28:36.838575 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:28:36.838575 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:28:36.838575 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:28:36.838575 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:28:36.838575 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:28:36.838575 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 04 18:28:36.838575 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:36.838575 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:36.838575 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:36.838575 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:36.838575 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:36.838575 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:36.838575 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:28:36.838575 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:28:36.838575 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 04 18:28:36.839673 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:36.840009 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e13cf066-1d1b-420c-aec7-99966defc0c8 tempest-AggregatesAdminNegativeTestJSON-632590997 tempest-AggregatesAdminNegativeTestJSON-632590997-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:28:36.844944 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e13cf066-1d1b-420c-aec7-99966defc0c8 tempest-AggregatesAdminNegativeTestJSON-632590997 tempest-AggregatesAdminNegativeTestJSON-632590997-project] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.023274 Oct 04 18:28:36.845542 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 168/301] 10.222.0.20 () {60 vars in 1164 bytes} [Tue Oct 4 18:28:36 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 34 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:28:36.850328 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9c7987a1-509a-472d-b0b6-9e102c3ca696 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:36.850938 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-9c7987a1-509a-472d-b0b6-9e102c3ca696 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] [instance: ff1c16fb-1167-4285-8d0c-c0fbb78a2883] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:36.871067 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9c7987a1-509a-472d-b0b6-9e102c3ca696 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:36.872605 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9c7987a1-509a-472d-b0b6-9e102c3ca696 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:36.873238 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9c7987a1-509a-472d-b0b6-9e102c3ca696 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:36.873959 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9c7987a1-509a-472d-b0b6-9e102c3ca696 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:36.874414 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9c7987a1-509a-472d-b0b6-9e102c3ca696 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:36.874840 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9c7987a1-509a-472d-b0b6-9e102c3ca696 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:37.306265 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-42c761de-82e6-47bf-879c-575453868445 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f87d9eaf49545bb8effb170768bb8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e99a0400fe947bb8907857cc4de2899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:37.317363 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-42c761de-82e6-47bf-879c-575453868445 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] 10.222.0.20 "GET /compute/v2.1/servers/a8ce9cb7-6601-4d8a-9052-f29620bff27c" status: 200 len: 1319 microversion: 2.1 time: 0.858568 Oct 04 18:28:37.320136 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 134/302] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:36 2022] GET /compute/v2.1/servers/a8ce9cb7-6601-4d8a-9052-f29620bff27c => generated 1319 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:37.330000 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-918d010b-8b69-431c-baba-fdf12b0386bf tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1071858662"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:37.341276 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.aggregate [None req-918d010b-8b69-431c-baba-fdf12b0386bf tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Generated uuid cd2aa7b5-d7c8-48c9-bdb9-c150df5f5a67 for aggregate {{(pid=123002) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 18:28:37.397701 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9c7987a1-509a-472d-b0b6-9e102c3ca696 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8675d7d8bab840f3a221fdf2ee4c9b5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25214dec3ef24597be8e5acde61de3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:37.409462 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9c7987a1-509a-472d-b0b6-9e102c3ca696 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] 10.222.0.20 "GET /compute/v2.1/servers/ff1c16fb-1167-4285-8d0c-c0fbb78a2883" status: 200 len: 1390 microversion: 2.1 time: 0.562693 Oct 04 18:28:37.413697 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 169/303] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:36 2022] GET /compute/v2.1/servers/ff1c16fb-1167-4285-8d0c-c0fbb78a2883 => generated 1390 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:37.426327 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5da52cd4-af12-489d-888e-3299fc7fe353 tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1564953690"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:37.431702 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.aggregate [None req-5da52cd4-af12-489d-888e-3299fc7fe353 tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] Generated uuid c17f1a0d-82cf-4831-86d5-094fdea261ec for aggregate {{(pid=123001) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 18:28:37.493273 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-918d010b-8b69-431c-baba-fdf12b0386bf tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.174323 Oct 04 18:28:37.494504 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 135/304] 10.222.0.20 () {60 vars in 1164 bytes} [Tue Oct 4 18:28:37 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:28:37.549397 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5da52cd4-af12-489d-888e-3299fc7fe353 tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.132845 Oct 04 18:28:37.550387 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 170/305] 10.222.0.20 () {60 vars in 1164 bytes} [Tue Oct 4 18:28:37 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:28:37.555233 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-61775be9-8cbf-493b-9e68-8e1b8b3e27cf tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:37.573049 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-61775be9-8cbf-493b-9e68-8e1b8b3e27cf tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates" status: 200 len: 446 microversion: 2.1 time: 0.021265 Oct 04 18:28:37.575295 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 171/306] 10.222.0.20 () {58 vars in 1143 bytes} [Tue Oct 4 18:28:37 2022] GET /compute/v2.1/os-aggregates => generated 446 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:28:37.579909 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7df34566-4bd7-4df0-95f3-1487906eda3c tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1564953690"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:37.600411 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.aggregate [None req-7df34566-4bd7-4df0-95f3-1487906eda3c tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] Generated uuid 66f4a706-b45c-4c49-a370-cd3b289d8024 for aggregate {{(pid=123001) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 18:28:37.620988 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-7df34566-4bd7-4df0-95f3-1487906eda3c tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1564953690 already exists. Oct 04 18:28:37.625810 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7df34566-4bd7-4df0-95f3-1487906eda3c tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] Request method failure captured: Oct 04 18:28:37.625810 n-d-850501-14 devstack@n-api.service[123001]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 04 18:28:37.625810 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:28:37.625810 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:28:37.625810 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:28:37.625810 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 60 Oct 04 18:28:37.625810 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:28:37.625810 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:28:37.625810 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:28:37.625810 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:28:37.625810 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPHsj9nOZ9ioO_efPq3nbDeMPU7oCAYiQMAUFnpAJqRUYWFcj0nO-Vc0rDXFFlNyHWs48QMwNACr4oauXko1gOAqr_7UWOM5Y1zL9Pn_-dp3toI9V46knq8PVOo4nzA_LKdJ6Cds3JRE8UOaG-Bg_oE1iHYmD4wltFvr-dMq30vCrVhs Oct 04 18:28:37.625810 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:28:37.625810 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:28:37.625810 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:28:37.625810 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:28:37.625810 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:28:37.625810 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:28:37.625810 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 3aa0a4867ac0403daa3a5a65747c8b93 Oct 04 18:28:37.625810 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-260413230 Oct 04 18:28:37.625810 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member,admin Oct 04 18:28:37.625810 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member,admin Oct 04 18:28:37.627041 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3aa0a4867ac0403daa3a5a65747c8b93"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3aa0a4867ac0403daa3a5a65747c8b93", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3aa0a4867ac0403daa3a5a65747c8b93"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3aa0a4867ac0403daa3a5a65747c8b93"}]}] Oct 04 18:28:37.627041 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-260413230 Oct 04 18:28:37.627041 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 3aa0a4867ac0403daa3a5a65747c8b93 Oct 04 18:28:37.627041 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-260413230 Oct 04 18:28:37.627041 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin Oct 04 18:28:37.627041 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:28:37.627041 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:28:37.627041 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 5fe40de42fd949d69e11128751c04f60 Oct 04 18:28:37.627041 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin Oct 04 18:28:37.627041 n-d-850501-14 devstack@n-api.service[123001]: Oct 04 18:28:37.627041 n-d-850501-14 devstack@n-api.service[123001]: {"aggregate": {"name": "tempest-test_aggregate-1564953690"}} Oct 04 18:28:37.627041 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:28:37.627041 n-d-850501-14 devstack@n-api.service[123001]: exception: Aggregate tempest-test_aggregate-1564953690 already exists. Oct 04 18:28:37.627743 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1564953690'}}} Oct 04 18:28:37.627743 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:28:37.627743 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:37.627743 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Oct 04 18:28:37.627743 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Oct 04 18:28:37.627743 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 18:28:37.627743 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 18:28:37.627743 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:28:37.627743 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:28:37.627743 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:28:37.627743 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:28:37.627743 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 18:28:37.627743 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 18:28:37.627743 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6458, in create_aggregate Oct 04 18:28:37.627743 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi aggregate.create() Oct 04 18:28:37.627743 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 04 18:28:37.627743 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 04 18:28:37.627743 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Oct 04 18:28:37.627743 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Oct 04 18:28:37.629665 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:28:37.629665 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:28:37.629665 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Oct 04 18:28:37.629665 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Oct 04 18:28:37.629665 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1564953690 already exists. Oct 04 18:28:37.629665 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:37.629665 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:37.629665 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:37.629665 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:37.629665 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:37.629665 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:37.629665 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:28:37.629665 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:28:37.629665 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:28:37.629665 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:28:37.629665 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:28:37.629665 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:28:37.629665 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:28:37.629665 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:28:37.629665 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Oct 04 18:28:37.631656 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 04 18:28:37.631656 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1564953690 already exists. Oct 04 18:28:37.631656 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:37.631656 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:37.631656 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:37.631656 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:37.631656 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:37.631656 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:37.631656 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:28:37.631656 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:28:37.631656 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1564953690 already exists. Oct 04 18:28:37.631656 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:37.634490 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7df34566-4bd7-4df0-95f3-1487906eda3c tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1564953690 already exists. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:28:37.635616 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7df34566-4bd7-4df0-95f3-1487906eda3c tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.059257 Oct 04 18:28:37.636791 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 172/307] 10.222.0.20 () {60 vars in 1164 bytes} [Tue Oct 4 18:28:37 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 61 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:28:37.643065 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a6b8aeba-5ac4-4053-a946-1fcc3971bd99 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:37.767097 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a6b8aeba-5ac4-4053-a946-1fcc3971bd99 tempest-AggregatesAdminTestJSON-1145487060 tempest-AggregatesAdminTestJSON-1145487060-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.128959 Oct 04 18:28:37.767764 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 173/308] 10.222.0.20 () {58 vars in 1155 bytes} [Tue Oct 4 18:28:37 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 18:28:37.774926 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-798fd731-0f3a-4299-b6bc-44e2c6f5b68e tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:37.915945 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-798fd731-0f3a-4299-b6bc-44e2c6f5b68e tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.144004 Oct 04 18:28:37.915945 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 174/309] 10.222.0.20 () {58 vars in 1155 bytes} [Tue Oct 4 18:28:37 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 18:28:37.925852 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ca7085b5-cd4e-41b6-bf3d-ff72a6f35ccc tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:37.926365 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ca7085b5-cd4e-41b6-bf3d-ff72a6f35ccc tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] [instance: 31110a13-e556-40c8-8d78-5243794ff095] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:37.934670 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-50b25639-224a-4803-888e-d77c44205c3b tempest-QuotaClassesAdmin257Test-1826695721 tempest-QuotaClassesAdmin257Test-1826695721-project-admin] Calling method '.version_select at 0x7fe259870280>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:37.941501 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ca7085b5-cd4e-41b6-bf3d-ff72a6f35ccc tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:37.942255 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ca7085b5-cd4e-41b6-bf3d-ff72a6f35ccc tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:37.942705 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ca7085b5-cd4e-41b6-bf3d-ff72a6f35ccc tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:37.943423 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ca7085b5-cd4e-41b6-bf3d-ff72a6f35ccc tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:37.943877 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ca7085b5-cd4e-41b6-bf3d-ff72a6f35ccc tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:37.944329 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ca7085b5-cd4e-41b6-bf3d-ff72a6f35ccc tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:37.955385 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=69 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:28:37.971783 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-50b25639-224a-4803-888e-d77c44205c3b tempest-QuotaClassesAdmin257Test-1826695721 tempest-QuotaClassesAdmin257Test-1826695721-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.474792 Oct 04 18:28:37.972745 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 136/310] 10.222.0.20 () {60 vars in 1226 bytes} [Tue Oct 4 18:28:37 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:28:37.981016 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:28:37.983064 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-27d54662-1fe9-4cf1-af34-27e92d1d1e4d tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-752041646"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:37.983527 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-ca7085b5-cd4e-41b6-bf3d-ff72a6f35ccc tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] HTTP exception thrown: Instance 31110a13-e556-40c8-8d78-5243794ff095 could not be found. Oct 04 18:28:37.986180 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ca7085b5-cd4e-41b6-bf3d-ff72a6f35ccc tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Request method failure captured: Oct 04 18:28:37.986180 n-d-850501-14 devstack@n-api.service[123001]: request: DELETE /compute/v2.1/servers/31110a13-e556-40c8-8d78-5243794ff095 HTTP/1.1 Oct 04 18:28:37.986180 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:28:37.986180 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:28:37.986180 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:28:37.986180 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:28:37.986180 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:28:37.986180 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:28:37.986180 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:28:37.986180 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:28:37.986180 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPHsgVJDqxxp4glyHgr5PdPkHYojrGsp7WPEuiQVyVjZZ0FfcS0XijguTGCYQoFbrsIuTR7h6UJ1zdYpeTrYWC-E9Q3Th8SWNtIQhS9n2qLubF2zIuchUY33Y0SXsUUfqVlmPm7KYJ0f_CLFfDYUAE0B2v6kiZl_So4IuDbYudYCovrc Oct 04 18:28:37.986180 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:28:37.986180 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:28:37.986180 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:28:37.986180 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:28:37.986180 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:28:37.986180 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:28:37.986180 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 126dad7acaf44f909302eac21c4aafcb Oct 04 18:28:37.986180 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-AggregatesAdminTestJSON-1929223191 Oct 04 18:28:37.986180 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:28:37.986180 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:28:37.990637 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/126dad7acaf44f909302eac21c4aafcb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_126dad7acaf44f909302eac21c4aafcb", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/126dad7acaf44f909302eac21c4aafcb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/126dad7acaf44f909302eac21c4aafcb"}]}] Oct 04 18:28:37.990637 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-AggregatesAdminTestJSON-1929223191 Oct 04 18:28:37.990637 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 126dad7acaf44f909302eac21c4aafcb Oct 04 18:28:37.990637 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1929223191 Oct 04 18:28:37.990637 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-AggregatesAdminTestJSON-1929223191-project Oct 04 18:28:37.990637 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:28:37.990637 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:28:37.990637 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: f86a8d114fbc4eb584934904d8f2ef56 Oct 04 18:28:37.990637 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-AggregatesAdminTestJSON-1929223191-project Oct 04 18:28:37.990637 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:28:37.990637 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 31110a13-e556-40c8-8d78-5243794ff095 could not be found. Oct 04 18:28:37.990637 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '31110a13-e556-40c8-8d78-5243794ff095'} Oct 04 18:28:37.991669 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:28:37.991669 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:37.991669 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:28:37.991669 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:28:37.991669 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:28:37.991669 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:28:37.991669 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:28:37.991669 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:28:37.991669 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:28:37.991669 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:28:37.991669 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31110a13-e556-40c8-8d78-5243794ff095 could not be found. Oct 04 18:28:37.991669 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:37.991669 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:37.991669 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:37.991669 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:37.991669 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:37.991669 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:37.991669 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:28:37.991669 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:28:37.991669 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:28:37.993330 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:28:37.993330 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:28:37.993330 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:28:37.993330 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:28:37.993330 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:28:37.993330 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:28:37.993330 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:28:37.993330 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:28:37.993330 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:28:37.993330 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31110a13-e556-40c8-8d78-5243794ff095 could not be found. Oct 04 18:28:37.993330 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:37.993330 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:37.993330 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:37.993330 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:37.993330 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:37.993330 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:37.993330 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:28:37.993330 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:28:37.993330 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31110a13-e556-40c8-8d78-5243794ff095 could not be found. Oct 04 18:28:37.993330 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:37.994452 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ca7085b5-cd4e-41b6-bf3d-ff72a6f35ccc tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Returning 404 to user: Instance 31110a13-e556-40c8-8d78-5243794ff095 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:28:37.994452 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ca7085b5-cd4e-41b6-bf3d-ff72a6f35ccc tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] 10.222.0.20 "DELETE /compute/v2.1/servers/31110a13-e556-40c8-8d78-5243794ff095" status: 404 len: 111 microversion: 2.1 time: 0.072495 Oct 04 18:28:37.994452 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 175/311] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:28:37 2022] DELETE /compute/v2.1/servers/31110a13-e556-40c8-8d78-5243794ff095 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:28:37.994452 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8c10e6dc-e659-424c-a1f8-abafacea6586 tempest-QuotaClassesAdmin257Test-1826695721 tempest-QuotaClassesAdmin257Test-1826695721-project-admin] Action: 'update', calling method: .version_select at 0x7fe2598edd30>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:37.998941 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.aggregate [None req-27d54662-1fe9-4cf1-af34-27e92d1d1e4d tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] Generated uuid e37d9300-f5f6-4556-be82-ec003315df1f for aggregate {{(pid=123002) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 18:28:38.026965 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=73 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:28:38.141187 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-27d54662-1fe9-4cf1-af34-27e92d1d1e4d tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.165898 Oct 04 18:28:38.142463 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 137/312] 10.222.0.20 () {60 vars in 1164 bytes} [Tue Oct 4 18:28:37 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:28:38.147965 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a043ba8b-fe16-4657-9d0d-6a2118e7dcfe tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:38.149182 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a043ba8b-fe16-4657-9d0d-6a2118e7dcfe tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] [instance: 31110a13-e556-40c8-8d78-5243794ff095] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:38.178182 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a043ba8b-fe16-4657-9d0d-6a2118e7dcfe tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:38.180381 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a043ba8b-fe16-4657-9d0d-6a2118e7dcfe tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:38.188602 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a043ba8b-fe16-4657-9d0d-6a2118e7dcfe tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:38.188602 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a043ba8b-fe16-4657-9d0d-6a2118e7dcfe tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:38.188602 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a043ba8b-fe16-4657-9d0d-6a2118e7dcfe tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:38.188602 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a043ba8b-fe16-4657-9d0d-6a2118e7dcfe tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:38.202782 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-a043ba8b-fe16-4657-9d0d-6a2118e7dcfe tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] HTTP exception thrown: Instance 31110a13-e556-40c8-8d78-5243794ff095 could not be found. Oct 04 18:28:38.210081 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a043ba8b-fe16-4657-9d0d-6a2118e7dcfe tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Request method failure captured: Oct 04 18:28:38.210081 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/31110a13-e556-40c8-8d78-5243794ff095 HTTP/1.1 Oct 04 18:28:38.210081 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:28:38.210081 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:28:38.210081 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:28:38.210081 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:28:38.210081 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:28:38.210081 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:28:38.210081 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:28:38.210081 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:28:38.210081 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPHsgVJDqxxp4glyHgr5PdPkHYojrGsp7WPEuiQVyVjZZ0FfcS0XijguTGCYQoFbrsIuTR7h6UJ1zdYpeTrYWC-E9Q3Th8SWNtIQhS9n2qLubF2zIuchUY33Y0SXsUUfqVlmPm7KYJ0f_CLFfDYUAE0B2v6kiZl_So4IuDbYudYCovrc Oct 04 18:28:38.210081 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:28:38.210081 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:28:38.210081 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:28:38.210081 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:28:38.210081 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:28:38.210081 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:28:38.210081 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 126dad7acaf44f909302eac21c4aafcb Oct 04 18:28:38.210081 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-AggregatesAdminTestJSON-1929223191 Oct 04 18:28:38.210081 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:28:38.210081 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:28:38.212579 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/126dad7acaf44f909302eac21c4aafcb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_126dad7acaf44f909302eac21c4aafcb", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/126dad7acaf44f909302eac21c4aafcb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/126dad7acaf44f909302eac21c4aafcb"}]}] Oct 04 18:28:38.212579 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-AggregatesAdminTestJSON-1929223191 Oct 04 18:28:38.212579 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 126dad7acaf44f909302eac21c4aafcb Oct 04 18:28:38.212579 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1929223191 Oct 04 18:28:38.212579 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-AggregatesAdminTestJSON-1929223191-project Oct 04 18:28:38.212579 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:28:38.212579 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:28:38.212579 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: f86a8d114fbc4eb584934904d8f2ef56 Oct 04 18:28:38.212579 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-AggregatesAdminTestJSON-1929223191-project Oct 04 18:28:38.212579 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:28:38.212579 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 31110a13-e556-40c8-8d78-5243794ff095 could not be found. Oct 04 18:28:38.212579 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '31110a13-e556-40c8-8d78-5243794ff095'} Oct 04 18:28:38.213239 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:28:38.213239 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:38.213239 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:28:38.213239 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:28:38.213239 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:28:38.213239 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:28:38.213239 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:28:38.213239 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:28:38.213239 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:28:38.213239 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:28:38.213239 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31110a13-e556-40c8-8d78-5243794ff095 could not be found. Oct 04 18:28:38.213239 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:38.213239 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:38.213239 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:38.213239 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:38.213239 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:38.213239 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:38.213239 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:28:38.213239 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:28:38.213239 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:28:38.214447 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:28:38.214447 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:28:38.214447 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:28:38.214447 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:28:38.214447 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:28:38.214447 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:28:38.214447 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:28:38.214447 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31110a13-e556-40c8-8d78-5243794ff095 could not be found. Oct 04 18:28:38.214447 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:38.214447 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:38.214447 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:38.214447 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:38.214447 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:38.214447 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:38.214447 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:28:38.214447 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:28:38.214447 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31110a13-e556-40c8-8d78-5243794ff095 could not be found. Oct 04 18:28:38.214447 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:38.215497 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a043ba8b-fe16-4657-9d0d-6a2118e7dcfe tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] Returning 404 to user: Instance 31110a13-e556-40c8-8d78-5243794ff095 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:28:38.215497 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a043ba8b-fe16-4657-9d0d-6a2118e7dcfe tempest-AggregatesAdminTestJSON-1929223191 tempest-AggregatesAdminTestJSON-1929223191-project] 10.222.0.20 "GET /compute/v2.1/servers/31110a13-e556-40c8-8d78-5243794ff095" status: 404 len: 111 microversion: 2.1 time: 0.067811 Oct 04 18:28:38.215497 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 138/313] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:38 2022] GET /compute/v2.1/servers/31110a13-e556-40c8-8d78-5243794ff095 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:28:38.217235 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8163a7df-ba6a-4838-83ac-130ac3685423 tempest-AggregatesAdminNegativeTestJSON-632590997 tempest-AggregatesAdminNegativeTestJSON-632590997-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:38.220078 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8163a7df-ba6a-4838-83ac-130ac3685423 tempest-AggregatesAdminNegativeTestJSON-632590997 tempest-AggregatesAdminNegativeTestJSON-632590997-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': 'd9be3f569b1a4539a011774d5e8bb2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d1b2a26945d4dc8b5392a9e4256be6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:38.220964 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8163a7df-ba6a-4838-83ac-130ac3685423 tempest-AggregatesAdminNegativeTestJSON-632590997 tempest-AggregatesAdminNegativeTestJSON-632590997-project] Request method failure captured: Oct 04 18:28:38.220964 n-d-850501-14 devstack@n-api.service[123002]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Oct 04 18:28:38.220964 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:28:38.220964 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:28:38.220964 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:28:38.220964 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:28:38.220964 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:28:38.220964 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:28:38.220964 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:28:38.220964 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:28:38.220964 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPHsgCFA9WfbKdTas7v4stPJJv-UCFak8NPPbTdqZBCupF5uM8fmvMa_tqXmrxAXrhGgBMVFIGt7_UxB2QsLWxKrKkOyTQ74eBJUMq4xCIJQqbPci2WxPA2_zCE7djqjGa0XvibmJRRsMHM4NSc0GX82_5_x2ELvBxti0vRF_HjdjJho Oct 04 18:28:38.220964 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:28:38.220964 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:28:38.220964 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:28:38.220964 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:28:38.220964 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:28:38.220964 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:28:38.220964 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 4d1b2a26945d4dc8b5392a9e4256be6f Oct 04 18:28:38.220964 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-632590997 Oct 04 18:28:38.220964 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:28:38.220964 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:28:38.223530 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4d1b2a26945d4dc8b5392a9e4256be6f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4d1b2a26945d4dc8b5392a9e4256be6f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4d1b2a26945d4dc8b5392a9e4256be6f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4d1b2a26945d4dc8b5392a9e4256be6f"}]}] Oct 04 18:28:38.223530 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-632590997 Oct 04 18:28:38.223530 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 4d1b2a26945d4dc8b5392a9e4256be6f Oct 04 18:28:38.223530 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-632590997 Oct 04 18:28:38.223530 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-AggregatesAdminNegativeTestJSON-632590997-project Oct 04 18:28:38.223530 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:28:38.223530 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:28:38.223530 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: d9be3f569b1a4539a011774d5e8bb2cd Oct 04 18:28:38.223530 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-632590997-project Oct 04 18:28:38.223530 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:28:38.223530 n-d-850501-14 devstack@n-api.service[123002]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 04 18:28:38.223530 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '15'} Oct 04 18:28:38.224389 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:28:38.224389 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:38.224389 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:38.224389 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:38.224389 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:28:38.224389 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:28:38.224389 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:28:38.224389 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:28:38.224389 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Oct 04 18:28:38.224389 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Oct 04 18:28:38.224389 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:28:38.224389 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:28:38.224389 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:28:38.224389 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:28:38.224389 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:28:38.224389 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:28:38.224389 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:28:38.224389 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:28:38.224389 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:28:38.226145 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:28:38.226145 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:28:38.226145 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:28:38.226145 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:28:38.226145 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:28:38.226145 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 04 18:28:38.226145 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:38.226145 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:38.226145 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:38.226145 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:38.226145 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:38.226145 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:38.226145 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:28:38.226145 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:28:38.226145 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 04 18:28:38.226145 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:38.226145 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8163a7df-ba6a-4838-83ac-130ac3685423 tempest-AggregatesAdminNegativeTestJSON-632590997 tempest-AggregatesAdminNegativeTestJSON-632590997-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:28:38.228336 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8163a7df-ba6a-4838-83ac-130ac3685423 tempest-AggregatesAdminNegativeTestJSON-632590997 tempest-AggregatesAdminNegativeTestJSON-632590997-project] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/15" status: 403 len: 116 microversion: 2.1 time: 0.009377 Oct 04 18:28:38.228336 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 139/314] 10.222.0.20 () {58 vars in 1155 bytes} [Tue Oct 4 18:28:38 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 116 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:28:38.233134 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0e3b6195-91e7-4ef4-843d-538745e44c8a tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:38.325714 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0e3b6195-91e7-4ef4-843d-538745e44c8a tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.096211 Oct 04 18:28:38.326685 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 140/315] 10.222.0.20 () {58 vars in 1155 bytes} [Tue Oct 4 18:28:38 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 18:28:38.336580 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7d6647df-5e75-45f2-a77b-cb5e8027f96e tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:38.372273 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-7d6647df-5e75-45f2-a77b-cb5e8027f96e tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 04 18:28:38.375256 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7d6647df-5e75-45f2-a77b-cb5e8027f96e tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] Request method failure captured: Oct 04 18:28:38.375256 n-d-850501-14 devstack@n-api.service[123002]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 04 18:28:38.375256 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:28:38.375256 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:28:38.375256 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:28:38.375256 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:28:38.375256 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:28:38.375256 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:28:38.375256 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:28:38.375256 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:28:38.375256 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPHsj9nOZ9ioO_efPq3nbDeMPU7oCAYiQMAUFnpAJqRUYWFcj0nO-Vc0rDXFFlNyHWs48QMwNACr4oauXko1gOAqr_7UWOM5Y1zL9Pn_-dp3toI9V46knq8PVOo4nzA_LKdJ6Cds3JRE8UOaG-Bg_oE1iHYmD4wltFvr-dMq30vCrVhs Oct 04 18:28:38.375256 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:28:38.375256 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:28:38.375256 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:28:38.375256 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:28:38.375256 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:28:38.375256 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:28:38.375256 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 3aa0a4867ac0403daa3a5a65747c8b93 Oct 04 18:28:38.375256 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-260413230 Oct 04 18:28:38.375256 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member,admin Oct 04 18:28:38.375256 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member,admin Oct 04 18:28:38.376734 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3aa0a4867ac0403daa3a5a65747c8b93"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3aa0a4867ac0403daa3a5a65747c8b93", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3aa0a4867ac0403daa3a5a65747c8b93"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3aa0a4867ac0403daa3a5a65747c8b93"}]}] Oct 04 18:28:38.376734 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-260413230 Oct 04 18:28:38.376734 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 3aa0a4867ac0403daa3a5a65747c8b93 Oct 04 18:28:38.376734 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-260413230 Oct 04 18:28:38.376734 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin Oct 04 18:28:38.376734 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:28:38.376734 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:28:38.376734 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 5fe40de42fd949d69e11128751c04f60 Oct 04 18:28:38.376734 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin Oct 04 18:28:38.376734 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:28:38.376734 n-d-850501-14 devstack@n-api.service[123002]: exception: Aggregate -1 could not be found. Oct 04 18:28:38.376734 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '-1'} Oct 04 18:28:38.377557 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:28:38.377557 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:38.377557 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 04 18:28:38.377557 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 04 18:28:38.377557 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 18:28:38.377557 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 18:28:38.377557 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:28:38.377557 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:28:38.377557 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:28:38.377557 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:28:38.377557 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 18:28:38.377557 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 18:28:38.377557 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 04 18:28:38.377557 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 04 18:28:38.377557 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:28:38.377557 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:28:38.377557 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 04 18:28:38.377557 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 04 18:28:38.377557 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:28:38.380207 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:28:38.380207 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 04 18:28:38.380207 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 04 18:28:38.380207 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 04 18:28:38.380207 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:38.380207 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:38.380207 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:38.380207 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:38.380207 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:38.380207 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:38.380207 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:28:38.380207 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:28:38.380207 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:28:38.380207 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:28:38.380207 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 04 18:28:38.380207 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:28:38.380207 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 04 18:28:38.380207 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:38.380207 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:38.380207 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:38.380207 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:38.384990 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:38.384990 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:38.384990 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:28:38.384990 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:28:38.384990 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 04 18:28:38.384990 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:38.384990 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7d6647df-5e75-45f2-a77b-cb5e8027f96e tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:28:38.384990 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7d6647df-5e75-45f2-a77b-cb5e8027f96e tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.045168 Oct 04 18:28:38.384990 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 141/316] 10.222.0.20 () {58 vars in 1155 bytes} [Tue Oct 4 18:28:38 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 04 18:28:38.396363 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-36d19e47-4953-4e89-8957-2751e45ab5b5 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:38.398002 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-36d19e47-4953-4e89-8957-2751e45ab5b5 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] [instance: a8ce9cb7-6601-4d8a-9052-f29620bff27c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:38.407070 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-36d19e47-4953-4e89-8957-2751e45ab5b5 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:38.407561 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-36d19e47-4953-4e89-8957-2751e45ab5b5 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:38.408173 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-36d19e47-4953-4e89-8957-2751e45ab5b5 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:38.409062 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-36d19e47-4953-4e89-8957-2751e45ab5b5 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:38.409746 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-36d19e47-4953-4e89-8957-2751e45ab5b5 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:38.410328 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-36d19e47-4953-4e89-8957-2751e45ab5b5 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:38.808088 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-36d19e47-4953-4e89-8957-2751e45ab5b5 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f87d9eaf49545bb8effb170768bb8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e99a0400fe947bb8907857cc4de2899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:38.819298 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-36d19e47-4953-4e89-8957-2751e45ab5b5 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] 10.222.0.20 "GET /compute/v2.1/servers/a8ce9cb7-6601-4d8a-9052-f29620bff27c" status: 200 len: 1319 microversion: 2.1 time: 0.438232 Oct 04 18:28:38.824983 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 142/317] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:38 2022] GET /compute/v2.1/servers/a8ce9cb7-6601-4d8a-9052-f29620bff27c => generated 1319 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:38.832024 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-113fdc4d-9185-4d6c-bcae-04f1f46eb18a tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-288719496"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:38.837303 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.aggregate [None req-113fdc4d-9185-4d6c-bcae-04f1f46eb18a tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] Generated uuid f0aa2504-a436-443a-89e7-88b48b9b70c9 for aggregate {{(pid=123002) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 18:28:38.936722 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-113fdc4d-9185-4d6c-bcae-04f1f46eb18a tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.110283 Oct 04 18:28:38.937780 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 143/318] 10.222.0.20 () {60 vars in 1164 bytes} [Tue Oct 4 18:28:38 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:28:38.948755 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ec671fcc-b525-4be4-8485-c9eaa1376172 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:38.949044 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ec671fcc-b525-4be4-8485-c9eaa1376172 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] [instance: ff1c16fb-1167-4285-8d0c-c0fbb78a2883] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:38.959222 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ec671fcc-b525-4be4-8485-c9eaa1376172 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:38.959853 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ec671fcc-b525-4be4-8485-c9eaa1376172 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:38.960482 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ec671fcc-b525-4be4-8485-c9eaa1376172 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:38.962099 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ec671fcc-b525-4be4-8485-c9eaa1376172 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:38.962573 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ec671fcc-b525-4be4-8485-c9eaa1376172 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:38.963048 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ec671fcc-b525-4be4-8485-c9eaa1376172 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:39.031230 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8c10e6dc-e659-424c-a1f8-abafacea6586 tempest-QuotaClassesAdmin257Test-1826695721 tempest-QuotaClassesAdmin257Test-1826695721-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 1.040660 Oct 04 18:28:39.037325 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 176/319] 10.222.0.20 () {62 vars in 1247 bytes} [Tue Oct 4 18:28:37 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:28:39.043904 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-cfaf4d0e-ebb3-4cd9-a04f-64df0e030ecb tempest-AggregatesAdminNegativeTestJSON-632590997 tempest-AggregatesAdminNegativeTestJSON-632590997-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:39.045327 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-cfaf4d0e-ebb3-4cd9-a04f-64df0e030ecb tempest-AggregatesAdminNegativeTestJSON-632590997 tempest-AggregatesAdminNegativeTestJSON-632590997-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': 'd9be3f569b1a4539a011774d5e8bb2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d1b2a26945d4dc8b5392a9e4256be6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:39.046921 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-cfaf4d0e-ebb3-4cd9-a04f-64df0e030ecb tempest-AggregatesAdminNegativeTestJSON-632590997 tempest-AggregatesAdminNegativeTestJSON-632590997-project] Request method failure captured: Oct 04 18:28:39.046921 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/os-aggregates/16 HTTP/1.1 Oct 04 18:28:39.046921 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:28:39.046921 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:28:39.046921 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:28:39.046921 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:28:39.046921 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:28:39.046921 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:28:39.046921 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:28:39.046921 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:28:39.046921 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPHsgCFA9WfbKdTas7v4stPJJv-UCFak8NPPbTdqZBCupF5uM8fmvMa_tqXmrxAXrhGgBMVFIGt7_UxB2QsLWxKrKkOyTQ74eBJUMq4xCIJQqbPci2WxPA2_zCE7djqjGa0XvibmJRRsMHM4NSc0GX82_5_x2ELvBxti0vRF_HjdjJho Oct 04 18:28:39.046921 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:28:39.046921 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:28:39.046921 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:28:39.046921 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:28:39.046921 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:28:39.046921 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:28:39.046921 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 4d1b2a26945d4dc8b5392a9e4256be6f Oct 04 18:28:39.046921 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-632590997 Oct 04 18:28:39.046921 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:28:39.046921 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:28:39.048309 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4d1b2a26945d4dc8b5392a9e4256be6f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4d1b2a26945d4dc8b5392a9e4256be6f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4d1b2a26945d4dc8b5392a9e4256be6f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4d1b2a26945d4dc8b5392a9e4256be6f"}]}] Oct 04 18:28:39.048309 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-632590997 Oct 04 18:28:39.048309 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 4d1b2a26945d4dc8b5392a9e4256be6f Oct 04 18:28:39.048309 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-632590997 Oct 04 18:28:39.048309 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-AggregatesAdminNegativeTestJSON-632590997-project Oct 04 18:28:39.048309 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:28:39.048309 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:28:39.048309 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: d9be3f569b1a4539a011774d5e8bb2cd Oct 04 18:28:39.048309 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-632590997-project Oct 04 18:28:39.048309 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:28:39.048309 n-d-850501-14 devstack@n-api.service[123001]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 04 18:28:39.048309 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '16'} Oct 04 18:28:39.054621 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:28:39.054621 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:39.054621 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:39.054621 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:39.054621 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:28:39.054621 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:28:39.054621 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:28:39.054621 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:28:39.054621 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Oct 04 18:28:39.054621 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Oct 04 18:28:39.054621 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:28:39.054621 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:28:39.054621 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:28:39.054621 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:28:39.054621 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:28:39.054621 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:28:39.054621 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:28:39.054621 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:28:39.054621 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:28:39.055982 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:28:39.055982 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:28:39.055982 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:28:39.055982 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:28:39.055982 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:28:39.055982 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 04 18:28:39.055982 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:39.055982 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:39.055982 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:39.055982 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:39.055982 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:39.055982 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:39.055982 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:28:39.055982 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:28:39.055982 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 04 18:28:39.055982 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:39.055982 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-cfaf4d0e-ebb3-4cd9-a04f-64df0e030ecb tempest-AggregatesAdminNegativeTestJSON-632590997 tempest-AggregatesAdminNegativeTestJSON-632590997-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:28:39.057032 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-cfaf4d0e-ebb3-4cd9-a04f-64df0e030ecb tempest-AggregatesAdminNegativeTestJSON-632590997 tempest-AggregatesAdminNegativeTestJSON-632590997-project] 10.222.0.20 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.012213 Oct 04 18:28:39.057032 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 177/320] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Oct 4 18:28:39 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:28:39.062575 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8d04a6ca-53fe-4bbc-a82e-3bb3507008c2 tempest-QuotaClassesAdmin257Test-1826695721 tempest-QuotaClassesAdmin257Test-1826695721-project-admin] Calling method '.version_select at 0x7fe2598bf1f0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:39.076236 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8d04a6ca-53fe-4bbc-a82e-3bb3507008c2 tempest-QuotaClassesAdmin257Test-1826695721 tempest-QuotaClassesAdmin257Test-1826695721-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.016798 Oct 04 18:28:39.086752 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 178/321] 10.222.0.20 () {60 vars in 1226 bytes} [Tue Oct 4 18:28:39 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:28:39.090690 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-666b18a3-4811-45b8-bf82-c97d6f567339 tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:39.202973 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-666b18a3-4811-45b8-bf82-c97d6f567339 tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.123090 Oct 04 18:28:39.204128 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 179/322] 10.222.0.20 () {58 vars in 1155 bytes} [Tue Oct 4 18:28:39 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 18:28:39.213610 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c2a62f8e-9409-4765-bdde-78a6add35e64 tempest-QuotaClassesAdmin257Test-1826695721 tempest-QuotaClassesAdmin257Test-1826695721-project-admin] Action: 'update', calling method: .version_select at 0x7fe259945040>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:39.232227 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=71,nova_api:DELETE=10,nova_api:INSERT=10,nova_api:UPDATE=9 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:28:39.311155 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ec671fcc-b525-4be4-8485-c9eaa1376172 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8675d7d8bab840f3a221fdf2ee4c9b5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25214dec3ef24597be8e5acde61de3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:39.319695 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ec671fcc-b525-4be4-8485-c9eaa1376172 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] 10.222.0.20 "GET /compute/v2.1/servers/ff1c16fb-1167-4285-8d0c-c0fbb78a2883" status: 200 len: 1390 microversion: 2.1 time: 0.380785 Oct 04 18:28:39.320992 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 144/323] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:38 2022] GET /compute/v2.1/servers/ff1c16fb-1167-4285-8d0c-c0fbb78a2883 => generated 1390 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:39.326254 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-92361c36-74f1-4bb2-ae6d-b69b050dab97 tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:39.339313 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-92361c36-74f1-4bb2-ae6d-b69b050dab97 tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 04 18:28:39.340916 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-92361c36-74f1-4bb2-ae6d-b69b050dab97 tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] Request method failure captured: Oct 04 18:28:39.340916 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 04 18:28:39.340916 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:28:39.340916 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:28:39.340916 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:28:39.340916 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:28:39.340916 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:28:39.340916 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:28:39.340916 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:28:39.340916 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:28:39.340916 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPHsj9nOZ9ioO_efPq3nbDeMPU7oCAYiQMAUFnpAJqRUYWFcj0nO-Vc0rDXFFlNyHWs48QMwNACr4oauXko1gOAqr_7UWOM5Y1zL9Pn_-dp3toI9V46knq8PVOo4nzA_LKdJ6Cds3JRE8UOaG-Bg_oE1iHYmD4wltFvr-dMq30vCrVhs Oct 04 18:28:39.340916 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:28:39.340916 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:28:39.340916 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:28:39.340916 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:28:39.340916 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:28:39.340916 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:28:39.340916 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 3aa0a4867ac0403daa3a5a65747c8b93 Oct 04 18:28:39.340916 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-260413230 Oct 04 18:28:39.340916 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member,admin Oct 04 18:28:39.340916 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member,admin Oct 04 18:28:39.342213 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3aa0a4867ac0403daa3a5a65747c8b93"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3aa0a4867ac0403daa3a5a65747c8b93", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3aa0a4867ac0403daa3a5a65747c8b93"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3aa0a4867ac0403daa3a5a65747c8b93"}]}] Oct 04 18:28:39.342213 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-260413230 Oct 04 18:28:39.342213 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 3aa0a4867ac0403daa3a5a65747c8b93 Oct 04 18:28:39.342213 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-260413230 Oct 04 18:28:39.342213 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin Oct 04 18:28:39.342213 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:28:39.342213 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:28:39.342213 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 5fe40de42fd949d69e11128751c04f60 Oct 04 18:28:39.342213 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin Oct 04 18:28:39.342213 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:28:39.342213 n-d-850501-14 devstack@n-api.service[123002]: exception: Aggregate -1 could not be found. Oct 04 18:28:39.342213 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '-1'} Oct 04 18:28:39.342933 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:28:39.342933 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:39.342933 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 04 18:28:39.342933 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 04 18:28:39.342933 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 04 18:28:39.342933 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 04 18:28:39.342933 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:28:39.342933 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:28:39.342933 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 04 18:28:39.342933 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 04 18:28:39.342933 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:28:39.342933 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:28:39.342933 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 04 18:28:39.342933 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 04 18:28:39.342933 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 04 18:28:39.342933 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:39.342933 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:39.342933 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:39.342933 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:39.342933 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:39.344004 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:39.344004 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:28:39.344004 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:28:39.344004 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:28:39.344004 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:28:39.344004 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 04 18:28:39.344004 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:28:39.344004 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 04 18:28:39.344004 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:39.344004 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:39.344004 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:39.344004 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:39.344004 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:39.344004 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:39.344004 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:28:39.344004 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:28:39.344004 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 04 18:28:39.344004 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:39.345041 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-92361c36-74f1-4bb2-ae6d-b69b050dab97 tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:28:39.345041 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-92361c36-74f1-4bb2-ae6d-b69b050dab97 tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.020159 Oct 04 18:28:39.346515 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 145/324] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Oct 4 18:28:39 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:28:39.358489 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-17262cdc-ade0-4eaa-b891-6805cee44cc3 tempest-AggregatesAdminNegativeTestJSON-632590997 tempest-AggregatesAdminNegativeTestJSON-632590997-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:39.360025 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-17262cdc-ade0-4eaa-b891-6805cee44cc3 tempest-AggregatesAdminNegativeTestJSON-632590997 tempest-AggregatesAdminNegativeTestJSON-632590997-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': 'd9be3f569b1a4539a011774d5e8bb2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d1b2a26945d4dc8b5392a9e4256be6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:39.361754 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-17262cdc-ade0-4eaa-b891-6805cee44cc3 tempest-AggregatesAdminNegativeTestJSON-632590997 tempest-AggregatesAdminNegativeTestJSON-632590997-project] Request method failure captured: Oct 04 18:28:39.361754 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Oct 04 18:28:39.361754 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:28:39.361754 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:28:39.361754 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:28:39.361754 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:28:39.361754 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:28:39.361754 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:28:39.361754 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:28:39.361754 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:28:39.361754 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPHsgCFA9WfbKdTas7v4stPJJv-UCFak8NPPbTdqZBCupF5uM8fmvMa_tqXmrxAXrhGgBMVFIGt7_UxB2QsLWxKrKkOyTQ74eBJUMq4xCIJQqbPci2WxPA2_zCE7djqjGa0XvibmJRRsMHM4NSc0GX82_5_x2ELvBxti0vRF_HjdjJho Oct 04 18:28:39.361754 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:28:39.361754 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:28:39.361754 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:28:39.361754 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:28:39.361754 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:28:39.361754 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:28:39.361754 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 4d1b2a26945d4dc8b5392a9e4256be6f Oct 04 18:28:39.361754 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-632590997 Oct 04 18:28:39.361754 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:28:39.361754 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:28:39.363052 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4d1b2a26945d4dc8b5392a9e4256be6f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4d1b2a26945d4dc8b5392a9e4256be6f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4d1b2a26945d4dc8b5392a9e4256be6f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4d1b2a26945d4dc8b5392a9e4256be6f"}]}] Oct 04 18:28:39.363052 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-632590997 Oct 04 18:28:39.363052 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 4d1b2a26945d4dc8b5392a9e4256be6f Oct 04 18:28:39.363052 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-632590997 Oct 04 18:28:39.363052 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-AggregatesAdminNegativeTestJSON-632590997-project Oct 04 18:28:39.363052 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:28:39.363052 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:28:39.363052 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: d9be3f569b1a4539a011774d5e8bb2cd Oct 04 18:28:39.363052 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-632590997-project Oct 04 18:28:39.363052 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:28:39.363052 n-d-850501-14 devstack@n-api.service[123002]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 04 18:28:39.363052 n-d-850501-14 devstack@n-api.service[123002]: action_args: {} Oct 04 18:28:39.363850 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:28:39.363850 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:39.363850 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:39.363850 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:39.363850 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:28:39.363850 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:28:39.363850 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:28:39.363850 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:28:39.363850 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Oct 04 18:28:39.363850 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Oct 04 18:28:39.363850 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:28:39.363850 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:28:39.363850 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:28:39.363850 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:28:39.363850 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:28:39.363850 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:28:39.363850 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:28:39.363850 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:28:39.363850 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:28:39.365004 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:28:39.365004 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:28:39.365004 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:28:39.365004 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:28:39.365004 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:28:39.365004 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 04 18:28:39.365004 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:39.365004 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:39.365004 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:39.365004 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:39.365004 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:39.365004 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:39.365004 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:28:39.365004 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:28:39.365004 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 04 18:28:39.365004 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:39.366927 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-17262cdc-ade0-4eaa-b891-6805cee44cc3 tempest-AggregatesAdminNegativeTestJSON-632590997 tempest-AggregatesAdminNegativeTestJSON-632590997-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:28:39.368862 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-17262cdc-ade0-4eaa-b891-6805cee44cc3 tempest-AggregatesAdminNegativeTestJSON-632590997 tempest-AggregatesAdminNegativeTestJSON-632590997-project] 10.222.0.20 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.014172 Oct 04 18:28:39.370518 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 146/325] 10.222.0.20 () {58 vars in 1143 bytes} [Tue Oct 4 18:28:39 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:28:39.388475 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-66525bee-3d87-46c4-8b68-8fa8b9a1121f tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1334329621"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:39.388475 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.aggregate [None req-66525bee-3d87-46c4-8b68-8fa8b9a1121f tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] Generated uuid 5f0c948f-d1d3-4ee5-aa96-d583ec028fcd for aggregate {{(pid=123002) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 18:28:39.497227 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-66525bee-3d87-46c4-8b68-8fa8b9a1121f tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.119758 Oct 04 18:28:39.498147 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 147/326] 10.222.0.20 () {60 vars in 1164 bytes} [Tue Oct 4 18:28:39 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:28:39.509876 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-6cf8937c-5380-4987-b546-70d0c2f58ff9 req-f5fb910d-2229-4131-8965-47429ed926bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff1c16fb-1167-4285-8d0c-c0fbb78a2883", "name": "network-vif-plugged", "status": "completed", "tag": "afa1da21-3240-4ddb-b1d7-ec031e238dee"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:39.531806 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-6cf8937c-5380-4987-b546-70d0c2f58ff9 req-f5fb910d-2229-4131-8965-47429ed926bd service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:39.531806 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-6cf8937c-5380-4987-b546-70d0c2f58ff9 req-f5fb910d-2229-4131-8965-47429ed926bd service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:39.531806 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-6cf8937c-5380-4987-b546-70d0c2f58ff9 req-f5fb910d-2229-4131-8965-47429ed926bd service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:39.541336 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-6cf8937c-5380-4987-b546-70d0c2f58ff9 req-f5fb910d-2229-4131-8965-47429ed926bd service nova] Creating event network-vif-plugged:afa1da21-3240-4ddb-b1d7-ec031e238dee for instance ff1c16fb-1167-4285-8d0c-c0fbb78a2883 on n-h2-850501-14 Oct 04 18:28:39.552518 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-6cf8937c-5380-4987-b546-70d0c2f58ff9 req-f5fb910d-2229-4131-8965-47429ed926bd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046817 Oct 04 18:28:39.554127 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 148/327] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:28:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:28:39.560834 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-77cf267e-123c-49fb-bdbb-ab9ed4a135c2 tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-850501-14"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:39.573142 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-77cf267e-123c-49fb-bdbb-ab9ed4a135c2 tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:39.573987 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-77cf267e-123c-49fb-bdbb-ab9ed4a135c2 tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:39.574625 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-77cf267e-123c-49fb-bdbb-ab9ed4a135c2 tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:39.932207 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-77cf267e-123c-49fb-bdbb-ab9ed4a135c2 tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 244 microversion: 2.1 time: 0.375532 Oct 04 18:28:39.939664 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 149/328] 10.222.0.20 () {60 vars in 1194 bytes} [Tue Oct 4 18:28:39 2022] POST /compute/v2.1/os-aggregates/17/action => generated 244 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:28:39.939664 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5243623c-6056-4c49-94ac-7a4a638816f6 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:39.939664 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5243623c-6056-4c49-94ac-7a4a638816f6 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] [instance: a8ce9cb7-6601-4d8a-9052-f29620bff27c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:39.956415 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5243623c-6056-4c49-94ac-7a4a638816f6 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:39.960698 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5243623c-6056-4c49-94ac-7a4a638816f6 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:39.961655 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5243623c-6056-4c49-94ac-7a4a638816f6 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:39.966323 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5243623c-6056-4c49-94ac-7a4a638816f6 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:39.966901 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5243623c-6056-4c49-94ac-7a4a638816f6 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:39.970961 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5243623c-6056-4c49-94ac-7a4a638816f6 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:40.044199 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c2a62f8e-9409-4765-bdde-78a6add35e64 tempest-QuotaClassesAdmin257Test-1826695721 tempest-QuotaClassesAdmin257Test-1826695721-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.838458 Oct 04 18:28:40.055302 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 180/329] 10.222.0.20 () {62 vars in 1247 bytes} [Tue Oct 4 18:28:39 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:28:40.066332 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-092c5a37-520d-4bcf-8e49-9f8f610168ff tempest-AggregatesAdminNegativeTestJSON-632590997 tempest-AggregatesAdminNegativeTestJSON-632590997-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-850501-14"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:40.072736 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-092c5a37-520d-4bcf-8e49-9f8f610168ff tempest-AggregatesAdminNegativeTestJSON-632590997 tempest-AggregatesAdminNegativeTestJSON-632590997-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': 'd9be3f569b1a4539a011774d5e8bb2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d1b2a26945d4dc8b5392a9e4256be6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:40.079451 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-092c5a37-520d-4bcf-8e49-9f8f610168ff tempest-AggregatesAdminNegativeTestJSON-632590997 tempest-AggregatesAdminNegativeTestJSON-632590997-project] Request method failure captured: Oct 04 18:28:40.079451 n-d-850501-14 devstack@n-api.service[123001]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Oct 04 18:28:40.079451 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:28:40.079451 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:28:40.079451 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:28:40.079451 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 43 Oct 04 18:28:40.079451 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:28:40.079451 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:28:40.079451 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:28:40.079451 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:28:40.079451 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPHsgCFA9WfbKdTas7v4stPJJv-UCFak8NPPbTdqZBCupF5uM8fmvMa_tqXmrxAXrhGgBMVFIGt7_UxB2QsLWxKrKkOyTQ74eBJUMq4xCIJQqbPci2WxPA2_zCE7djqjGa0XvibmJRRsMHM4NSc0GX82_5_x2ELvBxti0vRF_HjdjJho Oct 04 18:28:40.079451 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:28:40.079451 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:28:40.079451 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:28:40.079451 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:28:40.079451 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:28:40.079451 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:28:40.079451 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 4d1b2a26945d4dc8b5392a9e4256be6f Oct 04 18:28:40.079451 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-632590997 Oct 04 18:28:40.079451 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:28:40.079451 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:28:40.080737 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4d1b2a26945d4dc8b5392a9e4256be6f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4d1b2a26945d4dc8b5392a9e4256be6f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4d1b2a26945d4dc8b5392a9e4256be6f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4d1b2a26945d4dc8b5392a9e4256be6f"}]}] Oct 04 18:28:40.080737 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-632590997 Oct 04 18:28:40.080737 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 4d1b2a26945d4dc8b5392a9e4256be6f Oct 04 18:28:40.080737 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-632590997 Oct 04 18:28:40.080737 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-AggregatesAdminNegativeTestJSON-632590997-project Oct 04 18:28:40.080737 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:28:40.080737 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:28:40.080737 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: d9be3f569b1a4539a011774d5e8bb2cd Oct 04 18:28:40.080737 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-632590997-project Oct 04 18:28:40.080737 n-d-850501-14 devstack@n-api.service[123001]: Oct 04 18:28:40.080737 n-d-850501-14 devstack@n-api.service[123001]: {"remove_host": {"host": "n-h1-850501-14"}} Oct 04 18:28:40.080737 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:28:40.080737 n-d-850501-14 devstack@n-api.service[123001]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 04 18:28:40.081777 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'n-h1-850501-14'}}} Oct 04 18:28:40.081777 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:28:40.081777 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:40.081777 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:40.081777 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:40.081777 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:28:40.081777 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:28:40.081777 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:28:40.081777 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:28:40.081777 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:28:40.081777 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:28:40.081777 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Oct 04 18:28:40.081777 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Oct 04 18:28:40.081777 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:28:40.081777 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:28:40.081777 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:28:40.081777 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:28:40.081777 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:28:40.081777 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:28:40.082799 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:28:40.082799 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:28:40.082799 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:28:40.082799 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:28:40.082799 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:28:40.082799 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:28:40.082799 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:28:40.082799 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:28:40.082799 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 04 18:28:40.082799 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:40.082799 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:40.082799 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:40.082799 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:40.082799 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:40.082799 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:40.082799 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:28:40.082799 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:28:40.082799 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 04 18:28:40.082799 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:40.083820 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-092c5a37-520d-4bcf-8e49-9f8f610168ff tempest-AggregatesAdminNegativeTestJSON-632590997 tempest-AggregatesAdminNegativeTestJSON-632590997-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:28:40.083820 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-092c5a37-520d-4bcf-8e49-9f8f610168ff tempest-AggregatesAdminNegativeTestJSON-632590997 tempest-AggregatesAdminNegativeTestJSON-632590997-project] 10.222.0.20 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.024545 Oct 04 18:28:40.083820 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 181/330] 10.222.0.20 () {60 vars in 1194 bytes} [Tue Oct 4 18:28:40 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:28:40.098445 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-be952616-c0ed-4349-9fa1-d0c71557f9c3 tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-850501-14"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:40.121581 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-be952616-c0ed-4349-9fa1-d0c71557f9c3 tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:40.122964 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-be952616-c0ed-4349-9fa1-d0c71557f9c3 tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:40.123693 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-be952616-c0ed-4349-9fa1-d0c71557f9c3 tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:40.245467 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5243623c-6056-4c49-94ac-7a4a638816f6 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f87d9eaf49545bb8effb170768bb8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e99a0400fe947bb8907857cc4de2899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:40.255680 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5243623c-6056-4c49-94ac-7a4a638816f6 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] 10.222.0.20 "GET /compute/v2.1/servers/a8ce9cb7-6601-4d8a-9052-f29620bff27c" status: 200 len: 1319 microversion: 2.1 time: 0.319875 Oct 04 18:28:40.257163 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 150/331] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:39 2022] GET /compute/v2.1/servers/a8ce9cb7-6601-4d8a-9052-f29620bff27c => generated 1319 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:40.343325 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-69867803-693f-4a47-ab0f-338f3dbfd7ba tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:40.344376 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-69867803-693f-4a47-ab0f-338f3dbfd7ba tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] [instance: ff1c16fb-1167-4285-8d0c-c0fbb78a2883] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:40.362999 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-69867803-693f-4a47-ab0f-338f3dbfd7ba tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:40.362999 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-69867803-693f-4a47-ab0f-338f3dbfd7ba tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:40.363451 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-69867803-693f-4a47-ab0f-338f3dbfd7ba tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:40.369782 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-69867803-693f-4a47-ab0f-338f3dbfd7ba tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:40.370571 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-69867803-693f-4a47-ab0f-338f3dbfd7ba tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:40.371021 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-69867803-693f-4a47-ab0f-338f3dbfd7ba tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:40.731380 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-69867803-693f-4a47-ab0f-338f3dbfd7ba tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8675d7d8bab840f3a221fdf2ee4c9b5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25214dec3ef24597be8e5acde61de3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:40.731380 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-69867803-693f-4a47-ab0f-338f3dbfd7ba tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] 10.222.0.20 "GET /compute/v2.1/servers/ff1c16fb-1167-4285-8d0c-c0fbb78a2883" status: 200 len: 1390 microversion: 2.1 time: 0.307949 Oct 04 18:28:40.731380 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 151/332] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:40 2022] GET /compute/v2.1/servers/ff1c16fb-1167-4285-8d0c-c0fbb78a2883 => generated 1390 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:40.895267 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-be952616-c0ed-4349-9fa1-d0c71557f9c3 tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 228 microversion: 2.1 time: 0.805439 Oct 04 18:28:40.899368 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 182/333] 10.222.0.20 () {60 vars in 1194 bytes} [Tue Oct 4 18:28:40 2022] POST /compute/v2.1/os-aggregates/17/action => generated 228 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:28:40.907852 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-46cb7288-2410-4f75-a3c9-a8c69effbcc3 tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:41.126675 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-46cb7288-2410-4f75-a3c9-a8c69effbcc3 tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.222412 Oct 04 18:28:41.127629 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 152/334] 10.222.0.20 () {58 vars in 1155 bytes} [Tue Oct 4 18:28:40 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 18:28:41.138448 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-61932ba2-e308-46cc-ad9f-e5600656b716 tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-427253179"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:41.140972 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.aggregate [None req-61932ba2-e308-46cc-ad9f-e5600656b716 tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] Generated uuid 888bcc80-05d1-4e4b-a3c8-654424308b6b for aggregate {{(pid=123001) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 18:28:41.228626 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-61932ba2-e308-46cc-ad9f-e5600656b716 tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.095126 Oct 04 18:28:41.229650 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 183/335] 10.222.0.20 () {60 vars in 1164 bytes} [Tue Oct 4 18:28:41 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:28:41.241198 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-04a4dc08-f135-4780-99b5-924d961ca0cb tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:41.256807 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-04a4dc08-f135-4780-99b5-924d961ca0cb tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:41.257734 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-04a4dc08-f135-4780-99b5-924d961ca0cb tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:41.258938 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-04a4dc08-f135-4780-99b5-924d961ca0cb tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:41.275937 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-04a4dc08-f135-4780-99b5-924d961ca0cb tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:41.285299 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-04a4dc08-f135-4780-99b5-924d961ca0cb tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:41.285299 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-04a4dc08-f135-4780-99b5-924d961ca0cb tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:41.286513 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-64cc4619-0d75-4d1c-b9ad-2e58e5a17e23 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:41.287255 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-64cc4619-0d75-4d1c-b9ad-2e58e5a17e23 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] [instance: a8ce9cb7-6601-4d8a-9052-f29620bff27c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:41.300942 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-64cc4619-0d75-4d1c-b9ad-2e58e5a17e23 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:41.301487 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-64cc4619-0d75-4d1c-b9ad-2e58e5a17e23 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:41.303136 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.compute.aggregates [None req-04a4dc08-f135-4780-99b5-924d961ca0cb tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 04 18:28:41.303264 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-64cc4619-0d75-4d1c-b9ad-2e58e5a17e23 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:41.305310 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-64cc4619-0d75-4d1c-b9ad-2e58e5a17e23 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:41.306727 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-04a4dc08-f135-4780-99b5-924d961ca0cb tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Oct 04 18:28:41.306966 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-64cc4619-0d75-4d1c-b9ad-2e58e5a17e23 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:41.307374 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-64cc4619-0d75-4d1c-b9ad-2e58e5a17e23 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:41.311840 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-04a4dc08-f135-4780-99b5-924d961ca0cb tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] Request method failure captured: Oct 04 18:28:41.311840 n-d-850501-14 devstack@n-api.service[123002]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Oct 04 18:28:41.311840 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:28:41.311840 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:28:41.311840 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:28:41.311840 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 42 Oct 04 18:28:41.311840 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:28:41.311840 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:28:41.311840 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:28:41.311840 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:28:41.311840 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPHsj9nOZ9ioO_efPq3nbDeMPU7oCAYiQMAUFnpAJqRUYWFcj0nO-Vc0rDXFFlNyHWs48QMwNACr4oauXko1gOAqr_7UWOM5Y1zL9Pn_-dp3toI9V46knq8PVOo4nzA_LKdJ6Cds3JRE8UOaG-Bg_oE1iHYmD4wltFvr-dMq30vCrVhs Oct 04 18:28:41.311840 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:28:41.311840 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:28:41.311840 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:28:41.311840 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:28:41.311840 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:28:41.311840 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:28:41.311840 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 3aa0a4867ac0403daa3a5a65747c8b93 Oct 04 18:28:41.311840 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-260413230 Oct 04 18:28:41.311840 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member,admin Oct 04 18:28:41.311840 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member,admin Oct 04 18:28:41.315150 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3aa0a4867ac0403daa3a5a65747c8b93"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3aa0a4867ac0403daa3a5a65747c8b93", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3aa0a4867ac0403daa3a5a65747c8b93"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3aa0a4867ac0403daa3a5a65747c8b93"}]}] Oct 04 18:28:41.315150 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-260413230 Oct 04 18:28:41.315150 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 3aa0a4867ac0403daa3a5a65747c8b93 Oct 04 18:28:41.315150 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-260413230 Oct 04 18:28:41.315150 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin Oct 04 18:28:41.315150 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:28:41.315150 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:28:41.315150 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 5fe40de42fd949d69e11128751c04f60 Oct 04 18:28:41.315150 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin Oct 04 18:28:41.315150 n-d-850501-14 devstack@n-api.service[123002]: Oct 04 18:28:41.315150 n-d-850501-14 devstack@n-api.service[123002]: {"remove_host": {"host": "nonexist_host"}} Oct 04 18:28:41.315150 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:28:41.315150 n-d-850501-14 devstack@n-api.service[123002]: exception: Cannot remove host nonexist_host in aggregate 18 Oct 04 18:28:41.315930 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Oct 04 18:28:41.315930 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:28:41.315930 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:41.315930 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 04 18:28:41.315930 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 04 18:28:41.315930 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:28:41.315930 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:28:41.315930 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 04 18:28:41.315930 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 04 18:28:41.315930 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:28:41.315930 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:28:41.315930 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 04 18:28:41.315930 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 04 18:28:41.315930 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Oct 04 18:28:41.315930 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:41.315930 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:41.315930 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:41.315930 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:41.315930 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 04 18:28:41.315930 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 04 18:28:41.317146 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 04 18:28:41.317146 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 04 18:28:41.317146 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 04 18:28:41.317146 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:41.317146 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:41.317146 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:41.317146 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:41.317146 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Oct 04 18:28:41.317146 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Oct 04 18:28:41.317146 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 18:28:41.317146 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 18:28:41.317146 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:28:41.317146 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:28:41.317146 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:28:41.317146 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:28:41.317146 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 18:28:41.317146 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 18:28:41.317146 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6683, in remove_host_from_aggregate Oct 04 18:28:41.317146 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Oct 04 18:28:41.317146 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 04 18:28:41.318312 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 04 18:28:41.318312 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 04 18:28:41.318312 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:41.318312 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:41.318312 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:41.318312 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:41.318312 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:41.318312 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:41.318312 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:28:41.318312 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:28:41.318312 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:28:41.318312 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:28:41.318312 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:28:41.318312 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:28:41.318312 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Oct 04 18:28:41.318312 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 18:28:41.318312 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Oct 04 18:28:41.318312 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:41.318312 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:41.318312 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:41.318312 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:41.319496 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:41.319496 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:41.319496 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:28:41.319496 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:28:41.319496 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Oct 04 18:28:41.319496 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:41.323076 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-04a4dc08-f135-4780-99b5-924d961ca0cb tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:28:41.324590 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-04a4dc08-f135-4780-99b5-924d961ca0cb tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.087096 Oct 04 18:28:41.327035 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 153/336] 10.222.0.20 () {60 vars in 1194 bytes} [Tue Oct 4 18:28:41 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:28:41.342102 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-fb3718d7-c4db-4ac4-bfbf-736dadd164f8 tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:41.449394 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-fb3718d7-c4db-4ac4-bfbf-736dadd164f8 tempest-AggregatesAdminNegativeTestJSON-260413230 tempest-AggregatesAdminNegativeTestJSON-260413230-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.116984 Oct 04 18:28:41.450313 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 154/337] 10.222.0.20 () {58 vars in 1155 bytes} [Tue Oct 4 18:28:41 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 18:28:41.585750 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-9f93a16f-a3c6-498a-8c6f-16dd895c9e70 req-4e9ad82e-70a3-4b81-8789-9b9545fa1cd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8ce9cb7-6601-4d8a-9052-f29620bff27c", "name": "network-vif-plugged", "status": "completed", "tag": "5cc09ec0-dc36-4aa6-81fd-e58c3844e0d1"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:41.602871 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-9f93a16f-a3c6-498a-8c6f-16dd895c9e70 req-4e9ad82e-70a3-4b81-8789-9b9545fa1cd8 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:41.602871 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-9f93a16f-a3c6-498a-8c6f-16dd895c9e70 req-4e9ad82e-70a3-4b81-8789-9b9545fa1cd8 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:41.602871 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-9f93a16f-a3c6-498a-8c6f-16dd895c9e70 req-4e9ad82e-70a3-4b81-8789-9b9545fa1cd8 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:41.614357 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-9f93a16f-a3c6-498a-8c6f-16dd895c9e70 req-4e9ad82e-70a3-4b81-8789-9b9545fa1cd8 service nova] Creating event network-vif-plugged:5cc09ec0-dc36-4aa6-81fd-e58c3844e0d1 for instance a8ce9cb7-6601-4d8a-9052-f29620bff27c on n-h1-850501-14 Oct 04 18:28:41.627819 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-9f93a16f-a3c6-498a-8c6f-16dd895c9e70 req-4e9ad82e-70a3-4b81-8789-9b9545fa1cd8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048080 Oct 04 18:28:41.645586 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 155/338] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:28:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:28:41.745544 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c3170720-1f52-4402-b52b-34b55e10fea6 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:41.746555 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c3170720-1f52-4402-b52b-34b55e10fea6 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] [instance: ff1c16fb-1167-4285-8d0c-c0fbb78a2883] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:41.755052 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c3170720-1f52-4402-b52b-34b55e10fea6 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:41.756412 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c3170720-1f52-4402-b52b-34b55e10fea6 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:41.757040 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c3170720-1f52-4402-b52b-34b55e10fea6 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:41.757310 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-64cc4619-0d75-4d1c-b9ad-2e58e5a17e23 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f87d9eaf49545bb8effb170768bb8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e99a0400fe947bb8907857cc4de2899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:41.759085 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c3170720-1f52-4402-b52b-34b55e10fea6 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:41.759707 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c3170720-1f52-4402-b52b-34b55e10fea6 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:41.760317 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c3170720-1f52-4402-b52b-34b55e10fea6 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:41.770941 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-64cc4619-0d75-4d1c-b9ad-2e58e5a17e23 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] 10.222.0.20 "GET /compute/v2.1/servers/a8ce9cb7-6601-4d8a-9052-f29620bff27c" status: 200 len: 1319 microversion: 2.1 time: 0.490468 Oct 04 18:28:41.771592 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 184/339] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:41 2022] GET /compute/v2.1/servers/a8ce9cb7-6601-4d8a-9052-f29620bff27c => generated 1319 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:41.961855 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c3170720-1f52-4402-b52b-34b55e10fea6 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8675d7d8bab840f3a221fdf2ee4c9b5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25214dec3ef24597be8e5acde61de3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:41.969065 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c3170720-1f52-4402-b52b-34b55e10fea6 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] 10.222.0.20 "GET /compute/v2.1/servers/ff1c16fb-1167-4285-8d0c-c0fbb78a2883" status: 200 len: 1390 microversion: 2.1 time: 0.228031 Oct 04 18:28:41.969923 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 156/340] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:41 2022] GET /compute/v2.1/servers/ff1c16fb-1167-4285-8d0c-c0fbb78a2883 => generated 1390 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:42.797452 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-55003e97-4539-49c8-b519-4094f6d07195 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:42.798056 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-55003e97-4539-49c8-b519-4094f6d07195 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] [instance: a8ce9cb7-6601-4d8a-9052-f29620bff27c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:42.807710 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-55003e97-4539-49c8-b519-4094f6d07195 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:42.809135 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-55003e97-4539-49c8-b519-4094f6d07195 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:42.809135 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-55003e97-4539-49c8-b519-4094f6d07195 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:42.809328 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-55003e97-4539-49c8-b519-4094f6d07195 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:42.809788 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-55003e97-4539-49c8-b519-4094f6d07195 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:42.810214 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-55003e97-4539-49c8-b519-4094f6d07195 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:42.959098 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-787a9781-0cfd-41d7-9f9d-cbd3096ada6d tempest-QuotasAdminTestV257-1017813800 tempest-QuotasAdminTestV257-1017813800-project-admin] Action: 'update', calling method: .version_select at 0x7fe2598df820>, body: {"quota_set": {"ram": "5120"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:43.106763 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-55003e97-4539-49c8-b519-4094f6d07195 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f87d9eaf49545bb8effb170768bb8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e99a0400fe947bb8907857cc4de2899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:43.116620 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-55003e97-4539-49c8-b519-4094f6d07195 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] 10.222.0.20 "GET /compute/v2.1/servers/a8ce9cb7-6601-4d8a-9052-f29620bff27c" status: 200 len: 1319 microversion: 2.1 time: 0.322997 Oct 04 18:28:43.121958 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 157/341] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:42 2022] GET /compute/v2.1/servers/a8ce9cb7-6601-4d8a-9052-f29620bff27c => generated 1319 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:28:43.127020 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0b0fe6a8-68a5-4a18-91df-15944c5cd772 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:43.131403 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0b0fe6a8-68a5-4a18-91df-15944c5cd772 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] [instance: ff1c16fb-1167-4285-8d0c-c0fbb78a2883] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:43.150075 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0b0fe6a8-68a5-4a18-91df-15944c5cd772 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:43.151427 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0b0fe6a8-68a5-4a18-91df-15944c5cd772 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:43.151943 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0b0fe6a8-68a5-4a18-91df-15944c5cd772 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:43.153681 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0b0fe6a8-68a5-4a18-91df-15944c5cd772 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:43.154558 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0b0fe6a8-68a5-4a18-91df-15944c5cd772 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:43.155547 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0b0fe6a8-68a5-4a18-91df-15944c5cd772 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:43.384996 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0b0fe6a8-68a5-4a18-91df-15944c5cd772 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8675d7d8bab840f3a221fdf2ee4c9b5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25214dec3ef24597be8e5acde61de3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:43.397389 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0b0fe6a8-68a5-4a18-91df-15944c5cd772 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] 10.222.0.20 "GET /compute/v2.1/servers/ff1c16fb-1167-4285-8d0c-c0fbb78a2883" status: 200 len: 1588 microversion: 2.1 time: 0.273578 Oct 04 18:28:43.398346 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 158/342] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:43 2022] GET /compute/v2.1/servers/ff1c16fb-1167-4285-8d0c-c0fbb78a2883 => generated 1588 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:43.436769 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-25b74de5-7cff-4c22-8f09-8bd5471f116d tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:43.437723 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-25b74de5-7cff-4c22-8f09-8bd5471f116d tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] [instance: ff1c16fb-1167-4285-8d0c-c0fbb78a2883] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:43.451172 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-25b74de5-7cff-4c22-8f09-8bd5471f116d tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:43.454011 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-25b74de5-7cff-4c22-8f09-8bd5471f116d tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:43.454474 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-25b74de5-7cff-4c22-8f09-8bd5471f116d tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:43.455254 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-25b74de5-7cff-4c22-8f09-8bd5471f116d tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:43.458152 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-25b74de5-7cff-4c22-8f09-8bd5471f116d tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:43.458806 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-25b74de5-7cff-4c22-8f09-8bd5471f116d tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:43.629670 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-25b74de5-7cff-4c22-8f09-8bd5471f116d tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] 10.222.0.20 "GET /compute/v2.1/servers/ff1c16fb-1167-4285-8d0c-c0fbb78a2883/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.208608 Oct 04 18:28:43.632586 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 159/343] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Oct 4 18:28:43 2022] GET /compute/v2.1/servers/ff1c16fb-1167-4285-8d0c-c0fbb78a2883/os-interface => generated 284 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:28:43.764830 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-787a9781-0cfd-41d7-9f9d-cbd3096ada6d tempest-QuotasAdminTestV257-1017813800 tempest-QuotasAdminTestV257-1017813800-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:43.768119 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-787a9781-0cfd-41d7-9f9d-cbd3096ada6d tempest-QuotasAdminTestV257-1017813800 tempest-QuotasAdminTestV257-1017813800-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:43.769076 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-787a9781-0cfd-41d7-9f9d-cbd3096ada6d tempest-QuotasAdminTestV257-1017813800 tempest-QuotasAdminTestV257-1017813800-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:43.772354 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-787a9781-0cfd-41d7-9f9d-cbd3096ada6d tempest-QuotasAdminTestV257-1017813800 tempest-QuotasAdminTestV257-1017813800-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:43.774966 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-787a9781-0cfd-41d7-9f9d-cbd3096ada6d tempest-QuotasAdminTestV257-1017813800 tempest-QuotasAdminTestV257-1017813800-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:43.777849 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-787a9781-0cfd-41d7-9f9d-cbd3096ada6d tempest-QuotasAdminTestV257-1017813800 tempest-QuotasAdminTestV257-1017813800-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:43.893195 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-787a9781-0cfd-41d7-9f9d-cbd3096ada6d tempest-QuotasAdminTestV257-1017813800 tempest-QuotasAdminTestV257-1017813800-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/78160e276b6a4a5aa2fca9fce2868ebf" status: 200 len: 148 microversion: 2.57 time: 1.522085 Oct 04 18:28:43.893962 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 185/344] 10.222.0.20 () {62 vars in 1303 bytes} [Tue Oct 4 18:28:42 2022] PUT /compute/v2.1/os-quota-sets/78160e276b6a4a5aa2fca9fce2868ebf => generated 148 bytes in 1524 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:28:43.907339 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8819d12e-a16b-4618-83a0-4c00606685f4 tempest-QuotasAdminTestV257-1017813800 tempest-QuotasAdminTestV257-1017813800-project-admin] Calling method '.version_select at 0x7fe2597d55e0>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:44.151283 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-38b50fe6-67ab-4e2e-9c05-10d7ede8c579 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:44.152089 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-38b50fe6-67ab-4e2e-9c05-10d7ede8c579 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] [instance: a8ce9cb7-6601-4d8a-9052-f29620bff27c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:44.173685 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-38b50fe6-67ab-4e2e-9c05-10d7ede8c579 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:44.176922 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-38b50fe6-67ab-4e2e-9c05-10d7ede8c579 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:44.176922 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-38b50fe6-67ab-4e2e-9c05-10d7ede8c579 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:44.176922 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-38b50fe6-67ab-4e2e-9c05-10d7ede8c579 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:44.177881 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-38b50fe6-67ab-4e2e-9c05-10d7ede8c579 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:44.178531 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-38b50fe6-67ab-4e2e-9c05-10d7ede8c579 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:44.680837 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-38b50fe6-67ab-4e2e-9c05-10d7ede8c579 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f87d9eaf49545bb8effb170768bb8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e99a0400fe947bb8907857cc4de2899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:44.688988 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-38b50fe6-67ab-4e2e-9c05-10d7ede8c579 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] 10.222.0.20 "GET /compute/v2.1/servers/a8ce9cb7-6601-4d8a-9052-f29620bff27c" status: 200 len: 1469 microversion: 2.1 time: 0.542164 Oct 04 18:28:44.697945 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 186/345] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:44 2022] GET /compute/v2.1/servers/a8ce9cb7-6601-4d8a-9052-f29620bff27c => generated 1469 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:44.713895 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6b7fc219-12c4-4cda-837f-941e9c79b99a tempest-DeleteServersAdminTestJSON-1422669194 tempest-DeleteServersAdminTestJSON-1422669194-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:44.723643 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6b7fc219-12c4-4cda-837f-941e9c79b99a tempest-DeleteServersAdminTestJSON-1422669194 tempest-DeleteServersAdminTestJSON-1422669194-project-admin] [instance: a8ce9cb7-6601-4d8a-9052-f29620bff27c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:44.734772 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6b7fc219-12c4-4cda-837f-941e9c79b99a tempest-DeleteServersAdminTestJSON-1422669194 tempest-DeleteServersAdminTestJSON-1422669194-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:44.735629 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6b7fc219-12c4-4cda-837f-941e9c79b99a tempest-DeleteServersAdminTestJSON-1422669194 tempest-DeleteServersAdminTestJSON-1422669194-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:44.736302 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6b7fc219-12c4-4cda-837f-941e9c79b99a tempest-DeleteServersAdminTestJSON-1422669194 tempest-DeleteServersAdminTestJSON-1422669194-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:44.738666 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6b7fc219-12c4-4cda-837f-941e9c79b99a tempest-DeleteServersAdminTestJSON-1422669194 tempest-DeleteServersAdminTestJSON-1422669194-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:44.739378 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6b7fc219-12c4-4cda-837f-941e9c79b99a tempest-DeleteServersAdminTestJSON-1422669194 tempest-DeleteServersAdminTestJSON-1422669194-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:44.739966 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6b7fc219-12c4-4cda-837f-941e9c79b99a tempest-DeleteServersAdminTestJSON-1422669194 tempest-DeleteServersAdminTestJSON-1422669194-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:45.007495 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8819d12e-a16b-4618-83a0-4c00606685f4 tempest-QuotasAdminTestV257-1017813800 tempest-QuotasAdminTestV257-1017813800-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:45.009624 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8819d12e-a16b-4618-83a0-4c00606685f4 tempest-QuotasAdminTestV257-1017813800 tempest-QuotasAdminTestV257-1017813800-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:45.010568 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8819d12e-a16b-4618-83a0-4c00606685f4 tempest-QuotasAdminTestV257-1017813800 tempest-QuotasAdminTestV257-1017813800-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:45.011773 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8819d12e-a16b-4618-83a0-4c00606685f4 tempest-QuotasAdminTestV257-1017813800 tempest-QuotasAdminTestV257-1017813800-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:45.012459 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8819d12e-a16b-4618-83a0-4c00606685f4 tempest-QuotasAdminTestV257-1017813800 tempest-QuotasAdminTestV257-1017813800-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:45.013255 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8819d12e-a16b-4618-83a0-4c00606685f4 tempest-QuotasAdminTestV257-1017813800 tempest-QuotasAdminTestV257-1017813800-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:45.090850 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8819d12e-a16b-4618-83a0-4c00606685f4 tempest-QuotasAdminTestV257-1017813800 tempest-QuotasAdminTestV257-1017813800-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/78160e276b6a4a5aa2fca9fce2868ebf/detail" status: 200 len: 463 microversion: 2.57 time: 1.187098 Oct 04 18:28:45.091215 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 160/346] 10.222.0.20 () {60 vars in 1304 bytes} [Tue Oct 4 18:28:43 2022] GET /compute/v2.1/os-quota-sets/78160e276b6a4a5aa2fca9fce2868ebf/detail => generated 463 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:28:45.140535 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6b7fc219-12c4-4cda-837f-941e9c79b99a tempest-DeleteServersAdminTestJSON-1422669194 tempest-DeleteServersAdminTestJSON-1422669194-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/a8ce9cb7-6601-4d8a-9052-f29620bff27c/action" status: 202 len: 0 microversion: 2.1 time: 0.432917 Oct 04 18:28:45.141229 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 187/347] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:28:44 2022] POST /compute/v2.1/servers/a8ce9cb7-6601-4d8a-9052-f29620bff27c/action => generated 0 bytes in 434 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:28:45.150818 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4a3e1874-0215-4b92-b344-d1550139176c tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:45.151730 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4a3e1874-0215-4b92-b344-d1550139176c tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] [instance: a8ce9cb7-6601-4d8a-9052-f29620bff27c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:45.182348 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4a3e1874-0215-4b92-b344-d1550139176c tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:45.187457 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4a3e1874-0215-4b92-b344-d1550139176c tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:45.188401 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4a3e1874-0215-4b92-b344-d1550139176c tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:45.189445 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4a3e1874-0215-4b92-b344-d1550139176c tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:45.190739 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4a3e1874-0215-4b92-b344-d1550139176c tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:45.193769 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4a3e1874-0215-4b92-b344-d1550139176c tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:45.273258 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4a3e1874-0215-4b92-b344-d1550139176c tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:45.274804 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4a3e1874-0215-4b92-b344-d1550139176c tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:45.278825 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4a3e1874-0215-4b92-b344-d1550139176c tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:45.278825 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-4a3e1874-0215-4b92-b344-d1550139176c tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lazy-loading 'fault' on Instance uuid a8ce9cb7-6601-4d8a-9052-f29620bff27c {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:28:45.849322 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4a3e1874-0215-4b92-b344-d1550139176c tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f87d9eaf49545bb8effb170768bb8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e99a0400fe947bb8907857cc4de2899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:45.864136 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4a3e1874-0215-4b92-b344-d1550139176c tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] 10.222.0.20 "GET /compute/v2.1/servers/a8ce9cb7-6601-4d8a-9052-f29620bff27c" status: 200 len: 1452 microversion: 2.1 time: 0.712255 Oct 04 18:28:45.864136 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 161/348] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:45 2022] GET /compute/v2.1/servers/a8ce9cb7-6601-4d8a-9052-f29620bff27c => generated 1452 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:45.881920 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-bba7f18d-24b9-49e7-8a6d-957be5ad3273 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:45.882470 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-bba7f18d-24b9-49e7-8a6d-957be5ad3273 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] [instance: a8ce9cb7-6601-4d8a-9052-f29620bff27c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:45.897934 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bba7f18d-24b9-49e7-8a6d-957be5ad3273 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:45.897934 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bba7f18d-24b9-49e7-8a6d-957be5ad3273 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:45.897934 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bba7f18d-24b9-49e7-8a6d-957be5ad3273 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:45.897934 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bba7f18d-24b9-49e7-8a6d-957be5ad3273 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:45.898233 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bba7f18d-24b9-49e7-8a6d-957be5ad3273 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:45.898233 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bba7f18d-24b9-49e7-8a6d-957be5ad3273 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:45.926315 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-bba7f18d-24b9-49e7-8a6d-957be5ad3273 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] [instance: a8ce9cb7-6601-4d8a-9052-f29620bff27c] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:28:46.342998 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-bba7f18d-24b9-49e7-8a6d-957be5ad3273 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a8ce9cb7-6601-4d8a-9052-f29620bff27c" status: 204 len: 0 microversion: 2.1 time: 0.465054 Oct 04 18:28:46.356589 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 188/349] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:28:45 2022] DELETE /compute/v2.1/servers/a8ce9cb7-6601-4d8a-9052-f29620bff27c => generated 0 bytes in 480 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:28:46.367152 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c26894a0-8362-4afd-95b5-f4c0d1e3c2e9 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:46.369722 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c26894a0-8362-4afd-95b5-f4c0d1e3c2e9 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] [instance: a8ce9cb7-6601-4d8a-9052-f29620bff27c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:46.396523 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c26894a0-8362-4afd-95b5-f4c0d1e3c2e9 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:46.399866 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c26894a0-8362-4afd-95b5-f4c0d1e3c2e9 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:46.401397 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c26894a0-8362-4afd-95b5-f4c0d1e3c2e9 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:46.404962 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c26894a0-8362-4afd-95b5-f4c0d1e3c2e9 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:46.405514 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c26894a0-8362-4afd-95b5-f4c0d1e3c2e9 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:46.405963 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c26894a0-8362-4afd-95b5-f4c0d1e3c2e9 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:46.438920 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-86259737-63b2-41be-95dd-288499ea1ea1 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:46.439808 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-86259737-63b2-41be-95dd-288499ea1ea1 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] [instance: ff1c16fb-1167-4285-8d0c-c0fbb78a2883] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:46.465571 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-86259737-63b2-41be-95dd-288499ea1ea1 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:46.466219 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-86259737-63b2-41be-95dd-288499ea1ea1 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:46.467524 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-86259737-63b2-41be-95dd-288499ea1ea1 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:46.470039 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-86259737-63b2-41be-95dd-288499ea1ea1 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:46.471351 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-86259737-63b2-41be-95dd-288499ea1ea1 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:46.471861 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-86259737-63b2-41be-95dd-288499ea1ea1 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:46.597262 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c26894a0-8362-4afd-95b5-f4c0d1e3c2e9 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:46.597756 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c26894a0-8362-4afd-95b5-f4c0d1e3c2e9 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:46.598183 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c26894a0-8362-4afd-95b5-f4c0d1e3c2e9 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:46.598635 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-c26894a0-8362-4afd-95b5-f4c0d1e3c2e9 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lazy-loading 'fault' on Instance uuid a8ce9cb7-6601-4d8a-9052-f29620bff27c {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:28:46.980860 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-86259737-63b2-41be-95dd-288499ea1ea1 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8675d7d8bab840f3a221fdf2ee4c9b5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25214dec3ef24597be8e5acde61de3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:46.989664 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-86259737-63b2-41be-95dd-288499ea1ea1 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] 10.222.0.20 "GET /compute/v2.1/servers/ff1c16fb-1167-4285-8d0c-c0fbb78a2883" status: 200 len: 1588 microversion: 2.1 time: 0.560042 Oct 04 18:28:46.994755 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 189/350] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:46 2022] GET /compute/v2.1/servers/ff1c16fb-1167-4285-8d0c-c0fbb78a2883 => generated 1588 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:47.002604 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-009eb247-17d9-4d5b-a4c0-fc1e311b928e req-1f6362eb-fffa-4fbc-b7cc-7891bb34200c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff1c16fb-1167-4285-8d0c-c0fbb78a2883", "tag": "afa1da21-3240-4ddb-b1d7-ec031e238dee"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:47.029831 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-009eb247-17d9-4d5b-a4c0-fc1e311b928e req-1f6362eb-fffa-4fbc-b7cc-7891bb34200c service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:47.030484 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-009eb247-17d9-4d5b-a4c0-fc1e311b928e req-1f6362eb-fffa-4fbc-b7cc-7891bb34200c service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:47.031338 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-009eb247-17d9-4d5b-a4c0-fc1e311b928e req-1f6362eb-fffa-4fbc-b7cc-7891bb34200c service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:47.056303 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c26894a0-8362-4afd-95b5-f4c0d1e3c2e9 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f87d9eaf49545bb8effb170768bb8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e99a0400fe947bb8907857cc4de2899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:47.067437 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-009eb247-17d9-4d5b-a4c0-fc1e311b928e req-1f6362eb-fffa-4fbc-b7cc-7891bb34200c service nova] Creating event network-changed:afa1da21-3240-4ddb-b1d7-ec031e238dee for instance ff1c16fb-1167-4285-8d0c-c0fbb78a2883 on n-h2-850501-14 Oct 04 18:28:47.070107 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c26894a0-8362-4afd-95b5-f4c0d1e3c2e9 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] 10.222.0.20 "GET /compute/v2.1/servers/a8ce9cb7-6601-4d8a-9052-f29620bff27c" status: 200 len: 1458 microversion: 2.1 time: 0.708317 Oct 04 18:28:47.072092 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 162/351] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:46 2022] GET /compute/v2.1/servers/a8ce9cb7-6601-4d8a-9052-f29620bff27c => generated 1458 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:47.103556 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a4aeef00-0266-4c79-8983-861cc7a58f93 tempest-QuotasAdminTestV257-1017813800 tempest-QuotasAdminTestV257-1017813800-project-admin] Action: 'update', calling method: .version_select at 0x7fe2597a2310>, body: {"quota_set": {"ram": "2048"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:47.106322 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-009eb247-17d9-4d5b-a4c0-fc1e311b928e req-1f6362eb-fffa-4fbc-b7cc-7891bb34200c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106255 Oct 04 18:28:47.111223 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 190/352] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:28:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:28:48.104960 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-296a16db-fb35-405d-9b60-d03467611595 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:48.107470 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-296a16db-fb35-405d-9b60-d03467611595 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] [instance: a8ce9cb7-6601-4d8a-9052-f29620bff27c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:48.124653 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-296a16db-fb35-405d-9b60-d03467611595 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:48.126900 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-296a16db-fb35-405d-9b60-d03467611595 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:48.127608 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-296a16db-fb35-405d-9b60-d03467611595 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:48.129065 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-296a16db-fb35-405d-9b60-d03467611595 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:48.130459 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-296a16db-fb35-405d-9b60-d03467611595 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:48.133992 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-296a16db-fb35-405d-9b60-d03467611595 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:48.208095 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-296a16db-fb35-405d-9b60-d03467611595 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:48.208575 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-296a16db-fb35-405d-9b60-d03467611595 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:48.209013 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-296a16db-fb35-405d-9b60-d03467611595 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:48.209473 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-296a16db-fb35-405d-9b60-d03467611595 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lazy-loading 'fault' on Instance uuid a8ce9cb7-6601-4d8a-9052-f29620bff27c {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:28:48.453225 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a4aeef00-0266-4c79-8983-861cc7a58f93 tempest-QuotasAdminTestV257-1017813800 tempest-QuotasAdminTestV257-1017813800-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:48.454294 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a4aeef00-0266-4c79-8983-861cc7a58f93 tempest-QuotasAdminTestV257-1017813800 tempest-QuotasAdminTestV257-1017813800-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:48.454733 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a4aeef00-0266-4c79-8983-861cc7a58f93 tempest-QuotasAdminTestV257-1017813800 tempest-QuotasAdminTestV257-1017813800-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:48.455468 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a4aeef00-0266-4c79-8983-861cc7a58f93 tempest-QuotasAdminTestV257-1017813800 tempest-QuotasAdminTestV257-1017813800-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:48.455933 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a4aeef00-0266-4c79-8983-861cc7a58f93 tempest-QuotasAdminTestV257-1017813800 tempest-QuotasAdminTestV257-1017813800-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:48.461087 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a4aeef00-0266-4c79-8983-861cc7a58f93 tempest-QuotasAdminTestV257-1017813800 tempest-QuotasAdminTestV257-1017813800-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:48.526413 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=8,nova_api:INSERT=5 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:28:48.583992 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a4aeef00-0266-4c79-8983-861cc7a58f93 tempest-QuotasAdminTestV257-1017813800 tempest-QuotasAdminTestV257-1017813800-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:48.584435 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a4aeef00-0266-4c79-8983-861cc7a58f93 tempest-QuotasAdminTestV257-1017813800 tempest-QuotasAdminTestV257-1017813800-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:48.584880 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a4aeef00-0266-4c79-8983-861cc7a58f93 tempest-QuotasAdminTestV257-1017813800 tempest-QuotasAdminTestV257-1017813800-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:48.585640 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a4aeef00-0266-4c79-8983-861cc7a58f93 tempest-QuotasAdminTestV257-1017813800 tempest-QuotasAdminTestV257-1017813800-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:48.586950 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a4aeef00-0266-4c79-8983-861cc7a58f93 tempest-QuotasAdminTestV257-1017813800 tempest-QuotasAdminTestV257-1017813800-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:48.587413 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a4aeef00-0266-4c79-8983-861cc7a58f93 tempest-QuotasAdminTestV257-1017813800 tempest-QuotasAdminTestV257-1017813800-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:48.610741 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-296a16db-fb35-405d-9b60-d03467611595 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f87d9eaf49545bb8effb170768bb8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e99a0400fe947bb8907857cc4de2899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:48.619730 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=100 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:28:48.625911 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-296a16db-fb35-405d-9b60-d03467611595 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] 10.222.0.20 "GET /compute/v2.1/servers/a8ce9cb7-6601-4d8a-9052-f29620bff27c" status: 200 len: 1458 microversion: 2.1 time: 0.523476 Oct 04 18:28:48.627824 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 191/353] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:48 2022] GET /compute/v2.1/servers/a8ce9cb7-6601-4d8a-9052-f29620bff27c => generated 1458 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:48.857500 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a4aeef00-0266-4c79-8983-861cc7a58f93 tempest-QuotasAdminTestV257-1017813800 tempest-QuotasAdminTestV257-1017813800-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/78160e276b6a4a5aa2fca9fce2868ebf?user_id=d5b8b4d6bbfb4445bc10c0df822d0c88" status: 200 len: 148 microversion: 2.57 time: 1.784055 Oct 04 18:28:48.860164 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 163/354] 10.222.0.20 () {62 vars in 1384 bytes} [Tue Oct 4 18:28:47 2022] PUT /compute/v2.1/os-quota-sets/78160e276b6a4a5aa2fca9fce2868ebf?user_id=d5b8b4d6bbfb4445bc10c0df822d0c88 => generated 148 bytes in 1786 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:28:48.865743 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-c065a401-c544-41d0-a62f-7b35bbaf24f2 req-18dad685-c761-46be-b665-08d2b5a0b981 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8ce9cb7-6601-4d8a-9052-f29620bff27c", "name": "network-vif-deleted", "tag": "5cc09ec0-dc36-4aa6-81fd-e58c3844e0d1"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:48.877443 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-c065a401-c544-41d0-a62f-7b35bbaf24f2 req-18dad685-c761-46be-b665-08d2b5a0b981 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:48.878667 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-c065a401-c544-41d0-a62f-7b35bbaf24f2 req-18dad685-c761-46be-b665-08d2b5a0b981 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:48.880871 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-c065a401-c544-41d0-a62f-7b35bbaf24f2 req-18dad685-c761-46be-b665-08d2b5a0b981 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:48.907687 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-c065a401-c544-41d0-a62f-7b35bbaf24f2 req-18dad685-c761-46be-b665-08d2b5a0b981 service nova] Creating event network-vif-deleted:5cc09ec0-dc36-4aa6-81fd-e58c3844e0d1 for instance a8ce9cb7-6601-4d8a-9052-f29620bff27c on n-h1-850501-14 Oct 04 18:28:48.915975 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-c065a401-c544-41d0-a62f-7b35bbaf24f2 req-18dad685-c761-46be-b665-08d2b5a0b981 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054367 Oct 04 18:28:48.916685 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 164/355] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:28:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:28:48.923747 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-73b22b7f-beb8-4ace-9cc3-b96631392cc6 tempest-QuotasAdminTestV257-1017813800 tempest-QuotasAdminTestV257-1017813800-project-admin] Calling method '.version_select at 0x7fe2597b5670>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:49.283797 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5ca56576-d0cf-4ddb-9e2f-c3b43558c085 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1987165441", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:49.353931 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.neutron [None req-5ca56576-d0cf-4ddb-9e2f-c3b43558c085 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] validate_networks() for None {{(pid=123001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:28:49.700607 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-5ca56576-d0cf-4ddb-9e2f-c3b43558c085 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:28:49.705910 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-5ca56576-d0cf-4ddb-9e2f-c3b43558c085 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:28:49.705910 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-5ca56576-d0cf-4ddb-9e2f-c3b43558c085 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:28:49.705910 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-5ca56576-d0cf-4ddb-9e2f-c3b43558c085 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:28:49.744410 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-5ca56576-d0cf-4ddb-9e2f-c3b43558c085 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:28:49.792683 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5ca56576-d0cf-4ddb-9e2f-c3b43558c085 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:49.793188 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5ca56576-d0cf-4ddb-9e2f-c3b43558c085 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:49.797314 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5ca56576-d0cf-4ddb-9e2f-c3b43558c085 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:49.800683 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5ca56576-d0cf-4ddb-9e2f-c3b43558c085 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:49.801171 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5ca56576-d0cf-4ddb-9e2f-c3b43558c085 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:49.801613 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5ca56576-d0cf-4ddb-9e2f-c3b43558c085 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:49.807631 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-73b22b7f-beb8-4ace-9cc3-b96631392cc6 tempest-QuotasAdminTestV257-1017813800 tempest-QuotasAdminTestV257-1017813800-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/78160e276b6a4a5aa2fca9fce2868ebf?user_id=d5b8b4d6bbfb4445bc10c0df822d0c88" status: 200 len: 190 microversion: 2.57 time: 0.889337 Oct 04 18:28:49.814530 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 165/356] 10.222.0.20 () {60 vars in 1364 bytes} [Tue Oct 4 18:28:48 2022] GET /compute/v2.1/os-quota-sets/78160e276b6a4a5aa2fca9fce2868ebf?user_id=d5b8b4d6bbfb4445bc10c0df822d0c88 => generated 190 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:28:49.814530 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4a4bb99b-b144-4197-8800-b6bfa92ba8ee tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:49.816309 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4a4bb99b-b144-4197-8800-b6bfa92ba8ee tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] [instance: a8ce9cb7-6601-4d8a-9052-f29620bff27c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:49.823379 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4a4bb99b-b144-4197-8800-b6bfa92ba8ee tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:49.824077 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4a4bb99b-b144-4197-8800-b6bfa92ba8ee tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:49.824877 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4a4bb99b-b144-4197-8800-b6bfa92ba8ee tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:49.825592 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4a4bb99b-b144-4197-8800-b6bfa92ba8ee tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:49.826894 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4a4bb99b-b144-4197-8800-b6bfa92ba8ee tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:49.827381 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4a4bb99b-b144-4197-8800-b6bfa92ba8ee tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:49.829782 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=15 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:28:49.855606 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-5ca56576-d0cf-4ddb-9e2f-c3b43558c085 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Getting quotas for project 771211a4ce424aa48920ff102c894a9f. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:28:49.861837 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-5ca56576-d0cf-4ddb-9e2f-c3b43558c085 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Getting quotas for user 07dd131fa3c44d439d0f3ec6e4b8ad42 and project 771211a4ce424aa48920ff102c894a9f. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:28:49.881433 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4a4bb99b-b144-4197-8800-b6bfa92ba8ee tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:49.881971 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4a4bb99b-b144-4197-8800-b6bfa92ba8ee tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:49.884137 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4a4bb99b-b144-4197-8800-b6bfa92ba8ee tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:49.885002 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-4a4bb99b-b144-4197-8800-b6bfa92ba8ee tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lazy-loading 'fault' on Instance uuid a8ce9cb7-6601-4d8a-9052-f29620bff27c {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:28:49.902480 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5ca56576-d0cf-4ddb-9e2f-c3b43558c085 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Going to run 1 instances... {{(pid=123001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:28:49.910844 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5ca56576-d0cf-4ddb-9e2f-c3b43558c085 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: 2e85db28-c393-4e02-8f28-bf0d217b6db7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:28:49.963531 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4a4bb99b-b144-4197-8800-b6bfa92ba8ee tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f87d9eaf49545bb8effb170768bb8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e99a0400fe947bb8907857cc4de2899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:49.974784 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4a4bb99b-b144-4197-8800-b6bfa92ba8ee tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] 10.222.0.20 "GET /compute/v2.1/servers/a8ce9cb7-6601-4d8a-9052-f29620bff27c" status: 200 len: 1309 microversion: 2.1 time: 0.164472 Oct 04 18:28:49.977035 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 166/357] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:49 2022] GET /compute/v2.1/servers/a8ce9cb7-6601-4d8a-9052-f29620bff27c => generated 1309 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:50.115603 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5ca56576-d0cf-4ddb-9e2f-c3b43558c085 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.385421 Oct 04 18:28:50.120533 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 192/358] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:28:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1388 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 18:28:50.135963 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e17ff89a-2bc7-453b-ae86-c849e53ca4f6 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:50.136643 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e17ff89a-2bc7-453b-ae86-c849e53ca4f6 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: 2e85db28-c393-4e02-8f28-bf0d217b6db7] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:50.255907 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e17ff89a-2bc7-453b-ae86-c849e53ca4f6 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:50.266902 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e17ff89a-2bc7-453b-ae86-c849e53ca4f6 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/2e85db28-c393-4e02-8f28-bf0d217b6db7" status: 200 len: 1217 microversion: 2.1 time: 0.132853 Oct 04 18:28:50.269819 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 193/359] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:50 2022] GET /compute/v2.1/servers/2e85db28-c393-4e02-8f28-bf0d217b6db7 => generated 1217 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:50.324378 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-337ec114-3a6a-4797-9f8b-4f91366c3add tempest-FlavorMetadataValidation-278100153 tempest-FlavorMetadataValidation-278100153-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-428253602", "id": 705530771, "os-flavor-access:is_public": "True"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:50.485736 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-337ec114-3a6a-4797-9f8b-4f91366c3add tempest-FlavorMetadataValidation-278100153 tempest-FlavorMetadataValidation-278100153-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 467 microversion: 2.86 time: 0.508805 Oct 04 18:28:50.486496 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 167/360] 10.222.0.20 () {62 vars in 1188 bytes} [Tue Oct 4 18:28:49 2022] POST /compute/v2.1/flavors => generated 467 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:28:50.501549 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-bbb77306-a382-4b58-a743-5d8d415ff63d tempest-FlavorMetadataValidation-278100153 tempest-FlavorMetadataValidation-278100153-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:50.914596 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-bbb77306-a382-4b58-a743-5d8d415ff63d tempest-FlavorMetadataValidation-278100153 tempest-FlavorMetadataValidation-278100153-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/705530771/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.417307 Oct 04 18:28:50.917855 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 194/361] 10.222.0.20 () {62 vars in 1262 bytes} [Tue Oct 4 18:28:50 2022] POST /compute/v2.1/flavors/705530771/os-extra_specs => generated 62 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:50.927644 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-62bd95bc-0182-471e-bda5-11bc087ad7ae tempest-FlavorMetadataValidation-278100153 tempest-FlavorMetadataValidation-278100153-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:50.999773 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4763e07f-0176-4ecb-9bc0-29d1386fc70b tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:51.000723 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-4763e07f-0176-4ecb-9bc0-29d1386fc70b tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] [instance: a8ce9cb7-6601-4d8a-9052-f29620bff27c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:51.007584 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4763e07f-0176-4ecb-9bc0-29d1386fc70b tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:51.008685 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4763e07f-0176-4ecb-9bc0-29d1386fc70b tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:51.009213 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4763e07f-0176-4ecb-9bc0-29d1386fc70b tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:51.010313 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4763e07f-0176-4ecb-9bc0-29d1386fc70b tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:51.010763 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4763e07f-0176-4ecb-9bc0-29d1386fc70b tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:51.011181 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4763e07f-0176-4ecb-9bc0-29d1386fc70b tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:51.033838 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-4763e07f-0176-4ecb-9bc0-29d1386fc70b tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] HTTP exception thrown: Instance a8ce9cb7-6601-4d8a-9052-f29620bff27c could not be found. Oct 04 18:28:51.035695 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4763e07f-0176-4ecb-9bc0-29d1386fc70b tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Request method failure captured: Oct 04 18:28:51.035695 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/a8ce9cb7-6601-4d8a-9052-f29620bff27c HTTP/1.1 Oct 04 18:28:51.035695 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:28:51.035695 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:28:51.035695 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:28:51.035695 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:28:51.035695 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:28:51.035695 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:28:51.035695 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:28:51.035695 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:28:51.035695 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPHsdGC86QKxox70z4N6mdNeGYL7dredhlk2BhDAD-uwBFDVahMgnolZoWnH_4aas_hl9crqH58IGaAkwMPM89IzrLE60fTzB30CTpzyJSbZR5P0nQpNuVXKahgoGR0K-HTryT-g0_4i5mJelfqXttjQDjtkrm4kn1uUjW_Ask3a7wOE Oct 04 18:28:51.035695 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:28:51.035695 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:28:51.035695 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:28:51.035695 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:28:51.035695 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:28:51.035695 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:28:51.035695 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 1e99a0400fe947bb8907857cc4de2899 Oct 04 18:28:51.035695 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1376130247 Oct 04 18:28:51.035695 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:28:51.035695 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:28:51.036987 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1e99a0400fe947bb8907857cc4de2899"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1e99a0400fe947bb8907857cc4de2899", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1e99a0400fe947bb8907857cc4de2899"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1e99a0400fe947bb8907857cc4de2899"}]}] Oct 04 18:28:51.036987 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-DeleteServersAdminTestJSON-1376130247 Oct 04 18:28:51.036987 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 1e99a0400fe947bb8907857cc4de2899 Oct 04 18:28:51.036987 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1376130247 Oct 04 18:28:51.036987 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-DeleteServersAdminTestJSON-1376130247-project Oct 04 18:28:51.036987 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:28:51.036987 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:28:51.036987 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 7f87d9eaf49545bb8effb170768bb8e7 Oct 04 18:28:51.036987 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-DeleteServersAdminTestJSON-1376130247-project Oct 04 18:28:51.036987 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:28:51.036987 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance a8ce9cb7-6601-4d8a-9052-f29620bff27c could not be found. Oct 04 18:28:51.036987 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': 'a8ce9cb7-6601-4d8a-9052-f29620bff27c'} Oct 04 18:28:51.037655 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:28:51.037655 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:51.037655 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:28:51.037655 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:28:51.037655 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:28:51.037655 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:28:51.037655 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:28:51.037655 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:28:51.037655 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:28:51.037655 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:28:51.037655 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8ce9cb7-6601-4d8a-9052-f29620bff27c could not be found. Oct 04 18:28:51.037655 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:51.037655 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:51.037655 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:51.037655 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:51.037655 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:51.037655 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:51.037655 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:28:51.037655 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:28:51.037655 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:28:51.038875 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:28:51.038875 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:28:51.038875 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:28:51.038875 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:28:51.038875 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:28:51.038875 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:28:51.038875 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:28:51.038875 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8ce9cb7-6601-4d8a-9052-f29620bff27c could not be found. Oct 04 18:28:51.038875 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:51.038875 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:51.038875 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:51.038875 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:51.038875 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:51.038875 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:51.038875 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:28:51.038875 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:28:51.038875 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8ce9cb7-6601-4d8a-9052-f29620bff27c could not be found. Oct 04 18:28:51.038875 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:51.047971 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4763e07f-0176-4ecb-9bc0-29d1386fc70b tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Returning 404 to user: Instance a8ce9cb7-6601-4d8a-9052-f29620bff27c could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:28:51.047971 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-4763e07f-0176-4ecb-9bc0-29d1386fc70b tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] 10.222.0.20 "GET /compute/v2.1/servers/a8ce9cb7-6601-4d8a-9052-f29620bff27c" status: 404 len: 111 microversion: 2.1 time: 0.046258 Oct 04 18:28:51.047971 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 195/362] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:50 2022] GET /compute/v2.1/servers/a8ce9cb7-6601-4d8a-9052-f29620bff27c => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:28:51.062687 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d26ae6ad-782c-441a-9a6b-b0bbbeac28e2 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:51.063183 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d26ae6ad-782c-441a-9a6b-b0bbbeac28e2 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] [instance: a8ce9cb7-6601-4d8a-9052-f29620bff27c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:51.066785 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-62bd95bc-0182-471e-bda5-11bc087ad7ae tempest-FlavorMetadataValidation-278100153 tempest-FlavorMetadataValidation-278100153-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/705530771" status: 202 len: 0 microversion: 2.86 time: 0.144023 Oct 04 18:28:51.068232 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 168/363] 10.222.0.20 () {60 vars in 1199 bytes} [Tue Oct 4 18:28:50 2022] DELETE /compute/v2.1/flavors/705530771 => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:28:51.074507 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d26ae6ad-782c-441a-9a6b-b0bbbeac28e2 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:51.075746 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d26ae6ad-782c-441a-9a6b-b0bbbeac28e2 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:51.076328 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d26ae6ad-782c-441a-9a6b-b0bbbeac28e2 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:51.077494 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d26ae6ad-782c-441a-9a6b-b0bbbeac28e2 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:51.078274 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d26ae6ad-782c-441a-9a6b-b0bbbeac28e2 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:51.078711 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d26ae6ad-782c-441a-9a6b-b0bbbeac28e2 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:51.083695 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-75968f04-ddf3-45dd-b2b3-6055a6989dd2 tempest-FlavorMetadataValidation-278100153 tempest-FlavorMetadataValidation-278100153-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:51.114411 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-d26ae6ad-782c-441a-9a6b-b0bbbeac28e2 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] HTTP exception thrown: Instance a8ce9cb7-6601-4d8a-9052-f29620bff27c could not be found. Oct 04 18:28:51.116630 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d26ae6ad-782c-441a-9a6b-b0bbbeac28e2 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Request method failure captured: Oct 04 18:28:51.116630 n-d-850501-14 devstack@n-api.service[123001]: request: DELETE /compute/v2.1/servers/a8ce9cb7-6601-4d8a-9052-f29620bff27c HTTP/1.1 Oct 04 18:28:51.116630 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:28:51.116630 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:28:51.116630 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:28:51.116630 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:28:51.116630 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:28:51.116630 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:28:51.116630 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:28:51.116630 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:28:51.116630 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPHsdGC86QKxox70z4N6mdNeGYL7dredhlk2BhDAD-uwBFDVahMgnolZoWnH_4aas_hl9crqH58IGaAkwMPM89IzrLE60fTzB30CTpzyJSbZR5P0nQpNuVXKahgoGR0K-HTryT-g0_4i5mJelfqXttjQDjtkrm4kn1uUjW_Ask3a7wOE Oct 04 18:28:51.116630 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:28:51.116630 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:28:51.116630 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:28:51.116630 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:28:51.116630 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:28:51.116630 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:28:51.116630 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 1e99a0400fe947bb8907857cc4de2899 Oct 04 18:28:51.116630 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1376130247 Oct 04 18:28:51.116630 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:28:51.116630 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:28:51.118492 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1e99a0400fe947bb8907857cc4de2899"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1e99a0400fe947bb8907857cc4de2899", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1e99a0400fe947bb8907857cc4de2899"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1e99a0400fe947bb8907857cc4de2899"}]}] Oct 04 18:28:51.118492 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-DeleteServersAdminTestJSON-1376130247 Oct 04 18:28:51.118492 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 1e99a0400fe947bb8907857cc4de2899 Oct 04 18:28:51.118492 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1376130247 Oct 04 18:28:51.118492 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-DeleteServersAdminTestJSON-1376130247-project Oct 04 18:28:51.118492 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:28:51.118492 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:28:51.118492 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 7f87d9eaf49545bb8effb170768bb8e7 Oct 04 18:28:51.118492 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-DeleteServersAdminTestJSON-1376130247-project Oct 04 18:28:51.118492 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:28:51.118492 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance a8ce9cb7-6601-4d8a-9052-f29620bff27c could not be found. Oct 04 18:28:51.118492 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': 'a8ce9cb7-6601-4d8a-9052-f29620bff27c'} Oct 04 18:28:51.119178 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:28:51.119178 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:51.119178 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:28:51.119178 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:28:51.119178 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:28:51.119178 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:28:51.119178 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:28:51.119178 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:28:51.119178 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:28:51.119178 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:28:51.119178 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8ce9cb7-6601-4d8a-9052-f29620bff27c could not be found. Oct 04 18:28:51.119178 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:51.119178 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:51.119178 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:51.119178 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:51.119178 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:51.119178 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:51.119178 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:28:51.119178 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:28:51.119178 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:28:51.120306 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:28:51.120306 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:28:51.120306 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:28:51.120306 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:28:51.120306 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:28:51.120306 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:28:51.120306 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:28:51.120306 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:28:51.120306 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:28:51.120306 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8ce9cb7-6601-4d8a-9052-f29620bff27c could not be found. Oct 04 18:28:51.120306 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:51.120306 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:51.120306 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:51.120306 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:51.120306 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:51.120306 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:51.120306 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:28:51.120306 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:28:51.120306 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8ce9cb7-6601-4d8a-9052-f29620bff27c could not be found. Oct 04 18:28:51.120306 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:51.122538 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d26ae6ad-782c-441a-9a6b-b0bbbeac28e2 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Returning 404 to user: Instance a8ce9cb7-6601-4d8a-9052-f29620bff27c could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:28:51.122538 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d26ae6ad-782c-441a-9a6b-b0bbbeac28e2 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a8ce9cb7-6601-4d8a-9052-f29620bff27c" status: 404 len: 111 microversion: 2.1 time: 0.060479 Oct 04 18:28:51.124697 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 196/364] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:28:51 2022] DELETE /compute/v2.1/servers/a8ce9cb7-6601-4d8a-9052-f29620bff27c => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:28:51.135559 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ff52fea6-470d-4cca-9d31-81952fb831d6 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:51.140020 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ff52fea6-470d-4cca-9d31-81952fb831d6 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] [instance: a8ce9cb7-6601-4d8a-9052-f29620bff27c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:51.140464 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-75968f04-ddf3-45dd-b2b3-6055a6989dd2 tempest-FlavorMetadataValidation-278100153 tempest-FlavorMetadataValidation-278100153-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 6683 microversion: 2.86 time: 0.059556 Oct 04 18:28:51.140640 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:UPDATE=8,nova_api:SELECT=80,nova_api:DELETE=1,nova_api:INSERT=7,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:28:51.141922 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 169/365] 10.222.0.20 () {60 vars in 1187 bytes} [Tue Oct 4 18:28:51 2022] GET /compute/v2.1/flavors/detail => generated 6683 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:28:51.148594 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ff52fea6-470d-4cca-9d31-81952fb831d6 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:51.149249 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ff52fea6-470d-4cca-9d31-81952fb831d6 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:51.149688 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ff52fea6-470d-4cca-9d31-81952fb831d6 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:51.150396 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ff52fea6-470d-4cca-9d31-81952fb831d6 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:51.150846 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ff52fea6-470d-4cca-9d31-81952fb831d6 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:51.151268 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ff52fea6-470d-4cca-9d31-81952fb831d6 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:51.202403 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-ff52fea6-470d-4cca-9d31-81952fb831d6 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] HTTP exception thrown: Instance a8ce9cb7-6601-4d8a-9052-f29620bff27c could not be found. Oct 04 18:28:51.212764 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ff52fea6-470d-4cca-9d31-81952fb831d6 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Request method failure captured: Oct 04 18:28:51.212764 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/a8ce9cb7-6601-4d8a-9052-f29620bff27c HTTP/1.1 Oct 04 18:28:51.212764 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:28:51.212764 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:28:51.212764 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:28:51.212764 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:28:51.212764 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:28:51.212764 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:28:51.212764 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:28:51.212764 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:28:51.212764 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPHsdGC86QKxox70z4N6mdNeGYL7dredhlk2BhDAD-uwBFDVahMgnolZoWnH_4aas_hl9crqH58IGaAkwMPM89IzrLE60fTzB30CTpzyJSbZR5P0nQpNuVXKahgoGR0K-HTryT-g0_4i5mJelfqXttjQDjtkrm4kn1uUjW_Ask3a7wOE Oct 04 18:28:51.212764 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:28:51.212764 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:28:51.212764 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:28:51.212764 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:28:51.212764 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:28:51.212764 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:28:51.212764 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 1e99a0400fe947bb8907857cc4de2899 Oct 04 18:28:51.212764 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1376130247 Oct 04 18:28:51.212764 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:28:51.212764 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:28:51.214140 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1e99a0400fe947bb8907857cc4de2899"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1e99a0400fe947bb8907857cc4de2899", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1e99a0400fe947bb8907857cc4de2899"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1e99a0400fe947bb8907857cc4de2899"}]}] Oct 04 18:28:51.214140 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-DeleteServersAdminTestJSON-1376130247 Oct 04 18:28:51.214140 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 1e99a0400fe947bb8907857cc4de2899 Oct 04 18:28:51.214140 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1376130247 Oct 04 18:28:51.214140 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-DeleteServersAdminTestJSON-1376130247-project Oct 04 18:28:51.214140 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:28:51.214140 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:28:51.214140 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 7f87d9eaf49545bb8effb170768bb8e7 Oct 04 18:28:51.214140 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-DeleteServersAdminTestJSON-1376130247-project Oct 04 18:28:51.214140 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:28:51.214140 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance a8ce9cb7-6601-4d8a-9052-f29620bff27c could not be found. Oct 04 18:28:51.214140 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': 'a8ce9cb7-6601-4d8a-9052-f29620bff27c'} Oct 04 18:28:51.214921 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:28:51.214921 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:51.214921 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:28:51.214921 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:28:51.214921 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:28:51.214921 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:28:51.214921 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:28:51.214921 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:28:51.214921 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:28:51.214921 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:28:51.214921 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8ce9cb7-6601-4d8a-9052-f29620bff27c could not be found. Oct 04 18:28:51.214921 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:51.214921 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:51.214921 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:51.214921 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:51.214921 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:51.214921 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:51.214921 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:28:51.214921 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:28:51.214921 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:28:51.216135 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:28:51.216135 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:28:51.216135 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:28:51.216135 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:28:51.216135 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:28:51.216135 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:28:51.216135 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:28:51.216135 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8ce9cb7-6601-4d8a-9052-f29620bff27c could not be found. Oct 04 18:28:51.216135 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:51.216135 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:51.216135 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:51.216135 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:51.216135 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:51.216135 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:51.216135 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:28:51.216135 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:28:51.216135 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8ce9cb7-6601-4d8a-9052-f29620bff27c could not be found. Oct 04 18:28:51.216135 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:51.226222 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ff52fea6-470d-4cca-9d31-81952fb831d6 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Returning 404 to user: Instance a8ce9cb7-6601-4d8a-9052-f29620bff27c could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:28:51.226222 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ff52fea6-470d-4cca-9d31-81952fb831d6 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] 10.222.0.20 "GET /compute/v2.1/servers/a8ce9cb7-6601-4d8a-9052-f29620bff27c" status: 404 len: 111 microversion: 2.1 time: 0.087735 Oct 04 18:28:51.226222 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 197/366] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:51 2022] GET /compute/v2.1/servers/a8ce9cb7-6601-4d8a-9052-f29620bff27c => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:28:51.227282 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-aef9734c-4053-49b7-af99-cedd9a55c2b7 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:51.227793 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-aef9734c-4053-49b7-af99-cedd9a55c2b7 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] [instance: 6da2d407-863f-4f6a-9d71-d81e96f160fb] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:51.236929 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aef9734c-4053-49b7-af99-cedd9a55c2b7 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:51.237422 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aef9734c-4053-49b7-af99-cedd9a55c2b7 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:51.237863 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aef9734c-4053-49b7-af99-cedd9a55c2b7 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:51.238580 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aef9734c-4053-49b7-af99-cedd9a55c2b7 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:51.239043 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aef9734c-4053-49b7-af99-cedd9a55c2b7 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:51.239471 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aef9734c-4053-49b7-af99-cedd9a55c2b7 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:51.265449 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-aef9734c-4053-49b7-af99-cedd9a55c2b7 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] HTTP exception thrown: Instance 6da2d407-863f-4f6a-9d71-d81e96f160fb could not be found. Oct 04 18:28:51.268364 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-aef9734c-4053-49b7-af99-cedd9a55c2b7 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Request method failure captured: Oct 04 18:28:51.268364 n-d-850501-14 devstack@n-api.service[123002]: request: DELETE /compute/v2.1/servers/6da2d407-863f-4f6a-9d71-d81e96f160fb HTTP/1.1 Oct 04 18:28:51.268364 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:28:51.268364 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:28:51.268364 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:28:51.268364 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:28:51.268364 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:28:51.268364 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:28:51.268364 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:28:51.268364 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:28:51.268364 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPHsdGC86QKxox70z4N6mdNeGYL7dredhlk2BhDAD-uwBFDVahMgnolZoWnH_4aas_hl9crqH58IGaAkwMPM89IzrLE60fTzB30CTpzyJSbZR5P0nQpNuVXKahgoGR0K-HTryT-g0_4i5mJelfqXttjQDjtkrm4kn1uUjW_Ask3a7wOE Oct 04 18:28:51.268364 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:28:51.268364 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:28:51.268364 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:28:51.268364 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:28:51.268364 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:28:51.268364 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:28:51.268364 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 1e99a0400fe947bb8907857cc4de2899 Oct 04 18:28:51.268364 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1376130247 Oct 04 18:28:51.268364 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:28:51.268364 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:28:51.269780 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1e99a0400fe947bb8907857cc4de2899"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1e99a0400fe947bb8907857cc4de2899", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1e99a0400fe947bb8907857cc4de2899"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1e99a0400fe947bb8907857cc4de2899"}]}] Oct 04 18:28:51.269780 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-DeleteServersAdminTestJSON-1376130247 Oct 04 18:28:51.269780 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 1e99a0400fe947bb8907857cc4de2899 Oct 04 18:28:51.269780 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1376130247 Oct 04 18:28:51.269780 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-DeleteServersAdminTestJSON-1376130247-project Oct 04 18:28:51.269780 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:28:51.269780 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:28:51.269780 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 7f87d9eaf49545bb8effb170768bb8e7 Oct 04 18:28:51.269780 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-DeleteServersAdminTestJSON-1376130247-project Oct 04 18:28:51.269780 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:28:51.269780 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 6da2d407-863f-4f6a-9d71-d81e96f160fb could not be found. Oct 04 18:28:51.269780 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '6da2d407-863f-4f6a-9d71-d81e96f160fb'} Oct 04 18:28:51.270578 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:28:51.270578 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:51.270578 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:28:51.270578 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:28:51.270578 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:28:51.270578 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:28:51.270578 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:28:51.270578 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:28:51.270578 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:28:51.270578 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:28:51.270578 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6da2d407-863f-4f6a-9d71-d81e96f160fb could not be found. Oct 04 18:28:51.270578 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:51.270578 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:51.270578 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:51.270578 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:51.270578 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:51.270578 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:51.270578 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:28:51.270578 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:28:51.270578 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:28:51.271876 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:28:51.271876 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:28:51.271876 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:28:51.271876 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:28:51.271876 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:28:51.271876 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:28:51.271876 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:28:51.271876 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:28:51.271876 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:28:51.271876 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6da2d407-863f-4f6a-9d71-d81e96f160fb could not be found. Oct 04 18:28:51.271876 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:51.271876 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:51.271876 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:51.271876 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:51.271876 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:51.271876 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:51.271876 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:28:51.271876 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:28:51.271876 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6da2d407-863f-4f6a-9d71-d81e96f160fb could not be found. Oct 04 18:28:51.271876 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:28:51.274859 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-aef9734c-4053-49b7-af99-cedd9a55c2b7 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Returning 404 to user: Instance 6da2d407-863f-4f6a-9d71-d81e96f160fb could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:28:51.274859 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-aef9734c-4053-49b7-af99-cedd9a55c2b7 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6da2d407-863f-4f6a-9d71-d81e96f160fb" status: 404 len: 111 microversion: 2.1 time: 0.046761 Oct 04 18:28:51.277127 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 170/367] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:28:51 2022] DELETE /compute/v2.1/servers/6da2d407-863f-4f6a-9d71-d81e96f160fb => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:28:51.282164 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e6afb197-dbf8-4f39-a32f-64a69b854465 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:51.283070 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e6afb197-dbf8-4f39-a32f-64a69b854465 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] [instance: 6da2d407-863f-4f6a-9d71-d81e96f160fb] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:51.291301 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e6afb197-dbf8-4f39-a32f-64a69b854465 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:51.291788 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e6afb197-dbf8-4f39-a32f-64a69b854465 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:51.292250 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e6afb197-dbf8-4f39-a32f-64a69b854465 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:51.293003 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e6afb197-dbf8-4f39-a32f-64a69b854465 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:51.293585 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2034b99e-0ce8-4c54-9ae4-b563995f24a3 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:51.293703 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e6afb197-dbf8-4f39-a32f-64a69b854465 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:51.293853 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e6afb197-dbf8-4f39-a32f-64a69b854465 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:51.293984 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2034b99e-0ce8-4c54-9ae4-b563995f24a3 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: 2e85db28-c393-4e02-8f28-bf0d217b6db7] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:51.310303 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-e6afb197-dbf8-4f39-a32f-64a69b854465 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] HTTP exception thrown: Instance 6da2d407-863f-4f6a-9d71-d81e96f160fb could not be found. Oct 04 18:28:51.315045 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e6afb197-dbf8-4f39-a32f-64a69b854465 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Request method failure captured: Oct 04 18:28:51.315045 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/6da2d407-863f-4f6a-9d71-d81e96f160fb HTTP/1.1 Oct 04 18:28:51.315045 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:28:51.315045 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:28:51.315045 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:28:51.315045 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:28:51.315045 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:28:51.315045 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:28:51.315045 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:28:51.315045 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:28:51.315045 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPHsdGC86QKxox70z4N6mdNeGYL7dredhlk2BhDAD-uwBFDVahMgnolZoWnH_4aas_hl9crqH58IGaAkwMPM89IzrLE60fTzB30CTpzyJSbZR5P0nQpNuVXKahgoGR0K-HTryT-g0_4i5mJelfqXttjQDjtkrm4kn1uUjW_Ask3a7wOE Oct 04 18:28:51.315045 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:28:51.315045 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:28:51.315045 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:28:51.315045 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:28:51.315045 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:28:51.315045 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:28:51.315045 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 1e99a0400fe947bb8907857cc4de2899 Oct 04 18:28:51.315045 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1376130247 Oct 04 18:28:51.315045 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:28:51.315045 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:28:51.316833 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1e99a0400fe947bb8907857cc4de2899"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1e99a0400fe947bb8907857cc4de2899", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1e99a0400fe947bb8907857cc4de2899"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1e99a0400fe947bb8907857cc4de2899"}]}] Oct 04 18:28:51.316833 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-DeleteServersAdminTestJSON-1376130247 Oct 04 18:28:51.316833 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 1e99a0400fe947bb8907857cc4de2899 Oct 04 18:28:51.316833 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1376130247 Oct 04 18:28:51.316833 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-DeleteServersAdminTestJSON-1376130247-project Oct 04 18:28:51.316833 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:28:51.316833 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:28:51.316833 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 7f87d9eaf49545bb8effb170768bb8e7 Oct 04 18:28:51.316833 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-DeleteServersAdminTestJSON-1376130247-project Oct 04 18:28:51.316833 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:28:51.316833 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 6da2d407-863f-4f6a-9d71-d81e96f160fb could not be found. Oct 04 18:28:51.316833 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '6da2d407-863f-4f6a-9d71-d81e96f160fb'} Oct 04 18:28:51.317529 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:28:51.317529 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:51.317529 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:28:51.317529 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:28:51.317529 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:28:51.317529 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:28:51.317529 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:28:51.317529 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:28:51.317529 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:28:51.317529 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:28:51.317529 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6da2d407-863f-4f6a-9d71-d81e96f160fb could not be found. Oct 04 18:28:51.317529 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:51.317529 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:51.317529 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:51.317529 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:51.317529 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:51.317529 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:51.317529 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:28:51.317529 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:28:51.317529 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:28:51.318578 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:28:51.318578 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:28:51.318578 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:28:51.318578 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:28:51.318578 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:28:51.318578 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:28:51.318578 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:28:51.318578 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6da2d407-863f-4f6a-9d71-d81e96f160fb could not be found. Oct 04 18:28:51.318578 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:51.318578 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:51.318578 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:51.318578 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:51.318578 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:51.318578 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:51.318578 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:28:51.318578 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:28:51.318578 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6da2d407-863f-4f6a-9d71-d81e96f160fb could not be found. Oct 04 18:28:51.318578 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:28:51.319612 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e6afb197-dbf8-4f39-a32f-64a69b854465 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] Returning 404 to user: Instance 6da2d407-863f-4f6a-9d71-d81e96f160fb could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:28:51.319612 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e6afb197-dbf8-4f39-a32f-64a69b854465 tempest-DeleteServersAdminTestJSON-1376130247 tempest-DeleteServersAdminTestJSON-1376130247-project] 10.222.0.20 "GET /compute/v2.1/servers/6da2d407-863f-4f6a-9d71-d81e96f160fb" status: 404 len: 111 microversion: 2.1 time: 0.036723 Oct 04 18:28:51.319612 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 198/368] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:51 2022] GET /compute/v2.1/servers/6da2d407-863f-4f6a-9d71-d81e96f160fb => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:28:51.414578 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2034b99e-0ce8-4c54-9ae4-b563995f24a3 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:51.431102 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2034b99e-0ce8-4c54-9ae4-b563995f24a3 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/2e85db28-c393-4e02-8f28-bf0d217b6db7" status: 200 len: 1217 microversion: 2.1 time: 0.142027 Oct 04 18:28:51.436120 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 171/369] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:51 2022] GET /compute/v2.1/servers/2e85db28-c393-4e02-8f28-bf0d217b6db7 => generated 1217 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:52.463502 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e4a38166-ae51-4feb-98bb-b614601d29bd tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:52.465624 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e4a38166-ae51-4feb-98bb-b614601d29bd tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: 2e85db28-c393-4e02-8f28-bf0d217b6db7] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:52.475953 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e4a38166-ae51-4feb-98bb-b614601d29bd tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:52.477636 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e4a38166-ae51-4feb-98bb-b614601d29bd tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:52.478779 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e4a38166-ae51-4feb-98bb-b614601d29bd tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:52.480335 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e4a38166-ae51-4feb-98bb-b614601d29bd tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:52.481032 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e4a38166-ae51-4feb-98bb-b614601d29bd tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:52.481671 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e4a38166-ae51-4feb-98bb-b614601d29bd tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:52.691539 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e4a38166-ae51-4feb-98bb-b614601d29bd tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:52.703992 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e4a38166-ae51-4feb-98bb-b614601d29bd tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/2e85db28-c393-4e02-8f28-bf0d217b6db7" status: 200 len: 1213 microversion: 2.1 time: 0.250773 Oct 04 18:28:52.721100 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 199/370] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:52 2022] GET /compute/v2.1/servers/2e85db28-c393-4e02-8f28-bf0d217b6db7 => generated 1213 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:53.728345 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-02d389df-5c34-484c-974f-00faf3989a0c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:53.729756 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-02d389df-5c34-484c-974f-00faf3989a0c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: 2e85db28-c393-4e02-8f28-bf0d217b6db7] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:53.740882 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-02d389df-5c34-484c-974f-00faf3989a0c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:53.743846 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-02d389df-5c34-484c-974f-00faf3989a0c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:53.752797 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-02d389df-5c34-484c-974f-00faf3989a0c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:53.752797 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-02d389df-5c34-484c-974f-00faf3989a0c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:53.752797 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-02d389df-5c34-484c-974f-00faf3989a0c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:53.752797 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-02d389df-5c34-484c-974f-00faf3989a0c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:53.900850 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-02d389df-5c34-484c-974f-00faf3989a0c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:53.927105 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-02d389df-5c34-484c-974f-00faf3989a0c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/2e85db28-c393-4e02-8f28-bf0d217b6db7" status: 200 len: 1277 microversion: 2.1 time: 0.204034 Oct 04 18:28:53.927913 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 200/371] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:53 2022] GET /compute/v2.1/servers/2e85db28-c393-4e02-8f28-bf0d217b6db7 => generated 1277 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:54.141760 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6b57d9ef-2e69-42d8-ade6-9f2c538f2de5 tempest-QuotasAdminTestJSON-1284220734 tempest-QuotasAdminTestJSON-1284220734-project-admin] Calling method '.version_select at 0x7fe2597b5b80>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:54.955562 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a810220e-0e4f-42d0-a1d2-a9cbcdc0e8bf tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:54.957788 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a810220e-0e4f-42d0-a1d2-a9cbcdc0e8bf tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: 2e85db28-c393-4e02-8f28-bf0d217b6db7] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:54.966718 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a810220e-0e4f-42d0-a1d2-a9cbcdc0e8bf tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:54.966718 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a810220e-0e4f-42d0-a1d2-a9cbcdc0e8bf tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:54.966718 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a810220e-0e4f-42d0-a1d2-a9cbcdc0e8bf tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:54.967428 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a810220e-0e4f-42d0-a1d2-a9cbcdc0e8bf tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:54.967931 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a810220e-0e4f-42d0-a1d2-a9cbcdc0e8bf tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:54.968335 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a810220e-0e4f-42d0-a1d2-a9cbcdc0e8bf tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:55.171343 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a810220e-0e4f-42d0-a1d2-a9cbcdc0e8bf tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:55.191614 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a810220e-0e4f-42d0-a1d2-a9cbcdc0e8bf tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/2e85db28-c393-4e02-8f28-bf0d217b6db7" status: 200 len: 1275 microversion: 2.1 time: 0.238698 Oct 04 18:28:55.194345 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 201/372] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:54 2022] GET /compute/v2.1/servers/2e85db28-c393-4e02-8f28-bf0d217b6db7 => generated 1275 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:55.824276 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6b57d9ef-2e69-42d8-ade6-9f2c538f2de5 tempest-QuotasAdminTestJSON-1284220734 tempest-QuotasAdminTestJSON-1284220734-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/2d82e894d4eb477dbd29c84cdc1dd220" status: 200 len: 371 microversion: 2.1 time: 2.178787 Oct 04 18:28:55.835691 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 172/373] 10.222.0.20 () {58 vars in 1242 bytes} [Tue Oct 4 18:28:53 2022] GET /compute/v2.1/os-quota-sets/2d82e894d4eb477dbd29c84cdc1dd220 => generated 371 bytes in 2191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:28:55.840019 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4afb49a1-6add-44be-93b0-29cc9eb93e53 tempest-QuotasAdminTestJSON-1284220734 tempest-QuotasAdminTestJSON-1284220734-project-admin] Action: 'update', calling method: .version_select at 0x7fe259893160>, body: {"quota_set": {"ram": "5120"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:56.214843 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-cd0c1f5d-6527-4b75-8a3e-c0e11235e211 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:56.215901 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-cd0c1f5d-6527-4b75-8a3e-c0e11235e211 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: 2e85db28-c393-4e02-8f28-bf0d217b6db7] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:56.230314 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cd0c1f5d-6527-4b75-8a3e-c0e11235e211 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:56.234170 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cd0c1f5d-6527-4b75-8a3e-c0e11235e211 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:56.234755 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cd0c1f5d-6527-4b75-8a3e-c0e11235e211 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:56.235587 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cd0c1f5d-6527-4b75-8a3e-c0e11235e211 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:56.239432 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cd0c1f5d-6527-4b75-8a3e-c0e11235e211 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:56.243435 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cd0c1f5d-6527-4b75-8a3e-c0e11235e211 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:56.803461 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4afb49a1-6add-44be-93b0-29cc9eb93e53 tempest-QuotasAdminTestJSON-1284220734 tempest-QuotasAdminTestJSON-1284220734-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:56.803989 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4afb49a1-6add-44be-93b0-29cc9eb93e53 tempest-QuotasAdminTestJSON-1284220734 tempest-QuotasAdminTestJSON-1284220734-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:56.804418 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4afb49a1-6add-44be-93b0-29cc9eb93e53 tempest-QuotasAdminTestJSON-1284220734 tempest-QuotasAdminTestJSON-1284220734-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:56.805492 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4afb49a1-6add-44be-93b0-29cc9eb93e53 tempest-QuotasAdminTestJSON-1284220734 tempest-QuotasAdminTestJSON-1284220734-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:56.806073 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4afb49a1-6add-44be-93b0-29cc9eb93e53 tempest-QuotasAdminTestJSON-1284220734 tempest-QuotasAdminTestJSON-1284220734-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:56.806504 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4afb49a1-6add-44be-93b0-29cc9eb93e53 tempest-QuotasAdminTestJSON-1284220734 tempest-QuotasAdminTestJSON-1284220734-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:56.982004 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-cd0c1f5d-6527-4b75-8a3e-c0e11235e211 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:56.991079 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-cd0c1f5d-6527-4b75-8a3e-c0e11235e211 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/2e85db28-c393-4e02-8f28-bf0d217b6db7" status: 200 len: 1317 microversion: 2.1 time: 0.781037 Oct 04 18:28:57.004090 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 173/374] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:56 2022] GET /compute/v2.1/servers/2e85db28-c393-4e02-8f28-bf0d217b6db7 => generated 1317 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:28:57.018681 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-4afb49a1-6add-44be-93b0-29cc9eb93e53 tempest-QuotasAdminTestJSON-1284220734 tempest-QuotasAdminTestJSON-1284220734-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/2d82e894d4eb477dbd29c84cdc1dd220" status: 200 len: 328 microversion: 2.1 time: 1.183884 Oct 04 18:28:57.021012 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 202/375] 10.222.0.20 () {60 vars in 1262 bytes} [Tue Oct 4 18:28:55 2022] PUT /compute/v2.1/os-quota-sets/2d82e894d4eb477dbd29c84cdc1dd220 => generated 328 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:28:57.037103 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-83d10548-c564-4ef8-91dc-253ac3d14936 tempest-QuotasAdminTestJSON-1284220734 tempest-QuotasAdminTestJSON-1284220734-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:57.135400 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-83d10548-c564-4ef8-91dc-253ac3d14936 tempest-QuotasAdminTestJSON-1284220734 tempest-QuotasAdminTestJSON-1284220734-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-quota-sets/2d82e894d4eb477dbd29c84cdc1dd220" status: 202 len: 0 microversion: 2.1 time: 0.107378 Oct 04 18:28:57.136011 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 174/376] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Oct 4 18:28:57 2022] DELETE /compute/v2.1/os-quota-sets/2d82e894d4eb477dbd29c84cdc1dd220 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:28:57.151388 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-bd00d6b6-7b9b-42a3-8495-b6fd210f5259 tempest-QuotasAdminTestJSON-1284220734 tempest-QuotasAdminTestJSON-1284220734-project-admin] Calling method '.version_select at 0x7fe25989ce50>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:57.314114 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-ad15c567-d3d3-4ee3-bdc9-5791dd289647 req-d63d46cd-0811-4b51-a8cb-ce4bfa27cb20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e85db28-c393-4e02-8f28-bf0d217b6db7", "tag": "a7a62b4e-0cc7-42b1-976e-0559dd4fcf07"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:57.330763 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-ad15c567-d3d3-4ee3-bdc9-5791dd289647 req-d63d46cd-0811-4b51-a8cb-ce4bfa27cb20 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:57.333528 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-ad15c567-d3d3-4ee3-bdc9-5791dd289647 req-d63d46cd-0811-4b51-a8cb-ce4bfa27cb20 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:57.334380 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-ad15c567-d3d3-4ee3-bdc9-5791dd289647 req-d63d46cd-0811-4b51-a8cb-ce4bfa27cb20 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:57.376513 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-ad15c567-d3d3-4ee3-bdc9-5791dd289647 req-d63d46cd-0811-4b51-a8cb-ce4bfa27cb20 service nova] Creating event network-changed:a7a62b4e-0cc7-42b1-976e-0559dd4fcf07 for instance 2e85db28-c393-4e02-8f28-bf0d217b6db7 on n-h1-850501-14 Oct 04 18:28:57.386751 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-ad15c567-d3d3-4ee3-bdc9-5791dd289647 req-d63d46cd-0811-4b51-a8cb-ce4bfa27cb20 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077120 Oct 04 18:28:57.388875 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 175/377] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:28:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:28:58.019907 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4c851da9-4f3e-43bf-b042-a2834157a7ed tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:58.020879 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4c851da9-4f3e-43bf-b042-a2834157a7ed tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: 2e85db28-c393-4e02-8f28-bf0d217b6db7] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:58.035342 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4c851da9-4f3e-43bf-b042-a2834157a7ed tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:58.036180 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4c851da9-4f3e-43bf-b042-a2834157a7ed tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:58.037958 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4c851da9-4f3e-43bf-b042-a2834157a7ed tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:58.040824 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4c851da9-4f3e-43bf-b042-a2834157a7ed tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:58.041724 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4c851da9-4f3e-43bf-b042-a2834157a7ed tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:58.043798 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4c851da9-4f3e-43bf-b042-a2834157a7ed tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:58.208000 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-bd00d6b6-7b9b-42a3-8495-b6fd210f5259 tempest-QuotasAdminTestJSON-1284220734 tempest-QuotasAdminTestJSON-1284220734-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/2d82e894d4eb477dbd29c84cdc1dd220" status: 200 len: 371 microversion: 2.1 time: 1.065258 Oct 04 18:28:58.208935 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 203/378] 10.222.0.20 () {58 vars in 1242 bytes} [Tue Oct 4 18:28:57 2022] GET /compute/v2.1/os-quota-sets/2d82e894d4eb477dbd29c84cdc1dd220 => generated 371 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:28:58.387036 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4c851da9-4f3e-43bf-b042-a2834157a7ed tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:58.401249 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4c851da9-4f3e-43bf-b042-a2834157a7ed tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/2e85db28-c393-4e02-8f28-bf0d217b6db7" status: 200 len: 1317 microversion: 2.1 time: 0.386977 Oct 04 18:28:58.402397 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 176/379] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:58 2022] GET /compute/v2.1/servers/2e85db28-c393-4e02-8f28-bf0d217b6db7 => generated 1317 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:58.625255 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1c6d57ba-8e6c-46d0-bf8c-efce04aa0694 tempest-QuotasAdminTestJSON-1284220734 tempest-QuotasAdminTestJSON-1284220734-project-admin] Calling method '.version_select at 0x7fe259800790>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:59.424622 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3f4d74ad-89d5-4b9a-a5aa-28f8ad2bbea5 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:59.426248 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3f4d74ad-89d5-4b9a-a5aa-28f8ad2bbea5 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: 2e85db28-c393-4e02-8f28-bf0d217b6db7] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:59.433057 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=28 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:28:59.439337 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f4d74ad-89d5-4b9a-a5aa-28f8ad2bbea5 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:59.442347 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f4d74ad-89d5-4b9a-a5aa-28f8ad2bbea5 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:59.442347 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f4d74ad-89d5-4b9a-a5aa-28f8ad2bbea5 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:59.442347 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f4d74ad-89d5-4b9a-a5aa-28f8ad2bbea5 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:59.442347 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f4d74ad-89d5-4b9a-a5aa-28f8ad2bbea5 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:59.444875 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f4d74ad-89d5-4b9a-a5aa-28f8ad2bbea5 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:59.504277 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1c6d57ba-8e6c-46d0-bf8c-efce04aa0694 tempest-QuotasAdminTestJSON-1284220734 tempest-QuotasAdminTestJSON-1284220734-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/06c1142eeda640bba582c0fc08bd3cc8/defaults" status: 200 len: 371 microversion: 2.1 time: 0.885678 Oct 04 18:28:59.505229 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 204/380] 10.222.0.20 () {58 vars in 1269 bytes} [Tue Oct 4 18:28:58 2022] GET /compute/v2.1/os-quota-sets/06c1142eeda640bba582c0fc08bd3cc8/defaults => generated 371 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:28:59.740421 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3f4d74ad-89d5-4b9a-a5aa-28f8ad2bbea5 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:59.748836 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3f4d74ad-89d5-4b9a-a5aa-28f8ad2bbea5 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/2e85db28-c393-4e02-8f28-bf0d217b6db7" status: 200 len: 1317 microversion: 2.1 time: 0.327988 Oct 04 18:28:59.755998 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 177/381] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:59 2022] GET /compute/v2.1/servers/2e85db28-c393-4e02-8f28-bf0d217b6db7 => generated 1317 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:00.582322 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5efc6549-88b9-4e4e-b5ac-adb67475b33b tempest-QuotasAdminTestJSON-1284220734 tempest-QuotasAdminTestJSON-1284220734-project-admin] Action: 'update', calling method: .version_select at 0x7fe259800af0>, body: {"quota_set": {"ram": "5120"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:00.785001 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b60fbe5f-5d73-4a93-ac3b-2d08c5a9cb37 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:00.786343 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b60fbe5f-5d73-4a93-ac3b-2d08c5a9cb37 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: 2e85db28-c393-4e02-8f28-bf0d217b6db7] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:00.795319 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b60fbe5f-5d73-4a93-ac3b-2d08c5a9cb37 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:00.796482 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b60fbe5f-5d73-4a93-ac3b-2d08c5a9cb37 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:00.804254 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b60fbe5f-5d73-4a93-ac3b-2d08c5a9cb37 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:00.804254 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b60fbe5f-5d73-4a93-ac3b-2d08c5a9cb37 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:00.804254 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b60fbe5f-5d73-4a93-ac3b-2d08c5a9cb37 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:00.804254 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b60fbe5f-5d73-4a93-ac3b-2d08c5a9cb37 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:01.021836 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b60fbe5f-5d73-4a93-ac3b-2d08c5a9cb37 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:01.032525 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b60fbe5f-5d73-4a93-ac3b-2d08c5a9cb37 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/2e85db28-c393-4e02-8f28-bf0d217b6db7" status: 200 len: 1317 microversion: 2.1 time: 0.260489 Oct 04 18:29:01.033096 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 178/382] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:00 2022] GET /compute/v2.1/servers/2e85db28-c393-4e02-8f28-bf0d217b6db7 => generated 1317 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:01.146380 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5efc6549-88b9-4e4e-b5ac-adb67475b33b tempest-QuotasAdminTestJSON-1284220734 tempest-QuotasAdminTestJSON-1284220734-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:01.147398 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5efc6549-88b9-4e4e-b5ac-adb67475b33b tempest-QuotasAdminTestJSON-1284220734 tempest-QuotasAdminTestJSON-1284220734-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:01.148088 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5efc6549-88b9-4e4e-b5ac-adb67475b33b tempest-QuotasAdminTestJSON-1284220734 tempest-QuotasAdminTestJSON-1284220734-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:01.150219 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5efc6549-88b9-4e4e-b5ac-adb67475b33b tempest-QuotasAdminTestJSON-1284220734 tempest-QuotasAdminTestJSON-1284220734-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:01.154809 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5efc6549-88b9-4e4e-b5ac-adb67475b33b tempest-QuotasAdminTestJSON-1284220734 tempest-QuotasAdminTestJSON-1284220734-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:01.154809 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5efc6549-88b9-4e4e-b5ac-adb67475b33b tempest-QuotasAdminTestJSON-1284220734 tempest-QuotasAdminTestJSON-1284220734-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:01.322915 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5efc6549-88b9-4e4e-b5ac-adb67475b33b tempest-QuotasAdminTestJSON-1284220734 tempest-QuotasAdminTestJSON-1284220734-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/35490d1204c84681a5ca57b51fddea10" status: 200 len: 328 microversion: 2.1 time: 0.744590 Oct 04 18:29:01.327752 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 205/383] 10.222.0.20 () {60 vars in 1262 bytes} [Tue Oct 4 18:29:00 2022] PUT /compute/v2.1/os-quota-sets/35490d1204c84681a5ca57b51fddea10 => generated 328 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:29:01.337709 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-47838139-053e-4ee1-a6ae-68db818921bd tempest-QuotasAdminTestJSON-1284220734 tempest-QuotasAdminTestJSON-1284220734-project-admin] Calling method '.version_select at 0x7fe25982df70>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:01.749914 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4bf0047f-6222-4999-9fa7-2a20e6b50b23 tempest-AZAdminNegativeTestJSON-1273888873 tempest-AZAdminNegativeTestJSON-1273888873-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:01.751824 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-4bf0047f-6222-4999-9fa7-2a20e6b50b23 tempest-AZAdminNegativeTestJSON-1273888873 tempest-AZAdminNegativeTestJSON-1273888873-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '2d4b9dd29fc34f819e9a762e674f90cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa9fc07c00c44eea65621d9c73c59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:01.754275 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4bf0047f-6222-4999-9fa7-2a20e6b50b23 tempest-AZAdminNegativeTestJSON-1273888873 tempest-AZAdminNegativeTestJSON-1273888873-project] Request method failure captured: Oct 04 18:29:01.754275 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Oct 04 18:29:01.754275 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:29:01.754275 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:29:01.754275 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:29:01.754275 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:29:01.754275 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:29:01.754275 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:29:01.754275 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:29:01.754275 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:29:01.754275 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPHtqSLaOMoKFj_reMopNGL4XCHG9iUwU0KLzd-VeOTkWmCEuHT1zDDoreJLqLc6wtdsXX5z-nH1QX_57imkfNyq5uXlvfpOcE_iPgKhX23b1h2YgrUY7ZDHm1LWMXD3jTJ2qRhffd66Zg4EciDvpOi38M4xUxgASffTOO4AIjMXXrhk Oct 04 18:29:01.754275 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:29:01.754275 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:29:01.754275 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:29:01.754275 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:29:01.754275 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:29:01.754275 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:29:01.754275 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 5fa9fc07c00c44eea65621d9c73c59b7 Oct 04 18:29:01.754275 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-AZAdminNegativeTestJSON-1273888873 Oct 04 18:29:01.754275 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:29:01.754275 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:29:01.755763 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5fa9fc07c00c44eea65621d9c73c59b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5fa9fc07c00c44eea65621d9c73c59b7", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5fa9fc07c00c44eea65621d9c73c59b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5fa9fc07c00c44eea65621d9c73c59b7"}]}] Oct 04 18:29:01.755763 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-AZAdminNegativeTestJSON-1273888873 Oct 04 18:29:01.755763 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 5fa9fc07c00c44eea65621d9c73c59b7 Oct 04 18:29:01.755763 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-1273888873 Oct 04 18:29:01.755763 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-AZAdminNegativeTestJSON-1273888873-project Oct 04 18:29:01.755763 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:29:01.755763 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:29:01.755763 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 2d4b9dd29fc34f819e9a762e674f90cf Oct 04 18:29:01.755763 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-AZAdminNegativeTestJSON-1273888873-project Oct 04 18:29:01.755763 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:29:01.755763 n-d-850501-14 devstack@n-api.service[123001]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 04 18:29:01.755763 n-d-850501-14 devstack@n-api.service[123001]: action_args: {} Oct 04 18:29:01.756721 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:29:01.756721 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:29:01.756721 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:29:01.756721 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:29:01.756721 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:29:01.756721 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:29:01.756721 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:29:01.756721 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:29:01.756721 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Oct 04 18:29:01.756721 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Oct 04 18:29:01.756721 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:29:01.756721 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:29:01.756721 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:29:01.756721 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:29:01.756721 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:29:01.756721 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:29:01.756721 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:29:01.756721 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:29:01.756721 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:29:01.758672 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:29:01.758672 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:29:01.758672 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:29:01.758672 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:29:01.758672 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:29:01.758672 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 04 18:29:01.758672 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:29:01.758672 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:29:01.758672 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:29:01.758672 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:29:01.758672 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:29:01.758672 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:29:01.758672 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:29:01.758672 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:29:01.758672 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 04 18:29:01.758672 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:29:01.758672 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4bf0047f-6222-4999-9fa7-2a20e6b50b23 tempest-AZAdminNegativeTestJSON-1273888873 tempest-AZAdminNegativeTestJSON-1273888873-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:29:01.760563 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-4bf0047f-6222-4999-9fa7-2a20e6b50b23 tempest-AZAdminNegativeTestJSON-1273888873 tempest-AZAdminNegativeTestJSON-1273888873-project] 10.222.0.20 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.396881 Oct 04 18:29:01.761568 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 206/384] 10.222.0.20 () {58 vars in 1185 bytes} [Tue Oct 4 18:29:01 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 400 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:29:01.975375 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-47838139-053e-4ee1-a6ae-68db818921bd tempest-QuotasAdminTestJSON-1284220734 tempest-QuotasAdminTestJSON-1284220734-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:01.978641 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-47838139-053e-4ee1-a6ae-68db818921bd tempest-QuotasAdminTestJSON-1284220734 tempest-QuotasAdminTestJSON-1284220734-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:01.978641 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-47838139-053e-4ee1-a6ae-68db818921bd tempest-QuotasAdminTestJSON-1284220734 tempest-QuotasAdminTestJSON-1284220734-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:01.980130 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-47838139-053e-4ee1-a6ae-68db818921bd tempest-QuotasAdminTestJSON-1284220734 tempest-QuotasAdminTestJSON-1284220734-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:01.981475 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-47838139-053e-4ee1-a6ae-68db818921bd tempest-QuotasAdminTestJSON-1284220734 tempest-QuotasAdminTestJSON-1284220734-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:01.982325 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-47838139-053e-4ee1-a6ae-68db818921bd tempest-QuotasAdminTestJSON-1284220734 tempest-QuotasAdminTestJSON-1284220734-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:02.030254 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-47838139-053e-4ee1-a6ae-68db818921bd tempest-QuotasAdminTestJSON-1284220734 tempest-QuotasAdminTestJSON-1284220734-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/35490d1204c84681a5ca57b51fddea10/detail" status: 200 len: 916 microversion: 2.1 time: 0.696160 Oct 04 18:29:02.031092 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 179/385] 10.222.0.20 () {58 vars in 1263 bytes} [Tue Oct 4 18:29:01 2022] GET /compute/v2.1/os-quota-sets/35490d1204c84681a5ca57b51fddea10/detail => generated 916 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:29:02.056969 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d0b7f186-d10c-4652-a6a9-80cab8e74c14 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:02.058678 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d0b7f186-d10c-4652-a6a9-80cab8e74c14 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: 2e85db28-c393-4e02-8f28-bf0d217b6db7] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:02.068221 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d0b7f186-d10c-4652-a6a9-80cab8e74c14 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:02.069119 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d0b7f186-d10c-4652-a6a9-80cab8e74c14 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:02.069713 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d0b7f186-d10c-4652-a6a9-80cab8e74c14 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:02.072706 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d0b7f186-d10c-4652-a6a9-80cab8e74c14 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:02.074542 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d0b7f186-d10c-4652-a6a9-80cab8e74c14 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:02.075046 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d0b7f186-d10c-4652-a6a9-80cab8e74c14 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:02.095667 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:02.254292 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d0b7f186-d10c-4652-a6a9-80cab8e74c14 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:02.266001 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d0b7f186-d10c-4652-a6a9-80cab8e74c14 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/2e85db28-c393-4e02-8f28-bf0d217b6db7" status: 200 len: 1317 microversion: 2.1 time: 0.214621 Oct 04 18:29:02.266631 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 207/386] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:02 2022] GET /compute/v2.1/servers/2e85db28-c393-4e02-8f28-bf0d217b6db7 => generated 1317 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:03.106474 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1991cbb1-9fd9-411b-b16c-4f53844c063d tempest-FlavorsExtraSpecsTestJSON-774207453 tempest-FlavorsExtraSpecsTestJSON-774207453-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-2016834104", "ram": 512, "vcpus": 1, "disk": 10, "id": 471135163, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:03.205242 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1991cbb1-9fd9-411b-b16c-4f53844c063d tempest-FlavorsExtraSpecsTestJSON-774207453 tempest-FlavorsExtraSpecsTestJSON-774207453-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.550644 Oct 04 18:29:03.205927 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 180/387] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:29:02 2022] POST /compute/v2.1/flavors => generated 413 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:29:03.219792 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-05a8d68b-ba90-4961-a6ed-ed8ea3e14099 tempest-FlavorsExtraSpecsTestJSON-774207453 tempest-FlavorsExtraSpecsTestJSON-774207453-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:03.291424 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4cb64c40-367b-4c3f-92ea-c104fe752b4e tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:03.292137 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4cb64c40-367b-4c3f-92ea-c104fe752b4e tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: 2e85db28-c393-4e02-8f28-bf0d217b6db7] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:03.299565 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4cb64c40-367b-4c3f-92ea-c104fe752b4e tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:03.300742 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4cb64c40-367b-4c3f-92ea-c104fe752b4e tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:03.301182 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4cb64c40-367b-4c3f-92ea-c104fe752b4e tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:03.301893 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4cb64c40-367b-4c3f-92ea-c104fe752b4e tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:03.303913 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4cb64c40-367b-4c3f-92ea-c104fe752b4e tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:03.307989 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4cb64c40-367b-4c3f-92ea-c104fe752b4e tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:03.328653 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-05a8d68b-ba90-4961-a6ed-ed8ea3e14099 tempest-FlavorsExtraSpecsTestJSON-774207453 tempest-FlavorsExtraSpecsTestJSON-774207453-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/471135163/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.113016 Oct 04 18:29:03.329262 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 208/388] 10.222.0.20 () {60 vars in 1221 bytes} [Tue Oct 4 18:29:03 2022] POST /compute/v2.1/flavors/471135163/os-extra_specs => generated 66 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:29:03.732251 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4cb64c40-367b-4c3f-92ea-c104fe752b4e tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:03.740663 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4cb64c40-367b-4c3f-92ea-c104fe752b4e tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/2e85db28-c393-4e02-8f28-bf0d217b6db7" status: 200 len: 1317 microversion: 2.1 time: 0.454259 Oct 04 18:29:03.744687 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 181/389] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:03 2022] GET /compute/v2.1/servers/2e85db28-c393-4e02-8f28-bf0d217b6db7 => generated 1317 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:29:03.752817 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-75aafe59-8c5c-4150-8764-b63e058ee787 tempest-QuotasAdminTestJSON-1284220734 tempest-QuotasAdminTestJSON-1284220734-project-admin] Action: 'update', calling method: .version_select at 0x7fe259870040>, body: {"quota_set": {"ram": "2048"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:03.845926 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b05975b6-7e20-4ba6-b933-949308095e86 tempest-FlavorsExtraSpecsTestJSON-610875797 tempest-FlavorsExtraSpecsTestJSON-610875797-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:03.871111 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b05975b6-7e20-4ba6-b933-949308095e86 tempest-FlavorsExtraSpecsTestJSON-610875797 tempest-FlavorsExtraSpecsTestJSON-610875797-project] 10.222.0.20 "GET /compute/v2.1/flavors/471135163/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.536060 Oct 04 18:29:03.871684 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 209/390] 10.222.0.20 () {58 vars in 1200 bytes} [Tue Oct 4 18:29:03 2022] GET /compute/v2.1/flavors/471135163/os-extra_specs => generated 66 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 18:29:03.947471 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-75aafe59-8c5c-4150-8764-b63e058ee787 tempest-QuotasAdminTestJSON-1284220734 tempest-QuotasAdminTestJSON-1284220734-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:03.948794 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-75aafe59-8c5c-4150-8764-b63e058ee787 tempest-QuotasAdminTestJSON-1284220734 tempest-QuotasAdminTestJSON-1284220734-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:03.949313 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-75aafe59-8c5c-4150-8764-b63e058ee787 tempest-QuotasAdminTestJSON-1284220734 tempest-QuotasAdminTestJSON-1284220734-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:03.950130 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-75aafe59-8c5c-4150-8764-b63e058ee787 tempest-QuotasAdminTestJSON-1284220734 tempest-QuotasAdminTestJSON-1284220734-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:03.950756 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-75aafe59-8c5c-4150-8764-b63e058ee787 tempest-QuotasAdminTestJSON-1284220734 tempest-QuotasAdminTestJSON-1284220734-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:03.955264 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-75aafe59-8c5c-4150-8764-b63e058ee787 tempest-QuotasAdminTestJSON-1284220734 tempest-QuotasAdminTestJSON-1284220734-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:03.963205 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e6b76887-1e0e-4e67-8742-5e2ea86bddc7 tempest-FlavorsAccessTestJSON-1255965555 tempest-FlavorsAccessTestJSON-1255965555-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1871241989", "id": 1535005155, "os-flavor-access:is_public": "False"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:04.005050 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-75aafe59-8c5c-4150-8764-b63e058ee787 tempest-QuotasAdminTestJSON-1284220734 tempest-QuotasAdminTestJSON-1284220734-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:04.005833 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-75aafe59-8c5c-4150-8764-b63e058ee787 tempest-QuotasAdminTestJSON-1284220734 tempest-QuotasAdminTestJSON-1284220734-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:04.006719 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-75aafe59-8c5c-4150-8764-b63e058ee787 tempest-QuotasAdminTestJSON-1284220734 tempest-QuotasAdminTestJSON-1284220734-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:04.007741 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-75aafe59-8c5c-4150-8764-b63e058ee787 tempest-QuotasAdminTestJSON-1284220734 tempest-QuotasAdminTestJSON-1284220734-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:04.008467 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-75aafe59-8c5c-4150-8764-b63e058ee787 tempest-QuotasAdminTestJSON-1284220734 tempest-QuotasAdminTestJSON-1284220734-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:04.009110 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-75aafe59-8c5c-4150-8764-b63e058ee787 tempest-QuotasAdminTestJSON-1284220734 tempest-QuotasAdminTestJSON-1284220734-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:04.062567 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e6b76887-1e0e-4e67-8742-5e2ea86bddc7 tempest-FlavorsAccessTestJSON-1255965555 tempest-FlavorsAccessTestJSON-1255965555-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.184289 Oct 04 18:29:04.063871 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 210/391] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:29:03 2022] POST /compute/v2.1/flavors => generated 431 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:29:04.074229 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1c81ad5e-e863-40ff-bac9-67bddf4c43b8 tempest-FlavorsExtraSpecsTestJSON-774207453 tempest-FlavorsExtraSpecsTestJSON-774207453-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:04.107272 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1c81ad5e-e863-40ff-bac9-67bddf4c43b8 tempest-FlavorsExtraSpecsTestJSON-774207453 tempest-FlavorsExtraSpecsTestJSON-774207453-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/471135163/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.042011 Oct 04 18:29:04.108005 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 211/392] 10.222.0.20 () {60 vars in 1221 bytes} [Tue Oct 4 18:29:04 2022] POST /compute/v2.1/flavors/471135163/os-extra_specs => generated 66 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:29:04.112761 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-07b620f1-7020-4bc1-afa3-96e07ac89c40 tempest-FlavorsAccessTestJSON-1255965555 tempest-FlavorsAccessTestJSON-1255965555-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "f0810c82f0ee43afb87dbbc357be1e83"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:04.168043 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=4,nova_api:DELETE=5 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:04.175895 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-75aafe59-8c5c-4150-8764-b63e058ee787 tempest-QuotasAdminTestJSON-1284220734 tempest-QuotasAdminTestJSON-1284220734-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/35490d1204c84681a5ca57b51fddea10?user_id=ad458ab862e847e4b34187da332734d7" status: 200 len: 328 microversion: 2.1 time: 0.429903 Oct 04 18:29:04.182366 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 182/393] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Oct 4 18:29:03 2022] PUT /compute/v2.1/os-quota-sets/35490d1204c84681a5ca57b51fddea10?user_id=ad458ab862e847e4b34187da332734d7 => generated 328 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:29:04.188204 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0a949f0e-38f5-4004-a6d6-4d9697a0fdda tempest-FlavorsExtraSpecsTestJSON-610875797 tempest-FlavorsExtraSpecsTestJSON-610875797-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:04.200454 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0a949f0e-38f5-4004-a6d6-4d9697a0fdda tempest-FlavorsExtraSpecsTestJSON-610875797 tempest-FlavorsExtraSpecsTestJSON-610875797-project] 10.222.0.20 "GET /compute/v2.1/flavors/471135163/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.016801 Oct 04 18:29:04.201850 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 183/394] 10.222.0.20 () {58 vars in 1242 bytes} [Tue Oct 4 18:29:04 2022] GET /compute/v2.1/flavors/471135163/os-extra_specs/hw:numa_nodes => generated 22 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:29:04.210618 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8446b815-b273-4f75-b14a-0b394efad670 tempest-QuotasAdminTestJSON-1284220734 tempest-QuotasAdminTestJSON-1284220734-project-admin] Calling method '.version_select at 0x7fe2597d5a60>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:04.282303 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-07b620f1-7020-4bc1-afa3-96e07ac89c40 tempest-FlavorsAccessTestJSON-1255965555 tempest-FlavorsAccessTestJSON-1255965555-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/1535005155/action" status: 200 len: 97 microversion: 2.1 time: 0.172953 Oct 04 18:29:04.286228 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 212/395] 10.222.0.20 () {60 vars in 1200 bytes} [Tue Oct 4 18:29:04 2022] POST /compute/v2.1/flavors/1535005155/action => generated 97 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:29:04.298297 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b59993d7-ef6b-448b-b3f5-2ee97fa5c3f2 tempest-FlavorsExtraSpecsTestJSON-774207453 tempest-FlavorsExtraSpecsTestJSON-774207453-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:04.332085 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b59993d7-ef6b-448b-b3f5-2ee97fa5c3f2 tempest-FlavorsExtraSpecsTestJSON-774207453 tempest-FlavorsExtraSpecsTestJSON-774207453-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/471135163/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.043496 Oct 04 18:29:04.338020 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 213/396] 10.222.0.20 () {60 vars in 1221 bytes} [Tue Oct 4 18:29:04 2022] POST /compute/v2.1/flavors/471135163/os-extra_specs => generated 66 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:29:04.348112 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8446b815-b273-4f75-b14a-0b394efad670 tempest-QuotasAdminTestJSON-1284220734 tempest-QuotasAdminTestJSON-1284220734-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/35490d1204c84681a5ca57b51fddea10?user_id=ad458ab862e847e4b34187da332734d7" status: 200 len: 370 microversion: 2.1 time: 0.144905 Oct 04 18:29:04.350462 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 184/397] 10.222.0.20 () {58 vars in 1323 bytes} [Tue Oct 4 18:29:04 2022] GET /compute/v2.1/os-quota-sets/35490d1204c84681a5ca57b51fddea10?user_id=ad458ab862e847e4b34187da332734d7 => generated 370 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:29:04.358740 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-540fb11c-975b-40a5-8bce-d767586834bc tempest-FlavorsExtraSpecsTestJSON-774207453 tempest-FlavorsExtraSpecsTestJSON-774207453-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:04.376342 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-540fb11c-975b-40a5-8bce-d767586834bc tempest-FlavorsExtraSpecsTestJSON-774207453 tempest-FlavorsExtraSpecsTestJSON-774207453-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/471135163/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.023550 Oct 04 18:29:04.379560 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 185/398] 10.222.0.20 () {58 vars in 1200 bytes} [Tue Oct 4 18:29:04 2022] GET /compute/v2.1/flavors/471135163/os-extra_specs => generated 66 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:29:04.387263 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-68c8c4f4-de09-4adb-92a4-1fff31026997 req-d8bc3490-9b2c-4206-a83b-67ecc585c9e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e85db28-c393-4e02-8f28-bf0d217b6db7", "name": "network-vif-plugged", "status": "completed", "tag": "a7a62b4e-0cc7-42b1-976e-0559dd4fcf07"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:04.397299 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-68c8c4f4-de09-4adb-92a4-1fff31026997 req-d8bc3490-9b2c-4206-a83b-67ecc585c9e7 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:04.398010 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-68c8c4f4-de09-4adb-92a4-1fff31026997 req-d8bc3490-9b2c-4206-a83b-67ecc585c9e7 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:04.399196 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-68c8c4f4-de09-4adb-92a4-1fff31026997 req-d8bc3490-9b2c-4206-a83b-67ecc585c9e7 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:04.412834 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-68c8c4f4-de09-4adb-92a4-1fff31026997 req-d8bc3490-9b2c-4206-a83b-67ecc585c9e7 service nova] Creating event network-vif-plugged:a7a62b4e-0cc7-42b1-976e-0559dd4fcf07 for instance 2e85db28-c393-4e02-8f28-bf0d217b6db7 on n-h1-850501-14 Oct 04 18:29:04.419237 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-68c8c4f4-de09-4adb-92a4-1fff31026997 req-d8bc3490-9b2c-4206-a83b-67ecc585c9e7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036825 Oct 04 18:29:04.424823 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 186/399] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:29:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:29:04.428751 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-483f3f25-e46f-4241-9a46-7d15e6004a23 tempest-FlavorsExtraSpecsTestJSON-774207453 tempest-FlavorsExtraSpecsTestJSON-774207453-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:04.490985 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-482eb692-a796-41dd-a620-7810911dfdf9 tempest-FlavorsAccessTestJSON-739503869 tempest-FlavorsAccessTestJSON-739503869-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:04.535021 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-483f3f25-e46f-4241-9a46-7d15e6004a23 tempest-FlavorsExtraSpecsTestJSON-774207453 tempest-FlavorsExtraSpecsTestJSON-774207453-project-admin] 10.222.0.20 "PUT /compute/v2.1/flavors/471135163/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.110578 Oct 04 18:29:04.535696 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 187/400] 10.222.0.20 () {60 vars in 1262 bytes} [Tue Oct 4 18:29:04 2022] PUT /compute/v2.1/flavors/471135163/os-extra_specs/hw:numa_nodes => generated 22 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:29:04.541504 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-482eb692-a796-41dd-a620-7810911dfdf9 tempest-FlavorsAccessTestJSON-739503869 tempest-FlavorsAccessTestJSON-739503869-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 6643 microversion: 2.1 time: 0.201749 Oct 04 18:29:04.542315 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 214/401] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Oct 4 18:29:04 2022] GET /compute/v2.1/flavors/detail => generated 6643 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:04.548300 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f89feae4-5a99-43b6-a8d9-27916a36041e tempest-FlavorsExtraSpecsTestJSON-774207453 tempest-FlavorsExtraSpecsTestJSON-774207453-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:04.558093 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f89feae4-5a99-43b6-a8d9-27916a36041e tempest-FlavorsExtraSpecsTestJSON-774207453 tempest-FlavorsExtraSpecsTestJSON-774207453-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/471135163/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.016261 Oct 04 18:29:04.558802 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 188/402] 10.222.0.20 () {58 vars in 1200 bytes} [Tue Oct 4 18:29:04 2022] GET /compute/v2.1/flavors/471135163/os-extra_specs => generated 66 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 18:29:04.562812 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-14609f3d-6a0c-4f56-874a-9b24a6a5274e tempest-FlavorsAccessTestJSON-1255965555 tempest-FlavorsAccessTestJSON-1255965555-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "f0810c82f0ee43afb87dbbc357be1e83"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:04.567870 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-903f1b23-6ca6-4fc3-ad4c-fb0370316e94 tempest-FlavorsExtraSpecsTestJSON-774207453 tempest-FlavorsExtraSpecsTestJSON-774207453-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:04.682288 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-903f1b23-6ca6-4fc3-ad4c-fb0370316e94 tempest-FlavorsExtraSpecsTestJSON-774207453 tempest-FlavorsExtraSpecsTestJSON-774207453-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/471135163/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.117649 Oct 04 18:29:04.683046 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 189/403] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Oct 4 18:29:04 2022] DELETE /compute/v2.1/flavors/471135163/os-extra_specs/hw:numa_nodes => generated 0 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 04 18:29:04.694444 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-328a973e-abc1-41bd-b4c6-b6034911ef0f tempest-FlavorsExtraSpecsTestJSON-774207453 tempest-FlavorsExtraSpecsTestJSON-774207453-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:04.817114 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-328a973e-abc1-41bd-b4c6-b6034911ef0f tempest-FlavorsExtraSpecsTestJSON-774207453 tempest-FlavorsExtraSpecsTestJSON-774207453-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/471135163/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.126208 Oct 04 18:29:04.817979 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 190/404] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Oct 4 18:29:04 2022] DELETE /compute/v2.1/flavors/471135163/os-extra_specs/hw:cpu_policy => generated 0 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 04 18:29:04.828227 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-02f7350a-bec5-4c68-9223-7ac2136134d5 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:04.829274 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-02f7350a-bec5-4c68-9223-7ac2136134d5 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: 2e85db28-c393-4e02-8f28-bf0d217b6db7] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:04.835285 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-02f7350a-bec5-4c68-9223-7ac2136134d5 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:04.836684 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-02f7350a-bec5-4c68-9223-7ac2136134d5 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:04.837112 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-02f7350a-bec5-4c68-9223-7ac2136134d5 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:04.838143 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-02f7350a-bec5-4c68-9223-7ac2136134d5 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:04.838669 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-02f7350a-bec5-4c68-9223-7ac2136134d5 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:04.839157 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-02f7350a-bec5-4c68-9223-7ac2136134d5 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:04.996593 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-02f7350a-bec5-4c68-9223-7ac2136134d5 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:05.004950 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-02f7350a-bec5-4c68-9223-7ac2136134d5 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/2e85db28-c393-4e02-8f28-bf0d217b6db7" status: 200 len: 1317 microversion: 2.1 time: 0.181980 Oct 04 18:29:05.005920 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 191/405] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:04 2022] GET /compute/v2.1/servers/2e85db28-c393-4e02-8f28-bf0d217b6db7 => generated 1317 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:05.011150 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-53a6c036-7ef7-436a-80d0-8fc78b94225e tempest-FlavorsExtraSpecsTestJSON-774207453 tempest-FlavorsExtraSpecsTestJSON-774207453-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:05.023949 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-53a6c036-7ef7-436a-80d0-8fc78b94225e tempest-FlavorsExtraSpecsTestJSON-774207453 tempest-FlavorsExtraSpecsTestJSON-774207453-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/471135163/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.012454 Oct 04 18:29:05.023949 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 192/406] 10.222.0.20 () {58 vars in 1200 bytes} [Tue Oct 4 18:29:05 2022] GET /compute/v2.1/flavors/471135163/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:29:05.031080 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-09d5f4be-5857-48d0-9b9a-d3425df91a95 tempest-FlavorsExtraSpecsTestJSON-774207453 tempest-FlavorsExtraSpecsTestJSON-774207453-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:05.141368 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-09d5f4be-5857-48d0-9b9a-d3425df91a95 tempest-FlavorsExtraSpecsTestJSON-774207453 tempest-FlavorsExtraSpecsTestJSON-774207453-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/471135163" status: 202 len: 0 microversion: 2.1 time: 0.107979 Oct 04 18:29:05.141368 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 193/407] 10.222.0.20 () {58 vars in 1158 bytes} [Tue Oct 4 18:29:05 2022] DELETE /compute/v2.1/flavors/471135163 => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:29:05.146392 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-bc0c8e26-bb9b-453d-9fa7-17de2dfb28b4 tempest-FlavorsExtraSpecsTestJSON-774207453 tempest-FlavorsExtraSpecsTestJSON-774207453-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:05.181900 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-bc0c8e26-bb9b-453d-9fa7-17de2dfb28b4 tempest-FlavorsExtraSpecsTestJSON-774207453 tempest-FlavorsExtraSpecsTestJSON-774207453-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.040159 Oct 04 18:29:05.183578 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 194/408] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Oct 4 18:29:05 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:05.493454 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-14609f3d-6a0c-4f56-874a-9b24a6a5274e tempest-FlavorsAccessTestJSON-1255965555 tempest-FlavorsAccessTestJSON-1255965555-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/1535005155/action" status: 200 len: 21 microversion: 2.1 time: 0.934360 Oct 04 18:29:05.494133 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 215/409] 10.222.0.20 () {60 vars in 1200 bytes} [Tue Oct 4 18:29:04 2022] POST /compute/v2.1/flavors/1535005155/action => generated 21 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 18:29:05.504207 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-446e38db-4de4-4312-af54-0d4d5cd06030 tempest-FlavorsAccessTestJSON-739503869 tempest-FlavorsAccessTestJSON-739503869-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:05.549969 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-446e38db-4de4-4312-af54-0d4d5cd06030 tempest-FlavorsAccessTestJSON-739503869 tempest-FlavorsAccessTestJSON-739503869-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.049499 Oct 04 18:29:05.564489 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 195/410] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Oct 4 18:29:05 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:05.572801 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9ef51c3f-355c-45b2-80c1-40f6f7699f05 tempest-FlavorsAccessTestJSON-1255965555 tempest-FlavorsAccessTestJSON-1255965555-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:05.580184 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=6,nova_api:SAVEPOINT=6,nova_api:RELEASE=6,nova_api:DELETE=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:05.747517 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9ef51c3f-355c-45b2-80c1-40f6f7699f05 tempest-FlavorsAccessTestJSON-1255965555 tempest-FlavorsAccessTestJSON-1255965555-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1535005155" status: 202 len: 0 microversion: 2.1 time: 0.181055 Oct 04 18:29:05.754303 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 216/411] 10.222.0.20 () {58 vars in 1161 bytes} [Tue Oct 4 18:29:05 2022] DELETE /compute/v2.1/flavors/1535005155 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:29:05.769136 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9f181f66-1170-44a0-af7a-55dba1492ffe tempest-FlavorsAccessTestJSON-1255965555 tempest-FlavorsAccessTestJSON-1255965555-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:05.803032 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9f181f66-1170-44a0-af7a-55dba1492ffe tempest-FlavorsAccessTestJSON-1255965555 tempest-FlavorsAccessTestJSON-1255965555-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.038718 Oct 04 18:29:05.803629 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 196/412] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Oct 4 18:29:05 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:05.824741 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9581038f-ce03-46f8-80e2-b2be4549a179 tempest-FlavorsAccessTestJSON-1255965555 tempest-FlavorsAccessTestJSON-1255965555-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-2138727839", "id": 1632280412, "os-flavor-access:is_public": "False"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:05.891718 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-245149ba-5bfe-45ab-8d25-55e5710152eb tempest-QuotasAdminTestJSON-1284220734 tempest-QuotasAdminTestJSON-1284220734-project-admin] Calling method '.version_select at 0x7fe259751160>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:05.921513 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9581038f-ce03-46f8-80e2-b2be4549a179 tempest-FlavorsAccessTestJSON-1255965555 tempest-FlavorsAccessTestJSON-1255965555-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.100347 Oct 04 18:29:05.930374 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 217/413] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:29:05 2022] POST /compute/v2.1/flavors => generated 431 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:29:05.937621 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f319609f-5cdf-456b-b77f-0c1732e3b26c tempest-FlavorsAccessTestJSON-1255965555 tempest-FlavorsAccessTestJSON-1255965555-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:05.959792 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f319609f-5cdf-456b-b77f-0c1732e3b26c tempest-FlavorsAccessTestJSON-1255965555 tempest-FlavorsAccessTestJSON-1255965555-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/1632280412/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.027993 Oct 04 18:29:05.961877 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 218/414] 10.222.0.20 () {58 vars in 1209 bytes} [Tue Oct 4 18:29:05 2022] GET /compute/v2.1/flavors/1632280412/os-flavor-access => generated 21 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:29:05.973064 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0f082806-5f15-450e-8497-adfa5f5e934d tempest-FlavorsAccessTestJSON-1255965555 tempest-FlavorsAccessTestJSON-1255965555-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:06.055722 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0f082806-5f15-450e-8497-adfa5f5e934d tempest-FlavorsAccessTestJSON-1255965555 tempest-FlavorsAccessTestJSON-1255965555-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1632280412" status: 202 len: 0 microversion: 2.1 time: 0.087558 Oct 04 18:29:06.056889 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 219/415] 10.222.0.20 () {58 vars in 1161 bytes} [Tue Oct 4 18:29:05 2022] DELETE /compute/v2.1/flavors/1632280412 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:29:06.062799 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9f4a20f5-ac1f-4d41-a84a-fcb0c0f0525c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:06.063360 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-9f4a20f5-ac1f-4d41-a84a-fcb0c0f0525c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: 2e85db28-c393-4e02-8f28-bf0d217b6db7] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:06.076169 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9f4a20f5-ac1f-4d41-a84a-fcb0c0f0525c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:06.077700 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9f4a20f5-ac1f-4d41-a84a-fcb0c0f0525c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:06.078455 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9f4a20f5-ac1f-4d41-a84a-fcb0c0f0525c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:06.079397 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9f4a20f5-ac1f-4d41-a84a-fcb0c0f0525c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:06.079884 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9f4a20f5-ac1f-4d41-a84a-fcb0c0f0525c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:06.080922 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9f4a20f5-ac1f-4d41-a84a-fcb0c0f0525c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:06.246485 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9f4a20f5-ac1f-4d41-a84a-fcb0c0f0525c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:06.256515 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9f4a20f5-ac1f-4d41-a84a-fcb0c0f0525c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/2e85db28-c393-4e02-8f28-bf0d217b6db7" status: 200 len: 1467 microversion: 2.1 time: 0.198066 Oct 04 18:29:06.258240 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 220/416] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:06 2022] GET /compute/v2.1/servers/2e85db28-c393-4e02-8f28-bf0d217b6db7 => generated 1467 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:06.263247 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3e545e7d-d549-494a-a1f2-5ef31ff91c18 tempest-FlavorsAccessTestJSON-1255965555 tempest-FlavorsAccessTestJSON-1255965555-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:06.287940 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3e545e7d-d549-494a-a1f2-5ef31ff91c18 tempest-FlavorsAccessTestJSON-1255965555 tempest-FlavorsAccessTestJSON-1255965555-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.028021 Oct 04 18:29:06.288602 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 221/417] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Oct 4 18:29:06 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:06.783966 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1049ad05-36a5-4e3e-b439-9f29e079abe6 tempest-ServersOnMultiNodesTest-1719152185 tempest-ServersOnMultiNodesTest-1719152185-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:06.784837 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1049ad05-36a5-4e3e-b439-9f29e079abe6 tempest-ServersOnMultiNodesTest-1719152185 tempest-ServersOnMultiNodesTest-1719152185-project-admin] [instance: 2e85db28-c393-4e02-8f28-bf0d217b6db7] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:06.796433 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1049ad05-36a5-4e3e-b439-9f29e079abe6 tempest-ServersOnMultiNodesTest-1719152185 tempest-ServersOnMultiNodesTest-1719152185-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:06.797074 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1049ad05-36a5-4e3e-b439-9f29e079abe6 tempest-ServersOnMultiNodesTest-1719152185 tempest-ServersOnMultiNodesTest-1719152185-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:06.797688 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1049ad05-36a5-4e3e-b439-9f29e079abe6 tempest-ServersOnMultiNodesTest-1719152185 tempest-ServersOnMultiNodesTest-1719152185-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:06.798637 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1049ad05-36a5-4e3e-b439-9f29e079abe6 tempest-ServersOnMultiNodesTest-1719152185 tempest-ServersOnMultiNodesTest-1719152185-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:06.800410 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1049ad05-36a5-4e3e-b439-9f29e079abe6 tempest-ServersOnMultiNodesTest-1719152185 tempest-ServersOnMultiNodesTest-1719152185-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:06.801185 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1049ad05-36a5-4e3e-b439-9f29e079abe6 tempest-ServersOnMultiNodesTest-1719152185 tempest-ServersOnMultiNodesTest-1719152185-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:06.953448 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-245149ba-5bfe-45ab-8d25-55e5710152eb tempest-QuotasAdminTestJSON-1284220734 tempest-QuotasAdminTestJSON-1284220734-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/06c1142eeda640bba582c0fc08bd3cc8/defaults" status: 200 len: 371 microversion: 2.1 time: 1.066003 Oct 04 18:29:06.954805 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 197/418] 10.222.0.20 () {58 vars in 1269 bytes} [Tue Oct 4 18:29:05 2022] GET /compute/v2.1/os-quota-sets/06c1142eeda640bba582c0fc08bd3cc8/defaults => generated 371 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:29:06.970151 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-eb2e95d0-96c7-4a88-856d-ee17266274ee tempest-QuotasAdminTestJSON-1284220734 tempest-QuotasAdminTestJSON-1284220734-project-admin] Action: 'update', calling method: .version_select at 0x7fe2597d5a60>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:07.332872 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1049ad05-36a5-4e3e-b439-9f29e079abe6 tempest-ServersOnMultiNodesTest-1719152185 tempest-ServersOnMultiNodesTest-1719152185-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/2e85db28-c393-4e02-8f28-bf0d217b6db7" status: 200 len: 1620 microversion: 2.1 time: 1.043042 Oct 04 18:29:07.334293 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 222/419] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:06 2022] GET /compute/v2.1/servers/2e85db28-c393-4e02-8f28-bf0d217b6db7 => generated 1620 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:07.358251 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-338056fb-5549-43fc-a2e0-ad0bda8b8758 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Action: 'create', calling method: .version_select at 0x7fe259945e50>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-267143144", "policies": ["affinity"]}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:07.398230 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-338056fb-5549-43fc-a2e0-ad0bda8b8758 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Getting quotas for project 771211a4ce424aa48920ff102c894a9f. Resources: {'server_groups'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:29:07.410494 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-338056fb-5549-43fc-a2e0-ad0bda8b8758 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Getting quotas for user 07dd131fa3c44d439d0f3ec6e4b8ad42 and project 771211a4ce424aa48920ff102c894a9f. Resources: {'server_groups'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:29:07.582469 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-338056fb-5549-43fc-a2e0-ad0bda8b8758 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Getting quotas for project 771211a4ce424aa48920ff102c894a9f. Resources: {'server_groups'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:29:07.594891 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-338056fb-5549-43fc-a2e0-ad0bda8b8758 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Getting quotas for user 07dd131fa3c44d439d0f3ec6e4b8ad42 and project 771211a4ce424aa48920ff102c894a9f. Resources: {'server_groups'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:29:07.620930 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-338056fb-5549-43fc-a2e0-ad0bda8b8758 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.266893 Oct 04 18:29:07.624094 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 223/420] 10.222.0.20 () {60 vars in 1174 bytes} [Tue Oct 4 18:29:07 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:29:07.707358 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eb2e95d0-96c7-4a88-856d-ee17266274ee tempest-QuotasAdminTestJSON-1284220734 tempest-QuotasAdminTestJSON-1284220734-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:07.707843 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eb2e95d0-96c7-4a88-856d-ee17266274ee tempest-QuotasAdminTestJSON-1284220734 tempest-QuotasAdminTestJSON-1284220734-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:07.708300 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eb2e95d0-96c7-4a88-856d-ee17266274ee tempest-QuotasAdminTestJSON-1284220734 tempest-QuotasAdminTestJSON-1284220734-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:07.712844 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eb2e95d0-96c7-4a88-856d-ee17266274ee tempest-QuotasAdminTestJSON-1284220734 tempest-QuotasAdminTestJSON-1284220734-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:07.713388 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eb2e95d0-96c7-4a88-856d-ee17266274ee tempest-QuotasAdminTestJSON-1284220734 tempest-QuotasAdminTestJSON-1284220734-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:07.713829 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eb2e95d0-96c7-4a88-856d-ee17266274ee tempest-QuotasAdminTestJSON-1284220734 tempest-QuotasAdminTestJSON-1284220734-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:07.820857 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-05cf004f-ea84-4354-8d32-d504a92ccdc4 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-2023095152", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "75d1ac2f-d5be-4270-81b8-f7db691eccfb"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:07.902647 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.neutron [None req-05cf004f-ea84-4354-8d32-d504a92ccdc4 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] validate_networks() for None {{(pid=123001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:29:08.147023 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-05cf004f-ea84-4354-8d32-d504a92ccdc4 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:29:08.147450 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-05cf004f-ea84-4354-8d32-d504a92ccdc4 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:29:08.147929 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-05cf004f-ea84-4354-8d32-d504a92ccdc4 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:29:08.149013 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-05cf004f-ea84-4354-8d32-d504a92ccdc4 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:29:08.149529 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-05cf004f-ea84-4354-8d32-d504a92ccdc4 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:29:08.174193 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-05cf004f-ea84-4354-8d32-d504a92ccdc4 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:08.174673 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-05cf004f-ea84-4354-8d32-d504a92ccdc4 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:08.175109 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-05cf004f-ea84-4354-8d32-d504a92ccdc4 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:08.176131 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-05cf004f-ea84-4354-8d32-d504a92ccdc4 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:08.176589 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-05cf004f-ea84-4354-8d32-d504a92ccdc4 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:08.177020 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-05cf004f-ea84-4354-8d32-d504a92ccdc4 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:08.193763 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-05cf004f-ea84-4354-8d32-d504a92ccdc4 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Getting quotas for project 771211a4ce424aa48920ff102c894a9f. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:29:08.199357 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-05cf004f-ea84-4354-8d32-d504a92ccdc4 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Getting quotas for user 07dd131fa3c44d439d0f3ec6e4b8ad42 and project 771211a4ce424aa48920ff102c894a9f. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:29:08.214208 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-05cf004f-ea84-4354-8d32-d504a92ccdc4 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Going to run 2 instances... {{(pid=123001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:29:08.217147 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-05cf004f-ea84-4354-8d32-d504a92ccdc4 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: 890f8168-5b22-465a-894d-ca70dd1acbed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:29:08.361575 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-05cf004f-ea84-4354-8d32-d504a92ccdc4 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=123001) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 04 18:29:08.381724 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-05cf004f-ea84-4354-8d32-d504a92ccdc4 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Getting quotas for project 771211a4ce424aa48920ff102c894a9f. Resources: {'server_group_members'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:29:08.386348 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-05cf004f-ea84-4354-8d32-d504a92ccdc4 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Getting quotas for user 07dd131fa3c44d439d0f3ec6e4b8ad42 and project 771211a4ce424aa48920ff102c894a9f. Resources: {'server_group_members'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:29:08.486461 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-05cf004f-ea84-4354-8d32-d504a92ccdc4 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Getting quotas for project 771211a4ce424aa48920ff102c894a9f. Resources: {'server_group_members'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:29:08.491207 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-05cf004f-ea84-4354-8d32-d504a92ccdc4 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Getting quotas for user 07dd131fa3c44d439d0f3ec6e4b8ad42 and project 771211a4ce424aa48920ff102c894a9f. Resources: {'server_group_members'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:29:08.508418 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-05cf004f-ea84-4354-8d32-d504a92ccdc4 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: cb82f77b-6207-4a99-a494-f252a820990c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=890f8168-5b22-465a-894d-ca70dd1acbed,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:29:08.669860 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:DELETE=5,nova_api:SELECT=86,nova_api:INSERT=9 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:08.709037 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-05cf004f-ea84-4354-8d32-d504a92ccdc4 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Getting quotas for project 771211a4ce424aa48920ff102c894a9f. Resources: {'server_group_members'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:29:08.714758 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-05cf004f-ea84-4354-8d32-d504a92ccdc4 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Getting quotas for user 07dd131fa3c44d439d0f3ec6e4b8ad42 and project 771211a4ce424aa48920ff102c894a9f. Resources: {'server_group_members'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:29:08.827497 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=66 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:08.838824 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-05cf004f-ea84-4354-8d32-d504a92ccdc4 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Getting quotas for project 771211a4ce424aa48920ff102c894a9f. Resources: {'server_group_members'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:29:08.843552 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-05cf004f-ea84-4354-8d32-d504a92ccdc4 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Getting quotas for user 07dd131fa3c44d439d0f3ec6e4b8ad42 and project 771211a4ce424aa48920ff102c894a9f. Resources: {'server_group_members'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:29:08.878148 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-05cf004f-ea84-4354-8d32-d504a92ccdc4 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.061913 Oct 04 18:29:08.878753 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 224/421] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:29:07 2022] POST /compute/v2.1/servers => generated 32 bytes in 1063 msecs (HTTP/1.1 202) 9 headers in 362 bytes (2 switches on core 0) Oct 04 18:29:08.887204 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e1bf7d3a-fddc-43c6-b7b1-163acfefd15f tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:08.892169 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e1bf7d3a-fddc-43c6-b7b1-163acfefd15f tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:08.892834 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e1bf7d3a-fddc-43c6-b7b1-163acfefd15f tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Searching by: {'deleted': False, 'project_id': '771211a4ce424aa48920ff102c894a9f'} {{(pid=123001) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:29:08.911298 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e1bf7d3a-fddc-43c6-b7b1-163acfefd15f tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:08.911799 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e1bf7d3a-fddc-43c6-b7b1-163acfefd15f tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:08.912410 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e1bf7d3a-fddc-43c6-b7b1-163acfefd15f tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:08.918634 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e1bf7d3a-fddc-43c6-b7b1-163acfefd15f tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:08.918634 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e1bf7d3a-fddc-43c6-b7b1-163acfefd15f tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:08.918634 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e1bf7d3a-fddc-43c6-b7b1-163acfefd15f tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:09.007071 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.multi_cell_list [None req-e1bf7d3a-fddc-43c6-b7b1-163acfefd15f tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=123001) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:29:09.128109 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e1bf7d3a-fddc-43c6-b7b1-163acfefd15f tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 1004 microversion: 2.1 time: 0.245057 Oct 04 18:29:09.128883 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 225/422] 10.222.0.20 () {58 vars in 1125 bytes} [Tue Oct 4 18:29:08 2022] GET /compute/v2.1/servers => generated 1004 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:29:09.140878 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b8f00853-86d9-40f3-b7c1-31d1929bd813 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:09.141488 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b8f00853-86d9-40f3-b7c1-31d1929bd813 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: cb82f77b-6207-4a99-a494-f252a820990c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:09.217077 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b8f00853-86d9-40f3-b7c1-31d1929bd813 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:09.219968 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:UPDATE=7,nova_cell0:SELECT=91 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:09.225926 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b8f00853-86d9-40f3-b7c1-31d1929bd813 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/cb82f77b-6207-4a99-a494-f252a820990c" status: 200 len: 1219 microversion: 2.1 time: 0.088748 Oct 04 18:29:09.227314 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 226/423] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:09 2022] GET /compute/v2.1/servers/cb82f77b-6207-4a99-a494-f252a820990c => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:29:09.270622 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=74,nova_api:SAVEPOINT=3,nova_api:RELEASE=3,nova_api:UPDATE=1,nova_api:DELETE=5,nova_api:INSERT=14 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:09.274585 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-eb2e95d0-96c7-4a88-856d-ee17266274ee tempest-QuotasAdminTestJSON-1284220734 tempest-QuotasAdminTestJSON-1284220734-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/06c1142eeda640bba582c0fc08bd3cc8" status: 200 len: 329 microversion: 2.1 time: 2.310703 Oct 04 18:29:09.275214 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 198/424] 10.222.0.20 () {60 vars in 1263 bytes} [Tue Oct 4 18:29:06 2022] PUT /compute/v2.1/os-quota-sets/06c1142eeda640bba582c0fc08bd3cc8 => generated 329 bytes in 2312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:29:09.286968 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-98105145-981a-4957-809e-db8c8eee39bb tempest-QuotasAdminTestJSON-1284220734 tempest-QuotasAdminTestJSON-1284220734-project-admin] Action: 'update', calling method: .version_select at 0x7fe259846040>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:10.250668 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-45efa282-9f24-43e0-817d-d53a6f1c046d tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:10.251493 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-45efa282-9f24-43e0-817d-d53a6f1c046d tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: cb82f77b-6207-4a99-a494-f252a820990c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:10.362353 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-45efa282-9f24-43e0-817d-d53a6f1c046d tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:10.367378 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-45efa282-9f24-43e0-817d-d53a6f1c046d tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/cb82f77b-6207-4a99-a494-f252a820990c" status: 200 len: 1219 microversion: 2.1 time: 0.121438 Oct 04 18:29:10.368521 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 199/425] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:10 2022] GET /compute/v2.1/servers/cb82f77b-6207-4a99-a494-f252a820990c => generated 1219 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:10.388238 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-98105145-981a-4957-809e-db8c8eee39bb tempest-QuotasAdminTestJSON-1284220734 tempest-QuotasAdminTestJSON-1284220734-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:10.390729 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-98105145-981a-4957-809e-db8c8eee39bb tempest-QuotasAdminTestJSON-1284220734 tempest-QuotasAdminTestJSON-1284220734-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:10.390729 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-98105145-981a-4957-809e-db8c8eee39bb tempest-QuotasAdminTestJSON-1284220734 tempest-QuotasAdminTestJSON-1284220734-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:10.390729 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-98105145-981a-4957-809e-db8c8eee39bb tempest-QuotasAdminTestJSON-1284220734 tempest-QuotasAdminTestJSON-1284220734-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:10.390729 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-98105145-981a-4957-809e-db8c8eee39bb tempest-QuotasAdminTestJSON-1284220734 tempest-QuotasAdminTestJSON-1284220734-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:10.391076 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-98105145-981a-4957-809e-db8c8eee39bb tempest-QuotasAdminTestJSON-1284220734 tempest-QuotasAdminTestJSON-1284220734-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:10.775026 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-cd7b81bb-8be7-489d-ae56-cccff5fad4bc tempest-FlavorsV2NegativeTest-1417624124 tempest-FlavorsV2NegativeTest-1417624124-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:10.783925 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-cd7b81bb-8be7-489d-ae56-cccff5fad4bc tempest-FlavorsV2NegativeTest-1417624124 tempest-FlavorsV2NegativeTest-1417624124-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.290252 Oct 04 18:29:10.796178 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 200/426] 10.222.0.20 () {58 vars in 1137 bytes} [Tue Oct 4 18:29:10 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:29:11.394902 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a236a14f-04ff-4cd7-8914-fe77e1a42fd8 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:11.396454 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a236a14f-04ff-4cd7-8914-fe77e1a42fd8 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: cb82f77b-6207-4a99-a494-f252a820990c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:11.403681 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a236a14f-04ff-4cd7-8914-fe77e1a42fd8 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:11.404570 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a236a14f-04ff-4cd7-8914-fe77e1a42fd8 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:11.404991 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a236a14f-04ff-4cd7-8914-fe77e1a42fd8 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:11.405814 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a236a14f-04ff-4cd7-8914-fe77e1a42fd8 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:11.406397 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a236a14f-04ff-4cd7-8914-fe77e1a42fd8 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:11.406818 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a236a14f-04ff-4cd7-8914-fe77e1a42fd8 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:11.474814 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a236a14f-04ff-4cd7-8914-fe77e1a42fd8 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:11.483172 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a236a14f-04ff-4cd7-8914-fe77e1a42fd8 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/cb82f77b-6207-4a99-a494-f252a820990c" status: 200 len: 1215 microversion: 2.1 time: 0.093975 Oct 04 18:29:11.483736 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 201/427] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:11 2022] GET /compute/v2.1/servers/cb82f77b-6207-4a99-a494-f252a820990c => generated 1215 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:29:12.508220 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-44d9478d-b06e-47b1-a94d-ea7146675a43 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:12.508930 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-44d9478d-b06e-47b1-a94d-ea7146675a43 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: cb82f77b-6207-4a99-a494-f252a820990c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:12.516078 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-44d9478d-b06e-47b1-a94d-ea7146675a43 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:12.520562 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-44d9478d-b06e-47b1-a94d-ea7146675a43 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:12.521031 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-44d9478d-b06e-47b1-a94d-ea7146675a43 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:12.521828 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-44d9478d-b06e-47b1-a94d-ea7146675a43 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:12.522294 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-44d9478d-b06e-47b1-a94d-ea7146675a43 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:12.522734 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-44d9478d-b06e-47b1-a94d-ea7146675a43 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:12.626938 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-44d9478d-b06e-47b1-a94d-ea7146675a43 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:12.635370 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-44d9478d-b06e-47b1-a94d-ea7146675a43 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/cb82f77b-6207-4a99-a494-f252a820990c" status: 200 len: 1271 microversion: 2.1 time: 0.132399 Oct 04 18:29:12.643186 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 202/428] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:12 2022] GET /compute/v2.1/servers/cb82f77b-6207-4a99-a494-f252a820990c => generated 1271 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:29:12.733290 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-527779ae-b61b-4393-9ea6-9b7afe2cd769 tempest-FlavorsV2NegativeTest-1417624124 tempest-FlavorsV2NegativeTest-1417624124-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1678597377", "imageRef": "86a81523-0f1d-4859-9738-5a6ec089349f", "flavorRef": "452"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:12.793811 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-527779ae-b61b-4393-9ea6-9b7afe2cd769 tempest-FlavorsV2NegativeTest-1417624124 tempest-FlavorsV2NegativeTest-1417624124-project] validate_networks() for None {{(pid=123002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:29:13.066909 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-98105145-981a-4957-809e-db8c8eee39bb tempest-QuotasAdminTestJSON-1284220734 tempest-QuotasAdminTestJSON-1284220734-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/06c1142eeda640bba582c0fc08bd3cc8" status: 200 len: 329 microversion: 2.1 time: 3.783609 Oct 04 18:29:13.067769 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 227/429] 10.222.0.20 () {60 vars in 1263 bytes} [Tue Oct 4 18:29:09 2022] PUT /compute/v2.1/os-quota-sets/06c1142eeda640bba582c0fc08bd3cc8 => generated 329 bytes in 3785 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:29:13.122704 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-527779ae-b61b-4393-9ea6-9b7afe2cd769 tempest-FlavorsV2NegativeTest-1417624124 tempest-FlavorsV2NegativeTest-1417624124-project] HTTP exception thrown: Flavor's memory is too small for requested image. Oct 04 18:29:13.124754 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-527779ae-b61b-4393-9ea6-9b7afe2cd769 tempest-FlavorsV2NegativeTest-1417624124 tempest-FlavorsV2NegativeTest-1417624124-project] Request method failure captured: Oct 04 18:29:13.124754 n-d-850501-14 devstack@n-api.service[123002]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:29:13.124754 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:29:13.124754 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:29:13.124754 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:29:13.124754 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 143 Oct 04 18:29:13.124754 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:29:13.124754 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:29:13.124754 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:29:13.124754 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:29:13.124754 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPHt2df2yaMvD-GVAYTQbkzZ7rjQzCPotyGtWkQyG9DDMlQXeGiAhvJLY2OAa08E1oCVkjoSP2-gAR2z2_3B1ZqluNUao24M5eDaklI3eUo34K8I1spX9J2Z5LCIke59lTwbSHlR_o6b0ZwAO4Of5M0jIQu6nYz4oxQBYdifvkBV1Tvo Oct 04 18:29:13.124754 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:29:13.124754 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:29:13.124754 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:29:13.124754 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:29:13.124754 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:29:13.124754 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:29:13.124754 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 9f8831a3ea574fbc946f84686ac6575b Oct 04 18:29:13.124754 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-FlavorsV2NegativeTest-1417624124 Oct 04 18:29:13.124754 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:29:13.124754 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:29:13.126105 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9f8831a3ea574fbc946f84686ac6575b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9f8831a3ea574fbc946f84686ac6575b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9f8831a3ea574fbc946f84686ac6575b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9f8831a3ea574fbc946f84686ac6575b"}]}] Oct 04 18:29:13.126105 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-FlavorsV2NegativeTest-1417624124 Oct 04 18:29:13.126105 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 9f8831a3ea574fbc946f84686ac6575b Oct 04 18:29:13.126105 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1417624124 Oct 04 18:29:13.126105 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-FlavorsV2NegativeTest-1417624124-project Oct 04 18:29:13.126105 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:29:13.126105 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:29:13.126105 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 5f60cc60093945549d873f2e905f0e41 Oct 04 18:29:13.126105 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-FlavorsV2NegativeTest-1417624124-project Oct 04 18:29:13.126105 n-d-850501-14 devstack@n-api.service[123002]: Oct 04 18:29:13.126105 n-d-850501-14 devstack@n-api.service[123002]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1678597377", "imageRef": "86a81523-0f1d-4859-9738-5a6ec089349f", "flavorRef": "452"}} Oct 04 18:29:13.126105 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:29:13.126876 n-d-850501-14 devstack@n-api.service[123002]: exception: Flavor's memory is too small for requested image. Oct 04 18:29:13.126876 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-1678597377', 'imageRef': '86a81523-0f1d-4859-9738-5a6ec089349f', 'flavorRef': '452'}}} Oct 04 18:29:13.126876 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:29:13.126876 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:29:13.126876 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 18:29:13.126876 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 18:29:13.126876 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 18:29:13.126876 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 18:29:13.126876 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 04 18:29:13.126876 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 04 18:29:13.126876 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Oct 04 18:29:13.126876 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Oct 04 18:29:13.126876 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Oct 04 18:29:13.126876 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Oct 04 18:29:13.126876 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Oct 04 18:29:13.126876 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Oct 04 18:29:13.126876 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Oct 04 18:29:13.126876 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:29:13.126876 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:29:13.126876 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:29:13.128120 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:29:13.128120 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:29:13.128120 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:29:13.128120 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:29:13.128120 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:29:13.128120 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:29:13.128120 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:29:13.128120 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:29:13.128120 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:29:13.128120 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:29:13.128120 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:29:13.128120 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:29:13.128120 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:29:13.128120 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 18:29:13.128120 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Oct 04 18:29:13.128120 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 04 18:29:13.128120 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Oct 04 18:29:13.128120 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:29:13.128120 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:29:13.128120 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:29:13.128120 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:29:13.131033 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:29:13.131033 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:29:13.131033 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:29:13.131033 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:29:13.131033 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Oct 04 18:29:13.131033 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:29:13.131033 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-527779ae-b61b-4393-9ea6-9b7afe2cd769 tempest-FlavorsV2NegativeTest-1417624124 tempest-FlavorsV2NegativeTest-1417624124-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:29:13.131033 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-527779ae-b61b-4393-9ea6-9b7afe2cd769 tempest-FlavorsV2NegativeTest-1417624124 tempest-FlavorsV2NegativeTest-1417624124-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.396892 Oct 04 18:29:13.131033 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 203/430] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:29:12 2022] POST /compute/v2.1/servers => generated 93 bytes in 398 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 04 18:29:13.661197 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-31a7f484-a2bf-4b96-bdf2-1ab1039e8954 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:13.662175 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-31a7f484-a2bf-4b96-bdf2-1ab1039e8954 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: cb82f77b-6207-4a99-a494-f252a820990c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:13.668365 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:INSERT=16,nova_api:SELECT=70,nova_api:UPDATE=14 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:13.672711 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-31a7f484-a2bf-4b96-bdf2-1ab1039e8954 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:13.675370 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-31a7f484-a2bf-4b96-bdf2-1ab1039e8954 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:13.676351 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-31a7f484-a2bf-4b96-bdf2-1ab1039e8954 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:13.677066 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-31a7f484-a2bf-4b96-bdf2-1ab1039e8954 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:13.677696 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-31a7f484-a2bf-4b96-bdf2-1ab1039e8954 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:13.678122 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-31a7f484-a2bf-4b96-bdf2-1ab1039e8954 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:13.807203 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-31a7f484-a2bf-4b96-bdf2-1ab1039e8954 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:13.822062 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-31a7f484-a2bf-4b96-bdf2-1ab1039e8954 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/cb82f77b-6207-4a99-a494-f252a820990c" status: 200 len: 1289 microversion: 2.1 time: 0.164910 Oct 04 18:29:13.826601 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 228/431] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:13 2022] GET /compute/v2.1/servers/cb82f77b-6207-4a99-a494-f252a820990c => generated 1289 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:14.855760 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ab1f1f88-e8f9-48b5-bf7f-e29ff0f4638f tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:14.860129 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ab1f1f88-e8f9-48b5-bf7f-e29ff0f4638f tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: cb82f77b-6207-4a99-a494-f252a820990c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:14.866255 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ab1f1f88-e8f9-48b5-bf7f-e29ff0f4638f tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:14.868041 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ab1f1f88-e8f9-48b5-bf7f-e29ff0f4638f tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:14.869219 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ab1f1f88-e8f9-48b5-bf7f-e29ff0f4638f tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:14.870280 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ab1f1f88-e8f9-48b5-bf7f-e29ff0f4638f tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:14.870932 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ab1f1f88-e8f9-48b5-bf7f-e29ff0f4638f tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:14.871688 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ab1f1f88-e8f9-48b5-bf7f-e29ff0f4638f tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:15.120631 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ab1f1f88-e8f9-48b5-bf7f-e29ff0f4638f tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:15.135371 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ab1f1f88-e8f9-48b5-bf7f-e29ff0f4638f tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/cb82f77b-6207-4a99-a494-f252a820990c" status: 200 len: 1319 microversion: 2.1 time: 0.284392 Oct 04 18:29:15.135371 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 204/432] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:14 2022] GET /compute/v2.1/servers/cb82f77b-6207-4a99-a494-f252a820990c => generated 1319 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:15.250582 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-c3505b11-6902-4f1f-a280-b91f2091c523 req-af147eb3-5cd3-40c2-aec3-bb341fd3b683 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "890f8168-5b22-465a-894d-ca70dd1acbed", "tag": "7b1455a6-e16b-4098-ab8c-31d0d8669b3d"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:15.266885 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-c3505b11-6902-4f1f-a280-b91f2091c523 req-af147eb3-5cd3-40c2-aec3-bb341fd3b683 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:15.270775 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-c3505b11-6902-4f1f-a280-b91f2091c523 req-af147eb3-5cd3-40c2-aec3-bb341fd3b683 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:15.270775 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-c3505b11-6902-4f1f-a280-b91f2091c523 req-af147eb3-5cd3-40c2-aec3-bb341fd3b683 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:15.290111 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-c3505b11-6902-4f1f-a280-b91f2091c523 req-af147eb3-5cd3-40c2-aec3-bb341fd3b683 service nova] Creating event network-changed:7b1455a6-e16b-4098-ab8c-31d0d8669b3d for instance 890f8168-5b22-465a-894d-ca70dd1acbed on n-h2-850501-14 Oct 04 18:29:15.303850 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-c3505b11-6902-4f1f-a280-b91f2091c523 req-af147eb3-5cd3-40c2-aec3-bb341fd3b683 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057226 Oct 04 18:29:15.307185 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 205/433] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:29:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:29:15.365423 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4ad5636b-6569-4484-a647-b1b892bf1faa tempest-FlavorsV261TestJSON-157568488 tempest-FlavorsV261TestJSON-157568488-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-289479490", "id": 1949340564, "os-flavor-access:is_public": "True"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:15.448855 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-4ad5636b-6569-4484-a647-b1b892bf1faa tempest-FlavorsV261TestJSON-157568488 tempest-FlavorsV261TestJSON-157568488-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 467 microversion: 2.61 time: 0.457854 Oct 04 18:29:15.453446 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 229/434] 10.222.0.20 () {62 vars in 1188 bytes} [Tue Oct 4 18:29:14 2022] POST /compute/v2.1/flavors => generated 467 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:29:15.793159 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-57d50311-3380-4ce5-af8a-4824797c2650 req-9c5b6468-c7c4-4e70-b687-9990add44de8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb82f77b-6207-4a99-a494-f252a820990c", "tag": "373f7ba2-e607-421d-b977-173e90d9f09b"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:15.817849 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-57d50311-3380-4ce5-af8a-4824797c2650 req-9c5b6468-c7c4-4e70-b687-9990add44de8 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:15.818716 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-57d50311-3380-4ce5-af8a-4824797c2650 req-9c5b6468-c7c4-4e70-b687-9990add44de8 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:15.819617 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-57d50311-3380-4ce5-af8a-4824797c2650 req-9c5b6468-c7c4-4e70-b687-9990add44de8 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:15.848322 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-57d50311-3380-4ce5-af8a-4824797c2650 req-9c5b6468-c7c4-4e70-b687-9990add44de8 service nova] Creating event network-changed:373f7ba2-e607-421d-b977-173e90d9f09b for instance cb82f77b-6207-4a99-a494-f252a820990c on n-h2-850501-14 Oct 04 18:29:15.859556 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-57d50311-3380-4ce5-af8a-4824797c2650 req-9c5b6468-c7c4-4e70-b687-9990add44de8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072963 Oct 04 18:29:15.861702 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 230/435] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:29:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:29:16.072757 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-83a42cd9-067f-4593-b16c-d204bec4816b tempest-FlavorsV261TestJSON-1209157201 tempest-FlavorsV261TestJSON-1209157201-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:16.088532 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-83a42cd9-067f-4593-b16c-d204bec4816b tempest-FlavorsV261TestJSON-1209157201 tempest-FlavorsV261TestJSON-1209157201-project] 10.222.0.20 "GET /compute/v2.1/flavors/1949340564" status: 200 len: 467 microversion: 2.61 time: 0.628139 Oct 04 18:29:16.104658 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 206/436] 10.222.0.20 () {60 vars in 1199 bytes} [Tue Oct 4 18:29:15 2022] GET /compute/v2.1/flavors/1949340564 => generated 467 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:29:16.106171 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5d504cfd-6303-4b0f-96f1-7fc9aa07b6cb tempest-FlavorsV261TestJSON-157568488 tempest-FlavorsV261TestJSON-157568488-project-admin] Action: 'update', calling method: .version_select at 0x7fe25ae16670>, body: {"flavor": {"description": "new"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:16.155510 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-11c28b4b-f186-465f-ae1b-64b125c2e703 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:16.156898 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-11c28b4b-f186-465f-ae1b-64b125c2e703 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: cb82f77b-6207-4a99-a494-f252a820990c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:16.168486 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-11c28b4b-f186-465f-ae1b-64b125c2e703 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:16.169649 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-11c28b4b-f186-465f-ae1b-64b125c2e703 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:16.171788 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-11c28b4b-f186-465f-ae1b-64b125c2e703 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:16.172847 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-11c28b4b-f186-465f-ae1b-64b125c2e703 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:16.173329 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-11c28b4b-f186-465f-ae1b-64b125c2e703 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:16.173750 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-11c28b4b-f186-465f-ae1b-64b125c2e703 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:16.225429 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5d504cfd-6303-4b0f-96f1-7fc9aa07b6cb tempest-FlavorsV261TestJSON-157568488 tempest-FlavorsV261TestJSON-157568488-project-admin] 10.222.0.20 "PUT /compute/v2.1/flavors/1949340564" status: 200 len: 468 microversion: 2.61 time: 0.125595 Oct 04 18:29:16.236091 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 231/437] 10.222.0.20 () {62 vars in 1219 bytes} [Tue Oct 4 18:29:16 2022] PUT /compute/v2.1/flavors/1949340564 => generated 468 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 18:29:16.242612 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7b013860-9e40-47e7-a5a7-addbf840eb05 tempest-FlavorsV261TestJSON-1209157201 tempest-FlavorsV261TestJSON-1209157201-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:16.268655 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7b013860-9e40-47e7-a5a7-addbf840eb05 tempest-FlavorsV261TestJSON-1209157201 tempest-FlavorsV261TestJSON-1209157201-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 7157 microversion: 2.61 time: 0.030508 Oct 04 18:29:16.269228 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 232/438] 10.222.0.20 () {60 vars in 1187 bytes} [Tue Oct 4 18:29:16 2022] GET /compute/v2.1/flavors/detail => generated 7157 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:29:16.291710 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d34dcbe1-b3eb-4a5e-bea0-95bd8994ac66 tempest-FlavorsV261TestJSON-1209157201 tempest-FlavorsV261TestJSON-1209157201-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:16.330244 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d34dcbe1-b3eb-4a5e-bea0-95bd8994ac66 tempest-FlavorsV261TestJSON-1209157201 tempest-FlavorsV261TestJSON-1209157201-project] 10.222.0.20 "GET /compute/v2.1/flavors" status: 200 len: 3684 microversion: 2.61 time: 0.042862 Oct 04 18:29:16.343813 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 233/439] 10.222.0.20 () {60 vars in 1166 bytes} [Tue Oct 4 18:29:16 2022] GET /compute/v2.1/flavors => generated 3684 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:29:16.349655 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d76c5df0-a1e3-4cf1-a97e-3664f1b03a3b tempest-FlavorsV261TestJSON-157568488 tempest-FlavorsV261TestJSON-157568488-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:16.377197 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-11c28b4b-f186-465f-ae1b-64b125c2e703 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:16.389835 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-11c28b4b-f186-465f-ae1b-64b125c2e703 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/cb82f77b-6207-4a99-a494-f252a820990c" status: 200 len: 1319 microversion: 2.1 time: 0.239491 Oct 04 18:29:16.395877 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 207/440] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:16 2022] GET /compute/v2.1/servers/cb82f77b-6207-4a99-a494-f252a820990c => generated 1319 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:16.450087 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d76c5df0-a1e3-4cf1-a97e-3664f1b03a3b tempest-FlavorsV261TestJSON-157568488 tempest-FlavorsV261TestJSON-157568488-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1949340564" status: 202 len: 0 microversion: 2.61 time: 0.103381 Oct 04 18:29:16.455579 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 234/441] 10.222.0.20 () {60 vars in 1202 bytes} [Tue Oct 4 18:29:16 2022] DELETE /compute/v2.1/flavors/1949340564 => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:29:16.460766 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a86fd4c6-0fd9-4534-b208-bd01344e55ec tempest-FlavorsV261TestJSON-157568488 tempest-FlavorsV261TestJSON-157568488-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:16.490499 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a86fd4c6-0fd9-4534-b208-bd01344e55ec tempest-FlavorsV261TestJSON-157568488 tempest-FlavorsV261TestJSON-157568488-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 6699 microversion: 2.61 time: 0.033791 Oct 04 18:29:16.492026 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 208/442] 10.222.0.20 () {60 vars in 1187 bytes} [Tue Oct 4 18:29:16 2022] GET /compute/v2.1/flavors/detail => generated 6699 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:29:17.422160 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2a518d90-2a0e-41b8-83ea-29cb33723efe tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:17.422787 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2a518d90-2a0e-41b8-83ea-29cb33723efe tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: cb82f77b-6207-4a99-a494-f252a820990c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:17.430935 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2a518d90-2a0e-41b8-83ea-29cb33723efe tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:17.431436 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2a518d90-2a0e-41b8-83ea-29cb33723efe tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:17.431880 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2a518d90-2a0e-41b8-83ea-29cb33723efe tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:17.433081 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2a518d90-2a0e-41b8-83ea-29cb33723efe tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:17.438827 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2a518d90-2a0e-41b8-83ea-29cb33723efe tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:17.438827 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2a518d90-2a0e-41b8-83ea-29cb33723efe tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:17.711513 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-705da6dc-6342-4933-beb8-850a3e2b1619 tempest-FlavorsV255TestJSON-989115640 tempest-FlavorsV255TestJSON-989115640-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1455150047", "id": 1156621942, "os-flavor-access:is_public": "True"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:17.732544 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=9 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:17.790263 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-705da6dc-6342-4933-beb8-850a3e2b1619 tempest-FlavorsV255TestJSON-989115640 tempest-FlavorsV255TestJSON-989115640-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 449 microversion: 2.55 time: 0.426763 Oct 04 18:29:17.790972 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 235/443] 10.222.0.20 () {62 vars in 1188 bytes} [Tue Oct 4 18:29:17 2022] POST /compute/v2.1/flavors => generated 449 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:29:17.853641 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2a518d90-2a0e-41b8-83ea-29cb33723efe tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:17.864630 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2a518d90-2a0e-41b8-83ea-29cb33723efe tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/cb82f77b-6207-4a99-a494-f252a820990c" status: 200 len: 1319 microversion: 2.1 time: 0.446784 Oct 04 18:29:17.868429 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 209/444] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:17 2022] GET /compute/v2.1/servers/cb82f77b-6207-4a99-a494-f252a820990c => generated 1319 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:18.197202 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0a9c0a08-1db8-4fc8-a356-1d95192ba40e tempest-NetworksTest-1361011160 tempest-NetworksTest-1361011160-project-admin] Calling method '.version_select at 0x7fe2597a24c0>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:18.228985 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e9f50b6b-aecb-42c7-a2f4-8064f3b0e87b tempest-FlavorsV255TestJSON-1209031330 tempest-FlavorsV255TestJSON-1209031330-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:18.243106 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e9f50b6b-aecb-42c7-a2f4-8064f3b0e87b tempest-FlavorsV255TestJSON-1209031330 tempest-FlavorsV255TestJSON-1209031330-project] 10.222.0.20 "GET /compute/v2.1/flavors/1156621942" status: 200 len: 449 microversion: 2.55 time: 0.440231 Oct 04 18:29:18.245087 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 236/445] 10.222.0.20 () {60 vars in 1199 bytes} [Tue Oct 4 18:29:17 2022] GET /compute/v2.1/flavors/1156621942 => generated 449 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 18:29:18.360211 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0a9c0a08-1db8-4fc8-a356-1d95192ba40e tempest-NetworksTest-1361011160 tempest-NetworksTest-1361011160-project-admin] 10.222.0.20 "GET /compute/v2.1/os-networks" status: 200 len: 3325 microversion: 2.1 time: 0.490265 Oct 04 18:29:18.364634 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 210/446] 10.222.0.20 () {58 vars in 1137 bytes} [Tue Oct 4 18:29:17 2022] GET /compute/v2.1/os-networks => generated 3325 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:18.365047 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-44d6978e-a158-46b2-bd59-a43d16c9e61c tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-187663416", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:18.371575 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-fbe09d77-7981-4e24-956d-0bcde269680f tempest-FlavorsV255TestJSON-989115640 tempest-FlavorsV255TestJSON-989115640-project-admin] Action: 'update', calling method: .version_select at 0x7fe25ae12a60>, body: {"flavor": {"description": "new"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:18.458458 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.neutron [None req-44d6978e-a158-46b2-bd59-a43d16c9e61c tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] validate_networks() for None {{(pid=123001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:29:18.491751 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-fbe09d77-7981-4e24-956d-0bcde269680f tempest-FlavorsV255TestJSON-989115640 tempest-FlavorsV255TestJSON-989115640-project-admin] 10.222.0.20 "PUT /compute/v2.1/flavors/1156621942" status: 200 len: 450 microversion: 2.55 time: 0.124632 Oct 04 18:29:18.491751 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 211/447] 10.222.0.20 () {62 vars in 1219 bytes} [Tue Oct 4 18:29:18 2022] PUT /compute/v2.1/flavors/1156621942 => generated 450 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:29:18.497119 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d57fe35c-c8ca-4c7c-baec-0d8b9f989622 tempest-NetworksTest-1361011160 tempest-NetworksTest-1361011160-project-admin] Calling method '.version_select at 0x7fe259708670>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:18.758839 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d57fe35c-c8ca-4c7c-baec-0d8b9f989622 tempest-NetworksTest-1361011160 tempest-NetworksTest-1361011160-project-admin] 10.222.0.20 "GET /compute/v2.1/os-networks/c44df1aa-f2af-499a-b6e4-d012aa353460" status: 200 len: 652 microversion: 2.1 time: 0.266587 Oct 04 18:29:18.759592 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 212/448] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Oct 4 18:29:18 2022] GET /compute/v2.1/os-networks/c44df1aa-f2af-499a-b6e4-d012aa353460 => generated 652 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:29:18.764979 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8ac04aa3-f801-4076-b69b-7bc8e8c6b532 tempest-FlavorsV255TestJSON-1209031330 tempest-FlavorsV255TestJSON-1209031330-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:18.809336 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8ac04aa3-f801-4076-b69b-7bc8e8c6b532 tempest-FlavorsV255TestJSON-1209031330 tempest-FlavorsV255TestJSON-1209031330-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 6595 microversion: 2.55 time: 0.048136 Oct 04 18:29:18.832073 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 213/449] 10.222.0.20 () {60 vars in 1187 bytes} [Tue Oct 4 18:29:18 2022] GET /compute/v2.1/flavors/detail => generated 6595 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:29:18.832073 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-36645066-7fc2-47da-8427-d5534fe09985 tempest-NetworksTest-1361011160 tempest-NetworksTest-1361011160-project-admin] Calling method '.version_select at 0x7fe2597514c0>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:18.857945 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-44d6978e-a158-46b2-bd59-a43d16c9e61c tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:29:18.860070 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-44d6978e-a158-46b2-bd59-a43d16c9e61c tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:29:18.864098 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-44d6978e-a158-46b2-bd59-a43d16c9e61c tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:29:18.866264 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-44d6978e-a158-46b2-bd59-a43d16c9e61c tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:29:18.866914 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-44d6978e-a158-46b2-bd59-a43d16c9e61c tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:29:18.893258 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-44d6978e-a158-46b2-bd59-a43d16c9e61c tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:18.894188 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-44d6978e-a158-46b2-bd59-a43d16c9e61c tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:18.899561 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-44d6978e-a158-46b2-bd59-a43d16c9e61c tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:18.905105 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-44d6978e-a158-46b2-bd59-a43d16c9e61c tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:18.905105 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-44d6978e-a158-46b2-bd59-a43d16c9e61c tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:18.906808 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-44d6978e-a158-46b2-bd59-a43d16c9e61c tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:18.953658 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-44d6978e-a158-46b2-bd59-a43d16c9e61c tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Getting quotas for project 375d02476ed240ea967eb2e28e8474ab. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:29:18.963102 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-44d6978e-a158-46b2-bd59-a43d16c9e61c tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Getting quotas for user 3c11a7c3cec94797b639e6e53dcbfb20 and project 375d02476ed240ea967eb2e28e8474ab. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:29:18.975732 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-36645066-7fc2-47da-8427-d5534fe09985 tempest-NetworksTest-1361011160 tempest-NetworksTest-1361011160-project-admin] 10.222.0.20 "GET /compute/v2.1/os-networks" status: 200 len: 3325 microversion: 2.1 time: 0.152199 Oct 04 18:29:18.976339 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 214/450] 10.222.0.20 () {58 vars in 1137 bytes} [Tue Oct 4 18:29:18 2022] GET /compute/v2.1/os-networks => generated 3325 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:18.977558 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-44d6978e-a158-46b2-bd59-a43d16c9e61c tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Going to run 1 instances... {{(pid=123001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:29:18.981648 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-44d6978e-a158-46b2-bd59-a43d16c9e61c tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] [instance: 31fc27b2-5ba0-4ba9-b119-12644f8eea78] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:29:18.988952 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-06a849a7-ef2e-4397-b580-ccf9060054fb tempest-FlavorsV255TestJSON-1209031330 tempest-FlavorsV255TestJSON-1209031330-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:19.004596 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-06a849a7-ef2e-4397-b580-ccf9060054fb tempest-FlavorsV255TestJSON-1209031330 tempest-FlavorsV255TestJSON-1209031330-project] 10.222.0.20 "GET /compute/v2.1/flavors" status: 200 len: 3685 microversion: 2.55 time: 0.025981 Oct 04 18:29:19.005231 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 215/451] 10.222.0.20 () {60 vars in 1166 bytes} [Tue Oct 4 18:29:18 2022] GET /compute/v2.1/flavors => generated 3685 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:29:19.010546 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b15839aa-045b-4e51-812b-e3aff33c1648 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:19.011581 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b15839aa-045b-4e51-812b-e3aff33c1648 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: cb82f77b-6207-4a99-a494-f252a820990c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:19.019128 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b15839aa-045b-4e51-812b-e3aff33c1648 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:19.019682 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b15839aa-045b-4e51-812b-e3aff33c1648 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:19.020152 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b15839aa-045b-4e51-812b-e3aff33c1648 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:19.023957 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b15839aa-045b-4e51-812b-e3aff33c1648 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:19.023957 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b15839aa-045b-4e51-812b-e3aff33c1648 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:19.023957 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b15839aa-045b-4e51-812b-e3aff33c1648 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:19.122596 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-44d6978e-a158-46b2-bd59-a43d16c9e61c tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.875008 Oct 04 18:29:19.135571 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 237/452] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:29:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 889 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:29:19.142703 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f639ebe6-e18f-485f-989e-7be13e603c3d tempest-FlavorsV255TestJSON-989115640 tempest-FlavorsV255TestJSON-989115640-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:19.210660 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b15839aa-045b-4e51-812b-e3aff33c1648 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:19.218021 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=100 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:19.223208 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b15839aa-045b-4e51-812b-e3aff33c1648 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/cb82f77b-6207-4a99-a494-f252a820990c" status: 200 len: 1319 microversion: 2.1 time: 0.216614 Oct 04 18:29:19.224118 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 216/453] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:19 2022] GET /compute/v2.1/servers/cb82f77b-6207-4a99-a494-f252a820990c => generated 1319 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:19.229321 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1096b616-6623-44c8-a714-13943b79a8a7 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:19.230108 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1096b616-6623-44c8-a714-13943b79a8a7 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] [instance: 31fc27b2-5ba0-4ba9-b119-12644f8eea78] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:19.240352 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f639ebe6-e18f-485f-989e-7be13e603c3d tempest-FlavorsV255TestJSON-989115640 tempest-FlavorsV255TestJSON-989115640-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1156621942" status: 202 len: 0 microversion: 2.55 time: 0.102295 Oct 04 18:29:19.241748 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 238/454] 10.222.0.20 () {60 vars in 1202 bytes} [Tue Oct 4 18:29:19 2022] DELETE /compute/v2.1/flavors/1156621942 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:29:19.251248 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0c8c0b0b-f204-446f-b091-eab0ad8bb377 tempest-FlavorsV255TestJSON-989115640 tempest-FlavorsV255TestJSON-989115640-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:19.309272 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1096b616-6623-44c8-a714-13943b79a8a7 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c11a7c3cec94797b639e6e53dcbfb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375d02476ed240ea967eb2e28e8474ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:19.313118 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0c8c0b0b-f204-446f-b091-eab0ad8bb377 tempest-FlavorsV255TestJSON-989115640 tempest-FlavorsV255TestJSON-989115640-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 6155 microversion: 2.55 time: 0.066508 Oct 04 18:29:19.316418 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 239/455] 10.222.0.20 () {60 vars in 1187 bytes} [Tue Oct 4 18:29:19 2022] GET /compute/v2.1/flavors/detail => generated 6155 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:29:19.321784 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1096b616-6623-44c8-a714-13943b79a8a7 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] 10.222.0.20 "GET /compute/v2.1/servers/31fc27b2-5ba0-4ba9-b119-12644f8eea78" status: 200 len: 1221 microversion: 2.1 time: 0.096301 Oct 04 18:29:19.333713 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 217/456] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:19 2022] GET /compute/v2.1/servers/31fc27b2-5ba0-4ba9-b119-12644f8eea78 => generated 1221 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:20.252306 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d9c6acd2-689c-4f4a-be0d-755b211196eb tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:20.252921 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d9c6acd2-689c-4f4a-be0d-755b211196eb tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: cb82f77b-6207-4a99-a494-f252a820990c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:20.261865 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d9c6acd2-689c-4f4a-be0d-755b211196eb tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:20.262553 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d9c6acd2-689c-4f4a-be0d-755b211196eb tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:20.263145 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d9c6acd2-689c-4f4a-be0d-755b211196eb tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:20.268647 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d9c6acd2-689c-4f4a-be0d-755b211196eb tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:20.268647 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d9c6acd2-689c-4f4a-be0d-755b211196eb tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:20.268647 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d9c6acd2-689c-4f4a-be0d-755b211196eb tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:20.347244 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-cda17199-aa17-422c-9e5c-18839f75ec20 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:20.348382 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-cda17199-aa17-422c-9e5c-18839f75ec20 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] [instance: 31fc27b2-5ba0-4ba9-b119-12644f8eea78] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:20.427315 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-cda17199-aa17-422c-9e5c-18839f75ec20 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c11a7c3cec94797b639e6e53dcbfb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375d02476ed240ea967eb2e28e8474ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:20.443361 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-cda17199-aa17-422c-9e5c-18839f75ec20 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] 10.222.0.20 "GET /compute/v2.1/servers/31fc27b2-5ba0-4ba9-b119-12644f8eea78" status: 200 len: 1221 microversion: 2.1 time: 0.100130 Oct 04 18:29:20.445135 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 218/457] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:20 2022] GET /compute/v2.1/servers/31fc27b2-5ba0-4ba9-b119-12644f8eea78 => generated 1221 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:20.501399 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d9c6acd2-689c-4f4a-be0d-755b211196eb tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:20.510680 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d9c6acd2-689c-4f4a-be0d-755b211196eb tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/cb82f77b-6207-4a99-a494-f252a820990c" status: 200 len: 1319 microversion: 2.1 time: 0.262096 Oct 04 18:29:20.513136 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 240/458] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:20 2022] GET /compute/v2.1/servers/cb82f77b-6207-4a99-a494-f252a820990c => generated 1319 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:21.470029 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7c008df2-3127-418f-bc44-6edc16655540 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:21.470834 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7c008df2-3127-418f-bc44-6edc16655540 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] [instance: 31fc27b2-5ba0-4ba9-b119-12644f8eea78] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:21.477777 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c008df2-3127-418f-bc44-6edc16655540 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:21.478263 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c008df2-3127-418f-bc44-6edc16655540 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:21.478701 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c008df2-3127-418f-bc44-6edc16655540 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:21.479409 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c008df2-3127-418f-bc44-6edc16655540 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:21.479866 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c008df2-3127-418f-bc44-6edc16655540 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:21.480322 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c008df2-3127-418f-bc44-6edc16655540 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:21.534932 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-203df327-683c-4c6d-9633-2d7e4df85c9a tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:21.535541 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-203df327-683c-4c6d-9633-2d7e4df85c9a tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: cb82f77b-6207-4a99-a494-f252a820990c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:21.551216 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-203df327-683c-4c6d-9633-2d7e4df85c9a tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:21.552012 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-203df327-683c-4c6d-9633-2d7e4df85c9a tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:21.552690 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-203df327-683c-4c6d-9633-2d7e4df85c9a tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:21.553408 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-203df327-683c-4c6d-9633-2d7e4df85c9a tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:21.553872 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-203df327-683c-4c6d-9633-2d7e4df85c9a tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:21.554296 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-203df327-683c-4c6d-9633-2d7e4df85c9a tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:21.589222 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7c008df2-3127-418f-bc44-6edc16655540 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c11a7c3cec94797b639e6e53dcbfb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375d02476ed240ea967eb2e28e8474ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:21.597510 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7c008df2-3127-418f-bc44-6edc16655540 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] 10.222.0.20 "GET /compute/v2.1/servers/31fc27b2-5ba0-4ba9-b119-12644f8eea78" status: 200 len: 1273 microversion: 2.1 time: 0.131231 Oct 04 18:29:21.598069 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 219/459] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:21 2022] GET /compute/v2.1/servers/31fc27b2-5ba0-4ba9-b119-12644f8eea78 => generated 1273 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:21.701604 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-203df327-683c-4c6d-9633-2d7e4df85c9a tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:21.723028 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-203df327-683c-4c6d-9633-2d7e4df85c9a tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/cb82f77b-6207-4a99-a494-f252a820990c" status: 200 len: 1319 microversion: 2.1 time: 0.191265 Oct 04 18:29:21.725475 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 241/460] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:21 2022] GET /compute/v2.1/servers/cb82f77b-6207-4a99-a494-f252a820990c => generated 1319 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:22.621889 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-46ec4ddc-888f-4fc7-a592-14f73ba924bc tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:22.623110 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-46ec4ddc-888f-4fc7-a592-14f73ba924bc tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] [instance: 31fc27b2-5ba0-4ba9-b119-12644f8eea78] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:22.637374 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-46ec4ddc-888f-4fc7-a592-14f73ba924bc tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:22.638956 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-46ec4ddc-888f-4fc7-a592-14f73ba924bc tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:22.644994 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-46ec4ddc-888f-4fc7-a592-14f73ba924bc tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:22.644994 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-46ec4ddc-888f-4fc7-a592-14f73ba924bc tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:22.644994 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-46ec4ddc-888f-4fc7-a592-14f73ba924bc tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:22.644994 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-46ec4ddc-888f-4fc7-a592-14f73ba924bc tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:22.755708 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e16556f3-729c-498a-ac7e-576503a441ec tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:22.756435 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e16556f3-729c-498a-ac7e-576503a441ec tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: cb82f77b-6207-4a99-a494-f252a820990c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:22.769825 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e16556f3-729c-498a-ac7e-576503a441ec tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:22.770500 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e16556f3-729c-498a-ac7e-576503a441ec tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:22.771093 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e16556f3-729c-498a-ac7e-576503a441ec tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:22.772084 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e16556f3-729c-498a-ac7e-576503a441ec tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:22.773077 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e16556f3-729c-498a-ac7e-576503a441ec tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:22.774313 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e16556f3-729c-498a-ac7e-576503a441ec tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:22.798640 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-46ec4ddc-888f-4fc7-a592-14f73ba924bc tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c11a7c3cec94797b639e6e53dcbfb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375d02476ed240ea967eb2e28e8474ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:22.814037 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-46ec4ddc-888f-4fc7-a592-14f73ba924bc tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] 10.222.0.20 "GET /compute/v2.1/servers/31fc27b2-5ba0-4ba9-b119-12644f8eea78" status: 200 len: 1279 microversion: 2.1 time: 0.196769 Oct 04 18:29:22.814680 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 220/461] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:22 2022] GET /compute/v2.1/servers/31fc27b2-5ba0-4ba9-b119-12644f8eea78 => generated 1279 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:29:23.105484 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e16556f3-729c-498a-ac7e-576503a441ec tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:23.114759 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e16556f3-729c-498a-ac7e-576503a441ec tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/cb82f77b-6207-4a99-a494-f252a820990c" status: 200 len: 1319 microversion: 2.1 time: 0.363678 Oct 04 18:29:23.118845 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 242/462] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:22 2022] GET /compute/v2.1/servers/cb82f77b-6207-4a99-a494-f252a820990c => generated 1319 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:29:23.413217 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-88f92b4d-50fc-42ff-9fb5-5af726fafe15 req-6e0f529e-4b5e-4b9f-b976-c54b81cd478f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "890f8168-5b22-465a-894d-ca70dd1acbed", "name": "network-vif-plugged", "status": "completed", "tag": "7b1455a6-e16b-4098-ab8c-31d0d8669b3d"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:23.443207 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-88f92b4d-50fc-42ff-9fb5-5af726fafe15 req-6e0f529e-4b5e-4b9f-b976-c54b81cd478f service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:23.443207 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-88f92b4d-50fc-42ff-9fb5-5af726fafe15 req-6e0f529e-4b5e-4b9f-b976-c54b81cd478f service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:23.443207 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-88f92b4d-50fc-42ff-9fb5-5af726fafe15 req-6e0f529e-4b5e-4b9f-b976-c54b81cd478f service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:23.448246 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-88f92b4d-50fc-42ff-9fb5-5af726fafe15 req-6e0f529e-4b5e-4b9f-b976-c54b81cd478f service nova] Creating event network-vif-plugged:7b1455a6-e16b-4098-ab8c-31d0d8669b3d for instance 890f8168-5b22-465a-894d-ca70dd1acbed on n-h2-850501-14 Oct 04 18:29:23.454102 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-88f92b4d-50fc-42ff-9fb5-5af726fafe15 req-6e0f529e-4b5e-4b9f-b976-c54b81cd478f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045488 Oct 04 18:29:23.454978 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 243/463] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:29:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:29:23.842697 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ed10883a-6273-4245-81d3-a6be50cce8be tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:23.845625 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ed10883a-6273-4245-81d3-a6be50cce8be tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] [instance: 31fc27b2-5ba0-4ba9-b119-12644f8eea78] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:23.855151 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ed10883a-6273-4245-81d3-a6be50cce8be tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:23.855967 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ed10883a-6273-4245-81d3-a6be50cce8be tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:23.856662 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ed10883a-6273-4245-81d3-a6be50cce8be tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:23.858299 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ed10883a-6273-4245-81d3-a6be50cce8be tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:23.858983 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ed10883a-6273-4245-81d3-a6be50cce8be tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:23.859634 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ed10883a-6273-4245-81d3-a6be50cce8be tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:23.891914 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c73631ae-fa1f-4a31-894c-49da70313465 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1728780357", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:23.980719 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-c73631ae-fa1f-4a31-894c-49da70313465 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] validate_networks() for None {{(pid=123002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:29:24.237101 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-c73631ae-fa1f-4a31-894c-49da70313465 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:29:24.237786 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-c73631ae-fa1f-4a31-894c-49da70313465 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:29:24.238652 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-c73631ae-fa1f-4a31-894c-49da70313465 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:29:24.239224 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-c73631ae-fa1f-4a31-894c-49da70313465 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:29:24.239786 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-c73631ae-fa1f-4a31-894c-49da70313465 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:29:24.259935 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c73631ae-fa1f-4a31-894c-49da70313465 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:24.262671 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c73631ae-fa1f-4a31-894c-49da70313465 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:24.263527 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c73631ae-fa1f-4a31-894c-49da70313465 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:24.266253 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c73631ae-fa1f-4a31-894c-49da70313465 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:24.266916 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c73631ae-fa1f-4a31-894c-49da70313465 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:24.269486 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c73631ae-fa1f-4a31-894c-49da70313465 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:24.331929 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-c73631ae-fa1f-4a31-894c-49da70313465 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Getting quotas for project 2f90e4ecf4d440229cafe5c25ec6df81. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:29:24.338190 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-c73631ae-fa1f-4a31-894c-49da70313465 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Getting quotas for user 20cc2be1195747a4a363f0e490670d51 and project 2f90e4ecf4d440229cafe5c25ec6df81. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:29:24.339758 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ed10883a-6273-4245-81d3-a6be50cce8be tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c11a7c3cec94797b639e6e53dcbfb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375d02476ed240ea967eb2e28e8474ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:24.351292 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c73631ae-fa1f-4a31-894c-49da70313465 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Going to run 1 instances... {{(pid=123002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:29:24.354112 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c73631ae-fa1f-4a31-894c-49da70313465 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] [instance: 0c7c7ab7-7cd4-440c-b356-b02e2ce3b999] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:29:24.361930 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ed10883a-6273-4245-81d3-a6be50cce8be tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] 10.222.0.20 "GET /compute/v2.1/servers/31fc27b2-5ba0-4ba9-b119-12644f8eea78" status: 200 len: 1321 microversion: 2.1 time: 0.523391 Oct 04 18:29:24.364575 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 244/464] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:23 2022] GET /compute/v2.1/servers/31fc27b2-5ba0-4ba9-b119-12644f8eea78 => generated 1321 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:29:24.386854 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b3df1506-f507-4004-93ce-de4a1c85cb3f tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:24.388920 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b3df1506-f507-4004-93ce-de4a1c85cb3f tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: cb82f77b-6207-4a99-a494-f252a820990c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:24.412029 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b3df1506-f507-4004-93ce-de4a1c85cb3f tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:24.420290 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b3df1506-f507-4004-93ce-de4a1c85cb3f tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:24.420290 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b3df1506-f507-4004-93ce-de4a1c85cb3f tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:24.420290 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b3df1506-f507-4004-93ce-de4a1c85cb3f tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:24.420290 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b3df1506-f507-4004-93ce-de4a1c85cb3f tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:24.420876 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b3df1506-f507-4004-93ce-de4a1c85cb3f tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:24.606857 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c73631ae-fa1f-4a31-894c-49da70313465 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.511505 Oct 04 18:29:24.608427 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 221/465] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:29:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1514 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 18:29:24.636400 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e559dc79-6486-48f7-b888-4fc5ac01bbad tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:24.637272 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e559dc79-6486-48f7-b888-4fc5ac01bbad tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] [instance: 0c7c7ab7-7cd4-440c-b356-b02e2ce3b999] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:24.713652 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b3df1506-f507-4004-93ce-de4a1c85cb3f tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:24.759620 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b3df1506-f507-4004-93ce-de4a1c85cb3f tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/cb82f77b-6207-4a99-a494-f252a820990c" status: 200 len: 1319 microversion: 2.1 time: 0.393730 Oct 04 18:29:24.760582 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 245/466] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:24 2022] GET /compute/v2.1/servers/cb82f77b-6207-4a99-a494-f252a820990c => generated 1319 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:24.796220 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e559dc79-6486-48f7-b888-4fc5ac01bbad tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20cc2be1195747a4a363f0e490670d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f90e4ecf4d440229cafe5c25ec6df81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:24.803290 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e559dc79-6486-48f7-b888-4fc5ac01bbad tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] 10.222.0.20 "GET /compute/v2.1/servers/0c7c7ab7-7cd4-440c-b356-b02e2ce3b999" status: 200 len: 1223 microversion: 2.1 time: 0.187129 Oct 04 18:29:24.806815 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 222/467] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:24 2022] GET /compute/v2.1/servers/0c7c7ab7-7cd4-440c-b356-b02e2ce3b999 => generated 1223 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:25.389863 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ac5051bd-ab1e-4436-a2cb-b3c31828d0ee tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:25.390632 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ac5051bd-ab1e-4436-a2cb-b3c31828d0ee tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] [instance: 31fc27b2-5ba0-4ba9-b119-12644f8eea78] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:25.401506 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ac5051bd-ab1e-4436-a2cb-b3c31828d0ee tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:25.402404 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ac5051bd-ab1e-4436-a2cb-b3c31828d0ee tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:25.402928 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ac5051bd-ab1e-4436-a2cb-b3c31828d0ee tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:25.403876 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ac5051bd-ab1e-4436-a2cb-b3c31828d0ee tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:25.405893 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ac5051bd-ab1e-4436-a2cb-b3c31828d0ee tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:25.406552 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ac5051bd-ab1e-4436-a2cb-b3c31828d0ee tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:25.619498 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ac5051bd-ab1e-4436-a2cb-b3c31828d0ee tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c11a7c3cec94797b639e6e53dcbfb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375d02476ed240ea967eb2e28e8474ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:25.627142 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ac5051bd-ab1e-4436-a2cb-b3c31828d0ee tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] 10.222.0.20 "GET /compute/v2.1/servers/31fc27b2-5ba0-4ba9-b119-12644f8eea78" status: 200 len: 1321 microversion: 2.1 time: 0.240597 Oct 04 18:29:25.628418 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 246/468] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:25 2022] GET /compute/v2.1/servers/31fc27b2-5ba0-4ba9-b119-12644f8eea78 => generated 1321 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:25.783617 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-25910099-1e1e-43d1-be83-b5f665472cc5 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:25.784250 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-25910099-1e1e-43d1-be83-b5f665472cc5 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: cb82f77b-6207-4a99-a494-f252a820990c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:25.796037 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-25910099-1e1e-43d1-be83-b5f665472cc5 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:25.797929 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-25910099-1e1e-43d1-be83-b5f665472cc5 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:25.798533 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-25910099-1e1e-43d1-be83-b5f665472cc5 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:25.799962 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-25910099-1e1e-43d1-be83-b5f665472cc5 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:25.803564 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-25910099-1e1e-43d1-be83-b5f665472cc5 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:25.805931 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-25910099-1e1e-43d1-be83-b5f665472cc5 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:26.015739 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-25910099-1e1e-43d1-be83-b5f665472cc5 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:26.026181 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-25910099-1e1e-43d1-be83-b5f665472cc5 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/cb82f77b-6207-4a99-a494-f252a820990c" status: 200 len: 1319 microversion: 2.1 time: 0.247035 Oct 04 18:29:26.027005 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 247/469] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:25 2022] GET /compute/v2.1/servers/cb82f77b-6207-4a99-a494-f252a820990c => generated 1319 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:29:26.032920 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6bd85059-4dcf-4c52-b71b-52e5382f34b9 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:26.033733 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6bd85059-4dcf-4c52-b71b-52e5382f34b9 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] [instance: 0c7c7ab7-7cd4-440c-b356-b02e2ce3b999] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:26.096477 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-beff39b5-e607-43ca-8c20-95bd8692a25f tempest-ImagesDeleteNegativeTestJSON-1507772873 tempest-ImagesDeleteNegativeTestJSON-1507772873-project] 10.222.0.20 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.574938 Oct 04 18:29:26.097831 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 223/470] 10.222.0.20 () {58 vars in 1128 bytes} [Tue Oct 4 18:29:25 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 579 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Oct 04 18:29:26.112675 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-01b365ec-606b-40a7-a1b0-f81d24fd364b req-5374da02-f90e-406c-932e-1f4937bed5f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31fc27b2-5ba0-4ba9-b119-12644f8eea78", "tag": "c283ec45-e77a-4800-b6ac-8286118aa036"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:26.134530 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6bd85059-4dcf-4c52-b71b-52e5382f34b9 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20cc2be1195747a4a363f0e490670d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f90e4ecf4d440229cafe5c25ec6df81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:26.148542 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6bd85059-4dcf-4c52-b71b-52e5382f34b9 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] 10.222.0.20 "GET /compute/v2.1/servers/0c7c7ab7-7cd4-440c-b356-b02e2ce3b999" status: 200 len: 1223 microversion: 2.1 time: 0.118010 Oct 04 18:29:26.149775 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-01b365ec-606b-40a7-a1b0-f81d24fd364b req-5374da02-f90e-406c-932e-1f4937bed5f7 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:26.151136 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-01b365ec-606b-40a7-a1b0-f81d24fd364b req-5374da02-f90e-406c-932e-1f4937bed5f7 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:26.151529 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 248/471] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:26 2022] GET /compute/v2.1/servers/0c7c7ab7-7cd4-440c-b356-b02e2ce3b999 => generated 1223 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:26.152778 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-01b365ec-606b-40a7-a1b0-f81d24fd364b req-5374da02-f90e-406c-932e-1f4937bed5f7 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:26.176520 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5ca5595e-3fc6-4721-8587-e7845f5c1de3 tempest-ImagesDeleteNegativeTestJSON-1507772873 tempest-ImagesDeleteNegativeTestJSON-1507772873-project] Calling method '.version_select at 0x7fe2596ade50>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:26.188875 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-01b365ec-606b-40a7-a1b0-f81d24fd364b req-5374da02-f90e-406c-932e-1f4937bed5f7 service nova] Creating event network-changed:c283ec45-e77a-4800-b6ac-8286118aa036 for instance 31fc27b2-5ba0-4ba9-b119-12644f8eea78 on n-h1-850501-14 Oct 04 18:29:26.193647 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-01b365ec-606b-40a7-a1b0-f81d24fd364b req-5374da02-f90e-406c-932e-1f4937bed5f7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094162 Oct 04 18:29:26.194928 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 224/472] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:29:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:29:26.232627 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-5ca5595e-3fc6-4721-8587-e7845f5c1de3 tempest-ImagesDeleteNegativeTestJSON-1507772873 tempest-ImagesDeleteNegativeTestJSON-1507772873-project] HTTP exception thrown: Image not found. Oct 04 18:29:26.241144 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5ca5595e-3fc6-4721-8587-e7845f5c1de3 tempest-ImagesDeleteNegativeTestJSON-1507772873 tempest-ImagesDeleteNegativeTestJSON-1507772873-project] Request method failure captured: Oct 04 18:29:26.241144 n-d-850501-14 devstack@n-api.service[123001]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Oct 04 18:29:26.241144 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:29:26.241144 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:29:26.241144 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:29:26.241144 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:29:26.241144 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:29:26.241144 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:29:26.241144 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:29:26.241144 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:29:26.241144 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPHuFQ7pDGzeinSy43SzUj5M-_N06Jnz8VvPrQ_dAAaZjWIUzG5x39wVoSq5REvygxFkUrgsUpA9eGPAuz4gigixxOj0UIsOIJq461lerVQ324tkdGlcHdde3-uh392dFlY4-2YYzIi5m-jcQrM7CfViS1qwrwBMNKlBVLKYVSMIioMI Oct 04 18:29:26.241144 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:29:26.241144 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:29:26.241144 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:29:26.241144 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:29:26.241144 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:29:26.241144 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:29:26.241144 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 1ba039a7eac4415ca18f67dbb1a89525 Oct 04 18:29:26.241144 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1507772873 Oct 04 18:29:26.241144 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:29:26.241144 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:29:26.242909 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1ba039a7eac4415ca18f67dbb1a89525"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1ba039a7eac4415ca18f67dbb1a89525", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1ba039a7eac4415ca18f67dbb1a89525"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1ba039a7eac4415ca18f67dbb1a89525"}]}] Oct 04 18:29:26.242909 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1507772873 Oct 04 18:29:26.242909 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 1ba039a7eac4415ca18f67dbb1a89525 Oct 04 18:29:26.242909 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1507772873 Oct 04 18:29:26.242909 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ImagesDeleteNegativeTestJSON-1507772873-project Oct 04 18:29:26.242909 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:29:26.242909 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:29:26.242909 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: c90a5cf072cb4489a8045496f82963fc Oct 04 18:29:26.242909 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1507772873-project Oct 04 18:29:26.242909 n-d-850501-14 devstack@n-api.service[123001]: method: Oct 04 18:29:26.242909 n-d-850501-14 devstack@n-api.service[123001]: exception: Image not found. Oct 04 18:29:26.242909 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '-1'} Oct 04 18:29:26.242909 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:29:26.242909 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:29:26.243757 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 18:29:26.243757 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 18:29:26.243757 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:29:26.243757 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:29:26.243757 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:29:26.243757 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:29:26.243757 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 18:29:26.243757 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 18:29:26.243757 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 18:29:26.243757 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 18:29:26.243757 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:29:26.243757 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:29:26.243757 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:29:26.243757 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:29:26.243757 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Oct 04 18:29:26.243757 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:29:26.243757 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:29:26.243757 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:29:26.243757 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:29:26.249189 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 18:29:26.249189 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 18:29:26.249189 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 18:29:26.249189 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 18:29:26.249189 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 18:29:26.249189 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 18:29:26.249189 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Oct 04 18:29:26.249189 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:29:26.249189 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:29:26.249189 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:29:26.249189 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:29:26.249189 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:29:26.249189 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:29:26.249189 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:29:26.249189 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:29:26.249189 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:29:26.249189 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:29:26.249189 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:29:26.249189 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:29:26.249189 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 18:29:26.250456 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 18:29:26.250456 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:29:26.250456 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:29:26.250456 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:29:26.250456 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:29:26.250456 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:29:26.250456 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:29:26.250456 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:29:26.250456 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:29:26.250456 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:29:26.250456 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:29:26.250456 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:29:26.250456 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5ca5595e-3fc6-4721-8587-e7845f5c1de3 tempest-ImagesDeleteNegativeTestJSON-1507772873 tempest-ImagesDeleteNegativeTestJSON-1507772873-project] Returning 404 to user: Image not found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:29:26.250456 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5ca5595e-3fc6-4721-8587-e7845f5c1de3 tempest-ImagesDeleteNegativeTestJSON-1507772873 tempest-ImagesDeleteNegativeTestJSON-1507772873-project] 10.222.0.20 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.089887 Oct 04 18:29:26.250456 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 249/473] 10.222.0.20 () {58 vars in 1134 bytes} [Tue Oct 4 18:29:26 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:29:26.254296 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0f98e9a3-8b15-4e32-81c7-51cd59f4e7cc tempest-ImagesDeleteNegativeTestJSON-1507772873 tempest-ImagesDeleteNegativeTestJSON-1507772873-project] Calling method '.version_select at 0x7fe2596eb790>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:26.292769 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-0f98e9a3-8b15-4e32-81c7-51cd59f4e7cc tempest-ImagesDeleteNegativeTestJSON-1507772873 tempest-ImagesDeleteNegativeTestJSON-1507772873-project] HTTP exception thrown: Image not found. Oct 04 18:29:26.296473 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0f98e9a3-8b15-4e32-81c7-51cd59f4e7cc tempest-ImagesDeleteNegativeTestJSON-1507772873 tempest-ImagesDeleteNegativeTestJSON-1507772873-project] Request method failure captured: Oct 04 18:29:26.296473 n-d-850501-14 devstack@n-api.service[123002]: request: DELETE /compute/v2.1/images/47bc1e09-2c79-4bbd-a122-1816f0ec4adj HTTP/1.1 Oct 04 18:29:26.296473 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:29:26.296473 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:29:26.296473 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:29:26.296473 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:29:26.296473 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:29:26.296473 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:29:26.296473 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:29:26.296473 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:29:26.296473 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPHuFQ7pDGzeinSy43SzUj5M-_N06Jnz8VvPrQ_dAAaZjWIUzG5x39wVoSq5REvygxFkUrgsUpA9eGPAuz4gigixxOj0UIsOIJq461lerVQ324tkdGlcHdde3-uh392dFlY4-2YYzIi5m-jcQrM7CfViS1qwrwBMNKlBVLKYVSMIioMI Oct 04 18:29:26.296473 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:29:26.296473 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:29:26.296473 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:29:26.296473 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:29:26.296473 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:29:26.296473 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:29:26.296473 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 1ba039a7eac4415ca18f67dbb1a89525 Oct 04 18:29:26.296473 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1507772873 Oct 04 18:29:26.296473 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:29:26.296473 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:29:26.297808 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1ba039a7eac4415ca18f67dbb1a89525"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1ba039a7eac4415ca18f67dbb1a89525", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1ba039a7eac4415ca18f67dbb1a89525"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1ba039a7eac4415ca18f67dbb1a89525"}]}] Oct 04 18:29:26.297808 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1507772873 Oct 04 18:29:26.297808 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 1ba039a7eac4415ca18f67dbb1a89525 Oct 04 18:29:26.297808 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1507772873 Oct 04 18:29:26.297808 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ImagesDeleteNegativeTestJSON-1507772873-project Oct 04 18:29:26.297808 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:29:26.297808 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:29:26.297808 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: c90a5cf072cb4489a8045496f82963fc Oct 04 18:29:26.297808 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1507772873-project Oct 04 18:29:26.297808 n-d-850501-14 devstack@n-api.service[123002]: method: Oct 04 18:29:26.297808 n-d-850501-14 devstack@n-api.service[123002]: exception: Image not found. Oct 04 18:29:26.297808 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '47bc1e09-2c79-4bbd-a122-1816f0ec4adj'} Oct 04 18:29:26.297808 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:29:26.298560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:29:26.298560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 18:29:26.298560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 18:29:26.298560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:29:26.298560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:29:26.298560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:29:26.298560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:29:26.298560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 18:29:26.298560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 18:29:26.298560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 18:29:26.298560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 18:29:26.298560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:29:26.298560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:29:26.298560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:29:26.298560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:29:26.298560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 47bc1e09-2c79-4bbd-a122-1816f0ec4adj to delete Oct 04 18:29:26.298560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:29:26.298560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:29:26.298560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:29:26.307788 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:29:26.307788 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 18:29:26.307788 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 18:29:26.307788 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 18:29:26.307788 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 18:29:26.307788 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 18:29:26.307788 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 18:29:26.307788 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 47bc1e09-2c79-4bbd-a122-1816f0ec4adj could not be found. Oct 04 18:29:26.307788 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:29:26.307788 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:29:26.307788 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:29:26.307788 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:29:26.307788 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:29:26.307788 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:29:26.307788 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:29:26.307788 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:29:26.307788 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:29:26.307788 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:29:26.307788 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:29:26.307788 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:29:26.308986 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 18:29:26.308986 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 18:29:26.308986 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:29:26.308986 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:29:26.308986 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:29:26.308986 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:29:26.308986 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:29:26.308986 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:29:26.308986 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:29:26.308986 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:29:26.308986 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:29:26.308986 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:29:26.308986 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:29:26.308986 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0f98e9a3-8b15-4e32-81c7-51cd59f4e7cc tempest-ImagesDeleteNegativeTestJSON-1507772873 tempest-ImagesDeleteNegativeTestJSON-1507772873-project] Returning 404 to user: Image not found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:29:26.308986 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0f98e9a3-8b15-4e32-81c7-51cd59f4e7cc tempest-ImagesDeleteNegativeTestJSON-1507772873 tempest-ImagesDeleteNegativeTestJSON-1507772873-project] 10.222.0.20 "DELETE /compute/v2.1/images/47bc1e09-2c79-4bbd-a122-1816f0ec4adj" status: 404 len: 62 microversion: 2.1 time: 0.048239 Oct 04 18:29:26.309856 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 225/474] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:26 2022] DELETE /compute/v2.1/images/47bc1e09-2c79-4bbd-a122-1816f0ec4adj => generated 62 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:29:26.321734 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2800bb41-e02b-429b-8878-9cdf4ea4b1c4 tempest-ImagesDeleteNegativeTestJSON-1507772873 tempest-ImagesDeleteNegativeTestJSON-1507772873-project] Calling method '.version_select at 0x7fe2596368b0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:26.342242 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-2800bb41-e02b-429b-8878-9cdf4ea4b1c4 tempest-ImagesDeleteNegativeTestJSON-1507772873 tempest-ImagesDeleteNegativeTestJSON-1507772873-project] HTTP exception thrown: Image not found. Oct 04 18:29:26.344274 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2800bb41-e02b-429b-8878-9cdf4ea4b1c4 tempest-ImagesDeleteNegativeTestJSON-1507772873 tempest-ImagesDeleteNegativeTestJSON-1507772873-project] Request method failure captured: Oct 04 18:29:26.344274 n-d-850501-14 devstack@n-api.service[123001]: request: DELETE /compute/v2.1/images/510001e0-108b-4bf9-a77e-20c6b7c6cace1 HTTP/1.1 Oct 04 18:29:26.344274 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:29:26.344274 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:29:26.344274 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:29:26.344274 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:29:26.344274 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:29:26.344274 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:29:26.344274 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:29:26.344274 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:29:26.344274 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPHuFQ7pDGzeinSy43SzUj5M-_N06Jnz8VvPrQ_dAAaZjWIUzG5x39wVoSq5REvygxFkUrgsUpA9eGPAuz4gigixxOj0UIsOIJq461lerVQ324tkdGlcHdde3-uh392dFlY4-2YYzIi5m-jcQrM7CfViS1qwrwBMNKlBVLKYVSMIioMI Oct 04 18:29:26.344274 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:29:26.344274 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:29:26.344274 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:29:26.344274 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:29:26.344274 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:29:26.344274 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:29:26.344274 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 1ba039a7eac4415ca18f67dbb1a89525 Oct 04 18:29:26.344274 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1507772873 Oct 04 18:29:26.344274 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:29:26.344274 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:29:26.345560 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1ba039a7eac4415ca18f67dbb1a89525"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1ba039a7eac4415ca18f67dbb1a89525", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1ba039a7eac4415ca18f67dbb1a89525"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1ba039a7eac4415ca18f67dbb1a89525"}]}] Oct 04 18:29:26.345560 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1507772873 Oct 04 18:29:26.345560 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 1ba039a7eac4415ca18f67dbb1a89525 Oct 04 18:29:26.345560 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1507772873 Oct 04 18:29:26.345560 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ImagesDeleteNegativeTestJSON-1507772873-project Oct 04 18:29:26.345560 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:29:26.345560 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:29:26.345560 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: c90a5cf072cb4489a8045496f82963fc Oct 04 18:29:26.345560 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1507772873-project Oct 04 18:29:26.345560 n-d-850501-14 devstack@n-api.service[123001]: method: Oct 04 18:29:26.345560 n-d-850501-14 devstack@n-api.service[123001]: exception: Image not found. Oct 04 18:29:26.345560 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '510001e0-108b-4bf9-a77e-20c6b7c6cace1'} Oct 04 18:29:26.345560 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:29:26.346308 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:29:26.346308 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 18:29:26.346308 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 18:29:26.346308 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:29:26.346308 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:29:26.346308 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:29:26.346308 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:29:26.346308 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 18:29:26.346308 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 18:29:26.346308 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 18:29:26.346308 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 18:29:26.346308 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:29:26.346308 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:29:26.346308 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:29:26.346308 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:29:26.346308 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 510001e0-108b-4bf9-a77e-20c6b7c6cace1 to delete Oct 04 18:29:26.346308 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:29:26.346308 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:29:26.346308 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:29:26.347442 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:29:26.347442 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 18:29:26.347442 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 18:29:26.347442 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 18:29:26.347442 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 18:29:26.347442 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 18:29:26.347442 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 18:29:26.347442 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 510001e0-108b-4bf9-a77e-20c6b7c6cace1 could not be found. Oct 04 18:29:26.347442 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:29:26.347442 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:29:26.347442 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:29:26.347442 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:29:26.347442 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:29:26.347442 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:29:26.347442 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:29:26.347442 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:29:26.347442 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:29:26.347442 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:29:26.347442 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:29:26.347442 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:29:26.348601 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 18:29:26.348601 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 18:29:26.348601 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:29:26.348601 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:29:26.348601 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:29:26.348601 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:29:26.348601 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:29:26.348601 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:29:26.348601 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:29:26.348601 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:29:26.348601 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:29:26.348601 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:29:26.348601 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:29:26.348601 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2800bb41-e02b-429b-8878-9cdf4ea4b1c4 tempest-ImagesDeleteNegativeTestJSON-1507772873 tempest-ImagesDeleteNegativeTestJSON-1507772873-project] Returning 404 to user: Image not found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:29:26.348601 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2800bb41-e02b-429b-8878-9cdf4ea4b1c4 tempest-ImagesDeleteNegativeTestJSON-1507772873 tempest-ImagesDeleteNegativeTestJSON-1507772873-project] 10.222.0.20 "DELETE /compute/v2.1/images/510001e0-108b-4bf9-a77e-20c6b7c6cace1" status: 404 len: 62 microversion: 2.1 time: 0.037768 Oct 04 18:29:26.349451 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 250/475] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:29:26 2022] DELETE /compute/v2.1/images/510001e0-108b-4bf9-a77e-20c6b7c6cace1 => generated 62 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:29:26.359122 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4c4018f3-0fc3-4f40-b235-b3bb20381b6f tempest-ImagesDeleteNegativeTestJSON-1507772873 tempest-ImagesDeleteNegativeTestJSON-1507772873-project] Calling method '.version_select at 0x7fe25971aaf0>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:26.393765 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-4c4018f3-0fc3-4f40-b235-b3bb20381b6f tempest-ImagesDeleteNegativeTestJSON-1507772873 tempest-ImagesDeleteNegativeTestJSON-1507772873-project] HTTP exception thrown: Image not found. Oct 04 18:29:26.395614 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4c4018f3-0fc3-4f40-b235-b3bb20381b6f tempest-ImagesDeleteNegativeTestJSON-1507772873 tempest-ImagesDeleteNegativeTestJSON-1507772873-project] Request method failure captured: Oct 04 18:29:26.395614 n-d-850501-14 devstack@n-api.service[123002]: request: DELETE /compute/v2.1/images/tempest-invalid-662616659 HTTP/1.1 Oct 04 18:29:26.395614 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:29:26.395614 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:29:26.395614 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:29:26.395614 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:29:26.395614 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:29:26.395614 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:29:26.395614 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:29:26.395614 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:29:26.395614 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPHuFQ7pDGzeinSy43SzUj5M-_N06Jnz8VvPrQ_dAAaZjWIUzG5x39wVoSq5REvygxFkUrgsUpA9eGPAuz4gigixxOj0UIsOIJq461lerVQ324tkdGlcHdde3-uh392dFlY4-2YYzIi5m-jcQrM7CfViS1qwrwBMNKlBVLKYVSMIioMI Oct 04 18:29:26.395614 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:29:26.395614 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:29:26.395614 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:29:26.395614 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:29:26.395614 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:29:26.395614 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:29:26.395614 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 1ba039a7eac4415ca18f67dbb1a89525 Oct 04 18:29:26.395614 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1507772873 Oct 04 18:29:26.395614 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:29:26.395614 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:29:26.397023 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1ba039a7eac4415ca18f67dbb1a89525"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1ba039a7eac4415ca18f67dbb1a89525", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1ba039a7eac4415ca18f67dbb1a89525"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1ba039a7eac4415ca18f67dbb1a89525"}]}] Oct 04 18:29:26.397023 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1507772873 Oct 04 18:29:26.397023 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 1ba039a7eac4415ca18f67dbb1a89525 Oct 04 18:29:26.397023 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1507772873 Oct 04 18:29:26.397023 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ImagesDeleteNegativeTestJSON-1507772873-project Oct 04 18:29:26.397023 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:29:26.397023 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:29:26.397023 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: c90a5cf072cb4489a8045496f82963fc Oct 04 18:29:26.397023 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1507772873-project Oct 04 18:29:26.397023 n-d-850501-14 devstack@n-api.service[123002]: method: Oct 04 18:29:26.397023 n-d-850501-14 devstack@n-api.service[123002]: exception: Image not found. Oct 04 18:29:26.397023 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'tempest-invalid-662616659'} Oct 04 18:29:26.397023 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:29:26.397832 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:29:26.397832 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 18:29:26.397832 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 18:29:26.397832 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:29:26.397832 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:29:26.397832 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:29:26.397832 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:29:26.397832 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 18:29:26.397832 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 18:29:26.397832 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 18:29:26.397832 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 18:29:26.397832 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:29:26.397832 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:29:26.397832 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:29:26.397832 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:29:26.397832 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-662616659 to delete Oct 04 18:29:26.397832 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:29:26.397832 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:29:26.397832 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:29:26.400714 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:29:26.400714 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 18:29:26.400714 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 18:29:26.400714 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 18:29:26.400714 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 18:29:26.400714 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 18:29:26.400714 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 18:29:26.400714 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-662616659 could not be found. Oct 04 18:29:26.400714 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:29:26.400714 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:29:26.400714 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:29:26.400714 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:29:26.400714 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:29:26.400714 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:29:26.400714 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:29:26.400714 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:29:26.400714 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:29:26.400714 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:29:26.400714 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:29:26.400714 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:29:26.403330 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 18:29:26.403330 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 18:29:26.403330 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:29:26.403330 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:29:26.403330 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:29:26.403330 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:29:26.403330 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:29:26.403330 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:29:26.403330 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:29:26.403330 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:29:26.403330 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:29:26.403330 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:29:26.403330 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:29:26.403330 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4c4018f3-0fc3-4f40-b235-b3bb20381b6f tempest-ImagesDeleteNegativeTestJSON-1507772873 tempest-ImagesDeleteNegativeTestJSON-1507772873-project] Returning 404 to user: Image not found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:29:26.403330 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4c4018f3-0fc3-4f40-b235-b3bb20381b6f tempest-ImagesDeleteNegativeTestJSON-1507772873 tempest-ImagesDeleteNegativeTestJSON-1507772873-project] 10.222.0.20 "DELETE /compute/v2.1/images/tempest-invalid-662616659" status: 404 len: 62 microversion: 2.1 time: 0.043733 Oct 04 18:29:26.406616 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 226/476] 10.222.0.20 () {58 vars in 1203 bytes} [Tue Oct 4 18:29:26 2022] DELETE /compute/v2.1/images/tempest-invalid-662616659 => generated 62 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:29:26.409616 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7519ab2f-c721-45bd-a30a-bb32a382a023 tempest-ImagesDeleteNegativeTestJSON-1507772873 tempest-ImagesDeleteNegativeTestJSON-1507772873-project] Calling method '.version_select at 0x7fe2595f9700>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:26.456516 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-7519ab2f-c721-45bd-a30a-bb32a382a023 tempest-ImagesDeleteNegativeTestJSON-1507772873 tempest-ImagesDeleteNegativeTestJSON-1507772873-project] HTTP exception thrown: Image not found. Oct 04 18:29:26.458615 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7519ab2f-c721-45bd-a30a-bb32a382a023 tempest-ImagesDeleteNegativeTestJSON-1507772873 tempest-ImagesDeleteNegativeTestJSON-1507772873-project] Request method failure captured: Oct 04 18:29:26.458615 n-d-850501-14 devstack@n-api.service[123001]: request: DELETE /compute/v2.1/images/f1804745-89d3-4257-84e6-4c9decab5284 HTTP/1.1 Oct 04 18:29:26.458615 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:29:26.458615 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:29:26.458615 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:29:26.458615 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:29:26.458615 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:29:26.458615 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:29:26.458615 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:29:26.458615 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:29:26.458615 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPHuFQ7pDGzeinSy43SzUj5M-_N06Jnz8VvPrQ_dAAaZjWIUzG5x39wVoSq5REvygxFkUrgsUpA9eGPAuz4gigixxOj0UIsOIJq461lerVQ324tkdGlcHdde3-uh392dFlY4-2YYzIi5m-jcQrM7CfViS1qwrwBMNKlBVLKYVSMIioMI Oct 04 18:29:26.458615 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:29:26.458615 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:29:26.458615 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:29:26.458615 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:29:26.458615 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:29:26.458615 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:29:26.458615 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 1ba039a7eac4415ca18f67dbb1a89525 Oct 04 18:29:26.458615 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1507772873 Oct 04 18:29:26.458615 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:29:26.458615 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:29:26.463654 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1ba039a7eac4415ca18f67dbb1a89525"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1ba039a7eac4415ca18f67dbb1a89525", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1ba039a7eac4415ca18f67dbb1a89525"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1ba039a7eac4415ca18f67dbb1a89525"}]}] Oct 04 18:29:26.463654 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1507772873 Oct 04 18:29:26.463654 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 1ba039a7eac4415ca18f67dbb1a89525 Oct 04 18:29:26.463654 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1507772873 Oct 04 18:29:26.463654 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ImagesDeleteNegativeTestJSON-1507772873-project Oct 04 18:29:26.463654 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:29:26.463654 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:29:26.463654 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: c90a5cf072cb4489a8045496f82963fc Oct 04 18:29:26.463654 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1507772873-project Oct 04 18:29:26.463654 n-d-850501-14 devstack@n-api.service[123001]: method: Oct 04 18:29:26.463654 n-d-850501-14 devstack@n-api.service[123001]: exception: Image not found. Oct 04 18:29:26.463654 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': 'f1804745-89d3-4257-84e6-4c9decab5284'} Oct 04 18:29:26.463654 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:29:26.464792 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:29:26.464792 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 18:29:26.464792 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 18:29:26.464792 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:29:26.464792 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:29:26.464792 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:29:26.464792 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:29:26.464792 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 18:29:26.464792 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 18:29:26.464792 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 18:29:26.464792 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 18:29:26.464792 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:29:26.464792 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:29:26.464792 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:29:26.464792 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:29:26.464792 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image f1804745-89d3-4257-84e6-4c9decab5284 to delete Oct 04 18:29:26.464792 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:29:26.464792 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:29:26.464792 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:29:26.466075 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:29:26.466075 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 18:29:26.466075 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 18:29:26.466075 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 18:29:26.466075 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 18:29:26.466075 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 18:29:26.466075 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 18:29:26.466075 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f1804745-89d3-4257-84e6-4c9decab5284 could not be found. Oct 04 18:29:26.466075 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:29:26.466075 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:29:26.466075 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:29:26.466075 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:29:26.466075 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:29:26.466075 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:29:26.466075 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:29:26.466075 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:29:26.466075 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:29:26.466075 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:29:26.466075 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:29:26.466075 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:29:26.467648 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 18:29:26.467648 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 18:29:26.467648 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:29:26.467648 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:29:26.467648 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:29:26.467648 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:29:26.467648 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:29:26.467648 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:29:26.467648 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:29:26.467648 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:29:26.467648 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:29:26.467648 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:29:26.467648 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:29:26.467648 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7519ab2f-c721-45bd-a30a-bb32a382a023 tempest-ImagesDeleteNegativeTestJSON-1507772873 tempest-ImagesDeleteNegativeTestJSON-1507772873-project] Returning 404 to user: Image not found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:29:26.467648 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7519ab2f-c721-45bd-a30a-bb32a382a023 tempest-ImagesDeleteNegativeTestJSON-1507772873 tempest-ImagesDeleteNegativeTestJSON-1507772873-project] 10.222.0.20 "DELETE /compute/v2.1/images/f1804745-89d3-4257-84e6-4c9decab5284" status: 404 len: 62 microversion: 2.1 time: 0.055372 Oct 04 18:29:26.468708 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 251/477] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:26 2022] DELETE /compute/v2.1/images/f1804745-89d3-4257-84e6-4c9decab5284 => generated 62 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:29:26.651313 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-db35c9e1-18b8-4c49-9220-2f1eae11614f tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:26.651935 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-db35c9e1-18b8-4c49-9220-2f1eae11614f tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] [instance: 31fc27b2-5ba0-4ba9-b119-12644f8eea78] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:26.662476 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-db35c9e1-18b8-4c49-9220-2f1eae11614f tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:26.664762 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-db35c9e1-18b8-4c49-9220-2f1eae11614f tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:26.667663 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-db35c9e1-18b8-4c49-9220-2f1eae11614f tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:26.668630 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-db35c9e1-18b8-4c49-9220-2f1eae11614f tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:26.670518 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-db35c9e1-18b8-4c49-9220-2f1eae11614f tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:26.671142 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-db35c9e1-18b8-4c49-9220-2f1eae11614f tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:26.971497 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-49c07102-71fb-45a2-a98d-66ba53d1cdd8 tempest-HypervisorAdminUnderV252Test-1629218670 tempest-HypervisorAdminUnderV252Test-1629218670-project-admin] Calling method '.version_select at 0x7fe2596ebee0>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:26.975499 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-49c07102-71fb-45a2-a98d-66ba53d1cdd8 tempest-HypervisorAdminUnderV252Test-1629218670 tempest-HypervisorAdminUnderV252Test-1629218670-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:26.978406 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-49c07102-71fb-45a2-a98d-66ba53d1cdd8 tempest-HypervisorAdminUnderV252Test-1629218670 tempest-HypervisorAdminUnderV252Test-1629218670-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:26.978866 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-49c07102-71fb-45a2-a98d-66ba53d1cdd8 tempest-HypervisorAdminUnderV252Test-1629218670 tempest-HypervisorAdminUnderV252Test-1629218670-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:26.987231 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-db35c9e1-18b8-4c49-9220-2f1eae11614f tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c11a7c3cec94797b639e6e53dcbfb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375d02476ed240ea967eb2e28e8474ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:27.006556 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-db35c9e1-18b8-4c49-9220-2f1eae11614f tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] 10.222.0.20 "GET /compute/v2.1/servers/31fc27b2-5ba0-4ba9-b119-12644f8eea78" status: 200 len: 1321 microversion: 2.1 time: 0.358275 Oct 04 18:29:27.009632 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 252/478] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:26 2022] GET /compute/v2.1/servers/31fc27b2-5ba0-4ba9-b119-12644f8eea78 => generated 1321 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:29:27.030206 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-49c07102-71fb-45a2-a98d-66ba53d1cdd8 tempest-HypervisorAdminUnderV252Test-1629218670 tempest-HypervisorAdminUnderV252Test-1629218670-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:27.030724 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-49c07102-71fb-45a2-a98d-66ba53d1cdd8 tempest-HypervisorAdminUnderV252Test-1629218670 tempest-HypervisorAdminUnderV252Test-1629218670-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:27.031225 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-49c07102-71fb-45a2-a98d-66ba53d1cdd8 tempest-HypervisorAdminUnderV252Test-1629218670 tempest-HypervisorAdminUnderV252Test-1629218670-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:27.046298 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-49c07102-71fb-45a2-a98d-66ba53d1cdd8 tempest-HypervisorAdminUnderV252Test-1629218670 tempest-HypervisorAdminUnderV252Test-1629218670-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:27.054069 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3bcbcfb9-5008-4ae4-b63f-5c19945d68a7 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:27.054877 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3bcbcfb9-5008-4ae4-b63f-5c19945d68a7 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: cb82f77b-6207-4a99-a494-f252a820990c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:27.060417 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-49c07102-71fb-45a2-a98d-66ba53d1cdd8 tempest-HypervisorAdminUnderV252Test-1629218670 tempest-HypervisorAdminUnderV252Test-1629218670-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:27.060913 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-49c07102-71fb-45a2-a98d-66ba53d1cdd8 tempest-HypervisorAdminUnderV252Test-1629218670 tempest-HypervisorAdminUnderV252Test-1629218670-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:27.067605 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3bcbcfb9-5008-4ae4-b63f-5c19945d68a7 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:27.069871 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3bcbcfb9-5008-4ae4-b63f-5c19945d68a7 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:27.071287 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3bcbcfb9-5008-4ae4-b63f-5c19945d68a7 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:27.072038 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3bcbcfb9-5008-4ae4-b63f-5c19945d68a7 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:27.075220 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3bcbcfb9-5008-4ae4-b63f-5c19945d68a7 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:27.075672 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3bcbcfb9-5008-4ae4-b63f-5c19945d68a7 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:27.080258 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-49c07102-71fb-45a2-a98d-66ba53d1cdd8 tempest-HypervisorAdminUnderV252Test-1629218670 tempest-HypervisorAdminUnderV252Test-1629218670-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.606074 Oct 04 18:29:27.083135 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 227/479] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Oct 4 18:29:26 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:29:27.097406 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-78e13a0a-8e53-4acd-9a57-3aa4cb5ff245 tempest-HypervisorAdminUnderV252Test-1629218670 tempest-HypervisorAdminUnderV252Test-1629218670-project-admin] Calling method '.version_select at 0x7fe259708160>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:27.103520 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-78e13a0a-8e53-4acd-9a57-3aa4cb5ff245 tempest-HypervisorAdminUnderV252Test-1629218670 tempest-HypervisorAdminUnderV252Test-1629218670-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:27.105879 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-78e13a0a-8e53-4acd-9a57-3aa4cb5ff245 tempest-HypervisorAdminUnderV252Test-1629218670 tempest-HypervisorAdminUnderV252Test-1629218670-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:27.107718 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-78e13a0a-8e53-4acd-9a57-3aa4cb5ff245 tempest-HypervisorAdminUnderV252Test-1629218670 tempest-HypervisorAdminUnderV252Test-1629218670-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:27.158691 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-78e13a0a-8e53-4acd-9a57-3aa4cb5ff245 tempest-HypervisorAdminUnderV252Test-1629218670 tempest-HypervisorAdminUnderV252Test-1629218670-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:27.159101 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-78e13a0a-8e53-4acd-9a57-3aa4cb5ff245 tempest-HypervisorAdminUnderV252Test-1629218670 tempest-HypervisorAdminUnderV252Test-1629218670-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:27.159539 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-78e13a0a-8e53-4acd-9a57-3aa4cb5ff245 tempest-HypervisorAdminUnderV252Test-1629218670 tempest-HypervisorAdminUnderV252Test-1629218670-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:27.217889 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-78e13a0a-8e53-4acd-9a57-3aa4cb5ff245 tempest-HypervisorAdminUnderV252Test-1629218670 tempest-HypervisorAdminUnderV252Test-1629218670-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:27.218496 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-78e13a0a-8e53-4acd-9a57-3aa4cb5ff245 tempest-HypervisorAdminUnderV252Test-1629218670 tempest-HypervisorAdminUnderV252Test-1629218670-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:27.218945 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-78e13a0a-8e53-4acd-9a57-3aa4cb5ff245 tempest-HypervisorAdminUnderV252Test-1629218670 tempest-HypervisorAdminUnderV252Test-1629218670-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:27.234959 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-78e13a0a-8e53-4acd-9a57-3aa4cb5ff245 tempest-HypervisorAdminUnderV252Test-1629218670 tempest-HypervisorAdminUnderV252Test-1629218670-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/n-h1-850501-14/servers" status: 200 len: 355 microversion: 2.1 time: 0.144554 Oct 04 18:29:27.236235 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 228/480] 10.222.0.20 () {58 vars in 1215 bytes} [Tue Oct 4 18:29:27 2022] GET /compute/v2.1/os-hypervisors/n-h1-850501-14/servers => generated 355 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:29:27.244422 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-65d9977a-36ee-41a1-99aa-8d30688c83a8 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:27.245429 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-65d9977a-36ee-41a1-99aa-8d30688c83a8 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] [instance: 0c7c7ab7-7cd4-440c-b356-b02e2ce3b999] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:27.253837 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-65d9977a-36ee-41a1-99aa-8d30688c83a8 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:27.256089 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-65d9977a-36ee-41a1-99aa-8d30688c83a8 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:27.256892 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-65d9977a-36ee-41a1-99aa-8d30688c83a8 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:27.258591 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-65d9977a-36ee-41a1-99aa-8d30688c83a8 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:27.259521 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-65d9977a-36ee-41a1-99aa-8d30688c83a8 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:27.260387 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-65d9977a-36ee-41a1-99aa-8d30688c83a8 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:27.348215 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-65d9977a-36ee-41a1-99aa-8d30688c83a8 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20cc2be1195747a4a363f0e490670d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f90e4ecf4d440229cafe5c25ec6df81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:27.359886 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-65d9977a-36ee-41a1-99aa-8d30688c83a8 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] 10.222.0.20 "GET /compute/v2.1/servers/0c7c7ab7-7cd4-440c-b356-b02e2ce3b999" status: 200 len: 1275 microversion: 2.1 time: 0.122125 Oct 04 18:29:27.362960 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 229/481] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:27 2022] GET /compute/v2.1/servers/0c7c7ab7-7cd4-440c-b356-b02e2ce3b999 => generated 1275 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:27.371064 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b11ebcd9-1cff-4239-9b2f-fa5ad5594ca8 tempest-HypervisorAdminUnderV252Test-1629218670 tempest-HypervisorAdminUnderV252Test-1629218670-project-admin] Calling method '.version_select at 0x7fe2597b0e50>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:27.374487 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b11ebcd9-1cff-4239-9b2f-fa5ad5594ca8 tempest-HypervisorAdminUnderV252Test-1629218670 tempest-HypervisorAdminUnderV252Test-1629218670-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:27.377648 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b11ebcd9-1cff-4239-9b2f-fa5ad5594ca8 tempest-HypervisorAdminUnderV252Test-1629218670 tempest-HypervisorAdminUnderV252Test-1629218670-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:27.378976 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b11ebcd9-1cff-4239-9b2f-fa5ad5594ca8 tempest-HypervisorAdminUnderV252Test-1629218670 tempest-HypervisorAdminUnderV252Test-1629218670-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:27.415042 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b11ebcd9-1cff-4239-9b2f-fa5ad5594ca8 tempest-HypervisorAdminUnderV252Test-1629218670 tempest-HypervisorAdminUnderV252Test-1629218670-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:27.415042 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b11ebcd9-1cff-4239-9b2f-fa5ad5594ca8 tempest-HypervisorAdminUnderV252Test-1629218670 tempest-HypervisorAdminUnderV252Test-1629218670-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:27.419890 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b11ebcd9-1cff-4239-9b2f-fa5ad5594ca8 tempest-HypervisorAdminUnderV252Test-1629218670 tempest-HypervisorAdminUnderV252Test-1629218670-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:27.463674 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b11ebcd9-1cff-4239-9b2f-fa5ad5594ca8 tempest-HypervisorAdminUnderV252Test-1629218670 tempest-HypervisorAdminUnderV252Test-1629218670-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:27.464309 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b11ebcd9-1cff-4239-9b2f-fa5ad5594ca8 tempest-HypervisorAdminUnderV252Test-1629218670 tempest-HypervisorAdminUnderV252Test-1629218670-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:27.466550 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b11ebcd9-1cff-4239-9b2f-fa5ad5594ca8 tempest-HypervisorAdminUnderV252Test-1629218670 tempest-HypervisorAdminUnderV252Test-1629218670-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:27.495817 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b11ebcd9-1cff-4239-9b2f-fa5ad5594ca8 tempest-HypervisorAdminUnderV252Test-1629218670 tempest-HypervisorAdminUnderV252Test-1629218670-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.131701 Oct 04 18:29:27.496789 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 230/482] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Oct 4 18:29:27 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:29:27.512264 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-d12ecc61-df1d-413e-8ff2-6b938ffaf4d6 req-e6570a8c-96aa-45c1-8af7-22139b7c8c42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb82f77b-6207-4a99-a494-f252a820990c", "name": "network-vif-plugged", "status": "completed", "tag": "373f7ba2-e607-421d-b977-173e90d9f09b"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:27.532722 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3bcbcfb9-5008-4ae4-b63f-5c19945d68a7 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:27.544398 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-d12ecc61-df1d-413e-8ff2-6b938ffaf4d6 req-e6570a8c-96aa-45c1-8af7-22139b7c8c42 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:27.546563 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-d12ecc61-df1d-413e-8ff2-6b938ffaf4d6 req-e6570a8c-96aa-45c1-8af7-22139b7c8c42 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:27.546826 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-d12ecc61-df1d-413e-8ff2-6b938ffaf4d6 req-e6570a8c-96aa-45c1-8af7-22139b7c8c42 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:27.551654 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3bcbcfb9-5008-4ae4-b63f-5c19945d68a7 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/cb82f77b-6207-4a99-a494-f252a820990c" status: 200 len: 1319 microversion: 2.1 time: 0.498420 Oct 04 18:29:27.555079 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 253/483] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:27 2022] GET /compute/v2.1/servers/cb82f77b-6207-4a99-a494-f252a820990c => generated 1319 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:27.563643 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-25eaec82-0ffd-49ec-84a4-d0b2290bb2c1 tempest-HypervisorAdminUnderV252Test-1629218670 tempest-HypervisorAdminUnderV252Test-1629218670-project-admin] Calling method '.version_select at 0x7fe25966b550>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:27.567278 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-25eaec82-0ffd-49ec-84a4-d0b2290bb2c1 tempest-HypervisorAdminUnderV252Test-1629218670 tempest-HypervisorAdminUnderV252Test-1629218670-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:27.567993 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-25eaec82-0ffd-49ec-84a4-d0b2290bb2c1 tempest-HypervisorAdminUnderV252Test-1629218670 tempest-HypervisorAdminUnderV252Test-1629218670-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:27.568675 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-25eaec82-0ffd-49ec-84a4-d0b2290bb2c1 tempest-HypervisorAdminUnderV252Test-1629218670 tempest-HypervisorAdminUnderV252Test-1629218670-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:27.576238 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-d12ecc61-df1d-413e-8ff2-6b938ffaf4d6 req-e6570a8c-96aa-45c1-8af7-22139b7c8c42 service nova] Creating event network-vif-plugged:373f7ba2-e607-421d-b977-173e90d9f09b for instance cb82f77b-6207-4a99-a494-f252a820990c on n-h2-850501-14 Oct 04 18:29:27.590127 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-d12ecc61-df1d-413e-8ff2-6b938ffaf4d6 req-e6570a8c-96aa-45c1-8af7-22139b7c8c42 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089827 Oct 04 18:29:27.591701 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 231/484] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:29:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:29:27.628795 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-25eaec82-0ffd-49ec-84a4-d0b2290bb2c1 tempest-HypervisorAdminUnderV252Test-1629218670 tempest-HypervisorAdminUnderV252Test-1629218670-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:27.632080 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-25eaec82-0ffd-49ec-84a4-d0b2290bb2c1 tempest-HypervisorAdminUnderV252Test-1629218670 tempest-HypervisorAdminUnderV252Test-1629218670-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:27.634120 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-25eaec82-0ffd-49ec-84a4-d0b2290bb2c1 tempest-HypervisorAdminUnderV252Test-1629218670 tempest-HypervisorAdminUnderV252Test-1629218670-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:27.651774 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-25eaec82-0ffd-49ec-84a4-d0b2290bb2c1 tempest-HypervisorAdminUnderV252Test-1629218670 tempest-HypervisorAdminUnderV252Test-1629218670-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/n-h1-850501-14/search" status: 200 len: 105 microversion: 2.1 time: 0.094617 Oct 04 18:29:27.653699 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 254/485] 10.222.0.20 () {58 vars in 1212 bytes} [Tue Oct 4 18:29:27 2022] GET /compute/v2.1/os-hypervisors/n-h1-850501-14/search => generated 105 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:29:27.970125 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6c07f33e-ecdf-4b87-974e-27338885bc01 tempest-HostsAdminTestJSON-1387876188 tempest-HostsAdminTestJSON-1387876188-project-admin] Calling method '.version_select at 0x7fe2597a2820>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:27.973723 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6c07f33e-ecdf-4b87-974e-27338885bc01 tempest-HostsAdminTestJSON-1387876188 tempest-HostsAdminTestJSON-1387876188-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:27.974210 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6c07f33e-ecdf-4b87-974e-27338885bc01 tempest-HostsAdminTestJSON-1387876188 tempest-HostsAdminTestJSON-1387876188-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:27.974642 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6c07f33e-ecdf-4b87-974e-27338885bc01 tempest-HostsAdminTestJSON-1387876188 tempest-HostsAdminTestJSON-1387876188-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:27.975373 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6c07f33e-ecdf-4b87-974e-27338885bc01 tempest-HostsAdminTestJSON-1387876188 tempest-HostsAdminTestJSON-1387876188-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:27.975996 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6c07f33e-ecdf-4b87-974e-27338885bc01 tempest-HostsAdminTestJSON-1387876188 tempest-HostsAdminTestJSON-1387876188-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:27.976576 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6c07f33e-ecdf-4b87-974e-27338885bc01 tempest-HostsAdminTestJSON-1387876188 tempest-HostsAdminTestJSON-1387876188-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:28.010157 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6c07f33e-ecdf-4b87-974e-27338885bc01 tempest-HostsAdminTestJSON-1387876188 tempest-HostsAdminTestJSON-1387876188-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.378084 Oct 04 18:29:28.010748 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 232/486] 10.222.0.20 () {58 vars in 1128 bytes} [Tue Oct 4 18:29:27 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:29:28.024592 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9a632db6-9dd5-494e-9fff-af2a6359ac76 tempest-HostsAdminTestJSON-1387876188 tempest-HostsAdminTestJSON-1387876188-project-admin] Calling method '.version_select at 0x7fe25966bca0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:28.028802 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9a632db6-9dd5-494e-9fff-af2a6359ac76 tempest-HostsAdminTestJSON-1387876188 tempest-HostsAdminTestJSON-1387876188-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:28.029293 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9a632db6-9dd5-494e-9fff-af2a6359ac76 tempest-HostsAdminTestJSON-1387876188 tempest-HostsAdminTestJSON-1387876188-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:28.029933 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9a632db6-9dd5-494e-9fff-af2a6359ac76 tempest-HostsAdminTestJSON-1387876188 tempest-HostsAdminTestJSON-1387876188-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:28.030721 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9a632db6-9dd5-494e-9fff-af2a6359ac76 tempest-HostsAdminTestJSON-1387876188 tempest-HostsAdminTestJSON-1387876188-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:28.031166 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9a632db6-9dd5-494e-9fff-af2a6359ac76 tempest-HostsAdminTestJSON-1387876188 tempest-HostsAdminTestJSON-1387876188-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:28.031613 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9a632db6-9dd5-494e-9fff-af2a6359ac76 tempest-HostsAdminTestJSON-1387876188 tempest-HostsAdminTestJSON-1387876188-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:28.032890 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a0a39480-e320-4136-a36a-197a910b7019 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:28.033787 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a0a39480-e320-4136-a36a-197a910b7019 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] [instance: 31fc27b2-5ba0-4ba9-b119-12644f8eea78] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:28.037358 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=14 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:28.041026 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a0a39480-e320-4136-a36a-197a910b7019 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:28.041524 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a0a39480-e320-4136-a36a-197a910b7019 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:28.041960 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a0a39480-e320-4136-a36a-197a910b7019 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:28.042676 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a0a39480-e320-4136-a36a-197a910b7019 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:28.043135 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a0a39480-e320-4136-a36a-197a910b7019 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:28.043552 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a0a39480-e320-4136-a36a-197a910b7019 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:28.066929 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9a632db6-9dd5-494e-9fff-af2a6359ac76 tempest-HostsAdminTestJSON-1387876188 tempest-HostsAdminTestJSON-1387876188-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 381 microversion: 2.1 time: 0.045973 Oct 04 18:29:28.067532 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 255/487] 10.222.0.20 () {58 vars in 1139 bytes} [Tue Oct 4 18:29:28 2022] GET /compute/v2.1/os-hosts?zone= => generated 381 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:29:28.079862 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8924c8d5-e263-46ae-95c6-79c5b151b4e7 tempest-HostsAdminTestJSON-1387876188 tempest-HostsAdminTestJSON-1387876188-project-admin] Calling method '.version_select at 0x7fe2598bfa60>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:28.084621 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8924c8d5-e263-46ae-95c6-79c5b151b4e7 tempest-HostsAdminTestJSON-1387876188 tempest-HostsAdminTestJSON-1387876188-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:28.085385 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8924c8d5-e263-46ae-95c6-79c5b151b4e7 tempest-HostsAdminTestJSON-1387876188 tempest-HostsAdminTestJSON-1387876188-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:28.086599 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8924c8d5-e263-46ae-95c6-79c5b151b4e7 tempest-HostsAdminTestJSON-1387876188 tempest-HostsAdminTestJSON-1387876188-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:28.089801 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8924c8d5-e263-46ae-95c6-79c5b151b4e7 tempest-HostsAdminTestJSON-1387876188 tempest-HostsAdminTestJSON-1387876188-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:28.089801 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8924c8d5-e263-46ae-95c6-79c5b151b4e7 tempest-HostsAdminTestJSON-1387876188 tempest-HostsAdminTestJSON-1387876188-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:28.089801 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8924c8d5-e263-46ae-95c6-79c5b151b4e7 tempest-HostsAdminTestJSON-1387876188 tempest-HostsAdminTestJSON-1387876188-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:28.101654 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=100 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:28.124966 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8924c8d5-e263-46ae-95c6-79c5b151b4e7 tempest-HostsAdminTestJSON-1387876188 tempest-HostsAdminTestJSON-1387876188-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.049139 Oct 04 18:29:28.126580 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 256/488] 10.222.0.20 () {58 vars in 1145 bytes} [Tue Oct 4 18:29:28 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:29:28.139545 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d19c8db7-b5ff-4836-96ac-5f6cd2ecb3b4 tempest-HostsAdminTestJSON-1387876188 tempest-HostsAdminTestJSON-1387876188-project-admin] Calling method '.version_select at 0x7fe259636af0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:28.143166 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d19c8db7-b5ff-4836-96ac-5f6cd2ecb3b4 tempest-HostsAdminTestJSON-1387876188 tempest-HostsAdminTestJSON-1387876188-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:28.143829 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d19c8db7-b5ff-4836-96ac-5f6cd2ecb3b4 tempest-HostsAdminTestJSON-1387876188 tempest-HostsAdminTestJSON-1387876188-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:28.144306 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d19c8db7-b5ff-4836-96ac-5f6cd2ecb3b4 tempest-HostsAdminTestJSON-1387876188 tempest-HostsAdminTestJSON-1387876188-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:28.145666 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d19c8db7-b5ff-4836-96ac-5f6cd2ecb3b4 tempest-HostsAdminTestJSON-1387876188 tempest-HostsAdminTestJSON-1387876188-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:28.146430 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d19c8db7-b5ff-4836-96ac-5f6cd2ecb3b4 tempest-HostsAdminTestJSON-1387876188 tempest-HostsAdminTestJSON-1387876188-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:28.146865 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d19c8db7-b5ff-4836-96ac-5f6cd2ecb3b4 tempest-HostsAdminTestJSON-1387876188 tempest-HostsAdminTestJSON-1387876188-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:28.182104 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d19c8db7-b5ff-4836-96ac-5f6cd2ecb3b4 tempest-HostsAdminTestJSON-1387876188 tempest-HostsAdminTestJSON-1387876188-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.047038 Oct 04 18:29:28.182733 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 257/489] 10.222.0.20 () {58 vars in 1128 bytes} [Tue Oct 4 18:29:28 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:29:28.195048 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-be593c5d-1ed3-4a42-90c0-6eead9640d1b tempest-HostsAdminTestJSON-1387876188 tempest-HostsAdminTestJSON-1387876188-project-admin] Calling method '.version_select at 0x7fe259846160>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:28.199850 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-be593c5d-1ed3-4a42-90c0-6eead9640d1b tempest-HostsAdminTestJSON-1387876188 tempest-HostsAdminTestJSON-1387876188-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:28.200995 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-be593c5d-1ed3-4a42-90c0-6eead9640d1b tempest-HostsAdminTestJSON-1387876188 tempest-HostsAdminTestJSON-1387876188-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:28.201444 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-be593c5d-1ed3-4a42-90c0-6eead9640d1b tempest-HostsAdminTestJSON-1387876188 tempest-HostsAdminTestJSON-1387876188-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:28.202715 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-be593c5d-1ed3-4a42-90c0-6eead9640d1b tempest-HostsAdminTestJSON-1387876188 tempest-HostsAdminTestJSON-1387876188-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:28.203987 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-be593c5d-1ed3-4a42-90c0-6eead9640d1b tempest-HostsAdminTestJSON-1387876188 tempest-HostsAdminTestJSON-1387876188-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:28.204462 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-be593c5d-1ed3-4a42-90c0-6eead9640d1b tempest-HostsAdminTestJSON-1387876188 tempest-HostsAdminTestJSON-1387876188-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:28.238546 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-be593c5d-1ed3-4a42-90c0-6eead9640d1b tempest-HostsAdminTestJSON-1387876188 tempest-HostsAdminTestJSON-1387876188-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.048002 Oct 04 18:29:28.247544 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 258/490] 10.222.0.20 () {58 vars in 1155 bytes} [Tue Oct 4 18:29:28 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:29:28.253549 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5a408ec0-4a36-4bda-b9fa-d03dad7be135 tempest-HostsAdminTestJSON-1387876188 tempest-HostsAdminTestJSON-1387876188-project-admin] Calling method '.version_select at 0x7fe2595f95e0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:28.258938 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5a408ec0-4a36-4bda-b9fa-d03dad7be135 tempest-HostsAdminTestJSON-1387876188 tempest-HostsAdminTestJSON-1387876188-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:28.259438 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5a408ec0-4a36-4bda-b9fa-d03dad7be135 tempest-HostsAdminTestJSON-1387876188 tempest-HostsAdminTestJSON-1387876188-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:28.259934 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5a408ec0-4a36-4bda-b9fa-d03dad7be135 tempest-HostsAdminTestJSON-1387876188 tempest-HostsAdminTestJSON-1387876188-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:28.262419 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5a408ec0-4a36-4bda-b9fa-d03dad7be135 tempest-HostsAdminTestJSON-1387876188 tempest-HostsAdminTestJSON-1387876188-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:28.262419 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5a408ec0-4a36-4bda-b9fa-d03dad7be135 tempest-HostsAdminTestJSON-1387876188 tempest-HostsAdminTestJSON-1387876188-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:28.262419 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5a408ec0-4a36-4bda-b9fa-d03dad7be135 tempest-HostsAdminTestJSON-1387876188 tempest-HostsAdminTestJSON-1387876188-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:28.290622 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=5,nova_api:UPDATE=1,nova_api:DELETE=6 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:28.295302 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5a408ec0-4a36-4bda-b9fa-d03dad7be135 tempest-HostsAdminTestJSON-1387876188 tempest-HostsAdminTestJSON-1387876188-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.046699 Oct 04 18:29:28.297573 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a0a39480-e320-4136-a36a-197a910b7019 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c11a7c3cec94797b639e6e53dcbfb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375d02476ed240ea967eb2e28e8474ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:28.302471 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 259/491] 10.222.0.20 () {58 vars in 1128 bytes} [Tue Oct 4 18:29:28 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:29:28.307989 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-db64f8e9-30e1-4b0e-9195-e7ba7d6ecefa tempest-HostsAdminTestJSON-1387876188 tempest-HostsAdminTestJSON-1387876188-project-admin] Calling method '.version_select at 0x7fe259636820>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:28.310555 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a0a39480-e320-4136-a36a-197a910b7019 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] 10.222.0.20 "GET /compute/v2.1/servers/31fc27b2-5ba0-4ba9-b119-12644f8eea78" status: 200 len: 1321 microversion: 2.1 time: 0.280931 Oct 04 18:29:28.311173 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 233/492] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:28 2022] GET /compute/v2.1/servers/31fc27b2-5ba0-4ba9-b119-12644f8eea78 => generated 1321 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:29:28.317789 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-db64f8e9-30e1-4b0e-9195-e7ba7d6ecefa tempest-HostsAdminTestJSON-1387876188 tempest-HostsAdminTestJSON-1387876188-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:28.318543 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-db64f8e9-30e1-4b0e-9195-e7ba7d6ecefa tempest-HostsAdminTestJSON-1387876188 tempest-HostsAdminTestJSON-1387876188-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:28.319209 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-db64f8e9-30e1-4b0e-9195-e7ba7d6ecefa tempest-HostsAdminTestJSON-1387876188 tempest-HostsAdminTestJSON-1387876188-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:28.337707 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-db64f8e9-30e1-4b0e-9195-e7ba7d6ecefa tempest-HostsAdminTestJSON-1387876188 tempest-HostsAdminTestJSON-1387876188-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:28.338460 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-db64f8e9-30e1-4b0e-9195-e7ba7d6ecefa tempest-HostsAdminTestJSON-1387876188 tempest-HostsAdminTestJSON-1387876188-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:28.339058 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-db64f8e9-30e1-4b0e-9195-e7ba7d6ecefa tempest-HostsAdminTestJSON-1387876188 tempest-HostsAdminTestJSON-1387876188-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:28.379379 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-db64f8e9-30e1-4b0e-9195-e7ba7d6ecefa tempest-HostsAdminTestJSON-1387876188 tempest-HostsAdminTestJSON-1387876188-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts/n-h1-850501-14" status: 200 len: 735 microversion: 2.1 time: 0.075247 Oct 04 18:29:28.386221 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 260/493] 10.222.0.20 () {58 vars in 1173 bytes} [Tue Oct 4 18:29:28 2022] GET /compute/v2.1/os-hosts/n-h1-850501-14 => generated 735 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:29:28.390024 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-46bc06c1-47aa-43ba-b50b-9f3712fd4d60 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:28.390658 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-46bc06c1-47aa-43ba-b50b-9f3712fd4d60 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] [instance: 0c7c7ab7-7cd4-440c-b356-b02e2ce3b999] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:28.390816 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a7e33be7-c73f-4d24-87ce-85636d708e1e tempest-HostsAdminTestJSON-1387876188 tempest-HostsAdminTestJSON-1387876188-project-admin] Calling method '.version_select at 0x7fe25966b310>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:28.398107 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a7e33be7-c73f-4d24-87ce-85636d708e1e tempest-HostsAdminTestJSON-1387876188 tempest-HostsAdminTestJSON-1387876188-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:28.399479 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a7e33be7-c73f-4d24-87ce-85636d708e1e tempest-HostsAdminTestJSON-1387876188 tempest-HostsAdminTestJSON-1387876188-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:28.399919 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a7e33be7-c73f-4d24-87ce-85636d708e1e tempest-HostsAdminTestJSON-1387876188 tempest-HostsAdminTestJSON-1387876188-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:28.407613 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-46bc06c1-47aa-43ba-b50b-9f3712fd4d60 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:28.408133 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-46bc06c1-47aa-43ba-b50b-9f3712fd4d60 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:28.408569 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-46bc06c1-47aa-43ba-b50b-9f3712fd4d60 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:28.409458 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-46bc06c1-47aa-43ba-b50b-9f3712fd4d60 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:28.409976 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-46bc06c1-47aa-43ba-b50b-9f3712fd4d60 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:28.410406 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-46bc06c1-47aa-43ba-b50b-9f3712fd4d60 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:28.413660 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a7e33be7-c73f-4d24-87ce-85636d708e1e tempest-HostsAdminTestJSON-1387876188 tempest-HostsAdminTestJSON-1387876188-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:28.414619 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a7e33be7-c73f-4d24-87ce-85636d708e1e tempest-HostsAdminTestJSON-1387876188 tempest-HostsAdminTestJSON-1387876188-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:28.415296 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a7e33be7-c73f-4d24-87ce-85636d708e1e tempest-HostsAdminTestJSON-1387876188 tempest-HostsAdminTestJSON-1387876188-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:28.438453 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a7e33be7-c73f-4d24-87ce-85636d708e1e tempest-HostsAdminTestJSON-1387876188 tempest-HostsAdminTestJSON-1387876188-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts/n-h2-850501-14" status: 200 len: 603 microversion: 2.1 time: 0.051048 Oct 04 18:29:28.439339 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 261/494] 10.222.0.20 () {58 vars in 1173 bytes} [Tue Oct 4 18:29:28 2022] GET /compute/v2.1/os-hosts/n-h2-850501-14 => generated 603 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:29:28.545255 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-46bc06c1-47aa-43ba-b50b-9f3712fd4d60 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20cc2be1195747a4a363f0e490670d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f90e4ecf4d440229cafe5c25ec6df81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:28.567637 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-46bc06c1-47aa-43ba-b50b-9f3712fd4d60 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] 10.222.0.20 "GET /compute/v2.1/servers/0c7c7ab7-7cd4-440c-b356-b02e2ce3b999" status: 200 len: 1275 microversion: 2.1 time: 0.182446 Oct 04 18:29:28.568910 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 234/495] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:28 2022] GET /compute/v2.1/servers/0c7c7ab7-7cd4-440c-b356-b02e2ce3b999 => generated 1275 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:28.580203 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1669006b-8b5b-491d-86c7-7b7b4db203e1 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:28.581606 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1669006b-8b5b-491d-86c7-7b7b4db203e1 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: cb82f77b-6207-4a99-a494-f252a820990c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:28.599630 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1669006b-8b5b-491d-86c7-7b7b4db203e1 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:28.600372 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1669006b-8b5b-491d-86c7-7b7b4db203e1 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:28.603195 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1669006b-8b5b-491d-86c7-7b7b4db203e1 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:28.611233 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1669006b-8b5b-491d-86c7-7b7b4db203e1 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:28.611233 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1669006b-8b5b-491d-86c7-7b7b4db203e1 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:28.611233 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1669006b-8b5b-491d-86c7-7b7b4db203e1 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:28.937423 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1669006b-8b5b-491d-86c7-7b7b4db203e1 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:28.950400 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1669006b-8b5b-491d-86c7-7b7b4db203e1 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/cb82f77b-6207-4a99-a494-f252a820990c" status: 200 len: 1319 microversion: 2.1 time: 0.375430 Oct 04 18:29:28.954147 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 262/496] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:28 2022] GET /compute/v2.1/servers/cb82f77b-6207-4a99-a494-f252a820990c => generated 1319 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:29:29.335124 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4a228d4b-49e9-4472-8580-6883b5b3b6e7 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:29.335769 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4a228d4b-49e9-4472-8580-6883b5b3b6e7 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] [instance: 31fc27b2-5ba0-4ba9-b119-12644f8eea78] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:29.347012 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4a228d4b-49e9-4472-8580-6883b5b3b6e7 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:29.348167 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4a228d4b-49e9-4472-8580-6883b5b3b6e7 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:29.349521 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4a228d4b-49e9-4472-8580-6883b5b3b6e7 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:29.352570 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4a228d4b-49e9-4472-8580-6883b5b3b6e7 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:29.361111 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4a228d4b-49e9-4472-8580-6883b5b3b6e7 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:29.361909 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4a228d4b-49e9-4472-8580-6883b5b3b6e7 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:29.600122 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3e0b1100-dbad-4b0b-a4ae-6389a06b268c tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:29.600778 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3e0b1100-dbad-4b0b-a4ae-6389a06b268c tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] [instance: 0c7c7ab7-7cd4-440c-b356-b02e2ce3b999] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:29.620431 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3e0b1100-dbad-4b0b-a4ae-6389a06b268c tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:29.630375 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3e0b1100-dbad-4b0b-a4ae-6389a06b268c tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:29.630843 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3e0b1100-dbad-4b0b-a4ae-6389a06b268c tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:29.642309 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3e0b1100-dbad-4b0b-a4ae-6389a06b268c tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:29.642860 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3e0b1100-dbad-4b0b-a4ae-6389a06b268c tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:29.646783 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3e0b1100-dbad-4b0b-a4ae-6389a06b268c tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:29.900681 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3e0b1100-dbad-4b0b-a4ae-6389a06b268c tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20cc2be1195747a4a363f0e490670d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f90e4ecf4d440229cafe5c25ec6df81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:29.912894 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4a228d4b-49e9-4472-8580-6883b5b3b6e7 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c11a7c3cec94797b639e6e53dcbfb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375d02476ed240ea967eb2e28e8474ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:29.923850 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3e0b1100-dbad-4b0b-a4ae-6389a06b268c tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] 10.222.0.20 "GET /compute/v2.1/servers/0c7c7ab7-7cd4-440c-b356-b02e2ce3b999" status: 200 len: 1281 microversion: 2.1 time: 0.329703 Oct 04 18:29:29.925225 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 263/497] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:29 2022] GET /compute/v2.1/servers/0c7c7ab7-7cd4-440c-b356-b02e2ce3b999 => generated 1281 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:29.931560 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4a228d4b-49e9-4472-8580-6883b5b3b6e7 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] 10.222.0.20 "GET /compute/v2.1/servers/31fc27b2-5ba0-4ba9-b119-12644f8eea78" status: 200 len: 1321 microversion: 2.1 time: 0.598351 Oct 04 18:29:29.933001 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 235/498] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:29 2022] GET /compute/v2.1/servers/31fc27b2-5ba0-4ba9-b119-12644f8eea78 => generated 1321 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:29.974017 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2e91a993-8140-4fad-b510-5e7a346444ec tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:29.977788 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2e91a993-8140-4fad-b510-5e7a346444ec tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: cb82f77b-6207-4a99-a494-f252a820990c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:29.988483 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2e91a993-8140-4fad-b510-5e7a346444ec tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:30.003570 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2e91a993-8140-4fad-b510-5e7a346444ec tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:30.013022 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2e91a993-8140-4fad-b510-5e7a346444ec tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:30.017234 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2e91a993-8140-4fad-b510-5e7a346444ec tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:30.021851 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2e91a993-8140-4fad-b510-5e7a346444ec tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:30.025099 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2e91a993-8140-4fad-b510-5e7a346444ec tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:30.310337 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-2e91a993-8140-4fad-b510-5e7a346444ec tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:30.324273 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2e91a993-8140-4fad-b510-5e7a346444ec tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/cb82f77b-6207-4a99-a494-f252a820990c" status: 200 len: 1469 microversion: 2.1 time: 0.354372 Oct 04 18:29:30.325559 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 264/499] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:29 2022] GET /compute/v2.1/servers/cb82f77b-6207-4a99-a494-f252a820990c => generated 1469 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:30.350703 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-63290376-6718-47da-ac24-fc587c042993 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:30.351478 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-63290376-6718-47da-ac24-fc587c042993 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: 890f8168-5b22-465a-894d-ca70dd1acbed] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:30.359820 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-63290376-6718-47da-ac24-fc587c042993 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:30.360738 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-63290376-6718-47da-ac24-fc587c042993 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:30.361427 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-63290376-6718-47da-ac24-fc587c042993 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:30.362297 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-63290376-6718-47da-ac24-fc587c042993 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:30.363253 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-63290376-6718-47da-ac24-fc587c042993 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:30.363842 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-63290376-6718-47da-ac24-fc587c042993 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:30.605833 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-63290376-6718-47da-ac24-fc587c042993 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:30.620333 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-63290376-6718-47da-ac24-fc587c042993 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/890f8168-5b22-465a-894d-ca70dd1acbed" status: 200 len: 1469 microversion: 2.1 time: 0.273770 Oct 04 18:29:30.627051 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 236/500] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:30 2022] GET /compute/v2.1/servers/890f8168-5b22-465a-894d-ca70dd1acbed => generated 1469 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:30.649472 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6ccff2e7-ebe1-418d-b730-a1ddfe6e7e07 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:30.659658 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6ccff2e7-ebe1-418d-b730-a1ddfe6e7e07 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:30.660603 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6ccff2e7-ebe1-418d-b730-a1ddfe6e7e07 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Searching by: {'reservation_id': 'r-kur419r9', 'deleted': False, 'project_id': '771211a4ce424aa48920ff102c894a9f'} {{(pid=123001) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:29:30.678825 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6ccff2e7-ebe1-418d-b730-a1ddfe6e7e07 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:30.679303 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6ccff2e7-ebe1-418d-b730-a1ddfe6e7e07 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:30.680572 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6ccff2e7-ebe1-418d-b730-a1ddfe6e7e07 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:30.681618 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6ccff2e7-ebe1-418d-b730-a1ddfe6e7e07 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:30.683467 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6ccff2e7-ebe1-418d-b730-a1ddfe6e7e07 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:30.684290 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6ccff2e7-ebe1-418d-b730-a1ddfe6e7e07 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:30.915388 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.multi_cell_list [None req-6ccff2e7-ebe1-418d-b730-a1ddfe6e7e07 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=123001) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:29:30.955314 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8faeedd4-a09b-4bad-a4bc-dba556929f25 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:30.956222 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8faeedd4-a09b-4bad-a4bc-dba556929f25 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] [instance: 0c7c7ab7-7cd4-440c-b356-b02e2ce3b999] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:30.962365 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:30.971546 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8faeedd4-a09b-4bad-a4bc-dba556929f25 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:30.977865 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8faeedd4-a09b-4bad-a4bc-dba556929f25 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:30.978326 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8faeedd4-a09b-4bad-a4bc-dba556929f25 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:30.981419 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8faeedd4-a09b-4bad-a4bc-dba556929f25 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:30.993047 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8faeedd4-a09b-4bad-a4bc-dba556929f25 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:30.993624 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8faeedd4-a09b-4bad-a4bc-dba556929f25 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:31.179192 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6ccff2e7-ebe1-418d-b730-a1ddfe6e7e07 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:31.190242 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8faeedd4-a09b-4bad-a4bc-dba556929f25 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20cc2be1195747a4a363f0e490670d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f90e4ecf4d440229cafe5c25ec6df81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:31.203074 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8faeedd4-a09b-4bad-a4bc-dba556929f25 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] 10.222.0.20 "GET /compute/v2.1/servers/0c7c7ab7-7cd4-440c-b356-b02e2ce3b999" status: 200 len: 1281 microversion: 2.1 time: 0.251015 Oct 04 18:29:31.205848 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 237/501] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:30 2022] GET /compute/v2.1/servers/0c7c7ab7-7cd4-440c-b356-b02e2ce3b999 => generated 1281 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:29:31.209395 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6ccff2e7-ebe1-418d-b730-a1ddfe6e7e07 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:31.210114 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6ccff2e7-ebe1-418d-b730-a1ddfe6e7e07 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:31.212149 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6ccff2e7-ebe1-418d-b730-a1ddfe6e7e07 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:31.229721 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-51ba80e5-8932-4edf-a563-e55c6c3a480c tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:31.230598 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-51ba80e5-8932-4edf-a563-e55c6c3a480c tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] [instance: 31fc27b2-5ba0-4ba9-b119-12644f8eea78] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:31.238653 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-51ba80e5-8932-4edf-a563-e55c6c3a480c tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:31.239530 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-51ba80e5-8932-4edf-a563-e55c6c3a480c tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:31.240297 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-51ba80e5-8932-4edf-a563-e55c6c3a480c tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:31.241306 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-51ba80e5-8932-4edf-a563-e55c6c3a480c tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:31.242131 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-51ba80e5-8932-4edf-a563-e55c6c3a480c tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:31.247046 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-51ba80e5-8932-4edf-a563-e55c6c3a480c tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:31.620692 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6ccff2e7-ebe1-418d-b730-a1ddfe6e7e07 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/detail?reservation_id=r-kur419r9" status: 200 len: 2931 microversion: 2.1 time: 0.976198 Oct 04 18:29:31.641248 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 265/502] 10.222.0.20 () {58 vars in 1197 bytes} [Tue Oct 4 18:29:30 2022] GET /compute/v2.1/servers/detail?reservation_id=r-kur419r9 => generated 2931 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:31.661203 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5f38c00a-c401-411b-b5e7-54f64f002860 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:31.692355 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.compute.server_groups [None req-5f38c00a-c401-411b-b5e7-54f64f002860 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Querying cell a6039a6d-a98c-44a9-819b-4eff388d8aa7(cell1) for 2 instances {{(pid=123001) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 04 18:29:31.693832 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5f38c00a-c401-411b-b5e7-54f64f002860 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:31.694703 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5f38c00a-c401-411b-b5e7-54f64f002860 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:31.696300 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5f38c00a-c401-411b-b5e7-54f64f002860 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:31.736155 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5f38c00a-c401-411b-b5e7-54f64f002860 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups/75d1ac2f-d5be-4270-81b8-f7db691eccfb" status: 200 len: 265 microversion: 2.1 time: 0.090075 Oct 04 18:29:31.740450 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 266/503] 10.222.0.20 () {58 vars in 1263 bytes} [Tue Oct 4 18:29:31 2022] GET /compute/v2.1/os-server-groups/75d1ac2f-d5be-4270-81b8-f7db691eccfb => generated 265 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:29:31.748799 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c5c2ace2-4b77-42d9-b133-0b91e5c66f43 tempest-ServersOnMultiNodesTest-1719152185 tempest-ServersOnMultiNodesTest-1719152185-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:31.750552 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c5c2ace2-4b77-42d9-b133-0b91e5c66f43 tempest-ServersOnMultiNodesTest-1719152185 tempest-ServersOnMultiNodesTest-1719152185-project-admin] [instance: 890f8168-5b22-465a-894d-ca70dd1acbed] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:31.760623 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c5c2ace2-4b77-42d9-b133-0b91e5c66f43 tempest-ServersOnMultiNodesTest-1719152185 tempest-ServersOnMultiNodesTest-1719152185-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:31.761130 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c5c2ace2-4b77-42d9-b133-0b91e5c66f43 tempest-ServersOnMultiNodesTest-1719152185 tempest-ServersOnMultiNodesTest-1719152185-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:31.761625 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c5c2ace2-4b77-42d9-b133-0b91e5c66f43 tempest-ServersOnMultiNodesTest-1719152185 tempest-ServersOnMultiNodesTest-1719152185-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:31.762565 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c5c2ace2-4b77-42d9-b133-0b91e5c66f43 tempest-ServersOnMultiNodesTest-1719152185 tempest-ServersOnMultiNodesTest-1719152185-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:31.763222 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c5c2ace2-4b77-42d9-b133-0b91e5c66f43 tempest-ServersOnMultiNodesTest-1719152185 tempest-ServersOnMultiNodesTest-1719152185-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:31.764394 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c5c2ace2-4b77-42d9-b133-0b91e5c66f43 tempest-ServersOnMultiNodesTest-1719152185 tempest-ServersOnMultiNodesTest-1719152185-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:31.795897 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-51ba80e5-8932-4edf-a563-e55c6c3a480c tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c11a7c3cec94797b639e6e53dcbfb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375d02476ed240ea967eb2e28e8474ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:31.807201 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-51ba80e5-8932-4edf-a563-e55c6c3a480c tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] 10.222.0.20 "GET /compute/v2.1/servers/31fc27b2-5ba0-4ba9-b119-12644f8eea78" status: 200 len: 1321 microversion: 2.1 time: 0.581586 Oct 04 18:29:31.808672 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 238/504] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:31 2022] GET /compute/v2.1/servers/31fc27b2-5ba0-4ba9-b119-12644f8eea78 => generated 1321 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:31.940719 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c5c2ace2-4b77-42d9-b133-0b91e5c66f43 tempest-ServersOnMultiNodesTest-1719152185 tempest-ServersOnMultiNodesTest-1719152185-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/890f8168-5b22-465a-894d-ca70dd1acbed" status: 200 len: 1622 microversion: 2.1 time: 0.196170 Oct 04 18:29:31.941727 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 267/505] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:31 2022] GET /compute/v2.1/servers/890f8168-5b22-465a-894d-ca70dd1acbed => generated 1622 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:31.964445 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f1996d40-3e18-4b9d-b7b8-30158d6eea34 tempest-ServersOnMultiNodesTest-1719152185 tempest-ServersOnMultiNodesTest-1719152185-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:31.965091 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f1996d40-3e18-4b9d-b7b8-30158d6eea34 tempest-ServersOnMultiNodesTest-1719152185 tempest-ServersOnMultiNodesTest-1719152185-project-admin] [instance: cb82f77b-6207-4a99-a494-f252a820990c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:31.970949 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f1996d40-3e18-4b9d-b7b8-30158d6eea34 tempest-ServersOnMultiNodesTest-1719152185 tempest-ServersOnMultiNodesTest-1719152185-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:31.971435 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f1996d40-3e18-4b9d-b7b8-30158d6eea34 tempest-ServersOnMultiNodesTest-1719152185 tempest-ServersOnMultiNodesTest-1719152185-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:31.971871 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f1996d40-3e18-4b9d-b7b8-30158d6eea34 tempest-ServersOnMultiNodesTest-1719152185 tempest-ServersOnMultiNodesTest-1719152185-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:31.972591 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f1996d40-3e18-4b9d-b7b8-30158d6eea34 tempest-ServersOnMultiNodesTest-1719152185 tempest-ServersOnMultiNodesTest-1719152185-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:31.973049 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f1996d40-3e18-4b9d-b7b8-30158d6eea34 tempest-ServersOnMultiNodesTest-1719152185 tempest-ServersOnMultiNodesTest-1719152185-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:31.973474 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f1996d40-3e18-4b9d-b7b8-30158d6eea34 tempest-ServersOnMultiNodesTest-1719152185 tempest-ServersOnMultiNodesTest-1719152185-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:32.233565 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-be7e1397-fd4f-4e94-9b39-8b80e1260edd tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:32.233858 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-be7e1397-fd4f-4e94-9b39-8b80e1260edd tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] [instance: 0c7c7ab7-7cd4-440c-b356-b02e2ce3b999] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:32.256866 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-be7e1397-fd4f-4e94-9b39-8b80e1260edd tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:32.257372 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-be7e1397-fd4f-4e94-9b39-8b80e1260edd tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:32.264129 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-be7e1397-fd4f-4e94-9b39-8b80e1260edd tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:32.267412 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-be7e1397-fd4f-4e94-9b39-8b80e1260edd tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:32.267912 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-be7e1397-fd4f-4e94-9b39-8b80e1260edd tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:32.272512 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-be7e1397-fd4f-4e94-9b39-8b80e1260edd tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:32.326546 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f1996d40-3e18-4b9d-b7b8-30158d6eea34 tempest-ServersOnMultiNodesTest-1719152185 tempest-ServersOnMultiNodesTest-1719152185-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/cb82f77b-6207-4a99-a494-f252a820990c" status: 200 len: 1622 microversion: 2.1 time: 0.365574 Oct 04 18:29:32.353648 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 239/506] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:31 2022] GET /compute/v2.1/servers/cb82f77b-6207-4a99-a494-f252a820990c => generated 1622 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:32.503702 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d22d9c02-791f-4173-8d7c-964b751aab82 tempest-FloatingIPsTestJSON-1589412063 tempest-FloatingIPsTestJSON-1589412063-project] Action: 'create', calling method: .version_select at 0x7fe2596eb310>, body: {"pool": null} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:33.341979 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-be7e1397-fd4f-4e94-9b39-8b80e1260edd tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20cc2be1195747a4a363f0e490670d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f90e4ecf4d440229cafe5c25ec6df81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:33.350685 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-be7e1397-fd4f-4e94-9b39-8b80e1260edd tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] 10.222.0.20 "GET /compute/v2.1/servers/0c7c7ab7-7cd4-440c-b356-b02e2ce3b999" status: 200 len: 1323 microversion: 2.1 time: 1.125365 Oct 04 18:29:33.373774 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 268/507] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:32 2022] GET /compute/v2.1/servers/0c7c7ab7-7cd4-440c-b356-b02e2ce3b999 => generated 1323 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:29:33.375505 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5e288bec-03b0-40e8-a65a-9987fba4ad04 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Action: 'create', calling method: .version_select at 0x7fe2594ce160>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1177093654", "policies": ["anti-affinity"]}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:33.394260 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-5e288bec-03b0-40e8-a65a-9987fba4ad04 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Getting quotas for project 771211a4ce424aa48920ff102c894a9f. Resources: {'server_groups'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:29:33.400039 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-5e288bec-03b0-40e8-a65a-9987fba4ad04 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Getting quotas for user 07dd131fa3c44d439d0f3ec6e4b8ad42 and project 771211a4ce424aa48920ff102c894a9f. Resources: {'server_groups'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:29:33.535447 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-5e288bec-03b0-40e8-a65a-9987fba4ad04 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Getting quotas for project 771211a4ce424aa48920ff102c894a9f. Resources: {'server_groups'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:29:33.542106 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-5e288bec-03b0-40e8-a65a-9987fba4ad04 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Getting quotas for user 07dd131fa3c44d439d0f3ec6e4b8ad42 and project 771211a4ce424aa48920ff102c894a9f. Resources: {'server_groups'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:29:33.563481 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5e288bec-03b0-40e8-a65a-9987fba4ad04 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.187598 Oct 04 18:29:33.563481 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 269/508] 10.222.0.20 () {60 vars in 1174 bytes} [Tue Oct 4 18:29:33 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:29:33.566213 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d9c97cfa-05a6-4154-a194-4b6e70224a56 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:33.567078 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d9c97cfa-05a6-4154-a194-4b6e70224a56 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] [instance: 31fc27b2-5ba0-4ba9-b119-12644f8eea78] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:33.576578 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d9c97cfa-05a6-4154-a194-4b6e70224a56 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:33.577436 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d9c97cfa-05a6-4154-a194-4b6e70224a56 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:33.578153 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d9c97cfa-05a6-4154-a194-4b6e70224a56 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:33.579775 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d9c97cfa-05a6-4154-a194-4b6e70224a56 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:33.580516 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d9c97cfa-05a6-4154-a194-4b6e70224a56 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:33.581217 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d9c97cfa-05a6-4154-a194-4b6e70224a56 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:33.853005 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d9c97cfa-05a6-4154-a194-4b6e70224a56 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c11a7c3cec94797b639e6e53dcbfb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375d02476ed240ea967eb2e28e8474ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:33.863254 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d9c97cfa-05a6-4154-a194-4b6e70224a56 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] 10.222.0.20 "GET /compute/v2.1/servers/31fc27b2-5ba0-4ba9-b119-12644f8eea78" status: 200 len: 1321 microversion: 2.1 time: 0.301881 Oct 04 18:29:33.876965 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 270/509] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:33 2022] GET /compute/v2.1/servers/31fc27b2-5ba0-4ba9-b119-12644f8eea78 => generated 1321 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:33.889570 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-73f2502a-6b96-47ac-988d-bf9ed733b6da req-e835fcb0-0936-4865-a4cd-ea125d5ca57a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31fc27b2-5ba0-4ba9-b119-12644f8eea78", "name": "network-vif-plugged", "status": "completed", "tag": "c283ec45-e77a-4800-b6ac-8286118aa036"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:33.919707 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-73f2502a-6b96-47ac-988d-bf9ed733b6da req-e835fcb0-0936-4865-a4cd-ea125d5ca57a service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:33.920504 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-73f2502a-6b96-47ac-988d-bf9ed733b6da req-e835fcb0-0936-4865-a4cd-ea125d5ca57a service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:33.921079 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-73f2502a-6b96-47ac-988d-bf9ed733b6da req-e835fcb0-0936-4865-a4cd-ea125d5ca57a service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:33.946786 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-73f2502a-6b96-47ac-988d-bf9ed733b6da req-e835fcb0-0936-4865-a4cd-ea125d5ca57a service nova] Creating event network-vif-plugged:c283ec45-e77a-4800-b6ac-8286118aa036 for instance 31fc27b2-5ba0-4ba9-b119-12644f8eea78 on n-h1-850501-14 Oct 04 18:29:33.954198 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-73f2502a-6b96-47ac-988d-bf9ed733b6da req-e835fcb0-0936-4865-a4cd-ea125d5ca57a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075520 Oct 04 18:29:33.956979 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 271/510] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:29:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:29:33.965020 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3bf5538c-2a88-48de-86e2-e1c15e7a94a8 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1123128814", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "36972d4e-f7eb-4ece-bc60-6ecfce4969e3"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:34.027886 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.neutron [None req-3bf5538c-2a88-48de-86e2-e1c15e7a94a8 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] validate_networks() for None {{(pid=123001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:29:34.467274 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-3bf5538c-2a88-48de-86e2-e1c15e7a94a8 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:29:34.467906 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-3bf5538c-2a88-48de-86e2-e1c15e7a94a8 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:29:34.468928 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-3bf5538c-2a88-48de-86e2-e1c15e7a94a8 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:29:34.469347 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-3bf5538c-2a88-48de-86e2-e1c15e7a94a8 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:29:34.469766 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-3bf5538c-2a88-48de-86e2-e1c15e7a94a8 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:29:34.517273 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3bf5538c-2a88-48de-86e2-e1c15e7a94a8 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:34.517802 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3bf5538c-2a88-48de-86e2-e1c15e7a94a8 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:34.519338 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3bf5538c-2a88-48de-86e2-e1c15e7a94a8 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:34.520147 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3bf5538c-2a88-48de-86e2-e1c15e7a94a8 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:34.520658 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3bf5538c-2a88-48de-86e2-e1c15e7a94a8 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:34.521031 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3bf5538c-2a88-48de-86e2-e1c15e7a94a8 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:34.567087 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-3bf5538c-2a88-48de-86e2-e1c15e7a94a8 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Getting quotas for project 771211a4ce424aa48920ff102c894a9f. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:29:34.573082 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-3bf5538c-2a88-48de-86e2-e1c15e7a94a8 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Getting quotas for user 07dd131fa3c44d439d0f3ec6e4b8ad42 and project 771211a4ce424aa48920ff102c894a9f. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:29:34.587504 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3bf5538c-2a88-48de-86e2-e1c15e7a94a8 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Going to run 2 instances... {{(pid=123001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:29:34.590405 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3bf5538c-2a88-48de-86e2-e1c15e7a94a8 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: 2d07c478-8e9c-4000-92bb-3fa4547ea6c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:29:34.801079 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=23 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:34.831022 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-3bf5538c-2a88-48de-86e2-e1c15e7a94a8 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Getting quotas for project 771211a4ce424aa48920ff102c894a9f. Resources: {'server_group_members'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:29:34.850337 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-3bf5538c-2a88-48de-86e2-e1c15e7a94a8 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Getting quotas for user 07dd131fa3c44d439d0f3ec6e4b8ad42 and project 771211a4ce424aa48920ff102c894a9f. Resources: {'server_group_members'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:29:35.010737 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-3bf5538c-2a88-48de-86e2-e1c15e7a94a8 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Getting quotas for project 771211a4ce424aa48920ff102c894a9f. Resources: {'server_group_members'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:29:35.041487 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-3bf5538c-2a88-48de-86e2-e1c15e7a94a8 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Getting quotas for user 07dd131fa3c44d439d0f3ec6e4b8ad42 and project 771211a4ce424aa48920ff102c894a9f. Resources: {'server_group_members'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:29:35.068508 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:35.082032 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3bf5538c-2a88-48de-86e2-e1c15e7a94a8 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: d5e996e9-dc9f-46e3-8469-e46dc2932b24] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=2d07c478-8e9c-4000-92bb-3fa4547ea6c0,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:29:35.285459 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-3bf5538c-2a88-48de-86e2-e1c15e7a94a8 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Getting quotas for project 771211a4ce424aa48920ff102c894a9f. Resources: {'server_group_members'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:29:35.299127 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-3bf5538c-2a88-48de-86e2-e1c15e7a94a8 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Getting quotas for user 07dd131fa3c44d439d0f3ec6e4b8ad42 and project 771211a4ce424aa48920ff102c894a9f. Resources: {'server_group_members'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:29:35.439281 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-3bf5538c-2a88-48de-86e2-e1c15e7a94a8 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Getting quotas for project 771211a4ce424aa48920ff102c894a9f. Resources: {'server_group_members'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:29:35.444963 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-3bf5538c-2a88-48de-86e2-e1c15e7a94a8 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Getting quotas for user 07dd131fa3c44d439d0f3ec6e4b8ad42 and project 771211a4ce424aa48920ff102c894a9f. Resources: {'server_group_members'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:29:35.569136 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3bf5538c-2a88-48de-86e2-e1c15e7a94a8 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.612383 Oct 04 18:29:35.573145 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 272/511] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:29:33 2022] POST /compute/v2.1/servers => generated 32 bytes in 1617 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 04 18:29:35.596596 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-49d0f7a8-941e-4241-8cd5-11928e5f59c8 req-67823735-0333-4904-9e95-02c63025d592 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c7c7ab7-7cd4-440c-b356-b02e2ce3b999", "tag": "f4bea2ab-fc0f-49bd-a308-f3341bcd9942"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:35.625770 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-49d0f7a8-941e-4241-8cd5-11928e5f59c8 req-67823735-0333-4904-9e95-02c63025d592 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:35.629143 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-49d0f7a8-941e-4241-8cd5-11928e5f59c8 req-67823735-0333-4904-9e95-02c63025d592 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:35.630084 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-49d0f7a8-941e-4241-8cd5-11928e5f59c8 req-67823735-0333-4904-9e95-02c63025d592 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:35.671581 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-49d0f7a8-941e-4241-8cd5-11928e5f59c8 req-67823735-0333-4904-9e95-02c63025d592 service nova] Creating event network-changed:f4bea2ab-fc0f-49bd-a308-f3341bcd9942 for instance 0c7c7ab7-7cd4-440c-b356-b02e2ce3b999 on n-h1-850501-14 Oct 04 18:29:35.686065 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-49d0f7a8-941e-4241-8cd5-11928e5f59c8 req-67823735-0333-4904-9e95-02c63025d592 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102855 Oct 04 18:29:35.689404 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 273/512] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:29:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:29:35.702505 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4132f8e8-e544-4962-bdc4-4b7d10ec9a89 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:35.706461 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-4132f8e8-e544-4962-bdc4-4b7d10ec9a89 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] [instance: 0c7c7ab7-7cd4-440c-b356-b02e2ce3b999] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:35.721008 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4132f8e8-e544-4962-bdc4-4b7d10ec9a89 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:35.724507 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4132f8e8-e544-4962-bdc4-4b7d10ec9a89 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:35.725341 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4132f8e8-e544-4962-bdc4-4b7d10ec9a89 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:35.727199 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4132f8e8-e544-4962-bdc4-4b7d10ec9a89 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:35.730160 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4132f8e8-e544-4962-bdc4-4b7d10ec9a89 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:35.732120 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4132f8e8-e544-4962-bdc4-4b7d10ec9a89 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:36.458314 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-4132f8e8-e544-4962-bdc4-4b7d10ec9a89 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20cc2be1195747a4a363f0e490670d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f90e4ecf4d440229cafe5c25ec6df81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:36.471847 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-4132f8e8-e544-4962-bdc4-4b7d10ec9a89 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] 10.222.0.20 "GET /compute/v2.1/servers/0c7c7ab7-7cd4-440c-b356-b02e2ce3b999" status: 200 len: 1323 microversion: 2.1 time: 0.780599 Oct 04 18:29:36.474063 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 274/513] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:35 2022] GET /compute/v2.1/servers/0c7c7ab7-7cd4-440c-b356-b02e2ce3b999 => generated 1323 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:36.482553 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-314cced8-0170-4398-bf8f-6d013d4aa83f tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:36.486494 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-314cced8-0170-4398-bf8f-6d013d4aa83f tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] [instance: 31fc27b2-5ba0-4ba9-b119-12644f8eea78] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:36.495641 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d22d9c02-791f-4173-8d7c-964b751aab82 tempest-FloatingIPsTestJSON-1589412063 tempest-FloatingIPsTestJSON-1589412063-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.142190 Oct 04 18:29:36.510314 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-314cced8-0170-4398-bf8f-6d013d4aa83f tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:36.514316 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-314cced8-0170-4398-bf8f-6d013d4aa83f tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:36.514316 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-314cced8-0170-4398-bf8f-6d013d4aa83f tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:36.514316 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-314cced8-0170-4398-bf8f-6d013d4aa83f tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:36.514587 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 240/514] 10.222.0.20 () {60 vars in 1170 bytes} [Tue Oct 4 18:29:32 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:29:36.514824 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-314cced8-0170-4398-bf8f-6d013d4aa83f tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:36.514824 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-314cced8-0170-4398-bf8f-6d013d4aa83f tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:36.954956 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6e1e7111-0db2-488e-a3a6-4be4e53b280d tempest-HypervisorAdminNegativeUnderV252Test-1426425021 tempest-HypervisorAdminNegativeUnderV252Test-1426425021-project-admin] Calling method '.version_select at 0x7fe25971ae50>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:36.957704 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6e1e7111-0db2-488e-a3a6-4be4e53b280d tempest-HypervisorAdminNegativeUnderV252Test-1426425021 tempest-HypervisorAdminNegativeUnderV252Test-1426425021-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:36.959183 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6e1e7111-0db2-488e-a3a6-4be4e53b280d tempest-HypervisorAdminNegativeUnderV252Test-1426425021 tempest-HypervisorAdminNegativeUnderV252Test-1426425021-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:36.960507 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6e1e7111-0db2-488e-a3a6-4be4e53b280d tempest-HypervisorAdminNegativeUnderV252Test-1426425021 tempest-HypervisorAdminNegativeUnderV252Test-1426425021-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:36.999027 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-314cced8-0170-4398-bf8f-6d013d4aa83f tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c11a7c3cec94797b639e6e53dcbfb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375d02476ed240ea967eb2e28e8474ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:37.010824 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6e1e7111-0db2-488e-a3a6-4be4e53b280d tempest-HypervisorAdminNegativeUnderV252Test-1426425021 tempest-HypervisorAdminNegativeUnderV252Test-1426425021-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:37.011871 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6e1e7111-0db2-488e-a3a6-4be4e53b280d tempest-HypervisorAdminNegativeUnderV252Test-1426425021 tempest-HypervisorAdminNegativeUnderV252Test-1426425021-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:37.012550 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6e1e7111-0db2-488e-a3a6-4be4e53b280d tempest-HypervisorAdminNegativeUnderV252Test-1426425021 tempest-HypervisorAdminNegativeUnderV252Test-1426425021-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:37.021411 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-314cced8-0170-4398-bf8f-6d013d4aa83f tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] 10.222.0.20 "GET /compute/v2.1/servers/31fc27b2-5ba0-4ba9-b119-12644f8eea78" status: 200 len: 1471 microversion: 2.1 time: 0.543394 Oct 04 18:29:37.022016 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 275/515] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:36 2022] GET /compute/v2.1/servers/31fc27b2-5ba0-4ba9-b119-12644f8eea78 => generated 1471 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:37.029402 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6e1e7111-0db2-488e-a3a6-4be4e53b280d tempest-HypervisorAdminNegativeUnderV252Test-1426425021 tempest-HypervisorAdminNegativeUnderV252Test-1426425021-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:37.030795 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6e1e7111-0db2-488e-a3a6-4be4e53b280d tempest-HypervisorAdminNegativeUnderV252Test-1426425021 tempest-HypervisorAdminNegativeUnderV252Test-1426425021-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:37.031910 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6e1e7111-0db2-488e-a3a6-4be4e53b280d tempest-HypervisorAdminNegativeUnderV252Test-1426425021 tempest-HypervisorAdminNegativeUnderV252Test-1426425021-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:37.043813 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6bdf77b6-5128-4e04-993d-10bec22a3dd3 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:37.059286 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6bdf77b6-5128-4e04-993d-10bec22a3dd3 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:37.060460 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6bdf77b6-5128-4e04-993d-10bec22a3dd3 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Searching by: {'deleted': False, 'project_id': '771211a4ce424aa48920ff102c894a9f'} {{(pid=123001) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:29:37.061551 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6e1e7111-0db2-488e-a3a6-4be4e53b280d tempest-HypervisorAdminNegativeUnderV252Test-1426425021 tempest-HypervisorAdminNegativeUnderV252Test-1426425021-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.544189 Oct 04 18:29:37.065275 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 241/516] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Oct 4 18:29:36 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:29:37.082452 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3e9131d3-3488-4032-8f8b-34ead270119e tempest-FloatingIPsTestJSON-1589412063 tempest-FloatingIPsTestJSON-1589412063-project] Calling method '.version_select at 0x7fe2597d55e0>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:37.082776 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6bdf77b6-5128-4e04-993d-10bec22a3dd3 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:37.083268 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6bdf77b6-5128-4e04-993d-10bec22a3dd3 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:37.083715 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6bdf77b6-5128-4e04-993d-10bec22a3dd3 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:37.084485 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6bdf77b6-5128-4e04-993d-10bec22a3dd3 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:37.084940 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6bdf77b6-5128-4e04-993d-10bec22a3dd3 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:37.085360 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6bdf77b6-5128-4e04-993d-10bec22a3dd3 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:37.144365 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.multi_cell_list [None req-6bdf77b6-5128-4e04-993d-10bec22a3dd3 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=123001) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:29:37.180150 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6bdf77b6-5128-4e04-993d-10bec22a3dd3 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 1666 microversion: 2.1 time: 0.154801 Oct 04 18:29:37.180744 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 276/517] 10.222.0.20 () {58 vars in 1125 bytes} [Tue Oct 4 18:29:37 2022] GET /compute/v2.1/servers => generated 1666 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:37.349263 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b8843b12-7dcb-47bb-b485-edfab721b41d tempest-ServersAdminNegativeTestJSON-1850710304 tempest-ServersAdminNegativeTestJSON-1850710304-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:37.349806 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b8843b12-7dcb-47bb-b485-edfab721b41d tempest-ServersAdminNegativeTestJSON-1850710304 tempest-ServersAdminNegativeTestJSON-1850710304-project-admin] [instance: ae333d2e-b0bb-46a7-a591-72af69adef8b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:37.356571 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-b8843b12-7dcb-47bb-b485-edfab721b41d tempest-ServersAdminNegativeTestJSON-1850710304 tempest-ServersAdminNegativeTestJSON-1850710304-project-admin] HTTP exception thrown: Instance ae333d2e-b0bb-46a7-a591-72af69adef8b could not be found. Oct 04 18:29:37.368016 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b8843b12-7dcb-47bb-b485-edfab721b41d tempest-ServersAdminNegativeTestJSON-1850710304 tempest-ServersAdminNegativeTestJSON-1850710304-project-admin] Request method failure captured: Oct 04 18:29:37.368016 n-d-850501-14 devstack@n-api.service[123001]: request: POST /compute/v2.1/servers/ae333d2e-b0bb-46a7-a591-72af69adef8b/action HTTP/1.1 Oct 04 18:29:37.368016 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:29:37.368016 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:29:37.368016 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:29:37.368016 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 15 Oct 04 18:29:37.368016 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:29:37.368016 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:29:37.368016 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:29:37.368016 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:29:37.368016 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPHt9cKuiYAjdV1RFm8KbR5yx-QQRu8MSAAjPGOQZOj5ta9tBngPGgxbUrWZa0zwN6B2JkNGZHD5byrVmsbFdSRl4muYt_QnC9J210sWLEIRVIOZcBSFin0-SpwiRqm3hJAo8s4LYsVwBu27Pe4svBvETYhjlR4p_D-TgxRywFzlycO0 Oct 04 18:29:37.368016 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:29:37.368016 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:29:37.368016 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:29:37.368016 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:29:37.368016 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:29:37.368016 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:29:37.368016 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 82ea9489e4a141bdb8eaa55993bd41fe Oct 04 18:29:37.368016 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1850710304 Oct 04 18:29:37.368016 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member,admin Oct 04 18:29:37.368016 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member,admin Oct 04 18:29:37.369333 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/82ea9489e4a141bdb8eaa55993bd41fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_82ea9489e4a141bdb8eaa55993bd41fe", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/82ea9489e4a141bdb8eaa55993bd41fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/82ea9489e4a141bdb8eaa55993bd41fe"}]}] Oct 04 18:29:37.369333 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1850710304 Oct 04 18:29:37.369333 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 82ea9489e4a141bdb8eaa55993bd41fe Oct 04 18:29:37.369333 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1850710304 Oct 04 18:29:37.369333 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ServersAdminNegativeTestJSON-1850710304-project-admin Oct 04 18:29:37.369333 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:29:37.369333 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:29:37.369333 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: bde6b8bcf3c242f194926a7d830b5ad1 Oct 04 18:29:37.369333 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1850710304-project-admin Oct 04 18:29:37.369333 n-d-850501-14 devstack@n-api.service[123001]: Oct 04 18:29:37.369333 n-d-850501-14 devstack@n-api.service[123001]: {"migrate": {}} Oct 04 18:29:37.369333 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:29:37.369333 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance ae333d2e-b0bb-46a7-a591-72af69adef8b could not be found. Oct 04 18:29:37.370229 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': 'ae333d2e-b0bb-46a7-a591-72af69adef8b', 'body': {'migrate': {}}} Oct 04 18:29:37.370229 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:29:37.370229 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:29:37.370229 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:29:37.370229 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:29:37.370229 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:29:37.370229 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:29:37.370229 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:29:37.370229 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:29:37.370229 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae333d2e-b0bb-46a7-a591-72af69adef8b could not be found. Oct 04 18:29:37.370229 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:29:37.370229 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:29:37.370229 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:29:37.370229 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:29:37.370229 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:29:37.370229 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:29:37.370229 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:29:37.370229 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:29:37.370229 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:29:37.370229 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:29:37.371392 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:29:37.371392 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:29:37.371392 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Oct 04 18:29:37.371392 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Oct 04 18:29:37.371392 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:29:37.371392 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:29:37.371392 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae333d2e-b0bb-46a7-a591-72af69adef8b could not be found. Oct 04 18:29:37.371392 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:29:37.371392 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:29:37.371392 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:29:37.371392 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:29:37.371392 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:29:37.371392 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:29:37.371392 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:29:37.371392 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:29:37.371392 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae333d2e-b0bb-46a7-a591-72af69adef8b could not be found. Oct 04 18:29:37.371392 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:29:37.372431 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b8843b12-7dcb-47bb-b485-edfab721b41d tempest-ServersAdminNegativeTestJSON-1850710304 tempest-ServersAdminNegativeTestJSON-1850710304-project-admin] Returning 404 to user: Instance ae333d2e-b0bb-46a7-a591-72af69adef8b could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:29:37.372431 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b8843b12-7dcb-47bb-b485-edfab721b41d tempest-ServersAdminNegativeTestJSON-1850710304 tempest-ServersAdminNegativeTestJSON-1850710304-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/ae333d2e-b0bb-46a7-a591-72af69adef8b/action" status: 404 len: 111 microversion: 2.1 time: 0.181030 Oct 04 18:29:37.378029 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 277/518] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:29:37 2022] POST /compute/v2.1/servers/ae333d2e-b0bb-46a7-a591-72af69adef8b/action => generated 111 bytes in 196 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:29:37.550912 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3e9131d3-3488-4032-8f8b-34ead270119e tempest-FloatingIPsTestJSON-1589412063 tempest-FloatingIPsTestJSON-1589412063-project] 10.222.0.20 "GET /compute/v2.1/os-floating-ips/3b714bcf-a1d5-4c29-a90c-9b34a672a199" status: 200 len: 142 microversion: 2.1 time: 0.483774 Oct 04 18:29:37.552616 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 242/519] 10.222.0.20 () {58 vars in 1260 bytes} [Tue Oct 4 18:29:37 2022] GET /compute/v2.1/os-floating-ips/3b714bcf-a1d5-4c29-a90c-9b34a672a199 => generated 142 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:29:37.558892 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f1628525-9281-4c87-9876-ab3297a40136 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:37.559538 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f1628525-9281-4c87-9876-ab3297a40136 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: d5e996e9-dc9f-46e3-8469-e46dc2932b24] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:37.657659 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-fe904baf-0077-41ee-b03f-3b33203e1e86 tempest-HypervisorAdminNegativeUnderV252Test-199103995 tempest-HypervisorAdminNegativeUnderV252Test-199103995-project] Calling method '.version_select at 0x7fe2595e3d30>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:37.659637 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-fe904baf-0077-41ee-b03f-3b33203e1e86 tempest-HypervisorAdminNegativeUnderV252Test-199103995 tempest-HypervisorAdminNegativeUnderV252Test-199103995-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '0deab67dd92a42258992adc99a9b6153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5c9b0d73cd45248346407e6cd0af27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:37.661887 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-fe904baf-0077-41ee-b03f-3b33203e1e86 tempest-HypervisorAdminNegativeUnderV252Test-199103995 tempest-HypervisorAdminNegativeUnderV252Test-199103995-project] Request method failure captured: Oct 04 18:29:37.661887 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/os-hypervisors/n-h1-850501-14/search HTTP/1.1 Oct 04 18:29:37.661887 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:29:37.661887 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:29:37.661887 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:29:37.661887 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:29:37.661887 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:29:37.661887 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:29:37.661887 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:29:37.661887 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:29:37.661887 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPHuNFWCLkYnvH8ySZigy7aizWZ2OXldVgJpOsqIRwA431RY8J3g4B2SbNsvYs0Z7831XMGJdaO6QCVB8HUrYgVzaWTCd7fmWHfNxwgQKwdICM4DktdqmvZus0Or6x25wIiU6rX60sNpiBQ5lXsGiRLCjMPZ2drKCVJs4axnoqKwqiQc Oct 04 18:29:37.661887 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:29:37.661887 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:29:37.661887 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:29:37.661887 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:29:37.661887 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:29:37.661887 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:29:37.661887 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: ce5c9b0d73cd45248346407e6cd0af27 Oct 04 18:29:37.661887 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-199103995 Oct 04 18:29:37.661887 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:29:37.661887 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:29:37.663188 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ce5c9b0d73cd45248346407e6cd0af27"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ce5c9b0d73cd45248346407e6cd0af27", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ce5c9b0d73cd45248346407e6cd0af27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ce5c9b0d73cd45248346407e6cd0af27"}]}] Oct 04 18:29:37.663188 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-199103995 Oct 04 18:29:37.663188 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: ce5c9b0d73cd45248346407e6cd0af27 Oct 04 18:29:37.663188 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-199103995 Oct 04 18:29:37.663188 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-199103995-project Oct 04 18:29:37.663188 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:29:37.663188 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:29:37.663188 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 0deab67dd92a42258992adc99a9b6153 Oct 04 18:29:37.663188 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-199103995-project Oct 04 18:29:37.663188 n-d-850501-14 devstack@n-api.service[123001]: method: Oct 04 18:29:37.663188 n-d-850501-14 devstack@n-api.service[123001]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 04 18:29:37.663188 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': 'n-h1-850501-14'} Oct 04 18:29:37.664025 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:29:37.664025 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:29:37.664025 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:29:37.664025 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:29:37.664025 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:29:37.664025 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:29:37.664025 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:29:37.664025 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:29:37.664025 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:29:37.664025 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:29:37.664025 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Oct 04 18:29:37.664025 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Oct 04 18:29:37.664025 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:29:37.664025 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:29:37.664025 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:29:37.664025 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:29:37.664025 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:29:37.664025 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:29:37.664025 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:29:37.680791 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:29:37.680791 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:29:37.680791 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:29:37.680791 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:29:37.680791 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:29:37.680791 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:29:37.680791 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:29:37.680791 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 04 18:29:37.680791 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:29:37.680791 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:29:37.680791 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:29:37.680791 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:29:37.680791 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:29:37.680791 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:29:37.680791 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:29:37.680791 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:29:37.680791 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 04 18:29:37.680791 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:29:37.682261 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-fe904baf-0077-41ee-b03f-3b33203e1e86 tempest-HypervisorAdminNegativeUnderV252Test-199103995 tempest-HypervisorAdminNegativeUnderV252Test-199103995-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:29:37.682577 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f1628525-9281-4c87-9876-ab3297a40136 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:37.682955 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-fe904baf-0077-41ee-b03f-3b33203e1e86 tempest-HypervisorAdminNegativeUnderV252Test-199103995 tempest-HypervisorAdminNegativeUnderV252Test-199103995-project] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/n-h1-850501-14/search" status: 403 len: 117 microversion: 2.1 time: 0.284427 Oct 04 18:29:37.682955 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 278/520] 10.222.0.20 () {58 vars in 1212 bytes} [Tue Oct 4 18:29:37 2022] GET /compute/v2.1/os-hypervisors/n-h1-850501-14/search => generated 117 bytes in 304 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:29:37.689321 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f1628525-9281-4c87-9876-ab3297a40136 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e996e9-dc9f-46e3-8469-e46dc2932b24" status: 200 len: 1219 microversion: 2.1 time: 0.135481 Oct 04 18:29:37.693842 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 243/521] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:37 2022] GET /compute/v2.1/servers/d5e996e9-dc9f-46e3-8469-e46dc2932b24 => generated 1219 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:37.701420 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8e52fb21-73c1-406a-9a79-a6cc73b9f967 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:37.702072 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8e52fb21-73c1-406a-9a79-a6cc73b9f967 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] [instance: 0c7c7ab7-7cd4-440c-b356-b02e2ce3b999] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:37.704205 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d0516470-6a28-451e-af6c-d4af17e2969e tempest-FloatingIPsTestJSON-1589412063 tempest-FloatingIPsTestJSON-1589412063-project] Calling method '.version_select at 0x7fe2596eb550>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:37.716722 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8e52fb21-73c1-406a-9a79-a6cc73b9f967 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:37.717223 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8e52fb21-73c1-406a-9a79-a6cc73b9f967 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:37.720671 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8e52fb21-73c1-406a-9a79-a6cc73b9f967 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:37.721712 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8e52fb21-73c1-406a-9a79-a6cc73b9f967 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:37.722204 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8e52fb21-73c1-406a-9a79-a6cc73b9f967 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:37.722671 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8e52fb21-73c1-406a-9a79-a6cc73b9f967 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:37.988190 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=4 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:38.229187 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8e52fb21-73c1-406a-9a79-a6cc73b9f967 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20cc2be1195747a4a363f0e490670d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f90e4ecf4d440229cafe5c25ec6df81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:38.235774 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=100 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:38.240314 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8e52fb21-73c1-406a-9a79-a6cc73b9f967 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] 10.222.0.20 "GET /compute/v2.1/servers/0c7c7ab7-7cd4-440c-b356-b02e2ce3b999" status: 200 len: 1323 microversion: 2.1 time: 0.556465 Oct 04 18:29:38.240901 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 279/522] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:37 2022] GET /compute/v2.1/servers/0c7c7ab7-7cd4-440c-b356-b02e2ce3b999 => generated 1323 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:38.251344 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-54c8fa71-4f75-4654-bd5c-da1910440477 tempest-HypervisorAdminNegativeUnderV252Test-1426425021 tempest-HypervisorAdminNegativeUnderV252Test-1426425021-project-admin] Calling method '.version_select at 0x7fe2595e3790>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:38.261966 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-54c8fa71-4f75-4654-bd5c-da1910440477 tempest-HypervisorAdminNegativeUnderV252Test-1426425021 tempest-HypervisorAdminNegativeUnderV252Test-1426425021-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:38.262700 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-54c8fa71-4f75-4654-bd5c-da1910440477 tempest-HypervisorAdminNegativeUnderV252Test-1426425021 tempest-HypervisorAdminNegativeUnderV252Test-1426425021-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:38.263148 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-54c8fa71-4f75-4654-bd5c-da1910440477 tempest-HypervisorAdminNegativeUnderV252Test-1426425021 tempest-HypervisorAdminNegativeUnderV252Test-1426425021-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:38.270193 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d0516470-6a28-451e-af6c-d4af17e2969e tempest-FloatingIPsTestJSON-1589412063 tempest-FloatingIPsTestJSON-1589412063-project] 10.222.0.20 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.575204 Oct 04 18:29:38.270509 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-54c8fa71-4f75-4654-bd5c-da1910440477 tempest-HypervisorAdminNegativeUnderV252Test-1426425021 tempest-HypervisorAdminNegativeUnderV252Test-1426425021-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 04 18:29:38.271054 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 244/523] 10.222.0.20 () {58 vars in 1149 bytes} [Tue Oct 4 18:29:37 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:29:38.280873 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-54c8fa71-4f75-4654-bd5c-da1910440477 tempest-HypervisorAdminNegativeUnderV252Test-1426425021 tempest-HypervisorAdminNegativeUnderV252Test-1426425021-project-admin] Request method failure captured: Oct 04 18:29:38.280873 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Oct 04 18:29:38.280873 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:29:38.280873 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:29:38.280873 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:29:38.280873 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:29:38.280873 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:29:38.280873 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:29:38.280873 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:29:38.280873 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:29:38.280873 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPHuOomA5-S2zzEIKq5OEoPaWTMXBVY9IIMt71Y3wAQre0eHBxLdrzSWboxrSEM2HHj3hzm2KJIdDv8sNz5dS2ioR9ReXmdmNhW9EGwxJYYA1nlA0jZQ6tQFL9lbwk-Gp8dZGDohFKE1msgZVoXpYQ5ccebiJ8zKUHGetKKbNndgVumw Oct 04 18:29:38.280873 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:29:38.280873 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:29:38.280873 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:29:38.280873 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:29:38.280873 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:29:38.280873 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:29:38.280873 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: ce74603751dc4c02b1ff7ee03c2d0d1e Oct 04 18:29:38.280873 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1426425021 Oct 04 18:29:38.280873 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member,admin Oct 04 18:29:38.280873 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member,admin Oct 04 18:29:38.282148 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ce74603751dc4c02b1ff7ee03c2d0d1e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ce74603751dc4c02b1ff7ee03c2d0d1e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ce74603751dc4c02b1ff7ee03c2d0d1e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ce74603751dc4c02b1ff7ee03c2d0d1e"}]}] Oct 04 18:29:38.282148 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1426425021 Oct 04 18:29:38.282148 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: ce74603751dc4c02b1ff7ee03c2d0d1e Oct 04 18:29:38.282148 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1426425021 Oct 04 18:29:38.282148 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1426425021-project-admin Oct 04 18:29:38.282148 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:29:38.282148 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:29:38.282148 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 7238992720c44cf0b2c9b17e7d83813d Oct 04 18:29:38.282148 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1426425021-project-admin Oct 04 18:29:38.282148 n-d-850501-14 devstack@n-api.service[123001]: method: Oct 04 18:29:38.282148 n-d-850501-14 devstack@n-api.service[123001]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 04 18:29:38.282148 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': 'nonexistent_hypervisor_name'} Oct 04 18:29:38.283100 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:29:38.283100 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:29:38.283100 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:29:38.283100 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:29:38.283100 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:29:38.283100 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:29:38.283100 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:29:38.283100 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:29:38.283100 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:29:38.283100 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:29:38.283100 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Oct 04 18:29:38.283100 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 04 18:29:38.283100 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 04 18:29:38.283100 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 18:29:38.283100 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 04 18:29:38.283100 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:29:38.283100 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:29:38.283100 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:29:38.283100 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:29:38.283100 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:29:38.284410 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:29:38.284410 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:29:38.284410 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:29:38.284410 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 04 18:29:38.284410 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:29:38.284715 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2e64f129-faab-43a8-b256-cfb1f8e47fca tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-531979405", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:38.286088 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-54c8fa71-4f75-4654-bd5c-da1910440477 tempest-HypervisorAdminNegativeUnderV252Test-1426425021 tempest-HypervisorAdminNegativeUnderV252Test-1426425021-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:29:38.287473 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-54c8fa71-4f75-4654-bd5c-da1910440477 tempest-HypervisorAdminNegativeUnderV252Test-1426425021 tempest-HypervisorAdminNegativeUnderV252Test-1426425021-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.042259 Oct 04 18:29:38.288559 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 280/524] 10.222.0.20 () {58 vars in 1251 bytes} [Tue Oct 4 18:29:38 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:29:38.297820 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6c5e8f8b-1604-4856-8d44-6a53054981c5 tempest-FloatingIPsTestJSON-1589412063 tempest-FloatingIPsTestJSON-1589412063-project] Calling method '.version_select at 0x7fe2594ce310>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:38.415559 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-2e64f129-faab-43a8-b256-cfb1f8e47fca tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] validate_networks() for None {{(pid=123002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:29:39.390883 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-2e64f129-faab-43a8-b256-cfb1f8e47fca tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:29:39.390883 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-2e64f129-faab-43a8-b256-cfb1f8e47fca tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:29:39.390883 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-2e64f129-faab-43a8-b256-cfb1f8e47fca tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:29:39.390883 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-2e64f129-faab-43a8-b256-cfb1f8e47fca tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:29:39.390883 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-2e64f129-faab-43a8-b256-cfb1f8e47fca tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:29:39.400155 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e64f129-faab-43a8-b256-cfb1f8e47fca tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:39.400652 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e64f129-faab-43a8-b256-cfb1f8e47fca tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:39.401094 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e64f129-faab-43a8-b256-cfb1f8e47fca tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:39.401831 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e64f129-faab-43a8-b256-cfb1f8e47fca tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:39.402298 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e64f129-faab-43a8-b256-cfb1f8e47fca tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:39.402741 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e64f129-faab-43a8-b256-cfb1f8e47fca tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:39.454126 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-2e64f129-faab-43a8-b256-cfb1f8e47fca tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Getting quotas for project 375d02476ed240ea967eb2e28e8474ab. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:29:39.469031 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-2e64f129-faab-43a8-b256-cfb1f8e47fca tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Getting quotas for user 3c11a7c3cec94797b639e6e53dcbfb20 and project 375d02476ed240ea967eb2e28e8474ab. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:29:39.483001 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2e64f129-faab-43a8-b256-cfb1f8e47fca tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Going to run 1 instances... {{(pid=123002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:29:39.485574 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2e64f129-faab-43a8-b256-cfb1f8e47fca tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] [instance: 49d830ea-1eab-4d6b-b571-4aa5434d897e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:29:39.639469 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2e64f129-faab-43a8-b256-cfb1f8e47fca tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.367253 Oct 04 18:29:39.640484 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 245/525] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:29:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1369 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:29:39.650505 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a9d6524a-2fbe-46c5-804a-33beb7743d3c tempest-HypervisorAdminNegativeUnderV252Test-1426425021 tempest-HypervisorAdminNegativeUnderV252Test-1426425021-project-admin] Calling method '.version_select at 0x7fe259751ee0>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:39.655235 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a9d6524a-2fbe-46c5-804a-33beb7743d3c tempest-HypervisorAdminNegativeUnderV252Test-1426425021 tempest-HypervisorAdminNegativeUnderV252Test-1426425021-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:39.655755 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a9d6524a-2fbe-46c5-804a-33beb7743d3c tempest-HypervisorAdminNegativeUnderV252Test-1426425021 tempest-HypervisorAdminNegativeUnderV252Test-1426425021-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:39.656703 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a9d6524a-2fbe-46c5-804a-33beb7743d3c tempest-HypervisorAdminNegativeUnderV252Test-1426425021 tempest-HypervisorAdminNegativeUnderV252Test-1426425021-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:39.718661 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a9d6524a-2fbe-46c5-804a-33beb7743d3c tempest-HypervisorAdminNegativeUnderV252Test-1426425021 tempest-HypervisorAdminNegativeUnderV252Test-1426425021-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:39.719849 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a9d6524a-2fbe-46c5-804a-33beb7743d3c tempest-HypervisorAdminNegativeUnderV252Test-1426425021 tempest-HypervisorAdminNegativeUnderV252Test-1426425021-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:39.720485 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a9d6524a-2fbe-46c5-804a-33beb7743d3c tempest-HypervisorAdminNegativeUnderV252Test-1426425021 tempest-HypervisorAdminNegativeUnderV252Test-1426425021-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:39.735656 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=100 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:39.752524 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a9d6524a-2fbe-46c5-804a-33beb7743d3c tempest-HypervisorAdminNegativeUnderV252Test-1426425021 tempest-HypervisorAdminNegativeUnderV252Test-1426425021-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:39.753281 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a9d6524a-2fbe-46c5-804a-33beb7743d3c tempest-HypervisorAdminNegativeUnderV252Test-1426425021 tempest-HypervisorAdminNegativeUnderV252Test-1426425021-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:39.753882 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a9d6524a-2fbe-46c5-804a-33beb7743d3c tempest-HypervisorAdminNegativeUnderV252Test-1426425021 tempest-HypervisorAdminNegativeUnderV252Test-1426425021-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:39.777816 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a9d6524a-2fbe-46c5-804a-33beb7743d3c tempest-HypervisorAdminNegativeUnderV252Test-1426425021 tempest-HypervisorAdminNegativeUnderV252Test-1426425021-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.136170 Oct 04 18:29:39.779108 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 246/526] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Oct 4 18:29:39 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:29:39.796900 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7d4e4869-997a-4d45-9ef4-025b734a6814 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:39.797505 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7d4e4869-997a-4d45-9ef4-025b734a6814 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: d5e996e9-dc9f-46e3-8469-e46dc2932b24] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:39.814251 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7d4e4869-997a-4d45-9ef4-025b734a6814 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:39.816095 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7d4e4869-997a-4d45-9ef4-025b734a6814 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:39.817279 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7d4e4869-997a-4d45-9ef4-025b734a6814 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:39.817997 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7d4e4869-997a-4d45-9ef4-025b734a6814 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:39.818451 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7d4e4869-997a-4d45-9ef4-025b734a6814 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:39.822891 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7d4e4869-997a-4d45-9ef4-025b734a6814 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:39.945486 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7d4e4869-997a-4d45-9ef4-025b734a6814 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:39.956170 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7d4e4869-997a-4d45-9ef4-025b734a6814 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e996e9-dc9f-46e3-8469-e46dc2932b24" status: 200 len: 1271 microversion: 2.1 time: 0.175469 Oct 04 18:29:39.956847 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 247/527] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:39 2022] GET /compute/v2.1/servers/d5e996e9-dc9f-46e3-8469-e46dc2932b24 => generated 1271 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:39.980024 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f1e5c1f1-c71e-40f9-9386-2a56474ddf06 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:39.981047 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f1e5c1f1-c71e-40f9-9386-2a56474ddf06 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] [instance: 0c7c7ab7-7cd4-440c-b356-b02e2ce3b999] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:39.994698 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f1e5c1f1-c71e-40f9-9386-2a56474ddf06 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:39.995397 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f1e5c1f1-c71e-40f9-9386-2a56474ddf06 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:40.000590 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f1e5c1f1-c71e-40f9-9386-2a56474ddf06 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:40.001857 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f1e5c1f1-c71e-40f9-9386-2a56474ddf06 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:40.002604 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f1e5c1f1-c71e-40f9-9386-2a56474ddf06 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:40.003240 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f1e5c1f1-c71e-40f9-9386-2a56474ddf06 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:40.275100 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6c5e8f8b-1604-4856-8d44-6a53054981c5 tempest-FloatingIPsTestJSON-1589412063 tempest-FloatingIPsTestJSON-1589412063-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/3b714bcf-a1d5-4c29-a90c-9b34a672a199" status: 202 len: 0 microversion: 2.1 time: 1.960373 Oct 04 18:29:40.275100 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 281/528] 10.222.0.20 () {58 vars in 1263 bytes} [Tue Oct 4 18:29:38 2022] DELETE /compute/v2.1/os-floating-ips/3b714bcf-a1d5-4c29-a90c-9b34a672a199 => generated 0 bytes in 1962 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:29:40.275100 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-358b2d62-db43-41f7-ac03-99ae4e1fff51 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:40.275100 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-358b2d62-db43-41f7-ac03-99ae4e1fff51 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] [instance: 49d830ea-1eab-4d6b-b571-4aa5434d897e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:40.395001 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-358b2d62-db43-41f7-ac03-99ae4e1fff51 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c11a7c3cec94797b639e6e53dcbfb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375d02476ed240ea967eb2e28e8474ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:40.396783 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=76 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:40.396912 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f1e5c1f1-c71e-40f9-9386-2a56474ddf06 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20cc2be1195747a4a363f0e490670d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f90e4ecf4d440229cafe5c25ec6df81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:40.405266 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f1e5c1f1-c71e-40f9-9386-2a56474ddf06 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] 10.222.0.20 "GET /compute/v2.1/servers/0c7c7ab7-7cd4-440c-b356-b02e2ce3b999" status: 200 len: 1323 microversion: 2.1 time: 0.447112 Oct 04 18:29:40.405840 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 248/529] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:39 2022] GET /compute/v2.1/servers/0c7c7ab7-7cd4-440c-b356-b02e2ce3b999 => generated 1323 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:40.406232 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-358b2d62-db43-41f7-ac03-99ae4e1fff51 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] 10.222.0.20 "GET /compute/v2.1/servers/49d830ea-1eab-4d6b-b571-4aa5434d897e" status: 200 len: 1221 microversion: 2.1 time: 0.146088 Oct 04 18:29:40.420079 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 282/530] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:40 2022] GET /compute/v2.1/servers/49d830ea-1eab-4d6b-b571-4aa5434d897e => generated 1221 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:40.426008 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2a3e3c88-fdd6-4c38-ae95-ba7afa42be57 tempest-HypervisorAdminNegativeUnderV252Test-199103995 tempest-HypervisorAdminNegativeUnderV252Test-199103995-project] Calling method '.version_select at 0x7fe2594ce040>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:40.427307 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-2a3e3c88-fdd6-4c38-ae95-ba7afa42be57 tempest-HypervisorAdminNegativeUnderV252Test-199103995 tempest-HypervisorAdminNegativeUnderV252Test-199103995-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '0deab67dd92a42258992adc99a9b6153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5c9b0d73cd45248346407e6cd0af27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:40.428495 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-118687e6-e27c-4f4f-8ceb-38738d26ef19 tempest-FloatingIPsTestJSON-1589412063 tempest-FloatingIPsTestJSON-1589412063-project] Action: 'create', calling method: .version_select at 0x7fe2597083a0>, body: {"pool": null} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:40.431038 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2a3e3c88-fdd6-4c38-ae95-ba7afa42be57 tempest-HypervisorAdminNegativeUnderV252Test-199103995 tempest-HypervisorAdminNegativeUnderV252Test-199103995-project] Request method failure captured: Oct 04 18:29:40.431038 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Oct 04 18:29:40.431038 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:29:40.431038 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:29:40.431038 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:29:40.431038 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:29:40.431038 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:29:40.431038 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:29:40.431038 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:29:40.431038 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:29:40.431038 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPHuNFWCLkYnvH8ySZigy7aizWZ2OXldVgJpOsqIRwA431RY8J3g4B2SbNsvYs0Z7831XMGJdaO6QCVB8HUrYgVzaWTCd7fmWHfNxwgQKwdICM4DktdqmvZus0Or6x25wIiU6rX60sNpiBQ5lXsGiRLCjMPZ2drKCVJs4axnoqKwqiQc Oct 04 18:29:40.431038 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:29:40.431038 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:29:40.431038 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:29:40.431038 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:29:40.431038 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:29:40.431038 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:29:40.431038 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: ce5c9b0d73cd45248346407e6cd0af27 Oct 04 18:29:40.431038 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-199103995 Oct 04 18:29:40.431038 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:29:40.431038 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:29:40.432582 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ce5c9b0d73cd45248346407e6cd0af27"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ce5c9b0d73cd45248346407e6cd0af27", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ce5c9b0d73cd45248346407e6cd0af27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ce5c9b0d73cd45248346407e6cd0af27"}]}] Oct 04 18:29:40.432582 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-199103995 Oct 04 18:29:40.432582 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: ce5c9b0d73cd45248346407e6cd0af27 Oct 04 18:29:40.432582 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-199103995 Oct 04 18:29:40.432582 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-199103995-project Oct 04 18:29:40.432582 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:29:40.432582 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:29:40.432582 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 0deab67dd92a42258992adc99a9b6153 Oct 04 18:29:40.432582 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-199103995-project Oct 04 18:29:40.432582 n-d-850501-14 devstack@n-api.service[123001]: method: Oct 04 18:29:40.432582 n-d-850501-14 devstack@n-api.service[123001]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 04 18:29:40.432582 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '1'} Oct 04 18:29:40.433454 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:29:40.433454 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:29:40.433454 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:29:40.433454 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:29:40.433454 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:29:40.433454 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:29:40.433454 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:29:40.433454 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:29:40.433454 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:29:40.433454 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:29:40.433454 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Oct 04 18:29:40.433454 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Oct 04 18:29:40.433454 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:29:40.433454 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:29:40.433454 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:29:40.433454 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:29:40.433454 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:29:40.433454 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:29:40.433454 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:29:40.434783 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:29:40.434783 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:29:40.434783 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:29:40.434783 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:29:40.434783 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:29:40.434783 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:29:40.434783 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:29:40.434783 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 04 18:29:40.434783 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:29:40.434783 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:29:40.434783 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:29:40.434783 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:29:40.434783 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:29:40.434783 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:29:40.434783 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:29:40.434783 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:29:40.434783 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 04 18:29:40.434783 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:29:40.435859 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2a3e3c88-fdd6-4c38-ae95-ba7afa42be57 tempest-HypervisorAdminNegativeUnderV252Test-199103995 tempest-HypervisorAdminNegativeUnderV252Test-199103995-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:29:40.435859 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2a3e3c88-fdd6-4c38-ae95-ba7afa42be57 tempest-HypervisorAdminNegativeUnderV252Test-199103995 tempest-HypervisorAdminNegativeUnderV252Test-199103995-project] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.023799 Oct 04 18:29:40.435991 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 283/531] 10.222.0.20 () {58 vars in 1176 bytes} [Tue Oct 4 18:29:40 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:29:40.449802 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-23e7ab86-deed-4369-aa6a-57375af1e737 tempest-HypervisorAdminNegativeUnderV252Test-1426425021 tempest-HypervisorAdminNegativeUnderV252Test-1426425021-project-admin] Calling method '.version_select at 0x7fe2595e3310>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:40.454142 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-23e7ab86-deed-4369-aa6a-57375af1e737 tempest-HypervisorAdminNegativeUnderV252Test-1426425021 tempest-HypervisorAdminNegativeUnderV252Test-1426425021-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:40.458061 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-23e7ab86-deed-4369-aa6a-57375af1e737 tempest-HypervisorAdminNegativeUnderV252Test-1426425021 tempest-HypervisorAdminNegativeUnderV252Test-1426425021-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:40.458061 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-23e7ab86-deed-4369-aa6a-57375af1e737 tempest-HypervisorAdminNegativeUnderV252Test-1426425021 tempest-HypervisorAdminNegativeUnderV252Test-1426425021-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:40.466285 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-23e7ab86-deed-4369-aa6a-57375af1e737 tempest-HypervisorAdminNegativeUnderV252Test-1426425021 tempest-HypervisorAdminNegativeUnderV252Test-1426425021-project-admin] HTTP exception thrown: No hypervisor matching '09c7940d-caa8-4af3-99d9-bdf6bc420dee' could be found. Oct 04 18:29:40.467969 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-23e7ab86-deed-4369-aa6a-57375af1e737 tempest-HypervisorAdminNegativeUnderV252Test-1426425021 tempest-HypervisorAdminNegativeUnderV252Test-1426425021-project-admin] Request method failure captured: Oct 04 18:29:40.467969 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/os-hypervisors/09c7940d-caa8-4af3-99d9-bdf6bc420dee/servers HTTP/1.1 Oct 04 18:29:40.467969 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:29:40.467969 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:29:40.467969 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:29:40.467969 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:29:40.467969 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:29:40.467969 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:29:40.467969 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:29:40.467969 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:29:40.467969 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPHuOomA5-S2zzEIKq5OEoPaWTMXBVY9IIMt71Y3wAQre0eHBxLdrzSWboxrSEM2HHj3hzm2KJIdDv8sNz5dS2ioR9ReXmdmNhW9EGwxJYYA1nlA0jZQ6tQFL9lbwk-Gp8dZGDohFKE1msgZVoXpYQ5ccebiJ8zKUHGetKKbNndgVumw Oct 04 18:29:40.467969 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:29:40.467969 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:29:40.467969 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:29:40.467969 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:29:40.467969 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:29:40.467969 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:29:40.467969 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: ce74603751dc4c02b1ff7ee03c2d0d1e Oct 04 18:29:40.467969 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1426425021 Oct 04 18:29:40.467969 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member,admin Oct 04 18:29:40.467969 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member,admin Oct 04 18:29:40.469689 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ce74603751dc4c02b1ff7ee03c2d0d1e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ce74603751dc4c02b1ff7ee03c2d0d1e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ce74603751dc4c02b1ff7ee03c2d0d1e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ce74603751dc4c02b1ff7ee03c2d0d1e"}]}] Oct 04 18:29:40.469689 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1426425021 Oct 04 18:29:40.469689 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: ce74603751dc4c02b1ff7ee03c2d0d1e Oct 04 18:29:40.469689 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1426425021 Oct 04 18:29:40.469689 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1426425021-project-admin Oct 04 18:29:40.469689 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:29:40.469689 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:29:40.469689 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 7238992720c44cf0b2c9b17e7d83813d Oct 04 18:29:40.469689 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1426425021-project-admin Oct 04 18:29:40.469689 n-d-850501-14 devstack@n-api.service[123001]: method: Oct 04 18:29:40.469689 n-d-850501-14 devstack@n-api.service[123001]: exception: No hypervisor matching '09c7940d-caa8-4af3-99d9-bdf6bc420dee' could be found. Oct 04 18:29:40.469689 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '09c7940d-caa8-4af3-99d9-bdf6bc420dee'} Oct 04 18:29:40.470482 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:29:40.470482 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:29:40.470482 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:29:40.470482 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:29:40.470482 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:29:40.470482 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:29:40.470482 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:29:40.470482 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:29:40.470482 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:29:40.470482 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:29:40.470482 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Oct 04 18:29:40.470482 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 04 18:29:40.470482 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 04 18:29:40.470482 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 18:29:40.470482 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '09c7940d-caa8-4af3-99d9-bdf6bc420dee' could be found. Oct 04 18:29:40.470482 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:29:40.470482 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:29:40.470482 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:29:40.470482 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:29:40.471898 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:29:40.471898 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:29:40.471898 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:29:40.471898 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:29:40.471898 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '09c7940d-caa8-4af3-99d9-bdf6bc420dee' could be found. Oct 04 18:29:40.471898 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:29:40.473551 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-23e7ab86-deed-4369-aa6a-57375af1e737 tempest-HypervisorAdminNegativeUnderV252Test-1426425021 tempest-HypervisorAdminNegativeUnderV252Test-1426425021-project-admin] Returning 404 to user: No hypervisor matching '09c7940d-caa8-4af3-99d9-bdf6bc420dee' could be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:29:40.474570 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-23e7ab86-deed-4369-aa6a-57375af1e737 tempest-HypervisorAdminNegativeUnderV252Test-1426425021 tempest-HypervisorAdminNegativeUnderV252Test-1426425021-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/09c7940d-caa8-4af3-99d9-bdf6bc420dee/servers" status: 404 len: 123 microversion: 2.1 time: 0.034454 Oct 04 18:29:40.475661 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 284/532] 10.222.0.20 () {58 vars in 1281 bytes} [Tue Oct 4 18:29:40 2022] GET /compute/v2.1/os-hypervisors/09c7940d-caa8-4af3-99d9-bdf6bc420dee/servers => generated 123 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:29:40.985260 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7e0d0548-96c1-4c08-89af-3c3a71ade78c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:40.986105 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7e0d0548-96c1-4c08-89af-3c3a71ade78c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: d5e996e9-dc9f-46e3-8469-e46dc2932b24] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:41.006543 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7e0d0548-96c1-4c08-89af-3c3a71ade78c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:41.007045 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7e0d0548-96c1-4c08-89af-3c3a71ade78c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:41.010611 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7e0d0548-96c1-4c08-89af-3c3a71ade78c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:41.011618 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7e0d0548-96c1-4c08-89af-3c3a71ade78c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:41.014293 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7e0d0548-96c1-4c08-89af-3c3a71ade78c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:41.014967 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7e0d0548-96c1-4c08-89af-3c3a71ade78c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:41.167060 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7e0d0548-96c1-4c08-89af-3c3a71ade78c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:41.185684 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7e0d0548-96c1-4c08-89af-3c3a71ade78c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e996e9-dc9f-46e3-8469-e46dc2932b24" status: 200 len: 1289 microversion: 2.1 time: 0.198169 Oct 04 18:29:41.186518 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 285/533] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:40 2022] GET /compute/v2.1/servers/d5e996e9-dc9f-46e3-8469-e46dc2932b24 => generated 1289 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:29:41.441222 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-fe4b3ccf-eb4e-4b4c-a91f-d646971a50b1 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:41.442771 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-fe4b3ccf-eb4e-4b4c-a91f-d646971a50b1 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] [instance: 0c7c7ab7-7cd4-440c-b356-b02e2ce3b999] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:41.462003 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fe4b3ccf-eb4e-4b4c-a91f-d646971a50b1 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:41.462003 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fe4b3ccf-eb4e-4b4c-a91f-d646971a50b1 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:41.464696 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fe4b3ccf-eb4e-4b4c-a91f-d646971a50b1 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:41.464696 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fe4b3ccf-eb4e-4b4c-a91f-d646971a50b1 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:41.472701 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fe4b3ccf-eb4e-4b4c-a91f-d646971a50b1 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:41.473226 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fe4b3ccf-eb4e-4b4c-a91f-d646971a50b1 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:41.886768 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-fe4b3ccf-eb4e-4b4c-a91f-d646971a50b1 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20cc2be1195747a4a363f0e490670d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f90e4ecf4d440229cafe5c25ec6df81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:41.895292 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-fe4b3ccf-eb4e-4b4c-a91f-d646971a50b1 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] 10.222.0.20 "GET /compute/v2.1/servers/0c7c7ab7-7cd4-440c-b356-b02e2ce3b999" status: 200 len: 1323 microversion: 2.1 time: 0.465876 Oct 04 18:29:41.902584 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 286/534] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:41 2022] GET /compute/v2.1/servers/0c7c7ab7-7cd4-440c-b356-b02e2ce3b999 => generated 1323 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:41.909726 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-514ae593-8b6a-4981-b1f3-4d753c545127 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:41.917100 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-514ae593-8b6a-4981-b1f3-4d753c545127 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] [instance: 49d830ea-1eab-4d6b-b571-4aa5434d897e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:41.925951 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-514ae593-8b6a-4981-b1f3-4d753c545127 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:41.938122 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-514ae593-8b6a-4981-b1f3-4d753c545127 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:41.938122 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-514ae593-8b6a-4981-b1f3-4d753c545127 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:41.938418 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-514ae593-8b6a-4981-b1f3-4d753c545127 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:41.938817 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-514ae593-8b6a-4981-b1f3-4d753c545127 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:41.939328 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-514ae593-8b6a-4981-b1f3-4d753c545127 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:42.085671 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-514ae593-8b6a-4981-b1f3-4d753c545127 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c11a7c3cec94797b639e6e53dcbfb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375d02476ed240ea967eb2e28e8474ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:42.122058 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-514ae593-8b6a-4981-b1f3-4d753c545127 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] 10.222.0.20 "GET /compute/v2.1/servers/49d830ea-1eab-4d6b-b571-4aa5434d897e" status: 200 len: 1273 microversion: 2.1 time: 0.214598 Oct 04 18:29:42.124559 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 287/535] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:41 2022] GET /compute/v2.1/servers/49d830ea-1eab-4d6b-b571-4aa5434d897e => generated 1273 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:42.218676 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-15342307-38cf-4b4e-b7bf-e90387147f60 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:42.220388 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-15342307-38cf-4b4e-b7bf-e90387147f60 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: d5e996e9-dc9f-46e3-8469-e46dc2932b24] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:42.229109 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-15342307-38cf-4b4e-b7bf-e90387147f60 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:42.229880 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-15342307-38cf-4b4e-b7bf-e90387147f60 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:42.230536 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-15342307-38cf-4b4e-b7bf-e90387147f60 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:42.231445 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-15342307-38cf-4b4e-b7bf-e90387147f60 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:42.232090 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-15342307-38cf-4b4e-b7bf-e90387147f60 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:42.232679 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-15342307-38cf-4b4e-b7bf-e90387147f60 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:42.473422 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-15342307-38cf-4b4e-b7bf-e90387147f60 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:42.494462 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-15342307-38cf-4b4e-b7bf-e90387147f60 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e996e9-dc9f-46e3-8469-e46dc2932b24" status: 200 len: 1277 microversion: 2.1 time: 0.281137 Oct 04 18:29:42.496040 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 288/536] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:42 2022] GET /compute/v2.1/servers/d5e996e9-dc9f-46e3-8469-e46dc2932b24 => generated 1277 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:43.252830 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-2938ec79-8dec-478e-987c-cc87f2d09dc0 req-1484674c-1f8e-4809-8672-c76f80ae4920 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c7c7ab7-7cd4-440c-b356-b02e2ce3b999", "name": "network-vif-plugged", "status": "completed", "tag": "f4bea2ab-fc0f-49bd-a308-f3341bcd9942"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:43.252830 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-2938ec79-8dec-478e-987c-cc87f2d09dc0 req-1484674c-1f8e-4809-8672-c76f80ae4920 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:43.252830 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-2938ec79-8dec-478e-987c-cc87f2d09dc0 req-1484674c-1f8e-4809-8672-c76f80ae4920 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:43.252830 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-2938ec79-8dec-478e-987c-cc87f2d09dc0 req-1484674c-1f8e-4809-8672-c76f80ae4920 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:43.262126 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-2938ec79-8dec-478e-987c-cc87f2d09dc0 req-1484674c-1f8e-4809-8672-c76f80ae4920 service nova] Creating event network-vif-plugged:f4bea2ab-fc0f-49bd-a308-f3341bcd9942 for instance 0c7c7ab7-7cd4-440c-b356-b02e2ce3b999 on n-h1-850501-14 Oct 04 18:29:43.262126 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-2938ec79-8dec-478e-987c-cc87f2d09dc0 req-1484674c-1f8e-4809-8672-c76f80ae4920 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045601 Oct 04 18:29:43.262126 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 289/537] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:29:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:29:43.262126 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c18888d0-161a-4ed2-a4cb-a27c9a80dbe6 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:43.262126 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c18888d0-161a-4ed2-a4cb-a27c9a80dbe6 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] [instance: 0c7c7ab7-7cd4-440c-b356-b02e2ce3b999] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:43.267502 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c18888d0-161a-4ed2-a4cb-a27c9a80dbe6 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:43.267502 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c18888d0-161a-4ed2-a4cb-a27c9a80dbe6 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:43.267502 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c18888d0-161a-4ed2-a4cb-a27c9a80dbe6 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:43.267502 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c18888d0-161a-4ed2-a4cb-a27c9a80dbe6 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:43.268442 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c18888d0-161a-4ed2-a4cb-a27c9a80dbe6 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:43.268442 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c18888d0-161a-4ed2-a4cb-a27c9a80dbe6 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:43.268442 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c18888d0-161a-4ed2-a4cb-a27c9a80dbe6 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20cc2be1195747a4a363f0e490670d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f90e4ecf4d440229cafe5c25ec6df81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:43.269015 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c18888d0-161a-4ed2-a4cb-a27c9a80dbe6 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] 10.222.0.20 "GET /compute/v2.1/servers/0c7c7ab7-7cd4-440c-b356-b02e2ce3b999" status: 200 len: 1323 microversion: 2.1 time: 0.198718 Oct 04 18:29:43.269015 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 290/538] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:42 2022] GET /compute/v2.1/servers/0c7c7ab7-7cd4-440c-b356-b02e2ce3b999 => generated 1323 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:43.269015 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9f9ff461-4ee9-4604-895c-86a3cf4b33cf tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:43.269015 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-9f9ff461-4ee9-4604-895c-86a3cf4b33cf tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] [instance: 49d830ea-1eab-4d6b-b571-4aa5434d897e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:43.269015 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9f9ff461-4ee9-4604-895c-86a3cf4b33cf tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:43.269520 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9f9ff461-4ee9-4604-895c-86a3cf4b33cf tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:43.269520 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9f9ff461-4ee9-4604-895c-86a3cf4b33cf tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:43.269520 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9f9ff461-4ee9-4604-895c-86a3cf4b33cf tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:43.269520 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9f9ff461-4ee9-4604-895c-86a3cf4b33cf tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:43.270258 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9f9ff461-4ee9-4604-895c-86a3cf4b33cf tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:43.270258 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9f9ff461-4ee9-4604-895c-86a3cf4b33cf tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c11a7c3cec94797b639e6e53dcbfb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375d02476ed240ea967eb2e28e8474ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:43.270258 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9f9ff461-4ee9-4604-895c-86a3cf4b33cf tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] 10.222.0.20 "GET /compute/v2.1/servers/49d830ea-1eab-4d6b-b571-4aa5434d897e" status: 200 len: 1273 microversion: 2.1 time: 0.089589 Oct 04 18:29:43.270258 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 291/539] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:43 2022] GET /compute/v2.1/servers/49d830ea-1eab-4d6b-b571-4aa5434d897e => generated 1273 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:29:43.518877 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f42d4915-ffc9-447f-a80e-fc7c41c22b2e tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:43.519822 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f42d4915-ffc9-447f-a80e-fc7c41c22b2e tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: d5e996e9-dc9f-46e3-8469-e46dc2932b24] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:43.527884 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f42d4915-ffc9-447f-a80e-fc7c41c22b2e tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:43.528755 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f42d4915-ffc9-447f-a80e-fc7c41c22b2e tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:43.529803 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f42d4915-ffc9-447f-a80e-fc7c41c22b2e tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:43.530697 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f42d4915-ffc9-447f-a80e-fc7c41c22b2e tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:43.531388 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f42d4915-ffc9-447f-a80e-fc7c41c22b2e tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:43.531993 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f42d4915-ffc9-447f-a80e-fc7c41c22b2e tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:43.644768 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f42d4915-ffc9-447f-a80e-fc7c41c22b2e tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:43.655633 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f42d4915-ffc9-447f-a80e-fc7c41c22b2e tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e996e9-dc9f-46e3-8469-e46dc2932b24" status: 200 len: 1277 microversion: 2.1 time: 0.140560 Oct 04 18:29:43.659587 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 292/540] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:43 2022] GET /compute/v2.1/servers/d5e996e9-dc9f-46e3-8469-e46dc2932b24 => generated 1277 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:29:43.934559 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-118687e6-e27c-4f4f-8ceb-38738d26ef19 tempest-FloatingIPsTestJSON-1589412063 tempest-FloatingIPsTestJSON-1589412063-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.512259 Oct 04 18:29:43.937105 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 249/541] 10.222.0.20 () {60 vars in 1170 bytes} [Tue Oct 4 18:29:40 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3515 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:29:43.953376 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-71b1d703-4c6b-4b87-b23c-d8c9a8611a6a tempest-FloatingIPsTestJSON-1589412063 tempest-FloatingIPsTestJSON-1589412063-project] Calling method '.version_select at 0x7fe2595dfe50>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:44.284710 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-20c7f90a-7dd4-4b21-bd6e-27884dfe15b4 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:44.285335 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-20c7f90a-7dd4-4b21-bd6e-27884dfe15b4 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] [instance: 0c7c7ab7-7cd4-440c-b356-b02e2ce3b999] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:44.295250 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-20c7f90a-7dd4-4b21-bd6e-27884dfe15b4 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:44.295751 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-20c7f90a-7dd4-4b21-bd6e-27884dfe15b4 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:44.296241 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-20c7f90a-7dd4-4b21-bd6e-27884dfe15b4 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:44.296947 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-20c7f90a-7dd4-4b21-bd6e-27884dfe15b4 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:44.297476 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-20c7f90a-7dd4-4b21-bd6e-27884dfe15b4 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:44.297845 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-20c7f90a-7dd4-4b21-bd6e-27884dfe15b4 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:44.813994 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-20c7f90a-7dd4-4b21-bd6e-27884dfe15b4 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20cc2be1195747a4a363f0e490670d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f90e4ecf4d440229cafe5c25ec6df81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:44.828095 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-20c7f90a-7dd4-4b21-bd6e-27884dfe15b4 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] 10.222.0.20 "GET /compute/v2.1/servers/0c7c7ab7-7cd4-440c-b356-b02e2ce3b999" status: 200 len: 1323 microversion: 2.1 time: 0.547038 Oct 04 18:29:44.833229 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 250/542] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:44 2022] GET /compute/v2.1/servers/0c7c7ab7-7cd4-440c-b356-b02e2ce3b999 => generated 1323 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:29:44.844463 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-21b76dcd-c36e-4688-be0e-7de3b5302e19 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:44.845079 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-21b76dcd-c36e-4688-be0e-7de3b5302e19 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] [instance: 49d830ea-1eab-4d6b-b571-4aa5434d897e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:44.853431 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-21b76dcd-c36e-4688-be0e-7de3b5302e19 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:44.853431 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-21b76dcd-c36e-4688-be0e-7de3b5302e19 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:44.854504 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-21b76dcd-c36e-4688-be0e-7de3b5302e19 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:44.855447 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-21b76dcd-c36e-4688-be0e-7de3b5302e19 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:44.856111 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-21b76dcd-c36e-4688-be0e-7de3b5302e19 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:44.856727 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-21b76dcd-c36e-4688-be0e-7de3b5302e19 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:45.088033 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-21b76dcd-c36e-4688-be0e-7de3b5302e19 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c11a7c3cec94797b639e6e53dcbfb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375d02476ed240ea967eb2e28e8474ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:45.105782 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-21b76dcd-c36e-4688-be0e-7de3b5302e19 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] 10.222.0.20 "GET /compute/v2.1/servers/49d830ea-1eab-4d6b-b571-4aa5434d897e" status: 200 len: 1279 microversion: 2.1 time: 0.271165 Oct 04 18:29:45.106662 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 251/543] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:44 2022] GET /compute/v2.1/servers/49d830ea-1eab-4d6b-b571-4aa5434d897e => generated 1279 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:45.111694 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ac0baf40-bd10-48d4-8b2a-a51a53d2b884 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:45.112618 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ac0baf40-bd10-48d4-8b2a-a51a53d2b884 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: d5e996e9-dc9f-46e3-8469-e46dc2932b24] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:45.119667 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ac0baf40-bd10-48d4-8b2a-a51a53d2b884 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:45.120422 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ac0baf40-bd10-48d4-8b2a-a51a53d2b884 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:45.121050 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ac0baf40-bd10-48d4-8b2a-a51a53d2b884 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:45.121946 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ac0baf40-bd10-48d4-8b2a-a51a53d2b884 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:45.122551 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ac0baf40-bd10-48d4-8b2a-a51a53d2b884 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:45.123126 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ac0baf40-bd10-48d4-8b2a-a51a53d2b884 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:45.618467 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ac0baf40-bd10-48d4-8b2a-a51a53d2b884 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:45.639069 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ac0baf40-bd10-48d4-8b2a-a51a53d2b884 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e996e9-dc9f-46e3-8469-e46dc2932b24" status: 200 len: 1319 microversion: 2.1 time: 0.530925 Oct 04 18:29:45.640130 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 252/544] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:45 2022] GET /compute/v2.1/servers/d5e996e9-dc9f-46e3-8469-e46dc2932b24 => generated 1319 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:45.751133 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-71b1d703-4c6b-4b87-b23c-d8c9a8611a6a tempest-FloatingIPsTestJSON-1589412063 tempest-FloatingIPsTestJSON-1589412063-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/66fb1649-4d7e-4b59-a3e4-42f4ebc10dc8" status: 202 len: 0 microversion: 2.1 time: 1.801843 Oct 04 18:29:45.752700 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 293/545] 10.222.0.20 () {58 vars in 1263 bytes} [Tue Oct 4 18:29:43 2022] DELETE /compute/v2.1/os-floating-ips/66fb1649-4d7e-4b59-a3e4-42f4ebc10dc8 => generated 0 bytes in 1804 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:29:45.761865 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4179f759-d6c4-4afe-b4c3-1b8f01098fe4 tempest-FloatingIPsTestJSON-1589412063 tempest-FloatingIPsTestJSON-1589412063-project] Calling method '.version_select at 0x7fe2597083a0>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:45.815200 n-d-850501-14 devstack@n-api.service[123002]: DEBUG neutronclient.v2_0.client [None req-4179f759-d6c4-4afe-b4c3-1b8f01098fe4 tempest-FloatingIPsTestJSON-1589412063 tempest-FloatingIPsTestJSON-1589412063-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 66fb1649-4d7e-4b59-a3e4-42f4ebc10dc8 could not be found", "detail": ""}} {{(pid=123002) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:29:45.815887 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-4179f759-d6c4-4afe-b4c3-1b8f01098fe4 tempest-FloatingIPsTestJSON-1589412063 tempest-FloatingIPsTestJSON-1589412063-project] HTTP exception thrown: Floating IP not found for ID 66fb1649-4d7e-4b59-a3e4-42f4ebc10dc8 Oct 04 18:29:45.833670 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4179f759-d6c4-4afe-b4c3-1b8f01098fe4 tempest-FloatingIPsTestJSON-1589412063 tempest-FloatingIPsTestJSON-1589412063-project] Request method failure captured: Oct 04 18:29:45.833670 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/os-floating-ips/66fb1649-4d7e-4b59-a3e4-42f4ebc10dc8 HTTP/1.1 Oct 04 18:29:45.833670 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:29:45.833670 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:29:45.833670 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:29:45.833670 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:29:45.833670 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:29:45.833670 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:29:45.833670 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:29:45.833670 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:29:45.833670 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPHuMxo-0s7wS47zgugjw-tGECYk_dwQOi-jZU7sy0yYDoTbe3eGvkYeeuEJeZ9_eJH_rK6aCV-U0t4BYhGqKYIHio-LGnacMhvwyFr_8WnYf9K5fHzOnf0wQLoCde0OpMs5LF7DM_LZfL1goSB4jtxEClMug9MHf2jHbHeovWK47e9U Oct 04 18:29:45.833670 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:29:45.833670 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:29:45.833670 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:29:45.833670 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:29:45.833670 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:29:45.833670 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:29:45.833670 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 97389e5c7f9841b085860166fb601122 Oct 04 18:29:45.833670 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-FloatingIPsTestJSON-1589412063 Oct 04 18:29:45.833670 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:29:45.833670 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:29:45.837534 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/97389e5c7f9841b085860166fb601122"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_97389e5c7f9841b085860166fb601122", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/97389e5c7f9841b085860166fb601122"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/97389e5c7f9841b085860166fb601122"}]}] Oct 04 18:29:45.837534 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-FloatingIPsTestJSON-1589412063 Oct 04 18:29:45.837534 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 97389e5c7f9841b085860166fb601122 Oct 04 18:29:45.837534 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1589412063 Oct 04 18:29:45.837534 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-FloatingIPsTestJSON-1589412063-project Oct 04 18:29:45.837534 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:29:45.837534 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:29:45.837534 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 6355be33f851453db10dd4117d385b0c Oct 04 18:29:45.837534 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-FloatingIPsTestJSON-1589412063-project Oct 04 18:29:45.837534 n-d-850501-14 devstack@n-api.service[123002]: method: Oct 04 18:29:45.837534 n-d-850501-14 devstack@n-api.service[123002]: exception: Floating IP not found for ID 66fb1649-4d7e-4b59-a3e4-42f4ebc10dc8 Oct 04 18:29:45.837534 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '66fb1649-4d7e-4b59-a3e4-42f4ebc10dc8'} Oct 04 18:29:45.837534 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:29:45.838651 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:29:45.838651 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 04 18:29:45.838651 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 04 18:29:45.838651 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:29:45.838651 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:29:45.838651 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 04 18:29:45.838651 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 04 18:29:45.838651 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:29:45.838651 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:29:45.838651 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:29:45.838651 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 18:29:45.838651 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:29:45.838651 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:29:45.838651 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:29:45.838651 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:29:45.838651 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:29:45.838651 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:29:45.838651 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:29:45.838651 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:29:45.839949 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:29:45.839949 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:29:45.839949 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:29:45.839949 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:29:45.839949 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:29:45.839949 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:29:45.839949 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 66fb1649-4d7e-4b59-a3e4-42f4ebc10dc8 could not be found Oct 04 18:29:45.839949 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7043d8c5-de9d-4bea-8e36-929ff5b5984e'] Oct 04 18:29:45.839949 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:29:45.839949 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:29:45.839949 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:29:45.839949 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:29:45.839949 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 04 18:29:45.839949 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 04 18:29:45.839949 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 04 18:29:45.839949 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 04 18:29:45.839949 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 66fb1649-4d7e-4b59-a3e4-42f4ebc10dc8. Oct 04 18:29:45.839949 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:29:45.839949 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:29:45.839949 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:29:45.841424 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:29:45.841424 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:29:45.841424 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:29:45.841424 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:29:45.841424 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:29:45.841424 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:29:45.841424 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:29:45.841424 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:29:45.841424 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:29:45.841424 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 04 18:29:45.841424 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 18:29:45.841424 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 66fb1649-4d7e-4b59-a3e4-42f4ebc10dc8 Oct 04 18:29:45.841424 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:29:45.841424 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:29:45.841424 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:29:45.841424 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:29:45.841424 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:29:45.841424 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:29:45.841424 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:29:45.841424 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:29:45.842979 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 66fb1649-4d7e-4b59-a3e4-42f4ebc10dc8 Oct 04 18:29:45.842979 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:29:45.842979 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4179f759-d6c4-4afe-b4c3-1b8f01098fe4 tempest-FloatingIPsTestJSON-1589412063 tempest-FloatingIPsTestJSON-1589412063-project] Returning 404 to user: Floating IP not found for ID 66fb1649-4d7e-4b59-a3e4-42f4ebc10dc8 {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:29:45.844530 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4179f759-d6c4-4afe-b4c3-1b8f01098fe4 tempest-FloatingIPsTestJSON-1589412063 tempest-FloatingIPsTestJSON-1589412063-project] 10.222.0.20 "GET /compute/v2.1/os-floating-ips/66fb1649-4d7e-4b59-a3e4-42f4ebc10dc8" status: 404 len: 111 microversion: 2.1 time: 0.087317 Oct 04 18:29:45.845100 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 253/546] 10.222.0.20 () {58 vars in 1260 bytes} [Tue Oct 4 18:29:45 2022] GET /compute/v2.1/os-floating-ips/66fb1649-4d7e-4b59-a3e4-42f4ebc10dc8 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:29:45.858315 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7763ba77-0526-4890-a49a-a731a56fb664 tempest-FloatingIPsTestJSON-1589412063 tempest-FloatingIPsTestJSON-1589412063-project] Calling method '.version_select at 0x7fe2595dff70>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:45.865170 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-23b82fd9-974b-4a64-82a2-22cf9e4225a7 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:45.865841 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-23b82fd9-974b-4a64-82a2-22cf9e4225a7 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] [instance: 0c7c7ab7-7cd4-440c-b356-b02e2ce3b999] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:45.874222 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-23b82fd9-974b-4a64-82a2-22cf9e4225a7 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:45.875072 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-23b82fd9-974b-4a64-82a2-22cf9e4225a7 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:45.875728 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-23b82fd9-974b-4a64-82a2-22cf9e4225a7 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:45.876880 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-23b82fd9-974b-4a64-82a2-22cf9e4225a7 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:45.877492 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-23b82fd9-974b-4a64-82a2-22cf9e4225a7 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:45.878069 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-23b82fd9-974b-4a64-82a2-22cf9e4225a7 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:45.911626 n-d-850501-14 devstack@n-api.service[123001]: DEBUG neutronclient.v2_0.client [None req-7763ba77-0526-4890-a49a-a731a56fb664 tempest-FloatingIPsTestJSON-1589412063 tempest-FloatingIPsTestJSON-1589412063-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 66fb1649-4d7e-4b59-a3e4-42f4ebc10dc8 could not be found", "detail": ""}} {{(pid=123001) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:29:45.911626 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-7763ba77-0526-4890-a49a-a731a56fb664 tempest-FloatingIPsTestJSON-1589412063 tempest-FloatingIPsTestJSON-1589412063-project] HTTP exception thrown: Floating IP not found for ID 66fb1649-4d7e-4b59-a3e4-42f4ebc10dc8 Oct 04 18:29:45.915609 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7763ba77-0526-4890-a49a-a731a56fb664 tempest-FloatingIPsTestJSON-1589412063 tempest-FloatingIPsTestJSON-1589412063-project] Request method failure captured: Oct 04 18:29:45.915609 n-d-850501-14 devstack@n-api.service[123001]: request: DELETE /compute/v2.1/os-floating-ips/66fb1649-4d7e-4b59-a3e4-42f4ebc10dc8 HTTP/1.1 Oct 04 18:29:45.915609 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:29:45.915609 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:29:45.915609 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:29:45.915609 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:29:45.915609 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:29:45.915609 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:29:45.915609 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:29:45.915609 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:29:45.915609 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPHuMxo-0s7wS47zgugjw-tGECYk_dwQOi-jZU7sy0yYDoTbe3eGvkYeeuEJeZ9_eJH_rK6aCV-U0t4BYhGqKYIHio-LGnacMhvwyFr_8WnYf9K5fHzOnf0wQLoCde0OpMs5LF7DM_LZfL1goSB4jtxEClMug9MHf2jHbHeovWK47e9U Oct 04 18:29:45.915609 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:29:45.915609 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:29:45.915609 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:29:45.915609 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:29:45.915609 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:29:45.915609 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:29:45.915609 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 97389e5c7f9841b085860166fb601122 Oct 04 18:29:45.915609 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-FloatingIPsTestJSON-1589412063 Oct 04 18:29:45.915609 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:29:45.915609 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:29:45.917179 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/97389e5c7f9841b085860166fb601122"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_97389e5c7f9841b085860166fb601122", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/97389e5c7f9841b085860166fb601122"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/97389e5c7f9841b085860166fb601122"}]}] Oct 04 18:29:45.917179 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-FloatingIPsTestJSON-1589412063 Oct 04 18:29:45.917179 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 97389e5c7f9841b085860166fb601122 Oct 04 18:29:45.917179 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1589412063 Oct 04 18:29:45.917179 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-FloatingIPsTestJSON-1589412063-project Oct 04 18:29:45.917179 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:29:45.917179 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:29:45.917179 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 6355be33f851453db10dd4117d385b0c Oct 04 18:29:45.917179 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-FloatingIPsTestJSON-1589412063-project Oct 04 18:29:45.917179 n-d-850501-14 devstack@n-api.service[123001]: method: Oct 04 18:29:45.917179 n-d-850501-14 devstack@n-api.service[123001]: exception: Floating IP not found for ID 66fb1649-4d7e-4b59-a3e4-42f4ebc10dc8 Oct 04 18:29:45.917179 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '66fb1649-4d7e-4b59-a3e4-42f4ebc10dc8'} Oct 04 18:29:45.917179 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:29:45.918127 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:29:45.918127 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 04 18:29:45.918127 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 04 18:29:45.918127 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:29:45.918127 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:29:45.918127 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 04 18:29:45.918127 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 04 18:29:45.918127 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:29:45.918127 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:29:45.918127 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:29:45.918127 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 18:29:45.918127 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:29:45.918127 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:29:45.918127 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:29:45.918127 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:29:45.918127 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:29:45.918127 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:29:45.918127 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:29:45.918127 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:29:45.919657 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:29:45.919657 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:29:45.919657 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:29:45.919657 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:29:45.919657 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:29:45.919657 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:29:45.919657 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 66fb1649-4d7e-4b59-a3e4-42f4ebc10dc8 could not be found Oct 04 18:29:45.919657 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9e2419cc-7059-459c-8e20-507dd1a9c65b'] Oct 04 18:29:45.919657 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:29:45.919657 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:29:45.919657 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:29:45.919657 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:29:45.919657 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 04 18:29:45.919657 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 04 18:29:45.919657 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 04 18:29:45.919657 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 04 18:29:45.919657 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 66fb1649-4d7e-4b59-a3e4-42f4ebc10dc8. Oct 04 18:29:45.919657 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:29:45.919657 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:29:45.919657 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:29:45.921119 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:29:45.921119 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:29:45.921119 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:29:45.921119 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:29:45.921119 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:29:45.921119 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:29:45.921119 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:29:45.921119 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:29:45.921119 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:29:45.921119 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 04 18:29:45.921119 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 18:29:45.921119 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 66fb1649-4d7e-4b59-a3e4-42f4ebc10dc8 Oct 04 18:29:45.921119 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:29:45.921119 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:29:45.921119 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:29:45.921119 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:29:45.921119 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:29:45.921119 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:29:45.921119 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:29:45.921119 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:29:45.922501 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 66fb1649-4d7e-4b59-a3e4-42f4ebc10dc8 Oct 04 18:29:45.922501 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:29:45.923602 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7763ba77-0526-4890-a49a-a731a56fb664 tempest-FloatingIPsTestJSON-1589412063 tempest-FloatingIPsTestJSON-1589412063-project] Returning 404 to user: Floating IP not found for ID 66fb1649-4d7e-4b59-a3e4-42f4ebc10dc8 {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:29:45.924675 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7763ba77-0526-4890-a49a-a731a56fb664 tempest-FloatingIPsTestJSON-1589412063 tempest-FloatingIPsTestJSON-1589412063-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/66fb1649-4d7e-4b59-a3e4-42f4ebc10dc8" status: 404 len: 111 microversion: 2.1 time: 0.075032 Oct 04 18:29:45.926340 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 294/547] 10.222.0.20 () {58 vars in 1263 bytes} [Tue Oct 4 18:29:45 2022] DELETE /compute/v2.1/os-floating-ips/66fb1649-4d7e-4b59-a3e4-42f4ebc10dc8 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:29:46.313746 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3a426fc5-9c12-408e-b0cc-55c0837fe729 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Action: 'create', calling method: .version_select at 0x7fe2593da670>, body: {"keypair": {"name": "tempest-keypair-2076227649", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCXr7xwVVlV7lM30jCqoybwxBvdOFBaZjw5JjwU8NVXQbahRmRqfhmfVh4rs9APvMVCHl3+YPQ+QoBLHc1tr9xmLf4rQzoLsKkezoG9CdFgKlZ+rmcBrdzgX2Z7YsrltXg=="}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:46.315268 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-3a426fc5-9c12-408e-b0cc-55c0837fe729 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Getting quotas for project 9247c7ae3e4e4068a88a044e36945f32. Resources: {'key_pairs'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:29:46.321572 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-3a426fc5-9c12-408e-b0cc-55c0837fe729 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Getting quotas for user ad89f12d146749b38c688b7581e53f5b and project 9247c7ae3e4e4068a88a044e36945f32. Resources: {'key_pairs'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:29:46.435843 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3a426fc5-9c12-408e-b0cc-55c0837fe729 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.351485 Oct 04 18:29:46.445142 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 295/548] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Oct 4 18:29:46 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:29:46.451163 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-946f22b0-eeb6-43de-a2dd-f4c99f541246 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:46.451975 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-946f22b0-eeb6-43de-a2dd-f4c99f541246 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] [instance: 49d830ea-1eab-4d6b-b571-4aa5434d897e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:46.459996 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-946f22b0-eeb6-43de-a2dd-f4c99f541246 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:46.460917 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-946f22b0-eeb6-43de-a2dd-f4c99f541246 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:46.461691 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-946f22b0-eeb6-43de-a2dd-f4c99f541246 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:46.462653 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-946f22b0-eeb6-43de-a2dd-f4c99f541246 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:46.463352 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-946f22b0-eeb6-43de-a2dd-f4c99f541246 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:46.463972 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-946f22b0-eeb6-43de-a2dd-f4c99f541246 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:46.590306 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-946f22b0-eeb6-43de-a2dd-f4c99f541246 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c11a7c3cec94797b639e6e53dcbfb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375d02476ed240ea967eb2e28e8474ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:46.598583 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-946f22b0-eeb6-43de-a2dd-f4c99f541246 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] 10.222.0.20 "GET /compute/v2.1/servers/49d830ea-1eab-4d6b-b571-4aa5434d897e" status: 200 len: 1279 microversion: 2.1 time: 0.152031 Oct 04 18:29:46.600925 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 296/549] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:46 2022] GET /compute/v2.1/servers/49d830ea-1eab-4d6b-b571-4aa5434d897e => generated 1279 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:46.667039 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d1349006-d974-4c51-baa5-c8eec9287c33 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:46.667659 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d1349006-d974-4c51-baa5-c8eec9287c33 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: d5e996e9-dc9f-46e3-8469-e46dc2932b24] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:46.677291 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d1349006-d974-4c51-baa5-c8eec9287c33 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:46.679757 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d1349006-d974-4c51-baa5-c8eec9287c33 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:46.680416 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d1349006-d974-4c51-baa5-c8eec9287c33 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:46.684020 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d1349006-d974-4c51-baa5-c8eec9287c33 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:46.689506 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d1349006-d974-4c51-baa5-c8eec9287c33 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:46.690133 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d1349006-d974-4c51-baa5-c8eec9287c33 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:46.726728 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-23b82fd9-974b-4a64-82a2-22cf9e4225a7 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20cc2be1195747a4a363f0e490670d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f90e4ecf4d440229cafe5c25ec6df81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:46.737338 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-23b82fd9-974b-4a64-82a2-22cf9e4225a7 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] 10.222.0.20 "GET /compute/v2.1/servers/0c7c7ab7-7cd4-440c-b356-b02e2ce3b999" status: 200 len: 1472 microversion: 2.1 time: 0.875424 Oct 04 18:29:46.740075 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 254/550] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:45 2022] GET /compute/v2.1/servers/0c7c7ab7-7cd4-440c-b356-b02e2ce3b999 => generated 1472 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:46.764618 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-fa38e941-8654-4cec-a2f3-b36fe2594f14 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:46.768773 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-fa38e941-8654-4cec-a2f3-b36fe2594f14 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] [instance: 0c7c7ab7-7cd4-440c-b356-b02e2ce3b999] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:46.772566 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fa38e941-8654-4cec-a2f3-b36fe2594f14 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:46.774138 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fa38e941-8654-4cec-a2f3-b36fe2594f14 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:46.774755 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fa38e941-8654-4cec-a2f3-b36fe2594f14 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:46.775783 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fa38e941-8654-4cec-a2f3-b36fe2594f14 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:46.776540 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fa38e941-8654-4cec-a2f3-b36fe2594f14 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:46.777397 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fa38e941-8654-4cec-a2f3-b36fe2594f14 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:46.823560 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-fa38e941-8654-4cec-a2f3-b36fe2594f14 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '20cc2be1195747a4a363f0e490670d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f90e4ecf4d440229cafe5c25ec6df81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:46.826221 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-fa38e941-8654-4cec-a2f3-b36fe2594f14 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Request method failure captured: Oct 04 18:29:46.826221 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/0c7c7ab7-7cd4-440c-b356-b02e2ce3b999/diagnostics HTTP/1.1 Oct 04 18:29:46.826221 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:29:46.826221 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:29:46.826221 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:29:46.826221 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:29:46.826221 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:29:46.826221 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:29:46.826221 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:29:46.826221 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:29:46.826221 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPHuASRHqYJgzodbmxmTl27nEEbSKuu_XouXuqbqzOoRHZQ7vY0gOEzv_r3SlK_-31izF7JJu08etYzpBYfSbtUbdLj3vUhzbvv1JXse0LYPPr4bEmcSXeDbT08crwhlgIzYfHqabrh4cjJleMMAYfs5iNiL9rUqarsgcg88wjBderrE Oct 04 18:29:46.826221 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:29:46.826221 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:29:46.826221 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:29:46.826221 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:29:46.826221 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:29:46.826221 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:29:46.826221 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 2f90e4ecf4d440229cafe5c25ec6df81 Oct 04 18:29:46.826221 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1196758207 Oct 04 18:29:46.826221 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:29:46.826221 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:29:46.827603 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2f90e4ecf4d440229cafe5c25ec6df81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2f90e4ecf4d440229cafe5c25ec6df81", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2f90e4ecf4d440229cafe5c25ec6df81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2f90e4ecf4d440229cafe5c25ec6df81"}]}] Oct 04 18:29:46.827603 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1196758207 Oct 04 18:29:46.827603 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 2f90e4ecf4d440229cafe5c25ec6df81 Oct 04 18:29:46.827603 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1196758207 Oct 04 18:29:46.827603 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServerDiagnosticsNegativeTest-1196758207-project Oct 04 18:29:46.827603 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:29:46.827603 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:29:46.827603 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 20cc2be1195747a4a363f0e490670d51 Oct 04 18:29:46.827603 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1196758207-project Oct 04 18:29:46.827603 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:29:46.827603 n-d-850501-14 devstack@n-api.service[123002]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 04 18:29:46.837763 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'server_id': '0c7c7ab7-7cd4-440c-b356-b02e2ce3b999'} Oct 04 18:29:46.837763 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:29:46.837763 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:29:46.837763 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:29:46.837763 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:29:46.837763 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:29:46.837763 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:29:46.837763 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:29:46.837763 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:29:46.837763 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Oct 04 18:29:46.837763 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Oct 04 18:29:46.837763 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:29:46.837763 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:29:46.837763 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:29:46.837763 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:29:46.837763 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:29:46.837763 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:29:46.837763 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:29:46.837763 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:29:46.837763 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:29:46.839106 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:29:46.839106 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:29:46.839106 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:29:46.839106 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:29:46.839106 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:29:46.839106 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 04 18:29:46.839106 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:29:46.839106 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:29:46.839106 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:29:46.839106 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:29:46.839106 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:29:46.839106 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:29:46.839106 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:29:46.839106 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:29:46.839106 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 04 18:29:46.839106 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:29:46.839106 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-fa38e941-8654-4cec-a2f3-b36fe2594f14 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:29:46.840337 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-fa38e941-8654-4cec-a2f3-b36fe2594f14 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] 10.222.0.20 "GET /compute/v2.1/servers/0c7c7ab7-7cd4-440c-b356-b02e2ce3b999/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.067519 Oct 04 18:29:46.840337 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 255/551] 10.222.0.20 () {58 vars in 1272 bytes} [Tue Oct 4 18:29:46 2022] GET /compute/v2.1/servers/0c7c7ab7-7cd4-440c-b356-b02e2ce3b999/diagnostics => generated 117 bytes in 74 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:29:46.843092 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d8b518d6-230c-411e-b66d-75d0e38e225e tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:46.843657 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d8b518d6-230c-411e-b66d-75d0e38e225e tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] [instance: 0c7c7ab7-7cd4-440c-b356-b02e2ce3b999] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:46.850902 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d8b518d6-230c-411e-b66d-75d0e38e225e tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:46.851839 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d8b518d6-230c-411e-b66d-75d0e38e225e tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:46.852558 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d8b518d6-230c-411e-b66d-75d0e38e225e tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:46.853513 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d8b518d6-230c-411e-b66d-75d0e38e225e tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:46.854212 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d8b518d6-230c-411e-b66d-75d0e38e225e tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:46.854933 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d8b518d6-230c-411e-b66d-75d0e38e225e tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:46.892547 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d8b518d6-230c-411e-b66d-75d0e38e225e tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] [instance: 0c7c7ab7-7cd4-440c-b356-b02e2ce3b999] Going to try to terminate instance {{(pid=123002) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:29:47.007261 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d1349006-d974-4c51-baa5-c8eec9287c33 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:47.020023 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d1349006-d974-4c51-baa5-c8eec9287c33 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e996e9-dc9f-46e3-8469-e46dc2932b24" status: 200 len: 1319 microversion: 2.1 time: 0.356955 Oct 04 18:29:47.034037 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 297/552] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:46 2022] GET /compute/v2.1/servers/d5e996e9-dc9f-46e3-8469-e46dc2932b24 => generated 1319 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:29:47.316723 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d8b518d6-230c-411e-b66d-75d0e38e225e tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0c7c7ab7-7cd4-440c-b356-b02e2ce3b999" status: 204 len: 0 microversion: 2.1 time: 0.480752 Oct 04 18:29:47.318072 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 256/553] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:29:46 2022] DELETE /compute/v2.1/servers/0c7c7ab7-7cd4-440c-b356-b02e2ce3b999 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:29:47.326879 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0d339990-e9a0-4652-960b-13c6835a00c0 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:47.327483 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0d339990-e9a0-4652-960b-13c6835a00c0 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] [instance: 0c7c7ab7-7cd4-440c-b356-b02e2ce3b999] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:47.332744 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=15 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:47.334472 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0d339990-e9a0-4652-960b-13c6835a00c0 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:47.335352 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0d339990-e9a0-4652-960b-13c6835a00c0 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:47.335997 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0d339990-e9a0-4652-960b-13c6835a00c0 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:47.337125 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0d339990-e9a0-4652-960b-13c6835a00c0 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:47.337810 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0d339990-e9a0-4652-960b-13c6835a00c0 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:47.338312 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0d339990-e9a0-4652-960b-13c6835a00c0 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:47.545707 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0d339990-e9a0-4652-960b-13c6835a00c0 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20cc2be1195747a4a363f0e490670d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f90e4ecf4d440229cafe5c25ec6df81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:47.557943 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0d339990-e9a0-4652-960b-13c6835a00c0 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] 10.222.0.20 "GET /compute/v2.1/servers/0c7c7ab7-7cd4-440c-b356-b02e2ce3b999" status: 200 len: 1478 microversion: 2.1 time: 0.235518 Oct 04 18:29:47.559062 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 298/554] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:47 2022] GET /compute/v2.1/servers/0c7c7ab7-7cd4-440c-b356-b02e2ce3b999 => generated 1478 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:47.634414 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-75273faf-e347-48ab-87f9-380cfb9605cd tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:47.635140 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-75273faf-e347-48ab-87f9-380cfb9605cd tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] [instance: 49d830ea-1eab-4d6b-b571-4aa5434d897e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:47.655191 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-75273faf-e347-48ab-87f9-380cfb9605cd tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:47.657099 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-75273faf-e347-48ab-87f9-380cfb9605cd tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:47.657486 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-75273faf-e347-48ab-87f9-380cfb9605cd tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:47.658221 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-75273faf-e347-48ab-87f9-380cfb9605cd tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:47.661091 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-75273faf-e347-48ab-87f9-380cfb9605cd tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:47.661589 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-75273faf-e347-48ab-87f9-380cfb9605cd tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:47.760353 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-75273faf-e347-48ab-87f9-380cfb9605cd tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c11a7c3cec94797b639e6e53dcbfb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375d02476ed240ea967eb2e28e8474ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:47.760353 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-75273faf-e347-48ab-87f9-380cfb9605cd tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] 10.222.0.20 "GET /compute/v2.1/servers/49d830ea-1eab-4d6b-b571-4aa5434d897e" status: 200 len: 1279 microversion: 2.1 time: 0.129512 Oct 04 18:29:47.772210 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 257/555] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:47 2022] GET /compute/v2.1/servers/49d830ea-1eab-4d6b-b571-4aa5434d897e => generated 1279 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:48.083985 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4dca33a3-d16c-4878-a678-4b8265e3c141 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:48.085296 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-4dca33a3-d16c-4878-a678-4b8265e3c141 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: d5e996e9-dc9f-46e3-8469-e46dc2932b24] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:48.093967 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4dca33a3-d16c-4878-a678-4b8265e3c141 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:48.098342 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4dca33a3-d16c-4878-a678-4b8265e3c141 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:48.098342 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4dca33a3-d16c-4878-a678-4b8265e3c141 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:48.098342 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4dca33a3-d16c-4878-a678-4b8265e3c141 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:48.103620 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4dca33a3-d16c-4878-a678-4b8265e3c141 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:48.105506 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4dca33a3-d16c-4878-a678-4b8265e3c141 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:48.517458 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-3a1083a0-c641-4175-bec9-a210d715acba req-bd66491b-8895-4d54-b87f-4d9136a309f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d07c478-8e9c-4000-92bb-3fa4547ea6c0", "tag": "0f86385e-8401-4a2d-ab06-7b090939385b"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:48.533933 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-3a1083a0-c641-4175-bec9-a210d715acba req-bd66491b-8895-4d54-b87f-4d9136a309f7 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:48.534425 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-3a1083a0-c641-4175-bec9-a210d715acba req-bd66491b-8895-4d54-b87f-4d9136a309f7 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:48.534862 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-3a1083a0-c641-4175-bec9-a210d715acba req-bd66491b-8895-4d54-b87f-4d9136a309f7 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:48.563338 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-4dca33a3-d16c-4878-a678-4b8265e3c141 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:48.577172 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-4dca33a3-d16c-4878-a678-4b8265e3c141 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e996e9-dc9f-46e3-8469-e46dc2932b24" status: 200 len: 1319 microversion: 2.1 time: 0.532635 Oct 04 18:29:48.579023 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 299/556] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:48 2022] GET /compute/v2.1/servers/d5e996e9-dc9f-46e3-8469-e46dc2932b24 => generated 1319 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:48.596026 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-764820c6-9f2d-4109-af2d-f8fdc0188ab0 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:48.598376 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-764820c6-9f2d-4109-af2d-f8fdc0188ab0 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] [instance: 0c7c7ab7-7cd4-440c-b356-b02e2ce3b999] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:48.599520 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-3a1083a0-c641-4175-bec9-a210d715acba req-bd66491b-8895-4d54-b87f-4d9136a309f7 service nova] Creating event network-changed:0f86385e-8401-4a2d-ab06-7b090939385b for instance 2d07c478-8e9c-4000-92bb-3fa4547ea6c0 on n-h1-850501-14 Oct 04 18:29:48.607781 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-764820c6-9f2d-4109-af2d-f8fdc0188ab0 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:48.608424 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-764820c6-9f2d-4109-af2d-f8fdc0188ab0 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:48.609193 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-764820c6-9f2d-4109-af2d-f8fdc0188ab0 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:48.610136 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-764820c6-9f2d-4109-af2d-f8fdc0188ab0 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:48.610829 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-3a1083a0-c641-4175-bec9-a210d715acba req-bd66491b-8895-4d54-b87f-4d9136a309f7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097037 Oct 04 18:29:48.611486 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-764820c6-9f2d-4109-af2d-f8fdc0188ab0 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:48.612186 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 258/557] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:29:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:29:48.613056 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-764820c6-9f2d-4109-af2d-f8fdc0188ab0 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:48.807646 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e5a99855-44a7-4ee5-acfe-0220df2da692 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:48.813967 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e5a99855-44a7-4ee5-acfe-0220df2da692 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] [instance: 49d830ea-1eab-4d6b-b571-4aa5434d897e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:48.833375 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e5a99855-44a7-4ee5-acfe-0220df2da692 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:48.835194 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e5a99855-44a7-4ee5-acfe-0220df2da692 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:48.836582 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e5a99855-44a7-4ee5-acfe-0220df2da692 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:48.839282 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e5a99855-44a7-4ee5-acfe-0220df2da692 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:48.843058 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e5a99855-44a7-4ee5-acfe-0220df2da692 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:48.844009 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e5a99855-44a7-4ee5-acfe-0220df2da692 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:49.106345 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-764820c6-9f2d-4109-af2d-f8fdc0188ab0 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20cc2be1195747a4a363f0e490670d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f90e4ecf4d440229cafe5c25ec6df81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:49.132901 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-764820c6-9f2d-4109-af2d-f8fdc0188ab0 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] 10.222.0.20 "GET /compute/v2.1/servers/0c7c7ab7-7cd4-440c-b356-b02e2ce3b999" status: 200 len: 1478 microversion: 2.1 time: 0.551058 Oct 04 18:29:49.137513 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 300/558] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:48 2022] GET /compute/v2.1/servers/0c7c7ab7-7cd4-440c-b356-b02e2ce3b999 => generated 1478 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:49.437375 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:49.477249 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=8 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:49.519900 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e5a99855-44a7-4ee5-acfe-0220df2da692 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c11a7c3cec94797b639e6e53dcbfb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375d02476ed240ea967eb2e28e8474ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:49.530355 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e5a99855-44a7-4ee5-acfe-0220df2da692 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] 10.222.0.20 "GET /compute/v2.1/servers/49d830ea-1eab-4d6b-b571-4aa5434d897e" status: 200 len: 1321 microversion: 2.1 time: 0.751039 Oct 04 18:29:49.531471 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 259/559] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:48 2022] GET /compute/v2.1/servers/49d830ea-1eab-4d6b-b571-4aa5434d897e => generated 1321 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:49.601967 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-cac1b090-cb03-41bd-a878-1cce7b4576ee tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:49.602907 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-cac1b090-cb03-41bd-a878-1cce7b4576ee tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: d5e996e9-dc9f-46e3-8469-e46dc2932b24] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:49.611403 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cac1b090-cb03-41bd-a878-1cce7b4576ee tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:49.618927 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cac1b090-cb03-41bd-a878-1cce7b4576ee tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:49.618927 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cac1b090-cb03-41bd-a878-1cce7b4576ee tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:49.618927 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cac1b090-cb03-41bd-a878-1cce7b4576ee tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:49.618927 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cac1b090-cb03-41bd-a878-1cce7b4576ee tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:49.619319 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cac1b090-cb03-41bd-a878-1cce7b4576ee tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:49.895528 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-cac1b090-cb03-41bd-a878-1cce7b4576ee tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:49.915044 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-cac1b090-cb03-41bd-a878-1cce7b4576ee tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e996e9-dc9f-46e3-8469-e46dc2932b24" status: 200 len: 1319 microversion: 2.1 time: 0.317309 Oct 04 18:29:49.918136 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 301/560] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:49 2022] GET /compute/v2.1/servers/d5e996e9-dc9f-46e3-8469-e46dc2932b24 => generated 1319 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:50.159475 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9118fc67-1997-44ca-ad98-bf9411db7876 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:50.160236 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9118fc67-1997-44ca-ad98-bf9411db7876 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] [instance: 0c7c7ab7-7cd4-440c-b356-b02e2ce3b999] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:50.178388 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9118fc67-1997-44ca-ad98-bf9411db7876 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:50.180428 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9118fc67-1997-44ca-ad98-bf9411db7876 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:50.180760 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9118fc67-1997-44ca-ad98-bf9411db7876 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:50.184375 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9118fc67-1997-44ca-ad98-bf9411db7876 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:50.186685 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9118fc67-1997-44ca-ad98-bf9411db7876 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:50.187133 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9118fc67-1997-44ca-ad98-bf9411db7876 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:50.524566 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9118fc67-1997-44ca-ad98-bf9411db7876 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20cc2be1195747a4a363f0e490670d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f90e4ecf4d440229cafe5c25ec6df81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:50.539813 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9118fc67-1997-44ca-ad98-bf9411db7876 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] 10.222.0.20 "GET /compute/v2.1/servers/0c7c7ab7-7cd4-440c-b356-b02e2ce3b999" status: 200 len: 1478 microversion: 2.1 time: 0.384677 Oct 04 18:29:50.558225 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 260/561] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:50 2022] GET /compute/v2.1/servers/0c7c7ab7-7cd4-440c-b356-b02e2ce3b999 => generated 1478 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:50.561031 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ee0b6445-8d92-4026-b1bc-ad84295dc29e tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:50.562303 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ee0b6445-8d92-4026-b1bc-ad84295dc29e tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] [instance: 49d830ea-1eab-4d6b-b571-4aa5434d897e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:50.569203 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ee0b6445-8d92-4026-b1bc-ad84295dc29e tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:50.570761 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ee0b6445-8d92-4026-b1bc-ad84295dc29e tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:50.571568 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ee0b6445-8d92-4026-b1bc-ad84295dc29e tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:50.572680 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ee0b6445-8d92-4026-b1bc-ad84295dc29e tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:50.573364 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ee0b6445-8d92-4026-b1bc-ad84295dc29e tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:50.574476 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ee0b6445-8d92-4026-b1bc-ad84295dc29e tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:50.944436 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-225b471a-9b74-4366-bbbe-3d335862d3a9 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:50.945315 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-225b471a-9b74-4366-bbbe-3d335862d3a9 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: d5e996e9-dc9f-46e3-8469-e46dc2932b24] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:50.959940 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-225b471a-9b74-4366-bbbe-3d335862d3a9 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:50.959940 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-225b471a-9b74-4366-bbbe-3d335862d3a9 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:50.960204 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-225b471a-9b74-4366-bbbe-3d335862d3a9 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:50.967185 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-225b471a-9b74-4366-bbbe-3d335862d3a9 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:50.968690 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-225b471a-9b74-4366-bbbe-3d335862d3a9 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:50.969293 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-225b471a-9b74-4366-bbbe-3d335862d3a9 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:50.980198 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ee0b6445-8d92-4026-b1bc-ad84295dc29e tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c11a7c3cec94797b639e6e53dcbfb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375d02476ed240ea967eb2e28e8474ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:50.988625 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ee0b6445-8d92-4026-b1bc-ad84295dc29e tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] 10.222.0.20 "GET /compute/v2.1/servers/49d830ea-1eab-4d6b-b571-4aa5434d897e" status: 200 len: 1321 microversion: 2.1 time: 0.434836 Oct 04 18:29:50.989334 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 302/562] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:50 2022] GET /compute/v2.1/servers/49d830ea-1eab-4d6b-b571-4aa5434d897e => generated 1321 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:51.549831 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-225b471a-9b74-4366-bbbe-3d335862d3a9 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:51.564440 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-225b471a-9b74-4366-bbbe-3d335862d3a9 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e996e9-dc9f-46e3-8469-e46dc2932b24" status: 200 len: 1319 microversion: 2.1 time: 0.620353 Oct 04 18:29:51.567113 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 261/563] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:50 2022] GET /compute/v2.1/servers/d5e996e9-dc9f-46e3-8469-e46dc2932b24 => generated 1319 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:29:51.574346 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8b9c0c9e-3069-41b0-9043-fb44f57b6843 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:51.576211 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8b9c0c9e-3069-41b0-9043-fb44f57b6843 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] [instance: 0c7c7ab7-7cd4-440c-b356-b02e2ce3b999] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:51.605519 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8b9c0c9e-3069-41b0-9043-fb44f57b6843 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:51.608846 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8b9c0c9e-3069-41b0-9043-fb44f57b6843 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:51.616413 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8b9c0c9e-3069-41b0-9043-fb44f57b6843 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:51.617809 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8b9c0c9e-3069-41b0-9043-fb44f57b6843 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:51.618306 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8b9c0c9e-3069-41b0-9043-fb44f57b6843 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:51.618750 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8b9c0c9e-3069-41b0-9043-fb44f57b6843 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:52.014622 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3da7e3c2-d97f-4b44-99da-f20bd0c96aef tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:52.015241 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3da7e3c2-d97f-4b44-99da-f20bd0c96aef tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] [instance: 49d830ea-1eab-4d6b-b571-4aa5434d897e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:52.025810 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3da7e3c2-d97f-4b44-99da-f20bd0c96aef tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:52.026312 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3da7e3c2-d97f-4b44-99da-f20bd0c96aef tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:52.026748 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3da7e3c2-d97f-4b44-99da-f20bd0c96aef tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:52.035462 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3da7e3c2-d97f-4b44-99da-f20bd0c96aef tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:52.036628 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3da7e3c2-d97f-4b44-99da-f20bd0c96aef tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:52.037397 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3da7e3c2-d97f-4b44-99da-f20bd0c96aef tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:52.143418 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8b9c0c9e-3069-41b0-9043-fb44f57b6843 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20cc2be1195747a4a363f0e490670d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f90e4ecf4d440229cafe5c25ec6df81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:52.153578 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8b9c0c9e-3069-41b0-9043-fb44f57b6843 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] 10.222.0.20 "GET /compute/v2.1/servers/0c7c7ab7-7cd4-440c-b356-b02e2ce3b999" status: 200 len: 1478 microversion: 2.1 time: 0.590431 Oct 04 18:29:52.154270 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 303/564] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:51 2022] GET /compute/v2.1/servers/0c7c7ab7-7cd4-440c-b356-b02e2ce3b999 => generated 1478 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:52.274208 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3da7e3c2-d97f-4b44-99da-f20bd0c96aef tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c11a7c3cec94797b639e6e53dcbfb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375d02476ed240ea967eb2e28e8474ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:52.284095 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3da7e3c2-d97f-4b44-99da-f20bd0c96aef tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] 10.222.0.20 "GET /compute/v2.1/servers/49d830ea-1eab-4d6b-b571-4aa5434d897e" status: 200 len: 1321 microversion: 2.1 time: 0.273415 Oct 04 18:29:52.285694 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 262/565] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:52 2022] GET /compute/v2.1/servers/49d830ea-1eab-4d6b-b571-4aa5434d897e => generated 1321 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:52.590883 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b32d0d5a-4626-4baf-8717-054d2853260a tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:52.591612 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b32d0d5a-4626-4baf-8717-054d2853260a tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: d5e996e9-dc9f-46e3-8469-e46dc2932b24] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:52.614953 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b32d0d5a-4626-4baf-8717-054d2853260a tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:52.614953 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b32d0d5a-4626-4baf-8717-054d2853260a tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:52.614953 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b32d0d5a-4626-4baf-8717-054d2853260a tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:52.614953 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b32d0d5a-4626-4baf-8717-054d2853260a tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:52.615483 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b32d0d5a-4626-4baf-8717-054d2853260a tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:52.615483 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b32d0d5a-4626-4baf-8717-054d2853260a tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:52.646572 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-64fd85de-591f-4ea0-a962-04d670ce9c86 req-1e672d55-7305-4093-b72e-11c1aa4b0879 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c7c7ab7-7cd4-440c-b356-b02e2ce3b999", "name": "network-vif-deleted", "tag": "f4bea2ab-fc0f-49bd-a308-f3341bcd9942"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:52.671780 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-64fd85de-591f-4ea0-a962-04d670ce9c86 req-1e672d55-7305-4093-b72e-11c1aa4b0879 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:52.673539 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-64fd85de-591f-4ea0-a962-04d670ce9c86 req-1e672d55-7305-4093-b72e-11c1aa4b0879 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:52.674014 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-64fd85de-591f-4ea0-a962-04d670ce9c86 req-1e672d55-7305-4093-b72e-11c1aa4b0879 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:52.683272 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=100 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:52.702467 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-64fd85de-591f-4ea0-a962-04d670ce9c86 req-1e672d55-7305-4093-b72e-11c1aa4b0879 service nova] Creating event network-vif-deleted:f4bea2ab-fc0f-49bd-a308-f3341bcd9942 for instance 0c7c7ab7-7cd4-440c-b356-b02e2ce3b999 on n-h1-850501-14 Oct 04 18:29:52.737104 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-64fd85de-591f-4ea0-a962-04d670ce9c86 req-1e672d55-7305-4093-b72e-11c1aa4b0879 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094070 Oct 04 18:29:52.738022 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 263/566] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:29:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:29:53.181759 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d04bc9f8-3ee5-4fd4-a236-832f81416ed8 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:53.182481 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d04bc9f8-3ee5-4fd4-a236-832f81416ed8 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] [instance: 0c7c7ab7-7cd4-440c-b356-b02e2ce3b999] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:53.190307 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b32d0d5a-4626-4baf-8717-054d2853260a tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:53.195604 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d04bc9f8-3ee5-4fd4-a236-832f81416ed8 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:53.196726 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d04bc9f8-3ee5-4fd4-a236-832f81416ed8 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:53.200940 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d04bc9f8-3ee5-4fd4-a236-832f81416ed8 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:53.201244 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b32d0d5a-4626-4baf-8717-054d2853260a tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e996e9-dc9f-46e3-8469-e46dc2932b24" status: 200 len: 1319 microversion: 2.1 time: 0.613913 Oct 04 18:29:53.203278 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 304/567] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:52 2022] GET /compute/v2.1/servers/d5e996e9-dc9f-46e3-8469-e46dc2932b24 => generated 1319 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:53.204179 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d04bc9f8-3ee5-4fd4-a236-832f81416ed8 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:53.204844 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d04bc9f8-3ee5-4fd4-a236-832f81416ed8 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:53.209516 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d04bc9f8-3ee5-4fd4-a236-832f81416ed8 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:53.289812 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d04bc9f8-3ee5-4fd4-a236-832f81416ed8 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:53.290373 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d04bc9f8-3ee5-4fd4-a236-832f81416ed8 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:53.295832 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d04bc9f8-3ee5-4fd4-a236-832f81416ed8 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:53.296392 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-d04bc9f8-3ee5-4fd4-a236-832f81416ed8 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Lazy-loading 'fault' on Instance uuid 0c7c7ab7-7cd4-440c-b356-b02e2ce3b999 {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:29:53.311915 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-199273c1-36d9-4e1d-bfad-d89c3de739a4 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:53.314751 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-199273c1-36d9-4e1d-bfad-d89c3de739a4 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] [instance: 49d830ea-1eab-4d6b-b571-4aa5434d897e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:53.338489 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-199273c1-36d9-4e1d-bfad-d89c3de739a4 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:53.342927 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-199273c1-36d9-4e1d-bfad-d89c3de739a4 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:53.343905 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-199273c1-36d9-4e1d-bfad-d89c3de739a4 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:53.345319 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-199273c1-36d9-4e1d-bfad-d89c3de739a4 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:53.346353 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-199273c1-36d9-4e1d-bfad-d89c3de739a4 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:53.350527 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-199273c1-36d9-4e1d-bfad-d89c3de739a4 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:53.504262 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d04bc9f8-3ee5-4fd4-a236-832f81416ed8 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20cc2be1195747a4a363f0e490670d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f90e4ecf4d440229cafe5c25ec6df81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:53.511528 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:53.529898 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d04bc9f8-3ee5-4fd4-a236-832f81416ed8 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] 10.222.0.20 "GET /compute/v2.1/servers/0c7c7ab7-7cd4-440c-b356-b02e2ce3b999" status: 200 len: 1313 microversion: 2.1 time: 0.354362 Oct 04 18:29:53.533064 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 264/568] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:53 2022] GET /compute/v2.1/servers/0c7c7ab7-7cd4-440c-b356-b02e2ce3b999 => generated 1313 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:54.018109 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-199273c1-36d9-4e1d-bfad-d89c3de739a4 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c11a7c3cec94797b639e6e53dcbfb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375d02476ed240ea967eb2e28e8474ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:54.040782 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-199273c1-36d9-4e1d-bfad-d89c3de739a4 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] 10.222.0.20 "GET /compute/v2.1/servers/49d830ea-1eab-4d6b-b571-4aa5434d897e" status: 200 len: 1321 microversion: 2.1 time: 0.736907 Oct 04 18:29:54.041382 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 305/569] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:53 2022] GET /compute/v2.1/servers/49d830ea-1eab-4d6b-b571-4aa5434d897e => generated 1321 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:54.231462 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7ba39800-59f9-4f26-8fb6-fb543014fc96 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:54.234286 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7ba39800-59f9-4f26-8fb6-fb543014fc96 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: d5e996e9-dc9f-46e3-8469-e46dc2932b24] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:54.241387 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7ba39800-59f9-4f26-8fb6-fb543014fc96 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:54.252294 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7ba39800-59f9-4f26-8fb6-fb543014fc96 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:54.252294 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7ba39800-59f9-4f26-8fb6-fb543014fc96 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:54.252294 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7ba39800-59f9-4f26-8fb6-fb543014fc96 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:54.253189 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7ba39800-59f9-4f26-8fb6-fb543014fc96 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:54.254449 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7ba39800-59f9-4f26-8fb6-fb543014fc96 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:54.487102 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7ba39800-59f9-4f26-8fb6-fb543014fc96 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:54.504718 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7ba39800-59f9-4f26-8fb6-fb543014fc96 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e996e9-dc9f-46e3-8469-e46dc2932b24" status: 200 len: 1319 microversion: 2.1 time: 0.278306 Oct 04 18:29:54.505613 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 265/570] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:54 2022] GET /compute/v2.1/servers/d5e996e9-dc9f-46e3-8469-e46dc2932b24 => generated 1319 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:54.571546 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4c2c6fce-775a-480f-a86b-51cc01432694 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:54.572183 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-4c2c6fce-775a-480f-a86b-51cc01432694 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] [instance: 0c7c7ab7-7cd4-440c-b356-b02e2ce3b999] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:54.578972 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4c2c6fce-775a-480f-a86b-51cc01432694 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:54.579625 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4c2c6fce-775a-480f-a86b-51cc01432694 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:54.581547 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4c2c6fce-775a-480f-a86b-51cc01432694 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:54.582523 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4c2c6fce-775a-480f-a86b-51cc01432694 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:54.583157 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4c2c6fce-775a-480f-a86b-51cc01432694 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:54.583744 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4c2c6fce-775a-480f-a86b-51cc01432694 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:54.604184 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-4c2c6fce-775a-480f-a86b-51cc01432694 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] HTTP exception thrown: Instance 0c7c7ab7-7cd4-440c-b356-b02e2ce3b999 could not be found. Oct 04 18:29:54.606013 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4c2c6fce-775a-480f-a86b-51cc01432694 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Request method failure captured: Oct 04 18:29:54.606013 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/0c7c7ab7-7cd4-440c-b356-b02e2ce3b999 HTTP/1.1 Oct 04 18:29:54.606013 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:29:54.606013 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:29:54.606013 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:29:54.606013 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:29:54.606013 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:29:54.606013 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:29:54.606013 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:29:54.606013 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:29:54.606013 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPHuASRHqYJgzodbmxmTl27nEEbSKuu_XouXuqbqzOoRHZQ7vY0gOEzv_r3SlK_-31izF7JJu08etYzpBYfSbtUbdLj3vUhzbvv1JXse0LYPPr4bEmcSXeDbT08crwhlgIzYfHqabrh4cjJleMMAYfs5iNiL9rUqarsgcg88wjBderrE Oct 04 18:29:54.606013 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:29:54.606013 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:29:54.606013 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:29:54.606013 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:29:54.606013 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:29:54.606013 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:29:54.606013 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 2f90e4ecf4d440229cafe5c25ec6df81 Oct 04 18:29:54.606013 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1196758207 Oct 04 18:29:54.606013 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:29:54.606013 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:29:54.607506 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2f90e4ecf4d440229cafe5c25ec6df81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2f90e4ecf4d440229cafe5c25ec6df81", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2f90e4ecf4d440229cafe5c25ec6df81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2f90e4ecf4d440229cafe5c25ec6df81"}]}] Oct 04 18:29:54.607506 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1196758207 Oct 04 18:29:54.607506 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 2f90e4ecf4d440229cafe5c25ec6df81 Oct 04 18:29:54.607506 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1196758207 Oct 04 18:29:54.607506 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ServerDiagnosticsNegativeTest-1196758207-project Oct 04 18:29:54.607506 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:29:54.607506 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:29:54.607506 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 20cc2be1195747a4a363f0e490670d51 Oct 04 18:29:54.607506 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1196758207-project Oct 04 18:29:54.607506 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:29:54.607506 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 0c7c7ab7-7cd4-440c-b356-b02e2ce3b999 could not be found. Oct 04 18:29:54.607506 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '0c7c7ab7-7cd4-440c-b356-b02e2ce3b999'} Oct 04 18:29:54.608398 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:29:54.608398 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:29:54.608398 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:29:54.608398 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:29:54.608398 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:29:54.608398 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:29:54.608398 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:29:54.608398 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:29:54.608398 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:29:54.608398 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:29:54.608398 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c7c7ab7-7cd4-440c-b356-b02e2ce3b999 could not be found. Oct 04 18:29:54.608398 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:29:54.608398 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:29:54.608398 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:29:54.608398 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:29:54.608398 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:29:54.608398 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:29:54.608398 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:29:54.608398 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:29:54.608398 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:29:54.609779 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:29:54.609779 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:29:54.609779 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:29:54.609779 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:29:54.609779 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:29:54.609779 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:29:54.609779 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:29:54.609779 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c7c7ab7-7cd4-440c-b356-b02e2ce3b999 could not be found. Oct 04 18:29:54.609779 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:29:54.609779 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:29:54.609779 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:29:54.609779 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:29:54.609779 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:29:54.609779 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:29:54.609779 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:29:54.609779 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:29:54.609779 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c7c7ab7-7cd4-440c-b356-b02e2ce3b999 could not be found. Oct 04 18:29:54.609779 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:29:54.613132 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4c2c6fce-775a-480f-a86b-51cc01432694 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] Returning 404 to user: Instance 0c7c7ab7-7cd4-440c-b356-b02e2ce3b999 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:29:54.614852 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-4c2c6fce-775a-480f-a86b-51cc01432694 tempest-ServerDiagnosticsNegativeTest-1196758207 tempest-ServerDiagnosticsNegativeTest-1196758207-project] 10.222.0.20 "GET /compute/v2.1/servers/0c7c7ab7-7cd4-440c-b356-b02e2ce3b999" status: 404 len: 111 microversion: 2.1 time: 0.049013 Oct 04 18:29:54.615918 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 306/571] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:54 2022] GET /compute/v2.1/servers/0c7c7ab7-7cd4-440c-b356-b02e2ce3b999 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:29:54.809972 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-36c16c85-0ffb-43e6-9967-ebb200b93759 req-cabe1bb3-ae6b-4aaf-a030-4e4428becea7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5e996e9-dc9f-46e3-8469-e46dc2932b24", "tag": "07eac084-b2dc-4fbf-9f40-12ca4aeead64"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:54.830987 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-36c16c85-0ffb-43e6-9967-ebb200b93759 req-cabe1bb3-ae6b-4aaf-a030-4e4428becea7 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:54.831192 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-36c16c85-0ffb-43e6-9967-ebb200b93759 req-cabe1bb3-ae6b-4aaf-a030-4e4428becea7 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:54.831881 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-36c16c85-0ffb-43e6-9967-ebb200b93759 req-cabe1bb3-ae6b-4aaf-a030-4e4428becea7 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:54.868095 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-36c16c85-0ffb-43e6-9967-ebb200b93759 req-cabe1bb3-ae6b-4aaf-a030-4e4428becea7 service nova] Creating event network-changed:07eac084-b2dc-4fbf-9f40-12ca4aeead64 for instance d5e996e9-dc9f-46e3-8469-e46dc2932b24 on n-h2-850501-14 Oct 04 18:29:54.878400 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-36c16c85-0ffb-43e6-9967-ebb200b93759 req-cabe1bb3-ae6b-4aaf-a030-4e4428becea7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078916 Oct 04 18:29:54.881879 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 266/572] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:29:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:29:55.065993 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9fd180d8-a19c-4ca0-9cf6-bd802f67f6b9 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:55.066614 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-9fd180d8-a19c-4ca0-9cf6-bd802f67f6b9 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] [instance: 49d830ea-1eab-4d6b-b571-4aa5434d897e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:55.076748 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9fd180d8-a19c-4ca0-9cf6-bd802f67f6b9 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:55.078434 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9fd180d8-a19c-4ca0-9cf6-bd802f67f6b9 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:55.078991 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9fd180d8-a19c-4ca0-9cf6-bd802f67f6b9 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:55.080652 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9fd180d8-a19c-4ca0-9cf6-bd802f67f6b9 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:55.084239 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9fd180d8-a19c-4ca0-9cf6-bd802f67f6b9 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:55.090858 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9fd180d8-a19c-4ca0-9cf6-bd802f67f6b9 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:55.540760 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5246fdd8-4aef-4852-a5c8-afca9627cbb9 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:55.542522 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5246fdd8-4aef-4852-a5c8-afca9627cbb9 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: d5e996e9-dc9f-46e3-8469-e46dc2932b24] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:55.561178 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5246fdd8-4aef-4852-a5c8-afca9627cbb9 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:55.566505 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5246fdd8-4aef-4852-a5c8-afca9627cbb9 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:55.567394 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5246fdd8-4aef-4852-a5c8-afca9627cbb9 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:55.571848 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5246fdd8-4aef-4852-a5c8-afca9627cbb9 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:55.574070 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5246fdd8-4aef-4852-a5c8-afca9627cbb9 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:55.575979 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5246fdd8-4aef-4852-a5c8-afca9627cbb9 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:56.081840 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5246fdd8-4aef-4852-a5c8-afca9627cbb9 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:56.094496 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9fd180d8-a19c-4ca0-9cf6-bd802f67f6b9 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c11a7c3cec94797b639e6e53dcbfb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375d02476ed240ea967eb2e28e8474ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:56.112951 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9fd180d8-a19c-4ca0-9cf6-bd802f67f6b9 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] 10.222.0.20 "GET /compute/v2.1/servers/49d830ea-1eab-4d6b-b571-4aa5434d897e" status: 200 len: 1321 microversion: 2.1 time: 1.046812 Oct 04 18:29:56.134467 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 307/573] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:55 2022] GET /compute/v2.1/servers/49d830ea-1eab-4d6b-b571-4aa5434d897e => generated 1321 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:56.138078 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5246fdd8-4aef-4852-a5c8-afca9627cbb9 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e996e9-dc9f-46e3-8469-e46dc2932b24" status: 200 len: 1319 microversion: 2.1 time: 0.607884 Oct 04 18:29:56.152239 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 267/574] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:55 2022] GET /compute/v2.1/servers/d5e996e9-dc9f-46e3-8469-e46dc2932b24 => generated 1319 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:56.955905 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-15f98118-861f-418b-886c-63960085d655 req-e86f5731-86b2-4ad9-85e1-be8063f077c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49d830ea-1eab-4d6b-b571-4aa5434d897e", "tag": "a7dbb653-fbbe-4479-b569-0226403a1c50"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:56.985286 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=5 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:56.987596 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-15f98118-861f-418b-886c-63960085d655 req-e86f5731-86b2-4ad9-85e1-be8063f077c5 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:56.992549 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-15f98118-861f-418b-886c-63960085d655 req-e86f5731-86b2-4ad9-85e1-be8063f077c5 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:56.994655 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-15f98118-861f-418b-886c-63960085d655 req-e86f5731-86b2-4ad9-85e1-be8063f077c5 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:57.017067 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-15f98118-861f-418b-886c-63960085d655 req-e86f5731-86b2-4ad9-85e1-be8063f077c5 service nova] Creating event network-changed:a7dbb653-fbbe-4479-b569-0226403a1c50 for instance 49d830ea-1eab-4d6b-b571-4aa5434d897e on n-h1-850501-14 Oct 04 18:29:57.026647 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-15f98118-861f-418b-886c-63960085d655 req-e86f5731-86b2-4ad9-85e1-be8063f077c5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074337 Oct 04 18:29:57.027261 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 308/575] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:29:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:29:57.141585 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3e907408-3907-47b3-93fa-24a17bc80eea tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:57.142836 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3e907408-3907-47b3-93fa-24a17bc80eea tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] [instance: 49d830ea-1eab-4d6b-b571-4aa5434d897e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:57.158444 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3e907408-3907-47b3-93fa-24a17bc80eea tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:57.158944 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3e907408-3907-47b3-93fa-24a17bc80eea tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:57.159377 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3e907408-3907-47b3-93fa-24a17bc80eea tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:57.160148 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3e907408-3907-47b3-93fa-24a17bc80eea tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:57.160565 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3e907408-3907-47b3-93fa-24a17bc80eea tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:57.160988 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3e907408-3907-47b3-93fa-24a17bc80eea tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:57.171036 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-36141120-5cb2-4e3b-adf2-3fe432406121 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:57.171656 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-36141120-5cb2-4e3b-adf2-3fe432406121 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: d5e996e9-dc9f-46e3-8469-e46dc2932b24] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:57.174949 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:57.197919 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-36141120-5cb2-4e3b-adf2-3fe432406121 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:57.198442 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-36141120-5cb2-4e3b-adf2-3fe432406121 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:57.198924 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-36141120-5cb2-4e3b-adf2-3fe432406121 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:57.199871 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-36141120-5cb2-4e3b-adf2-3fe432406121 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:57.200015 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-36141120-5cb2-4e3b-adf2-3fe432406121 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:57.200665 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-36141120-5cb2-4e3b-adf2-3fe432406121 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:58.183098 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3e907408-3907-47b3-93fa-24a17bc80eea tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c11a7c3cec94797b639e6e53dcbfb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375d02476ed240ea967eb2e28e8474ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:58.183098 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3e907408-3907-47b3-93fa-24a17bc80eea tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] 10.222.0.20 "GET /compute/v2.1/servers/49d830ea-1eab-4d6b-b571-4aa5434d897e" status: 200 len: 1321 microversion: 2.1 time: 1.025653 Oct 04 18:29:58.183098 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 268/576] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:57 2022] GET /compute/v2.1/servers/49d830ea-1eab-4d6b-b571-4aa5434d897e => generated 1321 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:58.213199 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-36141120-5cb2-4e3b-adf2-3fe432406121 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:58.213199 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-36141120-5cb2-4e3b-adf2-3fe432406121 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e996e9-dc9f-46e3-8469-e46dc2932b24" status: 200 len: 1319 microversion: 2.1 time: 1.037638 Oct 04 18:29:58.213199 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 309/577] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:57 2022] GET /compute/v2.1/servers/d5e996e9-dc9f-46e3-8469-e46dc2932b24 => generated 1319 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:59.192190 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3e5dc3a3-f273-491b-8137-92c65e439258 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:59.193443 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3e5dc3a3-f273-491b-8137-92c65e439258 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] [instance: 49d830ea-1eab-4d6b-b571-4aa5434d897e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:59.206369 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3e5dc3a3-f273-491b-8137-92c65e439258 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:59.208095 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3e5dc3a3-f273-491b-8137-92c65e439258 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:59.212666 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3e5dc3a3-f273-491b-8137-92c65e439258 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:59.213944 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3e5dc3a3-f273-491b-8137-92c65e439258 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:59.214661 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3e5dc3a3-f273-491b-8137-92c65e439258 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:59.215328 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3e5dc3a3-f273-491b-8137-92c65e439258 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:59.237570 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-179d16a0-7462-4956-ae87-505a802d9d3e tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:59.239775 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-179d16a0-7462-4956-ae87-505a802d9d3e tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: d5e996e9-dc9f-46e3-8469-e46dc2932b24] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:59.258739 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-179d16a0-7462-4956-ae87-505a802d9d3e tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:59.259423 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-179d16a0-7462-4956-ae87-505a802d9d3e tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:59.260037 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-179d16a0-7462-4956-ae87-505a802d9d3e tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:59.262129 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-179d16a0-7462-4956-ae87-505a802d9d3e tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:59.262129 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-179d16a0-7462-4956-ae87-505a802d9d3e tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:59.264318 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-179d16a0-7462-4956-ae87-505a802d9d3e tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:59.852734 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3e5dc3a3-f273-491b-8137-92c65e439258 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c11a7c3cec94797b639e6e53dcbfb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375d02476ed240ea967eb2e28e8474ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:59.867003 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3e5dc3a3-f273-491b-8137-92c65e439258 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] 10.222.0.20 "GET /compute/v2.1/servers/49d830ea-1eab-4d6b-b571-4aa5434d897e" status: 200 len: 1321 microversion: 2.1 time: 0.683532 Oct 04 18:29:59.869397 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 269/578] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:59 2022] GET /compute/v2.1/servers/49d830ea-1eab-4d6b-b571-4aa5434d897e => generated 1321 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:59.878831 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-4a0a115f-947f-4684-acc1-3e31a487d2e2 req-de198b44-42de-4259-a8fd-775c6059de70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d07c478-8e9c-4000-92bb-3fa4547ea6c0", "name": "network-vif-plugged", "status": "completed", "tag": "0f86385e-8401-4a2d-ab06-7b090939385b"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:59.902732 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-179d16a0-7462-4956-ae87-505a802d9d3e tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:59.910933 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-4a0a115f-947f-4684-acc1-3e31a487d2e2 req-de198b44-42de-4259-a8fd-775c6059de70 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:59.914194 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-4a0a115f-947f-4684-acc1-3e31a487d2e2 req-de198b44-42de-4259-a8fd-775c6059de70 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:59.917783 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-4a0a115f-947f-4684-acc1-3e31a487d2e2 req-de198b44-42de-4259-a8fd-775c6059de70 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:59.918817 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-179d16a0-7462-4956-ae87-505a802d9d3e tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e996e9-dc9f-46e3-8469-e46dc2932b24" status: 200 len: 1319 microversion: 2.1 time: 0.686474 Oct 04 18:29:59.920149 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 310/579] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:59 2022] GET /compute/v2.1/servers/d5e996e9-dc9f-46e3-8469-e46dc2932b24 => generated 1319 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:59.945634 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-4a0a115f-947f-4684-acc1-3e31a487d2e2 req-de198b44-42de-4259-a8fd-775c6059de70 service nova] Creating event network-vif-plugged:0f86385e-8401-4a2d-ab06-7b090939385b for instance 2d07c478-8e9c-4000-92bb-3fa4547ea6c0 on n-h1-850501-14 Oct 04 18:29:59.956914 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-4a0a115f-947f-4684-acc1-3e31a487d2e2 req-de198b44-42de-4259-a8fd-775c6059de70 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085868 Oct 04 18:29:59.959009 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 270/580] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:29:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:30:00.923486 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-fc43be0d-31ae-4682-b03e-ed9abb00b398 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:00.923486 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-fc43be0d-31ae-4682-b03e-ed9abb00b398 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] [instance: 49d830ea-1eab-4d6b-b571-4aa5434d897e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:00.955134 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9ebc841e-88d0-4fe4-b638-ee5f0d0c8db2 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:00.961698 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9ebc841e-88d0-4fe4-b638-ee5f0d0c8db2 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: d5e996e9-dc9f-46e3-8469-e46dc2932b24] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:00.973952 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9ebc841e-88d0-4fe4-b638-ee5f0d0c8db2 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:00.974857 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fc43be0d-31ae-4682-b03e-ed9abb00b398 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:00.979482 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9ebc841e-88d0-4fe4-b638-ee5f0d0c8db2 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:00.983850 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9ebc841e-88d0-4fe4-b638-ee5f0d0c8db2 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:00.985154 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fc43be0d-31ae-4682-b03e-ed9abb00b398 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:00.986817 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fc43be0d-31ae-4682-b03e-ed9abb00b398 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:00.987483 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9ebc841e-88d0-4fe4-b638-ee5f0d0c8db2 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:00.998271 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fc43be0d-31ae-4682-b03e-ed9abb00b398 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:00.998271 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fc43be0d-31ae-4682-b03e-ed9abb00b398 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:00.998504 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9ebc841e-88d0-4fe4-b638-ee5f0d0c8db2 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:00.998633 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fc43be0d-31ae-4682-b03e-ed9abb00b398 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:00.998740 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9ebc841e-88d0-4fe4-b638-ee5f0d0c8db2 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:01.869031 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9ebc841e-88d0-4fe4-b638-ee5f0d0c8db2 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:01.912532 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9ebc841e-88d0-4fe4-b638-ee5f0d0c8db2 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e996e9-dc9f-46e3-8469-e46dc2932b24" status: 200 len: 1319 microversion: 2.1 time: 0.968280 Oct 04 18:30:01.914056 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 271/581] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:00 2022] GET /compute/v2.1/servers/d5e996e9-dc9f-46e3-8469-e46dc2932b24 => generated 1319 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:01.919334 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-74b7c42d-593f-485b-83b8-994b754afe45 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:01.932688 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-74b7c42d-593f-485b-83b8-994b754afe45 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] [instance: ff1c16fb-1167-4285-8d0c-c0fbb78a2883] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:01.958312 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-74b7c42d-593f-485b-83b8-994b754afe45 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:01.959007 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-74b7c42d-593f-485b-83b8-994b754afe45 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:01.971503 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-74b7c42d-593f-485b-83b8-994b754afe45 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:01.973057 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-74b7c42d-593f-485b-83b8-994b754afe45 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:01.973652 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-74b7c42d-593f-485b-83b8-994b754afe45 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:01.974395 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-74b7c42d-593f-485b-83b8-994b754afe45 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:02.055140 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-fc43be0d-31ae-4682-b03e-ed9abb00b398 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c11a7c3cec94797b639e6e53dcbfb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375d02476ed240ea967eb2e28e8474ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:02.064761 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-fc43be0d-31ae-4682-b03e-ed9abb00b398 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] 10.222.0.20 "GET /compute/v2.1/servers/49d830ea-1eab-4d6b-b571-4aa5434d897e" status: 200 len: 1321 microversion: 2.1 time: 1.173312 Oct 04 18:30:02.070092 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-74b7c42d-593f-485b-83b8-994b754afe45 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] [instance: ff1c16fb-1167-4285-8d0c-c0fbb78a2883] Going to try to terminate instance {{(pid=123002) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:30:02.077961 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 311/582] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:00 2022] GET /compute/v2.1/servers/49d830ea-1eab-4d6b-b571-4aa5434d897e => generated 1321 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:02.533249 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-74b7c42d-593f-485b-83b8-994b754afe45 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ff1c16fb-1167-4285-8d0c-c0fbb78a2883" status: 204 len: 0 microversion: 2.1 time: 0.616751 Oct 04 18:30:02.543919 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 272/583] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:30:01 2022] DELETE /compute/v2.1/servers/ff1c16fb-1167-4285-8d0c-c0fbb78a2883 => generated 0 bytes in 620 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:30:02.707118 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-acae64bf-1bb3-4ffb-86fa-0376ea701731 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1648260645", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "1799497983", "adminPass": "***", "networks": [{"uuid": "efe063a4-9cbc-4160-9e09-9b7d773c6a3e"}], "security_groups": [{"name": "tempest-securitygroup--1053507296"}], "key_name": "tempest-keypair-1365947858", "user_data": "}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:02.942344 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1894565b-fac2-4302-a267-c7d978e46573 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:02.943448 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1894565b-fac2-4302-a267-c7d978e46573 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: d5e996e9-dc9f-46e3-8469-e46dc2932b24] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:02.965317 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1894565b-fac2-4302-a267-c7d978e46573 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:02.974618 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1894565b-fac2-4302-a267-c7d978e46573 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:02.979575 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1894565b-fac2-4302-a267-c7d978e46573 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:02.980852 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1894565b-fac2-4302-a267-c7d978e46573 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:02.981556 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1894565b-fac2-4302-a267-c7d978e46573 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:02.985349 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1894565b-fac2-4302-a267-c7d978e46573 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:03.301111 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.neutron [None req-acae64bf-1bb3-4ffb-86fa-0376ea701731 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] validate_networks() for [('efe063a4-9cbc-4160-9e09-9b7d773c6a3e', None, None, None, None, None)] {{(pid=123001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:30:03.842884 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1894565b-fac2-4302-a267-c7d978e46573 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:03.863240 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1894565b-fac2-4302-a267-c7d978e46573 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e996e9-dc9f-46e3-8469-e46dc2932b24" status: 200 len: 1319 microversion: 2.1 time: 0.920756 Oct 04 18:30:03.870304 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 273/584] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:02 2022] GET /compute/v2.1/servers/d5e996e9-dc9f-46e3-8469-e46dc2932b24 => generated 1319 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:03.877862 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-09247edf-9584-4d0c-9221-6b875d699ea0 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:03.878703 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-09247edf-9584-4d0c-9221-6b875d699ea0 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] [instance: 49d830ea-1eab-4d6b-b571-4aa5434d897e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:03.890242 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:30:03.894804 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-09247edf-9584-4d0c-9221-6b875d699ea0 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:03.895853 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-09247edf-9584-4d0c-9221-6b875d699ea0 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:03.896601 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-09247edf-9584-4d0c-9221-6b875d699ea0 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:03.899261 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-09247edf-9584-4d0c-9221-6b875d699ea0 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:03.900546 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-09247edf-9584-4d0c-9221-6b875d699ea0 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:03.902348 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-09247edf-9584-4d0c-9221-6b875d699ea0 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:05.496196 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-09247edf-9584-4d0c-9221-6b875d699ea0 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c11a7c3cec94797b639e6e53dcbfb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375d02476ed240ea967eb2e28e8474ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:05.518530 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-09247edf-9584-4d0c-9221-6b875d699ea0 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] 10.222.0.20 "GET /compute/v2.1/servers/49d830ea-1eab-4d6b-b571-4aa5434d897e" status: 200 len: 1321 microversion: 2.1 time: 1.645788 Oct 04 18:30:05.548937 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 274/585] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:03 2022] GET /compute/v2.1/servers/49d830ea-1eab-4d6b-b571-4aa5434d897e => generated 1321 bytes in 1677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:05.563657 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-219dd8a4-2479-4efe-8921-bcc5987dcaeb tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:05.564565 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-219dd8a4-2479-4efe-8921-bcc5987dcaeb tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: d5e996e9-dc9f-46e3-8469-e46dc2932b24] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:05.577799 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-219dd8a4-2479-4efe-8921-bcc5987dcaeb tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:05.580726 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-219dd8a4-2479-4efe-8921-bcc5987dcaeb tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:05.582587 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-219dd8a4-2479-4efe-8921-bcc5987dcaeb tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:05.583525 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-219dd8a4-2479-4efe-8921-bcc5987dcaeb tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:05.586600 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-219dd8a4-2479-4efe-8921-bcc5987dcaeb tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:05.587322 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-219dd8a4-2479-4efe-8921-bcc5987dcaeb tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:06.425080 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-acae64bf-1bb3-4ffb-86fa-0376ea701731 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:30:06.425080 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-acae64bf-1bb3-4ffb-86fa-0376ea701731 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:30:06.425080 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-acae64bf-1bb3-4ffb-86fa-0376ea701731 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:30:06.425080 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-acae64bf-1bb3-4ffb-86fa-0376ea701731 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:30:06.425080 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-acae64bf-1bb3-4ffb-86fa-0376ea701731 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:30:06.450499 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-acae64bf-1bb3-4ffb-86fa-0376ea701731 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:06.460868 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-acae64bf-1bb3-4ffb-86fa-0376ea701731 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:06.461436 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-acae64bf-1bb3-4ffb-86fa-0376ea701731 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:06.462521 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-acae64bf-1bb3-4ffb-86fa-0376ea701731 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:06.464625 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-acae64bf-1bb3-4ffb-86fa-0376ea701731 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:06.467537 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-acae64bf-1bb3-4ffb-86fa-0376ea701731 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:06.586750 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-219dd8a4-2479-4efe-8921-bcc5987dcaeb tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:06.622640 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-acae64bf-1bb3-4ffb-86fa-0376ea701731 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Getting quotas for project 25214dec3ef24597be8e5acde61de3eb. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:30:06.653664 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-219dd8a4-2479-4efe-8921-bcc5987dcaeb tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e996e9-dc9f-46e3-8469-e46dc2932b24" status: 200 len: 1319 microversion: 2.1 time: 1.101718 Oct 04 18:30:06.668988 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 275/586] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:05 2022] GET /compute/v2.1/servers/d5e996e9-dc9f-46e3-8469-e46dc2932b24 => generated 1319 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:06.681961 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-acae64bf-1bb3-4ffb-86fa-0376ea701731 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Getting quotas for user 8675d7d8bab840f3a221fdf2ee4c9b5c and project 25214dec3ef24597be8e5acde61de3eb. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:30:06.687075 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-1fca51f8-87cb-44c2-9773-379e4d94fd8d req-d04fac77-ddd7-40f3-9e5e-7728781a638a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49d830ea-1eab-4d6b-b571-4aa5434d897e", "name": "network-vif-plugged", "status": "completed", "tag": "a7dbb653-fbbe-4479-b569-0226403a1c50"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:06.765960 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-1fca51f8-87cb-44c2-9773-379e4d94fd8d req-d04fac77-ddd7-40f3-9e5e-7728781a638a service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:06.771914 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-1fca51f8-87cb-44c2-9773-379e4d94fd8d req-d04fac77-ddd7-40f3-9e5e-7728781a638a service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:06.774603 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-1fca51f8-87cb-44c2-9773-379e4d94fd8d req-d04fac77-ddd7-40f3-9e5e-7728781a638a service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:06.780022 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-acae64bf-1bb3-4ffb-86fa-0376ea701731 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Going to run 1 instances... {{(pid=123001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:30:06.788495 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-acae64bf-1bb3-4ffb-86fa-0376ea701731 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] [instance: c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=123001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:30:06.815970 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-1fca51f8-87cb-44c2-9773-379e4d94fd8d req-d04fac77-ddd7-40f3-9e5e-7728781a638a service nova] Creating event network-vif-plugged:a7dbb653-fbbe-4479-b569-0226403a1c50 for instance 49d830ea-1eab-4d6b-b571-4aa5434d897e on n-h1-850501-14 Oct 04 18:30:06.843007 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-1fca51f8-87cb-44c2-9773-379e4d94fd8d req-d04fac77-ddd7-40f3-9e5e-7728781a638a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.172353 Oct 04 18:30:06.899900 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 276/587] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:30:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:30:06.925461 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-913ca5ba-7bd4-4907-86b0-66eeff94c8ab tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:06.935664 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-913ca5ba-7bd4-4907-86b0-66eeff94c8ab tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] [instance: 49d830ea-1eab-4d6b-b571-4aa5434d897e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:06.958170 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-913ca5ba-7bd4-4907-86b0-66eeff94c8ab tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:06.959032 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-913ca5ba-7bd4-4907-86b0-66eeff94c8ab tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:06.960035 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-913ca5ba-7bd4-4907-86b0-66eeff94c8ab tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:06.962198 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-913ca5ba-7bd4-4907-86b0-66eeff94c8ab tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:06.963044 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-913ca5ba-7bd4-4907-86b0-66eeff94c8ab tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:06.964121 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-913ca5ba-7bd4-4907-86b0-66eeff94c8ab tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:07.059870 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-acae64bf-1bb3-4ffb-86fa-0376ea701731 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.358566 Oct 04 18:30:07.067579 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 312/588] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:30:02 2022] POST /compute/v2.1/servers => generated 402 bytes in 4367 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:30:07.084217 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-739cdc6d-6b7b-4efb-8b10-0e1825044ef6 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:07.086213 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-739cdc6d-6b7b-4efb-8b10-0e1825044ef6 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] [instance: c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:07.410449 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-739cdc6d-6b7b-4efb-8b10-0e1825044ef6 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8675d7d8bab840f3a221fdf2ee4c9b5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25214dec3ef24597be8e5acde61de3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:07.446854 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-739cdc6d-6b7b-4efb-8b10-0e1825044ef6 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] 10.222.0.20 "GET /compute/v2.1/servers/c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23" status: 200 len: 1265 microversion: 2.1 time: 0.371411 Oct 04 18:30:07.477659 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 313/589] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:07 2022] GET /compute/v2.1/servers/c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23 => generated 1265 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:30:07.566047 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-913ca5ba-7bd4-4907-86b0-66eeff94c8ab tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c11a7c3cec94797b639e6e53dcbfb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375d02476ed240ea967eb2e28e8474ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:07.585729 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-913ca5ba-7bd4-4907-86b0-66eeff94c8ab tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] 10.222.0.20 "GET /compute/v2.1/servers/49d830ea-1eab-4d6b-b571-4aa5434d897e" status: 200 len: 1321 microversion: 2.1 time: 0.681683 Oct 04 18:30:07.596545 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 277/590] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:06 2022] GET /compute/v2.1/servers/49d830ea-1eab-4d6b-b571-4aa5434d897e => generated 1321 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:07.709891 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-96b8dacf-32bf-4541-b220-897911d5b4ba tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:07.711396 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-96b8dacf-32bf-4541-b220-897911d5b4ba tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: d5e996e9-dc9f-46e3-8469-e46dc2932b24] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:07.732091 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-96b8dacf-32bf-4541-b220-897911d5b4ba tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:07.732972 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-96b8dacf-32bf-4541-b220-897911d5b4ba tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:07.734042 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-96b8dacf-32bf-4541-b220-897911d5b4ba tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:07.734950 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-96b8dacf-32bf-4541-b220-897911d5b4ba tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:07.737573 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-96b8dacf-32bf-4541-b220-897911d5b4ba tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:07.739964 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-96b8dacf-32bf-4541-b220-897911d5b4ba tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:08.467115 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-96b8dacf-32bf-4541-b220-897911d5b4ba tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:08.483152 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0f0a174e-3d4c-4b2f-807a-5de7110d13d2 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:08.484037 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0f0a174e-3d4c-4b2f-807a-5de7110d13d2 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] [instance: c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:08.484217 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-96b8dacf-32bf-4541-b220-897911d5b4ba tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e996e9-dc9f-46e3-8469-e46dc2932b24" status: 200 len: 1319 microversion: 2.1 time: 0.781876 Oct 04 18:30:08.490488 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 314/591] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:07 2022] GET /compute/v2.1/servers/d5e996e9-dc9f-46e3-8469-e46dc2932b24 => generated 1319 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:08.613701 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-438803d3-67dd-4c2a-8588-666092a90ee9 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:08.614325 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-438803d3-67dd-4c2a-8588-666092a90ee9 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] [instance: 49d830ea-1eab-4d6b-b571-4aa5434d897e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:08.625688 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-438803d3-67dd-4c2a-8588-666092a90ee9 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:08.628655 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-438803d3-67dd-4c2a-8588-666092a90ee9 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:08.629321 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-438803d3-67dd-4c2a-8588-666092a90ee9 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:08.630224 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-438803d3-67dd-4c2a-8588-666092a90ee9 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:08.633604 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-438803d3-67dd-4c2a-8588-666092a90ee9 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:08.634233 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-438803d3-67dd-4c2a-8588-666092a90ee9 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:08.647369 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0f0a174e-3d4c-4b2f-807a-5de7110d13d2 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8675d7d8bab840f3a221fdf2ee4c9b5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25214dec3ef24597be8e5acde61de3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:08.661839 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0f0a174e-3d4c-4b2f-807a-5de7110d13d2 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] 10.222.0.20 "GET /compute/v2.1/servers/c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23" status: 200 len: 1265 microversion: 2.1 time: 0.184339 Oct 04 18:30:08.663011 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 278/592] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:08 2022] GET /compute/v2.1/servers/c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23 => generated 1265 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:09.010878 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-3d863ca6-1adc-4252-b371-747f5ba053ba req-3e5d6eb5-ae72-4068-8c55-343918bb0140 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff1c16fb-1167-4285-8d0c-c0fbb78a2883", "name": "network-vif-deleted", "tag": "afa1da21-3240-4ddb-b1d7-ec031e238dee"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:09.079196 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-3d863ca6-1adc-4252-b371-747f5ba053ba req-3e5d6eb5-ae72-4068-8c55-343918bb0140 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:09.079693 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-3d863ca6-1adc-4252-b371-747f5ba053ba req-3e5d6eb5-ae72-4068-8c55-343918bb0140 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:09.080145 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-3d863ca6-1adc-4252-b371-747f5ba053ba req-3e5d6eb5-ae72-4068-8c55-343918bb0140 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:09.081286 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-438803d3-67dd-4c2a-8588-666092a90ee9 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c11a7c3cec94797b639e6e53dcbfb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375d02476ed240ea967eb2e28e8474ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:09.105378 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-438803d3-67dd-4c2a-8588-666092a90ee9 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] 10.222.0.20 "GET /compute/v2.1/servers/49d830ea-1eab-4d6b-b571-4aa5434d897e" status: 200 len: 1321 microversion: 2.1 time: 0.495079 Oct 04 18:30:09.111247 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-3d863ca6-1adc-4252-b371-747f5ba053ba req-3e5d6eb5-ae72-4068-8c55-343918bb0140 service nova] Creating event network-vif-deleted:afa1da21-3240-4ddb-b1d7-ec031e238dee for instance ff1c16fb-1167-4285-8d0c-c0fbb78a2883 on n-h2-850501-14 Oct 04 18:30:09.122603 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 315/593] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:08 2022] GET /compute/v2.1/servers/49d830ea-1eab-4d6b-b571-4aa5434d897e => generated 1321 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:09.124827 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-3d863ca6-1adc-4252-b371-747f5ba053ba req-3e5d6eb5-ae72-4068-8c55-343918bb0140 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118315 Oct 04 18:30:09.125897 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 279/594] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:30:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:30:09.188199 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-2b36cd3a-4c6b-4033-b010-2b6695ee318e req-5129915e-e464-49e3-b75c-c8a11cfc177f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5e996e9-dc9f-46e3-8469-e46dc2932b24", "name": "network-vif-plugged", "status": "completed", "tag": "07eac084-b2dc-4fbf-9f40-12ca4aeead64"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:09.215590 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-2b36cd3a-4c6b-4033-b010-2b6695ee318e req-5129915e-e464-49e3-b75c-c8a11cfc177f service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:09.218638 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-2b36cd3a-4c6b-4033-b010-2b6695ee318e req-5129915e-e464-49e3-b75c-c8a11cfc177f service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:09.219320 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-2b36cd3a-4c6b-4033-b010-2b6695ee318e req-5129915e-e464-49e3-b75c-c8a11cfc177f service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:09.245045 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-2b36cd3a-4c6b-4033-b010-2b6695ee318e req-5129915e-e464-49e3-b75c-c8a11cfc177f service nova] Creating event network-vif-plugged:07eac084-b2dc-4fbf-9f40-12ca4aeead64 for instance d5e996e9-dc9f-46e3-8469-e46dc2932b24 on n-h2-850501-14 Oct 04 18:30:09.251746 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-2b36cd3a-4c6b-4033-b010-2b6695ee318e req-5129915e-e464-49e3-b75c-c8a11cfc177f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069941 Oct 04 18:30:09.252991 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 316/595] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:30:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:30:09.520354 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e7f1cb8b-5b4c-4570-a500-9fb1b3d2f24b tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:09.520354 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e7f1cb8b-5b4c-4570-a500-9fb1b3d2f24b tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: d5e996e9-dc9f-46e3-8469-e46dc2932b24] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:09.531844 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e7f1cb8b-5b4c-4570-a500-9fb1b3d2f24b tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:09.532495 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e7f1cb8b-5b4c-4570-a500-9fb1b3d2f24b tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:09.534529 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e7f1cb8b-5b4c-4570-a500-9fb1b3d2f24b tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:09.537430 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e7f1cb8b-5b4c-4570-a500-9fb1b3d2f24b tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:09.537948 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e7f1cb8b-5b4c-4570-a500-9fb1b3d2f24b tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:09.539726 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e7f1cb8b-5b4c-4570-a500-9fb1b3d2f24b tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:09.703047 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-af0f2fa1-3415-40cc-be26-4efe94b9217a tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:09.704534 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-af0f2fa1-3415-40cc-be26-4efe94b9217a tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] [instance: c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:09.744188 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-af0f2fa1-3415-40cc-be26-4efe94b9217a tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:09.745982 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-af0f2fa1-3415-40cc-be26-4efe94b9217a tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:09.746869 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-af0f2fa1-3415-40cc-be26-4efe94b9217a tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:09.747855 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-af0f2fa1-3415-40cc-be26-4efe94b9217a tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:09.748564 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-af0f2fa1-3415-40cc-be26-4efe94b9217a tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:09.749171 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-af0f2fa1-3415-40cc-be26-4efe94b9217a tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:09.895097 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-af0f2fa1-3415-40cc-be26-4efe94b9217a tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8675d7d8bab840f3a221fdf2ee4c9b5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25214dec3ef24597be8e5acde61de3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:09.915402 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-af0f2fa1-3415-40cc-be26-4efe94b9217a tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] 10.222.0.20 "GET /compute/v2.1/servers/c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23" status: 200 len: 1269 microversion: 2.1 time: 0.220389 Oct 04 18:30:09.929442 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 317/596] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:09 2022] GET /compute/v2.1/servers/c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23 => generated 1269 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:30:10.140417 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f5075421-399e-448d-9d4b-5427cb0e8f26 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:10.141127 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f5075421-399e-448d-9d4b-5427cb0e8f26 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] [instance: 49d830ea-1eab-4d6b-b571-4aa5434d897e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:10.156773 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e7f1cb8b-5b4c-4570-a500-9fb1b3d2f24b tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:10.161430 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f5075421-399e-448d-9d4b-5427cb0e8f26 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:10.161876 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f5075421-399e-448d-9d4b-5427cb0e8f26 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:10.162317 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f5075421-399e-448d-9d4b-5427cb0e8f26 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:10.165615 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f5075421-399e-448d-9d4b-5427cb0e8f26 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:10.166911 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f5075421-399e-448d-9d4b-5427cb0e8f26 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:10.167121 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f5075421-399e-448d-9d4b-5427cb0e8f26 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:10.168610 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e7f1cb8b-5b4c-4570-a500-9fb1b3d2f24b tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e996e9-dc9f-46e3-8469-e46dc2932b24" status: 200 len: 1319 microversion: 2.1 time: 0.655521 Oct 04 18:30:10.172735 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 280/597] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:09 2022] GET /compute/v2.1/servers/d5e996e9-dc9f-46e3-8469-e46dc2932b24 => generated 1319 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:10.692312 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f5075421-399e-448d-9d4b-5427cb0e8f26 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c11a7c3cec94797b639e6e53dcbfb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375d02476ed240ea967eb2e28e8474ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:10.707115 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f5075421-399e-448d-9d4b-5427cb0e8f26 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] 10.222.0.20 "GET /compute/v2.1/servers/49d830ea-1eab-4d6b-b571-4aa5434d897e" status: 200 len: 1471 microversion: 2.1 time: 0.571215 Oct 04 18:30:10.730733 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 318/598] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:10 2022] GET /compute/v2.1/servers/49d830ea-1eab-4d6b-b571-4aa5434d897e => generated 1471 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:30:10.736042 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-00d5caef-ab6c-489d-b7c0-8bd8e31e6042 tempest-ServersAdminNegativeTestJSON-1850710304 tempest-ServersAdminNegativeTestJSON-1850710304-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:10.737454 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-00d5caef-ab6c-489d-b7c0-8bd8e31e6042 tempest-ServersAdminNegativeTestJSON-1850710304 tempest-ServersAdminNegativeTestJSON-1850710304-project-admin] [instance: 49d830ea-1eab-4d6b-b571-4aa5434d897e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:10.749411 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-00d5caef-ab6c-489d-b7c0-8bd8e31e6042 tempest-ServersAdminNegativeTestJSON-1850710304 tempest-ServersAdminNegativeTestJSON-1850710304-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:10.752941 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-00d5caef-ab6c-489d-b7c0-8bd8e31e6042 tempest-ServersAdminNegativeTestJSON-1850710304 tempest-ServersAdminNegativeTestJSON-1850710304-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:10.753507 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-00d5caef-ab6c-489d-b7c0-8bd8e31e6042 tempest-ServersAdminNegativeTestJSON-1850710304 tempest-ServersAdminNegativeTestJSON-1850710304-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:10.754392 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-00d5caef-ab6c-489d-b7c0-8bd8e31e6042 tempest-ServersAdminNegativeTestJSON-1850710304 tempest-ServersAdminNegativeTestJSON-1850710304-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:10.756794 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-00d5caef-ab6c-489d-b7c0-8bd8e31e6042 tempest-ServersAdminNegativeTestJSON-1850710304 tempest-ServersAdminNegativeTestJSON-1850710304-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:10.757492 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-00d5caef-ab6c-489d-b7c0-8bd8e31e6042 tempest-ServersAdminNegativeTestJSON-1850710304 tempest-ServersAdminNegativeTestJSON-1850710304-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:10.942509 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3f7e841f-5941-40f1-8e10-2bcdc8341694 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:10.946703 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3f7e841f-5941-40f1-8e10-2bcdc8341694 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] [instance: c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:10.958743 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3f7e841f-5941-40f1-8e10-2bcdc8341694 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:10.959247 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3f7e841f-5941-40f1-8e10-2bcdc8341694 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:10.959690 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3f7e841f-5941-40f1-8e10-2bcdc8341694 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:10.966631 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3f7e841f-5941-40f1-8e10-2bcdc8341694 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:10.967155 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3f7e841f-5941-40f1-8e10-2bcdc8341694 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:10.976169 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3f7e841f-5941-40f1-8e10-2bcdc8341694 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:10.980403 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-00d5caef-ab6c-489d-b7c0-8bd8e31e6042 tempest-ServersAdminNegativeTestJSON-1850710304 tempest-ServersAdminNegativeTestJSON-1850710304-project-admin] Lazy-loading 'flavor' on Instance uuid 49d830ea-1eab-4d6b-b571-4aa5434d897e {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:30:11.296679 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:30:11.398347 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-00d5caef-ab6c-489d-b7c0-8bd8e31e6042 tempest-ServersAdminNegativeTestJSON-1850710304 tempest-ServersAdminNegativeTestJSON-1850710304-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/49d830ea-1eab-4d6b-b571-4aa5434d897e/action" status: 202 len: 0 microversion: 2.1 time: 0.666671 Oct 04 18:30:11.401876 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 281/599] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:30:10 2022] POST /compute/v2.1/servers/49d830ea-1eab-4d6b-b571-4aa5434d897e/action => generated 0 bytes in 671 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:30:11.433538 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6f749b47-9743-46f4-acd5-785ac8ff6cf7 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:11.441971 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-6f749b47-9743-46f4-acd5-785ac8ff6cf7 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: d5e996e9-dc9f-46e3-8469-e46dc2932b24] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:11.479364 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6f749b47-9743-46f4-acd5-785ac8ff6cf7 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:11.483988 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6f749b47-9743-46f4-acd5-785ac8ff6cf7 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:11.484656 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6f749b47-9743-46f4-acd5-785ac8ff6cf7 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:11.485561 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6f749b47-9743-46f4-acd5-785ac8ff6cf7 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:11.486194 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6f749b47-9743-46f4-acd5-785ac8ff6cf7 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:11.486774 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6f749b47-9743-46f4-acd5-785ac8ff6cf7 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:11.678759 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3f7e841f-5941-40f1-8e10-2bcdc8341694 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8675d7d8bab840f3a221fdf2ee4c9b5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25214dec3ef24597be8e5acde61de3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:11.693461 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3f7e841f-5941-40f1-8e10-2bcdc8341694 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] 10.222.0.20 "GET /compute/v2.1/servers/c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23" status: 200 len: 1261 microversion: 2.1 time: 0.751600 Oct 04 18:30:11.714451 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 319/600] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:10 2022] GET /compute/v2.1/servers/c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23 => generated 1261 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:30:11.738538 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-146fd13f-7047-4819-994a-a43a35267a51 tempest-ServersAdminNegativeTestJSON-1850710304 tempest-ServersAdminNegativeTestJSON-1850710304-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:11.740862 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-146fd13f-7047-4819-994a-a43a35267a51 tempest-ServersAdminNegativeTestJSON-1850710304 tempest-ServersAdminNegativeTestJSON-1850710304-project-admin] [instance: 49d830ea-1eab-4d6b-b571-4aa5434d897e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:11.777427 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-146fd13f-7047-4819-994a-a43a35267a51 tempest-ServersAdminNegativeTestJSON-1850710304 tempest-ServersAdminNegativeTestJSON-1850710304-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:11.779844 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-146fd13f-7047-4819-994a-a43a35267a51 tempest-ServersAdminNegativeTestJSON-1850710304 tempest-ServersAdminNegativeTestJSON-1850710304-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:11.780715 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-146fd13f-7047-4819-994a-a43a35267a51 tempest-ServersAdminNegativeTestJSON-1850710304 tempest-ServersAdminNegativeTestJSON-1850710304-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:11.783015 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-146fd13f-7047-4819-994a-a43a35267a51 tempest-ServersAdminNegativeTestJSON-1850710304 tempest-ServersAdminNegativeTestJSON-1850710304-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:11.783653 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-146fd13f-7047-4819-994a-a43a35267a51 tempest-ServersAdminNegativeTestJSON-1850710304 tempest-ServersAdminNegativeTestJSON-1850710304-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:11.784357 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-146fd13f-7047-4819-994a-a43a35267a51 tempest-ServersAdminNegativeTestJSON-1850710304 tempest-ServersAdminNegativeTestJSON-1850710304-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:12.493301 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-6f749b47-9743-46f4-acd5-785ac8ff6cf7 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:12.508042 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6f749b47-9743-46f4-acd5-785ac8ff6cf7 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e996e9-dc9f-46e3-8469-e46dc2932b24" status: 200 len: 1319 microversion: 2.1 time: 1.098211 Oct 04 18:30:12.511873 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 282/601] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:11 2022] GET /compute/v2.1/servers/d5e996e9-dc9f-46e3-8469-e46dc2932b24 => generated 1319 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:12.731189 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-52d379a6-d050-4f68-a0ce-d9e9df4ae2c2 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:12.732360 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-52d379a6-d050-4f68-a0ce-d9e9df4ae2c2 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] [instance: c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:12.777634 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-52d379a6-d050-4f68-a0ce-d9e9df4ae2c2 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:12.777737 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-52d379a6-d050-4f68-a0ce-d9e9df4ae2c2 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:12.778119 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-52d379a6-d050-4f68-a0ce-d9e9df4ae2c2 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:12.778898 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-52d379a6-d050-4f68-a0ce-d9e9df4ae2c2 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:12.782375 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-52d379a6-d050-4f68-a0ce-d9e9df4ae2c2 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:12.784455 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-52d379a6-d050-4f68-a0ce-d9e9df4ae2c2 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:12.986272 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-52d379a6-d050-4f68-a0ce-d9e9df4ae2c2 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8675d7d8bab840f3a221fdf2ee4c9b5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25214dec3ef24597be8e5acde61de3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:13.002247 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-52d379a6-d050-4f68-a0ce-d9e9df4ae2c2 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] 10.222.0.20 "GET /compute/v2.1/servers/c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23" status: 200 len: 1317 microversion: 2.1 time: 0.282062 Oct 04 18:30:13.018045 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 283/602] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:12 2022] GET /compute/v2.1/servers/c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23 => generated 1317 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:13.536191 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5aff107a-2694-44b5-8f75-a06dd22df833 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:13.536907 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5aff107a-2694-44b5-8f75-a06dd22df833 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: d5e996e9-dc9f-46e3-8469-e46dc2932b24] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:13.552461 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5aff107a-2694-44b5-8f75-a06dd22df833 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:13.555383 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5aff107a-2694-44b5-8f75-a06dd22df833 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:13.559470 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5aff107a-2694-44b5-8f75-a06dd22df833 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:13.560444 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5aff107a-2694-44b5-8f75-a06dd22df833 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:13.561133 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5aff107a-2694-44b5-8f75-a06dd22df833 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:13.561736 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5aff107a-2694-44b5-8f75-a06dd22df833 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:13.813132 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-146fd13f-7047-4819-994a-a43a35267a51 tempest-ServersAdminNegativeTestJSON-1850710304 tempest-ServersAdminNegativeTestJSON-1850710304-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/49d830ea-1eab-4d6b-b571-4aa5434d897e" status: 200 len: 1632 microversion: 2.1 time: 2.081378 Oct 04 18:30:13.816438 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 320/603] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:11 2022] GET /compute/v2.1/servers/49d830ea-1eab-4d6b-b571-4aa5434d897e => generated 1632 bytes in 2101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:14.028540 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d6b1b8ce-245f-45b3-8fe3-c98bfd43fb38 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:14.029452 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d6b1b8ce-245f-45b3-8fe3-c98bfd43fb38 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] [instance: c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:14.043807 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d6b1b8ce-245f-45b3-8fe3-c98bfd43fb38 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:14.047895 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d6b1b8ce-245f-45b3-8fe3-c98bfd43fb38 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:14.048656 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d6b1b8ce-245f-45b3-8fe3-c98bfd43fb38 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:14.049591 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d6b1b8ce-245f-45b3-8fe3-c98bfd43fb38 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:14.055284 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d6b1b8ce-245f-45b3-8fe3-c98bfd43fb38 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:14.056883 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d6b1b8ce-245f-45b3-8fe3-c98bfd43fb38 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:14.291374 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5aff107a-2694-44b5-8f75-a06dd22df833 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:14.294203 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d6b1b8ce-245f-45b3-8fe3-c98bfd43fb38 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8675d7d8bab840f3a221fdf2ee4c9b5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25214dec3ef24597be8e5acde61de3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:14.348261 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5aff107a-2694-44b5-8f75-a06dd22df833 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e996e9-dc9f-46e3-8469-e46dc2932b24" status: 200 len: 1469 microversion: 2.1 time: 0.795394 Oct 04 18:30:14.351498 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 284/604] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:13 2022] GET /compute/v2.1/servers/d5e996e9-dc9f-46e3-8469-e46dc2932b24 => generated 1469 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:14.362945 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-851f5454-06ae-4061-beeb-e388ea66a016 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:14.366489 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-851f5454-06ae-4061-beeb-e388ea66a016 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: 2d07c478-8e9c-4000-92bb-3fa4547ea6c0] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:14.369880 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d6b1b8ce-245f-45b3-8fe3-c98bfd43fb38 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] 10.222.0.20 "GET /compute/v2.1/servers/c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23" status: 200 len: 1323 microversion: 2.1 time: 0.334190 Oct 04 18:30:14.373644 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 321/605] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:14 2022] GET /compute/v2.1/servers/c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23 => generated 1323 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:14.383448 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-851f5454-06ae-4061-beeb-e388ea66a016 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:14.384686 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-851f5454-06ae-4061-beeb-e388ea66a016 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:14.385294 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-851f5454-06ae-4061-beeb-e388ea66a016 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:14.387083 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-851f5454-06ae-4061-beeb-e388ea66a016 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:14.387743 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-851f5454-06ae-4061-beeb-e388ea66a016 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:14.389318 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-851f5454-06ae-4061-beeb-e388ea66a016 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:14.857188 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-cae204bf-17a2-4941-b96a-8e03fa015a41 tempest-ServersAdminNegativeTestJSON-1850710304 tempest-ServersAdminNegativeTestJSON-1850710304-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:14.857919 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-cae204bf-17a2-4941-b96a-8e03fa015a41 tempest-ServersAdminNegativeTestJSON-1850710304 tempest-ServersAdminNegativeTestJSON-1850710304-project-admin] [instance: 49d830ea-1eab-4d6b-b571-4aa5434d897e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:14.880736 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cae204bf-17a2-4941-b96a-8e03fa015a41 tempest-ServersAdminNegativeTestJSON-1850710304 tempest-ServersAdminNegativeTestJSON-1850710304-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:14.883672 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cae204bf-17a2-4941-b96a-8e03fa015a41 tempest-ServersAdminNegativeTestJSON-1850710304 tempest-ServersAdminNegativeTestJSON-1850710304-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:14.901005 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cae204bf-17a2-4941-b96a-8e03fa015a41 tempest-ServersAdminNegativeTestJSON-1850710304 tempest-ServersAdminNegativeTestJSON-1850710304-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:14.902280 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cae204bf-17a2-4941-b96a-8e03fa015a41 tempest-ServersAdminNegativeTestJSON-1850710304 tempest-ServersAdminNegativeTestJSON-1850710304-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:14.902953 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cae204bf-17a2-4941-b96a-8e03fa015a41 tempest-ServersAdminNegativeTestJSON-1850710304 tempest-ServersAdminNegativeTestJSON-1850710304-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:14.913895 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cae204bf-17a2-4941-b96a-8e03fa015a41 tempest-ServersAdminNegativeTestJSON-1850710304 tempest-ServersAdminNegativeTestJSON-1850710304-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:15.692260 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-851f5454-06ae-4061-beeb-e388ea66a016 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:15.703795 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-851f5454-06ae-4061-beeb-e388ea66a016 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/2d07c478-8e9c-4000-92bb-3fa4547ea6c0" status: 200 len: 1469 microversion: 2.1 time: 1.342067 Oct 04 18:30:15.706463 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 285/606] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:14 2022] GET /compute/v2.1/servers/2d07c478-8e9c-4000-92bb-3fa4547ea6c0 => generated 1469 bytes in 1348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:30:15.732092 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-886b5bd1-0f53-4eed-93df-26d4eda4b9a5 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:15.732859 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-886b5bd1-0f53-4eed-93df-26d4eda4b9a5 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] [instance: c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:15.748377 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-886b5bd1-0f53-4eed-93df-26d4eda4b9a5 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:15.748875 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-886b5bd1-0f53-4eed-93df-26d4eda4b9a5 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:15.751521 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-886b5bd1-0f53-4eed-93df-26d4eda4b9a5 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:15.754437 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-886b5bd1-0f53-4eed-93df-26d4eda4b9a5 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:15.754954 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-886b5bd1-0f53-4eed-93df-26d4eda4b9a5 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:15.758029 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-886b5bd1-0f53-4eed-93df-26d4eda4b9a5 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:16.387269 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-886b5bd1-0f53-4eed-93df-26d4eda4b9a5 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8675d7d8bab840f3a221fdf2ee4c9b5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25214dec3ef24597be8e5acde61de3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:16.407367 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-cae204bf-17a2-4941-b96a-8e03fa015a41 tempest-ServersAdminNegativeTestJSON-1850710304 tempest-ServersAdminNegativeTestJSON-1850710304-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/49d830ea-1eab-4d6b-b571-4aa5434d897e" status: 200 len: 1615 microversion: 2.1 time: 1.567521 Oct 04 18:30:16.412246 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 322/607] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:14 2022] GET /compute/v2.1/servers/49d830ea-1eab-4d6b-b571-4aa5434d897e => generated 1615 bytes in 1578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:30:16.414402 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-886b5bd1-0f53-4eed-93df-26d4eda4b9a5 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] 10.222.0.20 "GET /compute/v2.1/servers/c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23" status: 200 len: 1323 microversion: 2.1 time: 0.706626 Oct 04 18:30:16.414987 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 286/608] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:15 2022] GET /compute/v2.1/servers/c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23 => generated 1323 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:16.435796 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-77ddc955-2d4d-4897-b056-f74c93ff6900 tempest-ServersAdminNegativeTestJSON-1850710304 tempest-ServersAdminNegativeTestJSON-1850710304-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:16.438555 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-77ddc955-2d4d-4897-b056-f74c93ff6900 tempest-ServersAdminNegativeTestJSON-1850710304 tempest-ServersAdminNegativeTestJSON-1850710304-project-admin] [instance: 49d830ea-1eab-4d6b-b571-4aa5434d897e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:16.443019 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d47d7bd5-3a89-493c-9450-23f04e9a2787 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:16.455860 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d47d7bd5-3a89-493c-9450-23f04e9a2787 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:16.457418 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-77ddc955-2d4d-4897-b056-f74c93ff6900 tempest-ServersAdminNegativeTestJSON-1850710304 tempest-ServersAdminNegativeTestJSON-1850710304-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:16.460480 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-77ddc955-2d4d-4897-b056-f74c93ff6900 tempest-ServersAdminNegativeTestJSON-1850710304 tempest-ServersAdminNegativeTestJSON-1850710304-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:16.460480 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-77ddc955-2d4d-4897-b056-f74c93ff6900 tempest-ServersAdminNegativeTestJSON-1850710304 tempest-ServersAdminNegativeTestJSON-1850710304-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:16.472121 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d47d7bd5-3a89-493c-9450-23f04e9a2787 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Searching by: {'reservation_id': 'r-g0vtgxoj', 'deleted': False, 'project_id': '771211a4ce424aa48920ff102c894a9f'} {{(pid=123001) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:30:16.473119 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-77ddc955-2d4d-4897-b056-f74c93ff6900 tempest-ServersAdminNegativeTestJSON-1850710304 tempest-ServersAdminNegativeTestJSON-1850710304-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:16.473994 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-77ddc955-2d4d-4897-b056-f74c93ff6900 tempest-ServersAdminNegativeTestJSON-1850710304 tempest-ServersAdminNegativeTestJSON-1850710304-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:16.474747 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-77ddc955-2d4d-4897-b056-f74c93ff6900 tempest-ServersAdminNegativeTestJSON-1850710304 tempest-ServersAdminNegativeTestJSON-1850710304-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:16.485299 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d47d7bd5-3a89-493c-9450-23f04e9a2787 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:16.489182 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d47d7bd5-3a89-493c-9450-23f04e9a2787 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:16.489182 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d47d7bd5-3a89-493c-9450-23f04e9a2787 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:16.489182 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d47d7bd5-3a89-493c-9450-23f04e9a2787 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:16.489182 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d47d7bd5-3a89-493c-9450-23f04e9a2787 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:16.489599 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d47d7bd5-3a89-493c-9450-23f04e9a2787 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:16.638865 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:30:16.744809 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-77ddc955-2d4d-4897-b056-f74c93ff6900 tempest-ServersAdminNegativeTestJSON-1850710304 tempest-ServersAdminNegativeTestJSON-1850710304-project-admin] HTTP exception thrown: Cannot 'migrate' instance 49d830ea-1eab-4d6b-b571-4aa5434d897e while it is in vm_state suspended Oct 04 18:30:16.748036 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-77ddc955-2d4d-4897-b056-f74c93ff6900 tempest-ServersAdminNegativeTestJSON-1850710304 tempest-ServersAdminNegativeTestJSON-1850710304-project-admin] Request method failure captured: Oct 04 18:30:16.748036 n-d-850501-14 devstack@n-api.service[123002]: request: POST /compute/v2.1/servers/49d830ea-1eab-4d6b-b571-4aa5434d897e/action HTTP/1.1 Oct 04 18:30:16.748036 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:30:16.748036 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:30:16.748036 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:30:16.748036 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 15 Oct 04 18:30:16.748036 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:30:16.748036 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:30:16.748036 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:30:16.748036 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:30:16.748036 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPHt9cKuiYAjdV1RFm8KbR5yx-QQRu8MSAAjPGOQZOj5ta9tBngPGgxbUrWZa0zwN6B2JkNGZHD5byrVmsbFdSRl4muYt_QnC9J210sWLEIRVIOZcBSFin0-SpwiRqm3hJAo8s4LYsVwBu27Pe4svBvETYhjlR4p_D-TgxRywFzlycO0 Oct 04 18:30:16.748036 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:30:16.748036 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:30:16.748036 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:30:16.748036 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:30:16.748036 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:30:16.748036 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:30:16.748036 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 82ea9489e4a141bdb8eaa55993bd41fe Oct 04 18:30:16.748036 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1850710304 Oct 04 18:30:16.748036 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member,admin Oct 04 18:30:16.748036 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member,admin Oct 04 18:30:16.749480 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/82ea9489e4a141bdb8eaa55993bd41fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_82ea9489e4a141bdb8eaa55993bd41fe", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/82ea9489e4a141bdb8eaa55993bd41fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/82ea9489e4a141bdb8eaa55993bd41fe"}]}] Oct 04 18:30:16.749480 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1850710304 Oct 04 18:30:16.749480 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 82ea9489e4a141bdb8eaa55993bd41fe Oct 04 18:30:16.749480 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1850710304 Oct 04 18:30:16.749480 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServersAdminNegativeTestJSON-1850710304-project-admin Oct 04 18:30:16.749480 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:30:16.749480 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:30:16.749480 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: bde6b8bcf3c242f194926a7d830b5ad1 Oct 04 18:30:16.749480 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1850710304-project-admin Oct 04 18:30:16.749480 n-d-850501-14 devstack@n-api.service[123002]: Oct 04 18:30:16.749480 n-d-850501-14 devstack@n-api.service[123002]: {"migrate": {}} Oct 04 18:30:16.749480 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:30:16.749480 n-d-850501-14 devstack@n-api.service[123002]: exception: Cannot 'migrate' instance 49d830ea-1eab-4d6b-b571-4aa5434d897e while it is in vm_state suspended Oct 04 18:30:16.750305 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '49d830ea-1eab-4d6b-b571-4aa5434d897e', 'body': {'migrate': {}}} Oct 04 18:30:16.750305 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:30:16.750305 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:16.750305 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Oct 04 18:30:16.750305 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Oct 04 18:30:16.750305 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 04 18:30:16.750305 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:30:16.750305 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 04 18:30:16.750305 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 18:30:16.750305 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 18:30:16.750305 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 18:30:16.750305 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:30:16.750305 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:30:16.750305 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 18:30:16.750305 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 18:30:16.750305 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 49d830ea-1eab-4d6b-b571-4aa5434d897e in vm_state suspended. Cannot resize while the instance is in this state. Oct 04 18:30:16.750305 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:30:16.750305 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:16.750305 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:30:16.750305 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:16.751668 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:16.751668 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:16.751668 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:30:16.751668 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:30:16.751668 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:30:16.751668 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:30:16.751668 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:30:16.751668 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:30:16.751668 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Oct 04 18:30:16.751668 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 18:30:16.751668 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 18:30:16.751668 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 18:30:16.751668 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 49d830ea-1eab-4d6b-b571-4aa5434d897e while it is in vm_state suspended Oct 04 18:30:16.751668 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:30:16.751668 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:16.751668 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:30:16.751668 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:16.751668 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:16.751668 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:16.752946 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:30:16.752946 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:30:16.752946 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 49d830ea-1eab-4d6b-b571-4aa5434d897e while it is in vm_state suspended Oct 04 18:30:16.752946 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:30:16.761739 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-77ddc955-2d4d-4897-b056-f74c93ff6900 tempest-ServersAdminNegativeTestJSON-1850710304 tempest-ServersAdminNegativeTestJSON-1850710304-project-admin] Returning 409 to user: Cannot 'migrate' instance 49d830ea-1eab-4d6b-b571-4aa5434d897e while it is in vm_state suspended {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:30:16.763172 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-77ddc955-2d4d-4897-b056-f74c93ff6900 tempest-ServersAdminNegativeTestJSON-1850710304 tempest-ServersAdminNegativeTestJSON-1850710304-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/49d830ea-1eab-4d6b-b571-4aa5434d897e/action" status: 409 len: 148 microversion: 2.1 time: 0.334003 Oct 04 18:30:16.770187 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 287/609] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:30:16 2022] POST /compute/v2.1/servers/49d830ea-1eab-4d6b-b571-4aa5434d897e/action => generated 148 bytes in 342 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:30:16.776239 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-fd42a7e4-a647-49cf-884b-7872e13b2b91 tempest-ServersAdminNegativeTestJSON-1850710304 tempest-ServersAdminNegativeTestJSON-1850710304-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:16.780291 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-fd42a7e4-a647-49cf-884b-7872e13b2b91 tempest-ServersAdminNegativeTestJSON-1850710304 tempest-ServersAdminNegativeTestJSON-1850710304-project-admin] Request method failure captured: Oct 04 18:30:16.780291 n-d-850501-14 devstack@n-api.service[123002]: request: POST /compute/v2.1/servers/31fc27b2-5ba0-4ba9-b119-12644f8eea78/action HTTP/1.1 Oct 04 18:30:16.780291 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:30:16.780291 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:30:16.780291 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:30:16.780291 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 39 Oct 04 18:30:16.780291 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:30:16.780291 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:30:16.780291 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:30:16.780291 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:30:16.780291 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPHt9cKuiYAjdV1RFm8KbR5yx-QQRu8MSAAjPGOQZOj5ta9tBngPGgxbUrWZa0zwN6B2JkNGZHD5byrVmsbFdSRl4muYt_QnC9J210sWLEIRVIOZcBSFin0-SpwiRqm3hJAo8s4LYsVwBu27Pe4svBvETYhjlR4p_D-TgxRywFzlycO0 Oct 04 18:30:16.780291 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:30:16.780291 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:30:16.780291 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:30:16.780291 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:30:16.780291 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:30:16.780291 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:30:16.780291 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 82ea9489e4a141bdb8eaa55993bd41fe Oct 04 18:30:16.780291 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1850710304 Oct 04 18:30:16.780291 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member,admin Oct 04 18:30:16.780291 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member,admin Oct 04 18:30:16.781631 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/82ea9489e4a141bdb8eaa55993bd41fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_82ea9489e4a141bdb8eaa55993bd41fe", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/82ea9489e4a141bdb8eaa55993bd41fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/82ea9489e4a141bdb8eaa55993bd41fe"}]}] Oct 04 18:30:16.781631 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1850710304 Oct 04 18:30:16.781631 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 82ea9489e4a141bdb8eaa55993bd41fe Oct 04 18:30:16.781631 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1850710304 Oct 04 18:30:16.781631 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServersAdminNegativeTestJSON-1850710304-project-admin Oct 04 18:30:16.781631 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:30:16.781631 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:30:16.781631 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: bde6b8bcf3c242f194926a7d830b5ad1 Oct 04 18:30:16.781631 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1850710304-project-admin Oct 04 18:30:16.781631 n-d-850501-14 devstack@n-api.service[123002]: Oct 04 18:30:16.781631 n-d-850501-14 devstack@n-api.service[123002]: {"os-resetState": {"state": "invalid"}} Oct 04 18:30:16.781631 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:30:16.782820 n-d-850501-14 devstack@n-api.service[123002]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 04 18:30:16.782820 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '31fc27b2-5ba0-4ba9-b119-12644f8eea78', 'body': {'os-resetState': {'state': 'invalid'}}} Oct 04 18:30:16.782820 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:30:16.782820 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:16.782820 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:30:16.782820 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:30:16.782820 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:30:16.782820 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:30:16.782820 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Oct 04 18:30:16.782820 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:30:16.782820 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Oct 04 18:30:16.782820 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 04 18:30:16.782820 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:30:16.782820 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 04 18:30:16.782820 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi 'invalid' Oct 04 18:30:16.782820 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:30:16.782820 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:16.782820 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:30:16.782820 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:16.782820 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:16.782820 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:16.782820 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:30:16.791987 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:30:16.791987 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:30:16.791987 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:30:16.791987 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:30:16.791987 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:30:16.791987 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:30:16.791987 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:30:16.791987 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:30:16.791987 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:30:16.791987 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 04 18:30:16.791987 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:30:16.791987 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:16.791987 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:30:16.791987 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:16.791987 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:16.791987 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:16.791987 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:30:16.791987 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:30:16.791987 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 04 18:30:16.793257 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:30:16.793345 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.multi_cell_list [None req-d47d7bd5-3a89-493c-9450-23f04e9a2787 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=123001) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:30:16.793431 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-fd42a7e4-a647-49cf-884b-7872e13b2b91 tempest-ServersAdminNegativeTestJSON-1850710304 tempest-ServersAdminNegativeTestJSON-1850710304-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:30:16.793431 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-fd42a7e4-a647-49cf-884b-7872e13b2b91 tempest-ServersAdminNegativeTestJSON-1850710304 tempest-ServersAdminNegativeTestJSON-1850710304-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/31fc27b2-5ba0-4ba9-b119-12644f8eea78/action" status: 400 len: 144 microversion: 2.1 time: 0.014776 Oct 04 18:30:16.794359 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 288/610] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:30:16 2022] POST /compute/v2.1/servers/31fc27b2-5ba0-4ba9-b119-12644f8eea78/action => generated 144 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:30:16.799571 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-687a4369-3bec-46e9-ba19-0cd6d796b3ea tempest-ServersAdminNegativeTestJSON-1850710304 tempest-ServersAdminNegativeTestJSON-1850710304-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:16.805100 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-687a4369-3bec-46e9-ba19-0cd6d796b3ea tempest-ServersAdminNegativeTestJSON-1850710304 tempest-ServersAdminNegativeTestJSON-1850710304-project-admin] Request method failure captured: Oct 04 18:30:16.805100 n-d-850501-14 devstack@n-api.service[123002]: request: POST /compute/v2.1/servers/31fc27b2-5ba0-4ba9-b119-12644f8eea78/action HTTP/1.1 Oct 04 18:30:16.805100 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:30:16.805100 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:30:16.805100 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:30:16.805100 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 31 Oct 04 18:30:16.805100 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:30:16.805100 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:30:16.805100 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:30:16.805100 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:30:16.805100 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPHt9cKuiYAjdV1RFm8KbR5yx-QQRu8MSAAjPGOQZOj5ta9tBngPGgxbUrWZa0zwN6B2JkNGZHD5byrVmsbFdSRl4muYt_QnC9J210sWLEIRVIOZcBSFin0-SpwiRqm3hJAo8s4LYsVwBu27Pe4svBvETYhjlR4p_D-TgxRywFzlycO0 Oct 04 18:30:16.805100 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:30:16.805100 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:30:16.805100 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:30:16.805100 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:30:16.805100 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:30:16.805100 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:30:16.805100 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 82ea9489e4a141bdb8eaa55993bd41fe Oct 04 18:30:16.805100 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1850710304 Oct 04 18:30:16.805100 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member,admin Oct 04 18:30:16.805100 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member,admin Oct 04 18:30:16.806519 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/82ea9489e4a141bdb8eaa55993bd41fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_82ea9489e4a141bdb8eaa55993bd41fe", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/82ea9489e4a141bdb8eaa55993bd41fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/82ea9489e4a141bdb8eaa55993bd41fe"}]}] Oct 04 18:30:16.806519 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1850710304 Oct 04 18:30:16.806519 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 82ea9489e4a141bdb8eaa55993bd41fe Oct 04 18:30:16.806519 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1850710304 Oct 04 18:30:16.806519 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServersAdminNegativeTestJSON-1850710304-project-admin Oct 04 18:30:16.806519 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:30:16.806519 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:30:16.806519 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: bde6b8bcf3c242f194926a7d830b5ad1 Oct 04 18:30:16.806519 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1850710304-project-admin Oct 04 18:30:16.806519 n-d-850501-14 devstack@n-api.service[123002]: Oct 04 18:30:16.806519 n-d-850501-14 devstack@n-api.service[123002]: {"os-resetState": {"state": 1}} Oct 04 18:30:16.806519 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:30:16.806519 n-d-850501-14 devstack@n-api.service[123002]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 04 18:30:16.807348 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '31fc27b2-5ba0-4ba9-b119-12644f8eea78', 'body': {'os-resetState': {'state': 1}}} Oct 04 18:30:16.807348 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:30:16.807348 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:16.807348 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:30:16.807348 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:30:16.807348 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:30:16.807348 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:30:16.807348 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Oct 04 18:30:16.807348 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:30:16.807348 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Oct 04 18:30:16.807348 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 04 18:30:16.807348 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:30:16.807348 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 04 18:30:16.807348 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi 1 Oct 04 18:30:16.807348 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:30:16.807348 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:16.807348 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:30:16.807348 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:16.807348 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:16.807348 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:16.807348 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:30:16.807348 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:30:16.809930 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:30:16.809930 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:30:16.809930 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:30:16.809930 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:30:16.809930 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:30:16.809930 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:30:16.809930 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:30:16.809930 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:30:16.809930 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 04 18:30:16.809930 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:30:16.809930 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:16.809930 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:30:16.809930 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:16.809930 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:16.809930 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:16.809930 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:30:16.809930 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:30:16.809930 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 04 18:30:16.809930 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:30:16.813272 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-687a4369-3bec-46e9-ba19-0cd6d796b3ea tempest-ServersAdminNegativeTestJSON-1850710304 tempest-ServersAdminNegativeTestJSON-1850710304-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:30:16.814375 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-687a4369-3bec-46e9-ba19-0cd6d796b3ea tempest-ServersAdminNegativeTestJSON-1850710304 tempest-ServersAdminNegativeTestJSON-1850710304-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/31fc27b2-5ba0-4ba9-b119-12644f8eea78/action" status: 400 len: 120 microversion: 2.1 time: 0.018811 Oct 04 18:30:16.816968 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 289/611] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:30:16 2022] POST /compute/v2.1/servers/31fc27b2-5ba0-4ba9-b119-12644f8eea78/action => generated 120 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:30:16.838964 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9f6e9c1a-cd2f-4e35-83c6-470dbee10b14 tempest-ServersAdminNegativeTestJSON-1850710304 tempest-ServersAdminNegativeTestJSON-1850710304-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:16.841608 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9f6e9c1a-cd2f-4e35-83c6-470dbee10b14 tempest-ServersAdminNegativeTestJSON-1850710304 tempest-ServersAdminNegativeTestJSON-1850710304-project-admin] Failed to fetch instance by id 999 {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 04 18:30:16.842329 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-9f6e9c1a-cd2f-4e35-83c6-470dbee10b14 tempest-ServersAdminNegativeTestJSON-1850710304 tempest-ServersAdminNegativeTestJSON-1850710304-project-admin] HTTP exception thrown: Instance 999 could not be found. Oct 04 18:30:16.850650 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9f6e9c1a-cd2f-4e35-83c6-470dbee10b14 tempest-ServersAdminNegativeTestJSON-1850710304 tempest-ServersAdminNegativeTestJSON-1850710304-project-admin] Request method failure captured: Oct 04 18:30:16.850650 n-d-850501-14 devstack@n-api.service[123002]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Oct 04 18:30:16.850650 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:30:16.850650 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:30:16.850650 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:30:16.850650 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 37 Oct 04 18:30:16.850650 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:30:16.850650 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:30:16.850650 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:30:16.850650 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:30:16.850650 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPHt9cKuiYAjdV1RFm8KbR5yx-QQRu8MSAAjPGOQZOj5ta9tBngPGgxbUrWZa0zwN6B2JkNGZHD5byrVmsbFdSRl4muYt_QnC9J210sWLEIRVIOZcBSFin0-SpwiRqm3hJAo8s4LYsVwBu27Pe4svBvETYhjlR4p_D-TgxRywFzlycO0 Oct 04 18:30:16.850650 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:30:16.850650 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:30:16.850650 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:30:16.850650 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:30:16.850650 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:30:16.850650 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:30:16.850650 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 82ea9489e4a141bdb8eaa55993bd41fe Oct 04 18:30:16.850650 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1850710304 Oct 04 18:30:16.850650 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member,admin Oct 04 18:30:16.850650 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member,admin Oct 04 18:30:16.852756 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/82ea9489e4a141bdb8eaa55993bd41fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_82ea9489e4a141bdb8eaa55993bd41fe", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/82ea9489e4a141bdb8eaa55993bd41fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/82ea9489e4a141bdb8eaa55993bd41fe"}]}] Oct 04 18:30:16.852756 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1850710304 Oct 04 18:30:16.852756 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 82ea9489e4a141bdb8eaa55993bd41fe Oct 04 18:30:16.852756 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1850710304 Oct 04 18:30:16.852756 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServersAdminNegativeTestJSON-1850710304-project-admin Oct 04 18:30:16.852756 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:30:16.852756 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:30:16.852756 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: bde6b8bcf3c242f194926a7d830b5ad1 Oct 04 18:30:16.852756 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1850710304-project-admin Oct 04 18:30:16.852756 n-d-850501-14 devstack@n-api.service[123002]: Oct 04 18:30:16.852756 n-d-850501-14 devstack@n-api.service[123002]: {"os-resetState": {"state": "error"}} Oct 04 18:30:16.852756 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:30:16.852756 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 999 could not be found. Oct 04 18:30:16.854703 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Oct 04 18:30:16.854703 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:30:16.854703 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:16.854703 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:30:16.854703 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:30:16.854703 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 04 18:30:16.854703 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 04 18:30:16.854703 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 04 18:30:16.854703 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:30:16.854703 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:16.854703 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:30:16.854703 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:16.854703 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:16.854703 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:16.854703 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:30:16.854703 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:30:16.854703 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:30:16.854703 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:30:16.854703 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:30:16.854703 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:30:16.854703 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Oct 04 18:30:16.856655 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 04 18:30:16.856655 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:30:16.856655 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:30:16.856655 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 04 18:30:16.856655 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:30:16.856655 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:16.856655 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:30:16.856655 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:16.856655 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:16.856655 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:16.856655 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:30:16.856655 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:30:16.856655 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 04 18:30:16.856655 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:30:16.858894 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9f6e9c1a-cd2f-4e35-83c6-470dbee10b14 tempest-ServersAdminNegativeTestJSON-1850710304 tempest-ServersAdminNegativeTestJSON-1850710304-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:30:16.860204 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9f6e9c1a-cd2f-4e35-83c6-470dbee10b14 tempest-ServersAdminNegativeTestJSON-1850710304 tempest-ServersAdminNegativeTestJSON-1850710304-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.026735 Oct 04 18:30:16.861229 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 290/612] 10.222.0.20 () {60 vars in 1179 bytes} [Tue Oct 4 18:30:16 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:30:16.882884 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f66b27f2-bf4f-4e0a-aaab-1d7d785720e7 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:16.882884 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f66b27f2-bf4f-4e0a-aaab-1d7d785720e7 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] [instance: 49d830ea-1eab-4d6b-b571-4aa5434d897e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:16.893141 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f66b27f2-bf4f-4e0a-aaab-1d7d785720e7 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:16.899594 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f66b27f2-bf4f-4e0a-aaab-1d7d785720e7 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:16.905745 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f66b27f2-bf4f-4e0a-aaab-1d7d785720e7 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:16.906778 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f66b27f2-bf4f-4e0a-aaab-1d7d785720e7 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:16.908168 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f66b27f2-bf4f-4e0a-aaab-1d7d785720e7 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:16.914206 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f66b27f2-bf4f-4e0a-aaab-1d7d785720e7 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:16.957490 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d47d7bd5-3a89-493c-9450-23f04e9a2787 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:16.965463 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f66b27f2-bf4f-4e0a-aaab-1d7d785720e7 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] [instance: 49d830ea-1eab-4d6b-b571-4aa5434d897e] Going to try to terminate instance {{(pid=123002) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:30:16.971930 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d47d7bd5-3a89-493c-9450-23f04e9a2787 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:16.972719 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d47d7bd5-3a89-493c-9450-23f04e9a2787 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:16.972896 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d47d7bd5-3a89-493c-9450-23f04e9a2787 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:17.380167 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f66b27f2-bf4f-4e0a-aaab-1d7d785720e7 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] 10.222.0.20 "DELETE /compute/v2.1/servers/49d830ea-1eab-4d6b-b571-4aa5434d897e" status: 204 len: 0 microversion: 2.1 time: 0.512328 Oct 04 18:30:17.381136 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 291/613] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:30:16 2022] DELETE /compute/v2.1/servers/49d830ea-1eab-4d6b-b571-4aa5434d897e => generated 0 bytes in 515 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:30:17.392004 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-951b108f-a881-4e83-bec4-cde87ff04ef0 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:17.392829 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-951b108f-a881-4e83-bec4-cde87ff04ef0 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] [instance: 49d830ea-1eab-4d6b-b571-4aa5434d897e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:17.412342 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-951b108f-a881-4e83-bec4-cde87ff04ef0 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:17.412841 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-951b108f-a881-4e83-bec4-cde87ff04ef0 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:17.413364 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-951b108f-a881-4e83-bec4-cde87ff04ef0 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:17.414113 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-951b108f-a881-4e83-bec4-cde87ff04ef0 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:17.414625 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-951b108f-a881-4e83-bec4-cde87ff04ef0 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:17.415054 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-951b108f-a881-4e83-bec4-cde87ff04ef0 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:18.497950 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-951b108f-a881-4e83-bec4-cde87ff04ef0 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c11a7c3cec94797b639e6e53dcbfb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375d02476ed240ea967eb2e28e8474ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:18.517580 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-951b108f-a881-4e83-bec4-cde87ff04ef0 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] 10.222.0.20 "GET /compute/v2.1/servers/49d830ea-1eab-4d6b-b571-4aa5434d897e" status: 200 len: 1468 microversion: 2.1 time: 1.128144 Oct 04 18:30:18.518222 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 292/614] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:17 2022] GET /compute/v2.1/servers/49d830ea-1eab-4d6b-b571-4aa5434d897e => generated 1468 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:18.550419 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a2772b6f-0252-4f24-97ad-d1c67d8bdf1f tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:18.557172 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a2772b6f-0252-4f24-97ad-d1c67d8bdf1f tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] [instance: c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:18.571128 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a2772b6f-0252-4f24-97ad-d1c67d8bdf1f tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:18.571766 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a2772b6f-0252-4f24-97ad-d1c67d8bdf1f tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:18.572356 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a2772b6f-0252-4f24-97ad-d1c67d8bdf1f tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:18.573187 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a2772b6f-0252-4f24-97ad-d1c67d8bdf1f tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:18.573755 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a2772b6f-0252-4f24-97ad-d1c67d8bdf1f tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:18.574300 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a2772b6f-0252-4f24-97ad-d1c67d8bdf1f tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:18.655561 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:30:18.836591 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d47d7bd5-3a89-493c-9450-23f04e9a2787 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/detail?reservation_id=r-g0vtgxoj" status: 200 len: 2931 microversion: 2.1 time: 2.423089 Oct 04 18:30:18.838803 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 323/615] 10.222.0.20 () {58 vars in 1197 bytes} [Tue Oct 4 18:30:16 2022] GET /compute/v2.1/servers/detail?reservation_id=r-g0vtgxoj => generated 2931 bytes in 2426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:18.866188 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f5344bda-1aeb-4645-8206-85daac8aed8d tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:18.893554 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.compute.server_groups [None req-f5344bda-1aeb-4645-8206-85daac8aed8d tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Querying cell a6039a6d-a98c-44a9-819b-4eff388d8aa7(cell1) for 2 instances {{(pid=123001) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 04 18:30:18.894645 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f5344bda-1aeb-4645-8206-85daac8aed8d tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:18.895353 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f5344bda-1aeb-4645-8206-85daac8aed8d tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:18.896003 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f5344bda-1aeb-4645-8206-85daac8aed8d tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:18.929648 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=100 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:30:18.929648 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f5344bda-1aeb-4645-8206-85daac8aed8d tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups/36972d4e-f7eb-4ece-bc60-6ecfce4969e3" status: 200 len: 271 microversion: 2.1 time: 0.064324 Oct 04 18:30:18.929648 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 324/616] 10.222.0.20 () {58 vars in 1263 bytes} [Tue Oct 4 18:30:18 2022] GET /compute/v2.1/os-server-groups/36972d4e-f7eb-4ece-bc60-6ecfce4969e3 => generated 271 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:30:18.957972 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-698590d6-95fd-408a-aa5f-6bb220812092 tempest-ServersOnMultiNodesTest-1719152185 tempest-ServersOnMultiNodesTest-1719152185-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:18.959993 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-698590d6-95fd-408a-aa5f-6bb220812092 tempest-ServersOnMultiNodesTest-1719152185 tempest-ServersOnMultiNodesTest-1719152185-project-admin] [instance: d5e996e9-dc9f-46e3-8469-e46dc2932b24] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:18.975949 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-698590d6-95fd-408a-aa5f-6bb220812092 tempest-ServersOnMultiNodesTest-1719152185 tempest-ServersOnMultiNodesTest-1719152185-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:18.976606 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-698590d6-95fd-408a-aa5f-6bb220812092 tempest-ServersOnMultiNodesTest-1719152185 tempest-ServersOnMultiNodesTest-1719152185-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:18.978321 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-698590d6-95fd-408a-aa5f-6bb220812092 tempest-ServersOnMultiNodesTest-1719152185 tempest-ServersOnMultiNodesTest-1719152185-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:18.985876 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-698590d6-95fd-408a-aa5f-6bb220812092 tempest-ServersOnMultiNodesTest-1719152185 tempest-ServersOnMultiNodesTest-1719152185-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:18.985876 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-698590d6-95fd-408a-aa5f-6bb220812092 tempest-ServersOnMultiNodesTest-1719152185 tempest-ServersOnMultiNodesTest-1719152185-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:18.985876 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-698590d6-95fd-408a-aa5f-6bb220812092 tempest-ServersOnMultiNodesTest-1719152185 tempest-ServersOnMultiNodesTest-1719152185-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:19.561826 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a2772b6f-0252-4f24-97ad-d1c67d8bdf1f tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8675d7d8bab840f3a221fdf2ee4c9b5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25214dec3ef24597be8e5acde61de3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:19.578442 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-698590d6-95fd-408a-aa5f-6bb220812092 tempest-ServersOnMultiNodesTest-1719152185 tempest-ServersOnMultiNodesTest-1719152185-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/d5e996e9-dc9f-46e3-8469-e46dc2932b24" status: 200 len: 1622 microversion: 2.1 time: 0.642665 Oct 04 18:30:19.581409 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a2772b6f-0252-4f24-97ad-d1c67d8bdf1f tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] 10.222.0.20 "GET /compute/v2.1/servers/c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23" status: 200 len: 1391 microversion: 2.1 time: 1.028698 Oct 04 18:30:19.583666 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 325/618] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:18 2022] GET /compute/v2.1/servers/d5e996e9-dc9f-46e3-8469-e46dc2932b24 => generated 1622 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:19.585464 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 293/618] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:18 2022] GET /compute/v2.1/servers/c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23 => generated 1391 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:19.591610 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-623180de-f806-4567-a8e0-d443f6ee6079 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:19.592247 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-623180de-f806-4567-a8e0-d443f6ee6079 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] [instance: 49d830ea-1eab-4d6b-b571-4aa5434d897e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:19.608273 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d423cc71-6bba-4367-bf0d-12ab3e1c0ad7 tempest-ServersOnMultiNodesTest-1719152185 tempest-ServersOnMultiNodesTest-1719152185-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:19.609824 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-623180de-f806-4567-a8e0-d443f6ee6079 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:19.610524 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-623180de-f806-4567-a8e0-d443f6ee6079 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:19.611012 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d423cc71-6bba-4367-bf0d-12ab3e1c0ad7 tempest-ServersOnMultiNodesTest-1719152185 tempest-ServersOnMultiNodesTest-1719152185-project-admin] [instance: 2d07c478-8e9c-4000-92bb-3fa4547ea6c0] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:19.611134 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-623180de-f806-4567-a8e0-d443f6ee6079 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:19.611830 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-623180de-f806-4567-a8e0-d443f6ee6079 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:19.612304 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-623180de-f806-4567-a8e0-d443f6ee6079 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:19.619674 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-623180de-f806-4567-a8e0-d443f6ee6079 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:19.625210 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d423cc71-6bba-4367-bf0d-12ab3e1c0ad7 tempest-ServersOnMultiNodesTest-1719152185 tempest-ServersOnMultiNodesTest-1719152185-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:19.628596 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d423cc71-6bba-4367-bf0d-12ab3e1c0ad7 tempest-ServersOnMultiNodesTest-1719152185 tempest-ServersOnMultiNodesTest-1719152185-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:19.630011 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d423cc71-6bba-4367-bf0d-12ab3e1c0ad7 tempest-ServersOnMultiNodesTest-1719152185 tempest-ServersOnMultiNodesTest-1719152185-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:19.634067 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d423cc71-6bba-4367-bf0d-12ab3e1c0ad7 tempest-ServersOnMultiNodesTest-1719152185 tempest-ServersOnMultiNodesTest-1719152185-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:19.635767 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d423cc71-6bba-4367-bf0d-12ab3e1c0ad7 tempest-ServersOnMultiNodesTest-1719152185 tempest-ServersOnMultiNodesTest-1719152185-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:19.643022 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d423cc71-6bba-4367-bf0d-12ab3e1c0ad7 tempest-ServersOnMultiNodesTest-1719152185 tempest-ServersOnMultiNodesTest-1719152185-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:20.191946 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d423cc71-6bba-4367-bf0d-12ab3e1c0ad7 tempest-ServersOnMultiNodesTest-1719152185 tempest-ServersOnMultiNodesTest-1719152185-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/2d07c478-8e9c-4000-92bb-3fa4547ea6c0" status: 200 len: 1622 microversion: 2.1 time: 0.594795 Oct 04 18:30:20.195647 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 294/619] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:19 2022] GET /compute/v2.1/servers/2d07c478-8e9c-4000-92bb-3fa4547ea6c0 => generated 1622 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:20.239251 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-623180de-f806-4567-a8e0-d443f6ee6079 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c11a7c3cec94797b639e6e53dcbfb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375d02476ed240ea967eb2e28e8474ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:20.260837 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-623180de-f806-4567-a8e0-d443f6ee6079 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] 10.222.0.20 "GET /compute/v2.1/servers/49d830ea-1eab-4d6b-b571-4aa5434d897e" status: 200 len: 1468 microversion: 2.1 time: 0.675646 Oct 04 18:30:20.281929 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 326/620] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:19 2022] GET /compute/v2.1/servers/49d830ea-1eab-4d6b-b571-4aa5434d897e => generated 1468 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:20.515766 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3a8d5011-158d-4080-a3ea-919aa66d5b89 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1145948543", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "2e85db28-c393-4e02-8f28-bf0d217b6db7"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:20.604673 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-3a8d5011-158d-4080-a3ea-919aa66d5b89 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] validate_networks() for None {{(pid=123002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:30:20.608572 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8eaa6945-e903-4cdd-b527-52e3763861ac tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:20.609511 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8eaa6945-e903-4cdd-b527-52e3763861ac tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] [instance: c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:20.620351 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8eaa6945-e903-4cdd-b527-52e3763861ac tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:20.624971 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8eaa6945-e903-4cdd-b527-52e3763861ac tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:20.625839 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8eaa6945-e903-4cdd-b527-52e3763861ac tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:20.626850 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8eaa6945-e903-4cdd-b527-52e3763861ac tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:20.627543 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8eaa6945-e903-4cdd-b527-52e3763861ac tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:20.628270 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8eaa6945-e903-4cdd-b527-52e3763861ac tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:21.124000 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8eaa6945-e903-4cdd-b527-52e3763861ac tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8675d7d8bab840f3a221fdf2ee4c9b5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25214dec3ef24597be8e5acde61de3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:21.132570 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8eaa6945-e903-4cdd-b527-52e3763861ac tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] 10.222.0.20 "GET /compute/v2.1/servers/c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23" status: 200 len: 1391 microversion: 2.1 time: 0.528036 Oct 04 18:30:21.138502 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 327/621] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:20 2022] GET /compute/v2.1/servers/c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23 => generated 1391 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:30:21.260704 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-675ed7eb-31dc-4f5b-9b38-eb6be64b9ae4 req-68c2612b-949c-43e5-89c2-ec0cf7d0cf6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49d830ea-1eab-4d6b-b571-4aa5434d897e", "name": "network-vif-deleted", "tag": "a7dbb653-fbbe-4479-b569-0226403a1c50"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:21.280344 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-675ed7eb-31dc-4f5b-9b38-eb6be64b9ae4 req-68c2612b-949c-43e5-89c2-ec0cf7d0cf6a service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:21.281049 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-675ed7eb-31dc-4f5b-9b38-eb6be64b9ae4 req-68c2612b-949c-43e5-89c2-ec0cf7d0cf6a service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:21.281633 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-675ed7eb-31dc-4f5b-9b38-eb6be64b9ae4 req-68c2612b-949c-43e5-89c2-ec0cf7d0cf6a service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:21.300748 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-675ed7eb-31dc-4f5b-9b38-eb6be64b9ae4 req-68c2612b-949c-43e5-89c2-ec0cf7d0cf6a service nova] Creating event network-vif-deleted:a7dbb653-fbbe-4479-b569-0226403a1c50 for instance 49d830ea-1eab-4d6b-b571-4aa5434d897e on n-h1-850501-14 Oct 04 18:30:21.309882 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-675ed7eb-31dc-4f5b-9b38-eb6be64b9ae4 req-68c2612b-949c-43e5-89c2-ec0cf7d0cf6a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055427 Oct 04 18:30:21.311124 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 328/622] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:30:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:30:21.339780 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-59cdb7a1-a61a-461a-a98e-5e5c89ffd60e tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:21.340785 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-59cdb7a1-a61a-461a-a98e-5e5c89ffd60e tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] [instance: 49d830ea-1eab-4d6b-b571-4aa5434d897e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:21.352896 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-59cdb7a1-a61a-461a-a98e-5e5c89ffd60e tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:21.353662 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-59cdb7a1-a61a-461a-a98e-5e5c89ffd60e tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:21.354279 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-59cdb7a1-a61a-461a-a98e-5e5c89ffd60e tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:21.355265 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-59cdb7a1-a61a-461a-a98e-5e5c89ffd60e tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:21.355962 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-59cdb7a1-a61a-461a-a98e-5e5c89ffd60e tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:21.357045 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-59cdb7a1-a61a-461a-a98e-5e5c89ffd60e tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:21.834511 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-59cdb7a1-a61a-461a-a98e-5e5c89ffd60e tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c11a7c3cec94797b639e6e53dcbfb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375d02476ed240ea967eb2e28e8474ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:21.841718 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-59cdb7a1-a61a-461a-a98e-5e5c89ffd60e tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] 10.222.0.20 "GET /compute/v2.1/servers/49d830ea-1eab-4d6b-b571-4aa5434d897e" status: 200 len: 1426 microversion: 2.1 time: 0.529200 Oct 04 18:30:21.860796 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 329/623] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:21 2022] GET /compute/v2.1/servers/49d830ea-1eab-4d6b-b571-4aa5434d897e => generated 1426 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:22.164837 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7b83a203-7d82-422c-b8e4-168887c7605f tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:22.165444 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7b83a203-7d82-422c-b8e4-168887c7605f tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] [instance: c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:22.174776 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7b83a203-7d82-422c-b8e4-168887c7605f tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:22.175273 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7b83a203-7d82-422c-b8e4-168887c7605f tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:22.175709 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7b83a203-7d82-422c-b8e4-168887c7605f tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:22.176463 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7b83a203-7d82-422c-b8e4-168887c7605f tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:22.176915 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7b83a203-7d82-422c-b8e4-168887c7605f tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:22.177336 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7b83a203-7d82-422c-b8e4-168887c7605f tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:22.436884 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-3a8d5011-158d-4080-a3ea-919aa66d5b89 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:30:22.437272 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-3a8d5011-158d-4080-a3ea-919aa66d5b89 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:30:22.437625 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-3a8d5011-158d-4080-a3ea-919aa66d5b89 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:30:22.438352 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-3a8d5011-158d-4080-a3ea-919aa66d5b89 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:30:22.439002 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-3a8d5011-158d-4080-a3ea-919aa66d5b89 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:30:22.461856 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3a8d5011-158d-4080-a3ea-919aa66d5b89 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:22.462385 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3a8d5011-158d-4080-a3ea-919aa66d5b89 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:22.463980 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3a8d5011-158d-4080-a3ea-919aa66d5b89 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:22.466099 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3a8d5011-158d-4080-a3ea-919aa66d5b89 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:22.466590 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3a8d5011-158d-4080-a3ea-919aa66d5b89 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:22.467029 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3a8d5011-158d-4080-a3ea-919aa66d5b89 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:22.512404 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-3a8d5011-158d-4080-a3ea-919aa66d5b89 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Getting quotas for project 771211a4ce424aa48920ff102c894a9f. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:30:22.528671 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-3a8d5011-158d-4080-a3ea-919aa66d5b89 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Getting quotas for user 07dd131fa3c44d439d0f3ec6e4b8ad42 and project 771211a4ce424aa48920ff102c894a9f. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:30:22.567315 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3a8d5011-158d-4080-a3ea-919aa66d5b89 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Going to run 1 instances... {{(pid=123002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:30:22.580541 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3a8d5011-158d-4080-a3ea-919aa66d5b89 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: 208ff352-ed98-4a12-8913-7e520822bf95] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:30:22.826556 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7b83a203-7d82-422c-b8e4-168887c7605f tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8675d7d8bab840f3a221fdf2ee4c9b5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25214dec3ef24597be8e5acde61de3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:22.840582 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7b83a203-7d82-422c-b8e4-168887c7605f tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] 10.222.0.20 "GET /compute/v2.1/servers/c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23" status: 200 len: 1391 microversion: 2.1 time: 0.679213 Oct 04 18:30:22.844169 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 330/624] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:22 2022] GET /compute/v2.1/servers/c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23 => generated 1391 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:30:22.920356 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3a8d5011-158d-4080-a3ea-919aa66d5b89 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.407992 Oct 04 18:30:22.930951 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 295/625] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:30:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 2420 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:30:22.959666 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c0150ca2-6fa9-4ce2-9d08-6b040e2c085a tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:22.962602 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c0150ca2-6fa9-4ce2-9d08-6b040e2c085a tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] [instance: 49d830ea-1eab-4d6b-b571-4aa5434d897e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:22.996301 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c0150ca2-6fa9-4ce2-9d08-6b040e2c085a tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:22.996810 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c0150ca2-6fa9-4ce2-9d08-6b040e2c085a tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:22.997250 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c0150ca2-6fa9-4ce2-9d08-6b040e2c085a tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:22.998008 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c0150ca2-6fa9-4ce2-9d08-6b040e2c085a tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:23.004018 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c0150ca2-6fa9-4ce2-9d08-6b040e2c085a tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:23.004780 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c0150ca2-6fa9-4ce2-9d08-6b040e2c085a tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:23.085160 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-c0150ca2-6fa9-4ce2-9d08-6b040e2c085a tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] HTTP exception thrown: Instance 49d830ea-1eab-4d6b-b571-4aa5434d897e could not be found. Oct 04 18:30:23.092703 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c0150ca2-6fa9-4ce2-9d08-6b040e2c085a tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Request method failure captured: Oct 04 18:30:23.092703 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/49d830ea-1eab-4d6b-b571-4aa5434d897e HTTP/1.1 Oct 04 18:30:23.092703 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:30:23.092703 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:30:23.092703 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:30:23.092703 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:30:23.092703 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:30:23.092703 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:30:23.092703 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:30:23.092703 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:30:23.092703 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPHt6Z4MqwPQR0qfQRMYX5wkNsh3pd3Y8mVrne4SDvn3IepmkSY1VJYmeMJeY7DTIjndDJPclSm9v9Yqc3PkAMNxeV1YHXIm_WxkI4bsGHCCl25TaqR72zTdMfKd5cCTL0Q96N2bCx_Rsm80NAfC-i0sbp01irNoH4Gu7I89xQq_GP9E Oct 04 18:30:23.092703 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:30:23.092703 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:30:23.092703 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:30:23.092703 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:30:23.092703 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:30:23.092703 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:30:23.092703 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 375d02476ed240ea967eb2e28e8474ab Oct 04 18:30:23.092703 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-921918686 Oct 04 18:30:23.092703 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:30:23.092703 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:30:23.094453 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/375d02476ed240ea967eb2e28e8474ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_375d02476ed240ea967eb2e28e8474ab", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/375d02476ed240ea967eb2e28e8474ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/375d02476ed240ea967eb2e28e8474ab"}]}] Oct 04 18:30:23.094453 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServersAdminNegativeTestJSON-921918686 Oct 04 18:30:23.094453 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 375d02476ed240ea967eb2e28e8474ab Oct 04 18:30:23.094453 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-921918686 Oct 04 18:30:23.094453 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServersAdminNegativeTestJSON-921918686-project Oct 04 18:30:23.094453 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:30:23.094453 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:30:23.094453 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 3c11a7c3cec94797b639e6e53dcbfb20 Oct 04 18:30:23.094453 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServersAdminNegativeTestJSON-921918686-project Oct 04 18:30:23.094453 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:30:23.094453 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 49d830ea-1eab-4d6b-b571-4aa5434d897e could not be found. Oct 04 18:30:23.094453 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '49d830ea-1eab-4d6b-b571-4aa5434d897e'} Oct 04 18:30:23.095393 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:30:23.095393 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:23.095393 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:30:23.095393 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:30:23.095393 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:30:23.095393 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:30:23.095393 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:30:23.095393 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:30:23.095393 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:30:23.095393 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:30:23.095393 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49d830ea-1eab-4d6b-b571-4aa5434d897e could not be found. Oct 04 18:30:23.095393 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:30:23.095393 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:23.095393 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:30:23.095393 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:23.095393 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:23.095393 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:23.095393 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:30:23.095393 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:30:23.095393 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:30:23.096865 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:30:23.096865 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:30:23.096865 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:30:23.096865 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:30:23.096865 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:30:23.096865 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:30:23.096865 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:30:23.096865 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49d830ea-1eab-4d6b-b571-4aa5434d897e could not be found. Oct 04 18:30:23.096865 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:30:23.096865 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:23.096865 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:30:23.096865 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:23.096865 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:23.096865 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:23.096865 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:30:23.096865 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:30:23.096865 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49d830ea-1eab-4d6b-b571-4aa5434d897e could not be found. Oct 04 18:30:23.096865 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:30:23.103863 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c0150ca2-6fa9-4ce2-9d08-6b040e2c085a tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Returning 404 to user: Instance 49d830ea-1eab-4d6b-b571-4aa5434d897e could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:30:23.105635 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c0150ca2-6fa9-4ce2-9d08-6b040e2c085a tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] 10.222.0.20 "GET /compute/v2.1/servers/49d830ea-1eab-4d6b-b571-4aa5434d897e" status: 404 len: 111 microversion: 2.1 time: 0.172966 Oct 04 18:30:23.108919 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 296/626] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:22 2022] GET /compute/v2.1/servers/49d830ea-1eab-4d6b-b571-4aa5434d897e => generated 111 bytes in 177 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:30:23.121880 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-40821c3f-1794-4bf6-8d72-2baf7d3f7ed8 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:23.128021 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-40821c3f-1794-4bf6-8d72-2baf7d3f7ed8 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: 208ff352-ed98-4a12-8913-7e520822bf95] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:23.209776 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0d87d24c-1b75-4a1b-9b2f-af8c5573ec77 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1544212444", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": [{"uuid": "f77e917f-247a-463a-8e5a-3fb6256ecb82"}]}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:23.329960 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.neutron [None req-0d87d24c-1b75-4a1b-9b2f-af8c5573ec77 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] validate_networks() for [('f77e917f-247a-463a-8e5a-3fb6256ecb82', None, None, None, None, None)] {{(pid=123001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:30:23.682118 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-40821c3f-1794-4bf6-8d72-2baf7d3f7ed8 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:23.691991 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-40821c3f-1794-4bf6-8d72-2baf7d3f7ed8 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/208ff352-ed98-4a12-8913-7e520822bf95" status: 200 len: 1217 microversion: 2.1 time: 0.581581 Oct 04 18:30:23.697787 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 297/627] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:23 2022] GET /compute/v2.1/servers/208ff352-ed98-4a12-8913-7e520822bf95 => generated 1217 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:23.707254 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-090cb81e-1ab3-4d45-9426-8f64959951b4 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:23.708106 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-090cb81e-1ab3-4d45-9426-8f64959951b4 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] [instance: 31fc27b2-5ba0-4ba9-b119-12644f8eea78] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:23.735100 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-090cb81e-1ab3-4d45-9426-8f64959951b4 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:23.735604 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-090cb81e-1ab3-4d45-9426-8f64959951b4 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:23.736036 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-090cb81e-1ab3-4d45-9426-8f64959951b4 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:23.736759 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-090cb81e-1ab3-4d45-9426-8f64959951b4 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:23.737538 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-090cb81e-1ab3-4d45-9426-8f64959951b4 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:23.737648 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-090cb81e-1ab3-4d45-9426-8f64959951b4 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:23.795188 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-090cb81e-1ab3-4d45-9426-8f64959951b4 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] [instance: 31fc27b2-5ba0-4ba9-b119-12644f8eea78] Going to try to terminate instance {{(pid=123002) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:30:24.175987 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-090cb81e-1ab3-4d45-9426-8f64959951b4 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] 10.222.0.20 "DELETE /compute/v2.1/servers/31fc27b2-5ba0-4ba9-b119-12644f8eea78" status: 204 len: 0 microversion: 2.1 time: 0.476629 Oct 04 18:30:24.176602 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 298/628] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:30:23 2022] DELETE /compute/v2.1/servers/31fc27b2-5ba0-4ba9-b119-12644f8eea78 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:30:24.187288 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e49256d8-7e50-4249-8314-fbc07a30bd16 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:24.188251 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e49256d8-7e50-4249-8314-fbc07a30bd16 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] [instance: c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:24.208104 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e49256d8-7e50-4249-8314-fbc07a30bd16 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:24.208824 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e49256d8-7e50-4249-8314-fbc07a30bd16 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:24.210203 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e49256d8-7e50-4249-8314-fbc07a30bd16 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:24.211305 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e49256d8-7e50-4249-8314-fbc07a30bd16 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:24.213733 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e49256d8-7e50-4249-8314-fbc07a30bd16 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:24.214451 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e49256d8-7e50-4249-8314-fbc07a30bd16 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:24.826136 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e49256d8-7e50-4249-8314-fbc07a30bd16 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8675d7d8bab840f3a221fdf2ee4c9b5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25214dec3ef24597be8e5acde61de3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:24.846363 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e49256d8-7e50-4249-8314-fbc07a30bd16 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] 10.222.0.20 "GET /compute/v2.1/servers/c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23" status: 200 len: 1391 microversion: 2.1 time: 0.658751 Oct 04 18:30:24.847580 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 299/629] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:24 2022] GET /compute/v2.1/servers/c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23 => generated 1391 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:24.857623 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-06aaa5b1-9632-48e3-9a0f-fb8e626e35fa req-37826a33-e150-42c0-a4ba-2689dc32734b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23", "tag": "2be6226f-41ea-4517-a7af-b60f36e97405"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:24.887912 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-06aaa5b1-9632-48e3-9a0f-fb8e626e35fa req-37826a33-e150-42c0-a4ba-2689dc32734b service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:24.906896 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-06aaa5b1-9632-48e3-9a0f-fb8e626e35fa req-37826a33-e150-42c0-a4ba-2689dc32734b service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:24.907291 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-06aaa5b1-9632-48e3-9a0f-fb8e626e35fa req-37826a33-e150-42c0-a4ba-2689dc32734b service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:24.985196 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-06aaa5b1-9632-48e3-9a0f-fb8e626e35fa req-37826a33-e150-42c0-a4ba-2689dc32734b service nova] Creating event network-changed:2be6226f-41ea-4517-a7af-b60f36e97405 for instance c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23 on n-h2-850501-14 Oct 04 18:30:25.025513 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-06aaa5b1-9632-48e3-9a0f-fb8e626e35fa req-37826a33-e150-42c0-a4ba-2689dc32734b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.176245 Oct 04 18:30:25.034453 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 300/630] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:30:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:30:25.062712 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f2e674d8-93e6-42c8-8a4b-fa3c31d0e1e7 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:25.063455 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f2e674d8-93e6-42c8-8a4b-fa3c31d0e1e7 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] [instance: 31fc27b2-5ba0-4ba9-b119-12644f8eea78] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:25.095966 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f2e674d8-93e6-42c8-8a4b-fa3c31d0e1e7 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:25.096516 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f2e674d8-93e6-42c8-8a4b-fa3c31d0e1e7 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:25.096944 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f2e674d8-93e6-42c8-8a4b-fa3c31d0e1e7 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:25.097669 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f2e674d8-93e6-42c8-8a4b-fa3c31d0e1e7 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:25.098131 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f2e674d8-93e6-42c8-8a4b-fa3c31d0e1e7 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:25.098558 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f2e674d8-93e6-42c8-8a4b-fa3c31d0e1e7 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:25.221763 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=95,nova_cell1:UPDATE=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:30:26.104369 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-0d87d24c-1b75-4a1b-9b2f-af8c5573ec77 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:30:26.105435 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-0d87d24c-1b75-4a1b-9b2f-af8c5573ec77 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:30:26.106102 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-0d87d24c-1b75-4a1b-9b2f-af8c5573ec77 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:30:26.106674 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-0d87d24c-1b75-4a1b-9b2f-af8c5573ec77 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:30:26.107256 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-0d87d24c-1b75-4a1b-9b2f-af8c5573ec77 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:30:26.129966 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0d87d24c-1b75-4a1b-9b2f-af8c5573ec77 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:26.130776 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0d87d24c-1b75-4a1b-9b2f-af8c5573ec77 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:26.133291 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0d87d24c-1b75-4a1b-9b2f-af8c5573ec77 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:26.137292 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0d87d24c-1b75-4a1b-9b2f-af8c5573ec77 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:26.138052 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0d87d24c-1b75-4a1b-9b2f-af8c5573ec77 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:26.138740 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0d87d24c-1b75-4a1b-9b2f-af8c5573ec77 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:26.186763 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-0d87d24c-1b75-4a1b-9b2f-af8c5573ec77 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Getting quotas for project 1fdde079f17642c69fb250c78903d69c. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:30:26.186763 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-0d87d24c-1b75-4a1b-9b2f-af8c5573ec77 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Getting quotas for user f1dec45626f44157a6f4637e668097b4 and project 1fdde079f17642c69fb250c78903d69c. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:30:26.199676 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0d87d24c-1b75-4a1b-9b2f-af8c5573ec77 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Going to run 1 instances... {{(pid=123001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:30:26.202216 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0d87d24c-1b75-4a1b-9b2f-af8c5573ec77 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: 609c8bd3-a9fc-4b16-ba22-c87aa44a822d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:30:26.357798 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f2e674d8-93e6-42c8-8a4b-fa3c31d0e1e7 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c11a7c3cec94797b639e6e53dcbfb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375d02476ed240ea967eb2e28e8474ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:26.368561 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f2e674d8-93e6-42c8-8a4b-fa3c31d0e1e7 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] 10.222.0.20 "GET /compute/v2.1/servers/31fc27b2-5ba0-4ba9-b119-12644f8eea78" status: 200 len: 1477 microversion: 2.1 time: 1.330632 Oct 04 18:30:26.374463 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 301/631] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:25 2022] GET /compute/v2.1/servers/31fc27b2-5ba0-4ba9-b119-12644f8eea78 => generated 1477 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:26.380587 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5008d1f2-5a95-4078-b02c-0953e61fd5b7 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:26.382324 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5008d1f2-5a95-4078-b02c-0953e61fd5b7 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: 208ff352-ed98-4a12-8913-7e520822bf95] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:26.399814 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5008d1f2-5a95-4078-b02c-0953e61fd5b7 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:26.400742 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5008d1f2-5a95-4078-b02c-0953e61fd5b7 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:26.407115 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5008d1f2-5a95-4078-b02c-0953e61fd5b7 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:26.408141 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5008d1f2-5a95-4078-b02c-0953e61fd5b7 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:26.408786 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5008d1f2-5a95-4078-b02c-0953e61fd5b7 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:26.409219 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5008d1f2-5a95-4078-b02c-0953e61fd5b7 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:26.432451 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0d87d24c-1b75-4a1b-9b2f-af8c5573ec77 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 3.585995 Oct 04 18:30:26.435233 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 331/632] 10.222.0.20 () {62 vars in 1188 bytes} [Tue Oct 4 18:30:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 3590 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 18:30:26.692552 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-cf10548e-76b8-4a99-9a5f-8194187310dd tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-204237121", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": [{"uuid": "c77a0479-286d-44e4-a122-b4b514a72dc4"}]}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:26.849996 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5008d1f2-5a95-4078-b02c-0953e61fd5b7 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:26.860017 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5008d1f2-5a95-4078-b02c-0953e61fd5b7 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/208ff352-ed98-4a12-8913-7e520822bf95" status: 200 len: 1213 microversion: 2.1 time: 0.484117 Oct 04 18:30:26.868930 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.neutron [None req-cf10548e-76b8-4a99-9a5f-8194187310dd tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] validate_networks() for [('c77a0479-286d-44e4-a122-b4b514a72dc4', None, None, None, None, None)] {{(pid=123001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:30:26.877604 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 302/633] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:26 2022] GET /compute/v2.1/servers/208ff352-ed98-4a12-8913-7e520822bf95 => generated 1213 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:26.896152 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c7f81f78-2998-4d48-8203-afbcb13c7ae2 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:26.902929 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c7f81f78-2998-4d48-8203-afbcb13c7ae2 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] [instance: c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:26.922643 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c7f81f78-2998-4d48-8203-afbcb13c7ae2 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:26.923133 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c7f81f78-2998-4d48-8203-afbcb13c7ae2 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:26.923562 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c7f81f78-2998-4d48-8203-afbcb13c7ae2 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:26.939965 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c7f81f78-2998-4d48-8203-afbcb13c7ae2 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:26.940366 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c7f81f78-2998-4d48-8203-afbcb13c7ae2 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:26.940811 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c7f81f78-2998-4d48-8203-afbcb13c7ae2 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:28.039588 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c7f81f78-2998-4d48-8203-afbcb13c7ae2 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8675d7d8bab840f3a221fdf2ee4c9b5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25214dec3ef24597be8e5acde61de3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:28.052861 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c7f81f78-2998-4d48-8203-afbcb13c7ae2 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] 10.222.0.20 "GET /compute/v2.1/servers/c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23" status: 200 len: 1391 microversion: 2.1 time: 1.170708 Oct 04 18:30:28.059267 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 303/634] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:26 2022] GET /compute/v2.1/servers/c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23 => generated 1391 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:28.095256 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-99da31e0-b8cf-40f1-8427-82be4d592fb5 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:28.099325 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-99da31e0-b8cf-40f1-8427-82be4d592fb5 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: 609c8bd3-a9fc-4b16-ba22-c87aa44a822d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:28.398324 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-99da31e0-b8cf-40f1-8427-82be4d592fb5 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:28.407433 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-99da31e0-b8cf-40f1-8427-82be4d592fb5 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:28.417132 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-99da31e0-b8cf-40f1-8427-82be4d592fb5 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:28.419907 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-99da31e0-b8cf-40f1-8427-82be4d592fb5 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/609c8bd3-a9fc-4b16-ba22-c87aa44a822d" status: 200 len: 1262 microversion: 2.25 time: 0.358922 Oct 04 18:30:28.425067 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 304/635] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:30:28 2022] GET /compute/v2.1/servers/609c8bd3-a9fc-4b16-ba22-c87aa44a822d => generated 1262 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:30:28.436981 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-4e788501-2e80-4fcb-afe7-afe1a7e36b74 req-9b797fca-1908-4803-9dcd-cdf210bba125 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31fc27b2-5ba0-4ba9-b119-12644f8eea78", "name": "network-vif-deleted", "tag": "c283ec45-e77a-4800-b6ac-8286118aa036"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:28.493698 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-4e788501-2e80-4fcb-afe7-afe1a7e36b74 req-9b797fca-1908-4803-9dcd-cdf210bba125 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:28.494433 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-4e788501-2e80-4fcb-afe7-afe1a7e36b74 req-9b797fca-1908-4803-9dcd-cdf210bba125 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:28.495047 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-4e788501-2e80-4fcb-afe7-afe1a7e36b74 req-9b797fca-1908-4803-9dcd-cdf210bba125 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:28.529293 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-4e788501-2e80-4fcb-afe7-afe1a7e36b74 req-9b797fca-1908-4803-9dcd-cdf210bba125 service nova] Creating event network-vif-deleted:c283ec45-e77a-4800-b6ac-8286118aa036 for instance 31fc27b2-5ba0-4ba9-b119-12644f8eea78 on n-h1-850501-14 Oct 04 18:30:28.581534 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-4e788501-2e80-4fcb-afe7-afe1a7e36b74 req-9b797fca-1908-4803-9dcd-cdf210bba125 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147995 Oct 04 18:30:28.584107 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 305/636] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:30:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:30:28.593730 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f2d38144-47ba-42c6-89e1-046c6a7647cf tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:28.605428 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f2d38144-47ba-42c6-89e1-046c6a7647cf tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] [instance: 31fc27b2-5ba0-4ba9-b119-12644f8eea78] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:28.634414 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f2d38144-47ba-42c6-89e1-046c6a7647cf tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:28.635393 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f2d38144-47ba-42c6-89e1-046c6a7647cf tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:28.636625 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f2d38144-47ba-42c6-89e1-046c6a7647cf tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:28.639847 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f2d38144-47ba-42c6-89e1-046c6a7647cf tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:28.645004 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f2d38144-47ba-42c6-89e1-046c6a7647cf tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:28.649546 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f2d38144-47ba-42c6-89e1-046c6a7647cf tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:28.827956 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f2d38144-47ba-42c6-89e1-046c6a7647cf tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:28.837574 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f2d38144-47ba-42c6-89e1-046c6a7647cf tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:28.844839 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f2d38144-47ba-42c6-89e1-046c6a7647cf tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:28.844839 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-f2d38144-47ba-42c6-89e1-046c6a7647cf tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lazy-loading 'fault' on Instance uuid 31fc27b2-5ba0-4ba9-b119-12644f8eea78 {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:30:29.087566 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f2d38144-47ba-42c6-89e1-046c6a7647cf tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c11a7c3cec94797b639e6e53dcbfb20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375d02476ed240ea967eb2e28e8474ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:29.100157 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f2d38144-47ba-42c6-89e1-046c6a7647cf tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] 10.222.0.20 "GET /compute/v2.1/servers/31fc27b2-5ba0-4ba9-b119-12644f8eea78" status: 200 len: 1311 microversion: 2.1 time: 0.510890 Oct 04 18:30:29.112992 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 306/637] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:28 2022] GET /compute/v2.1/servers/31fc27b2-5ba0-4ba9-b119-12644f8eea78 => generated 1311 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:29.121890 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5dfa0c7e-7614-4e14-92d5-93f40fc01152 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:29.129895 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5dfa0c7e-7614-4e14-92d5-93f40fc01152 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: 208ff352-ed98-4a12-8913-7e520822bf95] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:29.160877 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5dfa0c7e-7614-4e14-92d5-93f40fc01152 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:29.176465 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5dfa0c7e-7614-4e14-92d5-93f40fc01152 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:29.177472 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5dfa0c7e-7614-4e14-92d5-93f40fc01152 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:29.182664 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5dfa0c7e-7614-4e14-92d5-93f40fc01152 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:29.186306 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5dfa0c7e-7614-4e14-92d5-93f40fc01152 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:29.187258 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5dfa0c7e-7614-4e14-92d5-93f40fc01152 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:29.432217 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5dfa0c7e-7614-4e14-92d5-93f40fc01152 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:29.456756 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5dfa0c7e-7614-4e14-92d5-93f40fc01152 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/208ff352-ed98-4a12-8913-7e520822bf95" status: 200 len: 1269 microversion: 2.1 time: 0.346027 Oct 04 18:30:29.457342 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 307/638] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:29 2022] GET /compute/v2.1/servers/208ff352-ed98-4a12-8913-7e520822bf95 => generated 1269 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:29.590095 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d389f592-e243-4abd-ac8e-b447373e71c1 tempest-FloatingIPsNegativeTestJSON-133985293 tempest-FloatingIPsNegativeTestJSON-133985293-project] Calling method '.version_select at 0x7fe259400af0>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:29.615284 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-cf10548e-76b8-4a99-9a5f-8194187310dd tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:30:29.616773 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-cf10548e-76b8-4a99-9a5f-8194187310dd tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:30:29.617546 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-cf10548e-76b8-4a99-9a5f-8194187310dd tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:30:29.618190 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-cf10548e-76b8-4a99-9a5f-8194187310dd tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:30:29.624191 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-cf10548e-76b8-4a99-9a5f-8194187310dd tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:30:29.624191 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=6 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:30:29.636799 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=17 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:30:29.647909 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cf10548e-76b8-4a99-9a5f-8194187310dd tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:29.648435 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cf10548e-76b8-4a99-9a5f-8194187310dd tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:29.656349 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cf10548e-76b8-4a99-9a5f-8194187310dd tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:29.656625 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cf10548e-76b8-4a99-9a5f-8194187310dd tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:29.659790 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cf10548e-76b8-4a99-9a5f-8194187310dd tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:29.662251 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cf10548e-76b8-4a99-9a5f-8194187310dd tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:29.772576 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-cf10548e-76b8-4a99-9a5f-8194187310dd tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Getting quotas for project dde62f171d474b038f1af39899518211. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:30:29.787518 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-cf10548e-76b8-4a99-9a5f-8194187310dd tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Getting quotas for user c80f2b2dbf824a1d879f5b7edb343f26 and project dde62f171d474b038f1af39899518211. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:30:29.813389 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-cf10548e-76b8-4a99-9a5f-8194187310dd tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Going to run 1 instances... {{(pid=123001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:30:29.820627 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-cf10548e-76b8-4a99-9a5f-8194187310dd tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 89738dfe-3844-455a-93d1-d38702038946] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:30:29.838105 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d389f592-e243-4abd-ac8e-b447373e71c1 tempest-FloatingIPsNegativeTestJSON-133985293 tempest-FloatingIPsNegativeTestJSON-133985293-project] 10.222.0.20 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.375419 Oct 04 18:30:29.842848 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 308/639] 10.222.0.20 () {58 vars in 1149 bytes} [Tue Oct 4 18:30:29 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:30:29.851103 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-be417dd8-17b5-4574-8650-24acca0e6a05 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:29.852774 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-be417dd8-17b5-4574-8650-24acca0e6a05 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] [instance: c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:29.875145 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-be417dd8-17b5-4574-8650-24acca0e6a05 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:29.883982 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-be417dd8-17b5-4574-8650-24acca0e6a05 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:29.888627 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-be417dd8-17b5-4574-8650-24acca0e6a05 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:29.888627 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-be417dd8-17b5-4574-8650-24acca0e6a05 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:29.892500 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-be417dd8-17b5-4574-8650-24acca0e6a05 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:29.893459 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-be417dd8-17b5-4574-8650-24acca0e6a05 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:30.035781 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-cf10548e-76b8-4a99-9a5f-8194187310dd tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.599176 Oct 04 18:30:30.039295 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 332/640] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:30:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 3601 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:30:30.044095 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d24ac9d7-1c4d-4ad8-8035-13fd9adedd07 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:30.051553 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d24ac9d7-1c4d-4ad8-8035-13fd9adedd07 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: 609c8bd3-a9fc-4b16-ba22-c87aa44a822d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:30.089658 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d24ac9d7-1c4d-4ad8-8035-13fd9adedd07 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:30.099094 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d24ac9d7-1c4d-4ad8-8035-13fd9adedd07 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:30.101110 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d24ac9d7-1c4d-4ad8-8035-13fd9adedd07 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:30.108990 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d24ac9d7-1c4d-4ad8-8035-13fd9adedd07 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:30.109379 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d24ac9d7-1c4d-4ad8-8035-13fd9adedd07 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:30.109831 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d24ac9d7-1c4d-4ad8-8035-13fd9adedd07 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:30.727159 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d24ac9d7-1c4d-4ad8-8035-13fd9adedd07 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:30.761798 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-be417dd8-17b5-4574-8650-24acca0e6a05 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8675d7d8bab840f3a221fdf2ee4c9b5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25214dec3ef24597be8e5acde61de3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:30.770437 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-be417dd8-17b5-4574-8650-24acca0e6a05 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] 10.222.0.20 "GET /compute/v2.1/servers/c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23" status: 200 len: 1391 microversion: 2.1 time: 0.926528 Oct 04 18:30:30.777733 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d24ac9d7-1c4d-4ad8-8035-13fd9adedd07 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:30.778221 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 309/641] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:29 2022] GET /compute/v2.1/servers/c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23 => generated 1391 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:30.778307 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d24ac9d7-1c4d-4ad8-8035-13fd9adedd07 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:30.796373 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d24ac9d7-1c4d-4ad8-8035-13fd9adedd07 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/609c8bd3-a9fc-4b16-ba22-c87aa44a822d" status: 200 len: 1314 microversion: 2.25 time: 0.753451 Oct 04 18:30:30.812079 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 333/642] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:30:30 2022] GET /compute/v2.1/servers/609c8bd3-a9fc-4b16-ba22-c87aa44a822d => generated 1314 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:30:30.812408 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-53f41587-0407-4d6f-a8ad-97d7879b1556 tempest-FloatingIPsNegativeTestJSON-133985293 tempest-FloatingIPsNegativeTestJSON-133985293-project] Action: 'create', calling method: .version_select at 0x7fe259467310>, body: {"pool": "non_exist_pool"} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:30.823369 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-474df2cd-36e3-46b1-ac5d-97e4ee1b1bb8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:30.823369 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-474df2cd-36e3-46b1-ac5d-97e4ee1b1bb8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 89738dfe-3844-455a-93d1-d38702038946] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:31.345656 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-474df2cd-36e3-46b1-ac5d-97e4ee1b1bb8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:31.346433 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-53f41587-0407-4d6f-a8ad-97d7879b1556 tempest-FloatingIPsNegativeTestJSON-133985293 tempest-FloatingIPsNegativeTestJSON-133985293-project] HTTP exception thrown: Floating IP pool not found. Oct 04 18:30:31.352790 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-53f41587-0407-4d6f-a8ad-97d7879b1556 tempest-FloatingIPsNegativeTestJSON-133985293 tempest-FloatingIPsNegativeTestJSON-133985293-project] Request method failure captured: Oct 04 18:30:31.352790 n-d-850501-14 devstack@n-api.service[123002]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Oct 04 18:30:31.352790 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:30:31.352790 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:30:31.352790 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:30:31.352790 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 26 Oct 04 18:30:31.352790 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:30:31.352790 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:30:31.352790 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:30:31.352790 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:30:31.352790 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPHvEH86ch7Kf1NZstdQtYCGph2HuJweNHZfRTe9ZqP9DXVD-037VDeQWqWmjgENUhiXzgpszI2vGwDsVceefSccbemc6GRAQ0TMK4oyq0uutYxqFtmznU8IKYCzg-9h9U6k73L1KRvCBKRt2JkvwsUUjTS_BXEmlH5HTYBZrIjwVWmA Oct 04 18:30:31.352790 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:30:31.352790 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:30:31.352790 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:30:31.352790 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:30:31.352790 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:30:31.352790 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:30:31.352790 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 2368ea9ae69d4a94a35f253a4325e6ab Oct 04 18:30:31.352790 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-133985293 Oct 04 18:30:31.352790 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:30:31.352790 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:30:31.354438 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2368ea9ae69d4a94a35f253a4325e6ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2368ea9ae69d4a94a35f253a4325e6ab", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2368ea9ae69d4a94a35f253a4325e6ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2368ea9ae69d4a94a35f253a4325e6ab"}]}] Oct 04 18:30:31.354438 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-133985293 Oct 04 18:30:31.354438 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 2368ea9ae69d4a94a35f253a4325e6ab Oct 04 18:30:31.354438 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-133985293 Oct 04 18:30:31.354438 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-FloatingIPsNegativeTestJSON-133985293-project Oct 04 18:30:31.354438 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:30:31.354438 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:30:31.354438 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 0a7d480019644176a7ac083bb5201315 Oct 04 18:30:31.354438 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-133985293-project Oct 04 18:30:31.354438 n-d-850501-14 devstack@n-api.service[123002]: Oct 04 18:30:31.354438 n-d-850501-14 devstack@n-api.service[123002]: {"pool": "non_exist_pool"} Oct 04 18:30:31.354438 n-d-850501-14 devstack@n-api.service[123002]: method: Oct 04 18:30:31.354438 n-d-850501-14 devstack@n-api.service[123002]: exception: Floating IP pool not found. Oct 04 18:30:31.354438 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'body': {'pool': 'non_exist_pool'}} Oct 04 18:30:31.354438 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:30:31.355606 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:31.355606 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Oct 04 18:30:31.355606 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Oct 04 18:30:31.355606 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Oct 04 18:30:31.355606 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Oct 04 18:30:31.355606 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Oct 04 18:30:31.355606 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Oct 04 18:30:31.355606 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Oct 04 18:30:31.355606 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:30:31.355606 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:31.355606 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:30:31.355606 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:31.355606 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:31.355606 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:31.355606 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:30:31.355606 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:30:31.355606 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:30:31.355606 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:30:31.355606 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:30:31.355606 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:30:31.356950 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Oct 04 18:30:31.356950 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:30:31.356950 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Oct 04 18:30:31.356950 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:30:31.356950 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:31.356950 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:30:31.356950 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:31.356950 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:31.356950 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:31.356950 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:30:31.356950 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:30:31.356950 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Oct 04 18:30:31.356950 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:30:31.359242 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-53f41587-0407-4d6f-a8ad-97d7879b1556 tempest-FloatingIPsNegativeTestJSON-133985293 tempest-FloatingIPsNegativeTestJSON-133985293-project] Returning 404 to user: Floating IP pool not found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:30:31.362407 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-53f41587-0407-4d6f-a8ad-97d7879b1556 tempest-FloatingIPsNegativeTestJSON-133985293 tempest-FloatingIPsNegativeTestJSON-133985293-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.586776 Oct 04 18:30:31.363236 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 310/643] 10.222.0.20 () {60 vars in 1170 bytes} [Tue Oct 4 18:30:30 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 589 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:30:31.372895 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e8190b24-7da1-4cec-80e6-047c4851e3f8 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:31.374747 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e8190b24-7da1-4cec-80e6-047c4851e3f8 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] [instance: 31fc27b2-5ba0-4ba9-b119-12644f8eea78] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:31.377537 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-474df2cd-36e3-46b1-ac5d-97e4ee1b1bb8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946" status: 200 len: 1210 microversion: 2.1 time: 0.573038 Oct 04 18:30:31.378630 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 334/644] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:30 2022] GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946 => generated 1210 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:31.386545 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9ad48d10-9255-4778-a214-a18c73d4caa8 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:31.388712 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-9ad48d10-9255-4778-a214-a18c73d4caa8 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: 208ff352-ed98-4a12-8913-7e520822bf95] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:31.401647 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e8190b24-7da1-4cec-80e6-047c4851e3f8 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:31.402157 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e8190b24-7da1-4cec-80e6-047c4851e3f8 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:31.402595 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e8190b24-7da1-4cec-80e6-047c4851e3f8 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:31.407551 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e8190b24-7da1-4cec-80e6-047c4851e3f8 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:31.408155 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e8190b24-7da1-4cec-80e6-047c4851e3f8 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:31.408760 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e8190b24-7da1-4cec-80e6-047c4851e3f8 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:31.416770 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9ad48d10-9255-4778-a214-a18c73d4caa8 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:31.437544 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9ad48d10-9255-4778-a214-a18c73d4caa8 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:31.440504 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9ad48d10-9255-4778-a214-a18c73d4caa8 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:31.441775 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9ad48d10-9255-4778-a214-a18c73d4caa8 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:31.442768 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9ad48d10-9255-4778-a214-a18c73d4caa8 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:31.446172 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9ad48d10-9255-4778-a214-a18c73d4caa8 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:31.469359 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-e8190b24-7da1-4cec-80e6-047c4851e3f8 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] HTTP exception thrown: Instance 31fc27b2-5ba0-4ba9-b119-12644f8eea78 could not be found. Oct 04 18:30:31.471092 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e8190b24-7da1-4cec-80e6-047c4851e3f8 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Request method failure captured: Oct 04 18:30:31.471092 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/31fc27b2-5ba0-4ba9-b119-12644f8eea78 HTTP/1.1 Oct 04 18:30:31.471092 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:30:31.471092 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:30:31.471092 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:30:31.471092 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:30:31.471092 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:30:31.471092 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:30:31.471092 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:30:31.471092 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:30:31.471092 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPHt6Z4MqwPQR0qfQRMYX5wkNsh3pd3Y8mVrne4SDvn3IepmkSY1VJYmeMJeY7DTIjndDJPclSm9v9Yqc3PkAMNxeV1YHXIm_WxkI4bsGHCCl25TaqR72zTdMfKd5cCTL0Q96N2bCx_Rsm80NAfC-i0sbp01irNoH4Gu7I89xQq_GP9E Oct 04 18:30:31.471092 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:30:31.471092 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:30:31.471092 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:30:31.471092 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:30:31.471092 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:30:31.471092 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:30:31.471092 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 375d02476ed240ea967eb2e28e8474ab Oct 04 18:30:31.471092 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-921918686 Oct 04 18:30:31.471092 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:30:31.471092 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:30:31.473507 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/375d02476ed240ea967eb2e28e8474ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_375d02476ed240ea967eb2e28e8474ab", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/375d02476ed240ea967eb2e28e8474ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/375d02476ed240ea967eb2e28e8474ab"}]}] Oct 04 18:30:31.473507 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServersAdminNegativeTestJSON-921918686 Oct 04 18:30:31.473507 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 375d02476ed240ea967eb2e28e8474ab Oct 04 18:30:31.473507 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-921918686 Oct 04 18:30:31.473507 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServersAdminNegativeTestJSON-921918686-project Oct 04 18:30:31.473507 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:30:31.473507 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:30:31.473507 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 3c11a7c3cec94797b639e6e53dcbfb20 Oct 04 18:30:31.473507 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServersAdminNegativeTestJSON-921918686-project Oct 04 18:30:31.473507 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:30:31.473507 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 31fc27b2-5ba0-4ba9-b119-12644f8eea78 could not be found. Oct 04 18:30:31.473507 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '31fc27b2-5ba0-4ba9-b119-12644f8eea78'} Oct 04 18:30:31.474484 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:30:31.474484 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:31.474484 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:30:31.474484 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:30:31.474484 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:30:31.474484 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:30:31.474484 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:30:31.474484 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:30:31.474484 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:30:31.474484 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:30:31.474484 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31fc27b2-5ba0-4ba9-b119-12644f8eea78 could not be found. Oct 04 18:30:31.474484 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:30:31.474484 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:31.474484 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:30:31.474484 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:31.474484 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:31.474484 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:31.474484 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:30:31.474484 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:30:31.474484 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:30:31.476275 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:30:31.476275 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:30:31.476275 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:30:31.476275 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:30:31.476275 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:30:31.476275 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:30:31.476275 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:30:31.476275 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31fc27b2-5ba0-4ba9-b119-12644f8eea78 could not be found. Oct 04 18:30:31.476275 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:30:31.476275 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:31.476275 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:30:31.476275 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:31.476275 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:31.476275 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:31.476275 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:30:31.476275 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:30:31.476275 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31fc27b2-5ba0-4ba9-b119-12644f8eea78 could not be found. Oct 04 18:30:31.476275 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:30:31.478834 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e8190b24-7da1-4cec-80e6-047c4851e3f8 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] Returning 404 to user: Instance 31fc27b2-5ba0-4ba9-b119-12644f8eea78 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:30:31.479941 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e8190b24-7da1-4cec-80e6-047c4851e3f8 tempest-ServersAdminNegativeTestJSON-921918686 tempest-ServersAdminNegativeTestJSON-921918686-project] 10.222.0.20 "GET /compute/v2.1/servers/31fc27b2-5ba0-4ba9-b119-12644f8eea78" status: 404 len: 111 microversion: 2.1 time: 0.107571 Oct 04 18:30:31.482992 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 311/645] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:31 2022] GET /compute/v2.1/servers/31fc27b2-5ba0-4ba9-b119-12644f8eea78 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:30:31.489709 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-bdb0dc39-85ad-4ad6-be9b-e92cfa344637 tempest-FloatingIPsNegativeTestJSON-133985293 tempest-FloatingIPsNegativeTestJSON-133985293-project] Calling method '.version_select at 0x7fe259467790>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:31.734131 n-d-850501-14 devstack@n-api.service[123002]: DEBUG neutronclient.v2_0.client [None req-bdb0dc39-85ad-4ad6-be9b-e92cfa344637 tempest-FloatingIPsNegativeTestJSON-133985293 tempest-FloatingIPsNegativeTestJSON-133985293-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP e9703ee2-b8e2-46cf-9fcb-d70216ae8778 could not be found", "detail": ""}} {{(pid=123002) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:30:31.734859 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-bdb0dc39-85ad-4ad6-be9b-e92cfa344637 tempest-FloatingIPsNegativeTestJSON-133985293 tempest-FloatingIPsNegativeTestJSON-133985293-project] HTTP exception thrown: Floating IP not found for ID e9703ee2-b8e2-46cf-9fcb-d70216ae8778 Oct 04 18:30:31.736769 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-bdb0dc39-85ad-4ad6-be9b-e92cfa344637 tempest-FloatingIPsNegativeTestJSON-133985293 tempest-FloatingIPsNegativeTestJSON-133985293-project] Request method failure captured: Oct 04 18:30:31.736769 n-d-850501-14 devstack@n-api.service[123002]: request: DELETE /compute/v2.1/os-floating-ips/e9703ee2-b8e2-46cf-9fcb-d70216ae8778 HTTP/1.1 Oct 04 18:30:31.736769 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:30:31.736769 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:30:31.736769 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:30:31.736769 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:30:31.736769 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:30:31.736769 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:30:31.736769 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:30:31.736769 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:30:31.736769 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPHvEH86ch7Kf1NZstdQtYCGph2HuJweNHZfRTe9ZqP9DXVD-037VDeQWqWmjgENUhiXzgpszI2vGwDsVceefSccbemc6GRAQ0TMK4oyq0uutYxqFtmznU8IKYCzg-9h9U6k73L1KRvCBKRt2JkvwsUUjTS_BXEmlH5HTYBZrIjwVWmA Oct 04 18:30:31.736769 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:30:31.736769 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:30:31.736769 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:30:31.736769 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:30:31.736769 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:30:31.736769 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:30:31.736769 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 2368ea9ae69d4a94a35f253a4325e6ab Oct 04 18:30:31.736769 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-133985293 Oct 04 18:30:31.736769 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:30:31.736769 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:30:31.739198 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2368ea9ae69d4a94a35f253a4325e6ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2368ea9ae69d4a94a35f253a4325e6ab", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2368ea9ae69d4a94a35f253a4325e6ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2368ea9ae69d4a94a35f253a4325e6ab"}]}] Oct 04 18:30:31.739198 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-133985293 Oct 04 18:30:31.739198 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 2368ea9ae69d4a94a35f253a4325e6ab Oct 04 18:30:31.739198 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-133985293 Oct 04 18:30:31.739198 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-FloatingIPsNegativeTestJSON-133985293-project Oct 04 18:30:31.739198 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:30:31.739198 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:30:31.739198 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 0a7d480019644176a7ac083bb5201315 Oct 04 18:30:31.739198 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-133985293-project Oct 04 18:30:31.739198 n-d-850501-14 devstack@n-api.service[123002]: method: Oct 04 18:30:31.739198 n-d-850501-14 devstack@n-api.service[123002]: exception: Floating IP not found for ID e9703ee2-b8e2-46cf-9fcb-d70216ae8778 Oct 04 18:30:31.739198 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'e9703ee2-b8e2-46cf-9fcb-d70216ae8778'} Oct 04 18:30:31.739198 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:30:31.739986 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:31.739986 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 04 18:30:31.739986 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 04 18:30:31.739986 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:30:31.739986 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:30:31.739986 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 04 18:30:31.739986 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 04 18:30:31.739986 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:30:31.739986 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:30:31.739986 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:30:31.739986 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 18:30:31.739986 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:30:31.739986 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:30:31.739986 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:30:31.739986 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:30:31.739986 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:30:31.739986 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:30:31.739986 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:30:31.739986 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:30:31.741745 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:30:31.741745 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:30:31.741745 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:30:31.741745 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:30:31.741745 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:30:31.741745 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:30:31.741745 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP e9703ee2-b8e2-46cf-9fcb-d70216ae8778 could not be found Oct 04 18:30:31.741745 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cb1a8b61-caf5-4c3f-9433-671c1bbef861'] Oct 04 18:30:31.741745 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:30:31.741745 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:31.741745 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:30:31.741745 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:31.741745 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 04 18:30:31.741745 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 04 18:30:31.741745 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 04 18:30:31.741745 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 04 18:30:31.741745 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID e9703ee2-b8e2-46cf-9fcb-d70216ae8778. Oct 04 18:30:31.741745 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:30:31.741745 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:31.741745 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:30:31.745020 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:31.745020 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:31.745020 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:31.745020 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:30:31.745020 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:30:31.745020 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:30:31.745020 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:30:31.745020 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:30:31.745020 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:30:31.745020 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 04 18:30:31.745020 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 18:30:31.745020 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID e9703ee2-b8e2-46cf-9fcb-d70216ae8778 Oct 04 18:30:31.745020 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:30:31.745020 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:31.745020 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:30:31.745020 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:31.745020 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:31.745020 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:31.745020 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:30:31.745020 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:30:31.749488 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID e9703ee2-b8e2-46cf-9fcb-d70216ae8778 Oct 04 18:30:31.749488 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:30:31.749488 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-bdb0dc39-85ad-4ad6-be9b-e92cfa344637 tempest-FloatingIPsNegativeTestJSON-133985293 tempest-FloatingIPsNegativeTestJSON-133985293-project] Returning 404 to user: Floating IP not found for ID e9703ee2-b8e2-46cf-9fcb-d70216ae8778 {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:30:31.749488 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-bdb0dc39-85ad-4ad6-be9b-e92cfa344637 tempest-FloatingIPsNegativeTestJSON-133985293 tempest-FloatingIPsNegativeTestJSON-133985293-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/e9703ee2-b8e2-46cf-9fcb-d70216ae8778" status: 404 len: 111 microversion: 2.1 time: 0.252304 Oct 04 18:30:31.749488 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 312/646] 10.222.0.20 () {58 vars in 1263 bytes} [Tue Oct 4 18:30:31 2022] DELETE /compute/v2.1/os-floating-ips/e9703ee2-b8e2-46cf-9fcb-d70216ae8778 => generated 111 bytes in 256 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:30:31.804152 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2a92c29d-ffb7-4dd5-8d83-b81a590a5c58 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:31.804862 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2a92c29d-ffb7-4dd5-8d83-b81a590a5c58 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] [instance: c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:31.807744 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:30:31.824357 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2a92c29d-ffb7-4dd5-8d83-b81a590a5c58 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:31.824852 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2a92c29d-ffb7-4dd5-8d83-b81a590a5c58 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:31.825284 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2a92c29d-ffb7-4dd5-8d83-b81a590a5c58 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:31.829090 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2a92c29d-ffb7-4dd5-8d83-b81a590a5c58 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:31.829857 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2a92c29d-ffb7-4dd5-8d83-b81a590a5c58 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:31.830504 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2a92c29d-ffb7-4dd5-8d83-b81a590a5c58 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:31.947570 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9ad48d10-9255-4778-a214-a18c73d4caa8 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:31.958331 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9ad48d10-9255-4778-a214-a18c73d4caa8 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/208ff352-ed98-4a12-8913-7e520822bf95" status: 200 len: 1275 microversion: 2.1 time: 0.578108 Oct 04 18:30:31.958912 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 335/647] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:31 2022] GET /compute/v2.1/servers/208ff352-ed98-4a12-8913-7e520822bf95 => generated 1275 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:31.984447 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f67bb4bc-d781-40e2-9e14-5abbf39f1c61 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:31.987835 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f67bb4bc-d781-40e2-9e14-5abbf39f1c61 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: 609c8bd3-a9fc-4b16-ba22-c87aa44a822d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:32.009879 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f67bb4bc-d781-40e2-9e14-5abbf39f1c61 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:32.010790 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f67bb4bc-d781-40e2-9e14-5abbf39f1c61 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:32.011395 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f67bb4bc-d781-40e2-9e14-5abbf39f1c61 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:32.012451 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f67bb4bc-d781-40e2-9e14-5abbf39f1c61 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:32.013266 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f67bb4bc-d781-40e2-9e14-5abbf39f1c61 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:32.014852 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f67bb4bc-d781-40e2-9e14-5abbf39f1c61 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:32.439540 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f67bb4bc-d781-40e2-9e14-5abbf39f1c61 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:32.465216 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f67bb4bc-d781-40e2-9e14-5abbf39f1c61 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:32.472031 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f67bb4bc-d781-40e2-9e14-5abbf39f1c61 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:32.481595 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f67bb4bc-d781-40e2-9e14-5abbf39f1c61 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/609c8bd3-a9fc-4b16-ba22-c87aa44a822d" status: 200 len: 1320 microversion: 2.25 time: 0.516747 Oct 04 18:30:32.492998 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 336/648] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:30:31 2022] GET /compute/v2.1/servers/609c8bd3-a9fc-4b16-ba22-c87aa44a822d => generated 1320 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:30:32.493890 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:30:32.509830 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8bb96832-8f51-4cdc-875f-59f1247d0880 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:32.510709 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8bb96832-8f51-4cdc-875f-59f1247d0880 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 89738dfe-3844-455a-93d1-d38702038946] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:32.541704 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8bb96832-8f51-4cdc-875f-59f1247d0880 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:32.545752 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8bb96832-8f51-4cdc-875f-59f1247d0880 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:32.546583 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8bb96832-8f51-4cdc-875f-59f1247d0880 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:32.549618 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8bb96832-8f51-4cdc-875f-59f1247d0880 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:32.558289 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8bb96832-8f51-4cdc-875f-59f1247d0880 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:32.562551 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8bb96832-8f51-4cdc-875f-59f1247d0880 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:32.810633 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8bb96832-8f51-4cdc-875f-59f1247d0880 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:32.829637 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8bb96832-8f51-4cdc-875f-59f1247d0880 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946" status: 200 len: 1214 microversion: 2.1 time: 0.333632 Oct 04 18:30:32.830750 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 337/649] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:32 2022] GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946 => generated 1214 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:32.987832 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-902ae94b-b6eb-45c2-9b6c-7f8e478b7bab tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:32.990179 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-902ae94b-b6eb-45c2-9b6c-7f8e478b7bab tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: 208ff352-ed98-4a12-8913-7e520822bf95] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:33.034546 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-902ae94b-b6eb-45c2-9b6c-7f8e478b7bab tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:33.035111 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-902ae94b-b6eb-45c2-9b6c-7f8e478b7bab tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:33.035556 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-902ae94b-b6eb-45c2-9b6c-7f8e478b7bab tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:33.040135 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-902ae94b-b6eb-45c2-9b6c-7f8e478b7bab tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:33.040944 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-902ae94b-b6eb-45c2-9b6c-7f8e478b7bab tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:33.041601 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-902ae94b-b6eb-45c2-9b6c-7f8e478b7bab tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:33.978699 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-902ae94b-b6eb-45c2-9b6c-7f8e478b7bab tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:33.987906 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-902ae94b-b6eb-45c2-9b6c-7f8e478b7bab tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/208ff352-ed98-4a12-8913-7e520822bf95" status: 200 len: 1275 microversion: 2.1 time: 1.003891 Oct 04 18:30:34.025037 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 338/650] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:32 2022] GET /compute/v2.1/servers/208ff352-ed98-4a12-8913-7e520822bf95 => generated 1275 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:34.059696 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2a92c29d-ffb7-4dd5-8d83-b81a590a5c58 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8675d7d8bab840f3a221fdf2ee4c9b5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25214dec3ef24597be8e5acde61de3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:34.079141 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2a92c29d-ffb7-4dd5-8d83-b81a590a5c58 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] 10.222.0.20 "GET /compute/v2.1/servers/c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23" status: 200 len: 1391 microversion: 2.1 time: 2.282786 Oct 04 18:30:34.087704 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 313/651] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:31 2022] GET /compute/v2.1/servers/c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23 => generated 1391 bytes in 2292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:34.110722 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a9000461-0cb2-4e0b-b018-392b0106971a tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:34.113819 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a9000461-0cb2-4e0b-b018-392b0106971a tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: 609c8bd3-a9fc-4b16-ba22-c87aa44a822d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:34.136788 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a9000461-0cb2-4e0b-b018-392b0106971a tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:34.142496 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a9000461-0cb2-4e0b-b018-392b0106971a tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:34.147143 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a9000461-0cb2-4e0b-b018-392b0106971a tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:34.152378 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a9000461-0cb2-4e0b-b018-392b0106971a tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:34.158492 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a9000461-0cb2-4e0b-b018-392b0106971a tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:34.159126 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a9000461-0cb2-4e0b-b018-392b0106971a tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:34.467485 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-82cfdb12-5247-40d4-b29e-4c6934542948 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1571380018", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": [{"uuid": "51e9c15f-99f8-4dc7-83c1-3f0cf4949f12"}]}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:34.628834 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.neutron [None req-82cfdb12-5247-40d4-b29e-4c6934542948 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] validate_networks() for [('51e9c15f-99f8-4dc7-83c1-3f0cf4949f12', None, None, None, None, None)] {{(pid=123001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:30:35.274260 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a9000461-0cb2-4e0b-b018-392b0106971a tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:35.287651 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a9000461-0cb2-4e0b-b018-392b0106971a tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:35.301088 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a9000461-0cb2-4e0b-b018-392b0106971a tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:35.302669 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a9000461-0cb2-4e0b-b018-392b0106971a tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/609c8bd3-a9fc-4b16-ba22-c87aa44a822d" status: 200 len: 1362 microversion: 2.25 time: 1.207650 Oct 04 18:30:35.305514 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 314/652] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:30:34 2022] GET /compute/v2.1/servers/609c8bd3-a9fc-4b16-ba22-c87aa44a822d => generated 1362 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:30:35.311305 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1608d3fd-c750-404c-8bc1-848d65ca0b50 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:35.322619 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1608d3fd-c750-404c-8bc1-848d65ca0b50 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 89738dfe-3844-455a-93d1-d38702038946] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:35.335972 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1608d3fd-c750-404c-8bc1-848d65ca0b50 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:35.340264 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1608d3fd-c750-404c-8bc1-848d65ca0b50 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:35.340264 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1608d3fd-c750-404c-8bc1-848d65ca0b50 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:35.340264 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1608d3fd-c750-404c-8bc1-848d65ca0b50 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:35.340264 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1608d3fd-c750-404c-8bc1-848d65ca0b50 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:35.340640 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1608d3fd-c750-404c-8bc1-848d65ca0b50 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:35.551041 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1608d3fd-c750-404c-8bc1-848d65ca0b50 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:35.564829 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1608d3fd-c750-404c-8bc1-848d65ca0b50 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946" status: 200 len: 1270 microversion: 2.1 time: 0.257133 Oct 04 18:30:35.567704 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 315/653] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:35 2022] GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946 => generated 1270 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:35.584261 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-16b2ea94-c195-4323-8956-1dcfb578f802 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:35.585842 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-16b2ea94-c195-4323-8956-1dcfb578f802 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: 208ff352-ed98-4a12-8913-7e520822bf95] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:35.606289 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-16b2ea94-c195-4323-8956-1dcfb578f802 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:35.612033 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-16b2ea94-c195-4323-8956-1dcfb578f802 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:35.615191 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-16b2ea94-c195-4323-8956-1dcfb578f802 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:35.617892 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-16b2ea94-c195-4323-8956-1dcfb578f802 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:35.620460 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-16b2ea94-c195-4323-8956-1dcfb578f802 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:35.621878 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-16b2ea94-c195-4323-8956-1dcfb578f802 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:36.534882 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-82cfdb12-5247-40d4-b29e-4c6934542948 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:30:36.535921 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-82cfdb12-5247-40d4-b29e-4c6934542948 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:30:36.536877 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-82cfdb12-5247-40d4-b29e-4c6934542948 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:30:36.537663 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-82cfdb12-5247-40d4-b29e-4c6934542948 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:30:36.538789 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-82cfdb12-5247-40d4-b29e-4c6934542948 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:30:36.560115 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-82cfdb12-5247-40d4-b29e-4c6934542948 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:36.562312 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-82cfdb12-5247-40d4-b29e-4c6934542948 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:36.566610 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-82cfdb12-5247-40d4-b29e-4c6934542948 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:36.568009 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-82cfdb12-5247-40d4-b29e-4c6934542948 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:36.568760 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-82cfdb12-5247-40d4-b29e-4c6934542948 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:36.570010 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-82cfdb12-5247-40d4-b29e-4c6934542948 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:36.618834 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-82cfdb12-5247-40d4-b29e-4c6934542948 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Getting quotas for project 7e44e7aa06ee4126b5705ba65145ebcc. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:30:36.638647 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-82cfdb12-5247-40d4-b29e-4c6934542948 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Getting quotas for user 415f49a275284a7eb714a55c6bdd0005 and project 7e44e7aa06ee4126b5705ba65145ebcc. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:30:36.659608 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-82cfdb12-5247-40d4-b29e-4c6934542948 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Going to run 1 instances... {{(pid=123001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:30:36.663671 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-82cfdb12-5247-40d4-b29e-4c6934542948 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] [instance: c1bf585c-9cc9-4f87-966c-e02882aa51fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:30:36.838446 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-16b2ea94-c195-4323-8956-1dcfb578f802 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:36.855767 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-16b2ea94-c195-4323-8956-1dcfb578f802 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/208ff352-ed98-4a12-8913-7e520822bf95" status: 200 len: 1317 microversion: 2.1 time: 1.286716 Oct 04 18:30:36.857177 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 316/654] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:35 2022] GET /compute/v2.1/servers/208ff352-ed98-4a12-8913-7e520822bf95 => generated 1317 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:36.868573 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-82cfdb12-5247-40d4-b29e-4c6934542948 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.827817 Oct 04 18:30:36.875435 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 339/655] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:30:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 2844 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:30:36.879656 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-664f0fcf-e896-4097-be5b-8711cf64e45e req-8462a470-ef72-4f7f-9702-c8d3d863c73f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23", "name": "network-vif-plugged", "status": "completed", "tag": "2be6226f-41ea-4517-a7af-b60f36e97405"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:36.900216 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-41cf44f0-ac50-4ca7-a6a5-eb7baf99fc06 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:36.904018 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-41cf44f0-ac50-4ca7-a6a5-eb7baf99fc06 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] [instance: c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:36.915842 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-41cf44f0-ac50-4ca7-a6a5-eb7baf99fc06 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:36.920218 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-41cf44f0-ac50-4ca7-a6a5-eb7baf99fc06 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:36.921006 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-41cf44f0-ac50-4ca7-a6a5-eb7baf99fc06 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:36.926705 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-41cf44f0-ac50-4ca7-a6a5-eb7baf99fc06 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:36.927661 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-41cf44f0-ac50-4ca7-a6a5-eb7baf99fc06 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:36.930880 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-41cf44f0-ac50-4ca7-a6a5-eb7baf99fc06 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:36.941446 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-664f0fcf-e896-4097-be5b-8711cf64e45e req-8462a470-ef72-4f7f-9702-c8d3d863c73f service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:36.945907 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-664f0fcf-e896-4097-be5b-8711cf64e45e req-8462a470-ef72-4f7f-9702-c8d3d863c73f service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:36.953257 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-664f0fcf-e896-4097-be5b-8711cf64e45e req-8462a470-ef72-4f7f-9702-c8d3d863c73f service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:36.994529 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-664f0fcf-e896-4097-be5b-8711cf64e45e req-8462a470-ef72-4f7f-9702-c8d3d863c73f service nova] Creating event network-vif-plugged:2be6226f-41ea-4517-a7af-b60f36e97405 for instance c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23 on n-h2-850501-14 Oct 04 18:30:37.021438 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-664f0fcf-e896-4097-be5b-8711cf64e45e req-8462a470-ef72-4f7f-9702-c8d3d863c73f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150461 Oct 04 18:30:37.022061 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 340/656] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:30:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:30:37.037291 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c3eb0e01-a339-444f-b52c-674ded973118 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:37.037985 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c3eb0e01-a339-444f-b52c-674ded973118 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: 609c8bd3-a9fc-4b16-ba22-c87aa44a822d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:37.073008 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c3eb0e01-a339-444f-b52c-674ded973118 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:37.073439 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c3eb0e01-a339-444f-b52c-674ded973118 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:37.074033 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c3eb0e01-a339-444f-b52c-674ded973118 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:37.074764 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c3eb0e01-a339-444f-b52c-674ded973118 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:37.075216 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c3eb0e01-a339-444f-b52c-674ded973118 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:37.088964 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c3eb0e01-a339-444f-b52c-674ded973118 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:37.854247 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-41cf44f0-ac50-4ca7-a6a5-eb7baf99fc06 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8675d7d8bab840f3a221fdf2ee4c9b5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25214dec3ef24597be8e5acde61de3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:37.872547 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-41cf44f0-ac50-4ca7-a6a5-eb7baf99fc06 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] 10.222.0.20 "GET /compute/v2.1/servers/c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23" status: 200 len: 1391 microversion: 2.1 time: 1.009647 Oct 04 18:30:37.899371 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 317/657] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:36 2022] GET /compute/v2.1/servers/c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23 => generated 1391 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:37.929215 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ef6a91ab-80c0-4845-8646-343194c9a9da tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:37.929980 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ef6a91ab-80c0-4845-8646-343194c9a9da tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 89738dfe-3844-455a-93d1-d38702038946] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:37.952391 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ef6a91ab-80c0-4845-8646-343194c9a9da tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:37.956760 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ef6a91ab-80c0-4845-8646-343194c9a9da tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:37.957440 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ef6a91ab-80c0-4845-8646-343194c9a9da tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:37.958623 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ef6a91ab-80c0-4845-8646-343194c9a9da tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:37.963847 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ef6a91ab-80c0-4845-8646-343194c9a9da tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:37.964603 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ef6a91ab-80c0-4845-8646-343194c9a9da tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:38.406759 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=10 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:30:38.429582 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c3eb0e01-a339-444f-b52c-674ded973118 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:38.453312 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c3eb0e01-a339-444f-b52c-674ded973118 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:38.456892 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c3eb0e01-a339-444f-b52c-674ded973118 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:38.460702 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c3eb0e01-a339-444f-b52c-674ded973118 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/609c8bd3-a9fc-4b16-ba22-c87aa44a822d" status: 200 len: 1362 microversion: 2.25 time: 1.432429 Oct 04 18:30:38.463182 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 341/658] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:30:37 2022] GET /compute/v2.1/servers/609c8bd3-a9fc-4b16-ba22-c87aa44a822d => generated 1362 bytes in 1440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:30:38.474888 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e65c008e-3395-4dc2-8176-02710a493d04 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:38.475769 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e65c008e-3395-4dc2-8176-02710a493d04 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] [instance: c1bf585c-9cc9-4f87-966c-e02882aa51fd] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:38.878032 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ef6a91ab-80c0-4845-8646-343194c9a9da tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:38.895401 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ef6a91ab-80c0-4845-8646-343194c9a9da tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946" status: 200 len: 1310 microversion: 2.1 time: 0.989668 Oct 04 18:30:38.898815 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 318/659] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:37 2022] GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946 => generated 1310 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:38.927920 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-be2c0538-67a8-4011-9cef-823f78ad069a tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:38.929847 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e65c008e-3395-4dc2-8176-02710a493d04 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f49a275284a7eb714a55c6bdd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e44e7aa06ee4126b5705ba65145ebcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:38.941071 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-be2c0538-67a8-4011-9cef-823f78ad069a tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: 208ff352-ed98-4a12-8913-7e520822bf95] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:38.951739 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-be2c0538-67a8-4011-9cef-823f78ad069a tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:38.954828 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-be2c0538-67a8-4011-9cef-823f78ad069a tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:38.959594 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-be2c0538-67a8-4011-9cef-823f78ad069a tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:38.960895 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-be2c0538-67a8-4011-9cef-823f78ad069a tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:38.963119 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-be2c0538-67a8-4011-9cef-823f78ad069a tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:38.965647 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-be2c0538-67a8-4011-9cef-823f78ad069a tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:38.984278 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e65c008e-3395-4dc2-8176-02710a493d04 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] 10.222.0.20 "GET /compute/v2.1/servers/c1bf585c-9cc9-4f87-966c-e02882aa51fd" status: 200 len: 1225 microversion: 2.1 time: 0.500026 Oct 04 18:30:38.984278 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 342/660] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:38 2022] GET /compute/v2.1/servers/c1bf585c-9cc9-4f87-966c-e02882aa51fd => generated 1225 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:38.995128 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-46788703-5709-4f1e-b94a-e1e051d036fc tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:38.997499 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-46788703-5709-4f1e-b94a-e1e051d036fc tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] [instance: c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:39.023599 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-46788703-5709-4f1e-b94a-e1e051d036fc tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:39.027789 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-46788703-5709-4f1e-b94a-e1e051d036fc tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:39.027789 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-46788703-5709-4f1e-b94a-e1e051d036fc tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:39.027789 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-46788703-5709-4f1e-b94a-e1e051d036fc tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:39.027789 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-46788703-5709-4f1e-b94a-e1e051d036fc tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:39.028182 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-46788703-5709-4f1e-b94a-e1e051d036fc tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:39.429236 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-46788703-5709-4f1e-b94a-e1e051d036fc tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8675d7d8bab840f3a221fdf2ee4c9b5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25214dec3ef24597be8e5acde61de3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:39.445551 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-46788703-5709-4f1e-b94a-e1e051d036fc tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] 10.222.0.20 "GET /compute/v2.1/servers/c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23" status: 200 len: 1391 microversion: 2.1 time: 0.462289 Oct 04 18:30:39.466122 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 343/661] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:38 2022] GET /compute/v2.1/servers/c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23 => generated 1391 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:39.472774 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-be2c0538-67a8-4011-9cef-823f78ad069a tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:39.493702 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d825da25-51c8-4a09-a4ab-b3c874282749 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:39.494558 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d825da25-51c8-4a09-a4ab-b3c874282749 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: 609c8bd3-a9fc-4b16-ba22-c87aa44a822d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:39.497471 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-be2c0538-67a8-4011-9cef-823f78ad069a tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/208ff352-ed98-4a12-8913-7e520822bf95" status: 200 len: 1317 microversion: 2.1 time: 0.578350 Oct 04 18:30:39.499907 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 319/662] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:38 2022] GET /compute/v2.1/servers/208ff352-ed98-4a12-8913-7e520822bf95 => generated 1317 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:39.507676 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d825da25-51c8-4a09-a4ab-b3c874282749 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:39.508488 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d825da25-51c8-4a09-a4ab-b3c874282749 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:39.508920 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d825da25-51c8-4a09-a4ab-b3c874282749 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:39.512930 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d825da25-51c8-4a09-a4ab-b3c874282749 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:39.513618 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d825da25-51c8-4a09-a4ab-b3c874282749 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:39.514374 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d825da25-51c8-4a09-a4ab-b3c874282749 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:39.935762 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5aa362ed-fb61-444a-9854-4dd71c94e0d4 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:39.937451 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5aa362ed-fb61-444a-9854-4dd71c94e0d4 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 89738dfe-3844-455a-93d1-d38702038946] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:39.984913 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5aa362ed-fb61-444a-9854-4dd71c94e0d4 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:39.985932 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5aa362ed-fb61-444a-9854-4dd71c94e0d4 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:39.990682 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5aa362ed-fb61-444a-9854-4dd71c94e0d4 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:40.024037 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5aa362ed-fb61-444a-9854-4dd71c94e0d4 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:40.028686 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5aa362ed-fb61-444a-9854-4dd71c94e0d4 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.033s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:40.030455 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5aa362ed-fb61-444a-9854-4dd71c94e0d4 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:40.347235 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d825da25-51c8-4a09-a4ab-b3c874282749 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:40.360531 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d825da25-51c8-4a09-a4ab-b3c874282749 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:40.365533 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d825da25-51c8-4a09-a4ab-b3c874282749 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:40.384902 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d825da25-51c8-4a09-a4ab-b3c874282749 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/609c8bd3-a9fc-4b16-ba22-c87aa44a822d" status: 200 len: 1362 microversion: 2.25 time: 0.895498 Oct 04 18:30:40.402655 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 344/663] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:30:39 2022] GET /compute/v2.1/servers/609c8bd3-a9fc-4b16-ba22-c87aa44a822d => generated 1362 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:30:40.417758 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c37ae950-4d78-422c-b78a-03ab6ebc1dda tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:40.418318 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c37ae950-4d78-422c-b78a-03ab6ebc1dda tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] [instance: c1bf585c-9cc9-4f87-966c-e02882aa51fd] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:40.436746 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c37ae950-4d78-422c-b78a-03ab6ebc1dda tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:40.442278 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c37ae950-4d78-422c-b78a-03ab6ebc1dda tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:40.442278 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c37ae950-4d78-422c-b78a-03ab6ebc1dda tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:40.443930 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c37ae950-4d78-422c-b78a-03ab6ebc1dda tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:40.445160 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c37ae950-4d78-422c-b78a-03ab6ebc1dda tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:40.445748 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c37ae950-4d78-422c-b78a-03ab6ebc1dda tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:40.572169 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c37ae950-4d78-422c-b78a-03ab6ebc1dda tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f49a275284a7eb714a55c6bdd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e44e7aa06ee4126b5705ba65145ebcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:40.574662 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5aa362ed-fb61-444a-9854-4dd71c94e0d4 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:40.586418 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c37ae950-4d78-422c-b78a-03ab6ebc1dda tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] 10.222.0.20 "GET /compute/v2.1/servers/c1bf585c-9cc9-4f87-966c-e02882aa51fd" status: 200 len: 1277 microversion: 2.1 time: 0.182650 Oct 04 18:30:40.592231 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 345/664] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:40 2022] GET /compute/v2.1/servers/c1bf585c-9cc9-4f87-966c-e02882aa51fd => generated 1277 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:40.598691 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5aa362ed-fb61-444a-9854-4dd71c94e0d4 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946" status: 200 len: 1310 microversion: 2.1 time: 0.673517 Oct 04 18:30:40.603819 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 320/665] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:39 2022] GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946 => generated 1310 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:40.617603 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-2c1cad74-08d6-4d44-bf1c-af835666b180 req-3c1ed072-b58f-4d05-a849-69a8b5472c29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "609c8bd3-a9fc-4b16-ba22-c87aa44a822d", "tag": "5cd956ff-e097-4445-a4d4-66c2548f3dc6"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:40.674031 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-2c1cad74-08d6-4d44-bf1c-af835666b180 req-3c1ed072-b58f-4d05-a849-69a8b5472c29 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:40.674517 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-2c1cad74-08d6-4d44-bf1c-af835666b180 req-3c1ed072-b58f-4d05-a849-69a8b5472c29 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:40.674986 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-2c1cad74-08d6-4d44-bf1c-af835666b180 req-3c1ed072-b58f-4d05-a849-69a8b5472c29 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:40.712886 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-2c1cad74-08d6-4d44-bf1c-af835666b180 req-3c1ed072-b58f-4d05-a849-69a8b5472c29 service nova] Creating event network-changed:5cd956ff-e097-4445-a4d4-66c2548f3dc6 for instance 609c8bd3-a9fc-4b16-ba22-c87aa44a822d on n-h1-850501-14 Oct 04 18:30:40.719784 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-2c1cad74-08d6-4d44-bf1c-af835666b180 req-3c1ed072-b58f-4d05-a849-69a8b5472c29 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114675 Oct 04 18:30:40.721011 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 321/666] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:30:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:30:40.731822 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0c59e4ec-220d-463b-8e4c-baabef906057 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:40.734241 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0c59e4ec-220d-463b-8e4c-baabef906057 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] [instance: c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:40.760723 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0c59e4ec-220d-463b-8e4c-baabef906057 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:40.760723 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0c59e4ec-220d-463b-8e4c-baabef906057 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:40.760723 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0c59e4ec-220d-463b-8e4c-baabef906057 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:40.760723 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0c59e4ec-220d-463b-8e4c-baabef906057 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:40.764152 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0c59e4ec-220d-463b-8e4c-baabef906057 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:40.765128 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0c59e4ec-220d-463b-8e4c-baabef906057 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:40.921949 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-bfb7da76-caa4-4a0d-8100-e966b4e5bab5 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-862667775", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:40.987362 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.neutron [None req-bfb7da76-caa4-4a0d-8100-e966b4e5bab5 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] validate_networks() for None {{(pid=123001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:30:41.499797 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0c59e4ec-220d-463b-8e4c-baabef906057 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8675d7d8bab840f3a221fdf2ee4c9b5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25214dec3ef24597be8e5acde61de3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:41.526370 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0c59e4ec-220d-463b-8e4c-baabef906057 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] 10.222.0.20 "GET /compute/v2.1/servers/c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23" status: 200 len: 1590 microversion: 2.1 time: 0.801091 Oct 04 18:30:41.529825 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 322/667] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:40 2022] GET /compute/v2.1/servers/c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23 => generated 1590 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:41.548559 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ba730d3d-1755-41ba-82d9-21432c720993 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:41.551697 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ba730d3d-1755-41ba-82d9-21432c720993 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: 208ff352-ed98-4a12-8913-7e520822bf95] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:41.572771 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ba730d3d-1755-41ba-82d9-21432c720993 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:41.575244 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ba730d3d-1755-41ba-82d9-21432c720993 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:41.576454 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ba730d3d-1755-41ba-82d9-21432c720993 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:41.582594 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ba730d3d-1755-41ba-82d9-21432c720993 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:41.585597 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ba730d3d-1755-41ba-82d9-21432c720993 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:41.588742 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ba730d3d-1755-41ba-82d9-21432c720993 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:41.651514 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-bfb7da76-caa4-4a0d-8100-e966b4e5bab5 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:30:41.652609 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-bfb7da76-caa4-4a0d-8100-e966b4e5bab5 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:30:41.653506 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-bfb7da76-caa4-4a0d-8100-e966b4e5bab5 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:30:41.654078 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-bfb7da76-caa4-4a0d-8100-e966b4e5bab5 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:30:41.654488 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-bfb7da76-caa4-4a0d-8100-e966b4e5bab5 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:30:41.684661 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bfb7da76-caa4-4a0d-8100-e966b4e5bab5 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:41.685471 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bfb7da76-caa4-4a0d-8100-e966b4e5bab5 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:41.690087 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bfb7da76-caa4-4a0d-8100-e966b4e5bab5 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:41.696914 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bfb7da76-caa4-4a0d-8100-e966b4e5bab5 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:41.697589 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bfb7da76-caa4-4a0d-8100-e966b4e5bab5 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:41.699177 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bfb7da76-caa4-4a0d-8100-e966b4e5bab5 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:41.776332 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-bfb7da76-caa4-4a0d-8100-e966b4e5bab5 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Getting quotas for project 5a1cc290c58149f8988cc3d69aff9efd. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:30:41.784492 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-bfb7da76-caa4-4a0d-8100-e966b4e5bab5 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Getting quotas for user 1d326c048306423a87ddef70295a75e0 and project 5a1cc290c58149f8988cc3d69aff9efd. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:30:41.824464 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-bfb7da76-caa4-4a0d-8100-e966b4e5bab5 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Going to run 1 instances... {{(pid=123001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:30:41.827379 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-bfb7da76-caa4-4a0d-8100-e966b4e5bab5 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] [instance: 836f71c5-d859-4d09-9956-922b0bbee3ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:30:42.015236 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ba730d3d-1755-41ba-82d9-21432c720993 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:42.018721 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=100 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:30:42.036795 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ba730d3d-1755-41ba-82d9-21432c720993 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/208ff352-ed98-4a12-8913-7e520822bf95" status: 200 len: 1317 microversion: 2.1 time: 0.497196 Oct 04 18:30:42.037691 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 323/668] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:41 2022] GET /compute/v2.1/servers/208ff352-ed98-4a12-8913-7e520822bf95 => generated 1317 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:42.062727 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-912470ac-c1fa-49ed-941c-c47fa91bab64 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:42.064826 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-912470ac-c1fa-49ed-941c-c47fa91bab64 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: 609c8bd3-a9fc-4b16-ba22-c87aa44a822d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:42.084336 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-912470ac-c1fa-49ed-941c-c47fa91bab64 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:42.095757 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-912470ac-c1fa-49ed-941c-c47fa91bab64 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:42.095757 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-912470ac-c1fa-49ed-941c-c47fa91bab64 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:42.095757 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-912470ac-c1fa-49ed-941c-c47fa91bab64 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:42.095757 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-912470ac-c1fa-49ed-941c-c47fa91bab64 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:42.096175 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-912470ac-c1fa-49ed-941c-c47fa91bab64 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:42.163988 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-bfb7da76-caa4-4a0d-8100-e966b4e5bab5 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.560526 Oct 04 18:30:42.174160 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 346/669] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:30:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1580 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:30:42.193795 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b680c226-553a-476a-9f6d-a0645d770a37 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:42.194843 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b680c226-553a-476a-9f6d-a0645d770a37 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] [instance: c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:42.258642 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b680c226-553a-476a-9f6d-a0645d770a37 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:42.275976 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b680c226-553a-476a-9f6d-a0645d770a37 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:42.278861 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b680c226-553a-476a-9f6d-a0645d770a37 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:42.280403 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b680c226-553a-476a-9f6d-a0645d770a37 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:42.281128 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b680c226-553a-476a-9f6d-a0645d770a37 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:42.283881 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b680c226-553a-476a-9f6d-a0645d770a37 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:42.299893 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=100 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:30:42.720772 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b680c226-553a-476a-9f6d-a0645d770a37 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] 10.222.0.20 "GET /compute/v2.1/servers/c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.545109 Oct 04 18:30:42.740102 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 347/670] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Oct 4 18:30:42 2022] GET /compute/v2.1/servers/c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23/os-interface => generated 285 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:30:42.740102 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f5e18ad7-8b56-476f-b2df-47b796f08e7b tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:42.740102 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f5e18ad7-8b56-476f-b2df-47b796f08e7b tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] [instance: c1bf585c-9cc9-4f87-966c-e02882aa51fd] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:42.767346 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f5e18ad7-8b56-476f-b2df-47b796f08e7b tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:42.769615 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f5e18ad7-8b56-476f-b2df-47b796f08e7b tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:42.771983 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f5e18ad7-8b56-476f-b2df-47b796f08e7b tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:42.776767 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f5e18ad7-8b56-476f-b2df-47b796f08e7b tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:42.779216 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f5e18ad7-8b56-476f-b2df-47b796f08e7b tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:42.781271 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f5e18ad7-8b56-476f-b2df-47b796f08e7b tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:42.792663 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-912470ac-c1fa-49ed-941c-c47fa91bab64 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:42.810725 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-912470ac-c1fa-49ed-941c-c47fa91bab64 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:42.813043 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-912470ac-c1fa-49ed-941c-c47fa91bab64 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:42.815819 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-912470ac-c1fa-49ed-941c-c47fa91bab64 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/609c8bd3-a9fc-4b16-ba22-c87aa44a822d" status: 200 len: 1362 microversion: 2.25 time: 0.767342 Oct 04 18:30:42.833885 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 324/671] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:30:42 2022] GET /compute/v2.1/servers/609c8bd3-a9fc-4b16-ba22-c87aa44a822d => generated 1362 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:30:42.854046 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-cacd3182-dd3e-471d-97a7-0c22b1121a5d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:42.855054 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-cacd3182-dd3e-471d-97a7-0c22b1121a5d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 89738dfe-3844-455a-93d1-d38702038946] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:42.870830 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cacd3182-dd3e-471d-97a7-0c22b1121a5d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:42.871541 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cacd3182-dd3e-471d-97a7-0c22b1121a5d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:42.872276 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cacd3182-dd3e-471d-97a7-0c22b1121a5d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:42.875064 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cacd3182-dd3e-471d-97a7-0c22b1121a5d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:42.875725 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cacd3182-dd3e-471d-97a7-0c22b1121a5d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:42.876409 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cacd3182-dd3e-471d-97a7-0c22b1121a5d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:43.342732 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f5e18ad7-8b56-476f-b2df-47b796f08e7b tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f49a275284a7eb714a55c6bdd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e44e7aa06ee4126b5705ba65145ebcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:43.354896 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f5e18ad7-8b56-476f-b2df-47b796f08e7b tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] 10.222.0.20 "GET /compute/v2.1/servers/c1bf585c-9cc9-4f87-966c-e02882aa51fd" status: 200 len: 1283 microversion: 2.1 time: 0.620742 Oct 04 18:30:43.365943 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 348/672] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:42 2022] GET /compute/v2.1/servers/c1bf585c-9cc9-4f87-966c-e02882aa51fd => generated 1283 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:43.380872 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ddfbb91b-562b-4fea-8aa4-546ba9045ad7 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:43.382126 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ddfbb91b-562b-4fea-8aa4-546ba9045ad7 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] [instance: 836f71c5-d859-4d09-9956-922b0bbee3ae] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:43.602752 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ddfbb91b-562b-4fea-8aa4-546ba9045ad7 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d326c048306423a87ddef70295a75e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1cc290c58149f8988cc3d69aff9efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:43.615755 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ddfbb91b-562b-4fea-8aa4-546ba9045ad7 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] 10.222.0.20 "GET /compute/v2.1/servers/836f71c5-d859-4d09-9956-922b0bbee3ae" status: 200 len: 1216 microversion: 2.1 time: 0.250118 Oct 04 18:30:43.617400 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 349/673] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:43 2022] GET /compute/v2.1/servers/836f71c5-d859-4d09-9956-922b0bbee3ae => generated 1216 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:43.626467 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-88922392-373e-4e91-888a-bfbdd2194b13 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:43.642555 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-88922392-373e-4e91-888a-bfbdd2194b13 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: 208ff352-ed98-4a12-8913-7e520822bf95] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:43.653291 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-88922392-373e-4e91-888a-bfbdd2194b13 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:43.654983 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-88922392-373e-4e91-888a-bfbdd2194b13 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:43.655688 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-88922392-373e-4e91-888a-bfbdd2194b13 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:43.656624 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-88922392-373e-4e91-888a-bfbdd2194b13 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:43.657589 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-88922392-373e-4e91-888a-bfbdd2194b13 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:43.658174 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-88922392-373e-4e91-888a-bfbdd2194b13 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:43.763656 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-cacd3182-dd3e-471d-97a7-0c22b1121a5d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:43.774261 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-cacd3182-dd3e-471d-97a7-0c22b1121a5d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946" status: 200 len: 1310 microversion: 2.1 time: 0.938882 Oct 04 18:30:43.789684 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 325/674] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:42 2022] GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946 => generated 1310 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:43.799920 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-9d1211fd-6b3e-4557-b92e-c7b31c510ce0 req-b17e6d91-5f8f-48dc-a966-cd15c6a27c7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "208ff352-ed98-4a12-8913-7e520822bf95", "tag": "63a4b4fb-c5d8-4a51-9f44-49460db78384"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:43.814963 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-9d1211fd-6b3e-4557-b92e-c7b31c510ce0 req-b17e6d91-5f8f-48dc-a966-cd15c6a27c7e service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:43.815866 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-9d1211fd-6b3e-4557-b92e-c7b31c510ce0 req-b17e6d91-5f8f-48dc-a966-cd15c6a27c7e service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:43.816752 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-9d1211fd-6b3e-4557-b92e-c7b31c510ce0 req-b17e6d91-5f8f-48dc-a966-cd15c6a27c7e service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:43.834500 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-9d1211fd-6b3e-4557-b92e-c7b31c510ce0 req-b17e6d91-5f8f-48dc-a966-cd15c6a27c7e service nova] Creating event network-changed:63a4b4fb-c5d8-4a51-9f44-49460db78384 for instance 208ff352-ed98-4a12-8913-7e520822bf95 on n-h2-850501-14 Oct 04 18:30:43.844473 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-9d1211fd-6b3e-4557-b92e-c7b31c510ce0 req-b17e6d91-5f8f-48dc-a966-cd15c6a27c7e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049744 Oct 04 18:30:43.845716 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 326/675] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:30:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:30:43.856991 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f70796c6-30cd-4dc1-845a-2591f2aed95a tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:43.858025 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f70796c6-30cd-4dc1-845a-2591f2aed95a tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: 609c8bd3-a9fc-4b16-ba22-c87aa44a822d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:43.885120 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f70796c6-30cd-4dc1-845a-2591f2aed95a tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:43.885120 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f70796c6-30cd-4dc1-845a-2591f2aed95a tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:43.885120 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f70796c6-30cd-4dc1-845a-2591f2aed95a tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:43.885120 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f70796c6-30cd-4dc1-845a-2591f2aed95a tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:43.885604 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f70796c6-30cd-4dc1-845a-2591f2aed95a tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:43.885604 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f70796c6-30cd-4dc1-845a-2591f2aed95a tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:44.207023 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-88922392-373e-4e91-888a-bfbdd2194b13 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:44.224642 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-88922392-373e-4e91-888a-bfbdd2194b13 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/208ff352-ed98-4a12-8913-7e520822bf95" status: 200 len: 1317 microversion: 2.1 time: 0.605898 Oct 04 18:30:44.243304 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 350/676] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:43 2022] GET /compute/v2.1/servers/208ff352-ed98-4a12-8913-7e520822bf95 => generated 1317 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:44.324942 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f70796c6-30cd-4dc1-845a-2591f2aed95a tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:44.335903 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f70796c6-30cd-4dc1-845a-2591f2aed95a tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:44.337305 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f70796c6-30cd-4dc1-845a-2591f2aed95a tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:44.338509 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f70796c6-30cd-4dc1-845a-2591f2aed95a tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/609c8bd3-a9fc-4b16-ba22-c87aa44a822d" status: 200 len: 1362 microversion: 2.25 time: 0.491432 Oct 04 18:30:44.346196 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 327/677] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:30:43 2022] GET /compute/v2.1/servers/609c8bd3-a9fc-4b16-ba22-c87aa44a822d => generated 1362 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:30:44.378734 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7f1a122c-afbf-4a67-a45d-16254c746430 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:44.379726 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7f1a122c-afbf-4a67-a45d-16254c746430 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] [instance: c1bf585c-9cc9-4f87-966c-e02882aa51fd] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:44.386897 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7f1a122c-afbf-4a67-a45d-16254c746430 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:44.387395 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7f1a122c-afbf-4a67-a45d-16254c746430 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:44.387835 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7f1a122c-afbf-4a67-a45d-16254c746430 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:44.388640 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7f1a122c-afbf-4a67-a45d-16254c746430 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:44.389098 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7f1a122c-afbf-4a67-a45d-16254c746430 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:44.389570 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7f1a122c-afbf-4a67-a45d-16254c746430 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:44.476445 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7f1a122c-afbf-4a67-a45d-16254c746430 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f49a275284a7eb714a55c6bdd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e44e7aa06ee4126b5705ba65145ebcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:44.489106 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7f1a122c-afbf-4a67-a45d-16254c746430 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] 10.222.0.20 "GET /compute/v2.1/servers/c1bf585c-9cc9-4f87-966c-e02882aa51fd" status: 200 len: 1283 microversion: 2.1 time: 0.110372 Oct 04 18:30:44.492349 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 351/678] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:44 2022] GET /compute/v2.1/servers/c1bf585c-9cc9-4f87-966c-e02882aa51fd => generated 1283 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:44.651379 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d4732136-e052-4325-b1b1-5b932b768075 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:44.651910 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d4732136-e052-4325-b1b1-5b932b768075 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] [instance: 836f71c5-d859-4d09-9956-922b0bbee3ae] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:44.668691 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d4732136-e052-4325-b1b1-5b932b768075 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:44.672667 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d4732136-e052-4325-b1b1-5b932b768075 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:44.673474 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d4732136-e052-4325-b1b1-5b932b768075 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:44.684277 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d4732136-e052-4325-b1b1-5b932b768075 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:44.684943 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d4732136-e052-4325-b1b1-5b932b768075 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:44.686190 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d4732136-e052-4325-b1b1-5b932b768075 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:44.807478 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5df56806-40d2-4786-bfdd-1f8342c043d2 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:44.808405 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5df56806-40d2-4786-bfdd-1f8342c043d2 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 89738dfe-3844-455a-93d1-d38702038946] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:44.818188 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5df56806-40d2-4786-bfdd-1f8342c043d2 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:44.818739 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5df56806-40d2-4786-bfdd-1f8342c043d2 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:44.819700 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5df56806-40d2-4786-bfdd-1f8342c043d2 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:44.832632 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5df56806-40d2-4786-bfdd-1f8342c043d2 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:44.833423 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5df56806-40d2-4786-bfdd-1f8342c043d2 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:44.834024 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5df56806-40d2-4786-bfdd-1f8342c043d2 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:45.449061 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d4732136-e052-4325-b1b1-5b932b768075 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d326c048306423a87ddef70295a75e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1cc290c58149f8988cc3d69aff9efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:45.482098 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d4732136-e052-4325-b1b1-5b932b768075 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] 10.222.0.20 "GET /compute/v2.1/servers/836f71c5-d859-4d09-9956-922b0bbee3ae" status: 200 len: 1220 microversion: 2.1 time: 0.836764 Oct 04 18:30:45.506937 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 328/679] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:44 2022] GET /compute/v2.1/servers/836f71c5-d859-4d09-9956-922b0bbee3ae => generated 1220 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:45.513363 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-df3f9850-2ee4-44df-80a0-0a088449d7fc tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:45.514288 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-df3f9850-2ee4-44df-80a0-0a088449d7fc tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: 208ff352-ed98-4a12-8913-7e520822bf95] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:45.521233 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-df3f9850-2ee4-44df-80a0-0a088449d7fc tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:45.522211 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-df3f9850-2ee4-44df-80a0-0a088449d7fc tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:45.522854 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-df3f9850-2ee4-44df-80a0-0a088449d7fc tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:45.523736 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-df3f9850-2ee4-44df-80a0-0a088449d7fc tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:45.524386 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-df3f9850-2ee4-44df-80a0-0a088449d7fc tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:45.525187 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-df3f9850-2ee4-44df-80a0-0a088449d7fc tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:45.819672 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-df3f9850-2ee4-44df-80a0-0a088449d7fc tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:45.831222 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-df3f9850-2ee4-44df-80a0-0a088449d7fc tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/208ff352-ed98-4a12-8913-7e520822bf95" status: 200 len: 1317 microversion: 2.1 time: 0.322867 Oct 04 18:30:45.835466 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 329/680] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:45 2022] GET /compute/v2.1/servers/208ff352-ed98-4a12-8913-7e520822bf95 => generated 1317 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:45.851155 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-acdd0934-d50e-47f3-8f3a-c898f7f0cbb6 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:45.852789 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-acdd0934-d50e-47f3-8f3a-c898f7f0cbb6 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: 609c8bd3-a9fc-4b16-ba22-c87aa44a822d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:45.861966 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-acdd0934-d50e-47f3-8f3a-c898f7f0cbb6 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:45.864619 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5df56806-40d2-4786-bfdd-1f8342c043d2 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:45.866556 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-acdd0934-d50e-47f3-8f3a-c898f7f0cbb6 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:45.867124 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-acdd0934-d50e-47f3-8f3a-c898f7f0cbb6 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:45.867869 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-acdd0934-d50e-47f3-8f3a-c898f7f0cbb6 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:45.869021 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-acdd0934-d50e-47f3-8f3a-c898f7f0cbb6 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:45.869902 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-acdd0934-d50e-47f3-8f3a-c898f7f0cbb6 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:45.884764 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5df56806-40d2-4786-bfdd-1f8342c043d2 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946" status: 200 len: 1310 microversion: 2.1 time: 1.086049 Oct 04 18:30:45.888453 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 352/681] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:44 2022] GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946 => generated 1310 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:45.895492 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9df3bc5f-2ce5-46a5-bb65-2780b8ac078d tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:45.899747 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-9df3bc5f-2ce5-46a5-bb65-2780b8ac078d tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] [instance: c1bf585c-9cc9-4f87-966c-e02882aa51fd] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:45.928258 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9df3bc5f-2ce5-46a5-bb65-2780b8ac078d tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:45.930372 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9df3bc5f-2ce5-46a5-bb65-2780b8ac078d tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:45.933598 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9df3bc5f-2ce5-46a5-bb65-2780b8ac078d tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:45.937490 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9df3bc5f-2ce5-46a5-bb65-2780b8ac078d tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:45.938300 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9df3bc5f-2ce5-46a5-bb65-2780b8ac078d tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:45.940681 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9df3bc5f-2ce5-46a5-bb65-2780b8ac078d tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:46.395394 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-acdd0934-d50e-47f3-8f3a-c898f7f0cbb6 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:46.416111 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-acdd0934-d50e-47f3-8f3a-c898f7f0cbb6 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:46.419958 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-acdd0934-d50e-47f3-8f3a-c898f7f0cbb6 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:46.426390 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-acdd0934-d50e-47f3-8f3a-c898f7f0cbb6 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/609c8bd3-a9fc-4b16-ba22-c87aa44a822d" status: 200 len: 1362 microversion: 2.25 time: 0.584141 Oct 04 18:30:46.444738 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 330/682] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:30:45 2022] GET /compute/v2.1/servers/609c8bd3-a9fc-4b16-ba22-c87aa44a822d => generated 1362 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:30:46.444738 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-9bec6054-7034-4412-9efe-2fe99a913a34 req-3a186997-e0c9-4f8b-b800-2b61dd866360 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89738dfe-3844-455a-93d1-d38702038946", "tag": "77050755-1aa5-4d6d-8323-2fb66ab475c5"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:46.449221 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-9bec6054-7034-4412-9efe-2fe99a913a34 req-3a186997-e0c9-4f8b-b800-2b61dd866360 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:46.450497 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-9bec6054-7034-4412-9efe-2fe99a913a34 req-3a186997-e0c9-4f8b-b800-2b61dd866360 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:46.451296 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-9bec6054-7034-4412-9efe-2fe99a913a34 req-3a186997-e0c9-4f8b-b800-2b61dd866360 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:46.465375 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-9bec6054-7034-4412-9efe-2fe99a913a34 req-3a186997-e0c9-4f8b-b800-2b61dd866360 service nova] Creating event network-changed:77050755-1aa5-4d6d-8323-2fb66ab475c5 for instance 89738dfe-3844-455a-93d1-d38702038946 on n-h1-850501-14 Oct 04 18:30:46.488000 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-9bec6054-7034-4412-9efe-2fe99a913a34 req-3a186997-e0c9-4f8b-b800-2b61dd866360 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059437 Oct 04 18:30:46.491367 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9df3bc5f-2ce5-46a5-bb65-2780b8ac078d tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f49a275284a7eb714a55c6bdd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e44e7aa06ee4126b5705ba65145ebcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:46.495346 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 331/683] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:30:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:30:46.509835 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9df3bc5f-2ce5-46a5-bb65-2780b8ac078d tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] 10.222.0.20 "GET /compute/v2.1/servers/c1bf585c-9cc9-4f87-966c-e02882aa51fd" status: 200 len: 1325 microversion: 2.1 time: 0.620038 Oct 04 18:30:46.510601 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 353/684] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:45 2022] GET /compute/v2.1/servers/c1bf585c-9cc9-4f87-966c-e02882aa51fd => generated 1325 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:46.530015 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d5a220b6-b592-430d-a87f-6d0e39c0cf43 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:46.531599 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d5a220b6-b592-430d-a87f-6d0e39c0cf43 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] [instance: 836f71c5-d859-4d09-9956-922b0bbee3ae] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:46.548066 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d5a220b6-b592-430d-a87f-6d0e39c0cf43 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:46.548575 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d5a220b6-b592-430d-a87f-6d0e39c0cf43 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:46.549015 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d5a220b6-b592-430d-a87f-6d0e39c0cf43 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:46.549732 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d5a220b6-b592-430d-a87f-6d0e39c0cf43 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:46.550191 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d5a220b6-b592-430d-a87f-6d0e39c0cf43 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:46.550614 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d5a220b6-b592-430d-a87f-6d0e39c0cf43 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:46.684553 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d5a220b6-b592-430d-a87f-6d0e39c0cf43 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d326c048306423a87ddef70295a75e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1cc290c58149f8988cc3d69aff9efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:46.694516 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d5a220b6-b592-430d-a87f-6d0e39c0cf43 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] 10.222.0.20 "GET /compute/v2.1/servers/836f71c5-d859-4d09-9956-922b0bbee3ae" status: 200 len: 1276 microversion: 2.1 time: 0.184037 Oct 04 18:30:46.696277 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 332/685] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:46 2022] GET /compute/v2.1/servers/836f71c5-d859-4d09-9956-922b0bbee3ae => generated 1276 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:46.860309 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-18ffd901-71ae-4d09-8191-1cf588ac8b23 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:46.861196 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-18ffd901-71ae-4d09-8191-1cf588ac8b23 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: 208ff352-ed98-4a12-8913-7e520822bf95] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:46.873837 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-18ffd901-71ae-4d09-8191-1cf588ac8b23 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:46.875077 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-18ffd901-71ae-4d09-8191-1cf588ac8b23 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:46.875897 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-18ffd901-71ae-4d09-8191-1cf588ac8b23 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:46.876894 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-18ffd901-71ae-4d09-8191-1cf588ac8b23 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:46.878020 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-18ffd901-71ae-4d09-8191-1cf588ac8b23 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:46.879471 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-18ffd901-71ae-4d09-8191-1cf588ac8b23 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:46.913974 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2be56874-1c58-4eba-90a6-c614956f3eaa tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:46.914757 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2be56874-1c58-4eba-90a6-c614956f3eaa tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 89738dfe-3844-455a-93d1-d38702038946] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:46.930808 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2be56874-1c58-4eba-90a6-c614956f3eaa tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:46.931322 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2be56874-1c58-4eba-90a6-c614956f3eaa tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:46.956710 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2be56874-1c58-4eba-90a6-c614956f3eaa tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:46.957437 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2be56874-1c58-4eba-90a6-c614956f3eaa tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:46.957920 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2be56874-1c58-4eba-90a6-c614956f3eaa tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:46.966712 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2be56874-1c58-4eba-90a6-c614956f3eaa tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:47.529483 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2be56874-1c58-4eba-90a6-c614956f3eaa tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:47.536622 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-18ffd901-71ae-4d09-8191-1cf588ac8b23 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:47.541153 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2be56874-1c58-4eba-90a6-c614956f3eaa tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946" status: 200 len: 1310 microversion: 2.1 time: 0.631253 Oct 04 18:30:47.541747 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 333/686] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:46 2022] GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946 => generated 1310 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:30:47.551699 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-18ffd901-71ae-4d09-8191-1cf588ac8b23 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/208ff352-ed98-4a12-8913-7e520822bf95" status: 200 len: 1317 microversion: 2.1 time: 0.690142 Oct 04 18:30:47.562648 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 354/687] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:46 2022] GET /compute/v2.1/servers/208ff352-ed98-4a12-8913-7e520822bf95 => generated 1317 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:47.565795 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5f55d65a-905a-4d61-984a-f72fb0a6d760 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:47.566643 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5f55d65a-905a-4d61-984a-f72fb0a6d760 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] [instance: c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:47.574961 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5f55d65a-905a-4d61-984a-f72fb0a6d760 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:47.576147 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5f55d65a-905a-4d61-984a-f72fb0a6d760 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:47.576812 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5f55d65a-905a-4d61-984a-f72fb0a6d760 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:47.577818 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5f55d65a-905a-4d61-984a-f72fb0a6d760 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:47.578477 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5f55d65a-905a-4d61-984a-f72fb0a6d760 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:47.579110 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5f55d65a-905a-4d61-984a-f72fb0a6d760 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:47.579383 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f6ccc115-f003-4322-b0ca-ac739be63079 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-107203950", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "07cc8600-5df5-410d-8d5a-1b508cd48e83"}], "security_groups": [{"name": "tempest-securitygroup--1200674616"}], "key_name": "tempest-keypair-2076227649", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "a63753ee-b741-4348-ad76-9ab68078d97d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:48.083085 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.neutron [None req-f6ccc115-f003-4322-b0ca-ac739be63079 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] validate_networks() for [('07cc8600-5df5-410d-8d5a-1b508cd48e83', None, None, None, None, None)] {{(pid=123001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:30:48.171925 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5f55d65a-905a-4d61-984a-f72fb0a6d760 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8675d7d8bab840f3a221fdf2ee4c9b5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25214dec3ef24597be8e5acde61de3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:48.197503 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5f55d65a-905a-4d61-984a-f72fb0a6d760 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] 10.222.0.20 "GET /compute/v2.1/servers/c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23" status: 200 len: 1590 microversion: 2.1 time: 0.644053 Oct 04 18:30:48.204122 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 334/688] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:47 2022] GET /compute/v2.1/servers/c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23 => generated 1590 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:48.213995 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-1f047129-703d-48ee-a774-db0c7f940873 req-9589c867-8103-47f1-9951-c5998a4b17d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23", "tag": "2be6226f-41ea-4517-a7af-b60f36e97405"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:48.233672 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-1f047129-703d-48ee-a774-db0c7f940873 req-9589c867-8103-47f1-9951-c5998a4b17d7 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:48.234699 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-1f047129-703d-48ee-a774-db0c7f940873 req-9589c867-8103-47f1-9951-c5998a4b17d7 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:48.235372 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-1f047129-703d-48ee-a774-db0c7f940873 req-9589c867-8103-47f1-9951-c5998a4b17d7 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:48.259696 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-1f047129-703d-48ee-a774-db0c7f940873 req-9589c867-8103-47f1-9951-c5998a4b17d7 service nova] Creating event network-changed:2be6226f-41ea-4517-a7af-b60f36e97405 for instance c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23 on n-h2-850501-14 Oct 04 18:30:48.265041 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-1f047129-703d-48ee-a774-db0c7f940873 req-9589c867-8103-47f1-9951-c5998a4b17d7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057964 Oct 04 18:30:48.266510 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 335/689] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:30:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:30:48.275530 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f06ee605-e58b-423e-a09a-941106677614 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:48.276475 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f06ee605-e58b-423e-a09a-941106677614 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: 609c8bd3-a9fc-4b16-ba22-c87aa44a822d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:48.283451 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f06ee605-e58b-423e-a09a-941106677614 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:48.283955 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f06ee605-e58b-423e-a09a-941106677614 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:48.285082 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f06ee605-e58b-423e-a09a-941106677614 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:48.285213 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f06ee605-e58b-423e-a09a-941106677614 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:48.285694 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f06ee605-e58b-423e-a09a-941106677614 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:48.286611 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f06ee605-e58b-423e-a09a-941106677614 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:48.758232 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f06ee605-e58b-423e-a09a-941106677614 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:48.784347 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f06ee605-e58b-423e-a09a-941106677614 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:48.790403 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f06ee605-e58b-423e-a09a-941106677614 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:48.791561 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f06ee605-e58b-423e-a09a-941106677614 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/609c8bd3-a9fc-4b16-ba22-c87aa44a822d" status: 200 len: 1362 microversion: 2.25 time: 0.523777 Oct 04 18:30:48.799929 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 336/690] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:30:48 2022] GET /compute/v2.1/servers/609c8bd3-a9fc-4b16-ba22-c87aa44a822d => generated 1362 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:30:48.823688 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4c856f30-eee4-4710-b336-2062d9ff94c8 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:48.825347 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4c856f30-eee4-4710-b336-2062d9ff94c8 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] [instance: c1bf585c-9cc9-4f87-966c-e02882aa51fd] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:48.832373 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4c856f30-eee4-4710-b336-2062d9ff94c8 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:48.833295 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4c856f30-eee4-4710-b336-2062d9ff94c8 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:48.833992 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4c856f30-eee4-4710-b336-2062d9ff94c8 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:48.836912 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4c856f30-eee4-4710-b336-2062d9ff94c8 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:48.838866 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4c856f30-eee4-4710-b336-2062d9ff94c8 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:48.841170 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4c856f30-eee4-4710-b336-2062d9ff94c8 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:49.362760 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4c856f30-eee4-4710-b336-2062d9ff94c8 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f49a275284a7eb714a55c6bdd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e44e7aa06ee4126b5705ba65145ebcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:49.382093 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4c856f30-eee4-4710-b336-2062d9ff94c8 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] 10.222.0.20 "GET /compute/v2.1/servers/c1bf585c-9cc9-4f87-966c-e02882aa51fd" status: 200 len: 1325 microversion: 2.1 time: 0.570667 Oct 04 18:30:49.383838 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 337/691] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:48 2022] GET /compute/v2.1/servers/c1bf585c-9cc9-4f87-966c-e02882aa51fd => generated 1325 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:49.391561 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b23e3521-b65a-4117-b28a-748e3f562a1b tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:49.392217 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b23e3521-b65a-4117-b28a-748e3f562a1b tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] [instance: 836f71c5-d859-4d09-9956-922b0bbee3ae] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:49.399681 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b23e3521-b65a-4117-b28a-748e3f562a1b tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:49.402049 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b23e3521-b65a-4117-b28a-748e3f562a1b tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:49.402049 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b23e3521-b65a-4117-b28a-748e3f562a1b tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:49.402440 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b23e3521-b65a-4117-b28a-748e3f562a1b tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:49.404117 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b23e3521-b65a-4117-b28a-748e3f562a1b tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:49.404969 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b23e3521-b65a-4117-b28a-748e3f562a1b tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:49.815703 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-f6ccc115-f003-4322-b0ca-ac739be63079 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Getting quotas for project 9247c7ae3e4e4068a88a044e36945f32. Resources: dict_keys(['metadata_items']) {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:30:49.817501 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b23e3521-b65a-4117-b28a-748e3f562a1b tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d326c048306423a87ddef70295a75e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1cc290c58149f8988cc3d69aff9efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:49.827840 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b23e3521-b65a-4117-b28a-748e3f562a1b tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] 10.222.0.20 "GET /compute/v2.1/servers/836f71c5-d859-4d09-9956-922b0bbee3ae" status: 200 len: 1274 microversion: 2.1 time: 0.442710 Oct 04 18:30:49.828458 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 338/692] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:49 2022] GET /compute/v2.1/servers/836f71c5-d859-4d09-9956-922b0bbee3ae => generated 1274 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:49.833244 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-3f0eb1eb-41f2-4e77-b4df-ada39efeaf94 req-6ba45594-5867-4d17-be94-4d56f9996b82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1bf585c-9cc9-4f87-966c-e02882aa51fd", "tag": "a08a497b-a75d-46e8-bb72-da6d0464043b"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:49.840116 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-f6ccc115-f003-4322-b0ca-ac739be63079 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Getting quotas for user ad89f12d146749b38c688b7581e53f5b and project 9247c7ae3e4e4068a88a044e36945f32. Resources: dict_keys(['metadata_items']) {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:30:49.843760 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-3f0eb1eb-41f2-4e77-b4df-ada39efeaf94 req-6ba45594-5867-4d17-be94-4d56f9996b82 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:49.844473 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-3f0eb1eb-41f2-4e77-b4df-ada39efeaf94 req-6ba45594-5867-4d17-be94-4d56f9996b82 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:49.845058 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-3f0eb1eb-41f2-4e77-b4df-ada39efeaf94 req-6ba45594-5867-4d17-be94-4d56f9996b82 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:49.848739 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:30:49.858836 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-3f0eb1eb-41f2-4e77-b4df-ada39efeaf94 req-6ba45594-5867-4d17-be94-4d56f9996b82 service nova] Creating event network-changed:a08a497b-a75d-46e8-bb72-da6d0464043b for instance c1bf585c-9cc9-4f87-966c-e02882aa51fd on n-h1-850501-14 Oct 04 18:30:49.859953 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-f6ccc115-f003-4322-b0ca-ac739be63079 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:30:49.861029 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-f6ccc115-f003-4322-b0ca-ac739be63079 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:30:49.861676 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-f6ccc115-f003-4322-b0ca-ac739be63079 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:30:49.862223 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-f6ccc115-f003-4322-b0ca-ac739be63079 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:30:49.863349 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-f6ccc115-f003-4322-b0ca-ac739be63079 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:30:49.864501 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-3f0eb1eb-41f2-4e77-b4df-ada39efeaf94 req-6ba45594-5867-4d17-be94-4d56f9996b82 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034631 Oct 04 18:30:49.865410 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 339/693] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:30:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:30:49.872278 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-487ad23f-0697-4938-b2e5-26cbded1038e tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:49.875165 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-487ad23f-0697-4938-b2e5-26cbded1038e tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 89738dfe-3844-455a-93d1-d38702038946] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:49.875323 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f6ccc115-f003-4322-b0ca-ac739be63079 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:49.875323 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f6ccc115-f003-4322-b0ca-ac739be63079 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:49.875780 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f6ccc115-f003-4322-b0ca-ac739be63079 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:49.876725 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f6ccc115-f003-4322-b0ca-ac739be63079 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:49.877177 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f6ccc115-f003-4322-b0ca-ac739be63079 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:49.877853 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f6ccc115-f003-4322-b0ca-ac739be63079 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:49.879874 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-487ad23f-0697-4938-b2e5-26cbded1038e tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:49.880467 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-487ad23f-0697-4938-b2e5-26cbded1038e tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:49.880974 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-487ad23f-0697-4938-b2e5-26cbded1038e tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:49.883307 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-487ad23f-0697-4938-b2e5-26cbded1038e tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:49.883878 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-487ad23f-0697-4938-b2e5-26cbded1038e tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:49.884411 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-487ad23f-0697-4938-b2e5-26cbded1038e tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:49.890512 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=11 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:30:49.906078 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-f6ccc115-f003-4322-b0ca-ac739be63079 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Getting quotas for project 9247c7ae3e4e4068a88a044e36945f32. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:30:49.912033 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-f6ccc115-f003-4322-b0ca-ac739be63079 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Getting quotas for user ad89f12d146749b38c688b7581e53f5b and project 9247c7ae3e4e4068a88a044e36945f32. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:30:50.019845 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f6ccc115-f003-4322-b0ca-ac739be63079 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Going to run 1 instances... {{(pid=123001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:30:50.026672 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f6ccc115-f003-4322-b0ca-ac739be63079 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] [instance: 5e154d65-5086-47c1-bba7-ea3dfd53f6e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a63753ee-b741-4348-ad76-9ab68078d97d',volume_size=None,volume_type=None)] {{(pid=123001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:30:50.060202 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-487ad23f-0697-4938-b2e5-26cbded1038e tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:50.079991 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-487ad23f-0697-4938-b2e5-26cbded1038e tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946" status: 200 len: 1310 microversion: 2.1 time: 0.211992 Oct 04 18:30:50.101021 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 340/694] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:49 2022] GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946 => generated 1310 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:50.114238 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-405d99ab-dfb5-480a-8af5-2bc6b4abfe27 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:50.115126 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-405d99ab-dfb5-480a-8af5-2bc6b4abfe27 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: 208ff352-ed98-4a12-8913-7e520822bf95] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:50.122718 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-405d99ab-dfb5-480a-8af5-2bc6b4abfe27 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:50.123350 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-405d99ab-dfb5-480a-8af5-2bc6b4abfe27 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:50.123892 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-405d99ab-dfb5-480a-8af5-2bc6b4abfe27 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:50.124767 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-405d99ab-dfb5-480a-8af5-2bc6b4abfe27 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:50.125325 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-405d99ab-dfb5-480a-8af5-2bc6b4abfe27 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:50.125852 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-405d99ab-dfb5-480a-8af5-2bc6b4abfe27 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:50.360530 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-405d99ab-dfb5-480a-8af5-2bc6b4abfe27 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:50.377868 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-405d99ab-dfb5-480a-8af5-2bc6b4abfe27 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/208ff352-ed98-4a12-8913-7e520822bf95" status: 200 len: 1317 microversion: 2.1 time: 0.274867 Oct 04 18:30:50.378453 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 341/695] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:50 2022] GET /compute/v2.1/servers/208ff352-ed98-4a12-8913-7e520822bf95 => generated 1317 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:50.391427 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-fb1f0848-0b0f-4bc8-be3d-43e171ede09c req-137655b1-15e7-4373-8715-b1ab9e645362 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "609c8bd3-a9fc-4b16-ba22-c87aa44a822d", "name": "network-vif-plugged", "status": "completed", "tag": "5cd956ff-e097-4445-a4d4-66c2548f3dc6"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:50.414213 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-fb1f0848-0b0f-4bc8-be3d-43e171ede09c req-137655b1-15e7-4373-8715-b1ab9e645362 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:50.417450 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-fb1f0848-0b0f-4bc8-be3d-43e171ede09c req-137655b1-15e7-4373-8715-b1ab9e645362 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:50.417905 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-fb1f0848-0b0f-4bc8-be3d-43e171ede09c req-137655b1-15e7-4373-8715-b1ab9e645362 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:50.436455 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-fb1f0848-0b0f-4bc8-be3d-43e171ede09c req-137655b1-15e7-4373-8715-b1ab9e645362 service nova] Creating event network-vif-plugged:5cd956ff-e097-4445-a4d4-66c2548f3dc6 for instance 609c8bd3-a9fc-4b16-ba22-c87aa44a822d on n-h1-850501-14 Oct 04 18:30:50.444487 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-fb1f0848-0b0f-4bc8-be3d-43e171ede09c req-137655b1-15e7-4373-8715-b1ab9e645362 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059625 Oct 04 18:30:50.449258 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 342/696] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:30:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:30:50.450363 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0e46ee39-b015-4693-9c86-507e107fb5c1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:50.451225 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0e46ee39-b015-4693-9c86-507e107fb5c1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: 609c8bd3-a9fc-4b16-ba22-c87aa44a822d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:50.457955 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0e46ee39-b015-4693-9c86-507e107fb5c1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:50.458611 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0e46ee39-b015-4693-9c86-507e107fb5c1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:50.459275 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0e46ee39-b015-4693-9c86-507e107fb5c1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:50.461000 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0e46ee39-b015-4693-9c86-507e107fb5c1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:50.461592 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0e46ee39-b015-4693-9c86-507e107fb5c1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:50.462013 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0e46ee39-b015-4693-9c86-507e107fb5c1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:50.670063 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0e46ee39-b015-4693-9c86-507e107fb5c1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:50.672604 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=100 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:30:50.682434 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0e46ee39-b015-4693-9c86-507e107fb5c1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:50.684280 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0e46ee39-b015-4693-9c86-507e107fb5c1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:50.687122 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f6ccc115-f003-4322-b0ca-ac739be63079 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 3.123290 Oct 04 18:30:50.688087 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 355/697] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:30:47 2022] POST /compute/v2.1/servers => generated 407 bytes in 3125 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:30:50.695020 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ee572418-380e-46f3-ba5f-3254c7709f2e tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:50.703710 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0e46ee39-b015-4693-9c86-507e107fb5c1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/609c8bd3-a9fc-4b16-ba22-c87aa44a822d" status: 200 len: 1362 microversion: 2.25 time: 0.257229 Oct 04 18:30:50.707202 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 343/698] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:30:50 2022] GET /compute/v2.1/servers/609c8bd3-a9fc-4b16-ba22-c87aa44a822d => generated 1362 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:30:50.718936 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6738ac84-8116-4288-8c9c-c5c3cbdf1f51 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:50.720752 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-6738ac84-8116-4288-8c9c-c5c3cbdf1f51 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] [instance: 5e154d65-5086-47c1-bba7-ea3dfd53f6e6] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:50.744903 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ee572418-380e-46f3-ba5f-3254c7709f2e tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] [instance: c1bf585c-9cc9-4f87-966c-e02882aa51fd] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:50.765986 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ee572418-380e-46f3-ba5f-3254c7709f2e tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:50.768112 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ee572418-380e-46f3-ba5f-3254c7709f2e tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:50.769371 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ee572418-380e-46f3-ba5f-3254c7709f2e tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:50.772621 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ee572418-380e-46f3-ba5f-3254c7709f2e tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:50.775702 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ee572418-380e-46f3-ba5f-3254c7709f2e tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:50.776450 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ee572418-380e-46f3-ba5f-3254c7709f2e tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:50.819411 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-6738ac84-8116-4288-8c9c-c5c3cbdf1f51 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89f12d146749b38c688b7581e53f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247c7ae3e4e4068a88a044e36945f32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:50.835291 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6738ac84-8116-4288-8c9c-c5c3cbdf1f51 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] 10.222.0.20 "GET /compute/v2.1/servers/5e154d65-5086-47c1-bba7-ea3dfd53f6e6" status: 200 len: 1121 microversion: 2.1 time: 0.120331 Oct 04 18:30:50.845546 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 344/699] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:50 2022] GET /compute/v2.1/servers/5e154d65-5086-47c1-bba7-ea3dfd53f6e6 => generated 1121 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:50.853630 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8353dabe-28f1-4222-b703-3577c747056f tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:50.854643 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8353dabe-28f1-4222-b703-3577c747056f tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] [instance: 836f71c5-d859-4d09-9956-922b0bbee3ae] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:50.862023 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8353dabe-28f1-4222-b703-3577c747056f tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:50.864015 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8353dabe-28f1-4222-b703-3577c747056f tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:50.864015 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8353dabe-28f1-4222-b703-3577c747056f tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:50.864015 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8353dabe-28f1-4222-b703-3577c747056f tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:50.864329 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8353dabe-28f1-4222-b703-3577c747056f tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:50.864721 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8353dabe-28f1-4222-b703-3577c747056f tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:51.185239 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ee572418-380e-46f3-ba5f-3254c7709f2e tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f49a275284a7eb714a55c6bdd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e44e7aa06ee4126b5705ba65145ebcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:51.197249 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ee572418-380e-46f3-ba5f-3254c7709f2e tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] 10.222.0.20 "GET /compute/v2.1/servers/c1bf585c-9cc9-4f87-966c-e02882aa51fd" status: 200 len: 1325 microversion: 2.1 time: 0.504591 Oct 04 18:30:51.198339 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 356/700] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:50 2022] GET /compute/v2.1/servers/c1bf585c-9cc9-4f87-966c-e02882aa51fd => generated 1325 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:51.203750 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-fbf8a76d-b1a4-4374-b537-7cea0ec83c81 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:51.205033 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-fbf8a76d-b1a4-4374-b537-7cea0ec83c81 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 89738dfe-3844-455a-93d1-d38702038946] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:51.212356 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fbf8a76d-b1a4-4374-b537-7cea0ec83c81 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:51.212839 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fbf8a76d-b1a4-4374-b537-7cea0ec83c81 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:51.213267 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fbf8a76d-b1a4-4374-b537-7cea0ec83c81 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:51.214585 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fbf8a76d-b1a4-4374-b537-7cea0ec83c81 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:51.215034 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fbf8a76d-b1a4-4374-b537-7cea0ec83c81 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:51.216312 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fbf8a76d-b1a4-4374-b537-7cea0ec83c81 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:51.228924 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8353dabe-28f1-4222-b703-3577c747056f tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d326c048306423a87ddef70295a75e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1cc290c58149f8988cc3d69aff9efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:51.239747 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8353dabe-28f1-4222-b703-3577c747056f tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] 10.222.0.20 "GET /compute/v2.1/servers/836f71c5-d859-4d09-9956-922b0bbee3ae" status: 200 len: 1316 microversion: 2.1 time: 0.391069 Oct 04 18:30:51.240345 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 345/701] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:50 2022] GET /compute/v2.1/servers/836f71c5-d859-4d09-9956-922b0bbee3ae => generated 1316 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:51.378765 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-fbf8a76d-b1a4-4374-b537-7cea0ec83c81 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:51.394776 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-fbf8a76d-b1a4-4374-b537-7cea0ec83c81 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946" status: 200 len: 1310 microversion: 2.1 time: 0.195293 Oct 04 18:30:51.404132 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-580bab79-5128-422d-8e89-1e0cde976a4e tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:51.405050 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-580bab79-5128-422d-8e89-1e0cde976a4e tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: 208ff352-ed98-4a12-8913-7e520822bf95] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:51.410396 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 357/702] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:51 2022] GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946 => generated 1310 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:51.412368 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-580bab79-5128-422d-8e89-1e0cde976a4e tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:51.413590 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-580bab79-5128-422d-8e89-1e0cde976a4e tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:51.418538 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-580bab79-5128-422d-8e89-1e0cde976a4e tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:51.418538 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-580bab79-5128-422d-8e89-1e0cde976a4e tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:51.418538 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-580bab79-5128-422d-8e89-1e0cde976a4e tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:51.418538 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-580bab79-5128-422d-8e89-1e0cde976a4e tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:51.601243 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-580bab79-5128-422d-8e89-1e0cde976a4e tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:51.611840 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-580bab79-5128-422d-8e89-1e0cde976a4e tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/208ff352-ed98-4a12-8913-7e520822bf95" status: 200 len: 1317 microversion: 2.1 time: 0.213778 Oct 04 18:30:51.612497 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 346/703] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:51 2022] GET /compute/v2.1/servers/208ff352-ed98-4a12-8913-7e520822bf95 => generated 1317 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:51.734979 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9deab902-6fcc-4244-8b6a-9dbad3d1dbbb tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:51.735586 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-9deab902-6fcc-4244-8b6a-9dbad3d1dbbb tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: 609c8bd3-a9fc-4b16-ba22-c87aa44a822d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:51.743101 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9deab902-6fcc-4244-8b6a-9dbad3d1dbbb tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:51.743595 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9deab902-6fcc-4244-8b6a-9dbad3d1dbbb tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:51.744031 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9deab902-6fcc-4244-8b6a-9dbad3d1dbbb tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:51.747298 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9deab902-6fcc-4244-8b6a-9dbad3d1dbbb tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:51.747784 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9deab902-6fcc-4244-8b6a-9dbad3d1dbbb tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:51.748374 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9deab902-6fcc-4244-8b6a-9dbad3d1dbbb tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:51.856980 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-85740574-8117-4ee8-b451-0a875e951065 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:51.857759 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-85740574-8117-4ee8-b451-0a875e951065 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] [instance: 5e154d65-5086-47c1-bba7-ea3dfd53f6e6] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:51.936166 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9deab902-6fcc-4244-8b6a-9dbad3d1dbbb tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:51.949790 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9deab902-6fcc-4244-8b6a-9dbad3d1dbbb tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:51.955076 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9deab902-6fcc-4244-8b6a-9dbad3d1dbbb tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:51.955076 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9deab902-6fcc-4244-8b6a-9dbad3d1dbbb tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/609c8bd3-a9fc-4b16-ba22-c87aa44a822d" status: 200 len: 1362 microversion: 2.25 time: 0.221578 Oct 04 18:30:51.955386 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-85740574-8117-4ee8-b451-0a875e951065 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89f12d146749b38c688b7581e53f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247c7ae3e4e4068a88a044e36945f32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:51.955480 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 358/704] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:30:51 2022] GET /compute/v2.1/servers/609c8bd3-a9fc-4b16-ba22-c87aa44a822d => generated 1362 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:30:51.960588 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-85740574-8117-4ee8-b451-0a875e951065 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] 10.222.0.20 "GET /compute/v2.1/servers/5e154d65-5086-47c1-bba7-ea3dfd53f6e6" status: 200 len: 1121 microversion: 2.1 time: 0.108266 Oct 04 18:30:51.961316 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 347/705] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:51 2022] GET /compute/v2.1/servers/5e154d65-5086-47c1-bba7-ea3dfd53f6e6 => generated 1121 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:52.134344 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-84b97993-aee5-4a22-aafe-fdc9b8dba3c1 req-1021bcf7-9fd3-4241-a9a9-99ab1998fd5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "836f71c5-d859-4d09-9956-922b0bbee3ae", "tag": "0a037711-4826-46fe-ab3b-3321a329f5e9"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:52.143706 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-84b97993-aee5-4a22-aafe-fdc9b8dba3c1 req-1021bcf7-9fd3-4241-a9a9-99ab1998fd5f service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:52.144213 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-84b97993-aee5-4a22-aafe-fdc9b8dba3c1 req-1021bcf7-9fd3-4241-a9a9-99ab1998fd5f service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:52.144640 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-84b97993-aee5-4a22-aafe-fdc9b8dba3c1 req-1021bcf7-9fd3-4241-a9a9-99ab1998fd5f service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:52.157259 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-84b97993-aee5-4a22-aafe-fdc9b8dba3c1 req-1021bcf7-9fd3-4241-a9a9-99ab1998fd5f service nova] Creating event network-changed:0a037711-4826-46fe-ab3b-3321a329f5e9 for instance 836f71c5-d859-4d09-9956-922b0bbee3ae on n-h1-850501-14 Oct 04 18:30:52.163387 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-84b97993-aee5-4a22-aafe-fdc9b8dba3c1 req-1021bcf7-9fd3-4241-a9a9-99ab1998fd5f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032000 Oct 04 18:30:52.163992 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 359/706] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:30:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:30:52.223389 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-04ab6104-ec2f-4688-8261-52327e72dac2 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:52.224397 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-04ab6104-ec2f-4688-8261-52327e72dac2 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] [instance: c1bf585c-9cc9-4f87-966c-e02882aa51fd] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:52.235318 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-04ab6104-ec2f-4688-8261-52327e72dac2 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:52.236158 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-04ab6104-ec2f-4688-8261-52327e72dac2 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:52.236750 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-04ab6104-ec2f-4688-8261-52327e72dac2 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:52.237843 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-04ab6104-ec2f-4688-8261-52327e72dac2 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:52.238878 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-04ab6104-ec2f-4688-8261-52327e72dac2 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:52.242639 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-04ab6104-ec2f-4688-8261-52327e72dac2 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:52.267607 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f4159e39-c867-4c8d-87f9-f99cb6cc0b44 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:52.276164 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f4159e39-c867-4c8d-87f9-f99cb6cc0b44 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] [instance: 836f71c5-d859-4d09-9956-922b0bbee3ae] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:52.283023 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f4159e39-c867-4c8d-87f9-f99cb6cc0b44 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:52.284556 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f4159e39-c867-4c8d-87f9-f99cb6cc0b44 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:52.285532 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f4159e39-c867-4c8d-87f9-f99cb6cc0b44 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:52.286739 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f4159e39-c867-4c8d-87f9-f99cb6cc0b44 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:52.287342 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f4159e39-c867-4c8d-87f9-f99cb6cc0b44 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:52.289006 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f4159e39-c867-4c8d-87f9-f99cb6cc0b44 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:52.554380 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f4159e39-c867-4c8d-87f9-f99cb6cc0b44 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d326c048306423a87ddef70295a75e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1cc290c58149f8988cc3d69aff9efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:52.558185 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-04ab6104-ec2f-4688-8261-52327e72dac2 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f49a275284a7eb714a55c6bdd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e44e7aa06ee4126b5705ba65145ebcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:52.571606 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-04ab6104-ec2f-4688-8261-52327e72dac2 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] 10.222.0.20 "GET /compute/v2.1/servers/c1bf585c-9cc9-4f87-966c-e02882aa51fd" status: 200 len: 1325 microversion: 2.1 time: 0.352886 Oct 04 18:30:52.573823 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 348/707] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:52 2022] GET /compute/v2.1/servers/c1bf585c-9cc9-4f87-966c-e02882aa51fd => generated 1325 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:30:52.576757 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f4159e39-c867-4c8d-87f9-f99cb6cc0b44 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] 10.222.0.20 "GET /compute/v2.1/servers/836f71c5-d859-4d09-9956-922b0bbee3ae" status: 200 len: 1316 microversion: 2.1 time: 0.314581 Oct 04 18:30:52.593098 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 360/708] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:52 2022] GET /compute/v2.1/servers/836f71c5-d859-4d09-9956-922b0bbee3ae => generated 1316 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:52.601749 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2e66be5b-108d-4cc1-8d20-7320b3543739 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:52.602655 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2e66be5b-108d-4cc1-8d20-7320b3543739 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 89738dfe-3844-455a-93d1-d38702038946] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:52.609313 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-98f75489-432a-4caa-884d-3970d0384988 req-5becbe86-243d-4ee1-8298-10c997897bf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89738dfe-3844-455a-93d1-d38702038946", "name": "network-vif-plugged", "status": "completed", "tag": "77050755-1aa5-4d6d-8323-2fb66ab475c5"}, {"server_uuid": "208ff352-ed98-4a12-8913-7e520822bf95", "name": "network-vif-plugged", "status": "completed", "tag": "63a4b4fb-c5d8-4a51-9f44-49460db78384"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:52.612046 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e66be5b-108d-4cc1-8d20-7320b3543739 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:52.612828 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e66be5b-108d-4cc1-8d20-7320b3543739 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:52.613517 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e66be5b-108d-4cc1-8d20-7320b3543739 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:52.615419 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e66be5b-108d-4cc1-8d20-7320b3543739 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:52.620895 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e66be5b-108d-4cc1-8d20-7320b3543739 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:52.620895 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e66be5b-108d-4cc1-8d20-7320b3543739 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:52.636089 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-98f75489-432a-4caa-884d-3970d0384988 req-5becbe86-243d-4ee1-8298-10c997897bf3 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:52.636890 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-98f75489-432a-4caa-884d-3970d0384988 req-5becbe86-243d-4ee1-8298-10c997897bf3 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:52.638066 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-98f75489-432a-4caa-884d-3970d0384988 req-5becbe86-243d-4ee1-8298-10c997897bf3 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:52.657212 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-98f75489-432a-4caa-884d-3970d0384988 req-5becbe86-243d-4ee1-8298-10c997897bf3 service nova] Creating event network-vif-plugged:77050755-1aa5-4d6d-8323-2fb66ab475c5 for instance 89738dfe-3844-455a-93d1-d38702038946 on n-h1-850501-14 Oct 04 18:30:52.658785 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-98f75489-432a-4caa-884d-3970d0384988 req-5becbe86-243d-4ee1-8298-10c997897bf3 service nova] Creating event network-vif-plugged:63a4b4fb-c5d8-4a51-9f44-49460db78384 for instance 208ff352-ed98-4a12-8913-7e520822bf95 on n-h2-850501-14 Oct 04 18:30:52.678361 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-98f75489-432a-4caa-884d-3970d0384988 req-5becbe86-243d-4ee1-8298-10c997897bf3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.099218 Oct 04 18:30:52.681444 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 361/709] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:30:52 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:30:52.690403 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f5482a25-d8c9-4661-a0ae-7c3effdb54c0 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:52.695336 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f5482a25-d8c9-4661-a0ae-7c3effdb54c0 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: 208ff352-ed98-4a12-8913-7e520822bf95] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:52.704544 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f5482a25-d8c9-4661-a0ae-7c3effdb54c0 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:52.705694 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f5482a25-d8c9-4661-a0ae-7c3effdb54c0 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:52.706347 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f5482a25-d8c9-4661-a0ae-7c3effdb54c0 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:52.707359 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f5482a25-d8c9-4661-a0ae-7c3effdb54c0 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:52.708633 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f5482a25-d8c9-4661-a0ae-7c3effdb54c0 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:52.709340 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f5482a25-d8c9-4661-a0ae-7c3effdb54c0 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:52.939096 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2e66be5b-108d-4cc1-8d20-7320b3543739 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:52.955846 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2e66be5b-108d-4cc1-8d20-7320b3543739 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946" status: 200 len: 1310 microversion: 2.1 time: 0.380661 Oct 04 18:30:52.960426 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 349/710] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:52 2022] GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946 => generated 1310 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:52.984436 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-18a366e6-070f-4339-87f4-df64137b9cb2 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:52.984706 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f5482a25-d8c9-4661-a0ae-7c3effdb54c0 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:52.989565 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-18a366e6-070f-4339-87f4-df64137b9cb2 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: 609c8bd3-a9fc-4b16-ba22-c87aa44a822d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:53.019886 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-18a366e6-070f-4339-87f4-df64137b9cb2 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:53.021573 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f5482a25-d8c9-4661-a0ae-7c3effdb54c0 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/208ff352-ed98-4a12-8913-7e520822bf95" status: 200 len: 1317 microversion: 2.1 time: 0.327839 Oct 04 18:30:53.022956 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-18a366e6-070f-4339-87f4-df64137b9cb2 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:53.023385 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 362/711] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:52 2022] GET /compute/v2.1/servers/208ff352-ed98-4a12-8913-7e520822bf95 => generated 1317 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:53.026341 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-18a366e6-070f-4339-87f4-df64137b9cb2 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:53.030294 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-18a366e6-070f-4339-87f4-df64137b9cb2 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:53.030960 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-18a366e6-070f-4339-87f4-df64137b9cb2 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:53.031564 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-18a366e6-070f-4339-87f4-df64137b9cb2 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:53.036653 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-759b3c6d-bda5-40ff-8a05-7ca48ef26afc tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:53.039863 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-759b3c6d-bda5-40ff-8a05-7ca48ef26afc tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] [instance: 5e154d65-5086-47c1-bba7-ea3dfd53f6e6] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:53.061780 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-759b3c6d-bda5-40ff-8a05-7ca48ef26afc tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:53.062493 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-759b3c6d-bda5-40ff-8a05-7ca48ef26afc tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:53.063090 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-759b3c6d-bda5-40ff-8a05-7ca48ef26afc tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:53.064292 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-759b3c6d-bda5-40ff-8a05-7ca48ef26afc tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:53.065271 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-759b3c6d-bda5-40ff-8a05-7ca48ef26afc tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:53.065870 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-759b3c6d-bda5-40ff-8a05-7ca48ef26afc tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:53.181198 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-759b3c6d-bda5-40ff-8a05-7ca48ef26afc tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89f12d146749b38c688b7581e53f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247c7ae3e4e4068a88a044e36945f32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:53.189105 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-759b3c6d-bda5-40ff-8a05-7ca48ef26afc tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] 10.222.0.20 "GET /compute/v2.1/servers/5e154d65-5086-47c1-bba7-ea3dfd53f6e6" status: 200 len: 1163 microversion: 2.1 time: 0.163139 Oct 04 18:30:53.189693 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 363/712] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:53 2022] GET /compute/v2.1/servers/5e154d65-5086-47c1-bba7-ea3dfd53f6e6 => generated 1163 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:53.306245 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-18a366e6-070f-4339-87f4-df64137b9cb2 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:53.318103 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-18a366e6-070f-4339-87f4-df64137b9cb2 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:53.320948 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-18a366e6-070f-4339-87f4-df64137b9cb2 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:53.324200 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-18a366e6-070f-4339-87f4-df64137b9cb2 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/609c8bd3-a9fc-4b16-ba22-c87aa44a822d" status: 200 len: 1558 microversion: 2.25 time: 0.343823 Oct 04 18:30:53.325379 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 350/713] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:30:52 2022] GET /compute/v2.1/servers/609c8bd3-a9fc-4b16-ba22-c87aa44a822d => generated 1558 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:30:53.536314 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ade6090a-c377-4ca6-8b01-67d8ab0fbc54 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:53.537548 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ade6090a-c377-4ca6-8b01-67d8ab0fbc54 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] [instance: 609c8bd3-a9fc-4b16-ba22-c87aa44a822d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:53.546575 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ade6090a-c377-4ca6-8b01-67d8ab0fbc54 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:53.550317 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ade6090a-c377-4ca6-8b01-67d8ab0fbc54 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:53.550317 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ade6090a-c377-4ca6-8b01-67d8ab0fbc54 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:53.550317 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ade6090a-c377-4ca6-8b01-67d8ab0fbc54 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:53.550317 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ade6090a-c377-4ca6-8b01-67d8ab0fbc54 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:53.550944 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ade6090a-c377-4ca6-8b01-67d8ab0fbc54 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:53.597090 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-692e2ad5-383c-48bc-b688-db5f1d2554e2 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:53.597715 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-692e2ad5-383c-48bc-b688-db5f1d2554e2 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] [instance: c1bf585c-9cc9-4f87-966c-e02882aa51fd] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:53.605277 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-692e2ad5-383c-48bc-b688-db5f1d2554e2 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:53.606022 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-692e2ad5-383c-48bc-b688-db5f1d2554e2 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:53.606463 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-692e2ad5-383c-48bc-b688-db5f1d2554e2 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:53.607168 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-692e2ad5-383c-48bc-b688-db5f1d2554e2 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:53.607773 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-692e2ad5-383c-48bc-b688-db5f1d2554e2 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:53.608235 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-692e2ad5-383c-48bc-b688-db5f1d2554e2 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:53.729766 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-ade6090a-c377-4ca6-8b01-67d8ab0fbc54 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lazy-loading 'services' on Instance uuid 609c8bd3-a9fc-4b16-ba22-c87aa44a822d {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:30:53.773976 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-692e2ad5-383c-48bc-b688-db5f1d2554e2 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f49a275284a7eb714a55c6bdd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e44e7aa06ee4126b5705ba65145ebcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:53.786616 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ade6090a-c377-4ca6-8b01-67d8ab0fbc54 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/609c8bd3-a9fc-4b16-ba22-c87aa44a822d" status: 200 len: 2053 microversion: 2.25 time: 0.429110 Oct 04 18:30:53.787404 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 364/714] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:30:53 2022] GET /compute/v2.1/servers/609c8bd3-a9fc-4b16-ba22-c87aa44a822d => generated 2053 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:30:53.789436 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-692e2ad5-383c-48bc-b688-db5f1d2554e2 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] 10.222.0.20 "GET /compute/v2.1/servers/c1bf585c-9cc9-4f87-966c-e02882aa51fd" status: 200 len: 1325 microversion: 2.1 time: 0.195781 Oct 04 18:30:53.790323 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 351/715] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:53 2022] GET /compute/v2.1/servers/c1bf585c-9cc9-4f87-966c-e02882aa51fd => generated 1325 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:30:53.798228 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-be991d68-862e-4f3e-b873-4a7b350c42bc tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:53.800675 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-be991d68-862e-4f3e-b873-4a7b350c42bc tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] [instance: 836f71c5-d859-4d09-9956-922b0bbee3ae] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:53.808654 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-be991d68-862e-4f3e-b873-4a7b350c42bc tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:53.811126 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-be991d68-862e-4f3e-b873-4a7b350c42bc tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:53.811749 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-be991d68-862e-4f3e-b873-4a7b350c42bc tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:53.812534 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-be991d68-862e-4f3e-b873-4a7b350c42bc tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:53.812993 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-be991d68-862e-4f3e-b873-4a7b350c42bc tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:53.813439 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-be991d68-862e-4f3e-b873-4a7b350c42bc tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:53.814562 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a99af348-935b-4842-84ba-69fc346d0a18 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:53.815189 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a99af348-935b-4842-84ba-69fc346d0a18 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] [instance: 609c8bd3-a9fc-4b16-ba22-c87aa44a822d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:53.821261 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a99af348-935b-4842-84ba-69fc346d0a18 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:53.821748 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a99af348-935b-4842-84ba-69fc346d0a18 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:53.822179 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a99af348-935b-4842-84ba-69fc346d0a18 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:53.822875 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a99af348-935b-4842-84ba-69fc346d0a18 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:53.823318 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a99af348-935b-4842-84ba-69fc346d0a18 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:53.823738 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a99af348-935b-4842-84ba-69fc346d0a18 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:54.025766 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-be991d68-862e-4f3e-b873-4a7b350c42bc tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d326c048306423a87ddef70295a75e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1cc290c58149f8988cc3d69aff9efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:54.034795 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-a99af348-935b-4842-84ba-69fc346d0a18 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lazy-loading 'services' on Instance uuid 609c8bd3-a9fc-4b16-ba22-c87aa44a822d {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:30:54.037398 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-be991d68-862e-4f3e-b873-4a7b350c42bc tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] 10.222.0.20 "GET /compute/v2.1/servers/836f71c5-d859-4d09-9956-922b0bbee3ae" status: 200 len: 1316 microversion: 2.1 time: 0.248006 Oct 04 18:30:54.038474 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 365/716] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:53 2022] GET /compute/v2.1/servers/836f71c5-d859-4d09-9956-922b0bbee3ae => generated 1316 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:54.044096 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-68974a8d-5c89-4a24-a569-f80ed3181c84 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:54.044922 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-68974a8d-5c89-4a24-a569-f80ed3181c84 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 89738dfe-3844-455a-93d1-d38702038946] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:54.057478 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-68974a8d-5c89-4a24-a569-f80ed3181c84 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:54.058050 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-68974a8d-5c89-4a24-a569-f80ed3181c84 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:54.058469 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-68974a8d-5c89-4a24-a569-f80ed3181c84 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:54.059425 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-68974a8d-5c89-4a24-a569-f80ed3181c84 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:54.059864 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-68974a8d-5c89-4a24-a569-f80ed3181c84 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:54.060498 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-68974a8d-5c89-4a24-a569-f80ed3181c84 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:54.088384 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a99af348-935b-4842-84ba-69fc346d0a18 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/609c8bd3-a9fc-4b16-ba22-c87aa44a822d" status: 200 len: 2053 microversion: 2.25 time: 0.277450 Oct 04 18:30:54.089108 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 352/717] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:30:53 2022] GET /compute/v2.1/servers/609c8bd3-a9fc-4b16-ba22-c87aa44a822d => generated 2053 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:30:54.100587 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4a9a2f79-2737-4971-8d38-3294dee17cfa tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:54.101449 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4a9a2f79-2737-4971-8d38-3294dee17cfa tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: 208ff352-ed98-4a12-8913-7e520822bf95] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:54.108768 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4a9a2f79-2737-4971-8d38-3294dee17cfa tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:54.109490 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4a9a2f79-2737-4971-8d38-3294dee17cfa tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:54.109981 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4a9a2f79-2737-4971-8d38-3294dee17cfa tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:54.110741 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4a9a2f79-2737-4971-8d38-3294dee17cfa tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:54.111196 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4a9a2f79-2737-4971-8d38-3294dee17cfa tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:54.111622 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4a9a2f79-2737-4971-8d38-3294dee17cfa tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:54.290850 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-68974a8d-5c89-4a24-a569-f80ed3181c84 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:54.293350 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=100 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:30:54.299582 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-68974a8d-5c89-4a24-a569-f80ed3181c84 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946" status: 200 len: 1310 microversion: 2.1 time: 0.259841 Oct 04 18:30:54.300321 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 366/718] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:54 2022] GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946 => generated 1310 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:54.307086 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-bbb4226e-d2f2-45b6-b820-108b7c60b109 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:54.310265 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4a9a2f79-2737-4971-8d38-3294dee17cfa tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:54.311303 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bbb4226e-d2f2-45b6-b820-108b7c60b109 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:54.312123 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bbb4226e-d2f2-45b6-b820-108b7c60b109 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:54.312780 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bbb4226e-d2f2-45b6-b820-108b7c60b109 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:54.313758 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bbb4226e-d2f2-45b6-b820-108b7c60b109 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:54.314456 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bbb4226e-d2f2-45b6-b820-108b7c60b109 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:54.315032 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bbb4226e-d2f2-45b6-b820-108b7c60b109 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:54.318495 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4a9a2f79-2737-4971-8d38-3294dee17cfa tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/208ff352-ed98-4a12-8913-7e520822bf95" status: 200 len: 1317 microversion: 2.1 time: 0.228142 Oct 04 18:30:54.319332 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 353/719] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:54 2022] GET /compute/v2.1/servers/208ff352-ed98-4a12-8913-7e520822bf95 => generated 1317 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:54.324082 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-70b9d413-d7ee-417a-8b07-b52e2b86c3fc tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:54.324709 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-70b9d413-d7ee-417a-8b07-b52e2b86c3fc tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] [instance: 5e154d65-5086-47c1-bba7-ea3dfd53f6e6] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:54.330871 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-70b9d413-d7ee-417a-8b07-b52e2b86c3fc tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:54.331357 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-70b9d413-d7ee-417a-8b07-b52e2b86c3fc tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:54.331810 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-70b9d413-d7ee-417a-8b07-b52e2b86c3fc tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:54.332516 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-70b9d413-d7ee-417a-8b07-b52e2b86c3fc tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:54.332995 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-70b9d413-d7ee-417a-8b07-b52e2b86c3fc tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:54.333577 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-70b9d413-d7ee-417a-8b07-b52e2b86c3fc tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:54.346671 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-bbb4226e-d2f2-45b6-b820-108b7c60b109 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.044853 Oct 04 18:30:54.347360 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 367/720] 10.222.0.20 () {60 vars in 1217 bytes} [Tue Oct 4 18:30:54 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:30:54.361379 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4a051024-01a5-4299-9af7-ce912bef750b tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-850501-14", "block_migration": "auto"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:54.364747 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-4a051024-01a5-4299-9af7-ce912bef750b tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] [instance: 609c8bd3-a9fc-4b16-ba22-c87aa44a822d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:54.375303 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4a051024-01a5-4299-9af7-ce912bef750b tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:54.375965 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4a051024-01a5-4299-9af7-ce912bef750b tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:54.376658 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4a051024-01a5-4299-9af7-ce912bef750b tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:54.379279 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4a051024-01a5-4299-9af7-ce912bef750b tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:54.379279 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4a051024-01a5-4299-9af7-ce912bef750b tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:54.379279 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4a051024-01a5-4299-9af7-ce912bef750b tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:54.500168 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-70b9d413-d7ee-417a-8b07-b52e2b86c3fc tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89f12d146749b38c688b7581e53f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247c7ae3e4e4068a88a044e36945f32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:54.526445 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-70b9d413-d7ee-417a-8b07-b52e2b86c3fc tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] 10.222.0.20 "GET /compute/v2.1/servers/5e154d65-5086-47c1-bba7-ea3dfd53f6e6" status: 200 len: 1219 microversion: 2.1 time: 0.205725 Oct 04 18:30:54.528744 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-4a051024-01a5-4299-9af7-ce912bef750b tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lazy-loading 'flavor' on Instance uuid 609c8bd3-a9fc-4b16-ba22-c87aa44a822d {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:30:54.530460 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 354/721] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:54 2022] GET /compute/v2.1/servers/5e154d65-5086-47c1-bba7-ea3dfd53f6e6 => generated 1219 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:54.582912 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-4a051024-01a5-4299-9af7-ce912bef750b tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] [instance: 609c8bd3-a9fc-4b16-ba22-c87aa44a822d] Going to try to live migrate instance to n-h2-850501-14 {{(pid=123001) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 18:30:54.765939 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-3af660d2-89a2-43f0-b9c9-3deef6079067 req-c7110b9d-559c-4824-af2b-632cc16c700b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1bf585c-9cc9-4f87-966c-e02882aa51fd", "name": "network-vif-plugged", "status": "completed", "tag": "a08a497b-a75d-46e8-bb72-da6d0464043b"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:54.779027 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-3af660d2-89a2-43f0-b9c9-3deef6079067 req-c7110b9d-559c-4824-af2b-632cc16c700b service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:54.779809 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-3af660d2-89a2-43f0-b9c9-3deef6079067 req-c7110b9d-559c-4824-af2b-632cc16c700b service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:54.780661 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-3af660d2-89a2-43f0-b9c9-3deef6079067 req-c7110b9d-559c-4824-af2b-632cc16c700b service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:54.796778 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-3af660d2-89a2-43f0-b9c9-3deef6079067 req-c7110b9d-559c-4824-af2b-632cc16c700b service nova] Creating event network-vif-plugged:a08a497b-a75d-46e8-bb72-da6d0464043b for instance c1bf585c-9cc9-4f87-966c-e02882aa51fd on n-h1-850501-14 Oct 04 18:30:54.801934 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-3af660d2-89a2-43f0-b9c9-3deef6079067 req-c7110b9d-559c-4824-af2b-632cc16c700b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043097 Oct 04 18:30:54.802639 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 355/722] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:30:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:30:54.814502 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e65d55e3-b4b4-4ad8-98c9-951974bc9c39 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:54.815631 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e65d55e3-b4b4-4ad8-98c9-951974bc9c39 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] [instance: c1bf585c-9cc9-4f87-966c-e02882aa51fd] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:54.831979 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e65d55e3-b4b4-4ad8-98c9-951974bc9c39 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:54.832508 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e65d55e3-b4b4-4ad8-98c9-951974bc9c39 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:54.833015 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e65d55e3-b4b4-4ad8-98c9-951974bc9c39 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:54.833904 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e65d55e3-b4b4-4ad8-98c9-951974bc9c39 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:54.834362 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e65d55e3-b4b4-4ad8-98c9-951974bc9c39 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:54.835050 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e65d55e3-b4b4-4ad8-98c9-951974bc9c39 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:55.081351 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e65d55e3-b4b4-4ad8-98c9-951974bc9c39 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f49a275284a7eb714a55c6bdd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e44e7aa06ee4126b5705ba65145ebcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:55.099096 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e65d55e3-b4b4-4ad8-98c9-951974bc9c39 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] 10.222.0.20 "GET /compute/v2.1/servers/c1bf585c-9cc9-4f87-966c-e02882aa51fd" status: 200 len: 1325 microversion: 2.1 time: 0.289386 Oct 04 18:30:55.108222 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 356/723] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:54 2022] GET /compute/v2.1/servers/c1bf585c-9cc9-4f87-966c-e02882aa51fd => generated 1325 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:30:55.116571 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-31a31ac7-90d8-4898-8a3f-6b4dc54a7a35 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:55.117502 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-31a31ac7-90d8-4898-8a3f-6b4dc54a7a35 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] [instance: 836f71c5-d859-4d09-9956-922b0bbee3ae] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:55.125185 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-31a31ac7-90d8-4898-8a3f-6b4dc54a7a35 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:55.125935 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-31a31ac7-90d8-4898-8a3f-6b4dc54a7a35 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:55.126582 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-31a31ac7-90d8-4898-8a3f-6b4dc54a7a35 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:55.127773 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-31a31ac7-90d8-4898-8a3f-6b4dc54a7a35 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:55.128845 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-31a31ac7-90d8-4898-8a3f-6b4dc54a7a35 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:55.129499 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-31a31ac7-90d8-4898-8a3f-6b4dc54a7a35 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:55.349633 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-31a31ac7-90d8-4898-8a3f-6b4dc54a7a35 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d326c048306423a87ddef70295a75e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1cc290c58149f8988cc3d69aff9efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:55.367494 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-31a31ac7-90d8-4898-8a3f-6b4dc54a7a35 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] 10.222.0.20 "GET /compute/v2.1/servers/836f71c5-d859-4d09-9956-922b0bbee3ae" status: 200 len: 1316 microversion: 2.1 time: 0.265033 Oct 04 18:30:55.387324 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 357/724] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:55 2022] GET /compute/v2.1/servers/836f71c5-d859-4d09-9956-922b0bbee3ae => generated 1316 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:55.392488 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-17058066-b9f1-4f89-9942-81b1e0e8160a tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:55.393646 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-17058066-b9f1-4f89-9942-81b1e0e8160a tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 89738dfe-3844-455a-93d1-d38702038946] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:55.400235 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-17058066-b9f1-4f89-9942-81b1e0e8160a tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:55.400724 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-17058066-b9f1-4f89-9942-81b1e0e8160a tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:55.401152 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-17058066-b9f1-4f89-9942-81b1e0e8160a tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:55.401845 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-17058066-b9f1-4f89-9942-81b1e0e8160a tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:55.402677 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-17058066-b9f1-4f89-9942-81b1e0e8160a tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:55.403263 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-17058066-b9f1-4f89-9942-81b1e0e8160a tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:55.552240 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-17058066-b9f1-4f89-9942-81b1e0e8160a tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:55.560711 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-17058066-b9f1-4f89-9942-81b1e0e8160a tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946" status: 200 len: 1494 microversion: 2.1 time: 0.172178 Oct 04 18:30:55.561283 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 358/725] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:55 2022] GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946 => generated 1494 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:55.565869 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-38bb5c66-e4d7-4ab0-aa09-31fe1219393f tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:55.566636 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-38bb5c66-e4d7-4ab0-aa09-31fe1219393f tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: 208ff352-ed98-4a12-8913-7e520822bf95] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:55.575117 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-38bb5c66-e4d7-4ab0-aa09-31fe1219393f tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:55.575823 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-38bb5c66-e4d7-4ab0-aa09-31fe1219393f tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:55.576441 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-38bb5c66-e4d7-4ab0-aa09-31fe1219393f tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:55.578729 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-38bb5c66-e4d7-4ab0-aa09-31fe1219393f tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:55.579098 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-38bb5c66-e4d7-4ab0-aa09-31fe1219393f tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:55.582634 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-38bb5c66-e4d7-4ab0-aa09-31fe1219393f tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:55.763512 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-38bb5c66-e4d7-4ab0-aa09-31fe1219393f tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:55.774027 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-38bb5c66-e4d7-4ab0-aa09-31fe1219393f tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/208ff352-ed98-4a12-8913-7e520822bf95" status: 200 len: 1467 microversion: 2.1 time: 0.211601 Oct 04 18:30:55.791650 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 359/726] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:55 2022] GET /compute/v2.1/servers/208ff352-ed98-4a12-8913-7e520822bf95 => generated 1467 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:55.796972 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-cc92a2b0-75da-430d-80a0-436ee2683516 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:55.797602 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-cc92a2b0-75da-430d-80a0-436ee2683516 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] [instance: 5e154d65-5086-47c1-bba7-ea3dfd53f6e6] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:55.805346 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cc92a2b0-75da-430d-80a0-436ee2683516 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:55.805846 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cc92a2b0-75da-430d-80a0-436ee2683516 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:55.806280 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cc92a2b0-75da-430d-80a0-436ee2683516 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:55.807155 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cc92a2b0-75da-430d-80a0-436ee2683516 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:55.808013 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cc92a2b0-75da-430d-80a0-436ee2683516 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:55.808627 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cc92a2b0-75da-430d-80a0-436ee2683516 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:55.887215 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-cc92a2b0-75da-430d-80a0-436ee2683516 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89f12d146749b38c688b7581e53f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247c7ae3e4e4068a88a044e36945f32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:55.895574 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-cc92a2b0-75da-430d-80a0-436ee2683516 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] 10.222.0.20 "GET /compute/v2.1/servers/5e154d65-5086-47c1-bba7-ea3dfd53f6e6" status: 200 len: 1227 microversion: 2.1 time: 0.102774 Oct 04 18:30:55.896533 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 360/727] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:55 2022] GET /compute/v2.1/servers/5e154d65-5086-47c1-bba7-ea3dfd53f6e6 => generated 1227 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:56.045972 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2b5099d5-de5c-4510-9281-cd5832dd6500 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:56.046739 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2b5099d5-de5c-4510-9281-cd5832dd6500 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] [instance: 89738dfe-3844-455a-93d1-d38702038946] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:56.053413 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=100 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:30:56.055543 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2b5099d5-de5c-4510-9281-cd5832dd6500 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:56.056297 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2b5099d5-de5c-4510-9281-cd5832dd6500 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:56.056965 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2b5099d5-de5c-4510-9281-cd5832dd6500 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:56.058146 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2b5099d5-de5c-4510-9281-cd5832dd6500 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:56.058680 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2b5099d5-de5c-4510-9281-cd5832dd6500 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:56.059965 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2b5099d5-de5c-4510-9281-cd5832dd6500 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:56.227770 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2b5099d5-de5c-4510-9281-cd5832dd6500 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946" status: 200 len: 1647 microversion: 2.1 time: 0.329654 Oct 04 18:30:56.236166 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 361/728] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:55 2022] GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946 => generated 1647 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:56.246728 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9eecedb8-0d76-4096-81ac-e6ce636753c7 tempest-ServersOnMultiNodesTest-1719152185 tempest-ServersOnMultiNodesTest-1719152185-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:56.251239 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9eecedb8-0d76-4096-81ac-e6ce636753c7 tempest-ServersOnMultiNodesTest-1719152185 tempest-ServersOnMultiNodesTest-1719152185-project-admin] [instance: 208ff352-ed98-4a12-8913-7e520822bf95] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:56.259882 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9eecedb8-0d76-4096-81ac-e6ce636753c7 tempest-ServersOnMultiNodesTest-1719152185 tempest-ServersOnMultiNodesTest-1719152185-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:56.259882 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9eecedb8-0d76-4096-81ac-e6ce636753c7 tempest-ServersOnMultiNodesTest-1719152185 tempest-ServersOnMultiNodesTest-1719152185-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:56.259882 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9eecedb8-0d76-4096-81ac-e6ce636753c7 tempest-ServersOnMultiNodesTest-1719152185 tempest-ServersOnMultiNodesTest-1719152185-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:56.260598 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9eecedb8-0d76-4096-81ac-e6ce636753c7 tempest-ServersOnMultiNodesTest-1719152185 tempest-ServersOnMultiNodesTest-1719152185-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:56.261178 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9eecedb8-0d76-4096-81ac-e6ce636753c7 tempest-ServersOnMultiNodesTest-1719152185 tempest-ServersOnMultiNodesTest-1719152185-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:56.261880 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9eecedb8-0d76-4096-81ac-e6ce636753c7 tempest-ServersOnMultiNodesTest-1719152185 tempest-ServersOnMultiNodesTest-1719152185-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:56.446530 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=100 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:30:56.455734 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9eecedb8-0d76-4096-81ac-e6ce636753c7 tempest-ServersOnMultiNodesTest-1719152185 tempest-ServersOnMultiNodesTest-1719152185-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/208ff352-ed98-4a12-8913-7e520822bf95" status: 200 len: 1620 microversion: 2.1 time: 0.217667 Oct 04 18:30:56.456493 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 362/729] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:56 2022] GET /compute/v2.1/servers/208ff352-ed98-4a12-8913-7e520822bf95 => generated 1620 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:56.462611 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-12194467-8519-476b-be1e-9dcbc0c9f308 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:56.463358 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-12194467-8519-476b-be1e-9dcbc0c9f308 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] [instance: c1bf585c-9cc9-4f87-966c-e02882aa51fd] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:56.470657 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-12194467-8519-476b-be1e-9dcbc0c9f308 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:56.471474 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-12194467-8519-476b-be1e-9dcbc0c9f308 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:56.472152 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-12194467-8519-476b-be1e-9dcbc0c9f308 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:56.480332 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-12194467-8519-476b-be1e-9dcbc0c9f308 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:56.481188 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-12194467-8519-476b-be1e-9dcbc0c9f308 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:56.481845 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-12194467-8519-476b-be1e-9dcbc0c9f308 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:56.720302 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-12194467-8519-476b-be1e-9dcbc0c9f308 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f49a275284a7eb714a55c6bdd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e44e7aa06ee4126b5705ba65145ebcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:56.729484 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-12194467-8519-476b-be1e-9dcbc0c9f308 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] 10.222.0.20 "GET /compute/v2.1/servers/c1bf585c-9cc9-4f87-966c-e02882aa51fd" status: 200 len: 1521 microversion: 2.1 time: 0.271575 Oct 04 18:30:56.734131 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 363/730] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:56 2022] GET /compute/v2.1/servers/c1bf585c-9cc9-4f87-966c-e02882aa51fd => generated 1521 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:56.765489 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-345c9a93-a0b4-4ea5-909d-59a5934122e0 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:56.766354 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-345c9a93-a0b4-4ea5-909d-59a5934122e0 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] [instance: 89738dfe-3844-455a-93d1-d38702038946] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:56.778894 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-345c9a93-a0b4-4ea5-909d-59a5934122e0 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:56.779854 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-345c9a93-a0b4-4ea5-909d-59a5934122e0 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:56.780531 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-345c9a93-a0b4-4ea5-909d-59a5934122e0 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:56.781556 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-345c9a93-a0b4-4ea5-909d-59a5934122e0 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:56.782521 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-345c9a93-a0b4-4ea5-909d-59a5934122e0 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:56.783216 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-345c9a93-a0b4-4ea5-909d-59a5934122e0 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:56.990093 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-345c9a93-a0b4-4ea5-909d-59a5934122e0 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946" status: 200 len: 1647 microversion: 2.1 time: 0.253191 Oct 04 18:30:56.991409 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 364/731] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:56 2022] GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946 => generated 1647 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:57.023249 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-05dec122-7a2b-4486-85b7-75293ebeaadd tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:57.024343 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-05dec122-7a2b-4486-85b7-75293ebeaadd tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] [instance: 836f71c5-d859-4d09-9956-922b0bbee3ae] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:57.033144 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-05dec122-7a2b-4486-85b7-75293ebeaadd tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:57.033828 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-05dec122-7a2b-4486-85b7-75293ebeaadd tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:57.034708 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-05dec122-7a2b-4486-85b7-75293ebeaadd tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:57.035794 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-05dec122-7a2b-4486-85b7-75293ebeaadd tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:57.036774 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-05dec122-7a2b-4486-85b7-75293ebeaadd tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:57.038962 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-05dec122-7a2b-4486-85b7-75293ebeaadd tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:57.248440 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-05dec122-7a2b-4486-85b7-75293ebeaadd tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d326c048306423a87ddef70295a75e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1cc290c58149f8988cc3d69aff9efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:57.263762 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-05dec122-7a2b-4486-85b7-75293ebeaadd tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] 10.222.0.20 "GET /compute/v2.1/servers/836f71c5-d859-4d09-9956-922b0bbee3ae" status: 200 len: 1316 microversion: 2.1 time: 0.270039 Oct 04 18:30:57.285289 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 365/732] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:56 2022] GET /compute/v2.1/servers/836f71c5-d859-4d09-9956-922b0bbee3ae => generated 1316 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:57.292305 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-40ab0979-2f57-47c1-a469-8461206a9ef0 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:57.293299 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-40ab0979-2f57-47c1-a469-8461206a9ef0 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] [instance: c1bf585c-9cc9-4f87-966c-e02882aa51fd] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:57.304197 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-40ab0979-2f57-47c1-a469-8461206a9ef0 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:57.304919 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-40ab0979-2f57-47c1-a469-8461206a9ef0 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:57.305749 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-40ab0979-2f57-47c1-a469-8461206a9ef0 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:57.306671 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-40ab0979-2f57-47c1-a469-8461206a9ef0 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:57.307291 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-40ab0979-2f57-47c1-a469-8461206a9ef0 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:57.308157 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-40ab0979-2f57-47c1-a469-8461206a9ef0 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:57.905409 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-40ab0979-2f57-47c1-a469-8461206a9ef0 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f49a275284a7eb714a55c6bdd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e44e7aa06ee4126b5705ba65145ebcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:57.925565 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-40ab0979-2f57-47c1-a469-8461206a9ef0 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] 10.222.0.20 "GET /compute/v2.1/servers/c1bf585c-9cc9-4f87-966c-e02882aa51fd" status: 200 len: 1521 microversion: 2.1 time: 0.638723 Oct 04 18:30:57.926414 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 366/733] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:57 2022] GET /compute/v2.1/servers/c1bf585c-9cc9-4f87-966c-e02882aa51fd => generated 1521 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:57.944479 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-500cfb80-6511-4907-8700-7c2a336e2193 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-382191162", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["2e85db28-c393-4e02-8f28-bf0d217b6db7"]}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:58.037339 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-500cfb80-6511-4907-8700-7c2a336e2193 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] validate_networks() for None {{(pid=123002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:30:58.473481 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-500cfb80-6511-4907-8700-7c2a336e2193 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:30:58.474146 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-500cfb80-6511-4907-8700-7c2a336e2193 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:30:58.474354 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-500cfb80-6511-4907-8700-7c2a336e2193 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:30:58.474762 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-500cfb80-6511-4907-8700-7c2a336e2193 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:30:58.475879 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-500cfb80-6511-4907-8700-7c2a336e2193 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:30:58.492689 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-500cfb80-6511-4907-8700-7c2a336e2193 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:58.494644 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-500cfb80-6511-4907-8700-7c2a336e2193 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:58.495099 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-500cfb80-6511-4907-8700-7c2a336e2193 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:58.497147 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-500cfb80-6511-4907-8700-7c2a336e2193 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:58.497963 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-500cfb80-6511-4907-8700-7c2a336e2193 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:58.499137 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-500cfb80-6511-4907-8700-7c2a336e2193 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:58.547130 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-500cfb80-6511-4907-8700-7c2a336e2193 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Getting quotas for project 771211a4ce424aa48920ff102c894a9f. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:30:58.564119 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-500cfb80-6511-4907-8700-7c2a336e2193 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Getting quotas for user 07dd131fa3c44d439d0f3ec6e4b8ad42 and project 771211a4ce424aa48920ff102c894a9f. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:30:58.592708 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-500cfb80-6511-4907-8700-7c2a336e2193 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Going to run 1 instances... {{(pid=123002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:30:58.592708 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-500cfb80-6511-4907-8700-7c2a336e2193 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: 47fc818f-4a40-42b8-9698-0fdbed7631d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:30:58.769823 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-500cfb80-6511-4907-8700-7c2a336e2193 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.841762 Oct 04 18:30:58.778924 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 367/734] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:30:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 843 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:30:58.778924 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f2a65bd4-6da5-493b-92bb-bdb65acc073a tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:58.778924 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f2a65bd4-6da5-493b-92bb-bdb65acc073a tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] [instance: 5e154d65-5086-47c1-bba7-ea3dfd53f6e6] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:58.785879 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f2a65bd4-6da5-493b-92bb-bdb65acc073a tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:58.786474 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f2a65bd4-6da5-493b-92bb-bdb65acc073a tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:58.788210 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f2a65bd4-6da5-493b-92bb-bdb65acc073a tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:58.789127 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f2a65bd4-6da5-493b-92bb-bdb65acc073a tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:58.789771 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f2a65bd4-6da5-493b-92bb-bdb65acc073a tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:58.790288 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f2a65bd4-6da5-493b-92bb-bdb65acc073a tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:59.125921 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-4a051024-01a5-4299-9af7-ce912bef750b tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/609c8bd3-a9fc-4b16-ba22-c87aa44a822d/action" status: 202 len: 0 microversion: 2.25 time: 4.763644 Oct 04 18:30:59.125921 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 368/735] 10.222.0.20 () {62 vars in 1319 bytes} [Tue Oct 4 18:30:54 2022] POST /compute/v2.1/servers/609c8bd3-a9fc-4b16-ba22-c87aa44a822d/action => generated 0 bytes in 4766 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:30:59.129274 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-967757b3-e760-4c50-9c30-c8e4523e0ba8 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:59.139020 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-967757b3-e760-4c50-9c30-c8e4523e0ba8 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:59.139515 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-967757b3-e760-4c50-9c30-c8e4523e0ba8 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:59.140234 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-967757b3-e760-4c50-9c30-c8e4523e0ba8 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:59.158112 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-967757b3-e760-4c50-9c30-c8e4523e0ba8 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:59.159200 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f2a65bd4-6da5-493b-92bb-bdb65acc073a tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89f12d146749b38c688b7581e53f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247c7ae3e4e4068a88a044e36945f32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:59.161962 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-967757b3-e760-4c50-9c30-c8e4523e0ba8 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:59.168126 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-967757b3-e760-4c50-9c30-c8e4523e0ba8 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:59.174814 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f2a65bd4-6da5-493b-92bb-bdb65acc073a tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] 10.222.0.20 "GET /compute/v2.1/servers/5e154d65-5086-47c1-bba7-ea3dfd53f6e6" status: 200 len: 1305 microversion: 2.1 time: 0.402506 Oct 04 18:30:59.192761 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 368/736] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:58 2022] GET /compute/v2.1/servers/5e154d65-5086-47c1-bba7-ea3dfd53f6e6 => generated 1305 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:59.202957 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-379dc84c-0920-47be-8a51-58c2b005df66 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1189564894", "metadata": {"": ""}}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:59.238017 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-379dc84c-0920-47be-8a51-58c2b005df66 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Request method failure captured: Oct 04 18:30:59.238017 n-d-850501-14 devstack@n-api.service[123002]: request: POST /compute/v2.1/servers/c1bf585c-9cc9-4f87-966c-e02882aa51fd/action HTTP/1.1 Oct 04 18:30:59.238017 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:30:59.238017 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:30:59.238017 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:30:59.238017 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 107 Oct 04 18:30:59.238017 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:30:59.238017 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:30:59.238017 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:30:59.238017 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:30:59.238017 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPHvII_T7EcjvuInFv4t5qVF70S9vjGBK66HvfyVnOiY_TVbsAPYjguHISQjMiOeT1bz8CjLq7zDrG77IXy0kQULYEqIfKm3jlSWTKPDcogOtbqbQpds3d11ZgBfbFr39fSjqioDU_0CmuRBwgkz6wZ-Zh6uUaL8av5rXkIBhSk0fN1E Oct 04 18:30:59.238017 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:30:59.238017 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:30:59.238017 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:30:59.238017 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:30:59.238017 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:30:59.238017 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:30:59.238017 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 7e44e7aa06ee4126b5705ba65145ebcc Oct 04 18:30:59.238017 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1566997612 Oct 04 18:30:59.238017 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:30:59.238017 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:30:59.239692 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e44e7aa06ee4126b5705ba65145ebcc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7e44e7aa06ee4126b5705ba65145ebcc", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7e44e7aa06ee4126b5705ba65145ebcc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e44e7aa06ee4126b5705ba65145ebcc"}]}] Oct 04 18:30:59.239692 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1566997612 Oct 04 18:30:59.239692 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 7e44e7aa06ee4126b5705ba65145ebcc Oct 04 18:30:59.239692 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1566997612 Oct 04 18:30:59.239692 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ImagesOneServerNegativeTestJSON-1566997612-project Oct 04 18:30:59.239692 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:30:59.239692 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:30:59.239692 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 415f49a275284a7eb714a55c6bdd0005 Oct 04 18:30:59.239692 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1566997612-project Oct 04 18:30:59.239692 n-d-850501-14 devstack@n-api.service[123002]: Oct 04 18:30:59.239692 n-d-850501-14 devstack@n-api.service[123002]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1189564894", "metadata": {"": ""}}} Oct 04 18:30:59.239692 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:30:59.240515 n-d-850501-14 devstack@n-api.service[123002]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:30:59.240515 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'c1bf585c-9cc9-4f87-966c-e02882aa51fd', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1189564894', 'metadata': {'': ''}}}} Oct 04 18:30:59.240515 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:30:59.240515 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:59.240515 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:30:59.240515 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:30:59.240515 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:30:59.240515 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:30:59.240515 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:30:59.240515 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:30:59.240515 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 04 18:30:59.240515 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 04 18:30:59.240515 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 04 18:30:59.240515 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 04 18:30:59.240515 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 04 18:30:59.240515 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:30:59.240515 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 04 18:30:59.240515 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi {'': ''} Oct 04 18:30:59.240515 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:30:59.240515 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:59.240515 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:30:59.241938 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:59.241938 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:59.241938 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:59.241938 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:30:59.241938 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:30:59.241938 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:30:59.241938 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:30:59.241938 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:30:59.241938 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:30:59.241938 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:30:59.241938 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:30:59.241938 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:30:59.241938 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:30:59.241938 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:30:59.241938 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:30:59.241938 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:30:59.241938 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:30:59.241938 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:59.241938 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:30:59.241938 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:59.243708 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:59.243708 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:59.243708 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:30:59.243708 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:30:59.243708 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:30:59.243708 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:30:59.250940 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-379dc84c-0920-47be-8a51-58c2b005df66 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:30:59.252337 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-379dc84c-0920-47be-8a51-58c2b005df66 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] 10.222.0.20 "POST /compute/v2.1/servers/c1bf585c-9cc9-4f87-966c-e02882aa51fd/action" status: 400 len: 170 microversion: 2.1 time: 0.058437 Oct 04 18:30:59.253109 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 369/737] 10.222.0.20 () {60 vars in 1279 bytes} [Tue Oct 4 18:30:59 2022] POST /compute/v2.1/servers/c1bf585c-9cc9-4f87-966c-e02882aa51fd/action => generated 170 bytes in 60 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:30:59.275331 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-55fce908-12d9-458d-8b21-6a87572599bb tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:59.277273 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-55fce908-12d9-458d-8b21-6a87572599bb tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] [instance: 836f71c5-d859-4d09-9956-922b0bbee3ae] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:59.295385 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-967757b3-e760-4c50-9c30-c8e4523e0ba8 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.171009 Oct 04 18:30:59.301073 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-55fce908-12d9-458d-8b21-6a87572599bb tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:59.302592 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-55fce908-12d9-458d-8b21-6a87572599bb tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:59.306143 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-55fce908-12d9-458d-8b21-6a87572599bb tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:59.307417 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-55fce908-12d9-458d-8b21-6a87572599bb tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:59.307644 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 369/738] 10.222.0.20 () {58 vars in 1176 bytes} [Tue Oct 4 18:30:59 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:30:59.311121 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-55fce908-12d9-458d-8b21-6a87572599bb tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:59.311765 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-55fce908-12d9-458d-8b21-6a87572599bb tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:59.320271 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1d277494-c719-41a6-a08b-f3810398dadf tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:59.321863 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1d277494-c719-41a6-a08b-f3810398dadf tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: 47fc818f-4a40-42b8-9698-0fdbed7631d6] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:59.487957 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1d277494-c719-41a6-a08b-f3810398dadf tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:59.500735 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1d277494-c719-41a6-a08b-f3810398dadf tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/47fc818f-4a40-42b8-9698-0fdbed7631d6" status: 200 len: 1216 microversion: 2.1 time: 0.191446 Oct 04 18:30:59.528183 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 370/739] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:59 2022] GET /compute/v2.1/servers/47fc818f-4a40-42b8-9698-0fdbed7631d6 => generated 1216 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:59.536145 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-0aab9ee2-b211-48ec-bedb-d79b1823f2e5 req-58c22b96-f335-4747-bcb1-f857d3d080d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "836f71c5-d859-4d09-9956-922b0bbee3ae", "name": "network-vif-plugged", "status": "completed", "tag": "0a037711-4826-46fe-ab3b-3321a329f5e9"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:59.557238 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-0aab9ee2-b211-48ec-bedb-d79b1823f2e5 req-58c22b96-f335-4747-bcb1-f857d3d080d2 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:59.557946 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-0aab9ee2-b211-48ec-bedb-d79b1823f2e5 req-58c22b96-f335-4747-bcb1-f857d3d080d2 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:59.558644 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-0aab9ee2-b211-48ec-bedb-d79b1823f2e5 req-58c22b96-f335-4747-bcb1-f857d3d080d2 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:59.577420 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-0aab9ee2-b211-48ec-bedb-d79b1823f2e5 req-58c22b96-f335-4747-bcb1-f857d3d080d2 service nova] Creating event network-vif-plugged:0a037711-4826-46fe-ab3b-3321a329f5e9 for instance 836f71c5-d859-4d09-9956-922b0bbee3ae on n-h1-850501-14 Oct 04 18:30:59.590014 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-0aab9ee2-b211-48ec-bedb-d79b1823f2e5 req-58c22b96-f335-4747-bcb1-f857d3d080d2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058738 Oct 04 18:30:59.591663 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 371/740] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:30:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:30:59.601101 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f903d526-7e7a-49db-bb48-d30ebe95eaf7 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:59.602281 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f903d526-7e7a-49db-bb48-d30ebe95eaf7 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: 609c8bd3-a9fc-4b16-ba22-c87aa44a822d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:59.609629 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f903d526-7e7a-49db-bb48-d30ebe95eaf7 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:59.610272 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f903d526-7e7a-49db-bb48-d30ebe95eaf7 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:59.610886 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f903d526-7e7a-49db-bb48-d30ebe95eaf7 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:59.611842 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f903d526-7e7a-49db-bb48-d30ebe95eaf7 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:59.612492 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f903d526-7e7a-49db-bb48-d30ebe95eaf7 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:59.614087 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f903d526-7e7a-49db-bb48-d30ebe95eaf7 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:59.655508 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-55fce908-12d9-458d-8b21-6a87572599bb tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d326c048306423a87ddef70295a75e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1cc290c58149f8988cc3d69aff9efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:59.671050 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-55fce908-12d9-458d-8b21-6a87572599bb tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] 10.222.0.20 "GET /compute/v2.1/servers/836f71c5-d859-4d09-9956-922b0bbee3ae" status: 200 len: 1316 microversion: 2.1 time: 0.408764 Oct 04 18:30:59.674598 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 370/741] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:59 2022] GET /compute/v2.1/servers/836f71c5-d859-4d09-9956-922b0bbee3ae => generated 1316 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:59.692250 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9a8e9cdf-62e1-481c-9bcd-4ab1def7dff3 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:59.711413 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9a8e9cdf-62e1-481c-9bcd-4ab1def7dff3 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] [instance: c1bf585c-9cc9-4f87-966c-e02882aa51fd] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:59.732027 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9a8e9cdf-62e1-481c-9bcd-4ab1def7dff3 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:59.736467 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9a8e9cdf-62e1-481c-9bcd-4ab1def7dff3 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:59.737061 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9a8e9cdf-62e1-481c-9bcd-4ab1def7dff3 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:59.738073 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9a8e9cdf-62e1-481c-9bcd-4ab1def7dff3 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:59.738835 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9a8e9cdf-62e1-481c-9bcd-4ab1def7dff3 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:59.746916 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9a8e9cdf-62e1-481c-9bcd-4ab1def7dff3 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:00.143782 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9a8e9cdf-62e1-481c-9bcd-4ab1def7dff3 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f49a275284a7eb714a55c6bdd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e44e7aa06ee4126b5705ba65145ebcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:00.180368 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9a8e9cdf-62e1-481c-9bcd-4ab1def7dff3 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] 10.222.0.20 "GET /compute/v2.1/servers/c1bf585c-9cc9-4f87-966c-e02882aa51fd" status: 200 len: 1521 microversion: 2.1 time: 0.504259 Oct 04 18:31:00.181985 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 371/742] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:59 2022] GET /compute/v2.1/servers/c1bf585c-9cc9-4f87-966c-e02882aa51fd => generated 1521 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:00.192975 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7aaeaac7-b52f-4d1e-a951-75f74d5c48d0 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-850501-14", "block_migration": true, "disk_over_commit": false}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:00.198887 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7aaeaac7-b52f-4d1e-a951-75f74d5c48d0 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] [instance: 89738dfe-3844-455a-93d1-d38702038946] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:00.221737 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7aaeaac7-b52f-4d1e-a951-75f74d5c48d0 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:00.222265 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7aaeaac7-b52f-4d1e-a951-75f74d5c48d0 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:00.223022 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7aaeaac7-b52f-4d1e-a951-75f74d5c48d0 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:00.223903 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7aaeaac7-b52f-4d1e-a951-75f74d5c48d0 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:00.224559 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7aaeaac7-b52f-4d1e-a951-75f74d5c48d0 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:00.225826 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7aaeaac7-b52f-4d1e-a951-75f74d5c48d0 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:00.408730 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-7aaeaac7-b52f-4d1e-a951-75f74d5c48d0 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lazy-loading 'flavor' on Instance uuid 89738dfe-3844-455a-93d1-d38702038946 {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:31:00.430407 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7aaeaac7-b52f-4d1e-a951-75f74d5c48d0 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] [instance: 89738dfe-3844-455a-93d1-d38702038946] Going to try to live migrate instance to n-h2-850501-14 {{(pid=123002) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 18:31:00.525259 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f903d526-7e7a-49db-bb48-d30ebe95eaf7 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:00.568664 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f903d526-7e7a-49db-bb48-d30ebe95eaf7 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:00.573058 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f903d526-7e7a-49db-bb48-d30ebe95eaf7 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:00.574546 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f903d526-7e7a-49db-bb48-d30ebe95eaf7 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/609c8bd3-a9fc-4b16-ba22-c87aa44a822d" status: 200 len: 1568 microversion: 2.25 time: 0.980440 Oct 04 18:31:00.579139 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 372/743] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:30:59 2022] GET /compute/v2.1/servers/609c8bd3-a9fc-4b16-ba22-c87aa44a822d => generated 1568 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:31:00.599848 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-54032467-28e5-43a0-87af-9f8c69e24169 req-f906a463-ded8-4fd5-9a00-cdd3791dc1ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e154d65-5086-47c1-bba7-ea3dfd53f6e6", "tag": "1eb398e0-da63-4b45-bace-cc05ff4d0f6f"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:00.635695 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-54032467-28e5-43a0-87af-9f8c69e24169 req-f906a463-ded8-4fd5-9a00-cdd3791dc1ad service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:00.636649 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-54032467-28e5-43a0-87af-9f8c69e24169 req-f906a463-ded8-4fd5-9a00-cdd3791dc1ad service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:00.638191 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-54032467-28e5-43a0-87af-9f8c69e24169 req-f906a463-ded8-4fd5-9a00-cdd3791dc1ad service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:00.658639 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-54032467-28e5-43a0-87af-9f8c69e24169 req-f906a463-ded8-4fd5-9a00-cdd3791dc1ad service nova] Creating event network-changed:1eb398e0-da63-4b45-bace-cc05ff4d0f6f for instance 5e154d65-5086-47c1-bba7-ea3dfd53f6e6 on n-h2-850501-14 Oct 04 18:31:00.667053 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-54032467-28e5-43a0-87af-9f8c69e24169 req-f906a463-ded8-4fd5-9a00-cdd3791dc1ad service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086102 Oct 04 18:31:00.668363 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 373/744] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:31:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:00.681319 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ddf3f2ee-0770-489e-bea4-64fe479de664 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:00.682108 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ddf3f2ee-0770-489e-bea4-64fe479de664 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] [instance: 5e154d65-5086-47c1-bba7-ea3dfd53f6e6] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:00.691088 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ddf3f2ee-0770-489e-bea4-64fe479de664 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:00.691769 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ddf3f2ee-0770-489e-bea4-64fe479de664 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:00.702396 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ddf3f2ee-0770-489e-bea4-64fe479de664 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:00.710881 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ddf3f2ee-0770-489e-bea4-64fe479de664 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:00.711600 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ddf3f2ee-0770-489e-bea4-64fe479de664 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:00.712578 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ddf3f2ee-0770-489e-bea4-64fe479de664 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:00.964286 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ddf3f2ee-0770-489e-bea4-64fe479de664 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89f12d146749b38c688b7581e53f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247c7ae3e4e4068a88a044e36945f32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:00.981171 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ddf3f2ee-0770-489e-bea4-64fe479de664 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] 10.222.0.20 "GET /compute/v2.1/servers/5e154d65-5086-47c1-bba7-ea3dfd53f6e6" status: 200 len: 1305 microversion: 2.1 time: 0.306941 Oct 04 18:31:00.983705 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 374/745] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:00 2022] GET /compute/v2.1/servers/5e154d65-5086-47c1-bba7-ea3dfd53f6e6 => generated 1305 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:00.991214 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7e3cd066-a398-4850-b96c-59b5150d4bd2 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:00.994514 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7e3cd066-a398-4850-b96c-59b5150d4bd2 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] [instance: c1bf585c-9cc9-4f87-966c-e02882aa51fd] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:01.015354 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7e3cd066-a398-4850-b96c-59b5150d4bd2 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:01.019487 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7e3cd066-a398-4850-b96c-59b5150d4bd2 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:01.020441 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7e3cd066-a398-4850-b96c-59b5150d4bd2 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:01.028506 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7e3cd066-a398-4850-b96c-59b5150d4bd2 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:01.029325 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7e3cd066-a398-4850-b96c-59b5150d4bd2 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:01.030240 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7e3cd066-a398-4850-b96c-59b5150d4bd2 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:01.696947 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7e3cd066-a398-4850-b96c-59b5150d4bd2 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f49a275284a7eb714a55c6bdd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e44e7aa06ee4126b5705ba65145ebcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:01.710823 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7e3cd066-a398-4850-b96c-59b5150d4bd2 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] 10.222.0.20 "GET /compute/v2.1/servers/c1bf585c-9cc9-4f87-966c-e02882aa51fd" status: 200 len: 1521 microversion: 2.1 time: 0.723329 Oct 04 18:31:01.714347 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 375/746] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:00 2022] GET /compute/v2.1/servers/c1bf585c-9cc9-4f87-966c-e02882aa51fd => generated 1521 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:01.723818 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-249f4f64-f9ac-477c-b36e-054807710709 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:01.730434 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-249f4f64-f9ac-477c-b36e-054807710709 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: 47fc818f-4a40-42b8-9698-0fdbed7631d6] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:01.743783 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-249f4f64-f9ac-477c-b36e-054807710709 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:01.744436 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-249f4f64-f9ac-477c-b36e-054807710709 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:01.744958 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-249f4f64-f9ac-477c-b36e-054807710709 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:01.747125 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-249f4f64-f9ac-477c-b36e-054807710709 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:01.747704 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-249f4f64-f9ac-477c-b36e-054807710709 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:01.748319 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-249f4f64-f9ac-477c-b36e-054807710709 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:01.891800 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-249f4f64-f9ac-477c-b36e-054807710709 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:01.906200 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-249f4f64-f9ac-477c-b36e-054807710709 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/47fc818f-4a40-42b8-9698-0fdbed7631d6" status: 200 len: 1268 microversion: 2.1 time: 0.190415 Oct 04 18:31:01.907044 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 376/747] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:01 2022] GET /compute/v2.1/servers/47fc818f-4a40-42b8-9698-0fdbed7631d6 => generated 1268 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:01.914737 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0f26ff36-36ed-415d-91b9-ecefcd017023 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:01.916280 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0f26ff36-36ed-415d-91b9-ecefcd017023 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] [instance: 836f71c5-d859-4d09-9956-922b0bbee3ae] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:01.925164 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0f26ff36-36ed-415d-91b9-ecefcd017023 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:01.926390 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0f26ff36-36ed-415d-91b9-ecefcd017023 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:01.927322 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0f26ff36-36ed-415d-91b9-ecefcd017023 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:01.928496 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0f26ff36-36ed-415d-91b9-ecefcd017023 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:01.929602 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0f26ff36-36ed-415d-91b9-ecefcd017023 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:01.930273 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0f26ff36-36ed-415d-91b9-ecefcd017023 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:02.146584 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0f26ff36-36ed-415d-91b9-ecefcd017023 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d326c048306423a87ddef70295a75e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1cc290c58149f8988cc3d69aff9efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:02.171802 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0f26ff36-36ed-415d-91b9-ecefcd017023 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] 10.222.0.20 "GET /compute/v2.1/servers/836f71c5-d859-4d09-9956-922b0bbee3ae" status: 200 len: 1466 microversion: 2.1 time: 0.263245 Oct 04 18:31:02.176198 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 377/748] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:01 2022] GET /compute/v2.1/servers/836f71c5-d859-4d09-9956-922b0bbee3ae => generated 1466 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:02.199352 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c784499b-b76a-42ee-a9a0-894a0b3861d3 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:02.200254 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c784499b-b76a-42ee-a9a0-894a0b3861d3 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: 609c8bd3-a9fc-4b16-ba22-c87aa44a822d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:02.208408 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c784499b-b76a-42ee-a9a0-894a0b3861d3 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:02.209042 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c784499b-b76a-42ee-a9a0-894a0b3861d3 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:02.210156 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c784499b-b76a-42ee-a9a0-894a0b3861d3 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:02.211323 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c784499b-b76a-42ee-a9a0-894a0b3861d3 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:02.212025 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c784499b-b76a-42ee-a9a0-894a0b3861d3 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:02.212850 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c784499b-b76a-42ee-a9a0-894a0b3861d3 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:02.479673 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c784499b-b76a-42ee-a9a0-894a0b3861d3 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:02.502010 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c784499b-b76a-42ee-a9a0-894a0b3861d3 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:02.502641 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c784499b-b76a-42ee-a9a0-894a0b3861d3 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:02.507200 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c784499b-b76a-42ee-a9a0-894a0b3861d3 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/609c8bd3-a9fc-4b16-ba22-c87aa44a822d" status: 200 len: 1568 microversion: 2.25 time: 0.328498 Oct 04 18:31:02.508036 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 378/749] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:31:02 2022] GET /compute/v2.1/servers/609c8bd3-a9fc-4b16-ba22-c87aa44a822d => generated 1568 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:31:02.523223 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-dc3d877e-6e28-4a49-ad3b-5f7c59899f29 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-349138124", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:02.534924 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-dc3d877e-6e28-4a49-ad3b-5f7c59899f29 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Request method failure captured: Oct 04 18:31:02.534924 n-d-850501-14 devstack@n-api.service[123001]: request: POST /compute/v2.1/servers/c1bf585c-9cc9-4f87-966c-e02882aa51fd/action HTTP/1.1 Oct 04 18:31:02.534924 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:31:02.534924 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:31:02.534924 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:31:02.534924 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 618 Oct 04 18:31:02.534924 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:31:02.534924 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:31:02.534924 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:31:02.534924 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:31:02.534924 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPHvII_T7EcjvuInFv4t5qVF70S9vjGBK66HvfyVnOiY_TVbsAPYjguHISQjMiOeT1bz8CjLq7zDrG77IXy0kQULYEqIfKm3jlSWTKPDcogOtbqbQpds3d11ZgBfbFr39fSjqioDU_0CmuRBwgkz6wZ-Zh6uUaL8av5rXkIBhSk0fN1E Oct 04 18:31:02.534924 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:31:02.534924 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:31:02.534924 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:31:02.534924 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:31:02.534924 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:31:02.534924 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:31:02.534924 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 7e44e7aa06ee4126b5705ba65145ebcc Oct 04 18:31:02.534924 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1566997612 Oct 04 18:31:02.534924 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:31:02.534924 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:31:02.536572 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e44e7aa06ee4126b5705ba65145ebcc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7e44e7aa06ee4126b5705ba65145ebcc", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7e44e7aa06ee4126b5705ba65145ebcc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e44e7aa06ee4126b5705ba65145ebcc"}]}] Oct 04 18:31:02.536572 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1566997612 Oct 04 18:31:02.536572 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 7e44e7aa06ee4126b5705ba65145ebcc Oct 04 18:31:02.536572 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1566997612 Oct 04 18:31:02.536572 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ImagesOneServerNegativeTestJSON-1566997612-project Oct 04 18:31:02.536572 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:31:02.536572 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:31:02.536572 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 415f49a275284a7eb714a55c6bdd0005 Oct 04 18:31:02.536572 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1566997612-project Oct 04 18:31:02.536572 n-d-850501-14 devstack@n-api.service[123001]: Oct 04 18:31:02.541049 n-d-850501-14 devstack@n-api.service[123001]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-349138124", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Oct 04 18:31:02.541049 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:31:02.541049 n-d-850501-14 devstack@n-api.service[123001]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:31:02.541964 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': 'c1bf585c-9cc9-4f87-966c-e02882aa51fd', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-349138124', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Oct 04 18:31:02.541964 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:31:02.541964 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:02.541964 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:31:02.541964 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:31:02.541964 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:31:02.541964 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:31:02.541964 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:31:02.541964 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:31:02.541964 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 04 18:31:02.541964 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 04 18:31:02.543086 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 04 18:31:02.543086 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 04 18:31:02.543086 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 04 18:31:02.543086 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:31:02.543086 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 04 18:31:02.543086 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Oct 04 18:31:02.543086 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:31:02.543086 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:31:02.543086 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:31:02.543086 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:02.543086 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:31:02.543086 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:31:02.543086 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:31:02.543086 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:31:02.543086 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:31:02.543086 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:31:02.543086 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:31:02.545243 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:31:02.545243 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:31:02.545243 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:31:02.545243 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:31:02.545243 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:31:02.545243 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:31:02.545243 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:31:02.545243 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:31:02.545243 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:31:02.545243 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:31:02.545243 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:31:02.545243 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:02.546740 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:31:02.546740 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:31:02.546740 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:31:02.546740 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:31:02.546740 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:31:02.546740 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:31:02.547463 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-dc3d877e-6e28-4a49-ad3b-5f7c59899f29 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:31:02.547463 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-dc3d877e-6e28-4a49-ad3b-5f7c59899f29 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] 10.222.0.20 "POST /compute/v2.1/servers/c1bf585c-9cc9-4f87-966c-e02882aa51fd/action" status: 400 len: 938 microversion: 2.1 time: 0.027241 Oct 04 18:31:02.547463 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 379/750] 10.222.0.20 () {60 vars in 1279 bytes} [Tue Oct 4 18:31:02 2022] POST /compute/v2.1/servers/c1bf585c-9cc9-4f87-966c-e02882aa51fd/action => generated 938 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:31:02.558009 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5b0a4658-176c-4db1-9727-dbb6a2e523b0 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:02.558756 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5b0a4658-176c-4db1-9727-dbb6a2e523b0 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] [instance: 5e154d65-5086-47c1-bba7-ea3dfd53f6e6] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:02.588165 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5b0a4658-176c-4db1-9727-dbb6a2e523b0 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:02.588693 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5b0a4658-176c-4db1-9727-dbb6a2e523b0 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:02.589142 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5b0a4658-176c-4db1-9727-dbb6a2e523b0 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:02.589879 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5b0a4658-176c-4db1-9727-dbb6a2e523b0 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:02.592691 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5b0a4658-176c-4db1-9727-dbb6a2e523b0 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:02.593132 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5b0a4658-176c-4db1-9727-dbb6a2e523b0 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:02.837945 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5b0a4658-176c-4db1-9727-dbb6a2e523b0 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89f12d146749b38c688b7581e53f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247c7ae3e4e4068a88a044e36945f32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:02.847732 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5b0a4658-176c-4db1-9727-dbb6a2e523b0 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] 10.222.0.20 "GET /compute/v2.1/servers/5e154d65-5086-47c1-bba7-ea3dfd53f6e6" status: 200 len: 1305 microversion: 2.1 time: 0.301211 Oct 04 18:31:02.859248 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 380/751] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:02 2022] GET /compute/v2.1/servers/5e154d65-5086-47c1-bba7-ea3dfd53f6e6 => generated 1305 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:02.865713 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b238e385-a731-45d3-897d-f17ac5566efb tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-949934440", "metadata": {"image_type": "test"}}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:02.869476 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b238e385-a731-45d3-897d-f17ac5566efb tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] [instance: 836f71c5-d859-4d09-9956-922b0bbee3ae] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:02.888425 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b238e385-a731-45d3-897d-f17ac5566efb tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:02.889153 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b238e385-a731-45d3-897d-f17ac5566efb tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:02.889616 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b238e385-a731-45d3-897d-f17ac5566efb tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:02.891110 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b238e385-a731-45d3-897d-f17ac5566efb tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:02.891637 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b238e385-a731-45d3-897d-f17ac5566efb tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:02.892036 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b238e385-a731-45d3-897d-f17ac5566efb tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:02.964757 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-b238e385-a731-45d3-897d-f17ac5566efb tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Getting quotas for project 5a1cc290c58149f8988cc3d69aff9efd. Resources: dict_keys(['metadata_items']) {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:31:02.971422 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-b238e385-a731-45d3-897d-f17ac5566efb tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Getting quotas for user 1d326c048306423a87ddef70295a75e0 and project 5a1cc290c58149f8988cc3d69aff9efd. Resources: dict_keys(['metadata_items']) {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:31:03.580936 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b238e385-a731-45d3-897d-f17ac5566efb tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] 10.222.0.20 "POST /compute/v2.1/servers/836f71c5-d859-4d09-9956-922b0bbee3ae/action" status: 202 len: 0 microversion: 2.1 time: 0.727808 Oct 04 18:31:03.581963 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 381/752] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:31:02 2022] POST /compute/v2.1/servers/836f71c5-d859-4d09-9956-922b0bbee3ae/action => generated 0 bytes in 730 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 18:31:03.677414 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-04707bbf-2688-4e3c-bc9d-22c6e98cdd09 tempest-FloatingIPDetailsTestJSON-989363590 tempest-FloatingIPDetailsTestJSON-989363590-project] Action: 'create', calling method: .version_select at 0x7fe25914dd30>, body: {"pool": null} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:04.056435 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7aaeaac7-b52f-4d1e-a951-75f74d5c48d0 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946/action" status: 202 len: 0 microversion: 2.1 time: 3.872623 Oct 04 18:31:04.057590 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 372/753] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:31:00 2022] POST /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946/action => generated 0 bytes in 3875 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:31:04.063891 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e00eee67-4f26-4a19-9b3b-5851c7afdefd tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:04.067409 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e00eee67-4f26-4a19-9b3b-5851c7afdefd tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] [instance: c1bf585c-9cc9-4f87-966c-e02882aa51fd] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:04.093164 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e00eee67-4f26-4a19-9b3b-5851c7afdefd tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:04.093854 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e00eee67-4f26-4a19-9b3b-5851c7afdefd tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:04.094312 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e00eee67-4f26-4a19-9b3b-5851c7afdefd tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:04.097409 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e00eee67-4f26-4a19-9b3b-5851c7afdefd tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:04.097928 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e00eee67-4f26-4a19-9b3b-5851c7afdefd tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:04.099321 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e00eee67-4f26-4a19-9b3b-5851c7afdefd tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:04.714652 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e00eee67-4f26-4a19-9b3b-5851c7afdefd tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f49a275284a7eb714a55c6bdd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e44e7aa06ee4126b5705ba65145ebcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:04.714652 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e00eee67-4f26-4a19-9b3b-5851c7afdefd tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] 10.222.0.20 "GET /compute/v2.1/servers/c1bf585c-9cc9-4f87-966c-e02882aa51fd" status: 200 len: 1521 microversion: 2.1 time: 0.460407 Oct 04 18:31:04.714652 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 373/754] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:04 2022] GET /compute/v2.1/servers/c1bf585c-9cc9-4f87-966c-e02882aa51fd => generated 1521 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:04.715084 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-ec268b50-eff7-4e5b-9628-a9a22b0b9dba req-ac701d63-d087-415b-8fad-6330f0fa242b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "609c8bd3-a9fc-4b16-ba22-c87aa44a822d", "name": "network-vif-unplugged", "status": "completed", "tag": "5cd956ff-e097-4445-a4d4-66c2548f3dc6"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:04.715084 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-ec268b50-eff7-4e5b-9628-a9a22b0b9dba req-ac701d63-d087-415b-8fad-6330f0fa242b service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:04.715084 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-ec268b50-eff7-4e5b-9628-a9a22b0b9dba req-ac701d63-d087-415b-8fad-6330f0fa242b service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:04.715084 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-ec268b50-eff7-4e5b-9628-a9a22b0b9dba req-ac701d63-d087-415b-8fad-6330f0fa242b service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:04.715955 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-ec268b50-eff7-4e5b-9628-a9a22b0b9dba req-ac701d63-d087-415b-8fad-6330f0fa242b service nova] Creating event network-vif-unplugged:5cd956ff-e097-4445-a4d4-66c2548f3dc6 for instance 609c8bd3-a9fc-4b16-ba22-c87aa44a822d on n-h1-850501-14 Oct 04 18:31:04.715955 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-ec268b50-eff7-4e5b-9628-a9a22b0b9dba req-ac701d63-d087-415b-8fad-6330f0fa242b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035370 Oct 04 18:31:04.715955 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 374/755] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:31:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:04.715955 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-17bbeef3-f15e-4172-8fc9-104721bc0c28 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:04.715955 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-17bbeef3-f15e-4172-8fc9-104721bc0c28 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: 47fc818f-4a40-42b8-9698-0fdbed7631d6] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:04.716975 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-17bbeef3-f15e-4172-8fc9-104721bc0c28 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:04.716975 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-17bbeef3-f15e-4172-8fc9-104721bc0c28 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:04.716975 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-17bbeef3-f15e-4172-8fc9-104721bc0c28 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:04.716975 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-17bbeef3-f15e-4172-8fc9-104721bc0c28 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:04.717362 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-17bbeef3-f15e-4172-8fc9-104721bc0c28 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:04.717362 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-17bbeef3-f15e-4172-8fc9-104721bc0c28 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:04.898328 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-17bbeef3-f15e-4172-8fc9-104721bc0c28 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:04.917770 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-17bbeef3-f15e-4172-8fc9-104721bc0c28 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/47fc818f-4a40-42b8-9698-0fdbed7631d6" status: 200 len: 1316 microversion: 2.1 time: 0.358634 Oct 04 18:31:04.924664 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 375/756] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:04 2022] GET /compute/v2.1/servers/47fc818f-4a40-42b8-9698-0fdbed7631d6 => generated 1316 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:04.933045 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d30ad2ee-97fe-4638-892a-0391d890cb25 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:04.937395 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d30ad2ee-97fe-4638-892a-0391d890cb25 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: 609c8bd3-a9fc-4b16-ba22-c87aa44a822d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:04.953133 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d30ad2ee-97fe-4638-892a-0391d890cb25 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:04.953925 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d30ad2ee-97fe-4638-892a-0391d890cb25 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:04.954767 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d30ad2ee-97fe-4638-892a-0391d890cb25 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:04.955882 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d30ad2ee-97fe-4638-892a-0391d890cb25 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:04.956947 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d30ad2ee-97fe-4638-892a-0391d890cb25 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:04.957578 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d30ad2ee-97fe-4638-892a-0391d890cb25 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:05.222223 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d30ad2ee-97fe-4638-892a-0391d890cb25 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:05.232676 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d30ad2ee-97fe-4638-892a-0391d890cb25 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:05.246520 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d30ad2ee-97fe-4638-892a-0391d890cb25 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:05.247890 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d30ad2ee-97fe-4638-892a-0391d890cb25 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/609c8bd3-a9fc-4b16-ba22-c87aa44a822d" status: 200 len: 1568 microversion: 2.25 time: 0.321945 Oct 04 18:31:05.249199 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 376/757] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:31:04 2022] GET /compute/v2.1/servers/609c8bd3-a9fc-4b16-ba22-c87aa44a822d => generated 1568 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:31:05.254422 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-05ba60f9-6a66-4f9a-9388-87e4a58405a2 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Calling method '.version_select at 0x7fe259359f70>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:05.321302 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-05ba60f9-6a66-4f9a-9388-87e4a58405a2 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] 10.222.0.20 "GET /compute/v2.1/images/7c06454e-f4ee-4402-8078-68104b52d35a" status: 200 len: 1423 microversion: 2.1 time: 0.070787 Oct 04 18:31:05.331414 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 377/758] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:31:05 2022] GET /compute/v2.1/images/7c06454e-f4ee-4402-8078-68104b52d35a => generated 1423 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:05.339834 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9f7ba6ec-bfb2-4d57-9744-0445ea1afda0 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:05.340735 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9f7ba6ec-bfb2-4d57-9744-0445ea1afda0 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] [instance: 5e154d65-5086-47c1-bba7-ea3dfd53f6e6] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:05.347436 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9f7ba6ec-bfb2-4d57-9744-0445ea1afda0 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:05.347932 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9f7ba6ec-bfb2-4d57-9744-0445ea1afda0 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:05.348467 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9f7ba6ec-bfb2-4d57-9744-0445ea1afda0 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:05.349168 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9f7ba6ec-bfb2-4d57-9744-0445ea1afda0 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:05.350352 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9f7ba6ec-bfb2-4d57-9744-0445ea1afda0 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:05.350895 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9f7ba6ec-bfb2-4d57-9744-0445ea1afda0 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:05.627823 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9f7ba6ec-bfb2-4d57-9744-0445ea1afda0 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89f12d146749b38c688b7581e53f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247c7ae3e4e4068a88a044e36945f32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:05.638038 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9f7ba6ec-bfb2-4d57-9744-0445ea1afda0 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] 10.222.0.20 "GET /compute/v2.1/servers/5e154d65-5086-47c1-bba7-ea3dfd53f6e6" status: 200 len: 1305 microversion: 2.1 time: 0.308743 Oct 04 18:31:05.638894 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 378/759] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:05 2022] GET /compute/v2.1/servers/5e154d65-5086-47c1-bba7-ea3dfd53f6e6 => generated 1305 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:05.645430 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-af113b9c-17fe-450d-aba4-46950c0eb1a5 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:05.646047 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-af113b9c-17fe-450d-aba4-46950c0eb1a5 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 89738dfe-3844-455a-93d1-d38702038946] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:05.652833 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-af113b9c-17fe-450d-aba4-46950c0eb1a5 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:05.653965 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-af113b9c-17fe-450d-aba4-46950c0eb1a5 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:05.654443 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-af113b9c-17fe-450d-aba4-46950c0eb1a5 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:05.655203 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-af113b9c-17fe-450d-aba4-46950c0eb1a5 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:05.655830 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-af113b9c-17fe-450d-aba4-46950c0eb1a5 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:05.656293 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-af113b9c-17fe-450d-aba4-46950c0eb1a5 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:05.945207 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-af113b9c-17fe-450d-aba4-46950c0eb1a5 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:05.953930 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-af113b9c-17fe-450d-aba4-46950c0eb1a5 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946" status: 200 len: 1504 microversion: 2.1 time: 0.313568 Oct 04 18:31:05.954952 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 379/760] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:05 2022] GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946 => generated 1504 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:05.960760 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-97546050-6068-4400-9d42-f3163efb2f46 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:05.961392 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-97546050-6068-4400-9d42-f3163efb2f46 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] [instance: c1bf585c-9cc9-4f87-966c-e02882aa51fd] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:05.967509 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-97546050-6068-4400-9d42-f3163efb2f46 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:05.967999 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-97546050-6068-4400-9d42-f3163efb2f46 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:05.968454 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-97546050-6068-4400-9d42-f3163efb2f46 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:05.969363 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-97546050-6068-4400-9d42-f3163efb2f46 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:05.969816 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-97546050-6068-4400-9d42-f3163efb2f46 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:05.970236 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-97546050-6068-4400-9d42-f3163efb2f46 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:06.219394 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-97546050-6068-4400-9d42-f3163efb2f46 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f49a275284a7eb714a55c6bdd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e44e7aa06ee4126b5705ba65145ebcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:06.221730 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:06.228625 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-97546050-6068-4400-9d42-f3163efb2f46 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] 10.222.0.20 "GET /compute/v2.1/servers/c1bf585c-9cc9-4f87-966c-e02882aa51fd" status: 200 len: 1521 microversion: 2.1 time: 0.272583 Oct 04 18:31:06.242250 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 380/761] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:05 2022] GET /compute/v2.1/servers/c1bf585c-9cc9-4f87-966c-e02882aa51fd => generated 1521 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:06.242250 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-873326a4-c07b-44f8-9fba-e9b4cecd099f tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:06.242250 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-873326a4-c07b-44f8-9fba-e9b4cecd099f tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: 47fc818f-4a40-42b8-9698-0fdbed7631d6] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:06.242250 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-873326a4-c07b-44f8-9fba-e9b4cecd099f tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:06.242963 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-873326a4-c07b-44f8-9fba-e9b4cecd099f tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:06.242963 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-873326a4-c07b-44f8-9fba-e9b4cecd099f tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:06.243313 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-873326a4-c07b-44f8-9fba-e9b4cecd099f tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:06.243953 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-873326a4-c07b-44f8-9fba-e9b4cecd099f tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:06.244688 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-873326a4-c07b-44f8-9fba-e9b4cecd099f tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:06.516302 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-873326a4-c07b-44f8-9fba-e9b4cecd099f tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:06.525071 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-04707bbf-2688-4e3c-bc9d-22c6e98cdd09 tempest-FloatingIPDetailsTestJSON-989363590 tempest-FloatingIPDetailsTestJSON-989363590-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.937417 Oct 04 18:31:06.528771 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-873326a4-c07b-44f8-9fba-e9b4cecd099f tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/47fc818f-4a40-42b8-9698-0fdbed7631d6" status: 200 len: 1316 microversion: 2.1 time: 0.298091 Oct 04 18:31:06.529794 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 382/762] 10.222.0.20 () {60 vars in 1170 bytes} [Tue Oct 4 18:31:03 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2943 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:06.530213 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 381/763] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:06 2022] GET /compute/v2.1/servers/47fc818f-4a40-42b8-9698-0fdbed7631d6 => generated 1316 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:06.534760 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-42c7368d-cfde-46b4-9427-978381428ed8 req-e25a6f62-cb32-4bc1-bd62-c61ba065aaff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47fc818f-4a40-42b8-9698-0fdbed7631d6", "tag": "d975cead-350a-43ad-9299-eb99afd70ae5"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:06.540009 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b299c24c-f2c5-44fe-9b84-658c850d900a tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:06.546721 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b299c24c-f2c5-44fe-9b84-658c850d900a tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Request method failure captured: Oct 04 18:31:06.546721 n-d-850501-14 devstack@n-api.service[123002]: request: POST /compute/v2.1/servers/c1bf585c-9cc9-4f87-966c-e02882aa51fd/action HTTP/1.1 Oct 04 18:31:06.546721 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:31:06.546721 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:31:06.546721 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:31:06.546721 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 285 Oct 04 18:31:06.546721 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:31:06.546721 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:31:06.546721 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:31:06.546721 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:31:06.546721 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPHvII_T7EcjvuInFv4t5qVF70S9vjGBK66HvfyVnOiY_TVbsAPYjguHISQjMiOeT1bz8CjLq7zDrG77IXy0kQULYEqIfKm3jlSWTKPDcogOtbqbQpds3d11ZgBfbFr39fSjqioDU_0CmuRBwgkz6wZ-Zh6uUaL8av5rXkIBhSk0fN1E Oct 04 18:31:06.546721 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:31:06.546721 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:31:06.546721 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:31:06.546721 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:31:06.546721 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:31:06.546721 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:31:06.546721 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 7e44e7aa06ee4126b5705ba65145ebcc Oct 04 18:31:06.546721 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1566997612 Oct 04 18:31:06.546721 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:31:06.546721 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:31:06.548225 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e44e7aa06ee4126b5705ba65145ebcc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7e44e7aa06ee4126b5705ba65145ebcc", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7e44e7aa06ee4126b5705ba65145ebcc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e44e7aa06ee4126b5705ba65145ebcc"}]}] Oct 04 18:31:06.548225 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1566997612 Oct 04 18:31:06.548225 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 7e44e7aa06ee4126b5705ba65145ebcc Oct 04 18:31:06.548225 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1566997612 Oct 04 18:31:06.548225 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ImagesOneServerNegativeTestJSON-1566997612-project Oct 04 18:31:06.548225 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:31:06.548225 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:31:06.548225 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 415f49a275284a7eb714a55c6bdd0005 Oct 04 18:31:06.548225 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1566997612-project Oct 04 18:31:06.548225 n-d-850501-14 devstack@n-api.service[123002]: Oct 04 18:31:06.548225 n-d-850501-14 devstack@n-api.service[123002]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 04 18:31:06.549006 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:31:06.549006 n-d-850501-14 devstack@n-api.service[123002]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 18:31:06.549006 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'c1bf585c-9cc9-4f87-966c-e02882aa51fd', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 04 18:31:06.549006 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:31:06.549006 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:06.549006 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:31:06.549006 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:31:06.549006 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:31:06.549006 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:31:06.549006 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 18:31:06.549663 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:31:06.549663 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Oct 04 18:31:06.549663 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 18:31:06.549663 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:31:06.549663 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 04 18:31:06.549663 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 04 18:31:06.549663 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:31:06.549663 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:31:06.549663 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:31:06.549663 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:06.549663 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:31:06.549663 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:31:06.549663 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:31:06.549663 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:31:06.549663 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:31:06.549663 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:31:06.549663 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:31:06.549663 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:31:06.549663 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:31:06.549663 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:31:06.552359 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:31:06.552359 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:31:06.552359 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:31:06.552359 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:31:06.552359 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 18:31:06.552359 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:31:06.552359 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:31:06.552359 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:31:06.552359 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:06.552359 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:31:06.552359 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:31:06.552359 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:31:06.552359 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:31:06.555213 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 18:31:06.555213 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:31:06.555213 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b299c24c-f2c5-44fe-9b84-658c850d900a tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:31:06.555213 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b299c24c-f2c5-44fe-9b84-658c850d900a tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] 10.222.0.20 "POST /compute/v2.1/servers/c1bf585c-9cc9-4f87-966c-e02882aa51fd/action" status: 400 len: 619 microversion: 2.1 time: 0.021148 Oct 04 18:31:06.555739 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 382/764] 10.222.0.20 () {60 vars in 1279 bytes} [Tue Oct 4 18:31:06 2022] POST /compute/v2.1/servers/c1bf585c-9cc9-4f87-966c-e02882aa51fd/action => generated 619 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:31:06.567986 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-42c7368d-cfde-46b4-9427-978381428ed8 req-e25a6f62-cb32-4bc1-bd62-c61ba065aaff service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:06.571080 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-42c7368d-cfde-46b4-9427-978381428ed8 req-e25a6f62-cb32-4bc1-bd62-c61ba065aaff service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:06.571759 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-42c7368d-cfde-46b4-9427-978381428ed8 req-e25a6f62-cb32-4bc1-bd62-c61ba065aaff service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:06.572383 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-eb97d7c7-0836-48c9-975f-09784f8c9bf1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:06.573117 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-eb97d7c7-0836-48c9-975f-09784f8c9bf1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: 609c8bd3-a9fc-4b16-ba22-c87aa44a822d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:06.581560 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eb97d7c7-0836-48c9-975f-09784f8c9bf1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:06.582454 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eb97d7c7-0836-48c9-975f-09784f8c9bf1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:06.583163 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eb97d7c7-0836-48c9-975f-09784f8c9bf1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:06.584077 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eb97d7c7-0836-48c9-975f-09784f8c9bf1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:06.584624 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-42c7368d-cfde-46b4-9427-978381428ed8 req-e25a6f62-cb32-4bc1-bd62-c61ba065aaff service nova] Creating event network-changed:d975cead-350a-43ad-9299-eb99afd70ae5 for instance 47fc818f-4a40-42b8-9698-0fdbed7631d6 on n-h2-850501-14 Oct 04 18:31:06.585974 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eb97d7c7-0836-48c9-975f-09784f8c9bf1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:06.585974 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eb97d7c7-0836-48c9-975f-09784f8c9bf1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:06.594988 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-42c7368d-cfde-46b4-9427-978381428ed8 req-e25a6f62-cb32-4bc1-bd62-c61ba065aaff service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063896 Oct 04 18:31:06.595600 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 383/765] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:31:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:06.608893 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b476facc-bb34-42e3-96a9-9d67d877f59d tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Calling method '.version_select at 0x7fe2591460d0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:06.690213 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b476facc-bb34-42e3-96a9-9d67d877f59d tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] 10.222.0.20 "GET /compute/v2.1/images/7c06454e-f4ee-4402-8078-68104b52d35a" status: 200 len: 1423 microversion: 2.1 time: 0.087083 Oct 04 18:31:06.690802 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 384/766] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:31:06 2022] GET /compute/v2.1/images/7c06454e-f4ee-4402-8078-68104b52d35a => generated 1423 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:06.696844 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ba6335d0-a628-437a-851a-0f0a0f907b35 tempest-FloatingIPDetailsTestJSON-989363590 tempest-FloatingIPDetailsTestJSON-989363590-project] Action: 'create', calling method: .version_select at 0x7fe259ad5ee0>, body: {"pool": null} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:06.811861 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-eb97d7c7-0836-48c9-975f-09784f8c9bf1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:06.821594 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-eb97d7c7-0836-48c9-975f-09784f8c9bf1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:06.823265 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-eb97d7c7-0836-48c9-975f-09784f8c9bf1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:06.824190 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-eb97d7c7-0836-48c9-975f-09784f8c9bf1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/609c8bd3-a9fc-4b16-ba22-c87aa44a822d" status: 200 len: 1568 microversion: 2.25 time: 0.269010 Oct 04 18:31:06.824739 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 383/767] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:31:06 2022] GET /compute/v2.1/servers/609c8bd3-a9fc-4b16-ba22-c87aa44a822d => generated 1568 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:31:06.829331 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c12855dd-3119-4d9e-9470-e6c4689ad696 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:06.829929 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c12855dd-3119-4d9e-9470-e6c4689ad696 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] [instance: c1bf585c-9cc9-4f87-966c-e02882aa51fd] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:06.840460 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c12855dd-3119-4d9e-9470-e6c4689ad696 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:06.841188 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c12855dd-3119-4d9e-9470-e6c4689ad696 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:06.841802 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c12855dd-3119-4d9e-9470-e6c4689ad696 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:06.842694 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c12855dd-3119-4d9e-9470-e6c4689ad696 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:06.843148 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c12855dd-3119-4d9e-9470-e6c4689ad696 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:06.843565 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c12855dd-3119-4d9e-9470-e6c4689ad696 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:07.003533 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c12855dd-3119-4d9e-9470-e6c4689ad696 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f49a275284a7eb714a55c6bdd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e44e7aa06ee4126b5705ba65145ebcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:07.011527 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c12855dd-3119-4d9e-9470-e6c4689ad696 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] 10.222.0.20 "GET /compute/v2.1/servers/c1bf585c-9cc9-4f87-966c-e02882aa51fd" status: 200 len: 1521 microversion: 2.1 time: 0.185605 Oct 04 18:31:07.013060 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 384/768] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:06 2022] GET /compute/v2.1/servers/c1bf585c-9cc9-4f87-966c-e02882aa51fd => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:07.016653 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-73115507-39fc-4e75-b2cb-a59069dd21f3 req-125f4d9b-c9f1-4a44-acbd-0a7bc9a9a28a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "609c8bd3-a9fc-4b16-ba22-c87aa44a822d", "tag": "5cd956ff-e097-4445-a4d4-66c2548f3dc6"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:07.026308 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-73115507-39fc-4e75-b2cb-a59069dd21f3 req-125f4d9b-c9f1-4a44-acbd-0a7bc9a9a28a service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:07.026788 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-73115507-39fc-4e75-b2cb-a59069dd21f3 req-125f4d9b-c9f1-4a44-acbd-0a7bc9a9a28a service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:07.027222 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-73115507-39fc-4e75-b2cb-a59069dd21f3 req-125f4d9b-c9f1-4a44-acbd-0a7bc9a9a28a service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:07.039220 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-73115507-39fc-4e75-b2cb-a59069dd21f3 req-125f4d9b-c9f1-4a44-acbd-0a7bc9a9a28a service nova] Creating event network-changed:5cd956ff-e097-4445-a4d4-66c2548f3dc6 for instance 609c8bd3-a9fc-4b16-ba22-c87aa44a822d on n-h1-850501-14 Oct 04 18:31:07.045570 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-73115507-39fc-4e75-b2cb-a59069dd21f3 req-125f4d9b-c9f1-4a44-acbd-0a7bc9a9a28a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030917 Oct 04 18:31:07.045570 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 385/769] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:31:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:07.049880 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a56b0dac-a69e-4035-9a17-2936862ecd71 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:07.050579 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a56b0dac-a69e-4035-9a17-2936862ecd71 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] [instance: 5e154d65-5086-47c1-bba7-ea3dfd53f6e6] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:07.057742 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a56b0dac-a69e-4035-9a17-2936862ecd71 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:07.058276 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a56b0dac-a69e-4035-9a17-2936862ecd71 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:07.058714 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a56b0dac-a69e-4035-9a17-2936862ecd71 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:07.059424 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a56b0dac-a69e-4035-9a17-2936862ecd71 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:07.059878 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a56b0dac-a69e-4035-9a17-2936862ecd71 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:07.060333 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a56b0dac-a69e-4035-9a17-2936862ecd71 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:07.538755 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a56b0dac-a69e-4035-9a17-2936862ecd71 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89f12d146749b38c688b7581e53f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247c7ae3e4e4068a88a044e36945f32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:07.547954 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a56b0dac-a69e-4035-9a17-2936862ecd71 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] 10.222.0.20 "GET /compute/v2.1/servers/5e154d65-5086-47c1-bba7-ea3dfd53f6e6" status: 200 len: 1293 microversion: 2.1 time: 0.501747 Oct 04 18:31:07.548795 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 386/770] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:07 2022] GET /compute/v2.1/servers/5e154d65-5086-47c1-bba7-ea3dfd53f6e6 => generated 1293 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:07.554979 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d40827d5-38ab-4677-be66-d578caffd37e tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:07.555827 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d40827d5-38ab-4677-be66-d578caffd37e tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 89738dfe-3844-455a-93d1-d38702038946] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:07.562478 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d40827d5-38ab-4677-be66-d578caffd37e tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:07.562969 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d40827d5-38ab-4677-be66-d578caffd37e tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:07.563402 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d40827d5-38ab-4677-be66-d578caffd37e tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:07.564158 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d40827d5-38ab-4677-be66-d578caffd37e tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:07.564681 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d40827d5-38ab-4677-be66-d578caffd37e tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:07.565266 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d40827d5-38ab-4677-be66-d578caffd37e tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:07.888332 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d40827d5-38ab-4677-be66-d578caffd37e tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:07.896192 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d40827d5-38ab-4677-be66-d578caffd37e tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946" status: 200 len: 1504 microversion: 2.1 time: 0.346167 Oct 04 18:31:07.896876 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 387/771] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:07 2022] GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946 => generated 1504 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:07.901949 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-da5cbaf7-8f09-4c65-953a-af833daec029 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:07.902635 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-da5cbaf7-8f09-4c65-953a-af833daec029 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] [instance: c1bf585c-9cc9-4f87-966c-e02882aa51fd] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:07.908532 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-da5cbaf7-8f09-4c65-953a-af833daec029 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:07.919820 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-da5cbaf7-8f09-4c65-953a-af833daec029 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:07.920432 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-da5cbaf7-8f09-4c65-953a-af833daec029 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:07.921197 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-da5cbaf7-8f09-4c65-953a-af833daec029 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:07.921685 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-da5cbaf7-8f09-4c65-953a-af833daec029 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:07.922178 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-da5cbaf7-8f09-4c65-953a-af833daec029 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:08.228502 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-da5cbaf7-8f09-4c65-953a-af833daec029 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f49a275284a7eb714a55c6bdd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e44e7aa06ee4126b5705ba65145ebcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:08.236691 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-da5cbaf7-8f09-4c65-953a-af833daec029 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] 10.222.0.20 "GET /compute/v2.1/servers/c1bf585c-9cc9-4f87-966c-e02882aa51fd" status: 200 len: 1521 microversion: 2.1 time: 0.338375 Oct 04 18:31:08.237939 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 388/772] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:07 2022] GET /compute/v2.1/servers/c1bf585c-9cc9-4f87-966c-e02882aa51fd => generated 1521 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:08.244000 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-677abbe5-ce06-4a80-b3b3-fe4787992d6b tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:08.244745 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-677abbe5-ce06-4a80-b3b3-fe4787992d6b tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: 47fc818f-4a40-42b8-9698-0fdbed7631d6] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:08.251933 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-677abbe5-ce06-4a80-b3b3-fe4787992d6b tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:08.252517 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-677abbe5-ce06-4a80-b3b3-fe4787992d6b tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:08.253037 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-677abbe5-ce06-4a80-b3b3-fe4787992d6b tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:08.253964 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-677abbe5-ce06-4a80-b3b3-fe4787992d6b tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:08.254615 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-677abbe5-ce06-4a80-b3b3-fe4787992d6b tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:08.255230 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-677abbe5-ce06-4a80-b3b3-fe4787992d6b tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:08.529031 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:08.535997 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-677abbe5-ce06-4a80-b3b3-fe4787992d6b tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:08.555691 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-677abbe5-ce06-4a80-b3b3-fe4787992d6b tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/47fc818f-4a40-42b8-9698-0fdbed7631d6" status: 200 len: 1316 microversion: 2.1 time: 0.314557 Oct 04 18:31:08.556940 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 389/773] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:08 2022] GET /compute/v2.1/servers/47fc818f-4a40-42b8-9698-0fdbed7631d6 => generated 1316 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:08.563565 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4d981126-5479-4fe3-9d6e-18c936e822a5 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Calling method '.version_select at 0x7fe25935bb80>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:08.580575 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=10 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:08.635381 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4d981126-5479-4fe3-9d6e-18c936e822a5 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] 10.222.0.20 "GET /compute/v2.1/images/7c06454e-f4ee-4402-8078-68104b52d35a" status: 200 len: 1423 microversion: 2.1 time: 0.076600 Oct 04 18:31:08.635970 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 390/774] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:31:08 2022] GET /compute/v2.1/images/7c06454e-f4ee-4402-8078-68104b52d35a => generated 1423 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:08.652315 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e8463cb9-cf21-4211-afc7-0c6031b4a637 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:08.659169 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e8463cb9-cf21-4211-afc7-0c6031b4a637 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: 609c8bd3-a9fc-4b16-ba22-c87aa44a822d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:08.660743 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e8463cb9-cf21-4211-afc7-0c6031b4a637 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:08.661453 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e8463cb9-cf21-4211-afc7-0c6031b4a637 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:08.662052 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e8463cb9-cf21-4211-afc7-0c6031b4a637 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:08.663642 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e8463cb9-cf21-4211-afc7-0c6031b4a637 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:08.664575 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e8463cb9-cf21-4211-afc7-0c6031b4a637 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:08.665218 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e8463cb9-cf21-4211-afc7-0c6031b4a637 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:08.914903 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e8463cb9-cf21-4211-afc7-0c6031b4a637 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:08.923626 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e8463cb9-cf21-4211-afc7-0c6031b4a637 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:08.925047 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e8463cb9-cf21-4211-afc7-0c6031b4a637 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:08.926236 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e8463cb9-cf21-4211-afc7-0c6031b4a637 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/609c8bd3-a9fc-4b16-ba22-c87aa44a822d" status: 200 len: 1568 microversion: 2.25 time: 0.281160 Oct 04 18:31:08.926793 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 391/775] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:31:08 2022] GET /compute/v2.1/servers/609c8bd3-a9fc-4b16-ba22-c87aa44a822d => generated 1568 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:31:08.932282 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a83fc5dd-210d-4671-8b56-4adc456f435b tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-466768762"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:08.934630 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a83fc5dd-210d-4671-8b56-4adc456f435b tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] [instance: c1bf585c-9cc9-4f87-966c-e02882aa51fd] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:08.940741 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a83fc5dd-210d-4671-8b56-4adc456f435b tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:08.941227 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a83fc5dd-210d-4671-8b56-4adc456f435b tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:08.941775 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a83fc5dd-210d-4671-8b56-4adc456f435b tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:08.943001 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a83fc5dd-210d-4671-8b56-4adc456f435b tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:08.943001 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a83fc5dd-210d-4671-8b56-4adc456f435b tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:08.943411 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a83fc5dd-210d-4671-8b56-4adc456f435b tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:09.237142 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=5 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:09.330683 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ba6335d0-a628-437a-851a-0f0a0f907b35 tempest-FloatingIPDetailsTestJSON-989363590 tempest-FloatingIPDetailsTestJSON-989363590-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.638523 Oct 04 18:31:09.331337 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 385/776] 10.222.0.20 () {60 vars in 1170 bytes} [Tue Oct 4 18:31:06 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2640 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:09.346039 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8d1bbb57-8702-4f8d-bb62-bbbb41d6a962 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:09.349576 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8d1bbb57-8702-4f8d-bb62-bbbb41d6a962 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] [instance: 5e154d65-5086-47c1-bba7-ea3dfd53f6e6] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:09.354783 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8d1bbb57-8702-4f8d-bb62-bbbb41d6a962 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:09.355273 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8d1bbb57-8702-4f8d-bb62-bbbb41d6a962 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:09.355714 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8d1bbb57-8702-4f8d-bb62-bbbb41d6a962 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:09.356449 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8d1bbb57-8702-4f8d-bb62-bbbb41d6a962 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:09.357091 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8d1bbb57-8702-4f8d-bb62-bbbb41d6a962 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:09.357514 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8d1bbb57-8702-4f8d-bb62-bbbb41d6a962 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:09.439162 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a83fc5dd-210d-4671-8b56-4adc456f435b tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] 10.222.0.20 "POST /compute/v2.1/servers/c1bf585c-9cc9-4f87-966c-e02882aa51fd/action" status: 202 len: 0 microversion: 2.1 time: 0.511047 Oct 04 18:31:09.443158 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 392/777] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:31:08 2022] POST /compute/v2.1/servers/c1bf585c-9cc9-4f87-966c-e02882aa51fd/action => generated 0 bytes in 516 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 18:31:09.453647 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-2ce2d211-348f-45bd-9b4a-578ffdfc3e21 req-69b2e02b-f4fd-4f7d-ab18-f50af65fa07b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "836f71c5-d859-4d09-9956-922b0bbee3ae", "name": "network-vif-plugged", "status": "completed", "tag": "0a037711-4826-46fe-ab3b-3321a329f5e9"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:09.470721 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-2ce2d211-348f-45bd-9b4a-578ffdfc3e21 req-69b2e02b-f4fd-4f7d-ab18-f50af65fa07b service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:09.478890 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-2ce2d211-348f-45bd-9b4a-578ffdfc3e21 req-69b2e02b-f4fd-4f7d-ab18-f50af65fa07b service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:09.479940 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-2ce2d211-348f-45bd-9b4a-578ffdfc3e21 req-69b2e02b-f4fd-4f7d-ab18-f50af65fa07b service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:09.493836 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-2ce2d211-348f-45bd-9b4a-578ffdfc3e21 req-69b2e02b-f4fd-4f7d-ab18-f50af65fa07b service nova] Creating event network-vif-plugged:0a037711-4826-46fe-ab3b-3321a329f5e9 for instance 836f71c5-d859-4d09-9956-922b0bbee3ae on n-h1-850501-14 Oct 04 18:31:09.499114 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=35 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:09.499444 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-2ce2d211-348f-45bd-9b4a-578ffdfc3e21 req-69b2e02b-f4fd-4f7d-ab18-f50af65fa07b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054573 Oct 04 18:31:09.500471 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 393/778] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:31:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:09.508711 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c69ab5ac-8e11-4cca-9a2b-de4676d72294 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:09.509510 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c69ab5ac-8e11-4cca-9a2b-de4676d72294 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 89738dfe-3844-455a-93d1-d38702038946] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:09.516580 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c69ab5ac-8e11-4cca-9a2b-de4676d72294 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:09.517395 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c69ab5ac-8e11-4cca-9a2b-de4676d72294 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:09.518037 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c69ab5ac-8e11-4cca-9a2b-de4676d72294 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:09.518954 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c69ab5ac-8e11-4cca-9a2b-de4676d72294 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:09.519498 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c69ab5ac-8e11-4cca-9a2b-de4676d72294 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:09.520005 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c69ab5ac-8e11-4cca-9a2b-de4676d72294 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:09.530031 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8d1bbb57-8702-4f8d-bb62-bbbb41d6a962 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89f12d146749b38c688b7581e53f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247c7ae3e4e4068a88a044e36945f32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:09.539655 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8d1bbb57-8702-4f8d-bb62-bbbb41d6a962 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] 10.222.0.20 "GET /compute/v2.1/servers/5e154d65-5086-47c1-bba7-ea3dfd53f6e6" status: 200 len: 1293 microversion: 2.1 time: 0.207233 Oct 04 18:31:09.555371 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 386/779] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:09 2022] GET /compute/v2.1/servers/5e154d65-5086-47c1-bba7-ea3dfd53f6e6 => generated 1293 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:09.571995 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-01b0b9c5-aeee-4e94-9bc5-9f91d66e5846 tempest-FloatingIPDetailsTestJSON-989363590 tempest-FloatingIPDetailsTestJSON-989363590-project] Action: 'create', calling method: .version_select at 0x7fe259146f70>, body: {"pool": null} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:09.760941 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c69ab5ac-8e11-4cca-9a2b-de4676d72294 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:09.809994 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c69ab5ac-8e11-4cca-9a2b-de4676d72294 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946" status: 200 len: 1504 microversion: 2.1 time: 0.307966 Oct 04 18:31:09.810960 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 394/780] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:09 2022] GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946 => generated 1504 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:09.816098 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d8daec88-c819-48fe-afbc-502b98a28e1c tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2098743545"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:09.819471 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d8daec88-c819-48fe-afbc-502b98a28e1c tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] [instance: c1bf585c-9cc9-4f87-966c-e02882aa51fd] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:09.825953 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d8daec88-c819-48fe-afbc-502b98a28e1c tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:09.826448 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d8daec88-c819-48fe-afbc-502b98a28e1c tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:09.826881 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d8daec88-c819-48fe-afbc-502b98a28e1c tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:09.827682 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d8daec88-c819-48fe-afbc-502b98a28e1c tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:09.828168 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d8daec88-c819-48fe-afbc-502b98a28e1c tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:09.828597 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d8daec88-c819-48fe-afbc-502b98a28e1c tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:09.863550 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-d8daec88-c819-48fe-afbc-502b98a28e1c tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] HTTP exception thrown: Cannot 'createImage' instance c1bf585c-9cc9-4f87-966c-e02882aa51fd while it is in task_state image_snapshot Oct 04 18:31:09.865326 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d8daec88-c819-48fe-afbc-502b98a28e1c tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Request method failure captured: Oct 04 18:31:09.865326 n-d-850501-14 devstack@n-api.service[123002]: request: POST /compute/v2.1/servers/c1bf585c-9cc9-4f87-966c-e02882aa51fd/action HTTP/1.1 Oct 04 18:31:09.865326 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:31:09.865326 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:31:09.865326 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:31:09.865326 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 85 Oct 04 18:31:09.865326 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:31:09.865326 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:31:09.865326 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:31:09.865326 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:31:09.865326 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPHvII_T7EcjvuInFv4t5qVF70S9vjGBK66HvfyVnOiY_TVbsAPYjguHISQjMiOeT1bz8CjLq7zDrG77IXy0kQULYEqIfKm3jlSWTKPDcogOtbqbQpds3d11ZgBfbFr39fSjqioDU_0CmuRBwgkz6wZ-Zh6uUaL8av5rXkIBhSk0fN1E Oct 04 18:31:09.865326 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:31:09.865326 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:31:09.865326 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:31:09.865326 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:31:09.865326 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:31:09.865326 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:31:09.865326 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 7e44e7aa06ee4126b5705ba65145ebcc Oct 04 18:31:09.865326 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1566997612 Oct 04 18:31:09.865326 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:31:09.865326 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:31:09.866854 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e44e7aa06ee4126b5705ba65145ebcc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7e44e7aa06ee4126b5705ba65145ebcc", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7e44e7aa06ee4126b5705ba65145ebcc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e44e7aa06ee4126b5705ba65145ebcc"}]}] Oct 04 18:31:09.866854 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1566997612 Oct 04 18:31:09.866854 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 7e44e7aa06ee4126b5705ba65145ebcc Oct 04 18:31:09.866854 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1566997612 Oct 04 18:31:09.866854 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ImagesOneServerNegativeTestJSON-1566997612-project Oct 04 18:31:09.866854 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:31:09.866854 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:31:09.866854 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 415f49a275284a7eb714a55c6bdd0005 Oct 04 18:31:09.866854 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1566997612-project Oct 04 18:31:09.866854 n-d-850501-14 devstack@n-api.service[123002]: Oct 04 18:31:09.866854 n-d-850501-14 devstack@n-api.service[123002]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2098743545"}} Oct 04 18:31:09.866854 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:31:09.867660 n-d-850501-14 devstack@n-api.service[123002]: exception: Cannot 'createImage' instance c1bf585c-9cc9-4f87-966c-e02882aa51fd while it is in task_state image_snapshot Oct 04 18:31:09.867660 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'c1bf585c-9cc9-4f87-966c-e02882aa51fd', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-2098743545'}}} Oct 04 18:31:09.867660 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:31:09.867660 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:09.867660 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Oct 04 18:31:09.867660 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Oct 04 18:31:09.867660 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Oct 04 18:31:09.867660 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 18:31:09.867660 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c1bf585c-9cc9-4f87-966c-e02882aa51fd in task_state image_snapshot. Cannot snapshot while the instance is in this state. Oct 04 18:31:09.867660 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:31:09.867660 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:31:09.867660 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:31:09.867660 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:09.867660 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:31:09.867660 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:31:09.867660 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:31:09.867660 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:31:09.867660 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:31:09.867660 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:31:09.869333 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:31:09.869333 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:31:09.869333 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:31:09.869333 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:31:09.869333 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Oct 04 18:31:09.869333 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 18:31:09.869333 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 18:31:09.869333 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 18:31:09.869333 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance c1bf585c-9cc9-4f87-966c-e02882aa51fd while it is in task_state image_snapshot Oct 04 18:31:09.869333 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:31:09.869333 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:31:09.869333 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:31:09.869333 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:09.869333 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:31:09.869333 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:31:09.869333 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:31:09.869333 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:31:09.869333 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance c1bf585c-9cc9-4f87-966c-e02882aa51fd while it is in task_state image_snapshot Oct 04 18:31:09.869333 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:31:09.871314 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d8daec88-c819-48fe-afbc-502b98a28e1c tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Returning 409 to user: Cannot 'createImage' instance c1bf585c-9cc9-4f87-966c-e02882aa51fd while it is in task_state image_snapshot {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:31:09.871314 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d8daec88-c819-48fe-afbc-502b98a28e1c tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] 10.222.0.20 "POST /compute/v2.1/servers/c1bf585c-9cc9-4f87-966c-e02882aa51fd/action" status: 409 len: 159 microversion: 2.1 time: 0.054857 Oct 04 18:31:09.871314 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 395/781] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:31:09 2022] POST /compute/v2.1/servers/c1bf585c-9cc9-4f87-966c-e02882aa51fd/action => generated 159 bytes in 56 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:31:09.873950 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7c599db5-d32c-4c30-b842-efdeb2c66570 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:09.874562 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7c599db5-d32c-4c30-b842-efdeb2c66570 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: 47fc818f-4a40-42b8-9698-0fdbed7631d6] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:09.881226 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c599db5-d32c-4c30-b842-efdeb2c66570 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:09.881773 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c599db5-d32c-4c30-b842-efdeb2c66570 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:09.882215 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c599db5-d32c-4c30-b842-efdeb2c66570 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:09.882904 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c599db5-d32c-4c30-b842-efdeb2c66570 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:09.883363 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c599db5-d32c-4c30-b842-efdeb2c66570 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:09.883786 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c599db5-d32c-4c30-b842-efdeb2c66570 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:10.127863 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7c599db5-d32c-4c30-b842-efdeb2c66570 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:10.143753 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7c599db5-d32c-4c30-b842-efdeb2c66570 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/47fc818f-4a40-42b8-9698-0fdbed7631d6" status: 200 len: 1316 microversion: 2.1 time: 0.275284 Oct 04 18:31:10.144859 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 396/782] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:09 2022] GET /compute/v2.1/servers/47fc818f-4a40-42b8-9698-0fdbed7631d6 => generated 1316 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:10.167500 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2e95d108-7590-49fa-ac68-502dca907db6 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Calling method '.version_select at 0x7fe259353dc0>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:10.221137 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2e95d108-7590-49fa-ac68-502dca907db6 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] 10.222.0.20 "GET /compute/v2.1/images/7c06454e-f4ee-4402-8078-68104b52d35a" status: 200 len: 1423 microversion: 2.1 time: 0.075044 Oct 04 18:31:10.230393 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 397/783] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:31:10 2022] GET /compute/v2.1/images/7c06454e-f4ee-4402-8078-68104b52d35a => generated 1423 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:10.235388 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a3062c12-a928-492f-b142-4b4f441399ad tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Calling method '.version_select at 0x7fe25935ba60>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:10.580462 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a3062c12-a928-492f-b142-4b4f441399ad tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] 10.222.0.20 "DELETE /compute/v2.1/images/6fa98b5c-981c-4c2a-86e0-b8422120981a" status: 204 len: 0 microversion: 2.1 time: 0.348821 Oct 04 18:31:10.587928 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 398/784] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:10 2022] DELETE /compute/v2.1/images/6fa98b5c-981c-4c2a-86e0-b8422120981a => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:31:10.593365 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1fb6ee92-2235-4f1f-83bb-9c11cc5338e7 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:10.594290 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1fb6ee92-2235-4f1f-83bb-9c11cc5338e7 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: 609c8bd3-a9fc-4b16-ba22-c87aa44a822d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:10.603732 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1fb6ee92-2235-4f1f-83bb-9c11cc5338e7 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:10.604617 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1fb6ee92-2235-4f1f-83bb-9c11cc5338e7 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:10.605292 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1fb6ee92-2235-4f1f-83bb-9c11cc5338e7 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:10.606242 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1fb6ee92-2235-4f1f-83bb-9c11cc5338e7 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:10.606889 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1fb6ee92-2235-4f1f-83bb-9c11cc5338e7 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:10.607454 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1fb6ee92-2235-4f1f-83bb-9c11cc5338e7 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:10.828833 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1fb6ee92-2235-4f1f-83bb-9c11cc5338e7 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:10.841091 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1fb6ee92-2235-4f1f-83bb-9c11cc5338e7 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:10.856288 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1fb6ee92-2235-4f1f-83bb-9c11cc5338e7 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:10.856288 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1fb6ee92-2235-4f1f-83bb-9c11cc5338e7 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/609c8bd3-a9fc-4b16-ba22-c87aa44a822d" status: 200 len: 1568 microversion: 2.25 time: 0.254849 Oct 04 18:31:10.856288 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 399/785] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:31:10 2022] GET /compute/v2.1/servers/609c8bd3-a9fc-4b16-ba22-c87aa44a822d => generated 1568 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:31:10.871520 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f64d7e9a-9e53-471c-bbcf-3e0faaf5ce4e tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:10.872502 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f64d7e9a-9e53-471c-bbcf-3e0faaf5ce4e tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] [instance: 5e154d65-5086-47c1-bba7-ea3dfd53f6e6] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:10.879645 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f64d7e9a-9e53-471c-bbcf-3e0faaf5ce4e tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:10.880549 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f64d7e9a-9e53-471c-bbcf-3e0faaf5ce4e tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:10.883708 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f64d7e9a-9e53-471c-bbcf-3e0faaf5ce4e tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:10.883708 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f64d7e9a-9e53-471c-bbcf-3e0faaf5ce4e tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:10.883708 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f64d7e9a-9e53-471c-bbcf-3e0faaf5ce4e tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:10.883708 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f64d7e9a-9e53-471c-bbcf-3e0faaf5ce4e tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:10.973299 n-d-850501-14 devstack@n-api.service[123002]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 18:31:10.974072 n-d-850501-14 devstack@n-api.service[123002]: Tue Oct 4 18:31:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5e154d65-5086-47c1-bba7-ea3dfd53f6e6 (ip 10.222.0.20) !!! Oct 04 18:31:11.077451 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f64d7e9a-9e53-471c-bbcf-3e0faaf5ce4e tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89f12d146749b38c688b7581e53f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247c7ae3e4e4068a88a044e36945f32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:11.089944 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f64d7e9a-9e53-471c-bbcf-3e0faaf5ce4e tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] 10.222.0.20 "GET /compute/v2.1/servers/5e154d65-5086-47c1-bba7-ea3dfd53f6e6" status: 200 len: 1293 microversion: 2.1 time: 0.231496 Oct 04 18:31:11.092081 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 400/786] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:10 2022] GET /compute/v2.1/servers/5e154d65-5086-47c1-bba7-ea3dfd53f6e6 => generated 1293 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:11.095274 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-844c20a2-41f7-4ef0-beca-1ce72a1a0802 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:11.095895 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-844c20a2-41f7-4ef0-beca-1ce72a1a0802 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] [instance: c1bf585c-9cc9-4f87-966c-e02882aa51fd] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:11.102206 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-844c20a2-41f7-4ef0-beca-1ce72a1a0802 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:11.102699 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-844c20a2-41f7-4ef0-beca-1ce72a1a0802 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:11.103138 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-844c20a2-41f7-4ef0-beca-1ce72a1a0802 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:11.103896 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-844c20a2-41f7-4ef0-beca-1ce72a1a0802 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:11.104518 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-844c20a2-41f7-4ef0-beca-1ce72a1a0802 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:11.104990 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-844c20a2-41f7-4ef0-beca-1ce72a1a0802 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:11.125438 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:11.342427 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-844c20a2-41f7-4ef0-beca-1ce72a1a0802 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f49a275284a7eb714a55c6bdd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e44e7aa06ee4126b5705ba65145ebcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:11.352097 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-844c20a2-41f7-4ef0-beca-1ce72a1a0802 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] 10.222.0.20 "GET /compute/v2.1/servers/c1bf585c-9cc9-4f87-966c-e02882aa51fd" status: 200 len: 1539 microversion: 2.1 time: 0.260452 Oct 04 18:31:11.364846 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 401/787] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:11 2022] GET /compute/v2.1/servers/c1bf585c-9cc9-4f87-966c-e02882aa51fd => generated 1539 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:11.375513 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5ec69530-ecfa-41b9-b540-6faf14fbdf49 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:11.376234 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5ec69530-ecfa-41b9-b540-6faf14fbdf49 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 89738dfe-3844-455a-93d1-d38702038946] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:11.383071 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5ec69530-ecfa-41b9-b540-6faf14fbdf49 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:11.384872 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5ec69530-ecfa-41b9-b540-6faf14fbdf49 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:11.384872 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5ec69530-ecfa-41b9-b540-6faf14fbdf49 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:11.385732 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5ec69530-ecfa-41b9-b540-6faf14fbdf49 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:11.386308 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5ec69530-ecfa-41b9-b540-6faf14fbdf49 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:11.386795 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5ec69530-ecfa-41b9-b540-6faf14fbdf49 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:11.648455 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5ec69530-ecfa-41b9-b540-6faf14fbdf49 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:11.662605 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5ec69530-ecfa-41b9-b540-6faf14fbdf49 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946" status: 200 len: 1504 microversion: 2.1 time: 0.295763 Oct 04 18:31:11.665630 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-01b0b9c5-aeee-4e94-9bc5-9f91d66e5846 tempest-FloatingIPDetailsTestJSON-989363590 tempest-FloatingIPDetailsTestJSON-989363590-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.108369 Oct 04 18:31:11.668078 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 387/788] 10.222.0.20 () {60 vars in 1170 bytes} [Tue Oct 4 18:31:09 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:11.674203 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b04f7898-845a-4d3c-bf05-40610b1f3b79 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:11.675083 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b04f7898-845a-4d3c-bf05-40610b1f3b79 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: 47fc818f-4a40-42b8-9698-0fdbed7631d6] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:11.680631 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 402/789] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:11 2022] GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946 => generated 1504 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:11.685061 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b04f7898-845a-4d3c-bf05-40610b1f3b79 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:11.686219 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b04f7898-845a-4d3c-bf05-40610b1f3b79 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:11.686854 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b04f7898-845a-4d3c-bf05-40610b1f3b79 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:11.687475 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-04758a9d-191d-4872-81e5-d8f4cee5bc04 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Calling method '.version_select at 0x7fe2592c38b0>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:11.688183 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b04f7898-845a-4d3c-bf05-40610b1f3b79 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:11.689406 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b04f7898-845a-4d3c-bf05-40610b1f3b79 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:11.690456 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b04f7898-845a-4d3c-bf05-40610b1f3b79 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:11.766583 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-04758a9d-191d-4872-81e5-d8f4cee5bc04 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] 10.222.0.20 "GET /compute/v2.1/images/7c06454e-f4ee-4402-8078-68104b52d35a" status: 200 len: 1423 microversion: 2.1 time: 0.084935 Oct 04 18:31:11.775535 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 403/790] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:31:11 2022] GET /compute/v2.1/images/7c06454e-f4ee-4402-8078-68104b52d35a => generated 1423 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:11.775535 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-953ec887-5842-4288-bf16-9ef0ce55bd7e tempest-FloatingIPDetailsTestJSON-989363590 tempest-FloatingIPDetailsTestJSON-989363590-project] Action: 'create', calling method: .version_select at 0x7fe259737430>, body: {"pool": null} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:12.050212 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b04f7898-845a-4d3c-bf05-40610b1f3b79 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:12.051504 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:12.067027 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b04f7898-845a-4d3c-bf05-40610b1f3b79 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/47fc818f-4a40-42b8-9698-0fdbed7631d6" status: 200 len: 1316 microversion: 2.1 time: 0.397570 Oct 04 18:31:12.069461 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 388/791] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:11 2022] GET /compute/v2.1/servers/47fc818f-4a40-42b8-9698-0fdbed7631d6 => generated 1316 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:12.075329 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2741e1c1-6c50-4fd6-9637-a7169734c0de tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:12.079278 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2741e1c1-6c50-4fd6-9637-a7169734c0de tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: 609c8bd3-a9fc-4b16-ba22-c87aa44a822d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:12.083488 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2741e1c1-6c50-4fd6-9637-a7169734c0de tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:12.083986 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2741e1c1-6c50-4fd6-9637-a7169734c0de tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:12.084783 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2741e1c1-6c50-4fd6-9637-a7169734c0de tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:12.086443 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2741e1c1-6c50-4fd6-9637-a7169734c0de tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:12.087014 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2741e1c1-6c50-4fd6-9637-a7169734c0de tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:12.087675 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2741e1c1-6c50-4fd6-9637-a7169734c0de tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:12.383691 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-2741e1c1-6c50-4fd6-9637-a7169734c0de tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:12.394010 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-2741e1c1-6c50-4fd6-9637-a7169734c0de tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:12.395697 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-2741e1c1-6c50-4fd6-9637-a7169734c0de tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:12.397945 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2741e1c1-6c50-4fd6-9637-a7169734c0de tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/609c8bd3-a9fc-4b16-ba22-c87aa44a822d" status: 200 len: 1568 microversion: 2.25 time: 0.326178 Oct 04 18:31:12.398594 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 389/792] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:31:12 2022] GET /compute/v2.1/servers/609c8bd3-a9fc-4b16-ba22-c87aa44a822d => generated 1568 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:31:12.412305 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4e2c72fe-5d61-432e-8173-dc8542c56937 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:12.412305 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-4e2c72fe-5d61-432e-8173-dc8542c56937 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] [instance: 5e154d65-5086-47c1-bba7-ea3dfd53f6e6] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:12.415843 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4e2c72fe-5d61-432e-8173-dc8542c56937 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:12.416673 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4e2c72fe-5d61-432e-8173-dc8542c56937 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:12.417391 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4e2c72fe-5d61-432e-8173-dc8542c56937 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:12.418315 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4e2c72fe-5d61-432e-8173-dc8542c56937 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:12.418985 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4e2c72fe-5d61-432e-8173-dc8542c56937 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:12.419627 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4e2c72fe-5d61-432e-8173-dc8542c56937 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:12.651279 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-4e2c72fe-5d61-432e-8173-dc8542c56937 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89f12d146749b38c688b7581e53f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247c7ae3e4e4068a88a044e36945f32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:12.660589 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-4e2c72fe-5d61-432e-8173-dc8542c56937 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] 10.222.0.20 "GET /compute/v2.1/servers/5e154d65-5086-47c1-bba7-ea3dfd53f6e6" status: 200 len: 1293 microversion: 2.1 time: 0.257359 Oct 04 18:31:12.661888 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 390/793] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:12 2022] GET /compute/v2.1/servers/5e154d65-5086-47c1-bba7-ea3dfd53f6e6 => generated 1293 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:12.667885 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b3bada43-c02a-42ae-944d-4ff22a8dbdf9 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:12.668543 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b3bada43-c02a-42ae-944d-4ff22a8dbdf9 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] [instance: c1bf585c-9cc9-4f87-966c-e02882aa51fd] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:12.674652 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b3bada43-c02a-42ae-944d-4ff22a8dbdf9 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:12.676678 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b3bada43-c02a-42ae-944d-4ff22a8dbdf9 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:12.677387 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b3bada43-c02a-42ae-944d-4ff22a8dbdf9 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:12.678732 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b3bada43-c02a-42ae-944d-4ff22a8dbdf9 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:12.679207 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b3bada43-c02a-42ae-944d-4ff22a8dbdf9 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:12.679903 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b3bada43-c02a-42ae-944d-4ff22a8dbdf9 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:12.868489 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b3bada43-c02a-42ae-944d-4ff22a8dbdf9 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f49a275284a7eb714a55c6bdd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e44e7aa06ee4126b5705ba65145ebcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:12.878695 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b3bada43-c02a-42ae-944d-4ff22a8dbdf9 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] 10.222.0.20 "GET /compute/v2.1/servers/c1bf585c-9cc9-4f87-966c-e02882aa51fd" status: 200 len: 1539 microversion: 2.1 time: 0.214775 Oct 04 18:31:12.880116 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 391/794] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:12 2022] GET /compute/v2.1/servers/c1bf585c-9cc9-4f87-966c-e02882aa51fd => generated 1539 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:12.886128 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-bcfa7a3e-be2c-4c8d-9a90-0a93b35112af tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:12.887026 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-bcfa7a3e-be2c-4c8d-9a90-0a93b35112af tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 89738dfe-3844-455a-93d1-d38702038946] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:12.919575 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bcfa7a3e-be2c-4c8d-9a90-0a93b35112af tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:12.920275 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bcfa7a3e-be2c-4c8d-9a90-0a93b35112af tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:12.921060 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bcfa7a3e-be2c-4c8d-9a90-0a93b35112af tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:12.921840 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bcfa7a3e-be2c-4c8d-9a90-0a93b35112af tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:12.922482 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bcfa7a3e-be2c-4c8d-9a90-0a93b35112af tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:12.923102 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bcfa7a3e-be2c-4c8d-9a90-0a93b35112af tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:13.515523 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-bcfa7a3e-be2c-4c8d-9a90-0a93b35112af tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:13.529378 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-bcfa7a3e-be2c-4c8d-9a90-0a93b35112af tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946" status: 200 len: 1504 microversion: 2.1 time: 0.647955 Oct 04 18:31:13.530575 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 392/795] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:12 2022] GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946 => generated 1504 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:13.535514 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-cb588932-2135-4c2d-a9d2-420ca7d668ef tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Calling method '.version_select at 0x7fe259230790>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:13.610570 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-cb588932-2135-4c2d-a9d2-420ca7d668ef tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] 10.222.0.20 "GET /compute/v2.1/images/7c06454e-f4ee-4402-8078-68104b52d35a" status: 200 len: 1423 microversion: 2.1 time: 0.078739 Oct 04 18:31:13.620804 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 393/796] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:31:13 2022] GET /compute/v2.1/images/7c06454e-f4ee-4402-8078-68104b52d35a => generated 1423 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:13.626193 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-075b9500-02a1-4226-8e6d-ad0f4604ed08 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:13.627169 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-075b9500-02a1-4226-8e6d-ad0f4604ed08 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: 47fc818f-4a40-42b8-9698-0fdbed7631d6] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:13.637365 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-075b9500-02a1-4226-8e6d-ad0f4604ed08 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:13.638164 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-075b9500-02a1-4226-8e6d-ad0f4604ed08 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:13.638802 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-075b9500-02a1-4226-8e6d-ad0f4604ed08 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:13.639666 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-075b9500-02a1-4226-8e6d-ad0f4604ed08 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:13.640341 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-075b9500-02a1-4226-8e6d-ad0f4604ed08 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:13.646172 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-075b9500-02a1-4226-8e6d-ad0f4604ed08 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:13.931097 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-075b9500-02a1-4226-8e6d-ad0f4604ed08 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:13.940954 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-075b9500-02a1-4226-8e6d-ad0f4604ed08 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/47fc818f-4a40-42b8-9698-0fdbed7631d6" status: 200 len: 1316 microversion: 2.1 time: 0.318717 Oct 04 18:31:13.943455 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 394/797] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:13 2022] GET /compute/v2.1/servers/47fc818f-4a40-42b8-9698-0fdbed7631d6 => generated 1316 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:13.948718 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4087e598-f295-4c83-8169-9071a1932ce7 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:13.949638 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-4087e598-f295-4c83-8169-9071a1932ce7 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: 609c8bd3-a9fc-4b16-ba22-c87aa44a822d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:13.952732 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:13.956404 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4087e598-f295-4c83-8169-9071a1932ce7 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:13.957121 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4087e598-f295-4c83-8169-9071a1932ce7 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:13.957632 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4087e598-f295-4c83-8169-9071a1932ce7 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:13.958418 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4087e598-f295-4c83-8169-9071a1932ce7 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:13.959157 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4087e598-f295-4c83-8169-9071a1932ce7 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:13.959871 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4087e598-f295-4c83-8169-9071a1932ce7 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:14.229628 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-4087e598-f295-4c83-8169-9071a1932ce7 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:14.244891 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-4087e598-f295-4c83-8169-9071a1932ce7 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:14.246507 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-4087e598-f295-4c83-8169-9071a1932ce7 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:14.247685 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-4087e598-f295-4c83-8169-9071a1932ce7 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/609c8bd3-a9fc-4b16-ba22-c87aa44a822d" status: 200 len: 1568 microversion: 2.25 time: 0.304546 Oct 04 18:31:14.260083 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 395/798] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:31:13 2022] GET /compute/v2.1/servers/609c8bd3-a9fc-4b16-ba22-c87aa44a822d => generated 1568 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:31:14.260083 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ef6c543c-ec33-4254-996e-0751f418fb23 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:14.260083 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ef6c543c-ec33-4254-996e-0751f418fb23 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] [instance: 5e154d65-5086-47c1-bba7-ea3dfd53f6e6] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:14.262971 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ef6c543c-ec33-4254-996e-0751f418fb23 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:14.263467 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ef6c543c-ec33-4254-996e-0751f418fb23 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:14.263902 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ef6c543c-ec33-4254-996e-0751f418fb23 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:14.264638 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ef6c543c-ec33-4254-996e-0751f418fb23 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:14.265090 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ef6c543c-ec33-4254-996e-0751f418fb23 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:14.265513 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ef6c543c-ec33-4254-996e-0751f418fb23 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:14.530145 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ef6c543c-ec33-4254-996e-0751f418fb23 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89f12d146749b38c688b7581e53f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247c7ae3e4e4068a88a044e36945f32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:14.549769 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ef6c543c-ec33-4254-996e-0751f418fb23 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] 10.222.0.20 "GET /compute/v2.1/servers/5e154d65-5086-47c1-bba7-ea3dfd53f6e6" status: 200 len: 1293 microversion: 2.1 time: 0.294259 Oct 04 18:31:14.549769 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 396/799] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:14 2022] GET /compute/v2.1/servers/5e154d65-5086-47c1-bba7-ea3dfd53f6e6 => generated 1293 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:14.556222 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e37c1a7b-4ef2-40e3-bf03-066a63855bd6 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:14.563359 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e37c1a7b-4ef2-40e3-bf03-066a63855bd6 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] [instance: c1bf585c-9cc9-4f87-966c-e02882aa51fd] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:14.571818 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e37c1a7b-4ef2-40e3-bf03-066a63855bd6 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:14.572676 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e37c1a7b-4ef2-40e3-bf03-066a63855bd6 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:14.578516 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e37c1a7b-4ef2-40e3-bf03-066a63855bd6 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:14.578516 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e37c1a7b-4ef2-40e3-bf03-066a63855bd6 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:14.578516 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e37c1a7b-4ef2-40e3-bf03-066a63855bd6 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:14.578516 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e37c1a7b-4ef2-40e3-bf03-066a63855bd6 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:14.614359 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-953ec887-5842-4288-bf16-9ef0ce55bd7e tempest-FloatingIPDetailsTestJSON-989363590 tempest-FloatingIPDetailsTestJSON-989363590-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.845633 Oct 04 18:31:14.618603 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 404/800] 10.222.0.20 () {60 vars in 1170 bytes} [Tue Oct 4 18:31:11 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2847 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:14.621726 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-872b6aef-4441-4159-a8fb-93ce569076f8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:14.622533 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-872b6aef-4441-4159-a8fb-93ce569076f8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 89738dfe-3844-455a-93d1-d38702038946] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:14.630687 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-872b6aef-4441-4159-a8fb-93ce569076f8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:14.631720 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-872b6aef-4441-4159-a8fb-93ce569076f8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:14.632347 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-872b6aef-4441-4159-a8fb-93ce569076f8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:14.633413 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-872b6aef-4441-4159-a8fb-93ce569076f8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:14.634068 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-872b6aef-4441-4159-a8fb-93ce569076f8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:14.634709 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-872b6aef-4441-4159-a8fb-93ce569076f8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:14.824017 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e37c1a7b-4ef2-40e3-bf03-066a63855bd6 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f49a275284a7eb714a55c6bdd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e44e7aa06ee4126b5705ba65145ebcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:14.837790 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e37c1a7b-4ef2-40e3-bf03-066a63855bd6 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] 10.222.0.20 "GET /compute/v2.1/servers/c1bf585c-9cc9-4f87-966c-e02882aa51fd" status: 200 len: 1521 microversion: 2.1 time: 0.288615 Oct 04 18:31:14.848088 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 397/801] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:14 2022] GET /compute/v2.1/servers/c1bf585c-9cc9-4f87-966c-e02882aa51fd => generated 1521 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:14.856252 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-872b6aef-4441-4159-a8fb-93ce569076f8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:14.857355 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-13fc91df-c076-4e4c-ac0d-42ffc440f9f9 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Calling method '.version_select at 0x7fe25921c0d0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:14.857441 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-872b6aef-4441-4159-a8fb-93ce569076f8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946" status: 200 len: 1504 microversion: 2.1 time: 0.236856 Oct 04 18:31:14.857441 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 405/802] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:14 2022] GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946 => generated 1504 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:14.869818 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6c06a1eb-5894-45ef-ad64-b0e2bfaf7a18 tempest-FloatingIPDetailsTestJSON-989363590 tempest-FloatingIPDetailsTestJSON-989363590-project] Calling method '.version_select at 0x7fe259555ee0>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:14.914717 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-13fc91df-c076-4e4c-ac0d-42ffc440f9f9 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] 10.222.0.20 "GET /compute/v2.1/images/7c06454e-f4ee-4402-8078-68104b52d35a" status: 200 len: 1423 microversion: 2.1 time: 0.074316 Oct 04 18:31:14.915301 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 398/803] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:31:14 2022] GET /compute/v2.1/images/7c06454e-f4ee-4402-8078-68104b52d35a => generated 1423 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:14.920701 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-25f752da-1042-4a58-93ca-8bac1df85bb4 req-aa1ed3e1-cd3f-40a9-8c93-a546ea7a6b9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1bf585c-9cc9-4f87-966c-e02882aa51fd", "name": "network-vif-plugged", "status": "completed", "tag": "a08a497b-a75d-46e8-bb72-da6d0464043b"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:14.935588 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-25f752da-1042-4a58-93ca-8bac1df85bb4 req-aa1ed3e1-cd3f-40a9-8c93-a546ea7a6b9c service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:14.936920 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-25f752da-1042-4a58-93ca-8bac1df85bb4 req-aa1ed3e1-cd3f-40a9-8c93-a546ea7a6b9c service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:14.937570 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-25f752da-1042-4a58-93ca-8bac1df85bb4 req-aa1ed3e1-cd3f-40a9-8c93-a546ea7a6b9c service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:14.963959 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-25f752da-1042-4a58-93ca-8bac1df85bb4 req-aa1ed3e1-cd3f-40a9-8c93-a546ea7a6b9c service nova] Creating event network-vif-plugged:a08a497b-a75d-46e8-bb72-da6d0464043b for instance c1bf585c-9cc9-4f87-966c-e02882aa51fd on n-h1-850501-14 Oct 04 18:31:14.972908 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-25f752da-1042-4a58-93ca-8bac1df85bb4 req-aa1ed3e1-cd3f-40a9-8c93-a546ea7a6b9c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056321 Oct 04 18:31:14.974270 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 399/804] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:31:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:14.981291 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d4c09579-187d-41b4-842f-abfd3d82f6f2 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:14.982074 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d4c09579-187d-41b4-842f-abfd3d82f6f2 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] [instance: c1bf585c-9cc9-4f87-966c-e02882aa51fd] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:14.992728 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d4c09579-187d-41b4-842f-abfd3d82f6f2 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:14.993273 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d4c09579-187d-41b4-842f-abfd3d82f6f2 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:14.993783 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d4c09579-187d-41b4-842f-abfd3d82f6f2 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:14.995348 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d4c09579-187d-41b4-842f-abfd3d82f6f2 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:14.995833 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d4c09579-187d-41b4-842f-abfd3d82f6f2 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:14.996306 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d4c09579-187d-41b4-842f-abfd3d82f6f2 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:15.046493 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d4c09579-187d-41b4-842f-abfd3d82f6f2 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] [instance: c1bf585c-9cc9-4f87-966c-e02882aa51fd] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:31:15.100253 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6c06a1eb-5894-45ef-ad64-b0e2bfaf7a18 tempest-FloatingIPDetailsTestJSON-989363590 tempest-FloatingIPDetailsTestJSON-989363590-project] 10.222.0.20 "GET /compute/v2.1/os-floating-ips/1bcea569-df59-426e-81b0-3fc62252b5a2" status: 200 len: 142 microversion: 2.1 time: 0.242374 Oct 04 18:31:15.102359 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 406/805] 10.222.0.20 () {58 vars in 1260 bytes} [Tue Oct 4 18:31:14 2022] GET /compute/v2.1/os-floating-ips/1bcea569-df59-426e-81b0-3fc62252b5a2 => generated 142 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:15.105834 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7be06d6a-7aa0-48b4-a03b-e163dc5792ea tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:15.108746 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7be06d6a-7aa0-48b4-a03b-e163dc5792ea tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: 47fc818f-4a40-42b8-9698-0fdbed7631d6] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:15.115608 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7be06d6a-7aa0-48b4-a03b-e163dc5792ea tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:15.116263 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7be06d6a-7aa0-48b4-a03b-e163dc5792ea tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:15.117336 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7be06d6a-7aa0-48b4-a03b-e163dc5792ea tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:15.118047 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7be06d6a-7aa0-48b4-a03b-e163dc5792ea tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:15.118684 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7be06d6a-7aa0-48b4-a03b-e163dc5792ea tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:15.119272 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7be06d6a-7aa0-48b4-a03b-e163dc5792ea tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:15.281056 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7be06d6a-7aa0-48b4-a03b-e163dc5792ea tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:15.296432 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7be06d6a-7aa0-48b4-a03b-e163dc5792ea tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/47fc818f-4a40-42b8-9698-0fdbed7631d6" status: 200 len: 1316 microversion: 2.1 time: 0.194224 Oct 04 18:31:15.297629 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 407/806] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:15 2022] GET /compute/v2.1/servers/47fc818f-4a40-42b8-9698-0fdbed7631d6 => generated 1316 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:15.305552 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4ae83b1d-2ed0-4c5f-8276-d4bdb2a103db tempest-FloatingIPDetailsTestJSON-989363590 tempest-FloatingIPDetailsTestJSON-989363590-project] Calling method '.version_select at 0x7fe259433040>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:15.421366 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d4c09579-187d-41b4-842f-abfd3d82f6f2 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c1bf585c-9cc9-4f87-966c-e02882aa51fd" status: 204 len: 0 microversion: 2.1 time: 0.444128 Oct 04 18:31:15.423093 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 400/807] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:31:14 2022] DELETE /compute/v2.1/servers/c1bf585c-9cc9-4f87-966c-e02882aa51fd => generated 0 bytes in 448 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:31:15.441817 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-eb8be247-a6d7-4d1f-ad7d-368749c10281 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:15.443296 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-eb8be247-a6d7-4d1f-ad7d-368749c10281 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: 609c8bd3-a9fc-4b16-ba22-c87aa44a822d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:15.450288 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eb8be247-a6d7-4d1f-ad7d-368749c10281 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:15.450775 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eb8be247-a6d7-4d1f-ad7d-368749c10281 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:15.451211 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eb8be247-a6d7-4d1f-ad7d-368749c10281 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:15.451908 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eb8be247-a6d7-4d1f-ad7d-368749c10281 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:15.452387 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eb8be247-a6d7-4d1f-ad7d-368749c10281 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:15.457385 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eb8be247-a6d7-4d1f-ad7d-368749c10281 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:15.783023 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-eb8be247-a6d7-4d1f-ad7d-368749c10281 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:15.794627 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-eb8be247-a6d7-4d1f-ad7d-368749c10281 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:15.797447 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-eb8be247-a6d7-4d1f-ad7d-368749c10281 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:15.799523 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-eb8be247-a6d7-4d1f-ad7d-368749c10281 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/609c8bd3-a9fc-4b16-ba22-c87aa44a822d" status: 200 len: 1568 microversion: 2.25 time: 0.369513 Oct 04 18:31:15.800815 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 401/808] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:31:15 2022] GET /compute/v2.1/servers/609c8bd3-a9fc-4b16-ba22-c87aa44a822d => generated 1568 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:31:15.814891 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2a1aafde-c639-4e7f-b2ed-e2f2df7ed63a tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:15.815989 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2a1aafde-c639-4e7f-b2ed-e2f2df7ed63a tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] [instance: c1bf585c-9cc9-4f87-966c-e02882aa51fd] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:15.827716 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2a1aafde-c639-4e7f-b2ed-e2f2df7ed63a tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:15.828471 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2a1aafde-c639-4e7f-b2ed-e2f2df7ed63a tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:15.829136 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2a1aafde-c639-4e7f-b2ed-e2f2df7ed63a tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:15.830146 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2a1aafde-c639-4e7f-b2ed-e2f2df7ed63a tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:15.830979 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2a1aafde-c639-4e7f-b2ed-e2f2df7ed63a tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:15.831671 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2a1aafde-c639-4e7f-b2ed-e2f2df7ed63a tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:16.196631 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-2a1aafde-c639-4e7f-b2ed-e2f2df7ed63a tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f49a275284a7eb714a55c6bdd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e44e7aa06ee4126b5705ba65145ebcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:16.205208 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2a1aafde-c639-4e7f-b2ed-e2f2df7ed63a tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] 10.222.0.20 "GET /compute/v2.1/servers/c1bf585c-9cc9-4f87-966c-e02882aa51fd" status: 200 len: 1527 microversion: 2.1 time: 0.402712 Oct 04 18:31:16.216267 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 402/809] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:15 2022] GET /compute/v2.1/servers/c1bf585c-9cc9-4f87-966c-e02882aa51fd => generated 1527 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:16.216267 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1d0c9a75-6558-45be-ac47-42f1a0d78d5e tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:16.216267 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1d0c9a75-6558-45be-ac47-42f1a0d78d5e tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] [instance: 5e154d65-5086-47c1-bba7-ea3dfd53f6e6] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:16.223971 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1d0c9a75-6558-45be-ac47-42f1a0d78d5e tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:16.223971 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1d0c9a75-6558-45be-ac47-42f1a0d78d5e tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:16.223971 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1d0c9a75-6558-45be-ac47-42f1a0d78d5e tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:16.223971 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1d0c9a75-6558-45be-ac47-42f1a0d78d5e tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:16.224456 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1d0c9a75-6558-45be-ac47-42f1a0d78d5e tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:16.224456 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1d0c9a75-6558-45be-ac47-42f1a0d78d5e tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:16.552302 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1d0c9a75-6558-45be-ac47-42f1a0d78d5e tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89f12d146749b38c688b7581e53f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247c7ae3e4e4068a88a044e36945f32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:16.561738 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1d0c9a75-6558-45be-ac47-42f1a0d78d5e tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] 10.222.0.20 "GET /compute/v2.1/servers/5e154d65-5086-47c1-bba7-ea3dfd53f6e6" status: 200 len: 1293 microversion: 2.1 time: 0.354540 Oct 04 18:31:16.562327 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 403/810] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:16 2022] GET /compute/v2.1/servers/5e154d65-5086-47c1-bba7-ea3dfd53f6e6 => generated 1293 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:16.566773 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9a961feb-bd90-4ca1-a63c-ccefa1f13c1f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:16.567388 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-9a961feb-bd90-4ca1-a63c-ccefa1f13c1f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 89738dfe-3844-455a-93d1-d38702038946] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:16.573747 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9a961feb-bd90-4ca1-a63c-ccefa1f13c1f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:16.574229 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9a961feb-bd90-4ca1-a63c-ccefa1f13c1f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:16.574670 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9a961feb-bd90-4ca1-a63c-ccefa1f13c1f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:16.575370 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9a961feb-bd90-4ca1-a63c-ccefa1f13c1f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:16.575828 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9a961feb-bd90-4ca1-a63c-ccefa1f13c1f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:16.576289 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9a961feb-bd90-4ca1-a63c-ccefa1f13c1f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:16.841877 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9a961feb-bd90-4ca1-a63c-ccefa1f13c1f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:16.851645 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9a961feb-bd90-4ca1-a63c-ccefa1f13c1f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946" status: 200 len: 1504 microversion: 2.1 time: 0.288245 Oct 04 18:31:16.867624 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 404/811] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:16 2022] GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946 => generated 1504 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:16.873981 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-acb8c9f3-78d3-4bb5-b175-b99684bfce61 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Calling method '.version_select at 0x7fe2595e3940>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:16.933701 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-acb8c9f3-78d3-4bb5-b175-b99684bfce61 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] 10.222.0.20 "GET /compute/v2.1/images/7c06454e-f4ee-4402-8078-68104b52d35a" status: 200 len: 1423 microversion: 2.1 time: 0.064670 Oct 04 18:31:16.943910 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 405/812] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:31:16 2022] GET /compute/v2.1/images/7c06454e-f4ee-4402-8078-68104b52d35a => generated 1423 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:16.950594 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a41bc5dd-dd6e-47da-8337-242178eb9442 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:16.958102 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a41bc5dd-dd6e-47da-8337-242178eb9442 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: 47fc818f-4a40-42b8-9698-0fdbed7631d6] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:16.967295 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a41bc5dd-dd6e-47da-8337-242178eb9442 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:16.967867 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a41bc5dd-dd6e-47da-8337-242178eb9442 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:16.968490 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a41bc5dd-dd6e-47da-8337-242178eb9442 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:16.969198 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a41bc5dd-dd6e-47da-8337-242178eb9442 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:16.969656 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a41bc5dd-dd6e-47da-8337-242178eb9442 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:16.970079 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a41bc5dd-dd6e-47da-8337-242178eb9442 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:17.075205 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4ae83b1d-2ed0-4c5f-8276-d4bdb2a103db tempest-FloatingIPDetailsTestJSON-989363590 tempest-FloatingIPDetailsTestJSON-989363590-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/1bcea569-df59-426e-81b0-3fc62252b5a2" status: 202 len: 0 microversion: 2.1 time: 1.776264 Oct 04 18:31:17.076538 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 408/813] 10.222.0.20 () {58 vars in 1263 bytes} [Tue Oct 4 18:31:15 2022] DELETE /compute/v2.1/os-floating-ips/1bcea569-df59-426e-81b0-3fc62252b5a2 => generated 0 bytes in 1778 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:31:17.094288 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-34cd52e3-2507-4538-9a5c-c69ae6823fa2 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:17.095845 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-34cd52e3-2507-4538-9a5c-c69ae6823fa2 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: 609c8bd3-a9fc-4b16-ba22-c87aa44a822d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:17.105561 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-34cd52e3-2507-4538-9a5c-c69ae6823fa2 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:17.106361 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-34cd52e3-2507-4538-9a5c-c69ae6823fa2 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:17.106970 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-34cd52e3-2507-4538-9a5c-c69ae6823fa2 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:17.108314 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-34cd52e3-2507-4538-9a5c-c69ae6823fa2 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:17.110162 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-34cd52e3-2507-4538-9a5c-c69ae6823fa2 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:17.110911 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-34cd52e3-2507-4538-9a5c-c69ae6823fa2 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:17.161402 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a41bc5dd-dd6e-47da-8337-242178eb9442 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:17.174678 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a41bc5dd-dd6e-47da-8337-242178eb9442 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/47fc818f-4a40-42b8-9698-0fdbed7631d6" status: 200 len: 1316 microversion: 2.1 time: 0.229388 Oct 04 18:31:17.197154 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 406/814] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:16 2022] GET /compute/v2.1/servers/47fc818f-4a40-42b8-9698-0fdbed7631d6 => generated 1316 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:17.199204 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-e0819366-f4a4-4f8d-b29d-a75c49fcb386 req-793128c3-c887-4122-950f-4744fed303ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47fc818f-4a40-42b8-9698-0fdbed7631d6", "name": "network-vif-plugged", "status": "completed", "tag": "d975cead-350a-43ad-9299-eb99afd70ae5"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:17.208912 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-e0819366-f4a4-4f8d-b29d-a75c49fcb386 req-793128c3-c887-4122-950f-4744fed303ad service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:17.209488 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-e0819366-f4a4-4f8d-b29d-a75c49fcb386 req-793128c3-c887-4122-950f-4744fed303ad service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:17.209924 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-e0819366-f4a4-4f8d-b29d-a75c49fcb386 req-793128c3-c887-4122-950f-4744fed303ad service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:17.224007 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-e0819366-f4a4-4f8d-b29d-a75c49fcb386 req-793128c3-c887-4122-950f-4744fed303ad service nova] Creating event network-vif-plugged:d975cead-350a-43ad-9299-eb99afd70ae5 for instance 47fc818f-4a40-42b8-9698-0fdbed7631d6 on n-h2-850501-14 Oct 04 18:31:17.230321 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-e0819366-f4a4-4f8d-b29d-a75c49fcb386 req-793128c3-c887-4122-950f-4744fed303ad service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034740 Oct 04 18:31:17.231135 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 407/815] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:31:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:17.237159 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-cf2acf82-c6bb-41d4-8a34-39b39bade43b tempest-FloatingIPDetailsTestJSON-989363590 tempest-FloatingIPDetailsTestJSON-989363590-project] Calling method '.version_select at 0x7fe2596279d0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:17.926013 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-34cd52e3-2507-4538-9a5c-c69ae6823fa2 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:17.937900 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-34cd52e3-2507-4538-9a5c-c69ae6823fa2 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:17.942637 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-34cd52e3-2507-4538-9a5c-c69ae6823fa2 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:17.946760 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-34cd52e3-2507-4538-9a5c-c69ae6823fa2 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/609c8bd3-a9fc-4b16-ba22-c87aa44a822d" status: 200 len: 1568 microversion: 2.25 time: 0.868862 Oct 04 18:31:17.948751 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-cf2acf82-c6bb-41d4-8a34-39b39bade43b tempest-FloatingIPDetailsTestJSON-989363590 tempest-FloatingIPDetailsTestJSON-989363590-project] 10.222.0.20 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.715721 Oct 04 18:31:17.950229 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 409/816] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:31:17 2022] GET /compute/v2.1/servers/609c8bd3-a9fc-4b16-ba22-c87aa44a822d => generated 1568 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:31:17.955399 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-312afdcb-a426-430c-8fa2-5e91bfa12dde tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:17.961115 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-312afdcb-a426-430c-8fa2-5e91bfa12dde tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] [instance: c1bf585c-9cc9-4f87-966c-e02882aa51fd] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:17.972225 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 408/817] 10.222.0.20 () {58 vars in 1164 bytes} [Tue Oct 4 18:31:17 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:31:17.975267 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-312afdcb-a426-430c-8fa2-5e91bfa12dde tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:17.979832 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-69bf5eed-cc46-4c7a-b041-3b2c289d84be tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:17.983449 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-312afdcb-a426-430c-8fa2-5e91bfa12dde tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:17.984399 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-69bf5eed-cc46-4c7a-b041-3b2c289d84be tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] [instance: 5e154d65-5086-47c1-bba7-ea3dfd53f6e6] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:17.985044 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-312afdcb-a426-430c-8fa2-5e91bfa12dde tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:17.988367 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-312afdcb-a426-430c-8fa2-5e91bfa12dde tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:17.996665 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-69bf5eed-cc46-4c7a-b041-3b2c289d84be tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:17.997163 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-69bf5eed-cc46-4c7a-b041-3b2c289d84be tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:17.997602 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-69bf5eed-cc46-4c7a-b041-3b2c289d84be tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:17.998316 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-69bf5eed-cc46-4c7a-b041-3b2c289d84be tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:17.998679 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-312afdcb-a426-430c-8fa2-5e91bfa12dde tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:17.998818 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-69bf5eed-cc46-4c7a-b041-3b2c289d84be tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:17.999187 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-69bf5eed-cc46-4c7a-b041-3b2c289d84be tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:18.001018 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-312afdcb-a426-430c-8fa2-5e91bfa12dde tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:18.009786 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:18.440227 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-312afdcb-a426-430c-8fa2-5e91bfa12dde tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f49a275284a7eb714a55c6bdd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e44e7aa06ee4126b5705ba65145ebcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:18.457620 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-69bf5eed-cc46-4c7a-b041-3b2c289d84be tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89f12d146749b38c688b7581e53f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247c7ae3e4e4068a88a044e36945f32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:18.462868 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-312afdcb-a426-430c-8fa2-5e91bfa12dde tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] 10.222.0.20 "GET /compute/v2.1/servers/c1bf585c-9cc9-4f87-966c-e02882aa51fd" status: 200 len: 1527 microversion: 2.1 time: 0.502336 Oct 04 18:31:18.465858 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 410/818] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:17 2022] GET /compute/v2.1/servers/c1bf585c-9cc9-4f87-966c-e02882aa51fd => generated 1527 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:18.468677 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-69bf5eed-cc46-4c7a-b041-3b2c289d84be tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] 10.222.0.20 "GET /compute/v2.1/servers/5e154d65-5086-47c1-bba7-ea3dfd53f6e6" status: 200 len: 1293 microversion: 2.1 time: 0.495662 Oct 04 18:31:18.487577 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8498cc08-a772-430e-94f7-b2dada421306 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:18.487705 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 409/819] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:17 2022] GET /compute/v2.1/servers/5e154d65-5086-47c1-bba7-ea3dfd53f6e6 => generated 1293 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:18.487795 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8498cc08-a772-430e-94f7-b2dada421306 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 89738dfe-3844-455a-93d1-d38702038946] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:18.487875 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-95b6337f-e88f-4ed9-94e5-cb376bb37440 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Calling method '.version_select at 0x7fe2591f9a60>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:18.508229 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8498cc08-a772-430e-94f7-b2dada421306 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:18.509096 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8498cc08-a772-430e-94f7-b2dada421306 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:18.515537 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8498cc08-a772-430e-94f7-b2dada421306 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:18.519170 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8498cc08-a772-430e-94f7-b2dada421306 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:18.520794 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8498cc08-a772-430e-94f7-b2dada421306 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:18.525213 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8498cc08-a772-430e-94f7-b2dada421306 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:18.657317 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-95b6337f-e88f-4ed9-94e5-cb376bb37440 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] 10.222.0.20 "GET /compute/v2.1/images/7c06454e-f4ee-4402-8078-68104b52d35a" status: 200 len: 1423 microversion: 2.1 time: 0.176190 Oct 04 18:31:18.657317 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 410/820] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:31:18 2022] GET /compute/v2.1/images/7c06454e-f4ee-4402-8078-68104b52d35a => generated 1423 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:18.661492 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-62e6f548-196e-4fd8-a9c2-8c9c138921a9 tempest-FloatingIPDetailsTestJSON-989363590 tempest-FloatingIPDetailsTestJSON-989363590-project] Calling method '.version_select at 0x7fe25924d670>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:18.920587 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8498cc08-a772-430e-94f7-b2dada421306 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:18.931698 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8498cc08-a772-430e-94f7-b2dada421306 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946" status: 200 len: 1504 microversion: 2.1 time: 0.461655 Oct 04 18:31:18.937502 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 411/821] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:18 2022] GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946 => generated 1504 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:18.963361 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-000c1b2b-0490-49c3-a691-a2ffa8bfcc6e tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:18.965937 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-000c1b2b-0490-49c3-a691-a2ffa8bfcc6e tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: 47fc818f-4a40-42b8-9698-0fdbed7631d6] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:18.986332 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-000c1b2b-0490-49c3-a691-a2ffa8bfcc6e tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:18.994335 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-000c1b2b-0490-49c3-a691-a2ffa8bfcc6e tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:18.995091 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-000c1b2b-0490-49c3-a691-a2ffa8bfcc6e tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:18.996218 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-000c1b2b-0490-49c3-a691-a2ffa8bfcc6e tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:18.999483 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-000c1b2b-0490-49c3-a691-a2ffa8bfcc6e tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:19.001510 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-000c1b2b-0490-49c3-a691-a2ffa8bfcc6e tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:19.091456 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-62e6f548-196e-4fd8-a9c2-8c9c138921a9 tempest-FloatingIPDetailsTestJSON-989363590 tempest-FloatingIPDetailsTestJSON-989363590-project] 10.222.0.20 "GET /compute/v2.1/os-floating-ips" status: 200 len: 397 microversion: 2.1 time: 0.434005 Oct 04 18:31:19.092303 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 411/822] 10.222.0.20 () {58 vars in 1149 bytes} [Tue Oct 4 18:31:18 2022] GET /compute/v2.1/os-floating-ips => generated 397 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:19.097010 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-fb3c9df4-a674-4469-af7b-87e0f4e59cb0 req-e9b7b83a-d0dd-43fa-b987-b281bcb26b8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1bf585c-9cc9-4f87-966c-e02882aa51fd", "name": "network-vif-deleted", "tag": "a08a497b-a75d-46e8-bb72-da6d0464043b"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:19.125915 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-fb3c9df4-a674-4469-af7b-87e0f4e59cb0 req-e9b7b83a-d0dd-43fa-b987-b281bcb26b8b service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:19.126711 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-fb3c9df4-a674-4469-af7b-87e0f4e59cb0 req-e9b7b83a-d0dd-43fa-b987-b281bcb26b8b service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:19.127330 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-fb3c9df4-a674-4469-af7b-87e0f4e59cb0 req-e9b7b83a-d0dd-43fa-b987-b281bcb26b8b service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:19.155977 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-fb3c9df4-a674-4469-af7b-87e0f4e59cb0 req-e9b7b83a-d0dd-43fa-b987-b281bcb26b8b service nova] Creating event network-vif-deleted:a08a497b-a75d-46e8-bb72-da6d0464043b for instance c1bf585c-9cc9-4f87-966c-e02882aa51fd on n-h1-850501-14 Oct 04 18:31:19.162887 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-fb3c9df4-a674-4469-af7b-87e0f4e59cb0 req-e9b7b83a-d0dd-43fa-b987-b281bcb26b8b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068592 Oct 04 18:31:19.163957 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 412/823] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:31:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:19.176396 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ac7452ba-9bfb-444c-9661-29d4b554e560 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:19.176396 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ac7452ba-9bfb-444c-9661-29d4b554e560 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: 609c8bd3-a9fc-4b16-ba22-c87aa44a822d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:19.182468 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ac7452ba-9bfb-444c-9661-29d4b554e560 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:19.183247 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ac7452ba-9bfb-444c-9661-29d4b554e560 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:19.183880 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ac7452ba-9bfb-444c-9661-29d4b554e560 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:19.184799 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ac7452ba-9bfb-444c-9661-29d4b554e560 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:19.185419 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ac7452ba-9bfb-444c-9661-29d4b554e560 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:19.186006 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ac7452ba-9bfb-444c-9661-29d4b554e560 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:19.285900 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-000c1b2b-0490-49c3-a691-a2ffa8bfcc6e tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:19.302096 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-000c1b2b-0490-49c3-a691-a2ffa8bfcc6e tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/47fc818f-4a40-42b8-9698-0fdbed7631d6" status: 200 len: 1316 microversion: 2.1 time: 0.363172 Oct 04 18:31:19.328247 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 412/824] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:18 2022] GET /compute/v2.1/servers/47fc818f-4a40-42b8-9698-0fdbed7631d6 => generated 1316 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:19.335141 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-862f4859-5ec8-4389-8f79-98bce006b8fe tempest-FloatingIPDetailsTestJSON-989363590 tempest-FloatingIPDetailsTestJSON-989363590-project] Calling method '.version_select at 0x7fe2592d7430>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:19.556520 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ac7452ba-9bfb-444c-9661-29d4b554e560 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:19.567568 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ac7452ba-9bfb-444c-9661-29d4b554e560 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:19.571158 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ac7452ba-9bfb-444c-9661-29d4b554e560 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:19.573288 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ac7452ba-9bfb-444c-9661-29d4b554e560 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/609c8bd3-a9fc-4b16-ba22-c87aa44a822d" status: 200 len: 1558 microversion: 2.25 time: 0.407900 Oct 04 18:31:19.574420 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 413/825] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:31:19 2022] GET /compute/v2.1/servers/609c8bd3-a9fc-4b16-ba22-c87aa44a822d => generated 1558 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:31:19.580136 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c49b75b9-8abc-49fb-a4c3-7cd12aceaf6f tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:19.581245 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c49b75b9-8abc-49fb-a4c3-7cd12aceaf6f tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] [instance: c1bf585c-9cc9-4f87-966c-e02882aa51fd] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:19.589913 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c49b75b9-8abc-49fb-a4c3-7cd12aceaf6f tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:19.590850 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c49b75b9-8abc-49fb-a4c3-7cd12aceaf6f tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:19.591532 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c49b75b9-8abc-49fb-a4c3-7cd12aceaf6f tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:19.592527 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c49b75b9-8abc-49fb-a4c3-7cd12aceaf6f tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:19.593258 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c49b75b9-8abc-49fb-a4c3-7cd12aceaf6f tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:19.593909 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c49b75b9-8abc-49fb-a4c3-7cd12aceaf6f tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:19.645516 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c49b75b9-8abc-49fb-a4c3-7cd12aceaf6f tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:19.646490 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c49b75b9-8abc-49fb-a4c3-7cd12aceaf6f tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:19.647239 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c49b75b9-8abc-49fb-a4c3-7cd12aceaf6f tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:19.647978 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-c49b75b9-8abc-49fb-a4c3-7cd12aceaf6f tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lazy-loading 'fault' on Instance uuid c1bf585c-9cc9-4f87-966c-e02882aa51fd {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:31:19.727488 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c49b75b9-8abc-49fb-a4c3-7cd12aceaf6f tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f49a275284a7eb714a55c6bdd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e44e7aa06ee4126b5705ba65145ebcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:19.737136 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c49b75b9-8abc-49fb-a4c3-7cd12aceaf6f tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] 10.222.0.20 "GET /compute/v2.1/servers/c1bf585c-9cc9-4f87-966c-e02882aa51fd" status: 200 len: 1315 microversion: 2.1 time: 0.161422 Oct 04 18:31:19.738417 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 414/826] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:19 2022] GET /compute/v2.1/servers/c1bf585c-9cc9-4f87-966c-e02882aa51fd => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:19.744125 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1d96d71a-c88c-47df-bf8e-687a5041901a tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:19.745135 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1d96d71a-c88c-47df-bf8e-687a5041901a tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] [instance: 5e154d65-5086-47c1-bba7-ea3dfd53f6e6] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:19.751850 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1d96d71a-c88c-47df-bf8e-687a5041901a tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:19.752695 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1d96d71a-c88c-47df-bf8e-687a5041901a tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:19.753389 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1d96d71a-c88c-47df-bf8e-687a5041901a tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:19.754447 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1d96d71a-c88c-47df-bf8e-687a5041901a tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:19.755125 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1d96d71a-c88c-47df-bf8e-687a5041901a tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:19.755778 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1d96d71a-c88c-47df-bf8e-687a5041901a tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:20.142553 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1d96d71a-c88c-47df-bf8e-687a5041901a tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89f12d146749b38c688b7581e53f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247c7ae3e4e4068a88a044e36945f32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:20.152824 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1d96d71a-c88c-47df-bf8e-687a5041901a tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] 10.222.0.20 "GET /compute/v2.1/servers/5e154d65-5086-47c1-bba7-ea3dfd53f6e6" status: 200 len: 1293 microversion: 2.1 time: 0.413111 Oct 04 18:31:20.153740 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 415/827] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:19 2022] GET /compute/v2.1/servers/5e154d65-5086-47c1-bba7-ea3dfd53f6e6 => generated 1293 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:20.175452 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3c3ee420-8ba8-4cf9-b4ce-eddd89e7055a tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Calling method '.version_select at 0x7fe2593da670>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:20.181100 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3c3ee420-8ba8-4cf9-b4ce-eddd89e7055a tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:20.181905 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3c3ee420-8ba8-4cf9-b4ce-eddd89e7055a tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:20.183128 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3c3ee420-8ba8-4cf9-b4ce-eddd89e7055a tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:20.207291 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3c3ee420-8ba8-4cf9-b4ce-eddd89e7055a tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 1351 microversion: 2.25 time: 0.036365 Oct 04 18:31:20.208562 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 416/828] 10.222.0.20 () {60 vars in 1184 bytes} [Tue Oct 4 18:31:20 2022] GET /compute/v2.1/os-migrations => generated 1351 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:31:20.213991 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d71db93c-1b95-456b-8f7c-f8c4bc466f8a tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Calling method '.version_select at 0x7fe2593da3a0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:20.293126 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d71db93c-1b95-456b-8f7c-f8c4bc466f8a tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] 10.222.0.20 "GET /compute/v2.1/images/7c06454e-f4ee-4402-8078-68104b52d35a" status: 200 len: 1423 microversion: 2.1 time: 0.083243 Oct 04 18:31:20.307638 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 417/829] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:31:20 2022] GET /compute/v2.1/images/7c06454e-f4ee-4402-8078-68104b52d35a => generated 1423 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:20.315060 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f675edf6-7f9c-46c7-a3e2-c0065f52b154 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:20.316100 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f675edf6-7f9c-46c7-a3e2-c0065f52b154 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 89738dfe-3844-455a-93d1-d38702038946] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:20.325197 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f675edf6-7f9c-46c7-a3e2-c0065f52b154 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:20.326028 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f675edf6-7f9c-46c7-a3e2-c0065f52b154 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:20.326641 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f675edf6-7f9c-46c7-a3e2-c0065f52b154 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:20.331711 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f675edf6-7f9c-46c7-a3e2-c0065f52b154 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:20.331711 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f675edf6-7f9c-46c7-a3e2-c0065f52b154 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:20.331711 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f675edf6-7f9c-46c7-a3e2-c0065f52b154 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:20.551414 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f675edf6-7f9c-46c7-a3e2-c0065f52b154 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:20.563257 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f675edf6-7f9c-46c7-a3e2-c0065f52b154 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946" status: 200 len: 1504 microversion: 2.1 time: 0.254182 Oct 04 18:31:20.563944 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 418/830] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:20 2022] GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946 => generated 1504 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:20.568617 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-24b24767-3885-4f38-91ab-f95d0ca1d976 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:20.569386 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-24b24767-3885-4f38-91ab-f95d0ca1d976 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] [instance: 609c8bd3-a9fc-4b16-ba22-c87aa44a822d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:20.575916 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-24b24767-3885-4f38-91ab-f95d0ca1d976 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:20.578401 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-24b24767-3885-4f38-91ab-f95d0ca1d976 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:20.578401 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-24b24767-3885-4f38-91ab-f95d0ca1d976 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:20.578401 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-24b24767-3885-4f38-91ab-f95d0ca1d976 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:20.578401 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-24b24767-3885-4f38-91ab-f95d0ca1d976 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:20.579074 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-24b24767-3885-4f38-91ab-f95d0ca1d976 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:20.811908 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-862f4859-5ec8-4389-8f79-98bce006b8fe tempest-FloatingIPDetailsTestJSON-989363590 tempest-FloatingIPDetailsTestJSON-989363590-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/19598b32-2f86-4b89-8c3a-d9de1dfa5c86" status: 202 len: 0 microversion: 2.1 time: 1.482426 Oct 04 18:31:20.815707 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 413/831] 10.222.0.20 () {58 vars in 1263 bytes} [Tue Oct 4 18:31:19 2022] DELETE /compute/v2.1/os-floating-ips/19598b32-2f86-4b89-8c3a-d9de1dfa5c86 => generated 0 bytes in 1484 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:31:20.817706 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a73c2f95-a1bd-4789-b25c-b8755dab84d2 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:20.818853 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a73c2f95-a1bd-4789-b25c-b8755dab84d2 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: 47fc818f-4a40-42b8-9698-0fdbed7631d6] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:20.827248 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:20.831612 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a73c2f95-a1bd-4789-b25c-b8755dab84d2 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:20.832356 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a73c2f95-a1bd-4789-b25c-b8755dab84d2 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:20.833084 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a73c2f95-a1bd-4789-b25c-b8755dab84d2 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:20.834883 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a73c2f95-a1bd-4789-b25c-b8755dab84d2 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:20.837199 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a73c2f95-a1bd-4789-b25c-b8755dab84d2 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:20.837522 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a73c2f95-a1bd-4789-b25c-b8755dab84d2 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:20.882706 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-24b24767-3885-4f38-91ab-f95d0ca1d976 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lazy-loading 'services' on Instance uuid 609c8bd3-a9fc-4b16-ba22-c87aa44a822d {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:31:20.893496 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-24b24767-3885-4f38-91ab-f95d0ca1d976 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/609c8bd3-a9fc-4b16-ba22-c87aa44a822d" status: 200 len: 2053 microversion: 2.25 time: 0.328557 Oct 04 18:31:20.894092 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 419/832] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:31:20 2022] GET /compute/v2.1/servers/609c8bd3-a9fc-4b16-ba22-c87aa44a822d => generated 2053 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:31:20.916134 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e623fcd3-8af2-4e13-bc6a-dbbe29034b22 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:20.917191 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e623fcd3-8af2-4e13-bc6a-dbbe29034b22 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] [instance: c1bf585c-9cc9-4f87-966c-e02882aa51fd] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:20.936009 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e623fcd3-8af2-4e13-bc6a-dbbe29034b22 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:20.936976 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e623fcd3-8af2-4e13-bc6a-dbbe29034b22 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:20.937503 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e623fcd3-8af2-4e13-bc6a-dbbe29034b22 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:20.938225 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e623fcd3-8af2-4e13-bc6a-dbbe29034b22 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:20.938691 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e623fcd3-8af2-4e13-bc6a-dbbe29034b22 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:20.939238 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e623fcd3-8af2-4e13-bc6a-dbbe29034b22 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:20.989118 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-e623fcd3-8af2-4e13-bc6a-dbbe29034b22 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] HTTP exception thrown: Instance c1bf585c-9cc9-4f87-966c-e02882aa51fd could not be found. Oct 04 18:31:20.992540 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e623fcd3-8af2-4e13-bc6a-dbbe29034b22 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Request method failure captured: Oct 04 18:31:20.992540 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/c1bf585c-9cc9-4f87-966c-e02882aa51fd HTTP/1.1 Oct 04 18:31:20.992540 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:31:20.992540 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:31:20.992540 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:31:20.992540 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:31:20.992540 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:31:20.992540 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:31:20.992540 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:31:20.992540 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:31:20.992540 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPHvII_T7EcjvuInFv4t5qVF70S9vjGBK66HvfyVnOiY_TVbsAPYjguHISQjMiOeT1bz8CjLq7zDrG77IXy0kQULYEqIfKm3jlSWTKPDcogOtbqbQpds3d11ZgBfbFr39fSjqioDU_0CmuRBwgkz6wZ-Zh6uUaL8av5rXkIBhSk0fN1E Oct 04 18:31:20.992540 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:31:20.992540 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:31:20.992540 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:31:20.992540 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:31:20.992540 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:31:20.992540 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:31:20.992540 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 7e44e7aa06ee4126b5705ba65145ebcc Oct 04 18:31:20.992540 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1566997612 Oct 04 18:31:20.992540 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:31:20.992540 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:31:20.994150 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e44e7aa06ee4126b5705ba65145ebcc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7e44e7aa06ee4126b5705ba65145ebcc", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7e44e7aa06ee4126b5705ba65145ebcc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e44e7aa06ee4126b5705ba65145ebcc"}]}] Oct 04 18:31:20.994150 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1566997612 Oct 04 18:31:20.994150 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 7e44e7aa06ee4126b5705ba65145ebcc Oct 04 18:31:20.994150 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1566997612 Oct 04 18:31:20.994150 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ImagesOneServerNegativeTestJSON-1566997612-project Oct 04 18:31:20.994150 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:31:20.994150 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:31:20.994150 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 415f49a275284a7eb714a55c6bdd0005 Oct 04 18:31:20.994150 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1566997612-project Oct 04 18:31:20.994150 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:31:20.994150 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance c1bf585c-9cc9-4f87-966c-e02882aa51fd could not be found. Oct 04 18:31:20.994150 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': 'c1bf585c-9cc9-4f87-966c-e02882aa51fd'} Oct 04 18:31:20.995035 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:31:20.995035 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:20.995035 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:31:20.995035 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:31:20.995035 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:31:20.995035 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:31:20.995035 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:31:20.995035 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:31:20.995035 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:31:20.995035 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:31:20.995035 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1bf585c-9cc9-4f87-966c-e02882aa51fd could not be found. Oct 04 18:31:20.995035 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:31:20.995035 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:31:20.995035 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:31:20.995035 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:20.995035 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:31:20.995035 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:31:20.995035 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:31:20.995035 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:31:20.995035 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:31:20.996591 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:31:20.996591 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:31:20.996591 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:31:20.996591 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:31:20.996591 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:31:20.996591 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:31:20.996591 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:31:20.996591 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1bf585c-9cc9-4f87-966c-e02882aa51fd could not be found. Oct 04 18:31:20.996591 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:31:20.996591 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:31:20.996591 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:31:20.996591 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:20.996591 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:31:20.996591 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:31:20.996591 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:31:20.996591 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:31:20.996591 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1bf585c-9cc9-4f87-966c-e02882aa51fd could not be found. Oct 04 18:31:20.996591 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:31:20.997894 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e623fcd3-8af2-4e13-bc6a-dbbe29034b22 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Returning 404 to user: Instance c1bf585c-9cc9-4f87-966c-e02882aa51fd could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:31:20.999410 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e623fcd3-8af2-4e13-bc6a-dbbe29034b22 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] 10.222.0.20 "GET /compute/v2.1/servers/c1bf585c-9cc9-4f87-966c-e02882aa51fd" status: 404 len: 111 microversion: 2.1 time: 0.104317 Oct 04 18:31:21.007783 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 420/833] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:20 2022] GET /compute/v2.1/servers/c1bf585c-9cc9-4f87-966c-e02882aa51fd => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:31:21.007783 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d8db88d7-24cc-45ad-90fd-7569ef62a948 tempest-FloatingIPDetailsTestJSON-989363590 tempest-FloatingIPDetailsTestJSON-989363590-project] Calling method '.version_select at 0x7fe259142c10>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:21.172894 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a73c2f95-a1bd-4789-b25c-b8755dab84d2 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:21.182648 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a73c2f95-a1bd-4789-b25c-b8755dab84d2 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/47fc818f-4a40-42b8-9698-0fdbed7631d6" status: 200 len: 1465 microversion: 2.1 time: 0.368740 Oct 04 18:31:21.183424 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 414/834] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:20 2022] GET /compute/v2.1/servers/47fc818f-4a40-42b8-9698-0fdbed7631d6 => generated 1465 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:21.190094 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-44670998-2a92-4e70-b07e-86ea66a0214d req-5700f39f-1bd7-4562-bd43-259f544b40d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e154d65-5086-47c1-bba7-ea3dfd53f6e6", "name": "network-vif-plugged", "status": "completed", "tag": "1eb398e0-da63-4b45-bace-cc05ff4d0f6f"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:21.204798 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-44670998-2a92-4e70-b07e-86ea66a0214d req-5700f39f-1bd7-4562-bd43-259f544b40d1 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:21.204798 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-44670998-2a92-4e70-b07e-86ea66a0214d req-5700f39f-1bd7-4562-bd43-259f544b40d1 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:21.204798 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-44670998-2a92-4e70-b07e-86ea66a0214d req-5700f39f-1bd7-4562-bd43-259f544b40d1 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:21.215948 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-44670998-2a92-4e70-b07e-86ea66a0214d req-5700f39f-1bd7-4562-bd43-259f544b40d1 service nova] Creating event network-vif-plugged:1eb398e0-da63-4b45-bace-cc05ff4d0f6f for instance 5e154d65-5086-47c1-bba7-ea3dfd53f6e6 on n-h2-850501-14 Oct 04 18:31:21.236820 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-44670998-2a92-4e70-b07e-86ea66a0214d req-5700f39f-1bd7-4562-bd43-259f544b40d1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051585 Oct 04 18:31:21.237799 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 415/835] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:31:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:21.244781 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-53def246-e520-4bdf-8101-1ef1d5ca01a8 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Action: 'create', calling method: .version_select at 0x7fe259416940>, body: {"keypair": {"name": "tempest-keypair-2104126223", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGsemIbXOWw+Oqe0B6eKdsihh8ejf/K/yEhGhYYtU3y1qQKsBdnLWQBPHrTUel0i2QI1Dft/t+WKUCGbZPN5vgVz0ctGmFfW5GUrvJgEkJ87W3GiTvKNXPi+sri3GICRUw=="}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:21.264262 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-53def246-e520-4bdf-8101-1ef1d5ca01a8 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Getting quotas for project 7e44e7aa06ee4126b5705ba65145ebcc. Resources: {'key_pairs'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:31:21.269358 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-53def246-e520-4bdf-8101-1ef1d5ca01a8 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Getting quotas for user 415f49a275284a7eb714a55c6bdd0005 and project 7e44e7aa06ee4126b5705ba65145ebcc. Resources: {'key_pairs'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:31:21.877886 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-53def246-e520-4bdf-8101-1ef1d5ca01a8 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.638798 Oct 04 18:31:21.878563 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 416/836] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Oct 4 18:31:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:21.883663 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2e8706f3-850f-4527-beb4-7f18ec9d3423 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-2076674567", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": [{"uuid": "f77e917f-247a-463a-8e5a-3fb6256ecb82"}]}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:21.940569 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-2e8706f3-850f-4527-beb4-7f18ec9d3423 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] validate_networks() for [('f77e917f-247a-463a-8e5a-3fb6256ecb82', None, None, None, None, None)] {{(pid=123002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:31:22.131349 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d8db88d7-24cc-45ad-90fd-7569ef62a948 tempest-FloatingIPDetailsTestJSON-989363590 tempest-FloatingIPDetailsTestJSON-989363590-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/6a0acc48-5328-43b5-8ae4-2fa9bf32ea28" status: 202 len: 0 microversion: 2.1 time: 1.129178 Oct 04 18:31:22.136599 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 421/837] 10.222.0.20 () {58 vars in 1263 bytes} [Tue Oct 4 18:31:21 2022] DELETE /compute/v2.1/os-floating-ips/6a0acc48-5328-43b5-8ae4-2fa9bf32ea28 => generated 0 bytes in 1135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:31:22.143557 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d578b395-8861-4f22-9c46-e944391a214d tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:22.146011 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d578b395-8861-4f22-9c46-e944391a214d tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] [instance: 5e154d65-5086-47c1-bba7-ea3dfd53f6e6] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:22.154460 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d578b395-8861-4f22-9c46-e944391a214d tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:22.155276 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d578b395-8861-4f22-9c46-e944391a214d tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:22.156116 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d578b395-8861-4f22-9c46-e944391a214d tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:22.158166 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d578b395-8861-4f22-9c46-e944391a214d tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:22.158873 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d578b395-8861-4f22-9c46-e944391a214d tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:22.159490 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d578b395-8861-4f22-9c46-e944391a214d tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:22.455227 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d578b395-8861-4f22-9c46-e944391a214d tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89f12d146749b38c688b7581e53f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247c7ae3e4e4068a88a044e36945f32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:22.458696 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d578b395-8861-4f22-9c46-e944391a214d tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] 10.222.0.20 "GET /compute/v2.1/servers/5e154d65-5086-47c1-bba7-ea3dfd53f6e6" status: 200 len: 1293 microversion: 2.1 time: 0.320538 Oct 04 18:31:22.459678 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 422/838] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:22 2022] GET /compute/v2.1/servers/5e154d65-5086-47c1-bba7-ea3dfd53f6e6 => generated 1293 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:22.464098 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-07dd9eaf-f920-4214-80d4-02bf0b2efddc tempest-ServersOnMultiNodesTest-1719152185 tempest-ServersOnMultiNodesTest-1719152185-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:22.464931 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-07dd9eaf-f920-4214-80d4-02bf0b2efddc tempest-ServersOnMultiNodesTest-1719152185 tempest-ServersOnMultiNodesTest-1719152185-project-admin] [instance: 47fc818f-4a40-42b8-9698-0fdbed7631d6] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:22.473122 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-07dd9eaf-f920-4214-80d4-02bf0b2efddc tempest-ServersOnMultiNodesTest-1719152185 tempest-ServersOnMultiNodesTest-1719152185-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:22.473658 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-07dd9eaf-f920-4214-80d4-02bf0b2efddc tempest-ServersOnMultiNodesTest-1719152185 tempest-ServersOnMultiNodesTest-1719152185-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:22.474099 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-07dd9eaf-f920-4214-80d4-02bf0b2efddc tempest-ServersOnMultiNodesTest-1719152185 tempest-ServersOnMultiNodesTest-1719152185-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:22.475423 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-07dd9eaf-f920-4214-80d4-02bf0b2efddc tempest-ServersOnMultiNodesTest-1719152185 tempest-ServersOnMultiNodesTest-1719152185-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:22.475890 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-07dd9eaf-f920-4214-80d4-02bf0b2efddc tempest-ServersOnMultiNodesTest-1719152185 tempest-ServersOnMultiNodesTest-1719152185-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:22.476352 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-07dd9eaf-f920-4214-80d4-02bf0b2efddc tempest-ServersOnMultiNodesTest-1719152185 tempest-ServersOnMultiNodesTest-1719152185-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:22.662817 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-2e8706f3-850f-4527-beb4-7f18ec9d3423 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:31:22.663603 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-2e8706f3-850f-4527-beb4-7f18ec9d3423 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:31:22.664296 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-2e8706f3-850f-4527-beb4-7f18ec9d3423 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:31:22.664995 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-2e8706f3-850f-4527-beb4-7f18ec9d3423 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:31:22.665561 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-2e8706f3-850f-4527-beb4-7f18ec9d3423 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:31:22.675517 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e8706f3-850f-4527-beb4-7f18ec9d3423 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:22.676007 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e8706f3-850f-4527-beb4-7f18ec9d3423 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:22.676469 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e8706f3-850f-4527-beb4-7f18ec9d3423 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:22.677380 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e8706f3-850f-4527-beb4-7f18ec9d3423 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:22.678078 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e8706f3-850f-4527-beb4-7f18ec9d3423 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:22.678808 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e8706f3-850f-4527-beb4-7f18ec9d3423 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:22.693234 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-07dd9eaf-f920-4214-80d4-02bf0b2efddc tempest-ServersOnMultiNodesTest-1719152185 tempest-ServersOnMultiNodesTest-1719152185-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/47fc818f-4a40-42b8-9698-0fdbed7631d6" status: 200 len: 1618 microversion: 2.1 time: 0.232433 Oct 04 18:31:22.693829 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 423/839] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:22 2022] GET /compute/v2.1/servers/47fc818f-4a40-42b8-9698-0fdbed7631d6 => generated 1618 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:22.698213 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-2e8706f3-850f-4527-beb4-7f18ec9d3423 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Getting quotas for project 1fdde079f17642c69fb250c78903d69c. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:31:22.698825 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c6ec1f58-d1dc-493d-b728-11f4d6f63a31 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Calling method '.version_select at 0x7fe2595f94c0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:22.702869 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-2e8706f3-850f-4527-beb4-7f18ec9d3423 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Getting quotas for user f1dec45626f44157a6f4637e668097b4 and project 1fdde079f17642c69fb250c78903d69c. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:31:22.719278 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2e8706f3-850f-4527-beb4-7f18ec9d3423 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Going to run 1 instances... {{(pid=123002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:31:22.723900 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2e8706f3-850f-4527-beb4-7f18ec9d3423 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: 6b629ba0-6245-442f-bf1a-ad1c1a3116bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:31:22.767247 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c6ec1f58-d1dc-493d-b728-11f4d6f63a31 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] 10.222.0.20 "GET /compute/v2.1/images/7c06454e-f4ee-4402-8078-68104b52d35a" status: 200 len: 1423 microversion: 2.1 time: 0.072331 Oct 04 18:31:22.768158 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 424/840] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:31:22 2022] GET /compute/v2.1/images/7c06454e-f4ee-4402-8078-68104b52d35a => generated 1423 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:22.774135 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ad342261-f00c-43f2-a144-de0877ef6378 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:22.774754 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ad342261-f00c-43f2-a144-de0877ef6378 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 89738dfe-3844-455a-93d1-d38702038946] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:22.783714 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ad342261-f00c-43f2-a144-de0877ef6378 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:22.784363 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ad342261-f00c-43f2-a144-de0877ef6378 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:22.784850 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ad342261-f00c-43f2-a144-de0877ef6378 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:22.785643 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ad342261-f00c-43f2-a144-de0877ef6378 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:22.786142 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ad342261-f00c-43f2-a144-de0877ef6378 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:22.786589 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ad342261-f00c-43f2-a144-de0877ef6378 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:22.895146 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2e8706f3-850f-4527-beb4-7f18ec9d3423 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.015089 Oct 04 18:31:22.896989 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 417/841] 10.222.0.20 () {62 vars in 1188 bytes} [Tue Oct 4 18:31:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1018 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 18:31:22.902255 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0ff8f12f-86c0-4299-a318-4f2e822f75d9 tempest-FloatingIPDetailsTestJSON-989363590 tempest-FloatingIPDetailsTestJSON-989363590-project] Calling method '.version_select at 0x7fe2592d7e50>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:23.163294 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ad342261-f00c-43f2-a144-de0877ef6378 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:23.171876 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ad342261-f00c-43f2-a144-de0877ef6378 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946" status: 200 len: 1504 microversion: 2.1 time: 0.402086 Oct 04 18:31:23.184092 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 425/842] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:22 2022] GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946 => generated 1504 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:23.184092 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ad60ac2b-2013-4371-99b2-8b5b20e1fd13 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-655779256", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "2e85db28-c393-4e02-8f28-bf0d217b6db7"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:23.252666 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.neutron [None req-ad60ac2b-2013-4371-99b2-8b5b20e1fd13 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] validate_networks() for None {{(pid=123001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:31:24.132665 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-ad60ac2b-2013-4371-99b2-8b5b20e1fd13 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:31:24.133191 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-ad60ac2b-2013-4371-99b2-8b5b20e1fd13 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:31:24.134024 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-ad60ac2b-2013-4371-99b2-8b5b20e1fd13 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:31:24.134503 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-ad60ac2b-2013-4371-99b2-8b5b20e1fd13 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:31:24.134980 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-ad60ac2b-2013-4371-99b2-8b5b20e1fd13 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:31:24.144162 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ad60ac2b-2013-4371-99b2-8b5b20e1fd13 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:24.144654 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ad60ac2b-2013-4371-99b2-8b5b20e1fd13 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:24.145087 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ad60ac2b-2013-4371-99b2-8b5b20e1fd13 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:24.145847 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ad60ac2b-2013-4371-99b2-8b5b20e1fd13 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:24.146303 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ad60ac2b-2013-4371-99b2-8b5b20e1fd13 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:24.147629 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ad60ac2b-2013-4371-99b2-8b5b20e1fd13 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:24.167596 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-ad60ac2b-2013-4371-99b2-8b5b20e1fd13 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Getting quotas for project 771211a4ce424aa48920ff102c894a9f. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:31:24.172534 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-ad60ac2b-2013-4371-99b2-8b5b20e1fd13 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Getting quotas for user 07dd131fa3c44d439d0f3ec6e4b8ad42 and project 771211a4ce424aa48920ff102c894a9f. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:31:24.186241 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ad60ac2b-2013-4371-99b2-8b5b20e1fd13 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Going to run 1 instances... {{(pid=123001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:31:24.188656 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ad60ac2b-2013-4371-99b2-8b5b20e1fd13 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: fd73ee96-f932-48db-a1b5-664bb9740994] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:31:24.354353 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ad60ac2b-2013-4371-99b2-8b5b20e1fd13 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.180879 Oct 04 18:31:24.361573 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 426/843] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:31:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1188 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:31:24.367716 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-682f4233-c947-4193-ac02-1ad71c5b8145 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:24.368603 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-682f4233-c947-4193-ac02-1ad71c5b8145 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: 6b629ba0-6245-442f-bf1a-ad1c1a3116bc] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:24.375111 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-682f4233-c947-4193-ac02-1ad71c5b8145 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:24.375833 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-682f4233-c947-4193-ac02-1ad71c5b8145 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:24.376490 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-682f4233-c947-4193-ac02-1ad71c5b8145 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:24.377379 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-682f4233-c947-4193-ac02-1ad71c5b8145 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:24.378006 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-682f4233-c947-4193-ac02-1ad71c5b8145 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:24.378596 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-682f4233-c947-4193-ac02-1ad71c5b8145 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:24.509451 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-682f4233-c947-4193-ac02-1ad71c5b8145 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:24.528995 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-682f4233-c947-4193-ac02-1ad71c5b8145 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:24.528995 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-682f4233-c947-4193-ac02-1ad71c5b8145 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:24.528995 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-682f4233-c947-4193-ac02-1ad71c5b8145 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/6b629ba0-6245-442f-bf1a-ad1c1a3116bc" status: 200 len: 1258 microversion: 2.25 time: 0.165005 Oct 04 18:31:24.529959 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 427/844] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:31:24 2022] GET /compute/v2.1/servers/6b629ba0-6245-442f-bf1a-ad1c1a3116bc => generated 1258 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:31:24.557174 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6e7aa263-4b15-492a-abd3-6bb6164375d9 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:24.560876 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6e7aa263-4b15-492a-abd3-6bb6164375d9 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] [instance: 5e154d65-5086-47c1-bba7-ea3dfd53f6e6] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:24.566646 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6e7aa263-4b15-492a-abd3-6bb6164375d9 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:24.567268 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6e7aa263-4b15-492a-abd3-6bb6164375d9 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:24.567960 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6e7aa263-4b15-492a-abd3-6bb6164375d9 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:24.569114 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6e7aa263-4b15-492a-abd3-6bb6164375d9 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:24.569773 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6e7aa263-4b15-492a-abd3-6bb6164375d9 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:24.570307 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6e7aa263-4b15-492a-abd3-6bb6164375d9 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:24.680577 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0ff8f12f-86c0-4299-a318-4f2e822f75d9 tempest-FloatingIPDetailsTestJSON-989363590 tempest-FloatingIPDetailsTestJSON-989363590-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/642b17ca-3587-4dc9-9987-c3bb3e64744d" status: 202 len: 0 microversion: 2.1 time: 1.781953 Oct 04 18:31:24.685650 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 418/845] 10.222.0.20 () {58 vars in 1263 bytes} [Tue Oct 4 18:31:22 2022] DELETE /compute/v2.1/os-floating-ips/642b17ca-3587-4dc9-9987-c3bb3e64744d => generated 0 bytes in 1788 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:31:24.691328 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6a0543ec-ce7d-4093-8c98-8640abeec203 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Calling method '.version_select at 0x7fe259335310>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:24.756040 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6a0543ec-ce7d-4093-8c98-8640abeec203 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] 10.222.0.20 "GET /compute/v2.1/images/7c06454e-f4ee-4402-8078-68104b52d35a" status: 200 len: 1432 microversion: 2.1 time: 0.068783 Oct 04 18:31:24.756922 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 419/846] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:31:24 2022] GET /compute/v2.1/images/7c06454e-f4ee-4402-8078-68104b52d35a => generated 1432 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:24.763522 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-cbe861a0-a165-4367-8373-56444fbc1bab tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:24.765244 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-cbe861a0-a165-4367-8373-56444fbc1bab tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 89738dfe-3844-455a-93d1-d38702038946] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:24.784393 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cbe861a0-a165-4367-8373-56444fbc1bab tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:24.784393 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cbe861a0-a165-4367-8373-56444fbc1bab tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:24.784393 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cbe861a0-a165-4367-8373-56444fbc1bab tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:24.784393 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cbe861a0-a165-4367-8373-56444fbc1bab tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:24.785107 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cbe861a0-a165-4367-8373-56444fbc1bab tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:24.785107 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cbe861a0-a165-4367-8373-56444fbc1bab tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:24.946974 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6e7aa263-4b15-492a-abd3-6bb6164375d9 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89f12d146749b38c688b7581e53f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247c7ae3e4e4068a88a044e36945f32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:24.960580 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6e7aa263-4b15-492a-abd3-6bb6164375d9 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] 10.222.0.20 "GET /compute/v2.1/servers/5e154d65-5086-47c1-bba7-ea3dfd53f6e6" status: 200 len: 1485 microversion: 2.1 time: 0.429163 Oct 04 18:31:24.961405 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 428/847] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:24 2022] GET /compute/v2.1/servers/5e154d65-5086-47c1-bba7-ea3dfd53f6e6 => generated 1485 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:24.976114 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-43d1a6b7-2a4b-430a-975c-a29266d6760f tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:24.980239 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-43d1a6b7-2a4b-430a-975c-a29266d6760f tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: fd73ee96-f932-48db-a1b5-664bb9740994] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:25.075013 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-43d1a6b7-2a4b-430a-975c-a29266d6760f tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:25.078986 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-cbe861a0-a165-4367-8373-56444fbc1bab tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:25.083468 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-43d1a6b7-2a4b-430a-975c-a29266d6760f tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/fd73ee96-f932-48db-a1b5-664bb9740994" status: 200 len: 1216 microversion: 2.1 time: 0.120618 Oct 04 18:31:25.087301 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-cbe861a0-a165-4367-8373-56444fbc1bab tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946" status: 200 len: 1504 microversion: 2.1 time: 0.329196 Oct 04 18:31:25.100323 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 429/848] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:24 2022] GET /compute/v2.1/servers/fd73ee96-f932-48db-a1b5-664bb9740994 => generated 1216 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:25.103954 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 420/849] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:24 2022] GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946 => generated 1504 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:25.108979 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-06d13a8c-11ff-43ce-8bd9-de3be40f8e2d tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Calling method '.version_select at 0x7fe2593daca0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:25.120568 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7ff1b0df-0586-4b8e-964a-26163cb0cdbc tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:25.132218 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7ff1b0df-0586-4b8e-964a-26163cb0cdbc tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] [instance: 5e154d65-5086-47c1-bba7-ea3dfd53f6e6] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:25.138435 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7ff1b0df-0586-4b8e-964a-26163cb0cdbc tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:25.138938 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7ff1b0df-0586-4b8e-964a-26163cb0cdbc tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:25.139624 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7ff1b0df-0586-4b8e-964a-26163cb0cdbc tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:25.140097 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7ff1b0df-0586-4b8e-964a-26163cb0cdbc tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:25.140562 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7ff1b0df-0586-4b8e-964a-26163cb0cdbc tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:25.140993 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7ff1b0df-0586-4b8e-964a-26163cb0cdbc tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:25.185004 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-06d13a8c-11ff-43ce-8bd9-de3be40f8e2d tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] 10.222.0.20 "GET /compute/v2.1/images/7c06454e-f4ee-4402-8078-68104b52d35a" status: 200 len: 1432 microversion: 2.1 time: 0.083223 Oct 04 18:31:25.196359 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 430/850] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:31:25 2022] GET /compute/v2.1/images/7c06454e-f4ee-4402-8078-68104b52d35a => generated 1432 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:25.201674 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a54f5f4f-76e3-4030-8293-a4e5d5163a76 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-420187503", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:25.267512 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.neutron [None req-a54f5f4f-76e3-4030-8293-a4e5d5163a76 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] validate_networks() for [('51e9c15f-99f8-4dc7-83c1-3f0cf4949f12', None, None, None, None, None)] {{(pid=123001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:31:25.280650 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7ff1b0df-0586-4b8e-964a-26163cb0cdbc tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] 10.222.0.20 "GET /compute/v2.1/servers/5e154d65-5086-47c1-bba7-ea3dfd53f6e6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.175486 Oct 04 18:31:25.281462 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 421/851] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Oct 4 18:31:25 2022] GET /compute/v2.1/servers/5e154d65-5086-47c1-bba7-ea3dfd53f6e6/os-interface => generated 285 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:25.286489 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6cecee1c-32c7-4939-8b18-bb2bc596fd58 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:25.288407 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-6cecee1c-32c7-4939-8b18-bb2bc596fd58 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] [instance: 836f71c5-d859-4d09-9956-922b0bbee3ae] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:25.299233 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6cecee1c-32c7-4939-8b18-bb2bc596fd58 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:25.305613 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6cecee1c-32c7-4939-8b18-bb2bc596fd58 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:25.305613 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6cecee1c-32c7-4939-8b18-bb2bc596fd58 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:25.305613 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6cecee1c-32c7-4939-8b18-bb2bc596fd58 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:25.305613 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6cecee1c-32c7-4939-8b18-bb2bc596fd58 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:25.306023 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6cecee1c-32c7-4939-8b18-bb2bc596fd58 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:25.863573 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-6cecee1c-32c7-4939-8b18-bb2bc596fd58 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d326c048306423a87ddef70295a75e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1cc290c58149f8988cc3d69aff9efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:25.876816 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6cecee1c-32c7-4939-8b18-bb2bc596fd58 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] 10.222.0.20 "GET /compute/v2.1/servers/836f71c5-d859-4d09-9956-922b0bbee3ae" status: 200 len: 1466 microversion: 2.1 time: 0.594039 Oct 04 18:31:25.877407 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 422/852] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:25 2022] GET /compute/v2.1/servers/836f71c5-d859-4d09-9956-922b0bbee3ae => generated 1466 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:25.882509 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-22d5b440-5933-48c3-b823-6203c2a2022c req-1e350c8b-4a15-4a77-8706-c7ec1e8fa409 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89738dfe-3844-455a-93d1-d38702038946", "name": "network-vif-unplugged", "status": "completed", "tag": "77050755-1aa5-4d6d-8323-2fb66ab475c5"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:25.895219 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-22d5b440-5933-48c3-b823-6203c2a2022c req-1e350c8b-4a15-4a77-8706-c7ec1e8fa409 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:25.895709 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-22d5b440-5933-48c3-b823-6203c2a2022c req-1e350c8b-4a15-4a77-8706-c7ec1e8fa409 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:25.896168 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-22d5b440-5933-48c3-b823-6203c2a2022c req-1e350c8b-4a15-4a77-8706-c7ec1e8fa409 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:25.922980 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-22d5b440-5933-48c3-b823-6203c2a2022c req-1e350c8b-4a15-4a77-8706-c7ec1e8fa409 service nova] Creating event network-vif-unplugged:77050755-1aa5-4d6d-8323-2fb66ab475c5 for instance 89738dfe-3844-455a-93d1-d38702038946 on n-h1-850501-14 Oct 04 18:31:25.931261 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-22d5b440-5933-48c3-b823-6203c2a2022c req-1e350c8b-4a15-4a77-8706-c7ec1e8fa409 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052423 Oct 04 18:31:25.936285 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 423/853] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:31:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:25.941440 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c739d790-581c-4e50-9974-91756de312a1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:25.942156 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c739d790-581c-4e50-9974-91756de312a1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: 6b629ba0-6245-442f-bf1a-ad1c1a3116bc] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:25.948932 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c739d790-581c-4e50-9974-91756de312a1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:25.949656 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c739d790-581c-4e50-9974-91756de312a1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:25.950275 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c739d790-581c-4e50-9974-91756de312a1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:25.951224 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c739d790-581c-4e50-9974-91756de312a1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:25.951685 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c739d790-581c-4e50-9974-91756de312a1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:25.952204 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c739d790-581c-4e50-9974-91756de312a1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:26.078560 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c739d790-581c-4e50-9974-91756de312a1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:26.094303 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c739d790-581c-4e50-9974-91756de312a1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:26.096319 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c739d790-581c-4e50-9974-91756de312a1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:26.097728 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c739d790-581c-4e50-9974-91756de312a1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/6b629ba0-6245-442f-bf1a-ad1c1a3116bc" status: 200 len: 1332 microversion: 2.25 time: 0.163501 Oct 04 18:31:26.098558 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 424/854] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:31:25 2022] GET /compute/v2.1/servers/6b629ba0-6245-442f-bf1a-ad1c1a3116bc => generated 1332 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:31:26.105128 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4d5357c3-f733-4739-9d3d-4d45246fc47b tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Calling method '.version_select at 0x7fe259555ee0>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:26.182807 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4d5357c3-f733-4739-9d3d-4d45246fc47b tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] 10.222.0.20 "GET /compute/v2.1/images/f545e662-10b3-46b1-88bb-6e66dd294559" status: 200 len: 784 microversion: 2.1 time: 0.082560 Oct 04 18:31:26.186592 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 425/855] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:31:26 2022] GET /compute/v2.1/images/f545e662-10b3-46b1-88bb-6e66dd294559 => generated 784 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:26.190753 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-229405b9-fecd-4001-b688-83e14981050c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:26.191668 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-229405b9-fecd-4001-b688-83e14981050c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: fd73ee96-f932-48db-a1b5-664bb9740994] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:26.198747 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-229405b9-fecd-4001-b688-83e14981050c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:26.200110 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-229405b9-fecd-4001-b688-83e14981050c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:26.200592 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-229405b9-fecd-4001-b688-83e14981050c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:26.201300 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-229405b9-fecd-4001-b688-83e14981050c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:26.201758 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-229405b9-fecd-4001-b688-83e14981050c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:26.202366 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-229405b9-fecd-4001-b688-83e14981050c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:26.371217 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-229405b9-fecd-4001-b688-83e14981050c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:26.379320 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-229405b9-fecd-4001-b688-83e14981050c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/fd73ee96-f932-48db-a1b5-664bb9740994" status: 200 len: 1268 microversion: 2.1 time: 0.193471 Oct 04 18:31:26.392640 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 426/856] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:26 2022] GET /compute/v2.1/servers/fd73ee96-f932-48db-a1b5-664bb9740994 => generated 1268 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:26.411083 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5987712f-9d8e-4125-a65f-8193e402d086 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:26.413932 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5987712f-9d8e-4125-a65f-8193e402d086 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 89738dfe-3844-455a-93d1-d38702038946] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:26.429388 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5987712f-9d8e-4125-a65f-8193e402d086 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:26.430407 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5987712f-9d8e-4125-a65f-8193e402d086 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:26.431132 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5987712f-9d8e-4125-a65f-8193e402d086 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:26.432156 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5987712f-9d8e-4125-a65f-8193e402d086 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:26.433099 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5987712f-9d8e-4125-a65f-8193e402d086 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:26.433789 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5987712f-9d8e-4125-a65f-8193e402d086 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:27.220127 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-a54f5f4f-76e3-4030-8293-a4e5d5163a76 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:31:27.220718 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-a54f5f4f-76e3-4030-8293-a4e5d5163a76 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:31:27.221276 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-a54f5f4f-76e3-4030-8293-a4e5d5163a76 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:31:27.222112 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-a54f5f4f-76e3-4030-8293-a4e5d5163a76 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:31:27.222608 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-a54f5f4f-76e3-4030-8293-a4e5d5163a76 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:31:27.233162 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a54f5f4f-76e3-4030-8293-a4e5d5163a76 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:27.234054 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a54f5f4f-76e3-4030-8293-a4e5d5163a76 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:27.234460 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a54f5f4f-76e3-4030-8293-a4e5d5163a76 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:27.235266 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a54f5f4f-76e3-4030-8293-a4e5d5163a76 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:27.236043 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a54f5f4f-76e3-4030-8293-a4e5d5163a76 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:27.236611 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a54f5f4f-76e3-4030-8293-a4e5d5163a76 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:27.256917 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-a54f5f4f-76e3-4030-8293-a4e5d5163a76 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Getting quotas for project 7e44e7aa06ee4126b5705ba65145ebcc. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:31:27.262555 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-a54f5f4f-76e3-4030-8293-a4e5d5163a76 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Getting quotas for user 415f49a275284a7eb714a55c6bdd0005 and project 7e44e7aa06ee4126b5705ba65145ebcc. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:31:27.292229 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a54f5f4f-76e3-4030-8293-a4e5d5163a76 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Going to run 1 instances... {{(pid=123001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:31:27.294663 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a54f5f4f-76e3-4030-8293-a4e5d5163a76 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] [instance: e17c5b3e-a598-4369-9cf7-027a563e59fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:31:27.337221 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5987712f-9d8e-4125-a65f-8193e402d086 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:27.348855 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5987712f-9d8e-4125-a65f-8193e402d086 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946" status: 200 len: 1504 microversion: 2.1 time: 0.955039 Oct 04 18:31:27.354848 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 427/857] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:26 2022] GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946 => generated 1504 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:27.366093 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d4cb8b47-7ac9-40de-b66f-c16015699eca tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:27.385908 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d4cb8b47-7ac9-40de-b66f-c16015699eca tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.030625 Oct 04 18:31:27.386839 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 428/858] 10.222.0.20 () {58 vars in 1137 bytes} [Tue Oct 4 18:31:27 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:27.397262 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-ff735803-f7a9-4ed1-bf09-8d390111940a req-2488873c-d9d0-4ea5-9ad2-904e7f35f9c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "836f71c5-d859-4d09-9956-922b0bbee3ae", "name": "network-vif-unplugged", "status": "completed", "tag": "0a037711-4826-46fe-ab3b-3321a329f5e9"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:27.408803 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-ff735803-f7a9-4ed1-bf09-8d390111940a req-2488873c-d9d0-4ea5-9ad2-904e7f35f9c0 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:27.409616 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-ff735803-f7a9-4ed1-bf09-8d390111940a req-2488873c-d9d0-4ea5-9ad2-904e7f35f9c0 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:27.410260 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-ff735803-f7a9-4ed1-bf09-8d390111940a req-2488873c-d9d0-4ea5-9ad2-904e7f35f9c0 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:27.422616 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-ff735803-f7a9-4ed1-bf09-8d390111940a req-2488873c-d9d0-4ea5-9ad2-904e7f35f9c0 service nova] Creating event network-vif-unplugged:0a037711-4826-46fe-ab3b-3321a329f5e9 for instance 836f71c5-d859-4d09-9956-922b0bbee3ae on n-h1-850501-14 Oct 04 18:31:27.429064 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-ff735803-f7a9-4ed1-bf09-8d390111940a req-2488873c-d9d0-4ea5-9ad2-904e7f35f9c0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040947 Oct 04 18:31:27.430255 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 429/859] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:31:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:27.437668 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-66c4688a-0d14-47d3-8fd5-eb5d5ce6dfb8 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:27.441995 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-66c4688a-0d14-47d3-8fd5-eb5d5ce6dfb8 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: 6b629ba0-6245-442f-bf1a-ad1c1a3116bc] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:27.445025 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-66c4688a-0d14-47d3-8fd5-eb5d5ce6dfb8 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:27.445739 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-66c4688a-0d14-47d3-8fd5-eb5d5ce6dfb8 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:27.446387 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-66c4688a-0d14-47d3-8fd5-eb5d5ce6dfb8 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:27.447335 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-66c4688a-0d14-47d3-8fd5-eb5d5ce6dfb8 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:27.448000 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-66c4688a-0d14-47d3-8fd5-eb5d5ce6dfb8 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:27.448662 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-66c4688a-0d14-47d3-8fd5-eb5d5ce6dfb8 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:27.494085 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a54f5f4f-76e3-4030-8293-a4e5d5163a76 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.293530 Oct 04 18:31:27.494945 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 431/860] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:31:25 2022] POST /compute/v2.1/servers => generated 383 bytes in 2298 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:31:27.518955 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-462fc356-3bd2-4d14-a15c-4969c924f697 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Calling method '.version_select at 0x7fe2590ea3a0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:27.761919 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-66c4688a-0d14-47d3-8fd5-eb5d5ce6dfb8 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:27.778405 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-66c4688a-0d14-47d3-8fd5-eb5d5ce6dfb8 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:27.781395 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-66c4688a-0d14-47d3-8fd5-eb5d5ce6dfb8 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:27.784710 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-66c4688a-0d14-47d3-8fd5-eb5d5ce6dfb8 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/6b629ba0-6245-442f-bf1a-ad1c1a3116bc" status: 200 len: 1362 microversion: 2.25 time: 0.352807 Oct 04 18:31:27.801186 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 430/861] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:31:27 2022] GET /compute/v2.1/servers/6b629ba0-6245-442f-bf1a-ad1c1a3116bc => generated 1362 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:31:27.807284 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ca7febc1-b934-4ea1-95ff-fcf6c47759ec tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:27.808201 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ca7febc1-b934-4ea1-95ff-fcf6c47759ec tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: fd73ee96-f932-48db-a1b5-664bb9740994] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:27.821832 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ca7febc1-b934-4ea1-95ff-fcf6c47759ec tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:27.823841 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ca7febc1-b934-4ea1-95ff-fcf6c47759ec tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:27.824471 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ca7febc1-b934-4ea1-95ff-fcf6c47759ec tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:27.825457 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ca7febc1-b934-4ea1-95ff-fcf6c47759ec tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:27.827881 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ca7febc1-b934-4ea1-95ff-fcf6c47759ec tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:27.827881 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ca7febc1-b934-4ea1-95ff-fcf6c47759ec tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:27.861298 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=100 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:27.943002 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ca7febc1-b934-4ea1-95ff-fcf6c47759ec tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:27.971352 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ca7febc1-b934-4ea1-95ff-fcf6c47759ec tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/fd73ee96-f932-48db-a1b5-664bb9740994" status: 200 len: 1274 microversion: 2.1 time: 0.167760 Oct 04 18:31:27.974042 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 431/862] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:27 2022] GET /compute/v2.1/servers/fd73ee96-f932-48db-a1b5-664bb9740994 => generated 1274 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:27.980920 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d15f3522-5fc2-41eb-84ea-9013785f2598 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:27.981539 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d15f3522-5fc2-41eb-84ea-9013785f2598 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] [instance: e17c5b3e-a598-4369-9cf7-027a563e59fa] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:28.147013 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d15f3522-5fc2-41eb-84ea-9013785f2598 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f49a275284a7eb714a55c6bdd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e44e7aa06ee4126b5705ba65145ebcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:28.154520 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d15f3522-5fc2-41eb-84ea-9013785f2598 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] 10.222.0.20 "GET /compute/v2.1/servers/e17c5b3e-a598-4369-9cf7-027a563e59fa" status: 200 len: 1224 microversion: 2.1 time: 0.178574 Oct 04 18:31:28.155534 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 432/863] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:27 2022] GET /compute/v2.1/servers/e17c5b3e-a598-4369-9cf7-027a563e59fa => generated 1224 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:28.160741 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-b62cca01-c8d4-490d-ae77-29f34fab7dd1 req-f5a92005-384f-4528-8333-174fe93306ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89738dfe-3844-455a-93d1-d38702038946", "tag": "77050755-1aa5-4d6d-8323-2fb66ab475c5"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:28.171734 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-b62cca01-c8d4-490d-ae77-29f34fab7dd1 req-f5a92005-384f-4528-8333-174fe93306ef service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:28.172402 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-b62cca01-c8d4-490d-ae77-29f34fab7dd1 req-f5a92005-384f-4528-8333-174fe93306ef service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:28.172895 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-b62cca01-c8d4-490d-ae77-29f34fab7dd1 req-f5a92005-384f-4528-8333-174fe93306ef service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:28.188948 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-b62cca01-c8d4-490d-ae77-29f34fab7dd1 req-f5a92005-384f-4528-8333-174fe93306ef service nova] Creating event network-changed:77050755-1aa5-4d6d-8323-2fb66ab475c5 for instance 89738dfe-3844-455a-93d1-d38702038946 on n-h1-850501-14 Oct 04 18:31:28.195041 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-b62cca01-c8d4-490d-ae77-29f34fab7dd1 req-f5a92005-384f-4528-8333-174fe93306ef service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038145 Oct 04 18:31:28.196316 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 433/864] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:31:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:28.377627 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-931b1b86-8b44-406e-b592-89dde9f0058d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:28.378334 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-931b1b86-8b44-406e-b592-89dde9f0058d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 89738dfe-3844-455a-93d1-d38702038946] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:28.401767 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-931b1b86-8b44-406e-b592-89dde9f0058d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:28.402224 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-931b1b86-8b44-406e-b592-89dde9f0058d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:28.402714 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-931b1b86-8b44-406e-b592-89dde9f0058d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:28.403656 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-931b1b86-8b44-406e-b592-89dde9f0058d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:28.404344 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-931b1b86-8b44-406e-b592-89dde9f0058d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:28.405077 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-931b1b86-8b44-406e-b592-89dde9f0058d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:28.596048 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-931b1b86-8b44-406e-b592-89dde9f0058d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:28.609204 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-931b1b86-8b44-406e-b592-89dde9f0058d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946" status: 200 len: 1504 microversion: 2.1 time: 0.235586 Oct 04 18:31:28.610382 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 434/865] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:28 2022] GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946 => generated 1504 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:28.616482 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-679c5f03-24d5-4345-9435-6b9317aae430 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:28.617365 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-679c5f03-24d5-4345-9435-6b9317aae430 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] [instance: 5e154d65-5086-47c1-bba7-ea3dfd53f6e6] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:28.624151 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-679c5f03-24d5-4345-9435-6b9317aae430 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:28.624832 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-679c5f03-24d5-4345-9435-6b9317aae430 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:28.625584 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-679c5f03-24d5-4345-9435-6b9317aae430 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:28.626265 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-679c5f03-24d5-4345-9435-6b9317aae430 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:28.626731 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-679c5f03-24d5-4345-9435-6b9317aae430 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:28.627161 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-679c5f03-24d5-4345-9435-6b9317aae430 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:28.799996 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-679c5f03-24d5-4345-9435-6b9317aae430 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89f12d146749b38c688b7581e53f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247c7ae3e4e4068a88a044e36945f32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:28.819812 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-679c5f03-24d5-4345-9435-6b9317aae430 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] 10.222.0.20 "GET /compute/v2.1/servers/5e154d65-5086-47c1-bba7-ea3dfd53f6e6" status: 200 len: 1485 microversion: 2.1 time: 0.207086 Oct 04 18:31:28.821392 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 435/866] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:28 2022] GET /compute/v2.1/servers/5e154d65-5086-47c1-bba7-ea3dfd53f6e6 => generated 1485 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:28.828710 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0538b87b-132e-49d7-b552-a1e3cfc72121 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:28.830982 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0538b87b-132e-49d7-b552-a1e3cfc72121 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: 6b629ba0-6245-442f-bf1a-ad1c1a3116bc] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:28.843330 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0538b87b-132e-49d7-b552-a1e3cfc72121 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:28.845272 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0538b87b-132e-49d7-b552-a1e3cfc72121 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:28.846369 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0538b87b-132e-49d7-b552-a1e3cfc72121 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:28.847989 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0538b87b-132e-49d7-b552-a1e3cfc72121 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:28.849317 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0538b87b-132e-49d7-b552-a1e3cfc72121 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:28.850994 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0538b87b-132e-49d7-b552-a1e3cfc72121 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:28.868529 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-462fc356-3bd2-4d14-a15c-4969c924f697 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] 10.222.0.20 "DELETE /compute/v2.1/images/7c06454e-f4ee-4402-8078-68104b52d35a" status: 204 len: 0 microversion: 2.1 time: 1.354987 Oct 04 18:31:28.871819 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 432/867] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:27 2022] DELETE /compute/v2.1/images/7c06454e-f4ee-4402-8078-68104b52d35a => generated 0 bytes in 1374 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:31:28.878710 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-102e9643-6ca7-4a9a-9285-8c0157af92dd tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Calling method '.version_select at 0x7fe2593da940>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:28.924469 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-102e9643-6ca7-4a9a-9285-8c0157af92dd tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] HTTP exception thrown: Image not found. Oct 04 18:31:28.926497 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-102e9643-6ca7-4a9a-9285-8c0157af92dd tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Request method failure captured: Oct 04 18:31:28.926497 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/images/7c06454e-f4ee-4402-8078-68104b52d35a HTTP/1.1 Oct 04 18:31:28.926497 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:31:28.926497 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:31:28.926497 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:31:28.926497 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:31:28.926497 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:31:28.926497 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:31:28.926497 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:31:28.926497 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:31:28.926497 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPHvPs-hoO6h1u8p_Qc-pLi13ZzHgIAT1oVlmQY3t1RumfesDNmfdobG4KO8dFu0rZN_lRHyEWO51xZpbAn_dbTF8tqV_v7VBVkBqMRaAhO84mSRF82fX8xl2t-D9hIqQ0hZq0w-H18y9tDBeFjbxg1OAr8voiifQx2Nqamk8eHp9ltI Oct 04 18:31:28.926497 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:31:28.926497 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:31:28.926497 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:31:28.926497 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:31:28.926497 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:31:28.926497 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:31:28.926497 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 5a1cc290c58149f8988cc3d69aff9efd Oct 04 18:31:28.926497 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ImagesOneServerTestJSON-1597051758 Oct 04 18:31:28.926497 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:31:28.926497 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:31:28.930739 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5a1cc290c58149f8988cc3d69aff9efd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5a1cc290c58149f8988cc3d69aff9efd", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5a1cc290c58149f8988cc3d69aff9efd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5a1cc290c58149f8988cc3d69aff9efd"}]}] Oct 04 18:31:28.930739 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ImagesOneServerTestJSON-1597051758 Oct 04 18:31:28.930739 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 5a1cc290c58149f8988cc3d69aff9efd Oct 04 18:31:28.930739 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1597051758 Oct 04 18:31:28.930739 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ImagesOneServerTestJSON-1597051758-project Oct 04 18:31:28.930739 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:31:28.930739 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:31:28.930739 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 1d326c048306423a87ddef70295a75e0 Oct 04 18:31:28.930739 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ImagesOneServerTestJSON-1597051758-project Oct 04 18:31:28.930739 n-d-850501-14 devstack@n-api.service[123001]: method: Oct 04 18:31:28.930739 n-d-850501-14 devstack@n-api.service[123001]: exception: Image not found. Oct 04 18:31:28.930739 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '7c06454e-f4ee-4402-8078-68104b52d35a'} Oct 04 18:31:28.930739 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:31:28.931590 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:28.931590 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 18:31:28.931590 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 18:31:28.931590 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:31:28.931590 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:31:28.931590 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 18:31:28.931590 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 18:31:28.931590 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:31:28.931590 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:31:28.931590 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 18:31:28.931590 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 18:31:28.931590 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 18:31:28.931590 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 18:31:28.931590 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:31:28.931590 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:31:28.931590 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:31:28.931590 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:31:28.931590 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 7c06454e-f4ee-4402-8078-68104b52d35a Oct 04 18:31:28.932801 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:31:28.932801 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:31:28.932801 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:31:28.932801 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:28.932801 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 04 18:31:28.932801 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 04 18:31:28.932801 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 18:31:28.932801 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 18:31:28.932801 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 18:31:28.932801 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 18:31:28.932801 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 18:31:28.932801 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 18:31:28.932801 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 18:31:28.932801 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 18:31:28.932801 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:31:28.932801 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:31:28.932801 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 18:31:28.932801 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 18:31:28.932801 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:31:28.932801 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:31:28.934127 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 18:31:28.934127 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 18:31:28.934127 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 18:31:28.934127 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 18:31:28.934127 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:31:28.934127 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:31:28.934127 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:31:28.934127 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:31:28.934127 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7c06454e-f4ee-4402-8078-68104b52d35a could not be found. Oct 04 18:31:28.934127 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:31:28.934127 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:31:28.934127 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:31:28.934127 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:28.934127 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:31:28.934127 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:31:28.934127 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:31:28.934127 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:31:28.934127 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:31:28.934127 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:31:28.935848 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:31:28.935848 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:31:28.935848 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 04 18:31:28.935848 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 18:31:28.935848 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:31:28.935848 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:31:28.935848 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:31:28.935848 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:31:28.935848 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:28.935848 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:31:28.935848 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:31:28.935848 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:31:28.935848 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:31:28.935848 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:31:28.935848 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:31:28.935848 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-102e9643-6ca7-4a9a-9285-8c0157af92dd tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Returning 404 to user: Image not found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:31:28.935848 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-102e9643-6ca7-4a9a-9285-8c0157af92dd tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] 10.222.0.20 "GET /compute/v2.1/images/7c06454e-f4ee-4402-8078-68104b52d35a" status: 404 len: 62 microversion: 2.1 time: 0.053043 Oct 04 18:31:28.937788 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 433/868] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:31:28 2022] GET /compute/v2.1/images/7c06454e-f4ee-4402-8078-68104b52d35a => generated 62 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 04 18:31:28.942499 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f9c93fff-5b80-4c41-a4ba-a865f1b9a74f tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-504418958"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:28.949238 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f9c93fff-5b80-4c41-a4ba-a865f1b9a74f tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] [instance: 836f71c5-d859-4d09-9956-922b0bbee3ae] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:28.961581 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f9c93fff-5b80-4c41-a4ba-a865f1b9a74f tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:28.962078 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f9c93fff-5b80-4c41-a4ba-a865f1b9a74f tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:28.963550 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f9c93fff-5b80-4c41-a4ba-a865f1b9a74f tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:28.964342 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f9c93fff-5b80-4c41-a4ba-a865f1b9a74f tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:28.965426 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f9c93fff-5b80-4c41-a4ba-a865f1b9a74f tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:28.966038 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f9c93fff-5b80-4c41-a4ba-a865f1b9a74f tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:29.175015 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0538b87b-132e-49d7-b552-a1e3cfc72121 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:29.186748 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0538b87b-132e-49d7-b552-a1e3cfc72121 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:29.189611 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0538b87b-132e-49d7-b552-a1e3cfc72121 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:29.190927 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0538b87b-132e-49d7-b552-a1e3cfc72121 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/6b629ba0-6245-442f-bf1a-ad1c1a3116bc" status: 200 len: 1362 microversion: 2.25 time: 0.368072 Oct 04 18:31:29.192142 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 436/869] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:31:28 2022] GET /compute/v2.1/servers/6b629ba0-6245-442f-bf1a-ad1c1a3116bc => generated 1362 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:31:29.197917 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-04742286-1bde-4fe3-9214-ce7236d46052 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:29.198793 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-04742286-1bde-4fe3-9214-ce7236d46052 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: fd73ee96-f932-48db-a1b5-664bb9740994] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:29.209738 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-04742286-1bde-4fe3-9214-ce7236d46052 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:29.210292 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-04742286-1bde-4fe3-9214-ce7236d46052 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:29.210730 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-04742286-1bde-4fe3-9214-ce7236d46052 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:29.211468 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-04742286-1bde-4fe3-9214-ce7236d46052 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:29.211952 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-04742286-1bde-4fe3-9214-ce7236d46052 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:29.212747 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-04742286-1bde-4fe3-9214-ce7236d46052 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:29.313404 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-04742286-1bde-4fe3-9214-ce7236d46052 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:29.324518 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-04742286-1bde-4fe3-9214-ce7236d46052 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/fd73ee96-f932-48db-a1b5-664bb9740994" status: 200 len: 1274 microversion: 2.1 time: 0.131008 Oct 04 18:31:29.325623 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 437/870] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:29 2022] GET /compute/v2.1/servers/fd73ee96-f932-48db-a1b5-664bb9740994 => generated 1274 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:29.333272 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1bfc62b9-2638-4d73-87ba-9f5612ec2b82 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:29.334004 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1bfc62b9-2638-4d73-87ba-9f5612ec2b82 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] [instance: e17c5b3e-a598-4369-9cf7-027a563e59fa] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:29.340924 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1bfc62b9-2638-4d73-87ba-9f5612ec2b82 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:29.341607 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1bfc62b9-2638-4d73-87ba-9f5612ec2b82 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:29.344297 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1bfc62b9-2638-4d73-87ba-9f5612ec2b82 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:29.344297 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1bfc62b9-2638-4d73-87ba-9f5612ec2b82 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:29.344297 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1bfc62b9-2638-4d73-87ba-9f5612ec2b82 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:29.344297 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1bfc62b9-2638-4d73-87ba-9f5612ec2b82 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:29.462141 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1bfc62b9-2638-4d73-87ba-9f5612ec2b82 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f49a275284a7eb714a55c6bdd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e44e7aa06ee4126b5705ba65145ebcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:29.471703 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1bfc62b9-2638-4d73-87ba-9f5612ec2b82 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] 10.222.0.20 "GET /compute/v2.1/servers/e17c5b3e-a598-4369-9cf7-027a563e59fa" status: 200 len: 1220 microversion: 2.1 time: 0.144812 Oct 04 18:31:29.472881 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 438/871] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:29 2022] GET /compute/v2.1/servers/e17c5b3e-a598-4369-9cf7-027a563e59fa => generated 1220 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:29.509289 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f9c93fff-5b80-4c41-a4ba-a865f1b9a74f tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] 10.222.0.20 "POST /compute/v2.1/servers/836f71c5-d859-4d09-9956-922b0bbee3ae/action" status: 202 len: 0 microversion: 2.1 time: 0.572023 Oct 04 18:31:29.511883 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 434/872] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:31:28 2022] POST /compute/v2.1/servers/836f71c5-d859-4d09-9956-922b0bbee3ae/action => generated 0 bytes in 575 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 18:31:29.528332 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b8818207-5a87-47be-9a20-fb833b5015b7 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Calling method '.version_select at 0x7fe2592cf160>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:29.581445 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b8818207-5a87-47be-9a20-fb833b5015b7 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] 10.222.0.20 "GET /compute/v2.1/images/82e02158-d3ca-4c9a-afa8-3d1075568eff" status: 200 len: 1428 microversion: 2.1 time: 0.057591 Oct 04 18:31:29.582028 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 439/873] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:31:29 2022] GET /compute/v2.1/images/82e02158-d3ca-4c9a-afa8-3d1075568eff => generated 1428 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:29.638413 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e8a0d322-e511-4d3a-9c48-60e5acda03db tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:29.639118 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e8a0d322-e511-4d3a-9c48-60e5acda03db tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 89738dfe-3844-455a-93d1-d38702038946] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:29.650220 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e8a0d322-e511-4d3a-9c48-60e5acda03db tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:29.651176 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e8a0d322-e511-4d3a-9c48-60e5acda03db tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:29.651760 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e8a0d322-e511-4d3a-9c48-60e5acda03db tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:29.653754 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e8a0d322-e511-4d3a-9c48-60e5acda03db tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:29.654992 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e8a0d322-e511-4d3a-9c48-60e5acda03db tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:29.655605 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e8a0d322-e511-4d3a-9c48-60e5acda03db tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:29.843601 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e8a0d322-e511-4d3a-9c48-60e5acda03db tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:29.859100 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e8a0d322-e511-4d3a-9c48-60e5acda03db tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946" status: 200 len: 1504 microversion: 2.1 time: 0.228327 Oct 04 18:31:29.860792 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 435/874] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:29 2022] GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946 => generated 1504 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:30.217392 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e2990f7e-8789-4b0f-a649-71fd362fee4f tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:30.218315 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e2990f7e-8789-4b0f-a649-71fd362fee4f tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: 6b629ba0-6245-442f-bf1a-ad1c1a3116bc] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:30.220894 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-f280b436-2098-4865-b8e0-30d6cd299638 req-b8e3c5e5-f2cc-4420-90d5-a303723e2f0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e154d65-5086-47c1-bba7-ea3dfd53f6e6", "tag": "1eb398e0-da63-4b45-bace-cc05ff4d0f6f"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:30.227977 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e2990f7e-8789-4b0f-a649-71fd362fee4f tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:30.228755 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e2990f7e-8789-4b0f-a649-71fd362fee4f tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:30.229398 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e2990f7e-8789-4b0f-a649-71fd362fee4f tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:30.230170 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e2990f7e-8789-4b0f-a649-71fd362fee4f tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:30.231233 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e2990f7e-8789-4b0f-a649-71fd362fee4f tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:30.232046 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e2990f7e-8789-4b0f-a649-71fd362fee4f tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:30.234612 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-f280b436-2098-4865-b8e0-30d6cd299638 req-b8e3c5e5-f2cc-4420-90d5-a303723e2f0a service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:30.235184 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-f280b436-2098-4865-b8e0-30d6cd299638 req-b8e3c5e5-f2cc-4420-90d5-a303723e2f0a service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:30.235853 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-f280b436-2098-4865-b8e0-30d6cd299638 req-b8e3c5e5-f2cc-4420-90d5-a303723e2f0a service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:30.240871 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:30.249534 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-f280b436-2098-4865-b8e0-30d6cd299638 req-b8e3c5e5-f2cc-4420-90d5-a303723e2f0a service nova] Creating event network-changed:1eb398e0-da63-4b45-bace-cc05ff4d0f6f for instance 5e154d65-5086-47c1-bba7-ea3dfd53f6e6 on n-h2-850501-14 Oct 04 18:31:30.255110 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-f280b436-2098-4865-b8e0-30d6cd299638 req-b8e3c5e5-f2cc-4420-90d5-a303723e2f0a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039251 Oct 04 18:31:30.255762 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 436/875] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:31:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:31:30.348801 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-234fb55b-b019-4ca6-98a4-53243e9a7483 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:30.351340 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-234fb55b-b019-4ca6-98a4-53243e9a7483 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: fd73ee96-f932-48db-a1b5-664bb9740994] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:30.360175 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-234fb55b-b019-4ca6-98a4-53243e9a7483 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:30.360875 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-234fb55b-b019-4ca6-98a4-53243e9a7483 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:30.361508 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-234fb55b-b019-4ca6-98a4-53243e9a7483 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:30.363282 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-234fb55b-b019-4ca6-98a4-53243e9a7483 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:30.363747 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-234fb55b-b019-4ca6-98a4-53243e9a7483 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:30.364428 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-234fb55b-b019-4ca6-98a4-53243e9a7483 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:30.461313 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-234fb55b-b019-4ca6-98a4-53243e9a7483 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:30.485206 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-234fb55b-b019-4ca6-98a4-53243e9a7483 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/fd73ee96-f932-48db-a1b5-664bb9740994" status: 200 len: 1274 microversion: 2.1 time: 0.141221 Oct 04 18:31:30.486871 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 437/876] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:30 2022] GET /compute/v2.1/servers/fd73ee96-f932-48db-a1b5-664bb9740994 => generated 1274 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:30.493657 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-6b220233-4de2-4c79-b296-a7a0d2ac799b req-b6c70fc0-92ef-4dad-a2d3-77305fb9cfd9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b629ba0-6245-442f-bf1a-ad1c1a3116bc", "tag": "d4883fee-1e3e-46f0-9029-6d122a317d39"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:30.502078 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:30.506992 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-6b220233-4de2-4c79-b296-a7a0d2ac799b req-b6c70fc0-92ef-4dad-a2d3-77305fb9cfd9 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:30.507707 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-6b220233-4de2-4c79-b296-a7a0d2ac799b req-b6c70fc0-92ef-4dad-a2d3-77305fb9cfd9 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:30.508690 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-6b220233-4de2-4c79-b296-a7a0d2ac799b req-b6c70fc0-92ef-4dad-a2d3-77305fb9cfd9 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:30.510743 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e2990f7e-8789-4b0f-a649-71fd362fee4f tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:30.530007 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e2990f7e-8789-4b0f-a649-71fd362fee4f tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:30.534362 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-6b220233-4de2-4c79-b296-a7a0d2ac799b req-b6c70fc0-92ef-4dad-a2d3-77305fb9cfd9 service nova] Creating event network-changed:d4883fee-1e3e-46f0-9029-6d122a317d39 for instance 6b629ba0-6245-442f-bf1a-ad1c1a3116bc on n-h1-850501-14 Oct 04 18:31:30.542017 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-6b220233-4de2-4c79-b296-a7a0d2ac799b req-b6c70fc0-92ef-4dad-a2d3-77305fb9cfd9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053671 Oct 04 18:31:30.543152 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 438/877] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:31:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:30.551578 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b975e19f-c1ed-4c92-a278-9a6969911096 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:30.552797 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b975e19f-c1ed-4c92-a278-9a6969911096 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] [instance: e17c5b3e-a598-4369-9cf7-027a563e59fa] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:30.570140 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b975e19f-c1ed-4c92-a278-9a6969911096 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:30.570328 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e2990f7e-8789-4b0f-a649-71fd362fee4f tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:30.575028 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b975e19f-c1ed-4c92-a278-9a6969911096 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:30.575028 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b975e19f-c1ed-4c92-a278-9a6969911096 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:30.575028 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b975e19f-c1ed-4c92-a278-9a6969911096 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:30.575028 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b975e19f-c1ed-4c92-a278-9a6969911096 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:30.575397 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e2990f7e-8789-4b0f-a649-71fd362fee4f tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/6b629ba0-6245-442f-bf1a-ad1c1a3116bc" status: 200 len: 1362 microversion: 2.25 time: 0.359521 Oct 04 18:31:30.584479 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 440/878] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:31:30 2022] GET /compute/v2.1/servers/6b629ba0-6245-442f-bf1a-ad1c1a3116bc => generated 1362 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:31:30.588214 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b975e19f-c1ed-4c92-a278-9a6969911096 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:30.597068 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-cb4a6933-3a09-4aee-8a24-7f84b85946d7 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Calling method '.version_select at 0x7fe25926e550>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:30.677781 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-cb4a6933-3a09-4aee-8a24-7f84b85946d7 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] 10.222.0.20 "GET /compute/v2.1/images/82e02158-d3ca-4c9a-afa8-3d1075568eff" status: 200 len: 1428 microversion: 2.1 time: 0.084467 Oct 04 18:31:30.678368 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 441/879] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:31:30 2022] GET /compute/v2.1/images/82e02158-d3ca-4c9a-afa8-3d1075568eff => generated 1428 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:31:30.739452 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b975e19f-c1ed-4c92-a278-9a6969911096 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f49a275284a7eb714a55c6bdd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e44e7aa06ee4126b5705ba65145ebcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:30.774203 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b975e19f-c1ed-4c92-a278-9a6969911096 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] 10.222.0.20 "GET /compute/v2.1/servers/e17c5b3e-a598-4369-9cf7-027a563e59fa" status: 200 len: 1276 microversion: 2.1 time: 0.228207 Oct 04 18:31:30.801783 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 439/880] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:30 2022] GET /compute/v2.1/servers/e17c5b3e-a598-4369-9cf7-027a563e59fa => generated 1276 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:30.886017 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a5bb3de3-5375-4b51-b770-675b2cc9a4f8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:30.886591 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a5bb3de3-5375-4b51-b770-675b2cc9a4f8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 89738dfe-3844-455a-93d1-d38702038946] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:30.893066 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a5bb3de3-5375-4b51-b770-675b2cc9a4f8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:30.893555 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a5bb3de3-5375-4b51-b770-675b2cc9a4f8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:30.894017 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a5bb3de3-5375-4b51-b770-675b2cc9a4f8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:30.894720 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a5bb3de3-5375-4b51-b770-675b2cc9a4f8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:30.895357 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a5bb3de3-5375-4b51-b770-675b2cc9a4f8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:30.897973 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a5bb3de3-5375-4b51-b770-675b2cc9a4f8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:31.264772 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a5bb3de3-5375-4b51-b770-675b2cc9a4f8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:31.285057 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a5bb3de3-5375-4b51-b770-675b2cc9a4f8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946" status: 200 len: 1504 microversion: 2.1 time: 0.405626 Oct 04 18:31:31.300154 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 442/881] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:30 2022] GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946 => generated 1504 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:31.520191 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f3284350-7c66-4a40-ad18-4b42614be31c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:31.521864 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f3284350-7c66-4a40-ad18-4b42614be31c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: fd73ee96-f932-48db-a1b5-664bb9740994] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:31.531029 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f3284350-7c66-4a40-ad18-4b42614be31c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:31.531619 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f3284350-7c66-4a40-ad18-4b42614be31c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:31.532800 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f3284350-7c66-4a40-ad18-4b42614be31c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:31.535106 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f3284350-7c66-4a40-ad18-4b42614be31c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:31.536591 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f3284350-7c66-4a40-ad18-4b42614be31c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:31.538254 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f3284350-7c66-4a40-ad18-4b42614be31c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:31.598732 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8e61f6c4-5e38-4293-9da6-1aa84c55618e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:31.601469 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8e61f6c4-5e38-4293-9da6-1aa84c55618e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: 6b629ba0-6245-442f-bf1a-ad1c1a3116bc] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:31.609616 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8e61f6c4-5e38-4293-9da6-1aa84c55618e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:31.610495 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8e61f6c4-5e38-4293-9da6-1aa84c55618e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:31.611112 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8e61f6c4-5e38-4293-9da6-1aa84c55618e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:31.615668 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8e61f6c4-5e38-4293-9da6-1aa84c55618e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:31.615668 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8e61f6c4-5e38-4293-9da6-1aa84c55618e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:31.615668 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8e61f6c4-5e38-4293-9da6-1aa84c55618e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:31.809385 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f3284350-7c66-4a40-ad18-4b42614be31c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:31.820619 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f3284350-7c66-4a40-ad18-4b42614be31c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/fd73ee96-f932-48db-a1b5-664bb9740994" status: 200 len: 1316 microversion: 2.1 time: 0.310750 Oct 04 18:31:31.821361 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 440/882] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:31 2022] GET /compute/v2.1/servers/fd73ee96-f932-48db-a1b5-664bb9740994 => generated 1316 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:31.827069 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-00df5615-1ee9-4d20-b191-1925dbbd1bf4 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Calling method '.version_select at 0x7fe259146a60>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:31.850941 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8e61f6c4-5e38-4293-9da6-1aa84c55618e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:31.866592 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8e61f6c4-5e38-4293-9da6-1aa84c55618e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:31.867991 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8e61f6c4-5e38-4293-9da6-1aa84c55618e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:31.869303 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8e61f6c4-5e38-4293-9da6-1aa84c55618e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/6b629ba0-6245-442f-bf1a-ad1c1a3116bc" status: 200 len: 1362 microversion: 2.25 time: 0.275243 Oct 04 18:31:31.880041 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 443/883] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:31:31 2022] GET /compute/v2.1/servers/6b629ba0-6245-442f-bf1a-ad1c1a3116bc => generated 1362 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:31:31.880187 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-00df5615-1ee9-4d20-b191-1925dbbd1bf4 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] 10.222.0.20 "GET /compute/v2.1/images/82e02158-d3ca-4c9a-afa8-3d1075568eff" status: 200 len: 1428 microversion: 2.1 time: 0.054286 Oct 04 18:31:31.880187 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 441/884] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:31:31 2022] GET /compute/v2.1/images/82e02158-d3ca-4c9a-afa8-3d1075568eff => generated 1428 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:31.885621 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-365275f2-609a-4f3b-b131-f087bfe8e740 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:31.886524 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-365275f2-609a-4f3b-b131-f087bfe8e740 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] [instance: e17c5b3e-a598-4369-9cf7-027a563e59fa] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:31.894592 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-365275f2-609a-4f3b-b131-f087bfe8e740 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:31.895187 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-365275f2-609a-4f3b-b131-f087bfe8e740 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:31.895839 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-365275f2-609a-4f3b-b131-f087bfe8e740 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:31.897391 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-365275f2-609a-4f3b-b131-f087bfe8e740 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:31.897982 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-365275f2-609a-4f3b-b131-f087bfe8e740 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:31.898438 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-365275f2-609a-4f3b-b131-f087bfe8e740 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:31.963997 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-365275f2-609a-4f3b-b131-f087bfe8e740 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f49a275284a7eb714a55c6bdd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e44e7aa06ee4126b5705ba65145ebcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:31.971849 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-365275f2-609a-4f3b-b131-f087bfe8e740 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] 10.222.0.20 "GET /compute/v2.1/servers/e17c5b3e-a598-4369-9cf7-027a563e59fa" status: 200 len: 1282 microversion: 2.1 time: 0.100997 Oct 04 18:31:31.972455 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 444/885] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:31 2022] GET /compute/v2.1/servers/e17c5b3e-a598-4369-9cf7-027a563e59fa => generated 1282 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:32.310156 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-76143828-e430-45fd-9911-f13ac47118ca tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:32.310838 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-76143828-e430-45fd-9911-f13ac47118ca tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 89738dfe-3844-455a-93d1-d38702038946] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:32.317209 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-76143828-e430-45fd-9911-f13ac47118ca tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:32.317954 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-76143828-e430-45fd-9911-f13ac47118ca tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:32.319251 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-76143828-e430-45fd-9911-f13ac47118ca tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:32.320012 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-76143828-e430-45fd-9911-f13ac47118ca tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:32.320505 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-76143828-e430-45fd-9911-f13ac47118ca tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:32.320931 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-76143828-e430-45fd-9911-f13ac47118ca tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:32.481107 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-76143828-e430-45fd-9911-f13ac47118ca tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:32.489908 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-76143828-e430-45fd-9911-f13ac47118ca tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946" status: 200 len: 1504 microversion: 2.1 time: 0.184832 Oct 04 18:31:32.491500 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 442/886] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:32 2022] GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946 => generated 1504 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:32.846910 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c5c51825-a2c9-4707-8dda-ae8d7050dfdb tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:32.847650 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c5c51825-a2c9-4707-8dda-ae8d7050dfdb tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: fd73ee96-f932-48db-a1b5-664bb9740994] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:32.850390 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:32.855531 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c5c51825-a2c9-4707-8dda-ae8d7050dfdb tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:32.856047 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c5c51825-a2c9-4707-8dda-ae8d7050dfdb tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:32.856564 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c5c51825-a2c9-4707-8dda-ae8d7050dfdb tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:32.857330 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c5c51825-a2c9-4707-8dda-ae8d7050dfdb tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:32.857774 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c5c51825-a2c9-4707-8dda-ae8d7050dfdb tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:32.858194 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c5c51825-a2c9-4707-8dda-ae8d7050dfdb tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:32.892772 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8962cee6-afde-4eb2-b4c0-d01ee1b91df8 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Calling method '.version_select at 0x7fe2590ea310>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:32.950260 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8962cee6-afde-4eb2-b4c0-d01ee1b91df8 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] 10.222.0.20 "GET /compute/v2.1/images/82e02158-d3ca-4c9a-afa8-3d1075568eff" status: 200 len: 1428 microversion: 2.1 time: 0.061254 Oct 04 18:31:32.950896 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 443/887] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:31:32 2022] GET /compute/v2.1/images/82e02158-d3ca-4c9a-afa8-3d1075568eff => generated 1428 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:31:32.956703 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5591e89a-fb3d-45b8-8752-b46bb85dffbc tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:32.957450 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5591e89a-fb3d-45b8-8752-b46bb85dffbc tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: 6b629ba0-6245-442f-bf1a-ad1c1a3116bc] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:32.965766 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5591e89a-fb3d-45b8-8752-b46bb85dffbc tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:32.966407 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5591e89a-fb3d-45b8-8752-b46bb85dffbc tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:32.968672 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5591e89a-fb3d-45b8-8752-b46bb85dffbc tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:32.969530 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5591e89a-fb3d-45b8-8752-b46bb85dffbc tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:32.970012 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5591e89a-fb3d-45b8-8752-b46bb85dffbc tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:32.975221 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5591e89a-fb3d-45b8-8752-b46bb85dffbc tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:33.050883 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c5c51825-a2c9-4707-8dda-ae8d7050dfdb tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:33.063102 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c5c51825-a2c9-4707-8dda-ae8d7050dfdb tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/fd73ee96-f932-48db-a1b5-664bb9740994" status: 200 len: 1316 microversion: 2.1 time: 0.220269 Oct 04 18:31:33.073712 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 445/888] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:32 2022] GET /compute/v2.1/servers/fd73ee96-f932-48db-a1b5-664bb9740994 => generated 1316 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:33.073712 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-09d97596-c177-4829-ac6a-b21719f713f9 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:33.073712 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-09d97596-c177-4829-ac6a-b21719f713f9 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] [instance: e17c5b3e-a598-4369-9cf7-027a563e59fa] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:33.078669 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-09d97596-c177-4829-ac6a-b21719f713f9 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:33.079155 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-09d97596-c177-4829-ac6a-b21719f713f9 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:33.079657 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-09d97596-c177-4829-ac6a-b21719f713f9 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:33.080390 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-09d97596-c177-4829-ac6a-b21719f713f9 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:33.080841 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-09d97596-c177-4829-ac6a-b21719f713f9 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:33.081456 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-09d97596-c177-4829-ac6a-b21719f713f9 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:33.179542 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-09d97596-c177-4829-ac6a-b21719f713f9 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f49a275284a7eb714a55c6bdd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e44e7aa06ee4126b5705ba65145ebcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:33.194223 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-09d97596-c177-4829-ac6a-b21719f713f9 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] 10.222.0.20 "GET /compute/v2.1/servers/e17c5b3e-a598-4369-9cf7-027a563e59fa" status: 200 len: 1282 microversion: 2.1 time: 0.128776 Oct 04 18:31:33.195532 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 446/889] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:33 2022] GET /compute/v2.1/servers/e17c5b3e-a598-4369-9cf7-027a563e59fa => generated 1282 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:33.199680 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5591e89a-fb3d-45b8-8752-b46bb85dffbc tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:33.214567 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5591e89a-fb3d-45b8-8752-b46bb85dffbc tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:33.217307 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5591e89a-fb3d-45b8-8752-b46bb85dffbc tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:33.219246 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5591e89a-fb3d-45b8-8752-b46bb85dffbc tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/6b629ba0-6245-442f-bf1a-ad1c1a3116bc" status: 200 len: 1362 microversion: 2.25 time: 0.267149 Oct 04 18:31:33.220018 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 444/890] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:31:32 2022] GET /compute/v2.1/servers/6b629ba0-6245-442f-bf1a-ad1c1a3116bc => generated 1362 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:31:33.514111 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1144cbc9-7375-4a3b-a995-8562adc17ca6 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:33.514728 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1144cbc9-7375-4a3b-a995-8562adc17ca6 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 89738dfe-3844-455a-93d1-d38702038946] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:33.524101 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1144cbc9-7375-4a3b-a995-8562adc17ca6 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:33.524612 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1144cbc9-7375-4a3b-a995-8562adc17ca6 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:33.525051 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1144cbc9-7375-4a3b-a995-8562adc17ca6 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:33.525765 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1144cbc9-7375-4a3b-a995-8562adc17ca6 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:33.526220 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1144cbc9-7375-4a3b-a995-8562adc17ca6 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:33.528727 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1144cbc9-7375-4a3b-a995-8562adc17ca6 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:33.668171 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1144cbc9-7375-4a3b-a995-8562adc17ca6 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:33.676228 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1144cbc9-7375-4a3b-a995-8562adc17ca6 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946" status: 200 len: 1504 microversion: 2.1 time: 0.165789 Oct 04 18:31:33.676749 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 447/891] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:33 2022] GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946 => generated 1504 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:33.851475 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-ebf4ecba-cbad-4382-bb7d-8b833f0dfdc6 req-65b625e4-7fcf-455b-a1f4-f6baa2ca09fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd73ee96-f932-48db-a1b5-664bb9740994", "tag": "2c7f74ad-951d-4733-95ca-cd81429289f8"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:33.868865 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-ebf4ecba-cbad-4382-bb7d-8b833f0dfdc6 req-65b625e4-7fcf-455b-a1f4-f6baa2ca09fe service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:33.869350 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-ebf4ecba-cbad-4382-bb7d-8b833f0dfdc6 req-65b625e4-7fcf-455b-a1f4-f6baa2ca09fe service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:33.870266 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-ebf4ecba-cbad-4382-bb7d-8b833f0dfdc6 req-65b625e4-7fcf-455b-a1f4-f6baa2ca09fe service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:33.882083 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-ebf4ecba-cbad-4382-bb7d-8b833f0dfdc6 req-65b625e4-7fcf-455b-a1f4-f6baa2ca09fe service nova] Creating event network-changed:2c7f74ad-951d-4733-95ca-cd81429289f8 for instance fd73ee96-f932-48db-a1b5-664bb9740994 on n-h1-850501-14 Oct 04 18:31:33.887932 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-ebf4ecba-cbad-4382-bb7d-8b833f0dfdc6 req-65b625e4-7fcf-455b-a1f4-f6baa2ca09fe service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041874 Oct 04 18:31:33.889540 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 445/892] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:31:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:33.965822 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5ff66f35-845d-4e17-8fb6-6b8f1cfe4d4b tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Calling method '.version_select at 0x7fe259433e50>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:34.024993 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5ff66f35-845d-4e17-8fb6-6b8f1cfe4d4b tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] 10.222.0.20 "GET /compute/v2.1/images/82e02158-d3ca-4c9a-afa8-3d1075568eff" status: 200 len: 1428 microversion: 2.1 time: 0.063129 Oct 04 18:31:34.025582 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 448/893] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:31:33 2022] GET /compute/v2.1/images/82e02158-d3ca-4c9a-afa8-3d1075568eff => generated 1428 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:34.091704 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e39cd871-c1b2-4226-9b3f-e1487f9416b5 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:34.092347 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e39cd871-c1b2-4226-9b3f-e1487f9416b5 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: fd73ee96-f932-48db-a1b5-664bb9740994] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:34.101098 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e39cd871-c1b2-4226-9b3f-e1487f9416b5 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:34.101832 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e39cd871-c1b2-4226-9b3f-e1487f9416b5 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:34.104394 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e39cd871-c1b2-4226-9b3f-e1487f9416b5 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:34.104394 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e39cd871-c1b2-4226-9b3f-e1487f9416b5 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:34.104394 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e39cd871-c1b2-4226-9b3f-e1487f9416b5 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:34.104394 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e39cd871-c1b2-4226-9b3f-e1487f9416b5 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:34.218706 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a5e0c3e2-9411-45ba-8386-2c1a123a5017 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:34.219345 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a5e0c3e2-9411-45ba-8386-2c1a123a5017 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] [instance: e17c5b3e-a598-4369-9cf7-027a563e59fa] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:34.227746 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a5e0c3e2-9411-45ba-8386-2c1a123a5017 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:34.228249 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a5e0c3e2-9411-45ba-8386-2c1a123a5017 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:34.228867 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a5e0c3e2-9411-45ba-8386-2c1a123a5017 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:34.229757 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a5e0c3e2-9411-45ba-8386-2c1a123a5017 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:34.230469 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a5e0c3e2-9411-45ba-8386-2c1a123a5017 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:34.232136 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a5e0c3e2-9411-45ba-8386-2c1a123a5017 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:34.295950 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e39cd871-c1b2-4226-9b3f-e1487f9416b5 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:34.305946 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e39cd871-c1b2-4226-9b3f-e1487f9416b5 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/fd73ee96-f932-48db-a1b5-664bb9740994" status: 200 len: 1316 microversion: 2.1 time: 0.221984 Oct 04 18:31:34.307207 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 446/894] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:34 2022] GET /compute/v2.1/servers/fd73ee96-f932-48db-a1b5-664bb9740994 => generated 1316 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:34.316574 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-fe7ce85c-64f4-4892-a81f-5a2aa9db058e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:34.318545 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-fe7ce85c-64f4-4892-a81f-5a2aa9db058e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: 6b629ba0-6245-442f-bf1a-ad1c1a3116bc] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:34.327033 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fe7ce85c-64f4-4892-a81f-5a2aa9db058e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:34.327864 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fe7ce85c-64f4-4892-a81f-5a2aa9db058e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:34.328547 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fe7ce85c-64f4-4892-a81f-5a2aa9db058e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:34.334261 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fe7ce85c-64f4-4892-a81f-5a2aa9db058e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:34.334261 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fe7ce85c-64f4-4892-a81f-5a2aa9db058e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:34.334261 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fe7ce85c-64f4-4892-a81f-5a2aa9db058e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:34.460991 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a5e0c3e2-9411-45ba-8386-2c1a123a5017 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f49a275284a7eb714a55c6bdd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e44e7aa06ee4126b5705ba65145ebcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:34.470158 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a5e0c3e2-9411-45ba-8386-2c1a123a5017 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] 10.222.0.20 "GET /compute/v2.1/servers/e17c5b3e-a598-4369-9cf7-027a563e59fa" status: 200 len: 1324 microversion: 2.1 time: 0.255289 Oct 04 18:31:34.488689 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 449/895] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:34 2022] GET /compute/v2.1/servers/e17c5b3e-a598-4369-9cf7-027a563e59fa => generated 1324 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:31:34.532029 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-fe7ce85c-64f4-4892-a81f-5a2aa9db058e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:34.546464 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-fe7ce85c-64f4-4892-a81f-5a2aa9db058e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:34.546464 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-fe7ce85c-64f4-4892-a81f-5a2aa9db058e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:34.546464 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-fe7ce85c-64f4-4892-a81f-5a2aa9db058e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/6b629ba0-6245-442f-bf1a-ad1c1a3116bc" status: 200 len: 1362 microversion: 2.25 time: 0.237971 Oct 04 18:31:34.552870 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 447/896] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:31:34 2022] GET /compute/v2.1/servers/6b629ba0-6245-442f-bf1a-ad1c1a3116bc => generated 1362 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:31:34.703076 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-84cd5280-33e3-40a6-817c-f2efca903959 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:34.704714 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-84cd5280-33e3-40a6-817c-f2efca903959 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 89738dfe-3844-455a-93d1-d38702038946] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:34.733720 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-84cd5280-33e3-40a6-817c-f2efca903959 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:34.734500 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-84cd5280-33e3-40a6-817c-f2efca903959 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:34.734939 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-84cd5280-33e3-40a6-817c-f2efca903959 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:34.735651 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-84cd5280-33e3-40a6-817c-f2efca903959 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:34.739237 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-84cd5280-33e3-40a6-817c-f2efca903959 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:34.739732 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-84cd5280-33e3-40a6-817c-f2efca903959 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:34.855027 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-2153d172-705d-41f4-9fd2-5e826736467e req-f3f43d77-3d27-4f29-9770-879d20cc50e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "836f71c5-d859-4d09-9956-922b0bbee3ae", "name": "network-vif-plugged", "status": "completed", "tag": "0a037711-4826-46fe-ab3b-3321a329f5e9"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:34.877492 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-2153d172-705d-41f4-9fd2-5e826736467e req-f3f43d77-3d27-4f29-9770-879d20cc50e0 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:34.878304 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-2153d172-705d-41f4-9fd2-5e826736467e req-f3f43d77-3d27-4f29-9770-879d20cc50e0 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:34.879181 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-2153d172-705d-41f4-9fd2-5e826736467e req-f3f43d77-3d27-4f29-9770-879d20cc50e0 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:34.909713 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-2153d172-705d-41f4-9fd2-5e826736467e req-f3f43d77-3d27-4f29-9770-879d20cc50e0 service nova] Creating event network-vif-plugged:0a037711-4826-46fe-ab3b-3321a329f5e9 for instance 836f71c5-d859-4d09-9956-922b0bbee3ae on n-h1-850501-14 Oct 04 18:31:34.923437 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-2153d172-705d-41f4-9fd2-5e826736467e req-f3f43d77-3d27-4f29-9770-879d20cc50e0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072092 Oct 04 18:31:34.925699 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 448/897] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:31:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:35.042269 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-19770868-ed36-4ec4-9af6-9278394d0db0 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Calling method '.version_select at 0x7fe2595dfe50>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:35.065785 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-84cd5280-33e3-40a6-817c-f2efca903959 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:35.076729 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-84cd5280-33e3-40a6-817c-f2efca903959 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946" status: 200 len: 1504 microversion: 2.1 time: 0.377823 Oct 04 18:31:35.078024 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 450/898] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:34 2022] GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946 => generated 1504 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:35.131747 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-19770868-ed36-4ec4-9af6-9278394d0db0 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] 10.222.0.20 "GET /compute/v2.1/images/82e02158-d3ca-4c9a-afa8-3d1075568eff" status: 200 len: 1428 microversion: 2.1 time: 0.093944 Oct 04 18:31:35.142193 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 449/899] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:31:35 2022] GET /compute/v2.1/images/82e02158-d3ca-4c9a-afa8-3d1075568eff => generated 1428 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:31:35.340944 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1ef78536-53a1-430d-894e-0f9bb4c4fbcf tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:35.342012 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1ef78536-53a1-430d-894e-0f9bb4c4fbcf tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: fd73ee96-f932-48db-a1b5-664bb9740994] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:35.352721 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1ef78536-53a1-430d-894e-0f9bb4c4fbcf tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:35.354139 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1ef78536-53a1-430d-894e-0f9bb4c4fbcf tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:35.355854 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1ef78536-53a1-430d-894e-0f9bb4c4fbcf tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:35.357303 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1ef78536-53a1-430d-894e-0f9bb4c4fbcf tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:35.357999 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1ef78536-53a1-430d-894e-0f9bb4c4fbcf tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:35.360813 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1ef78536-53a1-430d-894e-0f9bb4c4fbcf tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:35.502502 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-dc2cb6ba-523c-4e0d-8163-82937d194a64 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:35.506423 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-dc2cb6ba-523c-4e0d-8163-82937d194a64 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] [instance: e17c5b3e-a598-4369-9cf7-027a563e59fa] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:35.558119 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dc2cb6ba-523c-4e0d-8163-82937d194a64 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:35.563711 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dc2cb6ba-523c-4e0d-8163-82937d194a64 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:35.565018 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dc2cb6ba-523c-4e0d-8163-82937d194a64 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:35.566421 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dc2cb6ba-523c-4e0d-8163-82937d194a64 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:35.571235 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dc2cb6ba-523c-4e0d-8163-82937d194a64 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:35.573627 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dc2cb6ba-523c-4e0d-8163-82937d194a64 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:35.575792 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1ef78536-53a1-430d-894e-0f9bb4c4fbcf tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:35.625198 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1ef78536-53a1-430d-894e-0f9bb4c4fbcf tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/fd73ee96-f932-48db-a1b5-664bb9740994" status: 200 len: 1316 microversion: 2.1 time: 0.254709 Oct 04 18:31:35.625198 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 451/900] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:35 2022] GET /compute/v2.1/servers/fd73ee96-f932-48db-a1b5-664bb9740994 => generated 1316 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:35.625198 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-dbaf43eb-0210-4a12-bfdf-c31f7bfdd97e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:35.625198 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-dbaf43eb-0210-4a12-bfdf-c31f7bfdd97e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: 6b629ba0-6245-442f-bf1a-ad1c1a3116bc] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:35.625198 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dbaf43eb-0210-4a12-bfdf-c31f7bfdd97e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:35.625882 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dbaf43eb-0210-4a12-bfdf-c31f7bfdd97e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:35.625882 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dbaf43eb-0210-4a12-bfdf-c31f7bfdd97e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:35.625882 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dbaf43eb-0210-4a12-bfdf-c31f7bfdd97e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:35.625882 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dbaf43eb-0210-4a12-bfdf-c31f7bfdd97e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:35.626232 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dbaf43eb-0210-4a12-bfdf-c31f7bfdd97e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:35.626232 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=100 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:35.893907 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-dbaf43eb-0210-4a12-bfdf-c31f7bfdd97e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:35.901874 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-dc2cb6ba-523c-4e0d-8163-82937d194a64 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f49a275284a7eb714a55c6bdd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e44e7aa06ee4126b5705ba65145ebcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:35.903841 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-dbaf43eb-0210-4a12-bfdf-c31f7bfdd97e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:35.905767 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-dbaf43eb-0210-4a12-bfdf-c31f7bfdd97e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:35.927277 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-dbaf43eb-0210-4a12-bfdf-c31f7bfdd97e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/6b629ba0-6245-442f-bf1a-ad1c1a3116bc" status: 200 len: 1362 microversion: 2.25 time: 0.319147 Oct 04 18:31:35.927277 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 452/901] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:31:35 2022] GET /compute/v2.1/servers/6b629ba0-6245-442f-bf1a-ad1c1a3116bc => generated 1362 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:31:35.928036 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-dc2cb6ba-523c-4e0d-8163-82937d194a64 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] 10.222.0.20 "GET /compute/v2.1/servers/e17c5b3e-a598-4369-9cf7-027a563e59fa" status: 200 len: 1324 microversion: 2.1 time: 0.426338 Oct 04 18:31:35.938215 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-84d62cd1-d387-484e-bf43-d00efc07a36d req-f399e594-f09b-4e52-b621-cdd33a31b77a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e17c5b3e-a598-4369-9cf7-027a563e59fa", "tag": "2f0b5af6-0cc2-4949-8880-47b512d4f031"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:35.940890 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 450/902] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:35 2022] GET /compute/v2.1/servers/e17c5b3e-a598-4369-9cf7-027a563e59fa => generated 1324 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:35.959312 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-84d62cd1-d387-484e-bf43-d00efc07a36d req-f399e594-f09b-4e52-b621-cdd33a31b77a service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:35.959864 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-84d62cd1-d387-484e-bf43-d00efc07a36d req-f399e594-f09b-4e52-b621-cdd33a31b77a service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:35.960344 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-84d62cd1-d387-484e-bf43-d00efc07a36d req-f399e594-f09b-4e52-b621-cdd33a31b77a service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:35.977163 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-84d62cd1-d387-484e-bf43-d00efc07a36d req-f399e594-f09b-4e52-b621-cdd33a31b77a service nova] Creating event network-changed:2f0b5af6-0cc2-4949-8880-47b512d4f031 for instance e17c5b3e-a598-4369-9cf7-027a563e59fa on n-h1-850501-14 Oct 04 18:31:35.983010 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-84d62cd1-d387-484e-bf43-d00efc07a36d req-f399e594-f09b-4e52-b621-cdd33a31b77a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053310 Oct 04 18:31:35.984269 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 453/903] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:31:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:31:36.102637 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-787b6576-cf5a-4cf9-9948-2f3f65fad90a tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:36.103576 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-787b6576-cf5a-4cf9-9948-2f3f65fad90a tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 89738dfe-3844-455a-93d1-d38702038946] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:36.111403 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-787b6576-cf5a-4cf9-9948-2f3f65fad90a tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:36.112475 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-787b6576-cf5a-4cf9-9948-2f3f65fad90a tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:36.113197 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-787b6576-cf5a-4cf9-9948-2f3f65fad90a tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:36.114679 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-787b6576-cf5a-4cf9-9948-2f3f65fad90a tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:36.118393 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-787b6576-cf5a-4cf9-9948-2f3f65fad90a tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:36.119140 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-787b6576-cf5a-4cf9-9948-2f3f65fad90a tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:36.151358 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d4ccbdf9-9e8c-472b-8172-616ff6ec0d69 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Calling method '.version_select at 0x7fe2592665e0>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:36.251429 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d4ccbdf9-9e8c-472b-8172-616ff6ec0d69 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] 10.222.0.20 "GET /compute/v2.1/images/82e02158-d3ca-4c9a-afa8-3d1075568eff" status: 200 len: 1428 microversion: 2.1 time: 0.106814 Oct 04 18:31:36.252387 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 454/904] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:31:36 2022] GET /compute/v2.1/images/82e02158-d3ca-4c9a-afa8-3d1075568eff => generated 1428 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:31:36.336988 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-787b6576-cf5a-4cf9-9948-2f3f65fad90a tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:36.354396 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-787b6576-cf5a-4cf9-9948-2f3f65fad90a tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946" status: 200 len: 1504 microversion: 2.1 time: 0.256421 Oct 04 18:31:36.355802 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 451/905] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:36 2022] GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946 => generated 1504 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:36.652325 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6690566e-9d06-42cb-8462-91a47211c196 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:36.652325 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-6690566e-9d06-42cb-8462-91a47211c196 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: fd73ee96-f932-48db-a1b5-664bb9740994] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:36.653314 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6690566e-9d06-42cb-8462-91a47211c196 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:36.666449 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6690566e-9d06-42cb-8462-91a47211c196 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:36.669076 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6690566e-9d06-42cb-8462-91a47211c196 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:36.670329 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6690566e-9d06-42cb-8462-91a47211c196 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:36.673213 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6690566e-9d06-42cb-8462-91a47211c196 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:36.673923 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6690566e-9d06-42cb-8462-91a47211c196 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:36.935412 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f5a68059-3baa-4d41-bcd2-95cf985dcd03 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:36.936036 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f5a68059-3baa-4d41-bcd2-95cf985dcd03 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: 6b629ba0-6245-442f-bf1a-ad1c1a3116bc] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:36.948029 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f5a68059-3baa-4d41-bcd2-95cf985dcd03 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:36.950960 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f5a68059-3baa-4d41-bcd2-95cf985dcd03 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:36.953656 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f5a68059-3baa-4d41-bcd2-95cf985dcd03 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:36.955039 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f5a68059-3baa-4d41-bcd2-95cf985dcd03 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:36.958256 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f5a68059-3baa-4d41-bcd2-95cf985dcd03 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:36.962417 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f5a68059-3baa-4d41-bcd2-95cf985dcd03 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:37.247580 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=4 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:37.274079 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=14 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:37.359022 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f5a68059-3baa-4d41-bcd2-95cf985dcd03 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:37.363290 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-6690566e-9d06-42cb-8462-91a47211c196 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:37.375608 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f5a68059-3baa-4d41-bcd2-95cf985dcd03 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:37.378697 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f5a68059-3baa-4d41-bcd2-95cf985dcd03 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:37.379140 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6690566e-9d06-42cb-8462-91a47211c196 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/fd73ee96-f932-48db-a1b5-664bb9740994" status: 200 len: 1316 microversion: 2.1 time: 0.738706 Oct 04 18:31:37.380084 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 455/906] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:36 2022] GET /compute/v2.1/servers/fd73ee96-f932-48db-a1b5-664bb9740994 => generated 1316 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:37.400676 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d5e4e62f-40d7-4832-b11f-137a76bea9e0 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:37.400676 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d5e4e62f-40d7-4832-b11f-137a76bea9e0 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] [instance: e17c5b3e-a598-4369-9cf7-027a563e59fa] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:37.400911 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f5a68059-3baa-4d41-bcd2-95cf985dcd03 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/6b629ba0-6245-442f-bf1a-ad1c1a3116bc" status: 200 len: 1362 microversion: 2.25 time: 0.462972 Oct 04 18:31:37.401718 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 452/907] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:31:36 2022] GET /compute/v2.1/servers/6b629ba0-6245-442f-bf1a-ad1c1a3116bc => generated 1362 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:31:37.408411 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1208b855-41da-4276-b889-0cdae81d09c9 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Calling method '.version_select at 0x7fe2591f9dc0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:37.420353 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d5e4e62f-40d7-4832-b11f-137a76bea9e0 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:37.420470 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d5e4e62f-40d7-4832-b11f-137a76bea9e0 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:37.420936 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d5e4e62f-40d7-4832-b11f-137a76bea9e0 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:37.422010 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d5e4e62f-40d7-4832-b11f-137a76bea9e0 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:37.422476 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d5e4e62f-40d7-4832-b11f-137a76bea9e0 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:37.422916 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d5e4e62f-40d7-4832-b11f-137a76bea9e0 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:37.489383 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1208b855-41da-4276-b889-0cdae81d09c9 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] 10.222.0.20 "GET /compute/v2.1/images/82e02158-d3ca-4c9a-afa8-3d1075568eff" status: 200 len: 1428 microversion: 2.1 time: 0.085967 Oct 04 18:31:37.502707 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 453/908] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:31:37 2022] GET /compute/v2.1/images/82e02158-d3ca-4c9a-afa8-3d1075568eff => generated 1428 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:37.517658 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4c2fbe15-f822-4065-9d06-707c18b38ab5 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:37.522738 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-4c2fbe15-f822-4065-9d06-707c18b38ab5 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 89738dfe-3844-455a-93d1-d38702038946] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:37.540199 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4c2fbe15-f822-4065-9d06-707c18b38ab5 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:37.542839 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4c2fbe15-f822-4065-9d06-707c18b38ab5 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:37.545479 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4c2fbe15-f822-4065-9d06-707c18b38ab5 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:37.547235 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4c2fbe15-f822-4065-9d06-707c18b38ab5 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:37.547730 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4c2fbe15-f822-4065-9d06-707c18b38ab5 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:37.548205 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4c2fbe15-f822-4065-9d06-707c18b38ab5 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:37.753746 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d5e4e62f-40d7-4832-b11f-137a76bea9e0 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f49a275284a7eb714a55c6bdd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e44e7aa06ee4126b5705ba65145ebcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:37.763039 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d5e4e62f-40d7-4832-b11f-137a76bea9e0 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] 10.222.0.20 "GET /compute/v2.1/servers/e17c5b3e-a598-4369-9cf7-027a563e59fa" status: 200 len: 1324 microversion: 2.1 time: 0.381240 Oct 04 18:31:37.763614 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 456/909] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:37 2022] GET /compute/v2.1/servers/e17c5b3e-a598-4369-9cf7-027a563e59fa => generated 1324 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:37.904658 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-4c2fbe15-f822-4065-9d06-707c18b38ab5 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:37.911146 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-4c2fbe15-f822-4065-9d06-707c18b38ab5 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946" status: 200 len: 1504 microversion: 2.1 time: 0.404737 Oct 04 18:31:37.924993 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 454/910] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:37 2022] GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946 => generated 1504 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:38.416697 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-eccc2162-0105-4ef8-9719-01f1c39000d9 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:38.419791 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-eccc2162-0105-4ef8-9719-01f1c39000d9 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: fd73ee96-f932-48db-a1b5-664bb9740994] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:38.432047 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-52b2cace-13bb-4311-98cf-a4c536cdc269 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:38.437040 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-52b2cace-13bb-4311-98cf-a4c536cdc269 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: 6b629ba0-6245-442f-bf1a-ad1c1a3116bc] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:38.452384 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=12 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:38.458459 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eccc2162-0105-4ef8-9719-01f1c39000d9 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:38.462691 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-52b2cace-13bb-4311-98cf-a4c536cdc269 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:38.463577 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-52b2cace-13bb-4311-98cf-a4c536cdc269 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:38.463866 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-52b2cace-13bb-4311-98cf-a4c536cdc269 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:38.464866 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eccc2162-0105-4ef8-9719-01f1c39000d9 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:38.465872 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eccc2162-0105-4ef8-9719-01f1c39000d9 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:38.467118 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eccc2162-0105-4ef8-9719-01f1c39000d9 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:38.467965 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eccc2162-0105-4ef8-9719-01f1c39000d9 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:38.469101 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-52b2cace-13bb-4311-98cf-a4c536cdc269 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:38.469656 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-52b2cace-13bb-4311-98cf-a4c536cdc269 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:38.470416 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-52b2cace-13bb-4311-98cf-a4c536cdc269 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:38.472749 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eccc2162-0105-4ef8-9719-01f1c39000d9 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:38.910256 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-eccc2162-0105-4ef8-9719-01f1c39000d9 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:38.918824 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-eccc2162-0105-4ef8-9719-01f1c39000d9 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/fd73ee96-f932-48db-a1b5-664bb9740994" status: 200 len: 1316 microversion: 2.1 time: 0.509128 Oct 04 18:31:38.919609 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 457/911] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:38 2022] GET /compute/v2.1/servers/fd73ee96-f932-48db-a1b5-664bb9740994 => generated 1316 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:38.942097 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3fa1e152-5390-49aa-bf43-550c5a978a44 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Calling method '.version_select at 0x7fe25926ed30>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:38.993893 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3fa1e152-5390-49aa-bf43-550c5a978a44 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] 10.222.0.20 "GET /compute/v2.1/images/82e02158-d3ca-4c9a-afa8-3d1075568eff" status: 200 len: 1428 microversion: 2.1 time: 0.061147 Oct 04 18:31:38.994620 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 458/912] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:31:38 2022] GET /compute/v2.1/images/82e02158-d3ca-4c9a-afa8-3d1075568eff => generated 1428 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:38.999835 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-269caf18-3601-4443-b9fb-c3b945bddbc4 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:39.001114 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-269caf18-3601-4443-b9fb-c3b945bddbc4 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] [instance: e17c5b3e-a598-4369-9cf7-027a563e59fa] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:39.005121 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:39.010372 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-269caf18-3601-4443-b9fb-c3b945bddbc4 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:39.011146 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-269caf18-3601-4443-b9fb-c3b945bddbc4 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:39.011874 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-269caf18-3601-4443-b9fb-c3b945bddbc4 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:39.012984 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-269caf18-3601-4443-b9fb-c3b945bddbc4 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:39.013702 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-269caf18-3601-4443-b9fb-c3b945bddbc4 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:39.014361 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-269caf18-3601-4443-b9fb-c3b945bddbc4 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:39.094888 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-52b2cace-13bb-4311-98cf-a4c536cdc269 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:39.110041 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-52b2cace-13bb-4311-98cf-a4c536cdc269 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:39.112213 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-52b2cace-13bb-4311-98cf-a4c536cdc269 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:39.113529 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-52b2cace-13bb-4311-98cf-a4c536cdc269 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/6b629ba0-6245-442f-bf1a-ad1c1a3116bc" status: 200 len: 1362 microversion: 2.25 time: 0.690176 Oct 04 18:31:39.114254 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 455/913] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:31:38 2022] GET /compute/v2.1/servers/6b629ba0-6245-442f-bf1a-ad1c1a3116bc => generated 1362 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:31:39.119927 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-792e6052-48c6-4dea-a571-64e494faa66f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:39.120606 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-792e6052-48c6-4dea-a571-64e494faa66f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 89738dfe-3844-455a-93d1-d38702038946] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:39.129474 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-792e6052-48c6-4dea-a571-64e494faa66f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:39.129973 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-792e6052-48c6-4dea-a571-64e494faa66f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:39.130780 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-792e6052-48c6-4dea-a571-64e494faa66f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:39.132033 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-792e6052-48c6-4dea-a571-64e494faa66f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:39.132595 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-792e6052-48c6-4dea-a571-64e494faa66f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:39.137005 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-792e6052-48c6-4dea-a571-64e494faa66f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:39.730148 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-269caf18-3601-4443-b9fb-c3b945bddbc4 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f49a275284a7eb714a55c6bdd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e44e7aa06ee4126b5705ba65145ebcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:39.746687 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-269caf18-3601-4443-b9fb-c3b945bddbc4 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] 10.222.0.20 "GET /compute/v2.1/servers/e17c5b3e-a598-4369-9cf7-027a563e59fa" status: 200 len: 1324 microversion: 2.1 time: 0.750741 Oct 04 18:31:39.749950 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 459/914] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:38 2022] GET /compute/v2.1/servers/e17c5b3e-a598-4369-9cf7-027a563e59fa => generated 1324 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:39.774852 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-b3e421bc-2b36-44ce-a6e3-51a653f7bec0 req-cd2a7667-649d-47f5-8f37-003a960da63f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b629ba0-6245-442f-bf1a-ad1c1a3116bc", "name": "network-vif-plugged", "status": "completed", "tag": "d4883fee-1e3e-46f0-9029-6d122a317d39"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:39.792223 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-b3e421bc-2b36-44ce-a6e3-51a653f7bec0 req-cd2a7667-649d-47f5-8f37-003a960da63f service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:39.796372 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-b3e421bc-2b36-44ce-a6e3-51a653f7bec0 req-cd2a7667-649d-47f5-8f37-003a960da63f service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:39.796372 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-b3e421bc-2b36-44ce-a6e3-51a653f7bec0 req-cd2a7667-649d-47f5-8f37-003a960da63f service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:39.801598 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-792e6052-48c6-4dea-a571-64e494faa66f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:39.830842 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-b3e421bc-2b36-44ce-a6e3-51a653f7bec0 req-cd2a7667-649d-47f5-8f37-003a960da63f service nova] Creating event network-vif-plugged:d4883fee-1e3e-46f0-9029-6d122a317d39 for instance 6b629ba0-6245-442f-bf1a-ad1c1a3116bc on n-h1-850501-14 Oct 04 18:31:39.833414 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-792e6052-48c6-4dea-a571-64e494faa66f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946" status: 200 len: 1504 microversion: 2.1 time: 0.717865 Oct 04 18:31:39.837826 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 456/915] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:39 2022] GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946 => generated 1504 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:39.841592 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-b3e421bc-2b36-44ce-a6e3-51a653f7bec0 req-cd2a7667-649d-47f5-8f37-003a960da63f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083228 Oct 04 18:31:39.847377 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 460/916] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:31:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:39.955060 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-edfb39f0-fcd1-4d04-99a2-bbfa1f360565 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:39.956316 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-edfb39f0-fcd1-4d04-99a2-bbfa1f360565 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: fd73ee96-f932-48db-a1b5-664bb9740994] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:39.968047 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-edfb39f0-fcd1-4d04-99a2-bbfa1f360565 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:39.968971 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-edfb39f0-fcd1-4d04-99a2-bbfa1f360565 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:39.969652 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-edfb39f0-fcd1-4d04-99a2-bbfa1f360565 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:39.970711 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-edfb39f0-fcd1-4d04-99a2-bbfa1f360565 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:39.971404 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-edfb39f0-fcd1-4d04-99a2-bbfa1f360565 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:39.971980 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-edfb39f0-fcd1-4d04-99a2-bbfa1f360565 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:40.028671 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-354c9561-c2e9-419e-8e7d-6146e6916eca tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Calling method '.version_select at 0x7fe2592c3a60>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:40.117043 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-354c9561-c2e9-419e-8e7d-6146e6916eca tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] 10.222.0.20 "GET /compute/v2.1/images/82e02158-d3ca-4c9a-afa8-3d1075568eff" status: 200 len: 1428 microversion: 2.1 time: 0.107301 Oct 04 18:31:40.117613 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 461/917] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:31:40 2022] GET /compute/v2.1/images/82e02158-d3ca-4c9a-afa8-3d1075568eff => generated 1428 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:40.139380 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-dc4d55c7-4de7-467e-a64c-ef49400594ce tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:40.140178 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-dc4d55c7-4de7-467e-a64c-ef49400594ce tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: 6b629ba0-6245-442f-bf1a-ad1c1a3116bc] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:40.153924 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dc4d55c7-4de7-467e-a64c-ef49400594ce tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:40.158725 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dc4d55c7-4de7-467e-a64c-ef49400594ce tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:40.158725 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dc4d55c7-4de7-467e-a64c-ef49400594ce tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:40.158725 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dc4d55c7-4de7-467e-a64c-ef49400594ce tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:40.158725 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dc4d55c7-4de7-467e-a64c-ef49400594ce tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:40.159281 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dc4d55c7-4de7-467e-a64c-ef49400594ce tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:40.475129 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-edfb39f0-fcd1-4d04-99a2-bbfa1f360565 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:40.510764 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-dc4d55c7-4de7-467e-a64c-ef49400594ce tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:40.522121 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-dc4d55c7-4de7-467e-a64c-ef49400594ce tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:40.523032 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-edfb39f0-fcd1-4d04-99a2-bbfa1f360565 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/fd73ee96-f932-48db-a1b5-664bb9740994" status: 200 len: 1316 microversion: 2.1 time: 0.574977 Oct 04 18:31:40.524297 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-dc4d55c7-4de7-467e-a64c-ef49400594ce tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:40.525408 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 457/918] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:39 2022] GET /compute/v2.1/servers/fd73ee96-f932-48db-a1b5-664bb9740994 => generated 1316 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:40.540892 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-dc4d55c7-4de7-467e-a64c-ef49400594ce tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/6b629ba0-6245-442f-bf1a-ad1c1a3116bc" status: 200 len: 1362 microversion: 2.25 time: 0.390685 Oct 04 18:31:40.542834 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 462/919] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:31:40 2022] GET /compute/v2.1/servers/6b629ba0-6245-442f-bf1a-ad1c1a3116bc => generated 1362 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:31:40.775131 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-fe9329e7-08ad-42e2-bf99-839b40979912 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:40.776210 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-fe9329e7-08ad-42e2-bf99-839b40979912 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] [instance: e17c5b3e-a598-4369-9cf7-027a563e59fa] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:40.793579 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fe9329e7-08ad-42e2-bf99-839b40979912 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:40.794403 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fe9329e7-08ad-42e2-bf99-839b40979912 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:40.795671 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fe9329e7-08ad-42e2-bf99-839b40979912 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:40.798565 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fe9329e7-08ad-42e2-bf99-839b40979912 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:40.801243 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fe9329e7-08ad-42e2-bf99-839b40979912 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:40.802913 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fe9329e7-08ad-42e2-bf99-839b40979912 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:40.864440 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-cf395284-d3a5-46bf-acdd-978b19022e76 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:40.868033 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-cf395284-d3a5-46bf-acdd-978b19022e76 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 89738dfe-3844-455a-93d1-d38702038946] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:40.884258 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cf395284-d3a5-46bf-acdd-978b19022e76 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:40.884761 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cf395284-d3a5-46bf-acdd-978b19022e76 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:40.885206 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cf395284-d3a5-46bf-acdd-978b19022e76 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:40.885925 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cf395284-d3a5-46bf-acdd-978b19022e76 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:40.890527 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cf395284-d3a5-46bf-acdd-978b19022e76 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:40.891336 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cf395284-d3a5-46bf-acdd-978b19022e76 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:41.208911 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-cf395284-d3a5-46bf-acdd-978b19022e76 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:41.220375 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-cf395284-d3a5-46bf-acdd-978b19022e76 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946" status: 200 len: 1504 microversion: 2.1 time: 0.361653 Oct 04 18:31:41.222044 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 463/920] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:40 2022] GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946 => generated 1504 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:41.228677 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a720cc95-5e79-4eb1-99bb-bd466d497ef4 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Calling method '.version_select at 0x7fe259400ca0>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:41.281454 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-fe9329e7-08ad-42e2-bf99-839b40979912 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f49a275284a7eb714a55c6bdd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e44e7aa06ee4126b5705ba65145ebcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:41.304556 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-fe9329e7-08ad-42e2-bf99-839b40979912 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] 10.222.0.20 "GET /compute/v2.1/servers/e17c5b3e-a598-4369-9cf7-027a563e59fa" status: 200 len: 1324 microversion: 2.1 time: 0.529257 Oct 04 18:31:41.307995 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 458/921] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:40 2022] GET /compute/v2.1/servers/e17c5b3e-a598-4369-9cf7-027a563e59fa => generated 1324 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:41.322749 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a720cc95-5e79-4eb1-99bb-bd466d497ef4 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] 10.222.0.20 "GET /compute/v2.1/images/82e02158-d3ca-4c9a-afa8-3d1075568eff" status: 200 len: 1428 microversion: 2.1 time: 0.099287 Oct 04 18:31:41.323339 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 464/922] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:31:41 2022] GET /compute/v2.1/images/82e02158-d3ca-4c9a-afa8-3d1075568eff => generated 1428 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:41.555923 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f27f52b3-4a7c-49ba-890f-d82c828f9e51 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:41.557069 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f27f52b3-4a7c-49ba-890f-d82c828f9e51 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: fd73ee96-f932-48db-a1b5-664bb9740994] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:41.579952 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c3bf9ac6-2435-46f8-801d-9cc88981e58b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:41.580988 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c3bf9ac6-2435-46f8-801d-9cc88981e58b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: 6b629ba0-6245-442f-bf1a-ad1c1a3116bc] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:41.601482 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c3bf9ac6-2435-46f8-801d-9cc88981e58b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:41.601839 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f27f52b3-4a7c-49ba-890f-d82c828f9e51 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:41.602395 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f27f52b3-4a7c-49ba-890f-d82c828f9e51 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:41.602794 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c3bf9ac6-2435-46f8-801d-9cc88981e58b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:41.603888 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f27f52b3-4a7c-49ba-890f-d82c828f9e51 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:41.604248 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c3bf9ac6-2435-46f8-801d-9cc88981e58b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:41.605462 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f27f52b3-4a7c-49ba-890f-d82c828f9e51 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:41.607191 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f27f52b3-4a7c-49ba-890f-d82c828f9e51 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:41.607392 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c3bf9ac6-2435-46f8-801d-9cc88981e58b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:41.607641 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f27f52b3-4a7c-49ba-890f-d82c828f9e51 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:41.608530 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c3bf9ac6-2435-46f8-801d-9cc88981e58b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:41.616201 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c3bf9ac6-2435-46f8-801d-9cc88981e58b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:41.641097 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=100 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:41.941406 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f27f52b3-4a7c-49ba-890f-d82c828f9e51 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:41.954696 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f27f52b3-4a7c-49ba-890f-d82c828f9e51 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/fd73ee96-f932-48db-a1b5-664bb9740994" status: 200 len: 1316 microversion: 2.1 time: 0.407913 Oct 04 18:31:41.955564 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 459/923] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:41 2022] GET /compute/v2.1/servers/fd73ee96-f932-48db-a1b5-664bb9740994 => generated 1316 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:41.979441 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c3bf9ac6-2435-46f8-801d-9cc88981e58b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:41.989182 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c3bf9ac6-2435-46f8-801d-9cc88981e58b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:41.993101 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c3bf9ac6-2435-46f8-801d-9cc88981e58b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:41.994496 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c3bf9ac6-2435-46f8-801d-9cc88981e58b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/6b629ba0-6245-442f-bf1a-ad1c1a3116bc" status: 200 len: 1362 microversion: 2.25 time: 0.420120 Oct 04 18:31:41.995540 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 465/924] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:31:41 2022] GET /compute/v2.1/servers/6b629ba0-6245-442f-bf1a-ad1c1a3116bc => generated 1362 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:31:42.249379 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-21654860-9d7d-4e12-930e-43fe429c0006 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:42.249994 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-21654860-9d7d-4e12-930e-43fe429c0006 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 89738dfe-3844-455a-93d1-d38702038946] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:42.258222 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-21654860-9d7d-4e12-930e-43fe429c0006 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:42.258723 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-21654860-9d7d-4e12-930e-43fe429c0006 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:42.259161 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-21654860-9d7d-4e12-930e-43fe429c0006 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:42.264006 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-21654860-9d7d-4e12-930e-43fe429c0006 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:42.266285 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-21654860-9d7d-4e12-930e-43fe429c0006 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:42.267424 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-21654860-9d7d-4e12-930e-43fe429c0006 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:42.331687 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d96ab6d5-d08f-4ac4-9af9-e3d1d1b4e4c9 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:42.332350 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d96ab6d5-d08f-4ac4-9af9-e3d1d1b4e4c9 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] [instance: e17c5b3e-a598-4369-9cf7-027a563e59fa] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:42.343250 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d96ab6d5-d08f-4ac4-9af9-e3d1d1b4e4c9 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:42.347785 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d96ab6d5-d08f-4ac4-9af9-e3d1d1b4e4c9 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:42.349365 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d96ab6d5-d08f-4ac4-9af9-e3d1d1b4e4c9 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:42.352692 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d96ab6d5-d08f-4ac4-9af9-e3d1d1b4e4c9 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:42.362338 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d96ab6d5-d08f-4ac4-9af9-e3d1d1b4e4c9 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:42.362338 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d96ab6d5-d08f-4ac4-9af9-e3d1d1b4e4c9 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:42.810446 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d96ab6d5-d08f-4ac4-9af9-e3d1d1b4e4c9 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f49a275284a7eb714a55c6bdd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e44e7aa06ee4126b5705ba65145ebcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:42.821050 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d96ab6d5-d08f-4ac4-9af9-e3d1d1b4e4c9 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] 10.222.0.20 "GET /compute/v2.1/servers/e17c5b3e-a598-4369-9cf7-027a563e59fa" status: 200 len: 1324 microversion: 2.1 time: 0.492944 Oct 04 18:31:42.821728 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 466/925] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:42 2022] GET /compute/v2.1/servers/e17c5b3e-a598-4369-9cf7-027a563e59fa => generated 1324 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:31:42.831106 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2cfecc41-8cc7-454a-b3ed-2dce4fbbf9be tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Calling method '.version_select at 0x7fe2592fedc0>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:42.847860 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-21654860-9d7d-4e12-930e-43fe429c0006 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:42.860537 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-21654860-9d7d-4e12-930e-43fe429c0006 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946" status: 200 len: 1494 microversion: 2.1 time: 0.616940 Oct 04 18:31:42.861509 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 460/926] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:42 2022] GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946 => generated 1494 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:42.885768 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-079956ea-5f71-4950-9d9d-083014759184 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Calling method '.version_select at 0x7fe2590ee820>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:42.891485 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-079956ea-5f71-4950-9d9d-083014759184 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:42.892332 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-079956ea-5f71-4950-9d9d-083014759184 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:42.893014 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-079956ea-5f71-4950-9d9d-083014759184 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:42.905681 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-079956ea-5f71-4950-9d9d-083014759184 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 790 microversion: 2.1 time: 0.026159 Oct 04 18:31:42.907651 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 461/927] 10.222.0.20 () {58 vars in 1143 bytes} [Tue Oct 4 18:31:42 2022] GET /compute/v2.1/os-migrations => generated 790 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:42.936149 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-000d1a37-ecf0-43ad-9026-a829fe241996 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:42.937267 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-000d1a37-ecf0-43ad-9026-a829fe241996 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] [instance: 89738dfe-3844-455a-93d1-d38702038946] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:42.953982 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2cfecc41-8cc7-454a-b3ed-2dce4fbbf9be tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] 10.222.0.20 "GET /compute/v2.1/images/82e02158-d3ca-4c9a-afa8-3d1075568eff" status: 200 len: 1428 microversion: 2.1 time: 0.127530 Oct 04 18:31:42.971557 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 467/928] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:31:42 2022] GET /compute/v2.1/images/82e02158-d3ca-4c9a-afa8-3d1075568eff => generated 1428 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:42.971793 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-000d1a37-ecf0-43ad-9026-a829fe241996 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:42.971793 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-000d1a37-ecf0-43ad-9026-a829fe241996 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:42.971793 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-000d1a37-ecf0-43ad-9026-a829fe241996 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:42.971793 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-000d1a37-ecf0-43ad-9026-a829fe241996 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:42.972482 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-000d1a37-ecf0-43ad-9026-a829fe241996 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:42.972482 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-000d1a37-ecf0-43ad-9026-a829fe241996 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:42.983376 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-dec5d861-4bc5-4c49-bbe1-079c3bc3d57c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:42.985218 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-dec5d861-4bc5-4c49-bbe1-079c3bc3d57c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: fd73ee96-f932-48db-a1b5-664bb9740994] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:42.993038 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dec5d861-4bc5-4c49-bbe1-079c3bc3d57c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:42.994598 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dec5d861-4bc5-4c49-bbe1-079c3bc3d57c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:42.995276 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dec5d861-4bc5-4c49-bbe1-079c3bc3d57c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:42.996245 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dec5d861-4bc5-4c49-bbe1-079c3bc3d57c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:42.997169 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dec5d861-4bc5-4c49-bbe1-079c3bc3d57c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:42.997813 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dec5d861-4bc5-4c49-bbe1-079c3bc3d57c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:43.368793 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-dec5d861-4bc5-4c49-bbe1-079c3bc3d57c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:43.378143 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-dec5d861-4bc5-4c49-bbe1-079c3bc3d57c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/fd73ee96-f932-48db-a1b5-664bb9740994" status: 200 len: 1316 microversion: 2.1 time: 0.399204 Oct 04 18:31:43.393476 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 468/929] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:42 2022] GET /compute/v2.1/servers/fd73ee96-f932-48db-a1b5-664bb9740994 => generated 1316 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:43.399066 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8bd4e351-782b-475c-924c-899401a42d1f tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:43.399685 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8bd4e351-782b-475c-924c-899401a42d1f tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: 6b629ba0-6245-442f-bf1a-ad1c1a3116bc] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:43.414123 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8bd4e351-782b-475c-924c-899401a42d1f tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:43.416362 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8bd4e351-782b-475c-924c-899401a42d1f tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:43.416362 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8bd4e351-782b-475c-924c-899401a42d1f tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:43.416362 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8bd4e351-782b-475c-924c-899401a42d1f tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:43.419723 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-000d1a37-ecf0-43ad-9026-a829fe241996 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946" status: 200 len: 1647 microversion: 2.1 time: 0.489124 Oct 04 18:31:43.420787 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 462/930] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:42 2022] GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946 => generated 1647 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:43.428683 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8bd4e351-782b-475c-924c-899401a42d1f tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:43.429453 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8bd4e351-782b-475c-924c-899401a42d1f tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:43.638244 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-489586da-7c8c-4d5e-8614-cd5d0330bbe6 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1668625662", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": [{"uuid": "c77a0479-286d-44e4-a122-b4b514a72dc4"}]}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:43.678533 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8bd4e351-782b-475c-924c-899401a42d1f tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:43.689294 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8bd4e351-782b-475c-924c-899401a42d1f tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:43.692082 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8bd4e351-782b-475c-924c-899401a42d1f tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:43.694741 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8bd4e351-782b-475c-924c-899401a42d1f tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/6b629ba0-6245-442f-bf1a-ad1c1a3116bc" status: 200 len: 1557 microversion: 2.25 time: 0.305285 Oct 04 18:31:43.695892 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 469/931] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:31:43 2022] GET /compute/v2.1/servers/6b629ba0-6245-442f-bf1a-ad1c1a3116bc => generated 1557 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:31:43.730258 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.neutron [None req-489586da-7c8c-4d5e-8614-cd5d0330bbe6 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] validate_networks() for [('c77a0479-286d-44e4-a122-b4b514a72dc4', None, None, None, None, None)] {{(pid=123001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:31:43.739732 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1842e933-8f9f-49ee-8fbf-cb051217f7f7 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:43.741255 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1842e933-8f9f-49ee-8fbf-cb051217f7f7 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] [instance: 6b629ba0-6245-442f-bf1a-ad1c1a3116bc] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:43.750227 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1842e933-8f9f-49ee-8fbf-cb051217f7f7 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:43.751054 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1842e933-8f9f-49ee-8fbf-cb051217f7f7 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:43.751764 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1842e933-8f9f-49ee-8fbf-cb051217f7f7 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:43.754038 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1842e933-8f9f-49ee-8fbf-cb051217f7f7 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:43.755214 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1842e933-8f9f-49ee-8fbf-cb051217f7f7 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:43.755930 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1842e933-8f9f-49ee-8fbf-cb051217f7f7 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:44.050097 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-1842e933-8f9f-49ee-8fbf-cb051217f7f7 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lazy-loading 'services' on Instance uuid 6b629ba0-6245-442f-bf1a-ad1c1a3116bc {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:31:44.086233 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1842e933-8f9f-49ee-8fbf-cb051217f7f7 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/6b629ba0-6245-442f-bf1a-ad1c1a3116bc" status: 200 len: 2052 microversion: 2.25 time: 0.350605 Oct 04 18:31:44.101321 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 470/932] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:31:43 2022] GET /compute/v2.1/servers/6b629ba0-6245-442f-bf1a-ad1c1a3116bc => generated 2052 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:31:44.118694 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8b501e54-32b6-404d-87a3-9ddaf97b9ec2 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:44.119440 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8b501e54-32b6-404d-87a3-9ddaf97b9ec2 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] [instance: e17c5b3e-a598-4369-9cf7-027a563e59fa] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:44.126958 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8b501e54-32b6-404d-87a3-9ddaf97b9ec2 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:44.127715 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8b501e54-32b6-404d-87a3-9ddaf97b9ec2 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:44.128530 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8b501e54-32b6-404d-87a3-9ddaf97b9ec2 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:44.133195 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8b501e54-32b6-404d-87a3-9ddaf97b9ec2 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:44.134390 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8b501e54-32b6-404d-87a3-9ddaf97b9ec2 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:44.135359 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8b501e54-32b6-404d-87a3-9ddaf97b9ec2 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:44.431807 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8b501e54-32b6-404d-87a3-9ddaf97b9ec2 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f49a275284a7eb714a55c6bdd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e44e7aa06ee4126b5705ba65145ebcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:44.443193 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8b501e54-32b6-404d-87a3-9ddaf97b9ec2 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] 10.222.0.20 "GET /compute/v2.1/servers/e17c5b3e-a598-4369-9cf7-027a563e59fa" status: 200 len: 1324 microversion: 2.1 time: 0.339497 Oct 04 18:31:44.444566 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 471/933] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:44 2022] GET /compute/v2.1/servers/e17c5b3e-a598-4369-9cf7-027a563e59fa => generated 1324 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:44.452553 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d446ca9f-ebd3-4535-a000-0fdcad68accd tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Calling method '.version_select at 0x7fe2593a3670>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:44.474471 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-489586da-7c8c-4d5e-8614-cd5d0330bbe6 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:31:44.474471 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-489586da-7c8c-4d5e-8614-cd5d0330bbe6 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:31:44.475435 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-489586da-7c8c-4d5e-8614-cd5d0330bbe6 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:31:44.476174 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-489586da-7c8c-4d5e-8614-cd5d0330bbe6 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:31:44.479859 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-489586da-7c8c-4d5e-8614-cd5d0330bbe6 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:31:44.499536 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-489586da-7c8c-4d5e-8614-cd5d0330bbe6 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:44.502262 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-489586da-7c8c-4d5e-8614-cd5d0330bbe6 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:44.502262 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-489586da-7c8c-4d5e-8614-cd5d0330bbe6 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:44.502262 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-489586da-7c8c-4d5e-8614-cd5d0330bbe6 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:44.502262 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-489586da-7c8c-4d5e-8614-cd5d0330bbe6 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:44.508813 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-489586da-7c8c-4d5e-8614-cd5d0330bbe6 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:44.539470 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d446ca9f-ebd3-4535-a000-0fdcad68accd tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] 10.222.0.20 "GET /compute/v2.1/images/82e02158-d3ca-4c9a-afa8-3d1075568eff" status: 200 len: 1428 microversion: 2.1 time: 0.090866 Oct 04 18:31:44.540047 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 472/934] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:31:44 2022] GET /compute/v2.1/images/82e02158-d3ca-4c9a-afa8-3d1075568eff => generated 1428 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:44.548926 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-91c7f030-7c16-44c3-a145-27f630444b93 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:44.549554 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-91c7f030-7c16-44c3-a145-27f630444b93 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] [instance: 6b629ba0-6245-442f-bf1a-ad1c1a3116bc] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:44.559843 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-489586da-7c8c-4d5e-8614-cd5d0330bbe6 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Getting quotas for project dde62f171d474b038f1af39899518211. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:31:44.563903 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-489586da-7c8c-4d5e-8614-cd5d0330bbe6 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Getting quotas for user c80f2b2dbf824a1d879f5b7edb343f26 and project dde62f171d474b038f1af39899518211. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:31:44.567419 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-91c7f030-7c16-44c3-a145-27f630444b93 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:44.568560 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-91c7f030-7c16-44c3-a145-27f630444b93 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:44.571694 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-91c7f030-7c16-44c3-a145-27f630444b93 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:44.571887 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-91c7f030-7c16-44c3-a145-27f630444b93 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:44.572335 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-91c7f030-7c16-44c3-a145-27f630444b93 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:44.575608 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-91c7f030-7c16-44c3-a145-27f630444b93 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:44.579016 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-489586da-7c8c-4d5e-8614-cd5d0330bbe6 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Going to run 1 instances... {{(pid=123001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:31:44.582304 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-489586da-7c8c-4d5e-8614-cd5d0330bbe6 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 4e1bb5af-9b8b-456f-beb1-aadf2491a8ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:31:44.717881 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-489586da-7c8c-4d5e-8614-cd5d0330bbe6 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.087414 Oct 04 18:31:44.723742 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 463/935] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:31:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1094 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 18:31:44.741285 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c6a64129-e4fa-400d-b4f4-804a134a83fd tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:44.748546 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c6a64129-e4fa-400d-b4f4-804a134a83fd tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: fd73ee96-f932-48db-a1b5-664bb9740994] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:44.782169 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c6a64129-e4fa-400d-b4f4-804a134a83fd tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:44.786356 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c6a64129-e4fa-400d-b4f4-804a134a83fd tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:44.787670 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c6a64129-e4fa-400d-b4f4-804a134a83fd tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:44.791440 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c6a64129-e4fa-400d-b4f4-804a134a83fd tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:44.794923 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c6a64129-e4fa-400d-b4f4-804a134a83fd tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:44.796209 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c6a64129-e4fa-400d-b4f4-804a134a83fd tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:44.800717 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-91c7f030-7c16-44c3-a145-27f630444b93 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lazy-loading 'services' on Instance uuid 6b629ba0-6245-442f-bf1a-ad1c1a3116bc {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:31:44.831223 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-91c7f030-7c16-44c3-a145-27f630444b93 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/6b629ba0-6245-442f-bf1a-ad1c1a3116bc" status: 200 len: 2052 microversion: 2.25 time: 0.290085 Oct 04 18:31:44.832517 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 473/936] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:31:44 2022] GET /compute/v2.1/servers/6b629ba0-6245-442f-bf1a-ad1c1a3116bc => generated 2052 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:31:44.838152 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-fd726637-d73b-4049-b15c-3ad834cfdbd2 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:44.838996 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-fd726637-d73b-4049-b15c-3ad834cfdbd2 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 4e1bb5af-9b8b-456f-beb1-aadf2491a8ed] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:44.897906 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-fd726637-d73b-4049-b15c-3ad834cfdbd2 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:44.905874 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-fd726637-d73b-4049-b15c-3ad834cfdbd2 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/4e1bb5af-9b8b-456f-beb1-aadf2491a8ed" status: 200 len: 1211 microversion: 2.1 time: 0.072116 Oct 04 18:31:44.908117 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 474/937] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:44 2022] GET /compute/v2.1/servers/4e1bb5af-9b8b-456f-beb1-aadf2491a8ed => generated 1211 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:44.914054 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-589926a5-8bd5-4f9b-a492-16596ca50b1c tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:44.929481 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-589926a5-8bd5-4f9b-a492-16596ca50b1c tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:44.930503 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-589926a5-8bd5-4f9b-a492-16596ca50b1c tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:44.930939 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-589926a5-8bd5-4f9b-a492-16596ca50b1c tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:44.937422 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-589926a5-8bd5-4f9b-a492-16596ca50b1c tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:44.937928 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-589926a5-8bd5-4f9b-a492-16596ca50b1c tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:44.938547 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-589926a5-8bd5-4f9b-a492-16596ca50b1c tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:45.015558 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-589926a5-8bd5-4f9b-a492-16596ca50b1c tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.105711 Oct 04 18:31:45.016544 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 475/938] 10.222.0.20 () {60 vars in 1217 bytes} [Tue Oct 4 18:31:44 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:31:45.032882 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-67065461-dc1a-4750-a6af-033650f2e753 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:45.033439 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-67065461-dc1a-4750-a6af-033650f2e753 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] [instance: 6b629ba0-6245-442f-bf1a-ad1c1a3116bc] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:45.074485 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-67065461-dc1a-4750-a6af-033650f2e753 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:45.075750 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-67065461-dc1a-4750-a6af-033650f2e753 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:45.076451 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-67065461-dc1a-4750-a6af-033650f2e753 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:45.077206 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-67065461-dc1a-4750-a6af-033650f2e753 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:45.077671 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-67065461-dc1a-4750-a6af-033650f2e753 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:45.078106 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-67065461-dc1a-4750-a6af-033650f2e753 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:45.132294 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c6a64129-e4fa-400d-b4f4-804a134a83fd tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:45.141676 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c6a64129-e4fa-400d-b4f4-804a134a83fd tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/fd73ee96-f932-48db-a1b5-664bb9740994" status: 200 len: 1316 microversion: 2.1 time: 0.415241 Oct 04 18:31:45.148569 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 464/939] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:44 2022] GET /compute/v2.1/servers/fd73ee96-f932-48db-a1b5-664bb9740994 => generated 1316 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:45.205274 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:45.469417 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6dacba1d-ad7d-4843-a312-4a53b21f7b84 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:45.470465 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6dacba1d-ad7d-4843-a312-4a53b21f7b84 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] [instance: e17c5b3e-a598-4369-9cf7-027a563e59fa] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:45.478059 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6dacba1d-ad7d-4843-a312-4a53b21f7b84 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:45.485944 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6dacba1d-ad7d-4843-a312-4a53b21f7b84 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:45.485944 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6dacba1d-ad7d-4843-a312-4a53b21f7b84 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:45.485944 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6dacba1d-ad7d-4843-a312-4a53b21f7b84 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:45.485944 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6dacba1d-ad7d-4843-a312-4a53b21f7b84 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:45.486433 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6dacba1d-ad7d-4843-a312-4a53b21f7b84 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:45.644232 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-67065461-dc1a-4750-a6af-033650f2e753 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/6b629ba0-6245-442f-bf1a-ad1c1a3116bc/action" status: 202 len: 0 microversion: 2.25 time: 0.614019 Oct 04 18:31:45.648807 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 476/940] 10.222.0.20 () {62 vars in 1319 bytes} [Tue Oct 4 18:31:45 2022] POST /compute/v2.1/servers/6b629ba0-6245-442f-bf1a-ad1c1a3116bc/action => generated 0 bytes in 620 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:31:45.659897 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-386b85f9-8735-4391-9a84-9c043c47bae9 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Calling method '.version_select at 0x7fe25926edc0>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:45.695802 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6dacba1d-ad7d-4843-a312-4a53b21f7b84 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f49a275284a7eb714a55c6bdd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e44e7aa06ee4126b5705ba65145ebcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:45.728734 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6dacba1d-ad7d-4843-a312-4a53b21f7b84 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] 10.222.0.20 "GET /compute/v2.1/servers/e17c5b3e-a598-4369-9cf7-027a563e59fa" status: 200 len: 1324 microversion: 2.1 time: 0.261094 Oct 04 18:31:45.730910 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 465/941] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:45 2022] GET /compute/v2.1/servers/e17c5b3e-a598-4369-9cf7-027a563e59fa => generated 1324 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:45.741009 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c3d132f5-7060-4ac7-8721-6048852f3a31 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:45.742151 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c3d132f5-7060-4ac7-8721-6048852f3a31 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] [instance: 6b629ba0-6245-442f-bf1a-ad1c1a3116bc] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:45.750488 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-386b85f9-8735-4391-9a84-9c043c47bae9 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] 10.222.0.20 "GET /compute/v2.1/images/82e02158-d3ca-4c9a-afa8-3d1075568eff" status: 200 len: 1428 microversion: 2.1 time: 0.099299 Oct 04 18:31:45.751278 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c3d132f5-7060-4ac7-8721-6048852f3a31 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:45.751586 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 477/942] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:31:45 2022] GET /compute/v2.1/images/82e02158-d3ca-4c9a-afa8-3d1075568eff => generated 1428 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:45.752282 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c3d132f5-7060-4ac7-8721-6048852f3a31 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:45.753870 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c3d132f5-7060-4ac7-8721-6048852f3a31 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:45.754828 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c3d132f5-7060-4ac7-8721-6048852f3a31 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:45.756401 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c3d132f5-7060-4ac7-8721-6048852f3a31 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:45.757036 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c3d132f5-7060-4ac7-8721-6048852f3a31 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:45.806479 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-2d1c2c48-41d5-4f69-87cc-0db4b923ed73 req-297670a3-564b-4d18-82c6-4f5fce021edd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd73ee96-f932-48db-a1b5-664bb9740994", "name": "network-vif-plugged", "status": "completed", "tag": "2c7f74ad-951d-4733-95ca-cd81429289f8"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:45.825398 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-2d1c2c48-41d5-4f69-87cc-0db4b923ed73 req-297670a3-564b-4d18-82c6-4f5fce021edd service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:45.825398 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-2d1c2c48-41d5-4f69-87cc-0db4b923ed73 req-297670a3-564b-4d18-82c6-4f5fce021edd service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:45.825398 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-2d1c2c48-41d5-4f69-87cc-0db4b923ed73 req-297670a3-564b-4d18-82c6-4f5fce021edd service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:45.840093 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-2d1c2c48-41d5-4f69-87cc-0db4b923ed73 req-297670a3-564b-4d18-82c6-4f5fce021edd service nova] Creating event network-vif-plugged:2c7f74ad-951d-4733-95ca-cd81429289f8 for instance fd73ee96-f932-48db-a1b5-664bb9740994 on n-h1-850501-14 Oct 04 18:31:45.846639 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-2d1c2c48-41d5-4f69-87cc-0db4b923ed73 req-297670a3-564b-4d18-82c6-4f5fce021edd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044532 Oct 04 18:31:45.848093 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 478/943] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:31:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:31:45.924553 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-c3d132f5-7060-4ac7-8721-6048852f3a31 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lazy-loading 'services' on Instance uuid 6b629ba0-6245-442f-bf1a-ad1c1a3116bc {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:31:45.935923 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5de61a56-e6a5-4498-910d-714074cde9ed tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:45.937301 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5de61a56-e6a5-4498-910d-714074cde9ed tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 4e1bb5af-9b8b-456f-beb1-aadf2491a8ed] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:45.957617 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c3d132f5-7060-4ac7-8721-6048852f3a31 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/6b629ba0-6245-442f-bf1a-ad1c1a3116bc" status: 200 len: 2057 microversion: 2.25 time: 0.223400 Oct 04 18:31:45.962157 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 466/944] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:31:45 2022] GET /compute/v2.1/servers/6b629ba0-6245-442f-bf1a-ad1c1a3116bc => generated 2057 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:31:46.023685 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5de61a56-e6a5-4498-910d-714074cde9ed tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:46.032384 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5de61a56-e6a5-4498-910d-714074cde9ed tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/4e1bb5af-9b8b-456f-beb1-aadf2491a8ed" status: 200 len: 1211 microversion: 2.1 time: 0.100797 Oct 04 18:31:46.060751 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 479/945] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:45 2022] GET /compute/v2.1/servers/4e1bb5af-9b8b-456f-beb1-aadf2491a8ed => generated 1211 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:46.177088 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5edc622d-dde8-4564-a1f5-b627c2314765 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:46.178634 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5edc622d-dde8-4564-a1f5-b627c2314765 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: fd73ee96-f932-48db-a1b5-664bb9740994] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:46.196725 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5edc622d-dde8-4564-a1f5-b627c2314765 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:46.197795 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5edc622d-dde8-4564-a1f5-b627c2314765 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:46.199389 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5edc622d-dde8-4564-a1f5-b627c2314765 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:46.201000 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5edc622d-dde8-4564-a1f5-b627c2314765 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:46.201896 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5edc622d-dde8-4564-a1f5-b627c2314765 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:46.202564 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5edc622d-dde8-4564-a1f5-b627c2314765 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:46.481892 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5edc622d-dde8-4564-a1f5-b627c2314765 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:46.492423 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5edc622d-dde8-4564-a1f5-b627c2314765 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/fd73ee96-f932-48db-a1b5-664bb9740994" status: 200 len: 1316 microversion: 2.1 time: 0.321884 Oct 04 18:31:46.494439 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 467/946] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:46 2022] GET /compute/v2.1/servers/fd73ee96-f932-48db-a1b5-664bb9740994 => generated 1316 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:46.759612 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b97b0372-4d1d-44cb-94b1-6bdcc2796b40 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:46.761794 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b97b0372-4d1d-44cb-94b1-6bdcc2796b40 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] [instance: e17c5b3e-a598-4369-9cf7-027a563e59fa] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:46.770573 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-45617910-3ddf-4d97-aab1-496e1a213eff tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Calling method '.version_select at 0x7fe2590f41f0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:46.798400 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b97b0372-4d1d-44cb-94b1-6bdcc2796b40 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:46.799177 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b97b0372-4d1d-44cb-94b1-6bdcc2796b40 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:46.806060 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b97b0372-4d1d-44cb-94b1-6bdcc2796b40 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:46.807485 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b97b0372-4d1d-44cb-94b1-6bdcc2796b40 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:46.810378 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b97b0372-4d1d-44cb-94b1-6bdcc2796b40 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:46.810813 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b97b0372-4d1d-44cb-94b1-6bdcc2796b40 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:46.850741 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-45617910-3ddf-4d97-aab1-496e1a213eff tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] 10.222.0.20 "GET /compute/v2.1/images/82e02158-d3ca-4c9a-afa8-3d1075568eff" status: 200 len: 1428 microversion: 2.1 time: 0.086103 Oct 04 18:31:46.852437 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 468/947] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:31:46 2022] GET /compute/v2.1/images/82e02158-d3ca-4c9a-afa8-3d1075568eff => generated 1428 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:46.987782 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-94fab4f5-d89a-4b06-a63e-b62bfb4339e7 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:46.988976 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-94fab4f5-d89a-4b06-a63e-b62bfb4339e7 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] [instance: 6b629ba0-6245-442f-bf1a-ad1c1a3116bc] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:47.000421 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-94fab4f5-d89a-4b06-a63e-b62bfb4339e7 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:47.001232 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-94fab4f5-d89a-4b06-a63e-b62bfb4339e7 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:47.002074 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-94fab4f5-d89a-4b06-a63e-b62bfb4339e7 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:47.006872 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-94fab4f5-d89a-4b06-a63e-b62bfb4339e7 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:47.006872 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-94fab4f5-d89a-4b06-a63e-b62bfb4339e7 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:47.006872 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-94fab4f5-d89a-4b06-a63e-b62bfb4339e7 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:47.035110 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b97b0372-4d1d-44cb-94b1-6bdcc2796b40 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f49a275284a7eb714a55c6bdd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e44e7aa06ee4126b5705ba65145ebcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:47.046962 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b97b0372-4d1d-44cb-94b1-6bdcc2796b40 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] 10.222.0.20 "GET /compute/v2.1/servers/e17c5b3e-a598-4369-9cf7-027a563e59fa" status: 200 len: 1324 microversion: 2.1 time: 0.292171 Oct 04 18:31:47.052167 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 480/948] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:46 2022] GET /compute/v2.1/servers/e17c5b3e-a598-4369-9cf7-027a563e59fa => generated 1324 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:47.072493 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-da7aa213-27c3-4718-af1a-a8991433b12f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:47.073818 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-da7aa213-27c3-4718-af1a-a8991433b12f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 4e1bb5af-9b8b-456f-beb1-aadf2491a8ed] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:47.115158 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-da7aa213-27c3-4718-af1a-a8991433b12f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:47.116882 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-da7aa213-27c3-4718-af1a-a8991433b12f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:47.120421 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-da7aa213-27c3-4718-af1a-a8991433b12f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:47.124997 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-da7aa213-27c3-4718-af1a-a8991433b12f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:47.129158 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-da7aa213-27c3-4718-af1a-a8991433b12f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:47.129997 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-da7aa213-27c3-4718-af1a-a8991433b12f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:47.360327 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-da7aa213-27c3-4718-af1a-a8991433b12f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:47.389106 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-da7aa213-27c3-4718-af1a-a8991433b12f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/4e1bb5af-9b8b-456f-beb1-aadf2491a8ed" status: 200 len: 1207 microversion: 2.1 time: 0.323684 Oct 04 18:31:47.392608 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 481/949] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:47 2022] GET /compute/v2.1/servers/4e1bb5af-9b8b-456f-beb1-aadf2491a8ed => generated 1207 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:31:47.478739 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-94fab4f5-d89a-4b06-a63e-b62bfb4339e7 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lazy-loading 'services' on Instance uuid 6b629ba0-6245-442f-bf1a-ad1c1a3116bc {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:31:47.510521 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-94fab4f5-d89a-4b06-a63e-b62bfb4339e7 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/6b629ba0-6245-442f-bf1a-ad1c1a3116bc" status: 200 len: 2037 microversion: 2.25 time: 0.527267 Oct 04 18:31:47.520152 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 469/950] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:31:46 2022] GET /compute/v2.1/servers/6b629ba0-6245-442f-bf1a-ad1c1a3116bc => generated 2037 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:31:47.535609 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-54873f01-31bd-45bb-91fe-5d5c68aa2d1a tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:47.537395 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-54873f01-31bd-45bb-91fe-5d5c68aa2d1a tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: fd73ee96-f932-48db-a1b5-664bb9740994] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:47.547464 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-54873f01-31bd-45bb-91fe-5d5c68aa2d1a tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:47.548637 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-32d73148-0936-4c5c-a6d7-caca1bb1c405 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-850501-14", "block_migration": "auto"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:47.550233 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-54873f01-31bd-45bb-91fe-5d5c68aa2d1a tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:47.551102 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-54873f01-31bd-45bb-91fe-5d5c68aa2d1a tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:47.552373 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-54873f01-31bd-45bb-91fe-5d5c68aa2d1a tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:47.553636 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-32d73148-0936-4c5c-a6d7-caca1bb1c405 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] [instance: 6b629ba0-6245-442f-bf1a-ad1c1a3116bc] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:47.555935 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-54873f01-31bd-45bb-91fe-5d5c68aa2d1a tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:47.557987 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-54873f01-31bd-45bb-91fe-5d5c68aa2d1a tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:47.566091 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-32d73148-0936-4c5c-a6d7-caca1bb1c405 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:47.566585 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-32d73148-0936-4c5c-a6d7-caca1bb1c405 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:47.567062 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-32d73148-0936-4c5c-a6d7-caca1bb1c405 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:47.572515 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-32d73148-0936-4c5c-a6d7-caca1bb1c405 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:47.573018 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-32d73148-0936-4c5c-a6d7-caca1bb1c405 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:47.574832 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-32d73148-0936-4c5c-a6d7-caca1bb1c405 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:47.617653 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-32d73148-0936-4c5c-a6d7-caca1bb1c405 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lazy-loading 'flavor' on Instance uuid 6b629ba0-6245-442f-bf1a-ad1c1a3116bc {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:31:47.637308 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-32d73148-0936-4c5c-a6d7-caca1bb1c405 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] [instance: 6b629ba0-6245-442f-bf1a-ad1c1a3116bc] Going to try to live migrate instance to n-h2-850501-14 {{(pid=123001) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 18:31:47.874023 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-54873f01-31bd-45bb-91fe-5d5c68aa2d1a tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:47.901535 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-54873f01-31bd-45bb-91fe-5d5c68aa2d1a tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/fd73ee96-f932-48db-a1b5-664bb9740994" status: 200 len: 1316 microversion: 2.1 time: 0.367430 Oct 04 18:31:47.901535 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 482/951] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:47 2022] GET /compute/v2.1/servers/fd73ee96-f932-48db-a1b5-664bb9740994 => generated 1316 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:47.901535 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c0eb67ca-85e2-4d9e-89f7-a0d155dcc45e tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Calling method '.version_select at 0x7fe259467dc0>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:47.988030 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c0eb67ca-85e2-4d9e-89f7-a0d155dcc45e tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] 10.222.0.20 "GET /compute/v2.1/images/82e02158-d3ca-4c9a-afa8-3d1075568eff" status: 200 len: 1428 microversion: 2.1 time: 0.100606 Oct 04 18:31:47.988425 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 483/952] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:31:47 2022] GET /compute/v2.1/images/82e02158-d3ca-4c9a-afa8-3d1075568eff => generated 1428 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:48.003429 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-29607460-ffda-44f4-91ba-9b3ba0de348e req-529f426d-a577-4c08-9550-4c4705302592 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e17c5b3e-a598-4369-9cf7-027a563e59fa", "name": "network-vif-plugged", "status": "completed", "tag": "2f0b5af6-0cc2-4949-8880-47b512d4f031"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:48.020491 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-29607460-ffda-44f4-91ba-9b3ba0de348e req-529f426d-a577-4c08-9550-4c4705302592 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:48.022359 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-29607460-ffda-44f4-91ba-9b3ba0de348e req-529f426d-a577-4c08-9550-4c4705302592 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:48.022955 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-29607460-ffda-44f4-91ba-9b3ba0de348e req-529f426d-a577-4c08-9550-4c4705302592 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:48.045806 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-29607460-ffda-44f4-91ba-9b3ba0de348e req-529f426d-a577-4c08-9550-4c4705302592 service nova] Creating event network-vif-plugged:2f0b5af6-0cc2-4949-8880-47b512d4f031 for instance e17c5b3e-a598-4369-9cf7-027a563e59fa on n-h1-850501-14 Oct 04 18:31:48.053114 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-29607460-ffda-44f4-91ba-9b3ba0de348e req-529f426d-a577-4c08-9550-4c4705302592 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059829 Oct 04 18:31:48.054509 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 484/953] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:31:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:48.073177 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-82461d7f-95ad-46a3-b4be-fb79dff414d5 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:48.074066 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-82461d7f-95ad-46a3-b4be-fb79dff414d5 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] [instance: e17c5b3e-a598-4369-9cf7-027a563e59fa] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:48.111769 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-82461d7f-95ad-46a3-b4be-fb79dff414d5 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:48.116282 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-82461d7f-95ad-46a3-b4be-fb79dff414d5 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:48.116978 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-82461d7f-95ad-46a3-b4be-fb79dff414d5 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:48.118453 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-82461d7f-95ad-46a3-b4be-fb79dff414d5 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:48.125770 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-82461d7f-95ad-46a3-b4be-fb79dff414d5 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:48.126506 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-82461d7f-95ad-46a3-b4be-fb79dff414d5 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:48.399163 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-82461d7f-95ad-46a3-b4be-fb79dff414d5 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f49a275284a7eb714a55c6bdd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e44e7aa06ee4126b5705ba65145ebcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:48.408649 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-82461d7f-95ad-46a3-b4be-fb79dff414d5 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] 10.222.0.20 "GET /compute/v2.1/servers/e17c5b3e-a598-4369-9cf7-027a563e59fa" status: 200 len: 1324 microversion: 2.1 time: 0.338862 Oct 04 18:31:48.409774 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 485/954] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:48 2022] GET /compute/v2.1/servers/e17c5b3e-a598-4369-9cf7-027a563e59fa => generated 1324 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:48.727041 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-51626cce-9866-43b8-9731-b55885bab3e2 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1050243812", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": [{"uuid": "d61331d4-8e69-4941-9497-adc08bbff779"}]}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:48.846143 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-51626cce-9866-43b8-9731-b55885bab3e2 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] validate_networks() for [('d61331d4-8e69-4941-9497-adc08bbff779', None, None, None, None, None)] {{(pid=123002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:31:49.384638 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-51626cce-9866-43b8-9731-b55885bab3e2 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:31:49.385342 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-51626cce-9866-43b8-9731-b55885bab3e2 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:31:49.385452 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-51626cce-9866-43b8-9731-b55885bab3e2 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:31:49.385861 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-51626cce-9866-43b8-9731-b55885bab3e2 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:31:49.386313 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-51626cce-9866-43b8-9731-b55885bab3e2 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:31:49.408326 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-51626cce-9866-43b8-9731-b55885bab3e2 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:49.408814 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-51626cce-9866-43b8-9731-b55885bab3e2 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:49.414433 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-51626cce-9866-43b8-9731-b55885bab3e2 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:49.414433 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-51626cce-9866-43b8-9731-b55885bab3e2 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:49.414433 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-51626cce-9866-43b8-9731-b55885bab3e2 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:49.414433 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-51626cce-9866-43b8-9731-b55885bab3e2 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:49.453475 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-51626cce-9866-43b8-9731-b55885bab3e2 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Getting quotas for project 08c83d7b68684daf8e67ba2361ad86c9. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:31:49.462007 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-51626cce-9866-43b8-9731-b55885bab3e2 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Getting quotas for user ef3c7ad35a05450496b6d1ff64f12b77 and project 08c83d7b68684daf8e67ba2361ad86c9. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:31:49.480917 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-51626cce-9866-43b8-9731-b55885bab3e2 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Going to run 1 instances... {{(pid=123002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:31:49.484264 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-51626cce-9866-43b8-9731-b55885bab3e2 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: 0cd68f0f-4385-45c4-8dd0-8f33a5a9e527] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:31:49.669395 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-51626cce-9866-43b8-9731-b55885bab3e2 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.258303 Oct 04 18:31:49.672642 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 486/955] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:31:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1262 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:31:49.688109 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ab1dcba5-de05-4bb0-a3db-4757f9102f78 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:49.693986 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ab1dcba5-de05-4bb0-a3db-4757f9102f78 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 4e1bb5af-9b8b-456f-beb1-aadf2491a8ed] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:49.699455 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ab1dcba5-de05-4bb0-a3db-4757f9102f78 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:49.700467 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ab1dcba5-de05-4bb0-a3db-4757f9102f78 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:49.701220 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ab1dcba5-de05-4bb0-a3db-4757f9102f78 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:49.702854 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ab1dcba5-de05-4bb0-a3db-4757f9102f78 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:49.703978 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ab1dcba5-de05-4bb0-a3db-4757f9102f78 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:49.704597 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ab1dcba5-de05-4bb0-a3db-4757f9102f78 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:49.803395 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ab1dcba5-de05-4bb0-a3db-4757f9102f78 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:49.831174 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ab1dcba5-de05-4bb0-a3db-4757f9102f78 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/4e1bb5af-9b8b-456f-beb1-aadf2491a8ed" status: 200 len: 1281 microversion: 2.1 time: 0.157185 Oct 04 18:31:49.834407 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 487/956] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:49 2022] GET /compute/v2.1/servers/4e1bb5af-9b8b-456f-beb1-aadf2491a8ed => generated 1281 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:49.842476 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-53add758-c039-4144-b9b9-27005bef6a10 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:49.845277 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-53add758-c039-4144-b9b9-27005bef6a10 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: fd73ee96-f932-48db-a1b5-664bb9740994] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:49.853415 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-53add758-c039-4144-b9b9-27005bef6a10 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:49.854236 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-53add758-c039-4144-b9b9-27005bef6a10 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:49.854892 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-53add758-c039-4144-b9b9-27005bef6a10 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:49.856182 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-53add758-c039-4144-b9b9-27005bef6a10 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:49.856866 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-53add758-c039-4144-b9b9-27005bef6a10 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:49.857506 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-53add758-c039-4144-b9b9-27005bef6a10 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:50.071811 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-53add758-c039-4144-b9b9-27005bef6a10 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:50.086297 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-53add758-c039-4144-b9b9-27005bef6a10 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/fd73ee96-f932-48db-a1b5-664bb9740994" status: 200 len: 1465 microversion: 2.1 time: 0.248241 Oct 04 18:31:50.087520 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 488/957] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:49 2022] GET /compute/v2.1/servers/fd73ee96-f932-48db-a1b5-664bb9740994 => generated 1465 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:50.092822 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c2d39bab-bb1e-4398-acd3-ab7503e114ba tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Calling method '.version_select at 0x7fe2592fe160>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:50.182125 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c2d39bab-bb1e-4398-acd3-ab7503e114ba tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] 10.222.0.20 "GET /compute/v2.1/images/82e02158-d3ca-4c9a-afa8-3d1075568eff" status: 200 len: 1428 microversion: 2.1 time: 0.093050 Oct 04 18:31:50.183735 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 489/958] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:31:50 2022] GET /compute/v2.1/images/82e02158-d3ca-4c9a-afa8-3d1075568eff => generated 1428 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:50.190599 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8bc186d8-7f56-4caf-8d8c-937ea8f1785a tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:50.191441 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8bc186d8-7f56-4caf-8d8c-937ea8f1785a tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] [instance: e17c5b3e-a598-4369-9cf7-027a563e59fa] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:50.222309 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8bc186d8-7f56-4caf-8d8c-937ea8f1785a tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:50.232856 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8bc186d8-7f56-4caf-8d8c-937ea8f1785a tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:50.232856 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8bc186d8-7f56-4caf-8d8c-937ea8f1785a tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:50.232856 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8bc186d8-7f56-4caf-8d8c-937ea8f1785a tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:50.232856 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8bc186d8-7f56-4caf-8d8c-937ea8f1785a tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:50.234986 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8bc186d8-7f56-4caf-8d8c-937ea8f1785a tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:50.531277 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8bc186d8-7f56-4caf-8d8c-937ea8f1785a tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f49a275284a7eb714a55c6bdd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e44e7aa06ee4126b5705ba65145ebcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:50.545322 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8bc186d8-7f56-4caf-8d8c-937ea8f1785a tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] 10.222.0.20 "GET /compute/v2.1/servers/e17c5b3e-a598-4369-9cf7-027a563e59fa" status: 200 len: 1520 microversion: 2.1 time: 0.359846 Oct 04 18:31:50.545908 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 490/959] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:50 2022] GET /compute/v2.1/servers/e17c5b3e-a598-4369-9cf7-027a563e59fa => generated 1520 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:50.554185 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-471f1e4d-2348-4a3b-9970-81560091aaa2 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:50.554814 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-471f1e4d-2348-4a3b-9970-81560091aaa2 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: 0cd68f0f-4385-45c4-8dd0-8f33a5a9e527] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:50.742620 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-471f1e4d-2348-4a3b-9970-81560091aaa2 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:50.754026 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-471f1e4d-2348-4a3b-9970-81560091aaa2 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/0cd68f0f-4385-45c4-8dd0-8f33a5a9e527" status: 200 len: 1208 microversion: 2.1 time: 0.207014 Oct 04 18:31:50.762745 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 491/960] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:50 2022] GET /compute/v2.1/servers/0cd68f0f-4385-45c4-8dd0-8f33a5a9e527 => generated 1208 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:50.765937 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-00ccfcd2-5888-43f1-8c8f-f9a7e749cc20 tempest-ServersOnMultiNodesTest-1719152185 tempest-ServersOnMultiNodesTest-1719152185-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:50.771808 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-00ccfcd2-5888-43f1-8c8f-f9a7e749cc20 tempest-ServersOnMultiNodesTest-1719152185 tempest-ServersOnMultiNodesTest-1719152185-project-admin] [instance: fd73ee96-f932-48db-a1b5-664bb9740994] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:50.779383 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-00ccfcd2-5888-43f1-8c8f-f9a7e749cc20 tempest-ServersOnMultiNodesTest-1719152185 tempest-ServersOnMultiNodesTest-1719152185-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:50.780154 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-00ccfcd2-5888-43f1-8c8f-f9a7e749cc20 tempest-ServersOnMultiNodesTest-1719152185 tempest-ServersOnMultiNodesTest-1719152185-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:50.780778 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-00ccfcd2-5888-43f1-8c8f-f9a7e749cc20 tempest-ServersOnMultiNodesTest-1719152185 tempest-ServersOnMultiNodesTest-1719152185-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:50.781706 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-00ccfcd2-5888-43f1-8c8f-f9a7e749cc20 tempest-ServersOnMultiNodesTest-1719152185 tempest-ServersOnMultiNodesTest-1719152185-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:50.782236 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-00ccfcd2-5888-43f1-8c8f-f9a7e749cc20 tempest-ServersOnMultiNodesTest-1719152185 tempest-ServersOnMultiNodesTest-1719152185-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:50.782715 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-00ccfcd2-5888-43f1-8c8f-f9a7e749cc20 tempest-ServersOnMultiNodesTest-1719152185 tempest-ServersOnMultiNodesTest-1719152185-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:51.208224 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-00ccfcd2-5888-43f1-8c8f-f9a7e749cc20 tempest-ServersOnMultiNodesTest-1719152185 tempest-ServersOnMultiNodesTest-1719152185-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/fd73ee96-f932-48db-a1b5-664bb9740994" status: 200 len: 1618 microversion: 2.1 time: 0.447754 Oct 04 18:31:51.212716 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 492/961] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:50 2022] GET /compute/v2.1/servers/fd73ee96-f932-48db-a1b5-664bb9740994 => generated 1618 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:51.220875 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4c46e113-54d9-4f78-8e22-abbdd8794cba tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:51.221859 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4c46e113-54d9-4f78-8e22-abbdd8794cba tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] [instance: e17c5b3e-a598-4369-9cf7-027a563e59fa] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:51.250341 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4c46e113-54d9-4f78-8e22-abbdd8794cba tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:51.251098 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4c46e113-54d9-4f78-8e22-abbdd8794cba tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:51.251664 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4c46e113-54d9-4f78-8e22-abbdd8794cba tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:51.260029 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4c46e113-54d9-4f78-8e22-abbdd8794cba tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:51.260029 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4c46e113-54d9-4f78-8e22-abbdd8794cba tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:51.260029 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4c46e113-54d9-4f78-8e22-abbdd8794cba tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:51.577840 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4c46e113-54d9-4f78-8e22-abbdd8794cba tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f49a275284a7eb714a55c6bdd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e44e7aa06ee4126b5705ba65145ebcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:51.591233 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4c46e113-54d9-4f78-8e22-abbdd8794cba tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] 10.222.0.20 "GET /compute/v2.1/servers/e17c5b3e-a598-4369-9cf7-027a563e59fa" status: 200 len: 1520 microversion: 2.1 time: 0.377100 Oct 04 18:31:51.607564 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 493/962] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:51 2022] GET /compute/v2.1/servers/e17c5b3e-a598-4369-9cf7-027a563e59fa => generated 1520 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:51.607564 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-798fc678-5b46-403a-ae31-f1284ee7079d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:51.607564 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-798fc678-5b46-403a-ae31-f1284ee7079d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 4e1bb5af-9b8b-456f-beb1-aadf2491a8ed] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:51.619923 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-798fc678-5b46-403a-ae31-f1284ee7079d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:51.620440 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-798fc678-5b46-403a-ae31-f1284ee7079d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:51.620883 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-798fc678-5b46-403a-ae31-f1284ee7079d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:51.621728 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-798fc678-5b46-403a-ae31-f1284ee7079d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:51.622049 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-798fc678-5b46-403a-ae31-f1284ee7079d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:51.622470 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-798fc678-5b46-403a-ae31-f1284ee7079d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:51.878945 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-798fc678-5b46-403a-ae31-f1284ee7079d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:51.889716 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-798fc678-5b46-403a-ae31-f1284ee7079d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/4e1bb5af-9b8b-456f-beb1-aadf2491a8ed" status: 200 len: 1311 microversion: 2.1 time: 0.296489 Oct 04 18:31:51.899759 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 494/963] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:51 2022] GET /compute/v2.1/servers/4e1bb5af-9b8b-456f-beb1-aadf2491a8ed => generated 1311 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:51.899759 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0726def8-5667-4218-9902-7f303c8dd112 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Calling method '.version_select at 0x7fe25926ee50>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:52.080279 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0726def8-5667-4218-9902-7f303c8dd112 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] 10.222.0.20 "GET /compute/v2.1/images/82e02158-d3ca-4c9a-afa8-3d1075568eff" status: 200 len: 1428 microversion: 2.1 time: 0.144004 Oct 04 18:31:52.080279 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 495/964] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:31:51 2022] GET /compute/v2.1/images/82e02158-d3ca-4c9a-afa8-3d1075568eff => generated 1428 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:52.080279 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4776d280-1685-4d6f-a024-b9bb333682d8 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:52.080279 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4776d280-1685-4d6f-a024-b9bb333682d8 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: fd73ee96-f932-48db-a1b5-664bb9740994] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:52.080279 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4776d280-1685-4d6f-a024-b9bb333682d8 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:52.081011 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4776d280-1685-4d6f-a024-b9bb333682d8 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:52.081011 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4776d280-1685-4d6f-a024-b9bb333682d8 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:52.081011 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4776d280-1685-4d6f-a024-b9bb333682d8 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:52.081011 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4776d280-1685-4d6f-a024-b9bb333682d8 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:52.081302 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4776d280-1685-4d6f-a024-b9bb333682d8 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:52.097400 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4776d280-1685-4d6f-a024-b9bb333682d8 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: fd73ee96-f932-48db-a1b5-664bb9740994] Going to try to terminate instance {{(pid=123002) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:31:53.172010 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4776d280-1685-4d6f-a024-b9bb333682d8 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "DELETE /compute/v2.1/servers/fd73ee96-f932-48db-a1b5-664bb9740994" status: 204 len: 0 microversion: 2.1 time: 1.133354 Oct 04 18:31:53.172786 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 496/965] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:31:52 2022] DELETE /compute/v2.1/servers/fd73ee96-f932-48db-a1b5-664bb9740994 => generated 0 bytes in 1135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:31:53.181307 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4600ea27-b8bb-47c2-8af6-fb10260e064f tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1106184074"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:53.188185 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4600ea27-b8bb-47c2-8af6-fb10260e064f tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] [instance: e17c5b3e-a598-4369-9cf7-027a563e59fa] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:53.206537 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4600ea27-b8bb-47c2-8af6-fb10260e064f tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:53.207305 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4600ea27-b8bb-47c2-8af6-fb10260e064f tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:53.207753 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4600ea27-b8bb-47c2-8af6-fb10260e064f tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:53.208556 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4600ea27-b8bb-47c2-8af6-fb10260e064f tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:53.208979 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4600ea27-b8bb-47c2-8af6-fb10260e064f tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:53.209962 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4600ea27-b8bb-47c2-8af6-fb10260e064f tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:53.307314 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-32d73148-0936-4c5c-a6d7-caca1bb1c405 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/6b629ba0-6245-442f-bf1a-ad1c1a3116bc/action" status: 202 len: 0 microversion: 2.25 time: 5.768297 Oct 04 18:31:53.311636 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 470/966] 10.222.0.20 () {62 vars in 1319 bytes} [Tue Oct 4 18:31:47 2022] POST /compute/v2.1/servers/6b629ba0-6245-442f-bf1a-ad1c1a3116bc/action => generated 0 bytes in 5771 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:31:53.315857 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9dfc1c92-0285-44c4-a1c7-0a15cc8a5782 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:53.317208 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-9dfc1c92-0285-44c4-a1c7-0a15cc8a5782 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: 0cd68f0f-4385-45c4-8dd0-8f33a5a9e527] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:53.330843 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9dfc1c92-0285-44c4-a1c7-0a15cc8a5782 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:53.331685 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9dfc1c92-0285-44c4-a1c7-0a15cc8a5782 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:53.332470 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9dfc1c92-0285-44c4-a1c7-0a15cc8a5782 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:53.333736 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9dfc1c92-0285-44c4-a1c7-0a15cc8a5782 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:53.335262 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9dfc1c92-0285-44c4-a1c7-0a15cc8a5782 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:53.335804 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9dfc1c92-0285-44c4-a1c7-0a15cc8a5782 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:53.443584 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9dfc1c92-0285-44c4-a1c7-0a15cc8a5782 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:53.457491 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9dfc1c92-0285-44c4-a1c7-0a15cc8a5782 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/0cd68f0f-4385-45c4-8dd0-8f33a5a9e527" status: 200 len: 1260 microversion: 2.1 time: 0.147542 Oct 04 18:31:53.472531 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 471/967] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:53 2022] GET /compute/v2.1/servers/0cd68f0f-4385-45c4-8dd0-8f33a5a9e527 => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:53.477572 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4990954c-5a2c-404a-8e4d-22767355810e tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:53.478259 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-4990954c-5a2c-404a-8e4d-22767355810e tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 4e1bb5af-9b8b-456f-beb1-aadf2491a8ed] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:53.485405 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4990954c-5a2c-404a-8e4d-22767355810e tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:53.485915 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4990954c-5a2c-404a-8e4d-22767355810e tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:53.486355 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4990954c-5a2c-404a-8e4d-22767355810e tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:53.487066 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4990954c-5a2c-404a-8e4d-22767355810e tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:53.487635 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4990954c-5a2c-404a-8e4d-22767355810e tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:53.491784 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4990954c-5a2c-404a-8e4d-22767355810e tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:53.717886 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-4990954c-5a2c-404a-8e4d-22767355810e tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:53.729000 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-4990954c-5a2c-404a-8e4d-22767355810e tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/4e1bb5af-9b8b-456f-beb1-aadf2491a8ed" status: 200 len: 1311 microversion: 2.1 time: 0.255386 Oct 04 18:31:53.729701 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 472/968] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:53 2022] GET /compute/v2.1/servers/4e1bb5af-9b8b-456f-beb1-aadf2491a8ed => generated 1311 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:53.734854 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9a5814ce-50c3-480b-87e3-891d307b4f90 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Calling method '.version_select at 0x7fe2591f94c0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:53.782256 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9a5814ce-50c3-480b-87e3-891d307b4f90 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] 10.222.0.20 "GET /compute/v2.1/images/82e02158-d3ca-4c9a-afa8-3d1075568eff" status: 200 len: 1428 microversion: 2.1 time: 0.051435 Oct 04 18:31:53.789998 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 473/969] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:31:53 2022] GET /compute/v2.1/images/82e02158-d3ca-4c9a-afa8-3d1075568eff => generated 1428 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:53.789998 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-41ee28ac-9862-4edd-9c21-88f6230eb87e tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:53.789998 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-41ee28ac-9862-4edd-9c21-88f6230eb87e tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: fd73ee96-f932-48db-a1b5-664bb9740994] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:53.795204 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-41ee28ac-9862-4edd-9c21-88f6230eb87e tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:53.795738 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-41ee28ac-9862-4edd-9c21-88f6230eb87e tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:53.796281 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-41ee28ac-9862-4edd-9c21-88f6230eb87e tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:53.796978 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-41ee28ac-9862-4edd-9c21-88f6230eb87e tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:53.797426 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-41ee28ac-9862-4edd-9c21-88f6230eb87e tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:53.797847 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-41ee28ac-9862-4edd-9c21-88f6230eb87e tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:53.936442 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4600ea27-b8bb-47c2-8af6-fb10260e064f tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] 10.222.0.20 "POST /compute/v2.1/servers/e17c5b3e-a598-4369-9cf7-027a563e59fa/action" status: 202 len: 0 microversion: 2.1 time: 0.761321 Oct 04 18:31:53.937087 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 497/970] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:31:53 2022] POST /compute/v2.1/servers/e17c5b3e-a598-4369-9cf7-027a563e59fa/action => generated 0 bytes in 763 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 18:31:53.942598 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-af897ec8-8a58-462e-9f92-1128527ce98a tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:53.943496 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-af897ec8-8a58-462e-9f92-1128527ce98a tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: 6b629ba0-6245-442f-bf1a-ad1c1a3116bc] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:53.950198 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-af897ec8-8a58-462e-9f92-1128527ce98a tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:53.952500 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-af897ec8-8a58-462e-9f92-1128527ce98a tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:53.952500 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-af897ec8-8a58-462e-9f92-1128527ce98a tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:53.952500 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-af897ec8-8a58-462e-9f92-1128527ce98a tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:53.952500 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-af897ec8-8a58-462e-9f92-1128527ce98a tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:53.953188 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-af897ec8-8a58-462e-9f92-1128527ce98a tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:53.955751 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:53.958255 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-41ee28ac-9862-4edd-9c21-88f6230eb87e tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:53.968086 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-41ee28ac-9862-4edd-9c21-88f6230eb87e tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/fd73ee96-f932-48db-a1b5-664bb9740994" status: 200 len: 1471 microversion: 2.1 time: 0.183489 Oct 04 18:31:53.970304 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 474/971] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:53 2022] GET /compute/v2.1/servers/fd73ee96-f932-48db-a1b5-664bb9740994 => generated 1471 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:53.976738 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-ba8df1c1-b10f-4c90-98a8-f628cb9e1ef7 req-64af53eb-30af-4f8b-be51-2336dcb2a5eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e1bb5af-9b8b-456f-beb1-aadf2491a8ed", "tag": "1fbe8b1c-48fa-4c89-bb2c-cf691330a2a8"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:53.991590 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-ba8df1c1-b10f-4c90-98a8-f628cb9e1ef7 req-64af53eb-30af-4f8b-be51-2336dcb2a5eb service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:53.992944 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-ba8df1c1-b10f-4c90-98a8-f628cb9e1ef7 req-64af53eb-30af-4f8b-be51-2336dcb2a5eb service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:53.993578 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-ba8df1c1-b10f-4c90-98a8-f628cb9e1ef7 req-64af53eb-30af-4f8b-be51-2336dcb2a5eb service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:54.013030 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-ba8df1c1-b10f-4c90-98a8-f628cb9e1ef7 req-64af53eb-30af-4f8b-be51-2336dcb2a5eb service nova] Creating event network-changed:1fbe8b1c-48fa-4c89-bb2c-cf691330a2a8 for instance 4e1bb5af-9b8b-456f-beb1-aadf2491a8ed on n-h1-850501-14 Oct 04 18:31:54.019008 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-ba8df1c1-b10f-4c90-98a8-f628cb9e1ef7 req-64af53eb-30af-4f8b-be51-2336dcb2a5eb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047142 Oct 04 18:31:54.020227 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 475/972] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:31:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:54.027963 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-cf03e009-7345-4530-83be-95d2c74a1556 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Calling method '.version_select at 0x7fe2590eeaf0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:54.132710 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-af897ec8-8a58-462e-9f92-1128527ce98a tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:54.141220 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-af897ec8-8a58-462e-9f92-1128527ce98a tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:54.142779 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-af897ec8-8a58-462e-9f92-1128527ce98a tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:54.143965 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-af897ec8-8a58-462e-9f92-1128527ce98a tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/6b629ba0-6245-442f-bf1a-ad1c1a3116bc" status: 200 len: 1567 microversion: 2.25 time: 0.205624 Oct 04 18:31:54.144805 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 498/973] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:31:53 2022] GET /compute/v2.1/servers/6b629ba0-6245-442f-bf1a-ad1c1a3116bc => generated 1567 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:31:54.370424 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-cf03e009-7345-4530-83be-95d2c74a1556 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] 10.222.0.20 "DELETE /compute/v2.1/images/39eaf8e6-b29a-454c-bbc7-2e57deb6bf76" status: 204 len: 0 microversion: 2.1 time: 0.348711 Oct 04 18:31:54.371000 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 476/974] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:54 2022] DELETE /compute/v2.1/images/39eaf8e6-b29a-454c-bbc7-2e57deb6bf76 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:31:54.380495 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-520af1f7-02fd-4d51-9d1c-b9238c81b3fb tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Calling method '.version_select at 0x7fe25926eee0>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:54.424083 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-520af1f7-02fd-4d51-9d1c-b9238c81b3fb tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] HTTP exception thrown: Image not found. Oct 04 18:31:54.425561 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-520af1f7-02fd-4d51-9d1c-b9238c81b3fb tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Request method failure captured: Oct 04 18:31:54.425561 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/images/39eaf8e6-b29a-454c-bbc7-2e57deb6bf76 HTTP/1.1 Oct 04 18:31:54.425561 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:31:54.425561 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:31:54.425561 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:31:54.425561 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:31:54.425561 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:31:54.425561 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:31:54.425561 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:31:54.425561 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:31:54.425561 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPHvII_T7EcjvuInFv4t5qVF70S9vjGBK66HvfyVnOiY_TVbsAPYjguHISQjMiOeT1bz8CjLq7zDrG77IXy0kQULYEqIfKm3jlSWTKPDcogOtbqbQpds3d11ZgBfbFr39fSjqioDU_0CmuRBwgkz6wZ-Zh6uUaL8av5rXkIBhSk0fN1E Oct 04 18:31:54.425561 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:31:54.425561 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:31:54.425561 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:31:54.425561 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:31:54.425561 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:31:54.425561 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:31:54.425561 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 7e44e7aa06ee4126b5705ba65145ebcc Oct 04 18:31:54.425561 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1566997612 Oct 04 18:31:54.425561 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:31:54.425561 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:31:54.427212 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e44e7aa06ee4126b5705ba65145ebcc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7e44e7aa06ee4126b5705ba65145ebcc", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7e44e7aa06ee4126b5705ba65145ebcc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e44e7aa06ee4126b5705ba65145ebcc"}]}] Oct 04 18:31:54.427212 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1566997612 Oct 04 18:31:54.427212 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 7e44e7aa06ee4126b5705ba65145ebcc Oct 04 18:31:54.427212 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1566997612 Oct 04 18:31:54.427212 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ImagesOneServerNegativeTestJSON-1566997612-project Oct 04 18:31:54.427212 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:31:54.427212 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:31:54.427212 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 415f49a275284a7eb714a55c6bdd0005 Oct 04 18:31:54.427212 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1566997612-project Oct 04 18:31:54.427212 n-d-850501-14 devstack@n-api.service[123002]: method: Oct 04 18:31:54.427212 n-d-850501-14 devstack@n-api.service[123002]: exception: Image not found. Oct 04 18:31:54.427212 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '39eaf8e6-b29a-454c-bbc7-2e57deb6bf76'} Oct 04 18:31:54.427212 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:31:54.428688 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:54.428688 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 18:31:54.428688 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 18:31:54.428688 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:31:54.428688 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:31:54.428688 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 18:31:54.428688 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 18:31:54.428688 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:31:54.428688 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:31:54.428688 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 18:31:54.428688 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 18:31:54.428688 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 18:31:54.428688 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 18:31:54.428688 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:31:54.428688 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:31:54.428688 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:31:54.428688 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:31:54.428688 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 39eaf8e6-b29a-454c-bbc7-2e57deb6bf76 Oct 04 18:31:54.430457 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:31:54.430457 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:31:54.430457 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:31:54.430457 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:54.430457 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 04 18:31:54.430457 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 04 18:31:54.430457 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 18:31:54.430457 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 18:31:54.430457 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 18:31:54.430457 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 18:31:54.430457 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 18:31:54.430457 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 18:31:54.430457 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 18:31:54.430457 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 18:31:54.430457 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:31:54.430457 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:31:54.430457 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 18:31:54.430457 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 18:31:54.430457 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:31:54.430457 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:31:54.433145 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 18:31:54.433145 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 18:31:54.433145 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 18:31:54.433145 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 18:31:54.433145 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:31:54.433145 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:31:54.433145 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:31:54.433145 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:31:54.433145 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 39eaf8e6-b29a-454c-bbc7-2e57deb6bf76 could not be found. Oct 04 18:31:54.433145 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:31:54.433145 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:31:54.433145 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:31:54.433145 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:54.433145 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:31:54.433145 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:31:54.433145 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:31:54.433145 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:31:54.433145 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:31:54.433145 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:31:54.434664 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:31:54.434664 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:31:54.434664 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 04 18:31:54.434664 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 18:31:54.434664 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:31:54.434664 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:31:54.434664 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:31:54.434664 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:31:54.434664 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:54.434664 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:31:54.434664 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:31:54.434664 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:31:54.434664 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:31:54.434664 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:31:54.434664 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:31:54.434664 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-520af1f7-02fd-4d51-9d1c-b9238c81b3fb tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Returning 404 to user: Image not found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:31:54.435970 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-520af1f7-02fd-4d51-9d1c-b9238c81b3fb tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] 10.222.0.20 "GET /compute/v2.1/images/39eaf8e6-b29a-454c-bbc7-2e57deb6bf76" status: 404 len: 62 microversion: 2.1 time: 0.053021 Oct 04 18:31:54.435970 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 499/975] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:31:54 2022] GET /compute/v2.1/images/39eaf8e6-b29a-454c-bbc7-2e57deb6bf76 => generated 62 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:31:54.441243 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2d5d7915-0529-4f57-bc9e-91501b7d59a1 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:54.442103 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2d5d7915-0529-4f57-bc9e-91501b7d59a1 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] [instance: e17c5b3e-a598-4369-9cf7-027a563e59fa] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:54.470625 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2d5d7915-0529-4f57-bc9e-91501b7d59a1 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:54.471131 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2d5d7915-0529-4f57-bc9e-91501b7d59a1 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:54.471569 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2d5d7915-0529-4f57-bc9e-91501b7d59a1 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:54.472391 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2d5d7915-0529-4f57-bc9e-91501b7d59a1 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:54.480794 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2d5d7915-0529-4f57-bc9e-91501b7d59a1 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:54.481143 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2d5d7915-0529-4f57-bc9e-91501b7d59a1 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:54.486439 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3e512ff3-9dcd-4252-a273-cde208c6c7dc tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:54.487168 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3e512ff3-9dcd-4252-a273-cde208c6c7dc tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: 0cd68f0f-4385-45c4-8dd0-8f33a5a9e527] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:54.499370 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3e512ff3-9dcd-4252-a273-cde208c6c7dc tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:54.499965 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3e512ff3-9dcd-4252-a273-cde208c6c7dc tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:54.500645 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3e512ff3-9dcd-4252-a273-cde208c6c7dc tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:54.508246 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3e512ff3-9dcd-4252-a273-cde208c6c7dc tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:54.508246 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3e512ff3-9dcd-4252-a273-cde208c6c7dc tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:54.508246 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3e512ff3-9dcd-4252-a273-cde208c6c7dc tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:54.535564 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:54.572936 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=6 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:54.687005 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3e512ff3-9dcd-4252-a273-cde208c6c7dc tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:54.698781 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3e512ff3-9dcd-4252-a273-cde208c6c7dc tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/0cd68f0f-4385-45c4-8dd0-8f33a5a9e527" status: 200 len: 1268 microversion: 2.1 time: 0.215762 Oct 04 18:31:54.717584 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 500/976] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:54 2022] GET /compute/v2.1/servers/0cd68f0f-4385-45c4-8dd0-8f33a5a9e527 => generated 1268 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:31:54.762716 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-287bf036-dedd-4ced-a4ea-368aacfdef57 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:54.769913 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-287bf036-dedd-4ced-a4ea-368aacfdef57 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 4e1bb5af-9b8b-456f-beb1-aadf2491a8ed] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:54.778673 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-287bf036-dedd-4ced-a4ea-368aacfdef57 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:54.780136 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-287bf036-dedd-4ced-a4ea-368aacfdef57 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:54.784244 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-287bf036-dedd-4ced-a4ea-368aacfdef57 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:54.785399 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-287bf036-dedd-4ced-a4ea-368aacfdef57 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:54.787994 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-287bf036-dedd-4ced-a4ea-368aacfdef57 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:54.789392 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-287bf036-dedd-4ced-a4ea-368aacfdef57 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:54.886597 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-2d5d7915-0529-4f57-bc9e-91501b7d59a1 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f49a275284a7eb714a55c6bdd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e44e7aa06ee4126b5705ba65145ebcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:54.899743 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2d5d7915-0529-4f57-bc9e-91501b7d59a1 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] 10.222.0.20 "GET /compute/v2.1/servers/e17c5b3e-a598-4369-9cf7-027a563e59fa" status: 200 len: 1540 microversion: 2.1 time: 0.463894 Oct 04 18:31:54.905336 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 477/977] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:54 2022] GET /compute/v2.1/servers/e17c5b3e-a598-4369-9cf7-027a563e59fa => generated 1540 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:54.919224 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0d223ecc-6276-4f47-b14e-3c56fce6b74a tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Calling method '.version_select at 0x7fe2590ecb80>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:55.001369 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0d223ecc-6276-4f47-b14e-3c56fce6b74a tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] 10.222.0.20 "GET /compute/v2.1/images/82e02158-d3ca-4c9a-afa8-3d1075568eff" status: 200 len: 1437 microversion: 2.1 time: 0.089211 Oct 04 18:31:55.003122 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 478/978] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:31:54 2022] GET /compute/v2.1/images/82e02158-d3ca-4c9a-afa8-3d1075568eff => generated 1437 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:55.013361 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-80dba18e-c7e8-48a1-a6c7-00f3c3e56f1b tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:55.013998 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-80dba18e-c7e8-48a1-a6c7-00f3c3e56f1b tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: fd73ee96-f932-48db-a1b5-664bb9740994] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:55.025547 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-80dba18e-c7e8-48a1-a6c7-00f3c3e56f1b tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:55.026193 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-80dba18e-c7e8-48a1-a6c7-00f3c3e56f1b tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:55.026734 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-80dba18e-c7e8-48a1-a6c7-00f3c3e56f1b tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:55.027552 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-80dba18e-c7e8-48a1-a6c7-00f3c3e56f1b tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:55.028278 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-80dba18e-c7e8-48a1-a6c7-00f3c3e56f1b tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:55.028810 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-80dba18e-c7e8-48a1-a6c7-00f3c3e56f1b tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:55.056764 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:55.206513 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-287bf036-dedd-4ced-a4ea-368aacfdef57 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:55.225467 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-287bf036-dedd-4ced-a4ea-368aacfdef57 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/4e1bb5af-9b8b-456f-beb1-aadf2491a8ed" status: 200 len: 1311 microversion: 2.1 time: 0.476331 Oct 04 18:31:55.227925 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 501/979] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:54 2022] GET /compute/v2.1/servers/4e1bb5af-9b8b-456f-beb1-aadf2491a8ed => generated 1311 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:31:55.233060 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-09570c05-f9b6-4bdf-8f17-5988a3f69e2c tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Calling method '.version_select at 0x7fe259599790>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:55.302494 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-80dba18e-c7e8-48a1-a6c7-00f3c3e56f1b tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:55.310404 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-09570c05-f9b6-4bdf-8f17-5988a3f69e2c tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] 10.222.0.20 "GET /compute/v2.1/images/82e02158-d3ca-4c9a-afa8-3d1075568eff" status: 200 len: 1437 microversion: 2.1 time: 0.080959 Oct 04 18:31:55.311751 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 502/980] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:31:55 2022] GET /compute/v2.1/images/82e02158-d3ca-4c9a-afa8-3d1075568eff => generated 1437 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:55.318550 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9d689c5c-251e-4115-bd81-65480339f0ae tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:55.320420 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9d689c5c-251e-4115-bd81-65480339f0ae tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: 6b629ba0-6245-442f-bf1a-ad1c1a3116bc] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:55.327535 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-80dba18e-c7e8-48a1-a6c7-00f3c3e56f1b tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/fd73ee96-f932-48db-a1b5-664bb9740994" status: 200 len: 1471 microversion: 2.1 time: 0.322952 Oct 04 18:31:55.330101 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 479/981] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:55 2022] GET /compute/v2.1/servers/fd73ee96-f932-48db-a1b5-664bb9740994 => generated 1471 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:55.336626 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9d689c5c-251e-4115-bd81-65480339f0ae tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:55.337441 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9d689c5c-251e-4115-bd81-65480339f0ae tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:55.338224 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9d689c5c-251e-4115-bd81-65480339f0ae tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:55.339167 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9d689c5c-251e-4115-bd81-65480339f0ae tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:55.339855 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9d689c5c-251e-4115-bd81-65480339f0ae tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:55.340577 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9d689c5c-251e-4115-bd81-65480339f0ae tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:55.347239 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4560635f-745e-4cb6-ada8-ff9b0030a9e6 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:55.348129 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-4560635f-745e-4cb6-ada8-ff9b0030a9e6 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] [instance: 836f71c5-d859-4d09-9956-922b0bbee3ae] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:55.359947 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4560635f-745e-4cb6-ada8-ff9b0030a9e6 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:55.365036 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4560635f-745e-4cb6-ada8-ff9b0030a9e6 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:55.365571 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4560635f-745e-4cb6-ada8-ff9b0030a9e6 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:55.366348 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4560635f-745e-4cb6-ada8-ff9b0030a9e6 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:55.366817 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4560635f-745e-4cb6-ada8-ff9b0030a9e6 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:55.373247 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4560635f-745e-4cb6-ada8-ff9b0030a9e6 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:55.663506 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9d689c5c-251e-4115-bd81-65480339f0ae tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:55.673917 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9d689c5c-251e-4115-bd81-65480339f0ae tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:55.675316 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9d689c5c-251e-4115-bd81-65480339f0ae tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:55.676529 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9d689c5c-251e-4115-bd81-65480339f0ae tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/6b629ba0-6245-442f-bf1a-ad1c1a3116bc" status: 200 len: 1567 microversion: 2.25 time: 0.363511 Oct 04 18:31:55.680226 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 503/982] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:31:55 2022] GET /compute/v2.1/servers/6b629ba0-6245-442f-bf1a-ad1c1a3116bc => generated 1567 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:31:55.722969 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-4560635f-745e-4cb6-ada8-ff9b0030a9e6 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d326c048306423a87ddef70295a75e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1cc290c58149f8988cc3d69aff9efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:55.733310 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8258b71f-b81b-4c5b-8601-23595d2b4966 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:55.733310 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8258b71f-b81b-4c5b-8601-23595d2b4966 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: 0cd68f0f-4385-45c4-8dd0-8f33a5a9e527] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:55.738987 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-4560635f-745e-4cb6-ada8-ff9b0030a9e6 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] 10.222.0.20 "GET /compute/v2.1/servers/836f71c5-d859-4d09-9956-922b0bbee3ae" status: 200 len: 1466 microversion: 2.1 time: 0.405593 Oct 04 18:31:55.739153 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8258b71f-b81b-4c5b-8601-23595d2b4966 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:55.739711 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8258b71f-b81b-4c5b-8601-23595d2b4966 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:55.740409 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8258b71f-b81b-4c5b-8601-23595d2b4966 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:55.741389 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 480/983] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:55 2022] GET /compute/v2.1/servers/836f71c5-d859-4d09-9956-922b0bbee3ae => generated 1466 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:55.742526 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8258b71f-b81b-4c5b-8601-23595d2b4966 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:55.742992 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8258b71f-b81b-4c5b-8601-23595d2b4966 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:55.743616 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8258b71f-b81b-4c5b-8601-23595d2b4966 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:55.767675 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6dc6673f-9fd6-4e38-b5fb-4f11a51188b4 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Calling method '.version_select at 0x7fe2593179d0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:55.864011 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8258b71f-b81b-4c5b-8601-23595d2b4966 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:55.876844 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8258b71f-b81b-4c5b-8601-23595d2b4966 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/0cd68f0f-4385-45c4-8dd0-8f33a5a9e527" status: 200 len: 1266 microversion: 2.1 time: 0.153393 Oct 04 18:31:55.893617 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 504/984] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:55 2022] GET /compute/v2.1/servers/0cd68f0f-4385-45c4-8dd0-8f33a5a9e527 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:55.929454 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-31bff76d-6ad6-440b-9b26-4312457e14f1 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:55.930389 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-31bff76d-6ad6-440b-9b26-4312457e14f1 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] [instance: e17c5b3e-a598-4369-9cf7-027a563e59fa] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:55.932947 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:55.952211 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-31bff76d-6ad6-440b-9b26-4312457e14f1 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:55.952211 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-31bff76d-6ad6-440b-9b26-4312457e14f1 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:55.952211 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-31bff76d-6ad6-440b-9b26-4312457e14f1 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:55.952211 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-31bff76d-6ad6-440b-9b26-4312457e14f1 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:55.954724 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-31bff76d-6ad6-440b-9b26-4312457e14f1 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:55.954724 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-31bff76d-6ad6-440b-9b26-4312457e14f1 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:56.466213 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-31bff76d-6ad6-440b-9b26-4312457e14f1 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f49a275284a7eb714a55c6bdd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e44e7aa06ee4126b5705ba65145ebcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:56.474020 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-31bff76d-6ad6-440b-9b26-4312457e14f1 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] 10.222.0.20 "GET /compute/v2.1/servers/e17c5b3e-a598-4369-9cf7-027a563e59fa" status: 200 len: 1538 microversion: 2.1 time: 0.550925 Oct 04 18:31:56.474593 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 505/985] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:55 2022] GET /compute/v2.1/servers/e17c5b3e-a598-4369-9cf7-027a563e59fa => generated 1538 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:31:56.492772 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-6c7f17ad-55c6-45e5-98a0-4274f5872ad1 req-65b79c0b-9012-4f3d-8288-40cbd5e145e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd73ee96-f932-48db-a1b5-664bb9740994", "name": "network-vif-deleted", "tag": "2c7f74ad-951d-4733-95ca-cd81429289f8"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:56.502743 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-6c7f17ad-55c6-45e5-98a0-4274f5872ad1 req-65b79c0b-9012-4f3d-8288-40cbd5e145e3 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:56.503221 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-6c7f17ad-55c6-45e5-98a0-4274f5872ad1 req-65b79c0b-9012-4f3d-8288-40cbd5e145e3 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:56.504448 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-6c7f17ad-55c6-45e5-98a0-4274f5872ad1 req-65b79c0b-9012-4f3d-8288-40cbd5e145e3 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:56.515847 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-6c7f17ad-55c6-45e5-98a0-4274f5872ad1 req-65b79c0b-9012-4f3d-8288-40cbd5e145e3 service nova] Creating event network-vif-deleted:2c7f74ad-951d-4733-95ca-cd81429289f8 for instance fd73ee96-f932-48db-a1b5-664bb9740994 on n-h1-850501-14 Oct 04 18:31:56.520708 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-6c7f17ad-55c6-45e5-98a0-4274f5872ad1 req-65b79c0b-9012-4f3d-8288-40cbd5e145e3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044362 Oct 04 18:31:56.521304 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 506/986] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:31:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:56.528156 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d44cfa18-4ddb-494a-92e5-08af3e0b1c17 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:56.528871 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d44cfa18-4ddb-494a-92e5-08af3e0b1c17 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 4e1bb5af-9b8b-456f-beb1-aadf2491a8ed] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:56.535041 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d44cfa18-4ddb-494a-92e5-08af3e0b1c17 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:56.535529 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d44cfa18-4ddb-494a-92e5-08af3e0b1c17 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:56.535961 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d44cfa18-4ddb-494a-92e5-08af3e0b1c17 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:56.536681 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d44cfa18-4ddb-494a-92e5-08af3e0b1c17 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:56.537139 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d44cfa18-4ddb-494a-92e5-08af3e0b1c17 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:56.538372 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d44cfa18-4ddb-494a-92e5-08af3e0b1c17 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:56.889142 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d44cfa18-4ddb-494a-92e5-08af3e0b1c17 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:56.900522 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d44cfa18-4ddb-494a-92e5-08af3e0b1c17 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/4e1bb5af-9b8b-456f-beb1-aadf2491a8ed" status: 200 len: 1311 microversion: 2.1 time: 0.376491 Oct 04 18:31:56.920626 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 507/987] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:56 2022] GET /compute/v2.1/servers/4e1bb5af-9b8b-456f-beb1-aadf2491a8ed => generated 1311 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:56.927851 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8ad91e3a-70c9-477a-b18a-9c9900d146fc tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:56.929779 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8ad91e3a-70c9-477a-b18a-9c9900d146fc tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: fd73ee96-f932-48db-a1b5-664bb9740994] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:56.936404 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8ad91e3a-70c9-477a-b18a-9c9900d146fc tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:56.936898 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8ad91e3a-70c9-477a-b18a-9c9900d146fc tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:56.937334 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8ad91e3a-70c9-477a-b18a-9c9900d146fc tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:56.938059 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8ad91e3a-70c9-477a-b18a-9c9900d146fc tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:56.938662 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8ad91e3a-70c9-477a-b18a-9c9900d146fc tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:56.939096 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8ad91e3a-70c9-477a-b18a-9c9900d146fc tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:57.009795 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8ad91e3a-70c9-477a-b18a-9c9900d146fc tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:57.023054 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8ad91e3a-70c9-477a-b18a-9c9900d146fc tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/fd73ee96-f932-48db-a1b5-664bb9740994" status: 200 len: 1429 microversion: 2.1 time: 0.100327 Oct 04 18:31:57.025951 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 508/988] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:56 2022] GET /compute/v2.1/servers/fd73ee96-f932-48db-a1b5-664bb9740994 => generated 1429 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:57.032255 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4b4a44e5-f145-4031-b7c0-707b343a086b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:57.033364 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4b4a44e5-f145-4031-b7c0-707b343a086b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: 6b629ba0-6245-442f-bf1a-ad1c1a3116bc] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:57.044910 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4b4a44e5-f145-4031-b7c0-707b343a086b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:57.045607 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4b4a44e5-f145-4031-b7c0-707b343a086b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:57.046058 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4b4a44e5-f145-4031-b7c0-707b343a086b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:57.048538 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4b4a44e5-f145-4031-b7c0-707b343a086b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:57.049155 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4b4a44e5-f145-4031-b7c0-707b343a086b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:57.053468 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4b4a44e5-f145-4031-b7c0-707b343a086b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:57.353586 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4b4a44e5-f145-4031-b7c0-707b343a086b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:57.368852 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4b4a44e5-f145-4031-b7c0-707b343a086b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:57.370298 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4b4a44e5-f145-4031-b7c0-707b343a086b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:57.375147 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4b4a44e5-f145-4031-b7c0-707b343a086b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/6b629ba0-6245-442f-bf1a-ad1c1a3116bc" status: 200 len: 1567 microversion: 2.25 time: 0.347963 Oct 04 18:31:57.378129 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 509/989] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:31:57 2022] GET /compute/v2.1/servers/6b629ba0-6245-442f-bf1a-ad1c1a3116bc => generated 1567 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:31:57.387716 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6c877684-4327-41f4-bf4a-5ddadd3e7cb0 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:57.392176 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-6c877684-4327-41f4-bf4a-5ddadd3e7cb0 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: 0cd68f0f-4385-45c4-8dd0-8f33a5a9e527] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:57.407543 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6c877684-4327-41f4-bf4a-5ddadd3e7cb0 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:57.407543 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6c877684-4327-41f4-bf4a-5ddadd3e7cb0 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:57.407543 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6c877684-4327-41f4-bf4a-5ddadd3e7cb0 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:57.407543 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6c877684-4327-41f4-bf4a-5ddadd3e7cb0 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:57.407986 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6c877684-4327-41f4-bf4a-5ddadd3e7cb0 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:57.414007 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6c877684-4327-41f4-bf4a-5ddadd3e7cb0 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:57.620388 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6dc6673f-9fd6-4e38-b5fb-4f11a51188b4 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] 10.222.0.20 "DELETE /compute/v2.1/images/82e02158-d3ca-4c9a-afa8-3d1075568eff" status: 204 len: 0 microversion: 2.1 time: 1.858338 Oct 04 18:31:57.621452 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 481/990] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:55 2022] DELETE /compute/v2.1/images/82e02158-d3ca-4c9a-afa8-3d1075568eff => generated 0 bytes in 1860 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:31:57.629119 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-54a2b0b1-356f-4726-bddc-b9ca3e608669 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:57.630410 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-54a2b0b1-356f-4726-bddc-b9ca3e608669 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] [instance: e17c5b3e-a598-4369-9cf7-027a563e59fa] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:57.637711 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-54a2b0b1-356f-4726-bddc-b9ca3e608669 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:57.642350 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-54a2b0b1-356f-4726-bddc-b9ca3e608669 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:57.642350 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-54a2b0b1-356f-4726-bddc-b9ca3e608669 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:57.642350 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-54a2b0b1-356f-4726-bddc-b9ca3e608669 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:57.642350 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-54a2b0b1-356f-4726-bddc-b9ca3e608669 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:57.642741 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-54a2b0b1-356f-4726-bddc-b9ca3e608669 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:57.654115 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-6c877684-4327-41f4-bf4a-5ddadd3e7cb0 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:57.677361 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6c877684-4327-41f4-bf4a-5ddadd3e7cb0 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/0cd68f0f-4385-45c4-8dd0-8f33a5a9e527" status: 200 len: 1308 microversion: 2.1 time: 0.296370 Oct 04 18:31:57.683559 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 510/991] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:57 2022] GET /compute/v2.1/servers/0cd68f0f-4385-45c4-8dd0-8f33a5a9e527 => generated 1308 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:57.700694 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1d869989-3aa5-45bc-91bc-46d89f6d312b tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Calling method '.version_select at 0x7fe25958b8b0>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:57.743837 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-1d869989-3aa5-45bc-91bc-46d89f6d312b tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] HTTP exception thrown: Image not found. Oct 04 18:31:57.745809 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1d869989-3aa5-45bc-91bc-46d89f6d312b tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Request method failure captured: Oct 04 18:31:57.745809 n-d-850501-14 devstack@n-api.service[123002]: request: DELETE /compute/v2.1/images/7c06454e-f4ee-4402-8078-68104b52d35a HTTP/1.1 Oct 04 18:31:57.745809 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:31:57.745809 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:31:57.745809 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:31:57.745809 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:31:57.745809 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:31:57.745809 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:31:57.745809 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:31:57.745809 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:31:57.745809 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPHvPs-hoO6h1u8p_Qc-pLi13ZzHgIAT1oVlmQY3t1RumfesDNmfdobG4KO8dFu0rZN_lRHyEWO51xZpbAn_dbTF8tqV_v7VBVkBqMRaAhO84mSRF82fX8xl2t-D9hIqQ0hZq0w-H18y9tDBeFjbxg1OAr8voiifQx2Nqamk8eHp9ltI Oct 04 18:31:57.745809 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:31:57.745809 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:31:57.745809 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:31:57.745809 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:31:57.745809 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:31:57.745809 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:31:57.745809 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 5a1cc290c58149f8988cc3d69aff9efd Oct 04 18:31:57.745809 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ImagesOneServerTestJSON-1597051758 Oct 04 18:31:57.745809 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:31:57.745809 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:31:57.747251 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5a1cc290c58149f8988cc3d69aff9efd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5a1cc290c58149f8988cc3d69aff9efd", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5a1cc290c58149f8988cc3d69aff9efd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5a1cc290c58149f8988cc3d69aff9efd"}]}] Oct 04 18:31:57.747251 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ImagesOneServerTestJSON-1597051758 Oct 04 18:31:57.747251 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 5a1cc290c58149f8988cc3d69aff9efd Oct 04 18:31:57.747251 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1597051758 Oct 04 18:31:57.747251 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ImagesOneServerTestJSON-1597051758-project Oct 04 18:31:57.747251 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:31:57.747251 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:31:57.747251 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 1d326c048306423a87ddef70295a75e0 Oct 04 18:31:57.747251 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ImagesOneServerTestJSON-1597051758-project Oct 04 18:31:57.747251 n-d-850501-14 devstack@n-api.service[123002]: method: Oct 04 18:31:57.747251 n-d-850501-14 devstack@n-api.service[123002]: exception: Image not found. Oct 04 18:31:57.747251 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '7c06454e-f4ee-4402-8078-68104b52d35a'} Oct 04 18:31:57.747251 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:31:57.748157 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:57.748157 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 18:31:57.748157 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 18:31:57.748157 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:31:57.748157 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:31:57.748157 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:31:57.748157 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:31:57.748157 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 18:31:57.748157 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 18:31:57.748157 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 18:31:57.748157 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 18:31:57.748157 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:31:57.748157 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:31:57.748157 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:31:57.748157 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:31:57.748157 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 7c06454e-f4ee-4402-8078-68104b52d35a to delete Oct 04 18:31:57.748157 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:31:57.748157 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:31:57.748157 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:31:57.749384 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:57.749384 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 18:31:57.749384 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 18:31:57.749384 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 18:31:57.749384 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 18:31:57.749384 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 18:31:57.749384 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 18:31:57.749384 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7c06454e-f4ee-4402-8078-68104b52d35a could not be found. Oct 04 18:31:57.749384 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:31:57.749384 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:31:57.749384 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:31:57.749384 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:57.749384 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:31:57.749384 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:31:57.749384 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:31:57.749384 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:31:57.749384 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:31:57.749384 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:31:57.749384 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:31:57.749384 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:31:57.750733 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 18:31:57.750733 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 18:31:57.750733 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:31:57.750733 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:31:57.750733 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:31:57.750733 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:31:57.750733 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:57.750733 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:31:57.750733 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:31:57.750733 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:31:57.750733 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:31:57.750733 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:31:57.750733 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:31:57.750733 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1d869989-3aa5-45bc-91bc-46d89f6d312b tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Returning 404 to user: Image not found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:31:57.750733 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1d869989-3aa5-45bc-91bc-46d89f6d312b tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] 10.222.0.20 "DELETE /compute/v2.1/images/7c06454e-f4ee-4402-8078-68104b52d35a" status: 404 len: 62 microversion: 2.1 time: 0.062305 Oct 04 18:31:57.752794 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 511/992] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:57 2022] DELETE /compute/v2.1/images/7c06454e-f4ee-4402-8078-68104b52d35a => generated 62 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:31:57.761562 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1b3c771e-b5ac-45d6-859a-522d138ff11c tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:57.762169 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1b3c771e-b5ac-45d6-859a-522d138ff11c tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] [instance: 836f71c5-d859-4d09-9956-922b0bbee3ae] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:57.775030 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1b3c771e-b5ac-45d6-859a-522d138ff11c tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:57.775534 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1b3c771e-b5ac-45d6-859a-522d138ff11c tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:57.779367 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1b3c771e-b5ac-45d6-859a-522d138ff11c tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:57.783228 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1b3c771e-b5ac-45d6-859a-522d138ff11c tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:57.783902 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1b3c771e-b5ac-45d6-859a-522d138ff11c tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:57.785945 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1b3c771e-b5ac-45d6-859a-522d138ff11c tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:57.817835 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1b3c771e-b5ac-45d6-859a-522d138ff11c tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] [instance: 836f71c5-d859-4d09-9956-922b0bbee3ae] Going to try to terminate instance {{(pid=123002) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:31:57.987295 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-54a2b0b1-356f-4726-bddc-b9ca3e608669 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f49a275284a7eb714a55c6bdd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e44e7aa06ee4126b5705ba65145ebcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:58.004459 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-54a2b0b1-356f-4726-bddc-b9ca3e608669 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] 10.222.0.20 "GET /compute/v2.1/servers/e17c5b3e-a598-4369-9cf7-027a563e59fa" status: 200 len: 1538 microversion: 2.1 time: 0.378073 Oct 04 18:31:58.005855 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 482/993] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:57 2022] GET /compute/v2.1/servers/e17c5b3e-a598-4369-9cf7-027a563e59fa => generated 1538 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:58.017004 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-df8e59f4-3493-4233-b24b-8299247b064e tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:58.020985 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-df8e59f4-3493-4233-b24b-8299247b064e tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 4e1bb5af-9b8b-456f-beb1-aadf2491a8ed] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:58.032630 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-df8e59f4-3493-4233-b24b-8299247b064e tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:58.033713 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-df8e59f4-3493-4233-b24b-8299247b064e tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:58.034380 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-df8e59f4-3493-4233-b24b-8299247b064e tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:58.035742 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-df8e59f4-3493-4233-b24b-8299247b064e tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:58.036481 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-df8e59f4-3493-4233-b24b-8299247b064e tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:58.037079 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-df8e59f4-3493-4233-b24b-8299247b064e tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:58.257732 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1b3c771e-b5ac-45d6-859a-522d138ff11c tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] 10.222.0.20 "DELETE /compute/v2.1/servers/836f71c5-d859-4d09-9956-922b0bbee3ae" status: 204 len: 0 microversion: 2.1 time: 0.503279 Oct 04 18:31:58.258586 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 512/994] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:31:57 2022] DELETE /compute/v2.1/servers/836f71c5-d859-4d09-9956-922b0bbee3ae => generated 0 bytes in 505 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:31:58.265610 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8f2af9b5-045a-4530-b8c3-bc2aa76939f6 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:58.266384 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8f2af9b5-045a-4530-b8c3-bc2aa76939f6 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: fd73ee96-f932-48db-a1b5-664bb9740994] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:58.274217 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8f2af9b5-045a-4530-b8c3-bc2aa76939f6 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:58.274554 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-df8e59f4-3493-4233-b24b-8299247b064e tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:58.274852 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8f2af9b5-045a-4530-b8c3-bc2aa76939f6 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:58.275382 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8f2af9b5-045a-4530-b8c3-bc2aa76939f6 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:58.276370 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8f2af9b5-045a-4530-b8c3-bc2aa76939f6 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:58.287158 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8f2af9b5-045a-4530-b8c3-bc2aa76939f6 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:58.287158 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8f2af9b5-045a-4530-b8c3-bc2aa76939f6 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:58.287460 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-df8e59f4-3493-4233-b24b-8299247b064e tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/4e1bb5af-9b8b-456f-beb1-aadf2491a8ed" status: 200 len: 1311 microversion: 2.1 time: 0.275294 Oct 04 18:31:58.287460 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 483/995] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:58 2022] GET /compute/v2.1/servers/4e1bb5af-9b8b-456f-beb1-aadf2491a8ed => generated 1311 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:58.290211 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-74e02ce2-607f-40d8-9a86-9c98bd83ff9a tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:58.291099 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-74e02ce2-607f-40d8-9a86-9c98bd83ff9a tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] [instance: 836f71c5-d859-4d09-9956-922b0bbee3ae] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:58.297732 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-74e02ce2-607f-40d8-9a86-9c98bd83ff9a tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:58.298451 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-74e02ce2-607f-40d8-9a86-9c98bd83ff9a tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:58.299227 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-74e02ce2-607f-40d8-9a86-9c98bd83ff9a tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:58.300293 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-74e02ce2-607f-40d8-9a86-9c98bd83ff9a tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:58.300962 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-74e02ce2-607f-40d8-9a86-9c98bd83ff9a tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:58.301604 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-74e02ce2-607f-40d8-9a86-9c98bd83ff9a tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:58.314960 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8f2af9b5-045a-4530-b8c3-bc2aa76939f6 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:58.315477 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8f2af9b5-045a-4530-b8c3-bc2aa76939f6 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:58.315991 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8f2af9b5-045a-4530-b8c3-bc2aa76939f6 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:58.316477 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-8f2af9b5-045a-4530-b8c3-bc2aa76939f6 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lazy-loading 'fault' on Instance uuid fd73ee96-f932-48db-a1b5-664bb9740994 {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:31:58.372830 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8f2af9b5-045a-4530-b8c3-bc2aa76939f6 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:58.380674 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8f2af9b5-045a-4530-b8c3-bc2aa76939f6 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/fd73ee96-f932-48db-a1b5-664bb9740994" status: 200 len: 1306 microversion: 2.1 time: 0.119986 Oct 04 18:31:58.381869 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 513/996] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:58 2022] GET /compute/v2.1/servers/fd73ee96-f932-48db-a1b5-664bb9740994 => generated 1306 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:58.387865 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-69ff5364-9c34-4da8-a31d-3870ec33b423 req-f6170304-d795-4ed0-add2-4403087ac6e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cd68f0f-4385-45c4-8dd0-8f33a5a9e527", "tag": "e0c9983a-03a1-4137-9aaf-8dc3ac6e4cb0"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:58.404396 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-69ff5364-9c34-4da8-a31d-3870ec33b423 req-f6170304-d795-4ed0-add2-4403087ac6e0 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:58.404882 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-69ff5364-9c34-4da8-a31d-3870ec33b423 req-f6170304-d795-4ed0-add2-4403087ac6e0 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:58.405334 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-69ff5364-9c34-4da8-a31d-3870ec33b423 req-f6170304-d795-4ed0-add2-4403087ac6e0 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:58.417772 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-69ff5364-9c34-4da8-a31d-3870ec33b423 req-f6170304-d795-4ed0-add2-4403087ac6e0 service nova] Creating event network-changed:e0c9983a-03a1-4137-9aaf-8dc3ac6e4cb0 for instance 0cd68f0f-4385-45c4-8dd0-8f33a5a9e527 on n-h2-850501-14 Oct 04 18:31:58.422805 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-69ff5364-9c34-4da8-a31d-3870ec33b423 req-f6170304-d795-4ed0-add2-4403087ac6e0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038777 Oct 04 18:31:58.434192 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 514/997] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:31:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:58.434192 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e9f84ac7-807e-428b-a3c0-a9c058cc8eca tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:58.434192 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e9f84ac7-807e-428b-a3c0-a9c058cc8eca tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: 6b629ba0-6245-442f-bf1a-ad1c1a3116bc] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:58.437772 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e9f84ac7-807e-428b-a3c0-a9c058cc8eca tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:58.438270 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e9f84ac7-807e-428b-a3c0-a9c058cc8eca tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:58.438970 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e9f84ac7-807e-428b-a3c0-a9c058cc8eca tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:58.439909 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e9f84ac7-807e-428b-a3c0-a9c058cc8eca tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:58.440591 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e9f84ac7-807e-428b-a3c0-a9c058cc8eca tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:58.441220 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e9f84ac7-807e-428b-a3c0-a9c058cc8eca tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:58.621861 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-74e02ce2-607f-40d8-9a86-9c98bd83ff9a tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d326c048306423a87ddef70295a75e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1cc290c58149f8988cc3d69aff9efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:58.630836 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-74e02ce2-607f-40d8-9a86-9c98bd83ff9a tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] 10.222.0.20 "GET /compute/v2.1/servers/836f71c5-d859-4d09-9956-922b0bbee3ae" status: 200 len: 1472 microversion: 2.1 time: 0.345553 Oct 04 18:31:58.632392 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 484/998] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:58 2022] GET /compute/v2.1/servers/836f71c5-d859-4d09-9956-922b0bbee3ae => generated 1472 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:58.637180 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-be31e461-0e9a-450d-a082-4541927ccd72 req-38c3d501-f269-4773-bbc1-8674a8e5af40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b629ba0-6245-442f-bf1a-ad1c1a3116bc", "name": "network-vif-unplugged", "status": "completed", "tag": "d4883fee-1e3e-46f0-9029-6d122a317d39"}, {"name": "network-changed", "server_uuid": "6b629ba0-6245-442f-bf1a-ad1c1a3116bc", "tag": "d4883fee-1e3e-46f0-9029-6d122a317d39"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:58.648314 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-be31e461-0e9a-450d-a082-4541927ccd72 req-38c3d501-f269-4773-bbc1-8674a8e5af40 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:58.648669 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-be31e461-0e9a-450d-a082-4541927ccd72 req-38c3d501-f269-4773-bbc1-8674a8e5af40 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:58.649414 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-be31e461-0e9a-450d-a082-4541927ccd72 req-38c3d501-f269-4773-bbc1-8674a8e5af40 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:58.661685 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-be31e461-0e9a-450d-a082-4541927ccd72 req-38c3d501-f269-4773-bbc1-8674a8e5af40 service nova] Creating event network-vif-unplugged:d4883fee-1e3e-46f0-9029-6d122a317d39 for instance 6b629ba0-6245-442f-bf1a-ad1c1a3116bc on n-h1-850501-14 Oct 04 18:31:58.662199 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-be31e461-0e9a-450d-a082-4541927ccd72 req-38c3d501-f269-4773-bbc1-8674a8e5af40 service nova] Creating event network-changed:d4883fee-1e3e-46f0-9029-6d122a317d39 for instance 6b629ba0-6245-442f-bf1a-ad1c1a3116bc on n-h1-850501-14 Oct 04 18:31:58.668460 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-be31e461-0e9a-450d-a082-4541927ccd72 req-38c3d501-f269-4773-bbc1-8674a8e5af40 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.034779 Oct 04 18:31:58.669068 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 485/999] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:31:58 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:58.706908 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-cf379eb3-4c74-410a-9f22-7330566a47b1 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:58.708309 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-cf379eb3-4c74-410a-9f22-7330566a47b1 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: 0cd68f0f-4385-45c4-8dd0-8f33a5a9e527] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:58.716791 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cf379eb3-4c74-410a-9f22-7330566a47b1 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:58.722395 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cf379eb3-4c74-410a-9f22-7330566a47b1 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:58.722395 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cf379eb3-4c74-410a-9f22-7330566a47b1 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:58.722395 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cf379eb3-4c74-410a-9f22-7330566a47b1 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:58.722395 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cf379eb3-4c74-410a-9f22-7330566a47b1 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:58.722795 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cf379eb3-4c74-410a-9f22-7330566a47b1 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:58.797612 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e9f84ac7-807e-428b-a3c0-a9c058cc8eca tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:58.807419 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e9f84ac7-807e-428b-a3c0-a9c058cc8eca tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:58.808906 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e9f84ac7-807e-428b-a3c0-a9c058cc8eca tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:58.810086 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e9f84ac7-807e-428b-a3c0-a9c058cc8eca tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/6b629ba0-6245-442f-bf1a-ad1c1a3116bc" status: 200 len: 1567 microversion: 2.25 time: 0.385043 Oct 04 18:31:58.810645 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 515/1000] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:31:58 2022] GET /compute/v2.1/servers/6b629ba0-6245-442f-bf1a-ad1c1a3116bc => generated 1567 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:31:58.991933 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-cf379eb3-4c74-410a-9f22-7330566a47b1 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:59.000008 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-cf379eb3-4c74-410a-9f22-7330566a47b1 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/0cd68f0f-4385-45c4-8dd0-8f33a5a9e527" status: 200 len: 1308 microversion: 2.1 time: 0.297426 Oct 04 18:31:59.000700 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 486/1001] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:58 2022] GET /compute/v2.1/servers/0cd68f0f-4385-45c4-8dd0-8f33a5a9e527 => generated 1308 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:31:59.034322 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-846b16a2-b356-4ebb-a1ff-2716e9e7f1f9 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:59.034941 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-846b16a2-b356-4ebb-a1ff-2716e9e7f1f9 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] [instance: e17c5b3e-a598-4369-9cf7-027a563e59fa] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:59.042925 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-846b16a2-b356-4ebb-a1ff-2716e9e7f1f9 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:59.043415 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-846b16a2-b356-4ebb-a1ff-2716e9e7f1f9 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:59.043856 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-846b16a2-b356-4ebb-a1ff-2716e9e7f1f9 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:59.044580 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-846b16a2-b356-4ebb-a1ff-2716e9e7f1f9 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:59.045092 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-846b16a2-b356-4ebb-a1ff-2716e9e7f1f9 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:59.045470 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-846b16a2-b356-4ebb-a1ff-2716e9e7f1f9 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:59.285829 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-846b16a2-b356-4ebb-a1ff-2716e9e7f1f9 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f49a275284a7eb714a55c6bdd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e44e7aa06ee4126b5705ba65145ebcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:59.296330 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-846b16a2-b356-4ebb-a1ff-2716e9e7f1f9 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] 10.222.0.20 "GET /compute/v2.1/servers/e17c5b3e-a598-4369-9cf7-027a563e59fa" status: 200 len: 1520 microversion: 2.1 time: 0.265681 Oct 04 18:31:59.297301 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 516/1002] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:59 2022] GET /compute/v2.1/servers/e17c5b3e-a598-4369-9cf7-027a563e59fa => generated 1520 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:59.309782 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4a742009-f3a5-4509-bc0f-faf3dcd60395 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:59.310860 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-4a742009-f3a5-4509-bc0f-faf3dcd60395 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 4e1bb5af-9b8b-456f-beb1-aadf2491a8ed] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:59.318024 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4a742009-f3a5-4509-bc0f-faf3dcd60395 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:59.318865 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4a742009-f3a5-4509-bc0f-faf3dcd60395 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:59.319957 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4a742009-f3a5-4509-bc0f-faf3dcd60395 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:59.320968 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4a742009-f3a5-4509-bc0f-faf3dcd60395 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:59.321768 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4a742009-f3a5-4509-bc0f-faf3dcd60395 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:59.322581 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4a742009-f3a5-4509-bc0f-faf3dcd60395 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:59.322733 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-40effb0c-4d26-4abb-806f-d829ef09ce81 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:59.327497 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-40effb0c-4d26-4abb-806f-d829ef09ce81 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] [instance: e17c5b3e-a598-4369-9cf7-027a563e59fa] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:59.331430 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-40effb0c-4d26-4abb-806f-d829ef09ce81 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:59.332128 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-40effb0c-4d26-4abb-806f-d829ef09ce81 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:59.332749 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-40effb0c-4d26-4abb-806f-d829ef09ce81 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:59.333750 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-40effb0c-4d26-4abb-806f-d829ef09ce81 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:59.334891 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-40effb0c-4d26-4abb-806f-d829ef09ce81 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:59.335473 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-40effb0c-4d26-4abb-806f-d829ef09ce81 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:59.360853 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:59.365990 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-40effb0c-4d26-4abb-806f-d829ef09ce81 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] [instance: e17c5b3e-a598-4369-9cf7-027a563e59fa] Going to try to terminate instance {{(pid=123002) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:31:59.427352 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=4 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:59.534599 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-4a742009-f3a5-4509-bc0f-faf3dcd60395 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:59.544848 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-4a742009-f3a5-4509-bc0f-faf3dcd60395 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/4e1bb5af-9b8b-456f-beb1-aadf2491a8ed" status: 200 len: 1311 microversion: 2.1 time: 0.239218 Oct 04 18:31:59.545666 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 487/1003] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:59 2022] GET /compute/v2.1/servers/4e1bb5af-9b8b-456f-beb1-aadf2491a8ed => generated 1311 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:59.550535 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b8df16f2-573f-4a74-9473-2be2f14ee85c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:59.551425 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b8df16f2-573f-4a74-9473-2be2f14ee85c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: fd73ee96-f932-48db-a1b5-664bb9740994] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:59.558733 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b8df16f2-573f-4a74-9473-2be2f14ee85c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:59.559575 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b8df16f2-573f-4a74-9473-2be2f14ee85c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:59.560480 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b8df16f2-573f-4a74-9473-2be2f14ee85c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:59.561804 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b8df16f2-573f-4a74-9473-2be2f14ee85c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:59.566631 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b8df16f2-573f-4a74-9473-2be2f14ee85c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:59.566631 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b8df16f2-573f-4a74-9473-2be2f14ee85c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:59.607076 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b8df16f2-573f-4a74-9473-2be2f14ee85c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:59.607746 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b8df16f2-573f-4a74-9473-2be2f14ee85c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:59.608345 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b8df16f2-573f-4a74-9473-2be2f14ee85c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:59.609053 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-b8df16f2-573f-4a74-9473-2be2f14ee85c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lazy-loading 'fault' on Instance uuid fd73ee96-f932-48db-a1b5-664bb9740994 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:31:59.655982 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b8df16f2-573f-4a74-9473-2be2f14ee85c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:59.665602 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b8df16f2-573f-4a74-9473-2be2f14ee85c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/fd73ee96-f932-48db-a1b5-664bb9740994" status: 200 len: 1306 microversion: 2.1 time: 0.118655 Oct 04 18:31:59.666531 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 488/1004] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:59 2022] GET /compute/v2.1/servers/fd73ee96-f932-48db-a1b5-664bb9740994 => generated 1306 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:59.676249 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-b79fbe48-3716-4612-938e-3b6c7b57b5b7 req-f1c1a578-d8a8-4f42-a1c8-709615f39c47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e17c5b3e-a598-4369-9cf7-027a563e59fa", "name": "network-vif-plugged", "status": "completed", "tag": "2f0b5af6-0cc2-4949-8880-47b512d4f031"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:59.682325 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:59.682325 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-b79fbe48-3716-4612-938e-3b6c7b57b5b7 req-f1c1a578-d8a8-4f42-a1c8-709615f39c47 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:59.682996 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-b79fbe48-3716-4612-938e-3b6c7b57b5b7 req-f1c1a578-d8a8-4f42-a1c8-709615f39c47 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:59.683522 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-b79fbe48-3716-4612-938e-3b6c7b57b5b7 req-f1c1a578-d8a8-4f42-a1c8-709615f39c47 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:59.697907 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-b79fbe48-3716-4612-938e-3b6c7b57b5b7 req-f1c1a578-d8a8-4f42-a1c8-709615f39c47 service nova] Creating event network-vif-plugged:2f0b5af6-0cc2-4949-8880-47b512d4f031 for instance e17c5b3e-a598-4369-9cf7-027a563e59fa on n-h1-850501-14 Oct 04 18:31:59.703466 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-b79fbe48-3716-4612-938e-3b6c7b57b5b7 req-f1c1a578-d8a8-4f42-a1c8-709615f39c47 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035725 Oct 04 18:31:59.705203 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-40effb0c-4d26-4abb-806f-d829ef09ce81 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e17c5b3e-a598-4369-9cf7-027a563e59fa" status: 204 len: 0 microversion: 2.1 time: 0.385351 Oct 04 18:31:59.705339 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 489/1005] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:31:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:59.708900 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 517/1006] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:31:59 2022] DELETE /compute/v2.1/servers/e17c5b3e-a598-4369-9cf7-027a563e59fa => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:31:59.712695 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0e31ba1f-d4a6-46c5-a55d-dfaffa597388 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:59.713416 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0e31ba1f-d4a6-46c5-a55d-dfaffa597388 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] [instance: 836f71c5-d859-4d09-9956-922b0bbee3ae] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:59.719461 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a4fe0a9a-52e1-43fc-ac5a-8e3d937d39a9 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:59.719959 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0e31ba1f-d4a6-46c5-a55d-dfaffa597388 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:59.720722 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a4fe0a9a-52e1-43fc-ac5a-8e3d937d39a9 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] [instance: e17c5b3e-a598-4369-9cf7-027a563e59fa] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:59.721527 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0e31ba1f-d4a6-46c5-a55d-dfaffa597388 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:59.722106 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0e31ba1f-d4a6-46c5-a55d-dfaffa597388 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:59.723474 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0e31ba1f-d4a6-46c5-a55d-dfaffa597388 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:59.724185 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0e31ba1f-d4a6-46c5-a55d-dfaffa597388 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:59.728579 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0e31ba1f-d4a6-46c5-a55d-dfaffa597388 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:59.732203 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a4fe0a9a-52e1-43fc-ac5a-8e3d937d39a9 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:59.732738 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a4fe0a9a-52e1-43fc-ac5a-8e3d937d39a9 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:59.733659 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a4fe0a9a-52e1-43fc-ac5a-8e3d937d39a9 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:59.733880 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a4fe0a9a-52e1-43fc-ac5a-8e3d937d39a9 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:59.734339 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a4fe0a9a-52e1-43fc-ac5a-8e3d937d39a9 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:59.734764 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a4fe0a9a-52e1-43fc-ac5a-8e3d937d39a9 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:59.952266 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0e31ba1f-d4a6-46c5-a55d-dfaffa597388 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d326c048306423a87ddef70295a75e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1cc290c58149f8988cc3d69aff9efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:59.957231 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a4fe0a9a-52e1-43fc-ac5a-8e3d937d39a9 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f49a275284a7eb714a55c6bdd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e44e7aa06ee4126b5705ba65145ebcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:59.965598 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a4fe0a9a-52e1-43fc-ac5a-8e3d937d39a9 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] 10.222.0.20 "GET /compute/v2.1/servers/e17c5b3e-a598-4369-9cf7-027a563e59fa" status: 200 len: 1526 microversion: 2.1 time: 0.253662 Oct 04 18:31:59.966156 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 518/1007] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:59 2022] GET /compute/v2.1/servers/e17c5b3e-a598-4369-9cf7-027a563e59fa => generated 1526 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:59.970706 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c73d804c-a198-49b7-be8f-20a2df8e95c9 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:59.971315 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c73d804c-a198-49b7-be8f-20a2df8e95c9 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: 6b629ba0-6245-442f-bf1a-ad1c1a3116bc] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:59.978334 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c73d804c-a198-49b7-be8f-20a2df8e95c9 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:59.978334 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c73d804c-a198-49b7-be8f-20a2df8e95c9 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:59.978715 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c73d804c-a198-49b7-be8f-20a2df8e95c9 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:59.979340 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c73d804c-a198-49b7-be8f-20a2df8e95c9 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:59.979801 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c73d804c-a198-49b7-be8f-20a2df8e95c9 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:59.980267 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c73d804c-a198-49b7-be8f-20a2df8e95c9 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:59.992669 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0e31ba1f-d4a6-46c5-a55d-dfaffa597388 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] 10.222.0.20 "GET /compute/v2.1/servers/836f71c5-d859-4d09-9956-922b0bbee3ae" status: 200 len: 1472 microversion: 2.1 time: 0.286026 Oct 04 18:31:59.993259 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 490/1008] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:59 2022] GET /compute/v2.1/servers/836f71c5-d859-4d09-9956-922b0bbee3ae => generated 1472 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:00.026678 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-84107dd6-1d6f-4369-b997-455c78ed4297 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:00.027553 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-84107dd6-1d6f-4369-b997-455c78ed4297 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: 0cd68f0f-4385-45c4-8dd0-8f33a5a9e527] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:00.034798 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-84107dd6-1d6f-4369-b997-455c78ed4297 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:00.035801 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-84107dd6-1d6f-4369-b997-455c78ed4297 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:00.036292 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-84107dd6-1d6f-4369-b997-455c78ed4297 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:00.037157 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-84107dd6-1d6f-4369-b997-455c78ed4297 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:00.038534 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-84107dd6-1d6f-4369-b997-455c78ed4297 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:00.039945 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-84107dd6-1d6f-4369-b997-455c78ed4297 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:00.181820 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c73d804c-a198-49b7-be8f-20a2df8e95c9 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:00.190906 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c73d804c-a198-49b7-be8f-20a2df8e95c9 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:00.192862 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c73d804c-a198-49b7-be8f-20a2df8e95c9 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:00.194605 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c73d804c-a198-49b7-be8f-20a2df8e95c9 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/6b629ba0-6245-442f-bf1a-ad1c1a3116bc" status: 200 len: 1567 microversion: 2.25 time: 0.227241 Oct 04 18:32:00.195457 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 519/1009] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:31:59 2022] GET /compute/v2.1/servers/6b629ba0-6245-442f-bf1a-ad1c1a3116bc => generated 1567 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:32:00.223286 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-84107dd6-1d6f-4369-b997-455c78ed4297 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:00.231979 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-84107dd6-1d6f-4369-b997-455c78ed4297 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/0cd68f0f-4385-45c4-8dd0-8f33a5a9e527" status: 200 len: 1308 microversion: 2.1 time: 0.212531 Oct 04 18:32:00.232579 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 491/1010] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:00 2022] GET /compute/v2.1/servers/0cd68f0f-4385-45c4-8dd0-8f33a5a9e527 => generated 1308 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:00.572988 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5e2dc7ea-957b-4d15-8e30-1c757d41c7f0 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:00.573614 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5e2dc7ea-957b-4d15-8e30-1c757d41c7f0 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 4e1bb5af-9b8b-456f-beb1-aadf2491a8ed] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:00.579728 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5e2dc7ea-957b-4d15-8e30-1c757d41c7f0 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:00.580254 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5e2dc7ea-957b-4d15-8e30-1c757d41c7f0 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:00.580698 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5e2dc7ea-957b-4d15-8e30-1c757d41c7f0 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:00.581432 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5e2dc7ea-957b-4d15-8e30-1c757d41c7f0 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:00.581912 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5e2dc7ea-957b-4d15-8e30-1c757d41c7f0 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:00.582342 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5e2dc7ea-957b-4d15-8e30-1c757d41c7f0 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:00.690708 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c00df899-ab91-4903-a51c-31a98def3ebf tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:00.691570 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c00df899-ab91-4903-a51c-31a98def3ebf tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: fd73ee96-f932-48db-a1b5-664bb9740994] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:00.698416 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c00df899-ab91-4903-a51c-31a98def3ebf tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:00.698999 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c00df899-ab91-4903-a51c-31a98def3ebf tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:00.699538 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c00df899-ab91-4903-a51c-31a98def3ebf tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:00.700326 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c00df899-ab91-4903-a51c-31a98def3ebf tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:00.700908 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c00df899-ab91-4903-a51c-31a98def3ebf tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:00.701420 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c00df899-ab91-4903-a51c-31a98def3ebf tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:00.730881 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5e2dc7ea-957b-4d15-8e30-1c757d41c7f0 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:00.735347 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c00df899-ab91-4903-a51c-31a98def3ebf tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:00.735838 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c00df899-ab91-4903-a51c-31a98def3ebf tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:00.736311 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c00df899-ab91-4903-a51c-31a98def3ebf tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:00.736766 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-c00df899-ab91-4903-a51c-31a98def3ebf tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lazy-loading 'fault' on Instance uuid fd73ee96-f932-48db-a1b5-664bb9740994 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:32:00.738800 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5e2dc7ea-957b-4d15-8e30-1c757d41c7f0 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/4e1bb5af-9b8b-456f-beb1-aadf2491a8ed" status: 200 len: 1311 microversion: 2.1 time: 0.170348 Oct 04 18:32:00.745306 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 520/1011] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:00 2022] GET /compute/v2.1/servers/4e1bb5af-9b8b-456f-beb1-aadf2491a8ed => generated 1311 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:00.781853 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c00df899-ab91-4903-a51c-31a98def3ebf tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:00.790944 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c00df899-ab91-4903-a51c-31a98def3ebf tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/fd73ee96-f932-48db-a1b5-664bb9740994" status: 200 len: 1306 microversion: 2.1 time: 0.104159 Oct 04 18:32:00.791430 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 492/1012] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:00 2022] GET /compute/v2.1/servers/fd73ee96-f932-48db-a1b5-664bb9740994 => generated 1306 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:32:00.993210 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0237bdfe-de8c-4cf9-acda-53657b279399 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:00.993825 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0237bdfe-de8c-4cf9-acda-53657b279399 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] [instance: e17c5b3e-a598-4369-9cf7-027a563e59fa] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:00.995760 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=12 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:01.000848 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0237bdfe-de8c-4cf9-acda-53657b279399 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:01.001477 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0237bdfe-de8c-4cf9-acda-53657b279399 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:01.001923 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0237bdfe-de8c-4cf9-acda-53657b279399 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:01.002711 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0237bdfe-de8c-4cf9-acda-53657b279399 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:01.003201 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0237bdfe-de8c-4cf9-acda-53657b279399 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:01.003608 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0237bdfe-de8c-4cf9-acda-53657b279399 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:01.014810 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2873e243-7e2a-4383-86c0-873132b25700 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:01.015430 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2873e243-7e2a-4383-86c0-873132b25700 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] [instance: 836f71c5-d859-4d09-9956-922b0bbee3ae] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:01.021340 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2873e243-7e2a-4383-86c0-873132b25700 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:01.021838 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2873e243-7e2a-4383-86c0-873132b25700 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:01.022776 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2873e243-7e2a-4383-86c0-873132b25700 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:01.023657 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2873e243-7e2a-4383-86c0-873132b25700 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:01.024101 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2873e243-7e2a-4383-86c0-873132b25700 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:01.024532 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2873e243-7e2a-4383-86c0-873132b25700 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:01.228721 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0237bdfe-de8c-4cf9-acda-53657b279399 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f49a275284a7eb714a55c6bdd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e44e7aa06ee4126b5705ba65145ebcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:01.231993 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-2873e243-7e2a-4383-86c0-873132b25700 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d326c048306423a87ddef70295a75e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1cc290c58149f8988cc3d69aff9efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:01.236893 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0237bdfe-de8c-4cf9-acda-53657b279399 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] 10.222.0.20 "GET /compute/v2.1/servers/e17c5b3e-a598-4369-9cf7-027a563e59fa" status: 200 len: 1526 microversion: 2.1 time: 0.248427 Oct 04 18:32:01.237480 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 521/1013] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:00 2022] GET /compute/v2.1/servers/e17c5b3e-a598-4369-9cf7-027a563e59fa => generated 1526 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:01.240351 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2873e243-7e2a-4383-86c0-873132b25700 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] 10.222.0.20 "GET /compute/v2.1/servers/836f71c5-d859-4d09-9956-922b0bbee3ae" status: 200 len: 1472 microversion: 2.1 time: 0.229385 Oct 04 18:32:01.241001 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 493/1014] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:01 2022] GET /compute/v2.1/servers/836f71c5-d859-4d09-9956-922b0bbee3ae => generated 1472 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:32:01.250294 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7b1bc212-945a-4c40-aa09-a3935b1ec763 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:01.251065 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7b1bc212-945a-4c40-aa09-a3935b1ec763 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: 6b629ba0-6245-442f-bf1a-ad1c1a3116bc] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:01.257399 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7b1bc212-945a-4c40-aa09-a3935b1ec763 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:01.257943 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7b1bc212-945a-4c40-aa09-a3935b1ec763 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:01.260100 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7b1bc212-945a-4c40-aa09-a3935b1ec763 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:01.260100 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7b1bc212-945a-4c40-aa09-a3935b1ec763 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:01.260100 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7b1bc212-945a-4c40-aa09-a3935b1ec763 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:01.260100 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7b1bc212-945a-4c40-aa09-a3935b1ec763 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:01.261111 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d2d545cb-2d68-4c75-9936-3e7aed9f2685 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:01.261734 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d2d545cb-2d68-4c75-9936-3e7aed9f2685 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: 0cd68f0f-4385-45c4-8dd0-8f33a5a9e527] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:01.268879 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d2d545cb-2d68-4c75-9936-3e7aed9f2685 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:01.269689 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d2d545cb-2d68-4c75-9936-3e7aed9f2685 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:01.270141 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d2d545cb-2d68-4c75-9936-3e7aed9f2685 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:01.270853 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d2d545cb-2d68-4c75-9936-3e7aed9f2685 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:01.271314 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d2d545cb-2d68-4c75-9936-3e7aed9f2685 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:01.271745 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d2d545cb-2d68-4c75-9936-3e7aed9f2685 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:01.466109 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7b1bc212-945a-4c40-aa09-a3935b1ec763 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:01.475221 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7b1bc212-945a-4c40-aa09-a3935b1ec763 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:01.477240 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7b1bc212-945a-4c40-aa09-a3935b1ec763 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:01.478462 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7b1bc212-945a-4c40-aa09-a3935b1ec763 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/6b629ba0-6245-442f-bf1a-ad1c1a3116bc" status: 200 len: 1567 microversion: 2.25 time: 0.232275 Oct 04 18:32:01.478984 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d2d545cb-2d68-4c75-9936-3e7aed9f2685 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:01.479151 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 522/1015] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:32:01 2022] GET /compute/v2.1/servers/6b629ba0-6245-442f-bf1a-ad1c1a3116bc => generated 1567 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:32:01.488709 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d2d545cb-2d68-4c75-9936-3e7aed9f2685 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/0cd68f0f-4385-45c4-8dd0-8f33a5a9e527" status: 200 len: 1308 microversion: 2.1 time: 0.231275 Oct 04 18:32:01.489650 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 494/1016] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:01 2022] GET /compute/v2.1/servers/0cd68f0f-4385-45c4-8dd0-8f33a5a9e527 => generated 1308 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:01.767501 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b523b755-2c4c-4313-b83a-82bfd28d6b61 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:01.768218 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b523b755-2c4c-4313-b83a-82bfd28d6b61 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 4e1bb5af-9b8b-456f-beb1-aadf2491a8ed] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:01.775813 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b523b755-2c4c-4313-b83a-82bfd28d6b61 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:01.776479 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b523b755-2c4c-4313-b83a-82bfd28d6b61 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:01.777024 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b523b755-2c4c-4313-b83a-82bfd28d6b61 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:01.777827 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b523b755-2c4c-4313-b83a-82bfd28d6b61 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:01.778382 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b523b755-2c4c-4313-b83a-82bfd28d6b61 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:01.778988 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b523b755-2c4c-4313-b83a-82bfd28d6b61 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:01.808900 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-3eb918ce-8efc-4100-a559-b7f0f4085d83 req-d487aadc-5264-4dd1-89a7-733dbcbf6657 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "836f71c5-d859-4d09-9956-922b0bbee3ae", "name": "network-vif-unplugged", "status": "completed", "tag": "0a037711-4826-46fe-ab3b-3321a329f5e9"}, {"server_uuid": "4e1bb5af-9b8b-456f-beb1-aadf2491a8ed", "name": "network-vif-plugged", "status": "completed", "tag": "1fbe8b1c-48fa-4c89-bb2c-cf691330a2a8"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:01.827814 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-3eb918ce-8efc-4100-a559-b7f0f4085d83 req-d487aadc-5264-4dd1-89a7-733dbcbf6657 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:01.828389 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-3eb918ce-8efc-4100-a559-b7f0f4085d83 req-d487aadc-5264-4dd1-89a7-733dbcbf6657 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:01.828836 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-3eb918ce-8efc-4100-a559-b7f0f4085d83 req-d487aadc-5264-4dd1-89a7-733dbcbf6657 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:01.842653 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-3eb918ce-8efc-4100-a559-b7f0f4085d83 req-d487aadc-5264-4dd1-89a7-733dbcbf6657 service nova] Creating event network-vif-unplugged:0a037711-4826-46fe-ab3b-3321a329f5e9 for instance 836f71c5-d859-4d09-9956-922b0bbee3ae on n-h1-850501-14 Oct 04 18:32:01.843177 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-3eb918ce-8efc-4100-a559-b7f0f4085d83 req-d487aadc-5264-4dd1-89a7-733dbcbf6657 service nova] Creating event network-vif-plugged:1fbe8b1c-48fa-4c89-bb2c-cf691330a2a8 for instance 4e1bb5af-9b8b-456f-beb1-aadf2491a8ed on n-h1-850501-14 Oct 04 18:32:01.851553 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-3eb918ce-8efc-4100-a559-b7f0f4085d83 req-d487aadc-5264-4dd1-89a7-733dbcbf6657 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.047468 Oct 04 18:32:01.854039 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 495/1017] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:32:01 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:32:01.864823 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8f7b5f5b-4bdf-4132-8833-adf9f17fa69c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:01.865552 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8f7b5f5b-4bdf-4132-8833-adf9f17fa69c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: fd73ee96-f932-48db-a1b5-664bb9740994] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:01.872834 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8f7b5f5b-4bdf-4132-8833-adf9f17fa69c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:01.873334 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8f7b5f5b-4bdf-4132-8833-adf9f17fa69c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:01.873779 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8f7b5f5b-4bdf-4132-8833-adf9f17fa69c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:01.874657 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8f7b5f5b-4bdf-4132-8833-adf9f17fa69c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:01.875126 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8f7b5f5b-4bdf-4132-8833-adf9f17fa69c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:01.875561 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8f7b5f5b-4bdf-4132-8833-adf9f17fa69c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:01.920885 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8f7b5f5b-4bdf-4132-8833-adf9f17fa69c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:01.921390 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8f7b5f5b-4bdf-4132-8833-adf9f17fa69c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:01.922153 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8f7b5f5b-4bdf-4132-8833-adf9f17fa69c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:01.922689 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-8f7b5f5b-4bdf-4132-8833-adf9f17fa69c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lazy-loading 'fault' on Instance uuid fd73ee96-f932-48db-a1b5-664bb9740994 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:32:01.989712 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8f7b5f5b-4bdf-4132-8833-adf9f17fa69c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:01.999580 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8f7b5f5b-4bdf-4132-8833-adf9f17fa69c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/fd73ee96-f932-48db-a1b5-664bb9740994" status: 200 len: 1306 microversion: 2.1 time: 0.144378 Oct 04 18:32:02.000491 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 496/1018] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:01 2022] GET /compute/v2.1/servers/fd73ee96-f932-48db-a1b5-664bb9740994 => generated 1306 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:02.016688 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b523b755-2c4c-4313-b83a-82bfd28d6b61 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:02.026902 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b523b755-2c4c-4313-b83a-82bfd28d6b61 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/4e1bb5af-9b8b-456f-beb1-aadf2491a8ed" status: 200 len: 1311 microversion: 2.1 time: 0.263494 Oct 04 18:32:02.029933 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 523/1019] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:01 2022] GET /compute/v2.1/servers/4e1bb5af-9b8b-456f-beb1-aadf2491a8ed => generated 1311 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:02.261432 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8844c637-70b7-45aa-959a-862c129c5b60 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:02.262128 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8844c637-70b7-45aa-959a-862c129c5b60 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] [instance: e17c5b3e-a598-4369-9cf7-027a563e59fa] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:02.263554 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-48f90875-bec0-479d-92d4-0c02bbde70b6 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:02.264381 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-48f90875-bec0-479d-92d4-0c02bbde70b6 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] [instance: 836f71c5-d859-4d09-9956-922b0bbee3ae] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:02.270537 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-48f90875-bec0-479d-92d4-0c02bbde70b6 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:02.270727 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8844c637-70b7-45aa-959a-862c129c5b60 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:02.271029 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-48f90875-bec0-479d-92d4-0c02bbde70b6 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:02.272975 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8844c637-70b7-45aa-959a-862c129c5b60 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:02.273118 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-48f90875-bec0-479d-92d4-0c02bbde70b6 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:02.273233 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8844c637-70b7-45aa-959a-862c129c5b60 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:02.273324 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-48f90875-bec0-479d-92d4-0c02bbde70b6 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:02.273406 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8844c637-70b7-45aa-959a-862c129c5b60 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:02.273406 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8844c637-70b7-45aa-959a-862c129c5b60 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:02.273579 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-48f90875-bec0-479d-92d4-0c02bbde70b6 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:02.273724 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8844c637-70b7-45aa-959a-862c129c5b60 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:02.274282 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-48f90875-bec0-479d-92d4-0c02bbde70b6 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:02.475382 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8844c637-70b7-45aa-959a-862c129c5b60 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f49a275284a7eb714a55c6bdd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e44e7aa06ee4126b5705ba65145ebcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:02.487782 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-48f90875-bec0-479d-92d4-0c02bbde70b6 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d326c048306423a87ddef70295a75e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1cc290c58149f8988cc3d69aff9efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:02.492083 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8844c637-70b7-45aa-959a-862c129c5b60 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] 10.222.0.20 "GET /compute/v2.1/servers/e17c5b3e-a598-4369-9cf7-027a563e59fa" status: 200 len: 1526 microversion: 2.1 time: 0.234245 Oct 04 18:32:02.492700 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 497/1020] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:02 2022] GET /compute/v2.1/servers/e17c5b3e-a598-4369-9cf7-027a563e59fa => generated 1526 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:02.502738 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-48f90875-bec0-479d-92d4-0c02bbde70b6 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] 10.222.0.20 "GET /compute/v2.1/servers/836f71c5-d859-4d09-9956-922b0bbee3ae" status: 200 len: 1472 microversion: 2.1 time: 0.243901 Oct 04 18:32:02.508531 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-105ca031-9cc5-4fc2-b0a6-af53ef77b293 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:02.509845 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-105ca031-9cc5-4fc2-b0a6-af53ef77b293 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: 6b629ba0-6245-442f-bf1a-ad1c1a3116bc] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:02.516990 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-105ca031-9cc5-4fc2-b0a6-af53ef77b293 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:02.517617 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-105ca031-9cc5-4fc2-b0a6-af53ef77b293 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:02.518325 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-105ca031-9cc5-4fc2-b0a6-af53ef77b293 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:02.519132 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-105ca031-9cc5-4fc2-b0a6-af53ef77b293 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:02.520198 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-105ca031-9cc5-4fc2-b0a6-af53ef77b293 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:02.520328 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 524/1021] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:02 2022] GET /compute/v2.1/servers/836f71c5-d859-4d09-9956-922b0bbee3ae => generated 1472 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:32:02.525281 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-105ca031-9cc5-4fc2-b0a6-af53ef77b293 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:02.526322 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e9668a0d-fffa-4d91-9c32-dc7f863652ab tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:02.526596 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=100 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:02.527343 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e9668a0d-fffa-4d91-9c32-dc7f863652ab tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: 0cd68f0f-4385-45c4-8dd0-8f33a5a9e527] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:02.534208 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e9668a0d-fffa-4d91-9c32-dc7f863652ab tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:02.534856 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e9668a0d-fffa-4d91-9c32-dc7f863652ab tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:02.535443 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e9668a0d-fffa-4d91-9c32-dc7f863652ab tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:02.536467 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e9668a0d-fffa-4d91-9c32-dc7f863652ab tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:02.537072 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e9668a0d-fffa-4d91-9c32-dc7f863652ab tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:02.537664 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e9668a0d-fffa-4d91-9c32-dc7f863652ab tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:02.717313 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-105ca031-9cc5-4fc2-b0a6-af53ef77b293 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:02.726847 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-105ca031-9cc5-4fc2-b0a6-af53ef77b293 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:02.728590 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-105ca031-9cc5-4fc2-b0a6-af53ef77b293 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:02.729866 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-105ca031-9cc5-4fc2-b0a6-af53ef77b293 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/6b629ba0-6245-442f-bf1a-ad1c1a3116bc" status: 200 len: 1567 microversion: 2.25 time: 0.228887 Oct 04 18:32:02.744664 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 498/1022] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:32:02 2022] GET /compute/v2.1/servers/6b629ba0-6245-442f-bf1a-ad1c1a3116bc => generated 1567 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:32:02.747799 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e9668a0d-fffa-4d91-9c32-dc7f863652ab tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:02.756465 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e9668a0d-fffa-4d91-9c32-dc7f863652ab tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/0cd68f0f-4385-45c4-8dd0-8f33a5a9e527" status: 200 len: 1308 microversion: 2.1 time: 0.235104 Oct 04 18:32:02.757240 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 525/1023] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:02 2022] GET /compute/v2.1/servers/0cd68f0f-4385-45c4-8dd0-8f33a5a9e527 => generated 1308 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:03.029243 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4e700213-7cdd-482d-88c2-3d3c77b149cc tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:03.029870 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-4e700213-7cdd-482d-88c2-3d3c77b149cc tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: fd73ee96-f932-48db-a1b5-664bb9740994] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:03.036479 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4e700213-7cdd-482d-88c2-3d3c77b149cc tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:03.036969 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4e700213-7cdd-482d-88c2-3d3c77b149cc tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:03.037414 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4e700213-7cdd-482d-88c2-3d3c77b149cc tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:03.038924 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4e700213-7cdd-482d-88c2-3d3c77b149cc tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:03.039389 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4e700213-7cdd-482d-88c2-3d3c77b149cc tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:03.039819 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4e700213-7cdd-482d-88c2-3d3c77b149cc tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:03.055474 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-434167c3-5924-47ca-9d07-a25b50f50804 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:03.056325 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-4e700213-7cdd-482d-88c2-3d3c77b149cc tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] HTTP exception thrown: Instance fd73ee96-f932-48db-a1b5-664bb9740994 could not be found. Oct 04 18:32:03.056763 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-434167c3-5924-47ca-9d07-a25b50f50804 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 4e1bb5af-9b8b-456f-beb1-aadf2491a8ed] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:03.057674 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4e700213-7cdd-482d-88c2-3d3c77b149cc tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Request method failure captured: Oct 04 18:32:03.057674 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/fd73ee96-f932-48db-a1b5-664bb9740994 HTTP/1.1 Oct 04 18:32:03.057674 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:32:03.057674 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:32:03.057674 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:32:03.057674 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:32:03.057674 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:32:03.057674 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:32:03.057674 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:32:03.057674 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:03.057674 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPHtcc3zsjcMKz8cEwRtflxvigEPx-In4JkTl328nJANVUfFz1p2OVDGilrcjY4qMu5vRjW2zvRxzHEswqbzFh2OoPWoz6R7t8Yv16v_mW4D1rWIFDhOB0dmfh2ZT-5VCy_oS_TIFc0c8n-LcarwX378VPTu7Id5dulS6vFtb7m4i7ZQ Oct 04 18:32:03.057674 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:32:03.057674 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:32:03.057674 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:32:03.057674 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:32:03.057674 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:32:03.057674 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:32:03.057674 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 771211a4ce424aa48920ff102c894a9f Oct 04 18:32:03.057674 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ServersOnMultiNodesTest-1893046075 Oct 04 18:32:03.057674 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:32:03.057674 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:32:03.059284 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/771211a4ce424aa48920ff102c894a9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_771211a4ce424aa48920ff102c894a9f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/771211a4ce424aa48920ff102c894a9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/771211a4ce424aa48920ff102c894a9f"}]}] Oct 04 18:32:03.059284 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ServersOnMultiNodesTest-1893046075 Oct 04 18:32:03.059284 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 771211a4ce424aa48920ff102c894a9f Oct 04 18:32:03.059284 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1893046075 Oct 04 18:32:03.059284 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ServersOnMultiNodesTest-1893046075-project Oct 04 18:32:03.059284 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:32:03.059284 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:32:03.059284 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 07dd131fa3c44d439d0f3ec6e4b8ad42 Oct 04 18:32:03.059284 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ServersOnMultiNodesTest-1893046075-project Oct 04 18:32:03.059284 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:32:03.059284 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance fd73ee96-f932-48db-a1b5-664bb9740994 could not be found. Oct 04 18:32:03.059284 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': 'fd73ee96-f932-48db-a1b5-664bb9740994'} Oct 04 18:32:03.060184 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:03.060184 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:03.060184 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:32:03.060184 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:32:03.060184 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:32:03.060184 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:32:03.060184 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:32:03.060184 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:32:03.060184 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:32:03.060184 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:32:03.060184 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd73ee96-f932-48db-a1b5-664bb9740994 could not be found. Oct 04 18:32:03.060184 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:32:03.060184 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:03.060184 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:32:03.060184 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:03.060184 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:03.060184 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:03.060184 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:03.060184 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:03.060184 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:03.061451 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:03.061451 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:32:03.061451 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:32:03.061451 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:32:03.061451 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:32:03.061451 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:32:03.061451 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:32:03.061451 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd73ee96-f932-48db-a1b5-664bb9740994 could not be found. Oct 04 18:32:03.061451 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:32:03.061451 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:03.061451 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:32:03.061451 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:03.061451 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:03.061451 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:03.061451 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:32:03.061451 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:32:03.061451 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd73ee96-f932-48db-a1b5-664bb9740994 could not be found. Oct 04 18:32:03.061451 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:32:03.062653 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4e700213-7cdd-482d-88c2-3d3c77b149cc tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Returning 404 to user: Instance fd73ee96-f932-48db-a1b5-664bb9740994 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:03.062653 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-4e700213-7cdd-482d-88c2-3d3c77b149cc tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/fd73ee96-f932-48db-a1b5-664bb9740994" status: 404 len: 111 microversion: 2.1 time: 0.034180 Oct 04 18:32:03.062653 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 499/1024] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:03 2022] GET /compute/v2.1/servers/fd73ee96-f932-48db-a1b5-664bb9740994 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:32:03.067785 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7e36ca3f-5107-4f20-a659-984b2fc0455b tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:03.068112 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7e36ca3f-5107-4f20-a659-984b2fc0455b tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: 47fc818f-4a40-42b8-9698-0fdbed7631d6] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:03.074101 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-434167c3-5924-47ca-9d07-a25b50f50804 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:03.074707 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7e36ca3f-5107-4f20-a659-984b2fc0455b tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:03.074845 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-434167c3-5924-47ca-9d07-a25b50f50804 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:03.075202 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7e36ca3f-5107-4f20-a659-984b2fc0455b tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:03.075561 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-434167c3-5924-47ca-9d07-a25b50f50804 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:03.075682 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7e36ca3f-5107-4f20-a659-984b2fc0455b tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:03.076376 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7e36ca3f-5107-4f20-a659-984b2fc0455b tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:03.082195 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-434167c3-5924-47ca-9d07-a25b50f50804 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:03.082491 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7e36ca3f-5107-4f20-a659-984b2fc0455b tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:03.082584 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-434167c3-5924-47ca-9d07-a25b50f50804 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:03.082666 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7e36ca3f-5107-4f20-a659-984b2fc0455b tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:03.082745 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-434167c3-5924-47ca-9d07-a25b50f50804 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:03.116150 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7e36ca3f-5107-4f20-a659-984b2fc0455b tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: 47fc818f-4a40-42b8-9698-0fdbed7631d6] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:32:03.251745 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-434167c3-5924-47ca-9d07-a25b50f50804 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:03.261081 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-434167c3-5924-47ca-9d07-a25b50f50804 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/4e1bb5af-9b8b-456f-beb1-aadf2491a8ed" status: 200 len: 1311 microversion: 2.1 time: 0.210717 Oct 04 18:32:03.262250 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 526/1025] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:03 2022] GET /compute/v2.1/servers/4e1bb5af-9b8b-456f-beb1-aadf2491a8ed => generated 1311 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:03.272877 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-5a41d365-6e54-4b3b-b95a-dd26406d2a9f req-8e0c94d0-0582-480e-a8a8-016b5d9af1c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "836f71c5-d859-4d09-9956-922b0bbee3ae", "name": "network-vif-deleted", "tag": "0a037711-4826-46fe-ab3b-3321a329f5e9"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:03.281718 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-5a41d365-6e54-4b3b-b95a-dd26406d2a9f req-8e0c94d0-0582-480e-a8a8-016b5d9af1c8 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:03.282626 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-5a41d365-6e54-4b3b-b95a-dd26406d2a9f req-8e0c94d0-0582-480e-a8a8-016b5d9af1c8 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:03.283289 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-5a41d365-6e54-4b3b-b95a-dd26406d2a9f req-8e0c94d0-0582-480e-a8a8-016b5d9af1c8 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:03.300454 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-5a41d365-6e54-4b3b-b95a-dd26406d2a9f req-8e0c94d0-0582-480e-a8a8-016b5d9af1c8 service nova] Creating event network-vif-deleted:0a037711-4826-46fe-ab3b-3321a329f5e9 for instance 836f71c5-d859-4d09-9956-922b0bbee3ae on n-h1-850501-14 Oct 04 18:32:03.306739 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-5a41d365-6e54-4b3b-b95a-dd26406d2a9f req-8e0c94d0-0582-480e-a8a8-016b5d9af1c8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043020 Oct 04 18:32:03.307346 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 527/1026] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:32:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:03.518759 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6d1201c7-5bca-497f-a137-1957a0ced974 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:03.519867 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-6d1201c7-5bca-497f-a137-1957a0ced974 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] [instance: e17c5b3e-a598-4369-9cf7-027a563e59fa] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:03.530676 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6d1201c7-5bca-497f-a137-1957a0ced974 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:03.531464 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6d1201c7-5bca-497f-a137-1957a0ced974 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:03.532212 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6d1201c7-5bca-497f-a137-1957a0ced974 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:03.533119 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6d1201c7-5bca-497f-a137-1957a0ced974 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:03.533754 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6d1201c7-5bca-497f-a137-1957a0ced974 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:03.534177 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6d1201c7-5bca-497f-a137-1957a0ced974 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:03.568843 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7e36ca3f-5107-4f20-a659-984b2fc0455b tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "DELETE /compute/v2.1/servers/47fc818f-4a40-42b8-9698-0fdbed7631d6" status: 204 len: 0 microversion: 2.1 time: 0.504592 Oct 04 18:32:03.569603 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 500/1027] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:32:03 2022] DELETE /compute/v2.1/servers/47fc818f-4a40-42b8-9698-0fdbed7631d6 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:32:03.577294 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f07a342f-fa9b-4b01-947d-6b69c94f1b6a tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:03.578068 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f07a342f-fa9b-4b01-947d-6b69c94f1b6a tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] [instance: 836f71c5-d859-4d09-9956-922b0bbee3ae] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:03.592560 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f07a342f-fa9b-4b01-947d-6b69c94f1b6a tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:03.593391 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f07a342f-fa9b-4b01-947d-6b69c94f1b6a tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:03.595901 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f07a342f-fa9b-4b01-947d-6b69c94f1b6a tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:03.598104 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f07a342f-fa9b-4b01-947d-6b69c94f1b6a tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:03.598600 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f07a342f-fa9b-4b01-947d-6b69c94f1b6a tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:03.601988 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f07a342f-fa9b-4b01-947d-6b69c94f1b6a tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:03.624321 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-6d1201c7-5bca-497f-a137-1957a0ced974 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f49a275284a7eb714a55c6bdd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e44e7aa06ee4126b5705ba65145ebcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:03.639661 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6d1201c7-5bca-497f-a137-1957a0ced974 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] 10.222.0.20 "GET /compute/v2.1/servers/e17c5b3e-a598-4369-9cf7-027a563e59fa" status: 200 len: 1484 microversion: 2.1 time: 0.126260 Oct 04 18:32:03.640286 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 528/1028] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:03 2022] GET /compute/v2.1/servers/e17c5b3e-a598-4369-9cf7-027a563e59fa => generated 1484 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:03.646926 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-abf71adf-08e1-437e-9406-c92a46379716 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:03.648315 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-abf71adf-08e1-437e-9406-c92a46379716 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: 47fc818f-4a40-42b8-9698-0fdbed7631d6] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:03.654951 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-abf71adf-08e1-437e-9406-c92a46379716 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:03.655991 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-abf71adf-08e1-437e-9406-c92a46379716 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:03.656614 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-abf71adf-08e1-437e-9406-c92a46379716 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:03.657489 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-abf71adf-08e1-437e-9406-c92a46379716 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:03.658112 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-abf71adf-08e1-437e-9406-c92a46379716 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:03.658703 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-abf71adf-08e1-437e-9406-c92a46379716 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:03.705162 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f07a342f-fa9b-4b01-947d-6b69c94f1b6a tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d326c048306423a87ddef70295a75e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1cc290c58149f8988cc3d69aff9efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:03.724938 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f07a342f-fa9b-4b01-947d-6b69c94f1b6a tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] 10.222.0.20 "GET /compute/v2.1/servers/836f71c5-d859-4d09-9956-922b0bbee3ae" status: 200 len: 1301 microversion: 2.1 time: 0.154099 Oct 04 18:32:03.732267 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 501/1029] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:03 2022] GET /compute/v2.1/servers/836f71c5-d859-4d09-9956-922b0bbee3ae => generated 1301 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:03.756003 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-46dbf525-6e0c-4b39-b695-40653c556d40 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:03.756677 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-46dbf525-6e0c-4b39-b695-40653c556d40 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: 6b629ba0-6245-442f-bf1a-ad1c1a3116bc] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:03.769975 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-46dbf525-6e0c-4b39-b695-40653c556d40 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:03.769975 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-46dbf525-6e0c-4b39-b695-40653c556d40 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:03.774784 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-46dbf525-6e0c-4b39-b695-40653c556d40 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:03.775909 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-46dbf525-6e0c-4b39-b695-40653c556d40 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:03.776622 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-46dbf525-6e0c-4b39-b695-40653c556d40 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:03.777161 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-46dbf525-6e0c-4b39-b695-40653c556d40 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:03.860192 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-abf71adf-08e1-437e-9406-c92a46379716 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:03.868866 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-abf71adf-08e1-437e-9406-c92a46379716 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/47fc818f-4a40-42b8-9698-0fdbed7631d6" status: 200 len: 1471 microversion: 2.1 time: 0.226631 Oct 04 18:32:03.869496 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 529/1030] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:03 2022] GET /compute/v2.1/servers/47fc818f-4a40-42b8-9698-0fdbed7631d6 => generated 1471 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:03.887704 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c247f1d9-3d1b-4539-9778-086828194455 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:03.888493 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c247f1d9-3d1b-4539-9778-086828194455 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: 0cd68f0f-4385-45c4-8dd0-8f33a5a9e527] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:03.894854 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c247f1d9-3d1b-4539-9778-086828194455 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:03.895515 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c247f1d9-3d1b-4539-9778-086828194455 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:03.896919 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c247f1d9-3d1b-4539-9778-086828194455 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:03.896919 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c247f1d9-3d1b-4539-9778-086828194455 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:03.898047 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c247f1d9-3d1b-4539-9778-086828194455 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:03.898829 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c247f1d9-3d1b-4539-9778-086828194455 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:03.941950 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-46dbf525-6e0c-4b39-b695-40653c556d40 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:03.954225 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-46dbf525-6e0c-4b39-b695-40653c556d40 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:03.955943 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-46dbf525-6e0c-4b39-b695-40653c556d40 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:03.957575 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-46dbf525-6e0c-4b39-b695-40653c556d40 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/6b629ba0-6245-442f-bf1a-ad1c1a3116bc" status: 200 len: 1567 microversion: 2.25 time: 0.205680 Oct 04 18:32:03.977261 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 502/1031] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:32:03 2022] GET /compute/v2.1/servers/6b629ba0-6245-442f-bf1a-ad1c1a3116bc => generated 1567 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:32:03.982768 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-01f0aa72-9442-4c02-9d9e-7c43e1b3a088 req-95e8b82e-07d8-41fb-b44b-27188a1e8e2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e17c5b3e-a598-4369-9cf7-027a563e59fa", "name": "network-vif-unplugged", "status": "completed", "tag": "2f0b5af6-0cc2-4949-8880-47b512d4f031"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:03.994813 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-01f0aa72-9442-4c02-9d9e-7c43e1b3a088 req-95e8b82e-07d8-41fb-b44b-27188a1e8e2d service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:03.995817 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-01f0aa72-9442-4c02-9d9e-7c43e1b3a088 req-95e8b82e-07d8-41fb-b44b-27188a1e8e2d service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:03.996824 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-01f0aa72-9442-4c02-9d9e-7c43e1b3a088 req-95e8b82e-07d8-41fb-b44b-27188a1e8e2d service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:04.010308 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-01f0aa72-9442-4c02-9d9e-7c43e1b3a088 req-95e8b82e-07d8-41fb-b44b-27188a1e8e2d service nova] Creating event network-vif-unplugged:2f0b5af6-0cc2-4949-8880-47b512d4f031 for instance e17c5b3e-a598-4369-9cf7-027a563e59fa on n-h1-850501-14 Oct 04 18:32:04.016544 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-01f0aa72-9442-4c02-9d9e-7c43e1b3a088 req-95e8b82e-07d8-41fb-b44b-27188a1e8e2d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037260 Oct 04 18:32:04.017492 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 503/1032] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:32:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:04.062752 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c247f1d9-3d1b-4539-9778-086828194455 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:04.071407 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c247f1d9-3d1b-4539-9778-086828194455 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/0cd68f0f-4385-45c4-8dd0-8f33a5a9e527" status: 200 len: 1308 microversion: 2.1 time: 0.188369 Oct 04 18:32:04.072075 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 530/1033] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:03 2022] GET /compute/v2.1/servers/0cd68f0f-4385-45c4-8dd0-8f33a5a9e527 => generated 1308 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:04.286512 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1356a4ad-a52b-4b03-8d98-d6215c37ac17 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:04.287295 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1356a4ad-a52b-4b03-8d98-d6215c37ac17 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 4e1bb5af-9b8b-456f-beb1-aadf2491a8ed] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:04.294987 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1356a4ad-a52b-4b03-8d98-d6215c37ac17 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:04.295603 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1356a4ad-a52b-4b03-8d98-d6215c37ac17 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:04.296042 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1356a4ad-a52b-4b03-8d98-d6215c37ac17 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:04.296762 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1356a4ad-a52b-4b03-8d98-d6215c37ac17 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:04.297246 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1356a4ad-a52b-4b03-8d98-d6215c37ac17 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:04.297670 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1356a4ad-a52b-4b03-8d98-d6215c37ac17 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:04.441756 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1356a4ad-a52b-4b03-8d98-d6215c37ac17 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:04.449936 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1356a4ad-a52b-4b03-8d98-d6215c37ac17 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/4e1bb5af-9b8b-456f-beb1-aadf2491a8ed" status: 200 len: 1494 microversion: 2.1 time: 0.167750 Oct 04 18:32:04.450504 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 504/1034] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:04 2022] GET /compute/v2.1/servers/4e1bb5af-9b8b-456f-beb1-aadf2491a8ed => generated 1494 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:04.473028 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-97cc46a6-f36e-4ea4-9ec8-92744cd61fdb tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:04.473648 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-97cc46a6-f36e-4ea4-9ec8-92744cd61fdb tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] [instance: 4e1bb5af-9b8b-456f-beb1-aadf2491a8ed] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:04.481541 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-97cc46a6-f36e-4ea4-9ec8-92744cd61fdb tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:04.485124 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-97cc46a6-f36e-4ea4-9ec8-92744cd61fdb tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:04.485124 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-97cc46a6-f36e-4ea4-9ec8-92744cd61fdb tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:04.485124 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-97cc46a6-f36e-4ea4-9ec8-92744cd61fdb tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:04.485124 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-97cc46a6-f36e-4ea4-9ec8-92744cd61fdb tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:04.485503 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-97cc46a6-f36e-4ea4-9ec8-92744cd61fdb tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:04.632832 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-97cc46a6-f36e-4ea4-9ec8-92744cd61fdb tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/4e1bb5af-9b8b-456f-beb1-aadf2491a8ed" status: 200 len: 1647 microversion: 2.1 time: 0.163523 Oct 04 18:32:04.633421 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 531/1035] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:04 2022] GET /compute/v2.1/servers/4e1bb5af-9b8b-456f-beb1-aadf2491a8ed => generated 1647 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:04.659536 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2625c825-42b1-4ae8-b82e-2a5949a8207f tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:04.660375 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2625c825-42b1-4ae8-b82e-2a5949a8207f tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] [instance: 4e1bb5af-9b8b-456f-beb1-aadf2491a8ed] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:04.669119 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5fbeffd1-75e8-4036-b6eb-d83ee9f72d20 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:04.670967 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5fbeffd1-75e8-4036-b6eb-d83ee9f72d20 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] [instance: e17c5b3e-a598-4369-9cf7-027a563e59fa] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:04.679854 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2625c825-42b1-4ae8-b82e-2a5949a8207f tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:04.680595 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2625c825-42b1-4ae8-b82e-2a5949a8207f tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:04.682715 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2625c825-42b1-4ae8-b82e-2a5949a8207f tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:04.683791 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2625c825-42b1-4ae8-b82e-2a5949a8207f tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:04.684447 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2625c825-42b1-4ae8-b82e-2a5949a8207f tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:04.685540 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5fbeffd1-75e8-4036-b6eb-d83ee9f72d20 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:04.685758 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2625c825-42b1-4ae8-b82e-2a5949a8207f tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:04.686378 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5fbeffd1-75e8-4036-b6eb-d83ee9f72d20 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:04.686913 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5fbeffd1-75e8-4036-b6eb-d83ee9f72d20 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:04.688429 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5fbeffd1-75e8-4036-b6eb-d83ee9f72d20 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:04.689254 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5fbeffd1-75e8-4036-b6eb-d83ee9f72d20 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:04.689852 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5fbeffd1-75e8-4036-b6eb-d83ee9f72d20 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:04.739775 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5fbeffd1-75e8-4036-b6eb-d83ee9f72d20 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:04.740287 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5fbeffd1-75e8-4036-b6eb-d83ee9f72d20 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:04.740719 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5fbeffd1-75e8-4036-b6eb-d83ee9f72d20 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:04.741441 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-5fbeffd1-75e8-4036-b6eb-d83ee9f72d20 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lazy-loading 'fault' on Instance uuid e17c5b3e-a598-4369-9cf7-027a563e59fa {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:32:04.743553 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:04.804759 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5fbeffd1-75e8-4036-b6eb-d83ee9f72d20 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f49a275284a7eb714a55c6bdd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e44e7aa06ee4126b5705ba65145ebcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:04.812836 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5fbeffd1-75e8-4036-b6eb-d83ee9f72d20 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] 10.222.0.20 "GET /compute/v2.1/servers/e17c5b3e-a598-4369-9cf7-027a563e59fa" status: 200 len: 1314 microversion: 2.1 time: 0.150075 Oct 04 18:32:04.813395 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 532/1036] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:04 2022] GET /compute/v2.1/servers/e17c5b3e-a598-4369-9cf7-027a563e59fa => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:32:04.818268 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-40685ea9-0823-4cc2-a919-b8419b5dee82 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:04.819674 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-40685ea9-0823-4cc2-a919-b8419b5dee82 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] [instance: 836f71c5-d859-4d09-9956-922b0bbee3ae] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:04.826724 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-40685ea9-0823-4cc2-a919-b8419b5dee82 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:04.826724 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-40685ea9-0823-4cc2-a919-b8419b5dee82 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:04.827120 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-40685ea9-0823-4cc2-a919-b8419b5dee82 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:04.827754 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-40685ea9-0823-4cc2-a919-b8419b5dee82 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:04.828323 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-40685ea9-0823-4cc2-a919-b8419b5dee82 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:04.828814 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-40685ea9-0823-4cc2-a919-b8419b5dee82 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:04.863281 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-40685ea9-0823-4cc2-a919-b8419b5dee82 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:04.863863 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-40685ea9-0823-4cc2-a919-b8419b5dee82 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:04.864533 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-40685ea9-0823-4cc2-a919-b8419b5dee82 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:04.864969 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-40685ea9-0823-4cc2-a919-b8419b5dee82 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Lazy-loading 'fault' on Instance uuid 836f71c5-d859-4d09-9956-922b0bbee3ae {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:32:04.874486 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2625c825-42b1-4ae8-b82e-2a5949a8207f tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/4e1bb5af-9b8b-456f-beb1-aadf2491a8ed" status: 200 len: 1647 microversion: 2.1 time: 0.220795 Oct 04 18:32:04.875074 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 505/1037] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:04 2022] GET /compute/v2.1/servers/4e1bb5af-9b8b-456f-beb1-aadf2491a8ed => generated 1647 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:04.894852 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ecc0c79b-7963-4790-8ae4-8fc6d93a4e50 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:04.895452 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ecc0c79b-7963-4790-8ae4-8fc6d93a4e50 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: 47fc818f-4a40-42b8-9698-0fdbed7631d6] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:04.903935 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ecc0c79b-7963-4790-8ae4-8fc6d93a4e50 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:04.904396 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ecc0c79b-7963-4790-8ae4-8fc6d93a4e50 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:04.904932 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ecc0c79b-7963-4790-8ae4-8fc6d93a4e50 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:04.905643 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ecc0c79b-7963-4790-8ae4-8fc6d93a4e50 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:04.906428 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ecc0c79b-7963-4790-8ae4-8fc6d93a4e50 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:04.907181 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ecc0c79b-7963-4790-8ae4-8fc6d93a4e50 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:04.915048 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-40685ea9-0823-4cc2-a919-b8419b5dee82 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d326c048306423a87ddef70295a75e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1cc290c58149f8988cc3d69aff9efd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:04.922899 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-40685ea9-0823-4cc2-a919-b8419b5dee82 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] 10.222.0.20 "GET /compute/v2.1/servers/836f71c5-d859-4d09-9956-922b0bbee3ae" status: 200 len: 1306 microversion: 2.1 time: 0.108522 Oct 04 18:32:04.923479 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 533/1038] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:04 2022] GET /compute/v2.1/servers/836f71c5-d859-4d09-9956-922b0bbee3ae => generated 1306 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:04.927846 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-bcbfefe4-28c0-425d-80c1-39524c823988 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:04.932132 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bcbfefe4-28c0-425d-80c1-39524c823988 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:04.932626 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bcbfefe4-28c0-425d-80c1-39524c823988 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:04.933116 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bcbfefe4-28c0-425d-80c1-39524c823988 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:04.933833 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bcbfefe4-28c0-425d-80c1-39524c823988 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:04.934289 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bcbfefe4-28c0-425d-80c1-39524c823988 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:04.934717 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bcbfefe4-28c0-425d-80c1-39524c823988 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:04.961353 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-bcbfefe4-28c0-425d-80c1-39524c823988 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.036819 Oct 04 18:32:04.964116 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 534/1039] 10.222.0.20 () {58 vars in 1176 bytes} [Tue Oct 4 18:32:04 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:04.975668 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d11651c8-6841-4a0d-9bd6-9743d287e0ca tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:04.976652 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d11651c8-6841-4a0d-9bd6-9743d287e0ca tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] [instance: 4e1bb5af-9b8b-456f-beb1-aadf2491a8ed] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:04.983646 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d11651c8-6841-4a0d-9bd6-9743d287e0ca tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:04.985647 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d11651c8-6841-4a0d-9bd6-9743d287e0ca tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:04.985647 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d11651c8-6841-4a0d-9bd6-9743d287e0ca tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:04.985647 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d11651c8-6841-4a0d-9bd6-9743d287e0ca tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:04.986031 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d11651c8-6841-4a0d-9bd6-9743d287e0ca tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:04.993458 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d11651c8-6841-4a0d-9bd6-9743d287e0ca tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:05.063056 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ecc0c79b-7963-4790-8ae4-8fc6d93a4e50 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:05.070997 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ecc0c79b-7963-4790-8ae4-8fc6d93a4e50 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/47fc818f-4a40-42b8-9698-0fdbed7631d6" status: 200 len: 1471 microversion: 2.1 time: 0.180096 Oct 04 18:32:05.071633 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 506/1040] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:04 2022] GET /compute/v2.1/servers/47fc818f-4a40-42b8-9698-0fdbed7631d6 => generated 1471 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:32:05.076094 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ac69f2cd-8a38-4a8e-bfa6-428655e59a77 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:05.076693 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ac69f2cd-8a38-4a8e-bfa6-428655e59a77 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: 6b629ba0-6245-442f-bf1a-ad1c1a3116bc] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:05.082409 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ac69f2cd-8a38-4a8e-bfa6-428655e59a77 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:05.082948 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ac69f2cd-8a38-4a8e-bfa6-428655e59a77 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:05.083333 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ac69f2cd-8a38-4a8e-bfa6-428655e59a77 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:05.085138 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ac69f2cd-8a38-4a8e-bfa6-428655e59a77 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:05.085699 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ac69f2cd-8a38-4a8e-bfa6-428655e59a77 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:05.086129 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ac69f2cd-8a38-4a8e-bfa6-428655e59a77 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:05.265493 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d11651c8-6841-4a0d-9bd6-9743d287e0ca tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/4e1bb5af-9b8b-456f-beb1-aadf2491a8ed/action" status: 202 len: 0 microversion: 2.1 time: 0.295078 Oct 04 18:32:05.267513 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 535/1041] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:32:04 2022] POST /compute/v2.1/servers/4e1bb5af-9b8b-456f-beb1-aadf2491a8ed/action => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:32:05.275487 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-086dfdcc-040a-43b6-8be1-fa2c48c59f0c tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:05.276743 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-086dfdcc-040a-43b6-8be1-fa2c48c59f0c tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: 0cd68f0f-4385-45c4-8dd0-8f33a5a9e527] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:05.285106 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-086dfdcc-040a-43b6-8be1-fa2c48c59f0c tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:05.285946 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-086dfdcc-040a-43b6-8be1-fa2c48c59f0c tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:05.286582 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-086dfdcc-040a-43b6-8be1-fa2c48c59f0c tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:05.289091 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-086dfdcc-040a-43b6-8be1-fa2c48c59f0c tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:05.289927 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-086dfdcc-040a-43b6-8be1-fa2c48c59f0c tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:05.290545 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-086dfdcc-040a-43b6-8be1-fa2c48c59f0c tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:05.554397 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ac69f2cd-8a38-4a8e-bfa6-428655e59a77 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:05.561138 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-086dfdcc-040a-43b6-8be1-fa2c48c59f0c tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:05.564907 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ac69f2cd-8a38-4a8e-bfa6-428655e59a77 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:05.566388 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ac69f2cd-8a38-4a8e-bfa6-428655e59a77 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:05.567552 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ac69f2cd-8a38-4a8e-bfa6-428655e59a77 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/6b629ba0-6245-442f-bf1a-ad1c1a3116bc" status: 200 len: 1567 microversion: 2.25 time: 0.494970 Oct 04 18:32:05.569938 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 507/1042] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:32:05 2022] GET /compute/v2.1/servers/6b629ba0-6245-442f-bf1a-ad1c1a3116bc => generated 1567 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:32:05.571032 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-086dfdcc-040a-43b6-8be1-fa2c48c59f0c tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/0cd68f0f-4385-45c4-8dd0-8f33a5a9e527" status: 200 len: 1308 microversion: 2.1 time: 0.301759 Oct 04 18:32:05.594343 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 536/1043] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:05 2022] GET /compute/v2.1/servers/0cd68f0f-4385-45c4-8dd0-8f33a5a9e527 => generated 1308 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:05.594510 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-bbe598b5-592b-4be7-9f74-7b0d75c9fa5f tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:05.594619 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-1b44567c-b22b-4c8b-a83c-c4c8812487cc req-4c8cd2d2-5691-466a-b3cc-492e99214245 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e17c5b3e-a598-4369-9cf7-027a563e59fa", "name": "network-vif-deleted", "tag": "2f0b5af6-0cc2-4949-8880-47b512d4f031"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:05.594713 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-bbe598b5-592b-4be7-9f74-7b0d75c9fa5f tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] [instance: 4e1bb5af-9b8b-456f-beb1-aadf2491a8ed] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:05.594713 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bbe598b5-592b-4be7-9f74-7b0d75c9fa5f tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:05.594713 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bbe598b5-592b-4be7-9f74-7b0d75c9fa5f tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:05.594713 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bbe598b5-592b-4be7-9f74-7b0d75c9fa5f tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:05.595066 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bbe598b5-592b-4be7-9f74-7b0d75c9fa5f tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:05.595066 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bbe598b5-592b-4be7-9f74-7b0d75c9fa5f tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:05.595066 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bbe598b5-592b-4be7-9f74-7b0d75c9fa5f tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:05.598200 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-1b44567c-b22b-4c8b-a83c-c4c8812487cc req-4c8cd2d2-5691-466a-b3cc-492e99214245 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:05.598776 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-1b44567c-b22b-4c8b-a83c-c4c8812487cc req-4c8cd2d2-5691-466a-b3cc-492e99214245 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:05.599903 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-1b44567c-b22b-4c8b-a83c-c4c8812487cc req-4c8cd2d2-5691-466a-b3cc-492e99214245 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:05.613106 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-1b44567c-b22b-4c8b-a83c-c4c8812487cc req-4c8cd2d2-5691-466a-b3cc-492e99214245 service nova] Creating event network-vif-deleted:2f0b5af6-0cc2-4949-8880-47b512d4f031 for instance e17c5b3e-a598-4369-9cf7-027a563e59fa on n-h1-850501-14 Oct 04 18:32:05.618442 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-1b44567c-b22b-4c8b-a83c-c4c8812487cc req-4c8cd2d2-5691-466a-b3cc-492e99214245 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045620 Oct 04 18:32:05.619389 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 537/1044] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:32:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:05.725586 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-bbe598b5-592b-4be7-9f74-7b0d75c9fa5f tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/4e1bb5af-9b8b-456f-beb1-aadf2491a8ed" status: 200 len: 1652 microversion: 2.1 time: 0.155376 Oct 04 18:32:05.726316 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 508/1045] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:05 2022] GET /compute/v2.1/servers/4e1bb5af-9b8b-456f-beb1-aadf2491a8ed => generated 1652 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:05.838637 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8fad3e71-bac1-4d76-ac33-f599a2360baf tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:05.839355 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8fad3e71-bac1-4d76-ac33-f599a2360baf tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] [instance: e17c5b3e-a598-4369-9cf7-027a563e59fa] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:05.845876 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8fad3e71-bac1-4d76-ac33-f599a2360baf tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:05.846363 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8fad3e71-bac1-4d76-ac33-f599a2360baf tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:05.846800 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8fad3e71-bac1-4d76-ac33-f599a2360baf tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:05.847495 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8fad3e71-bac1-4d76-ac33-f599a2360baf tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:05.848092 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8fad3e71-bac1-4d76-ac33-f599a2360baf tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:05.848520 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8fad3e71-bac1-4d76-ac33-f599a2360baf tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:05.863512 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-8fad3e71-bac1-4d76-ac33-f599a2360baf tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] HTTP exception thrown: Instance e17c5b3e-a598-4369-9cf7-027a563e59fa could not be found. Oct 04 18:32:05.865210 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8fad3e71-bac1-4d76-ac33-f599a2360baf tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Request method failure captured: Oct 04 18:32:05.865210 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/e17c5b3e-a598-4369-9cf7-027a563e59fa HTTP/1.1 Oct 04 18:32:05.865210 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:32:05.865210 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:32:05.865210 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:32:05.865210 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:32:05.865210 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:32:05.865210 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:32:05.865210 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:32:05.865210 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:05.865210 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPHvII_T7EcjvuInFv4t5qVF70S9vjGBK66HvfyVnOiY_TVbsAPYjguHISQjMiOeT1bz8CjLq7zDrG77IXy0kQULYEqIfKm3jlSWTKPDcogOtbqbQpds3d11ZgBfbFr39fSjqioDU_0CmuRBwgkz6wZ-Zh6uUaL8av5rXkIBhSk0fN1E Oct 04 18:32:05.865210 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:32:05.865210 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:32:05.865210 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:32:05.865210 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:32:05.865210 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:32:05.865210 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:32:05.865210 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 7e44e7aa06ee4126b5705ba65145ebcc Oct 04 18:32:05.865210 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1566997612 Oct 04 18:32:05.865210 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:32:05.865210 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:32:05.867067 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e44e7aa06ee4126b5705ba65145ebcc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7e44e7aa06ee4126b5705ba65145ebcc", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7e44e7aa06ee4126b5705ba65145ebcc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e44e7aa06ee4126b5705ba65145ebcc"}]}] Oct 04 18:32:05.867067 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1566997612 Oct 04 18:32:05.867067 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 7e44e7aa06ee4126b5705ba65145ebcc Oct 04 18:32:05.867067 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1566997612 Oct 04 18:32:05.867067 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ImagesOneServerNegativeTestJSON-1566997612-project Oct 04 18:32:05.867067 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:32:05.867067 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:32:05.867067 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 415f49a275284a7eb714a55c6bdd0005 Oct 04 18:32:05.867067 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1566997612-project Oct 04 18:32:05.867067 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:32:05.867067 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance e17c5b3e-a598-4369-9cf7-027a563e59fa could not be found. Oct 04 18:32:05.867067 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'e17c5b3e-a598-4369-9cf7-027a563e59fa'} Oct 04 18:32:05.867896 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:05.867896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:05.867896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:32:05.867896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:32:05.867896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:32:05.867896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:32:05.867896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:32:05.867896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:32:05.867896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:32:05.867896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:32:05.867896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e17c5b3e-a598-4369-9cf7-027a563e59fa could not be found. Oct 04 18:32:05.867896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:05.867896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:05.867896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:05.867896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:05.867896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:05.867896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:05.867896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:05.867896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:05.867896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:05.869194 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:05.869194 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:32:05.869194 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:32:05.869194 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:32:05.869194 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:32:05.869194 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:32:05.869194 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:32:05.869194 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e17c5b3e-a598-4369-9cf7-027a563e59fa could not be found. Oct 04 18:32:05.869194 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:05.869194 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:05.869194 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:05.869194 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:05.869194 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:05.869194 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:05.869194 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:32:05.869194 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:32:05.869194 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e17c5b3e-a598-4369-9cf7-027a563e59fa could not be found. Oct 04 18:32:05.869194 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:05.870331 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8fad3e71-bac1-4d76-ac33-f599a2360baf tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Returning 404 to user: Instance e17c5b3e-a598-4369-9cf7-027a563e59fa could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:05.870331 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8fad3e71-bac1-4d76-ac33-f599a2360baf tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] 10.222.0.20 "GET /compute/v2.1/servers/e17c5b3e-a598-4369-9cf7-027a563e59fa" status: 404 len: 111 microversion: 2.1 time: 0.033316 Oct 04 18:32:05.870331 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 538/1046] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:05 2022] GET /compute/v2.1/servers/e17c5b3e-a598-4369-9cf7-027a563e59fa => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:32:05.946966 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-520deb8b-7958-4167-960a-b4b1d8753074 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:05.947581 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-520deb8b-7958-4167-960a-b4b1d8753074 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] [instance: 836f71c5-d859-4d09-9956-922b0bbee3ae] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:05.953627 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-520deb8b-7958-4167-960a-b4b1d8753074 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:05.954115 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-520deb8b-7958-4167-960a-b4b1d8753074 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:05.954553 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-520deb8b-7958-4167-960a-b4b1d8753074 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:05.955254 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-520deb8b-7958-4167-960a-b4b1d8753074 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:05.955744 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-520deb8b-7958-4167-960a-b4b1d8753074 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:05.956345 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-520deb8b-7958-4167-960a-b4b1d8753074 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:05.971027 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7bd55f51-0d4e-427d-afa9-0205303f20e1 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-447260081", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:05.971327 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-520deb8b-7958-4167-960a-b4b1d8753074 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] HTTP exception thrown: Instance 836f71c5-d859-4d09-9956-922b0bbee3ae could not be found. Oct 04 18:32:05.973370 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-520deb8b-7958-4167-960a-b4b1d8753074 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Request method failure captured: Oct 04 18:32:05.973370 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/836f71c5-d859-4d09-9956-922b0bbee3ae HTTP/1.1 Oct 04 18:32:05.973370 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:32:05.973370 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:32:05.973370 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:32:05.973370 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:32:05.973370 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:32:05.973370 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:32:05.973370 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:32:05.973370 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:05.973370 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPHvPs-hoO6h1u8p_Qc-pLi13ZzHgIAT1oVlmQY3t1RumfesDNmfdobG4KO8dFu0rZN_lRHyEWO51xZpbAn_dbTF8tqV_v7VBVkBqMRaAhO84mSRF82fX8xl2t-D9hIqQ0hZq0w-H18y9tDBeFjbxg1OAr8voiifQx2Nqamk8eHp9ltI Oct 04 18:32:05.973370 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:32:05.973370 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:32:05.973370 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:32:05.973370 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:32:05.973370 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:32:05.973370 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:32:05.973370 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 5a1cc290c58149f8988cc3d69aff9efd Oct 04 18:32:05.973370 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ImagesOneServerTestJSON-1597051758 Oct 04 18:32:05.973370 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:32:05.973370 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:32:05.974990 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5a1cc290c58149f8988cc3d69aff9efd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5a1cc290c58149f8988cc3d69aff9efd", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5a1cc290c58149f8988cc3d69aff9efd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5a1cc290c58149f8988cc3d69aff9efd"}]}] Oct 04 18:32:05.974990 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ImagesOneServerTestJSON-1597051758 Oct 04 18:32:05.974990 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 5a1cc290c58149f8988cc3d69aff9efd Oct 04 18:32:05.974990 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1597051758 Oct 04 18:32:05.974990 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ImagesOneServerTestJSON-1597051758-project Oct 04 18:32:05.974990 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:32:05.974990 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:32:05.974990 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 1d326c048306423a87ddef70295a75e0 Oct 04 18:32:05.974990 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ImagesOneServerTestJSON-1597051758-project Oct 04 18:32:05.974990 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:32:05.974990 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 836f71c5-d859-4d09-9956-922b0bbee3ae could not be found. Oct 04 18:32:05.974990 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '836f71c5-d859-4d09-9956-922b0bbee3ae'} Oct 04 18:32:05.976448 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:05.976448 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:05.976448 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:32:05.976448 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:32:05.976448 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:32:05.976448 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:32:05.976448 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:32:05.976448 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:32:05.976448 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:32:05.976448 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:32:05.976448 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 836f71c5-d859-4d09-9956-922b0bbee3ae could not be found. Oct 04 18:32:05.976448 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:32:05.976448 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:05.976448 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:32:05.976448 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:05.976448 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:05.976448 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:05.976448 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:05.976448 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:05.976448 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:05.977874 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:05.977874 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:32:05.977874 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:32:05.977874 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:32:05.977874 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:32:05.977874 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:32:05.977874 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:32:05.977874 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 836f71c5-d859-4d09-9956-922b0bbee3ae could not be found. Oct 04 18:32:05.977874 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:32:05.977874 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:05.977874 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:32:05.977874 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:05.977874 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:05.977874 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:05.977874 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:32:05.977874 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:32:05.977874 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 836f71c5-d859-4d09-9956-922b0bbee3ae could not be found. Oct 04 18:32:05.977874 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:32:05.979288 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-520deb8b-7958-4167-960a-b4b1d8753074 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] Returning 404 to user: Instance 836f71c5-d859-4d09-9956-922b0bbee3ae could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:05.979288 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-520deb8b-7958-4167-960a-b4b1d8753074 tempest-ImagesOneServerTestJSON-1597051758 tempest-ImagesOneServerTestJSON-1597051758-project] 10.222.0.20 "GET /compute/v2.1/servers/836f71c5-d859-4d09-9956-922b0bbee3ae" status: 404 len: 111 microversion: 2.1 time: 0.034789 Oct 04 18:32:05.982881 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 509/1047] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:05 2022] GET /compute/v2.1/servers/836f71c5-d859-4d09-9956-922b0bbee3ae => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:32:06.031719 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-7bd55f51-0d4e-427d-afa9-0205303f20e1 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] validate_networks() for [('51e9c15f-99f8-4dc7-83c1-3f0cf4949f12', None, None, None, None, None)] {{(pid=123002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:32:06.094832 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-600b3043-14ae-44b3-baea-70fd72429c6c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:06.095504 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-600b3043-14ae-44b3-baea-70fd72429c6c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: 47fc818f-4a40-42b8-9698-0fdbed7631d6] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:06.102308 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-600b3043-14ae-44b3-baea-70fd72429c6c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:06.102802 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-600b3043-14ae-44b3-baea-70fd72429c6c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:06.103243 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-600b3043-14ae-44b3-baea-70fd72429c6c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:06.103947 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-600b3043-14ae-44b3-baea-70fd72429c6c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:06.104437 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-600b3043-14ae-44b3-baea-70fd72429c6c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:06.104861 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-600b3043-14ae-44b3-baea-70fd72429c6c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:06.394340 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-600b3043-14ae-44b3-baea-70fd72429c6c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:06.414193 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-600b3043-14ae-44b3-baea-70fd72429c6c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/47fc818f-4a40-42b8-9698-0fdbed7631d6" status: 200 len: 1471 microversion: 2.1 time: 0.323276 Oct 04 18:32:06.415029 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 510/1048] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:06 2022] GET /compute/v2.1/servers/47fc818f-4a40-42b8-9698-0fdbed7631d6 => generated 1471 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:32:06.607365 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d4a78514-df84-4017-8027-bc2094271b1f tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:06.609224 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d4a78514-df84-4017-8027-bc2094271b1f tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: 0cd68f0f-4385-45c4-8dd0-8f33a5a9e527] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:06.641574 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d4a78514-df84-4017-8027-bc2094271b1f tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:06.642289 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d4a78514-df84-4017-8027-bc2094271b1f tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:06.644129 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d4a78514-df84-4017-8027-bc2094271b1f tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:06.645160 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d4a78514-df84-4017-8027-bc2094271b1f tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:06.645883 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d4a78514-df84-4017-8027-bc2094271b1f tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:06.652428 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d4a78514-df84-4017-8027-bc2094271b1f tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:06.857599 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-7bd55f51-0d4e-427d-afa9-0205303f20e1 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:32:06.858772 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-7bd55f51-0d4e-427d-afa9-0205303f20e1 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:32:06.865593 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-7bd55f51-0d4e-427d-afa9-0205303f20e1 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:32:06.865593 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-7bd55f51-0d4e-427d-afa9-0205303f20e1 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:32:06.865593 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-7bd55f51-0d4e-427d-afa9-0205303f20e1 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:32:06.879584 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d4a78514-df84-4017-8027-bc2094271b1f tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:06.887302 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7bd55f51-0d4e-427d-afa9-0205303f20e1 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:06.887302 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7bd55f51-0d4e-427d-afa9-0205303f20e1 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:06.887302 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7bd55f51-0d4e-427d-afa9-0205303f20e1 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:06.887302 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7bd55f51-0d4e-427d-afa9-0205303f20e1 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:06.887635 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7bd55f51-0d4e-427d-afa9-0205303f20e1 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:06.889469 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7bd55f51-0d4e-427d-afa9-0205303f20e1 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:06.907695 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d4a78514-df84-4017-8027-bc2094271b1f tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/0cd68f0f-4385-45c4-8dd0-8f33a5a9e527" status: 200 len: 1308 microversion: 2.1 time: 0.307332 Oct 04 18:32:06.909876 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 511/1049] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:06 2022] GET /compute/v2.1/servers/0cd68f0f-4385-45c4-8dd0-8f33a5a9e527 => generated 1308 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:06.922300 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-7bd55f51-0d4e-427d-afa9-0205303f20e1 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Getting quotas for project 7e44e7aa06ee4126b5705ba65145ebcc. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:32:06.922787 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5d4f63a1-4359-4231-a36c-fde3d1a30e65 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:06.924519 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5d4f63a1-4359-4231-a36c-fde3d1a30e65 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: 6b629ba0-6245-442f-bf1a-ad1c1a3116bc] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:06.929296 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-7bd55f51-0d4e-427d-afa9-0205303f20e1 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Getting quotas for user 415f49a275284a7eb714a55c6bdd0005 and project 7e44e7aa06ee4126b5705ba65145ebcc. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:32:06.946867 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5d4f63a1-4359-4231-a36c-fde3d1a30e65 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:06.947586 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5d4f63a1-4359-4231-a36c-fde3d1a30e65 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:06.949819 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5d4f63a1-4359-4231-a36c-fde3d1a30e65 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:06.951408 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5d4f63a1-4359-4231-a36c-fde3d1a30e65 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:06.954322 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5d4f63a1-4359-4231-a36c-fde3d1a30e65 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:06.954928 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5d4f63a1-4359-4231-a36c-fde3d1a30e65 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:06.961044 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7bd55f51-0d4e-427d-afa9-0205303f20e1 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Going to run 1 instances... {{(pid=123002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:32:06.965788 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7bd55f51-0d4e-427d-afa9-0205303f20e1 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] [instance: 156c9c3a-ac54-4499-91fe-161cffddbf12] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:32:07.011383 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:INSERT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:07.141411 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5d4f63a1-4359-4231-a36c-fde3d1a30e65 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:07.151936 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5d4f63a1-4359-4231-a36c-fde3d1a30e65 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:07.153402 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5d4f63a1-4359-4231-a36c-fde3d1a30e65 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:07.154574 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5d4f63a1-4359-4231-a36c-fde3d1a30e65 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/6b629ba0-6245-442f-bf1a-ad1c1a3116bc" status: 200 len: 1567 microversion: 2.25 time: 0.243102 Oct 04 18:32:07.155320 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 512/1050] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:32:06 2022] GET /compute/v2.1/servers/6b629ba0-6245-442f-bf1a-ad1c1a3116bc => generated 1567 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:32:07.171032 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-54d61a8d-7225-4bfe-a445-ed41a67a37e8 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:07.174756 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-54d61a8d-7225-4bfe-a445-ed41a67a37e8 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] [instance: 4e1bb5af-9b8b-456f-beb1-aadf2491a8ed] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:07.182337 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7bd55f51-0d4e-427d-afa9-0205303f20e1 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.215415 Oct 04 18:32:07.185184 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 539/1051] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:32:05 2022] POST /compute/v2.1/servers => generated 383 bytes in 1219 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 18:32:07.192209 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-54d61a8d-7225-4bfe-a445-ed41a67a37e8 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:07.192902 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-54d61a8d-7225-4bfe-a445-ed41a67a37e8 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:07.193492 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-54d61a8d-7225-4bfe-a445-ed41a67a37e8 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:07.194951 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-54d61a8d-7225-4bfe-a445-ed41a67a37e8 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:07.195670 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-ed6d5270-91f6-41f1-8774-e463d2052163 req-ae2d5b31-82a9-4bad-bf18-83f46db042e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47fc818f-4a40-42b8-9698-0fdbed7631d6", "name": "network-vif-deleted", "tag": "d975cead-350a-43ad-9299-eb99afd70ae5"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:07.196379 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-54d61a8d-7225-4bfe-a445-ed41a67a37e8 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:07.198673 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-54d61a8d-7225-4bfe-a445-ed41a67a37e8 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:07.219750 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-ed6d5270-91f6-41f1-8774-e463d2052163 req-ae2d5b31-82a9-4bad-bf18-83f46db042e8 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:07.224287 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-ed6d5270-91f6-41f1-8774-e463d2052163 req-ae2d5b31-82a9-4bad-bf18-83f46db042e8 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:07.224823 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-ed6d5270-91f6-41f1-8774-e463d2052163 req-ae2d5b31-82a9-4bad-bf18-83f46db042e8 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:07.251627 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-ed6d5270-91f6-41f1-8774-e463d2052163 req-ae2d5b31-82a9-4bad-bf18-83f46db042e8 service nova] Creating event network-vif-deleted:d975cead-350a-43ad-9299-eb99afd70ae5 for instance 47fc818f-4a40-42b8-9698-0fdbed7631d6 on n-h2-850501-14 Oct 04 18:32:07.264599 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-ed6d5270-91f6-41f1-8774-e463d2052163 req-ae2d5b31-82a9-4bad-bf18-83f46db042e8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076840 Oct 04 18:32:07.269662 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 540/1052] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:32:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:07.277531 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-117db6ce-ed48-4897-837c-7fe8c3d5939d req-dd9d17cf-47b2-4b21-aace-5a94420edc54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cd68f0f-4385-45c4-8dd0-8f33a5a9e527", "name": "network-vif-plugged", "status": "completed", "tag": "e0c9983a-03a1-4137-9aaf-8dc3ac6e4cb0"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:07.290016 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-117db6ce-ed48-4897-837c-7fe8c3d5939d req-dd9d17cf-47b2-4b21-aace-5a94420edc54 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:07.290772 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-117db6ce-ed48-4897-837c-7fe8c3d5939d req-dd9d17cf-47b2-4b21-aace-5a94420edc54 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:07.291439 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-117db6ce-ed48-4897-837c-7fe8c3d5939d req-dd9d17cf-47b2-4b21-aace-5a94420edc54 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:07.309728 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-117db6ce-ed48-4897-837c-7fe8c3d5939d req-dd9d17cf-47b2-4b21-aace-5a94420edc54 service nova] Creating event network-vif-plugged:e0c9983a-03a1-4137-9aaf-8dc3ac6e4cb0 for instance 0cd68f0f-4385-45c4-8dd0-8f33a5a9e527 on n-h2-850501-14 Oct 04 18:32:07.329856 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-117db6ce-ed48-4897-837c-7fe8c3d5939d req-dd9d17cf-47b2-4b21-aace-5a94420edc54 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050824 Oct 04 18:32:07.329856 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 541/1053] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:32:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:07.331727 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b8410f39-7f55-40c2-8a4e-6f993efc7889 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:07.333329 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b8410f39-7f55-40c2-8a4e-6f993efc7889 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] [instance: 156c9c3a-ac54-4499-91fe-161cffddbf12] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:07.485715 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b8410f39-7f55-40c2-8a4e-6f993efc7889 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f49a275284a7eb714a55c6bdd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e44e7aa06ee4126b5705ba65145ebcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:07.531520 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b8410f39-7f55-40c2-8a4e-6f993efc7889 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] 10.222.0.20 "GET /compute/v2.1/servers/156c9c3a-ac54-4499-91fe-161cffddbf12" status: 200 len: 1224 microversion: 2.1 time: 0.207132 Oct 04 18:32:07.536913 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 542/1054] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:07 2022] GET /compute/v2.1/servers/156c9c3a-ac54-4499-91fe-161cffddbf12 => generated 1224 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:07.557411 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0fd26de2-5cf8-4382-bcfa-df02105df646 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:07.558045 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0fd26de2-5cf8-4382-bcfa-df02105df646 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: 47fc818f-4a40-42b8-9698-0fdbed7631d6] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:07.587078 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-54d61a8d-7225-4bfe-a445-ed41a67a37e8 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/4e1bb5af-9b8b-456f-beb1-aadf2491a8ed" status: 200 len: 1632 microversion: 2.1 time: 0.427958 Oct 04 18:32:07.593632 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0fd26de2-5cf8-4382-bcfa-df02105df646 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:07.597298 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0fd26de2-5cf8-4382-bcfa-df02105df646 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:07.597759 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0fd26de2-5cf8-4382-bcfa-df02105df646 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:07.600046 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0fd26de2-5cf8-4382-bcfa-df02105df646 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:07.602321 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0fd26de2-5cf8-4382-bcfa-df02105df646 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:07.602946 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0fd26de2-5cf8-4382-bcfa-df02105df646 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:07.606557 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 513/1055] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:07 2022] GET /compute/v2.1/servers/4e1bb5af-9b8b-456f-beb1-aadf2491a8ed => generated 1632 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:07.612113 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-224b5614-0750-4444-ac40-78f569a18210 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-850501-14", "block_migration": true, "disk_over_commit": false}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:07.618184 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-224b5614-0750-4444-ac40-78f569a18210 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] [instance: 4e1bb5af-9b8b-456f-beb1-aadf2491a8ed] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:07.626118 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-224b5614-0750-4444-ac40-78f569a18210 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:07.627152 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-224b5614-0750-4444-ac40-78f569a18210 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:07.627746 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-224b5614-0750-4444-ac40-78f569a18210 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:07.628682 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-224b5614-0750-4444-ac40-78f569a18210 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:07.629415 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-224b5614-0750-4444-ac40-78f569a18210 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:07.630033 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-224b5614-0750-4444-ac40-78f569a18210 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:07.662139 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-224b5614-0750-4444-ac40-78f569a18210 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lazy-loading 'flavor' on Instance uuid 4e1bb5af-9b8b-456f-beb1-aadf2491a8ed {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:32:07.679927 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-224b5614-0750-4444-ac40-78f569a18210 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] [instance: 4e1bb5af-9b8b-456f-beb1-aadf2491a8ed] Going to try to live migrate instance to n-h2-850501-14 {{(pid=123001) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 18:32:07.685843 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:07.708894 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0fd26de2-5cf8-4382-bcfa-df02105df646 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:07.721371 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0fd26de2-5cf8-4382-bcfa-df02105df646 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:07.722345 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0fd26de2-5cf8-4382-bcfa-df02105df646 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:07.722467 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-0fd26de2-5cf8-4382-bcfa-df02105df646 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lazy-loading 'fault' on Instance uuid 47fc818f-4a40-42b8-9698-0fdbed7631d6 {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:32:07.775205 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0fd26de2-5cf8-4382-bcfa-df02105df646 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:07.783949 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0fd26de2-5cf8-4382-bcfa-df02105df646 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/47fc818f-4a40-42b8-9698-0fdbed7631d6" status: 200 len: 1306 microversion: 2.1 time: 0.244812 Oct 04 18:32:07.784547 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 543/1056] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:07 2022] GET /compute/v2.1/servers/47fc818f-4a40-42b8-9698-0fdbed7631d6 => generated 1306 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:07.932474 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-acdbc9ef-a247-4705-b8c9-444ec7974846 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:07.933175 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-acdbc9ef-a247-4705-b8c9-444ec7974846 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: 0cd68f0f-4385-45c4-8dd0-8f33a5a9e527] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:07.939792 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-acdbc9ef-a247-4705-b8c9-444ec7974846 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:07.940505 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-acdbc9ef-a247-4705-b8c9-444ec7974846 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:07.941154 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-acdbc9ef-a247-4705-b8c9-444ec7974846 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:07.942073 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-acdbc9ef-a247-4705-b8c9-444ec7974846 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:07.942540 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-acdbc9ef-a247-4705-b8c9-444ec7974846 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:07.942964 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-acdbc9ef-a247-4705-b8c9-444ec7974846 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:08.077841 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-acdbc9ef-a247-4705-b8c9-444ec7974846 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:08.089333 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-acdbc9ef-a247-4705-b8c9-444ec7974846 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/0cd68f0f-4385-45c4-8dd0-8f33a5a9e527" status: 200 len: 1308 microversion: 2.1 time: 0.161705 Oct 04 18:32:08.103347 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 544/1057] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:07 2022] GET /compute/v2.1/servers/0cd68f0f-4385-45c4-8dd0-8f33a5a9e527 => generated 1308 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:32:08.188504 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a5a208c7-111d-4a8e-86f3-a6ae47831139 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:08.189163 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a5a208c7-111d-4a8e-86f3-a6ae47831139 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: 6b629ba0-6245-442f-bf1a-ad1c1a3116bc] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:08.199130 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a5a208c7-111d-4a8e-86f3-a6ae47831139 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:08.199631 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a5a208c7-111d-4a8e-86f3-a6ae47831139 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:08.200113 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a5a208c7-111d-4a8e-86f3-a6ae47831139 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:08.200834 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a5a208c7-111d-4a8e-86f3-a6ae47831139 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:08.201298 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a5a208c7-111d-4a8e-86f3-a6ae47831139 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:08.201777 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a5a208c7-111d-4a8e-86f3-a6ae47831139 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:08.341267 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a5a208c7-111d-4a8e-86f3-a6ae47831139 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:08.352497 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a5a208c7-111d-4a8e-86f3-a6ae47831139 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:08.355707 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a5a208c7-111d-4a8e-86f3-a6ae47831139 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:08.358031 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a5a208c7-111d-4a8e-86f3-a6ae47831139 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/6b629ba0-6245-442f-bf1a-ad1c1a3116bc" status: 200 len: 1567 microversion: 2.25 time: 0.177001 Oct 04 18:32:08.372970 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 545/1058] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:32:08 2022] GET /compute/v2.1/servers/6b629ba0-6245-442f-bf1a-ad1c1a3116bc => generated 1567 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:32:08.607186 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0b83812d-6730-42b0-b497-ce11aa4ff037 tempest-ListImageFiltersNegativeTestJSON-2098732437 tempest-ListImageFiltersNegativeTestJSON-2098732437-project] Calling method '.version_select at 0x7fe2597519d0>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:08.629538 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-0b83812d-6730-42b0-b497-ce11aa4ff037 tempest-ListImageFiltersNegativeTestJSON-2098732437 tempest-ListImageFiltersNegativeTestJSON-2098732437-project] HTTP exception thrown: Image not found. Oct 04 18:32:08.631720 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0b83812d-6730-42b0-b497-ce11aa4ff037 tempest-ListImageFiltersNegativeTestJSON-2098732437 tempest-ListImageFiltersNegativeTestJSON-2098732437-project] Request method failure captured: Oct 04 18:32:08.631720 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/images/8fcb2c80-8254-4f0b-aab6-ec512fff5c25 HTTP/1.1 Oct 04 18:32:08.631720 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:32:08.631720 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:32:08.631720 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:32:08.631720 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:32:08.631720 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:32:08.631720 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:32:08.631720 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:32:08.631720 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:08.631720 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPHwo6zewPG--9ztn6EIRX3__eMBVGHIRD3UXF7rcHoPTSEHUqaQLc719IUCyOu2U95UzWlLi4fxgyReBWZ48J91v_NwoqBzMeVsnIZWXnug8IityTHT1H0LMx-itlvwRreIgn3hAqXhOVzwB5h5HOO124Gd0FtHYBTR60_Bu75j9g8g Oct 04 18:32:08.631720 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:32:08.631720 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:32:08.631720 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:32:08.631720 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:32:08.631720 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:32:08.631720 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:32:08.631720 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 7b9238981a5d4411978087d5bed82067 Oct 04 18:32:08.631720 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-2098732437 Oct 04 18:32:08.631720 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:32:08.631720 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:32:08.633497 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7b9238981a5d4411978087d5bed82067"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7b9238981a5d4411978087d5bed82067", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7b9238981a5d4411978087d5bed82067"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7b9238981a5d4411978087d5bed82067"}]}] Oct 04 18:32:08.633497 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-2098732437 Oct 04 18:32:08.633497 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 7b9238981a5d4411978087d5bed82067 Oct 04 18:32:08.633497 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-2098732437 Oct 04 18:32:08.633497 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ListImageFiltersNegativeTestJSON-2098732437-project Oct 04 18:32:08.633497 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:32:08.633497 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:32:08.633497 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 3299f855867a461db0c41675abe8fd17 Oct 04 18:32:08.633497 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-2098732437-project Oct 04 18:32:08.633497 n-d-850501-14 devstack@n-api.service[123002]: method: Oct 04 18:32:08.633497 n-d-850501-14 devstack@n-api.service[123002]: exception: Image not found. Oct 04 18:32:08.633497 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '8fcb2c80-8254-4f0b-aab6-ec512fff5c25'} Oct 04 18:32:08.633497 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:08.634558 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:08.634558 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 18:32:08.634558 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 18:32:08.634558 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:32:08.634558 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:32:08.634558 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 18:32:08.634558 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 18:32:08.634558 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:32:08.634558 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:32:08.634558 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 18:32:08.634558 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 18:32:08.634558 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 18:32:08.634558 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 18:32:08.634558 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:32:08.634558 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:32:08.634558 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:32:08.634558 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:32:08.634558 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 8fcb2c80-8254-4f0b-aab6-ec512fff5c25 Oct 04 18:32:08.636098 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:08.636098 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:08.636098 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:08.636098 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:08.636098 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 04 18:32:08.636098 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 04 18:32:08.636098 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 18:32:08.636098 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 18:32:08.636098 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 18:32:08.636098 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 18:32:08.636098 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 18:32:08.636098 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 18:32:08.636098 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 18:32:08.636098 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 18:32:08.636098 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:32:08.636098 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:32:08.636098 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 18:32:08.636098 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 18:32:08.636098 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:32:08.636098 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:32:08.637521 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 18:32:08.637521 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 18:32:08.637521 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 18:32:08.637521 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 18:32:08.637521 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:32:08.637521 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:32:08.637521 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:32:08.637521 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:32:08.637521 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8fcb2c80-8254-4f0b-aab6-ec512fff5c25 could not be found. Oct 04 18:32:08.637521 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:08.637521 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:08.637521 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:08.637521 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:08.637521 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:08.637521 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:08.637521 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:08.637521 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:08.637521 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:32:08.637521 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:32:08.638822 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:08.638822 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:08.638822 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 04 18:32:08.638822 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 18:32:08.638822 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:32:08.638822 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:08.638822 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:08.638822 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:08.638822 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:08.638822 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:08.638822 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:08.638822 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:32:08.638822 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:32:08.638822 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:32:08.638822 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:08.638822 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0b83812d-6730-42b0-b497-ce11aa4ff037 tempest-ListImageFiltersNegativeTestJSON-2098732437 tempest-ListImageFiltersNegativeTestJSON-2098732437-project] Returning 404 to user: Image not found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:08.640038 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0b83812d-6730-42b0-b497-ce11aa4ff037 tempest-ListImageFiltersNegativeTestJSON-2098732437 tempest-ListImageFiltersNegativeTestJSON-2098732437-project] 10.222.0.20 "GET /compute/v2.1/images/8fcb2c80-8254-4f0b-aab6-ec512fff5c25" status: 404 len: 62 microversion: 2.1 time: 0.153594 Oct 04 18:32:08.640038 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 546/1059] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:32:08 2022] GET /compute/v2.1/images/8fcb2c80-8254-4f0b-aab6-ec512fff5c25 => generated 62 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 04 18:32:08.641361 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6b42da9d-0d0b-4b2b-bf42-6dc732e38e63 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:08.642012 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-6b42da9d-0d0b-4b2b-bf42-6dc732e38e63 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] [instance: 156c9c3a-ac54-4499-91fe-161cffddbf12] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:08.648576 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6b42da9d-0d0b-4b2b-bf42-6dc732e38e63 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:08.649064 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6b42da9d-0d0b-4b2b-bf42-6dc732e38e63 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:08.649503 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6b42da9d-0d0b-4b2b-bf42-6dc732e38e63 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:08.650203 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6b42da9d-0d0b-4b2b-bf42-6dc732e38e63 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:08.650656 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6b42da9d-0d0b-4b2b-bf42-6dc732e38e63 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:08.651083 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6b42da9d-0d0b-4b2b-bf42-6dc732e38e63 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:08.718063 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-6b42da9d-0d0b-4b2b-bf42-6dc732e38e63 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f49a275284a7eb714a55c6bdd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e44e7aa06ee4126b5705ba65145ebcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:08.728706 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6b42da9d-0d0b-4b2b-bf42-6dc732e38e63 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] 10.222.0.20 "GET /compute/v2.1/servers/156c9c3a-ac54-4499-91fe-161cffddbf12" status: 200 len: 1228 microversion: 2.1 time: 0.093651 Oct 04 18:32:08.741531 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 547/1060] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:08 2022] GET /compute/v2.1/servers/156c9c3a-ac54-4499-91fe-161cffddbf12 => generated 1228 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:08.809858 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c6a2764d-d3ac-47e7-9eb1-e177574cc708 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:08.810509 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c6a2764d-d3ac-47e7-9eb1-e177574cc708 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: 47fc818f-4a40-42b8-9698-0fdbed7631d6] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:08.816986 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c6a2764d-d3ac-47e7-9eb1-e177574cc708 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:08.817479 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c6a2764d-d3ac-47e7-9eb1-e177574cc708 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:08.817920 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c6a2764d-d3ac-47e7-9eb1-e177574cc708 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:08.818620 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c6a2764d-d3ac-47e7-9eb1-e177574cc708 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:08.819166 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c6a2764d-d3ac-47e7-9eb1-e177574cc708 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:08.819605 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c6a2764d-d3ac-47e7-9eb1-e177574cc708 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:08.851664 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c6a2764d-d3ac-47e7-9eb1-e177574cc708 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:08.852192 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c6a2764d-d3ac-47e7-9eb1-e177574cc708 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:08.852632 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c6a2764d-d3ac-47e7-9eb1-e177574cc708 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:08.853081 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-c6a2764d-d3ac-47e7-9eb1-e177574cc708 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lazy-loading 'fault' on Instance uuid 47fc818f-4a40-42b8-9698-0fdbed7631d6 {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:32:08.893971 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c6a2764d-d3ac-47e7-9eb1-e177574cc708 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:08.902128 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c6a2764d-d3ac-47e7-9eb1-e177574cc708 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/47fc818f-4a40-42b8-9698-0fdbed7631d6" status: 200 len: 1306 microversion: 2.1 time: 0.096469 Oct 04 18:32:08.902690 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 548/1061] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:08 2022] GET /compute/v2.1/servers/47fc818f-4a40-42b8-9698-0fdbed7631d6 => generated 1306 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:32:09.111957 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e9e4b3d4-bb9d-48c2-8b71-f4f5ac80ac05 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:09.112698 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e9e4b3d4-bb9d-48c2-8b71-f4f5ac80ac05 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: 0cd68f0f-4385-45c4-8dd0-8f33a5a9e527] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:09.119515 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e9e4b3d4-bb9d-48c2-8b71-f4f5ac80ac05 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:09.120095 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e9e4b3d4-bb9d-48c2-8b71-f4f5ac80ac05 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:09.121250 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e9e4b3d4-bb9d-48c2-8b71-f4f5ac80ac05 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:09.122172 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e9e4b3d4-bb9d-48c2-8b71-f4f5ac80ac05 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:09.122716 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e9e4b3d4-bb9d-48c2-8b71-f4f5ac80ac05 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:09.123631 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e9e4b3d4-bb9d-48c2-8b71-f4f5ac80ac05 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:09.300343 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e9e4b3d4-bb9d-48c2-8b71-f4f5ac80ac05 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:09.311328 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e9e4b3d4-bb9d-48c2-8b71-f4f5ac80ac05 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/0cd68f0f-4385-45c4-8dd0-8f33a5a9e527" status: 200 len: 1308 microversion: 2.1 time: 0.203320 Oct 04 18:32:09.312110 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 549/1062] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:09 2022] GET /compute/v2.1/servers/0cd68f0f-4385-45c4-8dd0-8f33a5a9e527 => generated 1308 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:32:09.386582 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b9b77a62-5600-4320-90a8-a7df252450b6 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:09.387215 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b9b77a62-5600-4320-90a8-a7df252450b6 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: 6b629ba0-6245-442f-bf1a-ad1c1a3116bc] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:09.394858 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b9b77a62-5600-4320-90a8-a7df252450b6 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:09.395356 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b9b77a62-5600-4320-90a8-a7df252450b6 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:09.395797 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b9b77a62-5600-4320-90a8-a7df252450b6 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:09.396532 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b9b77a62-5600-4320-90a8-a7df252450b6 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:09.396991 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b9b77a62-5600-4320-90a8-a7df252450b6 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:09.397986 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b9b77a62-5600-4320-90a8-a7df252450b6 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:09.540299 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b9b77a62-5600-4320-90a8-a7df252450b6 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:09.548442 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b9b77a62-5600-4320-90a8-a7df252450b6 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:09.549883 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b9b77a62-5600-4320-90a8-a7df252450b6 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:09.551035 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b9b77a62-5600-4320-90a8-a7df252450b6 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/6b629ba0-6245-442f-bf1a-ad1c1a3116bc" status: 200 len: 1567 microversion: 2.25 time: 0.168432 Oct 04 18:32:09.551583 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 550/1063] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:32:09 2022] GET /compute/v2.1/servers/6b629ba0-6245-442f-bf1a-ad1c1a3116bc => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:32:09.755252 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-635c3b0a-a6c5-4ab5-ba59-236e122c8818 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:09.756048 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-635c3b0a-a6c5-4ab5-ba59-236e122c8818 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] [instance: 156c9c3a-ac54-4499-91fe-161cffddbf12] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:09.764132 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-635c3b0a-a6c5-4ab5-ba59-236e122c8818 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:09.765004 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-635c3b0a-a6c5-4ab5-ba59-236e122c8818 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:09.765476 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-635c3b0a-a6c5-4ab5-ba59-236e122c8818 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:09.766626 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-635c3b0a-a6c5-4ab5-ba59-236e122c8818 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:09.767306 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-635c3b0a-a6c5-4ab5-ba59-236e122c8818 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:09.767976 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-635c3b0a-a6c5-4ab5-ba59-236e122c8818 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:09.882156 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-635c3b0a-a6c5-4ab5-ba59-236e122c8818 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f49a275284a7eb714a55c6bdd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e44e7aa06ee4126b5705ba65145ebcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:09.889995 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-635c3b0a-a6c5-4ab5-ba59-236e122c8818 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] 10.222.0.20 "GET /compute/v2.1/servers/156c9c3a-ac54-4499-91fe-161cffddbf12" status: 200 len: 1276 microversion: 2.1 time: 0.141542 Oct 04 18:32:09.890572 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 551/1064] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:09 2022] GET /compute/v2.1/servers/156c9c3a-ac54-4499-91fe-161cffddbf12 => generated 1276 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:32:09.925039 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-86f3a939-125b-451b-b6d9-c712e2385cfc tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:09.925772 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-86f3a939-125b-451b-b6d9-c712e2385cfc tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: 47fc818f-4a40-42b8-9698-0fdbed7631d6] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:09.939266 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-86f3a939-125b-451b-b6d9-c712e2385cfc tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:09.940412 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-86f3a939-125b-451b-b6d9-c712e2385cfc tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:09.941204 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-86f3a939-125b-451b-b6d9-c712e2385cfc tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:09.947089 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-86f3a939-125b-451b-b6d9-c712e2385cfc tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:09.948366 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-86f3a939-125b-451b-b6d9-c712e2385cfc tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:09.948366 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-86f3a939-125b-451b-b6d9-c712e2385cfc tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:09.987481 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-86f3a939-125b-451b-b6d9-c712e2385cfc tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:09.987982 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-86f3a939-125b-451b-b6d9-c712e2385cfc tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:09.988451 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-86f3a939-125b-451b-b6d9-c712e2385cfc tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:09.988920 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-86f3a939-125b-451b-b6d9-c712e2385cfc tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lazy-loading 'fault' on Instance uuid 47fc818f-4a40-42b8-9698-0fdbed7631d6 {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:32:10.043913 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-86f3a939-125b-451b-b6d9-c712e2385cfc tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:10.047446 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:10.053534 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-86f3a939-125b-451b-b6d9-c712e2385cfc tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/47fc818f-4a40-42b8-9698-0fdbed7631d6" status: 200 len: 1306 microversion: 2.1 time: 0.132372 Oct 04 18:32:10.054169 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 552/1065] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:09 2022] GET /compute/v2.1/servers/47fc818f-4a40-42b8-9698-0fdbed7631d6 => generated 1306 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:32:10.343014 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-cae7a3cc-6544-477b-a358-a790549d72e3 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:10.344719 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-cae7a3cc-6544-477b-a358-a790549d72e3 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: 0cd68f0f-4385-45c4-8dd0-8f33a5a9e527] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:10.352963 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cae7a3cc-6544-477b-a358-a790549d72e3 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:10.353462 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cae7a3cc-6544-477b-a358-a790549d72e3 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:10.353902 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cae7a3cc-6544-477b-a358-a790549d72e3 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:10.354612 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cae7a3cc-6544-477b-a358-a790549d72e3 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:10.355070 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cae7a3cc-6544-477b-a358-a790549d72e3 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:10.355497 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cae7a3cc-6544-477b-a358-a790549d72e3 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:10.586988 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-cae7a3cc-6544-477b-a358-a790549d72e3 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:10.596431 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-cae7a3cc-6544-477b-a358-a790549d72e3 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/0cd68f0f-4385-45c4-8dd0-8f33a5a9e527" status: 200 len: 1487 microversion: 2.1 time: 0.258200 Oct 04 18:32:10.597024 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 553/1066] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:10 2022] GET /compute/v2.1/servers/0cd68f0f-4385-45c4-8dd0-8f33a5a9e527 => generated 1487 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:32:10.601862 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-84f8dd17-f905-446c-af30-a79ce859e37f tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:10.602509 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-84f8dd17-f905-446c-af30-a79ce859e37f tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: 6b629ba0-6245-442f-bf1a-ad1c1a3116bc] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:10.609043 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-84f8dd17-f905-446c-af30-a79ce859e37f tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:10.609823 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-84f8dd17-f905-446c-af30-a79ce859e37f tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:10.610260 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-84f8dd17-f905-446c-af30-a79ce859e37f tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:10.610951 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-84f8dd17-f905-446c-af30-a79ce859e37f tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:10.611566 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-84f8dd17-f905-446c-af30-a79ce859e37f tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:10.611986 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-84f8dd17-f905-446c-af30-a79ce859e37f tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:10.767041 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-84f8dd17-f905-446c-af30-a79ce859e37f tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:10.776864 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-84f8dd17-f905-446c-af30-a79ce859e37f tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:10.778465 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-84f8dd17-f905-446c-af30-a79ce859e37f tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:10.779620 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-84f8dd17-f905-446c-af30-a79ce859e37f tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/6b629ba0-6245-442f-bf1a-ad1c1a3116bc" status: 200 len: 1567 microversion: 2.25 time: 0.181705 Oct 04 18:32:10.780350 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 554/1067] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:32:10 2022] GET /compute/v2.1/servers/6b629ba0-6245-442f-bf1a-ad1c1a3116bc => generated 1567 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:32:10.788848 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-220cc5ab-0d07-42cf-9e5d-9a9882502290 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:10.789732 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-220cc5ab-0d07-42cf-9e5d-9a9882502290 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: 0cd68f0f-4385-45c4-8dd0-8f33a5a9e527] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:10.795941 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-220cc5ab-0d07-42cf-9e5d-9a9882502290 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:10.796543 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-220cc5ab-0d07-42cf-9e5d-9a9882502290 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:10.797044 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-220cc5ab-0d07-42cf-9e5d-9a9882502290 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:10.797803 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-220cc5ab-0d07-42cf-9e5d-9a9882502290 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:10.798608 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-220cc5ab-0d07-42cf-9e5d-9a9882502290 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:10.799199 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-220cc5ab-0d07-42cf-9e5d-9a9882502290 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:11.099634 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-220cc5ab-0d07-42cf-9e5d-9a9882502290 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "POST /compute/v2.1/servers/0cd68f0f-4385-45c4-8dd0-8f33a5a9e527/action" status: 202 len: 0 microversion: 2.1 time: 0.309532 Oct 04 18:32:11.099634 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 555/1068] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:32:10 2022] POST /compute/v2.1/servers/0cd68f0f-4385-45c4-8dd0-8f33a5a9e527/action => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:32:11.102007 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-192c6350-448e-4d46-9e13-ea7e5d22d625 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:11.102994 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-192c6350-448e-4d46-9e13-ea7e5d22d625 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] [instance: 156c9c3a-ac54-4499-91fe-161cffddbf12] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:11.111192 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-192c6350-448e-4d46-9e13-ea7e5d22d625 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:11.111939 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-192c6350-448e-4d46-9e13-ea7e5d22d625 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:11.112635 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-192c6350-448e-4d46-9e13-ea7e5d22d625 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:11.113411 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-192c6350-448e-4d46-9e13-ea7e5d22d625 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:11.113931 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-192c6350-448e-4d46-9e13-ea7e5d22d625 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:11.114419 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-192c6350-448e-4d46-9e13-ea7e5d22d625 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:11.189777 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-192c6350-448e-4d46-9e13-ea7e5d22d625 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f49a275284a7eb714a55c6bdd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e44e7aa06ee4126b5705ba65145ebcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:11.199007 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-192c6350-448e-4d46-9e13-ea7e5d22d625 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] 10.222.0.20 "GET /compute/v2.1/servers/156c9c3a-ac54-4499-91fe-161cffddbf12" status: 200 len: 1282 microversion: 2.1 time: 0.102573 Oct 04 18:32:11.200263 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 556/1069] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:11 2022] GET /compute/v2.1/servers/156c9c3a-ac54-4499-91fe-161cffddbf12 => generated 1282 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:11.212024 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b2c5566d-6e55-4205-8f6d-c0a4a9354919 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:11.212840 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b2c5566d-6e55-4205-8f6d-c0a4a9354919 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: 47fc818f-4a40-42b8-9698-0fdbed7631d6] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:11.221699 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b2c5566d-6e55-4205-8f6d-c0a4a9354919 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:11.222602 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b2c5566d-6e55-4205-8f6d-c0a4a9354919 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:11.223116 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b2c5566d-6e55-4205-8f6d-c0a4a9354919 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:11.223838 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b2c5566d-6e55-4205-8f6d-c0a4a9354919 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:11.224558 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b2c5566d-6e55-4205-8f6d-c0a4a9354919 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:11.224851 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b2c5566d-6e55-4205-8f6d-c0a4a9354919 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:11.247923 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-b2c5566d-6e55-4205-8f6d-c0a4a9354919 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] HTTP exception thrown: Instance 47fc818f-4a40-42b8-9698-0fdbed7631d6 could not be found. Oct 04 18:32:11.250953 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b2c5566d-6e55-4205-8f6d-c0a4a9354919 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Request method failure captured: Oct 04 18:32:11.250953 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/47fc818f-4a40-42b8-9698-0fdbed7631d6 HTTP/1.1 Oct 04 18:32:11.250953 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:32:11.250953 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:32:11.250953 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:32:11.250953 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:32:11.250953 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:32:11.250953 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:32:11.250953 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:32:11.250953 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:11.250953 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPHtcc3zsjcMKz8cEwRtflxvigEPx-In4JkTl328nJANVUfFz1p2OVDGilrcjY4qMu5vRjW2zvRxzHEswqbzFh2OoPWoz6R7t8Yv16v_mW4D1rWIFDhOB0dmfh2ZT-5VCy_oS_TIFc0c8n-LcarwX378VPTu7Id5dulS6vFtb7m4i7ZQ Oct 04 18:32:11.250953 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:32:11.250953 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:32:11.250953 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:32:11.250953 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:32:11.250953 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:32:11.250953 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:32:11.250953 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 771211a4ce424aa48920ff102c894a9f Oct 04 18:32:11.250953 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServersOnMultiNodesTest-1893046075 Oct 04 18:32:11.250953 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:32:11.250953 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:32:11.252360 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/771211a4ce424aa48920ff102c894a9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_771211a4ce424aa48920ff102c894a9f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/771211a4ce424aa48920ff102c894a9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/771211a4ce424aa48920ff102c894a9f"}]}] Oct 04 18:32:11.252360 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServersOnMultiNodesTest-1893046075 Oct 04 18:32:11.252360 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 771211a4ce424aa48920ff102c894a9f Oct 04 18:32:11.252360 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1893046075 Oct 04 18:32:11.252360 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServersOnMultiNodesTest-1893046075-project Oct 04 18:32:11.252360 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:32:11.252360 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:32:11.252360 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 07dd131fa3c44d439d0f3ec6e4b8ad42 Oct 04 18:32:11.252360 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServersOnMultiNodesTest-1893046075-project Oct 04 18:32:11.252360 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:32:11.252360 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 47fc818f-4a40-42b8-9698-0fdbed7631d6 could not be found. Oct 04 18:32:11.252360 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '47fc818f-4a40-42b8-9698-0fdbed7631d6'} Oct 04 18:32:11.253234 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:11.253234 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:11.253234 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:32:11.253234 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:32:11.253234 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:32:11.253234 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:32:11.253234 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:32:11.253234 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:32:11.253234 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:32:11.253234 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:32:11.253234 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47fc818f-4a40-42b8-9698-0fdbed7631d6 could not be found. Oct 04 18:32:11.253234 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:11.253234 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:11.253234 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:11.253234 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:11.253234 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:11.253234 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:11.253234 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:11.253234 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:11.253234 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:11.254818 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:11.254818 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:32:11.254818 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:32:11.254818 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:32:11.254818 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:32:11.254818 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:32:11.254818 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:32:11.254818 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47fc818f-4a40-42b8-9698-0fdbed7631d6 could not be found. Oct 04 18:32:11.254818 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:11.254818 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:11.254818 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:11.254818 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:11.254818 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:11.254818 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:11.254818 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:32:11.254818 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:32:11.254818 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47fc818f-4a40-42b8-9698-0fdbed7631d6 could not be found. Oct 04 18:32:11.254818 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:11.256259 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b2c5566d-6e55-4205-8f6d-c0a4a9354919 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Returning 404 to user: Instance 47fc818f-4a40-42b8-9698-0fdbed7631d6 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:11.256259 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b2c5566d-6e55-4205-8f6d-c0a4a9354919 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/47fc818f-4a40-42b8-9698-0fdbed7631d6" status: 404 len: 111 microversion: 2.1 time: 0.047744 Oct 04 18:32:11.256259 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 557/1070] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:11 2022] GET /compute/v2.1/servers/47fc818f-4a40-42b8-9698-0fdbed7631d6 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:32:11.264125 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d6d48911-73e8-4d9f-8de3-0118f8f15538 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:11.264566 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d6d48911-73e8-4d9f-8de3-0118f8f15538 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: 0cd68f0f-4385-45c4-8dd0-8f33a5a9e527] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:11.273428 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d6d48911-73e8-4d9f-8de3-0118f8f15538 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:11.274103 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d6d48911-73e8-4d9f-8de3-0118f8f15538 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:11.274641 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d6d48911-73e8-4d9f-8de3-0118f8f15538 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:11.275556 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d6d48911-73e8-4d9f-8de3-0118f8f15538 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:11.276270 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d6d48911-73e8-4d9f-8de3-0118f8f15538 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:11.276792 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d6d48911-73e8-4d9f-8de3-0118f8f15538 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:11.451191 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-224b5614-0750-4444-ac40-78f569a18210 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/4e1bb5af-9b8b-456f-beb1-aadf2491a8ed/action" status: 202 len: 0 microversion: 2.1 time: 3.843109 Oct 04 18:32:11.453040 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 514/1071] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:32:07 2022] POST /compute/v2.1/servers/4e1bb5af-9b8b-456f-beb1-aadf2491a8ed/action => generated 0 bytes in 3846 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:32:11.461706 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-10c42dd9-62d1-4763-b525-657c66c3ca93 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:11.462561 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-10c42dd9-62d1-4763-b525-657c66c3ca93 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: 208ff352-ed98-4a12-8913-7e520822bf95] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:11.470352 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-10c42dd9-62d1-4763-b525-657c66c3ca93 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:11.470849 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-10c42dd9-62d1-4763-b525-657c66c3ca93 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:11.471288 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-10c42dd9-62d1-4763-b525-657c66c3ca93 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:11.472001 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-10c42dd9-62d1-4763-b525-657c66c3ca93 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:11.472479 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-10c42dd9-62d1-4763-b525-657c66c3ca93 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:11.473212 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-10c42dd9-62d1-4763-b525-657c66c3ca93 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:11.479469 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d6d48911-73e8-4d9f-8de3-0118f8f15538 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:11.489039 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d6d48911-73e8-4d9f-8de3-0118f8f15538 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/0cd68f0f-4385-45c4-8dd0-8f33a5a9e527" status: 200 len: 1492 microversion: 2.1 time: 0.230590 Oct 04 18:32:11.500200 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 558/1072] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:11 2022] GET /compute/v2.1/servers/0cd68f0f-4385-45c4-8dd0-8f33a5a9e527 => generated 1492 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:11.505550 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-10c42dd9-62d1-4763-b525-657c66c3ca93 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: 208ff352-ed98-4a12-8913-7e520822bf95] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:32:11.681836 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-cfb78fdb-bbfe-4470-bf5d-7831fffadba1 tempest-AbsoluteLimitsNegativeTestJSON-16360422 tempest-AbsoluteLimitsNegativeTestJSON-16360422-project] Calling method '.version_select at 0x7fe25992e160>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:11.695186 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cfb78fdb-bbfe-4470-bf5d-7831fffadba1 tempest-AbsoluteLimitsNegativeTestJSON-16360422 tempest-AbsoluteLimitsNegativeTestJSON-16360422-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:11.696048 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cfb78fdb-bbfe-4470-bf5d-7831fffadba1 tempest-AbsoluteLimitsNegativeTestJSON-16360422 tempest-AbsoluteLimitsNegativeTestJSON-16360422-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:11.696627 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cfb78fdb-bbfe-4470-bf5d-7831fffadba1 tempest-AbsoluteLimitsNegativeTestJSON-16360422 tempest-AbsoluteLimitsNegativeTestJSON-16360422-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:11.699783 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cfb78fdb-bbfe-4470-bf5d-7831fffadba1 tempest-AbsoluteLimitsNegativeTestJSON-16360422 tempest-AbsoluteLimitsNegativeTestJSON-16360422-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:11.699783 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cfb78fdb-bbfe-4470-bf5d-7831fffadba1 tempest-AbsoluteLimitsNegativeTestJSON-16360422 tempest-AbsoluteLimitsNegativeTestJSON-16360422-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:11.699783 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cfb78fdb-bbfe-4470-bf5d-7831fffadba1 tempest-AbsoluteLimitsNegativeTestJSON-16360422 tempest-AbsoluteLimitsNegativeTestJSON-16360422-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:11.735039 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-cfb78fdb-bbfe-4470-bf5d-7831fffadba1 tempest-AbsoluteLimitsNegativeTestJSON-16360422 tempest-AbsoluteLimitsNegativeTestJSON-16360422-project] 10.222.0.20 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.243919 Oct 04 18:32:11.735648 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 559/1073] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Oct 4 18:32:11 2022] GET /compute/v2.1/limits => generated 511 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:11.744316 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-69e94a81-7e32-4479-9b57-b7d2df0974a0 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:11.750570 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-69e94a81-7e32-4479-9b57-b7d2df0974a0 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 4e1bb5af-9b8b-456f-beb1-aadf2491a8ed] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:11.751065 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-69e94a81-7e32-4479-9b57-b7d2df0974a0 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:11.751732 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-69e94a81-7e32-4479-9b57-b7d2df0974a0 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:11.752234 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-69e94a81-7e32-4479-9b57-b7d2df0974a0 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:11.753747 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-69e94a81-7e32-4479-9b57-b7d2df0974a0 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:11.754393 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-69e94a81-7e32-4479-9b57-b7d2df0974a0 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:11.754967 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-69e94a81-7e32-4479-9b57-b7d2df0974a0 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:11.896826 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-69e94a81-7e32-4479-9b57-b7d2df0974a0 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:11.905221 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-69e94a81-7e32-4479-9b57-b7d2df0974a0 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/4e1bb5af-9b8b-456f-beb1-aadf2491a8ed" status: 200 len: 1504 microversion: 2.1 time: 0.166518 Oct 04 18:32:11.905795 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 560/1074] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:11 2022] GET /compute/v2.1/servers/4e1bb5af-9b8b-456f-beb1-aadf2491a8ed => generated 1504 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:11.925694 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1ba90a2f-d90e-4416-8663-63f2f60a194f tempest-AbsoluteLimitsNegativeTestJSON-16360422 tempest-AbsoluteLimitsNegativeTestJSON-16360422-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1001532367", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:11.931306 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-10c42dd9-62d1-4763-b525-657c66c3ca93 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "DELETE /compute/v2.1/servers/208ff352-ed98-4a12-8913-7e520822bf95" status: 204 len: 0 microversion: 2.1 time: 0.476492 Oct 04 18:32:11.932182 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 515/1075] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:32:11 2022] DELETE /compute/v2.1/servers/208ff352-ed98-4a12-8913-7e520822bf95 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:32:11.938396 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6ba0913c-3de5-4674-af77-a583e430cfe8 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:11.939606 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6ba0913c-3de5-4674-af77-a583e430cfe8 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: 6b629ba0-6245-442f-bf1a-ad1c1a3116bc] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:11.947514 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6ba0913c-3de5-4674-af77-a583e430cfe8 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:11.948103 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6ba0913c-3de5-4674-af77-a583e430cfe8 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:11.948545 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6ba0913c-3de5-4674-af77-a583e430cfe8 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:11.949252 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6ba0913c-3de5-4674-af77-a583e430cfe8 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:11.949716 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6ba0913c-3de5-4674-af77-a583e430cfe8 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:11.950140 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6ba0913c-3de5-4674-af77-a583e430cfe8 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:12.001914 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-1ba90a2f-d90e-4416-8663-63f2f60a194f tempest-AbsoluteLimitsNegativeTestJSON-16360422 tempest-AbsoluteLimitsNegativeTestJSON-16360422-project] validate_networks() for None {{(pid=123002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:32:12.183131 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6ba0913c-3de5-4674-af77-a583e430cfe8 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:12.201242 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6ba0913c-3de5-4674-af77-a583e430cfe8 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:12.202700 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6ba0913c-3de5-4674-af77-a583e430cfe8 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:12.203877 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6ba0913c-3de5-4674-af77-a583e430cfe8 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/6b629ba0-6245-442f-bf1a-ad1c1a3116bc" status: 200 len: 1542 microversion: 2.25 time: 0.270036 Oct 04 18:32:12.204477 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 516/1076] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:32:11 2022] GET /compute/v2.1/servers/6b629ba0-6245-442f-bf1a-ad1c1a3116bc => generated 1542 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:32:12.208916 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c2efdcef-6117-4adb-89ad-c2fc77f1a3b4 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:12.210111 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c2efdcef-6117-4adb-89ad-c2fc77f1a3b4 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: 208ff352-ed98-4a12-8913-7e520822bf95] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:12.229209 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c2efdcef-6117-4adb-89ad-c2fc77f1a3b4 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:12.229806 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c2efdcef-6117-4adb-89ad-c2fc77f1a3b4 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:12.230147 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c2efdcef-6117-4adb-89ad-c2fc77f1a3b4 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:12.230878 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c2efdcef-6117-4adb-89ad-c2fc77f1a3b4 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:12.231337 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c2efdcef-6117-4adb-89ad-c2fc77f1a3b4 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:12.231772 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c2efdcef-6117-4adb-89ad-c2fc77f1a3b4 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:12.302266 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-1ba90a2f-d90e-4416-8663-63f2f60a194f tempest-AbsoluteLimitsNegativeTestJSON-16360422 tempest-AbsoluteLimitsNegativeTestJSON-16360422-project] Getting quotas for project db6062d809ed4fbc9e5dfb5242007fe2. Resources: dict_keys(['metadata_items']) {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:32:12.309451 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-1ba90a2f-d90e-4416-8663-63f2f60a194f tempest-AbsoluteLimitsNegativeTestJSON-16360422 tempest-AbsoluteLimitsNegativeTestJSON-16360422-project] Getting quotas for user 68c6a525bc024c53b53c58bff78664ae and project db6062d809ed4fbc9e5dfb5242007fe2. Resources: dict_keys(['metadata_items']) {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:32:12.326990 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-1ba90a2f-d90e-4416-8663-63f2f60a194f tempest-AbsoluteLimitsNegativeTestJSON-16360422 tempest-AbsoluteLimitsNegativeTestJSON-16360422-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Oct 04 18:32:12.329578 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1ba90a2f-d90e-4416-8663-63f2f60a194f tempest-AbsoluteLimitsNegativeTestJSON-16360422 tempest-AbsoluteLimitsNegativeTestJSON-16360422-project] Request method failure captured: Oct 04 18:32:12.329578 n-d-850501-14 devstack@n-api.service[123002]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:32:12.329578 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:32:12.329578 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:32:12.329578 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:32:12.329578 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 1752 Oct 04 18:32:12.329578 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:32:12.329578 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:32:12.329578 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:32:12.329578 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:12.329578 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPHwrimzYcET6TyE7PzbP2wsVlMH3WTBlAHvcBuRfheyHxjP_Qrl2t-r2FR2qugE3RozraDVac9zd5hg6m09KDX7N2vJmsqcRkjdPLm1n1i90ac1Mseiev49VRhR0hJZU8HihZ21EHMTLNPrgAYEp7cdV2jElW4px7MhH1QS0zFNQiIk Oct 04 18:32:12.329578 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:32:12.329578 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:32:12.329578 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:32:12.329578 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:32:12.329578 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:32:12.329578 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:32:12.329578 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: db6062d809ed4fbc9e5dfb5242007fe2 Oct 04 18:32:12.329578 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-16360422 Oct 04 18:32:12.329578 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:32:12.329578 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:32:12.329578 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/db6062d809ed4fbc9e5dfb5242007fe2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_db6062d809ed4fbc9e5dfb5242007fe2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/db6062d809ed4fbc9e5dfb5242007fe2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/db6062d809ed4fbc9e5dfb5242007fe2"}]}] Oct 04 18:32:12.329578 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-16360422 Oct 04 18:32:12.329578 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: db6062d809ed4fbc9e5dfb5242007fe2 Oct 04 18:32:12.329578 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-16360422 Oct 04 18:32:12.329578 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-16360422-project Oct 04 18:32:12.329578 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:32:12.329578 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:32:12.329578 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 68c6a525bc024c53b53c58bff78664ae Oct 04 18:32:12.329578 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-16360422-project Oct 04 18:32:12.329578 n-d-850501-14 devstack@n-api.service[123002]: Oct 04 18:32:12.329578 n-d-850501-14 devstack@n-api.service[123002]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1001532367", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Oct 04 18:32:12.329578 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:32:12.329578 n-d-850501-14 devstack@n-api.service[123002]: exception: Maximum number of metadata items exceeds 128 Oct 04 18:32:12.332075 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-1001532367', 'imageRef': 'f545e662-10b3-46b1-88bb-6e66dd294559', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Oct 04 18:32:12.332075 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:12.332075 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:12.332075 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Oct 04 18:32:12.332075 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Oct 04 18:32:12.332075 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:32:12.332075 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:32:12.332075 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Oct 04 18:32:12.332075 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Oct 04 18:32:12.332075 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Oct 04 18:32:12.332075 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Oct 04 18:32:12.332075 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Oct 04 18:32:12.332075 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Oct 04 18:32:12.332075 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Oct 04 18:32:12.332075 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:12.332075 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:12.332075 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:12.332075 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:12.332075 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 18:32:12.332075 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 18:32:12.332075 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 18:32:12.332075 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 18:32:12.332075 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 04 18:32:12.332075 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 04 18:32:12.332075 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Oct 04 18:32:12.332075 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Oct 04 18:32:12.332075 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Oct 04 18:32:12.332075 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Oct 04 18:32:12.332075 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Oct 04 18:32:12.332075 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:12.332075 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:12.332075 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:12.332075 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:12.332075 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:12.332075 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:12.332075 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:12.332075 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:12.332075 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:12.332075 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:12.332075 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:32:12.332075 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:32:12.332075 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:32:12.332075 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:32:12.332075 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:32:12.340860 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:32:12.340860 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 18:32:12.340860 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 04 18:32:12.340860 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 04 18:32:12.340860 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Oct 04 18:32:12.340860 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:12.340860 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:12.340860 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:12.340860 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:12.340860 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:12.340860 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:12.340860 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:32:12.340860 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:32:12.340860 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Oct 04 18:32:12.340860 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:12.340860 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1ba90a2f-d90e-4416-8663-63f2f60a194f tempest-AbsoluteLimitsNegativeTestJSON-16360422 tempest-AbsoluteLimitsNegativeTestJSON-16360422-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:12.340860 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1ba90a2f-d90e-4416-8663-63f2f60a194f tempest-AbsoluteLimitsNegativeTestJSON-16360422 tempest-AbsoluteLimitsNegativeTestJSON-16360422-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.416223 Oct 04 18:32:12.344127 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 561/1077] 10.222.0.20 () {60 vars in 1148 bytes} [Tue Oct 4 18:32:11 2022] POST /compute/v2.1/servers => generated 87 bytes in 423 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:32:12.351947 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2b415d4b-50ca-4554-a004-70175a0d6061 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:12.353881 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2b415d4b-50ca-4554-a004-70175a0d6061 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] [instance: 156c9c3a-ac54-4499-91fe-161cffddbf12] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:12.361486 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2b415d4b-50ca-4554-a004-70175a0d6061 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:12.362348 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2b415d4b-50ca-4554-a004-70175a0d6061 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:12.364988 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2b415d4b-50ca-4554-a004-70175a0d6061 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:12.367000 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2b415d4b-50ca-4554-a004-70175a0d6061 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:12.367945 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2b415d4b-50ca-4554-a004-70175a0d6061 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:12.368517 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2b415d4b-50ca-4554-a004-70175a0d6061 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:12.475152 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c2efdcef-6117-4adb-89ad-c2fc77f1a3b4 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:12.489676 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c2efdcef-6117-4adb-89ad-c2fc77f1a3b4 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/208ff352-ed98-4a12-8913-7e520822bf95" status: 200 len: 1473 microversion: 2.1 time: 0.284126 Oct 04 18:32:12.490268 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 517/1078] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:12 2022] GET /compute/v2.1/servers/208ff352-ed98-4a12-8913-7e520822bf95 => generated 1473 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:12.495215 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c091e475-e75d-42b1-9c56-2222858c0efc tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Calling method '.version_select at 0x7fe2590a8ee0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:12.498974 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c091e475-e75d-42b1-9c56-2222858c0efc tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:12.499638 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c091e475-e75d-42b1-9c56-2222858c0efc tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:12.500303 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c091e475-e75d-42b1-9c56-2222858c0efc tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:12.510296 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c091e475-e75d-42b1-9c56-2222858c0efc tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 2199 microversion: 2.25 time: 0.018771 Oct 04 18:32:12.511158 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 518/1079] 10.222.0.20 () {60 vars in 1184 bytes} [Tue Oct 4 18:32:12 2022] GET /compute/v2.1/os-migrations => generated 2199 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:32:12.516028 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6daee4a4-faf3-4726-8431-bef0a1748521 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:12.516671 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6daee4a4-faf3-4726-8431-bef0a1748521 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: 0cd68f0f-4385-45c4-8dd0-8f33a5a9e527] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:12.523313 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6daee4a4-faf3-4726-8431-bef0a1748521 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:12.523801 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6daee4a4-faf3-4726-8431-bef0a1748521 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:12.524513 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6daee4a4-faf3-4726-8431-bef0a1748521 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:12.525427 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6daee4a4-faf3-4726-8431-bef0a1748521 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:12.525892 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6daee4a4-faf3-4726-8431-bef0a1748521 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:12.526910 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6daee4a4-faf3-4726-8431-bef0a1748521 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:12.570801 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2b415d4b-50ca-4554-a004-70175a0d6061 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f49a275284a7eb714a55c6bdd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e44e7aa06ee4126b5705ba65145ebcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:12.579226 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2b415d4b-50ca-4554-a004-70175a0d6061 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] 10.222.0.20 "GET /compute/v2.1/servers/156c9c3a-ac54-4499-91fe-161cffddbf12" status: 200 len: 1324 microversion: 2.1 time: 0.234010 Oct 04 18:32:12.592084 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 562/1080] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:12 2022] GET /compute/v2.1/servers/156c9c3a-ac54-4499-91fe-161cffddbf12 => generated 1324 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:12.592084 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-fbbd12b0-1d3f-437c-be4c-380169ccd566 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:12.592084 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-fbbd12b0-1d3f-437c-be4c-380169ccd566 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] [instance: 6b629ba0-6245-442f-bf1a-ad1c1a3116bc] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:12.592084 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fbbd12b0-1d3f-437c-be4c-380169ccd566 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:12.592553 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fbbd12b0-1d3f-437c-be4c-380169ccd566 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:12.592887 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fbbd12b0-1d3f-437c-be4c-380169ccd566 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:12.593793 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fbbd12b0-1d3f-437c-be4c-380169ccd566 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:12.594411 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fbbd12b0-1d3f-437c-be4c-380169ccd566 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:12.594984 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fbbd12b0-1d3f-437c-be4c-380169ccd566 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:12.712928 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6daee4a4-faf3-4726-8431-bef0a1748521 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:12.739142 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6daee4a4-faf3-4726-8431-bef0a1748521 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/0cd68f0f-4385-45c4-8dd0-8f33a5a9e527" status: 200 len: 1472 microversion: 2.1 time: 0.226588 Oct 04 18:32:12.739745 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 519/1081] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:12 2022] GET /compute/v2.1/servers/0cd68f0f-4385-45c4-8dd0-8f33a5a9e527 => generated 1472 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:12.746606 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-5d745fac-2314-4baf-b0e4-daabe2563315 req-c3c95be2-6b14-4f9c-b453-1e18ff3b8019 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "156c9c3a-ac54-4499-91fe-161cffddbf12", "tag": "bcc6e3df-34b1-4330-a2a2-9dcdc9fe670d"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:12.757359 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-5d745fac-2314-4baf-b0e4-daabe2563315 req-c3c95be2-6b14-4f9c-b453-1e18ff3b8019 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:12.758254 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-5d745fac-2314-4baf-b0e4-daabe2563315 req-c3c95be2-6b14-4f9c-b453-1e18ff3b8019 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:12.758870 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-5d745fac-2314-4baf-b0e4-daabe2563315 req-c3c95be2-6b14-4f9c-b453-1e18ff3b8019 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:12.776667 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-5d745fac-2314-4baf-b0e4-daabe2563315 req-c3c95be2-6b14-4f9c-b453-1e18ff3b8019 service nova] Creating event network-changed:bcc6e3df-34b1-4330-a2a2-9dcdc9fe670d for instance 156c9c3a-ac54-4499-91fe-161cffddbf12 on n-h1-850501-14 Oct 04 18:32:12.781946 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-5d745fac-2314-4baf-b0e4-daabe2563315 req-c3c95be2-6b14-4f9c-b453-1e18ff3b8019 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038888 Oct 04 18:32:12.785890 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 520/1082] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:32:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:12.795683 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ddd76abd-f5bd-4738-9596-424a80ccebd3 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1342901992"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:12.799637 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ddd76abd-f5bd-4738-9596-424a80ccebd3 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: 0cd68f0f-4385-45c4-8dd0-8f33a5a9e527] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:12.810674 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ddd76abd-f5bd-4738-9596-424a80ccebd3 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:12.811178 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ddd76abd-f5bd-4738-9596-424a80ccebd3 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:12.811618 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ddd76abd-f5bd-4738-9596-424a80ccebd3 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:12.812387 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ddd76abd-f5bd-4738-9596-424a80ccebd3 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:12.813250 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ddd76abd-f5bd-4738-9596-424a80ccebd3 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:12.813920 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ddd76abd-f5bd-4738-9596-424a80ccebd3 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:12.840557 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-fbbd12b0-1d3f-437c-be4c-380169ccd566 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lazy-loading 'services' on Instance uuid 6b629ba0-6245-442f-bf1a-ad1c1a3116bc {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:32:12.861819 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-fbbd12b0-1d3f-437c-be4c-380169ccd566 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/6b629ba0-6245-442f-bf1a-ad1c1a3116bc" status: 200 len: 2037 microversion: 2.25 time: 0.280331 Oct 04 18:32:12.863704 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 563/1083] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:32:12 2022] GET /compute/v2.1/servers/6b629ba0-6245-442f-bf1a-ad1c1a3116bc => generated 2037 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:32:12.870881 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0c7d69af-e461-4160-8db8-a9803906090f tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:12.872224 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0c7d69af-e461-4160-8db8-a9803906090f tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] [instance: c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:12.887976 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0c7d69af-e461-4160-8db8-a9803906090f tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:12.887976 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0c7d69af-e461-4160-8db8-a9803906090f tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:12.887976 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0c7d69af-e461-4160-8db8-a9803906090f tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:12.888652 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0c7d69af-e461-4160-8db8-a9803906090f tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:12.890670 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0c7d69af-e461-4160-8db8-a9803906090f tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:12.891744 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0c7d69af-e461-4160-8db8-a9803906090f tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:12.926305 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0c7d69af-e461-4160-8db8-a9803906090f tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] [instance: c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23] Going to try to terminate instance {{(pid=123002) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:32:13.262470 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0c7d69af-e461-4160-8db8-a9803906090f tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23" status: 204 len: 0 microversion: 2.1 time: 0.396560 Oct 04 18:32:13.268196 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 564/1084] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:32:12 2022] DELETE /compute/v2.1/servers/c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:32:13.275468 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7b1a4f55-7051-4ed9-bd8f-685e1097a43a tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Action: 'create', calling method: .version_select at 0x7fe2592fe1f0>, body: {"keypair": {"name": "tempest-keypair-265724266", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBATY5iJGWBkzXlbvD0o3jc/Tx4EhmkjVLbur8wzkl35T9S2sgCjST+JZtexUlZZbJDzwve4GMoqywltwIWP+3V1xqoeQd+KVhXKt9i4lD8pfGu2JXZPrUPlzLkEdltwYvA=="}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:13.300606 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-7b1a4f55-7051-4ed9-bd8f-685e1097a43a tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Getting quotas for project 1fdde079f17642c69fb250c78903d69c. Resources: {'key_pairs'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:32:13.306426 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-7b1a4f55-7051-4ed9-bd8f-685e1097a43a tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Getting quotas for user f1dec45626f44157a6f4637e668097b4 and project 1fdde079f17642c69fb250c78903d69c. Resources: {'key_pairs'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:32:13.389720 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ddd76abd-f5bd-4738-9596-424a80ccebd3 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "POST /compute/v2.1/servers/0cd68f0f-4385-45c4-8dd0-8f33a5a9e527/action" status: 202 len: 0 microversion: 2.1 time: 0.602129 Oct 04 18:32:13.390381 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 521/1085] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:32:12 2022] POST /compute/v2.1/servers/0cd68f0f-4385-45c4-8dd0-8f33a5a9e527/action => generated 0 bytes in 604 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 18:32:13.406634 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3293b378-1c9c-4819-9e56-6c3f6ac03279 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:13.407338 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3293b378-1c9c-4819-9e56-6c3f6ac03279 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 4e1bb5af-9b8b-456f-beb1-aadf2491a8ed] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:13.415042 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3293b378-1c9c-4819-9e56-6c3f6ac03279 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:13.415540 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3293b378-1c9c-4819-9e56-6c3f6ac03279 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:13.416225 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3293b378-1c9c-4819-9e56-6c3f6ac03279 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:13.417164 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3293b378-1c9c-4819-9e56-6c3f6ac03279 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:13.417905 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3293b378-1c9c-4819-9e56-6c3f6ac03279 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:13.418671 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3293b378-1c9c-4819-9e56-6c3f6ac03279 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:13.421986 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7b1a4f55-7051-4ed9-bd8f-685e1097a43a tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.25 time: 0.153694 Oct 04 18:32:13.423359 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 565/1086] 10.222.0.20 () {62 vars in 1200 bytes} [Tue Oct 4 18:32:13 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 160 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 18:32:13.429723 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3857733b-2fac-44ad-82fa-a18eecc30fc9 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:13.430935 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3857733b-2fac-44ad-82fa-a18eecc30fc9 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] [instance: c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:13.442911 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3857733b-2fac-44ad-82fa-a18eecc30fc9 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:13.443525 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3857733b-2fac-44ad-82fa-a18eecc30fc9 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:13.444187 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3857733b-2fac-44ad-82fa-a18eecc30fc9 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:13.445332 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3857733b-2fac-44ad-82fa-a18eecc30fc9 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:13.446776 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3857733b-2fac-44ad-82fa-a18eecc30fc9 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:13.448003 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3857733b-2fac-44ad-82fa-a18eecc30fc9 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:13.765084 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3293b378-1c9c-4819-9e56-6c3f6ac03279 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:13.769698 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3857733b-2fac-44ad-82fa-a18eecc30fc9 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8675d7d8bab840f3a221fdf2ee4c9b5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25214dec3ef24597be8e5acde61de3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:13.774107 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3293b378-1c9c-4819-9e56-6c3f6ac03279 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/4e1bb5af-9b8b-456f-beb1-aadf2491a8ed" status: 200 len: 1504 microversion: 2.1 time: 0.372362 Oct 04 18:32:13.774693 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 522/1087] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:13 2022] GET /compute/v2.1/servers/4e1bb5af-9b8b-456f-beb1-aadf2491a8ed => generated 1504 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:13.779473 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2bf98927-8893-43e8-80f5-216107dd8498 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '.version_select at 0x7fe2590f4790>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:13.793766 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3857733b-2fac-44ad-82fa-a18eecc30fc9 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] 10.222.0.20 "GET /compute/v2.1/servers/c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23" status: 200 len: 1714 microversion: 2.1 time: 0.369048 Oct 04 18:32:13.794510 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 566/1088] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:13 2022] GET /compute/v2.1/servers/c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23 => generated 1714 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:13.820458 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9174d674-c82a-4698-bb76-cb14915905ec tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:13.821092 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9174d674-c82a-4698-bb76-cb14915905ec tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: 208ff352-ed98-4a12-8913-7e520822bf95] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:13.829361 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2bf98927-8893-43e8-80f5-216107dd8498 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/images/cabaf7e6-9081-4a33-8415-4c717517ad62" status: 200 len: 1414 microversion: 2.1 time: 0.053381 Oct 04 18:32:13.829937 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 523/1089] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:32:13 2022] GET /compute/v2.1/images/cabaf7e6-9081-4a33-8415-4c717517ad62 => generated 1414 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:13.833807 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9174d674-c82a-4698-bb76-cb14915905ec tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:13.835107 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9174d674-c82a-4698-bb76-cb14915905ec tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:13.835630 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-120888ad-5510-40d9-9bc4-7a302753be81 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:13.836280 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-120888ad-5510-40d9-9bc4-7a302753be81 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] [instance: 156c9c3a-ac54-4499-91fe-161cffddbf12] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:13.836495 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9174d674-c82a-4698-bb76-cb14915905ec tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:13.837308 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9174d674-c82a-4698-bb76-cb14915905ec tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:13.837904 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9174d674-c82a-4698-bb76-cb14915905ec tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:13.838631 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9174d674-c82a-4698-bb76-cb14915905ec tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:13.842780 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-120888ad-5510-40d9-9bc4-7a302753be81 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:13.843459 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-120888ad-5510-40d9-9bc4-7a302753be81 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:13.843902 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-120888ad-5510-40d9-9bc4-7a302753be81 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:13.844650 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-120888ad-5510-40d9-9bc4-7a302753be81 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:13.845112 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-120888ad-5510-40d9-9bc4-7a302753be81 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:13.845541 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-120888ad-5510-40d9-9bc4-7a302753be81 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:14.100873 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-120888ad-5510-40d9-9bc4-7a302753be81 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f49a275284a7eb714a55c6bdd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e44e7aa06ee4126b5705ba65145ebcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:14.109753 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-120888ad-5510-40d9-9bc4-7a302753be81 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] 10.222.0.20 "GET /compute/v2.1/servers/156c9c3a-ac54-4499-91fe-161cffddbf12" status: 200 len: 1324 microversion: 2.1 time: 0.278447 Oct 04 18:32:14.110339 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 524/1090] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:13 2022] GET /compute/v2.1/servers/156c9c3a-ac54-4499-91fe-161cffddbf12 => generated 1324 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:14.113083 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9174d674-c82a-4698-bb76-cb14915905ec tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:14.126175 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9174d674-c82a-4698-bb76-cb14915905ec tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/208ff352-ed98-4a12-8913-7e520822bf95" status: 200 len: 1473 microversion: 2.1 time: 0.330216 Oct 04 18:32:14.126751 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 567/1091] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:13 2022] GET /compute/v2.1/servers/208ff352-ed98-4a12-8913-7e520822bf95 => generated 1473 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:14.798929 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9bcedf1d-f09c-4f3c-8682-fd3a5ada8d6c tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:14.799438 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-9bcedf1d-f09c-4f3c-8682-fd3a5ada8d6c tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 4e1bb5af-9b8b-456f-beb1-aadf2491a8ed] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:14.808585 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9bcedf1d-f09c-4f3c-8682-fd3a5ada8d6c tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:14.809324 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9bcedf1d-f09c-4f3c-8682-fd3a5ada8d6c tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:14.809991 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9bcedf1d-f09c-4f3c-8682-fd3a5ada8d6c tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:14.811105 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9bcedf1d-f09c-4f3c-8682-fd3a5ada8d6c tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:14.811814 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9bcedf1d-f09c-4f3c-8682-fd3a5ada8d6c tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:14.812507 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9bcedf1d-f09c-4f3c-8682-fd3a5ada8d6c tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:14.821449 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c6f710ac-429c-4995-a35e-e2899337ea64 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:14.823351 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c6f710ac-429c-4995-a35e-e2899337ea64 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] [instance: c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:14.863551 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c6f710ac-429c-4995-a35e-e2899337ea64 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:14.864805 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c6f710ac-429c-4995-a35e-e2899337ea64 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:14.865667 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c6f710ac-429c-4995-a35e-e2899337ea64 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:14.869916 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c6f710ac-429c-4995-a35e-e2899337ea64 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:14.870455 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c6f710ac-429c-4995-a35e-e2899337ea64 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:14.871046 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c6f710ac-429c-4995-a35e-e2899337ea64 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:15.057007 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9bcedf1d-f09c-4f3c-8682-fd3a5ada8d6c tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:15.068766 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9bcedf1d-f09c-4f3c-8682-fd3a5ada8d6c tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/4e1bb5af-9b8b-456f-beb1-aadf2491a8ed" status: 200 len: 1504 microversion: 2.1 time: 0.274718 Oct 04 18:32:15.070390 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 525/1092] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:14 2022] GET /compute/v2.1/servers/4e1bb5af-9b8b-456f-beb1-aadf2491a8ed => generated 1504 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:15.077779 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4072d189-bcf3-4cea-86af-4682c9354bb2 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '.version_select at 0x7fe259317af0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:15.116914 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c6f710ac-429c-4995-a35e-e2899337ea64 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8675d7d8bab840f3a221fdf2ee4c9b5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25214dec3ef24597be8e5acde61de3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:15.135156 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c6f710ac-429c-4995-a35e-e2899337ea64 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] 10.222.0.20 "GET /compute/v2.1/servers/c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23" status: 200 len: 1714 microversion: 2.1 time: 0.319631 Oct 04 18:32:15.142750 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-4072d189-bcf3-4cea-86af-4682c9354bb2 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/images/cabaf7e6-9081-4a33-8415-4c717517ad62" status: 200 len: 1414 microversion: 2.1 time: 0.070729 Oct 04 18:32:15.143349 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 526/1093] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:32:15 2022] GET /compute/v2.1/images/cabaf7e6-9081-4a33-8415-4c717517ad62 => generated 1414 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:15.149398 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 568/1094] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:14 2022] GET /compute/v2.1/servers/c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23 => generated 1714 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:15.157249 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6cee653c-9693-46f5-b282-7a8aada4fe2c tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:15.158309 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6cee653c-9693-46f5-b282-7a8aada4fe2c tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] [instance: 156c9c3a-ac54-4499-91fe-161cffddbf12] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:15.158848 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9eed0e7f-c92b-4b9b-885b-df3d3b18c690 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:15.159511 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9eed0e7f-c92b-4b9b-885b-df3d3b18c690 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: 208ff352-ed98-4a12-8913-7e520822bf95] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:15.167425 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9eed0e7f-c92b-4b9b-885b-df3d3b18c690 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:15.167908 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9eed0e7f-c92b-4b9b-885b-df3d3b18c690 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:15.168251 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6cee653c-9693-46f5-b282-7a8aada4fe2c tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:15.168451 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9eed0e7f-c92b-4b9b-885b-df3d3b18c690 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:15.169141 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6cee653c-9693-46f5-b282-7a8aada4fe2c tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:15.169295 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9eed0e7f-c92b-4b9b-885b-df3d3b18c690 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:15.169621 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9eed0e7f-c92b-4b9b-885b-df3d3b18c690 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:15.169883 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6cee653c-9693-46f5-b282-7a8aada4fe2c tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:15.170033 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9eed0e7f-c92b-4b9b-885b-df3d3b18c690 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:15.170901 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6cee653c-9693-46f5-b282-7a8aada4fe2c tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:15.171402 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6cee653c-9693-46f5-b282-7a8aada4fe2c tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:15.171935 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6cee653c-9693-46f5-b282-7a8aada4fe2c tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:15.399827 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9eed0e7f-c92b-4b9b-885b-df3d3b18c690 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:15.402506 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:15.408726 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9eed0e7f-c92b-4b9b-885b-df3d3b18c690 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/208ff352-ed98-4a12-8913-7e520822bf95" status: 200 len: 1473 microversion: 2.1 time: 0.254686 Oct 04 18:32:15.409473 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 569/1095] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:15 2022] GET /compute/v2.1/servers/208ff352-ed98-4a12-8913-7e520822bf95 => generated 1473 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:15.423943 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6cee653c-9693-46f5-b282-7a8aada4fe2c tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f49a275284a7eb714a55c6bdd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e44e7aa06ee4126b5705ba65145ebcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:15.435303 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6cee653c-9693-46f5-b282-7a8aada4fe2c tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] 10.222.0.20 "GET /compute/v2.1/servers/156c9c3a-ac54-4499-91fe-161cffddbf12" status: 200 len: 1324 microversion: 2.1 time: 0.288955 Oct 04 18:32:15.435303 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 527/1096] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:15 2022] GET /compute/v2.1/servers/156c9c3a-ac54-4499-91fe-161cffddbf12 => generated 1324 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:15.961385 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-9ace1602-c47f-46c4-94e4-b9707203e4a8 req-335d5399-0ae4-4553-b95d-75007f371a08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "208ff352-ed98-4a12-8913-7e520822bf95", "name": "network-vif-deleted", "tag": "63a4b4fb-c5d8-4a51-9f44-49460db78384"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:15.980350 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-9ace1602-c47f-46c4-94e4-b9707203e4a8 req-335d5399-0ae4-4553-b95d-75007f371a08 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:15.980836 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-9ace1602-c47f-46c4-94e4-b9707203e4a8 req-335d5399-0ae4-4553-b95d-75007f371a08 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:15.981265 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-9ace1602-c47f-46c4-94e4-b9707203e4a8 req-335d5399-0ae4-4553-b95d-75007f371a08 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:15.994400 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-9ace1602-c47f-46c4-94e4-b9707203e4a8 req-335d5399-0ae4-4553-b95d-75007f371a08 service nova] Creating event network-vif-deleted:63a4b4fb-c5d8-4a51-9f44-49460db78384 for instance 208ff352-ed98-4a12-8913-7e520822bf95 on n-h2-850501-14 Oct 04 18:32:15.999492 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-9ace1602-c47f-46c4-94e4-b9707203e4a8 req-335d5399-0ae4-4553-b95d-75007f371a08 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050752 Oct 04 18:32:16.000125 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 570/1097] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:32:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:16.093723 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-28c4755b-0080-452b-aa0a-d7bdd1e21d0a tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:16.095028 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-28c4755b-0080-452b-aa0a-d7bdd1e21d0a tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 4e1bb5af-9b8b-456f-beb1-aadf2491a8ed] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:16.102198 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-28c4755b-0080-452b-aa0a-d7bdd1e21d0a tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:16.103017 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-28c4755b-0080-452b-aa0a-d7bdd1e21d0a tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:16.103460 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-28c4755b-0080-452b-aa0a-d7bdd1e21d0a tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:16.104240 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-28c4755b-0080-452b-aa0a-d7bdd1e21d0a tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:16.104944 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-28c4755b-0080-452b-aa0a-d7bdd1e21d0a tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:16.105303 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-28c4755b-0080-452b-aa0a-d7bdd1e21d0a tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:16.164229 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-85e6de76-9ead-45f8-afb2-fc843f9037ab tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '.version_select at 0x7fe259804ca0>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:16.237934 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-85e6de76-9ead-45f8-afb2-fc843f9037ab tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/images/cabaf7e6-9081-4a33-8415-4c717517ad62" status: 200 len: 1414 microversion: 2.1 time: 0.078294 Oct 04 18:32:16.249056 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 571/1098] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:32:16 2022] GET /compute/v2.1/images/cabaf7e6-9081-4a33-8415-4c717517ad62 => generated 1414 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:16.261512 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-fd63667c-f9e1-44a5-a22f-71e55d2ed284 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:16.262265 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-fd63667c-f9e1-44a5-a22f-71e55d2ed284 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] [instance: c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:16.276614 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fd63667c-f9e1-44a5-a22f-71e55d2ed284 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:16.277102 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fd63667c-f9e1-44a5-a22f-71e55d2ed284 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:16.282564 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fd63667c-f9e1-44a5-a22f-71e55d2ed284 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:16.283518 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fd63667c-f9e1-44a5-a22f-71e55d2ed284 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:16.284178 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fd63667c-f9e1-44a5-a22f-71e55d2ed284 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:16.284762 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fd63667c-f9e1-44a5-a22f-71e55d2ed284 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:16.343231 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-28c4755b-0080-452b-aa0a-d7bdd1e21d0a tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:16.359123 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-28c4755b-0080-452b-aa0a-d7bdd1e21d0a tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/4e1bb5af-9b8b-456f-beb1-aadf2491a8ed" status: 200 len: 1504 microversion: 2.1 time: 0.269155 Oct 04 18:32:16.373117 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 528/1099] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:16 2022] GET /compute/v2.1/servers/4e1bb5af-9b8b-456f-beb1-aadf2491a8ed => generated 1504 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:16.434503 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-fe8446e6-20ea-4c1c-b213-76ec1a516431 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:16.435233 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-fe8446e6-20ea-4c1c-b213-76ec1a516431 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: 208ff352-ed98-4a12-8913-7e520822bf95] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:16.454084 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fe8446e6-20ea-4c1c-b213-76ec1a516431 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:16.454084 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fe8446e6-20ea-4c1c-b213-76ec1a516431 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:16.454084 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fe8446e6-20ea-4c1c-b213-76ec1a516431 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:16.454084 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fe8446e6-20ea-4c1c-b213-76ec1a516431 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:16.454084 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fe8446e6-20ea-4c1c-b213-76ec1a516431 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:16.454084 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fe8446e6-20ea-4c1c-b213-76ec1a516431 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:16.489722 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fe8446e6-20ea-4c1c-b213-76ec1a516431 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:16.491421 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fe8446e6-20ea-4c1c-b213-76ec1a516431 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:16.492397 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fe8446e6-20ea-4c1c-b213-76ec1a516431 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:16.493197 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-fe8446e6-20ea-4c1c-b213-76ec1a516431 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lazy-loading 'fault' on Instance uuid 208ff352-ed98-4a12-8913-7e520822bf95 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:32:16.534995 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-fd63667c-f9e1-44a5-a22f-71e55d2ed284 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8675d7d8bab840f3a221fdf2ee4c9b5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25214dec3ef24597be8e5acde61de3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:16.564692 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-fd63667c-f9e1-44a5-a22f-71e55d2ed284 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] 10.222.0.20 "GET /compute/v2.1/servers/c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23" status: 200 len: 1714 microversion: 2.1 time: 0.314461 Oct 04 18:32:16.564896 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-fe8446e6-20ea-4c1c-b213-76ec1a516431 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:16.568144 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:16.582878 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 572/1100] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:16 2022] GET /compute/v2.1/servers/c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23 => generated 1714 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:16.588510 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-fe8446e6-20ea-4c1c-b213-76ec1a516431 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/208ff352-ed98-4a12-8913-7e520822bf95" status: 200 len: 1307 microversion: 2.1 time: 0.158183 Oct 04 18:32:16.589727 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 529/1101] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:16 2022] GET /compute/v2.1/servers/208ff352-ed98-4a12-8913-7e520822bf95 => generated 1307 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:16.608115 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-cd8c68de-71aa-46bf-a3a7-9d95e5b00984 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:16.608742 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-cd8c68de-71aa-46bf-a3a7-9d95e5b00984 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] [instance: 156c9c3a-ac54-4499-91fe-161cffddbf12] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:16.610999 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=97,nova_api:UPDATE=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:16.634362 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cd8c68de-71aa-46bf-a3a7-9d95e5b00984 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:16.634866 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cd8c68de-71aa-46bf-a3a7-9d95e5b00984 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:16.635298 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cd8c68de-71aa-46bf-a3a7-9d95e5b00984 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:16.636121 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cd8c68de-71aa-46bf-a3a7-9d95e5b00984 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:16.636876 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cd8c68de-71aa-46bf-a3a7-9d95e5b00984 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:16.637298 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cd8c68de-71aa-46bf-a3a7-9d95e5b00984 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:16.860232 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-cd8c68de-71aa-46bf-a3a7-9d95e5b00984 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f49a275284a7eb714a55c6bdd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e44e7aa06ee4126b5705ba65145ebcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:16.871186 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-cd8c68de-71aa-46bf-a3a7-9d95e5b00984 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] 10.222.0.20 "GET /compute/v2.1/servers/156c9c3a-ac54-4499-91fe-161cffddbf12" status: 200 len: 1324 microversion: 2.1 time: 0.287122 Oct 04 18:32:16.873973 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 573/1102] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:16 2022] GET /compute/v2.1/servers/156c9c3a-ac54-4499-91fe-161cffddbf12 => generated 1324 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:17.255328 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-696aedec-ac9b-46ef-bf99-71d36d23c2ed tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '.version_select at 0x7fe2590f4af0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:17.314184 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-696aedec-ac9b-46ef-bf99-71d36d23c2ed tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/images/cabaf7e6-9081-4a33-8415-4c717517ad62" status: 200 len: 1414 microversion: 2.1 time: 0.063148 Oct 04 18:32:17.314763 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 530/1103] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:32:17 2022] GET /compute/v2.1/images/cabaf7e6-9081-4a33-8415-4c717517ad62 => generated 1414 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:17.386987 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-63d5a57c-0dc1-4529-8c34-c38ce97b2461 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:17.387660 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-63d5a57c-0dc1-4529-8c34-c38ce97b2461 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 4e1bb5af-9b8b-456f-beb1-aadf2491a8ed] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:17.396168 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-63d5a57c-0dc1-4529-8c34-c38ce97b2461 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:17.396666 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-63d5a57c-0dc1-4529-8c34-c38ce97b2461 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:17.397201 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-63d5a57c-0dc1-4529-8c34-c38ce97b2461 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:17.397982 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-63d5a57c-0dc1-4529-8c34-c38ce97b2461 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:17.398448 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-63d5a57c-0dc1-4529-8c34-c38ce97b2461 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:17.398882 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-63d5a57c-0dc1-4529-8c34-c38ce97b2461 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:17.576526 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-63d5a57c-0dc1-4529-8c34-c38ce97b2461 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:17.586646 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-63d5a57c-0dc1-4529-8c34-c38ce97b2461 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/4e1bb5af-9b8b-456f-beb1-aadf2491a8ed" status: 200 len: 1504 microversion: 2.1 time: 0.204081 Oct 04 18:32:17.598214 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-37b88b42-15b9-4a0c-8c7a-750a59b17cf1 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:17.599014 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-37b88b42-15b9-4a0c-8c7a-750a59b17cf1 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] [instance: c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:17.601194 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 574/1104] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:17 2022] GET /compute/v2.1/servers/4e1bb5af-9b8b-456f-beb1-aadf2491a8ed => generated 1504 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:17.617409 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-37b88b42-15b9-4a0c-8c7a-750a59b17cf1 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:17.617409 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-37b88b42-15b9-4a0c-8c7a-750a59b17cf1 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:17.617409 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-37b88b42-15b9-4a0c-8c7a-750a59b17cf1 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:17.617409 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-37b88b42-15b9-4a0c-8c7a-750a59b17cf1 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:17.617409 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-37b88b42-15b9-4a0c-8c7a-750a59b17cf1 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:17.618289 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-dc29abb9-75e8-45c7-9501-e70db88b1a45 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:17.618289 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-dc29abb9-75e8-45c7-9501-e70db88b1a45 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: 208ff352-ed98-4a12-8913-7e520822bf95] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:17.621700 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dc29abb9-75e8-45c7-9501-e70db88b1a45 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:17.622199 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dc29abb9-75e8-45c7-9501-e70db88b1a45 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:17.622630 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dc29abb9-75e8-45c7-9501-e70db88b1a45 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:17.623465 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dc29abb9-75e8-45c7-9501-e70db88b1a45 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:17.623916 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dc29abb9-75e8-45c7-9501-e70db88b1a45 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:17.624034 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-37b88b42-15b9-4a0c-8c7a-750a59b17cf1 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:17.624364 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dc29abb9-75e8-45c7-9501-e70db88b1a45 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:17.660746 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dc29abb9-75e8-45c7-9501-e70db88b1a45 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:17.661349 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dc29abb9-75e8-45c7-9501-e70db88b1a45 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:17.662056 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dc29abb9-75e8-45c7-9501-e70db88b1a45 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:17.663132 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-dc29abb9-75e8-45c7-9501-e70db88b1a45 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lazy-loading 'fault' on Instance uuid 208ff352-ed98-4a12-8913-7e520822bf95 {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:32:17.767255 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-37b88b42-15b9-4a0c-8c7a-750a59b17cf1 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8675d7d8bab840f3a221fdf2ee4c9b5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25214dec3ef24597be8e5acde61de3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:17.781604 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-37b88b42-15b9-4a0c-8c7a-750a59b17cf1 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] 10.222.0.20 "GET /compute/v2.1/servers/c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23" status: 200 len: 1646 microversion: 2.1 time: 0.190122 Oct 04 18:32:17.785654 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 531/1105] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:17 2022] GET /compute/v2.1/servers/c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23 => generated 1646 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:32:17.820522 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-dc29abb9-75e8-45c7-9501-e70db88b1a45 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:17.830929 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-dc29abb9-75e8-45c7-9501-e70db88b1a45 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/208ff352-ed98-4a12-8913-7e520822bf95" status: 200 len: 1307 microversion: 2.1 time: 0.221385 Oct 04 18:32:17.832149 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 575/1106] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:17 2022] GET /compute/v2.1/servers/208ff352-ed98-4a12-8913-7e520822bf95 => generated 1307 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:32:17.895084 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-70c77562-dd85-4786-ad4d-c60ce7d791ab tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:17.895700 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-70c77562-dd85-4786-ad4d-c60ce7d791ab tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] [instance: 156c9c3a-ac54-4499-91fe-161cffddbf12] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:17.910318 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-70c77562-dd85-4786-ad4d-c60ce7d791ab tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:17.911188 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-70c77562-dd85-4786-ad4d-c60ce7d791ab tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:17.911877 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-70c77562-dd85-4786-ad4d-c60ce7d791ab tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:17.913729 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-70c77562-dd85-4786-ad4d-c60ce7d791ab tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:17.914738 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-70c77562-dd85-4786-ad4d-c60ce7d791ab tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:17.915393 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-70c77562-dd85-4786-ad4d-c60ce7d791ab tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:18.128425 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6920267d-f71c-41fb-b293-12b63fd5b2f3 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-447644397", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": [{"uuid": "f77e917f-247a-463a-8e5a-3fb6256ecb82"}], "security_groups": [{"name": "tempest-securitygroup--484770784"}], "key_name": "tempest-keypair-265724266", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:18.479050 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-6920267d-f71c-41fb-b293-12b63fd5b2f3 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] validate_networks() for [('f77e917f-247a-463a-8e5a-3fb6256ecb82', None, None, None, None, None)] {{(pid=123002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:32:18.636499 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-70c77562-dd85-4786-ad4d-c60ce7d791ab tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f49a275284a7eb714a55c6bdd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e44e7aa06ee4126b5705ba65145ebcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:18.654164 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-70c77562-dd85-4786-ad4d-c60ce7d791ab tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] 10.222.0.20 "GET /compute/v2.1/servers/156c9c3a-ac54-4499-91fe-161cffddbf12" status: 200 len: 1324 microversion: 2.1 time: 0.761371 Oct 04 18:32:18.654779 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 532/1107] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:17 2022] GET /compute/v2.1/servers/156c9c3a-ac54-4499-91fe-161cffddbf12 => generated 1324 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:18.662102 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-40f5c807-0685-46b1-9d15-dbedc0489e50 req-70453ea8-84ea-4a9a-8bc2-badd724514cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23", "name": "network-vif-deleted", "tag": "2be6226f-41ea-4517-a7af-b60f36e97405"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:18.672248 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:18.674545 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-40f5c807-0685-46b1-9d15-dbedc0489e50 req-70453ea8-84ea-4a9a-8bc2-badd724514cc service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:18.675345 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-40f5c807-0685-46b1-9d15-dbedc0489e50 req-70453ea8-84ea-4a9a-8bc2-badd724514cc service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:18.676140 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-40f5c807-0685-46b1-9d15-dbedc0489e50 req-70453ea8-84ea-4a9a-8bc2-badd724514cc service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:18.695102 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-40f5c807-0685-46b1-9d15-dbedc0489e50 req-70453ea8-84ea-4a9a-8bc2-badd724514cc service nova] Creating event network-vif-deleted:2be6226f-41ea-4517-a7af-b60f36e97405 for instance c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23 on n-h2-850501-14 Oct 04 18:32:18.704240 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-40f5c807-0685-46b1-9d15-dbedc0489e50 req-70453ea8-84ea-4a9a-8bc2-badd724514cc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046094 Oct 04 18:32:18.705214 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 533/1108] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:32:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:18.714032 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-faca2e80-43ce-4f47-b15a-517db462d16a tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '.version_select at 0x7fe259102790>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:18.778601 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-faca2e80-43ce-4f47-b15a-517db462d16a tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/images/cabaf7e6-9081-4a33-8415-4c717517ad62" status: 200 len: 1414 microversion: 2.1 time: 0.071879 Oct 04 18:32:18.786480 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 534/1109] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:32:18 2022] GET /compute/v2.1/images/cabaf7e6-9081-4a33-8415-4c717517ad62 => generated 1414 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:18.796912 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-29e0b658-52a7-4931-9d6f-5ab101f753ea tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:18.797906 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-29e0b658-52a7-4931-9d6f-5ab101f753ea tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 4e1bb5af-9b8b-456f-beb1-aadf2491a8ed] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:18.806107 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-29e0b658-52a7-4931-9d6f-5ab101f753ea tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:18.807103 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-29e0b658-52a7-4931-9d6f-5ab101f753ea tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:18.807743 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-29e0b658-52a7-4931-9d6f-5ab101f753ea tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:18.808868 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-29e0b658-52a7-4931-9d6f-5ab101f753ea tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:18.809495 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-29e0b658-52a7-4931-9d6f-5ab101f753ea tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:18.810138 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-29e0b658-52a7-4931-9d6f-5ab101f753ea tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:19.207472 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-29e0b658-52a7-4931-9d6f-5ab101f753ea tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:19.215698 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-29e0b658-52a7-4931-9d6f-5ab101f753ea tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/4e1bb5af-9b8b-456f-beb1-aadf2491a8ed" status: 200 len: 1504 microversion: 2.1 time: 0.427550 Oct 04 18:32:19.233520 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 535/1110] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:18 2022] GET /compute/v2.1/servers/4e1bb5af-9b8b-456f-beb1-aadf2491a8ed => generated 1504 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:19.238543 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e0a0f86e-7f4e-401d-86f2-dc7021a360fd tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:19.239384 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e0a0f86e-7f4e-401d-86f2-dc7021a360fd tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] [instance: c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:19.246215 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e0a0f86e-7f4e-401d-86f2-dc7021a360fd tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:19.246707 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e0a0f86e-7f4e-401d-86f2-dc7021a360fd tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:19.247325 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e0a0f86e-7f4e-401d-86f2-dc7021a360fd tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:19.256447 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e0a0f86e-7f4e-401d-86f2-dc7021a360fd tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:19.256447 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e0a0f86e-7f4e-401d-86f2-dc7021a360fd tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:19.256447 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e0a0f86e-7f4e-401d-86f2-dc7021a360fd tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:19.297380 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e0a0f86e-7f4e-401d-86f2-dc7021a360fd tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:19.298174 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e0a0f86e-7f4e-401d-86f2-dc7021a360fd tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:19.298768 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e0a0f86e-7f4e-401d-86f2-dc7021a360fd tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:19.299456 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-e0a0f86e-7f4e-401d-86f2-dc7021a360fd tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lazy-loading 'fault' on Instance uuid c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:32:19.417804 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e0a0f86e-7f4e-401d-86f2-dc7021a360fd tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8675d7d8bab840f3a221fdf2ee4c9b5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25214dec3ef24597be8e5acde61de3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:19.426564 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e0a0f86e-7f4e-401d-86f2-dc7021a360fd tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] 10.222.0.20 "GET /compute/v2.1/servers/c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23" status: 200 len: 1355 microversion: 2.1 time: 0.191776 Oct 04 18:32:19.447999 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 536/1111] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:19 2022] GET /compute/v2.1/servers/c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23 => generated 1355 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:19.447999 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-95d3c7e5-7692-49b4-a055-3255ff91c47b tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:19.447999 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-95d3c7e5-7692-49b4-a055-3255ff91c47b tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: 208ff352-ed98-4a12-8913-7e520822bf95] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:19.447999 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-95d3c7e5-7692-49b4-a055-3255ff91c47b tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:19.447999 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-95d3c7e5-7692-49b4-a055-3255ff91c47b tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:19.447999 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-95d3c7e5-7692-49b4-a055-3255ff91c47b tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:19.447999 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-95d3c7e5-7692-49b4-a055-3255ff91c47b tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:19.447999 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-95d3c7e5-7692-49b4-a055-3255ff91c47b tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:19.447999 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-95d3c7e5-7692-49b4-a055-3255ff91c47b tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:19.461635 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-95d3c7e5-7692-49b4-a055-3255ff91c47b tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] HTTP exception thrown: Instance 208ff352-ed98-4a12-8913-7e520822bf95 could not be found. Oct 04 18:32:19.464396 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-95d3c7e5-7692-49b4-a055-3255ff91c47b tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Request method failure captured: Oct 04 18:32:19.464396 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/208ff352-ed98-4a12-8913-7e520822bf95 HTTP/1.1 Oct 04 18:32:19.464396 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:32:19.464396 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:32:19.464396 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:32:19.464396 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:32:19.464396 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:32:19.464396 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:32:19.464396 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:32:19.464396 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:19.464396 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPHtcc3zsjcMKz8cEwRtflxvigEPx-In4JkTl328nJANVUfFz1p2OVDGilrcjY4qMu5vRjW2zvRxzHEswqbzFh2OoPWoz6R7t8Yv16v_mW4D1rWIFDhOB0dmfh2ZT-5VCy_oS_TIFc0c8n-LcarwX378VPTu7Id5dulS6vFtb7m4i7ZQ Oct 04 18:32:19.464396 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:32:19.464396 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:32:19.464396 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:32:19.464396 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:32:19.464396 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:32:19.464396 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:32:19.464396 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 771211a4ce424aa48920ff102c894a9f Oct 04 18:32:19.464396 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ServersOnMultiNodesTest-1893046075 Oct 04 18:32:19.464396 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:32:19.464396 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:32:19.464396 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/771211a4ce424aa48920ff102c894a9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_771211a4ce424aa48920ff102c894a9f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/771211a4ce424aa48920ff102c894a9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/771211a4ce424aa48920ff102c894a9f"}]}] Oct 04 18:32:19.464396 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ServersOnMultiNodesTest-1893046075 Oct 04 18:32:19.464396 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 771211a4ce424aa48920ff102c894a9f Oct 04 18:32:19.464396 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1893046075 Oct 04 18:32:19.464396 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ServersOnMultiNodesTest-1893046075-project Oct 04 18:32:19.464396 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:32:19.464396 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:32:19.464396 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 07dd131fa3c44d439d0f3ec6e4b8ad42 Oct 04 18:32:19.464396 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ServersOnMultiNodesTest-1893046075-project Oct 04 18:32:19.464396 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:32:19.464396 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 208ff352-ed98-4a12-8913-7e520822bf95 could not be found. Oct 04 18:32:19.464396 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '208ff352-ed98-4a12-8913-7e520822bf95'} Oct 04 18:32:19.464396 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:19.464396 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:19.464396 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:32:19.464396 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:32:19.464396 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:32:19.464396 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:32:19.464396 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:32:19.464396 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:32:19.464396 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:32:19.464396 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:32:19.464396 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 208ff352-ed98-4a12-8913-7e520822bf95 could not be found. Oct 04 18:32:19.464396 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:32:19.464396 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:19.464396 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:32:19.464396 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:19.464396 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:19.464396 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:19.464396 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:19.464396 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:19.464396 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:19.464396 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:19.464396 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:32:19.464396 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:32:19.464396 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:32:19.464396 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:32:19.464396 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:32:19.464396 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:32:19.464396 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 208ff352-ed98-4a12-8913-7e520822bf95 could not be found. Oct 04 18:32:19.464396 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:32:19.464396 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:19.464396 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:32:19.471557 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:19.471557 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:19.471557 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:19.471557 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:32:19.471557 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:32:19.471557 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 208ff352-ed98-4a12-8913-7e520822bf95 could not be found. Oct 04 18:32:19.471557 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:32:19.471557 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-95d3c7e5-7692-49b4-a055-3255ff91c47b tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Returning 404 to user: Instance 208ff352-ed98-4a12-8913-7e520822bf95 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:19.471557 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-95d3c7e5-7692-49b4-a055-3255ff91c47b tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/208ff352-ed98-4a12-8913-7e520822bf95" status: 404 len: 111 microversion: 2.1 time: 0.032001 Oct 04 18:32:19.471557 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 537/1112] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:19 2022] GET /compute/v2.1/servers/208ff352-ed98-4a12-8913-7e520822bf95 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:32:19.473601 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1ad1b86a-0014-4856-aa74-2883573505bb tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:19.474295 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1ad1b86a-0014-4856-aa74-2883573505bb tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: 2d07c478-8e9c-4000-92bb-3fa4547ea6c0] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:19.482161 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1ad1b86a-0014-4856-aa74-2883573505bb tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:19.487930 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1ad1b86a-0014-4856-aa74-2883573505bb tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:19.487930 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1ad1b86a-0014-4856-aa74-2883573505bb tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:19.487930 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1ad1b86a-0014-4856-aa74-2883573505bb tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:19.487930 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1ad1b86a-0014-4856-aa74-2883573505bb tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:19.487930 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1ad1b86a-0014-4856-aa74-2883573505bb tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:19.513287 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1ad1b86a-0014-4856-aa74-2883573505bb tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: 2d07c478-8e9c-4000-92bb-3fa4547ea6c0] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:32:19.527317 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-6920267d-f71c-41fb-b293-12b63fd5b2f3 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:32:19.527965 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-6920267d-f71c-41fb-b293-12b63fd5b2f3 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:32:19.528343 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-6920267d-f71c-41fb-b293-12b63fd5b2f3 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:32:19.528640 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-6920267d-f71c-41fb-b293-12b63fd5b2f3 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:32:19.529123 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-6920267d-f71c-41fb-b293-12b63fd5b2f3 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:32:19.542434 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6920267d-f71c-41fb-b293-12b63fd5b2f3 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:19.543259 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6920267d-f71c-41fb-b293-12b63fd5b2f3 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:19.543857 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6920267d-f71c-41fb-b293-12b63fd5b2f3 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:19.544866 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6920267d-f71c-41fb-b293-12b63fd5b2f3 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:19.545608 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6920267d-f71c-41fb-b293-12b63fd5b2f3 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:19.546212 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6920267d-f71c-41fb-b293-12b63fd5b2f3 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:19.569164 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-6920267d-f71c-41fb-b293-12b63fd5b2f3 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Getting quotas for project 1fdde079f17642c69fb250c78903d69c. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:32:19.578506 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-6920267d-f71c-41fb-b293-12b63fd5b2f3 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Getting quotas for user f1dec45626f44157a6f4637e668097b4 and project 1fdde079f17642c69fb250c78903d69c. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:32:19.600966 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-6920267d-f71c-41fb-b293-12b63fd5b2f3 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Going to run 1 instances... {{(pid=123002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:32:19.603458 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-6920267d-f71c-41fb-b293-12b63fd5b2f3 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: b219d988-2847-45a0-a3b8-af54cf1a43f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:32:19.884608 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6920267d-f71c-41fb-b293-12b63fd5b2f3 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.25 time: 1.759258 Oct 04 18:32:19.885893 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 576/1113] 10.222.0.20 () {62 vars in 1188 bytes} [Tue Oct 4 18:32:18 2022] POST /compute/v2.1/servers => generated 405 bytes in 1762 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 04 18:32:19.891250 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-57e259ff-9b3b-4ecd-8acf-ca47b092c442 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:19.892300 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-57e259ff-9b3b-4ecd-8acf-ca47b092c442 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] [instance: 156c9c3a-ac54-4499-91fe-161cffddbf12] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:19.925986 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-57e259ff-9b3b-4ecd-8acf-ca47b092c442 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:19.927375 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-57e259ff-9b3b-4ecd-8acf-ca47b092c442 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:19.928033 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-57e259ff-9b3b-4ecd-8acf-ca47b092c442 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:19.930502 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-57e259ff-9b3b-4ecd-8acf-ca47b092c442 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:19.931736 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-57e259ff-9b3b-4ecd-8acf-ca47b092c442 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:19.932798 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-57e259ff-9b3b-4ecd-8acf-ca47b092c442 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:19.951205 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1ad1b86a-0014-4856-aa74-2883573505bb tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2d07c478-8e9c-4000-92bb-3fa4547ea6c0" status: 204 len: 0 microversion: 2.1 time: 0.479669 Oct 04 18:32:19.952909 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 538/1114] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:32:19 2022] DELETE /compute/v2.1/servers/2d07c478-8e9c-4000-92bb-3fa4547ea6c0 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:32:19.961196 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7321eb85-9b1c-437f-acba-2e9a96243917 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '.version_select at 0x7fe2590f45e0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:20.036014 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7321eb85-9b1c-437f-acba-2e9a96243917 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/images/cabaf7e6-9081-4a33-8415-4c717517ad62" status: 200 len: 1414 microversion: 2.1 time: 0.075744 Oct 04 18:32:20.046745 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 539/1115] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:32:19 2022] GET /compute/v2.1/images/cabaf7e6-9081-4a33-8415-4c717517ad62 => generated 1414 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:20.072260 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ef01fa5d-07be-4f75-acad-711e1f29b982 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:20.073009 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ef01fa5d-07be-4f75-acad-711e1f29b982 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: b219d988-2847-45a0-a3b8-af54cf1a43f8] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:20.341045 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ef01fa5d-07be-4f75-acad-711e1f29b982 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:20.351692 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ef01fa5d-07be-4f75-acad-711e1f29b982 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:20.353324 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ef01fa5d-07be-4f75-acad-711e1f29b982 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:20.354532 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ef01fa5d-07be-4f75-acad-711e1f29b982 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8" status: 200 len: 1284 microversion: 2.25 time: 0.305928 Oct 04 18:32:20.355232 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 540/1116] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:32:20 2022] GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8 => generated 1284 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:32:20.362283 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-93736e52-f922-41c5-b69d-f24d6e2ccf25 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:20.363556 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-93736e52-f922-41c5-b69d-f24d6e2ccf25 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: d5e996e9-dc9f-46e3-8469-e46dc2932b24] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:20.372510 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-93736e52-f922-41c5-b69d-f24d6e2ccf25 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:20.373314 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-93736e52-f922-41c5-b69d-f24d6e2ccf25 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:20.374006 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-93736e52-f922-41c5-b69d-f24d6e2ccf25 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:20.374788 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-93736e52-f922-41c5-b69d-f24d6e2ccf25 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:20.375343 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-93736e52-f922-41c5-b69d-f24d6e2ccf25 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:20.375873 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-93736e52-f922-41c5-b69d-f24d6e2ccf25 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:20.408098 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-93736e52-f922-41c5-b69d-f24d6e2ccf25 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: d5e996e9-dc9f-46e3-8469-e46dc2932b24] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:32:20.408799 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-57e259ff-9b3b-4ecd-8acf-ca47b092c442 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f49a275284a7eb714a55c6bdd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e44e7aa06ee4126b5705ba65145ebcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:20.417746 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-57e259ff-9b3b-4ecd-8acf-ca47b092c442 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] 10.222.0.20 "GET /compute/v2.1/servers/156c9c3a-ac54-4499-91fe-161cffddbf12" status: 200 len: 1324 microversion: 2.1 time: 0.530397 Oct 04 18:32:20.426259 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 577/1117] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:19 2022] GET /compute/v2.1/servers/156c9c3a-ac54-4499-91fe-161cffddbf12 => generated 1324 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:20.426259 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-12e4ef71-f93c-4b05-a112-2be245ffe012 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:20.426259 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-12e4ef71-f93c-4b05-a112-2be245ffe012 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 4e1bb5af-9b8b-456f-beb1-aadf2491a8ed] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:20.445881 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-12e4ef71-f93c-4b05-a112-2be245ffe012 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:20.446745 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-12e4ef71-f93c-4b05-a112-2be245ffe012 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:20.449306 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-12e4ef71-f93c-4b05-a112-2be245ffe012 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:20.449306 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-12e4ef71-f93c-4b05-a112-2be245ffe012 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:20.449306 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-12e4ef71-f93c-4b05-a112-2be245ffe012 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:20.450353 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-12e4ef71-f93c-4b05-a112-2be245ffe012 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:20.778390 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-12e4ef71-f93c-4b05-a112-2be245ffe012 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:20.793741 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-93736e52-f922-41c5-b69d-f24d6e2ccf25 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d5e996e9-dc9f-46e3-8469-e46dc2932b24" status: 204 len: 0 microversion: 2.1 time: 0.436820 Oct 04 18:32:20.794340 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 541/1118] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:32:20 2022] DELETE /compute/v2.1/servers/d5e996e9-dc9f-46e3-8469-e46dc2932b24 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:32:20.796578 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-12e4ef71-f93c-4b05-a112-2be245ffe012 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/4e1bb5af-9b8b-456f-beb1-aadf2491a8ed" status: 200 len: 1504 microversion: 2.1 time: 0.374584 Oct 04 18:32:20.799139 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 578/1119] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:20 2022] GET /compute/v2.1/servers/4e1bb5af-9b8b-456f-beb1-aadf2491a8ed => generated 1504 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:20.803633 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-03010699-f1b6-4470-a5d6-bdbd3b88e68b req-055facad-3cdf-4d8f-bf7c-6d222b63cc89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "156c9c3a-ac54-4499-91fe-161cffddbf12", "name": "network-vif-plugged", "status": "completed", "tag": "bcc6e3df-34b1-4330-a2a2-9dcdc9fe670d"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:20.805812 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-fdd17ad6-62d8-4537-9f6d-d739247beaec tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:20.807042 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-fdd17ad6-62d8-4537-9f6d-d739247beaec tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] [instance: c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:20.816294 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fdd17ad6-62d8-4537-9f6d-d739247beaec tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:20.817071 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fdd17ad6-62d8-4537-9f6d-d739247beaec tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:20.818325 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fdd17ad6-62d8-4537-9f6d-d739247beaec tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:20.820892 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fdd17ad6-62d8-4537-9f6d-d739247beaec tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:20.821684 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fdd17ad6-62d8-4537-9f6d-d739247beaec tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:20.822561 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fdd17ad6-62d8-4537-9f6d-d739247beaec tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:20.827603 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-03010699-f1b6-4470-a5d6-bdbd3b88e68b req-055facad-3cdf-4d8f-bf7c-6d222b63cc89 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:20.828456 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-03010699-f1b6-4470-a5d6-bdbd3b88e68b req-055facad-3cdf-4d8f-bf7c-6d222b63cc89 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:20.829248 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-03010699-f1b6-4470-a5d6-bdbd3b88e68b req-055facad-3cdf-4d8f-bf7c-6d222b63cc89 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:20.841991 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-fdd17ad6-62d8-4537-9f6d-d739247beaec tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] HTTP exception thrown: Instance c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23 could not be found. Oct 04 18:32:20.843519 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-03010699-f1b6-4470-a5d6-bdbd3b88e68b req-055facad-3cdf-4d8f-bf7c-6d222b63cc89 service nova] Creating event network-vif-plugged:bcc6e3df-34b1-4330-a2a2-9dcdc9fe670d for instance 156c9c3a-ac54-4499-91fe-161cffddbf12 on n-h1-850501-14 Oct 04 18:32:20.844618 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-fdd17ad6-62d8-4537-9f6d-d739247beaec tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Request method failure captured: Oct 04 18:32:20.844618 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23 HTTP/1.1 Oct 04 18:32:20.844618 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:32:20.844618 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:32:20.844618 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:32:20.844618 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:32:20.844618 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:32:20.844618 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:32:20.844618 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:32:20.844618 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:20.844618 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPHsoNGzrvUqs2pIRqxf7EtUMbzGy9-E1i_MbrGs3ARVKGSUEnV-5BSMRTg8OaxNPSOMe1uajVasTPKuG59E8P3vEFTGx4g6H7tsHtGNwLLuR_45skTAdTaqNdX2uQfgIrXuXZHDdvSj-OSqPlbIsRexyr6eNOqQf4Y4_TGOHISPReuA Oct 04 18:32:20.844618 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:32:20.844618 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:32:20.844618 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:32:20.844618 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:32:20.844618 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:32:20.844618 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:32:20.844618 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 25214dec3ef24597be8e5acde61de3eb Oct 04 18:32:20.844618 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-915896807 Oct 04 18:32:20.844618 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:32:20.844618 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:32:20.844618 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/25214dec3ef24597be8e5acde61de3eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_25214dec3ef24597be8e5acde61de3eb", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/25214dec3ef24597be8e5acde61de3eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/25214dec3ef24597be8e5acde61de3eb"}]}] Oct 04 18:32:20.844618 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-915896807 Oct 04 18:32:20.844618 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 25214dec3ef24597be8e5acde61de3eb Oct 04 18:32:20.844618 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-915896807 Oct 04 18:32:20.844618 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServersWithSpecificFlavorTestJSON-915896807-project Oct 04 18:32:20.844618 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:32:20.844618 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:32:20.844618 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 8675d7d8bab840f3a221fdf2ee4c9b5c Oct 04 18:32:20.844618 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-915896807-project Oct 04 18:32:20.844618 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:32:20.844618 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23 could not be found. Oct 04 18:32:20.844618 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23'} Oct 04 18:32:20.844618 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:20.844618 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:20.844618 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:32:20.844618 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:32:20.844618 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:32:20.844618 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:32:20.844618 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:32:20.844618 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:32:20.844618 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:32:20.844618 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:32:20.844618 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23 could not be found. Oct 04 18:32:20.844618 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:20.844618 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:20.844618 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:20.844618 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:20.844618 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:20.844618 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:20.844618 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:20.844618 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:20.844618 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:20.844618 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:20.844618 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:32:20.844618 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:32:20.844618 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:32:20.844618 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:32:20.844618 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:32:20.844618 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:32:20.844618 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23 could not be found. Oct 04 18:32:20.844618 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:20.844618 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:20.849016 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:20.849016 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:20.849016 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:20.849016 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:20.849016 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:32:20.849016 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:32:20.849016 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23 could not be found. Oct 04 18:32:20.849016 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:20.849016 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-fdd17ad6-62d8-4537-9f6d-d739247beaec tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Returning 404 to user: Instance c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:20.849016 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-fdd17ad6-62d8-4537-9f6d-d739247beaec tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] 10.222.0.20 "GET /compute/v2.1/servers/c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23" status: 404 len: 111 microversion: 2.1 time: 0.045833 Oct 04 18:32:20.849016 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 579/1120] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:20 2022] GET /compute/v2.1/servers/c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:32:20.854217 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-8c745e68-bdff-445e-a0cf-c501561bb1a6 req-29d0a901-62f4-4f79-a1ef-edd139921d70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e1bb5af-9b8b-456f-beb1-aadf2491a8ed", "name": "network-vif-unplugged", "status": "completed", "tag": "1fbe8b1c-48fa-4c89-bb2c-cf691330a2a8"}, {"name": "network-changed", "server_uuid": "4e1bb5af-9b8b-456f-beb1-aadf2491a8ed", "tag": "1fbe8b1c-48fa-4c89-bb2c-cf691330a2a8"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:20.856253 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-03010699-f1b6-4470-a5d6-bdbd3b88e68b req-055facad-3cdf-4d8f-bf7c-6d222b63cc89 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059958 Oct 04 18:32:20.857626 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 542/1121] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:32:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:20.864849 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-aba43375-a635-4a94-ba01-abbedc8f57a7 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:20.871227 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-aba43375-a635-4a94-ba01-abbedc8f57a7 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: 2d07c478-8e9c-4000-92bb-3fa4547ea6c0] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:20.880022 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aba43375-a635-4a94-ba01-abbedc8f57a7 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:20.880791 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aba43375-a635-4a94-ba01-abbedc8f57a7 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:20.882474 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aba43375-a635-4a94-ba01-abbedc8f57a7 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:20.883664 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aba43375-a635-4a94-ba01-abbedc8f57a7 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:20.884545 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aba43375-a635-4a94-ba01-abbedc8f57a7 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:20.884793 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-8c745e68-bdff-445e-a0cf-c501561bb1a6 req-29d0a901-62f4-4f79-a1ef-edd139921d70 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:20.885397 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-8c745e68-bdff-445e-a0cf-c501561bb1a6 req-29d0a901-62f4-4f79-a1ef-edd139921d70 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:20.885645 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aba43375-a635-4a94-ba01-abbedc8f57a7 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:20.885906 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-8c745e68-bdff-445e-a0cf-c501561bb1a6 req-29d0a901-62f4-4f79-a1ef-edd139921d70 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:20.903190 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-8c745e68-bdff-445e-a0cf-c501561bb1a6 req-29d0a901-62f4-4f79-a1ef-edd139921d70 service nova] Creating event network-vif-unplugged:1fbe8b1c-48fa-4c89-bb2c-cf691330a2a8 for instance 4e1bb5af-9b8b-456f-beb1-aadf2491a8ed on n-h1-850501-14 Oct 04 18:32:20.904137 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-8c745e68-bdff-445e-a0cf-c501561bb1a6 req-29d0a901-62f4-4f79-a1ef-edd139921d70 service nova] Creating event network-changed:1fbe8b1c-48fa-4c89-bb2c-cf691330a2a8 for instance 4e1bb5af-9b8b-456f-beb1-aadf2491a8ed on n-h1-850501-14 Oct 04 18:32:20.909885 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-8c745e68-bdff-445e-a0cf-c501561bb1a6 req-29d0a901-62f4-4f79-a1ef-edd139921d70 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.061496 Oct 04 18:32:20.911007 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 580/1122] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:32:20 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:20.927040 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-395cac80-9e6d-408d-9335-d634e4feebf0 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:20.928635 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-395cac80-9e6d-408d-9335-d634e4feebf0 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] [instance: ff1c16fb-1167-4285-8d0c-c0fbb78a2883] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:20.940709 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-395cac80-9e6d-408d-9335-d634e4feebf0 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:20.941520 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-395cac80-9e6d-408d-9335-d634e4feebf0 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:20.942283 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-395cac80-9e6d-408d-9335-d634e4feebf0 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:20.944342 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-395cac80-9e6d-408d-9335-d634e4feebf0 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:20.945462 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-395cac80-9e6d-408d-9335-d634e4feebf0 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:20.946094 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-395cac80-9e6d-408d-9335-d634e4feebf0 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:20.967755 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-395cac80-9e6d-408d-9335-d634e4feebf0 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] HTTP exception thrown: Instance ff1c16fb-1167-4285-8d0c-c0fbb78a2883 could not be found. Oct 04 18:32:20.969541 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-395cac80-9e6d-408d-9335-d634e4feebf0 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Request method failure captured: Oct 04 18:32:20.969541 n-d-850501-14 devstack@n-api.service[123002]: request: DELETE /compute/v2.1/servers/ff1c16fb-1167-4285-8d0c-c0fbb78a2883 HTTP/1.1 Oct 04 18:32:20.969541 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:32:20.969541 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:32:20.969541 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:32:20.969541 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:32:20.969541 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:32:20.969541 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:32:20.969541 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:32:20.969541 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:20.969541 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPHsoNGzrvUqs2pIRqxf7EtUMbzGy9-E1i_MbrGs3ARVKGSUEnV-5BSMRTg8OaxNPSOMe1uajVasTPKuG59E8P3vEFTGx4g6H7tsHtGNwLLuR_45skTAdTaqNdX2uQfgIrXuXZHDdvSj-OSqPlbIsRexyr6eNOqQf4Y4_TGOHISPReuA Oct 04 18:32:20.969541 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:32:20.969541 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:32:20.969541 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:32:20.969541 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:32:20.969541 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:32:20.969541 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:32:20.969541 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 25214dec3ef24597be8e5acde61de3eb Oct 04 18:32:20.969541 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-915896807 Oct 04 18:32:20.969541 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:32:20.969541 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:32:20.969541 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/25214dec3ef24597be8e5acde61de3eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_25214dec3ef24597be8e5acde61de3eb", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/25214dec3ef24597be8e5acde61de3eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/25214dec3ef24597be8e5acde61de3eb"}]}] Oct 04 18:32:20.969541 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-915896807 Oct 04 18:32:20.969541 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 25214dec3ef24597be8e5acde61de3eb Oct 04 18:32:20.969541 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-915896807 Oct 04 18:32:20.969541 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServersWithSpecificFlavorTestJSON-915896807-project Oct 04 18:32:20.969541 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:32:20.969541 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:32:20.969541 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 8675d7d8bab840f3a221fdf2ee4c9b5c Oct 04 18:32:20.969541 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-915896807-project Oct 04 18:32:20.969541 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:32:20.969541 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance ff1c16fb-1167-4285-8d0c-c0fbb78a2883 could not be found. Oct 04 18:32:20.969541 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'ff1c16fb-1167-4285-8d0c-c0fbb78a2883'} Oct 04 18:32:20.969541 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:20.969541 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:20.969541 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:32:20.969541 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:32:20.969541 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:32:20.969541 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:32:20.969541 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:32:20.969541 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:32:20.969541 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:32:20.969541 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:32:20.969541 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff1c16fb-1167-4285-8d0c-c0fbb78a2883 could not be found. Oct 04 18:32:20.969541 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:20.969541 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:20.969541 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:20.969541 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:20.969541 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:20.969541 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:20.969541 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:20.969541 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:20.969541 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:20.969541 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:20.969541 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:32:20.969541 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:32:20.969541 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:32:20.969541 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:32:20.969541 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:32:20.969541 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:32:20.969541 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:32:20.969541 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:32:20.973623 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff1c16fb-1167-4285-8d0c-c0fbb78a2883 could not be found. Oct 04 18:32:20.973623 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:20.973623 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:20.973623 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:20.973623 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:20.973623 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:20.973623 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:20.973623 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:32:20.973623 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:32:20.973623 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff1c16fb-1167-4285-8d0c-c0fbb78a2883 could not be found. Oct 04 18:32:20.973623 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:20.975415 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-395cac80-9e6d-408d-9335-d634e4feebf0 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Returning 404 to user: Instance ff1c16fb-1167-4285-8d0c-c0fbb78a2883 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:20.976658 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-395cac80-9e6d-408d-9335-d634e4feebf0 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ff1c16fb-1167-4285-8d0c-c0fbb78a2883" status: 404 len: 111 microversion: 2.1 time: 0.064551 Oct 04 18:32:20.977917 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 581/1123] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:32:20 2022] DELETE /compute/v2.1/servers/ff1c16fb-1167-4285-8d0c-c0fbb78a2883 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:32:20.989599 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5e7f32c5-d820-4348-a7aa-93e595c53c0e tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:20.991860 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5e7f32c5-d820-4348-a7aa-93e595c53c0e tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] [instance: ff1c16fb-1167-4285-8d0c-c0fbb78a2883] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:21.008185 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5e7f32c5-d820-4348-a7aa-93e595c53c0e tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:21.008987 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5e7f32c5-d820-4348-a7aa-93e595c53c0e tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:21.009783 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5e7f32c5-d820-4348-a7aa-93e595c53c0e tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:21.016576 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5e7f32c5-d820-4348-a7aa-93e595c53c0e tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:21.018789 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5e7f32c5-d820-4348-a7aa-93e595c53c0e tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:21.024741 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5e7f32c5-d820-4348-a7aa-93e595c53c0e tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:21.042618 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-5e7f32c5-d820-4348-a7aa-93e595c53c0e tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] HTTP exception thrown: Instance ff1c16fb-1167-4285-8d0c-c0fbb78a2883 could not be found. Oct 04 18:32:21.050618 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5e7f32c5-d820-4348-a7aa-93e595c53c0e tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Request method failure captured: Oct 04 18:32:21.050618 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/ff1c16fb-1167-4285-8d0c-c0fbb78a2883 HTTP/1.1 Oct 04 18:32:21.050618 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:32:21.050618 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:32:21.050618 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:32:21.050618 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:32:21.050618 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:32:21.050618 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:32:21.050618 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:32:21.050618 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:21.050618 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPHsoNGzrvUqs2pIRqxf7EtUMbzGy9-E1i_MbrGs3ARVKGSUEnV-5BSMRTg8OaxNPSOMe1uajVasTPKuG59E8P3vEFTGx4g6H7tsHtGNwLLuR_45skTAdTaqNdX2uQfgIrXuXZHDdvSj-OSqPlbIsRexyr6eNOqQf4Y4_TGOHISPReuA Oct 04 18:32:21.050618 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:32:21.050618 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:32:21.050618 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:32:21.050618 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:32:21.050618 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:32:21.050618 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:32:21.050618 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 25214dec3ef24597be8e5acde61de3eb Oct 04 18:32:21.050618 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-915896807 Oct 04 18:32:21.050618 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:32:21.050618 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:32:21.050618 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/25214dec3ef24597be8e5acde61de3eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_25214dec3ef24597be8e5acde61de3eb", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/25214dec3ef24597be8e5acde61de3eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/25214dec3ef24597be8e5acde61de3eb"}]}] Oct 04 18:32:21.050618 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-915896807 Oct 04 18:32:21.050618 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 25214dec3ef24597be8e5acde61de3eb Oct 04 18:32:21.050618 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-915896807 Oct 04 18:32:21.050618 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServersWithSpecificFlavorTestJSON-915896807-project Oct 04 18:32:21.050618 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:32:21.050618 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:32:21.050618 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 8675d7d8bab840f3a221fdf2ee4c9b5c Oct 04 18:32:21.050618 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-915896807-project Oct 04 18:32:21.050618 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:32:21.050618 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance ff1c16fb-1167-4285-8d0c-c0fbb78a2883 could not be found. Oct 04 18:32:21.050618 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'ff1c16fb-1167-4285-8d0c-c0fbb78a2883'} Oct 04 18:32:21.050618 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:21.050618 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:21.050618 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:32:21.050618 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:32:21.050618 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:32:21.050618 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:32:21.050618 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:32:21.050618 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:32:21.050618 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:32:21.050618 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:32:21.050618 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff1c16fb-1167-4285-8d0c-c0fbb78a2883 could not be found. Oct 04 18:32:21.050618 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:21.050618 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:21.050618 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:21.050618 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:21.050618 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:21.050618 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:21.050618 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:21.050618 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:21.050618 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:21.050618 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:21.050618 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:32:21.050618 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:32:21.050618 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:32:21.050618 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:32:21.050618 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:32:21.050618 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:32:21.050618 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff1c16fb-1167-4285-8d0c-c0fbb78a2883 could not be found. Oct 04 18:32:21.050618 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:21.050618 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:21.056624 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:21.056624 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:21.056624 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:21.056624 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:21.056624 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:32:21.056624 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:32:21.056624 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff1c16fb-1167-4285-8d0c-c0fbb78a2883 could not be found. Oct 04 18:32:21.056624 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:21.059848 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5e7f32c5-d820-4348-a7aa-93e595c53c0e tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Returning 404 to user: Instance ff1c16fb-1167-4285-8d0c-c0fbb78a2883 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:21.061021 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5e7f32c5-d820-4348-a7aa-93e595c53c0e tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] 10.222.0.20 "GET /compute/v2.1/servers/ff1c16fb-1167-4285-8d0c-c0fbb78a2883" status: 404 len: 111 microversion: 2.1 time: 0.075718 Oct 04 18:32:21.062108 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 582/1124] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:20 2022] GET /compute/v2.1/servers/ff1c16fb-1167-4285-8d0c-c0fbb78a2883 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:32:21.067662 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-226d3a67-ead2-4d30-90b1-bf1f1aa9089e tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '.version_select at 0x7fe259708af0>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:21.166256 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-226d3a67-ead2-4d30-90b1-bf1f1aa9089e tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/images/cabaf7e6-9081-4a33-8415-4c717517ad62" status: 200 len: 1414 microversion: 2.1 time: 0.102742 Oct 04 18:32:21.175149 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 583/1125] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:32:21 2022] GET /compute/v2.1/images/cabaf7e6-9081-4a33-8415-4c717517ad62 => generated 1414 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:21.181579 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-77d80862-98c0-4696-900b-03ba0ae69af2 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Calling method '.version_select at 0x7fe25a580790>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:21.214782 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-aba43375-a635-4a94-ba01-abbedc8f57a7 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:21.234992 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-aba43375-a635-4a94-ba01-abbedc8f57a7 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/2d07c478-8e9c-4000-92bb-3fa4547ea6c0" status: 200 len: 1475 microversion: 2.1 time: 0.375780 Oct 04 18:32:21.236346 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 543/1126] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:20 2022] GET /compute/v2.1/servers/2d07c478-8e9c-4000-92bb-3fa4547ea6c0 => generated 1475 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:21.294375 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-77d80862-98c0-4696-900b-03ba0ae69af2 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1365947858" status: 202 len: 0 microversion: 2.1 time: 0.117489 Oct 04 18:32:21.298014 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 584/1127] 10.222.0.20 () {58 vars in 1221 bytes} [Tue Oct 4 18:32:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1365947858 => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:32:21.382958 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-19da8966-6d2f-4896-a213-8f1a2426f800 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:21.384165 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-19da8966-6d2f-4896-a213-8f1a2426f800 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: b219d988-2847-45a0-a3b8-af54cf1a43f8] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:21.410202 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-19da8966-6d2f-4896-a213-8f1a2426f800 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:21.413923 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-19da8966-6d2f-4896-a213-8f1a2426f800 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:21.415607 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-19da8966-6d2f-4896-a213-8f1a2426f800 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:21.416672 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-19da8966-6d2f-4896-a213-8f1a2426f800 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:21.417410 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-19da8966-6d2f-4896-a213-8f1a2426f800 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:21.418267 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-19da8966-6d2f-4896-a213-8f1a2426f800 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:21.449678 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-fbc5d842-0039-4274-a3ed-79d5f66e2775 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:21.450304 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-fbc5d842-0039-4274-a3ed-79d5f66e2775 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] [instance: 156c9c3a-ac54-4499-91fe-161cffddbf12] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:21.464502 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fbc5d842-0039-4274-a3ed-79d5f66e2775 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:21.464999 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fbc5d842-0039-4274-a3ed-79d5f66e2775 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:21.465439 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fbc5d842-0039-4274-a3ed-79d5f66e2775 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:21.466157 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fbc5d842-0039-4274-a3ed-79d5f66e2775 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:21.466616 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fbc5d842-0039-4274-a3ed-79d5f66e2775 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:21.469033 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fbc5d842-0039-4274-a3ed-79d5f66e2775 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:21.588972 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-19da8966-6d2f-4896-a213-8f1a2426f800 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:21.602515 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-19da8966-6d2f-4896-a213-8f1a2426f800 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:21.604669 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-19da8966-6d2f-4896-a213-8f1a2426f800 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:21.606193 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-19da8966-6d2f-4896-a213-8f1a2426f800 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8" status: 200 len: 1288 microversion: 2.25 time: 0.229185 Oct 04 18:32:21.617709 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 544/1128] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:32:21 2022] GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8 => generated 1288 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:32:21.708364 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-fbc5d842-0039-4274-a3ed-79d5f66e2775 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f49a275284a7eb714a55c6bdd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e44e7aa06ee4126b5705ba65145ebcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:21.717493 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-fbc5d842-0039-4274-a3ed-79d5f66e2775 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] 10.222.0.20 "GET /compute/v2.1/servers/156c9c3a-ac54-4499-91fe-161cffddbf12" status: 200 len: 1324 microversion: 2.1 time: 0.271643 Oct 04 18:32:21.718367 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 585/1129] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:21 2022] GET /compute/v2.1/servers/156c9c3a-ac54-4499-91fe-161cffddbf12 => generated 1324 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:32:21.828080 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-38ddde17-c73f-40bd-9969-8564e282d488 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:21.829187 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-38ddde17-c73f-40bd-9969-8564e282d488 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 4e1bb5af-9b8b-456f-beb1-aadf2491a8ed] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:21.837870 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-38ddde17-c73f-40bd-9969-8564e282d488 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:21.838554 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-38ddde17-c73f-40bd-9969-8564e282d488 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:21.839007 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-38ddde17-c73f-40bd-9969-8564e282d488 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:21.839721 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-38ddde17-c73f-40bd-9969-8564e282d488 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:21.840298 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-38ddde17-c73f-40bd-9969-8564e282d488 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:21.840759 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-38ddde17-c73f-40bd-9969-8564e282d488 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:22.034633 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-38ddde17-c73f-40bd-9969-8564e282d488 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:22.044984 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-38ddde17-c73f-40bd-9969-8564e282d488 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/4e1bb5af-9b8b-456f-beb1-aadf2491a8ed" status: 200 len: 1504 microversion: 2.1 time: 0.223154 Oct 04 18:32:22.045578 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 545/1130] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:21 2022] GET /compute/v2.1/servers/4e1bb5af-9b8b-456f-beb1-aadf2491a8ed => generated 1504 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:22.182772 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8983799e-1164-4056-99b1-5136e70bef46 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '.version_select at 0x7fe2597b5280>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:22.235833 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8983799e-1164-4056-99b1-5136e70bef46 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/images/cabaf7e6-9081-4a33-8415-4c717517ad62" status: 200 len: 1414 microversion: 2.1 time: 0.057486 Oct 04 18:32:22.237098 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 586/1131] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:32:22 2022] GET /compute/v2.1/images/cabaf7e6-9081-4a33-8415-4c717517ad62 => generated 1414 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:32:22.268439 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d8294524-2408-4c7d-812f-a79388765c1d tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:22.271119 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d8294524-2408-4c7d-812f-a79388765c1d tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: 2d07c478-8e9c-4000-92bb-3fa4547ea6c0] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:22.280348 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d8294524-2408-4c7d-812f-a79388765c1d tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:22.280869 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d8294524-2408-4c7d-812f-a79388765c1d tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:22.284925 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d8294524-2408-4c7d-812f-a79388765c1d tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:22.285931 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d8294524-2408-4c7d-812f-a79388765c1d tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:22.294100 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d8294524-2408-4c7d-812f-a79388765c1d tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:22.294100 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d8294524-2408-4c7d-812f-a79388765c1d tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:22.562839 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d8294524-2408-4c7d-812f-a79388765c1d tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:22.573056 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d8294524-2408-4c7d-812f-a79388765c1d tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/2d07c478-8e9c-4000-92bb-3fa4547ea6c0" status: 200 len: 1433 microversion: 2.1 time: 0.316727 Oct 04 18:32:22.575964 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 546/1132] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:22 2022] GET /compute/v2.1/servers/2d07c478-8e9c-4000-92bb-3fa4547ea6c0 => generated 1433 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:22.632554 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-57a830d1-37b0-4d59-ae33-c6e4cda14b15 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:22.633168 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-57a830d1-37b0-4d59-ae33-c6e4cda14b15 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: b219d988-2847-45a0-a3b8-af54cf1a43f8] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:22.652874 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-57a830d1-37b0-4d59-ae33-c6e4cda14b15 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:22.652874 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-57a830d1-37b0-4d59-ae33-c6e4cda14b15 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:22.653100 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-57a830d1-37b0-4d59-ae33-c6e4cda14b15 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:22.665090 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-57a830d1-37b0-4d59-ae33-c6e4cda14b15 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:22.665090 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-57a830d1-37b0-4d59-ae33-c6e4cda14b15 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:22.665090 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-57a830d1-37b0-4d59-ae33-c6e4cda14b15 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:22.763227 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-953a450a-fe38-4ebf-936e-ae893e274e5d tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:22.763227 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-953a450a-fe38-4ebf-936e-ae893e274e5d tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] [instance: 156c9c3a-ac54-4499-91fe-161cffddbf12] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:22.763227 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-953a450a-fe38-4ebf-936e-ae893e274e5d tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:22.763227 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-953a450a-fe38-4ebf-936e-ae893e274e5d tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:22.763227 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-953a450a-fe38-4ebf-936e-ae893e274e5d tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:22.764002 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-953a450a-fe38-4ebf-936e-ae893e274e5d tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:22.764002 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-953a450a-fe38-4ebf-936e-ae893e274e5d tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:22.769302 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-953a450a-fe38-4ebf-936e-ae893e274e5d tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:23.241095 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-57a830d1-37b0-4d59-ae33-c6e4cda14b15 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:23.251051 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-57a830d1-37b0-4d59-ae33-c6e4cda14b15 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:23.252908 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-57a830d1-37b0-4d59-ae33-c6e4cda14b15 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:23.254165 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-57a830d1-37b0-4d59-ae33-c6e4cda14b15 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8" status: 200 len: 1336 microversion: 2.25 time: 0.626036 Oct 04 18:32:23.254796 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 587/1133] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:32:22 2022] GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8 => generated 1336 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:32:23.260768 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-feab626d-9ef5-4041-96e3-4c7a2513c91f tempest-ServersWithSpecificFlavorTestJSON-755179089 tempest-ServersWithSpecificFlavorTestJSON-755179089-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:23.414071 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-953a450a-fe38-4ebf-936e-ae893e274e5d tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f49a275284a7eb714a55c6bdd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e44e7aa06ee4126b5705ba65145ebcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:23.423388 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-953a450a-fe38-4ebf-936e-ae893e274e5d tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] 10.222.0.20 "GET /compute/v2.1/servers/156c9c3a-ac54-4499-91fe-161cffddbf12" status: 200 len: 1324 microversion: 2.1 time: 0.678285 Oct 04 18:32:23.425198 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 547/1134] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:22 2022] GET /compute/v2.1/servers/156c9c3a-ac54-4499-91fe-161cffddbf12 => generated 1324 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:32:23.430418 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-fc3c4bc6-1ac4-48dc-88fa-501083babb34 req-278d55ae-5b2a-4add-8146-3a83cf214def service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d07c478-8e9c-4000-92bb-3fa4547ea6c0", "name": "network-vif-deleted", "tag": "0f86385e-8401-4a2d-ab06-7b090939385b"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:23.443076 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-fc3c4bc6-1ac4-48dc-88fa-501083babb34 req-278d55ae-5b2a-4add-8146-3a83cf214def service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:23.444378 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-fc3c4bc6-1ac4-48dc-88fa-501083babb34 req-278d55ae-5b2a-4add-8146-3a83cf214def service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:23.445170 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-fc3c4bc6-1ac4-48dc-88fa-501083babb34 req-278d55ae-5b2a-4add-8146-3a83cf214def service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:23.460886 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-fc3c4bc6-1ac4-48dc-88fa-501083babb34 req-278d55ae-5b2a-4add-8146-3a83cf214def service nova] Creating event network-vif-deleted:0f86385e-8401-4a2d-ab06-7b090939385b for instance 2d07c478-8e9c-4000-92bb-3fa4547ea6c0 on n-h1-850501-14 Oct 04 18:32:23.467041 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-fc3c4bc6-1ac4-48dc-88fa-501083babb34 req-278d55ae-5b2a-4add-8146-3a83cf214def service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040044 Oct 04 18:32:23.467882 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 548/1135] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:32:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:23.477303 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f632b744-62c3-4d97-bf65-1450806c7932 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:23.478387 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f632b744-62c3-4d97-bf65-1450806c7932 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 4e1bb5af-9b8b-456f-beb1-aadf2491a8ed] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:23.485485 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f632b744-62c3-4d97-bf65-1450806c7932 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:23.491642 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f632b744-62c3-4d97-bf65-1450806c7932 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:23.491642 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f632b744-62c3-4d97-bf65-1450806c7932 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:23.491642 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f632b744-62c3-4d97-bf65-1450806c7932 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:23.491642 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f632b744-62c3-4d97-bf65-1450806c7932 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:23.491642 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f632b744-62c3-4d97-bf65-1450806c7932 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:23.520905 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:23.581946 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-feab626d-9ef5-4041-96e3-4c7a2513c91f tempest-ServersWithSpecificFlavorTestJSON-755179089 tempest-ServersWithSpecificFlavorTestJSON-755179089-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1102270088" status: 202 len: 0 microversion: 2.1 time: 0.325871 Oct 04 18:32:23.582601 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 588/1136] 10.222.0.20 () {58 vars in 1161 bytes} [Tue Oct 4 18:32:23 2022] DELETE /compute/v2.1/flavors/1102270088 => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:32:23.588821 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a10f5150-0918-400f-a792-d6307eb52372 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '.version_select at 0x7fe259870160>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:23.654468 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a10f5150-0918-400f-a792-d6307eb52372 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/images/cabaf7e6-9081-4a33-8415-4c717517ad62" status: 200 len: 1414 microversion: 2.1 time: 0.070108 Oct 04 18:32:23.670275 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 589/1137] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:32:23 2022] GET /compute/v2.1/images/cabaf7e6-9081-4a33-8415-4c717517ad62 => generated 1414 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:23.677377 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-93b6752d-9a56-49f9-a5f6-1e7b7cfcab89 tempest-ServersWithSpecificFlavorTestJSON-755179089 tempest-ServersWithSpecificFlavorTestJSON-755179089-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:23.708280 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-93b6752d-9a56-49f9-a5f6-1e7b7cfcab89 tempest-ServersWithSpecificFlavorTestJSON-755179089 tempest-ServersWithSpecificFlavorTestJSON-755179089-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5404 microversion: 2.1 time: 0.033394 Oct 04 18:32:23.708280 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 590/1138] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Oct 4 18:32:23 2022] GET /compute/v2.1/flavors/detail => generated 5404 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:23.710884 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-87187bc5-37dd-4e21-b68c-efe9ca438095 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:23.711701 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-87187bc5-37dd-4e21-b68c-efe9ca438095 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: 2d07c478-8e9c-4000-92bb-3fa4547ea6c0] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:23.727041 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-87187bc5-37dd-4e21-b68c-efe9ca438095 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:23.727908 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-87187bc5-37dd-4e21-b68c-efe9ca438095 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:23.728553 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-87187bc5-37dd-4e21-b68c-efe9ca438095 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:23.729819 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-87187bc5-37dd-4e21-b68c-efe9ca438095 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:23.730443 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-87187bc5-37dd-4e21-b68c-efe9ca438095 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:23.731187 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-87187bc5-37dd-4e21-b68c-efe9ca438095 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:23.752335 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f632b744-62c3-4d97-bf65-1450806c7932 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:23.771242 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f632b744-62c3-4d97-bf65-1450806c7932 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/4e1bb5af-9b8b-456f-beb1-aadf2491a8ed" status: 200 len: 1504 microversion: 2.1 time: 0.298187 Oct 04 18:32:23.772660 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 549/1139] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:23 2022] GET /compute/v2.1/servers/4e1bb5af-9b8b-456f-beb1-aadf2491a8ed => generated 1504 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:23.778463 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a8486423-eb84-49f6-b001-18a53d8372fc tempest-ServersWithSpecificFlavorTestJSON-755179089 tempest-ServersWithSpecificFlavorTestJSON-755179089-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:23.786664 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-87187bc5-37dd-4e21-b68c-efe9ca438095 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:23.787019 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-87187bc5-37dd-4e21-b68c-efe9ca438095 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:23.788100 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-87187bc5-37dd-4e21-b68c-efe9ca438095 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:23.789498 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-87187bc5-37dd-4e21-b68c-efe9ca438095 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lazy-loading 'fault' on Instance uuid 2d07c478-8e9c-4000-92bb-3fa4547ea6c0 {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:32:23.842537 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-87187bc5-37dd-4e21-b68c-efe9ca438095 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:23.866396 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-87187bc5-37dd-4e21-b68c-efe9ca438095 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/2d07c478-8e9c-4000-92bb-3fa4547ea6c0" status: 200 len: 1309 microversion: 2.1 time: 0.158757 Oct 04 18:32:23.871284 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 591/1140] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:23 2022] GET /compute/v2.1/servers/2d07c478-8e9c-4000-92bb-3fa4547ea6c0 => generated 1309 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:23.943731 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a8486423-eb84-49f6-b001-18a53d8372fc tempest-ServersWithSpecificFlavorTestJSON-755179089 tempest-ServersWithSpecificFlavorTestJSON-755179089-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1799497983" status: 202 len: 0 microversion: 2.1 time: 0.168868 Oct 04 18:32:23.948778 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 550/1141] 10.222.0.20 () {58 vars in 1161 bytes} [Tue Oct 4 18:32:23 2022] DELETE /compute/v2.1/flavors/1799497983 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:32:23.953183 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0971478c-8cb7-4ca0-b481-329ed0b9b92f tempest-ServersWithSpecificFlavorTestJSON-755179089 tempest-ServersWithSpecificFlavorTestJSON-755179089-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:23.984628 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0971478c-8cb7-4ca0-b481-329ed0b9b92f tempest-ServersWithSpecificFlavorTestJSON-755179089 tempest-ServersWithSpecificFlavorTestJSON-755179089-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.035272 Oct 04 18:32:23.985517 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 592/1142] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Oct 4 18:32:23 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:32:24.021327 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a3d1aeb6-a803-4cd2-bea1-095714f22d05 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:24.022621 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a3d1aeb6-a803-4cd2-bea1-095714f22d05 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] [instance: c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:24.029267 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a3d1aeb6-a803-4cd2-bea1-095714f22d05 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:24.030048 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a3d1aeb6-a803-4cd2-bea1-095714f22d05 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:24.030728 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a3d1aeb6-a803-4cd2-bea1-095714f22d05 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:24.031817 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a3d1aeb6-a803-4cd2-bea1-095714f22d05 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:24.032601 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a3d1aeb6-a803-4cd2-bea1-095714f22d05 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:24.033237 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a3d1aeb6-a803-4cd2-bea1-095714f22d05 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:24.051255 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-a3d1aeb6-a803-4cd2-bea1-095714f22d05 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] HTTP exception thrown: Instance c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23 could not be found. Oct 04 18:32:24.055523 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a3d1aeb6-a803-4cd2-bea1-095714f22d05 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Request method failure captured: Oct 04 18:32:24.055523 n-d-850501-14 devstack@n-api.service[123001]: request: DELETE /compute/v2.1/servers/c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23 HTTP/1.1 Oct 04 18:32:24.055523 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:32:24.055523 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:32:24.055523 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:32:24.055523 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:32:24.055523 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:32:24.055523 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:32:24.055523 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:32:24.055523 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:24.055523 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPHsoNGzrvUqs2pIRqxf7EtUMbzGy9-E1i_MbrGs3ARVKGSUEnV-5BSMRTg8OaxNPSOMe1uajVasTPKuG59E8P3vEFTGx4g6H7tsHtGNwLLuR_45skTAdTaqNdX2uQfgIrXuXZHDdvSj-OSqPlbIsRexyr6eNOqQf4Y4_TGOHISPReuA Oct 04 18:32:24.055523 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:32:24.055523 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:32:24.055523 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:32:24.055523 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:32:24.055523 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:32:24.055523 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:32:24.055523 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 25214dec3ef24597be8e5acde61de3eb Oct 04 18:32:24.055523 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-915896807 Oct 04 18:32:24.055523 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:32:24.055523 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:32:24.055523 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/25214dec3ef24597be8e5acde61de3eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_25214dec3ef24597be8e5acde61de3eb", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/25214dec3ef24597be8e5acde61de3eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/25214dec3ef24597be8e5acde61de3eb"}]}] Oct 04 18:32:24.055523 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-915896807 Oct 04 18:32:24.055523 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 25214dec3ef24597be8e5acde61de3eb Oct 04 18:32:24.055523 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-915896807 Oct 04 18:32:24.055523 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ServersWithSpecificFlavorTestJSON-915896807-project Oct 04 18:32:24.055523 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:32:24.055523 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:32:24.055523 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 8675d7d8bab840f3a221fdf2ee4c9b5c Oct 04 18:32:24.055523 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-915896807-project Oct 04 18:32:24.055523 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:32:24.055523 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23 could not be found. Oct 04 18:32:24.055523 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': 'c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23'} Oct 04 18:32:24.055523 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:24.055523 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:24.055523 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:32:24.055523 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:32:24.055523 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:32:24.055523 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:32:24.055523 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:32:24.055523 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:32:24.055523 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:32:24.055523 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:32:24.055523 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23 could not be found. Oct 04 18:32:24.055523 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:32:24.055523 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:24.055523 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:32:24.055523 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:24.055523 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:24.055523 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:24.055523 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:24.055523 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:24.055523 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:24.055523 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:24.055523 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:32:24.055523 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:32:24.055523 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:32:24.055523 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:32:24.055523 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:32:24.055523 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:32:24.055523 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:32:24.055523 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:32:24.060528 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23 could not be found. Oct 04 18:32:24.060528 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:32:24.060528 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:24.060528 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:32:24.060528 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:24.060528 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:24.060528 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:24.060528 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:32:24.060528 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:32:24.060528 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23 could not be found. Oct 04 18:32:24.060528 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:32:24.063045 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a3d1aeb6-a803-4cd2-bea1-095714f22d05 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Returning 404 to user: Instance c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:24.064189 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a3d1aeb6-a803-4cd2-bea1-095714f22d05 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23" status: 404 len: 111 microversion: 2.1 time: 0.049662 Oct 04 18:32:24.065285 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 551/1143] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:32:24 2022] DELETE /compute/v2.1/servers/c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:32:24.074858 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-645ea6b2-1cf3-41a6-9c27-c0e84fc6fb7c tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:24.076142 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-645ea6b2-1cf3-41a6-9c27-c0e84fc6fb7c tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] [instance: c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:24.083134 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-645ea6b2-1cf3-41a6-9c27-c0e84fc6fb7c tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:24.083636 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-645ea6b2-1cf3-41a6-9c27-c0e84fc6fb7c tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:24.084096 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-645ea6b2-1cf3-41a6-9c27-c0e84fc6fb7c tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:24.086047 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-645ea6b2-1cf3-41a6-9c27-c0e84fc6fb7c tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:24.086507 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-645ea6b2-1cf3-41a6-9c27-c0e84fc6fb7c tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:24.087213 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-645ea6b2-1cf3-41a6-9c27-c0e84fc6fb7c tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:24.110104 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-645ea6b2-1cf3-41a6-9c27-c0e84fc6fb7c tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] HTTP exception thrown: Instance c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23 could not be found. Oct 04 18:32:24.113170 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-645ea6b2-1cf3-41a6-9c27-c0e84fc6fb7c tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Request method failure captured: Oct 04 18:32:24.113170 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23 HTTP/1.1 Oct 04 18:32:24.113170 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:32:24.113170 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:32:24.113170 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:32:24.113170 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:32:24.113170 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:32:24.113170 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:32:24.113170 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:32:24.113170 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:24.113170 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPHsoNGzrvUqs2pIRqxf7EtUMbzGy9-E1i_MbrGs3ARVKGSUEnV-5BSMRTg8OaxNPSOMe1uajVasTPKuG59E8P3vEFTGx4g6H7tsHtGNwLLuR_45skTAdTaqNdX2uQfgIrXuXZHDdvSj-OSqPlbIsRexyr6eNOqQf4Y4_TGOHISPReuA Oct 04 18:32:24.113170 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:32:24.113170 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:32:24.113170 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:32:24.113170 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:32:24.113170 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:32:24.113170 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:32:24.113170 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 25214dec3ef24597be8e5acde61de3eb Oct 04 18:32:24.113170 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-915896807 Oct 04 18:32:24.113170 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:32:24.113170 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:32:24.113170 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/25214dec3ef24597be8e5acde61de3eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_25214dec3ef24597be8e5acde61de3eb", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/25214dec3ef24597be8e5acde61de3eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/25214dec3ef24597be8e5acde61de3eb"}]}] Oct 04 18:32:24.113170 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-915896807 Oct 04 18:32:24.113170 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 25214dec3ef24597be8e5acde61de3eb Oct 04 18:32:24.113170 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-915896807 Oct 04 18:32:24.113170 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServersWithSpecificFlavorTestJSON-915896807-project Oct 04 18:32:24.113170 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:32:24.113170 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:32:24.113170 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 8675d7d8bab840f3a221fdf2ee4c9b5c Oct 04 18:32:24.113170 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-915896807-project Oct 04 18:32:24.113170 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:32:24.113170 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23 could not be found. Oct 04 18:32:24.113170 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23'} Oct 04 18:32:24.113170 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:24.113170 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:24.113170 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:32:24.113170 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:32:24.113170 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:32:24.113170 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:32:24.113170 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:32:24.113170 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:32:24.113170 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:32:24.113170 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:32:24.113170 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23 could not be found. Oct 04 18:32:24.113170 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:24.113170 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:24.113170 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:24.113170 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:24.113170 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:24.113170 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:24.113170 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:24.113170 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:24.113170 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:24.113170 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:24.113170 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:32:24.113170 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:32:24.113170 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:32:24.113170 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:32:24.113170 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:32:24.113170 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:32:24.113170 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23 could not be found. Oct 04 18:32:24.113170 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:24.113170 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:24.118560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:24.118560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:24.118560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:24.118560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:24.118560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:32:24.118560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:32:24.118560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23 could not be found. Oct 04 18:32:24.118560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:24.118560 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-645ea6b2-1cf3-41a6-9c27-c0e84fc6fb7c tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Returning 404 to user: Instance c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:24.118560 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-645ea6b2-1cf3-41a6-9c27-c0e84fc6fb7c tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] 10.222.0.20 "GET /compute/v2.1/servers/c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23" status: 404 len: 111 microversion: 2.1 time: 0.042641 Oct 04 18:32:24.118560 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 593/1144] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:24 2022] GET /compute/v2.1/servers/c7d273b6-1ddd-40b7-bcdc-8b2fdd771c23 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:32:24.123666 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-83cf5fa7-cdd6-4d19-bb0b-07403873e25c tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:24.124312 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-83cf5fa7-cdd6-4d19-bb0b-07403873e25c tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] [instance: ff1c16fb-1167-4285-8d0c-c0fbb78a2883] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:24.131970 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-83cf5fa7-cdd6-4d19-bb0b-07403873e25c tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:24.133039 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-83cf5fa7-cdd6-4d19-bb0b-07403873e25c tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:24.133758 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-83cf5fa7-cdd6-4d19-bb0b-07403873e25c tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:24.134788 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-83cf5fa7-cdd6-4d19-bb0b-07403873e25c tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:24.135926 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-83cf5fa7-cdd6-4d19-bb0b-07403873e25c tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:24.136628 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-83cf5fa7-cdd6-4d19-bb0b-07403873e25c tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:24.156577 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-83cf5fa7-cdd6-4d19-bb0b-07403873e25c tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] HTTP exception thrown: Instance ff1c16fb-1167-4285-8d0c-c0fbb78a2883 could not be found. Oct 04 18:32:24.158489 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-83cf5fa7-cdd6-4d19-bb0b-07403873e25c tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Request method failure captured: Oct 04 18:32:24.158489 n-d-850501-14 devstack@n-api.service[123001]: request: DELETE /compute/v2.1/servers/ff1c16fb-1167-4285-8d0c-c0fbb78a2883 HTTP/1.1 Oct 04 18:32:24.158489 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:32:24.158489 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:32:24.158489 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:32:24.158489 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:32:24.158489 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:32:24.158489 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:32:24.158489 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:32:24.158489 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:24.158489 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPHsoNGzrvUqs2pIRqxf7EtUMbzGy9-E1i_MbrGs3ARVKGSUEnV-5BSMRTg8OaxNPSOMe1uajVasTPKuG59E8P3vEFTGx4g6H7tsHtGNwLLuR_45skTAdTaqNdX2uQfgIrXuXZHDdvSj-OSqPlbIsRexyr6eNOqQf4Y4_TGOHISPReuA Oct 04 18:32:24.158489 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:32:24.158489 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:32:24.158489 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:32:24.158489 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:32:24.158489 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:32:24.158489 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:32:24.158489 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 25214dec3ef24597be8e5acde61de3eb Oct 04 18:32:24.158489 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-915896807 Oct 04 18:32:24.158489 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:32:24.158489 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:32:24.158489 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/25214dec3ef24597be8e5acde61de3eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_25214dec3ef24597be8e5acde61de3eb", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/25214dec3ef24597be8e5acde61de3eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/25214dec3ef24597be8e5acde61de3eb"}]}] Oct 04 18:32:24.158489 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-915896807 Oct 04 18:32:24.158489 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 25214dec3ef24597be8e5acde61de3eb Oct 04 18:32:24.158489 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-915896807 Oct 04 18:32:24.158489 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ServersWithSpecificFlavorTestJSON-915896807-project Oct 04 18:32:24.158489 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:32:24.158489 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:32:24.158489 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 8675d7d8bab840f3a221fdf2ee4c9b5c Oct 04 18:32:24.158489 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-915896807-project Oct 04 18:32:24.158489 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:32:24.158489 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance ff1c16fb-1167-4285-8d0c-c0fbb78a2883 could not be found. Oct 04 18:32:24.158489 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': 'ff1c16fb-1167-4285-8d0c-c0fbb78a2883'} Oct 04 18:32:24.158489 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:24.158489 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:24.158489 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:32:24.158489 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:32:24.158489 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:32:24.158489 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:32:24.158489 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:32:24.158489 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:32:24.158489 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:32:24.158489 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:32:24.158489 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff1c16fb-1167-4285-8d0c-c0fbb78a2883 could not be found. Oct 04 18:32:24.158489 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:32:24.158489 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:24.158489 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:32:24.158489 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:24.158489 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:24.158489 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:24.158489 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:24.158489 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:24.158489 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:24.158489 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:24.158489 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:32:24.158489 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:32:24.158489 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:32:24.158489 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:32:24.158489 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:32:24.158489 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:32:24.158489 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:32:24.158489 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:32:24.163464 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff1c16fb-1167-4285-8d0c-c0fbb78a2883 could not be found. Oct 04 18:32:24.163464 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:32:24.163464 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:24.163464 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:32:24.163464 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:24.163464 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:24.163464 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:24.163464 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:32:24.163464 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:32:24.163464 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff1c16fb-1167-4285-8d0c-c0fbb78a2883 could not be found. Oct 04 18:32:24.163464 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:32:24.165885 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-83cf5fa7-cdd6-4d19-bb0b-07403873e25c tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Returning 404 to user: Instance ff1c16fb-1167-4285-8d0c-c0fbb78a2883 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:24.167366 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-83cf5fa7-cdd6-4d19-bb0b-07403873e25c tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ff1c16fb-1167-4285-8d0c-c0fbb78a2883" status: 404 len: 111 microversion: 2.1 time: 0.048203 Oct 04 18:32:24.168512 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 552/1145] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:32:24 2022] DELETE /compute/v2.1/servers/ff1c16fb-1167-4285-8d0c-c0fbb78a2883 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:32:24.179182 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-51b92f5d-e3ab-45f7-aa4b-efd280cd0779 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:24.180101 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-51b92f5d-e3ab-45f7-aa4b-efd280cd0779 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] [instance: ff1c16fb-1167-4285-8d0c-c0fbb78a2883] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:24.192139 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-51b92f5d-e3ab-45f7-aa4b-efd280cd0779 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:24.192712 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-51b92f5d-e3ab-45f7-aa4b-efd280cd0779 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:24.193234 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-51b92f5d-e3ab-45f7-aa4b-efd280cd0779 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:24.195377 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-51b92f5d-e3ab-45f7-aa4b-efd280cd0779 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:24.195865 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-51b92f5d-e3ab-45f7-aa4b-efd280cd0779 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:24.196485 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-51b92f5d-e3ab-45f7-aa4b-efd280cd0779 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:24.214386 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-51b92f5d-e3ab-45f7-aa4b-efd280cd0779 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] HTTP exception thrown: Instance ff1c16fb-1167-4285-8d0c-c0fbb78a2883 could not be found. Oct 04 18:32:24.216219 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-51b92f5d-e3ab-45f7-aa4b-efd280cd0779 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Request method failure captured: Oct 04 18:32:24.216219 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/ff1c16fb-1167-4285-8d0c-c0fbb78a2883 HTTP/1.1 Oct 04 18:32:24.216219 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:32:24.216219 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:32:24.216219 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:32:24.216219 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:32:24.216219 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:32:24.216219 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:32:24.216219 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:32:24.216219 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:24.216219 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPHsoNGzrvUqs2pIRqxf7EtUMbzGy9-E1i_MbrGs3ARVKGSUEnV-5BSMRTg8OaxNPSOMe1uajVasTPKuG59E8P3vEFTGx4g6H7tsHtGNwLLuR_45skTAdTaqNdX2uQfgIrXuXZHDdvSj-OSqPlbIsRexyr6eNOqQf4Y4_TGOHISPReuA Oct 04 18:32:24.216219 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:32:24.216219 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:32:24.216219 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:32:24.216219 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:32:24.216219 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:32:24.216219 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:32:24.216219 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 25214dec3ef24597be8e5acde61de3eb Oct 04 18:32:24.216219 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-915896807 Oct 04 18:32:24.216219 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:32:24.216219 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:32:24.216219 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/25214dec3ef24597be8e5acde61de3eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_25214dec3ef24597be8e5acde61de3eb", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/25214dec3ef24597be8e5acde61de3eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/25214dec3ef24597be8e5acde61de3eb"}]}] Oct 04 18:32:24.216219 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-915896807 Oct 04 18:32:24.216219 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 25214dec3ef24597be8e5acde61de3eb Oct 04 18:32:24.216219 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-915896807 Oct 04 18:32:24.216219 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServersWithSpecificFlavorTestJSON-915896807-project Oct 04 18:32:24.216219 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:32:24.216219 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:32:24.216219 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 8675d7d8bab840f3a221fdf2ee4c9b5c Oct 04 18:32:24.216219 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-915896807-project Oct 04 18:32:24.216219 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:32:24.216219 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance ff1c16fb-1167-4285-8d0c-c0fbb78a2883 could not be found. Oct 04 18:32:24.216219 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'ff1c16fb-1167-4285-8d0c-c0fbb78a2883'} Oct 04 18:32:24.216219 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:24.216219 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:24.216219 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:32:24.216219 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:32:24.216219 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:32:24.216219 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:32:24.216219 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:32:24.216219 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:32:24.216219 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:32:24.216219 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:32:24.216219 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff1c16fb-1167-4285-8d0c-c0fbb78a2883 could not be found. Oct 04 18:32:24.216219 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:24.216219 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:24.216219 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:24.216219 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:24.216219 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:24.216219 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:24.216219 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:24.216219 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:24.216219 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:24.216219 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:24.216219 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:32:24.216219 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:32:24.216219 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:32:24.216219 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:32:24.216219 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:32:24.216219 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:32:24.216219 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff1c16fb-1167-4285-8d0c-c0fbb78a2883 could not be found. Oct 04 18:32:24.216219 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:24.216219 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:24.223357 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:24.223357 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:24.223357 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:24.223357 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:24.223357 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:32:24.223357 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:32:24.223357 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff1c16fb-1167-4285-8d0c-c0fbb78a2883 could not be found. Oct 04 18:32:24.223357 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:24.223357 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-51b92f5d-e3ab-45f7-aa4b-efd280cd0779 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] Returning 404 to user: Instance ff1c16fb-1167-4285-8d0c-c0fbb78a2883 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:24.223357 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-51b92f5d-e3ab-45f7-aa4b-efd280cd0779 tempest-ServersWithSpecificFlavorTestJSON-915896807 tempest-ServersWithSpecificFlavorTestJSON-915896807-project] 10.222.0.20 "GET /compute/v2.1/servers/ff1c16fb-1167-4285-8d0c-c0fbb78a2883" status: 404 len: 111 microversion: 2.1 time: 0.047458 Oct 04 18:32:24.223357 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 594/1146] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:24 2022] GET /compute/v2.1/servers/ff1c16fb-1167-4285-8d0c-c0fbb78a2883 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:32:24.282201 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-17a58389-c9d5-4f76-a521-b3135a952129 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:24.282837 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-17a58389-c9d5-4f76-a521-b3135a952129 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: b219d988-2847-45a0-a3b8-af54cf1a43f8] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:24.293600 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-17a58389-c9d5-4f76-a521-b3135a952129 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:24.294113 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-17a58389-c9d5-4f76-a521-b3135a952129 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:24.294561 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-17a58389-c9d5-4f76-a521-b3135a952129 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:24.295300 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-17a58389-c9d5-4f76-a521-b3135a952129 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:24.295762 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-17a58389-c9d5-4f76-a521-b3135a952129 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:24.298076 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-17a58389-c9d5-4f76-a521-b3135a952129 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:24.453996 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d0d8a660-8d1e-4f86-92bd-1e2ddc666bce tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:24.456020 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d0d8a660-8d1e-4f86-92bd-1e2ddc666bce tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] [instance: 156c9c3a-ac54-4499-91fe-161cffddbf12] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:24.478129 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d0d8a660-8d1e-4f86-92bd-1e2ddc666bce tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:24.478129 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d0d8a660-8d1e-4f86-92bd-1e2ddc666bce tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:24.478129 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d0d8a660-8d1e-4f86-92bd-1e2ddc666bce tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:24.478129 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d0d8a660-8d1e-4f86-92bd-1e2ddc666bce tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:24.478129 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d0d8a660-8d1e-4f86-92bd-1e2ddc666bce tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:24.480207 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d0d8a660-8d1e-4f86-92bd-1e2ddc666bce tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:24.629844 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-17a58389-c9d5-4f76-a521-b3135a952129 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:24.639808 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-17a58389-c9d5-4f76-a521-b3135a952129 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:24.641317 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-17a58389-c9d5-4f76-a521-b3135a952129 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:24.642436 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-17a58389-c9d5-4f76-a521-b3135a952129 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8" status: 200 len: 1344 microversion: 2.25 time: 0.364493 Oct 04 18:32:24.656222 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 553/1147] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:32:24 2022] GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8 => generated 1344 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:32:24.680777 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7e0517bd-f644-45dd-916c-572d2816ec2d tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '.version_select at 0x7fe25911e4c0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:24.797639 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7e0517bd-f644-45dd-916c-572d2816ec2d tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/images/cabaf7e6-9081-4a33-8415-4c717517ad62" status: 200 len: 1414 microversion: 2.1 time: 0.124181 Oct 04 18:32:24.800491 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 554/1148] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:32:24 2022] GET /compute/v2.1/images/cabaf7e6-9081-4a33-8415-4c717517ad62 => generated 1414 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:32:24.826385 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b2a32a35-1975-4ca7-9e3c-b66d61b678d1 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:24.832459 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b2a32a35-1975-4ca7-9e3c-b66d61b678d1 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 4e1bb5af-9b8b-456f-beb1-aadf2491a8ed] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:24.849484 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b2a32a35-1975-4ca7-9e3c-b66d61b678d1 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:24.851786 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b2a32a35-1975-4ca7-9e3c-b66d61b678d1 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:24.853687 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b2a32a35-1975-4ca7-9e3c-b66d61b678d1 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:24.854842 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b2a32a35-1975-4ca7-9e3c-b66d61b678d1 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:24.856071 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b2a32a35-1975-4ca7-9e3c-b66d61b678d1 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:24.856958 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b2a32a35-1975-4ca7-9e3c-b66d61b678d1 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:25.068078 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d0d8a660-8d1e-4f86-92bd-1e2ddc666bce tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f49a275284a7eb714a55c6bdd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e44e7aa06ee4126b5705ba65145ebcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:25.080730 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d0d8a660-8d1e-4f86-92bd-1e2ddc666bce tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] 10.222.0.20 "GET /compute/v2.1/servers/156c9c3a-ac54-4499-91fe-161cffddbf12" status: 200 len: 1521 microversion: 2.1 time: 0.631607 Oct 04 18:32:25.081595 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 595/1149] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:24 2022] GET /compute/v2.1/servers/156c9c3a-ac54-4499-91fe-161cffddbf12 => generated 1521 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:25.087430 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ba8d704b-bad0-412d-9f7f-f41178da96c1 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:25.097803 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ba8d704b-bad0-412d-9f7f-f41178da96c1 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: 2d07c478-8e9c-4000-92bb-3fa4547ea6c0] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:25.107561 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ba8d704b-bad0-412d-9f7f-f41178da96c1 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:25.110317 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ba8d704b-bad0-412d-9f7f-f41178da96c1 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:25.112372 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ba8d704b-bad0-412d-9f7f-f41178da96c1 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:25.113465 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ba8d704b-bad0-412d-9f7f-f41178da96c1 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:25.114100 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ba8d704b-bad0-412d-9f7f-f41178da96c1 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:25.117220 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ba8d704b-bad0-412d-9f7f-f41178da96c1 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:25.154852 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-ba8d704b-bad0-412d-9f7f-f41178da96c1 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] HTTP exception thrown: Instance 2d07c478-8e9c-4000-92bb-3fa4547ea6c0 could not be found. Oct 04 18:32:25.160161 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ba8d704b-bad0-412d-9f7f-f41178da96c1 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Request method failure captured: Oct 04 18:32:25.160161 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/2d07c478-8e9c-4000-92bb-3fa4547ea6c0 HTTP/1.1 Oct 04 18:32:25.160161 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:32:25.160161 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:32:25.160161 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:32:25.160161 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:32:25.160161 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:32:25.160161 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:32:25.160161 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:32:25.160161 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:25.160161 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPHtcc3zsjcMKz8cEwRtflxvigEPx-In4JkTl328nJANVUfFz1p2OVDGilrcjY4qMu5vRjW2zvRxzHEswqbzFh2OoPWoz6R7t8Yv16v_mW4D1rWIFDhOB0dmfh2ZT-5VCy_oS_TIFc0c8n-LcarwX378VPTu7Id5dulS6vFtb7m4i7ZQ Oct 04 18:32:25.160161 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:32:25.160161 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:32:25.160161 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:32:25.160161 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:32:25.160161 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:32:25.160161 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:32:25.160161 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 771211a4ce424aa48920ff102c894a9f Oct 04 18:32:25.160161 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServersOnMultiNodesTest-1893046075 Oct 04 18:32:25.160161 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:32:25.160161 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:32:25.160161 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/771211a4ce424aa48920ff102c894a9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_771211a4ce424aa48920ff102c894a9f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/771211a4ce424aa48920ff102c894a9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/771211a4ce424aa48920ff102c894a9f"}]}] Oct 04 18:32:25.160161 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServersOnMultiNodesTest-1893046075 Oct 04 18:32:25.160161 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 771211a4ce424aa48920ff102c894a9f Oct 04 18:32:25.160161 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1893046075 Oct 04 18:32:25.160161 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServersOnMultiNodesTest-1893046075-project Oct 04 18:32:25.160161 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:32:25.160161 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:32:25.160161 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 07dd131fa3c44d439d0f3ec6e4b8ad42 Oct 04 18:32:25.160161 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServersOnMultiNodesTest-1893046075-project Oct 04 18:32:25.160161 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:32:25.160161 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 2d07c478-8e9c-4000-92bb-3fa4547ea6c0 could not be found. Oct 04 18:32:25.160161 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '2d07c478-8e9c-4000-92bb-3fa4547ea6c0'} Oct 04 18:32:25.160161 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:25.160161 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:25.160161 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:32:25.160161 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:32:25.160161 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:32:25.160161 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:32:25.160161 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:32:25.160161 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:32:25.160161 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:32:25.160161 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:32:25.160161 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d07c478-8e9c-4000-92bb-3fa4547ea6c0 could not be found. Oct 04 18:32:25.160161 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:25.160161 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:25.160161 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:25.160161 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:25.160161 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:25.160161 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:25.160161 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:25.160161 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:25.160161 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:25.160161 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:25.160161 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:32:25.160161 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:32:25.160161 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:32:25.160161 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:32:25.160161 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:32:25.160161 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:32:25.160161 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d07c478-8e9c-4000-92bb-3fa4547ea6c0 could not be found. Oct 04 18:32:25.160161 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:25.160161 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:25.160161 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:25.165309 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:25.165309 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:25.165309 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:25.165309 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:32:25.165309 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:32:25.165309 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d07c478-8e9c-4000-92bb-3fa4547ea6c0 could not be found. Oct 04 18:32:25.165309 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:25.167445 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ba8d704b-bad0-412d-9f7f-f41178da96c1 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Returning 404 to user: Instance 2d07c478-8e9c-4000-92bb-3fa4547ea6c0 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:25.173273 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ba8d704b-bad0-412d-9f7f-f41178da96c1 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/2d07c478-8e9c-4000-92bb-3fa4547ea6c0" status: 404 len: 111 microversion: 2.1 time: 0.089080 Oct 04 18:32:25.173273 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 596/1150] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:25 2022] GET /compute/v2.1/servers/2d07c478-8e9c-4000-92bb-3fa4547ea6c0 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:32:25.186336 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-7d556c67-36a6-4271-8353-cec56a6e8be2 req-22006624-389c-41ce-b48a-1b38efe3880f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cd68f0f-4385-45c4-8dd0-8f33a5a9e527", "name": "network-vif-plugged", "status": "completed", "tag": "e0c9983a-03a1-4137-9aaf-8dc3ac6e4cb0"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:25.206430 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-7d556c67-36a6-4271-8353-cec56a6e8be2 req-22006624-389c-41ce-b48a-1b38efe3880f service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:25.208755 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-7d556c67-36a6-4271-8353-cec56a6e8be2 req-22006624-389c-41ce-b48a-1b38efe3880f service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:25.209607 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-7d556c67-36a6-4271-8353-cec56a6e8be2 req-22006624-389c-41ce-b48a-1b38efe3880f service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:25.235401 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-7d556c67-36a6-4271-8353-cec56a6e8be2 req-22006624-389c-41ce-b48a-1b38efe3880f service nova] Creating event network-vif-plugged:e0c9983a-03a1-4137-9aaf-8dc3ac6e4cb0 for instance 0cd68f0f-4385-45c4-8dd0-8f33a5a9e527 on n-h2-850501-14 Oct 04 18:32:25.252858 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-7d556c67-36a6-4271-8353-cec56a6e8be2 req-22006624-389c-41ce-b48a-1b38efe3880f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079103 Oct 04 18:32:25.253797 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 597/1151] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:32:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:25.260117 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1a10c142-079b-49c1-92e0-5c0997049b50 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:25.270154 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1a10c142-079b-49c1-92e0-5c0997049b50 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] [instance: 156c9c3a-ac54-4499-91fe-161cffddbf12] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:25.286239 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1a10c142-079b-49c1-92e0-5c0997049b50 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:25.286923 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1a10c142-079b-49c1-92e0-5c0997049b50 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:25.287928 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1a10c142-079b-49c1-92e0-5c0997049b50 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:25.288741 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1a10c142-079b-49c1-92e0-5c0997049b50 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:25.289210 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1a10c142-079b-49c1-92e0-5c0997049b50 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:25.292475 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1a10c142-079b-49c1-92e0-5c0997049b50 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:25.353477 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1a10c142-079b-49c1-92e0-5c0997049b50 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] [instance: 156c9c3a-ac54-4499-91fe-161cffddbf12] Going to try to terminate instance {{(pid=123002) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:32:25.368462 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b2a32a35-1975-4ca7-9e3c-b66d61b678d1 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:25.379229 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b2a32a35-1975-4ca7-9e3c-b66d61b678d1 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/4e1bb5af-9b8b-456f-beb1-aadf2491a8ed" status: 200 len: 1504 microversion: 2.1 time: 0.564210 Oct 04 18:32:25.381249 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 555/1152] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:24 2022] GET /compute/v2.1/servers/4e1bb5af-9b8b-456f-beb1-aadf2491a8ed => generated 1504 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:25.392016 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1bc93366-e325-44d0-b964-1a3048ffde5a tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:25.396189 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1bc93366-e325-44d0-b964-1a3048ffde5a tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: d5e996e9-dc9f-46e3-8469-e46dc2932b24] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:25.411411 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1bc93366-e325-44d0-b964-1a3048ffde5a tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:25.411967 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1bc93366-e325-44d0-b964-1a3048ffde5a tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:25.413101 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1bc93366-e325-44d0-b964-1a3048ffde5a tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:25.425119 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1bc93366-e325-44d0-b964-1a3048ffde5a tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:25.425119 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1bc93366-e325-44d0-b964-1a3048ffde5a tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:25.425119 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1bc93366-e325-44d0-b964-1a3048ffde5a tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:25.599678 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1bc93366-e325-44d0-b964-1a3048ffde5a tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:25.609791 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1bc93366-e325-44d0-b964-1a3048ffde5a tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e996e9-dc9f-46e3-8469-e46dc2932b24" status: 200 len: 1433 microversion: 2.1 time: 0.225748 Oct 04 18:32:25.609791 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 556/1153] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:25 2022] GET /compute/v2.1/servers/d5e996e9-dc9f-46e3-8469-e46dc2932b24 => generated 1433 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:25.616021 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:25.671885 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0e3052b1-4765-4b68-96cb-0b5bb1ef63e5 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:25.676905 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0e3052b1-4765-4b68-96cb-0b5bb1ef63e5 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: b219d988-2847-45a0-a3b8-af54cf1a43f8] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:25.698493 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0e3052b1-4765-4b68-96cb-0b5bb1ef63e5 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:25.699298 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0e3052b1-4765-4b68-96cb-0b5bb1ef63e5 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:25.700774 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0e3052b1-4765-4b68-96cb-0b5bb1ef63e5 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:25.703266 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0e3052b1-4765-4b68-96cb-0b5bb1ef63e5 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:25.705427 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0e3052b1-4765-4b68-96cb-0b5bb1ef63e5 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:25.706026 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0e3052b1-4765-4b68-96cb-0b5bb1ef63e5 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:25.986608 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1a10c142-079b-49c1-92e0-5c0997049b50 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] 10.222.0.20 "DELETE /compute/v2.1/servers/156c9c3a-ac54-4499-91fe-161cffddbf12" status: 204 len: 0 microversion: 2.1 time: 0.731158 Oct 04 18:32:25.992481 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 598/1154] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:32:25 2022] DELETE /compute/v2.1/servers/156c9c3a-ac54-4499-91fe-161cffddbf12 => generated 0 bytes in 735 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:32:26.003281 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-4560b6ce-3955-4342-b689-40f6684c64e0 req-ab234f7b-f3ff-49df-b493-4ae30b62079b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5e996e9-dc9f-46e3-8469-e46dc2932b24", "name": "network-vif-deleted", "tag": "07eac084-b2dc-4fbf-9f40-12ca4aeead64"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:26.033850 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-4560b6ce-3955-4342-b689-40f6684c64e0 req-ab234f7b-f3ff-49df-b493-4ae30b62079b service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:26.036683 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-4560b6ce-3955-4342-b689-40f6684c64e0 req-ab234f7b-f3ff-49df-b493-4ae30b62079b service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:26.037276 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-4560b6ce-3955-4342-b689-40f6684c64e0 req-ab234f7b-f3ff-49df-b493-4ae30b62079b service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:26.089817 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-4560b6ce-3955-4342-b689-40f6684c64e0 req-ab234f7b-f3ff-49df-b493-4ae30b62079b service nova] Creating event network-vif-deleted:07eac084-b2dc-4fbf-9f40-12ca4aeead64 for instance d5e996e9-dc9f-46e3-8469-e46dc2932b24 on n-h2-850501-14 Oct 04 18:32:26.107782 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-4560b6ce-3955-4342-b689-40f6684c64e0 req-ab234f7b-f3ff-49df-b493-4ae30b62079b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113024 Oct 04 18:32:26.111333 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 599/1155] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:32:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:26.126667 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7c8908c2-a08e-4f0a-a241-a42228cbe8ba tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '.version_select at 0x7fe259588dc0>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:26.243702 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7c8908c2-a08e-4f0a-a241-a42228cbe8ba tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/images/cabaf7e6-9081-4a33-8415-4c717517ad62" status: 200 len: 1414 microversion: 2.1 time: 0.130755 Oct 04 18:32:26.262200 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 600/1156] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:32:26 2022] GET /compute/v2.1/images/cabaf7e6-9081-4a33-8415-4c717517ad62 => generated 1414 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:26.284563 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-eb5d964e-e7d3-4c08-9f89-4dfbf92cf7ce tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:26.285329 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-eb5d964e-e7d3-4c08-9f89-4dfbf92cf7ce tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] [instance: 156c9c3a-ac54-4499-91fe-161cffddbf12] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:26.318355 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eb5d964e-e7d3-4c08-9f89-4dfbf92cf7ce tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:26.351805 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eb5d964e-e7d3-4c08-9f89-4dfbf92cf7ce tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:26.355256 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eb5d964e-e7d3-4c08-9f89-4dfbf92cf7ce tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.033s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:26.363373 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eb5d964e-e7d3-4c08-9f89-4dfbf92cf7ce tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:26.367494 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eb5d964e-e7d3-4c08-9f89-4dfbf92cf7ce tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:26.370103 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eb5d964e-e7d3-4c08-9f89-4dfbf92cf7ce tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:26.807399 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0e3052b1-4765-4b68-96cb-0b5bb1ef63e5 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:26.823660 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0e3052b1-4765-4b68-96cb-0b5bb1ef63e5 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:26.825374 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0e3052b1-4765-4b68-96cb-0b5bb1ef63e5 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:26.826614 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0e3052b1-4765-4b68-96cb-0b5bb1ef63e5 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8" status: 200 len: 1409 microversion: 2.25 time: 1.160353 Oct 04 18:32:26.830821 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 557/1157] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:32:25 2022] GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8 => generated 1409 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:32:26.847398 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7d27b669-1e88-43d8-b3db-dd84938952f9 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:26.847398 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7d27b669-1e88-43d8-b3db-dd84938952f9 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 4e1bb5af-9b8b-456f-beb1-aadf2491a8ed] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:26.862157 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7d27b669-1e88-43d8-b3db-dd84938952f9 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:26.862659 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7d27b669-1e88-43d8-b3db-dd84938952f9 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:26.867213 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7d27b669-1e88-43d8-b3db-dd84938952f9 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:26.868267 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7d27b669-1e88-43d8-b3db-dd84938952f9 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:26.868917 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7d27b669-1e88-43d8-b3db-dd84938952f9 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:26.869516 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7d27b669-1e88-43d8-b3db-dd84938952f9 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:27.533013 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-eb5d964e-e7d3-4c08-9f89-4dfbf92cf7ce tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f49a275284a7eb714a55c6bdd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e44e7aa06ee4126b5705ba65145ebcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:27.549898 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-eb5d964e-e7d3-4c08-9f89-4dfbf92cf7ce tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] 10.222.0.20 "GET /compute/v2.1/servers/156c9c3a-ac54-4499-91fe-161cffddbf12" status: 200 len: 1527 microversion: 2.1 time: 1.279535 Oct 04 18:32:27.552706 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 601/1158] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:26 2022] GET /compute/v2.1/servers/156c9c3a-ac54-4499-91fe-161cffddbf12 => generated 1527 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:27.556898 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7d27b669-1e88-43d8-b3db-dd84938952f9 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:27.568016 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7d27b669-1e88-43d8-b3db-dd84938952f9 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/4e1bb5af-9b8b-456f-beb1-aadf2491a8ed" status: 200 len: 1504 microversion: 2.1 time: 0.731666 Oct 04 18:32:27.579280 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 558/1159] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:26 2022] GET /compute/v2.1/servers/4e1bb5af-9b8b-456f-beb1-aadf2491a8ed => generated 1504 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:27.579467 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-62141b47-a1e4-4938-bf09-aa1c7d9d7e56 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:27.581333 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-62141b47-a1e4-4938-bf09-aa1c7d9d7e56 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: d5e996e9-dc9f-46e3-8469-e46dc2932b24] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:27.596745 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-439869ae-67e7-4888-8ba4-6266d89e0739 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '.version_select at 0x7fe2590db8b0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:27.603530 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-62141b47-a1e4-4938-bf09-aa1c7d9d7e56 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:27.607765 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-62141b47-a1e4-4938-bf09-aa1c7d9d7e56 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:27.609013 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-62141b47-a1e4-4938-bf09-aa1c7d9d7e56 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:27.609809 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-62141b47-a1e4-4938-bf09-aa1c7d9d7e56 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:27.612636 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-62141b47-a1e4-4938-bf09-aa1c7d9d7e56 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:27.614065 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-62141b47-a1e4-4938-bf09-aa1c7d9d7e56 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:27.699710 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-62141b47-a1e4-4938-bf09-aa1c7d9d7e56 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:27.700304 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-62141b47-a1e4-4938-bf09-aa1c7d9d7e56 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:27.700762 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-62141b47-a1e4-4938-bf09-aa1c7d9d7e56 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:27.701235 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-62141b47-a1e4-4938-bf09-aa1c7d9d7e56 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lazy-loading 'fault' on Instance uuid d5e996e9-dc9f-46e3-8469-e46dc2932b24 {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:32:27.741399 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-439869ae-67e7-4888-8ba4-6266d89e0739 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/images/cabaf7e6-9081-4a33-8415-4c717517ad62" status: 200 len: 1414 microversion: 2.1 time: 0.165245 Oct 04 18:32:27.743260 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 559/1160] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:32:27 2022] GET /compute/v2.1/images/cabaf7e6-9081-4a33-8415-4c717517ad62 => generated 1414 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:27.859358 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-299dbe18-5c58-4095-bf08-071a9bdeb282 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:27.860838 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-299dbe18-5c58-4095-bf08-071a9bdeb282 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: b219d988-2847-45a0-a3b8-af54cf1a43f8] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:27.867123 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-62141b47-a1e4-4938-bf09-aa1c7d9d7e56 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:27.892165 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-62141b47-a1e4-4938-bf09-aa1c7d9d7e56 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e996e9-dc9f-46e3-8469-e46dc2932b24" status: 200 len: 1309 microversion: 2.1 time: 0.317721 Oct 04 18:32:27.892165 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 602/1161] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:27 2022] GET /compute/v2.1/servers/d5e996e9-dc9f-46e3-8469-e46dc2932b24 => generated 1309 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:27.897523 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-299dbe18-5c58-4095-bf08-071a9bdeb282 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:27.904131 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-299dbe18-5c58-4095-bf08-071a9bdeb282 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:27.904805 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-299dbe18-5c58-4095-bf08-071a9bdeb282 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:27.905796 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-299dbe18-5c58-4095-bf08-071a9bdeb282 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:27.906438 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-299dbe18-5c58-4095-bf08-071a9bdeb282 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:27.907048 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-299dbe18-5c58-4095-bf08-071a9bdeb282 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:28.115575 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-299dbe18-5c58-4095-bf08-071a9bdeb282 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:28.125266 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-299dbe18-5c58-4095-bf08-071a9bdeb282 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:28.135374 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-299dbe18-5c58-4095-bf08-071a9bdeb282 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:28.142428 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-299dbe18-5c58-4095-bf08-071a9bdeb282 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8" status: 200 len: 1409 microversion: 2.25 time: 0.287913 Oct 04 18:32:28.145327 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 560/1162] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:32:27 2022] GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8 => generated 1409 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:32:28.286162 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1ce9f2d1-bd31-472d-b127-846b25633c12 tempest-SecurityGroupRulesTestJSON-1957837475 tempest-SecurityGroupRulesTestJSON-1957837475-project] Action: 'create', calling method: .version_select at 0x7fe2592cf790>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-699816059", "description": "tempest-description-1136029642"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:28.578255 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ae68a765-bc12-475a-b710-0427bf71388e tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:28.579113 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ae68a765-bc12-475a-b710-0427bf71388e tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] [instance: 156c9c3a-ac54-4499-91fe-161cffddbf12] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:28.593133 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ae68a765-bc12-475a-b710-0427bf71388e tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:28.593965 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ae68a765-bc12-475a-b710-0427bf71388e tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:28.594590 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ae68a765-bc12-475a-b710-0427bf71388e tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:28.595550 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ae68a765-bc12-475a-b710-0427bf71388e tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:28.596202 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ae68a765-bc12-475a-b710-0427bf71388e tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:28.596796 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ae68a765-bc12-475a-b710-0427bf71388e tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:29.559992 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=8 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:29.584956 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ae68a765-bc12-475a-b710-0427bf71388e tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f49a275284a7eb714a55c6bdd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e44e7aa06ee4126b5705ba65145ebcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:29.590452 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=24 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:29.602619 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ae68a765-bc12-475a-b710-0427bf71388e tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] 10.222.0.20 "GET /compute/v2.1/servers/156c9c3a-ac54-4499-91fe-161cffddbf12" status: 200 len: 1527 microversion: 2.1 time: 1.026530 Oct 04 18:32:29.606371 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 561/1163] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:28 2022] GET /compute/v2.1/servers/156c9c3a-ac54-4499-91fe-161cffddbf12 => generated 1527 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:32:29.619803 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4559d7fa-8871-4f2c-b60f-88e47d36f7cf tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:29.622744 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-4559d7fa-8871-4f2c-b60f-88e47d36f7cf tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 4e1bb5af-9b8b-456f-beb1-aadf2491a8ed] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:29.636497 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4559d7fa-8871-4f2c-b60f-88e47d36f7cf tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:29.637914 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4559d7fa-8871-4f2c-b60f-88e47d36f7cf tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:29.639887 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4559d7fa-8871-4f2c-b60f-88e47d36f7cf tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:29.641999 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4559d7fa-8871-4f2c-b60f-88e47d36f7cf tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:29.643312 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4559d7fa-8871-4f2c-b60f-88e47d36f7cf tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:29.645594 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4559d7fa-8871-4f2c-b60f-88e47d36f7cf tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:29.893539 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1ce9f2d1-bd31-472d-b127-846b25633c12 tempest-SecurityGroupRulesTestJSON-1957837475 tempest-SecurityGroupRulesTestJSON-1957837475-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.924442 Oct 04 18:32:29.894455 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 603/1164] 10.222.0.20 () {60 vars in 1180 bytes} [Tue Oct 4 18:32:27 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1926 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:29.901507 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-32ba13e4-2708-4a7e-b07e-a2cd16abcdc3 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '.version_select at 0x7fe259555af0>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:29.972917 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-32ba13e4-2708-4a7e-b07e-a2cd16abcdc3 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/images/cabaf7e6-9081-4a33-8415-4c717517ad62" status: 200 len: 1414 microversion: 2.1 time: 0.077243 Oct 04 18:32:29.981805 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 604/1165] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:32:29 2022] GET /compute/v2.1/images/cabaf7e6-9081-4a33-8415-4c717517ad62 => generated 1414 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:29.988123 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7c29a6a3-e309-45e1-bc6c-f118a3e9197b tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:29.988973 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7c29a6a3-e309-45e1-bc6c-f118a3e9197b tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: d5e996e9-dc9f-46e3-8469-e46dc2932b24] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:29.998157 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c29a6a3-e309-45e1-bc6c-f118a3e9197b tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:29.998985 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c29a6a3-e309-45e1-bc6c-f118a3e9197b tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:29.999626 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c29a6a3-e309-45e1-bc6c-f118a3e9197b tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:30.000563 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c29a6a3-e309-45e1-bc6c-f118a3e9197b tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:30.001241 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c29a6a3-e309-45e1-bc6c-f118a3e9197b tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:30.002354 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c29a6a3-e309-45e1-bc6c-f118a3e9197b tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:30.020691 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-7c29a6a3-e309-45e1-bc6c-f118a3e9197b tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] HTTP exception thrown: Instance d5e996e9-dc9f-46e3-8469-e46dc2932b24 could not be found. Oct 04 18:32:30.024560 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7c29a6a3-e309-45e1-bc6c-f118a3e9197b tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Request method failure captured: Oct 04 18:32:30.024560 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/d5e996e9-dc9f-46e3-8469-e46dc2932b24 HTTP/1.1 Oct 04 18:32:30.024560 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:32:30.024560 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:32:30.024560 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:32:30.024560 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:32:30.024560 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:32:30.024560 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:32:30.024560 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:32:30.024560 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:30.024560 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPHtcc3zsjcMKz8cEwRtflxvigEPx-In4JkTl328nJANVUfFz1p2OVDGilrcjY4qMu5vRjW2zvRxzHEswqbzFh2OoPWoz6R7t8Yv16v_mW4D1rWIFDhOB0dmfh2ZT-5VCy_oS_TIFc0c8n-LcarwX378VPTu7Id5dulS6vFtb7m4i7ZQ Oct 04 18:32:30.024560 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:32:30.024560 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:32:30.024560 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:32:30.024560 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:32:30.024560 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:32:30.024560 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:32:30.024560 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 771211a4ce424aa48920ff102c894a9f Oct 04 18:32:30.024560 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServersOnMultiNodesTest-1893046075 Oct 04 18:32:30.024560 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:32:30.024560 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:32:30.024560 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/771211a4ce424aa48920ff102c894a9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_771211a4ce424aa48920ff102c894a9f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/771211a4ce424aa48920ff102c894a9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/771211a4ce424aa48920ff102c894a9f"}]}] Oct 04 18:32:30.024560 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServersOnMultiNodesTest-1893046075 Oct 04 18:32:30.024560 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 771211a4ce424aa48920ff102c894a9f Oct 04 18:32:30.024560 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1893046075 Oct 04 18:32:30.024560 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServersOnMultiNodesTest-1893046075-project Oct 04 18:32:30.024560 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:32:30.024560 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:32:30.024560 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 07dd131fa3c44d439d0f3ec6e4b8ad42 Oct 04 18:32:30.024560 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServersOnMultiNodesTest-1893046075-project Oct 04 18:32:30.024560 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:32:30.024560 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance d5e996e9-dc9f-46e3-8469-e46dc2932b24 could not be found. Oct 04 18:32:30.024560 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'd5e996e9-dc9f-46e3-8469-e46dc2932b24'} Oct 04 18:32:30.024560 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:30.024560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:30.024560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:32:30.024560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:32:30.024560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:32:30.024560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:32:30.024560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:32:30.024560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:32:30.024560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:32:30.024560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:32:30.024560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5e996e9-dc9f-46e3-8469-e46dc2932b24 could not be found. Oct 04 18:32:30.024560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:30.024560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:30.024560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:30.024560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:30.024560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:30.024560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:30.024560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:30.024560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:30.024560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:30.024560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:30.024560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:32:30.024560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:32:30.024560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:32:30.024560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:32:30.024560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:32:30.024560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:32:30.024560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5e996e9-dc9f-46e3-8469-e46dc2932b24 could not be found. Oct 04 18:32:30.024560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:30.024560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:30.024560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:30.029432 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:30.029432 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:30.029432 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:30.029432 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:32:30.029432 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:32:30.029432 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5e996e9-dc9f-46e3-8469-e46dc2932b24 could not be found. Oct 04 18:32:30.029432 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:30.034558 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7c29a6a3-e309-45e1-bc6c-f118a3e9197b tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Returning 404 to user: Instance d5e996e9-dc9f-46e3-8469-e46dc2932b24 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:30.036717 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7c29a6a3-e309-45e1-bc6c-f118a3e9197b tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/d5e996e9-dc9f-46e3-8469-e46dc2932b24" status: 404 len: 111 microversion: 2.1 time: 0.053421 Oct 04 18:32:30.038885 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 605/1166] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:29 2022] GET /compute/v2.1/servers/d5e996e9-dc9f-46e3-8469-e46dc2932b24 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:32:30.044812 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-0538720c-8c84-4d8d-864d-b7b6b6589b38 req-7237dcda-b329-4bb9-a2ee-91eada5ccf98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b219d988-2847-45a0-a3b8-af54cf1a43f8", "tag": "581c676f-096d-4159-ae53-d455ac141b32"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:30.056747 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-0538720c-8c84-4d8d-864d-b7b6b6589b38 req-7237dcda-b329-4bb9-a2ee-91eada5ccf98 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:30.057651 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-0538720c-8c84-4d8d-864d-b7b6b6589b38 req-7237dcda-b329-4bb9-a2ee-91eada5ccf98 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:30.058290 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-0538720c-8c84-4d8d-864d-b7b6b6589b38 req-7237dcda-b329-4bb9-a2ee-91eada5ccf98 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:30.080842 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-0538720c-8c84-4d8d-864d-b7b6b6589b38 req-7237dcda-b329-4bb9-a2ee-91eada5ccf98 service nova] Creating event network-changed:581c676f-096d-4159-ae53-d455ac141b32 for instance b219d988-2847-45a0-a3b8-af54cf1a43f8 on n-h1-850501-14 Oct 04 18:32:30.087286 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-0538720c-8c84-4d8d-864d-b7b6b6589b38 req-7237dcda-b329-4bb9-a2ee-91eada5ccf98 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046882 Oct 04 18:32:30.089426 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 606/1167] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:32:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:30.097896 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a86cecf9-66d4-4341-a30a-b763d978ac84 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:30.099465 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a86cecf9-66d4-4341-a30a-b763d978ac84 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: b219d988-2847-45a0-a3b8-af54cf1a43f8] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:30.108506 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a86cecf9-66d4-4341-a30a-b763d978ac84 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:30.109427 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a86cecf9-66d4-4341-a30a-b763d978ac84 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:30.110087 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a86cecf9-66d4-4341-a30a-b763d978ac84 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:30.110997 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a86cecf9-66d4-4341-a30a-b763d978ac84 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:30.111648 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a86cecf9-66d4-4341-a30a-b763d978ac84 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:30.112554 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a86cecf9-66d4-4341-a30a-b763d978ac84 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:30.346866 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:30.411131 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-4559d7fa-8871-4f2c-b60f-88e47d36f7cf tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:30.440272 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-4559d7fa-8871-4f2c-b60f-88e47d36f7cf tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/4e1bb5af-9b8b-456f-beb1-aadf2491a8ed" status: 200 len: 1504 microversion: 2.1 time: 0.825410 Oct 04 18:32:30.448302 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 562/1168] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:29 2022] GET /compute/v2.1/servers/4e1bb5af-9b8b-456f-beb1-aadf2491a8ed => generated 1504 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:30.480379 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4ea6a944-fd23-4d60-b4d2-283c98484cc4 tempest-SecurityGroupRulesTestJSON-1957837475 tempest-SecurityGroupRulesTestJSON-1957837475-project] Action: 'create', calling method: .version_select at 0x7fe25911e5e0>, body: {"security_group_rule": {"parent_group_id": "5bcdd70b-bd77-4cbf-b7fd-3d637d152a68", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:30.677519 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a86cecf9-66d4-4341-a30a-b763d978ac84 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:30.691187 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a86cecf9-66d4-4341-a30a-b763d978ac84 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:30.695202 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a86cecf9-66d4-4341-a30a-b763d978ac84 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:30.704373 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a86cecf9-66d4-4341-a30a-b763d978ac84 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8" status: 200 len: 1409 microversion: 2.25 time: 0.607929 Oct 04 18:32:30.704373 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 607/1169] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:32:30 2022] GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8 => generated 1409 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:32:30.712454 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-33a87d59-72c5-473d-9788-854d63a6c032 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:30.830174 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3,nova_api:DELETE=7,nova_api:UPDATE=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:30.966432 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-33a87d59-72c5-473d-9788-854d63a6c032 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/36972d4e-f7eb-4ece-bc60-6ecfce4969e3" status: 204 len: 0 microversion: 2.1 time: 0.266018 Oct 04 18:32:30.970158 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 608/1170] 10.222.0.20 () {58 vars in 1266 bytes} [Tue Oct 4 18:32:30 2022] DELETE /compute/v2.1/os-server-groups/36972d4e-f7eb-4ece-bc60-6ecfce4969e3 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:32:30.975822 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8dd15ef3-af85-4659-ac94-9341b4b0c964 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:30.980928 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8dd15ef3-af85-4659-ac94-9341b4b0c964 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] [instance: 156c9c3a-ac54-4499-91fe-161cffddbf12] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:30.994017 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8dd15ef3-af85-4659-ac94-9341b4b0c964 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:30.994802 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8dd15ef3-af85-4659-ac94-9341b4b0c964 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:30.995492 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8dd15ef3-af85-4659-ac94-9341b4b0c964 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:30.996603 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8dd15ef3-af85-4659-ac94-9341b4b0c964 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:30.998410 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8dd15ef3-af85-4659-ac94-9341b4b0c964 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:31.000466 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8dd15ef3-af85-4659-ac94-9341b4b0c964 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:31.049078 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8dd15ef3-af85-4659-ac94-9341b4b0c964 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:31.050092 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8dd15ef3-af85-4659-ac94-9341b4b0c964 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:31.050751 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8dd15ef3-af85-4659-ac94-9341b4b0c964 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:31.051411 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-8dd15ef3-af85-4659-ac94-9341b4b0c964 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lazy-loading 'fault' on Instance uuid 156c9c3a-ac54-4499-91fe-161cffddbf12 {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:32:31.107037 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8dd15ef3-af85-4659-ac94-9341b4b0c964 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f49a275284a7eb714a55c6bdd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e44e7aa06ee4126b5705ba65145ebcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:31.118204 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8dd15ef3-af85-4659-ac94-9341b4b0c964 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] 10.222.0.20 "GET /compute/v2.1/servers/156c9c3a-ac54-4499-91fe-161cffddbf12" status: 200 len: 1314 microversion: 2.1 time: 0.146703 Oct 04 18:32:31.119130 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 609/1171] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:30 2022] GET /compute/v2.1/servers/156c9c3a-ac54-4499-91fe-161cffddbf12 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:31.132627 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d5aa883d-5c85-4a4d-858b-0966e182861d tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:31.134174 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d5aa883d-5c85-4a4d-858b-0966e182861d tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: 890f8168-5b22-465a-894d-ca70dd1acbed] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:31.149550 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d5aa883d-5c85-4a4d-858b-0966e182861d tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:31.152636 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d5aa883d-5c85-4a4d-858b-0966e182861d tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:31.153352 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d5aa883d-5c85-4a4d-858b-0966e182861d tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:31.154274 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d5aa883d-5c85-4a4d-858b-0966e182861d tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:31.161122 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d5aa883d-5c85-4a4d-858b-0966e182861d tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:31.162076 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d5aa883d-5c85-4a4d-858b-0966e182861d tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:31.215899 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d5aa883d-5c85-4a4d-858b-0966e182861d tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: 890f8168-5b22-465a-894d-ca70dd1acbed] Going to try to terminate instance {{(pid=123002) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:32:31.634921 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d5aa883d-5c85-4a4d-858b-0966e182861d tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "DELETE /compute/v2.1/servers/890f8168-5b22-465a-894d-ca70dd1acbed" status: 204 len: 0 microversion: 2.1 time: 0.511930 Oct 04 18:32:31.635905 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 610/1172] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:32:31 2022] DELETE /compute/v2.1/servers/890f8168-5b22-465a-894d-ca70dd1acbed => generated 0 bytes in 516 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:32:31.643214 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7696f82b-4879-4a8e-8846-0aaebb248950 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '.version_select at 0x7fe259416280>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:31.726631 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-4ea6a944-fd23-4d60-b4d2-283c98484cc4 tempest-SecurityGroupRulesTestJSON-1957837475 tempest-SecurityGroupRulesTestJSON-1957837475-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.276052 Oct 04 18:32:31.727332 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 563/1173] 10.222.0.20 () {60 vars in 1195 bytes} [Tue Oct 4 18:32:30 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:31.737718 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c09db61a-c473-475a-9f37-fc206d783f99 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:31.739022 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c09db61a-c473-475a-9f37-fc206d783f99 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 4e1bb5af-9b8b-456f-beb1-aadf2491a8ed] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:31.749115 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c09db61a-c473-475a-9f37-fc206d783f99 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:31.751487 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c09db61a-c473-475a-9f37-fc206d783f99 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:31.752708 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c09db61a-c473-475a-9f37-fc206d783f99 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:31.753555 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c09db61a-c473-475a-9f37-fc206d783f99 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:31.754218 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c09db61a-c473-475a-9f37-fc206d783f99 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:31.754929 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c09db61a-c473-475a-9f37-fc206d783f99 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:31.762073 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7696f82b-4879-4a8e-8846-0aaebb248950 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/images/cabaf7e6-9081-4a33-8415-4c717517ad62" status: 200 len: 1414 microversion: 2.1 time: 0.124577 Oct 04 18:32:31.772654 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 611/1174] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:32:31 2022] GET /compute/v2.1/images/cabaf7e6-9081-4a33-8415-4c717517ad62 => generated 1414 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:31.772654 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d91830c5-833a-4331-a92b-9def12211213 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:31.773455 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d91830c5-833a-4331-a92b-9def12211213 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: cb82f77b-6207-4a99-a494-f252a820990c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:31.813993 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d91830c5-833a-4331-a92b-9def12211213 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:31.818447 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d91830c5-833a-4331-a92b-9def12211213 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:31.824841 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d91830c5-833a-4331-a92b-9def12211213 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:31.828194 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d91830c5-833a-4331-a92b-9def12211213 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:31.828905 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d91830c5-833a-4331-a92b-9def12211213 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:31.836335 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d91830c5-833a-4331-a92b-9def12211213 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:31.928290 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d91830c5-833a-4331-a92b-9def12211213 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: cb82f77b-6207-4a99-a494-f252a820990c] Going to try to terminate instance {{(pid=123002) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:32:32.208909 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c09db61a-c473-475a-9f37-fc206d783f99 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:32.236538 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c09db61a-c473-475a-9f37-fc206d783f99 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/4e1bb5af-9b8b-456f-beb1-aadf2491a8ed" status: 200 len: 1504 microversion: 2.1 time: 0.507851 Oct 04 18:32:32.242594 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 564/1175] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:31 2022] GET /compute/v2.1/servers/4e1bb5af-9b8b-456f-beb1-aadf2491a8ed => generated 1504 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:32.266668 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-31f0909a-77c7-4f52-833a-38b36f86cdf7 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:32.270557 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-31f0909a-77c7-4f52-833a-38b36f86cdf7 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: b219d988-2847-45a0-a3b8-af54cf1a43f8] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:32.296862 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-31f0909a-77c7-4f52-833a-38b36f86cdf7 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:32.297395 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-31f0909a-77c7-4f52-833a-38b36f86cdf7 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:32.297851 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-31f0909a-77c7-4f52-833a-38b36f86cdf7 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:32.299970 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-31f0909a-77c7-4f52-833a-38b36f86cdf7 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:32.300657 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-31f0909a-77c7-4f52-833a-38b36f86cdf7 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:32.301268 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-31f0909a-77c7-4f52-833a-38b36f86cdf7 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:32.560110 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-31f0909a-77c7-4f52-833a-38b36f86cdf7 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:32.585857 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-31f0909a-77c7-4f52-833a-38b36f86cdf7 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:32.591867 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-31f0909a-77c7-4f52-833a-38b36f86cdf7 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:32.593410 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-31f0909a-77c7-4f52-833a-38b36f86cdf7 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8" status: 200 len: 1409 microversion: 2.25 time: 0.349778 Oct 04 18:32:32.595864 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 565/1176] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:32:32 2022] GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8 => generated 1409 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:32:32.608485 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7e969595-876b-469f-a51e-0fd8a4b04bb0 tempest-SecurityGroupRulesTestJSON-1957837475 tempest-SecurityGroupRulesTestJSON-1957837475-project] Action: 'create', calling method: .version_select at 0x7fe259102550>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-2126296664", "description": "tempest-description-2054790232"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:32.789580 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d91830c5-833a-4331-a92b-9def12211213 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "DELETE /compute/v2.1/servers/cb82f77b-6207-4a99-a494-f252a820990c" status: 204 len: 0 microversion: 2.1 time: 1.023046 Oct 04 18:32:32.795459 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 612/1177] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:32:31 2022] DELETE /compute/v2.1/servers/cb82f77b-6207-4a99-a494-f252a820990c => generated 0 bytes in 1025 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:32:32.798184 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-08639ce1-9893-4a06-84f3-347718d681e6 req-ce85f17e-f951-416b-ba20-d260c0b36b17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "156c9c3a-ac54-4499-91fe-161cffddbf12", "name": "network-vif-deleted", "tag": "bcc6e3df-34b1-4330-a2a2-9dcdc9fe670d"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:32.824422 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-08639ce1-9893-4a06-84f3-347718d681e6 req-ce85f17e-f951-416b-ba20-d260c0b36b17 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:32.824910 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-08639ce1-9893-4a06-84f3-347718d681e6 req-ce85f17e-f951-416b-ba20-d260c0b36b17 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:32.830831 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-08639ce1-9893-4a06-84f3-347718d681e6 req-ce85f17e-f951-416b-ba20-d260c0b36b17 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:32.868804 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-08639ce1-9893-4a06-84f3-347718d681e6 req-ce85f17e-f951-416b-ba20-d260c0b36b17 service nova] Creating event network-vif-deleted:bcc6e3df-34b1-4330-a2a2-9dcdc9fe670d for instance 156c9c3a-ac54-4499-91fe-161cffddbf12 on n-h1-850501-14 Oct 04 18:32:32.875289 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-08639ce1-9893-4a06-84f3-347718d681e6 req-ce85f17e-f951-416b-ba20-d260c0b36b17 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083096 Oct 04 18:32:32.877691 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 613/1178] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:32:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:32.886688 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-09bc7e99-e8d3-4f93-89b3-a9588e2e9655 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:32.892919 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-09bc7e99-e8d3-4f93-89b3-a9588e2e9655 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] [instance: 156c9c3a-ac54-4499-91fe-161cffddbf12] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:32.908661 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-09bc7e99-e8d3-4f93-89b3-a9588e2e9655 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:32.909372 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-09bc7e99-e8d3-4f93-89b3-a9588e2e9655 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:32.909993 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-09bc7e99-e8d3-4f93-89b3-a9588e2e9655 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:32.910735 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-09bc7e99-e8d3-4f93-89b3-a9588e2e9655 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:32.915702 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-09bc7e99-e8d3-4f93-89b3-a9588e2e9655 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:32.925629 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-09bc7e99-e8d3-4f93-89b3-a9588e2e9655 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:32.940805 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-09bc7e99-e8d3-4f93-89b3-a9588e2e9655 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] HTTP exception thrown: Instance 156c9c3a-ac54-4499-91fe-161cffddbf12 could not be found. Oct 04 18:32:32.942467 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-09bc7e99-e8d3-4f93-89b3-a9588e2e9655 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Request method failure captured: Oct 04 18:32:32.942467 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/156c9c3a-ac54-4499-91fe-161cffddbf12 HTTP/1.1 Oct 04 18:32:32.942467 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:32:32.942467 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:32:32.942467 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:32:32.942467 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:32:32.942467 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:32:32.942467 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:32:32.942467 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:32:32.942467 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:32.942467 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPHvII_T7EcjvuInFv4t5qVF70S9vjGBK66HvfyVnOiY_TVbsAPYjguHISQjMiOeT1bz8CjLq7zDrG77IXy0kQULYEqIfKm3jlSWTKPDcogOtbqbQpds3d11ZgBfbFr39fSjqioDU_0CmuRBwgkz6wZ-Zh6uUaL8av5rXkIBhSk0fN1E Oct 04 18:32:32.942467 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:32:32.942467 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:32:32.942467 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:32:32.942467 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:32:32.942467 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:32:32.942467 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:32:32.942467 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 7e44e7aa06ee4126b5705ba65145ebcc Oct 04 18:32:32.942467 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1566997612 Oct 04 18:32:32.942467 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:32:32.942467 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:32:32.942467 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e44e7aa06ee4126b5705ba65145ebcc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7e44e7aa06ee4126b5705ba65145ebcc", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7e44e7aa06ee4126b5705ba65145ebcc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e44e7aa06ee4126b5705ba65145ebcc"}]}] Oct 04 18:32:32.942467 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1566997612 Oct 04 18:32:32.942467 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 7e44e7aa06ee4126b5705ba65145ebcc Oct 04 18:32:32.942467 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1566997612 Oct 04 18:32:32.942467 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ImagesOneServerNegativeTestJSON-1566997612-project Oct 04 18:32:32.942467 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:32:32.942467 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:32:32.942467 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 415f49a275284a7eb714a55c6bdd0005 Oct 04 18:32:32.942467 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1566997612-project Oct 04 18:32:32.942467 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:32:32.942467 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 156c9c3a-ac54-4499-91fe-161cffddbf12 could not be found. Oct 04 18:32:32.942467 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '156c9c3a-ac54-4499-91fe-161cffddbf12'} Oct 04 18:32:32.942467 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:32.942467 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:32.942467 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:32:32.942467 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:32:32.942467 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:32:32.942467 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:32:32.942467 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:32:32.942467 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:32:32.942467 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:32:32.942467 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:32:32.942467 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 156c9c3a-ac54-4499-91fe-161cffddbf12 could not be found. Oct 04 18:32:32.942467 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:32.942467 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:32.942467 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:32.942467 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:32.942467 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:32.942467 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:32.942467 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:32.942467 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:32.942467 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:32.942467 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:32.942467 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:32:32.942467 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:32:32.942467 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:32:32.942467 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:32:32.942467 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:32:32.942467 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:32:32.942467 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 156c9c3a-ac54-4499-91fe-161cffddbf12 could not be found. Oct 04 18:32:32.942467 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:32.942467 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:32.947849 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:32.947849 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:32.947849 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:32.947849 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:32.947849 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:32:32.947849 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:32:32.947849 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 156c9c3a-ac54-4499-91fe-161cffddbf12 could not be found. Oct 04 18:32:32.947849 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:32.947849 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-09bc7e99-e8d3-4f93-89b3-a9588e2e9655 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Returning 404 to user: Instance 156c9c3a-ac54-4499-91fe-161cffddbf12 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:32.957073 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-09bc7e99-e8d3-4f93-89b3-a9588e2e9655 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] 10.222.0.20 "GET /compute/v2.1/servers/156c9c3a-ac54-4499-91fe-161cffddbf12" status: 404 len: 111 microversion: 2.1 time: 0.077860 Oct 04 18:32:32.957675 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 614/1179] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:32 2022] GET /compute/v2.1/servers/156c9c3a-ac54-4499-91fe-161cffddbf12 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:32:32.962845 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f8310864-371a-4e17-a679-1a182d548c52 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '.version_select at 0x7fe25958be50>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:33.053457 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f8310864-371a-4e17-a679-1a182d548c52 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/images/cabaf7e6-9081-4a33-8415-4c717517ad62" status: 200 len: 1414 microversion: 2.1 time: 0.085571 Oct 04 18:32:33.053457 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 615/1180] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:32:32 2022] GET /compute/v2.1/images/cabaf7e6-9081-4a33-8415-4c717517ad62 => generated 1414 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:33.055287 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-80edb7a2-cc6b-4f52-9f07-325180424cb0 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:33.055514 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-80edb7a2-cc6b-4f52-9f07-325180424cb0 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: 890f8168-5b22-465a-894d-ca70dd1acbed] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:33.065791 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-80edb7a2-cc6b-4f52-9f07-325180424cb0 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:33.066523 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-80edb7a2-cc6b-4f52-9f07-325180424cb0 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:33.067135 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-80edb7a2-cc6b-4f52-9f07-325180424cb0 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:33.068008 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-80edb7a2-cc6b-4f52-9f07-325180424cb0 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:33.068734 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-80edb7a2-cc6b-4f52-9f07-325180424cb0 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:33.069318 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-80edb7a2-cc6b-4f52-9f07-325180424cb0 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:33.391370 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-80edb7a2-cc6b-4f52-9f07-325180424cb0 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:33.403180 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-80edb7a2-cc6b-4f52-9f07-325180424cb0 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/890f8168-5b22-465a-894d-ca70dd1acbed" status: 200 len: 1475 microversion: 2.1 time: 0.356385 Oct 04 18:32:33.407426 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 616/1181] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:33 2022] GET /compute/v2.1/servers/890f8168-5b22-465a-894d-ca70dd1acbed => generated 1475 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:33.416142 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3797357d-a616-450c-bd24-e81a53e67a5d tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Calling method '.version_select at 0x7fe2598704c0>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:33.442071 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-3797357d-a616-450c-bd24-e81a53e67a5d tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] HTTP exception thrown: Image not found. Oct 04 18:32:33.444983 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3797357d-a616-450c-bd24-e81a53e67a5d tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Request method failure captured: Oct 04 18:32:33.444983 n-d-850501-14 devstack@n-api.service[123002]: request: DELETE /compute/v2.1/images/39eaf8e6-b29a-454c-bbc7-2e57deb6bf76 HTTP/1.1 Oct 04 18:32:33.444983 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:32:33.444983 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:32:33.444983 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:32:33.444983 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:32:33.444983 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:32:33.444983 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:32:33.444983 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:32:33.444983 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:33.444983 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPHvII_T7EcjvuInFv4t5qVF70S9vjGBK66HvfyVnOiY_TVbsAPYjguHISQjMiOeT1bz8CjLq7zDrG77IXy0kQULYEqIfKm3jlSWTKPDcogOtbqbQpds3d11ZgBfbFr39fSjqioDU_0CmuRBwgkz6wZ-Zh6uUaL8av5rXkIBhSk0fN1E Oct 04 18:32:33.444983 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:32:33.444983 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:32:33.444983 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:32:33.444983 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:32:33.444983 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:32:33.444983 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:32:33.444983 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 7e44e7aa06ee4126b5705ba65145ebcc Oct 04 18:32:33.444983 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1566997612 Oct 04 18:32:33.444983 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:32:33.444983 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:32:33.444983 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e44e7aa06ee4126b5705ba65145ebcc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7e44e7aa06ee4126b5705ba65145ebcc", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7e44e7aa06ee4126b5705ba65145ebcc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e44e7aa06ee4126b5705ba65145ebcc"}]}] Oct 04 18:32:33.444983 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1566997612 Oct 04 18:32:33.444983 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 7e44e7aa06ee4126b5705ba65145ebcc Oct 04 18:32:33.444983 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1566997612 Oct 04 18:32:33.444983 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ImagesOneServerNegativeTestJSON-1566997612-project Oct 04 18:32:33.444983 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:32:33.444983 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:32:33.444983 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 415f49a275284a7eb714a55c6bdd0005 Oct 04 18:32:33.444983 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1566997612-project Oct 04 18:32:33.444983 n-d-850501-14 devstack@n-api.service[123002]: method: Oct 04 18:32:33.444983 n-d-850501-14 devstack@n-api.service[123002]: exception: Image not found. Oct 04 18:32:33.444983 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '39eaf8e6-b29a-454c-bbc7-2e57deb6bf76'} Oct 04 18:32:33.444983 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:33.444983 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:33.444983 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 18:32:33.444983 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 18:32:33.444983 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:32:33.444983 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:32:33.444983 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:32:33.444983 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:32:33.444983 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 18:32:33.444983 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 18:32:33.444983 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 18:32:33.444983 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 18:32:33.444983 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:32:33.444983 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:32:33.444983 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:32:33.444983 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:32:33.444983 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 39eaf8e6-b29a-454c-bbc7-2e57deb6bf76 to delete Oct 04 18:32:33.444983 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:33.444983 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:33.444983 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:33.444983 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:33.444983 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 18:32:33.444983 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 18:32:33.444983 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 18:32:33.444983 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 18:32:33.444983 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 18:32:33.444983 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 18:32:33.444983 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 39eaf8e6-b29a-454c-bbc7-2e57deb6bf76 could not be found. Oct 04 18:32:33.444983 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:33.444983 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:33.444983 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:33.449990 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:33.449990 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:33.449990 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:33.449990 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:33.449990 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:33.449990 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:32:33.449990 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:32:33.449990 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:33.449990 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:33.449990 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 18:32:33.449990 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 18:32:33.449990 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:32:33.449990 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:33.449990 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:33.449990 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:33.449990 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:33.449990 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:33.449990 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:33.449990 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:32:33.449990 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:32:33.449990 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:32:33.449990 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:33.452706 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3797357d-a616-450c-bd24-e81a53e67a5d tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Returning 404 to user: Image not found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:33.457246 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3797357d-a616-450c-bd24-e81a53e67a5d tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] 10.222.0.20 "DELETE /compute/v2.1/images/39eaf8e6-b29a-454c-bbc7-2e57deb6bf76" status: 404 len: 62 microversion: 2.1 time: 0.044987 Oct 04 18:32:33.457246 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 617/1182] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:33 2022] DELETE /compute/v2.1/images/39eaf8e6-b29a-454c-bbc7-2e57deb6bf76 => generated 62 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:32:33.463615 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7b62848a-f5d5-49c9-b558-cdc56a599347 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:33.464638 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7b62848a-f5d5-49c9-b558-cdc56a599347 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 4e1bb5af-9b8b-456f-beb1-aadf2491a8ed] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:33.477662 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7b62848a-f5d5-49c9-b558-cdc56a599347 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:33.482271 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7b62848a-f5d5-49c9-b558-cdc56a599347 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:33.482271 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7b62848a-f5d5-49c9-b558-cdc56a599347 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:33.483351 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7b62848a-f5d5-49c9-b558-cdc56a599347 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:33.484873 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7b62848a-f5d5-49c9-b558-cdc56a599347 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:33.488093 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7b62848a-f5d5-49c9-b558-cdc56a599347 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:33.758834 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7e969595-876b-469f-a51e-0fd8a4b04bb0 tempest-SecurityGroupRulesTestJSON-1957837475 tempest-SecurityGroupRulesTestJSON-1957837475-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 1.161592 Oct 04 18:32:33.761442 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 566/1183] 10.222.0.20 () {60 vars in 1180 bytes} [Tue Oct 4 18:32:32 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:33.766323 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3f6ab5d3-e7bc-4bb8-af60-21451136b8b2 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:33.766834 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3f6ab5d3-e7bc-4bb8-af60-21451136b8b2 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] [instance: e17c5b3e-a598-4369-9cf7-027a563e59fa] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:33.798815 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3f6ab5d3-e7bc-4bb8-af60-21451136b8b2 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:33.799803 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3f6ab5d3-e7bc-4bb8-af60-21451136b8b2 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:33.800471 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3f6ab5d3-e7bc-4bb8-af60-21451136b8b2 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:33.803209 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3f6ab5d3-e7bc-4bb8-af60-21451136b8b2 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:33.804322 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3f6ab5d3-e7bc-4bb8-af60-21451136b8b2 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:33.808670 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3f6ab5d3-e7bc-4bb8-af60-21451136b8b2 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:33.839055 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-3f6ab5d3-e7bc-4bb8-af60-21451136b8b2 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] HTTP exception thrown: Instance e17c5b3e-a598-4369-9cf7-027a563e59fa could not be found. Oct 04 18:32:33.845414 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3f6ab5d3-e7bc-4bb8-af60-21451136b8b2 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Request method failure captured: Oct 04 18:32:33.845414 n-d-850501-14 devstack@n-api.service[123001]: request: DELETE /compute/v2.1/servers/e17c5b3e-a598-4369-9cf7-027a563e59fa HTTP/1.1 Oct 04 18:32:33.845414 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:32:33.845414 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:32:33.845414 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:32:33.845414 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:32:33.845414 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:32:33.845414 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:32:33.845414 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:32:33.845414 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:33.845414 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPHvII_T7EcjvuInFv4t5qVF70S9vjGBK66HvfyVnOiY_TVbsAPYjguHISQjMiOeT1bz8CjLq7zDrG77IXy0kQULYEqIfKm3jlSWTKPDcogOtbqbQpds3d11ZgBfbFr39fSjqioDU_0CmuRBwgkz6wZ-Zh6uUaL8av5rXkIBhSk0fN1E Oct 04 18:32:33.845414 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:32:33.845414 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:32:33.845414 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:32:33.845414 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:32:33.845414 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:32:33.845414 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:32:33.845414 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 7e44e7aa06ee4126b5705ba65145ebcc Oct 04 18:32:33.845414 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1566997612 Oct 04 18:32:33.845414 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:32:33.845414 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:32:33.845414 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e44e7aa06ee4126b5705ba65145ebcc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7e44e7aa06ee4126b5705ba65145ebcc", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7e44e7aa06ee4126b5705ba65145ebcc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e44e7aa06ee4126b5705ba65145ebcc"}]}] Oct 04 18:32:33.845414 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1566997612 Oct 04 18:32:33.845414 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 7e44e7aa06ee4126b5705ba65145ebcc Oct 04 18:32:33.845414 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1566997612 Oct 04 18:32:33.845414 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ImagesOneServerNegativeTestJSON-1566997612-project Oct 04 18:32:33.845414 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:32:33.845414 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:32:33.845414 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 415f49a275284a7eb714a55c6bdd0005 Oct 04 18:32:33.845414 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1566997612-project Oct 04 18:32:33.845414 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:32:33.845414 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance e17c5b3e-a598-4369-9cf7-027a563e59fa could not be found. Oct 04 18:32:33.845414 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': 'e17c5b3e-a598-4369-9cf7-027a563e59fa'} Oct 04 18:32:33.845414 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:33.845414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:33.845414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:32:33.845414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:32:33.845414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:32:33.845414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:32:33.845414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:32:33.845414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:32:33.845414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:32:33.845414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:32:33.845414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e17c5b3e-a598-4369-9cf7-027a563e59fa could not be found. Oct 04 18:32:33.845414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:32:33.845414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:33.845414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:32:33.845414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:33.845414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:33.845414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:33.845414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:33.845414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:33.845414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:33.845414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:33.845414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:32:33.845414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:32:33.845414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:32:33.845414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:32:33.845414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:32:33.845414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:32:33.845414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:32:33.845414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:32:33.850771 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e17c5b3e-a598-4369-9cf7-027a563e59fa could not be found. Oct 04 18:32:33.850771 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:32:33.850771 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:33.850771 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:32:33.850771 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:33.850771 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:33.850771 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:33.850771 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:32:33.850771 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:32:33.850771 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e17c5b3e-a598-4369-9cf7-027a563e59fa could not be found. Oct 04 18:32:33.850771 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:32:33.857922 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3f6ab5d3-e7bc-4bb8-af60-21451136b8b2 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Returning 404 to user: Instance e17c5b3e-a598-4369-9cf7-027a563e59fa could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:33.858953 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3f6ab5d3-e7bc-4bb8-af60-21451136b8b2 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e17c5b3e-a598-4369-9cf7-027a563e59fa" status: 404 len: 111 microversion: 2.1 time: 0.096399 Oct 04 18:32:33.859545 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 567/1184] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:32:33 2022] DELETE /compute/v2.1/servers/e17c5b3e-a598-4369-9cf7-027a563e59fa => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:32:33.873325 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8fc1f176-272b-43e9-a398-c6b841b327f6 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:33.875311 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8fc1f176-272b-43e9-a398-c6b841b327f6 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: b219d988-2847-45a0-a3b8-af54cf1a43f8] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:33.900848 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8fc1f176-272b-43e9-a398-c6b841b327f6 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:33.908538 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8fc1f176-272b-43e9-a398-c6b841b327f6 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:33.908538 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8fc1f176-272b-43e9-a398-c6b841b327f6 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:33.908827 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7b62848a-f5d5-49c9-b558-cdc56a599347 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:33.909279 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8fc1f176-272b-43e9-a398-c6b841b327f6 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:33.909279 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8fc1f176-272b-43e9-a398-c6b841b327f6 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:33.909279 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8fc1f176-272b-43e9-a398-c6b841b327f6 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:33.914847 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7b62848a-f5d5-49c9-b558-cdc56a599347 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/4e1bb5af-9b8b-456f-beb1-aadf2491a8ed" status: 200 len: 1479 microversion: 2.1 time: 0.459122 Oct 04 18:32:33.921683 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 618/1185] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:33 2022] GET /compute/v2.1/servers/4e1bb5af-9b8b-456f-beb1-aadf2491a8ed => generated 1479 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:33.935011 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-39c40b83-044b-4668-9854-5fc640540513 tempest-SecurityGroupRulesTestJSON-1957837475 tempest-SecurityGroupRulesTestJSON-1957837475-project] Action: 'create', calling method: .version_select at 0x7fe259277940>, body: {"security_group_rule": {"parent_group_id": "fdf453ae-277d-4292-9bf9-5f0fb29f47e9", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:34.148279 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8fc1f176-272b-43e9-a398-c6b841b327f6 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:34.157658 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8fc1f176-272b-43e9-a398-c6b841b327f6 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:34.160608 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8fc1f176-272b-43e9-a398-c6b841b327f6 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:34.162988 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8fc1f176-272b-43e9-a398-c6b841b327f6 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8" status: 200 len: 1409 microversion: 2.25 time: 0.299228 Oct 04 18:32:34.187950 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 568/1186] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:32:33 2022] GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8 => generated 1409 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:32:34.199162 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b0135f10-6d34-4506-b6d9-663cbc0865df tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:34.200516 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b0135f10-6d34-4506-b6d9-663cbc0865df tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] [instance: e17c5b3e-a598-4369-9cf7-027a563e59fa] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:34.209610 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b0135f10-6d34-4506-b6d9-663cbc0865df tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:34.210690 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b0135f10-6d34-4506-b6d9-663cbc0865df tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:34.211264 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b0135f10-6d34-4506-b6d9-663cbc0865df tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:34.212991 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b0135f10-6d34-4506-b6d9-663cbc0865df tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:34.214155 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b0135f10-6d34-4506-b6d9-663cbc0865df tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:34.215012 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b0135f10-6d34-4506-b6d9-663cbc0865df tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:34.244977 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-b0135f10-6d34-4506-b6d9-663cbc0865df tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] HTTP exception thrown: Instance e17c5b3e-a598-4369-9cf7-027a563e59fa could not be found. Oct 04 18:32:34.246990 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b0135f10-6d34-4506-b6d9-663cbc0865df tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Request method failure captured: Oct 04 18:32:34.246990 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/e17c5b3e-a598-4369-9cf7-027a563e59fa HTTP/1.1 Oct 04 18:32:34.246990 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:32:34.246990 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:32:34.246990 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:32:34.246990 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:32:34.246990 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:32:34.246990 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:32:34.246990 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:32:34.246990 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:34.246990 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPHvII_T7EcjvuInFv4t5qVF70S9vjGBK66HvfyVnOiY_TVbsAPYjguHISQjMiOeT1bz8CjLq7zDrG77IXy0kQULYEqIfKm3jlSWTKPDcogOtbqbQpds3d11ZgBfbFr39fSjqioDU_0CmuRBwgkz6wZ-Zh6uUaL8av5rXkIBhSk0fN1E Oct 04 18:32:34.246990 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:32:34.246990 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:32:34.246990 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:32:34.246990 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:32:34.246990 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:32:34.246990 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:32:34.246990 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 7e44e7aa06ee4126b5705ba65145ebcc Oct 04 18:32:34.246990 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1566997612 Oct 04 18:32:34.246990 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:32:34.246990 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:32:34.246990 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e44e7aa06ee4126b5705ba65145ebcc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7e44e7aa06ee4126b5705ba65145ebcc", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7e44e7aa06ee4126b5705ba65145ebcc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e44e7aa06ee4126b5705ba65145ebcc"}]}] Oct 04 18:32:34.246990 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1566997612 Oct 04 18:32:34.246990 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 7e44e7aa06ee4126b5705ba65145ebcc Oct 04 18:32:34.246990 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1566997612 Oct 04 18:32:34.246990 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ImagesOneServerNegativeTestJSON-1566997612-project Oct 04 18:32:34.246990 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:32:34.246990 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:32:34.246990 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 415f49a275284a7eb714a55c6bdd0005 Oct 04 18:32:34.246990 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1566997612-project Oct 04 18:32:34.246990 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:32:34.246990 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance e17c5b3e-a598-4369-9cf7-027a563e59fa could not be found. Oct 04 18:32:34.246990 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': 'e17c5b3e-a598-4369-9cf7-027a563e59fa'} Oct 04 18:32:34.246990 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:34.246990 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:34.246990 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:32:34.246990 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:32:34.246990 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:32:34.246990 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:32:34.246990 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:32:34.246990 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:32:34.246990 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:32:34.246990 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:32:34.246990 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e17c5b3e-a598-4369-9cf7-027a563e59fa could not be found. Oct 04 18:32:34.246990 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:32:34.246990 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:34.246990 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:32:34.246990 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:34.246990 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:34.246990 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:34.246990 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:34.246990 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:34.246990 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:34.246990 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:34.246990 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:32:34.246990 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:32:34.246990 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:32:34.246990 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:32:34.246990 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:32:34.246990 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:32:34.246990 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e17c5b3e-a598-4369-9cf7-027a563e59fa could not be found. Oct 04 18:32:34.246990 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:32:34.246990 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:34.251998 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:32:34.251998 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:34.251998 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:34.251998 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:34.251998 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:32:34.251998 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:32:34.251998 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e17c5b3e-a598-4369-9cf7-027a563e59fa could not be found. Oct 04 18:32:34.251998 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:32:34.254562 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b0135f10-6d34-4506-b6d9-663cbc0865df tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Returning 404 to user: Instance e17c5b3e-a598-4369-9cf7-027a563e59fa could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:34.258144 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b0135f10-6d34-4506-b6d9-663cbc0865df tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] 10.222.0.20 "GET /compute/v2.1/servers/e17c5b3e-a598-4369-9cf7-027a563e59fa" status: 404 len: 111 microversion: 2.1 time: 0.069371 Oct 04 18:32:34.264256 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 569/1187] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:34 2022] GET /compute/v2.1/servers/e17c5b3e-a598-4369-9cf7-027a563e59fa => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:32:34.274988 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-eafa465d-e169-486d-956c-a9e108e88dda tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Calling method '.version_select at 0x7fe25911edc0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:34.275854 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eafa465d-e169-486d-956c-a9e108e88dda tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:34.276609 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eafa465d-e169-486d-956c-a9e108e88dda tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:34.277511 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eafa465d-e169-486d-956c-a9e108e88dda tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:34.300939 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-eafa465d-e169-486d-956c-a9e108e88dda tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 1566 microversion: 2.1 time: 0.032591 Oct 04 18:32:34.304250 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 570/1188] 10.222.0.20 () {58 vars in 1143 bytes} [Tue Oct 4 18:32:34 2022] GET /compute/v2.1/os-migrations => generated 1566 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:34.326112 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4328f640-195a-4810-b703-73b6cbc394b0 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '.version_select at 0x7fe259951430>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:34.474476 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-4328f640-195a-4810-b703-73b6cbc394b0 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/images/cabaf7e6-9081-4a33-8415-4c717517ad62" status: 200 len: 1414 microversion: 2.1 time: 0.159351 Oct 04 18:32:34.482952 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 571/1189] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:32:34 2022] GET /compute/v2.1/images/cabaf7e6-9081-4a33-8415-4c717517ad62 => generated 1414 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:34.499822 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a4a65cb5-3451-4c02-8a60-5bd852206b08 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Calling method '.version_select at 0x7fe2590dae50>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:34.515699 n-d-850501-14 devstack@n-api.service[123001]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a4a65cb5-3451-4c02-8a60-5bd852206b08 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] [6c8ce3ae-b440-4b28-996b-33b11441f461] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 18:32:34.649082 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-39c40b83-044b-4668-9854-5fc640540513 tempest-SecurityGroupRulesTestJSON-1957837475 tempest-SecurityGroupRulesTestJSON-1957837475-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.725890 Oct 04 18:32:34.650606 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 619/1190] 10.222.0.20 () {60 vars in 1195 bytes} [Tue Oct 4 18:32:33 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:34.656099 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-113efda9-7a46-458f-869a-60d34cba8851 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:34.660813 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-113efda9-7a46-458f-869a-60d34cba8851 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] [instance: 4e1bb5af-9b8b-456f-beb1-aadf2491a8ed] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:34.671684 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-113efda9-7a46-458f-869a-60d34cba8851 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:34.674682 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-113efda9-7a46-458f-869a-60d34cba8851 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:34.675137 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-113efda9-7a46-458f-869a-60d34cba8851 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:34.675869 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-113efda9-7a46-458f-869a-60d34cba8851 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:34.680343 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-113efda9-7a46-458f-869a-60d34cba8851 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:34.680853 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-113efda9-7a46-458f-869a-60d34cba8851 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:35.051692 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-113efda9-7a46-458f-869a-60d34cba8851 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/4e1bb5af-9b8b-456f-beb1-aadf2491a8ed" status: 200 len: 1632 microversion: 2.1 time: 0.393276 Oct 04 18:32:35.052621 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 620/1191] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:34 2022] GET /compute/v2.1/servers/4e1bb5af-9b8b-456f-beb1-aadf2491a8ed => generated 1632 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:35.060359 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ed3977fa-606a-469d-8819-9037b88f784d tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:35.066920 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ed3977fa-606a-469d-8819-9037b88f784d tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: 890f8168-5b22-465a-894d-ca70dd1acbed] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:35.092569 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ed3977fa-606a-469d-8819-9037b88f784d tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:35.095404 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ed3977fa-606a-469d-8819-9037b88f784d tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:35.096042 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ed3977fa-606a-469d-8819-9037b88f784d tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:35.097179 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ed3977fa-606a-469d-8819-9037b88f784d tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:35.099237 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ed3977fa-606a-469d-8819-9037b88f784d tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:35.102031 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ed3977fa-606a-469d-8819-9037b88f784d tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:35.286933 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ed3977fa-606a-469d-8819-9037b88f784d tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:35.298688 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ed3977fa-606a-469d-8819-9037b88f784d tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/890f8168-5b22-465a-894d-ca70dd1acbed" status: 200 len: 1475 microversion: 2.1 time: 0.244136 Oct 04 18:32:35.299686 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 621/1192] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:35 2022] GET /compute/v2.1/servers/890f8168-5b22-465a-894d-ca70dd1acbed => generated 1475 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:35.305273 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b743846c-d63c-41cf-ba3f-ebd73faa7833 tempest-SecurityGroupRulesTestJSON-1957837475 tempest-SecurityGroupRulesTestJSON-1957837475-project] Action: 'create', calling method: .version_select at 0x7fe259359280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-2043882264", "description": "tempest-description-1659860174"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:35.527168 n-d-850501-14 devstack@n-api.service[123001]: INFO oslo.messaging._drivers.impl_rabbit [None req-a4a65cb5-3451-4c02-8a60-5bd852206b08 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] [6c8ce3ae-b440-4b28-996b-33b11441f461] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 46500. Oct 04 18:32:35.657558 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a4a65cb5-3451-4c02-8a60-5bd852206b08 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2104126223" status: 202 len: 0 microversion: 2.1 time: 1.170902 Oct 04 18:32:35.658560 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 572/1193] 10.222.0.20 () {58 vars in 1221 bytes} [Tue Oct 4 18:32:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2104126223 => generated 0 bytes in 1175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:32:35.668048 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d1ca4da8-9f35-4c33-9736-feded652e4ae tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Action: 'create', calling method: .version_select at 0x7fe259102ee0>, body: {"keypair": {"name": "tempest-keypair-1788764597", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLK9mDyLfzCbOQGacle3ZGMeFGeoAL3A5wbmJ90/Id5OySTnDh6V7KdFbBTOAhry92UcuUloD9pJGpS27YJ2sBH+mf6A2CKECnBAgRVaaJkpNzneM7Zje5K7DQpNuHQXwg=="}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:35.713819 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-d1ca4da8-9f35-4c33-9736-feded652e4ae tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Getting quotas for project dde62f171d474b038f1af39899518211. Resources: {'key_pairs'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:32:35.728443 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-d1ca4da8-9f35-4c33-9736-feded652e4ae tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Getting quotas for user c80f2b2dbf824a1d879f5b7edb343f26 and project dde62f171d474b038f1af39899518211. Resources: {'key_pairs'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:32:35.883244 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b743846c-d63c-41cf-ba3f-ebd73faa7833 tempest-SecurityGroupRulesTestJSON-1957837475 tempest-SecurityGroupRulesTestJSON-1957837475-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.580087 Oct 04 18:32:35.885218 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 622/1194] 10.222.0.20 () {60 vars in 1180 bytes} [Tue Oct 4 18:32:35 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:35.889650 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d1ca4da8-9f35-4c33-9736-feded652e4ae tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.225377 Oct 04 18:32:35.891604 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 573/1195] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Oct 4 18:32:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:35.902834 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f35b9f22-8eb5-4fe3-a930-21616bee4c03 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '.version_select at 0x7fe2593daca0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:35.903127 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b465ad37-7bbf-4d29-a710-9b89b76f0814 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:35.904081 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b465ad37-7bbf-4d29-a710-9b89b76f0814 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: b219d988-2847-45a0-a3b8-af54cf1a43f8] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:35.915897 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b465ad37-7bbf-4d29-a710-9b89b76f0814 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:35.920932 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b465ad37-7bbf-4d29-a710-9b89b76f0814 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:35.922912 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b465ad37-7bbf-4d29-a710-9b89b76f0814 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:35.923904 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b465ad37-7bbf-4d29-a710-9b89b76f0814 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:35.925126 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b465ad37-7bbf-4d29-a710-9b89b76f0814 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:35.925862 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b465ad37-7bbf-4d29-a710-9b89b76f0814 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:35.988387 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f35b9f22-8eb5-4fe3-a930-21616bee4c03 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/images/cabaf7e6-9081-4a33-8415-4c717517ad62" status: 200 len: 1414 microversion: 2.1 time: 0.094020 Oct 04 18:32:35.989475 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 574/1196] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:32:35 2022] GET /compute/v2.1/images/cabaf7e6-9081-4a33-8415-4c717517ad62 => generated 1414 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:36.001831 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5ea93a80-71c7-41b2-bdee-f02b837c13f4 tempest-SecurityGroupRulesTestJSON-1957837475 tempest-SecurityGroupRulesTestJSON-1957837475-project] Action: 'create', calling method: .version_select at 0x7fe2590daca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-806487676", "description": "tempest-description-1938272783"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:36.559056 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b465ad37-7bbf-4d29-a710-9b89b76f0814 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:36.561551 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=95,nova_cell1:UPDATE=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:36.593800 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b465ad37-7bbf-4d29-a710-9b89b76f0814 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:36.606257 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b465ad37-7bbf-4d29-a710-9b89b76f0814 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:36.607254 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b465ad37-7bbf-4d29-a710-9b89b76f0814 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8" status: 200 len: 1409 microversion: 2.25 time: 0.717967 Oct 04 18:32:36.636621 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 623/1197] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:32:35 2022] GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8 => generated 1409 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:32:36.642167 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-8bfc4f72-6aef-4bda-9869-14f25f52b214 req-30506afa-cad5-4fb1-9611-4fd5e902cbba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b219d988-2847-45a0-a3b8-af54cf1a43f8", "name": "network-vif-plugged", "status": "completed", "tag": "581c676f-096d-4159-ae53-d455ac141b32"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:36.669602 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-8bfc4f72-6aef-4bda-9869-14f25f52b214 req-30506afa-cad5-4fb1-9611-4fd5e902cbba service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:36.670105 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-8bfc4f72-6aef-4bda-9869-14f25f52b214 req-30506afa-cad5-4fb1-9611-4fd5e902cbba service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:36.670545 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-8bfc4f72-6aef-4bda-9869-14f25f52b214 req-30506afa-cad5-4fb1-9611-4fd5e902cbba service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:36.683809 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-8bfc4f72-6aef-4bda-9869-14f25f52b214 req-30506afa-cad5-4fb1-9611-4fd5e902cbba service nova] Creating event network-vif-plugged:581c676f-096d-4159-ae53-d455ac141b32 for instance b219d988-2847-45a0-a3b8-af54cf1a43f8 on n-h1-850501-14 Oct 04 18:32:36.689641 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-8bfc4f72-6aef-4bda-9869-14f25f52b214 req-30506afa-cad5-4fb1-9611-4fd5e902cbba service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051445 Oct 04 18:32:36.691315 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 624/1198] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:32:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:36.698326 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-53adf6a1-9693-4b1b-bf45-aa631d1fe6af tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:36.714347 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-53adf6a1-9693-4b1b-bf45-aa631d1fe6af tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: 890f8168-5b22-465a-894d-ca70dd1acbed] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:36.755449 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-53adf6a1-9693-4b1b-bf45-aa631d1fe6af tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:36.757679 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-53adf6a1-9693-4b1b-bf45-aa631d1fe6af tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:36.760843 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-53adf6a1-9693-4b1b-bf45-aa631d1fe6af tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:36.762148 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-53adf6a1-9693-4b1b-bf45-aa631d1fe6af tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:36.762861 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-53adf6a1-9693-4b1b-bf45-aa631d1fe6af tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:36.764626 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-53adf6a1-9693-4b1b-bf45-aa631d1fe6af tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:37.153986 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5ea93a80-71c7-41b2-bdee-f02b837c13f4 tempest-SecurityGroupRulesTestJSON-1957837475 tempest-SecurityGroupRulesTestJSON-1957837475-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.162837 Oct 04 18:32:37.155537 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 575/1199] 10.222.0.20 () {60 vars in 1180 bytes} [Tue Oct 4 18:32:35 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:37.161346 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-07a11020-1763-463c-b8b1-43cbc7e4bbd6 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '.version_select at 0x7fe259102dc0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:37.201830 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-53adf6a1-9693-4b1b-bf45-aa631d1fe6af tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:37.239332 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-07a11020-1763-463c-b8b1-43cbc7e4bbd6 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/images/cabaf7e6-9081-4a33-8415-4c717517ad62" status: 200 len: 1414 microversion: 2.1 time: 0.082152 Oct 04 18:32:37.240883 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-53adf6a1-9693-4b1b-bf45-aa631d1fe6af tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/890f8168-5b22-465a-894d-ca70dd1acbed" status: 200 len: 1475 microversion: 2.1 time: 0.547670 Oct 04 18:32:37.246288 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 625/1200] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:36 2022] GET /compute/v2.1/servers/890f8168-5b22-465a-894d-ca70dd1acbed => generated 1475 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:37.247907 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 576/1201] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:32:37 2022] GET /compute/v2.1/images/cabaf7e6-9081-4a33-8415-4c717517ad62 => generated 1414 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:37.263379 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d42091cb-244b-43f6-b57c-f5227fc764e3 tempest-SecurityGroupRulesTestJSON-1957837475 tempest-SecurityGroupRulesTestJSON-1957837475-project] Action: 'create', calling method: .version_select at 0x7fe2592d7940>, body: {"security_group_rule": {"parent_group_id": "c76bd2e7-0e02-4248-9dd2-bd7378c5b97b", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "52560891-0ee5-48e9-af07-52731a75c806"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:37.324840 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-79a5f044-3933-4a11-ae2b-e09a8108a884 req-957143b1-859d-4f20-9c93-672d772fe677 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "890f8168-5b22-465a-894d-ca70dd1acbed", "name": "network-vif-deleted", "tag": "7b1455a6-e16b-4098-ab8c-31d0d8669b3d"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:37.344296 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:DELETE=4,nova_api:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:37.348408 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-79a5f044-3933-4a11-ae2b-e09a8108a884 req-957143b1-859d-4f20-9c93-672d772fe677 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:37.351450 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-79a5f044-3933-4a11-ae2b-e09a8108a884 req-957143b1-859d-4f20-9c93-672d772fe677 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:37.352381 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-79a5f044-3933-4a11-ae2b-e09a8108a884 req-957143b1-859d-4f20-9c93-672d772fe677 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:37.380166 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-79a5f044-3933-4a11-ae2b-e09a8108a884 req-957143b1-859d-4f20-9c93-672d772fe677 service nova] Creating event network-vif-deleted:7b1455a6-e16b-4098-ab8c-31d0d8669b3d for instance 890f8168-5b22-465a-894d-ca70dd1acbed on n-h2-850501-14 Oct 04 18:32:37.403297 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-79a5f044-3933-4a11-ae2b-e09a8108a884 req-957143b1-859d-4f20-9c93-672d772fe677 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076329 Oct 04 18:32:37.404638 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 577/1202] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:32:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:32:37.640306 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2b40bbd8-2b68-4683-8275-c9cd2f1ff541 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:37.641341 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2b40bbd8-2b68-4683-8275-c9cd2f1ff541 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: b219d988-2847-45a0-a3b8-af54cf1a43f8] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:37.653357 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2b40bbd8-2b68-4683-8275-c9cd2f1ff541 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:37.654164 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2b40bbd8-2b68-4683-8275-c9cd2f1ff541 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:37.654838 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2b40bbd8-2b68-4683-8275-c9cd2f1ff541 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:37.655774 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2b40bbd8-2b68-4683-8275-c9cd2f1ff541 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:37.656548 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2b40bbd8-2b68-4683-8275-c9cd2f1ff541 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:37.657170 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2b40bbd8-2b68-4683-8275-c9cd2f1ff541 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:38.475913 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-2b40bbd8-2b68-4683-8275-c9cd2f1ff541 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:38.488503 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-2b40bbd8-2b68-4683-8275-c9cd2f1ff541 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:38.490755 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-2b40bbd8-2b68-4683-8275-c9cd2f1ff541 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:38.493232 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2b40bbd8-2b68-4683-8275-c9cd2f1ff541 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8" status: 200 len: 1409 microversion: 2.25 time: 0.859099 Oct 04 18:32:38.493807 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 578/1203] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:32:37 2022] GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8 => generated 1409 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:32:38.507274 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6f25f86e-d758-4c27-9d82-f64b71f96b8e tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '.version_select at 0x7fe259317af0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:38.568173 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6f25f86e-d758-4c27-9d82-f64b71f96b8e tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/images/cabaf7e6-9081-4a33-8415-4c717517ad62" status: 200 len: 1414 microversion: 2.1 time: 0.071930 Oct 04 18:32:38.569815 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 579/1204] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:32:38 2022] GET /compute/v2.1/images/cabaf7e6-9081-4a33-8415-4c717517ad62 => generated 1414 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:38.576492 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e8c3d411-bc47-456a-9d4e-0aa7d823e705 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:38.577697 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e8c3d411-bc47-456a-9d4e-0aa7d823e705 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: 890f8168-5b22-465a-894d-ca70dd1acbed] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:38.589684 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e8c3d411-bc47-456a-9d4e-0aa7d823e705 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:38.591056 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e8c3d411-bc47-456a-9d4e-0aa7d823e705 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:38.591915 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e8c3d411-bc47-456a-9d4e-0aa7d823e705 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:38.592843 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e8c3d411-bc47-456a-9d4e-0aa7d823e705 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:38.593473 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e8c3d411-bc47-456a-9d4e-0aa7d823e705 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:38.594266 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e8c3d411-bc47-456a-9d4e-0aa7d823e705 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:38.633091 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e8c3d411-bc47-456a-9d4e-0aa7d823e705 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:38.634190 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e8c3d411-bc47-456a-9d4e-0aa7d823e705 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:38.634635 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e8c3d411-bc47-456a-9d4e-0aa7d823e705 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:38.635092 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-e8c3d411-bc47-456a-9d4e-0aa7d823e705 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lazy-loading 'fault' on Instance uuid 890f8168-5b22-465a-894d-ca70dd1acbed {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:32:38.726705 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e8c3d411-bc47-456a-9d4e-0aa7d823e705 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:38.735305 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e8c3d411-bc47-456a-9d4e-0aa7d823e705 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/890f8168-5b22-465a-894d-ca70dd1acbed" status: 200 len: 1309 microversion: 2.1 time: 0.162930 Oct 04 18:32:38.748081 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 580/1205] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:38 2022] GET /compute/v2.1/servers/890f8168-5b22-465a-894d-ca70dd1acbed => generated 1309 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:38.748081 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d827111a-9323-4ea9-b8d1-19d915b67bf2 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Calling method '.version_select at 0x7fe2590da8b0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:38.765659 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-d827111a-9323-4ea9-b8d1-19d915b67bf2 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] HTTP exception thrown: Image not found. Oct 04 18:32:38.767740 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d827111a-9323-4ea9-b8d1-19d915b67bf2 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Request method failure captured: Oct 04 18:32:38.767740 n-d-850501-14 devstack@n-api.service[123001]: request: DELETE /compute/v2.1/images/6fa98b5c-981c-4c2a-86e0-b8422120981a HTTP/1.1 Oct 04 18:32:38.767740 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:32:38.767740 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:32:38.767740 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:32:38.767740 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:32:38.767740 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:32:38.767740 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:32:38.767740 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:32:38.767740 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:38.767740 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPHvII_T7EcjvuInFv4t5qVF70S9vjGBK66HvfyVnOiY_TVbsAPYjguHISQjMiOeT1bz8CjLq7zDrG77IXy0kQULYEqIfKm3jlSWTKPDcogOtbqbQpds3d11ZgBfbFr39fSjqioDU_0CmuRBwgkz6wZ-Zh6uUaL8av5rXkIBhSk0fN1E Oct 04 18:32:38.767740 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:32:38.767740 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:32:38.767740 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:32:38.767740 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:32:38.767740 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:32:38.767740 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:32:38.767740 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 7e44e7aa06ee4126b5705ba65145ebcc Oct 04 18:32:38.767740 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1566997612 Oct 04 18:32:38.767740 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:32:38.767740 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:32:38.767740 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e44e7aa06ee4126b5705ba65145ebcc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7e44e7aa06ee4126b5705ba65145ebcc", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7e44e7aa06ee4126b5705ba65145ebcc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e44e7aa06ee4126b5705ba65145ebcc"}]}] Oct 04 18:32:38.767740 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1566997612 Oct 04 18:32:38.767740 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 7e44e7aa06ee4126b5705ba65145ebcc Oct 04 18:32:38.767740 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1566997612 Oct 04 18:32:38.767740 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ImagesOneServerNegativeTestJSON-1566997612-project Oct 04 18:32:38.767740 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:32:38.767740 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:32:38.767740 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 415f49a275284a7eb714a55c6bdd0005 Oct 04 18:32:38.767740 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1566997612-project Oct 04 18:32:38.767740 n-d-850501-14 devstack@n-api.service[123001]: method: Oct 04 18:32:38.767740 n-d-850501-14 devstack@n-api.service[123001]: exception: Image not found. Oct 04 18:32:38.767740 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '6fa98b5c-981c-4c2a-86e0-b8422120981a'} Oct 04 18:32:38.767740 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:38.767740 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:38.767740 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 18:32:38.767740 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 18:32:38.767740 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:32:38.767740 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:32:38.767740 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:32:38.767740 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:32:38.767740 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 18:32:38.767740 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 18:32:38.767740 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 18:32:38.767740 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 18:32:38.767740 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:32:38.767740 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:32:38.767740 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:32:38.767740 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:32:38.767740 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 6fa98b5c-981c-4c2a-86e0-b8422120981a to delete Oct 04 18:32:38.767740 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:32:38.767740 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:38.767740 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:32:38.767740 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:38.767740 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 18:32:38.767740 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 18:32:38.767740 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 18:32:38.767740 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 18:32:38.767740 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 18:32:38.767740 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 18:32:38.767740 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6fa98b5c-981c-4c2a-86e0-b8422120981a could not be found. Oct 04 18:32:38.767740 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:32:38.767740 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:38.767740 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:32:38.773552 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:38.773552 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:38.773552 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:38.773552 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:38.773552 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:38.773552 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:32:38.773552 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:32:38.773552 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:38.773552 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:38.773552 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 18:32:38.773552 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 18:32:38.773552 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:32:38.773552 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:32:38.773552 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:38.773552 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:32:38.773552 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:38.773552 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:38.773552 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:38.773552 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:32:38.773552 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:32:38.773552 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:32:38.773552 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:32:38.773552 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d827111a-9323-4ea9-b8d1-19d915b67bf2 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Returning 404 to user: Image not found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:38.773552 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d827111a-9323-4ea9-b8d1-19d915b67bf2 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] 10.222.0.20 "DELETE /compute/v2.1/images/6fa98b5c-981c-4c2a-86e0-b8422120981a" status: 404 len: 62 microversion: 2.1 time: 0.032164 Oct 04 18:32:38.776307 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 581/1206] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:38 2022] DELETE /compute/v2.1/images/6fa98b5c-981c-4c2a-86e0-b8422120981a => generated 62 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:32:38.780172 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-573b6bbc-43c8-40b9-b6f4-b8c93b238c59 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:38.780715 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-573b6bbc-43c8-40b9-b6f4-b8c93b238c59 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] [instance: c1bf585c-9cc9-4f87-966c-e02882aa51fd] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:38.788138 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-573b6bbc-43c8-40b9-b6f4-b8c93b238c59 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:38.788640 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-573b6bbc-43c8-40b9-b6f4-b8c93b238c59 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:38.789082 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-573b6bbc-43c8-40b9-b6f4-b8c93b238c59 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:38.789799 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-573b6bbc-43c8-40b9-b6f4-b8c93b238c59 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:38.790267 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-573b6bbc-43c8-40b9-b6f4-b8c93b238c59 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:38.790728 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-573b6bbc-43c8-40b9-b6f4-b8c93b238c59 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:38.806221 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-573b6bbc-43c8-40b9-b6f4-b8c93b238c59 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] HTTP exception thrown: Instance c1bf585c-9cc9-4f87-966c-e02882aa51fd could not be found. Oct 04 18:32:38.808048 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-573b6bbc-43c8-40b9-b6f4-b8c93b238c59 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Request method failure captured: Oct 04 18:32:38.808048 n-d-850501-14 devstack@n-api.service[123001]: request: DELETE /compute/v2.1/servers/c1bf585c-9cc9-4f87-966c-e02882aa51fd HTTP/1.1 Oct 04 18:32:38.808048 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:32:38.808048 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:32:38.808048 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:32:38.808048 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:32:38.808048 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:32:38.808048 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:32:38.808048 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:32:38.808048 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:38.808048 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPHvII_T7EcjvuInFv4t5qVF70S9vjGBK66HvfyVnOiY_TVbsAPYjguHISQjMiOeT1bz8CjLq7zDrG77IXy0kQULYEqIfKm3jlSWTKPDcogOtbqbQpds3d11ZgBfbFr39fSjqioDU_0CmuRBwgkz6wZ-Zh6uUaL8av5rXkIBhSk0fN1E Oct 04 18:32:38.808048 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:32:38.808048 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:32:38.808048 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:32:38.808048 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:32:38.808048 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:32:38.808048 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:32:38.808048 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 7e44e7aa06ee4126b5705ba65145ebcc Oct 04 18:32:38.808048 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1566997612 Oct 04 18:32:38.808048 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:32:38.808048 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:32:38.808048 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e44e7aa06ee4126b5705ba65145ebcc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7e44e7aa06ee4126b5705ba65145ebcc", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7e44e7aa06ee4126b5705ba65145ebcc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e44e7aa06ee4126b5705ba65145ebcc"}]}] Oct 04 18:32:38.808048 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1566997612 Oct 04 18:32:38.808048 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 7e44e7aa06ee4126b5705ba65145ebcc Oct 04 18:32:38.808048 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1566997612 Oct 04 18:32:38.808048 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ImagesOneServerNegativeTestJSON-1566997612-project Oct 04 18:32:38.808048 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:32:38.808048 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:32:38.808048 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 415f49a275284a7eb714a55c6bdd0005 Oct 04 18:32:38.808048 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1566997612-project Oct 04 18:32:38.808048 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:32:38.808048 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance c1bf585c-9cc9-4f87-966c-e02882aa51fd could not be found. Oct 04 18:32:38.808048 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': 'c1bf585c-9cc9-4f87-966c-e02882aa51fd'} Oct 04 18:32:38.808048 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:38.808048 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:38.808048 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:32:38.808048 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:32:38.808048 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:32:38.808048 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:32:38.808048 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:32:38.808048 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:32:38.808048 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:32:38.808048 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:32:38.808048 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1bf585c-9cc9-4f87-966c-e02882aa51fd could not be found. Oct 04 18:32:38.808048 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:32:38.808048 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:38.808048 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:32:38.808048 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:38.808048 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:38.808048 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:38.808048 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:38.808048 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:38.808048 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:38.808048 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:38.808048 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:32:38.808048 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:32:38.808048 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:32:38.808048 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:32:38.808048 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:32:38.808048 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:32:38.808048 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:32:38.808048 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:32:38.832420 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1bf585c-9cc9-4f87-966c-e02882aa51fd could not be found. Oct 04 18:32:38.832420 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:32:38.832420 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:38.832420 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:32:38.832420 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:38.832420 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:38.832420 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:38.832420 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:32:38.832420 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:32:38.832420 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1bf585c-9cc9-4f87-966c-e02882aa51fd could not be found. Oct 04 18:32:38.832420 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:32:38.832420 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-573b6bbc-43c8-40b9-b6f4-b8c93b238c59 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Returning 404 to user: Instance c1bf585c-9cc9-4f87-966c-e02882aa51fd could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:38.832420 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-573b6bbc-43c8-40b9-b6f4-b8c93b238c59 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c1bf585c-9cc9-4f87-966c-e02882aa51fd" status: 404 len: 111 microversion: 2.1 time: 0.033704 Oct 04 18:32:38.832420 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 582/1207] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:32:38 2022] DELETE /compute/v2.1/servers/c1bf585c-9cc9-4f87-966c-e02882aa51fd => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:32:38.835482 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-eaacccb7-7d9c-4a6b-b574-6d90e580aac5 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:38.836212 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-eaacccb7-7d9c-4a6b-b574-6d90e580aac5 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] [instance: c1bf585c-9cc9-4f87-966c-e02882aa51fd] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:38.842337 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eaacccb7-7d9c-4a6b-b574-6d90e580aac5 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:38.842836 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eaacccb7-7d9c-4a6b-b574-6d90e580aac5 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:38.843280 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eaacccb7-7d9c-4a6b-b574-6d90e580aac5 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:38.843992 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eaacccb7-7d9c-4a6b-b574-6d90e580aac5 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:38.844501 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eaacccb7-7d9c-4a6b-b574-6d90e580aac5 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:38.844934 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eaacccb7-7d9c-4a6b-b574-6d90e580aac5 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:38.868040 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-eaacccb7-7d9c-4a6b-b574-6d90e580aac5 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] HTTP exception thrown: Instance c1bf585c-9cc9-4f87-966c-e02882aa51fd could not be found. Oct 04 18:32:38.869654 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-eaacccb7-7d9c-4a6b-b574-6d90e580aac5 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Request method failure captured: Oct 04 18:32:38.869654 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/c1bf585c-9cc9-4f87-966c-e02882aa51fd HTTP/1.1 Oct 04 18:32:38.869654 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:32:38.869654 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:32:38.869654 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:32:38.869654 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:32:38.869654 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:32:38.869654 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:32:38.869654 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:32:38.869654 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:38.869654 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPHvII_T7EcjvuInFv4t5qVF70S9vjGBK66HvfyVnOiY_TVbsAPYjguHISQjMiOeT1bz8CjLq7zDrG77IXy0kQULYEqIfKm3jlSWTKPDcogOtbqbQpds3d11ZgBfbFr39fSjqioDU_0CmuRBwgkz6wZ-Zh6uUaL8av5rXkIBhSk0fN1E Oct 04 18:32:38.869654 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:32:38.869654 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:32:38.869654 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:32:38.869654 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:32:38.869654 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:32:38.869654 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:32:38.869654 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 7e44e7aa06ee4126b5705ba65145ebcc Oct 04 18:32:38.869654 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1566997612 Oct 04 18:32:38.869654 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:32:38.869654 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:32:38.869654 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e44e7aa06ee4126b5705ba65145ebcc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7e44e7aa06ee4126b5705ba65145ebcc", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7e44e7aa06ee4126b5705ba65145ebcc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e44e7aa06ee4126b5705ba65145ebcc"}]}] Oct 04 18:32:38.869654 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1566997612 Oct 04 18:32:38.869654 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 7e44e7aa06ee4126b5705ba65145ebcc Oct 04 18:32:38.869654 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1566997612 Oct 04 18:32:38.869654 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ImagesOneServerNegativeTestJSON-1566997612-project Oct 04 18:32:38.869654 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:32:38.869654 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:32:38.869654 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 415f49a275284a7eb714a55c6bdd0005 Oct 04 18:32:38.869654 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1566997612-project Oct 04 18:32:38.869654 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:32:38.869654 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance c1bf585c-9cc9-4f87-966c-e02882aa51fd could not be found. Oct 04 18:32:38.869654 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': 'c1bf585c-9cc9-4f87-966c-e02882aa51fd'} Oct 04 18:32:38.869654 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:38.869654 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:38.869654 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:32:38.869654 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:32:38.869654 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:32:38.869654 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:32:38.869654 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:32:38.869654 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:32:38.869654 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:32:38.869654 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:32:38.869654 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1bf585c-9cc9-4f87-966c-e02882aa51fd could not be found. Oct 04 18:32:38.869654 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:32:38.869654 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:38.869654 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:32:38.869654 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:38.869654 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:38.869654 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:38.869654 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:38.869654 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:38.869654 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:38.869654 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:38.869654 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:32:38.869654 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:32:38.869654 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:32:38.869654 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:32:38.869654 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:32:38.869654 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:32:38.869654 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1bf585c-9cc9-4f87-966c-e02882aa51fd could not be found. Oct 04 18:32:38.869654 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:32:38.869654 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:38.874904 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:32:38.874904 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:38.874904 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:38.874904 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:38.874904 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:32:38.874904 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:32:38.874904 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1bf585c-9cc9-4f87-966c-e02882aa51fd could not be found. Oct 04 18:32:38.874904 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:32:38.874904 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-eaacccb7-7d9c-4a6b-b574-6d90e580aac5 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] Returning 404 to user: Instance c1bf585c-9cc9-4f87-966c-e02882aa51fd could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:38.874904 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-eaacccb7-7d9c-4a6b-b574-6d90e580aac5 tempest-ImagesOneServerNegativeTestJSON-1566997612 tempest-ImagesOneServerNegativeTestJSON-1566997612-project] 10.222.0.20 "GET /compute/v2.1/servers/c1bf585c-9cc9-4f87-966c-e02882aa51fd" status: 404 len: 111 microversion: 2.1 time: 0.039783 Oct 04 18:32:38.874904 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 583/1208] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:38 2022] GET /compute/v2.1/servers/c1bf585c-9cc9-4f87-966c-e02882aa51fd => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:32:39.123448 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d42091cb-244b-43f6-b57c-f5227fc764e3 tempest-SecurityGroupRulesTestJSON-1957837475 tempest-SecurityGroupRulesTestJSON-1957837475-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 1.874140 Oct 04 18:32:39.124833 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 626/1209] 10.222.0.20 () {60 vars in 1195 bytes} [Tue Oct 4 18:32:37 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 1877 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:39.140247 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-917e058a-b418-48cf-a665-bd63913d82b7 tempest-SecurityGroupRulesTestJSON-1957837475 tempest-SecurityGroupRulesTestJSON-1957837475-project] Action: 'create', calling method: .version_select at 0x7fe259064c10>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-2119872134", "description": "tempest-description-55851485"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:39.467117 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-efe58ea5-32ec-42bc-8d30-98dceda5064b req-2d8e2c86-aa11-40a4-80b1-3dc115336305 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb82f77b-6207-4a99-a494-f252a820990c", "name": "network-vif-deleted", "tag": "373f7ba2-e607-421d-b977-173e90d9f09b"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:39.495508 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-efe58ea5-32ec-42bc-8d30-98dceda5064b req-2d8e2c86-aa11-40a4-80b1-3dc115336305 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:39.496731 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-efe58ea5-32ec-42bc-8d30-98dceda5064b req-2d8e2c86-aa11-40a4-80b1-3dc115336305 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:39.500680 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-efe58ea5-32ec-42bc-8d30-98dceda5064b req-2d8e2c86-aa11-40a4-80b1-3dc115336305 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:39.512248 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-efe58ea5-32ec-42bc-8d30-98dceda5064b req-2d8e2c86-aa11-40a4-80b1-3dc115336305 service nova] Creating event network-vif-deleted:373f7ba2-e607-421d-b977-173e90d9f09b for instance cb82f77b-6207-4a99-a494-f252a820990c on n-h2-850501-14 Oct 04 18:32:39.524669 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-efe58ea5-32ec-42bc-8d30-98dceda5064b req-2d8e2c86-aa11-40a4-80b1-3dc115336305 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061885 Oct 04 18:32:39.529956 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 627/1210] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:32:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:32:39.531554 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-48a0c300-8e43-4638-ac7d-21e7b7f71923 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:39.533198 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-48a0c300-8e43-4638-ac7d-21e7b7f71923 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: b219d988-2847-45a0-a3b8-af54cf1a43f8] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:39.543316 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-48a0c300-8e43-4638-ac7d-21e7b7f71923 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:39.544093 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-48a0c300-8e43-4638-ac7d-21e7b7f71923 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:39.544815 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-48a0c300-8e43-4638-ac7d-21e7b7f71923 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:39.545744 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-48a0c300-8e43-4638-ac7d-21e7b7f71923 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:39.546451 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-48a0c300-8e43-4638-ac7d-21e7b7f71923 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:39.548045 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-48a0c300-8e43-4638-ac7d-21e7b7f71923 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:39.923761 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-48a0c300-8e43-4638-ac7d-21e7b7f71923 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:39.986206 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-48a0c300-8e43-4638-ac7d-21e7b7f71923 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:39.997881 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-48a0c300-8e43-4638-ac7d-21e7b7f71923 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:40.007348 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-48a0c300-8e43-4638-ac7d-21e7b7f71923 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8" status: 200 len: 1605 microversion: 2.25 time: 0.472523 Oct 04 18:32:40.009239 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 628/1211] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:32:39 2022] GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8 => generated 1605 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:32:40.032493 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-29d7572d-8568-49fd-87b3-16af82a76667 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '.version_select at 0x7fe2594168b0>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:40.135034 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-29d7572d-8568-49fd-87b3-16af82a76667 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/images/cabaf7e6-9081-4a33-8415-4c717517ad62" status: 200 len: 1414 microversion: 2.1 time: 0.121410 Oct 04 18:32:40.135726 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 629/1212] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:32:40 2022] GET /compute/v2.1/images/cabaf7e6-9081-4a33-8415-4c717517ad62 => generated 1414 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:40.145760 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2e75d10a-8edc-4d0d-916e-03d2014bba85 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:40.146311 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2e75d10a-8edc-4d0d-916e-03d2014bba85 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: 890f8168-5b22-465a-894d-ca70dd1acbed] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:40.178029 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e75d10a-8edc-4d0d-916e-03d2014bba85 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:40.180698 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e75d10a-8edc-4d0d-916e-03d2014bba85 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:40.184250 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e75d10a-8edc-4d0d-916e-03d2014bba85 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:40.186716 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e75d10a-8edc-4d0d-916e-03d2014bba85 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:40.190981 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e75d10a-8edc-4d0d-916e-03d2014bba85 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:40.192597 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e75d10a-8edc-4d0d-916e-03d2014bba85 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:40.196684 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-917e058a-b418-48cf-a665-bd63913d82b7 tempest-SecurityGroupRulesTestJSON-1957837475 tempest-SecurityGroupRulesTestJSON-1957837475-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 1.060754 Oct 04 18:32:40.201239 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 584/1213] 10.222.0.20 () {60 vars in 1180 bytes} [Tue Oct 4 18:32:39 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:40.210619 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3011e65b-bc75-4886-b022-ec990114975d tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:40.211783 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3011e65b-bc75-4886-b022-ec990114975d tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: b219d988-2847-45a0-a3b8-af54cf1a43f8] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:40.227842 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-2e75d10a-8edc-4d0d-916e-03d2014bba85 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] HTTP exception thrown: Instance 890f8168-5b22-465a-894d-ca70dd1acbed could not be found. Oct 04 18:32:40.230091 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2e75d10a-8edc-4d0d-916e-03d2014bba85 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Request method failure captured: Oct 04 18:32:40.230091 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/890f8168-5b22-465a-894d-ca70dd1acbed HTTP/1.1 Oct 04 18:32:40.230091 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:32:40.230091 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:32:40.230091 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:32:40.230091 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:32:40.230091 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:32:40.230091 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:32:40.230091 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:32:40.230091 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:40.230091 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPHtcc3zsjcMKz8cEwRtflxvigEPx-In4JkTl328nJANVUfFz1p2OVDGilrcjY4qMu5vRjW2zvRxzHEswqbzFh2OoPWoz6R7t8Yv16v_mW4D1rWIFDhOB0dmfh2ZT-5VCy_oS_TIFc0c8n-LcarwX378VPTu7Id5dulS6vFtb7m4i7ZQ Oct 04 18:32:40.230091 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:32:40.230091 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:32:40.230091 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:32:40.230091 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:32:40.230091 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:32:40.230091 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:32:40.230091 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 771211a4ce424aa48920ff102c894a9f Oct 04 18:32:40.230091 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServersOnMultiNodesTest-1893046075 Oct 04 18:32:40.230091 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:32:40.230091 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:32:40.230091 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/771211a4ce424aa48920ff102c894a9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_771211a4ce424aa48920ff102c894a9f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/771211a4ce424aa48920ff102c894a9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/771211a4ce424aa48920ff102c894a9f"}]}] Oct 04 18:32:40.230091 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServersOnMultiNodesTest-1893046075 Oct 04 18:32:40.230091 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 771211a4ce424aa48920ff102c894a9f Oct 04 18:32:40.230091 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1893046075 Oct 04 18:32:40.230091 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServersOnMultiNodesTest-1893046075-project Oct 04 18:32:40.230091 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:32:40.230091 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:32:40.230091 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 07dd131fa3c44d439d0f3ec6e4b8ad42 Oct 04 18:32:40.230091 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServersOnMultiNodesTest-1893046075-project Oct 04 18:32:40.230091 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:32:40.230091 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 890f8168-5b22-465a-894d-ca70dd1acbed could not be found. Oct 04 18:32:40.230091 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '890f8168-5b22-465a-894d-ca70dd1acbed'} Oct 04 18:32:40.230091 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:40.230091 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:40.230091 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:32:40.230091 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:32:40.230091 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:32:40.230091 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:32:40.230091 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:32:40.230091 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:32:40.230091 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:32:40.230091 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:32:40.230091 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 890f8168-5b22-465a-894d-ca70dd1acbed could not be found. Oct 04 18:32:40.230091 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:40.230091 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:40.230091 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:40.230091 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:40.230091 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:40.230091 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:40.230091 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:40.230091 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:40.230091 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:40.230091 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:40.230091 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:32:40.230091 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:32:40.230091 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:32:40.230091 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:32:40.230091 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:32:40.230091 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:32:40.230091 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 890f8168-5b22-465a-894d-ca70dd1acbed could not be found. Oct 04 18:32:40.230091 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:40.230091 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:40.230091 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:40.236863 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:40.236863 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:40.236863 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:40.236863 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:32:40.236863 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:32:40.236863 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 890f8168-5b22-465a-894d-ca70dd1acbed could not be found. Oct 04 18:32:40.236863 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:40.237780 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3011e65b-bc75-4886-b022-ec990114975d tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:40.237780 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3011e65b-bc75-4886-b022-ec990114975d tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:40.237780 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3011e65b-bc75-4886-b022-ec990114975d tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:40.237780 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3011e65b-bc75-4886-b022-ec990114975d tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:40.239984 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2e75d10a-8edc-4d0d-916e-03d2014bba85 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Returning 404 to user: Instance 890f8168-5b22-465a-894d-ca70dd1acbed could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:40.240366 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3011e65b-bc75-4886-b022-ec990114975d tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:40.240845 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3011e65b-bc75-4886-b022-ec990114975d tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:40.241872 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2e75d10a-8edc-4d0d-916e-03d2014bba85 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/890f8168-5b22-465a-894d-ca70dd1acbed" status: 404 len: 111 microversion: 2.1 time: 0.105201 Oct 04 18:32:40.242986 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 630/1214] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:40 2022] GET /compute/v2.1/servers/890f8168-5b22-465a-894d-ca70dd1acbed => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:32:40.248338 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9b0b0181-3300-4807-87f4-bb0732442b4a tempest-SecurityGroupRulesTestJSON-1957837475 tempest-SecurityGroupRulesTestJSON-1957837475-project] Action: 'create', calling method: .version_select at 0x7fe259555a60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1805010389", "description": "tempest-description-1930350991"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:40.249739 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=100 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:40.397061 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3011e65b-bc75-4886-b022-ec990114975d tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8/os-interface" status: 200 len: 285 microversion: 2.25 time: 0.193395 Oct 04 18:32:40.398277 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 585/1215] 10.222.0.20 () {60 vars in 1316 bytes} [Tue Oct 4 18:32:40 2022] GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8/os-interface => generated 285 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:32:40.403046 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2de777b7-7dd2-41a5-b36e-40b5c864bf17 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:40.404584 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2de777b7-7dd2-41a5-b36e-40b5c864bf17 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: cb82f77b-6207-4a99-a494-f252a820990c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:40.422975 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2de777b7-7dd2-41a5-b36e-40b5c864bf17 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:40.423597 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2de777b7-7dd2-41a5-b36e-40b5c864bf17 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:40.424331 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2de777b7-7dd2-41a5-b36e-40b5c864bf17 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:40.425338 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2de777b7-7dd2-41a5-b36e-40b5c864bf17 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:40.429113 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2de777b7-7dd2-41a5-b36e-40b5c864bf17 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:40.429661 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2de777b7-7dd2-41a5-b36e-40b5c864bf17 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:40.475230 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-2de777b7-7dd2-41a5-b36e-40b5c864bf17 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] HTTP exception thrown: Instance cb82f77b-6207-4a99-a494-f252a820990c could not be found. Oct 04 18:32:40.484374 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2de777b7-7dd2-41a5-b36e-40b5c864bf17 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Request method failure captured: Oct 04 18:32:40.484374 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/cb82f77b-6207-4a99-a494-f252a820990c HTTP/1.1 Oct 04 18:32:40.484374 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:32:40.484374 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:32:40.484374 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:32:40.484374 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:32:40.484374 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:32:40.484374 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:32:40.484374 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:32:40.484374 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:40.484374 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPHtcc3zsjcMKz8cEwRtflxvigEPx-In4JkTl328nJANVUfFz1p2OVDGilrcjY4qMu5vRjW2zvRxzHEswqbzFh2OoPWoz6R7t8Yv16v_mW4D1rWIFDhOB0dmfh2ZT-5VCy_oS_TIFc0c8n-LcarwX378VPTu7Id5dulS6vFtb7m4i7ZQ Oct 04 18:32:40.484374 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:32:40.484374 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:32:40.484374 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:32:40.484374 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:32:40.484374 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:32:40.484374 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:32:40.484374 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 771211a4ce424aa48920ff102c894a9f Oct 04 18:32:40.484374 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ServersOnMultiNodesTest-1893046075 Oct 04 18:32:40.484374 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:32:40.484374 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:32:40.484374 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/771211a4ce424aa48920ff102c894a9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_771211a4ce424aa48920ff102c894a9f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/771211a4ce424aa48920ff102c894a9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/771211a4ce424aa48920ff102c894a9f"}]}] Oct 04 18:32:40.484374 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ServersOnMultiNodesTest-1893046075 Oct 04 18:32:40.484374 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 771211a4ce424aa48920ff102c894a9f Oct 04 18:32:40.484374 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1893046075 Oct 04 18:32:40.484374 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ServersOnMultiNodesTest-1893046075-project Oct 04 18:32:40.484374 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:32:40.484374 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:32:40.484374 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 07dd131fa3c44d439d0f3ec6e4b8ad42 Oct 04 18:32:40.484374 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ServersOnMultiNodesTest-1893046075-project Oct 04 18:32:40.484374 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:32:40.484374 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance cb82f77b-6207-4a99-a494-f252a820990c could not be found. Oct 04 18:32:40.484374 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': 'cb82f77b-6207-4a99-a494-f252a820990c'} Oct 04 18:32:40.484374 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:40.484374 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:40.484374 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:32:40.484374 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:32:40.484374 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:32:40.484374 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:32:40.484374 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:32:40.484374 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:32:40.484374 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:32:40.484374 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:32:40.484374 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb82f77b-6207-4a99-a494-f252a820990c could not be found. Oct 04 18:32:40.484374 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:32:40.484374 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:40.484374 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:32:40.484374 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:40.484374 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:40.484374 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:40.484374 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:40.484374 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:40.484374 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:40.484374 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:40.484374 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:32:40.484374 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:32:40.484374 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:32:40.484374 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:32:40.484374 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:32:40.484374 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:32:40.484374 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb82f77b-6207-4a99-a494-f252a820990c could not be found. Oct 04 18:32:40.484374 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:32:40.484374 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:40.484374 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:32:40.488560 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:40.488560 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:40.488560 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:40.488560 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:32:40.488560 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:32:40.488560 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb82f77b-6207-4a99-a494-f252a820990c could not be found. Oct 04 18:32:40.488560 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:32:40.492453 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2de777b7-7dd2-41a5-b36e-40b5c864bf17 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Returning 404 to user: Instance cb82f77b-6207-4a99-a494-f252a820990c could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:40.493886 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2de777b7-7dd2-41a5-b36e-40b5c864bf17 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/cb82f77b-6207-4a99-a494-f252a820990c" status: 404 len: 111 microversion: 2.1 time: 0.094159 Oct 04 18:32:40.495010 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 586/1216] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:40 2022] GET /compute/v2.1/servers/cb82f77b-6207-4a99-a494-f252a820990c => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:32:40.502599 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a1a71c17-6b5d-48b7-acdf-0b311d01f76c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:40.630009 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a1a71c17-6b5d-48b7-acdf-0b311d01f76c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/75d1ac2f-d5be-4270-81b8-f7db691eccfb" status: 204 len: 0 microversion: 2.1 time: 0.130166 Oct 04 18:32:40.631002 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 587/1217] 10.222.0.20 () {58 vars in 1266 bytes} [Tue Oct 4 18:32:40 2022] DELETE /compute/v2.1/os-server-groups/75d1ac2f-d5be-4270-81b8-f7db691eccfb => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:32:40.639997 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5bc63655-d474-4667-ad0b-9ed8582c6d9c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:40.641052 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5bc63655-d474-4667-ad0b-9ed8582c6d9c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: 2e85db28-c393-4e02-8f28-bf0d217b6db7] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:40.659801 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5bc63655-d474-4667-ad0b-9ed8582c6d9c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:40.662627 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5bc63655-d474-4667-ad0b-9ed8582c6d9c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:40.665175 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5bc63655-d474-4667-ad0b-9ed8582c6d9c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:40.666627 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5bc63655-d474-4667-ad0b-9ed8582c6d9c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:40.669739 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5bc63655-d474-4667-ad0b-9ed8582c6d9c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:40.670720 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5bc63655-d474-4667-ad0b-9ed8582c6d9c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:40.758166 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5bc63655-d474-4667-ad0b-9ed8582c6d9c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: 2e85db28-c393-4e02-8f28-bf0d217b6db7] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:32:41.149652 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5bc63655-d474-4667-ad0b-9ed8582c6d9c tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2e85db28-c393-4e02-8f28-bf0d217b6db7" status: 204 len: 0 microversion: 2.1 time: 0.513715 Oct 04 18:32:41.151326 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 588/1218] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:32:40 2022] DELETE /compute/v2.1/servers/2e85db28-c393-4e02-8f28-bf0d217b6db7 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:32:41.159188 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4cf0cbd6-26bf-487d-ba7b-593767dbddd6 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '.version_select at 0x7fe2590a8790>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:41.274080 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-4cf0cbd6-26bf-487d-ba7b-593767dbddd6 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/images/cabaf7e6-9081-4a33-8415-4c717517ad62" status: 200 len: 1414 microversion: 2.1 time: 0.120301 Oct 04 18:32:41.286669 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 589/1219] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:32:41 2022] GET /compute/v2.1/images/cabaf7e6-9081-4a33-8415-4c717517ad62 => generated 1414 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:41.296578 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ad568878-27af-4538-9151-fc90b51009b1 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:41.301593 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ad568878-27af-4538-9151-fc90b51009b1 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: 2e85db28-c393-4e02-8f28-bf0d217b6db7] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:41.324551 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ad568878-27af-4538-9151-fc90b51009b1 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:41.325165 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ad568878-27af-4538-9151-fc90b51009b1 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:41.325701 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ad568878-27af-4538-9151-fc90b51009b1 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:41.326435 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ad568878-27af-4538-9151-fc90b51009b1 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:41.331158 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ad568878-27af-4538-9151-fc90b51009b1 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:41.335138 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ad568878-27af-4538-9151-fc90b51009b1 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:41.783340 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ad568878-27af-4538-9151-fc90b51009b1 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:41.801525 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ad568878-27af-4538-9151-fc90b51009b1 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/2e85db28-c393-4e02-8f28-bf0d217b6db7" status: 200 len: 1473 microversion: 2.1 time: 0.519909 Oct 04 18:32:41.818192 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9b0b0181-3300-4807-87f4-bb0732442b4a tempest-SecurityGroupRulesTestJSON-1957837475 tempest-SecurityGroupRulesTestJSON-1957837475-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 1.565314 Oct 04 18:32:41.818192 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 631/1220] 10.222.0.20 () {60 vars in 1180 bytes} [Tue Oct 4 18:32:40 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 1568 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:41.831991 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 590/1221] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:41 2022] GET /compute/v2.1/servers/2e85db28-c393-4e02-8f28-bf0d217b6db7 => generated 1473 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:41.835210 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f8d0d5ee-2381-432c-9ca6-0ce19178d564 tempest-SecurityGroupRulesTestJSON-1957837475 tempest-SecurityGroupRulesTestJSON-1957837475-project] Action: 'create', calling method: .version_select at 0x7fe25d36d4c0>, body: {"security_group_rule": {"parent_group_id": "1c6a91f5-edd6-41c6-9cdd-6933cd94a57f", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "41194d91-6991-4abd-bae7-5bb2bd4ced3e"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:42.296405 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e14f4f12-595a-4697-8833-a28dd851456e tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '.version_select at 0x7fe259102790>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:42.359527 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e14f4f12-595a-4697-8833-a28dd851456e tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/images/cabaf7e6-9081-4a33-8415-4c717517ad62" status: 200 len: 1414 microversion: 2.1 time: 0.068189 Oct 04 18:32:42.378124 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 591/1222] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:32:42 2022] GET /compute/v2.1/images/cabaf7e6-9081-4a33-8415-4c717517ad62 => generated 1414 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:42.515787 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-c9281c16-e48f-4799-ae3a-777de7d30c09 req-68fb50b8-1b63-4133-85d5-ee30717aa21f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b219d988-2847-45a0-a3b8-af54cf1a43f8", "tag": "581c676f-096d-4159-ae53-d455ac141b32"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:42.540326 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-c9281c16-e48f-4799-ae3a-777de7d30c09 req-68fb50b8-1b63-4133-85d5-ee30717aa21f service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:42.540866 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-c9281c16-e48f-4799-ae3a-777de7d30c09 req-68fb50b8-1b63-4133-85d5-ee30717aa21f service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:42.553935 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-c9281c16-e48f-4799-ae3a-777de7d30c09 req-68fb50b8-1b63-4133-85d5-ee30717aa21f service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:42.572866 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-c9281c16-e48f-4799-ae3a-777de7d30c09 req-68fb50b8-1b63-4133-85d5-ee30717aa21f service nova] Creating event network-changed:581c676f-096d-4159-ae53-d455ac141b32 for instance b219d988-2847-45a0-a3b8-af54cf1a43f8 on n-h1-850501-14 Oct 04 18:32:42.590752 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-c9281c16-e48f-4799-ae3a-777de7d30c09 req-68fb50b8-1b63-4133-85d5-ee30717aa21f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078362 Oct 04 18:32:42.598410 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 592/1223] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:32:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:32:42.833494 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7af64cd6-c566-4851-816d-bb78be29d755 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:42.834765 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7af64cd6-c566-4851-816d-bb78be29d755 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: 2e85db28-c393-4e02-8f28-bf0d217b6db7] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:42.844437 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7af64cd6-c566-4851-816d-bb78be29d755 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:42.845142 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7af64cd6-c566-4851-816d-bb78be29d755 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:42.845846 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7af64cd6-c566-4851-816d-bb78be29d755 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:42.846733 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7af64cd6-c566-4851-816d-bb78be29d755 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:42.847205 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7af64cd6-c566-4851-816d-bb78be29d755 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:42.847642 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7af64cd6-c566-4851-816d-bb78be29d755 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:42.906717 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f8d0d5ee-2381-432c-9ca6-0ce19178d564 tempest-SecurityGroupRulesTestJSON-1957837475 tempest-SecurityGroupRulesTestJSON-1957837475-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 1.083746 Oct 04 18:32:42.919235 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 632/1224] 10.222.0.20 () {60 vars in 1195 bytes} [Tue Oct 4 18:32:41 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:42.926137 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8cfb471a-7add-4a34-bb39-f522c735f040 tempest-SecurityGroupRulesTestJSON-1957837475 tempest-SecurityGroupRulesTestJSON-1957837475-project] Calling method '.version_select at 0x7fe25d3498b0>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:43.268262 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7af64cd6-c566-4851-816d-bb78be29d755 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:43.283483 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7af64cd6-c566-4851-816d-bb78be29d755 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/2e85db28-c393-4e02-8f28-bf0d217b6db7" status: 200 len: 1473 microversion: 2.1 time: 0.454059 Oct 04 18:32:43.284106 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 593/1225] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:42 2022] GET /compute/v2.1/servers/2e85db28-c393-4e02-8f28-bf0d217b6db7 => generated 1473 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:43.400603 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-48dab7aa-0d55-4abc-9bef-4be0055ac3d8 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '.version_select at 0x7fe2590fe3a0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:43.505617 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-48dab7aa-0d55-4abc-9bef-4be0055ac3d8 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/images/cabaf7e6-9081-4a33-8415-4c717517ad62" status: 200 len: 1414 microversion: 2.1 time: 0.114630 Oct 04 18:32:43.509178 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 594/1226] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:32:43 2022] GET /compute/v2.1/images/cabaf7e6-9081-4a33-8415-4c717517ad62 => generated 1414 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:32:43.665517 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8cfb471a-7add-4a34-bb39-f522c735f040 tempest-SecurityGroupRulesTestJSON-1957837475 tempest-SecurityGroupRulesTestJSON-1957837475-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/41194d91-6991-4abd-bae7-5bb2bd4ced3e" status: 202 len: 0 microversion: 2.1 time: 0.744660 Oct 04 18:32:43.666600 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 633/1227] 10.222.0.20 () {58 vars in 1272 bytes} [Tue Oct 4 18:32:42 2022] DELETE /compute/v2.1/os-security-groups/41194d91-6991-4abd-bae7-5bb2bd4ced3e => generated 0 bytes in 746 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:32:43.676766 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4d4e8dc7-97a0-4301-b9fe-1f38c0e01b23 tempest-SecurityGroupRulesTestJSON-1957837475 tempest-SecurityGroupRulesTestJSON-1957837475-project] Calling method '.version_select at 0x7fe2590645e0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:43.769310 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-4d4e8dc7-97a0-4301-b9fe-1f38c0e01b23 tempest-SecurityGroupRulesTestJSON-1957837475 tempest-SecurityGroupRulesTestJSON-1957837475-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups/1c6a91f5-edd6-41c6-9cdd-6933cd94a57f" status: 200 len: 246 microversion: 2.1 time: 0.097881 Oct 04 18:32:43.770093 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 595/1228] 10.222.0.20 () {58 vars in 1269 bytes} [Tue Oct 4 18:32:43 2022] GET /compute/v2.1/os-security-groups/1c6a91f5-edd6-41c6-9cdd-6933cd94a57f => generated 246 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:43.792369 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5af01e6e-c035-4639-93e6-9794e6e613c2 tempest-SecurityGroupRulesTestJSON-1957837475 tempest-SecurityGroupRulesTestJSON-1957837475-project] Action: 'create', calling method: .version_select at 0x7fe25d3495e0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1094964455", "description": "tempest-description-176780850"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:44.289469 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5af01e6e-c035-4639-93e6-9794e6e613c2 tempest-SecurityGroupRulesTestJSON-1957837475 tempest-SecurityGroupRulesTestJSON-1957837475-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.504583 Oct 04 18:32:44.300566 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 634/1229] 10.222.0.20 () {60 vars in 1180 bytes} [Tue Oct 4 18:32:43 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:44.305919 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6def1be5-cce1-4512-835a-5702bca397bc tempest-SecurityGroupRulesTestJSON-1957837475 tempest-SecurityGroupRulesTestJSON-1957837475-project] Action: 'create', calling method: .version_select at 0x7fe2590da820>, body: {"security_group_rule": {"parent_group_id": "99400ef7-fb25-42c5-a827-48503328bd20", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:44.325918 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3f66b498-44e8-4494-bf2a-e3a0c39187c4 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:44.328087 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3f66b498-44e8-4494-bf2a-e3a0c39187c4 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: 2e85db28-c393-4e02-8f28-bf0d217b6db7] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:44.353646 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f66b498-44e8-4494-bf2a-e3a0c39187c4 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:44.354179 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f66b498-44e8-4494-bf2a-e3a0c39187c4 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:44.354626 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f66b498-44e8-4494-bf2a-e3a0c39187c4 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:44.361915 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f66b498-44e8-4494-bf2a-e3a0c39187c4 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:44.363610 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f66b498-44e8-4494-bf2a-e3a0c39187c4 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:44.364084 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f66b498-44e8-4494-bf2a-e3a0c39187c4 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:44.499038 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3f66b498-44e8-4494-bf2a-e3a0c39187c4 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:44.508161 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3f66b498-44e8-4494-bf2a-e3a0c39187c4 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/2e85db28-c393-4e02-8f28-bf0d217b6db7" status: 200 len: 1431 microversion: 2.1 time: 0.200311 Oct 04 18:32:44.509004 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 635/1230] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:44 2022] GET /compute/v2.1/servers/2e85db28-c393-4e02-8f28-bf0d217b6db7 => generated 1431 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:44.535351 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6956eb53-e1a9-422d-af0c-3d2c2ef53372 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '.version_select at 0x7fe25d349160>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:44.599198 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6956eb53-e1a9-422d-af0c-3d2c2ef53372 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/images/cabaf7e6-9081-4a33-8415-4c717517ad62" status: 200 len: 1414 microversion: 2.1 time: 0.069686 Oct 04 18:32:44.601440 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 636/1231] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:32:44 2022] GET /compute/v2.1/images/cabaf7e6-9081-4a33-8415-4c717517ad62 => generated 1414 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:44.817654 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-70a9b76c-1b02-49c1-9c3f-55f42a913fc6 req-47b1fa8d-1690-4ddd-a4d7-e298d15b5cc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e85db28-c393-4e02-8f28-bf0d217b6db7", "name": "network-vif-deleted", "tag": "a7a62b4e-0cc7-42b1-976e-0559dd4fcf07"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:44.848831 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-70a9b76c-1b02-49c1-9c3f-55f42a913fc6 req-47b1fa8d-1690-4ddd-a4d7-e298d15b5cc1 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:44.849504 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-70a9b76c-1b02-49c1-9c3f-55f42a913fc6 req-47b1fa8d-1690-4ddd-a4d7-e298d15b5cc1 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:44.849966 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-70a9b76c-1b02-49c1-9c3f-55f42a913fc6 req-47b1fa8d-1690-4ddd-a4d7-e298d15b5cc1 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:44.919935 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-70a9b76c-1b02-49c1-9c3f-55f42a913fc6 req-47b1fa8d-1690-4ddd-a4d7-e298d15b5cc1 service nova] Creating event network-vif-deleted:a7a62b4e-0cc7-42b1-976e-0559dd4fcf07 for instance 2e85db28-c393-4e02-8f28-bf0d217b6db7 on n-h1-850501-14 Oct 04 18:32:44.950000 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-70a9b76c-1b02-49c1-9c3f-55f42a913fc6 req-47b1fa8d-1690-4ddd-a4d7-e298d15b5cc1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137086 Oct 04 18:32:44.955792 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 637/1232] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:32:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:44.981802 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8af30636-c1af-47f5-8060-ee6732f04f0d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-2109163975", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": [{"uuid": "c77a0479-286d-44e4-a122-b4b514a72dc4"}], "security_groups": [{"name": "tempest-securitygroup--706278072"}], "key_name": "tempest-keypair-1788764597", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:45.354952 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-8af30636-c1af-47f5-8060-ee6732f04f0d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] validate_networks() for [('c77a0479-286d-44e4-a122-b4b514a72dc4', None, None, None, None, None)] {{(pid=123002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:32:45.738581 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=4 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:45.773274 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6def1be5-cce1-4512-835a-5702bca397bc tempest-SecurityGroupRulesTestJSON-1957837475 tempest-SecurityGroupRulesTestJSON-1957837475-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.472474 Oct 04 18:32:45.774070 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 596/1233] 10.222.0.20 () {60 vars in 1195 bytes} [Tue Oct 4 18:32:44 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1474 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:45.779350 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-65750875-240c-4715-8a4c-962514c9ef7f tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:45.789805 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-65750875-240c-4715-8a4c-962514c9ef7f tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: 2e85db28-c393-4e02-8f28-bf0d217b6db7] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:45.789805 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-65750875-240c-4715-8a4c-962514c9ef7f tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:45.789805 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-65750875-240c-4715-8a4c-962514c9ef7f tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:45.789805 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-65750875-240c-4715-8a4c-962514c9ef7f tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:45.790701 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-65750875-240c-4715-8a4c-962514c9ef7f tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:45.791169 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-65750875-240c-4715-8a4c-962514c9ef7f tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:45.791722 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-65750875-240c-4715-8a4c-962514c9ef7f tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:45.851922 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-8af30636-c1af-47f5-8060-ee6732f04f0d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:32:45.856656 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-8af30636-c1af-47f5-8060-ee6732f04f0d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:32:45.857372 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-8af30636-c1af-47f5-8060-ee6732f04f0d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:32:45.857786 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-8af30636-c1af-47f5-8060-ee6732f04f0d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:32:45.858197 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-8af30636-c1af-47f5-8060-ee6732f04f0d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:32:45.901248 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-65750875-240c-4715-8a4c-962514c9ef7f tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:45.903234 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8af30636-c1af-47f5-8060-ee6732f04f0d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:45.906867 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8af30636-c1af-47f5-8060-ee6732f04f0d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:45.907584 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8af30636-c1af-47f5-8060-ee6732f04f0d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:45.909756 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8af30636-c1af-47f5-8060-ee6732f04f0d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:45.910337 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8af30636-c1af-47f5-8060-ee6732f04f0d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:45.910874 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8af30636-c1af-47f5-8060-ee6732f04f0d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:45.912686 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-65750875-240c-4715-8a4c-962514c9ef7f tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/2e85db28-c393-4e02-8f28-bf0d217b6db7" status: 200 len: 1302 microversion: 2.1 time: 0.137361 Oct 04 18:32:45.914158 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 597/1234] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:45 2022] GET /compute/v2.1/servers/2e85db28-c393-4e02-8f28-bf0d217b6db7 => generated 1302 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:45.925950 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a7ecba40-8d75-4fda-8236-8cd3f7811d0e tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '.version_select at 0x7fe2590a84c0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:45.951065 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-8af30636-c1af-47f5-8060-ee6732f04f0d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Getting quotas for project dde62f171d474b038f1af39899518211. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:32:45.961664 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-8af30636-c1af-47f5-8060-ee6732f04f0d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Getting quotas for user c80f2b2dbf824a1d879f5b7edb343f26 and project dde62f171d474b038f1af39899518211. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:32:45.998964 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8af30636-c1af-47f5-8060-ee6732f04f0d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Going to run 1 instances... {{(pid=123002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:32:46.008314 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a7ecba40-8d75-4fda-8236-8cd3f7811d0e tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/images/cabaf7e6-9081-4a33-8415-4c717517ad62" status: 200 len: 1414 microversion: 2.1 time: 0.092852 Oct 04 18:32:46.008895 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 598/1235] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:32:45 2022] GET /compute/v2.1/images/cabaf7e6-9081-4a33-8415-4c717517ad62 => generated 1414 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:46.009150 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8af30636-c1af-47f5-8060-ee6732f04f0d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 158e9f52-fd16-48d1-87b5-e0dd523e97a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:32:46.014065 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c464cf5c-9472-4b73-af73-17ba189597fb tempest-SecurityGroupRulesTestJSON-1957837475 tempest-SecurityGroupRulesTestJSON-1957837475-project] Action: 'create', calling method: .version_select at 0x7fe2590fe700>, body: {"security_group_rule": {"parent_group_id": "99400ef7-fb25-42c5-a827-48503328bd20", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:46.187783 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8af30636-c1af-47f5-8060-ee6732f04f0d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.228551 Oct 04 18:32:46.188691 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 638/1236] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:32:44 2022] POST /compute/v2.1/servers => generated 405 bytes in 1232 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:32:46.201364 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-76c33bbb-dbc7-4464-831b-8e59dcdc9fc4 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:46.207627 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-76c33bbb-dbc7-4464-831b-8e59dcdc9fc4 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 158e9f52-fd16-48d1-87b5-e0dd523e97a4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:46.808443 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-76c33bbb-dbc7-4464-831b-8e59dcdc9fc4 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:46.822398 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-76c33bbb-dbc7-4464-831b-8e59dcdc9fc4 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4" status: 200 len: 1235 microversion: 2.1 time: 0.625232 Oct 04 18:32:46.823204 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 639/1237] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:46 2022] GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4 => generated 1235 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:32:46.940707 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6b6818cc-10df-4958-890a-47b321577c1f tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:46.943773 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-6b6818cc-10df-4958-890a-47b321577c1f tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: 2e85db28-c393-4e02-8f28-bf0d217b6db7] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:46.956015 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6b6818cc-10df-4958-890a-47b321577c1f tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:46.957485 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6b6818cc-10df-4958-890a-47b321577c1f tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:46.958233 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6b6818cc-10df-4958-890a-47b321577c1f tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:46.959577 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6b6818cc-10df-4958-890a-47b321577c1f tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:46.960247 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6b6818cc-10df-4958-890a-47b321577c1f tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:46.960905 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6b6818cc-10df-4958-890a-47b321577c1f tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:47.014000 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6b6818cc-10df-4958-890a-47b321577c1f tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:47.014545 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6b6818cc-10df-4958-890a-47b321577c1f tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:47.015022 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6b6818cc-10df-4958-890a-47b321577c1f tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:47.015509 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-6b6818cc-10df-4958-890a-47b321577c1f tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lazy-loading 'fault' on Instance uuid 2e85db28-c393-4e02-8f28-bf0d217b6db7 {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:32:47.068619 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-6b6818cc-10df-4958-890a-47b321577c1f tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd131fa3c44d439d0f3ec6e4b8ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771211a4ce424aa48920ff102c894a9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:47.076011 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6b6818cc-10df-4958-890a-47b321577c1f tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/2e85db28-c393-4e02-8f28-bf0d217b6db7" status: 200 len: 1307 microversion: 2.1 time: 0.141022 Oct 04 18:32:47.076636 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 640/1238] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:46 2022] GET /compute/v2.1/servers/2e85db28-c393-4e02-8f28-bf0d217b6db7 => generated 1307 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:32:47.081680 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-753fbb5f-7656-4e32-ba1c-0e8047329efa tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '.version_select at 0x7fe2594169d0>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:47.137438 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-753fbb5f-7656-4e32-ba1c-0e8047329efa tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/images/cabaf7e6-9081-4a33-8415-4c717517ad62" status: 200 len: 1414 microversion: 2.1 time: 0.059684 Oct 04 18:32:47.138330 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 641/1239] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:32:47 2022] GET /compute/v2.1/images/cabaf7e6-9081-4a33-8415-4c717517ad62 => generated 1414 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:47.340046 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c464cf5c-9472-4b73-af73-17ba189597fb tempest-SecurityGroupRulesTestJSON-1957837475 tempest-SecurityGroupRulesTestJSON-1957837475-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 1.329507 Oct 04 18:32:47.340839 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 599/1240] 10.222.0.20 () {60 vars in 1195 bytes} [Tue Oct 4 18:32:46 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:47.357597 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-16077ba2-d61a-40b9-99f4-8903e41005db tempest-SecurityGroupRulesTestJSON-1957837475 tempest-SecurityGroupRulesTestJSON-1957837475-project] Calling method '.version_select at 0x7fe259277280>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:47.471445 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-16077ba2-d61a-40b9-99f4-8903e41005db tempest-SecurityGroupRulesTestJSON-1957837475 tempest-SecurityGroupRulesTestJSON-1957837475-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups/99400ef7-fb25-42c5-a827-48503328bd20" status: 200 len: 664 microversion: 2.1 time: 0.116416 Oct 04 18:32:47.471445 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 642/1241] 10.222.0.20 () {58 vars in 1269 bytes} [Tue Oct 4 18:32:47 2022] GET /compute/v2.1/os-security-groups/99400ef7-fb25-42c5-a827-48503328bd20 => generated 664 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:47.484747 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7ac18ace-3f55-4a2f-8236-233fbde18191 tempest-SecurityGroupRulesTestJSON-1957837475 tempest-SecurityGroupRulesTestJSON-1957837475-project] Calling method '.version_select at 0x7fe259091ca0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:47.774373 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7ac18ace-3f55-4a2f-8236-233fbde18191 tempest-SecurityGroupRulesTestJSON-1957837475 tempest-SecurityGroupRulesTestJSON-1957837475-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-group-rules/97e5f0c8-aeba-45a9-ae9b-2316a4c8e92c" status: 202 len: 0 microversion: 2.1 time: 0.293483 Oct 04 18:32:47.776575 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 600/1242] 10.222.0.20 () {58 vars in 1287 bytes} [Tue Oct 4 18:32:47 2022] DELETE /compute/v2.1/os-security-group-rules/97e5f0c8-aeba-45a9-ae9b-2316a4c8e92c => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:32:47.788294 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2cb2e15d-df41-421d-82d5-27a9de8d9d21 tempest-SecurityGroupRulesTestJSON-1957837475 tempest-SecurityGroupRulesTestJSON-1957837475-project] Calling method '.version_select at 0x7fe259359d30>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:47.845692 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-14f0f389-b06e-4543-807d-f12b59905a43 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:47.847064 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-14f0f389-b06e-4543-807d-f12b59905a43 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 158e9f52-fd16-48d1-87b5-e0dd523e97a4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:47.860339 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-14f0f389-b06e-4543-807d-f12b59905a43 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:47.861114 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-14f0f389-b06e-4543-807d-f12b59905a43 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:47.861725 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-14f0f389-b06e-4543-807d-f12b59905a43 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:47.862726 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-14f0f389-b06e-4543-807d-f12b59905a43 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:47.863362 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-14f0f389-b06e-4543-807d-f12b59905a43 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:47.863791 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-14f0f389-b06e-4543-807d-f12b59905a43 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:48.154413 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2cb2e15d-df41-421d-82d5-27a9de8d9d21 tempest-SecurityGroupRulesTestJSON-1957837475 tempest-SecurityGroupRulesTestJSON-1957837475-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/99400ef7-fb25-42c5-a827-48503328bd20" status: 202 len: 0 microversion: 2.1 time: 0.370372 Oct 04 18:32:48.154413 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 643/1243] 10.222.0.20 () {58 vars in 1272 bytes} [Tue Oct 4 18:32:47 2022] DELETE /compute/v2.1/os-security-groups/99400ef7-fb25-42c5-a827-48503328bd20 => generated 0 bytes in 373 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:32:48.159812 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-87d5c1d3-c42e-499d-b574-c3e6ad73e257 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:48.160391 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-87d5c1d3-c42e-499d-b574-c3e6ad73e257 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] [instance: 2e85db28-c393-4e02-8f28-bf0d217b6db7] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:48.183333 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-87d5c1d3-c42e-499d-b574-c3e6ad73e257 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:48.183836 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-87d5c1d3-c42e-499d-b574-c3e6ad73e257 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:48.194496 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-87d5c1d3-c42e-499d-b574-c3e6ad73e257 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:48.206849 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-87d5c1d3-c42e-499d-b574-c3e6ad73e257 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:48.207655 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-87d5c1d3-c42e-499d-b574-c3e6ad73e257 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:48.208238 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-87d5c1d3-c42e-499d-b574-c3e6ad73e257 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:48.244802 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-87d5c1d3-c42e-499d-b574-c3e6ad73e257 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] HTTP exception thrown: Instance 2e85db28-c393-4e02-8f28-bf0d217b6db7 could not be found. Oct 04 18:32:48.247843 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-87d5c1d3-c42e-499d-b574-c3e6ad73e257 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Request method failure captured: Oct 04 18:32:48.247843 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/2e85db28-c393-4e02-8f28-bf0d217b6db7 HTTP/1.1 Oct 04 18:32:48.247843 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:32:48.247843 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:32:48.247843 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:32:48.247843 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:32:48.247843 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:32:48.247843 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:32:48.247843 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:32:48.247843 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:48.247843 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPHtcc3zsjcMKz8cEwRtflxvigEPx-In4JkTl328nJANVUfFz1p2OVDGilrcjY4qMu5vRjW2zvRxzHEswqbzFh2OoPWoz6R7t8Yv16v_mW4D1rWIFDhOB0dmfh2ZT-5VCy_oS_TIFc0c8n-LcarwX378VPTu7Id5dulS6vFtb7m4i7ZQ Oct 04 18:32:48.247843 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:32:48.247843 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:32:48.247843 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:32:48.247843 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:32:48.247843 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:32:48.247843 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:32:48.247843 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 771211a4ce424aa48920ff102c894a9f Oct 04 18:32:48.247843 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServersOnMultiNodesTest-1893046075 Oct 04 18:32:48.247843 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:32:48.247843 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:32:48.247843 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/771211a4ce424aa48920ff102c894a9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_771211a4ce424aa48920ff102c894a9f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/771211a4ce424aa48920ff102c894a9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/771211a4ce424aa48920ff102c894a9f"}]}] Oct 04 18:32:48.247843 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServersOnMultiNodesTest-1893046075 Oct 04 18:32:48.247843 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 771211a4ce424aa48920ff102c894a9f Oct 04 18:32:48.247843 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1893046075 Oct 04 18:32:48.247843 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServersOnMultiNodesTest-1893046075-project Oct 04 18:32:48.247843 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:32:48.247843 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:32:48.247843 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 07dd131fa3c44d439d0f3ec6e4b8ad42 Oct 04 18:32:48.247843 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServersOnMultiNodesTest-1893046075-project Oct 04 18:32:48.247843 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:32:48.247843 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 2e85db28-c393-4e02-8f28-bf0d217b6db7 could not be found. Oct 04 18:32:48.247843 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '2e85db28-c393-4e02-8f28-bf0d217b6db7'} Oct 04 18:32:48.247843 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:48.247843 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:48.247843 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:32:48.247843 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:32:48.247843 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:32:48.247843 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:32:48.247843 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:32:48.247843 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:32:48.247843 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:32:48.247843 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:32:48.247843 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e85db28-c393-4e02-8f28-bf0d217b6db7 could not be found. Oct 04 18:32:48.247843 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:48.247843 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:48.247843 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:48.247843 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:48.247843 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:48.247843 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:48.247843 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:48.247843 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:48.247843 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:48.247843 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:48.247843 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:32:48.247843 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:32:48.247843 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:32:48.247843 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:32:48.247843 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:32:48.247843 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:32:48.247843 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e85db28-c393-4e02-8f28-bf0d217b6db7 could not be found. Oct 04 18:32:48.247843 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:48.247843 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:48.247843 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:48.257205 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:48.257205 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:48.257205 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:48.257205 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:32:48.257205 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:32:48.257205 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e85db28-c393-4e02-8f28-bf0d217b6db7 could not be found. Oct 04 18:32:48.257205 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:48.257205 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-87d5c1d3-c42e-499d-b574-c3e6ad73e257 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] Returning 404 to user: Instance 2e85db28-c393-4e02-8f28-bf0d217b6db7 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:48.257205 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-87d5c1d3-c42e-499d-b574-c3e6ad73e257 tempest-ServersOnMultiNodesTest-1893046075 tempest-ServersOnMultiNodesTest-1893046075-project] 10.222.0.20 "GET /compute/v2.1/servers/2e85db28-c393-4e02-8f28-bf0d217b6db7" status: 404 len: 111 microversion: 2.1 time: 0.094035 Oct 04 18:32:48.257205 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 644/1244] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:48 2022] GET /compute/v2.1/servers/2e85db28-c393-4e02-8f28-bf0d217b6db7 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:32:48.258657 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-57f3cfd7-9633-4c1c-86a9-3a479cae7aef tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '.version_select at 0x7fe2594164c0>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:48.304662 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-14f0f389-b06e-4543-807d-f12b59905a43 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:48.313922 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-14f0f389-b06e-4543-807d-f12b59905a43 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4" status: 200 len: 1239 microversion: 2.1 time: 0.472112 Oct 04 18:32:48.336232 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 601/1245] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:47 2022] GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4 => generated 1239 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:32:48.342453 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-57f3cfd7-9633-4c1c-86a9-3a479cae7aef tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/images/cabaf7e6-9081-4a33-8415-4c717517ad62" status: 200 len: 1423 microversion: 2.1 time: 0.091426 Oct 04 18:32:48.347389 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-54706f1d-3ddd-4fb1-b054-1d68025cc6da tempest-SecurityGroupRulesTestJSON-1957837475 tempest-SecurityGroupRulesTestJSON-1957837475-project] Calling method '.version_select at 0x7fe2590feee0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:48.352760 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 645/1246] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:32:48 2022] GET /compute/v2.1/images/cabaf7e6-9081-4a33-8415-4c717517ad62 => generated 1423 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:48.373911 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ecf18bf2-1ff0-40d3-875a-6d5611425fea tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '.version_select at 0x7fe259277670>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:48.402026 n-d-850501-14 devstack@n-api.service[123001]: DEBUG neutronclient.v2_0.client [None req-54706f1d-3ddd-4fb1-b054-1d68025cc6da tempest-SecurityGroupRulesTestJSON-1957837475 tempest-SecurityGroupRulesTestJSON-1957837475-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 41194d91-6991-4abd-bae7-5bb2bd4ced3e does not exist", "detail": ""}} {{(pid=123001) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:32:48.402713 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.security_group_api [None req-54706f1d-3ddd-4fb1-b054-1d68025cc6da tempest-SecurityGroupRulesTestJSON-1957837475 tempest-SecurityGroupRulesTestJSON-1957837475-project] Neutron security group 41194d91-6991-4abd-bae7-5bb2bd4ced3e not found {{(pid=123001) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 18:32:48.406255 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-54706f1d-3ddd-4fb1-b054-1d68025cc6da tempest-SecurityGroupRulesTestJSON-1957837475 tempest-SecurityGroupRulesTestJSON-1957837475-project] HTTP exception thrown: Security group 41194d91-6991-4abd-bae7-5bb2bd4ced3e does not exist Oct 04 18:32:48.406255 n-d-850501-14 devstack@n-api.service[123001]: Neutron server returns request_ids: ['req-b2ce919f-cd09-4cb9-ac3d-b2aceed0802a'] Oct 04 18:32:48.408018 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-54706f1d-3ddd-4fb1-b054-1d68025cc6da tempest-SecurityGroupRulesTestJSON-1957837475 tempest-SecurityGroupRulesTestJSON-1957837475-project] Request method failure captured: Oct 04 18:32:48.408018 n-d-850501-14 devstack@n-api.service[123001]: request: DELETE /compute/v2.1/os-security-groups/41194d91-6991-4abd-bae7-5bb2bd4ced3e HTTP/1.1 Oct 04 18:32:48.408018 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:32:48.408018 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:32:48.408018 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:32:48.408018 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:32:48.408018 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:32:48.408018 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:32:48.408018 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:32:48.408018 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:48.408018 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPHw7X3bZR0yTUBt5ilu0ZmxcyxgDoscTHeV02O6rzvvfHtWlCIYVN4aEYw1p1zbh--KLct2APimnRScxNQ2u93xINWNl1EWbLj95P50vai5adJoe6l7ln8zGUflM90IjenYEW4Sjhd6RwiGGGR5vCMsyya8j4ECO65TbIX46JbKl40c Oct 04 18:32:48.408018 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:32:48.408018 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:32:48.408018 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:32:48.408018 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:32:48.408018 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:32:48.408018 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:32:48.408018 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 35d742d10f994ba3885830ca0b1a4c44 Oct 04 18:32:48.408018 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-1957837475 Oct 04 18:32:48.408018 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:32:48.408018 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:32:48.408018 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/35d742d10f994ba3885830ca0b1a4c44"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_35d742d10f994ba3885830ca0b1a4c44", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/35d742d10f994ba3885830ca0b1a4c44"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/35d742d10f994ba3885830ca0b1a4c44"}]}] Oct 04 18:32:48.408018 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-SecurityGroupRulesTestJSON-1957837475 Oct 04 18:32:48.408018 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 35d742d10f994ba3885830ca0b1a4c44 Oct 04 18:32:48.408018 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-1957837475 Oct 04 18:32:48.408018 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-SecurityGroupRulesTestJSON-1957837475-project Oct 04 18:32:48.408018 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:32:48.408018 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:32:48.408018 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 50d2485b4c7843608a89b922b4f5c928 Oct 04 18:32:48.408018 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-SecurityGroupRulesTestJSON-1957837475-project Oct 04 18:32:48.408018 n-d-850501-14 devstack@n-api.service[123001]: method: Oct 04 18:32:48.408018 n-d-850501-14 devstack@n-api.service[123001]: exception: Security group 41194d91-6991-4abd-bae7-5bb2bd4ced3e does not exist Oct 04 18:32:48.408018 n-d-850501-14 devstack@n-api.service[123001]: Neutron server returns request_ids: ['req-b2ce919f-cd09-4cb9-ac3d-b2aceed0802a'] Oct 04 18:32:48.408018 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '41194d91-6991-4abd-bae7-5bb2bd4ced3e'} Oct 04 18:32:48.408018 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:48.408018 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:48.408018 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 18:32:48.408018 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 18:32:48.408018 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:32:48.408018 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:32:48.408018 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 18:32:48.408018 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 18:32:48.408018 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:32:48.408018 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:32:48.408018 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:32:48.408018 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 18:32:48.408018 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:32:48.408018 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:32:48.408018 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:32:48.408018 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:32:48.408018 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:32:48.408018 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:32:48.408018 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:32:48.408018 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:32:48.408018 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:32:48.408018 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:32:48.408018 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:32:48.408018 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:32:48.408018 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:32:48.408018 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:32:48.408018 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 41194d91-6991-4abd-bae7-5bb2bd4ced3e does not exist Oct 04 18:32:48.412312 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b2ce919f-cd09-4cb9-ac3d-b2aceed0802a'] Oct 04 18:32:48.412312 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:32:48.412312 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:48.412312 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:32:48.412312 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:48.412312 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 04 18:32:48.412312 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 18:32:48.412312 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 18:32:48.412312 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 18:32:48.412312 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 41194d91-6991-4abd-bae7-5bb2bd4ced3e does not exist Oct 04 18:32:48.412312 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b2ce919f-cd09-4cb9-ac3d-b2aceed0802a'] Oct 04 18:32:48.412312 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:32:48.412312 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:48.412312 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:32:48.412312 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:48.412312 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:48.412312 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:48.412312 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:48.412312 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:48.412312 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:32:48.412312 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:32:48.412312 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:48.412312 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:48.412312 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 04 18:32:48.412312 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 18:32:48.412312 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 41194d91-6991-4abd-bae7-5bb2bd4ced3e does not exist Oct 04 18:32:48.412312 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b2ce919f-cd09-4cb9-ac3d-b2aceed0802a'] Oct 04 18:32:48.412312 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:32:48.412312 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:48.412312 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:32:48.412312 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:48.412312 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:48.412312 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:48.412312 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:32:48.412312 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:32:48.412312 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 41194d91-6991-4abd-bae7-5bb2bd4ced3e does not exist Oct 04 18:32:48.412312 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b2ce919f-cd09-4cb9-ac3d-b2aceed0802a'] Oct 04 18:32:48.412312 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:32:48.416761 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-54706f1d-3ddd-4fb1-b054-1d68025cc6da tempest-SecurityGroupRulesTestJSON-1957837475 tempest-SecurityGroupRulesTestJSON-1957837475-project] Returning 404 to user: Security group 41194d91-6991-4abd-bae7-5bb2bd4ced3e does not exist Oct 04 18:32:48.416761 n-d-850501-14 devstack@n-api.service[123001]: Neutron server returns request_ids: ['req-b2ce919f-cd09-4cb9-ac3d-b2aceed0802a'] {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:48.417665 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-54706f1d-3ddd-4fb1-b054-1d68025cc6da tempest-SecurityGroupRulesTestJSON-1957837475 tempest-SecurityGroupRulesTestJSON-1957837475-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/41194d91-6991-4abd-bae7-5bb2bd4ced3e" status: 404 len: 194 microversion: 2.1 time: 0.090083 Oct 04 18:32:48.418395 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 602/1247] 10.222.0.20 () {58 vars in 1272 bytes} [Tue Oct 4 18:32:48 2022] DELETE /compute/v2.1/os-security-groups/41194d91-6991-4abd-bae7-5bb2bd4ced3e => generated 194 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:32:48.427767 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4753cd1a-594b-4f5e-9594-d18a35293cc5 tempest-SecurityGroupRulesTestJSON-1957837475 tempest-SecurityGroupRulesTestJSON-1957837475-project] Calling method '.version_select at 0x7fe25911e790>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:48.445206 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ecf18bf2-1ff0-40d3-875a-6d5611425fea tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/images/cabaf7e6-9081-4a33-8415-4c717517ad62" status: 200 len: 1423 microversion: 2.1 time: 0.081557 Oct 04 18:32:48.446374 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 646/1248] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:32:48 2022] GET /compute/v2.1/images/cabaf7e6-9081-4a33-8415-4c717517ad62 => generated 1423 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:48.467008 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e685d2d1-8cd6-4a32-8168-286bb8023d52 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '.version_select at 0x7fe259416a60>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:48.929807 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-4753cd1a-594b-4f5e-9594-d18a35293cc5 tempest-SecurityGroupRulesTestJSON-1957837475 tempest-SecurityGroupRulesTestJSON-1957837475-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/1c6a91f5-edd6-41c6-9cdd-6933cd94a57f" status: 202 len: 0 microversion: 2.1 time: 0.506983 Oct 04 18:32:48.930397 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 603/1249] 10.222.0.20 () {58 vars in 1272 bytes} [Tue Oct 4 18:32:48 2022] DELETE /compute/v2.1/os-security-groups/1c6a91f5-edd6-41c6-9cdd-6933cd94a57f => generated 0 bytes in 508 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:32:48.946232 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b70a59df-5ffa-46f2-bf26-cf200904dae0 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:48.957598 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b70a59df-5ffa-46f2-bf26-cf200904dae0 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ad89f12d146749b38c688b7581e53f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247c7ae3e4e4068a88a044e36945f32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:48.962872 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b70a59df-5ffa-46f2-bf26-cf200904dae0 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Searching by: {'deleted': False, 'project_id': '9247c7ae3e4e4068a88a044e36945f32'} {{(pid=123001) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:32:48.969060 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b70a59df-5ffa-46f2-bf26-cf200904dae0 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:48.969925 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b70a59df-5ffa-46f2-bf26-cf200904dae0 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:48.970538 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b70a59df-5ffa-46f2-bf26-cf200904dae0 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:48.971647 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b70a59df-5ffa-46f2-bf26-cf200904dae0 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:48.972326 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b70a59df-5ffa-46f2-bf26-cf200904dae0 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:48.973120 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b70a59df-5ffa-46f2-bf26-cf200904dae0 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:49.013743 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.multi_cell_list [None req-b70a59df-5ffa-46f2-bf26-cf200904dae0 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123001) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:32:49.065316 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b70a59df-5ffa-46f2-bf26-cf200904dae0 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.129614 Oct 04 18:32:49.065883 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 604/1250] 10.222.0.20 () {58 vars in 1125 bytes} [Tue Oct 4 18:32:48 2022] GET /compute/v2.1/servers => generated 343 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:49.090411 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-12ad5574-099f-40a9-ae2a-404e08912f0e tempest-SecurityGroupRulesTestJSON-1957837475 tempest-SecurityGroupRulesTestJSON-1957837475-project] Calling method '.version_select at 0x7fe25911ef70>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:49.596625 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-12ad5574-099f-40a9-ae2a-404e08912f0e tempest-SecurityGroupRulesTestJSON-1957837475 tempest-SecurityGroupRulesTestJSON-1957837475-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/52560891-0ee5-48e9-af07-52731a75c806" status: 202 len: 0 microversion: 2.1 time: 0.529108 Oct 04 18:32:49.597868 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 605/1251] 10.222.0.20 () {58 vars in 1272 bytes} [Tue Oct 4 18:32:49 2022] DELETE /compute/v2.1/os-security-groups/52560891-0ee5-48e9-af07-52731a75c806 => generated 0 bytes in 531 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:32:49.604823 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7d33ee2f-a6c1-4abe-8377-7063ecc86746 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:49.613774 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7d33ee2f-a6c1-4abe-8377-7063ecc86746 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ad89f12d146749b38c688b7581e53f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247c7ae3e4e4068a88a044e36945f32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:49.617201 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7d33ee2f-a6c1-4abe-8377-7063ecc86746 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Searching by: {'deleted': False, 'project_id': '9247c7ae3e4e4068a88a044e36945f32'} {{(pid=123001) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:32:49.632249 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7d33ee2f-a6c1-4abe-8377-7063ecc86746 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:49.632249 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7d33ee2f-a6c1-4abe-8377-7063ecc86746 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:49.632249 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7d33ee2f-a6c1-4abe-8377-7063ecc86746 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:49.632249 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7d33ee2f-a6c1-4abe-8377-7063ecc86746 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:49.632249 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7d33ee2f-a6c1-4abe-8377-7063ecc86746 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:49.632249 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7d33ee2f-a6c1-4abe-8377-7063ecc86746 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:49.780883 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.multi_cell_list [None req-7d33ee2f-a6c1-4abe-8377-7063ecc86746 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123001) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:32:49.853062 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7d33ee2f-a6c1-4abe-8377-7063ecc86746 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89f12d146749b38c688b7581e53f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247c7ae3e4e4068a88a044e36945f32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:49.860154 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7d33ee2f-a6c1-4abe-8377-7063ecc86746 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:49.860646 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7d33ee2f-a6c1-4abe-8377-7063ecc86746 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:49.861390 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7d33ee2f-a6c1-4abe-8377-7063ecc86746 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:49.994960 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7d33ee2f-a6c1-4abe-8377-7063ecc86746 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] 10.222.0.20 "GET /compute/v2.1/servers/detail" status: 200 len: 1606 microversion: 2.1 time: 0.395525 Oct 04 18:32:49.995838 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 606/1252] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Oct 4 18:32:49 2022] GET /compute/v2.1/servers/detail => generated 1606 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:50.017671 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-883cec4e-7fd4-4ad2-85cc-339bd7e6130f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:50.018304 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-883cec4e-7fd4-4ad2-85cc-339bd7e6130f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 158e9f52-fd16-48d1-87b5-e0dd523e97a4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:50.031917 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-883cec4e-7fd4-4ad2-85cc-339bd7e6130f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:50.032783 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-883cec4e-7fd4-4ad2-85cc-339bd7e6130f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:50.033292 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-883cec4e-7fd4-4ad2-85cc-339bd7e6130f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:50.034119 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-883cec4e-7fd4-4ad2-85cc-339bd7e6130f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:50.035255 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-883cec4e-7fd4-4ad2-85cc-339bd7e6130f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:50.035682 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-883cec4e-7fd4-4ad2-85cc-339bd7e6130f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:50.142520 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-883cec4e-7fd4-4ad2-85cc-339bd7e6130f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:50.151670 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-883cec4e-7fd4-4ad2-85cc-339bd7e6130f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4" status: 200 len: 1305 microversion: 2.1 time: 0.142032 Oct 04 18:32:50.164295 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 607/1253] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:49 2022] GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4 => generated 1305 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:50.164295 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-baaa6a8e-b459-41cd-90d9-a92e90007708 tempest-SecurityGroupRulesTestJSON-1957837475 tempest-SecurityGroupRulesTestJSON-1957837475-project] Calling method '.version_select at 0x7fe2590dbca0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:50.262223 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e685d2d1-8cd6-4a32-8168-286bb8023d52 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "DELETE /compute/v2.1/images/cabaf7e6-9081-4a33-8415-4c717517ad62" status: 204 len: 0 microversion: 2.1 time: 1.799500 Oct 04 18:32:50.265431 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 647/1254] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:48 2022] DELETE /compute/v2.1/images/cabaf7e6-9081-4a33-8415-4c717517ad62 => generated 0 bytes in 1802 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:32:50.272911 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-58769164-2c7d-4a6a-9ac4-b2d18d210ec4 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:50.280884 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-58769164-2c7d-4a6a-9ac4-b2d18d210ec4 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016321 Oct 04 18:32:50.293508 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 648/1255] 10.222.0.20 () {58 vars in 1137 bytes} [Tue Oct 4 18:32:50 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:50.302963 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7b350df9-2f4d-4060-81c9-fd106aead20e tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:50.303701 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7b350df9-2f4d-4060-81c9-fd106aead20e tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: 0cd68f0f-4385-45c4-8dd0-8f33a5a9e527] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:50.313831 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7b350df9-2f4d-4060-81c9-fd106aead20e tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:50.318773 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7b350df9-2f4d-4060-81c9-fd106aead20e tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:50.318773 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7b350df9-2f4d-4060-81c9-fd106aead20e tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:50.318773 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7b350df9-2f4d-4060-81c9-fd106aead20e tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:50.318773 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7b350df9-2f4d-4060-81c9-fd106aead20e tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:50.318773 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7b350df9-2f4d-4060-81c9-fd106aead20e tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:50.356436 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7b350df9-2f4d-4060-81c9-fd106aead20e tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: 0cd68f0f-4385-45c4-8dd0-8f33a5a9e527] Going to try to terminate instance {{(pid=123002) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:32:50.565098 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-baaa6a8e-b459-41cd-90d9-a92e90007708 tempest-SecurityGroupRulesTestJSON-1957837475 tempest-SecurityGroupRulesTestJSON-1957837475-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/c76bd2e7-0e02-4248-9dd2-bd7378c5b97b" status: 202 len: 0 microversion: 2.1 time: 0.409864 Oct 04 18:32:50.566305 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 608/1256] 10.222.0.20 () {58 vars in 1272 bytes} [Tue Oct 4 18:32:50 2022] DELETE /compute/v2.1/os-security-groups/c76bd2e7-0e02-4248-9dd2-bd7378c5b97b => generated 0 bytes in 413 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:32:50.575353 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-252efd02-71a9-4f82-a0dd-342bc1a77644 tempest-SecurityGroupRulesTestJSON-1957837475 tempest-SecurityGroupRulesTestJSON-1957837475-project] Calling method '.version_select at 0x7fe25911e280>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:50.782197 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7b350df9-2f4d-4060-81c9-fd106aead20e tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0cd68f0f-4385-45c4-8dd0-8f33a5a9e527" status: 204 len: 0 microversion: 2.1 time: 0.485962 Oct 04 18:32:50.782698 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 649/1257] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:32:50 2022] DELETE /compute/v2.1/servers/0cd68f0f-4385-45c4-8dd0-8f33a5a9e527 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:32:50.794871 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-82138e50-2ca2-4124-b8e0-d38800f181da tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:50.794871 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-82138e50-2ca2-4124-b8e0-d38800f181da tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] [instance: 5e154d65-5086-47c1-bba7-ea3dfd53f6e6] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:50.808529 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-82138e50-2ca2-4124-b8e0-d38800f181da tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:50.809851 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-82138e50-2ca2-4124-b8e0-d38800f181da tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:50.810350 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-82138e50-2ca2-4124-b8e0-d38800f181da tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:50.811232 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-82138e50-2ca2-4124-b8e0-d38800f181da tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:50.811783 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-82138e50-2ca2-4124-b8e0-d38800f181da tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:50.812355 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-82138e50-2ca2-4124-b8e0-d38800f181da tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:50.839938 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-82138e50-2ca2-4124-b8e0-d38800f181da tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] [instance: 5e154d65-5086-47c1-bba7-ea3dfd53f6e6] Going to try to terminate instance {{(pid=123002) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:32:50.985975 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-252efd02-71a9-4f82-a0dd-342bc1a77644 tempest-SecurityGroupRulesTestJSON-1957837475 tempest-SecurityGroupRulesTestJSON-1957837475-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/fdf453ae-277d-4292-9bf9-5f0fb29f47e9" status: 202 len: 0 microversion: 2.1 time: 0.414650 Oct 04 18:32:50.987015 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 609/1258] 10.222.0.20 () {58 vars in 1272 bytes} [Tue Oct 4 18:32:50 2022] DELETE /compute/v2.1/os-security-groups/fdf453ae-277d-4292-9bf9-5f0fb29f47e9 => generated 0 bytes in 417 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:32:50.995989 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-fae1565d-0ba5-482d-8bb3-e8933a155463 tempest-SecurityGroupRulesTestJSON-1957837475 tempest-SecurityGroupRulesTestJSON-1957837475-project] Calling method '.version_select at 0x7fe2590da700>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:51.215404 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-82138e50-2ca2-4124-b8e0-d38800f181da tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5e154d65-5086-47c1-bba7-ea3dfd53f6e6" status: 204 len: 0 microversion: 2.1 time: 0.430511 Oct 04 18:32:51.219921 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 650/1259] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:32:50 2022] DELETE /compute/v2.1/servers/5e154d65-5086-47c1-bba7-ea3dfd53f6e6 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:32:51.226999 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-441d5647-fb53-444e-824b-70cdf4ed32a4 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-290566316", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": [{"uuid": "d61331d4-8e69-4941-9497-adc08bbff779"}]}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:51.324725 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-fae1565d-0ba5-482d-8bb3-e8933a155463 tempest-SecurityGroupRulesTestJSON-1957837475 tempest-SecurityGroupRulesTestJSON-1957837475-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/5bcdd70b-bd77-4cbf-b7fd-3d637d152a68" status: 202 len: 0 microversion: 2.1 time: 0.332622 Oct 04 18:32:51.325988 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 610/1260] 10.222.0.20 () {58 vars in 1272 bytes} [Tue Oct 4 18:32:50 2022] DELETE /compute/v2.1/os-security-groups/5bcdd70b-bd77-4cbf-b7fd-3d637d152a68 => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:32:51.333384 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1e78755c-d51a-4bc8-9027-fcc665b13694 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:51.334805 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1e78755c-d51a-4bc8-9027-fcc665b13694 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 158e9f52-fd16-48d1-87b5-e0dd523e97a4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:51.357852 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1e78755c-d51a-4bc8-9027-fcc665b13694 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:51.358858 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1e78755c-d51a-4bc8-9027-fcc665b13694 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:51.361203 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1e78755c-d51a-4bc8-9027-fcc665b13694 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:51.363735 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1e78755c-d51a-4bc8-9027-fcc665b13694 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:51.365093 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1e78755c-d51a-4bc8-9027-fcc665b13694 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:51.367465 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1e78755c-d51a-4bc8-9027-fcc665b13694 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:51.663852 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-441d5647-fb53-444e-824b-70cdf4ed32a4 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] validate_networks() for [('d61331d4-8e69-4941-9497-adc08bbff779', None, None, None, None, None)] {{(pid=123002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:32:51.762208 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1e78755c-d51a-4bc8-9027-fcc665b13694 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:51.773634 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1e78755c-d51a-4bc8-9027-fcc665b13694 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4" status: 200 len: 1360 microversion: 2.1 time: 0.446160 Oct 04 18:32:51.774920 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 611/1261] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:51 2022] GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4 => generated 1360 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:51.781089 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f7f4aee3-3679-4bd3-951c-c08c61fbadfb tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:51.782607 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f7f4aee3-3679-4bd3-951c-c08c61fbadfb tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] [instance: 5e154d65-5086-47c1-bba7-ea3dfd53f6e6] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:51.791419 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f7f4aee3-3679-4bd3-951c-c08c61fbadfb tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:51.792203 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f7f4aee3-3679-4bd3-951c-c08c61fbadfb tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:51.792932 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f7f4aee3-3679-4bd3-951c-c08c61fbadfb tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:51.793923 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f7f4aee3-3679-4bd3-951c-c08c61fbadfb tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:51.794617 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f7f4aee3-3679-4bd3-951c-c08c61fbadfb tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:51.795277 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f7f4aee3-3679-4bd3-951c-c08c61fbadfb tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:52.119527 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f7f4aee3-3679-4bd3-951c-c08c61fbadfb tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89f12d146749b38c688b7581e53f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247c7ae3e4e4068a88a044e36945f32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:52.128264 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f7f4aee3-3679-4bd3-951c-c08c61fbadfb tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] 10.222.0.20 "GET /compute/v2.1/servers/5e154d65-5086-47c1-bba7-ea3dfd53f6e6" status: 200 len: 1609 microversion: 2.1 time: 0.351882 Oct 04 18:32:52.130139 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 612/1262] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:51 2022] GET /compute/v2.1/servers/5e154d65-5086-47c1-bba7-ea3dfd53f6e6 => generated 1609 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:52.316856 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-de54e0d9-b97d-4591-a636-093ff128f657 req-8dee2ddc-53b7-475a-88d1-47ee509bb74a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "158e9f52-fd16-48d1-87b5-e0dd523e97a4", "tag": "339801ef-bddd-45f8-802a-ec8d2e0687e7"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:52.338942 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-de54e0d9-b97d-4591-a636-093ff128f657 req-8dee2ddc-53b7-475a-88d1-47ee509bb74a service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:52.340458 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-de54e0d9-b97d-4591-a636-093ff128f657 req-8dee2ddc-53b7-475a-88d1-47ee509bb74a service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:52.340458 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-de54e0d9-b97d-4591-a636-093ff128f657 req-8dee2ddc-53b7-475a-88d1-47ee509bb74a service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:52.365868 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-de54e0d9-b97d-4591-a636-093ff128f657 req-8dee2ddc-53b7-475a-88d1-47ee509bb74a service nova] Creating event network-changed:339801ef-bddd-45f8-802a-ec8d2e0687e7 for instance 158e9f52-fd16-48d1-87b5-e0dd523e97a4 on n-h1-850501-14 Oct 04 18:32:52.372721 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-de54e0d9-b97d-4591-a636-093ff128f657 req-8dee2ddc-53b7-475a-88d1-47ee509bb74a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059894 Oct 04 18:32:52.374052 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 613/1263] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:32:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:32:52.541138 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-a9823b27-51b3-488f-bedd-27bf655a4e6f req-29349cbb-39e2-489a-be9f-4913e92506c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cd68f0f-4385-45c4-8dd0-8f33a5a9e527", "name": "network-vif-unplugged", "status": "completed", "tag": "e0c9983a-03a1-4137-9aaf-8dc3ac6e4cb0"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:52.571014 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-a9823b27-51b3-488f-bedd-27bf655a4e6f req-29349cbb-39e2-489a-be9f-4913e92506c3 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:52.572408 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-a9823b27-51b3-488f-bedd-27bf655a4e6f req-29349cbb-39e2-489a-be9f-4913e92506c3 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:52.573892 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-a9823b27-51b3-488f-bedd-27bf655a4e6f req-29349cbb-39e2-489a-be9f-4913e92506c3 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:52.605272 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-a9823b27-51b3-488f-bedd-27bf655a4e6f req-29349cbb-39e2-489a-be9f-4913e92506c3 service nova] Creating event network-vif-unplugged:e0c9983a-03a1-4137-9aaf-8dc3ac6e4cb0 for instance 0cd68f0f-4385-45c4-8dd0-8f33a5a9e527 on n-h2-850501-14 Oct 04 18:32:52.616741 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-a9823b27-51b3-488f-bedd-27bf655a4e6f req-29349cbb-39e2-489a-be9f-4913e92506c3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081167 Oct 04 18:32:52.619842 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 614/1264] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:32:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:52.641341 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-441d5647-fb53-444e-824b-70cdf4ed32a4 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:32:52.642406 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-441d5647-fb53-444e-824b-70cdf4ed32a4 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:32:52.643597 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-441d5647-fb53-444e-824b-70cdf4ed32a4 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:32:52.644305 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-441d5647-fb53-444e-824b-70cdf4ed32a4 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:32:52.644949 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-441d5647-fb53-444e-824b-70cdf4ed32a4 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:32:52.657423 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-441d5647-fb53-444e-824b-70cdf4ed32a4 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:52.667791 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-441d5647-fb53-444e-824b-70cdf4ed32a4 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:52.668503 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-441d5647-fb53-444e-824b-70cdf4ed32a4 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:52.676195 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-441d5647-fb53-444e-824b-70cdf4ed32a4 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:52.676959 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-441d5647-fb53-444e-824b-70cdf4ed32a4 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:52.678493 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-441d5647-fb53-444e-824b-70cdf4ed32a4 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:52.717502 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=4,nova_api:INSERT=3 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:52.727853 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-441d5647-fb53-444e-824b-70cdf4ed32a4 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Getting quotas for project 08c83d7b68684daf8e67ba2361ad86c9. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:32:52.742318 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-441d5647-fb53-444e-824b-70cdf4ed32a4 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Getting quotas for user ef3c7ad35a05450496b6d1ff64f12b77 and project 08c83d7b68684daf8e67ba2361ad86c9. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:32:52.749759 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-441d5647-fb53-444e-824b-70cdf4ed32a4 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Going to run 1 instances... {{(pid=123002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:32:52.752691 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-441d5647-fb53-444e-824b-70cdf4ed32a4 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: c8c84d9e-2274-49dd-99e9-cbd7222c22d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:32:52.859018 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-14f03ce3-9c88-47f3-88c8-b922d1f36a6a tempest-HypervisorAdminV228Test-1764529769 tempest-HypervisorAdminV228Test-1764529769-project-admin] Calling method '.version_select at 0x7fe25911eee0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:52.861723 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-14f03ce3-9c88-47f3-88c8-b922d1f36a6a tempest-HypervisorAdminV228Test-1764529769 tempest-HypervisorAdminV228Test-1764529769-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:52.862205 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-14f03ce3-9c88-47f3-88c8-b922d1f36a6a tempest-HypervisorAdminV228Test-1764529769 tempest-HypervisorAdminV228Test-1764529769-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:52.862637 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-14f03ce3-9c88-47f3-88c8-b922d1f36a6a tempest-HypervisorAdminV228Test-1764529769 tempest-HypervisorAdminV228Test-1764529769-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:52.889352 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-14f03ce3-9c88-47f3-88c8-b922d1f36a6a tempest-HypervisorAdminV228Test-1764529769 tempest-HypervisorAdminV228Test-1764529769-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:52.889820 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-14f03ce3-9c88-47f3-88c8-b922d1f36a6a tempest-HypervisorAdminV228Test-1764529769 tempest-HypervisorAdminV228Test-1764529769-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:52.890268 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-14f03ce3-9c88-47f3-88c8-b922d1f36a6a tempest-HypervisorAdminV228Test-1764529769 tempest-HypervisorAdminV228Test-1764529769-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:52.916008 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-14f03ce3-9c88-47f3-88c8-b922d1f36a6a tempest-HypervisorAdminV228Test-1764529769 tempest-HypervisorAdminV228Test-1764529769-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:52.916680 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-14f03ce3-9c88-47f3-88c8-b922d1f36a6a tempest-HypervisorAdminV228Test-1764529769 tempest-HypervisorAdminV228Test-1764529769-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:52.917120 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-14f03ce3-9c88-47f3-88c8-b922d1f36a6a tempest-HypervisorAdminV228Test-1764529769 tempest-HypervisorAdminV228Test-1764529769-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:52.940590 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-14f03ce3-9c88-47f3-88c8-b922d1f36a6a tempest-HypervisorAdminV228Test-1764529769 tempest-HypervisorAdminV228Test-1764529769-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.28 time: 0.269774 Oct 04 18:32:52.941603 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 615/1265] 10.222.0.20 () {60 vars in 1187 bytes} [Tue Oct 4 18:32:52 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:32:52.945150 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-441d5647-fb53-444e-824b-70cdf4ed32a4 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.723389 Oct 04 18:32:52.953525 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 651/1266] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:32:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1733 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:32:52.966135 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b2b38259-9b15-4942-9ec5-a5b2dab031de tempest-HypervisorAdminV228Test-1764529769 tempest-HypervisorAdminV228Test-1764529769-project-admin] Calling method '.version_select at 0x7fe25d34eaf0>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:52.966260 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c4c514b3-d21b-4ee4-ab5a-bfff72456b83 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:52.966260 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c4c514b3-d21b-4ee4-ab5a-bfff72456b83 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 158e9f52-fd16-48d1-87b5-e0dd523e97a4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:52.966422 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b2b38259-9b15-4942-9ec5-a5b2dab031de tempest-HypervisorAdminV228Test-1764529769 tempest-HypervisorAdminV228Test-1764529769-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:52.966422 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b2b38259-9b15-4942-9ec5-a5b2dab031de tempest-HypervisorAdminV228Test-1764529769 tempest-HypervisorAdminV228Test-1764529769-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:52.967262 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b2b38259-9b15-4942-9ec5-a5b2dab031de tempest-HypervisorAdminV228Test-1764529769 tempest-HypervisorAdminV228Test-1764529769-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:52.988819 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b2b38259-9b15-4942-9ec5-a5b2dab031de tempest-HypervisorAdminV228Test-1764529769 tempest-HypervisorAdminV228Test-1764529769-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:52.988819 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b2b38259-9b15-4942-9ec5-a5b2dab031de tempest-HypervisorAdminV228Test-1764529769 tempest-HypervisorAdminV228Test-1764529769-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:52.988819 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b2b38259-9b15-4942-9ec5-a5b2dab031de tempest-HypervisorAdminV228Test-1764529769 tempest-HypervisorAdminV228Test-1764529769-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:52.993224 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b2b38259-9b15-4942-9ec5-a5b2dab031de tempest-HypervisorAdminV228Test-1764529769 tempest-HypervisorAdminV228Test-1764529769-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 720 microversion: 2.28 time: 0.037098 Oct 04 18:32:52.994926 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 652/1267] 10.222.0.20 () {60 vars in 1193 bytes} [Tue Oct 4 18:32:52 2022] GET /compute/v2.1/os-hypervisors/1 => generated 720 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:32:52.996899 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c4c514b3-d21b-4ee4-ab5a-bfff72456b83 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:52.997416 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c4c514b3-d21b-4ee4-ab5a-bfff72456b83 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:52.997844 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c4c514b3-d21b-4ee4-ab5a-bfff72456b83 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:52.998552 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c4c514b3-d21b-4ee4-ab5a-bfff72456b83 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:52.999010 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c4c514b3-d21b-4ee4-ab5a-bfff72456b83 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:52.999434 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c4c514b3-d21b-4ee4-ab5a-bfff72456b83 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:53.001554 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7b888bd7-ca66-4bfd-aaad-a029a5faa6ab tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:53.002326 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7b888bd7-ca66-4bfd-aaad-a029a5faa6ab tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: c8c84d9e-2274-49dd-99e9-cbd7222c22d5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:53.081549 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7b888bd7-ca66-4bfd-aaad-a029a5faa6ab tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:53.101897 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7b888bd7-ca66-4bfd-aaad-a029a5faa6ab tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/c8c84d9e-2274-49dd-99e9-cbd7222c22d5" status: 200 len: 1207 microversion: 2.1 time: 0.105658 Oct 04 18:32:53.115620 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 653/1268] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:52 2022] GET /compute/v2.1/servers/c8c84d9e-2274-49dd-99e9-cbd7222c22d5 => generated 1207 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:53.163689 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-962f80bd-dd0e-4661-8e32-54154602a740 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:53.167262 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-962f80bd-dd0e-4661-8e32-54154602a740 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] [instance: 5e154d65-5086-47c1-bba7-ea3dfd53f6e6] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:53.170857 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-962f80bd-dd0e-4661-8e32-54154602a740 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:53.171384 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-962f80bd-dd0e-4661-8e32-54154602a740 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:53.172078 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-962f80bd-dd0e-4661-8e32-54154602a740 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:53.173046 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-962f80bd-dd0e-4661-8e32-54154602a740 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:53.173402 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-962f80bd-dd0e-4661-8e32-54154602a740 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:53.173899 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-962f80bd-dd0e-4661-8e32-54154602a740 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:53.294444 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c4c514b3-d21b-4ee4-ab5a-bfff72456b83 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:53.312905 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c4c514b3-d21b-4ee4-ab5a-bfff72456b83 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4" status: 200 len: 1360 microversion: 2.1 time: 0.369438 Oct 04 18:32:53.314816 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 616/1269] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:52 2022] GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4 => generated 1360 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:53.372289 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-962f80bd-dd0e-4661-8e32-54154602a740 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89f12d146749b38c688b7581e53f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247c7ae3e4e4068a88a044e36945f32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:53.390489 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-962f80bd-dd0e-4661-8e32-54154602a740 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] 10.222.0.20 "GET /compute/v2.1/servers/5e154d65-5086-47c1-bba7-ea3dfd53f6e6" status: 200 len: 1609 microversion: 2.1 time: 0.229924 Oct 04 18:32:53.390489 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 654/1270] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:53 2022] GET /compute/v2.1/servers/5e154d65-5086-47c1-bba7-ea3dfd53f6e6 => generated 1609 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:53.910205 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c0eb1f8a-ced6-47cb-8117-bd6b7a2c48e5 tempest-KeyPairsNegativeTestJSON-759592740 tempest-KeyPairsNegativeTestJSON-759592740-project] Action: 'create', calling method: .version_select at 0x7fe25910cf70>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIKSL23lHXoSqVK7EG4VcV8inhggiTTPKexvvFTKtOuvK+/QWiOcw9UI0Xjp1Tw3PIhFQdEINpzTylJlBuZOhuZRKLua/XEfekfFxYkezhleDhfaiKojnmHv3Fv+KVeLMQ=="}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:53.912716 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c0eb1f8a-ced6-47cb-8117-bd6b7a2c48e5 tempest-KeyPairsNegativeTestJSON-759592740 tempest-KeyPairsNegativeTestJSON-759592740-project] Request method failure captured: Oct 04 18:32:53.912716 n-d-850501-14 devstack@n-api.service[123001]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 04 18:32:53.912716 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:32:53.912716 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:32:53.912716 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:32:53.912716 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 257 Oct 04 18:32:53.912716 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:32:53.912716 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:32:53.912716 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:32:53.912716 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:53.912716 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPHxU8623ZenD4S896n6QJ9B1dAHFdOiSYkEpFMcGOGHRFVJTmjzNoOZegfDBMQYuktgM5UkmD4n7Mo6Gy5RXPrnNueJVYBf-twWdtDgIbmAd4sq-qldWS_hbZK9JFRf9-QJEjOVl1J9CmyKtodo5H5zq1QQgrwF0DqiQFJAxbHNAiec Oct 04 18:32:53.912716 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:32:53.912716 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:32:53.912716 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:32:53.912716 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:32:53.912716 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:32:53.912716 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:32:53.912716 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 27024471ee3947ceb1a8f000ac401301 Oct 04 18:32:53.912716 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-759592740 Oct 04 18:32:53.912716 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:32:53.912716 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:32:53.912716 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/27024471ee3947ceb1a8f000ac401301"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_27024471ee3947ceb1a8f000ac401301", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/27024471ee3947ceb1a8f000ac401301"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/27024471ee3947ceb1a8f000ac401301"}]}] Oct 04 18:32:53.912716 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-KeyPairsNegativeTestJSON-759592740 Oct 04 18:32:53.912716 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 27024471ee3947ceb1a8f000ac401301 Oct 04 18:32:53.912716 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-759592740 Oct 04 18:32:53.912716 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-KeyPairsNegativeTestJSON-759592740-project Oct 04 18:32:53.912716 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:32:53.912716 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:32:53.912716 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 2df39449781a49038d4d2662e8538849 Oct 04 18:32:53.912716 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-KeyPairsNegativeTestJSON-759592740-project Oct 04 18:32:53.912716 n-d-850501-14 devstack@n-api.service[123001]: Oct 04 18:32:53.912716 n-d-850501-14 devstack@n-api.service[123001]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIKSL23lHXoSqVK7EG4VcV8inhggiTTPKexvvFTKtOuvK+/QWiOcw9UI0Xjp1Tw3PIhFQdEINpzTylJlBuZOhuZRKLua/XEfekfFxYkezhleDhfaiKojnmHv3Fv+KVeLMQ=="}} Oct 04 18:32:53.912716 n-d-850501-14 devstack@n-api.service[123001]: method: Oct 04 18:32:53.912716 n-d-850501-14 devstack@n-api.service[123001]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 04 18:32:53.912716 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIKSL23lHXoSqVK7EG4VcV8inhggiTTPKexvvFTKtOuvK+/QWiOcw9UI0Xjp1Tw3PIhFQdEINpzTylJlBuZOhuZRKLua/XEfekfFxYkezhleDhfaiKojnmHv3Fv+KVeLMQ=='}}} Oct 04 18:32:53.912716 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:53.912716 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:53.912716 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 04 18:32:53.912716 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 04 18:32:53.912716 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Oct 04 18:32:53.912716 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Oct 04 18:32:53.912716 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Oct 04 18:32:53.912716 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Oct 04 18:32:53.912716 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 04 18:32:53.912716 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:32:53.912716 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 04 18:32:53.912716 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:32:53.912716 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:53.912716 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:32:53.912716 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:32:53.912716 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:32:53.912716 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:32:53.912716 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Oct 04 18:32:53.912716 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:32:53.912716 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Oct 04 18:32:53.912716 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Oct 04 18:32:53.912716 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Oct 04 18:32:53.912716 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi 'minLength': 1, Oct 04 18:32:53.912716 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 04 18:32:53.912716 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:32:53.912716 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Oct 04 18:32:53.912716 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Oct 04 18:32:53.912716 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:32:53.919017 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:53.919017 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:32:53.919017 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:53.919017 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:53.919017 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:53.919017 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:53.919017 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:53.919017 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:32:53.919017 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:32:53.919017 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:53.919017 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:53.919017 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:32:53.919017 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:32:53.919017 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:32:53.919017 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:32:53.919017 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:32:53.919017 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:32:53.919017 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:32:53.919017 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:32:53.919017 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 04 18:32:53.919017 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:32:53.919017 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:53.919017 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:32:53.919017 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:53.919017 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:53.919017 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:53.919017 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:32:53.919017 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:32:53.919017 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 04 18:32:53.919017 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:32:53.924245 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c0eb1f8a-ced6-47cb-8117-bd6b7a2c48e5 tempest-KeyPairsNegativeTestJSON-759592740 tempest-KeyPairsNegativeTestJSON-759592740-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:53.925449 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c0eb1f8a-ced6-47cb-8117-bd6b7a2c48e5 tempest-KeyPairsNegativeTestJSON-759592740 tempest-KeyPairsNegativeTestJSON-759592740-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.609261 Oct 04 18:32:53.926535 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 617/1271] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Oct 4 18:32:53 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 611 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:32:53.948037 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-91f06135-113c-4dc2-ac64-a546c941bb36 tempest-KeyPairsNegativeTestJSON-759592740 tempest-KeyPairsNegativeTestJSON-759592740-project] Action: 'create', calling method: .version_select at 0x7fe25d36d280>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-41829754", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:53.968014 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-91f06135-113c-4dc2-ac64-a546c941bb36 tempest-KeyPairsNegativeTestJSON-759592740 tempest-KeyPairsNegativeTestJSON-759592740-project] Getting quotas for project 27024471ee3947ceb1a8f000ac401301. Resources: {'key_pairs'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:32:53.973469 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-91f06135-113c-4dc2-ac64-a546c941bb36 tempest-KeyPairsNegativeTestJSON-759592740 tempest-KeyPairsNegativeTestJSON-759592740-project] Getting quotas for user 2df39449781a49038d4d2662e8538849 and project 27024471ee3947ceb1a8f000ac401301. Resources: {'key_pairs'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:32:53.994914 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-91f06135-113c-4dc2-ac64-a546c941bb36 tempest-KeyPairsNegativeTestJSON-759592740 tempest-KeyPairsNegativeTestJSON-759592740-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 04 18:32:54.001537 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-91f06135-113c-4dc2-ac64-a546c941bb36 tempest-KeyPairsNegativeTestJSON-759592740 tempest-KeyPairsNegativeTestJSON-759592740-project] Request method failure captured: Oct 04 18:32:54.001537 n-d-850501-14 devstack@n-api.service[123002]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 04 18:32:54.001537 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:32:54.001537 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:32:54.001537 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:32:54.001537 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 2165 Oct 04 18:32:54.001537 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:32:54.001537 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:32:54.001537 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:32:54.001537 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:54.001537 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPHxU8623ZenD4S896n6QJ9B1dAHFdOiSYkEpFMcGOGHRFVJTmjzNoOZegfDBMQYuktgM5UkmD4n7Mo6Gy5RXPrnNueJVYBf-twWdtDgIbmAd4sq-qldWS_hbZK9JFRf9-QJEjOVl1J9CmyKtodo5H5zq1QQgrwF0DqiQFJAxbHNAiec Oct 04 18:32:54.001537 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:32:54.001537 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:32:54.001537 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:32:54.001537 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:32:54.001537 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:32:54.001537 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:32:54.001537 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 27024471ee3947ceb1a8f000ac401301 Oct 04 18:32:54.001537 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-759592740 Oct 04 18:32:54.001537 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:32:54.001537 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:32:54.001537 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/27024471ee3947ceb1a8f000ac401301"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_27024471ee3947ceb1a8f000ac401301", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/27024471ee3947ceb1a8f000ac401301"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/27024471ee3947ceb1a8f000ac401301"}]}] Oct 04 18:32:54.001537 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-KeyPairsNegativeTestJSON-759592740 Oct 04 18:32:54.001537 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 27024471ee3947ceb1a8f000ac401301 Oct 04 18:32:54.001537 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-759592740 Oct 04 18:32:54.001537 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-KeyPairsNegativeTestJSON-759592740-project Oct 04 18:32:54.001537 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:32:54.001537 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:32:54.001537 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 2df39449781a49038d4d2662e8538849 Oct 04 18:32:54.001537 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-KeyPairsNegativeTestJSON-759592740-project Oct 04 18:32:54.001537 n-d-850501-14 devstack@n-api.service[123002]: Oct 04 18:32:54.001537 n-d-850501-14 devstack@n-api.service[123002]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-41829754", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Oct 04 18:32:54.001537 n-d-850501-14 devstack@n-api.service[123002]: method: Oct 04 18:32:54.001537 n-d-850501-14 devstack@n-api.service[123002]: exception: Keypair data is invalid: failed to generate fingerprint Oct 04 18:32:54.004244 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-41829754', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Oct 04 18:32:54.004244 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:54.004244 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:54.004244 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 04 18:32:54.004244 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 04 18:32:54.004244 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Oct 04 18:32:54.004244 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Oct 04 18:32:54.004244 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Oct 04 18:32:54.004244 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:54.004244 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:54.004244 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:54.004244 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:54.004244 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 04 18:32:54.004244 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 04 18:32:54.004244 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 18:32:54.004244 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 18:32:54.004244 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:32:54.004244 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:32:54.004244 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:32:54.004244 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:32:54.004244 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 18:32:54.004244 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 18:32:54.004244 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 04 18:32:54.004244 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 04 18:32:54.004244 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 04 18:32:54.004244 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 04 18:32:54.004244 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 04 18:32:54.004244 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 04 18:32:54.004244 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 04 18:32:54.004244 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:54.004244 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:54.004244 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:54.004244 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:54.004244 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:54.004244 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:54.004244 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:54.004244 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:54.004244 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:32:54.004244 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:32:54.004244 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:54.004244 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:54.007545 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:32:54.007545 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:32:54.007545 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:32:54.007545 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:32:54.007545 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 04 18:32:54.007545 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 04 18:32:54.007545 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 04 18:32:54.007545 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 04 18:32:54.007545 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 04 18:32:54.007545 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:54.007545 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:54.007545 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:54.007545 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:54.007545 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:54.007545 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:54.007545 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:32:54.007545 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:32:54.007545 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 04 18:32:54.007545 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:54.007545 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-91f06135-113c-4dc2-ac64-a546c941bb36 tempest-KeyPairsNegativeTestJSON-759592740 tempest-KeyPairsNegativeTestJSON-759592740-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:54.007545 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-91f06135-113c-4dc2-ac64-a546c941bb36 tempest-KeyPairsNegativeTestJSON-759592740 tempest-KeyPairsNegativeTestJSON-759592740-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.066099 Oct 04 18:32:54.011619 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 655/1272] 10.222.0.20 () {60 vars in 1160 bytes} [Tue Oct 4 18:32:53 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 74 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 04 18:32:54.016025 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-fced532f-36c4-41ae-a370-fca769f0865b tempest-KeyPairsNegativeTestJSON-759592740 tempest-KeyPairsNegativeTestJSON-759592740-project] Action: 'create', calling method: .version_select at 0x7fe259098c10>, body: {"keypair": {"name": "tempest-keypair-1541539389", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM4RinmOjAzxJ/VJIq6aOTezul+YCPUv/weJpBPs/1HD+TXOr6k3BHfZpuJOOqDMG7AB6NlJ889xBbgAYzHcYUytIZ7moalqnBdhAGC7Y7V4qnT0qfgMy9sD9koTbO5Jdg=="}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:54.034976 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-fced532f-36c4-41ae-a370-fca769f0865b tempest-KeyPairsNegativeTestJSON-759592740 tempest-KeyPairsNegativeTestJSON-759592740-project] Getting quotas for project 27024471ee3947ceb1a8f000ac401301. Resources: {'key_pairs'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:32:54.040856 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-fced532f-36c4-41ae-a370-fca769f0865b tempest-KeyPairsNegativeTestJSON-759592740 tempest-KeyPairsNegativeTestJSON-759592740-project] Getting quotas for user 2df39449781a49038d4d2662e8538849 and project 27024471ee3947ceb1a8f000ac401301. Resources: {'key_pairs'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:32:54.127932 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2da05320-c325-4586-8773-ac501c0a43e7 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:54.128819 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2da05320-c325-4586-8773-ac501c0a43e7 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: c8c84d9e-2274-49dd-99e9-cbd7222c22d5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:54.189070 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-fced532f-36c4-41ae-a370-fca769f0865b tempest-KeyPairsNegativeTestJSON-759592740 tempest-KeyPairsNegativeTestJSON-759592740-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.176886 Oct 04 18:32:54.190226 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 618/1273] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Oct 4 18:32:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:32:54.205023 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ecd6cd4e-3e5e-49be-a7ec-45c5718a3958 tempest-KeyPairsNegativeTestJSON-759592740 tempest-KeyPairsNegativeTestJSON-759592740-project] Action: 'create', calling method: .version_select at 0x7fe2590da0d0>, body: {"keypair": {"name": "tempest-keypair-1541539389", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK4xVC62hlbvtSKN4cwV2XCtr3tdnXOBJwV4DUGobyncghx+xHkmfTIHSnIjqGHmRI/stO2ejlvvDEXfzqNWWqdVMbVMDa3Dl0T3WC0UPVv8o7LL78HZVsTIlKsvXnExnA=="}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:54.224617 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-ecd6cd4e-3e5e-49be-a7ec-45c5718a3958 tempest-KeyPairsNegativeTestJSON-759592740 tempest-KeyPairsNegativeTestJSON-759592740-project] Getting quotas for project 27024471ee3947ceb1a8f000ac401301. Resources: {'key_pairs'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:32:54.230254 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-ecd6cd4e-3e5e-49be-a7ec-45c5718a3958 tempest-KeyPairsNegativeTestJSON-759592740 tempest-KeyPairsNegativeTestJSON-759592740-project] Getting quotas for user 2df39449781a49038d4d2662e8538849 and project 27024471ee3947ceb1a8f000ac401301. Resources: {'key_pairs'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:32:54.238749 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2da05320-c325-4586-8773-ac501c0a43e7 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:54.248845 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2da05320-c325-4586-8773-ac501c0a43e7 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/c8c84d9e-2274-49dd-99e9-cbd7222c22d5" status: 200 len: 1207 microversion: 2.1 time: 0.125759 Oct 04 18:32:54.249546 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 656/1274] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:54 2022] GET /compute/v2.1/servers/c8c84d9e-2274-49dd-99e9-cbd7222c22d5 => generated 1207 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:54.317148 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-ecd6cd4e-3e5e-49be-a7ec-45c5718a3958 tempest-KeyPairsNegativeTestJSON-759592740 tempest-KeyPairsNegativeTestJSON-759592740-project] HTTP exception thrown: Key pair 'tempest-keypair-1541539389' already exists. Oct 04 18:32:54.339520 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-530503f0-666e-4084-b773-264d6bbd7e04 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:54.340367 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-530503f0-666e-4084-b773-264d6bbd7e04 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 158e9f52-fd16-48d1-87b5-e0dd523e97a4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:54.350345 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ecd6cd4e-3e5e-49be-a7ec-45c5718a3958 tempest-KeyPairsNegativeTestJSON-759592740 tempest-KeyPairsNegativeTestJSON-759592740-project] Request method failure captured: Oct 04 18:32:54.350345 n-d-850501-14 devstack@n-api.service[123001]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 04 18:32:54.350345 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:32:54.350345 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:32:54.350345 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:32:54.350345 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 273 Oct 04 18:32:54.350345 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:32:54.350345 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:32:54.350345 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:32:54.350345 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:54.350345 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPHxU8623ZenD4S896n6QJ9B1dAHFdOiSYkEpFMcGOGHRFVJTmjzNoOZegfDBMQYuktgM5UkmD4n7Mo6Gy5RXPrnNueJVYBf-twWdtDgIbmAd4sq-qldWS_hbZK9JFRf9-QJEjOVl1J9CmyKtodo5H5zq1QQgrwF0DqiQFJAxbHNAiec Oct 04 18:32:54.350345 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:32:54.350345 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:32:54.350345 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:32:54.350345 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:32:54.350345 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:32:54.350345 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:32:54.350345 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 27024471ee3947ceb1a8f000ac401301 Oct 04 18:32:54.350345 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-759592740 Oct 04 18:32:54.350345 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:32:54.350345 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:32:54.350345 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/27024471ee3947ceb1a8f000ac401301"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_27024471ee3947ceb1a8f000ac401301", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/27024471ee3947ceb1a8f000ac401301"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/27024471ee3947ceb1a8f000ac401301"}]}] Oct 04 18:32:54.350345 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-KeyPairsNegativeTestJSON-759592740 Oct 04 18:32:54.350345 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 27024471ee3947ceb1a8f000ac401301 Oct 04 18:32:54.350345 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-759592740 Oct 04 18:32:54.350345 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-KeyPairsNegativeTestJSON-759592740-project Oct 04 18:32:54.350345 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:32:54.350345 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:32:54.350345 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 2df39449781a49038d4d2662e8538849 Oct 04 18:32:54.350345 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-KeyPairsNegativeTestJSON-759592740-project Oct 04 18:32:54.350345 n-d-850501-14 devstack@n-api.service[123001]: Oct 04 18:32:54.350345 n-d-850501-14 devstack@n-api.service[123001]: {"keypair": {"name": "tempest-keypair-1541539389", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK4xVC62hlbvtSKN4cwV2XCtr3tdnXOBJwV4DUGobyncghx+xHkmfTIHSnIjqGHmRI/stO2ejlvvDEXfzqNWWqdVMbVMDa3Dl0T3WC0UPVv8o7LL78HZVsTIlKsvXnExnA=="}} Oct 04 18:32:54.350345 n-d-850501-14 devstack@n-api.service[123001]: method: Oct 04 18:32:54.350345 n-d-850501-14 devstack@n-api.service[123001]: exception: Key pair 'tempest-keypair-1541539389' already exists. Oct 04 18:32:54.350345 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-1541539389', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK4xVC62hlbvtSKN4cwV2XCtr3tdnXOBJwV4DUGobyncghx+xHkmfTIHSnIjqGHmRI/stO2ejlvvDEXfzqNWWqdVMbVMDa3Dl0T3WC0UPVv8o7LL78HZVsTIlKsvXnExnA=='}}} Oct 04 18:32:54.350345 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:54.350345 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:54.350345 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 18:32:54.350345 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 04 18:32:54.350345 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 18:32:54.350345 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 04 18:32:54.350345 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 18:32:54.350345 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 04 18:32:54.350345 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 18:32:54.350345 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 04 18:32:54.350345 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 18:32:54.350345 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 18:32:54.350345 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 18:32:54.350345 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi result.read() Oct 04 18:32:54.350345 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 18:32:54.350345 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 04 18:32:54.350345 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 18:32:54.350345 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 04 18:32:54.350345 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 18:32:54.350345 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 04 18:32:54.350345 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 18:32:54.350345 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 04 18:32:54.350345 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '2df39449781a49038d4d2662e8538849-tempest-keypair-1541539389' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 04 18:32:54.350345 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:32:54.360601 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 04 18:32:54.360601 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:32:54.360601 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:54.360601 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Oct 04 18:32:54.360601 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi kp.save(context.session) Oct 04 18:32:54.360601 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 04 18:32:54.360601 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi session.flush() Oct 04 18:32:54.360601 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 04 18:32:54.360601 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 04 18:32:54.360601 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 04 18:32:54.360601 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 04 18:32:54.360601 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 04 18:32:54.360601 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 04 18:32:54.360601 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 18:32:54.360601 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception Oct 04 18:32:54.360601 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 04 18:32:54.360601 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 04 18:32:54.360601 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 04 18:32:54.360601 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 04 18:32:54.360601 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 04 18:32:54.360601 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 04 18:32:54.360601 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 04 18:32:54.360601 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 04 18:32:54.360601 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 04 18:32:54.360601 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 04 18:32:54.360601 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 04 18:32:54.360601 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 04 18:32:54.360601 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 04 18:32:54.360601 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 04 18:32:54.360601 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 04 18:32:54.360601 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 04 18:32:54.360601 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 04 18:32:54.360601 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 04 18:32:54.360601 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 04 18:32:54.360601 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 04 18:32:54.360601 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 18:32:54.360601 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception Oct 04 18:32:54.360601 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 18:32:54.360601 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 04 18:32:54.360601 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 18:32:54.360601 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 04 18:32:54.360601 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 18:32:54.360601 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 04 18:32:54.360601 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 18:32:54.360601 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 04 18:32:54.360601 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 18:32:54.360601 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 18:32:54.360601 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 18:32:54.360601 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi result.read() Oct 04 18:32:54.360601 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 18:32:54.360601 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 04 18:32:54.360601 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 18:32:54.360601 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 04 18:32:54.360601 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 18:32:54.360601 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 04 18:32:54.360601 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 18:32:54.372002 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 04 18:32:54.372002 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '2df39449781a49038d4d2662e8538849-tempest-keypair-1541539389' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 04 18:32:54.372002 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Oct 04 18:32:54.372002 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 4, 18, 32, 54, 246999), 'updated_at': None, 'name': 'tempest-keypair-1541539389', 'user_id': '2df39449781a49038d4d2662e8538849', 'fingerprint': 'c7:10:ea:52:b9:5d:0e:69:92:d6:47:36:05:4d:80:2c', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK4xVC62hlbvtSKN4cwV2XCtr3tdnXOBJwV4DUGobyncghx+xHkmfTIHSnIjqGHmRI/stO2ejlvvDEXfzqNWWqdVMbVMDa3Dl0T3WC0UPVv8o7LL78HZVsTIlKsvXnExnA==', 'type': 'ssh'}] Oct 04 18:32:54.372002 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 04 18:32:54.372002 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:32:54.372002 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:54.372002 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:32:54.372002 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:54.372002 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 04 18:32:54.372002 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 04 18:32:54.372002 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 18:32:54.372002 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 18:32:54.372002 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:32:54.372002 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:32:54.372002 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:32:54.372002 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:32:54.372002 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 18:32:54.372002 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 18:32:54.372002 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Oct 04 18:32:54.372002 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi keypair.create() Oct 04 18:32:54.372002 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 04 18:32:54.372002 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 04 18:32:54.372002 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Oct 04 18:32:54.372002 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self._create() Oct 04 18:32:54.372002 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Oct 04 18:32:54.372002 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Oct 04 18:32:54.372002 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Oct 04 18:32:54.372002 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Oct 04 18:32:54.372002 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:32:54.372002 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:32:54.372002 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Oct 04 18:32:54.372002 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Oct 04 18:32:54.372002 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-1541539389' already exists. Oct 04 18:32:54.372002 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:32:54.372002 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:54.372002 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:32:54.372002 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:54.372002 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:54.372002 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:54.372002 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:54.372002 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:54.372002 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:32:54.372002 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:32:54.372002 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:54.372002 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:54.372002 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:32:54.372002 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:32:54.372002 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:32:54.372002 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:32:54.372002 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 04 18:32:54.372002 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 04 18:32:54.372002 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Oct 04 18:32:54.372002 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Oct 04 18:32:54.372002 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-1541539389' already exists. Oct 04 18:32:54.379394 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:32:54.379394 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:54.379394 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:32:54.379394 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:54.379394 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:54.379394 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:54.379394 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:32:54.379394 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:32:54.379394 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-1541539389' already exists. Oct 04 18:32:54.379394 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:32:54.379394 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ecd6cd4e-3e5e-49be-a7ec-45c5718a3958 tempest-KeyPairsNegativeTestJSON-759592740 tempest-KeyPairsNegativeTestJSON-759592740-project] Returning 409 to user: Key pair 'tempest-keypair-1541539389' already exists. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:54.381141 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-530503f0-666e-4084-b773-264d6bbd7e04 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:54.381141 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-530503f0-666e-4084-b773-264d6bbd7e04 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:54.381141 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-530503f0-666e-4084-b773-264d6bbd7e04 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:54.390528 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ecd6cd4e-3e5e-49be-a7ec-45c5718a3958 tempest-KeyPairsNegativeTestJSON-759592740 tempest-KeyPairsNegativeTestJSON-759592740-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.151314 Oct 04 18:32:54.390528 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 619/1275] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Oct 4 18:32:54 2022] POST /compute/v2.1/os-keypairs => generated 105 bytes in 159 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 04 18:32:54.390877 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-530503f0-666e-4084-b773-264d6bbd7e04 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:54.390877 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-530503f0-666e-4084-b773-264d6bbd7e04 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:54.390877 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-530503f0-666e-4084-b773-264d6bbd7e04 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:54.391111 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b56e6850-23d7-4f5b-9b91-cfc4bca3b2bb tempest-KeyPairsNegativeTestJSON-759592740 tempest-KeyPairsNegativeTestJSON-759592740-project] Calling method '.version_select at 0x7fe2590fedc0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:54.526517 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b56e6850-23d7-4f5b-9b91-cfc4bca3b2bb tempest-KeyPairsNegativeTestJSON-759592740 tempest-KeyPairsNegativeTestJSON-759592740-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1541539389" status: 202 len: 0 microversion: 2.1 time: 0.156658 Oct 04 18:32:54.527111 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 620/1276] 10.222.0.20 () {58 vars in 1221 bytes} [Tue Oct 4 18:32:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1541539389 => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:32:54.531950 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-60cc75ca-5679-4904-9115-e9ad6a4df640 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:54.532872 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-60cc75ca-5679-4904-9115-e9ad6a4df640 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] [instance: 5e154d65-5086-47c1-bba7-ea3dfd53f6e6] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:54.551260 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-60cc75ca-5679-4904-9115-e9ad6a4df640 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:54.568375 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-60cc75ca-5679-4904-9115-e9ad6a4df640 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:54.568375 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-60cc75ca-5679-4904-9115-e9ad6a4df640 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:54.568375 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-60cc75ca-5679-4904-9115-e9ad6a4df640 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:54.568375 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-60cc75ca-5679-4904-9115-e9ad6a4df640 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:54.568375 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-60cc75ca-5679-4904-9115-e9ad6a4df640 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:54.568375 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:54.698715 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-530503f0-666e-4084-b773-264d6bbd7e04 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:54.711252 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-530503f0-666e-4084-b773-264d6bbd7e04 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4" status: 200 len: 1360 microversion: 2.1 time: 0.375926 Oct 04 18:32:54.712590 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 657/1277] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:54 2022] GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4 => generated 1360 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:32:54.717696 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3b841ee2-8118-457d-935d-c5addf260aa3 tempest-KeyPairsNegativeTestJSON-759592740 tempest-KeyPairsNegativeTestJSON-759592740-project] Action: 'create', calling method: .version_select at 0x7fe25d31a310>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLSpn0aHWSQ1VWIWQ+cYP1E+m+FhAkEJTSXg79pTiHlSjqv9FGNyDEeH6ZOt5ISeqrXgomkW2uKiDAGlrLnZ+F+KmqeegFZlT8nlD5aF/yie664rqL8zZJhWsZORrpjrEw=="}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:54.723569 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3b841ee2-8118-457d-935d-c5addf260aa3 tempest-KeyPairsNegativeTestJSON-759592740 tempest-KeyPairsNegativeTestJSON-759592740-project] Request method failure captured: Oct 04 18:32:54.723569 n-d-850501-14 devstack@n-api.service[123002]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 04 18:32:54.723569 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:32:54.723569 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:32:54.723569 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:32:54.723569 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 247 Oct 04 18:32:54.723569 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:32:54.723569 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:32:54.723569 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:32:54.723569 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:54.723569 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPHxU8623ZenD4S896n6QJ9B1dAHFdOiSYkEpFMcGOGHRFVJTmjzNoOZegfDBMQYuktgM5UkmD4n7Mo6Gy5RXPrnNueJVYBf-twWdtDgIbmAd4sq-qldWS_hbZK9JFRf9-QJEjOVl1J9CmyKtodo5H5zq1QQgrwF0DqiQFJAxbHNAiec Oct 04 18:32:54.723569 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:32:54.723569 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:32:54.723569 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:32:54.723569 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:32:54.723569 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:32:54.723569 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:32:54.723569 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 27024471ee3947ceb1a8f000ac401301 Oct 04 18:32:54.723569 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-759592740 Oct 04 18:32:54.723569 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:32:54.723569 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:32:54.723569 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/27024471ee3947ceb1a8f000ac401301"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_27024471ee3947ceb1a8f000ac401301", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/27024471ee3947ceb1a8f000ac401301"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/27024471ee3947ceb1a8f000ac401301"}]}] Oct 04 18:32:54.723569 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-KeyPairsNegativeTestJSON-759592740 Oct 04 18:32:54.723569 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 27024471ee3947ceb1a8f000ac401301 Oct 04 18:32:54.723569 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-759592740 Oct 04 18:32:54.723569 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-KeyPairsNegativeTestJSON-759592740-project Oct 04 18:32:54.723569 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:32:54.723569 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:32:54.723569 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 2df39449781a49038d4d2662e8538849 Oct 04 18:32:54.723569 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-KeyPairsNegativeTestJSON-759592740-project Oct 04 18:32:54.723569 n-d-850501-14 devstack@n-api.service[123002]: Oct 04 18:32:54.723569 n-d-850501-14 devstack@n-api.service[123002]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLSpn0aHWSQ1VWIWQ+cYP1E+m+FhAkEJTSXg79pTiHlSjqv9FGNyDEeH6ZOt5ISeqrXgomkW2uKiDAGlrLnZ+F+KmqeegFZlT8nlD5aF/yie664rqL8zZJhWsZORrpjrEw=="}} Oct 04 18:32:54.723569 n-d-850501-14 devstack@n-api.service[123002]: method: Oct 04 18:32:54.723569 n-d-850501-14 devstack@n-api.service[123002]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 04 18:32:54.723569 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLSpn0aHWSQ1VWIWQ+cYP1E+m+FhAkEJTSXg79pTiHlSjqv9FGNyDEeH6ZOt5ISeqrXgomkW2uKiDAGlrLnZ+F+KmqeegFZlT8nlD5aF/yie664rqL8zZJhWsZORrpjrEw=='}}} Oct 04 18:32:54.723569 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:54.723569 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:54.723569 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:32:54.723569 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:32:54.723569 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:32:54.723569 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:32:54.723569 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 04 18:32:54.723569 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:54.723569 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 04 18:32:54.723569 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 18:32:54.723569 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:54.723569 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 04 18:32:54.723569 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi '' Oct 04 18:32:54.723569 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:54.723569 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:54.723569 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:54.723569 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:54.723569 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:54.723569 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:54.723569 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:54.723569 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:54.723569 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:32:54.723569 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:32:54.723569 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:54.723569 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:54.723569 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:32:54.723569 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:32:54.723569 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:32:54.723569 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:32:54.728910 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:32:54.728910 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:32:54.728910 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:32:54.728910 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:32:54.728910 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 04 18:32:54.728910 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:54.728910 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:54.728910 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:54.728910 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:54.728910 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:54.728910 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:54.728910 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:32:54.728910 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:32:54.728910 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 04 18:32:54.728910 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:54.732751 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3b841ee2-8118-457d-935d-c5addf260aa3 tempest-KeyPairsNegativeTestJSON-759592740 tempest-KeyPairsNegativeTestJSON-759592740-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:54.733813 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3b841ee2-8118-457d-935d-c5addf260aa3 tempest-KeyPairsNegativeTestJSON-759592740 tempest-KeyPairsNegativeTestJSON-759592740-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.019970 Oct 04 18:32:54.735232 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 658/1278] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Oct 4 18:32:54 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:32:54.747654 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ba819133-c3ac-4bdb-9c78-8fa43fe34464 tempest-KeyPairsNegativeTestJSON-759592740 tempest-KeyPairsNegativeTestJSON-759592740-project] Action: 'create', calling method: .version_select at 0x7fe259277ca0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-2124114552", "public_key": " "}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:54.780354 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-ba819133-c3ac-4bdb-9c78-8fa43fe34464 tempest-KeyPairsNegativeTestJSON-759592740 tempest-KeyPairsNegativeTestJSON-759592740-project] Getting quotas for project 27024471ee3947ceb1a8f000ac401301. Resources: {'key_pairs'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:32:54.786047 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-ba819133-c3ac-4bdb-9c78-8fa43fe34464 tempest-KeyPairsNegativeTestJSON-759592740 tempest-KeyPairsNegativeTestJSON-759592740-project] Getting quotas for user 2df39449781a49038d4d2662e8538849 and project 27024471ee3947ceb1a8f000ac401301. Resources: {'key_pairs'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:32:54.822373 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-ba819133-c3ac-4bdb-9c78-8fa43fe34464 tempest-KeyPairsNegativeTestJSON-759592740 tempest-KeyPairsNegativeTestJSON-759592740-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 04 18:32:54.825090 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ba819133-c3ac-4bdb-9c78-8fa43fe34464 tempest-KeyPairsNegativeTestJSON-759592740 tempest-KeyPairsNegativeTestJSON-759592740-project] Request method failure captured: Oct 04 18:32:54.825090 n-d-850501-14 devstack@n-api.service[123002]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 04 18:32:54.825090 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:32:54.825090 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:32:54.825090 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:32:54.825090 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 95 Oct 04 18:32:54.825090 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:32:54.825090 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:32:54.825090 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:32:54.825090 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:54.825090 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPHxU8623ZenD4S896n6QJ9B1dAHFdOiSYkEpFMcGOGHRFVJTmjzNoOZegfDBMQYuktgM5UkmD4n7Mo6Gy5RXPrnNueJVYBf-twWdtDgIbmAd4sq-qldWS_hbZK9JFRf9-QJEjOVl1J9CmyKtodo5H5zq1QQgrwF0DqiQFJAxbHNAiec Oct 04 18:32:54.825090 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:32:54.825090 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:32:54.825090 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:32:54.825090 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:32:54.825090 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:32:54.825090 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:32:54.825090 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 27024471ee3947ceb1a8f000ac401301 Oct 04 18:32:54.825090 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-759592740 Oct 04 18:32:54.825090 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:32:54.825090 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:32:54.825090 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/27024471ee3947ceb1a8f000ac401301"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_27024471ee3947ceb1a8f000ac401301", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/27024471ee3947ceb1a8f000ac401301"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/27024471ee3947ceb1a8f000ac401301"}]}] Oct 04 18:32:54.825090 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-KeyPairsNegativeTestJSON-759592740 Oct 04 18:32:54.825090 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 27024471ee3947ceb1a8f000ac401301 Oct 04 18:32:54.825090 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-759592740 Oct 04 18:32:54.825090 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-KeyPairsNegativeTestJSON-759592740-project Oct 04 18:32:54.825090 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:32:54.825090 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:32:54.825090 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 2df39449781a49038d4d2662e8538849 Oct 04 18:32:54.825090 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-KeyPairsNegativeTestJSON-759592740-project Oct 04 18:32:54.825090 n-d-850501-14 devstack@n-api.service[123002]: Oct 04 18:32:54.825090 n-d-850501-14 devstack@n-api.service[123002]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-2124114552", "public_key": " "}} Oct 04 18:32:54.825090 n-d-850501-14 devstack@n-api.service[123002]: method: Oct 04 18:32:54.825090 n-d-850501-14 devstack@n-api.service[123002]: exception: Keypair data is invalid: failed to generate fingerprint Oct 04 18:32:54.825090 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-2124114552', 'public_key': ' '}}} Oct 04 18:32:54.825090 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:54.825090 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:54.825090 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 04 18:32:54.825090 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 04 18:32:54.825090 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Oct 04 18:32:54.825090 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Oct 04 18:32:54.825090 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Oct 04 18:32:54.825090 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:54.825090 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:54.825090 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:54.825090 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:54.825090 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 04 18:32:54.825090 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 04 18:32:54.825090 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 18:32:54.825090 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 18:32:54.825090 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:32:54.825090 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:32:54.825090 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:32:54.825090 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:32:54.825090 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 18:32:54.825090 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 18:32:54.825090 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 04 18:32:54.825090 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 04 18:32:54.825090 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 04 18:32:54.825090 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 04 18:32:54.825090 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 04 18:32:54.825090 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 04 18:32:54.825090 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 04 18:32:54.825090 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:54.825090 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:54.825090 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:54.830344 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:54.830344 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:54.830344 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:54.830344 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:54.830344 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:54.830344 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:32:54.830344 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:32:54.830344 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:54.830344 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:54.830344 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:32:54.830344 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:32:54.830344 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:32:54.830344 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:32:54.830344 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 04 18:32:54.830344 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 04 18:32:54.830344 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 04 18:32:54.830344 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 04 18:32:54.830344 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 04 18:32:54.830344 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:54.830344 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:54.830344 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:54.830344 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:54.830344 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:54.830344 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:54.830344 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:32:54.830344 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:32:54.830344 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 04 18:32:54.830344 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:54.834981 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ba819133-c3ac-4bdb-9c78-8fa43fe34464 tempest-KeyPairsNegativeTestJSON-759592740 tempest-KeyPairsNegativeTestJSON-759592740-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:54.841997 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ba819133-c3ac-4bdb-9c78-8fa43fe34464 tempest-KeyPairsNegativeTestJSON-759592740 tempest-KeyPairsNegativeTestJSON-759592740-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.094665 Oct 04 18:32:54.841997 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 659/1279] 10.222.0.20 () {60 vars in 1158 bytes} [Tue Oct 4 18:32:54 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 18:32:54.853908 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7087b237-8d8a-486e-96fb-a164366bf9e9 tempest-KeyPairsNegativeTestJSON-759592740 tempest-KeyPairsNegativeTestJSON-759592740-project] Action: 'create', calling method: .version_select at 0x7fe259ae79d0>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBNw1r6bd82V52NFD+5HyggSQgWRKJnc28OOlMLoYh3J5UwCA1qG8iDE0NCbFtQFmFhUtmJllCq2VNkjz5VMiyCHCeEAVQ7eTkyI+FWj923qkNAhjDJc9TqrmN4ScsNvxA=="}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:54.860430 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7087b237-8d8a-486e-96fb-a164366bf9e9 tempest-KeyPairsNegativeTestJSON-759592740 tempest-KeyPairsNegativeTestJSON-759592740-project] Request method failure captured: Oct 04 18:32:54.860430 n-d-850501-14 devstack@n-api.service[123002]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 04 18:32:54.860430 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:32:54.860430 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:32:54.860430 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:32:54.860430 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 507 Oct 04 18:32:54.860430 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:32:54.860430 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:32:54.860430 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:32:54.860430 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:54.860430 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPHxU8623ZenD4S896n6QJ9B1dAHFdOiSYkEpFMcGOGHRFVJTmjzNoOZegfDBMQYuktgM5UkmD4n7Mo6Gy5RXPrnNueJVYBf-twWdtDgIbmAd4sq-qldWS_hbZK9JFRf9-QJEjOVl1J9CmyKtodo5H5zq1QQgrwF0DqiQFJAxbHNAiec Oct 04 18:32:54.860430 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:32:54.860430 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:32:54.860430 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:32:54.860430 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:32:54.860430 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:32:54.860430 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:32:54.860430 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 27024471ee3947ceb1a8f000ac401301 Oct 04 18:32:54.860430 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-759592740 Oct 04 18:32:54.860430 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:32:54.860430 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:32:54.860430 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/27024471ee3947ceb1a8f000ac401301"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_27024471ee3947ceb1a8f000ac401301", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/27024471ee3947ceb1a8f000ac401301"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/27024471ee3947ceb1a8f000ac401301"}]}] Oct 04 18:32:54.860430 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-KeyPairsNegativeTestJSON-759592740 Oct 04 18:32:54.860430 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 27024471ee3947ceb1a8f000ac401301 Oct 04 18:32:54.860430 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-759592740 Oct 04 18:32:54.860430 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-KeyPairsNegativeTestJSON-759592740-project Oct 04 18:32:54.860430 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:32:54.860430 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:32:54.860430 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 2df39449781a49038d4d2662e8538849 Oct 04 18:32:54.860430 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-KeyPairsNegativeTestJSON-759592740-project Oct 04 18:32:54.860430 n-d-850501-14 devstack@n-api.service[123002]: Oct 04 18:32:54.860430 n-d-850501-14 devstack@n-api.service[123002]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBNw1r6bd82V52NFD+5HyggSQgWRKJnc28OOlMLoYh3J5UwCA1qG8iDE0NCbFtQFmFhUtmJllCq2VNkjz5VMiyCHCeEAVQ7eTkyI+FWj923qkNAhjDJc9TqrmN4ScsNvxA=="}} Oct 04 18:32:54.860430 n-d-850501-14 devstack@n-api.service[123002]: method: Oct 04 18:32:54.860430 n-d-850501-14 devstack@n-api.service[123002]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 04 18:32:54.860430 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBNw1r6bd82V52NFD+5HyggSQgWRKJnc28OOlMLoYh3J5UwCA1qG8iDE0NCbFtQFmFhUtmJllCq2VNkjz5VMiyCHCeEAVQ7eTkyI+FWj923qkNAhjDJc9TqrmN4ScsNvxA=='}}} Oct 04 18:32:54.860430 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:54.860430 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:54.860430 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:32:54.860430 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:32:54.860430 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:32:54.860430 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:32:54.860430 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 04 18:32:54.860430 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:54.860430 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 04 18:32:54.860430 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 18:32:54.860430 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:54.860430 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 04 18:32:54.860430 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Oct 04 18:32:54.871577 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:54.871577 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:54.871577 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:54.871577 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:54.871577 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:54.871577 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:54.871577 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:54.871577 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:54.871577 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:32:54.871577 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:32:54.871577 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:54.871577 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:54.871577 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:32:54.871577 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:32:54.871577 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:32:54.871577 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:32:54.871577 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:32:54.871577 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:32:54.871577 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:32:54.871577 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:32:54.871577 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 04 18:32:54.871577 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:54.871577 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:54.871577 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:54.871577 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:54.871577 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:54.871577 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:54.871577 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:32:54.871577 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:32:54.871577 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 04 18:32:54.871577 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:54.871577 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7087b237-8d8a-486e-96fb-a164366bf9e9 tempest-KeyPairsNegativeTestJSON-759592740 tempest-KeyPairsNegativeTestJSON-759592740-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:54.871577 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7087b237-8d8a-486e-96fb-a164366bf9e9 tempest-KeyPairsNegativeTestJSON-759592740 tempest-KeyPairsNegativeTestJSON-759592740-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.014612 Oct 04 18:32:54.871577 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 660/1280] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Oct 4 18:32:54 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 04 18:32:54.881189 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2f880a03-63fe-4f94-9639-d48eba74b8dc tempest-KeyPairsNegativeTestJSON-759592740 tempest-KeyPairsNegativeTestJSON-759592740-project] Action: 'create', calling method: .version_select at 0x7fe25d31af70>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1529819130", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:54.909683 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-2f880a03-63fe-4f94-9639-d48eba74b8dc tempest-KeyPairsNegativeTestJSON-759592740 tempest-KeyPairsNegativeTestJSON-759592740-project] Getting quotas for project 27024471ee3947ceb1a8f000ac401301. Resources: {'key_pairs'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:32:54.916964 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-2f880a03-63fe-4f94-9639-d48eba74b8dc tempest-KeyPairsNegativeTestJSON-759592740 tempest-KeyPairsNegativeTestJSON-759592740-project] Getting quotas for user 2df39449781a49038d4d2662e8538849 and project 27024471ee3947ceb1a8f000ac401301. Resources: {'key_pairs'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:32:54.935805 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-2f880a03-63fe-4f94-9639-d48eba74b8dc tempest-KeyPairsNegativeTestJSON-759592740 tempest-KeyPairsNegativeTestJSON-759592740-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 04 18:32:54.938230 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2f880a03-63fe-4f94-9639-d48eba74b8dc tempest-KeyPairsNegativeTestJSON-759592740 tempest-KeyPairsNegativeTestJSON-759592740-project] Request method failure captured: Oct 04 18:32:54.938230 n-d-850501-14 devstack@n-api.service[123002]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 04 18:32:54.938230 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:32:54.938230 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:32:54.938230 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:32:54.938230 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 118 Oct 04 18:32:54.938230 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:32:54.938230 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:32:54.938230 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:32:54.938230 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:54.938230 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPHxU8623ZenD4S896n6QJ9B1dAHFdOiSYkEpFMcGOGHRFVJTmjzNoOZegfDBMQYuktgM5UkmD4n7Mo6Gy5RXPrnNueJVYBf-twWdtDgIbmAd4sq-qldWS_hbZK9JFRf9-QJEjOVl1J9CmyKtodo5H5zq1QQgrwF0DqiQFJAxbHNAiec Oct 04 18:32:54.938230 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:32:54.938230 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:32:54.938230 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:32:54.938230 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:32:54.938230 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:32:54.938230 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:32:54.938230 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 27024471ee3947ceb1a8f000ac401301 Oct 04 18:32:54.938230 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-759592740 Oct 04 18:32:54.938230 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:32:54.938230 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:32:54.938230 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/27024471ee3947ceb1a8f000ac401301"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_27024471ee3947ceb1a8f000ac401301", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/27024471ee3947ceb1a8f000ac401301"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/27024471ee3947ceb1a8f000ac401301"}]}] Oct 04 18:32:54.938230 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-KeyPairsNegativeTestJSON-759592740 Oct 04 18:32:54.938230 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 27024471ee3947ceb1a8f000ac401301 Oct 04 18:32:54.938230 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-759592740 Oct 04 18:32:54.938230 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-KeyPairsNegativeTestJSON-759592740-project Oct 04 18:32:54.938230 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:32:54.938230 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:32:54.938230 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 2df39449781a49038d4d2662e8538849 Oct 04 18:32:54.938230 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-KeyPairsNegativeTestJSON-759592740-project Oct 04 18:32:54.938230 n-d-850501-14 devstack@n-api.service[123002]: Oct 04 18:32:54.938230 n-d-850501-14 devstack@n-api.service[123002]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1529819130", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Oct 04 18:32:54.938230 n-d-850501-14 devstack@n-api.service[123002]: method: Oct 04 18:32:54.938230 n-d-850501-14 devstack@n-api.service[123002]: exception: Keypair data is invalid: failed to generate fingerprint Oct 04 18:32:54.938230 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1529819130', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Oct 04 18:32:54.938230 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:54.938230 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:54.938230 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 04 18:32:54.938230 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 04 18:32:54.938230 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Oct 04 18:32:54.938230 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Oct 04 18:32:54.938230 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Oct 04 18:32:54.938230 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Oct 04 18:32:54.938230 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Oct 04 18:32:54.938230 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Oct 04 18:32:54.938230 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Oct 04 18:32:54.938230 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:54.938230 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:54.938230 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:54.938230 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:54.938230 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 04 18:32:54.938230 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 04 18:32:54.938230 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 18:32:54.938230 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 18:32:54.938230 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:32:54.938230 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:32:54.938230 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:32:54.938230 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:32:54.938230 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 18:32:54.938230 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 18:32:54.938230 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 04 18:32:54.938230 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 04 18:32:54.938230 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 04 18:32:54.938230 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 04 18:32:54.944198 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 04 18:32:54.944198 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 04 18:32:54.944198 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 04 18:32:54.944198 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:54.944198 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:54.944198 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:54.944198 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:54.944198 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:54.944198 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:54.944198 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:54.944198 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:54.944198 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:32:54.944198 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:32:54.944198 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:54.944198 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:54.944198 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:32:54.944198 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:32:54.944198 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:32:54.944198 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:32:54.944198 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 04 18:32:54.944198 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 04 18:32:54.944198 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 04 18:32:54.944198 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 04 18:32:54.944198 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 04 18:32:54.944198 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:54.944198 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:54.944198 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:54.944198 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:54.944198 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:54.944198 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:54.944198 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:32:54.944198 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:32:54.944198 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 04 18:32:54.944198 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:54.958248 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2f880a03-63fe-4f94-9639-d48eba74b8dc tempest-KeyPairsNegativeTestJSON-759592740 tempest-KeyPairsNegativeTestJSON-759592740-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:54.958248 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2f880a03-63fe-4f94-9639-d48eba74b8dc tempest-KeyPairsNegativeTestJSON-759592740 tempest-KeyPairsNegativeTestJSON-759592740-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.076405 Oct 04 18:32:54.958248 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 661/1281] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Oct 4 18:32:54 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 78 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 18:32:54.973902 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-464181b6-6660-43d7-996f-018671b37a60 tempest-KeyPairsNegativeTestJSON-759592740 tempest-KeyPairsNegativeTestJSON-759592740-project] Calling method '.version_select at 0x7fe259277af0>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:54.990879 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-464181b6-6660-43d7-996f-018671b37a60 tempest-KeyPairsNegativeTestJSON-759592740 tempest-KeyPairsNegativeTestJSON-759592740-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-695828102 not found for user 2df39449781a49038d4d2662e8538849 Oct 04 18:32:54.993223 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-464181b6-6660-43d7-996f-018671b37a60 tempest-KeyPairsNegativeTestJSON-759592740 tempest-KeyPairsNegativeTestJSON-759592740-project] Request method failure captured: Oct 04 18:32:54.993223 n-d-850501-14 devstack@n-api.service[123002]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-695828102 HTTP/1.1 Oct 04 18:32:54.993223 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:32:54.993223 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:32:54.993223 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:32:54.993223 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:32:54.993223 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:32:54.993223 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:32:54.993223 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:32:54.993223 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:54.993223 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPHxU8623ZenD4S896n6QJ9B1dAHFdOiSYkEpFMcGOGHRFVJTmjzNoOZegfDBMQYuktgM5UkmD4n7Mo6Gy5RXPrnNueJVYBf-twWdtDgIbmAd4sq-qldWS_hbZK9JFRf9-QJEjOVl1J9CmyKtodo5H5zq1QQgrwF0DqiQFJAxbHNAiec Oct 04 18:32:54.993223 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:32:54.993223 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:32:54.993223 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:32:54.993223 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:32:54.993223 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:32:54.993223 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:32:54.993223 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 27024471ee3947ceb1a8f000ac401301 Oct 04 18:32:54.993223 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-759592740 Oct 04 18:32:54.993223 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:32:54.993223 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:32:54.993223 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/27024471ee3947ceb1a8f000ac401301"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_27024471ee3947ceb1a8f000ac401301", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/27024471ee3947ceb1a8f000ac401301"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/27024471ee3947ceb1a8f000ac401301"}]}] Oct 04 18:32:54.993223 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-KeyPairsNegativeTestJSON-759592740 Oct 04 18:32:54.993223 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 27024471ee3947ceb1a8f000ac401301 Oct 04 18:32:54.993223 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-759592740 Oct 04 18:32:54.993223 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-KeyPairsNegativeTestJSON-759592740-project Oct 04 18:32:54.993223 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:32:54.993223 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:32:54.993223 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 2df39449781a49038d4d2662e8538849 Oct 04 18:32:54.993223 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-KeyPairsNegativeTestJSON-759592740-project Oct 04 18:32:54.993223 n-d-850501-14 devstack@n-api.service[123002]: method: Oct 04 18:32:54.993223 n-d-850501-14 devstack@n-api.service[123002]: exception: Keypair tempest-keypair-non-existent-695828102 not found for user 2df39449781a49038d4d2662e8538849 Oct 04 18:32:54.993223 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'tempest-keypair-non-existent-695828102'} Oct 04 18:32:54.993223 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:54.993223 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:54.993223 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Oct 04 18:32:54.993223 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Oct 04 18:32:54.993223 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 18:32:54.993223 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 18:32:54.993223 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:32:54.993223 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:32:54.993223 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:32:54.993223 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:32:54.993223 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 18:32:54.993223 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 18:32:54.993223 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6861, in delete_key_pair Oct 04 18:32:54.993223 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Oct 04 18:32:54.993223 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6882, in get_key_pair Oct 04 18:32:54.993223 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Oct 04 18:32:54.993223 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:32:54.993223 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:32:54.993223 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 04 18:32:54.993223 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 04 18:32:54.993223 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 04 18:32:54.993223 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 04 18:32:54.993223 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:32:54.993223 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:32:54.993223 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 04 18:32:54.993223 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 04 18:32:54.993223 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-695828102 not found for user 2df39449781a49038d4d2662e8538849 Oct 04 18:32:54.993223 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:54.993223 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:55.000940 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:55.000940 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:55.000940 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:55.000940 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:55.000940 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:55.000940 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:55.000940 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:32:55.000940 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:32:55.000940 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:32:55.000940 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:32:55.000940 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:55.000940 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:55.000940 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Oct 04 18:32:55.000940 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self._delete(req, id) Oct 04 18:32:55.000940 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Oct 04 18:32:55.000940 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Oct 04 18:32:55.000940 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-695828102 not found for user 2df39449781a49038d4d2662e8538849 Oct 04 18:32:55.000940 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:55.000940 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:55.000940 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:55.000940 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:55.000940 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:55.000940 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:55.000940 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:32:55.000940 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:32:55.000940 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-695828102 not found for user 2df39449781a49038d4d2662e8538849 Oct 04 18:32:55.000940 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:32:55.000940 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-464181b6-6660-43d7-996f-018671b37a60 tempest-KeyPairsNegativeTestJSON-759592740 tempest-KeyPairsNegativeTestJSON-759592740-project] Returning 404 to user: Keypair tempest-keypair-non-existent-695828102 not found for user 2df39449781a49038d4d2662e8538849 {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:55.000940 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-464181b6-6660-43d7-996f-018671b37a60 tempest-KeyPairsNegativeTestJSON-759592740 tempest-KeyPairsNegativeTestJSON-759592740-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-695828102" status: 404 len: 144 microversion: 2.1 time: 0.031865 Oct 04 18:32:55.000940 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 662/1282] 10.222.0.20 () {58 vars in 1257 bytes} [Tue Oct 4 18:32:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-695828102 => generated 144 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:32:55.029738 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-60cc75ca-5679-4904-9115-e9ad6a4df640 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89f12d146749b38c688b7581e53f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247c7ae3e4e4068a88a044e36945f32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:55.044840 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-60cc75ca-5679-4904-9115-e9ad6a4df640 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] 10.222.0.20 "GET /compute/v2.1/servers/5e154d65-5086-47c1-bba7-ea3dfd53f6e6" status: 200 len: 1609 microversion: 2.1 time: 0.516512 Oct 04 18:32:55.060095 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 621/1283] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:54 2022] GET /compute/v2.1/servers/5e154d65-5086-47c1-bba7-ea3dfd53f6e6 => generated 1609 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:55.273062 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-cdb3afeb-4472-451d-aa5c-9aaf4f17bab1 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:55.274021 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-cdb3afeb-4472-451d-aa5c-9aaf4f17bab1 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: c8c84d9e-2274-49dd-99e9-cbd7222c22d5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:55.280345 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cdb3afeb-4472-451d-aa5c-9aaf4f17bab1 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:55.280937 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cdb3afeb-4472-451d-aa5c-9aaf4f17bab1 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:55.281465 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cdb3afeb-4472-451d-aa5c-9aaf4f17bab1 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:55.282234 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cdb3afeb-4472-451d-aa5c-9aaf4f17bab1 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:55.282828 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cdb3afeb-4472-451d-aa5c-9aaf4f17bab1 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:55.283317 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cdb3afeb-4472-451d-aa5c-9aaf4f17bab1 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:55.352566 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-cdb3afeb-4472-451d-aa5c-9aaf4f17bab1 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:55.365824 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-cdb3afeb-4472-451d-aa5c-9aaf4f17bab1 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/c8c84d9e-2274-49dd-99e9-cbd7222c22d5" status: 200 len: 1203 microversion: 2.1 time: 0.097451 Oct 04 18:32:55.376131 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 663/1284] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:55 2022] GET /compute/v2.1/servers/c8c84d9e-2274-49dd-99e9-cbd7222c22d5 => generated 1203 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:55.745973 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-cc91eca5-37e2-4ade-9d2a-8b0a4a218889 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:55.747253 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-cc91eca5-37e2-4ade-9d2a-8b0a4a218889 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 158e9f52-fd16-48d1-87b5-e0dd523e97a4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:55.758907 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cc91eca5-37e2-4ade-9d2a-8b0a4a218889 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:55.759727 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cc91eca5-37e2-4ade-9d2a-8b0a4a218889 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:55.760433 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cc91eca5-37e2-4ade-9d2a-8b0a4a218889 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:55.761483 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cc91eca5-37e2-4ade-9d2a-8b0a4a218889 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:55.769246 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cc91eca5-37e2-4ade-9d2a-8b0a4a218889 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:55.769246 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cc91eca5-37e2-4ade-9d2a-8b0a4a218889 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:55.925390 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-57905bb8-d1dd-4281-a60f-fdb256a75eb2 req-dba52e57-bc64-4a9e-a56e-2a896efa26f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cd68f0f-4385-45c4-8dd0-8f33a5a9e527", "name": "network-vif-deleted", "tag": "e0c9983a-03a1-4137-9aaf-8dc3ac6e4cb0"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:55.950652 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-57905bb8-d1dd-4281-a60f-fdb256a75eb2 req-dba52e57-bc64-4a9e-a56e-2a896efa26f0 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:55.957428 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-57905bb8-d1dd-4281-a60f-fdb256a75eb2 req-dba52e57-bc64-4a9e-a56e-2a896efa26f0 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:55.959866 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-57905bb8-d1dd-4281-a60f-fdb256a75eb2 req-dba52e57-bc64-4a9e-a56e-2a896efa26f0 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:55.987685 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-57905bb8-d1dd-4281-a60f-fdb256a75eb2 req-dba52e57-bc64-4a9e-a56e-2a896efa26f0 service nova] Creating event network-vif-deleted:e0c9983a-03a1-4137-9aaf-8dc3ac6e4cb0 for instance 0cd68f0f-4385-45c4-8dd0-8f33a5a9e527 on n-h2-850501-14 Oct 04 18:32:55.993755 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-57905bb8-d1dd-4281-a60f-fdb256a75eb2 req-dba52e57-bc64-4a9e-a56e-2a896efa26f0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072521 Oct 04 18:32:55.995098 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 664/1285] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:32:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:32:56.075652 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9be1c75b-9e61-4502-a970-84681a280595 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:56.077183 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9be1c75b-9e61-4502-a970-84681a280595 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] [instance: 5e154d65-5086-47c1-bba7-ea3dfd53f6e6] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:56.093923 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9be1c75b-9e61-4502-a970-84681a280595 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:56.094360 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9be1c75b-9e61-4502-a970-84681a280595 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:56.094799 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9be1c75b-9e61-4502-a970-84681a280595 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:56.095541 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9be1c75b-9e61-4502-a970-84681a280595 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:56.105220 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9be1c75b-9e61-4502-a970-84681a280595 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:56.105220 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9be1c75b-9e61-4502-a970-84681a280595 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:56.141001 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:56.321302 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9be1c75b-9e61-4502-a970-84681a280595 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89f12d146749b38c688b7581e53f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247c7ae3e4e4068a88a044e36945f32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:56.332255 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9be1c75b-9e61-4502-a970-84681a280595 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] 10.222.0.20 "GET /compute/v2.1/servers/5e154d65-5086-47c1-bba7-ea3dfd53f6e6" status: 200 len: 1541 microversion: 2.1 time: 0.262607 Oct 04 18:32:56.333432 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 665/1286] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:56 2022] GET /compute/v2.1/servers/5e154d65-5086-47c1-bba7-ea3dfd53f6e6 => generated 1541 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:56.389886 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-34bc107b-b8cf-45d9-9c99-ccb5fb0685b9 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:56.390528 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-34bc107b-b8cf-45d9-9c99-ccb5fb0685b9 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: c8c84d9e-2274-49dd-99e9-cbd7222c22d5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:56.401078 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-34bc107b-b8cf-45d9-9c99-ccb5fb0685b9 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:56.403209 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-34bc107b-b8cf-45d9-9c99-ccb5fb0685b9 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:56.403814 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-34bc107b-b8cf-45d9-9c99-ccb5fb0685b9 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:56.405314 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-34bc107b-b8cf-45d9-9c99-ccb5fb0685b9 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:56.410082 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-34bc107b-b8cf-45d9-9c99-ccb5fb0685b9 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:56.410656 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-34bc107b-b8cf-45d9-9c99-ccb5fb0685b9 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:56.451000 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-cc91eca5-37e2-4ade-9d2a-8b0a4a218889 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:56.466287 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-cc91eca5-37e2-4ade-9d2a-8b0a4a218889 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4" status: 200 len: 1360 microversion: 2.1 time: 0.726038 Oct 04 18:32:56.467321 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 622/1287] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:55 2022] GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4 => generated 1360 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:56.572702 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-34bc107b-b8cf-45d9-9c99-ccb5fb0685b9 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:56.589354 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-34bc107b-b8cf-45d9-9c99-ccb5fb0685b9 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/c8c84d9e-2274-49dd-99e9-cbd7222c22d5" status: 200 len: 1267 microversion: 2.1 time: 0.203336 Oct 04 18:32:56.592948 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 666/1288] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:56 2022] GET /compute/v2.1/servers/c8c84d9e-2274-49dd-99e9-cbd7222c22d5 => generated 1267 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:32:56.876042 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1fc79d11-254d-4ca3-abc2-18159ddd8eba tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-887899869", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": "none"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:56.971047 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-1fc79d11-254d-4ca3-abc2-18159ddd8eba tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:32:56.972879 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-1fc79d11-254d-4ca3-abc2-18159ddd8eba tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:32:56.972879 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-1fc79d11-254d-4ca3-abc2-18159ddd8eba tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:32:56.973262 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-1fc79d11-254d-4ca3-abc2-18159ddd8eba tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:32:56.973772 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-1fc79d11-254d-4ca3-abc2-18159ddd8eba tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:32:56.983997 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1fc79d11-254d-4ca3-abc2-18159ddd8eba tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:56.984669 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1fc79d11-254d-4ca3-abc2-18159ddd8eba tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:56.985177 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1fc79d11-254d-4ca3-abc2-18159ddd8eba tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:56.985989 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1fc79d11-254d-4ca3-abc2-18159ddd8eba tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:56.986648 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1fc79d11-254d-4ca3-abc2-18159ddd8eba tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:56.987150 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1fc79d11-254d-4ca3-abc2-18159ddd8eba tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:57.000132 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=4,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:57.007959 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-1fc79d11-254d-4ca3-abc2-18159ddd8eba tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Getting quotas for project 0bba928e5c484bd886efd007b93878ff. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:32:57.013297 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-1fc79d11-254d-4ca3-abc2-18159ddd8eba tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Getting quotas for user 5c4125e047784f3684a6688e78aa6b8d and project 0bba928e5c484bd886efd007b93878ff. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:32:57.026189 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1fc79d11-254d-4ca3-abc2-18159ddd8eba tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Going to run 1 instances... {{(pid=123001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:32:57.028669 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1fc79d11-254d-4ca3-abc2-18159ddd8eba tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:32:57.195982 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1fc79d11-254d-4ca3-abc2-18159ddd8eba tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 0.623085 Oct 04 18:32:57.197240 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 623/1289] 10.222.0.20 () {62 vars in 1188 bytes} [Tue Oct 4 18:32:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 625 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 18:32:57.208167 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e1342b94-ef24-44a4-9de2-22e51083be42 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:57.210332 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e1342b94-ef24-44a4-9de2-22e51083be42 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:57.278089 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e1342b94-ef24-44a4-9de2-22e51083be42 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:57.290299 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e1342b94-ef24-44a4-9de2-22e51083be42 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:57.292424 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e1342b94-ef24-44a4-9de2-22e51083be42 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:57.304509 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e1342b94-ef24-44a4-9de2-22e51083be42 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1452 microversion: 2.91 time: 0.100088 Oct 04 18:32:57.305425 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 667/1290] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:32:57 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1452 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:32:57.359022 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-da79777e-e226-425f-b693-981635109825 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:57.360552 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-da79777e-e226-425f-b693-981635109825 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] [instance: 5e154d65-5086-47c1-bba7-ea3dfd53f6e6] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:57.370180 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-da79777e-e226-425f-b693-981635109825 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:57.370828 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-da79777e-e226-425f-b693-981635109825 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:57.371423 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-da79777e-e226-425f-b693-981635109825 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:57.372851 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-da79777e-e226-425f-b693-981635109825 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:57.373476 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-da79777e-e226-425f-b693-981635109825 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:57.374446 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-da79777e-e226-425f-b693-981635109825 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:57.490656 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-cf1d30c7-8636-4d37-aaca-d51aca6e976d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:57.491502 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-cf1d30c7-8636-4d37-aaca-d51aca6e976d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 158e9f52-fd16-48d1-87b5-e0dd523e97a4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:57.523288 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cf1d30c7-8636-4d37-aaca-d51aca6e976d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:57.524000 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cf1d30c7-8636-4d37-aaca-d51aca6e976d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:57.526232 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cf1d30c7-8636-4d37-aaca-d51aca6e976d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:57.529139 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cf1d30c7-8636-4d37-aaca-d51aca6e976d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:57.531703 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cf1d30c7-8636-4d37-aaca-d51aca6e976d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:57.532334 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cf1d30c7-8636-4d37-aaca-d51aca6e976d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:57.551798 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-da79777e-e226-425f-b693-981635109825 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89f12d146749b38c688b7581e53f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247c7ae3e4e4068a88a044e36945f32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:57.568963 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-da79777e-e226-425f-b693-981635109825 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] 10.222.0.20 "GET /compute/v2.1/servers/5e154d65-5086-47c1-bba7-ea3dfd53f6e6" status: 200 len: 1541 microversion: 2.1 time: 0.213532 Oct 04 18:32:57.573236 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 624/1291] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:57 2022] GET /compute/v2.1/servers/5e154d65-5086-47c1-bba7-ea3dfd53f6e6 => generated 1541 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:57.619077 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ac693de2-dce7-42df-88f7-906b50e535d9 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:57.625286 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ac693de2-dce7-42df-88f7-906b50e535d9 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: c8c84d9e-2274-49dd-99e9-cbd7222c22d5] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:57.642428 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ac693de2-dce7-42df-88f7-906b50e535d9 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:57.643326 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ac693de2-dce7-42df-88f7-906b50e535d9 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:57.645276 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ac693de2-dce7-42df-88f7-906b50e535d9 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:57.650021 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ac693de2-dce7-42df-88f7-906b50e535d9 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:57.650768 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ac693de2-dce7-42df-88f7-906b50e535d9 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:57.651428 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ac693de2-dce7-42df-88f7-906b50e535d9 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:57.838901 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ac693de2-dce7-42df-88f7-906b50e535d9 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:57.850942 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ac693de2-dce7-42df-88f7-906b50e535d9 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/c8c84d9e-2274-49dd-99e9-cbd7222c22d5" status: 200 len: 1265 microversion: 2.1 time: 0.239284 Oct 04 18:32:57.853120 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 625/1292] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:57 2022] GET /compute/v2.1/servers/c8c84d9e-2274-49dd-99e9-cbd7222c22d5 => generated 1265 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:57.969742 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-cf1d30c7-8636-4d37-aaca-d51aca6e976d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:57.988906 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-cf1d30c7-8636-4d37-aaca-d51aca6e976d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4" status: 200 len: 1360 microversion: 2.1 time: 0.498947 Oct 04 18:32:57.992112 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 668/1293] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:57 2022] GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4 => generated 1360 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:32:58.017026 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-ddf7163f-7c08-44b8-aa94-1eaa74916d6d req-8c98fc61-e0e5-492a-b567-8a1068831539 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e154d65-5086-47c1-bba7-ea3dfd53f6e6", "name": "network-vif-deleted", "tag": "1eb398e0-da63-4b45-bace-cc05ff4d0f6f"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:58.044893 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-ddf7163f-7c08-44b8-aa94-1eaa74916d6d req-8c98fc61-e0e5-492a-b567-8a1068831539 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:58.052176 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-ddf7163f-7c08-44b8-aa94-1eaa74916d6d req-8c98fc61-e0e5-492a-b567-8a1068831539 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:58.053991 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-ddf7163f-7c08-44b8-aa94-1eaa74916d6d req-8c98fc61-e0e5-492a-b567-8a1068831539 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:58.087669 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-ddf7163f-7c08-44b8-aa94-1eaa74916d6d req-8c98fc61-e0e5-492a-b567-8a1068831539 service nova] Creating event network-vif-deleted:1eb398e0-da63-4b45-bace-cc05ff4d0f6f for instance 5e154d65-5086-47c1-bba7-ea3dfd53f6e6 on n-h2-850501-14 Oct 04 18:32:58.104261 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-ddf7163f-7c08-44b8-aa94-1eaa74916d6d req-8c98fc61-e0e5-492a-b567-8a1068831539 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090950 Oct 04 18:32:58.118157 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 626/1294] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:32:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:58.337207 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e150bf62-f3b2-4953-a850-f717942a4da8 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:58.337831 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e150bf62-f3b2-4953-a850-f717942a4da8 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:58.486963 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e150bf62-f3b2-4953-a850-f717942a4da8 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:58.504145 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e150bf62-f3b2-4953-a850-f717942a4da8 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:58.506184 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e150bf62-f3b2-4953-a850-f717942a4da8 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:58.522344 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e150bf62-f3b2-4953-a850-f717942a4da8 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1452 microversion: 2.91 time: 0.191070 Oct 04 18:32:58.525238 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 669/1295] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:32:58 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1452 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:32:58.599676 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f4c76c31-e8cb-48b0-aa15-781e8a973b43 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:58.602159 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f4c76c31-e8cb-48b0-aa15-781e8a973b43 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] [instance: 5e154d65-5086-47c1-bba7-ea3dfd53f6e6] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:58.630273 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f4c76c31-e8cb-48b0-aa15-781e8a973b43 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:58.633348 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f4c76c31-e8cb-48b0-aa15-781e8a973b43 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:58.634191 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f4c76c31-e8cb-48b0-aa15-781e8a973b43 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:58.636723 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f4c76c31-e8cb-48b0-aa15-781e8a973b43 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:58.641895 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f4c76c31-e8cb-48b0-aa15-781e8a973b43 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:58.641895 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f4c76c31-e8cb-48b0-aa15-781e8a973b43 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:58.788419 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f4c76c31-e8cb-48b0-aa15-781e8a973b43 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89f12d146749b38c688b7581e53f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247c7ae3e4e4068a88a044e36945f32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:58.803592 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f4c76c31-e8cb-48b0-aa15-781e8a973b43 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] 10.222.0.20 "GET /compute/v2.1/servers/5e154d65-5086-47c1-bba7-ea3dfd53f6e6" status: 200 len: 1252 microversion: 2.1 time: 0.210597 Oct 04 18:32:58.820156 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 627/1296] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:58 2022] GET /compute/v2.1/servers/5e154d65-5086-47c1-bba7-ea3dfd53f6e6 => generated 1252 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:58.876927 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c6272853-a8e9-48c2-8dbe-50921c1feeee tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:58.877780 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c6272853-a8e9-48c2-8dbe-50921c1feeee tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: c8c84d9e-2274-49dd-99e9-cbd7222c22d5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:58.919058 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c6272853-a8e9-48c2-8dbe-50921c1feeee tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:58.919602 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c6272853-a8e9-48c2-8dbe-50921c1feeee tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:58.920129 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c6272853-a8e9-48c2-8dbe-50921c1feeee tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:58.921137 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c6272853-a8e9-48c2-8dbe-50921c1feeee tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:58.921785 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c6272853-a8e9-48c2-8dbe-50921c1feeee tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:58.922377 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c6272853-a8e9-48c2-8dbe-50921c1feeee tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:59.013614 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a49d61cd-60e9-494f-a06b-877cdd1c1d99 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:59.014236 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a49d61cd-60e9-494f-a06b-877cdd1c1d99 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 158e9f52-fd16-48d1-87b5-e0dd523e97a4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:59.034399 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a49d61cd-60e9-494f-a06b-877cdd1c1d99 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:59.034965 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a49d61cd-60e9-494f-a06b-877cdd1c1d99 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:59.041073 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a49d61cd-60e9-494f-a06b-877cdd1c1d99 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:59.041855 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a49d61cd-60e9-494f-a06b-877cdd1c1d99 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:59.042333 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a49d61cd-60e9-494f-a06b-877cdd1c1d99 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:59.042763 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a49d61cd-60e9-494f-a06b-877cdd1c1d99 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:59.269391 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c6272853-a8e9-48c2-8dbe-50921c1feeee tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:59.280867 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c6272853-a8e9-48c2-8dbe-50921c1feeee tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/c8c84d9e-2274-49dd-99e9-cbd7222c22d5" status: 200 len: 1307 microversion: 2.1 time: 0.408401 Oct 04 18:32:59.282439 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 670/1297] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:58 2022] GET /compute/v2.1/servers/c8c84d9e-2274-49dd-99e9-cbd7222c22d5 => generated 1307 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:59.461006 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a49d61cd-60e9-494f-a06b-877cdd1c1d99 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:59.474814 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a49d61cd-60e9-494f-a06b-877cdd1c1d99 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4" status: 200 len: 1360 microversion: 2.1 time: 0.463144 Oct 04 18:32:59.475507 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 628/1298] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:59 2022] GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4 => generated 1360 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:59.550963 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f62f4b46-3268-4b9b-a529-e7b7dad0ccde tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:59.551545 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f62f4b46-3268-4b9b-a529-e7b7dad0ccde tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:59.573300 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f62f4b46-3268-4b9b-a529-e7b7dad0ccde tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:59.574407 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f62f4b46-3268-4b9b-a529-e7b7dad0ccde tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:59.581468 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f62f4b46-3268-4b9b-a529-e7b7dad0ccde tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:59.585237 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f62f4b46-3268-4b9b-a529-e7b7dad0ccde tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:59.585918 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f62f4b46-3268-4b9b-a529-e7b7dad0ccde tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:59.587643 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f62f4b46-3268-4b9b-a529-e7b7dad0ccde tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:59.829836 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-89181599-bcf2-4011-b3eb-fce163c86179 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:59.831182 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-89181599-bcf2-4011-b3eb-fce163c86179 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] [instance: 5e154d65-5086-47c1-bba7-ea3dfd53f6e6] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:59.841280 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-89181599-bcf2-4011-b3eb-fce163c86179 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:59.856797 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-89181599-bcf2-4011-b3eb-fce163c86179 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:59.857657 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-89181599-bcf2-4011-b3eb-fce163c86179 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:59.858812 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-89181599-bcf2-4011-b3eb-fce163c86179 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:59.859643 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-89181599-bcf2-4011-b3eb-fce163c86179 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:59.860296 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-89181599-bcf2-4011-b3eb-fce163c86179 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:59.993345 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f62f4b46-3268-4b9b-a529-e7b7dad0ccde tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:00.026054 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f62f4b46-3268-4b9b-a529-e7b7dad0ccde tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:00.039633 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f62f4b46-3268-4b9b-a529-e7b7dad0ccde tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:00.055041 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f62f4b46-3268-4b9b-a529-e7b7dad0ccde tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1504 microversion: 2.91 time: 0.508113 Oct 04 18:33:00.059232 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 671/1299] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:32:59 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1504 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:00.080997 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-89181599-bcf2-4011-b3eb-fce163c86179 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89f12d146749b38c688b7581e53f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247c7ae3e4e4068a88a044e36945f32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:00.109503 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-89181599-bcf2-4011-b3eb-fce163c86179 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] 10.222.0.20 "GET /compute/v2.1/servers/5e154d65-5086-47c1-bba7-ea3dfd53f6e6" status: 200 len: 1252 microversion: 2.1 time: 0.283670 Oct 04 18:33:00.112400 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 629/1300] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:59 2022] GET /compute/v2.1/servers/5e154d65-5086-47c1-bba7-ea3dfd53f6e6 => generated 1252 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:00.310530 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3214a6f9-3641-44ee-bc5b-938614f7dd46 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:00.310530 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3214a6f9-3641-44ee-bc5b-938614f7dd46 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: c8c84d9e-2274-49dd-99e9-cbd7222c22d5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:00.320919 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3214a6f9-3641-44ee-bc5b-938614f7dd46 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:00.321412 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3214a6f9-3641-44ee-bc5b-938614f7dd46 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:00.321849 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3214a6f9-3641-44ee-bc5b-938614f7dd46 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:00.322545 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3214a6f9-3641-44ee-bc5b-938614f7dd46 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:00.324675 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3214a6f9-3641-44ee-bc5b-938614f7dd46 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:00.326153 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3214a6f9-3641-44ee-bc5b-938614f7dd46 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:00.498686 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f83f19d4-7db1-4d45-a90c-1a91e71bc7e4 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:00.499293 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f83f19d4-7db1-4d45-a90c-1a91e71bc7e4 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 158e9f52-fd16-48d1-87b5-e0dd523e97a4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:00.512218 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f83f19d4-7db1-4d45-a90c-1a91e71bc7e4 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:00.512700 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f83f19d4-7db1-4d45-a90c-1a91e71bc7e4 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:00.513142 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f83f19d4-7db1-4d45-a90c-1a91e71bc7e4 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:00.513840 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f83f19d4-7db1-4d45-a90c-1a91e71bc7e4 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:00.514286 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f83f19d4-7db1-4d45-a90c-1a91e71bc7e4 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:00.514994 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f83f19d4-7db1-4d45-a90c-1a91e71bc7e4 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:00.577773 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3214a6f9-3641-44ee-bc5b-938614f7dd46 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:00.592673 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3214a6f9-3641-44ee-bc5b-938614f7dd46 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/c8c84d9e-2274-49dd-99e9-cbd7222c22d5" status: 200 len: 1307 microversion: 2.1 time: 0.284761 Oct 04 18:33:00.601101 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 672/1301] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:00 2022] GET /compute/v2.1/servers/c8c84d9e-2274-49dd-99e9-cbd7222c22d5 => generated 1307 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:00.846811 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f83f19d4-7db1-4d45-a90c-1a91e71bc7e4 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:00.865958 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f83f19d4-7db1-4d45-a90c-1a91e71bc7e4 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4" status: 200 len: 1360 microversion: 2.1 time: 0.370181 Oct 04 18:33:00.866548 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 630/1302] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:00 2022] GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4 => generated 1360 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:33:01.088514 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1ce9b918-d6b2-45ba-9e16-b38e3195f676 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:01.089239 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1ce9b918-d6b2-45ba-9e16-b38e3195f676 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:01.096819 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1ce9b918-d6b2-45ba-9e16-b38e3195f676 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:01.097674 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1ce9b918-d6b2-45ba-9e16-b38e3195f676 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:01.098448 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1ce9b918-d6b2-45ba-9e16-b38e3195f676 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:01.100414 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1ce9b918-d6b2-45ba-9e16-b38e3195f676 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:01.101127 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1ce9b918-d6b2-45ba-9e16-b38e3195f676 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:01.103063 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1ce9b918-d6b2-45ba-9e16-b38e3195f676 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:01.207411 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1ce9b918-d6b2-45ba-9e16-b38e3195f676 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:01.218655 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1ce9b918-d6b2-45ba-9e16-b38e3195f676 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:01.224837 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1ce9b918-d6b2-45ba-9e16-b38e3195f676 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:01.230196 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1ce9b918-d6b2-45ba-9e16-b38e3195f676 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1512 microversion: 2.91 time: 0.148241 Oct 04 18:33:01.231215 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 673/1303] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:01 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1512 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:01.236827 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d5fe0098-23cf-499d-91f9-6166d77b1400 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:01.237794 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d5fe0098-23cf-499d-91f9-6166d77b1400 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] [instance: 5e154d65-5086-47c1-bba7-ea3dfd53f6e6] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:01.247236 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d5fe0098-23cf-499d-91f9-6166d77b1400 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:01.248096 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d5fe0098-23cf-499d-91f9-6166d77b1400 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:01.248647 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d5fe0098-23cf-499d-91f9-6166d77b1400 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:01.249823 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d5fe0098-23cf-499d-91f9-6166d77b1400 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:01.250401 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d5fe0098-23cf-499d-91f9-6166d77b1400 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:01.250939 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d5fe0098-23cf-499d-91f9-6166d77b1400 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:01.370919 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d5fe0098-23cf-499d-91f9-6166d77b1400 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89f12d146749b38c688b7581e53f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247c7ae3e4e4068a88a044e36945f32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:01.383972 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d5fe0098-23cf-499d-91f9-6166d77b1400 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] 10.222.0.20 "GET /compute/v2.1/servers/5e154d65-5086-47c1-bba7-ea3dfd53f6e6" status: 200 len: 1252 microversion: 2.1 time: 0.147845 Oct 04 18:33:01.394878 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 674/1304] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:01 2022] GET /compute/v2.1/servers/5e154d65-5086-47c1-bba7-ea3dfd53f6e6 => generated 1252 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:01.446097 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-63576f46-fbce-4d66-a85f-e77326508347 req-f9a9413d-eb32-46e9-90d2-50633e08011a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8c84d9e-2274-49dd-99e9-cbd7222c22d5", "tag": "84624e18-aa6c-4e5b-a8b8-776adc3416b5"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:01.469268 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-63576f46-fbce-4d66-a85f-e77326508347 req-f9a9413d-eb32-46e9-90d2-50633e08011a service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:01.473401 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-63576f46-fbce-4d66-a85f-e77326508347 req-f9a9413d-eb32-46e9-90d2-50633e08011a service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:01.473401 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-63576f46-fbce-4d66-a85f-e77326508347 req-f9a9413d-eb32-46e9-90d2-50633e08011a service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:01.488332 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-63576f46-fbce-4d66-a85f-e77326508347 req-f9a9413d-eb32-46e9-90d2-50633e08011a service nova] Creating event network-changed:84624e18-aa6c-4e5b-a8b8-776adc3416b5 for instance c8c84d9e-2274-49dd-99e9-cbd7222c22d5 on n-h2-850501-14 Oct 04 18:33:01.496554 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-63576f46-fbce-4d66-a85f-e77326508347 req-f9a9413d-eb32-46e9-90d2-50633e08011a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.390510 Oct 04 18:33:01.497804 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 631/1305] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:33:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:33:01.508897 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9692de72-11a9-413f-a033-823da3c1115a tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1811674062", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:01.607487 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-9692de72-11a9-413f-a033-823da3c1115a tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] validate_networks() for None {{(pid=123002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:33:01.629842 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7666cf63-8fb5-40c4-9d71-2d39cba73094 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:01.629842 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7666cf63-8fb5-40c4-9d71-2d39cba73094 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: c8c84d9e-2274-49dd-99e9-cbd7222c22d5] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:01.635839 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7666cf63-8fb5-40c4-9d71-2d39cba73094 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:01.637624 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7666cf63-8fb5-40c4-9d71-2d39cba73094 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:01.638155 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7666cf63-8fb5-40c4-9d71-2d39cba73094 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:01.639111 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7666cf63-8fb5-40c4-9d71-2d39cba73094 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:01.640404 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7666cf63-8fb5-40c4-9d71-2d39cba73094 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:01.641003 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7666cf63-8fb5-40c4-9d71-2d39cba73094 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:01.963072 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7666cf63-8fb5-40c4-9d71-2d39cba73094 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:01.964995 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-9692de72-11a9-413f-a033-823da3c1115a tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:33:01.965652 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-9692de72-11a9-413f-a033-823da3c1115a tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:33:01.966364 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-9692de72-11a9-413f-a033-823da3c1115a tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:33:01.966936 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-9692de72-11a9-413f-a033-823da3c1115a tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:33:01.967557 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-9692de72-11a9-413f-a033-823da3c1115a tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:33:01.978223 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9692de72-11a9-413f-a033-823da3c1115a tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:01.979004 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9692de72-11a9-413f-a033-823da3c1115a tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:01.979596 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9692de72-11a9-413f-a033-823da3c1115a tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:01.980625 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9692de72-11a9-413f-a033-823da3c1115a tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:01.981196 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7666cf63-8fb5-40c4-9d71-2d39cba73094 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/c8c84d9e-2274-49dd-99e9-cbd7222c22d5" status: 200 len: 1307 microversion: 2.1 time: 0.358425 Oct 04 18:33:01.981445 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9692de72-11a9-413f-a033-823da3c1115a tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:01.982044 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9692de72-11a9-413f-a033-823da3c1115a tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:01.984225 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 632/1306] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:01 2022] GET /compute/v2.1/servers/c8c84d9e-2274-49dd-99e9-cbd7222c22d5 => generated 1307 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:33:01.999640 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-00c9bdd9-c141-4970-aa36-b82df6ec26bb tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:02.003111 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-00c9bdd9-c141-4970-aa36-b82df6ec26bb tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 158e9f52-fd16-48d1-87b5-e0dd523e97a4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:02.024962 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-00c9bdd9-c141-4970-aa36-b82df6ec26bb tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:02.026515 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-00c9bdd9-c141-4970-aa36-b82df6ec26bb tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:02.027366 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-00c9bdd9-c141-4970-aa36-b82df6ec26bb tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:02.028840 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-00c9bdd9-c141-4970-aa36-b82df6ec26bb tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:02.030369 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-9692de72-11a9-413f-a033-823da3c1115a tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Getting quotas for project 8064cbc5ef6a4f5c9df672a3b8668040. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:33:02.030854 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-00c9bdd9-c141-4970-aa36-b82df6ec26bb tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:02.032811 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:02.033157 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-00c9bdd9-c141-4970-aa36-b82df6ec26bb tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:02.048597 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-9692de72-11a9-413f-a033-823da3c1115a tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Getting quotas for user e6ff8f5b6c58416b82eb6765a209b344 and project 8064cbc5ef6a4f5c9df672a3b8668040. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:33:02.076778 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9692de72-11a9-413f-a033-823da3c1115a tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Going to run 1 instances... {{(pid=123002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:33:02.079100 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9692de72-11a9-413f-a033-823da3c1115a tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] [instance: ba5fa602-5596-4e3f-a0a4-7c88dc89cd16] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:33:02.219867 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-00c9bdd9-c141-4970-aa36-b82df6ec26bb tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:02.228391 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-00c9bdd9-c141-4970-aa36-b82df6ec26bb tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4" status: 200 len: 1360 microversion: 2.1 time: 0.242031 Oct 04 18:33:02.228989 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 633/1307] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:01 2022] GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4 => generated 1360 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:02.233824 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-6d69e511-23ed-4ee2-a7b6-d92f4068454c req-e76e1177-f175-459a-bfbf-926ba9f4bed4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "158e9f52-fd16-48d1-87b5-e0dd523e97a4", "name": "network-vif-plugged", "status": "completed", "tag": "339801ef-bddd-45f8-802a-ec8d2e0687e7"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:02.281761 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9692de72-11a9-413f-a033-823da3c1115a tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.894534 Oct 04 18:33:02.287730 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 675/1308] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:33:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 900 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:33:02.292323 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-6d69e511-23ed-4ee2-a7b6-d92f4068454c req-e76e1177-f175-459a-bfbf-926ba9f4bed4 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:02.292323 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-6d69e511-23ed-4ee2-a7b6-d92f4068454c req-e76e1177-f175-459a-bfbf-926ba9f4bed4 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:02.292665 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-6d69e511-23ed-4ee2-a7b6-d92f4068454c req-e76e1177-f175-459a-bfbf-926ba9f4bed4 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:02.304437 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f4946754-99ec-41e2-b278-9ed0df6dd5b3 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:02.306664 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f4946754-99ec-41e2-b278-9ed0df6dd5b3 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:02.320098 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-6d69e511-23ed-4ee2-a7b6-d92f4068454c req-e76e1177-f175-459a-bfbf-926ba9f4bed4 service nova] Creating event network-vif-plugged:339801ef-bddd-45f8-802a-ec8d2e0687e7 for instance 158e9f52-fd16-48d1-87b5-e0dd523e97a4 on n-h1-850501-14 Oct 04 18:33:02.323268 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f4946754-99ec-41e2-b278-9ed0df6dd5b3 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:02.326756 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-6d69e511-23ed-4ee2-a7b6-d92f4068454c req-e76e1177-f175-459a-bfbf-926ba9f4bed4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096545 Oct 04 18:33:02.327560 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f4946754-99ec-41e2-b278-9ed0df6dd5b3 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:02.327841 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 634/1309] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:33:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:33:02.328488 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f4946754-99ec-41e2-b278-9ed0df6dd5b3 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:02.330991 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f4946754-99ec-41e2-b278-9ed0df6dd5b3 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:02.331649 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f4946754-99ec-41e2-b278-9ed0df6dd5b3 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:02.332288 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f4946754-99ec-41e2-b278-9ed0df6dd5b3 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:02.335217 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-24b02e6c-668d-4d0e-b8d6-e2e88414645d tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:02.335998 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-24b02e6c-668d-4d0e-b8d6-e2e88414645d tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] [instance: ba5fa602-5596-4e3f-a0a4-7c88dc89cd16] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:02.488972 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-24b02e6c-668d-4d0e-b8d6-e2e88414645d tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6ff8f5b6c58416b82eb6765a209b344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064cbc5ef6a4f5c9df672a3b8668040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:02.497806 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-24b02e6c-668d-4d0e-b8d6-e2e88414645d tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] 10.222.0.20 "GET /compute/v2.1/servers/ba5fa602-5596-4e3f-a0a4-7c88dc89cd16" status: 200 len: 1219 microversion: 2.1 time: 0.167822 Oct 04 18:33:02.502543 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f4946754-99ec-41e2-b278-9ed0df6dd5b3 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:02.513094 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f4946754-99ec-41e2-b278-9ed0df6dd5b3 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:02.515924 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 635/1310] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:02 2022] GET /compute/v2.1/servers/ba5fa602-5596-4e3f-a0a4-7c88dc89cd16 => generated 1219 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:02.521874 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-25585cfa-6889-4376-9ecc-68d97d51413a tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:02.522731 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-25585cfa-6889-4376-9ecc-68d97d51413a tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] [instance: 5e154d65-5086-47c1-bba7-ea3dfd53f6e6] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:02.529211 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-25585cfa-6889-4376-9ecc-68d97d51413a tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:02.530393 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f4946754-99ec-41e2-b278-9ed0df6dd5b3 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:02.530802 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-25585cfa-6889-4376-9ecc-68d97d51413a tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:02.531470 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-25585cfa-6889-4376-9ecc-68d97d51413a tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:02.532420 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-25585cfa-6889-4376-9ecc-68d97d51413a tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:02.532881 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-25585cfa-6889-4376-9ecc-68d97d51413a tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:02.533604 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-25585cfa-6889-4376-9ecc-68d97d51413a tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:02.544563 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f4946754-99ec-41e2-b278-9ed0df6dd5b3 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1510 microversion: 2.91 time: 0.253019 Oct 04 18:33:02.544563 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 676/1311] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:02 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1510 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:02.705739 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-25585cfa-6889-4376-9ecc-68d97d51413a tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89f12d146749b38c688b7581e53f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247c7ae3e4e4068a88a044e36945f32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:02.739989 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-25585cfa-6889-4376-9ecc-68d97d51413a tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] 10.222.0.20 "GET /compute/v2.1/servers/5e154d65-5086-47c1-bba7-ea3dfd53f6e6" status: 200 len: 1252 microversion: 2.1 time: 0.223135 Oct 04 18:33:02.744107 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 636/1312] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:02 2022] GET /compute/v2.1/servers/5e154d65-5086-47c1-bba7-ea3dfd53f6e6 => generated 1252 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:03.012044 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a106d66b-6e06-4587-86f5-1e8163260210 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:03.012719 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a106d66b-6e06-4587-86f5-1e8163260210 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: c8c84d9e-2274-49dd-99e9-cbd7222c22d5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:03.018904 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a106d66b-6e06-4587-86f5-1e8163260210 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:03.019714 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a106d66b-6e06-4587-86f5-1e8163260210 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:03.020385 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a106d66b-6e06-4587-86f5-1e8163260210 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:03.021626 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a106d66b-6e06-4587-86f5-1e8163260210 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:03.022078 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a106d66b-6e06-4587-86f5-1e8163260210 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:03.022503 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a106d66b-6e06-4587-86f5-1e8163260210 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:03.257367 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-46b06081-3635-423d-af58-c052863d7b6b tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:03.258069 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-46b06081-3635-423d-af58-c052863d7b6b tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 158e9f52-fd16-48d1-87b5-e0dd523e97a4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:03.269476 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-46b06081-3635-423d-af58-c052863d7b6b tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:03.271586 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-46b06081-3635-423d-af58-c052863d7b6b tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:03.274547 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-46b06081-3635-423d-af58-c052863d7b6b tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:03.276923 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-46b06081-3635-423d-af58-c052863d7b6b tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:03.277659 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-46b06081-3635-423d-af58-c052863d7b6b tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:03.278324 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-46b06081-3635-423d-af58-c052863d7b6b tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:03.321505 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a106d66b-6e06-4587-86f5-1e8163260210 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:03.335312 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a106d66b-6e06-4587-86f5-1e8163260210 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/c8c84d9e-2274-49dd-99e9-cbd7222c22d5" status: 200 len: 1307 microversion: 2.1 time: 0.321867 Oct 04 18:33:03.335312 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 677/1313] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:03 2022] GET /compute/v2.1/servers/c8c84d9e-2274-49dd-99e9-cbd7222c22d5 => generated 1307 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:03.521168 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-46b06081-3635-423d-af58-c052863d7b6b tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:03.523906 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-79299c6a-1235-48d1-9080-b53412e5ad4f tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:03.524736 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-79299c6a-1235-48d1-9080-b53412e5ad4f tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] [instance: ba5fa602-5596-4e3f-a0a4-7c88dc89cd16] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:03.554656 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-46b06081-3635-423d-af58-c052863d7b6b tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4" status: 200 len: 1360 microversion: 2.1 time: 0.303307 Oct 04 18:33:03.560952 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 637/1314] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:03 2022] GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4 => generated 1360 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:03.577871 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-901e0d61-a51b-4fd9-8d5f-bef47b7eef3c tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:03.578501 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-901e0d61-a51b-4fd9-8d5f-bef47b7eef3c tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:03.604043 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-901e0d61-a51b-4fd9-8d5f-bef47b7eef3c tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:03.608483 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-901e0d61-a51b-4fd9-8d5f-bef47b7eef3c tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:03.608483 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-901e0d61-a51b-4fd9-8d5f-bef47b7eef3c tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:03.608483 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-901e0d61-a51b-4fd9-8d5f-bef47b7eef3c tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:03.608483 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-901e0d61-a51b-4fd9-8d5f-bef47b7eef3c tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:03.612715 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-901e0d61-a51b-4fd9-8d5f-bef47b7eef3c tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:03.679873 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-79299c6a-1235-48d1-9080-b53412e5ad4f tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6ff8f5b6c58416b82eb6765a209b344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064cbc5ef6a4f5c9df672a3b8668040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:03.690852 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-79299c6a-1235-48d1-9080-b53412e5ad4f tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] 10.222.0.20 "GET /compute/v2.1/servers/ba5fa602-5596-4e3f-a0a4-7c88dc89cd16" status: 200 len: 1219 microversion: 2.1 time: 0.170531 Oct 04 18:33:03.692648 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 678/1315] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:03 2022] GET /compute/v2.1/servers/ba5fa602-5596-4e3f-a0a4-7c88dc89cd16 => generated 1219 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:33:03.768015 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-08fcbcb7-8b44-4690-9cf6-2dc9ea6dcc29 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:03.773163 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-08fcbcb7-8b44-4690-9cf6-2dc9ea6dcc29 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] [instance: 5e154d65-5086-47c1-bba7-ea3dfd53f6e6] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:03.778648 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-08fcbcb7-8b44-4690-9cf6-2dc9ea6dcc29 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:03.779443 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-08fcbcb7-8b44-4690-9cf6-2dc9ea6dcc29 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:03.780123 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-08fcbcb7-8b44-4690-9cf6-2dc9ea6dcc29 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:03.781874 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-08fcbcb7-8b44-4690-9cf6-2dc9ea6dcc29 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:03.782503 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-08fcbcb7-8b44-4690-9cf6-2dc9ea6dcc29 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:03.783090 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-08fcbcb7-8b44-4690-9cf6-2dc9ea6dcc29 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:03.787460 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-901e0d61-a51b-4fd9-8d5f-bef47b7eef3c tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:03.797948 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-901e0d61-a51b-4fd9-8d5f-bef47b7eef3c tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:03.799705 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-901e0d61-a51b-4fd9-8d5f-bef47b7eef3c tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:03.808079 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-901e0d61-a51b-4fd9-8d5f-bef47b7eef3c tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1510 microversion: 2.91 time: 0.237403 Oct 04 18:33:03.820488 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 638/1316] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:03 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1510 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:03.899930 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-08fcbcb7-8b44-4690-9cf6-2dc9ea6dcc29 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89f12d146749b38c688b7581e53f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247c7ae3e4e4068a88a044e36945f32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:03.918900 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-08fcbcb7-8b44-4690-9cf6-2dc9ea6dcc29 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] 10.222.0.20 "GET /compute/v2.1/servers/5e154d65-5086-47c1-bba7-ea3dfd53f6e6" status: 200 len: 1252 microversion: 2.1 time: 0.155700 Oct 04 18:33:03.922500 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 679/1317] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:03 2022] GET /compute/v2.1/servers/5e154d65-5086-47c1-bba7-ea3dfd53f6e6 => generated 1252 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:33:04.353474 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2d468934-f1f0-4b31-b180-e9fd42c05c35 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:04.354387 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2d468934-f1f0-4b31-b180-e9fd42c05c35 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: c8c84d9e-2274-49dd-99e9-cbd7222c22d5] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:04.361072 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2d468934-f1f0-4b31-b180-e9fd42c05c35 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:04.361868 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2d468934-f1f0-4b31-b180-e9fd42c05c35 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:04.362462 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2d468934-f1f0-4b31-b180-e9fd42c05c35 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:04.365382 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2d468934-f1f0-4b31-b180-e9fd42c05c35 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:04.365382 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2d468934-f1f0-4b31-b180-e9fd42c05c35 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:04.365382 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2d468934-f1f0-4b31-b180-e9fd42c05c35 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:04.580225 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4f85489b-d4b1-4d30-b7bd-df1340ce3f24 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:04.580970 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4f85489b-d4b1-4d30-b7bd-df1340ce3f24 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 158e9f52-fd16-48d1-87b5-e0dd523e97a4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:04.596092 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4f85489b-d4b1-4d30-b7bd-df1340ce3f24 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:04.596271 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4f85489b-d4b1-4d30-b7bd-df1340ce3f24 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:04.596617 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4f85489b-d4b1-4d30-b7bd-df1340ce3f24 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:04.600327 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4f85489b-d4b1-4d30-b7bd-df1340ce3f24 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:04.602755 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4f85489b-d4b1-4d30-b7bd-df1340ce3f24 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:04.605067 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4f85489b-d4b1-4d30-b7bd-df1340ce3f24 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:04.641188 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-2d468934-f1f0-4b31-b180-e9fd42c05c35 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:04.666176 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2d468934-f1f0-4b31-b180-e9fd42c05c35 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/c8c84d9e-2274-49dd-99e9-cbd7222c22d5" status: 200 len: 1307 microversion: 2.1 time: 0.301948 Oct 04 18:33:04.667010 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 639/1318] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:04 2022] GET /compute/v2.1/servers/c8c84d9e-2274-49dd-99e9-cbd7222c22d5 => generated 1307 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:04.718445 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-19a74748-ff51-46c6-900a-94120688633f tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:04.720817 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-19a74748-ff51-46c6-900a-94120688633f tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] [instance: ba5fa602-5596-4e3f-a0a4-7c88dc89cd16] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:04.735224 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-19a74748-ff51-46c6-900a-94120688633f tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:04.735224 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-19a74748-ff51-46c6-900a-94120688633f tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:04.735767 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-19a74748-ff51-46c6-900a-94120688633f tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:04.736879 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-19a74748-ff51-46c6-900a-94120688633f tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:04.737563 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-19a74748-ff51-46c6-900a-94120688633f tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:04.738313 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-19a74748-ff51-46c6-900a-94120688633f tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:04.864034 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-19a74748-ff51-46c6-900a-94120688633f tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6ff8f5b6c58416b82eb6765a209b344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064cbc5ef6a4f5c9df672a3b8668040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:04.877163 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-19a74748-ff51-46c6-900a-94120688633f tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] 10.222.0.20 "GET /compute/v2.1/servers/ba5fa602-5596-4e3f-a0a4-7c88dc89cd16" status: 200 len: 1215 microversion: 2.1 time: 0.162995 Oct 04 18:33:04.882482 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 640/1319] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:04 2022] GET /compute/v2.1/servers/ba5fa602-5596-4e3f-a0a4-7c88dc89cd16 => generated 1215 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:04.888809 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b6214008-8a23-41c6-94f8-4b39b0ed0e68 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:04.889431 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b6214008-8a23-41c6-94f8-4b39b0ed0e68 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:04.906374 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b6214008-8a23-41c6-94f8-4b39b0ed0e68 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:04.907308 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b6214008-8a23-41c6-94f8-4b39b0ed0e68 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:04.908581 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b6214008-8a23-41c6-94f8-4b39b0ed0e68 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:04.909830 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b6214008-8a23-41c6-94f8-4b39b0ed0e68 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:04.915346 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b6214008-8a23-41c6-94f8-4b39b0ed0e68 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:04.915753 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b6214008-8a23-41c6-94f8-4b39b0ed0e68 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:04.948191 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=100 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:04.972342 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4f85489b-d4b1-4d30-b7bd-df1340ce3f24 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:04.987370 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4f85489b-d4b1-4d30-b7bd-df1340ce3f24 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4" status: 200 len: 1544 microversion: 2.1 time: 0.411629 Oct 04 18:33:04.996306 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 680/1320] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:04 2022] GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4 => generated 1544 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:33:05.003469 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a3772ddc-2ae5-4827-b44f-b86d750386b5 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:05.004903 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a3772ddc-2ae5-4827-b44f-b86d750386b5 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] [instance: 5e154d65-5086-47c1-bba7-ea3dfd53f6e6] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:05.013377 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a3772ddc-2ae5-4827-b44f-b86d750386b5 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:05.014549 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a3772ddc-2ae5-4827-b44f-b86d750386b5 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:05.015526 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a3772ddc-2ae5-4827-b44f-b86d750386b5 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:05.016641 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a3772ddc-2ae5-4827-b44f-b86d750386b5 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:05.017695 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a3772ddc-2ae5-4827-b44f-b86d750386b5 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:05.018553 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a3772ddc-2ae5-4827-b44f-b86d750386b5 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:05.085678 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b6214008-8a23-41c6-94f8-4b39b0ed0e68 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:05.098533 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b6214008-8a23-41c6-94f8-4b39b0ed0e68 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:05.106101 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b6214008-8a23-41c6-94f8-4b39b0ed0e68 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:05.125563 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b6214008-8a23-41c6-94f8-4b39b0ed0e68 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1510 microversion: 2.91 time: 0.233176 Oct 04 18:33:05.146608 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 641/1321] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:04 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1510 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:05.163341 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0f66f54f-1834-4b65-8ea3-38c3ec57c99e tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:05.164423 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a3772ddc-2ae5-4827-b44f-b86d750386b5 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89f12d146749b38c688b7581e53f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247c7ae3e4e4068a88a044e36945f32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:05.166618 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0f66f54f-1834-4b65-8ea3-38c3ec57c99e tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 158e9f52-fd16-48d1-87b5-e0dd523e97a4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:05.175836 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a3772ddc-2ae5-4827-b44f-b86d750386b5 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] 10.222.0.20 "GET /compute/v2.1/servers/5e154d65-5086-47c1-bba7-ea3dfd53f6e6" status: 200 len: 1252 microversion: 2.1 time: 0.176830 Oct 04 18:33:05.176081 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0f66f54f-1834-4b65-8ea3-38c3ec57c99e tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:05.176593 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0f66f54f-1834-4b65-8ea3-38c3ec57c99e tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:05.179360 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0f66f54f-1834-4b65-8ea3-38c3ec57c99e tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:05.180455 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 681/1322] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:04 2022] GET /compute/v2.1/servers/5e154d65-5086-47c1-bba7-ea3dfd53f6e6 => generated 1252 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:05.180685 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0f66f54f-1834-4b65-8ea3-38c3ec57c99e tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:05.181234 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0f66f54f-1834-4b65-8ea3-38c3ec57c99e tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:05.181689 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0f66f54f-1834-4b65-8ea3-38c3ec57c99e tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:05.297344 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0f66f54f-1834-4b65-8ea3-38c3ec57c99e tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.149231 Oct 04 18:33:05.306575 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 642/1323] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Oct 4 18:33:05 2022] GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4/os-interface => generated 285 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:33:05.703878 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-991bb9cf-9cae-4df3-96f6-95a53f7a602b tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:05.705165 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-991bb9cf-9cae-4df3-96f6-95a53f7a602b tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: c8c84d9e-2274-49dd-99e9-cbd7222c22d5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:05.723374 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-991bb9cf-9cae-4df3-96f6-95a53f7a602b tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:05.726447 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-991bb9cf-9cae-4df3-96f6-95a53f7a602b tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:05.727186 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-991bb9cf-9cae-4df3-96f6-95a53f7a602b tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:05.728740 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-991bb9cf-9cae-4df3-96f6-95a53f7a602b tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:05.729380 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-991bb9cf-9cae-4df3-96f6-95a53f7a602b tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:05.732213 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-991bb9cf-9cae-4df3-96f6-95a53f7a602b tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:05.905501 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a98d7dd2-795c-478c-b889-19019e75285a tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:05.906729 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a98d7dd2-795c-478c-b889-19019e75285a tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] [instance: ba5fa602-5596-4e3f-a0a4-7c88dc89cd16] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:05.913636 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a98d7dd2-795c-478c-b889-19019e75285a tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:05.914407 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a98d7dd2-795c-478c-b889-19019e75285a tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:05.915164 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a98d7dd2-795c-478c-b889-19019e75285a tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:05.916290 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a98d7dd2-795c-478c-b889-19019e75285a tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:05.916916 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a98d7dd2-795c-478c-b889-19019e75285a tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:05.917516 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a98d7dd2-795c-478c-b889-19019e75285a tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:06.051248 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a98d7dd2-795c-478c-b889-19019e75285a tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6ff8f5b6c58416b82eb6765a209b344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064cbc5ef6a4f5c9df672a3b8668040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:06.064290 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a98d7dd2-795c-478c-b889-19019e75285a tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] 10.222.0.20 "GET /compute/v2.1/servers/ba5fa602-5596-4e3f-a0a4-7c88dc89cd16" status: 200 len: 1279 microversion: 2.1 time: 0.164397 Oct 04 18:33:06.082069 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 643/1324] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:05 2022] GET /compute/v2.1/servers/ba5fa602-5596-4e3f-a0a4-7c88dc89cd16 => generated 1279 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:06.167117 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9b939398-5369-45f5-866e-05256c9053b8 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:06.168024 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-9b939398-5369-45f5-866e-05256c9053b8 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:06.177735 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9b939398-5369-45f5-866e-05256c9053b8 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:06.178566 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9b939398-5369-45f5-866e-05256c9053b8 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:06.179208 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9b939398-5369-45f5-866e-05256c9053b8 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:06.180536 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9b939398-5369-45f5-866e-05256c9053b8 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:06.181380 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9b939398-5369-45f5-866e-05256c9053b8 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:06.182064 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9b939398-5369-45f5-866e-05256c9053b8 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:06.221250 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-991bb9cf-9cae-4df3-96f6-95a53f7a602b tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:06.233728 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-991bb9cf-9cae-4df3-96f6-95a53f7a602b tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/c8c84d9e-2274-49dd-99e9-cbd7222c22d5" status: 200 len: 1307 microversion: 2.1 time: 0.537611 Oct 04 18:33:06.236918 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 682/1325] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:05 2022] GET /compute/v2.1/servers/c8c84d9e-2274-49dd-99e9-cbd7222c22d5 => generated 1307 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:06.248677 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3f069f18-6cc0-4629-ad51-efdb982b5f02 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:06.250568 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3f069f18-6cc0-4629-ad51-efdb982b5f02 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] [instance: 5e154d65-5086-47c1-bba7-ea3dfd53f6e6] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:06.260922 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f069f18-6cc0-4629-ad51-efdb982b5f02 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:06.261664 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f069f18-6cc0-4629-ad51-efdb982b5f02 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:06.262287 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f069f18-6cc0-4629-ad51-efdb982b5f02 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:06.263889 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f069f18-6cc0-4629-ad51-efdb982b5f02 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:06.264544 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f069f18-6cc0-4629-ad51-efdb982b5f02 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:06.265167 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f069f18-6cc0-4629-ad51-efdb982b5f02 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:06.315134 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9b939398-5369-45f5-866e-05256c9053b8 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:06.331504 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9b939398-5369-45f5-866e-05256c9053b8 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:06.333488 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9b939398-5369-45f5-866e-05256c9053b8 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:06.342787 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9b939398-5369-45f5-866e-05256c9053b8 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1510 microversion: 2.91 time: 0.180370 Oct 04 18:33:06.342787 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 644/1326] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:06 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1510 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:33:06.424594 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3f069f18-6cc0-4629-ad51-efdb982b5f02 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89f12d146749b38c688b7581e53f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247c7ae3e4e4068a88a044e36945f32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:06.433977 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3f069f18-6cc0-4629-ad51-efdb982b5f02 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] 10.222.0.20 "GET /compute/v2.1/servers/5e154d65-5086-47c1-bba7-ea3dfd53f6e6" status: 200 len: 1252 microversion: 2.1 time: 0.195783 Oct 04 18:33:06.439064 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 683/1327] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:06 2022] GET /compute/v2.1/servers/5e154d65-5086-47c1-bba7-ea3dfd53f6e6 => generated 1252 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:07.088784 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5a989b2b-8fbd-4904-894d-9a98d13687b9 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:07.090701 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5a989b2b-8fbd-4904-894d-9a98d13687b9 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] [instance: ba5fa602-5596-4e3f-a0a4-7c88dc89cd16] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:07.094472 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=6 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:07.105903 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5a989b2b-8fbd-4904-894d-9a98d13687b9 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:07.108660 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5a989b2b-8fbd-4904-894d-9a98d13687b9 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:07.109358 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5a989b2b-8fbd-4904-894d-9a98d13687b9 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:07.112874 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5a989b2b-8fbd-4904-894d-9a98d13687b9 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:07.114064 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5a989b2b-8fbd-4904-894d-9a98d13687b9 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:07.116069 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5a989b2b-8fbd-4904-894d-9a98d13687b9 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:07.266329 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-99cbbdde-35d8-4a71-847c-1d57a897d5e2 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:07.273747 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-99cbbdde-35d8-4a71-847c-1d57a897d5e2 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: c8c84d9e-2274-49dd-99e9-cbd7222c22d5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:07.292264 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-99cbbdde-35d8-4a71-847c-1d57a897d5e2 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:07.296515 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-99cbbdde-35d8-4a71-847c-1d57a897d5e2 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:07.297297 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-99cbbdde-35d8-4a71-847c-1d57a897d5e2 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:07.318337 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5a989b2b-8fbd-4904-894d-9a98d13687b9 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6ff8f5b6c58416b82eb6765a209b344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064cbc5ef6a4f5c9df672a3b8668040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:07.341874 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-99cbbdde-35d8-4a71-847c-1d57a897d5e2 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:07.347270 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5a989b2b-8fbd-4904-894d-9a98d13687b9 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] 10.222.0.20 "GET /compute/v2.1/servers/ba5fa602-5596-4e3f-a0a4-7c88dc89cd16" status: 200 len: 1277 microversion: 2.1 time: 0.262663 Oct 04 18:33:07.348365 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-99cbbdde-35d8-4a71-847c-1d57a897d5e2 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:07.354637 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-99cbbdde-35d8-4a71-847c-1d57a897d5e2 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:07.361593 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 645/1328] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:07 2022] GET /compute/v2.1/servers/ba5fa602-5596-4e3f-a0a4-7c88dc89cd16 => generated 1277 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:07.383834 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e8592899-331a-4cc6-8e81-97237f0cefb0 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:07.394094 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e8592899-331a-4cc6-8e81-97237f0cefb0 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:07.414556 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e8592899-331a-4cc6-8e81-97237f0cefb0 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:07.415312 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e8592899-331a-4cc6-8e81-97237f0cefb0 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:07.415769 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e8592899-331a-4cc6-8e81-97237f0cefb0 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:07.419177 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e8592899-331a-4cc6-8e81-97237f0cefb0 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:07.419676 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e8592899-331a-4cc6-8e81-97237f0cefb0 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:07.420154 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e8592899-331a-4cc6-8e81-97237f0cefb0 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:07.613539 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e8592899-331a-4cc6-8e81-97237f0cefb0 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:07.627843 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e8592899-331a-4cc6-8e81-97237f0cefb0 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:07.631436 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e8592899-331a-4cc6-8e81-97237f0cefb0 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:07.658904 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e8592899-331a-4cc6-8e81-97237f0cefb0 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1510 microversion: 2.91 time: 0.282423 Oct 04 18:33:07.659585 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 646/1329] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:07 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1510 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:07.681189 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ec4b4338-cbcc-472a-a960-b6570a43a72d tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:07.685865 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ec4b4338-cbcc-472a-a960-b6570a43a72d tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] [instance: 5e154d65-5086-47c1-bba7-ea3dfd53f6e6] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:07.706752 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec4b4338-cbcc-472a-a960-b6570a43a72d tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:07.707323 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec4b4338-cbcc-472a-a960-b6570a43a72d tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:07.707943 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec4b4338-cbcc-472a-a960-b6570a43a72d tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:07.708688 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec4b4338-cbcc-472a-a960-b6570a43a72d tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:07.709231 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec4b4338-cbcc-472a-a960-b6570a43a72d tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:07.709815 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec4b4338-cbcc-472a-a960-b6570a43a72d tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:07.803246 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec4b4338-cbcc-472a-a960-b6570a43a72d tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:07.804851 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec4b4338-cbcc-472a-a960-b6570a43a72d tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:07.819360 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec4b4338-cbcc-472a-a960-b6570a43a72d tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:07.819869 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-ec4b4338-cbcc-472a-a960-b6570a43a72d tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lazy-loading 'fault' on Instance uuid 5e154d65-5086-47c1-bba7-ea3dfd53f6e6 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:33:08.096877 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ec4b4338-cbcc-472a-a960-b6570a43a72d tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89f12d146749b38c688b7581e53f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247c7ae3e4e4068a88a044e36945f32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:08.116661 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ec4b4338-cbcc-472a-a960-b6570a43a72d tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] 10.222.0.20 "GET /compute/v2.1/servers/5e154d65-5086-47c1-bba7-ea3dfd53f6e6" status: 200 len: 1257 microversion: 2.1 time: 0.442090 Oct 04 18:33:08.117463 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 647/1330] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:07 2022] GET /compute/v2.1/servers/5e154d65-5086-47c1-bba7-ea3dfd53f6e6 => generated 1257 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:08.278933 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-99cbbdde-35d8-4a71-847c-1d57a897d5e2 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:08.297933 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-99cbbdde-35d8-4a71-847c-1d57a897d5e2 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/c8c84d9e-2274-49dd-99e9-cbd7222c22d5" status: 200 len: 1307 microversion: 2.1 time: 1.038528 Oct 04 18:33:08.298890 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 684/1331] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:07 2022] GET /compute/v2.1/servers/c8c84d9e-2274-49dd-99e9-cbd7222c22d5 => generated 1307 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:08.390021 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5b30abc8-a5e4-465a-9b08-fcb793c718ef tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:08.393109 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5b30abc8-a5e4-465a-9b08-fcb793c718ef tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] [instance: ba5fa602-5596-4e3f-a0a4-7c88dc89cd16] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:08.397922 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5b30abc8-a5e4-465a-9b08-fcb793c718ef tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:08.398405 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5b30abc8-a5e4-465a-9b08-fcb793c718ef tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:08.405165 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5b30abc8-a5e4-465a-9b08-fcb793c718ef tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:08.406198 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5b30abc8-a5e4-465a-9b08-fcb793c718ef tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:08.406829 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5b30abc8-a5e4-465a-9b08-fcb793c718ef tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:08.407413 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5b30abc8-a5e4-465a-9b08-fcb793c718ef tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:08.698075 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1f73e1ed-3f33-460a-831f-6ac7258c8f79 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:08.698075 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1f73e1ed-3f33-460a-831f-6ac7258c8f79 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:08.710289 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1f73e1ed-3f33-460a-831f-6ac7258c8f79 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:08.710928 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1f73e1ed-3f33-460a-831f-6ac7258c8f79 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:08.712868 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1f73e1ed-3f33-460a-831f-6ac7258c8f79 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:08.714919 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1f73e1ed-3f33-460a-831f-6ac7258c8f79 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:08.718072 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1f73e1ed-3f33-460a-831f-6ac7258c8f79 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:08.718830 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1f73e1ed-3f33-460a-831f-6ac7258c8f79 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:09.250250 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1f73e1ed-3f33-460a-831f-6ac7258c8f79 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:09.257515 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=100 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:09.269093 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1f73e1ed-3f33-460a-831f-6ac7258c8f79 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:09.273185 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1f73e1ed-3f33-460a-831f-6ac7258c8f79 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:09.292494 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1f73e1ed-3f33-460a-831f-6ac7258c8f79 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1531 microversion: 2.91 time: 0.600781 Oct 04 18:33:09.294261 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 685/1332] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:08 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1531 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:33:09.306648 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e46ceeee-41d2-43d9-a78b-9747184f9972 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:09.309148 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e46ceeee-41d2-43d9-a78b-9747184f9972 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] [instance: 5e154d65-5086-47c1-bba7-ea3dfd53f6e6] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:09.330966 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e46ceeee-41d2-43d9-a78b-9747184f9972 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:09.331634 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e46ceeee-41d2-43d9-a78b-9747184f9972 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:09.336590 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e46ceeee-41d2-43d9-a78b-9747184f9972 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:09.337548 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e46ceeee-41d2-43d9-a78b-9747184f9972 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:09.342173 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e46ceeee-41d2-43d9-a78b-9747184f9972 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:09.342725 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e46ceeee-41d2-43d9-a78b-9747184f9972 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:09.399866 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-e46ceeee-41d2-43d9-a78b-9747184f9972 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] HTTP exception thrown: Instance 5e154d65-5086-47c1-bba7-ea3dfd53f6e6 could not be found. Oct 04 18:33:09.402899 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e46ceeee-41d2-43d9-a78b-9747184f9972 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Request method failure captured: Oct 04 18:33:09.402899 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/5e154d65-5086-47c1-bba7-ea3dfd53f6e6 HTTP/1.1 Oct 04 18:33:09.402899 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:33:09.402899 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:33:09.402899 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:33:09.402899 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:33:09.402899 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:33:09.402899 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:33:09.402899 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:33:09.402899 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:33:09.402899 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPHuZ1_Ab4v6esttYggYB3Wj90whQXHpMtpo1_M2PMUGchnuihuB8p0YVRqHrWNkEE9H_71lQy5Fz2rwnWIXZzlIapggXz7KiJ_GSo6uUm7EqTohuHVqt_giQM7lnQuA_kym9LhnJajwhyk82NKfRva1CFgFegB-UBOy-Ur4jLJWVMT4 Oct 04 18:33:09.402899 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:33:09.402899 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:33:09.402899 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:33:09.402899 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:33:09.402899 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:33:09.402899 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:33:09.402899 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 9247c7ae3e4e4068a88a044e36945f32 Oct 04 18:33:09.402899 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServersTestBootFromVolume-1276846158 Oct 04 18:33:09.402899 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:33:09.402899 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:33:09.402899 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9247c7ae3e4e4068a88a044e36945f32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9247c7ae3e4e4068a88a044e36945f32", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9247c7ae3e4e4068a88a044e36945f32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9247c7ae3e4e4068a88a044e36945f32"}]}] Oct 04 18:33:09.402899 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServersTestBootFromVolume-1276846158 Oct 04 18:33:09.402899 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 9247c7ae3e4e4068a88a044e36945f32 Oct 04 18:33:09.402899 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServersTestBootFromVolume-1276846158 Oct 04 18:33:09.402899 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServersTestBootFromVolume-1276846158-project Oct 04 18:33:09.402899 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:33:09.402899 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:33:09.402899 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: ad89f12d146749b38c688b7581e53f5b Oct 04 18:33:09.402899 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServersTestBootFromVolume-1276846158-project Oct 04 18:33:09.402899 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:33:09.402899 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 5e154d65-5086-47c1-bba7-ea3dfd53f6e6 could not be found. Oct 04 18:33:09.402899 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '5e154d65-5086-47c1-bba7-ea3dfd53f6e6'} Oct 04 18:33:09.402899 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:33:09.402899 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:09.402899 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:33:09.402899 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:33:09.402899 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:33:09.402899 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:33:09.402899 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:33:09.402899 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:33:09.402899 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:33:09.402899 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:33:09.402899 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e154d65-5086-47c1-bba7-ea3dfd53f6e6 could not be found. Oct 04 18:33:09.402899 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:33:09.402899 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:09.402899 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:33:09.402899 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:09.402899 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:09.402899 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:09.402899 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:33:09.402899 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:33:09.402899 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:33:09.402899 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:33:09.402899 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:33:09.402899 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:33:09.402899 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:33:09.402899 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:33:09.402899 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:33:09.402899 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:33:09.402899 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e154d65-5086-47c1-bba7-ea3dfd53f6e6 could not be found. Oct 04 18:33:09.402899 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:33:09.402899 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:09.402899 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:33:09.407393 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:09.407393 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:09.407393 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:09.407393 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:33:09.407393 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:33:09.407393 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e154d65-5086-47c1-bba7-ea3dfd53f6e6 could not be found. Oct 04 18:33:09.407393 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:33:09.409432 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e46ceeee-41d2-43d9-a78b-9747184f9972 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Returning 404 to user: Instance 5e154d65-5086-47c1-bba7-ea3dfd53f6e6 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:33:09.413035 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e46ceeee-41d2-43d9-a78b-9747184f9972 tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] 10.222.0.20 "GET /compute/v2.1/servers/5e154d65-5086-47c1-bba7-ea3dfd53f6e6" status: 404 len: 111 microversion: 2.1 time: 0.117533 Oct 04 18:33:09.421506 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 686/1333] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:09 2022] GET /compute/v2.1/servers/5e154d65-5086-47c1-bba7-ea3dfd53f6e6 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:33:09.436878 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-b7e6f57c-fe64-40b7-b75a-44e0ac5e1aff req-28cb7cf7-32c3-4ed1-8ecd-0b4f978f4db0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "158e9f52-fd16-48d1-87b5-e0dd523e97a4", "tag": "339801ef-bddd-45f8-802a-ec8d2e0687e7"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:09.495858 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-b7e6f57c-fe64-40b7-b75a-44e0ac5e1aff req-28cb7cf7-32c3-4ed1-8ecd-0b4f978f4db0 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:09.496593 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-b7e6f57c-fe64-40b7-b75a-44e0ac5e1aff req-28cb7cf7-32c3-4ed1-8ecd-0b4f978f4db0 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:09.498745 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-b7e6f57c-fe64-40b7-b75a-44e0ac5e1aff req-28cb7cf7-32c3-4ed1-8ecd-0b4f978f4db0 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:09.533843 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-b7e6f57c-fe64-40b7-b75a-44e0ac5e1aff req-28cb7cf7-32c3-4ed1-8ecd-0b4f978f4db0 service nova] Creating event network-changed:339801ef-bddd-45f8-802a-ec8d2e0687e7 for instance 158e9f52-fd16-48d1-87b5-e0dd523e97a4 on n-h1-850501-14 Oct 04 18:33:09.567017 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-b7e6f57c-fe64-40b7-b75a-44e0ac5e1aff req-28cb7cf7-32c3-4ed1-8ecd-0b4f978f4db0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144016 Oct 04 18:33:09.588481 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 687/1334] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:33:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:33:09.607635 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-54fe5787-6001-4969-b0e4-7d0e1ef6db5b tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:09.623029 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5b30abc8-a5e4-465a-9b08-fcb793c718ef tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6ff8f5b6c58416b82eb6765a209b344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064cbc5ef6a4f5c9df672a3b8668040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:09.624130 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-54fe5787-6001-4969-b0e4-7d0e1ef6db5b tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: c8c84d9e-2274-49dd-99e9-cbd7222c22d5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:09.645158 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5b30abc8-a5e4-465a-9b08-fcb793c718ef tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] 10.222.0.20 "GET /compute/v2.1/servers/ba5fa602-5596-4e3f-a0a4-7c88dc89cd16" status: 200 len: 1319 microversion: 2.1 time: 1.257064 Oct 04 18:33:09.646695 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 648/1335] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:08 2022] GET /compute/v2.1/servers/ba5fa602-5596-4e3f-a0a4-7c88dc89cd16 => generated 1319 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:09.665040 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-54fe5787-6001-4969-b0e4-7d0e1ef6db5b tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:09.665588 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-54fe5787-6001-4969-b0e4-7d0e1ef6db5b tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:09.665985 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-54fe5787-6001-4969-b0e4-7d0e1ef6db5b tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:09.666713 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-54fe5787-6001-4969-b0e4-7d0e1ef6db5b tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:09.667165 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-54fe5787-6001-4969-b0e4-7d0e1ef6db5b tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:09.667590 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-54fe5787-6001-4969-b0e4-7d0e1ef6db5b tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:10.121276 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4e1268fb-8241-4884-824f-6df62291105c tempest-UnshelveToHostMultiNodesTest-409522397 tempest-UnshelveToHostMultiNodesTest-409522397-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:10.121900 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-4e1268fb-8241-4884-824f-6df62291105c tempest-UnshelveToHostMultiNodesTest-409522397 tempest-UnshelveToHostMultiNodesTest-409522397-project-admin] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:10.130855 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4e1268fb-8241-4884-824f-6df62291105c tempest-UnshelveToHostMultiNodesTest-409522397 tempest-UnshelveToHostMultiNodesTest-409522397-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:10.132693 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4e1268fb-8241-4884-824f-6df62291105c tempest-UnshelveToHostMultiNodesTest-409522397 tempest-UnshelveToHostMultiNodesTest-409522397-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:10.133395 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4e1268fb-8241-4884-824f-6df62291105c tempest-UnshelveToHostMultiNodesTest-409522397 tempest-UnshelveToHostMultiNodesTest-409522397-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:10.144281 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4e1268fb-8241-4884-824f-6df62291105c tempest-UnshelveToHostMultiNodesTest-409522397 tempest-UnshelveToHostMultiNodesTest-409522397-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:10.145083 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4e1268fb-8241-4884-824f-6df62291105c tempest-UnshelveToHostMultiNodesTest-409522397 tempest-UnshelveToHostMultiNodesTest-409522397-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:10.145795 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4e1268fb-8241-4884-824f-6df62291105c tempest-UnshelveToHostMultiNodesTest-409522397 tempest-UnshelveToHostMultiNodesTest-409522397-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:10.548355 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-54fe5787-6001-4969-b0e4-7d0e1ef6db5b tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:10.559782 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-54fe5787-6001-4969-b0e4-7d0e1ef6db5b tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/c8c84d9e-2274-49dd-99e9-cbd7222c22d5" status: 200 len: 1307 microversion: 2.1 time: 0.966650 Oct 04 18:33:10.563759 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 688/1336] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:09 2022] GET /compute/v2.1/servers/c8c84d9e-2274-49dd-99e9-cbd7222c22d5 => generated 1307 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:10.590122 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-4e1268fb-8241-4884-824f-6df62291105c tempest-UnshelveToHostMultiNodesTest-409522397 tempest-UnshelveToHostMultiNodesTest-409522397-project-admin] Lazy-loading 'services' on Instance uuid bb962e56-0c86-4511-b629-d51507a3a8c9 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:33:10.602448 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-bf525684-f3bd-4031-a787-0f7f2044573c tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] Calling method '.version_select at 0x7fe25d31a310>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:10.663112 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-4e1268fb-8241-4884-824f-6df62291105c tempest-UnshelveToHostMultiNodesTest-409522397 tempest-UnshelveToHostMultiNodesTest-409522397-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1938 microversion: 2.91 time: 1.010181 Oct 04 18:33:10.666380 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 649/1337] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:09 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1938 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:10.693869 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-39bf17e4-fc95-41e0-8899-891ef24e6de0 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:10.695881 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-39bf17e4-fc95-41e0-8899-891ef24e6de0 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] [instance: ba5fa602-5596-4e3f-a0a4-7c88dc89cd16] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:10.710810 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-39bf17e4-fc95-41e0-8899-891ef24e6de0 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:10.717109 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-39bf17e4-fc95-41e0-8899-891ef24e6de0 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:10.720472 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-39bf17e4-fc95-41e0-8899-891ef24e6de0 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:10.721891 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-39bf17e4-fc95-41e0-8899-891ef24e6de0 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:10.726134 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-39bf17e4-fc95-41e0-8899-891ef24e6de0 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:10.728840 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-39bf17e4-fc95-41e0-8899-891ef24e6de0 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:10.729464 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-bf525684-f3bd-4031-a787-0f7f2044573c tempest-ServersTestBootFromVolume-1276846158 tempest-ServersTestBootFromVolume-1276846158-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2076227649" status: 202 len: 0 microversion: 2.1 time: 0.159422 Oct 04 18:33:10.729962 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 689/1338] 10.222.0.20 () {58 vars in 1221 bytes} [Tue Oct 4 18:33:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2076227649 => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:33:10.740927 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-bb56be40-9b53-47ca-acdd-2f208a388046 tempest-UnshelveToHostMultiNodesTest-409522397 tempest-UnshelveToHostMultiNodesTest-409522397-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:10.741561 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-bb56be40-9b53-47ca-acdd-2f208a388046 tempest-UnshelveToHostMultiNodesTest-409522397 tempest-UnshelveToHostMultiNodesTest-409522397-project-admin] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:10.760002 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bb56be40-9b53-47ca-acdd-2f208a388046 tempest-UnshelveToHostMultiNodesTest-409522397 tempest-UnshelveToHostMultiNodesTest-409522397-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:10.760532 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bb56be40-9b53-47ca-acdd-2f208a388046 tempest-UnshelveToHostMultiNodesTest-409522397 tempest-UnshelveToHostMultiNodesTest-409522397-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:10.768237 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bb56be40-9b53-47ca-acdd-2f208a388046 tempest-UnshelveToHostMultiNodesTest-409522397 tempest-UnshelveToHostMultiNodesTest-409522397-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:10.769261 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bb56be40-9b53-47ca-acdd-2f208a388046 tempest-UnshelveToHostMultiNodesTest-409522397 tempest-UnshelveToHostMultiNodesTest-409522397-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:10.769758 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bb56be40-9b53-47ca-acdd-2f208a388046 tempest-UnshelveToHostMultiNodesTest-409522397 tempest-UnshelveToHostMultiNodesTest-409522397-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:10.777221 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bb56be40-9b53-47ca-acdd-2f208a388046 tempest-UnshelveToHostMultiNodesTest-409522397 tempest-UnshelveToHostMultiNodesTest-409522397-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:11.135679 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-39bf17e4-fc95-41e0-8899-891ef24e6de0 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6ff8f5b6c58416b82eb6765a209b344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064cbc5ef6a4f5c9df672a3b8668040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:11.136410 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-bb56be40-9b53-47ca-acdd-2f208a388046 tempest-UnshelveToHostMultiNodesTest-409522397 tempest-UnshelveToHostMultiNodesTest-409522397-project-admin] Lazy-loading 'services' on Instance uuid bb962e56-0c86-4511-b629-d51507a3a8c9 {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:33:11.148586 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-39bf17e4-fc95-41e0-8899-891ef24e6de0 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] 10.222.0.20 "GET /compute/v2.1/servers/ba5fa602-5596-4e3f-a0a4-7c88dc89cd16" status: 200 len: 1319 microversion: 2.1 time: 0.478178 Oct 04 18:33:11.153038 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 650/1339] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:10 2022] GET /compute/v2.1/servers/ba5fa602-5596-4e3f-a0a4-7c88dc89cd16 => generated 1319 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:11.188560 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-bb56be40-9b53-47ca-acdd-2f208a388046 tempest-UnshelveToHostMultiNodesTest-409522397 tempest-UnshelveToHostMultiNodesTest-409522397-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1938 microversion: 2.91 time: 0.457471 Oct 04 18:33:11.192821 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 690/1340] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:10 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1938 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:11.221120 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c4a42782-409b-4560-a6c5-ebb42eda427f tempest-UnshelveToHostMultiNodesTest-409522397 tempest-UnshelveToHostMultiNodesTest-409522397-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:11.225580 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c4a42782-409b-4560-a6c5-ebb42eda427f tempest-UnshelveToHostMultiNodesTest-409522397 tempest-UnshelveToHostMultiNodesTest-409522397-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:11.226519 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c4a42782-409b-4560-a6c5-ebb42eda427f tempest-UnshelveToHostMultiNodesTest-409522397 tempest-UnshelveToHostMultiNodesTest-409522397-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:11.245297 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c4a42782-409b-4560-a6c5-ebb42eda427f tempest-UnshelveToHostMultiNodesTest-409522397 tempest-UnshelveToHostMultiNodesTest-409522397-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:11.245297 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c4a42782-409b-4560-a6c5-ebb42eda427f tempest-UnshelveToHostMultiNodesTest-409522397 tempest-UnshelveToHostMultiNodesTest-409522397-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:11.245297 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c4a42782-409b-4560-a6c5-ebb42eda427f tempest-UnshelveToHostMultiNodesTest-409522397 tempest-UnshelveToHostMultiNodesTest-409522397-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:11.250385 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c4a42782-409b-4560-a6c5-ebb42eda427f tempest-UnshelveToHostMultiNodesTest-409522397 tempest-UnshelveToHostMultiNodesTest-409522397-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:11.323650 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c4a42782-409b-4560-a6c5-ebb42eda427f tempest-UnshelveToHostMultiNodesTest-409522397 tempest-UnshelveToHostMultiNodesTest-409522397-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 500 microversion: 2.91 time: 0.107750 Oct 04 18:33:11.325305 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 651/1341] 10.222.0.20 () {60 vars in 1217 bytes} [Tue Oct 4 18:33:11 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 500 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:33:11.337806 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-95aea78a-4a2f-439e-a368-adaa5777e6e8 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:11.338490 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-95aea78a-4a2f-439e-a368-adaa5777e6e8 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:11.352184 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-95aea78a-4a2f-439e-a368-adaa5777e6e8 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:11.352919 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-95aea78a-4a2f-439e-a368-adaa5777e6e8 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:11.353527 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-95aea78a-4a2f-439e-a368-adaa5777e6e8 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:11.354400 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-95aea78a-4a2f-439e-a368-adaa5777e6e8 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:11.355051 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-95aea78a-4a2f-439e-a368-adaa5777e6e8 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:11.355641 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-95aea78a-4a2f-439e-a368-adaa5777e6e8 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:11.389694 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-95aea78a-4a2f-439e-a368-adaa5777e6e8 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lazy-loading 'flavor' on Instance uuid bb962e56-0c86-4511-b629-d51507a3a8c9 {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:33:11.600163 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e6c52764-c92b-44c2-a2cc-1d9a2c3f000f tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:11.600793 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e6c52764-c92b-44c2-a2cc-1d9a2c3f000f tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: c8c84d9e-2274-49dd-99e9-cbd7222c22d5] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:11.616232 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e6c52764-c92b-44c2-a2cc-1d9a2c3f000f tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:11.617795 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e6c52764-c92b-44c2-a2cc-1d9a2c3f000f tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:11.620877 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e6c52764-c92b-44c2-a2cc-1d9a2c3f000f tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:11.627138 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e6c52764-c92b-44c2-a2cc-1d9a2c3f000f tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:11.629701 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e6c52764-c92b-44c2-a2cc-1d9a2c3f000f tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:11.631170 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e6c52764-c92b-44c2-a2cc-1d9a2c3f000f tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:11.990499 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=6 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:12.152413 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-95aea78a-4a2f-439e-a368-adaa5777e6e8 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "POST /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9/action" status: 202 len: 0 microversion: 2.91 time: 0.818717 Oct 04 18:33:12.153992 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 691/1342] 10.222.0.20 () {62 vars in 1319 bytes} [Tue Oct 4 18:33:11 2022] POST /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9/action => generated 0 bytes in 822 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:33:12.188865 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-c096ebdd-8241-4a4a-a6eb-ceccbc594bfd req-5a254f94-531a-438a-aba0-027eeec2565c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8c84d9e-2274-49dd-99e9-cbd7222c22d5", "name": "network-vif-plugged", "status": "completed", "tag": "84624e18-aa6c-4e5b-a8b8-776adc3416b5"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:12.218021 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e6c52764-c92b-44c2-a2cc-1d9a2c3f000f tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:12.236672 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e6c52764-c92b-44c2-a2cc-1d9a2c3f000f tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/c8c84d9e-2274-49dd-99e9-cbd7222c22d5" status: 200 len: 1307 microversion: 2.1 time: 0.641927 Oct 04 18:33:12.240295 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 652/1343] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:11 2022] GET /compute/v2.1/servers/c8c84d9e-2274-49dd-99e9-cbd7222c22d5 => generated 1307 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:12.250644 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-c096ebdd-8241-4a4a-a6eb-ceccbc594bfd req-5a254f94-531a-438a-aba0-027eeec2565c service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:12.251152 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-c096ebdd-8241-4a4a-a6eb-ceccbc594bfd req-5a254f94-531a-438a-aba0-027eeec2565c service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:12.251593 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-c096ebdd-8241-4a4a-a6eb-ceccbc594bfd req-5a254f94-531a-438a-aba0-027eeec2565c service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:12.257679 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f7668b45-f36c-481f-832c-905d34595fcb tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:12.258658 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f7668b45-f36c-481f-832c-905d34595fcb tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:12.279778 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f7668b45-f36c-481f-832c-905d34595fcb tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:12.280796 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f7668b45-f36c-481f-832c-905d34595fcb tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:12.281619 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f7668b45-f36c-481f-832c-905d34595fcb tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:12.286010 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f7668b45-f36c-481f-832c-905d34595fcb tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:12.294578 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f7668b45-f36c-481f-832c-905d34595fcb tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:12.294578 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f7668b45-f36c-481f-832c-905d34595fcb tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:12.294791 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-c096ebdd-8241-4a4a-a6eb-ceccbc594bfd req-5a254f94-531a-438a-aba0-027eeec2565c service nova] Creating event network-vif-plugged:84624e18-aa6c-4e5b-a8b8-776adc3416b5 for instance c8c84d9e-2274-49dd-99e9-cbd7222c22d5 on n-h2-850501-14 Oct 04 18:33:12.320240 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-c096ebdd-8241-4a4a-a6eb-ceccbc594bfd req-5a254f94-531a-438a-aba0-027eeec2565c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152194 Oct 04 18:33:12.321829 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 692/1344] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:33:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:33:12.335562 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-01efbd13-c25d-4dde-9175-8e7c51c7f1c8 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:12.336756 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-01efbd13-c25d-4dde-9175-8e7c51c7f1c8 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] [instance: ba5fa602-5596-4e3f-a0a4-7c88dc89cd16] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:12.358079 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-01efbd13-c25d-4dde-9175-8e7c51c7f1c8 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:12.358931 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-01efbd13-c25d-4dde-9175-8e7c51c7f1c8 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:12.361160 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-01efbd13-c25d-4dde-9175-8e7c51c7f1c8 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:12.362343 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-01efbd13-c25d-4dde-9175-8e7c51c7f1c8 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:12.367398 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-01efbd13-c25d-4dde-9175-8e7c51c7f1c8 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:12.368159 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-01efbd13-c25d-4dde-9175-8e7c51c7f1c8 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:12.464855 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f7668b45-f36c-481f-832c-905d34595fcb tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:12.483132 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f7668b45-f36c-481f-832c-905d34595fcb tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:12.487641 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f7668b45-f36c-481f-832c-905d34595fcb tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:12.502268 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=18 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:12.517060 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f7668b45-f36c-481f-832c-905d34595fcb tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1537 microversion: 2.91 time: 0.275265 Oct 04 18:33:12.529681 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 653/1345] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:12 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1537 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:12.722825 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-01efbd13-c25d-4dde-9175-8e7c51c7f1c8 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6ff8f5b6c58416b82eb6765a209b344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064cbc5ef6a4f5c9df672a3b8668040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:12.730816 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-01efbd13-c25d-4dde-9175-8e7c51c7f1c8 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] 10.222.0.20 "GET /compute/v2.1/servers/ba5fa602-5596-4e3f-a0a4-7c88dc89cd16" status: 200 len: 1319 microversion: 2.1 time: 0.407614 Oct 04 18:33:12.741926 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 693/1346] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:12 2022] GET /compute/v2.1/servers/ba5fa602-5596-4e3f-a0a4-7c88dc89cd16 => generated 1319 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:12.772879 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f99643cf-4f64-4f15-a021-c6e9a656744b tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Action: 'create', calling method: .version_select at 0x7fe258fd0dc0>, body: {"keypair": {"name": "tempest-keypair-1560806999", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLIzbqJNCxXtv4gZhXPQ5IQl583YxSucpBPlRc6EqM2tyNiFO95lHyYuWCJ5nOqI4bUphn8wx04/V3Gr0TWeQ0USid6RpHoyaqNfcdaaHRy4HnI25lPt6jkfyR9JaJywDg=="}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:12.795154 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-f99643cf-4f64-4f15-a021-c6e9a656744b tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Getting quotas for project 2759ed7f36eb4693aa74b76f7907899e. Resources: {'key_pairs'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:33:12.801699 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-f99643cf-4f64-4f15-a021-c6e9a656744b tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Getting quotas for user 697ff4892d1f4c559523990779ccfaab and project 2759ed7f36eb4693aa74b76f7907899e. Resources: {'key_pairs'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:33:12.830896 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:12.883034 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-8b632b5d-02b3-45cc-9a2f-df2e8916fae0 req-68856934-a7ce-44be-8e8e-da168bbde62f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba5fa602-5596-4e3f-a0a4-7c88dc89cd16", "tag": "815e70e4-400f-49c5-839e-f517fd1e6065"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:12.904174 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-8b632b5d-02b3-45cc-9a2f-df2e8916fae0 req-68856934-a7ce-44be-8e8e-da168bbde62f service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:12.904660 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-8b632b5d-02b3-45cc-9a2f-df2e8916fae0 req-68856934-a7ce-44be-8e8e-da168bbde62f service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:12.905091 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-8b632b5d-02b3-45cc-9a2f-df2e8916fae0 req-68856934-a7ce-44be-8e8e-da168bbde62f service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:12.922390 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f99643cf-4f64-4f15-a021-c6e9a656744b tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.240040 Oct 04 18:33:12.923222 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 654/1347] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Oct 4 18:33:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:33:12.934207 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-8b632b5d-02b3-45cc-9a2f-df2e8916fae0 req-68856934-a7ce-44be-8e8e-da168bbde62f service nova] Creating event network-changed:815e70e4-400f-49c5-839e-f517fd1e6065 for instance ba5fa602-5596-4e3f-a0a4-7c88dc89cd16 on n-h1-850501-14 Oct 04 18:33:12.945660 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-8b632b5d-02b3-45cc-9a2f-df2e8916fae0 req-68856934-a7ce-44be-8e8e-da168bbde62f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066590 Oct 04 18:33:12.946293 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 694/1348] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:33:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:33:13.265251 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c0354d2f-de4b-4bbf-9da2-af6577d4583f tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:13.265838 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c0354d2f-de4b-4bbf-9da2-af6577d4583f tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: c8c84d9e-2274-49dd-99e9-cbd7222c22d5] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:13.277424 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c0354d2f-de4b-4bbf-9da2-af6577d4583f tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:13.277841 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c0354d2f-de4b-4bbf-9da2-af6577d4583f tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:13.278278 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c0354d2f-de4b-4bbf-9da2-af6577d4583f tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:13.282718 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c0354d2f-de4b-4bbf-9da2-af6577d4583f tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:13.283462 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c0354d2f-de4b-4bbf-9da2-af6577d4583f tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:13.284753 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c0354d2f-de4b-4bbf-9da2-af6577d4583f tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:13.551661 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0cb8dd9f-c3b0-4730-b9fe-72f87bcc4f6e tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:13.553914 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0cb8dd9f-c3b0-4730-b9fe-72f87bcc4f6e tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:13.562420 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0cb8dd9f-c3b0-4730-b9fe-72f87bcc4f6e tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:13.563189 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0cb8dd9f-c3b0-4730-b9fe-72f87bcc4f6e tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:13.564005 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0cb8dd9f-c3b0-4730-b9fe-72f87bcc4f6e tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:13.564979 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0cb8dd9f-c3b0-4730-b9fe-72f87bcc4f6e tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:13.565681 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0cb8dd9f-c3b0-4730-b9fe-72f87bcc4f6e tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:13.566359 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0cb8dd9f-c3b0-4730-b9fe-72f87bcc4f6e tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:13.613850 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c0354d2f-de4b-4bbf-9da2-af6577d4583f tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:13.629573 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c0354d2f-de4b-4bbf-9da2-af6577d4583f tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/c8c84d9e-2274-49dd-99e9-cbd7222c22d5" status: 200 len: 1307 microversion: 2.1 time: 0.368670 Oct 04 18:33:13.642585 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 655/1349] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:13 2022] GET /compute/v2.1/servers/c8c84d9e-2274-49dd-99e9-cbd7222c22d5 => generated 1307 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:33:13.688656 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=42 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:13.695777 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0cb8dd9f-c3b0-4730-b9fe-72f87bcc4f6e tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:13.726626 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0cb8dd9f-c3b0-4730-b9fe-72f87bcc4f6e tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:13.728837 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0cb8dd9f-c3b0-4730-b9fe-72f87bcc4f6e tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:13.745104 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0cb8dd9f-c3b0-4730-b9fe-72f87bcc4f6e tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1537 microversion: 2.91 time: 0.199223 Oct 04 18:33:13.751977 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 695/1350] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:13 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1537 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:33:13.783355 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5022ddfb-549e-41a1-8a06-1f29e13f1d43 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:13.784368 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5022ddfb-549e-41a1-8a06-1f29e13f1d43 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] [instance: ba5fa602-5596-4e3f-a0a4-7c88dc89cd16] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:13.797691 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5022ddfb-549e-41a1-8a06-1f29e13f1d43 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:13.798263 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5022ddfb-549e-41a1-8a06-1f29e13f1d43 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:13.798775 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5022ddfb-549e-41a1-8a06-1f29e13f1d43 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:13.799762 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5022ddfb-549e-41a1-8a06-1f29e13f1d43 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:13.800132 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5022ddfb-549e-41a1-8a06-1f29e13f1d43 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:13.800635 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5022ddfb-549e-41a1-8a06-1f29e13f1d43 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:14.498005 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5022ddfb-549e-41a1-8a06-1f29e13f1d43 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6ff8f5b6c58416b82eb6765a209b344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064cbc5ef6a4f5c9df672a3b8668040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:14.511167 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5022ddfb-549e-41a1-8a06-1f29e13f1d43 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] 10.222.0.20 "GET /compute/v2.1/servers/ba5fa602-5596-4e3f-a0a4-7c88dc89cd16" status: 200 len: 1319 microversion: 2.1 time: 0.739560 Oct 04 18:33:14.524088 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 656/1351] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:13 2022] GET /compute/v2.1/servers/ba5fa602-5596-4e3f-a0a4-7c88dc89cd16 => generated 1319 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:14.663700 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-99b88e50-0568-4222-b2d9-12697121be28 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:14.665031 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-99b88e50-0568-4222-b2d9-12697121be28 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: c8c84d9e-2274-49dd-99e9-cbd7222c22d5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:14.676091 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-99b88e50-0568-4222-b2d9-12697121be28 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:14.677688 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-99b88e50-0568-4222-b2d9-12697121be28 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:14.678740 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-99b88e50-0568-4222-b2d9-12697121be28 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:14.679911 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-99b88e50-0568-4222-b2d9-12697121be28 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:14.680911 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-99b88e50-0568-4222-b2d9-12697121be28 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:14.682073 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-99b88e50-0568-4222-b2d9-12697121be28 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:14.781672 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6f5d7c0b-693e-4fc4-a1af-43570a355134 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:14.784972 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6f5d7c0b-693e-4fc4-a1af-43570a355134 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:14.798622 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6f5d7c0b-693e-4fc4-a1af-43570a355134 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:14.799397 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6f5d7c0b-693e-4fc4-a1af-43570a355134 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:14.800102 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6f5d7c0b-693e-4fc4-a1af-43570a355134 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:14.801442 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6f5d7c0b-693e-4fc4-a1af-43570a355134 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:14.803084 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6f5d7c0b-693e-4fc4-a1af-43570a355134 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:14.803816 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6f5d7c0b-693e-4fc4-a1af-43570a355134 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:14.996846 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6f5d7c0b-693e-4fc4-a1af-43570a355134 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:15.010894 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6f5d7c0b-693e-4fc4-a1af-43570a355134 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:15.017270 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6f5d7c0b-693e-4fc4-a1af-43570a355134 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:15.017735 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-99b88e50-0568-4222-b2d9-12697121be28 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:15.028971 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-99b88e50-0568-4222-b2d9-12697121be28 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/c8c84d9e-2274-49dd-99e9-cbd7222c22d5" status: 200 len: 1486 microversion: 2.1 time: 0.372923 Oct 04 18:33:15.030716 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6f5d7c0b-693e-4fc4-a1af-43570a355134 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1537 microversion: 2.91 time: 0.254701 Oct 04 18:33:15.032986 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 696/1352] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:14 2022] GET /compute/v2.1/servers/c8c84d9e-2274-49dd-99e9-cbd7222c22d5 => generated 1486 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:15.035403 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 657/1353] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:14 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1537 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:15.068969 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f5f61dc0-dd76-465d-bc11-1ddca8a2fca2 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:15.075241 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f5f61dc0-dd76-465d-bc11-1ddca8a2fca2 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:15.075730 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f5f61dc0-dd76-465d-bc11-1ddca8a2fca2 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:15.076198 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f5f61dc0-dd76-465d-bc11-1ddca8a2fca2 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:15.142910 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f5f61dc0-dd76-465d-bc11-1ddca8a2fca2 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: c8c84d9e-2274-49dd-99e9-cbd7222c22d5] Going to try to stop instance {{(pid=123002) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 18:33:15.381956 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f5f61dc0-dd76-465d-bc11-1ddca8a2fca2 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "POST /compute/v2.1/servers/c8c84d9e-2274-49dd-99e9-cbd7222c22d5/action" status: 202 len: 0 microversion: 2.1 time: 0.312300 Oct 04 18:33:15.383066 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 697/1354] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:33:15 2022] POST /compute/v2.1/servers/c8c84d9e-2274-49dd-99e9-cbd7222c22d5/action => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:33:15.401868 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-52bc9c4f-4568-4ec7-a06e-c7dcb4e363ab tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:15.401868 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-52bc9c4f-4568-4ec7-a06e-c7dcb4e363ab tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: c8c84d9e-2274-49dd-99e9-cbd7222c22d5] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:15.408134 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-52bc9c4f-4568-4ec7-a06e-c7dcb4e363ab tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:15.408925 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-52bc9c4f-4568-4ec7-a06e-c7dcb4e363ab tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:15.410316 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-52bc9c4f-4568-4ec7-a06e-c7dcb4e363ab tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:15.413475 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-52bc9c4f-4568-4ec7-a06e-c7dcb4e363ab tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:15.415508 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-52bc9c4f-4568-4ec7-a06e-c7dcb4e363ab tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:15.418247 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-52bc9c4f-4568-4ec7-a06e-c7dcb4e363ab tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:15.536531 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-cd001b17-1a63-4f7d-a034-49e25d448579 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:15.538862 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-cd001b17-1a63-4f7d-a034-49e25d448579 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] [instance: ba5fa602-5596-4e3f-a0a4-7c88dc89cd16] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:15.549076 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cd001b17-1a63-4f7d-a034-49e25d448579 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:15.552531 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cd001b17-1a63-4f7d-a034-49e25d448579 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:15.553715 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cd001b17-1a63-4f7d-a034-49e25d448579 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:15.556482 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cd001b17-1a63-4f7d-a034-49e25d448579 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:15.557142 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cd001b17-1a63-4f7d-a034-49e25d448579 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:15.558608 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cd001b17-1a63-4f7d-a034-49e25d448579 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:15.928208 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-52bc9c4f-4568-4ec7-a06e-c7dcb4e363ab tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:15.942232 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-52bc9c4f-4568-4ec7-a06e-c7dcb4e363ab tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/c8c84d9e-2274-49dd-99e9-cbd7222c22d5" status: 200 len: 1496 microversion: 2.1 time: 0.554375 Oct 04 18:33:15.948384 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 658/1355] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:15 2022] GET /compute/v2.1/servers/c8c84d9e-2274-49dd-99e9-cbd7222c22d5 => generated 1496 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:16.014870 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ef9e8594-16bd-44a7-80fb-67d57ccc838c tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Action: 'create', calling method: .version_select at 0x7fe258d32790>, body: {"keypair": {"name": "tempest-keypair-216215324", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKNOPZ4J4XlwwyUPFG23j5akDKciEz458fwXzHQfFBe6QEGARp0Y9I8zp9mwKah1LA1yoJwQTU/QPzwnJ/swkLJk/1b0huzzKWZY6qQU18KtAzZvX3XwGhNGd8bNOdTaTA=="}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:16.042121 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-ef9e8594-16bd-44a7-80fb-67d57ccc838c tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Getting quotas for project bc7808c2a8d8491aa5e1594383fab2a3. Resources: {'key_pairs'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:33:16.049507 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-ef9e8594-16bd-44a7-80fb-67d57ccc838c tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Getting quotas for user 71bed3af030c43dbaa23a3e23520f407 and project bc7808c2a8d8491aa5e1594383fab2a3. Resources: {'key_pairs'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:33:16.103391 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-cd001b17-1a63-4f7d-a034-49e25d448579 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6ff8f5b6c58416b82eb6765a209b344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064cbc5ef6a4f5c9df672a3b8668040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:16.115331 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-cd001b17-1a63-4f7d-a034-49e25d448579 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] 10.222.0.20 "GET /compute/v2.1/servers/ba5fa602-5596-4e3f-a0a4-7c88dc89cd16" status: 200 len: 1319 microversion: 2.1 time: 0.582427 Oct 04 18:33:16.140344 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 698/1356] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:15 2022] GET /compute/v2.1/servers/ba5fa602-5596-4e3f-a0a4-7c88dc89cd16 => generated 1319 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:16.140344 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-057e0748-5ea7-4edd-9be5-7ff693849b62 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:16.140344 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-057e0748-5ea7-4edd-9be5-7ff693849b62 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:16.150829 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-057e0748-5ea7-4edd-9be5-7ff693849b62 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:16.151366 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-057e0748-5ea7-4edd-9be5-7ff693849b62 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:16.151833 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-057e0748-5ea7-4edd-9be5-7ff693849b62 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:16.152749 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-057e0748-5ea7-4edd-9be5-7ff693849b62 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:16.153521 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-057e0748-5ea7-4edd-9be5-7ff693849b62 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:16.154204 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-057e0748-5ea7-4edd-9be5-7ff693849b62 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:16.308658 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-057e0748-5ea7-4edd-9be5-7ff693849b62 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:16.328784 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-057e0748-5ea7-4edd-9be5-7ff693849b62 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:16.340290 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-057e0748-5ea7-4edd-9be5-7ff693849b62 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:16.349645 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-057e0748-5ea7-4edd-9be5-7ff693849b62 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1537 microversion: 2.91 time: 0.229748 Oct 04 18:33:16.355624 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 699/1357] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:16 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1537 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:16.467438 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ef9e8594-16bd-44a7-80fb-67d57ccc838c tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.517693 Oct 04 18:33:16.474733 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 659/1358] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Oct 4 18:33:15 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:33:16.975040 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a60d8c39-e52b-41db-a500-8c071d2fdc43 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:16.975888 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a60d8c39-e52b-41db-a500-8c071d2fdc43 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: c8c84d9e-2274-49dd-99e9-cbd7222c22d5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:16.993408 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a60d8c39-e52b-41db-a500-8c071d2fdc43 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:16.994128 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a60d8c39-e52b-41db-a500-8c071d2fdc43 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:16.994825 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a60d8c39-e52b-41db-a500-8c071d2fdc43 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:16.998469 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a60d8c39-e52b-41db-a500-8c071d2fdc43 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:16.999122 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a60d8c39-e52b-41db-a500-8c071d2fdc43 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:16.999729 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a60d8c39-e52b-41db-a500-8c071d2fdc43 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:17.154487 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0727cf88-b201-4119-9df7-53320dfb9548 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:17.156091 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0727cf88-b201-4119-9df7-53320dfb9548 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] [instance: ba5fa602-5596-4e3f-a0a4-7c88dc89cd16] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:17.168907 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0727cf88-b201-4119-9df7-53320dfb9548 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:17.170869 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0727cf88-b201-4119-9df7-53320dfb9548 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:17.173622 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0727cf88-b201-4119-9df7-53320dfb9548 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:17.175530 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0727cf88-b201-4119-9df7-53320dfb9548 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:17.177483 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0727cf88-b201-4119-9df7-53320dfb9548 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:17.178157 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0727cf88-b201-4119-9df7-53320dfb9548 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:17.209156 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=100 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:17.868487 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0727cf88-b201-4119-9df7-53320dfb9548 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6ff8f5b6c58416b82eb6765a209b344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064cbc5ef6a4f5c9df672a3b8668040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:17.884840 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a60d8c39-e52b-41db-a500-8c071d2fdc43 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:17.885609 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0727cf88-b201-4119-9df7-53320dfb9548 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] 10.222.0.20 "GET /compute/v2.1/servers/ba5fa602-5596-4e3f-a0a4-7c88dc89cd16" status: 200 len: 1319 microversion: 2.1 time: 0.733968 Oct 04 18:33:17.886755 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 660/1359] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:17 2022] GET /compute/v2.1/servers/ba5fa602-5596-4e3f-a0a4-7c88dc89cd16 => generated 1319 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:33:17.901572 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-63e54161-e803-4bd9-a4e0-d08cfbc01c3c tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:17.903165 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-63e54161-e803-4bd9-a4e0-d08cfbc01c3c tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:17.912764 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a60d8c39-e52b-41db-a500-8c071d2fdc43 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/c8c84d9e-2274-49dd-99e9-cbd7222c22d5" status: 200 len: 1496 microversion: 2.1 time: 0.943363 Oct 04 18:33:17.914212 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 700/1360] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:16 2022] GET /compute/v2.1/servers/c8c84d9e-2274-49dd-99e9-cbd7222c22d5 => generated 1496 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:17.920021 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c55dc03a-e5e2-478d-ae78-c8e76254facf tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:17.921139 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c55dc03a-e5e2-478d-ae78-c8e76254facf tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] [instance: b219d988-2847-45a0-a3b8-af54cf1a43f8] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:17.923342 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-63e54161-e803-4bd9-a4e0-d08cfbc01c3c tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:17.923934 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-63e54161-e803-4bd9-a4e0-d08cfbc01c3c tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:17.924870 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-63e54161-e803-4bd9-a4e0-d08cfbc01c3c tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:17.925966 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-63e54161-e803-4bd9-a4e0-d08cfbc01c3c tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:17.927203 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-63e54161-e803-4bd9-a4e0-d08cfbc01c3c tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:17.928139 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-63e54161-e803-4bd9-a4e0-d08cfbc01c3c tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:17.932293 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c55dc03a-e5e2-478d-ae78-c8e76254facf tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:17.933055 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c55dc03a-e5e2-478d-ae78-c8e76254facf tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:17.933487 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c55dc03a-e5e2-478d-ae78-c8e76254facf tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:17.936732 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c55dc03a-e5e2-478d-ae78-c8e76254facf tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:17.937204 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c55dc03a-e5e2-478d-ae78-c8e76254facf tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:17.937631 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c55dc03a-e5e2-478d-ae78-c8e76254facf tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:18.220930 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-63e54161-e803-4bd9-a4e0-d08cfbc01c3c tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:18.238542 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-63e54161-e803-4bd9-a4e0-d08cfbc01c3c tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:18.249292 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-63e54161-e803-4bd9-a4e0-d08cfbc01c3c tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:18.273339 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-63e54161-e803-4bd9-a4e0-d08cfbc01c3c tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1537 microversion: 2.91 time: 0.381787 Oct 04 18:33:18.278992 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 661/1361] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:17 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1537 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:18.434301 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-c55dc03a-e5e2-478d-ae78-c8e76254facf tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lazy-loading 'services' on Instance uuid b219d988-2847-45a0-a3b8-af54cf1a43f8 {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:33:18.475739 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c55dc03a-e5e2-478d-ae78-c8e76254facf tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8" status: 200 len: 2343 microversion: 2.25 time: 0.560222 Oct 04 18:33:18.480481 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 701/1362] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:17 2022] GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8 => generated 2343 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:18.505506 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-043ae141-0280-425e-b1b4-c41e51d11180 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "488b6f37-059b-4ba3-b48f-061e29117b7c"}], "security_groups": [{"name": "tempest-securitygroup--1817742438"}], "key_name": "tempest-keypair-1560806999", "user_data": "}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:18.510481 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e9cc1bf7-7f3d-4f1c-a566-61d635486ac0 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:18.511392 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e9cc1bf7-7f3d-4f1c-a566-61d635486ac0 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:18.512664 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e9cc1bf7-7f3d-4f1c-a566-61d635486ac0 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:18.514573 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e9cc1bf7-7f3d-4f1c-a566-61d635486ac0 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:18.515759 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e9cc1bf7-7f3d-4f1c-a566-61d635486ac0 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:18.516971 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e9cc1bf7-7f3d-4f1c-a566-61d635486ac0 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:18.518764 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e9cc1bf7-7f3d-4f1c-a566-61d635486ac0 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:18.555495 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e9cc1bf7-7f3d-4f1c-a566-61d635486ac0 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.052311 Oct 04 18:33:18.556862 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 702/1363] 10.222.0.20 () {60 vars in 1217 bytes} [Tue Oct 4 18:33:18 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:33:18.792579 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.neutron [None req-043ae141-0280-425e-b1b4-c41e51d11180 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] validate_networks() for [('488b6f37-059b-4ba3-b48f-061e29117b7c', None, None, None, None, None)] {{(pid=123001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:33:18.909921 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7a07336d-8731-43a8-8fa2-7ff5fd0060b8 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:18.910528 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7a07336d-8731-43a8-8fa2-7ff5fd0060b8 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] [instance: ba5fa602-5596-4e3f-a0a4-7c88dc89cd16] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:18.922200 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7a07336d-8731-43a8-8fa2-7ff5fd0060b8 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:18.925379 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7a07336d-8731-43a8-8fa2-7ff5fd0060b8 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:18.926445 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7a07336d-8731-43a8-8fa2-7ff5fd0060b8 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:18.927903 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7a07336d-8731-43a8-8fa2-7ff5fd0060b8 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:18.929072 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7a07336d-8731-43a8-8fa2-7ff5fd0060b8 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:18.929563 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7a07336d-8731-43a8-8fa2-7ff5fd0060b8 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:18.945555 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:19.391364 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7a07336d-8731-43a8-8fa2-7ff5fd0060b8 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6ff8f5b6c58416b82eb6765a209b344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064cbc5ef6a4f5c9df672a3b8668040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:19.400931 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7a07336d-8731-43a8-8fa2-7ff5fd0060b8 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] 10.222.0.20 "GET /compute/v2.1/servers/ba5fa602-5596-4e3f-a0a4-7c88dc89cd16" status: 200 len: 1319 microversion: 2.1 time: 0.494929 Oct 04 18:33:19.402110 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 703/1364] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:18 2022] GET /compute/v2.1/servers/ba5fa602-5596-4e3f-a0a4-7c88dc89cd16 => generated 1319 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:33:19.407258 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-12a2a3c8-93ad-43db-93be-51e8f891b31b tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:19.408031 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-12a2a3c8-93ad-43db-93be-51e8f891b31b tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: c8c84d9e-2274-49dd-99e9-cbd7222c22d5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:19.414921 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-12a2a3c8-93ad-43db-93be-51e8f891b31b tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:19.415660 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-12a2a3c8-93ad-43db-93be-51e8f891b31b tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:19.417308 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-12a2a3c8-93ad-43db-93be-51e8f891b31b tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:19.418828 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-12a2a3c8-93ad-43db-93be-51e8f891b31b tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:19.419289 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-12a2a3c8-93ad-43db-93be-51e8f891b31b tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:19.419709 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-12a2a3c8-93ad-43db-93be-51e8f891b31b tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:19.809391 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-043ae141-0280-425e-b1b4-c41e51d11180 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:33:19.810141 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-043ae141-0280-425e-b1b4-c41e51d11180 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:33:19.810646 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-043ae141-0280-425e-b1b4-c41e51d11180 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:33:19.811081 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-043ae141-0280-425e-b1b4-c41e51d11180 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:33:19.811483 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-043ae141-0280-425e-b1b4-c41e51d11180 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:33:19.835509 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-043ae141-0280-425e-b1b4-c41e51d11180 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:19.848257 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-043ae141-0280-425e-b1b4-c41e51d11180 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:19.849584 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-043ae141-0280-425e-b1b4-c41e51d11180 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:19.855061 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-043ae141-0280-425e-b1b4-c41e51d11180 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:19.855794 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-043ae141-0280-425e-b1b4-c41e51d11180 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:19.856927 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-043ae141-0280-425e-b1b4-c41e51d11180 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:19.907389 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-043ae141-0280-425e-b1b4-c41e51d11180 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Getting quotas for project 2759ed7f36eb4693aa74b76f7907899e. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:33:19.933663 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-043ae141-0280-425e-b1b4-c41e51d11180 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Getting quotas for user 697ff4892d1f4c559523990779ccfaab and project 2759ed7f36eb4693aa74b76f7907899e. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:33:19.935397 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-12a2a3c8-93ad-43db-93be-51e8f891b31b tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:19.965585 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-043ae141-0280-425e-b1b4-c41e51d11180 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Going to run 1 instances... {{(pid=123001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:33:19.967489 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-043ae141-0280-425e-b1b4-c41e51d11180 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] [instance: 89a512b5-8107-4c63-8387-69892fc7e5f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:33:19.976963 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-12a2a3c8-93ad-43db-93be-51e8f891b31b tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/c8c84d9e-2274-49dd-99e9-cbd7222c22d5" status: 200 len: 1496 microversion: 2.1 time: 0.573414 Oct 04 18:33:19.981859 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 704/1365] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:19 2022] GET /compute/v2.1/servers/c8c84d9e-2274-49dd-99e9-cbd7222c22d5 => generated 1496 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:19.993137 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4e743de4-13a3-4692-a7dc-ca8767413b53 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:19.997332 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4e743de4-13a3-4692-a7dc-ca8767413b53 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:20.007522 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4e743de4-13a3-4692-a7dc-ca8767413b53 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:20.010802 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4e743de4-13a3-4692-a7dc-ca8767413b53 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:20.010802 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4e743de4-13a3-4692-a7dc-ca8767413b53 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:20.010802 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4e743de4-13a3-4692-a7dc-ca8767413b53 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:20.011386 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4e743de4-13a3-4692-a7dc-ca8767413b53 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:20.012164 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4e743de4-13a3-4692-a7dc-ca8767413b53 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:20.133311 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4e743de4-13a3-4692-a7dc-ca8767413b53 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:20.134754 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-043ae141-0280-425e-b1b4-c41e51d11180 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.634383 Oct 04 18:33:20.143163 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 662/1366] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:33:18 2022] POST /compute/v2.1/servers => generated 409 bytes in 1644 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:33:20.151047 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4e743de4-13a3-4692-a7dc-ca8767413b53 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:20.156569 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4e743de4-13a3-4692-a7dc-ca8767413b53 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:20.165251 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-81fb4890-0371-475b-b849-c135b5997c09 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:20.169248 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-81fb4890-0371-475b-b849-c135b5997c09 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] [instance: 89a512b5-8107-4c63-8387-69892fc7e5f4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:20.171355 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4e743de4-13a3-4692-a7dc-ca8767413b53 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1537 microversion: 2.91 time: 0.187865 Oct 04 18:33:20.171956 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 705/1367] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:19 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1537 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:20.390463 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-81fb4890-0371-475b-b849-c135b5997c09 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697ff4892d1f4c559523990779ccfaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2759ed7f36eb4693aa74b76f7907899e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:20.398896 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-81fb4890-0371-475b-b849-c135b5997c09 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] 10.222.0.20 "GET /compute/v2.1/servers/89a512b5-8107-4c63-8387-69892fc7e5f4" status: 200 len: 1226 microversion: 2.1 time: 0.254345 Oct 04 18:33:20.402946 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 663/1368] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:20 2022] GET /compute/v2.1/servers/89a512b5-8107-4c63-8387-69892fc7e5f4 => generated 1226 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:20.436648 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-010455a2-91ef-4e69-99a8-9b47f5a388ca tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:20.437544 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-010455a2-91ef-4e69-99a8-9b47f5a388ca tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] [instance: ba5fa602-5596-4e3f-a0a4-7c88dc89cd16] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:20.455556 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-010455a2-91ef-4e69-99a8-9b47f5a388ca tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:20.457590 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-010455a2-91ef-4e69-99a8-9b47f5a388ca tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:20.466190 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-010455a2-91ef-4e69-99a8-9b47f5a388ca tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:20.467057 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-010455a2-91ef-4e69-99a8-9b47f5a388ca tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:20.467636 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-010455a2-91ef-4e69-99a8-9b47f5a388ca tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:20.469412 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-010455a2-91ef-4e69-99a8-9b47f5a388ca tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:20.914755 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-010455a2-91ef-4e69-99a8-9b47f5a388ca tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6ff8f5b6c58416b82eb6765a209b344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064cbc5ef6a4f5c9df672a3b8668040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:20.931465 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-010455a2-91ef-4e69-99a8-9b47f5a388ca tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] 10.222.0.20 "GET /compute/v2.1/servers/ba5fa602-5596-4e3f-a0a4-7c88dc89cd16" status: 200 len: 1319 microversion: 2.1 time: 0.503056 Oct 04 18:33:20.932280 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 706/1369] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:20 2022] GET /compute/v2.1/servers/ba5fa602-5596-4e3f-a0a4-7c88dc89cd16 => generated 1319 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:21.017056 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9cda796a-d07e-4d6a-a8be-8bbab6cc40b5 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:21.023360 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-9cda796a-d07e-4d6a-a8be-8bbab6cc40b5 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: c8c84d9e-2274-49dd-99e9-cbd7222c22d5] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:21.045574 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9cda796a-d07e-4d6a-a8be-8bbab6cc40b5 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:21.046272 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9cda796a-d07e-4d6a-a8be-8bbab6cc40b5 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:21.046792 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9cda796a-d07e-4d6a-a8be-8bbab6cc40b5 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:21.047716 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9cda796a-d07e-4d6a-a8be-8bbab6cc40b5 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:21.048213 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9cda796a-d07e-4d6a-a8be-8bbab6cc40b5 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:21.049821 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9cda796a-d07e-4d6a-a8be-8bbab6cc40b5 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:21.248108 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-9d57e3ae-5cd6-43f4-95fd-f6c156d4984b req-5a495027-c335-418b-8dbe-957f19b5a58d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba5fa602-5596-4e3f-a0a4-7c88dc89cd16", "name": "network-vif-plugged", "status": "completed", "tag": "815e70e4-400f-49c5-839e-f517fd1e6065"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:21.285893 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-9d57e3ae-5cd6-43f4-95fd-f6c156d4984b req-5a495027-c335-418b-8dbe-957f19b5a58d service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:21.289130 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-9d57e3ae-5cd6-43f4-95fd-f6c156d4984b req-5a495027-c335-418b-8dbe-957f19b5a58d service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:21.289673 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-9d57e3ae-5cd6-43f4-95fd-f6c156d4984b req-5a495027-c335-418b-8dbe-957f19b5a58d service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:21.324173 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-9d57e3ae-5cd6-43f4-95fd-f6c156d4984b req-5a495027-c335-418b-8dbe-957f19b5a58d service nova] Creating event network-vif-plugged:815e70e4-400f-49c5-839e-f517fd1e6065 for instance ba5fa602-5596-4e3f-a0a4-7c88dc89cd16 on n-h1-850501-14 Oct 04 18:33:21.341143 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-9d57e3ae-5cd6-43f4-95fd-f6c156d4984b req-5a495027-c335-418b-8dbe-957f19b5a58d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.281281 Oct 04 18:33:21.343308 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 707/1370] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:33:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:33:21.352482 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-786b7ff9-700e-4614-8d24-d9cbe97c0dd7 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:21.353615 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-786b7ff9-700e-4614-8d24-d9cbe97c0dd7 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:21.379514 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-786b7ff9-700e-4614-8d24-d9cbe97c0dd7 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:21.381766 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-786b7ff9-700e-4614-8d24-d9cbe97c0dd7 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:21.381766 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-786b7ff9-700e-4614-8d24-d9cbe97c0dd7 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:21.382433 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-786b7ff9-700e-4614-8d24-d9cbe97c0dd7 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:21.383035 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-786b7ff9-700e-4614-8d24-d9cbe97c0dd7 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:21.383564 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-786b7ff9-700e-4614-8d24-d9cbe97c0dd7 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:21.395920 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9cda796a-d07e-4d6a-a8be-8bbab6cc40b5 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:21.408152 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9cda796a-d07e-4d6a-a8be-8bbab6cc40b5 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/c8c84d9e-2274-49dd-99e9-cbd7222c22d5" status: 200 len: 1496 microversion: 2.1 time: 0.404999 Oct 04 18:33:21.421562 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 664/1371] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:21 2022] GET /compute/v2.1/servers/c8c84d9e-2274-49dd-99e9-cbd7222c22d5 => generated 1496 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:21.437663 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-52565576-2236-45bc-a877-d18261ff348e tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:21.438626 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-52565576-2236-45bc-a877-d18261ff348e tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] [instance: 89a512b5-8107-4c63-8387-69892fc7e5f4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:21.518596 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-52565576-2236-45bc-a877-d18261ff348e tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697ff4892d1f4c559523990779ccfaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2759ed7f36eb4693aa74b76f7907899e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:21.532327 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-52565576-2236-45bc-a877-d18261ff348e tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] 10.222.0.20 "GET /compute/v2.1/servers/89a512b5-8107-4c63-8387-69892fc7e5f4" status: 200 len: 1226 microversion: 2.1 time: 0.096735 Oct 04 18:33:21.533296 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 665/1372] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:21 2022] GET /compute/v2.1/servers/89a512b5-8107-4c63-8387-69892fc7e5f4 => generated 1226 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:33:21.545789 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-786b7ff9-700e-4614-8d24-d9cbe97c0dd7 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:21.550091 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-21d4fc32-6982-4d5a-9739-a1342d172321 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1969939927", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "c818f9a1-106b-4ff1-9224-1d8b0b8129fc"}], "security_groups": [{"name": "tempest-securitygroup--478414261"}], "key_name": "tempest-keypair-216215324", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:21.563778 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-786b7ff9-700e-4614-8d24-d9cbe97c0dd7 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:21.566293 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-786b7ff9-700e-4614-8d24-d9cbe97c0dd7 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:21.573146 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-786b7ff9-700e-4614-8d24-d9cbe97c0dd7 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1537 microversion: 2.91 time: 0.226604 Oct 04 18:33:21.574651 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 708/1373] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:21 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1537 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:21.700658 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-59f23f14-95cf-43c9-bfa3-18d998f884d1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3c346ae8-91cb-4213-9900-9dc53e5db5f7", "device": "/dev/xvdb"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:21.708570 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-59f23f14-95cf-43c9-bfa3-18d998f884d1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: b219d988-2847-45a0-a3b8-af54cf1a43f8] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:21.715524 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-59f23f14-95cf-43c9-bfa3-18d998f884d1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:21.716459 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-59f23f14-95cf-43c9-bfa3-18d998f884d1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:21.717071 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-59f23f14-95cf-43c9-bfa3-18d998f884d1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:21.718120 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-59f23f14-95cf-43c9-bfa3-18d998f884d1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:21.718879 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-59f23f14-95cf-43c9-bfa3-18d998f884d1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:21.719700 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-59f23f14-95cf-43c9-bfa3-18d998f884d1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:21.723707 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.neutron [None req-21d4fc32-6982-4d5a-9739-a1342d172321 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] validate_networks() for [('c818f9a1-106b-4ff1-9224-1d8b0b8129fc', None, None, None, None, None)] {{(pid=123001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:33:22.536872 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-21d4fc32-6982-4d5a-9739-a1342d172321 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Getting quotas for project bc7808c2a8d8491aa5e1594383fab2a3. Resources: dict_keys(['metadata_items']) {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:33:22.547275 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-21d4fc32-6982-4d5a-9739-a1342d172321 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Getting quotas for user 71bed3af030c43dbaa23a3e23520f407 and project bc7808c2a8d8491aa5e1594383fab2a3. Resources: dict_keys(['metadata_items']) {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:33:22.563403 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-21d4fc32-6982-4d5a-9739-a1342d172321 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:33:22.567290 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-21d4fc32-6982-4d5a-9739-a1342d172321 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:33:22.567290 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-21d4fc32-6982-4d5a-9739-a1342d172321 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:33:22.567290 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-21d4fc32-6982-4d5a-9739-a1342d172321 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:33:22.567290 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-21d4fc32-6982-4d5a-9739-a1342d172321 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:33:22.574416 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-21d4fc32-6982-4d5a-9739-a1342d172321 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:22.575223 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-21d4fc32-6982-4d5a-9739-a1342d172321 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:22.575862 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-21d4fc32-6982-4d5a-9739-a1342d172321 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:22.576896 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-21d4fc32-6982-4d5a-9739-a1342d172321 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:22.577580 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-21d4fc32-6982-4d5a-9739-a1342d172321 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:22.578414 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-21d4fc32-6982-4d5a-9739-a1342d172321 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:22.603318 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-21d4fc32-6982-4d5a-9739-a1342d172321 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Getting quotas for project bc7808c2a8d8491aa5e1594383fab2a3. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:33:22.612602 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-21d4fc32-6982-4d5a-9739-a1342d172321 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Getting quotas for user 71bed3af030c43dbaa23a3e23520f407 and project bc7808c2a8d8491aa5e1594383fab2a3. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:33:22.631183 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-21d4fc32-6982-4d5a-9739-a1342d172321 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Going to run 1 instances... {{(pid=123001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:33:22.634514 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-21d4fc32-6982-4d5a-9739-a1342d172321 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] [instance: bc418c02-1d95-407f-bbda-c696e9ba5959] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:33:22.706363 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-59f23f14-95cf-43c9-bfa3-18d998f884d1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "POST /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 1.011064 Oct 04 18:33:22.712374 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 709/1374] 10.222.0.20 () {62 vars in 1364 bytes} [Tue Oct 4 18:33:21 2022] POST /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8/os-volume_attachments => generated 194 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 18:33:22.744154 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0786f3ce-5411-48c8-a317-ecbb295b429f tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:22.745152 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0786f3ce-5411-48c8-a317-ecbb295b429f tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] [instance: ba5fa602-5596-4e3f-a0a4-7c88dc89cd16] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:22.758130 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0786f3ce-5411-48c8-a317-ecbb295b429f tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:22.758792 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0786f3ce-5411-48c8-a317-ecbb295b429f tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:22.759226 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0786f3ce-5411-48c8-a317-ecbb295b429f tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:22.759930 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0786f3ce-5411-48c8-a317-ecbb295b429f tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:22.760407 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0786f3ce-5411-48c8-a317-ecbb295b429f tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:22.760819 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0786f3ce-5411-48c8-a317-ecbb295b429f tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:22.814148 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-21d4fc32-6982-4d5a-9739-a1342d172321 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.279660 Oct 04 18:33:22.814866 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 666/1375] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:33:21 2022] POST /compute/v2.1/servers => generated 406 bytes in 1281 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:33:22.829888 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b70d6ab7-eb40-4ba9-aac3-d88d0c90e507 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:22.830704 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b70d6ab7-eb40-4ba9-aac3-d88d0c90e507 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: c8c84d9e-2274-49dd-99e9-cbd7222c22d5] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:22.838473 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b70d6ab7-eb40-4ba9-aac3-d88d0c90e507 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:22.838978 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b70d6ab7-eb40-4ba9-aac3-d88d0c90e507 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:22.839502 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b70d6ab7-eb40-4ba9-aac3-d88d0c90e507 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:22.840998 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b70d6ab7-eb40-4ba9-aac3-d88d0c90e507 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:22.841466 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b70d6ab7-eb40-4ba9-aac3-d88d0c90e507 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:22.841952 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b70d6ab7-eb40-4ba9-aac3-d88d0c90e507 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:22.971492 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0786f3ce-5411-48c8-a317-ecbb295b429f tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6ff8f5b6c58416b82eb6765a209b344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064cbc5ef6a4f5c9df672a3b8668040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:22.982281 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0786f3ce-5411-48c8-a317-ecbb295b429f tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] 10.222.0.20 "GET /compute/v2.1/servers/ba5fa602-5596-4e3f-a0a4-7c88dc89cd16" status: 200 len: 1319 microversion: 2.1 time: 0.273991 Oct 04 18:33:22.987192 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 710/1376] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:22 2022] GET /compute/v2.1/servers/ba5fa602-5596-4e3f-a0a4-7c88dc89cd16 => generated 1319 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:23.001855 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-117beaa9-05bc-4aa8-94b3-e57710a521f7 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:23.004262 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-117beaa9-05bc-4aa8-94b3-e57710a521f7 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] [instance: 89a512b5-8107-4c63-8387-69892fc7e5f4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:23.025453 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:23.027910 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-117beaa9-05bc-4aa8-94b3-e57710a521f7 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:23.032107 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-117beaa9-05bc-4aa8-94b3-e57710a521f7 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:23.041385 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-117beaa9-05bc-4aa8-94b3-e57710a521f7 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:23.042283 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-117beaa9-05bc-4aa8-94b3-e57710a521f7 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:23.046939 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-117beaa9-05bc-4aa8-94b3-e57710a521f7 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:23.046939 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-117beaa9-05bc-4aa8-94b3-e57710a521f7 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:23.050603 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b70d6ab7-eb40-4ba9-aac3-d88d0c90e507 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:23.062838 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b70d6ab7-eb40-4ba9-aac3-d88d0c90e507 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/c8c84d9e-2274-49dd-99e9-cbd7222c22d5" status: 200 len: 1496 microversion: 2.1 time: 0.246583 Oct 04 18:33:23.064142 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 667/1377] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:22 2022] GET /compute/v2.1/servers/c8c84d9e-2274-49dd-99e9-cbd7222c22d5 => generated 1496 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:23.071445 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-13662508-cda1-426a-8918-705c3e0ae4be tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:23.072791 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-13662508-cda1-426a-8918-705c3e0ae4be tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:23.083654 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-13662508-cda1-426a-8918-705c3e0ae4be tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:23.084365 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-13662508-cda1-426a-8918-705c3e0ae4be tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:23.084891 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-13662508-cda1-426a-8918-705c3e0ae4be tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:23.085675 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-13662508-cda1-426a-8918-705c3e0ae4be tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:23.086215 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-13662508-cda1-426a-8918-705c3e0ae4be tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:23.086701 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-13662508-cda1-426a-8918-705c3e0ae4be tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:23.211120 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-117beaa9-05bc-4aa8-94b3-e57710a521f7 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697ff4892d1f4c559523990779ccfaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2759ed7f36eb4693aa74b76f7907899e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:23.219565 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-117beaa9-05bc-4aa8-94b3-e57710a521f7 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] 10.222.0.20 "GET /compute/v2.1/servers/89a512b5-8107-4c63-8387-69892fc7e5f4" status: 200 len: 1278 microversion: 2.1 time: 0.231287 Oct 04 18:33:23.220464 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 711/1378] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:22 2022] GET /compute/v2.1/servers/89a512b5-8107-4c63-8387-69892fc7e5f4 => generated 1278 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:23.221448 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-13662508-cda1-426a-8918-705c3e0ae4be tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:23.230978 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-13662508-cda1-426a-8918-705c3e0ae4be tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:23.232534 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-13662508-cda1-426a-8918-705c3e0ae4be tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:23.233984 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-af22472e-df44-4a9c-a303-77331ecdfc03 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:23.234895 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-af22472e-df44-4a9c-a303-77331ecdfc03 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] [instance: bc418c02-1d95-407f-bbda-c696e9ba5959] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:23.238284 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-13662508-cda1-426a-8918-705c3e0ae4be tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1537 microversion: 2.91 time: 0.172501 Oct 04 18:33:23.252089 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 668/1379] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:23 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1537 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:23.311106 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-af22472e-df44-4a9c-a303-77331ecdfc03 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bed3af030c43dbaa23a3e23520f407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7808c2a8d8491aa5e1594383fab2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:23.319379 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-af22472e-df44-4a9c-a303-77331ecdfc03 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] 10.222.0.20 "GET /compute/v2.1/servers/bc418c02-1d95-407f-bbda-c696e9ba5959" status: 200 len: 1269 microversion: 2.1 time: 0.097773 Oct 04 18:33:23.320833 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 712/1380] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:23 2022] GET /compute/v2.1/servers/bc418c02-1d95-407f-bbda-c696e9ba5959 => generated 1269 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:24.012862 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3b5e065d-1105-4721-862e-01861f3f3a88 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:24.014128 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3b5e065d-1105-4721-862e-01861f3f3a88 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] [instance: ba5fa602-5596-4e3f-a0a4-7c88dc89cd16] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:24.029091 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3b5e065d-1105-4721-862e-01861f3f3a88 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:24.030034 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3b5e065d-1105-4721-862e-01861f3f3a88 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:24.032610 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3b5e065d-1105-4721-862e-01861f3f3a88 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:24.033420 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3b5e065d-1105-4721-862e-01861f3f3a88 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:24.034209 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3b5e065d-1105-4721-862e-01861f3f3a88 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:24.038733 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3b5e065d-1105-4721-862e-01861f3f3a88 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:24.091073 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-437457b5-5389-463c-b492-830278c5b71b tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:24.094002 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-437457b5-5389-463c-b492-830278c5b71b tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: c8c84d9e-2274-49dd-99e9-cbd7222c22d5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:24.109984 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-437457b5-5389-463c-b492-830278c5b71b tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:24.112661 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-437457b5-5389-463c-b492-830278c5b71b tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:24.113480 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-437457b5-5389-463c-b492-830278c5b71b tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:24.115264 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-437457b5-5389-463c-b492-830278c5b71b tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:24.116425 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-437457b5-5389-463c-b492-830278c5b71b tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:24.117110 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-437457b5-5389-463c-b492-830278c5b71b tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:24.244413 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3b5e065d-1105-4721-862e-01861f3f3a88 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6ff8f5b6c58416b82eb6765a209b344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064cbc5ef6a4f5c9df672a3b8668040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:24.252937 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3b5e065d-1105-4721-862e-01861f3f3a88 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] 10.222.0.20 "GET /compute/v2.1/servers/ba5fa602-5596-4e3f-a0a4-7c88dc89cd16" status: 200 len: 1469 microversion: 2.1 time: 0.247022 Oct 04 18:33:24.253814 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 669/1381] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:24 2022] GET /compute/v2.1/servers/ba5fa602-5596-4e3f-a0a4-7c88dc89cd16 => generated 1469 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:24.261101 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7309adbe-c78c-4617-9303-ac51425e1c0c tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:24.262348 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7309adbe-c78c-4617-9303-ac51425e1c0c tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] [instance: 89a512b5-8107-4c63-8387-69892fc7e5f4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:24.286624 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7309adbe-c78c-4617-9303-ac51425e1c0c tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:24.287460 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7309adbe-c78c-4617-9303-ac51425e1c0c tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:24.288141 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7309adbe-c78c-4617-9303-ac51425e1c0c tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:24.289035 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7309adbe-c78c-4617-9303-ac51425e1c0c tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:24.289646 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7309adbe-c78c-4617-9303-ac51425e1c0c tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:24.290243 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7309adbe-c78c-4617-9303-ac51425e1c0c tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:24.421088 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7309adbe-c78c-4617-9303-ac51425e1c0c tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697ff4892d1f4c559523990779ccfaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2759ed7f36eb4693aa74b76f7907899e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:24.437266 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7309adbe-c78c-4617-9303-ac51425e1c0c tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] 10.222.0.20 "GET /compute/v2.1/servers/89a512b5-8107-4c63-8387-69892fc7e5f4" status: 200 len: 1296 microversion: 2.1 time: 0.181475 Oct 04 18:33:24.437882 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 670/1382] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:24 2022] GET /compute/v2.1/servers/89a512b5-8107-4c63-8387-69892fc7e5f4 => generated 1296 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:24.443091 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-795ea3fb-4652-424c-b1d5-fdc82fb0d15c tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:24.443706 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-795ea3fb-4652-424c-b1d5-fdc82fb0d15c tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:24.449725 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-795ea3fb-4652-424c-b1d5-fdc82fb0d15c tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:24.450455 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-795ea3fb-4652-424c-b1d5-fdc82fb0d15c tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:24.451064 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-795ea3fb-4652-424c-b1d5-fdc82fb0d15c tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:24.451918 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-795ea3fb-4652-424c-b1d5-fdc82fb0d15c tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:24.452601 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-795ea3fb-4652-424c-b1d5-fdc82fb0d15c tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:24.453302 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-795ea3fb-4652-424c-b1d5-fdc82fb0d15c tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:24.478146 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-437457b5-5389-463c-b492-830278c5b71b tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:24.488385 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-437457b5-5389-463c-b492-830278c5b71b tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/c8c84d9e-2274-49dd-99e9-cbd7222c22d5" status: 200 len: 1496 microversion: 2.1 time: 0.402349 Oct 04 18:33:24.489432 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 713/1383] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:24 2022] GET /compute/v2.1/servers/c8c84d9e-2274-49dd-99e9-cbd7222c22d5 => generated 1496 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:33:24.548450 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-795ea3fb-4652-424c-b1d5-fdc82fb0d15c tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:24.557504 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-795ea3fb-4652-424c-b1d5-fdc82fb0d15c tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:24.559226 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-795ea3fb-4652-424c-b1d5-fdc82fb0d15c tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:24.565184 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-795ea3fb-4652-424c-b1d5-fdc82fb0d15c tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1537 microversion: 2.91 time: 0.126302 Oct 04 18:33:24.565776 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 671/1384] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:24 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1537 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:24.594027 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-55d727a2-a748-43b8-b0b2-483a267ba75d tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:24.597003 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-55d727a2-a748-43b8-b0b2-483a267ba75d tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] [instance: bc418c02-1d95-407f-bbda-c696e9ba5959] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:24.605116 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-55d727a2-a748-43b8-b0b2-483a267ba75d tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:24.605668 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-55d727a2-a748-43b8-b0b2-483a267ba75d tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:24.606177 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-55d727a2-a748-43b8-b0b2-483a267ba75d tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:24.606891 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-55d727a2-a748-43b8-b0b2-483a267ba75d tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:24.607354 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-55d727a2-a748-43b8-b0b2-483a267ba75d tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:24.607802 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-55d727a2-a748-43b8-b0b2-483a267ba75d tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:24.693728 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-55d727a2-a748-43b8-b0b2-483a267ba75d tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bed3af030c43dbaa23a3e23520f407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7808c2a8d8491aa5e1594383fab2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:24.704668 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-55d727a2-a748-43b8-b0b2-483a267ba75d tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] 10.222.0.20 "GET /compute/v2.1/servers/bc418c02-1d95-407f-bbda-c696e9ba5959" status: 200 len: 1273 microversion: 2.1 time: 0.116334 Oct 04 18:33:24.707329 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 672/1385] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:24 2022] GET /compute/v2.1/servers/bc418c02-1d95-407f-bbda-c696e9ba5959 => generated 1273 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:24.880944 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6c232bec-8880-482f-b4b3-14f206ff3e54 tempest-LiveMigrationNegativeTest-168754894 tempest-LiveMigrationNegativeTest-168754894-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-1051818190", "block_migration": true, "disk_over_commit": false}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:24.902455 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-6c232bec-8880-482f-b4b3-14f206ff3e54 tempest-LiveMigrationNegativeTest-168754894 tempest-LiveMigrationNegativeTest-168754894-project-admin] [instance: ba5fa602-5596-4e3f-a0a4-7c88dc89cd16] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:24.918427 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6c232bec-8880-482f-b4b3-14f206ff3e54 tempest-LiveMigrationNegativeTest-168754894 tempest-LiveMigrationNegativeTest-168754894-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:24.938252 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6c232bec-8880-482f-b4b3-14f206ff3e54 tempest-LiveMigrationNegativeTest-168754894 tempest-LiveMigrationNegativeTest-168754894-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:24.940369 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6c232bec-8880-482f-b4b3-14f206ff3e54 tempest-LiveMigrationNegativeTest-168754894 tempest-LiveMigrationNegativeTest-168754894-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:24.941326 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6c232bec-8880-482f-b4b3-14f206ff3e54 tempest-LiveMigrationNegativeTest-168754894 tempest-LiveMigrationNegativeTest-168754894-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:24.945165 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6c232bec-8880-482f-b4b3-14f206ff3e54 tempest-LiveMigrationNegativeTest-168754894 tempest-LiveMigrationNegativeTest-168754894-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:24.947481 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6c232bec-8880-482f-b4b3-14f206ff3e54 tempest-LiveMigrationNegativeTest-168754894 tempest-LiveMigrationNegativeTest-168754894-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:25.032191 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-6c232bec-8880-482f-b4b3-14f206ff3e54 tempest-LiveMigrationNegativeTest-168754894 tempest-LiveMigrationNegativeTest-168754894-project-admin] Lazy-loading 'flavor' on Instance uuid ba5fa602-5596-4e3f-a0a4-7c88dc89cd16 {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:33:25.058514 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-6c232bec-8880-482f-b4b3-14f206ff3e54 tempest-LiveMigrationNegativeTest-168754894 tempest-LiveMigrationNegativeTest-168754894-project-admin] [instance: ba5fa602-5596-4e3f-a0a4-7c88dc89cd16] Going to try to live migrate instance to tempest-host-1051818190 {{(pid=123002) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 18:33:25.066669 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-6c232bec-8880-482f-b4b3-14f206ff3e54 tempest-LiveMigrationNegativeTest-168754894 tempest-LiveMigrationNegativeTest-168754894-project-admin] HTTP exception thrown: Compute host tempest-host-1051818190 could not be found. Oct 04 18:33:25.072429 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6c232bec-8880-482f-b4b3-14f206ff3e54 tempest-LiveMigrationNegativeTest-168754894 tempest-LiveMigrationNegativeTest-168754894-project-admin] Request method failure captured: Oct 04 18:33:25.072429 n-d-850501-14 devstack@n-api.service[123002]: request: POST /compute/v2.1/servers/ba5fa602-5596-4e3f-a0a4-7c88dc89cd16/action HTTP/1.1 Oct 04 18:33:25.072429 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:33:25.072429 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:33:25.072429 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:33:25.072429 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 107 Oct 04 18:33:25.072429 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:33:25.072429 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:33:25.072429 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:33:25.072429 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:33:25.072429 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPHxclMCp23AHlWTCOfUXxBznZn5tXniE-oMGfAlLY-R0GQskpYiN0Mb93D5lNNgRXhn6vuFaVjubqzsGSZrCfvJi0mEsTvBOY0RZmz4NXXD5DN0tXRt1C0SQUFK5Xahydife8XDhV2JX4U4DaXtzmiFn2WopeiG57SUNwG2kfdSSTF8 Oct 04 18:33:25.072429 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:33:25.072429 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:33:25.072429 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:33:25.072429 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:33:25.072429 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:33:25.072429 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:33:25.072429 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 65d7c0ca17414d3c8f3bb75261001dfc Oct 04 18:33:25.072429 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-LiveMigrationNegativeTest-168754894 Oct 04 18:33:25.072429 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member,admin Oct 04 18:33:25.072429 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member,admin Oct 04 18:33:25.072429 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/65d7c0ca17414d3c8f3bb75261001dfc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_65d7c0ca17414d3c8f3bb75261001dfc", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/65d7c0ca17414d3c8f3bb75261001dfc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/65d7c0ca17414d3c8f3bb75261001dfc"}]}] Oct 04 18:33:25.072429 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-LiveMigrationNegativeTest-168754894 Oct 04 18:33:25.072429 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 65d7c0ca17414d3c8f3bb75261001dfc Oct 04 18:33:25.072429 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-168754894 Oct 04 18:33:25.072429 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-LiveMigrationNegativeTest-168754894-project-admin Oct 04 18:33:25.072429 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:33:25.072429 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:33:25.072429 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: fc74a6a01673400bacee588ad761456d Oct 04 18:33:25.072429 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-LiveMigrationNegativeTest-168754894-project-admin Oct 04 18:33:25.072429 n-d-850501-14 devstack@n-api.service[123002]: Oct 04 18:33:25.072429 n-d-850501-14 devstack@n-api.service[123002]: {"os-migrateLive": {"host": "tempest-host-1051818190", "block_migration": true, "disk_over_commit": false}} Oct 04 18:33:25.072429 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:33:25.072429 n-d-850501-14 devstack@n-api.service[123002]: exception: Compute host tempest-host-1051818190 could not be found. Oct 04 18:33:25.072429 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'ba5fa602-5596-4e3f-a0a4-7c88dc89cd16', 'body': {'os-migrateLive': {'host': 'tempest-host-1051818190', 'block_migration': True, 'disk_over_commit': False}}} Oct 04 18:33:25.072429 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:33:25.072429 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:25.072429 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 04 18:33:25.072429 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 04 18:33:25.072429 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 04 18:33:25.072429 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:33:25.072429 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 04 18:33:25.072429 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 18:33:25.072429 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 04 18:33:25.072429 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 18:33:25.072429 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 18:33:25.072429 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 18:33:25.072429 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 04 18:33:25.072429 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 18:33:25.072429 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 04 18:33:25.072429 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 18:33:25.072429 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:33:25.072429 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:33:25.072429 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 04 18:33:25.072429 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 18:33:25.072429 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5488, in live_migrate Oct 04 18:33:25.072429 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Oct 04 18:33:25.072429 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:33:25.072429 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:33:25.072429 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Oct 04 18:33:25.072429 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Oct 04 18:33:25.079972 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Oct 04 18:33:25.079972 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:33:25.079972 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Oct 04 18:33:25.079972 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Oct 04 18:33:25.079972 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Oct 04 18:33:25.079972 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Oct 04 18:33:25.079972 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Oct 04 18:33:25.079972 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Oct 04 18:33:25.079972 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-1051818190 could not be found. Oct 04 18:33:25.079972 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:33:25.079972 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:25.079972 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:33:25.079972 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:25.079972 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:25.079972 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:25.079972 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:33:25.079972 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:33:25.079972 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:33:25.079972 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:33:25.079972 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:33:25.079972 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:33:25.079972 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:33:25.079972 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:33:25.079972 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:33:25.079972 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:33:25.079972 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 04 18:33:25.079972 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Oct 04 18:33:25.079972 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 04 18:33:25.079972 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-1051818190 could not be found. Oct 04 18:33:25.079972 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:33:25.079972 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:25.079972 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:33:25.079972 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:25.079972 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:25.079972 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:25.079972 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:33:25.079972 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:33:25.079972 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-1051818190 could not be found. Oct 04 18:33:25.079972 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:33:25.079972 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6c232bec-8880-482f-b4b3-14f206ff3e54 tempest-LiveMigrationNegativeTest-168754894 tempest-LiveMigrationNegativeTest-168754894-project-admin] Returning 400 to user: Compute host tempest-host-1051818190 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:33:25.079972 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6c232bec-8880-482f-b4b3-14f206ff3e54 tempest-LiveMigrationNegativeTest-168754894 tempest-LiveMigrationNegativeTest-168754894-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/ba5fa602-5596-4e3f-a0a4-7c88dc89cd16/action" status: 400 len: 100 microversion: 2.1 time: 0.583558 Oct 04 18:33:25.079972 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 714/1386] 10.222.0.20 () {60 vars in 1279 bytes} [Tue Oct 4 18:33:24 2022] POST /compute/v2.1/servers/ba5fa602-5596-4e3f-a0a4-7c88dc89cd16/action => generated 100 bytes in 584 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:33:25.087096 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1ccff5fb-fc98-4238-be3d-ffe7fc2578b1 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:25.087096 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1ccff5fb-fc98-4238-be3d-ffe7fc2578b1 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] [instance: ba5fa602-5596-4e3f-a0a4-7c88dc89cd16] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:25.089925 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:25.115769 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1ccff5fb-fc98-4238-be3d-ffe7fc2578b1 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:25.118762 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1ccff5fb-fc98-4238-be3d-ffe7fc2578b1 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:25.119219 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1ccff5fb-fc98-4238-be3d-ffe7fc2578b1 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:25.122995 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1ccff5fb-fc98-4238-be3d-ffe7fc2578b1 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:25.123520 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1ccff5fb-fc98-4238-be3d-ffe7fc2578b1 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:25.126426 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1ccff5fb-fc98-4238-be3d-ffe7fc2578b1 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:25.471721 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1ccff5fb-fc98-4238-be3d-ffe7fc2578b1 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6ff8f5b6c58416b82eb6765a209b344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064cbc5ef6a4f5c9df672a3b8668040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:25.474708 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0c0e866e-fcf5-4a86-b28a-36ba042b8cf7 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:25.477494 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0c0e866e-fcf5-4a86-b28a-36ba042b8cf7 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] [instance: 89a512b5-8107-4c63-8387-69892fc7e5f4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:25.493625 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1ccff5fb-fc98-4238-be3d-ffe7fc2578b1 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] 10.222.0.20 "GET /compute/v2.1/servers/ba5fa602-5596-4e3f-a0a4-7c88dc89cd16" status: 200 len: 1469 microversion: 2.1 time: 0.413772 Oct 04 18:33:25.497223 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0c0e866e-fcf5-4a86-b28a-36ba042b8cf7 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:25.497761 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 673/1387] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:25 2022] GET /compute/v2.1/servers/ba5fa602-5596-4e3f-a0a4-7c88dc89cd16 => generated 1469 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:25.522271 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0c0e866e-fcf5-4a86-b28a-36ba042b8cf7 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:25.531309 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0c0e866e-fcf5-4a86-b28a-36ba042b8cf7 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:25.532834 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-02eac746-b33a-471f-ae8a-6628bbd835da tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:25.536489 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-02eac746-b33a-471f-ae8a-6628bbd835da tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: c8c84d9e-2274-49dd-99e9-cbd7222c22d5] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:25.543388 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0c0e866e-fcf5-4a86-b28a-36ba042b8cf7 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:25.543615 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-02eac746-b33a-471f-ae8a-6628bbd835da tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:25.545467 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0c0e866e-fcf5-4a86-b28a-36ba042b8cf7 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:25.546155 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0c0e866e-fcf5-4a86-b28a-36ba042b8cf7 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:25.546276 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-02eac746-b33a-471f-ae8a-6628bbd835da tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:25.546862 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-02eac746-b33a-471f-ae8a-6628bbd835da tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:25.547670 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-02eac746-b33a-471f-ae8a-6628bbd835da tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:25.548390 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-02eac746-b33a-471f-ae8a-6628bbd835da tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:25.548891 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-02eac746-b33a-471f-ae8a-6628bbd835da tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:25.839608 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-02eac746-b33a-471f-ae8a-6628bbd835da tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:25.847409 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-02eac746-b33a-471f-ae8a-6628bbd835da tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/c8c84d9e-2274-49dd-99e9-cbd7222c22d5" status: 200 len: 1496 microversion: 2.1 time: 0.322187 Oct 04 18:33:25.860219 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 674/1388] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:25 2022] GET /compute/v2.1/servers/c8c84d9e-2274-49dd-99e9-cbd7222c22d5 => generated 1496 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:25.860219 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5dd6bb59-4ba4-4765-9309-daccc1db8dcb tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:25.861509 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5dd6bb59-4ba4-4765-9309-daccc1db8dcb tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:25.875546 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5dd6bb59-4ba4-4765-9309-daccc1db8dcb tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:25.880964 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5dd6bb59-4ba4-4765-9309-daccc1db8dcb tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:25.881428 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5dd6bb59-4ba4-4765-9309-daccc1db8dcb tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:25.883874 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5dd6bb59-4ba4-4765-9309-daccc1db8dcb tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:25.884401 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5dd6bb59-4ba4-4765-9309-daccc1db8dcb tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:25.884846 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5dd6bb59-4ba4-4765-9309-daccc1db8dcb tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:25.922893 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0c0e866e-fcf5-4a86-b28a-36ba042b8cf7 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697ff4892d1f4c559523990779ccfaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2759ed7f36eb4693aa74b76f7907899e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:25.933462 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0c0e866e-fcf5-4a86-b28a-36ba042b8cf7 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] 10.222.0.20 "GET /compute/v2.1/servers/89a512b5-8107-4c63-8387-69892fc7e5f4" status: 200 len: 1352 microversion: 2.1 time: 0.466427 Oct 04 18:33:25.949466 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 715/1389] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:25 2022] GET /compute/v2.1/servers/89a512b5-8107-4c63-8387-69892fc7e5f4 => generated 1352 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:25.949466 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-dca5f7f5-1d27-4da1-8f50-bf637f0de80f tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1718819156", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:26.011992 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5dd6bb59-4ba4-4765-9309-daccc1db8dcb tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:26.030249 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5dd6bb59-4ba4-4765-9309-daccc1db8dcb tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:26.031663 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-dca5f7f5-1d27-4da1-8f50-bf637f0de80f tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] validate_networks() for None {{(pid=123002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:33:26.035367 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5dd6bb59-4ba4-4765-9309-daccc1db8dcb tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:26.046380 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5dd6bb59-4ba4-4765-9309-daccc1db8dcb tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1537 microversion: 2.91 time: 0.196620 Oct 04 18:33:26.047609 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 675/1390] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:25 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1537 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:26.061069 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a6dd389c-0223-467b-bf35-cf331e806235 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:26.062462 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a6dd389c-0223-467b-bf35-cf331e806235 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] [instance: bc418c02-1d95-407f-bbda-c696e9ba5959] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:26.072035 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a6dd389c-0223-467b-bf35-cf331e806235 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:26.073682 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a6dd389c-0223-467b-bf35-cf331e806235 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:26.073682 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a6dd389c-0223-467b-bf35-cf331e806235 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:26.075669 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a6dd389c-0223-467b-bf35-cf331e806235 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:26.076607 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a6dd389c-0223-467b-bf35-cf331e806235 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:26.077324 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a6dd389c-0223-467b-bf35-cf331e806235 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:26.231785 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a6dd389c-0223-467b-bf35-cf331e806235 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bed3af030c43dbaa23a3e23520f407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7808c2a8d8491aa5e1594383fab2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:26.244170 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a6dd389c-0223-467b-bf35-cf331e806235 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] 10.222.0.20 "GET /compute/v2.1/servers/bc418c02-1d95-407f-bbda-c696e9ba5959" status: 200 len: 1321 microversion: 2.1 time: 0.194754 Oct 04 18:33:26.245241 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 676/1391] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:26 2022] GET /compute/v2.1/servers/bc418c02-1d95-407f-bbda-c696e9ba5959 => generated 1321 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:26.404817 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-dca5f7f5-1d27-4da1-8f50-bf637f0de80f tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:33:26.405243 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-dca5f7f5-1d27-4da1-8f50-bf637f0de80f tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:33:26.405718 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-dca5f7f5-1d27-4da1-8f50-bf637f0de80f tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:33:26.406366 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-dca5f7f5-1d27-4da1-8f50-bf637f0de80f tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:33:26.406954 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-dca5f7f5-1d27-4da1-8f50-bf637f0de80f tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:33:26.417346 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dca5f7f5-1d27-4da1-8f50-bf637f0de80f tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:26.418018 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dca5f7f5-1d27-4da1-8f50-bf637f0de80f tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:26.418700 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dca5f7f5-1d27-4da1-8f50-bf637f0de80f tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:26.419727 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dca5f7f5-1d27-4da1-8f50-bf637f0de80f tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:26.420407 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dca5f7f5-1d27-4da1-8f50-bf637f0de80f tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:26.421058 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dca5f7f5-1d27-4da1-8f50-bf637f0de80f tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:26.441922 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-dca5f7f5-1d27-4da1-8f50-bf637f0de80f tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Getting quotas for project 8064cbc5ef6a4f5c9df672a3b8668040. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:33:26.448383 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-dca5f7f5-1d27-4da1-8f50-bf637f0de80f tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Getting quotas for user e6ff8f5b6c58416b82eb6765a209b344 and project 8064cbc5ef6a4f5c9df672a3b8668040. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:33:26.491758 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-dca5f7f5-1d27-4da1-8f50-bf637f0de80f tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Going to run 1 instances... {{(pid=123002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:33:26.495081 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-dca5f7f5-1d27-4da1-8f50-bf637f0de80f tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] [instance: 0948d595-51a2-41fb-b561-8255de0bc6a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:33:26.695735 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-dca5f7f5-1d27-4da1-8f50-bf637f0de80f tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.751661 Oct 04 18:33:26.697034 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 716/1392] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:33:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 755 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:33:26.709192 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ed697fa2-1662-4c6d-ac18-2feb7a33e210 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:26.715176 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ed697fa2-1662-4c6d-ac18-2feb7a33e210 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] [instance: 0948d595-51a2-41fb-b561-8255de0bc6a0] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:26.828190 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-f898d841-f196-4555-96c4-24163b00535a req-efd4d97d-68e1-48ab-9af4-2638513d18a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89a512b5-8107-4c63-8387-69892fc7e5f4", "tag": "92a0e1fe-3095-49a6-a363-561de4b984e4"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:26.844064 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-f898d841-f196-4555-96c4-24163b00535a req-efd4d97d-68e1-48ab-9af4-2638513d18a9 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:26.844810 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-f898d841-f196-4555-96c4-24163b00535a req-efd4d97d-68e1-48ab-9af4-2638513d18a9 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:26.845242 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-f898d841-f196-4555-96c4-24163b00535a req-efd4d97d-68e1-48ab-9af4-2638513d18a9 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:26.873331 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-f898d841-f196-4555-96c4-24163b00535a req-efd4d97d-68e1-48ab-9af4-2638513d18a9 service nova] Creating event network-changed:92a0e1fe-3095-49a6-a363-561de4b984e4 for instance 89a512b5-8107-4c63-8387-69892fc7e5f4 on n-h1-850501-14 Oct 04 18:33:26.886898 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-f898d841-f196-4555-96c4-24163b00535a req-efd4d97d-68e1-48ab-9af4-2638513d18a9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069273 Oct 04 18:33:26.887802 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 717/1393] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:33:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:33:26.901240 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-87fab54e-9228-4406-9d0a-eddd00ee114d tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:26.902341 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-87fab54e-9228-4406-9d0a-eddd00ee114d tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: c8c84d9e-2274-49dd-99e9-cbd7222c22d5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:26.916399 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-87fab54e-9228-4406-9d0a-eddd00ee114d tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:26.917614 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-87fab54e-9228-4406-9d0a-eddd00ee114d tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:26.922086 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-87fab54e-9228-4406-9d0a-eddd00ee114d tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:26.923057 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-87fab54e-9228-4406-9d0a-eddd00ee114d tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:26.924006 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-87fab54e-9228-4406-9d0a-eddd00ee114d tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:26.924702 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-87fab54e-9228-4406-9d0a-eddd00ee114d tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:27.010235 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ed697fa2-1662-4c6d-ac18-2feb7a33e210 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6ff8f5b6c58416b82eb6765a209b344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064cbc5ef6a4f5c9df672a3b8668040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:27.044711 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ed697fa2-1662-4c6d-ac18-2feb7a33e210 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] 10.222.0.20 "GET /compute/v2.1/servers/0948d595-51a2-41fb-b561-8255de0bc6a0" status: 200 len: 1219 microversion: 2.1 time: 0.338542 Oct 04 18:33:27.049333 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 677/1394] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:26 2022] GET /compute/v2.1/servers/0948d595-51a2-41fb-b561-8255de0bc6a0 => generated 1219 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:27.068750 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2c1bd9fc-35b4-4508-9091-7c2f9308e26b tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:27.073012 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2c1bd9fc-35b4-4508-9091-7c2f9308e26b tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] [instance: 89a512b5-8107-4c63-8387-69892fc7e5f4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:27.100531 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2c1bd9fc-35b4-4508-9091-7c2f9308e26b tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:27.102413 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2c1bd9fc-35b4-4508-9091-7c2f9308e26b tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:27.105338 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2c1bd9fc-35b4-4508-9091-7c2f9308e26b tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:27.110564 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2c1bd9fc-35b4-4508-9091-7c2f9308e26b tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:27.111466 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2c1bd9fc-35b4-4508-9091-7c2f9308e26b tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:27.113136 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2c1bd9fc-35b4-4508-9091-7c2f9308e26b tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:27.648398 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-87fab54e-9228-4406-9d0a-eddd00ee114d tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:27.659447 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-87fab54e-9228-4406-9d0a-eddd00ee114d tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/c8c84d9e-2274-49dd-99e9-cbd7222c22d5" status: 200 len: 1496 microversion: 2.1 time: 0.770170 Oct 04 18:33:27.663306 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 718/1395] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:26 2022] GET /compute/v2.1/servers/c8c84d9e-2274-49dd-99e9-cbd7222c22d5 => generated 1496 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:27.673862 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a034b671-19f8-4fb9-a5b9-d683e68ad779 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:27.674746 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a034b671-19f8-4fb9-a5b9-d683e68ad779 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:27.694705 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a034b671-19f8-4fb9-a5b9-d683e68ad779 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:27.695451 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a034b671-19f8-4fb9-a5b9-d683e68ad779 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:27.696150 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a034b671-19f8-4fb9-a5b9-d683e68ad779 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:27.697713 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a034b671-19f8-4fb9-a5b9-d683e68ad779 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:27.698452 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a034b671-19f8-4fb9-a5b9-d683e68ad779 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:27.699090 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a034b671-19f8-4fb9-a5b9-d683e68ad779 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:27.709031 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-2c1bd9fc-35b4-4508-9091-7c2f9308e26b tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697ff4892d1f4c559523990779ccfaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2759ed7f36eb4693aa74b76f7907899e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:27.721627 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2c1bd9fc-35b4-4508-9091-7c2f9308e26b tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] 10.222.0.20 "GET /compute/v2.1/servers/89a512b5-8107-4c63-8387-69892fc7e5f4" status: 200 len: 1352 microversion: 2.1 time: 0.669274 Oct 04 18:33:27.723928 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 678/1396] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:27 2022] GET /compute/v2.1/servers/89a512b5-8107-4c63-8387-69892fc7e5f4 => generated 1352 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:27.735573 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f078fc03-ccd1-4ba1-8bc1-3d1626e53732 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:27.744516 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f078fc03-ccd1-4ba1-8bc1-3d1626e53732 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] [instance: bc418c02-1d95-407f-bbda-c696e9ba5959] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:27.763439 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f078fc03-ccd1-4ba1-8bc1-3d1626e53732 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:27.769951 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f078fc03-ccd1-4ba1-8bc1-3d1626e53732 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:27.773110 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f078fc03-ccd1-4ba1-8bc1-3d1626e53732 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:27.775389 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f078fc03-ccd1-4ba1-8bc1-3d1626e53732 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:27.776756 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f078fc03-ccd1-4ba1-8bc1-3d1626e53732 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:27.779535 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f078fc03-ccd1-4ba1-8bc1-3d1626e53732 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:27.959411 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a034b671-19f8-4fb9-a5b9-d683e68ad779 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:27.960449 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f078fc03-ccd1-4ba1-8bc1-3d1626e53732 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bed3af030c43dbaa23a3e23520f407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7808c2a8d8491aa5e1594383fab2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:27.971407 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f078fc03-ccd1-4ba1-8bc1-3d1626e53732 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] 10.222.0.20 "GET /compute/v2.1/servers/bc418c02-1d95-407f-bbda-c696e9ba5959" status: 200 len: 1327 microversion: 2.1 time: 0.245142 Oct 04 18:33:27.972510 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 679/1397] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:27 2022] GET /compute/v2.1/servers/bc418c02-1d95-407f-bbda-c696e9ba5959 => generated 1327 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:27.977564 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a034b671-19f8-4fb9-a5b9-d683e68ad779 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:27.981893 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a034b671-19f8-4fb9-a5b9-d683e68ad779 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:27.997626 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a034b671-19f8-4fb9-a5b9-d683e68ad779 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1537 microversion: 2.91 time: 0.332863 Oct 04 18:33:27.998583 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 719/1398] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:27 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1537 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:28.074020 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-cfad4a32-b9c9-4b2e-90e2-018939a25685 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:28.075040 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-cfad4a32-b9c9-4b2e-90e2-018939a25685 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] [instance: 0948d595-51a2-41fb-b561-8255de0bc6a0] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:28.143854 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-cfad4a32-b9c9-4b2e-90e2-018939a25685 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6ff8f5b6c58416b82eb6765a209b344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064cbc5ef6a4f5c9df672a3b8668040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:28.154833 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-cfad4a32-b9c9-4b2e-90e2-018939a25685 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] 10.222.0.20 "GET /compute/v2.1/servers/0948d595-51a2-41fb-b561-8255de0bc6a0" status: 200 len: 1219 microversion: 2.1 time: 0.082722 Oct 04 18:33:28.168961 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 680/1399] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:28 2022] GET /compute/v2.1/servers/0948d595-51a2-41fb-b561-8255de0bc6a0 => generated 1219 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:28.693073 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7f7d69a8-87b9-40ff-8077-24299778bacf tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:28.693073 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7f7d69a8-87b9-40ff-8077-24299778bacf tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: c8c84d9e-2274-49dd-99e9-cbd7222c22d5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:28.700494 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7f7d69a8-87b9-40ff-8077-24299778bacf tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:28.701471 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7f7d69a8-87b9-40ff-8077-24299778bacf tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:28.701975 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7f7d69a8-87b9-40ff-8077-24299778bacf tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:28.708660 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7f7d69a8-87b9-40ff-8077-24299778bacf tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:28.723079 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7f7d69a8-87b9-40ff-8077-24299778bacf tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:28.723651 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7f7d69a8-87b9-40ff-8077-24299778bacf tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:28.746196 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5b68b23f-8d04-42e4-808b-04abd4cec8cb tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:28.746959 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5b68b23f-8d04-42e4-808b-04abd4cec8cb tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] [instance: 89a512b5-8107-4c63-8387-69892fc7e5f4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:28.757970 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5b68b23f-8d04-42e4-808b-04abd4cec8cb tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:28.764011 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5b68b23f-8d04-42e4-808b-04abd4cec8cb tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:28.764578 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5b68b23f-8d04-42e4-808b-04abd4cec8cb tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:28.765356 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5b68b23f-8d04-42e4-808b-04abd4cec8cb tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:28.765835 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5b68b23f-8d04-42e4-808b-04abd4cec8cb tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:28.766264 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5b68b23f-8d04-42e4-808b-04abd4cec8cb tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:29.144090 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5b68b23f-8d04-42e4-808b-04abd4cec8cb tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697ff4892d1f4c559523990779ccfaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2759ed7f36eb4693aa74b76f7907899e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:29.159109 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5b68b23f-8d04-42e4-808b-04abd4cec8cb tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] 10.222.0.20 "GET /compute/v2.1/servers/89a512b5-8107-4c63-8387-69892fc7e5f4" status: 200 len: 1352 microversion: 2.1 time: 0.416884 Oct 04 18:33:29.162429 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 681/1400] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:28 2022] GET /compute/v2.1/servers/89a512b5-8107-4c63-8387-69892fc7e5f4 => generated 1352 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:29.168208 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b3bf6fc4-368c-4158-b049-3b80a0471383 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:29.169050 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b3bf6fc4-368c-4158-b049-3b80a0471383 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] [instance: bc418c02-1d95-407f-bbda-c696e9ba5959] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:29.184207 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7f7d69a8-87b9-40ff-8077-24299778bacf tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:29.201634 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b3bf6fc4-368c-4158-b049-3b80a0471383 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:29.205256 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7f7d69a8-87b9-40ff-8077-24299778bacf tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/c8c84d9e-2274-49dd-99e9-cbd7222c22d5" status: 200 len: 1496 microversion: 2.1 time: 0.518872 Oct 04 18:33:29.206473 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b3bf6fc4-368c-4158-b049-3b80a0471383 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:29.208645 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 720/1401] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:28 2022] GET /compute/v2.1/servers/c8c84d9e-2274-49dd-99e9-cbd7222c22d5 => generated 1496 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:29.210202 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b3bf6fc4-368c-4158-b049-3b80a0471383 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:29.217946 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b3bf6fc4-368c-4158-b049-3b80a0471383 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:29.217946 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b3bf6fc4-368c-4158-b049-3b80a0471383 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:29.222714 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b3bf6fc4-368c-4158-b049-3b80a0471383 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:29.237346 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4aa41b0f-ca53-4d45-b8c1-8510a742bd98 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:29.237957 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4aa41b0f-ca53-4d45-b8c1-8510a742bd98 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:29.262545 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=100 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:29.263359 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4aa41b0f-ca53-4d45-b8c1-8510a742bd98 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:29.265077 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4aa41b0f-ca53-4d45-b8c1-8510a742bd98 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:29.265577 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4aa41b0f-ca53-4d45-b8c1-8510a742bd98 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:29.266322 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4aa41b0f-ca53-4d45-b8c1-8510a742bd98 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:29.266763 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4aa41b0f-ca53-4d45-b8c1-8510a742bd98 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:29.267185 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4aa41b0f-ca53-4d45-b8c1-8510a742bd98 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:29.278103 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:29.483920 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4aa41b0f-ca53-4d45-b8c1-8510a742bd98 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:29.509609 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4aa41b0f-ca53-4d45-b8c1-8510a742bd98 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:29.520254 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4aa41b0f-ca53-4d45-b8c1-8510a742bd98 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:29.539835 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4aa41b0f-ca53-4d45-b8c1-8510a742bd98 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1537 microversion: 2.91 time: 0.324922 Oct 04 18:33:29.540029 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 721/1402] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:29 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1537 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:29.567948 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6ec56c46-e191-4283-be64-1794dd18661c tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:29.578195 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-6ec56c46-e191-4283-be64-1794dd18661c tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] [instance: 0948d595-51a2-41fb-b561-8255de0bc6a0] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:29.586273 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6ec56c46-e191-4283-be64-1794dd18661c tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:29.591705 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6ec56c46-e191-4283-be64-1794dd18661c tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:29.591705 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6ec56c46-e191-4283-be64-1794dd18661c tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:29.591705 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6ec56c46-e191-4283-be64-1794dd18661c tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:29.591705 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6ec56c46-e191-4283-be64-1794dd18661c tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:29.591705 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6ec56c46-e191-4283-be64-1794dd18661c tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:29.767401 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-6ec56c46-e191-4283-be64-1794dd18661c tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6ff8f5b6c58416b82eb6765a209b344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064cbc5ef6a4f5c9df672a3b8668040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:29.776874 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6ec56c46-e191-4283-be64-1794dd18661c tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] 10.222.0.20 "GET /compute/v2.1/servers/0948d595-51a2-41fb-b561-8255de0bc6a0" status: 200 len: 1271 microversion: 2.1 time: 0.222153 Oct 04 18:33:29.777424 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 722/1403] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:29 2022] GET /compute/v2.1/servers/0948d595-51a2-41fb-b561-8255de0bc6a0 => generated 1271 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:29.872000 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b3bf6fc4-368c-4158-b049-3b80a0471383 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bed3af030c43dbaa23a3e23520f407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7808c2a8d8491aa5e1594383fab2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:29.885780 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b3bf6fc4-368c-4158-b049-3b80a0471383 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] 10.222.0.20 "GET /compute/v2.1/servers/bc418c02-1d95-407f-bbda-c696e9ba5959" status: 200 len: 1394 microversion: 2.1 time: 0.717766 Oct 04 18:33:29.886979 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 682/1404] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:29 2022] GET /compute/v2.1/servers/bc418c02-1d95-407f-bbda-c696e9ba5959 => generated 1394 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:30.119775 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-54b5df0b-e311-4e2b-9f33-5445c79c940c req-3de90f20-7073-4a62-8567-ab954ec6a4bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc418c02-1d95-407f-bbda-c696e9ba5959", "tag": "ba72231c-323b-48fb-83de-ea9aad878e62"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:30.136045 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-54b5df0b-e311-4e2b-9f33-5445c79c940c req-3de90f20-7073-4a62-8567-ab954ec6a4bb service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:30.140298 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-54b5df0b-e311-4e2b-9f33-5445c79c940c req-3de90f20-7073-4a62-8567-ab954ec6a4bb service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:30.142255 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-54b5df0b-e311-4e2b-9f33-5445c79c940c req-3de90f20-7073-4a62-8567-ab954ec6a4bb service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:30.167097 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-54b5df0b-e311-4e2b-9f33-5445c79c940c req-3de90f20-7073-4a62-8567-ab954ec6a4bb service nova] Creating event network-changed:ba72231c-323b-48fb-83de-ea9aad878e62 for instance bc418c02-1d95-407f-bbda-c696e9ba5959 on n-h1-850501-14 Oct 04 18:33:30.180095 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-54b5df0b-e311-4e2b-9f33-5445c79c940c req-3de90f20-7073-4a62-8567-ab954ec6a4bb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064223 Oct 04 18:33:30.181031 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 723/1405] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:33:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:33:30.185708 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b1d88ba6-509c-44de-89a2-78b11e9e1703 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:30.186420 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b1d88ba6-509c-44de-89a2-78b11e9e1703 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] [instance: 89a512b5-8107-4c63-8387-69892fc7e5f4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:30.212677 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b1d88ba6-509c-44de-89a2-78b11e9e1703 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:30.216657 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b1d88ba6-509c-44de-89a2-78b11e9e1703 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:30.218251 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b1d88ba6-509c-44de-89a2-78b11e9e1703 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:30.219264 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b1d88ba6-509c-44de-89a2-78b11e9e1703 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:30.231041 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b1d88ba6-509c-44de-89a2-78b11e9e1703 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:30.231881 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b1d88ba6-509c-44de-89a2-78b11e9e1703 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:30.232098 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-92391d50-c320-45ce-9a7f-25f3b4080c78 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:30.233050 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-92391d50-c320-45ce-9a7f-25f3b4080c78 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: c8c84d9e-2274-49dd-99e9-cbd7222c22d5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:30.245401 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-92391d50-c320-45ce-9a7f-25f3b4080c78 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:30.246473 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-92391d50-c320-45ce-9a7f-25f3b4080c78 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:30.249210 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-92391d50-c320-45ce-9a7f-25f3b4080c78 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:30.250190 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-92391d50-c320-45ce-9a7f-25f3b4080c78 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:30.250858 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-92391d50-c320-45ce-9a7f-25f3b4080c78 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:30.253990 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-92391d50-c320-45ce-9a7f-25f3b4080c78 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:30.954781 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-92391d50-c320-45ce-9a7f-25f3b4080c78 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:30.965140 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-92391d50-c320-45ce-9a7f-25f3b4080c78 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/c8c84d9e-2274-49dd-99e9-cbd7222c22d5" status: 200 len: 1496 microversion: 2.1 time: 0.737689 Oct 04 18:33:30.981977 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 724/1406] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:30 2022] GET /compute/v2.1/servers/c8c84d9e-2274-49dd-99e9-cbd7222c22d5 => generated 1496 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:30.985551 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b1d88ba6-509c-44de-89a2-78b11e9e1703 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697ff4892d1f4c559523990779ccfaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2759ed7f36eb4693aa74b76f7907899e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:30.998114 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b1d88ba6-509c-44de-89a2-78b11e9e1703 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] 10.222.0.20 "GET /compute/v2.1/servers/89a512b5-8107-4c63-8387-69892fc7e5f4" status: 200 len: 1352 microversion: 2.1 time: 0.816281 Oct 04 18:33:30.998873 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 683/1407] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:30 2022] GET /compute/v2.1/servers/89a512b5-8107-4c63-8387-69892fc7e5f4 => generated 1352 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:33:31.000221 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3c727aff-438b-45c3-9587-38fe52504e30 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:31.001001 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3c727aff-438b-45c3-9587-38fe52504e30 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:31.008321 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3c727aff-438b-45c3-9587-38fe52504e30 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:31.009027 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3c727aff-438b-45c3-9587-38fe52504e30 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:31.009651 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3c727aff-438b-45c3-9587-38fe52504e30 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:31.010515 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3c727aff-438b-45c3-9587-38fe52504e30 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:31.011879 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3c727aff-438b-45c3-9587-38fe52504e30 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:31.012478 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3c727aff-438b-45c3-9587-38fe52504e30 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:31.019000 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-42497985-486e-4b58-b994-4fe5de710987 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:31.019927 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-42497985-486e-4b58-b994-4fe5de710987 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] [instance: 0948d595-51a2-41fb-b561-8255de0bc6a0] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:31.039581 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-42497985-486e-4b58-b994-4fe5de710987 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:31.040919 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-42497985-486e-4b58-b994-4fe5de710987 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:31.041400 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-42497985-486e-4b58-b994-4fe5de710987 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:31.043905 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-42497985-486e-4b58-b994-4fe5de710987 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:31.044625 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-42497985-486e-4b58-b994-4fe5de710987 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:31.045592 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-42497985-486e-4b58-b994-4fe5de710987 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:31.129080 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3c727aff-438b-45c3-9587-38fe52504e30 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:31.140257 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3c727aff-438b-45c3-9587-38fe52504e30 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:31.142069 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3c727aff-438b-45c3-9587-38fe52504e30 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:31.147869 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3c727aff-438b-45c3-9587-38fe52504e30 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1537 microversion: 2.91 time: 0.151565 Oct 04 18:33:31.149031 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 725/1408] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:30 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1537 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:31.153901 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2e70b488-7175-4d3d-a3e2-19172fd03c36 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:31.154714 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2e70b488-7175-4d3d-a3e2-19172fd03c36 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] [instance: bc418c02-1d95-407f-bbda-c696e9ba5959] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:31.161522 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e70b488-7175-4d3d-a3e2-19172fd03c36 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:31.162216 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e70b488-7175-4d3d-a3e2-19172fd03c36 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:31.162838 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e70b488-7175-4d3d-a3e2-19172fd03c36 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:31.163710 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e70b488-7175-4d3d-a3e2-19172fd03c36 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:31.164370 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e70b488-7175-4d3d-a3e2-19172fd03c36 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:31.164956 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e70b488-7175-4d3d-a3e2-19172fd03c36 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:31.166591 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-42497985-486e-4b58-b994-4fe5de710987 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6ff8f5b6c58416b82eb6765a209b344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064cbc5ef6a4f5c9df672a3b8668040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:31.186687 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-42497985-486e-4b58-b994-4fe5de710987 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] 10.222.0.20 "GET /compute/v2.1/servers/0948d595-51a2-41fb-b561-8255de0bc6a0" status: 200 len: 1277 microversion: 2.1 time: 0.185095 Oct 04 18:33:31.188483 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 684/1409] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:31 2022] GET /compute/v2.1/servers/0948d595-51a2-41fb-b561-8255de0bc6a0 => generated 1277 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:31.319189 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2e70b488-7175-4d3d-a3e2-19172fd03c36 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bed3af030c43dbaa23a3e23520f407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7808c2a8d8491aa5e1594383fab2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:31.329352 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2e70b488-7175-4d3d-a3e2-19172fd03c36 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] 10.222.0.20 "GET /compute/v2.1/servers/bc418c02-1d95-407f-bbda-c696e9ba5959" status: 200 len: 1394 microversion: 2.1 time: 0.178950 Oct 04 18:33:31.330123 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 726/1410] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:31 2022] GET /compute/v2.1/servers/bc418c02-1d95-407f-bbda-c696e9ba5959 => generated 1394 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:32.008717 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f104aa09-df8f-41ac-a463-d51781a4b3ca tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:32.010640 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f104aa09-df8f-41ac-a463-d51781a4b3ca tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: c8c84d9e-2274-49dd-99e9-cbd7222c22d5] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:32.025023 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f104aa09-df8f-41ac-a463-d51781a4b3ca tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:32.025023 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f104aa09-df8f-41ac-a463-d51781a4b3ca tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:32.025425 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f104aa09-df8f-41ac-a463-d51781a4b3ca tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:32.040232 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8fbb0e57-d169-48c3-abe6-42a963c3f179 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:32.042558 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8fbb0e57-d169-48c3-abe6-42a963c3f179 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] [instance: 89a512b5-8107-4c63-8387-69892fc7e5f4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:32.046813 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f104aa09-df8f-41ac-a463-d51781a4b3ca tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:32.047571 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f104aa09-df8f-41ac-a463-d51781a4b3ca tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:32.049398 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f104aa09-df8f-41ac-a463-d51781a4b3ca tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:32.062244 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8fbb0e57-d169-48c3-abe6-42a963c3f179 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:32.065565 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8fbb0e57-d169-48c3-abe6-42a963c3f179 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:32.066625 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8fbb0e57-d169-48c3-abe6-42a963c3f179 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:32.069037 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8fbb0e57-d169-48c3-abe6-42a963c3f179 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:32.071683 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8fbb0e57-d169-48c3-abe6-42a963c3f179 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:32.072729 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8fbb0e57-d169-48c3-abe6-42a963c3f179 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:32.375922 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8fbb0e57-d169-48c3-abe6-42a963c3f179 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697ff4892d1f4c559523990779ccfaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2759ed7f36eb4693aa74b76f7907899e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:32.386044 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8fbb0e57-d169-48c3-abe6-42a963c3f179 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] 10.222.0.20 "GET /compute/v2.1/servers/89a512b5-8107-4c63-8387-69892fc7e5f4" status: 200 len: 1352 microversion: 2.1 time: 0.357792 Oct 04 18:33:32.387475 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 727/1411] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:32 2022] GET /compute/v2.1/servers/89a512b5-8107-4c63-8387-69892fc7e5f4 => generated 1352 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:33:32.398205 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-363bc827-ef38-41f7-acfd-86e1af7af6ec tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:32.398416 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f104aa09-df8f-41ac-a463-d51781a4b3ca tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:32.399460 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-363bc827-ef38-41f7-acfd-86e1af7af6ec tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:32.406807 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-363bc827-ef38-41f7-acfd-86e1af7af6ec tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:32.407725 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-363bc827-ef38-41f7-acfd-86e1af7af6ec tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:32.408451 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-363bc827-ef38-41f7-acfd-86e1af7af6ec tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:32.409452 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-363bc827-ef38-41f7-acfd-86e1af7af6ec tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:32.410131 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-363bc827-ef38-41f7-acfd-86e1af7af6ec tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:32.411966 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-363bc827-ef38-41f7-acfd-86e1af7af6ec tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:32.413801 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f104aa09-df8f-41ac-a463-d51781a4b3ca tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/c8c84d9e-2274-49dd-99e9-cbd7222c22d5" status: 200 len: 1496 microversion: 2.1 time: 0.412177 Oct 04 18:33:32.414417 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 685/1412] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:31 2022] GET /compute/v2.1/servers/c8c84d9e-2274-49dd-99e9-cbd7222c22d5 => generated 1496 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:33:32.421429 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3ceb07d9-0c5e-42b9-90e9-71bb162d3fd9 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:32.422053 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3ceb07d9-0c5e-42b9-90e9-71bb162d3fd9 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] [instance: 0948d595-51a2-41fb-b561-8255de0bc6a0] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:32.431935 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3ceb07d9-0c5e-42b9-90e9-71bb162d3fd9 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:32.432774 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3ceb07d9-0c5e-42b9-90e9-71bb162d3fd9 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:32.433702 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3ceb07d9-0c5e-42b9-90e9-71bb162d3fd9 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:32.435229 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3ceb07d9-0c5e-42b9-90e9-71bb162d3fd9 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:32.436086 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3ceb07d9-0c5e-42b9-90e9-71bb162d3fd9 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:32.436773 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3ceb07d9-0c5e-42b9-90e9-71bb162d3fd9 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:32.532963 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-363bc827-ef38-41f7-acfd-86e1af7af6ec tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:32.556927 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-363bc827-ef38-41f7-acfd-86e1af7af6ec tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:32.562921 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-363bc827-ef38-41f7-acfd-86e1af7af6ec tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:32.582649 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-363bc827-ef38-41f7-acfd-86e1af7af6ec tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1537 microversion: 2.91 time: 0.193776 Oct 04 18:33:32.583455 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 728/1413] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:32 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1537 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:32.596754 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=6 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:32.623033 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8a5846a7-f862-42bb-aded-1e8eea087e8c tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:32.623655 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8a5846a7-f862-42bb-aded-1e8eea087e8c tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] [instance: bc418c02-1d95-407f-bbda-c696e9ba5959] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:32.662286 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8a5846a7-f862-42bb-aded-1e8eea087e8c tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:32.662893 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8a5846a7-f862-42bb-aded-1e8eea087e8c tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:32.663410 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8a5846a7-f862-42bb-aded-1e8eea087e8c tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:32.664282 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8a5846a7-f862-42bb-aded-1e8eea087e8c tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:32.664830 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8a5846a7-f862-42bb-aded-1e8eea087e8c tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:32.666608 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8a5846a7-f862-42bb-aded-1e8eea087e8c tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:32.797336 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3ceb07d9-0c5e-42b9-90e9-71bb162d3fd9 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6ff8f5b6c58416b82eb6765a209b344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064cbc5ef6a4f5c9df672a3b8668040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:32.821425 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3ceb07d9-0c5e-42b9-90e9-71bb162d3fd9 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] 10.222.0.20 "GET /compute/v2.1/servers/0948d595-51a2-41fb-b561-8255de0bc6a0" status: 200 len: 1319 microversion: 2.1 time: 0.405882 Oct 04 18:33:32.822678 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 686/1414] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:32 2022] GET /compute/v2.1/servers/0948d595-51a2-41fb-b561-8255de0bc6a0 => generated 1319 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:33.004661 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8a5846a7-f862-42bb-aded-1e8eea087e8c tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bed3af030c43dbaa23a3e23520f407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7808c2a8d8491aa5e1594383fab2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:33.013415 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8a5846a7-f862-42bb-aded-1e8eea087e8c tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] 10.222.0.20 "GET /compute/v2.1/servers/bc418c02-1d95-407f-bbda-c696e9ba5959" status: 200 len: 1394 microversion: 2.1 time: 0.402015 Oct 04 18:33:33.014704 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 729/1415] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:32 2022] GET /compute/v2.1/servers/bc418c02-1d95-407f-bbda-c696e9ba5959 => generated 1394 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:33.411456 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a1bb3549-964a-4660-ae83-fd81bac3bd0e tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:33.412764 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a1bb3549-964a-4660-ae83-fd81bac3bd0e tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] [instance: 89a512b5-8107-4c63-8387-69892fc7e5f4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:33.427431 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a1bb3549-964a-4660-ae83-fd81bac3bd0e tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:33.428017 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a1bb3549-964a-4660-ae83-fd81bac3bd0e tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:33.428409 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a1bb3549-964a-4660-ae83-fd81bac3bd0e tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:33.429116 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a1bb3549-964a-4660-ae83-fd81bac3bd0e tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:33.429762 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a1bb3549-964a-4660-ae83-fd81bac3bd0e tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:33.430856 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a1bb3549-964a-4660-ae83-fd81bac3bd0e tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:33.445316 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6098643c-35d8-4de4-9612-a3048951e809 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:33.446144 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-6098643c-35d8-4de4-9612-a3048951e809 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: c8c84d9e-2274-49dd-99e9-cbd7222c22d5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:33.461558 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6098643c-35d8-4de4-9612-a3048951e809 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:33.462551 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6098643c-35d8-4de4-9612-a3048951e809 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:33.463651 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6098643c-35d8-4de4-9612-a3048951e809 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:33.464807 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6098643c-35d8-4de4-9612-a3048951e809 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:33.465543 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6098643c-35d8-4de4-9612-a3048951e809 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:33.466187 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6098643c-35d8-4de4-9612-a3048951e809 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:33.735070 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a1bb3549-964a-4660-ae83-fd81bac3bd0e tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697ff4892d1f4c559523990779ccfaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2759ed7f36eb4693aa74b76f7907899e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:33.739456 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-6098643c-35d8-4de4-9612-a3048951e809 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:33.745428 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a1bb3549-964a-4660-ae83-fd81bac3bd0e tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] 10.222.0.20 "GET /compute/v2.1/servers/89a512b5-8107-4c63-8387-69892fc7e5f4" status: 200 len: 1352 microversion: 2.1 time: 0.338436 Oct 04 18:33:33.763673 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 687/1416] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:33 2022] GET /compute/v2.1/servers/89a512b5-8107-4c63-8387-69892fc7e5f4 => generated 1352 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:33.764423 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6098643c-35d8-4de4-9612-a3048951e809 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/c8c84d9e-2274-49dd-99e9-cbd7222c22d5" status: 200 len: 1496 microversion: 2.1 time: 0.310554 Oct 04 18:33:33.764423 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 730/1417] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:33 2022] GET /compute/v2.1/servers/c8c84d9e-2274-49dd-99e9-cbd7222c22d5 => generated 1496 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:33.768123 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6052f4c3-8985-4225-840c-2778870788ea tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:33.768995 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6052f4c3-8985-4225-840c-2778870788ea tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:33.777765 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6052f4c3-8985-4225-840c-2778870788ea tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:33.778330 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6052f4c3-8985-4225-840c-2778870788ea tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:33.778833 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6052f4c3-8985-4225-840c-2778870788ea tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:33.779604 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6052f4c3-8985-4225-840c-2778870788ea tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:33.780153 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6052f4c3-8985-4225-840c-2778870788ea tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:33.780725 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6052f4c3-8985-4225-840c-2778870788ea tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:33.853083 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-707bc386-b9ec-4b79-91f6-6b51a22855e9 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:33.854079 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-707bc386-b9ec-4b79-91f6-6b51a22855e9 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] [instance: 0948d595-51a2-41fb-b561-8255de0bc6a0] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:33.858567 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6052f4c3-8985-4225-840c-2778870788ea tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:33.860572 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-707bc386-b9ec-4b79-91f6-6b51a22855e9 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:33.861069 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-707bc386-b9ec-4b79-91f6-6b51a22855e9 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:33.861536 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-707bc386-b9ec-4b79-91f6-6b51a22855e9 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:33.863920 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-707bc386-b9ec-4b79-91f6-6b51a22855e9 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:33.863920 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-707bc386-b9ec-4b79-91f6-6b51a22855e9 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:33.863920 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-707bc386-b9ec-4b79-91f6-6b51a22855e9 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:33.868207 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6052f4c3-8985-4225-840c-2778870788ea tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:33.869754 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6052f4c3-8985-4225-840c-2778870788ea tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:33.874824 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6052f4c3-8985-4225-840c-2778870788ea tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1537 microversion: 2.91 time: 0.127541 Oct 04 18:33:33.875514 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 688/1418] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:33 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1537 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:34.014180 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-707bc386-b9ec-4b79-91f6-6b51a22855e9 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6ff8f5b6c58416b82eb6765a209b344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064cbc5ef6a4f5c9df672a3b8668040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:34.023305 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-707bc386-b9ec-4b79-91f6-6b51a22855e9 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] 10.222.0.20 "GET /compute/v2.1/servers/0948d595-51a2-41fb-b561-8255de0bc6a0" status: 200 len: 1319 microversion: 2.1 time: 0.176330 Oct 04 18:33:34.024297 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 731/1419] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:33 2022] GET /compute/v2.1/servers/0948d595-51a2-41fb-b561-8255de0bc6a0 => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:33:34.046611 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d5a9c03b-fc33-4867-86ba-51243e2e716a tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:34.046611 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d5a9c03b-fc33-4867-86ba-51243e2e716a tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] [instance: bc418c02-1d95-407f-bbda-c696e9ba5959] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:34.052867 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d5a9c03b-fc33-4867-86ba-51243e2e716a tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:34.053423 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d5a9c03b-fc33-4867-86ba-51243e2e716a tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:34.054055 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d5a9c03b-fc33-4867-86ba-51243e2e716a tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:34.054768 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d5a9c03b-fc33-4867-86ba-51243e2e716a tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:34.055223 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d5a9c03b-fc33-4867-86ba-51243e2e716a tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:34.055641 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d5a9c03b-fc33-4867-86ba-51243e2e716a tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:34.219817 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-af759e1a-3c96-4085-b467-bab14a9791bc req-cb753989-d56d-486f-885c-88a145a636e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89a512b5-8107-4c63-8387-69892fc7e5f4", "name": "network-vif-plugged", "status": "completed", "tag": "92a0e1fe-3095-49a6-a363-561de4b984e4"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:34.221728 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d5a9c03b-fc33-4867-86ba-51243e2e716a tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bed3af030c43dbaa23a3e23520f407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7808c2a8d8491aa5e1594383fab2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:34.230403 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-af759e1a-3c96-4085-b467-bab14a9791bc req-cb753989-d56d-486f-885c-88a145a636e9 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:34.230940 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-af759e1a-3c96-4085-b467-bab14a9791bc req-cb753989-d56d-486f-885c-88a145a636e9 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:34.231315 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-af759e1a-3c96-4085-b467-bab14a9791bc req-cb753989-d56d-486f-885c-88a145a636e9 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:34.235346 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d5a9c03b-fc33-4867-86ba-51243e2e716a tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] 10.222.0.20 "GET /compute/v2.1/servers/bc418c02-1d95-407f-bbda-c696e9ba5959" status: 200 len: 1394 microversion: 2.1 time: 0.194007 Oct 04 18:33:34.236614 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 689/1420] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:34 2022] GET /compute/v2.1/servers/bc418c02-1d95-407f-bbda-c696e9ba5959 => generated 1394 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:34.251272 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-af759e1a-3c96-4085-b467-bab14a9791bc req-cb753989-d56d-486f-885c-88a145a636e9 service nova] Creating event network-vif-plugged:92a0e1fe-3095-49a6-a363-561de4b984e4 for instance 89a512b5-8107-4c63-8387-69892fc7e5f4 on n-h1-850501-14 Oct 04 18:33:34.258621 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-af759e1a-3c96-4085-b467-bab14a9791bc req-cb753989-d56d-486f-885c-88a145a636e9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042682 Oct 04 18:33:34.259692 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 732/1421] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:33:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:33:34.771566 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7e5d8d1f-e2e7-4c0c-bac5-52f37d420e1e tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:34.772698 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7e5d8d1f-e2e7-4c0c-bac5-52f37d420e1e tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] [instance: 89a512b5-8107-4c63-8387-69892fc7e5f4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:34.779116 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-76318ded-2fc9-4b39-b714-d4ef39727093 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:34.779636 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7e5d8d1f-e2e7-4c0c-bac5-52f37d420e1e tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:34.780133 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7e5d8d1f-e2e7-4c0c-bac5-52f37d420e1e tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:34.780679 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7e5d8d1f-e2e7-4c0c-bac5-52f37d420e1e tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:34.781480 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7e5d8d1f-e2e7-4c0c-bac5-52f37d420e1e tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:34.781899 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-76318ded-2fc9-4b39-b714-d4ef39727093 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: c8c84d9e-2274-49dd-99e9-cbd7222c22d5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:34.782840 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7e5d8d1f-e2e7-4c0c-bac5-52f37d420e1e tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:34.783511 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7e5d8d1f-e2e7-4c0c-bac5-52f37d420e1e tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:34.793849 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-76318ded-2fc9-4b39-b714-d4ef39727093 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:34.794744 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-76318ded-2fc9-4b39-b714-d4ef39727093 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:34.795404 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-76318ded-2fc9-4b39-b714-d4ef39727093 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:34.796361 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-76318ded-2fc9-4b39-b714-d4ef39727093 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:34.797376 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-76318ded-2fc9-4b39-b714-d4ef39727093 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:34.798025 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-76318ded-2fc9-4b39-b714-d4ef39727093 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:35.024616 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7e5d8d1f-e2e7-4c0c-bac5-52f37d420e1e tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697ff4892d1f4c559523990779ccfaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2759ed7f36eb4693aa74b76f7907899e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:35.044766 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-76318ded-2fc9-4b39-b714-d4ef39727093 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:35.047170 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7e5d8d1f-e2e7-4c0c-bac5-52f37d420e1e tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] 10.222.0.20 "GET /compute/v2.1/servers/89a512b5-8107-4c63-8387-69892fc7e5f4" status: 200 len: 1352 microversion: 2.1 time: 0.280171 Oct 04 18:33:35.053587 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 690/1422] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:34 2022] GET /compute/v2.1/servers/89a512b5-8107-4c63-8387-69892fc7e5f4 => generated 1352 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:35.056351 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3a8cf18d-a9f9-4853-82ba-05b1bbfbd303 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:35.057150 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3a8cf18d-a9f9-4853-82ba-05b1bbfbd303 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:35.064631 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3a8cf18d-a9f9-4853-82ba-05b1bbfbd303 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:35.065493 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3a8cf18d-a9f9-4853-82ba-05b1bbfbd303 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:35.066134 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3a8cf18d-a9f9-4853-82ba-05b1bbfbd303 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:35.067964 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3a8cf18d-a9f9-4853-82ba-05b1bbfbd303 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:35.068658 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3a8cf18d-a9f9-4853-82ba-05b1bbfbd303 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:35.069369 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3a8cf18d-a9f9-4853-82ba-05b1bbfbd303 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:35.073882 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-76318ded-2fc9-4b39-b714-d4ef39727093 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/c8c84d9e-2274-49dd-99e9-cbd7222c22d5" status: 200 len: 1496 microversion: 2.1 time: 0.303247 Oct 04 18:33:35.074485 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 733/1423] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:34 2022] GET /compute/v2.1/servers/c8c84d9e-2274-49dd-99e9-cbd7222c22d5 => generated 1496 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:35.087655 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-b8baebde-1b81-42f6-b81c-fa50ca3ec08e req-bd480ba7-e34e-4675-9754-da2313fe2ccc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0948d595-51a2-41fb-b561-8255de0bc6a0", "tag": "2957805e-e9be-4262-adc3-d1a7b55b1476"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:35.107139 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-b8baebde-1b81-42f6-b81c-fa50ca3ec08e req-bd480ba7-e34e-4675-9754-da2313fe2ccc service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:35.111880 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-b8baebde-1b81-42f6-b81c-fa50ca3ec08e req-bd480ba7-e34e-4675-9754-da2313fe2ccc service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:35.112630 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-b8baebde-1b81-42f6-b81c-fa50ca3ec08e req-bd480ba7-e34e-4675-9754-da2313fe2ccc service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:35.140949 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-b8baebde-1b81-42f6-b81c-fa50ca3ec08e req-bd480ba7-e34e-4675-9754-da2313fe2ccc service nova] Creating event network-changed:2957805e-e9be-4262-adc3-d1a7b55b1476 for instance 0948d595-51a2-41fb-b561-8255de0bc6a0 on n-h2-850501-14 Oct 04 18:33:35.151022 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-b8baebde-1b81-42f6-b81c-fa50ca3ec08e req-bd480ba7-e34e-4675-9754-da2313fe2ccc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075022 Oct 04 18:33:35.159672 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 734/1424] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:33:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:33:35.166090 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-fe6a3290-bd76-49cb-8ef7-3b4519d06272 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:35.168040 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-fe6a3290-bd76-49cb-8ef7-3b4519d06272 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] [instance: 0948d595-51a2-41fb-b561-8255de0bc6a0] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:35.181743 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3a8cf18d-a9f9-4853-82ba-05b1bbfbd303 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:35.183451 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fe6a3290-bd76-49cb-8ef7-3b4519d06272 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:35.183947 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fe6a3290-bd76-49cb-8ef7-3b4519d06272 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:35.184446 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fe6a3290-bd76-49cb-8ef7-3b4519d06272 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:35.185167 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fe6a3290-bd76-49cb-8ef7-3b4519d06272 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:35.185617 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fe6a3290-bd76-49cb-8ef7-3b4519d06272 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:35.186041 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fe6a3290-bd76-49cb-8ef7-3b4519d06272 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:35.197443 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3a8cf18d-a9f9-4853-82ba-05b1bbfbd303 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:35.199450 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3a8cf18d-a9f9-4853-82ba-05b1bbfbd303 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:35.216883 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3a8cf18d-a9f9-4853-82ba-05b1bbfbd303 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1537 microversion: 2.91 time: 0.166008 Oct 04 18:33:35.218006 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 691/1425] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:35 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1537 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:35.260001 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-139c7dc8-e858-44fc-bf10-1310be0e6f5f tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:35.260915 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-139c7dc8-e858-44fc-bf10-1310be0e6f5f tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] [instance: bc418c02-1d95-407f-bbda-c696e9ba5959] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:35.267953 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-139c7dc8-e858-44fc-bf10-1310be0e6f5f tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:35.271475 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-139c7dc8-e858-44fc-bf10-1310be0e6f5f tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:35.272026 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-139c7dc8-e858-44fc-bf10-1310be0e6f5f tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:35.272875 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-139c7dc8-e858-44fc-bf10-1310be0e6f5f tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:35.273411 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-139c7dc8-e858-44fc-bf10-1310be0e6f5f tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:35.273902 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-139c7dc8-e858-44fc-bf10-1310be0e6f5f tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:35.398630 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-fe6a3290-bd76-49cb-8ef7-3b4519d06272 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6ff8f5b6c58416b82eb6765a209b344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064cbc5ef6a4f5c9df672a3b8668040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:35.409634 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-fe6a3290-bd76-49cb-8ef7-3b4519d06272 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] 10.222.0.20 "GET /compute/v2.1/servers/0948d595-51a2-41fb-b561-8255de0bc6a0" status: 200 len: 1319 microversion: 2.1 time: 0.247717 Oct 04 18:33:35.411655 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 735/1426] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:35 2022] GET /compute/v2.1/servers/0948d595-51a2-41fb-b561-8255de0bc6a0 => generated 1319 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:35.486764 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-10ed0b9a-6ccd-4343-8788-db5c0899c38e tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1501891286", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "775db4fd-ffbb-4b60-8080-bcd59498413f"}]}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:35.498871 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-139c7dc8-e858-44fc-bf10-1310be0e6f5f tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bed3af030c43dbaa23a3e23520f407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7808c2a8d8491aa5e1594383fab2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:35.507916 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-139c7dc8-e858-44fc-bf10-1310be0e6f5f tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] 10.222.0.20 "GET /compute/v2.1/servers/bc418c02-1d95-407f-bbda-c696e9ba5959" status: 200 len: 1394 microversion: 2.1 time: 0.252477 Oct 04 18:33:35.508866 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 692/1427] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:35 2022] GET /compute/v2.1/servers/bc418c02-1d95-407f-bbda-c696e9ba5959 => generated 1394 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:33:35.562333 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-10ed0b9a-6ccd-4343-8788-db5c0899c38e tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] validate_networks() for [('775db4fd-ffbb-4b60-8080-bcd59498413f', None, None, None, None, None)] {{(pid=123002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:33:36.039273 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-10ed0b9a-6ccd-4343-8788-db5c0899c38e tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:33:36.039844 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-10ed0b9a-6ccd-4343-8788-db5c0899c38e tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:33:36.040177 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-10ed0b9a-6ccd-4343-8788-db5c0899c38e tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:33:36.040718 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-10ed0b9a-6ccd-4343-8788-db5c0899c38e tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:33:36.041158 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-10ed0b9a-6ccd-4343-8788-db5c0899c38e tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:33:36.049814 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-10ed0b9a-6ccd-4343-8788-db5c0899c38e tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:36.050292 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-10ed0b9a-6ccd-4343-8788-db5c0899c38e tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:36.050758 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-10ed0b9a-6ccd-4343-8788-db5c0899c38e tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:36.052090 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-10ed0b9a-6ccd-4343-8788-db5c0899c38e tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:36.052604 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-10ed0b9a-6ccd-4343-8788-db5c0899c38e tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:36.053162 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-10ed0b9a-6ccd-4343-8788-db5c0899c38e tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:36.074960 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-96d29f7a-2058-4d46-a43f-1059277e5625 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:36.076081 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-10ed0b9a-6ccd-4343-8788-db5c0899c38e tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Getting quotas for project 320e0b0088d8476bbcb4c83783fec0e6. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:33:36.076570 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-96d29f7a-2058-4d46-a43f-1059277e5625 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] [instance: 89a512b5-8107-4c63-8387-69892fc7e5f4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:36.082589 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-10ed0b9a-6ccd-4343-8788-db5c0899c38e tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Getting quotas for user 44cc98e07d134a15b0fbf2b80bd25ef7 and project 320e0b0088d8476bbcb4c83783fec0e6. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:33:36.084896 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-96d29f7a-2058-4d46-a43f-1059277e5625 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:36.085654 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-96d29f7a-2058-4d46-a43f-1059277e5625 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:36.086330 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-96d29f7a-2058-4d46-a43f-1059277e5625 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:36.087247 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-96d29f7a-2058-4d46-a43f-1059277e5625 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:36.087915 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-96d29f7a-2058-4d46-a43f-1059277e5625 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:36.088589 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-96d29f7a-2058-4d46-a43f-1059277e5625 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:36.097718 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-10ed0b9a-6ccd-4343-8788-db5c0899c38e tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Going to run 2 instances... {{(pid=123002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:33:36.100673 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-10ed0b9a-6ccd-4343-8788-db5c0899c38e tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] [instance: 7a384d42-782c-49ac-ad60-e98cf5924e92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:33:36.235306 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-96d29f7a-2058-4d46-a43f-1059277e5625 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697ff4892d1f4c559523990779ccfaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2759ed7f36eb4693aa74b76f7907899e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:36.244522 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-96d29f7a-2058-4d46-a43f-1059277e5625 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] 10.222.0.20 "GET /compute/v2.1/servers/89a512b5-8107-4c63-8387-69892fc7e5f4" status: 200 len: 1352 microversion: 2.1 time: 0.173065 Oct 04 18:33:36.245336 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 693/1428] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:36 2022] GET /compute/v2.1/servers/89a512b5-8107-4c63-8387-69892fc7e5f4 => generated 1352 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:33:36.249959 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b3576f34-d6fb-43a5-9e50-e6ef3e2b9622 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:36.250696 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b3576f34-d6fb-43a5-9e50-e6ef3e2b9622 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: c8c84d9e-2274-49dd-99e9-cbd7222c22d5] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:36.257799 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-10ed0b9a-6ccd-4343-8788-db5c0899c38e tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] [instance: 7fd2a976-0bed-40c2-ba69-a88e8541db48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=7a384d42-782c-49ac-ad60-e98cf5924e92,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:33:36.258143 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b3576f34-d6fb-43a5-9e50-e6ef3e2b9622 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:36.259240 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b3576f34-d6fb-43a5-9e50-e6ef3e2b9622 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:36.259688 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b3576f34-d6fb-43a5-9e50-e6ef3e2b9622 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:36.260916 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b3576f34-d6fb-43a5-9e50-e6ef3e2b9622 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:36.261377 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b3576f34-d6fb-43a5-9e50-e6ef3e2b9622 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:36.261799 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b3576f34-d6fb-43a5-9e50-e6ef3e2b9622 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:36.417885 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b3576f34-d6fb-43a5-9e50-e6ef3e2b9622 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:36.423895 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-10ed0b9a-6ccd-4343-8788-db5c0899c38e tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.010854 Oct 04 18:33:36.431127 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 736/1429] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:33:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1019 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:33:36.436078 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b3576f34-d6fb-43a5-9e50-e6ef3e2b9622 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/c8c84d9e-2274-49dd-99e9-cbd7222c22d5" status: 200 len: 1496 microversion: 2.1 time: 0.189686 Oct 04 18:33:36.436783 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ff362699-1153-4d5f-893a-fcd65805afa2 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:36.436982 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ff362699-1153-4d5f-893a-fcd65805afa2 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:36.443769 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ff362699-1153-4d5f-893a-fcd65805afa2 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:36.444289 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ff362699-1153-4d5f-893a-fcd65805afa2 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:36.444723 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ff362699-1153-4d5f-893a-fcd65805afa2 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:36.445420 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ff362699-1153-4d5f-893a-fcd65805afa2 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:36.445859 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ff362699-1153-4d5f-893a-fcd65805afa2 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:36.446320 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ff362699-1153-4d5f-893a-fcd65805afa2 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:36.459083 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 694/1430] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:36 2022] GET /compute/v2.1/servers/c8c84d9e-2274-49dd-99e9-cbd7222c22d5 => generated 1496 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:36.472814 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-370ec47f-5eaf-4ba6-8e4e-4484351d0985 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:36.474761 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-370ec47f-5eaf-4ba6-8e4e-4484351d0985 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] [instance: 0948d595-51a2-41fb-b561-8255de0bc6a0] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:36.500479 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-370ec47f-5eaf-4ba6-8e4e-4484351d0985 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:36.501486 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-370ec47f-5eaf-4ba6-8e4e-4484351d0985 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:36.502281 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-370ec47f-5eaf-4ba6-8e4e-4484351d0985 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:36.515265 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-370ec47f-5eaf-4ba6-8e4e-4484351d0985 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:36.516092 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-370ec47f-5eaf-4ba6-8e4e-4484351d0985 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:36.516752 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-370ec47f-5eaf-4ba6-8e4e-4484351d0985 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:36.538415 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ff362699-1153-4d5f-893a-fcd65805afa2 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:36.549635 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ff362699-1153-4d5f-893a-fcd65805afa2 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:36.552942 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ff362699-1153-4d5f-893a-fcd65805afa2 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:36.560322 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ff362699-1153-4d5f-893a-fcd65805afa2 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1537 microversion: 2.91 time: 0.128151 Oct 04 18:33:36.568446 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 737/1431] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:36 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1537 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:36.574121 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d820da52-0228-4d86-8f74-1ee1a7f33751 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:36.579255 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d820da52-0228-4d86-8f74-1ee1a7f33751 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '44cc98e07d134a15b0fbf2b80bd25ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e0b0088d8476bbcb4c83783fec0e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:36.580028 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d820da52-0228-4d86-8f74-1ee1a7f33751 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Searching by: {'deleted': False, 'project_id': '320e0b0088d8476bbcb4c83783fec0e6'} {{(pid=123002) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:33:36.612807 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d820da52-0228-4d86-8f74-1ee1a7f33751 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:36.613424 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d820da52-0228-4d86-8f74-1ee1a7f33751 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:36.614916 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d820da52-0228-4d86-8f74-1ee1a7f33751 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:36.615719 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d820da52-0228-4d86-8f74-1ee1a7f33751 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:36.617163 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d820da52-0228-4d86-8f74-1ee1a7f33751 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:36.617163 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d820da52-0228-4d86-8f74-1ee1a7f33751 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:36.720268 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d820da52-0228-4d86-8f74-1ee1a7f33751 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.150153 Oct 04 18:33:36.727005 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 738/1432] 10.222.0.20 () {58 vars in 1125 bytes} [Tue Oct 4 18:33:36 2022] GET /compute/v2.1/servers => generated 677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:33:36.740510 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-370ec47f-5eaf-4ba6-8e4e-4484351d0985 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6ff8f5b6c58416b82eb6765a209b344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064cbc5ef6a4f5c9df672a3b8668040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:36.742421 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-14c7cb94-180d-4787-a12a-5cac4f565369 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:36.743180 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-14c7cb94-180d-4787-a12a-5cac4f565369 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] [instance: bc418c02-1d95-407f-bbda-c696e9ba5959] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:36.751425 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-370ec47f-5eaf-4ba6-8e4e-4484351d0985 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] 10.222.0.20 "GET /compute/v2.1/servers/0948d595-51a2-41fb-b561-8255de0bc6a0" status: 200 len: 1319 microversion: 2.1 time: 0.290627 Oct 04 18:33:36.752286 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 695/1433] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:36 2022] GET /compute/v2.1/servers/0948d595-51a2-41fb-b561-8255de0bc6a0 => generated 1319 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:36.757679 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a034142a-d53f-44fc-967f-5e0ae71704ba tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:36.758561 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a034142a-d53f-44fc-967f-5e0ae71704ba tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] [instance: 7fd2a976-0bed-40c2-ba69-a88e8541db48] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:36.762211 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:36.765661 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-14c7cb94-180d-4787-a12a-5cac4f565369 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:36.766170 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-14c7cb94-180d-4787-a12a-5cac4f565369 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:36.766610 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-14c7cb94-180d-4787-a12a-5cac4f565369 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:36.773258 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-14c7cb94-180d-4787-a12a-5cac4f565369 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:36.773258 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-14c7cb94-180d-4787-a12a-5cac4f565369 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:36.773258 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-14c7cb94-180d-4787-a12a-5cac4f565369 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:36.823152 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a034142a-d53f-44fc-967f-5e0ae71704ba tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44cc98e07d134a15b0fbf2b80bd25ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e0b0088d8476bbcb4c83783fec0e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:36.833319 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a034142a-d53f-44fc-967f-5e0ae71704ba tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] 10.222.0.20 "GET /compute/v2.1/servers/7fd2a976-0bed-40c2-ba69-a88e8541db48" status: 200 len: 1220 microversion: 2.1 time: 0.078723 Oct 04 18:33:36.836130 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 696/1434] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:36 2022] GET /compute/v2.1/servers/7fd2a976-0bed-40c2-ba69-a88e8541db48 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:36.943428 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-14c7cb94-180d-4787-a12a-5cac4f565369 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bed3af030c43dbaa23a3e23520f407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7808c2a8d8491aa5e1594383fab2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:36.951125 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-14c7cb94-180d-4787-a12a-5cac4f565369 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] 10.222.0.20 "GET /compute/v2.1/servers/bc418c02-1d95-407f-bbda-c696e9ba5959" status: 200 len: 1394 microversion: 2.1 time: 0.227343 Oct 04 18:33:36.951699 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 739/1435] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:36 2022] GET /compute/v2.1/servers/bc418c02-1d95-407f-bbda-c696e9ba5959 => generated 1394 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:37.269031 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ba61c443-92f7-4b4f-94ae-1dae966d5692 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:37.269659 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ba61c443-92f7-4b4f-94ae-1dae966d5692 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] [instance: 89a512b5-8107-4c63-8387-69892fc7e5f4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:37.277308 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ba61c443-92f7-4b4f-94ae-1dae966d5692 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:37.277881 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ba61c443-92f7-4b4f-94ae-1dae966d5692 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:37.278404 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ba61c443-92f7-4b4f-94ae-1dae966d5692 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:37.279266 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ba61c443-92f7-4b4f-94ae-1dae966d5692 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:37.279791 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ba61c443-92f7-4b4f-94ae-1dae966d5692 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:37.280309 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ba61c443-92f7-4b4f-94ae-1dae966d5692 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:37.423473 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ba61c443-92f7-4b4f-94ae-1dae966d5692 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697ff4892d1f4c559523990779ccfaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2759ed7f36eb4693aa74b76f7907899e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:37.431681 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ba61c443-92f7-4b4f-94ae-1dae966d5692 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] 10.222.0.20 "GET /compute/v2.1/servers/89a512b5-8107-4c63-8387-69892fc7e5f4" status: 200 len: 1542 microversion: 2.1 time: 0.166583 Oct 04 18:33:37.432714 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 697/1436] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:37 2022] GET /compute/v2.1/servers/89a512b5-8107-4c63-8387-69892fc7e5f4 => generated 1542 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:37.454520 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c28bf7c6-f436-47cc-85c3-b4eabcfc77d6 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:37.459798 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c28bf7c6-f436-47cc-85c3-b4eabcfc77d6 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] [instance: 89a512b5-8107-4c63-8387-69892fc7e5f4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:37.468002 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-430d77fc-f541-45de-9805-d65e5a409a39 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:37.468989 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-430d77fc-f541-45de-9805-d65e5a409a39 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: c8c84d9e-2274-49dd-99e9-cbd7222c22d5] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:37.474473 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c28bf7c6-f436-47cc-85c3-b4eabcfc77d6 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:37.476805 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-430d77fc-f541-45de-9805-d65e5a409a39 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:37.477155 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c28bf7c6-f436-47cc-85c3-b4eabcfc77d6 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:37.477617 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c28bf7c6-f436-47cc-85c3-b4eabcfc77d6 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:37.478065 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-430d77fc-f541-45de-9805-d65e5a409a39 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:37.478355 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c28bf7c6-f436-47cc-85c3-b4eabcfc77d6 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:37.478819 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c28bf7c6-f436-47cc-85c3-b4eabcfc77d6 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:37.479075 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-430d77fc-f541-45de-9805-d65e5a409a39 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:37.479256 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c28bf7c6-f436-47cc-85c3-b4eabcfc77d6 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:37.480243 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-430d77fc-f541-45de-9805-d65e5a409a39 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:37.480882 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-430d77fc-f541-45de-9805-d65e5a409a39 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:37.481494 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-430d77fc-f541-45de-9805-d65e5a409a39 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:37.606188 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c28bf7c6-f436-47cc-85c3-b4eabcfc77d6 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] 10.222.0.20 "GET /compute/v2.1/servers/89a512b5-8107-4c63-8387-69892fc7e5f4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.155528 Oct 04 18:33:37.606964 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 740/1437] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Oct 4 18:33:37 2022] GET /compute/v2.1/servers/89a512b5-8107-4c63-8387-69892fc7e5f4/os-interface => generated 284 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:33:37.619319 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-762c676f-537a-463a-bfae-1960b2d389d8 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:37.620169 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-762c676f-537a-463a-bfae-1960b2d389d8 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:37.626739 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-762c676f-537a-463a-bfae-1960b2d389d8 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:37.627227 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-762c676f-537a-463a-bfae-1960b2d389d8 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:37.627656 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-762c676f-537a-463a-bfae-1960b2d389d8 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:37.628383 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-762c676f-537a-463a-bfae-1960b2d389d8 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:37.628824 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-762c676f-537a-463a-bfae-1960b2d389d8 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:37.629574 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-762c676f-537a-463a-bfae-1960b2d389d8 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:37.646702 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=100 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:37.753116 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-762c676f-537a-463a-bfae-1960b2d389d8 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:37.762734 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-762c676f-537a-463a-bfae-1960b2d389d8 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:37.764328 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-762c676f-537a-463a-bfae-1960b2d389d8 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:37.771177 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-762c676f-537a-463a-bfae-1960b2d389d8 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1537 microversion: 2.91 time: 0.156684 Oct 04 18:33:37.772561 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 741/1438] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:37 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1537 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:37.782426 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4d3b187d-5d9b-4387-b344-c5dfaf5a22c1 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:37.783289 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4d3b187d-5d9b-4387-b344-c5dfaf5a22c1 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] [instance: 0948d595-51a2-41fb-b561-8255de0bc6a0] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:37.791453 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4d3b187d-5d9b-4387-b344-c5dfaf5a22c1 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:37.796225 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4d3b187d-5d9b-4387-b344-c5dfaf5a22c1 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:37.796225 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4d3b187d-5d9b-4387-b344-c5dfaf5a22c1 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:37.796225 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4d3b187d-5d9b-4387-b344-c5dfaf5a22c1 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:37.796225 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4d3b187d-5d9b-4387-b344-c5dfaf5a22c1 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:37.796225 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4d3b187d-5d9b-4387-b344-c5dfaf5a22c1 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:37.804979 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-430d77fc-f541-45de-9805-d65e5a409a39 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:37.813990 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-430d77fc-f541-45de-9805-d65e5a409a39 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/c8c84d9e-2274-49dd-99e9-cbd7222c22d5" status: 200 len: 1496 microversion: 2.1 time: 0.349946 Oct 04 18:33:37.815293 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 698/1439] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:37 2022] GET /compute/v2.1/servers/c8c84d9e-2274-49dd-99e9-cbd7222c22d5 => generated 1496 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:37.860001 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-123c94ab-b31f-4ca8-84ae-28c6bf7e2d04 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:37.861015 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-123c94ab-b31f-4ca8-84ae-28c6bf7e2d04 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] [instance: 7fd2a976-0bed-40c2-ba69-a88e8541db48] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:38.007306 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-123c94ab-b31f-4ca8-84ae-28c6bf7e2d04 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44cc98e07d134a15b0fbf2b80bd25ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e0b0088d8476bbcb4c83783fec0e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:38.023158 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-123c94ab-b31f-4ca8-84ae-28c6bf7e2d04 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] 10.222.0.20 "GET /compute/v2.1/servers/7fd2a976-0bed-40c2-ba69-a88e8541db48" status: 200 len: 1220 microversion: 2.1 time: 0.168627 Oct 04 18:33:38.028094 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 699/1440] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:37 2022] GET /compute/v2.1/servers/7fd2a976-0bed-40c2-ba69-a88e8541db48 => generated 1220 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:33:38.042649 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-fc28e8b6-5f05-4d10-9b61-21622752b700 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:38.043342 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-fc28e8b6-5f05-4d10-9b61-21622752b700 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] [instance: bc418c02-1d95-407f-bbda-c696e9ba5959] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:38.055321 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fc28e8b6-5f05-4d10-9b61-21622752b700 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:38.055883 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fc28e8b6-5f05-4d10-9b61-21622752b700 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:38.058658 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fc28e8b6-5f05-4d10-9b61-21622752b700 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:38.059433 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fc28e8b6-5f05-4d10-9b61-21622752b700 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:38.059910 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fc28e8b6-5f05-4d10-9b61-21622752b700 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:38.062881 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fc28e8b6-5f05-4d10-9b61-21622752b700 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:38.358617 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4d3b187d-5d9b-4387-b344-c5dfaf5a22c1 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6ff8f5b6c58416b82eb6765a209b344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064cbc5ef6a4f5c9df672a3b8668040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:38.381184 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4d3b187d-5d9b-4387-b344-c5dfaf5a22c1 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] 10.222.0.20 "GET /compute/v2.1/servers/0948d595-51a2-41fb-b561-8255de0bc6a0" status: 200 len: 1319 microversion: 2.1 time: 0.599903 Oct 04 18:33:38.382058 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 742/1441] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:37 2022] GET /compute/v2.1/servers/0948d595-51a2-41fb-b561-8255de0bc6a0 => generated 1319 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:38.402499 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-b041be68-5617-433c-9296-bb24bce397c6 req-cc509bad-4850-4b7a-a8ef-58c4e910df4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc418c02-1d95-407f-bbda-c696e9ba5959", "name": "network-vif-plugged", "status": "completed", "tag": "ba72231c-323b-48fb-83de-ea9aad878e62"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:38.414591 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-b041be68-5617-433c-9296-bb24bce397c6 req-cc509bad-4850-4b7a-a8ef-58c4e910df4e service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:38.415395 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-b041be68-5617-433c-9296-bb24bce397c6 req-cc509bad-4850-4b7a-a8ef-58c4e910df4e service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:38.416193 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-b041be68-5617-433c-9296-bb24bce397c6 req-cc509bad-4850-4b7a-a8ef-58c4e910df4e service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:38.449348 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-b041be68-5617-433c-9296-bb24bce397c6 req-cc509bad-4850-4b7a-a8ef-58c4e910df4e service nova] Creating event network-vif-plugged:ba72231c-323b-48fb-83de-ea9aad878e62 for instance bc418c02-1d95-407f-bbda-c696e9ba5959 on n-h1-850501-14 Oct 04 18:33:38.456631 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-b041be68-5617-433c-9296-bb24bce397c6 req-cc509bad-4850-4b7a-a8ef-58c4e910df4e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067522 Oct 04 18:33:38.462814 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 743/1442] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:33:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:33:38.536519 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-fc28e8b6-5f05-4d10-9b61-21622752b700 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bed3af030c43dbaa23a3e23520f407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7808c2a8d8491aa5e1594383fab2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:38.545645 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-fc28e8b6-5f05-4d10-9b61-21622752b700 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] 10.222.0.20 "GET /compute/v2.1/servers/bc418c02-1d95-407f-bbda-c696e9ba5959" status: 200 len: 1394 microversion: 2.1 time: 0.515704 Oct 04 18:33:38.549513 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 700/1443] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:38 2022] GET /compute/v2.1/servers/bc418c02-1d95-407f-bbda-c696e9ba5959 => generated 1394 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:38.552201 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-898b96d8-b36f-4daf-8cbf-a48b56480444 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:38.552925 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-898b96d8-b36f-4daf-8cbf-a48b56480444 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] [instance: b219d988-2847-45a0-a3b8-af54cf1a43f8] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:38.588507 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-898b96d8-b36f-4daf-8cbf-a48b56480444 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:38.588754 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-898b96d8-b36f-4daf-8cbf-a48b56480444 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:38.589012 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-898b96d8-b36f-4daf-8cbf-a48b56480444 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:38.589733 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-898b96d8-b36f-4daf-8cbf-a48b56480444 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:38.590185 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-898b96d8-b36f-4daf-8cbf-a48b56480444 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:38.592645 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-898b96d8-b36f-4daf-8cbf-a48b56480444 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:38.784742 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-898b96d8-b36f-4daf-8cbf-a48b56480444 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lazy-loading 'services' on Instance uuid b219d988-2847-45a0-a3b8-af54cf1a43f8 {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:33:38.812997 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-bee07255-1469-4afa-9adb-8af1ab159a8e tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:38.813626 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-bee07255-1469-4afa-9adb-8af1ab159a8e tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:38.829741 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-898b96d8-b36f-4daf-8cbf-a48b56480444 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8" status: 200 len: 2421 microversion: 2.25 time: 0.286607 Oct 04 18:33:38.830965 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bee07255-1469-4afa-9adb-8af1ab159a8e tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:38.831445 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bee07255-1469-4afa-9adb-8af1ab159a8e tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:38.832024 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bee07255-1469-4afa-9adb-8af1ab159a8e tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:38.836737 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bee07255-1469-4afa-9adb-8af1ab159a8e tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:38.837427 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bee07255-1469-4afa-9adb-8af1ab159a8e tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:38.837822 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 744/1444] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:38 2022] GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8 => generated 2421 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:38.843437 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bee07255-1469-4afa-9adb-8af1ab159a8e tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:38.843963 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-22c7d97d-98c1-4665-a4d3-63c5959a72e1 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:38.849268 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-22c7d97d-98c1-4665-a4d3-63c5959a72e1 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: c8c84d9e-2274-49dd-99e9-cbd7222c22d5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:38.849463 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=100 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:38.855582 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-22c7d97d-98c1-4665-a4d3-63c5959a72e1 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:38.856392 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-22c7d97d-98c1-4665-a4d3-63c5959a72e1 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:38.857048 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-22c7d97d-98c1-4665-a4d3-63c5959a72e1 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:38.858361 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-22c7d97d-98c1-4665-a4d3-63c5959a72e1 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:38.859220 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-22c7d97d-98c1-4665-a4d3-63c5959a72e1 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:38.859951 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-22c7d97d-98c1-4665-a4d3-63c5959a72e1 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:38.970106 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-bee07255-1469-4afa-9adb-8af1ab159a8e tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:38.981281 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-bee07255-1469-4afa-9adb-8af1ab159a8e tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:38.982995 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-bee07255-1469-4afa-9adb-8af1ab159a8e tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:38.989136 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-bee07255-1469-4afa-9adb-8af1ab159a8e tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1537 microversion: 2.91 time: 0.189266 Oct 04 18:33:39.006109 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 701/1445] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:38 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1537 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:33:39.017327 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4165544d-4e5a-4746-8203-7827e6828ccf tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-850501-14", "block_migration": "auto"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:39.022371 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-4165544d-4e5a-4746-8203-7827e6828ccf tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] [instance: b219d988-2847-45a0-a3b8-af54cf1a43f8] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:39.032018 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4165544d-4e5a-4746-8203-7827e6828ccf tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:39.032859 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4165544d-4e5a-4746-8203-7827e6828ccf tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:39.033554 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4165544d-4e5a-4746-8203-7827e6828ccf tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:39.034467 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4165544d-4e5a-4746-8203-7827e6828ccf tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:39.035676 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4165544d-4e5a-4746-8203-7827e6828ccf tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:39.036383 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4165544d-4e5a-4746-8203-7827e6828ccf tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:39.076923 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-4165544d-4e5a-4746-8203-7827e6828ccf tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lazy-loading 'flavor' on Instance uuid b219d988-2847-45a0-a3b8-af54cf1a43f8 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:33:39.092583 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-4165544d-4e5a-4746-8203-7827e6828ccf tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] [instance: b219d988-2847-45a0-a3b8-af54cf1a43f8] Going to try to live migrate instance to n-h2-850501-14 {{(pid=123001) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 18:33:39.132659 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-22c7d97d-98c1-4665-a4d3-63c5959a72e1 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:39.146676 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-22c7d97d-98c1-4665-a4d3-63c5959a72e1 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/c8c84d9e-2274-49dd-99e9-cbd7222c22d5" status: 200 len: 1496 microversion: 2.1 time: 0.307128 Oct 04 18:33:39.147287 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 745/1446] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:38 2022] GET /compute/v2.1/servers/c8c84d9e-2274-49dd-99e9-cbd7222c22d5 => generated 1496 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:39.153635 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f79f86dc-f7b8-42a0-96a1-7ef93ed0c44f tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:39.154437 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f79f86dc-f7b8-42a0-96a1-7ef93ed0c44f tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] [instance: 7fd2a976-0bed-40c2-ba69-a88e8541db48] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:39.174581 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f79f86dc-f7b8-42a0-96a1-7ef93ed0c44f tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:39.174694 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f79f86dc-f7b8-42a0-96a1-7ef93ed0c44f tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:39.175077 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f79f86dc-f7b8-42a0-96a1-7ef93ed0c44f tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:39.175784 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f79f86dc-f7b8-42a0-96a1-7ef93ed0c44f tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:39.176295 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f79f86dc-f7b8-42a0-96a1-7ef93ed0c44f tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:39.176777 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f79f86dc-f7b8-42a0-96a1-7ef93ed0c44f tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:39.299326 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f79f86dc-f7b8-42a0-96a1-7ef93ed0c44f tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44cc98e07d134a15b0fbf2b80bd25ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e0b0088d8476bbcb4c83783fec0e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:39.307989 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f79f86dc-f7b8-42a0-96a1-7ef93ed0c44f tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] 10.222.0.20 "GET /compute/v2.1/servers/7fd2a976-0bed-40c2-ba69-a88e8541db48" status: 200 len: 1224 microversion: 2.1 time: 0.158717 Oct 04 18:33:39.308955 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 746/1447] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:39 2022] GET /compute/v2.1/servers/7fd2a976-0bed-40c2-ba69-a88e8541db48 => generated 1224 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:39.409007 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3f753dab-47ab-42b2-acf6-f9786912bf4e tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:39.409609 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3f753dab-47ab-42b2-acf6-f9786912bf4e tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] [instance: 0948d595-51a2-41fb-b561-8255de0bc6a0] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:39.415921 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f753dab-47ab-42b2-acf6-f9786912bf4e tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:39.416546 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f753dab-47ab-42b2-acf6-f9786912bf4e tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:39.416983 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f753dab-47ab-42b2-acf6-f9786912bf4e tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:39.417683 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f753dab-47ab-42b2-acf6-f9786912bf4e tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:39.418131 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f753dab-47ab-42b2-acf6-f9786912bf4e tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:39.418553 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f753dab-47ab-42b2-acf6-f9786912bf4e tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:39.593421 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3f753dab-47ab-42b2-acf6-f9786912bf4e tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6ff8f5b6c58416b82eb6765a209b344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064cbc5ef6a4f5c9df672a3b8668040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:39.602660 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3f753dab-47ab-42b2-acf6-f9786912bf4e tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] 10.222.0.20 "GET /compute/v2.1/servers/0948d595-51a2-41fb-b561-8255de0bc6a0" status: 200 len: 1319 microversion: 2.1 time: 0.197572 Oct 04 18:33:39.603253 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 747/1448] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:39 2022] GET /compute/v2.1/servers/0948d595-51a2-41fb-b561-8255de0bc6a0 => generated 1319 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:33:39.672920 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-2f00d34e-cbc6-4aea-b1af-e03e1c0770cd req-3974eb0e-56f7-4717-9c4f-9a9421ab362d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89a512b5-8107-4c63-8387-69892fc7e5f4", "tag": "92a0e1fe-3095-49a6-a363-561de4b984e4"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:39.684560 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-2f00d34e-cbc6-4aea-b1af-e03e1c0770cd req-3974eb0e-56f7-4717-9c4f-9a9421ab362d service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:39.685299 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-2f00d34e-cbc6-4aea-b1af-e03e1c0770cd req-3974eb0e-56f7-4717-9c4f-9a9421ab362d service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:39.685916 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-2f00d34e-cbc6-4aea-b1af-e03e1c0770cd req-3974eb0e-56f7-4717-9c4f-9a9421ab362d service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:39.706918 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-2f00d34e-cbc6-4aea-b1af-e03e1c0770cd req-3974eb0e-56f7-4717-9c4f-9a9421ab362d service nova] Creating event network-changed:92a0e1fe-3095-49a6-a363-561de4b984e4 for instance 89a512b5-8107-4c63-8387-69892fc7e5f4 on n-h1-850501-14 Oct 04 18:33:39.719203 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-2f00d34e-cbc6-4aea-b1af-e03e1c0770cd req-3974eb0e-56f7-4717-9c4f-9a9421ab362d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114530 Oct 04 18:33:39.734609 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 748/1449] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:33:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:33:39.736842 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-853aad5a-cace-4ab5-bd1f-05cbff01df92 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:39.738067 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-853aad5a-cace-4ab5-bd1f-05cbff01df92 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] [instance: bc418c02-1d95-407f-bbda-c696e9ba5959] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:39.747047 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-853aad5a-cace-4ab5-bd1f-05cbff01df92 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:39.747540 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-853aad5a-cace-4ab5-bd1f-05cbff01df92 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:39.748093 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-853aad5a-cace-4ab5-bd1f-05cbff01df92 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:39.748805 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-853aad5a-cace-4ab5-bd1f-05cbff01df92 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:39.749409 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-853aad5a-cace-4ab5-bd1f-05cbff01df92 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:39.749891 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-853aad5a-cace-4ab5-bd1f-05cbff01df92 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:39.922631 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-853aad5a-cace-4ab5-bd1f-05cbff01df92 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bed3af030c43dbaa23a3e23520f407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7808c2a8d8491aa5e1594383fab2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:39.935353 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-853aad5a-cace-4ab5-bd1f-05cbff01df92 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] 10.222.0.20 "GET /compute/v2.1/servers/bc418c02-1d95-407f-bbda-c696e9ba5959" status: 200 len: 1394 microversion: 2.1 time: 0.200876 Oct 04 18:33:39.968382 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 749/1450] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:39 2022] GET /compute/v2.1/servers/bc418c02-1d95-407f-bbda-c696e9ba5959 => generated 1394 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:40.025933 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-db7b7b07-466d-47f3-ac6f-1de7b188db8a tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:40.026555 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-db7b7b07-466d-47f3-ac6f-1de7b188db8a tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:40.033531 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-db7b7b07-466d-47f3-ac6f-1de7b188db8a tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:40.034068 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-db7b7b07-466d-47f3-ac6f-1de7b188db8a tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:40.034506 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-db7b7b07-466d-47f3-ac6f-1de7b188db8a tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:40.035208 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-db7b7b07-466d-47f3-ac6f-1de7b188db8a tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:40.035700 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-db7b7b07-466d-47f3-ac6f-1de7b188db8a tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:40.036160 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-db7b7b07-466d-47f3-ac6f-1de7b188db8a tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:40.115853 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-db7b7b07-466d-47f3-ac6f-1de7b188db8a tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:40.134247 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-db7b7b07-466d-47f3-ac6f-1de7b188db8a tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:40.136140 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-db7b7b07-466d-47f3-ac6f-1de7b188db8a tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:40.152490 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-db7b7b07-466d-47f3-ac6f-1de7b188db8a tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1558 microversion: 2.91 time: 0.131330 Oct 04 18:33:40.161080 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 750/1451] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:40 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1558 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:33:40.170213 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c5b6367a-6030-4c0b-bc3c-1fdfedf2a328 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:40.171073 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c5b6367a-6030-4c0b-bc3c-1fdfedf2a328 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: c8c84d9e-2274-49dd-99e9-cbd7222c22d5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:40.177669 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c5b6367a-6030-4c0b-bc3c-1fdfedf2a328 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:40.178149 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c5b6367a-6030-4c0b-bc3c-1fdfedf2a328 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:40.178586 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c5b6367a-6030-4c0b-bc3c-1fdfedf2a328 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:40.179278 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c5b6367a-6030-4c0b-bc3c-1fdfedf2a328 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:40.180244 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c5b6367a-6030-4c0b-bc3c-1fdfedf2a328 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:40.180244 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c5b6367a-6030-4c0b-bc3c-1fdfedf2a328 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:40.405428 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c5b6367a-6030-4c0b-bc3c-1fdfedf2a328 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:40.413669 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c5b6367a-6030-4c0b-bc3c-1fdfedf2a328 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/c8c84d9e-2274-49dd-99e9-cbd7222c22d5" status: 200 len: 1496 microversion: 2.1 time: 0.247380 Oct 04 18:33:40.414483 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 751/1452] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:40 2022] GET /compute/v2.1/servers/c8c84d9e-2274-49dd-99e9-cbd7222c22d5 => generated 1496 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:33:40.419545 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1690dc7a-1dcf-4a1a-b2ef-9175a9789c0c tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:40.420365 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1690dc7a-1dcf-4a1a-b2ef-9175a9789c0c tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] [instance: 7fd2a976-0bed-40c2-ba69-a88e8541db48] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:40.427006 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1690dc7a-1dcf-4a1a-b2ef-9175a9789c0c tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:40.427484 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1690dc7a-1dcf-4a1a-b2ef-9175a9789c0c tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:40.427934 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1690dc7a-1dcf-4a1a-b2ef-9175a9789c0c tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:40.428648 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1690dc7a-1dcf-4a1a-b2ef-9175a9789c0c tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:40.429104 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1690dc7a-1dcf-4a1a-b2ef-9175a9789c0c tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:40.429668 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1690dc7a-1dcf-4a1a-b2ef-9175a9789c0c tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:40.502294 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1690dc7a-1dcf-4a1a-b2ef-9175a9789c0c tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44cc98e07d134a15b0fbf2b80bd25ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e0b0088d8476bbcb4c83783fec0e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:40.510659 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1690dc7a-1dcf-4a1a-b2ef-9175a9789c0c tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] 10.222.0.20 "GET /compute/v2.1/servers/7fd2a976-0bed-40c2-ba69-a88e8541db48" status: 200 len: 1216 microversion: 2.1 time: 0.094991 Oct 04 18:33:40.511506 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 752/1453] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:40 2022] GET /compute/v2.1/servers/7fd2a976-0bed-40c2-ba69-a88e8541db48 => generated 1216 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:40.626639 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-620cdb7e-e877-4d97-a989-7e2a0b229d61 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:40.627243 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-620cdb7e-e877-4d97-a989-7e2a0b229d61 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] [instance: 0948d595-51a2-41fb-b561-8255de0bc6a0] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:40.633728 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-620cdb7e-e877-4d97-a989-7e2a0b229d61 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:40.634221 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-620cdb7e-e877-4d97-a989-7e2a0b229d61 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:40.634660 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-620cdb7e-e877-4d97-a989-7e2a0b229d61 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:40.635361 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-620cdb7e-e877-4d97-a989-7e2a0b229d61 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:40.635817 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-620cdb7e-e877-4d97-a989-7e2a0b229d61 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:40.636285 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-620cdb7e-e877-4d97-a989-7e2a0b229d61 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:40.821925 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-620cdb7e-e877-4d97-a989-7e2a0b229d61 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6ff8f5b6c58416b82eb6765a209b344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064cbc5ef6a4f5c9df672a3b8668040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:40.830930 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-620cdb7e-e877-4d97-a989-7e2a0b229d61 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] 10.222.0.20 "GET /compute/v2.1/servers/0948d595-51a2-41fb-b561-8255de0bc6a0" status: 200 len: 1319 microversion: 2.1 time: 0.208230 Oct 04 18:33:40.850083 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 753/1454] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:40 2022] GET /compute/v2.1/servers/0948d595-51a2-41fb-b561-8255de0bc6a0 => generated 1319 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:33:40.961532 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2af938ca-ef09-436d-8388-4889c85f7799 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:40.962456 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2af938ca-ef09-436d-8388-4889c85f7799 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] [instance: bc418c02-1d95-407f-bbda-c696e9ba5959] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:40.969606 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2af938ca-ef09-436d-8388-4889c85f7799 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:40.970570 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2af938ca-ef09-436d-8388-4889c85f7799 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:40.971103 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2af938ca-ef09-436d-8388-4889c85f7799 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:40.971909 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2af938ca-ef09-436d-8388-4889c85f7799 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:40.972832 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2af938ca-ef09-436d-8388-4889c85f7799 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:40.975513 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2af938ca-ef09-436d-8388-4889c85f7799 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:41.194524 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2af938ca-ef09-436d-8388-4889c85f7799 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bed3af030c43dbaa23a3e23520f407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7808c2a8d8491aa5e1594383fab2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:41.207111 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2af938ca-ef09-436d-8388-4889c85f7799 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] 10.222.0.20 "GET /compute/v2.1/servers/bc418c02-1d95-407f-bbda-c696e9ba5959" status: 200 len: 1575 microversion: 2.1 time: 0.249748 Oct 04 18:33:41.207903 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 754/1455] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:40 2022] GET /compute/v2.1/servers/bc418c02-1d95-407f-bbda-c696e9ba5959 => generated 1575 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:33:41.212723 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b3441bdd-f43b-4686-b98d-fae5289a430e tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:41.215424 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b3441bdd-f43b-4686-b98d-fae5289a430e tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:41.219133 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b3441bdd-f43b-4686-b98d-fae5289a430e tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:41.219615 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b3441bdd-f43b-4686-b98d-fae5289a430e tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:41.220042 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b3441bdd-f43b-4686-b98d-fae5289a430e tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:41.220876 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b3441bdd-f43b-4686-b98d-fae5289a430e tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:41.221314 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b3441bdd-f43b-4686-b98d-fae5289a430e tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:41.221714 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b3441bdd-f43b-4686-b98d-fae5289a430e tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:41.297757 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b3441bdd-f43b-4686-b98d-fae5289a430e tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:41.312314 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b3441bdd-f43b-4686-b98d-fae5289a430e tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:41.313824 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b3441bdd-f43b-4686-b98d-fae5289a430e tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:41.326321 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b3441bdd-f43b-4686-b98d-fae5289a430e tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1558 microversion: 2.91 time: 0.115980 Oct 04 18:33:41.328935 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 755/1456] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:41 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1558 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:41.341821 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-717c85c9-2343-4dc5-b463-5de4bf03014e tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:41.342645 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-717c85c9-2343-4dc5-b463-5de4bf03014e tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] [instance: bc418c02-1d95-407f-bbda-c696e9ba5959] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:41.362932 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-717c85c9-2343-4dc5-b463-5de4bf03014e tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:41.364102 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-717c85c9-2343-4dc5-b463-5de4bf03014e tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:41.366446 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-717c85c9-2343-4dc5-b463-5de4bf03014e tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:41.368850 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-717c85c9-2343-4dc5-b463-5de4bf03014e tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:41.369350 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-717c85c9-2343-4dc5-b463-5de4bf03014e tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:41.369788 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-717c85c9-2343-4dc5-b463-5de4bf03014e tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:41.471239 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-717c85c9-2343-4dc5-b463-5de4bf03014e tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] 10.222.0.20 "GET /compute/v2.1/servers/bc418c02-1d95-407f-bbda-c696e9ba5959/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.140366 Oct 04 18:33:41.471843 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 756/1457] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Oct 4 18:33:41 2022] GET /compute/v2.1/servers/bc418c02-1d95-407f-bbda-c696e9ba5959/os-interface => generated 284 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:33:41.477848 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-81092fe1-44c0-46c4-b5cf-9add66ea0498 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:41.484114 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-81092fe1-44c0-46c4-b5cf-9add66ea0498 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: c8c84d9e-2274-49dd-99e9-cbd7222c22d5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:41.484928 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-81092fe1-44c0-46c4-b5cf-9add66ea0498 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:41.485423 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-81092fe1-44c0-46c4-b5cf-9add66ea0498 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:41.485863 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-81092fe1-44c0-46c4-b5cf-9add66ea0498 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:41.486564 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-81092fe1-44c0-46c4-b5cf-9add66ea0498 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:41.487025 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-81092fe1-44c0-46c4-b5cf-9add66ea0498 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:41.487498 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-81092fe1-44c0-46c4-b5cf-9add66ea0498 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:41.787957 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-81092fe1-44c0-46c4-b5cf-9add66ea0498 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:41.803504 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-81092fe1-44c0-46c4-b5cf-9add66ea0498 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/c8c84d9e-2274-49dd-99e9-cbd7222c22d5" status: 200 len: 1496 microversion: 2.1 time: 0.330359 Oct 04 18:33:41.809417 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 757/1458] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:41 2022] GET /compute/v2.1/servers/c8c84d9e-2274-49dd-99e9-cbd7222c22d5 => generated 1496 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:41.824088 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-97f799da-515d-4fda-a269-357a86448943 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:41.824722 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-97f799da-515d-4fda-a269-357a86448943 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] [instance: 7fd2a976-0bed-40c2-ba69-a88e8541db48] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:41.832929 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-97f799da-515d-4fda-a269-357a86448943 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:41.833929 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-97f799da-515d-4fda-a269-357a86448943 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:41.834564 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-97f799da-515d-4fda-a269-357a86448943 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:41.835557 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-97f799da-515d-4fda-a269-357a86448943 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:41.836330 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-97f799da-515d-4fda-a269-357a86448943 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:41.837134 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-97f799da-515d-4fda-a269-357a86448943 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:41.959826 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-97f799da-515d-4fda-a269-357a86448943 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44cc98e07d134a15b0fbf2b80bd25ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e0b0088d8476bbcb4c83783fec0e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:41.970531 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-97f799da-515d-4fda-a269-357a86448943 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] 10.222.0.20 "GET /compute/v2.1/servers/7fd2a976-0bed-40c2-ba69-a88e8541db48" status: 200 len: 1272 microversion: 2.1 time: 0.159686 Oct 04 18:33:41.971548 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 758/1459] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:41 2022] GET /compute/v2.1/servers/7fd2a976-0bed-40c2-ba69-a88e8541db48 => generated 1272 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:41.988186 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3b3945dc-09b4-4a09-bd3c-2cf789e96239 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:41.988186 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3b3945dc-09b4-4a09-bd3c-2cf789e96239 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] [instance: 0948d595-51a2-41fb-b561-8255de0bc6a0] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:41.990264 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3b3945dc-09b4-4a09-bd3c-2cf789e96239 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:41.991132 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3b3945dc-09b4-4a09-bd3c-2cf789e96239 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:41.992044 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3b3945dc-09b4-4a09-bd3c-2cf789e96239 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:41.993393 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3b3945dc-09b4-4a09-bd3c-2cf789e96239 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:41.994395 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3b3945dc-09b4-4a09-bd3c-2cf789e96239 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:41.994961 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3b3945dc-09b4-4a09-bd3c-2cf789e96239 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:42.013530 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=100 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:42.151773 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-4165544d-4e5a-4746-8203-7827e6828ccf tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8/action" status: 202 len: 0 microversion: 2.25 time: 3.144077 Oct 04 18:33:42.157292 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 702/1460] 10.222.0.20 () {62 vars in 1319 bytes} [Tue Oct 4 18:33:39 2022] POST /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8/action => generated 0 bytes in 3150 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:33:42.163039 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-042620e1-26fc-4420-90bb-632023856282 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:42.163815 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-042620e1-26fc-4420-90bb-632023856282 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: b219d988-2847-45a0-a3b8-af54cf1a43f8] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:42.178913 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-042620e1-26fc-4420-90bb-632023856282 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:42.178913 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-042620e1-26fc-4420-90bb-632023856282 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:42.178913 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-042620e1-26fc-4420-90bb-632023856282 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:42.178913 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-042620e1-26fc-4420-90bb-632023856282 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:42.179740 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-042620e1-26fc-4420-90bb-632023856282 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:42.180617 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-042620e1-26fc-4420-90bb-632023856282 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:42.770943 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3b3945dc-09b4-4a09-bd3c-2cf789e96239 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6ff8f5b6c58416b82eb6765a209b344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064cbc5ef6a4f5c9df672a3b8668040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:42.781728 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3b3945dc-09b4-4a09-bd3c-2cf789e96239 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] 10.222.0.20 "GET /compute/v2.1/servers/0948d595-51a2-41fb-b561-8255de0bc6a0" status: 200 len: 1319 microversion: 2.1 time: 0.808862 Oct 04 18:33:42.782961 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 759/1461] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:41 2022] GET /compute/v2.1/servers/0948d595-51a2-41fb-b561-8255de0bc6a0 => generated 1319 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:42.790633 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-39c4a0a4-1adc-41cc-a5f9-8abcadbb1120 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:42.792044 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-39c4a0a4-1adc-41cc-a5f9-8abcadbb1120 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:42.806481 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-39c4a0a4-1adc-41cc-a5f9-8abcadbb1120 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:42.807860 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-39c4a0a4-1adc-41cc-a5f9-8abcadbb1120 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:42.808777 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-39c4a0a4-1adc-41cc-a5f9-8abcadbb1120 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:42.809508 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-39c4a0a4-1adc-41cc-a5f9-8abcadbb1120 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:42.815643 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-39c4a0a4-1adc-41cc-a5f9-8abcadbb1120 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:42.816465 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-39c4a0a4-1adc-41cc-a5f9-8abcadbb1120 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:42.818461 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-042620e1-26fc-4420-90bb-632023856282 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:42.830583 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-042620e1-26fc-4420-90bb-632023856282 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:42.838254 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-042620e1-26fc-4420-90bb-632023856282 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:42.838254 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-042620e1-26fc-4420-90bb-632023856282 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8" status: 200 len: 1811 microversion: 2.25 time: 0.677170 Oct 04 18:33:42.838254 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 703/1462] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:42 2022] GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8 => generated 1811 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:42.847049 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ed69615d-0665-4fc0-87a0-438f83f1a970 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:42.848623 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ed69615d-0665-4fc0-87a0-438f83f1a970 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] [instance: 158e9f52-fd16-48d1-87b5-e0dd523e97a4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:42.859636 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ed69615d-0665-4fc0-87a0-438f83f1a970 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:42.860200 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ed69615d-0665-4fc0-87a0-438f83f1a970 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:42.860649 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ed69615d-0665-4fc0-87a0-438f83f1a970 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:42.861671 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ed69615d-0665-4fc0-87a0-438f83f1a970 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:42.862376 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ed69615d-0665-4fc0-87a0-438f83f1a970 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:42.863114 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ed69615d-0665-4fc0-87a0-438f83f1a970 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:42.969322 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-39c4a0a4-1adc-41cc-a5f9-8abcadbb1120 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:42.978624 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-39c4a0a4-1adc-41cc-a5f9-8abcadbb1120 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:42.980448 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-39c4a0a4-1adc-41cc-a5f9-8abcadbb1120 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:42.986786 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-39c4a0a4-1adc-41cc-a5f9-8abcadbb1120 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1558 microversion: 2.91 time: 0.202461 Oct 04 18:33:42.987627 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 760/1463] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:42 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1558 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:42.993040 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6ab15ea5-798c-43e7-b603-c1755cadf35f tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:42.993799 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-6ab15ea5-798c-43e7-b603-c1755cadf35f tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: c8c84d9e-2274-49dd-99e9-cbd7222c22d5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:43.000319 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6ab15ea5-798c-43e7-b603-c1755cadf35f tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:43.001179 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6ab15ea5-798c-43e7-b603-c1755cadf35f tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:43.001838 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6ab15ea5-798c-43e7-b603-c1755cadf35f tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:43.003507 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6ab15ea5-798c-43e7-b603-c1755cadf35f tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:43.005392 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6ab15ea5-798c-43e7-b603-c1755cadf35f tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:43.006107 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6ab15ea5-798c-43e7-b603-c1755cadf35f tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:43.208813 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ed69615d-0665-4fc0-87a0-438f83f1a970 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4" status: 200 len: 1816 microversion: 2.1 time: 0.371236 Oct 04 18:33:43.225309 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 704/1464] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:42 2022] GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4 => generated 1816 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:43.230509 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-484e9687-6a24-41c3-a157-23245aab9fe3 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:43.231109 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-484e9687-6a24-41c3-a157-23245aab9fe3 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] [instance: 7fd2a976-0bed-40c2-ba69-a88e8541db48] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:43.237693 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-484e9687-6a24-41c3-a157-23245aab9fe3 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:43.238588 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-484e9687-6a24-41c3-a157-23245aab9fe3 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:43.239440 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-484e9687-6a24-41c3-a157-23245aab9fe3 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:43.240360 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-484e9687-6a24-41c3-a157-23245aab9fe3 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:43.240818 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-484e9687-6a24-41c3-a157-23245aab9fe3 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:43.241240 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-484e9687-6a24-41c3-a157-23245aab9fe3 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:43.246520 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-6ab15ea5-798c-43e7-b603-c1755cadf35f tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:43.270722 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6ab15ea5-798c-43e7-b603-c1755cadf35f tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/c8c84d9e-2274-49dd-99e9-cbd7222c22d5" status: 200 len: 1496 microversion: 2.1 time: 0.280489 Oct 04 18:33:43.272235 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 761/1465] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:42 2022] GET /compute/v2.1/servers/c8c84d9e-2274-49dd-99e9-cbd7222c22d5 => generated 1496 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:43.293081 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7efee988-54be-4bed-a2c9-d0184dbfd524 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:43.296822 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7efee988-54be-4bed-a2c9-d0184dbfd524 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:43.297368 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7efee988-54be-4bed-a2c9-d0184dbfd524 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:43.297807 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7efee988-54be-4bed-a2c9-d0184dbfd524 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:43.299201 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7efee988-54be-4bed-a2c9-d0184dbfd524 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:43.299654 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7efee988-54be-4bed-a2c9-d0184dbfd524 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:43.300088 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7efee988-54be-4bed-a2c9-d0184dbfd524 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:43.310803 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=9 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:43.328766 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7efee988-54be-4bed-a2c9-d0184dbfd524 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.055245 Oct 04 18:33:43.329357 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 762/1466] 10.222.0.20 () {58 vars in 1176 bytes} [Tue Oct 4 18:33:43 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:33:43.355098 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-484e9687-6a24-41c3-a157-23245aab9fe3 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44cc98e07d134a15b0fbf2b80bd25ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e0b0088d8476bbcb4c83783fec0e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:43.367165 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-484e9687-6a24-41c3-a157-23245aab9fe3 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] 10.222.0.20 "GET /compute/v2.1/servers/7fd2a976-0bed-40c2-ba69-a88e8541db48" status: 200 len: 1278 microversion: 2.1 time: 0.140399 Oct 04 18:33:43.372174 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 705/1467] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:43 2022] GET /compute/v2.1/servers/7fd2a976-0bed-40c2-ba69-a88e8541db48 => generated 1278 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:43.560904 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-56952fc4-0cf2-446a-ad98-382814b41f02 req-ef3968a6-0a89-4c76-92e0-e447a55446f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc418c02-1d95-407f-bbda-c696e9ba5959", "tag": "ba72231c-323b-48fb-83de-ea9aad878e62"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:43.563689 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9936c274-4f13-44b9-bcb4-eb2c445bbc9a tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:43.571318 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9936c274-4f13-44b9-bcb4-eb2c445bbc9a tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] [instance: bc418c02-1d95-407f-bbda-c696e9ba5959] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:43.585295 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-56952fc4-0cf2-446a-ad98-382814b41f02 req-ef3968a6-0a89-4c76-92e0-e447a55446f0 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:43.585928 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-56952fc4-0cf2-446a-ad98-382814b41f02 req-ef3968a6-0a89-4c76-92e0-e447a55446f0 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:43.586754 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9936c274-4f13-44b9-bcb4-eb2c445bbc9a tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:43.587294 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-56952fc4-0cf2-446a-ad98-382814b41f02 req-ef3968a6-0a89-4c76-92e0-e447a55446f0 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:43.588978 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9936c274-4f13-44b9-bcb4-eb2c445bbc9a tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:43.590195 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9936c274-4f13-44b9-bcb4-eb2c445bbc9a tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:43.591161 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9936c274-4f13-44b9-bcb4-eb2c445bbc9a tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:43.592910 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9936c274-4f13-44b9-bcb4-eb2c445bbc9a tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:43.593791 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9936c274-4f13-44b9-bcb4-eb2c445bbc9a tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:43.607559 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-56952fc4-0cf2-446a-ad98-382814b41f02 req-ef3968a6-0a89-4c76-92e0-e447a55446f0 service nova] Creating event network-changed:ba72231c-323b-48fb-83de-ea9aad878e62 for instance bc418c02-1d95-407f-bbda-c696e9ba5959 on n-h1-850501-14 Oct 04 18:33:43.617026 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-56952fc4-0cf2-446a-ad98-382814b41f02 req-ef3968a6-0a89-4c76-92e0-e447a55446f0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058975 Oct 04 18:33:43.618346 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 706/1468] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:33:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:33:43.750855 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9936c274-4f13-44b9-bcb4-eb2c445bbc9a tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bed3af030c43dbaa23a3e23520f407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7808c2a8d8491aa5e1594383fab2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:43.760970 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9936c274-4f13-44b9-bcb4-eb2c445bbc9a tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] 10.222.0.20 "GET /compute/v2.1/servers/bc418c02-1d95-407f-bbda-c696e9ba5959" status: 200 len: 1575 microversion: 2.1 time: 0.207107 Oct 04 18:33:43.761796 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 763/1469] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:43 2022] GET /compute/v2.1/servers/bc418c02-1d95-407f-bbda-c696e9ba5959 => generated 1575 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:43.815516 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-cf7480a2-f860-4109-b437-76c4945e3aac tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:43.816280 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-cf7480a2-f860-4109-b437-76c4945e3aac tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] [instance: 0948d595-51a2-41fb-b561-8255de0bc6a0] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:43.825430 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cf7480a2-f860-4109-b437-76c4945e3aac tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:43.825917 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cf7480a2-f860-4109-b437-76c4945e3aac tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:43.826347 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cf7480a2-f860-4109-b437-76c4945e3aac tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:43.827216 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cf7480a2-f860-4109-b437-76c4945e3aac tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:43.828172 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cf7480a2-f860-4109-b437-76c4945e3aac tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:43.828537 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cf7480a2-f860-4109-b437-76c4945e3aac tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:43.866002 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-eb1a736d-d972-4361-b57e-6c8207a0ae8b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:43.867311 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-eb1a736d-d972-4361-b57e-6c8207a0ae8b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: b219d988-2847-45a0-a3b8-af54cf1a43f8] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:43.874889 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eb1a736d-d972-4361-b57e-6c8207a0ae8b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:43.875725 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eb1a736d-d972-4361-b57e-6c8207a0ae8b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:43.878173 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eb1a736d-d972-4361-b57e-6c8207a0ae8b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:43.879710 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eb1a736d-d972-4361-b57e-6c8207a0ae8b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:43.880415 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eb1a736d-d972-4361-b57e-6c8207a0ae8b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:43.882447 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eb1a736d-d972-4361-b57e-6c8207a0ae8b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:44.108577 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-eb1a736d-d972-4361-b57e-6c8207a0ae8b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:44.123663 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-eb1a736d-d972-4361-b57e-6c8207a0ae8b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:44.126627 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-eb1a736d-d972-4361-b57e-6c8207a0ae8b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:44.129917 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-eb1a736d-d972-4361-b57e-6c8207a0ae8b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8" status: 200 len: 1811 microversion: 2.25 time: 0.267994 Oct 04 18:33:44.132974 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 764/1470] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:43 2022] GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8 => generated 1811 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:44.147709 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3ca71169-84f6-4cc3-9f96-bd0fd596182a tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:44.155268 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-cf7480a2-f860-4109-b437-76c4945e3aac tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6ff8f5b6c58416b82eb6765a209b344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064cbc5ef6a4f5c9df672a3b8668040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:44.160585 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3ca71169-84f6-4cc3-9f96-bd0fd596182a tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:44.188708 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-cf7480a2-f860-4109-b437-76c4945e3aac tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] 10.222.0.20 "GET /compute/v2.1/servers/0948d595-51a2-41fb-b561-8255de0bc6a0" status: 200 len: 1319 microversion: 2.1 time: 0.353992 Oct 04 18:33:44.188708 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 707/1471] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:43 2022] GET /compute/v2.1/servers/0948d595-51a2-41fb-b561-8255de0bc6a0 => generated 1319 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:44.189138 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3ca71169-84f6-4cc3-9f96-bd0fd596182a tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:44.189138 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3ca71169-84f6-4cc3-9f96-bd0fd596182a tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:44.189138 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3ca71169-84f6-4cc3-9f96-bd0fd596182a tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:44.189138 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3ca71169-84f6-4cc3-9f96-bd0fd596182a tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:44.189138 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3ca71169-84f6-4cc3-9f96-bd0fd596182a tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:44.190844 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3ca71169-84f6-4cc3-9f96-bd0fd596182a tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:44.295355 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-152f403b-db6b-4a2e-ac80-d2d9c007ed2f tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:44.295944 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-152f403b-db6b-4a2e-ac80-d2d9c007ed2f tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: c8c84d9e-2274-49dd-99e9-cbd7222c22d5] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:44.314571 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-152f403b-db6b-4a2e-ac80-d2d9c007ed2f tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:44.315080 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-152f403b-db6b-4a2e-ac80-d2d9c007ed2f tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:44.320954 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-152f403b-db6b-4a2e-ac80-d2d9c007ed2f tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:44.328430 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-152f403b-db6b-4a2e-ac80-d2d9c007ed2f tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:44.330009 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-152f403b-db6b-4a2e-ac80-d2d9c007ed2f tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:44.330457 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-152f403b-db6b-4a2e-ac80-d2d9c007ed2f tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:44.375321 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3ca71169-84f6-4cc3-9f96-bd0fd596182a tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:44.412463 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3ca71169-84f6-4cc3-9f96-bd0fd596182a tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:44.417323 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3ca71169-84f6-4cc3-9f96-bd0fd596182a tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:44.429753 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3ca71169-84f6-4cc3-9f96-bd0fd596182a tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1558 microversion: 2.91 time: 0.294775 Oct 04 18:33:44.430687 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 765/1472] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:44 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1558 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:44.449945 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-0a291f5b-381b-4323-8a10-30f1fdc9ea7f req-525339cf-deda-4d57-ad0b-e6b5bef5ef71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0948d595-51a2-41fb-b561-8255de0bc6a0", "name": "network-vif-plugged", "status": "completed", "tag": "2957805e-e9be-4262-adc3-d1a7b55b1476"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:44.478871 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-0a291f5b-381b-4323-8a10-30f1fdc9ea7f req-525339cf-deda-4d57-ad0b-e6b5bef5ef71 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:44.480332 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-0a291f5b-381b-4323-8a10-30f1fdc9ea7f req-525339cf-deda-4d57-ad0b-e6b5bef5ef71 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:44.480971 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-0a291f5b-381b-4323-8a10-30f1fdc9ea7f req-525339cf-deda-4d57-ad0b-e6b5bef5ef71 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:44.496983 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-0a291f5b-381b-4323-8a10-30f1fdc9ea7f req-525339cf-deda-4d57-ad0b-e6b5bef5ef71 service nova] Creating event network-vif-plugged:2957805e-e9be-4262-adc3-d1a7b55b1476 for instance 0948d595-51a2-41fb-b561-8255de0bc6a0 on n-h2-850501-14 Oct 04 18:33:44.502657 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-0a291f5b-381b-4323-8a10-30f1fdc9ea7f req-525339cf-deda-4d57-ad0b-e6b5bef5ef71 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069481 Oct 04 18:33:44.505042 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 766/1473] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:33:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:33:44.511916 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ef41304b-9717-4d7f-83bc-90a986fe5bf0 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:44.512966 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ef41304b-9717-4d7f-83bc-90a986fe5bf0 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] [instance: 7fd2a976-0bed-40c2-ba69-a88e8541db48] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:44.525704 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ef41304b-9717-4d7f-83bc-90a986fe5bf0 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:44.525704 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ef41304b-9717-4d7f-83bc-90a986fe5bf0 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:44.525704 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ef41304b-9717-4d7f-83bc-90a986fe5bf0 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:44.525704 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ef41304b-9717-4d7f-83bc-90a986fe5bf0 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:44.525704 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ef41304b-9717-4d7f-83bc-90a986fe5bf0 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:44.536014 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ef41304b-9717-4d7f-83bc-90a986fe5bf0 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:44.644168 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-152f403b-db6b-4a2e-ac80-d2d9c007ed2f tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:44.651566 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-152f403b-db6b-4a2e-ac80-d2d9c007ed2f tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/c8c84d9e-2274-49dd-99e9-cbd7222c22d5" status: 200 len: 1496 microversion: 2.1 time: 0.360238 Oct 04 18:33:44.652369 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 708/1474] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:44 2022] GET /compute/v2.1/servers/c8c84d9e-2274-49dd-99e9-cbd7222c22d5 => generated 1496 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:44.788237 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ef41304b-9717-4d7f-83bc-90a986fe5bf0 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44cc98e07d134a15b0fbf2b80bd25ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e0b0088d8476bbcb4c83783fec0e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:44.798341 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ef41304b-9717-4d7f-83bc-90a986fe5bf0 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] 10.222.0.20 "GET /compute/v2.1/servers/7fd2a976-0bed-40c2-ba69-a88e8541db48" status: 200 len: 1320 microversion: 2.1 time: 0.291644 Oct 04 18:33:44.798930 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 767/1475] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:44 2022] GET /compute/v2.1/servers/7fd2a976-0bed-40c2-ba69-a88e8541db48 => generated 1320 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:45.163732 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-060e4722-17f6-4c4b-a5d8-512f36d1eff3 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:45.164777 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-060e4722-17f6-4c4b-a5d8-512f36d1eff3 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: b219d988-2847-45a0-a3b8-af54cf1a43f8] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:45.183854 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-060e4722-17f6-4c4b-a5d8-512f36d1eff3 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:45.184733 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-060e4722-17f6-4c4b-a5d8-512f36d1eff3 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:45.185516 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-060e4722-17f6-4c4b-a5d8-512f36d1eff3 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:45.186457 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-060e4722-17f6-4c4b-a5d8-512f36d1eff3 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:45.187215 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-060e4722-17f6-4c4b-a5d8-512f36d1eff3 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:45.187848 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-060e4722-17f6-4c4b-a5d8-512f36d1eff3 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:45.205099 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-89b28773-3c5e-4f68-a1f7-48e87b4fa711 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:45.205099 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-89b28773-3c5e-4f68-a1f7-48e87b4fa711 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] [instance: 0948d595-51a2-41fb-b561-8255de0bc6a0] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:45.215245 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-89b28773-3c5e-4f68-a1f7-48e87b4fa711 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:45.217913 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-89b28773-3c5e-4f68-a1f7-48e87b4fa711 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:45.221016 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-89b28773-3c5e-4f68-a1f7-48e87b4fa711 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:45.222577 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-89b28773-3c5e-4f68-a1f7-48e87b4fa711 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:45.226914 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-89b28773-3c5e-4f68-a1f7-48e87b4fa711 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:45.227440 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-89b28773-3c5e-4f68-a1f7-48e87b4fa711 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:45.453465 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-060e4722-17f6-4c4b-a5d8-512f36d1eff3 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:45.469574 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-060e4722-17f6-4c4b-a5d8-512f36d1eff3 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:45.476404 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-060e4722-17f6-4c4b-a5d8-512f36d1eff3 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:45.481381 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-060e4722-17f6-4c4b-a5d8-512f36d1eff3 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8" status: 200 len: 1811 microversion: 2.25 time: 0.321194 Oct 04 18:33:45.483136 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 709/1476] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:45 2022] GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8 => generated 1811 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:45.501240 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ffd34434-8769-4105-af57-92e7c5c0d518 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:45.502268 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ffd34434-8769-4105-af57-92e7c5c0d518 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:45.517097 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-89b28773-3c5e-4f68-a1f7-48e87b4fa711 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6ff8f5b6c58416b82eb6765a209b344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064cbc5ef6a4f5c9df672a3b8668040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:45.520504 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ffd34434-8769-4105-af57-92e7c5c0d518 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:45.521406 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ffd34434-8769-4105-af57-92e7c5c0d518 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:45.522119 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ffd34434-8769-4105-af57-92e7c5c0d518 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:45.523114 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ffd34434-8769-4105-af57-92e7c5c0d518 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:45.523852 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ffd34434-8769-4105-af57-92e7c5c0d518 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:45.525048 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ffd34434-8769-4105-af57-92e7c5c0d518 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:45.549780 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-89b28773-3c5e-4f68-a1f7-48e87b4fa711 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] 10.222.0.20 "GET /compute/v2.1/servers/0948d595-51a2-41fb-b561-8255de0bc6a0" status: 200 len: 1319 microversion: 2.1 time: 0.348551 Oct 04 18:33:45.551107 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 768/1477] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:45 2022] GET /compute/v2.1/servers/0948d595-51a2-41fb-b561-8255de0bc6a0 => generated 1319 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:45.657840 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ffd34434-8769-4105-af57-92e7c5c0d518 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:45.675015 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ffd34434-8769-4105-af57-92e7c5c0d518 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:45.677333 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-825333d5-07a8-4b15-9aa7-ac2f8da2a924 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:45.678203 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-825333d5-07a8-4b15-9aa7-ac2f8da2a924 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: c8c84d9e-2274-49dd-99e9-cbd7222c22d5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:45.678489 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ffd34434-8769-4105-af57-92e7c5c0d518 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:45.689627 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ffd34434-8769-4105-af57-92e7c5c0d518 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1558 microversion: 2.91 time: 0.202380 Oct 04 18:33:45.689627 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 710/1478] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:45 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1558 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:45.691848 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-825333d5-07a8-4b15-9aa7-ac2f8da2a924 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:45.701384 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-825333d5-07a8-4b15-9aa7-ac2f8da2a924 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:45.702092 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-825333d5-07a8-4b15-9aa7-ac2f8da2a924 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:45.703027 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-825333d5-07a8-4b15-9aa7-ac2f8da2a924 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:45.703650 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-825333d5-07a8-4b15-9aa7-ac2f8da2a924 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:45.704280 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-825333d5-07a8-4b15-9aa7-ac2f8da2a924 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:45.823448 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6c8ea87d-222e-4883-a69a-7ea52a7f7b11 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:45.824142 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6c8ea87d-222e-4883-a69a-7ea52a7f7b11 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] [instance: 7fd2a976-0bed-40c2-ba69-a88e8541db48] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:45.830270 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6c8ea87d-222e-4883-a69a-7ea52a7f7b11 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:45.834050 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6c8ea87d-222e-4883-a69a-7ea52a7f7b11 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:45.834050 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6c8ea87d-222e-4883-a69a-7ea52a7f7b11 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:45.834050 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6c8ea87d-222e-4883-a69a-7ea52a7f7b11 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:45.834050 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6c8ea87d-222e-4883-a69a-7ea52a7f7b11 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:45.834050 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6c8ea87d-222e-4883-a69a-7ea52a7f7b11 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:45.888557 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-825333d5-07a8-4b15-9aa7-ac2f8da2a924 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:45.899263 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-825333d5-07a8-4b15-9aa7-ac2f8da2a924 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/c8c84d9e-2274-49dd-99e9-cbd7222c22d5" status: 200 len: 1496 microversion: 2.1 time: 0.225286 Oct 04 18:33:45.901582 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 769/1479] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:45 2022] GET /compute/v2.1/servers/c8c84d9e-2274-49dd-99e9-cbd7222c22d5 => generated 1496 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:45.917141 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-0b3d6666-d086-49b5-bd5d-4fbc93b437ab req-92da6a14-b421-4602-9ee2-b01e55acdd50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a384d42-782c-49ac-ad60-e98cf5924e92", "tag": "32162a47-baaf-47bb-89d8-931b66187f65"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:45.938572 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-0b3d6666-d086-49b5-bd5d-4fbc93b437ab req-92da6a14-b421-4602-9ee2-b01e55acdd50 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:45.939052 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-0b3d6666-d086-49b5-bd5d-4fbc93b437ab req-92da6a14-b421-4602-9ee2-b01e55acdd50 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:45.939478 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-0b3d6666-d086-49b5-bd5d-4fbc93b437ab req-92da6a14-b421-4602-9ee2-b01e55acdd50 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:45.963291 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-0b3d6666-d086-49b5-bd5d-4fbc93b437ab req-92da6a14-b421-4602-9ee2-b01e55acdd50 service nova] Creating event network-changed:32162a47-baaf-47bb-89d8-931b66187f65 for instance 7a384d42-782c-49ac-ad60-e98cf5924e92 on n-h1-850501-14 Oct 04 18:33:45.971416 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-0b3d6666-d086-49b5-bd5d-4fbc93b437ab req-92da6a14-b421-4602-9ee2-b01e55acdd50 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068405 Oct 04 18:33:45.972563 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 770/1480] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:33:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:33:46.008945 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6c8ea87d-222e-4883-a69a-7ea52a7f7b11 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44cc98e07d134a15b0fbf2b80bd25ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e0b0088d8476bbcb4c83783fec0e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:46.017943 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6c8ea87d-222e-4883-a69a-7ea52a7f7b11 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] 10.222.0.20 "GET /compute/v2.1/servers/7fd2a976-0bed-40c2-ba69-a88e8541db48" status: 200 len: 1320 microversion: 2.1 time: 0.198143 Oct 04 18:33:46.035122 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 711/1481] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:45 2022] GET /compute/v2.1/servers/7fd2a976-0bed-40c2-ba69-a88e8541db48 => generated 1320 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:33:46.354974 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f59e8b9b-b1e8-4c32-929f-e2011b405e4a tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1c120330-d74d-49d4-807f-2d91ac218d32", "device": "/dev/xvdb"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:46.357489 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f59e8b9b-b1e8-4c32-929f-e2011b405e4a tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 158e9f52-fd16-48d1-87b5-e0dd523e97a4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:46.359577 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=14 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:46.365947 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f59e8b9b-b1e8-4c32-929f-e2011b405e4a tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:46.366903 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f59e8b9b-b1e8-4c32-929f-e2011b405e4a tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:46.367321 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f59e8b9b-b1e8-4c32-929f-e2011b405e4a tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:46.368025 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f59e8b9b-b1e8-4c32-929f-e2011b405e4a tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:46.368497 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f59e8b9b-b1e8-4c32-929f-e2011b405e4a tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:46.368912 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f59e8b9b-b1e8-4c32-929f-e2011b405e4a tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:46.509518 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-aebe62a4-f8db-4e80-95b1-fbfc27b80f31 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:46.510787 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-aebe62a4-f8db-4e80-95b1-fbfc27b80f31 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: b219d988-2847-45a0-a3b8-af54cf1a43f8] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:46.520931 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aebe62a4-f8db-4e80-95b1-fbfc27b80f31 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:46.521714 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aebe62a4-f8db-4e80-95b1-fbfc27b80f31 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:46.522463 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aebe62a4-f8db-4e80-95b1-fbfc27b80f31 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:46.523444 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aebe62a4-f8db-4e80-95b1-fbfc27b80f31 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:46.524085 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aebe62a4-f8db-4e80-95b1-fbfc27b80f31 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:46.524738 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aebe62a4-f8db-4e80-95b1-fbfc27b80f31 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:46.758464 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-aebe62a4-f8db-4e80-95b1-fbfc27b80f31 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:46.771026 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-aebe62a4-f8db-4e80-95b1-fbfc27b80f31 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:46.774524 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-aebe62a4-f8db-4e80-95b1-fbfc27b80f31 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:46.778446 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-aebe62a4-f8db-4e80-95b1-fbfc27b80f31 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8" status: 200 len: 1811 microversion: 2.25 time: 0.274228 Oct 04 18:33:46.782656 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 712/1482] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:46 2022] GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8 => generated 1811 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:33:46.793159 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d3dcf35d-6a70-44b4-b62a-d16678c86826 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:46.794067 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d3dcf35d-6a70-44b4-b62a-d16678c86826 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] [instance: 0948d595-51a2-41fb-b561-8255de0bc6a0] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:46.820178 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=100 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:46.823540 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d3dcf35d-6a70-44b4-b62a-d16678c86826 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:46.824564 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d3dcf35d-6a70-44b4-b62a-d16678c86826 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:46.825278 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d3dcf35d-6a70-44b4-b62a-d16678c86826 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:46.826217 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d3dcf35d-6a70-44b4-b62a-d16678c86826 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:46.831457 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d3dcf35d-6a70-44b4-b62a-d16678c86826 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:46.832873 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d3dcf35d-6a70-44b4-b62a-d16678c86826 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:47.035724 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d3dcf35d-6a70-44b4-b62a-d16678c86826 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6ff8f5b6c58416b82eb6765a209b344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064cbc5ef6a4f5c9df672a3b8668040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:47.046082 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d3dcf35d-6a70-44b4-b62a-d16678c86826 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] 10.222.0.20 "GET /compute/v2.1/servers/0948d595-51a2-41fb-b561-8255de0bc6a0" status: 200 len: 1319 microversion: 2.1 time: 0.261684 Oct 04 18:33:47.047171 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 713/1483] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:46 2022] GET /compute/v2.1/servers/0948d595-51a2-41fb-b561-8255de0bc6a0 => generated 1319 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:47.053782 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1fadad26-9948-4125-ac61-364748e1698d tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:47.054941 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1fadad26-9948-4125-ac61-364748e1698d tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:47.063130 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1fadad26-9948-4125-ac61-364748e1698d tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:47.064002 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1fadad26-9948-4125-ac61-364748e1698d tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:47.064829 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1fadad26-9948-4125-ac61-364748e1698d tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:47.065843 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1fadad26-9948-4125-ac61-364748e1698d tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:47.066543 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1fadad26-9948-4125-ac61-364748e1698d tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:47.068156 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1fadad26-9948-4125-ac61-364748e1698d tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:47.172344 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1fadad26-9948-4125-ac61-364748e1698d tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:47.182755 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1fadad26-9948-4125-ac61-364748e1698d tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:47.184585 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1fadad26-9948-4125-ac61-364748e1698d tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:47.190451 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1fadad26-9948-4125-ac61-364748e1698d tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1553 microversion: 2.91 time: 0.141974 Oct 04 18:33:47.191116 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 714/1484] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:47 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1553 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:47.197574 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0df3d5fb-59f9-4d45-af1e-1e14a4e4d04e tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:47.198538 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0df3d5fb-59f9-4d45-af1e-1e14a4e4d04e tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: c8c84d9e-2274-49dd-99e9-cbd7222c22d5] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:47.209831 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0df3d5fb-59f9-4d45-af1e-1e14a4e4d04e tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:47.210346 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0df3d5fb-59f9-4d45-af1e-1e14a4e4d04e tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:47.210754 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0df3d5fb-59f9-4d45-af1e-1e14a4e4d04e tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:47.211460 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0df3d5fb-59f9-4d45-af1e-1e14a4e4d04e tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:47.211922 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0df3d5fb-59f9-4d45-af1e-1e14a4e4d04e tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:47.212434 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0df3d5fb-59f9-4d45-af1e-1e14a4e4d04e tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:47.358794 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0df3d5fb-59f9-4d45-af1e-1e14a4e4d04e tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:47.368712 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0df3d5fb-59f9-4d45-af1e-1e14a4e4d04e tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/c8c84d9e-2274-49dd-99e9-cbd7222c22d5" status: 200 len: 1496 microversion: 2.1 time: 0.175056 Oct 04 18:33:47.379130 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 715/1485] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:47 2022] GET /compute/v2.1/servers/c8c84d9e-2274-49dd-99e9-cbd7222c22d5 => generated 1496 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:47.379130 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c1b9d95c-7ddd-42a9-83b0-33f6ef26ff0e tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:47.379130 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c1b9d95c-7ddd-42a9-83b0-33f6ef26ff0e tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] [instance: 7fd2a976-0bed-40c2-ba69-a88e8541db48] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:47.391910 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c1b9d95c-7ddd-42a9-83b0-33f6ef26ff0e tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:47.393204 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c1b9d95c-7ddd-42a9-83b0-33f6ef26ff0e tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:47.393204 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c1b9d95c-7ddd-42a9-83b0-33f6ef26ff0e tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:47.393880 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c1b9d95c-7ddd-42a9-83b0-33f6ef26ff0e tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:47.394337 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c1b9d95c-7ddd-42a9-83b0-33f6ef26ff0e tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:47.395590 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c1b9d95c-7ddd-42a9-83b0-33f6ef26ff0e tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:47.413744 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:47.569062 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c1b9d95c-7ddd-42a9-83b0-33f6ef26ff0e tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44cc98e07d134a15b0fbf2b80bd25ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e0b0088d8476bbcb4c83783fec0e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:47.577506 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f59e8b9b-b1e8-4c32-929f-e2011b405e4a tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "POST /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.223142 Oct 04 18:33:47.583691 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c1b9d95c-7ddd-42a9-83b0-33f6ef26ff0e tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] 10.222.0.20 "GET /compute/v2.1/servers/7fd2a976-0bed-40c2-ba69-a88e8541db48" status: 200 len: 1320 microversion: 2.1 time: 0.211831 Oct 04 18:33:47.588598 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 771/1486] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Oct 4 18:33:46 2022] POST /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4/os-volume_attachments => generated 194 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:33:47.604271 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 716/1487] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:47 2022] GET /compute/v2.1/servers/7fd2a976-0bed-40c2-ba69-a88e8541db48 => generated 1320 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:47.823926 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4a483ae6-c2de-4d4b-b72d-f2f1df52b8fd tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:47.826628 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4a483ae6-c2de-4d4b-b72d-f2f1df52b8fd tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: b219d988-2847-45a0-a3b8-af54cf1a43f8] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:47.846441 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4a483ae6-c2de-4d4b-b72d-f2f1df52b8fd tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:47.847314 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4a483ae6-c2de-4d4b-b72d-f2f1df52b8fd tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:47.849145 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4a483ae6-c2de-4d4b-b72d-f2f1df52b8fd tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:47.850167 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4a483ae6-c2de-4d4b-b72d-f2f1df52b8fd tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:47.850842 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4a483ae6-c2de-4d4b-b72d-f2f1df52b8fd tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:47.851484 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4a483ae6-c2de-4d4b-b72d-f2f1df52b8fd tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:48.045758 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4a483ae6-c2de-4d4b-b72d-f2f1df52b8fd tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:48.050290 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=36 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:48.056097 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-ee35d888-3004-4c3c-a15b-aac4733b5909 req-0e28a8f1-4135-4879-818c-bec312ec732a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fd2a976-0bed-40c2-ba69-a88e8541db48", "tag": "480deffd-886a-4376-bd61-3b97bf1b5aa3"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:48.059101 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4a483ae6-c2de-4d4b-b72d-f2f1df52b8fd tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:48.061405 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4a483ae6-c2de-4d4b-b72d-f2f1df52b8fd tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:48.062696 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4a483ae6-c2de-4d4b-b72d-f2f1df52b8fd tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8" status: 200 len: 1811 microversion: 2.25 time: 0.253385 Oct 04 18:33:48.069117 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-ee35d888-3004-4c3c-a15b-aac4733b5909 req-0e28a8f1-4135-4879-818c-bec312ec732a service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:48.069823 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-ee35d888-3004-4c3c-a15b-aac4733b5909 req-0e28a8f1-4135-4879-818c-bec312ec732a service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:48.070412 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-ee35d888-3004-4c3c-a15b-aac4733b5909 req-0e28a8f1-4135-4879-818c-bec312ec732a service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:48.077162 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 772/1488] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:47 2022] GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8 => generated 1811 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:48.085814 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-ee35d888-3004-4c3c-a15b-aac4733b5909 req-0e28a8f1-4135-4879-818c-bec312ec732a service nova] Creating event network-changed:480deffd-886a-4376-bd61-3b97bf1b5aa3 for instance 7fd2a976-0bed-40c2-ba69-a88e8541db48 on n-h1-850501-14 Oct 04 18:33:48.091246 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-ee35d888-3004-4c3c-a15b-aac4733b5909 req-0e28a8f1-4135-4879-818c-bec312ec732a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041937 Oct 04 18:33:48.095341 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 717/1489] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:33:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:33:48.115998 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d9a861d5-8d76-49c3-bf92-3052a8007061 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:48.116768 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d9a861d5-8d76-49c3-bf92-3052a8007061 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] [instance: 0948d595-51a2-41fb-b561-8255de0bc6a0] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:48.123267 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d9a861d5-8d76-49c3-bf92-3052a8007061 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:48.127061 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d9a861d5-8d76-49c3-bf92-3052a8007061 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:48.127962 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d9a861d5-8d76-49c3-bf92-3052a8007061 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:48.129036 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d9a861d5-8d76-49c3-bf92-3052a8007061 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:48.129916 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d9a861d5-8d76-49c3-bf92-3052a8007061 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:48.130539 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d9a861d5-8d76-49c3-bf92-3052a8007061 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:48.227261 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a5e4dc5b-0016-4fe2-b5a1-fce1ec5931cb tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:48.228346 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a5e4dc5b-0016-4fe2-b5a1-fce1ec5931cb tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:48.238617 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a5e4dc5b-0016-4fe2-b5a1-fce1ec5931cb tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:48.239744 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a5e4dc5b-0016-4fe2-b5a1-fce1ec5931cb tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:48.240556 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a5e4dc5b-0016-4fe2-b5a1-fce1ec5931cb tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:48.241485 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a5e4dc5b-0016-4fe2-b5a1-fce1ec5931cb tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:48.242401 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a5e4dc5b-0016-4fe2-b5a1-fce1ec5931cb tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:48.243032 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a5e4dc5b-0016-4fe2-b5a1-fce1ec5931cb tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:48.334336 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d9a861d5-8d76-49c3-bf92-3052a8007061 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6ff8f5b6c58416b82eb6765a209b344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064cbc5ef6a4f5c9df672a3b8668040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:48.343941 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d9a861d5-8d76-49c3-bf92-3052a8007061 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] 10.222.0.20 "GET /compute/v2.1/servers/0948d595-51a2-41fb-b561-8255de0bc6a0" status: 200 len: 1468 microversion: 2.1 time: 0.232437 Oct 04 18:33:48.360082 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a5e4dc5b-0016-4fe2-b5a1-fce1ec5931cb tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:48.361735 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 773/1490] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:48 2022] GET /compute/v2.1/servers/0948d595-51a2-41fb-b561-8255de0bc6a0 => generated 1468 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:48.373073 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2ae0795f-9994-496a-b10e-03e79659a584 tempest-LiveMigrationNegativeTest-168754894 tempest-LiveMigrationNegativeTest-168754894-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:48.373869 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2ae0795f-9994-496a-b10e-03e79659a584 tempest-LiveMigrationNegativeTest-168754894 tempest-LiveMigrationNegativeTest-168754894-project-admin] [instance: 0948d595-51a2-41fb-b561-8255de0bc6a0] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:48.382163 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2ae0795f-9994-496a-b10e-03e79659a584 tempest-LiveMigrationNegativeTest-168754894 tempest-LiveMigrationNegativeTest-168754894-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:48.383008 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2ae0795f-9994-496a-b10e-03e79659a584 tempest-LiveMigrationNegativeTest-168754894 tempest-LiveMigrationNegativeTest-168754894-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:48.383641 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2ae0795f-9994-496a-b10e-03e79659a584 tempest-LiveMigrationNegativeTest-168754894 tempest-LiveMigrationNegativeTest-168754894-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:48.384583 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2ae0795f-9994-496a-b10e-03e79659a584 tempest-LiveMigrationNegativeTest-168754894 tempest-LiveMigrationNegativeTest-168754894-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:48.385222 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2ae0795f-9994-496a-b10e-03e79659a584 tempest-LiveMigrationNegativeTest-168754894 tempest-LiveMigrationNegativeTest-168754894-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:48.385937 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2ae0795f-9994-496a-b10e-03e79659a584 tempest-LiveMigrationNegativeTest-168754894 tempest-LiveMigrationNegativeTest-168754894-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:48.386300 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a5e4dc5b-0016-4fe2-b5a1-fce1ec5931cb tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:48.392131 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a5e4dc5b-0016-4fe2-b5a1-fce1ec5931cb tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:48.408920 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a5e4dc5b-0016-4fe2-b5a1-fce1ec5931cb tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1553 microversion: 2.91 time: 0.190120 Oct 04 18:33:48.418715 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-2ae0795f-9994-496a-b10e-03e79659a584 tempest-LiveMigrationNegativeTest-168754894 tempest-LiveMigrationNegativeTest-168754894-project-admin] Lazy-loading 'flavor' on Instance uuid 0948d595-51a2-41fb-b561-8255de0bc6a0 {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:33:48.430992 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 718/1491] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:48 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1553 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:48.442724 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-aeefd527-c224-4dbc-b64b-0456df541ede tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:48.448691 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-aeefd527-c224-4dbc-b64b-0456df541ede tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: c8c84d9e-2274-49dd-99e9-cbd7222c22d5] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:48.455271 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aeefd527-c224-4dbc-b64b-0456df541ede tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:48.455897 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aeefd527-c224-4dbc-b64b-0456df541ede tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:48.456480 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aeefd527-c224-4dbc-b64b-0456df541ede tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:48.457404 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aeefd527-c224-4dbc-b64b-0456df541ede tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:48.457992 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aeefd527-c224-4dbc-b64b-0456df541ede tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:48.458528 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aeefd527-c224-4dbc-b64b-0456df541ede tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:48.640497 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-aeefd527-c224-4dbc-b64b-0456df541ede tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:48.661174 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-aeefd527-c224-4dbc-b64b-0456df541ede tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/c8c84d9e-2274-49dd-99e9-cbd7222c22d5" status: 200 len: 1496 microversion: 2.1 time: 0.224372 Oct 04 18:33:48.663136 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 719/1492] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:48 2022] GET /compute/v2.1/servers/c8c84d9e-2274-49dd-99e9-cbd7222c22d5 => generated 1496 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:48.694305 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-16339e34-31ea-4e8b-a017-dd7c226bce62 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:48.695269 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-16339e34-31ea-4e8b-a017-dd7c226bce62 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] [instance: 7fd2a976-0bed-40c2-ba69-a88e8541db48] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:48.707609 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-16339e34-31ea-4e8b-a017-dd7c226bce62 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:48.709384 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-16339e34-31ea-4e8b-a017-dd7c226bce62 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:48.711542 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-16339e34-31ea-4e8b-a017-dd7c226bce62 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:48.712610 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-16339e34-31ea-4e8b-a017-dd7c226bce62 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:48.713432 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-16339e34-31ea-4e8b-a017-dd7c226bce62 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:48.716457 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-16339e34-31ea-4e8b-a017-dd7c226bce62 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:48.874016 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2ae0795f-9994-496a-b10e-03e79659a584 tempest-LiveMigrationNegativeTest-168754894 tempest-LiveMigrationNegativeTest-168754894-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/0948d595-51a2-41fb-b561-8255de0bc6a0/action" status: 202 len: 0 microversion: 2.1 time: 0.502518 Oct 04 18:33:48.880802 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 774/1493] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:33:48 2022] POST /compute/v2.1/servers/0948d595-51a2-41fb-b561-8255de0bc6a0/action => generated 0 bytes in 510 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:33:48.895879 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-929a10e1-bd49-435e-a02a-f1304a167a5f tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:48.901025 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-929a10e1-bd49-435e-a02a-f1304a167a5f tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] [instance: 0948d595-51a2-41fb-b561-8255de0bc6a0] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:48.918972 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-929a10e1-bd49-435e-a02a-f1304a167a5f tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:48.921448 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-929a10e1-bd49-435e-a02a-f1304a167a5f tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:48.921924 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-929a10e1-bd49-435e-a02a-f1304a167a5f tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:48.923527 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-929a10e1-bd49-435e-a02a-f1304a167a5f tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:48.925814 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-929a10e1-bd49-435e-a02a-f1304a167a5f tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:48.926525 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-929a10e1-bd49-435e-a02a-f1304a167a5f tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:48.945874 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:48.969702 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-16339e34-31ea-4e8b-a017-dd7c226bce62 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44cc98e07d134a15b0fbf2b80bd25ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e0b0088d8476bbcb4c83783fec0e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:48.979653 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-16339e34-31ea-4e8b-a017-dd7c226bce62 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] 10.222.0.20 "GET /compute/v2.1/servers/7fd2a976-0bed-40c2-ba69-a88e8541db48" status: 200 len: 1320 microversion: 2.1 time: 0.300580 Oct 04 18:33:48.980273 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 720/1494] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:48 2022] GET /compute/v2.1/servers/7fd2a976-0bed-40c2-ba69-a88e8541db48 => generated 1320 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:49.091947 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-fd52195f-4f49-4af4-960b-c7d48c6d2ae2 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:49.092661 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-fd52195f-4f49-4af4-960b-c7d48c6d2ae2 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: b219d988-2847-45a0-a3b8-af54cf1a43f8] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:49.100196 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fd52195f-4f49-4af4-960b-c7d48c6d2ae2 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:49.101747 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fd52195f-4f49-4af4-960b-c7d48c6d2ae2 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:49.102194 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fd52195f-4f49-4af4-960b-c7d48c6d2ae2 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:49.102909 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fd52195f-4f49-4af4-960b-c7d48c6d2ae2 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:49.103537 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fd52195f-4f49-4af4-960b-c7d48c6d2ae2 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:49.104165 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fd52195f-4f49-4af4-960b-c7d48c6d2ae2 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:49.264545 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-929a10e1-bd49-435e-a02a-f1304a167a5f tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6ff8f5b6c58416b82eb6765a209b344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064cbc5ef6a4f5c9df672a3b8668040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:49.274754 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-929a10e1-bd49-435e-a02a-f1304a167a5f tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] 10.222.0.20 "GET /compute/v2.1/servers/0948d595-51a2-41fb-b561-8255de0bc6a0" status: 200 len: 1476 microversion: 2.1 time: 0.391241 Oct 04 18:33:49.280383 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 775/1495] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:48 2022] GET /compute/v2.1/servers/0948d595-51a2-41fb-b561-8255de0bc6a0 => generated 1476 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:49.376184 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-fd52195f-4f49-4af4-960b-c7d48c6d2ae2 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:49.388939 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-fd52195f-4f49-4af4-960b-c7d48c6d2ae2 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:49.390669 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-fd52195f-4f49-4af4-960b-c7d48c6d2ae2 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:49.392114 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-fd52195f-4f49-4af4-960b-c7d48c6d2ae2 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8" status: 200 len: 1811 microversion: 2.25 time: 0.304510 Oct 04 18:33:49.393556 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 721/1496] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:49 2022] GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8 => generated 1811 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:33:49.450235 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-841c8e15-22a9-4f85-b92b-f8cc4b5da47b tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:49.451214 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-841c8e15-22a9-4f85-b92b-f8cc4b5da47b tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:49.463385 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-841c8e15-22a9-4f85-b92b-f8cc4b5da47b tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:49.466522 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-841c8e15-22a9-4f85-b92b-f8cc4b5da47b tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:49.466522 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-841c8e15-22a9-4f85-b92b-f8cc4b5da47b tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:49.466522 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-841c8e15-22a9-4f85-b92b-f8cc4b5da47b tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:49.467475 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-841c8e15-22a9-4f85-b92b-f8cc4b5da47b tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:49.469122 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-841c8e15-22a9-4f85-b92b-f8cc4b5da47b tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:49.617557 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-841c8e15-22a9-4f85-b92b-f8cc4b5da47b tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:49.626300 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-841c8e15-22a9-4f85-b92b-f8cc4b5da47b tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:49.627743 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-841c8e15-22a9-4f85-b92b-f8cc4b5da47b tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:49.642760 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-841c8e15-22a9-4f85-b92b-f8cc4b5da47b tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1553 microversion: 2.91 time: 0.200442 Oct 04 18:33:49.660142 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 776/1497] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:49 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1553 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:49.699369 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a168a6c1-b150-477f-a550-26dc11e7b9aa tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:49.701632 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a168a6c1-b150-477f-a550-26dc11e7b9aa tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: c8c84d9e-2274-49dd-99e9-cbd7222c22d5] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:49.721428 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a168a6c1-b150-477f-a550-26dc11e7b9aa tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:49.726827 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a168a6c1-b150-477f-a550-26dc11e7b9aa tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:49.726827 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a168a6c1-b150-477f-a550-26dc11e7b9aa tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:49.727377 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a168a6c1-b150-477f-a550-26dc11e7b9aa tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:49.728166 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a168a6c1-b150-477f-a550-26dc11e7b9aa tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:49.730306 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a168a6c1-b150-477f-a550-26dc11e7b9aa tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:50.007296 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5dc04986-737c-433f-a5e7-20f4c7356825 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:50.010891 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5dc04986-737c-433f-a5e7-20f4c7356825 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] [instance: 7fd2a976-0bed-40c2-ba69-a88e8541db48] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:50.036242 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5dc04986-737c-433f-a5e7-20f4c7356825 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:50.045722 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5dc04986-737c-433f-a5e7-20f4c7356825 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:50.049247 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5dc04986-737c-433f-a5e7-20f4c7356825 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:50.057946 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5dc04986-737c-433f-a5e7-20f4c7356825 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:50.057946 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5dc04986-737c-433f-a5e7-20f4c7356825 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:50.057946 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5dc04986-737c-433f-a5e7-20f4c7356825 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:50.118531 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a168a6c1-b150-477f-a550-26dc11e7b9aa tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:50.134505 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a168a6c1-b150-477f-a550-26dc11e7b9aa tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/c8c84d9e-2274-49dd-99e9-cbd7222c22d5" status: 200 len: 1473 microversion: 2.1 time: 0.447721 Oct 04 18:33:50.151146 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 722/1498] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:49 2022] GET /compute/v2.1/servers/c8c84d9e-2274-49dd-99e9-cbd7222c22d5 => generated 1473 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:50.199885 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-39a1977f-1ded-44e7-abe1-534c4b46a0d3 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-217077115"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:50.204457 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-39a1977f-1ded-44e7-abe1-534c4b46a0d3 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: c8c84d9e-2274-49dd-99e9-cbd7222c22d5] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:50.249953 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-39a1977f-1ded-44e7-abe1-534c4b46a0d3 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:50.252985 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-39a1977f-1ded-44e7-abe1-534c4b46a0d3 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:50.253510 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-39a1977f-1ded-44e7-abe1-534c4b46a0d3 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:50.254891 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-39a1977f-1ded-44e7-abe1-534c4b46a0d3 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:50.262137 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-39a1977f-1ded-44e7-abe1-534c4b46a0d3 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:50.262137 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-39a1977f-1ded-44e7-abe1-534c4b46a0d3 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:50.463747 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5dc04986-737c-433f-a5e7-20f4c7356825 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44cc98e07d134a15b0fbf2b80bd25ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e0b0088d8476bbcb4c83783fec0e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:50.472251 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5dc04986-737c-433f-a5e7-20f4c7356825 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] 10.222.0.20 "GET /compute/v2.1/servers/7fd2a976-0bed-40c2-ba69-a88e8541db48" status: 200 len: 1320 microversion: 2.1 time: 0.469964 Oct 04 18:33:50.473460 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 777/1499] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:50 2022] GET /compute/v2.1/servers/7fd2a976-0bed-40c2-ba69-a88e8541db48 => generated 1320 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:33:50.494235 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3c34f955-1328-4965-adaf-0f7d07e1ba36 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:50.495085 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3c34f955-1328-4965-adaf-0f7d07e1ba36 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] [instance: 0948d595-51a2-41fb-b561-8255de0bc6a0] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:50.501766 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3c34f955-1328-4965-adaf-0f7d07e1ba36 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:50.502525 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3c34f955-1328-4965-adaf-0f7d07e1ba36 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:50.503156 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3c34f955-1328-4965-adaf-0f7d07e1ba36 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:50.504809 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3c34f955-1328-4965-adaf-0f7d07e1ba36 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:50.505481 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3c34f955-1328-4965-adaf-0f7d07e1ba36 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:50.512694 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3c34f955-1328-4965-adaf-0f7d07e1ba36 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:50.737698 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3c34f955-1328-4965-adaf-0f7d07e1ba36 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6ff8f5b6c58416b82eb6765a209b344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064cbc5ef6a4f5c9df672a3b8668040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:50.748338 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3c34f955-1328-4965-adaf-0f7d07e1ba36 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] 10.222.0.20 "GET /compute/v2.1/servers/0948d595-51a2-41fb-b561-8255de0bc6a0" status: 200 len: 1459 microversion: 2.1 time: 0.257852 Oct 04 18:33:50.749193 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 778/1500] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:50 2022] GET /compute/v2.1/servers/0948d595-51a2-41fb-b561-8255de0bc6a0 => generated 1459 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:50.756749 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9b928623-f358-4796-a17c-96fe7892ba8b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:50.757799 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9b928623-f358-4796-a17c-96fe7892ba8b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: b219d988-2847-45a0-a3b8-af54cf1a43f8] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:50.771183 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9b928623-f358-4796-a17c-96fe7892ba8b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:50.772035 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9b928623-f358-4796-a17c-96fe7892ba8b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:50.772681 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9b928623-f358-4796-a17c-96fe7892ba8b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:50.773672 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9b928623-f358-4796-a17c-96fe7892ba8b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:50.774873 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9b928623-f358-4796-a17c-96fe7892ba8b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:50.775486 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9b928623-f358-4796-a17c-96fe7892ba8b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:50.886188 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-39a1977f-1ded-44e7-abe1-534c4b46a0d3 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "POST /compute/v2.1/servers/c8c84d9e-2274-49dd-99e9-cbd7222c22d5/action" status: 202 len: 0 microversion: 2.1 time: 0.690122 Oct 04 18:33:50.888404 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 723/1501] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:33:50 2022] POST /compute/v2.1/servers/c8c84d9e-2274-49dd-99e9-cbd7222c22d5/action => generated 0 bytes in 693 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 18:33:50.901224 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7877c857-ef49-458f-a2df-efa7611e20e5 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:50.908360 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7877c857-ef49-458f-a2df-efa7611e20e5 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:50.938460 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7877c857-ef49-458f-a2df-efa7611e20e5 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:50.939415 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7877c857-ef49-458f-a2df-efa7611e20e5 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:50.940042 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7877c857-ef49-458f-a2df-efa7611e20e5 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:50.947733 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7877c857-ef49-458f-a2df-efa7611e20e5 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:50.948629 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7877c857-ef49-458f-a2df-efa7611e20e5 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:50.949282 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7877c857-ef49-458f-a2df-efa7611e20e5 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:51.004029 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9b928623-f358-4796-a17c-96fe7892ba8b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:51.016176 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9b928623-f358-4796-a17c-96fe7892ba8b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:51.017709 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9b928623-f358-4796-a17c-96fe7892ba8b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:51.019357 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9b928623-f358-4796-a17c-96fe7892ba8b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8" status: 200 len: 1811 microversion: 2.25 time: 0.268539 Oct 04 18:33:51.028489 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 779/1502] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:50 2022] GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8 => generated 1811 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:51.044805 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0fd792b8-22a7-42a1-a9fa-65b30f013377 tempest-LiveMigrationNegativeTest-168754894 tempest-LiveMigrationNegativeTest-168754894-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:51.056297 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0fd792b8-22a7-42a1-a9fa-65b30f013377 tempest-LiveMigrationNegativeTest-168754894 tempest-LiveMigrationNegativeTest-168754894-project-admin] [instance: 0948d595-51a2-41fb-b561-8255de0bc6a0] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:51.076340 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0fd792b8-22a7-42a1-a9fa-65b30f013377 tempest-LiveMigrationNegativeTest-168754894 tempest-LiveMigrationNegativeTest-168754894-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:51.077653 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0fd792b8-22a7-42a1-a9fa-65b30f013377 tempest-LiveMigrationNegativeTest-168754894 tempest-LiveMigrationNegativeTest-168754894-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:51.080856 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0fd792b8-22a7-42a1-a9fa-65b30f013377 tempest-LiveMigrationNegativeTest-168754894 tempest-LiveMigrationNegativeTest-168754894-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:51.083372 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0fd792b8-22a7-42a1-a9fa-65b30f013377 tempest-LiveMigrationNegativeTest-168754894 tempest-LiveMigrationNegativeTest-168754894-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:51.084625 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0fd792b8-22a7-42a1-a9fa-65b30f013377 tempest-LiveMigrationNegativeTest-168754894 tempest-LiveMigrationNegativeTest-168754894-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:51.088085 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0fd792b8-22a7-42a1-a9fa-65b30f013377 tempest-LiveMigrationNegativeTest-168754894 tempest-LiveMigrationNegativeTest-168754894-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:51.111905 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7877c857-ef49-458f-a2df-efa7611e20e5 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:51.123610 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7877c857-ef49-458f-a2df-efa7611e20e5 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:51.129141 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7877c857-ef49-458f-a2df-efa7611e20e5 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:51.139492 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7877c857-ef49-458f-a2df-efa7611e20e5 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1553 microversion: 2.91 time: 0.249811 Oct 04 18:33:51.140562 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 724/1503] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:50 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1553 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:51.146363 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0b006863-3b55-4235-bd89-8d146a24f187 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '.version_select at 0x7fe258cd0940>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:51.251221 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0b006863-3b55-4235-bd89-8d146a24f187 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/images/ea702f85-8e85-400a-a6e3-61ce78efff2c" status: 200 len: 1413 microversion: 2.1 time: 0.109056 Oct 04 18:33:51.260101 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 725/1504] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:33:51 2022] GET /compute/v2.1/images/ea702f85-8e85-400a-a6e3-61ce78efff2c => generated 1413 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:51.498894 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a563e79c-00f3-4557-b1e9-089bf61d644b tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:51.507035 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a563e79c-00f3-4557-b1e9-089bf61d644b tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] [instance: 7fd2a976-0bed-40c2-ba69-a88e8541db48] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:51.524647 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a563e79c-00f3-4557-b1e9-089bf61d644b tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:51.530225 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a563e79c-00f3-4557-b1e9-089bf61d644b tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:51.530225 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a563e79c-00f3-4557-b1e9-089bf61d644b tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:51.530225 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a563e79c-00f3-4557-b1e9-089bf61d644b tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:51.530225 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a563e79c-00f3-4557-b1e9-089bf61d644b tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:51.530225 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a563e79c-00f3-4557-b1e9-089bf61d644b tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:51.630879 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0fd792b8-22a7-42a1-a9fa-65b30f013377 tempest-LiveMigrationNegativeTest-168754894 tempest-LiveMigrationNegativeTest-168754894-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/0948d595-51a2-41fb-b561-8255de0bc6a0" status: 200 len: 1612 microversion: 2.1 time: 0.598025 Oct 04 18:33:51.631752 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 780/1505] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:51 2022] GET /compute/v2.1/servers/0948d595-51a2-41fb-b561-8255de0bc6a0 => generated 1612 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:51.655745 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-89f5776f-9844-4407-8e3b-bf6566611161 tempest-LiveMigrationNegativeTest-168754894 tempest-LiveMigrationNegativeTest-168754894-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:51.662694 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-89f5776f-9844-4407-8e3b-bf6566611161 tempest-LiveMigrationNegativeTest-168754894 tempest-LiveMigrationNegativeTest-168754894-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:51.663493 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-89f5776f-9844-4407-8e3b-bf6566611161 tempest-LiveMigrationNegativeTest-168754894 tempest-LiveMigrationNegativeTest-168754894-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:51.664143 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-89f5776f-9844-4407-8e3b-bf6566611161 tempest-LiveMigrationNegativeTest-168754894 tempest-LiveMigrationNegativeTest-168754894-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:51.665091 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-89f5776f-9844-4407-8e3b-bf6566611161 tempest-LiveMigrationNegativeTest-168754894 tempest-LiveMigrationNegativeTest-168754894-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:51.665721 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-89f5776f-9844-4407-8e3b-bf6566611161 tempest-LiveMigrationNegativeTest-168754894 tempest-LiveMigrationNegativeTest-168754894-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:51.666323 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-89f5776f-9844-4407-8e3b-bf6566611161 tempest-LiveMigrationNegativeTest-168754894 tempest-LiveMigrationNegativeTest-168754894-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:51.697147 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=100 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:51.697147 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-89f5776f-9844-4407-8e3b-bf6566611161 tempest-LiveMigrationNegativeTest-168754894 tempest-LiveMigrationNegativeTest-168754894-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.043143 Oct 04 18:33:51.703414 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 781/1506] 10.222.0.20 () {58 vars in 1176 bytes} [Tue Oct 4 18:33:51 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:33:51.709768 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ddccea8b-ff59-4cd2-8333-1bd978b67fbb tempest-LiveMigrationNegativeTest-168754894 tempest-LiveMigrationNegativeTest-168754894-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-850501-14", "block_migration": true, "disk_over_commit": false}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:51.712567 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ddccea8b-ff59-4cd2-8333-1bd978b67fbb tempest-LiveMigrationNegativeTest-168754894 tempest-LiveMigrationNegativeTest-168754894-project-admin] [instance: 0948d595-51a2-41fb-b561-8255de0bc6a0] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:51.722211 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ddccea8b-ff59-4cd2-8333-1bd978b67fbb tempest-LiveMigrationNegativeTest-168754894 tempest-LiveMigrationNegativeTest-168754894-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:51.723197 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ddccea8b-ff59-4cd2-8333-1bd978b67fbb tempest-LiveMigrationNegativeTest-168754894 tempest-LiveMigrationNegativeTest-168754894-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:51.723834 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ddccea8b-ff59-4cd2-8333-1bd978b67fbb tempest-LiveMigrationNegativeTest-168754894 tempest-LiveMigrationNegativeTest-168754894-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:51.724768 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ddccea8b-ff59-4cd2-8333-1bd978b67fbb tempest-LiveMigrationNegativeTest-168754894 tempest-LiveMigrationNegativeTest-168754894-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:51.725394 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ddccea8b-ff59-4cd2-8333-1bd978b67fbb tempest-LiveMigrationNegativeTest-168754894 tempest-LiveMigrationNegativeTest-168754894-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:51.726015 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ddccea8b-ff59-4cd2-8333-1bd978b67fbb tempest-LiveMigrationNegativeTest-168754894 tempest-LiveMigrationNegativeTest-168754894-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:51.757689 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-ddccea8b-ff59-4cd2-8333-1bd978b67fbb tempest-LiveMigrationNegativeTest-168754894 tempest-LiveMigrationNegativeTest-168754894-project-admin] Lazy-loading 'flavor' on Instance uuid 0948d595-51a2-41fb-b561-8255de0bc6a0 {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:33:51.762839 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a563e79c-00f3-4557-b1e9-089bf61d644b tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44cc98e07d134a15b0fbf2b80bd25ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e0b0088d8476bbcb4c83783fec0e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:51.772562 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-ddccea8b-ff59-4cd2-8333-1bd978b67fbb tempest-LiveMigrationNegativeTest-168754894 tempest-LiveMigrationNegativeTest-168754894-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 0948d595-51a2-41fb-b561-8255de0bc6a0 while it is in vm_state suspended Oct 04 18:33:51.774709 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ddccea8b-ff59-4cd2-8333-1bd978b67fbb tempest-LiveMigrationNegativeTest-168754894 tempest-LiveMigrationNegativeTest-168754894-project-admin] Request method failure captured: Oct 04 18:33:51.774709 n-d-850501-14 devstack@n-api.service[123002]: request: POST /compute/v2.1/servers/0948d595-51a2-41fb-b561-8255de0bc6a0/action HTTP/1.1 Oct 04 18:33:51.774709 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:33:51.774709 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:33:51.774709 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:33:51.774709 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 98 Oct 04 18:33:51.774709 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:33:51.774709 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:33:51.774709 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:33:51.774709 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:33:51.774709 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPHxclMCp23AHlWTCOfUXxBznZn5tXniE-oMGfAlLY-R0GQskpYiN0Mb93D5lNNgRXhn6vuFaVjubqzsGSZrCfvJi0mEsTvBOY0RZmz4NXXD5DN0tXRt1C0SQUFK5Xahydife8XDhV2JX4U4DaXtzmiFn2WopeiG57SUNwG2kfdSSTF8 Oct 04 18:33:51.774709 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:33:51.774709 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:33:51.774709 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:33:51.774709 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:33:51.774709 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:33:51.774709 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:33:51.774709 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 65d7c0ca17414d3c8f3bb75261001dfc Oct 04 18:33:51.774709 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-LiveMigrationNegativeTest-168754894 Oct 04 18:33:51.774709 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member,admin Oct 04 18:33:51.774709 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member,admin Oct 04 18:33:51.774709 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/65d7c0ca17414d3c8f3bb75261001dfc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_65d7c0ca17414d3c8f3bb75261001dfc", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/65d7c0ca17414d3c8f3bb75261001dfc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/65d7c0ca17414d3c8f3bb75261001dfc"}]}] Oct 04 18:33:51.774709 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-LiveMigrationNegativeTest-168754894 Oct 04 18:33:51.774709 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 65d7c0ca17414d3c8f3bb75261001dfc Oct 04 18:33:51.774709 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-168754894 Oct 04 18:33:51.774709 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-LiveMigrationNegativeTest-168754894-project-admin Oct 04 18:33:51.774709 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:33:51.774709 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:33:51.774709 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: fc74a6a01673400bacee588ad761456d Oct 04 18:33:51.774709 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-LiveMigrationNegativeTest-168754894-project-admin Oct 04 18:33:51.774709 n-d-850501-14 devstack@n-api.service[123002]: Oct 04 18:33:51.774709 n-d-850501-14 devstack@n-api.service[123002]: {"os-migrateLive": {"host": "n-h1-850501-14", "block_migration": true, "disk_over_commit": false}} Oct 04 18:33:51.774709 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:33:51.774709 n-d-850501-14 devstack@n-api.service[123002]: exception: Cannot 'os-migrateLive' instance 0948d595-51a2-41fb-b561-8255de0bc6a0 while it is in vm_state suspended Oct 04 18:33:51.774709 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '0948d595-51a2-41fb-b561-8255de0bc6a0', 'body': {'os-migrateLive': {'host': 'n-h1-850501-14', 'block_migration': True, 'disk_over_commit': False}}} Oct 04 18:33:51.774709 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:33:51.774709 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:51.774709 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 04 18:33:51.774709 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 04 18:33:51.774709 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 04 18:33:51.774709 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:33:51.774709 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 04 18:33:51.774709 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 18:33:51.774709 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 04 18:33:51.774709 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 18:33:51.774709 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 18:33:51.774709 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 18:33:51.774709 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 04 18:33:51.774709 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 18:33:51.774709 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 04 18:33:51.774709 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 18:33:51.774709 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:33:51.774709 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:33:51.774709 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 18:33:51.774709 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 18:33:51.774709 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0948d595-51a2-41fb-b561-8255de0bc6a0 in vm_state suspended. Cannot live_migrate while the instance is in this state. Oct 04 18:33:51.774709 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:33:51.774709 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:51.774709 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:33:51.774709 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:51.774709 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:51.794581 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:51.794581 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:33:51.794581 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:33:51.794581 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:33:51.794581 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:33:51.794581 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:33:51.794581 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:33:51.794581 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:33:51.794581 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:33:51.794581 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:33:51.794581 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:33:51.794581 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 04 18:33:51.794581 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Oct 04 18:33:51.794581 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 18:33:51.794581 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 18:33:51.794581 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 18:33:51.794581 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 0948d595-51a2-41fb-b561-8255de0bc6a0 while it is in vm_state suspended Oct 04 18:33:51.794581 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:33:51.794581 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:51.794581 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:33:51.794581 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:51.794581 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:51.794581 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:51.794581 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:33:51.794581 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:33:51.794581 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 0948d595-51a2-41fb-b561-8255de0bc6a0 while it is in vm_state suspended Oct 04 18:33:51.794581 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:33:51.796890 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a563e79c-00f3-4557-b1e9-089bf61d644b tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] 10.222.0.20 "GET /compute/v2.1/servers/7fd2a976-0bed-40c2-ba69-a88e8541db48" status: 200 len: 1320 microversion: 2.1 time: 0.283472 Oct 04 18:33:51.796890 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 726/1507] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:51 2022] GET /compute/v2.1/servers/7fd2a976-0bed-40c2-ba69-a88e8541db48 => generated 1320 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:33:51.797089 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ddccea8b-ff59-4cd2-8333-1bd978b67fbb tempest-LiveMigrationNegativeTest-168754894 tempest-LiveMigrationNegativeTest-168754894-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 0948d595-51a2-41fb-b561-8255de0bc6a0 while it is in vm_state suspended {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:33:51.805131 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ddccea8b-ff59-4cd2-8333-1bd978b67fbb tempest-LiveMigrationNegativeTest-168754894 tempest-LiveMigrationNegativeTest-168754894-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/0948d595-51a2-41fb-b561-8255de0bc6a0/action" status: 409 len: 155 microversion: 2.1 time: 0.099588 Oct 04 18:33:51.811058 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 782/1508] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:33:51 2022] POST /compute/v2.1/servers/0948d595-51a2-41fb-b561-8255de0bc6a0/action => generated 155 bytes in 102 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:33:51.818151 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1d2343f3-f4fb-47cf-b717-c28be0d46ba5 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:51.818833 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1d2343f3-f4fb-47cf-b717-c28be0d46ba5 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] [instance: 0948d595-51a2-41fb-b561-8255de0bc6a0] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:51.828917 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1d2343f3-f4fb-47cf-b717-c28be0d46ba5 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:51.829582 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1d2343f3-f4fb-47cf-b717-c28be0d46ba5 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:51.836780 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1d2343f3-f4fb-47cf-b717-c28be0d46ba5 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:51.837860 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1d2343f3-f4fb-47cf-b717-c28be0d46ba5 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:51.838604 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1d2343f3-f4fb-47cf-b717-c28be0d46ba5 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:51.839244 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1d2343f3-f4fb-47cf-b717-c28be0d46ba5 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:51.886340 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1d2343f3-f4fb-47cf-b717-c28be0d46ba5 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] [instance: 0948d595-51a2-41fb-b561-8255de0bc6a0] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:33:52.050433 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-812f8155-abc1-4117-9de8-1a063fe2f2ef tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:52.051349 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-812f8155-abc1-4117-9de8-1a063fe2f2ef tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: b219d988-2847-45a0-a3b8-af54cf1a43f8] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:52.063250 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-812f8155-abc1-4117-9de8-1a063fe2f2ef tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:52.063752 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-812f8155-abc1-4117-9de8-1a063fe2f2ef tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:52.070427 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-812f8155-abc1-4117-9de8-1a063fe2f2ef tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:52.078194 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-812f8155-abc1-4117-9de8-1a063fe2f2ef tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:52.078194 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-812f8155-abc1-4117-9de8-1a063fe2f2ef tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:52.078194 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-812f8155-abc1-4117-9de8-1a063fe2f2ef tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:52.390719 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-812f8155-abc1-4117-9de8-1a063fe2f2ef tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:52.416377 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-812f8155-abc1-4117-9de8-1a063fe2f2ef tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:52.420786 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-812f8155-abc1-4117-9de8-1a063fe2f2ef tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:52.424518 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-812f8155-abc1-4117-9de8-1a063fe2f2ef tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8" status: 200 len: 1811 microversion: 2.25 time: 0.378313 Oct 04 18:33:52.427199 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 783/1509] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:52 2022] GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8 => generated 1811 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:52.431630 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1d2343f3-f4fb-47cf-b717-c28be0d46ba5 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0948d595-51a2-41fb-b561-8255de0bc6a0" status: 204 len: 0 microversion: 2.1 time: 0.619010 Oct 04 18:33:52.432617 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 727/1510] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:33:51 2022] DELETE /compute/v2.1/servers/0948d595-51a2-41fb-b561-8255de0bc6a0 => generated 0 bytes in 621 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:33:52.435412 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-37ce6a20-de80-4517-9694-23999e236590 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:52.436219 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-37ce6a20-de80-4517-9694-23999e236590 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:52.443901 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b9cbcfe8-341c-4f1f-becb-dd44f6fc54ed tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '.version_select at 0x7fe258fd0940>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:52.444143 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-37ce6a20-de80-4517-9694-23999e236590 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:52.444143 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-37ce6a20-de80-4517-9694-23999e236590 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:52.445031 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-37ce6a20-de80-4517-9694-23999e236590 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:52.446226 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-37ce6a20-de80-4517-9694-23999e236590 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:52.446846 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-37ce6a20-de80-4517-9694-23999e236590 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:52.447425 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-37ce6a20-de80-4517-9694-23999e236590 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:52.528755 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b9cbcfe8-341c-4f1f-becb-dd44f6fc54ed tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/images/ea702f85-8e85-400a-a6e3-61ce78efff2c" status: 200 len: 1413 microversion: 2.1 time: 0.094570 Oct 04 18:33:52.529532 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 728/1511] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:33:52 2022] GET /compute/v2.1/images/ea702f85-8e85-400a-a6e3-61ce78efff2c => generated 1413 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:52.553421 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-19c0fe19-71ac-4acf-bc5d-20849d4b7acd tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:52.553912 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-19c0fe19-71ac-4acf-bc5d-20849d4b7acd tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] [instance: 0948d595-51a2-41fb-b561-8255de0bc6a0] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:52.570608 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-19c0fe19-71ac-4acf-bc5d-20849d4b7acd tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:52.571108 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-19c0fe19-71ac-4acf-bc5d-20849d4b7acd tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:52.571557 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-19c0fe19-71ac-4acf-bc5d-20849d4b7acd tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:52.572420 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-19c0fe19-71ac-4acf-bc5d-20849d4b7acd tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:52.572882 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-19c0fe19-71ac-4acf-bc5d-20849d4b7acd tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:52.573309 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-19c0fe19-71ac-4acf-bc5d-20849d4b7acd tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:52.844739 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-19c0fe19-71ac-4acf-bc5d-20849d4b7acd tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6ff8f5b6c58416b82eb6765a209b344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064cbc5ef6a4f5c9df672a3b8668040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:52.854729 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-19c0fe19-71ac-4acf-bc5d-20849d4b7acd tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] 10.222.0.20 "GET /compute/v2.1/servers/0948d595-51a2-41fb-b561-8255de0bc6a0" status: 200 len: 1465 microversion: 2.1 time: 0.312712 Oct 04 18:33:52.857255 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 729/1512] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:52 2022] GET /compute/v2.1/servers/0948d595-51a2-41fb-b561-8255de0bc6a0 => generated 1465 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:52.867389 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-378769fc-6720-4a22-b624-a7296f8bb421 req-37aff28c-6941-41dd-85b1-b36233f6c537 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a384d42-782c-49ac-ad60-e98cf5924e92", "name": "network-vif-plugged", "status": "completed", "tag": "32162a47-baaf-47bb-89d8-931b66187f65"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:52.880304 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-37ce6a20-de80-4517-9694-23999e236590 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:52.890155 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-37ce6a20-de80-4517-9694-23999e236590 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:52.895024 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-37ce6a20-de80-4517-9694-23999e236590 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:52.897292 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-378769fc-6720-4a22-b624-a7296f8bb421 req-37aff28c-6941-41dd-85b1-b36233f6c537 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:52.898503 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-378769fc-6720-4a22-b624-a7296f8bb421 req-37aff28c-6941-41dd-85b1-b36233f6c537 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:52.899192 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-378769fc-6720-4a22-b624-a7296f8bb421 req-37aff28c-6941-41dd-85b1-b36233f6c537 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:52.901562 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-37ce6a20-de80-4517-9694-23999e236590 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1553 microversion: 2.91 time: 0.473056 Oct 04 18:33:52.913964 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-378769fc-6720-4a22-b624-a7296f8bb421 req-37aff28c-6941-41dd-85b1-b36233f6c537 service nova] Creating event network-vif-plugged:32162a47-baaf-47bb-89d8-931b66187f65 for instance 7a384d42-782c-49ac-ad60-e98cf5924e92 on n-h1-850501-14 Oct 04 18:33:52.917607 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 784/1513] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:52 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1553 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:52.919549 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-378769fc-6720-4a22-b624-a7296f8bb421 req-37aff28c-6941-41dd-85b1-b36233f6c537 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060301 Oct 04 18:33:52.923902 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 730/1514] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:33:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:33:52.929389 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5082dd69-e992-43c3-80bb-7d1b37b20ca1 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:52.930156 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5082dd69-e992-43c3-80bb-7d1b37b20ca1 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] [instance: 7fd2a976-0bed-40c2-ba69-a88e8541db48] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:52.949908 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5082dd69-e992-43c3-80bb-7d1b37b20ca1 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:52.950582 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5082dd69-e992-43c3-80bb-7d1b37b20ca1 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:52.951144 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5082dd69-e992-43c3-80bb-7d1b37b20ca1 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:52.951966 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5082dd69-e992-43c3-80bb-7d1b37b20ca1 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:52.952565 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5082dd69-e992-43c3-80bb-7d1b37b20ca1 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:52.953157 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5082dd69-e992-43c3-80bb-7d1b37b20ca1 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:53.169200 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5082dd69-e992-43c3-80bb-7d1b37b20ca1 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44cc98e07d134a15b0fbf2b80bd25ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e0b0088d8476bbcb4c83783fec0e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:53.179482 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5082dd69-e992-43c3-80bb-7d1b37b20ca1 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] 10.222.0.20 "GET /compute/v2.1/servers/7fd2a976-0bed-40c2-ba69-a88e8541db48" status: 200 len: 1320 microversion: 2.1 time: 0.254346 Oct 04 18:33:53.180105 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 785/1515] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:52 2022] GET /compute/v2.1/servers/7fd2a976-0bed-40c2-ba69-a88e8541db48 => generated 1320 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:53.459213 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b3da5ec8-41fc-497d-bdef-b5759a6a8362 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:53.459922 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b3da5ec8-41fc-497d-bdef-b5759a6a8362 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: b219d988-2847-45a0-a3b8-af54cf1a43f8] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:53.467299 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b3da5ec8-41fc-497d-bdef-b5759a6a8362 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:53.467822 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b3da5ec8-41fc-497d-bdef-b5759a6a8362 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:53.468305 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b3da5ec8-41fc-497d-bdef-b5759a6a8362 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:53.469012 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b3da5ec8-41fc-497d-bdef-b5759a6a8362 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:53.469472 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b3da5ec8-41fc-497d-bdef-b5759a6a8362 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:53.469898 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b3da5ec8-41fc-497d-bdef-b5759a6a8362 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:53.545746 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-23b50c06-abe7-4331-a90f-f64876578345 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '.version_select at 0x7fe258b7aa60>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:53.615975 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-23b50c06-abe7-4331-a90f-f64876578345 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/images/ea702f85-8e85-400a-a6e3-61ce78efff2c" status: 200 len: 1413 microversion: 2.1 time: 0.073905 Oct 04 18:33:53.623921 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 786/1516] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:33:53 2022] GET /compute/v2.1/images/ea702f85-8e85-400a-a6e3-61ce78efff2c => generated 1413 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:53.653392 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b3da5ec8-41fc-497d-bdef-b5759a6a8362 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:53.669104 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b3da5ec8-41fc-497d-bdef-b5759a6a8362 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:53.672495 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b3da5ec8-41fc-497d-bdef-b5759a6a8362 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:53.673915 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b3da5ec8-41fc-497d-bdef-b5759a6a8362 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8" status: 200 len: 1811 microversion: 2.25 time: 0.219610 Oct 04 18:33:53.688280 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 731/1517] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:53 2022] GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8 => generated 1811 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:53.882415 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f985fbe2-ddf2-4953-9953-560b1bdde55c tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:53.886458 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f985fbe2-ddf2-4953-9953-560b1bdde55c tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] [instance: 0948d595-51a2-41fb-b561-8255de0bc6a0] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:53.896388 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f985fbe2-ddf2-4953-9953-560b1bdde55c tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:53.898043 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f985fbe2-ddf2-4953-9953-560b1bdde55c tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:53.899037 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f985fbe2-ddf2-4953-9953-560b1bdde55c tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:53.899964 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f985fbe2-ddf2-4953-9953-560b1bdde55c tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:53.901051 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f985fbe2-ddf2-4953-9953-560b1bdde55c tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:53.901733 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f985fbe2-ddf2-4953-9953-560b1bdde55c tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:53.938118 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5e40ce94-af0e-4d08-ab30-7b4e808bad22 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:53.939371 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5e40ce94-af0e-4d08-ab30-7b4e808bad22 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:53.951774 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5e40ce94-af0e-4d08-ab30-7b4e808bad22 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:53.954784 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5e40ce94-af0e-4d08-ab30-7b4e808bad22 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:53.955247 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5e40ce94-af0e-4d08-ab30-7b4e808bad22 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:53.955975 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5e40ce94-af0e-4d08-ab30-7b4e808bad22 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:53.956464 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5e40ce94-af0e-4d08-ab30-7b4e808bad22 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:53.956894 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5e40ce94-af0e-4d08-ab30-7b4e808bad22 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:54.080478 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5e40ce94-af0e-4d08-ab30-7b4e808bad22 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:54.093268 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5e40ce94-af0e-4d08-ab30-7b4e808bad22 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:54.094711 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5e40ce94-af0e-4d08-ab30-7b4e808bad22 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:54.109569 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5e40ce94-af0e-4d08-ab30-7b4e808bad22 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1553 microversion: 2.91 time: 0.180125 Oct 04 18:33:54.120523 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 732/1518] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:53 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1553 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:33:54.134833 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f985fbe2-ddf2-4953-9953-560b1bdde55c tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6ff8f5b6c58416b82eb6765a209b344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064cbc5ef6a4f5c9df672a3b8668040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:54.143962 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f985fbe2-ddf2-4953-9953-560b1bdde55c tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] 10.222.0.20 "GET /compute/v2.1/servers/0948d595-51a2-41fb-b561-8255de0bc6a0" status: 200 len: 1465 microversion: 2.1 time: 0.267385 Oct 04 18:33:54.145874 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 787/1519] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:53 2022] GET /compute/v2.1/servers/0948d595-51a2-41fb-b561-8255de0bc6a0 => generated 1465 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:54.206418 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-81bf4be5-2c3a-4f51-a392-31abf2baf63b tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:54.208034 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-81bf4be5-2c3a-4f51-a392-31abf2baf63b tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] [instance: 7fd2a976-0bed-40c2-ba69-a88e8541db48] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:54.227400 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-81bf4be5-2c3a-4f51-a392-31abf2baf63b tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:54.228758 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-81bf4be5-2c3a-4f51-a392-31abf2baf63b tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:54.229418 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-81bf4be5-2c3a-4f51-a392-31abf2baf63b tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:54.231172 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-81bf4be5-2c3a-4f51-a392-31abf2baf63b tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:54.231825 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-81bf4be5-2c3a-4f51-a392-31abf2baf63b tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:54.232947 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-81bf4be5-2c3a-4f51-a392-31abf2baf63b tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:54.260029 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:54.448038 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-81bf4be5-2c3a-4f51-a392-31abf2baf63b tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44cc98e07d134a15b0fbf2b80bd25ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e0b0088d8476bbcb4c83783fec0e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:54.462794 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-81bf4be5-2c3a-4f51-a392-31abf2baf63b tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] 10.222.0.20 "GET /compute/v2.1/servers/7fd2a976-0bed-40c2-ba69-a88e8541db48" status: 200 len: 1320 microversion: 2.1 time: 0.260996 Oct 04 18:33:54.468669 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 733/1520] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:54 2022] GET /compute/v2.1/servers/7fd2a976-0bed-40c2-ba69-a88e8541db48 => generated 1320 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:54.630993 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4966b643-af81-4d35-ae10-d0626f5e1f62 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '.version_select at 0x7fe258b7a8b0>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:54.701690 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7e3c7abc-5201-4988-8831-38d03bd1c837 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:54.702718 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7e3c7abc-5201-4988-8831-38d03bd1c837 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: b219d988-2847-45a0-a3b8-af54cf1a43f8] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:54.713305 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7e3c7abc-5201-4988-8831-38d03bd1c837 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:54.719221 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7e3c7abc-5201-4988-8831-38d03bd1c837 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:54.719691 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7e3c7abc-5201-4988-8831-38d03bd1c837 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:54.726894 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7e3c7abc-5201-4988-8831-38d03bd1c837 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:54.727187 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7e3c7abc-5201-4988-8831-38d03bd1c837 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:54.727643 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7e3c7abc-5201-4988-8831-38d03bd1c837 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:54.749312 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4966b643-af81-4d35-ae10-d0626f5e1f62 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/images/ea702f85-8e85-400a-a6e3-61ce78efff2c" status: 200 len: 1413 microversion: 2.1 time: 0.122452 Oct 04 18:33:54.752465 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 788/1521] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:33:54 2022] GET /compute/v2.1/images/ea702f85-8e85-400a-a6e3-61ce78efff2c => generated 1413 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:54.999503 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7e3c7abc-5201-4988-8831-38d03bd1c837 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:55.015780 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7e3c7abc-5201-4988-8831-38d03bd1c837 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:55.021597 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7e3c7abc-5201-4988-8831-38d03bd1c837 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:55.022019 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7e3c7abc-5201-4988-8831-38d03bd1c837 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8" status: 200 len: 1811 microversion: 2.25 time: 0.324093 Oct 04 18:33:55.023230 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 734/1522] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:54 2022] GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8 => generated 1811 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:55.144031 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2e3e4ecf-e8d5-49b2-a4c4-817b3eb25ff5 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:55.145146 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2e3e4ecf-e8d5-49b2-a4c4-817b3eb25ff5 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:55.159321 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e3e4ecf-e8d5-49b2-a4c4-817b3eb25ff5 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:55.162083 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e3e4ecf-e8d5-49b2-a4c4-817b3eb25ff5 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:55.162867 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e3e4ecf-e8d5-49b2-a4c4-817b3eb25ff5 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:55.168880 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-82b822d2-2c1c-4c22-820b-cf8306da9564 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:55.169831 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-82b822d2-2c1c-4c22-820b-cf8306da9564 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] [instance: 0948d595-51a2-41fb-b561-8255de0bc6a0] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:55.174176 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e3e4ecf-e8d5-49b2-a4c4-817b3eb25ff5 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:55.177559 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e3e4ecf-e8d5-49b2-a4c4-817b3eb25ff5 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:55.180475 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e3e4ecf-e8d5-49b2-a4c4-817b3eb25ff5 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:55.185780 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-82b822d2-2c1c-4c22-820b-cf8306da9564 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:55.189666 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-82b822d2-2c1c-4c22-820b-cf8306da9564 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:55.193143 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-82b822d2-2c1c-4c22-820b-cf8306da9564 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:55.196275 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-82b822d2-2c1c-4c22-820b-cf8306da9564 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:55.198064 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-82b822d2-2c1c-4c22-820b-cf8306da9564 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:55.200665 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-82b822d2-2c1c-4c22-820b-cf8306da9564 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:55.338815 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2e3e4ecf-e8d5-49b2-a4c4-817b3eb25ff5 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:55.358962 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2e3e4ecf-e8d5-49b2-a4c4-817b3eb25ff5 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:55.361642 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2e3e4ecf-e8d5-49b2-a4c4-817b3eb25ff5 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:55.372156 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2e3e4ecf-e8d5-49b2-a4c4-817b3eb25ff5 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1553 microversion: 2.91 time: 0.233107 Oct 04 18:33:55.373050 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 789/1523] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:55 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1553 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:55.444222 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-82b822d2-2c1c-4c22-820b-cf8306da9564 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6ff8f5b6c58416b82eb6765a209b344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064cbc5ef6a4f5c9df672a3b8668040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:55.452590 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-82b822d2-2c1c-4c22-820b-cf8306da9564 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] 10.222.0.20 "GET /compute/v2.1/servers/0948d595-51a2-41fb-b561-8255de0bc6a0" status: 200 len: 1465 microversion: 2.1 time: 0.287873 Oct 04 18:33:55.454006 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 735/1524] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:55 2022] GET /compute/v2.1/servers/0948d595-51a2-41fb-b561-8255de0bc6a0 => generated 1465 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:33:55.491948 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f631aee4-3355-4f5f-bbed-42b74dc85ac4 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:55.492681 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f631aee4-3355-4f5f-bbed-42b74dc85ac4 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] [instance: 7fd2a976-0bed-40c2-ba69-a88e8541db48] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:55.499898 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f631aee4-3355-4f5f-bbed-42b74dc85ac4 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:55.500476 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f631aee4-3355-4f5f-bbed-42b74dc85ac4 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:55.500922 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f631aee4-3355-4f5f-bbed-42b74dc85ac4 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:55.501822 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f631aee4-3355-4f5f-bbed-42b74dc85ac4 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:55.502330 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f631aee4-3355-4f5f-bbed-42b74dc85ac4 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:55.502771 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f631aee4-3355-4f5f-bbed-42b74dc85ac4 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:55.663594 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-93200a7d-b13d-49f3-9832-b58534e071b7 req-251440f0-90a3-413e-a73b-54dcae712cb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0948d595-51a2-41fb-b561-8255de0bc6a0", "name": "network-vif-deleted", "tag": "2957805e-e9be-4262-adc3-d1a7b55b1476"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:55.677979 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-93200a7d-b13d-49f3-9832-b58534e071b7 req-251440f0-90a3-413e-a73b-54dcae712cb4 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:55.678467 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-93200a7d-b13d-49f3-9832-b58534e071b7 req-251440f0-90a3-413e-a73b-54dcae712cb4 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:55.678900 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-93200a7d-b13d-49f3-9832-b58534e071b7 req-251440f0-90a3-413e-a73b-54dcae712cb4 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:55.705249 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-93200a7d-b13d-49f3-9832-b58534e071b7 req-251440f0-90a3-413e-a73b-54dcae712cb4 service nova] Creating event network-vif-deleted:2957805e-e9be-4262-adc3-d1a7b55b1476 for instance 0948d595-51a2-41fb-b561-8255de0bc6a0 on n-h2-850501-14 Oct 04 18:33:55.711567 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-93200a7d-b13d-49f3-9832-b58534e071b7 req-251440f0-90a3-413e-a73b-54dcae712cb4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056834 Oct 04 18:33:55.715641 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 736/1525] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:33:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:33:55.767381 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-885ae87b-6b64-4ef4-a7f1-9c2ab53f6b4e tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '.version_select at 0x7fe258d20700>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:55.799402 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f631aee4-3355-4f5f-bbed-42b74dc85ac4 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44cc98e07d134a15b0fbf2b80bd25ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e0b0088d8476bbcb4c83783fec0e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:55.810705 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f631aee4-3355-4f5f-bbed-42b74dc85ac4 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] 10.222.0.20 "GET /compute/v2.1/servers/7fd2a976-0bed-40c2-ba69-a88e8541db48" status: 200 len: 1320 microversion: 2.1 time: 0.323257 Oct 04 18:33:55.833160 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 790/1526] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:55 2022] GET /compute/v2.1/servers/7fd2a976-0bed-40c2-ba69-a88e8541db48 => generated 1320 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:55.835633 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-885ae87b-6b64-4ef4-a7f1-9c2ab53f6b4e tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/images/ea702f85-8e85-400a-a6e3-61ce78efff2c" status: 200 len: 1413 microversion: 2.1 time: 0.072729 Oct 04 18:33:55.837378 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 737/1527] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:33:55 2022] GET /compute/v2.1/images/ea702f85-8e85-400a-a6e3-61ce78efff2c => generated 1413 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:33:56.050779 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d06715f8-c55a-486e-8a0f-56d85a90be37 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:56.051492 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d06715f8-c55a-486e-8a0f-56d85a90be37 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: b219d988-2847-45a0-a3b8-af54cf1a43f8] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:56.068003 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d06715f8-c55a-486e-8a0f-56d85a90be37 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:56.069036 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d06715f8-c55a-486e-8a0f-56d85a90be37 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:56.069728 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d06715f8-c55a-486e-8a0f-56d85a90be37 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:56.070712 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d06715f8-c55a-486e-8a0f-56d85a90be37 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:56.071418 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d06715f8-c55a-486e-8a0f-56d85a90be37 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:56.072109 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d06715f8-c55a-486e-8a0f-56d85a90be37 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:56.297703 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d06715f8-c55a-486e-8a0f-56d85a90be37 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:56.319120 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d06715f8-c55a-486e-8a0f-56d85a90be37 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:56.322550 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d06715f8-c55a-486e-8a0f-56d85a90be37 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:56.327024 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d06715f8-c55a-486e-8a0f-56d85a90be37 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8" status: 200 len: 1811 microversion: 2.25 time: 0.279863 Oct 04 18:33:56.330443 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 791/1528] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:56 2022] GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8 => generated 1811 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:56.402263 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9de64c83-d6ee-4a06-b3d6-192f19046a37 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:56.403704 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-9de64c83-d6ee-4a06-b3d6-192f19046a37 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:56.417922 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9de64c83-d6ee-4a06-b3d6-192f19046a37 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:56.420815 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9de64c83-d6ee-4a06-b3d6-192f19046a37 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:56.421476 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9de64c83-d6ee-4a06-b3d6-192f19046a37 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:56.422497 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9de64c83-d6ee-4a06-b3d6-192f19046a37 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:56.423202 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9de64c83-d6ee-4a06-b3d6-192f19046a37 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:56.424008 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9de64c83-d6ee-4a06-b3d6-192f19046a37 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:56.485745 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2f57fcb8-58a6-46d1-aa87-e07e741b8398 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:56.490719 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2f57fcb8-58a6-46d1-aa87-e07e741b8398 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] [instance: 0948d595-51a2-41fb-b561-8255de0bc6a0] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:56.516815 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2f57fcb8-58a6-46d1-aa87-e07e741b8398 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:56.517512 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2f57fcb8-58a6-46d1-aa87-e07e741b8398 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:56.518048 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2f57fcb8-58a6-46d1-aa87-e07e741b8398 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:56.522312 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2f57fcb8-58a6-46d1-aa87-e07e741b8398 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:56.522881 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2f57fcb8-58a6-46d1-aa87-e07e741b8398 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:56.523396 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2f57fcb8-58a6-46d1-aa87-e07e741b8398 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:56.561977 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9de64c83-d6ee-4a06-b3d6-192f19046a37 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:56.575779 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9de64c83-d6ee-4a06-b3d6-192f19046a37 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:56.582190 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9de64c83-d6ee-4a06-b3d6-192f19046a37 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:56.601772 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9de64c83-d6ee-4a06-b3d6-192f19046a37 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1553 microversion: 2.91 time: 0.200514 Oct 04 18:33:56.612619 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2f57fcb8-58a6-46d1-aa87-e07e741b8398 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:56.613832 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2f57fcb8-58a6-46d1-aa87-e07e741b8398 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:56.614609 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2f57fcb8-58a6-46d1-aa87-e07e741b8398 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:56.617974 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-2f57fcb8-58a6-46d1-aa87-e07e741b8398 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lazy-loading 'fault' on Instance uuid 0948d595-51a2-41fb-b561-8255de0bc6a0 {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:33:56.620872 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 738/1529] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:56 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1553 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:33:56.683297 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-b7bf14a6-68d8-4e14-91f5-3009a45b03d8 req-58f043f8-08a5-4809-bf06-388f20c36bbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fd2a976-0bed-40c2-ba69-a88e8541db48", "name": "network-vif-plugged", "status": "completed", "tag": "480deffd-886a-4376-bd61-3b97bf1b5aa3"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:56.742286 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-b7bf14a6-68d8-4e14-91f5-3009a45b03d8 req-58f043f8-08a5-4809-bf06-388f20c36bbc service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:56.742801 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-b7bf14a6-68d8-4e14-91f5-3009a45b03d8 req-58f043f8-08a5-4809-bf06-388f20c36bbc service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:56.743211 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-b7bf14a6-68d8-4e14-91f5-3009a45b03d8 req-58f043f8-08a5-4809-bf06-388f20c36bbc service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:56.754772 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2f57fcb8-58a6-46d1-aa87-e07e741b8398 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6ff8f5b6c58416b82eb6765a209b344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064cbc5ef6a4f5c9df672a3b8668040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:56.767017 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2f57fcb8-58a6-46d1-aa87-e07e741b8398 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] 10.222.0.20 "GET /compute/v2.1/servers/0948d595-51a2-41fb-b561-8255de0bc6a0" status: 200 len: 1309 microversion: 2.1 time: 0.292683 Oct 04 18:33:56.788136 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 792/1530] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:56 2022] GET /compute/v2.1/servers/0948d595-51a2-41fb-b561-8255de0bc6a0 => generated 1309 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:56.790679 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-b7bf14a6-68d8-4e14-91f5-3009a45b03d8 req-58f043f8-08a5-4809-bf06-388f20c36bbc service nova] Creating event network-vif-plugged:480deffd-886a-4376-bd61-3b97bf1b5aa3 for instance 7fd2a976-0bed-40c2-ba69-a88e8541db48 on n-h1-850501-14 Oct 04 18:33:56.798174 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-b7bf14a6-68d8-4e14-91f5-3009a45b03d8 req-58f043f8-08a5-4809-bf06-388f20c36bbc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143291 Oct 04 18:33:56.800193 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 739/1531] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:33:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:33:56.843394 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-38243d0d-f193-49fd-bb16-2c7e928aa87a tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:56.844580 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-38243d0d-f193-49fd-bb16-2c7e928aa87a tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] [instance: 7fd2a976-0bed-40c2-ba69-a88e8541db48] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:56.856204 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-121d063b-8f16-43e7-9f5d-3ad0d50ae15d tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '.version_select at 0x7fe258cd0310>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:56.856505 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-38243d0d-f193-49fd-bb16-2c7e928aa87a tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:56.857202 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-38243d0d-f193-49fd-bb16-2c7e928aa87a tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:56.857828 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-38243d0d-f193-49fd-bb16-2c7e928aa87a tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:56.858907 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-38243d0d-f193-49fd-bb16-2c7e928aa87a tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:56.859836 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-38243d0d-f193-49fd-bb16-2c7e928aa87a tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:56.861258 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-38243d0d-f193-49fd-bb16-2c7e928aa87a tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:57.002906 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-121d063b-8f16-43e7-9f5d-3ad0d50ae15d tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/images/ea702f85-8e85-400a-a6e3-61ce78efff2c" status: 200 len: 1413 microversion: 2.1 time: 0.151921 Oct 04 18:33:57.003684 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 740/1532] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:33:56 2022] GET /compute/v2.1/images/ea702f85-8e85-400a-a6e3-61ce78efff2c => generated 1413 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:33:57.167149 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-38243d0d-f193-49fd-bb16-2c7e928aa87a tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44cc98e07d134a15b0fbf2b80bd25ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e0b0088d8476bbcb4c83783fec0e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:57.175340 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-38243d0d-f193-49fd-bb16-2c7e928aa87a tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] 10.222.0.20 "GET /compute/v2.1/servers/7fd2a976-0bed-40c2-ba69-a88e8541db48" status: 200 len: 1320 microversion: 2.1 time: 0.339633 Oct 04 18:33:57.175957 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 793/1533] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:56 2022] GET /compute/v2.1/servers/7fd2a976-0bed-40c2-ba69-a88e8541db48 => generated 1320 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:57.355180 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8a209394-fb53-44eb-ad13-93a9797332ac tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:57.355910 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8a209394-fb53-44eb-ad13-93a9797332ac tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: b219d988-2847-45a0-a3b8-af54cf1a43f8] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:57.362946 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8a209394-fb53-44eb-ad13-93a9797332ac tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:57.365549 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8a209394-fb53-44eb-ad13-93a9797332ac tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:57.365549 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8a209394-fb53-44eb-ad13-93a9797332ac tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:57.365549 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8a209394-fb53-44eb-ad13-93a9797332ac tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:57.365949 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8a209394-fb53-44eb-ad13-93a9797332ac tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:57.366150 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8a209394-fb53-44eb-ad13-93a9797332ac tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:57.524410 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8a209394-fb53-44eb-ad13-93a9797332ac tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:57.534838 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8a209394-fb53-44eb-ad13-93a9797332ac tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:57.537037 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8a209394-fb53-44eb-ad13-93a9797332ac tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:57.538274 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8a209394-fb53-44eb-ad13-93a9797332ac tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8" status: 200 len: 1811 microversion: 2.25 time: 0.187048 Oct 04 18:33:57.538839 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 741/1534] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:57 2022] GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8 => generated 1811 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:57.633566 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d95c686a-88d5-4b85-8f2e-57962cf30c7b tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:57.634443 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d95c686a-88d5-4b85-8f2e-57962cf30c7b tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:57.641081 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d95c686a-88d5-4b85-8f2e-57962cf30c7b tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:57.641841 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d95c686a-88d5-4b85-8f2e-57962cf30c7b tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:57.642273 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d95c686a-88d5-4b85-8f2e-57962cf30c7b tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:57.643364 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d95c686a-88d5-4b85-8f2e-57962cf30c7b tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:57.644077 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d95c686a-88d5-4b85-8f2e-57962cf30c7b tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:57.648308 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d95c686a-88d5-4b85-8f2e-57962cf30c7b tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:57.653984 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=100 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:57.743115 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d95c686a-88d5-4b85-8f2e-57962cf30c7b tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:57.752366 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d95c686a-88d5-4b85-8f2e-57962cf30c7b tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:57.755243 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d95c686a-88d5-4b85-8f2e-57962cf30c7b tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:57.760811 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d95c686a-88d5-4b85-8f2e-57962cf30c7b tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1553 microversion: 2.91 time: 0.132831 Oct 04 18:33:57.761873 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 794/1535] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:57 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1553 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:57.798914 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-153f2b09-2168-494f-989f-03447bacd6f6 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:57.799881 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-153f2b09-2168-494f-989f-03447bacd6f6 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] [instance: 0948d595-51a2-41fb-b561-8255de0bc6a0] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:57.807226 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-153f2b09-2168-494f-989f-03447bacd6f6 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:57.808071 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-153f2b09-2168-494f-989f-03447bacd6f6 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:57.808986 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-153f2b09-2168-494f-989f-03447bacd6f6 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:57.809893 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-153f2b09-2168-494f-989f-03447bacd6f6 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:57.810530 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-153f2b09-2168-494f-989f-03447bacd6f6 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:57.811157 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-153f2b09-2168-494f-989f-03447bacd6f6 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:57.827704 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-153f2b09-2168-494f-989f-03447bacd6f6 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] HTTP exception thrown: Instance 0948d595-51a2-41fb-b561-8255de0bc6a0 could not be found. Oct 04 18:33:57.830074 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-153f2b09-2168-494f-989f-03447bacd6f6 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Request method failure captured: Oct 04 18:33:57.830074 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/0948d595-51a2-41fb-b561-8255de0bc6a0 HTTP/1.1 Oct 04 18:33:57.830074 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:33:57.830074 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:33:57.830074 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:33:57.830074 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:33:57.830074 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:33:57.830074 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:33:57.830074 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:33:57.830074 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:33:57.830074 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPHxbPrTvWqlyTT9hFmfszq1ydDFQZsMDWY7rXVMeS6tJHCRELbJJpHVzl2tvI64HUw7bzHlwkod0V8ZXMxHoC3rIa5AY1_8QPNuxQZYKMlVnVtqbrl6zmKS5CEdAviynIUpt3iO7a6RvbNFSffxF8Br20zZAjsF6UxH6qTcQVJCLHC0 Oct 04 18:33:57.830074 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:33:57.830074 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:33:57.830074 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:33:57.830074 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:33:57.830074 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:33:57.830074 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:33:57.830074 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 8064cbc5ef6a4f5c9df672a3b8668040 Oct 04 18:33:57.830074 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-LiveMigrationNegativeTest-834824199 Oct 04 18:33:57.830074 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:33:57.830074 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:33:57.830074 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8064cbc5ef6a4f5c9df672a3b8668040"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8064cbc5ef6a4f5c9df672a3b8668040", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8064cbc5ef6a4f5c9df672a3b8668040"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8064cbc5ef6a4f5c9df672a3b8668040"}]}] Oct 04 18:33:57.830074 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-LiveMigrationNegativeTest-834824199 Oct 04 18:33:57.830074 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 8064cbc5ef6a4f5c9df672a3b8668040 Oct 04 18:33:57.830074 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-834824199 Oct 04 18:33:57.830074 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-LiveMigrationNegativeTest-834824199-project Oct 04 18:33:57.830074 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:33:57.830074 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:33:57.830074 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: e6ff8f5b6c58416b82eb6765a209b344 Oct 04 18:33:57.830074 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-LiveMigrationNegativeTest-834824199-project Oct 04 18:33:57.830074 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:33:57.830074 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 0948d595-51a2-41fb-b561-8255de0bc6a0 could not be found. Oct 04 18:33:57.830074 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '0948d595-51a2-41fb-b561-8255de0bc6a0'} Oct 04 18:33:57.830074 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:33:57.830074 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:57.830074 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:33:57.830074 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:33:57.830074 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:33:57.830074 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:33:57.830074 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:33:57.830074 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:33:57.830074 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:33:57.830074 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:33:57.830074 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0948d595-51a2-41fb-b561-8255de0bc6a0 could not be found. Oct 04 18:33:57.830074 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:33:57.830074 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:57.830074 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:33:57.830074 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:57.830074 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:57.830074 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:57.830074 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:33:57.830074 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:33:57.830074 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:33:57.830074 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:33:57.830074 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:33:57.830074 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:33:57.830074 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:33:57.830074 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:33:57.830074 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:33:57.830074 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:33:57.830074 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0948d595-51a2-41fb-b561-8255de0bc6a0 could not be found. Oct 04 18:33:57.830074 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:33:57.830074 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:57.830074 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:33:57.835810 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:57.835810 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:57.835810 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:57.835810 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:33:57.835810 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:33:57.835810 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0948d595-51a2-41fb-b561-8255de0bc6a0 could not be found. Oct 04 18:33:57.835810 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:33:57.838054 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-153f2b09-2168-494f-989f-03447bacd6f6 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Returning 404 to user: Instance 0948d595-51a2-41fb-b561-8255de0bc6a0 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:33:57.839164 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-153f2b09-2168-494f-989f-03447bacd6f6 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] 10.222.0.20 "GET /compute/v2.1/servers/0948d595-51a2-41fb-b561-8255de0bc6a0" status: 404 len: 111 microversion: 2.1 time: 0.044188 Oct 04 18:33:57.840285 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 742/1536] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:57 2022] GET /compute/v2.1/servers/0948d595-51a2-41fb-b561-8255de0bc6a0 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:33:57.848707 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4ea6b13a-8522-45f9-a547-d458e6a74ec6 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:57.849285 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4ea6b13a-8522-45f9-a547-d458e6a74ec6 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] [instance: ba5fa602-5596-4e3f-a0a4-7c88dc89cd16] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:57.856019 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4ea6b13a-8522-45f9-a547-d458e6a74ec6 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:57.864889 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4ea6b13a-8522-45f9-a547-d458e6a74ec6 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:57.865520 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4ea6b13a-8522-45f9-a547-d458e6a74ec6 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:57.866900 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4ea6b13a-8522-45f9-a547-d458e6a74ec6 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:57.868684 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4ea6b13a-8522-45f9-a547-d458e6a74ec6 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:57.871908 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4ea6b13a-8522-45f9-a547-d458e6a74ec6 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:57.911865 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4ea6b13a-8522-45f9-a547-d458e6a74ec6 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] [instance: ba5fa602-5596-4e3f-a0a4-7c88dc89cd16] Going to try to terminate instance {{(pid=123002) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:33:58.018625 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6639d958-8b2a-49a0-b7ca-daab76d162bc tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '.version_select at 0x7fe25911e820>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:58.072507 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6639d958-8b2a-49a0-b7ca-daab76d162bc tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/images/ea702f85-8e85-400a-a6e3-61ce78efff2c" status: 200 len: 1413 microversion: 2.1 time: 0.057550 Oct 04 18:33:58.086958 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 743/1537] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:33:58 2022] GET /compute/v2.1/images/ea702f85-8e85-400a-a6e3-61ce78efff2c => generated 1413 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:58.199871 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2f8144fe-9452-4201-a63d-d707b631227c tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:58.200848 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2f8144fe-9452-4201-a63d-d707b631227c tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] [instance: 7fd2a976-0bed-40c2-ba69-a88e8541db48] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:58.211254 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2f8144fe-9452-4201-a63d-d707b631227c tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:58.212265 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2f8144fe-9452-4201-a63d-d707b631227c tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:58.212733 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2f8144fe-9452-4201-a63d-d707b631227c tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:58.213465 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2f8144fe-9452-4201-a63d-d707b631227c tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:58.213945 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2f8144fe-9452-4201-a63d-d707b631227c tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:58.214402 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2f8144fe-9452-4201-a63d-d707b631227c tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:58.220130 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4ea6b13a-8522-45f9-a547-d458e6a74ec6 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ba5fa602-5596-4e3f-a0a4-7c88dc89cd16" status: 204 len: 0 microversion: 2.1 time: 0.375630 Oct 04 18:33:58.224333 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 795/1538] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:33:57 2022] DELETE /compute/v2.1/servers/ba5fa602-5596-4e3f-a0a4-7c88dc89cd16 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:33:58.229948 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5d857d7a-0921-44d1-8fee-2abcdb86d160 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:58.230949 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5d857d7a-0921-44d1-8fee-2abcdb86d160 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] [instance: ba5fa602-5596-4e3f-a0a4-7c88dc89cd16] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:58.237630 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5d857d7a-0921-44d1-8fee-2abcdb86d160 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:58.238441 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5d857d7a-0921-44d1-8fee-2abcdb86d160 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:58.239096 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5d857d7a-0921-44d1-8fee-2abcdb86d160 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:58.240024 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5d857d7a-0921-44d1-8fee-2abcdb86d160 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:58.243532 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5d857d7a-0921-44d1-8fee-2abcdb86d160 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:58.244261 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5d857d7a-0921-44d1-8fee-2abcdb86d160 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:58.485103 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5d857d7a-0921-44d1-8fee-2abcdb86d160 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6ff8f5b6c58416b82eb6765a209b344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064cbc5ef6a4f5c9df672a3b8668040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:58.489490 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-2f8144fe-9452-4201-a63d-d707b631227c tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44cc98e07d134a15b0fbf2b80bd25ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e0b0088d8476bbcb4c83783fec0e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:58.494606 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5d857d7a-0921-44d1-8fee-2abcdb86d160 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] 10.222.0.20 "GET /compute/v2.1/servers/ba5fa602-5596-4e3f-a0a4-7c88dc89cd16" status: 200 len: 1475 microversion: 2.1 time: 0.268777 Oct 04 18:33:58.495938 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 796/1539] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:58 2022] GET /compute/v2.1/servers/ba5fa602-5596-4e3f-a0a4-7c88dc89cd16 => generated 1475 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:58.499526 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2f8144fe-9452-4201-a63d-d707b631227c tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] 10.222.0.20 "GET /compute/v2.1/servers/7fd2a976-0bed-40c2-ba69-a88e8541db48" status: 200 len: 1320 microversion: 2.1 time: 0.304553 Oct 04 18:33:58.508246 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 744/1540] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:58 2022] GET /compute/v2.1/servers/7fd2a976-0bed-40c2-ba69-a88e8541db48 => generated 1320 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:33:58.566693 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a0d8abaa-ab9c-4363-9fae-5171e955faf5 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:58.567362 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a0d8abaa-ab9c-4363-9fae-5171e955faf5 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: b219d988-2847-45a0-a3b8-af54cf1a43f8] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:58.575123 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a0d8abaa-ab9c-4363-9fae-5171e955faf5 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:58.575750 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a0d8abaa-ab9c-4363-9fae-5171e955faf5 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:58.576219 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a0d8abaa-ab9c-4363-9fae-5171e955faf5 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:58.576957 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a0d8abaa-ab9c-4363-9fae-5171e955faf5 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:58.577414 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a0d8abaa-ab9c-4363-9fae-5171e955faf5 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:58.577840 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a0d8abaa-ab9c-4363-9fae-5171e955faf5 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:58.743868 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a0d8abaa-ab9c-4363-9fae-5171e955faf5 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:58.743868 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a0d8abaa-ab9c-4363-9fae-5171e955faf5 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:58.743868 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a0d8abaa-ab9c-4363-9fae-5171e955faf5 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:58.743868 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a0d8abaa-ab9c-4363-9fae-5171e955faf5 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8" status: 200 len: 1811 microversion: 2.25 time: 0.178689 Oct 04 18:33:58.743868 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 797/1541] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:58 2022] GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8 => generated 1811 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:58.795015 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1f8a1fa6-839d-449b-a12f-e6e7ec2c2098 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:58.795629 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1f8a1fa6-839d-449b-a12f-e6e7ec2c2098 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:58.801717 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1f8a1fa6-839d-449b-a12f-e6e7ec2c2098 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:58.802202 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1f8a1fa6-839d-449b-a12f-e6e7ec2c2098 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:58.802630 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1f8a1fa6-839d-449b-a12f-e6e7ec2c2098 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:58.803317 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1f8a1fa6-839d-449b-a12f-e6e7ec2c2098 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:58.803767 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1f8a1fa6-839d-449b-a12f-e6e7ec2c2098 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:58.804221 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1f8a1fa6-839d-449b-a12f-e6e7ec2c2098 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:58.871066 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1f8a1fa6-839d-449b-a12f-e6e7ec2c2098 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:58.871548 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-affaf942-743d-472b-b403-d3d8f614290e req-00fa6b33-8bbd-4fe3-997b-fae0fc08d6ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8c84d9e-2274-49dd-99e9-cbd7222c22d5", "name": "network-vif-plugged", "status": "completed", "tag": "84624e18-aa6c-4e5b-a8b8-776adc3416b5"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:58.880184 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1f8a1fa6-839d-449b-a12f-e6e7ec2c2098 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:58.881742 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1f8a1fa6-839d-449b-a12f-e6e7ec2c2098 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:58.882367 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-affaf942-743d-472b-b403-d3d8f614290e req-00fa6b33-8bbd-4fe3-997b-fae0fc08d6ff service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:58.882850 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-affaf942-743d-472b-b403-d3d8f614290e req-00fa6b33-8bbd-4fe3-997b-fae0fc08d6ff service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:58.883465 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-affaf942-743d-472b-b403-d3d8f614290e req-00fa6b33-8bbd-4fe3-997b-fae0fc08d6ff service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:58.886965 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1f8a1fa6-839d-449b-a12f-e6e7ec2c2098 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1553 microversion: 2.91 time: 0.095857 Oct 04 18:33:58.887861 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 745/1542] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:58 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1553 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:33:58.896463 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-affaf942-743d-472b-b403-d3d8f614290e req-00fa6b33-8bbd-4fe3-997b-fae0fc08d6ff service nova] Creating event network-vif-plugged:84624e18-aa6c-4e5b-a8b8-776adc3416b5 for instance c8c84d9e-2274-49dd-99e9-cbd7222c22d5 on n-h2-850501-14 Oct 04 18:33:58.907192 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-affaf942-743d-472b-b403-d3d8f614290e req-00fa6b33-8bbd-4fe3-997b-fae0fc08d6ff service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039150 Oct 04 18:33:58.907786 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 798/1543] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:33:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:33:59.090738 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7e3611bd-e3b3-410b-9ec7-b47fa784fcc7 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '.version_select at 0x7fe2593179d0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:59.143082 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7e3611bd-e3b3-410b-9ec7-b47fa784fcc7 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/images/ea702f85-8e85-400a-a6e3-61ce78efff2c" status: 200 len: 1413 microversion: 2.1 time: 0.056424 Oct 04 18:33:59.143671 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 746/1544] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:33:59 2022] GET /compute/v2.1/images/ea702f85-8e85-400a-a6e3-61ce78efff2c => generated 1413 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:59.525263 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e3e23236-566d-441b-9858-275174757a05 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:59.528198 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-29dba53b-a4ec-4d8c-b323-b07fdaf5b435 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:59.528915 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-29dba53b-a4ec-4d8c-b323-b07fdaf5b435 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] [instance: ba5fa602-5596-4e3f-a0a4-7c88dc89cd16] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:59.532490 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e3e23236-566d-441b-9858-275174757a05 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] [instance: 7fd2a976-0bed-40c2-ba69-a88e8541db48] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:59.542284 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e3e23236-566d-441b-9858-275174757a05 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:59.544253 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-29dba53b-a4ec-4d8c-b323-b07fdaf5b435 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:59.545029 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e3e23236-566d-441b-9858-275174757a05 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:59.545689 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e3e23236-566d-441b-9858-275174757a05 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:59.546422 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e3e23236-566d-441b-9858-275174757a05 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:59.546928 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e3e23236-566d-441b-9858-275174757a05 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:59.547383 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e3e23236-566d-441b-9858-275174757a05 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:59.554377 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-29dba53b-a4ec-4d8c-b323-b07fdaf5b435 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:59.554377 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-29dba53b-a4ec-4d8c-b323-b07fdaf5b435 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:59.555046 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-29dba53b-a4ec-4d8c-b323-b07fdaf5b435 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:59.555505 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-29dba53b-a4ec-4d8c-b323-b07fdaf5b435 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:59.555933 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-29dba53b-a4ec-4d8c-b323-b07fdaf5b435 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:59.779762 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e3e23236-566d-441b-9858-275174757a05 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44cc98e07d134a15b0fbf2b80bd25ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e0b0088d8476bbcb4c83783fec0e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:59.791997 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e3e23236-566d-441b-9858-275174757a05 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] 10.222.0.20 "GET /compute/v2.1/servers/7fd2a976-0bed-40c2-ba69-a88e8541db48" status: 200 len: 1508 microversion: 2.1 time: 0.273514 Oct 04 18:33:59.809744 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 747/1545] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:59 2022] GET /compute/v2.1/servers/7fd2a976-0bed-40c2-ba69-a88e8541db48 => generated 1508 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:59.816008 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-29dba53b-a4ec-4d8c-b323-b07fdaf5b435 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6ff8f5b6c58416b82eb6765a209b344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064cbc5ef6a4f5c9df672a3b8668040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:59.818311 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d5afc86d-f7dc-432d-99f5-325b04eac938 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:59.819602 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d5afc86d-f7dc-432d-99f5-325b04eac938 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: b219d988-2847-45a0-a3b8-af54cf1a43f8] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:59.825881 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-29dba53b-a4ec-4d8c-b323-b07fdaf5b435 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] 10.222.0.20 "GET /compute/v2.1/servers/ba5fa602-5596-4e3f-a0a4-7c88dc89cd16" status: 200 len: 1475 microversion: 2.1 time: 0.311653 Oct 04 18:33:59.826671 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d5afc86d-f7dc-432d-99f5-325b04eac938 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:59.827659 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 799/1546] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:59 2022] GET /compute/v2.1/servers/ba5fa602-5596-4e3f-a0a4-7c88dc89cd16 => generated 1475 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:59.827927 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d5afc86d-f7dc-432d-99f5-325b04eac938 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:59.828538 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d5afc86d-f7dc-432d-99f5-325b04eac938 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:59.830024 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d5afc86d-f7dc-432d-99f5-325b04eac938 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:59.830633 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d5afc86d-f7dc-432d-99f5-325b04eac938 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:59.831203 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d5afc86d-f7dc-432d-99f5-325b04eac938 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:59.833814 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-718b685b-2d51-4cba-8cc3-f8c502ff233f tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:59.834537 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-718b685b-2d51-4cba-8cc3-f8c502ff233f tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] [instance: 7a384d42-782c-49ac-ad60-e98cf5924e92] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:59.848917 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-718b685b-2d51-4cba-8cc3-f8c502ff233f tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:59.849595 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-718b685b-2d51-4cba-8cc3-f8c502ff233f tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:59.849885 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-718b685b-2d51-4cba-8cc3-f8c502ff233f tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:59.850841 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-718b685b-2d51-4cba-8cc3-f8c502ff233f tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:59.851308 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-718b685b-2d51-4cba-8cc3-f8c502ff233f tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:59.851913 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-718b685b-2d51-4cba-8cc3-f8c502ff233f tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:00.064725 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d5afc86d-f7dc-432d-99f5-325b04eac938 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:00.074620 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d5afc86d-f7dc-432d-99f5-325b04eac938 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:00.078841 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d5afc86d-f7dc-432d-99f5-325b04eac938 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:00.084033 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d5afc86d-f7dc-432d-99f5-325b04eac938 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8" status: 200 len: 1811 microversion: 2.25 time: 0.273136 Oct 04 18:34:00.100510 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 748/1547] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:33:59 2022] GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8 => generated 1811 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:00.113252 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-85d46e8a-3f5b-46b7-bf0b-3220becfd0f6 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:00.114426 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-85d46e8a-3f5b-46b7-bf0b-3220becfd0f6 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:00.121096 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-85d46e8a-3f5b-46b7-bf0b-3220becfd0f6 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:00.122648 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-85d46e8a-3f5b-46b7-bf0b-3220becfd0f6 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:00.123335 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-85d46e8a-3f5b-46b7-bf0b-3220becfd0f6 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:00.124139 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-718b685b-2d51-4cba-8cc3-f8c502ff233f tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44cc98e07d134a15b0fbf2b80bd25ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e0b0088d8476bbcb4c83783fec0e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:00.125157 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-85d46e8a-3f5b-46b7-bf0b-3220becfd0f6 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:00.125793 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-85d46e8a-3f5b-46b7-bf0b-3220becfd0f6 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:00.126633 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-85d46e8a-3f5b-46b7-bf0b-3220becfd0f6 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:00.134536 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-718b685b-2d51-4cba-8cc3-f8c502ff233f tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] 10.222.0.20 "GET /compute/v2.1/servers/7a384d42-782c-49ac-ad60-e98cf5924e92" status: 200 len: 1509 microversion: 2.1 time: 0.305677 Oct 04 18:34:00.149042 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 800/1548] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:59 2022] GET /compute/v2.1/servers/7a384d42-782c-49ac-ad60-e98cf5924e92 => generated 1509 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:00.162580 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-356de540-ca8c-428c-b59b-6489e9bcbe96 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:00.163072 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-356de540-ca8c-428c-b59b-6489e9bcbe96 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] [instance: 7a384d42-782c-49ac-ad60-e98cf5924e92] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:00.180395 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-356de540-ca8c-428c-b59b-6489e9bcbe96 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:00.182731 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-356de540-ca8c-428c-b59b-6489e9bcbe96 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:00.186981 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-356de540-ca8c-428c-b59b-6489e9bcbe96 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:00.187948 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-356de540-ca8c-428c-b59b-6489e9bcbe96 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:00.189488 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-356de540-ca8c-428c-b59b-6489e9bcbe96 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:00.192606 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-356de540-ca8c-428c-b59b-6489e9bcbe96 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:00.237154 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-85d46e8a-3f5b-46b7-bf0b-3220becfd0f6 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:00.247955 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-85d46e8a-3f5b-46b7-bf0b-3220becfd0f6 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:00.249593 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-85d46e8a-3f5b-46b7-bf0b-3220becfd0f6 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:00.257672 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-85d46e8a-3f5b-46b7-bf0b-3220becfd0f6 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1553 microversion: 2.91 time: 0.155675 Oct 04 18:34:00.259792 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 749/1549] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:00 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1553 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:00.261466 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-356de540-ca8c-428c-b59b-6489e9bcbe96 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] [instance: 7a384d42-782c-49ac-ad60-e98cf5924e92] Going to try to terminate instance {{(pid=123002) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:34:00.266322 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b12dc8eb-d327-4020-a69a-26e66e060b78 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '.version_select at 0x7fe258beddc0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:00.339742 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b12dc8eb-d327-4020-a69a-26e66e060b78 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/images/ea702f85-8e85-400a-a6e3-61ce78efff2c" status: 200 len: 1413 microversion: 2.1 time: 0.078426 Oct 04 18:34:00.340652 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 750/1550] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:34:00 2022] GET /compute/v2.1/images/ea702f85-8e85-400a-a6e3-61ce78efff2c => generated 1413 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:00.617322 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-356de540-ca8c-428c-b59b-6489e9bcbe96 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7a384d42-782c-49ac-ad60-e98cf5924e92" status: 204 len: 0 microversion: 2.1 time: 0.460909 Oct 04 18:34:00.618470 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 801/1551] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:34:00 2022] DELETE /compute/v2.1/servers/7a384d42-782c-49ac-ad60-e98cf5924e92 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:34:00.639957 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-931fdf63-b371-4f89-81d5-2872b9c8a041 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:00.642351 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-931fdf63-b371-4f89-81d5-2872b9c8a041 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] [instance: 7fd2a976-0bed-40c2-ba69-a88e8541db48] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:00.658495 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-931fdf63-b371-4f89-81d5-2872b9c8a041 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:00.661116 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-931fdf63-b371-4f89-81d5-2872b9c8a041 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:00.661594 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-931fdf63-b371-4f89-81d5-2872b9c8a041 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:00.664162 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-931fdf63-b371-4f89-81d5-2872b9c8a041 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:00.676518 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-931fdf63-b371-4f89-81d5-2872b9c8a041 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:00.676518 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-931fdf63-b371-4f89-81d5-2872b9c8a041 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:00.729562 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-931fdf63-b371-4f89-81d5-2872b9c8a041 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] [instance: 7fd2a976-0bed-40c2-ba69-a88e8541db48] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:34:00.817625 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-69e9929c-173b-42be-aac0-40d3bb4c4058 req-ca215bdc-6c47-4dce-a512-16f98cfa7cf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba5fa602-5596-4e3f-a0a4-7c88dc89cd16", "name": "network-vif-deleted", "tag": "815e70e4-400f-49c5-839e-f517fd1e6065"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:00.829527 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-69e9929c-173b-42be-aac0-40d3bb4c4058 req-ca215bdc-6c47-4dce-a512-16f98cfa7cf9 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:00.830223 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-69e9929c-173b-42be-aac0-40d3bb4c4058 req-ca215bdc-6c47-4dce-a512-16f98cfa7cf9 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:00.831020 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-69e9929c-173b-42be-aac0-40d3bb4c4058 req-ca215bdc-6c47-4dce-a512-16f98cfa7cf9 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:00.844970 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-69e9929c-173b-42be-aac0-40d3bb4c4058 req-ca215bdc-6c47-4dce-a512-16f98cfa7cf9 service nova] Creating event network-vif-deleted:815e70e4-400f-49c5-839e-f517fd1e6065 for instance ba5fa602-5596-4e3f-a0a4-7c88dc89cd16 on n-h1-850501-14 Oct 04 18:34:00.853560 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-69e9929c-173b-42be-aac0-40d3bb4c4058 req-ca215bdc-6c47-4dce-a512-16f98cfa7cf9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040370 Oct 04 18:34:00.865892 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 802/1552] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:34:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:34:00.866217 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-74686b38-1476-444e-b380-94e5942203a2 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:00.867028 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-74686b38-1476-444e-b380-94e5942203a2 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] [instance: ba5fa602-5596-4e3f-a0a4-7c88dc89cd16] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:00.873826 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-74686b38-1476-444e-b380-94e5942203a2 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:00.874463 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-74686b38-1476-444e-b380-94e5942203a2 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:00.875008 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-74686b38-1476-444e-b380-94e5942203a2 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:00.876118 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-74686b38-1476-444e-b380-94e5942203a2 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:00.876818 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-74686b38-1476-444e-b380-94e5942203a2 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:00.877520 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-74686b38-1476-444e-b380-94e5942203a2 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:00.952346 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-74686b38-1476-444e-b380-94e5942203a2 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6ff8f5b6c58416b82eb6765a209b344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064cbc5ef6a4f5c9df672a3b8668040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:00.961966 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-74686b38-1476-444e-b380-94e5942203a2 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] 10.222.0.20 "GET /compute/v2.1/servers/ba5fa602-5596-4e3f-a0a4-7c88dc89cd16" status: 200 len: 1433 microversion: 2.1 time: 0.100969 Oct 04 18:34:00.963228 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 803/1553] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:00 2022] GET /compute/v2.1/servers/ba5fa602-5596-4e3f-a0a4-7c88dc89cd16 => generated 1433 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:01.045099 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-931fdf63-b371-4f89-81d5-2872b9c8a041 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7fd2a976-0bed-40c2-ba69-a88e8541db48" status: 204 len: 0 microversion: 2.1 time: 0.421941 Oct 04 18:34:01.046372 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 751/1554] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:34:00 2022] DELETE /compute/v2.1/servers/7fd2a976-0bed-40c2-ba69-a88e8541db48 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:34:01.119690 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7fa53d26-7965-44e1-9e40-093c33697546 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:01.120760 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7fa53d26-7965-44e1-9e40-093c33697546 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: b219d988-2847-45a0-a3b8-af54cf1a43f8] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:01.130971 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-bab2c9c6-488a-4fe4-9b0c-370830f6e4ae tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-1665032068", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "775db4fd-ffbb-4b60-8080-bcd59498413f"}]}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:01.134566 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7fa53d26-7965-44e1-9e40-093c33697546 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:01.136221 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7fa53d26-7965-44e1-9e40-093c33697546 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:01.138401 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7fa53d26-7965-44e1-9e40-093c33697546 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:01.139340 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7fa53d26-7965-44e1-9e40-093c33697546 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:01.140292 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7fa53d26-7965-44e1-9e40-093c33697546 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:01.142345 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7fa53d26-7965-44e1-9e40-093c33697546 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:01.331318 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7fa53d26-7965-44e1-9e40-093c33697546 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:01.345794 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7fa53d26-7965-44e1-9e40-093c33697546 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:01.347249 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7fa53d26-7965-44e1-9e40-093c33697546 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:01.349005 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7fa53d26-7965-44e1-9e40-093c33697546 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8" status: 200 len: 1811 microversion: 2.25 time: 0.233904 Oct 04 18:34:01.349568 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 804/1555] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:01 2022] GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8 => generated 1811 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:01.360386 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-97ae7c07-eae0-4a5b-992e-79b87d9bcca0 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:01.360992 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-97ae7c07-eae0-4a5b-992e-79b87d9bcca0 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:01.381716 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-97ae7c07-eae0-4a5b-992e-79b87d9bcca0 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:01.382230 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-97ae7c07-eae0-4a5b-992e-79b87d9bcca0 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:01.382667 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-97ae7c07-eae0-4a5b-992e-79b87d9bcca0 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:01.385039 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-97ae7c07-eae0-4a5b-992e-79b87d9bcca0 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:01.385709 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-97ae7c07-eae0-4a5b-992e-79b87d9bcca0 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:01.386146 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-97ae7c07-eae0-4a5b-992e-79b87d9bcca0 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:01.489932 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-97ae7c07-eae0-4a5b-992e-79b87d9bcca0 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:01.500572 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-97ae7c07-eae0-4a5b-992e-79b87d9bcca0 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:01.502075 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-97ae7c07-eae0-4a5b-992e-79b87d9bcca0 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:01.508094 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-97ae7c07-eae0-4a5b-992e-79b87d9bcca0 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1553 microversion: 2.91 time: 0.151435 Oct 04 18:34:01.509131 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 805/1556] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:01 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1553 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:01.515799 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7139b1f8-f32c-47c0-b964-2f180f514c11 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '.version_select at 0x7fe25d1310d0>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:01.677848 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=3 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:04.046200 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.neutron [None req-bab2c9c6-488a-4fe4-9b0c-370830f6e4ae tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] validate_networks() for [('775db4fd-ffbb-4b60-8080-bcd59498413f', None, None, None, None, None)] {{(pid=123001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:34:04.060190 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7139b1f8-f32c-47c0-b964-2f180f514c11 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/images/ea702f85-8e85-400a-a6e3-61ce78efff2c" status: 200 len: 1413 microversion: 2.1 time: 2.549937 Oct 04 18:34:04.061958 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 806/1557] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:34:01 2022] GET /compute/v2.1/images/ea702f85-8e85-400a-a6e3-61ce78efff2c => generated 1413 bytes in 2552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:04.068820 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d91c67d5-4052-4794-bc39-7e489a540d5a tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:04.075763 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d91c67d5-4052-4794-bc39-7e489a540d5a tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] [instance: ba5fa602-5596-4e3f-a0a4-7c88dc89cd16] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:04.093464 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d91c67d5-4052-4794-bc39-7e489a540d5a tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:04.094541 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d91c67d5-4052-4794-bc39-7e489a540d5a tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:04.095887 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d91c67d5-4052-4794-bc39-7e489a540d5a tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:04.096975 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d91c67d5-4052-4794-bc39-7e489a540d5a tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:04.097831 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d91c67d5-4052-4794-bc39-7e489a540d5a tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:04.098517 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d91c67d5-4052-4794-bc39-7e489a540d5a tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:04.328891 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d91c67d5-4052-4794-bc39-7e489a540d5a tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6ff8f5b6c58416b82eb6765a209b344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064cbc5ef6a4f5c9df672a3b8668040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:04.351924 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d91c67d5-4052-4794-bc39-7e489a540d5a tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] 10.222.0.20 "GET /compute/v2.1/servers/ba5fa602-5596-4e3f-a0a4-7c88dc89cd16" status: 200 len: 1304 microversion: 2.1 time: 0.285231 Oct 04 18:34:04.372332 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 807/1558] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:04 2022] GET /compute/v2.1/servers/ba5fa602-5596-4e3f-a0a4-7c88dc89cd16 => generated 1304 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:04.372332 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-495fedf7-a19a-494d-bacd-969fed509a20 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:04.372332 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-495fedf7-a19a-494d-bacd-969fed509a20 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: b219d988-2847-45a0-a3b8-af54cf1a43f8] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:04.377102 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-495fedf7-a19a-494d-bacd-969fed509a20 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:04.377746 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-495fedf7-a19a-494d-bacd-969fed509a20 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:04.378493 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-495fedf7-a19a-494d-bacd-969fed509a20 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:04.380482 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-495fedf7-a19a-494d-bacd-969fed509a20 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:04.381270 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-495fedf7-a19a-494d-bacd-969fed509a20 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:04.381940 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-495fedf7-a19a-494d-bacd-969fed509a20 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:04.657614 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-495fedf7-a19a-494d-bacd-969fed509a20 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:04.686990 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-495fedf7-a19a-494d-bacd-969fed509a20 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:04.686990 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-495fedf7-a19a-494d-bacd-969fed509a20 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:04.686990 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-495fedf7-a19a-494d-bacd-969fed509a20 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8" status: 200 len: 1811 microversion: 2.25 time: 0.332943 Oct 04 18:34:04.691886 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 808/1559] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:04 2022] GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8 => generated 1811 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:04.703384 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e0d4aed7-d116-4966-8071-56d544b562ee tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:04.704281 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e0d4aed7-d116-4966-8071-56d544b562ee tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:04.725859 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e0d4aed7-d116-4966-8071-56d544b562ee tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:04.726364 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e0d4aed7-d116-4966-8071-56d544b562ee tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:04.726805 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e0d4aed7-d116-4966-8071-56d544b562ee tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:04.727595 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e0d4aed7-d116-4966-8071-56d544b562ee tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:04.728074 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e0d4aed7-d116-4966-8071-56d544b562ee tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:04.728509 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e0d4aed7-d116-4966-8071-56d544b562ee tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:04.809650 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e0d4aed7-d116-4966-8071-56d544b562ee tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:04.811831 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:04.820009 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e0d4aed7-d116-4966-8071-56d544b562ee tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:04.821622 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e0d4aed7-d116-4966-8071-56d544b562ee tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:04.827695 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e0d4aed7-d116-4966-8071-56d544b562ee tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1553 microversion: 2.91 time: 0.133981 Oct 04 18:34:04.828331 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 809/1560] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:04 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1553 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:04.834126 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-a6478a84-9875-4ee2-bee7-df91f9620207 req-dc8009c1-68e6-4c7a-a4e9-d97c7de83e87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b219d988-2847-45a0-a3b8-af54cf1a43f8", "name": "network-vif-unplugged", "status": "completed", "tag": "581c676f-096d-4159-ae53-d455ac141b32"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:04.852225 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-a6478a84-9875-4ee2-bee7-df91f9620207 req-dc8009c1-68e6-4c7a-a4e9-d97c7de83e87 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:04.854868 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-a6478a84-9875-4ee2-bee7-df91f9620207 req-dc8009c1-68e6-4c7a-a4e9-d97c7de83e87 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:04.854868 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-a6478a84-9875-4ee2-bee7-df91f9620207 req-dc8009c1-68e6-4c7a-a4e9-d97c7de83e87 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:04.866226 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-a6478a84-9875-4ee2-bee7-df91f9620207 req-dc8009c1-68e6-4c7a-a4e9-d97c7de83e87 service nova] Creating event network-vif-unplugged:581c676f-096d-4159-ae53-d455ac141b32 for instance b219d988-2847-45a0-a3b8-af54cf1a43f8 on n-h1-850501-14 Oct 04 18:34:04.872826 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-a6478a84-9875-4ee2-bee7-df91f9620207 req-dc8009c1-68e6-4c7a-a4e9-d97c7de83e87 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043042 Oct 04 18:34:04.873627 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 810/1561] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:34:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:34:04.971304 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-bab2c9c6-488a-4fe4-9b0c-370830f6e4ae tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:34:04.971767 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-bab2c9c6-488a-4fe4-9b0c-370830f6e4ae tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:34:04.972495 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-bab2c9c6-488a-4fe4-9b0c-370830f6e4ae tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:34:04.972918 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-bab2c9c6-488a-4fe4-9b0c-370830f6e4ae tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:34:04.973389 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-bab2c9c6-488a-4fe4-9b0c-370830f6e4ae tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:34:04.993683 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bab2c9c6-488a-4fe4-9b0c-370830f6e4ae tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:04.994632 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bab2c9c6-488a-4fe4-9b0c-370830f6e4ae tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:04.995326 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bab2c9c6-488a-4fe4-9b0c-370830f6e4ae tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:04.996158 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bab2c9c6-488a-4fe4-9b0c-370830f6e4ae tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:04.996726 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bab2c9c6-488a-4fe4-9b0c-370830f6e4ae tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:04.997236 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bab2c9c6-488a-4fe4-9b0c-370830f6e4ae tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:05.020693 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-bab2c9c6-488a-4fe4-9b0c-370830f6e4ae tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Getting quotas for project 320e0b0088d8476bbcb4c83783fec0e6. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:34:05.028397 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-bab2c9c6-488a-4fe4-9b0c-370830f6e4ae tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Getting quotas for user 44cc98e07d134a15b0fbf2b80bd25ef7 and project 320e0b0088d8476bbcb4c83783fec0e6. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:34:05.041302 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:05.044908 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-bab2c9c6-488a-4fe4-9b0c-370830f6e4ae tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Going to run 2 instances... {{(pid=123001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:34:05.048046 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-bab2c9c6-488a-4fe4-9b0c-370830f6e4ae tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] [instance: 859d2a18-b7eb-457b-a4e3-7d3b5fb80137] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:34:05.079652 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3bc5f559-095c-48a7-b8e6-1e1c968c773e tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '.version_select at 0x7fe25d131e50>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:05.132626 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3bc5f559-095c-48a7-b8e6-1e1c968c773e tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/images/ea702f85-8e85-400a-a6e3-61ce78efff2c" status: 200 len: 1413 microversion: 2.1 time: 0.058263 Oct 04 18:34:05.133216 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 811/1562] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:34:05 2022] GET /compute/v2.1/images/ea702f85-8e85-400a-a6e3-61ce78efff2c => generated 1413 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:34:05.266100 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-bab2c9c6-488a-4fe4-9b0c-370830f6e4ae tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] [instance: d3abc28f-8361-4906-a085-1440991c298f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=859d2a18-b7eb-457b-a4e3-7d3b5fb80137,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:34:05.381744 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-89365520-e94c-432d-9d15-a0b30afdfe15 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:05.382918 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-89365520-e94c-432d-9d15-a0b30afdfe15 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] [instance: ba5fa602-5596-4e3f-a0a4-7c88dc89cd16] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:05.390497 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-89365520-e94c-432d-9d15-a0b30afdfe15 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:05.391378 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-89365520-e94c-432d-9d15-a0b30afdfe15 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:05.394253 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-89365520-e94c-432d-9d15-a0b30afdfe15 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:05.396028 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-89365520-e94c-432d-9d15-a0b30afdfe15 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:05.397408 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-89365520-e94c-432d-9d15-a0b30afdfe15 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:05.398166 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-89365520-e94c-432d-9d15-a0b30afdfe15 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:05.424086 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-bab2c9c6-488a-4fe4-9b0c-370830f6e4ae tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 4.299528 Oct 04 18:34:05.425298 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 752/1563] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:34:01 2022] POST /compute/v2.1/servers => generated 32 bytes in 4302 msecs (HTTP/1.1 202) 9 headers in 362 bytes (2 switches on core 0) Oct 04 18:34:05.438580 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-137caf56-8b67-4bc7-9fe5-c58dcb6aa372 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:05.446543 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-137caf56-8b67-4bc7-9fe5-c58dcb6aa372 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '44cc98e07d134a15b0fbf2b80bd25ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e0b0088d8476bbcb4c83783fec0e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:05.449697 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-137caf56-8b67-4bc7-9fe5-c58dcb6aa372 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Searching by: {'deleted': False, 'project_id': '320e0b0088d8476bbcb4c83783fec0e6'} {{(pid=123001) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:34:05.465282 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-89365520-e94c-432d-9d15-a0b30afdfe15 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:05.466086 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-89365520-e94c-432d-9d15-a0b30afdfe15 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:05.468208 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-89365520-e94c-432d-9d15-a0b30afdfe15 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:05.469905 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-89365520-e94c-432d-9d15-a0b30afdfe15 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lazy-loading 'fault' on Instance uuid ba5fa602-5596-4e3f-a0a4-7c88dc89cd16 {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:34:05.474847 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-137caf56-8b67-4bc7-9fe5-c58dcb6aa372 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:05.475079 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-137caf56-8b67-4bc7-9fe5-c58dcb6aa372 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:05.475529 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-137caf56-8b67-4bc7-9fe5-c58dcb6aa372 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:05.476352 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-137caf56-8b67-4bc7-9fe5-c58dcb6aa372 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:05.476996 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-137caf56-8b67-4bc7-9fe5-c58dcb6aa372 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:05.477597 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-137caf56-8b67-4bc7-9fe5-c58dcb6aa372 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:05.537039 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-89365520-e94c-432d-9d15-a0b30afdfe15 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6ff8f5b6c58416b82eb6765a209b344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064cbc5ef6a4f5c9df672a3b8668040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:05.541735 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.multi_cell_list [None req-137caf56-8b67-4bc7-9fe5-c58dcb6aa372 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=123001) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:34:05.548333 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-89365520-e94c-432d-9d15-a0b30afdfe15 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] 10.222.0.20 "GET /compute/v2.1/servers/ba5fa602-5596-4e3f-a0a4-7c88dc89cd16" status: 200 len: 1309 microversion: 2.1 time: 0.172705 Oct 04 18:34:05.549720 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 812/1564] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:05 2022] GET /compute/v2.1/servers/ba5fa602-5596-4e3f-a0a4-7c88dc89cd16 => generated 1309 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:34:05.588201 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-137caf56-8b67-4bc7-9fe5-c58dcb6aa372 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 1337 microversion: 2.1 time: 0.154186 Oct 04 18:34:05.588946 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 753/1565] 10.222.0.20 () {58 vars in 1125 bytes} [Tue Oct 4 18:34:05 2022] GET /compute/v2.1/servers => generated 1337 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:05.605278 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-58aaf9d0-3c59-44eb-aa8f-0794bd585742 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:05.606200 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-58aaf9d0-3c59-44eb-aa8f-0794bd585742 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] [instance: d3abc28f-8361-4906-a085-1440991c298f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:05.676785 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-58aaf9d0-3c59-44eb-aa8f-0794bd585742 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44cc98e07d134a15b0fbf2b80bd25ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e0b0088d8476bbcb4c83783fec0e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:05.687628 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-58aaf9d0-3c59-44eb-aa8f-0794bd585742 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] 10.222.0.20 "GET /compute/v2.1/servers/d3abc28f-8361-4906-a085-1440991c298f" status: 200 len: 1218 microversion: 2.1 time: 0.087396 Oct 04 18:34:05.689125 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 813/1566] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:05 2022] GET /compute/v2.1/servers/d3abc28f-8361-4906-a085-1440991c298f => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:34:05.726527 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-fc626e78-c0e7-40cf-a7ad-f752a963e52f tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:05.727404 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-fc626e78-c0e7-40cf-a7ad-f752a963e52f tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: b219d988-2847-45a0-a3b8-af54cf1a43f8] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:05.742795 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fc626e78-c0e7-40cf-a7ad-f752a963e52f tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:05.742795 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fc626e78-c0e7-40cf-a7ad-f752a963e52f tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:05.743673 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fc626e78-c0e7-40cf-a7ad-f752a963e52f tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:05.745389 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fc626e78-c0e7-40cf-a7ad-f752a963e52f tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:05.749054 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fc626e78-c0e7-40cf-a7ad-f752a963e52f tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:05.750581 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fc626e78-c0e7-40cf-a7ad-f752a963e52f tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:05.857567 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2cab9bf3-a48d-485c-959d-8703b1958b5d tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:05.858382 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2cab9bf3-a48d-485c-959d-8703b1958b5d tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:05.875531 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2cab9bf3-a48d-485c-959d-8703b1958b5d tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:05.877424 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2cab9bf3-a48d-485c-959d-8703b1958b5d tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:05.881463 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2cab9bf3-a48d-485c-959d-8703b1958b5d tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:05.883831 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2cab9bf3-a48d-485c-959d-8703b1958b5d tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:05.884659 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2cab9bf3-a48d-485c-959d-8703b1958b5d tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:05.886413 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2cab9bf3-a48d-485c-959d-8703b1958b5d tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:06.317246 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2cab9bf3-a48d-485c-959d-8703b1958b5d tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:06.327506 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2cab9bf3-a48d-485c-959d-8703b1958b5d tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:06.332374 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2cab9bf3-a48d-485c-959d-8703b1958b5d tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:06.341864 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2cab9bf3-a48d-485c-959d-8703b1958b5d tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1535 microversion: 2.91 time: 0.487693 Oct 04 18:34:06.362212 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 814/1567] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:05 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1535 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:34:06.384662 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-17927be0-7027-4a5d-8a5c-54282dc119a5 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '.version_select at 0x7fe25d131e50>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:06.411125 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-fc626e78-c0e7-40cf-a7ad-f752a963e52f tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:06.422582 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-fc626e78-c0e7-40cf-a7ad-f752a963e52f tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:06.424037 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-fc626e78-c0e7-40cf-a7ad-f752a963e52f tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:06.425288 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-fc626e78-c0e7-40cf-a7ad-f752a963e52f tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8" status: 200 len: 1811 microversion: 2.25 time: 0.707179 Oct 04 18:34:06.440521 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 754/1568] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:05 2022] GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8 => generated 1811 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:06.451118 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-17927be0-7027-4a5d-8a5c-54282dc119a5 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/images/ea702f85-8e85-400a-a6e3-61ce78efff2c" status: 200 len: 1413 microversion: 2.1 time: 0.073225 Oct 04 18:34:06.451995 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 815/1569] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:34:06 2022] GET /compute/v2.1/images/ea702f85-8e85-400a-a6e3-61ce78efff2c => generated 1413 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:06.571669 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-681cb080-3bb9-48a9-bb35-d35b5f4eac65 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:06.572814 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-681cb080-3bb9-48a9-bb35-d35b5f4eac65 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] [instance: ba5fa602-5596-4e3f-a0a4-7c88dc89cd16] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:06.585855 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-681cb080-3bb9-48a9-bb35-d35b5f4eac65 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:06.586583 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-681cb080-3bb9-48a9-bb35-d35b5f4eac65 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:06.587200 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-681cb080-3bb9-48a9-bb35-d35b5f4eac65 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:06.588287 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-681cb080-3bb9-48a9-bb35-d35b5f4eac65 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:06.589404 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-681cb080-3bb9-48a9-bb35-d35b5f4eac65 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:06.590054 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-681cb080-3bb9-48a9-bb35-d35b5f4eac65 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:06.645644 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-681cb080-3bb9-48a9-bb35-d35b5f4eac65 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:06.646823 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-681cb080-3bb9-48a9-bb35-d35b5f4eac65 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:06.648265 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-681cb080-3bb9-48a9-bb35-d35b5f4eac65 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:06.648265 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-681cb080-3bb9-48a9-bb35-d35b5f4eac65 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lazy-loading 'fault' on Instance uuid ba5fa602-5596-4e3f-a0a4-7c88dc89cd16 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:34:06.650052 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:06.707800 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-681cb080-3bb9-48a9-bb35-d35b5f4eac65 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6ff8f5b6c58416b82eb6765a209b344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064cbc5ef6a4f5c9df672a3b8668040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:06.724915 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-681cb080-3bb9-48a9-bb35-d35b5f4eac65 tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] 10.222.0.20 "GET /compute/v2.1/servers/ba5fa602-5596-4e3f-a0a4-7c88dc89cd16" status: 200 len: 1309 microversion: 2.1 time: 0.157189 Oct 04 18:34:06.740020 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 755/1570] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:06 2022] GET /compute/v2.1/servers/ba5fa602-5596-4e3f-a0a4-7c88dc89cd16 => generated 1309 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:06.747214 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-57259156-cd3a-4f92-b62b-b2d1b118f8b8 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:06.747369 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-57259156-cd3a-4f92-b62b-b2d1b118f8b8 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] [instance: d3abc28f-8361-4906-a085-1440991c298f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:06.819447 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-57259156-cd3a-4f92-b62b-b2d1b118f8b8 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44cc98e07d134a15b0fbf2b80bd25ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e0b0088d8476bbcb4c83783fec0e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:06.831518 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-57259156-cd3a-4f92-b62b-b2d1b118f8b8 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] 10.222.0.20 "GET /compute/v2.1/servers/d3abc28f-8361-4906-a085-1440991c298f" status: 200 len: 1218 microversion: 2.1 time: 0.111494 Oct 04 18:34:06.834494 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 816/1571] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:06 2022] GET /compute/v2.1/servers/d3abc28f-8361-4906-a085-1440991c298f => generated 1218 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:06.891535 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-0c5299ac-81ed-4b23-aabd-feb7aafbdbe3 req-7533ea39-7bd2-4386-ab52-d675ad0b2c63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b219d988-2847-45a0-a3b8-af54cf1a43f8", "tag": "581c676f-096d-4159-ae53-d455ac141b32"}, {"server_uuid": "7a384d42-782c-49ac-ad60-e98cf5924e92", "name": "network-vif-deleted", "tag": "32162a47-baaf-47bb-89d8-931b66187f65"}, {"server_uuid": "7fd2a976-0bed-40c2-ba69-a88e8541db48", "name": "network-vif-deleted", "tag": "480deffd-886a-4376-bd61-3b97bf1b5aa3"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:06.909071 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-0c5299ac-81ed-4b23-aabd-feb7aafbdbe3 req-7533ea39-7bd2-4386-ab52-d675ad0b2c63 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:06.913519 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-0c5299ac-81ed-4b23-aabd-feb7aafbdbe3 req-7533ea39-7bd2-4386-ab52-d675ad0b2c63 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:06.915977 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-0c5299ac-81ed-4b23-aabd-feb7aafbdbe3 req-7533ea39-7bd2-4386-ab52-d675ad0b2c63 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:06.942453 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-0c5299ac-81ed-4b23-aabd-feb7aafbdbe3 req-7533ea39-7bd2-4386-ab52-d675ad0b2c63 service nova] Creating event network-changed:581c676f-096d-4159-ae53-d455ac141b32 for instance b219d988-2847-45a0-a3b8-af54cf1a43f8 on n-h1-850501-14 Oct 04 18:34:06.943523 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-0c5299ac-81ed-4b23-aabd-feb7aafbdbe3 req-7533ea39-7bd2-4386-ab52-d675ad0b2c63 service nova] Creating event network-vif-deleted:32162a47-baaf-47bb-89d8-931b66187f65 for instance 7a384d42-782c-49ac-ad60-e98cf5924e92 on n-h1-850501-14 Oct 04 18:34:06.944270 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-0c5299ac-81ed-4b23-aabd-feb7aafbdbe3 req-7533ea39-7bd2-4386-ab52-d675ad0b2c63 service nova] Creating event network-vif-deleted:480deffd-886a-4376-bd61-3b97bf1b5aa3 for instance 7fd2a976-0bed-40c2-ba69-a88e8541db48 on n-h1-850501-14 Oct 04 18:34:06.953822 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-0c5299ac-81ed-4b23-aabd-feb7aafbdbe3 req-7533ea39-7bd2-4386-ab52-d675ad0b2c63 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 521 microversion: 2.1 time: 0.067417 Oct 04 18:34:06.957590 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 756/1572] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:34:06 2022] POST /compute/v2.1/os-server-external-events => generated 521 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:34:07.042781 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-74c66854-e0c3-4356-9a5d-bb7794232191 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:07.043898 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-74c66854-e0c3-4356-9a5d-bb7794232191 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] [instance: 158e9f52-fd16-48d1-87b5-e0dd523e97a4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:07.051892 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-74c66854-e0c3-4356-9a5d-bb7794232191 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:07.052737 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-74c66854-e0c3-4356-9a5d-bb7794232191 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:07.053447 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-74c66854-e0c3-4356-9a5d-bb7794232191 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:07.054454 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-74c66854-e0c3-4356-9a5d-bb7794232191 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:07.055070 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-74c66854-e0c3-4356-9a5d-bb7794232191 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:07.055655 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-74c66854-e0c3-4356-9a5d-bb7794232191 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:07.328899 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-74c66854-e0c3-4356-9a5d-bb7794232191 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4" status: 200 len: 1862 microversion: 2.1 time: 0.290075 Oct 04 18:34:07.332544 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 817/1573] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:07 2022] GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4 => generated 1862 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:07.365374 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-19867a07-5e6d-4156-95e1-59505a14dde7 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-850501-14", "block_migration": true, "disk_over_commit": false}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:07.367941 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-19867a07-5e6d-4156-95e1-59505a14dde7 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] [instance: 158e9f52-fd16-48d1-87b5-e0dd523e97a4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:07.389497 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-19867a07-5e6d-4156-95e1-59505a14dde7 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:07.390000 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-19867a07-5e6d-4156-95e1-59505a14dde7 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:07.390443 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-19867a07-5e6d-4156-95e1-59505a14dde7 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:07.391165 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-19867a07-5e6d-4156-95e1-59505a14dde7 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:07.391642 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-19867a07-5e6d-4156-95e1-59505a14dde7 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:07.392077 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-19867a07-5e6d-4156-95e1-59505a14dde7 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:07.392737 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0b0c7145-5e23-4bb7-b2ac-7f97da25519f tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:07.394110 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0b0c7145-5e23-4bb7-b2ac-7f97da25519f tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:07.420224 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0b0c7145-5e23-4bb7-b2ac-7f97da25519f tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:07.424726 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0b0c7145-5e23-4bb7-b2ac-7f97da25519f tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:07.425187 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0b0c7145-5e23-4bb7-b2ac-7f97da25519f tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:07.432719 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0b0c7145-5e23-4bb7-b2ac-7f97da25519f tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:07.433418 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0b0c7145-5e23-4bb7-b2ac-7f97da25519f tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:07.443480 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0b0c7145-5e23-4bb7-b2ac-7f97da25519f tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:07.476075 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-19867a07-5e6d-4156-95e1-59505a14dde7 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lazy-loading 'flavor' on Instance uuid 158e9f52-fd16-48d1-87b5-e0dd523e97a4 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:34:07.515223 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-19867a07-5e6d-4156-95e1-59505a14dde7 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] [instance: 158e9f52-fd16-48d1-87b5-e0dd523e97a4] Going to try to live migrate instance to n-h2-850501-14 {{(pid=123001) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 18:34:07.563354 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0b0c7145-5e23-4bb7-b2ac-7f97da25519f tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:07.573935 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0b0c7145-5e23-4bb7-b2ac-7f97da25519f tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:07.575616 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0b0c7145-5e23-4bb7-b2ac-7f97da25519f tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:07.585265 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0b0c7145-5e23-4bb7-b2ac-7f97da25519f tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1538 microversion: 2.91 time: 0.207867 Oct 04 18:34:07.586027 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 818/1574] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:07 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1538 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:07.590871 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1552b79c-0b1e-4cb0-8e84-ac587723b47e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:07.591769 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1552b79c-0b1e-4cb0-8e84-ac587723b47e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: b219d988-2847-45a0-a3b8-af54cf1a43f8] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:07.597259 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:07.599206 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1552b79c-0b1e-4cb0-8e84-ac587723b47e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:07.599944 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1552b79c-0b1e-4cb0-8e84-ac587723b47e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:07.600718 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1552b79c-0b1e-4cb0-8e84-ac587723b47e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:07.601744 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1552b79c-0b1e-4cb0-8e84-ac587723b47e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:07.602449 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1552b79c-0b1e-4cb0-8e84-ac587723b47e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:07.603104 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1552b79c-0b1e-4cb0-8e84-ac587723b47e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:07.787296 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1552b79c-0b1e-4cb0-8e84-ac587723b47e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:07.799411 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1552b79c-0b1e-4cb0-8e84-ac587723b47e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:07.801676 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1552b79c-0b1e-4cb0-8e84-ac587723b47e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:07.802969 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1552b79c-0b1e-4cb0-8e84-ac587723b47e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8" status: 200 len: 1811 microversion: 2.25 time: 0.215807 Oct 04 18:34:07.803526 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 819/1575] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:07 2022] GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8 => generated 1811 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:07.817462 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5fe79830-a0cc-4800-af2b-6edfcf47fb2a tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '.version_select at 0x7fe25d107ca0>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:07.869528 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5fe79830-a0cc-4800-af2b-6edfcf47fb2a tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/images/ea702f85-8e85-400a-a6e3-61ce78efff2c" status: 200 len: 1413 microversion: 2.1 time: 0.056251 Oct 04 18:34:07.870222 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 820/1576] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:34:07 2022] GET /compute/v2.1/images/ea702f85-8e85-400a-a6e3-61ce78efff2c => generated 1413 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:07.888322 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2bac75a2-d224-43c3-a4a0-135af5b79e59 tempest-UnshelveToHostMultiNodesTest-409522397 tempest-UnshelveToHostMultiNodesTest-409522397-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h2-850501-14"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:07.890689 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2bac75a2-d224-43c3-a4a0-135af5b79e59 tempest-UnshelveToHostMultiNodesTest-409522397 tempest-UnshelveToHostMultiNodesTest-409522397-project-admin] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:07.897981 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2bac75a2-d224-43c3-a4a0-135af5b79e59 tempest-UnshelveToHostMultiNodesTest-409522397 tempest-UnshelveToHostMultiNodesTest-409522397-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:07.900325 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2bac75a2-d224-43c3-a4a0-135af5b79e59 tempest-UnshelveToHostMultiNodesTest-409522397 tempest-UnshelveToHostMultiNodesTest-409522397-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:07.900325 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2bac75a2-d224-43c3-a4a0-135af5b79e59 tempest-UnshelveToHostMultiNodesTest-409522397 tempest-UnshelveToHostMultiNodesTest-409522397-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:07.917542 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2bac75a2-d224-43c3-a4a0-135af5b79e59 tempest-UnshelveToHostMultiNodesTest-409522397 tempest-UnshelveToHostMultiNodesTest-409522397-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:07.922961 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2bac75a2-d224-43c3-a4a0-135af5b79e59 tempest-UnshelveToHostMultiNodesTest-409522397 tempest-UnshelveToHostMultiNodesTest-409522397-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:07.923990 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2bac75a2-d224-43c3-a4a0-135af5b79e59 tempest-UnshelveToHostMultiNodesTest-409522397 tempest-UnshelveToHostMultiNodesTest-409522397-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:08.021667 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2bac75a2-d224-43c3-a4a0-135af5b79e59 tempest-UnshelveToHostMultiNodesTest-409522397 tempest-UnshelveToHostMultiNodesTest-409522397-project-admin] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h2-850501-14". {{(pid=123002) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 18:34:08.367753 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2bac75a2-d224-43c3-a4a0-135af5b79e59 tempest-UnshelveToHostMultiNodesTest-409522397 tempest-UnshelveToHostMultiNodesTest-409522397-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9/action" status: 202 len: 0 microversion: 2.91 time: 0.488646 Oct 04 18:34:08.372813 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 821/1577] 10.222.0.20 () {62 vars in 1319 bytes} [Tue Oct 4 18:34:07 2022] POST /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9/action => generated 0 bytes in 502 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:34:08.379391 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-91d653ad-bca0-4bf6-acd9-1b058f7746be tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:08.380500 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-91d653ad-bca0-4bf6-acd9-1b058f7746be tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] [instance: ba5fa602-5596-4e3f-a0a4-7c88dc89cd16] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:08.388216 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-91d653ad-bca0-4bf6-acd9-1b058f7746be tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:08.388959 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-91d653ad-bca0-4bf6-acd9-1b058f7746be tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:08.389624 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-91d653ad-bca0-4bf6-acd9-1b058f7746be tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:08.390564 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-91d653ad-bca0-4bf6-acd9-1b058f7746be tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:08.391247 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-91d653ad-bca0-4bf6-acd9-1b058f7746be tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:08.391880 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-91d653ad-bca0-4bf6-acd9-1b058f7746be tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:08.413930 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-91d653ad-bca0-4bf6-acd9-1b058f7746be tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] HTTP exception thrown: Instance ba5fa602-5596-4e3f-a0a4-7c88dc89cd16 could not be found. Oct 04 18:34:08.416749 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-91d653ad-bca0-4bf6-acd9-1b058f7746be tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Request method failure captured: Oct 04 18:34:08.416749 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/ba5fa602-5596-4e3f-a0a4-7c88dc89cd16 HTTP/1.1 Oct 04 18:34:08.416749 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:34:08.416749 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:34:08.416749 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:34:08.416749 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:34:08.416749 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:34:08.416749 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:34:08.416749 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:34:08.416749 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:34:08.416749 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPHxbPrTvWqlyTT9hFmfszq1ydDFQZsMDWY7rXVMeS6tJHCRELbJJpHVzl2tvI64HUw7bzHlwkod0V8ZXMxHoC3rIa5AY1_8QPNuxQZYKMlVnVtqbrl6zmKS5CEdAviynIUpt3iO7a6RvbNFSffxF8Br20zZAjsF6UxH6qTcQVJCLHC0 Oct 04 18:34:08.416749 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:34:08.416749 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:34:08.416749 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:34:08.416749 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:34:08.416749 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:34:08.416749 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:34:08.416749 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 8064cbc5ef6a4f5c9df672a3b8668040 Oct 04 18:34:08.416749 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-LiveMigrationNegativeTest-834824199 Oct 04 18:34:08.416749 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:34:08.416749 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:34:08.416749 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8064cbc5ef6a4f5c9df672a3b8668040"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8064cbc5ef6a4f5c9df672a3b8668040", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8064cbc5ef6a4f5c9df672a3b8668040"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8064cbc5ef6a4f5c9df672a3b8668040"}]}] Oct 04 18:34:08.416749 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-LiveMigrationNegativeTest-834824199 Oct 04 18:34:08.416749 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 8064cbc5ef6a4f5c9df672a3b8668040 Oct 04 18:34:08.416749 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-834824199 Oct 04 18:34:08.416749 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-LiveMigrationNegativeTest-834824199-project Oct 04 18:34:08.416749 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:34:08.416749 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:34:08.416749 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: e6ff8f5b6c58416b82eb6765a209b344 Oct 04 18:34:08.416749 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-LiveMigrationNegativeTest-834824199-project Oct 04 18:34:08.416749 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:34:08.416749 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance ba5fa602-5596-4e3f-a0a4-7c88dc89cd16 could not be found. Oct 04 18:34:08.416749 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'ba5fa602-5596-4e3f-a0a4-7c88dc89cd16'} Oct 04 18:34:08.416749 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:34:08.416749 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:08.416749 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:34:08.416749 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:34:08.416749 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:34:08.416749 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:34:08.416749 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:34:08.416749 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:34:08.416749 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:34:08.416749 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:34:08.416749 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba5fa602-5596-4e3f-a0a4-7c88dc89cd16 could not be found. Oct 04 18:34:08.416749 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:34:08.416749 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:08.416749 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:34:08.416749 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:08.416749 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:08.416749 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:08.416749 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:34:08.416749 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:34:08.416749 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:34:08.416749 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:34:08.416749 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:34:08.416749 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:34:08.416749 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:34:08.416749 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:34:08.416749 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:34:08.416749 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:34:08.416749 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba5fa602-5596-4e3f-a0a4-7c88dc89cd16 could not be found. Oct 04 18:34:08.416749 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:34:08.416749 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:08.416749 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:34:08.428090 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:08.428090 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:08.428090 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:08.428090 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:34:08.428090 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:34:08.428090 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba5fa602-5596-4e3f-a0a4-7c88dc89cd16 could not be found. Oct 04 18:34:08.428090 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:34:08.428090 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-91d653ad-bca0-4bf6-acd9-1b058f7746be tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] Returning 404 to user: Instance ba5fa602-5596-4e3f-a0a4-7c88dc89cd16 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:34:08.428090 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-91d653ad-bca0-4bf6-acd9-1b058f7746be tempest-LiveMigrationNegativeTest-834824199 tempest-LiveMigrationNegativeTest-834824199-project] 10.222.0.20 "GET /compute/v2.1/servers/ba5fa602-5596-4e3f-a0a4-7c88dc89cd16" status: 404 len: 111 microversion: 2.1 time: 0.048323 Oct 04 18:34:08.429552 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 822/1578] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:08 2022] GET /compute/v2.1/servers/ba5fa602-5596-4e3f-a0a4-7c88dc89cd16 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:34:08.450527 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a86e8f04-1eec-48af-9107-e627569e6095 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:08.453902 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a86e8f04-1eec-48af-9107-e627569e6095 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] [instance: d3abc28f-8361-4906-a085-1440991c298f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:08.467756 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a86e8f04-1eec-48af-9107-e627569e6095 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:08.468521 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a86e8f04-1eec-48af-9107-e627569e6095 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:08.469206 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a86e8f04-1eec-48af-9107-e627569e6095 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:08.470157 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a86e8f04-1eec-48af-9107-e627569e6095 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:08.470920 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a86e8f04-1eec-48af-9107-e627569e6095 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:08.471561 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a86e8f04-1eec-48af-9107-e627569e6095 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:08.558294 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a86e8f04-1eec-48af-9107-e627569e6095 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44cc98e07d134a15b0fbf2b80bd25ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e0b0088d8476bbcb4c83783fec0e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:08.573441 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a86e8f04-1eec-48af-9107-e627569e6095 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] 10.222.0.20 "GET /compute/v2.1/servers/d3abc28f-8361-4906-a085-1440991c298f" status: 200 len: 1214 microversion: 2.1 time: 0.142459 Oct 04 18:34:08.584488 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 823/1579] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:08 2022] GET /compute/v2.1/servers/d3abc28f-8361-4906-a085-1440991c298f => generated 1214 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:08.593185 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ab8f2f96-10a6-48a9-8bf5-e5f4eda91029 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:08.593932 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ab8f2f96-10a6-48a9-8bf5-e5f4eda91029 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:08.602066 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ab8f2f96-10a6-48a9-8bf5-e5f4eda91029 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:08.603623 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ab8f2f96-10a6-48a9-8bf5-e5f4eda91029 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:08.604203 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ab8f2f96-10a6-48a9-8bf5-e5f4eda91029 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:08.605151 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ab8f2f96-10a6-48a9-8bf5-e5f4eda91029 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:08.605449 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ab8f2f96-10a6-48a9-8bf5-e5f4eda91029 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:08.606187 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ab8f2f96-10a6-48a9-8bf5-e5f4eda91029 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:08.699328 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ab8f2f96-10a6-48a9-8bf5-e5f4eda91029 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:08.725625 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ab8f2f96-10a6-48a9-8bf5-e5f4eda91029 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:08.729876 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ab8f2f96-10a6-48a9-8bf5-e5f4eda91029 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:08.739373 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ab8f2f96-10a6-48a9-8bf5-e5f4eda91029 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1486 microversion: 2.91 time: 0.152059 Oct 04 18:34:08.741526 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 824/1580] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:08 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1486 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:08.835022 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9afe071c-790c-4e28-88dd-56e813204fa0 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:08.835955 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9afe071c-790c-4e28-88dd-56e813204fa0 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: b219d988-2847-45a0-a3b8-af54cf1a43f8] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:08.846023 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9afe071c-790c-4e28-88dd-56e813204fa0 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:08.847019 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9afe071c-790c-4e28-88dd-56e813204fa0 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:08.848318 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9afe071c-790c-4e28-88dd-56e813204fa0 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:08.849723 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9afe071c-790c-4e28-88dd-56e813204fa0 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:08.850534 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9afe071c-790c-4e28-88dd-56e813204fa0 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:08.851255 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9afe071c-790c-4e28-88dd-56e813204fa0 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:09.058434 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9afe071c-790c-4e28-88dd-56e813204fa0 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:09.071220 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9afe071c-790c-4e28-88dd-56e813204fa0 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:09.074388 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9afe071c-790c-4e28-88dd-56e813204fa0 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:09.075829 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9afe071c-790c-4e28-88dd-56e813204fa0 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8" status: 200 len: 1811 microversion: 2.25 time: 0.248408 Oct 04 18:34:09.077042 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 825/1581] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:08 2022] GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8 => generated 1811 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:09.084346 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b953958a-017f-46bf-981d-16c36fe59e00 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '.version_select at 0x7fe258ce0b80>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:09.166191 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b953958a-017f-46bf-981d-16c36fe59e00 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/images/ea702f85-8e85-400a-a6e3-61ce78efff2c" status: 200 len: 1413 microversion: 2.1 time: 0.087481 Oct 04 18:34:09.167998 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 826/1582] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:34:09 2022] GET /compute/v2.1/images/ea702f85-8e85-400a-a6e3-61ce78efff2c => generated 1413 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:09.608231 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f9a360ad-6512-4cae-8140-7468b31c3128 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:09.608992 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f9a360ad-6512-4cae-8140-7468b31c3128 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] [instance: d3abc28f-8361-4906-a085-1440991c298f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:09.616839 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f9a360ad-6512-4cae-8140-7468b31c3128 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:09.617402 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f9a360ad-6512-4cae-8140-7468b31c3128 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:09.617960 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f9a360ad-6512-4cae-8140-7468b31c3128 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:09.618729 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f9a360ad-6512-4cae-8140-7468b31c3128 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:09.619241 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f9a360ad-6512-4cae-8140-7468b31c3128 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:09.619794 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f9a360ad-6512-4cae-8140-7468b31c3128 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:09.700544 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f9a360ad-6512-4cae-8140-7468b31c3128 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44cc98e07d134a15b0fbf2b80bd25ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e0b0088d8476bbcb4c83783fec0e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:09.700544 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f9a360ad-6512-4cae-8140-7468b31c3128 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] 10.222.0.20 "GET /compute/v2.1/servers/d3abc28f-8361-4906-a085-1440991c298f" status: 200 len: 1214 microversion: 2.1 time: 0.096714 Oct 04 18:34:09.700544 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 827/1583] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:09 2022] GET /compute/v2.1/servers/d3abc28f-8361-4906-a085-1440991c298f => generated 1214 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:09.770834 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d880f44b-de6c-4e3d-86f3-c20276048ff7 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:09.771445 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d880f44b-de6c-4e3d-86f3-c20276048ff7 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:09.787560 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d880f44b-de6c-4e3d-86f3-c20276048ff7 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:09.788152 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d880f44b-de6c-4e3d-86f3-c20276048ff7 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:09.788615 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d880f44b-de6c-4e3d-86f3-c20276048ff7 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:09.789379 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d880f44b-de6c-4e3d-86f3-c20276048ff7 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:09.789887 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d880f44b-de6c-4e3d-86f3-c20276048ff7 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:09.790314 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d880f44b-de6c-4e3d-86f3-c20276048ff7 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:09.857903 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d880f44b-de6c-4e3d-86f3-c20276048ff7 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:09.866930 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d880f44b-de6c-4e3d-86f3-c20276048ff7 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:09.868439 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d880f44b-de6c-4e3d-86f3-c20276048ff7 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:09.873390 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d880f44b-de6c-4e3d-86f3-c20276048ff7 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1486 microversion: 2.91 time: 0.107000 Oct 04 18:34:09.873951 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 828/1584] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:09 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1486 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:34:10.108668 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9315f3df-db99-4f79-b1b5-237b155fe766 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:10.110081 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9315f3df-db99-4f79-b1b5-237b155fe766 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: b219d988-2847-45a0-a3b8-af54cf1a43f8] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:10.129072 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9315f3df-db99-4f79-b1b5-237b155fe766 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:10.129673 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9315f3df-db99-4f79-b1b5-237b155fe766 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:10.130119 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9315f3df-db99-4f79-b1b5-237b155fe766 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:10.130922 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9315f3df-db99-4f79-b1b5-237b155fe766 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:10.131301 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9315f3df-db99-4f79-b1b5-237b155fe766 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:10.131682 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9315f3df-db99-4f79-b1b5-237b155fe766 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:10.344974 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9315f3df-db99-4f79-b1b5-237b155fe766 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:10.367100 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9315f3df-db99-4f79-b1b5-237b155fe766 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:10.373046 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9315f3df-db99-4f79-b1b5-237b155fe766 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:10.374646 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9315f3df-db99-4f79-b1b5-237b155fe766 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8" status: 200 len: 1811 microversion: 2.25 time: 0.271728 Oct 04 18:34:10.379722 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 829/1585] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:10 2022] GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8 => generated 1811 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:34:10.399463 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2fd9aabe-b5e2-4d4c-b7a1-03913d96895b tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '.version_select at 0x7fe25d157670>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:10.474793 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2fd9aabe-b5e2-4d4c-b7a1-03913d96895b tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/images/ea702f85-8e85-400a-a6e3-61ce78efff2c" status: 200 len: 1413 microversion: 2.1 time: 0.093172 Oct 04 18:34:10.483714 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 830/1586] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:34:10 2022] GET /compute/v2.1/images/ea702f85-8e85-400a-a6e3-61ce78efff2c => generated 1413 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:10.726259 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-45af0aec-fc92-4dd2-8507-f3f87e2fce05 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:10.727473 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-45af0aec-fc92-4dd2-8507-f3f87e2fce05 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] [instance: d3abc28f-8361-4906-a085-1440991c298f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:10.734795 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-45af0aec-fc92-4dd2-8507-f3f87e2fce05 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:10.735578 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-45af0aec-fc92-4dd2-8507-f3f87e2fce05 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:10.736009 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-45af0aec-fc92-4dd2-8507-f3f87e2fce05 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:10.736741 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-45af0aec-fc92-4dd2-8507-f3f87e2fce05 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:10.737194 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-45af0aec-fc92-4dd2-8507-f3f87e2fce05 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:10.737617 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-45af0aec-fc92-4dd2-8507-f3f87e2fce05 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:10.861140 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-45af0aec-fc92-4dd2-8507-f3f87e2fce05 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44cc98e07d134a15b0fbf2b80bd25ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e0b0088d8476bbcb4c83783fec0e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:10.886753 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-45af0aec-fc92-4dd2-8507-f3f87e2fce05 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] 10.222.0.20 "GET /compute/v2.1/servers/d3abc28f-8361-4906-a085-1440991c298f" status: 200 len: 1270 microversion: 2.1 time: 0.162839 Oct 04 18:34:10.887866 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 831/1587] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:10 2022] GET /compute/v2.1/servers/d3abc28f-8361-4906-a085-1440991c298f => generated 1270 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:34:10.902276 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-733d5a41-2411-47df-aad7-bcc874adc740 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:10.904019 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-733d5a41-2411-47df-aad7-bcc874adc740 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:10.910164 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-733d5a41-2411-47df-aad7-bcc874adc740 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:10.910882 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-733d5a41-2411-47df-aad7-bcc874adc740 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:10.911577 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-733d5a41-2411-47df-aad7-bcc874adc740 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:10.912402 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-733d5a41-2411-47df-aad7-bcc874adc740 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:10.913006 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-733d5a41-2411-47df-aad7-bcc874adc740 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:10.913614 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-733d5a41-2411-47df-aad7-bcc874adc740 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:10.989031 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-733d5a41-2411-47df-aad7-bcc874adc740 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:10.998226 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-733d5a41-2411-47df-aad7-bcc874adc740 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:11.004192 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-733d5a41-2411-47df-aad7-bcc874adc740 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:11.010243 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-733d5a41-2411-47df-aad7-bcc874adc740 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1488 microversion: 2.91 time: 0.112296 Oct 04 18:34:11.025326 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 832/1588] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:10 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1488 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:34:11.408643 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-99e1272d-8149-4e31-90cc-4450960593ae tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:11.409442 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-99e1272d-8149-4e31-90cc-4450960593ae tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: b219d988-2847-45a0-a3b8-af54cf1a43f8] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:11.420868 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-99e1272d-8149-4e31-90cc-4450960593ae tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:11.421443 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-99e1272d-8149-4e31-90cc-4450960593ae tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:11.422007 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-99e1272d-8149-4e31-90cc-4450960593ae tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:11.422832 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-99e1272d-8149-4e31-90cc-4450960593ae tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:11.423535 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-99e1272d-8149-4e31-90cc-4450960593ae tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:11.424197 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-99e1272d-8149-4e31-90cc-4450960593ae tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:11.452486 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:11.850582 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-99e1272d-8149-4e31-90cc-4450960593ae tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:11.866164 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-99e1272d-8149-4e31-90cc-4450960593ae tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:11.871871 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-99e1272d-8149-4e31-90cc-4450960593ae tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:11.871871 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-99e1272d-8149-4e31-90cc-4450960593ae tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8" status: 200 len: 1811 microversion: 2.25 time: 0.465997 Oct 04 18:34:11.871871 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 833/1589] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:11 2022] GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8 => generated 1811 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:11.885146 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-272462d7-6fd6-4ab8-852e-19c8f0c8d236 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '.version_select at 0x7fe25d1318b0>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:12.006826 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-272462d7-6fd6-4ab8-852e-19c8f0c8d236 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/images/ea702f85-8e85-400a-a6e3-61ce78efff2c" status: 200 len: 1413 microversion: 2.1 time: 0.135866 Oct 04 18:34:12.022197 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 834/1590] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:34:11 2022] GET /compute/v2.1/images/ea702f85-8e85-400a-a6e3-61ce78efff2c => generated 1413 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:12.026173 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-fd8cfd7c-d527-480a-acd5-c1527aca97b3 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:12.027025 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-fd8cfd7c-d527-480a-acd5-c1527aca97b3 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] [instance: d3abc28f-8361-4906-a085-1440991c298f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:12.042300 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-19867a07-5e6d-4156-95e1-59505a14dde7 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4/action" status: 202 len: 0 microversion: 2.1 time: 4.688215 Oct 04 18:34:12.043685 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 757/1591] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:34:07 2022] POST /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4/action => generated 0 bytes in 4690 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:34:12.048555 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fd8cfd7c-d527-480a-acd5-c1527aca97b3 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:12.049099 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e371d9c6-ee02-4f56-ab38-76d9f276abf6 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:12.049719 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e371d9c6-ee02-4f56-ab38-76d9f276abf6 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:12.051676 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fd8cfd7c-d527-480a-acd5-c1527aca97b3 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:12.052685 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fd8cfd7c-d527-480a-acd5-c1527aca97b3 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:12.053442 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fd8cfd7c-d527-480a-acd5-c1527aca97b3 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:12.053933 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fd8cfd7c-d527-480a-acd5-c1527aca97b3 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:12.054343 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fd8cfd7c-d527-480a-acd5-c1527aca97b3 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:12.068506 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e371d9c6-ee02-4f56-ab38-76d9f276abf6 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:12.069286 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e371d9c6-ee02-4f56-ab38-76d9f276abf6 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:12.074159 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e371d9c6-ee02-4f56-ab38-76d9f276abf6 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:12.075816 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e371d9c6-ee02-4f56-ab38-76d9f276abf6 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:12.076515 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e371d9c6-ee02-4f56-ab38-76d9f276abf6 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:12.079061 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e371d9c6-ee02-4f56-ab38-76d9f276abf6 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:12.244181 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-fd8cfd7c-d527-480a-acd5-c1527aca97b3 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44cc98e07d134a15b0fbf2b80bd25ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e0b0088d8476bbcb4c83783fec0e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:12.266971 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-fd8cfd7c-d527-480a-acd5-c1527aca97b3 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] 10.222.0.20 "GET /compute/v2.1/servers/d3abc28f-8361-4906-a085-1440991c298f" status: 200 len: 1288 microversion: 2.1 time: 0.250707 Oct 04 18:34:12.267546 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 835/1592] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:12 2022] GET /compute/v2.1/servers/d3abc28f-8361-4906-a085-1440991c298f => generated 1288 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:12.280123 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d63d256b-ed1e-44fb-a686-675d806eaf39 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:12.283892 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d63d256b-ed1e-44fb-a686-675d806eaf39 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 158e9f52-fd16-48d1-87b5-e0dd523e97a4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:12.299413 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d63d256b-ed1e-44fb-a686-675d806eaf39 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:12.299919 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d63d256b-ed1e-44fb-a686-675d806eaf39 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:12.300484 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d63d256b-ed1e-44fb-a686-675d806eaf39 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:12.301585 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d63d256b-ed1e-44fb-a686-675d806eaf39 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:12.304407 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d63d256b-ed1e-44fb-a686-675d806eaf39 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:12.308078 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e371d9c6-ee02-4f56-ab38-76d9f276abf6 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:12.318118 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d63d256b-ed1e-44fb-a686-675d806eaf39 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:12.324395 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e371d9c6-ee02-4f56-ab38-76d9f276abf6 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:12.329516 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e371d9c6-ee02-4f56-ab38-76d9f276abf6 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:12.346560 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e371d9c6-ee02-4f56-ab38-76d9f276abf6 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1544 microversion: 2.91 time: 0.301808 Oct 04 18:34:12.352625 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 758/1593] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:12 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1544 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:12.574663 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d63d256b-ed1e-44fb-a686-675d806eaf39 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:12.588247 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d63d256b-ed1e-44fb-a686-675d806eaf39 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4" status: 200 len: 1719 microversion: 2.1 time: 0.319193 Oct 04 18:34:12.592122 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 836/1594] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:12 2022] GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4 => generated 1719 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:12.900132 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-84b25014-0ea7-429f-b783-5ddb45e74109 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:12.900824 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-84b25014-0ea7-429f-b783-5ddb45e74109 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: b219d988-2847-45a0-a3b8-af54cf1a43f8] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:12.912361 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-84b25014-0ea7-429f-b783-5ddb45e74109 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:12.913156 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-84b25014-0ea7-429f-b783-5ddb45e74109 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:12.913780 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-84b25014-0ea7-429f-b783-5ddb45e74109 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:12.914669 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-84b25014-0ea7-429f-b783-5ddb45e74109 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:12.922369 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-84b25014-0ea7-429f-b783-5ddb45e74109 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:12.928383 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-84b25014-0ea7-429f-b783-5ddb45e74109 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:13.039257 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1009e2d7-a68c-4634-83bf-8f73026cc227 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '.version_select at 0x7fe258cc2310>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:13.132404 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1009e2d7-a68c-4634-83bf-8f73026cc227 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/images/ea702f85-8e85-400a-a6e3-61ce78efff2c" status: 200 len: 1413 microversion: 2.1 time: 0.105841 Oct 04 18:34:13.133584 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 837/1595] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:34:13 2022] GET /compute/v2.1/images/ea702f85-8e85-400a-a6e3-61ce78efff2c => generated 1413 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:13.291670 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3581eaaf-d624-4eb4-a7d9-c9daf5d7448a tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:13.292334 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3581eaaf-d624-4eb4-a7d9-c9daf5d7448a tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] [instance: d3abc28f-8361-4906-a085-1440991c298f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:13.304160 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3581eaaf-d624-4eb4-a7d9-c9daf5d7448a tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:13.304160 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3581eaaf-d624-4eb4-a7d9-c9daf5d7448a tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:13.308328 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3581eaaf-d624-4eb4-a7d9-c9daf5d7448a tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:13.310689 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3581eaaf-d624-4eb4-a7d9-c9daf5d7448a tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:13.311195 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3581eaaf-d624-4eb4-a7d9-c9daf5d7448a tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:13.312806 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3581eaaf-d624-4eb4-a7d9-c9daf5d7448a tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:13.318707 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-84b25014-0ea7-429f-b783-5ddb45e74109 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:13.342722 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-84b25014-0ea7-429f-b783-5ddb45e74109 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:13.358663 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-84b25014-0ea7-429f-b783-5ddb45e74109 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:13.360030 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-84b25014-0ea7-429f-b783-5ddb45e74109 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8" status: 200 len: 1811 microversion: 2.25 time: 0.464928 Oct 04 18:34:13.360643 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 759/1596] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:12 2022] GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8 => generated 1811 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:13.388198 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3ad5b0bf-6aed-4a7d-b7b7-f8ebbf5f4487 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:13.391037 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3ad5b0bf-6aed-4a7d-b7b7-f8ebbf5f4487 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:13.411516 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3ad5b0bf-6aed-4a7d-b7b7-f8ebbf5f4487 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:13.413429 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3ad5b0bf-6aed-4a7d-b7b7-f8ebbf5f4487 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:13.414477 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3ad5b0bf-6aed-4a7d-b7b7-f8ebbf5f4487 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:13.415434 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3ad5b0bf-6aed-4a7d-b7b7-f8ebbf5f4487 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:13.416495 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3ad5b0bf-6aed-4a7d-b7b7-f8ebbf5f4487 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:13.417324 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3ad5b0bf-6aed-4a7d-b7b7-f8ebbf5f4487 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:13.529014 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3581eaaf-d624-4eb4-a7d9-c9daf5d7448a tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44cc98e07d134a15b0fbf2b80bd25ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e0b0088d8476bbcb4c83783fec0e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:13.538805 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3581eaaf-d624-4eb4-a7d9-c9daf5d7448a tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] 10.222.0.20 "GET /compute/v2.1/servers/d3abc28f-8361-4906-a085-1440991c298f" status: 200 len: 1276 microversion: 2.1 time: 0.251357 Oct 04 18:34:13.565693 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 838/1597] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:13 2022] GET /compute/v2.1/servers/d3abc28f-8361-4906-a085-1440991c298f => generated 1276 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:34:13.614754 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3ad5b0bf-6aed-4a7d-b7b7-f8ebbf5f4487 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:13.627595 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3ad5b0bf-6aed-4a7d-b7b7-f8ebbf5f4487 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:13.631441 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3ad5b0bf-6aed-4a7d-b7b7-f8ebbf5f4487 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:13.646240 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3ad5b0bf-6aed-4a7d-b7b7-f8ebbf5f4487 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1544 microversion: 2.91 time: 0.269696 Oct 04 18:34:13.648085 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 760/1598] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:13 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1544 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:13.684700 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-32eb872f-a71f-4e26-a2d7-6c15a8bb01e8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:13.684700 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-32eb872f-a71f-4e26-a2d7-6c15a8bb01e8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 158e9f52-fd16-48d1-87b5-e0dd523e97a4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:13.691934 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-32eb872f-a71f-4e26-a2d7-6c15a8bb01e8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:13.692481 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-32eb872f-a71f-4e26-a2d7-6c15a8bb01e8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:13.692926 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-32eb872f-a71f-4e26-a2d7-6c15a8bb01e8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:13.693648 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-32eb872f-a71f-4e26-a2d7-6c15a8bb01e8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:13.694107 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-32eb872f-a71f-4e26-a2d7-6c15a8bb01e8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:13.694539 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-32eb872f-a71f-4e26-a2d7-6c15a8bb01e8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:14.013924 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-32eb872f-a71f-4e26-a2d7-6c15a8bb01e8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:14.037034 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-32eb872f-a71f-4e26-a2d7-6c15a8bb01e8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4" status: 200 len: 1719 microversion: 2.1 time: 0.362671 Oct 04 18:34:14.040586 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 839/1599] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:13 2022] GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4 => generated 1719 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:14.149111 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5a0e5d24-e933-47e6-895f-08164cea9f9b tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '.version_select at 0x7fe258c54280>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:14.222492 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-4bca5d29-683c-42c8-91ce-ef48646711b4 req-f1db5850-830c-4dd5-b031-41d97d5df9b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "859d2a18-b7eb-457b-a4e3-7d3b5fb80137", "tag": "605c1b20-b6e3-41bd-9506-756a56c042bd"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:14.264588 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-4bca5d29-683c-42c8-91ce-ef48646711b4 req-f1db5850-830c-4dd5-b031-41d97d5df9b0 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:14.271016 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-4bca5d29-683c-42c8-91ce-ef48646711b4 req-f1db5850-830c-4dd5-b031-41d97d5df9b0 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:14.271710 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-4bca5d29-683c-42c8-91ce-ef48646711b4 req-f1db5850-830c-4dd5-b031-41d97d5df9b0 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:14.317705 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-4bca5d29-683c-42c8-91ce-ef48646711b4 req-f1db5850-830c-4dd5-b031-41d97d5df9b0 service nova] Creating event network-changed:605c1b20-b6e3-41bd-9506-756a56c042bd for instance 859d2a18-b7eb-457b-a4e3-7d3b5fb80137 on n-h2-850501-14 Oct 04 18:34:14.328527 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-4bca5d29-683c-42c8-91ce-ef48646711b4 req-f1db5850-830c-4dd5-b031-41d97d5df9b0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112314 Oct 04 18:34:14.333174 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 840/1600] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:34:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:34:14.391586 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-24704e5d-6532-4f9d-b2f4-2da081fcafb4 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:14.393851 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-24704e5d-6532-4f9d-b2f4-2da081fcafb4 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: b219d988-2847-45a0-a3b8-af54cf1a43f8] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:14.408168 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-24704e5d-6532-4f9d-b2f4-2da081fcafb4 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:14.411681 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-24704e5d-6532-4f9d-b2f4-2da081fcafb4 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:14.412410 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-24704e5d-6532-4f9d-b2f4-2da081fcafb4 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:14.420307 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-24704e5d-6532-4f9d-b2f4-2da081fcafb4 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:14.420307 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-24704e5d-6532-4f9d-b2f4-2da081fcafb4 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:14.420307 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-24704e5d-6532-4f9d-b2f4-2da081fcafb4 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:14.761212 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-24704e5d-6532-4f9d-b2f4-2da081fcafb4 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:14.774832 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-24704e5d-6532-4f9d-b2f4-2da081fcafb4 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:14.776427 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-24704e5d-6532-4f9d-b2f4-2da081fcafb4 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:14.784318 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-24704e5d-6532-4f9d-b2f4-2da081fcafb4 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8" status: 200 len: 1811 microversion: 2.25 time: 0.399116 Oct 04 18:34:14.790871 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 841/1601] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:14 2022] GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8 => generated 1811 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:14.814925 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-aef76644-b976-45fc-920d-79346a386053 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:14.818853 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-aef76644-b976-45fc-920d-79346a386053 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] [instance: d3abc28f-8361-4906-a085-1440991c298f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:14.832075 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aef76644-b976-45fc-920d-79346a386053 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:14.835148 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aef76644-b976-45fc-920d-79346a386053 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:14.837110 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aef76644-b976-45fc-920d-79346a386053 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:14.846463 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aef76644-b976-45fc-920d-79346a386053 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:14.846463 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aef76644-b976-45fc-920d-79346a386053 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:14.846463 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aef76644-b976-45fc-920d-79346a386053 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:15.039961 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=6 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:15.411796 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-aef76644-b976-45fc-920d-79346a386053 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44cc98e07d134a15b0fbf2b80bd25ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e0b0088d8476bbcb4c83783fec0e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:15.411796 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-aef76644-b976-45fc-920d-79346a386053 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] 10.222.0.20 "GET /compute/v2.1/servers/d3abc28f-8361-4906-a085-1440991c298f" status: 200 len: 1318 microversion: 2.1 time: 0.572512 Oct 04 18:34:15.411796 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 842/1602] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:14 2022] GET /compute/v2.1/servers/d3abc28f-8361-4906-a085-1440991c298f => generated 1318 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:15.411796 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a140cca1-a97a-48c7-927d-9a7d729b75e0 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:15.411796 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a140cca1-a97a-48c7-927d-9a7d729b75e0 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:15.411796 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a140cca1-a97a-48c7-927d-9a7d729b75e0 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:15.411796 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a140cca1-a97a-48c7-927d-9a7d729b75e0 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:15.411796 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a140cca1-a97a-48c7-927d-9a7d729b75e0 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:15.411796 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a140cca1-a97a-48c7-927d-9a7d729b75e0 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:15.411796 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a140cca1-a97a-48c7-927d-9a7d729b75e0 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:15.411796 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a140cca1-a97a-48c7-927d-9a7d729b75e0 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:15.510604 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=4 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:15.564472 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a140cca1-a97a-48c7-927d-9a7d729b75e0 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:15.574727 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a140cca1-a97a-48c7-927d-9a7d729b75e0 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:15.582409 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a140cca1-a97a-48c7-927d-9a7d729b75e0 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:15.594161 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a140cca1-a97a-48c7-927d-9a7d729b75e0 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1544 microversion: 2.91 time: 0.212626 Oct 04 18:34:15.596743 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 843/1603] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:15 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1544 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:15.607352 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e507ae7e-cc7d-4198-ac54-b8c1fdc11b48 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:15.616102 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e507ae7e-cc7d-4198-ac54-b8c1fdc11b48 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 158e9f52-fd16-48d1-87b5-e0dd523e97a4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:15.629869 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e507ae7e-cc7d-4198-ac54-b8c1fdc11b48 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:15.636801 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e507ae7e-cc7d-4198-ac54-b8c1fdc11b48 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:15.637670 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e507ae7e-cc7d-4198-ac54-b8c1fdc11b48 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:15.639006 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e507ae7e-cc7d-4198-ac54-b8c1fdc11b48 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:15.639632 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e507ae7e-cc7d-4198-ac54-b8c1fdc11b48 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:15.642422 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e507ae7e-cc7d-4198-ac54-b8c1fdc11b48 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:15.845670 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e507ae7e-cc7d-4198-ac54-b8c1fdc11b48 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:15.855289 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e507ae7e-cc7d-4198-ac54-b8c1fdc11b48 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4" status: 200 len: 1719 microversion: 2.1 time: 0.255716 Oct 04 18:34:15.869345 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 844/1604] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:15 2022] GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4 => generated 1719 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:16.102291 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9623eb87-df6e-4c99-8b74-77b81c02a27c tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-2015356564", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:16.826543 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=4 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:17.549330 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-9623eb87-df6e-4c99-8b74-77b81c02a27c tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] validate_networks() for None {{(pid=123002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:34:17.557927 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5a0e5d24-e933-47e6-895f-08164cea9f9b tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/images/ea702f85-8e85-400a-a6e3-61ce78efff2c" status: 200 len: 1422 microversion: 2.1 time: 3.412679 Oct 04 18:34:17.568723 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 761/1605] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:34:14 2022] GET /compute/v2.1/images/ea702f85-8e85-400a-a6e3-61ce78efff2c => generated 1422 bytes in 3425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:17.574009 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-37bc5d1e-d7dc-4c6d-b0ac-9c4aab191b66 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:17.574864 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-37bc5d1e-d7dc-4c6d-b0ac-9c4aab191b66 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: b219d988-2847-45a0-a3b8-af54cf1a43f8] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:17.583379 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-37bc5d1e-d7dc-4c6d-b0ac-9c4aab191b66 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:17.583895 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-37bc5d1e-d7dc-4c6d-b0ac-9c4aab191b66 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:17.584364 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-37bc5d1e-d7dc-4c6d-b0ac-9c4aab191b66 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:17.585088 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-37bc5d1e-d7dc-4c6d-b0ac-9c4aab191b66 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:17.585775 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-37bc5d1e-d7dc-4c6d-b0ac-9c4aab191b66 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:17.585971 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-37bc5d1e-d7dc-4c6d-b0ac-9c4aab191b66 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:17.816456 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-37bc5d1e-d7dc-4c6d-b0ac-9c4aab191b66 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:17.825315 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-37bc5d1e-d7dc-4c6d-b0ac-9c4aab191b66 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:17.826754 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-37bc5d1e-d7dc-4c6d-b0ac-9c4aab191b66 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:17.827916 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-37bc5d1e-d7dc-4c6d-b0ac-9c4aab191b66 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8" status: 200 len: 1811 microversion: 2.25 time: 0.257907 Oct 04 18:34:17.828511 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 762/1606] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:17 2022] GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8 => generated 1811 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:17.833021 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5853eb61-046e-4add-b471-396cb835f17b tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:17.833617 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5853eb61-046e-4add-b471-396cb835f17b tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] [instance: d3abc28f-8361-4906-a085-1440991c298f] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:17.839467 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5853eb61-046e-4add-b471-396cb835f17b tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:17.839952 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5853eb61-046e-4add-b471-396cb835f17b tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:17.840583 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5853eb61-046e-4add-b471-396cb835f17b tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:17.841274 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5853eb61-046e-4add-b471-396cb835f17b tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:17.841754 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5853eb61-046e-4add-b471-396cb835f17b tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:17.842174 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5853eb61-046e-4add-b471-396cb835f17b tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:17.849952 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-9623eb87-df6e-4c99-8b74-77b81c02a27c tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:34:17.850439 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-9623eb87-df6e-4c99-8b74-77b81c02a27c tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:34:17.850829 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-9623eb87-df6e-4c99-8b74-77b81c02a27c tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:34:17.851233 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-9623eb87-df6e-4c99-8b74-77b81c02a27c tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:34:17.851639 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-9623eb87-df6e-4c99-8b74-77b81c02a27c tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:34:17.860378 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9623eb87-df6e-4c99-8b74-77b81c02a27c tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:17.860855 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9623eb87-df6e-4c99-8b74-77b81c02a27c tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:17.861285 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9623eb87-df6e-4c99-8b74-77b81c02a27c tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:17.862008 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9623eb87-df6e-4c99-8b74-77b81c02a27c tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:17.862455 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9623eb87-df6e-4c99-8b74-77b81c02a27c tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:17.863438 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9623eb87-df6e-4c99-8b74-77b81c02a27c tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:17.881182 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-9623eb87-df6e-4c99-8b74-77b81c02a27c tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Getting quotas for project 552ab59dabe840cb8582c54bedc49b09. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:34:17.885923 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-9623eb87-df6e-4c99-8b74-77b81c02a27c tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Getting quotas for user 9b05d1f8b9014e798926f9c496885a4d and project 552ab59dabe840cb8582c54bedc49b09. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:34:17.898113 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9623eb87-df6e-4c99-8b74-77b81c02a27c tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Going to run 1 instances... {{(pid=123002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:34:17.900435 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9623eb87-df6e-4c99-8b74-77b81c02a27c tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2fe6c508-f183-40bd-bfd5-23c757e99a05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:34:17.981840 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5853eb61-046e-4add-b471-396cb835f17b tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44cc98e07d134a15b0fbf2b80bd25ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e0b0088d8476bbcb4c83783fec0e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:17.990270 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5853eb61-046e-4add-b471-396cb835f17b tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] 10.222.0.20 "GET /compute/v2.1/servers/d3abc28f-8361-4906-a085-1440991c298f" status: 200 len: 1318 microversion: 2.1 time: 0.160744 Oct 04 18:34:17.990878 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 763/1607] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:17 2022] GET /compute/v2.1/servers/d3abc28f-8361-4906-a085-1440991c298f => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:17.996756 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-56b11371-8f39-4988-bebb-ed43a74fae66 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:17.997461 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-56b11371-8f39-4988-bebb-ed43a74fae66 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:18.003983 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-56b11371-8f39-4988-bebb-ed43a74fae66 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:18.004886 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-56b11371-8f39-4988-bebb-ed43a74fae66 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:18.005150 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-56b11371-8f39-4988-bebb-ed43a74fae66 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:18.005939 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-56b11371-8f39-4988-bebb-ed43a74fae66 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:18.006463 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-56b11371-8f39-4988-bebb-ed43a74fae66 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:18.006954 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-56b11371-8f39-4988-bebb-ed43a74fae66 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:18.038787 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9623eb87-df6e-4c99-8b74-77b81c02a27c tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.180852 Oct 04 18:34:18.045022 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 845/1608] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:34:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 2183 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:34:18.045022 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b3f40cc4-d81e-4a87-96a3-34cfd9470296 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:18.045820 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b3f40cc4-d81e-4a87-96a3-34cfd9470296 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 158e9f52-fd16-48d1-87b5-e0dd523e97a4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:18.053899 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b3f40cc4-d81e-4a87-96a3-34cfd9470296 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:18.054676 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b3f40cc4-d81e-4a87-96a3-34cfd9470296 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:18.055316 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b3f40cc4-d81e-4a87-96a3-34cfd9470296 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:18.056224 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b3f40cc4-d81e-4a87-96a3-34cfd9470296 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:18.056722 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b3f40cc4-d81e-4a87-96a3-34cfd9470296 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:18.057144 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b3f40cc4-d81e-4a87-96a3-34cfd9470296 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:18.094429 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-56b11371-8f39-4988-bebb-ed43a74fae66 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:18.104531 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-56b11371-8f39-4988-bebb-ed43a74fae66 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:18.105954 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-56b11371-8f39-4988-bebb-ed43a74fae66 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:18.111365 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-56b11371-8f39-4988-bebb-ed43a74fae66 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1544 microversion: 2.91 time: 0.118633 Oct 04 18:34:18.132019 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 764/1609] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:17 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1544 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:18.132019 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-ef0aca95-7f92-4f5e-b234-33a3f691089c req-13914cae-32a8-47da-9778-59683cda9d2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3abc28f-8361-4906-a085-1440991c298f", "tag": "82ad6043-0772-4416-b7ca-f387aa238059"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:18.132019 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-ef0aca95-7f92-4f5e-b234-33a3f691089c req-13914cae-32a8-47da-9778-59683cda9d2c service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:18.132019 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-ef0aca95-7f92-4f5e-b234-33a3f691089c req-13914cae-32a8-47da-9778-59683cda9d2c service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:18.132019 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-ef0aca95-7f92-4f5e-b234-33a3f691089c req-13914cae-32a8-47da-9778-59683cda9d2c service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:18.144359 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-ef0aca95-7f92-4f5e-b234-33a3f691089c req-13914cae-32a8-47da-9778-59683cda9d2c service nova] Creating event network-changed:82ad6043-0772-4416-b7ca-f387aa238059 for instance d3abc28f-8361-4906-a085-1440991c298f on n-h2-850501-14 Oct 04 18:34:18.149864 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-ef0aca95-7f92-4f5e-b234-33a3f691089c req-13914cae-32a8-47da-9778-59683cda9d2c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035103 Oct 04 18:34:18.150467 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 765/1610] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:34:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:34:18.160688 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-de13d3ba-dc5b-464b-9146-9506f1c24ac9 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '.version_select at 0x7fe25911ea60>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:18.230883 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-de13d3ba-dc5b-464b-9146-9506f1c24ac9 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/images/ea702f85-8e85-400a-a6e3-61ce78efff2c" status: 200 len: 1422 microversion: 2.1 time: 0.075433 Oct 04 18:34:18.232596 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 766/1611] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:34:18 2022] GET /compute/v2.1/images/ea702f85-8e85-400a-a6e3-61ce78efff2c => generated 1422 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:18.234145 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b3f40cc4-d81e-4a87-96a3-34cfd9470296 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:18.239217 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c7a090f2-1a2e-4ff1-b3a8-0ae256144550 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:18.240787 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c7a090f2-1a2e-4ff1-b3a8-0ae256144550 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2fe6c508-f183-40bd-bfd5-23c757e99a05] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:18.245967 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b3f40cc4-d81e-4a87-96a3-34cfd9470296 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4" status: 200 len: 1719 microversion: 2.1 time: 0.204778 Oct 04 18:34:18.261372 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 846/1612] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:18 2022] GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4 => generated 1719 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:18.271061 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-79178614-c1f3-4096-8662-e6fe6aebd4cf tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '.version_select at 0x7fe25d133b80>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:18.314706 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c7a090f2-1a2e-4ff1-b3a8-0ae256144550 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:18.324908 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c7a090f2-1a2e-4ff1-b3a8-0ae256144550 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05" status: 200 len: 1213 microversion: 2.1 time: 0.090988 Oct 04 18:34:18.339882 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 767/1613] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:18 2022] GET /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05 => generated 1213 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:18.854499 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9a7a5165-fa30-460e-b699-ff0648a84aec tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:18.855156 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-9a7a5165-fa30-460e-b699-ff0648a84aec tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: b219d988-2847-45a0-a3b8-af54cf1a43f8] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:18.861610 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9a7a5165-fa30-460e-b699-ff0648a84aec tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:18.862090 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9a7a5165-fa30-460e-b699-ff0648a84aec tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:18.863026 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9a7a5165-fa30-460e-b699-ff0648a84aec tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:18.864093 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9a7a5165-fa30-460e-b699-ff0648a84aec tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:18.864544 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9a7a5165-fa30-460e-b699-ff0648a84aec tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:18.864968 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9a7a5165-fa30-460e-b699-ff0648a84aec tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:19.038402 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9a7a5165-fa30-460e-b699-ff0648a84aec tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:19.048088 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9a7a5165-fa30-460e-b699-ff0648a84aec tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:19.049535 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9a7a5165-fa30-460e-b699-ff0648a84aec tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:19.051344 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9a7a5165-fa30-460e-b699-ff0648a84aec tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8" status: 200 len: 1811 microversion: 2.25 time: 0.200643 Oct 04 18:34:19.052129 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 768/1614] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:18 2022] GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8 => generated 1811 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:34:19.057309 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9a6d6713-a5e4-4497-a015-70385b8af4dc tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:19.058166 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-9a6d6713-a5e4-4497-a015-70385b8af4dc tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] [instance: d3abc28f-8361-4906-a085-1440991c298f] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:19.069182 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9a6d6713-a5e4-4497-a015-70385b8af4dc tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:19.072897 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9a6d6713-a5e4-4497-a015-70385b8af4dc tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:19.072897 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9a6d6713-a5e4-4497-a015-70385b8af4dc tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:19.072897 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9a6d6713-a5e4-4497-a015-70385b8af4dc tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:19.072897 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9a6d6713-a5e4-4497-a015-70385b8af4dc tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:19.072897 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9a6d6713-a5e4-4497-a015-70385b8af4dc tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:19.308671 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9a6d6713-a5e4-4497-a015-70385b8af4dc tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44cc98e07d134a15b0fbf2b80bd25ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e0b0088d8476bbcb4c83783fec0e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:19.321009 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9a6d6713-a5e4-4497-a015-70385b8af4dc tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] 10.222.0.20 "GET /compute/v2.1/servers/d3abc28f-8361-4906-a085-1440991c298f" status: 200 len: 1318 microversion: 2.1 time: 0.267635 Oct 04 18:34:19.344288 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 769/1615] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:19 2022] GET /compute/v2.1/servers/d3abc28f-8361-4906-a085-1440991c298f => generated 1318 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:19.349682 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-57c6a2df-e269-4043-94a3-2e363e22a6fd tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:19.355967 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-57c6a2df-e269-4043-94a3-2e363e22a6fd tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:19.357403 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-57c6a2df-e269-4043-94a3-2e363e22a6fd tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:19.357403 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-57c6a2df-e269-4043-94a3-2e363e22a6fd tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:19.357866 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-57c6a2df-e269-4043-94a3-2e363e22a6fd tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:19.358402 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-57c6a2df-e269-4043-94a3-2e363e22a6fd tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:19.358851 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-57c6a2df-e269-4043-94a3-2e363e22a6fd tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:19.359695 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-57c6a2df-e269-4043-94a3-2e363e22a6fd tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:19.435771 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-57c6a2df-e269-4043-94a3-2e363e22a6fd tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:19.447714 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-57c6a2df-e269-4043-94a3-2e363e22a6fd tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:19.449229 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-57c6a2df-e269-4043-94a3-2e363e22a6fd tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:19.455533 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-57c6a2df-e269-4043-94a3-2e363e22a6fd tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1544 microversion: 2.91 time: 0.110081 Oct 04 18:34:19.458828 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 770/1616] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:19 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1544 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:19.472140 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6ade1758-95fa-4b32-bbfe-d5d0647eda2d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:19.473215 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6ade1758-95fa-4b32-bbfe-d5d0647eda2d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 158e9f52-fd16-48d1-87b5-e0dd523e97a4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:19.479716 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6ade1758-95fa-4b32-bbfe-d5d0647eda2d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:19.482150 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6ade1758-95fa-4b32-bbfe-d5d0647eda2d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:19.482792 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6ade1758-95fa-4b32-bbfe-d5d0647eda2d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:19.483804 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6ade1758-95fa-4b32-bbfe-d5d0647eda2d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:19.484478 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6ade1758-95fa-4b32-bbfe-d5d0647eda2d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:19.489619 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6ade1758-95fa-4b32-bbfe-d5d0647eda2d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:19.663567 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6ade1758-95fa-4b32-bbfe-d5d0647eda2d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:19.674834 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6ade1758-95fa-4b32-bbfe-d5d0647eda2d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4" status: 200 len: 1719 microversion: 2.1 time: 0.216777 Oct 04 18:34:19.677670 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 771/1617] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:19 2022] GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4 => generated 1719 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:19.684722 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5fe625fe-3899-46ab-891f-3b036fa23674 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:19.686080 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5fe625fe-3899-46ab-891f-3b036fa23674 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2fe6c508-f183-40bd-bfd5-23c757e99a05] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:19.702448 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5fe625fe-3899-46ab-891f-3b036fa23674 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:19.703750 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5fe625fe-3899-46ab-891f-3b036fa23674 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:19.704425 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5fe625fe-3899-46ab-891f-3b036fa23674 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:19.705438 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5fe625fe-3899-46ab-891f-3b036fa23674 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:19.705898 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5fe625fe-3899-46ab-891f-3b036fa23674 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:19.706378 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5fe625fe-3899-46ab-891f-3b036fa23674 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:19.786183 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5fe625fe-3899-46ab-891f-3b036fa23674 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:19.795252 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5fe625fe-3899-46ab-891f-3b036fa23674 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05" status: 200 len: 1217 microversion: 2.1 time: 0.116074 Oct 04 18:34:19.796552 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 772/1618] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:19 2022] GET /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05 => generated 1217 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:20.079017 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0f1a776d-89ca-4f76-8aaf-672d3be2fbdf tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:20.079676 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0f1a776d-89ca-4f76-8aaf-672d3be2fbdf tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: b219d988-2847-45a0-a3b8-af54cf1a43f8] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:20.090237 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0f1a776d-89ca-4f76-8aaf-672d3be2fbdf tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:20.092640 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0f1a776d-89ca-4f76-8aaf-672d3be2fbdf tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:20.092640 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0f1a776d-89ca-4f76-8aaf-672d3be2fbdf tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:20.092640 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0f1a776d-89ca-4f76-8aaf-672d3be2fbdf tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:20.094152 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0f1a776d-89ca-4f76-8aaf-672d3be2fbdf tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:20.094744 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0f1a776d-89ca-4f76-8aaf-672d3be2fbdf tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:20.117533 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-79178614-c1f3-4096-8662-e6fe6aebd4cf tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "DELETE /compute/v2.1/images/ea702f85-8e85-400a-a6e3-61ce78efff2c" status: 204 len: 0 microversion: 2.1 time: 1.854484 Oct 04 18:34:20.118190 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 847/1619] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:18 2022] DELETE /compute/v2.1/images/ea702f85-8e85-400a-a6e3-61ce78efff2c => generated 0 bytes in 1856 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:34:20.126744 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f73b96b8-c578-4cec-883d-0f27ae819839 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:20.127543 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f73b96b8-c578-4cec-883d-0f27ae819839 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: c8c84d9e-2274-49dd-99e9-cbd7222c22d5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:20.145290 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f73b96b8-c578-4cec-883d-0f27ae819839 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:20.145656 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f73b96b8-c578-4cec-883d-0f27ae819839 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:20.146104 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f73b96b8-c578-4cec-883d-0f27ae819839 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:20.148992 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f73b96b8-c578-4cec-883d-0f27ae819839 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:20.152396 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f73b96b8-c578-4cec-883d-0f27ae819839 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:20.152999 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f73b96b8-c578-4cec-883d-0f27ae819839 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:20.192683 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f73b96b8-c578-4cec-883d-0f27ae819839 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: c8c84d9e-2274-49dd-99e9-cbd7222c22d5] Going to try to terminate instance {{(pid=123002) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:34:20.279963 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0f1a776d-89ca-4f76-8aaf-672d3be2fbdf tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:20.290404 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0f1a776d-89ca-4f76-8aaf-672d3be2fbdf tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:20.293215 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0f1a776d-89ca-4f76-8aaf-672d3be2fbdf tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:20.293762 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0f1a776d-89ca-4f76-8aaf-672d3be2fbdf tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8" status: 200 len: 1811 microversion: 2.25 time: 0.218347 Oct 04 18:34:20.308672 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 773/1620] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:20 2022] GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8 => generated 1811 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:34:20.344622 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8782a2d1-7e29-4140-8829-e0b5631fa91e tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:20.345265 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8782a2d1-7e29-4140-8829-e0b5631fa91e tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] [instance: d3abc28f-8361-4906-a085-1440991c298f] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:20.352384 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8782a2d1-7e29-4140-8829-e0b5631fa91e tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:20.353049 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8782a2d1-7e29-4140-8829-e0b5631fa91e tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:20.353662 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8782a2d1-7e29-4140-8829-e0b5631fa91e tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:20.354364 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8782a2d1-7e29-4140-8829-e0b5631fa91e tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:20.355037 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8782a2d1-7e29-4140-8829-e0b5631fa91e tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:20.355624 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8782a2d1-7e29-4140-8829-e0b5631fa91e tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:20.376394 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:20.484570 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f73b96b8-c578-4cec-883d-0f27ae819839 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c8c84d9e-2274-49dd-99e9-cbd7222c22d5" status: 204 len: 0 microversion: 2.1 time: 0.361934 Oct 04 18:34:20.486122 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 848/1621] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:34:20 2022] DELETE /compute/v2.1/servers/c8c84d9e-2274-49dd-99e9-cbd7222c22d5 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:34:20.499099 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-110d6c7e-d645-4e9e-b1ad-ecb741e6e345 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:20.500112 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-110d6c7e-d645-4e9e-b1ad-ecb741e6e345 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:20.513231 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-110d6c7e-d645-4e9e-b1ad-ecb741e6e345 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:20.515265 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-110d6c7e-d645-4e9e-b1ad-ecb741e6e345 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:20.515265 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-110d6c7e-d645-4e9e-b1ad-ecb741e6e345 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:20.515265 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-110d6c7e-d645-4e9e-b1ad-ecb741e6e345 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:20.516534 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-110d6c7e-d645-4e9e-b1ad-ecb741e6e345 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:20.517180 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-110d6c7e-d645-4e9e-b1ad-ecb741e6e345 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:20.523172 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8782a2d1-7e29-4140-8829-e0b5631fa91e tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44cc98e07d134a15b0fbf2b80bd25ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e0b0088d8476bbcb4c83783fec0e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:20.531745 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8782a2d1-7e29-4140-8829-e0b5631fa91e tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] 10.222.0.20 "GET /compute/v2.1/servers/d3abc28f-8361-4906-a085-1440991c298f" status: 200 len: 1318 microversion: 2.1 time: 0.190957 Oct 04 18:34:20.532470 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 774/1622] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:20 2022] GET /compute/v2.1/servers/d3abc28f-8361-4906-a085-1440991c298f => generated 1318 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:20.631961 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-110d6c7e-d645-4e9e-b1ad-ecb741e6e345 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:20.645227 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-110d6c7e-d645-4e9e-b1ad-ecb741e6e345 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:20.646954 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-110d6c7e-d645-4e9e-b1ad-ecb741e6e345 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:20.655062 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-098af55f-77c5-4a0c-a4fd-7d33d6b0f1e3 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-457297983", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": [{"uuid": "d61331d4-8e69-4941-9497-adc08bbff779"}]}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:20.666838 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-110d6c7e-d645-4e9e-b1ad-ecb741e6e345 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1544 microversion: 2.91 time: 0.178875 Oct 04 18:34:20.673608 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 849/1623] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:20 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1544 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:20.710633 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-beeda37d-c1b3-4c37-8f78-d2cc6063417b tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:20.711674 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-beeda37d-c1b3-4c37-8f78-d2cc6063417b tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 158e9f52-fd16-48d1-87b5-e0dd523e97a4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:20.731577 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-beeda37d-c1b3-4c37-8f78-d2cc6063417b tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:20.731577 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-beeda37d-c1b3-4c37-8f78-d2cc6063417b tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:20.731577 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-beeda37d-c1b3-4c37-8f78-d2cc6063417b tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:20.731577 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-beeda37d-c1b3-4c37-8f78-d2cc6063417b tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:20.731577 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-beeda37d-c1b3-4c37-8f78-d2cc6063417b tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:20.731577 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-beeda37d-c1b3-4c37-8f78-d2cc6063417b tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:20.746604 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.neutron [None req-098af55f-77c5-4a0c-a4fd-7d33d6b0f1e3 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] validate_networks() for [('d61331d4-8e69-4941-9497-adc08bbff779', None, None, None, None, None)] {{(pid=123001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:34:20.987047 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-beeda37d-c1b3-4c37-8f78-d2cc6063417b tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:20.996199 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-beeda37d-c1b3-4c37-8f78-d2cc6063417b tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4" status: 200 len: 1719 microversion: 2.1 time: 0.293176 Oct 04 18:34:21.012280 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 850/1624] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:20 2022] GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4 => generated 1719 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:21.017266 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-10399c4e-9cd8-44af-b1bd-218ae82f0a66 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:21.017878 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-10399c4e-9cd8-44af-b1bd-218ae82f0a66 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2fe6c508-f183-40bd-bfd5-23c757e99a05] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:21.025321 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-10399c4e-9cd8-44af-b1bd-218ae82f0a66 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:21.025813 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-10399c4e-9cd8-44af-b1bd-218ae82f0a66 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:21.026248 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-10399c4e-9cd8-44af-b1bd-218ae82f0a66 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:21.026959 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-10399c4e-9cd8-44af-b1bd-218ae82f0a66 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:21.027405 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-10399c4e-9cd8-44af-b1bd-218ae82f0a66 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:21.027824 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-10399c4e-9cd8-44af-b1bd-218ae82f0a66 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:21.117447 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-10399c4e-9cd8-44af-b1bd-218ae82f0a66 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:21.127657 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-10399c4e-9cd8-44af-b1bd-218ae82f0a66 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05" status: 200 len: 1273 microversion: 2.1 time: 0.114151 Oct 04 18:34:21.128372 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 851/1625] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:21 2022] GET /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05 => generated 1273 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:21.322142 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7f015c30-387c-45b5-8efe-5a191c5f3413 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:21.323695 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7f015c30-387c-45b5-8efe-5a191c5f3413 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: b219d988-2847-45a0-a3b8-af54cf1a43f8] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:21.334201 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7f015c30-387c-45b5-8efe-5a191c5f3413 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:21.334700 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7f015c30-387c-45b5-8efe-5a191c5f3413 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:21.335134 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7f015c30-387c-45b5-8efe-5a191c5f3413 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:21.335846 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7f015c30-387c-45b5-8efe-5a191c5f3413 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:21.342189 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7f015c30-387c-45b5-8efe-5a191c5f3413 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:21.342977 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7f015c30-387c-45b5-8efe-5a191c5f3413 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:21.376777 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:21.493553 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-098af55f-77c5-4a0c-a4fd-7d33d6b0f1e3 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:34:21.494148 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-098af55f-77c5-4a0c-a4fd-7d33d6b0f1e3 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:34:21.494879 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-098af55f-77c5-4a0c-a4fd-7d33d6b0f1e3 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:34:21.495760 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-098af55f-77c5-4a0c-a4fd-7d33d6b0f1e3 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:34:21.496952 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-098af55f-77c5-4a0c-a4fd-7d33d6b0f1e3 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:34:21.508865 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-098af55f-77c5-4a0c-a4fd-7d33d6b0f1e3 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:21.509764 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-098af55f-77c5-4a0c-a4fd-7d33d6b0f1e3 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:21.510617 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-098af55f-77c5-4a0c-a4fd-7d33d6b0f1e3 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:21.512110 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-098af55f-77c5-4a0c-a4fd-7d33d6b0f1e3 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:21.513371 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-098af55f-77c5-4a0c-a4fd-7d33d6b0f1e3 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:21.523085 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-098af55f-77c5-4a0c-a4fd-7d33d6b0f1e3 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:21.545892 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-098af55f-77c5-4a0c-a4fd-7d33d6b0f1e3 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Getting quotas for project 08c83d7b68684daf8e67ba2361ad86c9. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:34:21.552562 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-098af55f-77c5-4a0c-a4fd-7d33d6b0f1e3 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Getting quotas for user ef3c7ad35a05450496b6d1ff64f12b77 and project 08c83d7b68684daf8e67ba2361ad86c9. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:34:21.568733 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-098af55f-77c5-4a0c-a4fd-7d33d6b0f1e3 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Going to run 1 instances... {{(pid=123001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:34:21.571614 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-098af55f-77c5-4a0c-a4fd-7d33d6b0f1e3 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: 0fa89d74-e5c4-461c-adcc-6c29ce9ad8db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:34:21.596614 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7f015c30-387c-45b5-8efe-5a191c5f3413 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:21.605057 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7f015c30-387c-45b5-8efe-5a191c5f3413 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:21.606745 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7f015c30-387c-45b5-8efe-5a191c5f3413 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:21.614883 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7f015c30-387c-45b5-8efe-5a191c5f3413 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8" status: 200 len: 1811 microversion: 2.25 time: 0.296398 Oct 04 18:34:21.617127 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 852/1626] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:21 2022] GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8 => generated 1811 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:34:21.622801 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7affb2c4-06bc-42ff-85f6-c2beb2eb0700 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:21.625200 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7affb2c4-06bc-42ff-85f6-c2beb2eb0700 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] [instance: d3abc28f-8361-4906-a085-1440991c298f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:21.631722 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7affb2c4-06bc-42ff-85f6-c2beb2eb0700 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:21.632433 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7affb2c4-06bc-42ff-85f6-c2beb2eb0700 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:21.633204 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7affb2c4-06bc-42ff-85f6-c2beb2eb0700 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:21.634250 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7affb2c4-06bc-42ff-85f6-c2beb2eb0700 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:21.634859 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7affb2c4-06bc-42ff-85f6-c2beb2eb0700 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:21.635386 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7affb2c4-06bc-42ff-85f6-c2beb2eb0700 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:21.739395 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-098af55f-77c5-4a0c-a4fd-7d33d6b0f1e3 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.086766 Oct 04 18:34:21.747966 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 775/1627] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:34:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1098 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 18:34:21.753653 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6daf0f89-b119-4d9f-adb7-161e2d67e59b tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:21.756085 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6daf0f89-b119-4d9f-adb7-161e2d67e59b tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:21.780702 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6daf0f89-b119-4d9f-adb7-161e2d67e59b tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:21.780702 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6daf0f89-b119-4d9f-adb7-161e2d67e59b tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:21.780702 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6daf0f89-b119-4d9f-adb7-161e2d67e59b tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:21.781691 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6daf0f89-b119-4d9f-adb7-161e2d67e59b tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:21.782059 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6daf0f89-b119-4d9f-adb7-161e2d67e59b tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:21.782559 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6daf0f89-b119-4d9f-adb7-161e2d67e59b tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:21.837761 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7affb2c4-06bc-42ff-85f6-c2beb2eb0700 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44cc98e07d134a15b0fbf2b80bd25ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e0b0088d8476bbcb4c83783fec0e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:21.847046 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7affb2c4-06bc-42ff-85f6-c2beb2eb0700 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] 10.222.0.20 "GET /compute/v2.1/servers/d3abc28f-8361-4906-a085-1440991c298f" status: 200 len: 1318 microversion: 2.1 time: 0.228570 Oct 04 18:34:21.853732 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 853/1628] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:21 2022] GET /compute/v2.1/servers/d3abc28f-8361-4906-a085-1440991c298f => generated 1318 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:21.859879 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7981a676-f123-4ccd-9046-6f214b7f55f8 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:21.860750 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7981a676-f123-4ccd-9046-6f214b7f55f8 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: 0fa89d74-e5c4-461c-adcc-6c29ce9ad8db] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:21.870952 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6daf0f89-b119-4d9f-adb7-161e2d67e59b tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:21.881192 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6daf0f89-b119-4d9f-adb7-161e2d67e59b tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:21.882611 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6daf0f89-b119-4d9f-adb7-161e2d67e59b tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:21.900443 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6daf0f89-b119-4d9f-adb7-161e2d67e59b tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1544 microversion: 2.91 time: 0.150710 Oct 04 18:34:21.912243 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 776/1629] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:21 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1544 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:21.954192 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7981a676-f123-4ccd-9046-6f214b7f55f8 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:21.976479 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7981a676-f123-4ccd-9046-6f214b7f55f8 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/0fa89d74-e5c4-461c-adcc-6c29ce9ad8db" status: 200 len: 1207 microversion: 2.1 time: 0.115374 Oct 04 18:34:21.976479 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 854/1630] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:21 2022] GET /compute/v2.1/servers/0fa89d74-e5c4-461c-adcc-6c29ce9ad8db => generated 1207 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:22.022186 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-42e63423-086e-445e-8975-667538783964 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:22.022978 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-42e63423-086e-445e-8975-667538783964 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 158e9f52-fd16-48d1-87b5-e0dd523e97a4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:22.032777 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-42e63423-086e-445e-8975-667538783964 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:22.039644 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-42e63423-086e-445e-8975-667538783964 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:22.039644 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-42e63423-086e-445e-8975-667538783964 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:22.039644 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-42e63423-086e-445e-8975-667538783964 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:22.039644 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-42e63423-086e-445e-8975-667538783964 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:22.039644 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-42e63423-086e-445e-8975-667538783964 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:22.155157 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ca12ee5d-419d-430a-89ce-e2a4efd7621b tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:22.155721 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ca12ee5d-419d-430a-89ce-e2a4efd7621b tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2fe6c508-f183-40bd-bfd5-23c757e99a05] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:22.163910 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ca12ee5d-419d-430a-89ce-e2a4efd7621b tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:22.164565 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ca12ee5d-419d-430a-89ce-e2a4efd7621b tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:22.165015 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ca12ee5d-419d-430a-89ce-e2a4efd7621b tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:22.165746 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ca12ee5d-419d-430a-89ce-e2a4efd7621b tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:22.166234 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ca12ee5d-419d-430a-89ce-e2a4efd7621b tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:22.173075 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ca12ee5d-419d-430a-89ce-e2a4efd7621b tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:22.251877 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-42e63423-086e-445e-8975-667538783964 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:22.263273 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-42e63423-086e-445e-8975-667538783964 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4" status: 200 len: 1719 microversion: 2.1 time: 0.247898 Oct 04 18:34:22.264534 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 777/1631] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:22 2022] GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4 => generated 1719 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:22.428891 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ca12ee5d-419d-430a-89ce-e2a4efd7621b tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:22.439381 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ca12ee5d-419d-430a-89ce-e2a4efd7621b tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05" status: 200 len: 1271 microversion: 2.1 time: 0.288131 Oct 04 18:34:22.440762 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 855/1632] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:22 2022] GET /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05 => generated 1271 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:22.642671 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-14b3395f-4da8-42a6-a5ba-09a1fd789888 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:22.645251 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-14b3395f-4da8-42a6-a5ba-09a1fd789888 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: b219d988-2847-45a0-a3b8-af54cf1a43f8] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:22.657152 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-14b3395f-4da8-42a6-a5ba-09a1fd789888 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:22.660666 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-14b3395f-4da8-42a6-a5ba-09a1fd789888 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:22.660666 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-14b3395f-4da8-42a6-a5ba-09a1fd789888 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:22.662192 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-14b3395f-4da8-42a6-a5ba-09a1fd789888 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:22.662881 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-14b3395f-4da8-42a6-a5ba-09a1fd789888 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:22.663526 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-14b3395f-4da8-42a6-a5ba-09a1fd789888 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:22.875363 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b3996f8e-7df8-4834-9fb3-d1b3ba5c01d8 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:22.876428 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b3996f8e-7df8-4834-9fb3-d1b3ba5c01d8 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] [instance: d3abc28f-8361-4906-a085-1440991c298f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:22.890413 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b3996f8e-7df8-4834-9fb3-d1b3ba5c01d8 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:22.891241 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b3996f8e-7df8-4834-9fb3-d1b3ba5c01d8 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:22.892388 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b3996f8e-7df8-4834-9fb3-d1b3ba5c01d8 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:22.896473 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b3996f8e-7df8-4834-9fb3-d1b3ba5c01d8 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:22.897194 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b3996f8e-7df8-4834-9fb3-d1b3ba5c01d8 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:22.897835 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b3996f8e-7df8-4834-9fb3-d1b3ba5c01d8 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:22.919109 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-14b3395f-4da8-42a6-a5ba-09a1fd789888 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:22.928551 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-14b3395f-4da8-42a6-a5ba-09a1fd789888 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:22.929976 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-14b3395f-4da8-42a6-a5ba-09a1fd789888 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:22.931267 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-14b3395f-4da8-42a6-a5ba-09a1fd789888 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8" status: 200 len: 1811 microversion: 2.25 time: 0.292771 Oct 04 18:34:22.932161 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 778/1633] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:22 2022] GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8 => generated 1811 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:22.938726 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-06a30716-ca7e-46f6-beee-15cf39615d4d tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:22.939461 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-06a30716-ca7e-46f6-beee-15cf39615d4d tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:22.945972 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-06a30716-ca7e-46f6-beee-15cf39615d4d tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:22.946480 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-06a30716-ca7e-46f6-beee-15cf39615d4d tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:22.946954 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-06a30716-ca7e-46f6-beee-15cf39615d4d tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:22.947705 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-06a30716-ca7e-46f6-beee-15cf39615d4d tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:22.948318 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-06a30716-ca7e-46f6-beee-15cf39615d4d tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:22.948740 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-06a30716-ca7e-46f6-beee-15cf39615d4d tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:23.026319 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-06a30716-ca7e-46f6-beee-15cf39615d4d tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:23.036111 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-06a30716-ca7e-46f6-beee-15cf39615d4d tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:23.038125 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-06a30716-ca7e-46f6-beee-15cf39615d4d tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:23.044311 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-06a30716-ca7e-46f6-beee-15cf39615d4d tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1544 microversion: 2.91 time: 0.110916 Oct 04 18:34:23.056120 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 779/1634] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:22 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1544 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:23.056120 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5dde1bcb-64e3-4505-80ab-c91d27986cd7 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:23.056120 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5dde1bcb-64e3-4505-80ab-c91d27986cd7 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: 0fa89d74-e5c4-461c-adcc-6c29ce9ad8db] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:23.058237 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5dde1bcb-64e3-4505-80ab-c91d27986cd7 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:23.068006 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5dde1bcb-64e3-4505-80ab-c91d27986cd7 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:23.068006 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5dde1bcb-64e3-4505-80ab-c91d27986cd7 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:23.068006 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5dde1bcb-64e3-4505-80ab-c91d27986cd7 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:23.068006 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5dde1bcb-64e3-4505-80ab-c91d27986cd7 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:23.068006 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5dde1bcb-64e3-4505-80ab-c91d27986cd7 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:23.114151 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b3996f8e-7df8-4834-9fb3-d1b3ba5c01d8 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44cc98e07d134a15b0fbf2b80bd25ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e0b0088d8476bbcb4c83783fec0e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:23.125181 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b3996f8e-7df8-4834-9fb3-d1b3ba5c01d8 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] 10.222.0.20 "GET /compute/v2.1/servers/d3abc28f-8361-4906-a085-1440991c298f" status: 200 len: 1318 microversion: 2.1 time: 0.253896 Oct 04 18:34:23.127191 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 856/1635] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:22 2022] GET /compute/v2.1/servers/d3abc28f-8361-4906-a085-1440991c298f => generated 1318 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:34:23.151545 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5dde1bcb-64e3-4505-80ab-c91d27986cd7 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:23.160736 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5dde1bcb-64e3-4505-80ab-c91d27986cd7 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/0fa89d74-e5c4-461c-adcc-6c29ce9ad8db" status: 200 len: 1211 microversion: 2.1 time: 0.113286 Oct 04 18:34:23.161234 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 780/1636] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:23 2022] GET /compute/v2.1/servers/0fa89d74-e5c4-461c-adcc-6c29ce9ad8db => generated 1211 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:23.288893 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-fada3d0e-49a0-4440-aa73-9d3d878ecadb tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:23.289478 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-fada3d0e-49a0-4440-aa73-9d3d878ecadb tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 158e9f52-fd16-48d1-87b5-e0dd523e97a4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:23.291643 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:23.296453 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fada3d0e-49a0-4440-aa73-9d3d878ecadb tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:23.296933 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fada3d0e-49a0-4440-aa73-9d3d878ecadb tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:23.297367 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fada3d0e-49a0-4440-aa73-9d3d878ecadb tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:23.298065 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fada3d0e-49a0-4440-aa73-9d3d878ecadb tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:23.298570 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fada3d0e-49a0-4440-aa73-9d3d878ecadb tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:23.298997 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fada3d0e-49a0-4440-aa73-9d3d878ecadb tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:23.460961 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-fada3d0e-49a0-4440-aa73-9d3d878ecadb tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:23.464111 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0b9d5ecb-6f0f-446d-b4da-9416f0861e2b tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:23.464955 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0b9d5ecb-6f0f-446d-b4da-9416f0861e2b tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2fe6c508-f183-40bd-bfd5-23c757e99a05] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:23.473050 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0b9d5ecb-6f0f-446d-b4da-9416f0861e2b tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:23.473859 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0b9d5ecb-6f0f-446d-b4da-9416f0861e2b tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:23.474508 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-fada3d0e-49a0-4440-aa73-9d3d878ecadb tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4" status: 200 len: 1719 microversion: 2.1 time: 0.190651 Oct 04 18:34:23.474666 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0b9d5ecb-6f0f-446d-b4da-9416f0861e2b tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:23.488151 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 857/1637] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:23 2022] GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4 => generated 1719 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:23.488789 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0b9d5ecb-6f0f-446d-b4da-9416f0861e2b tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:23.489445 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0b9d5ecb-6f0f-446d-b4da-9416f0861e2b tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:23.489935 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0b9d5ecb-6f0f-446d-b4da-9416f0861e2b tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:23.641731 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0b9d5ecb-6f0f-446d-b4da-9416f0861e2b tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:23.650396 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0b9d5ecb-6f0f-446d-b4da-9416f0861e2b tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05" status: 200 len: 1313 microversion: 2.1 time: 0.190868 Oct 04 18:34:23.651036 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 781/1638] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:23 2022] GET /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05 => generated 1313 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:34:23.877216 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-1cfba559-e127-4425-976b-3a2cc202ec31 req-e9a984f7-9ce2-4767-9591-2c549937ac08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fe6c508-f183-40bd-bfd5-23c757e99a05", "tag": "4ffbd68f-521b-46aa-9313-bc62980cacb6"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:23.889883 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-1cfba559-e127-4425-976b-3a2cc202ec31 req-e9a984f7-9ce2-4767-9591-2c549937ac08 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:23.890354 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-1cfba559-e127-4425-976b-3a2cc202ec31 req-e9a984f7-9ce2-4767-9591-2c549937ac08 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:23.890779 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-1cfba559-e127-4425-976b-3a2cc202ec31 req-e9a984f7-9ce2-4767-9591-2c549937ac08 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:23.903378 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-1cfba559-e127-4425-976b-3a2cc202ec31 req-e9a984f7-9ce2-4767-9591-2c549937ac08 service nova] Creating event network-changed:4ffbd68f-521b-46aa-9313-bc62980cacb6 for instance 2fe6c508-f183-40bd-bfd5-23c757e99a05 on n-h1-850501-14 Oct 04 18:34:23.909335 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-1cfba559-e127-4425-976b-3a2cc202ec31 req-e9a984f7-9ce2-4767-9591-2c549937ac08 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036750 Oct 04 18:34:23.918809 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 858/1639] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:34:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:34:23.963530 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d7c14a87-a698-4ff3-a00a-71ae85359288 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:23.964309 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d7c14a87-a698-4ff3-a00a-71ae85359288 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: b219d988-2847-45a0-a3b8-af54cf1a43f8] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:23.970424 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d7c14a87-a698-4ff3-a00a-71ae85359288 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:23.970953 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d7c14a87-a698-4ff3-a00a-71ae85359288 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:23.971334 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d7c14a87-a698-4ff3-a00a-71ae85359288 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:23.972879 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d7c14a87-a698-4ff3-a00a-71ae85359288 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:23.973645 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d7c14a87-a698-4ff3-a00a-71ae85359288 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:23.973852 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d7c14a87-a698-4ff3-a00a-71ae85359288 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:24.077966 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f623cc62-d84c-443a-8746-b1f01cf1e098 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:24.078659 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f623cc62-d84c-443a-8746-b1f01cf1e098 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:24.086842 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f623cc62-d84c-443a-8746-b1f01cf1e098 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:24.087364 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f623cc62-d84c-443a-8746-b1f01cf1e098 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:24.087856 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f623cc62-d84c-443a-8746-b1f01cf1e098 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:24.088593 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f623cc62-d84c-443a-8746-b1f01cf1e098 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:24.089053 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f623cc62-d84c-443a-8746-b1f01cf1e098 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:24.089483 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f623cc62-d84c-443a-8746-b1f01cf1e098 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:24.107620 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d7c14a87-a698-4ff3-a00a-71ae85359288 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:24.116243 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d7c14a87-a698-4ff3-a00a-71ae85359288 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:24.117661 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d7c14a87-a698-4ff3-a00a-71ae85359288 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:24.118804 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d7c14a87-a698-4ff3-a00a-71ae85359288 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8" status: 200 len: 1811 microversion: 2.25 time: 0.159506 Oct 04 18:34:24.119360 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 782/1640] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:23 2022] GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8 => generated 1811 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:24.150943 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9f8a2178-511e-4940-9132-6010da9df28a tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:24.151694 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-9f8a2178-511e-4940-9132-6010da9df28a tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] [instance: d3abc28f-8361-4906-a085-1440991c298f] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:24.156123 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f623cc62-d84c-443a-8746-b1f01cf1e098 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:24.157978 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9f8a2178-511e-4940-9132-6010da9df28a tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:24.158469 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9f8a2178-511e-4940-9132-6010da9df28a tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:24.158910 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9f8a2178-511e-4940-9132-6010da9df28a tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:24.159607 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9f8a2178-511e-4940-9132-6010da9df28a tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:24.160981 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9f8a2178-511e-4940-9132-6010da9df28a tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:24.161110 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9f8a2178-511e-4940-9132-6010da9df28a tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:24.166265 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f623cc62-d84c-443a-8746-b1f01cf1e098 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:24.167761 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f623cc62-d84c-443a-8746-b1f01cf1e098 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:24.172980 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f623cc62-d84c-443a-8746-b1f01cf1e098 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1544 microversion: 2.91 time: 0.099442 Oct 04 18:34:24.173557 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 859/1641] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:24 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1544 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:34:24.183838 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-fb568b26-a849-4ffb-8609-33e6e7a7a33a tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:24.184763 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-fb568b26-a849-4ffb-8609-33e6e7a7a33a tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: 0fa89d74-e5c4-461c-adcc-6c29ce9ad8db] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:24.191471 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fb568b26-a849-4ffb-8609-33e6e7a7a33a tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:24.191954 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fb568b26-a849-4ffb-8609-33e6e7a7a33a tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:24.192418 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fb568b26-a849-4ffb-8609-33e6e7a7a33a tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:24.193116 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fb568b26-a849-4ffb-8609-33e6e7a7a33a tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:24.193575 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fb568b26-a849-4ffb-8609-33e6e7a7a33a tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:24.194013 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fb568b26-a849-4ffb-8609-33e6e7a7a33a tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:24.266771 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-fb568b26-a849-4ffb-8609-33e6e7a7a33a tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:24.278838 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-fb568b26-a849-4ffb-8609-33e6e7a7a33a tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/0fa89d74-e5c4-461c-adcc-6c29ce9ad8db" status: 200 len: 1259 microversion: 2.1 time: 0.098198 Oct 04 18:34:24.288234 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 860/1642] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:24 2022] GET /compute/v2.1/servers/0fa89d74-e5c4-461c-adcc-6c29ce9ad8db => generated 1259 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:34:24.334097 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9f8a2178-511e-4940-9132-6010da9df28a tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44cc98e07d134a15b0fbf2b80bd25ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e0b0088d8476bbcb4c83783fec0e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:24.342219 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9f8a2178-511e-4940-9132-6010da9df28a tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] 10.222.0.20 "GET /compute/v2.1/servers/d3abc28f-8361-4906-a085-1440991c298f" status: 200 len: 1318 microversion: 2.1 time: 0.194902 Oct 04 18:34:24.356381 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 783/1643] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:24 2022] GET /compute/v2.1/servers/d3abc28f-8361-4906-a085-1440991c298f => generated 1318 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:24.508465 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3573dd6b-bb84-4559-b991-faa0b346a5db tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:24.509171 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3573dd6b-bb84-4559-b991-faa0b346a5db tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 158e9f52-fd16-48d1-87b5-e0dd523e97a4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:24.516793 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3573dd6b-bb84-4559-b991-faa0b346a5db tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:24.517558 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3573dd6b-bb84-4559-b991-faa0b346a5db tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:24.518001 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3573dd6b-bb84-4559-b991-faa0b346a5db tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:24.518814 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3573dd6b-bb84-4559-b991-faa0b346a5db tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:24.519893 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3573dd6b-bb84-4559-b991-faa0b346a5db tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:24.520359 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3573dd6b-bb84-4559-b991-faa0b346a5db tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:24.536707 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-82901a23-5070-48b2-a7f5-aeb2a049690d tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:24.537288 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-82901a23-5070-48b2-a7f5-aeb2a049690d tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] [instance: 89a512b5-8107-4c63-8387-69892fc7e5f4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:24.549779 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:24.552450 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-82901a23-5070-48b2-a7f5-aeb2a049690d tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:24.553290 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-82901a23-5070-48b2-a7f5-aeb2a049690d tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:24.553290 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-82901a23-5070-48b2-a7f5-aeb2a049690d tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:24.553921 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-82901a23-5070-48b2-a7f5-aeb2a049690d tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:24.554471 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-82901a23-5070-48b2-a7f5-aeb2a049690d tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:24.554927 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-82901a23-5070-48b2-a7f5-aeb2a049690d tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:24.705370 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-82901a23-5070-48b2-a7f5-aeb2a049690d tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] [instance: 89a512b5-8107-4c63-8387-69892fc7e5f4] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:34:24.780826 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3573dd6b-bb84-4559-b991-faa0b346a5db tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:24.822457 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3573dd6b-bb84-4559-b991-faa0b346a5db tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4" status: 200 len: 1719 microversion: 2.1 time: 0.312575 Oct 04 18:34:24.823733 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 861/1644] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:24 2022] GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4 => generated 1719 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:24.834160 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5ac0751e-a6c7-4049-a5d3-30d4827f27d3 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:24.835099 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5ac0751e-a6c7-4049-a5d3-30d4827f27d3 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2fe6c508-f183-40bd-bfd5-23c757e99a05] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:24.862374 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5ac0751e-a6c7-4049-a5d3-30d4827f27d3 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:24.864918 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5ac0751e-a6c7-4049-a5d3-30d4827f27d3 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:24.865784 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5ac0751e-a6c7-4049-a5d3-30d4827f27d3 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:24.866730 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5ac0751e-a6c7-4049-a5d3-30d4827f27d3 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:24.867555 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5ac0751e-a6c7-4049-a5d3-30d4827f27d3 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:24.868202 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5ac0751e-a6c7-4049-a5d3-30d4827f27d3 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:25.058877 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5ac0751e-a6c7-4049-a5d3-30d4827f27d3 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:25.068601 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5ac0751e-a6c7-4049-a5d3-30d4827f27d3 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05" status: 200 len: 1313 microversion: 2.1 time: 0.243281 Oct 04 18:34:25.069680 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 862/1645] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:24 2022] GET /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05 => generated 1313 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:25.144689 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0c40dc4d-395a-4b8c-b776-b31067970916 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:25.145515 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0c40dc4d-395a-4b8c-b776-b31067970916 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: b219d988-2847-45a0-a3b8-af54cf1a43f8] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:25.151792 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0c40dc4d-395a-4b8c-b776-b31067970916 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:25.152431 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0c40dc4d-395a-4b8c-b776-b31067970916 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:25.153058 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0c40dc4d-395a-4b8c-b776-b31067970916 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:25.153760 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0c40dc4d-395a-4b8c-b776-b31067970916 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:25.154333 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0c40dc4d-395a-4b8c-b776-b31067970916 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:25.154857 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0c40dc4d-395a-4b8c-b776-b31067970916 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:25.326760 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0c40dc4d-395a-4b8c-b776-b31067970916 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:25.336662 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0c40dc4d-395a-4b8c-b776-b31067970916 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:25.338193 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0c40dc4d-395a-4b8c-b776-b31067970916 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:25.339455 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0c40dc4d-395a-4b8c-b776-b31067970916 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8" status: 200 len: 1811 microversion: 2.25 time: 0.198937 Oct 04 18:34:25.362719 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 863/1646] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:25 2022] GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8 => generated 1811 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:34:25.370272 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b2442122-73ac-4053-95fd-2b2a4c254d19 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:25.370898 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b2442122-73ac-4053-95fd-2b2a4c254d19 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:25.377304 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b2442122-73ac-4053-95fd-2b2a4c254d19 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:25.377799 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b2442122-73ac-4053-95fd-2b2a4c254d19 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:25.378243 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b2442122-73ac-4053-95fd-2b2a4c254d19 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:25.379030 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b2442122-73ac-4053-95fd-2b2a4c254d19 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:25.379493 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b2442122-73ac-4053-95fd-2b2a4c254d19 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:25.379925 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b2442122-73ac-4053-95fd-2b2a4c254d19 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:25.466584 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b2442122-73ac-4053-95fd-2b2a4c254d19 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:25.476518 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b2442122-73ac-4053-95fd-2b2a4c254d19 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:25.478512 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b2442122-73ac-4053-95fd-2b2a4c254d19 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:25.487045 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b2442122-73ac-4053-95fd-2b2a4c254d19 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1544 microversion: 2.91 time: 0.123018 Oct 04 18:34:25.489683 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 864/1647] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:25 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1544 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:25.497034 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2afe86ff-1aa1-48bd-8e25-655353608495 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:25.497834 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2afe86ff-1aa1-48bd-8e25-655353608495 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: 0fa89d74-e5c4-461c-adcc-6c29ce9ad8db] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:25.519632 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2afe86ff-1aa1-48bd-8e25-655353608495 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:25.522329 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2afe86ff-1aa1-48bd-8e25-655353608495 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:25.522981 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2afe86ff-1aa1-48bd-8e25-655353608495 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:25.523922 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2afe86ff-1aa1-48bd-8e25-655353608495 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:25.524583 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2afe86ff-1aa1-48bd-8e25-655353608495 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:25.525199 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2afe86ff-1aa1-48bd-8e25-655353608495 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:25.617431 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2afe86ff-1aa1-48bd-8e25-655353608495 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:25.625338 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2afe86ff-1aa1-48bd-8e25-655353608495 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/0fa89d74-e5c4-461c-adcc-6c29ce9ad8db" status: 200 len: 1267 microversion: 2.1 time: 0.132148 Oct 04 18:34:25.626025 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 865/1648] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:25 2022] GET /compute/v2.1/servers/0fa89d74-e5c4-461c-adcc-6c29ce9ad8db => generated 1267 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:25.631274 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-fe6eeed6-2106-4600-910c-b11f55699645 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:25.631882 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-fe6eeed6-2106-4600-910c-b11f55699645 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] [instance: d3abc28f-8361-4906-a085-1440991c298f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:25.651531 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fe6eeed6-2106-4600-910c-b11f55699645 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:25.652260 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fe6eeed6-2106-4600-910c-b11f55699645 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:25.652707 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fe6eeed6-2106-4600-910c-b11f55699645 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:25.653483 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fe6eeed6-2106-4600-910c-b11f55699645 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:25.653994 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fe6eeed6-2106-4600-910c-b11f55699645 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:25.654669 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fe6eeed6-2106-4600-910c-b11f55699645 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:25.764526 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-82901a23-5070-48b2-a7f5-aeb2a049690d tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] 10.222.0.20 "DELETE /compute/v2.1/servers/89a512b5-8107-4c63-8387-69892fc7e5f4" status: 204 len: 0 microversion: 2.1 time: 1.232524 Oct 04 18:34:25.765537 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 784/1649] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:34:24 2022] DELETE /compute/v2.1/servers/89a512b5-8107-4c63-8387-69892fc7e5f4 => generated 0 bytes in 1234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:34:25.774529 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-92ee45b5-bd04-49fc-ab88-f4d2b2f5fd89 req-91516af5-6e59-4424-be9f-8a9f14f46367 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "859d2a18-b7eb-457b-a4e3-7d3b5fb80137", "name": "network-vif-plugged", "status": "completed", "tag": "605c1b20-b6e3-41bd-9506-756a56c042bd"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:25.786209 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-92ee45b5-bd04-49fc-ab88-f4d2b2f5fd89 req-91516af5-6e59-4424-be9f-8a9f14f46367 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:25.786979 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-92ee45b5-bd04-49fc-ab88-f4d2b2f5fd89 req-91516af5-6e59-4424-be9f-8a9f14f46367 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:25.788424 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-92ee45b5-bd04-49fc-ab88-f4d2b2f5fd89 req-91516af5-6e59-4424-be9f-8a9f14f46367 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:25.808760 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-92ee45b5-bd04-49fc-ab88-f4d2b2f5fd89 req-91516af5-6e59-4424-be9f-8a9f14f46367 service nova] Creating event network-vif-plugged:605c1b20-b6e3-41bd-9506-756a56c042bd for instance 859d2a18-b7eb-457b-a4e3-7d3b5fb80137 on n-h2-850501-14 Oct 04 18:34:25.814883 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-92ee45b5-bd04-49fc-ab88-f4d2b2f5fd89 req-91516af5-6e59-4424-be9f-8a9f14f46367 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047982 Oct 04 18:34:25.819821 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 785/1650] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:34:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:34:25.831681 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-103c1285-72fe-4c97-9285-b51da2c744e5 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:25.832960 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-103c1285-72fe-4c97-9285-b51da2c744e5 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] [instance: 89a512b5-8107-4c63-8387-69892fc7e5f4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:25.844792 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-103c1285-72fe-4c97-9285-b51da2c744e5 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:25.848648 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-103c1285-72fe-4c97-9285-b51da2c744e5 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:25.848648 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-103c1285-72fe-4c97-9285-b51da2c744e5 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:25.848648 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-103c1285-72fe-4c97-9285-b51da2c744e5 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:25.848648 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-103c1285-72fe-4c97-9285-b51da2c744e5 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:25.849762 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-103c1285-72fe-4c97-9285-b51da2c744e5 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:25.934553 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-fe6eeed6-2106-4600-910c-b11f55699645 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44cc98e07d134a15b0fbf2b80bd25ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e0b0088d8476bbcb4c83783fec0e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:25.943593 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-fe6eeed6-2106-4600-910c-b11f55699645 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] 10.222.0.20 "GET /compute/v2.1/servers/d3abc28f-8361-4906-a085-1440991c298f" status: 200 len: 1318 microversion: 2.1 time: 0.316618 Oct 04 18:34:25.946436 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 866/1651] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:25 2022] GET /compute/v2.1/servers/d3abc28f-8361-4906-a085-1440991c298f => generated 1318 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:25.957022 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b73f1e6e-577c-40e1-8ffe-cf76bc3b498d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:25.957650 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b73f1e6e-577c-40e1-8ffe-cf76bc3b498d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 158e9f52-fd16-48d1-87b5-e0dd523e97a4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:25.969015 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b73f1e6e-577c-40e1-8ffe-cf76bc3b498d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:25.969652 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b73f1e6e-577c-40e1-8ffe-cf76bc3b498d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:25.971020 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b73f1e6e-577c-40e1-8ffe-cf76bc3b498d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:25.971900 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b73f1e6e-577c-40e1-8ffe-cf76bc3b498d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:25.973569 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b73f1e6e-577c-40e1-8ffe-cf76bc3b498d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:25.974024 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b73f1e6e-577c-40e1-8ffe-cf76bc3b498d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:26.092995 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-103c1285-72fe-4c97-9285-b51da2c744e5 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697ff4892d1f4c559523990779ccfaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2759ed7f36eb4693aa74b76f7907899e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:26.105236 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-103c1285-72fe-4c97-9285-b51da2c744e5 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] 10.222.0.20 "GET /compute/v2.1/servers/89a512b5-8107-4c63-8387-69892fc7e5f4" status: 200 len: 1666 microversion: 2.1 time: 0.284164 Oct 04 18:34:26.116289 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 786/1652] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:25 2022] GET /compute/v2.1/servers/89a512b5-8107-4c63-8387-69892fc7e5f4 => generated 1666 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:26.124261 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8a400c3f-6e7d-4c77-b13e-635c2c3eeacf tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:26.129974 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8a400c3f-6e7d-4c77-b13e-635c2c3eeacf tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2fe6c508-f183-40bd-bfd5-23c757e99a05] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:26.148663 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8a400c3f-6e7d-4c77-b13e-635c2c3eeacf tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:26.149648 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8a400c3f-6e7d-4c77-b13e-635c2c3eeacf tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:26.149648 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8a400c3f-6e7d-4c77-b13e-635c2c3eeacf tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:26.152759 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8a400c3f-6e7d-4c77-b13e-635c2c3eeacf tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:26.152759 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8a400c3f-6e7d-4c77-b13e-635c2c3eeacf tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:26.152759 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8a400c3f-6e7d-4c77-b13e-635c2c3eeacf tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:26.177110 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b73f1e6e-577c-40e1-8ffe-cf76bc3b498d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:26.186088 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b73f1e6e-577c-40e1-8ffe-cf76bc3b498d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4" status: 200 len: 1719 microversion: 2.1 time: 0.233135 Oct 04 18:34:26.186663 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 867/1653] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:25 2022] GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4 => generated 1719 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:26.311476 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8a400c3f-6e7d-4c77-b13e-635c2c3eeacf tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:26.321070 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8a400c3f-6e7d-4c77-b13e-635c2c3eeacf tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05" status: 200 len: 1313 microversion: 2.1 time: 0.202751 Oct 04 18:34:26.322472 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 787/1654] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:26 2022] GET /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05 => generated 1313 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:26.372352 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-37d16840-5952-487a-a6dd-9a7091885e2c tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:26.372985 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-37d16840-5952-487a-a6dd-9a7091885e2c tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: b219d988-2847-45a0-a3b8-af54cf1a43f8] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:26.382014 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-37d16840-5952-487a-a6dd-9a7091885e2c tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:26.382573 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-37d16840-5952-487a-a6dd-9a7091885e2c tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:26.382989 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-37d16840-5952-487a-a6dd-9a7091885e2c tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:26.383728 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-37d16840-5952-487a-a6dd-9a7091885e2c tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:26.384614 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-37d16840-5952-487a-a6dd-9a7091885e2c tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:26.385091 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-37d16840-5952-487a-a6dd-9a7091885e2c tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:26.523172 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ce9e2d3a-4ce0-451a-8b59-a533e22a83bc tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:26.523932 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ce9e2d3a-4ce0-451a-8b59-a533e22a83bc tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:26.530719 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ce9e2d3a-4ce0-451a-8b59-a533e22a83bc tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:26.532639 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ce9e2d3a-4ce0-451a-8b59-a533e22a83bc tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:26.533369 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ce9e2d3a-4ce0-451a-8b59-a533e22a83bc tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:26.534935 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ce9e2d3a-4ce0-451a-8b59-a533e22a83bc tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:26.536717 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ce9e2d3a-4ce0-451a-8b59-a533e22a83bc tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:26.537175 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ce9e2d3a-4ce0-451a-8b59-a533e22a83bc tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:26.699670 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ce9e2d3a-4ce0-451a-8b59-a533e22a83bc tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:26.726383 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ce9e2d3a-4ce0-451a-8b59-a533e22a83bc tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:26.727718 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-37d16840-5952-487a-a6dd-9a7091885e2c tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:26.734148 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ce9e2d3a-4ce0-451a-8b59-a533e22a83bc tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:26.737197 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-37d16840-5952-487a-a6dd-9a7091885e2c tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:26.745426 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ce9e2d3a-4ce0-451a-8b59-a533e22a83bc tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1544 microversion: 2.91 time: 0.228864 Oct 04 18:34:26.746740 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-37d16840-5952-487a-a6dd-9a7091885e2c tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:26.748633 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-37d16840-5952-487a-a6dd-9a7091885e2c tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8" status: 200 len: 1811 microversion: 2.25 time: 0.380985 Oct 04 18:34:26.749202 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 868/1655] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:26 2022] GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8 => generated 1811 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:26.755490 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9961831e-03f0-433b-999e-a27e92d0324e tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:26.764379 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9961831e-03f0-433b-999e-a27e92d0324e tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: 0fa89d74-e5c4-461c-adcc-6c29ce9ad8db] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:26.764671 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 788/1656] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:26 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1544 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:34:26.794983 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9961831e-03f0-433b-999e-a27e92d0324e tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:26.795509 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9961831e-03f0-433b-999e-a27e92d0324e tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:26.795941 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9961831e-03f0-433b-999e-a27e92d0324e tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:26.796708 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9961831e-03f0-433b-999e-a27e92d0324e tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:26.797167 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9961831e-03f0-433b-999e-a27e92d0324e tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:26.797596 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9961831e-03f0-433b-999e-a27e92d0324e tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:26.967759 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b59eb3c2-7ad3-4ca4-81b3-2d24dc0b1860 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:26.969685 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b59eb3c2-7ad3-4ca4-81b3-2d24dc0b1860 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] [instance: d3abc28f-8361-4906-a085-1440991c298f] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:26.977710 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b59eb3c2-7ad3-4ca4-81b3-2d24dc0b1860 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:26.979281 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b59eb3c2-7ad3-4ca4-81b3-2d24dc0b1860 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:26.979974 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b59eb3c2-7ad3-4ca4-81b3-2d24dc0b1860 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:26.980949 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b59eb3c2-7ad3-4ca4-81b3-2d24dc0b1860 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:26.982248 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b59eb3c2-7ad3-4ca4-81b3-2d24dc0b1860 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:26.982903 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b59eb3c2-7ad3-4ca4-81b3-2d24dc0b1860 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:27.039247 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9961831e-03f0-433b-999e-a27e92d0324e tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:27.065255 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9961831e-03f0-433b-999e-a27e92d0324e tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/0fa89d74-e5c4-461c-adcc-6c29ce9ad8db" status: 200 len: 1307 microversion: 2.1 time: 0.313956 Oct 04 18:34:27.081188 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 869/1657] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:26 2022] GET /compute/v2.1/servers/0fa89d74-e5c4-461c-adcc-6c29ce9ad8db => generated 1307 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:27.130808 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-86a2881f-ff90-454b-91cd-47f0a399bfba tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:27.131425 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-86a2881f-ff90-454b-91cd-47f0a399bfba tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] [instance: 89a512b5-8107-4c63-8387-69892fc7e5f4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:27.141082 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-86a2881f-ff90-454b-91cd-47f0a399bfba tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:27.142091 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-86a2881f-ff90-454b-91cd-47f0a399bfba tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:27.142904 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-86a2881f-ff90-454b-91cd-47f0a399bfba tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:27.144283 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-86a2881f-ff90-454b-91cd-47f0a399bfba tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:27.145502 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-86a2881f-ff90-454b-91cd-47f0a399bfba tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:27.146598 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-86a2881f-ff90-454b-91cd-47f0a399bfba tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:27.232850 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b59eb3c2-7ad3-4ca4-81b3-2d24dc0b1860 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44cc98e07d134a15b0fbf2b80bd25ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e0b0088d8476bbcb4c83783fec0e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:27.242639 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b59eb3c2-7ad3-4ca4-81b3-2d24dc0b1860 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] 10.222.0.20 "GET /compute/v2.1/servers/d3abc28f-8361-4906-a085-1440991c298f" status: 200 len: 1318 microversion: 2.1 time: 0.279112 Oct 04 18:34:27.243741 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 789/1658] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:26 2022] GET /compute/v2.1/servers/d3abc28f-8361-4906-a085-1440991c298f => generated 1318 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:27.257456 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6b16839c-2ecc-43f8-9265-276dc1889273 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:27.262099 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6b16839c-2ecc-43f8-9265-276dc1889273 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 158e9f52-fd16-48d1-87b5-e0dd523e97a4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:27.272113 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6b16839c-2ecc-43f8-9265-276dc1889273 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:27.272614 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6b16839c-2ecc-43f8-9265-276dc1889273 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:27.273057 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6b16839c-2ecc-43f8-9265-276dc1889273 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:27.276106 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6b16839c-2ecc-43f8-9265-276dc1889273 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:27.276741 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6b16839c-2ecc-43f8-9265-276dc1889273 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:27.277182 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6b16839c-2ecc-43f8-9265-276dc1889273 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:27.520781 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-86a2881f-ff90-454b-91cd-47f0a399bfba tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697ff4892d1f4c559523990779ccfaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2759ed7f36eb4693aa74b76f7907899e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:27.527183 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=100 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:27.545332 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6b16839c-2ecc-43f8-9265-276dc1889273 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:27.551056 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:27.551212 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-86a2881f-ff90-454b-91cd-47f0a399bfba tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] 10.222.0.20 "GET /compute/v2.1/servers/89a512b5-8107-4c63-8387-69892fc7e5f4" status: 200 len: 1666 microversion: 2.1 time: 0.424517 Oct 04 18:34:27.552134 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 870/1659] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:27 2022] GET /compute/v2.1/servers/89a512b5-8107-4c63-8387-69892fc7e5f4 => generated 1666 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:27.557968 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e2d17da9-3396-4627-9c4a-bb2aad452211 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:27.574789 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6b16839c-2ecc-43f8-9265-276dc1889273 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4" status: 200 len: 1719 microversion: 2.1 time: 0.329883 Oct 04 18:34:27.576273 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 790/1660] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:27 2022] GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4 => generated 1719 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:27.580264 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e2d17da9-3396-4627-9c4a-bb2aad452211 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2fe6c508-f183-40bd-bfd5-23c757e99a05] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:27.598638 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e2d17da9-3396-4627-9c4a-bb2aad452211 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:27.600685 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e2d17da9-3396-4627-9c4a-bb2aad452211 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:27.601349 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e2d17da9-3396-4627-9c4a-bb2aad452211 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:27.604752 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e2d17da9-3396-4627-9c4a-bb2aad452211 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:27.605475 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e2d17da9-3396-4627-9c4a-bb2aad452211 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:27.606140 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e2d17da9-3396-4627-9c4a-bb2aad452211 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:27.785999 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f62f599d-ae2b-4726-8ba2-4d72344d4c1c tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:27.789438 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f62f599d-ae2b-4726-8ba2-4d72344d4c1c tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: b219d988-2847-45a0-a3b8-af54cf1a43f8] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:27.804098 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f62f599d-ae2b-4726-8ba2-4d72344d4c1c tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:27.804752 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f62f599d-ae2b-4726-8ba2-4d72344d4c1c tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:27.806829 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f62f599d-ae2b-4726-8ba2-4d72344d4c1c tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:27.806829 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f62f599d-ae2b-4726-8ba2-4d72344d4c1c tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:27.806829 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f62f599d-ae2b-4726-8ba2-4d72344d4c1c tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:27.812366 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f62f599d-ae2b-4726-8ba2-4d72344d4c1c tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:27.871257 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:27.917710 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e2d17da9-3396-4627-9c4a-bb2aad452211 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:27.933157 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e2d17da9-3396-4627-9c4a-bb2aad452211 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05" status: 200 len: 1313 microversion: 2.1 time: 0.379208 Oct 04 18:34:27.936919 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 871/1661] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:27 2022] GET /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05 => generated 1313 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:27.950164 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-45ebab76-af45-4232-87d6-181b8e65d9e0 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:27.951181 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-45ebab76-af45-4232-87d6-181b8e65d9e0 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:27.966900 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-45ebab76-af45-4232-87d6-181b8e65d9e0 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:27.969191 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-45ebab76-af45-4232-87d6-181b8e65d9e0 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:27.969838 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-45ebab76-af45-4232-87d6-181b8e65d9e0 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:27.970743 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-45ebab76-af45-4232-87d6-181b8e65d9e0 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:27.974826 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-45ebab76-af45-4232-87d6-181b8e65d9e0 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:27.976800 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-45ebab76-af45-4232-87d6-181b8e65d9e0 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:28.118483 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-45ebab76-af45-4232-87d6-181b8e65d9e0 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:28.127451 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-45ebab76-af45-4232-87d6-181b8e65d9e0 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:28.133079 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-45ebab76-af45-4232-87d6-181b8e65d9e0 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:28.141393 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f62f599d-ae2b-4726-8ba2-4d72344d4c1c tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:28.144020 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-45ebab76-af45-4232-87d6-181b8e65d9e0 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1544 microversion: 2.91 time: 0.205763 Oct 04 18:34:28.158881 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f62f599d-ae2b-4726-8ba2-4d72344d4c1c tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:28.161234 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 872/1662] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:27 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1544 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:28.170208 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f62f599d-ae2b-4726-8ba2-4d72344d4c1c tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:28.170208 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f62f599d-ae2b-4726-8ba2-4d72344d4c1c tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8" status: 200 len: 1811 microversion: 2.25 time: 0.389819 Oct 04 18:34:28.170208 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 791/1663] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:27 2022] GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8 => generated 1811 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:34:28.174875 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0b570ded-5f35-47eb-a977-fad51bdd2192 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:28.176363 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0b570ded-5f35-47eb-a977-fad51bdd2192 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: 0fa89d74-e5c4-461c-adcc-6c29ce9ad8db] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:28.179721 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7300cee3-b2f4-436b-ac56-be0f1977f73a tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:28.191387 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0b570ded-5f35-47eb-a977-fad51bdd2192 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:28.191719 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7300cee3-b2f4-436b-ac56-be0f1977f73a tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '71bed3af030c43dbaa23a3e23520f407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7808c2a8d8491aa5e1594383fab2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:28.192659 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7300cee3-b2f4-436b-ac56-be0f1977f73a tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Searching by: {'deleted': False, 'project_id': 'bc7808c2a8d8491aa5e1594383fab2a3'} {{(pid=123001) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:34:28.192803 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0b570ded-5f35-47eb-a977-fad51bdd2192 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:28.193535 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0b570ded-5f35-47eb-a977-fad51bdd2192 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:28.194638 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0b570ded-5f35-47eb-a977-fad51bdd2192 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:28.195725 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0b570ded-5f35-47eb-a977-fad51bdd2192 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:28.196406 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0b570ded-5f35-47eb-a977-fad51bdd2192 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:28.205133 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7300cee3-b2f4-436b-ac56-be0f1977f73a tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:28.210276 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7300cee3-b2f4-436b-ac56-be0f1977f73a tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:28.210829 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7300cee3-b2f4-436b-ac56-be0f1977f73a tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:28.211731 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7300cee3-b2f4-436b-ac56-be0f1977f73a tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:28.212315 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7300cee3-b2f4-436b-ac56-be0f1977f73a tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:28.212821 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7300cee3-b2f4-436b-ac56-be0f1977f73a tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:28.251636 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.multi_cell_list [None req-7300cee3-b2f4-436b-ac56-be0f1977f73a tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123001) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:34:28.299319 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7300cee3-b2f4-436b-ac56-be0f1977f73a tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.133558 Oct 04 18:34:28.301411 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 792/1664] 10.222.0.20 () {58 vars in 1125 bytes} [Tue Oct 4 18:34:28 2022] GET /compute/v2.1/servers => generated 334 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:34:28.306326 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5653582a-351a-47fb-9f6f-063c2930bff3 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:28.307507 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5653582a-351a-47fb-9f6f-063c2930bff3 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] [instance: d3abc28f-8361-4906-a085-1440991c298f] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:28.314410 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5653582a-351a-47fb-9f6f-063c2930bff3 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:28.315260 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5653582a-351a-47fb-9f6f-063c2930bff3 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:28.317808 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5653582a-351a-47fb-9f6f-063c2930bff3 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:28.318619 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5653582a-351a-47fb-9f6f-063c2930bff3 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:28.319093 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5653582a-351a-47fb-9f6f-063c2930bff3 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:28.319527 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5653582a-351a-47fb-9f6f-063c2930bff3 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:28.421080 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0b570ded-5f35-47eb-a977-fad51bdd2192 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:28.441921 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0b570ded-5f35-47eb-a977-fad51bdd2192 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/0fa89d74-e5c4-461c-adcc-6c29ce9ad8db" status: 200 len: 1307 microversion: 2.1 time: 0.268000 Oct 04 18:34:28.441921 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 873/1665] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:28 2022] GET /compute/v2.1/servers/0fa89d74-e5c4-461c-adcc-6c29ce9ad8db => generated 1307 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:28.441921 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-70c81f64-508a-47de-9cd3-eac1f2f361dd tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:28.443013 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-70c81f64-508a-47de-9cd3-eac1f2f361dd tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '71bed3af030c43dbaa23a3e23520f407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7808c2a8d8491aa5e1594383fab2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:28.443845 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-70c81f64-508a-47de-9cd3-eac1f2f361dd tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Searching by: {'deleted': False, 'project_id': 'bc7808c2a8d8491aa5e1594383fab2a3'} {{(pid=123002) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:34:28.457537 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-70c81f64-508a-47de-9cd3-eac1f2f361dd tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:28.457537 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-70c81f64-508a-47de-9cd3-eac1f2f361dd tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:28.457537 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-70c81f64-508a-47de-9cd3-eac1f2f361dd tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:28.458025 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-70c81f64-508a-47de-9cd3-eac1f2f361dd tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:28.458302 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-70c81f64-508a-47de-9cd3-eac1f2f361dd tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:28.458714 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-70c81f64-508a-47de-9cd3-eac1f2f361dd tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:28.527176 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5653582a-351a-47fb-9f6f-063c2930bff3 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44cc98e07d134a15b0fbf2b80bd25ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e0b0088d8476bbcb4c83783fec0e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:28.535944 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5653582a-351a-47fb-9f6f-063c2930bff3 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] 10.222.0.20 "GET /compute/v2.1/servers/d3abc28f-8361-4906-a085-1440991c298f" status: 200 len: 1318 microversion: 2.1 time: 0.233099 Oct 04 18:34:28.536571 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 793/1666] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:28 2022] GET /compute/v2.1/servers/d3abc28f-8361-4906-a085-1440991c298f => generated 1318 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:28.555753 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.multi_cell_list [None req-70c81f64-508a-47de-9cd3-eac1f2f361dd tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123002) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:34:28.576260 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ae75bb1f-416f-46cb-8103-4a0912cab1a1 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:28.580591 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ae75bb1f-416f-46cb-8103-4a0912cab1a1 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] [instance: 89a512b5-8107-4c63-8387-69892fc7e5f4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:28.590713 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ae75bb1f-416f-46cb-8103-4a0912cab1a1 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:28.591425 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ae75bb1f-416f-46cb-8103-4a0912cab1a1 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:28.592303 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ae75bb1f-416f-46cb-8103-4a0912cab1a1 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:28.593185 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ae75bb1f-416f-46cb-8103-4a0912cab1a1 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:28.593837 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ae75bb1f-416f-46cb-8103-4a0912cab1a1 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:28.594420 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ae75bb1f-416f-46cb-8103-4a0912cab1a1 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:28.690281 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-70c81f64-508a-47de-9cd3-eac1f2f361dd tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bed3af030c43dbaa23a3e23520f407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7808c2a8d8491aa5e1594383fab2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:28.698867 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-70c81f64-508a-47de-9cd3-eac1f2f361dd tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:28.699775 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-70c81f64-508a-47de-9cd3-eac1f2f361dd tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:28.700142 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-70c81f64-508a-47de-9cd3-eac1f2f361dd tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:28.845328 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ae75bb1f-416f-46cb-8103-4a0912cab1a1 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697ff4892d1f4c559523990779ccfaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2759ed7f36eb4693aa74b76f7907899e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:28.855536 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ae75bb1f-416f-46cb-8103-4a0912cab1a1 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] 10.222.0.20 "GET /compute/v2.1/servers/89a512b5-8107-4c63-8387-69892fc7e5f4" status: 200 len: 1666 microversion: 2.1 time: 0.283229 Oct 04 18:34:28.872761 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 794/1667] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:28 2022] GET /compute/v2.1/servers/89a512b5-8107-4c63-8387-69892fc7e5f4 => generated 1666 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:34:28.878058 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-562231ca-6a0d-44f4-8f2f-c0192ef1a9d7 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:28.879695 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-562231ca-6a0d-44f4-8f2f-c0192ef1a9d7 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 158e9f52-fd16-48d1-87b5-e0dd523e97a4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:28.887731 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-562231ca-6a0d-44f4-8f2f-c0192ef1a9d7 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:28.888587 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-562231ca-6a0d-44f4-8f2f-c0192ef1a9d7 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:28.889098 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-562231ca-6a0d-44f4-8f2f-c0192ef1a9d7 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:28.889720 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-562231ca-6a0d-44f4-8f2f-c0192ef1a9d7 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:28.890253 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-562231ca-6a0d-44f4-8f2f-c0192ef1a9d7 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:28.891839 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-562231ca-6a0d-44f4-8f2f-c0192ef1a9d7 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:28.916309 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-70c81f64-508a-47de-9cd3-eac1f2f361dd tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] 10.222.0.20 "GET /compute/v2.1/servers/detail" status: 200 len: 1697 microversion: 2.1 time: 0.483902 Oct 04 18:34:28.917267 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 874/1668] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Oct 4 18:34:28 2022] GET /compute/v2.1/servers/detail => generated 1697 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:28.922272 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-f2c891c5-7892-4590-82ea-44a3a5a418e8 req-11eb4b9a-2b96-4ffc-96bf-8d4145f23d0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fa89d74-e5c4-461c-adcc-6c29ce9ad8db", "tag": "59347bf8-4a31-4a7c-ad79-7b1486886df8"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:28.936774 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-f2c891c5-7892-4590-82ea-44a3a5a418e8 req-11eb4b9a-2b96-4ffc-96bf-8d4145f23d0d service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:28.937113 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-f2c891c5-7892-4590-82ea-44a3a5a418e8 req-11eb4b9a-2b96-4ffc-96bf-8d4145f23d0d service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:28.937804 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-f2c891c5-7892-4590-82ea-44a3a5a418e8 req-11eb4b9a-2b96-4ffc-96bf-8d4145f23d0d service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:28.960987 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-f2c891c5-7892-4590-82ea-44a3a5a418e8 req-11eb4b9a-2b96-4ffc-96bf-8d4145f23d0d service nova] Creating event network-changed:59347bf8-4a31-4a7c-ad79-7b1486886df8 for instance 0fa89d74-e5c4-461c-adcc-6c29ce9ad8db on n-h1-850501-14 Oct 04 18:34:28.965995 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-f2c891c5-7892-4590-82ea-44a3a5a418e8 req-11eb4b9a-2b96-4ffc-96bf-8d4145f23d0d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047541 Oct 04 18:34:28.966770 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 875/1669] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:34:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:34:28.977994 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-a8b4433f-14ac-42a4-8eb4-bd47e1b0df9c req-498f8e6d-4379-4487-ba8a-8d8f6186bae8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8c84d9e-2274-49dd-99e9-cbd7222c22d5", "name": "network-vif-unplugged", "status": "completed", "tag": "84624e18-aa6c-4e5b-a8b8-776adc3416b5"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:28.983167 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-a8b4433f-14ac-42a4-8eb4-bd47e1b0df9c req-498f8e6d-4379-4487-ba8a-8d8f6186bae8 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:28.983655 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-a8b4433f-14ac-42a4-8eb4-bd47e1b0df9c req-498f8e6d-4379-4487-ba8a-8d8f6186bae8 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:28.984127 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-a8b4433f-14ac-42a4-8eb4-bd47e1b0df9c req-498f8e6d-4379-4487-ba8a-8d8f6186bae8 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:29.002452 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-a8b4433f-14ac-42a4-8eb4-bd47e1b0df9c req-498f8e6d-4379-4487-ba8a-8d8f6186bae8 service nova] Creating event network-vif-unplugged:84624e18-aa6c-4e5b-a8b8-776adc3416b5 for instance c8c84d9e-2274-49dd-99e9-cbd7222c22d5 on n-h2-850501-14 Oct 04 18:34:29.010661 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-a8b4433f-14ac-42a4-8eb4-bd47e1b0df9c req-498f8e6d-4379-4487-ba8a-8d8f6186bae8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040713 Oct 04 18:34:29.010661 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 876/1670] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:34:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:34:29.016293 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-79c3fd3e-bb98-489c-8607-f3ae4d682fdd tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:29.037826 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-79c3fd3e-bb98-489c-8607-f3ae4d682fdd tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.021618 Oct 04 18:34:29.041145 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 877/1671] 10.222.0.20 () {58 vars in 1137 bytes} [Tue Oct 4 18:34:29 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:34:29.049128 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-447db600-eea0-4073-afd2-8dc1e8df3892 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:29.049928 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-447db600-eea0-4073-afd2-8dc1e8df3892 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2fe6c508-f183-40bd-bfd5-23c757e99a05] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:29.059481 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-447db600-eea0-4073-afd2-8dc1e8df3892 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:29.059973 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-447db600-eea0-4073-afd2-8dc1e8df3892 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:29.065888 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-447db600-eea0-4073-afd2-8dc1e8df3892 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:29.065888 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-447db600-eea0-4073-afd2-8dc1e8df3892 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:29.065888 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-447db600-eea0-4073-afd2-8dc1e8df3892 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:29.065888 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-447db600-eea0-4073-afd2-8dc1e8df3892 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:29.099898 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-562231ca-6a0d-44f4-8f2f-c0192ef1a9d7 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:29.109236 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-562231ca-6a0d-44f4-8f2f-c0192ef1a9d7 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4" status: 200 len: 1719 microversion: 2.1 time: 0.235163 Oct 04 18:34:29.111821 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 795/1672] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:28 2022] GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4 => generated 1719 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:29.179944 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5b96105c-0420-4b25-bfb0-8eba306c27dd tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:29.180710 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5b96105c-0420-4b25-bfb0-8eba306c27dd tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:29.188695 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5b96105c-0420-4b25-bfb0-8eba306c27dd tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:29.188695 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5b96105c-0420-4b25-bfb0-8eba306c27dd tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:29.188695 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5b96105c-0420-4b25-bfb0-8eba306c27dd tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:29.189707 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5b96105c-0420-4b25-bfb0-8eba306c27dd tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:29.190133 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5b96105c-0420-4b25-bfb0-8eba306c27dd tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:29.191656 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5b96105c-0420-4b25-bfb0-8eba306c27dd tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:29.215032 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-447db600-eea0-4073-afd2-8dc1e8df3892 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:29.223463 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-447db600-eea0-4073-afd2-8dc1e8df3892 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05" status: 200 len: 1313 microversion: 2.1 time: 0.180817 Oct 04 18:34:29.232111 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 878/1673] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:29 2022] GET /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05 => generated 1313 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:29.232111 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4b2babfa-ff82-49f1-86a0-27d433fb8021 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:29.232111 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4b2babfa-ff82-49f1-86a0-27d433fb8021 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: b219d988-2847-45a0-a3b8-af54cf1a43f8] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:29.236142 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4b2babfa-ff82-49f1-86a0-27d433fb8021 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:29.243924 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4b2babfa-ff82-49f1-86a0-27d433fb8021 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:29.243924 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4b2babfa-ff82-49f1-86a0-27d433fb8021 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:29.243924 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4b2babfa-ff82-49f1-86a0-27d433fb8021 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:29.243924 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4b2babfa-ff82-49f1-86a0-27d433fb8021 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:29.243924 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4b2babfa-ff82-49f1-86a0-27d433fb8021 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:29.262766 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5b96105c-0420-4b25-bfb0-8eba306c27dd tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:29.273058 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5b96105c-0420-4b25-bfb0-8eba306c27dd tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:29.274482 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5b96105c-0420-4b25-bfb0-8eba306c27dd tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:29.279892 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5b96105c-0420-4b25-bfb0-8eba306c27dd tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1544 microversion: 2.91 time: 0.105892 Oct 04 18:34:29.284096 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 796/1674] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:29 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1544 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:29.359936 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-066d4b55-6bf3-4b31-b762-461ada6e0558 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:29.360471 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-066d4b55-6bf3-4b31-b762-461ada6e0558 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] [instance: bc418c02-1d95-407f-bbda-c696e9ba5959] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:29.368492 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-066d4b55-6bf3-4b31-b762-461ada6e0558 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:29.368989 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-066d4b55-6bf3-4b31-b762-461ada6e0558 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:29.369425 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-066d4b55-6bf3-4b31-b762-461ada6e0558 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:29.370291 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-066d4b55-6bf3-4b31-b762-461ada6e0558 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:29.370807 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-066d4b55-6bf3-4b31-b762-461ada6e0558 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:29.371234 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-066d4b55-6bf3-4b31-b762-461ada6e0558 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:29.404591 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-066d4b55-6bf3-4b31-b762-461ada6e0558 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] [instance: bc418c02-1d95-407f-bbda-c696e9ba5959] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:34:29.405581 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4b2babfa-ff82-49f1-86a0-27d433fb8021 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:29.416113 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4b2babfa-ff82-49f1-86a0-27d433fb8021 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:29.417789 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4b2babfa-ff82-49f1-86a0-27d433fb8021 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:29.419045 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4b2babfa-ff82-49f1-86a0-27d433fb8021 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8" status: 200 len: 1811 microversion: 2.25 time: 0.193942 Oct 04 18:34:29.433340 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 879/1675] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:29 2022] GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8 => generated 1811 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:29.456569 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e0b90aae-93f6-4650-937e-07d7bce0fb9d tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:29.457224 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e0b90aae-93f6-4650-937e-07d7bce0fb9d tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: 0fa89d74-e5c4-461c-adcc-6c29ce9ad8db] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:29.468784 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e0b90aae-93f6-4650-937e-07d7bce0fb9d tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:29.468784 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e0b90aae-93f6-4650-937e-07d7bce0fb9d tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:29.468784 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e0b90aae-93f6-4650-937e-07d7bce0fb9d tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:29.468784 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e0b90aae-93f6-4650-937e-07d7bce0fb9d tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:29.468784 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e0b90aae-93f6-4650-937e-07d7bce0fb9d tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:29.468784 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e0b90aae-93f6-4650-937e-07d7bce0fb9d tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:29.615657 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e0b90aae-93f6-4650-937e-07d7bce0fb9d tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:29.623963 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e0b90aae-93f6-4650-937e-07d7bce0fb9d tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/0fa89d74-e5c4-461c-adcc-6c29ce9ad8db" status: 200 len: 1307 microversion: 2.1 time: 0.171745 Oct 04 18:34:29.635520 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 880/1676] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:29 2022] GET /compute/v2.1/servers/0fa89d74-e5c4-461c-adcc-6c29ce9ad8db => generated 1307 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:34:29.647701 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-285928fe-a8da-4055-913f-ae994a4b169c tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:29.648845 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-285928fe-a8da-4055-913f-ae994a4b169c tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] [instance: d3abc28f-8361-4906-a085-1440991c298f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:29.656635 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-285928fe-a8da-4055-913f-ae994a4b169c tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:29.660804 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-285928fe-a8da-4055-913f-ae994a4b169c tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:29.660804 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-285928fe-a8da-4055-913f-ae994a4b169c tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:29.660804 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-285928fe-a8da-4055-913f-ae994a4b169c tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:29.660804 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-285928fe-a8da-4055-913f-ae994a4b169c tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:29.661494 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-285928fe-a8da-4055-913f-ae994a4b169c tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:29.727196 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-066d4b55-6bf3-4b31-b762-461ada6e0558 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] 10.222.0.20 "DELETE /compute/v2.1/servers/bc418c02-1d95-407f-bbda-c696e9ba5959" status: 204 len: 0 microversion: 2.1 time: 0.370418 Oct 04 18:34:29.727817 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 797/1677] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:34:29 2022] DELETE /compute/v2.1/servers/bc418c02-1d95-407f-bbda-c696e9ba5959 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:34:29.749188 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b088b113-c9f3-4d28-b4cb-79a9a97e4b5a tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:29.750093 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b088b113-c9f3-4d28-b4cb-79a9a97e4b5a tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] [instance: bc418c02-1d95-407f-bbda-c696e9ba5959] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:29.757297 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b088b113-c9f3-4d28-b4cb-79a9a97e4b5a tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:29.758069 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b088b113-c9f3-4d28-b4cb-79a9a97e4b5a tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:29.758859 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b088b113-c9f3-4d28-b4cb-79a9a97e4b5a tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:29.760015 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b088b113-c9f3-4d28-b4cb-79a9a97e4b5a tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:29.760948 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b088b113-c9f3-4d28-b4cb-79a9a97e4b5a tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:29.761551 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b088b113-c9f3-4d28-b4cb-79a9a97e4b5a tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:29.861307 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-285928fe-a8da-4055-913f-ae994a4b169c tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44cc98e07d134a15b0fbf2b80bd25ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e0b0088d8476bbcb4c83783fec0e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:29.871476 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-285928fe-a8da-4055-913f-ae994a4b169c tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] 10.222.0.20 "GET /compute/v2.1/servers/d3abc28f-8361-4906-a085-1440991c298f" status: 200 len: 1318 microversion: 2.1 time: 0.233900 Oct 04 18:34:29.888091 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 881/1678] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:29 2022] GET /compute/v2.1/servers/d3abc28f-8361-4906-a085-1440991c298f => generated 1318 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:29.888091 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-425e29de-9095-4669-9010-8f5aea0f47ff tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:29.888091 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-425e29de-9095-4669-9010-8f5aea0f47ff tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] [instance: 89a512b5-8107-4c63-8387-69892fc7e5f4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:29.892346 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-425e29de-9095-4669-9010-8f5aea0f47ff tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:29.892933 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-425e29de-9095-4669-9010-8f5aea0f47ff tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:29.893437 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-425e29de-9095-4669-9010-8f5aea0f47ff tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:29.894776 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-425e29de-9095-4669-9010-8f5aea0f47ff tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:29.895302 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-425e29de-9095-4669-9010-8f5aea0f47ff tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:29.895796 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-425e29de-9095-4669-9010-8f5aea0f47ff tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:29.930719 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b088b113-c9f3-4d28-b4cb-79a9a97e4b5a tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bed3af030c43dbaa23a3e23520f407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7808c2a8d8491aa5e1594383fab2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:29.940277 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b088b113-c9f3-4d28-b4cb-79a9a97e4b5a tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] 10.222.0.20 "GET /compute/v2.1/servers/bc418c02-1d95-407f-bbda-c696e9ba5959" status: 200 len: 1700 microversion: 2.1 time: 0.195507 Oct 04 18:34:29.941330 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 798/1679] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:29 2022] GET /compute/v2.1/servers/bc418c02-1d95-407f-bbda-c696e9ba5959 => generated 1700 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:34:29.963282 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-425e29de-9095-4669-9010-8f5aea0f47ff tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697ff4892d1f4c559523990779ccfaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2759ed7f36eb4693aa74b76f7907899e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:29.971109 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-425e29de-9095-4669-9010-8f5aea0f47ff tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] 10.222.0.20 "GET /compute/v2.1/servers/89a512b5-8107-4c63-8387-69892fc7e5f4" status: 200 len: 1598 microversion: 2.1 time: 0.095605 Oct 04 18:34:29.971664 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 882/1680] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:29 2022] GET /compute/v2.1/servers/89a512b5-8107-4c63-8387-69892fc7e5f4 => generated 1598 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:30.133059 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7b22f712-fc47-4ac5-a4b5-b88c833f1402 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:30.133670 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7b22f712-fc47-4ac5-a4b5-b88c833f1402 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 158e9f52-fd16-48d1-87b5-e0dd523e97a4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:30.139567 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7b22f712-fc47-4ac5-a4b5-b88c833f1402 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:30.140077 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7b22f712-fc47-4ac5-a4b5-b88c833f1402 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:30.140521 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7b22f712-fc47-4ac5-a4b5-b88c833f1402 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:30.141219 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7b22f712-fc47-4ac5-a4b5-b88c833f1402 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:30.141676 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7b22f712-fc47-4ac5-a4b5-b88c833f1402 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:30.142105 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7b22f712-fc47-4ac5-a4b5-b88c833f1402 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:30.248568 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-30690711-d7df-4324-afc4-891957ee2ec8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:30.250076 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-30690711-d7df-4324-afc4-891957ee2ec8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2fe6c508-f183-40bd-bfd5-23c757e99a05] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:30.259708 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-30690711-d7df-4324-afc4-891957ee2ec8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:30.260363 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-30690711-d7df-4324-afc4-891957ee2ec8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:30.261022 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-30690711-d7df-4324-afc4-891957ee2ec8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:30.262179 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-30690711-d7df-4324-afc4-891957ee2ec8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:30.263262 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-30690711-d7df-4324-afc4-891957ee2ec8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:30.263768 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-30690711-d7df-4324-afc4-891957ee2ec8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:30.285630 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7b22f712-fc47-4ac5-a4b5-b88c833f1402 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:30.294989 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7b22f712-fc47-4ac5-a4b5-b88c833f1402 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4" status: 200 len: 1719 microversion: 2.1 time: 0.165709 Oct 04 18:34:30.304247 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 799/1681] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:30 2022] GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4 => generated 1719 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:30.313986 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-db68e80f-42fa-4ce6-82b7-7542723a78f9 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:30.314604 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-db68e80f-42fa-4ce6-82b7-7542723a78f9 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:30.322316 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-db68e80f-42fa-4ce6-82b7-7542723a78f9 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:30.322316 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-db68e80f-42fa-4ce6-82b7-7542723a78f9 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:30.322530 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-db68e80f-42fa-4ce6-82b7-7542723a78f9 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:30.323061 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-db68e80f-42fa-4ce6-82b7-7542723a78f9 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:30.323533 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-db68e80f-42fa-4ce6-82b7-7542723a78f9 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:30.323961 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-db68e80f-42fa-4ce6-82b7-7542723a78f9 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:30.436130 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-db68e80f-42fa-4ce6-82b7-7542723a78f9 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:30.449349 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-db68e80f-42fa-4ce6-82b7-7542723a78f9 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:30.455948 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-db68e80f-42fa-4ce6-82b7-7542723a78f9 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:30.466755 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-db68e80f-42fa-4ce6-82b7-7542723a78f9 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1544 microversion: 2.91 time: 0.157388 Oct 04 18:34:30.467348 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 800/1682] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:30 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1544 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:30.489233 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5a89d778-f510-4320-ae39-7ebcba6fc348 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:30.489233 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5a89d778-f510-4320-ae39-7ebcba6fc348 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: b219d988-2847-45a0-a3b8-af54cf1a43f8] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:30.489918 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-30690711-d7df-4324-afc4-891957ee2ec8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:30.497988 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5a89d778-f510-4320-ae39-7ebcba6fc348 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:30.498153 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5a89d778-f510-4320-ae39-7ebcba6fc348 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:30.498637 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5a89d778-f510-4320-ae39-7ebcba6fc348 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:30.499476 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5a89d778-f510-4320-ae39-7ebcba6fc348 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:30.500076 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5a89d778-f510-4320-ae39-7ebcba6fc348 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:30.500650 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5a89d778-f510-4320-ae39-7ebcba6fc348 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:30.512120 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-30690711-d7df-4324-afc4-891957ee2ec8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05" status: 200 len: 1313 microversion: 2.1 time: 0.268513 Oct 04 18:34:30.513204 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 883/1683] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:30 2022] GET /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05 => generated 1313 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:34:30.657676 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5a89d778-f510-4320-ae39-7ebcba6fc348 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:30.660912 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-94ec0ec8-3e6c-4aa8-9f3d-87ab635d3342 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:30.661457 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-94ec0ec8-3e6c-4aa8-9f3d-87ab635d3342 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: 0fa89d74-e5c4-461c-adcc-6c29ce9ad8db] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:30.668752 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-94ec0ec8-3e6c-4aa8-9f3d-87ab635d3342 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:30.669259 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5a89d778-f510-4320-ae39-7ebcba6fc348 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:30.669544 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-94ec0ec8-3e6c-4aa8-9f3d-87ab635d3342 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:30.669900 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-94ec0ec8-3e6c-4aa8-9f3d-87ab635d3342 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:30.670601 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-94ec0ec8-3e6c-4aa8-9f3d-87ab635d3342 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:30.670789 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5a89d778-f510-4320-ae39-7ebcba6fc348 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:30.671054 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-94ec0ec8-3e6c-4aa8-9f3d-87ab635d3342 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:30.671479 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-94ec0ec8-3e6c-4aa8-9f3d-87ab635d3342 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:30.671967 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5a89d778-f510-4320-ae39-7ebcba6fc348 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8" status: 200 len: 1811 microversion: 2.25 time: 0.201437 Oct 04 18:34:30.676009 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 801/1684] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:30 2022] GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8 => generated 1811 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:30.821500 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-94ec0ec8-3e6c-4aa8-9f3d-87ab635d3342 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:30.829308 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-94ec0ec8-3e6c-4aa8-9f3d-87ab635d3342 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/0fa89d74-e5c4-461c-adcc-6c29ce9ad8db" status: 200 len: 1307 microversion: 2.1 time: 0.172956 Oct 04 18:34:30.829884 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 884/1685] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:30 2022] GET /compute/v2.1/servers/0fa89d74-e5c4-461c-adcc-6c29ce9ad8db => generated 1307 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:30.898553 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-defdc202-a5fd-4e1d-8994-bf17a09bf9c4 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:30.899160 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-defdc202-a5fd-4e1d-8994-bf17a09bf9c4 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] [instance: d3abc28f-8361-4906-a085-1440991c298f] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:30.905626 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-defdc202-a5fd-4e1d-8994-bf17a09bf9c4 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:30.906103 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-defdc202-a5fd-4e1d-8994-bf17a09bf9c4 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:30.906550 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-defdc202-a5fd-4e1d-8994-bf17a09bf9c4 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:30.907210 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-defdc202-a5fd-4e1d-8994-bf17a09bf9c4 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:30.907733 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-defdc202-a5fd-4e1d-8994-bf17a09bf9c4 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:30.908181 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-defdc202-a5fd-4e1d-8994-bf17a09bf9c4 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:30.963424 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b9eed0d9-fe9a-4ea4-b954-d2e1c994a8ac tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:30.964303 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b9eed0d9-fe9a-4ea4-b954-d2e1c994a8ac tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] [instance: bc418c02-1d95-407f-bbda-c696e9ba5959] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:30.970576 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b9eed0d9-fe9a-4ea4-b954-d2e1c994a8ac tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:30.971399 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b9eed0d9-fe9a-4ea4-b954-d2e1c994a8ac tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:30.972510 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b9eed0d9-fe9a-4ea4-b954-d2e1c994a8ac tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:30.973526 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b9eed0d9-fe9a-4ea4-b954-d2e1c994a8ac tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:30.974094 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b9eed0d9-fe9a-4ea4-b954-d2e1c994a8ac tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:30.974644 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b9eed0d9-fe9a-4ea4-b954-d2e1c994a8ac tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:31.081360 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-defdc202-a5fd-4e1d-8994-bf17a09bf9c4 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44cc98e07d134a15b0fbf2b80bd25ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e0b0088d8476bbcb4c83783fec0e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:31.090123 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-defdc202-a5fd-4e1d-8994-bf17a09bf9c4 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] 10.222.0.20 "GET /compute/v2.1/servers/d3abc28f-8361-4906-a085-1440991c298f" status: 200 len: 1318 microversion: 2.1 time: 0.195376 Oct 04 18:34:31.090786 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 802/1686] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:30 2022] GET /compute/v2.1/servers/d3abc28f-8361-4906-a085-1440991c298f => generated 1318 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:34:31.104347 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-cfbd4a93-605e-42ed-96db-728cfb9fb2b4 req-64015475-8ec7-460c-893d-c286f4fdedc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89a512b5-8107-4c63-8387-69892fc7e5f4", "name": "network-vif-deleted", "tag": "92a0e1fe-3095-49a6-a363-561de4b984e4"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:31.104565 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-cfbd4a93-605e-42ed-96db-728cfb9fb2b4 req-64015475-8ec7-460c-893d-c286f4fdedc3 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:31.105252 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-cfbd4a93-605e-42ed-96db-728cfb9fb2b4 req-64015475-8ec7-460c-893d-c286f4fdedc3 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:31.105868 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-cfbd4a93-605e-42ed-96db-728cfb9fb2b4 req-64015475-8ec7-460c-893d-c286f4fdedc3 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:31.117038 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-cfbd4a93-605e-42ed-96db-728cfb9fb2b4 req-64015475-8ec7-460c-893d-c286f4fdedc3 service nova] Creating event network-vif-deleted:92a0e1fe-3095-49a6-a363-561de4b984e4 for instance 89a512b5-8107-4c63-8387-69892fc7e5f4 on n-h1-850501-14 Oct 04 18:34:31.121975 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-cfbd4a93-605e-42ed-96db-728cfb9fb2b4 req-64015475-8ec7-460c-893d-c286f4fdedc3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029956 Oct 04 18:34:31.122572 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 803/1687] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:34:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:34:31.127652 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d11806a9-2b1b-4b58-afcf-889351ebc942 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:31.129045 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d11806a9-2b1b-4b58-afcf-889351ebc942 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] [instance: 89a512b5-8107-4c63-8387-69892fc7e5f4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:31.135102 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d11806a9-2b1b-4b58-afcf-889351ebc942 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:31.135589 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d11806a9-2b1b-4b58-afcf-889351ebc942 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:31.136032 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d11806a9-2b1b-4b58-afcf-889351ebc942 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:31.136756 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d11806a9-2b1b-4b58-afcf-889351ebc942 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:31.137213 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d11806a9-2b1b-4b58-afcf-889351ebc942 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:31.137642 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d11806a9-2b1b-4b58-afcf-889351ebc942 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:31.141171 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b9eed0d9-fe9a-4ea4-b954-d2e1c994a8ac tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bed3af030c43dbaa23a3e23520f407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7808c2a8d8491aa5e1594383fab2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:31.149775 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b9eed0d9-fe9a-4ea4-b954-d2e1c994a8ac tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] 10.222.0.20 "GET /compute/v2.1/servers/bc418c02-1d95-407f-bbda-c696e9ba5959" status: 200 len: 1700 microversion: 2.1 time: 0.190197 Oct 04 18:34:31.150499 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 885/1688] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:30 2022] GET /compute/v2.1/servers/bc418c02-1d95-407f-bbda-c696e9ba5959 => generated 1700 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:31.164924 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-9af65249-0d10-4566-bf48-5e3e07ae1088 req-a5e6e2a7-eeb0-4de9-9489-b2627886ce51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fe6c508-f183-40bd-bfd5-23c757e99a05", "name": "network-vif-plugged", "status": "completed", "tag": "4ffbd68f-521b-46aa-9313-bc62980cacb6"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:31.174481 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-9af65249-0d10-4566-bf48-5e3e07ae1088 req-a5e6e2a7-eeb0-4de9-9489-b2627886ce51 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:31.174962 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-9af65249-0d10-4566-bf48-5e3e07ae1088 req-a5e6e2a7-eeb0-4de9-9489-b2627886ce51 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:31.175449 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-9af65249-0d10-4566-bf48-5e3e07ae1088 req-a5e6e2a7-eeb0-4de9-9489-b2627886ce51 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:31.186737 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-9af65249-0d10-4566-bf48-5e3e07ae1088 req-a5e6e2a7-eeb0-4de9-9489-b2627886ce51 service nova] Creating event network-vif-plugged:4ffbd68f-521b-46aa-9313-bc62980cacb6 for instance 2fe6c508-f183-40bd-bfd5-23c757e99a05 on n-h1-850501-14 Oct 04 18:34:31.192218 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-9af65249-0d10-4566-bf48-5e3e07ae1088 req-a5e6e2a7-eeb0-4de9-9489-b2627886ce51 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030908 Oct 04 18:34:31.192874 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 886/1689] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:34:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:34:31.203497 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d11806a9-2b1b-4b58-afcf-889351ebc942 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697ff4892d1f4c559523990779ccfaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2759ed7f36eb4693aa74b76f7907899e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:31.211891 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d11806a9-2b1b-4b58-afcf-889351ebc942 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] 10.222.0.20 "GET /compute/v2.1/servers/89a512b5-8107-4c63-8387-69892fc7e5f4" status: 200 len: 1311 microversion: 2.1 time: 0.088128 Oct 04 18:34:31.212487 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 804/1690] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:31 2022] GET /compute/v2.1/servers/89a512b5-8107-4c63-8387-69892fc7e5f4 => generated 1311 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:31.319771 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3ee0af42-d592-4382-af1c-fda4349d08c7 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:31.320420 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3ee0af42-d592-4382-af1c-fda4349d08c7 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 158e9f52-fd16-48d1-87b5-e0dd523e97a4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:31.326716 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3ee0af42-d592-4382-af1c-fda4349d08c7 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:31.327195 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3ee0af42-d592-4382-af1c-fda4349d08c7 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:31.327624 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3ee0af42-d592-4382-af1c-fda4349d08c7 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:31.328334 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3ee0af42-d592-4382-af1c-fda4349d08c7 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:31.328789 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3ee0af42-d592-4382-af1c-fda4349d08c7 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:31.329210 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3ee0af42-d592-4382-af1c-fda4349d08c7 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:31.462116 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3ee0af42-d592-4382-af1c-fda4349d08c7 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:31.470383 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3ee0af42-d592-4382-af1c-fda4349d08c7 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4" status: 200 len: 1719 microversion: 2.1 time: 0.155492 Oct 04 18:34:31.470943 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 887/1691] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:31 2022] GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4 => generated 1719 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:31.496339 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f3c48429-b5de-4917-94fd-f58ae1443f9a tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:31.496966 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f3c48429-b5de-4917-94fd-f58ae1443f9a tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:31.502899 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f3c48429-b5de-4917-94fd-f58ae1443f9a tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:31.504046 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f3c48429-b5de-4917-94fd-f58ae1443f9a tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:31.504560 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f3c48429-b5de-4917-94fd-f58ae1443f9a tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:31.505213 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f3c48429-b5de-4917-94fd-f58ae1443f9a tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:31.505670 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f3c48429-b5de-4917-94fd-f58ae1443f9a tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:31.506095 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f3c48429-b5de-4917-94fd-f58ae1443f9a tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:31.536868 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-94709db2-5501-4372-9dd7-8989adab9907 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:31.537593 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-94709db2-5501-4372-9dd7-8989adab9907 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2fe6c508-f183-40bd-bfd5-23c757e99a05] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:31.544186 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-94709db2-5501-4372-9dd7-8989adab9907 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:31.544831 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-94709db2-5501-4372-9dd7-8989adab9907 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:31.545335 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-94709db2-5501-4372-9dd7-8989adab9907 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:31.546688 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-94709db2-5501-4372-9dd7-8989adab9907 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:31.547208 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-94709db2-5501-4372-9dd7-8989adab9907 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:31.547718 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-94709db2-5501-4372-9dd7-8989adab9907 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:31.563410 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=8 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:31.586048 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f3c48429-b5de-4917-94fd-f58ae1443f9a tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:31.592632 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f3c48429-b5de-4917-94fd-f58ae1443f9a tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:31.595515 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f3c48429-b5de-4917-94fd-f58ae1443f9a tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:31.602328 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f3c48429-b5de-4917-94fd-f58ae1443f9a tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1544 microversion: 2.91 time: 0.109641 Oct 04 18:34:31.603862 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 805/1692] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:31 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1544 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:31.701525 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c5630995-c7f7-4784-bbd3-bf1ab10ae8cb tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:31.702360 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c5630995-c7f7-4784-bbd3-bf1ab10ae8cb tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: b219d988-2847-45a0-a3b8-af54cf1a43f8] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:31.710079 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c5630995-c7f7-4784-bbd3-bf1ab10ae8cb tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:31.710580 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c5630995-c7f7-4784-bbd3-bf1ab10ae8cb tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:31.711447 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c5630995-c7f7-4784-bbd3-bf1ab10ae8cb tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:31.711677 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-94709db2-5501-4372-9dd7-8989adab9907 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:31.712677 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c5630995-c7f7-4784-bbd3-bf1ab10ae8cb tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:31.713448 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c5630995-c7f7-4784-bbd3-bf1ab10ae8cb tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:31.714034 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c5630995-c7f7-4784-bbd3-bf1ab10ae8cb tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:31.719376 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:31.722887 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-94709db2-5501-4372-9dd7-8989adab9907 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05" status: 200 len: 1313 microversion: 2.1 time: 0.189598 Oct 04 18:34:31.724454 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 888/1693] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:31 2022] GET /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05 => generated 1313 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:34:31.851980 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-357b2119-ca5a-4333-bf8d-14ff81b7fffb tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:31.853229 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-357b2119-ca5a-4333-bf8d-14ff81b7fffb tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: 0fa89d74-e5c4-461c-adcc-6c29ce9ad8db] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:31.862007 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-357b2119-ca5a-4333-bf8d-14ff81b7fffb tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:31.863765 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-357b2119-ca5a-4333-bf8d-14ff81b7fffb tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:31.865200 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-357b2119-ca5a-4333-bf8d-14ff81b7fffb tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:31.865962 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-357b2119-ca5a-4333-bf8d-14ff81b7fffb tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:31.866802 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-357b2119-ca5a-4333-bf8d-14ff81b7fffb tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:31.867323 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-357b2119-ca5a-4333-bf8d-14ff81b7fffb tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:31.871453 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c5630995-c7f7-4784-bbd3-bf1ab10ae8cb tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:31.883294 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c5630995-c7f7-4784-bbd3-bf1ab10ae8cb tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:31.885025 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c5630995-c7f7-4784-bbd3-bf1ab10ae8cb tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:31.886313 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c5630995-c7f7-4784-bbd3-bf1ab10ae8cb tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8" status: 200 len: 1811 microversion: 2.25 time: 0.190609 Oct 04 18:34:31.887413 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 806/1694] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:31 2022] GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8 => generated 1811 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:34:32.022931 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-357b2119-ca5a-4333-bf8d-14ff81b7fffb tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:32.025975 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=100 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:32.033192 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-357b2119-ca5a-4333-bf8d-14ff81b7fffb tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/0fa89d74-e5c4-461c-adcc-6c29ce9ad8db" status: 200 len: 1307 microversion: 2.1 time: 0.185036 Oct 04 18:34:32.034091 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 889/1695] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:31 2022] GET /compute/v2.1/servers/0fa89d74-e5c4-461c-adcc-6c29ce9ad8db => generated 1307 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:32.114673 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-300c5994-22cc-4c7a-b134-5c7d4b8549e2 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:32.115923 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-300c5994-22cc-4c7a-b134-5c7d4b8549e2 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] [instance: d3abc28f-8361-4906-a085-1440991c298f] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:32.123380 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-300c5994-22cc-4c7a-b134-5c7d4b8549e2 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:32.123875 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-300c5994-22cc-4c7a-b134-5c7d4b8549e2 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:32.124333 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-300c5994-22cc-4c7a-b134-5c7d4b8549e2 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:32.125024 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-300c5994-22cc-4c7a-b134-5c7d4b8549e2 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:32.125472 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-300c5994-22cc-4c7a-b134-5c7d4b8549e2 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:32.125887 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-300c5994-22cc-4c7a-b134-5c7d4b8549e2 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:32.173816 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3e10fae7-9d10-40c3-9a18-adf05ae6eb8e tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:32.174435 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3e10fae7-9d10-40c3-9a18-adf05ae6eb8e tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] [instance: bc418c02-1d95-407f-bbda-c696e9ba5959] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:32.181664 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3e10fae7-9d10-40c3-9a18-adf05ae6eb8e tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:32.182256 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3e10fae7-9d10-40c3-9a18-adf05ae6eb8e tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:32.182782 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3e10fae7-9d10-40c3-9a18-adf05ae6eb8e tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:32.183427 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3e10fae7-9d10-40c3-9a18-adf05ae6eb8e tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:32.183886 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3e10fae7-9d10-40c3-9a18-adf05ae6eb8e tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:32.184711 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3e10fae7-9d10-40c3-9a18-adf05ae6eb8e tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:32.811364 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-300c5994-22cc-4c7a-b134-5c7d4b8549e2 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44cc98e07d134a15b0fbf2b80bd25ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e0b0088d8476bbcb4c83783fec0e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:32.820173 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-300c5994-22cc-4c7a-b134-5c7d4b8549e2 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] 10.222.0.20 "GET /compute/v2.1/servers/d3abc28f-8361-4906-a085-1440991c298f" status: 200 len: 1318 microversion: 2.1 time: 0.709733 Oct 04 18:34:32.820951 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 807/1696] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:32 2022] GET /compute/v2.1/servers/d3abc28f-8361-4906-a085-1440991c298f => generated 1318 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:32.826075 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a2e68bfd-3f40-4345-8a10-04567a07c149 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:32.826927 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a2e68bfd-3f40-4345-8a10-04567a07c149 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] [instance: 89a512b5-8107-4c63-8387-69892fc7e5f4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:32.833942 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a2e68bfd-3f40-4345-8a10-04567a07c149 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:32.834772 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a2e68bfd-3f40-4345-8a10-04567a07c149 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:32.835421 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a2e68bfd-3f40-4345-8a10-04567a07c149 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:32.836417 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a2e68bfd-3f40-4345-8a10-04567a07c149 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:32.837095 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a2e68bfd-3f40-4345-8a10-04567a07c149 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:32.837595 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a2e68bfd-3f40-4345-8a10-04567a07c149 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:32.873332 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a2e68bfd-3f40-4345-8a10-04567a07c149 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:32.874119 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a2e68bfd-3f40-4345-8a10-04567a07c149 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:32.874767 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a2e68bfd-3f40-4345-8a10-04567a07c149 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:32.875853 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-a2e68bfd-3f40-4345-8a10-04567a07c149 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Lazy-loading 'fault' on Instance uuid 89a512b5-8107-4c63-8387-69892fc7e5f4 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:34:32.917391 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3e10fae7-9d10-40c3-9a18-adf05ae6eb8e tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bed3af030c43dbaa23a3e23520f407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7808c2a8d8491aa5e1594383fab2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:32.928382 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3e10fae7-9d10-40c3-9a18-adf05ae6eb8e tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] 10.222.0.20 "GET /compute/v2.1/servers/bc418c02-1d95-407f-bbda-c696e9ba5959" status: 200 len: 1700 microversion: 2.1 time: 0.758959 Oct 04 18:34:32.929893 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 890/1697] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:32 2022] GET /compute/v2.1/servers/bc418c02-1d95-407f-bbda-c696e9ba5959 => generated 1700 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:34:32.937148 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-16fe7bbc-6015-490f-ad4a-301fa5733557 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:32.938663 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-16fe7bbc-6015-490f-ad4a-301fa5733557 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 158e9f52-fd16-48d1-87b5-e0dd523e97a4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:32.946301 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a2e68bfd-3f40-4345-8a10-04567a07c149 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697ff4892d1f4c559523990779ccfaab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2759ed7f36eb4693aa74b76f7907899e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:32.949999 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-16fe7bbc-6015-490f-ad4a-301fa5733557 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:32.953333 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-16fe7bbc-6015-490f-ad4a-301fa5733557 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:32.954039 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-16fe7bbc-6015-490f-ad4a-301fa5733557 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:32.956916 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-16fe7bbc-6015-490f-ad4a-301fa5733557 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:32.956916 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-16fe7bbc-6015-490f-ad4a-301fa5733557 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:32.957392 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a2e68bfd-3f40-4345-8a10-04567a07c149 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] 10.222.0.20 "GET /compute/v2.1/servers/89a512b5-8107-4c63-8387-69892fc7e5f4" status: 200 len: 1316 microversion: 2.1 time: 0.133140 Oct 04 18:34:32.957892 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-16fe7bbc-6015-490f-ad4a-301fa5733557 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:32.958009 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 808/1698] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:32 2022] GET /compute/v2.1/servers/89a512b5-8107-4c63-8387-69892fc7e5f4 => generated 1316 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:32.963066 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5c704f5c-5820-468d-804f-cce9e586a6f0 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:32.963778 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5c704f5c-5820-468d-804f-cce9e586a6f0 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:32.971853 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5c704f5c-5820-468d-804f-cce9e586a6f0 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:32.972560 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5c704f5c-5820-468d-804f-cce9e586a6f0 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:32.974560 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5c704f5c-5820-468d-804f-cce9e586a6f0 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:32.975333 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5c704f5c-5820-468d-804f-cce9e586a6f0 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:32.976189 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5c704f5c-5820-468d-804f-cce9e586a6f0 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:32.979894 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5c704f5c-5820-468d-804f-cce9e586a6f0 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:33.182220 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5c704f5c-5820-468d-804f-cce9e586a6f0 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:33.199862 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5c704f5c-5820-468d-804f-cce9e586a6f0 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:33.201539 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5c704f5c-5820-468d-804f-cce9e586a6f0 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:33.208345 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5c704f5c-5820-468d-804f-cce9e586a6f0 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1544 microversion: 2.91 time: 0.249110 Oct 04 18:34:33.243492 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 809/1699] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:32 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1544 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:33.254669 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-51f9330b-13fa-49bc-baf8-1a1a7130b67b tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:33.255307 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-51f9330b-13fa-49bc-baf8-1a1a7130b67b tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2fe6c508-f183-40bd-bfd5-23c757e99a05] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:33.263951 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-51f9330b-13fa-49bc-baf8-1a1a7130b67b tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:33.264814 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-51f9330b-13fa-49bc-baf8-1a1a7130b67b tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:33.265265 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-51f9330b-13fa-49bc-baf8-1a1a7130b67b tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:33.266042 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-51f9330b-13fa-49bc-baf8-1a1a7130b67b tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:33.266511 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-51f9330b-13fa-49bc-baf8-1a1a7130b67b tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:33.266935 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-51f9330b-13fa-49bc-baf8-1a1a7130b67b tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:33.272795 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-16fe7bbc-6015-490f-ad4a-301fa5733557 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:33.284131 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-16fe7bbc-6015-490f-ad4a-301fa5733557 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4" status: 200 len: 1719 microversion: 2.1 time: 0.352590 Oct 04 18:34:33.286652 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 891/1700] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:32 2022] GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4 => generated 1719 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:33.292250 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-54b0b147-c391-4ad9-bc72-9bb914577ee7 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:33.293035 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-54b0b147-c391-4ad9-bc72-9bb914577ee7 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: b219d988-2847-45a0-a3b8-af54cf1a43f8] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:33.299539 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-54b0b147-c391-4ad9-bc72-9bb914577ee7 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:33.300272 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-54b0b147-c391-4ad9-bc72-9bb914577ee7 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:33.301138 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-54b0b147-c391-4ad9-bc72-9bb914577ee7 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:33.302139 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-54b0b147-c391-4ad9-bc72-9bb914577ee7 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:33.302813 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-54b0b147-c391-4ad9-bc72-9bb914577ee7 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:33.303312 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-54b0b147-c391-4ad9-bc72-9bb914577ee7 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:33.569926 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-54b0b147-c391-4ad9-bc72-9bb914577ee7 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:33.581481 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-54b0b147-c391-4ad9-bc72-9bb914577ee7 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:33.583404 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-54b0b147-c391-4ad9-bc72-9bb914577ee7 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:33.590526 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-54b0b147-c391-4ad9-bc72-9bb914577ee7 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8" status: 200 len: 1811 microversion: 2.25 time: 0.302225 Oct 04 18:34:33.591521 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 892/1701] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:33 2022] GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8 => generated 1811 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:33.596761 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-51f9330b-13fa-49bc-baf8-1a1a7130b67b tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:33.598342 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-972a2ce8-7b8c-410a-9c2d-64cca1ebaf5f tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:33.599176 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-972a2ce8-7b8c-410a-9c2d-64cca1ebaf5f tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: 0fa89d74-e5c4-461c-adcc-6c29ce9ad8db] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:33.605976 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-972a2ce8-7b8c-410a-9c2d-64cca1ebaf5f tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:33.606549 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-972a2ce8-7b8c-410a-9c2d-64cca1ebaf5f tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:33.608168 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-51f9330b-13fa-49bc-baf8-1a1a7130b67b tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05" status: 200 len: 1313 microversion: 2.1 time: 0.363276 Oct 04 18:34:33.610604 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-972a2ce8-7b8c-410a-9c2d-64cca1ebaf5f tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:33.611596 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-972a2ce8-7b8c-410a-9c2d-64cca1ebaf5f tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:33.612291 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-972a2ce8-7b8c-410a-9c2d-64cca1ebaf5f tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:33.612427 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 810/1702] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:33 2022] GET /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05 => generated 1313 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:33.613684 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-972a2ce8-7b8c-410a-9c2d-64cca1ebaf5f tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:33.829332 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-f51b7177-4d3e-450b-9f50-902e1d4590bb req-2067dbed-e8b2-4eaa-9bfe-f11f0f3914dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc418c02-1d95-407f-bbda-c696e9ba5959", "name": "network-vif-deleted", "tag": "ba72231c-323b-48fb-83de-ea9aad878e62"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:33.854107 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-f51b7177-4d3e-450b-9f50-902e1d4590bb req-2067dbed-e8b2-4eaa-9bfe-f11f0f3914dd service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:33.859375 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-f51b7177-4d3e-450b-9f50-902e1d4590bb req-2067dbed-e8b2-4eaa-9bfe-f11f0f3914dd service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:33.859375 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-f51b7177-4d3e-450b-9f50-902e1d4590bb req-2067dbed-e8b2-4eaa-9bfe-f11f0f3914dd service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:33.878725 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-972a2ce8-7b8c-410a-9c2d-64cca1ebaf5f tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:33.886052 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-f51b7177-4d3e-450b-9f50-902e1d4590bb req-2067dbed-e8b2-4eaa-9bfe-f11f0f3914dd service nova] Creating event network-vif-deleted:ba72231c-323b-48fb-83de-ea9aad878e62 for instance bc418c02-1d95-407f-bbda-c696e9ba5959 on n-h1-850501-14 Oct 04 18:34:33.890324 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-972a2ce8-7b8c-410a-9c2d-64cca1ebaf5f tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/0fa89d74-e5c4-461c-adcc-6c29ce9ad8db" status: 200 len: 1307 microversion: 2.1 time: 0.296167 Oct 04 18:34:33.891006 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 893/1703] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:33 2022] GET /compute/v2.1/servers/0fa89d74-e5c4-461c-adcc-6c29ce9ad8db => generated 1307 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:33.901972 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-f51b7177-4d3e-450b-9f50-902e1d4590bb req-2067dbed-e8b2-4eaa-9bfe-f11f0f3914dd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076305 Oct 04 18:34:33.904194 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 811/1704] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:34:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:34:33.923000 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c270fac0-2ecb-4bbb-ba00-ca83a67e63a2 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:33.924528 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c270fac0-2ecb-4bbb-ba00-ca83a67e63a2 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] [instance: d3abc28f-8361-4906-a085-1440991c298f] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:33.929917 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-cfd3147c-c003-4b64-bba8-1dcfee2c9f56 req-1d81f597-5adc-48b1-87b5-71b5359f7a6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8c84d9e-2274-49dd-99e9-cbd7222c22d5", "name": "network-vif-deleted", "tag": "84624e18-aa6c-4e5b-a8b8-776adc3416b5"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:33.932776 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c270fac0-2ecb-4bbb-ba00-ca83a67e63a2 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:33.933470 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c270fac0-2ecb-4bbb-ba00-ca83a67e63a2 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:33.933904 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c270fac0-2ecb-4bbb-ba00-ca83a67e63a2 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:33.934865 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c270fac0-2ecb-4bbb-ba00-ca83a67e63a2 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:33.935308 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c270fac0-2ecb-4bbb-ba00-ca83a67e63a2 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:33.935881 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c270fac0-2ecb-4bbb-ba00-ca83a67e63a2 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:33.951394 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-cfd3147c-c003-4b64-bba8-1dcfee2c9f56 req-1d81f597-5adc-48b1-87b5-71b5359f7a6f service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:33.952036 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-cfd3147c-c003-4b64-bba8-1dcfee2c9f56 req-1d81f597-5adc-48b1-87b5-71b5359f7a6f service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:33.952663 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-cfd3147c-c003-4b64-bba8-1dcfee2c9f56 req-1d81f597-5adc-48b1-87b5-71b5359f7a6f service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:33.967436 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-cfd3147c-c003-4b64-bba8-1dcfee2c9f56 req-1d81f597-5adc-48b1-87b5-71b5359f7a6f service nova] Creating event network-vif-deleted:84624e18-aa6c-4e5b-a8b8-776adc3416b5 for instance c8c84d9e-2274-49dd-99e9-cbd7222c22d5 on n-h2-850501-14 Oct 04 18:34:33.973654 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-cfd3147c-c003-4b64-bba8-1dcfee2c9f56 req-1d81f597-5adc-48b1-87b5-71b5359f7a6f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080523 Oct 04 18:34:33.974476 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 894/1705] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:34:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:34:33.980162 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f19cbf6b-8e68-4bc6-a14a-59c87aa24b17 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:33.980854 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f19cbf6b-8e68-4bc6-a14a-59c87aa24b17 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] [instance: bc418c02-1d95-407f-bbda-c696e9ba5959] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:33.989934 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f19cbf6b-8e68-4bc6-a14a-59c87aa24b17 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:33.990697 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f19cbf6b-8e68-4bc6-a14a-59c87aa24b17 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:33.991389 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f19cbf6b-8e68-4bc6-a14a-59c87aa24b17 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:33.992383 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f19cbf6b-8e68-4bc6-a14a-59c87aa24b17 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:33.993005 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f19cbf6b-8e68-4bc6-a14a-59c87aa24b17 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:33.993604 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f19cbf6b-8e68-4bc6-a14a-59c87aa24b17 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:34.091910 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f19cbf6b-8e68-4bc6-a14a-59c87aa24b17 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bed3af030c43dbaa23a3e23520f407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7808c2a8d8491aa5e1594383fab2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:34.103526 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f19cbf6b-8e68-4bc6-a14a-59c87aa24b17 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] 10.222.0.20 "GET /compute/v2.1/servers/bc418c02-1d95-407f-bbda-c696e9ba5959" status: 200 len: 1633 microversion: 2.1 time: 0.126982 Oct 04 18:34:34.106197 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 895/1706] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:33 2022] GET /compute/v2.1/servers/bc418c02-1d95-407f-bbda-c696e9ba5959 => generated 1633 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:34.116763 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-712ecd36-4d7c-4c74-b324-5feabf60de19 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:34.118410 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-712ecd36-4d7c-4c74-b324-5feabf60de19 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] [instance: 89a512b5-8107-4c63-8387-69892fc7e5f4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:34.125022 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c270fac0-2ecb-4bbb-ba00-ca83a67e63a2 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44cc98e07d134a15b0fbf2b80bd25ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e0b0088d8476bbcb4c83783fec0e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:34.134376 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c270fac0-2ecb-4bbb-ba00-ca83a67e63a2 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] 10.222.0.20 "GET /compute/v2.1/servers/d3abc28f-8361-4906-a085-1440991c298f" status: 200 len: 1318 microversion: 2.1 time: 0.225729 Oct 04 18:34:34.135269 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 812/1707] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:33 2022] GET /compute/v2.1/servers/d3abc28f-8361-4906-a085-1440991c298f => generated 1318 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:34.150622 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-712ecd36-4d7c-4c74-b324-5feabf60de19 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:34.151151 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-712ecd36-4d7c-4c74-b324-5feabf60de19 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:34.151672 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-712ecd36-4d7c-4c74-b324-5feabf60de19 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:34.152446 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-712ecd36-4d7c-4c74-b324-5feabf60de19 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:34.152908 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-712ecd36-4d7c-4c74-b324-5feabf60de19 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:34.153339 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-712ecd36-4d7c-4c74-b324-5feabf60de19 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:34.168294 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-712ecd36-4d7c-4c74-b324-5feabf60de19 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] HTTP exception thrown: Instance 89a512b5-8107-4c63-8387-69892fc7e5f4 could not be found. Oct 04 18:34:34.169893 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-712ecd36-4d7c-4c74-b324-5feabf60de19 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Request method failure captured: Oct 04 18:34:34.169893 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/89a512b5-8107-4c63-8387-69892fc7e5f4 HTTP/1.1 Oct 04 18:34:34.169893 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:34:34.169893 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:34:34.169893 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:34:34.169893 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:34:34.169893 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:34:34.169893 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:34:34.169893 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:34:34.169893 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:34:34.169893 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPHxoBap6tuxTxtrL-wogtpxg8UKsrBAE02MVNxB8sSs-r_-6hjirhYk6apGdpDjCXDp_Cd4maQDGE9WHVVqoagxpUYlaBCXtPFx-VK_mEl15ZTMCMEwQCX2Il1uKO0FgLr3yTTCofsuf_NiVPF9x_VecPgukP-J4ShYHRBpBQx9C4VE Oct 04 18:34:34.169893 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:34:34.169893 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:34:34.169893 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:34:34.169893 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:34:34.169893 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:34:34.169893 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:34:34.169893 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 2759ed7f36eb4693aa74b76f7907899e Oct 04 18:34:34.169893 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServersTestFqdnHostnames-953552007 Oct 04 18:34:34.169893 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:34:34.169893 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:34:34.169893 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2759ed7f36eb4693aa74b76f7907899e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2759ed7f36eb4693aa74b76f7907899e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2759ed7f36eb4693aa74b76f7907899e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2759ed7f36eb4693aa74b76f7907899e"}]}] Oct 04 18:34:34.169893 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServersTestFqdnHostnames-953552007 Oct 04 18:34:34.169893 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 2759ed7f36eb4693aa74b76f7907899e Oct 04 18:34:34.169893 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-953552007 Oct 04 18:34:34.169893 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServersTestFqdnHostnames-953552007-project Oct 04 18:34:34.169893 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:34:34.169893 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:34:34.169893 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 697ff4892d1f4c559523990779ccfaab Oct 04 18:34:34.169893 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServersTestFqdnHostnames-953552007-project Oct 04 18:34:34.169893 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:34:34.169893 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 89a512b5-8107-4c63-8387-69892fc7e5f4 could not be found. Oct 04 18:34:34.169893 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '89a512b5-8107-4c63-8387-69892fc7e5f4'} Oct 04 18:34:34.169893 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:34:34.169893 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:34.169893 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:34:34.169893 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:34:34.169893 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:34:34.169893 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:34:34.169893 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:34:34.169893 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:34:34.169893 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:34:34.169893 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:34:34.169893 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89a512b5-8107-4c63-8387-69892fc7e5f4 could not be found. Oct 04 18:34:34.169893 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:34:34.169893 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:34.169893 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:34:34.169893 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:34.169893 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:34.169893 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:34.169893 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:34:34.169893 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:34:34.169893 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:34:34.169893 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:34:34.169893 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:34:34.169893 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:34:34.169893 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:34:34.169893 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:34:34.169893 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:34:34.169893 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:34:34.169893 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89a512b5-8107-4c63-8387-69892fc7e5f4 could not be found. Oct 04 18:34:34.169893 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:34:34.169893 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:34.169893 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:34:34.177446 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:34.177446 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:34.177446 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:34.177446 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:34:34.177446 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:34:34.177446 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89a512b5-8107-4c63-8387-69892fc7e5f4 could not be found. Oct 04 18:34:34.177446 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:34:34.177446 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-712ecd36-4d7c-4c74-b324-5feabf60de19 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Returning 404 to user: Instance 89a512b5-8107-4c63-8387-69892fc7e5f4 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:34:34.177446 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-712ecd36-4d7c-4c74-b324-5feabf60de19 tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] 10.222.0.20 "GET /compute/v2.1/servers/89a512b5-8107-4c63-8387-69892fc7e5f4" status: 404 len: 111 microversion: 2.1 time: 0.063870 Oct 04 18:34:34.177446 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 896/1708] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:34 2022] GET /compute/v2.1/servers/89a512b5-8107-4c63-8387-69892fc7e5f4 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:34:34.181274 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-bcceb5b1-7ad8-4805-b5c1-0e3ae3d87b3b tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] Calling method '.version_select at 0x7fe258fd0dc0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:34.247904 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2f7584fc-0e8e-4299-8c37-309f32ebf535 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:34.248641 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2f7584fc-0e8e-4299-8c37-309f32ebf535 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:34.258204 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-bcceb5b1-7ad8-4805-b5c1-0e3ae3d87b3b tempest-ServersTestFqdnHostnames-953552007 tempest-ServersTestFqdnHostnames-953552007-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1560806999" status: 202 len: 0 microversion: 2.1 time: 0.081022 Oct 04 18:34:34.260538 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 813/1709] 10.222.0.20 () {58 vars in 1221 bytes} [Tue Oct 4 18:34:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1560806999 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:34:34.263995 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2f7584fc-0e8e-4299-8c37-309f32ebf535 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:34.266704 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2f7584fc-0e8e-4299-8c37-309f32ebf535 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:34.267420 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2f7584fc-0e8e-4299-8c37-309f32ebf535 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:34.276494 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2f7584fc-0e8e-4299-8c37-309f32ebf535 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:34.276494 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2f7584fc-0e8e-4299-8c37-309f32ebf535 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:34.276494 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2f7584fc-0e8e-4299-8c37-309f32ebf535 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:34.309830 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-39657d22-f2a0-4698-8ca2-4834520eadf8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:34.310455 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-39657d22-f2a0-4698-8ca2-4834520eadf8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 158e9f52-fd16-48d1-87b5-e0dd523e97a4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:34.327861 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-39657d22-f2a0-4698-8ca2-4834520eadf8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:34.329136 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-39657d22-f2a0-4698-8ca2-4834520eadf8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:34.329136 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-39657d22-f2a0-4698-8ca2-4834520eadf8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:34.330752 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-39657d22-f2a0-4698-8ca2-4834520eadf8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:34.332264 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-39657d22-f2a0-4698-8ca2-4834520eadf8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:34.332906 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-39657d22-f2a0-4698-8ca2-4834520eadf8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:34.381064 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2f7584fc-0e8e-4299-8c37-309f32ebf535 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:34.396892 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2f7584fc-0e8e-4299-8c37-309f32ebf535 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:34.398350 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2f7584fc-0e8e-4299-8c37-309f32ebf535 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:34.406817 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2f7584fc-0e8e-4299-8c37-309f32ebf535 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1544 microversion: 2.91 time: 0.164339 Oct 04 18:34:34.407628 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 897/1710] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:34 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1544 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:34.535951 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-9b54c791-03a4-4215-a2d5-11fdd65ea511 req-4bd0f4e9-55ed-4028-932e-24038036e17d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fa89d74-e5c4-461c-adcc-6c29ce9ad8db", "name": "network-vif-plugged", "status": "completed", "tag": "59347bf8-4a31-4a7c-ad79-7b1486886df8"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:34.549193 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-9b54c791-03a4-4215-a2d5-11fdd65ea511 req-4bd0f4e9-55ed-4028-932e-24038036e17d service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:34.549669 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-9b54c791-03a4-4215-a2d5-11fdd65ea511 req-4bd0f4e9-55ed-4028-932e-24038036e17d service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:34.550166 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-9b54c791-03a4-4215-a2d5-11fdd65ea511 req-4bd0f4e9-55ed-4028-932e-24038036e17d service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:34.562824 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-9b54c791-03a4-4215-a2d5-11fdd65ea511 req-4bd0f4e9-55ed-4028-932e-24038036e17d service nova] Creating event network-vif-plugged:59347bf8-4a31-4a7c-ad79-7b1486886df8 for instance 0fa89d74-e5c4-461c-adcc-6c29ce9ad8db on n-h1-850501-14 Oct 04 18:34:34.568698 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-9b54c791-03a4-4215-a2d5-11fdd65ea511 req-4bd0f4e9-55ed-4028-932e-24038036e17d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038821 Oct 04 18:34:34.569616 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 898/1711] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:34:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:34:34.578759 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-39657d22-f2a0-4698-8ca2-4834520eadf8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:34.589654 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-39657d22-f2a0-4698-8ca2-4834520eadf8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4" status: 200 len: 1719 microversion: 2.1 time: 0.283962 Oct 04 18:34:34.590539 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 814/1712] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:34 2022] GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4 => generated 1719 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:34.619135 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-187101ee-4c6e-44ad-ae55-34c52b2166ca tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:34.619834 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-187101ee-4c6e-44ad-ae55-34c52b2166ca tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: b219d988-2847-45a0-a3b8-af54cf1a43f8] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:34.626064 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-187101ee-4c6e-44ad-ae55-34c52b2166ca tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:34.626853 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-187101ee-4c6e-44ad-ae55-34c52b2166ca tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:34.627294 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-187101ee-4c6e-44ad-ae55-34c52b2166ca tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:34.628026 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-187101ee-4c6e-44ad-ae55-34c52b2166ca tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:34.629940 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-187101ee-4c6e-44ad-ae55-34c52b2166ca tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:34.629940 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-187101ee-4c6e-44ad-ae55-34c52b2166ca tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:34.635786 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9dc3cfa8-0b86-4547-bf0d-33d30d5762fb tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:34.636444 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-9dc3cfa8-0b86-4547-bf0d-33d30d5762fb tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2fe6c508-f183-40bd-bfd5-23c757e99a05] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:34.670425 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9dc3cfa8-0b86-4547-bf0d-33d30d5762fb tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:34.671065 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9dc3cfa8-0b86-4547-bf0d-33d30d5762fb tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:34.671525 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9dc3cfa8-0b86-4547-bf0d-33d30d5762fb tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:34.672377 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9dc3cfa8-0b86-4547-bf0d-33d30d5762fb tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:34.672847 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9dc3cfa8-0b86-4547-bf0d-33d30d5762fb tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:34.673281 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9dc3cfa8-0b86-4547-bf0d-33d30d5762fb tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:35.084824 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-187101ee-4c6e-44ad-ae55-34c52b2166ca tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:35.100179 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-187101ee-4c6e-44ad-ae55-34c52b2166ca tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:35.104756 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-187101ee-4c6e-44ad-ae55-34c52b2166ca tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:35.106064 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-187101ee-4c6e-44ad-ae55-34c52b2166ca tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8" status: 200 len: 1811 microversion: 2.25 time: 0.491422 Oct 04 18:34:35.124092 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 899/1713] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:34 2022] GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8 => generated 1811 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:34:35.132241 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a1c1b78b-3406-4644-8f9b-6b3ce936aa32 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:35.133114 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a1c1b78b-3406-4644-8f9b-6b3ce936aa32 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: 0fa89d74-e5c4-461c-adcc-6c29ce9ad8db] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:35.140536 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a1c1b78b-3406-4644-8f9b-6b3ce936aa32 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:35.140536 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a1c1b78b-3406-4644-8f9b-6b3ce936aa32 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:35.141171 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a1c1b78b-3406-4644-8f9b-6b3ce936aa32 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:35.142261 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a1c1b78b-3406-4644-8f9b-6b3ce936aa32 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:35.142889 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a1c1b78b-3406-4644-8f9b-6b3ce936aa32 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:35.143486 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a1c1b78b-3406-4644-8f9b-6b3ce936aa32 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:35.162460 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9dc3cfa8-0b86-4547-bf0d-33d30d5762fb tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:35.170550 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9dc3cfa8-0b86-4547-bf0d-33d30d5762fb tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05" status: 200 len: 1463 microversion: 2.1 time: 0.539273 Oct 04 18:34:35.177826 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 815/1714] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:34 2022] GET /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05 => generated 1463 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:34:35.177826 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b78cf541-5071-4b9c-a27e-c6ba6df49839 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:35.177826 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b78cf541-5071-4b9c-a27e-c6ba6df49839 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] [instance: bc418c02-1d95-407f-bbda-c696e9ba5959] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:35.183738 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b78cf541-5071-4b9c-a27e-c6ba6df49839 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:35.184732 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b78cf541-5071-4b9c-a27e-c6ba6df49839 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:35.185364 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b78cf541-5071-4b9c-a27e-c6ba6df49839 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:35.186312 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b78cf541-5071-4b9c-a27e-c6ba6df49839 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:35.187006 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b78cf541-5071-4b9c-a27e-c6ba6df49839 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:35.187661 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b78cf541-5071-4b9c-a27e-c6ba6df49839 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:35.228533 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b78cf541-5071-4b9c-a27e-c6ba6df49839 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:35.229022 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b78cf541-5071-4b9c-a27e-c6ba6df49839 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:35.229449 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b78cf541-5071-4b9c-a27e-c6ba6df49839 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:35.230199 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-b78cf541-5071-4b9c-a27e-c6ba6df49839 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lazy-loading 'fault' on Instance uuid bc418c02-1d95-407f-bbda-c696e9ba5959 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:34:35.297582 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b78cf541-5071-4b9c-a27e-c6ba6df49839 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bed3af030c43dbaa23a3e23520f407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7808c2a8d8491aa5e1594383fab2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:35.307963 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b78cf541-5071-4b9c-a27e-c6ba6df49839 tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] 10.222.0.20 "GET /compute/v2.1/servers/bc418c02-1d95-407f-bbda-c696e9ba5959" status: 200 len: 1359 microversion: 2.1 time: 0.134101 Oct 04 18:34:35.308881 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 816/1715] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:35 2022] GET /compute/v2.1/servers/bc418c02-1d95-407f-bbda-c696e9ba5959 => generated 1359 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:35.315814 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f00f6358-c7b9-4a44-892f-b0379f33c13b tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:35.317587 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f00f6358-c7b9-4a44-892f-b0379f33c13b tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] [instance: d3abc28f-8361-4906-a085-1440991c298f] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:35.324898 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f00f6358-c7b9-4a44-892f-b0379f33c13b tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:35.325645 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f00f6358-c7b9-4a44-892f-b0379f33c13b tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:35.326089 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f00f6358-c7b9-4a44-892f-b0379f33c13b tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:35.326854 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f00f6358-c7b9-4a44-892f-b0379f33c13b tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:35.327316 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f00f6358-c7b9-4a44-892f-b0379f33c13b tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:35.327738 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f00f6358-c7b9-4a44-892f-b0379f33c13b tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:35.370903 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a1c1b78b-3406-4644-8f9b-6b3ce936aa32 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:35.384212 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a1c1b78b-3406-4644-8f9b-6b3ce936aa32 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/0fa89d74-e5c4-461c-adcc-6c29ce9ad8db" status: 200 len: 1307 microversion: 2.1 time: 0.260281 Oct 04 18:34:35.385546 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 900/1716] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:35 2022] GET /compute/v2.1/servers/0fa89d74-e5c4-461c-adcc-6c29ce9ad8db => generated 1307 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:35.480454 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-dfe018b8-edb4-47b7-8815-c4e03c05dc46 tempest-MigrationsAdminTest-1101631867 tempest-MigrationsAdminTest-1101631867-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:35.481157 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-dfe018b8-edb4-47b7-8815-c4e03c05dc46 tempest-MigrationsAdminTest-1101631867 tempest-MigrationsAdminTest-1101631867-project-admin] [instance: 2fe6c508-f183-40bd-bfd5-23c757e99a05] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:35.488377 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dfe018b8-edb4-47b7-8815-c4e03c05dc46 tempest-MigrationsAdminTest-1101631867 tempest-MigrationsAdminTest-1101631867-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:35.501895 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dfe018b8-edb4-47b7-8815-c4e03c05dc46 tempest-MigrationsAdminTest-1101631867 tempest-MigrationsAdminTest-1101631867-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:35.501895 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dfe018b8-edb4-47b7-8815-c4e03c05dc46 tempest-MigrationsAdminTest-1101631867 tempest-MigrationsAdminTest-1101631867-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:35.501895 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dfe018b8-edb4-47b7-8815-c4e03c05dc46 tempest-MigrationsAdminTest-1101631867 tempest-MigrationsAdminTest-1101631867-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:35.501895 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dfe018b8-edb4-47b7-8815-c4e03c05dc46 tempest-MigrationsAdminTest-1101631867 tempest-MigrationsAdminTest-1101631867-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:35.501895 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dfe018b8-edb4-47b7-8815-c4e03c05dc46 tempest-MigrationsAdminTest-1101631867 tempest-MigrationsAdminTest-1101631867-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:35.583941 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f00f6358-c7b9-4a44-892f-b0379f33c13b tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44cc98e07d134a15b0fbf2b80bd25ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e0b0088d8476bbcb4c83783fec0e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:35.594167 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f00f6358-c7b9-4a44-892f-b0379f33c13b tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] 10.222.0.20 "GET /compute/v2.1/servers/d3abc28f-8361-4906-a085-1440991c298f" status: 200 len: 1318 microversion: 2.1 time: 0.283034 Oct 04 18:34:35.594636 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 817/1717] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:35 2022] GET /compute/v2.1/servers/d3abc28f-8361-4906-a085-1440991c298f => generated 1318 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:35.612708 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8f9d4047-50de-4bde-96da-c223f772b161 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:35.613550 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8f9d4047-50de-4bde-96da-c223f772b161 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:35.619549 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8f9d4047-50de-4bde-96da-c223f772b161 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:35.620278 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8f9d4047-50de-4bde-96da-c223f772b161 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:35.620711 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8f9d4047-50de-4bde-96da-c223f772b161 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:35.621408 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8f9d4047-50de-4bde-96da-c223f772b161 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:35.621852 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8f9d4047-50de-4bde-96da-c223f772b161 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:35.622286 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8f9d4047-50de-4bde-96da-c223f772b161 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:35.704222 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8f9d4047-50de-4bde-96da-c223f772b161 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:35.723668 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8f9d4047-50de-4bde-96da-c223f772b161 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:35.725083 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8f9d4047-50de-4bde-96da-c223f772b161 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:35.731308 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8f9d4047-50de-4bde-96da-c223f772b161 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1544 microversion: 2.91 time: 0.122647 Oct 04 18:34:35.732121 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 818/1718] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:35 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1544 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:35.741868 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-77e87738-889e-4108-a3b7-bbd66bb8870b tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:35.742816 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-77e87738-889e-4108-a3b7-bbd66bb8870b tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 158e9f52-fd16-48d1-87b5-e0dd523e97a4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:35.748530 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:35.750103 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-77e87738-889e-4108-a3b7-bbd66bb8870b tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:35.750764 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-77e87738-889e-4108-a3b7-bbd66bb8870b tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:35.751364 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-77e87738-889e-4108-a3b7-bbd66bb8870b tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:35.752281 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-77e87738-889e-4108-a3b7-bbd66bb8870b tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:35.753217 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-77e87738-889e-4108-a3b7-bbd66bb8870b tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:35.753845 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-77e87738-889e-4108-a3b7-bbd66bb8870b tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:36.009895 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-77e87738-889e-4108-a3b7-bbd66bb8870b tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:36.021456 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-77e87738-889e-4108-a3b7-bbd66bb8870b tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4" status: 200 len: 1719 microversion: 2.1 time: 0.287605 Oct 04 18:34:36.037596 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 819/1719] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:35 2022] GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4 => generated 1719 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:36.058999 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-dfe018b8-edb4-47b7-8815-c4e03c05dc46 tempest-MigrationsAdminTest-1101631867 tempest-MigrationsAdminTest-1101631867-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05" status: 200 len: 1616 microversion: 2.1 time: 0.671944 Oct 04 18:34:36.059848 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 901/1720] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:35 2022] GET /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05 => generated 1616 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:36.083735 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-dfaea53a-9930-46ca-9d0f-80267bbaa209 tempest-MigrationsAdminTest-1101631867 tempest-MigrationsAdminTest-1101631867-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:36.086671 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-dfaea53a-9930-46ca-9d0f-80267bbaa209 tempest-MigrationsAdminTest-1101631867 tempest-MigrationsAdminTest-1101631867-project-admin] [instance: 2fe6c508-f183-40bd-bfd5-23c757e99a05] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:36.093286 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dfaea53a-9930-46ca-9d0f-80267bbaa209 tempest-MigrationsAdminTest-1101631867 tempest-MigrationsAdminTest-1101631867-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:36.093775 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dfaea53a-9930-46ca-9d0f-80267bbaa209 tempest-MigrationsAdminTest-1101631867 tempest-MigrationsAdminTest-1101631867-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:36.094209 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dfaea53a-9930-46ca-9d0f-80267bbaa209 tempest-MigrationsAdminTest-1101631867 tempest-MigrationsAdminTest-1101631867-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:36.097616 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dfaea53a-9930-46ca-9d0f-80267bbaa209 tempest-MigrationsAdminTest-1101631867 tempest-MigrationsAdminTest-1101631867-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:36.100863 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dfaea53a-9930-46ca-9d0f-80267bbaa209 tempest-MigrationsAdminTest-1101631867 tempest-MigrationsAdminTest-1101631867-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:36.101318 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dfaea53a-9930-46ca-9d0f-80267bbaa209 tempest-MigrationsAdminTest-1101631867 tempest-MigrationsAdminTest-1101631867-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:36.141150 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1c9044d0-b1d7-4dc4-8a47-67ceb081fea6 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:36.141981 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1c9044d0-b1d7-4dc4-8a47-67ceb081fea6 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: b219d988-2847-45a0-a3b8-af54cf1a43f8] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:36.157713 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=100 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:36.161899 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1c9044d0-b1d7-4dc4-8a47-67ceb081fea6 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:36.163278 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1c9044d0-b1d7-4dc4-8a47-67ceb081fea6 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:36.163978 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1c9044d0-b1d7-4dc4-8a47-67ceb081fea6 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:36.166903 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1c9044d0-b1d7-4dc4-8a47-67ceb081fea6 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:36.167645 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1c9044d0-b1d7-4dc4-8a47-67ceb081fea6 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:36.168338 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1c9044d0-b1d7-4dc4-8a47-67ceb081fea6 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:36.208075 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-dfaea53a-9930-46ca-9d0f-80267bbaa209 tempest-MigrationsAdminTest-1101631867 tempest-MigrationsAdminTest-1101631867-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '803e67aad71745aebdd938e7f46fb870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30e8d60a7c224546bb88676729b4cc04', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:36.208775 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-dfaea53a-9930-46ca-9d0f-80267bbaa209 tempest-MigrationsAdminTest-1101631867 tempest-MigrationsAdminTest-1101631867-project-admin] [instance: 2fe6c508-f183-40bd-bfd5-23c757e99a05] flavor_id is None. Assuming migration. {{(pid=123001) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 04 18:34:36.212834 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-dfaea53a-9930-46ca-9d0f-80267bbaa209 tempest-MigrationsAdminTest-1101631867 tempest-MigrationsAdminTest-1101631867-project-admin] [instance: 2fe6c508-f183-40bd-bfd5-23c757e99a05] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=123001) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 18:34:36.398292 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1c9044d0-b1d7-4dc4-8a47-67ceb081fea6 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:36.413655 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1c9044d0-b1d7-4dc4-8a47-67ceb081fea6 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:36.414342 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1c9044d0-b1d7-4dc4-8a47-67ceb081fea6 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:36.415923 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1c9044d0-b1d7-4dc4-8a47-67ceb081fea6 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8" status: 200 len: 1811 microversion: 2.25 time: 0.279936 Oct 04 18:34:36.416530 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 902/1721] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:36 2022] GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8 => generated 1811 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:36.422555 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a33c49a4-2082-452e-ba0a-becfb15dfcfe tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:36.423463 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a33c49a4-2082-452e-ba0a-becfb15dfcfe tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] [instance: bc418c02-1d95-407f-bbda-c696e9ba5959] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:36.431438 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a33c49a4-2082-452e-ba0a-becfb15dfcfe tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:36.432298 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a33c49a4-2082-452e-ba0a-becfb15dfcfe tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:36.433007 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a33c49a4-2082-452e-ba0a-becfb15dfcfe tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:36.433978 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a33c49a4-2082-452e-ba0a-becfb15dfcfe tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:36.434954 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a33c49a4-2082-452e-ba0a-becfb15dfcfe tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:36.435653 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a33c49a4-2082-452e-ba0a-becfb15dfcfe tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:36.451806 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-a33c49a4-2082-452e-ba0a-becfb15dfcfe tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] HTTP exception thrown: Instance bc418c02-1d95-407f-bbda-c696e9ba5959 could not be found. Oct 04 18:34:36.453990 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a33c49a4-2082-452e-ba0a-becfb15dfcfe tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Request method failure captured: Oct 04 18:34:36.453990 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/bc418c02-1d95-407f-bbda-c696e9ba5959 HTTP/1.1 Oct 04 18:34:36.453990 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:34:36.453990 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:34:36.453990 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:34:36.453990 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:34:36.453990 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:34:36.453990 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:34:36.453990 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:34:36.453990 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:34:36.453990 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPHxrvpP2eevembsFIuQGDsfYs7tKyICrI4XD3H6ALbv_wA6hmzCzuP7frmLGut7t50llAJziP4PS1GCkGjnEfV6w_2-zcMQx5viaM__8e7c5TzJUUbeiSMHY5cayZ3qwgQqR2dMvcsF6_yBk2_xxckI6ObF3hiaCsgZTjsXVzGav3wk Oct 04 18:34:36.453990 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:34:36.453990 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:34:36.453990 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:34:36.453990 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:34:36.453990 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:34:36.453990 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:34:36.453990 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: bc7808c2a8d8491aa5e1594383fab2a3 Oct 04 18:34:36.453990 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServersTestJSON-1991282129 Oct 04 18:34:36.453990 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:34:36.453990 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:34:36.453990 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bc7808c2a8d8491aa5e1594383fab2a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bc7808c2a8d8491aa5e1594383fab2a3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bc7808c2a8d8491aa5e1594383fab2a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bc7808c2a8d8491aa5e1594383fab2a3"}]}] Oct 04 18:34:36.453990 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServersTestJSON-1991282129 Oct 04 18:34:36.453990 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: bc7808c2a8d8491aa5e1594383fab2a3 Oct 04 18:34:36.453990 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServersTestJSON-1991282129 Oct 04 18:34:36.453990 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServersTestJSON-1991282129-project Oct 04 18:34:36.453990 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:34:36.453990 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:34:36.453990 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 71bed3af030c43dbaa23a3e23520f407 Oct 04 18:34:36.453990 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServersTestJSON-1991282129-project Oct 04 18:34:36.453990 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:34:36.453990 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance bc418c02-1d95-407f-bbda-c696e9ba5959 could not be found. Oct 04 18:34:36.453990 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'bc418c02-1d95-407f-bbda-c696e9ba5959'} Oct 04 18:34:36.453990 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:34:36.453990 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:36.453990 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:34:36.453990 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:34:36.453990 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:34:36.453990 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:34:36.453990 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:34:36.453990 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:34:36.453990 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:34:36.453990 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:34:36.453990 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc418c02-1d95-407f-bbda-c696e9ba5959 could not be found. Oct 04 18:34:36.453990 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:34:36.453990 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:36.453990 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:34:36.453990 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:36.453990 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:36.453990 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:36.453990 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:34:36.453990 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:34:36.453990 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:34:36.453990 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:34:36.453990 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:34:36.453990 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:34:36.453990 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:34:36.453990 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:34:36.453990 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:34:36.453990 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:34:36.453990 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc418c02-1d95-407f-bbda-c696e9ba5959 could not be found. Oct 04 18:34:36.453990 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:34:36.453990 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:36.453990 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:34:36.458901 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:36.458901 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:36.458901 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:36.458901 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:34:36.458901 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:34:36.458901 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc418c02-1d95-407f-bbda-c696e9ba5959 could not be found. Oct 04 18:34:36.458901 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:34:36.458901 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a33c49a4-2082-452e-ba0a-becfb15dfcfe tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Returning 404 to user: Instance bc418c02-1d95-407f-bbda-c696e9ba5959 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:34:36.458901 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a33c49a4-2082-452e-ba0a-becfb15dfcfe tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] 10.222.0.20 "GET /compute/v2.1/servers/bc418c02-1d95-407f-bbda-c696e9ba5959" status: 404 len: 111 microversion: 2.1 time: 0.037277 Oct 04 18:34:36.459600 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 903/1722] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:36 2022] GET /compute/v2.1/servers/bc418c02-1d95-407f-bbda-c696e9ba5959 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:34:36.464324 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a309ec3a-bfb7-4a22-bd2e-25b45117f161 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:36.464933 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a309ec3a-bfb7-4a22-bd2e-25b45117f161 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: 0fa89d74-e5c4-461c-adcc-6c29ce9ad8db] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:36.471119 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a309ec3a-bfb7-4a22-bd2e-25b45117f161 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:36.472404 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a309ec3a-bfb7-4a22-bd2e-25b45117f161 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:36.472848 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a309ec3a-bfb7-4a22-bd2e-25b45117f161 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:36.473549 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a309ec3a-bfb7-4a22-bd2e-25b45117f161 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:36.474003 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a309ec3a-bfb7-4a22-bd2e-25b45117f161 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:36.474458 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a309ec3a-bfb7-4a22-bd2e-25b45117f161 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:36.687086 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-dfaea53a-9930-46ca-9d0f-80267bbaa209 tempest-MigrationsAdminTest-1101631867 tempest-MigrationsAdminTest-1101631867-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05/action" status: 202 len: 0 microversion: 2.1 time: 0.606581 Oct 04 18:34:36.689246 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 820/1723] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:34:36 2022] POST /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05/action => generated 0 bytes in 611 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:34:36.697280 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c7b1ddfb-4160-4e04-b669-e898ce14521d tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] Calling method '.version_select at 0x7fe258bdcaf0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:36.763690 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a309ec3a-bfb7-4a22-bd2e-25b45117f161 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:36.772819 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a309ec3a-bfb7-4a22-bd2e-25b45117f161 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/0fa89d74-e5c4-461c-adcc-6c29ce9ad8db" status: 200 len: 1307 microversion: 2.1 time: 0.311502 Oct 04 18:34:36.775794 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 904/1724] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:36 2022] GET /compute/v2.1/servers/0fa89d74-e5c4-461c-adcc-6c29ce9ad8db => generated 1307 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:36.780671 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d7b88b23-22fd-402c-bff4-0e78eec7b3b3 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:36.781278 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d7b88b23-22fd-402c-bff4-0e78eec7b3b3 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] [instance: d3abc28f-8361-4906-a085-1440991c298f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:36.788158 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d7b88b23-22fd-402c-bff4-0e78eec7b3b3 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:36.788645 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d7b88b23-22fd-402c-bff4-0e78eec7b3b3 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:36.789079 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d7b88b23-22fd-402c-bff4-0e78eec7b3b3 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:36.789909 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d7b88b23-22fd-402c-bff4-0e78eec7b3b3 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:36.790361 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d7b88b23-22fd-402c-bff4-0e78eec7b3b3 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:36.790781 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d7b88b23-22fd-402c-bff4-0e78eec7b3b3 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:36.826663 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c7b1ddfb-4160-4e04-b669-e898ce14521d tempest-ServersTestJSON-1991282129 tempest-ServersTestJSON-1991282129-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-216215324" status: 202 len: 0 microversion: 2.1 time: 0.134830 Oct 04 18:34:36.827245 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 821/1725] 10.222.0.20 () {58 vars in 1218 bytes} [Tue Oct 4 18:34:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-216215324 => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:34:36.831897 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-bd692282-2a27-442d-9fd5-0232f72d276f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:36.832529 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-bd692282-2a27-442d-9fd5-0232f72d276f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2fe6c508-f183-40bd-bfd5-23c757e99a05] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:36.839529 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bd692282-2a27-442d-9fd5-0232f72d276f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:36.840018 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bd692282-2a27-442d-9fd5-0232f72d276f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:36.840477 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bd692282-2a27-442d-9fd5-0232f72d276f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:36.841333 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bd692282-2a27-442d-9fd5-0232f72d276f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:36.841698 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bd692282-2a27-442d-9fd5-0232f72d276f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:36.842119 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bd692282-2a27-442d-9fd5-0232f72d276f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:37.062361 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d7b88b23-22fd-402c-bff4-0e78eec7b3b3 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44cc98e07d134a15b0fbf2b80bd25ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e0b0088d8476bbcb4c83783fec0e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:37.071952 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d7b88b23-22fd-402c-bff4-0e78eec7b3b3 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] 10.222.0.20 "GET /compute/v2.1/servers/d3abc28f-8361-4906-a085-1440991c298f" status: 200 len: 1318 microversion: 2.1 time: 0.294845 Oct 04 18:34:37.072579 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 905/1726] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:36 2022] GET /compute/v2.1/servers/d3abc28f-8361-4906-a085-1440991c298f => generated 1318 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:37.077978 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-322098ce-cd34-4d47-bc24-912886186845 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:37.078783 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-322098ce-cd34-4d47-bc24-912886186845 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:37.087116 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-322098ce-cd34-4d47-bc24-912886186845 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:37.088194 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-322098ce-cd34-4d47-bc24-912886186845 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:37.101684 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-322098ce-cd34-4d47-bc24-912886186845 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:37.101684 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-322098ce-cd34-4d47-bc24-912886186845 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:37.101684 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-322098ce-cd34-4d47-bc24-912886186845 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:37.101684 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-322098ce-cd34-4d47-bc24-912886186845 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:37.145676 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-bd692282-2a27-442d-9fd5-0232f72d276f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:37.156738 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-bd692282-2a27-442d-9fd5-0232f72d276f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05" status: 200 len: 1472 microversion: 2.1 time: 0.328439 Oct 04 18:34:37.157335 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 822/1727] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:36 2022] GET /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05 => generated 1472 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:37.165356 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-27552145-14b0-4e21-86d4-48ce87c141a0 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:37.174676 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-27552145-14b0-4e21-86d4-48ce87c141a0 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 158e9f52-fd16-48d1-87b5-e0dd523e97a4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:37.183619 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-27552145-14b0-4e21-86d4-48ce87c141a0 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:37.184158 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-27552145-14b0-4e21-86d4-48ce87c141a0 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:37.185095 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-27552145-14b0-4e21-86d4-48ce87c141a0 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:37.185807 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-27552145-14b0-4e21-86d4-48ce87c141a0 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:37.186327 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-27552145-14b0-4e21-86d4-48ce87c141a0 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:37.186761 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-27552145-14b0-4e21-86d4-48ce87c141a0 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:37.194007 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:37.220618 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-322098ce-cd34-4d47-bc24-912886186845 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:37.232112 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-322098ce-cd34-4d47-bc24-912886186845 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:37.233568 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-322098ce-cd34-4d47-bc24-912886186845 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:37.239138 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-322098ce-cd34-4d47-bc24-912886186845 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1544 microversion: 2.91 time: 0.165334 Oct 04 18:34:37.240340 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 906/1728] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:37 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1544 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:37.444491 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-320a461e-bef6-4bc4-ada8-39f510d501e6 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:37.445096 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-320a461e-bef6-4bc4-ada8-39f510d501e6 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: b219d988-2847-45a0-a3b8-af54cf1a43f8] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:37.451301 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-320a461e-bef6-4bc4-ada8-39f510d501e6 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:37.464882 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-320a461e-bef6-4bc4-ada8-39f510d501e6 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:37.465334 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-320a461e-bef6-4bc4-ada8-39f510d501e6 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:37.466298 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-320a461e-bef6-4bc4-ada8-39f510d501e6 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:37.466768 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-320a461e-bef6-4bc4-ada8-39f510d501e6 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:37.467207 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-320a461e-bef6-4bc4-ada8-39f510d501e6 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:37.491396 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-27552145-14b0-4e21-86d4-48ce87c141a0 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:37.501072 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-27552145-14b0-4e21-86d4-48ce87c141a0 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4" status: 200 len: 1719 microversion: 2.1 time: 0.339333 Oct 04 18:34:37.502105 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 823/1729] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:37 2022] GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4 => generated 1719 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:37.794644 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6b3a649c-a0c7-47d5-b12d-c3dbdc851efb tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:37.795297 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6b3a649c-a0c7-47d5-b12d-c3dbdc851efb tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: 0fa89d74-e5c4-461c-adcc-6c29ce9ad8db] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:37.814558 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6b3a649c-a0c7-47d5-b12d-c3dbdc851efb tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:37.815092 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6b3a649c-a0c7-47d5-b12d-c3dbdc851efb tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:37.824422 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6b3a649c-a0c7-47d5-b12d-c3dbdc851efb tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:37.824422 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6b3a649c-a0c7-47d5-b12d-c3dbdc851efb tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:37.824422 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6b3a649c-a0c7-47d5-b12d-c3dbdc851efb tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:37.824422 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6b3a649c-a0c7-47d5-b12d-c3dbdc851efb tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:38.232195 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-320a461e-bef6-4bc4-ada8-39f510d501e6 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:38.235800 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=4 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:38.245072 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-320a461e-bef6-4bc4-ada8-39f510d501e6 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:38.247677 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-320a461e-bef6-4bc4-ada8-39f510d501e6 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:38.250352 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-320a461e-bef6-4bc4-ada8-39f510d501e6 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8" status: 200 len: 1811 microversion: 2.25 time: 0.809359 Oct 04 18:34:38.251062 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 907/1730] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:37 2022] GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8 => generated 1811 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:34:38.256999 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-087fced2-9aad-4e0e-b103-72ce314b2425 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:38.257797 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-087fced2-9aad-4e0e-b103-72ce314b2425 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] [instance: d3abc28f-8361-4906-a085-1440991c298f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:38.264342 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-087fced2-9aad-4e0e-b103-72ce314b2425 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:38.265234 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-087fced2-9aad-4e0e-b103-72ce314b2425 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:38.265783 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-087fced2-9aad-4e0e-b103-72ce314b2425 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:38.266581 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-087fced2-9aad-4e0e-b103-72ce314b2425 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:38.267363 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-087fced2-9aad-4e0e-b103-72ce314b2425 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:38.267878 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-087fced2-9aad-4e0e-b103-72ce314b2425 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:38.524493 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:38.619961 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6b3a649c-a0c7-47d5-b12d-c3dbdc851efb tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:38.649804 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6b3a649c-a0c7-47d5-b12d-c3dbdc851efb tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/0fa89d74-e5c4-461c-adcc-6c29ce9ad8db" status: 200 len: 1486 microversion: 2.1 time: 0.843128 Oct 04 18:34:38.649804 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 824/1731] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:37 2022] GET /compute/v2.1/servers/0fa89d74-e5c4-461c-adcc-6c29ce9ad8db => generated 1486 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:34:38.649804 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9865ae4f-ddc5-49ca-846d-d9864fc8aff7 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:38.656939 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-9865ae4f-ddc5-49ca-846d-d9864fc8aff7 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2fe6c508-f183-40bd-bfd5-23c757e99a05] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:38.664861 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9865ae4f-ddc5-49ca-846d-d9864fc8aff7 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:38.665363 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9865ae4f-ddc5-49ca-846d-d9864fc8aff7 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:38.665797 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9865ae4f-ddc5-49ca-846d-d9864fc8aff7 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:38.666508 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9865ae4f-ddc5-49ca-846d-d9864fc8aff7 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:38.666964 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9865ae4f-ddc5-49ca-846d-d9864fc8aff7 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:38.667383 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9865ae4f-ddc5-49ca-846d-d9864fc8aff7 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:38.686647 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=10 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:38.697289 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-087fced2-9aad-4e0e-b103-72ce314b2425 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44cc98e07d134a15b0fbf2b80bd25ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e0b0088d8476bbcb4c83783fec0e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:38.716802 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-087fced2-9aad-4e0e-b103-72ce314b2425 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] 10.222.0.20 "GET /compute/v2.1/servers/d3abc28f-8361-4906-a085-1440991c298f" status: 200 len: 1318 microversion: 2.1 time: 0.464365 Oct 04 18:34:38.717392 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 908/1732] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:38 2022] GET /compute/v2.1/servers/d3abc28f-8361-4906-a085-1440991c298f => generated 1318 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:38.744405 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3b69b69b-bb49-41dc-a3e6-2782148d088c tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:38.747631 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3b69b69b-bb49-41dc-a3e6-2782148d088c tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:38.766800 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3b69b69b-bb49-41dc-a3e6-2782148d088c tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:38.767297 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3b69b69b-bb49-41dc-a3e6-2782148d088c tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:38.767753 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3b69b69b-bb49-41dc-a3e6-2782148d088c tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:38.772824 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3b69b69b-bb49-41dc-a3e6-2782148d088c tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:38.774532 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3b69b69b-bb49-41dc-a3e6-2782148d088c tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:38.775137 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3b69b69b-bb49-41dc-a3e6-2782148d088c tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:38.781287 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=100 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:38.875039 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3b69b69b-bb49-41dc-a3e6-2782148d088c tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:38.895590 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3b69b69b-bb49-41dc-a3e6-2782148d088c tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:38.903293 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3b69b69b-bb49-41dc-a3e6-2782148d088c tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:38.914853 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3b69b69b-bb49-41dc-a3e6-2782148d088c tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1544 microversion: 2.91 time: 0.184994 Oct 04 18:34:38.916882 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 909/1733] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:38 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1544 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:38.927879 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-70cd9d50-e5ef-437b-a708-d3db5fc5ec56 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:38.928807 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-70cd9d50-e5ef-437b-a708-d3db5fc5ec56 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 158e9f52-fd16-48d1-87b5-e0dd523e97a4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:38.944815 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-70cd9d50-e5ef-437b-a708-d3db5fc5ec56 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:38.945639 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-70cd9d50-e5ef-437b-a708-d3db5fc5ec56 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:38.946370 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-70cd9d50-e5ef-437b-a708-d3db5fc5ec56 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:38.948973 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-70cd9d50-e5ef-437b-a708-d3db5fc5ec56 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:38.949665 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-70cd9d50-e5ef-437b-a708-d3db5fc5ec56 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:38.950919 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-70cd9d50-e5ef-437b-a708-d3db5fc5ec56 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:39.271091 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9865ae4f-ddc5-49ca-846d-d9864fc8aff7 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:39.274774 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-70cd9d50-e5ef-437b-a708-d3db5fc5ec56 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:39.287105 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-70cd9d50-e5ef-437b-a708-d3db5fc5ec56 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4" status: 200 len: 1719 microversion: 2.1 time: 0.366720 Oct 04 18:34:39.302778 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9865ae4f-ddc5-49ca-846d-d9864fc8aff7 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05" status: 200 len: 1472 microversion: 2.1 time: 0.647734 Oct 04 18:34:39.303084 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 910/1734] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:38 2022] GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4 => generated 1719 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:39.303084 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b266ff7b-190d-4e4c-b0e0-5ac230dcbd0d tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:39.303084 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b266ff7b-190d-4e4c-b0e0-5ac230dcbd0d tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: 0fa89d74-e5c4-461c-adcc-6c29ce9ad8db] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:39.305293 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 825/1735] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:38 2022] GET /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05 => generated 1472 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:39.310651 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b266ff7b-190d-4e4c-b0e0-5ac230dcbd0d tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:39.311451 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b266ff7b-190d-4e4c-b0e0-5ac230dcbd0d tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:39.312310 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b266ff7b-190d-4e4c-b0e0-5ac230dcbd0d tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:39.313241 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b266ff7b-190d-4e4c-b0e0-5ac230dcbd0d tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:39.318487 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d868f22a-df51-4d27-81e9-aa79de62bc48 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:39.323041 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d868f22a-df51-4d27-81e9-aa79de62bc48 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: b219d988-2847-45a0-a3b8-af54cf1a43f8] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:39.323203 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b266ff7b-190d-4e4c-b0e0-5ac230dcbd0d tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:39.323203 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b266ff7b-190d-4e4c-b0e0-5ac230dcbd0d tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:39.327070 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d868f22a-df51-4d27-81e9-aa79de62bc48 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:39.327727 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d868f22a-df51-4d27-81e9-aa79de62bc48 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:39.328385 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d868f22a-df51-4d27-81e9-aa79de62bc48 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:39.329393 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d868f22a-df51-4d27-81e9-aa79de62bc48 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:39.329959 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d868f22a-df51-4d27-81e9-aa79de62bc48 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:39.330494 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d868f22a-df51-4d27-81e9-aa79de62bc48 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:39.384900 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-b266ff7b-190d-4e4c-b0e0-5ac230dcbd0d tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lazy-loading 'flavor' on Instance uuid 0fa89d74-e5c4-461c-adcc-6c29ce9ad8db {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:34:39.662919 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d868f22a-df51-4d27-81e9-aa79de62bc48 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:39.677305 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b266ff7b-190d-4e4c-b0e0-5ac230dcbd0d tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "POST /compute/v2.1/servers/0fa89d74-e5c4-461c-adcc-6c29ce9ad8db/action" status: 202 len: 0 microversion: 2.1 time: 0.383354 Oct 04 18:34:39.681210 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 911/1736] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:34:39 2022] POST /compute/v2.1/servers/0fa89d74-e5c4-461c-adcc-6c29ce9ad8db/action => generated 0 bytes in 385 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:34:39.688366 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d868f22a-df51-4d27-81e9-aa79de62bc48 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:39.689442 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-cef18070-fc30-4c1e-a4fd-d0963d572da4 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:39.691589 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d868f22a-df51-4d27-81e9-aa79de62bc48 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:39.692609 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-cef18070-fc30-4c1e-a4fd-d0963d572da4 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: 0fa89d74-e5c4-461c-adcc-6c29ce9ad8db] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:39.696839 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d868f22a-df51-4d27-81e9-aa79de62bc48 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8" status: 200 len: 1811 microversion: 2.25 time: 0.390148 Oct 04 18:34:39.712594 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 826/1737] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:39 2022] GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8 => generated 1811 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:39.719863 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cef18070-fc30-4c1e-a4fd-d0963d572da4 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:39.720658 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cef18070-fc30-4c1e-a4fd-d0963d572da4 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:39.721287 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cef18070-fc30-4c1e-a4fd-d0963d572da4 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:39.722843 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cef18070-fc30-4c1e-a4fd-d0963d572da4 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:39.723325 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cef18070-fc30-4c1e-a4fd-d0963d572da4 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:39.723762 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cef18070-fc30-4c1e-a4fd-d0963d572da4 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:39.741711 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6dece950-eb25-41b4-a5bf-bf335ff69987 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:39.742591 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6dece950-eb25-41b4-a5bf-bf335ff69987 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] [instance: d3abc28f-8361-4906-a085-1440991c298f] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:39.750840 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6dece950-eb25-41b4-a5bf-bf335ff69987 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:39.751347 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6dece950-eb25-41b4-a5bf-bf335ff69987 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:39.751786 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6dece950-eb25-41b4-a5bf-bf335ff69987 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:39.752523 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6dece950-eb25-41b4-a5bf-bf335ff69987 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:39.753045 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6dece950-eb25-41b4-a5bf-bf335ff69987 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:39.753484 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6dece950-eb25-41b4-a5bf-bf335ff69987 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:39.978407 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-cef18070-fc30-4c1e-a4fd-d0963d572da4 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:39.988710 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-cef18070-fc30-4c1e-a4fd-d0963d572da4 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/0fa89d74-e5c4-461c-adcc-6c29ce9ad8db" status: 200 len: 1494 microversion: 2.1 time: 0.305467 Oct 04 18:34:39.989282 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 912/1738] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:39 2022] GET /compute/v2.1/servers/0fa89d74-e5c4-461c-adcc-6c29ce9ad8db => generated 1494 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:39.994502 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6dece950-eb25-41b4-a5bf-bf335ff69987 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44cc98e07d134a15b0fbf2b80bd25ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e0b0088d8476bbcb4c83783fec0e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:40.014601 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6dece950-eb25-41b4-a5bf-bf335ff69987 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] 10.222.0.20 "GET /compute/v2.1/servers/d3abc28f-8361-4906-a085-1440991c298f" status: 200 len: 1318 microversion: 2.1 time: 0.277508 Oct 04 18:34:40.028096 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 827/1739] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:39 2022] GET /compute/v2.1/servers/d3abc28f-8361-4906-a085-1440991c298f => generated 1318 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:40.028302 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e11d2903-d98f-472a-afe2-8a67da61572f tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:40.028302 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e11d2903-d98f-472a-afe2-8a67da61572f tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:40.045548 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e11d2903-d98f-472a-afe2-8a67da61572f tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:40.050460 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e11d2903-d98f-472a-afe2-8a67da61572f tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:40.050460 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e11d2903-d98f-472a-afe2-8a67da61572f tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:40.050460 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e11d2903-d98f-472a-afe2-8a67da61572f tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:40.052443 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e11d2903-d98f-472a-afe2-8a67da61572f tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:40.053068 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e11d2903-d98f-472a-afe2-8a67da61572f tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:40.173199 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e11d2903-d98f-472a-afe2-8a67da61572f tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:40.184266 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e11d2903-d98f-472a-afe2-8a67da61572f tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:40.192838 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e11d2903-d98f-472a-afe2-8a67da61572f tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:40.203720 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e11d2903-d98f-472a-afe2-8a67da61572f tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1544 microversion: 2.91 time: 0.204503 Oct 04 18:34:40.204400 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 913/1740] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:39 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1544 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:40.311270 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4b79df01-c6cb-4505-b996-19440ff326cb tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:40.312582 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-4b79df01-c6cb-4505-b996-19440ff326cb tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 158e9f52-fd16-48d1-87b5-e0dd523e97a4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:40.322765 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ec60c696-1d61-491f-8fe3-571327d1eb36 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:40.323634 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ec60c696-1d61-491f-8fe3-571327d1eb36 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2fe6c508-f183-40bd-bfd5-23c757e99a05] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:40.333379 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ec60c696-1d61-491f-8fe3-571327d1eb36 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:40.338157 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ec60c696-1d61-491f-8fe3-571327d1eb36 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:40.338157 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ec60c696-1d61-491f-8fe3-571327d1eb36 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:40.338415 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4b79df01-c6cb-4505-b996-19440ff326cb tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:40.338415 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4b79df01-c6cb-4505-b996-19440ff326cb tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:40.338607 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ec60c696-1d61-491f-8fe3-571327d1eb36 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:40.338697 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4b79df01-c6cb-4505-b996-19440ff326cb tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:40.338802 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ec60c696-1d61-491f-8fe3-571327d1eb36 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:40.338915 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4b79df01-c6cb-4505-b996-19440ff326cb tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:40.339006 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ec60c696-1d61-491f-8fe3-571327d1eb36 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:40.339336 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4b79df01-c6cb-4505-b996-19440ff326cb tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:40.340257 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4b79df01-c6cb-4505-b996-19440ff326cb tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:40.609170 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ec60c696-1d61-491f-8fe3-571327d1eb36 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:40.629172 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ec60c696-1d61-491f-8fe3-571327d1eb36 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05" status: 200 len: 1472 microversion: 2.1 time: 0.310062 Oct 04 18:34:40.630250 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 914/1741] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:40 2022] GET /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05 => generated 1472 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:34:40.690338 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-4b79df01-c6cb-4505-b996-19440ff326cb tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:40.709107 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-4b79df01-c6cb-4505-b996-19440ff326cb tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4" status: 200 len: 1719 microversion: 2.1 time: 0.402101 Oct 04 18:34:40.720224 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 828/1742] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:40 2022] GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4 => generated 1719 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:34:40.737304 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-96e79668-cb50-49be-bc71-8023e2a99434 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:40.739440 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-96e79668-cb50-49be-bc71-8023e2a99434 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: b219d988-2847-45a0-a3b8-af54cf1a43f8] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:40.755348 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-96e79668-cb50-49be-bc71-8023e2a99434 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:40.756349 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-96e79668-cb50-49be-bc71-8023e2a99434 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:40.763081 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-96e79668-cb50-49be-bc71-8023e2a99434 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:40.764212 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-96e79668-cb50-49be-bc71-8023e2a99434 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:40.767840 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-96e79668-cb50-49be-bc71-8023e2a99434 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:40.768555 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-96e79668-cb50-49be-bc71-8023e2a99434 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:41.016670 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-62ee1952-e39e-4f20-b98f-0d2887df6e72 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:41.017299 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-62ee1952-e39e-4f20-b98f-0d2887df6e72 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: 0fa89d74-e5c4-461c-adcc-6c29ce9ad8db] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:41.030385 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-62ee1952-e39e-4f20-b98f-0d2887df6e72 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:41.031119 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-62ee1952-e39e-4f20-b98f-0d2887df6e72 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:41.038100 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-62ee1952-e39e-4f20-b98f-0d2887df6e72 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:41.039077 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-62ee1952-e39e-4f20-b98f-0d2887df6e72 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:41.039559 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-62ee1952-e39e-4f20-b98f-0d2887df6e72 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:41.040184 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-62ee1952-e39e-4f20-b98f-0d2887df6e72 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:41.153326 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-96e79668-cb50-49be-bc71-8023e2a99434 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:41.176741 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-96e79668-cb50-49be-bc71-8023e2a99434 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:41.182142 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-96e79668-cb50-49be-bc71-8023e2a99434 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:41.187062 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-96e79668-cb50-49be-bc71-8023e2a99434 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8" status: 200 len: 1811 microversion: 2.25 time: 0.453701 Oct 04 18:34:41.188940 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 915/1743] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:40 2022] GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8 => generated 1811 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:41.200108 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e15b1083-2107-4e0b-b908-392dbe603dd6 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:41.201917 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e15b1083-2107-4e0b-b908-392dbe603dd6 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] [instance: d3abc28f-8361-4906-a085-1440991c298f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:41.221170 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e15b1083-2107-4e0b-b908-392dbe603dd6 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:41.223560 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e15b1083-2107-4e0b-b908-392dbe603dd6 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:41.232400 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e15b1083-2107-4e0b-b908-392dbe603dd6 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:41.235349 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e15b1083-2107-4e0b-b908-392dbe603dd6 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:41.235349 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e15b1083-2107-4e0b-b908-392dbe603dd6 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:41.235349 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e15b1083-2107-4e0b-b908-392dbe603dd6 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:41.481276 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-62ee1952-e39e-4f20-b98f-0d2887df6e72 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:41.497901 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-62ee1952-e39e-4f20-b98f-0d2887df6e72 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/0fa89d74-e5c4-461c-adcc-6c29ce9ad8db" status: 200 len: 1477 microversion: 2.1 time: 0.485122 Oct 04 18:34:41.501499 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 829/1744] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:41 2022] GET /compute/v2.1/servers/0fa89d74-e5c4-461c-adcc-6c29ce9ad8db => generated 1477 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:34:41.512589 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0b1dc9f0-76b9-4c2a-a586-0d71494e45ec tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:41.514118 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0b1dc9f0-76b9-4c2a-a586-0d71494e45ec tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:41.557393 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0b1dc9f0-76b9-4c2a-a586-0d71494e45ec tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:41.557893 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0b1dc9f0-76b9-4c2a-a586-0d71494e45ec tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:41.558331 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0b1dc9f0-76b9-4c2a-a586-0d71494e45ec tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:41.559040 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0b1dc9f0-76b9-4c2a-a586-0d71494e45ec tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:41.559763 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0b1dc9f0-76b9-4c2a-a586-0d71494e45ec tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:41.560222 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0b1dc9f0-76b9-4c2a-a586-0d71494e45ec tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:41.696074 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e15b1083-2107-4e0b-b908-392dbe603dd6 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44cc98e07d134a15b0fbf2b80bd25ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e0b0088d8476bbcb4c83783fec0e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:41.742328 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e15b1083-2107-4e0b-b908-392dbe603dd6 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] 10.222.0.20 "GET /compute/v2.1/servers/d3abc28f-8361-4906-a085-1440991c298f" status: 200 len: 1318 microversion: 2.1 time: 0.550570 Oct 04 18:34:41.743072 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 916/1745] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:41 2022] GET /compute/v2.1/servers/d3abc28f-8361-4906-a085-1440991c298f => generated 1318 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:41.747170 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0b1dc9f0-76b9-4c2a-a586-0d71494e45ec tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:41.767013 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9ee79260-7f2e-452e-868f-37affa39d27b tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1133475010"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:41.767701 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0b1dc9f0-76b9-4c2a-a586-0d71494e45ec tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:41.770725 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0b1dc9f0-76b9-4c2a-a586-0d71494e45ec tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:41.785691 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9ee79260-7f2e-452e-868f-37affa39d27b tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: 0fa89d74-e5c4-461c-adcc-6c29ce9ad8db] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:41.785845 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0b1dc9f0-76b9-4c2a-a586-0d71494e45ec tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1531 microversion: 2.91 time: 0.275299 Oct 04 18:34:41.787642 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 830/1746] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:41 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1531 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:41.789577 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9ee79260-7f2e-452e-868f-37affa39d27b tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:41.790082 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9ee79260-7f2e-452e-868f-37affa39d27b tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:41.790584 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9ee79260-7f2e-452e-868f-37affa39d27b tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:41.791362 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9ee79260-7f2e-452e-868f-37affa39d27b tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:41.791887 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9ee79260-7f2e-452e-868f-37affa39d27b tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:41.792555 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9ee79260-7f2e-452e-868f-37affa39d27b tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:41.812025 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4d543337-ed44-4a00-a3e2-12c01f7a5567 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:41.816678 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-4d543337-ed44-4a00-a3e2-12c01f7a5567 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2fe6c508-f183-40bd-bfd5-23c757e99a05] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:41.842772 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4d543337-ed44-4a00-a3e2-12c01f7a5567 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:41.843259 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4d543337-ed44-4a00-a3e2-12c01f7a5567 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:41.843694 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4d543337-ed44-4a00-a3e2-12c01f7a5567 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:41.844440 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4d543337-ed44-4a00-a3e2-12c01f7a5567 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:41.844998 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4d543337-ed44-4a00-a3e2-12c01f7a5567 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:41.845422 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4d543337-ed44-4a00-a3e2-12c01f7a5567 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:42.073328 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-4d543337-ed44-4a00-a3e2-12c01f7a5567 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:42.105357 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-4d543337-ed44-4a00-a3e2-12c01f7a5567 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05" status: 200 len: 1472 microversion: 2.1 time: 0.316151 Oct 04 18:34:42.106151 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 831/1747] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:41 2022] GET /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05 => generated 1472 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:42.121622 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6196bd13-e149-44dd-ade0-d4ddec79697b tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:42.122503 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6196bd13-e149-44dd-ade0-d4ddec79697b tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 158e9f52-fd16-48d1-87b5-e0dd523e97a4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:42.137454 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6196bd13-e149-44dd-ade0-d4ddec79697b tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:42.150655 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6196bd13-e149-44dd-ade0-d4ddec79697b tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:42.151120 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6196bd13-e149-44dd-ade0-d4ddec79697b tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:42.151979 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6196bd13-e149-44dd-ade0-d4ddec79697b tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:42.155535 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6196bd13-e149-44dd-ade0-d4ddec79697b tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:42.156231 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6196bd13-e149-44dd-ade0-d4ddec79697b tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:42.374729 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6196bd13-e149-44dd-ade0-d4ddec79697b tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:42.386070 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6196bd13-e149-44dd-ade0-d4ddec79697b tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4" status: 200 len: 1719 microversion: 2.1 time: 0.269674 Oct 04 18:34:42.386977 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 832/1748] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:42 2022] GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4 => generated 1719 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:42.404910 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b9c7f98d-f674-48ba-acf8-e41291335a10 tempest-UnshelveToHostMultiNodesTest-409522397 tempest-UnshelveToHostMultiNodesTest-409522397-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:42.405872 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b9c7f98d-f674-48ba-acf8-e41291335a10 tempest-UnshelveToHostMultiNodesTest-409522397 tempest-UnshelveToHostMultiNodesTest-409522397-project-admin] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:42.414200 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b9c7f98d-f674-48ba-acf8-e41291335a10 tempest-UnshelveToHostMultiNodesTest-409522397 tempest-UnshelveToHostMultiNodesTest-409522397-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:42.417149 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b9c7f98d-f674-48ba-acf8-e41291335a10 tempest-UnshelveToHostMultiNodesTest-409522397 tempest-UnshelveToHostMultiNodesTest-409522397-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:42.417149 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b9c7f98d-f674-48ba-acf8-e41291335a10 tempest-UnshelveToHostMultiNodesTest-409522397 tempest-UnshelveToHostMultiNodesTest-409522397-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:42.417149 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b9c7f98d-f674-48ba-acf8-e41291335a10 tempest-UnshelveToHostMultiNodesTest-409522397 tempest-UnshelveToHostMultiNodesTest-409522397-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:42.417149 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b9c7f98d-f674-48ba-acf8-e41291335a10 tempest-UnshelveToHostMultiNodesTest-409522397 tempest-UnshelveToHostMultiNodesTest-409522397-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:42.418286 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b9c7f98d-f674-48ba-acf8-e41291335a10 tempest-UnshelveToHostMultiNodesTest-409522397 tempest-UnshelveToHostMultiNodesTest-409522397-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:42.421107 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9ee79260-7f2e-452e-868f-37affa39d27b tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "POST /compute/v2.1/servers/0fa89d74-e5c4-461c-adcc-6c29ce9ad8db/action" status: 202 len: 0 microversion: 2.1 time: 0.674382 Oct 04 18:34:42.423160 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 917/1749] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:34:41 2022] POST /compute/v2.1/servers/0fa89d74-e5c4-461c-adcc-6c29ce9ad8db/action => generated 0 bytes in 679 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 18:34:42.436101 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e7b4b0ea-234c-4f6e-9cca-f730834ec6f3 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:42.438221 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e7b4b0ea-234c-4f6e-9cca-f730834ec6f3 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: b219d988-2847-45a0-a3b8-af54cf1a43f8] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:42.445903 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e7b4b0ea-234c-4f6e-9cca-f730834ec6f3 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:42.446401 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e7b4b0ea-234c-4f6e-9cca-f730834ec6f3 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:42.446851 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e7b4b0ea-234c-4f6e-9cca-f730834ec6f3 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:42.447751 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e7b4b0ea-234c-4f6e-9cca-f730834ec6f3 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:42.451606 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e7b4b0ea-234c-4f6e-9cca-f730834ec6f3 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:42.451606 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e7b4b0ea-234c-4f6e-9cca-f730834ec6f3 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:42.589595 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-b9c7f98d-f674-48ba-acf8-e41291335a10 tempest-UnshelveToHostMultiNodesTest-409522397 tempest-UnshelveToHostMultiNodesTest-409522397-project-admin] Lazy-loading 'services' on Instance uuid bb962e56-0c86-4511-b629-d51507a3a8c9 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:34:42.639810 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b9c7f98d-f674-48ba-acf8-e41291335a10 tempest-UnshelveToHostMultiNodesTest-409522397 tempest-UnshelveToHostMultiNodesTest-409522397-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1938 microversion: 2.91 time: 0.251796 Oct 04 18:34:42.643339 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 833/1750] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:42 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1938 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:42.671544 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d3a948bd-6804-4c48-9fcc-3cafdd605490 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '.version_select at 0x7fe258fd0310>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:42.716152 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e7b4b0ea-234c-4f6e-9cca-f730834ec6f3 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:42.736491 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e7b4b0ea-234c-4f6e-9cca-f730834ec6f3 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:42.744665 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d3a948bd-6804-4c48-9fcc-3cafdd605490 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/images/e64eecee-1f9d-474a-9126-89110fbb7f85" status: 200 len: 1440 microversion: 2.1 time: 0.087073 Oct 04 18:34:42.756810 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 834/1751] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:34:42 2022] GET /compute/v2.1/images/e64eecee-1f9d-474a-9126-89110fbb7f85 => generated 1440 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:42.757228 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e7b4b0ea-234c-4f6e-9cca-f730834ec6f3 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:42.757228 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e7b4b0ea-234c-4f6e-9cca-f730834ec6f3 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8" status: 200 len: 1801 microversion: 2.25 time: 0.326790 Oct 04 18:34:42.757228 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 918/1752] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:42 2022] GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8 => generated 1801 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:42.758209 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f73bcc77-2ff6-41dc-91cd-68dfc2a1d0c3 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:42.758209 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f73bcc77-2ff6-41dc-91cd-68dfc2a1d0c3 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:42.764426 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f73bcc77-2ff6-41dc-91cd-68dfc2a1d0c3 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:42.765675 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f73bcc77-2ff6-41dc-91cd-68dfc2a1d0c3 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:42.766321 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f73bcc77-2ff6-41dc-91cd-68dfc2a1d0c3 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:42.767231 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f73bcc77-2ff6-41dc-91cd-68dfc2a1d0c3 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:42.767883 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f73bcc77-2ff6-41dc-91cd-68dfc2a1d0c3 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:42.770065 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9f5d4033-f4d6-433f-8393-c8ff03156759 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:42.770278 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f73bcc77-2ff6-41dc-91cd-68dfc2a1d0c3 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:42.770836 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9f5d4033-f4d6-433f-8393-c8ff03156759 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] [instance: d3abc28f-8361-4906-a085-1440991c298f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:42.786710 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9f5d4033-f4d6-433f-8393-c8ff03156759 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:42.787214 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9f5d4033-f4d6-433f-8393-c8ff03156759 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:42.787661 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9f5d4033-f4d6-433f-8393-c8ff03156759 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:42.791160 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9f5d4033-f4d6-433f-8393-c8ff03156759 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:42.791687 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9f5d4033-f4d6-433f-8393-c8ff03156759 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:42.792220 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9f5d4033-f4d6-433f-8393-c8ff03156759 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:42.811040 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-f73bcc77-2ff6-41dc-91cd-68dfc2a1d0c3 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lazy-loading 'flavor' on Instance uuid bb962e56-0c86-4511-b629-d51507a3a8c9 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:34:43.036027 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9f5d4033-f4d6-433f-8393-c8ff03156759 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44cc98e07d134a15b0fbf2b80bd25ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e0b0088d8476bbcb4c83783fec0e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:43.048960 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9f5d4033-f4d6-433f-8393-c8ff03156759 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] 10.222.0.20 "GET /compute/v2.1/servers/d3abc28f-8361-4906-a085-1440991c298f" status: 200 len: 1318 microversion: 2.1 time: 0.283541 Oct 04 18:34:43.055030 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 919/1753] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:42 2022] GET /compute/v2.1/servers/d3abc28f-8361-4906-a085-1440991c298f => generated 1318 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:43.071457 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2c3977a7-27b1-4f88-a53c-7fa4d663f699 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Calling method '.version_select at 0x7fe2598dbf70>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:43.075681 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2c3977a7-27b1-4f88-a53c-7fa4d663f699 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:43.076538 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2c3977a7-27b1-4f88-a53c-7fa4d663f699 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:43.077179 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2c3977a7-27b1-4f88-a53c-7fa4d663f699 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:43.099958 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2c3977a7-27b1-4f88-a53c-7fa4d663f699 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 3235 microversion: 2.25 time: 0.043576 Oct 04 18:34:43.103710 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 920/1754] 10.222.0.20 () {60 vars in 1184 bytes} [Tue Oct 4 18:34:43 2022] GET /compute/v2.1/os-migrations => generated 3235 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:43.120134 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-31f00537-6dd0-4ac1-9574-e47d6693a48f tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:43.121057 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-31f00537-6dd0-4ac1-9574-e47d6693a48f tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] [instance: b219d988-2847-45a0-a3b8-af54cf1a43f8] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:43.130167 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-31f00537-6dd0-4ac1-9574-e47d6693a48f tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:43.130915 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-31f00537-6dd0-4ac1-9574-e47d6693a48f tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:43.131552 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-31f00537-6dd0-4ac1-9574-e47d6693a48f tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:43.132636 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-31f00537-6dd0-4ac1-9574-e47d6693a48f tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:43.133338 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-31f00537-6dd0-4ac1-9574-e47d6693a48f tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:43.133873 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-31f00537-6dd0-4ac1-9574-e47d6693a48f tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:43.401478 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-31f00537-6dd0-4ac1-9574-e47d6693a48f tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lazy-loading 'services' on Instance uuid b219d988-2847-45a0-a3b8-af54cf1a43f8 {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:34:43.418403 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-31f00537-6dd0-4ac1-9574-e47d6693a48f tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8" status: 200 len: 2421 microversion: 2.25 time: 0.302511 Oct 04 18:34:43.419304 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 921/1755] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:43 2022] GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8 => generated 2421 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:34:43.423778 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d922169a-5872-4d50-bd82-1c26e838118f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:43.425120 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d922169a-5872-4d50-bd82-1c26e838118f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2fe6c508-f183-40bd-bfd5-23c757e99a05] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:43.431923 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d922169a-5872-4d50-bd82-1c26e838118f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:43.432440 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d922169a-5872-4d50-bd82-1c26e838118f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:43.432871 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d922169a-5872-4d50-bd82-1c26e838118f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:43.433569 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d922169a-5872-4d50-bd82-1c26e838118f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:43.434133 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d922169a-5872-4d50-bd82-1c26e838118f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:43.434826 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d922169a-5872-4d50-bd82-1c26e838118f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:43.482362 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f73bcc77-2ff6-41dc-91cd-68dfc2a1d0c3 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "POST /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9/action" status: 202 len: 0 microversion: 2.91 time: 0.728377 Oct 04 18:34:43.494534 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 835/1756] 10.222.0.20 () {62 vars in 1319 bytes} [Tue Oct 4 18:34:42 2022] POST /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9/action => generated 0 bytes in 748 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:34:43.523605 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-072c5f76-6259-4b99-95c4-74f32353f8f5 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:43.524737 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-072c5f76-6259-4b99-95c4-74f32353f8f5 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 158e9f52-fd16-48d1-87b5-e0dd523e97a4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:43.541061 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-072c5f76-6259-4b99-95c4-74f32353f8f5 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:43.541868 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-072c5f76-6259-4b99-95c4-74f32353f8f5 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:43.542493 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-072c5f76-6259-4b99-95c4-74f32353f8f5 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:43.543411 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-072c5f76-6259-4b99-95c4-74f32353f8f5 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:43.544035 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-072c5f76-6259-4b99-95c4-74f32353f8f5 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:43.544836 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-072c5f76-6259-4b99-95c4-74f32353f8f5 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:43.771998 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d922169a-5872-4d50-bd82-1c26e838118f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:43.783328 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d922169a-5872-4d50-bd82-1c26e838118f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05" status: 200 len: 1472 microversion: 2.1 time: 0.362964 Oct 04 18:34:43.786529 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 922/1757] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:43 2022] GET /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05 => generated 1472 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:43.793327 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e343ebd2-c0cf-4a8e-97a5-034653e452a0 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:43.794165 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e343ebd2-c0cf-4a8e-97a5-034653e452a0 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] [instance: b219d988-2847-45a0-a3b8-af54cf1a43f8] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:43.803382 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e343ebd2-c0cf-4a8e-97a5-034653e452a0 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:43.804160 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e343ebd2-c0cf-4a8e-97a5-034653e452a0 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:43.819385 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e343ebd2-c0cf-4a8e-97a5-034653e452a0 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:43.820355 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e343ebd2-c0cf-4a8e-97a5-034653e452a0 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:43.820984 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e343ebd2-c0cf-4a8e-97a5-034653e452a0 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:43.821571 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e343ebd2-c0cf-4a8e-97a5-034653e452a0 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:43.826149 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:43.861804 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-072c5f76-6259-4b99-95c4-74f32353f8f5 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:43.875386 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-072c5f76-6259-4b99-95c4-74f32353f8f5 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4" status: 200 len: 1719 microversion: 2.1 time: 0.372899 Oct 04 18:34:43.879647 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 836/1758] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:43 2022] GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4 => generated 1719 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:43.883638 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3f4d44cb-f021-4311-8332-7118dd8dc050 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:43.886380 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3f4d44cb-f021-4311-8332-7118dd8dc050 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:43.903980 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3f4d44cb-f021-4311-8332-7118dd8dc050 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:43.904708 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3f4d44cb-f021-4311-8332-7118dd8dc050 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:43.905189 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3f4d44cb-f021-4311-8332-7118dd8dc050 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:43.905914 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3f4d44cb-f021-4311-8332-7118dd8dc050 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:43.913198 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3f4d44cb-f021-4311-8332-7118dd8dc050 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:43.913198 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3f4d44cb-f021-4311-8332-7118dd8dc050 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:44.050311 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3f4d44cb-f021-4311-8332-7118dd8dc050 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:44.067871 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3f4d44cb-f021-4311-8332-7118dd8dc050 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:44.070624 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3f4d44cb-f021-4311-8332-7118dd8dc050 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:44.084601 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3f4d44cb-f021-4311-8332-7118dd8dc050 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1537 microversion: 2.91 time: 0.205020 Oct 04 18:34:44.101686 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 837/1759] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:43 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1537 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:44.102180 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b9ea95dc-9281-489f-80fe-96283d6307af tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '.version_select at 0x7fe258bd80d0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:44.153492 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-e343ebd2-c0cf-4a8e-97a5-034653e452a0 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lazy-loading 'services' on Instance uuid b219d988-2847-45a0-a3b8-af54cf1a43f8 {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:34:44.174435 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e343ebd2-c0cf-4a8e-97a5-034653e452a0 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8" status: 200 len: 2421 microversion: 2.25 time: 0.386311 Oct 04 18:34:44.175229 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 923/1760] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:43 2022] GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8 => generated 2421 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:44.188453 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3875357b-a25c-47bf-9ff8-7b77687b26d0 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:44.188453 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3875357b-a25c-47bf-9ff8-7b77687b26d0 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] [instance: d3abc28f-8361-4906-a085-1440991c298f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:44.199176 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3875357b-a25c-47bf-9ff8-7b77687b26d0 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:44.199704 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3875357b-a25c-47bf-9ff8-7b77687b26d0 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:44.203162 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3875357b-a25c-47bf-9ff8-7b77687b26d0 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:44.203162 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3875357b-a25c-47bf-9ff8-7b77687b26d0 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:44.203162 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3875357b-a25c-47bf-9ff8-7b77687b26d0 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:44.203162 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3875357b-a25c-47bf-9ff8-7b77687b26d0 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:44.218304 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b9ea95dc-9281-489f-80fe-96283d6307af tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/images/e64eecee-1f9d-474a-9126-89110fbb7f85" status: 200 len: 1440 microversion: 2.1 time: 0.120745 Oct 04 18:34:44.220073 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 838/1761] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:34:44 2022] GET /compute/v2.1/images/e64eecee-1f9d-474a-9126-89110fbb7f85 => generated 1440 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:44.227087 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-5620a827-c53c-4589-bf3f-a90874c333e9 req-2e3137d3-9ac9-43cc-a3be-3d917f0e9cae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3abc28f-8361-4906-a085-1440991c298f", "name": "network-vif-plugged", "status": "completed", "tag": "82ad6043-0772-4416-b7ca-f387aa238059"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:44.238132 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-5620a827-c53c-4589-bf3f-a90874c333e9 req-2e3137d3-9ac9-43cc-a3be-3d917f0e9cae service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:44.239005 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-5620a827-c53c-4589-bf3f-a90874c333e9 req-2e3137d3-9ac9-43cc-a3be-3d917f0e9cae service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:44.239693 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-5620a827-c53c-4589-bf3f-a90874c333e9 req-2e3137d3-9ac9-43cc-a3be-3d917f0e9cae service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:44.255420 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-5620a827-c53c-4589-bf3f-a90874c333e9 req-2e3137d3-9ac9-43cc-a3be-3d917f0e9cae service nova] Creating event network-vif-plugged:82ad6043-0772-4416-b7ca-f387aa238059 for instance d3abc28f-8361-4906-a085-1440991c298f on n-h2-850501-14 Oct 04 18:34:44.262814 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-5620a827-c53c-4589-bf3f-a90874c333e9 req-2e3137d3-9ac9-43cc-a3be-3d917f0e9cae service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040424 Oct 04 18:34:44.264295 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 839/1762] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:34:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:34:44.334103 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-388c6147-7e8e-4cf2-9def-1460ccaebeb9 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:44.336671 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-388c6147-7e8e-4cf2-9def-1460ccaebeb9 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: b219d988-2847-45a0-a3b8-af54cf1a43f8] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:44.351091 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-388c6147-7e8e-4cf2-9def-1460ccaebeb9 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:44.359365 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-388c6147-7e8e-4cf2-9def-1460ccaebeb9 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:44.361907 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-388c6147-7e8e-4cf2-9def-1460ccaebeb9 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:44.364502 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-388c6147-7e8e-4cf2-9def-1460ccaebeb9 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:44.365104 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-388c6147-7e8e-4cf2-9def-1460ccaebeb9 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:44.367086 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-388c6147-7e8e-4cf2-9def-1460ccaebeb9 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:44.432894 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:44.566985 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3875357b-a25c-47bf-9ff8-7b77687b26d0 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44cc98e07d134a15b0fbf2b80bd25ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e0b0088d8476bbcb4c83783fec0e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:44.567927 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-388c6147-7e8e-4cf2-9def-1460ccaebeb9 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lazy-loading 'services' on Instance uuid b219d988-2847-45a0-a3b8-af54cf1a43f8 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:34:44.574953 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3875357b-a25c-47bf-9ff8-7b77687b26d0 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] 10.222.0.20 "GET /compute/v2.1/servers/d3abc28f-8361-4906-a085-1440991c298f" status: 200 len: 1318 microversion: 2.1 time: 0.397280 Oct 04 18:34:44.577945 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 924/1763] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:44 2022] GET /compute/v2.1/servers/d3abc28f-8361-4906-a085-1440991c298f => generated 1318 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:44.814409 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f94d76bd-8fc2-46dc-84e4-a0817c2d876e tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:44.816185 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f94d76bd-8fc2-46dc-84e4-a0817c2d876e tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2fe6c508-f183-40bd-bfd5-23c757e99a05] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:44.831275 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f94d76bd-8fc2-46dc-84e4-a0817c2d876e tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:44.832518 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f94d76bd-8fc2-46dc-84e4-a0817c2d876e tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:44.833605 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f94d76bd-8fc2-46dc-84e4-a0817c2d876e tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:44.835253 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f94d76bd-8fc2-46dc-84e4-a0817c2d876e tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:44.836233 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f94d76bd-8fc2-46dc-84e4-a0817c2d876e tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:44.837108 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f94d76bd-8fc2-46dc-84e4-a0817c2d876e tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:44.963601 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-388c6147-7e8e-4cf2-9def-1460ccaebeb9 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8/os-volume_attachments/3c346ae8-91cb-4213-9900-9dc53e5db5f7" status: 202 len: 0 microversion: 2.25 time: 0.637632 Oct 04 18:34:44.968795 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 840/1764] 10.222.0.20 () {60 vars in 1457 bytes} [Tue Oct 4 18:34:44 2022] DELETE /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8/os-volume_attachments/3c346ae8-91cb-4213-9900-9dc53e5db5f7 => generated 0 bytes in 644 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:34:44.975531 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-50dea28c-acf3-4660-85b1-588457a613bf tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:44.976433 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-50dea28c-acf3-4660-85b1-588457a613bf tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 158e9f52-fd16-48d1-87b5-e0dd523e97a4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:44.983120 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-50dea28c-acf3-4660-85b1-588457a613bf tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:44.983774 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-50dea28c-acf3-4660-85b1-588457a613bf tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:44.984522 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-50dea28c-acf3-4660-85b1-588457a613bf tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:44.985491 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-50dea28c-acf3-4660-85b1-588457a613bf tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:44.986103 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-50dea28c-acf3-4660-85b1-588457a613bf tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:44.986599 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-50dea28c-acf3-4660-85b1-588457a613bf tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:45.008386 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f94d76bd-8fc2-46dc-84e4-a0817c2d876e tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:45.017290 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f94d76bd-8fc2-46dc-84e4-a0817c2d876e tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05" status: 200 len: 1477 microversion: 2.1 time: 0.211647 Oct 04 18:34:45.018585 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 925/1765] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:44 2022] GET /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05 => generated 1477 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:45.028009 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-52e65eaa-da24-47cc-818e-77631202b468 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:45.038026 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-52e65eaa-da24-47cc-818e-77631202b468 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: b219d988-2847-45a0-a3b8-af54cf1a43f8] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:45.047931 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-52e65eaa-da24-47cc-818e-77631202b468 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:45.048460 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-52e65eaa-da24-47cc-818e-77631202b468 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:45.048953 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-52e65eaa-da24-47cc-818e-77631202b468 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:45.049739 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-52e65eaa-da24-47cc-818e-77631202b468 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:45.050747 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-52e65eaa-da24-47cc-818e-77631202b468 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:45.051336 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-52e65eaa-da24-47cc-818e-77631202b468 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:45.084779 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-52e65eaa-da24-47cc-818e-77631202b468 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.060621 Oct 04 18:34:45.088143 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 926/1766] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Oct 4 18:34:45 2022] GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:34:45.120258 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0daf0702-d7ea-4aa1-9481-2b04b788c892 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:45.121113 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0daf0702-d7ea-4aa1-9481-2b04b788c892 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:45.127849 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0daf0702-d7ea-4aa1-9481-2b04b788c892 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:45.128666 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0daf0702-d7ea-4aa1-9481-2b04b788c892 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:45.129261 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0daf0702-d7ea-4aa1-9481-2b04b788c892 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:45.130049 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0daf0702-d7ea-4aa1-9481-2b04b788c892 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:45.130618 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0daf0702-d7ea-4aa1-9481-2b04b788c892 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:45.131050 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0daf0702-d7ea-4aa1-9481-2b04b788c892 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:45.224710 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0daf0702-d7ea-4aa1-9481-2b04b788c892 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:45.247179 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-50dea28c-acf3-4660-85b1-588457a613bf tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:45.251465 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0daf0702-d7ea-4aa1-9481-2b04b788c892 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:45.254547 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0daf0702-d7ea-4aa1-9481-2b04b788c892 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:45.258611 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-50dea28c-acf3-4660-85b1-588457a613bf tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4" status: 200 len: 1719 microversion: 2.1 time: 0.288241 Oct 04 18:34:45.259242 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 841/1767] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:44 2022] GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4 => generated 1719 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:45.260696 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0daf0702-d7ea-4aa1-9481-2b04b788c892 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1537 microversion: 2.91 time: 0.144897 Oct 04 18:34:45.262106 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 927/1768] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:45 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1537 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:34:45.282873 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-47880682-fc64-46aa-8233-199de3d46189 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '.version_select at 0x7fe258bf8b80>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:45.336174 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-47880682-fc64-46aa-8233-199de3d46189 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/images/e64eecee-1f9d-474a-9126-89110fbb7f85" status: 200 len: 1440 microversion: 2.1 time: 0.065145 Oct 04 18:34:45.336697 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 842/1769] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:34:45 2022] GET /compute/v2.1/images/e64eecee-1f9d-474a-9126-89110fbb7f85 => generated 1440 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:45.605367 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-059e9a53-c974-405b-bd9c-b216fe0e4895 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:45.606193 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-059e9a53-c974-405b-bd9c-b216fe0e4895 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] [instance: d3abc28f-8361-4906-a085-1440991c298f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:45.615017 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-059e9a53-c974-405b-bd9c-b216fe0e4895 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:45.615830 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-059e9a53-c974-405b-bd9c-b216fe0e4895 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:45.616489 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-059e9a53-c974-405b-bd9c-b216fe0e4895 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:45.617521 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-059e9a53-c974-405b-bd9c-b216fe0e4895 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:45.618157 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-059e9a53-c974-405b-bd9c-b216fe0e4895 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:45.619358 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-059e9a53-c974-405b-bd9c-b216fe0e4895 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:46.044332 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2726c2b5-69d7-48ed-948c-dce07f3b8819 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:46.045554 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2726c2b5-69d7-48ed-948c-dce07f3b8819 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2fe6c508-f183-40bd-bfd5-23c757e99a05] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:46.052455 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2726c2b5-69d7-48ed-948c-dce07f3b8819 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:46.053205 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2726c2b5-69d7-48ed-948c-dce07f3b8819 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:46.053815 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2726c2b5-69d7-48ed-948c-dce07f3b8819 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:46.054696 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2726c2b5-69d7-48ed-948c-dce07f3b8819 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:46.055345 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2726c2b5-69d7-48ed-948c-dce07f3b8819 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:46.055955 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2726c2b5-69d7-48ed-948c-dce07f3b8819 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:46.071665 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-059e9a53-c974-405b-bd9c-b216fe0e4895 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44cc98e07d134a15b0fbf2b80bd25ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e0b0088d8476bbcb4c83783fec0e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:46.082803 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-059e9a53-c974-405b-bd9c-b216fe0e4895 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] 10.222.0.20 "GET /compute/v2.1/servers/d3abc28f-8361-4906-a085-1440991c298f" status: 200 len: 1318 microversion: 2.1 time: 0.481139 Oct 04 18:34:46.090348 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 928/1770] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:45 2022] GET /compute/v2.1/servers/d3abc28f-8361-4906-a085-1440991c298f => generated 1318 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:34:46.102989 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-46afbc45-38dd-425d-b9d6-af8d0f63af85 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:46.110165 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-46afbc45-38dd-425d-b9d6-af8d0f63af85 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: b219d988-2847-45a0-a3b8-af54cf1a43f8] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:46.123771 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-46afbc45-38dd-425d-b9d6-af8d0f63af85 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:46.124351 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-46afbc45-38dd-425d-b9d6-af8d0f63af85 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:46.124783 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-46afbc45-38dd-425d-b9d6-af8d0f63af85 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:46.125501 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-46afbc45-38dd-425d-b9d6-af8d0f63af85 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:46.126011 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-46afbc45-38dd-425d-b9d6-af8d0f63af85 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:46.126502 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-46afbc45-38dd-425d-b9d6-af8d0f63af85 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:46.167193 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-46afbc45-38dd-425d-b9d6-af8d0f63af85 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.072144 Oct 04 18:34:46.173660 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 929/1771] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Oct 4 18:34:46 2022] GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:34:46.293383 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-40bd4f8e-7277-43a0-8f50-e6960f3fe518 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:46.293843 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-40bd4f8e-7277-43a0-8f50-e6960f3fe518 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 158e9f52-fd16-48d1-87b5-e0dd523e97a4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:46.297535 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-2726c2b5-69d7-48ed-948c-dce07f3b8819 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:46.306369 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-40bd4f8e-7277-43a0-8f50-e6960f3fe518 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:46.308840 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-40bd4f8e-7277-43a0-8f50-e6960f3fe518 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:46.309321 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-40bd4f8e-7277-43a0-8f50-e6960f3fe518 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:46.310371 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-40bd4f8e-7277-43a0-8f50-e6960f3fe518 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:46.313705 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2726c2b5-69d7-48ed-948c-dce07f3b8819 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05" status: 200 len: 1477 microversion: 2.1 time: 0.273770 Oct 04 18:34:46.314419 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-40bd4f8e-7277-43a0-8f50-e6960f3fe518 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:46.314926 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-40bd4f8e-7277-43a0-8f50-e6960f3fe518 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:46.316965 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 843/1772] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:46 2022] GET /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05 => generated 1477 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:34:46.329931 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-234f01bb-0d33-443b-9ad1-f877d77c943d tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:46.336005 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-234f01bb-0d33-443b-9ad1-f877d77c943d tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:46.345698 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-234f01bb-0d33-443b-9ad1-f877d77c943d tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:46.348869 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-234f01bb-0d33-443b-9ad1-f877d77c943d tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:46.349574 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-234f01bb-0d33-443b-9ad1-f877d77c943d tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:46.356955 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-234f01bb-0d33-443b-9ad1-f877d77c943d tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:46.358459 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-234f01bb-0d33-443b-9ad1-f877d77c943d tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:46.358905 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-234f01bb-0d33-443b-9ad1-f877d77c943d tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:46.526094 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-234f01bb-0d33-443b-9ad1-f877d77c943d tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:46.548432 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-234f01bb-0d33-443b-9ad1-f877d77c943d tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:46.550616 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-234f01bb-0d33-443b-9ad1-f877d77c943d tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:46.562891 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-234f01bb-0d33-443b-9ad1-f877d77c943d tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1537 microversion: 2.91 time: 0.243421 Oct 04 18:34:46.563990 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 844/1773] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:46 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1537 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:46.586770 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c9967b72-b7cd-4c92-a75b-884ce49b5fe3 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '.version_select at 0x7fe258bf8af0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:46.664643 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-40bd4f8e-7277-43a0-8f50-e6960f3fe518 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:46.674224 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-40bd4f8e-7277-43a0-8f50-e6960f3fe518 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4" status: 200 len: 1719 microversion: 2.1 time: 0.392745 Oct 04 18:34:46.674968 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 930/1774] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:46 2022] GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4 => generated 1719 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:46.716931 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c9967b72-b7cd-4c92-a75b-884ce49b5fe3 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/images/e64eecee-1f9d-474a-9126-89110fbb7f85" status: 200 len: 1440 microversion: 2.1 time: 0.149523 Oct 04 18:34:46.732168 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 845/1775] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:34:46 2022] GET /compute/v2.1/images/e64eecee-1f9d-474a-9126-89110fbb7f85 => generated 1440 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:47.119454 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-691e18fd-aefa-49e6-9fa6-22c0e070486e tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:47.120338 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-691e18fd-aefa-49e6-9fa6-22c0e070486e tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] [instance: d3abc28f-8361-4906-a085-1440991c298f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:47.127383 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-691e18fd-aefa-49e6-9fa6-22c0e070486e tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:47.129748 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-691e18fd-aefa-49e6-9fa6-22c0e070486e tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:47.130448 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-691e18fd-aefa-49e6-9fa6-22c0e070486e tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:47.131594 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-691e18fd-aefa-49e6-9fa6-22c0e070486e tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:47.132299 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-691e18fd-aefa-49e6-9fa6-22c0e070486e tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:47.133803 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-691e18fd-aefa-49e6-9fa6-22c0e070486e tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:47.182925 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4462b52d-9a63-49d3-bfd6-04fb58ea9cfe tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:47.185877 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-4462b52d-9a63-49d3-bfd6-04fb58ea9cfe tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: b219d988-2847-45a0-a3b8-af54cf1a43f8] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:47.205343 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4462b52d-9a63-49d3-bfd6-04fb58ea9cfe tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:47.206867 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4462b52d-9a63-49d3-bfd6-04fb58ea9cfe tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:47.207820 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4462b52d-9a63-49d3-bfd6-04fb58ea9cfe tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:47.211610 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4462b52d-9a63-49d3-bfd6-04fb58ea9cfe tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:47.211610 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4462b52d-9a63-49d3-bfd6-04fb58ea9cfe tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:47.211610 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4462b52d-9a63-49d3-bfd6-04fb58ea9cfe tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:47.280500 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-4462b52d-9a63-49d3-bfd6-04fb58ea9cfe tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.103608 Oct 04 18:34:47.286298 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 846/1776] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Oct 4 18:34:47 2022] GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:34:47.323279 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-691e18fd-aefa-49e6-9fa6-22c0e070486e tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44cc98e07d134a15b0fbf2b80bd25ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e0b0088d8476bbcb4c83783fec0e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:47.349609 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-02009493-87aa-4477-a6ff-1302fd5c324a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:47.350229 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-02009493-87aa-4477-a6ff-1302fd5c324a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2fe6c508-f183-40bd-bfd5-23c757e99a05] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:47.357264 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-691e18fd-aefa-49e6-9fa6-22c0e070486e tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] 10.222.0.20 "GET /compute/v2.1/servers/d3abc28f-8361-4906-a085-1440991c298f" status: 200 len: 1507 microversion: 2.1 time: 0.248397 Oct 04 18:34:47.357857 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 931/1777] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:47 2022] GET /compute/v2.1/servers/d3abc28f-8361-4906-a085-1440991c298f => generated 1507 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:47.360703 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-02009493-87aa-4477-a6ff-1302fd5c324a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:47.361145 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-02009493-87aa-4477-a6ff-1302fd5c324a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:47.362859 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-02009493-87aa-4477-a6ff-1302fd5c324a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:47.376848 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-02009493-87aa-4477-a6ff-1302fd5c324a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:47.377472 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-02009493-87aa-4477-a6ff-1302fd5c324a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:47.378220 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-02009493-87aa-4477-a6ff-1302fd5c324a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:47.389387 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e669502c-bb5c-4a79-9d2b-60f9418cf64b tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:47.390744 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e669502c-bb5c-4a79-9d2b-60f9418cf64b tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] [instance: 859d2a18-b7eb-457b-a4e3-7d3b5fb80137] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:47.401742 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e669502c-bb5c-4a79-9d2b-60f9418cf64b tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:47.402240 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e669502c-bb5c-4a79-9d2b-60f9418cf64b tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:47.402680 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e669502c-bb5c-4a79-9d2b-60f9418cf64b tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:47.403854 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e669502c-bb5c-4a79-9d2b-60f9418cf64b tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:47.404340 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e669502c-bb5c-4a79-9d2b-60f9418cf64b tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:47.404765 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e669502c-bb5c-4a79-9d2b-60f9418cf64b tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:47.630913 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e669502c-bb5c-4a79-9d2b-60f9418cf64b tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44cc98e07d134a15b0fbf2b80bd25ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e0b0088d8476bbcb4c83783fec0e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:47.641657 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e669502c-bb5c-4a79-9d2b-60f9418cf64b tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] 10.222.0.20 "GET /compute/v2.1/servers/859d2a18-b7eb-457b-a4e3-7d3b5fb80137" status: 200 len: 1506 microversion: 2.1 time: 0.257812 Oct 04 18:34:47.642244 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 932/1778] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:47 2022] GET /compute/v2.1/servers/859d2a18-b7eb-457b-a4e3-7d3b5fb80137 => generated 1506 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:34:47.648986 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a37d2c82-67fc-41ef-adb8-d5b71d6015a7 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:47.654526 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a37d2c82-67fc-41ef-adb8-d5b71d6015a7 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:47.672144 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a37d2c82-67fc-41ef-adb8-d5b71d6015a7 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:47.673009 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a37d2c82-67fc-41ef-adb8-d5b71d6015a7 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:47.673674 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a37d2c82-67fc-41ef-adb8-d5b71d6015a7 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:47.674629 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a37d2c82-67fc-41ef-adb8-d5b71d6015a7 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:47.676158 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a37d2c82-67fc-41ef-adb8-d5b71d6015a7 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:47.676820 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a37d2c82-67fc-41ef-adb8-d5b71d6015a7 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:47.695718 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-02009493-87aa-4477-a6ff-1302fd5c324a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:47.700870 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-02009493-87aa-4477-a6ff-1302fd5c324a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05" status: 200 len: 1477 microversion: 2.1 time: 0.364620 Oct 04 18:34:47.703280 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 847/1779] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:47 2022] GET /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05 => generated 1477 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:47.708584 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a262eb97-8303-4955-9ff4-ca085e9f4318 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:47.709096 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a262eb97-8303-4955-9ff4-ca085e9f4318 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] [instance: 859d2a18-b7eb-457b-a4e3-7d3b5fb80137] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:47.727683 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a262eb97-8303-4955-9ff4-ca085e9f4318 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:47.728720 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a262eb97-8303-4955-9ff4-ca085e9f4318 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:47.731590 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a262eb97-8303-4955-9ff4-ca085e9f4318 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:47.735553 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a262eb97-8303-4955-9ff4-ca085e9f4318 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:47.736308 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a262eb97-8303-4955-9ff4-ca085e9f4318 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:47.736920 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a262eb97-8303-4955-9ff4-ca085e9f4318 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:47.781401 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a262eb97-8303-4955-9ff4-ca085e9f4318 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] [instance: 859d2a18-b7eb-457b-a4e3-7d3b5fb80137] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:34:47.801546 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a37d2c82-67fc-41ef-adb8-d5b71d6015a7 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:47.815597 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a37d2c82-67fc-41ef-adb8-d5b71d6015a7 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:47.817979 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a37d2c82-67fc-41ef-adb8-d5b71d6015a7 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:47.830270 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a37d2c82-67fc-41ef-adb8-d5b71d6015a7 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1537 microversion: 2.91 time: 0.185014 Oct 04 18:34:47.832102 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 933/1780] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:47 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1537 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:47.848007 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b2186e99-a3f4-41af-9c08-d0eb819e348e tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:47.849193 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b2186e99-a3f4-41af-9c08-d0eb819e348e tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 158e9f52-fd16-48d1-87b5-e0dd523e97a4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:47.857688 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b2186e99-a3f4-41af-9c08-d0eb819e348e tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:47.860917 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b2186e99-a3f4-41af-9c08-d0eb819e348e tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:47.861636 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b2186e99-a3f4-41af-9c08-d0eb819e348e tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:47.863227 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b2186e99-a3f4-41af-9c08-d0eb819e348e tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:47.864196 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b2186e99-a3f4-41af-9c08-d0eb819e348e tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:47.864614 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b2186e99-a3f4-41af-9c08-d0eb819e348e tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:48.106117 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b2186e99-a3f4-41af-9c08-d0eb819e348e tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:48.117845 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b2186e99-a3f4-41af-9c08-d0eb819e348e tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4" status: 200 len: 1719 microversion: 2.1 time: 0.282818 Oct 04 18:34:48.120333 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 934/1781] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:47 2022] GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4 => generated 1719 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:48.136244 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7f9e3988-9548-455d-a0f2-fc173d1fe8b5 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '.version_select at 0x7fe25971aaf0>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:48.207729 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7f9e3988-9548-455d-a0f2-fc173d1fe8b5 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/images/e64eecee-1f9d-474a-9126-89110fbb7f85" status: 200 len: 1440 microversion: 2.1 time: 0.086320 Oct 04 18:34:48.208571 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 935/1782] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:34:48 2022] GET /compute/v2.1/images/e64eecee-1f9d-474a-9126-89110fbb7f85 => generated 1440 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:48.210738 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a262eb97-8303-4955-9ff4-ca085e9f4318 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] 10.222.0.20 "DELETE /compute/v2.1/servers/859d2a18-b7eb-457b-a4e3-7d3b5fb80137" status: 204 len: 0 microversion: 2.1 time: 0.505929 Oct 04 18:34:48.215436 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 848/1783] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:34:47 2022] DELETE /compute/v2.1/servers/859d2a18-b7eb-457b-a4e3-7d3b5fb80137 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:34:48.230006 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-aca7cdb5-5ad2-499a-9fcf-be3a97beb855 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:48.230899 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-aca7cdb5-5ad2-499a-9fcf-be3a97beb855 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] [instance: d3abc28f-8361-4906-a085-1440991c298f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:48.242880 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aca7cdb5-5ad2-499a-9fcf-be3a97beb855 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:48.244193 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aca7cdb5-5ad2-499a-9fcf-be3a97beb855 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:48.244935 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aca7cdb5-5ad2-499a-9fcf-be3a97beb855 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:48.245932 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aca7cdb5-5ad2-499a-9fcf-be3a97beb855 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:48.246666 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aca7cdb5-5ad2-499a-9fcf-be3a97beb855 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:48.247323 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aca7cdb5-5ad2-499a-9fcf-be3a97beb855 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:48.297499 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b177d8fd-7cd1-42e0-90c9-f2532c26e188 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:48.303612 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b177d8fd-7cd1-42e0-90c9-f2532c26e188 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: b219d988-2847-45a0-a3b8-af54cf1a43f8] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:48.322305 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-aca7cdb5-5ad2-499a-9fcf-be3a97beb855 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] [instance: d3abc28f-8361-4906-a085-1440991c298f] Going to try to terminate instance {{(pid=123002) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:34:48.322741 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b177d8fd-7cd1-42e0-90c9-f2532c26e188 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:48.323458 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b177d8fd-7cd1-42e0-90c9-f2532c26e188 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:48.324155 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b177d8fd-7cd1-42e0-90c9-f2532c26e188 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:48.325119 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b177d8fd-7cd1-42e0-90c9-f2532c26e188 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:48.325787 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b177d8fd-7cd1-42e0-90c9-f2532c26e188 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:48.326426 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b177d8fd-7cd1-42e0-90c9-f2532c26e188 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:48.430977 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b177d8fd-7cd1-42e0-90c9-f2532c26e188 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.140386 Oct 04 18:34:48.431565 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 849/1784] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Oct 4 18:34:48 2022] GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8/os-volume_attachments => generated 197 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 18:34:48.551102 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-619129ae-395a-459b-b9ba-ea9418bbae1e req-573bdb15-8fc6-47b5-816c-d9819de7a4d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fa89d74-e5c4-461c-adcc-6c29ce9ad8db", "name": "network-vif-plugged", "status": "completed", "tag": "59347bf8-4a31-4a7c-ad79-7b1486886df8"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:48.579119 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-619129ae-395a-459b-b9ba-ea9418bbae1e req-573bdb15-8fc6-47b5-816c-d9819de7a4d5 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:48.580074 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-619129ae-395a-459b-b9ba-ea9418bbae1e req-573bdb15-8fc6-47b5-816c-d9819de7a4d5 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:48.581524 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-619129ae-395a-459b-b9ba-ea9418bbae1e req-573bdb15-8fc6-47b5-816c-d9819de7a4d5 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:48.605624 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-619129ae-395a-459b-b9ba-ea9418bbae1e req-573bdb15-8fc6-47b5-816c-d9819de7a4d5 service nova] Creating event network-vif-plugged:59347bf8-4a31-4a7c-ad79-7b1486886df8 for instance 0fa89d74-e5c4-461c-adcc-6c29ce9ad8db on n-h1-850501-14 Oct 04 18:34:48.614259 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-619129ae-395a-459b-b9ba-ea9418bbae1e req-573bdb15-8fc6-47b5-816c-d9819de7a4d5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074389 Oct 04 18:34:48.619937 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 850/1785] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:34:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:34:48.731806 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5f83cb46-9960-4b4b-a974-36e1df638836 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:48.733232 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5f83cb46-9960-4b4b-a974-36e1df638836 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2fe6c508-f183-40bd-bfd5-23c757e99a05] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:48.741468 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5f83cb46-9960-4b4b-a974-36e1df638836 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:48.747439 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5f83cb46-9960-4b4b-a974-36e1df638836 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:48.747439 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5f83cb46-9960-4b4b-a974-36e1df638836 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:48.747439 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5f83cb46-9960-4b4b-a974-36e1df638836 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:48.747439 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5f83cb46-9960-4b4b-a974-36e1df638836 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:48.747439 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5f83cb46-9960-4b4b-a974-36e1df638836 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:48.810312 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-aca7cdb5-5ad2-499a-9fcf-be3a97beb855 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d3abc28f-8361-4906-a085-1440991c298f" status: 204 len: 0 microversion: 2.1 time: 0.590100 Oct 04 18:34:48.811341 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 936/1786] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:34:48 2022] DELETE /compute/v2.1/servers/d3abc28f-8361-4906-a085-1440991c298f => generated 0 bytes in 593 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:34:48.820833 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0b6197e9-d497-4368-81d2-974004f02be4 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:48.821816 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0b6197e9-d497-4368-81d2-974004f02be4 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] [instance: 859d2a18-b7eb-457b-a4e3-7d3b5fb80137] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:48.837213 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0b6197e9-d497-4368-81d2-974004f02be4 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:48.838208 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0b6197e9-d497-4368-81d2-974004f02be4 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:48.838817 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0b6197e9-d497-4368-81d2-974004f02be4 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:48.839533 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0b6197e9-d497-4368-81d2-974004f02be4 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:48.839989 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0b6197e9-d497-4368-81d2-974004f02be4 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:48.843648 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0b6197e9-d497-4368-81d2-974004f02be4 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:49.023590 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5f83cb46-9960-4b4b-a974-36e1df638836 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:49.031926 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5f83cb46-9960-4b4b-a974-36e1df638836 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05" status: 200 len: 1477 microversion: 2.1 time: 0.304552 Oct 04 18:34:49.039483 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 851/1787] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:48 2022] GET /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05 => generated 1477 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:34:49.056563 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e5f5d3db-1a23-44c9-b7b3-a32e9c9203e7 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:49.058215 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e5f5d3db-1a23-44c9-b7b3-a32e9c9203e7 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:49.069872 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e5f5d3db-1a23-44c9-b7b3-a32e9c9203e7 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:49.070749 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e5f5d3db-1a23-44c9-b7b3-a32e9c9203e7 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:49.071577 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e5f5d3db-1a23-44c9-b7b3-a32e9c9203e7 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:49.072596 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e5f5d3db-1a23-44c9-b7b3-a32e9c9203e7 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:49.073285 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e5f5d3db-1a23-44c9-b7b3-a32e9c9203e7 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:49.073940 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e5f5d3db-1a23-44c9-b7b3-a32e9c9203e7 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:49.167722 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0b6197e9-d497-4368-81d2-974004f02be4 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44cc98e07d134a15b0fbf2b80bd25ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e0b0088d8476bbcb4c83783fec0e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:49.185678 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0b6197e9-d497-4368-81d2-974004f02be4 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] 10.222.0.20 "GET /compute/v2.1/servers/859d2a18-b7eb-457b-a4e3-7d3b5fb80137" status: 200 len: 1512 microversion: 2.1 time: 0.369755 Oct 04 18:34:49.186270 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 937/1788] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:48 2022] GET /compute/v2.1/servers/859d2a18-b7eb-457b-a4e3-7d3b5fb80137 => generated 1512 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:34:49.194997 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-318401cb-6ab7-4e6c-a1bd-76e19458476c tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:49.195906 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-318401cb-6ab7-4e6c-a1bd-76e19458476c tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 158e9f52-fd16-48d1-87b5-e0dd523e97a4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:49.203638 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-318401cb-6ab7-4e6c-a1bd-76e19458476c tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:49.205253 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-318401cb-6ab7-4e6c-a1bd-76e19458476c tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:49.206443 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-318401cb-6ab7-4e6c-a1bd-76e19458476c tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:49.209393 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-318401cb-6ab7-4e6c-a1bd-76e19458476c tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:49.209870 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-318401cb-6ab7-4e6c-a1bd-76e19458476c tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:49.210303 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-318401cb-6ab7-4e6c-a1bd-76e19458476c tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:49.232567 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e5f5d3db-1a23-44c9-b7b3-a32e9c9203e7 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:49.257358 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e5f5d3db-1a23-44c9-b7b3-a32e9c9203e7 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:49.268615 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e5f5d3db-1a23-44c9-b7b3-a32e9c9203e7 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:49.302138 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e5f5d3db-1a23-44c9-b7b3-a32e9c9203e7 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1537 microversion: 2.91 time: 0.260989 Oct 04 18:34:49.304279 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 852/1789] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:49 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1537 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:49.349273 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-af94cd5c-8413-4c81-85f8-b291133be781 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '.version_select at 0x7fe258c6cdc0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:49.458752 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-af94cd5c-8413-4c81-85f8-b291133be781 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/images/e64eecee-1f9d-474a-9126-89110fbb7f85" status: 200 len: 1440 microversion: 2.1 time: 0.152800 Oct 04 18:34:49.460366 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 853/1790] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:34:49 2022] GET /compute/v2.1/images/e64eecee-1f9d-474a-9126-89110fbb7f85 => generated 1440 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:49.481816 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-269a40a3-3b5f-42c0-b219-18db95fe5ace tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:49.498700 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-269a40a3-3b5f-42c0-b219-18db95fe5ace tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: b219d988-2847-45a0-a3b8-af54cf1a43f8] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:49.524503 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-269a40a3-3b5f-42c0-b219-18db95fe5ace tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:49.525522 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-269a40a3-3b5f-42c0-b219-18db95fe5ace tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:49.526985 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-269a40a3-3b5f-42c0-b219-18db95fe5ace tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:49.532270 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-269a40a3-3b5f-42c0-b219-18db95fe5ace tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:49.533417 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-269a40a3-3b5f-42c0-b219-18db95fe5ace tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:49.537080 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-269a40a3-3b5f-42c0-b219-18db95fe5ace tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:49.613528 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-318401cb-6ab7-4e6c-a1bd-76e19458476c tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:49.628147 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:49.636709 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-318401cb-6ab7-4e6c-a1bd-76e19458476c tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4" status: 200 len: 1719 microversion: 2.1 time: 0.448434 Oct 04 18:34:49.639421 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 938/1791] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:49 2022] GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4 => generated 1719 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:49.663474 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-269a40a3-3b5f-42c0-b219-18db95fe5ace tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.200248 Oct 04 18:34:49.668548 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 854/1792] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Oct 4 18:34:49 2022] GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8/os-volume_attachments => generated 197 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:34:50.046043 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b0155ce3-3a10-4977-bb8d-4365d028a378 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1008228703", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": [{"uuid": "5c4757cc-c771-4b67-8bc3-b9a74c5bf184"}]}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:50.070425 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-28ac754e-5296-407d-8873-fa9a67c56ec3 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:50.071986 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-28ac754e-5296-407d-8873-fa9a67c56ec3 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2fe6c508-f183-40bd-bfd5-23c757e99a05] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:50.091614 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-28ac754e-5296-407d-8873-fa9a67c56ec3 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:50.092507 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-28ac754e-5296-407d-8873-fa9a67c56ec3 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:50.093661 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-28ac754e-5296-407d-8873-fa9a67c56ec3 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:50.099061 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-28ac754e-5296-407d-8873-fa9a67c56ec3 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:50.101090 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-28ac754e-5296-407d-8873-fa9a67c56ec3 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:50.101807 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-28ac754e-5296-407d-8873-fa9a67c56ec3 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:50.201494 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-b0155ce3-3a10-4977-bb8d-4365d028a378 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] validate_networks() for [('5c4757cc-c771-4b67-8bc3-b9a74c5bf184', None, None, None, None, None)] {{(pid=123002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:34:50.630667 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-28ac754e-5296-407d-8873-fa9a67c56ec3 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:50.642484 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-28ac754e-5296-407d-8873-fa9a67c56ec3 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05" status: 200 len: 1477 microversion: 2.1 time: 0.584151 Oct 04 18:34:50.664636 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 855/1793] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:50 2022] GET /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05 => generated 1477 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:50.673263 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f240fc9b-8e1b-4775-94e1-d3d5686ea144 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:50.673895 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f240fc9b-8e1b-4775-94e1-d3d5686ea144 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] [instance: 859d2a18-b7eb-457b-a4e3-7d3b5fb80137] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:50.683903 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f240fc9b-8e1b-4775-94e1-d3d5686ea144 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:50.685500 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f240fc9b-8e1b-4775-94e1-d3d5686ea144 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:50.686730 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f240fc9b-8e1b-4775-94e1-d3d5686ea144 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:50.687713 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f240fc9b-8e1b-4775-94e1-d3d5686ea144 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:50.688275 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f240fc9b-8e1b-4775-94e1-d3d5686ea144 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:50.688787 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f240fc9b-8e1b-4775-94e1-d3d5686ea144 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:50.968751 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-b0155ce3-3a10-4977-bb8d-4365d028a378 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:34:50.970099 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-b0155ce3-3a10-4977-bb8d-4365d028a378 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:34:50.970849 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-b0155ce3-3a10-4977-bb8d-4365d028a378 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:34:50.971830 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-b0155ce3-3a10-4977-bb8d-4365d028a378 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:34:50.972393 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-b0155ce3-3a10-4977-bb8d-4365d028a378 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:34:50.990779 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b0155ce3-3a10-4977-bb8d-4365d028a378 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:50.991662 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b0155ce3-3a10-4977-bb8d-4365d028a378 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:50.992269 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b0155ce3-3a10-4977-bb8d-4365d028a378 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:50.993150 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b0155ce3-3a10-4977-bb8d-4365d028a378 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:50.993884 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b0155ce3-3a10-4977-bb8d-4365d028a378 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:50.994583 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b0155ce3-3a10-4977-bb8d-4365d028a378 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:51.023199 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-b0155ce3-3a10-4977-bb8d-4365d028a378 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Getting quotas for project d4650d613cb84018b92dc5d51486885e. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:34:51.029831 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-b0155ce3-3a10-4977-bb8d-4365d028a378 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Getting quotas for user 6a81e50834114f0fa3cca4b0b9f8acf1 and project d4650d613cb84018b92dc5d51486885e. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:34:51.048484 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b0155ce3-3a10-4977-bb8d-4365d028a378 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Going to run 1 instances... {{(pid=123002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:34:51.055242 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b0155ce3-3a10-4977-bb8d-4365d028a378 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] [instance: c3a29732-fa0a-4dfd-8475-0f43e9bb0846] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:34:51.115529 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:51.193815 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b0155ce3-3a10-4977-bb8d-4365d028a378 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.419703 Oct 04 18:34:51.195354 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 939/1794] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:34:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1422 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:34:51.201388 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-355499ec-38e0-48d1-8057-81d03e9d2d68 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:51.202366 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-355499ec-38e0-48d1-8057-81d03e9d2d68 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:51.213706 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f240fc9b-8e1b-4775-94e1-d3d5686ea144 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44cc98e07d134a15b0fbf2b80bd25ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e0b0088d8476bbcb4c83783fec0e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:51.215650 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-355499ec-38e0-48d1-8057-81d03e9d2d68 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:51.216721 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-355499ec-38e0-48d1-8057-81d03e9d2d68 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:51.219664 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-355499ec-38e0-48d1-8057-81d03e9d2d68 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:51.230655 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-355499ec-38e0-48d1-8057-81d03e9d2d68 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:51.235199 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-355499ec-38e0-48d1-8057-81d03e9d2d68 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:51.238936 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-355499ec-38e0-48d1-8057-81d03e9d2d68 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:51.249194 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f240fc9b-8e1b-4775-94e1-d3d5686ea144 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] 10.222.0.20 "GET /compute/v2.1/servers/859d2a18-b7eb-457b-a4e3-7d3b5fb80137" status: 200 len: 1512 microversion: 2.1 time: 0.578889 Oct 04 18:34:51.280125 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 856/1795] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:50 2022] GET /compute/v2.1/servers/859d2a18-b7eb-457b-a4e3-7d3b5fb80137 => generated 1512 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:51.280125 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-389a5bcc-e969-4d07-beed-4e5427c82bdc tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '.version_select at 0x7fe258bf8e50>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:51.371539 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-389a5bcc-e969-4d07-beed-4e5427c82bdc tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/images/e64eecee-1f9d-474a-9126-89110fbb7f85" status: 200 len: 1440 microversion: 2.1 time: 0.095869 Oct 04 18:34:51.371923 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 857/1796] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:34:51 2022] GET /compute/v2.1/images/e64eecee-1f9d-474a-9126-89110fbb7f85 => generated 1440 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:51.390880 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-563e03b1-2dc7-4be1-9f63-7d8e80018115 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:51.395473 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-563e03b1-2dc7-4be1-9f63-7d8e80018115 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 158e9f52-fd16-48d1-87b5-e0dd523e97a4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:51.421868 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-563e03b1-2dc7-4be1-9f63-7d8e80018115 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:51.422377 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-563e03b1-2dc7-4be1-9f63-7d8e80018115 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:51.422823 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-563e03b1-2dc7-4be1-9f63-7d8e80018115 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:51.436294 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-563e03b1-2dc7-4be1-9f63-7d8e80018115 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:51.437245 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-563e03b1-2dc7-4be1-9f63-7d8e80018115 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:51.438789 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-563e03b1-2dc7-4be1-9f63-7d8e80018115 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:51.604202 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-355499ec-38e0-48d1-8057-81d03e9d2d68 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:51.617923 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-355499ec-38e0-48d1-8057-81d03e9d2d68 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:51.626350 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-355499ec-38e0-48d1-8057-81d03e9d2d68 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:51.646239 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-355499ec-38e0-48d1-8057-81d03e9d2d68 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1537 microversion: 2.91 time: 0.449445 Oct 04 18:34:51.649303 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 940/1797] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:51 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1537 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:51.664339 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4cc845e7-ff1d-48ff-a203-68977342df1f tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:51.670472 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4cc845e7-ff1d-48ff-a203-68977342df1f tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: b219d988-2847-45a0-a3b8-af54cf1a43f8] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:51.687119 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4cc845e7-ff1d-48ff-a203-68977342df1f tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:51.691895 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4cc845e7-ff1d-48ff-a203-68977342df1f tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:51.692463 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4cc845e7-ff1d-48ff-a203-68977342df1f tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:51.693214 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4cc845e7-ff1d-48ff-a203-68977342df1f tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:51.693682 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4cc845e7-ff1d-48ff-a203-68977342df1f tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:51.694104 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4cc845e7-ff1d-48ff-a203-68977342df1f tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:51.796328 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4cc845e7-ff1d-48ff-a203-68977342df1f tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.145766 Oct 04 18:34:51.802353 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 941/1798] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Oct 4 18:34:51 2022] GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8/os-volume_attachments => generated 197 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:34:51.807882 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9e8a24be-86f2-4ca1-8f2e-1c38ab69ed9e tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1552126410", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": [{"uuid": "5c4757cc-c771-4b67-8bc3-b9a74c5bf184"}]}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:51.903333 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-9e8a24be-86f2-4ca1-8f2e-1c38ab69ed9e tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] validate_networks() for [('5c4757cc-c771-4b67-8bc3-b9a74c5bf184', None, None, None, None, None)] {{(pid=123002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:34:52.980145 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-563e03b1-2dc7-4be1-9f63-7d8e80018115 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:52.992205 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-563e03b1-2dc7-4be1-9f63-7d8e80018115 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4" status: 200 len: 1719 microversion: 2.1 time: 1.618870 Oct 04 18:34:52.997776 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 858/1799] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:51 2022] GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4 => generated 1719 bytes in 1625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:53.017586 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d5651cf8-1064-4ca4-b663-70525bae83a8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:53.017586 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d5651cf8-1064-4ca4-b663-70525bae83a8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2fe6c508-f183-40bd-bfd5-23c757e99a05] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:53.039479 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d5651cf8-1064-4ca4-b663-70525bae83a8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:53.044394 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d5651cf8-1064-4ca4-b663-70525bae83a8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:53.044394 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d5651cf8-1064-4ca4-b663-70525bae83a8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:53.044394 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d5651cf8-1064-4ca4-b663-70525bae83a8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:53.059907 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d5651cf8-1064-4ca4-b663-70525bae83a8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:53.062270 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d5651cf8-1064-4ca4-b663-70525bae83a8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:53.073552 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:54.015102 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-9e8a24be-86f2-4ca1-8f2e-1c38ab69ed9e tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:34:54.015102 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-9e8a24be-86f2-4ca1-8f2e-1c38ab69ed9e tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:34:54.015102 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-9e8a24be-86f2-4ca1-8f2e-1c38ab69ed9e tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:34:54.015102 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-9e8a24be-86f2-4ca1-8f2e-1c38ab69ed9e tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:34:54.015102 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-9e8a24be-86f2-4ca1-8f2e-1c38ab69ed9e tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:34:54.042431 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9e8a24be-86f2-4ca1-8f2e-1c38ab69ed9e tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:54.043563 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9e8a24be-86f2-4ca1-8f2e-1c38ab69ed9e tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:54.044208 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9e8a24be-86f2-4ca1-8f2e-1c38ab69ed9e tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:54.045201 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9e8a24be-86f2-4ca1-8f2e-1c38ab69ed9e tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:54.045824 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9e8a24be-86f2-4ca1-8f2e-1c38ab69ed9e tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:54.046566 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9e8a24be-86f2-4ca1-8f2e-1c38ab69ed9e tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:54.095525 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d5651cf8-1064-4ca4-b663-70525bae83a8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:54.108257 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-9e8a24be-86f2-4ca1-8f2e-1c38ab69ed9e tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Getting quotas for project d4650d613cb84018b92dc5d51486885e. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:34:54.111560 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d5651cf8-1064-4ca4-b663-70525bae83a8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05" status: 200 len: 1477 microversion: 2.1 time: 1.112340 Oct 04 18:34:54.128644 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 859/1800] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:52 2022] GET /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05 => generated 1477 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:54.128644 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-60875bb9-f143-4c18-90c5-8724fd8a0663 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:54.129817 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-60875bb9-f143-4c18-90c5-8724fd8a0663 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] [instance: 859d2a18-b7eb-457b-a4e3-7d3b5fb80137] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:54.141590 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-9e8a24be-86f2-4ca1-8f2e-1c38ab69ed9e tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Getting quotas for user 6a81e50834114f0fa3cca4b0b9f8acf1 and project d4650d613cb84018b92dc5d51486885e. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:34:54.151066 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-60875bb9-f143-4c18-90c5-8724fd8a0663 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:54.152696 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-60875bb9-f143-4c18-90c5-8724fd8a0663 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:54.153329 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-60875bb9-f143-4c18-90c5-8724fd8a0663 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:54.154315 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-60875bb9-f143-4c18-90c5-8724fd8a0663 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:54.154952 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-60875bb9-f143-4c18-90c5-8724fd8a0663 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:54.158671 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-60875bb9-f143-4c18-90c5-8724fd8a0663 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:54.159785 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9e8a24be-86f2-4ca1-8f2e-1c38ab69ed9e tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Going to run 1 instances... {{(pid=123002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:34:54.162590 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9e8a24be-86f2-4ca1-8f2e-1c38ab69ed9e tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] [instance: b4d49cb2-f2a4-481b-bdb4-bcdad0649bd2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:34:54.244484 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-60875bb9-f143-4c18-90c5-8724fd8a0663 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:54.245493 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-60875bb9-f143-4c18-90c5-8724fd8a0663 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:54.247419 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-60875bb9-f143-4c18-90c5-8724fd8a0663 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:54.248093 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-60875bb9-f143-4c18-90c5-8724fd8a0663 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lazy-loading 'fault' on Instance uuid 859d2a18-b7eb-457b-a4e3-7d3b5fb80137 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:34:54.350554 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9e8a24be-86f2-4ca1-8f2e-1c38ab69ed9e tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.539933 Oct 04 18:34:54.352044 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 942/1801] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:34:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 2549 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:34:54.384023 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-bcf181d0-8526-4d77-86aa-d8ec0b77b30b tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '.version_select at 0x7fe259467430>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:54.447038 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-60875bb9-f143-4c18-90c5-8724fd8a0663 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44cc98e07d134a15b0fbf2b80bd25ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e0b0088d8476bbcb4c83783fec0e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:54.472585 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-60875bb9-f143-4c18-90c5-8724fd8a0663 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] 10.222.0.20 "GET /compute/v2.1/servers/859d2a18-b7eb-457b-a4e3-7d3b5fb80137" status: 200 len: 1308 microversion: 2.1 time: 0.357944 Oct 04 18:34:54.479669 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 860/1802] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:54 2022] GET /compute/v2.1/servers/859d2a18-b7eb-457b-a4e3-7d3b5fb80137 => generated 1308 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:54.508909 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-55019336-b675-4a80-83dc-1bde55aa4f19 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:54.513165 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-55019336-b675-4a80-83dc-1bde55aa4f19 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:54.528149 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-55019336-b675-4a80-83dc-1bde55aa4f19 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:54.528934 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-55019336-b675-4a80-83dc-1bde55aa4f19 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:54.551435 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-55019336-b675-4a80-83dc-1bde55aa4f19 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:54.556721 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-55019336-b675-4a80-83dc-1bde55aa4f19 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:54.557378 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-55019336-b675-4a80-83dc-1bde55aa4f19 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:54.557835 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-55019336-b675-4a80-83dc-1bde55aa4f19 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:54.558176 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-bcf181d0-8526-4d77-86aa-d8ec0b77b30b tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/images/e64eecee-1f9d-474a-9126-89110fbb7f85" status: 200 len: 1440 microversion: 2.1 time: 0.198443 Oct 04 18:34:54.558772 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 943/1803] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:34:54 2022] GET /compute/v2.1/images/e64eecee-1f9d-474a-9126-89110fbb7f85 => generated 1440 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:54.597793 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-bfbf0b8d-c15a-41d9-b163-d0eba81d5abc tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:54.600067 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-bfbf0b8d-c15a-41d9-b163-d0eba81d5abc tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: b219d988-2847-45a0-a3b8-af54cf1a43f8] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:54.635800 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bfbf0b8d-c15a-41d9-b163-d0eba81d5abc tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:54.645252 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bfbf0b8d-c15a-41d9-b163-d0eba81d5abc tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:54.645905 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bfbf0b8d-c15a-41d9-b163-d0eba81d5abc tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:54.646680 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bfbf0b8d-c15a-41d9-b163-d0eba81d5abc tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:54.647158 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bfbf0b8d-c15a-41d9-b163-d0eba81d5abc tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:54.647589 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bfbf0b8d-c15a-41d9-b163-d0eba81d5abc tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:54.757533 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-bfbf0b8d-c15a-41d9-b163-d0eba81d5abc tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.197665 Oct 04 18:34:54.758132 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 944/1804] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Oct 4 18:34:54 2022] GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8/os-volume_attachments => generated 197 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:34:54.771581 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-be849982-0c30-4be9-91ad-d765fef146d4 req-1c6dc666-fe00-44ac-970b-6247a502e715 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "859d2a18-b7eb-457b-a4e3-7d3b5fb80137", "name": "network-vif-deleted", "tag": "605c1b20-b6e3-41bd-9506-756a56c042bd"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:54.782825 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-55019336-b675-4a80-83dc-1bde55aa4f19 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:54.796776 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-55019336-b675-4a80-83dc-1bde55aa4f19 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:54.798371 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-55019336-b675-4a80-83dc-1bde55aa4f19 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:54.806445 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-55019336-b675-4a80-83dc-1bde55aa4f19 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1537 microversion: 2.91 time: 0.323121 Oct 04 18:34:54.807803 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 861/1805] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:54 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1537 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:54.814400 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-128f93f5-b070-4c8b-990f-6686bf853e12 req-3b5dc90a-704c-4142-9e2b-303207c831d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3abc28f-8361-4906-a085-1440991c298f", "name": "network-vif-deleted", "tag": "82ad6043-0772-4416-b7ca-f387aa238059"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:54.825754 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-be849982-0c30-4be9-91ad-d765fef146d4 req-1c6dc666-fe00-44ac-970b-6247a502e715 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:54.826250 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-be849982-0c30-4be9-91ad-d765fef146d4 req-1c6dc666-fe00-44ac-970b-6247a502e715 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:54.839863 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-be849982-0c30-4be9-91ad-d765fef146d4 req-1c6dc666-fe00-44ac-970b-6247a502e715 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:54.851727 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-128f93f5-b070-4c8b-990f-6686bf853e12 req-3b5dc90a-704c-4142-9e2b-303207c831d5 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:54.854404 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-128f93f5-b070-4c8b-990f-6686bf853e12 req-3b5dc90a-704c-4142-9e2b-303207c831d5 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:54.855926 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-128f93f5-b070-4c8b-990f-6686bf853e12 req-3b5dc90a-704c-4142-9e2b-303207c831d5 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:54.880572 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-be849982-0c30-4be9-91ad-d765fef146d4 req-1c6dc666-fe00-44ac-970b-6247a502e715 service nova] Creating event network-vif-deleted:605c1b20-b6e3-41bd-9506-756a56c042bd for instance 859d2a18-b7eb-457b-a4e3-7d3b5fb80137 on n-h2-850501-14 Oct 04 18:34:54.911418 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-128f93f5-b070-4c8b-990f-6686bf853e12 req-3b5dc90a-704c-4142-9e2b-303207c831d5 service nova] Creating event network-vif-deleted:82ad6043-0772-4416-b7ca-f387aa238059 for instance d3abc28f-8361-4906-a085-1440991c298f on n-h2-850501-14 Oct 04 18:34:54.915899 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-be849982-0c30-4be9-91ad-d765fef146d4 req-1c6dc666-fe00-44ac-970b-6247a502e715 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149035 Oct 04 18:34:54.916887 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 945/1806] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:34:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:34:54.931181 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4b6e570c-8709-40da-81a1-8d4829303c10 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:54.932653 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4b6e570c-8709-40da-81a1-8d4829303c10 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 158e9f52-fd16-48d1-87b5-e0dd523e97a4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:54.934963 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-128f93f5-b070-4c8b-990f-6686bf853e12 req-3b5dc90a-704c-4142-9e2b-303207c831d5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125438 Oct 04 18:34:54.947439 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 862/1807] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:34:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:34:54.951520 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4b6e570c-8709-40da-81a1-8d4829303c10 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:54.952845 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4b6e570c-8709-40da-81a1-8d4829303c10 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:54.954011 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4b6e570c-8709-40da-81a1-8d4829303c10 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:54.958374 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4b6e570c-8709-40da-81a1-8d4829303c10 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:54.959105 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4b6e570c-8709-40da-81a1-8d4829303c10 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:54.959710 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4b6e570c-8709-40da-81a1-8d4829303c10 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:54.972347 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-05b9757c-957a-4655-b22e-7288d53e537b tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-2120055384", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "451", "networks": [{"uuid": "5c4757cc-c771-4b67-8bc3-b9a74c5bf184"}]}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:55.010061 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:55.100365 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.neutron [None req-05b9757c-957a-4655-b22e-7288d53e537b tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] validate_networks() for [('5c4757cc-c771-4b67-8bc3-b9a74c5bf184', None, None, None, None, None)] {{(pid=123001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:34:55.606052 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4b6e570c-8709-40da-81a1-8d4829303c10 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:55.680620 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4b6e570c-8709-40da-81a1-8d4829303c10 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4" status: 200 len: 1719 microversion: 2.1 time: 0.754768 Oct 04 18:34:55.681491 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 946/1808] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:54 2022] GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4 => generated 1719 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:55.701088 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f2c900be-7299-4346-ad3a-f35f7c2ce33c tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:55.702441 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f2c900be-7299-4346-ad3a-f35f7c2ce33c tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2fe6c508-f183-40bd-bfd5-23c757e99a05] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:55.728471 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f2c900be-7299-4346-ad3a-f35f7c2ce33c tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:55.728976 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f2c900be-7299-4346-ad3a-f35f7c2ce33c tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:55.729422 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f2c900be-7299-4346-ad3a-f35f7c2ce33c tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:55.730137 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f2c900be-7299-4346-ad3a-f35f7c2ce33c tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:55.730604 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f2c900be-7299-4346-ad3a-f35f7c2ce33c tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:55.731039 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f2c900be-7299-4346-ad3a-f35f7c2ce33c tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:56.176856 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f2c900be-7299-4346-ad3a-f35f7c2ce33c tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:56.192728 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f2c900be-7299-4346-ad3a-f35f7c2ce33c tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05" status: 200 len: 1477 microversion: 2.1 time: 0.510065 Oct 04 18:34:56.196922 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 947/1809] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:55 2022] GET /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05 => generated 1477 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:56.207758 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-74964060-fd3e-4edf-be5c-2054a05557d8 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:56.224824 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-74964060-fd3e-4edf-be5c-2054a05557d8 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] [instance: 859d2a18-b7eb-457b-a4e3-7d3b5fb80137] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:56.229558 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-74964060-fd3e-4edf-be5c-2054a05557d8 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:56.230317 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-74964060-fd3e-4edf-be5c-2054a05557d8 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:56.231049 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-74964060-fd3e-4edf-be5c-2054a05557d8 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:56.232763 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-74964060-fd3e-4edf-be5c-2054a05557d8 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:56.233706 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-74964060-fd3e-4edf-be5c-2054a05557d8 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:56.234321 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-74964060-fd3e-4edf-be5c-2054a05557d8 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:56.285886 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-74964060-fd3e-4edf-be5c-2054a05557d8 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] HTTP exception thrown: Instance 859d2a18-b7eb-457b-a4e3-7d3b5fb80137 could not be found. Oct 04 18:34:56.287322 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-74964060-fd3e-4edf-be5c-2054a05557d8 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Request method failure captured: Oct 04 18:34:56.287322 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/859d2a18-b7eb-457b-a4e3-7d3b5fb80137 HTTP/1.1 Oct 04 18:34:56.287322 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:34:56.287322 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:34:56.287322 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:34:56.287322 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:34:56.287322 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:34:56.287322 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:34:56.287322 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:34:56.287322 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:34:56.287322 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPHx_zKNt-YFfAzYLzGIcI4LEWNOEtxBOAI38ISKsz8-ehUNXHeIP0lM2r9zdrar9MloPO1Wx3O4MPviJtmubrA7C3F5QQuWvRzQ43IObIRQqJPAbZoZ1TZ4B6o-giha3jSSzRSRvqZusElpA_LUK6XUppWx4nGrRmkbTxUqd6i3AM-k Oct 04 18:34:56.287322 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:34:56.287322 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:34:56.287322 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:34:56.287322 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:34:56.287322 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:34:56.287322 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:34:56.287322 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 320e0b0088d8476bbcb4c83783fec0e6 Oct 04 18:34:56.287322 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-MultipleCreateTestJSON-2005185779 Oct 04 18:34:56.287322 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:34:56.287322 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:34:56.287322 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/320e0b0088d8476bbcb4c83783fec0e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_320e0b0088d8476bbcb4c83783fec0e6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/320e0b0088d8476bbcb4c83783fec0e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/320e0b0088d8476bbcb4c83783fec0e6"}]}] Oct 04 18:34:56.287322 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-MultipleCreateTestJSON-2005185779 Oct 04 18:34:56.287322 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 320e0b0088d8476bbcb4c83783fec0e6 Oct 04 18:34:56.287322 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-MultipleCreateTestJSON-2005185779 Oct 04 18:34:56.287322 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-MultipleCreateTestJSON-2005185779-project Oct 04 18:34:56.287322 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:34:56.287322 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:34:56.287322 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 44cc98e07d134a15b0fbf2b80bd25ef7 Oct 04 18:34:56.287322 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-MultipleCreateTestJSON-2005185779-project Oct 04 18:34:56.287322 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:34:56.287322 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 859d2a18-b7eb-457b-a4e3-7d3b5fb80137 could not be found. Oct 04 18:34:56.287322 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '859d2a18-b7eb-457b-a4e3-7d3b5fb80137'} Oct 04 18:34:56.287322 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:34:56.287322 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:56.287322 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:34:56.287322 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:34:56.287322 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:34:56.287322 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:34:56.287322 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:34:56.287322 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:34:56.287322 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:34:56.287322 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:34:56.287322 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 859d2a18-b7eb-457b-a4e3-7d3b5fb80137 could not be found. Oct 04 18:34:56.287322 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:34:56.287322 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:56.287322 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:34:56.287322 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:56.287322 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:56.287322 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:56.287322 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:34:56.287322 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:34:56.287322 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:34:56.287322 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:34:56.287322 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:34:56.287322 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:34:56.287322 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:34:56.287322 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:34:56.287322 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:34:56.287322 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:34:56.287322 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 859d2a18-b7eb-457b-a4e3-7d3b5fb80137 could not be found. Oct 04 18:34:56.287322 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:34:56.287322 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:56.287322 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:34:56.293832 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:56.293832 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:56.293832 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:56.293832 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:34:56.293832 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:34:56.293832 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 859d2a18-b7eb-457b-a4e3-7d3b5fb80137 could not be found. Oct 04 18:34:56.293832 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:34:56.293832 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-74964060-fd3e-4edf-be5c-2054a05557d8 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Returning 404 to user: Instance 859d2a18-b7eb-457b-a4e3-7d3b5fb80137 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:34:56.297082 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-74964060-fd3e-4edf-be5c-2054a05557d8 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] 10.222.0.20 "GET /compute/v2.1/servers/859d2a18-b7eb-457b-a4e3-7d3b5fb80137" status: 404 len: 111 microversion: 2.1 time: 0.097140 Oct 04 18:34:56.297676 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 948/1810] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:56 2022] GET /compute/v2.1/servers/859d2a18-b7eb-457b-a4e3-7d3b5fb80137 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:34:56.305934 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a346185b-63d1-422b-be2c-9d975d561719 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '.version_select at 0x7fe25958b670>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:56.453018 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-05b9757c-957a-4655-b22e-7288d53e537b tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:34:56.453514 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-05b9757c-957a-4655-b22e-7288d53e537b tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:34:56.454011 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-05b9757c-957a-4655-b22e-7288d53e537b tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:34:56.454417 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-05b9757c-957a-4655-b22e-7288d53e537b tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:34:56.454867 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-05b9757c-957a-4655-b22e-7288d53e537b tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:34:56.461085 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a346185b-63d1-422b-be2c-9d975d561719 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/images/e64eecee-1f9d-474a-9126-89110fbb7f85" status: 200 len: 1440 microversion: 2.1 time: 0.162072 Oct 04 18:34:56.461674 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 949/1811] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:34:56 2022] GET /compute/v2.1/images/e64eecee-1f9d-474a-9126-89110fbb7f85 => generated 1440 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:56.475783 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-47a7d28c-c1f0-40fc-9db2-49ec1a0306a6 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:56.482433 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-05b9757c-957a-4655-b22e-7288d53e537b tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:56.486413 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-05b9757c-957a-4655-b22e-7288d53e537b tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:56.488343 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-05b9757c-957a-4655-b22e-7288d53e537b tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:56.490699 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-05b9757c-957a-4655-b22e-7288d53e537b tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:56.490884 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-47a7d28c-c1f0-40fc-9db2-49ec1a0306a6 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: b219d988-2847-45a0-a3b8-af54cf1a43f8] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:56.493185 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-05b9757c-957a-4655-b22e-7288d53e537b tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:56.493912 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-05b9757c-957a-4655-b22e-7288d53e537b tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:56.508097 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-47a7d28c-c1f0-40fc-9db2-49ec1a0306a6 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:56.508606 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-47a7d28c-c1f0-40fc-9db2-49ec1a0306a6 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:56.509051 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-47a7d28c-c1f0-40fc-9db2-49ec1a0306a6 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:56.509769 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-47a7d28c-c1f0-40fc-9db2-49ec1a0306a6 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:56.510235 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-47a7d28c-c1f0-40fc-9db2-49ec1a0306a6 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:56.510663 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-47a7d28c-c1f0-40fc-9db2-49ec1a0306a6 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:56.543063 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-05b9757c-957a-4655-b22e-7288d53e537b tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Getting quotas for project d4650d613cb84018b92dc5d51486885e. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:34:56.555966 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-05b9757c-957a-4655-b22e-7288d53e537b tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Getting quotas for user 6a81e50834114f0fa3cca4b0b9f8acf1 and project d4650d613cb84018b92dc5d51486885e. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:34:56.576375 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-47a7d28c-c1f0-40fc-9db2-49ec1a0306a6 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.113580 Oct 04 18:34:56.582410 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 950/1812] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Oct 4 18:34:56 2022] GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:34:56.587788 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-67b8ac32-5b99-451d-b078-48599e13ec74 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:56.588713 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-67b8ac32-5b99-451d-b078-48599e13ec74 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:56.589358 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-05b9757c-957a-4655-b22e-7288d53e537b tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Going to run 1 instances... {{(pid=123001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:34:56.595497 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-67b8ac32-5b99-451d-b078-48599e13ec74 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:56.595902 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-05b9757c-957a-4655-b22e-7288d53e537b tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] [instance: adc33804-eb64-40ca-a943-f2e74040c1b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:34:56.597180 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-67b8ac32-5b99-451d-b078-48599e13ec74 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:56.597927 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-67b8ac32-5b99-451d-b078-48599e13ec74 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:56.598967 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-67b8ac32-5b99-451d-b078-48599e13ec74 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:56.599599 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-67b8ac32-5b99-451d-b078-48599e13ec74 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:56.600228 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-67b8ac32-5b99-451d-b078-48599e13ec74 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:56.754170 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-67b8ac32-5b99-451d-b078-48599e13ec74 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:56.770265 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-67b8ac32-5b99-451d-b078-48599e13ec74 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:56.771765 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-67b8ac32-5b99-451d-b078-48599e13ec74 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:56.786600 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-67b8ac32-5b99-451d-b078-48599e13ec74 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1537 microversion: 2.91 time: 0.202631 Oct 04 18:34:56.787218 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 951/1813] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:56 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1537 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:56.817385 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-825b6406-a638-4a12-a893-b563b3b3f42e tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:56.818026 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-825b6406-a638-4a12-a893-b563b3b3f42e tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] [instance: d3abc28f-8361-4906-a085-1440991c298f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:56.832697 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-825b6406-a638-4a12-a893-b563b3b3f42e tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:56.840791 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-825b6406-a638-4a12-a893-b563b3b3f42e tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:56.841958 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-825b6406-a638-4a12-a893-b563b3b3f42e tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:56.845049 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-825b6406-a638-4a12-a893-b563b3b3f42e tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:56.848886 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-825b6406-a638-4a12-a893-b563b3b3f42e tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:56.851489 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-825b6406-a638-4a12-a893-b563b3b3f42e tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:56.916078 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-05b9757c-957a-4655-b22e-7288d53e537b tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.968385 Oct 04 18:34:56.932560 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 863/1814] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:34:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1983 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:34:56.943618 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-25ac2ede-09eb-42f6-a242-fd17a6ff9086 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:56.958407 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-25ac2ede-09eb-42f6-a242-fd17a6ff9086 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 158e9f52-fd16-48d1-87b5-e0dd523e97a4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:56.981462 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-25ac2ede-09eb-42f6-a242-fd17a6ff9086 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:56.988675 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-825b6406-a638-4a12-a893-b563b3b3f42e tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:56.989113 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-25ac2ede-09eb-42f6-a242-fd17a6ff9086 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:56.989267 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-825b6406-a638-4a12-a893-b563b3b3f42e tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:56.990055 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-25ac2ede-09eb-42f6-a242-fd17a6ff9086 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:56.992264 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-25ac2ede-09eb-42f6-a242-fd17a6ff9086 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:56.993021 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-25ac2ede-09eb-42f6-a242-fd17a6ff9086 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:56.995563 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-25ac2ede-09eb-42f6-a242-fd17a6ff9086 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:56.995929 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-825b6406-a638-4a12-a893-b563b3b3f42e tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:56.997218 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-825b6406-a638-4a12-a893-b563b3b3f42e tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lazy-loading 'fault' on Instance uuid d3abc28f-8361-4906-a085-1440991c298f {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:34:57.125466 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-825b6406-a638-4a12-a893-b563b3b3f42e tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44cc98e07d134a15b0fbf2b80bd25ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e0b0088d8476bbcb4c83783fec0e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:57.138618 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-825b6406-a638-4a12-a893-b563b3b3f42e tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] 10.222.0.20 "GET /compute/v2.1/servers/d3abc28f-8361-4906-a085-1440991c298f" status: 200 len: 1308 microversion: 2.1 time: 0.342450 Oct 04 18:34:57.163103 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 952/1815] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:56 2022] GET /compute/v2.1/servers/d3abc28f-8361-4906-a085-1440991c298f => generated 1308 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:57.201078 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-35f3c575-a0c5-404a-8775-be1913d20108 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:57.208850 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-35f3c575-a0c5-404a-8775-be1913d20108 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] [instance: adc33804-eb64-40ca-a943-f2e74040c1b2] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:57.422362 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-35f3c575-a0c5-404a-8775-be1913d20108 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81e50834114f0fa3cca4b0b9f8acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4650d613cb84018b92dc5d51486885e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:57.443430 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-35f3c575-a0c5-404a-8775-be1913d20108 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] 10.222.0.20 "GET /compute/v2.1/servers/adc33804-eb64-40ca-a943-f2e74040c1b2" status: 200 len: 1221 microversion: 2.1 time: 0.271140 Oct 04 18:34:57.443430 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 953/1816] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:57 2022] GET /compute/v2.1/servers/adc33804-eb64-40ca-a943-f2e74040c1b2 => generated 1221 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:57.452278 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-66bf67fd-b854-43bd-9008-a2e9e546019a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:57.453013 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-66bf67fd-b854-43bd-9008-a2e9e546019a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2fe6c508-f183-40bd-bfd5-23c757e99a05] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:57.485185 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-66bf67fd-b854-43bd-9008-a2e9e546019a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:57.488679 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-66bf67fd-b854-43bd-9008-a2e9e546019a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:57.494888 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-66bf67fd-b854-43bd-9008-a2e9e546019a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:57.494888 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-66bf67fd-b854-43bd-9008-a2e9e546019a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:57.494888 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-66bf67fd-b854-43bd-9008-a2e9e546019a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:57.494888 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-66bf67fd-b854-43bd-9008-a2e9e546019a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:57.644567 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-25ac2ede-09eb-42f6-a242-fd17a6ff9086 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:57.655072 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-25ac2ede-09eb-42f6-a242-fd17a6ff9086 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4" status: 200 len: 1719 microversion: 2.1 time: 0.722800 Oct 04 18:34:57.659470 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 864/1817] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:56 2022] GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4 => generated 1719 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:57.664564 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c6bc8267-3159-4116-8e93-4ce7c3c3d5e9 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '.version_select at 0x7fe258d20c10>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:57.816497 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c6bc8267-3159-4116-8e93-4ce7c3c3d5e9 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/images/e64eecee-1f9d-474a-9126-89110fbb7f85" status: 200 len: 1440 microversion: 2.1 time: 0.155537 Oct 04 18:34:57.820822 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 865/1818] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:34:57 2022] GET /compute/v2.1/images/e64eecee-1f9d-474a-9126-89110fbb7f85 => generated 1440 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:57.839729 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-eef0c322-fd3b-490a-9836-174f0c10794b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:57.848453 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-eef0c322-fd3b-490a-9836-174f0c10794b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: b219d988-2847-45a0-a3b8-af54cf1a43f8] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:57.869114 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eef0c322-fd3b-490a-9836-174f0c10794b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:57.874233 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eef0c322-fd3b-490a-9836-174f0c10794b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:57.876831 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eef0c322-fd3b-490a-9836-174f0c10794b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:57.879011 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eef0c322-fd3b-490a-9836-174f0c10794b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:57.884241 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eef0c322-fd3b-490a-9836-174f0c10794b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:57.884700 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eef0c322-fd3b-490a-9836-174f0c10794b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:57.938477 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-66bf67fd-b854-43bd-9008-a2e9e546019a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:57.949649 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-66bf67fd-b854-43bd-9008-a2e9e546019a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05" status: 200 len: 1477 microversion: 2.1 time: 0.504170 Oct 04 18:34:57.971837 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 954/1819] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:57 2022] GET /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05 => generated 1477 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:57.983754 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d67183fe-1cc5-4f2e-9a43-412b20d2614b tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:57.984771 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d67183fe-1cc5-4f2e-9a43-412b20d2614b tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:57.994241 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-eef0c322-fd3b-490a-9836-174f0c10794b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.172284 Oct 04 18:34:57.997754 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d67183fe-1cc5-4f2e-9a43-412b20d2614b tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:57.998585 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 866/1820] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Oct 4 18:34:57 2022] GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8/os-volume_attachments => generated 197 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:34:57.999317 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d67183fe-1cc5-4f2e-9a43-412b20d2614b tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:57.999913 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d67183fe-1cc5-4f2e-9a43-412b20d2614b tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:58.000831 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d67183fe-1cc5-4f2e-9a43-412b20d2614b tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:58.001872 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d67183fe-1cc5-4f2e-9a43-412b20d2614b tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:58.003097 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d67183fe-1cc5-4f2e-9a43-412b20d2614b tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:58.083342 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d67183fe-1cc5-4f2e-9a43-412b20d2614b tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:58.092389 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d67183fe-1cc5-4f2e-9a43-412b20d2614b tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:58.094447 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d67183fe-1cc5-4f2e-9a43-412b20d2614b tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:58.109708 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d67183fe-1cc5-4f2e-9a43-412b20d2614b tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1537 microversion: 2.91 time: 0.136116 Oct 04 18:34:58.114138 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 955/1821] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:57 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1537 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:58.177262 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a2a08f11-83e0-490c-b0ab-80d4b75dc270 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:58.177887 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a2a08f11-83e0-490c-b0ab-80d4b75dc270 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] [instance: d3abc28f-8361-4906-a085-1440991c298f] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:58.190132 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a2a08f11-83e0-490c-b0ab-80d4b75dc270 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:58.190927 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a2a08f11-83e0-490c-b0ab-80d4b75dc270 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:58.191545 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a2a08f11-83e0-490c-b0ab-80d4b75dc270 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:58.193103 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a2a08f11-83e0-490c-b0ab-80d4b75dc270 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:58.193735 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a2a08f11-83e0-490c-b0ab-80d4b75dc270 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:58.195039 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a2a08f11-83e0-490c-b0ab-80d4b75dc270 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:58.211031 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-a2a08f11-83e0-490c-b0ab-80d4b75dc270 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] HTTP exception thrown: Instance d3abc28f-8361-4906-a085-1440991c298f could not be found. Oct 04 18:34:58.213850 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a2a08f11-83e0-490c-b0ab-80d4b75dc270 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Request method failure captured: Oct 04 18:34:58.213850 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/d3abc28f-8361-4906-a085-1440991c298f HTTP/1.1 Oct 04 18:34:58.213850 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:34:58.213850 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:34:58.213850 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:34:58.213850 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:34:58.213850 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:34:58.213850 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:34:58.213850 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:34:58.213850 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:34:58.213850 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPHx_zKNt-YFfAzYLzGIcI4LEWNOEtxBOAI38ISKsz8-ehUNXHeIP0lM2r9zdrar9MloPO1Wx3O4MPviJtmubrA7C3F5QQuWvRzQ43IObIRQqJPAbZoZ1TZ4B6o-giha3jSSzRSRvqZusElpA_LUK6XUppWx4nGrRmkbTxUqd6i3AM-k Oct 04 18:34:58.213850 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:34:58.213850 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:34:58.213850 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:34:58.213850 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:34:58.213850 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:34:58.213850 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:34:58.213850 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 320e0b0088d8476bbcb4c83783fec0e6 Oct 04 18:34:58.213850 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-MultipleCreateTestJSON-2005185779 Oct 04 18:34:58.213850 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:34:58.213850 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:34:58.213850 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/320e0b0088d8476bbcb4c83783fec0e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_320e0b0088d8476bbcb4c83783fec0e6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/320e0b0088d8476bbcb4c83783fec0e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/320e0b0088d8476bbcb4c83783fec0e6"}]}] Oct 04 18:34:58.213850 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-MultipleCreateTestJSON-2005185779 Oct 04 18:34:58.213850 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 320e0b0088d8476bbcb4c83783fec0e6 Oct 04 18:34:58.213850 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-MultipleCreateTestJSON-2005185779 Oct 04 18:34:58.213850 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-MultipleCreateTestJSON-2005185779-project Oct 04 18:34:58.213850 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:34:58.213850 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:34:58.213850 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 44cc98e07d134a15b0fbf2b80bd25ef7 Oct 04 18:34:58.213850 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-MultipleCreateTestJSON-2005185779-project Oct 04 18:34:58.213850 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:34:58.213850 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance d3abc28f-8361-4906-a085-1440991c298f could not be found. Oct 04 18:34:58.213850 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': 'd3abc28f-8361-4906-a085-1440991c298f'} Oct 04 18:34:58.213850 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:34:58.213850 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:58.213850 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:34:58.213850 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:34:58.213850 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:34:58.213850 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:34:58.213850 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:34:58.213850 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:34:58.213850 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:34:58.213850 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:34:58.213850 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3abc28f-8361-4906-a085-1440991c298f could not be found. Oct 04 18:34:58.213850 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:34:58.213850 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:58.213850 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:34:58.213850 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:58.213850 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:58.213850 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:58.213850 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:34:58.213850 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:34:58.213850 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:34:58.213850 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:34:58.213850 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:34:58.213850 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:34:58.213850 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:34:58.213850 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:34:58.213850 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:34:58.213850 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:34:58.213850 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3abc28f-8361-4906-a085-1440991c298f could not be found. Oct 04 18:34:58.213850 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:34:58.213850 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:58.213850 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:34:58.218500 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:58.218500 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:58.218500 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:58.218500 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:34:58.218500 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:34:58.218500 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3abc28f-8361-4906-a085-1440991c298f could not be found. Oct 04 18:34:58.218500 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:34:58.220590 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a2a08f11-83e0-490c-b0ab-80d4b75dc270 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] Returning 404 to user: Instance d3abc28f-8361-4906-a085-1440991c298f could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:34:58.222234 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a2a08f11-83e0-490c-b0ab-80d4b75dc270 tempest-MultipleCreateTestJSON-2005185779 tempest-MultipleCreateTestJSON-2005185779-project] 10.222.0.20 "GET /compute/v2.1/servers/d3abc28f-8361-4906-a085-1440991c298f" status: 404 len: 111 microversion: 2.1 time: 0.049844 Oct 04 18:34:58.223317 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 867/1822] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:58 2022] GET /compute/v2.1/servers/d3abc28f-8361-4906-a085-1440991c298f => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:34:58.475584 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a783ca2f-489e-4a9b-9930-d56468f40c12 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:58.476360 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a783ca2f-489e-4a9b-9930-d56468f40c12 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] [instance: adc33804-eb64-40ca-a943-f2e74040c1b2] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:58.498525 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a783ca2f-489e-4a9b-9930-d56468f40c12 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:58.500737 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a783ca2f-489e-4a9b-9930-d56468f40c12 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:58.506658 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a783ca2f-489e-4a9b-9930-d56468f40c12 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:58.507264 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a783ca2f-489e-4a9b-9930-d56468f40c12 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:58.510366 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a783ca2f-489e-4a9b-9930-d56468f40c12 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:58.510989 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a783ca2f-489e-4a9b-9930-d56468f40c12 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:58.688924 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ca9b6b43-4e7d-411f-9ef5-6a67ecab944f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:58.690443 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ca9b6b43-4e7d-411f-9ef5-6a67ecab944f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 158e9f52-fd16-48d1-87b5-e0dd523e97a4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:58.705476 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ca9b6b43-4e7d-411f-9ef5-6a67ecab944f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:58.720949 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ca9b6b43-4e7d-411f-9ef5-6a67ecab944f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:58.722474 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ca9b6b43-4e7d-411f-9ef5-6a67ecab944f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:58.723453 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ca9b6b43-4e7d-411f-9ef5-6a67ecab944f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:58.724980 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ca9b6b43-4e7d-411f-9ef5-6a67ecab944f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:58.726180 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ca9b6b43-4e7d-411f-9ef5-6a67ecab944f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:58.740607 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a783ca2f-489e-4a9b-9930-d56468f40c12 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81e50834114f0fa3cca4b0b9f8acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4650d613cb84018b92dc5d51486885e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:58.751053 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a783ca2f-489e-4a9b-9930-d56468f40c12 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] 10.222.0.20 "GET /compute/v2.1/servers/adc33804-eb64-40ca-a943-f2e74040c1b2" status: 200 len: 1225 microversion: 2.1 time: 0.285792 Oct 04 18:34:58.781459 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 956/1823] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:58 2022] GET /compute/v2.1/servers/adc33804-eb64-40ca-a943-f2e74040c1b2 => generated 1225 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:58.834153 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-230c4f5f-fa56-465a-bdb8-5f17ab9b7098 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '.version_select at 0x7fe2594449d0>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:58.923285 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-230c4f5f-fa56-465a-bdb8-5f17ab9b7098 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/images/e64eecee-1f9d-474a-9126-89110fbb7f85" status: 200 len: 1440 microversion: 2.1 time: 0.094597 Oct 04 18:34:58.927148 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 957/1824] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:34:58 2022] GET /compute/v2.1/images/e64eecee-1f9d-474a-9126-89110fbb7f85 => generated 1440 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:58.979789 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-56f21db8-b465-4267-a22c-ed8d532ebf09 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:58.981392 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-56f21db8-b465-4267-a22c-ed8d532ebf09 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2fe6c508-f183-40bd-bfd5-23c757e99a05] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:59.000490 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-56f21db8-b465-4267-a22c-ed8d532ebf09 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:59.004020 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-56f21db8-b465-4267-a22c-ed8d532ebf09 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:59.009314 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-56f21db8-b465-4267-a22c-ed8d532ebf09 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:59.010735 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-56f21db8-b465-4267-a22c-ed8d532ebf09 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:59.013317 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-56f21db8-b465-4267-a22c-ed8d532ebf09 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:59.013779 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-56f21db8-b465-4267-a22c-ed8d532ebf09 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:59.179455 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ca9b6b43-4e7d-411f-9ef5-6a67ecab944f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:59.192441 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ca9b6b43-4e7d-411f-9ef5-6a67ecab944f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4" status: 200 len: 1719 microversion: 2.1 time: 0.508453 Oct 04 18:34:59.199639 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 868/1825] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:58 2022] GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4 => generated 1719 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:59.208008 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b5c16257-e978-4628-b15e-b6a3ec80dd9e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:59.216598 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b5c16257-e978-4628-b15e-b6a3ec80dd9e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: b219d988-2847-45a0-a3b8-af54cf1a43f8] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:59.233131 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b5c16257-e978-4628-b15e-b6a3ec80dd9e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:59.236102 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b5c16257-e978-4628-b15e-b6a3ec80dd9e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:59.237581 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b5c16257-e978-4628-b15e-b6a3ec80dd9e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:59.240649 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b5c16257-e978-4628-b15e-b6a3ec80dd9e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:59.241740 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b5c16257-e978-4628-b15e-b6a3ec80dd9e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:59.242437 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b5c16257-e978-4628-b15e-b6a3ec80dd9e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:59.328541 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b5c16257-e978-4628-b15e-b6a3ec80dd9e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.124691 Oct 04 18:34:59.331293 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 869/1826] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Oct 4 18:34:59 2022] GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:34:59.344820 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0905cf3e-7114-4479-ab3a-ec2622132264 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:59.346097 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0905cf3e-7114-4479-ab3a-ec2622132264 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:59.362538 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0905cf3e-7114-4479-ab3a-ec2622132264 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:59.364375 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0905cf3e-7114-4479-ab3a-ec2622132264 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:59.365965 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0905cf3e-7114-4479-ab3a-ec2622132264 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:59.368741 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0905cf3e-7114-4479-ab3a-ec2622132264 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:59.369464 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0905cf3e-7114-4479-ab3a-ec2622132264 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:59.371893 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0905cf3e-7114-4479-ab3a-ec2622132264 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:59.529437 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-56f21db8-b465-4267-a22c-ed8d532ebf09 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:59.543338 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-56f21db8-b465-4267-a22c-ed8d532ebf09 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05" status: 200 len: 1477 microversion: 2.1 time: 0.568346 Oct 04 18:34:59.545450 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 958/1827] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:58 2022] GET /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05 => generated 1477 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:59.767226 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0905cf3e-7114-4479-ab3a-ec2622132264 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:59.777361 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0905cf3e-7114-4479-ab3a-ec2622132264 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:59.789071 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0905cf3e-7114-4479-ab3a-ec2622132264 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:59.795304 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d3086d5f-85a6-4b36-b565-a9ca910199b8 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:59.795564 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0905cf3e-7114-4479-ab3a-ec2622132264 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1537 microversion: 2.91 time: 0.462550 Oct 04 18:34:59.796111 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 870/1828] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:34:59 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1537 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:34:59.797029 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d3086d5f-85a6-4b36-b565-a9ca910199b8 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] [instance: adc33804-eb64-40ca-a943-f2e74040c1b2] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:59.813600 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d3086d5f-85a6-4b36-b565-a9ca910199b8 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:59.817111 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d3086d5f-85a6-4b36-b565-a9ca910199b8 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:59.822669 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d3086d5f-85a6-4b36-b565-a9ca910199b8 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:59.823756 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d3086d5f-85a6-4b36-b565-a9ca910199b8 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:59.826910 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d3086d5f-85a6-4b36-b565-a9ca910199b8 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:59.828094 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d3086d5f-85a6-4b36-b565-a9ca910199b8 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:59.944135 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c5744e51-cbda-4e3b-9835-7eb60f107d93 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '.version_select at 0x7fe258ca13a0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:00.030326 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c5744e51-cbda-4e3b-9835-7eb60f107d93 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/images/e64eecee-1f9d-474a-9126-89110fbb7f85" status: 200 len: 1440 microversion: 2.1 time: 0.091103 Oct 04 18:35:00.030776 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 871/1829] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:34:59 2022] GET /compute/v2.1/images/e64eecee-1f9d-474a-9126-89110fbb7f85 => generated 1440 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:00.063208 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d3086d5f-85a6-4b36-b565-a9ca910199b8 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81e50834114f0fa3cca4b0b9f8acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4650d613cb84018b92dc5d51486885e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:00.071840 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d3086d5f-85a6-4b36-b565-a9ca910199b8 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] 10.222.0.20 "GET /compute/v2.1/servers/adc33804-eb64-40ca-a943-f2e74040c1b2" status: 200 len: 1217 microversion: 2.1 time: 0.283024 Oct 04 18:35:00.082518 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 959/1830] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:59 2022] GET /compute/v2.1/servers/adc33804-eb64-40ca-a943-f2e74040c1b2 => generated 1217 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:00.232427 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-de1ff490-68a0-4495-8475-1c2f82726a3d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:00.233548 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-de1ff490-68a0-4495-8475-1c2f82726a3d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 158e9f52-fd16-48d1-87b5-e0dd523e97a4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:00.248498 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-de1ff490-68a0-4495-8475-1c2f82726a3d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:00.250363 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-de1ff490-68a0-4495-8475-1c2f82726a3d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:00.251023 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-de1ff490-68a0-4495-8475-1c2f82726a3d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:00.256758 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-de1ff490-68a0-4495-8475-1c2f82726a3d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:00.257604 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-de1ff490-68a0-4495-8475-1c2f82726a3d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:00.258930 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-de1ff490-68a0-4495-8475-1c2f82726a3d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:00.342546 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9fc6a5a1-fa1d-4fa2-aece-91b465c85a93 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:00.345640 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9fc6a5a1-fa1d-4fa2-aece-91b465c85a93 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: b219d988-2847-45a0-a3b8-af54cf1a43f8] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:00.366163 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9fc6a5a1-fa1d-4fa2-aece-91b465c85a93 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:00.368016 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9fc6a5a1-fa1d-4fa2-aece-91b465c85a93 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:00.369153 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9fc6a5a1-fa1d-4fa2-aece-91b465c85a93 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:00.370550 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9fc6a5a1-fa1d-4fa2-aece-91b465c85a93 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:00.371570 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9fc6a5a1-fa1d-4fa2-aece-91b465c85a93 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:00.373418 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9fc6a5a1-fa1d-4fa2-aece-91b465c85a93 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:00.491118 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9fc6a5a1-fa1d-4fa2-aece-91b465c85a93 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.143137 Oct 04 18:35:00.499957 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 960/1831] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Oct 4 18:35:00 2022] GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8/os-volume_attachments => generated 197 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 18:35:00.566887 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d96da932-b985-4f10-bca5-967da9c219fb tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:00.567681 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d96da932-b985-4f10-bca5-967da9c219fb tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2fe6c508-f183-40bd-bfd5-23c757e99a05] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:00.575734 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d96da932-b985-4f10-bca5-967da9c219fb tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:00.579973 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d96da932-b985-4f10-bca5-967da9c219fb tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:00.581131 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d96da932-b985-4f10-bca5-967da9c219fb tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:00.583126 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d96da932-b985-4f10-bca5-967da9c219fb tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:00.588138 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d96da932-b985-4f10-bca5-967da9c219fb tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:00.593836 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d96da932-b985-4f10-bca5-967da9c219fb tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:01.498450 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d96da932-b985-4f10-bca5-967da9c219fb tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:01.506296 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=100 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:01.511948 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d96da932-b985-4f10-bca5-967da9c219fb tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05" status: 200 len: 1477 microversion: 2.1 time: 0.949013 Oct 04 18:35:01.512584 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 961/1832] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:00 2022] GET /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05 => generated 1477 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:01.537074 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f1ebeea0-c8e8-46f2-af10-e04963cba750 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:01.539796 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f1ebeea0-c8e8-46f2-af10-e04963cba750 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:01.556974 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f1ebeea0-c8e8-46f2-af10-e04963cba750 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:01.559247 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f1ebeea0-c8e8-46f2-af10-e04963cba750 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:01.559708 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f1ebeea0-c8e8-46f2-af10-e04963cba750 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:01.560760 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f1ebeea0-c8e8-46f2-af10-e04963cba750 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:01.563873 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f1ebeea0-c8e8-46f2-af10-e04963cba750 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:01.565529 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f1ebeea0-c8e8-46f2-af10-e04963cba750 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:01.647027 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-de1ff490-68a0-4495-8475-1c2f82726a3d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:01.679123 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-de1ff490-68a0-4495-8475-1c2f82726a3d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4" status: 200 len: 1719 microversion: 2.1 time: 1.455027 Oct 04 18:35:01.679877 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 872/1833] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:00 2022] GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4 => generated 1719 bytes in 1457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:01.697639 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-66ef97df-03ed-429f-9081-ce4ea0a1c520 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '.version_select at 0x7fe258c2d5e0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:01.777380 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f1ebeea0-c8e8-46f2-af10-e04963cba750 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:01.797034 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f1ebeea0-c8e8-46f2-af10-e04963cba750 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:01.798998 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f1ebeea0-c8e8-46f2-af10-e04963cba750 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:01.801283 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-66ef97df-03ed-429f-9081-ce4ea0a1c520 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/images/e64eecee-1f9d-474a-9126-89110fbb7f85" status: 200 len: 1440 microversion: 2.1 time: 0.119806 Oct 04 18:35:01.802370 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 873/1834] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:35:01 2022] GET /compute/v2.1/images/e64eecee-1f9d-474a-9126-89110fbb7f85 => generated 1440 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:01.823283 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-dbab2bf9-db3d-4add-9c09-d21b317d2b00 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:01.824127 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-dbab2bf9-db3d-4add-9c09-d21b317d2b00 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] [instance: adc33804-eb64-40ca-a943-f2e74040c1b2] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:01.833673 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f1ebeea0-c8e8-46f2-af10-e04963cba750 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1558 microversion: 2.91 time: 0.306128 Oct 04 18:35:01.834303 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 962/1835] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:01 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1558 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:01.837846 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dbab2bf9-db3d-4add-9c09-d21b317d2b00 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:01.838474 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dbab2bf9-db3d-4add-9c09-d21b317d2b00 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:01.839013 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dbab2bf9-db3d-4add-9c09-d21b317d2b00 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:01.839818 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dbab2bf9-db3d-4add-9c09-d21b317d2b00 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:01.843613 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dbab2bf9-db3d-4add-9c09-d21b317d2b00 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:01.844489 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dbab2bf9-db3d-4add-9c09-d21b317d2b00 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:01.845353 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f4ac63c2-320e-4d8b-b9c1-2fa06fe824b7 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:01.854966 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f4ac63c2-320e-4d8b-b9c1-2fa06fe824b7 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: b219d988-2847-45a0-a3b8-af54cf1a43f8] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:01.864019 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f4ac63c2-320e-4d8b-b9c1-2fa06fe824b7 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:01.864767 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f4ac63c2-320e-4d8b-b9c1-2fa06fe824b7 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:01.865404 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f4ac63c2-320e-4d8b-b9c1-2fa06fe824b7 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:01.866317 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f4ac63c2-320e-4d8b-b9c1-2fa06fe824b7 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:01.870990 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f4ac63c2-320e-4d8b-b9c1-2fa06fe824b7 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:01.871735 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f4ac63c2-320e-4d8b-b9c1-2fa06fe824b7 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:01.922119 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f4ac63c2-320e-4d8b-b9c1-2fa06fe824b7 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.085702 Oct 04 18:35:01.932459 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 963/1836] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Oct 4 18:35:01 2022] GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:35:02.079328 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-dbab2bf9-db3d-4add-9c09-d21b317d2b00 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81e50834114f0fa3cca4b0b9f8acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4650d613cb84018b92dc5d51486885e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:02.120256 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-dbab2bf9-db3d-4add-9c09-d21b317d2b00 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] 10.222.0.20 "GET /compute/v2.1/servers/adc33804-eb64-40ca-a943-f2e74040c1b2" status: 200 len: 1281 microversion: 2.1 time: 0.316519 Oct 04 18:35:02.127781 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 874/1837] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:01 2022] GET /compute/v2.1/servers/adc33804-eb64-40ca-a943-f2e74040c1b2 => generated 1281 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:02.548633 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-59f7b547-5846-48bf-b1fa-12f8ca73bc04 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:02.549857 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-59f7b547-5846-48bf-b1fa-12f8ca73bc04 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2fe6c508-f183-40bd-bfd5-23c757e99a05] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:02.573848 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-59f7b547-5846-48bf-b1fa-12f8ca73bc04 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:02.574337 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-59f7b547-5846-48bf-b1fa-12f8ca73bc04 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:02.574796 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-59f7b547-5846-48bf-b1fa-12f8ca73bc04 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:02.575670 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-59f7b547-5846-48bf-b1fa-12f8ca73bc04 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:02.576190 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-59f7b547-5846-48bf-b1fa-12f8ca73bc04 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:02.576625 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-59f7b547-5846-48bf-b1fa-12f8ca73bc04 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:02.706269 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c5e20186-306f-4a7e-8f7f-b06f668ff575 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:02.706879 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c5e20186-306f-4a7e-8f7f-b06f668ff575 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 158e9f52-fd16-48d1-87b5-e0dd523e97a4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:02.720831 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c5e20186-306f-4a7e-8f7f-b06f668ff575 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:02.722213 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c5e20186-306f-4a7e-8f7f-b06f668ff575 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:02.723059 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c5e20186-306f-4a7e-8f7f-b06f668ff575 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:02.723965 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c5e20186-306f-4a7e-8f7f-b06f668ff575 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:02.724617 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c5e20186-306f-4a7e-8f7f-b06f668ff575 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:02.725234 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c5e20186-306f-4a7e-8f7f-b06f668ff575 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:02.950606 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-59f7b547-5846-48bf-b1fa-12f8ca73bc04 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:02.963963 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-59f7b547-5846-48bf-b1fa-12f8ca73bc04 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05" status: 200 len: 1477 microversion: 2.1 time: 0.421616 Oct 04 18:35:02.965257 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 964/1838] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:02 2022] GET /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05 => generated 1477 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:02.975177 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f45e3e45-5cdd-4d8d-9305-0216b2ab0216 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '.version_select at 0x7fe259536a60>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:03.062828 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f45e3e45-5cdd-4d8d-9305-0216b2ab0216 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/images/e64eecee-1f9d-474a-9126-89110fbb7f85" status: 200 len: 1440 microversion: 2.1 time: 0.096217 Oct 04 18:35:03.069886 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 965/1839] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:35:02 2022] GET /compute/v2.1/images/e64eecee-1f9d-474a-9126-89110fbb7f85 => generated 1440 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:03.095021 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a4d0ecf8-26ef-4001-91a5-1443c65de316 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:03.096144 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a4d0ecf8-26ef-4001-91a5-1443c65de316 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:03.114083 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a4d0ecf8-26ef-4001-91a5-1443c65de316 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:03.116269 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a4d0ecf8-26ef-4001-91a5-1443c65de316 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:03.122337 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a4d0ecf8-26ef-4001-91a5-1443c65de316 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:03.122337 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a4d0ecf8-26ef-4001-91a5-1443c65de316 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:03.122337 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a4d0ecf8-26ef-4001-91a5-1443c65de316 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:03.122337 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a4d0ecf8-26ef-4001-91a5-1443c65de316 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:03.292531 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a4d0ecf8-26ef-4001-91a5-1443c65de316 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:03.313735 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a4d0ecf8-26ef-4001-91a5-1443c65de316 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:03.317919 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a4d0ecf8-26ef-4001-91a5-1443c65de316 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:03.339909 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a4d0ecf8-26ef-4001-91a5-1443c65de316 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1558 microversion: 2.91 time: 0.268690 Oct 04 18:35:03.340569 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 966/1840] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:03 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1558 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:03.371599 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5f176fd2-8809-43cd-994b-0100be9304e2 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:03.374090 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5f176fd2-8809-43cd-994b-0100be9304e2 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: b219d988-2847-45a0-a3b8-af54cf1a43f8] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:03.424392 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c5e20186-306f-4a7e-8f7f-b06f668ff575 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:03.434473 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c5e20186-306f-4a7e-8f7f-b06f668ff575 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4" status: 200 len: 1719 microversion: 2.1 time: 0.732211 Oct 04 18:35:03.437265 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5f176fd2-8809-43cd-994b-0100be9304e2 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:03.437772 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5f176fd2-8809-43cd-994b-0100be9304e2 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:03.438217 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5f176fd2-8809-43cd-994b-0100be9304e2 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:03.438943 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5f176fd2-8809-43cd-994b-0100be9304e2 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:03.439401 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5f176fd2-8809-43cd-994b-0100be9304e2 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:03.447161 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 875/1841] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:02 2022] GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4 => generated 1719 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:35:03.447983 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5f176fd2-8809-43cd-994b-0100be9304e2 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:03.463479 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-477b018e-5d21-40a6-b390-54490c7845ae tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:03.464460 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-477b018e-5d21-40a6-b390-54490c7845ae tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] [instance: adc33804-eb64-40ca-a943-f2e74040c1b2] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:03.485522 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-477b018e-5d21-40a6-b390-54490c7845ae tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:03.508718 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-477b018e-5d21-40a6-b390-54490c7845ae tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:03.509188 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-477b018e-5d21-40a6-b390-54490c7845ae tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:03.509947 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-477b018e-5d21-40a6-b390-54490c7845ae tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:03.510405 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-477b018e-5d21-40a6-b390-54490c7845ae tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:03.510827 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-477b018e-5d21-40a6-b390-54490c7845ae tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:03.603946 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5f176fd2-8809-43cd-994b-0100be9304e2 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.236298 Oct 04 18:35:03.614324 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 967/1842] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Oct 4 18:35:03 2022] GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8/os-volume_attachments => generated 25 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:03.774123 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-477b018e-5d21-40a6-b390-54490c7845ae tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81e50834114f0fa3cca4b0b9f8acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4650d613cb84018b92dc5d51486885e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:03.790010 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-477b018e-5d21-40a6-b390-54490c7845ae tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] 10.222.0.20 "GET /compute/v2.1/servers/adc33804-eb64-40ca-a943-f2e74040c1b2" status: 200 len: 1279 microversion: 2.1 time: 0.339406 Oct 04 18:35:03.795431 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 876/1843] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:03 2022] GET /compute/v2.1/servers/adc33804-eb64-40ca-a943-f2e74040c1b2 => generated 1279 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:03.992728 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b4951d3a-852c-4e15-a2cc-d75e6feca865 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:03.993934 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b4951d3a-852c-4e15-a2cc-d75e6feca865 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2fe6c508-f183-40bd-bfd5-23c757e99a05] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:04.022365 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b4951d3a-852c-4e15-a2cc-d75e6feca865 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:04.023407 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b4951d3a-852c-4e15-a2cc-d75e6feca865 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:04.025253 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b4951d3a-852c-4e15-a2cc-d75e6feca865 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:04.026956 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b4951d3a-852c-4e15-a2cc-d75e6feca865 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:04.027697 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b4951d3a-852c-4e15-a2cc-d75e6feca865 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:04.029859 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b4951d3a-852c-4e15-a2cc-d75e6feca865 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:04.085232 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a010eede-5b3f-498c-a5bd-ea31f2676ba1 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '.version_select at 0x7fe258bf8e50>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:04.101799 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=4 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:04.446883 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b4951d3a-852c-4e15-a2cc-d75e6feca865 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:04.461664 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b4951d3a-852c-4e15-a2cc-d75e6feca865 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05" status: 200 len: 1477 microversion: 2.1 time: 0.474501 Oct 04 18:35:04.462171 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 968/1844] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:03 2022] GET /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05 => generated 1477 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:04.469831 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b280172b-ffdc-440f-923e-1b50572566fa tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:04.471002 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b280172b-ffdc-440f-923e-1b50572566fa tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:04.485197 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b280172b-ffdc-440f-923e-1b50572566fa tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:04.496140 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b280172b-ffdc-440f-923e-1b50572566fa tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:04.496899 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b280172b-ffdc-440f-923e-1b50572566fa tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:04.497836 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b280172b-ffdc-440f-923e-1b50572566fa tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:04.499391 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b280172b-ffdc-440f-923e-1b50572566fa tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:04.502704 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b280172b-ffdc-440f-923e-1b50572566fa tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:04.706508 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b280172b-ffdc-440f-923e-1b50572566fa tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:04.733392 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b280172b-ffdc-440f-923e-1b50572566fa tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:04.744422 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b280172b-ffdc-440f-923e-1b50572566fa tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:04.754977 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b280172b-ffdc-440f-923e-1b50572566fa tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1553 microversion: 2.91 time: 0.289618 Oct 04 18:35:04.756214 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 969/1845] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:04 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1553 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:04.764222 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-50a5d829-569b-47dc-a4b6-46e2d1da8afa tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:04.779336 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-50a5d829-569b-47dc-a4b6-46e2d1da8afa tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 158e9f52-fd16-48d1-87b5-e0dd523e97a4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:04.807502 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-50a5d829-569b-47dc-a4b6-46e2d1da8afa tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:04.813146 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-50a5d829-569b-47dc-a4b6-46e2d1da8afa tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:04.817111 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-50a5d829-569b-47dc-a4b6-46e2d1da8afa tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:04.818147 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-50a5d829-569b-47dc-a4b6-46e2d1da8afa tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:04.818993 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-50a5d829-569b-47dc-a4b6-46e2d1da8afa tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:04.819600 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-50a5d829-569b-47dc-a4b6-46e2d1da8afa tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:04.832576 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a010eede-5b3f-498c-a5bd-ea31f2676ba1 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/images/e64eecee-1f9d-474a-9126-89110fbb7f85" status: 200 len: 1440 microversion: 2.1 time: 0.751301 Oct 04 18:35:04.861166 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 877/1846] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:35:04 2022] GET /compute/v2.1/images/e64eecee-1f9d-474a-9126-89110fbb7f85 => generated 1440 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:04.874644 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-71a4d280-4591-4f5a-8cdd-27adab559921 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:04.875746 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-71a4d280-4591-4f5a-8cdd-27adab559921 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] [instance: adc33804-eb64-40ca-a943-f2e74040c1b2] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:04.896614 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-71a4d280-4591-4f5a-8cdd-27adab559921 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:04.899128 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-71a4d280-4591-4f5a-8cdd-27adab559921 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:04.904901 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-71a4d280-4591-4f5a-8cdd-27adab559921 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:04.906971 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-71a4d280-4591-4f5a-8cdd-27adab559921 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:04.906971 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-71a4d280-4591-4f5a-8cdd-27adab559921 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:04.906971 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-71a4d280-4591-4f5a-8cdd-27adab559921 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:05.177657 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-71a4d280-4591-4f5a-8cdd-27adab559921 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81e50834114f0fa3cca4b0b9f8acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4650d613cb84018b92dc5d51486885e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:05.208095 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-71a4d280-4591-4f5a-8cdd-27adab559921 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] 10.222.0.20 "GET /compute/v2.1/servers/adc33804-eb64-40ca-a943-f2e74040c1b2" status: 200 len: 1279 microversion: 2.1 time: 0.340440 Oct 04 18:35:05.228402 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 878/1847] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:04 2022] GET /compute/v2.1/servers/adc33804-eb64-40ca-a943-f2e74040c1b2 => generated 1279 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:05.264721 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-50a5d829-569b-47dc-a4b6-46e2d1da8afa tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:05.280913 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-50a5d829-569b-47dc-a4b6-46e2d1da8afa tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4" status: 200 len: 1719 microversion: 2.1 time: 0.523244 Oct 04 18:35:05.283992 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 970/1848] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:04 2022] GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4 => generated 1719 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:05.489750 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1295e5c3-1c85-46f7-8fb7-ba247cf94339 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:05.490755 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1295e5c3-1c85-46f7-8fb7-ba247cf94339 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2fe6c508-f183-40bd-bfd5-23c757e99a05] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:05.510225 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1295e5c3-1c85-46f7-8fb7-ba247cf94339 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:05.521333 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1295e5c3-1c85-46f7-8fb7-ba247cf94339 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:05.521801 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1295e5c3-1c85-46f7-8fb7-ba247cf94339 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:05.522597 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1295e5c3-1c85-46f7-8fb7-ba247cf94339 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:05.526176 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1295e5c3-1c85-46f7-8fb7-ba247cf94339 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:05.526713 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1295e5c3-1c85-46f7-8fb7-ba247cf94339 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:05.559368 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-0cf3438d-d7c0-4ceb-af0e-a283b84432c4 req-bf74f2a3-64d4-4db4-bcc2-c7bc1912c8b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3a29732-fa0a-4dfd-8475-0f43e9bb0846", "tag": "fba0321b-163f-45c1-8bb6-a7e8f98924cc"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:05.591576 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-0cf3438d-d7c0-4ceb-af0e-a283b84432c4 req-bf74f2a3-64d4-4db4-bcc2-c7bc1912c8b0 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:05.597477 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-0cf3438d-d7c0-4ceb-af0e-a283b84432c4 req-bf74f2a3-64d4-4db4-bcc2-c7bc1912c8b0 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:05.598643 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-0cf3438d-d7c0-4ceb-af0e-a283b84432c4 req-bf74f2a3-64d4-4db4-bcc2-c7bc1912c8b0 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:05.643710 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-0cf3438d-d7c0-4ceb-af0e-a283b84432c4 req-bf74f2a3-64d4-4db4-bcc2-c7bc1912c8b0 service nova] Creating event network-changed:fba0321b-163f-45c1-8bb6-a7e8f98924cc for instance c3a29732-fa0a-4dfd-8475-0f43e9bb0846 on n-h1-850501-14 Oct 04 18:35:05.655008 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-0cf3438d-d7c0-4ceb-af0e-a283b84432c4 req-bf74f2a3-64d4-4db4-bcc2-c7bc1912c8b0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099114 Oct 04 18:35:05.659901 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 971/1849] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:35:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:35:05.852662 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-943d0cc4-4537-42a1-a9f6-c39b20a929dc tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:05.853380 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-943d0cc4-4537-42a1-a9f6-c39b20a929dc tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:05.861529 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-943d0cc4-4537-42a1-a9f6-c39b20a929dc tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:05.862214 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-943d0cc4-4537-42a1-a9f6-c39b20a929dc tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:05.862899 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-943d0cc4-4537-42a1-a9f6-c39b20a929dc tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:05.864004 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-943d0cc4-4537-42a1-a9f6-c39b20a929dc tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:05.864771 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-943d0cc4-4537-42a1-a9f6-c39b20a929dc tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:05.865429 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-943d0cc4-4537-42a1-a9f6-c39b20a929dc tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:06.146663 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-943d0cc4-4537-42a1-a9f6-c39b20a929dc tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:06.146663 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-943d0cc4-4537-42a1-a9f6-c39b20a929dc tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:06.146663 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-943d0cc4-4537-42a1-a9f6-c39b20a929dc tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:06.150718 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1295e5c3-1c85-46f7-8fb7-ba247cf94339 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:06.152542 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-943d0cc4-4537-42a1-a9f6-c39b20a929dc tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1553 microversion: 2.91 time: 0.139803 Oct 04 18:35:06.152867 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1295e5c3-1c85-46f7-8fb7-ba247cf94339 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05" status: 200 len: 1477 microversion: 2.1 time: 0.507924 Oct 04 18:35:06.152867 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 879/1850] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:05 2022] GET /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05 => generated 1477 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:35:06.152867 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-afd5209c-1198-42ed-9515-68d43578a45a tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '.version_select at 0x7fe258bd8940>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:06.153505 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 972/1851] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:05 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1553 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:35:06.242761 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7c82ea12-49f2-42ac-a282-ed153ae6ed49 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:06.244398 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7c82ea12-49f2-42ac-a282-ed153ae6ed49 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] [instance: adc33804-eb64-40ca-a943-f2e74040c1b2] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:06.254431 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c82ea12-49f2-42ac-a282-ed153ae6ed49 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:06.255283 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c82ea12-49f2-42ac-a282-ed153ae6ed49 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:06.256026 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c82ea12-49f2-42ac-a282-ed153ae6ed49 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:06.257109 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c82ea12-49f2-42ac-a282-ed153ae6ed49 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:06.258207 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c82ea12-49f2-42ac-a282-ed153ae6ed49 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:06.258924 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c82ea12-49f2-42ac-a282-ed153ae6ed49 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:06.470789 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7c82ea12-49f2-42ac-a282-ed153ae6ed49 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81e50834114f0fa3cca4b0b9f8acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4650d613cb84018b92dc5d51486885e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:06.470789 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7c82ea12-49f2-42ac-a282-ed153ae6ed49 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] 10.222.0.20 "GET /compute/v2.1/servers/adc33804-eb64-40ca-a943-f2e74040c1b2" status: 200 len: 1279 microversion: 2.1 time: 0.134310 Oct 04 18:35:06.470789 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 973/1852] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:06 2022] GET /compute/v2.1/servers/adc33804-eb64-40ca-a943-f2e74040c1b2 => generated 1279 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:35:06.470789 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4fdd9e22-83ba-45ec-aecc-121620f92a1b tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:06.470789 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4fdd9e22-83ba-45ec-aecc-121620f92a1b tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 158e9f52-fd16-48d1-87b5-e0dd523e97a4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:06.470789 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4fdd9e22-83ba-45ec-aecc-121620f92a1b tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:06.470789 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4fdd9e22-83ba-45ec-aecc-121620f92a1b tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:06.470789 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4fdd9e22-83ba-45ec-aecc-121620f92a1b tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:06.470789 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4fdd9e22-83ba-45ec-aecc-121620f92a1b tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:06.470789 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4fdd9e22-83ba-45ec-aecc-121620f92a1b tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:06.470789 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4fdd9e22-83ba-45ec-aecc-121620f92a1b tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:06.517239 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:06.573476 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=6 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:06.649657 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4fdd9e22-83ba-45ec-aecc-121620f92a1b tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:06.660373 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4fdd9e22-83ba-45ec-aecc-121620f92a1b tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4" status: 200 len: 1719 microversion: 2.1 time: 0.286685 Oct 04 18:35:06.679144 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 974/1853] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:06 2022] GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4 => generated 1719 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:07.021501 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2faad0fc-75a7-4120-9812-7ebd957fe2aa tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:07.022899 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2faad0fc-75a7-4120-9812-7ebd957fe2aa tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:07.041894 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2faad0fc-75a7-4120-9812-7ebd957fe2aa tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:07.042704 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2faad0fc-75a7-4120-9812-7ebd957fe2aa tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:07.044615 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2faad0fc-75a7-4120-9812-7ebd957fe2aa tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:07.045588 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2faad0fc-75a7-4120-9812-7ebd957fe2aa tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:07.048296 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2faad0fc-75a7-4120-9812-7ebd957fe2aa tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:07.048975 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2faad0fc-75a7-4120-9812-7ebd957fe2aa tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:07.189000 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2faad0fc-75a7-4120-9812-7ebd957fe2aa tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:07.204493 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2faad0fc-75a7-4120-9812-7ebd957fe2aa tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:07.213683 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2faad0fc-75a7-4120-9812-7ebd957fe2aa tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:07.235851 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2faad0fc-75a7-4120-9812-7ebd957fe2aa tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1553 microversion: 2.91 time: 0.217326 Oct 04 18:35:07.237779 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 975/1854] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:07 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1553 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:07.244925 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-27dbd6a1-23ed-4d55-8320-7a6dd9d749e9 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:07.250378 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-27dbd6a1-23ed-4d55-8320-7a6dd9d749e9 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2fe6c508-f183-40bd-bfd5-23c757e99a05] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:07.266407 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=96 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:07.269669 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-27dbd6a1-23ed-4d55-8320-7a6dd9d749e9 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:07.271066 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-27dbd6a1-23ed-4d55-8320-7a6dd9d749e9 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:07.271573 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-27dbd6a1-23ed-4d55-8320-7a6dd9d749e9 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:07.272631 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-27dbd6a1-23ed-4d55-8320-7a6dd9d749e9 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:07.276724 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-27dbd6a1-23ed-4d55-8320-7a6dd9d749e9 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:07.277661 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-27dbd6a1-23ed-4d55-8320-7a6dd9d749e9 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:07.437354 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=14 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:07.965540 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-27dbd6a1-23ed-4d55-8320-7a6dd9d749e9 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:07.985139 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-27dbd6a1-23ed-4d55-8320-7a6dd9d749e9 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05" status: 200 len: 1477 microversion: 2.1 time: 0.743599 Oct 04 18:35:07.992373 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 976/1855] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:07 2022] GET /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05 => generated 1477 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:08.014238 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c976af87-6caf-4220-9f27-6e99c180c993 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:08.015237 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c976af87-6caf-4220-9f27-6e99c180c993 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] [instance: adc33804-eb64-40ca-a943-f2e74040c1b2] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:08.034675 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c976af87-6caf-4220-9f27-6e99c180c993 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:08.039415 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c976af87-6caf-4220-9f27-6e99c180c993 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:08.040810 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c976af87-6caf-4220-9f27-6e99c180c993 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:08.041894 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c976af87-6caf-4220-9f27-6e99c180c993 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:08.042739 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c976af87-6caf-4220-9f27-6e99c180c993 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:08.043696 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c976af87-6caf-4220-9f27-6e99c180c993 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:08.637319 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c976af87-6caf-4220-9f27-6e99c180c993 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81e50834114f0fa3cca4b0b9f8acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4650d613cb84018b92dc5d51486885e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:08.648788 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c976af87-6caf-4220-9f27-6e99c180c993 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] 10.222.0.20 "GET /compute/v2.1/servers/adc33804-eb64-40ca-a943-f2e74040c1b2" status: 200 len: 1321 microversion: 2.1 time: 0.652897 Oct 04 18:35:08.668343 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 977/1856] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:07 2022] GET /compute/v2.1/servers/adc33804-eb64-40ca-a943-f2e74040c1b2 => generated 1321 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:08.693710 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1e0d0696-3de4-441f-8af0-bb0e2c896b42 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:08.698862 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1e0d0696-3de4-441f-8af0-bb0e2c896b42 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 158e9f52-fd16-48d1-87b5-e0dd523e97a4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:08.737211 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1e0d0696-3de4-441f-8af0-bb0e2c896b42 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:08.737824 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1e0d0696-3de4-441f-8af0-bb0e2c896b42 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:08.738584 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1e0d0696-3de4-441f-8af0-bb0e2c896b42 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:08.739407 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1e0d0696-3de4-441f-8af0-bb0e2c896b42 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:08.739872 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1e0d0696-3de4-441f-8af0-bb0e2c896b42 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:08.740328 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1e0d0696-3de4-441f-8af0-bb0e2c896b42 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:10.484517 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1e0d0696-3de4-441f-8af0-bb0e2c896b42 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:10.515607 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1e0d0696-3de4-441f-8af0-bb0e2c896b42 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4" status: 200 len: 1719 microversion: 2.1 time: 1.846027 Oct 04 18:35:10.532574 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 978/1857] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:08 2022] GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4 => generated 1719 bytes in 1866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:10.560972 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-449be071-c861-4c1d-ad2b-2136afaa2500 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:10.565155 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-449be071-c861-4c1d-ad2b-2136afaa2500 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:10.597666 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-449be071-c861-4c1d-ad2b-2136afaa2500 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:10.599194 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-449be071-c861-4c1d-ad2b-2136afaa2500 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:10.604111 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-449be071-c861-4c1d-ad2b-2136afaa2500 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:10.605158 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-449be071-c861-4c1d-ad2b-2136afaa2500 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:10.606048 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-449be071-c861-4c1d-ad2b-2136afaa2500 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:10.606656 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-449be071-c861-4c1d-ad2b-2136afaa2500 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:10.854111 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-449be071-c861-4c1d-ad2b-2136afaa2500 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:10.878693 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-449be071-c861-4c1d-ad2b-2136afaa2500 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:10.881370 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-449be071-c861-4c1d-ad2b-2136afaa2500 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:10.909299 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-449be071-c861-4c1d-ad2b-2136afaa2500 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1553 microversion: 2.91 time: 0.369828 Oct 04 18:35:10.910322 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 979/1858] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:10 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1553 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:10.922329 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-71a529cb-3137-47c4-bd5f-cad698583b91 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:10.923252 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-71a529cb-3137-47c4-bd5f-cad698583b91 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2fe6c508-f183-40bd-bfd5-23c757e99a05] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:10.940930 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-71a529cb-3137-47c4-bd5f-cad698583b91 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:10.957728 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-71a529cb-3137-47c4-bd5f-cad698583b91 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:10.959531 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-71a529cb-3137-47c4-bd5f-cad698583b91 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:10.969354 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-71a529cb-3137-47c4-bd5f-cad698583b91 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:10.972876 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-71a529cb-3137-47c4-bd5f-cad698583b91 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:10.973565 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-71a529cb-3137-47c4-bd5f-cad698583b91 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:10.984140 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=100 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:11.860908 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-71a529cb-3137-47c4-bd5f-cad698583b91 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:11.877940 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-71a529cb-3137-47c4-bd5f-cad698583b91 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05" status: 200 len: 1476 microversion: 2.1 time: 0.966043 Oct 04 18:35:11.878553 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 980/1859] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:10 2022] GET /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05 => generated 1476 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:11.888868 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-49a798a0-a303-466e-9850-2ccaa14676ba tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:11.909607 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-49a798a0-a303-466e-9850-2ccaa14676ba tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] [instance: adc33804-eb64-40ca-a943-f2e74040c1b2] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:11.926902 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-49a798a0-a303-466e-9850-2ccaa14676ba tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:11.930490 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-49a798a0-a303-466e-9850-2ccaa14676ba tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:11.932937 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-49a798a0-a303-466e-9850-2ccaa14676ba tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:11.935404 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-49a798a0-a303-466e-9850-2ccaa14676ba tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:11.942942 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-49a798a0-a303-466e-9850-2ccaa14676ba tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:11.945956 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-49a798a0-a303-466e-9850-2ccaa14676ba tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:12.769573 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-49a798a0-a303-466e-9850-2ccaa14676ba tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81e50834114f0fa3cca4b0b9f8acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4650d613cb84018b92dc5d51486885e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:12.778235 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-49a798a0-a303-466e-9850-2ccaa14676ba tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] 10.222.0.20 "GET /compute/v2.1/servers/adc33804-eb64-40ca-a943-f2e74040c1b2" status: 200 len: 1321 microversion: 2.1 time: 0.893385 Oct 04 18:35:12.793802 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 981/1860] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:11 2022] GET /compute/v2.1/servers/adc33804-eb64-40ca-a943-f2e74040c1b2 => generated 1321 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:12.808515 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-e8ffd265-0dca-4c07-917c-a8a8c1c02d00 req-366ae722-ecf0-400e-96a1-d83dbb19ade8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fe6c508-f183-40bd-bfd5-23c757e99a05", "name": "network-vif-unplugged", "status": "completed", "tag": "4ffbd68f-521b-46aa-9313-bc62980cacb6"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:12.840229 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-e8ffd265-0dca-4c07-917c-a8a8c1c02d00 req-366ae722-ecf0-400e-96a1-d83dbb19ade8 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:12.846486 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-e8ffd265-0dca-4c07-917c-a8a8c1c02d00 req-366ae722-ecf0-400e-96a1-d83dbb19ade8 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:12.847225 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-e8ffd265-0dca-4c07-917c-a8a8c1c02d00 req-366ae722-ecf0-400e-96a1-d83dbb19ade8 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:12.915875 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-e8ffd265-0dca-4c07-917c-a8a8c1c02d00 req-366ae722-ecf0-400e-96a1-d83dbb19ade8 service nova] Creating event network-vif-unplugged:4ffbd68f-521b-46aa-9313-bc62980cacb6 for instance 2fe6c508-f183-40bd-bfd5-23c757e99a05 on n-h2-850501-14 Oct 04 18:35:12.955018 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [req-e8ffd265-0dca-4c07-917c-a8a8c1c02d00 req-366ae722-ecf0-400e-96a1-d83dbb19ade8 service nova] Instance 2fe6c508-f183-40bd-bfd5-23c757e99a05 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850501-14', 'n-h2-850501-14'} {{(pid=123002) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:35:13.000652 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-e8ffd265-0dca-4c07-917c-a8a8c1c02d00 req-366ae722-ecf0-400e-96a1-d83dbb19ade8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.203308 Oct 04 18:35:13.006114 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 982/1861] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:35:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:35:13.015970 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1e40e0cb-0fc4-4f04-8978-5d704cc7fafe tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:13.022463 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1e40e0cb-0fc4-4f04-8978-5d704cc7fafe tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 158e9f52-fd16-48d1-87b5-e0dd523e97a4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:13.043176 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1e40e0cb-0fc4-4f04-8978-5d704cc7fafe tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:13.047379 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1e40e0cb-0fc4-4f04-8978-5d704cc7fafe tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:13.049177 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1e40e0cb-0fc4-4f04-8978-5d704cc7fafe tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:13.054020 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1e40e0cb-0fc4-4f04-8978-5d704cc7fafe tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:13.055656 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1e40e0cb-0fc4-4f04-8978-5d704cc7fafe tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:13.057275 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1e40e0cb-0fc4-4f04-8978-5d704cc7fafe tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:13.509669 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1e40e0cb-0fc4-4f04-8978-5d704cc7fafe tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:13.519100 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1e40e0cb-0fc4-4f04-8978-5d704cc7fafe tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4" status: 200 len: 1719 microversion: 2.1 time: 0.509531 Oct 04 18:35:13.520346 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 983/1862] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:13 2022] GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4 => generated 1719 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:13.525416 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-52766d9d-f4ad-445a-b3cd-a9cb129d8391 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:13.526215 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-52766d9d-f4ad-445a-b3cd-a9cb129d8391 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:13.532236 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-52766d9d-f4ad-445a-b3cd-a9cb129d8391 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:13.532937 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-52766d9d-f4ad-445a-b3cd-a9cb129d8391 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:13.534376 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-52766d9d-f4ad-445a-b3cd-a9cb129d8391 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:13.535412 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-52766d9d-f4ad-445a-b3cd-a9cb129d8391 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:13.536217 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-52766d9d-f4ad-445a-b3cd-a9cb129d8391 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:13.536877 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-52766d9d-f4ad-445a-b3cd-a9cb129d8391 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:13.612867 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-52766d9d-f4ad-445a-b3cd-a9cb129d8391 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:13.621185 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-52766d9d-f4ad-445a-b3cd-a9cb129d8391 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:13.622626 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-52766d9d-f4ad-445a-b3cd-a9cb129d8391 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:13.627540 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-52766d9d-f4ad-445a-b3cd-a9cb129d8391 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1553 microversion: 2.91 time: 0.105944 Oct 04 18:35:13.628136 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 984/1863] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:13 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1553 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:13.633401 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-d299472e-1da1-46f2-beb3-d506b542200d req-86b763f0-3162-427e-bdf7-d20eb44f9815 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4d49cb2-f2a4-481b-bdb4-bcdad0649bd2", "tag": "b7fdc86f-aa1a-42fc-9636-18ad6b5b67b6"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:13.643967 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-d299472e-1da1-46f2-beb3-d506b542200d req-86b763f0-3162-427e-bdf7-d20eb44f9815 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:13.644848 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-d299472e-1da1-46f2-beb3-d506b542200d req-86b763f0-3162-427e-bdf7-d20eb44f9815 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:13.645529 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-d299472e-1da1-46f2-beb3-d506b542200d req-86b763f0-3162-427e-bdf7-d20eb44f9815 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:13.663363 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-d299472e-1da1-46f2-beb3-d506b542200d req-86b763f0-3162-427e-bdf7-d20eb44f9815 service nova] Creating event network-changed:b7fdc86f-aa1a-42fc-9636-18ad6b5b67b6 for instance b4d49cb2-f2a4-481b-bdb4-bcdad0649bd2 on n-h2-850501-14 Oct 04 18:35:13.669100 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-d299472e-1da1-46f2-beb3-d506b542200d req-86b763f0-3162-427e-bdf7-d20eb44f9815 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039498 Oct 04 18:35:13.670607 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 985/1864] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:35:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:35:13.676717 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-eb7f13ef-434c-4c13-80fb-637cc8cd72f7 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:13.677733 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-eb7f13ef-434c-4c13-80fb-637cc8cd72f7 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2fe6c508-f183-40bd-bfd5-23c757e99a05] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:13.687876 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eb7f13ef-434c-4c13-80fb-637cc8cd72f7 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:13.688709 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eb7f13ef-434c-4c13-80fb-637cc8cd72f7 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:13.689376 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eb7f13ef-434c-4c13-80fb-637cc8cd72f7 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:13.691118 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eb7f13ef-434c-4c13-80fb-637cc8cd72f7 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:13.691931 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eb7f13ef-434c-4c13-80fb-637cc8cd72f7 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:13.692787 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eb7f13ef-434c-4c13-80fb-637cc8cd72f7 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:14.090314 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-eb7f13ef-434c-4c13-80fb-637cc8cd72f7 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:14.110310 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-eb7f13ef-434c-4c13-80fb-637cc8cd72f7 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05" status: 200 len: 1476 microversion: 2.1 time: 0.438076 Oct 04 18:35:14.111938 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 986/1865] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:13 2022] GET /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05 => generated 1476 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:14.135912 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a740a5d6-336f-41a3-96fe-c682d83ecb2e tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:14.136878 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a740a5d6-336f-41a3-96fe-c682d83ecb2e tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] [instance: adc33804-eb64-40ca-a943-f2e74040c1b2] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:14.144372 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a740a5d6-336f-41a3-96fe-c682d83ecb2e tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:14.145160 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a740a5d6-336f-41a3-96fe-c682d83ecb2e tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:14.146086 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a740a5d6-336f-41a3-96fe-c682d83ecb2e tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:14.147177 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a740a5d6-336f-41a3-96fe-c682d83ecb2e tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:14.148013 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a740a5d6-336f-41a3-96fe-c682d83ecb2e tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:14.148697 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a740a5d6-336f-41a3-96fe-c682d83ecb2e tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:14.586168 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a740a5d6-336f-41a3-96fe-c682d83ecb2e tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81e50834114f0fa3cca4b0b9f8acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4650d613cb84018b92dc5d51486885e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:14.597184 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a740a5d6-336f-41a3-96fe-c682d83ecb2e tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] 10.222.0.20 "GET /compute/v2.1/servers/adc33804-eb64-40ca-a943-f2e74040c1b2" status: 200 len: 1321 microversion: 2.1 time: 0.467400 Oct 04 18:35:14.613690 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 987/1866] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:14 2022] GET /compute/v2.1/servers/adc33804-eb64-40ca-a943-f2e74040c1b2 => generated 1321 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:14.620577 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-dec9243c-9420-40ed-89de-b0ec4daa3c4b tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:14.621273 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-dec9243c-9420-40ed-89de-b0ec4daa3c4b tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 158e9f52-fd16-48d1-87b5-e0dd523e97a4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:14.628115 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dec9243c-9420-40ed-89de-b0ec4daa3c4b tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:14.628701 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dec9243c-9420-40ed-89de-b0ec4daa3c4b tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:14.629397 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dec9243c-9420-40ed-89de-b0ec4daa3c4b tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:14.630317 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dec9243c-9420-40ed-89de-b0ec4daa3c4b tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:14.630844 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dec9243c-9420-40ed-89de-b0ec4daa3c4b tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:14.631388 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dec9243c-9420-40ed-89de-b0ec4daa3c4b tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:14.843885 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-dec9243c-9420-40ed-89de-b0ec4daa3c4b tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:14.867749 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-dec9243c-9420-40ed-89de-b0ec4daa3c4b tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4" status: 200 len: 1719 microversion: 2.1 time: 0.252552 Oct 04 18:35:14.871010 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 988/1867] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:14 2022] GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4 => generated 1719 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:14.898775 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-15def9b2-3b0a-42d8-a84b-941cbff8633e tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:14.898775 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-15def9b2-3b0a-42d8-a84b-941cbff8633e tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:14.900883 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-15def9b2-3b0a-42d8-a84b-941cbff8633e tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:14.901769 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-15def9b2-3b0a-42d8-a84b-941cbff8633e tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:14.902606 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-15def9b2-3b0a-42d8-a84b-941cbff8633e tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:14.903496 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-15def9b2-3b0a-42d8-a84b-941cbff8633e tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:14.917119 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-15def9b2-3b0a-42d8-a84b-941cbff8633e tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:14.917916 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-15def9b2-3b0a-42d8-a84b-941cbff8633e tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:15.334665 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-15def9b2-3b0a-42d8-a84b-941cbff8633e tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:15.347277 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-15def9b2-3b0a-42d8-a84b-941cbff8633e tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:15.351084 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-15def9b2-3b0a-42d8-a84b-941cbff8633e tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:15.367189 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-15def9b2-3b0a-42d8-a84b-941cbff8633e tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1553 microversion: 2.91 time: 0.495070 Oct 04 18:35:15.374549 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 989/1868] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:14 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1553 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:15.394609 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-30592d41-33df-4b2d-9876-34be5c4ab19d tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:15.395538 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-30592d41-33df-4b2d-9876-34be5c4ab19d tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2fe6c508-f183-40bd-bfd5-23c757e99a05] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:15.418432 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-30592d41-33df-4b2d-9876-34be5c4ab19d tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:15.418432 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-30592d41-33df-4b2d-9876-34be5c4ab19d tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:15.418432 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-30592d41-33df-4b2d-9876-34be5c4ab19d tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:15.428900 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-30592d41-33df-4b2d-9876-34be5c4ab19d tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:15.435554 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-30592d41-33df-4b2d-9876-34be5c4ab19d tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:15.436112 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-30592d41-33df-4b2d-9876-34be5c4ab19d tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:15.507259 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:15.773395 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-30592d41-33df-4b2d-9876-34be5c4ab19d tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:15.789529 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-30592d41-33df-4b2d-9876-34be5c4ab19d tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05" status: 200 len: 1476 microversion: 2.1 time: 0.413548 Oct 04 18:35:15.790525 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 990/1869] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:15 2022] GET /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05 => generated 1476 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:15.797797 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-521d6a09-b3ec-4432-bd05-f1eafdb4719f req-3176ba13-db4f-4448-a372-4303cd3bb559 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fe6c508-f183-40bd-bfd5-23c757e99a05", "tag": "4ffbd68f-521b-46aa-9313-bc62980cacb6"}, {"server_uuid": "158e9f52-fd16-48d1-87b5-e0dd523e97a4", "name": "network-vif-unplugged", "status": "completed", "tag": "339801ef-bddd-45f8-802a-ec8d2e0687e7"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:15.821020 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-521d6a09-b3ec-4432-bd05-f1eafdb4719f req-3176ba13-db4f-4448-a372-4303cd3bb559 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:15.833250 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-521d6a09-b3ec-4432-bd05-f1eafdb4719f req-3176ba13-db4f-4448-a372-4303cd3bb559 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:15.834337 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-521d6a09-b3ec-4432-bd05-f1eafdb4719f req-3176ba13-db4f-4448-a372-4303cd3bb559 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:15.858261 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-521d6a09-b3ec-4432-bd05-f1eafdb4719f req-3176ba13-db4f-4448-a372-4303cd3bb559 service nova] Creating event network-changed:4ffbd68f-521b-46aa-9313-bc62980cacb6 for instance 2fe6c508-f183-40bd-bfd5-23c757e99a05 on n-h2-850501-14 Oct 04 18:35:15.859189 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-521d6a09-b3ec-4432-bd05-f1eafdb4719f req-3176ba13-db4f-4448-a372-4303cd3bb559 service nova] Creating event network-vif-unplugged:339801ef-bddd-45f8-802a-ec8d2e0687e7 for instance 158e9f52-fd16-48d1-87b5-e0dd523e97a4 on n-h1-850501-14 Oct 04 18:35:15.885189 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [req-521d6a09-b3ec-4432-bd05-f1eafdb4719f req-3176ba13-db4f-4448-a372-4303cd3bb559 service nova] Instance 2fe6c508-f183-40bd-bfd5-23c757e99a05 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850501-14', 'n-h2-850501-14'} {{(pid=123002) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:35:15.909943 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-521d6a09-b3ec-4432-bd05-f1eafdb4719f req-3176ba13-db4f-4448-a372-4303cd3bb559 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.117926 Oct 04 18:35:15.911164 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 991/1870] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:35:15 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:35:15.917941 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-dd3412b6-e0a1-42f1-b9f0-c269e390748b tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:15.918648 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-dd3412b6-e0a1-42f1-b9f0-c269e390748b tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] [instance: adc33804-eb64-40ca-a943-f2e74040c1b2] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:15.925447 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dd3412b6-e0a1-42f1-b9f0-c269e390748b tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:15.926279 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dd3412b6-e0a1-42f1-b9f0-c269e390748b tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:15.926902 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dd3412b6-e0a1-42f1-b9f0-c269e390748b tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:15.927892 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dd3412b6-e0a1-42f1-b9f0-c269e390748b tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:15.928533 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dd3412b6-e0a1-42f1-b9f0-c269e390748b tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:15.929195 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dd3412b6-e0a1-42f1-b9f0-c269e390748b tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:15.988385 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=91 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:16.434234 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-dd3412b6-e0a1-42f1-b9f0-c269e390748b tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81e50834114f0fa3cca4b0b9f8acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4650d613cb84018b92dc5d51486885e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:16.469135 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-dd3412b6-e0a1-42f1-b9f0-c269e390748b tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] 10.222.0.20 "GET /compute/v2.1/servers/adc33804-eb64-40ca-a943-f2e74040c1b2" status: 200 len: 1321 microversion: 2.1 time: 0.555570 Oct 04 18:35:16.469822 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 992/1871] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:15 2022] GET /compute/v2.1/servers/adc33804-eb64-40ca-a943-f2e74040c1b2 => generated 1321 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:16.516388 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-3c331c70-3b28-4fb1-ab97-775907488f48 req-081b829c-8b4a-4fc7-a1a5-04f2fb6c0023 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "adc33804-eb64-40ca-a943-f2e74040c1b2", "tag": "ff04ab26-1f82-497a-9628-266b9352d2a5"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:16.553471 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-3c331c70-3b28-4fb1-ab97-775907488f48 req-081b829c-8b4a-4fc7-a1a5-04f2fb6c0023 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:16.562061 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-3c331c70-3b28-4fb1-ab97-775907488f48 req-081b829c-8b4a-4fc7-a1a5-04f2fb6c0023 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:16.565906 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-3c331c70-3b28-4fb1-ab97-775907488f48 req-081b829c-8b4a-4fc7-a1a5-04f2fb6c0023 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:16.602448 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-afd5209c-1198-42ed-9515-68d43578a45a tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/images/e64eecee-1f9d-474a-9126-89110fbb7f85" status: 200 len: 1449 microversion: 2.1 time: 10.605819 Oct 04 18:35:16.619191 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 880/1872] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:35:05 2022] GET /compute/v2.1/images/e64eecee-1f9d-474a-9126-89110fbb7f85 => generated 1449 bytes in 10624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:16.635284 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-3c331c70-3b28-4fb1-ab97-775907488f48 req-081b829c-8b4a-4fc7-a1a5-04f2fb6c0023 service nova] Creating event network-changed:ff04ab26-1f82-497a-9628-266b9352d2a5 for instance adc33804-eb64-40ca-a943-f2e74040c1b2 on n-h2-850501-14 Oct 04 18:35:16.637872 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e92cb8bf-1993-4615-aef2-dcb4eaaea41b tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:16.641578 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e92cb8bf-1993-4615-aef2-dcb4eaaea41b tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 158e9f52-fd16-48d1-87b5-e0dd523e97a4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:16.655535 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-3c331c70-3b28-4fb1-ab97-775907488f48 req-081b829c-8b4a-4fc7-a1a5-04f2fb6c0023 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.177570 Oct 04 18:35:16.661270 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e92cb8bf-1993-4615-aef2-dcb4eaaea41b tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:16.664077 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 993/1873] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:35:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:35:16.664348 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e92cb8bf-1993-4615-aef2-dcb4eaaea41b tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:16.664348 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e92cb8bf-1993-4615-aef2-dcb4eaaea41b tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:16.667799 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e92cb8bf-1993-4615-aef2-dcb4eaaea41b tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:16.669953 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e92cb8bf-1993-4615-aef2-dcb4eaaea41b tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:16.671264 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e92cb8bf-1993-4615-aef2-dcb4eaaea41b tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:16.687067 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-fb66e1d2-d91e-4e44-b031-20da12a1eccf tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:16.688178 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-fb66e1d2-d91e-4e44-b031-20da12a1eccf tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:16.698289 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fb66e1d2-d91e-4e44-b031-20da12a1eccf tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:16.700524 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fb66e1d2-d91e-4e44-b031-20da12a1eccf tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:16.701160 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fb66e1d2-d91e-4e44-b031-20da12a1eccf tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:16.702062 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fb66e1d2-d91e-4e44-b031-20da12a1eccf tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:16.702792 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fb66e1d2-d91e-4e44-b031-20da12a1eccf tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:16.703460 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fb66e1d2-d91e-4e44-b031-20da12a1eccf tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:16.947462 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-fb66e1d2-d91e-4e44-b031-20da12a1eccf tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:16.977815 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-fb66e1d2-d91e-4e44-b031-20da12a1eccf tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:16.983800 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-fb66e1d2-d91e-4e44-b031-20da12a1eccf tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:17.002648 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-fb66e1d2-d91e-4e44-b031-20da12a1eccf tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1553 microversion: 2.91 time: 0.321593 Oct 04 18:35:17.009310 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 994/1874] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:16 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1553 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:17.022634 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8e2ae3f1-9f3f-4474-9faf-26e4edfa29f7 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '.version_select at 0x7fe259277f70>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:17.134345 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8e2ae3f1-9f3f-4474-9faf-26e4edfa29f7 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/images/e64eecee-1f9d-474a-9126-89110fbb7f85" status: 200 len: 1449 microversion: 2.1 time: 0.125802 Oct 04 18:35:17.135337 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 995/1875] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:35:17 2022] GET /compute/v2.1/images/e64eecee-1f9d-474a-9126-89110fbb7f85 => generated 1449 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:17.149467 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3c7968a1-ee29-4767-ae06-6ebcdf051aa2 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:17.150297 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3c7968a1-ee29-4767-ae06-6ebcdf051aa2 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2fe6c508-f183-40bd-bfd5-23c757e99a05] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:17.157055 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3c7968a1-ee29-4767-ae06-6ebcdf051aa2 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:17.159244 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3c7968a1-ee29-4767-ae06-6ebcdf051aa2 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:17.159244 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3c7968a1-ee29-4767-ae06-6ebcdf051aa2 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:17.159958 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3c7968a1-ee29-4767-ae06-6ebcdf051aa2 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:17.160558 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3c7968a1-ee29-4767-ae06-6ebcdf051aa2 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:17.161088 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3c7968a1-ee29-4767-ae06-6ebcdf051aa2 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:17.460769 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e92cb8bf-1993-4615-aef2-dcb4eaaea41b tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:17.510892 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e92cb8bf-1993-4615-aef2-dcb4eaaea41b tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4" status: 200 len: 1719 microversion: 2.1 time: 0.884387 Oct 04 18:35:17.525121 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 881/1876] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:16 2022] GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4 => generated 1719 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:17.536084 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3c7968a1-ee29-4767-ae06-6ebcdf051aa2 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:17.571956 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3c7968a1-ee29-4767-ae06-6ebcdf051aa2 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05" status: 200 len: 1476 microversion: 2.1 time: 0.427643 Oct 04 18:35:17.571956 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 996/1877] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:17 2022] GET /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05 => generated 1476 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:17.582812 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6261419b-b39e-422c-93c0-45f2a7fa1ee6 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-383908567", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": [{"uuid": "8ae7c3ad-a283-49a3-aeec-6720078b6d59"}, {"uuid": "c4c1b728-bfcb-4f7a-a16a-fbe9e08dc4b6"}, {"uuid": "8ae7c3ad-a283-49a3-aeec-6720078b6d59"}]}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:17.593340 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-477d210b-95b2-4765-a88c-82e19c873d61 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '.version_select at 0x7fe2593a3700>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:19.620606 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-477d210b-95b2-4765-a88c-82e19c873d61 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "DELETE /compute/v2.1/images/e64eecee-1f9d-474a-9126-89110fbb7f85" status: 204 len: 0 microversion: 2.1 time: 2.041955 Oct 04 18:35:19.622132 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 997/1878] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:17 2022] DELETE /compute/v2.1/images/e64eecee-1f9d-474a-9126-89110fbb7f85 => generated 0 bytes in 2051 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:35:19.629327 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-78992d97-6b1c-467d-b8f0-877badbdf5bd tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:19.630012 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-78992d97-6b1c-467d-b8f0-877badbdf5bd tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] [instance: adc33804-eb64-40ca-a943-f2e74040c1b2] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:19.643307 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-78992d97-6b1c-467d-b8f0-877badbdf5bd tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:19.650168 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-78992d97-6b1c-467d-b8f0-877badbdf5bd tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:19.650914 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-78992d97-6b1c-467d-b8f0-877badbdf5bd tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:19.651855 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-78992d97-6b1c-467d-b8f0-877badbdf5bd tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:19.652535 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-78992d97-6b1c-467d-b8f0-877badbdf5bd tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:19.653184 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-78992d97-6b1c-467d-b8f0-877badbdf5bd tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:19.741252 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.neutron [None req-6261419b-b39e-422c-93c0-45f2a7fa1ee6 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] validate_networks() for [('8ae7c3ad-a283-49a3-aeec-6720078b6d59', None, None, None, None, None), ('c4c1b728-bfcb-4f7a-a16a-fbe9e08dc4b6', None, None, None, None, None), ('8ae7c3ad-a283-49a3-aeec-6720078b6d59', None, None, None, None, None)] {{(pid=123001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:35:20.405506 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-78992d97-6b1c-467d-b8f0-877badbdf5bd tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81e50834114f0fa3cca4b0b9f8acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4650d613cb84018b92dc5d51486885e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:20.434005 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-78992d97-6b1c-467d-b8f0-877badbdf5bd tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] 10.222.0.20 "GET /compute/v2.1/servers/adc33804-eb64-40ca-a943-f2e74040c1b2" status: 200 len: 1321 microversion: 2.1 time: 0.803598 Oct 04 18:35:20.456627 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 998/1879] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:19 2022] GET /compute/v2.1/servers/adc33804-eb64-40ca-a943-f2e74040c1b2 => generated 1321 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:20.493509 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-7a48c4ee-638e-4ac0-b0c4-d3ebcf896993 req-ebae48f3-fb6f-4461-ab82-a3185823d646 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "158e9f52-fd16-48d1-87b5-e0dd523e97a4", "tag": "339801ef-bddd-45f8-802a-ec8d2e0687e7"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:20.509841 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-7a48c4ee-638e-4ac0-b0c4-d3ebcf896993 req-ebae48f3-fb6f-4461-ab82-a3185823d646 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:20.516734 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-7a48c4ee-638e-4ac0-b0c4-d3ebcf896993 req-ebae48f3-fb6f-4461-ab82-a3185823d646 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:20.519460 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-7a48c4ee-638e-4ac0-b0c4-d3ebcf896993 req-ebae48f3-fb6f-4461-ab82-a3185823d646 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:20.559218 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-7a48c4ee-638e-4ac0-b0c4-d3ebcf896993 req-ebae48f3-fb6f-4461-ab82-a3185823d646 service nova] Creating event network-changed:339801ef-bddd-45f8-802a-ec8d2e0687e7 for instance 158e9f52-fd16-48d1-87b5-e0dd523e97a4 on n-h1-850501-14 Oct 04 18:35:20.574287 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-7a48c4ee-638e-4ac0-b0c4-d3ebcf896993 req-ebae48f3-fb6f-4461-ab82-a3185823d646 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127404 Oct 04 18:35:20.575162 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 999/1880] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:35:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:35:20.600312 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-210d6e45-d190-4243-b68c-a9c9eb2ffd14 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:20.606992 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-210d6e45-d190-4243-b68c-a9c9eb2ffd14 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:20.608760 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-210d6e45-d190-4243-b68c-a9c9eb2ffd14 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:20.613413 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-210d6e45-d190-4243-b68c-a9c9eb2ffd14 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:20.614145 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-210d6e45-d190-4243-b68c-a9c9eb2ffd14 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:20.615091 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-210d6e45-d190-4243-b68c-a9c9eb2ffd14 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:20.615730 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-210d6e45-d190-4243-b68c-a9c9eb2ffd14 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:20.617179 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-210d6e45-d190-4243-b68c-a9c9eb2ffd14 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:20.772000 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-210d6e45-d190-4243-b68c-a9c9eb2ffd14 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:20.796635 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-210d6e45-d190-4243-b68c-a9c9eb2ffd14 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:20.802730 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-210d6e45-d190-4243-b68c-a9c9eb2ffd14 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:20.824885 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-210d6e45-d190-4243-b68c-a9c9eb2ffd14 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1553 microversion: 2.91 time: 0.247567 Oct 04 18:35:20.830577 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1000/1881] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:20 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1553 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:20.844410 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d9fe6b08-08d8-44bb-9ee3-4bbccfe2a5a5 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:20.845534 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d9fe6b08-08d8-44bb-9ee3-4bbccfe2a5a5 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 158e9f52-fd16-48d1-87b5-e0dd523e97a4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:20.867263 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d9fe6b08-08d8-44bb-9ee3-4bbccfe2a5a5 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:20.868186 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d9fe6b08-08d8-44bb-9ee3-4bbccfe2a5a5 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:20.868810 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d9fe6b08-08d8-44bb-9ee3-4bbccfe2a5a5 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:20.872097 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d9fe6b08-08d8-44bb-9ee3-4bbccfe2a5a5 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:20.875278 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d9fe6b08-08d8-44bb-9ee3-4bbccfe2a5a5 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:20.881738 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d9fe6b08-08d8-44bb-9ee3-4bbccfe2a5a5 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:20.927064 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=100 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:21.456981 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d9fe6b08-08d8-44bb-9ee3-4bbccfe2a5a5 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:21.476750 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d9fe6b08-08d8-44bb-9ee3-4bbccfe2a5a5 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4" status: 200 len: 1719 microversion: 2.1 time: 0.644120 Oct 04 18:35:21.496701 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1001/1882] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:20 2022] GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4 => generated 1719 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:21.518573 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2b670ffd-1db8-45eb-bff5-a317532e9519 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:21.519384 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2b670ffd-1db8-45eb-bff5-a317532e9519 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2fe6c508-f183-40bd-bfd5-23c757e99a05] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:21.544119 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2b670ffd-1db8-45eb-bff5-a317532e9519 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:21.552936 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2b670ffd-1db8-45eb-bff5-a317532e9519 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:21.552936 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2b670ffd-1db8-45eb-bff5-a317532e9519 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:21.552936 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2b670ffd-1db8-45eb-bff5-a317532e9519 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:21.552936 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2b670ffd-1db8-45eb-bff5-a317532e9519 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:21.552936 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2b670ffd-1db8-45eb-bff5-a317532e9519 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:22.714726 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2b670ffd-1db8-45eb-bff5-a317532e9519 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:22.728176 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2b670ffd-1db8-45eb-bff5-a317532e9519 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05" status: 200 len: 1474 microversion: 2.1 time: 1.228602 Oct 04 18:35:22.734342 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1002/1883] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:21 2022] GET /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05 => generated 1474 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:22.740308 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-639c242f-9f23-4cd3-912b-f9121b392b24 req-076c3b82-e46e-40bb-bd93-91ca66d2948a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3a29732-fa0a-4dfd-8475-0f43e9bb0846", "name": "network-vif-plugged", "status": "completed", "tag": "fba0321b-163f-45c1-8bb6-a7e8f98924cc"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:22.778097 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-639c242f-9f23-4cd3-912b-f9121b392b24 req-076c3b82-e46e-40bb-bd93-91ca66d2948a service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:22.778916 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-639c242f-9f23-4cd3-912b-f9121b392b24 req-076c3b82-e46e-40bb-bd93-91ca66d2948a service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:22.779544 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-639c242f-9f23-4cd3-912b-f9121b392b24 req-076c3b82-e46e-40bb-bd93-91ca66d2948a service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:22.807776 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-639c242f-9f23-4cd3-912b-f9121b392b24 req-076c3b82-e46e-40bb-bd93-91ca66d2948a service nova] Creating event network-vif-plugged:fba0321b-163f-45c1-8bb6-a7e8f98924cc for instance c3a29732-fa0a-4dfd-8475-0f43e9bb0846 on n-h1-850501-14 Oct 04 18:35:22.818127 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-639c242f-9f23-4cd3-912b-f9121b392b24 req-076c3b82-e46e-40bb-bd93-91ca66d2948a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082252 Oct 04 18:35:22.822135 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1003/1884] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:35:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:35:22.823819 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-6261419b-b39e-422c-93c0-45f2a7fa1ee6 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:35:22.824379 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-6261419b-b39e-422c-93c0-45f2a7fa1ee6 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:35:22.824800 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-6261419b-b39e-422c-93c0-45f2a7fa1ee6 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:35:22.825210 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-6261419b-b39e-422c-93c0-45f2a7fa1ee6 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:35:22.825623 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-6261419b-b39e-422c-93c0-45f2a7fa1ee6 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:35:22.829476 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d180591c-2bc9-4210-b887-5790ec2402ed tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:22.831466 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d180591c-2bc9-4210-b887-5790ec2402ed tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: 0fa89d74-e5c4-461c-adcc-6c29ce9ad8db] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:22.841928 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d180591c-2bc9-4210-b887-5790ec2402ed tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:22.844354 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6261419b-b39e-422c-93c0-45f2a7fa1ee6 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:22.844853 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6261419b-b39e-422c-93c0-45f2a7fa1ee6 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:22.845285 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6261419b-b39e-422c-93c0-45f2a7fa1ee6 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:22.846137 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6261419b-b39e-422c-93c0-45f2a7fa1ee6 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:22.846594 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6261419b-b39e-422c-93c0-45f2a7fa1ee6 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:22.847050 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6261419b-b39e-422c-93c0-45f2a7fa1ee6 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:22.851048 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d180591c-2bc9-4210-b887-5790ec2402ed tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:22.858806 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d180591c-2bc9-4210-b887-5790ec2402ed tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:22.862053 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d180591c-2bc9-4210-b887-5790ec2402ed tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:22.862803 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d180591c-2bc9-4210-b887-5790ec2402ed tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:22.863416 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d180591c-2bc9-4210-b887-5790ec2402ed tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:22.918845 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d180591c-2bc9-4210-b887-5790ec2402ed tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: 0fa89d74-e5c4-461c-adcc-6c29ce9ad8db] Going to try to terminate instance {{(pid=123002) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:35:22.923038 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-6261419b-b39e-422c-93c0-45f2a7fa1ee6 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Getting quotas for project c3242afeef424d588cf102a2f0f38020. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:35:22.940831 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-6261419b-b39e-422c-93c0-45f2a7fa1ee6 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Getting quotas for user acb44381220d43b7bdfa744a1dc410a8 and project c3242afeef424d588cf102a2f0f38020. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:35:22.973453 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6261419b-b39e-422c-93c0-45f2a7fa1ee6 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Going to run 1 instances... {{(pid=123001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:35:22.982586 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6261419b-b39e-422c-93c0-45f2a7fa1ee6 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] [instance: 4fbde026-7d69-4924-97e6-28262d00e5db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:35:23.216981 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6261419b-b39e-422c-93c0-45f2a7fa1ee6 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.673847 Oct 04 18:35:23.236908 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 882/1885] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:35:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 5707 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:35:23.263294 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0d083eef-d4a5-41a8-9b05-37fa2fe8e272 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:23.264095 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0d083eef-d4a5-41a8-9b05-37fa2fe8e272 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] [instance: adc33804-eb64-40ca-a943-f2e74040c1b2] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:23.290679 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0d083eef-d4a5-41a8-9b05-37fa2fe8e272 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:23.292190 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0d083eef-d4a5-41a8-9b05-37fa2fe8e272 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:23.292604 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0d083eef-d4a5-41a8-9b05-37fa2fe8e272 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:23.297549 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0d083eef-d4a5-41a8-9b05-37fa2fe8e272 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:23.300230 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0d083eef-d4a5-41a8-9b05-37fa2fe8e272 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:23.300834 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0d083eef-d4a5-41a8-9b05-37fa2fe8e272 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:23.394315 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d180591c-2bc9-4210-b887-5790ec2402ed tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0fa89d74-e5c4-461c-adcc-6c29ce9ad8db" status: 204 len: 0 microversion: 2.1 time: 0.568862 Oct 04 18:35:23.398814 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1004/1886] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:35:22 2022] DELETE /compute/v2.1/servers/0fa89d74-e5c4-461c-adcc-6c29ce9ad8db => generated 0 bytes in 572 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:35:23.406901 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ab588e30-4157-44f3-a836-8698d54ae6cd tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:23.406901 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ab588e30-4157-44f3-a836-8698d54ae6cd tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:23.424826 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ab588e30-4157-44f3-a836-8698d54ae6cd tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:23.425728 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ab588e30-4157-44f3-a836-8698d54ae6cd tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:23.429141 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ab588e30-4157-44f3-a836-8698d54ae6cd tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:23.429141 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ab588e30-4157-44f3-a836-8698d54ae6cd tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:23.429141 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ab588e30-4157-44f3-a836-8698d54ae6cd tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:23.429141 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ab588e30-4157-44f3-a836-8698d54ae6cd tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:23.967116 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0d083eef-d4a5-41a8-9b05-37fa2fe8e272 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81e50834114f0fa3cca4b0b9f8acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4650d613cb84018b92dc5d51486885e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:23.994232 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0d083eef-d4a5-41a8-9b05-37fa2fe8e272 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] 10.222.0.20 "GET /compute/v2.1/servers/adc33804-eb64-40ca-a943-f2e74040c1b2" status: 200 len: 1321 microversion: 2.1 time: 0.748713 Oct 04 18:35:23.995540 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 883/1887] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:23 2022] GET /compute/v2.1/servers/adc33804-eb64-40ca-a943-f2e74040c1b2 => generated 1321 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:24.008819 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ab588e30-4157-44f3-a836-8698d54ae6cd tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:24.010513 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-653d5917-8794-42a5-b1c6-f6de77ec45f5 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:24.011602 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-653d5917-8794-42a5-b1c6-f6de77ec45f5 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 158e9f52-fd16-48d1-87b5-e0dd523e97a4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:24.031357 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ab588e30-4157-44f3-a836-8698d54ae6cd tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:24.038259 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ab588e30-4157-44f3-a836-8698d54ae6cd tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:24.040306 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-653d5917-8794-42a5-b1c6-f6de77ec45f5 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:24.041033 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-653d5917-8794-42a5-b1c6-f6de77ec45f5 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:24.041676 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-653d5917-8794-42a5-b1c6-f6de77ec45f5 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:24.042595 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-653d5917-8794-42a5-b1c6-f6de77ec45f5 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:24.045835 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-653d5917-8794-42a5-b1c6-f6de77ec45f5 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:24.049641 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-653d5917-8794-42a5-b1c6-f6de77ec45f5 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:24.059078 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ab588e30-4157-44f3-a836-8698d54ae6cd tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1553 microversion: 2.91 time: 0.660295 Oct 04 18:35:24.062576 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1005/1888] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:23 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1553 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:24.079310 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-05f35794-e0a6-4682-9447-f6473e6f7701 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:24.088148 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-05f35794-e0a6-4682-9447-f6473e6f7701 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] [instance: 4fbde026-7d69-4924-97e6-28262d00e5db] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:24.316000 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-05f35794-e0a6-4682-9447-f6473e6f7701 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb44381220d43b7bdfa744a1dc410a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3242afeef424d588cf102a2f0f38020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:24.326717 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-05f35794-e0a6-4682-9447-f6473e6f7701 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] 10.222.0.20 "GET /compute/v2.1/servers/4fbde026-7d69-4924-97e6-28262d00e5db" status: 200 len: 1212 microversion: 2.1 time: 0.261389 Oct 04 18:35:24.328467 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1006/1889] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:24 2022] GET /compute/v2.1/servers/4fbde026-7d69-4924-97e6-28262d00e5db => generated 1212 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:24.342576 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0fe31d2e-6895-4531-9711-d0dc9d611a2b tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-145934993", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": [{"uuid": "d61331d4-8e69-4941-9497-adc08bbff779"}]}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:24.666077 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-653d5917-8794-42a5-b1c6-f6de77ec45f5 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:24.704653 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-653d5917-8794-42a5-b1c6-f6de77ec45f5 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4" status: 200 len: 1719 microversion: 2.1 time: 0.701507 Oct 04 18:35:24.707377 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 884/1890] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:23 2022] GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4 => generated 1719 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:24.755548 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-00197f12-deaa-4e71-80ff-3042d1c55b3d tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:24.764480 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-00197f12-deaa-4e71-80ff-3042d1c55b3d tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2fe6c508-f183-40bd-bfd5-23c757e99a05] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:24.775209 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-00197f12-deaa-4e71-80ff-3042d1c55b3d tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:24.776445 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-00197f12-deaa-4e71-80ff-3042d1c55b3d tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:24.780776 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-00197f12-deaa-4e71-80ff-3042d1c55b3d tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:24.783216 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-00197f12-deaa-4e71-80ff-3042d1c55b3d tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:24.784074 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-00197f12-deaa-4e71-80ff-3042d1c55b3d tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:24.788121 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-00197f12-deaa-4e71-80ff-3042d1c55b3d tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:25.645734 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-00197f12-deaa-4e71-80ff-3042d1c55b3d tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:25.655847 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-00197f12-deaa-4e71-80ff-3042d1c55b3d tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05" status: 200 len: 1471 microversion: 2.1 time: 0.926784 Oct 04 18:35:25.661427 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 885/1891] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:24 2022] GET /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05 => generated 1471 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:25.679479 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-20a64fad-9dad-4ec7-b76d-9bc44a997aec req-10396700-5cbf-4c48-8b4b-933d04811b96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fa89d74-e5c4-461c-adcc-6c29ce9ad8db", "name": "network-vif-unplugged", "status": "completed", "tag": "59347bf8-4a31-4a7c-ad79-7b1486886df8"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:25.711648 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-20a64fad-9dad-4ec7-b76d-9bc44a997aec req-10396700-5cbf-4c48-8b4b-933d04811b96 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:25.714185 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-20a64fad-9dad-4ec7-b76d-9bc44a997aec req-10396700-5cbf-4c48-8b4b-933d04811b96 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:25.717804 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-20a64fad-9dad-4ec7-b76d-9bc44a997aec req-10396700-5cbf-4c48-8b4b-933d04811b96 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:25.744974 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-20a64fad-9dad-4ec7-b76d-9bc44a997aec req-10396700-5cbf-4c48-8b4b-933d04811b96 service nova] Creating event network-vif-unplugged:59347bf8-4a31-4a7c-ad79-7b1486886df8 for instance 0fa89d74-e5c4-461c-adcc-6c29ce9ad8db on n-h1-850501-14 Oct 04 18:35:25.757475 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-20a64fad-9dad-4ec7-b76d-9bc44a997aec req-10396700-5cbf-4c48-8b4b-933d04811b96 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.094483 Oct 04 18:35:25.765612 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 886/1892] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:35:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:35:25.782451 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c4239015-c43c-45c6-a9d4-a41c22c5a8b0 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:25.784764 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c4239015-c43c-45c6-a9d4-a41c22c5a8b0 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] [instance: adc33804-eb64-40ca-a943-f2e74040c1b2] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:25.804207 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c4239015-c43c-45c6-a9d4-a41c22c5a8b0 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:25.805577 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c4239015-c43c-45c6-a9d4-a41c22c5a8b0 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:25.806073 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c4239015-c43c-45c6-a9d4-a41c22c5a8b0 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:25.806799 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c4239015-c43c-45c6-a9d4-a41c22c5a8b0 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:25.807556 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c4239015-c43c-45c6-a9d4-a41c22c5a8b0 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:25.807996 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c4239015-c43c-45c6-a9d4-a41c22c5a8b0 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:26.200557 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c4239015-c43c-45c6-a9d4-a41c22c5a8b0 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81e50834114f0fa3cca4b0b9f8acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4650d613cb84018b92dc5d51486885e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:26.210650 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c4239015-c43c-45c6-a9d4-a41c22c5a8b0 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] 10.222.0.20 "GET /compute/v2.1/servers/adc33804-eb64-40ca-a943-f2e74040c1b2" status: 200 len: 1321 microversion: 2.1 time: 0.443720 Oct 04 18:35:26.239778 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 887/1893] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:25 2022] GET /compute/v2.1/servers/adc33804-eb64-40ca-a943-f2e74040c1b2 => generated 1321 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:26.258181 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-78927ee3-2a77-4a50-ad20-f928acdaad87 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:26.258797 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-78927ee3-2a77-4a50-ad20-f928acdaad87 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:26.275622 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-78927ee3-2a77-4a50-ad20-f928acdaad87 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:26.276726 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-78927ee3-2a77-4a50-ad20-f928acdaad87 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:26.277426 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-78927ee3-2a77-4a50-ad20-f928acdaad87 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:26.278603 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-78927ee3-2a77-4a50-ad20-f928acdaad87 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:26.279261 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-78927ee3-2a77-4a50-ad20-f928acdaad87 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:26.279884 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-78927ee3-2a77-4a50-ad20-f928acdaad87 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:26.385857 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-78927ee3-2a77-4a50-ad20-f928acdaad87 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:26.398599 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-78927ee3-2a77-4a50-ad20-f928acdaad87 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:26.400360 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-78927ee3-2a77-4a50-ad20-f928acdaad87 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:26.408533 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-78927ee3-2a77-4a50-ad20-f928acdaad87 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1553 microversion: 2.91 time: 0.167244 Oct 04 18:35:26.410434 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 888/1894] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:26 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1553 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:26.419496 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-95152a09-3955-461d-a7a3-e6a22473aa7d tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:26.424141 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-95152a09-3955-461d-a7a3-e6a22473aa7d tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] [instance: 4fbde026-7d69-4924-97e6-28262d00e5db] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:26.445348 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-95152a09-3955-461d-a7a3-e6a22473aa7d tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:26.446135 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-95152a09-3955-461d-a7a3-e6a22473aa7d tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:26.447140 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-95152a09-3955-461d-a7a3-e6a22473aa7d tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:26.448256 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-95152a09-3955-461d-a7a3-e6a22473aa7d tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:26.448893 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-95152a09-3955-461d-a7a3-e6a22473aa7d tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:26.449487 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-95152a09-3955-461d-a7a3-e6a22473aa7d tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:26.629272 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-95152a09-3955-461d-a7a3-e6a22473aa7d tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb44381220d43b7bdfa744a1dc410a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3242afeef424d588cf102a2f0f38020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:26.644581 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-95152a09-3955-461d-a7a3-e6a22473aa7d tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] 10.222.0.20 "GET /compute/v2.1/servers/4fbde026-7d69-4924-97e6-28262d00e5db" status: 200 len: 1264 microversion: 2.1 time: 0.232443 Oct 04 18:35:26.645361 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 889/1895] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:26 2022] GET /compute/v2.1/servers/4fbde026-7d69-4924-97e6-28262d00e5db => generated 1264 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:26.663959 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1ee6ae45-171d-48fb-8581-a68c2768fc12 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:26.673533 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1ee6ae45-171d-48fb-8581-a68c2768fc12 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2fe6c508-f183-40bd-bfd5-23c757e99a05] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:26.702816 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1ee6ae45-171d-48fb-8581-a68c2768fc12 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:26.706014 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1ee6ae45-171d-48fb-8581-a68c2768fc12 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:26.706014 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1ee6ae45-171d-48fb-8581-a68c2768fc12 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:26.714887 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1ee6ae45-171d-48fb-8581-a68c2768fc12 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:26.734876 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1ee6ae45-171d-48fb-8581-a68c2768fc12 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:26.734876 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1ee6ae45-171d-48fb-8581-a68c2768fc12 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:27.802445 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1ee6ae45-171d-48fb-8581-a68c2768fc12 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "POST /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05/action" status: 204 len: 0 microversion: 2.1 time: 1.154998 Oct 04 18:35:27.805997 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 890/1896] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:35:26 2022] POST /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05/action => generated 0 bytes in 1158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:35:28.447617 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e5583447-6da1-4f4a-ad6f-4e84e0ce8edc tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:28.449319 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e5583447-6da1-4f4a-ad6f-4e84e0ce8edc tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 158e9f52-fd16-48d1-87b5-e0dd523e97a4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:28.485270 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e5583447-6da1-4f4a-ad6f-4e84e0ce8edc tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:28.488959 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e5583447-6da1-4f4a-ad6f-4e84e0ce8edc tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:28.488959 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e5583447-6da1-4f4a-ad6f-4e84e0ce8edc tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:28.494290 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e5583447-6da1-4f4a-ad6f-4e84e0ce8edc tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:28.495552 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e5583447-6da1-4f4a-ad6f-4e84e0ce8edc tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:28.499064 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e5583447-6da1-4f4a-ad6f-4e84e0ce8edc tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:28.836452 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e5583447-6da1-4f4a-ad6f-4e84e0ce8edc tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:28.848941 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e5583447-6da1-4f4a-ad6f-4e84e0ce8edc tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4" status: 200 len: 1719 microversion: 2.1 time: 1.041537 Oct 04 18:35:28.853137 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 891/1897] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:27 2022] GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4 => generated 1719 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:28.863388 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f839be8d-5be6-4800-88fc-d6920ff82b3a tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:28.863388 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f839be8d-5be6-4800-88fc-d6920ff82b3a tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] [instance: adc33804-eb64-40ca-a943-f2e74040c1b2] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:28.869805 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f839be8d-5be6-4800-88fc-d6920ff82b3a tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:28.870699 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f839be8d-5be6-4800-88fc-d6920ff82b3a tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:28.871327 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f839be8d-5be6-4800-88fc-d6920ff82b3a tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:28.872653 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f839be8d-5be6-4800-88fc-d6920ff82b3a tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:28.873305 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f839be8d-5be6-4800-88fc-d6920ff82b3a tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:28.883154 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f839be8d-5be6-4800-88fc-d6920ff82b3a tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:29.151813 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f839be8d-5be6-4800-88fc-d6920ff82b3a tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81e50834114f0fa3cca4b0b9f8acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4650d613cb84018b92dc5d51486885e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:29.165887 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f839be8d-5be6-4800-88fc-d6920ff82b3a tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] 10.222.0.20 "GET /compute/v2.1/servers/adc33804-eb64-40ca-a943-f2e74040c1b2" status: 200 len: 1321 microversion: 2.1 time: 0.310896 Oct 04 18:35:29.167103 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 892/1898] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:28 2022] GET /compute/v2.1/servers/adc33804-eb64-40ca-a943-f2e74040c1b2 => generated 1321 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:29.179808 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-aafaeb04-cacb-405f-af7b-07c36b8855d8 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:29.181770 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-aafaeb04-cacb-405f-af7b-07c36b8855d8 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:29.203050 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aafaeb04-cacb-405f-af7b-07c36b8855d8 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:29.203912 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aafaeb04-cacb-405f-af7b-07c36b8855d8 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:29.204412 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aafaeb04-cacb-405f-af7b-07c36b8855d8 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:29.205242 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aafaeb04-cacb-405f-af7b-07c36b8855d8 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:29.205712 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aafaeb04-cacb-405f-af7b-07c36b8855d8 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:29.213258 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aafaeb04-cacb-405f-af7b-07c36b8855d8 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:29.305402 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-aafaeb04-cacb-405f-af7b-07c36b8855d8 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:29.326141 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-aafaeb04-cacb-405f-af7b-07c36b8855d8 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:29.328234 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-aafaeb04-cacb-405f-af7b-07c36b8855d8 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:29.335779 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-aafaeb04-cacb-405f-af7b-07c36b8855d8 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1553 microversion: 2.91 time: 0.167336 Oct 04 18:35:29.337540 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 893/1899] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:29 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1553 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:29.343180 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-fe587342-272e-4b50-b06c-bc16d75cc6dd tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:29.344130 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-fe587342-272e-4b50-b06c-bc16d75cc6dd tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] [instance: 4fbde026-7d69-4924-97e6-28262d00e5db] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:29.351550 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fe587342-272e-4b50-b06c-bc16d75cc6dd tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:29.358127 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fe587342-272e-4b50-b06c-bc16d75cc6dd tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:29.362284 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fe587342-272e-4b50-b06c-bc16d75cc6dd tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:29.367812 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fe587342-272e-4b50-b06c-bc16d75cc6dd tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:29.369689 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fe587342-272e-4b50-b06c-bc16d75cc6dd tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:29.371952 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fe587342-272e-4b50-b06c-bc16d75cc6dd tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:29.512731 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-fe587342-272e-4b50-b06c-bc16d75cc6dd tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb44381220d43b7bdfa744a1dc410a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3242afeef424d588cf102a2f0f38020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:29.534922 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-fe587342-272e-4b50-b06c-bc16d75cc6dd tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] 10.222.0.20 "GET /compute/v2.1/servers/4fbde026-7d69-4924-97e6-28262d00e5db" status: 200 len: 1270 microversion: 2.1 time: 0.195680 Oct 04 18:35:29.539656 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 894/1900] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:29 2022] GET /compute/v2.1/servers/4fbde026-7d69-4924-97e6-28262d00e5db => generated 1270 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:29.541940 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-c38de23d-b7dd-4f3f-a1aa-ddc42f14a49a req-6f547f11-f107-4047-a05e-94b4249950f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4d49cb2-f2a4-481b-bdb4-bcdad0649bd2", "name": "network-vif-plugged", "status": "completed", "tag": "b7fdc86f-aa1a-42fc-9636-18ad6b5b67b6"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:29.554570 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-c38de23d-b7dd-4f3f-a1aa-ddc42f14a49a req-6f547f11-f107-4047-a05e-94b4249950f9 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:29.555246 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-c38de23d-b7dd-4f3f-a1aa-ddc42f14a49a req-6f547f11-f107-4047-a05e-94b4249950f9 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:29.556286 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-c38de23d-b7dd-4f3f-a1aa-ddc42f14a49a req-6f547f11-f107-4047-a05e-94b4249950f9 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:29.574754 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-c38de23d-b7dd-4f3f-a1aa-ddc42f14a49a req-6f547f11-f107-4047-a05e-94b4249950f9 service nova] Creating event network-vif-plugged:b7fdc86f-aa1a-42fc-9636-18ad6b5b67b6 for instance b4d49cb2-f2a4-481b-bdb4-bcdad0649bd2 on n-h2-850501-14 Oct 04 18:35:29.581721 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-c38de23d-b7dd-4f3f-a1aa-ddc42f14a49a req-6f547f11-f107-4047-a05e-94b4249950f9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044140 Oct 04 18:35:29.586230 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 895/1901] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:35:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:35:29.595008 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6fdbf781-08b1-4dbc-8499-c16236d8dc4e tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:29.597245 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6fdbf781-08b1-4dbc-8499-c16236d8dc4e tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2fe6c508-f183-40bd-bfd5-23c757e99a05] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:29.604418 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6fdbf781-08b1-4dbc-8499-c16236d8dc4e tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:29.604920 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6fdbf781-08b1-4dbc-8499-c16236d8dc4e tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:29.605367 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6fdbf781-08b1-4dbc-8499-c16236d8dc4e tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:29.606088 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6fdbf781-08b1-4dbc-8499-c16236d8dc4e tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:29.606551 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6fdbf781-08b1-4dbc-8499-c16236d8dc4e tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:29.606987 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6fdbf781-08b1-4dbc-8499-c16236d8dc4e tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:30.139462 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6fdbf781-08b1-4dbc-8499-c16236d8dc4e tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:30.156582 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6fdbf781-08b1-4dbc-8499-c16236d8dc4e tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05" status: 200 len: 1471 microversion: 2.1 time: 0.558828 Oct 04 18:35:30.159146 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 896/1902] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:29 2022] GET /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05 => generated 1471 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:30.164972 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-51a7ee83-2d5e-47e8-82a3-5b832443a529 req-20d5b188-42bc-47b6-8d2f-f5ab5d82d187 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fa89d74-e5c4-461c-adcc-6c29ce9ad8db", "name": "network-vif-deleted", "tag": "59347bf8-4a31-4a7c-ad79-7b1486886df8"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:30.203332 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-51a7ee83-2d5e-47e8-82a3-5b832443a529 req-20d5b188-42bc-47b6-8d2f-f5ab5d82d187 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:30.203898 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-51a7ee83-2d5e-47e8-82a3-5b832443a529 req-20d5b188-42bc-47b6-8d2f-f5ab5d82d187 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:30.204986 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-51a7ee83-2d5e-47e8-82a3-5b832443a529 req-20d5b188-42bc-47b6-8d2f-f5ab5d82d187 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:30.242328 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-51a7ee83-2d5e-47e8-82a3-5b832443a529 req-20d5b188-42bc-47b6-8d2f-f5ab5d82d187 service nova] Creating event network-vif-deleted:59347bf8-4a31-4a7c-ad79-7b1486886df8 for instance 0fa89d74-e5c4-461c-adcc-6c29ce9ad8db on n-h1-850501-14 Oct 04 18:35:30.257574 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-51a7ee83-2d5e-47e8-82a3-5b832443a529 req-20d5b188-42bc-47b6-8d2f-f5ab5d82d187 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096972 Oct 04 18:35:30.259998 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 897/1903] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:35:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:35:30.285226 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8933aa0c-f5fb-49fe-bb2b-00fe6b2f45ed tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:30.285226 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8933aa0c-f5fb-49fe-bb2b-00fe6b2f45ed tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 158e9f52-fd16-48d1-87b5-e0dd523e97a4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:30.322431 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8933aa0c-f5fb-49fe-bb2b-00fe6b2f45ed tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:30.322431 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8933aa0c-f5fb-49fe-bb2b-00fe6b2f45ed tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:30.322431 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8933aa0c-f5fb-49fe-bb2b-00fe6b2f45ed tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:30.322431 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8933aa0c-f5fb-49fe-bb2b-00fe6b2f45ed tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:30.322431 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8933aa0c-f5fb-49fe-bb2b-00fe6b2f45ed tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:30.322431 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8933aa0c-f5fb-49fe-bb2b-00fe6b2f45ed tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:30.729238 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8933aa0c-f5fb-49fe-bb2b-00fe6b2f45ed tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:30.745102 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8933aa0c-f5fb-49fe-bb2b-00fe6b2f45ed tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4" status: 200 len: 1719 microversion: 2.1 time: 0.485009 Oct 04 18:35:30.745898 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 898/1904] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:30 2022] GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4 => generated 1719 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:30.754118 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-36fff863-a3bc-44f8-af28-a923fc59ce76 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:30.755079 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-36fff863-a3bc-44f8-af28-a923fc59ce76 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] [instance: adc33804-eb64-40ca-a943-f2e74040c1b2] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:30.761734 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-36fff863-a3bc-44f8-af28-a923fc59ce76 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:30.764229 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-36fff863-a3bc-44f8-af28-a923fc59ce76 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:30.764229 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-36fff863-a3bc-44f8-af28-a923fc59ce76 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:30.764229 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-36fff863-a3bc-44f8-af28-a923fc59ce76 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:30.764229 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-36fff863-a3bc-44f8-af28-a923fc59ce76 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:30.765910 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-36fff863-a3bc-44f8-af28-a923fc59ce76 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:30.783219 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:31.053387 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-36fff863-a3bc-44f8-af28-a923fc59ce76 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81e50834114f0fa3cca4b0b9f8acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4650d613cb84018b92dc5d51486885e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:31.066287 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-36fff863-a3bc-44f8-af28-a923fc59ce76 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] 10.222.0.20 "GET /compute/v2.1/servers/adc33804-eb64-40ca-a943-f2e74040c1b2" status: 200 len: 1321 microversion: 2.1 time: 0.318641 Oct 04 18:35:31.066901 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 899/1905] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:30 2022] GET /compute/v2.1/servers/adc33804-eb64-40ca-a943-f2e74040c1b2 => generated 1321 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:31.088265 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5cfc7cc6-7f05-472b-a99a-9ee87d3b5015 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:31.089337 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5cfc7cc6-7f05-472b-a99a-9ee87d3b5015 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:31.107173 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5cfc7cc6-7f05-472b-a99a-9ee87d3b5015 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:31.107451 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5cfc7cc6-7f05-472b-a99a-9ee87d3b5015 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:31.107849 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5cfc7cc6-7f05-472b-a99a-9ee87d3b5015 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:31.113077 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5cfc7cc6-7f05-472b-a99a-9ee87d3b5015 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:31.113662 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5cfc7cc6-7f05-472b-a99a-9ee87d3b5015 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:31.114120 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5cfc7cc6-7f05-472b-a99a-9ee87d3b5015 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:31.254822 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5cfc7cc6-7f05-472b-a99a-9ee87d3b5015 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:31.300757 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5cfc7cc6-7f05-472b-a99a-9ee87d3b5015 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:31.309201 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5cfc7cc6-7f05-472b-a99a-9ee87d3b5015 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:31.339403 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5cfc7cc6-7f05-472b-a99a-9ee87d3b5015 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1553 microversion: 2.91 time: 0.257205 Oct 04 18:35:31.356980 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 900/1906] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:31 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1553 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:31.375796 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-97789fe0-7411-45f3-ae6e-3be8fd9c242e tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:31.378252 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-97789fe0-7411-45f3-ae6e-3be8fd9c242e tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] [instance: 4fbde026-7d69-4924-97e6-28262d00e5db] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:31.393096 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-97789fe0-7411-45f3-ae6e-3be8fd9c242e tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:31.394637 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-97789fe0-7411-45f3-ae6e-3be8fd9c242e tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:31.394637 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-97789fe0-7411-45f3-ae6e-3be8fd9c242e tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:31.395670 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-97789fe0-7411-45f3-ae6e-3be8fd9c242e tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:31.396396 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-97789fe0-7411-45f3-ae6e-3be8fd9c242e tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:31.397606 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-97789fe0-7411-45f3-ae6e-3be8fd9c242e tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:31.533073 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-97789fe0-7411-45f3-ae6e-3be8fd9c242e tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb44381220d43b7bdfa744a1dc410a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3242afeef424d588cf102a2f0f38020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:31.557958 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-97789fe0-7411-45f3-ae6e-3be8fd9c242e tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] 10.222.0.20 "GET /compute/v2.1/servers/4fbde026-7d69-4924-97e6-28262d00e5db" status: 200 len: 1270 microversion: 2.1 time: 0.195560 Oct 04 18:35:31.559517 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 901/1907] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:31 2022] GET /compute/v2.1/servers/4fbde026-7d69-4924-97e6-28262d00e5db => generated 1270 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:31.565655 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-64bb5cf7-34a7-4406-b37c-636b8319b121 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:31.566141 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-64bb5cf7-34a7-4406-b37c-636b8319b121 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2fe6c508-f183-40bd-bfd5-23c757e99a05] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:31.572684 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-64bb5cf7-34a7-4406-b37c-636b8319b121 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:31.573167 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-64bb5cf7-34a7-4406-b37c-636b8319b121 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:31.573603 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-64bb5cf7-34a7-4406-b37c-636b8319b121 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:31.574321 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-64bb5cf7-34a7-4406-b37c-636b8319b121 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:31.574779 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-64bb5cf7-34a7-4406-b37c-636b8319b121 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:31.575212 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-64bb5cf7-34a7-4406-b37c-636b8319b121 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:31.915618 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-64bb5cf7-34a7-4406-b37c-636b8319b121 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:31.924554 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-64bb5cf7-34a7-4406-b37c-636b8319b121 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05" status: 200 len: 1471 microversion: 2.1 time: 0.363784 Oct 04 18:35:31.927648 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 902/1908] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:31 2022] GET /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05 => generated 1471 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:31.934914 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-f572e7e0-0fcd-47d5-b975-4fd8396bc0fc req-033b97f3-fe80-4bc2-bf20-3d9d63e795da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adc33804-eb64-40ca-a943-f2e74040c1b2", "name": "network-vif-plugged", "status": "completed", "tag": "ff04ab26-1f82-497a-9628-266b9352d2a5"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:31.956667 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-f572e7e0-0fcd-47d5-b975-4fd8396bc0fc req-033b97f3-fe80-4bc2-bf20-3d9d63e795da service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:31.957458 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-f572e7e0-0fcd-47d5-b975-4fd8396bc0fc req-033b97f3-fe80-4bc2-bf20-3d9d63e795da service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:31.967825 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-f572e7e0-0fcd-47d5-b975-4fd8396bc0fc req-033b97f3-fe80-4bc2-bf20-3d9d63e795da service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:31.986959 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-f572e7e0-0fcd-47d5-b975-4fd8396bc0fc req-033b97f3-fe80-4bc2-bf20-3d9d63e795da service nova] Creating event network-vif-plugged:ff04ab26-1f82-497a-9628-266b9352d2a5 for instance adc33804-eb64-40ca-a943-f2e74040c1b2 on n-h2-850501-14 Oct 04 18:35:32.008484 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-f572e7e0-0fcd-47d5-b975-4fd8396bc0fc req-033b97f3-fe80-4bc2-bf20-3d9d63e795da service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074646 Oct 04 18:35:32.013507 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 903/1909] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:35:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:35:32.050782 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-92121b5e-c2c3-4209-ac0a-e82650b84ccb tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:32.050782 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-92121b5e-c2c3-4209-ac0a-e82650b84ccb tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 158e9f52-fd16-48d1-87b5-e0dd523e97a4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:32.073972 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-92121b5e-c2c3-4209-ac0a-e82650b84ccb tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:32.078030 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-92121b5e-c2c3-4209-ac0a-e82650b84ccb tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:32.080396 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-92121b5e-c2c3-4209-ac0a-e82650b84ccb tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:32.081869 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-92121b5e-c2c3-4209-ac0a-e82650b84ccb tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:32.082996 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-92121b5e-c2c3-4209-ac0a-e82650b84ccb tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:32.084377 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-92121b5e-c2c3-4209-ac0a-e82650b84ccb tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:32.635975 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-92121b5e-c2c3-4209-ac0a-e82650b84ccb tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:32.661876 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-92121b5e-c2c3-4209-ac0a-e82650b84ccb tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4" status: 200 len: 1719 microversion: 2.1 time: 0.646408 Oct 04 18:35:32.673023 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 904/1910] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:32 2022] GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4 => generated 1719 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:32.710755 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1b8efac6-408f-4234-ba2d-99efa25a307f tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:32.711793 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1b8efac6-408f-4234-ba2d-99efa25a307f tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] [instance: adc33804-eb64-40ca-a943-f2e74040c1b2] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:32.721211 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1b8efac6-408f-4234-ba2d-99efa25a307f tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:32.722358 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1b8efac6-408f-4234-ba2d-99efa25a307f tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:32.723026 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1b8efac6-408f-4234-ba2d-99efa25a307f tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:32.723966 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1b8efac6-408f-4234-ba2d-99efa25a307f tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:32.724866 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1b8efac6-408f-4234-ba2d-99efa25a307f tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:32.733215 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1b8efac6-408f-4234-ba2d-99efa25a307f tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:32.872989 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:32.959048 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=6 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:33.049116 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1b8efac6-408f-4234-ba2d-99efa25a307f tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81e50834114f0fa3cca4b0b9f8acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4650d613cb84018b92dc5d51486885e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:33.071352 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1b8efac6-408f-4234-ba2d-99efa25a307f tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] 10.222.0.20 "GET /compute/v2.1/servers/adc33804-eb64-40ca-a943-f2e74040c1b2" status: 200 len: 1321 microversion: 2.1 time: 0.386411 Oct 04 18:35:33.072254 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 905/1911] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:32 2022] GET /compute/v2.1/servers/adc33804-eb64-40ca-a943-f2e74040c1b2 => generated 1321 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:33.195586 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8d3ba186-f696-4804-848a-144bb030a8bd tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-1844181520", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": [{"uuid": "88a60572-dcdc-4299-a14f-28695bf4c29f"}]}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:33.960266 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-0fe31d2e-6895-4531-9711-d0dc9d611a2b tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] validate_networks() for [('d61331d4-8e69-4941-9497-adc08bbff779', None, None, None, None, None)] {{(pid=123002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:35:33.981106 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.neutron [None req-8d3ba186-f696-4804-848a-144bb030a8bd tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] validate_networks() for [('88a60572-dcdc-4299-a14f-28695bf4c29f', None, None, None, None, None)] {{(pid=123001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:35:34.015289 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:34.320656 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:34.411868 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:34.840368 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-0fe31d2e-6895-4531-9711-d0dc9d611a2b tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:35:34.840791 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-0fe31d2e-6895-4531-9711-d0dc9d611a2b tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:35:34.841260 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-0fe31d2e-6895-4531-9711-d0dc9d611a2b tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:35:34.841695 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-0fe31d2e-6895-4531-9711-d0dc9d611a2b tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:35:34.842268 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-0fe31d2e-6895-4531-9711-d0dc9d611a2b tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:35:34.850914 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-8d3ba186-f696-4804-848a-144bb030a8bd tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:35:34.853453 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-8d3ba186-f696-4804-848a-144bb030a8bd tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:35:34.856214 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-8d3ba186-f696-4804-848a-144bb030a8bd tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:35:34.857234 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-8d3ba186-f696-4804-848a-144bb030a8bd tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:35:34.858669 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-8d3ba186-f696-4804-848a-144bb030a8bd tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:35:34.866715 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0fe31d2e-6895-4531-9711-d0dc9d611a2b tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:34.867702 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0fe31d2e-6895-4531-9711-d0dc9d611a2b tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:34.869592 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0fe31d2e-6895-4531-9711-d0dc9d611a2b tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:34.870550 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0fe31d2e-6895-4531-9711-d0dc9d611a2b tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:34.875545 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0fe31d2e-6895-4531-9711-d0dc9d611a2b tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:34.876127 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0fe31d2e-6895-4531-9711-d0dc9d611a2b tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:34.896924 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8d3ba186-f696-4804-848a-144bb030a8bd tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:34.899040 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8d3ba186-f696-4804-848a-144bb030a8bd tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:34.900960 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8d3ba186-f696-4804-848a-144bb030a8bd tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:34.905609 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8d3ba186-f696-4804-848a-144bb030a8bd tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:34.905609 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8d3ba186-f696-4804-848a-144bb030a8bd tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:34.905609 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8d3ba186-f696-4804-848a-144bb030a8bd tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:34.943440 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-0fe31d2e-6895-4531-9711-d0dc9d611a2b tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Getting quotas for project 08c83d7b68684daf8e67ba2361ad86c9. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:35:34.953825 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-0fe31d2e-6895-4531-9711-d0dc9d611a2b tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Getting quotas for user ef3c7ad35a05450496b6d1ff64f12b77 and project 08c83d7b68684daf8e67ba2361ad86c9. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:35:34.984201 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-8d3ba186-f696-4804-848a-144bb030a8bd tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Getting quotas for project cd4c8595d87e49aba075a9372572093a. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:35:34.992197 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0fe31d2e-6895-4531-9711-d0dc9d611a2b tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Going to run 1 instances... {{(pid=123002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:35:34.995164 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0fe31d2e-6895-4531-9711-d0dc9d611a2b tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: 600147f3-401d-4897-8ce1-0f536234c3fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:35:35.003713 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-8d3ba186-f696-4804-848a-144bb030a8bd tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Getting quotas for user faa52dda618b4da394932ec8e37ad065 and project cd4c8595d87e49aba075a9372572093a. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:35:35.049788 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8d3ba186-f696-4804-848a-144bb030a8bd tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Going to run 1 instances... {{(pid=123001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:35:35.058521 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8d3ba186-f696-4804-848a-144bb030a8bd tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] [instance: bfc2eb17-e0fe-4f59-974a-d35419f2093d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:35:35.256800 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0fe31d2e-6895-4531-9711-d0dc9d611a2b tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 10.926853 Oct 04 18:35:35.259162 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8d3ba186-f696-4804-848a-144bb030a8bd tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.184881 Oct 04 18:35:35.263661 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1007/1912] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:35:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 10934 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:35:35.271434 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 906/1913] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:35:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 2198 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:35:35.272073 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-fb1c0072-8b8b-4b3a-b005-22d4632e6f35 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:35.272744 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-fb1c0072-8b8b-4b3a-b005-22d4632e6f35 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:35.277465 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-69e31fb7-2824-42f3-b0d9-6aed2ef9c952 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:35.278129 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-69e31fb7-2824-42f3-b0d9-6aed2ef9c952 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] [instance: 4fbde026-7d69-4924-97e6-28262d00e5db] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:35.290701 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fb1c0072-8b8b-4b3a-b005-22d4632e6f35 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:35.291204 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fb1c0072-8b8b-4b3a-b005-22d4632e6f35 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:35.291644 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fb1c0072-8b8b-4b3a-b005-22d4632e6f35 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:35.295710 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fb1c0072-8b8b-4b3a-b005-22d4632e6f35 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:35.296220 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fb1c0072-8b8b-4b3a-b005-22d4632e6f35 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:35.296664 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fb1c0072-8b8b-4b3a-b005-22d4632e6f35 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:35.302690 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-69e31fb7-2824-42f3-b0d9-6aed2ef9c952 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:35.306573 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-69e31fb7-2824-42f3-b0d9-6aed2ef9c952 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:35.307943 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-69e31fb7-2824-42f3-b0d9-6aed2ef9c952 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:35.310816 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-69e31fb7-2824-42f3-b0d9-6aed2ef9c952 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:35.329068 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-69e31fb7-2824-42f3-b0d9-6aed2ef9c952 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:35.331205 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-69e31fb7-2824-42f3-b0d9-6aed2ef9c952 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:35.565044 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-fb1c0072-8b8b-4b3a-b005-22d4632e6f35 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:35.592408 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-fb1c0072-8b8b-4b3a-b005-22d4632e6f35 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:35.596262 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-fb1c0072-8b8b-4b3a-b005-22d4632e6f35 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:35.628158 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-fb1c0072-8b8b-4b3a-b005-22d4632e6f35 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1535 microversion: 2.91 time: 0.360880 Oct 04 18:35:35.628158 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1008/1914] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:35 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1535 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:35.641407 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-288bf755-cac9-4cee-afbb-a31d0e1b15bd tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:35.642057 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-288bf755-cac9-4cee-afbb-a31d0e1b15bd tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2fe6c508-f183-40bd-bfd5-23c757e99a05] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:35.668533 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-288bf755-cac9-4cee-afbb-a31d0e1b15bd tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:35.669027 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-288bf755-cac9-4cee-afbb-a31d0e1b15bd tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:35.677393 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-288bf755-cac9-4cee-afbb-a31d0e1b15bd tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:35.678228 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-288bf755-cac9-4cee-afbb-a31d0e1b15bd tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:35.678713 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-288bf755-cac9-4cee-afbb-a31d0e1b15bd tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:35.679148 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-288bf755-cac9-4cee-afbb-a31d0e1b15bd tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:36.041479 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-69e31fb7-2824-42f3-b0d9-6aed2ef9c952 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb44381220d43b7bdfa744a1dc410a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3242afeef424d588cf102a2f0f38020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:36.076701 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-69e31fb7-2824-42f3-b0d9-6aed2ef9c952 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] 10.222.0.20 "GET /compute/v2.1/servers/4fbde026-7d69-4924-97e6-28262d00e5db" status: 200 len: 1354 microversion: 2.1 time: 0.803808 Oct 04 18:35:36.080708 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 907/1915] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:35 2022] GET /compute/v2.1/servers/4fbde026-7d69-4924-97e6-28262d00e5db => generated 1354 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:36.090826 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-fe7822f2-ab5e-4b96-8218-a580f5310b21 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:36.094588 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-fe7822f2-ab5e-4b96-8218-a580f5310b21 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 158e9f52-fd16-48d1-87b5-e0dd523e97a4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:36.119119 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fe7822f2-ab5e-4b96-8218-a580f5310b21 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:36.120216 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fe7822f2-ab5e-4b96-8218-a580f5310b21 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:36.120865 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fe7822f2-ab5e-4b96-8218-a580f5310b21 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:36.124371 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fe7822f2-ab5e-4b96-8218-a580f5310b21 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:36.125120 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fe7822f2-ab5e-4b96-8218-a580f5310b21 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:36.125770 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fe7822f2-ab5e-4b96-8218-a580f5310b21 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:36.500580 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-288bf755-cac9-4cee-afbb-a31d0e1b15bd tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:36.519956 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-288bf755-cac9-4cee-afbb-a31d0e1b15bd tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05" status: 200 len: 1463 microversion: 2.1 time: 0.891647 Oct 04 18:35:36.525141 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1009/1916] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:35 2022] GET /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05 => generated 1463 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:36.535489 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-edddb397-b15f-4ccc-bc8a-30b9d2887019 req-395f90be-0b59-4475-8076-9baaa9793366 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fe6c508-f183-40bd-bfd5-23c757e99a05", "name": "network-vif-plugged", "status": "completed", "tag": "4ffbd68f-521b-46aa-9313-bc62980cacb6"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:36.570221 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-edddb397-b15f-4ccc-bc8a-30b9d2887019 req-395f90be-0b59-4475-8076-9baaa9793366 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:36.570792 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-edddb397-b15f-4ccc-bc8a-30b9d2887019 req-395f90be-0b59-4475-8076-9baaa9793366 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:36.571284 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-edddb397-b15f-4ccc-bc8a-30b9d2887019 req-395f90be-0b59-4475-8076-9baaa9793366 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:36.605709 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-edddb397-b15f-4ccc-bc8a-30b9d2887019 req-395f90be-0b59-4475-8076-9baaa9793366 service nova] Creating event network-vif-plugged:4ffbd68f-521b-46aa-9313-bc62980cacb6 for instance 2fe6c508-f183-40bd-bfd5-23c757e99a05 on n-h2-850501-14 Oct 04 18:35:36.617505 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-edddb397-b15f-4ccc-bc8a-30b9d2887019 req-395f90be-0b59-4475-8076-9baaa9793366 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090296 Oct 04 18:35:36.620084 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1010/1917] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:35:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:35:36.629911 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ea6272fb-ad32-49bf-b5bb-14b8f869aadb tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:36.629911 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ea6272fb-ad32-49bf-b5bb-14b8f869aadb tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] [instance: adc33804-eb64-40ca-a943-f2e74040c1b2] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:36.641762 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ea6272fb-ad32-49bf-b5bb-14b8f869aadb tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:36.644041 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ea6272fb-ad32-49bf-b5bb-14b8f869aadb tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:36.645037 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ea6272fb-ad32-49bf-b5bb-14b8f869aadb tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:36.647191 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ea6272fb-ad32-49bf-b5bb-14b8f869aadb tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:36.648099 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ea6272fb-ad32-49bf-b5bb-14b8f869aadb tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:36.652343 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ea6272fb-ad32-49bf-b5bb-14b8f869aadb tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:36.661881 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-fe7822f2-ab5e-4b96-8218-a580f5310b21 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:36.675677 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-fe7822f2-ab5e-4b96-8218-a580f5310b21 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4" status: 200 len: 1719 microversion: 2.1 time: 0.593076 Oct 04 18:35:36.693859 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 908/1918] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:36 2022] GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4 => generated 1719 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:36.707276 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e1feeaf4-7f77-441d-8b82-f6a0add802fa tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:36.707937 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e1feeaf4-7f77-441d-8b82-f6a0add802fa tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: 600147f3-401d-4897-8ce1-0f536234c3fa] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:36.858372 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e1feeaf4-7f77-441d-8b82-f6a0add802fa tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:36.894003 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e1feeaf4-7f77-441d-8b82-f6a0add802fa tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/600147f3-401d-4897-8ce1-0f536234c3fa" status: 200 len: 1207 microversion: 2.1 time: 0.195278 Oct 04 18:35:36.894949 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 909/1919] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:36 2022] GET /compute/v2.1/servers/600147f3-401d-4897-8ce1-0f536234c3fa => generated 1207 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:36.915435 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-340e151f-9132-48d1-93ba-155adaadecd9 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:36.916122 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-340e151f-9132-48d1-93ba-155adaadecd9 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] [instance: bfc2eb17-e0fe-4f59-974a-d35419f2093d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:37.100048 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ea6272fb-ad32-49bf-b5bb-14b8f869aadb tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81e50834114f0fa3cca4b0b9f8acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4650d613cb84018b92dc5d51486885e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:37.109723 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ea6272fb-ad32-49bf-b5bb-14b8f869aadb tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] 10.222.0.20 "GET /compute/v2.1/servers/adc33804-eb64-40ca-a943-f2e74040c1b2" status: 200 len: 1513 microversion: 2.1 time: 0.486819 Oct 04 18:35:37.136571 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1011/1920] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:36 2022] GET /compute/v2.1/servers/adc33804-eb64-40ca-a943-f2e74040c1b2 => generated 1513 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:37.144955 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-340e151f-9132-48d1-93ba-155adaadecd9 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa52dda618b4da394932ec8e37ad065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4c8595d87e49aba075a9372572093a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:37.147393 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-75fbb356-3d62-4b54-8888-32065c9d99a3 tempest-MigrationsAdminTest-1101631867 tempest-MigrationsAdminTest-1101631867-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:37.148241 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-75fbb356-3d62-4b54-8888-32065c9d99a3 tempest-MigrationsAdminTest-1101631867 tempest-MigrationsAdminTest-1101631867-project-admin] [instance: 2fe6c508-f183-40bd-bfd5-23c757e99a05] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:37.159039 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-75fbb356-3d62-4b54-8888-32065c9d99a3 tempest-MigrationsAdminTest-1101631867 tempest-MigrationsAdminTest-1101631867-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:37.159829 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-75fbb356-3d62-4b54-8888-32065c9d99a3 tempest-MigrationsAdminTest-1101631867 tempest-MigrationsAdminTest-1101631867-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:37.160078 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-340e151f-9132-48d1-93ba-155adaadecd9 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] 10.222.0.20 "GET /compute/v2.1/servers/bfc2eb17-e0fe-4f59-974a-d35419f2093d" status: 200 len: 1225 microversion: 2.1 time: 0.263959 Oct 04 18:35:37.176099 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-75fbb356-3d62-4b54-8888-32065c9d99a3 tempest-MigrationsAdminTest-1101631867 tempest-MigrationsAdminTest-1101631867-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:37.176826 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 910/1921] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:36 2022] GET /compute/v2.1/servers/bfc2eb17-e0fe-4f59-974a-d35419f2093d => generated 1225 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:37.183363 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-75fbb356-3d62-4b54-8888-32065c9d99a3 tempest-MigrationsAdminTest-1101631867 tempest-MigrationsAdminTest-1101631867-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:37.183363 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-75fbb356-3d62-4b54-8888-32065c9d99a3 tempest-MigrationsAdminTest-1101631867 tempest-MigrationsAdminTest-1101631867-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:37.183363 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-75fbb356-3d62-4b54-8888-32065c9d99a3 tempest-MigrationsAdminTest-1101631867 tempest-MigrationsAdminTest-1101631867-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:37.184111 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7524497c-909e-46ce-b5db-93997e5a196f tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:37.184736 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7524497c-909e-46ce-b5db-93997e5a196f tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:37.200305 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:37.219942 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7524497c-909e-46ce-b5db-93997e5a196f tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:37.223232 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7524497c-909e-46ce-b5db-93997e5a196f tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:37.223232 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7524497c-909e-46ce-b5db-93997e5a196f tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:37.223232 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7524497c-909e-46ce-b5db-93997e5a196f tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:37.223232 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7524497c-909e-46ce-b5db-93997e5a196f tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:37.233660 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7524497c-909e-46ce-b5db-93997e5a196f tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:37.430774 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7524497c-909e-46ce-b5db-93997e5a196f tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:37.453284 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7524497c-909e-46ce-b5db-93997e5a196f tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:37.458586 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7524497c-909e-46ce-b5db-93997e5a196f tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:37.467238 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-75fbb356-3d62-4b54-8888-32065c9d99a3 tempest-MigrationsAdminTest-1101631867 tempest-MigrationsAdminTest-1101631867-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05" status: 200 len: 1616 microversion: 2.1 time: 0.328172 Oct 04 18:35:37.467238 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1012/1922] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:37 2022] GET /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05 => generated 1616 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:37.479429 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7524497c-909e-46ce-b5db-93997e5a196f tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1535 microversion: 2.91 time: 0.303350 Oct 04 18:35:37.484627 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 911/1923] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:37 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1535 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:37.509613 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8dadfb60-bf91-4051-8190-6189209b7e4d tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:37.510025 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8dadfb60-bf91-4051-8190-6189209b7e4d tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] [instance: 4fbde026-7d69-4924-97e6-28262d00e5db] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:37.513407 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6c5103a3-5294-403e-aeb7-5027b4a75b86 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:37.515053 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6c5103a3-5294-403e-aeb7-5027b4a75b86 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] [instance: c3a29732-fa0a-4dfd-8475-0f43e9bb0846] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:37.535655 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6c5103a3-5294-403e-aeb7-5027b4a75b86 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:37.536236 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6c5103a3-5294-403e-aeb7-5027b4a75b86 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:37.536871 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8dadfb60-bf91-4051-8190-6189209b7e4d tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:37.539245 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6c5103a3-5294-403e-aeb7-5027b4a75b86 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:37.540272 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6c5103a3-5294-403e-aeb7-5027b4a75b86 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:37.540981 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8dadfb60-bf91-4051-8190-6189209b7e4d tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:37.541399 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6c5103a3-5294-403e-aeb7-5027b4a75b86 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:37.542007 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8dadfb60-bf91-4051-8190-6189209b7e4d tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:37.543004 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8dadfb60-bf91-4051-8190-6189209b7e4d tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:37.543881 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6c5103a3-5294-403e-aeb7-5027b4a75b86 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:37.544692 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8dadfb60-bf91-4051-8190-6189209b7e4d tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:37.547421 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8dadfb60-bf91-4051-8190-6189209b7e4d tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:37.905512 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8dadfb60-bf91-4051-8190-6189209b7e4d tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb44381220d43b7bdfa744a1dc410a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3242afeef424d588cf102a2f0f38020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:37.917001 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8dadfb60-bf91-4051-8190-6189209b7e4d tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] 10.222.0.20 "GET /compute/v2.1/servers/4fbde026-7d69-4924-97e6-28262d00e5db" status: 200 len: 1354 microversion: 2.1 time: 0.448836 Oct 04 18:35:37.917601 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1013/1924] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:37 2022] GET /compute/v2.1/servers/4fbde026-7d69-4924-97e6-28262d00e5db => generated 1354 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:37.938561 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-78c18c34-75d9-4b3d-9cc5-117fa1de1f8c tempest-MigrationsAdminTest-1101631867 tempest-MigrationsAdminTest-1101631867-project-admin] Calling method '.version_select at 0x7fe258a90e50>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:37.944172 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-78c18c34-75d9-4b3d-9cc5-117fa1de1f8c tempest-MigrationsAdminTest-1101631867 tempest-MigrationsAdminTest-1101631867-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:37.945034 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-78c18c34-75d9-4b3d-9cc5-117fa1de1f8c tempest-MigrationsAdminTest-1101631867 tempest-MigrationsAdminTest-1101631867-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:37.946744 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-78c18c34-75d9-4b3d-9cc5-117fa1de1f8c tempest-MigrationsAdminTest-1101631867 tempest-MigrationsAdminTest-1101631867-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:37.971430 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-78c18c34-75d9-4b3d-9cc5-117fa1de1f8c tempest-MigrationsAdminTest-1101631867 tempest-MigrationsAdminTest-1101631867-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 2739 microversion: 2.1 time: 0.036099 Oct 04 18:35:37.972578 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1014/1925] 10.222.0.20 () {58 vars in 1143 bytes} [Tue Oct 4 18:35:37 2022] GET /compute/v2.1/os-migrations => generated 2739 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:37.988853 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6c5103a3-5294-403e-aeb7-5027b4a75b86 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81e50834114f0fa3cca4b0b9f8acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4650d613cb84018b92dc5d51486885e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:37.999059 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6c5103a3-5294-403e-aeb7-5027b4a75b86 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] 10.222.0.20 "GET /compute/v2.1/servers/c3a29732-fa0a-4dfd-8475-0f43e9bb0846" status: 200 len: 1512 microversion: 2.1 time: 0.513159 Oct 04 18:35:37.999967 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 912/1926] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:37 2022] GET /compute/v2.1/servers/c3a29732-fa0a-4dfd-8475-0f43e9bb0846 => generated 1512 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:38.008652 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-917f272f-a836-4c0a-a51c-9f7dc29603a3 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:38.009725 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-917f272f-a836-4c0a-a51c-9f7dc29603a3 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: 600147f3-401d-4897-8ce1-0f536234c3fa] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:38.013585 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-af3bcf5e-7f92-43a0-9d53-5a5578b5f97a tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:38.019150 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-af3bcf5e-7f92-43a0-9d53-5a5578b5f97a tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 158e9f52-fd16-48d1-87b5-e0dd523e97a4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:38.039786 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-af3bcf5e-7f92-43a0-9d53-5a5578b5f97a tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:38.041374 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-af3bcf5e-7f92-43a0-9d53-5a5578b5f97a tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:38.041992 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-af3bcf5e-7f92-43a0-9d53-5a5578b5f97a tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:38.044776 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-af3bcf5e-7f92-43a0-9d53-5a5578b5f97a tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:38.044960 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-917f272f-a836-4c0a-a51c-9f7dc29603a3 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:38.049800 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-af3bcf5e-7f92-43a0-9d53-5a5578b5f97a tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:38.049800 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-af3bcf5e-7f92-43a0-9d53-5a5578b5f97a tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:38.050350 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-917f272f-a836-4c0a-a51c-9f7dc29603a3 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:38.051191 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-917f272f-a836-4c0a-a51c-9f7dc29603a3 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:38.052142 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-917f272f-a836-4c0a-a51c-9f7dc29603a3 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:38.055735 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-917f272f-a836-4c0a-a51c-9f7dc29603a3 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:38.056958 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-917f272f-a836-4c0a-a51c-9f7dc29603a3 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:38.229288 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-917f272f-a836-4c0a-a51c-9f7dc29603a3 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:38.242346 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-917f272f-a836-4c0a-a51c-9f7dc29603a3 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/600147f3-401d-4897-8ce1-0f536234c3fa" status: 200 len: 1203 microversion: 2.1 time: 0.240920 Oct 04 18:35:38.243284 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 913/1927] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:38 2022] GET /compute/v2.1/servers/600147f3-401d-4897-8ce1-0f536234c3fa => generated 1203 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:38.267486 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-74fc7283-7278-4c51-a7ea-e1d09cdf403b req-43e9301d-c865-4452-82eb-28ce5a306137 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fbde026-7d69-4924-97e6-28262d00e5db", "tag": "02a2cc69-90c5-45e4-b836-8c90afdd6218"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:38.278573 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-74fc7283-7278-4c51-a7ea-e1d09cdf403b req-43e9301d-c865-4452-82eb-28ce5a306137 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:38.279319 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-74fc7283-7278-4c51-a7ea-e1d09cdf403b req-43e9301d-c865-4452-82eb-28ce5a306137 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:38.279987 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-74fc7283-7278-4c51-a7ea-e1d09cdf403b req-43e9301d-c865-4452-82eb-28ce5a306137 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:38.302558 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-74fc7283-7278-4c51-a7ea-e1d09cdf403b req-43e9301d-c865-4452-82eb-28ce5a306137 service nova] Creating event network-changed:02a2cc69-90c5-45e4-b836-8c90afdd6218 for instance 4fbde026-7d69-4924-97e6-28262d00e5db on n-h1-850501-14 Oct 04 18:35:38.315079 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-74fc7283-7278-4c51-a7ea-e1d09cdf403b req-43e9301d-c865-4452-82eb-28ce5a306137 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065766 Oct 04 18:35:38.316807 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 914/1928] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:35:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:35:38.324184 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c52de4bf-e4f6-4e18-886e-d51fe671f920 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:38.325555 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c52de4bf-e4f6-4e18-886e-d51fe671f920 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] [instance: b4d49cb2-f2a4-481b-bdb4-bcdad0649bd2] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:38.335154 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c52de4bf-e4f6-4e18-886e-d51fe671f920 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:38.335920 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c52de4bf-e4f6-4e18-886e-d51fe671f920 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:38.336568 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c52de4bf-e4f6-4e18-886e-d51fe671f920 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:38.338078 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c52de4bf-e4f6-4e18-886e-d51fe671f920 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:38.338768 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c52de4bf-e4f6-4e18-886e-d51fe671f920 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:38.339431 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c52de4bf-e4f6-4e18-886e-d51fe671f920 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:38.367972 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-af3bcf5e-7f92-43a0-9d53-5a5578b5f97a tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:38.380524 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-af3bcf5e-7f92-43a0-9d53-5a5578b5f97a tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4" status: 200 len: 1719 microversion: 2.1 time: 0.393258 Oct 04 18:35:38.388693 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1015/1929] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:37 2022] GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4 => generated 1719 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:38.413800 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ee4d8e95-5ed9-4569-a4d5-d03cd9478cd1 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-287127198", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:38.524156 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-ee4d8e95-5ed9-4569-a4d5-d03cd9478cd1 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] validate_networks() for None {{(pid=123002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:35:38.742589 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c52de4bf-e4f6-4e18-886e-d51fe671f920 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81e50834114f0fa3cca4b0b9f8acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4650d613cb84018b92dc5d51486885e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:38.753396 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c52de4bf-e4f6-4e18-886e-d51fe671f920 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] 10.222.0.20 "GET /compute/v2.1/servers/b4d49cb2-f2a4-481b-bdb4-bcdad0649bd2" status: 200 len: 1512 microversion: 2.1 time: 0.434527 Oct 04 18:35:38.758750 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 915/1930] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:38 2022] GET /compute/v2.1/servers/b4d49cb2-f2a4-481b-bdb4-bcdad0649bd2 => generated 1512 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:38.776801 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e2969514-d063-48ba-bbaf-76f1f1fdbad6 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:38.779019 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e2969514-d063-48ba-bbaf-76f1f1fdbad6 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] [instance: bfc2eb17-e0fe-4f59-974a-d35419f2093d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:38.801131 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e2969514-d063-48ba-bbaf-76f1f1fdbad6 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:38.801260 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e2969514-d063-48ba-bbaf-76f1f1fdbad6 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:38.805338 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e2969514-d063-48ba-bbaf-76f1f1fdbad6 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:38.806799 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e2969514-d063-48ba-bbaf-76f1f1fdbad6 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:38.807726 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e2969514-d063-48ba-bbaf-76f1f1fdbad6 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:38.808269 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e2969514-d063-48ba-bbaf-76f1f1fdbad6 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:38.961861 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e2969514-d063-48ba-bbaf-76f1f1fdbad6 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa52dda618b4da394932ec8e37ad065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4c8595d87e49aba075a9372572093a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:38.985423 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e2969514-d063-48ba-bbaf-76f1f1fdbad6 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] 10.222.0.20 "GET /compute/v2.1/servers/bfc2eb17-e0fe-4f59-974a-d35419f2093d" status: 200 len: 1221 microversion: 2.1 time: 0.225119 Oct 04 18:35:38.986852 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 916/1931] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:38 2022] GET /compute/v2.1/servers/bfc2eb17-e0fe-4f59-974a-d35419f2093d => generated 1221 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:38.998247 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d7f5fda3-f97c-4337-b02a-1eeb0064afa9 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:39.000024 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d7f5fda3-f97c-4337-b02a-1eeb0064afa9 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:39.018054 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d7f5fda3-f97c-4337-b02a-1eeb0064afa9 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:39.018942 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d7f5fda3-f97c-4337-b02a-1eeb0064afa9 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:39.019595 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d7f5fda3-f97c-4337-b02a-1eeb0064afa9 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:39.031019 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d7f5fda3-f97c-4337-b02a-1eeb0064afa9 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:39.032486 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d7f5fda3-f97c-4337-b02a-1eeb0064afa9 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:39.035752 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d7f5fda3-f97c-4337-b02a-1eeb0064afa9 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:39.081426 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-ee4d8e95-5ed9-4569-a4d5-d03cd9478cd1 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:35:39.083273 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-ee4d8e95-5ed9-4569-a4d5-d03cd9478cd1 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:35:39.084021 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-ee4d8e95-5ed9-4569-a4d5-d03cd9478cd1 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:35:39.084712 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-ee4d8e95-5ed9-4569-a4d5-d03cd9478cd1 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:35:39.085544 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-ee4d8e95-5ed9-4569-a4d5-d03cd9478cd1 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:35:39.112792 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ee4d8e95-5ed9-4569-a4d5-d03cd9478cd1 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:39.114618 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ee4d8e95-5ed9-4569-a4d5-d03cd9478cd1 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:39.115488 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ee4d8e95-5ed9-4569-a4d5-d03cd9478cd1 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:39.117437 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ee4d8e95-5ed9-4569-a4d5-d03cd9478cd1 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:39.120355 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ee4d8e95-5ed9-4569-a4d5-d03cd9478cd1 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:39.121053 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ee4d8e95-5ed9-4569-a4d5-d03cd9478cd1 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:39.209240 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-ee4d8e95-5ed9-4569-a4d5-d03cd9478cd1 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Getting quotas for project 552ab59dabe840cb8582c54bedc49b09. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:35:39.222408 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-ee4d8e95-5ed9-4569-a4d5-d03cd9478cd1 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Getting quotas for user 9b05d1f8b9014e798926f9c496885a4d and project 552ab59dabe840cb8582c54bedc49b09. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:35:39.224023 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d7f5fda3-f97c-4337-b02a-1eeb0064afa9 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:39.241272 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ee4d8e95-5ed9-4569-a4d5-d03cd9478cd1 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Going to run 1 instances... {{(pid=123002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:35:39.243802 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d7f5fda3-f97c-4337-b02a-1eeb0064afa9 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:39.245977 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ee4d8e95-5ed9-4569-a4d5-d03cd9478cd1 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 3ead1560-9c23-48ad-a938-6b3179b70035] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:35:39.249837 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d7f5fda3-f97c-4337-b02a-1eeb0064afa9 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:39.263408 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d7f5fda3-f97c-4337-b02a-1eeb0064afa9 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1538 microversion: 2.91 time: 0.273786 Oct 04 18:35:39.269956 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 917/1932] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:38 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1538 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:39.285345 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-25731e61-00c4-4e88-a3dc-06b0156691ae tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:39.291704 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-25731e61-00c4-4e88-a3dc-06b0156691ae tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6a81e50834114f0fa3cca4b0b9f8acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4650d613cb84018b92dc5d51486885e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:39.292888 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-25731e61-00c4-4e88-a3dc-06b0156691ae tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'd4650d613cb84018b92dc5d51486885e'} {{(pid=123001) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:35:39.360005 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-25731e61-00c4-4e88-a3dc-06b0156691ae tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:39.361635 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-25731e61-00c4-4e88-a3dc-06b0156691ae tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:39.362329 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-25731e61-00c4-4e88-a3dc-06b0156691ae tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:39.363383 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-25731e61-00c4-4e88-a3dc-06b0156691ae tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:39.364183 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-25731e61-00c4-4e88-a3dc-06b0156691ae tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:39.365330 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-25731e61-00c4-4e88-a3dc-06b0156691ae tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:39.453212 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ee4d8e95-5ed9-4569-a4d5-d03cd9478cd1 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.063032 Oct 04 18:35:39.458952 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1016/1933] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:35:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1069 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:35:39.469599 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7dc318d4-59a9-4005-8378-0c95ebe3c610 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:39.471839 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7dc318d4-59a9-4005-8378-0c95ebe3c610 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] [instance: 4fbde026-7d69-4924-97e6-28262d00e5db] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:39.487670 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7dc318d4-59a9-4005-8378-0c95ebe3c610 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:39.488465 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7dc318d4-59a9-4005-8378-0c95ebe3c610 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:39.489115 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7dc318d4-59a9-4005-8378-0c95ebe3c610 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:39.490133 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7dc318d4-59a9-4005-8378-0c95ebe3c610 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:39.490827 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7dc318d4-59a9-4005-8378-0c95ebe3c610 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:39.492341 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7dc318d4-59a9-4005-8378-0c95ebe3c610 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:39.545447 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.multi_cell_list [None req-25731e61-00c4-4e88-a3dc-06b0156691ae tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123001) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:35:39.771717 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-25731e61-00c4-4e88-a3dc-06b0156691ae tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81e50834114f0fa3cca4b0b9f8acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4650d613cb84018b92dc5d51486885e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:39.787047 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7dc318d4-59a9-4005-8378-0c95ebe3c610 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb44381220d43b7bdfa744a1dc410a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3242afeef424d588cf102a2f0f38020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:39.797565 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-25731e61-00c4-4e88-a3dc-06b0156691ae tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:39.797565 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-25731e61-00c4-4e88-a3dc-06b0156691ae tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:39.797565 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-25731e61-00c4-4e88-a3dc-06b0156691ae tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:39.800482 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7dc318d4-59a9-4005-8378-0c95ebe3c610 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] 10.222.0.20 "GET /compute/v2.1/servers/4fbde026-7d69-4924-97e6-28262d00e5db" status: 200 len: 1354 microversion: 2.1 time: 0.339086 Oct 04 18:35:39.801606 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1017/1934] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:39 2022] GET /compute/v2.1/servers/4fbde026-7d69-4924-97e6-28262d00e5db => generated 1354 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:39.807962 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6ccf8776-2f85-45b4-af4c-6904b4b0fcde tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:39.808806 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-6ccf8776-2f85-45b4-af4c-6904b4b0fcde tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: 600147f3-401d-4897-8ce1-0f536234c3fa] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:39.821964 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6ccf8776-2f85-45b4-af4c-6904b4b0fcde tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:39.822778 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6ccf8776-2f85-45b4-af4c-6904b4b0fcde tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:39.826353 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6ccf8776-2f85-45b4-af4c-6904b4b0fcde tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:39.827111 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6ccf8776-2f85-45b4-af4c-6904b4b0fcde tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:39.827766 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6ccf8776-2f85-45b4-af4c-6904b4b0fcde tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:39.828354 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6ccf8776-2f85-45b4-af4c-6904b4b0fcde tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:40.038875 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-6ccf8776-2f85-45b4-af4c-6904b4b0fcde tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:40.062312 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6ccf8776-2f85-45b4-af4c-6904b4b0fcde tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/600147f3-401d-4897-8ce1-0f536234c3fa" status: 200 len: 1267 microversion: 2.1 time: 0.259276 Oct 04 18:35:40.063237 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1018/1935] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:39 2022] GET /compute/v2.1/servers/600147f3-401d-4897-8ce1-0f536234c3fa => generated 1267 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:40.080869 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2238cf25-8fc4-4184-afae-58b0a42c853c tempest-UnshelveToHostMultiNodesTest-409522397 tempest-UnshelveToHostMultiNodesTest-409522397-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h1-850501-14"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:40.089589 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2238cf25-8fc4-4184-afae-58b0a42c853c tempest-UnshelveToHostMultiNodesTest-409522397 tempest-UnshelveToHostMultiNodesTest-409522397-project-admin] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:40.104507 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2238cf25-8fc4-4184-afae-58b0a42c853c tempest-UnshelveToHostMultiNodesTest-409522397 tempest-UnshelveToHostMultiNodesTest-409522397-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:40.105232 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2238cf25-8fc4-4184-afae-58b0a42c853c tempest-UnshelveToHostMultiNodesTest-409522397 tempest-UnshelveToHostMultiNodesTest-409522397-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:40.106320 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2238cf25-8fc4-4184-afae-58b0a42c853c tempest-UnshelveToHostMultiNodesTest-409522397 tempest-UnshelveToHostMultiNodesTest-409522397-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:40.107592 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2238cf25-8fc4-4184-afae-58b0a42c853c tempest-UnshelveToHostMultiNodesTest-409522397 tempest-UnshelveToHostMultiNodesTest-409522397-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:40.108145 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2238cf25-8fc4-4184-afae-58b0a42c853c tempest-UnshelveToHostMultiNodesTest-409522397 tempest-UnshelveToHostMultiNodesTest-409522397-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:40.108573 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2238cf25-8fc4-4184-afae-58b0a42c853c tempest-UnshelveToHostMultiNodesTest-409522397 tempest-UnshelveToHostMultiNodesTest-409522397-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:40.135158 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-25731e61-00c4-4e88-a3dc-06b0156691ae tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] 10.222.0.20 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1516 microversion: 2.1 time: 0.863154 Oct 04 18:35:40.135896 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 918/1936] 10.222.0.20 () {58 vars in 1167 bytes} [Tue Oct 4 18:35:39 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1516 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:40.156318 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-35a535a7-9428-4fc1-9aab-955e74610b43 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:40.157169 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-35a535a7-9428-4fc1-9aab-955e74610b43 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 158e9f52-fd16-48d1-87b5-e0dd523e97a4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:40.164707 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-35a535a7-9428-4fc1-9aab-955e74610b43 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:40.165194 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-35a535a7-9428-4fc1-9aab-955e74610b43 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:40.170153 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-35a535a7-9428-4fc1-9aab-955e74610b43 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:40.170153 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-35a535a7-9428-4fc1-9aab-955e74610b43 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:40.170153 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-35a535a7-9428-4fc1-9aab-955e74610b43 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:40.170153 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-35a535a7-9428-4fc1-9aab-955e74610b43 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:40.171885 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=100 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:40.210595 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2238cf25-8fc4-4184-afae-58b0a42c853c tempest-UnshelveToHostMultiNodesTest-409522397 tempest-UnshelveToHostMultiNodesTest-409522397-project-admin] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h1-850501-14". {{(pid=123002) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 18:35:40.331024 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-35a535a7-9428-4fc1-9aab-955e74610b43 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:40.342966 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-35a535a7-9428-4fc1-9aab-955e74610b43 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4" status: 200 len: 1719 microversion: 2.1 time: 0.205451 Oct 04 18:35:40.344760 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 919/1937] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:40 2022] GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4 => generated 1719 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:40.350187 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-16ae8233-45df-43f9-878b-051ccd4d38ca tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:40.351106 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-16ae8233-45df-43f9-878b-051ccd4d38ca tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 3ead1560-9c23-48ad-a938-6b3179b70035] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:40.429331 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-16ae8233-45df-43f9-878b-051ccd4d38ca tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:40.437244 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-16ae8233-45df-43f9-878b-051ccd4d38ca tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035" status: 200 len: 1212 microversion: 2.1 time: 0.090907 Oct 04 18:35:40.438504 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 920/1938] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:40 2022] GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035 => generated 1212 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:40.443702 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-dd601507-464a-4221-a24d-cf2f837669b3 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:40.444324 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-dd601507-464a-4221-a24d-cf2f837669b3 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] [instance: bfc2eb17-e0fe-4f59-974a-d35419f2093d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:40.450875 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dd601507-464a-4221-a24d-cf2f837669b3 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:40.451756 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dd601507-464a-4221-a24d-cf2f837669b3 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:40.452355 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dd601507-464a-4221-a24d-cf2f837669b3 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:40.453564 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dd601507-464a-4221-a24d-cf2f837669b3 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:40.454146 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dd601507-464a-4221-a24d-cf2f837669b3 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:40.455341 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dd601507-464a-4221-a24d-cf2f837669b3 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:40.546951 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-dd601507-464a-4221-a24d-cf2f837669b3 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa52dda618b4da394932ec8e37ad065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4c8595d87e49aba075a9372572093a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:40.562389 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2238cf25-8fc4-4184-afae-58b0a42c853c tempest-UnshelveToHostMultiNodesTest-409522397 tempest-UnshelveToHostMultiNodesTest-409522397-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9/action" status: 202 len: 0 microversion: 2.91 time: 0.497230 Oct 04 18:35:40.565870 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1019/1939] 10.222.0.20 () {62 vars in 1319 bytes} [Tue Oct 4 18:35:40 2022] POST /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9/action => generated 0 bytes in 502 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:35:40.572466 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-dd601507-464a-4221-a24d-cf2f837669b3 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] 10.222.0.20 "GET /compute/v2.1/servers/bfc2eb17-e0fe-4f59-974a-d35419f2093d" status: 200 len: 1277 microversion: 2.1 time: 0.132491 Oct 04 18:35:40.578928 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1cc8dc72-8e5e-47d7-a741-22bbd20d2de5 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:40.585860 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1cc8dc72-8e5e-47d7-a741-22bbd20d2de5 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6a81e50834114f0fa3cca4b0b9f8acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4650d613cb84018b92dc5d51486885e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:40.592202 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1cc8dc72-8e5e-47d7-a741-22bbd20d2de5 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1008228703', 'deleted': False, 'project_id': 'd4650d613cb84018b92dc5d51486885e'} {{(pid=123002) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:35:40.595818 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 921/1940] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:40 2022] GET /compute/v2.1/servers/bfc2eb17-e0fe-4f59-974a-d35419f2093d => generated 1277 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:40.603705 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f13df30b-a904-4701-8dac-6067d7ada67e tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:40.604832 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f13df30b-a904-4701-8dac-6067d7ada67e tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:40.612038 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1cc8dc72-8e5e-47d7-a741-22bbd20d2de5 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:40.613161 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1cc8dc72-8e5e-47d7-a741-22bbd20d2de5 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:40.615177 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f13df30b-a904-4701-8dac-6067d7ada67e tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:40.615177 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f13df30b-a904-4701-8dac-6067d7ada67e tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:40.615177 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f13df30b-a904-4701-8dac-6067d7ada67e tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:40.615545 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1cc8dc72-8e5e-47d7-a741-22bbd20d2de5 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:40.615704 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f13df30b-a904-4701-8dac-6067d7ada67e tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:40.615905 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f13df30b-a904-4701-8dac-6067d7ada67e tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:40.616667 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f13df30b-a904-4701-8dac-6067d7ada67e tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:40.617338 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1cc8dc72-8e5e-47d7-a741-22bbd20d2de5 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:40.617831 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1cc8dc72-8e5e-47d7-a741-22bbd20d2de5 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:40.621152 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1cc8dc72-8e5e-47d7-a741-22bbd20d2de5 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:40.743016 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f13df30b-a904-4701-8dac-6067d7ada67e tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:40.769656 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f13df30b-a904-4701-8dac-6067d7ada67e tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:40.776386 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f13df30b-a904-4701-8dac-6067d7ada67e tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:40.790373 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f13df30b-a904-4701-8dac-6067d7ada67e tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1486 microversion: 2.91 time: 0.191171 Oct 04 18:35:40.792230 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 922/1941] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:40 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1486 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:40.824914 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ec3a9d7d-c51e-47ec-97f4-c9291cddab0c tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:40.825242 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ec3a9d7d-c51e-47ec-97f4-c9291cddab0c tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] [instance: 4fbde026-7d69-4924-97e6-28262d00e5db] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:40.844069 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.multi_cell_list [None req-1cc8dc72-8e5e-47d7-a741-22bbd20d2de5 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123002) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:35:40.845627 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec3a9d7d-c51e-47ec-97f4-c9291cddab0c tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:40.847262 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec3a9d7d-c51e-47ec-97f4-c9291cddab0c tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:40.847747 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec3a9d7d-c51e-47ec-97f4-c9291cddab0c tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:40.848523 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec3a9d7d-c51e-47ec-97f4-c9291cddab0c tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:40.849010 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec3a9d7d-c51e-47ec-97f4-c9291cddab0c tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:40.849429 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec3a9d7d-c51e-47ec-97f4-c9291cddab0c tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:40.997931 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1cc8dc72-8e5e-47d7-a741-22bbd20d2de5 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81e50834114f0fa3cca4b0b9f8acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4650d613cb84018b92dc5d51486885e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:41.008639 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1cc8dc72-8e5e-47d7-a741-22bbd20d2de5 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:41.009152 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1cc8dc72-8e5e-47d7-a741-22bbd20d2de5 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:41.009624 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1cc8dc72-8e5e-47d7-a741-22bbd20d2de5 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:41.054451 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ec3a9d7d-c51e-47ec-97f4-c9291cddab0c tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb44381220d43b7bdfa744a1dc410a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3242afeef424d588cf102a2f0f38020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:41.068635 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ec3a9d7d-c51e-47ec-97f4-c9291cddab0c tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] 10.222.0.20 "GET /compute/v2.1/servers/4fbde026-7d69-4924-97e6-28262d00e5db" status: 200 len: 1354 microversion: 2.1 time: 0.248047 Oct 04 18:35:41.076840 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 923/1942] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:40 2022] GET /compute/v2.1/servers/4fbde026-7d69-4924-97e6-28262d00e5db => generated 1354 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:35:41.091789 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b45b9cf5-a21f-4475-8f4a-af80dd329474 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:41.092810 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b45b9cf5-a21f-4475-8f4a-af80dd329474 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: 600147f3-401d-4897-8ce1-0f536234c3fa] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:41.106584 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b45b9cf5-a21f-4475-8f4a-af80dd329474 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:41.107855 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b45b9cf5-a21f-4475-8f4a-af80dd329474 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:41.108334 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b45b9cf5-a21f-4475-8f4a-af80dd329474 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:41.109065 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b45b9cf5-a21f-4475-8f4a-af80dd329474 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:41.109528 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b45b9cf5-a21f-4475-8f4a-af80dd329474 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:41.109953 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b45b9cf5-a21f-4475-8f4a-af80dd329474 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:41.218588 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b45b9cf5-a21f-4475-8f4a-af80dd329474 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:41.233379 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b45b9cf5-a21f-4475-8f4a-af80dd329474 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/600147f3-401d-4897-8ce1-0f536234c3fa" status: 200 len: 1265 microversion: 2.1 time: 0.143620 Oct 04 18:35:41.256092 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 924/1943] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:41 2022] GET /compute/v2.1/servers/600147f3-401d-4897-8ce1-0f536234c3fa => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:41.261211 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1cc8dc72-8e5e-47d7-a741-22bbd20d2de5 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] 10.222.0.20 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1008228703" status: 200 len: 1515 microversion: 2.1 time: 0.692859 Oct 04 18:35:41.264143 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1020/1944] 10.222.0.20 () {58 vars in 1263 bytes} [Tue Oct 4 18:35:40 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1008228703 => generated 1515 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:41.287528 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-adaff23d-2fb4-41fa-9c85-ba76d3e9634e tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:41.305325 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-adaff23d-2fb4-41fa-9c85-ba76d3e9634e tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6a81e50834114f0fa3cca4b0b9f8acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4650d613cb84018b92dc5d51486885e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:41.306216 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-adaff23d-2fb4-41fa-9c85-ba76d3e9634e tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'd4650d613cb84018b92dc5d51486885e'} {{(pid=123001) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:35:41.322458 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-adaff23d-2fb4-41fa-9c85-ba76d3e9634e tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:41.322953 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-adaff23d-2fb4-41fa-9c85-ba76d3e9634e tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:41.323425 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-adaff23d-2fb4-41fa-9c85-ba76d3e9634e tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:41.326337 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-adaff23d-2fb4-41fa-9c85-ba76d3e9634e tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:41.327171 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-adaff23d-2fb4-41fa-9c85-ba76d3e9634e tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:41.327745 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-adaff23d-2fb4-41fa-9c85-ba76d3e9634e tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:41.368544 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5d86f988-a056-4c72-9885-6b889fe46fe6 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:41.369243 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5d86f988-a056-4c72-9885-6b889fe46fe6 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 158e9f52-fd16-48d1-87b5-e0dd523e97a4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:41.380424 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5d86f988-a056-4c72-9885-6b889fe46fe6 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:41.381171 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5d86f988-a056-4c72-9885-6b889fe46fe6 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:41.381630 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5d86f988-a056-4c72-9885-6b889fe46fe6 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:41.382343 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5d86f988-a056-4c72-9885-6b889fe46fe6 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:41.382804 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5d86f988-a056-4c72-9885-6b889fe46fe6 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:41.383260 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5d86f988-a056-4c72-9885-6b889fe46fe6 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:41.491220 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.multi_cell_list [None req-adaff23d-2fb4-41fa-9c85-ba76d3e9634e tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=123001) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:35:41.595464 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-adaff23d-2fb4-41fa-9c85-ba76d3e9634e tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81e50834114f0fa3cca4b0b9f8acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4650d613cb84018b92dc5d51486885e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:41.604883 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-adaff23d-2fb4-41fa-9c85-ba76d3e9634e tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:41.605373 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-adaff23d-2fb4-41fa-9c85-ba76d3e9634e tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:41.605812 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-adaff23d-2fb4-41fa-9c85-ba76d3e9634e tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:41.615408 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5d86f988-a056-4c72-9885-6b889fe46fe6 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:41.624831 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5d86f988-a056-4c72-9885-6b889fe46fe6 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4" status: 200 len: 1719 microversion: 2.1 time: 0.260320 Oct 04 18:35:41.640396 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1021/1945] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:41 2022] GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4 => generated 1719 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:41.640396 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5edcbedb-40d7-4311-af2d-a3be7c15e4ff tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:41.641783 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5edcbedb-40d7-4311-af2d-a3be7c15e4ff tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 3ead1560-9c23-48ad-a938-6b3179b70035] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:41.655290 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5edcbedb-40d7-4311-af2d-a3be7c15e4ff tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:41.656226 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5edcbedb-40d7-4311-af2d-a3be7c15e4ff tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:41.656807 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5edcbedb-40d7-4311-af2d-a3be7c15e4ff tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:41.658546 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5edcbedb-40d7-4311-af2d-a3be7c15e4ff tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:41.659148 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5edcbedb-40d7-4311-af2d-a3be7c15e4ff tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:41.659653 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5edcbedb-40d7-4311-af2d-a3be7c15e4ff tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:41.741036 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5edcbedb-40d7-4311-af2d-a3be7c15e4ff tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:41.765331 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5edcbedb-40d7-4311-af2d-a3be7c15e4ff tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035" status: 200 len: 1208 microversion: 2.1 time: 0.137125 Oct 04 18:35:41.766155 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1022/1946] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:41 2022] GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035 => generated 1208 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:41.775049 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-e29d9055-c229-4434-bcb9-7a452cb3061e req-eaadc8e1-7398-41aa-8110-81f2b0c164d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fbde026-7d69-4924-97e6-28262d00e5db", "tag": "93b066fb-3183-4276-b726-fe88bd826b24"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:41.787900 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-e29d9055-c229-4434-bcb9-7a452cb3061e req-eaadc8e1-7398-41aa-8110-81f2b0c164d5 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:41.788736 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-e29d9055-c229-4434-bcb9-7a452cb3061e req-eaadc8e1-7398-41aa-8110-81f2b0c164d5 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:41.789381 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-e29d9055-c229-4434-bcb9-7a452cb3061e req-eaadc8e1-7398-41aa-8110-81f2b0c164d5 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:41.803431 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-adaff23d-2fb4-41fa-9c85-ba76d3e9634e tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] 10.222.0.20 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4520 microversion: 2.1 time: 0.520524 Oct 04 18:35:41.804387 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 925/1947] 10.222.0.20 () {58 vars in 1173 bytes} [Tue Oct 4 18:35:41 2022] GET /compute/v2.1/servers/detail?status=active => generated 4520 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:41.806391 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-e29d9055-c229-4434-bcb9-7a452cb3061e req-eaadc8e1-7398-41aa-8110-81f2b0c164d5 service nova] Creating event network-changed:93b066fb-3183-4276-b726-fe88bd826b24 for instance 4fbde026-7d69-4924-97e6-28262d00e5db on n-h1-850501-14 Oct 04 18:35:41.809291 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e2ec9685-fd3f-404c-8b38-8b0261a70afc tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:41.809924 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e2ec9685-fd3f-404c-8b38-8b0261a70afc tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] [instance: bfc2eb17-e0fe-4f59-974a-d35419f2093d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:41.819258 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e2ec9685-fd3f-404c-8b38-8b0261a70afc tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:41.819258 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e2ec9685-fd3f-404c-8b38-8b0261a70afc tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:41.819635 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e2ec9685-fd3f-404c-8b38-8b0261a70afc tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:41.823160 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e2ec9685-fd3f-404c-8b38-8b0261a70afc tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:41.823160 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e2ec9685-fd3f-404c-8b38-8b0261a70afc tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:41.823160 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e2ec9685-fd3f-404c-8b38-8b0261a70afc tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:41.823440 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-e29d9055-c229-4434-bcb9-7a452cb3061e req-eaadc8e1-7398-41aa-8110-81f2b0c164d5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051582 Oct 04 18:35:41.823440 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1023/1948] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:35:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:35:41.852947 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-98c96c5f-983a-43b6-a165-c7b0adf4fc86 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:41.856239 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-98c96c5f-983a-43b6-a165-c7b0adf4fc86 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:41.875083 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-98c96c5f-983a-43b6-a165-c7b0adf4fc86 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:41.876528 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-98c96c5f-983a-43b6-a165-c7b0adf4fc86 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:41.883741 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-98c96c5f-983a-43b6-a165-c7b0adf4fc86 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:41.886881 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-98c96c5f-983a-43b6-a165-c7b0adf4fc86 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:41.891126 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-98c96c5f-983a-43b6-a165-c7b0adf4fc86 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:41.893171 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-98c96c5f-983a-43b6-a165-c7b0adf4fc86 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:41.981015 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e2ec9685-fd3f-404c-8b38-8b0261a70afc tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa52dda618b4da394932ec8e37ad065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4c8595d87e49aba075a9372572093a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:41.992222 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e2ec9685-fd3f-404c-8b38-8b0261a70afc tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] 10.222.0.20 "GET /compute/v2.1/servers/bfc2eb17-e0fe-4f59-974a-d35419f2093d" status: 200 len: 1283 microversion: 2.1 time: 0.186585 Oct 04 18:35:42.008086 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 926/1949] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:41 2022] GET /compute/v2.1/servers/bfc2eb17-e0fe-4f59-974a-d35419f2093d => generated 1283 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:42.012552 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b80b4c07-7adb-46df-9202-63aaea6a7ae6 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:42.018548 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b80b4c07-7adb-46df-9202-63aaea6a7ae6 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6a81e50834114f0fa3cca4b0b9f8acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4650d613cb84018b92dc5d51486885e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:42.018744 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.compute.servers [None req-b80b4c07-7adb-46df-9202-63aaea6a7ae6 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Removing options 'limit' from query {{(pid=123001) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 04 18:35:42.019361 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b80b4c07-7adb-46df-9202-63aaea6a7ae6 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Searching by: {'deleted': False, 'project_id': 'd4650d613cb84018b92dc5d51486885e'} {{(pid=123001) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:35:42.025784 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b80b4c07-7adb-46df-9202-63aaea6a7ae6 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:42.026270 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b80b4c07-7adb-46df-9202-63aaea6a7ae6 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:42.026707 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b80b4c07-7adb-46df-9202-63aaea6a7ae6 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:42.027441 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b80b4c07-7adb-46df-9202-63aaea6a7ae6 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:42.027899 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b80b4c07-7adb-46df-9202-63aaea6a7ae6 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:42.028355 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b80b4c07-7adb-46df-9202-63aaea6a7ae6 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:42.067821 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b80b4c07-7adb-46df-9202-63aaea6a7ae6 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81e50834114f0fa3cca4b0b9f8acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4650d613cb84018b92dc5d51486885e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:42.074464 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b80b4c07-7adb-46df-9202-63aaea6a7ae6 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:42.074952 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b80b4c07-7adb-46df-9202-63aaea6a7ae6 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:42.075581 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b80b4c07-7adb-46df-9202-63aaea6a7ae6 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:42.153827 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-98c96c5f-983a-43b6-a165-c7b0adf4fc86 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:42.181435 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:42.190532 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-98c96c5f-983a-43b6-a165-c7b0adf4fc86 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:42.193401 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-98c96c5f-983a-43b6-a165-c7b0adf4fc86 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:42.201930 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-98c96c5f-983a-43b6-a165-c7b0adf4fc86 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1486 microversion: 2.91 time: 0.377214 Oct 04 18:35:42.202774 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1024/1950] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:41 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1486 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:42.230934 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0eb8ad38-075c-4ec4-82be-c77ccf10f9b3 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:42.230934 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0eb8ad38-075c-4ec4-82be-c77ccf10f9b3 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] [instance: 4fbde026-7d69-4924-97e6-28262d00e5db] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:42.240525 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0eb8ad38-075c-4ec4-82be-c77ccf10f9b3 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:42.241106 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0eb8ad38-075c-4ec4-82be-c77ccf10f9b3 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:42.241660 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0eb8ad38-075c-4ec4-82be-c77ccf10f9b3 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:42.242529 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0eb8ad38-075c-4ec4-82be-c77ccf10f9b3 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:42.242935 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0eb8ad38-075c-4ec4-82be-c77ccf10f9b3 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:42.243366 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0eb8ad38-075c-4ec4-82be-c77ccf10f9b3 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:42.361451 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b80b4c07-7adb-46df-9202-63aaea6a7ae6 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] 10.222.0.20 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1662 microversion: 2.1 time: 0.363061 Oct 04 18:35:42.362056 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 927/1951] 10.222.0.20 () {58 vars in 1161 bytes} [Tue Oct 4 18:35:41 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1662 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:42.371794 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d69cf60f-d0db-4dea-91f2-e27530b9276d tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:42.372816 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d69cf60f-d0db-4dea-91f2-e27530b9276d tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: 600147f3-401d-4897-8ce1-0f536234c3fa] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:42.384991 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d69cf60f-d0db-4dea-91f2-e27530b9276d tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:42.385765 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d69cf60f-d0db-4dea-91f2-e27530b9276d tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:42.386546 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d69cf60f-d0db-4dea-91f2-e27530b9276d tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:42.387391 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d69cf60f-d0db-4dea-91f2-e27530b9276d tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:42.388234 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d69cf60f-d0db-4dea-91f2-e27530b9276d tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:42.388932 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d69cf60f-d0db-4dea-91f2-e27530b9276d tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:42.807150 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d69cf60f-d0db-4dea-91f2-e27530b9276d tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:42.827550 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d69cf60f-d0db-4dea-91f2-e27530b9276d tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/600147f3-401d-4897-8ce1-0f536234c3fa" status: 200 len: 1265 microversion: 2.1 time: 0.461845 Oct 04 18:35:42.852644 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 928/1952] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:42 2022] GET /compute/v2.1/servers/600147f3-401d-4897-8ce1-0f536234c3fa => generated 1265 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:42.852644 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-128f3795-1d51-482a-b307-ccb3f5d02bf3 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:42.852644 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-128f3795-1d51-482a-b307-ccb3f5d02bf3 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6a81e50834114f0fa3cca4b0b9f8acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4650d613cb84018b92dc5d51486885e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:42.852644 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-128f3795-1d51-482a-b307-ccb3f5d02bf3 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'd4650d613cb84018b92dc5d51486885e'} {{(pid=123001) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:35:42.852644 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-128f3795-1d51-482a-b307-ccb3f5d02bf3 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:42.852644 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-128f3795-1d51-482a-b307-ccb3f5d02bf3 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:42.852644 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-128f3795-1d51-482a-b307-ccb3f5d02bf3 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:42.857706 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-128f3795-1d51-482a-b307-ccb3f5d02bf3 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:42.858756 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-128f3795-1d51-482a-b307-ccb3f5d02bf3 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:42.859739 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-128f3795-1d51-482a-b307-ccb3f5d02bf3 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:43.010928 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0eb8ad38-075c-4ec4-82be-c77ccf10f9b3 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb44381220d43b7bdfa744a1dc410a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3242afeef424d588cf102a2f0f38020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:43.013593 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.multi_cell_list [None req-128f3795-1d51-482a-b307-ccb3f5d02bf3 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=123001) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:35:43.025916 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0eb8ad38-075c-4ec4-82be-c77ccf10f9b3 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] 10.222.0.20 "GET /compute/v2.1/servers/4fbde026-7d69-4924-97e6-28262d00e5db" status: 200 len: 1354 microversion: 2.1 time: 0.811888 Oct 04 18:35:43.040085 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1025/1953] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:42 2022] GET /compute/v2.1/servers/4fbde026-7d69-4924-97e6-28262d00e5db => generated 1354 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:43.040085 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5cd5e397-98b7-4919-979c-34945f5bee46 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:43.040085 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5cd5e397-98b7-4919-979c-34945f5bee46 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 158e9f52-fd16-48d1-87b5-e0dd523e97a4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:43.049622 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5cd5e397-98b7-4919-979c-34945f5bee46 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:43.050224 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5cd5e397-98b7-4919-979c-34945f5bee46 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:43.050742 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5cd5e397-98b7-4919-979c-34945f5bee46 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:43.051600 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5cd5e397-98b7-4919-979c-34945f5bee46 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:43.052682 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5cd5e397-98b7-4919-979c-34945f5bee46 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:43.053519 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5cd5e397-98b7-4919-979c-34945f5bee46 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:43.121018 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-128f3795-1d51-482a-b307-ccb3f5d02bf3 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] 10.222.0.20 "GET /compute/v2.1/servers?status=active" status: 200 len: 1012 microversion: 2.1 time: 0.289037 Oct 04 18:35:43.121779 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 929/1954] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Oct 4 18:35:42 2022] GET /compute/v2.1/servers?status=active => generated 1012 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:43.127047 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b430431c-8d2f-4847-af6b-f3ee4e4caf02 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:43.127756 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b430431c-8d2f-4847-af6b-f3ee4e4caf02 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 3ead1560-9c23-48ad-a938-6b3179b70035] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:43.134584 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b430431c-8d2f-4847-af6b-f3ee4e4caf02 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:43.135198 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b430431c-8d2f-4847-af6b-f3ee4e4caf02 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:43.135642 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b430431c-8d2f-4847-af6b-f3ee4e4caf02 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:43.136432 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b430431c-8d2f-4847-af6b-f3ee4e4caf02 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:43.136891 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b430431c-8d2f-4847-af6b-f3ee4e4caf02 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:43.137608 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b430431c-8d2f-4847-af6b-f3ee4e4caf02 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:43.262744 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b430431c-8d2f-4847-af6b-f3ee4e4caf02 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:43.276657 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b430431c-8d2f-4847-af6b-f3ee4e4caf02 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035" status: 200 len: 1264 microversion: 2.1 time: 0.153733 Oct 04 18:35:43.293215 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 930/1955] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:43 2022] GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035 => generated 1264 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:43.300450 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d7226dc1-ac9e-49ae-b0b3-799373ea1005 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:43.301390 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d7226dc1-ac9e-49ae-b0b3-799373ea1005 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] [instance: bfc2eb17-e0fe-4f59-974a-d35419f2093d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:43.314232 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d7226dc1-ac9e-49ae-b0b3-799373ea1005 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:43.315882 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d7226dc1-ac9e-49ae-b0b3-799373ea1005 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:43.316658 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d7226dc1-ac9e-49ae-b0b3-799373ea1005 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:43.317660 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d7226dc1-ac9e-49ae-b0b3-799373ea1005 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:43.318362 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d7226dc1-ac9e-49ae-b0b3-799373ea1005 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:43.319046 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d7226dc1-ac9e-49ae-b0b3-799373ea1005 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:43.681979 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5cd5e397-98b7-4919-979c-34945f5bee46 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:43.691485 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5cd5e397-98b7-4919-979c-34945f5bee46 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4" status: 200 len: 1719 microversion: 2.1 time: 0.663224 Oct 04 18:35:43.695398 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1026/1956] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:43 2022] GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4 => generated 1719 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:43.710470 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0c0f2641-0990-4144-8d89-8380d2aff975 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:43.724030 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0c0f2641-0990-4144-8d89-8380d2aff975 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6a81e50834114f0fa3cca4b0b9f8acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4650d613cb84018b92dc5d51486885e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:43.724936 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.compute.servers [None req-0c0f2641-0990-4144-8d89-8380d2aff975 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Removing options 'limit' from query {{(pid=123002) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 04 18:35:43.739923 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0c0f2641-0990-4144-8d89-8380d2aff975 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Searching by: {'deleted': False, 'project_id': 'd4650d613cb84018b92dc5d51486885e'} {{(pid=123002) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:35:43.787829 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0c0f2641-0990-4144-8d89-8380d2aff975 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:43.788469 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0c0f2641-0990-4144-8d89-8380d2aff975 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:43.788830 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0c0f2641-0990-4144-8d89-8380d2aff975 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:43.789752 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0c0f2641-0990-4144-8d89-8380d2aff975 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:43.792976 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0c0f2641-0990-4144-8d89-8380d2aff975 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:43.794243 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0c0f2641-0990-4144-8d89-8380d2aff975 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:43.877505 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.multi_cell_list [None req-0c0f2641-0990-4144-8d89-8380d2aff975 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=123002) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:35:44.015511 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0c0f2641-0990-4144-8d89-8380d2aff975 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] 10.222.0.20 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1012 microversion: 2.1 time: 0.318264 Oct 04 18:35:44.017124 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1027/1957] 10.222.0.20 () {58 vars in 1150 bytes} [Tue Oct 4 18:35:43 2022] GET /compute/v2.1/servers?limit=100000 => generated 1012 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:44.051258 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6fa0e9c5-1c94-4337-a7db-be50e5736229 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:44.056547 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-6fa0e9c5-1c94-4337-a7db-be50e5736229 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:44.087311 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6fa0e9c5-1c94-4337-a7db-be50e5736229 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:44.087758 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6fa0e9c5-1c94-4337-a7db-be50e5736229 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:44.089702 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6fa0e9c5-1c94-4337-a7db-be50e5736229 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:44.090806 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6fa0e9c5-1c94-4337-a7db-be50e5736229 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:44.091331 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6fa0e9c5-1c94-4337-a7db-be50e5736229 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:44.092206 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6fa0e9c5-1c94-4337-a7db-be50e5736229 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:44.120756 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d7226dc1-ac9e-49ae-b0b3-799373ea1005 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa52dda618b4da394932ec8e37ad065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4c8595d87e49aba075a9372572093a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:44.131457 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d7226dc1-ac9e-49ae-b0b3-799373ea1005 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] 10.222.0.20 "GET /compute/v2.1/servers/bfc2eb17-e0fe-4f59-974a-d35419f2093d" status: 200 len: 1325 microversion: 2.1 time: 0.836858 Oct 04 18:35:44.133774 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 931/1958] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:43 2022] GET /compute/v2.1/servers/bfc2eb17-e0fe-4f59-974a-d35419f2093d => generated 1325 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:44.140389 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1201c9ed-b663-4b18-a773-c7d147a61a16 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:44.142409 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1201c9ed-b663-4b18-a773-c7d147a61a16 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: 600147f3-401d-4897-8ce1-0f536234c3fa] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:44.158965 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1201c9ed-b663-4b18-a773-c7d147a61a16 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:44.159826 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1201c9ed-b663-4b18-a773-c7d147a61a16 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:44.162602 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1201c9ed-b663-4b18-a773-c7d147a61a16 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:44.165696 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1201c9ed-b663-4b18-a773-c7d147a61a16 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:44.167395 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1201c9ed-b663-4b18-a773-c7d147a61a16 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:44.168446 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1201c9ed-b663-4b18-a773-c7d147a61a16 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:44.291472 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-6fa0e9c5-1c94-4337-a7db-be50e5736229 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:44.304104 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-6fa0e9c5-1c94-4337-a7db-be50e5736229 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:44.306612 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-6fa0e9c5-1c94-4337-a7db-be50e5736229 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:44.318428 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6fa0e9c5-1c94-4337-a7db-be50e5736229 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1544 microversion: 2.91 time: 0.299388 Oct 04 18:35:44.319365 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1028/1959] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:44 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1544 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:44.325397 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-29d0b93a-bd09-4046-b563-edb724fa71ba tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:44.331834 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-29d0b93a-bd09-4046-b563-edb724fa71ba tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6a81e50834114f0fa3cca4b0b9f8acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4650d613cb84018b92dc5d51486885e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:44.332922 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-29d0b93a-bd09-4046-b563-edb724fa71ba tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Searching by: {'deleted': False, 'project_id': 'd4650d613cb84018b92dc5d51486885e'} {{(pid=123002) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:35:44.339773 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-29d0b93a-bd09-4046-b563-edb724fa71ba tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:44.340821 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-29d0b93a-bd09-4046-b563-edb724fa71ba tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:44.341485 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-29d0b93a-bd09-4046-b563-edb724fa71ba tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:44.342466 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-29d0b93a-bd09-4046-b563-edb724fa71ba tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:44.343758 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-29d0b93a-bd09-4046-b563-edb724fa71ba tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:44.345575 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-29d0b93a-bd09-4046-b563-edb724fa71ba tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:44.389113 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.multi_cell_list [None req-29d0b93a-bd09-4046-b563-edb724fa71ba tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=123002) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:35:44.431161 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-29d0b93a-bd09-4046-b563-edb724fa71ba tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 1012 microversion: 2.1 time: 0.110084 Oct 04 18:35:44.442178 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1029/1960] 10.222.0.20 () {58 vars in 1125 bytes} [Tue Oct 4 18:35:44 2022] GET /compute/v2.1/servers => generated 1012 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:44.442178 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7d65d248-4923-4cf7-a132-534ee610f8e2 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:44.442178 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7d65d248-4923-4cf7-a132-534ee610f8e2 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] [instance: 4fbde026-7d69-4924-97e6-28262d00e5db] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:44.447560 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7d65d248-4923-4cf7-a132-534ee610f8e2 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:44.448085 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7d65d248-4923-4cf7-a132-534ee610f8e2 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:44.448553 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7d65d248-4923-4cf7-a132-534ee610f8e2 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:44.449253 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7d65d248-4923-4cf7-a132-534ee610f8e2 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:44.449718 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7d65d248-4923-4cf7-a132-534ee610f8e2 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:44.450144 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7d65d248-4923-4cf7-a132-534ee610f8e2 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:44.594243 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1201c9ed-b663-4b18-a773-c7d147a61a16 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:44.620732 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1201c9ed-b663-4b18-a773-c7d147a61a16 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/600147f3-401d-4897-8ce1-0f536234c3fa" status: 200 len: 1307 microversion: 2.1 time: 0.483242 Oct 04 18:35:44.620732 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 932/1961] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:44 2022] GET /compute/v2.1/servers/600147f3-401d-4897-8ce1-0f536234c3fa => generated 1307 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:44.631090 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-831f431c-443e-4e9f-b737-ffbcd9f24384 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:44.632116 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-831f431c-443e-4e9f-b737-ffbcd9f24384 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 3ead1560-9c23-48ad-a938-6b3179b70035] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:44.648462 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-831f431c-443e-4e9f-b737-ffbcd9f24384 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:44.648462 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-831f431c-443e-4e9f-b737-ffbcd9f24384 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:44.650574 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-831f431c-443e-4e9f-b737-ffbcd9f24384 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:44.651691 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-831f431c-443e-4e9f-b737-ffbcd9f24384 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:44.652699 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-831f431c-443e-4e9f-b737-ffbcd9f24384 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:44.653914 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-831f431c-443e-4e9f-b737-ffbcd9f24384 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:44.820008 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-831f431c-443e-4e9f-b737-ffbcd9f24384 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:44.823451 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7d65d248-4923-4cf7-a132-534ee610f8e2 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb44381220d43b7bdfa744a1dc410a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3242afeef424d588cf102a2f0f38020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:44.831863 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-831f431c-443e-4e9f-b737-ffbcd9f24384 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035" status: 200 len: 1270 microversion: 2.1 time: 0.211589 Oct 04 18:35:44.833312 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 933/1962] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:44 2022] GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035 => generated 1270 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:44.839794 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7d65d248-4923-4cf7-a132-534ee610f8e2 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] 10.222.0.20 "GET /compute/v2.1/servers/4fbde026-7d69-4924-97e6-28262d00e5db" status: 200 len: 1354 microversion: 2.1 time: 0.400050 Oct 04 18:35:44.840737 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1030/1963] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:44 2022] GET /compute/v2.1/servers/4fbde026-7d69-4924-97e6-28262d00e5db => generated 1354 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:44.843537 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9d0e5d20-e1cc-4067-93a7-5374db44dc77 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:44.846304 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5f4d359e-a786-40a1-8190-4d61f9e9af76 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:44.846912 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5f4d359e-a786-40a1-8190-4d61f9e9af76 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 158e9f52-fd16-48d1-87b5-e0dd523e97a4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:44.854294 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9d0e5d20-e1cc-4067-93a7-5374db44dc77 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6a81e50834114f0fa3cca4b0b9f8acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4650d613cb84018b92dc5d51486885e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:44.855905 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-9d0e5d20-e1cc-4067-93a7-5374db44dc77 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'd4650d613cb84018b92dc5d51486885e'} {{(pid=123001) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:35:44.867770 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5f4d359e-a786-40a1-8190-4d61f9e9af76 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:44.868242 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5f4d359e-a786-40a1-8190-4d61f9e9af76 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:44.868679 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5f4d359e-a786-40a1-8190-4d61f9e9af76 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:44.869378 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5f4d359e-a786-40a1-8190-4d61f9e9af76 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:44.870219 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5f4d359e-a786-40a1-8190-4d61f9e9af76 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:44.870795 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5f4d359e-a786-40a1-8190-4d61f9e9af76 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:44.886712 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9d0e5d20-e1cc-4067-93a7-5374db44dc77 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:44.889099 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9d0e5d20-e1cc-4067-93a7-5374db44dc77 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:44.890339 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9d0e5d20-e1cc-4067-93a7-5374db44dc77 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:44.893792 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9d0e5d20-e1cc-4067-93a7-5374db44dc77 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:44.894649 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9d0e5d20-e1cc-4067-93a7-5374db44dc77 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:44.895338 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9d0e5d20-e1cc-4067-93a7-5374db44dc77 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:45.076196 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.multi_cell_list [None req-9d0e5d20-e1cc-4067-93a7-5374db44dc77 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123001) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:35:45.233804 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9d0e5d20-e1cc-4067-93a7-5374db44dc77 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] 10.222.0.20 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.399029 Oct 04 18:35:45.240835 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 934/1964] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Oct 4 18:35:44 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:35:45.250426 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-f3c56471-bae7-4b60-98e6-5fa49b2df004 req-29adcef3-fc04-43af-a367-62727922c2e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fbde026-7d69-4924-97e6-28262d00e5db", "tag": "03780673-89a1-4320-8c01-92071ed08378"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:45.276500 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-f3c56471-bae7-4b60-98e6-5fa49b2df004 req-29adcef3-fc04-43af-a367-62727922c2e6 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:45.277968 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-f3c56471-bae7-4b60-98e6-5fa49b2df004 req-29adcef3-fc04-43af-a367-62727922c2e6 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:45.279294 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-f3c56471-bae7-4b60-98e6-5fa49b2df004 req-29adcef3-fc04-43af-a367-62727922c2e6 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:45.297057 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-f3c56471-bae7-4b60-98e6-5fa49b2df004 req-29adcef3-fc04-43af-a367-62727922c2e6 service nova] Creating event network-changed:03780673-89a1-4320-8c01-92071ed08378 for instance 4fbde026-7d69-4924-97e6-28262d00e5db on n-h1-850501-14 Oct 04 18:35:45.307174 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-f3c56471-bae7-4b60-98e6-5fa49b2df004 req-29adcef3-fc04-43af-a367-62727922c2e6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064903 Oct 04 18:35:45.308171 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 935/1965] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:35:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:35:45.308956 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5f4d359e-a786-40a1-8190-4d61f9e9af76 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:45.322613 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8e6b8d8f-f53f-461c-af56-b113bd0ad5ff tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:45.323981 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8e6b8d8f-f53f-461c-af56-b113bd0ad5ff tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] [instance: bfc2eb17-e0fe-4f59-974a-d35419f2093d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:45.325706 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5f4d359e-a786-40a1-8190-4d61f9e9af76 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4" status: 200 len: 1719 microversion: 2.1 time: 0.483628 Oct 04 18:35:45.326611 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1031/1966] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:44 2022] GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4 => generated 1719 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:45.334145 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-417695f5-cac2-4586-82f5-290f667f755a tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:45.339536 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-417695f5-cac2-4586-82f5-290f667f755a tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6a81e50834114f0fa3cca4b0b9f8acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4650d613cb84018b92dc5d51486885e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:45.345720 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.compute.servers [None req-417695f5-cac2-4586-82f5-290f667f755a tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Removing options 'limit' from query {{(pid=123002) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 04 18:35:45.345720 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-417695f5-cac2-4586-82f5-290f667f755a tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Searching by: {'deleted': False, 'project_id': 'd4650d613cb84018b92dc5d51486885e'} {{(pid=123002) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:35:45.349063 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8e6b8d8f-f53f-461c-af56-b113bd0ad5ff tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:45.349507 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8e6b8d8f-f53f-461c-af56-b113bd0ad5ff tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:45.349929 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8e6b8d8f-f53f-461c-af56-b113bd0ad5ff tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:45.350704 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8e6b8d8f-f53f-461c-af56-b113bd0ad5ff tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:45.351157 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8e6b8d8f-f53f-461c-af56-b113bd0ad5ff tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:45.351616 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8e6b8d8f-f53f-461c-af56-b113bd0ad5ff tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:45.352655 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-417695f5-cac2-4586-82f5-290f667f755a tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:45.353781 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-417695f5-cac2-4586-82f5-290f667f755a tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:45.354451 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-417695f5-cac2-4586-82f5-290f667f755a tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:45.355491 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-417695f5-cac2-4586-82f5-290f667f755a tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:45.356247 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-417695f5-cac2-4586-82f5-290f667f755a tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:45.356850 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-417695f5-cac2-4586-82f5-290f667f755a tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:45.379630 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=100 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:45.408387 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-417695f5-cac2-4586-82f5-290f667f755a tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] 10.222.0.20 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.079705 Oct 04 18:35:45.412240 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1032/1967] 10.222.0.20 () {58 vars in 1140 bytes} [Tue Oct 4 18:35:45 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:35:45.427138 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a7cbb36d-9ef4-406d-bbe9-da8630583bb5 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:45.427810 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a7cbb36d-9ef4-406d-bbe9-da8630583bb5 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:45.435800 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a7cbb36d-9ef4-406d-bbe9-da8630583bb5 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:45.436430 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a7cbb36d-9ef4-406d-bbe9-da8630583bb5 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:45.436926 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a7cbb36d-9ef4-406d-bbe9-da8630583bb5 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:45.437694 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a7cbb36d-9ef4-406d-bbe9-da8630583bb5 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:45.438328 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a7cbb36d-9ef4-406d-bbe9-da8630583bb5 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:45.439971 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a7cbb36d-9ef4-406d-bbe9-da8630583bb5 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:45.596861 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a7cbb36d-9ef4-406d-bbe9-da8630583bb5 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:45.606557 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a7cbb36d-9ef4-406d-bbe9-da8630583bb5 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:45.608019 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a7cbb36d-9ef4-406d-bbe9-da8630583bb5 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:45.622110 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a7cbb36d-9ef4-406d-bbe9-da8630583bb5 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1544 microversion: 2.91 time: 0.207677 Oct 04 18:35:45.636206 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1033/1968] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:45 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1544 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:45.636206 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ab8f6730-c2c4-44fe-ad55-0b4ef0945d4d tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:45.643302 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ab8f6730-c2c4-44fe-ad55-0b4ef0945d4d tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6a81e50834114f0fa3cca4b0b9f8acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4650d613cb84018b92dc5d51486885e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:45.644389 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ab8f6730-c2c4-44fe-ad55-0b4ef0945d4d tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1008228703', 'deleted': False, 'project_id': 'd4650d613cb84018b92dc5d51486885e'} {{(pid=123002) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:35:45.651842 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ab8f6730-c2c4-44fe-ad55-0b4ef0945d4d tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:45.653042 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ab8f6730-c2c4-44fe-ad55-0b4ef0945d4d tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:45.653566 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ab8f6730-c2c4-44fe-ad55-0b4ef0945d4d tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:45.654364 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ab8f6730-c2c4-44fe-ad55-0b4ef0945d4d tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:45.654922 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ab8f6730-c2c4-44fe-ad55-0b4ef0945d4d tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:45.655408 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ab8f6730-c2c4-44fe-ad55-0b4ef0945d4d tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:45.813669 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8e6b8d8f-f53f-461c-af56-b113bd0ad5ff tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa52dda618b4da394932ec8e37ad065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4c8595d87e49aba075a9372572093a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:45.828402 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8e6b8d8f-f53f-461c-af56-b113bd0ad5ff tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] 10.222.0.20 "GET /compute/v2.1/servers/bfc2eb17-e0fe-4f59-974a-d35419f2093d" status: 200 len: 1325 microversion: 2.1 time: 0.516372 Oct 04 18:35:45.833280 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 936/1969] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:45 2022] GET /compute/v2.1/servers/bfc2eb17-e0fe-4f59-974a-d35419f2093d => generated 1325 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:45.843041 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f6dfb6c8-3d9e-48f4-a503-af24afe8147e tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:45.845335 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f6dfb6c8-3d9e-48f4-a503-af24afe8147e tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: 600147f3-401d-4897-8ce1-0f536234c3fa] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:45.858970 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f6dfb6c8-3d9e-48f4-a503-af24afe8147e tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:45.861582 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f6dfb6c8-3d9e-48f4-a503-af24afe8147e tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:45.865422 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f6dfb6c8-3d9e-48f4-a503-af24afe8147e tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:45.869722 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f6dfb6c8-3d9e-48f4-a503-af24afe8147e tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:45.869722 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f6dfb6c8-3d9e-48f4-a503-af24afe8147e tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:45.869722 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f6dfb6c8-3d9e-48f4-a503-af24afe8147e tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:45.904041 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.multi_cell_list [None req-ab8f6730-c2c4-44fe-ad55-0b4ef0945d4d tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123002) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:35:46.009616 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ab8f6730-c2c4-44fe-ad55-0b4ef0945d4d tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] 10.222.0.20 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1008228703" status: 200 len: 346 microversion: 2.1 time: 0.379118 Oct 04 18:35:46.018256 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1034/1970] 10.222.0.20 () {58 vars in 1242 bytes} [Tue Oct 4 18:35:45 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1008228703 => generated 346 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:35:46.032976 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0d6fb419-1767-4245-b604-ec7f463e1c55 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:46.034042 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0d6fb419-1767-4245-b604-ec7f463e1c55 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 3ead1560-9c23-48ad-a938-6b3179b70035] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:46.047747 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0d6fb419-1767-4245-b604-ec7f463e1c55 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:46.049353 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0d6fb419-1767-4245-b604-ec7f463e1c55 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:46.049914 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0d6fb419-1767-4245-b604-ec7f463e1c55 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:46.050848 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0d6fb419-1767-4245-b604-ec7f463e1c55 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:46.051395 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0d6fb419-1767-4245-b604-ec7f463e1c55 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:46.066609 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0d6fb419-1767-4245-b604-ec7f463e1c55 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:46.480547 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f6dfb6c8-3d9e-48f4-a503-af24afe8147e tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:46.494060 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f6dfb6c8-3d9e-48f4-a503-af24afe8147e tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/600147f3-401d-4897-8ce1-0f536234c3fa" status: 200 len: 1307 microversion: 2.1 time: 0.659194 Oct 04 18:35:46.511413 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 937/1971] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:45 2022] GET /compute/v2.1/servers/600147f3-401d-4897-8ce1-0f536234c3fa => generated 1307 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:46.521270 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-12490756-bb55-4b8f-a8c2-d9a8b7f6a861 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:46.543277 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-12490756-bb55-4b8f-a8c2-d9a8b7f6a861 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] [instance: 4fbde026-7d69-4924-97e6-28262d00e5db] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:46.549501 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-12490756-bb55-4b8f-a8c2-d9a8b7f6a861 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:46.550482 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-12490756-bb55-4b8f-a8c2-d9a8b7f6a861 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:46.551883 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-12490756-bb55-4b8f-a8c2-d9a8b7f6a861 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:46.553047 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-12490756-bb55-4b8f-a8c2-d9a8b7f6a861 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:46.553891 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-12490756-bb55-4b8f-a8c2-d9a8b7f6a861 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:46.556651 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-12490756-bb55-4b8f-a8c2-d9a8b7f6a861 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:46.996939 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0d6fb419-1767-4245-b604-ec7f463e1c55 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:47.017995 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0d6fb419-1767-4245-b604-ec7f463e1c55 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035" status: 200 len: 1312 microversion: 2.1 time: 0.996110 Oct 04 18:35:47.019799 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1035/1972] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:46 2022] GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035 => generated 1312 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:47.031285 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9f328a70-9a0f-4c1a-8986-10bdae4fa420 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:47.049584 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9f328a70-9a0f-4c1a-8986-10bdae4fa420 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:47.051317 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9f328a70-9a0f-4c1a-8986-10bdae4fa420 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:47.052330 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9f328a70-9a0f-4c1a-8986-10bdae4fa420 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:47.100784 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9f328a70-9a0f-4c1a-8986-10bdae4fa420 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] [instance: c3a29732-fa0a-4dfd-8475-0f43e9bb0846] Going to try to stop instance {{(pid=123002) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 18:35:47.248636 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-12490756-bb55-4b8f-a8c2-d9a8b7f6a861 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb44381220d43b7bdfa744a1dc410a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3242afeef424d588cf102a2f0f38020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:47.275743 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-12490756-bb55-4b8f-a8c2-d9a8b7f6a861 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] 10.222.0.20 "GET /compute/v2.1/servers/4fbde026-7d69-4924-97e6-28262d00e5db" status: 200 len: 1354 microversion: 2.1 time: 0.755464 Oct 04 18:35:47.296605 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 938/1973] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:46 2022] GET /compute/v2.1/servers/4fbde026-7d69-4924-97e6-28262d00e5db => generated 1354 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:47.305859 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-522be416-e7c7-4000-b087-0a2bc3b5d97c tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:47.307369 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-522be416-e7c7-4000-b087-0a2bc3b5d97c tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 158e9f52-fd16-48d1-87b5-e0dd523e97a4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:47.323087 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9f328a70-9a0f-4c1a-8986-10bdae4fa420 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] 10.222.0.20 "POST /compute/v2.1/servers/c3a29732-fa0a-4dfd-8475-0f43e9bb0846/action" status: 202 len: 0 microversion: 2.1 time: 0.301630 Oct 04 18:35:47.324617 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1036/1974] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:35:47 2022] POST /compute/v2.1/servers/c3a29732-fa0a-4dfd-8475-0f43e9bb0846/action => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:35:47.350398 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-522be416-e7c7-4000-b087-0a2bc3b5d97c tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:47.350939 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-522be416-e7c7-4000-b087-0a2bc3b5d97c tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:47.351380 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-522be416-e7c7-4000-b087-0a2bc3b5d97c tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:47.355724 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ce4ba055-15e2-47c8-a0a8-f0043a6ace54 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:47.357416 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-522be416-e7c7-4000-b087-0a2bc3b5d97c tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:47.357915 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-522be416-e7c7-4000-b087-0a2bc3b5d97c tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:47.359991 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ce4ba055-15e2-47c8-a0a8-f0043a6ace54 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:47.361680 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-522be416-e7c7-4000-b087-0a2bc3b5d97c tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:47.371426 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:47.390300 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ce4ba055-15e2-47c8-a0a8-f0043a6ace54 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:47.391085 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ce4ba055-15e2-47c8-a0a8-f0043a6ace54 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:47.391537 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ce4ba055-15e2-47c8-a0a8-f0043a6ace54 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:47.397000 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ce4ba055-15e2-47c8-a0a8-f0043a6ace54 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:47.397497 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ce4ba055-15e2-47c8-a0a8-f0043a6ace54 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:47.400089 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ce4ba055-15e2-47c8-a0a8-f0043a6ace54 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:47.646847 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ce4ba055-15e2-47c8-a0a8-f0043a6ace54 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:47.673245 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ce4ba055-15e2-47c8-a0a8-f0043a6ace54 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:47.675799 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ce4ba055-15e2-47c8-a0a8-f0043a6ace54 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:47.687984 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ce4ba055-15e2-47c8-a0a8-f0043a6ace54 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1544 microversion: 2.91 time: 0.361672 Oct 04 18:35:47.690802 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1037/1975] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:47 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1544 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:47.696204 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-13c8e1bb-b0d2-4f71-aaff-408342ae89c8 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:47.697129 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-13c8e1bb-b0d2-4f71-aaff-408342ae89c8 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] [instance: bfc2eb17-e0fe-4f59-974a-d35419f2093d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:47.705692 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-13c8e1bb-b0d2-4f71-aaff-408342ae89c8 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:47.706550 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-13c8e1bb-b0d2-4f71-aaff-408342ae89c8 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:47.707256 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-13c8e1bb-b0d2-4f71-aaff-408342ae89c8 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:47.708251 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-13c8e1bb-b0d2-4f71-aaff-408342ae89c8 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:47.708957 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-13c8e1bb-b0d2-4f71-aaff-408342ae89c8 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:47.709771 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-13c8e1bb-b0d2-4f71-aaff-408342ae89c8 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:47.991458 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-522be416-e7c7-4000-b087-0a2bc3b5d97c tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:48.006118 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-522be416-e7c7-4000-b087-0a2bc3b5d97c tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4" status: 200 len: 1709 microversion: 2.1 time: 0.707848 Oct 04 18:35:48.008244 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 939/1976] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:47 2022] GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4 => generated 1709 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:48.015864 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-fbf585ac-c24b-45e6-b96f-038949d43283 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:48.016529 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-fbf585ac-c24b-45e6-b96f-038949d43283 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] [instance: c3a29732-fa0a-4dfd-8475-0f43e9bb0846] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:48.033502 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fbf585ac-c24b-45e6-b96f-038949d43283 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:48.035202 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fbf585ac-c24b-45e6-b96f-038949d43283 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:48.038466 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fbf585ac-c24b-45e6-b96f-038949d43283 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:48.038466 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fbf585ac-c24b-45e6-b96f-038949d43283 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:48.038466 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fbf585ac-c24b-45e6-b96f-038949d43283 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:48.038466 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fbf585ac-c24b-45e6-b96f-038949d43283 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:48.143934 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-13c8e1bb-b0d2-4f71-aaff-408342ae89c8 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa52dda618b4da394932ec8e37ad065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4c8595d87e49aba075a9372572093a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:48.156113 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-13c8e1bb-b0d2-4f71-aaff-408342ae89c8 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] 10.222.0.20 "GET /compute/v2.1/servers/bfc2eb17-e0fe-4f59-974a-d35419f2093d" status: 200 len: 1325 microversion: 2.1 time: 0.463870 Oct 04 18:35:48.157093 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1038/1977] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:47 2022] GET /compute/v2.1/servers/bfc2eb17-e0fe-4f59-974a-d35419f2093d => generated 1325 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:48.176688 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-28c26a0d-5384-491d-a789-9a36a52b728a tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:48.177793 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-28c26a0d-5384-491d-a789-9a36a52b728a tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: 600147f3-401d-4897-8ce1-0f536234c3fa] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:48.198449 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-28c26a0d-5384-491d-a789-9a36a52b728a tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:48.199356 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-28c26a0d-5384-491d-a789-9a36a52b728a tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:48.200128 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-28c26a0d-5384-491d-a789-9a36a52b728a tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:48.201094 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-28c26a0d-5384-491d-a789-9a36a52b728a tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:48.201839 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-28c26a0d-5384-491d-a789-9a36a52b728a tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:48.202514 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-28c26a0d-5384-491d-a789-9a36a52b728a tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:48.762086 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-fbf585ac-c24b-45e6-b96f-038949d43283 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81e50834114f0fa3cca4b0b9f8acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4650d613cb84018b92dc5d51486885e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:48.762086 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-fbf585ac-c24b-45e6-b96f-038949d43283 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] 10.222.0.20 "GET /compute/v2.1/servers/c3a29732-fa0a-4dfd-8475-0f43e9bb0846" status: 200 len: 1522 microversion: 2.1 time: 0.553741 Oct 04 18:35:48.762086 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 940/1978] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:48 2022] GET /compute/v2.1/servers/c3a29732-fa0a-4dfd-8475-0f43e9bb0846 => generated 1522 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:48.762086 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-7e4bf465-6a77-4b37-b935-314f6caad215 req-da5796af-ecd4-40a4-8069-467a3a1119a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "600147f3-401d-4897-8ce1-0f536234c3fa", "tag": "a25f2711-7194-4624-bebd-55e73ad4b5c9"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:48.762086 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-7e4bf465-6a77-4b37-b935-314f6caad215 req-da5796af-ecd4-40a4-8069-467a3a1119a3 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:48.762086 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-7e4bf465-6a77-4b37-b935-314f6caad215 req-da5796af-ecd4-40a4-8069-467a3a1119a3 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:48.762086 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-7e4bf465-6a77-4b37-b935-314f6caad215 req-da5796af-ecd4-40a4-8069-467a3a1119a3 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:48.762086 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-7e4bf465-6a77-4b37-b935-314f6caad215 req-da5796af-ecd4-40a4-8069-467a3a1119a3 service nova] Creating event network-changed:a25f2711-7194-4624-bebd-55e73ad4b5c9 for instance 600147f3-401d-4897-8ce1-0f536234c3fa on n-h1-850501-14 Oct 04 18:35:48.766339 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-28c26a0d-5384-491d-a789-9a36a52b728a tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:48.767834 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-7e4bf465-6a77-4b37-b935-314f6caad215 req-da5796af-ecd4-40a4-8069-467a3a1119a3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034469 Oct 04 18:35:48.767834 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 941/1979] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:35:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:35:48.780438 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-28c26a0d-5384-491d-a789-9a36a52b728a tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/600147f3-401d-4897-8ce1-0f536234c3fa" status: 200 len: 1307 microversion: 2.1 time: 0.447323 Oct 04 18:35:48.782110 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3ef402d1-e954-439b-87d7-03aa31ffe92d tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Calling method '.version_select at 0x7fe25911e310>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:48.783275 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1039/1980] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:48 2022] GET /compute/v2.1/servers/600147f3-401d-4897-8ce1-0f536234c3fa => generated 1307 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:48.783427 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3ef402d1-e954-439b-87d7-03aa31ffe92d tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:48.783427 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3ef402d1-e954-439b-87d7-03aa31ffe92d tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:48.783427 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3ef402d1-e954-439b-87d7-03aa31ffe92d tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:48.784534 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-40243fff-3afd-4264-b396-e60603f11a73 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:48.784534 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-40243fff-3afd-4264-b396-e60603f11a73 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 3ead1560-9c23-48ad-a938-6b3179b70035] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:48.784534 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-40243fff-3afd-4264-b396-e60603f11a73 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:48.784534 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-40243fff-3afd-4264-b396-e60603f11a73 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:48.784534 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-40243fff-3afd-4264-b396-e60603f11a73 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:48.784534 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-40243fff-3afd-4264-b396-e60603f11a73 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:48.784534 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-40243fff-3afd-4264-b396-e60603f11a73 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:48.784534 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-40243fff-3afd-4264-b396-e60603f11a73 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:48.786636 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3ef402d1-e954-439b-87d7-03aa31ffe92d tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 2739 microversion: 2.1 time: 0.021456 Oct 04 18:35:48.786636 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 942/1981] 10.222.0.20 () {58 vars in 1143 bytes} [Tue Oct 4 18:35:48 2022] GET /compute/v2.1/os-migrations => generated 2739 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:48.787432 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:48.787901 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c872ebbc-3607-4456-9bfd-0efbd1b34aa3 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:48.787901 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c872ebbc-3607-4456-9bfd-0efbd1b34aa3 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] [instance: 4fbde026-7d69-4924-97e6-28262d00e5db] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:48.787901 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c872ebbc-3607-4456-9bfd-0efbd1b34aa3 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:48.787901 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c872ebbc-3607-4456-9bfd-0efbd1b34aa3 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:48.787901 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c872ebbc-3607-4456-9bfd-0efbd1b34aa3 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:48.787901 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c872ebbc-3607-4456-9bfd-0efbd1b34aa3 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:48.787901 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c872ebbc-3607-4456-9bfd-0efbd1b34aa3 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:48.787901 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c872ebbc-3607-4456-9bfd-0efbd1b34aa3 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:48.901582 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-40243fff-3afd-4264-b396-e60603f11a73 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:48.912803 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-40243fff-3afd-4264-b396-e60603f11a73 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035" status: 200 len: 1312 microversion: 2.1 time: 0.300998 Oct 04 18:35:48.915392 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c872ebbc-3607-4456-9bfd-0efbd1b34aa3 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb44381220d43b7bdfa744a1dc410a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3242afeef424d588cf102a2f0f38020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:48.924186 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c872ebbc-3607-4456-9bfd-0efbd1b34aa3 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] 10.222.0.20 "GET /compute/v2.1/servers/4fbde026-7d69-4924-97e6-28262d00e5db" status: 200 len: 1354 microversion: 2.1 time: 0.297146 Oct 04 18:35:48.925196 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 943/1982] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:48 2022] GET /compute/v2.1/servers/4fbde026-7d69-4924-97e6-28262d00e5db => generated 1354 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:48.926330 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1040/1983] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:48 2022] GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035 => generated 1312 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:48.937357 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2a090d2a-39c5-4b77-9c47-40b7d12e8f2c tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:48.938326 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2a090d2a-39c5-4b77-9c47-40b7d12e8f2c tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:48.940215 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-393c449a-4ecc-408f-97ad-3bb5909d3d43 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:48.941259 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-393c449a-4ecc-408f-97ad-3bb5909d3d43 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] [instance: 158e9f52-fd16-48d1-87b5-e0dd523e97a4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:48.948632 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-393c449a-4ecc-408f-97ad-3bb5909d3d43 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:48.950119 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-393c449a-4ecc-408f-97ad-3bb5909d3d43 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:48.950811 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-393c449a-4ecc-408f-97ad-3bb5909d3d43 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:48.950965 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2a090d2a-39c5-4b77-9c47-40b7d12e8f2c tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:48.951438 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2a090d2a-39c5-4b77-9c47-40b7d12e8f2c tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:48.951881 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2a090d2a-39c5-4b77-9c47-40b7d12e8f2c tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:48.952486 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-393c449a-4ecc-408f-97ad-3bb5909d3d43 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:48.952667 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2a090d2a-39c5-4b77-9c47-40b7d12e8f2c tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:48.953284 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-393c449a-4ecc-408f-97ad-3bb5909d3d43 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:48.953479 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2a090d2a-39c5-4b77-9c47-40b7d12e8f2c tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:48.953946 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-393c449a-4ecc-408f-97ad-3bb5909d3d43 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:48.954952 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2a090d2a-39c5-4b77-9c47-40b7d12e8f2c tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:49.105379 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-2a090d2a-39c5-4b77-9c47-40b7d12e8f2c tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:49.115598 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-2a090d2a-39c5-4b77-9c47-40b7d12e8f2c tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:49.117446 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-2a090d2a-39c5-4b77-9c47-40b7d12e8f2c tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:49.124194 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2a090d2a-39c5-4b77-9c47-40b7d12e8f2c tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1544 microversion: 2.91 time: 0.197331 Oct 04 18:35:49.136870 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 944/1984] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:48 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1544 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:49.186079 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-85279967-00d7-4a8f-9325-ce82d5527634 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:49.187091 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-85279967-00d7-4a8f-9325-ce82d5527634 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] [instance: bfc2eb17-e0fe-4f59-974a-d35419f2093d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:49.202977 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-85279967-00d7-4a8f-9325-ce82d5527634 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:49.207482 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-85279967-00d7-4a8f-9325-ce82d5527634 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:49.207482 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-85279967-00d7-4a8f-9325-ce82d5527634 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:49.207482 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-85279967-00d7-4a8f-9325-ce82d5527634 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:49.208660 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-85279967-00d7-4a8f-9325-ce82d5527634 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:49.209494 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-85279967-00d7-4a8f-9325-ce82d5527634 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:49.974635 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-393c449a-4ecc-408f-97ad-3bb5909d3d43 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4" status: 200 len: 1862 microversion: 2.1 time: 1.045679 Oct 04 18:35:49.975295 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1041/1985] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:48 2022] GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4 => generated 1862 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:49.995841 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8945f1d3-041f-497a-a553-aa0dd43e46e4 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:49.995841 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8945f1d3-041f-497a-a553-aa0dd43e46e4 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: 600147f3-401d-4897-8ce1-0f536234c3fa] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:50.005077 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8945f1d3-041f-497a-a553-aa0dd43e46e4 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:50.005575 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8945f1d3-041f-497a-a553-aa0dd43e46e4 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:50.006015 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8945f1d3-041f-497a-a553-aa0dd43e46e4 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:50.006718 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8945f1d3-041f-497a-a553-aa0dd43e46e4 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:50.025975 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8945f1d3-041f-497a-a553-aa0dd43e46e4 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:50.026219 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8945f1d3-041f-497a-a553-aa0dd43e46e4 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:50.226184 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-85279967-00d7-4a8f-9325-ce82d5527634 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa52dda618b4da394932ec8e37ad065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4c8595d87e49aba075a9372572093a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:50.247091 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-85279967-00d7-4a8f-9325-ce82d5527634 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] 10.222.0.20 "GET /compute/v2.1/servers/bfc2eb17-e0fe-4f59-974a-d35419f2093d" status: 200 len: 1325 microversion: 2.1 time: 1.064344 Oct 04 18:35:50.260887 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 945/1986] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:49 2022] GET /compute/v2.1/servers/bfc2eb17-e0fe-4f59-974a-d35419f2093d => generated 1325 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:50.271364 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-81852624-076f-4ddf-bdc7-184e811c634d tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:50.272427 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-81852624-076f-4ddf-bdc7-184e811c634d tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] [instance: c3a29732-fa0a-4dfd-8475-0f43e9bb0846] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:50.278981 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-81852624-076f-4ddf-bdc7-184e811c634d tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:50.279796 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-81852624-076f-4ddf-bdc7-184e811c634d tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:50.281425 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-81852624-076f-4ddf-bdc7-184e811c634d tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:50.283693 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-81852624-076f-4ddf-bdc7-184e811c634d tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:50.284562 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-81852624-076f-4ddf-bdc7-184e811c634d tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:50.285748 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-81852624-076f-4ddf-bdc7-184e811c634d tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:50.375102 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8945f1d3-041f-497a-a553-aa0dd43e46e4 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:50.389597 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8945f1d3-041f-497a-a553-aa0dd43e46e4 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/600147f3-401d-4897-8ce1-0f536234c3fa" status: 200 len: 1307 microversion: 2.1 time: 0.413248 Oct 04 18:35:50.401760 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1042/1987] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:49 2022] GET /compute/v2.1/servers/600147f3-401d-4897-8ce1-0f536234c3fa => generated 1307 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:50.414545 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-72cf02ee-dbc9-4205-8ef1-de4caf47a3ec tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:50.416647 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-72cf02ee-dbc9-4205-8ef1-de4caf47a3ec tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 3ead1560-9c23-48ad-a938-6b3179b70035] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:50.432510 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-72cf02ee-dbc9-4205-8ef1-de4caf47a3ec tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:50.434068 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-72cf02ee-dbc9-4205-8ef1-de4caf47a3ec tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:50.437308 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-72cf02ee-dbc9-4205-8ef1-de4caf47a3ec tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:50.441911 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-72cf02ee-dbc9-4205-8ef1-de4caf47a3ec tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:50.443339 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-72cf02ee-dbc9-4205-8ef1-de4caf47a3ec tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:50.444505 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-72cf02ee-dbc9-4205-8ef1-de4caf47a3ec tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:50.596100 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-81852624-076f-4ddf-bdc7-184e811c634d tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81e50834114f0fa3cca4b0b9f8acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4650d613cb84018b92dc5d51486885e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:50.604685 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-81852624-076f-4ddf-bdc7-184e811c634d tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] 10.222.0.20 "GET /compute/v2.1/servers/c3a29732-fa0a-4dfd-8475-0f43e9bb0846" status: 200 len: 1522 microversion: 2.1 time: 0.342283 Oct 04 18:35:50.620972 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 946/1988] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:50 2022] GET /compute/v2.1/servers/c3a29732-fa0a-4dfd-8475-0f43e9bb0846 => generated 1522 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:50.626970 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e6288271-b95e-4c9e-b4ce-f871ede03dcd tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:50.628043 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e6288271-b95e-4c9e-b4ce-f871ede03dcd tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] [instance: 4fbde026-7d69-4924-97e6-28262d00e5db] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:50.637131 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e6288271-b95e-4c9e-b4ce-f871ede03dcd tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:50.637741 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e6288271-b95e-4c9e-b4ce-f871ede03dcd tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:50.638551 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e6288271-b95e-4c9e-b4ce-f871ede03dcd tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:50.639681 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e6288271-b95e-4c9e-b4ce-f871ede03dcd tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:50.640451 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e6288271-b95e-4c9e-b4ce-f871ede03dcd tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:50.641173 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e6288271-b95e-4c9e-b4ce-f871ede03dcd tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:50.846709 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-72cf02ee-dbc9-4205-8ef1-de4caf47a3ec tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:50.855603 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-72cf02ee-dbc9-4205-8ef1-de4caf47a3ec tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035" status: 200 len: 1312 microversion: 2.1 time: 0.452084 Oct 04 18:35:50.856382 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1043/1989] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:50 2022] GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035 => generated 1312 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:50.883609 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c09f0446-63cf-467a-922f-4c66218792d2 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:50.883609 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c09f0446-63cf-467a-922f-4c66218792d2 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] [instance: 158e9f52-fd16-48d1-87b5-e0dd523e97a4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:50.886662 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c09f0446-63cf-467a-922f-4c66218792d2 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:50.887158 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c09f0446-63cf-467a-922f-4c66218792d2 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:50.887570 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c09f0446-63cf-467a-922f-4c66218792d2 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:50.888286 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c09f0446-63cf-467a-922f-4c66218792d2 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:50.888735 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c09f0446-63cf-467a-922f-4c66218792d2 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:50.889172 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c09f0446-63cf-467a-922f-4c66218792d2 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:50.901609 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e6288271-b95e-4c9e-b4ce-f871ede03dcd tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb44381220d43b7bdfa744a1dc410a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3242afeef424d588cf102a2f0f38020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:50.912375 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e6288271-b95e-4c9e-b4ce-f871ede03dcd tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] 10.222.0.20 "GET /compute/v2.1/servers/4fbde026-7d69-4924-97e6-28262d00e5db" status: 200 len: 1354 microversion: 2.1 time: 0.289659 Oct 04 18:35:50.928664 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 947/1990] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:50 2022] GET /compute/v2.1/servers/4fbde026-7d69-4924-97e6-28262d00e5db => generated 1354 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:50.939429 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e248d1d5-d803-483f-9963-94048375c8c5 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:50.945732 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e248d1d5-d803-483f-9963-94048375c8c5 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:50.952578 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e248d1d5-d803-483f-9963-94048375c8c5 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:50.958403 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e248d1d5-d803-483f-9963-94048375c8c5 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:50.958403 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e248d1d5-d803-483f-9963-94048375c8c5 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:50.958403 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e248d1d5-d803-483f-9963-94048375c8c5 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:50.958403 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e248d1d5-d803-483f-9963-94048375c8c5 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:50.958403 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e248d1d5-d803-483f-9963-94048375c8c5 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:50.995417 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=14 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:51.101130 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e248d1d5-d803-483f-9963-94048375c8c5 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:51.112416 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e248d1d5-d803-483f-9963-94048375c8c5 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:51.115239 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e248d1d5-d803-483f-9963-94048375c8c5 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:51.119833 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e248d1d5-d803-483f-9963-94048375c8c5 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1544 microversion: 2.91 time: 0.190076 Oct 04 18:35:51.120681 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 948/1991] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:50 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1544 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:51.125422 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-737f8cbe-f6e7-42cd-b39d-28e8301f8b02 req-af96e59a-237b-4cd0-baf6-3b86fffb37e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfc2eb17-e0fe-4f59-974a-d35419f2093d", "tag": "5563625e-0101-40d9-a724-0febc25125a4"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:51.139170 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-737f8cbe-f6e7-42cd-b39d-28e8301f8b02 req-af96e59a-237b-4cd0-baf6-3b86fffb37e2 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:51.140108 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-737f8cbe-f6e7-42cd-b39d-28e8301f8b02 req-af96e59a-237b-4cd0-baf6-3b86fffb37e2 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:51.140777 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-737f8cbe-f6e7-42cd-b39d-28e8301f8b02 req-af96e59a-237b-4cd0-baf6-3b86fffb37e2 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:51.155437 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-737f8cbe-f6e7-42cd-b39d-28e8301f8b02 req-af96e59a-237b-4cd0-baf6-3b86fffb37e2 service nova] Creating event network-changed:5563625e-0101-40d9-a724-0febc25125a4 for instance bfc2eb17-e0fe-4f59-974a-d35419f2093d on n-h1-850501-14 Oct 04 18:35:51.162078 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-737f8cbe-f6e7-42cd-b39d-28e8301f8b02 req-af96e59a-237b-4cd0-baf6-3b86fffb37e2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039861 Oct 04 18:35:51.166778 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 949/1992] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:35:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:35:51.173317 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-6a6f6a2b-64b3-4724-b078-7cd48c51d0c5 req-845a11a5-14e5-4b40-9da2-919fc8f7f077 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ead1560-9c23-48ad-a938-6b3179b70035", "tag": "7d8819bd-e6dc-4ea2-a722-7f903297fff8"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:51.178531 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c09f0446-63cf-467a-922f-4c66218792d2 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4" status: 200 len: 1862 microversion: 2.1 time: 0.307067 Oct 04 18:35:51.179235 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1044/1993] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:50 2022] GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4 => generated 1862 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:51.186756 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-6a6f6a2b-64b3-4724-b078-7cd48c51d0c5 req-845a11a5-14e5-4b40-9da2-919fc8f7f077 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:51.187518 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-6a6f6a2b-64b3-4724-b078-7cd48c51d0c5 req-845a11a5-14e5-4b40-9da2-919fc8f7f077 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:51.188185 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-6a6f6a2b-64b3-4724-b078-7cd48c51d0c5 req-845a11a5-14e5-4b40-9da2-919fc8f7f077 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:51.202042 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-6a6f6a2b-64b3-4724-b078-7cd48c51d0c5 req-845a11a5-14e5-4b40-9da2-919fc8f7f077 service nova] Creating event network-changed:7d8819bd-e6dc-4ea2-a722-7f903297fff8 for instance 3ead1560-9c23-48ad-a938-6b3179b70035 on n-h1-850501-14 Oct 04 18:35:51.220954 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-6a6f6a2b-64b3-4724-b078-7cd48c51d0c5 req-845a11a5-14e5-4b40-9da2-919fc8f7f077 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051643 Oct 04 18:35:51.222442 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 950/1994] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:35:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:35:51.280426 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-27fd8f58-c6fd-4507-a5fd-dfdfd9fc7924 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:51.280426 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-27fd8f58-c6fd-4507-a5fd-dfdfd9fc7924 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] [instance: bfc2eb17-e0fe-4f59-974a-d35419f2093d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:51.286551 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-27fd8f58-c6fd-4507-a5fd-dfdfd9fc7924 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:51.294220 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-17cf0274-be72-4b31-afad-7d948a0b7a52 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:51.297055 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-17cf0274-be72-4b31-afad-7d948a0b7a52 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 158e9f52-fd16-48d1-87b5-e0dd523e97a4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:51.297205 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-27fd8f58-c6fd-4507-a5fd-dfdfd9fc7924 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:51.297205 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-27fd8f58-c6fd-4507-a5fd-dfdfd9fc7924 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:51.297205 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-27fd8f58-c6fd-4507-a5fd-dfdfd9fc7924 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:51.297205 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-27fd8f58-c6fd-4507-a5fd-dfdfd9fc7924 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:51.298033 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-27fd8f58-c6fd-4507-a5fd-dfdfd9fc7924 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:51.299266 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=100 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:51.303405 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-17cf0274-be72-4b31-afad-7d948a0b7a52 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:51.304342 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-17cf0274-be72-4b31-afad-7d948a0b7a52 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:51.305060 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-17cf0274-be72-4b31-afad-7d948a0b7a52 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:51.306157 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-17cf0274-be72-4b31-afad-7d948a0b7a52 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:51.306843 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-17cf0274-be72-4b31-afad-7d948a0b7a52 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:51.320443 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-17cf0274-be72-4b31-afad-7d948a0b7a52 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:51.516488 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-17cf0274-be72-4b31-afad-7d948a0b7a52 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lazy-loading 'services' on Instance uuid 158e9f52-fd16-48d1-87b5-e0dd523e97a4 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:35:51.558692 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-27fd8f58-c6fd-4507-a5fd-dfdfd9fc7924 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa52dda618b4da394932ec8e37ad065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4c8595d87e49aba075a9372572093a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:51.571497 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-27fd8f58-c6fd-4507-a5fd-dfdfd9fc7924 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] 10.222.0.20 "GET /compute/v2.1/servers/bfc2eb17-e0fe-4f59-974a-d35419f2093d" status: 200 len: 1325 microversion: 2.1 time: 0.301518 Oct 04 18:35:51.572292 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1045/1995] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:51 2022] GET /compute/v2.1/servers/bfc2eb17-e0fe-4f59-974a-d35419f2093d => generated 1325 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:51.585491 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f9277138-92ad-4966-9efd-b38a54af6a75 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:51.588622 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f9277138-92ad-4966-9efd-b38a54af6a75 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: 600147f3-401d-4897-8ce1-0f536234c3fa] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:51.601809 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f9277138-92ad-4966-9efd-b38a54af6a75 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:51.601809 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f9277138-92ad-4966-9efd-b38a54af6a75 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:51.603013 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f9277138-92ad-4966-9efd-b38a54af6a75 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:51.603013 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f9277138-92ad-4966-9efd-b38a54af6a75 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:51.609757 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f9277138-92ad-4966-9efd-b38a54af6a75 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:51.611213 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f9277138-92ad-4966-9efd-b38a54af6a75 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:51.786114 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-17cf0274-be72-4b31-afad-7d948a0b7a52 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "DELETE /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4/os-volume_attachments/1c120330-d74d-49d4-807f-2d91ac218d32" status: 202 len: 0 microversion: 2.1 time: 0.496226 Oct 04 18:35:51.790215 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 951/1996] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Oct 4 18:35:51 2022] DELETE /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4/os-volume_attachments/1c120330-d74d-49d4-807f-2d91ac218d32 => generated 0 bytes in 502 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:35:51.802525 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1855838a-e0de-4d15-b578-16cebad94e01 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:51.803251 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1855838a-e0de-4d15-b578-16cebad94e01 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] [instance: c3a29732-fa0a-4dfd-8475-0f43e9bb0846] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:51.817065 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1855838a-e0de-4d15-b578-16cebad94e01 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:51.819063 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1855838a-e0de-4d15-b578-16cebad94e01 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:51.819063 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1855838a-e0de-4d15-b578-16cebad94e01 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:51.819063 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1855838a-e0de-4d15-b578-16cebad94e01 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:51.823719 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1855838a-e0de-4d15-b578-16cebad94e01 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:51.823976 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1855838a-e0de-4d15-b578-16cebad94e01 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:51.912665 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f9277138-92ad-4966-9efd-b38a54af6a75 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:51.944551 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f9277138-92ad-4966-9efd-b38a54af6a75 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/600147f3-401d-4897-8ce1-0f536234c3fa" status: 200 len: 1307 microversion: 2.1 time: 0.367561 Oct 04 18:35:51.964417 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1046/1997] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:51 2022] GET /compute/v2.1/servers/600147f3-401d-4897-8ce1-0f536234c3fa => generated 1307 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:51.970620 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8566ae62-c32a-4330-bad7-932a7ba37dfc tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:51.986637 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8566ae62-c32a-4330-bad7-932a7ba37dfc tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 158e9f52-fd16-48d1-87b5-e0dd523e97a4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:52.012135 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8566ae62-c32a-4330-bad7-932a7ba37dfc tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:52.012836 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8566ae62-c32a-4330-bad7-932a7ba37dfc tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:52.013338 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8566ae62-c32a-4330-bad7-932a7ba37dfc tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:52.014069 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8566ae62-c32a-4330-bad7-932a7ba37dfc tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:52.014530 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8566ae62-c32a-4330-bad7-932a7ba37dfc tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:52.014962 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8566ae62-c32a-4330-bad7-932a7ba37dfc tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:52.064824 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=18 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:52.164716 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8566ae62-c32a-4330-bad7-932a7ba37dfc tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.199204 Oct 04 18:35:52.169935 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1047/1998] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 18:35:51 2022] GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4/os-volume_attachments => generated 197 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:35:52.182024 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-69b3ad23-071c-4d6c-a853-ea7d5f23bba7 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:52.187622 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-69b3ad23-071c-4d6c-a853-ea7d5f23bba7 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 3ead1560-9c23-48ad-a938-6b3179b70035] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:52.206770 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-69b3ad23-071c-4d6c-a853-ea7d5f23bba7 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:52.207817 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-69b3ad23-071c-4d6c-a853-ea7d5f23bba7 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:52.209659 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-69b3ad23-071c-4d6c-a853-ea7d5f23bba7 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:52.212289 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-69b3ad23-071c-4d6c-a853-ea7d5f23bba7 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:52.213211 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-69b3ad23-071c-4d6c-a853-ea7d5f23bba7 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:52.215347 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-69b3ad23-071c-4d6c-a853-ea7d5f23bba7 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:52.568140 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1855838a-e0de-4d15-b578-16cebad94e01 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81e50834114f0fa3cca4b0b9f8acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4650d613cb84018b92dc5d51486885e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:52.576377 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1855838a-e0de-4d15-b578-16cebad94e01 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] 10.222.0.20 "GET /compute/v2.1/servers/c3a29732-fa0a-4dfd-8475-0f43e9bb0846" status: 200 len: 1522 microversion: 2.1 time: 0.786751 Oct 04 18:35:52.580884 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 952/1999] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:51 2022] GET /compute/v2.1/servers/c3a29732-fa0a-4dfd-8475-0f43e9bb0846 => generated 1522 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:52.587108 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-50fc0710-6c5e-4870-aab2-333386675f1f tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:52.595808 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-50fc0710-6c5e-4870-aab2-333386675f1f tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] [instance: 4fbde026-7d69-4924-97e6-28262d00e5db] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:52.614022 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-50fc0710-6c5e-4870-aab2-333386675f1f tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:52.614936 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-50fc0710-6c5e-4870-aab2-333386675f1f tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:52.615619 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-50fc0710-6c5e-4870-aab2-333386675f1f tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:52.616709 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-50fc0710-6c5e-4870-aab2-333386675f1f tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:52.617409 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-50fc0710-6c5e-4870-aab2-333386675f1f tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:52.618071 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-50fc0710-6c5e-4870-aab2-333386675f1f tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:52.691528 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-69b3ad23-071c-4d6c-a853-ea7d5f23bba7 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:52.700826 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-69b3ad23-071c-4d6c-a853-ea7d5f23bba7 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035" status: 200 len: 1312 microversion: 2.1 time: 0.526398 Oct 04 18:35:52.704752 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1048/2000] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:52 2022] GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035 => generated 1312 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:52.725978 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b485384f-c0ed-4241-8692-0679ad03525d tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:52.732937 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b485384f-c0ed-4241-8692-0679ad03525d tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:52.753975 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b485384f-c0ed-4241-8692-0679ad03525d tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:52.753975 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b485384f-c0ed-4241-8692-0679ad03525d tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:52.753975 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b485384f-c0ed-4241-8692-0679ad03525d tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:52.753975 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b485384f-c0ed-4241-8692-0679ad03525d tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:52.753975 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b485384f-c0ed-4241-8692-0679ad03525d tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:52.753975 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b485384f-c0ed-4241-8692-0679ad03525d tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:52.973382 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b485384f-c0ed-4241-8692-0679ad03525d tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:52.987017 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b485384f-c0ed-4241-8692-0679ad03525d tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:52.994880 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b485384f-c0ed-4241-8692-0679ad03525d tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:53.018388 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b485384f-c0ed-4241-8692-0679ad03525d tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1544 microversion: 2.91 time: 0.309070 Oct 04 18:35:53.020197 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1049/2001] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:52 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1544 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:53.030037 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-fa204045-1050-4473-bc60-ad0baafae3b0 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:53.031008 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-fa204045-1050-4473-bc60-ad0baafae3b0 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] [instance: bfc2eb17-e0fe-4f59-974a-d35419f2093d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:53.046764 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fa204045-1050-4473-bc60-ad0baafae3b0 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:53.047689 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fa204045-1050-4473-bc60-ad0baafae3b0 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:53.048499 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fa204045-1050-4473-bc60-ad0baafae3b0 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:53.057103 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fa204045-1050-4473-bc60-ad0baafae3b0 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:53.058801 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fa204045-1050-4473-bc60-ad0baafae3b0 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:53.060254 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fa204045-1050-4473-bc60-ad0baafae3b0 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:53.188970 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-50fc0710-6c5e-4870-aab2-333386675f1f tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb44381220d43b7bdfa744a1dc410a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3242afeef424d588cf102a2f0f38020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:53.234200 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-50fc0710-6c5e-4870-aab2-333386675f1f tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] 10.222.0.20 "GET /compute/v2.1/servers/4fbde026-7d69-4924-97e6-28262d00e5db" status: 200 len: 1354 microversion: 2.1 time: 0.650186 Oct 04 18:35:53.252415 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 953/2002] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:52 2022] GET /compute/v2.1/servers/4fbde026-7d69-4924-97e6-28262d00e5db => generated 1354 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:53.263995 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-fc940274-0d32-4ef1-96e7-2d20d04e1857 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:53.268894 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-fc940274-0d32-4ef1-96e7-2d20d04e1857 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: 600147f3-401d-4897-8ce1-0f536234c3fa] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:53.280902 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fc940274-0d32-4ef1-96e7-2d20d04e1857 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:53.286157 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fc940274-0d32-4ef1-96e7-2d20d04e1857 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:53.286970 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fc940274-0d32-4ef1-96e7-2d20d04e1857 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:53.287953 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fc940274-0d32-4ef1-96e7-2d20d04e1857 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:53.289636 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fc940274-0d32-4ef1-96e7-2d20d04e1857 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:53.290309 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fc940274-0d32-4ef1-96e7-2d20d04e1857 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:53.831982 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-fa204045-1050-4473-bc60-ad0baafae3b0 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa52dda618b4da394932ec8e37ad065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4c8595d87e49aba075a9372572093a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:53.847195 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-fa204045-1050-4473-bc60-ad0baafae3b0 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] 10.222.0.20 "GET /compute/v2.1/servers/bfc2eb17-e0fe-4f59-974a-d35419f2093d" status: 200 len: 1325 microversion: 2.1 time: 0.825568 Oct 04 18:35:53.847791 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1050/2003] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:53 2022] GET /compute/v2.1/servers/bfc2eb17-e0fe-4f59-974a-d35419f2093d => generated 1325 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:53.868005 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-cd58d586-b7ce-4d3c-bd0d-3d2eb7299d20 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:53.871640 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-fc940274-0d32-4ef1-96e7-2d20d04e1857 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:53.875942 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:53.882297 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-cd58d586-b7ce-4d3c-bd0d-3d2eb7299d20 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 158e9f52-fd16-48d1-87b5-e0dd523e97a4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:53.884644 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-fc940274-0d32-4ef1-96e7-2d20d04e1857 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/600147f3-401d-4897-8ce1-0f536234c3fa" status: 200 len: 1307 microversion: 2.1 time: 0.630702 Oct 04 18:35:53.887509 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 954/2004] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:53 2022] GET /compute/v2.1/servers/600147f3-401d-4897-8ce1-0f536234c3fa => generated 1307 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:53.898583 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cd58d586-b7ce-4d3c-bd0d-3d2eb7299d20 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:53.899515 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cd58d586-b7ce-4d3c-bd0d-3d2eb7299d20 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:53.900243 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-04d01248-fbeb-41cf-bfe9-9a6e114e5f6a tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:53.900901 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cd58d586-b7ce-4d3c-bd0d-3d2eb7299d20 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:53.901780 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-04d01248-fbeb-41cf-bfe9-9a6e114e5f6a tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] [instance: c3a29732-fa0a-4dfd-8475-0f43e9bb0846] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:53.902708 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cd58d586-b7ce-4d3c-bd0d-3d2eb7299d20 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:53.905575 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cd58d586-b7ce-4d3c-bd0d-3d2eb7299d20 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:53.906267 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cd58d586-b7ce-4d3c-bd0d-3d2eb7299d20 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:53.916207 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-04d01248-fbeb-41cf-bfe9-9a6e114e5f6a tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:53.919442 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-04d01248-fbeb-41cf-bfe9-9a6e114e5f6a tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:53.920087 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-04d01248-fbeb-41cf-bfe9-9a6e114e5f6a tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:53.921209 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-04d01248-fbeb-41cf-bfe9-9a6e114e5f6a tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:53.921852 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-04d01248-fbeb-41cf-bfe9-9a6e114e5f6a tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:53.922286 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-04d01248-fbeb-41cf-bfe9-9a6e114e5f6a tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:53.969729 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-cd58d586-b7ce-4d3c-bd0d-3d2eb7299d20 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107698 Oct 04 18:35:53.970755 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1051/2005] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 18:35:53 2022] GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:35:53.976492 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8b6c4b41-9be6-4d9a-adf4-d2d53de0d3c8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:53.977403 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8b6c4b41-9be6-4d9a-adf4-d2d53de0d3c8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 3ead1560-9c23-48ad-a938-6b3179b70035] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:53.984161 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8b6c4b41-9be6-4d9a-adf4-d2d53de0d3c8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:53.984664 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8b6c4b41-9be6-4d9a-adf4-d2d53de0d3c8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:53.985083 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8b6c4b41-9be6-4d9a-adf4-d2d53de0d3c8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:53.986440 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8b6c4b41-9be6-4d9a-adf4-d2d53de0d3c8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:53.986914 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8b6c4b41-9be6-4d9a-adf4-d2d53de0d3c8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:53.987340 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8b6c4b41-9be6-4d9a-adf4-d2d53de0d3c8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:54.317154 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8b6c4b41-9be6-4d9a-adf4-d2d53de0d3c8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:54.328443 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-04d01248-fbeb-41cf-bfe9-9a6e114e5f6a tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81e50834114f0fa3cca4b0b9f8acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4650d613cb84018b92dc5d51486885e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:54.337097 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8b6c4b41-9be6-4d9a-adf4-d2d53de0d3c8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035" status: 200 len: 1312 microversion: 2.1 time: 0.365246 Oct 04 18:35:54.352080 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1052/2006] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:53 2022] GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035 => generated 1312 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:54.352316 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8a63aa5b-4ae8-4afe-ad83-eee0768a74df tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:54.360321 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8a63aa5b-4ae8-4afe-ad83-eee0768a74df tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:54.360575 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-04d01248-fbeb-41cf-bfe9-9a6e114e5f6a tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] 10.222.0.20 "GET /compute/v2.1/servers/c3a29732-fa0a-4dfd-8475-0f43e9bb0846" status: 200 len: 1499 microversion: 2.1 time: 0.471673 Oct 04 18:35:54.367972 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8a63aa5b-4ae8-4afe-ad83-eee0768a74df tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:54.369569 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8a63aa5b-4ae8-4afe-ad83-eee0768a74df tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:54.370450 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8a63aa5b-4ae8-4afe-ad83-eee0768a74df tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:54.372182 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8a63aa5b-4ae8-4afe-ad83-eee0768a74df tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:54.373559 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8a63aa5b-4ae8-4afe-ad83-eee0768a74df tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:54.377748 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8a63aa5b-4ae8-4afe-ad83-eee0768a74df tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:54.383852 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 955/2007] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:53 2022] GET /compute/v2.1/servers/c3a29732-fa0a-4dfd-8475-0f43e9bb0846 => generated 1499 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:54.401145 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-da5cf540-400c-4724-88c1-15bfda7ad9fc tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:54.402162 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-da5cf540-400c-4724-88c1-15bfda7ad9fc tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] [instance: 4fbde026-7d69-4924-97e6-28262d00e5db] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:54.432097 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-da5cf540-400c-4724-88c1-15bfda7ad9fc tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:54.439130 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-da5cf540-400c-4724-88c1-15bfda7ad9fc tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:54.439130 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-da5cf540-400c-4724-88c1-15bfda7ad9fc tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:54.439130 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-da5cf540-400c-4724-88c1-15bfda7ad9fc tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:54.439130 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-da5cf540-400c-4724-88c1-15bfda7ad9fc tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:54.439130 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-da5cf540-400c-4724-88c1-15bfda7ad9fc tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:54.597920 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8a63aa5b-4ae8-4afe-ad83-eee0768a74df tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:54.612033 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8a63aa5b-4ae8-4afe-ad83-eee0768a74df tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:54.618898 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8a63aa5b-4ae8-4afe-ad83-eee0768a74df tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:54.638729 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8a63aa5b-4ae8-4afe-ad83-eee0768a74df tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1544 microversion: 2.91 time: 0.295793 Oct 04 18:35:54.639614 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1053/2008] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:54 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1544 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:54.649355 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-892b4e24-b263-42ed-8c14-905e72acd68a tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:54.672124 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-892b4e24-b263-42ed-8c14-905e72acd68a tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6a81e50834114f0fa3cca4b0b9f8acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4650d613cb84018b92dc5d51486885e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:54.673895 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-892b4e24-b263-42ed-8c14-905e72acd68a tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': 'd4650d613cb84018b92dc5d51486885e'} {{(pid=123002) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:35:54.680296 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-892b4e24-b263-42ed-8c14-905e72acd68a tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:54.682290 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-892b4e24-b263-42ed-8c14-905e72acd68a tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:54.682933 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-892b4e24-b263-42ed-8c14-905e72acd68a tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:54.683901 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-892b4e24-b263-42ed-8c14-905e72acd68a tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:54.692721 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-892b4e24-b263-42ed-8c14-905e72acd68a tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:54.693639 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-892b4e24-b263-42ed-8c14-905e72acd68a tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:54.803757 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.multi_cell_list [None req-892b4e24-b263-42ed-8c14-905e72acd68a tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123002) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:35:54.852985 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-da5cf540-400c-4724-88c1-15bfda7ad9fc tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb44381220d43b7bdfa744a1dc410a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3242afeef424d588cf102a2f0f38020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:54.866274 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-da5cf540-400c-4724-88c1-15bfda7ad9fc tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] 10.222.0.20 "GET /compute/v2.1/servers/4fbde026-7d69-4924-97e6-28262d00e5db" status: 200 len: 1354 microversion: 2.1 time: 0.478881 Oct 04 18:35:54.868672 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 956/2009] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:54 2022] GET /compute/v2.1/servers/4fbde026-7d69-4924-97e6-28262d00e5db => generated 1354 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:54.899542 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-32c29921-5771-43b4-9fdf-75322bebd25c tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:54.903339 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-32c29921-5771-43b4-9fdf-75322bebd25c tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] [instance: bfc2eb17-e0fe-4f59-974a-d35419f2093d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:54.910817 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-892b4e24-b263-42ed-8c14-905e72acd68a tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] 10.222.0.20 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.269274 Oct 04 18:35:54.912240 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1054/2010] 10.222.0.20 () {58 vars in 1154 bytes} [Tue Oct 4 18:35:54 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:35:54.919970 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e8a8529c-448d-470b-aa1e-e48dd2e0c0f0 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:54.920661 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-32c29921-5771-43b4-9fdf-75322bebd25c tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:54.920905 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e8a8529c-448d-470b-aa1e-e48dd2e0c0f0 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: 600147f3-401d-4897-8ce1-0f536234c3fa] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:54.921389 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-32c29921-5771-43b4-9fdf-75322bebd25c tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:54.921878 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-32c29921-5771-43b4-9fdf-75322bebd25c tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:54.923290 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-32c29921-5771-43b4-9fdf-75322bebd25c tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:54.924491 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-32c29921-5771-43b4-9fdf-75322bebd25c tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:54.926217 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-32c29921-5771-43b4-9fdf-75322bebd25c tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:54.929251 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e8a8529c-448d-470b-aa1e-e48dd2e0c0f0 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:54.930113 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e8a8529c-448d-470b-aa1e-e48dd2e0c0f0 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:54.930828 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e8a8529c-448d-470b-aa1e-e48dd2e0c0f0 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:54.931715 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e8a8529c-448d-470b-aa1e-e48dd2e0c0f0 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:54.932678 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e8a8529c-448d-470b-aa1e-e48dd2e0c0f0 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:54.934852 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e8a8529c-448d-470b-aa1e-e48dd2e0c0f0 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:54.946716 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=12 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:55.422394 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-32c29921-5771-43b4-9fdf-75322bebd25c tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa52dda618b4da394932ec8e37ad065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4c8595d87e49aba075a9372572093a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:55.427456 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e8a8529c-448d-470b-aa1e-e48dd2e0c0f0 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:55.437519 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e8a8529c-448d-470b-aa1e-e48dd2e0c0f0 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/600147f3-401d-4897-8ce1-0f536234c3fa" status: 200 len: 1307 microversion: 2.1 time: 0.523458 Oct 04 18:35:55.437874 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-32c29921-5771-43b4-9fdf-75322bebd25c tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] 10.222.0.20 "GET /compute/v2.1/servers/bfc2eb17-e0fe-4f59-974a-d35419f2093d" status: 200 len: 1325 microversion: 2.1 time: 0.565532 Oct 04 18:35:55.444077 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1055/2011] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:54 2022] GET /compute/v2.1/servers/600147f3-401d-4897-8ce1-0f536234c3fa => generated 1307 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:55.459927 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 957/2012] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:54 2022] GET /compute/v2.1/servers/bfc2eb17-e0fe-4f59-974a-d35419f2093d => generated 1325 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:55.461025 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0a3a5b61-db3b-4a4f-a919-365991a740ce tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:55.468019 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0a3a5b61-db3b-4a4f-a919-365991a740ce tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:55.468543 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0a3a5b61-db3b-4a4f-a919-365991a740ce tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:55.468984 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0a3a5b61-db3b-4a4f-a919-365991a740ce tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:55.470341 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c5177f89-ff62-48c2-afd8-b46cbd4220f3 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:55.473000 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c5177f89-ff62-48c2-afd8-b46cbd4220f3 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 158e9f52-fd16-48d1-87b5-e0dd523e97a4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:55.490038 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c5177f89-ff62-48c2-afd8-b46cbd4220f3 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:55.490038 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c5177f89-ff62-48c2-afd8-b46cbd4220f3 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:55.490038 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c5177f89-ff62-48c2-afd8-b46cbd4220f3 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:55.490038 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c5177f89-ff62-48c2-afd8-b46cbd4220f3 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:55.490038 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c5177f89-ff62-48c2-afd8-b46cbd4220f3 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:55.490038 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c5177f89-ff62-48c2-afd8-b46cbd4220f3 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:55.502890 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=100 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:55.527778 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c5177f89-ff62-48c2-afd8-b46cbd4220f3 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064447 Oct 04 18:35:55.529198 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1056/2013] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 18:35:55 2022] GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:35:55.535009 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-f2040698-e98d-4895-9b8a-d1a76696f340 req-79534ab2-7bfb-4953-8ce3-ab8b2f85d9b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "600147f3-401d-4897-8ce1-0f536234c3fa", "name": "network-vif-plugged", "status": "completed", "tag": "a25f2711-7194-4624-bebd-55e73ad4b5c9"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:55.547478 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-f2040698-e98d-4895-9b8a-d1a76696f340 req-79534ab2-7bfb-4953-8ce3-ab8b2f85d9b4 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:55.548046 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-f2040698-e98d-4895-9b8a-d1a76696f340 req-79534ab2-7bfb-4953-8ce3-ab8b2f85d9b4 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:55.548510 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-f2040698-e98d-4895-9b8a-d1a76696f340 req-79534ab2-7bfb-4953-8ce3-ab8b2f85d9b4 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:55.577479 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-f2040698-e98d-4895-9b8a-d1a76696f340 req-79534ab2-7bfb-4953-8ce3-ab8b2f85d9b4 service nova] Creating event network-vif-plugged:a25f2711-7194-4624-bebd-55e73ad4b5c9 for instance 600147f3-401d-4897-8ce1-0f536234c3fa on n-h1-850501-14 Oct 04 18:35:55.582015 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0a3a5b61-db3b-4a4f-a919-365991a740ce tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] [instance: c3a29732-fa0a-4dfd-8475-0f43e9bb0846] Going to try to start instance {{(pid=123001) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 04 18:35:55.585101 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-f2040698-e98d-4895-9b8a-d1a76696f340 req-79534ab2-7bfb-4953-8ce3-ab8b2f85d9b4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054676 Oct 04 18:35:55.586593 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1057/2014] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:35:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:35:55.594027 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c1f08525-241c-4136-926f-57fa15572678 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:55.595822 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c1f08525-241c-4136-926f-57fa15572678 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 3ead1560-9c23-48ad-a938-6b3179b70035] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:55.603267 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c1f08525-241c-4136-926f-57fa15572678 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:55.604970 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c1f08525-241c-4136-926f-57fa15572678 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:55.604970 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c1f08525-241c-4136-926f-57fa15572678 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:55.604970 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c1f08525-241c-4136-926f-57fa15572678 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:55.605330 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c1f08525-241c-4136-926f-57fa15572678 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:55.605739 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c1f08525-241c-4136-926f-57fa15572678 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:55.754652 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c1f08525-241c-4136-926f-57fa15572678 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:55.762655 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c1f08525-241c-4136-926f-57fa15572678 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035" status: 200 len: 1312 microversion: 2.1 time: 0.174941 Oct 04 18:35:55.766420 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1058/2015] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:55 2022] GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035 => generated 1312 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:55.769061 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-42aeaa6a-442f-4eda-b605-0a2ddb09078a tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:55.769664 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-42aeaa6a-442f-4eda-b605-0a2ddb09078a tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:55.776844 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-42aeaa6a-442f-4eda-b605-0a2ddb09078a tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:55.777330 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-42aeaa6a-442f-4eda-b605-0a2ddb09078a tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:55.777765 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-42aeaa6a-442f-4eda-b605-0a2ddb09078a tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:55.778466 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-42aeaa6a-442f-4eda-b605-0a2ddb09078a tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:55.778936 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-42aeaa6a-442f-4eda-b605-0a2ddb09078a tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:55.779362 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-42aeaa6a-442f-4eda-b605-0a2ddb09078a tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:55.856107 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-42aeaa6a-442f-4eda-b605-0a2ddb09078a tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:55.866357 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-42aeaa6a-442f-4eda-b605-0a2ddb09078a tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:55.869032 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-42aeaa6a-442f-4eda-b605-0a2ddb09078a tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:55.870041 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0a3a5b61-db3b-4a4f-a919-365991a740ce tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] 10.222.0.20 "POST /compute/v2.1/servers/c3a29732-fa0a-4dfd-8475-0f43e9bb0846/action" status: 202 len: 0 microversion: 2.1 time: 0.415829 Oct 04 18:35:55.870998 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 958/2016] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:35:55 2022] POST /compute/v2.1/servers/c3a29732-fa0a-4dfd-8475-0f43e9bb0846/action => generated 0 bytes in 418 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:35:55.881964 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-699a3e75-1052-41fe-b29b-e2ad14ce8dcd tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:55.882983 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-699a3e75-1052-41fe-b29b-e2ad14ce8dcd tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] [instance: c3a29732-fa0a-4dfd-8475-0f43e9bb0846] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:55.892427 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-699a3e75-1052-41fe-b29b-e2ad14ce8dcd tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:55.893129 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-42aeaa6a-442f-4eda-b605-0a2ddb09078a tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1544 microversion: 2.91 time: 0.128620 Oct 04 18:35:55.893496 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-699a3e75-1052-41fe-b29b-e2ad14ce8dcd tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:55.893711 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1059/2017] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:55 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1544 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:55.893945 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-699a3e75-1052-41fe-b29b-e2ad14ce8dcd tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:55.895039 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-699a3e75-1052-41fe-b29b-e2ad14ce8dcd tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:55.895681 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-699a3e75-1052-41fe-b29b-e2ad14ce8dcd tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:55.896137 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-699a3e75-1052-41fe-b29b-e2ad14ce8dcd tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:55.904293 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e28b2850-efaa-47e2-a692-91a8338542c7 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:55.905715 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e28b2850-efaa-47e2-a692-91a8338542c7 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] [instance: 4fbde026-7d69-4924-97e6-28262d00e5db] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:55.913602 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e28b2850-efaa-47e2-a692-91a8338542c7 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:55.914562 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e28b2850-efaa-47e2-a692-91a8338542c7 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:55.919445 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e28b2850-efaa-47e2-a692-91a8338542c7 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:55.919445 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e28b2850-efaa-47e2-a692-91a8338542c7 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:55.919445 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e28b2850-efaa-47e2-a692-91a8338542c7 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:55.919445 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e28b2850-efaa-47e2-a692-91a8338542c7 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:56.137387 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-699a3e75-1052-41fe-b29b-e2ad14ce8dcd tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81e50834114f0fa3cca4b0b9f8acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4650d613cb84018b92dc5d51486885e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:56.145676 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e28b2850-efaa-47e2-a692-91a8338542c7 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb44381220d43b7bdfa744a1dc410a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3242afeef424d588cf102a2f0f38020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:56.151017 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-699a3e75-1052-41fe-b29b-e2ad14ce8dcd tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] 10.222.0.20 "GET /compute/v2.1/servers/c3a29732-fa0a-4dfd-8475-0f43e9bb0846" status: 200 len: 1508 microversion: 2.1 time: 0.273434 Oct 04 18:35:56.151741 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 959/2018] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:55 2022] GET /compute/v2.1/servers/c3a29732-fa0a-4dfd-8475-0f43e9bb0846 => generated 1508 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:56.154785 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e28b2850-efaa-47e2-a692-91a8338542c7 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] 10.222.0.20 "GET /compute/v2.1/servers/4fbde026-7d69-4924-97e6-28262d00e5db" status: 200 len: 1354 microversion: 2.1 time: 0.257127 Oct 04 18:35:56.155716 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1060/2019] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:55 2022] GET /compute/v2.1/servers/4fbde026-7d69-4924-97e6-28262d00e5db => generated 1354 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:56.468952 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-331da045-a359-4bf3-95d9-204da3cf8a5c tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:56.471272 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-331da045-a359-4bf3-95d9-204da3cf8a5c tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: 600147f3-401d-4897-8ce1-0f536234c3fa] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:56.474230 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-aad0e3b6-a3c5-4f3c-a494-3ded352e037f tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:56.474859 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-aad0e3b6-a3c5-4f3c-a494-3ded352e037f tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] [instance: bfc2eb17-e0fe-4f59-974a-d35419f2093d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:56.483378 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-331da045-a359-4bf3-95d9-204da3cf8a5c tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:56.483865 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-331da045-a359-4bf3-95d9-204da3cf8a5c tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:56.484334 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-331da045-a359-4bf3-95d9-204da3cf8a5c tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:56.485072 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-331da045-a359-4bf3-95d9-204da3cf8a5c tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:56.486757 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-331da045-a359-4bf3-95d9-204da3cf8a5c tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:56.487316 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-331da045-a359-4bf3-95d9-204da3cf8a5c tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:56.491079 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aad0e3b6-a3c5-4f3c-a494-3ded352e037f tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:56.491579 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aad0e3b6-a3c5-4f3c-a494-3ded352e037f tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:56.492210 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aad0e3b6-a3c5-4f3c-a494-3ded352e037f tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:56.492915 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aad0e3b6-a3c5-4f3c-a494-3ded352e037f tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:56.493369 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aad0e3b6-a3c5-4f3c-a494-3ded352e037f tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:56.493792 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aad0e3b6-a3c5-4f3c-a494-3ded352e037f tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:56.780425 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-331da045-a359-4bf3-95d9-204da3cf8a5c tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:56.792927 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-331da045-a359-4bf3-95d9-204da3cf8a5c tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/600147f3-401d-4897-8ce1-0f536234c3fa" status: 200 len: 1307 microversion: 2.1 time: 0.328053 Oct 04 18:35:56.813418 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-aad0e3b6-a3c5-4f3c-a494-3ded352e037f tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa52dda618b4da394932ec8e37ad065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4c8595d87e49aba075a9372572093a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:56.821576 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1061/2020] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:56 2022] GET /compute/v2.1/servers/600147f3-401d-4897-8ce1-0f536234c3fa => generated 1307 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:56.824582 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-aad0e3b6-a3c5-4f3c-a494-3ded352e037f tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] 10.222.0.20 "GET /compute/v2.1/servers/bfc2eb17-e0fe-4f59-974a-d35419f2093d" status: 200 len: 1325 microversion: 2.1 time: 0.360034 Oct 04 18:35:56.838428 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 960/2021] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:56 2022] GET /compute/v2.1/servers/bfc2eb17-e0fe-4f59-974a-d35419f2093d => generated 1325 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:56.838739 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1462013d-7625-4616-853f-7021fb5dafe4 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:56.838739 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1462013d-7625-4616-853f-7021fb5dafe4 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 158e9f52-fd16-48d1-87b5-e0dd523e97a4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:56.838951 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-43dea7f9-96ea-47b7-9bb8-e99c3c169078 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:56.842332 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-43dea7f9-96ea-47b7-9bb8-e99c3c169078 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 3ead1560-9c23-48ad-a938-6b3179b70035] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:56.851255 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1462013d-7625-4616-853f-7021fb5dafe4 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:56.851754 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1462013d-7625-4616-853f-7021fb5dafe4 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:56.852232 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1462013d-7625-4616-853f-7021fb5dafe4 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:56.852979 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1462013d-7625-4616-853f-7021fb5dafe4 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:56.853437 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1462013d-7625-4616-853f-7021fb5dafe4 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:56.853892 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1462013d-7625-4616-853f-7021fb5dafe4 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:56.854462 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-43dea7f9-96ea-47b7-9bb8-e99c3c169078 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:56.855632 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-43dea7f9-96ea-47b7-9bb8-e99c3c169078 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:56.856416 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-43dea7f9-96ea-47b7-9bb8-e99c3c169078 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:56.857159 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-43dea7f9-96ea-47b7-9bb8-e99c3c169078 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:56.857932 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-43dea7f9-96ea-47b7-9bb8-e99c3c169078 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:56.858371 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-43dea7f9-96ea-47b7-9bb8-e99c3c169078 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:56.906686 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1462013d-7625-4616-853f-7021fb5dafe4 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075653 Oct 04 18:35:56.906686 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1062/2022] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 18:35:56 2022] GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:35:56.927710 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-26e6fb92-1373-436f-bc4c-661b0c0ba92f tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:56.928523 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-26e6fb92-1373-436f-bc4c-661b0c0ba92f tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:56.934678 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-26e6fb92-1373-436f-bc4c-661b0c0ba92f tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:56.935270 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-26e6fb92-1373-436f-bc4c-661b0c0ba92f tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:56.936095 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-26e6fb92-1373-436f-bc4c-661b0c0ba92f tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:56.941359 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-26e6fb92-1373-436f-bc4c-661b0c0ba92f tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:56.941359 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-26e6fb92-1373-436f-bc4c-661b0c0ba92f tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:56.941359 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-26e6fb92-1373-436f-bc4c-661b0c0ba92f tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:57.059753 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-43dea7f9-96ea-47b7-9bb8-e99c3c169078 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:57.062846 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-26e6fb92-1373-436f-bc4c-661b0c0ba92f tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:57.074443 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-26e6fb92-1373-436f-bc4c-661b0c0ba92f tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:57.078658 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-43dea7f9-96ea-47b7-9bb8-e99c3c169078 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035" status: 200 len: 1312 microversion: 2.1 time: 0.248110 Oct 04 18:35:57.079186 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-26e6fb92-1373-436f-bc4c-661b0c0ba92f tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:57.079384 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 961/2023] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:56 2022] GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035 => generated 1312 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:57.083898 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-26e6fb92-1373-436f-bc4c-661b0c0ba92f tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1544 microversion: 2.91 time: 0.160012 Oct 04 18:35:57.100098 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1063/2024] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:56 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1544 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:35:57.179319 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-728f3747-cef9-42b5-9b72-19c46acb77ac tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:57.181586 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-154c5f7f-766f-4ee5-8bf2-39b3ca16f5ae tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:57.182910 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-728f3747-cef9-42b5-9b72-19c46acb77ac tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] [instance: 4fbde026-7d69-4924-97e6-28262d00e5db] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:57.184807 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-154c5f7f-766f-4ee5-8bf2-39b3ca16f5ae tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] [instance: c3a29732-fa0a-4dfd-8475-0f43e9bb0846] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:57.194890 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-728f3747-cef9-42b5-9b72-19c46acb77ac tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:57.200585 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-154c5f7f-766f-4ee5-8bf2-39b3ca16f5ae tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:57.201407 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-728f3747-cef9-42b5-9b72-19c46acb77ac tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:57.202136 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-728f3747-cef9-42b5-9b72-19c46acb77ac tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:57.202923 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-154c5f7f-766f-4ee5-8bf2-39b3ca16f5ae tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:57.204494 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-728f3747-cef9-42b5-9b72-19c46acb77ac tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:57.205247 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-154c5f7f-766f-4ee5-8bf2-39b3ca16f5ae tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:57.206243 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-154c5f7f-766f-4ee5-8bf2-39b3ca16f5ae tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:57.207004 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-728f3747-cef9-42b5-9b72-19c46acb77ac tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:57.207705 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-154c5f7f-766f-4ee5-8bf2-39b3ca16f5ae tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:57.208432 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-728f3747-cef9-42b5-9b72-19c46acb77ac tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:57.209114 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-154c5f7f-766f-4ee5-8bf2-39b3ca16f5ae tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:57.614822 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-728f3747-cef9-42b5-9b72-19c46acb77ac tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb44381220d43b7bdfa744a1dc410a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3242afeef424d588cf102a2f0f38020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:57.626838 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-728f3747-cef9-42b5-9b72-19c46acb77ac tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] 10.222.0.20 "GET /compute/v2.1/servers/4fbde026-7d69-4924-97e6-28262d00e5db" status: 200 len: 1354 microversion: 2.1 time: 0.451058 Oct 04 18:35:57.645996 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1064/2025] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:57 2022] GET /compute/v2.1/servers/4fbde026-7d69-4924-97e6-28262d00e5db => generated 1354 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:57.660226 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-154c5f7f-766f-4ee5-8bf2-39b3ca16f5ae tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81e50834114f0fa3cca4b0b9f8acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4650d613cb84018b92dc5d51486885e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:57.676283 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-154c5f7f-766f-4ee5-8bf2-39b3ca16f5ae tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] 10.222.0.20 "GET /compute/v2.1/servers/c3a29732-fa0a-4dfd-8475-0f43e9bb0846" status: 200 len: 1508 microversion: 2.1 time: 0.504879 Oct 04 18:35:57.677173 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 962/2026] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:57 2022] GET /compute/v2.1/servers/c3a29732-fa0a-4dfd-8475-0f43e9bb0846 => generated 1508 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:57.817442 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-05bef8da-3f2c-4155-9dc7-659d7b43de8b tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:57.818057 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-05bef8da-3f2c-4155-9dc7-659d7b43de8b tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: 600147f3-401d-4897-8ce1-0f536234c3fa] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:57.832097 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-05bef8da-3f2c-4155-9dc7-659d7b43de8b tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:57.832823 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-05bef8da-3f2c-4155-9dc7-659d7b43de8b tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:57.833290 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-05bef8da-3f2c-4155-9dc7-659d7b43de8b tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:57.833968 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-05bef8da-3f2c-4155-9dc7-659d7b43de8b tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:57.834429 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-05bef8da-3f2c-4155-9dc7-659d7b43de8b tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:57.834857 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-05bef8da-3f2c-4155-9dc7-659d7b43de8b tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:57.852020 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-567631c2-58c1-4be1-9125-8db00c58084b tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:57.853057 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-567631c2-58c1-4be1-9125-8db00c58084b tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] [instance: bfc2eb17-e0fe-4f59-974a-d35419f2093d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:57.859634 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-567631c2-58c1-4be1-9125-8db00c58084b tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:57.861027 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-567631c2-58c1-4be1-9125-8db00c58084b tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:57.861646 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-567631c2-58c1-4be1-9125-8db00c58084b tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:57.862713 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-567631c2-58c1-4be1-9125-8db00c58084b tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:57.863389 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-567631c2-58c1-4be1-9125-8db00c58084b tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:57.864012 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-567631c2-58c1-4be1-9125-8db00c58084b tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:58.139047 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-567631c2-58c1-4be1-9125-8db00c58084b tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa52dda618b4da394932ec8e37ad065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4c8595d87e49aba075a9372572093a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:58.142672 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-05bef8da-3f2c-4155-9dc7-659d7b43de8b tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:58.153227 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-05bef8da-3f2c-4155-9dc7-659d7b43de8b tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/600147f3-401d-4897-8ce1-0f536234c3fa" status: 200 len: 1307 microversion: 2.1 time: 0.340342 Oct 04 18:35:58.154382 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1065/2027] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:57 2022] GET /compute/v2.1/servers/600147f3-401d-4897-8ce1-0f536234c3fa => generated 1307 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:58.160824 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b2508ce6-ed49-4e1d-b163-151bcc1fc7cb tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:58.163403 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b2508ce6-ed49-4e1d-b163-151bcc1fc7cb tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 158e9f52-fd16-48d1-87b5-e0dd523e97a4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:58.169926 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-567631c2-58c1-4be1-9125-8db00c58084b tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] 10.222.0.20 "GET /compute/v2.1/servers/bfc2eb17-e0fe-4f59-974a-d35419f2093d" status: 200 len: 1325 microversion: 2.1 time: 0.306351 Oct 04 18:35:58.170903 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b2508ce6-ed49-4e1d-b163-151bcc1fc7cb tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:58.171651 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b2508ce6-ed49-4e1d-b163-151bcc1fc7cb tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:58.172332 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b2508ce6-ed49-4e1d-b163-151bcc1fc7cb tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:58.174571 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b2508ce6-ed49-4e1d-b163-151bcc1fc7cb tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:58.175207 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b2508ce6-ed49-4e1d-b163-151bcc1fc7cb tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:58.175807 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b2508ce6-ed49-4e1d-b163-151bcc1fc7cb tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:58.176939 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 963/2028] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:57 2022] GET /compute/v2.1/servers/bfc2eb17-e0fe-4f59-974a-d35419f2093d => generated 1325 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:35:58.201134 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-18516a3c-009d-47d1-8699-230a88f750e9 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:58.201903 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-18516a3c-009d-47d1-8699-230a88f750e9 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 3ead1560-9c23-48ad-a938-6b3179b70035] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:58.213203 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b2508ce6-ed49-4e1d-b163-151bcc1fc7cb tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057463 Oct 04 18:35:58.218539 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1066/2029] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 18:35:58 2022] GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:35:58.221213 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-18516a3c-009d-47d1-8699-230a88f750e9 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:58.222025 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-18516a3c-009d-47d1-8699-230a88f750e9 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:58.222487 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-18516a3c-009d-47d1-8699-230a88f750e9 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:58.223224 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-18516a3c-009d-47d1-8699-230a88f750e9 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:58.223682 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-18516a3c-009d-47d1-8699-230a88f750e9 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:58.224130 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-18516a3c-009d-47d1-8699-230a88f750e9 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:58.226483 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ec6adb6c-9382-4ec2-90fc-f6751ef252c6 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:58.227463 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ec6adb6c-9382-4ec2-90fc-f6751ef252c6 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:58.234613 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ec6adb6c-9382-4ec2-90fc-f6751ef252c6 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:58.236290 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ec6adb6c-9382-4ec2-90fc-f6751ef252c6 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:58.237139 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ec6adb6c-9382-4ec2-90fc-f6751ef252c6 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:58.238099 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ec6adb6c-9382-4ec2-90fc-f6751ef252c6 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:58.238734 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ec6adb6c-9382-4ec2-90fc-f6751ef252c6 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:58.239318 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ec6adb6c-9382-4ec2-90fc-f6751ef252c6 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:58.349673 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ec6adb6c-9382-4ec2-90fc-f6751ef252c6 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:58.371070 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ec6adb6c-9382-4ec2-90fc-f6751ef252c6 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:58.373484 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ec6adb6c-9382-4ec2-90fc-f6751ef252c6 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:58.382137 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ec6adb6c-9382-4ec2-90fc-f6751ef252c6 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1544 microversion: 2.91 time: 0.161674 Oct 04 18:35:58.383439 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1067/2030] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:35:58 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1544 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:35:58.652120 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-afd21067-d862-4059-a6c9-ebcb096de581 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:58.653245 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-afd21067-d862-4059-a6c9-ebcb096de581 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] [instance: 4fbde026-7d69-4924-97e6-28262d00e5db] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:58.653616 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-18516a3c-009d-47d1-8699-230a88f750e9 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:58.664829 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-afd21067-d862-4059-a6c9-ebcb096de581 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:58.668802 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-afd21067-d862-4059-a6c9-ebcb096de581 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:58.670329 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-afd21067-d862-4059-a6c9-ebcb096de581 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:58.671237 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-afd21067-d862-4059-a6c9-ebcb096de581 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:58.671960 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-18516a3c-009d-47d1-8699-230a88f750e9 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035" status: 200 len: 1312 microversion: 2.1 time: 0.493577 Oct 04 18:35:58.677396 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-afd21067-d862-4059-a6c9-ebcb096de581 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:58.677561 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 964/2031] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:58 2022] GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035 => generated 1312 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:58.677681 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-afd21067-d862-4059-a6c9-ebcb096de581 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:58.707219 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e763cb0f-bbf1-4b79-96d5-579236ff6cd9 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:58.707907 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e763cb0f-bbf1-4b79-96d5-579236ff6cd9 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] [instance: c3a29732-fa0a-4dfd-8475-0f43e9bb0846] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:58.747841 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e763cb0f-bbf1-4b79-96d5-579236ff6cd9 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:58.751827 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e763cb0f-bbf1-4b79-96d5-579236ff6cd9 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:58.752398 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e763cb0f-bbf1-4b79-96d5-579236ff6cd9 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:58.762212 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e763cb0f-bbf1-4b79-96d5-579236ff6cd9 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:58.764472 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e763cb0f-bbf1-4b79-96d5-579236ff6cd9 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:58.764860 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e763cb0f-bbf1-4b79-96d5-579236ff6cd9 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:59.526835 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e763cb0f-bbf1-4b79-96d5-579236ff6cd9 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81e50834114f0fa3cca4b0b9f8acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4650d613cb84018b92dc5d51486885e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:59.544862 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e763cb0f-bbf1-4b79-96d5-579236ff6cd9 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] 10.222.0.20 "GET /compute/v2.1/servers/c3a29732-fa0a-4dfd-8475-0f43e9bb0846" status: 200 len: 1508 microversion: 2.1 time: 0.842947 Oct 04 18:35:59.554918 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 965/2032] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:58 2022] GET /compute/v2.1/servers/c3a29732-fa0a-4dfd-8475-0f43e9bb0846 => generated 1508 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:59.570265 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ed769469-c917-47da-b01c-f95f05706a4e tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:59.577017 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ed769469-c917-47da-b01c-f95f05706a4e tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: 600147f3-401d-4897-8ce1-0f536234c3fa] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:59.608066 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ed769469-c917-47da-b01c-f95f05706a4e tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:59.609726 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ed769469-c917-47da-b01c-f95f05706a4e tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:59.611596 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ed769469-c917-47da-b01c-f95f05706a4e tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:59.617352 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ed769469-c917-47da-b01c-f95f05706a4e tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:59.619037 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ed769469-c917-47da-b01c-f95f05706a4e tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:59.621681 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ed769469-c917-47da-b01c-f95f05706a4e tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:59.744034 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-afd21067-d862-4059-a6c9-ebcb096de581 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb44381220d43b7bdfa744a1dc410a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3242afeef424d588cf102a2f0f38020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:59.771170 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-afd21067-d862-4059-a6c9-ebcb096de581 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] 10.222.0.20 "GET /compute/v2.1/servers/4fbde026-7d69-4924-97e6-28262d00e5db" status: 200 len: 1354 microversion: 2.1 time: 1.124142 Oct 04 18:35:59.788714 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1068/2033] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:58 2022] GET /compute/v2.1/servers/4fbde026-7d69-4924-97e6-28262d00e5db => generated 1354 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:59.795134 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b10c6e33-0e0a-46bc-ad96-b60481720486 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:59.795134 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b10c6e33-0e0a-46bc-ad96-b60481720486 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] [instance: bfc2eb17-e0fe-4f59-974a-d35419f2093d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:59.820437 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b10c6e33-0e0a-46bc-ad96-b60481720486 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:59.827823 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b10c6e33-0e0a-46bc-ad96-b60481720486 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:59.827823 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b10c6e33-0e0a-46bc-ad96-b60481720486 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:59.827823 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b10c6e33-0e0a-46bc-ad96-b60481720486 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:59.827823 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b10c6e33-0e0a-46bc-ad96-b60481720486 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:59.827823 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b10c6e33-0e0a-46bc-ad96-b60481720486 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:00.657759 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ed769469-c917-47da-b01c-f95f05706a4e tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:00.668861 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ed769469-c917-47da-b01c-f95f05706a4e tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/600147f3-401d-4897-8ce1-0f536234c3fa" status: 200 len: 1307 microversion: 2.1 time: 1.121079 Oct 04 18:36:00.683179 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 966/2034] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:59 2022] GET /compute/v2.1/servers/600147f3-401d-4897-8ce1-0f536234c3fa => generated 1307 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:00.683586 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b10c6e33-0e0a-46bc-ad96-b60481720486 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa52dda618b4da394932ec8e37ad065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4c8595d87e49aba075a9372572093a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:00.683718 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-654d9fe7-407b-4abe-b2ac-dab252e116ed tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:00.683718 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-654d9fe7-407b-4abe-b2ac-dab252e116ed tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 158e9f52-fd16-48d1-87b5-e0dd523e97a4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:00.683916 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b10c6e33-0e0a-46bc-ad96-b60481720486 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] 10.222.0.20 "GET /compute/v2.1/servers/bfc2eb17-e0fe-4f59-974a-d35419f2093d" status: 200 len: 1325 microversion: 2.1 time: 0.904262 Oct 04 18:36:00.685000 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1069/2035] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:59 2022] GET /compute/v2.1/servers/bfc2eb17-e0fe-4f59-974a-d35419f2093d => generated 1325 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:00.688264 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-654d9fe7-407b-4abe-b2ac-dab252e116ed tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:00.688664 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-654d9fe7-407b-4abe-b2ac-dab252e116ed tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:00.689142 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-654d9fe7-407b-4abe-b2ac-dab252e116ed tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:00.689867 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-654d9fe7-407b-4abe-b2ac-dab252e116ed tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:00.690329 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-654d9fe7-407b-4abe-b2ac-dab252e116ed tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:00.690756 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-654d9fe7-407b-4abe-b2ac-dab252e116ed tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:00.697632 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2b9c3f8a-d5d4-4dea-b55f-637a82b5a1cc tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:00.698550 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2b9c3f8a-d5d4-4dea-b55f-637a82b5a1cc tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:00.707093 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2b9c3f8a-d5d4-4dea-b55f-637a82b5a1cc tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:00.707535 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2b9c3f8a-d5d4-4dea-b55f-637a82b5a1cc tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:00.707982 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2b9c3f8a-d5d4-4dea-b55f-637a82b5a1cc tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:00.708735 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2b9c3f8a-d5d4-4dea-b55f-637a82b5a1cc tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:00.709241 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2b9c3f8a-d5d4-4dea-b55f-637a82b5a1cc tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:00.709699 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2b9c3f8a-d5d4-4dea-b55f-637a82b5a1cc tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:00.727235 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-654d9fe7-407b-4abe-b2ac-dab252e116ed tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056067 Oct 04 18:36:00.728618 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 967/2036] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 18:36:00 2022] GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:36:00.733278 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c9043ff6-a09f-4e3c-b970-015c52574839 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:00.737931 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c9043ff6-a09f-4e3c-b970-015c52574839 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 3ead1560-9c23-48ad-a938-6b3179b70035] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:00.748804 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c9043ff6-a09f-4e3c-b970-015c52574839 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:00.749922 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c9043ff6-a09f-4e3c-b970-015c52574839 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:00.749922 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c9043ff6-a09f-4e3c-b970-015c52574839 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:00.750552 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c9043ff6-a09f-4e3c-b970-015c52574839 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:00.751707 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c9043ff6-a09f-4e3c-b970-015c52574839 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:00.752165 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c9043ff6-a09f-4e3c-b970-015c52574839 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:00.833817 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2b9c3f8a-d5d4-4dea-b55f-637a82b5a1cc tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:00.856220 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2b9c3f8a-d5d4-4dea-b55f-637a82b5a1cc tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:00.858574 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2b9c3f8a-d5d4-4dea-b55f-637a82b5a1cc tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:00.866818 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2b9c3f8a-d5d4-4dea-b55f-637a82b5a1cc tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1544 microversion: 2.91 time: 0.180720 Oct 04 18:36:00.876398 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1070/2037] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:00 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1544 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:36:00.876398 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-cb7f9437-2530-40cd-9e11-6c6b9ba1c9b8 req-b0c9a8b2-87b1-4795-9580-49aa74323ccd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfc2eb17-e0fe-4f59-974a-d35419f2093d", "name": "network-vif-plugged", "status": "completed", "tag": "5563625e-0101-40d9-a724-0febc25125a4"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:00.886391 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-cb7f9437-2530-40cd-9e11-6c6b9ba1c9b8 req-b0c9a8b2-87b1-4795-9580-49aa74323ccd service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:00.887074 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-cb7f9437-2530-40cd-9e11-6c6b9ba1c9b8 req-b0c9a8b2-87b1-4795-9580-49aa74323ccd service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:00.887642 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-cb7f9437-2530-40cd-9e11-6c6b9ba1c9b8 req-b0c9a8b2-87b1-4795-9580-49aa74323ccd service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:00.904416 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-cb7f9437-2530-40cd-9e11-6c6b9ba1c9b8 req-b0c9a8b2-87b1-4795-9580-49aa74323ccd service nova] Creating event network-vif-plugged:5563625e-0101-40d9-a724-0febc25125a4 for instance bfc2eb17-e0fe-4f59-974a-d35419f2093d on n-h1-850501-14 Oct 04 18:36:00.911311 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-cb7f9437-2530-40cd-9e11-6c6b9ba1c9b8 req-b0c9a8b2-87b1-4795-9580-49aa74323ccd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040487 Oct 04 18:36:00.912741 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1071/2038] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:36:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:36:00.921114 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3f375edd-cc66-4eab-8dd6-825eed9d576a tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:00.922152 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3f375edd-cc66-4eab-8dd6-825eed9d576a tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] [instance: c3a29732-fa0a-4dfd-8475-0f43e9bb0846] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:00.930497 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f375edd-cc66-4eab-8dd6-825eed9d576a tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:00.931359 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f375edd-cc66-4eab-8dd6-825eed9d576a tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:00.932113 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f375edd-cc66-4eab-8dd6-825eed9d576a tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:00.933433 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f375edd-cc66-4eab-8dd6-825eed9d576a tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:00.935126 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f375edd-cc66-4eab-8dd6-825eed9d576a tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:00.936552 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f375edd-cc66-4eab-8dd6-825eed9d576a tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:00.973845 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c9043ff6-a09f-4e3c-b970-015c52574839 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:00.987742 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c9043ff6-a09f-4e3c-b970-015c52574839 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035" status: 200 len: 1312 microversion: 2.1 time: 0.257914 Oct 04 18:36:00.988619 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 968/2039] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:00 2022] GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035 => generated 1312 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:00.993822 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d2114695-5802-470d-9ecd-d4eebfbacb9f tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:00.995306 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d2114695-5802-470d-9ecd-d4eebfbacb9f tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] [instance: 4fbde026-7d69-4924-97e6-28262d00e5db] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:01.009977 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d2114695-5802-470d-9ecd-d4eebfbacb9f tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:01.009977 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d2114695-5802-470d-9ecd-d4eebfbacb9f tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:01.009977 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d2114695-5802-470d-9ecd-d4eebfbacb9f tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:01.009977 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d2114695-5802-470d-9ecd-d4eebfbacb9f tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:01.009977 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d2114695-5802-470d-9ecd-d4eebfbacb9f tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:01.009977 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d2114695-5802-470d-9ecd-d4eebfbacb9f tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:01.256032 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d2114695-5802-470d-9ecd-d4eebfbacb9f tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb44381220d43b7bdfa744a1dc410a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3242afeef424d588cf102a2f0f38020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:01.273582 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d2114695-5802-470d-9ecd-d4eebfbacb9f tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] 10.222.0.20 "GET /compute/v2.1/servers/4fbde026-7d69-4924-97e6-28262d00e5db" status: 200 len: 1354 microversion: 2.1 time: 0.279348 Oct 04 18:36:01.289582 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 969/2040] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:00 2022] GET /compute/v2.1/servers/4fbde026-7d69-4924-97e6-28262d00e5db => generated 1354 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:01.294996 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f3103495-4036-44e9-b021-5efd11159da7 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1848882136", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "f77e917f-247a-463a-8e5a-3fb6256ecb82"}], "block_device_mapping_v2": [{"uuid": "fdefa762-d5ae-41f0-904a-b20f7dbc3fcf", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:01.339493 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3f375edd-cc66-4eab-8dd6-825eed9d576a tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81e50834114f0fa3cca4b0b9f8acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4650d613cb84018b92dc5d51486885e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:01.350376 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3f375edd-cc66-4eab-8dd6-825eed9d576a tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] 10.222.0.20 "GET /compute/v2.1/servers/c3a29732-fa0a-4dfd-8475-0f43e9bb0846" status: 200 len: 1508 microversion: 2.1 time: 0.435662 Oct 04 18:36:01.351440 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1072/2041] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:00 2022] GET /compute/v2.1/servers/c3a29732-fa0a-4dfd-8475-0f43e9bb0846 => generated 1508 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:01.389114 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.neutron [None req-f3103495-4036-44e9-b021-5efd11159da7 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] validate_networks() for [('f77e917f-247a-463a-8e5a-3fb6256ecb82', None, None, None, None, None)] {{(pid=123001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:36:01.696162 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f61e54ad-8973-4ceb-baa4-b9eb1524628e tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:01.696811 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f61e54ad-8973-4ceb-baa4-b9eb1524628e tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: 600147f3-401d-4897-8ce1-0f536234c3fa] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:01.703215 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f61e54ad-8973-4ceb-baa4-b9eb1524628e tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:01.703894 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f61e54ad-8973-4ceb-baa4-b9eb1524628e tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:01.704455 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f61e54ad-8973-4ceb-baa4-b9eb1524628e tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:01.705293 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f61e54ad-8973-4ceb-baa4-b9eb1524628e tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:01.705991 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f61e54ad-8973-4ceb-baa4-b9eb1524628e tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:01.706642 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f61e54ad-8973-4ceb-baa4-b9eb1524628e tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:01.909498 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-f3103495-4036-44e9-b021-5efd11159da7 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:36:01.910010 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-f3103495-4036-44e9-b021-5efd11159da7 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:36:01.910409 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-f3103495-4036-44e9-b021-5efd11159da7 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:36:01.911126 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-f3103495-4036-44e9-b021-5efd11159da7 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:36:01.911727 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-f3103495-4036-44e9-b021-5efd11159da7 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:36:01.921163 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f61e54ad-8973-4ceb-baa4-b9eb1524628e tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:01.923380 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f3103495-4036-44e9-b021-5efd11159da7 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:01.924090 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f3103495-4036-44e9-b021-5efd11159da7 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:01.924728 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f3103495-4036-44e9-b021-5efd11159da7 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:01.925460 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f3103495-4036-44e9-b021-5efd11159da7 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:01.925913 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f3103495-4036-44e9-b021-5efd11159da7 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:01.926519 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f3103495-4036-44e9-b021-5efd11159da7 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:01.929977 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f61e54ad-8973-4ceb-baa4-b9eb1524628e tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/600147f3-401d-4897-8ce1-0f536234c3fa" status: 200 len: 1486 microversion: 2.1 time: 0.237747 Oct 04 18:36:01.931073 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1073/2042] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:01 2022] GET /compute/v2.1/servers/600147f3-401d-4897-8ce1-0f536234c3fa => generated 1486 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:36:01.937521 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-fe25f22c-70d4-491a-b23b-9975ac34ffa0 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:01.941848 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-fe25f22c-70d4-491a-b23b-9975ac34ffa0 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] [instance: bfc2eb17-e0fe-4f59-974a-d35419f2093d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:01.945532 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fe25f22c-70d4-491a-b23b-9975ac34ffa0 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:01.946222 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fe25f22c-70d4-491a-b23b-9975ac34ffa0 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:01.946868 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fe25f22c-70d4-491a-b23b-9975ac34ffa0 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:01.947768 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fe25f22c-70d4-491a-b23b-9975ac34ffa0 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:01.948542 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fe25f22c-70d4-491a-b23b-9975ac34ffa0 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:01.949452 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fe25f22c-70d4-491a-b23b-9975ac34ffa0 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:01.956554 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-f3103495-4036-44e9-b021-5efd11159da7 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Getting quotas for project 1fdde079f17642c69fb250c78903d69c. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:36:01.961676 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-f3103495-4036-44e9-b021-5efd11159da7 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Getting quotas for user f1dec45626f44157a6f4637e668097b4 and project 1fdde079f17642c69fb250c78903d69c. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:36:01.967962 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=100 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:02.024275 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f3103495-4036-44e9-b021-5efd11159da7 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Going to run 1 instances... {{(pid=123001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:36:02.026451 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f3103495-4036-44e9-b021-5efd11159da7 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: cd74aff9-f694-49f3-a1cc-2095b71cd9e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fdefa762-d5ae-41f0-904a-b20f7dbc3fcf',volume_size=None,volume_type=None)] {{(pid=123001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:36:02.112347 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-fe25f22c-70d4-491a-b23b-9975ac34ffa0 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa52dda618b4da394932ec8e37ad065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4c8595d87e49aba075a9372572093a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:02.120313 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-fe25f22c-70d4-491a-b23b-9975ac34ffa0 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] 10.222.0.20 "GET /compute/v2.1/servers/bfc2eb17-e0fe-4f59-974a-d35419f2093d" status: 200 len: 1325 microversion: 2.1 time: 0.188232 Oct 04 18:36:02.120886 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1074/2043] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:01 2022] GET /compute/v2.1/servers/bfc2eb17-e0fe-4f59-974a-d35419f2093d => generated 1325 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:02.125559 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-09eae990-8741-4baf-8598-a251c22ed423 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:02.126187 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-09eae990-8741-4baf-8598-a251c22ed423 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:02.132388 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-09eae990-8741-4baf-8598-a251c22ed423 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:02.132886 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-09eae990-8741-4baf-8598-a251c22ed423 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:02.133332 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-09eae990-8741-4baf-8598-a251c22ed423 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:02.134043 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-09eae990-8741-4baf-8598-a251c22ed423 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:02.134504 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-09eae990-8741-4baf-8598-a251c22ed423 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:02.134931 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-09eae990-8741-4baf-8598-a251c22ed423 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:02.209399 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-09eae990-8741-4baf-8598-a251c22ed423 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:02.218504 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-09eae990-8741-4baf-8598-a251c22ed423 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:02.220034 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-09eae990-8741-4baf-8598-a251c22ed423 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:02.225429 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-09eae990-8741-4baf-8598-a251c22ed423 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1544 microversion: 2.91 time: 0.103563 Oct 04 18:36:02.226264 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1075/2044] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:02 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1544 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:36:02.231648 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0f8fe704-b96e-463c-9560-bb76dc07eb51 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1865421507"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:02.234170 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0f8fe704-b96e-463c-9560-bb76dc07eb51 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: 600147f3-401d-4897-8ce1-0f536234c3fa] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:02.243044 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0f8fe704-b96e-463c-9560-bb76dc07eb51 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:02.243615 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0f8fe704-b96e-463c-9560-bb76dc07eb51 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:02.244727 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0f8fe704-b96e-463c-9560-bb76dc07eb51 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:02.245868 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0f8fe704-b96e-463c-9560-bb76dc07eb51 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:02.246365 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0f8fe704-b96e-463c-9560-bb76dc07eb51 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:02.247009 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0f8fe704-b96e-463c-9560-bb76dc07eb51 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:02.457817 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f3103495-4036-44e9-b021-5efd11159da7 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.166660 Oct 04 18:36:02.458726 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 970/2045] 10.222.0.20 () {62 vars in 1188 bytes} [Tue Oct 4 18:36:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1168 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 18:36:02.463634 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2e82cf67-7a66-4833-9378-9e930861b06f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:02.464496 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2e82cf67-7a66-4833-9378-9e930861b06f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 3ead1560-9c23-48ad-a938-6b3179b70035] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:02.471372 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2e82cf67-7a66-4833-9378-9e930861b06f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:02.473542 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2e82cf67-7a66-4833-9378-9e930861b06f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:02.473542 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2e82cf67-7a66-4833-9378-9e930861b06f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:02.473542 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2e82cf67-7a66-4833-9378-9e930861b06f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:02.494540 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2e82cf67-7a66-4833-9378-9e930861b06f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:02.495192 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2e82cf67-7a66-4833-9378-9e930861b06f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:02.541906 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:02.779663 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-2e82cf67-7a66-4833-9378-9e930861b06f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:02.789025 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2e82cf67-7a66-4833-9378-9e930861b06f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035" status: 200 len: 1312 microversion: 2.1 time: 0.328945 Oct 04 18:36:02.790044 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 971/2046] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:02 2022] GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035 => generated 1312 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:02.793279 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0f8fe704-b96e-463c-9560-bb76dc07eb51 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "POST /compute/v2.1/servers/600147f3-401d-4897-8ce1-0f536234c3fa/action" status: 202 len: 0 microversion: 2.1 time: 0.565191 Oct 04 18:36:02.793947 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1076/2047] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:36:02 2022] POST /compute/v2.1/servers/600147f3-401d-4897-8ce1-0f536234c3fa/action => generated 0 bytes in 567 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 18:36:02.804168 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-119ec643-b20f-4f77-8ab9-b9e165264728 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:02.804777 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-119ec643-b20f-4f77-8ab9-b9e165264728 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] [instance: 4fbde026-7d69-4924-97e6-28262d00e5db] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:02.805263 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-13605bbb-d5bf-41e2-a441-15358df285e5 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:02.805961 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-13605bbb-d5bf-41e2-a441-15358df285e5 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] [instance: c3a29732-fa0a-4dfd-8475-0f43e9bb0846] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:02.811696 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-119ec643-b20f-4f77-8ab9-b9e165264728 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:02.812441 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-119ec643-b20f-4f77-8ab9-b9e165264728 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:02.813267 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-119ec643-b20f-4f77-8ab9-b9e165264728 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:02.814140 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-119ec643-b20f-4f77-8ab9-b9e165264728 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:02.814633 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-13605bbb-d5bf-41e2-a441-15358df285e5 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:02.814978 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-119ec643-b20f-4f77-8ab9-b9e165264728 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:02.815292 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-13605bbb-d5bf-41e2-a441-15358df285e5 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:02.815731 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-13605bbb-d5bf-41e2-a441-15358df285e5 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:02.815887 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-119ec643-b20f-4f77-8ab9-b9e165264728 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:02.817428 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-13605bbb-d5bf-41e2-a441-15358df285e5 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:02.818114 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-13605bbb-d5bf-41e2-a441-15358df285e5 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:02.818601 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-13605bbb-d5bf-41e2-a441-15358df285e5 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:03.094569 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-119ec643-b20f-4f77-8ab9-b9e165264728 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb44381220d43b7bdfa744a1dc410a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3242afeef424d588cf102a2f0f38020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:03.104968 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-119ec643-b20f-4f77-8ab9-b9e165264728 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] 10.222.0.20 "GET /compute/v2.1/servers/4fbde026-7d69-4924-97e6-28262d00e5db" status: 200 len: 1354 microversion: 2.1 time: 0.313551 Oct 04 18:36:03.106363 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 972/2048] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:02 2022] GET /compute/v2.1/servers/4fbde026-7d69-4924-97e6-28262d00e5db => generated 1354 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:03.106994 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-13605bbb-d5bf-41e2-a441-15358df285e5 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81e50834114f0fa3cca4b0b9f8acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4650d613cb84018b92dc5d51486885e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:03.113814 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ecfe130f-fa82-4b62-b4a4-c496a41d9950 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:03.115584 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ecfe130f-fa82-4b62-b4a4-c496a41d9950 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: cd74aff9-f694-49f3-a1cc-2095b71cd9e5] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:03.120734 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-13605bbb-d5bf-41e2-a441-15358df285e5 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] 10.222.0.20 "GET /compute/v2.1/servers/c3a29732-fa0a-4dfd-8475-0f43e9bb0846" status: 200 len: 1508 microversion: 2.1 time: 0.324737 Oct 04 18:36:03.123263 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1077/2049] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:02 2022] GET /compute/v2.1/servers/c3a29732-fa0a-4dfd-8475-0f43e9bb0846 => generated 1508 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:03.136137 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-317b2bd3-d486-4e41-9464-a212721be3cd tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '.version_select at 0x7fe25890f9d0>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:03.200406 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-317b2bd3-d486-4e41-9464-a212721be3cd tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/images/0aa8d42d-6bae-40b6-9e6a-49180df5b746" status: 200 len: 1414 microversion: 2.1 time: 0.075825 Oct 04 18:36:03.208993 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1078/2050] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:36:03 2022] GET /compute/v2.1/images/0aa8d42d-6bae-40b6-9e6a-49180df5b746 => generated 1414 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:03.208993 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-26b0a869-0434-422b-8930-0a12ee102cfc tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:03.208993 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-26b0a869-0434-422b-8930-0a12ee102cfc tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] [instance: bfc2eb17-e0fe-4f59-974a-d35419f2093d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:03.220518 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ecfe130f-fa82-4b62-b4a4-c496a41d9950 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:03.220978 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-26b0a869-0434-422b-8930-0a12ee102cfc tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:03.220978 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-26b0a869-0434-422b-8930-0a12ee102cfc tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:03.220978 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-26b0a869-0434-422b-8930-0a12ee102cfc tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:03.220978 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-26b0a869-0434-422b-8930-0a12ee102cfc tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:03.220978 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-26b0a869-0434-422b-8930-0a12ee102cfc tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:03.223236 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ecfe130f-fa82-4b62-b4a4-c496a41d9950 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:03.224179 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-26b0a869-0434-422b-8930-0a12ee102cfc tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:03.224702 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ecfe130f-fa82-4b62-b4a4-c496a41d9950 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:03.225795 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ecfe130f-fa82-4b62-b4a4-c496a41d9950 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5" status: 200 len: 1104 microversion: 2.25 time: 0.116936 Oct 04 18:36:03.226354 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 973/2051] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:03 2022] GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5 => generated 1104 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:36:03.249375 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-48cca896-a5f1-45a1-aca8-6edc6972db73 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '.version_select at 0x7fe259091ee0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:03.340304 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-48cca896-a5f1-45a1-aca8-6edc6972db73 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/images/0aa8d42d-6bae-40b6-9e6a-49180df5b746" status: 200 len: 1414 microversion: 2.1 time: 0.099716 Oct 04 18:36:03.342142 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 974/2052] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:36:03 2022] GET /compute/v2.1/images/0aa8d42d-6bae-40b6-9e6a-49180df5b746 => generated 1414 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:03.348647 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9f02d2fc-25c0-47e8-b499-fef247585830 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:03.349836 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-9f02d2fc-25c0-47e8-b499-fef247585830 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:03.358220 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9f02d2fc-25c0-47e8-b499-fef247585830 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:03.360095 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9f02d2fc-25c0-47e8-b499-fef247585830 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:03.361200 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9f02d2fc-25c0-47e8-b499-fef247585830 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:03.362792 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9f02d2fc-25c0-47e8-b499-fef247585830 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:03.363865 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9f02d2fc-25c0-47e8-b499-fef247585830 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:03.365183 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9f02d2fc-25c0-47e8-b499-fef247585830 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:03.450430 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9f02d2fc-25c0-47e8-b499-fef247585830 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:03.462303 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9f02d2fc-25c0-47e8-b499-fef247585830 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:03.464028 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9f02d2fc-25c0-47e8-b499-fef247585830 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:03.470477 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9f02d2fc-25c0-47e8-b499-fef247585830 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1544 microversion: 2.91 time: 0.126761 Oct 04 18:36:03.473805 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 975/2053] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:03 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1544 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:36:03.478825 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a8e2d71b-575a-44e9-aabd-3faef5015785 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '.version_select at 0x7fe259091ca0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:03.481037 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-26b0a869-0434-422b-8930-0a12ee102cfc tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa52dda618b4da394932ec8e37ad065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4c8595d87e49aba075a9372572093a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:03.497326 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-26b0a869-0434-422b-8930-0a12ee102cfc tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] 10.222.0.20 "GET /compute/v2.1/servers/bfc2eb17-e0fe-4f59-974a-d35419f2093d" status: 200 len: 1325 microversion: 2.1 time: 0.293837 Oct 04 18:36:03.498223 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1079/2054] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:03 2022] GET /compute/v2.1/servers/bfc2eb17-e0fe-4f59-974a-d35419f2093d => generated 1325 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:03.768684 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a8e2d71b-575a-44e9-aabd-3faef5015785 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "DELETE /compute/v2.1/images/0aa8d42d-6bae-40b6-9e6a-49180df5b746" status: 204 len: 0 microversion: 2.1 time: 0.296552 Oct 04 18:36:03.772158 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 976/2055] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:03 2022] DELETE /compute/v2.1/images/0aa8d42d-6bae-40b6-9e6a-49180df5b746 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:36:03.777667 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4aa99902-f653-4f9d-ab9c-741a431eb069 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '.version_select at 0x7fe258905a60>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:03.801766 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-4aa99902-f653-4f9d-ab9c-741a431eb069 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] HTTP exception thrown: Image not found. Oct 04 18:36:03.801766 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4aa99902-f653-4f9d-ab9c-741a431eb069 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Request method failure captured: Oct 04 18:36:03.801766 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/images/0aa8d42d-6bae-40b6-9e6a-49180df5b746 HTTP/1.1 Oct 04 18:36:03.801766 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:36:03.801766 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:36:03.801766 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:36:03.801766 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:36:03.801766 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:36:03.801766 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:36:03.801766 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:36:03.801766 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:36:03.801766 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPHwUQIR1TKCa6SuO5KxFm7-u_FizcG48Uot0gdIOuCeSh8CFWYcfwzYNxmsP1Ox8pbA_3AaF7FzwotmrVSCbO7eABAZII6tUmaEh-Y24i0KlqIupFERqEnu-z8kdpdoodlufKA0ebuuWvnLVx428den86l5yxh9C2_Lvb9bKR3dLeNk Oct 04 18:36:03.801766 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:36:03.801766 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:36:03.801766 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:36:03.801766 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:36:03.801766 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:36:03.801766 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:36:03.801766 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 08c83d7b68684daf8e67ba2361ad86c9 Oct 04 18:36:03.801766 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ImagesTestJSON-1467584864 Oct 04 18:36:03.801766 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:36:03.801766 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:36:03.801766 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/08c83d7b68684daf8e67ba2361ad86c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_08c83d7b68684daf8e67ba2361ad86c9", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/08c83d7b68684daf8e67ba2361ad86c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/08c83d7b68684daf8e67ba2361ad86c9"}]}] Oct 04 18:36:03.801766 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ImagesTestJSON-1467584864 Oct 04 18:36:03.801766 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 08c83d7b68684daf8e67ba2361ad86c9 Oct 04 18:36:03.801766 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ImagesTestJSON-1467584864 Oct 04 18:36:03.801766 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ImagesTestJSON-1467584864-project Oct 04 18:36:03.801766 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:36:03.801766 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:36:03.801766 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: ef3c7ad35a05450496b6d1ff64f12b77 Oct 04 18:36:03.801766 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ImagesTestJSON-1467584864-project Oct 04 18:36:03.801766 n-d-850501-14 devstack@n-api.service[123002]: method: Oct 04 18:36:03.801766 n-d-850501-14 devstack@n-api.service[123002]: exception: Image not found. Oct 04 18:36:03.801766 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '0aa8d42d-6bae-40b6-9e6a-49180df5b746'} Oct 04 18:36:03.801766 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:36:03.801766 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:03.801766 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 18:36:03.801766 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 18:36:03.801766 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:36:03.801766 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:36:03.801766 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 18:36:03.801766 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 18:36:03.801766 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:36:03.801766 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:36:03.801766 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 18:36:03.801766 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 18:36:03.801766 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 18:36:03.801766 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 18:36:03.801766 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:36:03.801766 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:36:03.801766 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:36:03.801766 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:36:03.801766 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 0aa8d42d-6bae-40b6-9e6a-49180df5b746 Oct 04 18:36:03.801766 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:36:03.801766 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:03.801766 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:36:03.801766 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:03.801766 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 04 18:36:03.801766 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 04 18:36:03.801766 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 18:36:03.801766 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 18:36:03.801766 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 18:36:03.801766 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 18:36:03.806757 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 18:36:03.806757 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 18:36:03.806757 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 18:36:03.806757 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 18:36:03.806757 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:36:03.806757 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:36:03.806757 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 18:36:03.806757 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 18:36:03.806757 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:36:03.806757 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:36:03.806757 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 18:36:03.806757 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 18:36:03.806757 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 18:36:03.806757 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 18:36:03.806757 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:36:03.806757 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:36:03.806757 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:36:03.806757 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:36:03.806757 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0aa8d42d-6bae-40b6-9e6a-49180df5b746 could not be found. Oct 04 18:36:03.806757 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:36:03.806757 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:03.806757 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:36:03.806757 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:03.806757 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:03.806757 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:03.806757 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:36:03.806757 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:36:03.806757 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:36:03.806757 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:36:03.806757 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:36:03.806757 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:36:03.806757 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 04 18:36:03.806757 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 18:36:03.806757 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:36:03.806757 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:36:03.806757 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:03.806757 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:36:03.806757 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:03.806757 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:03.806757 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:03.806757 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:36:03.806757 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:36:03.806757 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:36:03.806757 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:36:03.806757 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4aa99902-f653-4f9d-ab9c-741a431eb069 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Returning 404 to user: Image not found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:36:03.806757 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4aa99902-f653-4f9d-ab9c-741a431eb069 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/images/0aa8d42d-6bae-40b6-9e6a-49180df5b746" status: 404 len: 62 microversion: 2.1 time: 0.029546 Oct 04 18:36:03.806757 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1080/2056] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:36:03 2022] GET /compute/v2.1/images/0aa8d42d-6bae-40b6-9e6a-49180df5b746 => generated 62 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:36:03.812768 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-24723c37-e001-4739-94c3-f20183211cb8 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:03.813825 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-24723c37-e001-4739-94c3-f20183211cb8 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: 600147f3-401d-4897-8ce1-0f536234c3fa] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:03.816746 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ff1c075e-4664-43ef-b4e0-ee8ae11dcb04 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:03.817930 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ff1c075e-4664-43ef-b4e0-ee8ae11dcb04 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 3ead1560-9c23-48ad-a938-6b3179b70035] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:03.820892 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-24723c37-e001-4739-94c3-f20183211cb8 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:03.826299 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-24723c37-e001-4739-94c3-f20183211cb8 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:03.826299 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-24723c37-e001-4739-94c3-f20183211cb8 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:03.826534 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=100 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:03.826639 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-24723c37-e001-4739-94c3-f20183211cb8 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:03.826639 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-24723c37-e001-4739-94c3-f20183211cb8 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:03.826639 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-24723c37-e001-4739-94c3-f20183211cb8 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:03.826897 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ff1c075e-4664-43ef-b4e0-ee8ae11dcb04 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:03.826897 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ff1c075e-4664-43ef-b4e0-ee8ae11dcb04 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:03.826897 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ff1c075e-4664-43ef-b4e0-ee8ae11dcb04 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:03.827167 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ff1c075e-4664-43ef-b4e0-ee8ae11dcb04 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:03.827766 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ff1c075e-4664-43ef-b4e0-ee8ae11dcb04 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:03.828232 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ff1c075e-4664-43ef-b4e0-ee8ae11dcb04 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:04.043805 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-24723c37-e001-4739-94c3-f20183211cb8 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:04.046998 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ff1c075e-4664-43ef-b4e0-ee8ae11dcb04 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:04.054396 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-24723c37-e001-4739-94c3-f20183211cb8 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/600147f3-401d-4897-8ce1-0f536234c3fa" status: 200 len: 1498 microversion: 2.1 time: 0.245994 Oct 04 18:36:04.055539 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 977/2057] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:03 2022] GET /compute/v2.1/servers/600147f3-401d-4897-8ce1-0f536234c3fa => generated 1498 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:04.056784 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ff1c075e-4664-43ef-b4e0-ee8ae11dcb04 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035" status: 200 len: 1312 microversion: 2.1 time: 0.246945 Oct 04 18:36:04.074032 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1081/2058] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:03 2022] GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035 => generated 1312 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:04.130071 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3647c4a0-a658-4e6f-92bb-123b052e626b tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:04.130723 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3647c4a0-a658-4e6f-92bb-123b052e626b tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] [instance: 4fbde026-7d69-4924-97e6-28262d00e5db] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:04.136824 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3647c4a0-a658-4e6f-92bb-123b052e626b tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:04.139419 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3647c4a0-a658-4e6f-92bb-123b052e626b tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:04.139419 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3647c4a0-a658-4e6f-92bb-123b052e626b tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:04.139419 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3647c4a0-a658-4e6f-92bb-123b052e626b tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:04.139419 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3647c4a0-a658-4e6f-92bb-123b052e626b tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:04.139419 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3647c4a0-a658-4e6f-92bb-123b052e626b tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:04.146200 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5200dcb6-8da6-49f9-83fb-87b49475e586 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:04.146814 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5200dcb6-8da6-49f9-83fb-87b49475e586 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] [instance: c3a29732-fa0a-4dfd-8475-0f43e9bb0846] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:04.164374 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5200dcb6-8da6-49f9-83fb-87b49475e586 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:04.168145 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5200dcb6-8da6-49f9-83fb-87b49475e586 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:04.168145 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5200dcb6-8da6-49f9-83fb-87b49475e586 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:04.168145 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5200dcb6-8da6-49f9-83fb-87b49475e586 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:04.168145 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5200dcb6-8da6-49f9-83fb-87b49475e586 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:04.168145 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5200dcb6-8da6-49f9-83fb-87b49475e586 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:04.350579 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3647c4a0-a658-4e6f-92bb-123b052e626b tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb44381220d43b7bdfa744a1dc410a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3242afeef424d588cf102a2f0f38020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:04.366522 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3647c4a0-a658-4e6f-92bb-123b052e626b tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] 10.222.0.20 "GET /compute/v2.1/servers/4fbde026-7d69-4924-97e6-28262d00e5db" status: 200 len: 1354 microversion: 2.1 time: 0.241049 Oct 04 18:36:04.367271 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 978/2059] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:04 2022] GET /compute/v2.1/servers/4fbde026-7d69-4924-97e6-28262d00e5db => generated 1354 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:36:04.372537 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6e44700e-0f10-45f6-b09c-c75c7bc03d3c tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:04.373543 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6e44700e-0f10-45f6-b09c-c75c7bc03d3c tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: cd74aff9-f694-49f3-a1cc-2095b71cd9e5] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:04.376890 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5200dcb6-8da6-49f9-83fb-87b49475e586 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81e50834114f0fa3cca4b0b9f8acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4650d613cb84018b92dc5d51486885e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:04.382285 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6e44700e-0f10-45f6-b09c-c75c7bc03d3c tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:04.383032 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6e44700e-0f10-45f6-b09c-c75c7bc03d3c tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:04.383701 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6e44700e-0f10-45f6-b09c-c75c7bc03d3c tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:04.384701 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6e44700e-0f10-45f6-b09c-c75c7bc03d3c tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:04.385422 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6e44700e-0f10-45f6-b09c-c75c7bc03d3c tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:04.385955 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6e44700e-0f10-45f6-b09c-c75c7bc03d3c tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:04.388970 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5200dcb6-8da6-49f9-83fb-87b49475e586 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] 10.222.0.20 "GET /compute/v2.1/servers/c3a29732-fa0a-4dfd-8475-0f43e9bb0846" status: 200 len: 1512 microversion: 2.1 time: 0.246528 Oct 04 18:36:04.394306 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1082/2060] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:04 2022] GET /compute/v2.1/servers/c3a29732-fa0a-4dfd-8475-0f43e9bb0846 => generated 1512 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:36:04.418870 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-31cc02e4-23e9-4bb3-b448-d240f12fb560 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:04.424910 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-31cc02e4-23e9-4bb3-b448-d240f12fb560 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6a81e50834114f0fa3cca4b0b9f8acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4650d613cb84018b92dc5d51486885e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:04.425363 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.compute.servers [None req-31cc02e4-23e9-4bb3-b448-d240f12fb560 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Removing options 'limit' from query {{(pid=123002) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 04 18:36:04.426140 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-31cc02e4-23e9-4bb3-b448-d240f12fb560 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Searching by: {'deleted': False, 'project_id': 'd4650d613cb84018b92dc5d51486885e'} {{(pid=123002) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:36:04.427281 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-31cc02e4-23e9-4bb3-b448-d240f12fb560 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:04.427758 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-31cc02e4-23e9-4bb3-b448-d240f12fb560 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:04.428217 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-31cc02e4-23e9-4bb3-b448-d240f12fb560 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:04.429143 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-31cc02e4-23e9-4bb3-b448-d240f12fb560 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:04.429835 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-31cc02e4-23e9-4bb3-b448-d240f12fb560 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:04.430739 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-31cc02e4-23e9-4bb3-b448-d240f12fb560 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:04.432163 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-31cc02e4-23e9-4bb3-b448-d240f12fb560 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] 10.222.0.20 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.019377 Oct 04 18:36:04.433031 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1083/2061] 10.222.0.20 () {58 vars in 1140 bytes} [Tue Oct 4 18:36:04 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 18:36:04.446314 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a2d96f7e-3a50-455a-83ac-039d3a127bac tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:04.446937 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a2d96f7e-3a50-455a-83ac-039d3a127bac tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] [instance: c3a29732-fa0a-4dfd-8475-0f43e9bb0846] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:04.456142 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a2d96f7e-3a50-455a-83ac-039d3a127bac tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:04.456763 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a2d96f7e-3a50-455a-83ac-039d3a127bac tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:04.457775 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a2d96f7e-3a50-455a-83ac-039d3a127bac tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:04.458560 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a2d96f7e-3a50-455a-83ac-039d3a127bac tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:04.459229 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a2d96f7e-3a50-455a-83ac-039d3a127bac tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:04.459759 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a2d96f7e-3a50-455a-83ac-039d3a127bac tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:04.459940 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6e44700e-0f10-45f6-b09c-c75c7bc03d3c tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:04.469009 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6e44700e-0f10-45f6-b09c-c75c7bc03d3c tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:04.470480 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6e44700e-0f10-45f6-b09c-c75c7bc03d3c tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:04.471934 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6e44700e-0f10-45f6-b09c-c75c7bc03d3c tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5" status: 200 len: 1177 microversion: 2.25 time: 0.103553 Oct 04 18:36:04.487430 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 979/2062] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:04 2022] GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5 => generated 1177 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:36:04.508040 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b242db3c-7d82-428e-a3ab-4c2fae561225 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:04.509382 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b242db3c-7d82-428e-a3ab-4c2fae561225 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:04.518289 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b242db3c-7d82-428e-a3ab-4c2fae561225 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:04.521974 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b242db3c-7d82-428e-a3ab-4c2fae561225 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:04.521974 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b242db3c-7d82-428e-a3ab-4c2fae561225 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:04.521974 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b242db3c-7d82-428e-a3ab-4c2fae561225 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:04.521974 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b242db3c-7d82-428e-a3ab-4c2fae561225 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:04.521974 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b242db3c-7d82-428e-a3ab-4c2fae561225 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:04.621757 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b242db3c-7d82-428e-a3ab-4c2fae561225 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:04.632782 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b242db3c-7d82-428e-a3ab-4c2fae561225 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:04.634378 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b242db3c-7d82-428e-a3ab-4c2fae561225 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:04.640749 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b242db3c-7d82-428e-a3ab-4c2fae561225 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1544 microversion: 2.91 time: 0.140218 Oct 04 18:36:04.642782 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 980/2063] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:04 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1544 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:36:04.652363 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b14f3445-bc33-4780-a06a-7b703d90f77c tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:04.653341 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b14f3445-bc33-4780-a06a-7b703d90f77c tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] [instance: bfc2eb17-e0fe-4f59-974a-d35419f2093d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:04.664110 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b14f3445-bc33-4780-a06a-7b703d90f77c tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:04.668906 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b14f3445-bc33-4780-a06a-7b703d90f77c tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:04.669578 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b14f3445-bc33-4780-a06a-7b703d90f77c tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:04.670768 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b14f3445-bc33-4780-a06a-7b703d90f77c tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:04.671545 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b14f3445-bc33-4780-a06a-7b703d90f77c tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:04.671980 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b14f3445-bc33-4780-a06a-7b703d90f77c tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:04.678200 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a2d96f7e-3a50-455a-83ac-039d3a127bac tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81e50834114f0fa3cca4b0b9f8acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4650d613cb84018b92dc5d51486885e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:04.686713 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a2d96f7e-3a50-455a-83ac-039d3a127bac tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] 10.222.0.20 "GET /compute/v2.1/servers/c3a29732-fa0a-4dfd-8475-0f43e9bb0846" status: 200 len: 1512 microversion: 2.1 time: 0.244050 Oct 04 18:36:04.688443 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1084/2064] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:04 2022] GET /compute/v2.1/servers/c3a29732-fa0a-4dfd-8475-0f43e9bb0846 => generated 1512 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:36:04.712838 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-880d16de-d8e5-4bbe-b8d1-426eae7d6c51 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:04.713494 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-880d16de-d8e5-4bbe-b8d1-426eae7d6c51 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] [instance: b4d49cb2-f2a4-481b-bdb4-bcdad0649bd2] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:04.724427 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-880d16de-d8e5-4bbe-b8d1-426eae7d6c51 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:04.724927 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-880d16de-d8e5-4bbe-b8d1-426eae7d6c51 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:04.725911 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-880d16de-d8e5-4bbe-b8d1-426eae7d6c51 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:04.726280 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-880d16de-d8e5-4bbe-b8d1-426eae7d6c51 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:04.728642 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-880d16de-d8e5-4bbe-b8d1-426eae7d6c51 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:04.729095 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-880d16de-d8e5-4bbe-b8d1-426eae7d6c51 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:04.729714 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=16 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:04.901358 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b14f3445-bc33-4780-a06a-7b703d90f77c tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa52dda618b4da394932ec8e37ad065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4c8595d87e49aba075a9372572093a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:04.913850 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b14f3445-bc33-4780-a06a-7b703d90f77c tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] 10.222.0.20 "GET /compute/v2.1/servers/bfc2eb17-e0fe-4f59-974a-d35419f2093d" status: 200 len: 1522 microversion: 2.1 time: 0.268559 Oct 04 18:36:04.915539 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 981/2065] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:04 2022] GET /compute/v2.1/servers/bfc2eb17-e0fe-4f59-974a-d35419f2093d => generated 1522 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:04.929805 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-880d16de-d8e5-4bbe-b8d1-426eae7d6c51 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81e50834114f0fa3cca4b0b9f8acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4650d613cb84018b92dc5d51486885e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:04.940295 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-880d16de-d8e5-4bbe-b8d1-426eae7d6c51 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] 10.222.0.20 "GET /compute/v2.1/servers/b4d49cb2-f2a4-481b-bdb4-bcdad0649bd2" status: 200 len: 1512 microversion: 2.1 time: 0.234553 Oct 04 18:36:04.941157 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-424ac920-25fe-4cf5-9a20-e554eef74dac tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:04.941846 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-424ac920-25fe-4cf5-9a20-e554eef74dac tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] [instance: bfc2eb17-e0fe-4f59-974a-d35419f2093d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:04.949138 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-424ac920-25fe-4cf5-9a20-e554eef74dac tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:04.949832 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-424ac920-25fe-4cf5-9a20-e554eef74dac tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:04.951672 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-424ac920-25fe-4cf5-9a20-e554eef74dac tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:04.952422 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-424ac920-25fe-4cf5-9a20-e554eef74dac tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:04.952884 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-424ac920-25fe-4cf5-9a20-e554eef74dac tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:04.953032 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1085/2066] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:04 2022] GET /compute/v2.1/servers/b4d49cb2-f2a4-481b-bdb4-bcdad0649bd2 => generated 1512 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:04.953313 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-424ac920-25fe-4cf5-9a20-e554eef74dac tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:04.967031 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-459e2615-dd1f-485d-b886-e0dd93aca9fb tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:04.968733 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-459e2615-dd1f-485d-b886-e0dd93aca9fb tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] [instance: adc33804-eb64-40ca-a943-f2e74040c1b2] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:04.976541 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-459e2615-dd1f-485d-b886-e0dd93aca9fb tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:04.977315 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-459e2615-dd1f-485d-b886-e0dd93aca9fb tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:04.977925 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-459e2615-dd1f-485d-b886-e0dd93aca9fb tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:04.979116 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-459e2615-dd1f-485d-b886-e0dd93aca9fb tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:04.979751 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-459e2615-dd1f-485d-b886-e0dd93aca9fb tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:04.980619 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-459e2615-dd1f-485d-b886-e0dd93aca9fb tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:04.988953 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-424ac920-25fe-4cf5-9a20-e554eef74dac tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] HTTP exception thrown: Instance is not a member of specified network Oct 04 18:36:04.999117 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-424ac920-25fe-4cf5-9a20-e554eef74dac tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Request method failure captured: Oct 04 18:36:04.999117 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/bfc2eb17-e0fe-4f59-974a-d35419f2093d/ips/invalid HTTP/1.1 Oct 04 18:36:04.999117 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:36:04.999117 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:36:04.999117 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:36:04.999117 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:36:04.999117 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:36:04.999117 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:36:04.999117 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:36:04.999117 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:36:04.999117 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPHzz1H5bE0pKP3M__TyvRgSc44hfKaxGVjfGXMrZ7Eq8wAKjXqVK93MNnZ0vzcO0KLYCfoYkEX58c3fio2TDFftuPARv65TFKn2yRNOFH4f0oiTU5v1WXdc1lcSlYv4pa-TuWpgcn7-Ri37zgoIHXywl9UTcC0NZR0i_n0Jt-QvOOJk Oct 04 18:36:04.999117 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:36:04.999117 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:36:04.999117 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:36:04.999117 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:36:04.999117 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:36:04.999117 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:36:04.999117 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: cd4c8595d87e49aba075a9372572093a Oct 04 18:36:04.999117 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-743873696 Oct 04 18:36:04.999117 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:36:04.999117 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:36:04.999117 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cd4c8595d87e49aba075a9372572093a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_cd4c8595d87e49aba075a9372572093a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/cd4c8595d87e49aba075a9372572093a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cd4c8595d87e49aba075a9372572093a"}]}] Oct 04 18:36:04.999117 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-743873696 Oct 04 18:36:04.999117 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: cd4c8595d87e49aba075a9372572093a Oct 04 18:36:04.999117 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-743873696 Oct 04 18:36:04.999117 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ServerAddressesNegativeTestJSON-743873696-project Oct 04 18:36:04.999117 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:36:04.999117 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:36:04.999117 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: faa52dda618b4da394932ec8e37ad065 Oct 04 18:36:04.999117 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-743873696-project Oct 04 18:36:04.999117 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:36:04.999117 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance is not a member of specified network Oct 04 18:36:04.999117 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'server_id': 'bfc2eb17-e0fe-4f59-974a-d35419f2093d', 'id': 'invalid'} Oct 04 18:36:04.999117 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:36:04.999117 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:04.999117 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:04.999117 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:04.999117 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:36:04.999117 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:36:04.999117 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:36:04.999117 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:36:04.999117 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Oct 04 18:36:04.999117 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 18:36:04.999117 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Oct 04 18:36:04.999117 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:36:04.999117 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:04.999117 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:36:04.999117 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:04.999117 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:04.999117 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:04.999117 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:36:04.999117 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:36:04.999117 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Oct 04 18:36:04.999117 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:36:05.009176 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-424ac920-25fe-4cf5-9a20-e554eef74dac tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Returning 404 to user: Instance is not a member of specified network {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:36:05.009176 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-424ac920-25fe-4cf5-9a20-e554eef74dac tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] 10.222.0.20 "GET /compute/v2.1/servers/bfc2eb17-e0fe-4f59-974a-d35419f2093d/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.065295 Oct 04 18:36:05.009176 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 982/2067] 10.222.0.20 () {58 vars in 1272 bytes} [Tue Oct 4 18:36:04 2022] GET /compute/v2.1/servers/bfc2eb17-e0fe-4f59-974a-d35419f2093d/ips/invalid => generated 91 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:36:05.011443 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5976c4b2-8d93-4b53-8670-55f84ce6ae21 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:05.011928 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5976c4b2-8d93-4b53-8670-55f84ce6ae21 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Failed to fetch instance by id 999 {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 04 18:36:05.012460 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-5976c4b2-8d93-4b53-8670-55f84ce6ae21 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] HTTP exception thrown: Instance 999 could not be found. Oct 04 18:36:05.013897 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5976c4b2-8d93-4b53-8670-55f84ce6ae21 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Request method failure captured: Oct 04 18:36:05.013897 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Oct 04 18:36:05.013897 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:36:05.013897 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:36:05.013897 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:36:05.013897 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:36:05.013897 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:36:05.013897 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:36:05.013897 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:36:05.013897 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:36:05.013897 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPHzz1H5bE0pKP3M__TyvRgSc44hfKaxGVjfGXMrZ7Eq8wAKjXqVK93MNnZ0vzcO0KLYCfoYkEX58c3fio2TDFftuPARv65TFKn2yRNOFH4f0oiTU5v1WXdc1lcSlYv4pa-TuWpgcn7-Ri37zgoIHXywl9UTcC0NZR0i_n0Jt-QvOOJk Oct 04 18:36:05.013897 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:36:05.013897 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:36:05.013897 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:36:05.013897 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:36:05.013897 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:36:05.013897 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:36:05.013897 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: cd4c8595d87e49aba075a9372572093a Oct 04 18:36:05.013897 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-743873696 Oct 04 18:36:05.013897 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:36:05.013897 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:36:05.013897 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cd4c8595d87e49aba075a9372572093a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_cd4c8595d87e49aba075a9372572093a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/cd4c8595d87e49aba075a9372572093a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cd4c8595d87e49aba075a9372572093a"}]}] Oct 04 18:36:05.013897 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-743873696 Oct 04 18:36:05.013897 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: cd4c8595d87e49aba075a9372572093a Oct 04 18:36:05.013897 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-743873696 Oct 04 18:36:05.013897 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ServerAddressesNegativeTestJSON-743873696-project Oct 04 18:36:05.013897 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:36:05.013897 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:36:05.013897 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: faa52dda618b4da394932ec8e37ad065 Oct 04 18:36:05.013897 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-743873696-project Oct 04 18:36:05.013897 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:36:05.013897 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 999 could not be found. Oct 04 18:36:05.013897 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'server_id': '999'} Oct 04 18:36:05.013897 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:36:05.013897 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:05.013897 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:36:05.013897 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:36:05.013897 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 04 18:36:05.013897 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 04 18:36:05.013897 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 04 18:36:05.013897 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:36:05.013897 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:05.013897 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:36:05.013897 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:05.013897 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:05.013897 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:05.013897 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:36:05.013897 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:36:05.013897 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:36:05.013897 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:36:05.013897 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Oct 04 18:36:05.013897 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Oct 04 18:36:05.013897 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:36:05.013897 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:36:05.013897 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 04 18:36:05.013897 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:36:05.013897 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:05.013897 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:36:05.013897 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:05.013897 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:05.013897 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:05.013897 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:36:05.013897 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:36:05.013897 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 04 18:36:05.013897 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:36:05.020068 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5976c4b2-8d93-4b53-8670-55f84ce6ae21 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Returning 404 to user: Instance 999 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:36:05.024026 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5976c4b2-8d93-4b53-8670-55f84ce6ae21 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] 10.222.0.20 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.016341 Oct 04 18:36:05.028782 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 983/2068] 10.222.0.20 () {58 vars in 1149 bytes} [Tue Oct 4 18:36:05 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 04 18:36:05.034569 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-80776329-68f0-4ad3-a7ff-8d8e9ca72f55 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:05.035188 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-80776329-68f0-4ad3-a7ff-8d8e9ca72f55 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] [instance: bfc2eb17-e0fe-4f59-974a-d35419f2093d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:05.044583 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-80776329-68f0-4ad3-a7ff-8d8e9ca72f55 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:05.045319 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-80776329-68f0-4ad3-a7ff-8d8e9ca72f55 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:05.045505 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-80776329-68f0-4ad3-a7ff-8d8e9ca72f55 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:05.046260 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-80776329-68f0-4ad3-a7ff-8d8e9ca72f55 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:05.046740 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-80776329-68f0-4ad3-a7ff-8d8e9ca72f55 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:05.047148 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-80776329-68f0-4ad3-a7ff-8d8e9ca72f55 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:05.084442 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-80776329-68f0-4ad3-a7ff-8d8e9ca72f55 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] [instance: bfc2eb17-e0fe-4f59-974a-d35419f2093d] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:36:05.173433 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-459e2615-dd1f-485d-b886-e0dd93aca9fb tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81e50834114f0fa3cca4b0b9f8acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4650d613cb84018b92dc5d51486885e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:05.182663 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-459e2615-dd1f-485d-b886-e0dd93aca9fb tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] 10.222.0.20 "GET /compute/v2.1/servers/adc33804-eb64-40ca-a943-f2e74040c1b2" status: 200 len: 1513 microversion: 2.1 time: 0.220285 Oct 04 18:36:05.183373 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1086/2069] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:04 2022] GET /compute/v2.1/servers/adc33804-eb64-40ca-a943-f2e74040c1b2 => generated 1513 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:36:05.188700 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0b4075b5-5d4a-42af-b5f1-ec4774cb70cc tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:05.189646 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0b4075b5-5d4a-42af-b5f1-ec4774cb70cc tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: 600147f3-401d-4897-8ce1-0f536234c3fa] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:05.196980 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0b4075b5-5d4a-42af-b5f1-ec4774cb70cc tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:05.197998 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0b4075b5-5d4a-42af-b5f1-ec4774cb70cc tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:05.198897 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0b4075b5-5d4a-42af-b5f1-ec4774cb70cc tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:05.200157 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0b4075b5-5d4a-42af-b5f1-ec4774cb70cc tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:05.201050 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0b4075b5-5d4a-42af-b5f1-ec4774cb70cc tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:05.203374 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0b4075b5-5d4a-42af-b5f1-ec4774cb70cc tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:05.412270 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-80776329-68f0-4ad3-a7ff-8d8e9ca72f55 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] 10.222.0.20 "DELETE /compute/v2.1/servers/bfc2eb17-e0fe-4f59-974a-d35419f2093d" status: 204 len: 0 microversion: 2.1 time: 0.373819 Oct 04 18:36:05.412923 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0b4075b5-5d4a-42af-b5f1-ec4774cb70cc tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:05.413147 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 984/2070] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:36:05 2022] DELETE /compute/v2.1/servers/bfc2eb17-e0fe-4f59-974a-d35419f2093d => generated 0 bytes in 376 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:36:05.413147 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f285b782-d7b1-431a-b59c-2aacf74548d6 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:05.416400 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f285b782-d7b1-431a-b59c-2aacf74548d6 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 3ead1560-9c23-48ad-a938-6b3179b70035] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:05.426304 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f285b782-d7b1-431a-b59c-2aacf74548d6 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:05.427154 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f285b782-d7b1-431a-b59c-2aacf74548d6 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:05.427820 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f285b782-d7b1-431a-b59c-2aacf74548d6 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:05.428643 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f285b782-d7b1-431a-b59c-2aacf74548d6 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:05.429172 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f285b782-d7b1-431a-b59c-2aacf74548d6 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:05.429660 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f285b782-d7b1-431a-b59c-2aacf74548d6 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:05.434366 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0b4075b5-5d4a-42af-b5f1-ec4774cb70cc tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/600147f3-401d-4897-8ce1-0f536234c3fa" status: 200 len: 1498 microversion: 2.1 time: 0.249711 Oct 04 18:36:05.435564 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1087/2071] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:05 2022] GET /compute/v2.1/servers/600147f3-401d-4897-8ce1-0f536234c3fa => generated 1498 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:05.441951 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7e312f5e-12dd-4cd3-bcb8-d94de7f0ad2c tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:05.447513 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7e312f5e-12dd-4cd3-bcb8-d94de7f0ad2c tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6a81e50834114f0fa3cca4b0b9f8acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4650d613cb84018b92dc5d51486885e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:05.448282 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7e312f5e-12dd-4cd3-bcb8-d94de7f0ad2c tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Searching by: {'ip': '172.20.0.13', 'deleted': False, 'project_id': 'd4650d613cb84018b92dc5d51486885e'} {{(pid=123002) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:36:05.682906 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7e312f5e-12dd-4cd3-bcb8-d94de7f0ad2c tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:05.683442 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7e312f5e-12dd-4cd3-bcb8-d94de7f0ad2c tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:05.683875 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7e312f5e-12dd-4cd3-bcb8-d94de7f0ad2c tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:05.684840 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7e312f5e-12dd-4cd3-bcb8-d94de7f0ad2c tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:05.685074 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7e312f5e-12dd-4cd3-bcb8-d94de7f0ad2c tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:05.685721 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7e312f5e-12dd-4cd3-bcb8-d94de7f0ad2c tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:05.823155 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.multi_cell_list [None req-7e312f5e-12dd-4cd3-bcb8-d94de7f0ad2c tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123002) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:36:05.902330 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7e312f5e-12dd-4cd3-bcb8-d94de7f0ad2c tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] 10.222.0.20 "GET /compute/v2.1/servers?ip=172.20.0.13" status: 200 len: 346 microversion: 2.1 time: 0.464992 Oct 04 18:36:05.902915 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1088/2072] 10.222.0.20 () {58 vars in 1154 bytes} [Tue Oct 4 18:36:05 2022] GET /compute/v2.1/servers?ip=172.20.0.13 => generated 346 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:36:05.908080 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-bd0a5a98-5b21-41c7-bbd7-2b8175535754 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:05.908964 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-bd0a5a98-5b21-41c7-bbd7-2b8175535754 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] [instance: 4fbde026-7d69-4924-97e6-28262d00e5db] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:05.917893 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bd0a5a98-5b21-41c7-bbd7-2b8175535754 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:05.918645 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bd0a5a98-5b21-41c7-bbd7-2b8175535754 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:05.919305 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bd0a5a98-5b21-41c7-bbd7-2b8175535754 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:05.920154 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bd0a5a98-5b21-41c7-bbd7-2b8175535754 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:05.920868 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bd0a5a98-5b21-41c7-bbd7-2b8175535754 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:05.921489 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bd0a5a98-5b21-41c7-bbd7-2b8175535754 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:05.926121 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f285b782-d7b1-431a-b59c-2aacf74548d6 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:05.944908 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f285b782-d7b1-431a-b59c-2aacf74548d6 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035" status: 200 len: 1312 microversion: 2.1 time: 0.538773 Oct 04 18:36:05.945661 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 985/2073] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:05 2022] GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035 => generated 1312 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:05.955737 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-96af384a-7818-4e64-a94c-151efa3bf5bc tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:05.956410 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-96af384a-7818-4e64-a94c-151efa3bf5bc tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] [instance: bfc2eb17-e0fe-4f59-974a-d35419f2093d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:05.982303 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-96af384a-7818-4e64-a94c-151efa3bf5bc tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:05.984512 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-96af384a-7818-4e64-a94c-151efa3bf5bc tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:05.986887 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-96af384a-7818-4e64-a94c-151efa3bf5bc tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:05.988803 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-96af384a-7818-4e64-a94c-151efa3bf5bc tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:05.989285 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-96af384a-7818-4e64-a94c-151efa3bf5bc tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:05.992345 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-96af384a-7818-4e64-a94c-151efa3bf5bc tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:06.231047 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-bd0a5a98-5b21-41c7-bbd7-2b8175535754 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb44381220d43b7bdfa744a1dc410a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3242afeef424d588cf102a2f0f38020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:06.241756 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-bd0a5a98-5b21-41c7-bbd7-2b8175535754 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] 10.222.0.20 "GET /compute/v2.1/servers/4fbde026-7d69-4924-97e6-28262d00e5db" status: 200 len: 1354 microversion: 2.1 time: 0.337336 Oct 04 18:36:06.243145 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1089/2074] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:05 2022] GET /compute/v2.1/servers/4fbde026-7d69-4924-97e6-28262d00e5db => generated 1354 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:06.248553 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-420daf69-7101-4d22-b464-baf1c5130378 req-30fb5427-293f-4b08-9bec-2e4773a83ae7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fbde026-7d69-4924-97e6-28262d00e5db", "name": "network-vif-plugged", "status": "completed", "tag": "93b066fb-3183-4276-b726-fe88bd826b24"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:06.266043 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-420daf69-7101-4d22-b464-baf1c5130378 req-30fb5427-293f-4b08-9bec-2e4773a83ae7 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:06.267749 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-96af384a-7818-4e64-a94c-151efa3bf5bc tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa52dda618b4da394932ec8e37ad065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4c8595d87e49aba075a9372572093a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:06.268323 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-420daf69-7101-4d22-b464-baf1c5130378 req-30fb5427-293f-4b08-9bec-2e4773a83ae7 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:06.268959 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-420daf69-7101-4d22-b464-baf1c5130378 req-30fb5427-293f-4b08-9bec-2e4773a83ae7 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:06.276074 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-96af384a-7818-4e64-a94c-151efa3bf5bc tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] 10.222.0.20 "GET /compute/v2.1/servers/bfc2eb17-e0fe-4f59-974a-d35419f2093d" status: 200 len: 1528 microversion: 2.1 time: 0.327679 Oct 04 18:36:06.288085 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 986/2075] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:05 2022] GET /compute/v2.1/servers/bfc2eb17-e0fe-4f59-974a-d35419f2093d => generated 1528 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:06.299841 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5c753244-8440-47c7-968a-d10ad6166fe1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:06.299841 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5c753244-8440-47c7-968a-d10ad6166fe1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: cd74aff9-f694-49f3-a1cc-2095b71cd9e5] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:06.302263 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-420daf69-7101-4d22-b464-baf1c5130378 req-30fb5427-293f-4b08-9bec-2e4773a83ae7 service nova] Creating event network-vif-plugged:93b066fb-3183-4276-b726-fe88bd826b24 for instance 4fbde026-7d69-4924-97e6-28262d00e5db on n-h1-850501-14 Oct 04 18:36:06.310271 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5c753244-8440-47c7-968a-d10ad6166fe1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:06.311775 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5c753244-8440-47c7-968a-d10ad6166fe1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:06.312034 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-420daf69-7101-4d22-b464-baf1c5130378 req-30fb5427-293f-4b08-9bec-2e4773a83ae7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065100 Oct 04 18:36:06.312704 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1090/2076] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:36:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:36:06.313797 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5c753244-8440-47c7-968a-d10ad6166fe1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:06.314752 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5c753244-8440-47c7-968a-d10ad6166fe1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:06.315393 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5c753244-8440-47c7-968a-d10ad6166fe1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:06.316291 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5c753244-8440-47c7-968a-d10ad6166fe1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:06.317947 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a57a58f8-dfbb-4cd2-a3a3-28274d1f9c58 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:06.318799 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a57a58f8-dfbb-4cd2-a3a3-28274d1f9c58 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:06.326157 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a57a58f8-dfbb-4cd2-a3a3-28274d1f9c58 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:06.326585 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a57a58f8-dfbb-4cd2-a3a3-28274d1f9c58 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:06.327030 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a57a58f8-dfbb-4cd2-a3a3-28274d1f9c58 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:06.327743 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a57a58f8-dfbb-4cd2-a3a3-28274d1f9c58 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:06.328241 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a57a58f8-dfbb-4cd2-a3a3-28274d1f9c58 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:06.328935 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a57a58f8-dfbb-4cd2-a3a3-28274d1f9c58 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:06.431039 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5c753244-8440-47c7-968a-d10ad6166fe1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:06.441895 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5c753244-8440-47c7-968a-d10ad6166fe1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:06.444248 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5c753244-8440-47c7-968a-d10ad6166fe1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:06.445793 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5c753244-8440-47c7-968a-d10ad6166fe1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5" status: 200 len: 1251 microversion: 2.25 time: 0.167716 Oct 04 18:36:06.456447 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 987/2077] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:06 2022] GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5 => generated 1251 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:36:06.470556 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a57a58f8-dfbb-4cd2-a3a3-28274d1f9c58 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:06.473262 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-360a15ed-699e-4d33-9cad-a4f2678d23e4 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:06.474067 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-360a15ed-699e-4d33-9cad-a4f2678d23e4 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] [instance: c3a29732-fa0a-4dfd-8475-0f43e9bb0846] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:06.481207 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-360a15ed-699e-4d33-9cad-a4f2678d23e4 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:06.482330 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-360a15ed-699e-4d33-9cad-a4f2678d23e4 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:06.483664 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-360a15ed-699e-4d33-9cad-a4f2678d23e4 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:06.485532 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-360a15ed-699e-4d33-9cad-a4f2678d23e4 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:06.486589 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-360a15ed-699e-4d33-9cad-a4f2678d23e4 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:06.487296 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-360a15ed-699e-4d33-9cad-a4f2678d23e4 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:06.488555 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a57a58f8-dfbb-4cd2-a3a3-28274d1f9c58 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:06.493291 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a57a58f8-dfbb-4cd2-a3a3-28274d1f9c58 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:06.501778 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a57a58f8-dfbb-4cd2-a3a3-28274d1f9c58 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1544 microversion: 2.91 time: 0.187809 Oct 04 18:36:06.504917 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1091/2078] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:06 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1544 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:36:06.510725 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-95f1f612-7cf1-48b1-bf71-46ade70adaa2 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:06.511567 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-95f1f612-7cf1-48b1-bf71-46ade70adaa2 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: 600147f3-401d-4897-8ce1-0f536234c3fa] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:06.520512 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-95f1f612-7cf1-48b1-bf71-46ade70adaa2 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:06.521303 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-95f1f612-7cf1-48b1-bf71-46ade70adaa2 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:06.521939 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-95f1f612-7cf1-48b1-bf71-46ade70adaa2 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:06.522986 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-95f1f612-7cf1-48b1-bf71-46ade70adaa2 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:06.523611 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-95f1f612-7cf1-48b1-bf71-46ade70adaa2 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:06.524247 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-95f1f612-7cf1-48b1-bf71-46ade70adaa2 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:06.852914 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-360a15ed-699e-4d33-9cad-a4f2678d23e4 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81e50834114f0fa3cca4b0b9f8acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4650d613cb84018b92dc5d51486885e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:06.866822 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-360a15ed-699e-4d33-9cad-a4f2678d23e4 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] 10.222.0.20 "GET /compute/v2.1/servers/c3a29732-fa0a-4dfd-8475-0f43e9bb0846" status: 200 len: 1512 microversion: 2.1 time: 0.404191 Oct 04 18:36:06.886370 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 988/2079] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:06 2022] GET /compute/v2.1/servers/c3a29732-fa0a-4dfd-8475-0f43e9bb0846 => generated 1512 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:06.890582 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-95f1f612-7cf1-48b1-bf71-46ade70adaa2 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:06.893741 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2ed5eadb-0118-47ec-8870-1e21531e44db tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:06.895090 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2ed5eadb-0118-47ec-8870-1e21531e44db tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] [instance: b4d49cb2-f2a4-481b-bdb4-bcdad0649bd2] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:06.908676 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-95f1f612-7cf1-48b1-bf71-46ade70adaa2 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/600147f3-401d-4897-8ce1-0f536234c3fa" status: 200 len: 1504 microversion: 2.1 time: 0.400619 Oct 04 18:36:06.909723 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1092/2080] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:06 2022] GET /compute/v2.1/servers/600147f3-401d-4897-8ce1-0f536234c3fa => generated 1504 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:06.915812 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2ed5eadb-0118-47ec-8870-1e21531e44db tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:06.917219 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2ed5eadb-0118-47ec-8870-1e21531e44db tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:06.917853 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2ed5eadb-0118-47ec-8870-1e21531e44db tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:06.919485 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2ed5eadb-0118-47ec-8870-1e21531e44db tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:06.920168 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2ed5eadb-0118-47ec-8870-1e21531e44db tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:06.920773 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2ed5eadb-0118-47ec-8870-1e21531e44db tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:06.974895 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-95288218-af1f-4581-921b-f3d9a01d9aaf tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:06.976121 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-95288218-af1f-4581-921b-f3d9a01d9aaf tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 3ead1560-9c23-48ad-a938-6b3179b70035] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:06.983883 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-95288218-af1f-4581-921b-f3d9a01d9aaf tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:06.984904 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-95288218-af1f-4581-921b-f3d9a01d9aaf tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:06.986434 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-95288218-af1f-4581-921b-f3d9a01d9aaf tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:06.987295 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-95288218-af1f-4581-921b-f3d9a01d9aaf tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:06.989499 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-95288218-af1f-4581-921b-f3d9a01d9aaf tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:06.990056 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-95288218-af1f-4581-921b-f3d9a01d9aaf tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:07.033939 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:07.575440 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-2ed5eadb-0118-47ec-8870-1e21531e44db tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81e50834114f0fa3cca4b0b9f8acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4650d613cb84018b92dc5d51486885e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:07.590213 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2ed5eadb-0118-47ec-8870-1e21531e44db tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] 10.222.0.20 "GET /compute/v2.1/servers/b4d49cb2-f2a4-481b-bdb4-bcdad0649bd2" status: 200 len: 1512 microversion: 2.1 time: 0.701096 Oct 04 18:36:07.591436 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 989/2081] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:06 2022] GET /compute/v2.1/servers/b4d49cb2-f2a4-481b-bdb4-bcdad0649bd2 => generated 1512 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:07.602413 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6e8e0b48-1094-48b3-8916-d0a53dc29a18 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:07.603298 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6e8e0b48-1094-48b3-8916-d0a53dc29a18 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] [instance: 4fbde026-7d69-4924-97e6-28262d00e5db] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:07.620025 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6e8e0b48-1094-48b3-8916-d0a53dc29a18 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:07.623918 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6e8e0b48-1094-48b3-8916-d0a53dc29a18 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:07.630882 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6e8e0b48-1094-48b3-8916-d0a53dc29a18 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:07.631664 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6e8e0b48-1094-48b3-8916-d0a53dc29a18 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:07.632188 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6e8e0b48-1094-48b3-8916-d0a53dc29a18 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:07.632631 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6e8e0b48-1094-48b3-8916-d0a53dc29a18 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:07.642539 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-95288218-af1f-4581-921b-f3d9a01d9aaf tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:07.655556 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-95288218-af1f-4581-921b-f3d9a01d9aaf tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035" status: 200 len: 1312 microversion: 2.1 time: 0.683872 Oct 04 18:36:07.657647 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1093/2082] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:06 2022] GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035 => generated 1312 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:36:07.663306 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:07.679553 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-60a8c5d7-27b7-42b3-a12d-af0bd03753a7 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:07.681445 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-60a8c5d7-27b7-42b3-a12d-af0bd03753a7 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] [instance: bfc2eb17-e0fe-4f59-974a-d35419f2093d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:07.691970 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-60a8c5d7-27b7-42b3-a12d-af0bd03753a7 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:07.703071 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-60a8c5d7-27b7-42b3-a12d-af0bd03753a7 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:07.703678 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-60a8c5d7-27b7-42b3-a12d-af0bd03753a7 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:07.705304 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-60a8c5d7-27b7-42b3-a12d-af0bd03753a7 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:07.706811 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-60a8c5d7-27b7-42b3-a12d-af0bd03753a7 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:07.707519 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-60a8c5d7-27b7-42b3-a12d-af0bd03753a7 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:07.942519 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-60a8c5d7-27b7-42b3-a12d-af0bd03753a7 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa52dda618b4da394932ec8e37ad065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd4c8595d87e49aba075a9372572093a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:07.953333 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-60a8c5d7-27b7-42b3-a12d-af0bd03753a7 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] 10.222.0.20 "GET /compute/v2.1/servers/bfc2eb17-e0fe-4f59-974a-d35419f2093d" status: 200 len: 1486 microversion: 2.1 time: 0.293668 Oct 04 18:36:07.965733 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1094/2083] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:07 2022] GET /compute/v2.1/servers/bfc2eb17-e0fe-4f59-974a-d35419f2093d => generated 1486 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:07.975397 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ab1457ef-599f-45e1-876e-25b7b4e605d4 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:07.980319 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ab1457ef-599f-45e1-876e-25b7b4e605d4 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: cd74aff9-f694-49f3-a1cc-2095b71cd9e5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:07.990502 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ab1457ef-599f-45e1-876e-25b7b4e605d4 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:07.992140 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ab1457ef-599f-45e1-876e-25b7b4e605d4 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:07.992140 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ab1457ef-599f-45e1-876e-25b7b4e605d4 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:07.995838 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ab1457ef-599f-45e1-876e-25b7b4e605d4 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:07.996665 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ab1457ef-599f-45e1-876e-25b7b4e605d4 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:07.997222 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ab1457ef-599f-45e1-876e-25b7b4e605d4 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:08.088274 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6e8e0b48-1094-48b3-8916-d0a53dc29a18 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb44381220d43b7bdfa744a1dc410a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3242afeef424d588cf102a2f0f38020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:08.107225 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6e8e0b48-1094-48b3-8916-d0a53dc29a18 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] 10.222.0.20 "GET /compute/v2.1/servers/4fbde026-7d69-4924-97e6-28262d00e5db" status: 200 len: 1354 microversion: 2.1 time: 0.514341 Oct 04 18:36:08.113560 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 990/2084] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:07 2022] GET /compute/v2.1/servers/4fbde026-7d69-4924-97e6-28262d00e5db => generated 1354 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:08.130229 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ab1457ef-599f-45e1-876e-25b7b4e605d4 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:08.135386 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ec4b1026-d314-4ccf-98bd-cb7b0c4917b8 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:08.136888 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ec4b1026-d314-4ccf-98bd-cb7b0c4917b8 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:08.144262 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:08.146767 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ab1457ef-599f-45e1-876e-25b7b4e605d4 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:08.147309 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec4b1026-d314-4ccf-98bd-cb7b0c4917b8 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:08.147911 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec4b1026-d314-4ccf-98bd-cb7b0c4917b8 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:08.148274 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ab1457ef-599f-45e1-876e-25b7b4e605d4 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:08.148700 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec4b1026-d314-4ccf-98bd-cb7b0c4917b8 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:08.149439 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ab1457ef-599f-45e1-876e-25b7b4e605d4 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5" status: 200 len: 1251 microversion: 2.25 time: 0.182108 Oct 04 18:36:08.149581 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec4b1026-d314-4ccf-98bd-cb7b0c4917b8 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:08.150131 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec4b1026-d314-4ccf-98bd-cb7b0c4917b8 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:08.150658 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec4b1026-d314-4ccf-98bd-cb7b0c4917b8 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:08.152700 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1095/2085] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:07 2022] GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5 => generated 1251 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:36:08.174752 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d5c2d331-d65e-442b-9d25-973df879a171 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:08.176477 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d5c2d331-d65e-442b-9d25-973df879a171 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] [instance: adc33804-eb64-40ca-a943-f2e74040c1b2] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:08.189364 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d5c2d331-d65e-442b-9d25-973df879a171 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:08.190694 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d5c2d331-d65e-442b-9d25-973df879a171 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:08.191936 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d5c2d331-d65e-442b-9d25-973df879a171 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:08.193484 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d5c2d331-d65e-442b-9d25-973df879a171 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:08.194717 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d5c2d331-d65e-442b-9d25-973df879a171 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:08.198143 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d5c2d331-d65e-442b-9d25-973df879a171 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:08.292309 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ec4b1026-d314-4ccf-98bd-cb7b0c4917b8 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:08.307385 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ec4b1026-d314-4ccf-98bd-cb7b0c4917b8 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:08.319010 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ec4b1026-d314-4ccf-98bd-cb7b0c4917b8 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:08.327223 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ec4b1026-d314-4ccf-98bd-cb7b0c4917b8 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1531 microversion: 2.91 time: 0.205038 Oct 04 18:36:08.331591 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 991/2086] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:08 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1531 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:36:08.339801 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-6dd8508a-e75b-4433-85f7-7101c19545ff req-a6284562-a250-4634-ab86-54e85b7c689b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfc2eb17-e0fe-4f59-974a-d35419f2093d", "name": "network-vif-deleted", "tag": "5563625e-0101-40d9-a724-0febc25125a4"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:08.365353 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-6dd8508a-e75b-4433-85f7-7101c19545ff req-a6284562-a250-4634-ab86-54e85b7c689b service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:08.368684 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-6dd8508a-e75b-4433-85f7-7101c19545ff req-a6284562-a250-4634-ab86-54e85b7c689b service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:08.368684 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-6dd8508a-e75b-4433-85f7-7101c19545ff req-a6284562-a250-4634-ab86-54e85b7c689b service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:08.426904 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-6dd8508a-e75b-4433-85f7-7101c19545ff req-a6284562-a250-4634-ab86-54e85b7c689b service nova] Creating event network-vif-deleted:5563625e-0101-40d9-a724-0febc25125a4 for instance bfc2eb17-e0fe-4f59-974a-d35419f2093d on n-h1-850501-14 Oct 04 18:36:08.442176 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-6dd8508a-e75b-4433-85f7-7101c19545ff req-a6284562-a250-4634-ab86-54e85b7c689b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105898 Oct 04 18:36:08.442929 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 992/2087] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:36:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:36:08.453307 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-945ac5d0-c337-4d37-a20a-96ab620e59c7 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:08.454276 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-945ac5d0-c337-4d37-a20a-96ab620e59c7 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: 600147f3-401d-4897-8ce1-0f536234c3fa] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:08.461409 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-945ac5d0-c337-4d37-a20a-96ab620e59c7 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:08.461910 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-945ac5d0-c337-4d37-a20a-96ab620e59c7 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:08.462350 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-945ac5d0-c337-4d37-a20a-96ab620e59c7 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:08.463064 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-945ac5d0-c337-4d37-a20a-96ab620e59c7 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:08.463535 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-945ac5d0-c337-4d37-a20a-96ab620e59c7 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:08.463967 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-945ac5d0-c337-4d37-a20a-96ab620e59c7 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:08.710774 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d5c2d331-d65e-442b-9d25-973df879a171 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81e50834114f0fa3cca4b0b9f8acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4650d613cb84018b92dc5d51486885e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:08.731648 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d5c2d331-d65e-442b-9d25-973df879a171 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] 10.222.0.20 "GET /compute/v2.1/servers/adc33804-eb64-40ca-a943-f2e74040c1b2" status: 200 len: 1513 microversion: 2.1 time: 0.577713 Oct 04 18:36:08.734896 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1096/2088] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:08 2022] GET /compute/v2.1/servers/adc33804-eb64-40ca-a943-f2e74040c1b2 => generated 1513 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:08.743284 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d6fe768e-52ad-4df8-abbc-8e056a952f4e tempest-UnshelveToHostMultiNodesTest-409522397 tempest-UnshelveToHostMultiNodesTest-409522397-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:08.746028 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d6fe768e-52ad-4df8-abbc-8e056a952f4e tempest-UnshelveToHostMultiNodesTest-409522397 tempest-UnshelveToHostMultiNodesTest-409522397-project-admin] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:08.758895 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d6fe768e-52ad-4df8-abbc-8e056a952f4e tempest-UnshelveToHostMultiNodesTest-409522397 tempest-UnshelveToHostMultiNodesTest-409522397-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:08.759723 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d6fe768e-52ad-4df8-abbc-8e056a952f4e tempest-UnshelveToHostMultiNodesTest-409522397 tempest-UnshelveToHostMultiNodesTest-409522397-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:08.760368 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d6fe768e-52ad-4df8-abbc-8e056a952f4e tempest-UnshelveToHostMultiNodesTest-409522397 tempest-UnshelveToHostMultiNodesTest-409522397-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:08.761279 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d6fe768e-52ad-4df8-abbc-8e056a952f4e tempest-UnshelveToHostMultiNodesTest-409522397 tempest-UnshelveToHostMultiNodesTest-409522397-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:08.761909 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d6fe768e-52ad-4df8-abbc-8e056a952f4e tempest-UnshelveToHostMultiNodesTest-409522397 tempest-UnshelveToHostMultiNodesTest-409522397-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:08.762510 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d6fe768e-52ad-4df8-abbc-8e056a952f4e tempest-UnshelveToHostMultiNodesTest-409522397 tempest-UnshelveToHostMultiNodesTest-409522397-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:08.896358 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-945ac5d0-c337-4d37-a20a-96ab620e59c7 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:08.907969 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-945ac5d0-c337-4d37-a20a-96ab620e59c7 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/600147f3-401d-4897-8ce1-0f536234c3fa" status: 200 len: 1499 microversion: 2.1 time: 0.460823 Oct 04 18:36:08.907969 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 993/2089] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:08 2022] GET /compute/v2.1/servers/600147f3-401d-4897-8ce1-0f536234c3fa => generated 1499 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:08.921722 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-591a72ee-b1a9-4b8d-abdc-6d9031d386bb req-452baad1-5d66-4b5c-8af7-0fa7e3557dad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fbde026-7d69-4924-97e6-28262d00e5db", "name": "network-vif-plugged", "status": "completed", "tag": "02a2cc69-90c5-45e4-b836-8c90afdd6218"}, {"server_uuid": "4fbde026-7d69-4924-97e6-28262d00e5db", "name": "network-vif-plugged", "status": "completed", "tag": "03780673-89a1-4320-8c01-92071ed08378"}, {"server_uuid": "3ead1560-9c23-48ad-a938-6b3179b70035", "name": "network-vif-plugged", "status": "completed", "tag": "7d8819bd-e6dc-4ea2-a722-7f903297fff8"}, {"server_uuid": "600147f3-401d-4897-8ce1-0f536234c3fa", "name": "network-vif-plugged", "status": "completed", "tag": "a25f2711-7194-4624-bebd-55e73ad4b5c9"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:08.930808 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-d6fe768e-52ad-4df8-abbc-8e056a952f4e tempest-UnshelveToHostMultiNodesTest-409522397 tempest-UnshelveToHostMultiNodesTest-409522397-project-admin] Lazy-loading 'services' on Instance uuid bb962e56-0c86-4511-b629-d51507a3a8c9 {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:36:08.942495 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-591a72ee-b1a9-4b8d-abdc-6d9031d386bb req-452baad1-5d66-4b5c-8af7-0fa7e3557dad service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:08.948221 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-591a72ee-b1a9-4b8d-abdc-6d9031d386bb req-452baad1-5d66-4b5c-8af7-0fa7e3557dad service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:08.948221 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-591a72ee-b1a9-4b8d-abdc-6d9031d386bb req-452baad1-5d66-4b5c-8af7-0fa7e3557dad service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:08.972761 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-591a72ee-b1a9-4b8d-abdc-6d9031d386bb req-452baad1-5d66-4b5c-8af7-0fa7e3557dad service nova] Creating event network-vif-plugged:02a2cc69-90c5-45e4-b836-8c90afdd6218 for instance 4fbde026-7d69-4924-97e6-28262d00e5db on n-h1-850501-14 Oct 04 18:36:08.975510 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d6fe768e-52ad-4df8-abbc-8e056a952f4e tempest-UnshelveToHostMultiNodesTest-409522397 tempest-UnshelveToHostMultiNodesTest-409522397-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1938 microversion: 2.91 time: 0.239202 Oct 04 18:36:08.977108 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-591a72ee-b1a9-4b8d-abdc-6d9031d386bb req-452baad1-5d66-4b5c-8af7-0fa7e3557dad service nova] Creating event network-vif-plugged:03780673-89a1-4320-8c01-92071ed08378 for instance 4fbde026-7d69-4924-97e6-28262d00e5db on n-h1-850501-14 Oct 04 18:36:08.983264 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-591a72ee-b1a9-4b8d-abdc-6d9031d386bb req-452baad1-5d66-4b5c-8af7-0fa7e3557dad service nova] Creating event network-vif-plugged:7d8819bd-e6dc-4ea2-a722-7f903297fff8 for instance 3ead1560-9c23-48ad-a938-6b3179b70035 on n-h1-850501-14 Oct 04 18:36:08.986834 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-591a72ee-b1a9-4b8d-abdc-6d9031d386bb req-452baad1-5d66-4b5c-8af7-0fa7e3557dad service nova] Creating event network-vif-plugged:a25f2711-7194-4624-bebd-55e73ad4b5c9 for instance 600147f3-401d-4897-8ce1-0f536234c3fa on n-h1-850501-14 Oct 04 18:36:09.003042 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-591a72ee-b1a9-4b8d-abdc-6d9031d386bb req-452baad1-5d66-4b5c-8af7-0fa7e3557dad service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.095776 Oct 04 18:36:09.004006 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 994/2090] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:36:08 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:36:09.016559 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1097/2091] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:08 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1938 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:36:09.031360 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4392994a-f5d8-4e07-a2e6-51db127a3000 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:09.031721 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e11050d0-f84d-448a-bb77-4e9bef93fcb7 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:09.031721 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e11050d0-f84d-448a-bb77-4e9bef93fcb7 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 3ead1560-9c23-48ad-a938-6b3179b70035] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:09.032017 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4392994a-f5d8-4e07-a2e6-51db127a3000 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6a81e50834114f0fa3cca4b0b9f8acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4650d613cb84018b92dc5d51486885e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:09.032017 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4392994a-f5d8-4e07-a2e6-51db127a3000 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Searching by: {'deleted': False, 'project_id': 'd4650d613cb84018b92dc5d51486885e'} {{(pid=123002) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:36:09.036903 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4392994a-f5d8-4e07-a2e6-51db127a3000 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:09.037615 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4392994a-f5d8-4e07-a2e6-51db127a3000 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:09.038371 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4392994a-f5d8-4e07-a2e6-51db127a3000 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:09.039260 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4392994a-f5d8-4e07-a2e6-51db127a3000 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:09.039958 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4392994a-f5d8-4e07-a2e6-51db127a3000 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:09.040565 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4392994a-f5d8-4e07-a2e6-51db127a3000 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:09.051224 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e11050d0-f84d-448a-bb77-4e9bef93fcb7 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:09.052862 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e11050d0-f84d-448a-bb77-4e9bef93fcb7 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:09.053326 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e11050d0-f84d-448a-bb77-4e9bef93fcb7 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:09.054059 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e11050d0-f84d-448a-bb77-4e9bef93fcb7 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:09.054541 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e11050d0-f84d-448a-bb77-4e9bef93fcb7 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:09.054977 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e11050d0-f84d-448a-bb77-4e9bef93fcb7 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:09.096167 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.multi_cell_list [None req-4392994a-f5d8-4e07-a2e6-51db127a3000 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=123002) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:36:09.147826 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4392994a-f5d8-4e07-a2e6-51db127a3000 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81e50834114f0fa3cca4b0b9f8acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4650d613cb84018b92dc5d51486885e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:09.156685 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4392994a-f5d8-4e07-a2e6-51db127a3000 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:09.158075 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4392994a-f5d8-4e07-a2e6-51db127a3000 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:09.158687 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4392994a-f5d8-4e07-a2e6-51db127a3000 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:09.615146 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4392994a-f5d8-4e07-a2e6-51db127a3000 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] 10.222.0.20 "GET /compute/v2.1/servers/detail" status: 200 len: 4520 microversion: 2.1 time: 0.596828 Oct 04 18:36:09.615842 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1098/2092] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Oct 4 18:36:09 2022] GET /compute/v2.1/servers/detail => generated 4520 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:09.624487 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9c765513-a9e8-4c29-b112-9b92c79e7360 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:09.626015 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9c765513-a9e8-4c29-b112-9b92c79e7360 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] [instance: bfc2eb17-e0fe-4f59-974a-d35419f2093d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:09.630173 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e11050d0-f84d-448a-bb77-4e9bef93fcb7 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:09.638569 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e11050d0-f84d-448a-bb77-4e9bef93fcb7 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035" status: 200 len: 1312 microversion: 2.1 time: 0.632608 Oct 04 18:36:09.651206 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9c765513-a9e8-4c29-b112-9b92c79e7360 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:09.651206 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9c765513-a9e8-4c29-b112-9b92c79e7360 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:09.651206 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9c765513-a9e8-4c29-b112-9b92c79e7360 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:09.651206 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9c765513-a9e8-4c29-b112-9b92c79e7360 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:09.651206 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9c765513-a9e8-4c29-b112-9b92c79e7360 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:09.651206 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9c765513-a9e8-4c29-b112-9b92c79e7360 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:09.652594 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 995/2093] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:09 2022] GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035 => generated 1312 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:09.666601 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8b2709ae-04cf-4925-8328-90c004915654 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:09.667336 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8b2709ae-04cf-4925-8328-90c004915654 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:09.674926 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8b2709ae-04cf-4925-8328-90c004915654 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:09.675769 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8b2709ae-04cf-4925-8328-90c004915654 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:09.676434 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-9c765513-a9e8-4c29-b112-9b92c79e7360 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] HTTP exception thrown: Instance bfc2eb17-e0fe-4f59-974a-d35419f2093d could not be found. Oct 04 18:36:09.676588 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8b2709ae-04cf-4925-8328-90c004915654 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:09.677460 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8b2709ae-04cf-4925-8328-90c004915654 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:09.678080 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8b2709ae-04cf-4925-8328-90c004915654 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:09.678673 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8b2709ae-04cf-4925-8328-90c004915654 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:09.679212 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9c765513-a9e8-4c29-b112-9b92c79e7360 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Request method failure captured: Oct 04 18:36:09.679212 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/bfc2eb17-e0fe-4f59-974a-d35419f2093d HTTP/1.1 Oct 04 18:36:09.679212 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:36:09.679212 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:36:09.679212 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:36:09.679212 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:36:09.679212 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:36:09.679212 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:36:09.679212 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:36:09.679212 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:36:09.679212 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPHzz1H5bE0pKP3M__TyvRgSc44hfKaxGVjfGXMrZ7Eq8wAKjXqVK93MNnZ0vzcO0KLYCfoYkEX58c3fio2TDFftuPARv65TFKn2yRNOFH4f0oiTU5v1WXdc1lcSlYv4pa-TuWpgcn7-Ri37zgoIHXywl9UTcC0NZR0i_n0Jt-QvOOJk Oct 04 18:36:09.679212 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:36:09.679212 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:36:09.679212 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:36:09.679212 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:36:09.679212 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:36:09.679212 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:36:09.679212 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: cd4c8595d87e49aba075a9372572093a Oct 04 18:36:09.679212 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-743873696 Oct 04 18:36:09.679212 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:36:09.679212 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:36:09.679212 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cd4c8595d87e49aba075a9372572093a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_cd4c8595d87e49aba075a9372572093a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/cd4c8595d87e49aba075a9372572093a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cd4c8595d87e49aba075a9372572093a"}]}] Oct 04 18:36:09.679212 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-743873696 Oct 04 18:36:09.679212 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: cd4c8595d87e49aba075a9372572093a Oct 04 18:36:09.679212 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-743873696 Oct 04 18:36:09.679212 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServerAddressesNegativeTestJSON-743873696-project Oct 04 18:36:09.679212 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:36:09.679212 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:36:09.679212 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: faa52dda618b4da394932ec8e37ad065 Oct 04 18:36:09.679212 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-743873696-project Oct 04 18:36:09.679212 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:36:09.679212 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance bfc2eb17-e0fe-4f59-974a-d35419f2093d could not be found. Oct 04 18:36:09.679212 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'bfc2eb17-e0fe-4f59-974a-d35419f2093d'} Oct 04 18:36:09.679212 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:36:09.679212 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:09.679212 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:36:09.679212 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:36:09.679212 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:36:09.679212 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:36:09.679212 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:36:09.679212 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:36:09.679212 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:36:09.679212 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:36:09.679212 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfc2eb17-e0fe-4f59-974a-d35419f2093d could not be found. Oct 04 18:36:09.679212 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:36:09.679212 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:09.679212 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:36:09.679212 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:09.679212 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:09.679212 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:09.679212 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:36:09.679212 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:36:09.679212 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:36:09.679212 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:36:09.679212 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:36:09.679212 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:36:09.679212 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:36:09.679212 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:36:09.679212 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:36:09.679212 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:36:09.679212 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfc2eb17-e0fe-4f59-974a-d35419f2093d could not be found. Oct 04 18:36:09.679212 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:36:09.679212 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:09.687595 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:36:09.687595 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:09.687595 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:09.687595 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:09.687595 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:36:09.687595 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:36:09.687595 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfc2eb17-e0fe-4f59-974a-d35419f2093d could not be found. Oct 04 18:36:09.687595 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:36:09.687595 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9c765513-a9e8-4c29-b112-9b92c79e7360 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] Returning 404 to user: Instance bfc2eb17-e0fe-4f59-974a-d35419f2093d could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:36:09.687595 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9c765513-a9e8-4c29-b112-9b92c79e7360 tempest-ServerAddressesNegativeTestJSON-743873696 tempest-ServerAddressesNegativeTestJSON-743873696-project] 10.222.0.20 "GET /compute/v2.1/servers/bfc2eb17-e0fe-4f59-974a-d35419f2093d" status: 404 len: 111 microversion: 2.1 time: 0.062873 Oct 04 18:36:09.687595 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1099/2094] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:09 2022] GET /compute/v2.1/servers/bfc2eb17-e0fe-4f59-974a-d35419f2093d => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:36:09.687595 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0e2892f6-6833-42eb-8067-1a51b6b0b360 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:09.689012 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0e2892f6-6833-42eb-8067-1a51b6b0b360 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] [instance: 4fbde026-7d69-4924-97e6-28262d00e5db] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:09.697815 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0e2892f6-6833-42eb-8067-1a51b6b0b360 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:09.698504 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0e2892f6-6833-42eb-8067-1a51b6b0b360 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:09.698895 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0e2892f6-6833-42eb-8067-1a51b6b0b360 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:09.700332 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0e2892f6-6833-42eb-8067-1a51b6b0b360 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:09.700826 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0e2892f6-6833-42eb-8067-1a51b6b0b360 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:09.702215 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0e2892f6-6833-42eb-8067-1a51b6b0b360 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:09.729961 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8b2709ae-04cf-4925-8328-90c004915654 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:36:09.970589 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0e2892f6-6833-42eb-8067-1a51b6b0b360 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb44381220d43b7bdfa744a1dc410a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3242afeef424d588cf102a2f0f38020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:09.979700 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0e2892f6-6833-42eb-8067-1a51b6b0b360 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] 10.222.0.20 "GET /compute/v2.1/servers/4fbde026-7d69-4924-97e6-28262d00e5db" status: 200 len: 1354 microversion: 2.1 time: 0.296881 Oct 04 18:36:09.981178 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1100/2095] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:09 2022] GET /compute/v2.1/servers/4fbde026-7d69-4924-97e6-28262d00e5db => generated 1354 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:09.987052 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-960bf249-0b27-4067-b07c-d61dbfe399ec tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:09.987669 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-960bf249-0b27-4067-b07c-d61dbfe399ec tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: cd74aff9-f694-49f3-a1cc-2095b71cd9e5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:09.999193 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-960bf249-0b27-4067-b07c-d61dbfe399ec tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:09.999193 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-960bf249-0b27-4067-b07c-d61dbfe399ec tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:09.999193 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-960bf249-0b27-4067-b07c-d61dbfe399ec tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:09.999193 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-960bf249-0b27-4067-b07c-d61dbfe399ec tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:09.999193 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-960bf249-0b27-4067-b07c-d61dbfe399ec tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:09.999193 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-960bf249-0b27-4067-b07c-d61dbfe399ec tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:10.118448 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8b2709ae-04cf-4925-8328-90c004915654 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "DELETE /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 204 len: 0 microversion: 2.91 time: 0.464120 Oct 04 18:36:10.119334 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 996/2096] 10.222.0.20 () {60 vars in 1280 bytes} [Tue Oct 4 18:36:09 2022] DELETE /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:36:10.125702 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d9e4f676-3d74-43cb-8da9-c8407fa4f884 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:10.143646 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d9e4f676-3d74-43cb-8da9-c8407fa4f884 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6a81e50834114f0fa3cca4b0b9f8acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4650d613cb84018b92dc5d51486885e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:10.147332 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d9e4f676-3d74-43cb-8da9-c8407fa4f884 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': 'd4650d613cb84018b92dc5d51486885e'} {{(pid=123001) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:36:10.387082 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-960bf249-0b27-4067-b07c-d61dbfe399ec tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:10.397550 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-960bf249-0b27-4067-b07c-d61dbfe399ec tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:10.400136 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-960bf249-0b27-4067-b07c-d61dbfe399ec tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:10.401710 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-960bf249-0b27-4067-b07c-d61dbfe399ec tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5" status: 200 len: 1293 microversion: 2.25 time: 0.419602 Oct 04 18:36:10.402451 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1101/2097] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:09 2022] GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5 => generated 1293 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:36:10.407392 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d9e4f676-3d74-43cb-8da9-c8407fa4f884 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:10.408610 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d9e4f676-3d74-43cb-8da9-c8407fa4f884 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:10.409128 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d9e4f676-3d74-43cb-8da9-c8407fa4f884 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:10.409982 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d9e4f676-3d74-43cb-8da9-c8407fa4f884 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:10.410398 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f5bf741e-0459-4096-91f3-a08aac9d5874 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:10.410637 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d9e4f676-3d74-43cb-8da9-c8407fa4f884 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:10.411176 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d9e4f676-3d74-43cb-8da9-c8407fa4f884 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:10.417395 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f5bf741e-0459-4096-91f3-a08aac9d5874 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: 600147f3-401d-4897-8ce1-0f536234c3fa] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:10.435177 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f5bf741e-0459-4096-91f3-a08aac9d5874 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:10.436261 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f5bf741e-0459-4096-91f3-a08aac9d5874 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:10.437137 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f5bf741e-0459-4096-91f3-a08aac9d5874 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:10.438278 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f5bf741e-0459-4096-91f3-a08aac9d5874 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:10.438923 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f5bf741e-0459-4096-91f3-a08aac9d5874 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:10.442193 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f5bf741e-0459-4096-91f3-a08aac9d5874 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:10.575243 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.multi_cell_list [None req-d9e4f676-3d74-43cb-8da9-c8407fa4f884 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=123001) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:36:10.694726 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d9e4f676-3d74-43cb-8da9-c8407fa4f884 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] 10.222.0.20 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1012 microversion: 2.1 time: 0.574135 Oct 04 18:36:10.704845 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 997/2098] 10.222.0.20 () {58 vars in 1150 bytes} [Tue Oct 4 18:36:10 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1012 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:10.722007 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e9d2f79e-9e09-4510-aa6d-13dd3d4ff74f tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:10.724974 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e9d2f79e-9e09-4510-aa6d-13dd3d4ff74f tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:10.731529 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e9d2f79e-9e09-4510-aa6d-13dd3d4ff74f tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:10.732282 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e9d2f79e-9e09-4510-aa6d-13dd3d4ff74f tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:10.732930 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e9d2f79e-9e09-4510-aa6d-13dd3d4ff74f tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:10.733847 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e9d2f79e-9e09-4510-aa6d-13dd3d4ff74f tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:10.734478 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e9d2f79e-9e09-4510-aa6d-13dd3d4ff74f tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:10.735136 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e9d2f79e-9e09-4510-aa6d-13dd3d4ff74f tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:10.842862 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e9d2f79e-9e09-4510-aa6d-13dd3d4ff74f tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:10.847537 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f5bf741e-0459-4096-91f3-a08aac9d5874 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:10.853705 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e9d2f79e-9e09-4510-aa6d-13dd3d4ff74f tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:10.855902 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e9d2f79e-9e09-4510-aa6d-13dd3d4ff74f tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:10.861035 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f5bf741e-0459-4096-91f3-a08aac9d5874 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/600147f3-401d-4897-8ce1-0f536234c3fa" status: 200 len: 1486 microversion: 2.1 time: 0.454632 Oct 04 18:36:10.864330 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e9d2f79e-9e09-4510-aa6d-13dd3d4ff74f tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1537 microversion: 2.91 time: 0.158015 Oct 04 18:36:10.865652 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 998/2099] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:10 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1537 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:36:10.872316 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3fcb7565-4d8f-45e4-ad79-bbf794db1036 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:10.873385 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3fcb7565-4d8f-45e4-ad79-bbf794db1036 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 3ead1560-9c23-48ad-a938-6b3179b70035] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:10.880508 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3fcb7565-4d8f-45e4-ad79-bbf794db1036 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:10.880838 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1102/2100] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:10 2022] GET /compute/v2.1/servers/600147f3-401d-4897-8ce1-0f536234c3fa => generated 1486 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:10.881623 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3fcb7565-4d8f-45e4-ad79-bbf794db1036 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:10.882310 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3fcb7565-4d8f-45e4-ad79-bbf794db1036 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:10.883269 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3fcb7565-4d8f-45e4-ad79-bbf794db1036 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:10.884029 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3fcb7565-4d8f-45e4-ad79-bbf794db1036 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:10.884736 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3fcb7565-4d8f-45e4-ad79-bbf794db1036 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:10.902892 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-38027bc8-c962-4d0e-b277-33c70c414fe4 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:10.915985 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-38027bc8-c962-4d0e-b277-33c70c414fe4 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6a81e50834114f0fa3cca4b0b9f8acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4650d613cb84018b92dc5d51486885e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:10.917009 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-38027bc8-c962-4d0e-b277-33c70c414fe4 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': 'd4650d613cb84018b92dc5d51486885e'} {{(pid=123002) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:36:10.924649 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-38027bc8-c962-4d0e-b277-33c70c414fe4 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:10.925526 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-38027bc8-c962-4d0e-b277-33c70c414fe4 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:10.926279 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-38027bc8-c962-4d0e-b277-33c70c414fe4 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:10.927283 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-38027bc8-c962-4d0e-b277-33c70c414fe4 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:10.928005 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-38027bc8-c962-4d0e-b277-33c70c414fe4 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:10.928679 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-38027bc8-c962-4d0e-b277-33c70c414fe4 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:11.002618 n-d-850501-14 devstack@n-api.service[123002]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 18:36:11.002618 n-d-850501-14 devstack@n-api.service[123002]: Tue Oct 4 18:36:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 (ip 10.222.0.20) !!! Oct 04 18:36:11.038433 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.multi_cell_list [None req-38027bc8-c962-4d0e-b277-33c70c414fe4 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=123002) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:36:11.144525 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-38027bc8-c962-4d0e-b277-33c70c414fe4 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] 10.222.0.20 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1012 microversion: 2.1 time: 0.259175 Oct 04 18:36:11.145433 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1103/2101] 10.222.0.20 () {58 vars in 1212 bytes} [Tue Oct 4 18:36:10 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1012 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:11.160815 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-60ccae0d-4c97-45f6-8e93-da709a8bfd70 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:11.161022 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-60ccae0d-4c97-45f6-8e93-da709a8bfd70 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: 600147f3-401d-4897-8ce1-0f536234c3fa] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:11.194072 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-60ccae0d-4c97-45f6-8e93-da709a8bfd70 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:11.201391 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-60ccae0d-4c97-45f6-8e93-da709a8bfd70 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:11.204400 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-60ccae0d-4c97-45f6-8e93-da709a8bfd70 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:11.205284 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-60ccae0d-4c97-45f6-8e93-da709a8bfd70 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:11.205777 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-60ccae0d-4c97-45f6-8e93-da709a8bfd70 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:11.208097 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-60ccae0d-4c97-45f6-8e93-da709a8bfd70 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:11.326438 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-60ccae0d-4c97-45f6-8e93-da709a8bfd70 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: 600147f3-401d-4897-8ce1-0f536234c3fa] Going to try to terminate instance {{(pid=123002) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:36:11.712895 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-60ccae0d-4c97-45f6-8e93-da709a8bfd70 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "DELETE /compute/v2.1/servers/600147f3-401d-4897-8ce1-0f536234c3fa" status: 204 len: 0 microversion: 2.1 time: 0.563341 Oct 04 18:36:11.714261 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1104/2102] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:36:11 2022] DELETE /compute/v2.1/servers/600147f3-401d-4897-8ce1-0f536234c3fa => generated 0 bytes in 567 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:36:11.721178 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3fcb7565-4d8f-45e4-ad79-bbf794db1036 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:11.733722 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d158b3d9-13a0-4902-b6d5-e54811c9e197 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:11.733722 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d158b3d9-13a0-4902-b6d5-e54811c9e197 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] [instance: 4fbde026-7d69-4924-97e6-28262d00e5db] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:11.735351 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3fcb7565-4d8f-45e4-ad79-bbf794db1036 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035" status: 200 len: 1312 microversion: 2.1 time: 0.867556 Oct 04 18:36:11.742186 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d158b3d9-13a0-4902-b6d5-e54811c9e197 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:11.743572 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d158b3d9-13a0-4902-b6d5-e54811c9e197 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:11.744313 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d158b3d9-13a0-4902-b6d5-e54811c9e197 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:11.745607 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d158b3d9-13a0-4902-b6d5-e54811c9e197 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:11.746222 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d158b3d9-13a0-4902-b6d5-e54811c9e197 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:11.746650 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d158b3d9-13a0-4902-b6d5-e54811c9e197 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:11.748740 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 999/2103] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:10 2022] GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035 => generated 1312 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:11.760947 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-281e36bd-a3a8-4f42-a347-f7c0b9267bfa tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:11.769488 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-281e36bd-a3a8-4f42-a347-f7c0b9267bfa tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6a81e50834114f0fa3cca4b0b9f8acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4650d613cb84018b92dc5d51486885e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:11.770953 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-281e36bd-a3a8-4f42-a347-f7c0b9267bfa tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': 'd4650d613cb84018b92dc5d51486885e'} {{(pid=123001) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:36:11.778294 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-281e36bd-a3a8-4f42-a347-f7c0b9267bfa tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:11.779163 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-281e36bd-a3a8-4f42-a347-f7c0b9267bfa tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:11.779869 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-281e36bd-a3a8-4f42-a347-f7c0b9267bfa tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:11.780839 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-281e36bd-a3a8-4f42-a347-f7c0b9267bfa tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:11.781416 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-281e36bd-a3a8-4f42-a347-f7c0b9267bfa tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:11.782491 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-281e36bd-a3a8-4f42-a347-f7c0b9267bfa tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:11.891831 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.multi_cell_list [None req-281e36bd-a3a8-4f42-a347-f7c0b9267bfa tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=123001) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:36:11.964794 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-281e36bd-a3a8-4f42-a347-f7c0b9267bfa tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] 10.222.0.20 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1012 microversion: 2.1 time: 0.214536 Oct 04 18:36:11.965778 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1000/2104] 10.222.0.20 () {58 vars in 1196 bytes} [Tue Oct 4 18:36:11 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1012 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:11.972385 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-31d88d50-8c48-4faa-9517-8079ddfb17fc tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:11.973287 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-31d88d50-8c48-4faa-9517-8079ddfb17fc tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: cd74aff9-f694-49f3-a1cc-2095b71cd9e5] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:11.980339 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-31d88d50-8c48-4faa-9517-8079ddfb17fc tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:11.981231 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-31d88d50-8c48-4faa-9517-8079ddfb17fc tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:11.981925 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-31d88d50-8c48-4faa-9517-8079ddfb17fc tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:11.982912 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-31d88d50-8c48-4faa-9517-8079ddfb17fc tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:11.983655 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-31d88d50-8c48-4faa-9517-8079ddfb17fc tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:11.984362 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-31d88d50-8c48-4faa-9517-8079ddfb17fc tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:12.370482 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d158b3d9-13a0-4902-b6d5-e54811c9e197 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb44381220d43b7bdfa744a1dc410a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3242afeef424d588cf102a2f0f38020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:12.385533 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d158b3d9-13a0-4902-b6d5-e54811c9e197 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] 10.222.0.20 "GET /compute/v2.1/servers/4fbde026-7d69-4924-97e6-28262d00e5db" status: 200 len: 1803 microversion: 2.1 time: 0.669688 Oct 04 18:36:12.386307 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1105/2105] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:11 2022] GET /compute/v2.1/servers/4fbde026-7d69-4924-97e6-28262d00e5db => generated 1803 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:12.391338 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-647ad54f-a992-4658-bf68-65bb6ef60496 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '.version_select at 0x7fe258857670>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:12.440652 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-647ad54f-a992-4658-bf68-65bb6ef60496 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] HTTP exception thrown: Image not found. Oct 04 18:36:12.442713 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-647ad54f-a992-4658-bf68-65bb6ef60496 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Request method failure captured: Oct 04 18:36:12.442713 n-d-850501-14 devstack@n-api.service[123002]: request: DELETE /compute/v2.1/images/0aa8d42d-6bae-40b6-9e6a-49180df5b746 HTTP/1.1 Oct 04 18:36:12.442713 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:36:12.442713 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:36:12.442713 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:36:12.442713 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:36:12.442713 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:36:12.442713 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:36:12.442713 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:36:12.442713 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:36:12.442713 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPHwUQIR1TKCa6SuO5KxFm7-u_FizcG48Uot0gdIOuCeSh8CFWYcfwzYNxmsP1Ox8pbA_3AaF7FzwotmrVSCbO7eABAZII6tUmaEh-Y24i0KlqIupFERqEnu-z8kdpdoodlufKA0ebuuWvnLVx428den86l5yxh9C2_Lvb9bKR3dLeNk Oct 04 18:36:12.442713 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:36:12.442713 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:36:12.442713 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:36:12.442713 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:36:12.442713 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:36:12.442713 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:36:12.442713 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 08c83d7b68684daf8e67ba2361ad86c9 Oct 04 18:36:12.442713 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ImagesTestJSON-1467584864 Oct 04 18:36:12.442713 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:36:12.442713 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:36:12.442713 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/08c83d7b68684daf8e67ba2361ad86c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_08c83d7b68684daf8e67ba2361ad86c9", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/08c83d7b68684daf8e67ba2361ad86c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/08c83d7b68684daf8e67ba2361ad86c9"}]}] Oct 04 18:36:12.442713 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ImagesTestJSON-1467584864 Oct 04 18:36:12.442713 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 08c83d7b68684daf8e67ba2361ad86c9 Oct 04 18:36:12.442713 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ImagesTestJSON-1467584864 Oct 04 18:36:12.442713 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ImagesTestJSON-1467584864-project Oct 04 18:36:12.442713 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:36:12.442713 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:36:12.442713 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: ef3c7ad35a05450496b6d1ff64f12b77 Oct 04 18:36:12.442713 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ImagesTestJSON-1467584864-project Oct 04 18:36:12.442713 n-d-850501-14 devstack@n-api.service[123002]: method: Oct 04 18:36:12.442713 n-d-850501-14 devstack@n-api.service[123002]: exception: Image not found. Oct 04 18:36:12.442713 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '0aa8d42d-6bae-40b6-9e6a-49180df5b746'} Oct 04 18:36:12.442713 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:36:12.442713 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:12.442713 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 18:36:12.442713 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 18:36:12.442713 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:36:12.442713 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:36:12.442713 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:36:12.442713 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:36:12.442713 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 18:36:12.442713 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 18:36:12.442713 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 18:36:12.442713 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 18:36:12.442713 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:36:12.442713 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:36:12.442713 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:36:12.442713 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:36:12.442713 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 0aa8d42d-6bae-40b6-9e6a-49180df5b746 to delete Oct 04 18:36:12.442713 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:36:12.442713 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:12.442713 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:36:12.442713 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:12.442713 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 18:36:12.442713 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 18:36:12.442713 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 18:36:12.442713 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 18:36:12.442713 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 18:36:12.442713 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 18:36:12.442713 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0aa8d42d-6bae-40b6-9e6a-49180df5b746 could not be found. Oct 04 18:36:12.442713 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:36:12.442713 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:12.442713 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:36:12.442713 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:12.448374 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:12.448374 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:12.448374 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:36:12.448374 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:36:12.448374 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:36:12.448374 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:36:12.448374 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:36:12.448374 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:36:12.448374 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 18:36:12.448374 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 18:36:12.448374 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:36:12.448374 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:36:12.448374 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:12.448374 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:36:12.448374 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:12.448374 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:12.448374 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:12.448374 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:36:12.448374 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:36:12.448374 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:36:12.448374 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:36:12.448374 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-647ad54f-a992-4658-bf68-65bb6ef60496 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Returning 404 to user: Image not found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:36:12.454258 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-647ad54f-a992-4658-bf68-65bb6ef60496 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "DELETE /compute/v2.1/images/0aa8d42d-6bae-40b6-9e6a-49180df5b746" status: 404 len: 62 microversion: 2.1 time: 0.063181 Oct 04 18:36:12.454258 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1106/2106] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:12 2022] DELETE /compute/v2.1/images/0aa8d42d-6bae-40b6-9e6a-49180df5b746 => generated 62 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:36:12.461162 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-9416df40-e970-45cd-a4f5-8450bdb66198 req-55f1f046-e17a-481b-a4bd-5f0b39607676 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd74aff9-f694-49f3-a1cc-2095b71cd9e5", "tag": "bd7c52cb-3d4c-4b6f-a043-15c22280ba46"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:12.472887 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-31d88d50-8c48-4faa-9517-8079ddfb17fc tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:12.487123 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-9416df40-e970-45cd-a4f5-8450bdb66198 req-55f1f046-e17a-481b-a4bd-5f0b39607676 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:12.487338 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-31d88d50-8c48-4faa-9517-8079ddfb17fc tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:12.487620 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-9416df40-e970-45cd-a4f5-8450bdb66198 req-55f1f046-e17a-481b-a4bd-5f0b39607676 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:12.488080 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-9416df40-e970-45cd-a4f5-8450bdb66198 req-55f1f046-e17a-481b-a4bd-5f0b39607676 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:12.494170 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-31d88d50-8c48-4faa-9517-8079ddfb17fc tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:12.495558 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-31d88d50-8c48-4faa-9517-8079ddfb17fc tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5" status: 200 len: 1293 microversion: 2.25 time: 0.528568 Oct 04 18:36:12.510321 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1001/2107] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:11 2022] GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5 => generated 1293 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:36:12.510321 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-60b48a23-b53e-45bd-b0ba-21569886e193 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:12.510321 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-60b48a23-b53e-45bd-b0ba-21569886e193 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:12.525151 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-9416df40-e970-45cd-a4f5-8450bdb66198 req-55f1f046-e17a-481b-a4bd-5f0b39607676 service nova] Creating event network-changed:bd7c52cb-3d4c-4b6f-a043-15c22280ba46 for instance cd74aff9-f694-49f3-a1cc-2095b71cd9e5 on n-h2-850501-14 Oct 04 18:36:12.526937 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-60b48a23-b53e-45bd-b0ba-21569886e193 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:12.527546 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-60b48a23-b53e-45bd-b0ba-21569886e193 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:12.528132 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-60b48a23-b53e-45bd-b0ba-21569886e193 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:12.528964 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-60b48a23-b53e-45bd-b0ba-21569886e193 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:12.529533 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-60b48a23-b53e-45bd-b0ba-21569886e193 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:12.531263 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-60b48a23-b53e-45bd-b0ba-21569886e193 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:12.542913 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-9416df40-e970-45cd-a4f5-8450bdb66198 req-55f1f046-e17a-481b-a4bd-5f0b39607676 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085558 Oct 04 18:36:12.543941 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1107/2108] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:36:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:36:12.553355 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2e6b019e-2594-49c5-8d20-951c55d3a960 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:12.578164 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2e6b019e-2594-49c5-8d20-951c55d3a960 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6a81e50834114f0fa3cca4b0b9f8acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4650d613cb84018b92dc5d51486885e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:12.583938 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2e6b019e-2594-49c5-8d20-951c55d3a960 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Searching by: {'name': '1008228703', 'deleted': False, 'project_id': 'd4650d613cb84018b92dc5d51486885e'} {{(pid=123002) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:36:12.593818 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e6b019e-2594-49c5-8d20-951c55d3a960 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:12.602143 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e6b019e-2594-49c5-8d20-951c55d3a960 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:12.602696 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e6b019e-2594-49c5-8d20-951c55d3a960 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:12.603775 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e6b019e-2594-49c5-8d20-951c55d3a960 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:12.604534 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e6b019e-2594-49c5-8d20-951c55d3a960 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:12.604977 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e6b019e-2594-49c5-8d20-951c55d3a960 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:12.664893 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-60b48a23-b53e-45bd-b0ba-21569886e193 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:12.681020 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-60b48a23-b53e-45bd-b0ba-21569886e193 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:12.682868 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-60b48a23-b53e-45bd-b0ba-21569886e193 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:12.695231 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-60b48a23-b53e-45bd-b0ba-21569886e193 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1537 microversion: 2.91 time: 0.197022 Oct 04 18:36:12.699456 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1002/2109] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:12 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1537 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:36:12.724539 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-37099224-8274-4047-baae-b17f7831036a tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:12.727711 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-37099224-8274-4047-baae-b17f7831036a tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] [instance: 4fbde026-7d69-4924-97e6-28262d00e5db] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:12.742239 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-37099224-8274-4047-baae-b17f7831036a tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:12.746599 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-37099224-8274-4047-baae-b17f7831036a tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:12.746599 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-37099224-8274-4047-baae-b17f7831036a tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:12.746599 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-37099224-8274-4047-baae-b17f7831036a tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:12.746599 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-37099224-8274-4047-baae-b17f7831036a tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:12.746599 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-37099224-8274-4047-baae-b17f7831036a tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:12.783427 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.multi_cell_list [None req-2e6b019e-2594-49c5-8d20-951c55d3a960 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123002) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:36:12.805362 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-37099224-8274-4047-baae-b17f7831036a tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] 10.222.0.20 "GET /compute/v2.1/servers/4fbde026-7d69-4924-97e6-28262d00e5db/ips" status: 200 len: 217 microversion: 2.1 time: 0.101568 Oct 04 18:36:12.806374 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1003/2110] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Oct 4 18:36:12 2022] GET /compute/v2.1/servers/4fbde026-7d69-4924-97e6-28262d00e5db/ips => generated 217 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:36:12.817470 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-99bd597e-e086-4688-b0e5-398fda289df3 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:12.819772 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-99bd597e-e086-4688-b0e5-398fda289df3 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: 600147f3-401d-4897-8ce1-0f536234c3fa] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:12.835282 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-99bd597e-e086-4688-b0e5-398fda289df3 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:12.836157 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-99bd597e-e086-4688-b0e5-398fda289df3 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:12.836869 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-99bd597e-e086-4688-b0e5-398fda289df3 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:12.837820 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-99bd597e-e086-4688-b0e5-398fda289df3 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:12.839257 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-99bd597e-e086-4688-b0e5-398fda289df3 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:12.844119 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-99bd597e-e086-4688-b0e5-398fda289df3 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:12.857210 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:12.860201 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2e6b019e-2594-49c5-8d20-951c55d3a960 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] 10.222.0.20 "GET /compute/v2.1/servers?name=1008228703" status: 200 len: 346 microversion: 2.1 time: 0.314504 Oct 04 18:36:12.864646 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1108/2111] 10.222.0.20 () {58 vars in 1156 bytes} [Tue Oct 4 18:36:12 2022] GET /compute/v2.1/servers?name=1008228703 => generated 346 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:36:12.879415 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-42101db4-62ee-4cf8-8338-58ce03edbc0c tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:12.880240 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-42101db4-62ee-4cf8-8338-58ce03edbc0c tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 3ead1560-9c23-48ad-a938-6b3179b70035] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:12.881567 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-99bd597e-e086-4688-b0e5-398fda289df3 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: 600147f3-401d-4897-8ce1-0f536234c3fa] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:36:12.892441 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-42101db4-62ee-4cf8-8338-58ce03edbc0c tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:12.892948 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-42101db4-62ee-4cf8-8338-58ce03edbc0c tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:12.893383 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-42101db4-62ee-4cf8-8338-58ce03edbc0c tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:12.900161 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-42101db4-62ee-4cf8-8338-58ce03edbc0c tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:12.900161 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-42101db4-62ee-4cf8-8338-58ce03edbc0c tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:12.901902 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-42101db4-62ee-4cf8-8338-58ce03edbc0c tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:13.012920 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.compute.api [None req-99bd597e-e086-4688-b0e5-398fda289df3 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: 600147f3-401d-4897-8ce1-0f536234c3fa] Instance is already in deleting state, ignoring this request Oct 04 18:36:13.015409 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-99bd597e-e086-4688-b0e5-398fda289df3 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "DELETE /compute/v2.1/servers/600147f3-401d-4897-8ce1-0f536234c3fa" status: 204 len: 0 microversion: 2.1 time: 0.207466 Oct 04 18:36:13.020651 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1004/2112] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:36:12 2022] DELETE /compute/v2.1/servers/600147f3-401d-4897-8ce1-0f536234c3fa => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:36:13.046778 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-94dd53d2-ae71-40e6-91b6-5cae4d693ae2 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:13.048667 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-94dd53d2-ae71-40e6-91b6-5cae4d693ae2 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] [instance: 4fbde026-7d69-4924-97e6-28262d00e5db] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:13.070003 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-94dd53d2-ae71-40e6-91b6-5cae4d693ae2 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:13.071780 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-94dd53d2-ae71-40e6-91b6-5cae4d693ae2 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:13.073212 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-94dd53d2-ae71-40e6-91b6-5cae4d693ae2 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:13.076027 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-94dd53d2-ae71-40e6-91b6-5cae4d693ae2 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:13.076746 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-94dd53d2-ae71-40e6-91b6-5cae4d693ae2 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:13.077928 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-94dd53d2-ae71-40e6-91b6-5cae4d693ae2 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:13.122438 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:13.130991 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-94dd53d2-ae71-40e6-91b6-5cae4d693ae2 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] [instance: 4fbde026-7d69-4924-97e6-28262d00e5db] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:36:13.220155 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=8 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:13.249944 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-42101db4-62ee-4cf8-8338-58ce03edbc0c tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:13.262314 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-42101db4-62ee-4cf8-8338-58ce03edbc0c tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035" status: 200 len: 1461 microversion: 2.1 time: 0.390050 Oct 04 18:36:13.263425 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1109/2113] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:12 2022] GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035 => generated 1461 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:13.286332 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-67f47dfe-874d-40c3-bac0-9c81629ad5bb tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:13.291699 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-67f47dfe-874d-40c3-bac0-9c81629ad5bb tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6a81e50834114f0fa3cca4b0b9f8acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4650d613cb84018b92dc5d51486885e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:13.292680 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-67f47dfe-874d-40c3-bac0-9c81629ad5bb tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': 'd4650d613cb84018b92dc5d51486885e'} {{(pid=123002) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:36:13.299527 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-67f47dfe-874d-40c3-bac0-9c81629ad5bb tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:13.300674 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-67f47dfe-874d-40c3-bac0-9c81629ad5bb tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:13.301352 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-67f47dfe-874d-40c3-bac0-9c81629ad5bb tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:13.302907 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-67f47dfe-874d-40c3-bac0-9c81629ad5bb tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:13.303999 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-67f47dfe-874d-40c3-bac0-9c81629ad5bb tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:13.304723 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-67f47dfe-874d-40c3-bac0-9c81629ad5bb tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:13.414868 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.multi_cell_list [None req-67f47dfe-874d-40c3-bac0-9c81629ad5bb tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=123002) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:36:13.493611 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-94dd53d2-ae71-40e6-91b6-5cae4d693ae2 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4fbde026-7d69-4924-97e6-28262d00e5db" status: 204 len: 0 microversion: 2.1 time: 0.470917 Oct 04 18:36:13.495437 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1005/2114] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:36:13 2022] DELETE /compute/v2.1/servers/4fbde026-7d69-4924-97e6-28262d00e5db => generated 0 bytes in 473 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:36:13.501975 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-61773f22-7ac2-4e6f-9477-38b4305f5e70 req-b3382498-5930-4e50-b7ea-bd2b90816b8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "600147f3-401d-4897-8ce1-0f536234c3fa", "name": "network-vif-unplugged", "status": "completed", "tag": "a25f2711-7194-4624-bebd-55e73ad4b5c9"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:13.537825 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-61773f22-7ac2-4e6f-9477-38b4305f5e70 req-b3382498-5930-4e50-b7ea-bd2b90816b8a service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:13.538236 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-61773f22-7ac2-4e6f-9477-38b4305f5e70 req-b3382498-5930-4e50-b7ea-bd2b90816b8a service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:13.538699 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-61773f22-7ac2-4e6f-9477-38b4305f5e70 req-b3382498-5930-4e50-b7ea-bd2b90816b8a service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:13.541363 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-67f47dfe-874d-40c3-bac0-9c81629ad5bb tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] 10.222.0.20 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1012 microversion: 2.1 time: 0.263579 Oct 04 18:36:13.558648 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1110/2115] 10.222.0.20 () {58 vars in 1154 bytes} [Tue Oct 4 18:36:13 2022] GET /compute/v2.1/servers?name=-instance => generated 1012 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:13.564355 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-61773f22-7ac2-4e6f-9477-38b4305f5e70 req-b3382498-5930-4e50-b7ea-bd2b90816b8a service nova] Creating event network-vif-unplugged:a25f2711-7194-4624-bebd-55e73ad4b5c9 for instance 600147f3-401d-4897-8ce1-0f536234c3fa on n-h1-850501-14 Oct 04 18:36:13.567417 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f28ec21d-d40e-4d72-b2d7-95e97aa0b875 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:13.569012 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f28ec21d-d40e-4d72-b2d7-95e97aa0b875 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: 600147f3-401d-4897-8ce1-0f536234c3fa] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:13.574706 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-61773f22-7ac2-4e6f-9477-38b4305f5e70 req-b3382498-5930-4e50-b7ea-bd2b90816b8a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078549 Oct 04 18:36:13.575758 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1006/2116] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:36:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:36:13.582319 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1617ea21-b3d6-4984-9b2d-abbedc56aae7 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:13.585606 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1617ea21-b3d6-4984-9b2d-abbedc56aae7 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 3ead1560-9c23-48ad-a938-6b3179b70035] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:13.587438 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f28ec21d-d40e-4d72-b2d7-95e97aa0b875 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:13.587896 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f28ec21d-d40e-4d72-b2d7-95e97aa0b875 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:13.588376 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f28ec21d-d40e-4d72-b2d7-95e97aa0b875 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:13.593964 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1617ea21-b3d6-4984-9b2d-abbedc56aae7 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:13.594988 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1617ea21-b3d6-4984-9b2d-abbedc56aae7 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:13.595492 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1617ea21-b3d6-4984-9b2d-abbedc56aae7 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:13.596408 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1617ea21-b3d6-4984-9b2d-abbedc56aae7 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:13.596557 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f28ec21d-d40e-4d72-b2d7-95e97aa0b875 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:13.597022 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1617ea21-b3d6-4984-9b2d-abbedc56aae7 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:13.597146 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f28ec21d-d40e-4d72-b2d7-95e97aa0b875 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:13.597516 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1617ea21-b3d6-4984-9b2d-abbedc56aae7 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:13.597639 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f28ec21d-d40e-4d72-b2d7-95e97aa0b875 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:13.745709 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1617ea21-b3d6-4984-9b2d-abbedc56aae7 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:13.753941 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1617ea21-b3d6-4984-9b2d-abbedc56aae7 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 3ead1560-9c23-48ad-a938-6b3179b70035] Old instance type m1.heat2, new instance type m1.heat {{(pid=123001) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 18:36:13.765284 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-1617ea21-b3d6-4984-9b2d-abbedc56aae7 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:36:13.765284 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-1617ea21-b3d6-4984-9b2d-abbedc56aae7 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:36:13.765284 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-1617ea21-b3d6-4984-9b2d-abbedc56aae7 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:36:13.765961 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-1617ea21-b3d6-4984-9b2d-abbedc56aae7 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:36:13.767170 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-1617ea21-b3d6-4984-9b2d-abbedc56aae7 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:36:13.918960 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f28ec21d-d40e-4d72-b2d7-95e97aa0b875 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:13.939245 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f28ec21d-d40e-4d72-b2d7-95e97aa0b875 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/600147f3-401d-4897-8ce1-0f536234c3fa" status: 200 len: 1492 microversion: 2.1 time: 0.380190 Oct 04 18:36:13.940038 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1111/2117] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:13 2022] GET /compute/v2.1/servers/600147f3-401d-4897-8ce1-0f536234c3fa => generated 1492 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:13.957914 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-343deb7f-6330-4efb-9726-d937047e17e0 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:13.958550 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-343deb7f-6330-4efb-9726-d937047e17e0 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] [instance: 4fbde026-7d69-4924-97e6-28262d00e5db] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:13.971895 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-343deb7f-6330-4efb-9726-d937047e17e0 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:13.973630 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-343deb7f-6330-4efb-9726-d937047e17e0 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:13.975318 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-343deb7f-6330-4efb-9726-d937047e17e0 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:13.976871 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-343deb7f-6330-4efb-9726-d937047e17e0 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:13.978371 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-343deb7f-6330-4efb-9726-d937047e17e0 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:13.979154 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-343deb7f-6330-4efb-9726-d937047e17e0 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:14.135780 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1617ea21-b3d6-4984-9b2d-abbedc56aae7 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "POST /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035/action" status: 202 len: 0 microversion: 2.1 time: 0.558331 Oct 04 18:36:14.136638 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1007/2118] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:36:13 2022] POST /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035/action => generated 0 bytes in 560 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:36:14.142612 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7c324588-6398-4bd1-b497-69c5749a0c61 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:14.143227 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7c324588-6398-4bd1-b497-69c5749a0c61 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: cd74aff9-f694-49f3-a1cc-2095b71cd9e5] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:14.162822 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7c324588-6398-4bd1-b497-69c5749a0c61 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:14.163325 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7c324588-6398-4bd1-b497-69c5749a0c61 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:14.163813 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7c324588-6398-4bd1-b497-69c5749a0c61 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:14.164860 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7c324588-6398-4bd1-b497-69c5749a0c61 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:14.165261 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7c324588-6398-4bd1-b497-69c5749a0c61 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:14.166203 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7c324588-6398-4bd1-b497-69c5749a0c61 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:14.343401 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-343deb7f-6330-4efb-9726-d937047e17e0 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb44381220d43b7bdfa744a1dc410a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3242afeef424d588cf102a2f0f38020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:14.353331 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-343deb7f-6330-4efb-9726-d937047e17e0 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] 10.222.0.20 "GET /compute/v2.1/servers/4fbde026-7d69-4924-97e6-28262d00e5db" status: 200 len: 1809 microversion: 2.1 time: 0.412394 Oct 04 18:36:14.355189 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1112/2119] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:13 2022] GET /compute/v2.1/servers/4fbde026-7d69-4924-97e6-28262d00e5db => generated 1809 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:14.359017 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-76f271d9-9d5f-40e6-938d-e70f270bd6f4 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:14.364652 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-76f271d9-9d5f-40e6-938d-e70f270bd6f4 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6a81e50834114f0fa3cca4b0b9f8acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4650d613cb84018b92dc5d51486885e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:14.365540 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-76f271d9-9d5f-40e6-938d-e70f270bd6f4 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-100822870', 'deleted': False, 'project_id': 'd4650d613cb84018b92dc5d51486885e'} {{(pid=123002) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:36:14.377784 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-76f271d9-9d5f-40e6-938d-e70f270bd6f4 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:14.378311 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-76f271d9-9d5f-40e6-938d-e70f270bd6f4 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:14.378966 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-76f271d9-9d5f-40e6-938d-e70f270bd6f4 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:14.379986 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-76f271d9-9d5f-40e6-938d-e70f270bd6f4 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:14.380643 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-76f271d9-9d5f-40e6-938d-e70f270bd6f4 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:14.381320 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-76f271d9-9d5f-40e6-938d-e70f270bd6f4 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:14.396327 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7c324588-6398-4bd1-b497-69c5749a0c61 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:14.410701 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7c324588-6398-4bd1-b497-69c5749a0c61 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:14.415220 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7c324588-6398-4bd1-b497-69c5749a0c61 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:14.418863 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7c324588-6398-4bd1-b497-69c5749a0c61 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5" status: 200 len: 1293 microversion: 2.25 time: 0.279924 Oct 04 18:36:14.419629 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1008/2120] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:14 2022] GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5 => generated 1293 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:36:14.428339 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-214cc026-c5fb-4e5b-a152-968a67d0fb53 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:14.429170 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-214cc026-c5fb-4e5b-a152-968a67d0fb53 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:14.443365 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-214cc026-c5fb-4e5b-a152-968a67d0fb53 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:14.444000 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-214cc026-c5fb-4e5b-a152-968a67d0fb53 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:14.444572 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-214cc026-c5fb-4e5b-a152-968a67d0fb53 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:14.445366 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-214cc026-c5fb-4e5b-a152-968a67d0fb53 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:14.452758 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-214cc026-c5fb-4e5b-a152-968a67d0fb53 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:14.456760 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-214cc026-c5fb-4e5b-a152-968a67d0fb53 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:14.506234 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.multi_cell_list [None req-76f271d9-9d5f-40e6-938d-e70f270bd6f4 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123002) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:36:14.574681 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-214cc026-c5fb-4e5b-a152-968a67d0fb53 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:14.581453 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-76f271d9-9d5f-40e6-938d-e70f270bd6f4 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] 10.222.0.20 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-100822870" status: 200 len: 346 microversion: 2.1 time: 0.226271 Oct 04 18:36:14.582379 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1113/2121] 10.222.0.20 () {58 vars in 1228 bytes} [Tue Oct 4 18:36:14 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-100822870 => generated 346 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:36:14.589289 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f454fec2-c689-4c2c-b389-d6e93818c397 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:14.590137 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f454fec2-c689-4c2c-b389-d6e93818c397 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 3ead1560-9c23-48ad-a938-6b3179b70035] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:14.599139 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f454fec2-c689-4c2c-b389-d6e93818c397 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:14.599652 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f454fec2-c689-4c2c-b389-d6e93818c397 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:14.600120 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f454fec2-c689-4c2c-b389-d6e93818c397 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:14.601336 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f454fec2-c689-4c2c-b389-d6e93818c397 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:14.602499 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f454fec2-c689-4c2c-b389-d6e93818c397 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:14.603299 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f454fec2-c689-4c2c-b389-d6e93818c397 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:14.622593 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-214cc026-c5fb-4e5b-a152-968a67d0fb53 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:14.625660 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-214cc026-c5fb-4e5b-a152-968a67d0fb53 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:14.639680 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-214cc026-c5fb-4e5b-a152-968a67d0fb53 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1537 microversion: 2.91 time: 0.216377 Oct 04 18:36:14.644047 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1009/2122] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:14 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1537 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:36:14.653865 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e672f07e-7a5a-41fc-a23e-27a00d92203a tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:14.654367 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e672f07e-7a5a-41fc-a23e-27a00d92203a tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] [instance: adc33804-eb64-40ca-a943-f2e74040c1b2] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:14.665871 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e672f07e-7a5a-41fc-a23e-27a00d92203a tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:14.666370 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e672f07e-7a5a-41fc-a23e-27a00d92203a tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:14.668100 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e672f07e-7a5a-41fc-a23e-27a00d92203a tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:14.668100 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e672f07e-7a5a-41fc-a23e-27a00d92203a tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:14.668100 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e672f07e-7a5a-41fc-a23e-27a00d92203a tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:14.668440 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e672f07e-7a5a-41fc-a23e-27a00d92203a tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:14.710537 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e672f07e-7a5a-41fc-a23e-27a00d92203a tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] [instance: adc33804-eb64-40ca-a943-f2e74040c1b2] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:36:14.884636 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f454fec2-c689-4c2c-b389-d6e93818c397 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:14.896860 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f454fec2-c689-4c2c-b389-d6e93818c397 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035" status: 200 len: 1470 microversion: 2.1 time: 0.313092 Oct 04 18:36:14.898080 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1114/2123] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:14 2022] GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035 => generated 1470 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:14.964687 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-108fa3ec-1894-4aee-85af-a0109ba4e219 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:14.965703 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-108fa3ec-1894-4aee-85af-a0109ba4e219 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: 600147f3-401d-4897-8ce1-0f536234c3fa] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:14.978451 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-108fa3ec-1894-4aee-85af-a0109ba4e219 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:14.982302 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-108fa3ec-1894-4aee-85af-a0109ba4e219 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:14.982879 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-108fa3ec-1894-4aee-85af-a0109ba4e219 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:14.985564 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-108fa3ec-1894-4aee-85af-a0109ba4e219 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:14.986852 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-108fa3ec-1894-4aee-85af-a0109ba4e219 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:14.989142 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-108fa3ec-1894-4aee-85af-a0109ba4e219 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:15.071514 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e672f07e-7a5a-41fc-a23e-27a00d92203a tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] 10.222.0.20 "DELETE /compute/v2.1/servers/adc33804-eb64-40ca-a943-f2e74040c1b2" status: 204 len: 0 microversion: 2.1 time: 0.428478 Oct 04 18:36:15.073131 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1010/2124] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:36:14 2022] DELETE /compute/v2.1/servers/adc33804-eb64-40ca-a943-f2e74040c1b2 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:36:15.084541 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1581f75d-7029-4d2e-bd37-405e109c5ec0 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:15.085666 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1581f75d-7029-4d2e-bd37-405e109c5ec0 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] [instance: adc33804-eb64-40ca-a943-f2e74040c1b2] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:15.094335 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1581f75d-7029-4d2e-bd37-405e109c5ec0 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:15.096787 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1581f75d-7029-4d2e-bd37-405e109c5ec0 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:15.097635 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1581f75d-7029-4d2e-bd37-405e109c5ec0 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:15.098701 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1581f75d-7029-4d2e-bd37-405e109c5ec0 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:15.099331 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1581f75d-7029-4d2e-bd37-405e109c5ec0 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:15.100032 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1581f75d-7029-4d2e-bd37-405e109c5ec0 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:15.320951 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-108fa3ec-1894-4aee-85af-a0109ba4e219 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:15.329781 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-108fa3ec-1894-4aee-85af-a0109ba4e219 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/600147f3-401d-4897-8ce1-0f536234c3fa" status: 200 len: 1492 microversion: 2.1 time: 0.368709 Oct 04 18:36:15.345978 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1115/2125] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:14 2022] GET /compute/v2.1/servers/600147f3-401d-4897-8ce1-0f536234c3fa => generated 1492 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:15.367150 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1581f75d-7029-4d2e-bd37-405e109c5ec0 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81e50834114f0fa3cca4b0b9f8acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4650d613cb84018b92dc5d51486885e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:15.382085 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8d5f4d67-b474-4bce-837f-75de55763580 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:15.383108 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8d5f4d67-b474-4bce-837f-75de55763580 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] [instance: 4fbde026-7d69-4924-97e6-28262d00e5db] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:15.386685 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1581f75d-7029-4d2e-bd37-405e109c5ec0 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] 10.222.0.20 "GET /compute/v2.1/servers/adc33804-eb64-40ca-a943-f2e74040c1b2" status: 200 len: 1519 microversion: 2.1 time: 0.306984 Oct 04 18:36:15.387500 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1011/2126] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:15 2022] GET /compute/v2.1/servers/adc33804-eb64-40ca-a943-f2e74040c1b2 => generated 1519 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:36:15.392275 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8d5f4d67-b474-4bce-837f-75de55763580 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:15.393124 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8d5f4d67-b474-4bce-837f-75de55763580 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:15.393415 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8d5f4d67-b474-4bce-837f-75de55763580 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:15.394246 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8d5f4d67-b474-4bce-837f-75de55763580 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:15.394782 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8d5f4d67-b474-4bce-837f-75de55763580 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:15.395277 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8d5f4d67-b474-4bce-837f-75de55763580 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:15.454986 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b1eb56d8-f1c6-4d20-8dca-ecd162e1b15b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:15.455606 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b1eb56d8-f1c6-4d20-8dca-ecd162e1b15b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: cd74aff9-f694-49f3-a1cc-2095b71cd9e5] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:15.464896 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b1eb56d8-f1c6-4d20-8dca-ecd162e1b15b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:15.465676 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b1eb56d8-f1c6-4d20-8dca-ecd162e1b15b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:15.466297 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b1eb56d8-f1c6-4d20-8dca-ecd162e1b15b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:15.467286 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b1eb56d8-f1c6-4d20-8dca-ecd162e1b15b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:15.469541 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b1eb56d8-f1c6-4d20-8dca-ecd162e1b15b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:15.470749 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b1eb56d8-f1c6-4d20-8dca-ecd162e1b15b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:15.803909 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8d5f4d67-b474-4bce-837f-75de55763580 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb44381220d43b7bdfa744a1dc410a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3242afeef424d588cf102a2f0f38020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:15.816994 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8d5f4d67-b474-4bce-837f-75de55763580 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] 10.222.0.20 "GET /compute/v2.1/servers/4fbde026-7d69-4924-97e6-28262d00e5db" status: 200 len: 1809 microversion: 2.1 time: 0.438968 Oct 04 18:36:15.829413 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1116/2127] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:15 2022] GET /compute/v2.1/servers/4fbde026-7d69-4924-97e6-28262d00e5db => generated 1809 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:15.829413 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-062d493d-fe0e-4bae-82a2-08df2d086a49 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:15.829413 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-062d493d-fe0e-4bae-82a2-08df2d086a49 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:15.837960 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-062d493d-fe0e-4bae-82a2-08df2d086a49 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:15.837960 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-062d493d-fe0e-4bae-82a2-08df2d086a49 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:15.837960 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-062d493d-fe0e-4bae-82a2-08df2d086a49 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:15.837960 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-062d493d-fe0e-4bae-82a2-08df2d086a49 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:15.837960 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-062d493d-fe0e-4bae-82a2-08df2d086a49 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:15.837960 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-062d493d-fe0e-4bae-82a2-08df2d086a49 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:15.856696 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b1eb56d8-f1c6-4d20-8dca-ecd162e1b15b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:15.874031 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b1eb56d8-f1c6-4d20-8dca-ecd162e1b15b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:15.874031 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b1eb56d8-f1c6-4d20-8dca-ecd162e1b15b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:15.884356 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b1eb56d8-f1c6-4d20-8dca-ecd162e1b15b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5" status: 200 len: 1281 microversion: 2.25 time: 0.435043 Oct 04 18:36:15.908982 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1012/2128] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:15 2022] GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5 => generated 1281 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:36:15.921581 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6cad6566-f32f-4bac-8430-0c1c8974b1f3 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:15.922967 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6cad6566-f32f-4bac-8430-0c1c8974b1f3 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 3ead1560-9c23-48ad-a938-6b3179b70035] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:15.935958 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6cad6566-f32f-4bac-8430-0c1c8974b1f3 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:15.936371 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6cad6566-f32f-4bac-8430-0c1c8974b1f3 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:15.938560 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6cad6566-f32f-4bac-8430-0c1c8974b1f3 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:15.939286 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6cad6566-f32f-4bac-8430-0c1c8974b1f3 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:15.939748 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6cad6566-f32f-4bac-8430-0c1c8974b1f3 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:15.940198 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6cad6566-f32f-4bac-8430-0c1c8974b1f3 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:15.985358 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-062d493d-fe0e-4bae-82a2-08df2d086a49 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:15.995203 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-062d493d-fe0e-4bae-82a2-08df2d086a49 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:16.007221 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-062d493d-fe0e-4bae-82a2-08df2d086a49 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c4125e047784f3684a6688e78aa6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bba928e5c484bd886efd007b93878ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:16.021180 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-062d493d-fe0e-4bae-82a2-08df2d086a49 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 200 len: 1537 microversion: 2.91 time: 0.201955 Oct 04 18:36:16.022737 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1117/2129] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:15 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 1537 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:36:16.314232 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6cad6566-f32f-4bac-8430-0c1c8974b1f3 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:16.321660 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6cad6566-f32f-4bac-8430-0c1c8974b1f3 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035" status: 200 len: 1470 microversion: 2.1 time: 0.404934 Oct 04 18:36:16.337811 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1013/2130] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:15 2022] GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035 => generated 1470 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:36:16.353394 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d7ab0287-5690-4c6d-9b73-90ecbbbef1c3 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:16.354008 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d7ab0287-5690-4c6d-9b73-90ecbbbef1c3 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: 600147f3-401d-4897-8ce1-0f536234c3fa] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:16.362122 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d7ab0287-5690-4c6d-9b73-90ecbbbef1c3 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:16.363042 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d7ab0287-5690-4c6d-9b73-90ecbbbef1c3 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:16.363694 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d7ab0287-5690-4c6d-9b73-90ecbbbef1c3 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:16.365191 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d7ab0287-5690-4c6d-9b73-90ecbbbef1c3 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:16.366266 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d7ab0287-5690-4c6d-9b73-90ecbbbef1c3 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:16.367160 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d7ab0287-5690-4c6d-9b73-90ecbbbef1c3 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:16.411457 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-61e245a3-2bcc-452a-9add-d4843095de5c tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:16.411770 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-61e245a3-2bcc-452a-9add-d4843095de5c tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] [instance: adc33804-eb64-40ca-a943-f2e74040c1b2] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:16.423160 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-61e245a3-2bcc-452a-9add-d4843095de5c tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:16.425280 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-61e245a3-2bcc-452a-9add-d4843095de5c tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:16.428675 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-61e245a3-2bcc-452a-9add-d4843095de5c tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:16.428675 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-61e245a3-2bcc-452a-9add-d4843095de5c tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:16.429199 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-61e245a3-2bcc-452a-9add-d4843095de5c tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:16.431342 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-61e245a3-2bcc-452a-9add-d4843095de5c tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:16.707621 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d7ab0287-5690-4c6d-9b73-90ecbbbef1c3 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:16.732561 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-61e245a3-2bcc-452a-9add-d4843095de5c tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81e50834114f0fa3cca4b0b9f8acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4650d613cb84018b92dc5d51486885e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:16.733908 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d7ab0287-5690-4c6d-9b73-90ecbbbef1c3 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/600147f3-401d-4897-8ce1-0f536234c3fa" status: 200 len: 1492 microversion: 2.1 time: 0.384461 Oct 04 18:36:16.748906 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-61e245a3-2bcc-452a-9add-d4843095de5c tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] 10.222.0.20 "GET /compute/v2.1/servers/adc33804-eb64-40ca-a943-f2e74040c1b2" status: 200 len: 1519 microversion: 2.1 time: 0.336959 Oct 04 18:36:16.749636 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1118/2131] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:16 2022] GET /compute/v2.1/servers/600147f3-401d-4897-8ce1-0f536234c3fa => generated 1492 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:16.761798 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1014/2132] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:16 2022] GET /compute/v2.1/servers/adc33804-eb64-40ca-a943-f2e74040c1b2 => generated 1519 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:16.846287 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-dbc961d7-9714-458b-b05b-c3ea971d5ba8 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:16.847021 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-dbc961d7-9714-458b-b05b-c3ea971d5ba8 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] [instance: 4fbde026-7d69-4924-97e6-28262d00e5db] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:16.863410 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dbc961d7-9714-458b-b05b-c3ea971d5ba8 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:16.864018 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dbc961d7-9714-458b-b05b-c3ea971d5ba8 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:16.871311 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dbc961d7-9714-458b-b05b-c3ea971d5ba8 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:16.871311 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dbc961d7-9714-458b-b05b-c3ea971d5ba8 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:16.871311 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dbc961d7-9714-458b-b05b-c3ea971d5ba8 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:16.871311 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dbc961d7-9714-458b-b05b-c3ea971d5ba8 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:16.909043 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-caae378c-6fab-4a27-8e6e-3eaf91678258 req-2515f07e-9294-496d-a95e-1b2ca23288f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "600147f3-401d-4897-8ce1-0f536234c3fa", "name": "network-vif-deleted", "tag": "a25f2711-7194-4624-bebd-55e73ad4b5c9"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:16.927581 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-caae378c-6fab-4a27-8e6e-3eaf91678258 req-2515f07e-9294-496d-a95e-1b2ca23288f6 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:16.931802 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-caae378c-6fab-4a27-8e6e-3eaf91678258 req-2515f07e-9294-496d-a95e-1b2ca23288f6 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:16.932588 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-caae378c-6fab-4a27-8e6e-3eaf91678258 req-2515f07e-9294-496d-a95e-1b2ca23288f6 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:16.961729 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-caae378c-6fab-4a27-8e6e-3eaf91678258 req-2515f07e-9294-496d-a95e-1b2ca23288f6 service nova] Creating event network-vif-deleted:a25f2711-7194-4624-bebd-55e73ad4b5c9 for instance 600147f3-401d-4897-8ce1-0f536234c3fa on n-h1-850501-14 Oct 04 18:36:16.970389 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-caae378c-6fab-4a27-8e6e-3eaf91678258 req-2515f07e-9294-496d-a95e-1b2ca23288f6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064561 Oct 04 18:36:16.971791 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1015/2133] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:36:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:36:16.993899 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4bc15181-f4b4-4b2b-9ecd-0dd2ae4580a1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:16.994921 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-4bc15181-f4b4-4b2b-9ecd-0dd2ae4580a1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: cd74aff9-f694-49f3-a1cc-2095b71cd9e5] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:17.009278 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4bc15181-f4b4-4b2b-9ecd-0dd2ae4580a1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:17.010064 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4bc15181-f4b4-4b2b-9ecd-0dd2ae4580a1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:17.010725 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4bc15181-f4b4-4b2b-9ecd-0dd2ae4580a1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:17.011638 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4bc15181-f4b4-4b2b-9ecd-0dd2ae4580a1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:17.012358 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4bc15181-f4b4-4b2b-9ecd-0dd2ae4580a1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:17.020411 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4bc15181-f4b4-4b2b-9ecd-0dd2ae4580a1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:17.409371 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-dbc961d7-9714-458b-b05b-c3ea971d5ba8 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb44381220d43b7bdfa744a1dc410a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3242afeef424d588cf102a2f0f38020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:17.423000 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-dbc961d7-9714-458b-b05b-c3ea971d5ba8 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] 10.222.0.20 "GET /compute/v2.1/servers/4fbde026-7d69-4924-97e6-28262d00e5db" status: 200 len: 1788 microversion: 2.1 time: 0.581035 Oct 04 18:36:17.423000 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1119/2134] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:16 2022] GET /compute/v2.1/servers/4fbde026-7d69-4924-97e6-28262d00e5db => generated 1788 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:17.428581 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-86819b72-f923-454b-a524-05375fc9f681 req-a819b43e-6ec8-4abe-a7ce-419b73a6315d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fbde026-7d69-4924-97e6-28262d00e5db", "name": "network-vif-deleted", "tag": "02a2cc69-90c5-45e4-b836-8c90afdd6218"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:17.447197 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-86819b72-f923-454b-a524-05375fc9f681 req-a819b43e-6ec8-4abe-a7ce-419b73a6315d service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:17.448166 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-86819b72-f923-454b-a524-05375fc9f681 req-a819b43e-6ec8-4abe-a7ce-419b73a6315d service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:17.449087 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-86819b72-f923-454b-a524-05375fc9f681 req-a819b43e-6ec8-4abe-a7ce-419b73a6315d service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:17.471715 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-86819b72-f923-454b-a524-05375fc9f681 req-a819b43e-6ec8-4abe-a7ce-419b73a6315d service nova] Creating event network-vif-deleted:02a2cc69-90c5-45e4-b836-8c90afdd6218 for instance 4fbde026-7d69-4924-97e6-28262d00e5db on n-h1-850501-14 Oct 04 18:36:17.478163 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-4bc15181-f4b4-4b2b-9ecd-0dd2ae4580a1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:17.489540 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-86819b72-f923-454b-a524-05375fc9f681 req-a819b43e-6ec8-4abe-a7ce-419b73a6315d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065698 Oct 04 18:36:17.491309 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1120/2135] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:36:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:36:17.497312 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8177fadc-4568-44d7-8270-24bb8fce8c92 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:17.510790 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-4bc15181-f4b4-4b2b-9ecd-0dd2ae4580a1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:17.513974 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8177fadc-4568-44d7-8270-24bb8fce8c92 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] [instance: bb962e56-0c86-4511-b629-d51507a3a8c9] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:17.517295 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-4bc15181-f4b4-4b2b-9ecd-0dd2ae4580a1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:17.529039 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-4bc15181-f4b4-4b2b-9ecd-0dd2ae4580a1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5" status: 200 len: 1281 microversion: 2.25 time: 0.551208 Oct 04 18:36:17.532278 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8177fadc-4568-44d7-8270-24bb8fce8c92 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:17.533029 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8177fadc-4568-44d7-8270-24bb8fce8c92 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:17.536482 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8177fadc-4568-44d7-8270-24bb8fce8c92 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:17.536482 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8177fadc-4568-44d7-8270-24bb8fce8c92 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:17.536482 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8177fadc-4568-44d7-8270-24bb8fce8c92 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:17.536482 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8177fadc-4568-44d7-8270-24bb8fce8c92 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:17.553233 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1016/2136] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:16 2022] GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5 => generated 1281 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:36:17.566635 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d467f459-ee4d-4b55-b85b-b26394c42ac0 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:17.576268 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-8177fadc-4568-44d7-8270-24bb8fce8c92 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] HTTP exception thrown: Instance bb962e56-0c86-4511-b629-d51507a3a8c9 could not be found. Oct 04 18:36:17.577513 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d467f459-ee4d-4b55-b85b-b26394c42ac0 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 3ead1560-9c23-48ad-a938-6b3179b70035] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:17.577725 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8177fadc-4568-44d7-8270-24bb8fce8c92 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Request method failure captured: Oct 04 18:36:17.577725 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 HTTP/1.1 Oct 04 18:36:17.577725 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:36:17.577725 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:36:17.577725 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:36:17.577725 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:36:17.577725 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:36:17.577725 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:36:17.577725 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:36:17.577725 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:36:17.577725 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPHxWl2E-kw3ebi0E1dHCRZVMoX8Jakh9TQBIl6_NV7HSp0zNJvbaK4ENL1dxAfEXAOQr3Bu8zYbuced4NRTTrpFun4bkvuZwjbKjg6jdq22T7MTyIFyyMU-LCUJWpLo8NRGtVO5n6-4mbl5AaWHRDVo3XiK2UIqjNMUdgl49o8M5UJ0 Oct 04 18:36:17.577725 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:36:17.577725 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:36:17.577725 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:36:17.577725 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:36:17.577725 n-d-850501-14 devstack@n-api.service[123002]: X-Openstack-Nova-Api-Version: 2.91 Oct 04 18:36:17.577725 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:36:17.577725 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:36:17.577725 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 0bba928e5c484bd886efd007b93878ff Oct 04 18:36:17.577725 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-1236001962 Oct 04 18:36:17.577725 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:36:17.577725 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:36:17.577725 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0bba928e5c484bd886efd007b93878ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0bba928e5c484bd886efd007b93878ff", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0bba928e5c484bd886efd007b93878ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0bba928e5c484bd886efd007b93878ff"}]}] Oct 04 18:36:17.577725 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-1236001962 Oct 04 18:36:17.577725 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 0bba928e5c484bd886efd007b93878ff Oct 04 18:36:17.577725 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-1236001962 Oct 04 18:36:17.577725 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-UnshelveToHostMultiNodesTest-1236001962-project Oct 04 18:36:17.577725 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:36:17.577725 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:36:17.577725 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 5c4125e047784f3684a6688e78aa6b8d Oct 04 18:36:17.577725 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-1236001962-project Oct 04 18:36:17.577725 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:36:17.577725 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance bb962e56-0c86-4511-b629-d51507a3a8c9 could not be found. Oct 04 18:36:17.577725 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'bb962e56-0c86-4511-b629-d51507a3a8c9'} Oct 04 18:36:17.577725 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:36:17.577725 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:17.577725 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:36:17.577725 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:36:17.577725 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:36:17.577725 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:36:17.577725 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:36:17.577725 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:36:17.577725 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:36:17.577725 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:36:17.577725 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb962e56-0c86-4511-b629-d51507a3a8c9 could not be found. Oct 04 18:36:17.577725 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:36:17.577725 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:17.577725 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:36:17.577725 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:17.577725 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:17.577725 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:17.577725 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:36:17.577725 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:36:17.577725 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:36:17.577725 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:36:17.577725 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:36:17.577725 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:36:17.577725 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:36:17.577725 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:36:17.577725 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:36:17.577725 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:36:17.577725 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb962e56-0c86-4511-b629-d51507a3a8c9 could not be found. Oct 04 18:36:17.577725 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:36:17.583731 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:17.583731 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:36:17.583731 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:17.583731 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:17.583731 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:17.583731 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:36:17.583731 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:36:17.583731 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb962e56-0c86-4511-b629-d51507a3a8c9 could not be found. Oct 04 18:36:17.583731 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:36:17.583731 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8177fadc-4568-44d7-8270-24bb8fce8c92 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] Returning 404 to user: Instance bb962e56-0c86-4511-b629-d51507a3a8c9 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:36:17.583731 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8177fadc-4568-44d7-8270-24bb8fce8c92 tempest-UnshelveToHostMultiNodesTest-1236001962 tempest-UnshelveToHostMultiNodesTest-1236001962-project] 10.222.0.20 "GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9" status: 404 len: 111 microversion: 2.91 time: 0.078409 Oct 04 18:36:17.583731 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1121/2137] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:17 2022] GET /compute/v2.1/servers/bb962e56-0c86-4511-b629-d51507a3a8c9 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:36:17.587014 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d467f459-ee4d-4b55-b85b-b26394c42ac0 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:17.587014 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d467f459-ee4d-4b55-b85b-b26394c42ac0 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:17.587014 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d467f459-ee4d-4b55-b85b-b26394c42ac0 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:17.587014 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d467f459-ee4d-4b55-b85b-b26394c42ac0 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:17.587014 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d467f459-ee4d-4b55-b85b-b26394c42ac0 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:17.587485 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d467f459-ee4d-4b55-b85b-b26394c42ac0 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:17.759207 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c174433e-df1b-43fb-9f0a-607ab533b781 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:17.760167 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c174433e-df1b-43fb-9f0a-607ab533b781 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: 600147f3-401d-4897-8ce1-0f536234c3fa] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:17.769853 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c174433e-df1b-43fb-9f0a-607ab533b781 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:17.773928 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c174433e-df1b-43fb-9f0a-607ab533b781 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:17.789802 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c174433e-df1b-43fb-9f0a-607ab533b781 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:17.791687 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c174433e-df1b-43fb-9f0a-607ab533b781 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:17.795082 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c174433e-df1b-43fb-9f0a-607ab533b781 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:17.800446 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c174433e-df1b-43fb-9f0a-607ab533b781 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:17.875968 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c174433e-df1b-43fb-9f0a-607ab533b781 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:17.877202 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c174433e-df1b-43fb-9f0a-607ab533b781 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:17.877809 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c174433e-df1b-43fb-9f0a-607ab533b781 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:17.878435 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-c174433e-df1b-43fb-9f0a-607ab533b781 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lazy-loading 'fault' on Instance uuid 600147f3-401d-4897-8ce1-0f536234c3fa {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:36:18.005409 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c174433e-df1b-43fb-9f0a-607ab533b781 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3c7ad35a05450496b6d1ff64f12b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c83d7b68684daf8e67ba2361ad86c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:18.013577 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c174433e-df1b-43fb-9f0a-607ab533b781 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/600147f3-401d-4897-8ce1-0f536234c3fa" status: 200 len: 1297 microversion: 2.1 time: 0.258503 Oct 04 18:36:18.018844 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1122/2138] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:17 2022] GET /compute/v2.1/servers/600147f3-401d-4897-8ce1-0f536234c3fa => generated 1297 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:36:18.032071 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-617656bb-02e3-4965-a644-b4e668584f87 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:18.035996 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-617656bb-02e3-4965-a644-b4e668584f87 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] [instance: adc33804-eb64-40ca-a943-f2e74040c1b2] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:18.061866 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-617656bb-02e3-4965-a644-b4e668584f87 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:18.062744 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-617656bb-02e3-4965-a644-b4e668584f87 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:18.063366 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-617656bb-02e3-4965-a644-b4e668584f87 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:18.066322 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-617656bb-02e3-4965-a644-b4e668584f87 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:18.068309 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-617656bb-02e3-4965-a644-b4e668584f87 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:18.069420 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-617656bb-02e3-4965-a644-b4e668584f87 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:18.802253 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d467f459-ee4d-4b55-b85b-b26394c42ac0 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:18.817056 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d467f459-ee4d-4b55-b85b-b26394c42ac0 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035" status: 200 len: 1470 microversion: 2.1 time: 1.261800 Oct 04 18:36:18.827564 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1017/2139] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:17 2022] GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035 => generated 1470 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:18.832624 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-47ee8f55-11f4-4220-b322-a2a65f2f6c65 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:18.833450 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-47ee8f55-11f4-4220-b322-a2a65f2f6c65 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] [instance: 4fbde026-7d69-4924-97e6-28262d00e5db] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:18.847824 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-47ee8f55-11f4-4220-b322-a2a65f2f6c65 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:18.849241 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-47ee8f55-11f4-4220-b322-a2a65f2f6c65 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:18.849865 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-47ee8f55-11f4-4220-b322-a2a65f2f6c65 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:18.850767 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-47ee8f55-11f4-4220-b322-a2a65f2f6c65 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:18.861671 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-47ee8f55-11f4-4220-b322-a2a65f2f6c65 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:18.861671 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-47ee8f55-11f4-4220-b322-a2a65f2f6c65 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:18.900111 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:19.063989 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-617656bb-02e3-4965-a644-b4e668584f87 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81e50834114f0fa3cca4b0b9f8acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4650d613cb84018b92dc5d51486885e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:19.078002 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-617656bb-02e3-4965-a644-b4e668584f87 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] 10.222.0.20 "GET /compute/v2.1/servers/adc33804-eb64-40ca-a943-f2e74040c1b2" status: 200 len: 1519 microversion: 2.1 time: 1.057537 Oct 04 18:36:19.079014 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1123/2140] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:18 2022] GET /compute/v2.1/servers/adc33804-eb64-40ca-a943-f2e74040c1b2 => generated 1519 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:19.104110 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6b4beaa7-9549-4db3-aec9-0f8edf464b54 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:19.105135 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-6b4beaa7-9549-4db3-aec9-0f8edf464b54 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: cd74aff9-f694-49f3-a1cc-2095b71cd9e5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:19.112627 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6b4beaa7-9549-4db3-aec9-0f8edf464b54 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:19.113531 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6b4beaa7-9549-4db3-aec9-0f8edf464b54 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:19.114213 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6b4beaa7-9549-4db3-aec9-0f8edf464b54 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:19.116213 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6b4beaa7-9549-4db3-aec9-0f8edf464b54 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:19.117207 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6b4beaa7-9549-4db3-aec9-0f8edf464b54 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:19.119848 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6b4beaa7-9549-4db3-aec9-0f8edf464b54 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:19.160506 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:19.527573 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-47ee8f55-11f4-4220-b322-a2a65f2f6c65 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb44381220d43b7bdfa744a1dc410a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3242afeef424d588cf102a2f0f38020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:19.539670 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-47ee8f55-11f4-4220-b322-a2a65f2f6c65 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] 10.222.0.20 "GET /compute/v2.1/servers/4fbde026-7d69-4924-97e6-28262d00e5db" status: 200 len: 1611 microversion: 2.1 time: 0.720006 Oct 04 18:36:19.544407 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1018/2141] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:18 2022] GET /compute/v2.1/servers/4fbde026-7d69-4924-97e6-28262d00e5db => generated 1611 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:19.568755 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d00b9ae6-ad12-4717-a654-cbb4a8832eca tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:19.569395 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d00b9ae6-ad12-4717-a654-cbb4a8832eca tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: 600147f3-401d-4897-8ce1-0f536234c3fa] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:19.590229 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d00b9ae6-ad12-4717-a654-cbb4a8832eca tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:19.595609 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d00b9ae6-ad12-4717-a654-cbb4a8832eca tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:19.596233 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d00b9ae6-ad12-4717-a654-cbb4a8832eca tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:19.602393 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d00b9ae6-ad12-4717-a654-cbb4a8832eca tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:19.603148 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d00b9ae6-ad12-4717-a654-cbb4a8832eca tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:19.604952 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d00b9ae6-ad12-4717-a654-cbb4a8832eca tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:19.658642 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-d00b9ae6-ad12-4717-a654-cbb4a8832eca tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] HTTP exception thrown: Instance 600147f3-401d-4897-8ce1-0f536234c3fa could not be found. Oct 04 18:36:19.660329 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d00b9ae6-ad12-4717-a654-cbb4a8832eca tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Request method failure captured: Oct 04 18:36:19.660329 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/600147f3-401d-4897-8ce1-0f536234c3fa HTTP/1.1 Oct 04 18:36:19.660329 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:36:19.660329 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:36:19.660329 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:36:19.660329 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:36:19.660329 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:36:19.660329 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:36:19.660329 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:36:19.660329 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:36:19.660329 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPHwUQIR1TKCa6SuO5KxFm7-u_FizcG48Uot0gdIOuCeSh8CFWYcfwzYNxmsP1Ox8pbA_3AaF7FzwotmrVSCbO7eABAZII6tUmaEh-Y24i0KlqIupFERqEnu-z8kdpdoodlufKA0ebuuWvnLVx428den86l5yxh9C2_Lvb9bKR3dLeNk Oct 04 18:36:19.660329 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:36:19.660329 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:36:19.660329 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:36:19.660329 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:36:19.660329 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:36:19.660329 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:36:19.660329 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 08c83d7b68684daf8e67ba2361ad86c9 Oct 04 18:36:19.660329 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ImagesTestJSON-1467584864 Oct 04 18:36:19.660329 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:36:19.660329 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:36:19.660329 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/08c83d7b68684daf8e67ba2361ad86c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_08c83d7b68684daf8e67ba2361ad86c9", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/08c83d7b68684daf8e67ba2361ad86c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/08c83d7b68684daf8e67ba2361ad86c9"}]}] Oct 04 18:36:19.660329 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ImagesTestJSON-1467584864 Oct 04 18:36:19.660329 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 08c83d7b68684daf8e67ba2361ad86c9 Oct 04 18:36:19.660329 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ImagesTestJSON-1467584864 Oct 04 18:36:19.660329 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ImagesTestJSON-1467584864-project Oct 04 18:36:19.660329 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:36:19.660329 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:36:19.660329 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: ef3c7ad35a05450496b6d1ff64f12b77 Oct 04 18:36:19.660329 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ImagesTestJSON-1467584864-project Oct 04 18:36:19.660329 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:36:19.660329 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 600147f3-401d-4897-8ce1-0f536234c3fa could not be found. Oct 04 18:36:19.660329 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '600147f3-401d-4897-8ce1-0f536234c3fa'} Oct 04 18:36:19.660329 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:36:19.660329 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:19.660329 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:36:19.660329 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:36:19.660329 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:36:19.660329 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:36:19.660329 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:36:19.660329 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:36:19.660329 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:36:19.660329 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:36:19.660329 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 600147f3-401d-4897-8ce1-0f536234c3fa could not be found. Oct 04 18:36:19.660329 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:36:19.660329 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:19.660329 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:36:19.660329 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:19.660329 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:19.660329 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:19.660329 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:36:19.660329 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:36:19.660329 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:36:19.660329 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:36:19.660329 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:36:19.660329 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:36:19.660329 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:36:19.660329 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:36:19.660329 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:36:19.660329 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:36:19.660329 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 600147f3-401d-4897-8ce1-0f536234c3fa could not be found. Oct 04 18:36:19.660329 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:36:19.660329 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:19.660329 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:36:19.660329 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:19.665064 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:19.665064 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:19.665064 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:36:19.665064 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:36:19.665064 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 600147f3-401d-4897-8ce1-0f536234c3fa could not be found. Oct 04 18:36:19.665064 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:36:19.665064 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d00b9ae6-ad12-4717-a654-cbb4a8832eca tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Returning 404 to user: Instance 600147f3-401d-4897-8ce1-0f536234c3fa could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:36:19.665064 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d00b9ae6-ad12-4717-a654-cbb4a8832eca tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/600147f3-401d-4897-8ce1-0f536234c3fa" status: 404 len: 111 microversion: 2.1 time: 0.115074 Oct 04 18:36:19.665064 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1019/2142] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:19 2022] GET /compute/v2.1/servers/600147f3-401d-4897-8ce1-0f536234c3fa => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:36:19.675598 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-00d23589-fc84-41ab-ac43-d75d11a712db req-1d5a2800-5e26-48fa-b253-e9835b9778f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fbde026-7d69-4924-97e6-28262d00e5db", "name": "network-vif-deleted", "tag": "03780673-89a1-4320-8c01-92071ed08378"}, {"server_uuid": "4fbde026-7d69-4924-97e6-28262d00e5db", "name": "network-vif-deleted", "tag": "93b066fb-3183-4276-b726-fe88bd826b24"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:19.690923 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-6b4beaa7-9549-4db3-aec9-0f8edf464b54 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:19.726354 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-00d23589-fc84-41ab-ac43-d75d11a712db req-1d5a2800-5e26-48fa-b253-e9835b9778f2 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:19.729519 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-6b4beaa7-9549-4db3-aec9-0f8edf464b54 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:19.730271 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-00d23589-fc84-41ab-ac43-d75d11a712db req-1d5a2800-5e26-48fa-b253-e9835b9778f2 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:19.736874 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-6b4beaa7-9549-4db3-aec9-0f8edf464b54 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:19.738655 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6b4beaa7-9549-4db3-aec9-0f8edf464b54 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5" status: 200 len: 1281 microversion: 2.25 time: 0.638167 Oct 04 18:36:19.742295 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1124/2143] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:19 2022] GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5 => generated 1281 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:36:19.745544 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-00d23589-fc84-41ab-ac43-d75d11a712db req-1d5a2800-5e26-48fa-b253-e9835b9778f2 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:19.757255 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f22989c6-e4ed-42ab-bf47-5c25274ba9e5 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '.version_select at 0x7fe259536280>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:19.788443 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-00d23589-fc84-41ab-ac43-d75d11a712db req-1d5a2800-5e26-48fa-b253-e9835b9778f2 service nova] Creating event network-vif-deleted:03780673-89a1-4320-8c01-92071ed08378 for instance 4fbde026-7d69-4924-97e6-28262d00e5db on n-h1-850501-14 Oct 04 18:36:19.789006 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-00d23589-fc84-41ab-ac43-d75d11a712db req-1d5a2800-5e26-48fa-b253-e9835b9778f2 service nova] Creating event network-vif-deleted:93b066fb-3183-4276-b726-fe88bd826b24 for instance 4fbde026-7d69-4924-97e6-28262d00e5db on n-h1-850501-14 Oct 04 18:36:19.805214 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-00d23589-fc84-41ab-ac43-d75d11a712db req-1d5a2800-5e26-48fa-b253-e9835b9778f2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.138748 Oct 04 18:36:19.818192 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-f22989c6-e4ed-42ab-bf47-5c25274ba9e5 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] HTTP exception thrown: Image not found. Oct 04 18:36:19.820322 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f22989c6-e4ed-42ab-bf47-5c25274ba9e5 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Request method failure captured: Oct 04 18:36:19.820322 n-d-850501-14 devstack@n-api.service[123002]: request: DELETE /compute/v2.1/images/e64eecee-1f9d-474a-9126-89110fbb7f85 HTTP/1.1 Oct 04 18:36:19.820322 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:36:19.820322 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:36:19.820322 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:36:19.820322 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:36:19.820322 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:36:19.820322 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:36:19.820322 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:36:19.820322 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:36:19.820322 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPHwUQIR1TKCa6SuO5KxFm7-u_FizcG48Uot0gdIOuCeSh8CFWYcfwzYNxmsP1Ox8pbA_3AaF7FzwotmrVSCbO7eABAZII6tUmaEh-Y24i0KlqIupFERqEnu-z8kdpdoodlufKA0ebuuWvnLVx428den86l5yxh9C2_Lvb9bKR3dLeNk Oct 04 18:36:19.820322 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:36:19.820322 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:36:19.820322 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:36:19.820322 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:36:19.820322 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:36:19.820322 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:36:19.820322 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 08c83d7b68684daf8e67ba2361ad86c9 Oct 04 18:36:19.820322 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ImagesTestJSON-1467584864 Oct 04 18:36:19.820322 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:36:19.820322 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:36:19.820322 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/08c83d7b68684daf8e67ba2361ad86c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_08c83d7b68684daf8e67ba2361ad86c9", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/08c83d7b68684daf8e67ba2361ad86c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/08c83d7b68684daf8e67ba2361ad86c9"}]}] Oct 04 18:36:19.820322 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ImagesTestJSON-1467584864 Oct 04 18:36:19.820322 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 08c83d7b68684daf8e67ba2361ad86c9 Oct 04 18:36:19.820322 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ImagesTestJSON-1467584864 Oct 04 18:36:19.820322 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ImagesTestJSON-1467584864-project Oct 04 18:36:19.820322 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:36:19.820322 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:36:19.820322 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: ef3c7ad35a05450496b6d1ff64f12b77 Oct 04 18:36:19.820322 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ImagesTestJSON-1467584864-project Oct 04 18:36:19.820322 n-d-850501-14 devstack@n-api.service[123002]: method: Oct 04 18:36:19.820322 n-d-850501-14 devstack@n-api.service[123002]: exception: Image not found. Oct 04 18:36:19.820322 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'e64eecee-1f9d-474a-9126-89110fbb7f85'} Oct 04 18:36:19.820322 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:36:19.820322 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:19.820322 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 18:36:19.820322 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 18:36:19.820322 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:36:19.820322 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:36:19.820322 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:36:19.820322 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:36:19.820322 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 18:36:19.820322 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 18:36:19.820322 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 18:36:19.820322 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 18:36:19.820322 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:36:19.820322 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:36:19.820322 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:36:19.820322 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:36:19.820322 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image e64eecee-1f9d-474a-9126-89110fbb7f85 to delete Oct 04 18:36:19.820322 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:36:19.820322 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:19.820322 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:36:19.820322 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:19.820322 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 18:36:19.820322 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 18:36:19.820322 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 18:36:19.820322 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 18:36:19.820322 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 18:36:19.820322 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 18:36:19.820322 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e64eecee-1f9d-474a-9126-89110fbb7f85 could not be found. Oct 04 18:36:19.820322 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:36:19.820322 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:19.820322 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:36:19.820322 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:19.825937 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:19.825937 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:19.825937 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:36:19.825937 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:36:19.825937 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:36:19.825937 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:36:19.825937 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:36:19.825937 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:36:19.825937 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 18:36:19.825937 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 18:36:19.825937 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:36:19.825937 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:36:19.825937 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:19.825937 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:36:19.825937 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:19.825937 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:19.825937 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:19.825937 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:36:19.825937 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:36:19.825937 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:36:19.825937 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:36:19.825937 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f22989c6-e4ed-42ab-bf47-5c25274ba9e5 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Returning 404 to user: Image not found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:36:19.825937 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f22989c6-e4ed-42ab-bf47-5c25274ba9e5 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "DELETE /compute/v2.1/images/e64eecee-1f9d-474a-9126-89110fbb7f85" status: 404 len: 62 microversion: 2.1 time: 0.077036 Oct 04 18:36:19.825937 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1125/2144] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:19 2022] DELETE /compute/v2.1/images/e64eecee-1f9d-474a-9126-89110fbb7f85 => generated 62 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:36:19.832196 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0b788149-4e08-4113-b72f-a2483adb4d15 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:19.832714 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0b788149-4e08-4113-b72f-a2483adb4d15 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: 0fa89d74-e5c4-461c-adcc-6c29ce9ad8db] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:19.845744 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1020/2145] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:36:19 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:36:19.852741 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0b788149-4e08-4113-b72f-a2483adb4d15 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:19.854531 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0b788149-4e08-4113-b72f-a2483adb4d15 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:19.856185 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0b788149-4e08-4113-b72f-a2483adb4d15 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:19.858578 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0b788149-4e08-4113-b72f-a2483adb4d15 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:19.859271 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0b788149-4e08-4113-b72f-a2483adb4d15 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:19.861062 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0b788149-4e08-4113-b72f-a2483adb4d15 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:19.863083 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d8469264-b6ef-4d0f-ba64-fff1f4a24b25 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:19.871827 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d8469264-b6ef-4d0f-ba64-fff1f4a24b25 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 3ead1560-9c23-48ad-a938-6b3179b70035] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:19.883326 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-0b788149-4e08-4113-b72f-a2483adb4d15 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] HTTP exception thrown: Instance 0fa89d74-e5c4-461c-adcc-6c29ce9ad8db could not be found. Oct 04 18:36:19.885199 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0b788149-4e08-4113-b72f-a2483adb4d15 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Request method failure captured: Oct 04 18:36:19.885199 n-d-850501-14 devstack@n-api.service[123002]: request: DELETE /compute/v2.1/servers/0fa89d74-e5c4-461c-adcc-6c29ce9ad8db HTTP/1.1 Oct 04 18:36:19.885199 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:36:19.885199 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:36:19.885199 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:36:19.885199 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:36:19.885199 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:36:19.885199 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:36:19.885199 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:36:19.885199 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:36:19.885199 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPHwUQIR1TKCa6SuO5KxFm7-u_FizcG48Uot0gdIOuCeSh8CFWYcfwzYNxmsP1Ox8pbA_3AaF7FzwotmrVSCbO7eABAZII6tUmaEh-Y24i0KlqIupFERqEnu-z8kdpdoodlufKA0ebuuWvnLVx428den86l5yxh9C2_Lvb9bKR3dLeNk Oct 04 18:36:19.885199 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:36:19.885199 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:36:19.885199 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:36:19.885199 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:36:19.885199 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:36:19.885199 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:36:19.885199 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 08c83d7b68684daf8e67ba2361ad86c9 Oct 04 18:36:19.885199 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ImagesTestJSON-1467584864 Oct 04 18:36:19.885199 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:36:19.885199 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:36:19.885199 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/08c83d7b68684daf8e67ba2361ad86c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_08c83d7b68684daf8e67ba2361ad86c9", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/08c83d7b68684daf8e67ba2361ad86c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/08c83d7b68684daf8e67ba2361ad86c9"}]}] Oct 04 18:36:19.885199 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ImagesTestJSON-1467584864 Oct 04 18:36:19.885199 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 08c83d7b68684daf8e67ba2361ad86c9 Oct 04 18:36:19.885199 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ImagesTestJSON-1467584864 Oct 04 18:36:19.885199 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ImagesTestJSON-1467584864-project Oct 04 18:36:19.885199 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:36:19.885199 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:36:19.885199 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: ef3c7ad35a05450496b6d1ff64f12b77 Oct 04 18:36:19.885199 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ImagesTestJSON-1467584864-project Oct 04 18:36:19.885199 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:36:19.885199 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 0fa89d74-e5c4-461c-adcc-6c29ce9ad8db could not be found. Oct 04 18:36:19.885199 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '0fa89d74-e5c4-461c-adcc-6c29ce9ad8db'} Oct 04 18:36:19.885199 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:36:19.885199 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:19.885199 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:36:19.885199 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:36:19.885199 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:36:19.885199 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:36:19.885199 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:36:19.885199 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:36:19.885199 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:36:19.885199 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:36:19.885199 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fa89d74-e5c4-461c-adcc-6c29ce9ad8db could not be found. Oct 04 18:36:19.885199 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:36:19.885199 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:19.885199 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:36:19.885199 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:19.885199 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:19.885199 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:19.885199 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:36:19.885199 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:36:19.885199 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:36:19.885199 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:36:19.885199 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:36:19.885199 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:36:19.885199 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:36:19.885199 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:36:19.885199 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:36:19.885199 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:36:19.885199 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:36:19.885199 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:36:19.885199 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fa89d74-e5c4-461c-adcc-6c29ce9ad8db could not be found. Oct 04 18:36:19.889837 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:36:19.889837 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:19.889837 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:36:19.889837 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:19.889837 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:19.889837 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:19.889837 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:36:19.889837 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:36:19.889837 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fa89d74-e5c4-461c-adcc-6c29ce9ad8db could not be found. Oct 04 18:36:19.889837 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:36:19.890627 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d8469264-b6ef-4d0f-ba64-fff1f4a24b25 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:19.890627 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d8469264-b6ef-4d0f-ba64-fff1f4a24b25 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:19.893756 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d8469264-b6ef-4d0f-ba64-fff1f4a24b25 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:19.893756 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d8469264-b6ef-4d0f-ba64-fff1f4a24b25 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:19.893756 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d8469264-b6ef-4d0f-ba64-fff1f4a24b25 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:19.894291 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d8469264-b6ef-4d0f-ba64-fff1f4a24b25 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:19.895679 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0b788149-4e08-4113-b72f-a2483adb4d15 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Returning 404 to user: Instance 0fa89d74-e5c4-461c-adcc-6c29ce9ad8db could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:36:19.897169 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0b788149-4e08-4113-b72f-a2483adb4d15 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0fa89d74-e5c4-461c-adcc-6c29ce9ad8db" status: 404 len: 111 microversion: 2.1 time: 0.070384 Oct 04 18:36:19.898242 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1126/2146] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:36:19 2022] DELETE /compute/v2.1/servers/0fa89d74-e5c4-461c-adcc-6c29ce9ad8db => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:36:19.908230 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1ff3d590-fd67-4740-8127-3455ef0e9625 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:19.909316 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1ff3d590-fd67-4740-8127-3455ef0e9625 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: 0fa89d74-e5c4-461c-adcc-6c29ce9ad8db] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:19.916177 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:19.917977 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1ff3d590-fd67-4740-8127-3455ef0e9625 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:19.918749 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1ff3d590-fd67-4740-8127-3455ef0e9625 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:19.919433 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1ff3d590-fd67-4740-8127-3455ef0e9625 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:19.920484 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1ff3d590-fd67-4740-8127-3455ef0e9625 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:19.921177 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1ff3d590-fd67-4740-8127-3455ef0e9625 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:19.921911 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1ff3d590-fd67-4740-8127-3455ef0e9625 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:19.941135 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-1ff3d590-fd67-4740-8127-3455ef0e9625 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] HTTP exception thrown: Instance 0fa89d74-e5c4-461c-adcc-6c29ce9ad8db could not be found. Oct 04 18:36:19.943180 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1ff3d590-fd67-4740-8127-3455ef0e9625 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Request method failure captured: Oct 04 18:36:19.943180 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/0fa89d74-e5c4-461c-adcc-6c29ce9ad8db HTTP/1.1 Oct 04 18:36:19.943180 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:36:19.943180 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:36:19.943180 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:36:19.943180 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:36:19.943180 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:36:19.943180 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:36:19.943180 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:36:19.943180 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:36:19.943180 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPHwUQIR1TKCa6SuO5KxFm7-u_FizcG48Uot0gdIOuCeSh8CFWYcfwzYNxmsP1Ox8pbA_3AaF7FzwotmrVSCbO7eABAZII6tUmaEh-Y24i0KlqIupFERqEnu-z8kdpdoodlufKA0ebuuWvnLVx428den86l5yxh9C2_Lvb9bKR3dLeNk Oct 04 18:36:19.943180 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:36:19.943180 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:36:19.943180 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:36:19.943180 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:36:19.943180 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:36:19.943180 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:36:19.943180 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 08c83d7b68684daf8e67ba2361ad86c9 Oct 04 18:36:19.943180 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ImagesTestJSON-1467584864 Oct 04 18:36:19.943180 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:36:19.943180 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:36:19.943180 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/08c83d7b68684daf8e67ba2361ad86c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_08c83d7b68684daf8e67ba2361ad86c9", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/08c83d7b68684daf8e67ba2361ad86c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/08c83d7b68684daf8e67ba2361ad86c9"}]}] Oct 04 18:36:19.943180 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ImagesTestJSON-1467584864 Oct 04 18:36:19.943180 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 08c83d7b68684daf8e67ba2361ad86c9 Oct 04 18:36:19.943180 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ImagesTestJSON-1467584864 Oct 04 18:36:19.943180 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ImagesTestJSON-1467584864-project Oct 04 18:36:19.943180 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:36:19.943180 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:36:19.943180 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: ef3c7ad35a05450496b6d1ff64f12b77 Oct 04 18:36:19.943180 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ImagesTestJSON-1467584864-project Oct 04 18:36:19.943180 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:36:19.943180 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 0fa89d74-e5c4-461c-adcc-6c29ce9ad8db could not be found. Oct 04 18:36:19.943180 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '0fa89d74-e5c4-461c-adcc-6c29ce9ad8db'} Oct 04 18:36:19.943180 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:36:19.943180 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:19.943180 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:36:19.943180 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:36:19.943180 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:36:19.943180 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:36:19.943180 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:36:19.943180 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:36:19.943180 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:36:19.943180 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:36:19.943180 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fa89d74-e5c4-461c-adcc-6c29ce9ad8db could not be found. Oct 04 18:36:19.943180 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:36:19.943180 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:19.943180 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:36:19.943180 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:19.943180 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:19.943180 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:19.943180 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:36:19.943180 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:36:19.943180 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:36:19.943180 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:36:19.943180 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:36:19.943180 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:36:19.943180 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:36:19.943180 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:36:19.943180 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:36:19.943180 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:36:19.943180 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fa89d74-e5c4-461c-adcc-6c29ce9ad8db could not be found. Oct 04 18:36:19.943180 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:36:19.943180 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:19.943180 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:36:19.943180 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:19.953788 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:19.953788 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:19.953788 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:36:19.953788 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:36:19.953788 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fa89d74-e5c4-461c-adcc-6c29ce9ad8db could not be found. Oct 04 18:36:19.953788 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:36:19.953788 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1ff3d590-fd67-4740-8127-3455ef0e9625 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Returning 404 to user: Instance 0fa89d74-e5c4-461c-adcc-6c29ce9ad8db could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:36:19.953788 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1ff3d590-fd67-4740-8127-3455ef0e9625 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/0fa89d74-e5c4-461c-adcc-6c29ce9ad8db" status: 404 len: 111 microversion: 2.1 time: 0.048216 Oct 04 18:36:19.955011 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1127/2147] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:19 2022] GET /compute/v2.1/servers/0fa89d74-e5c4-461c-adcc-6c29ce9ad8db => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:36:19.961064 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6d6cf2c1-4bee-4a4b-a205-7193c45effb8 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '.version_select at 0x7fe2597518b0>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:19.989970 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-6d6cf2c1-4bee-4a4b-a205-7193c45effb8 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] HTTP exception thrown: Image not found. Oct 04 18:36:19.992958 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6d6cf2c1-4bee-4a4b-a205-7193c45effb8 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Request method failure captured: Oct 04 18:36:19.992958 n-d-850501-14 devstack@n-api.service[123002]: request: DELETE /compute/v2.1/images/ea702f85-8e85-400a-a6e3-61ce78efff2c HTTP/1.1 Oct 04 18:36:19.992958 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:36:19.992958 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:36:19.992958 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:36:19.992958 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:36:19.992958 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:36:19.992958 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:36:19.992958 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:36:19.992958 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:36:19.992958 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPHwUQIR1TKCa6SuO5KxFm7-u_FizcG48Uot0gdIOuCeSh8CFWYcfwzYNxmsP1Ox8pbA_3AaF7FzwotmrVSCbO7eABAZII6tUmaEh-Y24i0KlqIupFERqEnu-z8kdpdoodlufKA0ebuuWvnLVx428den86l5yxh9C2_Lvb9bKR3dLeNk Oct 04 18:36:19.992958 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:36:19.992958 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:36:19.992958 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:36:19.992958 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:36:19.992958 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:36:19.992958 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:36:19.992958 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 08c83d7b68684daf8e67ba2361ad86c9 Oct 04 18:36:19.992958 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ImagesTestJSON-1467584864 Oct 04 18:36:19.992958 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:36:19.992958 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:36:19.992958 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/08c83d7b68684daf8e67ba2361ad86c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_08c83d7b68684daf8e67ba2361ad86c9", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/08c83d7b68684daf8e67ba2361ad86c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/08c83d7b68684daf8e67ba2361ad86c9"}]}] Oct 04 18:36:19.992958 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ImagesTestJSON-1467584864 Oct 04 18:36:19.992958 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 08c83d7b68684daf8e67ba2361ad86c9 Oct 04 18:36:19.992958 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ImagesTestJSON-1467584864 Oct 04 18:36:19.992958 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ImagesTestJSON-1467584864-project Oct 04 18:36:19.992958 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:36:19.992958 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:36:19.992958 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: ef3c7ad35a05450496b6d1ff64f12b77 Oct 04 18:36:19.992958 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ImagesTestJSON-1467584864-project Oct 04 18:36:19.992958 n-d-850501-14 devstack@n-api.service[123002]: method: Oct 04 18:36:19.992958 n-d-850501-14 devstack@n-api.service[123002]: exception: Image not found. Oct 04 18:36:19.992958 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'ea702f85-8e85-400a-a6e3-61ce78efff2c'} Oct 04 18:36:19.992958 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:36:19.992958 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:19.992958 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 18:36:19.992958 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 18:36:19.992958 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:36:19.992958 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:36:19.992958 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:36:19.992958 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:36:19.992958 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 18:36:19.992958 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 18:36:19.992958 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 18:36:19.992958 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 18:36:19.992958 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:36:19.992958 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:36:19.992958 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:36:19.992958 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:36:19.992958 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image ea702f85-8e85-400a-a6e3-61ce78efff2c to delete Oct 04 18:36:19.992958 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:36:19.992958 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:19.992958 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:36:19.992958 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:19.992958 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 18:36:19.992958 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 18:36:19.992958 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 18:36:19.992958 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 18:36:19.992958 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 18:36:19.992958 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 18:36:19.992958 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ea702f85-8e85-400a-a6e3-61ce78efff2c could not be found. Oct 04 18:36:19.992958 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:36:19.992958 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:19.992958 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:36:19.992958 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:20.000954 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:20.000954 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:20.000954 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:36:20.000954 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:36:20.000954 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:36:20.000954 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:36:20.000954 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:36:20.000954 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:36:20.000954 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 18:36:20.000954 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 18:36:20.000954 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:36:20.000954 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:36:20.000954 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:20.000954 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:36:20.000954 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:20.000954 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:20.000954 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:20.000954 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:36:20.000954 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:36:20.000954 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:36:20.000954 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:36:20.006112 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6d6cf2c1-4bee-4a4b-a205-7193c45effb8 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Returning 404 to user: Image not found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:36:20.009592 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6d6cf2c1-4bee-4a4b-a205-7193c45effb8 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "DELETE /compute/v2.1/images/ea702f85-8e85-400a-a6e3-61ce78efff2c" status: 404 len: 62 microversion: 2.1 time: 0.050028 Oct 04 18:36:20.018453 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1128/2148] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:19 2022] DELETE /compute/v2.1/images/ea702f85-8e85-400a-a6e3-61ce78efff2c => generated 62 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:36:20.028941 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c6cc9ca1-c240-46aa-ac7d-34d0afca9b9c tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:20.035252 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c6cc9ca1-c240-46aa-ac7d-34d0afca9b9c tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: c8c84d9e-2274-49dd-99e9-cbd7222c22d5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:20.050952 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c6cc9ca1-c240-46aa-ac7d-34d0afca9b9c tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:20.051437 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c6cc9ca1-c240-46aa-ac7d-34d0afca9b9c tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:20.055568 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c6cc9ca1-c240-46aa-ac7d-34d0afca9b9c tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:20.058993 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c6cc9ca1-c240-46aa-ac7d-34d0afca9b9c tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:20.059489 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c6cc9ca1-c240-46aa-ac7d-34d0afca9b9c tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:20.061529 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c6cc9ca1-c240-46aa-ac7d-34d0afca9b9c tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:20.072659 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=100 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:20.168196 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-c6cc9ca1-c240-46aa-ac7d-34d0afca9b9c tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] HTTP exception thrown: Instance c8c84d9e-2274-49dd-99e9-cbd7222c22d5 could not be found. Oct 04 18:36:20.174243 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c6cc9ca1-c240-46aa-ac7d-34d0afca9b9c tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Request method failure captured: Oct 04 18:36:20.174243 n-d-850501-14 devstack@n-api.service[123002]: request: DELETE /compute/v2.1/servers/c8c84d9e-2274-49dd-99e9-cbd7222c22d5 HTTP/1.1 Oct 04 18:36:20.174243 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:36:20.174243 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:36:20.174243 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:36:20.174243 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:36:20.174243 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:36:20.174243 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:36:20.174243 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:36:20.174243 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:36:20.174243 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPHwUQIR1TKCa6SuO5KxFm7-u_FizcG48Uot0gdIOuCeSh8CFWYcfwzYNxmsP1Ox8pbA_3AaF7FzwotmrVSCbO7eABAZII6tUmaEh-Y24i0KlqIupFERqEnu-z8kdpdoodlufKA0ebuuWvnLVx428den86l5yxh9C2_Lvb9bKR3dLeNk Oct 04 18:36:20.174243 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:36:20.174243 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:36:20.174243 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:36:20.174243 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:36:20.174243 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:36:20.174243 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:36:20.174243 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 08c83d7b68684daf8e67ba2361ad86c9 Oct 04 18:36:20.174243 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ImagesTestJSON-1467584864 Oct 04 18:36:20.174243 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:36:20.174243 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:36:20.174243 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/08c83d7b68684daf8e67ba2361ad86c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_08c83d7b68684daf8e67ba2361ad86c9", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/08c83d7b68684daf8e67ba2361ad86c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/08c83d7b68684daf8e67ba2361ad86c9"}]}] Oct 04 18:36:20.174243 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ImagesTestJSON-1467584864 Oct 04 18:36:20.174243 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 08c83d7b68684daf8e67ba2361ad86c9 Oct 04 18:36:20.174243 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ImagesTestJSON-1467584864 Oct 04 18:36:20.174243 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ImagesTestJSON-1467584864-project Oct 04 18:36:20.174243 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:36:20.174243 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:36:20.174243 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: ef3c7ad35a05450496b6d1ff64f12b77 Oct 04 18:36:20.174243 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ImagesTestJSON-1467584864-project Oct 04 18:36:20.174243 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:36:20.174243 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance c8c84d9e-2274-49dd-99e9-cbd7222c22d5 could not be found. Oct 04 18:36:20.174243 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'c8c84d9e-2274-49dd-99e9-cbd7222c22d5'} Oct 04 18:36:20.174243 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:36:20.174243 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:20.174243 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:36:20.174243 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:36:20.174243 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:36:20.174243 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:36:20.174243 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:36:20.174243 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:36:20.174243 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:36:20.174243 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:36:20.174243 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8c84d9e-2274-49dd-99e9-cbd7222c22d5 could not be found. Oct 04 18:36:20.174243 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:36:20.174243 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:20.174243 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:36:20.174243 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:20.174243 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:20.174243 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:20.174243 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:36:20.174243 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:36:20.174243 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:36:20.174243 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:36:20.174243 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:36:20.174243 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:36:20.174243 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:36:20.174243 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:36:20.174243 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:36:20.174243 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:36:20.174243 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:36:20.174243 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:36:20.174243 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8c84d9e-2274-49dd-99e9-cbd7222c22d5 could not be found. Oct 04 18:36:20.178974 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:36:20.178974 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:20.178974 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:36:20.178974 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:20.178974 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:20.178974 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:20.178974 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:36:20.178974 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:36:20.178974 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8c84d9e-2274-49dd-99e9-cbd7222c22d5 could not be found. Oct 04 18:36:20.178974 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:36:20.178974 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c6cc9ca1-c240-46aa-ac7d-34d0afca9b9c tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Returning 404 to user: Instance c8c84d9e-2274-49dd-99e9-cbd7222c22d5 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:36:20.179782 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c6cc9ca1-c240-46aa-ac7d-34d0afca9b9c tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c8c84d9e-2274-49dd-99e9-cbd7222c22d5" status: 404 len: 111 microversion: 2.1 time: 0.157943 Oct 04 18:36:20.183439 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1129/2149] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:36:20 2022] DELETE /compute/v2.1/servers/c8c84d9e-2274-49dd-99e9-cbd7222c22d5 => generated 111 bytes in 161 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:36:20.197299 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c866c335-6727-47f4-9157-291788d082da tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:20.212118 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c866c335-6727-47f4-9157-291788d082da tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] [instance: adc33804-eb64-40ca-a943-f2e74040c1b2] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:20.225471 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c866c335-6727-47f4-9157-291788d082da tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:20.238146 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c866c335-6727-47f4-9157-291788d082da tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:20.238782 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c866c335-6727-47f4-9157-291788d082da tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:20.240877 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c866c335-6727-47f4-9157-291788d082da tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:20.240877 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c866c335-6727-47f4-9157-291788d082da tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:20.240877 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c866c335-6727-47f4-9157-291788d082da tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:20.825414 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c866c335-6727-47f4-9157-291788d082da tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81e50834114f0fa3cca4b0b9f8acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4650d613cb84018b92dc5d51486885e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:20.847961 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c866c335-6727-47f4-9157-291788d082da tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] 10.222.0.20 "GET /compute/v2.1/servers/adc33804-eb64-40ca-a943-f2e74040c1b2" status: 200 len: 1477 microversion: 2.1 time: 0.658317 Oct 04 18:36:20.867049 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1130/2150] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:20 2022] GET /compute/v2.1/servers/adc33804-eb64-40ca-a943-f2e74040c1b2 => generated 1477 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:20.873240 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-377defe6-2137-4f17-ac64-6b86a71fe570 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:20.874090 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-377defe6-2137-4f17-ac64-6b86a71fe570 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: c8c84d9e-2274-49dd-99e9-cbd7222c22d5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:20.886042 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-377defe6-2137-4f17-ac64-6b86a71fe570 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:20.888289 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-377defe6-2137-4f17-ac64-6b86a71fe570 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:20.888289 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-377defe6-2137-4f17-ac64-6b86a71fe570 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:20.888851 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-377defe6-2137-4f17-ac64-6b86a71fe570 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:20.889508 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-377defe6-2137-4f17-ac64-6b86a71fe570 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:20.890092 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-377defe6-2137-4f17-ac64-6b86a71fe570 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:20.917822 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-377defe6-2137-4f17-ac64-6b86a71fe570 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] HTTP exception thrown: Instance c8c84d9e-2274-49dd-99e9-cbd7222c22d5 could not be found. Oct 04 18:36:20.919810 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-377defe6-2137-4f17-ac64-6b86a71fe570 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Request method failure captured: Oct 04 18:36:20.919810 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/c8c84d9e-2274-49dd-99e9-cbd7222c22d5 HTTP/1.1 Oct 04 18:36:20.919810 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:36:20.919810 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:36:20.919810 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:36:20.919810 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:36:20.919810 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:36:20.919810 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:36:20.919810 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:36:20.919810 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:36:20.919810 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPHwUQIR1TKCa6SuO5KxFm7-u_FizcG48Uot0gdIOuCeSh8CFWYcfwzYNxmsP1Ox8pbA_3AaF7FzwotmrVSCbO7eABAZII6tUmaEh-Y24i0KlqIupFERqEnu-z8kdpdoodlufKA0ebuuWvnLVx428den86l5yxh9C2_Lvb9bKR3dLeNk Oct 04 18:36:20.919810 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:36:20.919810 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:36:20.919810 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:36:20.919810 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:36:20.919810 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:36:20.919810 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:36:20.919810 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 08c83d7b68684daf8e67ba2361ad86c9 Oct 04 18:36:20.919810 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ImagesTestJSON-1467584864 Oct 04 18:36:20.919810 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:36:20.919810 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:36:20.919810 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/08c83d7b68684daf8e67ba2361ad86c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_08c83d7b68684daf8e67ba2361ad86c9", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/08c83d7b68684daf8e67ba2361ad86c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/08c83d7b68684daf8e67ba2361ad86c9"}]}] Oct 04 18:36:20.919810 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ImagesTestJSON-1467584864 Oct 04 18:36:20.919810 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 08c83d7b68684daf8e67ba2361ad86c9 Oct 04 18:36:20.919810 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ImagesTestJSON-1467584864 Oct 04 18:36:20.919810 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ImagesTestJSON-1467584864-project Oct 04 18:36:20.919810 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:36:20.919810 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:36:20.919810 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: ef3c7ad35a05450496b6d1ff64f12b77 Oct 04 18:36:20.919810 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ImagesTestJSON-1467584864-project Oct 04 18:36:20.919810 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:36:20.919810 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance c8c84d9e-2274-49dd-99e9-cbd7222c22d5 could not be found. Oct 04 18:36:20.919810 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'c8c84d9e-2274-49dd-99e9-cbd7222c22d5'} Oct 04 18:36:20.919810 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:36:20.919810 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:20.919810 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:36:20.919810 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:36:20.919810 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:36:20.919810 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:36:20.919810 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:36:20.919810 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:36:20.919810 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:36:20.919810 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:36:20.919810 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8c84d9e-2274-49dd-99e9-cbd7222c22d5 could not be found. Oct 04 18:36:20.919810 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:36:20.919810 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:20.919810 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:36:20.919810 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:20.919810 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:20.919810 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:20.919810 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:36:20.919810 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:36:20.919810 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:36:20.919810 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:36:20.919810 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:36:20.919810 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:36:20.919810 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:36:20.919810 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:36:20.919810 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:36:20.919810 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:36:20.919810 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8c84d9e-2274-49dd-99e9-cbd7222c22d5 could not be found. Oct 04 18:36:20.919810 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:36:20.919810 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:20.919810 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:36:20.919810 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:20.925374 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:20.925374 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:20.925374 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:36:20.925374 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:36:20.925374 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8c84d9e-2274-49dd-99e9-cbd7222c22d5 could not be found. Oct 04 18:36:20.925374 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:36:20.925374 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-377defe6-2137-4f17-ac64-6b86a71fe570 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Returning 404 to user: Instance c8c84d9e-2274-49dd-99e9-cbd7222c22d5 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:36:20.925374 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-377defe6-2137-4f17-ac64-6b86a71fe570 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/c8c84d9e-2274-49dd-99e9-cbd7222c22d5" status: 404 len: 111 microversion: 2.1 time: 0.054523 Oct 04 18:36:20.925374 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1131/2151] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:20 2022] GET /compute/v2.1/servers/c8c84d9e-2274-49dd-99e9-cbd7222c22d5 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:36:20.933362 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-69da5474-3f84-4eb4-9013-eca4a4e1218f tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:20.939770 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-69da5474-3f84-4eb4-9013-eca4a4e1218f tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] [instance: 4fbde026-7d69-4924-97e6-28262d00e5db] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:20.943085 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-69da5474-3f84-4eb4-9013-eca4a4e1218f tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:20.943633 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-69da5474-3f84-4eb4-9013-eca4a4e1218f tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:20.944087 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-69da5474-3f84-4eb4-9013-eca4a4e1218f tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:20.945150 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-69da5474-3f84-4eb4-9013-eca4a4e1218f tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:20.945617 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-69da5474-3f84-4eb4-9013-eca4a4e1218f tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:20.946233 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-69da5474-3f84-4eb4-9013-eca4a4e1218f tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:20.954994 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d8469264-b6ef-4d0f-ba64-fff1f4a24b25 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:20.963527 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-69da5474-3f84-4eb4-9013-eca4a4e1218f tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] HTTP exception thrown: Instance 4fbde026-7d69-4924-97e6-28262d00e5db could not be found. Oct 04 18:36:20.965101 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-69da5474-3f84-4eb4-9013-eca4a4e1218f tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Request method failure captured: Oct 04 18:36:20.965101 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/4fbde026-7d69-4924-97e6-28262d00e5db HTTP/1.1 Oct 04 18:36:20.965101 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:36:20.965101 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:36:20.965101 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:36:20.965101 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:36:20.965101 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:36:20.965101 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:36:20.965101 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:36:20.965101 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:36:20.965101 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPHzalpqmsewN2J61v1Y0qLDtlN2FHUi2_nWyZ1Q-vjMt_4gSQz5L13cLBjtmLCrnLRTB9GqNa_-hKs10nMk9Qvuv6OZyurGD386ZLOA5t161yDtVaKb0xp2inIdlbDXLtIUVom-9v7H_1WP8Q90_876Lqq25zfLlqGgtW_IuOJz1qAY Oct 04 18:36:20.965101 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:36:20.965101 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:36:20.965101 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:36:20.965101 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:36:20.965101 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:36:20.965101 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:36:20.965101 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: c3242afeef424d588cf102a2f0f38020 Oct 04 18:36:20.965101 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServersTestMultiNic-1495387740 Oct 04 18:36:20.965101 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:36:20.965101 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:36:20.965101 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c3242afeef424d588cf102a2f0f38020"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c3242afeef424d588cf102a2f0f38020", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c3242afeef424d588cf102a2f0f38020"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c3242afeef424d588cf102a2f0f38020"}]}] Oct 04 18:36:20.965101 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServersTestMultiNic-1495387740 Oct 04 18:36:20.965101 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: c3242afeef424d588cf102a2f0f38020 Oct 04 18:36:20.965101 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServersTestMultiNic-1495387740 Oct 04 18:36:20.965101 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServersTestMultiNic-1495387740-project Oct 04 18:36:20.965101 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:36:20.965101 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:36:20.965101 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: acb44381220d43b7bdfa744a1dc410a8 Oct 04 18:36:20.965101 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServersTestMultiNic-1495387740-project Oct 04 18:36:20.965101 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:36:20.965101 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 4fbde026-7d69-4924-97e6-28262d00e5db could not be found. Oct 04 18:36:20.965101 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '4fbde026-7d69-4924-97e6-28262d00e5db'} Oct 04 18:36:20.965101 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:36:20.965101 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:20.965101 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:36:20.965101 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:36:20.965101 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:36:20.965101 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:36:20.965101 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:36:20.965101 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:36:20.965101 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:36:20.965101 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:36:20.965101 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fbde026-7d69-4924-97e6-28262d00e5db could not be found. Oct 04 18:36:20.965101 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:36:20.965101 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:20.965101 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:36:20.965101 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:20.965101 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:20.965101 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:20.965101 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:36:20.965101 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:36:20.965101 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:36:20.965101 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:36:20.965101 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:36:20.965101 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:36:20.965101 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:36:20.965101 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:36:20.965101 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:36:20.965101 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:36:20.965101 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fbde026-7d69-4924-97e6-28262d00e5db could not be found. Oct 04 18:36:20.965101 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:36:20.965101 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:20.965101 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:36:20.974320 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:20.974320 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:20.974320 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:20.974320 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:36:20.974320 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:36:20.974320 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fbde026-7d69-4924-97e6-28262d00e5db could not be found. Oct 04 18:36:20.974320 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:36:20.974320 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-69da5474-3f84-4eb4-9013-eca4a4e1218f tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Returning 404 to user: Instance 4fbde026-7d69-4924-97e6-28262d00e5db could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:36:20.974320 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-69da5474-3f84-4eb4-9013-eca4a4e1218f tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] 10.222.0.20 "GET /compute/v2.1/servers/4fbde026-7d69-4924-97e6-28262d00e5db" status: 404 len: 111 microversion: 2.1 time: 0.041715 Oct 04 18:36:20.975216 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d8469264-b6ef-4d0f-ba64-fff1f4a24b25 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035" status: 200 len: 1470 microversion: 2.1 time: 1.119177 Oct 04 18:36:20.975322 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1132/2152] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:20 2022] GET /compute/v2.1/servers/4fbde026-7d69-4924-97e6-28262d00e5db => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:36:20.975420 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1021/2153] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:19 2022] GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035 => generated 1470 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:20.979460 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-11a843d7-b17e-4495-9435-8727af1c71dc tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:20.980314 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-11a843d7-b17e-4495-9435-8727af1c71dc tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: cd74aff9-f694-49f3-a1cc-2095b71cd9e5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:20.988892 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-11a843d7-b17e-4495-9435-8727af1c71dc tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:20.989314 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-11a843d7-b17e-4495-9435-8727af1c71dc tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:20.989753 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-11a843d7-b17e-4495-9435-8727af1c71dc tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:20.990456 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-11a843d7-b17e-4495-9435-8727af1c71dc tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:20.991094 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-11a843d7-b17e-4495-9435-8727af1c71dc tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:20.991696 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-11a843d7-b17e-4495-9435-8727af1c71dc tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:20.996401 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-0b5ae147-7bab-4125-900b-e35ea56bb586 req-95358a44-bc4f-4710-986e-266d44ec1c84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adc33804-eb64-40ca-a943-f2e74040c1b2", "name": "network-vif-deleted", "tag": "ff04ab26-1f82-497a-9628-266b9352d2a5"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:21.015764 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-0b5ae147-7bab-4125-900b-e35ea56bb586 req-95358a44-bc4f-4710-986e-266d44ec1c84 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:21.016564 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-0b5ae147-7bab-4125-900b-e35ea56bb586 req-95358a44-bc4f-4710-986e-266d44ec1c84 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:21.016948 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-0b5ae147-7bab-4125-900b-e35ea56bb586 req-95358a44-bc4f-4710-986e-266d44ec1c84 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:21.042348 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-0b5ae147-7bab-4125-900b-e35ea56bb586 req-95358a44-bc4f-4710-986e-266d44ec1c84 service nova] Creating event network-vif-deleted:ff04ab26-1f82-497a-9628-266b9352d2a5 for instance adc33804-eb64-40ca-a943-f2e74040c1b2 on n-h2-850501-14 Oct 04 18:36:21.049962 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-0b5ae147-7bab-4125-900b-e35ea56bb586 req-95358a44-bc4f-4710-986e-266d44ec1c84 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080585 Oct 04 18:36:21.051299 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1022/2154] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:36:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:36:21.058641 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5434f195-7b72-48b9-b697-db22bb48e845 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '.version_select at 0x7fe25914d280>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:21.095395 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-5434f195-7b72-48b9-b697-db22bb48e845 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] HTTP exception thrown: Image not found. Oct 04 18:36:21.098823 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5434f195-7b72-48b9-b697-db22bb48e845 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Request method failure captured: Oct 04 18:36:21.098823 n-d-850501-14 devstack@n-api.service[123001]: request: DELETE /compute/v2.1/images/cabaf7e6-9081-4a33-8415-4c717517ad62 HTTP/1.1 Oct 04 18:36:21.098823 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:36:21.098823 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:36:21.098823 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:36:21.098823 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:36:21.098823 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:36:21.098823 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:36:21.098823 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:36:21.098823 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:36:21.098823 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPHwUQIR1TKCa6SuO5KxFm7-u_FizcG48Uot0gdIOuCeSh8CFWYcfwzYNxmsP1Ox8pbA_3AaF7FzwotmrVSCbO7eABAZII6tUmaEh-Y24i0KlqIupFERqEnu-z8kdpdoodlufKA0ebuuWvnLVx428den86l5yxh9C2_Lvb9bKR3dLeNk Oct 04 18:36:21.098823 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:36:21.098823 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:36:21.098823 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:36:21.098823 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:36:21.098823 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:36:21.098823 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:36:21.098823 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 08c83d7b68684daf8e67ba2361ad86c9 Oct 04 18:36:21.098823 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ImagesTestJSON-1467584864 Oct 04 18:36:21.098823 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:36:21.098823 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:36:21.098823 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/08c83d7b68684daf8e67ba2361ad86c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_08c83d7b68684daf8e67ba2361ad86c9", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/08c83d7b68684daf8e67ba2361ad86c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/08c83d7b68684daf8e67ba2361ad86c9"}]}] Oct 04 18:36:21.098823 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ImagesTestJSON-1467584864 Oct 04 18:36:21.098823 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 08c83d7b68684daf8e67ba2361ad86c9 Oct 04 18:36:21.098823 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ImagesTestJSON-1467584864 Oct 04 18:36:21.098823 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ImagesTestJSON-1467584864-project Oct 04 18:36:21.098823 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:36:21.098823 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:36:21.098823 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: ef3c7ad35a05450496b6d1ff64f12b77 Oct 04 18:36:21.098823 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ImagesTestJSON-1467584864-project Oct 04 18:36:21.098823 n-d-850501-14 devstack@n-api.service[123001]: method: Oct 04 18:36:21.098823 n-d-850501-14 devstack@n-api.service[123001]: exception: Image not found. Oct 04 18:36:21.098823 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': 'cabaf7e6-9081-4a33-8415-4c717517ad62'} Oct 04 18:36:21.098823 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:36:21.098823 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:21.098823 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 18:36:21.098823 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 18:36:21.098823 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:36:21.098823 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:36:21.098823 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:36:21.098823 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:36:21.098823 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 18:36:21.098823 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 18:36:21.098823 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 18:36:21.098823 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 18:36:21.098823 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:36:21.098823 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:36:21.098823 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:36:21.098823 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:36:21.098823 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image cabaf7e6-9081-4a33-8415-4c717517ad62 to delete Oct 04 18:36:21.098823 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:36:21.098823 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:21.098823 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:36:21.098823 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:21.098823 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 18:36:21.098823 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 18:36:21.098823 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 18:36:21.098823 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 18:36:21.098823 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 18:36:21.098823 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 18:36:21.098823 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image cabaf7e6-9081-4a33-8415-4c717517ad62 could not be found. Oct 04 18:36:21.098823 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:36:21.098823 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:21.098823 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:36:21.098823 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:21.105830 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:21.105830 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:21.105830 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:36:21.105830 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:36:21.105830 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:36:21.105830 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:36:21.105830 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:36:21.105830 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:36:21.105830 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 18:36:21.105830 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 18:36:21.105830 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:36:21.105830 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:36:21.105830 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:21.105830 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:36:21.105830 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:21.105830 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:21.105830 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:21.105830 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:36:21.105830 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:36:21.105830 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:36:21.105830 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:36:21.105830 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5434f195-7b72-48b9-b697-db22bb48e845 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Returning 404 to user: Image not found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:36:21.105830 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5434f195-7b72-48b9-b697-db22bb48e845 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "DELETE /compute/v2.1/images/cabaf7e6-9081-4a33-8415-4c717517ad62" status: 404 len: 62 microversion: 2.1 time: 0.051025 Oct 04 18:36:21.105830 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1023/2155] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:21 2022] DELETE /compute/v2.1/images/cabaf7e6-9081-4a33-8415-4c717517ad62 => generated 62 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:36:21.116288 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c4d9064c-f560-4f55-a41b-09cb9864290c tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:21.120995 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c4d9064c-f560-4f55-a41b-09cb9864290c tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: 0cd68f0f-4385-45c4-8dd0-8f33a5a9e527] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:21.139921 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c4d9064c-f560-4f55-a41b-09cb9864290c tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:21.141581 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c4d9064c-f560-4f55-a41b-09cb9864290c tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:21.142229 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c4d9064c-f560-4f55-a41b-09cb9864290c tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:21.143129 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c4d9064c-f560-4f55-a41b-09cb9864290c tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:21.143761 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c4d9064c-f560-4f55-a41b-09cb9864290c tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:21.144605 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c4d9064c-f560-4f55-a41b-09cb9864290c tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:21.164273 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-c4d9064c-f560-4f55-a41b-09cb9864290c tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] HTTP exception thrown: Instance 0cd68f0f-4385-45c4-8dd0-8f33a5a9e527 could not be found. Oct 04 18:36:21.166120 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c4d9064c-f560-4f55-a41b-09cb9864290c tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Request method failure captured: Oct 04 18:36:21.166120 n-d-850501-14 devstack@n-api.service[123001]: request: DELETE /compute/v2.1/servers/0cd68f0f-4385-45c4-8dd0-8f33a5a9e527 HTTP/1.1 Oct 04 18:36:21.166120 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:36:21.166120 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:36:21.166120 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:36:21.166120 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:36:21.166120 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:36:21.166120 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:36:21.166120 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:36:21.166120 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:36:21.166120 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPHwUQIR1TKCa6SuO5KxFm7-u_FizcG48Uot0gdIOuCeSh8CFWYcfwzYNxmsP1Ox8pbA_3AaF7FzwotmrVSCbO7eABAZII6tUmaEh-Y24i0KlqIupFERqEnu-z8kdpdoodlufKA0ebuuWvnLVx428den86l5yxh9C2_Lvb9bKR3dLeNk Oct 04 18:36:21.166120 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:36:21.166120 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:36:21.166120 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:36:21.166120 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:36:21.166120 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:36:21.166120 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:36:21.166120 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 08c83d7b68684daf8e67ba2361ad86c9 Oct 04 18:36:21.166120 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ImagesTestJSON-1467584864 Oct 04 18:36:21.166120 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:36:21.166120 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:36:21.166120 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/08c83d7b68684daf8e67ba2361ad86c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_08c83d7b68684daf8e67ba2361ad86c9", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/08c83d7b68684daf8e67ba2361ad86c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/08c83d7b68684daf8e67ba2361ad86c9"}]}] Oct 04 18:36:21.166120 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ImagesTestJSON-1467584864 Oct 04 18:36:21.166120 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 08c83d7b68684daf8e67ba2361ad86c9 Oct 04 18:36:21.166120 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ImagesTestJSON-1467584864 Oct 04 18:36:21.166120 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ImagesTestJSON-1467584864-project Oct 04 18:36:21.166120 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:36:21.166120 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:36:21.166120 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: ef3c7ad35a05450496b6d1ff64f12b77 Oct 04 18:36:21.166120 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ImagesTestJSON-1467584864-project Oct 04 18:36:21.166120 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:36:21.166120 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 0cd68f0f-4385-45c4-8dd0-8f33a5a9e527 could not be found. Oct 04 18:36:21.166120 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '0cd68f0f-4385-45c4-8dd0-8f33a5a9e527'} Oct 04 18:36:21.166120 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:36:21.166120 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:21.166120 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:36:21.166120 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:36:21.166120 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:36:21.166120 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:36:21.166120 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:36:21.166120 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:36:21.166120 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:36:21.166120 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:36:21.166120 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cd68f0f-4385-45c4-8dd0-8f33a5a9e527 could not be found. Oct 04 18:36:21.166120 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:36:21.166120 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:21.166120 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:36:21.166120 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:21.166120 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:21.166120 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:21.166120 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:36:21.166120 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:36:21.166120 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:36:21.166120 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:36:21.166120 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:36:21.166120 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:36:21.166120 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:36:21.166120 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:36:21.166120 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:36:21.166120 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:36:21.166120 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:36:21.166120 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:36:21.166120 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cd68f0f-4385-45c4-8dd0-8f33a5a9e527 could not be found. Oct 04 18:36:21.171038 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:36:21.171038 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:21.171038 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:36:21.171038 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:21.171038 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:21.171038 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:21.171038 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:36:21.171038 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:36:21.171038 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cd68f0f-4385-45c4-8dd0-8f33a5a9e527 could not be found. Oct 04 18:36:21.171038 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:36:21.176517 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c4d9064c-f560-4f55-a41b-09cb9864290c tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Returning 404 to user: Instance 0cd68f0f-4385-45c4-8dd0-8f33a5a9e527 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:36:21.177449 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c4d9064c-f560-4f55-a41b-09cb9864290c tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0cd68f0f-4385-45c4-8dd0-8f33a5a9e527" status: 404 len: 111 microversion: 2.1 time: 0.065572 Oct 04 18:36:21.178031 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1024/2156] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:36:21 2022] DELETE /compute/v2.1/servers/0cd68f0f-4385-45c4-8dd0-8f33a5a9e527 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:36:21.195613 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b3c129e0-07f2-4d07-82dc-7067f5e1d5e2 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:21.196288 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b3c129e0-07f2-4d07-82dc-7067f5e1d5e2 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] [instance: 0cd68f0f-4385-45c4-8dd0-8f33a5a9e527] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:21.203390 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b3c129e0-07f2-4d07-82dc-7067f5e1d5e2 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:21.204289 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b3c129e0-07f2-4d07-82dc-7067f5e1d5e2 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:21.204954 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b3c129e0-07f2-4d07-82dc-7067f5e1d5e2 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:21.205883 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b3c129e0-07f2-4d07-82dc-7067f5e1d5e2 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:21.206518 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b3c129e0-07f2-4d07-82dc-7067f5e1d5e2 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:21.207120 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b3c129e0-07f2-4d07-82dc-7067f5e1d5e2 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:21.229552 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-11a843d7-b17e-4495-9435-8727af1c71dc tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:21.230154 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-b3c129e0-07f2-4d07-82dc-7067f5e1d5e2 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] HTTP exception thrown: Instance 0cd68f0f-4385-45c4-8dd0-8f33a5a9e527 could not be found. Oct 04 18:36:21.235419 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b3c129e0-07f2-4d07-82dc-7067f5e1d5e2 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Request method failure captured: Oct 04 18:36:21.235419 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/0cd68f0f-4385-45c4-8dd0-8f33a5a9e527 HTTP/1.1 Oct 04 18:36:21.235419 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:36:21.235419 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:36:21.235419 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:36:21.235419 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:36:21.235419 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:36:21.235419 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:36:21.235419 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:36:21.235419 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:36:21.235419 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPHwUQIR1TKCa6SuO5KxFm7-u_FizcG48Uot0gdIOuCeSh8CFWYcfwzYNxmsP1Ox8pbA_3AaF7FzwotmrVSCbO7eABAZII6tUmaEh-Y24i0KlqIupFERqEnu-z8kdpdoodlufKA0ebuuWvnLVx428den86l5yxh9C2_Lvb9bKR3dLeNk Oct 04 18:36:21.235419 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:36:21.235419 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:36:21.235419 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:36:21.235419 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:36:21.235419 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:36:21.235419 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:36:21.235419 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 08c83d7b68684daf8e67ba2361ad86c9 Oct 04 18:36:21.235419 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ImagesTestJSON-1467584864 Oct 04 18:36:21.235419 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:36:21.235419 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:36:21.235419 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/08c83d7b68684daf8e67ba2361ad86c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_08c83d7b68684daf8e67ba2361ad86c9", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/08c83d7b68684daf8e67ba2361ad86c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/08c83d7b68684daf8e67ba2361ad86c9"}]}] Oct 04 18:36:21.235419 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ImagesTestJSON-1467584864 Oct 04 18:36:21.235419 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 08c83d7b68684daf8e67ba2361ad86c9 Oct 04 18:36:21.235419 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ImagesTestJSON-1467584864 Oct 04 18:36:21.235419 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ImagesTestJSON-1467584864-project Oct 04 18:36:21.235419 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:36:21.235419 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:36:21.235419 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: ef3c7ad35a05450496b6d1ff64f12b77 Oct 04 18:36:21.235419 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ImagesTestJSON-1467584864-project Oct 04 18:36:21.235419 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:36:21.235419 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 0cd68f0f-4385-45c4-8dd0-8f33a5a9e527 could not be found. Oct 04 18:36:21.235419 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '0cd68f0f-4385-45c4-8dd0-8f33a5a9e527'} Oct 04 18:36:21.235419 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:36:21.235419 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:21.235419 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:36:21.235419 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:36:21.235419 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:36:21.235419 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:36:21.235419 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:36:21.235419 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:36:21.235419 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:36:21.235419 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:36:21.235419 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cd68f0f-4385-45c4-8dd0-8f33a5a9e527 could not be found. Oct 04 18:36:21.235419 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:36:21.235419 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:21.235419 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:36:21.235419 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:21.235419 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:21.235419 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:21.235419 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:36:21.235419 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:36:21.235419 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:36:21.235419 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:36:21.235419 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:36:21.235419 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:36:21.235419 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:36:21.235419 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:36:21.235419 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:36:21.235419 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:36:21.235419 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cd68f0f-4385-45c4-8dd0-8f33a5a9e527 could not be found. Oct 04 18:36:21.235419 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:36:21.235419 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:21.235419 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:36:21.235419 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:21.242118 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:21.242118 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:21.242118 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:36:21.242118 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:36:21.242118 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cd68f0f-4385-45c4-8dd0-8f33a5a9e527 could not be found. Oct 04 18:36:21.242118 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:36:21.242118 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b3c129e0-07f2-4d07-82dc-7067f5e1d5e2 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] Returning 404 to user: Instance 0cd68f0f-4385-45c4-8dd0-8f33a5a9e527 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:36:21.242118 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b3c129e0-07f2-4d07-82dc-7067f5e1d5e2 tempest-ImagesTestJSON-1467584864 tempest-ImagesTestJSON-1467584864-project] 10.222.0.20 "GET /compute/v2.1/servers/0cd68f0f-4385-45c4-8dd0-8f33a5a9e527" status: 404 len: 111 microversion: 2.1 time: 0.054262 Oct 04 18:36:21.243133 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1025/2157] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:21 2022] GET /compute/v2.1/servers/0cd68f0f-4385-45c4-8dd0-8f33a5a9e527 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:36:21.243257 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-11a843d7-b17e-4495-9435-8727af1c71dc tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:21.244442 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-11a843d7-b17e-4495-9435-8727af1c71dc tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:21.245729 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-11a843d7-b17e-4495-9435-8727af1c71dc tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5" status: 200 len: 1281 microversion: 2.25 time: 0.277824 Oct 04 18:36:21.276026 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1133/2158] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:20 2022] GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5 => generated 1281 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:36:21.876747 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e35c299c-95cc-4f32-b863-b6606a03a72c tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:21.877757 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e35c299c-95cc-4f32-b863-b6606a03a72c tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] [instance: adc33804-eb64-40ca-a943-f2e74040c1b2] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:21.885969 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=6 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:21.891809 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e35c299c-95cc-4f32-b863-b6606a03a72c tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:21.894418 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e35c299c-95cc-4f32-b863-b6606a03a72c tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:21.894988 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e35c299c-95cc-4f32-b863-b6606a03a72c tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:21.896936 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e35c299c-95cc-4f32-b863-b6606a03a72c tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:21.898210 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e35c299c-95cc-4f32-b863-b6606a03a72c tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:21.904209 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e35c299c-95cc-4f32-b863-b6606a03a72c tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:21.987405 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e35c299c-95cc-4f32-b863-b6606a03a72c tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:21.988156 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e35c299c-95cc-4f32-b863-b6606a03a72c tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:21.991469 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9a5c5e14-f62f-4c84-8c20-856f59d299ba tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:21.992068 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e35c299c-95cc-4f32-b863-b6606a03a72c tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:21.992647 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-e35c299c-95cc-4f32-b863-b6606a03a72c tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lazy-loading 'fault' on Instance uuid adc33804-eb64-40ca-a943-f2e74040c1b2 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:36:21.993060 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9a5c5e14-f62f-4c84-8c20-856f59d299ba tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 3ead1560-9c23-48ad-a938-6b3179b70035] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:22.004546 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9a5c5e14-f62f-4c84-8c20-856f59d299ba tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:22.011818 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9a5c5e14-f62f-4c84-8c20-856f59d299ba tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:22.012286 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9a5c5e14-f62f-4c84-8c20-856f59d299ba tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:22.013040 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9a5c5e14-f62f-4c84-8c20-856f59d299ba tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:22.013508 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9a5c5e14-f62f-4c84-8c20-856f59d299ba tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:22.013947 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9a5c5e14-f62f-4c84-8c20-856f59d299ba tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:22.162651 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e35c299c-95cc-4f32-b863-b6606a03a72c tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81e50834114f0fa3cca4b0b9f8acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4650d613cb84018b92dc5d51486885e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:22.177384 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e35c299c-95cc-4f32-b863-b6606a03a72c tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] 10.222.0.20 "GET /compute/v2.1/servers/adc33804-eb64-40ca-a943-f2e74040c1b2" status: 200 len: 1311 microversion: 2.1 time: 0.303525 Oct 04 18:36:22.179106 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1026/2159] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:21 2022] GET /compute/v2.1/servers/adc33804-eb64-40ca-a943-f2e74040c1b2 => generated 1311 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:22.277114 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3fec2885-78c2-447d-8ea2-8aa19c5c7455 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:22.278110 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3fec2885-78c2-447d-8ea2-8aa19c5c7455 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: cd74aff9-f694-49f3-a1cc-2095b71cd9e5] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:22.282154 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:22.299281 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3fec2885-78c2-447d-8ea2-8aa19c5c7455 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:22.303712 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3fec2885-78c2-447d-8ea2-8aa19c5c7455 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:22.305632 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3fec2885-78c2-447d-8ea2-8aa19c5c7455 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:22.308187 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3fec2885-78c2-447d-8ea2-8aa19c5c7455 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:22.318719 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3fec2885-78c2-447d-8ea2-8aa19c5c7455 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:22.319449 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3fec2885-78c2-447d-8ea2-8aa19c5c7455 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:22.419530 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9a5c5e14-f62f-4c84-8c20-856f59d299ba tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:22.441431 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9a5c5e14-f62f-4c84-8c20-856f59d299ba tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035" status: 200 len: 1475 microversion: 2.1 time: 0.450653 Oct 04 18:36:22.446368 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1134/2160] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:21 2022] GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035 => generated 1475 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:22.881677 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3fec2885-78c2-447d-8ea2-8aa19c5c7455 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:22.893349 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3fec2885-78c2-447d-8ea2-8aa19c5c7455 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:22.895584 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3fec2885-78c2-447d-8ea2-8aa19c5c7455 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:22.897071 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3fec2885-78c2-447d-8ea2-8aa19c5c7455 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5" status: 200 len: 1281 microversion: 2.25 time: 0.625468 Oct 04 18:36:22.908445 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1027/2161] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:22 2022] GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5 => generated 1281 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:36:23.204746 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-cfd104c8-b4a5-496b-87fb-d7dc1601a6c9 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:23.205380 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-cfd104c8-b4a5-496b-87fb-d7dc1601a6c9 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] [instance: adc33804-eb64-40ca-a943-f2e74040c1b2] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:23.212428 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cfd104c8-b4a5-496b-87fb-d7dc1601a6c9 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:23.212921 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cfd104c8-b4a5-496b-87fb-d7dc1601a6c9 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:23.213423 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cfd104c8-b4a5-496b-87fb-d7dc1601a6c9 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:23.214127 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cfd104c8-b4a5-496b-87fb-d7dc1601a6c9 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:23.214582 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cfd104c8-b4a5-496b-87fb-d7dc1601a6c9 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:23.215010 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cfd104c8-b4a5-496b-87fb-d7dc1601a6c9 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:23.249658 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cfd104c8-b4a5-496b-87fb-d7dc1601a6c9 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:23.250743 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cfd104c8-b4a5-496b-87fb-d7dc1601a6c9 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:23.251181 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cfd104c8-b4a5-496b-87fb-d7dc1601a6c9 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:23.252325 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-cfd104c8-b4a5-496b-87fb-d7dc1601a6c9 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lazy-loading 'fault' on Instance uuid adc33804-eb64-40ca-a943-f2e74040c1b2 {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:36:23.300504 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-cfd104c8-b4a5-496b-87fb-d7dc1601a6c9 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81e50834114f0fa3cca4b0b9f8acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4650d613cb84018b92dc5d51486885e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:23.308562 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-cfd104c8-b4a5-496b-87fb-d7dc1601a6c9 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] 10.222.0.20 "GET /compute/v2.1/servers/adc33804-eb64-40ca-a943-f2e74040c1b2" status: 200 len: 1311 microversion: 2.1 time: 0.107889 Oct 04 18:36:23.309223 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1135/2162] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:23 2022] GET /compute/v2.1/servers/adc33804-eb64-40ca-a943-f2e74040c1b2 => generated 1311 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:23.470458 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1bbcb355-ea12-4523-855a-1f5d0edfdcd8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:23.471090 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1bbcb355-ea12-4523-855a-1f5d0edfdcd8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 3ead1560-9c23-48ad-a938-6b3179b70035] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:23.478097 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1bbcb355-ea12-4523-855a-1f5d0edfdcd8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:23.478590 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1bbcb355-ea12-4523-855a-1f5d0edfdcd8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:23.479060 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1bbcb355-ea12-4523-855a-1f5d0edfdcd8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:23.479771 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1bbcb355-ea12-4523-855a-1f5d0edfdcd8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:23.480342 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1bbcb355-ea12-4523-855a-1f5d0edfdcd8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:23.480706 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1bbcb355-ea12-4523-855a-1f5d0edfdcd8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:23.629641 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1bbcb355-ea12-4523-855a-1f5d0edfdcd8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:23.637536 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1bbcb355-ea12-4523-855a-1f5d0edfdcd8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035" status: 200 len: 1475 microversion: 2.1 time: 0.171827 Oct 04 18:36:23.638323 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1028/2163] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:23 2022] GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035 => generated 1475 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:23.934355 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8be072f3-2ba7-47d1-815b-4dc538c973fa tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:23.934997 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8be072f3-2ba7-47d1-815b-4dc538c973fa tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: cd74aff9-f694-49f3-a1cc-2095b71cd9e5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:23.961295 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8be072f3-2ba7-47d1-815b-4dc538c973fa tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:23.961735 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8be072f3-2ba7-47d1-815b-4dc538c973fa tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:23.962194 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8be072f3-2ba7-47d1-815b-4dc538c973fa tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:23.962930 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8be072f3-2ba7-47d1-815b-4dc538c973fa tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:23.963394 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8be072f3-2ba7-47d1-815b-4dc538c973fa tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:23.963826 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8be072f3-2ba7-47d1-815b-4dc538c973fa tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:24.341142 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-fb942ba2-99a6-4ff7-9957-48cd2a379049 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:24.341871 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-fb942ba2-99a6-4ff7-9957-48cd2a379049 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] [instance: adc33804-eb64-40ca-a943-f2e74040c1b2] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:24.350658 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fb942ba2-99a6-4ff7-9957-48cd2a379049 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:24.351482 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fb942ba2-99a6-4ff7-9957-48cd2a379049 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:24.351928 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fb942ba2-99a6-4ff7-9957-48cd2a379049 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:24.352810 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fb942ba2-99a6-4ff7-9957-48cd2a379049 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:24.353132 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fb942ba2-99a6-4ff7-9957-48cd2a379049 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:24.353556 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fb942ba2-99a6-4ff7-9957-48cd2a379049 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:24.371817 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-fb942ba2-99a6-4ff7-9957-48cd2a379049 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] HTTP exception thrown: Instance adc33804-eb64-40ca-a943-f2e74040c1b2 could not be found. Oct 04 18:36:24.374311 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-fb942ba2-99a6-4ff7-9957-48cd2a379049 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Request method failure captured: Oct 04 18:36:24.374311 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/adc33804-eb64-40ca-a943-f2e74040c1b2 HTTP/1.1 Oct 04 18:36:24.374311 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:36:24.374311 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:36:24.374311 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:36:24.374311 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:36:24.374311 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:36:24.374311 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:36:24.374311 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:36:24.374311 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:36:24.374311 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPHzJ9xbn_MCsyek9o_Q4LQpZokiYpLBfypHoz6lM5WZ91e8BRnanSFM1UoaGYc6aZox7FJxW4z7S9fN-1iYG3vh7CbZ3kFwCrOl7E4QN7WJje0fTrRhEik-56-AcKNDjSFDbGVTZ3v2H_5nxHmdRwbBAPblCZtWqyZjupQ0Rkijcahk Oct 04 18:36:24.374311 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:36:24.374311 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:36:24.374311 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:36:24.374311 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:36:24.374311 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:36:24.374311 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:36:24.374311 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: d4650d613cb84018b92dc5d51486885e Oct 04 18:36:24.374311 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ListServerFiltersTestJSON-888884125 Oct 04 18:36:24.374311 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:36:24.374311 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:36:24.374311 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d4650d613cb84018b92dc5d51486885e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d4650d613cb84018b92dc5d51486885e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d4650d613cb84018b92dc5d51486885e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d4650d613cb84018b92dc5d51486885e"}]}] Oct 04 18:36:24.374311 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ListServerFiltersTestJSON-888884125 Oct 04 18:36:24.374311 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: d4650d613cb84018b92dc5d51486885e Oct 04 18:36:24.374311 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-888884125 Oct 04 18:36:24.374311 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ListServerFiltersTestJSON-888884125-project Oct 04 18:36:24.374311 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:36:24.374311 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:36:24.374311 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 6a81e50834114f0fa3cca4b0b9f8acf1 Oct 04 18:36:24.374311 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ListServerFiltersTestJSON-888884125-project Oct 04 18:36:24.374311 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:36:24.374311 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance adc33804-eb64-40ca-a943-f2e74040c1b2 could not be found. Oct 04 18:36:24.374311 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': 'adc33804-eb64-40ca-a943-f2e74040c1b2'} Oct 04 18:36:24.374311 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:36:24.374311 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:24.374311 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:36:24.374311 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:36:24.374311 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:36:24.374311 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:36:24.374311 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:36:24.374311 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:36:24.374311 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:36:24.374311 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:36:24.374311 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance adc33804-eb64-40ca-a943-f2e74040c1b2 could not be found. Oct 04 18:36:24.374311 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:36:24.374311 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:24.374311 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:36:24.374311 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:24.374311 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:24.374311 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:24.374311 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:36:24.374311 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:36:24.374311 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:36:24.374311 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:36:24.374311 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:36:24.374311 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:36:24.374311 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:36:24.374311 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:36:24.374311 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:36:24.374311 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:36:24.374311 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance adc33804-eb64-40ca-a943-f2e74040c1b2 could not be found. Oct 04 18:36:24.374311 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:36:24.374311 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:24.374311 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:36:24.381194 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:24.381194 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:24.381194 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:24.381194 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:36:24.381194 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:36:24.381194 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance adc33804-eb64-40ca-a943-f2e74040c1b2 could not be found. Oct 04 18:36:24.381194 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:36:24.381194 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-fb942ba2-99a6-4ff7-9957-48cd2a379049 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Returning 404 to user: Instance adc33804-eb64-40ca-a943-f2e74040c1b2 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:36:24.381194 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-fb942ba2-99a6-4ff7-9957-48cd2a379049 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] 10.222.0.20 "GET /compute/v2.1/servers/adc33804-eb64-40ca-a943-f2e74040c1b2" status: 404 len: 111 microversion: 2.1 time: 0.040461 Oct 04 18:36:24.381194 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1029/2164] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:24 2022] GET /compute/v2.1/servers/adc33804-eb64-40ca-a943-f2e74040c1b2 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:36:24.388593 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1726199c-4e78-409c-a7dc-7249110ba062 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:24.394676 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1726199c-4e78-409c-a7dc-7249110ba062 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] [instance: b4d49cb2-f2a4-481b-bdb4-bcdad0649bd2] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:24.396269 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1726199c-4e78-409c-a7dc-7249110ba062 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:24.396752 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1726199c-4e78-409c-a7dc-7249110ba062 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:24.397361 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1726199c-4e78-409c-a7dc-7249110ba062 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:24.398286 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1726199c-4e78-409c-a7dc-7249110ba062 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:24.398746 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1726199c-4e78-409c-a7dc-7249110ba062 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:24.399174 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1726199c-4e78-409c-a7dc-7249110ba062 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:24.428660 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8be072f3-2ba7-47d1-815b-4dc538c973fa tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:24.431856 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1726199c-4e78-409c-a7dc-7249110ba062 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] [instance: b4d49cb2-f2a4-481b-bdb4-bcdad0649bd2] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:36:24.445516 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=12 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:24.452021 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8be072f3-2ba7-47d1-815b-4dc538c973fa tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:24.452021 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8be072f3-2ba7-47d1-815b-4dc538c973fa tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:24.455107 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8be072f3-2ba7-47d1-815b-4dc538c973fa tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5" status: 200 len: 1281 microversion: 2.25 time: 0.531790 Oct 04 18:36:24.456367 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1136/2165] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:23 2022] GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5 => generated 1281 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:36:24.662609 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e42db42c-617f-4bfc-a479-0a226b20eefa tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:24.663229 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e42db42c-617f-4bfc-a479-0a226b20eefa tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 3ead1560-9c23-48ad-a938-6b3179b70035] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:24.683242 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e42db42c-617f-4bfc-a479-0a226b20eefa tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:24.683793 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e42db42c-617f-4bfc-a479-0a226b20eefa tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:24.684274 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e42db42c-617f-4bfc-a479-0a226b20eefa tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:24.685281 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e42db42c-617f-4bfc-a479-0a226b20eefa tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:24.686518 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e42db42c-617f-4bfc-a479-0a226b20eefa tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:24.687165 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e42db42c-617f-4bfc-a479-0a226b20eefa tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:25.011434 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1726199c-4e78-409c-a7dc-7249110ba062 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b4d49cb2-f2a4-481b-bdb4-bcdad0649bd2" status: 204 len: 0 microversion: 2.1 time: 0.626296 Oct 04 18:36:25.019034 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1030/2166] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:36:24 2022] DELETE /compute/v2.1/servers/b4d49cb2-f2a4-481b-bdb4-bcdad0649bd2 => generated 0 bytes in 630 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:36:25.027018 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-80900006-a1fb-474a-a3db-df45ebcf4c1a tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:25.028989 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-80900006-a1fb-474a-a3db-df45ebcf4c1a tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] [instance: b4d49cb2-f2a4-481b-bdb4-bcdad0649bd2] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:25.037382 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-80900006-a1fb-474a-a3db-df45ebcf4c1a tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:25.038907 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-80900006-a1fb-474a-a3db-df45ebcf4c1a tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:25.039584 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-80900006-a1fb-474a-a3db-df45ebcf4c1a tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:25.040547 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-80900006-a1fb-474a-a3db-df45ebcf4c1a tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:25.041289 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-80900006-a1fb-474a-a3db-df45ebcf4c1a tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:25.047433 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-80900006-a1fb-474a-a3db-df45ebcf4c1a tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:25.277377 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e42db42c-617f-4bfc-a479-0a226b20eefa tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:25.285642 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e42db42c-617f-4bfc-a479-0a226b20eefa tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035" status: 200 len: 1475 microversion: 2.1 time: 0.627144 Oct 04 18:36:25.293466 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1137/2167] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:24 2022] GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035 => generated 1475 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:36:25.487543 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a89bd236-8f69-4163-9b39-1d3aa7e03226 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:25.488748 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a89bd236-8f69-4163-9b39-1d3aa7e03226 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: cd74aff9-f694-49f3-a1cc-2095b71cd9e5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:25.495539 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a89bd236-8f69-4163-9b39-1d3aa7e03226 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:25.496388 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a89bd236-8f69-4163-9b39-1d3aa7e03226 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:25.497029 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a89bd236-8f69-4163-9b39-1d3aa7e03226 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:25.497978 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a89bd236-8f69-4163-9b39-1d3aa7e03226 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:25.505962 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a89bd236-8f69-4163-9b39-1d3aa7e03226 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:25.506485 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a89bd236-8f69-4163-9b39-1d3aa7e03226 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:25.998031 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-80900006-a1fb-474a-a3db-df45ebcf4c1a tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81e50834114f0fa3cca4b0b9f8acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4650d613cb84018b92dc5d51486885e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:26.003687 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-80900006-a1fb-474a-a3db-df45ebcf4c1a tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] 10.222.0.20 "GET /compute/v2.1/servers/b4d49cb2-f2a4-481b-bdb4-bcdad0649bd2" status: 200 len: 1518 microversion: 2.1 time: 0.981649 Oct 04 18:36:26.005567 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1031/2168] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:25 2022] GET /compute/v2.1/servers/b4d49cb2-f2a4-481b-bdb4-bcdad0649bd2 => generated 1518 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:36:26.405669 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a89bd236-8f69-4163-9b39-1d3aa7e03226 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:26.423451 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a89bd236-8f69-4163-9b39-1d3aa7e03226 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:26.425491 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a89bd236-8f69-4163-9b39-1d3aa7e03226 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:26.429630 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a89bd236-8f69-4163-9b39-1d3aa7e03226 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5" status: 200 len: 1281 microversion: 2.25 time: 0.946283 Oct 04 18:36:26.430416 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1138/2169] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:25 2022] GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5 => generated 1281 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:36:26.465714 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-189f8078-5957-46dc-ad93-d5d0ffa35188 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:26.469420 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-189f8078-5957-46dc-ad93-d5d0ffa35188 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 3ead1560-9c23-48ad-a938-6b3179b70035] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:26.488574 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-189f8078-5957-46dc-ad93-d5d0ffa35188 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:26.489971 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-189f8078-5957-46dc-ad93-d5d0ffa35188 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:26.493521 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-189f8078-5957-46dc-ad93-d5d0ffa35188 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:26.497285 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-189f8078-5957-46dc-ad93-d5d0ffa35188 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:26.497285 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-189f8078-5957-46dc-ad93-d5d0ffa35188 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:26.501233 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-189f8078-5957-46dc-ad93-d5d0ffa35188 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:26.595493 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-78bbfa13-8ad1-4c7a-8f22-7ffbb9eac548 tempest-ServicesAdminNegativeTestJSON-504608491 tempest-ServicesAdminNegativeTestJSON-504608491-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:26.614438 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-78bbfa13-8ad1-4c7a-8f22-7ffbb9eac548 tempest-ServicesAdminNegativeTestJSON-504608491 tempest-ServicesAdminNegativeTestJSON-504608491-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:26.615014 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-78bbfa13-8ad1-4c7a-8f22-7ffbb9eac548 tempest-ServicesAdminNegativeTestJSON-504608491 tempest-ServicesAdminNegativeTestJSON-504608491-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:26.617312 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-78bbfa13-8ad1-4c7a-8f22-7ffbb9eac548 tempest-ServicesAdminNegativeTestJSON-504608491 tempest-ServicesAdminNegativeTestJSON-504608491-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:26.618145 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-78bbfa13-8ad1-4c7a-8f22-7ffbb9eac548 tempest-ServicesAdminNegativeTestJSON-504608491 tempest-ServicesAdminNegativeTestJSON-504608491-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:26.618620 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-78bbfa13-8ad1-4c7a-8f22-7ffbb9eac548 tempest-ServicesAdminNegativeTestJSON-504608491 tempest-ServicesAdminNegativeTestJSON-504608491-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:26.619053 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-78bbfa13-8ad1-4c7a-8f22-7ffbb9eac548 tempest-ServicesAdminNegativeTestJSON-504608491 tempest-ServicesAdminNegativeTestJSON-504608491-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:26.743797 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-78bbfa13-8ad1-4c7a-8f22-7ffbb9eac548 tempest-ServicesAdminNegativeTestJSON-504608491 tempest-ServicesAdminNegativeTestJSON-504608491-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.532142 Oct 04 18:36:26.745365 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1032/2170] 10.222.0.20 () {58 vars in 1137 bytes} [Tue Oct 4 18:36:26 2022] GET /compute/v2.1/os-services => generated 949 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:36:26.760813 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c8f878a7-2e7b-4e7b-a89b-4484ca0f0fda tempest-ServicesAdminNegativeTestJSON-504608491 tempest-ServicesAdminNegativeTestJSON-504608491-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:26.765147 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c8f878a7-2e7b-4e7b-a89b-4484ca0f0fda tempest-ServicesAdminNegativeTestJSON-504608491 tempest-ServicesAdminNegativeTestJSON-504608491-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:26.766878 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c8f878a7-2e7b-4e7b-a89b-4484ca0f0fda tempest-ServicesAdminNegativeTestJSON-504608491 tempest-ServicesAdminNegativeTestJSON-504608491-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:26.767573 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c8f878a7-2e7b-4e7b-a89b-4484ca0f0fda tempest-ServicesAdminNegativeTestJSON-504608491 tempest-ServicesAdminNegativeTestJSON-504608491-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:26.768722 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c8f878a7-2e7b-4e7b-a89b-4484ca0f0fda tempest-ServicesAdminNegativeTestJSON-504608491 tempest-ServicesAdminNegativeTestJSON-504608491-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:26.769477 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c8f878a7-2e7b-4e7b-a89b-4484ca0f0fda tempest-ServicesAdminNegativeTestJSON-504608491 tempest-ServicesAdminNegativeTestJSON-504608491-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:26.770594 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c8f878a7-2e7b-4e7b-a89b-4484ca0f0fda tempest-ServicesAdminNegativeTestJSON-504608491 tempest-ServicesAdminNegativeTestJSON-504608491-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:26.848784 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c8f878a7-2e7b-4e7b-a89b-4484ca0f0fda tempest-ServicesAdminNegativeTestJSON-504608491 tempest-ServicesAdminNegativeTestJSON-504608491-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.094346 Oct 04 18:36:26.866079 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1033/2171] 10.222.0.20 () {58 vars in 1170 bytes} [Tue Oct 4 18:36:26 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 949 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:36:26.871382 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7296092b-b8dd-46a7-8dbf-1cc05b6367b4 tempest-ServicesAdminNegativeTestJSON-504608491 tempest-ServicesAdminNegativeTestJSON-504608491-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:26.876555 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7296092b-b8dd-46a7-8dbf-1cc05b6367b4 tempest-ServicesAdminNegativeTestJSON-504608491 tempest-ServicesAdminNegativeTestJSON-504608491-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:26.879380 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7296092b-b8dd-46a7-8dbf-1cc05b6367b4 tempest-ServicesAdminNegativeTestJSON-504608491 tempest-ServicesAdminNegativeTestJSON-504608491-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:26.879969 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7296092b-b8dd-46a7-8dbf-1cc05b6367b4 tempest-ServicesAdminNegativeTestJSON-504608491 tempest-ServicesAdminNegativeTestJSON-504608491-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:26.880895 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7296092b-b8dd-46a7-8dbf-1cc05b6367b4 tempest-ServicesAdminNegativeTestJSON-504608491 tempest-ServicesAdminNegativeTestJSON-504608491-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:26.882768 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7296092b-b8dd-46a7-8dbf-1cc05b6367b4 tempest-ServicesAdminNegativeTestJSON-504608491 tempest-ServicesAdminNegativeTestJSON-504608491-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:26.886964 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7296092b-b8dd-46a7-8dbf-1cc05b6367b4 tempest-ServicesAdminNegativeTestJSON-504608491 tempest-ServicesAdminNegativeTestJSON-504608491-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:26.942318 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7296092b-b8dd-46a7-8dbf-1cc05b6367b4 tempest-ServicesAdminNegativeTestJSON-504608491 tempest-ServicesAdminNegativeTestJSON-504608491-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.074643 Oct 04 18:36:26.943579 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1034/2172] 10.222.0.20 () {58 vars in 1137 bytes} [Tue Oct 4 18:36:26 2022] GET /compute/v2.1/os-services => generated 949 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:36:26.957237 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2016e02b-62c4-48f1-879e-cfec25b74617 tempest-ServicesAdminNegativeTestJSON-504608491 tempest-ServicesAdminNegativeTestJSON-504608491-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:26.961534 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2016e02b-62c4-48f1-879e-cfec25b74617 tempest-ServicesAdminNegativeTestJSON-504608491 tempest-ServicesAdminNegativeTestJSON-504608491-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:26.962264 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2016e02b-62c4-48f1-879e-cfec25b74617 tempest-ServicesAdminNegativeTestJSON-504608491 tempest-ServicesAdminNegativeTestJSON-504608491-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:26.963032 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2016e02b-62c4-48f1-879e-cfec25b74617 tempest-ServicesAdminNegativeTestJSON-504608491 tempest-ServicesAdminNegativeTestJSON-504608491-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:26.964426 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2016e02b-62c4-48f1-879e-cfec25b74617 tempest-ServicesAdminNegativeTestJSON-504608491 tempest-ServicesAdminNegativeTestJSON-504608491-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:26.965059 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2016e02b-62c4-48f1-879e-cfec25b74617 tempest-ServicesAdminNegativeTestJSON-504608491 tempest-ServicesAdminNegativeTestJSON-504608491-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:26.965683 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2016e02b-62c4-48f1-879e-cfec25b74617 tempest-ServicesAdminNegativeTestJSON-504608491 tempest-ServicesAdminNegativeTestJSON-504608491-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:26.994042 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2016e02b-62c4-48f1-879e-cfec25b74617 tempest-ServicesAdminNegativeTestJSON-504608491 tempest-ServicesAdminNegativeTestJSON-504608491-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?host=n-d-850501-14&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.041975 Oct 04 18:36:26.995626 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1035/2173] 10.222.0.20 () {58 vars in 1196 bytes} [Tue Oct 4 18:36:26 2022] GET /compute/v2.1/os-services?host=n-d-850501-14&binary=xxx => generated 16 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 18:36:27.011630 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d382e6eb-8be3-420b-9226-b60d3fc30d81 tempest-ServicesAdminNegativeTestJSON-504608491 tempest-ServicesAdminNegativeTestJSON-504608491-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:27.016197 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d382e6eb-8be3-420b-9226-b60d3fc30d81 tempest-ServicesAdminNegativeTestJSON-504608491 tempest-ServicesAdminNegativeTestJSON-504608491-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:27.019666 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d382e6eb-8be3-420b-9226-b60d3fc30d81 tempest-ServicesAdminNegativeTestJSON-504608491 tempest-ServicesAdminNegativeTestJSON-504608491-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:27.019666 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d382e6eb-8be3-420b-9226-b60d3fc30d81 tempest-ServicesAdminNegativeTestJSON-504608491 tempest-ServicesAdminNegativeTestJSON-504608491-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:27.019666 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d382e6eb-8be3-420b-9226-b60d3fc30d81 tempest-ServicesAdminNegativeTestJSON-504608491 tempest-ServicesAdminNegativeTestJSON-504608491-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:27.019666 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d382e6eb-8be3-420b-9226-b60d3fc30d81 tempest-ServicesAdminNegativeTestJSON-504608491 tempest-ServicesAdminNegativeTestJSON-504608491-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:27.020223 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d382e6eb-8be3-420b-9226-b60d3fc30d81 tempest-ServicesAdminNegativeTestJSON-504608491 tempest-ServicesAdminNegativeTestJSON-504608491-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:27.050680 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d382e6eb-8be3-420b-9226-b60d3fc30d81 tempest-ServicesAdminNegativeTestJSON-504608491 tempest-ServicesAdminNegativeTestJSON-504608491-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.044724 Oct 04 18:36:27.051853 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1036/2174] 10.222.0.20 () {58 vars in 1137 bytes} [Tue Oct 4 18:36:27 2022] GET /compute/v2.1/os-services => generated 949 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:36:27.068217 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8a38884a-91ff-4693-9a6b-e77bf53bea08 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:27.069199 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8a38884a-91ff-4693-9a6b-e77bf53bea08 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] [instance: b4d49cb2-f2a4-481b-bdb4-bcdad0649bd2] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:27.077425 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8a38884a-91ff-4693-9a6b-e77bf53bea08 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:27.078693 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8a38884a-91ff-4693-9a6b-e77bf53bea08 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:27.079610 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8a38884a-91ff-4693-9a6b-e77bf53bea08 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:27.080945 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8a38884a-91ff-4693-9a6b-e77bf53bea08 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:27.081669 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8a38884a-91ff-4693-9a6b-e77bf53bea08 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:27.082363 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8a38884a-91ff-4693-9a6b-e77bf53bea08 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:27.414816 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-189f8078-5957-46dc-ad93-d5d0ffa35188 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:27.427175 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-189f8078-5957-46dc-ad93-d5d0ffa35188 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035" status: 200 len: 1475 microversion: 2.1 time: 0.981299 Oct 04 18:36:27.427770 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1139/2175] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:26 2022] GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035 => generated 1475 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:27.443226 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-020dc2c6-d538-423e-be9a-9c866a610dca tempest-ServicesAdminNegativeTestJSON-504608491 tempest-ServicesAdminNegativeTestJSON-504608491-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:27.459995 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-020dc2c6-d538-423e-be9a-9c866a610dca tempest-ServicesAdminNegativeTestJSON-504608491 tempest-ServicesAdminNegativeTestJSON-504608491-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:27.460535 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-020dc2c6-d538-423e-be9a-9c866a610dca tempest-ServicesAdminNegativeTestJSON-504608491 tempest-ServicesAdminNegativeTestJSON-504608491-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:27.460986 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-020dc2c6-d538-423e-be9a-9c866a610dca tempest-ServicesAdminNegativeTestJSON-504608491 tempest-ServicesAdminNegativeTestJSON-504608491-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:27.461753 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-020dc2c6-d538-423e-be9a-9c866a610dca tempest-ServicesAdminNegativeTestJSON-504608491 tempest-ServicesAdminNegativeTestJSON-504608491-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:27.462219 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-020dc2c6-d538-423e-be9a-9c866a610dca tempest-ServicesAdminNegativeTestJSON-504608491 tempest-ServicesAdminNegativeTestJSON-504608491-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:27.462645 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-020dc2c6-d538-423e-be9a-9c866a610dca tempest-ServicesAdminNegativeTestJSON-504608491 tempest-ServicesAdminNegativeTestJSON-504608491-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:27.526768 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-020dc2c6-d538-423e-be9a-9c866a610dca tempest-ServicesAdminNegativeTestJSON-504608491 tempest-ServicesAdminNegativeTestJSON-504608491-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.092170 Oct 04 18:36:27.527653 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1140/2176] 10.222.0.20 () {58 vars in 1198 bytes} [Tue Oct 4 18:36:27 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:36:27.540676 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-47f85e24-a94d-42b9-8668-f8ee7e226927 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:27.541285 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-47f85e24-a94d-42b9-8668-f8ee7e226927 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: cd74aff9-f694-49f3-a1cc-2095b71cd9e5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:27.554785 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-47f85e24-a94d-42b9-8668-f8ee7e226927 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:27.555285 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-47f85e24-a94d-42b9-8668-f8ee7e226927 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:27.556593 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-47f85e24-a94d-42b9-8668-f8ee7e226927 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:27.557698 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-47f85e24-a94d-42b9-8668-f8ee7e226927 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:27.558333 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-47f85e24-a94d-42b9-8668-f8ee7e226927 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:27.558938 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-47f85e24-a94d-42b9-8668-f8ee7e226927 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:27.947647 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8a38884a-91ff-4693-9a6b-e77bf53bea08 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81e50834114f0fa3cca4b0b9f8acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4650d613cb84018b92dc5d51486885e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:27.961279 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8a38884a-91ff-4693-9a6b-e77bf53bea08 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] 10.222.0.20 "GET /compute/v2.1/servers/b4d49cb2-f2a4-481b-bdb4-bcdad0649bd2" status: 200 len: 1518 microversion: 2.1 time: 0.907836 Oct 04 18:36:27.962664 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1037/2177] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:27 2022] GET /compute/v2.1/servers/b4d49cb2-f2a4-481b-bdb4-bcdad0649bd2 => generated 1518 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:28.260028 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d51f4a54-f79a-4244-b253-5ee1b351a5dd tempest-ServicesAdminNegativeTestJSON-851919724 tempest-ServicesAdminNegativeTestJSON-851919724-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:28.263857 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d51f4a54-f79a-4244-b253-5ee1b351a5dd tempest-ServicesAdminNegativeTestJSON-851919724 tempest-ServicesAdminNegativeTestJSON-851919724-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '1608e5e3fc134d3a926dddd81d5174d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f06523ca3e274be29c1dfa7934e0a5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:28.286464 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d51f4a54-f79a-4244-b253-5ee1b351a5dd tempest-ServicesAdminNegativeTestJSON-851919724 tempest-ServicesAdminNegativeTestJSON-851919724-project] Request method failure captured: Oct 04 18:36:28.286464 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 04 18:36:28.286464 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:36:28.286464 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:36:28.286464 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:36:28.286464 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:36:28.286464 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:36:28.286464 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:36:28.286464 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:36:28.286464 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:36:28.286464 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPH0oF9cQ_UpDJnQvxgJGiafq37mwt36kw8Y9hT-pv8xSnpWvcyKy_veg2m1yB27F-G3LdudjW7uKyO_KDQ1u9aqBbnNOTZxjLEkDiwWFym9KVtgRzts2ju6ewRQc0bMWt1kRZe506ZBHkdbkRVfk442Hqfi2-zE8PVpqYdvo4sI4PVk Oct 04 18:36:28.286464 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:36:28.286464 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:36:28.286464 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:36:28.286464 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:36:28.286464 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:36:28.286464 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:36:28.286464 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: f06523ca3e274be29c1dfa7934e0a5ca Oct 04 18:36:28.286464 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-851919724 Oct 04 18:36:28.286464 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:36:28.286464 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:36:28.286464 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f06523ca3e274be29c1dfa7934e0a5ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f06523ca3e274be29c1dfa7934e0a5ca", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f06523ca3e274be29c1dfa7934e0a5ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f06523ca3e274be29c1dfa7934e0a5ca"}]}] Oct 04 18:36:28.286464 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-851919724 Oct 04 18:36:28.286464 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: f06523ca3e274be29c1dfa7934e0a5ca Oct 04 18:36:28.286464 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-851919724 Oct 04 18:36:28.286464 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ServicesAdminNegativeTestJSON-851919724-project Oct 04 18:36:28.286464 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:36:28.286464 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:36:28.286464 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 1608e5e3fc134d3a926dddd81d5174d7 Oct 04 18:36:28.286464 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-851919724-project Oct 04 18:36:28.286464 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:36:28.286464 n-d-850501-14 devstack@n-api.service[123001]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 04 18:36:28.286464 n-d-850501-14 devstack@n-api.service[123001]: action_args: {} Oct 04 18:36:28.286464 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:36:28.286464 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:28.286464 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:28.286464 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:28.286464 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:36:28.286464 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:36:28.286464 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:36:28.286464 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:36:28.286464 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:36:28.286464 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:36:28.286464 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:36:28.286464 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:36:28.286464 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 04 18:36:28.286464 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 04 18:36:28.286464 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:36:28.286464 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:36:28.286464 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:36:28.286464 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:36:28.286464 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:36:28.286464 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:36:28.286464 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:36:28.286464 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:36:28.286464 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:36:28.286464 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:36:28.286464 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:36:28.286464 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:36:28.286464 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:36:28.286464 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:36:28.286464 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 04 18:36:28.286464 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:36:28.297330 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:28.297330 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:36:28.297330 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:28.297330 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:28.297330 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:28.297330 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:36:28.297330 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:36:28.297330 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 04 18:36:28.297330 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:36:28.297330 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d51f4a54-f79a-4244-b253-5ee1b351a5dd tempest-ServicesAdminNegativeTestJSON-851919724 tempest-ServicesAdminNegativeTestJSON-851919724-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:36:28.297330 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d51f4a54-f79a-4244-b253-5ee1b351a5dd tempest-ServicesAdminNegativeTestJSON-851919724 tempest-ServicesAdminNegativeTestJSON-851919724-project] 10.222.0.20 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.322973 Oct 04 18:36:28.297330 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1038/2178] 10.222.0.20 () {58 vars in 1137 bytes} [Tue Oct 4 18:36:27 2022] GET /compute/v2.1/os-services => generated 112 bytes in 326 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:36:28.455595 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e4674733-6814-463d-9fed-56fbe6299454 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:28.461664 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e4674733-6814-463d-9fed-56fbe6299454 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 3ead1560-9c23-48ad-a938-6b3179b70035] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:28.475818 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e4674733-6814-463d-9fed-56fbe6299454 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:28.482140 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e4674733-6814-463d-9fed-56fbe6299454 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:28.483067 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e4674733-6814-463d-9fed-56fbe6299454 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:28.484837 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e4674733-6814-463d-9fed-56fbe6299454 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:28.485914 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e4674733-6814-463d-9fed-56fbe6299454 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:28.497686 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e4674733-6814-463d-9fed-56fbe6299454 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:28.946700 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-47f85e24-a94d-42b9-8668-f8ee7e226927 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:28.967481 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-47f85e24-a94d-42b9-8668-f8ee7e226927 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:28.973772 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-47f85e24-a94d-42b9-8668-f8ee7e226927 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:28.982257 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-47f85e24-a94d-42b9-8668-f8ee7e226927 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5" status: 200 len: 1281 microversion: 2.25 time: 1.447750 Oct 04 18:36:28.982257 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1141/2179] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:27 2022] GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5 => generated 1281 bytes in 1450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:36:29.004232 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e5b1da13-0a98-4b91-969b-e713dfe3d1b6 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:29.008533 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e5b1da13-0a98-4b91-969b-e713dfe3d1b6 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] [instance: b4d49cb2-f2a4-481b-bdb4-bcdad0649bd2] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:29.045421 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e5b1da13-0a98-4b91-969b-e713dfe3d1b6 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:29.052258 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e5b1da13-0a98-4b91-969b-e713dfe3d1b6 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:29.055696 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e5b1da13-0a98-4b91-969b-e713dfe3d1b6 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:29.057454 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e5b1da13-0a98-4b91-969b-e713dfe3d1b6 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:29.057742 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e5b1da13-0a98-4b91-969b-e713dfe3d1b6 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:29.058180 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e5b1da13-0a98-4b91-969b-e713dfe3d1b6 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:29.796497 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e4674733-6814-463d-9fed-56fbe6299454 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:29.810665 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e4674733-6814-463d-9fed-56fbe6299454 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035" status: 200 len: 1475 microversion: 2.1 time: 1.359545 Oct 04 18:36:29.835940 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1039/2180] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:28 2022] GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035 => generated 1475 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:29.860936 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-d91ccf71-912e-408e-9d31-880c10c1a621 req-5179c18f-7214-4062-8899-3b71450d504d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4d49cb2-f2a4-481b-bdb4-bcdad0649bd2", "name": "network-vif-deleted", "tag": "b7fdc86f-aa1a-42fc-9636-18ad6b5b67b6"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:29.874789 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e5b1da13-0a98-4b91-969b-e713dfe3d1b6 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81e50834114f0fa3cca4b0b9f8acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4650d613cb84018b92dc5d51486885e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:29.883229 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e5b1da13-0a98-4b91-969b-e713dfe3d1b6 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] 10.222.0.20 "GET /compute/v2.1/servers/b4d49cb2-f2a4-481b-bdb4-bcdad0649bd2" status: 200 len: 1518 microversion: 2.1 time: 0.889389 Oct 04 18:36:29.887436 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1142/2181] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:28 2022] GET /compute/v2.1/servers/b4d49cb2-f2a4-481b-bdb4-bcdad0649bd2 => generated 1518 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:29.891654 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-d91ccf71-912e-408e-9d31-880c10c1a621 req-5179c18f-7214-4062-8899-3b71450d504d service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:29.892192 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-d91ccf71-912e-408e-9d31-880c10c1a621 req-5179c18f-7214-4062-8899-3b71450d504d service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:29.892627 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-d91ccf71-912e-408e-9d31-880c10c1a621 req-5179c18f-7214-4062-8899-3b71450d504d service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:29.916887 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-d91ccf71-912e-408e-9d31-880c10c1a621 req-5179c18f-7214-4062-8899-3b71450d504d service nova] Creating event network-vif-deleted:b7fdc86f-aa1a-42fc-9636-18ad6b5b67b6 for instance b4d49cb2-f2a4-481b-bdb4-bcdad0649bd2 on n-h2-850501-14 Oct 04 18:36:29.925218 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-d91ccf71-912e-408e-9d31-880c10c1a621 req-5179c18f-7214-4062-8899-3b71450d504d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067729 Oct 04 18:36:29.929382 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1040/2182] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:36:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:36:30.013725 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-40f98290-7b8e-4fe2-944b-73df6e7a8660 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:30.016310 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-40f98290-7b8e-4fe2-944b-73df6e7a8660 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: cd74aff9-f694-49f3-a1cc-2095b71cd9e5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:30.032867 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-40f98290-7b8e-4fe2-944b-73df6e7a8660 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:30.033366 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-40f98290-7b8e-4fe2-944b-73df6e7a8660 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:30.035490 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-40f98290-7b8e-4fe2-944b-73df6e7a8660 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:30.037014 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-40f98290-7b8e-4fe2-944b-73df6e7a8660 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:30.041386 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-40f98290-7b8e-4fe2-944b-73df6e7a8660 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:30.042194 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-40f98290-7b8e-4fe2-944b-73df6e7a8660 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:30.805907 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-40f98290-7b8e-4fe2-944b-73df6e7a8660 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:30.826741 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-40f98290-7b8e-4fe2-944b-73df6e7a8660 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:30.835325 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-40f98290-7b8e-4fe2-944b-73df6e7a8660 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:30.841911 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-40f98290-7b8e-4fe2-944b-73df6e7a8660 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5" status: 200 len: 1281 microversion: 2.25 time: 0.833423 Oct 04 18:36:30.846110 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1143/2183] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:30 2022] GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5 => generated 1281 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:36:30.849068 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-fc484d1b-404f-4fbf-8678-b85b1ad39c7a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:30.849068 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-fc484d1b-404f-4fbf-8678-b85b1ad39c7a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 3ead1560-9c23-48ad-a938-6b3179b70035] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:30.884836 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fc484d1b-404f-4fbf-8678-b85b1ad39c7a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:30.884836 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fc484d1b-404f-4fbf-8678-b85b1ad39c7a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:30.884836 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fc484d1b-404f-4fbf-8678-b85b1ad39c7a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:30.885472 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fc484d1b-404f-4fbf-8678-b85b1ad39c7a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:30.885733 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fc484d1b-404f-4fbf-8678-b85b1ad39c7a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:30.886165 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fc484d1b-404f-4fbf-8678-b85b1ad39c7a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:30.922465 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-45956afb-6e3e-47b4-98a2-9922467db3f5 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:30.923388 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-45956afb-6e3e-47b4-98a2-9922467db3f5 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] [instance: b4d49cb2-f2a4-481b-bdb4-bcdad0649bd2] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:30.941677 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-45956afb-6e3e-47b4-98a2-9922467db3f5 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:30.945254 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-45956afb-6e3e-47b4-98a2-9922467db3f5 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:30.948600 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-45956afb-6e3e-47b4-98a2-9922467db3f5 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:30.950373 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-45956afb-6e3e-47b4-98a2-9922467db3f5 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:30.953423 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-45956afb-6e3e-47b4-98a2-9922467db3f5 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:30.955279 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-45956afb-6e3e-47b4-98a2-9922467db3f5 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:31.058194 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-45956afb-6e3e-47b4-98a2-9922467db3f5 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:31.058851 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-45956afb-6e3e-47b4-98a2-9922467db3f5 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:31.064338 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-45956afb-6e3e-47b4-98a2-9922467db3f5 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:31.064338 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-45956afb-6e3e-47b4-98a2-9922467db3f5 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lazy-loading 'fault' on Instance uuid b4d49cb2-f2a4-481b-bdb4-bcdad0649bd2 {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:36:31.236748 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-45956afb-6e3e-47b4-98a2-9922467db3f5 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81e50834114f0fa3cca4b0b9f8acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4650d613cb84018b92dc5d51486885e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:31.245382 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-45956afb-6e3e-47b4-98a2-9922467db3f5 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] 10.222.0.20 "GET /compute/v2.1/servers/b4d49cb2-f2a4-481b-bdb4-bcdad0649bd2" status: 200 len: 1311 microversion: 2.1 time: 0.336479 Oct 04 18:36:31.252469 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1144/2184] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:30 2022] GET /compute/v2.1/servers/b4d49cb2-f2a4-481b-bdb4-bcdad0649bd2 => generated 1311 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:36:31.366600 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-fc484d1b-404f-4fbf-8678-b85b1ad39c7a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:31.377942 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-fc484d1b-404f-4fbf-8678-b85b1ad39c7a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035" status: 200 len: 1475 microversion: 2.1 time: 0.536739 Oct 04 18:36:31.384779 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1041/2185] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:30 2022] GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035 => generated 1475 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:31.600974 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0b97281c-7f1d-487a-b97d-0345ab159e9f tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-651804872", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": [{"uuid": "117b0b3c-151b-44fc-b90a-62045a0fbc2f"}]}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:31.713208 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-0b97281c-7f1d-487a-b97d-0345ab159e9f tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] validate_networks() for [('117b0b3c-151b-44fc-b90a-62045a0fbc2f', None, None, None, None, None)] {{(pid=123002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:36:31.878536 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-bb40f219-a7cf-42b3-a38f-2369dc4d6792 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:31.878536 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-bb40f219-a7cf-42b3-a38f-2369dc4d6792 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: cd74aff9-f694-49f3-a1cc-2095b71cd9e5] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:31.906293 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bb40f219-a7cf-42b3-a38f-2369dc4d6792 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:31.906821 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bb40f219-a7cf-42b3-a38f-2369dc4d6792 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:31.907236 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bb40f219-a7cf-42b3-a38f-2369dc4d6792 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:31.915691 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bb40f219-a7cf-42b3-a38f-2369dc4d6792 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:31.916433 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bb40f219-a7cf-42b3-a38f-2369dc4d6792 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:31.917987 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bb40f219-a7cf-42b3-a38f-2369dc4d6792 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:32.291926 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-bb40f219-a7cf-42b3-a38f-2369dc4d6792 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:32.313761 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-bb40f219-a7cf-42b3-a38f-2369dc4d6792 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:32.315795 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-bb40f219-a7cf-42b3-a38f-2369dc4d6792 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:32.319736 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-bb40f219-a7cf-42b3-a38f-2369dc4d6792 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5" status: 200 len: 1281 microversion: 2.25 time: 0.448824 Oct 04 18:36:32.354226 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1042/2186] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:31 2022] GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5 => generated 1281 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:36:32.368375 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-008175e1-400c-4cf8-85bc-afe7110852d7 req-fc7854c7-207d-4eb6-9474-09882fc82e8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd74aff9-f694-49f3-a1cc-2095b71cd9e5", "name": "network-vif-plugged", "status": "completed", "tag": "bd7c52cb-3d4c-4b6f-a043-15c22280ba46"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:32.389715 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-008175e1-400c-4cf8-85bc-afe7110852d7 req-fc7854c7-207d-4eb6-9474-09882fc82e8a service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:32.391397 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-008175e1-400c-4cf8-85bc-afe7110852d7 req-fc7854c7-207d-4eb6-9474-09882fc82e8a service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:32.391954 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-008175e1-400c-4cf8-85bc-afe7110852d7 req-fc7854c7-207d-4eb6-9474-09882fc82e8a service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:32.407087 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:32.410694 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-008175e1-400c-4cf8-85bc-afe7110852d7 req-fc7854c7-207d-4eb6-9474-09882fc82e8a service nova] Creating event network-vif-plugged:bd7c52cb-3d4c-4b6f-a043-15c22280ba46 for instance cd74aff9-f694-49f3-a1cc-2095b71cd9e5 on n-h2-850501-14 Oct 04 18:36:32.418274 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-008175e1-400c-4cf8-85bc-afe7110852d7 req-fc7854c7-207d-4eb6-9474-09882fc82e8a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062325 Oct 04 18:36:32.421043 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1043/2187] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:36:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:36:32.428656 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-22d92b53-9ddf-4339-ad9b-263cdb0927b8 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:32.436856 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-22d92b53-9ddf-4339-ad9b-263cdb0927b8 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] [instance: b4d49cb2-f2a4-481b-bdb4-bcdad0649bd2] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:32.439220 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-22d92b53-9ddf-4339-ad9b-263cdb0927b8 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:32.439992 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-22d92b53-9ddf-4339-ad9b-263cdb0927b8 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:32.442945 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-22d92b53-9ddf-4339-ad9b-263cdb0927b8 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:32.444401 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-22d92b53-9ddf-4339-ad9b-263cdb0927b8 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:32.445185 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-22d92b53-9ddf-4339-ad9b-263cdb0927b8 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:32.445856 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-22d92b53-9ddf-4339-ad9b-263cdb0927b8 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:32.488482 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-22d92b53-9ddf-4339-ad9b-263cdb0927b8 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] HTTP exception thrown: Instance b4d49cb2-f2a4-481b-bdb4-bcdad0649bd2 could not be found. Oct 04 18:36:32.491280 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-22d92b53-9ddf-4339-ad9b-263cdb0927b8 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Request method failure captured: Oct 04 18:36:32.491280 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/b4d49cb2-f2a4-481b-bdb4-bcdad0649bd2 HTTP/1.1 Oct 04 18:36:32.491280 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:36:32.491280 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:36:32.491280 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:36:32.491280 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:36:32.491280 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:36:32.491280 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:36:32.491280 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:36:32.491280 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:36:32.491280 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPHzJ9xbn_MCsyek9o_Q4LQpZokiYpLBfypHoz6lM5WZ91e8BRnanSFM1UoaGYc6aZox7FJxW4z7S9fN-1iYG3vh7CbZ3kFwCrOl7E4QN7WJje0fTrRhEik-56-AcKNDjSFDbGVTZ3v2H_5nxHmdRwbBAPblCZtWqyZjupQ0Rkijcahk Oct 04 18:36:32.491280 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:36:32.491280 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:36:32.491280 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:36:32.491280 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:36:32.491280 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:36:32.491280 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:36:32.491280 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: d4650d613cb84018b92dc5d51486885e Oct 04 18:36:32.491280 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ListServerFiltersTestJSON-888884125 Oct 04 18:36:32.491280 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:36:32.491280 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:36:32.491280 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d4650d613cb84018b92dc5d51486885e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d4650d613cb84018b92dc5d51486885e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d4650d613cb84018b92dc5d51486885e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d4650d613cb84018b92dc5d51486885e"}]}] Oct 04 18:36:32.491280 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ListServerFiltersTestJSON-888884125 Oct 04 18:36:32.491280 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: d4650d613cb84018b92dc5d51486885e Oct 04 18:36:32.491280 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-888884125 Oct 04 18:36:32.491280 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ListServerFiltersTestJSON-888884125-project Oct 04 18:36:32.491280 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:36:32.491280 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:36:32.491280 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 6a81e50834114f0fa3cca4b0b9f8acf1 Oct 04 18:36:32.491280 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ListServerFiltersTestJSON-888884125-project Oct 04 18:36:32.491280 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:36:32.491280 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance b4d49cb2-f2a4-481b-bdb4-bcdad0649bd2 could not be found. Oct 04 18:36:32.491280 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': 'b4d49cb2-f2a4-481b-bdb4-bcdad0649bd2'} Oct 04 18:36:32.491280 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:36:32.491280 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:32.491280 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:36:32.491280 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:36:32.491280 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:36:32.491280 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:36:32.491280 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:36:32.491280 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:36:32.491280 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:36:32.491280 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:36:32.491280 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4d49cb2-f2a4-481b-bdb4-bcdad0649bd2 could not be found. Oct 04 18:36:32.491280 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:36:32.491280 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:32.491280 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:36:32.491280 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:32.491280 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:32.491280 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:32.491280 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:36:32.491280 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:36:32.491280 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:36:32.491280 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:36:32.491280 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:36:32.491280 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:36:32.491280 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:36:32.491280 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:36:32.491280 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:36:32.491280 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:36:32.491280 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4d49cb2-f2a4-481b-bdb4-bcdad0649bd2 could not be found. Oct 04 18:36:32.491280 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:36:32.491280 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:32.491280 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:36:32.495985 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:32.495985 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:32.495985 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:32.495985 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:36:32.495985 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:36:32.495985 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4d49cb2-f2a4-481b-bdb4-bcdad0649bd2 could not be found. Oct 04 18:36:32.495985 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:36:32.509071 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-22d92b53-9ddf-4339-ad9b-263cdb0927b8 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Returning 404 to user: Instance b4d49cb2-f2a4-481b-bdb4-bcdad0649bd2 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:36:32.510907 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-22d92b53-9ddf-4339-ad9b-263cdb0927b8 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] 10.222.0.20 "GET /compute/v2.1/servers/b4d49cb2-f2a4-481b-bdb4-bcdad0649bd2" status: 404 len: 111 microversion: 2.1 time: 0.088407 Oct 04 18:36:32.514693 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1044/2188] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:32 2022] GET /compute/v2.1/servers/b4d49cb2-f2a4-481b-bdb4-bcdad0649bd2 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:36:32.524591 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-bbe5f5cf-23fe-49da-9ec9-fe87d9e4ea4f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:32.525485 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-bbe5f5cf-23fe-49da-9ec9-fe87d9e4ea4f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 3ead1560-9c23-48ad-a938-6b3179b70035] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:32.534346 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bbe5f5cf-23fe-49da-9ec9-fe87d9e4ea4f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:32.535448 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bbe5f5cf-23fe-49da-9ec9-fe87d9e4ea4f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:32.536408 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bbe5f5cf-23fe-49da-9ec9-fe87d9e4ea4f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:32.537525 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bbe5f5cf-23fe-49da-9ec9-fe87d9e4ea4f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:32.540452 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bbe5f5cf-23fe-49da-9ec9-fe87d9e4ea4f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:32.541025 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bbe5f5cf-23fe-49da-9ec9-fe87d9e4ea4f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:32.693016 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-0b97281c-7f1d-487a-b97d-0345ab159e9f tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:36:32.693509 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-0b97281c-7f1d-487a-b97d-0345ab159e9f tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:36:32.694422 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-0b97281c-7f1d-487a-b97d-0345ab159e9f tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:36:32.695108 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-0b97281c-7f1d-487a-b97d-0345ab159e9f tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:36:32.695709 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-0b97281c-7f1d-487a-b97d-0345ab159e9f tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:36:32.712883 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0b97281c-7f1d-487a-b97d-0345ab159e9f tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:32.714156 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0b97281c-7f1d-487a-b97d-0345ab159e9f tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:32.717751 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0b97281c-7f1d-487a-b97d-0345ab159e9f tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:32.719204 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0b97281c-7f1d-487a-b97d-0345ab159e9f tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:32.720901 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0b97281c-7f1d-487a-b97d-0345ab159e9f tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:32.727945 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0b97281c-7f1d-487a-b97d-0345ab159e9f tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:32.773470 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-0b97281c-7f1d-487a-b97d-0345ab159e9f tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Getting quotas for project 30b6df28ccc1404686c1df3d8df4a366. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:36:32.787489 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-0b97281c-7f1d-487a-b97d-0345ab159e9f tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Getting quotas for user 8dbfa195640841ed9ea72cfa654e2a0d and project 30b6df28ccc1404686c1df3d8df4a366. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:36:32.807758 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0b97281c-7f1d-487a-b97d-0345ab159e9f tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Going to run 1 instances... {{(pid=123002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:36:32.823112 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0b97281c-7f1d-487a-b97d-0345ab159e9f tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] [instance: 930b527f-b438-4dca-821a-c23a37020707] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:36:32.853657 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-bbe5f5cf-23fe-49da-9ec9-fe87d9e4ea4f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:32.865055 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-bbe5f5cf-23fe-49da-9ec9-fe87d9e4ea4f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035" status: 200 len: 1475 microversion: 2.1 time: 0.351789 Oct 04 18:36:32.865931 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1045/2189] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:32 2022] GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035 => generated 1475 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:32.886293 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-acd84acf-9759-4037-bf69-18f835244161 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:32.888117 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-acd84acf-9759-4037-bf69-18f835244161 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] [instance: c3a29732-fa0a-4dfd-8475-0f43e9bb0846] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:32.904674 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-acd84acf-9759-4037-bf69-18f835244161 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:32.907782 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-acd84acf-9759-4037-bf69-18f835244161 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:32.907782 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-acd84acf-9759-4037-bf69-18f835244161 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:32.907782 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-acd84acf-9759-4037-bf69-18f835244161 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:32.908277 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-acd84acf-9759-4037-bf69-18f835244161 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:32.908907 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-acd84acf-9759-4037-bf69-18f835244161 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:32.965637 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-acd84acf-9759-4037-bf69-18f835244161 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] [instance: c3a29732-fa0a-4dfd-8475-0f43e9bb0846] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:36:33.063754 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0b97281c-7f1d-487a-b97d-0345ab159e9f tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 1.795034 Oct 04 18:36:33.063754 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1145/2190] 10.222.0.20 () {62 vars in 1188 bytes} [Tue Oct 4 18:36:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1799 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 18:36:33.073682 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4f82628e-2f01-4895-82ee-4133cf3a2589 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:33.076780 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4f82628e-2f01-4895-82ee-4133cf3a2589 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] [instance: 930b527f-b438-4dca-821a-c23a37020707] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:33.218097 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4f82628e-2f01-4895-82ee-4133cf3a2589 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbfa195640841ed9ea72cfa654e2a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b6df28ccc1404686c1df3d8df4a366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:33.241234 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4f82628e-2f01-4895-82ee-4133cf3a2589 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dbfa195640841ed9ea72cfa654e2a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b6df28ccc1404686c1df3d8df4a366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:33.241234 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4f82628e-2f01-4895-82ee-4133cf3a2589 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dbfa195640841ed9ea72cfa654e2a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b6df28ccc1404686c1df3d8df4a366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:33.241234 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4f82628e-2f01-4895-82ee-4133cf3a2589 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] 10.222.0.20 "GET /compute/v2.1/servers/930b527f-b438-4dca-821a-c23a37020707" status: 200 len: 1261 microversion: 2.26 time: 0.167187 Oct 04 18:36:33.241234 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1146/2191] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:33 2022] GET /compute/v2.1/servers/930b527f-b438-4dca-821a-c23a37020707 => generated 1261 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:36:33.353916 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-995f630c-4007-4c68-823d-de9abfd6d823 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:33.361790 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-995f630c-4007-4c68-823d-de9abfd6d823 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: cd74aff9-f694-49f3-a1cc-2095b71cd9e5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:33.372780 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-995f630c-4007-4c68-823d-de9abfd6d823 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:33.374166 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-995f630c-4007-4c68-823d-de9abfd6d823 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:33.374791 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-995f630c-4007-4c68-823d-de9abfd6d823 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:33.376348 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-995f630c-4007-4c68-823d-de9abfd6d823 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:33.379514 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-995f630c-4007-4c68-823d-de9abfd6d823 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:33.380564 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-995f630c-4007-4c68-823d-de9abfd6d823 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:33.524469 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-acd84acf-9759-4037-bf69-18f835244161 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c3a29732-fa0a-4dfd-8475-0f43e9bb0846" status: 204 len: 0 microversion: 2.1 time: 0.651610 Oct 04 18:36:33.524469 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1046/2192] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:36:32 2022] DELETE /compute/v2.1/servers/c3a29732-fa0a-4dfd-8475-0f43e9bb0846 => generated 0 bytes in 654 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:36:33.530060 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-323e1b0b-7651-441a-9fb0-dc7b30744c68 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:33.530925 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-323e1b0b-7651-441a-9fb0-dc7b30744c68 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] [instance: c3a29732-fa0a-4dfd-8475-0f43e9bb0846] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:33.550476 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-323e1b0b-7651-441a-9fb0-dc7b30744c68 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:33.550972 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-323e1b0b-7651-441a-9fb0-dc7b30744c68 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:33.551406 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-323e1b0b-7651-441a-9fb0-dc7b30744c68 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:33.552138 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-323e1b0b-7651-441a-9fb0-dc7b30744c68 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:33.552595 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-323e1b0b-7651-441a-9fb0-dc7b30744c68 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:33.553017 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-323e1b0b-7651-441a-9fb0-dc7b30744c68 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:33.772337 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-995f630c-4007-4c68-823d-de9abfd6d823 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:33.781661 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-995f630c-4007-4c68-823d-de9abfd6d823 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:33.783428 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-995f630c-4007-4c68-823d-de9abfd6d823 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:33.784532 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-995f630c-4007-4c68-823d-de9abfd6d823 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5" status: 200 len: 1281 microversion: 2.25 time: 0.437979 Oct 04 18:36:33.790709 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1147/2193] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:33 2022] GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5 => generated 1281 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:36:33.890033 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-437231ba-f526-49f7-b98a-ecff7c2abd64 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:33.891322 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-437231ba-f526-49f7-b98a-ecff7c2abd64 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 3ead1560-9c23-48ad-a938-6b3179b70035] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:33.899320 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-437231ba-f526-49f7-b98a-ecff7c2abd64 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:33.903320 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-437231ba-f526-49f7-b98a-ecff7c2abd64 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:33.907356 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-437231ba-f526-49f7-b98a-ecff7c2abd64 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:33.907356 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-437231ba-f526-49f7-b98a-ecff7c2abd64 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:33.907356 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-437231ba-f526-49f7-b98a-ecff7c2abd64 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:33.907356 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-437231ba-f526-49f7-b98a-ecff7c2abd64 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:33.967294 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-323e1b0b-7651-441a-9fb0-dc7b30744c68 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81e50834114f0fa3cca4b0b9f8acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4650d613cb84018b92dc5d51486885e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:33.976302 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-323e1b0b-7651-441a-9fb0-dc7b30744c68 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] 10.222.0.20 "GET /compute/v2.1/servers/c3a29732-fa0a-4dfd-8475-0f43e9bb0846" status: 200 len: 1518 microversion: 2.1 time: 0.450951 Oct 04 18:36:33.979255 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1047/2194] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:33 2022] GET /compute/v2.1/servers/c3a29732-fa0a-4dfd-8475-0f43e9bb0846 => generated 1518 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:34.230272 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-437231ba-f526-49f7-b98a-ecff7c2abd64 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:34.250655 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-437231ba-f526-49f7-b98a-ecff7c2abd64 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035" status: 200 len: 1475 microversion: 2.1 time: 0.364174 Oct 04 18:36:34.258925 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1148/2195] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:33 2022] GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035 => generated 1475 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:36:34.271218 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a0bfe0f3-820f-444a-98aa-b27f8eb22712 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:34.271856 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a0bfe0f3-820f-444a-98aa-b27f8eb22712 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] [instance: 930b527f-b438-4dca-821a-c23a37020707] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:34.816669 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9048ff36-2d7f-4aad-8a90-70b5b97a8a2b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:34.818884 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9048ff36-2d7f-4aad-8a90-70b5b97a8a2b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: cd74aff9-f694-49f3-a1cc-2095b71cd9e5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:34.829989 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9048ff36-2d7f-4aad-8a90-70b5b97a8a2b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:34.834664 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9048ff36-2d7f-4aad-8a90-70b5b97a8a2b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:34.834664 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9048ff36-2d7f-4aad-8a90-70b5b97a8a2b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:34.834664 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9048ff36-2d7f-4aad-8a90-70b5b97a8a2b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:34.834664 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9048ff36-2d7f-4aad-8a90-70b5b97a8a2b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:34.842171 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9048ff36-2d7f-4aad-8a90-70b5b97a8a2b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:34.866300 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=100 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:34.942743 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a0bfe0f3-820f-444a-98aa-b27f8eb22712 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbfa195640841ed9ea72cfa654e2a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b6df28ccc1404686c1df3d8df4a366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:34.953098 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a0bfe0f3-820f-444a-98aa-b27f8eb22712 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dbfa195640841ed9ea72cfa654e2a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b6df28ccc1404686c1df3d8df4a366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:34.960843 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a0bfe0f3-820f-444a-98aa-b27f8eb22712 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dbfa195640841ed9ea72cfa654e2a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b6df28ccc1404686c1df3d8df4a366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:34.970539 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a0bfe0f3-820f-444a-98aa-b27f8eb22712 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] 10.222.0.20 "GET /compute/v2.1/servers/930b527f-b438-4dca-821a-c23a37020707" status: 200 len: 1261 microversion: 2.26 time: 0.707285 Oct 04 18:36:34.984580 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1048/2196] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:34 2022] GET /compute/v2.1/servers/930b527f-b438-4dca-821a-c23a37020707 => generated 1261 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:36:35.015773 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-50398652-134b-4d3f-b2a9-0839ae66f8ce tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:35.016948 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-50398652-134b-4d3f-b2a9-0839ae66f8ce tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] [instance: c3a29732-fa0a-4dfd-8475-0f43e9bb0846] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:35.023602 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-50398652-134b-4d3f-b2a9-0839ae66f8ce tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:35.024361 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-50398652-134b-4d3f-b2a9-0839ae66f8ce tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:35.024892 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-50398652-134b-4d3f-b2a9-0839ae66f8ce tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:35.025779 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-50398652-134b-4d3f-b2a9-0839ae66f8ce tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:35.026350 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-50398652-134b-4d3f-b2a9-0839ae66f8ce tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:35.026801 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-50398652-134b-4d3f-b2a9-0839ae66f8ce tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:35.294302 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9048ff36-2d7f-4aad-8a90-70b5b97a8a2b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:35.329709 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9048ff36-2d7f-4aad-8a90-70b5b97a8a2b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:35.331593 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9048ff36-2d7f-4aad-8a90-70b5b97a8a2b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:35.333268 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9048ff36-2d7f-4aad-8a90-70b5b97a8a2b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5" status: 200 len: 1476 microversion: 2.25 time: 0.523147 Oct 04 18:36:35.348336 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1149/2197] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:34 2022] GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5 => generated 1476 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:36:35.364663 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e4b3dd76-ad13-41f2-a3c0-d7d71cc21019 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:35.364663 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e4b3dd76-ad13-41f2-a3c0-d7d71cc21019 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 3ead1560-9c23-48ad-a938-6b3179b70035] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:35.368015 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e4b3dd76-ad13-41f2-a3c0-d7d71cc21019 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:35.368805 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e4b3dd76-ad13-41f2-a3c0-d7d71cc21019 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:35.369479 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e4b3dd76-ad13-41f2-a3c0-d7d71cc21019 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:35.370425 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e4b3dd76-ad13-41f2-a3c0-d7d71cc21019 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:35.371116 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e4b3dd76-ad13-41f2-a3c0-d7d71cc21019 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:35.371792 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e4b3dd76-ad13-41f2-a3c0-d7d71cc21019 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:35.497006 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-50398652-134b-4d3f-b2a9-0839ae66f8ce tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81e50834114f0fa3cca4b0b9f8acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4650d613cb84018b92dc5d51486885e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:35.507167 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-50398652-134b-4d3f-b2a9-0839ae66f8ce tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] 10.222.0.20 "GET /compute/v2.1/servers/c3a29732-fa0a-4dfd-8475-0f43e9bb0846" status: 200 len: 1518 microversion: 2.1 time: 0.507405 Oct 04 18:36:35.544943 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1049/2198] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:34 2022] GET /compute/v2.1/servers/c3a29732-fa0a-4dfd-8475-0f43e9bb0846 => generated 1518 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:36.088550 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e4b3dd76-ad13-41f2-a3c0-d7d71cc21019 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:36.105231 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e4b3dd76-ad13-41f2-a3c0-d7d71cc21019 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035" status: 200 len: 1475 microversion: 2.1 time: 0.751528 Oct 04 18:36:36.107594 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1150/2199] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:35 2022] GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035 => generated 1475 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:36.120488 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7a571928-2cd3-4ba8-90e3-25fe53304104 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:36.121447 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7a571928-2cd3-4ba8-90e3-25fe53304104 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] [instance: 930b527f-b438-4dca-821a-c23a37020707] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:36.139975 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7a571928-2cd3-4ba8-90e3-25fe53304104 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:36.141518 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7a571928-2cd3-4ba8-90e3-25fe53304104 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:36.142161 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7a571928-2cd3-4ba8-90e3-25fe53304104 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:36.143476 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7a571928-2cd3-4ba8-90e3-25fe53304104 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:36.144165 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7a571928-2cd3-4ba8-90e3-25fe53304104 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:36.144795 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7a571928-2cd3-4ba8-90e3-25fe53304104 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:36.239701 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0e85685a-ce3d-47ae-8de4-7073adc334ab tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:36.240493 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0e85685a-ce3d-47ae-8de4-7073adc334ab tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] [instance: cd74aff9-f694-49f3-a1cc-2095b71cd9e5] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:36.252146 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0e85685a-ce3d-47ae-8de4-7073adc334ab tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:36.258903 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0e85685a-ce3d-47ae-8de4-7073adc334ab tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:36.263262 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0e85685a-ce3d-47ae-8de4-7073adc334ab tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:36.270745 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0e85685a-ce3d-47ae-8de4-7073adc334ab tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:36.271790 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0e85685a-ce3d-47ae-8de4-7073adc334ab tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:36.275807 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0e85685a-ce3d-47ae-8de4-7073adc334ab tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:36.399702 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7a571928-2cd3-4ba8-90e3-25fe53304104 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbfa195640841ed9ea72cfa654e2a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b6df28ccc1404686c1df3d8df4a366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:36.418548 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7a571928-2cd3-4ba8-90e3-25fe53304104 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dbfa195640841ed9ea72cfa654e2a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b6df28ccc1404686c1df3d8df4a366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:36.420099 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7a571928-2cd3-4ba8-90e3-25fe53304104 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dbfa195640841ed9ea72cfa654e2a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b6df28ccc1404686c1df3d8df4a366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:36.427785 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7a571928-2cd3-4ba8-90e3-25fe53304104 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] 10.222.0.20 "GET /compute/v2.1/servers/930b527f-b438-4dca-821a-c23a37020707" status: 200 len: 1257 microversion: 2.26 time: 0.311463 Oct 04 18:36:36.432502 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1151/2200] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:36 2022] GET /compute/v2.1/servers/930b527f-b438-4dca-821a-c23a37020707 => generated 1257 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:36:36.547790 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-dc305fd1-e6b7-471e-a16c-e3dbd760e439 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:36.548863 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-dc305fd1-e6b7-471e-a16c-e3dbd760e439 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] [instance: c3a29732-fa0a-4dfd-8475-0f43e9bb0846] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:36.590977 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dc305fd1-e6b7-471e-a16c-e3dbd760e439 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:36.591687 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dc305fd1-e6b7-471e-a16c-e3dbd760e439 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:36.595741 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dc305fd1-e6b7-471e-a16c-e3dbd760e439 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:36.597052 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dc305fd1-e6b7-471e-a16c-e3dbd760e439 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:36.601137 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dc305fd1-e6b7-471e-a16c-e3dbd760e439 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:36.615948 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dc305fd1-e6b7-471e-a16c-e3dbd760e439 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:36.649538 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-0e85685a-ce3d-47ae-8de4-7073adc334ab tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lazy-loading 'services' on Instance uuid cd74aff9-f694-49f3-a1cc-2095b71cd9e5 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:36:36.680096 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0e85685a-ce3d-47ae-8de4-7073adc334ab tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5" status: 200 len: 1971 microversion: 2.25 time: 1.133613 Oct 04 18:36:36.681785 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1050/2201] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:35 2022] GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5 => generated 1971 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:36:36.689878 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d7385343-4a86-49cd-b2a7-563a555955ff tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-334491754", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": [{"uuid": "634efda8-ef22-4052-a226-cd36c9333eef"}, {"uuid": "9f778c61-9ef6-4a34-9ffb-2f747415b9ef"}]}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:36.779899 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.neutron [None req-d7385343-4a86-49cd-b2a7-563a555955ff tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] validate_networks() for [('634efda8-ef22-4052-a226-cd36c9333eef', None, None, None, None, None), ('9f778c61-9ef6-4a34-9ffb-2f747415b9ef', None, None, None, None, None)] {{(pid=123001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:36:36.993782 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-dc305fd1-e6b7-471e-a16c-e3dbd760e439 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81e50834114f0fa3cca4b0b9f8acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4650d613cb84018b92dc5d51486885e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:37.007209 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-dc305fd1-e6b7-471e-a16c-e3dbd760e439 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] 10.222.0.20 "GET /compute/v2.1/servers/c3a29732-fa0a-4dfd-8475-0f43e9bb0846" status: 200 len: 1518 microversion: 2.1 time: 0.466616 Oct 04 18:36:37.030846 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1152/2202] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:36 2022] GET /compute/v2.1/servers/c3a29732-fa0a-4dfd-8475-0f43e9bb0846 => generated 1518 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:36:37.033692 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=10 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:37.042323 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ca443e08-49bc-4fbc-bbe7-1bc9e65e786e tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:37.043638 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ca443e08-49bc-4fbc-bbe7-1bc9e65e786e tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] [instance: cd74aff9-f694-49f3-a1cc-2095b71cd9e5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:37.064889 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ca443e08-49bc-4fbc-bbe7-1bc9e65e786e tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:37.072126 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ca443e08-49bc-4fbc-bbe7-1bc9e65e786e tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:37.072694 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ca443e08-49bc-4fbc-bbe7-1bc9e65e786e tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:37.078275 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ca443e08-49bc-4fbc-bbe7-1bc9e65e786e tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:37.083532 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ca443e08-49bc-4fbc-bbe7-1bc9e65e786e tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:37.083990 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ca443e08-49bc-4fbc-bbe7-1bc9e65e786e tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:37.378482 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-ca443e08-49bc-4fbc-bbe7-1bc9e65e786e tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lazy-loading 'services' on Instance uuid cd74aff9-f694-49f3-a1cc-2095b71cd9e5 {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:36:37.404146 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ca443e08-49bc-4fbc-bbe7-1bc9e65e786e tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5" status: 200 len: 1971 microversion: 2.25 time: 0.377546 Oct 04 18:36:37.405654 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1153/2203] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:37 2022] GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5 => generated 1971 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:36:37.417154 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3a1e8b07-323e-40be-84e8-0235b95d4bde tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:37.418737 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3a1e8b07-323e-40be-84e8-0235b95d4bde tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 3ead1560-9c23-48ad-a938-6b3179b70035] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:37.427460 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3a1e8b07-323e-40be-84e8-0235b95d4bde tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:37.432429 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3a1e8b07-323e-40be-84e8-0235b95d4bde tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:37.433096 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3a1e8b07-323e-40be-84e8-0235b95d4bde tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:37.434054 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3a1e8b07-323e-40be-84e8-0235b95d4bde tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:37.434768 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3a1e8b07-323e-40be-84e8-0235b95d4bde tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:37.435386 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3a1e8b07-323e-40be-84e8-0235b95d4bde tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:37.966279 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3a1e8b07-323e-40be-84e8-0235b95d4bde tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:37.978790 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3a1e8b07-323e-40be-84e8-0235b95d4bde tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035" status: 200 len: 1475 microversion: 2.1 time: 0.569217 Oct 04 18:36:37.978790 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1154/2204] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:37 2022] GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035 => generated 1475 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:37.987456 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-fedea8e2-90ac-4ef4-ba91-9e1934e266da req-8fadc510-a102-4479-a576-66c321961f39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3a29732-fa0a-4dfd-8475-0f43e9bb0846", "name": "network-vif-deleted", "tag": "fba0321b-163f-45c1-8bb6-a7e8f98924cc"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:38.004387 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-fedea8e2-90ac-4ef4-ba91-9e1934e266da req-8fadc510-a102-4479-a576-66c321961f39 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:38.004863 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-fedea8e2-90ac-4ef4-ba91-9e1934e266da req-8fadc510-a102-4479-a576-66c321961f39 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:38.005537 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-fedea8e2-90ac-4ef4-ba91-9e1934e266da req-8fadc510-a102-4479-a576-66c321961f39 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:38.017993 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-fedea8e2-90ac-4ef4-ba91-9e1934e266da req-8fadc510-a102-4479-a576-66c321961f39 service nova] Creating event network-vif-deleted:fba0321b-163f-45c1-8bb6-a7e8f98924cc for instance c3a29732-fa0a-4dfd-8475-0f43e9bb0846 on n-h1-850501-14 Oct 04 18:36:38.024941 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-fedea8e2-90ac-4ef4-ba91-9e1934e266da req-8fadc510-a102-4479-a576-66c321961f39 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046267 Oct 04 18:36:38.026529 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1155/2205] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:36:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:36:38.042416 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3cf99bfc-e0fb-49cd-9199-312651a3e903 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:38.050625 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3cf99bfc-e0fb-49cd-9199-312651a3e903 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:38.051725 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3cf99bfc-e0fb-49cd-9199-312651a3e903 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:38.052533 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3cf99bfc-e0fb-49cd-9199-312651a3e903 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:38.053465 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3cf99bfc-e0fb-49cd-9199-312651a3e903 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:38.054304 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3cf99bfc-e0fb-49cd-9199-312651a3e903 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:38.054902 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3cf99bfc-e0fb-49cd-9199-312651a3e903 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:38.127376 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3cf99bfc-e0fb-49cd-9199-312651a3e903 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.098604 Oct 04 18:36:38.129402 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1156/2206] 10.222.0.20 () {60 vars in 1217 bytes} [Tue Oct 4 18:36:38 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:36:38.135338 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4152d639-a0b0-4364-a3b5-faae7c21848e tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:38.140283 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4152d639-a0b0-4364-a3b5-faae7c21848e tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] [instance: 930b527f-b438-4dca-821a-c23a37020707] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:38.159876 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4152d639-a0b0-4364-a3b5-faae7c21848e tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:38.160794 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4152d639-a0b0-4364-a3b5-faae7c21848e tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:38.163384 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4152d639-a0b0-4364-a3b5-faae7c21848e tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:38.166125 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4152d639-a0b0-4364-a3b5-faae7c21848e tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:38.168159 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4152d639-a0b0-4364-a3b5-faae7c21848e tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:38.170231 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4152d639-a0b0-4364-a3b5-faae7c21848e tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:38.362256 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4152d639-a0b0-4364-a3b5-faae7c21848e tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbfa195640841ed9ea72cfa654e2a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b6df28ccc1404686c1df3d8df4a366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:38.372244 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4152d639-a0b0-4364-a3b5-faae7c21848e tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dbfa195640841ed9ea72cfa654e2a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b6df28ccc1404686c1df3d8df4a366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:38.374008 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4152d639-a0b0-4364-a3b5-faae7c21848e tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dbfa195640841ed9ea72cfa654e2a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b6df28ccc1404686c1df3d8df4a366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:38.376417 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4152d639-a0b0-4364-a3b5-faae7c21848e tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] 10.222.0.20 "GET /compute/v2.1/servers/930b527f-b438-4dca-821a-c23a37020707" status: 200 len: 1321 microversion: 2.26 time: 0.245177 Oct 04 18:36:38.377827 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1157/2207] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:38 2022] GET /compute/v2.1/servers/930b527f-b438-4dca-821a-c23a37020707 => generated 1321 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:36:38.382972 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ebcbfc87-d427-429a-8684-47041b50ccc8 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:38.383593 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ebcbfc87-d427-429a-8684-47041b50ccc8 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] [instance: c3a29732-fa0a-4dfd-8475-0f43e9bb0846] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:38.400860 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ebcbfc87-d427-429a-8684-47041b50ccc8 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:38.401810 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ebcbfc87-d427-429a-8684-47041b50ccc8 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:38.402266 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ebcbfc87-d427-429a-8684-47041b50ccc8 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:38.402964 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ebcbfc87-d427-429a-8684-47041b50ccc8 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:38.403419 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ebcbfc87-d427-429a-8684-47041b50ccc8 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:38.403843 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ebcbfc87-d427-429a-8684-47041b50ccc8 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:38.442961 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ebcbfc87-d427-429a-8684-47041b50ccc8 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:38.443454 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ebcbfc87-d427-429a-8684-47041b50ccc8 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:38.444010 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ebcbfc87-d427-429a-8684-47041b50ccc8 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:38.445536 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-ebcbfc87-d427-429a-8684-47041b50ccc8 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lazy-loading 'fault' on Instance uuid c3a29732-fa0a-4dfd-8475-0f43e9bb0846 {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:36:38.509832 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-d7385343-4a86-49cd-b2a7-563a555955ff tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:36:38.511366 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-d7385343-4a86-49cd-b2a7-563a555955ff tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:36:38.511875 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-d7385343-4a86-49cd-b2a7-563a555955ff tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:36:38.512338 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-d7385343-4a86-49cd-b2a7-563a555955ff tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:36:38.512762 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-d7385343-4a86-49cd-b2a7-563a555955ff tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:36:38.534061 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d7385343-4a86-49cd-b2a7-563a555955ff tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:38.534758 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d7385343-4a86-49cd-b2a7-563a555955ff tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:38.535380 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d7385343-4a86-49cd-b2a7-563a555955ff tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:38.536316 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d7385343-4a86-49cd-b2a7-563a555955ff tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:38.538110 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d7385343-4a86-49cd-b2a7-563a555955ff tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:38.538811 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d7385343-4a86-49cd-b2a7-563a555955ff tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:38.559525 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ebcbfc87-d427-429a-8684-47041b50ccc8 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81e50834114f0fa3cca4b0b9f8acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4650d613cb84018b92dc5d51486885e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:38.571522 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-d7385343-4a86-49cd-b2a7-563a555955ff tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Getting quotas for project c3242afeef424d588cf102a2f0f38020. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:36:38.573310 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ebcbfc87-d427-429a-8684-47041b50ccc8 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] 10.222.0.20 "GET /compute/v2.1/servers/c3a29732-fa0a-4dfd-8475-0f43e9bb0846" status: 200 len: 1311 microversion: 2.1 time: 0.193965 Oct 04 18:36:38.574378 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1158/2208] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:38 2022] GET /compute/v2.1/servers/c3a29732-fa0a-4dfd-8475-0f43e9bb0846 => generated 1311 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:38.579147 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-d7385343-4a86-49cd-b2a7-563a555955ff tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Getting quotas for user acb44381220d43b7bdfa744a1dc410a8 and project c3242afeef424d588cf102a2f0f38020. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:36:38.594593 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8ae4ac7e-5c1e-47b0-b85e-c39982371bb9 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-850501-14", "block_migration": "auto"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:38.598847 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8ae4ac7e-5c1e-47b0-b85e-c39982371bb9 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] [instance: cd74aff9-f694-49f3-a1cc-2095b71cd9e5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:38.602714 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d7385343-4a86-49cd-b2a7-563a555955ff tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Going to run 1 instances... {{(pid=123001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:36:38.605626 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d7385343-4a86-49cd-b2a7-563a555955ff tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] [instance: 616e21b9-c93b-4ff0-8740-24c613f4d708] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:36:38.897018 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8ae4ac7e-5c1e-47b0-b85e-c39982371bb9 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:38.897018 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8ae4ac7e-5c1e-47b0-b85e-c39982371bb9 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:38.897018 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8ae4ac7e-5c1e-47b0-b85e-c39982371bb9 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:38.897018 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8ae4ac7e-5c1e-47b0-b85e-c39982371bb9 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:38.897018 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8ae4ac7e-5c1e-47b0-b85e-c39982371bb9 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:38.897018 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8ae4ac7e-5c1e-47b0-b85e-c39982371bb9 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:38.897018 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-8ae4ac7e-5c1e-47b0-b85e-c39982371bb9 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lazy-loading 'flavor' on Instance uuid cd74aff9-f694-49f3-a1cc-2095b71cd9e5 {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:36:38.897018 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8ae4ac7e-5c1e-47b0-b85e-c39982371bb9 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] [instance: cd74aff9-f694-49f3-a1cc-2095b71cd9e5] Going to try to live migrate instance to n-h1-850501-14 {{(pid=123002) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 18:36:38.905126 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d7385343-4a86-49cd-b2a7-563a555955ff tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.221860 Oct 04 18:36:38.906983 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1051/2209] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:36:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 2224 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:36:38.934516 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-619c8947-72d9-44b7-8885-2e4e3db701cd tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:38.935525 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-619c8947-72d9-44b7-8885-2e4e3db701cd tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] [instance: 616e21b9-c93b-4ff0-8740-24c613f4d708] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:39.039107 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-619c8947-72d9-44b7-8885-2e4e3db701cd tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb44381220d43b7bdfa744a1dc410a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3242afeef424d588cf102a2f0f38020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:39.050096 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-619c8947-72d9-44b7-8885-2e4e3db701cd tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] 10.222.0.20 "GET /compute/v2.1/servers/616e21b9-c93b-4ff0-8740-24c613f4d708" status: 200 len: 1212 microversion: 2.1 time: 0.123596 Oct 04 18:36:39.051004 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1052/2210] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:38 2022] GET /compute/v2.1/servers/616e21b9-c93b-4ff0-8740-24c613f4d708 => generated 1212 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:39.056681 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-04083e5b-8fdd-4338-9701-5fd4c2de0054 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:39.057566 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-04083e5b-8fdd-4338-9701-5fd4c2de0054 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 3ead1560-9c23-48ad-a938-6b3179b70035] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:39.075565 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-04083e5b-8fdd-4338-9701-5fd4c2de0054 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:39.076208 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-04083e5b-8fdd-4338-9701-5fd4c2de0054 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:39.076940 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-04083e5b-8fdd-4338-9701-5fd4c2de0054 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:39.078630 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-04083e5b-8fdd-4338-9701-5fd4c2de0054 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:39.079202 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-04083e5b-8fdd-4338-9701-5fd4c2de0054 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:39.080083 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-04083e5b-8fdd-4338-9701-5fd4c2de0054 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:39.279144 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-04083e5b-8fdd-4338-9701-5fd4c2de0054 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:39.289757 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-04083e5b-8fdd-4338-9701-5fd4c2de0054 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035" status: 200 len: 1475 microversion: 2.1 time: 0.237264 Oct 04 18:36:39.310155 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1053/2211] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:39 2022] GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035 => generated 1475 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:39.403685 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f9aee354-1820-4839-af41-3197f5e071aa tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:39.404643 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f9aee354-1820-4839-af41-3197f5e071aa tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] [instance: 930b527f-b438-4dca-821a-c23a37020707] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:39.424298 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f9aee354-1820-4839-af41-3197f5e071aa tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:39.425074 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f9aee354-1820-4839-af41-3197f5e071aa tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:39.425663 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f9aee354-1820-4839-af41-3197f5e071aa tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:39.426719 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f9aee354-1820-4839-af41-3197f5e071aa tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:39.427325 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f9aee354-1820-4839-af41-3197f5e071aa tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:39.428046 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f9aee354-1820-4839-af41-3197f5e071aa tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:40.057749 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f9aee354-1820-4839-af41-3197f5e071aa tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbfa195640841ed9ea72cfa654e2a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b6df28ccc1404686c1df3d8df4a366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:40.077006 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f9aee354-1820-4839-af41-3197f5e071aa tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dbfa195640841ed9ea72cfa654e2a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b6df28ccc1404686c1df3d8df4a366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:40.079207 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f9aee354-1820-4839-af41-3197f5e071aa tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dbfa195640841ed9ea72cfa654e2a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b6df28ccc1404686c1df3d8df4a366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:40.080633 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f9aee354-1820-4839-af41-3197f5e071aa tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] 10.222.0.20 "GET /compute/v2.1/servers/930b527f-b438-4dca-821a-c23a37020707" status: 200 len: 1361 microversion: 2.26 time: 0.681701 Oct 04 18:36:40.081796 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1054/2212] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:39 2022] GET /compute/v2.1/servers/930b527f-b438-4dca-821a-c23a37020707 => generated 1361 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:36:40.087696 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-713cc812-b2ef-41ac-bcb2-680739d8ecb0 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:40.091561 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-713cc812-b2ef-41ac-bcb2-680739d8ecb0 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] [instance: c3a29732-fa0a-4dfd-8475-0f43e9bb0846] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:40.101879 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-713cc812-b2ef-41ac-bcb2-680739d8ecb0 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:40.102783 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-713cc812-b2ef-41ac-bcb2-680739d8ecb0 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:40.103428 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-713cc812-b2ef-41ac-bcb2-680739d8ecb0 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:40.104543 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-713cc812-b2ef-41ac-bcb2-680739d8ecb0 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:40.105313 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-713cc812-b2ef-41ac-bcb2-680739d8ecb0 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:40.105948 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-713cc812-b2ef-41ac-bcb2-680739d8ecb0 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:40.131073 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-713cc812-b2ef-41ac-bcb2-680739d8ecb0 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] HTTP exception thrown: Instance c3a29732-fa0a-4dfd-8475-0f43e9bb0846 could not be found. Oct 04 18:36:40.134354 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-713cc812-b2ef-41ac-bcb2-680739d8ecb0 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Request method failure captured: Oct 04 18:36:40.134354 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/c3a29732-fa0a-4dfd-8475-0f43e9bb0846 HTTP/1.1 Oct 04 18:36:40.134354 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:36:40.134354 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:36:40.134354 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:36:40.134354 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:36:40.134354 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:36:40.134354 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:36:40.134354 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:36:40.134354 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:36:40.134354 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPHzJ9xbn_MCsyek9o_Q4LQpZokiYpLBfypHoz6lM5WZ91e8BRnanSFM1UoaGYc6aZox7FJxW4z7S9fN-1iYG3vh7CbZ3kFwCrOl7E4QN7WJje0fTrRhEik-56-AcKNDjSFDbGVTZ3v2H_5nxHmdRwbBAPblCZtWqyZjupQ0Rkijcahk Oct 04 18:36:40.134354 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:36:40.134354 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:36:40.134354 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:36:40.134354 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:36:40.134354 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:36:40.134354 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:36:40.134354 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: d4650d613cb84018b92dc5d51486885e Oct 04 18:36:40.134354 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ListServerFiltersTestJSON-888884125 Oct 04 18:36:40.134354 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:36:40.134354 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:36:40.134354 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d4650d613cb84018b92dc5d51486885e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d4650d613cb84018b92dc5d51486885e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d4650d613cb84018b92dc5d51486885e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d4650d613cb84018b92dc5d51486885e"}]}] Oct 04 18:36:40.134354 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ListServerFiltersTestJSON-888884125 Oct 04 18:36:40.134354 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: d4650d613cb84018b92dc5d51486885e Oct 04 18:36:40.134354 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-888884125 Oct 04 18:36:40.134354 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ListServerFiltersTestJSON-888884125-project Oct 04 18:36:40.134354 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:36:40.134354 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:36:40.134354 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 6a81e50834114f0fa3cca4b0b9f8acf1 Oct 04 18:36:40.134354 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ListServerFiltersTestJSON-888884125-project Oct 04 18:36:40.134354 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:36:40.134354 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance c3a29732-fa0a-4dfd-8475-0f43e9bb0846 could not be found. Oct 04 18:36:40.134354 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': 'c3a29732-fa0a-4dfd-8475-0f43e9bb0846'} Oct 04 18:36:40.134354 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:36:40.134354 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:40.134354 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:36:40.134354 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:36:40.134354 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:36:40.134354 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:36:40.134354 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:36:40.134354 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:36:40.134354 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:36:40.134354 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:36:40.134354 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3a29732-fa0a-4dfd-8475-0f43e9bb0846 could not be found. Oct 04 18:36:40.134354 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:36:40.134354 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:40.134354 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:36:40.134354 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:40.134354 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:40.134354 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:40.134354 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:36:40.134354 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:36:40.134354 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:36:40.134354 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:36:40.134354 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:36:40.134354 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:36:40.134354 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:36:40.134354 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:36:40.134354 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:36:40.134354 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:36:40.134354 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3a29732-fa0a-4dfd-8475-0f43e9bb0846 could not be found. Oct 04 18:36:40.134354 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:36:40.134354 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:40.134354 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:36:40.138012 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:40.138012 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:40.138012 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:40.138012 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:36:40.138012 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:36:40.138012 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3a29732-fa0a-4dfd-8475-0f43e9bb0846 could not be found. Oct 04 18:36:40.138012 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:36:40.140738 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-713cc812-b2ef-41ac-bcb2-680739d8ecb0 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] Returning 404 to user: Instance c3a29732-fa0a-4dfd-8475-0f43e9bb0846 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:36:40.141822 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-713cc812-b2ef-41ac-bcb2-680739d8ecb0 tempest-ListServerFiltersTestJSON-888884125 tempest-ListServerFiltersTestJSON-888884125-project] 10.222.0.20 "GET /compute/v2.1/servers/c3a29732-fa0a-4dfd-8475-0f43e9bb0846" status: 404 len: 111 microversion: 2.1 time: 0.058614 Oct 04 18:36:40.142415 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1055/2213] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:40 2022] GET /compute/v2.1/servers/c3a29732-fa0a-4dfd-8475-0f43e9bb0846 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:36:40.151334 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b009cefd-8061-45d4-9f79-12ce737a82d6 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:40.151961 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b009cefd-8061-45d4-9f79-12ce737a82d6 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] [instance: 616e21b9-c93b-4ff0-8740-24c613f4d708] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:40.380788 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b009cefd-8061-45d4-9f79-12ce737a82d6 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb44381220d43b7bdfa744a1dc410a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3242afeef424d588cf102a2f0f38020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:40.408221 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b009cefd-8061-45d4-9f79-12ce737a82d6 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] 10.222.0.20 "GET /compute/v2.1/servers/616e21b9-c93b-4ff0-8740-24c613f4d708" status: 200 len: 1212 microversion: 2.1 time: 0.248049 Oct 04 18:36:40.408221 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1056/2214] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:40 2022] GET /compute/v2.1/servers/616e21b9-c93b-4ff0-8740-24c613f4d708 => generated 1212 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:40.410952 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-088e61da-c776-451e-93b3-94987e8f9e00 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:40.413693 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-088e61da-c776-451e-93b3-94987e8f9e00 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 3ead1560-9c23-48ad-a938-6b3179b70035] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:40.425600 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:40.456799 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-088e61da-c776-451e-93b3-94987e8f9e00 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:40.457389 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-088e61da-c776-451e-93b3-94987e8f9e00 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:40.457830 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-088e61da-c776-451e-93b3-94987e8f9e00 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:40.458536 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-088e61da-c776-451e-93b3-94987e8f9e00 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:40.461136 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-088e61da-c776-451e-93b3-94987e8f9e00 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:40.462560 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-088e61da-c776-451e-93b3-94987e8f9e00 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:40.910331 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-088e61da-c776-451e-93b3-94987e8f9e00 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:40.926061 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-088e61da-c776-451e-93b3-94987e8f9e00 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035" status: 200 len: 1475 microversion: 2.1 time: 0.528107 Oct 04 18:36:40.941591 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1057/2215] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:40 2022] GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035 => generated 1475 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:41.112614 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4d6a683d-9666-46e0-a991-38ca14411e7c tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:41.114438 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-4d6a683d-9666-46e0-a991-38ca14411e7c tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] [instance: 930b527f-b438-4dca-821a-c23a37020707] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:41.128962 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4d6a683d-9666-46e0-a991-38ca14411e7c tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:41.131703 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4d6a683d-9666-46e0-a991-38ca14411e7c tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:41.133920 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4d6a683d-9666-46e0-a991-38ca14411e7c tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:41.138683 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4d6a683d-9666-46e0-a991-38ca14411e7c tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:41.139413 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4d6a683d-9666-46e0-a991-38ca14411e7c tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:41.141466 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4d6a683d-9666-46e0-a991-38ca14411e7c tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:41.903504 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-4d6a683d-9666-46e0-a991-38ca14411e7c tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbfa195640841ed9ea72cfa654e2a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b6df28ccc1404686c1df3d8df4a366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:41.931582 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-4d6a683d-9666-46e0-a991-38ca14411e7c tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dbfa195640841ed9ea72cfa654e2a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b6df28ccc1404686c1df3d8df4a366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:41.933105 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-4d6a683d-9666-46e0-a991-38ca14411e7c tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dbfa195640841ed9ea72cfa654e2a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b6df28ccc1404686c1df3d8df4a366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:41.934284 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-4d6a683d-9666-46e0-a991-38ca14411e7c tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] 10.222.0.20 "GET /compute/v2.1/servers/930b527f-b438-4dca-821a-c23a37020707" status: 200 len: 1361 microversion: 2.26 time: 0.827453 Oct 04 18:36:41.940376 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1058/2216] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:41 2022] GET /compute/v2.1/servers/930b527f-b438-4dca-821a-c23a37020707 => generated 1361 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:36:41.949832 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-128db547-e24d-4f20-8107-3b8f2c25ef60 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:41.959844 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-128db547-e24d-4f20-8107-3b8f2c25ef60 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] [instance: 616e21b9-c93b-4ff0-8740-24c613f4d708] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:41.971237 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-128db547-e24d-4f20-8107-3b8f2c25ef60 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:41.972174 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-128db547-e24d-4f20-8107-3b8f2c25ef60 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:41.972851 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-128db547-e24d-4f20-8107-3b8f2c25ef60 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:41.974429 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-128db547-e24d-4f20-8107-3b8f2c25ef60 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:41.975110 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-128db547-e24d-4f20-8107-3b8f2c25ef60 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:41.975830 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-128db547-e24d-4f20-8107-3b8f2c25ef60 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:42.129674 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-128db547-e24d-4f20-8107-3b8f2c25ef60 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb44381220d43b7bdfa744a1dc410a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3242afeef424d588cf102a2f0f38020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:42.149019 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-128db547-e24d-4f20-8107-3b8f2c25ef60 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] 10.222.0.20 "GET /compute/v2.1/servers/616e21b9-c93b-4ff0-8740-24c613f4d708" status: 200 len: 1264 microversion: 2.1 time: 0.205950 Oct 04 18:36:42.160142 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1059/2217] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:41 2022] GET /compute/v2.1/servers/616e21b9-c93b-4ff0-8740-24c613f4d708 => generated 1264 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:42.180481 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6fb2aa8e-2561-485e-b3af-03129fede035 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:42.181461 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6fb2aa8e-2561-485e-b3af-03129fede035 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 3ead1560-9c23-48ad-a938-6b3179b70035] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:42.204837 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6fb2aa8e-2561-485e-b3af-03129fede035 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:42.205866 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6fb2aa8e-2561-485e-b3af-03129fede035 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:42.207203 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6fb2aa8e-2561-485e-b3af-03129fede035 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:42.210662 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6fb2aa8e-2561-485e-b3af-03129fede035 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:42.211269 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6fb2aa8e-2561-485e-b3af-03129fede035 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:42.213698 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6fb2aa8e-2561-485e-b3af-03129fede035 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:42.554425 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6fb2aa8e-2561-485e-b3af-03129fede035 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:42.574004 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6fb2aa8e-2561-485e-b3af-03129fede035 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035" status: 200 len: 1475 microversion: 2.1 time: 0.410294 Oct 04 18:36:42.576182 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1060/2218] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:42 2022] GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035 => generated 1475 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:42.912994 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-faf67045-07b3-4233-9e2d-e4a5aa33285c req-16e2fec2-9a11-404f-b705-00433d435c3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "930b527f-b438-4dca-821a-c23a37020707", "tag": "de4c1af8-905a-42e9-bbd4-87936a6c637a"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:42.928384 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-faf67045-07b3-4233-9e2d-e4a5aa33285c req-16e2fec2-9a11-404f-b705-00433d435c3d service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:42.929528 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-faf67045-07b3-4233-9e2d-e4a5aa33285c req-16e2fec2-9a11-404f-b705-00433d435c3d service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:42.930109 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-faf67045-07b3-4233-9e2d-e4a5aa33285c req-16e2fec2-9a11-404f-b705-00433d435c3d service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:42.945624 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-faf67045-07b3-4233-9e2d-e4a5aa33285c req-16e2fec2-9a11-404f-b705-00433d435c3d service nova] Creating event network-changed:de4c1af8-905a-42e9-bbd4-87936a6c637a for instance 930b527f-b438-4dca-821a-c23a37020707 on n-h1-850501-14 Oct 04 18:36:42.951451 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-faf67045-07b3-4233-9e2d-e4a5aa33285c req-16e2fec2-9a11-404f-b705-00433d435c3d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043062 Oct 04 18:36:42.957188 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1061/2219] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:36:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:36:42.971538 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a5073478-7b7f-4689-bde4-f1761215a686 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:42.972656 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a5073478-7b7f-4689-bde4-f1761215a686 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] [instance: 930b527f-b438-4dca-821a-c23a37020707] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:43.004032 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a5073478-7b7f-4689-bde4-f1761215a686 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:43.004577 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a5073478-7b7f-4689-bde4-f1761215a686 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:43.005019 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a5073478-7b7f-4689-bde4-f1761215a686 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:43.005984 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a5073478-7b7f-4689-bde4-f1761215a686 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:43.010253 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a5073478-7b7f-4689-bde4-f1761215a686 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:43.010253 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a5073478-7b7f-4689-bde4-f1761215a686 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:43.229185 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=8 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:43.362678 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a5073478-7b7f-4689-bde4-f1761215a686 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbfa195640841ed9ea72cfa654e2a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b6df28ccc1404686c1df3d8df4a366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:43.372558 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a5073478-7b7f-4689-bde4-f1761215a686 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dbfa195640841ed9ea72cfa654e2a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b6df28ccc1404686c1df3d8df4a366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:43.375863 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a5073478-7b7f-4689-bde4-f1761215a686 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dbfa195640841ed9ea72cfa654e2a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b6df28ccc1404686c1df3d8df4a366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:43.378706 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a5073478-7b7f-4689-bde4-f1761215a686 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] 10.222.0.20 "GET /compute/v2.1/servers/930b527f-b438-4dca-821a-c23a37020707" status: 200 len: 1361 microversion: 2.26 time: 0.412279 Oct 04 18:36:43.390633 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1062/2220] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:42 2022] GET /compute/v2.1/servers/930b527f-b438-4dca-821a-c23a37020707 => generated 1361 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:36:43.392208 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e2aeb0ba-01b2-4cac-84ca-caa9b62133dd tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:43.392927 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e2aeb0ba-01b2-4cac-84ca-caa9b62133dd tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] [instance: 616e21b9-c93b-4ff0-8740-24c613f4d708] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:43.398955 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e2aeb0ba-01b2-4cac-84ca-caa9b62133dd tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:43.399548 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e2aeb0ba-01b2-4cac-84ca-caa9b62133dd tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:43.400743 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e2aeb0ba-01b2-4cac-84ca-caa9b62133dd tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:43.401584 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e2aeb0ba-01b2-4cac-84ca-caa9b62133dd tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:43.402143 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e2aeb0ba-01b2-4cac-84ca-caa9b62133dd tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:43.402664 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e2aeb0ba-01b2-4cac-84ca-caa9b62133dd tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:43.588097 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e2aeb0ba-01b2-4cac-84ca-caa9b62133dd tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb44381220d43b7bdfa744a1dc410a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3242afeef424d588cf102a2f0f38020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:43.601633 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e2aeb0ba-01b2-4cac-84ca-caa9b62133dd tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] 10.222.0.20 "GET /compute/v2.1/servers/616e21b9-c93b-4ff0-8740-24c613f4d708" status: 200 len: 1264 microversion: 2.1 time: 0.216811 Oct 04 18:36:43.607318 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1063/2221] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:43 2022] GET /compute/v2.1/servers/616e21b9-c93b-4ff0-8740-24c613f4d708 => generated 1264 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:43.614792 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-861e67a9-9003-409a-958a-37bbe6010b52 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:43.618017 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-861e67a9-9003-409a-958a-37bbe6010b52 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 3ead1560-9c23-48ad-a938-6b3179b70035] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:43.628299 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-861e67a9-9003-409a-958a-37bbe6010b52 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:43.631328 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-861e67a9-9003-409a-958a-37bbe6010b52 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:43.635460 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-861e67a9-9003-409a-958a-37bbe6010b52 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:43.638428 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-861e67a9-9003-409a-958a-37bbe6010b52 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:43.639101 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-861e67a9-9003-409a-958a-37bbe6010b52 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:43.640580 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-861e67a9-9003-409a-958a-37bbe6010b52 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:43.650044 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:44.085445 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-861e67a9-9003-409a-958a-37bbe6010b52 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:44.094628 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-861e67a9-9003-409a-958a-37bbe6010b52 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035" status: 200 len: 1475 microversion: 2.1 time: 0.491009 Oct 04 18:36:44.103471 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1064/2222] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:43 2022] GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035 => generated 1475 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:44.407167 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5585b5fe-0286-4a2b-887b-d7ed66e317da tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:44.407946 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5585b5fe-0286-4a2b-887b-d7ed66e317da tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] [instance: 930b527f-b438-4dca-821a-c23a37020707] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:44.425950 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5585b5fe-0286-4a2b-887b-d7ed66e317da tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:44.426455 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5585b5fe-0286-4a2b-887b-d7ed66e317da tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:44.426898 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5585b5fe-0286-4a2b-887b-d7ed66e317da tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:44.427616 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5585b5fe-0286-4a2b-887b-d7ed66e317da tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:44.428098 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5585b5fe-0286-4a2b-887b-d7ed66e317da tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:44.442347 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5585b5fe-0286-4a2b-887b-d7ed66e317da tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:44.985149 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5585b5fe-0286-4a2b-887b-d7ed66e317da tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbfa195640841ed9ea72cfa654e2a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b6df28ccc1404686c1df3d8df4a366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:44.998783 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5585b5fe-0286-4a2b-887b-d7ed66e317da tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dbfa195640841ed9ea72cfa654e2a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b6df28ccc1404686c1df3d8df4a366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:45.002913 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5585b5fe-0286-4a2b-887b-d7ed66e317da tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dbfa195640841ed9ea72cfa654e2a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b6df28ccc1404686c1df3d8df4a366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:45.004920 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5585b5fe-0286-4a2b-887b-d7ed66e317da tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] 10.222.0.20 "GET /compute/v2.1/servers/930b527f-b438-4dca-821a-c23a37020707" status: 200 len: 1361 microversion: 2.26 time: 0.602961 Oct 04 18:36:45.005691 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1065/2223] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:44 2022] GET /compute/v2.1/servers/930b527f-b438-4dca-821a-c23a37020707 => generated 1361 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:36:45.043274 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2263f38f-1ab8-4a84-949b-2205062a951f tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:45.045195 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2263f38f-1ab8-4a84-949b-2205062a951f tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] [instance: 616e21b9-c93b-4ff0-8740-24c613f4d708] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:45.054041 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2263f38f-1ab8-4a84-949b-2205062a951f tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:45.054920 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2263f38f-1ab8-4a84-949b-2205062a951f tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:45.055549 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2263f38f-1ab8-4a84-949b-2205062a951f tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:45.056594 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2263f38f-1ab8-4a84-949b-2205062a951f tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:45.057448 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2263f38f-1ab8-4a84-949b-2205062a951f tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:45.058134 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2263f38f-1ab8-4a84-949b-2205062a951f tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:45.252278 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-2263f38f-1ab8-4a84-949b-2205062a951f tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb44381220d43b7bdfa744a1dc410a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3242afeef424d588cf102a2f0f38020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:45.265834 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2263f38f-1ab8-4a84-949b-2205062a951f tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] 10.222.0.20 "GET /compute/v2.1/servers/616e21b9-c93b-4ff0-8740-24c613f4d708" status: 200 len: 1270 microversion: 2.1 time: 0.226502 Oct 04 18:36:45.266232 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1066/2224] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:45 2022] GET /compute/v2.1/servers/616e21b9-c93b-4ff0-8740-24c613f4d708 => generated 1270 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:45.301800 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-adee9b56-886d-4158-b93c-8780908f79f0 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:45.302560 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-adee9b56-886d-4158-b93c-8780908f79f0 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 3ead1560-9c23-48ad-a938-6b3179b70035] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:45.327080 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-adee9b56-886d-4158-b93c-8780908f79f0 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:45.329462 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-adee9b56-886d-4158-b93c-8780908f79f0 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:45.331197 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-adee9b56-886d-4158-b93c-8780908f79f0 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:45.332780 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-adee9b56-886d-4158-b93c-8780908f79f0 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:45.335672 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-adee9b56-886d-4158-b93c-8780908f79f0 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:45.336386 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-adee9b56-886d-4158-b93c-8780908f79f0 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:46.049594 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-adee9b56-886d-4158-b93c-8780908f79f0 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:46.069743 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-adee9b56-886d-4158-b93c-8780908f79f0 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035" status: 200 len: 1474 microversion: 2.1 time: 0.782881 Oct 04 18:36:46.080594 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1067/2225] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:45 2022] GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035 => generated 1474 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:46.087435 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-dc2cd4ae-8368-4da4-b772-40fce7c2041f tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:46.087435 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-dc2cd4ae-8368-4da4-b772-40fce7c2041f tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] [instance: 930b527f-b438-4dca-821a-c23a37020707] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:46.107956 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dc2cd4ae-8368-4da4-b772-40fce7c2041f tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:46.109173 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dc2cd4ae-8368-4da4-b772-40fce7c2041f tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:46.109509 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dc2cd4ae-8368-4da4-b772-40fce7c2041f tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:46.112909 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dc2cd4ae-8368-4da4-b772-40fce7c2041f tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:46.115264 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dc2cd4ae-8368-4da4-b772-40fce7c2041f tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:46.116795 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dc2cd4ae-8368-4da4-b772-40fce7c2041f tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:46.325710 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8ae4ac7e-5c1e-47b0-b85e-c39982371bb9 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5/action" status: 202 len: 0 microversion: 2.25 time: 7.749869 Oct 04 18:36:46.327763 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1159/2226] 10.222.0.20 () {62 vars in 1319 bytes} [Tue Oct 4 18:36:38 2022] POST /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5/action => generated 0 bytes in 7753 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:36:46.333229 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-367d9a0f-5b2d-454d-81f8-cb0bb15c9e34 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1413815373", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "c77a0479-286d-44e4-a122-b4b514a72dc4"}], "block_device_mapping_v2": [{"uuid": "5d14b5e7-3091-446a-8387-f21c392e3e52", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:46.532964 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-367d9a0f-5b2d-454d-81f8-cb0bb15c9e34 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] validate_networks() for [('c77a0479-286d-44e4-a122-b4b514a72dc4', None, None, None, None, None)] {{(pid=123002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:36:47.277256 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-dc2cd4ae-8368-4da4-b772-40fce7c2041f tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbfa195640841ed9ea72cfa654e2a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b6df28ccc1404686c1df3d8df4a366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:47.298989 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-dc2cd4ae-8368-4da4-b772-40fce7c2041f tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dbfa195640841ed9ea72cfa654e2a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b6df28ccc1404686c1df3d8df4a366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:47.302609 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-dc2cd4ae-8368-4da4-b772-40fce7c2041f tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dbfa195640841ed9ea72cfa654e2a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b6df28ccc1404686c1df3d8df4a366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:47.305762 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-dc2cd4ae-8368-4da4-b772-40fce7c2041f tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] 10.222.0.20 "GET /compute/v2.1/servers/930b527f-b438-4dca-821a-c23a37020707" status: 200 len: 1361 microversion: 2.26 time: 1.233360 Oct 04 18:36:47.306358 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1068/2227] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:46 2022] GET /compute/v2.1/servers/930b527f-b438-4dca-821a-c23a37020707 => generated 1361 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:36:47.316782 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-251eaf55-7128-4efb-974b-d14f885c9af5 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:47.319983 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-251eaf55-7128-4efb-974b-d14f885c9af5 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] [instance: 616e21b9-c93b-4ff0-8740-24c613f4d708] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:47.339829 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-251eaf55-7128-4efb-974b-d14f885c9af5 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:47.343638 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-251eaf55-7128-4efb-974b-d14f885c9af5 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:47.344119 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-251eaf55-7128-4efb-974b-d14f885c9af5 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:47.348963 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-251eaf55-7128-4efb-974b-d14f885c9af5 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:47.349545 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-251eaf55-7128-4efb-974b-d14f885c9af5 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:47.350058 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-251eaf55-7128-4efb-974b-d14f885c9af5 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:47.486623 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-251eaf55-7128-4efb-974b-d14f885c9af5 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb44381220d43b7bdfa744a1dc410a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3242afeef424d588cf102a2f0f38020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:47.498557 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-251eaf55-7128-4efb-974b-d14f885c9af5 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] 10.222.0.20 "GET /compute/v2.1/servers/616e21b9-c93b-4ff0-8740-24c613f4d708" status: 200 len: 1270 microversion: 2.1 time: 0.188242 Oct 04 18:36:47.499882 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1069/2228] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:47 2022] GET /compute/v2.1/servers/616e21b9-c93b-4ff0-8740-24c613f4d708 => generated 1270 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:47.522616 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f0634d4f-cfae-4389-a4b9-c43eb21c0968 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:47.528241 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f0634d4f-cfae-4389-a4b9-c43eb21c0968 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: cd74aff9-f694-49f3-a1cc-2095b71cd9e5] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:47.546866 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f0634d4f-cfae-4389-a4b9-c43eb21c0968 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:47.551003 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f0634d4f-cfae-4389-a4b9-c43eb21c0968 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:47.551003 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f0634d4f-cfae-4389-a4b9-c43eb21c0968 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:47.551899 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f0634d4f-cfae-4389-a4b9-c43eb21c0968 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:47.553132 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f0634d4f-cfae-4389-a4b9-c43eb21c0968 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:47.555194 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f0634d4f-cfae-4389-a4b9-c43eb21c0968 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:48.086085 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=6 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:48.145591 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f0634d4f-cfae-4389-a4b9-c43eb21c0968 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:48.158501 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f0634d4f-cfae-4389-a4b9-c43eb21c0968 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:48.164402 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f0634d4f-cfae-4389-a4b9-c43eb21c0968 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:48.168342 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f0634d4f-cfae-4389-a4b9-c43eb21c0968 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5" status: 200 len: 1486 microversion: 2.25 time: 0.655452 Oct 04 18:36:48.168342 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1070/2229] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:47 2022] GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5 => generated 1486 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:36:48.175682 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-ee3e508c-8582-44ea-8b45-4d1764b2d046 req-fef33711-6685-48ba-a38c-7b2a513314c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ead1560-9c23-48ad-a938-6b3179b70035", "name": "network-vif-unplugged", "status": "completed", "tag": "7d8819bd-e6dc-4ea2-a722-7f903297fff8"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:48.201901 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-ee3e508c-8582-44ea-8b45-4d1764b2d046 req-fef33711-6685-48ba-a38c-7b2a513314c1 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:48.203217 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-ee3e508c-8582-44ea-8b45-4d1764b2d046 req-fef33711-6685-48ba-a38c-7b2a513314c1 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:48.204499 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-ee3e508c-8582-44ea-8b45-4d1764b2d046 req-fef33711-6685-48ba-a38c-7b2a513314c1 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:48.242382 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-ee3e508c-8582-44ea-8b45-4d1764b2d046 req-fef33711-6685-48ba-a38c-7b2a513314c1 service nova] Creating event network-vif-unplugged:7d8819bd-e6dc-4ea2-a722-7f903297fff8 for instance 3ead1560-9c23-48ad-a938-6b3179b70035 on n-h1-850501-14 Oct 04 18:36:48.257624 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [req-ee3e508c-8582-44ea-8b45-4d1764b2d046 req-fef33711-6685-48ba-a38c-7b2a513314c1 service nova] Instance 3ead1560-9c23-48ad-a938-6b3179b70035 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850501-14'} {{(pid=123001) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:36:48.271401 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-ee3e508c-8582-44ea-8b45-4d1764b2d046 req-fef33711-6685-48ba-a38c-7b2a513314c1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.102706 Oct 04 18:36:48.276285 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1071/2230] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:36:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:36:48.289076 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-bc2cf59e-bc8a-498a-a362-9b0d075fcd97 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:48.290485 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-bc2cf59e-bc8a-498a-a362-9b0d075fcd97 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 3ead1560-9c23-48ad-a938-6b3179b70035] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:48.306704 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bc2cf59e-bc8a-498a-a362-9b0d075fcd97 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:48.311110 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bc2cf59e-bc8a-498a-a362-9b0d075fcd97 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:48.311110 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bc2cf59e-bc8a-498a-a362-9b0d075fcd97 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:48.311110 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bc2cf59e-bc8a-498a-a362-9b0d075fcd97 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:48.312341 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bc2cf59e-bc8a-498a-a362-9b0d075fcd97 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:48.314167 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bc2cf59e-bc8a-498a-a362-9b0d075fcd97 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:48.430424 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-367d9a0f-5b2d-454d-81f8-cb0bb15c9e34 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:36:48.431202 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-367d9a0f-5b2d-454d-81f8-cb0bb15c9e34 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:36:48.432577 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-367d9a0f-5b2d-454d-81f8-cb0bb15c9e34 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:36:48.443772 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-367d9a0f-5b2d-454d-81f8-cb0bb15c9e34 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:36:48.445524 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-367d9a0f-5b2d-454d-81f8-cb0bb15c9e34 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:36:48.491444 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-367d9a0f-5b2d-454d-81f8-cb0bb15c9e34 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:48.492565 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-367d9a0f-5b2d-454d-81f8-cb0bb15c9e34 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:48.493653 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-367d9a0f-5b2d-454d-81f8-cb0bb15c9e34 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:48.494882 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-367d9a0f-5b2d-454d-81f8-cb0bb15c9e34 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:48.495462 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-367d9a0f-5b2d-454d-81f8-cb0bb15c9e34 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:48.496007 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-367d9a0f-5b2d-454d-81f8-cb0bb15c9e34 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:48.535925 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-367d9a0f-5b2d-454d-81f8-cb0bb15c9e34 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Getting quotas for project dde62f171d474b038f1af39899518211. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:36:48.542452 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-367d9a0f-5b2d-454d-81f8-cb0bb15c9e34 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Getting quotas for user c80f2b2dbf824a1d879f5b7edb343f26 and project dde62f171d474b038f1af39899518211. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:36:48.548074 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:48.553271 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:48.677790 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-bc2cf59e-bc8a-498a-a362-9b0d075fcd97 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:48.691854 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-bc2cf59e-bc8a-498a-a362-9b0d075fcd97 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035" status: 200 len: 1474 microversion: 2.1 time: 0.414066 Oct 04 18:36:48.704617 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1072/2231] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:48 2022] GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035 => generated 1474 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:48.709677 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-367d9a0f-5b2d-454d-81f8-cb0bb15c9e34 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Going to run 1 instances... {{(pid=123002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:36:48.712515 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-367d9a0f-5b2d-454d-81f8-cb0bb15c9e34 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 98dfffc8-51aa-407a-a374-8e120ec43a31] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5d14b5e7-3091-446a-8387-f21c392e3e52',volume_size=None,volume_type=None)] {{(pid=123002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:36:48.731563 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-46b35230-9e75-4236-8f3a-238ff2ac6dc0 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:48.733969 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-46b35230-9e75-4236-8f3a-238ff2ac6dc0 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] [instance: 930b527f-b438-4dca-821a-c23a37020707] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:48.750714 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-46b35230-9e75-4236-8f3a-238ff2ac6dc0 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:48.750714 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-46b35230-9e75-4236-8f3a-238ff2ac6dc0 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:48.750714 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-46b35230-9e75-4236-8f3a-238ff2ac6dc0 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:48.750714 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-46b35230-9e75-4236-8f3a-238ff2ac6dc0 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:48.750714 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-46b35230-9e75-4236-8f3a-238ff2ac6dc0 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:48.750714 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-46b35230-9e75-4236-8f3a-238ff2ac6dc0 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:49.388757 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-367d9a0f-5b2d-454d-81f8-cb0bb15c9e34 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.058483 Oct 04 18:36:49.389432 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1160/2232] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:36:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 3061 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:36:49.411711 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1c41a16f-dace-44bc-b92d-334b9d344854 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:49.415903 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1c41a16f-dace-44bc-b92d-334b9d344854 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] [instance: 616e21b9-c93b-4ff0-8740-24c613f4d708] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:49.428265 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1c41a16f-dace-44bc-b92d-334b9d344854 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:49.428936 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1c41a16f-dace-44bc-b92d-334b9d344854 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:49.429379 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1c41a16f-dace-44bc-b92d-334b9d344854 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:49.430090 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1c41a16f-dace-44bc-b92d-334b9d344854 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:49.430548 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1c41a16f-dace-44bc-b92d-334b9d344854 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:49.430977 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1c41a16f-dace-44bc-b92d-334b9d344854 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:49.777404 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-46b35230-9e75-4236-8f3a-238ff2ac6dc0 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbfa195640841ed9ea72cfa654e2a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b6df28ccc1404686c1df3d8df4a366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:49.794130 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-46b35230-9e75-4236-8f3a-238ff2ac6dc0 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dbfa195640841ed9ea72cfa654e2a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b6df28ccc1404686c1df3d8df4a366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:49.801854 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-46b35230-9e75-4236-8f3a-238ff2ac6dc0 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dbfa195640841ed9ea72cfa654e2a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b6df28ccc1404686c1df3d8df4a366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:49.808297 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-46b35230-9e75-4236-8f3a-238ff2ac6dc0 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] 10.222.0.20 "GET /compute/v2.1/servers/930b527f-b438-4dca-821a-c23a37020707" status: 200 len: 1361 microversion: 2.26 time: 1.102232 Oct 04 18:36:49.813783 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1073/2233] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:48 2022] GET /compute/v2.1/servers/930b527f-b438-4dca-821a-c23a37020707 => generated 1361 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:36:49.835930 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e666e169-9fd3-4e07-8297-ab40f7dd5050 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:49.835930 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e666e169-9fd3-4e07-8297-ab40f7dd5050 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: cd74aff9-f694-49f3-a1cc-2095b71cd9e5] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:49.863832 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e666e169-9fd3-4e07-8297-ab40f7dd5050 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:49.865984 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e666e169-9fd3-4e07-8297-ab40f7dd5050 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:49.867631 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e666e169-9fd3-4e07-8297-ab40f7dd5050 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:49.873904 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e666e169-9fd3-4e07-8297-ab40f7dd5050 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:49.875121 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e666e169-9fd3-4e07-8297-ab40f7dd5050 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:49.876813 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e666e169-9fd3-4e07-8297-ab40f7dd5050 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:50.239166 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1c41a16f-dace-44bc-b92d-334b9d344854 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb44381220d43b7bdfa744a1dc410a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3242afeef424d588cf102a2f0f38020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:50.273757 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1c41a16f-dace-44bc-b92d-334b9d344854 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] 10.222.0.20 "GET /compute/v2.1/servers/616e21b9-c93b-4ff0-8740-24c613f4d708" status: 200 len: 1312 microversion: 2.1 time: 0.877575 Oct 04 18:36:50.278733 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1161/2234] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:49 2022] GET /compute/v2.1/servers/616e21b9-c93b-4ff0-8740-24c613f4d708 => generated 1312 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:50.316360 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-78eb592a-0604-4020-b4fc-25678a5dc884 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:50.317791 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-78eb592a-0604-4020-b4fc-25678a5dc884 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 98dfffc8-51aa-407a-a374-8e120ec43a31] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:50.391287 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=12 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:50.513837 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-78eb592a-0604-4020-b4fc-25678a5dc884 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:50.524225 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-78eb592a-0604-4020-b4fc-25678a5dc884 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31" status: 200 len: 1053 microversion: 2.1 time: 0.222892 Oct 04 18:36:50.525675 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1162/2235] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:50 2022] GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31 => generated 1053 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:50.533487 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-98840e38-400b-4b56-a7c8-6072bcc31556 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:50.535080 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-98840e38-400b-4b56-a7c8-6072bcc31556 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 3ead1560-9c23-48ad-a938-6b3179b70035] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:50.546976 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-98840e38-400b-4b56-a7c8-6072bcc31556 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:50.547900 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-98840e38-400b-4b56-a7c8-6072bcc31556 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:50.548860 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-98840e38-400b-4b56-a7c8-6072bcc31556 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:50.550108 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-98840e38-400b-4b56-a7c8-6072bcc31556 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:50.550923 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-98840e38-400b-4b56-a7c8-6072bcc31556 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:50.551581 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-98840e38-400b-4b56-a7c8-6072bcc31556 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:50.627019 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e666e169-9fd3-4e07-8297-ab40f7dd5050 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:50.636451 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e666e169-9fd3-4e07-8297-ab40f7dd5050 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:50.650076 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e666e169-9fd3-4e07-8297-ab40f7dd5050 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:50.651326 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e666e169-9fd3-4e07-8297-ab40f7dd5050 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5" status: 200 len: 1486 microversion: 2.25 time: 0.833877 Oct 04 18:36:50.651902 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1074/2236] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:49 2022] GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5 => generated 1486 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:36:50.830671 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-98840e38-400b-4b56-a7c8-6072bcc31556 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:50.841099 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-52d802b6-3845-4dac-945e-913c5a0f0e57 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:50.842244 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-52d802b6-3845-4dac-945e-913c5a0f0e57 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] [instance: 930b527f-b438-4dca-821a-c23a37020707] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:50.858885 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-52d802b6-3845-4dac-945e-913c5a0f0e57 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:50.859644 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-98840e38-400b-4b56-a7c8-6072bcc31556 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035" status: 200 len: 1469 microversion: 2.1 time: 0.324974 Oct 04 18:36:50.860798 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1163/2237] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:50 2022] GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035 => generated 1469 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:50.861519 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-52d802b6-3845-4dac-945e-913c5a0f0e57 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:50.862106 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-52d802b6-3845-4dac-945e-913c5a0f0e57 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:50.862994 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-52d802b6-3845-4dac-945e-913c5a0f0e57 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:50.869883 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-52d802b6-3845-4dac-945e-913c5a0f0e57 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:50.870542 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-52d802b6-3845-4dac-945e-913c5a0f0e57 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:50.887053 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ba582f68-18c1-4cef-961e-4f0e1b458f38 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:50.887600 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ba582f68-18c1-4cef-961e-4f0e1b458f38 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 3ead1560-9c23-48ad-a938-6b3179b70035] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:50.899244 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ba582f68-18c1-4cef-961e-4f0e1b458f38 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:50.899717 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ba582f68-18c1-4cef-961e-4f0e1b458f38 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:50.900194 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ba582f68-18c1-4cef-961e-4f0e1b458f38 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:50.903099 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ba582f68-18c1-4cef-961e-4f0e1b458f38 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:50.903560 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ba582f68-18c1-4cef-961e-4f0e1b458f38 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:50.904751 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ba582f68-18c1-4cef-961e-4f0e1b458f38 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:51.185147 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ba582f68-18c1-4cef-961e-4f0e1b458f38 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "POST /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035/action" status: 204 len: 0 microversion: 2.1 time: 0.301575 Oct 04 18:36:51.186044 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1164/2238] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:36:50 2022] POST /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035/action => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:36:51.219449 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e8664876-367c-499a-9617-0ae8c4518fd2 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:51.224651 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e8664876-367c-499a-9617-0ae8c4518fd2 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 3ead1560-9c23-48ad-a938-6b3179b70035] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:51.273794 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e8664876-367c-499a-9617-0ae8c4518fd2 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:51.274730 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e8664876-367c-499a-9617-0ae8c4518fd2 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:51.274730 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e8664876-367c-499a-9617-0ae8c4518fd2 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:51.275442 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e8664876-367c-499a-9617-0ae8c4518fd2 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:51.286425 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e8664876-367c-499a-9617-0ae8c4518fd2 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:51.286898 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e8664876-367c-499a-9617-0ae8c4518fd2 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:51.329963 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:51.620458 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-52d802b6-3845-4dac-945e-913c5a0f0e57 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbfa195640841ed9ea72cfa654e2a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b6df28ccc1404686c1df3d8df4a366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:51.652608 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-52d802b6-3845-4dac-945e-913c5a0f0e57 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dbfa195640841ed9ea72cfa654e2a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b6df28ccc1404686c1df3d8df4a366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:51.675891 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-52d802b6-3845-4dac-945e-913c5a0f0e57 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dbfa195640841ed9ea72cfa654e2a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b6df28ccc1404686c1df3d8df4a366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:51.678854 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-52d802b6-3845-4dac-945e-913c5a0f0e57 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] 10.222.0.20 "GET /compute/v2.1/servers/930b527f-b438-4dca-821a-c23a37020707" status: 200 len: 1361 microversion: 2.26 time: 0.843477 Oct 04 18:36:51.679477 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1075/2239] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:50 2022] GET /compute/v2.1/servers/930b527f-b438-4dca-821a-c23a37020707 => generated 1361 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:36:51.723612 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e05575fc-2785-437f-8655-3b4c278da50d tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:51.729241 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e05575fc-2785-437f-8655-3b4c278da50d tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] [instance: 616e21b9-c93b-4ff0-8740-24c613f4d708] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:51.754504 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e05575fc-2785-437f-8655-3b4c278da50d tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:51.757084 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e05575fc-2785-437f-8655-3b4c278da50d tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:51.757757 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e05575fc-2785-437f-8655-3b4c278da50d tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:51.758850 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e05575fc-2785-437f-8655-3b4c278da50d tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:51.762902 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e05575fc-2785-437f-8655-3b4c278da50d tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:51.772658 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e05575fc-2785-437f-8655-3b4c278da50d tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:52.198352 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e8664876-367c-499a-9617-0ae8c4518fd2 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:52.216561 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e8664876-367c-499a-9617-0ae8c4518fd2 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035" status: 200 len: 1469 microversion: 2.1 time: 1.024751 Oct 04 18:36:52.224191 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1165/2240] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:51 2022] GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035 => generated 1469 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:52.246203 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-755758d2-93df-4aa5-9595-a7c68d53e86a tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:52.247160 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-755758d2-93df-4aa5-9595-a7c68d53e86a tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 98dfffc8-51aa-407a-a374-8e120ec43a31] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:52.259457 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-755758d2-93df-4aa5-9595-a7c68d53e86a tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:52.271390 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-755758d2-93df-4aa5-9595-a7c68d53e86a tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:52.271390 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-755758d2-93df-4aa5-9595-a7c68d53e86a tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:52.274582 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-755758d2-93df-4aa5-9595-a7c68d53e86a tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:52.277650 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-755758d2-93df-4aa5-9595-a7c68d53e86a tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:52.278360 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-755758d2-93df-4aa5-9595-a7c68d53e86a tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:52.412091 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e05575fc-2785-437f-8655-3b4c278da50d tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb44381220d43b7bdfa744a1dc410a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3242afeef424d588cf102a2f0f38020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:52.429198 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e05575fc-2785-437f-8655-3b4c278da50d tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] 10.222.0.20 "GET /compute/v2.1/servers/616e21b9-c93b-4ff0-8740-24c613f4d708" status: 200 len: 1333 microversion: 2.1 time: 0.719604 Oct 04 18:36:52.430485 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1076/2241] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:51 2022] GET /compute/v2.1/servers/616e21b9-c93b-4ff0-8740-24c613f4d708 => generated 1333 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:52.447205 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-61c3b549-0d1d-4994-80c6-84fa47879bd9 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:52.452041 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-61c3b549-0d1d-4994-80c6-84fa47879bd9 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: cd74aff9-f694-49f3-a1cc-2095b71cd9e5] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:52.469034 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-61c3b549-0d1d-4994-80c6-84fa47879bd9 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:52.469802 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-61c3b549-0d1d-4994-80c6-84fa47879bd9 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:52.470736 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-61c3b549-0d1d-4994-80c6-84fa47879bd9 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:52.472336 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-61c3b549-0d1d-4994-80c6-84fa47879bd9 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:52.473386 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-61c3b549-0d1d-4994-80c6-84fa47879bd9 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:52.475374 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-61c3b549-0d1d-4994-80c6-84fa47879bd9 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:52.623283 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-755758d2-93df-4aa5-9595-a7c68d53e86a tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:52.633951 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-755758d2-93df-4aa5-9595-a7c68d53e86a tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31" status: 200 len: 1151 microversion: 2.1 time: 0.408567 Oct 04 18:36:52.634544 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1166/2242] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:52 2022] GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31 => generated 1151 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:52.651852 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-47c89082-2fa5-417a-b9c6-9abf480a5790 req-792a68d0-129e-4f19-86d2-0ab40f54e82a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "930b527f-b438-4dca-821a-c23a37020707", "name": "network-vif-plugged", "status": "completed", "tag": "de4c1af8-905a-42e9-bbd4-87936a6c637a"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:52.669730 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-47c89082-2fa5-417a-b9c6-9abf480a5790 req-792a68d0-129e-4f19-86d2-0ab40f54e82a service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:52.672390 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-47c89082-2fa5-417a-b9c6-9abf480a5790 req-792a68d0-129e-4f19-86d2-0ab40f54e82a service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:52.673471 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-47c89082-2fa5-417a-b9c6-9abf480a5790 req-792a68d0-129e-4f19-86d2-0ab40f54e82a service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:52.687960 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-47c89082-2fa5-417a-b9c6-9abf480a5790 req-792a68d0-129e-4f19-86d2-0ab40f54e82a service nova] Creating event network-vif-plugged:de4c1af8-905a-42e9-bbd4-87936a6c637a for instance 930b527f-b438-4dca-821a-c23a37020707 on n-h1-850501-14 Oct 04 18:36:52.694601 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-47c89082-2fa5-417a-b9c6-9abf480a5790 req-792a68d0-129e-4f19-86d2-0ab40f54e82a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058636 Oct 04 18:36:52.696534 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1167/2243] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:36:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:36:53.034896 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-935a6b19-44c3-4d16-8bad-c051af3e0742 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-1873144340", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": [{"uuid": "2881aa1b-489f-4fa8-907e-25857d4e4090"}]}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:53.120404 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-935a6b19-44c3-4d16-8bad-c051af3e0742 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] validate_networks() for [('2881aa1b-489f-4fa8-907e-25857d4e4090', None, None, None, None, None)] {{(pid=123002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:36:54.000881 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-61c3b549-0d1d-4994-80c6-84fa47879bd9 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:54.022069 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-61c3b549-0d1d-4994-80c6-84fa47879bd9 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:54.026357 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-61c3b549-0d1d-4994-80c6-84fa47879bd9 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:54.042909 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-61c3b549-0d1d-4994-80c6-84fa47879bd9 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5" status: 200 len: 1486 microversion: 2.25 time: 1.595438 Oct 04 18:36:54.053557 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1077/2244] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:52 2022] GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5 => generated 1486 bytes in 1622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:36:54.074135 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9da08d53-873a-4c24-8013-ebc9e37b6fa9 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:54.074763 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-9da08d53-873a-4c24-8013-ebc9e37b6fa9 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] [instance: 930b527f-b438-4dca-821a-c23a37020707] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:54.090924 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9da08d53-873a-4c24-8013-ebc9e37b6fa9 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:54.091419 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9da08d53-873a-4c24-8013-ebc9e37b6fa9 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:54.092205 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9da08d53-873a-4c24-8013-ebc9e37b6fa9 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:54.093407 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9da08d53-873a-4c24-8013-ebc9e37b6fa9 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:54.094312 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9da08d53-873a-4c24-8013-ebc9e37b6fa9 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:54.094889 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9da08d53-873a-4c24-8013-ebc9e37b6fa9 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:54.683110 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9da08d53-873a-4c24-8013-ebc9e37b6fa9 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbfa195640841ed9ea72cfa654e2a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b6df28ccc1404686c1df3d8df4a366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:54.698760 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9da08d53-873a-4c24-8013-ebc9e37b6fa9 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dbfa195640841ed9ea72cfa654e2a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b6df28ccc1404686c1df3d8df4a366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:54.701520 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9da08d53-873a-4c24-8013-ebc9e37b6fa9 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dbfa195640841ed9ea72cfa654e2a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b6df28ccc1404686c1df3d8df4a366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:54.709517 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9da08d53-873a-4c24-8013-ebc9e37b6fa9 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] 10.222.0.20 "GET /compute/v2.1/servers/930b527f-b438-4dca-821a-c23a37020707" status: 200 len: 1361 microversion: 2.26 time: 0.645391 Oct 04 18:36:54.720878 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1078/2245] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:54 2022] GET /compute/v2.1/servers/930b527f-b438-4dca-821a-c23a37020707 => generated 1361 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:36:54.732353 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ec7db169-52ff-4036-95ff-32b333a5907d tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:54.733766 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ec7db169-52ff-4036-95ff-32b333a5907d tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 3ead1560-9c23-48ad-a938-6b3179b70035] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:54.747908 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec7db169-52ff-4036-95ff-32b333a5907d tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:54.749939 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec7db169-52ff-4036-95ff-32b333a5907d tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:54.753552 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec7db169-52ff-4036-95ff-32b333a5907d tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:54.754474 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec7db169-52ff-4036-95ff-32b333a5907d tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:54.755083 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec7db169-52ff-4036-95ff-32b333a5907d tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:54.755652 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec7db169-52ff-4036-95ff-32b333a5907d tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:55.423868 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-935a6b19-44c3-4d16-8bad-c051af3e0742 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:36:55.425567 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-935a6b19-44c3-4d16-8bad-c051af3e0742 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:36:55.426223 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-935a6b19-44c3-4d16-8bad-c051af3e0742 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:36:55.426962 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-935a6b19-44c3-4d16-8bad-c051af3e0742 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:36:55.427525 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-935a6b19-44c3-4d16-8bad-c051af3e0742 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:36:55.477957 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-935a6b19-44c3-4d16-8bad-c051af3e0742 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:55.482773 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-935a6b19-44c3-4d16-8bad-c051af3e0742 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:55.483530 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-935a6b19-44c3-4d16-8bad-c051af3e0742 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:55.491643 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-935a6b19-44c3-4d16-8bad-c051af3e0742 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:55.492257 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-935a6b19-44c3-4d16-8bad-c051af3e0742 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:55.498257 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-935a6b19-44c3-4d16-8bad-c051af3e0742 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:55.584936 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-935a6b19-44c3-4d16-8bad-c051af3e0742 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Getting quotas for project 7e8869e8a46f40b18434fbe68d819dc4. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:36:55.598267 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-935a6b19-44c3-4d16-8bad-c051af3e0742 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Getting quotas for user 8356b47bd87f42e2b642c6df82014e86 and project 7e8869e8a46f40b18434fbe68d819dc4. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:36:55.636829 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-935a6b19-44c3-4d16-8bad-c051af3e0742 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Going to run 1 instances... {{(pid=123002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:36:55.644434 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-935a6b19-44c3-4d16-8bad-c051af3e0742 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] [instance: 94cff31c-a849-4365-b9e8-326613749226] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:36:55.856310 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-935a6b19-44c3-4d16-8bad-c051af3e0742 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.157507 Oct 04 18:36:55.857574 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1168/2246] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:36:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 3160 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:36:55.864401 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f0243c70-c194-4409-b1aa-3f3d7037b512 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:55.865313 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f0243c70-c194-4409-b1aa-3f3d7037b512 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] [instance: 616e21b9-c93b-4ff0-8740-24c613f4d708] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:55.891873 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f0243c70-c194-4409-b1aa-3f3d7037b512 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:55.892745 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f0243c70-c194-4409-b1aa-3f3d7037b512 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:55.893622 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f0243c70-c194-4409-b1aa-3f3d7037b512 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:55.894998 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f0243c70-c194-4409-b1aa-3f3d7037b512 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:55.895664 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f0243c70-c194-4409-b1aa-3f3d7037b512 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:55.897176 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f0243c70-c194-4409-b1aa-3f3d7037b512 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:56.005664 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ec7db169-52ff-4036-95ff-32b333a5907d tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:56.026019 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ec7db169-52ff-4036-95ff-32b333a5907d tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035" status: 200 len: 1461 microversion: 2.1 time: 1.299838 Oct 04 18:36:56.040093 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1079/2247] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:54 2022] GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035 => generated 1461 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:56.040093 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4525aed6-7469-4071-a393-13a6f603103f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:56.040093 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-4525aed6-7469-4071-a393-13a6f603103f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 98dfffc8-51aa-407a-a374-8e120ec43a31] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:56.064912 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4525aed6-7469-4071-a393-13a6f603103f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:56.068770 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4525aed6-7469-4071-a393-13a6f603103f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:56.069638 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4525aed6-7469-4071-a393-13a6f603103f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:56.070738 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4525aed6-7469-4071-a393-13a6f603103f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:56.071948 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4525aed6-7469-4071-a393-13a6f603103f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:56.077594 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4525aed6-7469-4071-a393-13a6f603103f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:56.454381 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-4525aed6-7469-4071-a393-13a6f603103f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:56.470899 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-4525aed6-7469-4071-a393-13a6f603103f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31" status: 200 len: 1169 microversion: 2.1 time: 0.441587 Oct 04 18:36:56.473251 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1080/2248] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:56 2022] GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31 => generated 1169 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:56.496932 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-dbaf7f03-e6b7-4687-979f-62e5eaee8653 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:56.499338 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-dbaf7f03-e6b7-4687-979f-62e5eaee8653 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: cd74aff9-f694-49f3-a1cc-2095b71cd9e5] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:56.525244 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dbaf7f03-e6b7-4687-979f-62e5eaee8653 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:56.526318 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dbaf7f03-e6b7-4687-979f-62e5eaee8653 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:56.527502 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dbaf7f03-e6b7-4687-979f-62e5eaee8653 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:56.535945 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dbaf7f03-e6b7-4687-979f-62e5eaee8653 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:56.537895 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dbaf7f03-e6b7-4687-979f-62e5eaee8653 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:56.538361 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dbaf7f03-e6b7-4687-979f-62e5eaee8653 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:56.560416 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=100 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:56.633844 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f0243c70-c194-4409-b1aa-3f3d7037b512 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb44381220d43b7bdfa744a1dc410a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3242afeef424d588cf102a2f0f38020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:56.645953 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f0243c70-c194-4409-b1aa-3f3d7037b512 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] 10.222.0.20 "GET /compute/v2.1/servers/616e21b9-c93b-4ff0-8740-24c613f4d708" status: 200 len: 1333 microversion: 2.1 time: 0.786410 Oct 04 18:36:56.653745 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1169/2249] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:55 2022] GET /compute/v2.1/servers/616e21b9-c93b-4ff0-8740-24c613f4d708 => generated 1333 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:56.668688 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-21312b95-49c3-42f8-85f1-94466d0ae659 req-796e6bca-0dcc-468d-8b88-501cec3858e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ead1560-9c23-48ad-a938-6b3179b70035", "name": "network-vif-plugged", "status": "completed", "tag": "7d8819bd-e6dc-4ea2-a722-7f903297fff8"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:56.728901 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-21312b95-49c3-42f8-85f1-94466d0ae659 req-796e6bca-0dcc-468d-8b88-501cec3858e5 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:56.728901 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-21312b95-49c3-42f8-85f1-94466d0ae659 req-796e6bca-0dcc-468d-8b88-501cec3858e5 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:56.729572 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-21312b95-49c3-42f8-85f1-94466d0ae659 req-796e6bca-0dcc-468d-8b88-501cec3858e5 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:56.779209 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-21312b95-49c3-42f8-85f1-94466d0ae659 req-796e6bca-0dcc-468d-8b88-501cec3858e5 service nova] Creating event network-vif-plugged:7d8819bd-e6dc-4ea2-a722-7f903297fff8 for instance 3ead1560-9c23-48ad-a938-6b3179b70035 on n-h1-850501-14 Oct 04 18:36:56.803982 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-21312b95-49c3-42f8-85f1-94466d0ae659 req-796e6bca-0dcc-468d-8b88-501cec3858e5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151789 Oct 04 18:36:56.804784 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1170/2250] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:36:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:36:56.810926 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3faceb0c-9955-4724-b0e6-3d4cf8f5ea9d tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:56.812357 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3faceb0c-9955-4724-b0e6-3d4cf8f5ea9d tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] [instance: 930b527f-b438-4dca-821a-c23a37020707] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:56.823383 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3faceb0c-9955-4724-b0e6-3d4cf8f5ea9d tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:56.832379 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3faceb0c-9955-4724-b0e6-3d4cf8f5ea9d tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:56.832379 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3faceb0c-9955-4724-b0e6-3d4cf8f5ea9d tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:56.848827 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3faceb0c-9955-4724-b0e6-3d4cf8f5ea9d tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:56.849475 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3faceb0c-9955-4724-b0e6-3d4cf8f5ea9d tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:56.849932 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3faceb0c-9955-4724-b0e6-3d4cf8f5ea9d tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:57.184351 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-dbaf7f03-e6b7-4687-979f-62e5eaee8653 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:57.197355 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-dbaf7f03-e6b7-4687-979f-62e5eaee8653 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:57.206234 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-dbaf7f03-e6b7-4687-979f-62e5eaee8653 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:57.207783 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-dbaf7f03-e6b7-4687-979f-62e5eaee8653 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5" status: 200 len: 1486 microversion: 2.25 time: 0.732896 Oct 04 18:36:57.209473 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1081/2251] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:56 2022] GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5 => generated 1486 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:36:57.214340 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2724a33c-4007-49b4-83e3-4f8422b8bc0c tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:57.225197 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2724a33c-4007-49b4-83e3-4f8422b8bc0c tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] [instance: 94cff31c-a849-4365-b9e8-326613749226] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:57.294792 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3faceb0c-9955-4724-b0e6-3d4cf8f5ea9d tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbfa195640841ed9ea72cfa654e2a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b6df28ccc1404686c1df3d8df4a366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:57.307143 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3faceb0c-9955-4724-b0e6-3d4cf8f5ea9d tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dbfa195640841ed9ea72cfa654e2a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b6df28ccc1404686c1df3d8df4a366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:57.309959 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3faceb0c-9955-4724-b0e6-3d4cf8f5ea9d tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dbfa195640841ed9ea72cfa654e2a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b6df28ccc1404686c1df3d8df4a366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:57.313664 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3faceb0c-9955-4724-b0e6-3d4cf8f5ea9d tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] 10.222.0.20 "GET /compute/v2.1/servers/930b527f-b438-4dca-821a-c23a37020707" status: 200 len: 1545 microversion: 2.26 time: 0.507431 Oct 04 18:36:57.321322 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1171/2252] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:56 2022] GET /compute/v2.1/servers/930b527f-b438-4dca-821a-c23a37020707 => generated 1545 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:36:57.327416 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e7ba11c9-6f55-49b0-bb26-5d92c96e7b2f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:57.332958 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e7ba11c9-6f55-49b0-bb26-5d92c96e7b2f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 3ead1560-9c23-48ad-a938-6b3179b70035] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:57.350346 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e7ba11c9-6f55-49b0-bb26-5d92c96e7b2f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:57.350896 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e7ba11c9-6f55-49b0-bb26-5d92c96e7b2f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:57.351342 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e7ba11c9-6f55-49b0-bb26-5d92c96e7b2f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:57.352090 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e7ba11c9-6f55-49b0-bb26-5d92c96e7b2f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:57.352551 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e7ba11c9-6f55-49b0-bb26-5d92c96e7b2f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:57.352984 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e7ba11c9-6f55-49b0-bb26-5d92c96e7b2f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:57.454334 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-2724a33c-4007-49b4-83e3-4f8422b8bc0c tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8356b47bd87f42e2b642c6df82014e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8869e8a46f40b18434fbe68d819dc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:57.464177 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2724a33c-4007-49b4-83e3-4f8422b8bc0c tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] 10.222.0.20 "GET /compute/v2.1/servers/94cff31c-a849-4365-b9e8-326613749226" status: 200 len: 1216 microversion: 2.1 time: 0.253793 Oct 04 18:36:57.466028 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1082/2253] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:57 2022] GET /compute/v2.1/servers/94cff31c-a849-4365-b9e8-326613749226 => generated 1216 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:57.481330 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-269611c6-1e31-4660-bbdd-e1740cd100a1 req-78f3f60e-600f-4a5b-b2c1-1f1422a409f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "616e21b9-c93b-4ff0-8740-24c613f4d708", "tag": "d4cd2e6b-3870-407c-a96e-a4f89855e326"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:57.502750 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-269611c6-1e31-4660-bbdd-e1740cd100a1 req-78f3f60e-600f-4a5b-b2c1-1f1422a409f8 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:57.525344 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-269611c6-1e31-4660-bbdd-e1740cd100a1 req-78f3f60e-600f-4a5b-b2c1-1f1422a409f8 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:57.528344 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-269611c6-1e31-4660-bbdd-e1740cd100a1 req-78f3f60e-600f-4a5b-b2c1-1f1422a409f8 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:57.575050 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-269611c6-1e31-4660-bbdd-e1740cd100a1 req-78f3f60e-600f-4a5b-b2c1-1f1422a409f8 service nova] Creating event network-changed:d4cd2e6b-3870-407c-a96e-a4f89855e326 for instance 616e21b9-c93b-4ff0-8740-24c613f4d708 on n-h1-850501-14 Oct 04 18:36:57.601967 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-269611c6-1e31-4660-bbdd-e1740cd100a1 req-78f3f60e-600f-4a5b-b2c1-1f1422a409f8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132664 Oct 04 18:36:57.608990 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1083/2254] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:36:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:36:57.615298 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ff77bbac-d548-4f67-a105-b05b1b99df6c tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Calling method '.version_select at 0x7fe259098d30>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:57.652677 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ff77bbac-d548-4f67-a105-b05b1b99df6c tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:57.653551 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ff77bbac-d548-4f67-a105-b05b1b99df6c tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:57.654152 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ff77bbac-d548-4f67-a105-b05b1b99df6c tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:57.654896 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ff77bbac-d548-4f67-a105-b05b1b99df6c tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] [instance: 930b527f-b438-4dca-821a-c23a37020707] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:57.671424 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ff77bbac-d548-4f67-a105-b05b1b99df6c tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:57.672143 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ff77bbac-d548-4f67-a105-b05b1b99df6c tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:57.672774 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ff77bbac-d548-4f67-a105-b05b1b99df6c tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:57.674380 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ff77bbac-d548-4f67-a105-b05b1b99df6c tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:57.675065 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ff77bbac-d548-4f67-a105-b05b1b99df6c tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:57.681173 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ff77bbac-d548-4f67-a105-b05b1b99df6c tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:57.776549 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ff77bbac-d548-4f67-a105-b05b1b99df6c tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:57.777405 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ff77bbac-d548-4f67-a105-b05b1b99df6c tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:57.777695 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ff77bbac-d548-4f67-a105-b05b1b99df6c tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:57.826218 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ff77bbac-d548-4f67-a105-b05b1b99df6c tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:57.826714 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ff77bbac-d548-4f67-a105-b05b1b99df6c tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:57.827224 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ff77bbac-d548-4f67-a105-b05b1b99df6c tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:58.031343 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-ff77bbac-d548-4f67-a105-b05b1b99df6c tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lazy-loading 'flavor' on Instance uuid 930b527f-b438-4dca-821a-c23a37020707 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:36:58.080781 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ff77bbac-d548-4f67-a105-b05b1b99df6c tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] 10.222.0.20 "PUT /compute/v2.1/servers/930b527f-b438-4dca-821a-c23a37020707/tags/tempest-tag-307891641" status: 201 len: 0 microversion: 2.26 time: 0.466357 Oct 04 18:36:58.082053 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1084/2255] 10.222.0.20 () {62 vars in 1377 bytes} [Tue Oct 4 18:36:57 2022] PUT /compute/v2.1/servers/930b527f-b438-4dca-821a-c23a37020707/tags/tempest-tag-307891641 => generated 0 bytes in 472 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 04 18:36:58.102628 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-db07b2d5-6ac0-49ad-a496-8eb54b19fdbd tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:58.103325 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-db07b2d5-6ac0-49ad-a496-8eb54b19fdbd tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 98dfffc8-51aa-407a-a374-8e120ec43a31] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:58.110445 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-db07b2d5-6ac0-49ad-a496-8eb54b19fdbd tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:58.111154 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-db07b2d5-6ac0-49ad-a496-8eb54b19fdbd tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:58.111783 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-db07b2d5-6ac0-49ad-a496-8eb54b19fdbd tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:58.112769 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-db07b2d5-6ac0-49ad-a496-8eb54b19fdbd tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:58.113422 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-db07b2d5-6ac0-49ad-a496-8eb54b19fdbd tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:58.114038 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-db07b2d5-6ac0-49ad-a496-8eb54b19fdbd tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:58.198270 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e7ba11c9-6f55-49b0-bb26-5d92c96e7b2f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:58.210201 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e7ba11c9-6f55-49b0-bb26-5d92c96e7b2f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035" status: 200 len: 1461 microversion: 2.1 time: 0.885035 Oct 04 18:36:58.210788 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1172/2256] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:57 2022] GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035 => generated 1461 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:58.235247 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f32fe271-5d1e-461c-90f5-38ac8041583e tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:58.235247 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f32fe271-5d1e-461c-90f5-38ac8041583e tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] [instance: 616e21b9-c93b-4ff0-8740-24c613f4d708] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:58.257859 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f32fe271-5d1e-461c-90f5-38ac8041583e tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:58.258713 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f32fe271-5d1e-461c-90f5-38ac8041583e tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:58.261771 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f32fe271-5d1e-461c-90f5-38ac8041583e tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:58.263233 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f32fe271-5d1e-461c-90f5-38ac8041583e tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:58.263926 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f32fe271-5d1e-461c-90f5-38ac8041583e tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:58.265338 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f32fe271-5d1e-461c-90f5-38ac8041583e tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:58.818697 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-db07b2d5-6ac0-49ad-a496-8eb54b19fdbd tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:58.830368 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-db07b2d5-6ac0-49ad-a496-8eb54b19fdbd tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31" status: 200 len: 1211 microversion: 2.1 time: 0.746480 Oct 04 18:36:58.848560 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1085/2257] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:58 2022] GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31 => generated 1211 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:58.865062 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-46804644-061e-49d4-9349-12a09b91f9cc tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Calling method '.version_select at 0x7fe2590da4c0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:58.886619 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-46804644-061e-49d4-9349-12a09b91f9cc tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:58.887208 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-46804644-061e-49d4-9349-12a09b91f9cc tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:58.887862 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-46804644-061e-49d4-9349-12a09b91f9cc tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:58.903507 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f32fe271-5d1e-461c-90f5-38ac8041583e tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb44381220d43b7bdfa744a1dc410a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3242afeef424d588cf102a2f0f38020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:58.912434 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f32fe271-5d1e-461c-90f5-38ac8041583e tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] 10.222.0.20 "GET /compute/v2.1/servers/616e21b9-c93b-4ff0-8740-24c613f4d708" status: 200 len: 1333 microversion: 2.1 time: 0.697488 Oct 04 18:36:58.920017 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1173/2258] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:58 2022] GET /compute/v2.1/servers/616e21b9-c93b-4ff0-8740-24c613f4d708 => generated 1333 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:58.929359 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b46843a7-c2f3-47da-8adf-487cbd258bf3 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:58.932958 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b46843a7-c2f3-47da-8adf-487cbd258bf3 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: cd74aff9-f694-49f3-a1cc-2095b71cd9e5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:58.941303 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-46804644-061e-49d4-9349-12a09b91f9cc tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] 10.222.0.20 "GET /compute/v2.1/servers/930b527f-b438-4dca-821a-c23a37020707/tags/tempest-tag-307891641" status: 204 len: 0 microversion: 2.26 time: 0.091365 Oct 04 18:36:58.949874 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1086/2259] 10.222.0.20 () {60 vars in 1358 bytes} [Tue Oct 4 18:36:58 2022] GET /compute/v2.1/servers/930b527f-b438-4dca-821a-c23a37020707/tags/tempest-tag-307891641 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:36:58.960349 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2388425f-2a6c-4b8d-aef8-c9277da3b472 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Action: 'create', calling method: .version_select at 0x7fe2590db5e0>, body: {"keypair": {"name": "tempest-keypair-720708956", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPYJ/H4uJxyTwTEtSUVQzThixCshCgKEPIJWTV3PHniWzHlhWGkbSLQGZB8fSgYTnOMlRgPFoDuOTIsD1ZiLJqECwdMqo6GczzBTLDdN8fvijT8M2vAWagWWGKdp52zQ6Q=="}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:58.963394 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b46843a7-c2f3-47da-8adf-487cbd258bf3 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:58.964171 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b46843a7-c2f3-47da-8adf-487cbd258bf3 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:58.964890 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b46843a7-c2f3-47da-8adf-487cbd258bf3 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:58.965626 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b46843a7-c2f3-47da-8adf-487cbd258bf3 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:58.969869 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b46843a7-c2f3-47da-8adf-487cbd258bf3 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:58.971766 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b46843a7-c2f3-47da-8adf-487cbd258bf3 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:59.033271 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-2388425f-2a6c-4b8d-aef8-c9277da3b472 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Getting quotas for project 552ab59dabe840cb8582c54bedc49b09. Resources: {'key_pairs'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:36:59.049242 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-2388425f-2a6c-4b8d-aef8-c9277da3b472 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Getting quotas for user 9b05d1f8b9014e798926f9c496885a4d and project 552ab59dabe840cb8582c54bedc49b09. Resources: {'key_pairs'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:36:59.199833 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2388425f-2a6c-4b8d-aef8-c9277da3b472 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.255661 Oct 04 18:36:59.204917 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1087/2260] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Oct 4 18:36:58 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:36:59.207939 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-796c0d33-6ca0-46cd-aa05-e43ab698ba5e tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:59.208595 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-796c0d33-6ca0-46cd-aa05-e43ab698ba5e tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] [instance: 94cff31c-a849-4365-b9e8-326613749226] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:59.215634 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-796c0d33-6ca0-46cd-aa05-e43ab698ba5e tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:59.216207 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-796c0d33-6ca0-46cd-aa05-e43ab698ba5e tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:59.216851 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-796c0d33-6ca0-46cd-aa05-e43ab698ba5e tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:59.218686 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-796c0d33-6ca0-46cd-aa05-e43ab698ba5e tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:59.219299 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-796c0d33-6ca0-46cd-aa05-e43ab698ba5e tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:59.220031 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-796c0d33-6ca0-46cd-aa05-e43ab698ba5e tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:59.817912 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-796c0d33-6ca0-46cd-aa05-e43ab698ba5e tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8356b47bd87f42e2b642c6df82014e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8869e8a46f40b18434fbe68d819dc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:59.834261 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-796c0d33-6ca0-46cd-aa05-e43ab698ba5e tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] 10.222.0.20 "GET /compute/v2.1/servers/94cff31c-a849-4365-b9e8-326613749226" status: 200 len: 1268 microversion: 2.1 time: 0.631526 Oct 04 18:36:59.852938 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1088/2261] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:59 2022] GET /compute/v2.1/servers/94cff31c-a849-4365-b9e8-326613749226 => generated 1268 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:59.858947 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1d848eb2-a17a-400d-ba3c-a99db3659976 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Calling method '.version_select at 0x7fe258fda310>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:59.882339 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1d848eb2-a17a-400d-ba3c-a99db3659976 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:59.883064 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1d848eb2-a17a-400d-ba3c-a99db3659976 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:59.883728 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1d848eb2-a17a-400d-ba3c-a99db3659976 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:59.884387 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1d848eb2-a17a-400d-ba3c-a99db3659976 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] [instance: 930b527f-b438-4dca-821a-c23a37020707] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:59.898070 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1d848eb2-a17a-400d-ba3c-a99db3659976 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:59.905100 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1d848eb2-a17a-400d-ba3c-a99db3659976 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:59.905789 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1d848eb2-a17a-400d-ba3c-a99db3659976 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:59.906760 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1d848eb2-a17a-400d-ba3c-a99db3659976 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:59.907409 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1d848eb2-a17a-400d-ba3c-a99db3659976 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:59.908078 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1d848eb2-a17a-400d-ba3c-a99db3659976 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:59.966789 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1d848eb2-a17a-400d-ba3c-a99db3659976 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:59.968318 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1d848eb2-a17a-400d-ba3c-a99db3659976 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:59.969457 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1d848eb2-a17a-400d-ba3c-a99db3659976 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:59.991356 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b46843a7-c2f3-47da-8adf-487cbd258bf3 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:00.014149 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b46843a7-c2f3-47da-8adf-487cbd258bf3 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:00.019013 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b46843a7-c2f3-47da-8adf-487cbd258bf3 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:00.020230 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b46843a7-c2f3-47da-8adf-487cbd258bf3 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5" status: 200 len: 1486 microversion: 2.25 time: 1.098788 Oct 04 18:37:00.032604 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1174/2262] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:36:58 2022] GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5 => generated 1486 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:37:00.040220 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-65ba962c-750b-4768-95d8-af5facc045e8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:00.041181 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-65ba962c-750b-4768-95d8-af5facc045e8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 98dfffc8-51aa-407a-a374-8e120ec43a31] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:00.053541 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-65ba962c-750b-4768-95d8-af5facc045e8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:00.054578 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-65ba962c-750b-4768-95d8-af5facc045e8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:00.057578 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-65ba962c-750b-4768-95d8-af5facc045e8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:00.057578 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-65ba962c-750b-4768-95d8-af5facc045e8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:00.057578 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-65ba962c-750b-4768-95d8-af5facc045e8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:00.057909 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-65ba962c-750b-4768-95d8-af5facc045e8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:00.106618 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-1d848eb2-a17a-400d-ba3c-a99db3659976 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lazy-loading 'flavor' on Instance uuid 930b527f-b438-4dca-821a-c23a37020707 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:37:00.156875 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1d848eb2-a17a-400d-ba3c-a99db3659976 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] 10.222.0.20 "DELETE /compute/v2.1/servers/930b527f-b438-4dca-821a-c23a37020707/tags" status: 204 len: 0 microversion: 2.26 time: 0.302560 Oct 04 18:37:00.169721 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1089/2263] 10.222.0.20 () {60 vars in 1295 bytes} [Tue Oct 4 18:36:59 2022] DELETE /compute/v2.1/servers/930b527f-b438-4dca-821a-c23a37020707/tags => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:37:00.174256 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-315ee363-fab9-4262-9ec4-211962b779eb tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:00.177730 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-315ee363-fab9-4262-9ec4-211962b779eb tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] [instance: 616e21b9-c93b-4ff0-8740-24c613f4d708] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:00.190253 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-315ee363-fab9-4262-9ec4-211962b779eb tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:00.190741 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-315ee363-fab9-4262-9ec4-211962b779eb tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:00.191176 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-315ee363-fab9-4262-9ec4-211962b779eb tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:00.197024 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-315ee363-fab9-4262-9ec4-211962b779eb tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:00.197759 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-315ee363-fab9-4262-9ec4-211962b779eb tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:00.201094 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-315ee363-fab9-4262-9ec4-211962b779eb tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:00.716652 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-315ee363-fab9-4262-9ec4-211962b779eb tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb44381220d43b7bdfa744a1dc410a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3242afeef424d588cf102a2f0f38020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:00.730333 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-315ee363-fab9-4262-9ec4-211962b779eb tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] 10.222.0.20 "GET /compute/v2.1/servers/616e21b9-c93b-4ff0-8740-24c613f4d708" status: 200 len: 1333 microversion: 2.1 time: 0.563108 Oct 04 18:37:00.733287 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1090/2264] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:00 2022] GET /compute/v2.1/servers/616e21b9-c93b-4ff0-8740-24c613f4d708 => generated 1333 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:00.743764 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b5698c65-2ae7-48c0-b570-9b9b000f4cf3 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Calling method '.version_select at 0x7fe258bf8e50>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:00.747391 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-65ba962c-750b-4768-95d8-af5facc045e8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:00.757219 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-65ba962c-750b-4768-95d8-af5facc045e8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31" status: 200 len: 1211 microversion: 2.1 time: 0.723164 Oct 04 18:37:00.770195 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b5698c65-2ae7-48c0-b570-9b9b000f4cf3 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:00.770195 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b5698c65-2ae7-48c0-b570-9b9b000f4cf3 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:00.770195 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b5698c65-2ae7-48c0-b570-9b9b000f4cf3 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:00.770790 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1175/2265] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:00 2022] GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31 => generated 1211 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:00.776950 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b5698c65-2ae7-48c0-b570-9b9b000f4cf3 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] 10.222.0.20 "GET /compute/v2.1/servers/930b527f-b438-4dca-821a-c23a37020707/tags" status: 200 len: 12 microversion: 2.26 time: 0.042176 Oct 04 18:37:00.777589 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1091/2266] 10.222.0.20 () {60 vars in 1292 bytes} [Tue Oct 4 18:37:00 2022] GET /compute/v2.1/servers/930b527f-b438-4dca-821a-c23a37020707/tags => generated 12 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:00.787322 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-f91216ad-f1a7-401a-adb8-127aed04c438 req-cfd22d60-e844-4d5c-8435-9055f49b50d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "616e21b9-c93b-4ff0-8740-24c613f4d708", "tag": "092863dc-5ae4-498b-b3d8-b7f299e949c4"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:00.818183 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-11b57bd3-8cc5-4168-85e9-49cca40c33d0 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Calling method '.version_select at 0x7fe259098940>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:00.823969 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-f91216ad-f1a7-401a-adb8-127aed04c438 req-cfd22d60-e844-4d5c-8435-9055f49b50d3 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:00.824481 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-f91216ad-f1a7-401a-adb8-127aed04c438 req-cfd22d60-e844-4d5c-8435-9055f49b50d3 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:00.824911 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-f91216ad-f1a7-401a-adb8-127aed04c438 req-cfd22d60-e844-4d5c-8435-9055f49b50d3 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:00.831985 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-11b57bd3-8cc5-4168-85e9-49cca40c33d0 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:00.832507 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-11b57bd3-8cc5-4168-85e9-49cca40c33d0 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:00.833051 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-11b57bd3-8cc5-4168-85e9-49cca40c33d0 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:00.833690 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-11b57bd3-8cc5-4168-85e9-49cca40c33d0 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] [instance: 930b527f-b438-4dca-821a-c23a37020707] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:00.845382 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-11b57bd3-8cc5-4168-85e9-49cca40c33d0 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:00.845973 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-11b57bd3-8cc5-4168-85e9-49cca40c33d0 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:00.846638 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-11b57bd3-8cc5-4168-85e9-49cca40c33d0 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:00.848308 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-11b57bd3-8cc5-4168-85e9-49cca40c33d0 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:00.850117 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-11b57bd3-8cc5-4168-85e9-49cca40c33d0 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:00.850800 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-11b57bd3-8cc5-4168-85e9-49cca40c33d0 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:00.853053 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-f91216ad-f1a7-401a-adb8-127aed04c438 req-cfd22d60-e844-4d5c-8435-9055f49b50d3 service nova] Creating event network-changed:092863dc-5ae4-498b-b3d8-b7f299e949c4 for instance 616e21b9-c93b-4ff0-8740-24c613f4d708 on n-h1-850501-14 Oct 04 18:37:00.860617 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-f91216ad-f1a7-401a-adb8-127aed04c438 req-cfd22d60-e844-4d5c-8435-9055f49b50d3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078527 Oct 04 18:37:00.861583 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1176/2267] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:37:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:37:00.869587 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f3b6bc26-ac36-4715-a06d-2c9a61c28960 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:00.870288 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f3b6bc26-ac36-4715-a06d-2c9a61c28960 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] [instance: 94cff31c-a849-4365-b9e8-326613749226] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:00.895327 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f3b6bc26-ac36-4715-a06d-2c9a61c28960 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:00.896091 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f3b6bc26-ac36-4715-a06d-2c9a61c28960 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:00.896666 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f3b6bc26-ac36-4715-a06d-2c9a61c28960 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:00.897749 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f3b6bc26-ac36-4715-a06d-2c9a61c28960 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:00.898349 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f3b6bc26-ac36-4715-a06d-2c9a61c28960 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:00.898905 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f3b6bc26-ac36-4715-a06d-2c9a61c28960 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:00.902116 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-11b57bd3-8cc5-4168-85e9-49cca40c33d0 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:00.906555 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-11b57bd3-8cc5-4168-85e9-49cca40c33d0 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:00.907318 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-11b57bd3-8cc5-4168-85e9-49cca40c33d0 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:00.918940 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-11b57bd3-8cc5-4168-85e9-49cca40c33d0 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:00.920147 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-11b57bd3-8cc5-4168-85e9-49cca40c33d0 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:00.921694 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-11b57bd3-8cc5-4168-85e9-49cca40c33d0 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:01.045264 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f3b6bc26-ac36-4715-a06d-2c9a61c28960 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8356b47bd87f42e2b642c6df82014e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8869e8a46f40b18434fbe68d819dc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:01.077701 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-11b57bd3-8cc5-4168-85e9-49cca40c33d0 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lazy-loading 'flavor' on Instance uuid 930b527f-b438-4dca-821a-c23a37020707 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:37:01.092215 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f3b6bc26-ac36-4715-a06d-2c9a61c28960 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] 10.222.0.20 "GET /compute/v2.1/servers/94cff31c-a849-4365-b9e8-326613749226" status: 200 len: 1274 microversion: 2.1 time: 0.228428 Oct 04 18:37:01.097582 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1177/2268] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:00 2022] GET /compute/v2.1/servers/94cff31c-a849-4365-b9e8-326613749226 => generated 1274 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:01.117828 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b50ea9d0-6e56-4dd5-af7b-4dea16559958 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:01.119848 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b50ea9d0-6e56-4dd5-af7b-4dea16559958 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: cd74aff9-f694-49f3-a1cc-2095b71cd9e5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:01.134438 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-11b57bd3-8cc5-4168-85e9-49cca40c33d0 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] 10.222.0.20 "PUT /compute/v2.1/servers/930b527f-b438-4dca-821a-c23a37020707/tags/tempest-tag-1011266902" status: 201 len: 0 microversion: 2.26 time: 0.341893 Oct 04 18:37:01.135989 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b50ea9d0-6e56-4dd5-af7b-4dea16559958 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:01.137534 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1092/2269] 10.222.0.20 () {62 vars in 1380 bytes} [Tue Oct 4 18:37:00 2022] PUT /compute/v2.1/servers/930b527f-b438-4dca-821a-c23a37020707/tags/tempest-tag-1011266902 => generated 0 bytes in 345 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 04 18:37:01.137864 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b50ea9d0-6e56-4dd5-af7b-4dea16559958 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:01.138634 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b50ea9d0-6e56-4dd5-af7b-4dea16559958 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:01.140221 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b50ea9d0-6e56-4dd5-af7b-4dea16559958 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:01.141064 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b50ea9d0-6e56-4dd5-af7b-4dea16559958 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:01.141667 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b50ea9d0-6e56-4dd5-af7b-4dea16559958 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:01.154526 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d8fb53e3-0529-48ad-a087-e7be517bf948 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Calling method '.version_select at 0x7fe259098dc0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:01.192209 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d8fb53e3-0529-48ad-a087-e7be517bf948 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:01.192977 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d8fb53e3-0529-48ad-a087-e7be517bf948 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:01.194646 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d8fb53e3-0529-48ad-a087-e7be517bf948 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:01.218973 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d8fb53e3-0529-48ad-a087-e7be517bf948 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] 10.222.0.20 "GET /compute/v2.1/servers/930b527f-b438-4dca-821a-c23a37020707/tags" status: 200 len: 36 microversion: 2.26 time: 0.072983 Oct 04 18:37:01.221600 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1093/2270] 10.222.0.20 () {60 vars in 1292 bytes} [Tue Oct 4 18:37:01 2022] GET /compute/v2.1/servers/930b527f-b438-4dca-821a-c23a37020707/tags => generated 36 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:01.244802 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9351cfb4-25a7-4c58-a54a-a2f84c6d6862 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Calling method '.version_select at 0x7fe259098040>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:01.272176 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9351cfb4-25a7-4c58-a54a-a2f84c6d6862 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:01.272609 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9351cfb4-25a7-4c58-a54a-a2f84c6d6862 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:01.273059 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9351cfb4-25a7-4c58-a54a-a2f84c6d6862 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:01.274106 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-9351cfb4-25a7-4c58-a54a-a2f84c6d6862 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] [instance: 930b527f-b438-4dca-821a-c23a37020707] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:01.296677 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9351cfb4-25a7-4c58-a54a-a2f84c6d6862 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:01.298930 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9351cfb4-25a7-4c58-a54a-a2f84c6d6862 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:01.299928 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9351cfb4-25a7-4c58-a54a-a2f84c6d6862 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:01.300922 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9351cfb4-25a7-4c58-a54a-a2f84c6d6862 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:01.301548 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9351cfb4-25a7-4c58-a54a-a2f84c6d6862 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:01.302807 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9351cfb4-25a7-4c58-a54a-a2f84c6d6862 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:01.356674 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9351cfb4-25a7-4c58-a54a-a2f84c6d6862 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:01.360216 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9351cfb4-25a7-4c58-a54a-a2f84c6d6862 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:01.361113 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9351cfb4-25a7-4c58-a54a-a2f84c6d6862 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:01.473894 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-9351cfb4-25a7-4c58-a54a-a2f84c6d6862 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lazy-loading 'flavor' on Instance uuid 930b527f-b438-4dca-821a-c23a37020707 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:37:01.494372 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9351cfb4-25a7-4c58-a54a-a2f84c6d6862 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] 10.222.0.20 "DELETE /compute/v2.1/servers/930b527f-b438-4dca-821a-c23a37020707/tags/tempest-tag-1011266902" status: 204 len: 0 microversion: 2.26 time: 0.266889 Oct 04 18:37:01.498387 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1094/2271] 10.222.0.20 () {60 vars in 1364 bytes} [Tue Oct 4 18:37:01 2022] DELETE /compute/v2.1/servers/930b527f-b438-4dca-821a-c23a37020707/tags/tempest-tag-1011266902 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:37:01.498472 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b50ea9d0-6e56-4dd5-af7b-4dea16559958 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:01.512910 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-62aaf4dc-9b17-4491-88c9-fd1d4cf9692d tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Calling method '.version_select at 0x7fe2590981f0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:01.515412 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b50ea9d0-6e56-4dd5-af7b-4dea16559958 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:01.516973 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b50ea9d0-6e56-4dd5-af7b-4dea16559958 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:01.518169 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b50ea9d0-6e56-4dd5-af7b-4dea16559958 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5" status: 200 len: 1486 microversion: 2.25 time: 0.416337 Oct 04 18:37:01.518731 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1178/2272] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:01 2022] GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5 => generated 1486 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:37:01.534203 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-62aaf4dc-9b17-4491-88c9-fd1d4cf9692d tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:01.537199 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-62aaf4dc-9b17-4491-88c9-fd1d4cf9692d tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:01.537671 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-62aaf4dc-9b17-4491-88c9-fd1d4cf9692d tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:01.563813 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-62aaf4dc-9b17-4491-88c9-fd1d4cf9692d tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] 10.222.0.20 "GET /compute/v2.1/servers/930b527f-b438-4dca-821a-c23a37020707/tags" status: 200 len: 12 microversion: 2.26 time: 0.056316 Oct 04 18:37:01.569822 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1095/2273] 10.222.0.20 () {60 vars in 1292 bytes} [Tue Oct 4 18:37:01 2022] GET /compute/v2.1/servers/930b527f-b438-4dca-821a-c23a37020707/tags => generated 12 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:01.575212 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d8f57808-faac-4131-852e-31785c731cdf tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Calling method '.version_select at 0x7fe25d29f5e0>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:01.586434 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d8f57808-faac-4131-852e-31785c731cdf tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:01.587140 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d8f57808-faac-4131-852e-31785c731cdf tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:01.587713 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d8f57808-faac-4131-852e-31785c731cdf tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:01.588970 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d8f57808-faac-4131-852e-31785c731cdf tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] [instance: 930b527f-b438-4dca-821a-c23a37020707] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:01.621954 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d8f57808-faac-4131-852e-31785c731cdf tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:01.626664 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d8f57808-faac-4131-852e-31785c731cdf tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:01.627324 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d8f57808-faac-4131-852e-31785c731cdf tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:01.628254 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d8f57808-faac-4131-852e-31785c731cdf tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:01.632151 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d8f57808-faac-4131-852e-31785c731cdf tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:01.632817 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d8f57808-faac-4131-852e-31785c731cdf tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:01.697795 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d8f57808-faac-4131-852e-31785c731cdf tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:01.698279 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d8f57808-faac-4131-852e-31785c731cdf tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:01.698768 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d8f57808-faac-4131-852e-31785c731cdf tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:01.743504 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-d8f57808-faac-4131-852e-31785c731cdf tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lazy-loading 'flavor' on Instance uuid 930b527f-b438-4dca-821a-c23a37020707 {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:37:01.771200 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-787ae36b-4655-4023-a3f3-be045872f582 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:01.774434 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-787ae36b-4655-4023-a3f3-be045872f582 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] [instance: 616e21b9-c93b-4ff0-8740-24c613f4d708] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:01.791304 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-787ae36b-4655-4023-a3f3-be045872f582 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:01.792191 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-787ae36b-4655-4023-a3f3-be045872f582 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:01.794087 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-787ae36b-4655-4023-a3f3-be045872f582 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:01.794984 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d8f57808-faac-4131-852e-31785c731cdf tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] 10.222.0.20 "DELETE /compute/v2.1/servers/930b527f-b438-4dca-821a-c23a37020707/tags" status: 204 len: 0 microversion: 2.26 time: 0.223726 Oct 04 18:37:01.796430 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-787ae36b-4655-4023-a3f3-be045872f582 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:01.796545 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1179/2274] 10.222.0.20 () {60 vars in 1295 bytes} [Tue Oct 4 18:37:01 2022] DELETE /compute/v2.1/servers/930b527f-b438-4dca-821a-c23a37020707/tags => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:37:01.799117 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-787ae36b-4655-4023-a3f3-be045872f582 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:01.799716 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-787ae36b-4655-4023-a3f3-be045872f582 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:01.801516 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-769e6e12-1148-491b-b17f-f74458125118 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:01.802126 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-769e6e12-1148-491b-b17f-f74458125118 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 98dfffc8-51aa-407a-a374-8e120ec43a31] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:01.816655 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-769e6e12-1148-491b-b17f-f74458125118 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:01.821175 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-769e6e12-1148-491b-b17f-f74458125118 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:01.821827 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-769e6e12-1148-491b-b17f-f74458125118 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:01.822735 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-769e6e12-1148-491b-b17f-f74458125118 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:01.823339 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-769e6e12-1148-491b-b17f-f74458125118 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:01.823895 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-769e6e12-1148-491b-b17f-f74458125118 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:02.301824 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-787ae36b-4655-4023-a3f3-be045872f582 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb44381220d43b7bdfa744a1dc410a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3242afeef424d588cf102a2f0f38020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:02.317565 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-787ae36b-4655-4023-a3f3-be045872f582 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] 10.222.0.20 "GET /compute/v2.1/servers/616e21b9-c93b-4ff0-8740-24c613f4d708" status: 200 len: 1333 microversion: 2.1 time: 0.552018 Oct 04 18:37:02.323434 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1096/2275] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:01 2022] GET /compute/v2.1/servers/616e21b9-c93b-4ff0-8740-24c613f4d708 => generated 1333 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:02.337960 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-976f468a-a1f2-4152-8038-e63d05d3481e tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Calling method '.version_select at 0x7fe258e20d30>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:02.360623 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:02.371077 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-976f468a-a1f2-4152-8038-e63d05d3481e tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:02.371765 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-976f468a-a1f2-4152-8038-e63d05d3481e tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:02.373175 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-976f468a-a1f2-4152-8038-e63d05d3481e tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:02.375391 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-976f468a-a1f2-4152-8038-e63d05d3481e tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] [instance: 930b527f-b438-4dca-821a-c23a37020707] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:02.383840 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-976f468a-a1f2-4152-8038-e63d05d3481e tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:02.385166 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-976f468a-a1f2-4152-8038-e63d05d3481e tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:02.385693 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-976f468a-a1f2-4152-8038-e63d05d3481e tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:02.386521 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-976f468a-a1f2-4152-8038-e63d05d3481e tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:02.387106 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-976f468a-a1f2-4152-8038-e63d05d3481e tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:02.387731 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-976f468a-a1f2-4152-8038-e63d05d3481e tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:02.464195 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:02.487123 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-976f468a-a1f2-4152-8038-e63d05d3481e tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:02.488341 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-976f468a-a1f2-4152-8038-e63d05d3481e tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:02.491875 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-976f468a-a1f2-4152-8038-e63d05d3481e tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:02.522811 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-976f468a-a1f2-4152-8038-e63d05d3481e tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:02.523390 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-976f468a-a1f2-4152-8038-e63d05d3481e tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:02.523836 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-976f468a-a1f2-4152-8038-e63d05d3481e tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:02.592977 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-769e6e12-1148-491b-b17f-f74458125118 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:02.613870 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-769e6e12-1148-491b-b17f-f74458125118 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31" status: 200 len: 1211 microversion: 2.1 time: 0.814431 Oct 04 18:37:02.626273 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1180/2276] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:01 2022] GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31 => generated 1211 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:02.631838 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-976f468a-a1f2-4152-8038-e63d05d3481e tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lazy-loading 'flavor' on Instance uuid 930b527f-b438-4dca-821a-c23a37020707 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:37:02.642782 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7bf02c6e-868d-460b-b851-03236c65ea2c tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:02.644603 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7bf02c6e-868d-460b-b851-03236c65ea2c tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] [instance: 94cff31c-a849-4365-b9e8-326613749226] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:02.651703 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7bf02c6e-868d-460b-b851-03236c65ea2c tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:02.652558 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7bf02c6e-868d-460b-b851-03236c65ea2c tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:02.653347 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7bf02c6e-868d-460b-b851-03236c65ea2c tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:02.654279 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7bf02c6e-868d-460b-b851-03236c65ea2c tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:02.655009 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7bf02c6e-868d-460b-b851-03236c65ea2c tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:02.655770 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7bf02c6e-868d-460b-b851-03236c65ea2c tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:02.660508 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-976f468a-a1f2-4152-8038-e63d05d3481e tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] 10.222.0.20 "PUT /compute/v2.1/servers/930b527f-b438-4dca-821a-c23a37020707/tags/tempest-tag-1836927395" status: 201 len: 0 microversion: 2.26 time: 0.335539 Oct 04 18:37:02.666099 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1097/2277] 10.222.0.20 () {62 vars in 1380 bytes} [Tue Oct 4 18:37:02 2022] PUT /compute/v2.1/servers/930b527f-b438-4dca-821a-c23a37020707/tags/tempest-tag-1836927395 => generated 0 bytes in 337 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 04 18:37:02.672295 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c1aca193-4b13-4d5a-a2b4-1a62f2cd1c7b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:02.672928 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c1aca193-4b13-4d5a-a2b4-1a62f2cd1c7b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: cd74aff9-f694-49f3-a1cc-2095b71cd9e5] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:02.692385 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c1aca193-4b13-4d5a-a2b4-1a62f2cd1c7b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:02.692984 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c1aca193-4b13-4d5a-a2b4-1a62f2cd1c7b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:02.693435 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c1aca193-4b13-4d5a-a2b4-1a62f2cd1c7b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:02.694155 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c1aca193-4b13-4d5a-a2b4-1a62f2cd1c7b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:02.694622 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c1aca193-4b13-4d5a-a2b4-1a62f2cd1c7b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:02.695054 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c1aca193-4b13-4d5a-a2b4-1a62f2cd1c7b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:03.203619 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7bf02c6e-868d-460b-b851-03236c65ea2c tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8356b47bd87f42e2b642c6df82014e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8869e8a46f40b18434fbe68d819dc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:03.211987 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7bf02c6e-868d-460b-b851-03236c65ea2c tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] 10.222.0.20 "GET /compute/v2.1/servers/94cff31c-a849-4365-b9e8-326613749226" status: 200 len: 1316 microversion: 2.1 time: 0.579145 Oct 04 18:37:03.240800 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1181/2278] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:02 2022] GET /compute/v2.1/servers/94cff31c-a849-4365-b9e8-326613749226 => generated 1316 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:03.250128 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-df72b342-9028-4181-b978-52967345006b tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Calling method '.version_select at 0x7fe25d19fa60>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:03.312798 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-df72b342-9028-4181-b978-52967345006b tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:03.314850 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-df72b342-9028-4181-b978-52967345006b tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:03.316003 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-df72b342-9028-4181-b978-52967345006b tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:03.322722 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-df72b342-9028-4181-b978-52967345006b tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] [instance: 930b527f-b438-4dca-821a-c23a37020707] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:03.348878 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-df72b342-9028-4181-b978-52967345006b tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:03.352221 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-df72b342-9028-4181-b978-52967345006b tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:03.353943 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-df72b342-9028-4181-b978-52967345006b tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:03.360246 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-df72b342-9028-4181-b978-52967345006b tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:03.361888 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-df72b342-9028-4181-b978-52967345006b tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:03.365421 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-df72b342-9028-4181-b978-52967345006b tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:03.380745 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c1aca193-4b13-4d5a-a2b4-1a62f2cd1c7b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:03.390556 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c1aca193-4b13-4d5a-a2b4-1a62f2cd1c7b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:03.392022 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c1aca193-4b13-4d5a-a2b4-1a62f2cd1c7b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:03.402629 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c1aca193-4b13-4d5a-a2b4-1a62f2cd1c7b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5" status: 200 len: 1486 microversion: 2.25 time: 0.739596 Oct 04 18:37:03.403700 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1098/2279] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:02 2022] GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5 => generated 1486 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:37:03.416263 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-5538b4d7-6285-4130-b4e3-481c23f1006d req-24faeeb7-1769-41e1-9ce2-14cd7b570a66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98dfffc8-51aa-407a-a374-8e120ec43a31", "tag": "0f1337d3-c904-4533-8791-cffcbc2b23d5"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:03.440217 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-5538b4d7-6285-4130-b4e3-481c23f1006d req-24faeeb7-1769-41e1-9ce2-14cd7b570a66 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:03.441175 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-5538b4d7-6285-4130-b4e3-481c23f1006d req-24faeeb7-1769-41e1-9ce2-14cd7b570a66 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:03.441769 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-5538b4d7-6285-4130-b4e3-481c23f1006d req-24faeeb7-1769-41e1-9ce2-14cd7b570a66 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:03.462319 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-5538b4d7-6285-4130-b4e3-481c23f1006d req-24faeeb7-1769-41e1-9ce2-14cd7b570a66 service nova] Creating event network-changed:0f1337d3-c904-4533-8791-cffcbc2b23d5 for instance 98dfffc8-51aa-407a-a374-8e120ec43a31 on n-h2-850501-14 Oct 04 18:37:03.486939 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-5538b4d7-6285-4130-b4e3-481c23f1006d req-24faeeb7-1769-41e1-9ce2-14cd7b570a66 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067620 Oct 04 18:37:03.487974 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1099/2280] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:37:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:03.489938 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-df72b342-9028-4181-b978-52967345006b tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:03.490434 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-df72b342-9028-4181-b978-52967345006b tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:03.490870 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-df72b342-9028-4181-b978-52967345006b tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:03.494307 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-52b11758-b53c-4af6-be97-7a9690ad63e4 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:03.495271 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-52b11758-b53c-4af6-be97-7a9690ad63e4 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] [instance: 616e21b9-c93b-4ff0-8740-24c613f4d708] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:03.506341 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-df72b342-9028-4181-b978-52967345006b tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:03.506829 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-df72b342-9028-4181-b978-52967345006b tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:03.507255 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-df72b342-9028-4181-b978-52967345006b tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:03.508507 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-52b11758-b53c-4af6-be97-7a9690ad63e4 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:03.509222 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-52b11758-b53c-4af6-be97-7a9690ad63e4 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:03.509870 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-52b11758-b53c-4af6-be97-7a9690ad63e4 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:03.512307 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-52b11758-b53c-4af6-be97-7a9690ad63e4 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:03.513521 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-52b11758-b53c-4af6-be97-7a9690ad63e4 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:03.515989 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-52b11758-b53c-4af6-be97-7a9690ad63e4 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:03.611381 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=96,nova_cell1:DELETE=1,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=1,nova_cell1:RELEASE=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:03.633703 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-df72b342-9028-4181-b978-52967345006b tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lazy-loading 'flavor' on Instance uuid 930b527f-b438-4dca-821a-c23a37020707 {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:37:03.658862 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-df72b342-9028-4181-b978-52967345006b tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] 10.222.0.20 "PUT /compute/v2.1/servers/930b527f-b438-4dca-821a-c23a37020707/tags/tempest-tag-814202719" status: 201 len: 0 microversion: 2.26 time: 0.416731 Oct 04 18:37:03.661535 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1182/2281] 10.222.0.20 () {62 vars in 1377 bytes} [Tue Oct 4 18:37:03 2022] PUT /compute/v2.1/servers/930b527f-b438-4dca-821a-c23a37020707/tags/tempest-tag-814202719 => generated 0 bytes in 420 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 04 18:37:03.667001 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-50ec91dc-d422-4bf0-934d-f03e87688ea8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:03.676628 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-50ec91dc-d422-4bf0-934d-f03e87688ea8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 98dfffc8-51aa-407a-a374-8e120ec43a31] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:03.678962 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-50ec91dc-d422-4bf0-934d-f03e87688ea8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:03.679472 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-50ec91dc-d422-4bf0-934d-f03e87688ea8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:03.679913 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-50ec91dc-d422-4bf0-934d-f03e87688ea8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:03.680709 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-50ec91dc-d422-4bf0-934d-f03e87688ea8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:03.681380 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-50ec91dc-d422-4bf0-934d-f03e87688ea8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:03.681823 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-50ec91dc-d422-4bf0-934d-f03e87688ea8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:04.475909 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-52b11758-b53c-4af6-be97-7a9690ad63e4 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb44381220d43b7bdfa744a1dc410a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3242afeef424d588cf102a2f0f38020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:04.489973 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-52b11758-b53c-4af6-be97-7a9690ad63e4 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] 10.222.0.20 "GET /compute/v2.1/servers/616e21b9-c93b-4ff0-8740-24c613f4d708" status: 200 len: 1333 microversion: 2.1 time: 0.999945 Oct 04 18:37:04.492372 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1100/2282] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:03 2022] GET /compute/v2.1/servers/616e21b9-c93b-4ff0-8740-24c613f4d708 => generated 1333 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:04.508883 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-cdae619c-7d9e-44d5-8968-167c3b7be184 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Calling method '.version_select at 0x7fe2594cee50>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:04.524818 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cdae619c-7d9e-44d5-8968-167c3b7be184 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:04.525665 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cdae619c-7d9e-44d5-8968-167c3b7be184 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:04.526346 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cdae619c-7d9e-44d5-8968-167c3b7be184 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:04.527045 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-cdae619c-7d9e-44d5-8968-167c3b7be184 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] [instance: 930b527f-b438-4dca-821a-c23a37020707] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:04.538401 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cdae619c-7d9e-44d5-8968-167c3b7be184 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:04.539142 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cdae619c-7d9e-44d5-8968-167c3b7be184 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:04.539790 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cdae619c-7d9e-44d5-8968-167c3b7be184 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:04.540736 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cdae619c-7d9e-44d5-8968-167c3b7be184 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:04.541404 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cdae619c-7d9e-44d5-8968-167c3b7be184 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:04.542055 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cdae619c-7d9e-44d5-8968-167c3b7be184 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:04.569782 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cdae619c-7d9e-44d5-8968-167c3b7be184 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:04.570601 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cdae619c-7d9e-44d5-8968-167c3b7be184 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:04.571299 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cdae619c-7d9e-44d5-8968-167c3b7be184 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:04.587996 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-50ec91dc-d422-4bf0-934d-f03e87688ea8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:04.600102 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-50ec91dc-d422-4bf0-934d-f03e87688ea8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31" status: 200 len: 1211 microversion: 2.1 time: 0.937379 Oct 04 18:37:04.618367 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1183/2283] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:03 2022] GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31 => generated 1211 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:04.624871 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-10727590-7c12-47d7-8f30-936d969b7df2 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:04.625542 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-10727590-7c12-47d7-8f30-936d969b7df2 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] [instance: 94cff31c-a849-4365-b9e8-326613749226] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:04.644269 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-10727590-7c12-47d7-8f30-936d969b7df2 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:04.644771 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-10727590-7c12-47d7-8f30-936d969b7df2 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:04.645205 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-10727590-7c12-47d7-8f30-936d969b7df2 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:04.646003 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-10727590-7c12-47d7-8f30-936d969b7df2 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:04.646456 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-10727590-7c12-47d7-8f30-936d969b7df2 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:04.648133 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-10727590-7c12-47d7-8f30-936d969b7df2 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:04.690117 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-cdae619c-7d9e-44d5-8968-167c3b7be184 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lazy-loading 'flavor' on Instance uuid 930b527f-b438-4dca-821a-c23a37020707 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:37:04.737636 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-cdae619c-7d9e-44d5-8968-167c3b7be184 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] 10.222.0.20 "DELETE /compute/v2.1/servers/930b527f-b438-4dca-821a-c23a37020707/tags" status: 204 len: 0 microversion: 2.26 time: 0.243618 Oct 04 18:37:04.738657 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1101/2284] 10.222.0.20 () {60 vars in 1295 bytes} [Tue Oct 4 18:37:04 2022] DELETE /compute/v2.1/servers/930b527f-b438-4dca-821a-c23a37020707/tags => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:37:04.744035 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-54759e2d-af26-4984-a9d9-21d4acd6c0d5 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:04.745298 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-54759e2d-af26-4984-a9d9-21d4acd6c0d5 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: cd74aff9-f694-49f3-a1cc-2095b71cd9e5] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:04.761811 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-54759e2d-af26-4984-a9d9-21d4acd6c0d5 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:04.765718 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-54759e2d-af26-4984-a9d9-21d4acd6c0d5 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:04.766108 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-54759e2d-af26-4984-a9d9-21d4acd6c0d5 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:04.768348 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-54759e2d-af26-4984-a9d9-21d4acd6c0d5 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:04.769037 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-54759e2d-af26-4984-a9d9-21d4acd6c0d5 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:04.769664 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-54759e2d-af26-4984-a9d9-21d4acd6c0d5 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:05.544565 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-10727590-7c12-47d7-8f30-936d969b7df2 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8356b47bd87f42e2b642c6df82014e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8869e8a46f40b18434fbe68d819dc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:05.556398 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=4 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:05.566642 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-10727590-7c12-47d7-8f30-936d969b7df2 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] 10.222.0.20 "GET /compute/v2.1/servers/94cff31c-a849-4365-b9e8-326613749226" status: 200 len: 1316 microversion: 2.1 time: 0.953761 Oct 04 18:37:05.575425 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1184/2285] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:04 2022] GET /compute/v2.1/servers/94cff31c-a849-4365-b9e8-326613749226 => generated 1316 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:05.581683 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ba451a23-b105-452e-bea7-eada26087871 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Calling method '.version_select at 0x7fe25d36dd30>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:05.589931 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-54759e2d-af26-4984-a9d9-21d4acd6c0d5 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:05.603594 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-54759e2d-af26-4984-a9d9-21d4acd6c0d5 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:05.604695 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ba451a23-b105-452e-bea7-eada26087871 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:05.605353 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ba451a23-b105-452e-bea7-eada26087871 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:05.606664 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-54759e2d-af26-4984-a9d9-21d4acd6c0d5 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:05.606787 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ba451a23-b105-452e-bea7-eada26087871 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:05.607031 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-54759e2d-af26-4984-a9d9-21d4acd6c0d5 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5" status: 200 len: 1486 microversion: 2.25 time: 0.866796 Oct 04 18:37:05.608935 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1102/2286] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:04 2022] GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5 => generated 1486 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:37:05.619604 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a74f783b-0eab-4879-9dd9-d59f4c353b85 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:05.622215 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a74f783b-0eab-4879-9dd9-d59f4c353b85 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] [instance: 616e21b9-c93b-4ff0-8740-24c613f4d708] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:05.656605 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a74f783b-0eab-4879-9dd9-d59f4c353b85 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:05.658420 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=14 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:05.658875 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a74f783b-0eab-4879-9dd9-d59f4c353b85 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:05.658875 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a74f783b-0eab-4879-9dd9-d59f4c353b85 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:05.660844 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ba451a23-b105-452e-bea7-eada26087871 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] 10.222.0.20 "GET /compute/v2.1/servers/930b527f-b438-4dca-821a-c23a37020707/tags" status: 200 len: 12 microversion: 2.26 time: 0.084054 Oct 04 18:37:05.662211 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a74f783b-0eab-4879-9dd9-d59f4c353b85 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:05.669256 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1185/2287] 10.222.0.20 () {60 vars in 1292 bytes} [Tue Oct 4 18:37:05 2022] GET /compute/v2.1/servers/930b527f-b438-4dca-821a-c23a37020707/tags => generated 12 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:05.669803 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a74f783b-0eab-4879-9dd9-d59f4c353b85 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:05.671157 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a74f783b-0eab-4879-9dd9-d59f4c353b85 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:05.676412 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-dc23ad14-a2f1-4e75-9147-148cf53e1e0e tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:05.677217 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-dc23ad14-a2f1-4e75-9147-148cf53e1e0e tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 98dfffc8-51aa-407a-a374-8e120ec43a31] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:05.728373 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dc23ad14-a2f1-4e75-9147-148cf53e1e0e tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:05.728840 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dc23ad14-a2f1-4e75-9147-148cf53e1e0e tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:05.729290 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dc23ad14-a2f1-4e75-9147-148cf53e1e0e tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:05.745380 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dc23ad14-a2f1-4e75-9147-148cf53e1e0e tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:05.746859 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dc23ad14-a2f1-4e75-9147-148cf53e1e0e tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:05.748649 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dc23ad14-a2f1-4e75-9147-148cf53e1e0e tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:06.387034 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a74f783b-0eab-4879-9dd9-d59f4c353b85 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb44381220d43b7bdfa744a1dc410a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3242afeef424d588cf102a2f0f38020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:06.399698 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a74f783b-0eab-4879-9dd9-d59f4c353b85 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] 10.222.0.20 "GET /compute/v2.1/servers/616e21b9-c93b-4ff0-8740-24c613f4d708" status: 200 len: 1333 microversion: 2.1 time: 0.789257 Oct 04 18:37:06.418713 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1103/2288] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:05 2022] GET /compute/v2.1/servers/616e21b9-c93b-4ff0-8740-24c613f4d708 => generated 1333 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:06.432540 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-173e0f93-53ec-49b7-8432-106691ba9908 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Calling method '.version_select at 0x7fe25989c4c0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:06.461350 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-173e0f93-53ec-49b7-8432-106691ba9908 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:06.462170 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-173e0f93-53ec-49b7-8432-106691ba9908 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:06.462851 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-173e0f93-53ec-49b7-8432-106691ba9908 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:06.463494 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-173e0f93-53ec-49b7-8432-106691ba9908 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] [instance: 930b527f-b438-4dca-821a-c23a37020707] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:06.483673 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-173e0f93-53ec-49b7-8432-106691ba9908 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:06.485372 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-173e0f93-53ec-49b7-8432-106691ba9908 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:06.486145 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-173e0f93-53ec-49b7-8432-106691ba9908 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:06.487345 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-173e0f93-53ec-49b7-8432-106691ba9908 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:06.488028 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-173e0f93-53ec-49b7-8432-106691ba9908 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:06.491185 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-173e0f93-53ec-49b7-8432-106691ba9908 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:06.556748 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-173e0f93-53ec-49b7-8432-106691ba9908 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:06.557282 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-173e0f93-53ec-49b7-8432-106691ba9908 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:06.560124 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-173e0f93-53ec-49b7-8432-106691ba9908 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:06.590700 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-173e0f93-53ec-49b7-8432-106691ba9908 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lazy-loading 'flavor' on Instance uuid 930b527f-b438-4dca-821a-c23a37020707 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:37:06.625837 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-173e0f93-53ec-49b7-8432-106691ba9908 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] 10.222.0.20 "DELETE /compute/v2.1/servers/930b527f-b438-4dca-821a-c23a37020707/tags" status: 204 len: 0 microversion: 2.26 time: 0.204174 Oct 04 18:37:06.632558 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1104/2289] 10.222.0.20 () {60 vars in 1295 bytes} [Tue Oct 4 18:37:06 2022] DELETE /compute/v2.1/servers/930b527f-b438-4dca-821a-c23a37020707/tags => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:37:06.646218 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-cfedad72-34de-4695-b8f5-69f4c43f9bc2 req-fe5c3a6c-ff7a-4099-bbb9-2dcb9592a91a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94cff31c-a849-4365-b9e8-326613749226", "tag": "df7147f4-8667-4f09-933e-1ff7b252b5f1"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:06.664552 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-cfedad72-34de-4695-b8f5-69f4c43f9bc2 req-fe5c3a6c-ff7a-4099-bbb9-2dcb9592a91a service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:06.668856 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-cfedad72-34de-4695-b8f5-69f4c43f9bc2 req-fe5c3a6c-ff7a-4099-bbb9-2dcb9592a91a service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:06.669533 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-cfedad72-34de-4695-b8f5-69f4c43f9bc2 req-fe5c3a6c-ff7a-4099-bbb9-2dcb9592a91a service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:06.700458 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-cfedad72-34de-4695-b8f5-69f4c43f9bc2 req-fe5c3a6c-ff7a-4099-bbb9-2dcb9592a91a service nova] Creating event network-changed:df7147f4-8667-4f09-933e-1ff7b252b5f1 for instance 94cff31c-a849-4365-b9e8-326613749226 on n-h1-850501-14 Oct 04 18:37:06.709092 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-cfedad72-34de-4695-b8f5-69f4c43f9bc2 req-fe5c3a6c-ff7a-4099-bbb9-2dcb9592a91a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074459 Oct 04 18:37:06.710602 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1105/2290] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:37:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:06.719507 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-980d1dc6-82c3-4796-9ffd-fda67401f423 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:06.720644 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-980d1dc6-82c3-4796-9ffd-fda67401f423 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] [instance: 94cff31c-a849-4365-b9e8-326613749226] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:06.728761 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-980d1dc6-82c3-4796-9ffd-fda67401f423 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:06.729263 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-980d1dc6-82c3-4796-9ffd-fda67401f423 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:06.729763 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-980d1dc6-82c3-4796-9ffd-fda67401f423 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:06.730989 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-980d1dc6-82c3-4796-9ffd-fda67401f423 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:06.739926 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-980d1dc6-82c3-4796-9ffd-fda67401f423 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:06.739926 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-980d1dc6-82c3-4796-9ffd-fda67401f423 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:06.808321 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-dc23ad14-a2f1-4e75-9147-148cf53e1e0e tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:06.821317 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-dc23ad14-a2f1-4e75-9147-148cf53e1e0e tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31" status: 200 len: 1211 microversion: 2.1 time: 1.156840 Oct 04 18:37:06.839945 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1186/2291] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:05 2022] GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31 => generated 1211 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:06.845851 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5c9a9edf-3bbd-46c6-9f4e-25d08951de17 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:06.855224 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5c9a9edf-3bbd-46c6-9f4e-25d08951de17 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: cd74aff9-f694-49f3-a1cc-2095b71cd9e5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:06.872474 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5c9a9edf-3bbd-46c6-9f4e-25d08951de17 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:06.872474 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5c9a9edf-3bbd-46c6-9f4e-25d08951de17 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:06.872474 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5c9a9edf-3bbd-46c6-9f4e-25d08951de17 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:06.872474 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5c9a9edf-3bbd-46c6-9f4e-25d08951de17 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:06.872474 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5c9a9edf-3bbd-46c6-9f4e-25d08951de17 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:06.872474 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5c9a9edf-3bbd-46c6-9f4e-25d08951de17 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:07.281004 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-980d1dc6-82c3-4796-9ffd-fda67401f423 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8356b47bd87f42e2b642c6df82014e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8869e8a46f40b18434fbe68d819dc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:07.293871 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-980d1dc6-82c3-4796-9ffd-fda67401f423 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] 10.222.0.20 "GET /compute/v2.1/servers/94cff31c-a849-4365-b9e8-326613749226" status: 200 len: 1316 microversion: 2.1 time: 0.581917 Oct 04 18:37:07.299366 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1106/2292] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:06 2022] GET /compute/v2.1/servers/94cff31c-a849-4365-b9e8-326613749226 => generated 1316 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:07.313000 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-408113ef-33b4-4955-b391-98f3d9c40007 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Calling method '.version_select at 0x7fe258bf8820>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:07.333882 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-408113ef-33b4-4955-b391-98f3d9c40007 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:07.334632 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-408113ef-33b4-4955-b391-98f3d9c40007 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:07.335426 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-408113ef-33b4-4955-b391-98f3d9c40007 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:07.336111 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-408113ef-33b4-4955-b391-98f3d9c40007 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] [instance: 930b527f-b438-4dca-821a-c23a37020707] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:07.343084 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-408113ef-33b4-4955-b391-98f3d9c40007 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:07.346587 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-408113ef-33b4-4955-b391-98f3d9c40007 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:07.346587 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-408113ef-33b4-4955-b391-98f3d9c40007 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:07.346587 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-408113ef-33b4-4955-b391-98f3d9c40007 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:07.346587 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-408113ef-33b4-4955-b391-98f3d9c40007 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:07.346587 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-408113ef-33b4-4955-b391-98f3d9c40007 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:07.378050 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5c9a9edf-3bbd-46c6-9f4e-25d08951de17 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:07.393127 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5c9a9edf-3bbd-46c6-9f4e-25d08951de17 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:07.395155 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5c9a9edf-3bbd-46c6-9f4e-25d08951de17 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:07.397883 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5c9a9edf-3bbd-46c6-9f4e-25d08951de17 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5" status: 200 len: 1486 microversion: 2.25 time: 0.556120 Oct 04 18:37:07.399825 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1187/2293] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:06 2022] GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5 => generated 1486 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:37:07.408652 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-408113ef-33b4-4955-b391-98f3d9c40007 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:07.409142 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-408113ef-33b4-4955-b391-98f3d9c40007 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:07.411316 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-408113ef-33b4-4955-b391-98f3d9c40007 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:07.434188 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ac630150-1818-4d10-aedf-9d6b541f1646 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:07.435159 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ac630150-1818-4d10-aedf-9d6b541f1646 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] [instance: 616e21b9-c93b-4ff0-8740-24c613f4d708] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:07.435293 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-408113ef-33b4-4955-b391-98f3d9c40007 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:07.437933 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-408113ef-33b4-4955-b391-98f3d9c40007 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:07.438878 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-408113ef-33b4-4955-b391-98f3d9c40007 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:07.480111 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ac630150-1818-4d10-aedf-9d6b541f1646 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:07.481934 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ac630150-1818-4d10-aedf-9d6b541f1646 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:07.482875 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ac630150-1818-4d10-aedf-9d6b541f1646 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:07.484855 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ac630150-1818-4d10-aedf-9d6b541f1646 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:07.486794 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ac630150-1818-4d10-aedf-9d6b541f1646 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:07.487495 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ac630150-1818-4d10-aedf-9d6b541f1646 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:07.596703 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-408113ef-33b4-4955-b391-98f3d9c40007 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lazy-loading 'flavor' on Instance uuid 930b527f-b438-4dca-821a-c23a37020707 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:37:07.629333 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-408113ef-33b4-4955-b391-98f3d9c40007 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] 10.222.0.20 "PUT /compute/v2.1/servers/930b527f-b438-4dca-821a-c23a37020707/tags/tempest-tag-1240027755" status: 201 len: 0 microversion: 2.26 time: 0.326497 Oct 04 18:37:07.630561 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1107/2294] 10.222.0.20 () {62 vars in 1380 bytes} [Tue Oct 4 18:37:07 2022] PUT /compute/v2.1/servers/930b527f-b438-4dca-821a-c23a37020707/tags/tempest-tag-1240027755 => generated 0 bytes in 330 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 04 18:37:07.641373 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-faf5d634-27b8-429c-84fb-02be15af730e tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Calling method '.version_select at 0x7fe2590989d0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:07.674993 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-faf5d634-27b8-429c-84fb-02be15af730e tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:07.680380 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-faf5d634-27b8-429c-84fb-02be15af730e tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:07.686558 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-faf5d634-27b8-429c-84fb-02be15af730e tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:07.686558 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-faf5d634-27b8-429c-84fb-02be15af730e tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] [instance: 930b527f-b438-4dca-821a-c23a37020707] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:07.700903 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-faf5d634-27b8-429c-84fb-02be15af730e tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:07.701701 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-faf5d634-27b8-429c-84fb-02be15af730e tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:07.702359 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-faf5d634-27b8-429c-84fb-02be15af730e tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:07.704028 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-faf5d634-27b8-429c-84fb-02be15af730e tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:07.704921 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-faf5d634-27b8-429c-84fb-02be15af730e tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:07.705809 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-faf5d634-27b8-429c-84fb-02be15af730e tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:07.754126 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-faf5d634-27b8-429c-84fb-02be15af730e tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:07.754625 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-faf5d634-27b8-429c-84fb-02be15af730e tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:07.755060 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-faf5d634-27b8-429c-84fb-02be15af730e tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:07.794149 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-faf5d634-27b8-429c-84fb-02be15af730e tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:07.796611 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-faf5d634-27b8-429c-84fb-02be15af730e tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:07.797228 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-faf5d634-27b8-429c-84fb-02be15af730e tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:07.854871 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ac630150-1818-4d10-aedf-9d6b541f1646 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb44381220d43b7bdfa744a1dc410a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3242afeef424d588cf102a2f0f38020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:07.867643 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ac630150-1818-4d10-aedf-9d6b541f1646 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] 10.222.0.20 "GET /compute/v2.1/servers/616e21b9-c93b-4ff0-8740-24c613f4d708" status: 200 len: 1333 microversion: 2.1 time: 0.437479 Oct 04 18:37:07.870164 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1188/2295] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:07 2022] GET /compute/v2.1/servers/616e21b9-c93b-4ff0-8740-24c613f4d708 => generated 1333 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:37:07.876318 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5440d2c4-56aa-48fc-8e8f-2587a5f1554e tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:07.878506 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5440d2c4-56aa-48fc-8e8f-2587a5f1554e tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 98dfffc8-51aa-407a-a374-8e120ec43a31] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:07.900915 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5440d2c4-56aa-48fc-8e8f-2587a5f1554e tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:07.901588 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5440d2c4-56aa-48fc-8e8f-2587a5f1554e tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:07.903447 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5440d2c4-56aa-48fc-8e8f-2587a5f1554e tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:07.904238 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5440d2c4-56aa-48fc-8e8f-2587a5f1554e tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:07.904735 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5440d2c4-56aa-48fc-8e8f-2587a5f1554e tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:07.905867 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5440d2c4-56aa-48fc-8e8f-2587a5f1554e tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:07.982268 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-faf5d634-27b8-429c-84fb-02be15af730e tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lazy-loading 'flavor' on Instance uuid 930b527f-b438-4dca-821a-c23a37020707 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:37:07.991582 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=89,nova_cell1:SAVEPOINT=3,nova_cell1:INSERT=3,nova_cell1:RELEASE=3,nova_cell1:DELETE=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:08.013479 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-faf5d634-27b8-429c-84fb-02be15af730e tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] 10.222.0.20 "PUT /compute/v2.1/servers/930b527f-b438-4dca-821a-c23a37020707/tags/tempest-tag-942339350" status: 201 len: 0 microversion: 2.26 time: 0.377289 Oct 04 18:37:08.020015 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1108/2296] 10.222.0.20 () {62 vars in 1377 bytes} [Tue Oct 4 18:37:07 2022] PUT /compute/v2.1/servers/930b527f-b438-4dca-821a-c23a37020707/tags/tempest-tag-942339350 => generated 0 bytes in 385 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) Oct 04 18:37:08.025896 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4ba2197e-6b0f-41f0-a141-666a07cd20c1 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Action: 'update_all', calling method: .version_select at 0x7fe25910c670>, body: {"tags": ["tempest-tag-1279821026", "tempest-tag-1257105169"]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:08.050415 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4ba2197e-6b0f-41f0-a141-666a07cd20c1 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:08.051079 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4ba2197e-6b0f-41f0-a141-666a07cd20c1 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:08.051320 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4ba2197e-6b0f-41f0-a141-666a07cd20c1 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:08.057335 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-4ba2197e-6b0f-41f0-a141-666a07cd20c1 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] [instance: 930b527f-b438-4dca-821a-c23a37020707] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:08.077259 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4ba2197e-6b0f-41f0-a141-666a07cd20c1 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:08.077989 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4ba2197e-6b0f-41f0-a141-666a07cd20c1 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:08.078576 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4ba2197e-6b0f-41f0-a141-666a07cd20c1 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:08.081244 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4ba2197e-6b0f-41f0-a141-666a07cd20c1 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:08.081880 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4ba2197e-6b0f-41f0-a141-666a07cd20c1 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:08.083766 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4ba2197e-6b0f-41f0-a141-666a07cd20c1 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:08.168015 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5440d2c4-56aa-48fc-8e8f-2587a5f1554e tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:08.176309 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4ba2197e-6b0f-41f0-a141-666a07cd20c1 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:08.176925 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4ba2197e-6b0f-41f0-a141-666a07cd20c1 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:08.177868 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4ba2197e-6b0f-41f0-a141-666a07cd20c1 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:08.182583 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5440d2c4-56aa-48fc-8e8f-2587a5f1554e tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31" status: 200 len: 1211 microversion: 2.1 time: 0.309223 Oct 04 18:37:08.183898 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1189/2297] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:07 2022] GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31 => generated 1211 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:08.192785 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7b283a8f-08af-45d6-a2cd-6cec0fcf1e1e tempest-MigrationsAdminTest-1101631867 tempest-MigrationsAdminTest-1101631867-project-admin] Calling method '.version_select at 0x7fe259751700>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:08.198468 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7b283a8f-08af-45d6-a2cd-6cec0fcf1e1e tempest-MigrationsAdminTest-1101631867 tempest-MigrationsAdminTest-1101631867-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:08.199132 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7b283a8f-08af-45d6-a2cd-6cec0fcf1e1e tempest-MigrationsAdminTest-1101631867 tempest-MigrationsAdminTest-1101631867-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:08.199754 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7b283a8f-08af-45d6-a2cd-6cec0fcf1e1e tempest-MigrationsAdminTest-1101631867 tempest-MigrationsAdminTest-1101631867-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:08.226714 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7b283a8f-08af-45d6-a2cd-6cec0fcf1e1e tempest-MigrationsAdminTest-1101631867 tempest-MigrationsAdminTest-1101631867-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 3526 microversion: 2.1 time: 0.041172 Oct 04 18:37:08.227588 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1190/2298] 10.222.0.20 () {58 vars in 1143 bytes} [Tue Oct 4 18:37:08 2022] GET /compute/v2.1/os-migrations => generated 3526 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:08.259380 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-31d63315-766d-4459-80a7-083e710a02ba tempest-MigrationsAdminTest-1101631867 tempest-MigrationsAdminTest-1101631867-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:08.270435 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-31d63315-766d-4459-80a7-083e710a02ba tempest-MigrationsAdminTest-1101631867 tempest-MigrationsAdminTest-1101631867-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015133 Oct 04 18:37:08.271288 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1191/2299] 10.222.0.20 () {58 vars in 1137 bytes} [Tue Oct 4 18:37:08 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:37:08.285189 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d8538b39-d345-4647-adea-e12accef8103 tempest-MigrationsAdminTest-1101631867 tempest-MigrationsAdminTest-1101631867-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-1193614459", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:08.364128 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-4ba2197e-6b0f-41f0-a141-666a07cd20c1 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lazy-loading 'flavor' on Instance uuid 930b527f-b438-4dca-821a-c23a37020707 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:37:08.383863 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-4ba2197e-6b0f-41f0-a141-666a07cd20c1 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] 10.222.0.20 "PUT /compute/v2.1/servers/930b527f-b438-4dca-821a-c23a37020707/tags" status: 200 len: 62 microversion: 2.26 time: 0.362380 Oct 04 18:37:08.389893 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1109/2300] 10.222.0.20 () {62 vars in 1312 bytes} [Tue Oct 4 18:37:08 2022] PUT /compute/v2.1/servers/930b527f-b438-4dca-821a-c23a37020707/tags => generated 62 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:08.395403 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-eb65ae92-29a6-4e3b-9276-1b7ecd507394 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:08.396073 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-eb65ae92-29a6-4e3b-9276-1b7ecd507394 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] [instance: 94cff31c-a849-4365-b9e8-326613749226] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:08.402614 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eb65ae92-29a6-4e3b-9276-1b7ecd507394 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:08.403229 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eb65ae92-29a6-4e3b-9276-1b7ecd507394 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:08.403678 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eb65ae92-29a6-4e3b-9276-1b7ecd507394 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:08.404429 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eb65ae92-29a6-4e3b-9276-1b7ecd507394 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:08.407478 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eb65ae92-29a6-4e3b-9276-1b7ecd507394 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:08.408916 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d8538b39-d345-4647-adea-e12accef8103 tempest-MigrationsAdminTest-1101631867 tempest-MigrationsAdminTest-1101631867-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.129154 Oct 04 18:37:08.416530 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1192/2301] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Oct 4 18:37:08 2022] POST /compute/v2.1/flavors => generated 499 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:08.416623 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eb65ae92-29a6-4e3b-9276-1b7ecd507394 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:08.416709 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ce209cbf-8072-4cdc-9962-2dd162de229f tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Calling method '.version_select at 0x7fe25d29f1f0>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:08.442659 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ce209cbf-8072-4cdc-9962-2dd162de229f tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:08.442898 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ce209cbf-8072-4cdc-9962-2dd162de229f tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:08.443329 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ce209cbf-8072-4cdc-9962-2dd162de229f tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:08.460877 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ce209cbf-8072-4cdc-9962-2dd162de229f tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] 10.222.0.20 "GET /compute/v2.1/servers/930b527f-b438-4dca-821a-c23a37020707/tags" status: 200 len: 62 microversion: 2.26 time: 0.049918 Oct 04 18:37:08.461677 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1193/2302] 10.222.0.20 () {60 vars in 1292 bytes} [Tue Oct 4 18:37:08 2022] GET /compute/v2.1/servers/930b527f-b438-4dca-821a-c23a37020707/tags => generated 62 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:08.478155 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-bac3e95e-347a-4860-bf0d-0c07473ca614 tempest-MigrationsAdminTest-1101631867 tempest-MigrationsAdminTest-1101631867-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:08.497518 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-bac3e95e-347a-4860-bf0d-0c07473ca614 tempest-MigrationsAdminTest-1101631867 tempest-MigrationsAdminTest-1101631867-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.034867 Oct 04 18:37:08.498307 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1194/2303] 10.222.0.20 () {58 vars in 1182 bytes} [Tue Oct 4 18:37:08 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:37:08.505578 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-24d695c6-a38f-48fe-8472-bb4559a48d6e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:08.506204 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-24d695c6-a38f-48fe-8472-bb4559a48d6e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: cd74aff9-f694-49f3-a1cc-2095b71cd9e5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:08.528529 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-24d695c6-a38f-48fe-8472-bb4559a48d6e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:08.536621 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-24d695c6-a38f-48fe-8472-bb4559a48d6e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:08.537107 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-24d695c6-a38f-48fe-8472-bb4559a48d6e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:08.537866 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-24d695c6-a38f-48fe-8472-bb4559a48d6e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:08.538340 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-24d695c6-a38f-48fe-8472-bb4559a48d6e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:08.538772 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-24d695c6-a38f-48fe-8472-bb4559a48d6e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:08.786310 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-eb65ae92-29a6-4e3b-9276-1b7ecd507394 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8356b47bd87f42e2b642c6df82014e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8869e8a46f40b18434fbe68d819dc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:08.800004 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-eb65ae92-29a6-4e3b-9276-1b7ecd507394 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] 10.222.0.20 "GET /compute/v2.1/servers/94cff31c-a849-4365-b9e8-326613749226" status: 200 len: 1316 microversion: 2.1 time: 0.405247 Oct 04 18:37:08.800004 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1110/2304] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:08 2022] GET /compute/v2.1/servers/94cff31c-a849-4365-b9e8-326613749226 => generated 1316 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:08.803175 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9bb75d15-8dfe-4e83-8ba2-e22df4476134 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Calling method '.version_select at 0x7fe259102c10>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:08.814428 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9bb75d15-8dfe-4e83-8ba2-e22df4476134 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:08.815898 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9bb75d15-8dfe-4e83-8ba2-e22df4476134 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:08.817442 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9bb75d15-8dfe-4e83-8ba2-e22df4476134 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:08.818141 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-9bb75d15-8dfe-4e83-8ba2-e22df4476134 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] [instance: 930b527f-b438-4dca-821a-c23a37020707] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:08.826630 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9bb75d15-8dfe-4e83-8ba2-e22df4476134 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:08.827382 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9bb75d15-8dfe-4e83-8ba2-e22df4476134 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:08.828032 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9bb75d15-8dfe-4e83-8ba2-e22df4476134 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:08.828991 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9bb75d15-8dfe-4e83-8ba2-e22df4476134 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:08.829683 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9bb75d15-8dfe-4e83-8ba2-e22df4476134 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:08.830448 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9bb75d15-8dfe-4e83-8ba2-e22df4476134 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:08.855409 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9bb75d15-8dfe-4e83-8ba2-e22df4476134 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:08.856486 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9bb75d15-8dfe-4e83-8ba2-e22df4476134 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:08.857269 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9bb75d15-8dfe-4e83-8ba2-e22df4476134 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:08.888703 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-24d695c6-a38f-48fe-8472-bb4559a48d6e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:08.897927 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-24d695c6-a38f-48fe-8472-bb4559a48d6e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:08.899765 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-24d695c6-a38f-48fe-8472-bb4559a48d6e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:08.901241 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-24d695c6-a38f-48fe-8472-bb4559a48d6e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5" status: 200 len: 1486 microversion: 2.25 time: 0.401989 Oct 04 18:37:08.916262 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1195/2305] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:08 2022] GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5 => generated 1486 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:37:08.925694 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-280c1b57-d664-41fd-94b5-1a0b6a28d972 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-191192628", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "2016a852-14f5-4c8b-9c97-7c97aa0c71e6"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:08.986023 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-280c1b57-d664-41fd-94b5-1a0b6a28d972 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] validate_networks() for None {{(pid=123002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:37:09.028187 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-9bb75d15-8dfe-4e83-8ba2-e22df4476134 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lazy-loading 'flavor' on Instance uuid 930b527f-b438-4dca-821a-c23a37020707 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:37:09.047904 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9bb75d15-8dfe-4e83-8ba2-e22df4476134 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] 10.222.0.20 "DELETE /compute/v2.1/servers/930b527f-b438-4dca-821a-c23a37020707/tags" status: 204 len: 0 microversion: 2.26 time: 0.249072 Oct 04 18:37:09.048873 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1111/2306] 10.222.0.20 () {60 vars in 1295 bytes} [Tue Oct 4 18:37:08 2022] DELETE /compute/v2.1/servers/930b527f-b438-4dca-821a-c23a37020707/tags => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:37:09.055911 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-93820113-171a-4b89-8396-22acf0dfdddc tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:09.057363 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-93820113-171a-4b89-8396-22acf0dfdddc tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] [instance: 616e21b9-c93b-4ff0-8740-24c613f4d708] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:09.075549 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-93820113-171a-4b89-8396-22acf0dfdddc tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:09.076660 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-93820113-171a-4b89-8396-22acf0dfdddc tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:09.077656 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-93820113-171a-4b89-8396-22acf0dfdddc tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:09.078918 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-93820113-171a-4b89-8396-22acf0dfdddc tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:09.080244 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-93820113-171a-4b89-8396-22acf0dfdddc tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:09.080843 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-93820113-171a-4b89-8396-22acf0dfdddc tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:09.081456 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=6 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:09.371146 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-93820113-171a-4b89-8396-22acf0dfdddc tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb44381220d43b7bdfa744a1dc410a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3242afeef424d588cf102a2f0f38020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:09.391037 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-93820113-171a-4b89-8396-22acf0dfdddc tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] 10.222.0.20 "GET /compute/v2.1/servers/616e21b9-c93b-4ff0-8740-24c613f4d708" status: 200 len: 1333 microversion: 2.1 time: 0.340630 Oct 04 18:37:09.417400 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1112/2307] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:09 2022] GET /compute/v2.1/servers/616e21b9-c93b-4ff0-8740-24c613f4d708 => generated 1333 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:09.427086 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d9772d40-544c-4203-8a06-9166d415e88e tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:09.428533 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d9772d40-544c-4203-8a06-9166d415e88e tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] [instance: 930b527f-b438-4dca-821a-c23a37020707] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:09.442112 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d9772d40-544c-4203-8a06-9166d415e88e tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:09.442784 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d9772d40-544c-4203-8a06-9166d415e88e tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:09.443526 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d9772d40-544c-4203-8a06-9166d415e88e tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:09.444527 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d9772d40-544c-4203-8a06-9166d415e88e tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:09.445144 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d9772d40-544c-4203-8a06-9166d415e88e tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:09.447079 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d9772d40-544c-4203-8a06-9166d415e88e tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:09.517159 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d9772d40-544c-4203-8a06-9166d415e88e tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] [instance: 930b527f-b438-4dca-821a-c23a37020707] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:37:09.901536 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d9772d40-544c-4203-8a06-9166d415e88e tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] 10.222.0.20 "DELETE /compute/v2.1/servers/930b527f-b438-4dca-821a-c23a37020707" status: 204 len: 0 microversion: 2.26 time: 0.481658 Oct 04 18:37:09.902793 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1113/2308] 10.222.0.20 () {60 vars in 1280 bytes} [Tue Oct 4 18:37:09 2022] DELETE /compute/v2.1/servers/930b527f-b438-4dca-821a-c23a37020707 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:37:09.917176 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-80d80b74-480e-4176-9fde-b8729c700f00 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:09.918156 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-80d80b74-480e-4176-9fde-b8729c700f00 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 98dfffc8-51aa-407a-a374-8e120ec43a31] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:09.957012 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-80d80b74-480e-4176-9fde-b8729c700f00 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:09.959360 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-80d80b74-480e-4176-9fde-b8729c700f00 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:09.959955 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-80d80b74-480e-4176-9fde-b8729c700f00 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:09.961003 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-80d80b74-480e-4176-9fde-b8729c700f00 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:09.968219 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-80d80b74-480e-4176-9fde-b8729c700f00 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:09.968356 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-80d80b74-480e-4176-9fde-b8729c700f00 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:10.125618 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-280c1b57-d664-41fd-94b5-1a0b6a28d972 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:37:10.126675 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-280c1b57-d664-41fd-94b5-1a0b6a28d972 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:37:10.127517 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-280c1b57-d664-41fd-94b5-1a0b6a28d972 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:37:10.128311 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-280c1b57-d664-41fd-94b5-1a0b6a28d972 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:37:10.128888 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-280c1b57-d664-41fd-94b5-1a0b6a28d972 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:37:10.139705 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:10.151030 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-280c1b57-d664-41fd-94b5-1a0b6a28d972 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:10.152509 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-280c1b57-d664-41fd-94b5-1a0b6a28d972 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:10.153106 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-280c1b57-d664-41fd-94b5-1a0b6a28d972 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:10.153870 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-280c1b57-d664-41fd-94b5-1a0b6a28d972 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:10.171295 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-280c1b57-d664-41fd-94b5-1a0b6a28d972 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:10.171964 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-280c1b57-d664-41fd-94b5-1a0b6a28d972 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:10.200436 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-280c1b57-d664-41fd-94b5-1a0b6a28d972 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Getting quotas for project 552ab59dabe840cb8582c54bedc49b09. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:37:10.203735 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-80d80b74-480e-4176-9fde-b8729c700f00 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:10.207781 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-280c1b57-d664-41fd-94b5-1a0b6a28d972 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Getting quotas for user 9b05d1f8b9014e798926f9c496885a4d and project 552ab59dabe840cb8582c54bedc49b09. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:37:10.214133 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-80d80b74-480e-4176-9fde-b8729c700f00 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31" status: 200 len: 1199 microversion: 2.1 time: 0.310186 Oct 04 18:37:10.229867 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1114/2309] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:09 2022] GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31 => generated 1199 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:10.242825 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-280c1b57-d664-41fd-94b5-1a0b6a28d972 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Going to run 1 instances... {{(pid=123002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:37:10.245792 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-280c1b57-d664-41fd-94b5-1a0b6a28d972 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 474a799f-8e38-49d6-8fff-9ec3e7657ef5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:37:10.402982 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a824eb2c-f7c4-4586-bf68-6839bd4b6d63 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-660564719", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:10.417163 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-280c1b57-d664-41fd-94b5-1a0b6a28d972 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.499400 Oct 04 18:37:10.420458 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1196/2310] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:37:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1503 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:37:10.442285 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2d4ece38-5b7e-467a-90db-476805f37deb tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:10.443080 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2d4ece38-5b7e-467a-90db-476805f37deb tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] [instance: 94cff31c-a849-4365-b9e8-326613749226] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:10.451953 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2d4ece38-5b7e-467a-90db-476805f37deb tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:10.455957 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2d4ece38-5b7e-467a-90db-476805f37deb tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:10.457057 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2d4ece38-5b7e-467a-90db-476805f37deb tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:10.458233 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2d4ece38-5b7e-467a-90db-476805f37deb tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:10.459285 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2d4ece38-5b7e-467a-90db-476805f37deb tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:10.463560 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2d4ece38-5b7e-467a-90db-476805f37deb tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:10.504954 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.neutron [None req-a824eb2c-f7c4-4586-bf68-6839bd4b6d63 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] validate_networks() for [('5f0d6ed8-1b1a-4dd2-afb9-d29b58b254e5', None, None, None, None, None)] {{(pid=123001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:37:11.074175 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2d4ece38-5b7e-467a-90db-476805f37deb tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8356b47bd87f42e2b642c6df82014e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8869e8a46f40b18434fbe68d819dc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:11.085169 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2d4ece38-5b7e-467a-90db-476805f37deb tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] 10.222.0.20 "GET /compute/v2.1/servers/94cff31c-a849-4365-b9e8-326613749226" status: 200 len: 1316 microversion: 2.1 time: 0.660132 Oct 04 18:37:11.086661 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1197/2311] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:10 2022] GET /compute/v2.1/servers/94cff31c-a849-4365-b9e8-326613749226 => generated 1316 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:11.096705 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-04e3b5f9-b234-44b6-ab6f-62bb3d145648 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:11.099243 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-04e3b5f9-b234-44b6-ab6f-62bb3d145648 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] [instance: 930b527f-b438-4dca-821a-c23a37020707] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:11.114522 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-04e3b5f9-b234-44b6-ab6f-62bb3d145648 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:11.114925 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-04e3b5f9-b234-44b6-ab6f-62bb3d145648 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:11.116010 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-04e3b5f9-b234-44b6-ab6f-62bb3d145648 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:11.119264 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-04e3b5f9-b234-44b6-ab6f-62bb3d145648 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:11.119929 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-04e3b5f9-b234-44b6-ab6f-62bb3d145648 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:11.120467 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-04e3b5f9-b234-44b6-ab6f-62bb3d145648 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:11.399916 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-a824eb2c-f7c4-4586-bf68-6839bd4b6d63 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:37:11.407329 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-a824eb2c-f7c4-4586-bf68-6839bd4b6d63 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:37:11.407329 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-a824eb2c-f7c4-4586-bf68-6839bd4b6d63 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:37:11.407329 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-a824eb2c-f7c4-4586-bf68-6839bd4b6d63 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:37:11.407329 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-a824eb2c-f7c4-4586-bf68-6839bd4b6d63 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:37:11.417869 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a824eb2c-f7c4-4586-bf68-6839bd4b6d63 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:11.418727 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a824eb2c-f7c4-4586-bf68-6839bd4b6d63 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:11.419251 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a824eb2c-f7c4-4586-bf68-6839bd4b6d63 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:11.420833 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a824eb2c-f7c4-4586-bf68-6839bd4b6d63 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:11.421544 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a824eb2c-f7c4-4586-bf68-6839bd4b6d63 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:11.422168 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a824eb2c-f7c4-4586-bf68-6839bd4b6d63 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:11.427967 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-04e3b5f9-b234-44b6-ab6f-62bb3d145648 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbfa195640841ed9ea72cfa654e2a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b6df28ccc1404686c1df3d8df4a366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:11.446491 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-04e3b5f9-b234-44b6-ab6f-62bb3d145648 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dbfa195640841ed9ea72cfa654e2a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b6df28ccc1404686c1df3d8df4a366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:11.451036 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-04e3b5f9-b234-44b6-ab6f-62bb3d145648 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dbfa195640841ed9ea72cfa654e2a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b6df28ccc1404686c1df3d8df4a366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:11.454205 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-04e3b5f9-b234-44b6-ab6f-62bb3d145648 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] 10.222.0.20 "GET /compute/v2.1/servers/930b527f-b438-4dca-821a-c23a37020707" status: 200 len: 1551 microversion: 2.26 time: 0.366329 Oct 04 18:37:11.457744 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1198/2312] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:11 2022] GET /compute/v2.1/servers/930b527f-b438-4dca-821a-c23a37020707 => generated 1551 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:37:11.475426 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-151026d2-7197-4b2b-a3bd-2c1729dee20e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:11.476082 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-151026d2-7197-4b2b-a3bd-2c1729dee20e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: cd74aff9-f694-49f3-a1cc-2095b71cd9e5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:11.493991 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-a824eb2c-f7c4-4586-bf68-6839bd4b6d63 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Getting quotas for project 87473abf47e74adf844e3ddfa24da3f2. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:37:11.500850 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-151026d2-7197-4b2b-a3bd-2c1729dee20e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:11.500850 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-151026d2-7197-4b2b-a3bd-2c1729dee20e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:11.500850 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-151026d2-7197-4b2b-a3bd-2c1729dee20e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:11.502339 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-151026d2-7197-4b2b-a3bd-2c1729dee20e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:11.502829 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-151026d2-7197-4b2b-a3bd-2c1729dee20e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:11.503259 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-151026d2-7197-4b2b-a3bd-2c1729dee20e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:11.505632 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-a824eb2c-f7c4-4586-bf68-6839bd4b6d63 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Getting quotas for user 8284fe51decd4db0bf6b3ed1514cc2c1 and project 87473abf47e74adf844e3ddfa24da3f2. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:37:11.536797 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a824eb2c-f7c4-4586-bf68-6839bd4b6d63 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Going to run 1 instances... {{(pid=123001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:37:11.543093 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a824eb2c-f7c4-4586-bf68-6839bd4b6d63 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 61ec7cca-1572-496c-ba44-439f04c2a79c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:37:11.750950 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a824eb2c-f7c4-4586-bf68-6839bd4b6d63 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.533988 Oct 04 18:37:11.757984 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1115/2313] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:37:10 2022] POST /compute/v2.1/servers => generated 383 bytes in 1537 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:37:11.758680 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-151026d2-7197-4b2b-a3bd-2c1729dee20e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:11.772451 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-151026d2-7197-4b2b-a3bd-2c1729dee20e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:11.773927 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-151026d2-7197-4b2b-a3bd-2c1729dee20e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:11.775548 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a374b259-d9bc-457c-869e-38640f402667 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:11.776832 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a374b259-d9bc-457c-869e-38640f402667 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] [instance: 616e21b9-c93b-4ff0-8740-24c613f4d708] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:11.779141 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-151026d2-7197-4b2b-a3bd-2c1729dee20e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5" status: 200 len: 1486 microversion: 2.25 time: 0.317838 Oct 04 18:37:11.795121 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1199/2314] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:11 2022] GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5 => generated 1486 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:37:11.825347 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a374b259-d9bc-457c-869e-38640f402667 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:11.833957 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a374b259-d9bc-457c-869e-38640f402667 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:11.838888 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a374b259-d9bc-457c-869e-38640f402667 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:11.839599 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-de168502-64d7-41a7-8825-4d1efaea9023 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:11.840583 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a374b259-d9bc-457c-869e-38640f402667 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:11.841452 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-de168502-64d7-41a7-8825-4d1efaea9023 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 474a799f-8e38-49d6-8fff-9ec3e7657ef5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:11.842412 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a374b259-d9bc-457c-869e-38640f402667 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:11.863131 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a374b259-d9bc-457c-869e-38640f402667 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:11.878859 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-de168502-64d7-41a7-8825-4d1efaea9023 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:11.881069 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-de168502-64d7-41a7-8825-4d1efaea9023 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:11.882015 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-de168502-64d7-41a7-8825-4d1efaea9023 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:11.883418 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-de168502-64d7-41a7-8825-4d1efaea9023 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:11.898349 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-de168502-64d7-41a7-8825-4d1efaea9023 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:11.901794 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-de168502-64d7-41a7-8825-4d1efaea9023 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:12.211459 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-de168502-64d7-41a7-8825-4d1efaea9023 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:12.230499 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-de168502-64d7-41a7-8825-4d1efaea9023 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5" status: 200 len: 1282 microversion: 2.1 time: 0.426056 Oct 04 18:37:12.232433 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1200/2315] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:11 2022] GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5 => generated 1282 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:12.247858 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e3ecac13-1554-44c4-bae9-74695941ead4 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:12.251987 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e3ecac13-1554-44c4-bae9-74695941ead4 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 98dfffc8-51aa-407a-a374-8e120ec43a31] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:12.281735 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e3ecac13-1554-44c4-bae9-74695941ead4 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:12.282468 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e3ecac13-1554-44c4-bae9-74695941ead4 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:12.283441 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e3ecac13-1554-44c4-bae9-74695941ead4 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:12.285471 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e3ecac13-1554-44c4-bae9-74695941ead4 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:12.286843 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e3ecac13-1554-44c4-bae9-74695941ead4 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:12.287811 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e3ecac13-1554-44c4-bae9-74695941ead4 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:13.532683 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a374b259-d9bc-457c-869e-38640f402667 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb44381220d43b7bdfa744a1dc410a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3242afeef424d588cf102a2f0f38020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:13.547257 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a374b259-d9bc-457c-869e-38640f402667 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] 10.222.0.20 "GET /compute/v2.1/servers/616e21b9-c93b-4ff0-8740-24c613f4d708" status: 200 len: 1333 microversion: 2.1 time: 1.793088 Oct 04 18:37:13.556149 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1116/2316] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:11 2022] GET /compute/v2.1/servers/616e21b9-c93b-4ff0-8740-24c613f4d708 => generated 1333 bytes in 1800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:13.568616 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-727e9dfe-c652-4e3d-964d-58fa1eef0f6f tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:13.569663 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-727e9dfe-c652-4e3d-964d-58fa1eef0f6f tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 61ec7cca-1572-496c-ba44-439f04c2a79c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:13.804648 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e3ecac13-1554-44c4-bae9-74695941ead4 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:13.807281 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-727e9dfe-c652-4e3d-964d-58fa1eef0f6f tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8284fe51decd4db0bf6b3ed1514cc2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87473abf47e74adf844e3ddfa24da3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:13.816656 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e3ecac13-1554-44c4-bae9-74695941ead4 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31" status: 200 len: 1199 microversion: 2.1 time: 1.581965 Oct 04 18:37:13.820532 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-727e9dfe-c652-4e3d-964d-58fa1eef0f6f tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] 10.222.0.20 "GET /compute/v2.1/servers/61ec7cca-1572-496c-ba44-439f04c2a79c" status: 200 len: 1213 microversion: 2.1 time: 0.263087 Oct 04 18:37:13.825565 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1117/2317] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:13 2022] GET /compute/v2.1/servers/61ec7cca-1572-496c-ba44-439f04c2a79c => generated 1213 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:13.826074 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1201/2318] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:12 2022] GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31 => generated 1199 bytes in 1592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:13.841554 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c1dc6d75-4f13-42e9-a62d-0f2277bd5f59 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:13.842227 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c1dc6d75-4f13-42e9-a62d-0f2277bd5f59 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] [instance: 94cff31c-a849-4365-b9e8-326613749226] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:13.848830 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-71b9ab4e-2126-472c-a16b-aa67b5025504 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:13.850146 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-71b9ab4e-2126-472c-a16b-aa67b5025504 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] [instance: 930b527f-b438-4dca-821a-c23a37020707] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:13.863429 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-71b9ab4e-2126-472c-a16b-aa67b5025504 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:13.864436 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-71b9ab4e-2126-472c-a16b-aa67b5025504 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:13.865142 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-71b9ab4e-2126-472c-a16b-aa67b5025504 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:13.866460 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-71b9ab4e-2126-472c-a16b-aa67b5025504 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:13.867206 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-71b9ab4e-2126-472c-a16b-aa67b5025504 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:13.867961 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-71b9ab4e-2126-472c-a16b-aa67b5025504 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:13.872096 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c1dc6d75-4f13-42e9-a62d-0f2277bd5f59 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:13.872705 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c1dc6d75-4f13-42e9-a62d-0f2277bd5f59 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:13.880012 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c1dc6d75-4f13-42e9-a62d-0f2277bd5f59 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:13.882119 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c1dc6d75-4f13-42e9-a62d-0f2277bd5f59 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:13.886315 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c1dc6d75-4f13-42e9-a62d-0f2277bd5f59 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:13.886957 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c1dc6d75-4f13-42e9-a62d-0f2277bd5f59 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:14.338718 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-71b9ab4e-2126-472c-a16b-aa67b5025504 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbfa195640841ed9ea72cfa654e2a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b6df28ccc1404686c1df3d8df4a366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:14.354141 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-71b9ab4e-2126-472c-a16b-aa67b5025504 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dbfa195640841ed9ea72cfa654e2a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b6df28ccc1404686c1df3d8df4a366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:14.355846 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-71b9ab4e-2126-472c-a16b-aa67b5025504 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dbfa195640841ed9ea72cfa654e2a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b6df28ccc1404686c1df3d8df4a366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:14.361486 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-71b9ab4e-2126-472c-a16b-aa67b5025504 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] 10.222.0.20 "GET /compute/v2.1/servers/930b527f-b438-4dca-821a-c23a37020707" status: 200 len: 1509 microversion: 2.26 time: 0.521370 Oct 04 18:37:14.377072 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1202/2319] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:13 2022] GET /compute/v2.1/servers/930b527f-b438-4dca-821a-c23a37020707 => generated 1509 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:37:14.397396 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e9c3eca9-16c2-4e72-9a07-bb0ce38bb891 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:14.400813 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e9c3eca9-16c2-4e72-9a07-bb0ce38bb891 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: cd74aff9-f694-49f3-a1cc-2095b71cd9e5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:14.419179 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e9c3eca9-16c2-4e72-9a07-bb0ce38bb891 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:14.421516 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e9c3eca9-16c2-4e72-9a07-bb0ce38bb891 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:14.422162 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e9c3eca9-16c2-4e72-9a07-bb0ce38bb891 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:14.426108 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e9c3eca9-16c2-4e72-9a07-bb0ce38bb891 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:14.426817 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e9c3eca9-16c2-4e72-9a07-bb0ce38bb891 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:14.427475 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e9c3eca9-16c2-4e72-9a07-bb0ce38bb891 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:15.046189 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e9c3eca9-16c2-4e72-9a07-bb0ce38bb891 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:15.059401 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e9c3eca9-16c2-4e72-9a07-bb0ce38bb891 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:15.063793 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e9c3eca9-16c2-4e72-9a07-bb0ce38bb891 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:15.072770 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e9c3eca9-16c2-4e72-9a07-bb0ce38bb891 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5" status: 200 len: 1486 microversion: 2.25 time: 0.690439 Oct 04 18:37:15.072770 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1203/2320] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:14 2022] GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5 => generated 1486 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:37:15.120313 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2b814c3e-b40b-4619-9fdf-0eb06844ffba tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:15.121205 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2b814c3e-b40b-4619-9fdf-0eb06844ffba tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 474a799f-8e38-49d6-8fff-9ec3e7657ef5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:15.127364 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c1dc6d75-4f13-42e9-a62d-0f2277bd5f59 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8356b47bd87f42e2b642c6df82014e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8869e8a46f40b18434fbe68d819dc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:15.141595 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2b814c3e-b40b-4619-9fdf-0eb06844ffba tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:15.143965 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2b814c3e-b40b-4619-9fdf-0eb06844ffba tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:15.147635 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2b814c3e-b40b-4619-9fdf-0eb06844ffba tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:15.148768 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2b814c3e-b40b-4619-9fdf-0eb06844ffba tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:15.150704 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2b814c3e-b40b-4619-9fdf-0eb06844ffba tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:15.152939 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2b814c3e-b40b-4619-9fdf-0eb06844ffba tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:15.168660 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c1dc6d75-4f13-42e9-a62d-0f2277bd5f59 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] 10.222.0.20 "GET /compute/v2.1/servers/94cff31c-a849-4365-b9e8-326613749226" status: 200 len: 1316 microversion: 2.1 time: 1.338498 Oct 04 18:37:15.169293 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1118/2321] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:13 2022] GET /compute/v2.1/servers/94cff31c-a849-4365-b9e8-326613749226 => generated 1316 bytes in 1343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:15.211644 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=100 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:15.216586 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-c48b4b4b-e574-42f1-adfa-a6de29c90b71 req-5622d1b7-cf50-4d15-b900-a4e82404afad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd74aff9-f694-49f3-a1cc-2095b71cd9e5", "name": "network-vif-unplugged", "status": "completed", "tag": "bd7c52cb-3d4c-4b6f-a043-15c22280ba46"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:15.249046 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-c48b4b4b-e574-42f1-adfa-a6de29c90b71 req-5622d1b7-cf50-4d15-b900-a4e82404afad service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:15.249558 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-c48b4b4b-e574-42f1-adfa-a6de29c90b71 req-5622d1b7-cf50-4d15-b900-a4e82404afad service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:15.250010 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-c48b4b4b-e574-42f1-adfa-a6de29c90b71 req-5622d1b7-cf50-4d15-b900-a4e82404afad service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:15.286160 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-c48b4b4b-e574-42f1-adfa-a6de29c90b71 req-5622d1b7-cf50-4d15-b900-a4e82404afad service nova] Creating event network-vif-unplugged:bd7c52cb-3d4c-4b6f-a043-15c22280ba46 for instance cd74aff9-f694-49f3-a1cc-2095b71cd9e5 on n-h2-850501-14 Oct 04 18:37:15.318876 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-c48b4b4b-e574-42f1-adfa-a6de29c90b71 req-5622d1b7-cf50-4d15-b900-a4e82404afad service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.119452 Oct 04 18:37:15.321422 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1119/2322] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:37:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:15.339528 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-51635f76-a2f5-4163-8153-a931c9a4f863 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:15.342156 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-51635f76-a2f5-4163-8153-a931c9a4f863 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] [instance: 616e21b9-c93b-4ff0-8740-24c613f4d708] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:15.344537 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2b814c3e-b40b-4619-9fdf-0eb06844ffba tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:15.357427 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2b814c3e-b40b-4619-9fdf-0eb06844ffba tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5" status: 200 len: 1348 microversion: 2.1 time: 0.252094 Oct 04 18:37:15.362303 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-51635f76-a2f5-4163-8153-a931c9a4f863 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:15.365194 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-51635f76-a2f5-4163-8153-a931c9a4f863 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:15.365741 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-51635f76-a2f5-4163-8153-a931c9a4f863 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:15.368882 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-51635f76-a2f5-4163-8153-a931c9a4f863 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:15.370285 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-51635f76-a2f5-4163-8153-a931c9a4f863 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:15.372425 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-51635f76-a2f5-4163-8153-a931c9a4f863 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:15.379592 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1204/2323] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:15 2022] GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5 => generated 1348 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:15.385107 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b5e04a83-8e44-42b2-86e4-82201c01030a tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:15.390745 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b5e04a83-8e44-42b2-86e4-82201c01030a tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 98dfffc8-51aa-407a-a374-8e120ec43a31] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:15.406072 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b5e04a83-8e44-42b2-86e4-82201c01030a tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:15.408320 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b5e04a83-8e44-42b2-86e4-82201c01030a tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:15.412554 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b5e04a83-8e44-42b2-86e4-82201c01030a tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:15.412554 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b5e04a83-8e44-42b2-86e4-82201c01030a tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:15.412554 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b5e04a83-8e44-42b2-86e4-82201c01030a tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:15.412554 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b5e04a83-8e44-42b2-86e4-82201c01030a tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:16.384780 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-51635f76-a2f5-4163-8153-a931c9a4f863 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb44381220d43b7bdfa744a1dc410a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3242afeef424d588cf102a2f0f38020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:16.400564 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-51635f76-a2f5-4163-8153-a931c9a4f863 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] 10.222.0.20 "GET /compute/v2.1/servers/616e21b9-c93b-4ff0-8740-24c613f4d708" status: 200 len: 1333 microversion: 2.1 time: 1.076481 Oct 04 18:37:16.417969 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1120/2324] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:15 2022] GET /compute/v2.1/servers/616e21b9-c93b-4ff0-8740-24c613f4d708 => generated 1333 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:16.435016 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a2367005-0b16-44c1-8692-4ca9dc1f5953 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:16.438303 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a2367005-0b16-44c1-8692-4ca9dc1f5953 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 61ec7cca-1572-496c-ba44-439f04c2a79c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:16.450901 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a2367005-0b16-44c1-8692-4ca9dc1f5953 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:16.452378 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a2367005-0b16-44c1-8692-4ca9dc1f5953 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:16.457870 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a2367005-0b16-44c1-8692-4ca9dc1f5953 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:16.457870 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a2367005-0b16-44c1-8692-4ca9dc1f5953 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:16.457870 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a2367005-0b16-44c1-8692-4ca9dc1f5953 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:16.457870 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a2367005-0b16-44c1-8692-4ca9dc1f5953 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:16.465083 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b5e04a83-8e44-42b2-86e4-82201c01030a tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:16.478958 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b5e04a83-8e44-42b2-86e4-82201c01030a tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31" status: 200 len: 1199 microversion: 2.1 time: 1.097665 Oct 04 18:37:16.480350 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1205/2325] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:15 2022] GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31 => generated 1199 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:16.494427 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-d8402438-243a-46f5-9609-7fedb390aa0a req-c6588043-b3d9-45bf-8b24-f4a2ec41e715 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "930b527f-b438-4dca-821a-c23a37020707", "name": "network-vif-deleted", "tag": "de4c1af8-905a-42e9-bbd4-87936a6c637a"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:16.517385 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-d8402438-243a-46f5-9609-7fedb390aa0a req-c6588043-b3d9-45bf-8b24-f4a2ec41e715 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:16.521886 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-d8402438-243a-46f5-9609-7fedb390aa0a req-c6588043-b3d9-45bf-8b24-f4a2ec41e715 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:16.532541 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-d8402438-243a-46f5-9609-7fedb390aa0a req-c6588043-b3d9-45bf-8b24-f4a2ec41e715 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:16.553938 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-d8402438-243a-46f5-9609-7fedb390aa0a req-c6588043-b3d9-45bf-8b24-f4a2ec41e715 service nova] Creating event network-vif-deleted:de4c1af8-905a-42e9-bbd4-87936a6c637a for instance 930b527f-b438-4dca-821a-c23a37020707 on n-h1-850501-14 Oct 04 18:37:16.560223 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-d8402438-243a-46f5-9609-7fedb390aa0a req-c6588043-b3d9-45bf-8b24-f4a2ec41e715 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077384 Oct 04 18:37:16.562427 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1206/2326] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:37:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:16.567867 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-4924223d-e7ab-47bd-991f-3ce84a49308e req-19fff51e-092d-4e1b-af25-aea44ba12bfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "616e21b9-c93b-4ff0-8740-24c613f4d708", "name": "network-vif-plugged", "status": "completed", "tag": "092863dc-5ae4-498b-b3d8-b7f299e949c4"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:16.580723 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-4924223d-e7ab-47bd-991f-3ce84a49308e req-19fff51e-092d-4e1b-af25-aea44ba12bfc service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:16.581513 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-4924223d-e7ab-47bd-991f-3ce84a49308e req-19fff51e-092d-4e1b-af25-aea44ba12bfc service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:16.582230 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-4924223d-e7ab-47bd-991f-3ce84a49308e req-19fff51e-092d-4e1b-af25-aea44ba12bfc service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:16.595184 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-4924223d-e7ab-47bd-991f-3ce84a49308e req-19fff51e-092d-4e1b-af25-aea44ba12bfc service nova] Creating event network-vif-plugged:092863dc-5ae4-498b-b3d8-b7f299e949c4 for instance 616e21b9-c93b-4ff0-8740-24c613f4d708 on n-h1-850501-14 Oct 04 18:37:16.602750 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-4924223d-e7ab-47bd-991f-3ce84a49308e req-19fff51e-092d-4e1b-af25-aea44ba12bfc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038169 Oct 04 18:37:16.603735 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1207/2327] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:37:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:16.609945 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5eb41af4-7566-4d50-9cc7-e82755cb319f tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:16.611181 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5eb41af4-7566-4d50-9cc7-e82755cb319f tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] [instance: 930b527f-b438-4dca-821a-c23a37020707] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:16.629897 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5eb41af4-7566-4d50-9cc7-e82755cb319f tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:16.631206 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5eb41af4-7566-4d50-9cc7-e82755cb319f tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:16.632583 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5eb41af4-7566-4d50-9cc7-e82755cb319f tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:16.636100 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5eb41af4-7566-4d50-9cc7-e82755cb319f tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:16.636824 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5eb41af4-7566-4d50-9cc7-e82755cb319f tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:16.638071 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5eb41af4-7566-4d50-9cc7-e82755cb319f tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:16.672163 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a2367005-0b16-44c1-8692-4ca9dc1f5953 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8284fe51decd4db0bf6b3ed1514cc2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87473abf47e74adf844e3ddfa24da3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:16.689620 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a2367005-0b16-44c1-8692-4ca9dc1f5953 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] 10.222.0.20 "GET /compute/v2.1/servers/61ec7cca-1572-496c-ba44-439f04c2a79c" status: 200 len: 1265 microversion: 2.1 time: 0.270386 Oct 04 18:37:16.702063 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1121/2328] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:16 2022] GET /compute/v2.1/servers/61ec7cca-1572-496c-ba44-439f04c2a79c => generated 1265 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:16.721841 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-52df8f45-4f28-4277-9726-498176841088 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:16.726430 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-52df8f45-4f28-4277-9726-498176841088 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: cd74aff9-f694-49f3-a1cc-2095b71cd9e5] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:16.749012 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-52df8f45-4f28-4277-9726-498176841088 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:16.760829 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5eb41af4-7566-4d50-9cc7-e82755cb319f tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:16.760829 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5eb41af4-7566-4d50-9cc7-e82755cb319f tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:16.760829 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5eb41af4-7566-4d50-9cc7-e82755cb319f tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:16.760829 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-5eb41af4-7566-4d50-9cc7-e82755cb319f tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lazy-loading 'fault' on Instance uuid 930b527f-b438-4dca-821a-c23a37020707 {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:37:16.765639 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-52df8f45-4f28-4277-9726-498176841088 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:16.766535 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-52df8f45-4f28-4277-9726-498176841088 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:16.774667 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-52df8f45-4f28-4277-9726-498176841088 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:16.777135 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-52df8f45-4f28-4277-9726-498176841088 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:16.783019 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-52df8f45-4f28-4277-9726-498176841088 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:17.077985 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5eb41af4-7566-4d50-9cc7-e82755cb319f tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbfa195640841ed9ea72cfa654e2a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b6df28ccc1404686c1df3d8df4a366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:17.086142 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5eb41af4-7566-4d50-9cc7-e82755cb319f tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dbfa195640841ed9ea72cfa654e2a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b6df28ccc1404686c1df3d8df4a366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:17.087777 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5eb41af4-7566-4d50-9cc7-e82755cb319f tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dbfa195640841ed9ea72cfa654e2a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b6df28ccc1404686c1df3d8df4a366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:17.089194 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5eb41af4-7566-4d50-9cc7-e82755cb319f tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] 10.222.0.20 "GET /compute/v2.1/servers/930b527f-b438-4dca-821a-c23a37020707" status: 200 len: 1351 microversion: 2.26 time: 0.483973 Oct 04 18:37:17.099842 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1208/2329] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:16 2022] GET /compute/v2.1/servers/930b527f-b438-4dca-821a-c23a37020707 => generated 1351 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:37:17.114170 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3edeb0c8-0ed0-492f-9058-2ff88fa4064a tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:17.114996 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3edeb0c8-0ed0-492f-9058-2ff88fa4064a tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] [instance: 94cff31c-a849-4365-b9e8-326613749226] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:17.125732 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3edeb0c8-0ed0-492f-9058-2ff88fa4064a tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:17.126453 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3edeb0c8-0ed0-492f-9058-2ff88fa4064a tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:17.127226 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3edeb0c8-0ed0-492f-9058-2ff88fa4064a tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:17.128216 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3edeb0c8-0ed0-492f-9058-2ff88fa4064a tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:17.128817 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3edeb0c8-0ed0-492f-9058-2ff88fa4064a tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:17.129453 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3edeb0c8-0ed0-492f-9058-2ff88fa4064a tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:17.318192 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-52df8f45-4f28-4277-9726-498176841088 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:17.335678 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-52df8f45-4f28-4277-9726-498176841088 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:17.341515 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-52df8f45-4f28-4277-9726-498176841088 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:17.350362 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-52df8f45-4f28-4277-9726-498176841088 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5" status: 200 len: 1486 microversion: 2.25 time: 0.637018 Oct 04 18:37:17.356081 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1122/2330] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:16 2022] GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5 => generated 1486 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:37:17.356081 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-313daac4-75e7-4eb9-9d1f-483d52df93c8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:17.356329 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-313daac4-75e7-4eb9-9d1f-483d52df93c8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 474a799f-8e38-49d6-8fff-9ec3e7657ef5] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:17.372786 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-313daac4-75e7-4eb9-9d1f-483d52df93c8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:17.372786 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-313daac4-75e7-4eb9-9d1f-483d52df93c8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:17.372786 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-313daac4-75e7-4eb9-9d1f-483d52df93c8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:17.375506 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-313daac4-75e7-4eb9-9d1f-483d52df93c8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:17.376006 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-313daac4-75e7-4eb9-9d1f-483d52df93c8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:17.377792 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-313daac4-75e7-4eb9-9d1f-483d52df93c8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:17.488856 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3edeb0c8-0ed0-492f-9058-2ff88fa4064a tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8356b47bd87f42e2b642c6df82014e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8869e8a46f40b18434fbe68d819dc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:17.506347 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3edeb0c8-0ed0-492f-9058-2ff88fa4064a tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] 10.222.0.20 "GET /compute/v2.1/servers/94cff31c-a849-4365-b9e8-326613749226" status: 200 len: 1316 microversion: 2.1 time: 0.400589 Oct 04 18:37:17.506347 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1209/2331] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:17 2022] GET /compute/v2.1/servers/94cff31c-a849-4365-b9e8-326613749226 => generated 1316 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:17.519419 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-3dcc1534-da89-417f-a48a-3a9e88855560 req-71eb6d38-4d75-4dd8-bf22-e66512169103 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd74aff9-f694-49f3-a1cc-2095b71cd9e5", "tag": "bd7c52cb-3d4c-4b6f-a043-15c22280ba46"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:17.542133 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-3dcc1534-da89-417f-a48a-3a9e88855560 req-71eb6d38-4d75-4dd8-bf22-e66512169103 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:17.545673 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-3dcc1534-da89-417f-a48a-3a9e88855560 req-71eb6d38-4d75-4dd8-bf22-e66512169103 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:17.548129 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-3dcc1534-da89-417f-a48a-3a9e88855560 req-71eb6d38-4d75-4dd8-bf22-e66512169103 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:17.566274 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-3dcc1534-da89-417f-a48a-3a9e88855560 req-71eb6d38-4d75-4dd8-bf22-e66512169103 service nova] Creating event network-changed:bd7c52cb-3d4c-4b6f-a043-15c22280ba46 for instance cd74aff9-f694-49f3-a1cc-2095b71cd9e5 on n-h2-850501-14 Oct 04 18:37:17.581555 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-3dcc1534-da89-417f-a48a-3a9e88855560 req-71eb6d38-4d75-4dd8-bf22-e66512169103 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071932 Oct 04 18:37:17.584472 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1210/2332] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:37:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:17.608814 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e835eed6-29d6-4cfd-9b33-b7be6254c65f tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:17.615255 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e835eed6-29d6-4cfd-9b33-b7be6254c65f tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] [instance: 616e21b9-c93b-4ff0-8740-24c613f4d708] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:17.620929 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-313daac4-75e7-4eb9-9d1f-483d52df93c8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:17.631507 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e835eed6-29d6-4cfd-9b33-b7be6254c65f tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:17.632145 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-313daac4-75e7-4eb9-9d1f-483d52df93c8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5" status: 200 len: 1336 microversion: 2.1 time: 0.279982 Oct 04 18:37:17.632509 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e835eed6-29d6-4cfd-9b33-b7be6254c65f tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:17.632730 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1123/2333] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:17 2022] GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5 => generated 1336 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:17.633133 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e835eed6-29d6-4cfd-9b33-b7be6254c65f tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:17.634442 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e835eed6-29d6-4cfd-9b33-b7be6254c65f tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:17.635197 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e835eed6-29d6-4cfd-9b33-b7be6254c65f tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:17.635797 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e835eed6-29d6-4cfd-9b33-b7be6254c65f tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:17.649087 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-44d7cc32-589d-464b-828b-352b6420d003 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:17.649706 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-44d7cc32-589d-464b-828b-352b6420d003 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 98dfffc8-51aa-407a-a374-8e120ec43a31] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:17.682811 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-44d7cc32-589d-464b-828b-352b6420d003 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:17.686771 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-44d7cc32-589d-464b-828b-352b6420d003 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:17.688270 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-44d7cc32-589d-464b-828b-352b6420d003 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:17.696798 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-44d7cc32-589d-464b-828b-352b6420d003 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:17.697362 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-44d7cc32-589d-464b-828b-352b6420d003 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:17.697825 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-44d7cc32-589d-464b-828b-352b6420d003 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:18.616706 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-44d7cc32-589d-464b-828b-352b6420d003 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:18.619200 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=95,nova_cell1:DELETE=2,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:18.641392 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-44d7cc32-589d-464b-828b-352b6420d003 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31" status: 200 len: 1199 microversion: 2.1 time: 1.000217 Oct 04 18:37:18.650470 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1124/2334] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:17 2022] GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31 => generated 1199 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:18.660093 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6002af6b-6b9c-477a-a880-f627f721e7e8 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:18.667749 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6002af6b-6b9c-477a-a880-f627f721e7e8 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 61ec7cca-1572-496c-ba44-439f04c2a79c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:18.690307 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6002af6b-6b9c-477a-a880-f627f721e7e8 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:18.698342 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6002af6b-6b9c-477a-a880-f627f721e7e8 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:18.699035 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6002af6b-6b9c-477a-a880-f627f721e7e8 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:18.700248 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6002af6b-6b9c-477a-a880-f627f721e7e8 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:18.700980 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6002af6b-6b9c-477a-a880-f627f721e7e8 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:18.713284 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6002af6b-6b9c-477a-a880-f627f721e7e8 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:19.100773 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e835eed6-29d6-4cfd-9b33-b7be6254c65f tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb44381220d43b7bdfa744a1dc410a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3242afeef424d588cf102a2f0f38020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:19.119319 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e835eed6-29d6-4cfd-9b33-b7be6254c65f tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] 10.222.0.20 "GET /compute/v2.1/servers/616e21b9-c93b-4ff0-8740-24c613f4d708" status: 200 len: 1333 microversion: 2.1 time: 1.526217 Oct 04 18:37:19.120387 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1211/2335] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:17 2022] GET /compute/v2.1/servers/616e21b9-c93b-4ff0-8740-24c613f4d708 => generated 1333 bytes in 1535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:19.133559 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-da8e377b-025d-460b-a91b-90d58bbfff67 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:19.136837 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-da8e377b-025d-460b-a91b-90d58bbfff67 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] [instance: 930b527f-b438-4dca-821a-c23a37020707] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:19.160037 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-da8e377b-025d-460b-a91b-90d58bbfff67 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:19.162465 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-da8e377b-025d-460b-a91b-90d58bbfff67 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:19.163056 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-da8e377b-025d-460b-a91b-90d58bbfff67 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:19.167152 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-da8e377b-025d-460b-a91b-90d58bbfff67 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:19.172126 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-da8e377b-025d-460b-a91b-90d58bbfff67 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:19.172798 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-da8e377b-025d-460b-a91b-90d58bbfff67 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:19.189577 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6002af6b-6b9c-477a-a880-f627f721e7e8 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8284fe51decd4db0bf6b3ed1514cc2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87473abf47e74adf844e3ddfa24da3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:19.205517 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6002af6b-6b9c-477a-a880-f627f721e7e8 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] 10.222.0.20 "GET /compute/v2.1/servers/61ec7cca-1572-496c-ba44-439f04c2a79c" status: 200 len: 1271 microversion: 2.1 time: 0.553291 Oct 04 18:37:19.209210 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1125/2336] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:18 2022] GET /compute/v2.1/servers/61ec7cca-1572-496c-ba44-439f04c2a79c => generated 1271 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:19.242751 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6652731e-1154-420d-af9d-22f456d9bfd8 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:19.244934 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6652731e-1154-420d-af9d-22f456d9bfd8 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: cd74aff9-f694-49f3-a1cc-2095b71cd9e5] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:19.246309 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-da8e377b-025d-460b-a91b-90d58bbfff67 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] HTTP exception thrown: Instance 930b527f-b438-4dca-821a-c23a37020707 could not be found. Oct 04 18:37:19.251673 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-da8e377b-025d-460b-a91b-90d58bbfff67 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Request method failure captured: Oct 04 18:37:19.251673 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/930b527f-b438-4dca-821a-c23a37020707 HTTP/1.1 Oct 04 18:37:19.251673 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:37:19.251673 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:37:19.251673 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:37:19.251673 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:37:19.251673 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:37:19.251673 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:37:19.251673 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:37:19.251673 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:37:19.251673 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH0vYMImhpO2R8Cn1O-vJ_iuk1HDj3tBhc9P1xcrUv0wjY6mEI2du5YSV4QXVyDuW7KfGoSVWx2fpeXumt1w6W4CvpteGkU2R2E27EPkk8WUVUSuerK4f4i4tnuKkoOnyE3Ivukbp48dMMlhfRYY6zlGq7koGiCQGb90diwJDaCm_Y0 Oct 04 18:37:19.251673 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:37:19.251673 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:37:19.251673 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:37:19.251673 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:37:19.251673 n-d-850501-14 devstack@n-api.service[123002]: X-Openstack-Nova-Api-Version: 2.26 Oct 04 18:37:19.251673 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:37:19.251673 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:37:19.251673 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 30b6df28ccc1404686c1df3d8df4a366 Oct 04 18:37:19.251673 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServerTagsTestJSON-1586895797 Oct 04 18:37:19.251673 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:37:19.251673 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:37:19.251673 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/30b6df28ccc1404686c1df3d8df4a366"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_30b6df28ccc1404686c1df3d8df4a366", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/30b6df28ccc1404686c1df3d8df4a366"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/30b6df28ccc1404686c1df3d8df4a366"}]}] Oct 04 18:37:19.251673 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServerTagsTestJSON-1586895797 Oct 04 18:37:19.251673 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 30b6df28ccc1404686c1df3d8df4a366 Oct 04 18:37:19.251673 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServerTagsTestJSON-1586895797 Oct 04 18:37:19.251673 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServerTagsTestJSON-1586895797-project Oct 04 18:37:19.251673 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:37:19.251673 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:37:19.251673 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 8dbfa195640841ed9ea72cfa654e2a0d Oct 04 18:37:19.251673 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServerTagsTestJSON-1586895797-project Oct 04 18:37:19.251673 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:37:19.251673 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 930b527f-b438-4dca-821a-c23a37020707 could not be found. Oct 04 18:37:19.251673 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '930b527f-b438-4dca-821a-c23a37020707'} Oct 04 18:37:19.251673 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:37:19.251673 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:19.251673 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:37:19.251673 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:37:19.251673 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:37:19.251673 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:37:19.251673 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:37:19.251673 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:37:19.251673 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:37:19.251673 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:37:19.251673 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 930b527f-b438-4dca-821a-c23a37020707 could not be found. Oct 04 18:37:19.251673 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:37:19.251673 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:19.251673 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:37:19.251673 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:19.251673 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:19.251673 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:19.251673 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:37:19.251673 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:37:19.251673 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:37:19.251673 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:37:19.251673 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:37:19.251673 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:37:19.251673 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:37:19.251673 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:37:19.251673 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:37:19.251673 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:37:19.251673 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 930b527f-b438-4dca-821a-c23a37020707 could not be found. Oct 04 18:37:19.251673 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:37:19.251673 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:19.251673 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:37:19.255600 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:19.255600 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:19.255600 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:19.255600 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:37:19.255600 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:37:19.255600 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 930b527f-b438-4dca-821a-c23a37020707 could not be found. Oct 04 18:37:19.255600 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:37:19.255600 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-da8e377b-025d-460b-a91b-90d58bbfff67 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] Returning 404 to user: Instance 930b527f-b438-4dca-821a-c23a37020707 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:37:19.259451 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-da8e377b-025d-460b-a91b-90d58bbfff67 tempest-ServerTagsTestJSON-1586895797 tempest-ServerTagsTestJSON-1586895797-project] 10.222.0.20 "GET /compute/v2.1/servers/930b527f-b438-4dca-821a-c23a37020707" status: 404 len: 111 microversion: 2.26 time: 0.131705 Oct 04 18:37:19.261529 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6652731e-1154-420d-af9d-22f456d9bfd8 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:19.267050 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1212/2337] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:19 2022] GET /compute/v2.1/servers/930b527f-b438-4dca-821a-c23a37020707 => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:37:19.267208 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6652731e-1154-420d-af9d-22f456d9bfd8 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:19.267208 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6652731e-1154-420d-af9d-22f456d9bfd8 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:19.269623 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6652731e-1154-420d-af9d-22f456d9bfd8 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:19.272446 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6652731e-1154-420d-af9d-22f456d9bfd8 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:19.272910 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6652731e-1154-420d-af9d-22f456d9bfd8 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:19.279092 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a87ceceb-5122-461b-ad90-dbae9f4bae9d tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:19.281269 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a87ceceb-5122-461b-ad90-dbae9f4bae9d tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] [instance: 94cff31c-a849-4365-b9e8-326613749226] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:19.288721 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a87ceceb-5122-461b-ad90-dbae9f4bae9d tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:19.289455 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a87ceceb-5122-461b-ad90-dbae9f4bae9d tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:19.290115 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a87ceceb-5122-461b-ad90-dbae9f4bae9d tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:19.291325 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a87ceceb-5122-461b-ad90-dbae9f4bae9d tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:19.292015 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a87ceceb-5122-461b-ad90-dbae9f4bae9d tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:19.292681 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a87ceceb-5122-461b-ad90-dbae9f4bae9d tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:20.192690 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:20.236804 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=6 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:20.364084 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a87ceceb-5122-461b-ad90-dbae9f4bae9d tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8356b47bd87f42e2b642c6df82014e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8869e8a46f40b18434fbe68d819dc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:20.378783 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a87ceceb-5122-461b-ad90-dbae9f4bae9d tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] 10.222.0.20 "GET /compute/v2.1/servers/94cff31c-a849-4365-b9e8-326613749226" status: 200 len: 1316 microversion: 2.1 time: 1.110359 Oct 04 18:37:20.390033 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1213/2338] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:19 2022] GET /compute/v2.1/servers/94cff31c-a849-4365-b9e8-326613749226 => generated 1316 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:20.410215 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7fd7a287-bacc-4a37-b962-f8affec8e0ad tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:20.412459 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7fd7a287-bacc-4a37-b962-f8affec8e0ad tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 474a799f-8e38-49d6-8fff-9ec3e7657ef5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:20.427169 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6652731e-1154-420d-af9d-22f456d9bfd8 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:20.445604 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7fd7a287-bacc-4a37-b962-f8affec8e0ad tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:20.446144 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7fd7a287-bacc-4a37-b962-f8affec8e0ad tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:20.446590 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7fd7a287-bacc-4a37-b962-f8affec8e0ad tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:20.447317 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7fd7a287-bacc-4a37-b962-f8affec8e0ad tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:20.448219 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6652731e-1154-420d-af9d-22f456d9bfd8 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:20.449723 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6652731e-1154-420d-af9d-22f456d9bfd8 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:20.453165 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7fd7a287-bacc-4a37-b962-f8affec8e0ad tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:20.453623 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7fd7a287-bacc-4a37-b962-f8affec8e0ad tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:20.463521 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6652731e-1154-420d-af9d-22f456d9bfd8 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5" status: 200 len: 1486 microversion: 2.25 time: 1.248835 Oct 04 18:37:20.470516 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1126/2339] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:19 2022] GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5 => generated 1486 bytes in 1258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:37:20.485819 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-bf37c24e-fb72-4570-b15f-e4ca7d8dd1f6 req-14ddbc40-9950-482f-99de-ca3eee5dc6b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "616e21b9-c93b-4ff0-8740-24c613f4d708", "name": "network-vif-plugged", "status": "completed", "tag": "d4cd2e6b-3870-407c-a96e-a4f89855e326"}, {"server_uuid": "94cff31c-a849-4365-b9e8-326613749226", "name": "network-vif-plugged", "status": "completed", "tag": "df7147f4-8667-4f09-933e-1ff7b252b5f1"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:20.523049 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-bf37c24e-fb72-4570-b15f-e4ca7d8dd1f6 req-14ddbc40-9950-482f-99de-ca3eee5dc6b0 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:20.524720 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-bf37c24e-fb72-4570-b15f-e4ca7d8dd1f6 req-14ddbc40-9950-482f-99de-ca3eee5dc6b0 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:20.525421 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-bf37c24e-fb72-4570-b15f-e4ca7d8dd1f6 req-14ddbc40-9950-482f-99de-ca3eee5dc6b0 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:20.595446 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-bf37c24e-fb72-4570-b15f-e4ca7d8dd1f6 req-14ddbc40-9950-482f-99de-ca3eee5dc6b0 service nova] Creating event network-vif-plugged:d4cd2e6b-3870-407c-a96e-a4f89855e326 for instance 616e21b9-c93b-4ff0-8740-24c613f4d708 on n-h1-850501-14 Oct 04 18:37:20.595982 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-bf37c24e-fb72-4570-b15f-e4ca7d8dd1f6 req-14ddbc40-9950-482f-99de-ca3eee5dc6b0 service nova] Creating event network-vif-plugged:df7147f4-8667-4f09-933e-1ff7b252b5f1 for instance 94cff31c-a849-4365-b9e8-326613749226 on n-h1-850501-14 Oct 04 18:37:20.621507 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-bf37c24e-fb72-4570-b15f-e4ca7d8dd1f6 req-14ddbc40-9950-482f-99de-ca3eee5dc6b0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.149400 Oct 04 18:37:20.628434 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1127/2340] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:37:20 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:20.668631 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d0005a09-a9e9-4820-a52a-7ff1e820a09f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:20.675062 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d0005a09-a9e9-4820-a52a-7ff1e820a09f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 98dfffc8-51aa-407a-a374-8e120ec43a31] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:20.726592 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d0005a09-a9e9-4820-a52a-7ff1e820a09f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:20.731544 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d0005a09-a9e9-4820-a52a-7ff1e820a09f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:20.743369 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d0005a09-a9e9-4820-a52a-7ff1e820a09f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:20.744868 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d0005a09-a9e9-4820-a52a-7ff1e820a09f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:20.749808 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d0005a09-a9e9-4820-a52a-7ff1e820a09f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:20.753445 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d0005a09-a9e9-4820-a52a-7ff1e820a09f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:21.456755 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:21.472609 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d0005a09-a9e9-4820-a52a-7ff1e820a09f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:21.489293 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d0005a09-a9e9-4820-a52a-7ff1e820a09f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31" status: 200 len: 1199 microversion: 2.1 time: 0.858253 Oct 04 18:37:21.490041 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1128/2341] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:20 2022] GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31 => generated 1199 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:21.509262 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-16f3b063-4675-4568-b8bc-27d455b9942f tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:21.509740 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-16f3b063-4675-4568-b8bc-27d455b9942f tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] [instance: 616e21b9-c93b-4ff0-8740-24c613f4d708] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:21.524810 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:21.527998 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-16f3b063-4675-4568-b8bc-27d455b9942f tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:21.530992 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-16f3b063-4675-4568-b8bc-27d455b9942f tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:21.534592 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-16f3b063-4675-4568-b8bc-27d455b9942f tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:21.539788 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-16f3b063-4675-4568-b8bc-27d455b9942f tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:21.539788 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-16f3b063-4675-4568-b8bc-27d455b9942f tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:21.539788 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-16f3b063-4675-4568-b8bc-27d455b9942f tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:21.699600 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7fd7a287-bacc-4a37-b962-f8affec8e0ad tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:21.713684 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7fd7a287-bacc-4a37-b962-f8affec8e0ad tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5" status: 200 len: 1378 microversion: 2.1 time: 1.321066 Oct 04 18:37:21.714681 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1214/2342] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:20 2022] GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5 => generated 1378 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:21.719872 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6dec88e8-b5a8-4cf9-8952-63aa62e46d92 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:21.728729 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-6dec88e8-b5a8-4cf9-8952-63aa62e46d92 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 61ec7cca-1572-496c-ba44-439f04c2a79c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:21.744620 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6dec88e8-b5a8-4cf9-8952-63aa62e46d92 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:21.748948 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6dec88e8-b5a8-4cf9-8952-63aa62e46d92 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:21.748948 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6dec88e8-b5a8-4cf9-8952-63aa62e46d92 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:21.748948 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6dec88e8-b5a8-4cf9-8952-63aa62e46d92 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:21.748948 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6dec88e8-b5a8-4cf9-8952-63aa62e46d92 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:21.749735 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6dec88e8-b5a8-4cf9-8952-63aa62e46d92 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:22.417322 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-6dec88e8-b5a8-4cf9-8952-63aa62e46d92 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8284fe51decd4db0bf6b3ed1514cc2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87473abf47e74adf844e3ddfa24da3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:22.429636 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6dec88e8-b5a8-4cf9-8952-63aa62e46d92 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] 10.222.0.20 "GET /compute/v2.1/servers/61ec7cca-1572-496c-ba44-439f04c2a79c" status: 200 len: 1313 microversion: 2.1 time: 0.713693 Oct 04 18:37:22.430223 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1215/2343] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:21 2022] GET /compute/v2.1/servers/61ec7cca-1572-496c-ba44-439f04c2a79c => generated 1313 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:22.445048 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-16f3b063-4675-4568-b8bc-27d455b9942f tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb44381220d43b7bdfa744a1dc410a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3242afeef424d588cf102a2f0f38020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:22.459674 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8281407f-eb05-4877-8cbb-4a1b56d3a54b tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:22.468226 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8281407f-eb05-4877-8cbb-4a1b56d3a54b tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] [instance: 94cff31c-a849-4365-b9e8-326613749226] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:22.469102 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-16f3b063-4675-4568-b8bc-27d455b9942f tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] 10.222.0.20 "GET /compute/v2.1/servers/616e21b9-c93b-4ff0-8740-24c613f4d708" status: 200 len: 1333 microversion: 2.1 time: 0.969506 Oct 04 18:37:22.471660 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1129/2344] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:21 2022] GET /compute/v2.1/servers/616e21b9-c93b-4ff0-8740-24c613f4d708 => generated 1333 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:22.491159 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-be366200-ee86-41fc-84e0-91cf207036a9 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:22.494798 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-be366200-ee86-41fc-84e0-91cf207036a9 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: cd74aff9-f694-49f3-a1cc-2095b71cd9e5] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:22.519312 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8281407f-eb05-4877-8cbb-4a1b56d3a54b tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:22.522157 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8281407f-eb05-4877-8cbb-4a1b56d3a54b tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:22.526339 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8281407f-eb05-4877-8cbb-4a1b56d3a54b tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:22.527325 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8281407f-eb05-4877-8cbb-4a1b56d3a54b tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:22.527723 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8281407f-eb05-4877-8cbb-4a1b56d3a54b tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:22.534866 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8281407f-eb05-4877-8cbb-4a1b56d3a54b tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:22.537216 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-be366200-ee86-41fc-84e0-91cf207036a9 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:22.537216 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-be366200-ee86-41fc-84e0-91cf207036a9 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:22.543563 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-be366200-ee86-41fc-84e0-91cf207036a9 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:22.550219 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-be366200-ee86-41fc-84e0-91cf207036a9 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:22.552330 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-be366200-ee86-41fc-84e0-91cf207036a9 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:22.552783 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-be366200-ee86-41fc-84e0-91cf207036a9 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:23.690976 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-be366200-ee86-41fc-84e0-91cf207036a9 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:23.705204 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-be366200-ee86-41fc-84e0-91cf207036a9 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:23.706644 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-be366200-ee86-41fc-84e0-91cf207036a9 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:23.714099 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-be366200-ee86-41fc-84e0-91cf207036a9 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5" status: 200 len: 1486 microversion: 2.25 time: 1.234785 Oct 04 18:37:23.715158 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1130/2345] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:22 2022] GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5 => generated 1486 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:37:23.726293 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3dd8b0b5-a738-41c4-9536-c1ce48d49a2f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:23.726945 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3dd8b0b5-a738-41c4-9536-c1ce48d49a2f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 98dfffc8-51aa-407a-a374-8e120ec43a31] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:23.735943 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8281407f-eb05-4877-8cbb-4a1b56d3a54b tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8356b47bd87f42e2b642c6df82014e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8869e8a46f40b18434fbe68d819dc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:23.743755 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3dd8b0b5-a738-41c4-9536-c1ce48d49a2f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:23.743755 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3dd8b0b5-a738-41c4-9536-c1ce48d49a2f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:23.743755 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3dd8b0b5-a738-41c4-9536-c1ce48d49a2f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:23.744044 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3dd8b0b5-a738-41c4-9536-c1ce48d49a2f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:23.744459 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3dd8b0b5-a738-41c4-9536-c1ce48d49a2f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:23.749314 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3dd8b0b5-a738-41c4-9536-c1ce48d49a2f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:23.752164 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8281407f-eb05-4877-8cbb-4a1b56d3a54b tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] 10.222.0.20 "GET /compute/v2.1/servers/94cff31c-a849-4365-b9e8-326613749226" status: 200 len: 1316 microversion: 2.1 time: 1.307178 Oct 04 18:37:23.759509 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1216/2346] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:22 2022] GET /compute/v2.1/servers/94cff31c-a849-4365-b9e8-326613749226 => generated 1316 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:23.776912 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f0e38580-62ce-45c0-b929-4136adb4f8b7 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:23.778758 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f0e38580-62ce-45c0-b929-4136adb4f8b7 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 474a799f-8e38-49d6-8fff-9ec3e7657ef5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:23.786560 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f0e38580-62ce-45c0-b929-4136adb4f8b7 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:23.787405 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f0e38580-62ce-45c0-b929-4136adb4f8b7 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:23.788137 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f0e38580-62ce-45c0-b929-4136adb4f8b7 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:23.789097 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f0e38580-62ce-45c0-b929-4136adb4f8b7 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:23.789874 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f0e38580-62ce-45c0-b929-4136adb4f8b7 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:23.790760 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f0e38580-62ce-45c0-b929-4136adb4f8b7 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:23.825431 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=8 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:24.293906 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f0e38580-62ce-45c0-b929-4136adb4f8b7 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:24.333069 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3dd8b0b5-a738-41c4-9536-c1ce48d49a2f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:24.345058 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f0e38580-62ce-45c0-b929-4136adb4f8b7 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5" status: 200 len: 1378 microversion: 2.1 time: 0.547169 Oct 04 18:37:24.354147 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1217/2347] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:23 2022] GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5 => generated 1378 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:24.354324 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3dd8b0b5-a738-41c4-9536-c1ce48d49a2f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31" status: 200 len: 1199 microversion: 2.1 time: 0.637475 Oct 04 18:37:24.360000 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1131/2348] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:23 2022] GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31 => generated 1199 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:24.366559 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-76bcc2b6-1aba-4cdb-bee2-38dbc69662f5 req-8115d29a-a4cb-4ee4-a4ca-b43ca8cded1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98dfffc8-51aa-407a-a374-8e120ec43a31", "name": "network-vif-plugged", "status": "completed", "tag": "0f1337d3-c904-4533-8791-cffcbc2b23d5"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:24.372384 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-958c0d91-46fb-46dc-9142-215d7b759b2a tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:24.374803 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-958c0d91-46fb-46dc-9142-215d7b759b2a tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 61ec7cca-1572-496c-ba44-439f04c2a79c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:24.390887 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-76bcc2b6-1aba-4cdb-bee2-38dbc69662f5 req-8115d29a-a4cb-4ee4-a4ca-b43ca8cded1f service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:24.399283 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-958c0d91-46fb-46dc-9142-215d7b759b2a tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:24.400021 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-958c0d91-46fb-46dc-9142-215d7b759b2a tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:24.406657 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-958c0d91-46fb-46dc-9142-215d7b759b2a tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:24.406657 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-958c0d91-46fb-46dc-9142-215d7b759b2a tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:24.406886 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-76bcc2b6-1aba-4cdb-bee2-38dbc69662f5 req-8115d29a-a4cb-4ee4-a4ca-b43ca8cded1f service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:24.406989 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-958c0d91-46fb-46dc-9142-215d7b759b2a tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:24.407075 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-76bcc2b6-1aba-4cdb-bee2-38dbc69662f5 req-8115d29a-a4cb-4ee4-a4ca-b43ca8cded1f service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:24.407145 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-958c0d91-46fb-46dc-9142-215d7b759b2a tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:24.439795 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-76bcc2b6-1aba-4cdb-bee2-38dbc69662f5 req-8115d29a-a4cb-4ee4-a4ca-b43ca8cded1f service nova] Creating event network-vif-plugged:0f1337d3-c904-4533-8791-cffcbc2b23d5 for instance 98dfffc8-51aa-407a-a374-8e120ec43a31 on n-h2-850501-14 Oct 04 18:37:24.476337 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-76bcc2b6-1aba-4cdb-bee2-38dbc69662f5 req-8115d29a-a4cb-4ee4-a4ca-b43ca8cded1f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123904 Oct 04 18:37:24.484788 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1218/2349] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:37:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:24.504523 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5d8d6be4-0597-4816-a61d-a1ec08aa9174 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:24.505780 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5d8d6be4-0597-4816-a61d-a1ec08aa9174 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] [instance: 616e21b9-c93b-4ff0-8740-24c613f4d708] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:24.524399 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5d8d6be4-0597-4816-a61d-a1ec08aa9174 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:24.527639 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5d8d6be4-0597-4816-a61d-a1ec08aa9174 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:24.528266 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5d8d6be4-0597-4816-a61d-a1ec08aa9174 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:24.541942 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5d8d6be4-0597-4816-a61d-a1ec08aa9174 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:24.546922 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5d8d6be4-0597-4816-a61d-a1ec08aa9174 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:24.549180 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5d8d6be4-0597-4816-a61d-a1ec08aa9174 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:25.003802 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5d8d6be4-0597-4816-a61d-a1ec08aa9174 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb44381220d43b7bdfa744a1dc410a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3242afeef424d588cf102a2f0f38020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:25.023097 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5d8d6be4-0597-4816-a61d-a1ec08aa9174 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] 10.222.0.20 "GET /compute/v2.1/servers/616e21b9-c93b-4ff0-8740-24c613f4d708" status: 200 len: 1667 microversion: 2.1 time: 0.536028 Oct 04 18:37:25.043154 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1219/2350] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:24 2022] GET /compute/v2.1/servers/616e21b9-c93b-4ff0-8740-24c613f4d708 => generated 1667 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:25.054614 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-bd907721-376d-41a9-b230-be619c2a0c90 req-5138914a-d837-4864-a4b9-ebb5570cdb45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61ec7cca-1572-496c-ba44-439f04c2a79c", "tag": "1e8e5488-c1ba-4f9a-8944-b4e0b9ce8a0e"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:25.080307 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-bd907721-376d-41a9-b230-be619c2a0c90 req-5138914a-d837-4864-a4b9-ebb5570cdb45 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:25.080984 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-bd907721-376d-41a9-b230-be619c2a0c90 req-5138914a-d837-4864-a4b9-ebb5570cdb45 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:25.081929 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-bd907721-376d-41a9-b230-be619c2a0c90 req-5138914a-d837-4864-a4b9-ebb5570cdb45 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:25.082071 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-958c0d91-46fb-46dc-9142-215d7b759b2a tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8284fe51decd4db0bf6b3ed1514cc2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87473abf47e74adf844e3ddfa24da3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:25.095866 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-958c0d91-46fb-46dc-9142-215d7b759b2a tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] 10.222.0.20 "GET /compute/v2.1/servers/61ec7cca-1572-496c-ba44-439f04c2a79c" status: 200 len: 1313 microversion: 2.1 time: 0.731775 Oct 04 18:37:25.097528 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-bd907721-376d-41a9-b230-be619c2a0c90 req-5138914a-d837-4864-a4b9-ebb5570cdb45 service nova] Creating event network-changed:1e8e5488-c1ba-4f9a-8944-b4e0b9ce8a0e for instance 61ec7cca-1572-496c-ba44-439f04c2a79c on n-h2-850501-14 Oct 04 18:37:25.101532 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1132/2351] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:24 2022] GET /compute/v2.1/servers/61ec7cca-1572-496c-ba44-439f04c2a79c => generated 1313 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:25.102612 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-bd907721-376d-41a9-b230-be619c2a0c90 req-5138914a-d837-4864-a4b9-ebb5570cdb45 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057888 Oct 04 18:37:25.104546 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1220/2352] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:37:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:25.111791 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-85790c23-935e-4877-b9e3-eadafb41bd66 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:25.112534 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-85790c23-935e-4877-b9e3-eadafb41bd66 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: cd74aff9-f694-49f3-a1cc-2095b71cd9e5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:25.114454 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-a112f8b7-ac3f-4dcc-b493-99ad8e6cc1e5 req-f839aa33-5f1a-44c0-9cc2-fd461a50b61c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "474a799f-8e38-49d6-8fff-9ec3e7657ef5", "tag": "a0d7cb42-218d-4bf1-adab-5dbf22e8ab22"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:25.120469 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-85790c23-935e-4877-b9e3-eadafb41bd66 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:25.121256 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-85790c23-935e-4877-b9e3-eadafb41bd66 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:25.124320 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-85790c23-935e-4877-b9e3-eadafb41bd66 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:25.125912 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-85790c23-935e-4877-b9e3-eadafb41bd66 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:25.126666 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-85790c23-935e-4877-b9e3-eadafb41bd66 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:25.127474 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-85790c23-935e-4877-b9e3-eadafb41bd66 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:25.133192 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-a112f8b7-ac3f-4dcc-b493-99ad8e6cc1e5 req-f839aa33-5f1a-44c0-9cc2-fd461a50b61c service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:25.139129 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-a112f8b7-ac3f-4dcc-b493-99ad8e6cc1e5 req-f839aa33-5f1a-44c0-9cc2-fd461a50b61c service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:25.139129 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-a112f8b7-ac3f-4dcc-b493-99ad8e6cc1e5 req-f839aa33-5f1a-44c0-9cc2-fd461a50b61c service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:25.149859 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-a112f8b7-ac3f-4dcc-b493-99ad8e6cc1e5 req-f839aa33-5f1a-44c0-9cc2-fd461a50b61c service nova] Creating event network-changed:a0d7cb42-218d-4bf1-adab-5dbf22e8ab22 for instance 474a799f-8e38-49d6-8fff-9ec3e7657ef5 on n-h2-850501-14 Oct 04 18:37:25.155539 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-a112f8b7-ac3f-4dcc-b493-99ad8e6cc1e5 req-f839aa33-5f1a-44c0-9cc2-fd461a50b61c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051838 Oct 04 18:37:25.156491 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1133/2353] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:37:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:25.162593 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-57b9e872-8c09-4315-b814-f5d2aadfdbff tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:25.163483 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-57b9e872-8c09-4315-b814-f5d2aadfdbff tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] [instance: 94cff31c-a849-4365-b9e8-326613749226] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:25.172625 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-57b9e872-8c09-4315-b814-f5d2aadfdbff tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:25.173125 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-57b9e872-8c09-4315-b814-f5d2aadfdbff tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:25.173578 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-57b9e872-8c09-4315-b814-f5d2aadfdbff tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:25.174284 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-57b9e872-8c09-4315-b814-f5d2aadfdbff tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:25.174767 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-57b9e872-8c09-4315-b814-f5d2aadfdbff tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:25.175167 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-57b9e872-8c09-4315-b814-f5d2aadfdbff tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:25.609350 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-85790c23-935e-4877-b9e3-eadafb41bd66 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:25.620592 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-85790c23-935e-4877-b9e3-eadafb41bd66 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:25.627976 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-85790c23-935e-4877-b9e3-eadafb41bd66 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:25.629553 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-85790c23-935e-4877-b9e3-eadafb41bd66 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5" status: 200 len: 1486 microversion: 2.25 time: 0.523863 Oct 04 18:37:25.634851 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1221/2354] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:25 2022] GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5 => generated 1486 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:37:25.642265 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-57b9e872-8c09-4315-b814-f5d2aadfdbff tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8356b47bd87f42e2b642c6df82014e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8869e8a46f40b18434fbe68d819dc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:25.652323 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-32bcd53a-1c95-4b85-b6d4-36510d8bc7f4 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:25.653087 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-32bcd53a-1c95-4b85-b6d4-36510d8bc7f4 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] [instance: 616e21b9-c93b-4ff0-8740-24c613f4d708] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:25.653554 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-57b9e872-8c09-4315-b814-f5d2aadfdbff tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] 10.222.0.20 "GET /compute/v2.1/servers/94cff31c-a849-4365-b9e8-326613749226" status: 200 len: 1504 microversion: 2.1 time: 0.495239 Oct 04 18:37:25.664833 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1134/2355] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:25 2022] GET /compute/v2.1/servers/94cff31c-a849-4365-b9e8-326613749226 => generated 1504 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:25.670339 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-32bcd53a-1c95-4b85-b6d4-36510d8bc7f4 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:25.672191 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-32bcd53a-1c95-4b85-b6d4-36510d8bc7f4 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:25.672654 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-32bcd53a-1c95-4b85-b6d4-36510d8bc7f4 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:25.673383 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-32bcd53a-1c95-4b85-b6d4-36510d8bc7f4 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:25.673851 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-32bcd53a-1c95-4b85-b6d4-36510d8bc7f4 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:25.674281 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-32bcd53a-1c95-4b85-b6d4-36510d8bc7f4 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:25.679883 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7ceb0c94-61a5-4cf9-b63d-a74897067092 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:25.681535 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7ceb0c94-61a5-4cf9-b63d-a74897067092 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 474a799f-8e38-49d6-8fff-9ec3e7657ef5] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:25.689031 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7ceb0c94-61a5-4cf9-b63d-a74897067092 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:25.689736 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7ceb0c94-61a5-4cf9-b63d-a74897067092 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:25.690368 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7ceb0c94-61a5-4cf9-b63d-a74897067092 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:25.691234 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7ceb0c94-61a5-4cf9-b63d-a74897067092 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:25.691843 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7ceb0c94-61a5-4cf9-b63d-a74897067092 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:25.692447 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7ceb0c94-61a5-4cf9-b63d-a74897067092 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:25.781104 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-32bcd53a-1c95-4b85-b6d4-36510d8bc7f4 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] 10.222.0.20 "GET /compute/v2.1/servers/616e21b9-c93b-4ff0-8740-24c613f4d708/ips" status: 200 len: 178 microversion: 2.1 time: 0.144860 Oct 04 18:37:25.782266 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1222/2356] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Oct 4 18:37:25 2022] GET /compute/v2.1/servers/616e21b9-c93b-4ff0-8740-24c613f4d708/ips => generated 178 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:25.792380 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-728919d0-0215-436b-b502-22aa4d604866 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:25.793224 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-728919d0-0215-436b-b502-22aa4d604866 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 98dfffc8-51aa-407a-a374-8e120ec43a31] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:25.808461 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-728919d0-0215-436b-b502-22aa4d604866 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:25.810851 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-728919d0-0215-436b-b502-22aa4d604866 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:25.812494 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-728919d0-0215-436b-b502-22aa4d604866 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:25.814000 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-728919d0-0215-436b-b502-22aa4d604866 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:25.815677 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-728919d0-0215-436b-b502-22aa4d604866 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:25.816364 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-728919d0-0215-436b-b502-22aa4d604866 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:25.976006 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7ceb0c94-61a5-4cf9-b63d-a74897067092 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:25.986461 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7ceb0c94-61a5-4cf9-b63d-a74897067092 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5" status: 200 len: 1378 microversion: 2.1 time: 0.320433 Oct 04 18:37:25.988733 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1135/2357] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:25 2022] GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5 => generated 1378 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:26.014635 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-933196e3-8a10-4266-81ff-95fa618f8f51 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:26.015218 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-933196e3-8a10-4266-81ff-95fa618f8f51 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] [instance: 94cff31c-a849-4365-b9e8-326613749226] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:26.038748 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-933196e3-8a10-4266-81ff-95fa618f8f51 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:26.041488 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-933196e3-8a10-4266-81ff-95fa618f8f51 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:26.042129 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-933196e3-8a10-4266-81ff-95fa618f8f51 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:26.043082 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-933196e3-8a10-4266-81ff-95fa618f8f51 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:26.043805 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-933196e3-8a10-4266-81ff-95fa618f8f51 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:26.044488 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-933196e3-8a10-4266-81ff-95fa618f8f51 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:26.104470 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-933196e3-8a10-4266-81ff-95fa618f8f51 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] [instance: 94cff31c-a849-4365-b9e8-326613749226] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:37:26.315034 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-728919d0-0215-436b-b502-22aa4d604866 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:26.324290 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-728919d0-0215-436b-b502-22aa4d604866 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31" status: 200 len: 1199 microversion: 2.1 time: 0.540762 Oct 04 18:37:26.325621 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1223/2358] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:25 2022] GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31 => generated 1199 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:26.331216 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-bcb94478-7812-419c-ba5e-314add34610d tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:26.331950 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-bcb94478-7812-419c-ba5e-314add34610d tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] [instance: 616e21b9-c93b-4ff0-8740-24c613f4d708] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:26.338846 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bcb94478-7812-419c-ba5e-314add34610d tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:26.339542 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bcb94478-7812-419c-ba5e-314add34610d tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:26.340175 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bcb94478-7812-419c-ba5e-314add34610d tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:26.341037 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bcb94478-7812-419c-ba5e-314add34610d tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:26.342216 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bcb94478-7812-419c-ba5e-314add34610d tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:26.343779 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bcb94478-7812-419c-ba5e-314add34610d tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:26.382466 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-bcb94478-7812-419c-ba5e-314add34610d tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] [instance: 616e21b9-c93b-4ff0-8740-24c613f4d708] Going to try to terminate instance {{(pid=123002) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:37:26.386316 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=100 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:26.653540 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-933196e3-8a10-4266-81ff-95fa618f8f51 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] 10.222.0.20 "DELETE /compute/v2.1/servers/94cff31c-a849-4365-b9e8-326613749226" status: 204 len: 0 microversion: 2.1 time: 0.643769 Oct 04 18:37:26.664090 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1136/2359] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:37:26 2022] DELETE /compute/v2.1/servers/94cff31c-a849-4365-b9e8-326613749226 => generated 0 bytes in 656 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:37:26.681294 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6b9cfe39-36b9-404f-b4ad-6ee7a549f7b2 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:26.692437 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6b9cfe39-36b9-404f-b4ad-6ee7a549f7b2 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 61ec7cca-1572-496c-ba44-439f04c2a79c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:26.713333 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6b9cfe39-36b9-404f-b4ad-6ee7a549f7b2 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:26.716852 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6b9cfe39-36b9-404f-b4ad-6ee7a549f7b2 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:26.718375 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6b9cfe39-36b9-404f-b4ad-6ee7a549f7b2 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:26.720947 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6b9cfe39-36b9-404f-b4ad-6ee7a549f7b2 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:26.727003 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6b9cfe39-36b9-404f-b4ad-6ee7a549f7b2 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:26.729085 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6b9cfe39-36b9-404f-b4ad-6ee7a549f7b2 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:26.809014 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-bcb94478-7812-419c-ba5e-314add34610d tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] 10.222.0.20 "DELETE /compute/v2.1/servers/616e21b9-c93b-4ff0-8740-24c613f4d708" status: 204 len: 0 microversion: 2.1 time: 0.480803 Oct 04 18:37:26.823950 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1224/2360] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:37:26 2022] DELETE /compute/v2.1/servers/616e21b9-c93b-4ff0-8740-24c613f4d708 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:37:26.823950 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-05810583-b451-481a-a370-17e10ee1d8e5 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:26.829969 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-05810583-b451-481a-a370-17e10ee1d8e5 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: cd74aff9-f694-49f3-a1cc-2095b71cd9e5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:26.846123 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-05810583-b451-481a-a370-17e10ee1d8e5 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:26.849085 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-05810583-b451-481a-a370-17e10ee1d8e5 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:26.852218 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-05810583-b451-481a-a370-17e10ee1d8e5 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:26.853210 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-05810583-b451-481a-a370-17e10ee1d8e5 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:26.853682 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-05810583-b451-481a-a370-17e10ee1d8e5 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:26.854117 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-05810583-b451-481a-a370-17e10ee1d8e5 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:27.075251 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6b9cfe39-36b9-404f-b4ad-6ee7a549f7b2 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8284fe51decd4db0bf6b3ed1514cc2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87473abf47e74adf844e3ddfa24da3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:27.084983 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6b9cfe39-36b9-404f-b4ad-6ee7a549f7b2 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] 10.222.0.20 "GET /compute/v2.1/servers/61ec7cca-1572-496c-ba44-439f04c2a79c" status: 200 len: 1313 microversion: 2.1 time: 0.421875 Oct 04 18:37:27.088297 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1137/2361] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:26 2022] GET /compute/v2.1/servers/61ec7cca-1572-496c-ba44-439f04c2a79c => generated 1313 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:27.098532 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c7966243-f2a0-4461-8a84-9633f4a92cb3 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:27.100774 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c7966243-f2a0-4461-8a84-9633f4a92cb3 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] [instance: 94cff31c-a849-4365-b9e8-326613749226] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:27.117440 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c7966243-f2a0-4461-8a84-9633f4a92cb3 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:27.118257 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c7966243-f2a0-4461-8a84-9633f4a92cb3 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:27.118813 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c7966243-f2a0-4461-8a84-9633f4a92cb3 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:27.119627 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c7966243-f2a0-4461-8a84-9633f4a92cb3 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:27.120321 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c7966243-f2a0-4461-8a84-9633f4a92cb3 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:27.120846 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c7966243-f2a0-4461-8a84-9633f4a92cb3 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:27.147951 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-05810583-b451-481a-a370-17e10ee1d8e5 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:27.159062 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-05810583-b451-481a-a370-17e10ee1d8e5 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:27.162504 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-05810583-b451-481a-a370-17e10ee1d8e5 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:27.169004 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-05810583-b451-481a-a370-17e10ee1d8e5 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5" status: 200 len: 1486 microversion: 2.25 time: 0.351620 Oct 04 18:37:27.173313 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1225/2362] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:26 2022] GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5 => generated 1486 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:37:27.183435 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-28982cbd-574e-47d1-9394-0151df5bd2a7 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:27.186520 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-28982cbd-574e-47d1-9394-0151df5bd2a7 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] [instance: 616e21b9-c93b-4ff0-8740-24c613f4d708] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:27.195211 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-28982cbd-574e-47d1-9394-0151df5bd2a7 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:27.196026 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-28982cbd-574e-47d1-9394-0151df5bd2a7 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:27.204770 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-28982cbd-574e-47d1-9394-0151df5bd2a7 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:27.209987 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-28982cbd-574e-47d1-9394-0151df5bd2a7 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:27.210847 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-28982cbd-574e-47d1-9394-0151df5bd2a7 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:27.211484 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-28982cbd-574e-47d1-9394-0151df5bd2a7 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:27.398826 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c7966243-f2a0-4461-8a84-9633f4a92cb3 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8356b47bd87f42e2b642c6df82014e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8869e8a46f40b18434fbe68d819dc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:27.412818 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c7966243-f2a0-4461-8a84-9633f4a92cb3 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] 10.222.0.20 "GET /compute/v2.1/servers/94cff31c-a849-4365-b9e8-326613749226" status: 200 len: 1510 microversion: 2.1 time: 0.323208 Oct 04 18:37:27.414232 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1138/2363] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:27 2022] GET /compute/v2.1/servers/94cff31c-a849-4365-b9e8-326613749226 => generated 1510 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:27.422020 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a08b5f0c-ab8e-4e0a-b4b7-13ee9d431259 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:27.423498 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a08b5f0c-ab8e-4e0a-b4b7-13ee9d431259 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 474a799f-8e38-49d6-8fff-9ec3e7657ef5] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:27.443176 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a08b5f0c-ab8e-4e0a-b4b7-13ee9d431259 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:27.443680 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a08b5f0c-ab8e-4e0a-b4b7-13ee9d431259 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:27.444148 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a08b5f0c-ab8e-4e0a-b4b7-13ee9d431259 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:27.445234 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a08b5f0c-ab8e-4e0a-b4b7-13ee9d431259 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:27.445845 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a08b5f0c-ab8e-4e0a-b4b7-13ee9d431259 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:27.446421 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a08b5f0c-ab8e-4e0a-b4b7-13ee9d431259 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:27.564747 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-28982cbd-574e-47d1-9394-0151df5bd2a7 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb44381220d43b7bdfa744a1dc410a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3242afeef424d588cf102a2f0f38020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:27.576450 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-28982cbd-574e-47d1-9394-0151df5bd2a7 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] 10.222.0.20 "GET /compute/v2.1/servers/616e21b9-c93b-4ff0-8740-24c613f4d708" status: 200 len: 1673 microversion: 2.1 time: 0.401408 Oct 04 18:37:27.577411 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1226/2364] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:27 2022] GET /compute/v2.1/servers/616e21b9-c93b-4ff0-8740-24c613f4d708 => generated 1673 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:27.582290 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e6aa327e-9610-4051-b1d4-2f172b74afc6 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:27.583963 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e6aa327e-9610-4051-b1d4-2f172b74afc6 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 98dfffc8-51aa-407a-a374-8e120ec43a31] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:27.600335 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e6aa327e-9610-4051-b1d4-2f172b74afc6 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:27.600953 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e6aa327e-9610-4051-b1d4-2f172b74afc6 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:27.601599 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e6aa327e-9610-4051-b1d4-2f172b74afc6 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:27.602562 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e6aa327e-9610-4051-b1d4-2f172b74afc6 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:27.603081 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e6aa327e-9610-4051-b1d4-2f172b74afc6 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:27.603563 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e6aa327e-9610-4051-b1d4-2f172b74afc6 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:27.715714 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a08b5f0c-ab8e-4e0a-b4b7-13ee9d431259 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:27.728308 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a08b5f0c-ab8e-4e0a-b4b7-13ee9d431259 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5" status: 200 len: 1378 microversion: 2.1 time: 0.310857 Oct 04 18:37:27.728902 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1139/2365] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:27 2022] GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5 => generated 1378 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:27.810877 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e6aa327e-9610-4051-b1d4-2f172b74afc6 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:27.839698 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e6aa327e-9610-4051-b1d4-2f172b74afc6 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31" status: 200 len: 1199 microversion: 2.1 time: 0.258329 Oct 04 18:37:27.844763 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1227/2366] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:27 2022] GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31 => generated 1199 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:28.114708 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-af354ab9-5488-4f6e-bb61-2ac156b06ebc tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:28.115332 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-af354ab9-5488-4f6e-bb61-2ac156b06ebc tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 61ec7cca-1572-496c-ba44-439f04c2a79c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:28.124340 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-af354ab9-5488-4f6e-bb61-2ac156b06ebc tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:28.124964 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-af354ab9-5488-4f6e-bb61-2ac156b06ebc tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:28.125300 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-af354ab9-5488-4f6e-bb61-2ac156b06ebc tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:28.125998 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-af354ab9-5488-4f6e-bb61-2ac156b06ebc tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:28.126451 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-af354ab9-5488-4f6e-bb61-2ac156b06ebc tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:28.126873 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-af354ab9-5488-4f6e-bb61-2ac156b06ebc tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:28.213035 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8f29eab8-3b18-49cc-b368-970f094f86b1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:28.214237 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8f29eab8-3b18-49cc-b368-970f094f86b1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: cd74aff9-f694-49f3-a1cc-2095b71cd9e5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:28.223066 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8f29eab8-3b18-49cc-b368-970f094f86b1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:28.226507 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8f29eab8-3b18-49cc-b368-970f094f86b1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:28.227201 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8f29eab8-3b18-49cc-b368-970f094f86b1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:28.228278 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8f29eab8-3b18-49cc-b368-970f094f86b1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:28.228841 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8f29eab8-3b18-49cc-b368-970f094f86b1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:28.229997 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8f29eab8-3b18-49cc-b368-970f094f86b1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:28.399545 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-af354ab9-5488-4f6e-bb61-2ac156b06ebc tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8284fe51decd4db0bf6b3ed1514cc2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87473abf47e74adf844e3ddfa24da3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:28.409594 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-af354ab9-5488-4f6e-bb61-2ac156b06ebc tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] 10.222.0.20 "GET /compute/v2.1/servers/61ec7cca-1572-496c-ba44-439f04c2a79c" status: 200 len: 1313 microversion: 2.1 time: 0.299739 Oct 04 18:37:28.411557 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1140/2367] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:28 2022] GET /compute/v2.1/servers/61ec7cca-1572-496c-ba44-439f04c2a79c => generated 1313 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:28.442066 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-43a4c6bc-0910-4e4d-bada-8835453d6840 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:28.442711 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-43a4c6bc-0910-4e4d-bada-8835453d6840 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] [instance: 94cff31c-a849-4365-b9e8-326613749226] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:28.450444 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-43a4c6bc-0910-4e4d-bada-8835453d6840 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:28.451228 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-43a4c6bc-0910-4e4d-bada-8835453d6840 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:28.452697 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-43a4c6bc-0910-4e4d-bada-8835453d6840 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:28.453805 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-43a4c6bc-0910-4e4d-bada-8835453d6840 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:28.454425 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-43a4c6bc-0910-4e4d-bada-8835453d6840 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:28.455159 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-43a4c6bc-0910-4e4d-bada-8835453d6840 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:28.473988 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:28.531228 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8f29eab8-3b18-49cc-b368-970f094f86b1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:28.539971 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8f29eab8-3b18-49cc-b368-970f094f86b1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:28.547870 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8f29eab8-3b18-49cc-b368-970f094f86b1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:28.550646 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8f29eab8-3b18-49cc-b368-970f094f86b1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5" status: 200 len: 1486 microversion: 2.25 time: 0.342443 Oct 04 18:37:28.551755 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1228/2368] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:28 2022] GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5 => generated 1486 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:37:28.616099 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4827c83c-4ffc-410c-8714-0a878948dd16 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:28.617606 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4827c83c-4ffc-410c-8714-0a878948dd16 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] [instance: 616e21b9-c93b-4ff0-8740-24c613f4d708] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:28.635775 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4827c83c-4ffc-410c-8714-0a878948dd16 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:28.636304 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4827c83c-4ffc-410c-8714-0a878948dd16 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:28.636741 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4827c83c-4ffc-410c-8714-0a878948dd16 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:28.637449 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4827c83c-4ffc-410c-8714-0a878948dd16 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:28.637905 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4827c83c-4ffc-410c-8714-0a878948dd16 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:28.638320 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4827c83c-4ffc-410c-8714-0a878948dd16 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:28.718686 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-43a4c6bc-0910-4e4d-bada-8835453d6840 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8356b47bd87f42e2b642c6df82014e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8869e8a46f40b18434fbe68d819dc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:28.737574 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-43a4c6bc-0910-4e4d-bada-8835453d6840 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] 10.222.0.20 "GET /compute/v2.1/servers/94cff31c-a849-4365-b9e8-326613749226" status: 200 len: 1510 microversion: 2.1 time: 0.300424 Oct 04 18:37:28.738489 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1141/2369] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:28 2022] GET /compute/v2.1/servers/94cff31c-a849-4365-b9e8-326613749226 => generated 1510 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:28.752397 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4ec85b99-3ece-4040-8407-67618870f3c4 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:28.753048 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-4ec85b99-3ece-4040-8407-67618870f3c4 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 474a799f-8e38-49d6-8fff-9ec3e7657ef5] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:28.761951 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4ec85b99-3ece-4040-8407-67618870f3c4 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:28.762452 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4ec85b99-3ece-4040-8407-67618870f3c4 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:28.762957 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4ec85b99-3ece-4040-8407-67618870f3c4 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:28.764744 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4ec85b99-3ece-4040-8407-67618870f3c4 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:28.765214 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4ec85b99-3ece-4040-8407-67618870f3c4 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:28.765649 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4ec85b99-3ece-4040-8407-67618870f3c4 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:28.909901 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4827c83c-4ffc-410c-8714-0a878948dd16 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb44381220d43b7bdfa744a1dc410a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3242afeef424d588cf102a2f0f38020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:28.920166 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4827c83c-4ffc-410c-8714-0a878948dd16 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] 10.222.0.20 "GET /compute/v2.1/servers/616e21b9-c93b-4ff0-8740-24c613f4d708" status: 200 len: 1673 microversion: 2.1 time: 0.317886 Oct 04 18:37:28.920680 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1229/2370] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:28 2022] GET /compute/v2.1/servers/616e21b9-c93b-4ff0-8740-24c613f4d708 => generated 1673 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:37:28.926770 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d94e01ec-fad4-41f9-a1c9-4ac876a96a36 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:28.927464 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d94e01ec-fad4-41f9-a1c9-4ac876a96a36 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 98dfffc8-51aa-407a-a374-8e120ec43a31] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:28.936130 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d94e01ec-fad4-41f9-a1c9-4ac876a96a36 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:28.937502 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d94e01ec-fad4-41f9-a1c9-4ac876a96a36 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:28.938311 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d94e01ec-fad4-41f9-a1c9-4ac876a96a36 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:28.939251 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d94e01ec-fad4-41f9-a1c9-4ac876a96a36 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:28.939909 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d94e01ec-fad4-41f9-a1c9-4ac876a96a36 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:28.942668 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d94e01ec-fad4-41f9-a1c9-4ac876a96a36 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:29.035196 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-4ec85b99-3ece-4040-8407-67618870f3c4 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:29.047866 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-4ec85b99-3ece-4040-8407-67618870f3c4 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5" status: 200 len: 1378 microversion: 2.1 time: 0.300321 Oct 04 18:37:29.050500 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1142/2371] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:28 2022] GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5 => generated 1378 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:29.176574 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d94e01ec-fad4-41f9-a1c9-4ac876a96a36 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:29.186518 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d94e01ec-fad4-41f9-a1c9-4ac876a96a36 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31" status: 200 len: 1382 microversion: 2.1 time: 0.264916 Oct 04 18:37:29.200308 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1230/2372] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:28 2022] GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31 => generated 1382 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:29.434850 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d13941c8-576d-4c5e-a1ef-38579b494370 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:29.435739 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d13941c8-576d-4c5e-a1ef-38579b494370 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 61ec7cca-1572-496c-ba44-439f04c2a79c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:29.449438 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d13941c8-576d-4c5e-a1ef-38579b494370 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:29.449929 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d13941c8-576d-4c5e-a1ef-38579b494370 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:29.457488 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d13941c8-576d-4c5e-a1ef-38579b494370 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:29.459131 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d13941c8-576d-4c5e-a1ef-38579b494370 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:29.459625 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d13941c8-576d-4c5e-a1ef-38579b494370 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:29.460087 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d13941c8-576d-4c5e-a1ef-38579b494370 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:29.659267 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7cb4f545-3e34-4fb4-b6c9-eeba35f39e16 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:29.660008 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7cb4f545-3e34-4fb4-b6c9-eeba35f39e16 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] [instance: 98dfffc8-51aa-407a-a374-8e120ec43a31] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:29.673131 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7cb4f545-3e34-4fb4-b6c9-eeba35f39e16 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:29.674174 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7cb4f545-3e34-4fb4-b6c9-eeba35f39e16 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:29.674960 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7cb4f545-3e34-4fb4-b6c9-eeba35f39e16 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:29.676085 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7cb4f545-3e34-4fb4-b6c9-eeba35f39e16 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:29.676754 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7cb4f545-3e34-4fb4-b6c9-eeba35f39e16 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:29.677380 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7cb4f545-3e34-4fb4-b6c9-eeba35f39e16 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:29.844246 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d13941c8-576d-4c5e-a1ef-38579b494370 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8284fe51decd4db0bf6b3ed1514cc2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87473abf47e74adf844e3ddfa24da3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:29.859424 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d13941c8-576d-4c5e-a1ef-38579b494370 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] 10.222.0.20 "GET /compute/v2.1/servers/61ec7cca-1572-496c-ba44-439f04c2a79c" status: 200 len: 1313 microversion: 2.1 time: 0.428318 Oct 04 18:37:29.877338 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1231/2373] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:29 2022] GET /compute/v2.1/servers/61ec7cca-1572-496c-ba44-439f04c2a79c => generated 1313 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:29.889504 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-83b78c8d-c370-4a87-8e9c-607d3d8ca9a8 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:29.892754 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-83b78c8d-c370-4a87-8e9c-607d3d8ca9a8 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: cd74aff9-f694-49f3-a1cc-2095b71cd9e5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:29.907093 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-83b78c8d-c370-4a87-8e9c-607d3d8ca9a8 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:29.907593 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-83b78c8d-c370-4a87-8e9c-607d3d8ca9a8 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:29.908120 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-83b78c8d-c370-4a87-8e9c-607d3d8ca9a8 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:29.908844 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-83b78c8d-c370-4a87-8e9c-607d3d8ca9a8 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:29.909287 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-83b78c8d-c370-4a87-8e9c-607d3d8ca9a8 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:29.909704 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-83b78c8d-c370-4a87-8e9c-607d3d8ca9a8 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:30.080872 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7cb4f545-3e34-4fb4-b6c9-eeba35f39e16 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31" status: 200 len: 1535 microversion: 2.1 time: 0.873897 Oct 04 18:37:30.082045 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1143/2374] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:29 2022] GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31 => generated 1535 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:30.105944 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-23f2af8f-f824-47fd-aa09-bcbfd73f740e tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:30.105944 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-23f2af8f-f824-47fd-aa09-bcbfd73f740e tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] [instance: 94cff31c-a849-4365-b9e8-326613749226] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:30.117878 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-23f2af8f-f824-47fd-aa09-bcbfd73f740e tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:30.120244 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-23f2af8f-f824-47fd-aa09-bcbfd73f740e tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:30.124293 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-23f2af8f-f824-47fd-aa09-bcbfd73f740e tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:30.127557 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-23f2af8f-f824-47fd-aa09-bcbfd73f740e tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:30.132232 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-23f2af8f-f824-47fd-aa09-bcbfd73f740e tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:30.132876 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-23f2af8f-f824-47fd-aa09-bcbfd73f740e tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:30.172573 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-83b78c8d-c370-4a87-8e9c-607d3d8ca9a8 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:30.182261 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-83b78c8d-c370-4a87-8e9c-607d3d8ca9a8 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:30.184301 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-83b78c8d-c370-4a87-8e9c-607d3d8ca9a8 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:30.186424 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-83b78c8d-c370-4a87-8e9c-607d3d8ca9a8 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5" status: 200 len: 1486 microversion: 2.25 time: 0.307118 Oct 04 18:37:30.213551 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1232/2375] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:29 2022] GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5 => generated 1486 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:37:30.220825 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-55d1ec12-1358-4f36-b411-ef783100af51 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:30.223364 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-55d1ec12-1358-4f36-b411-ef783100af51 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] [instance: 616e21b9-c93b-4ff0-8740-24c613f4d708] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:30.243001 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-55d1ec12-1358-4f36-b411-ef783100af51 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:30.243742 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-55d1ec12-1358-4f36-b411-ef783100af51 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:30.244371 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-55d1ec12-1358-4f36-b411-ef783100af51 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:30.249079 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-55d1ec12-1358-4f36-b411-ef783100af51 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:30.249787 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-55d1ec12-1358-4f36-b411-ef783100af51 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:30.250237 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-55d1ec12-1358-4f36-b411-ef783100af51 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:30.429167 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-23f2af8f-f824-47fd-aa09-bcbfd73f740e tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8356b47bd87f42e2b642c6df82014e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8869e8a46f40b18434fbe68d819dc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:30.442671 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-23f2af8f-f824-47fd-aa09-bcbfd73f740e tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] 10.222.0.20 "GET /compute/v2.1/servers/94cff31c-a849-4365-b9e8-326613749226" status: 200 len: 1510 microversion: 2.1 time: 0.355146 Oct 04 18:37:30.443486 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1144/2376] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:30 2022] GET /compute/v2.1/servers/94cff31c-a849-4365-b9e8-326613749226 => generated 1510 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:30.452814 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a564e903-15e6-4dab-999d-452f75145b1b tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:30.464998 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a564e903-15e6-4dab-999d-452f75145b1b tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 474a799f-8e38-49d6-8fff-9ec3e7657ef5] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:30.472662 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a564e903-15e6-4dab-999d-452f75145b1b tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:30.610992 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a564e903-15e6-4dab-999d-452f75145b1b tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:30.610992 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a564e903-15e6-4dab-999d-452f75145b1b tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:30.610992 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a564e903-15e6-4dab-999d-452f75145b1b tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:30.610992 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a564e903-15e6-4dab-999d-452f75145b1b tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:30.610992 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a564e903-15e6-4dab-999d-452f75145b1b tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:30.611798 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-55d1ec12-1358-4f36-b411-ef783100af51 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb44381220d43b7bdfa744a1dc410a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3242afeef424d588cf102a2f0f38020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:30.611798 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-55d1ec12-1358-4f36-b411-ef783100af51 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] 10.222.0.20 "GET /compute/v2.1/servers/616e21b9-c93b-4ff0-8740-24c613f4d708" status: 200 len: 1673 microversion: 2.1 time: 0.358880 Oct 04 18:37:30.611798 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1233/2377] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:30 2022] GET /compute/v2.1/servers/616e21b9-c93b-4ff0-8740-24c613f4d708 => generated 1673 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:30.611798 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ccf09676-0115-422f-81c9-d788c91c1436 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:30.611798 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ccf09676-0115-422f-81c9-d788c91c1436 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] [instance: 98dfffc8-51aa-407a-a374-8e120ec43a31] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:30.611798 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ccf09676-0115-422f-81c9-d788c91c1436 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:30.611798 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ccf09676-0115-422f-81c9-d788c91c1436 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:30.611798 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ccf09676-0115-422f-81c9-d788c91c1436 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:30.611798 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ccf09676-0115-422f-81c9-d788c91c1436 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:30.611798 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ccf09676-0115-422f-81c9-d788c91c1436 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:30.611798 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ccf09676-0115-422f-81c9-d788c91c1436 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:30.647557 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a564e903-15e6-4dab-999d-452f75145b1b tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:30.656725 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a564e903-15e6-4dab-999d-452f75145b1b tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5" status: 200 len: 1378 microversion: 2.1 time: 0.208047 Oct 04 18:37:30.657632 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1145/2378] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:30 2022] GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5 => generated 1378 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:30.744620 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ccf09676-0115-422f-81c9-d788c91c1436 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31" status: 200 len: 1535 microversion: 2.1 time: 0.169158 Oct 04 18:37:30.745383 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1234/2379] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:30 2022] GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31 => generated 1535 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:30.768598 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-381c256e-c1df-4b63-9725-96e6b8c8d198 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:30.772553 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-381c256e-c1df-4b63-9725-96e6b8c8d198 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:30.772930 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-381c256e-c1df-4b63-9725-96e6b8c8d198 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:30.773367 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-381c256e-c1df-4b63-9725-96e6b8c8d198 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:30.774093 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-381c256e-c1df-4b63-9725-96e6b8c8d198 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:30.774539 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-381c256e-c1df-4b63-9725-96e6b8c8d198 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:30.774958 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-381c256e-c1df-4b63-9725-96e6b8c8d198 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:30.802185 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:30.809082 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-381c256e-c1df-4b63-9725-96e6b8c8d198 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.044160 Oct 04 18:37:30.815894 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1235/2380] 10.222.0.20 () {58 vars in 1176 bytes} [Tue Oct 4 18:37:30 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:37:30.826793 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-20b4a1bc-cbaa-401d-9699-1f4637f5f649 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-850501-14", "block_migration": false, "disk_over_commit": false}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:30.843110 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-20b4a1bc-cbaa-401d-9699-1f4637f5f649 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] [instance: 98dfffc8-51aa-407a-a374-8e120ec43a31] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:30.850911 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-20b4a1bc-cbaa-401d-9699-1f4637f5f649 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:30.852270 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-20b4a1bc-cbaa-401d-9699-1f4637f5f649 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:30.852870 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-20b4a1bc-cbaa-401d-9699-1f4637f5f649 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:30.853792 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-20b4a1bc-cbaa-401d-9699-1f4637f5f649 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:30.854511 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-20b4a1bc-cbaa-401d-9699-1f4637f5f649 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:30.855141 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-20b4a1bc-cbaa-401d-9699-1f4637f5f649 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:30.915678 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6ce0fad6-9041-4369-8286-47fa86cdee3a tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1282757123", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": "none"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:30.918251 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-20b4a1bc-cbaa-401d-9699-1f4637f5f649 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lazy-loading 'flavor' on Instance uuid 98dfffc8-51aa-407a-a374-8e120ec43a31 {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:37:30.935314 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-20b4a1bc-cbaa-401d-9699-1f4637f5f649 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] [instance: 98dfffc8-51aa-407a-a374-8e120ec43a31] Going to try to live migrate instance to n-h1-850501-14 {{(pid=123002) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 18:37:31.037561 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-6ce0fad6-9041-4369-8286-47fa86cdee3a tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:37:31.038197 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-6ce0fad6-9041-4369-8286-47fa86cdee3a tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:37:31.040493 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-6ce0fad6-9041-4369-8286-47fa86cdee3a tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:37:31.040989 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-6ce0fad6-9041-4369-8286-47fa86cdee3a tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:37:31.042185 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-6ce0fad6-9041-4369-8286-47fa86cdee3a tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:37:31.054629 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6ce0fad6-9041-4369-8286-47fa86cdee3a tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:31.055186 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6ce0fad6-9041-4369-8286-47fa86cdee3a tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:31.055648 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6ce0fad6-9041-4369-8286-47fa86cdee3a tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:31.062749 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6ce0fad6-9041-4369-8286-47fa86cdee3a tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:31.062749 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6ce0fad6-9041-4369-8286-47fa86cdee3a tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:31.062749 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6ce0fad6-9041-4369-8286-47fa86cdee3a tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:31.093195 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-6ce0fad6-9041-4369-8286-47fa86cdee3a tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Getting quotas for project 33b06f718d51425c8f97973d3a71f69d. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:37:31.100299 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-6ce0fad6-9041-4369-8286-47fa86cdee3a tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Getting quotas for user ea07cc36ba87434cbcfa91b218543597 and project 33b06f718d51425c8f97973d3a71f69d. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:37:31.125987 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6ce0fad6-9041-4369-8286-47fa86cdee3a tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Going to run 1 instances... {{(pid=123001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:37:31.129822 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6ce0fad6-9041-4369-8286-47fa86cdee3a tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] [instance: 0bef06d7-ba85-4f48-bd08-228211391394] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:37:31.337337 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6ce0fad6-9041-4369-8286-47fa86cdee3a tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.678045 Oct 04 18:37:31.338813 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1146/2381] 10.222.0.20 () {62 vars in 1188 bytes} [Tue Oct 4 18:37:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 680 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 18:37:31.346468 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-96658859-e2cd-4586-8b03-ad940154a78f tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:31.347555 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-96658859-e2cd-4586-8b03-ad940154a78f tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 61ec7cca-1572-496c-ba44-439f04c2a79c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:31.380361 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-96658859-e2cd-4586-8b03-ad940154a78f tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:31.385374 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-96658859-e2cd-4586-8b03-ad940154a78f tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:31.385998 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-96658859-e2cd-4586-8b03-ad940154a78f tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:31.391300 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-96658859-e2cd-4586-8b03-ad940154a78f tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:31.392119 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-96658859-e2cd-4586-8b03-ad940154a78f tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:31.392642 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-96658859-e2cd-4586-8b03-ad940154a78f tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:31.703153 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-96658859-e2cd-4586-8b03-ad940154a78f tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8284fe51decd4db0bf6b3ed1514cc2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87473abf47e74adf844e3ddfa24da3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:31.732400 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-96658859-e2cd-4586-8b03-ad940154a78f tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] 10.222.0.20 "GET /compute/v2.1/servers/61ec7cca-1572-496c-ba44-439f04c2a79c" status: 200 len: 1313 microversion: 2.1 time: 0.375246 Oct 04 18:37:31.732400 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1147/2382] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:31 2022] GET /compute/v2.1/servers/61ec7cca-1572-496c-ba44-439f04c2a79c => generated 1313 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:31.741115 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-b92354c9-d9c0-4e9f-a10a-ed36c5c65632 req-01829efb-6e4d-4c03-99a6-d7ce422f2533 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94cff31c-a849-4365-b9e8-326613749226", "name": "network-vif-deleted", "tag": "df7147f4-8667-4f09-933e-1ff7b252b5f1"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:31.754801 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-b92354c9-d9c0-4e9f-a10a-ed36c5c65632 req-01829efb-6e4d-4c03-99a6-d7ce422f2533 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:31.757421 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-b92354c9-d9c0-4e9f-a10a-ed36c5c65632 req-01829efb-6e4d-4c03-99a6-d7ce422f2533 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:31.758110 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-b92354c9-d9c0-4e9f-a10a-ed36c5c65632 req-01829efb-6e4d-4c03-99a6-d7ce422f2533 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:31.793591 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-b92354c9-d9c0-4e9f-a10a-ed36c5c65632 req-01829efb-6e4d-4c03-99a6-d7ce422f2533 service nova] Creating event network-vif-deleted:df7147f4-8667-4f09-933e-1ff7b252b5f1 for instance 94cff31c-a849-4365-b9e8-326613749226 on n-h1-850501-14 Oct 04 18:37:31.809838 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-b92354c9-d9c0-4e9f-a10a-ed36c5c65632 req-01829efb-6e4d-4c03-99a6-d7ce422f2533 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073220 Oct 04 18:37:31.812480 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1148/2383] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:37:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:31.827775 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1b4f7b6e-5db5-4bc0-9f2c-e5c70494b9af tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:31.828536 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1b4f7b6e-5db5-4bc0-9f2c-e5c70494b9af tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: cd74aff9-f694-49f3-a1cc-2095b71cd9e5] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:31.843204 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1b4f7b6e-5db5-4bc0-9f2c-e5c70494b9af tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:31.845247 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1b4f7b6e-5db5-4bc0-9f2c-e5c70494b9af tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:31.845708 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1b4f7b6e-5db5-4bc0-9f2c-e5c70494b9af tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:31.846438 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1b4f7b6e-5db5-4bc0-9f2c-e5c70494b9af tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:31.849451 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1b4f7b6e-5db5-4bc0-9f2c-e5c70494b9af tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:31.849916 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1b4f7b6e-5db5-4bc0-9f2c-e5c70494b9af tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:32.219918 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1b4f7b6e-5db5-4bc0-9f2c-e5c70494b9af tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:32.266466 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1b4f7b6e-5db5-4bc0-9f2c-e5c70494b9af tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:32.273640 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1b4f7b6e-5db5-4bc0-9f2c-e5c70494b9af tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:32.286963 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1b4f7b6e-5db5-4bc0-9f2c-e5c70494b9af tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5" status: 200 len: 1476 microversion: 2.25 time: 0.468945 Oct 04 18:37:32.290935 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1149/2384] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:31 2022] GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5 => generated 1476 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:37:32.340348 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-498b99ac-a01f-4c3f-b912-d6d53087eaa9 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:32.341963 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-498b99ac-a01f-4c3f-b912-d6d53087eaa9 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] [instance: 0bef06d7-ba85-4f48-bd08-228211391394] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:32.452272 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-498b99ac-a01f-4c3f-b912-d6d53087eaa9 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:32.472801 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-498b99ac-a01f-4c3f-b912-d6d53087eaa9 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:32.484760 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-498b99ac-a01f-4c3f-b912-d6d53087eaa9 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:32.486023 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-498b99ac-a01f-4c3f-b912-d6d53087eaa9 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] 10.222.0.20 "GET /compute/v2.1/servers/0bef06d7-ba85-4f48-bd08-228211391394" status: 200 len: 1278 microversion: 2.57 time: 0.190845 Oct 04 18:37:32.489526 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1150/2385] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:32 2022] GET /compute/v2.1/servers/0bef06d7-ba85-4f48-bd08-228211391394 => generated 1278 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:37:32.508433 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-edffdd89-2b49-40c4-8f86-636ff5ba7cb0 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:32.509333 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-edffdd89-2b49-40c4-8f86-636ff5ba7cb0 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] [instance: 94cff31c-a849-4365-b9e8-326613749226] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:32.528546 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-edffdd89-2b49-40c4-8f86-636ff5ba7cb0 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:32.529763 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-edffdd89-2b49-40c4-8f86-636ff5ba7cb0 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:32.530164 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-edffdd89-2b49-40c4-8f86-636ff5ba7cb0 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:32.536198 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-edffdd89-2b49-40c4-8f86-636ff5ba7cb0 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:32.536733 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-edffdd89-2b49-40c4-8f86-636ff5ba7cb0 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:32.537175 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-edffdd89-2b49-40c4-8f86-636ff5ba7cb0 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:32.587851 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-edffdd89-2b49-40c4-8f86-636ff5ba7cb0 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:32.588893 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-edffdd89-2b49-40c4-8f86-636ff5ba7cb0 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:32.589484 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-edffdd89-2b49-40c4-8f86-636ff5ba7cb0 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:32.590087 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-edffdd89-2b49-40c4-8f86-636ff5ba7cb0 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Lazy-loading 'fault' on Instance uuid 94cff31c-a849-4365-b9e8-326613749226 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:37:32.681358 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-edffdd89-2b49-40c4-8f86-636ff5ba7cb0 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8356b47bd87f42e2b642c6df82014e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8869e8a46f40b18434fbe68d819dc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:32.692247 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-edffdd89-2b49-40c4-8f86-636ff5ba7cb0 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] 10.222.0.20 "GET /compute/v2.1/servers/94cff31c-a849-4365-b9e8-326613749226" status: 200 len: 1306 microversion: 2.1 time: 0.201546 Oct 04 18:37:32.694455 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1151/2386] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:32 2022] GET /compute/v2.1/servers/94cff31c-a849-4365-b9e8-326613749226 => generated 1306 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:32.708308 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e50c6151-3a46-4a7a-9eb7-e68f586f481d tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:32.708950 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e50c6151-3a46-4a7a-9eb7-e68f586f481d tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] [instance: 616e21b9-c93b-4ff0-8740-24c613f4d708] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:32.731065 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e50c6151-3a46-4a7a-9eb7-e68f586f481d tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:32.731810 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e50c6151-3a46-4a7a-9eb7-e68f586f481d tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:32.733037 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e50c6151-3a46-4a7a-9eb7-e68f586f481d tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:32.733971 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e50c6151-3a46-4a7a-9eb7-e68f586f481d tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:32.734446 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e50c6151-3a46-4a7a-9eb7-e68f586f481d tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:32.734883 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e50c6151-3a46-4a7a-9eb7-e68f586f481d tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:32.926759 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e50c6151-3a46-4a7a-9eb7-e68f586f481d tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb44381220d43b7bdfa744a1dc410a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3242afeef424d588cf102a2f0f38020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:32.937647 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e50c6151-3a46-4a7a-9eb7-e68f586f481d tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] 10.222.0.20 "GET /compute/v2.1/servers/616e21b9-c93b-4ff0-8740-24c613f4d708" status: 200 len: 1652 microversion: 2.1 time: 0.241634 Oct 04 18:37:32.938606 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1152/2387] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:32 2022] GET /compute/v2.1/servers/616e21b9-c93b-4ff0-8740-24c613f4d708 => generated 1652 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:32.943927 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-435653dd-0df5-40ff-9646-4f9189bb98b1 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:32.944674 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-435653dd-0df5-40ff-9646-4f9189bb98b1 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 474a799f-8e38-49d6-8fff-9ec3e7657ef5] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:32.965388 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-435653dd-0df5-40ff-9646-4f9189bb98b1 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:32.965988 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-435653dd-0df5-40ff-9646-4f9189bb98b1 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:32.969250 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-435653dd-0df5-40ff-9646-4f9189bb98b1 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:32.975000 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-435653dd-0df5-40ff-9646-4f9189bb98b1 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:32.976135 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-435653dd-0df5-40ff-9646-4f9189bb98b1 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:32.976802 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-435653dd-0df5-40ff-9646-4f9189bb98b1 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:33.397805 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-435653dd-0df5-40ff-9646-4f9189bb98b1 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:33.441365 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-435653dd-0df5-40ff-9646-4f9189bb98b1 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5" status: 200 len: 1378 microversion: 2.1 time: 0.501111 Oct 04 18:37:33.460485 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1153/2388] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:32 2022] GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5 => generated 1378 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:33.483165 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e8063f2e-3579-43ca-a240-239c9075122b tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Calling method '.version_select at 0x7fe2590f4820>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:33.493230 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e8063f2e-3579-43ca-a240-239c9075122b tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:33.494457 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e8063f2e-3579-43ca-a240-239c9075122b tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:33.494457 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e8063f2e-3579-43ca-a240-239c9075122b tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:33.525944 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e8063f2e-3579-43ca-a240-239c9075122b tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 4457 microversion: 2.25 time: 0.064002 Oct 04 18:37:33.536197 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1154/2389] 10.222.0.20 () {60 vars in 1184 bytes} [Tue Oct 4 18:37:33 2022] GET /compute/v2.1/os-migrations => generated 4457 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:37:33.536197 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6a17883c-51ab-4636-a4c5-2b49dc6ea774 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:33.536197 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6a17883c-51ab-4636-a4c5-2b49dc6ea774 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 61ec7cca-1572-496c-ba44-439f04c2a79c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:33.542832 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6a17883c-51ab-4636-a4c5-2b49dc6ea774 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:33.543387 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6a17883c-51ab-4636-a4c5-2b49dc6ea774 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:33.543883 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6a17883c-51ab-4636-a4c5-2b49dc6ea774 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:33.544800 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6a17883c-51ab-4636-a4c5-2b49dc6ea774 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:33.545317 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6a17883c-51ab-4636-a4c5-2b49dc6ea774 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:33.545757 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6a17883c-51ab-4636-a4c5-2b49dc6ea774 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:33.812606 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6a17883c-51ab-4636-a4c5-2b49dc6ea774 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8284fe51decd4db0bf6b3ed1514cc2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87473abf47e74adf844e3ddfa24da3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:33.829801 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6a17883c-51ab-4636-a4c5-2b49dc6ea774 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] 10.222.0.20 "GET /compute/v2.1/servers/61ec7cca-1572-496c-ba44-439f04c2a79c" status: 200 len: 1313 microversion: 2.1 time: 0.301587 Oct 04 18:37:33.830489 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1155/2390] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:33 2022] GET /compute/v2.1/servers/61ec7cca-1572-496c-ba44-439f04c2a79c => generated 1313 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:33.845100 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-80e41ee7-d862-4ee8-9438-dad4ef73baf2 req-76756214-f11b-4721-9f91-1242edee8d7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61ec7cca-1572-496c-ba44-439f04c2a79c", "name": "network-vif-plugged", "status": "completed", "tag": "1e8e5488-c1ba-4f9a-8944-b4e0b9ce8a0e"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:33.860048 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-80e41ee7-d862-4ee8-9438-dad4ef73baf2 req-76756214-f11b-4721-9f91-1242edee8d7c service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:33.860605 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-80e41ee7-d862-4ee8-9438-dad4ef73baf2 req-76756214-f11b-4721-9f91-1242edee8d7c service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:33.861229 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-80e41ee7-d862-4ee8-9438-dad4ef73baf2 req-76756214-f11b-4721-9f91-1242edee8d7c service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:33.879436 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-80e41ee7-d862-4ee8-9438-dad4ef73baf2 req-76756214-f11b-4721-9f91-1242edee8d7c service nova] Creating event network-vif-plugged:1e8e5488-c1ba-4f9a-8944-b4e0b9ce8a0e for instance 61ec7cca-1572-496c-ba44-439f04c2a79c on n-h2-850501-14 Oct 04 18:37:33.887017 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-80e41ee7-d862-4ee8-9438-dad4ef73baf2 req-76756214-f11b-4721-9f91-1242edee8d7c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055231 Oct 04 18:37:33.887997 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1156/2391] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:37:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:33.898110 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-14001601-cb72-409c-aecf-667d4406cb6e tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:33.898922 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-14001601-cb72-409c-aecf-667d4406cb6e tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] [instance: 0bef06d7-ba85-4f48-bd08-228211391394] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:33.923332 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-14001601-cb72-409c-aecf-667d4406cb6e tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:33.923906 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-14001601-cb72-409c-aecf-667d4406cb6e tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:33.931148 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-14001601-cb72-409c-aecf-667d4406cb6e tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:33.935908 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-14001601-cb72-409c-aecf-667d4406cb6e tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:33.938322 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-14001601-cb72-409c-aecf-667d4406cb6e tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:33.940974 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-14001601-cb72-409c-aecf-667d4406cb6e tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:34.079868 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-14001601-cb72-409c-aecf-667d4406cb6e tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:34.092728 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-14001601-cb72-409c-aecf-667d4406cb6e tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:34.099491 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-14001601-cb72-409c-aecf-667d4406cb6e tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:34.102525 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-14001601-cb72-409c-aecf-667d4406cb6e tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] 10.222.0.20 "GET /compute/v2.1/servers/0bef06d7-ba85-4f48-bd08-228211391394" status: 200 len: 1274 microversion: 2.57 time: 0.212897 Oct 04 18:37:34.104353 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1157/2392] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:33 2022] GET /compute/v2.1/servers/0bef06d7-ba85-4f48-bd08-228211391394 => generated 1274 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:37:34.116279 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e9fe10d0-2191-4442-a73c-5d3e49b95360 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:34.117913 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e9fe10d0-2191-4442-a73c-5d3e49b95360 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] [instance: cd74aff9-f694-49f3-a1cc-2095b71cd9e5] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:34.133154 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e9fe10d0-2191-4442-a73c-5d3e49b95360 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:34.133698 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e9fe10d0-2191-4442-a73c-5d3e49b95360 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:34.134146 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e9fe10d0-2191-4442-a73c-5d3e49b95360 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:34.134892 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e9fe10d0-2191-4442-a73c-5d3e49b95360 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:34.135390 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e9fe10d0-2191-4442-a73c-5d3e49b95360 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:34.136171 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e9fe10d0-2191-4442-a73c-5d3e49b95360 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:34.376832 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-e9fe10d0-2191-4442-a73c-5d3e49b95360 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] Lazy-loading 'services' on Instance uuid cd74aff9-f694-49f3-a1cc-2095b71cd9e5 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:37:34.395754 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e9fe10d0-2191-4442-a73c-5d3e49b95360 tempest-LiveAutoBlockMigrationV225Test-60773764 tempest-LiveAutoBlockMigrationV225Test-60773764-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5" status: 200 len: 1971 microversion: 2.25 time: 0.289603 Oct 04 18:37:34.396190 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1158/2393] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:34 2022] GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5 => generated 1971 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:37:34.403261 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-91877c4b-b203-4c37-9f01-7c2b7413633f tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:34.405048 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-91877c4b-b203-4c37-9f01-7c2b7413633f tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] [instance: 94cff31c-a849-4365-b9e8-326613749226] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:34.414439 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-91877c4b-b203-4c37-9f01-7c2b7413633f tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:34.414949 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-91877c4b-b203-4c37-9f01-7c2b7413633f tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:34.416042 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-91877c4b-b203-4c37-9f01-7c2b7413633f tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:34.416847 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-91877c4b-b203-4c37-9f01-7c2b7413633f tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:34.417367 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-91877c4b-b203-4c37-9f01-7c2b7413633f tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:34.423156 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-91877c4b-b203-4c37-9f01-7c2b7413633f tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:34.454406 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-91877c4b-b203-4c37-9f01-7c2b7413633f tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] HTTP exception thrown: Instance 94cff31c-a849-4365-b9e8-326613749226 could not be found. Oct 04 18:37:34.456335 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-91877c4b-b203-4c37-9f01-7c2b7413633f tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Request method failure captured: Oct 04 18:37:34.456335 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/94cff31c-a849-4365-b9e8-326613749226 HTTP/1.1 Oct 04 18:37:34.456335 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:37:34.456335 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:37:34.456335 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:37:34.456335 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:37:34.456335 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:37:34.456335 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:37:34.456335 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:37:34.456335 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:37:34.456335 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPH1Dlx0lX392Wv8FbWkRABjIEtVWAjFV4oDpwhlGiikBDXxvbJVNEhwJUfycmZDLBibLNux1-FpUZdN8YI8aTf5ONt9GVytLLpHvPBStHkXt5XvrkskAbeeamsXdZORc6VLyR_DzR28zYa95H67V-bnA-WM4TEOFriMOHKxZLHQuNcM Oct 04 18:37:34.456335 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:37:34.456335 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:37:34.456335 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:37:34.456335 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:37:34.456335 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:37:34.456335 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:37:34.456335 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 7e8869e8a46f40b18434fbe68d819dc4 Oct 04 18:37:34.456335 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ImagesNegativeTestJSON-67203657 Oct 04 18:37:34.456335 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:37:34.456335 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:37:34.456335 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e8869e8a46f40b18434fbe68d819dc4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7e8869e8a46f40b18434fbe68d819dc4", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7e8869e8a46f40b18434fbe68d819dc4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e8869e8a46f40b18434fbe68d819dc4"}]}] Oct 04 18:37:34.456335 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ImagesNegativeTestJSON-67203657 Oct 04 18:37:34.456335 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 7e8869e8a46f40b18434fbe68d819dc4 Oct 04 18:37:34.456335 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-67203657 Oct 04 18:37:34.456335 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ImagesNegativeTestJSON-67203657-project Oct 04 18:37:34.456335 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:37:34.456335 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:37:34.456335 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 8356b47bd87f42e2b642c6df82014e86 Oct 04 18:37:34.456335 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ImagesNegativeTestJSON-67203657-project Oct 04 18:37:34.456335 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:37:34.456335 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 94cff31c-a849-4365-b9e8-326613749226 could not be found. Oct 04 18:37:34.456335 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '94cff31c-a849-4365-b9e8-326613749226'} Oct 04 18:37:34.456335 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:37:34.456335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:34.456335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:37:34.456335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:37:34.456335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:37:34.456335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:37:34.456335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:37:34.456335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:37:34.456335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:37:34.456335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:37:34.456335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94cff31c-a849-4365-b9e8-326613749226 could not be found. Oct 04 18:37:34.456335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:37:34.456335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:34.456335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:37:34.456335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:34.456335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:34.456335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:34.456335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:37:34.456335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:37:34.456335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:37:34.456335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:37:34.456335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:37:34.456335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:37:34.456335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:37:34.456335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:37:34.456335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:37:34.456335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:37:34.456335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94cff31c-a849-4365-b9e8-326613749226 could not be found. Oct 04 18:37:34.456335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:37:34.456335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:34.456335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:37:34.459782 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:34.459782 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:34.459782 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:34.459782 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:37:34.459782 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:37:34.459782 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94cff31c-a849-4365-b9e8-326613749226 could not be found. Oct 04 18:37:34.459782 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:37:34.459782 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-91877c4b-b203-4c37-9f01-7c2b7413633f tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Returning 404 to user: Instance 94cff31c-a849-4365-b9e8-326613749226 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:37:34.459782 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-91877c4b-b203-4c37-9f01-7c2b7413633f tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] 10.222.0.20 "GET /compute/v2.1/servers/94cff31c-a849-4365-b9e8-326613749226" status: 404 len: 111 microversion: 2.1 time: 0.060603 Oct 04 18:37:34.470633 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1159/2394] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:34 2022] GET /compute/v2.1/servers/94cff31c-a849-4365-b9e8-326613749226 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:37:34.482823 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-beeac56a-6543-46a0-92ee-5e15f806f855 req-f332adef-5e3d-478d-9852-3b12fa95733b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "616e21b9-c93b-4ff0-8740-24c613f4d708", "name": "network-vif-deleted", "tag": "092863dc-5ae4-498b-b3d8-b7f299e949c4"}, {"server_uuid": "616e21b9-c93b-4ff0-8740-24c613f4d708", "name": "network-vif-deleted", "tag": "d4cd2e6b-3870-407c-a96e-a4f89855e326"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:34.521380 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-beeac56a-6543-46a0-92ee-5e15f806f855 req-f332adef-5e3d-478d-9852-3b12fa95733b service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:34.522542 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-beeac56a-6543-46a0-92ee-5e15f806f855 req-f332adef-5e3d-478d-9852-3b12fa95733b service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:34.523347 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-beeac56a-6543-46a0-92ee-5e15f806f855 req-f332adef-5e3d-478d-9852-3b12fa95733b service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:34.548950 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-beeac56a-6543-46a0-92ee-5e15f806f855 req-f332adef-5e3d-478d-9852-3b12fa95733b service nova] Creating event network-vif-deleted:092863dc-5ae4-498b-b3d8-b7f299e949c4 for instance 616e21b9-c93b-4ff0-8740-24c613f4d708 on n-h1-850501-14 Oct 04 18:37:34.549860 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-beeac56a-6543-46a0-92ee-5e15f806f855 req-f332adef-5e3d-478d-9852-3b12fa95733b service nova] Creating event network-vif-deleted:d4cd2e6b-3870-407c-a96e-a4f89855e326 for instance 616e21b9-c93b-4ff0-8740-24c613f4d708 on n-h1-850501-14 Oct 04 18:37:34.555816 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-beeac56a-6543-46a0-92ee-5e15f806f855 req-f332adef-5e3d-478d-9852-3b12fa95733b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.083699 Oct 04 18:37:34.556907 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1160/2395] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:37:34 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:34.565452 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-14b16977-fc57-4740-924b-058196692d11 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:34.566317 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-14b16977-fc57-4740-924b-058196692d11 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] [instance: 616e21b9-c93b-4ff0-8740-24c613f4d708] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:34.574054 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-14b16977-fc57-4740-924b-058196692d11 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:34.574730 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-14b16977-fc57-4740-924b-058196692d11 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:34.575774 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-14b16977-fc57-4740-924b-058196692d11 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:34.577590 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-14b16977-fc57-4740-924b-058196692d11 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:34.578228 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-14b16977-fc57-4740-924b-058196692d11 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:34.579014 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-14b16977-fc57-4740-924b-058196692d11 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:34.637839 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-14b16977-fc57-4740-924b-058196692d11 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:34.646291 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-14b16977-fc57-4740-924b-058196692d11 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:34.646291 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-14b16977-fc57-4740-924b-058196692d11 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:34.646291 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-14b16977-fc57-4740-924b-058196692d11 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lazy-loading 'fault' on Instance uuid 616e21b9-c93b-4ff0-8740-24c613f4d708 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:37:34.686206 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-14b16977-fc57-4740-924b-058196692d11 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb44381220d43b7bdfa744a1dc410a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3242afeef424d588cf102a2f0f38020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:34.688852 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=100 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:34.698069 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-14b16977-fc57-4740-924b-058196692d11 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] 10.222.0.20 "GET /compute/v2.1/servers/616e21b9-c93b-4ff0-8740-24c613f4d708" status: 200 len: 1302 microversion: 2.1 time: 0.139894 Oct 04 18:37:34.698694 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1161/2396] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:34 2022] GET /compute/v2.1/servers/616e21b9-c93b-4ff0-8740-24c613f4d708 => generated 1302 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:34.704791 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6bbdc423-dfcc-4f56-8b97-a49169eb6dfe tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:34.705297 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6bbdc423-dfcc-4f56-8b97-a49169eb6dfe tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: cd74aff9-f694-49f3-a1cc-2095b71cd9e5] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:34.720428 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6bbdc423-dfcc-4f56-8b97-a49169eb6dfe tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:34.720868 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6bbdc423-dfcc-4f56-8b97-a49169eb6dfe tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:34.721316 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6bbdc423-dfcc-4f56-8b97-a49169eb6dfe tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:34.722337 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6bbdc423-dfcc-4f56-8b97-a49169eb6dfe tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:34.724411 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6bbdc423-dfcc-4f56-8b97-a49169eb6dfe tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:34.724902 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6bbdc423-dfcc-4f56-8b97-a49169eb6dfe tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:34.758550 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6bbdc423-dfcc-4f56-8b97-a49169eb6dfe tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: cd74aff9-f694-49f3-a1cc-2095b71cd9e5] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:37:35.189744 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-20b4a1bc-cbaa-401d-9699-1f4637f5f649 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31/action" status: 202 len: 0 microversion: 2.1 time: 4.371057 Oct 04 18:37:35.191595 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1236/2397] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:37:30 2022] POST /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31/action => generated 0 bytes in 4374 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:37:35.198425 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-908333dc-fdae-4799-9ccc-efee72f7bcce tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:35.202248 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-908333dc-fdae-4799-9ccc-efee72f7bcce tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 474a799f-8e38-49d6-8fff-9ec3e7657ef5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:35.210302 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-908333dc-fdae-4799-9ccc-efee72f7bcce tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:35.210904 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-908333dc-fdae-4799-9ccc-efee72f7bcce tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:35.211404 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-908333dc-fdae-4799-9ccc-efee72f7bcce tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:35.212230 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-908333dc-fdae-4799-9ccc-efee72f7bcce tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:35.212882 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-908333dc-fdae-4799-9ccc-efee72f7bcce tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:35.213500 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-908333dc-fdae-4799-9ccc-efee72f7bcce tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:35.231240 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6bbdc423-dfcc-4f56-8b97-a49169eb6dfe tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "DELETE /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5" status: 204 len: 0 microversion: 2.25 time: 0.531095 Oct 04 18:37:35.232352 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1162/2398] 10.222.0.20 () {60 vars in 1280 bytes} [Tue Oct 4 18:37:34 2022] DELETE /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:37:35.242882 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f7d74b03-c5d8-41e6-8a53-d2496aab46df tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-88249428", "metadata": {"image_type": "test"}}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:35.246663 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f7d74b03-c5d8-41e6-8a53-d2496aab46df tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] [instance: 94cff31c-a849-4365-b9e8-326613749226] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:35.255899 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f7d74b03-c5d8-41e6-8a53-d2496aab46df tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:35.256836 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f7d74b03-c5d8-41e6-8a53-d2496aab46df tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:35.257714 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f7d74b03-c5d8-41e6-8a53-d2496aab46df tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:35.258688 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f7d74b03-c5d8-41e6-8a53-d2496aab46df tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:35.259274 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f7d74b03-c5d8-41e6-8a53-d2496aab46df tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:35.264436 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f7d74b03-c5d8-41e6-8a53-d2496aab46df tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:35.286155 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-f7d74b03-c5d8-41e6-8a53-d2496aab46df tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] HTTP exception thrown: Instance 94cff31c-a849-4365-b9e8-326613749226 could not be found. Oct 04 18:37:35.288094 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f7d74b03-c5d8-41e6-8a53-d2496aab46df tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Request method failure captured: Oct 04 18:37:35.288094 n-d-850501-14 devstack@n-api.service[123001]: request: POST /compute/v2.1/servers/94cff31c-a849-4365-b9e8-326613749226/action HTTP/1.1 Oct 04 18:37:35.288094 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:37:35.288094 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:37:35.288094 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:37:35.288094 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 110 Oct 04 18:37:35.288094 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:37:35.288094 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:37:35.288094 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:37:35.288094 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:37:35.288094 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPH1Dlx0lX392Wv8FbWkRABjIEtVWAjFV4oDpwhlGiikBDXxvbJVNEhwJUfycmZDLBibLNux1-FpUZdN8YI8aTf5ONt9GVytLLpHvPBStHkXt5XvrkskAbeeamsXdZORc6VLyR_DzR28zYa95H67V-bnA-WM4TEOFriMOHKxZLHQuNcM Oct 04 18:37:35.288094 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:37:35.288094 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:37:35.288094 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:37:35.288094 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:37:35.288094 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:37:35.288094 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:37:35.288094 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 7e8869e8a46f40b18434fbe68d819dc4 Oct 04 18:37:35.288094 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ImagesNegativeTestJSON-67203657 Oct 04 18:37:35.288094 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:37:35.288094 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:37:35.288094 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e8869e8a46f40b18434fbe68d819dc4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7e8869e8a46f40b18434fbe68d819dc4", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7e8869e8a46f40b18434fbe68d819dc4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e8869e8a46f40b18434fbe68d819dc4"}]}] Oct 04 18:37:35.288094 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ImagesNegativeTestJSON-67203657 Oct 04 18:37:35.288094 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 7e8869e8a46f40b18434fbe68d819dc4 Oct 04 18:37:35.288094 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-67203657 Oct 04 18:37:35.288094 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ImagesNegativeTestJSON-67203657-project Oct 04 18:37:35.288094 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:37:35.288094 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:37:35.288094 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 8356b47bd87f42e2b642c6df82014e86 Oct 04 18:37:35.288094 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ImagesNegativeTestJSON-67203657-project Oct 04 18:37:35.288094 n-d-850501-14 devstack@n-api.service[123001]: Oct 04 18:37:35.288094 n-d-850501-14 devstack@n-api.service[123001]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-88249428", "metadata": {"image_type": "test"}}} Oct 04 18:37:35.288094 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:37:35.288094 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 94cff31c-a849-4365-b9e8-326613749226 could not be found. Oct 04 18:37:35.288094 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '94cff31c-a849-4365-b9e8-326613749226', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-88249428', 'metadata': {'image_type': 'test'}}}} Oct 04 18:37:35.288094 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:37:35.288094 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:35.288094 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:37:35.288094 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:37:35.288094 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:37:35.288094 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:37:35.288094 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:37:35.288094 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:37:35.288094 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:37:35.288094 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:37:35.288094 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94cff31c-a849-4365-b9e8-326613749226 could not be found. Oct 04 18:37:35.288094 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:37:35.288094 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:35.288094 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:37:35.288094 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:35.288094 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:35.288094 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:35.288094 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:37:35.288094 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:37:35.288094 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:37:35.288094 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:37:35.288094 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:37:35.288094 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:37:35.288094 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:37:35.288094 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:37:35.288094 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 04 18:37:35.288094 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 04 18:37:35.288094 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:37:35.291760 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:37:35.291760 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:37:35.291760 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:37:35.291760 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94cff31c-a849-4365-b9e8-326613749226 could not be found. Oct 04 18:37:35.291760 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:37:35.291760 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:35.291760 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:37:35.291760 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:35.291760 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:35.291760 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:35.291760 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:37:35.291760 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:37:35.291760 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94cff31c-a849-4365-b9e8-326613749226 could not be found. Oct 04 18:37:35.291760 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:37:35.296813 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f7d74b03-c5d8-41e6-8a53-d2496aab46df tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Returning 404 to user: Instance 94cff31c-a849-4365-b9e8-326613749226 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:37:35.297783 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f7d74b03-c5d8-41e6-8a53-d2496aab46df tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] 10.222.0.20 "POST /compute/v2.1/servers/94cff31c-a849-4365-b9e8-326613749226/action" status: 404 len: 111 microversion: 2.1 time: 0.063787 Oct 04 18:37:35.298396 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1163/2399] 10.222.0.20 () {60 vars in 1279 bytes} [Tue Oct 4 18:37:35 2022] POST /compute/v2.1/servers/94cff31c-a849-4365-b9e8-326613749226/action => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:37:35.306112 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ecda5ff7-46c8-4beb-b5c6-632bb03957f9 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:35.306745 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ecda5ff7-46c8-4beb-b5c6-632bb03957f9 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 61ec7cca-1572-496c-ba44-439f04c2a79c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:35.310568 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:35.321626 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ecda5ff7-46c8-4beb-b5c6-632bb03957f9 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:35.324299 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ecda5ff7-46c8-4beb-b5c6-632bb03957f9 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:35.327506 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ecda5ff7-46c8-4beb-b5c6-632bb03957f9 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:35.329728 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ecda5ff7-46c8-4beb-b5c6-632bb03957f9 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:35.329728 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ecda5ff7-46c8-4beb-b5c6-632bb03957f9 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:35.329728 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ecda5ff7-46c8-4beb-b5c6-632bb03957f9 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:35.455647 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-908333dc-fdae-4799-9ccc-efee72f7bcce tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:35.465582 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-908333dc-fdae-4799-9ccc-efee72f7bcce tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5" status: 200 len: 1378 microversion: 2.1 time: 0.272486 Oct 04 18:37:35.481244 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1237/2400] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:35 2022] GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5 => generated 1378 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:35.499895 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b20bba55-e18a-4e65-b387-35e4958d6e42 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:35.500893 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b20bba55-e18a-4e65-b387-35e4958d6e42 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] [instance: 0bef06d7-ba85-4f48-bd08-228211391394] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:35.512422 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b20bba55-e18a-4e65-b387-35e4958d6e42 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:35.514006 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b20bba55-e18a-4e65-b387-35e4958d6e42 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:35.514830 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b20bba55-e18a-4e65-b387-35e4958d6e42 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:35.515761 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b20bba55-e18a-4e65-b387-35e4958d6e42 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:35.516465 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b20bba55-e18a-4e65-b387-35e4958d6e42 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:35.517174 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b20bba55-e18a-4e65-b387-35e4958d6e42 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:35.544259 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:35.572442 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ecda5ff7-46c8-4beb-b5c6-632bb03957f9 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8284fe51decd4db0bf6b3ed1514cc2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87473abf47e74adf844e3ddfa24da3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:35.591050 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ecda5ff7-46c8-4beb-b5c6-632bb03957f9 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] 10.222.0.20 "GET /compute/v2.1/servers/61ec7cca-1572-496c-ba44-439f04c2a79c" status: 200 len: 1313 microversion: 2.1 time: 0.287200 Oct 04 18:37:35.592730 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1164/2401] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:35 2022] GET /compute/v2.1/servers/61ec7cca-1572-496c-ba44-439f04c2a79c => generated 1313 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:35.605561 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e9891ce6-b573-4e9f-aa59-ff03b6a0951d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:35.606296 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e9891ce6-b573-4e9f-aa59-ff03b6a0951d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 98dfffc8-51aa-407a-a374-8e120ec43a31] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:35.623975 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e9891ce6-b573-4e9f-aa59-ff03b6a0951d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:35.624766 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e9891ce6-b573-4e9f-aa59-ff03b6a0951d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:35.632366 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e9891ce6-b573-4e9f-aa59-ff03b6a0951d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:35.633400 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e9891ce6-b573-4e9f-aa59-ff03b6a0951d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:35.634265 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e9891ce6-b573-4e9f-aa59-ff03b6a0951d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:35.634884 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e9891ce6-b573-4e9f-aa59-ff03b6a0951d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:35.641356 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b20bba55-e18a-4e65-b387-35e4958d6e42 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:35.651286 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b20bba55-e18a-4e65-b387-35e4958d6e42 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:35.652939 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b20bba55-e18a-4e65-b387-35e4958d6e42 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:35.654461 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b20bba55-e18a-4e65-b387-35e4958d6e42 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] 10.222.0.20 "GET /compute/v2.1/servers/0bef06d7-ba85-4f48-bd08-228211391394" status: 200 len: 1338 microversion: 2.57 time: 0.171221 Oct 04 18:37:35.673043 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1238/2402] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:35 2022] GET /compute/v2.1/servers/0bef06d7-ba85-4f48-bd08-228211391394 => generated 1338 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:37:35.703298 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5a756ee6-e9da-4b7e-8b1f-397b41a37cd1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:35.704265 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5a756ee6-e9da-4b7e-8b1f-397b41a37cd1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: cd74aff9-f694-49f3-a1cc-2095b71cd9e5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:35.713281 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5a756ee6-e9da-4b7e-8b1f-397b41a37cd1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:35.714134 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5a756ee6-e9da-4b7e-8b1f-397b41a37cd1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:35.714817 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5a756ee6-e9da-4b7e-8b1f-397b41a37cd1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:35.715744 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5a756ee6-e9da-4b7e-8b1f-397b41a37cd1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:35.717437 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5a756ee6-e9da-4b7e-8b1f-397b41a37cd1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:35.718100 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5a756ee6-e9da-4b7e-8b1f-397b41a37cd1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:36.282941 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e9891ce6-b573-4e9f-aa59-ff03b6a0951d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:36.291289 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e9891ce6-b573-4e9f-aa59-ff03b6a0951d tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31" status: 200 len: 1392 microversion: 2.1 time: 0.695654 Oct 04 18:37:36.292089 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1165/2403] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:35 2022] GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31 => generated 1392 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:36.296775 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c0bdc0a3-a8e8-40c6-a66d-15357a692f89 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-92060958", "metadata": {"image_type": "test"}}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:36.299363 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c0bdc0a3-a8e8-40c6-a66d-15357a692f89 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Failed to fetch instance by id tempest-invalid-1730384854 {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 04 18:37:36.299880 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-c0bdc0a3-a8e8-40c6-a66d-15357a692f89 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] HTTP exception thrown: Instance tempest-invalid-1730384854 could not be found. Oct 04 18:37:36.301552 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c0bdc0a3-a8e8-40c6-a66d-15357a692f89 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Request method failure captured: Oct 04 18:37:36.301552 n-d-850501-14 devstack@n-api.service[123001]: request: POST /compute/v2.1/servers/tempest-invalid-1730384854/action HTTP/1.1 Oct 04 18:37:36.301552 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:37:36.301552 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:37:36.301552 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:37:36.301552 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 110 Oct 04 18:37:36.301552 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:37:36.301552 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:37:36.301552 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:37:36.301552 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:37:36.301552 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPH1Dlx0lX392Wv8FbWkRABjIEtVWAjFV4oDpwhlGiikBDXxvbJVNEhwJUfycmZDLBibLNux1-FpUZdN8YI8aTf5ONt9GVytLLpHvPBStHkXt5XvrkskAbeeamsXdZORc6VLyR_DzR28zYa95H67V-bnA-WM4TEOFriMOHKxZLHQuNcM Oct 04 18:37:36.301552 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:37:36.301552 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:37:36.301552 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:37:36.301552 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:37:36.301552 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:37:36.301552 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:37:36.301552 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 7e8869e8a46f40b18434fbe68d819dc4 Oct 04 18:37:36.301552 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ImagesNegativeTestJSON-67203657 Oct 04 18:37:36.301552 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:37:36.301552 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:37:36.301552 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e8869e8a46f40b18434fbe68d819dc4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7e8869e8a46f40b18434fbe68d819dc4", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7e8869e8a46f40b18434fbe68d819dc4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e8869e8a46f40b18434fbe68d819dc4"}]}] Oct 04 18:37:36.301552 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ImagesNegativeTestJSON-67203657 Oct 04 18:37:36.301552 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 7e8869e8a46f40b18434fbe68d819dc4 Oct 04 18:37:36.301552 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-67203657 Oct 04 18:37:36.301552 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ImagesNegativeTestJSON-67203657-project Oct 04 18:37:36.301552 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:37:36.301552 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:37:36.301552 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 8356b47bd87f42e2b642c6df82014e86 Oct 04 18:37:36.301552 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ImagesNegativeTestJSON-67203657-project Oct 04 18:37:36.301552 n-d-850501-14 devstack@n-api.service[123001]: Oct 04 18:37:36.301552 n-d-850501-14 devstack@n-api.service[123001]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-92060958", "metadata": {"image_type": "test"}}} Oct 04 18:37:36.301552 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:37:36.301552 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance tempest-invalid-1730384854 could not be found. Oct 04 18:37:36.301552 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': 'tempest-invalid-1730384854', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-92060958', 'metadata': {'image_type': 'test'}}}} Oct 04 18:37:36.301552 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:37:36.301552 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:36.301552 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:37:36.301552 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:37:36.301552 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 04 18:37:36.301552 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 04 18:37:36.301552 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-1730384854 could not be found. Oct 04 18:37:36.301552 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:37:36.301552 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:36.301552 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:37:36.301552 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:36.301552 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:36.301552 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:36.301552 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:37:36.301552 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:37:36.301552 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:37:36.301552 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:37:36.301552 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:37:36.301552 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:37:36.301552 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:37:36.301552 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:37:36.301552 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 04 18:37:36.301552 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 04 18:37:36.301552 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:37:36.301552 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:37:36.301552 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:37:36.301552 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:37:36.301552 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-1730384854 could not be found. Oct 04 18:37:36.305731 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:37:36.305731 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:36.305731 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:37:36.305731 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:36.305731 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:36.305731 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:36.305731 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:37:36.305731 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:37:36.305731 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-1730384854 could not be found. Oct 04 18:37:36.305731 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:37:36.305731 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c0bdc0a3-a8e8-40c6-a66d-15357a692f89 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Returning 404 to user: Instance tempest-invalid-1730384854 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:37:36.305731 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c0bdc0a3-a8e8-40c6-a66d-15357a692f89 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] 10.222.0.20 "POST /compute/v2.1/servers/tempest-invalid-1730384854/action" status: 404 len: 101 microversion: 2.1 time: 0.010093 Oct 04 18:37:36.305731 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1166/2404] 10.222.0.20 () {60 vars in 1249 bytes} [Tue Oct 4 18:37:36 2022] POST /compute/v2.1/servers/tempest-invalid-1730384854/action => generated 101 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:37:36.310115 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e909d07a-afc6-4034-9145-60f0ba2388cc tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:36.311249 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e909d07a-afc6-4034-9145-60f0ba2388cc tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] [instance: 616e21b9-c93b-4ff0-8740-24c613f4d708] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:36.314749 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5a756ee6-e9da-4b7e-8b1f-397b41a37cd1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:36.331195 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e909d07a-afc6-4034-9145-60f0ba2388cc tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:36.331195 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e909d07a-afc6-4034-9145-60f0ba2388cc tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:36.331195 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e909d07a-afc6-4034-9145-60f0ba2388cc tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:36.331195 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e909d07a-afc6-4034-9145-60f0ba2388cc tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:36.331195 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e909d07a-afc6-4034-9145-60f0ba2388cc tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:36.331195 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e909d07a-afc6-4034-9145-60f0ba2388cc tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:36.334695 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5a756ee6-e9da-4b7e-8b1f-397b41a37cd1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:36.336511 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5a756ee6-e9da-4b7e-8b1f-397b41a37cd1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:36.338245 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5a756ee6-e9da-4b7e-8b1f-397b41a37cd1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5" status: 200 len: 1482 microversion: 2.25 time: 0.648953 Oct 04 18:37:36.340490 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1239/2405] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:35 2022] GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5 => generated 1482 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:37:36.348283 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-da39c049-7fd1-4fc9-9f8e-54557f0d3b48 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1040137322"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:36.351387 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-da39c049-7fd1-4fc9-9f8e-54557f0d3b48 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 04 18:37:36.351902 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-da39c049-7fd1-4fc9-9f8e-54557f0d3b48 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 18:37:36.353797 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-da39c049-7fd1-4fc9-9f8e-54557f0d3b48 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Request method failure captured: Oct 04 18:37:36.353797 n-d-850501-14 devstack@n-api.service[123002]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 04 18:37:36.353797 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:37:36.353797 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:37:36.353797 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:37:36.353797 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 57 Oct 04 18:37:36.353797 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:37:36.353797 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:37:36.353797 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:37:36.353797 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:37:36.353797 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH1Dlx0lX392Wv8FbWkRABjIEtVWAjFV4oDpwhlGiikBDXxvbJVNEhwJUfycmZDLBibLNux1-FpUZdN8YI8aTf5ONt9GVytLLpHvPBStHkXt5XvrkskAbeeamsXdZORc6VLyR_DzR28zYa95H67V-bnA-WM4TEOFriMOHKxZLHQuNcM Oct 04 18:37:36.353797 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:37:36.353797 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:37:36.353797 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:37:36.353797 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:37:36.353797 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:37:36.353797 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:37:36.353797 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 7e8869e8a46f40b18434fbe68d819dc4 Oct 04 18:37:36.353797 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ImagesNegativeTestJSON-67203657 Oct 04 18:37:36.353797 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:37:36.353797 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:37:36.353797 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e8869e8a46f40b18434fbe68d819dc4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7e8869e8a46f40b18434fbe68d819dc4", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7e8869e8a46f40b18434fbe68d819dc4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e8869e8a46f40b18434fbe68d819dc4"}]}] Oct 04 18:37:36.353797 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ImagesNegativeTestJSON-67203657 Oct 04 18:37:36.353797 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 7e8869e8a46f40b18434fbe68d819dc4 Oct 04 18:37:36.353797 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-67203657 Oct 04 18:37:36.353797 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ImagesNegativeTestJSON-67203657-project Oct 04 18:37:36.353797 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:37:36.353797 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:37:36.353797 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 8356b47bd87f42e2b642c6df82014e86 Oct 04 18:37:36.353797 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ImagesNegativeTestJSON-67203657-project Oct 04 18:37:36.353797 n-d-850501-14 devstack@n-api.service[123002]: Oct 04 18:37:36.353797 n-d-850501-14 devstack@n-api.service[123002]: {"createImage": {"name": "tempest-test-snap-1040137322"}} Oct 04 18:37:36.353797 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:37:36.353797 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 18:37:36.353797 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1040137322'}}} Oct 04 18:37:36.353797 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:37:36.353797 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:36.353797 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:37:36.353797 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:37:36.353797 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 04 18:37:36.353797 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 04 18:37:36.353797 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 18:37:36.353797 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:37:36.353797 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:36.353797 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:37:36.353797 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:36.353797 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:36.353797 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:36.353797 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:37:36.353797 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:37:36.353797 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:37:36.353797 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:37:36.353797 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:37:36.353797 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:37:36.353797 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:37:36.353797 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:37:36.353797 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 04 18:37:36.353797 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 04 18:37:36.353797 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:37:36.353797 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:37:36.353797 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:37:36.353797 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:37:36.353797 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 18:37:36.353797 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:37:36.358082 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:36.358082 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:37:36.358082 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:36.358082 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:36.358082 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:36.358082 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:37:36.358082 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:37:36.358082 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 18:37:36.358082 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:37:36.358082 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-da39c049-7fd1-4fc9-9f8e-54557f0d3b48 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:37:36.358082 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-da39c049-7fd1-4fc9-9f8e-54557f0d3b48 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] 10.222.0.20 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.012250 Oct 04 18:37:36.360452 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1240/2406] 10.222.0.20 () {60 vars in 1275 bytes} [Tue Oct 4 18:37:36 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:37:36.373700 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4bab0879-951a-4d77-a6a5-b2fd51389b9b tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1267405818"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:36.374347 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e909d07a-afc6-4034-9145-60f0ba2388cc tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:36.374858 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e909d07a-afc6-4034-9145-60f0ba2388cc tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:36.375316 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e909d07a-afc6-4034-9145-60f0ba2388cc tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:36.375768 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-e909d07a-afc6-4034-9145-60f0ba2388cc tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lazy-loading 'fault' on Instance uuid 616e21b9-c93b-4ff0-8740-24c613f4d708 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:37:36.378266 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4bab0879-951a-4d77-a6a5-b2fd51389b9b tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 04 18:37:36.378959 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-4bab0879-951a-4d77-a6a5-b2fd51389b9b tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 18:37:36.380834 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4bab0879-951a-4d77-a6a5-b2fd51389b9b tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Request method failure captured: Oct 04 18:37:36.380834 n-d-850501-14 devstack@n-api.service[123002]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 04 18:37:36.380834 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:37:36.380834 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:37:36.380834 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:37:36.380834 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 57 Oct 04 18:37:36.380834 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:37:36.380834 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:37:36.380834 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:37:36.380834 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:37:36.380834 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH1Dlx0lX392Wv8FbWkRABjIEtVWAjFV4oDpwhlGiikBDXxvbJVNEhwJUfycmZDLBibLNux1-FpUZdN8YI8aTf5ONt9GVytLLpHvPBStHkXt5XvrkskAbeeamsXdZORc6VLyR_DzR28zYa95H67V-bnA-WM4TEOFriMOHKxZLHQuNcM Oct 04 18:37:36.380834 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:37:36.380834 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:37:36.380834 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:37:36.380834 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:37:36.380834 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:37:36.380834 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:37:36.380834 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 7e8869e8a46f40b18434fbe68d819dc4 Oct 04 18:37:36.380834 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ImagesNegativeTestJSON-67203657 Oct 04 18:37:36.380834 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:37:36.380834 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:37:36.380834 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e8869e8a46f40b18434fbe68d819dc4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7e8869e8a46f40b18434fbe68d819dc4", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7e8869e8a46f40b18434fbe68d819dc4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e8869e8a46f40b18434fbe68d819dc4"}]}] Oct 04 18:37:36.380834 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ImagesNegativeTestJSON-67203657 Oct 04 18:37:36.380834 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 7e8869e8a46f40b18434fbe68d819dc4 Oct 04 18:37:36.380834 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-67203657 Oct 04 18:37:36.380834 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ImagesNegativeTestJSON-67203657-project Oct 04 18:37:36.380834 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:37:36.380834 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:37:36.380834 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 8356b47bd87f42e2b642c6df82014e86 Oct 04 18:37:36.380834 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ImagesNegativeTestJSON-67203657-project Oct 04 18:37:36.380834 n-d-850501-14 devstack@n-api.service[123002]: Oct 04 18:37:36.380834 n-d-850501-14 devstack@n-api.service[123002]: {"createImage": {"name": "tempest-test-snap-1267405818"}} Oct 04 18:37:36.380834 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:37:36.380834 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 18:37:36.380834 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1267405818'}}} Oct 04 18:37:36.380834 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:37:36.380834 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:36.380834 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:37:36.380834 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:37:36.380834 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 04 18:37:36.380834 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 04 18:37:36.380834 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 18:37:36.380834 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:37:36.380834 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:36.380834 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:37:36.380834 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:36.380834 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:36.380834 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:36.380834 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:37:36.380834 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:37:36.380834 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:37:36.380834 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:37:36.380834 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:37:36.380834 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:37:36.380834 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:37:36.380834 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:37:36.380834 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 04 18:37:36.380834 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 04 18:37:36.380834 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:37:36.380834 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:37:36.380834 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:37:36.380834 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:37:36.380834 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 18:37:36.380834 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:37:36.386550 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:36.386550 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:37:36.386550 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:36.386550 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:36.386550 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:36.386550 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:37:36.386550 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:37:36.386550 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 18:37:36.386550 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:37:36.386550 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4bab0879-951a-4d77-a6a5-b2fd51389b9b tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:37:36.386550 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4bab0879-951a-4d77-a6a5-b2fd51389b9b tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] 10.222.0.20 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.019051 Oct 04 18:37:36.387744 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1241/2407] 10.222.0.20 () {60 vars in 1281 bytes} [Tue Oct 4 18:37:36 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:37:36.400259 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7726497f-a532-43a8-b32f-7cb5c675874e tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:36.400951 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7726497f-a532-43a8-b32f-7cb5c675874e tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] [instance: 94cff31c-a849-4365-b9e8-326613749226] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:36.410191 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7726497f-a532-43a8-b32f-7cb5c675874e tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:36.411011 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7726497f-a532-43a8-b32f-7cb5c675874e tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:36.411688 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7726497f-a532-43a8-b32f-7cb5c675874e tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:36.412529 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7726497f-a532-43a8-b32f-7cb5c675874e tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:36.413064 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7726497f-a532-43a8-b32f-7cb5c675874e tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:36.414094 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7726497f-a532-43a8-b32f-7cb5c675874e tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:36.427692 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e909d07a-afc6-4034-9145-60f0ba2388cc tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb44381220d43b7bdfa744a1dc410a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3242afeef424d588cf102a2f0f38020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:36.429929 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-7726497f-a532-43a8-b32f-7cb5c675874e tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] HTTP exception thrown: Instance 94cff31c-a849-4365-b9e8-326613749226 could not be found. Oct 04 18:37:36.431566 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7726497f-a532-43a8-b32f-7cb5c675874e tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Request method failure captured: Oct 04 18:37:36.431566 n-d-850501-14 devstack@n-api.service[123002]: request: DELETE /compute/v2.1/servers/94cff31c-a849-4365-b9e8-326613749226 HTTP/1.1 Oct 04 18:37:36.431566 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:37:36.431566 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:37:36.431566 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:37:36.431566 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:37:36.431566 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:37:36.431566 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:37:36.431566 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:37:36.431566 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:37:36.431566 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH1Dlx0lX392Wv8FbWkRABjIEtVWAjFV4oDpwhlGiikBDXxvbJVNEhwJUfycmZDLBibLNux1-FpUZdN8YI8aTf5ONt9GVytLLpHvPBStHkXt5XvrkskAbeeamsXdZORc6VLyR_DzR28zYa95H67V-bnA-WM4TEOFriMOHKxZLHQuNcM Oct 04 18:37:36.431566 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:37:36.431566 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:37:36.431566 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:37:36.431566 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:37:36.431566 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:37:36.431566 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:37:36.431566 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 7e8869e8a46f40b18434fbe68d819dc4 Oct 04 18:37:36.431566 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ImagesNegativeTestJSON-67203657 Oct 04 18:37:36.431566 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:37:36.431566 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:37:36.431566 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e8869e8a46f40b18434fbe68d819dc4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7e8869e8a46f40b18434fbe68d819dc4", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7e8869e8a46f40b18434fbe68d819dc4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e8869e8a46f40b18434fbe68d819dc4"}]}] Oct 04 18:37:36.431566 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ImagesNegativeTestJSON-67203657 Oct 04 18:37:36.431566 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 7e8869e8a46f40b18434fbe68d819dc4 Oct 04 18:37:36.431566 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-67203657 Oct 04 18:37:36.431566 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ImagesNegativeTestJSON-67203657-project Oct 04 18:37:36.431566 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:37:36.431566 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:37:36.431566 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 8356b47bd87f42e2b642c6df82014e86 Oct 04 18:37:36.431566 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ImagesNegativeTestJSON-67203657-project Oct 04 18:37:36.431566 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:37:36.431566 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 94cff31c-a849-4365-b9e8-326613749226 could not be found. Oct 04 18:37:36.431566 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '94cff31c-a849-4365-b9e8-326613749226'} Oct 04 18:37:36.431566 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:37:36.431566 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:36.431566 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:37:36.431566 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:37:36.431566 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:37:36.431566 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:37:36.431566 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:37:36.431566 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:37:36.431566 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:37:36.431566 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:37:36.431566 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94cff31c-a849-4365-b9e8-326613749226 could not be found. Oct 04 18:37:36.431566 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:37:36.431566 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:36.431566 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:37:36.431566 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:36.431566 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:36.431566 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:36.431566 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:37:36.431566 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:37:36.431566 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:37:36.431566 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:37:36.431566 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:37:36.431566 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:37:36.431566 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:37:36.431566 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:37:36.431566 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:37:36.431566 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:37:36.431566 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:37:36.431566 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:37:36.436424 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94cff31c-a849-4365-b9e8-326613749226 could not be found. Oct 04 18:37:36.436424 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:37:36.436424 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:36.436424 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:37:36.436424 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:36.436424 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:36.436424 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:36.436424 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:37:36.436424 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:37:36.436424 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94cff31c-a849-4365-b9e8-326613749226 could not be found. Oct 04 18:37:36.436424 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:37:36.436424 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7726497f-a532-43a8-b32f-7cb5c675874e tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Returning 404 to user: Instance 94cff31c-a849-4365-b9e8-326613749226 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:37:36.436424 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7726497f-a532-43a8-b32f-7cb5c675874e tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] 10.222.0.20 "DELETE /compute/v2.1/servers/94cff31c-a849-4365-b9e8-326613749226" status: 404 len: 111 microversion: 2.1 time: 0.037318 Oct 04 18:37:36.438068 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e909d07a-afc6-4034-9145-60f0ba2388cc tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] 10.222.0.20 "GET /compute/v2.1/servers/616e21b9-c93b-4ff0-8740-24c613f4d708" status: 200 len: 1302 microversion: 2.1 time: 0.131186 Oct 04 18:37:36.438689 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1242/2408] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:37:36 2022] DELETE /compute/v2.1/servers/94cff31c-a849-4365-b9e8-326613749226 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:37:36.440183 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1167/2409] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:36 2022] GET /compute/v2.1/servers/616e21b9-c93b-4ff0-8740-24c613f4d708 => generated 1302 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:36.458558 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3dd34446-09fb-4b4a-ab43-a6ea41311ea5 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:36.463333 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3dd34446-09fb-4b4a-ab43-a6ea41311ea5 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] [instance: 94cff31c-a849-4365-b9e8-326613749226] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:36.470973 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3dd34446-09fb-4b4a-ab43-a6ea41311ea5 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:36.471955 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3dd34446-09fb-4b4a-ab43-a6ea41311ea5 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:36.472668 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3dd34446-09fb-4b4a-ab43-a6ea41311ea5 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:36.473638 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3dd34446-09fb-4b4a-ab43-a6ea41311ea5 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:36.474154 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3dd34446-09fb-4b4a-ab43-a6ea41311ea5 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:36.474665 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3dd34446-09fb-4b4a-ab43-a6ea41311ea5 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:36.492972 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-3dd34446-09fb-4b4a-ab43-a6ea41311ea5 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] HTTP exception thrown: Instance 94cff31c-a849-4365-b9e8-326613749226 could not be found. Oct 04 18:37:36.493520 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-98859cf0-1140-459b-9a64-e941a8e1a6b1 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:36.494139 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-98859cf0-1140-459b-9a64-e941a8e1a6b1 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 474a799f-8e38-49d6-8fff-9ec3e7657ef5] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:36.494673 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3dd34446-09fb-4b4a-ab43-a6ea41311ea5 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Request method failure captured: Oct 04 18:37:36.494673 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/94cff31c-a849-4365-b9e8-326613749226 HTTP/1.1 Oct 04 18:37:36.494673 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:37:36.494673 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:37:36.494673 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:37:36.494673 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:37:36.494673 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:37:36.494673 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:37:36.494673 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:37:36.494673 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:37:36.494673 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH1Dlx0lX392Wv8FbWkRABjIEtVWAjFV4oDpwhlGiikBDXxvbJVNEhwJUfycmZDLBibLNux1-FpUZdN8YI8aTf5ONt9GVytLLpHvPBStHkXt5XvrkskAbeeamsXdZORc6VLyR_DzR28zYa95H67V-bnA-WM4TEOFriMOHKxZLHQuNcM Oct 04 18:37:36.494673 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:37:36.494673 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:37:36.494673 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:37:36.494673 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:37:36.494673 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:37:36.494673 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:37:36.494673 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 7e8869e8a46f40b18434fbe68d819dc4 Oct 04 18:37:36.494673 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ImagesNegativeTestJSON-67203657 Oct 04 18:37:36.494673 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:37:36.494673 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:37:36.494673 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e8869e8a46f40b18434fbe68d819dc4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7e8869e8a46f40b18434fbe68d819dc4", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7e8869e8a46f40b18434fbe68d819dc4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e8869e8a46f40b18434fbe68d819dc4"}]}] Oct 04 18:37:36.494673 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ImagesNegativeTestJSON-67203657 Oct 04 18:37:36.494673 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 7e8869e8a46f40b18434fbe68d819dc4 Oct 04 18:37:36.494673 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-67203657 Oct 04 18:37:36.494673 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ImagesNegativeTestJSON-67203657-project Oct 04 18:37:36.494673 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:37:36.494673 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:37:36.494673 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 8356b47bd87f42e2b642c6df82014e86 Oct 04 18:37:36.494673 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ImagesNegativeTestJSON-67203657-project Oct 04 18:37:36.494673 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:37:36.494673 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 94cff31c-a849-4365-b9e8-326613749226 could not be found. Oct 04 18:37:36.494673 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '94cff31c-a849-4365-b9e8-326613749226'} Oct 04 18:37:36.494673 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:37:36.494673 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:36.494673 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:37:36.494673 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:37:36.494673 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:37:36.494673 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:37:36.494673 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:37:36.494673 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:37:36.494673 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:37:36.494673 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:37:36.494673 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94cff31c-a849-4365-b9e8-326613749226 could not be found. Oct 04 18:37:36.494673 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:37:36.494673 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:36.494673 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:37:36.494673 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:36.494673 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:36.494673 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:36.494673 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:37:36.494673 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:37:36.494673 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:37:36.494673 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:37:36.494673 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:37:36.494673 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:37:36.494673 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:37:36.494673 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:37:36.494673 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:37:36.494673 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:37:36.494673 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94cff31c-a849-4365-b9e8-326613749226 could not be found. Oct 04 18:37:36.494673 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:37:36.494673 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:36.494673 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:37:36.499419 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:36.499419 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:36.499419 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:36.499419 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:37:36.499419 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:37:36.499419 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94cff31c-a849-4365-b9e8-326613749226 could not be found. Oct 04 18:37:36.499419 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:37:36.499419 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3dd34446-09fb-4b4a-ab43-a6ea41311ea5 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] Returning 404 to user: Instance 94cff31c-a849-4365-b9e8-326613749226 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:37:36.499419 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3dd34446-09fb-4b4a-ab43-a6ea41311ea5 tempest-ImagesNegativeTestJSON-67203657 tempest-ImagesNegativeTestJSON-67203657-project] 10.222.0.20 "GET /compute/v2.1/servers/94cff31c-a849-4365-b9e8-326613749226" status: 404 len: 111 microversion: 2.1 time: 0.042753 Oct 04 18:37:36.501889 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1243/2410] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:36 2022] GET /compute/v2.1/servers/94cff31c-a849-4365-b9e8-326613749226 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:37:36.503272 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-98859cf0-1140-459b-9a64-e941a8e1a6b1 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:36.503834 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-98859cf0-1140-459b-9a64-e941a8e1a6b1 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:36.504379 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-98859cf0-1140-459b-9a64-e941a8e1a6b1 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:36.505193 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-98859cf0-1140-459b-9a64-e941a8e1a6b1 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:36.505725 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-98859cf0-1140-459b-9a64-e941a8e1a6b1 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:36.506228 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-98859cf0-1140-459b-9a64-e941a8e1a6b1 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:36.620223 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2163cac3-53e0-4d78-b0ba-baac104b7af1 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:36.623754 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2163cac3-53e0-4d78-b0ba-baac104b7af1 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 61ec7cca-1572-496c-ba44-439f04c2a79c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:36.630266 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2163cac3-53e0-4d78-b0ba-baac104b7af1 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:36.630789 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2163cac3-53e0-4d78-b0ba-baac104b7af1 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:36.631554 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2163cac3-53e0-4d78-b0ba-baac104b7af1 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:36.632409 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2163cac3-53e0-4d78-b0ba-baac104b7af1 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:36.632871 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2163cac3-53e0-4d78-b0ba-baac104b7af1 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:36.633297 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2163cac3-53e0-4d78-b0ba-baac104b7af1 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:36.745816 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-98859cf0-1140-459b-9a64-e941a8e1a6b1 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:36.762053 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-98859cf0-1140-459b-9a64-e941a8e1a6b1 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5" status: 200 len: 1378 microversion: 2.1 time: 0.272266 Oct 04 18:37:36.763814 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1168/2411] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:36 2022] GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5 => generated 1378 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:37:36.772714 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e87453f4-50ef-4017-8139-491f58c1955f tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:36.773368 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e87453f4-50ef-4017-8139-491f58c1955f tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] [instance: 0bef06d7-ba85-4f48-bd08-228211391394] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:36.787509 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e87453f4-50ef-4017-8139-491f58c1955f tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:36.788009 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e87453f4-50ef-4017-8139-491f58c1955f tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:36.788495 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e87453f4-50ef-4017-8139-491f58c1955f tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:36.789213 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e87453f4-50ef-4017-8139-491f58c1955f tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:36.789674 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e87453f4-50ef-4017-8139-491f58c1955f tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:36.790124 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e87453f4-50ef-4017-8139-491f58c1955f tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:36.926659 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e87453f4-50ef-4017-8139-491f58c1955f tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:36.935835 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e87453f4-50ef-4017-8139-491f58c1955f tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:36.939572 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e87453f4-50ef-4017-8139-491f58c1955f tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:36.941114 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e87453f4-50ef-4017-8139-491f58c1955f tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] 10.222.0.20 "GET /compute/v2.1/servers/0bef06d7-ba85-4f48-bd08-228211391394" status: 200 len: 1336 microversion: 2.57 time: 0.176477 Oct 04 18:37:36.942242 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1169/2412] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:36 2022] GET /compute/v2.1/servers/0bef06d7-ba85-4f48-bd08-228211391394 => generated 1336 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:37:36.947045 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-cfc7b925-0c6e-46e8-be50-f97d98ebe537 req-89297687-8ad8-4c8e-b004-13067950ca96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd74aff9-f694-49f3-a1cc-2095b71cd9e5", "name": "network-vif-deleted", "tag": "bd7c52cb-3d4c-4b6f-a043-15c22280ba46"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:36.984663 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-cfc7b925-0c6e-46e8-be50-f97d98ebe537 req-89297687-8ad8-4c8e-b004-13067950ca96 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:36.985154 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-cfc7b925-0c6e-46e8-be50-f97d98ebe537 req-89297687-8ad8-4c8e-b004-13067950ca96 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:36.985596 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-cfc7b925-0c6e-46e8-be50-f97d98ebe537 req-89297687-8ad8-4c8e-b004-13067950ca96 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:37.037533 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-cfc7b925-0c6e-46e8-be50-f97d98ebe537 req-89297687-8ad8-4c8e-b004-13067950ca96 service nova] Creating event network-vif-deleted:bd7c52cb-3d4c-4b6f-a043-15c22280ba46 for instance cd74aff9-f694-49f3-a1cc-2095b71cd9e5 on n-h1-850501-14 Oct 04 18:37:37.051522 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-cfc7b925-0c6e-46e8-be50-f97d98ebe537 req-89297687-8ad8-4c8e-b004-13067950ca96 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107676 Oct 04 18:37:37.060856 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1170/2413] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:37:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:37.148812 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-09db0282-04cb-4e3f-85d6-60468d2b91cb req-0cd983e9-dc0c-45c5-bd9d-1c8870e65994 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "474a799f-8e38-49d6-8fff-9ec3e7657ef5", "name": "network-vif-plugged", "status": "completed", "tag": "a0d7cb42-218d-4bf1-adab-5dbf22e8ab22"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:37.153343 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2163cac3-53e0-4d78-b0ba-baac104b7af1 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8284fe51decd4db0bf6b3ed1514cc2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87473abf47e74adf844e3ddfa24da3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:37.161128 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2163cac3-53e0-4d78-b0ba-baac104b7af1 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] 10.222.0.20 "GET /compute/v2.1/servers/61ec7cca-1572-496c-ba44-439f04c2a79c" status: 200 len: 1499 microversion: 2.1 time: 0.544810 Oct 04 18:37:37.166595 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-09db0282-04cb-4e3f-85d6-60468d2b91cb req-0cd983e9-dc0c-45c5-bd9d-1c8870e65994 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:37.167648 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-09db0282-04cb-4e3f-85d6-60468d2b91cb req-0cd983e9-dc0c-45c5-bd9d-1c8870e65994 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:37.169951 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1244/2414] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:36 2022] GET /compute/v2.1/servers/61ec7cca-1572-496c-ba44-439f04c2a79c => generated 1499 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:37.170650 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-09db0282-04cb-4e3f-85d6-60468d2b91cb req-0cd983e9-dc0c-45c5-bd9d-1c8870e65994 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:37.185590 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-09db0282-04cb-4e3f-85d6-60468d2b91cb req-0cd983e9-dc0c-45c5-bd9d-1c8870e65994 service nova] Creating event network-vif-plugged:a0d7cb42-218d-4bf1-adab-5dbf22e8ab22 for instance 474a799f-8e38-49d6-8fff-9ec3e7657ef5 on n-h2-850501-14 Oct 04 18:37:37.195035 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-09db0282-04cb-4e3f-85d6-60468d2b91cb req-0cd983e9-dc0c-45c5-bd9d-1c8870e65994 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050562 Oct 04 18:37:37.197290 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1171/2415] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:37:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:37:37.199090 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b662b1f7-4c17-4bbb-9c4e-ad169db68d8d tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:37.205798 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b662b1f7-4c17-4bbb-9c4e-ad169db68d8d tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 61ec7cca-1572-496c-ba44-439f04c2a79c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:37.221422 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b662b1f7-4c17-4bbb-9c4e-ad169db68d8d tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:37.221929 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b662b1f7-4c17-4bbb-9c4e-ad169db68d8d tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:37.223475 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b662b1f7-4c17-4bbb-9c4e-ad169db68d8d tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:37.224242 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b662b1f7-4c17-4bbb-9c4e-ad169db68d8d tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:37.225344 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b662b1f7-4c17-4bbb-9c4e-ad169db68d8d tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:37.225784 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b662b1f7-4c17-4bbb-9c4e-ad169db68d8d tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:37.330059 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-154f7fe6-6db2-48e5-b3ec-20561a765c77 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:37.334009 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-154f7fe6-6db2-48e5-b3ec-20561a765c77 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 98dfffc8-51aa-407a-a374-8e120ec43a31] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:37.355177 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-b662b1f7-4c17-4bbb-9c4e-ad169db68d8d tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lazy-loading 'flavor' on Instance uuid 61ec7cca-1572-496c-ba44-439f04c2a79c {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:37:37.404697 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-154f7fe6-6db2-48e5-b3ec-20561a765c77 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:37.405598 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-154f7fe6-6db2-48e5-b3ec-20561a765c77 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:37.407589 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-154f7fe6-6db2-48e5-b3ec-20561a765c77 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:37.410327 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-154f7fe6-6db2-48e5-b3ec-20561a765c77 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:37.410327 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-154f7fe6-6db2-48e5-b3ec-20561a765c77 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:37.410327 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-154f7fe6-6db2-48e5-b3ec-20561a765c77 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:37.680866 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b662b1f7-4c17-4bbb-9c4e-ad169db68d8d tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] 10.222.0.20 "POST /compute/v2.1/servers/61ec7cca-1572-496c-ba44-439f04c2a79c/action" status: 200 len: 32 microversion: 2.1 time: 0.486708 Oct 04 18:37:37.686008 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1245/2416] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:37:37 2022] POST /compute/v2.1/servers/61ec7cca-1572-496c-ba44-439f04c2a79c/action => generated 32 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 18:37:37.693657 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6104ad4b-4a9e-47dc-8c2d-12643f1c5aa1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:37.695629 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-6104ad4b-4a9e-47dc-8c2d-12643f1c5aa1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: cd74aff9-f694-49f3-a1cc-2095b71cd9e5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:37.723770 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6104ad4b-4a9e-47dc-8c2d-12643f1c5aa1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:37.726475 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6104ad4b-4a9e-47dc-8c2d-12643f1c5aa1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:37.728542 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6104ad4b-4a9e-47dc-8c2d-12643f1c5aa1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:37.729462 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6104ad4b-4a9e-47dc-8c2d-12643f1c5aa1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:37.731749 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6104ad4b-4a9e-47dc-8c2d-12643f1c5aa1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:37.736328 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6104ad4b-4a9e-47dc-8c2d-12643f1c5aa1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:37.839312 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-154f7fe6-6db2-48e5-b3ec-20561a765c77 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:37.846182 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-6104ad4b-4a9e-47dc-8c2d-12643f1c5aa1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:37.849349 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-154f7fe6-6db2-48e5-b3ec-20561a765c77 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31" status: 200 len: 1392 microversion: 2.1 time: 0.531200 Oct 04 18:37:37.851915 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1172/2417] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:37 2022] GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31 => generated 1392 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:37:37.864938 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-6104ad4b-4a9e-47dc-8c2d-12643f1c5aa1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:37.869153 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-6104ad4b-4a9e-47dc-8c2d-12643f1c5aa1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:37.870360 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6104ad4b-4a9e-47dc-8c2d-12643f1c5aa1 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5" status: 200 len: 1266 microversion: 2.25 time: 0.187253 Oct 04 18:37:37.870996 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b4f97004-f55a-470f-a656-b0ef29c5ce74 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:37.872509 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b4f97004-f55a-470f-a656-b0ef29c5ce74 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] [instance: 616e21b9-c93b-4ff0-8740-24c613f4d708] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:37.873809 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1246/2418] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:37 2022] GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5 => generated 1266 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:37:37.880019 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b4944d6f-a61a-494a-ad3f-53a73d81d752 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:37.880656 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b4944d6f-a61a-494a-ad3f-53a73d81d752 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 61ec7cca-1572-496c-ba44-439f04c2a79c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:37.882655 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b4f97004-f55a-470f-a656-b0ef29c5ce74 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:37.889391 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b4944d6f-a61a-494a-ad3f-53a73d81d752 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:37.889907 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b4944d6f-a61a-494a-ad3f-53a73d81d752 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:37.890342 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b4944d6f-a61a-494a-ad3f-53a73d81d752 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:37.891441 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b4f97004-f55a-470f-a656-b0ef29c5ce74 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:37.892157 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b4f97004-f55a-470f-a656-b0ef29c5ce74 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:37.893547 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b4944d6f-a61a-494a-ad3f-53a73d81d752 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:37.894385 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b4944d6f-a61a-494a-ad3f-53a73d81d752 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:37.894831 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b4944d6f-a61a-494a-ad3f-53a73d81d752 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:37.896280 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b4f97004-f55a-470f-a656-b0ef29c5ce74 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:37.896974 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b4f97004-f55a-470f-a656-b0ef29c5ce74 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:37.900825 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b4f97004-f55a-470f-a656-b0ef29c5ce74 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:37.949620 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-b4f97004-f55a-470f-a656-b0ef29c5ce74 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] HTTP exception thrown: Instance 616e21b9-c93b-4ff0-8740-24c613f4d708 could not be found. Oct 04 18:37:37.954345 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b4f97004-f55a-470f-a656-b0ef29c5ce74 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Request method failure captured: Oct 04 18:37:37.954345 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/616e21b9-c93b-4ff0-8740-24c613f4d708 HTTP/1.1 Oct 04 18:37:37.954345 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:37:37.954345 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:37:37.954345 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:37:37.954345 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:37:37.954345 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:37:37.954345 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:37:37.954345 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:37:37.954345 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:37:37.954345 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPHzalpqmsewN2J61v1Y0qLDtlN2FHUi2_nWyZ1Q-vjMt_4gSQz5L13cLBjtmLCrnLRTB9GqNa_-hKs10nMk9Qvuv6OZyurGD386ZLOA5t161yDtVaKb0xp2inIdlbDXLtIUVom-9v7H_1WP8Q90_876Lqq25zfLlqGgtW_IuOJz1qAY Oct 04 18:37:37.954345 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:37:37.954345 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:37:37.954345 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:37:37.954345 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:37:37.954345 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:37:37.954345 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:37:37.954345 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: c3242afeef424d588cf102a2f0f38020 Oct 04 18:37:37.954345 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ServersTestMultiNic-1495387740 Oct 04 18:37:37.954345 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:37:37.954345 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:37:37.954345 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c3242afeef424d588cf102a2f0f38020"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c3242afeef424d588cf102a2f0f38020", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c3242afeef424d588cf102a2f0f38020"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c3242afeef424d588cf102a2f0f38020"}]}] Oct 04 18:37:37.954345 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ServersTestMultiNic-1495387740 Oct 04 18:37:37.954345 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: c3242afeef424d588cf102a2f0f38020 Oct 04 18:37:37.954345 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ServersTestMultiNic-1495387740 Oct 04 18:37:37.954345 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ServersTestMultiNic-1495387740-project Oct 04 18:37:37.954345 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:37:37.954345 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:37:37.954345 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: acb44381220d43b7bdfa744a1dc410a8 Oct 04 18:37:37.954345 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ServersTestMultiNic-1495387740-project Oct 04 18:37:37.954345 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:37:37.954345 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 616e21b9-c93b-4ff0-8740-24c613f4d708 could not be found. Oct 04 18:37:37.954345 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '616e21b9-c93b-4ff0-8740-24c613f4d708'} Oct 04 18:37:37.954345 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:37:37.954345 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:37.954345 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:37:37.954345 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:37:37.954345 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:37:37.954345 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:37:37.954345 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:37:37.954345 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:37:37.954345 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:37:37.954345 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:37:37.954345 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 616e21b9-c93b-4ff0-8740-24c613f4d708 could not be found. Oct 04 18:37:37.954345 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:37:37.954345 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:37.954345 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:37:37.954345 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:37.954345 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:37.954345 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:37.954345 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:37:37.954345 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:37:37.954345 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:37:37.954345 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:37:37.954345 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:37:37.954345 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:37:37.954345 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:37:37.954345 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:37:37.954345 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:37:37.954345 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:37:37.954345 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 616e21b9-c93b-4ff0-8740-24c613f4d708 could not be found. Oct 04 18:37:37.954345 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:37:37.954345 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:37.954345 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:37:37.958219 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:37.958219 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:37.958219 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:37.958219 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:37:37.958219 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:37:37.958219 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 616e21b9-c93b-4ff0-8740-24c613f4d708 could not be found. Oct 04 18:37:37.958219 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:37:37.959937 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b4f97004-f55a-470f-a656-b0ef29c5ce74 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Returning 404 to user: Instance 616e21b9-c93b-4ff0-8740-24c613f4d708 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:37:37.961190 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b4f97004-f55a-470f-a656-b0ef29c5ce74 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] 10.222.0.20 "GET /compute/v2.1/servers/616e21b9-c93b-4ff0-8740-24c613f4d708" status: 404 len: 111 microversion: 2.1 time: 0.108025 Oct 04 18:37:37.962277 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1173/2419] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:37 2022] GET /compute/v2.1/servers/616e21b9-c93b-4ff0-8740-24c613f4d708 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:37:37.988236 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ef42d609-3ecb-4006-83e6-e71489f411e8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:37.990093 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ef42d609-3ecb-4006-83e6-e71489f411e8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 474a799f-8e38-49d6-8fff-9ec3e7657ef5] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:38.007670 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ef42d609-3ecb-4006-83e6-e71489f411e8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:38.008653 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ef42d609-3ecb-4006-83e6-e71489f411e8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:38.009823 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ef42d609-3ecb-4006-83e6-e71489f411e8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:38.011877 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ef42d609-3ecb-4006-83e6-e71489f411e8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:38.013150 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ef42d609-3ecb-4006-83e6-e71489f411e8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:38.015059 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ef42d609-3ecb-4006-83e6-e71489f411e8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:38.765840 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b4944d6f-a61a-494a-ad3f-53a73d81d752 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8284fe51decd4db0bf6b3ed1514cc2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87473abf47e74adf844e3ddfa24da3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:38.795037 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b4944d6f-a61a-494a-ad3f-53a73d81d752 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] 10.222.0.20 "GET /compute/v2.1/servers/61ec7cca-1572-496c-ba44-439f04c2a79c" status: 200 len: 1505 microversion: 2.1 time: 0.918714 Oct 04 18:37:38.810326 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1247/2420] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:37 2022] GET /compute/v2.1/servers/61ec7cca-1572-496c-ba44-439f04c2a79c => generated 1505 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:38.838973 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-039e3342-173d-4bed-8969-76d1d7ae9155 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:38.838973 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-039e3342-173d-4bed-8969-76d1d7ae9155 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] [instance: 0bef06d7-ba85-4f48-bd08-228211391394] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:38.843968 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-039e3342-173d-4bed-8969-76d1d7ae9155 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:38.844836 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-039e3342-173d-4bed-8969-76d1d7ae9155 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:38.845545 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-039e3342-173d-4bed-8969-76d1d7ae9155 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:38.846519 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-039e3342-173d-4bed-8969-76d1d7ae9155 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:38.847245 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-039e3342-173d-4bed-8969-76d1d7ae9155 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:38.847903 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-039e3342-173d-4bed-8969-76d1d7ae9155 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:39.097278 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-039e3342-173d-4bed-8969-76d1d7ae9155 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:39.111551 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-039e3342-173d-4bed-8969-76d1d7ae9155 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:39.116157 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-039e3342-173d-4bed-8969-76d1d7ae9155 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:39.120624 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-039e3342-173d-4bed-8969-76d1d7ae9155 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] 10.222.0.20 "GET /compute/v2.1/servers/0bef06d7-ba85-4f48-bd08-228211391394" status: 200 len: 1357 microversion: 2.57 time: 0.294273 Oct 04 18:37:39.121762 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1248/2421] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:38 2022] GET /compute/v2.1/servers/0bef06d7-ba85-4f48-bd08-228211391394 => generated 1357 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:37:39.138311 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a4998a0b-64c8-426d-899a-f224b94a4910 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:39.140830 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a4998a0b-64c8-426d-899a-f224b94a4910 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 98dfffc8-51aa-407a-a374-8e120ec43a31] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:39.168606 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a4998a0b-64c8-426d-899a-f224b94a4910 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:39.170420 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a4998a0b-64c8-426d-899a-f224b94a4910 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:39.170977 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a4998a0b-64c8-426d-899a-f224b94a4910 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:39.175031 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a4998a0b-64c8-426d-899a-f224b94a4910 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:39.176405 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a4998a0b-64c8-426d-899a-f224b94a4910 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:39.179014 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a4998a0b-64c8-426d-899a-f224b94a4910 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:39.410617 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ef42d609-3ecb-4006-83e6-e71489f411e8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:39.422654 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ef42d609-3ecb-4006-83e6-e71489f411e8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5" status: 200 len: 1378 microversion: 2.1 time: 1.459078 Oct 04 18:37:39.441004 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1174/2422] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:37 2022] GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5 => generated 1378 bytes in 1477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:39.451998 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-236b87ad-9b54-4f80-9e6a-72a26f3d25a6 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:39.452652 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-236b87ad-9b54-4f80-9e6a-72a26f3d25a6 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: cd74aff9-f694-49f3-a1cc-2095b71cd9e5] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:39.468711 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-236b87ad-9b54-4f80-9e6a-72a26f3d25a6 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:39.469603 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-236b87ad-9b54-4f80-9e6a-72a26f3d25a6 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:39.470236 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-236b87ad-9b54-4f80-9e6a-72a26f3d25a6 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:39.475760 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-236b87ad-9b54-4f80-9e6a-72a26f3d25a6 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:39.476514 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-236b87ad-9b54-4f80-9e6a-72a26f3d25a6 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:39.477109 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-236b87ad-9b54-4f80-9e6a-72a26f3d25a6 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:39.704450 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-236b87ad-9b54-4f80-9e6a-72a26f3d25a6 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:39.723199 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-236b87ad-9b54-4f80-9e6a-72a26f3d25a6 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:39.730549 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-236b87ad-9b54-4f80-9e6a-72a26f3d25a6 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:39.734748 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-236b87ad-9b54-4f80-9e6a-72a26f3d25a6 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5" status: 200 len: 1266 microversion: 2.25 time: 0.292379 Oct 04 18:37:39.737871 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1175/2423] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:39 2022] GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5 => generated 1266 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:37:39.750978 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-df5a8323-997c-45e5-82dc-edd2b667a5e7 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:39.764265 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-df5a8323-997c-45e5-82dc-edd2b667a5e7 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] [instance: 0bef06d7-ba85-4f48-bd08-228211391394] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:39.784485 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-df5a8323-997c-45e5-82dc-edd2b667a5e7 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:39.785346 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-df5a8323-997c-45e5-82dc-edd2b667a5e7 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:39.785947 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-df5a8323-997c-45e5-82dc-edd2b667a5e7 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:39.787417 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-df5a8323-997c-45e5-82dc-edd2b667a5e7 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:39.789886 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-df5a8323-997c-45e5-82dc-edd2b667a5e7 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:39.791118 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-df5a8323-997c-45e5-82dc-edd2b667a5e7 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:39.812618 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a4998a0b-64c8-426d-899a-f224b94a4910 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:39.832739 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a4998a0b-64c8-426d-899a-f224b94a4910 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31" status: 200 len: 1392 microversion: 2.1 time: 0.705774 Oct 04 18:37:39.837364 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1249/2424] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:39 2022] GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31 => generated 1392 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:39.856568 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2a99039d-f9ab-45da-ac2c-152945e22901 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:39.861087 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2a99039d-f9ab-45da-ac2c-152945e22901 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 61ec7cca-1572-496c-ba44-439f04c2a79c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:39.887586 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2a99039d-f9ab-45da-ac2c-152945e22901 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:39.891953 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2a99039d-f9ab-45da-ac2c-152945e22901 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:39.894375 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2a99039d-f9ab-45da-ac2c-152945e22901 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:39.897762 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2a99039d-f9ab-45da-ac2c-152945e22901 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:39.898451 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2a99039d-f9ab-45da-ac2c-152945e22901 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:39.900916 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2a99039d-f9ab-45da-ac2c-152945e22901 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:40.090154 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-df5a8323-997c-45e5-82dc-edd2b667a5e7 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:37:40.094950 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-df5a8323-997c-45e5-82dc-edd2b667a5e7 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:37:40.095614 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-df5a8323-997c-45e5-82dc-edd2b667a5e7 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:37:40.096038 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-df5a8323-997c-45e5-82dc-edd2b667a5e7 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:37:40.098756 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-df5a8323-997c-45e5-82dc-edd2b667a5e7 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:37:40.299414 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2a99039d-f9ab-45da-ac2c-152945e22901 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8284fe51decd4db0bf6b3ed1514cc2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87473abf47e74adf844e3ddfa24da3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:40.310315 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2a99039d-f9ab-45da-ac2c-152945e22901 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] 10.222.0.20 "GET /compute/v2.1/servers/61ec7cca-1572-496c-ba44-439f04c2a79c" status: 200 len: 1505 microversion: 2.1 time: 0.470265 Oct 04 18:37:40.315480 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1250/2425] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:39 2022] GET /compute/v2.1/servers/61ec7cca-1572-496c-ba44-439f04c2a79c => generated 1505 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:40.413017 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-df5a8323-997c-45e5-82dc-edd2b667a5e7 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] [instance: 0bef06d7-ba85-4f48-bd08-228211391394] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:40.421804 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-df5a8323-997c-45e5-82dc-edd2b667a5e7 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:40.422533 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-df5a8323-997c-45e5-82dc-edd2b667a5e7 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:40.423146 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-df5a8323-997c-45e5-82dc-edd2b667a5e7 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:40.424307 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-df5a8323-997c-45e5-82dc-edd2b667a5e7 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:40.425125 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-df5a8323-997c-45e5-82dc-edd2b667a5e7 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:40.426584 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-df5a8323-997c-45e5-82dc-edd2b667a5e7 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:40.446650 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-20937fcf-4753-464f-be91-7037f5e67f6f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:40.447488 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-20937fcf-4753-464f-be91-7037f5e67f6f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 474a799f-8e38-49d6-8fff-9ec3e7657ef5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:40.463696 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-20937fcf-4753-464f-be91-7037f5e67f6f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:40.464126 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-20937fcf-4753-464f-be91-7037f5e67f6f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:40.464591 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-20937fcf-4753-464f-be91-7037f5e67f6f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:40.465308 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-20937fcf-4753-464f-be91-7037f5e67f6f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:40.465769 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-20937fcf-4753-464f-be91-7037f5e67f6f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:40.466235 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-20937fcf-4753-464f-be91-7037f5e67f6f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:40.519406 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-df5a8323-997c-45e5-82dc-edd2b667a5e7 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] 10.222.0.20 "POST /compute/v2.1/servers/0bef06d7-ba85-4f48-bd08-228211391394/action" status: 202 len: 1138 microversion: 2.57 time: 0.780056 Oct 04 18:37:40.533465 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1176/2426] 10.222.0.20 () {62 vars in 1320 bytes} [Tue Oct 4 18:37:39 2022] POST /compute/v2.1/servers/0bef06d7-ba85-4f48-bd08-228211391394/action => generated 1138 bytes in 795 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 04 18:37:40.548172 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ecaa2f47-365c-4f34-b807-60a78cb1619c tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:40.549048 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ecaa2f47-365c-4f34-b807-60a78cb1619c tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] [instance: 0bef06d7-ba85-4f48-bd08-228211391394] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:40.572461 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ecaa2f47-365c-4f34-b807-60a78cb1619c tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:40.573479 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ecaa2f47-365c-4f34-b807-60a78cb1619c tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:40.574121 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ecaa2f47-365c-4f34-b807-60a78cb1619c tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:40.575048 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ecaa2f47-365c-4f34-b807-60a78cb1619c tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:40.576291 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ecaa2f47-365c-4f34-b807-60a78cb1619c tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:40.577038 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ecaa2f47-365c-4f34-b807-60a78cb1619c tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:40.782808 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ecaa2f47-365c-4f34-b807-60a78cb1619c tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:40.788647 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:40.800791 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ecaa2f47-365c-4f34-b807-60a78cb1619c tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:40.803433 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ecaa2f47-365c-4f34-b807-60a78cb1619c tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:40.805743 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ecaa2f47-365c-4f34-b807-60a78cb1619c tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] 10.222.0.20 "GET /compute/v2.1/servers/0bef06d7-ba85-4f48-bd08-228211391394" status: 200 len: 1366 microversion: 2.57 time: 0.263768 Oct 04 18:37:40.806955 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1177/2427] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:40 2022] GET /compute/v2.1/servers/0bef06d7-ba85-4f48-bd08-228211391394 => generated 1366 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:37:40.814749 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e2891c8a-c0a6-4ac6-8288-09ebfdf5a941 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:40.815644 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e2891c8a-c0a6-4ac6-8288-09ebfdf5a941 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: cd74aff9-f694-49f3-a1cc-2095b71cd9e5] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:40.826066 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e2891c8a-c0a6-4ac6-8288-09ebfdf5a941 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:40.827215 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e2891c8a-c0a6-4ac6-8288-09ebfdf5a941 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:40.827972 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e2891c8a-c0a6-4ac6-8288-09ebfdf5a941 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:40.828974 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e2891c8a-c0a6-4ac6-8288-09ebfdf5a941 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:40.829928 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e2891c8a-c0a6-4ac6-8288-09ebfdf5a941 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:40.830814 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e2891c8a-c0a6-4ac6-8288-09ebfdf5a941 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:40.885808 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:40.924691 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-20937fcf-4753-464f-be91-7037f5e67f6f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:40.953017 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-20937fcf-4753-464f-be91-7037f5e67f6f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5" status: 200 len: 1528 microversion: 2.1 time: 0.510274 Oct 04 18:37:40.962243 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1251/2428] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:40 2022] GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5 => generated 1528 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:40.974415 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-cd9a3516-64b6-4eba-ad50-79fc4633bd93 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:40.975255 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-cd9a3516-64b6-4eba-ad50-79fc4633bd93 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 98dfffc8-51aa-407a-a374-8e120ec43a31] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:40.992713 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cd9a3516-64b6-4eba-ad50-79fc4633bd93 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:40.995414 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cd9a3516-64b6-4eba-ad50-79fc4633bd93 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:40.998655 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cd9a3516-64b6-4eba-ad50-79fc4633bd93 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:40.999699 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cd9a3516-64b6-4eba-ad50-79fc4633bd93 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:41.004473 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cd9a3516-64b6-4eba-ad50-79fc4633bd93 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:41.005131 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cd9a3516-64b6-4eba-ad50-79fc4633bd93 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:41.077447 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:41.126628 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e2891c8a-c0a6-4ac6-8288-09ebfdf5a941 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:41.141021 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e2891c8a-c0a6-4ac6-8288-09ebfdf5a941 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:41.142451 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e2891c8a-c0a6-4ac6-8288-09ebfdf5a941 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:41.143596 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e2891c8a-c0a6-4ac6-8288-09ebfdf5a941 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5" status: 200 len: 1266 microversion: 2.25 time: 0.335459 Oct 04 18:37:41.144172 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1178/2429] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:40 2022] GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5 => generated 1266 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:37:41.151624 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b1553d51-7908-4290-8a29-0a7a47e9ed9a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:41.152444 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b1553d51-7908-4290-8a29-0a7a47e9ed9a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 474a799f-8e38-49d6-8fff-9ec3e7657ef5] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:41.165743 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b1553d51-7908-4290-8a29-0a7a47e9ed9a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:41.172241 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b1553d51-7908-4290-8a29-0a7a47e9ed9a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:41.173603 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b1553d51-7908-4290-8a29-0a7a47e9ed9a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:41.176672 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b1553d51-7908-4290-8a29-0a7a47e9ed9a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:41.177359 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b1553d51-7908-4290-8a29-0a7a47e9ed9a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:41.178749 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b1553d51-7908-4290-8a29-0a7a47e9ed9a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:41.354494 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-cd9a3516-64b6-4eba-ad50-79fc4633bd93 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:41.364069 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-cd9a3516-64b6-4eba-ad50-79fc4633bd93 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31" status: 200 len: 1392 microversion: 2.1 time: 0.398754 Oct 04 18:37:41.369518 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1252/2430] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:40 2022] GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31 => generated 1392 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:41.375105 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1b55b493-c9f0-4ea8-b578-2c2c447df236 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:41.385261 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1b55b493-c9f0-4ea8-b578-2c2c447df236 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 61ec7cca-1572-496c-ba44-439f04c2a79c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:41.395052 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1b55b493-c9f0-4ea8-b578-2c2c447df236 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:41.395811 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1b55b493-c9f0-4ea8-b578-2c2c447df236 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:41.396433 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1b55b493-c9f0-4ea8-b578-2c2c447df236 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:41.397286 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1b55b493-c9f0-4ea8-b578-2c2c447df236 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:41.409956 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1b55b493-c9f0-4ea8-b578-2c2c447df236 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:41.410694 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1b55b493-c9f0-4ea8-b578-2c2c447df236 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:42.471760 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=8 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:42.860281 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b1553d51-7908-4290-8a29-0a7a47e9ed9a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:42.873401 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b1553d51-7908-4290-8a29-0a7a47e9ed9a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5" status: 200 len: 1528 microversion: 2.1 time: 1.727020 Oct 04 18:37:42.874626 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1179/2431] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:41 2022] GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5 => generated 1528 bytes in 1730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:42.882574 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-40df1f59-0799-43f7-8f8f-d79fe465e1dc tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:42.886190 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-40df1f59-0799-43f7-8f8f-d79fe465e1dc tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] [instance: 0bef06d7-ba85-4f48-bd08-228211391394] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:42.905254 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-40df1f59-0799-43f7-8f8f-d79fe465e1dc tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:42.906085 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-40df1f59-0799-43f7-8f8f-d79fe465e1dc tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:42.906687 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-40df1f59-0799-43f7-8f8f-d79fe465e1dc tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:42.907474 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-40df1f59-0799-43f7-8f8f-d79fe465e1dc tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:42.914441 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-40df1f59-0799-43f7-8f8f-d79fe465e1dc tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:42.914441 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-40df1f59-0799-43f7-8f8f-d79fe465e1dc tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:43.030901 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1b55b493-c9f0-4ea8-b578-2c2c447df236 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8284fe51decd4db0bf6b3ed1514cc2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87473abf47e74adf844e3ddfa24da3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:43.041580 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1b55b493-c9f0-4ea8-b578-2c2c447df236 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] 10.222.0.20 "GET /compute/v2.1/servers/61ec7cca-1572-496c-ba44-439f04c2a79c" status: 200 len: 1505 microversion: 2.1 time: 1.670262 Oct 04 18:37:43.046294 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1253/2432] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:41 2022] GET /compute/v2.1/servers/61ec7cca-1572-496c-ba44-439f04c2a79c => generated 1505 bytes in 1676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:43.058239 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-339c12f1-38db-4b2f-bdb0-8764283b259c tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:43.061920 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-339c12f1-38db-4b2f-bdb0-8764283b259c tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: cd74aff9-f694-49f3-a1cc-2095b71cd9e5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:43.078894 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-339c12f1-38db-4b2f-bdb0-8764283b259c tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:43.080729 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-339c12f1-38db-4b2f-bdb0-8764283b259c tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:43.081343 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-339c12f1-38db-4b2f-bdb0-8764283b259c tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:43.084009 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-339c12f1-38db-4b2f-bdb0-8764283b259c tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:43.085114 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-339c12f1-38db-4b2f-bdb0-8764283b259c tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:43.085725 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-339c12f1-38db-4b2f-bdb0-8764283b259c tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:43.095757 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-40df1f59-0799-43f7-8f8f-d79fe465e1dc tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:43.109166 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-40df1f59-0799-43f7-8f8f-d79fe465e1dc tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:43.112817 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-40df1f59-0799-43f7-8f8f-d79fe465e1dc tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:43.117338 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-40df1f59-0799-43f7-8f8f-d79fe465e1dc tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] 10.222.0.20 "GET /compute/v2.1/servers/0bef06d7-ba85-4f48-bd08-228211391394" status: 200 len: 1366 microversion: 2.57 time: 0.241451 Oct 04 18:37:43.133224 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1180/2433] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:42 2022] GET /compute/v2.1/servers/0bef06d7-ba85-4f48-bd08-228211391394 => generated 1366 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:37:43.161706 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8eb0db0b-f32d-4426-aaac-11f217fe1653 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:43.165462 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8eb0db0b-f32d-4426-aaac-11f217fe1653 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 98dfffc8-51aa-407a-a374-8e120ec43a31] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:43.179826 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8eb0db0b-f32d-4426-aaac-11f217fe1653 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:43.186058 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8eb0db0b-f32d-4426-aaac-11f217fe1653 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:43.199997 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8eb0db0b-f32d-4426-aaac-11f217fe1653 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:43.202870 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8eb0db0b-f32d-4426-aaac-11f217fe1653 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:43.203384 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8eb0db0b-f32d-4426-aaac-11f217fe1653 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:43.203978 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8eb0db0b-f32d-4426-aaac-11f217fe1653 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:43.297299 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-339c12f1-38db-4b2f-bdb0-8764283b259c tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:43.311578 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-339c12f1-38db-4b2f-bdb0-8764283b259c tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:43.316037 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-339c12f1-38db-4b2f-bdb0-8764283b259c tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:43.321069 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-339c12f1-38db-4b2f-bdb0-8764283b259c tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5" status: 200 len: 1266 microversion: 2.25 time: 0.272799 Oct 04 18:37:43.324755 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1254/2434] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:43 2022] GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5 => generated 1266 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:37:43.343480 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ab22c233-1e68-4ad9-9fe2-162170061432 tempest-MigrationsAdminTest-1101631867 tempest-MigrationsAdminTest-1101631867-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:43.494807 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ab22c233-1e68-4ad9-9fe2-162170061432 tempest-MigrationsAdminTest-1101631867 tempest-MigrationsAdminTest-1101631867-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/2016a852-14f5-4c8b-9c97-7c97aa0c71e6" status: 202 len: 0 microversion: 2.1 time: 0.167682 Oct 04 18:37:43.498065 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1255/2435] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:37:43 2022] DELETE /compute/v2.1/flavors/2016a852-14f5-4c8b-9c97-7c97aa0c71e6 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:37:43.508960 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4134427f-83d7-4941-bc3c-f9aa1e5234a5 tempest-MigrationsAdminTest-1101631867 tempest-MigrationsAdminTest-1101631867-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:43.555547 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4134427f-83d7-4941-bc3c-f9aa1e5234a5 tempest-MigrationsAdminTest-1101631867 tempest-MigrationsAdminTest-1101631867-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.052740 Oct 04 18:37:43.557081 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1256/2436] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Oct 4 18:37:43 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:37:43.575439 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-566dbb38-5fbe-4906-94bd-c6219162bf91 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:43.578017 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-566dbb38-5fbe-4906-94bd-c6219162bf91 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 474a799f-8e38-49d6-8fff-9ec3e7657ef5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:43.584332 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-566dbb38-5fbe-4906-94bd-c6219162bf91 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:43.584932 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-566dbb38-5fbe-4906-94bd-c6219162bf91 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:43.585482 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-566dbb38-5fbe-4906-94bd-c6219162bf91 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:43.586097 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-566dbb38-5fbe-4906-94bd-c6219162bf91 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:43.586743 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-566dbb38-5fbe-4906-94bd-c6219162bf91 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:43.587182 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-566dbb38-5fbe-4906-94bd-c6219162bf91 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:43.719662 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-566dbb38-5fbe-4906-94bd-c6219162bf91 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:43.741336 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-566dbb38-5fbe-4906-94bd-c6219162bf91 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 474a799f-8e38-49d6-8fff-9ec3e7657ef5] Old instance type tempest-test_resize_flavor_-1193614459, new instance type m1.heat {{(pid=123002) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 18:37:43.757674 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-566dbb38-5fbe-4906-94bd-c6219162bf91 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:37:43.757674 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-566dbb38-5fbe-4906-94bd-c6219162bf91 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:37:43.757674 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-566dbb38-5fbe-4906-94bd-c6219162bf91 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:37:43.757674 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-566dbb38-5fbe-4906-94bd-c6219162bf91 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:37:43.757674 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-566dbb38-5fbe-4906-94bd-c6219162bf91 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:37:43.831002 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8eb0db0b-f32d-4426-aaac-11f217fe1653 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:43.844397 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:43.866364 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8eb0db0b-f32d-4426-aaac-11f217fe1653 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31" status: 200 len: 1392 microversion: 2.1 time: 0.712066 Oct 04 18:37:43.866824 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1181/2437] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:43 2022] GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31 => generated 1392 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:43.974753 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7d5933d4-ba0f-47df-b062-9e7a4aa35f65 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:43.975421 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7d5933d4-ba0f-47df-b062-9e7a4aa35f65 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] [instance: 616e21b9-c93b-4ff0-8740-24c613f4d708] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:43.983746 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7d5933d4-ba0f-47df-b062-9e7a4aa35f65 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:43.987935 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7d5933d4-ba0f-47df-b062-9e7a4aa35f65 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:43.988588 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7d5933d4-ba0f-47df-b062-9e7a4aa35f65 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:43.989987 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7d5933d4-ba0f-47df-b062-9e7a4aa35f65 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:43.990910 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7d5933d4-ba0f-47df-b062-9e7a4aa35f65 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:43.991939 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7d5933d4-ba0f-47df-b062-9e7a4aa35f65 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:44.016380 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-7d5933d4-ba0f-47df-b062-9e7a4aa35f65 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] HTTP exception thrown: Instance 616e21b9-c93b-4ff0-8740-24c613f4d708 could not be found. Oct 04 18:37:44.031682 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7d5933d4-ba0f-47df-b062-9e7a4aa35f65 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Request method failure captured: Oct 04 18:37:44.031682 n-d-850501-14 devstack@n-api.service[123001]: request: DELETE /compute/v2.1/servers/616e21b9-c93b-4ff0-8740-24c613f4d708 HTTP/1.1 Oct 04 18:37:44.031682 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:37:44.031682 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:37:44.031682 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:37:44.031682 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:37:44.031682 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:37:44.031682 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:37:44.031682 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:37:44.031682 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:37:44.031682 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPHzalpqmsewN2J61v1Y0qLDtlN2FHUi2_nWyZ1Q-vjMt_4gSQz5L13cLBjtmLCrnLRTB9GqNa_-hKs10nMk9Qvuv6OZyurGD386ZLOA5t161yDtVaKb0xp2inIdlbDXLtIUVom-9v7H_1WP8Q90_876Lqq25zfLlqGgtW_IuOJz1qAY Oct 04 18:37:44.031682 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:37:44.031682 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:37:44.031682 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:37:44.031682 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:37:44.031682 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:37:44.031682 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:37:44.031682 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: c3242afeef424d588cf102a2f0f38020 Oct 04 18:37:44.031682 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ServersTestMultiNic-1495387740 Oct 04 18:37:44.031682 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:37:44.031682 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:37:44.031682 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c3242afeef424d588cf102a2f0f38020"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c3242afeef424d588cf102a2f0f38020", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c3242afeef424d588cf102a2f0f38020"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c3242afeef424d588cf102a2f0f38020"}]}] Oct 04 18:37:44.031682 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ServersTestMultiNic-1495387740 Oct 04 18:37:44.031682 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: c3242afeef424d588cf102a2f0f38020 Oct 04 18:37:44.031682 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ServersTestMultiNic-1495387740 Oct 04 18:37:44.031682 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ServersTestMultiNic-1495387740-project Oct 04 18:37:44.031682 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:37:44.031682 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:37:44.031682 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: acb44381220d43b7bdfa744a1dc410a8 Oct 04 18:37:44.031682 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ServersTestMultiNic-1495387740-project Oct 04 18:37:44.031682 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:37:44.031682 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 616e21b9-c93b-4ff0-8740-24c613f4d708 could not be found. Oct 04 18:37:44.031682 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '616e21b9-c93b-4ff0-8740-24c613f4d708'} Oct 04 18:37:44.031682 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:37:44.031682 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:44.031682 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:37:44.031682 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:37:44.031682 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:37:44.031682 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:37:44.031682 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:37:44.031682 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:37:44.031682 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:37:44.031682 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:37:44.031682 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 616e21b9-c93b-4ff0-8740-24c613f4d708 could not be found. Oct 04 18:37:44.031682 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:37:44.031682 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:44.031682 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:37:44.031682 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:44.031682 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:44.031682 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:44.031682 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:37:44.031682 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:37:44.031682 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:37:44.031682 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:37:44.031682 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:37:44.031682 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:37:44.031682 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:37:44.031682 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:37:44.031682 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:37:44.031682 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:37:44.031682 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:37:44.031682 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:37:44.035698 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 616e21b9-c93b-4ff0-8740-24c613f4d708 could not be found. Oct 04 18:37:44.035698 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:37:44.035698 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:44.035698 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:37:44.035698 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:44.035698 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:44.035698 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:44.035698 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:37:44.035698 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:37:44.035698 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 616e21b9-c93b-4ff0-8740-24c613f4d708 could not be found. Oct 04 18:37:44.035698 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:37:44.035698 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7d5933d4-ba0f-47df-b062-9e7a4aa35f65 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Returning 404 to user: Instance 616e21b9-c93b-4ff0-8740-24c613f4d708 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:37:44.035698 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7d5933d4-ba0f-47df-b062-9e7a4aa35f65 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] 10.222.0.20 "DELETE /compute/v2.1/servers/616e21b9-c93b-4ff0-8740-24c613f4d708" status: 404 len: 111 microversion: 2.1 time: 0.068143 Oct 04 18:37:44.040396 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1182/2438] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:37:43 2022] DELETE /compute/v2.1/servers/616e21b9-c93b-4ff0-8740-24c613f4d708 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:37:44.046133 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ecaafa9f-3f98-48f6-96af-9c3b1b7c6452 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:44.049309 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ecaafa9f-3f98-48f6-96af-9c3b1b7c6452 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] [instance: 616e21b9-c93b-4ff0-8740-24c613f4d708] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:44.072453 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-566dbb38-5fbe-4906-94bd-c6219162bf91 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "POST /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5/action" status: 202 len: 0 microversion: 2.1 time: 0.501007 Oct 04 18:37:44.079774 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1257/2439] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:37:43 2022] POST /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5/action => generated 0 bytes in 509 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:37:44.091997 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ecaafa9f-3f98-48f6-96af-9c3b1b7c6452 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:44.093144 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ecaafa9f-3f98-48f6-96af-9c3b1b7c6452 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:44.093623 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ecaafa9f-3f98-48f6-96af-9c3b1b7c6452 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:44.094458 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ecaafa9f-3f98-48f6-96af-9c3b1b7c6452 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:44.095016 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ecaafa9f-3f98-48f6-96af-9c3b1b7c6452 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:44.096930 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-326bc7c2-7494-4f2a-9d9c-490e2939dfbf tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:44.097689 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ecaafa9f-3f98-48f6-96af-9c3b1b7c6452 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:44.100750 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-326bc7c2-7494-4f2a-9d9c-490e2939dfbf tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 61ec7cca-1572-496c-ba44-439f04c2a79c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:44.125719 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-326bc7c2-7494-4f2a-9d9c-490e2939dfbf tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:44.140972 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-326bc7c2-7494-4f2a-9d9c-490e2939dfbf tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:44.143968 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-326bc7c2-7494-4f2a-9d9c-490e2939dfbf tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:44.144882 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-326bc7c2-7494-4f2a-9d9c-490e2939dfbf tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:44.145459 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-326bc7c2-7494-4f2a-9d9c-490e2939dfbf tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:44.145997 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-326bc7c2-7494-4f2a-9d9c-490e2939dfbf tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:44.150857 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-ecaafa9f-3f98-48f6-96af-9c3b1b7c6452 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] HTTP exception thrown: Instance 616e21b9-c93b-4ff0-8740-24c613f4d708 could not be found. Oct 04 18:37:44.152696 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ecaafa9f-3f98-48f6-96af-9c3b1b7c6452 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Request method failure captured: Oct 04 18:37:44.152696 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/616e21b9-c93b-4ff0-8740-24c613f4d708 HTTP/1.1 Oct 04 18:37:44.152696 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:37:44.152696 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:37:44.152696 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:37:44.152696 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:37:44.152696 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:37:44.152696 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:37:44.152696 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:37:44.152696 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:37:44.152696 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPHzalpqmsewN2J61v1Y0qLDtlN2FHUi2_nWyZ1Q-vjMt_4gSQz5L13cLBjtmLCrnLRTB9GqNa_-hKs10nMk9Qvuv6OZyurGD386ZLOA5t161yDtVaKb0xp2inIdlbDXLtIUVom-9v7H_1WP8Q90_876Lqq25zfLlqGgtW_IuOJz1qAY Oct 04 18:37:44.152696 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:37:44.152696 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:37:44.152696 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:37:44.152696 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:37:44.152696 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:37:44.152696 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:37:44.152696 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: c3242afeef424d588cf102a2f0f38020 Oct 04 18:37:44.152696 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ServersTestMultiNic-1495387740 Oct 04 18:37:44.152696 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:37:44.152696 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:37:44.152696 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c3242afeef424d588cf102a2f0f38020"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c3242afeef424d588cf102a2f0f38020", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c3242afeef424d588cf102a2f0f38020"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c3242afeef424d588cf102a2f0f38020"}]}] Oct 04 18:37:44.152696 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ServersTestMultiNic-1495387740 Oct 04 18:37:44.152696 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: c3242afeef424d588cf102a2f0f38020 Oct 04 18:37:44.152696 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ServersTestMultiNic-1495387740 Oct 04 18:37:44.152696 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ServersTestMultiNic-1495387740-project Oct 04 18:37:44.152696 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:37:44.152696 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:37:44.152696 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: acb44381220d43b7bdfa744a1dc410a8 Oct 04 18:37:44.152696 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ServersTestMultiNic-1495387740-project Oct 04 18:37:44.152696 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:37:44.152696 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 616e21b9-c93b-4ff0-8740-24c613f4d708 could not be found. Oct 04 18:37:44.152696 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '616e21b9-c93b-4ff0-8740-24c613f4d708'} Oct 04 18:37:44.152696 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:37:44.152696 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:44.152696 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:37:44.152696 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:37:44.152696 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:37:44.152696 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:37:44.152696 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:37:44.152696 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:37:44.152696 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:37:44.152696 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:37:44.152696 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 616e21b9-c93b-4ff0-8740-24c613f4d708 could not be found. Oct 04 18:37:44.152696 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:37:44.152696 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:44.152696 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:37:44.152696 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:44.152696 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:44.152696 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:44.152696 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:37:44.152696 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:37:44.152696 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:37:44.152696 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:37:44.152696 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:37:44.152696 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:37:44.152696 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:37:44.152696 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:37:44.152696 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:37:44.152696 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:37:44.152696 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 616e21b9-c93b-4ff0-8740-24c613f4d708 could not be found. Oct 04 18:37:44.152696 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:37:44.152696 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:44.152696 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:37:44.158798 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:44.158798 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:44.158798 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:44.158798 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:37:44.158798 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:37:44.158798 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 616e21b9-c93b-4ff0-8740-24c613f4d708 could not be found. Oct 04 18:37:44.158798 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:37:44.158798 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ecaafa9f-3f98-48f6-96af-9c3b1b7c6452 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Returning 404 to user: Instance 616e21b9-c93b-4ff0-8740-24c613f4d708 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:37:44.160836 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ecaafa9f-3f98-48f6-96af-9c3b1b7c6452 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] 10.222.0.20 "GET /compute/v2.1/servers/616e21b9-c93b-4ff0-8740-24c613f4d708" status: 404 len: 111 microversion: 2.1 time: 0.119238 Oct 04 18:37:44.161909 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1183/2440] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:44 2022] GET /compute/v2.1/servers/616e21b9-c93b-4ff0-8740-24c613f4d708 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:37:44.166894 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6b9680c9-aff0-47cd-b9f0-98f2e3a35b4a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:44.167809 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6b9680c9-aff0-47cd-b9f0-98f2e3a35b4a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 474a799f-8e38-49d6-8fff-9ec3e7657ef5] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:44.175550 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6b9680c9-aff0-47cd-b9f0-98f2e3a35b4a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:44.176407 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6b9680c9-aff0-47cd-b9f0-98f2e3a35b4a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:44.177026 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6b9680c9-aff0-47cd-b9f0-98f2e3a35b4a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:44.178014 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6b9680c9-aff0-47cd-b9f0-98f2e3a35b4a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:44.178673 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6b9680c9-aff0-47cd-b9f0-98f2e3a35b4a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:44.179481 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6b9680c9-aff0-47cd-b9f0-98f2e3a35b4a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:44.489594 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-326bc7c2-7494-4f2a-9d9c-490e2939dfbf tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8284fe51decd4db0bf6b3ed1514cc2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87473abf47e74adf844e3ddfa24da3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:44.500489 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-326bc7c2-7494-4f2a-9d9c-490e2939dfbf tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] 10.222.0.20 "GET /compute/v2.1/servers/61ec7cca-1572-496c-ba44-439f04c2a79c" status: 200 len: 1505 microversion: 2.1 time: 0.418392 Oct 04 18:37:44.506449 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1258/2441] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:44 2022] GET /compute/v2.1/servers/61ec7cca-1572-496c-ba44-439f04c2a79c => generated 1505 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:44.511434 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7161cef0-e4b7-4833-8f5a-bcc61f41c41f tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:44.512587 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7161cef0-e4b7-4833-8f5a-bcc61f41c41f tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] [instance: 0bef06d7-ba85-4f48-bd08-228211391394] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:44.537641 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6b9680c9-aff0-47cd-b9f0-98f2e3a35b4a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:44.545057 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6b9680c9-aff0-47cd-b9f0-98f2e3a35b4a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5" status: 200 len: 1537 microversion: 2.1 time: 0.381778 Oct 04 18:37:44.558761 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7161cef0-e4b7-4833-8f5a-bcc61f41c41f tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:44.558761 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7161cef0-e4b7-4833-8f5a-bcc61f41c41f tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:44.558761 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7161cef0-e4b7-4833-8f5a-bcc61f41c41f tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:44.564776 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1184/2442] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:44 2022] GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5 => generated 1537 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:44.568419 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7161cef0-e4b7-4833-8f5a-bcc61f41c41f tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:44.568920 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7161cef0-e4b7-4833-8f5a-bcc61f41c41f tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:44.572497 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7161cef0-e4b7-4833-8f5a-bcc61f41c41f tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:44.584777 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-802c20bf-5d4f-43b8-9a7b-681ca1136113 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:44.585280 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-802c20bf-5d4f-43b8-9a7b-681ca1136113 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] [instance: 4fbde026-7d69-4924-97e6-28262d00e5db] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:44.606044 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-802c20bf-5d4f-43b8-9a7b-681ca1136113 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:44.606816 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-802c20bf-5d4f-43b8-9a7b-681ca1136113 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:44.607073 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-802c20bf-5d4f-43b8-9a7b-681ca1136113 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:44.607840 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-802c20bf-5d4f-43b8-9a7b-681ca1136113 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:44.612471 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-802c20bf-5d4f-43b8-9a7b-681ca1136113 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:44.612962 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-802c20bf-5d4f-43b8-9a7b-681ca1136113 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:44.663611 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-802c20bf-5d4f-43b8-9a7b-681ca1136113 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] HTTP exception thrown: Instance 4fbde026-7d69-4924-97e6-28262d00e5db could not be found. Oct 04 18:37:44.665191 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-802c20bf-5d4f-43b8-9a7b-681ca1136113 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Request method failure captured: Oct 04 18:37:44.665191 n-d-850501-14 devstack@n-api.service[123001]: request: DELETE /compute/v2.1/servers/4fbde026-7d69-4924-97e6-28262d00e5db HTTP/1.1 Oct 04 18:37:44.665191 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:37:44.665191 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:37:44.665191 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:37:44.665191 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:37:44.665191 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:37:44.665191 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:37:44.665191 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:37:44.665191 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:37:44.665191 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPHzalpqmsewN2J61v1Y0qLDtlN2FHUi2_nWyZ1Q-vjMt_4gSQz5L13cLBjtmLCrnLRTB9GqNa_-hKs10nMk9Qvuv6OZyurGD386ZLOA5t161yDtVaKb0xp2inIdlbDXLtIUVom-9v7H_1WP8Q90_876Lqq25zfLlqGgtW_IuOJz1qAY Oct 04 18:37:44.665191 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:37:44.665191 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:37:44.665191 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:37:44.665191 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:37:44.665191 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:37:44.665191 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:37:44.665191 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: c3242afeef424d588cf102a2f0f38020 Oct 04 18:37:44.665191 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ServersTestMultiNic-1495387740 Oct 04 18:37:44.665191 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:37:44.665191 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:37:44.665191 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c3242afeef424d588cf102a2f0f38020"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c3242afeef424d588cf102a2f0f38020", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c3242afeef424d588cf102a2f0f38020"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c3242afeef424d588cf102a2f0f38020"}]}] Oct 04 18:37:44.665191 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ServersTestMultiNic-1495387740 Oct 04 18:37:44.665191 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: c3242afeef424d588cf102a2f0f38020 Oct 04 18:37:44.665191 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ServersTestMultiNic-1495387740 Oct 04 18:37:44.665191 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ServersTestMultiNic-1495387740-project Oct 04 18:37:44.665191 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:37:44.665191 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:37:44.665191 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: acb44381220d43b7bdfa744a1dc410a8 Oct 04 18:37:44.665191 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ServersTestMultiNic-1495387740-project Oct 04 18:37:44.665191 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:37:44.665191 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 4fbde026-7d69-4924-97e6-28262d00e5db could not be found. Oct 04 18:37:44.665191 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '4fbde026-7d69-4924-97e6-28262d00e5db'} Oct 04 18:37:44.665191 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:37:44.665191 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:44.665191 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:37:44.665191 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:37:44.665191 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:37:44.665191 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:37:44.665191 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:37:44.665191 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:37:44.665191 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:37:44.665191 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:37:44.665191 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fbde026-7d69-4924-97e6-28262d00e5db could not be found. Oct 04 18:37:44.665191 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:37:44.665191 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:44.665191 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:37:44.665191 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:44.665191 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:44.665191 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:44.665191 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:37:44.665191 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:37:44.665191 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:37:44.665191 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:37:44.665191 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:37:44.665191 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:37:44.665191 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:37:44.665191 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:37:44.665191 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:37:44.665191 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:37:44.665191 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:37:44.665191 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:37:44.669422 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fbde026-7d69-4924-97e6-28262d00e5db could not be found. Oct 04 18:37:44.669422 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:37:44.669422 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:44.669422 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:37:44.669422 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:44.669422 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:44.669422 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:44.669422 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:37:44.669422 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:37:44.669422 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fbde026-7d69-4924-97e6-28262d00e5db could not be found. Oct 04 18:37:44.669422 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:37:44.670278 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-802c20bf-5d4f-43b8-9a7b-681ca1136113 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Returning 404 to user: Instance 4fbde026-7d69-4924-97e6-28262d00e5db could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:37:44.670688 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-802c20bf-5d4f-43b8-9a7b-681ca1136113 tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4fbde026-7d69-4924-97e6-28262d00e5db" status: 404 len: 111 microversion: 2.1 time: 0.104811 Oct 04 18:37:44.671251 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1185/2443] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:37:44 2022] DELETE /compute/v2.1/servers/4fbde026-7d69-4924-97e6-28262d00e5db => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:37:44.678200 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-102ff961-9dbc-4650-be23-287ac0f8370c tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:44.682713 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-102ff961-9dbc-4650-be23-287ac0f8370c tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: cd74aff9-f694-49f3-a1cc-2095b71cd9e5] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:44.706208 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-102ff961-9dbc-4650-be23-287ac0f8370c tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:44.709930 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-102ff961-9dbc-4650-be23-287ac0f8370c tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:44.732958 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-102ff961-9dbc-4650-be23-287ac0f8370c tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:44.733733 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-102ff961-9dbc-4650-be23-287ac0f8370c tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:44.734401 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-102ff961-9dbc-4650-be23-287ac0f8370c tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:44.734985 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-102ff961-9dbc-4650-be23-287ac0f8370c tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:44.754428 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7161cef0-e4b7-4833-8f5a-bcc61f41c41f tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:44.772685 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7161cef0-e4b7-4833-8f5a-bcc61f41c41f tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:44.774379 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7161cef0-e4b7-4833-8f5a-bcc61f41c41f tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:44.776456 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7161cef0-e4b7-4833-8f5a-bcc61f41c41f tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] 10.222.0.20 "GET /compute/v2.1/servers/0bef06d7-ba85-4f48-bd08-228211391394" status: 200 len: 1366 microversion: 2.57 time: 0.268803 Oct 04 18:37:44.779496 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1259/2444] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:44 2022] GET /compute/v2.1/servers/0bef06d7-ba85-4f48-bd08-228211391394 => generated 1366 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:37:44.799198 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2f5aec52-ff18-4f10-935a-bf792d93091d tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:44.803477 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2f5aec52-ff18-4f10-935a-bf792d93091d tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] [instance: 4fbde026-7d69-4924-97e6-28262d00e5db] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:44.814974 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2f5aec52-ff18-4f10-935a-bf792d93091d tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:44.818544 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2f5aec52-ff18-4f10-935a-bf792d93091d tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:44.818991 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2f5aec52-ff18-4f10-935a-bf792d93091d tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:44.820153 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2f5aec52-ff18-4f10-935a-bf792d93091d tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:44.833796 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2f5aec52-ff18-4f10-935a-bf792d93091d tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:44.834704 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2f5aec52-ff18-4f10-935a-bf792d93091d tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:44.892220 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-2f5aec52-ff18-4f10-935a-bf792d93091d tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] HTTP exception thrown: Instance 4fbde026-7d69-4924-97e6-28262d00e5db could not be found. Oct 04 18:37:44.893886 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2f5aec52-ff18-4f10-935a-bf792d93091d tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Request method failure captured: Oct 04 18:37:44.893886 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/4fbde026-7d69-4924-97e6-28262d00e5db HTTP/1.1 Oct 04 18:37:44.893886 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:37:44.893886 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:37:44.893886 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:37:44.893886 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:37:44.893886 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:37:44.893886 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:37:44.893886 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:37:44.893886 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:37:44.893886 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPHzalpqmsewN2J61v1Y0qLDtlN2FHUi2_nWyZ1Q-vjMt_4gSQz5L13cLBjtmLCrnLRTB9GqNa_-hKs10nMk9Qvuv6OZyurGD386ZLOA5t161yDtVaKb0xp2inIdlbDXLtIUVom-9v7H_1WP8Q90_876Lqq25zfLlqGgtW_IuOJz1qAY Oct 04 18:37:44.893886 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:37:44.893886 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:37:44.893886 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:37:44.893886 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:37:44.893886 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:37:44.893886 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:37:44.893886 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: c3242afeef424d588cf102a2f0f38020 Oct 04 18:37:44.893886 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServersTestMultiNic-1495387740 Oct 04 18:37:44.893886 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:37:44.893886 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:37:44.893886 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c3242afeef424d588cf102a2f0f38020"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c3242afeef424d588cf102a2f0f38020", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c3242afeef424d588cf102a2f0f38020"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c3242afeef424d588cf102a2f0f38020"}]}] Oct 04 18:37:44.893886 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServersTestMultiNic-1495387740 Oct 04 18:37:44.893886 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: c3242afeef424d588cf102a2f0f38020 Oct 04 18:37:44.893886 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServersTestMultiNic-1495387740 Oct 04 18:37:44.893886 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServersTestMultiNic-1495387740-project Oct 04 18:37:44.893886 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:37:44.893886 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:37:44.893886 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: acb44381220d43b7bdfa744a1dc410a8 Oct 04 18:37:44.893886 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServersTestMultiNic-1495387740-project Oct 04 18:37:44.893886 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:37:44.893886 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 4fbde026-7d69-4924-97e6-28262d00e5db could not be found. Oct 04 18:37:44.893886 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '4fbde026-7d69-4924-97e6-28262d00e5db'} Oct 04 18:37:44.893886 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:37:44.893886 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:44.893886 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:37:44.893886 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:37:44.893886 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:37:44.893886 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:37:44.893886 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:37:44.893886 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:37:44.893886 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:37:44.893886 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:37:44.893886 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fbde026-7d69-4924-97e6-28262d00e5db could not be found. Oct 04 18:37:44.893886 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:37:44.893886 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:44.893886 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:37:44.893886 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:44.893886 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:44.893886 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:44.893886 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:37:44.893886 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:37:44.893886 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:37:44.893886 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:37:44.893886 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:37:44.893886 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:37:44.893886 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:37:44.893886 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:37:44.893886 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:37:44.893886 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:37:44.893886 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fbde026-7d69-4924-97e6-28262d00e5db could not be found. Oct 04 18:37:44.893886 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:37:44.893886 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:44.893886 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:37:44.915954 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:44.915954 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:44.915954 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:44.915954 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:37:44.915954 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:37:44.915954 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fbde026-7d69-4924-97e6-28262d00e5db could not be found. Oct 04 18:37:44.915954 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:37:44.915954 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2f5aec52-ff18-4f10-935a-bf792d93091d tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] Returning 404 to user: Instance 4fbde026-7d69-4924-97e6-28262d00e5db could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:37:44.915954 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2f5aec52-ff18-4f10-935a-bf792d93091d tempest-ServersTestMultiNic-1495387740 tempest-ServersTestMultiNic-1495387740-project] 10.222.0.20 "GET /compute/v2.1/servers/4fbde026-7d69-4924-97e6-28262d00e5db" status: 404 len: 111 microversion: 2.1 time: 0.114648 Oct 04 18:37:44.917067 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-102ff961-9dbc-4650-be23-287ac0f8370c tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:44.917067 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-102ff961-9dbc-4650-be23-287ac0f8370c tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:44.917067 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-102ff961-9dbc-4650-be23-287ac0f8370c tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:44.917986 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1260/2445] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:44 2022] GET /compute/v2.1/servers/4fbde026-7d69-4924-97e6-28262d00e5db => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:37:44.929330 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-102ff961-9dbc-4650-be23-287ac0f8370c tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5" status: 200 len: 1266 microversion: 2.25 time: 0.257025 Oct 04 18:37:44.931816 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a439dafa-f4ea-4969-8796-15d432df1d74 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:44.932737 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a439dafa-f4ea-4969-8796-15d432df1d74 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 98dfffc8-51aa-407a-a374-8e120ec43a31] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:44.933146 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1186/2446] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:44 2022] GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5 => generated 1266 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:37:44.946141 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a439dafa-f4ea-4969-8796-15d432df1d74 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:44.948697 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a439dafa-f4ea-4969-8796-15d432df1d74 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:44.949322 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a439dafa-f4ea-4969-8796-15d432df1d74 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:44.952812 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a439dafa-f4ea-4969-8796-15d432df1d74 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:44.956647 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a439dafa-f4ea-4969-8796-15d432df1d74 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:44.960658 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a439dafa-f4ea-4969-8796-15d432df1d74 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:45.250599 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a439dafa-f4ea-4969-8796-15d432df1d74 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:45.250599 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a439dafa-f4ea-4969-8796-15d432df1d74 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31" status: 200 len: 1392 microversion: 2.1 time: 0.297298 Oct 04 18:37:45.250599 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1261/2447] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:44 2022] GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31 => generated 1392 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:45.530167 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-15ca59cb-a92b-4356-b794-60493dfdb400 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:45.530985 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-15ca59cb-a92b-4356-b794-60493dfdb400 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 61ec7cca-1572-496c-ba44-439f04c2a79c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:45.540197 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-15ca59cb-a92b-4356-b794-60493dfdb400 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:45.545493 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-15ca59cb-a92b-4356-b794-60493dfdb400 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:45.546225 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-15ca59cb-a92b-4356-b794-60493dfdb400 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:45.546769 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-15ca59cb-a92b-4356-b794-60493dfdb400 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:45.548438 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-15ca59cb-a92b-4356-b794-60493dfdb400 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:45.549061 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-15ca59cb-a92b-4356-b794-60493dfdb400 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:45.579866 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d9a989ad-c1c1-4a3d-a54f-d2c9de04e511 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:45.580852 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d9a989ad-c1c1-4a3d-a54f-d2c9de04e511 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 474a799f-8e38-49d6-8fff-9ec3e7657ef5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:45.595503 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d9a989ad-c1c1-4a3d-a54f-d2c9de04e511 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:45.596008 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d9a989ad-c1c1-4a3d-a54f-d2c9de04e511 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:45.608427 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d9a989ad-c1c1-4a3d-a54f-d2c9de04e511 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:45.609113 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d9a989ad-c1c1-4a3d-a54f-d2c9de04e511 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:45.611382 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d9a989ad-c1c1-4a3d-a54f-d2c9de04e511 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:45.611786 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d9a989ad-c1c1-4a3d-a54f-d2c9de04e511 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:46.036436 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-15ca59cb-a92b-4356-b794-60493dfdb400 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8284fe51decd4db0bf6b3ed1514cc2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87473abf47e74adf844e3ddfa24da3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:46.049035 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-15ca59cb-a92b-4356-b794-60493dfdb400 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] 10.222.0.20 "GET /compute/v2.1/servers/61ec7cca-1572-496c-ba44-439f04c2a79c" status: 200 len: 1505 microversion: 2.1 time: 0.522647 Oct 04 18:37:46.051274 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1187/2448] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:45 2022] GET /compute/v2.1/servers/61ec7cca-1572-496c-ba44-439f04c2a79c => generated 1505 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:46.058837 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-76b37f5c-ae8c-4006-9123-1fdf78d19bce tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:46.060948 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-76b37f5c-ae8c-4006-9123-1fdf78d19bce tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] [instance: 0bef06d7-ba85-4f48-bd08-228211391394] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:46.075069 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-76b37f5c-ae8c-4006-9123-1fdf78d19bce tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:46.076666 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-76b37f5c-ae8c-4006-9123-1fdf78d19bce tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:46.082199 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d9a989ad-c1c1-4a3d-a54f-d2c9de04e511 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:46.082471 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-76b37f5c-ae8c-4006-9123-1fdf78d19bce tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:46.082471 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-76b37f5c-ae8c-4006-9123-1fdf78d19bce tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:46.085913 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-76b37f5c-ae8c-4006-9123-1fdf78d19bce tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:46.086650 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-76b37f5c-ae8c-4006-9123-1fdf78d19bce tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:46.088562 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d9a989ad-c1c1-4a3d-a54f-d2c9de04e511 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5" status: 200 len: 1537 microversion: 2.1 time: 0.520239 Oct 04 18:37:46.089141 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1262/2449] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:45 2022] GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5 => generated 1537 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:37:46.205163 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-76b37f5c-ae8c-4006-9123-1fdf78d19bce tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:46.221425 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-76b37f5c-ae8c-4006-9123-1fdf78d19bce tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:46.223201 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-76b37f5c-ae8c-4006-9123-1fdf78d19bce tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:46.226093 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-76b37f5c-ae8c-4006-9123-1fdf78d19bce tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] 10.222.0.20 "GET /compute/v2.1/servers/0bef06d7-ba85-4f48-bd08-228211391394" status: 200 len: 1366 microversion: 2.57 time: 0.173649 Oct 04 18:37:46.236890 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1188/2450] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:46 2022] GET /compute/v2.1/servers/0bef06d7-ba85-4f48-bd08-228211391394 => generated 1366 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:37:46.248644 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-33fca50a-63aa-4686-a08a-2c76473eaf29 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:46.249504 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-33fca50a-63aa-4686-a08a-2c76473eaf29 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: cd74aff9-f694-49f3-a1cc-2095b71cd9e5] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:46.256385 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-33fca50a-63aa-4686-a08a-2c76473eaf29 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:46.260510 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-33fca50a-63aa-4686-a08a-2c76473eaf29 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:46.260510 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-33fca50a-63aa-4686-a08a-2c76473eaf29 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:46.260510 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-33fca50a-63aa-4686-a08a-2c76473eaf29 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:46.260510 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-33fca50a-63aa-4686-a08a-2c76473eaf29 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:46.260510 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-33fca50a-63aa-4686-a08a-2c76473eaf29 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:46.301857 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-33fca50a-63aa-4686-a08a-2c76473eaf29 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:46.303144 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-33fca50a-63aa-4686-a08a-2c76473eaf29 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:46.303745 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-33fca50a-63aa-4686-a08a-2c76473eaf29 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:46.304738 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-33fca50a-63aa-4686-a08a-2c76473eaf29 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lazy-loading 'fault' on Instance uuid cd74aff9-f694-49f3-a1cc-2095b71cd9e5 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:37:46.326893 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7e50d26f-152d-4eb8-9a76-a9510f7f833e tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Action: 'create', calling method: .version_select at 0x7fe25891c0d0>, body: {"keypair": {"name": "tempest-keypair-869337610", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB60wc/lJR2DbN/wO0vzPnGzTAOiV5SUkigtQY6TJMHNa24BbFp+TlmhfQGbJ+KhZWREG3bEDZxjNQ6BlsmTJDzqwOaAw7UOnrTo4KRRwIzCAsXgdQqQ3NeXIJqXt4sTzA=="}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:46.361194 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-7e50d26f-152d-4eb8-9a76-a9510f7f833e tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Getting quotas for project 9174b09e32064811a61539c64992ee50. Resources: {'key_pairs'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:37:46.371377 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-7e50d26f-152d-4eb8-9a76-a9510f7f833e tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Getting quotas for user c73127bc6636476482e280eddad7f66c and project 9174b09e32064811a61539c64992ee50. Resources: {'key_pairs'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:37:46.383099 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-33fca50a-63aa-4686-a08a-2c76473eaf29 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:46.398912 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-33fca50a-63aa-4686-a08a-2c76473eaf29 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:46.402418 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-33fca50a-63aa-4686-a08a-2c76473eaf29 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:46.409010 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-33fca50a-63aa-4686-a08a-2c76473eaf29 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5" status: 200 len: 1271 microversion: 2.25 time: 0.170613 Oct 04 18:37:46.424155 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1189/2451] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:46 2022] GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5 => generated 1271 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:37:46.429191 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7fd5adfb-91bf-4956-baca-61eb384cb319 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:46.430286 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7fd5adfb-91bf-4956-baca-61eb384cb319 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 98dfffc8-51aa-407a-a374-8e120ec43a31] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:46.439460 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7fd5adfb-91bf-4956-baca-61eb384cb319 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:46.440416 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7fd5adfb-91bf-4956-baca-61eb384cb319 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:46.441045 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7fd5adfb-91bf-4956-baca-61eb384cb319 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:46.442410 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7fd5adfb-91bf-4956-baca-61eb384cb319 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:46.442974 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7fd5adfb-91bf-4956-baca-61eb384cb319 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:46.443631 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7fd5adfb-91bf-4956-baca-61eb384cb319 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:46.489571 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7e50d26f-152d-4eb8-9a76-a9510f7f833e tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.399345 Oct 04 18:37:46.490665 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1263/2452] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Oct 4 18:37:46 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:46.867613 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7fd5adfb-91bf-4956-baca-61eb384cb319 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:46.891749 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7fd5adfb-91bf-4956-baca-61eb384cb319 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31" status: 200 len: 1392 microversion: 2.1 time: 0.476946 Oct 04 18:37:46.897222 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1190/2453] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:46 2022] GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31 => generated 1392 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:47.078793 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-db1ea2d8-fcf6-4636-a05b-4bfcabb57fbf tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:47.079573 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-db1ea2d8-fcf6-4636-a05b-4bfcabb57fbf tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 61ec7cca-1572-496c-ba44-439f04c2a79c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:47.096712 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-db1ea2d8-fcf6-4636-a05b-4bfcabb57fbf tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:47.097712 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-db1ea2d8-fcf6-4636-a05b-4bfcabb57fbf tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:47.103158 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-db1ea2d8-fcf6-4636-a05b-4bfcabb57fbf tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:47.106021 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-db1ea2d8-fcf6-4636-a05b-4bfcabb57fbf tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:47.106983 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-db1ea2d8-fcf6-4636-a05b-4bfcabb57fbf tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:47.108642 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-db1ea2d8-fcf6-4636-a05b-4bfcabb57fbf tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:47.120566 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-233fc6ac-db65-4618-9507-c235ffda3fa5 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:47.121177 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-233fc6ac-db65-4618-9507-c235ffda3fa5 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 474a799f-8e38-49d6-8fff-9ec3e7657ef5] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:47.145272 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-233fc6ac-db65-4618-9507-c235ffda3fa5 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:47.148398 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-233fc6ac-db65-4618-9507-c235ffda3fa5 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:47.148957 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-233fc6ac-db65-4618-9507-c235ffda3fa5 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:47.149700 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-233fc6ac-db65-4618-9507-c235ffda3fa5 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:47.150378 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-233fc6ac-db65-4618-9507-c235ffda3fa5 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:47.150826 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-233fc6ac-db65-4618-9507-c235ffda3fa5 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:47.925300 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-db1ea2d8-fcf6-4636-a05b-4bfcabb57fbf tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8284fe51decd4db0bf6b3ed1514cc2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87473abf47e74adf844e3ddfa24da3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:47.936690 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-db1ea2d8-fcf6-4636-a05b-4bfcabb57fbf tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] 10.222.0.20 "GET /compute/v2.1/servers/61ec7cca-1572-496c-ba44-439f04c2a79c" status: 200 len: 1505 microversion: 2.1 time: 0.864381 Oct 04 18:37:47.960275 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1264/2454] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:47 2022] GET /compute/v2.1/servers/61ec7cca-1572-496c-ba44-439f04c2a79c => generated 1505 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:47.975876 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-abeaaae0-435a-464f-b67f-d88d98bbf161 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:47.978087 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-abeaaae0-435a-464f-b67f-d88d98bbf161 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] [instance: 0bef06d7-ba85-4f48-bd08-228211391394] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:47.987837 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-abeaaae0-435a-464f-b67f-d88d98bbf161 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:47.988853 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-abeaaae0-435a-464f-b67f-d88d98bbf161 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:47.989493 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-abeaaae0-435a-464f-b67f-d88d98bbf161 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:47.992707 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-abeaaae0-435a-464f-b67f-d88d98bbf161 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:47.993532 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-abeaaae0-435a-464f-b67f-d88d98bbf161 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:47.999932 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-abeaaae0-435a-464f-b67f-d88d98bbf161 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:48.121824 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-233fc6ac-db65-4618-9507-c235ffda3fa5 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:48.123319 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-abeaaae0-435a-464f-b67f-d88d98bbf161 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:48.135573 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-abeaaae0-435a-464f-b67f-d88d98bbf161 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:48.137949 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-abeaaae0-435a-464f-b67f-d88d98bbf161 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:48.139291 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-233fc6ac-db65-4618-9507-c235ffda3fa5 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5" status: 200 len: 1537 microversion: 2.1 time: 1.022715 Oct 04 18:37:48.139504 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-abeaaae0-435a-464f-b67f-d88d98bbf161 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] 10.222.0.20 "GET /compute/v2.1/servers/0bef06d7-ba85-4f48-bd08-228211391394" status: 200 len: 1366 microversion: 2.57 time: 0.177034 Oct 04 18:37:48.139886 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1191/2455] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:47 2022] GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5 => generated 1537 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:48.154408 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1265/2456] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:47 2022] GET /compute/v2.1/servers/0bef06d7-ba85-4f48-bd08-228211391394 => generated 1366 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:37:48.158305 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2464d37c-8b9d-4a4a-ae41-621912dd3206 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:48.159093 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2464d37c-8b9d-4a4a-ae41-621912dd3206 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: cd74aff9-f694-49f3-a1cc-2095b71cd9e5] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:48.164313 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0334b7fc-cd9c-48e1-b39f-bdf2ad9ebed6 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:48.165750 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0334b7fc-cd9c-48e1-b39f-bdf2ad9ebed6 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 98dfffc8-51aa-407a-a374-8e120ec43a31] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:48.173990 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0334b7fc-cd9c-48e1-b39f-bdf2ad9ebed6 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:48.174838 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0334b7fc-cd9c-48e1-b39f-bdf2ad9ebed6 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:48.175470 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0334b7fc-cd9c-48e1-b39f-bdf2ad9ebed6 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:48.176545 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0334b7fc-cd9c-48e1-b39f-bdf2ad9ebed6 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:48.177256 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0334b7fc-cd9c-48e1-b39f-bdf2ad9ebed6 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:48.177893 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0334b7fc-cd9c-48e1-b39f-bdf2ad9ebed6 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:48.183072 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2464d37c-8b9d-4a4a-ae41-621912dd3206 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:48.183953 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2464d37c-8b9d-4a4a-ae41-621912dd3206 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:48.184437 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2464d37c-8b9d-4a4a-ae41-621912dd3206 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:48.188620 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2464d37c-8b9d-4a4a-ae41-621912dd3206 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:48.189107 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2464d37c-8b9d-4a4a-ae41-621912dd3206 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:48.189540 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2464d37c-8b9d-4a4a-ae41-621912dd3206 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:48.232510 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-2464d37c-8b9d-4a4a-ae41-621912dd3206 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] HTTP exception thrown: Instance cd74aff9-f694-49f3-a1cc-2095b71cd9e5 could not be found. Oct 04 18:37:48.234155 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2464d37c-8b9d-4a4a-ae41-621912dd3206 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Request method failure captured: Oct 04 18:37:48.234155 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5 HTTP/1.1 Oct 04 18:37:48.234155 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:37:48.234155 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:37:48.234155 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:37:48.234155 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:37:48.234155 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:37:48.234155 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:37:48.234155 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:37:48.234155 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:37:48.234155 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPHup0Mt_OyDwnruja4S1gmdmaCVMO4uXecUyp2F0Y8-1G2eggJOcOg62Ru7-OxnxnTV3tLeieUdQsjcRftin5u12YtjniY2GtodDByQDpmATG8MPRb-XNcR4e8kX0gQWaLrGaVgyqdxnogKK8Swq664D-K5SgTZfp2H1qk6W31Bqe5k Oct 04 18:37:48.234155 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:37:48.234155 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:37:48.234155 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:37:48.234155 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:37:48.234155 n-d-850501-14 devstack@n-api.service[123001]: X-Openstack-Nova-Api-Version: 2.25 Oct 04 18:37:48.234155 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:37:48.234155 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:37:48.234155 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 1fdde079f17642c69fb250c78903d69c Oct 04 18:37:48.234155 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-842433930 Oct 04 18:37:48.234155 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:37:48.234155 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:37:48.234155 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1fdde079f17642c69fb250c78903d69c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1fdde079f17642c69fb250c78903d69c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1fdde079f17642c69fb250c78903d69c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1fdde079f17642c69fb250c78903d69c"}]}] Oct 04 18:37:48.234155 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-842433930 Oct 04 18:37:48.234155 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 1fdde079f17642c69fb250c78903d69c Oct 04 18:37:48.234155 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-842433930 Oct 04 18:37:48.234155 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-LiveAutoBlockMigrationV225Test-842433930-project Oct 04 18:37:48.234155 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:37:48.234155 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:37:48.234155 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: f1dec45626f44157a6f4637e668097b4 Oct 04 18:37:48.234155 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-842433930-project Oct 04 18:37:48.234155 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:37:48.234155 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance cd74aff9-f694-49f3-a1cc-2095b71cd9e5 could not be found. Oct 04 18:37:48.234155 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': 'cd74aff9-f694-49f3-a1cc-2095b71cd9e5'} Oct 04 18:37:48.234155 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:37:48.234155 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:48.234155 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:37:48.234155 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:37:48.234155 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:37:48.234155 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:37:48.234155 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:37:48.234155 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:37:48.234155 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:37:48.234155 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:37:48.234155 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd74aff9-f694-49f3-a1cc-2095b71cd9e5 could not be found. Oct 04 18:37:48.234155 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:37:48.234155 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:48.234155 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:37:48.234155 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:48.234155 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:48.234155 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:48.234155 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:37:48.234155 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:37:48.234155 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:37:48.234155 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:37:48.234155 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:37:48.234155 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:37:48.234155 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:37:48.234155 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:37:48.234155 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:37:48.234155 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:37:48.234155 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd74aff9-f694-49f3-a1cc-2095b71cd9e5 could not be found. Oct 04 18:37:48.234155 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:37:48.237908 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:48.237908 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:37:48.237908 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:48.237908 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:48.237908 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:48.237908 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:37:48.237908 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:37:48.237908 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd74aff9-f694-49f3-a1cc-2095b71cd9e5 could not be found. Oct 04 18:37:48.237908 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:37:48.237908 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2464d37c-8b9d-4a4a-ae41-621912dd3206 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Returning 404 to user: Instance cd74aff9-f694-49f3-a1cc-2095b71cd9e5 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:37:48.237908 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2464d37c-8b9d-4a4a-ae41-621912dd3206 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5" status: 404 len: 111 microversion: 2.25 time: 0.093244 Oct 04 18:37:48.245340 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1192/2457] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:48 2022] GET /compute/v2.1/servers/cd74aff9-f694-49f3-a1cc-2095b71cd9e5 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:37:48.433926 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0334b7fc-cd9c-48e1-b39f-bdf2ad9ebed6 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:48.447532 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0334b7fc-cd9c-48e1-b39f-bdf2ad9ebed6 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31" status: 200 len: 1392 microversion: 2.1 time: 0.291933 Oct 04 18:37:48.448915 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1266/2458] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:48 2022] GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31 => generated 1392 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:48.963476 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e0cbbf8f-e4c0-42bf-b731-4d1ddb1ce1cb tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:48.964178 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e0cbbf8f-e4c0-42bf-b731-4d1ddb1ce1cb tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 61ec7cca-1572-496c-ba44-439f04c2a79c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:48.971989 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e0cbbf8f-e4c0-42bf-b731-4d1ddb1ce1cb tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:48.972507 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e0cbbf8f-e4c0-42bf-b731-4d1ddb1ce1cb tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:48.972942 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e0cbbf8f-e4c0-42bf-b731-4d1ddb1ce1cb tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:48.977951 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e0cbbf8f-e4c0-42bf-b731-4d1ddb1ce1cb tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:48.977951 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e0cbbf8f-e4c0-42bf-b731-4d1ddb1ce1cb tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:48.977951 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e0cbbf8f-e4c0-42bf-b731-4d1ddb1ce1cb tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:49.190910 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-06a6c0ed-c384-4e15-94cc-baf1ceb2ea68 tempest-ListImagesTestJSON-1971968031 tempest-ListImagesTestJSON-1971968031-project] Calling method '.version_select at 0x7fe258bd8a60>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:49.268409 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-06a6c0ed-c384-4e15-94cc-baf1ceb2ea68 tempest-ListImagesTestJSON-1971968031 tempest-ListImagesTestJSON-1971968031-project] 10.222.0.20 "GET /compute/v2.1/images/f545e662-10b3-46b1-88bb-6e66dd294559" status: 200 len: 784 microversion: 2.1 time: 0.320166 Oct 04 18:37:49.269279 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1193/2459] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:37:48 2022] GET /compute/v2.1/images/f545e662-10b3-46b1-88bb-6e66dd294559 => generated 784 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:49.286540 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d2469f25-bc33-4ec8-93ec-bfd7e8e93690 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:49.293700 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d2469f25-bc33-4ec8-93ec-bfd7e8e93690 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 474a799f-8e38-49d6-8fff-9ec3e7657ef5] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:49.302038 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d2469f25-bc33-4ec8-93ec-bfd7e8e93690 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:49.302826 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d2469f25-bc33-4ec8-93ec-bfd7e8e93690 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:49.303464 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d2469f25-bc33-4ec8-93ec-bfd7e8e93690 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:49.304487 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d2469f25-bc33-4ec8-93ec-bfd7e8e93690 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:49.305108 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d2469f25-bc33-4ec8-93ec-bfd7e8e93690 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:49.306139 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d2469f25-bc33-4ec8-93ec-bfd7e8e93690 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:49.349132 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e0cbbf8f-e4c0-42bf-b731-4d1ddb1ce1cb tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8284fe51decd4db0bf6b3ed1514cc2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87473abf47e74adf844e3ddfa24da3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:49.359610 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e0cbbf8f-e4c0-42bf-b731-4d1ddb1ce1cb tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] 10.222.0.20 "GET /compute/v2.1/servers/61ec7cca-1572-496c-ba44-439f04c2a79c" status: 200 len: 1505 microversion: 2.1 time: 0.399726 Oct 04 18:37:49.360267 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1267/2460] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:48 2022] GET /compute/v2.1/servers/61ec7cca-1572-496c-ba44-439f04c2a79c => generated 1505 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:49.367535 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ed73605f-7f90-4145-a8da-2c21e9410fec tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:49.368380 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ed73605f-7f90-4145-a8da-2c21e9410fec tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] [instance: 0bef06d7-ba85-4f48-bd08-228211391394] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:49.386776 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ed73605f-7f90-4145-a8da-2c21e9410fec tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:49.387296 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ed73605f-7f90-4145-a8da-2c21e9410fec tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:49.393475 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ed73605f-7f90-4145-a8da-2c21e9410fec tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:49.399572 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ed73605f-7f90-4145-a8da-2c21e9410fec tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:49.399572 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ed73605f-7f90-4145-a8da-2c21e9410fec tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:49.399572 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ed73605f-7f90-4145-a8da-2c21e9410fec tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:49.590646 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ed73605f-7f90-4145-a8da-2c21e9410fec tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:49.614571 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ed73605f-7f90-4145-a8da-2c21e9410fec tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:49.617456 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ed73605f-7f90-4145-a8da-2c21e9410fec tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:49.618731 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ed73605f-7f90-4145-a8da-2c21e9410fec tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] 10.222.0.20 "GET /compute/v2.1/servers/0bef06d7-ba85-4f48-bd08-228211391394" status: 200 len: 1366 microversion: 2.57 time: 0.257525 Oct 04 18:37:49.619302 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1268/2461] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:49 2022] GET /compute/v2.1/servers/0bef06d7-ba85-4f48-bd08-228211391394 => generated 1366 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:37:49.624764 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-78aefdbd-3058-4e78-a346-aab19a825b17 tempest-ListImagesTestJSON-1971968031 tempest-ListImagesTestJSON-1971968031-project] Calling method '.version_select at 0x7fe258bb6940>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:49.681975 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d2469f25-bc33-4ec8-93ec-bfd7e8e93690 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:49.690534 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d2469f25-bc33-4ec8-93ec-bfd7e8e93690 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5" status: 200 len: 1537 microversion: 2.1 time: 0.409275 Oct 04 18:37:49.691442 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1194/2462] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:49 2022] GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5 => generated 1537 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:49.699565 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a100f725-2b29-43ac-8cc5-6c7a6bea250f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:49.699565 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a100f725-2b29-43ac-8cc5-6c7a6bea250f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 98dfffc8-51aa-407a-a374-8e120ec43a31] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:49.718675 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a100f725-2b29-43ac-8cc5-6c7a6bea250f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:49.719292 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a100f725-2b29-43ac-8cc5-6c7a6bea250f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:49.722663 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a100f725-2b29-43ac-8cc5-6c7a6bea250f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:49.724321 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a100f725-2b29-43ac-8cc5-6c7a6bea250f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:49.724955 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a100f725-2b29-43ac-8cc5-6c7a6bea250f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:49.728263 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a100f725-2b29-43ac-8cc5-6c7a6bea250f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:49.777405 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-78aefdbd-3058-4e78-a346-aab19a825b17 tempest-ListImagesTestJSON-1971968031 tempest-ListImagesTestJSON-1971968031-project] 10.222.0.20 "GET /compute/v2.1/images" status: 200 len: 871 microversion: 2.1 time: 0.156860 Oct 04 18:37:49.778281 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1269/2463] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Oct 4 18:37:49 2022] GET /compute/v2.1/images => generated 871 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:49.797826 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-855f4c9b-6a2b-4313-a813-366359dbf9cc tempest-ListImagesTestJSON-1971968031 tempest-ListImagesTestJSON-1971968031-project] Calling method '.version_select at 0x7fe25d19f8b0>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:49.898974 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-855f4c9b-6a2b-4313-a813-366359dbf9cc tempest-ListImagesTestJSON-1971968031 tempest-ListImagesTestJSON-1971968031-project] 10.222.0.20 "GET /compute/v2.1/images/detail" status: 200 len: 1475 microversion: 2.1 time: 0.109513 Oct 04 18:37:49.899960 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1270/2464] 10.222.0.20 () {58 vars in 1143 bytes} [Tue Oct 4 18:37:49 2022] GET /compute/v2.1/images/detail => generated 1475 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:37:50.098427 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a100f725-2b29-43ac-8cc5-6c7a6bea250f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:50.108875 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a100f725-2b29-43ac-8cc5-6c7a6bea250f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31" status: 200 len: 1392 microversion: 2.1 time: 0.416120 Oct 04 18:37:50.110250 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1195/2465] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:49 2022] GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31 => generated 1392 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:50.388028 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c0bc0468-084b-41fa-a0bc-df8084101c76 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:50.389755 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c0bc0468-084b-41fa-a0bc-df8084101c76 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 61ec7cca-1572-496c-ba44-439f04c2a79c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:50.399145 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c0bc0468-084b-41fa-a0bc-df8084101c76 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:50.404298 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c0bc0468-084b-41fa-a0bc-df8084101c76 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:50.404298 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c0bc0468-084b-41fa-a0bc-df8084101c76 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:50.404298 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c0bc0468-084b-41fa-a0bc-df8084101c76 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:50.404298 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c0bc0468-084b-41fa-a0bc-df8084101c76 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:50.404298 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c0bc0468-084b-41fa-a0bc-df8084101c76 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:50.647067 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-793d55df-39af-48b6-969b-07efffeff517 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:50.648217 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-793d55df-39af-48b6-969b-07efffeff517 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] [instance: 0bef06d7-ba85-4f48-bd08-228211391394] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:50.659309 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-793d55df-39af-48b6-969b-07efffeff517 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:50.659820 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-793d55df-39af-48b6-969b-07efffeff517 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:50.660292 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-793d55df-39af-48b6-969b-07efffeff517 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:50.661003 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-793d55df-39af-48b6-969b-07efffeff517 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:50.665099 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-793d55df-39af-48b6-969b-07efffeff517 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:50.667071 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-793d55df-39af-48b6-969b-07efffeff517 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:50.832569 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-793d55df-39af-48b6-969b-07efffeff517 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:50.889032 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-793d55df-39af-48b6-969b-07efffeff517 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:50.893945 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-793d55df-39af-48b6-969b-07efffeff517 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:50.895483 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-793d55df-39af-48b6-969b-07efffeff517 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] 10.222.0.20 "GET /compute/v2.1/servers/0bef06d7-ba85-4f48-bd08-228211391394" status: 200 len: 1366 microversion: 2.57 time: 0.253412 Oct 04 18:37:50.898320 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1196/2466] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:50 2022] GET /compute/v2.1/servers/0bef06d7-ba85-4f48-bd08-228211391394 => generated 1366 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:37:50.917160 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0cdc0211-ea01-40ae-a85a-cd0f5862e511 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:50.918190 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0cdc0211-ea01-40ae-a85a-cd0f5862e511 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 474a799f-8e38-49d6-8fff-9ec3e7657ef5] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:50.927633 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0cdc0211-ea01-40ae-a85a-cd0f5862e511 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:50.932042 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0cdc0211-ea01-40ae-a85a-cd0f5862e511 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:50.933174 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0cdc0211-ea01-40ae-a85a-cd0f5862e511 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:50.936032 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0cdc0211-ea01-40ae-a85a-cd0f5862e511 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:50.936557 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0cdc0211-ea01-40ae-a85a-cd0f5862e511 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:50.937000 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0cdc0211-ea01-40ae-a85a-cd0f5862e511 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:51.238312 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0cdc0211-ea01-40ae-a85a-cd0f5862e511 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:51.248379 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0cdc0211-ea01-40ae-a85a-cd0f5862e511 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5" status: 200 len: 1542 microversion: 2.1 time: 0.348581 Oct 04 18:37:51.250729 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1197/2467] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:50 2022] GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5 => generated 1542 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:51.263566 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f661b6a6-9fc0-4de2-aed2-ac6d632c79d6 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:51.264736 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f661b6a6-9fc0-4de2-aed2-ac6d632c79d6 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 98dfffc8-51aa-407a-a374-8e120ec43a31] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:51.278479 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f661b6a6-9fc0-4de2-aed2-ac6d632c79d6 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:51.280685 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f661b6a6-9fc0-4de2-aed2-ac6d632c79d6 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:51.285936 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f661b6a6-9fc0-4de2-aed2-ac6d632c79d6 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:51.285936 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f661b6a6-9fc0-4de2-aed2-ac6d632c79d6 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:51.285936 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f661b6a6-9fc0-4de2-aed2-ac6d632c79d6 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:51.285936 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f661b6a6-9fc0-4de2-aed2-ac6d632c79d6 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:51.290580 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=100 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:51.362929 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c0bc0468-084b-41fa-a0bc-df8084101c76 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8284fe51decd4db0bf6b3ed1514cc2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87473abf47e74adf844e3ddfa24da3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:51.389167 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c0bc0468-084b-41fa-a0bc-df8084101c76 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] 10.222.0.20 "GET /compute/v2.1/servers/61ec7cca-1572-496c-ba44-439f04c2a79c" status: 200 len: 1505 microversion: 2.1 time: 1.005933 Oct 04 18:37:51.390199 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1271/2468] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:50 2022] GET /compute/v2.1/servers/61ec7cca-1572-496c-ba44-439f04c2a79c => generated 1505 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:51.398197 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1fdc1ff1-77fa-42ba-821a-841f649dce7b tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-57702008", "imageRef": "cc6e6490-a7ea-4f5d-9cb1-51dfc6183d82", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "997fbf6a-4b0f-4786-9ae4-9cdb3ca01147"}], "security_groups": [{"name": "tempest-securitygroup--1309797222"}], "key_name": "tempest-keypair-869337610", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:51.503970 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f661b6a6-9fc0-4de2-aed2-ac6d632c79d6 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:51.517175 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f661b6a6-9fc0-4de2-aed2-ac6d632c79d6 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31" status: 200 len: 1392 microversion: 2.1 time: 0.265198 Oct 04 18:37:51.523730 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1198/2469] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:51 2022] GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31 => generated 1392 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:51.636954 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-1fdc1ff1-77fa-42ba-821a-841f649dce7b tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] validate_networks() for [('997fbf6a-4b0f-4786-9ae4-9cdb3ca01147', None, None, None, None, None)] {{(pid=123002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:37:51.934066 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-04a951d7-6e18-4919-9ebf-fc1cfc70befa tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:51.934975 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-04a951d7-6e18-4919-9ebf-fc1cfc70befa tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] [instance: 0bef06d7-ba85-4f48-bd08-228211391394] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:51.956208 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-04a951d7-6e18-4919-9ebf-fc1cfc70befa tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:51.956723 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-04a951d7-6e18-4919-9ebf-fc1cfc70befa tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:51.957580 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-04a951d7-6e18-4919-9ebf-fc1cfc70befa tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:51.957861 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-04a951d7-6e18-4919-9ebf-fc1cfc70befa tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:51.958316 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-04a951d7-6e18-4919-9ebf-fc1cfc70befa tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:51.958739 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-04a951d7-6e18-4919-9ebf-fc1cfc70befa tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:52.192334 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-04a951d7-6e18-4919-9ebf-fc1cfc70befa tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:52.204792 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-04a951d7-6e18-4919-9ebf-fc1cfc70befa tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:52.212506 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-04a951d7-6e18-4919-9ebf-fc1cfc70befa tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:52.212506 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-04a951d7-6e18-4919-9ebf-fc1cfc70befa tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] 10.222.0.20 "GET /compute/v2.1/servers/0bef06d7-ba85-4f48-bd08-228211391394" status: 200 len: 1366 microversion: 2.57 time: 0.278504 Oct 04 18:37:52.237677 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1199/2470] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:51 2022] GET /compute/v2.1/servers/0bef06d7-ba85-4f48-bd08-228211391394 => generated 1366 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:37:52.275240 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f0bbfbb9-960f-49dd-95b5-e1ac19280d9e tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:52.275878 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f0bbfbb9-960f-49dd-95b5-e1ac19280d9e tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 474a799f-8e38-49d6-8fff-9ec3e7657ef5] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:52.286369 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f0bbfbb9-960f-49dd-95b5-e1ac19280d9e tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:52.289833 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f0bbfbb9-960f-49dd-95b5-e1ac19280d9e tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:52.290521 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f0bbfbb9-960f-49dd-95b5-e1ac19280d9e tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:52.291637 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f0bbfbb9-960f-49dd-95b5-e1ac19280d9e tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:52.298250 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f0bbfbb9-960f-49dd-95b5-e1ac19280d9e tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:52.299212 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f0bbfbb9-960f-49dd-95b5-e1ac19280d9e tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:52.779004 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f0bbfbb9-960f-49dd-95b5-e1ac19280d9e tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:52.787259 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-1fdc1ff1-77fa-42ba-821a-841f649dce7b tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:37:52.787805 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-1fdc1ff1-77fa-42ba-821a-841f649dce7b tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:37:52.789688 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-1fdc1ff1-77fa-42ba-821a-841f649dce7b tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:37:52.790192 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f0bbfbb9-960f-49dd-95b5-e1ac19280d9e tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5" status: 200 len: 1542 microversion: 2.1 time: 0.516600 Oct 04 18:37:52.790605 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-1fdc1ff1-77fa-42ba-821a-841f649dce7b tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:37:52.791368 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-1fdc1ff1-77fa-42ba-821a-841f649dce7b tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:37:52.792607 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1200/2471] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:52 2022] GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5 => generated 1542 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:52.819975 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-851ae2c0-414a-4a01-807b-dfe170ee2588 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:52.820812 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-851ae2c0-414a-4a01-807b-dfe170ee2588 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 61ec7cca-1572-496c-ba44-439f04c2a79c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:52.829403 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1fdc1ff1-77fa-42ba-821a-841f649dce7b tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:52.830192 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1fdc1ff1-77fa-42ba-821a-841f649dce7b tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:52.832261 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1fdc1ff1-77fa-42ba-821a-841f649dce7b tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:52.833460 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1fdc1ff1-77fa-42ba-821a-841f649dce7b tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:52.836093 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1fdc1ff1-77fa-42ba-821a-841f649dce7b tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:52.836816 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1fdc1ff1-77fa-42ba-821a-841f649dce7b tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:52.844591 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-851ae2c0-414a-4a01-807b-dfe170ee2588 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:52.845658 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-851ae2c0-414a-4a01-807b-dfe170ee2588 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:52.846660 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-851ae2c0-414a-4a01-807b-dfe170ee2588 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:52.849187 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-851ae2c0-414a-4a01-807b-dfe170ee2588 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:52.849900 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-851ae2c0-414a-4a01-807b-dfe170ee2588 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:52.851439 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-851ae2c0-414a-4a01-807b-dfe170ee2588 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:52.907860 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-1fdc1ff1-77fa-42ba-821a-841f649dce7b tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Getting quotas for project 9174b09e32064811a61539c64992ee50. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:37:52.921249 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-1fdc1ff1-77fa-42ba-821a-841f649dce7b tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Getting quotas for user c73127bc6636476482e280eddad7f66c and project 9174b09e32064811a61539c64992ee50. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:37:52.944555 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1fdc1ff1-77fa-42ba-821a-841f649dce7b tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Going to run 1 instances... {{(pid=123002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:37:52.949156 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1fdc1ff1-77fa-42ba-821a-841f649dce7b tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] [instance: b319d463-fa0d-4e2d-b03f-6227475572da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cc6e6490-a7ea-4f5d-9cb1-51dfc6183d82',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:37:52.980643 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=3,nova_api:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:53.126794 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1fdc1ff1-77fa-42ba-821a-841f649dce7b tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.734541 Oct 04 18:37:53.133248 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1272/2472] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:37:51 2022] POST /compute/v2.1/servers => generated 406 bytes in 1737 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:37:53.134983 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-75761716-cf30-4efc-90b7-1fa248f0ca60 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:53.135777 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-75761716-cf30-4efc-90b7-1fa248f0ca60 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 98dfffc8-51aa-407a-a374-8e120ec43a31] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:53.146682 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-75761716-cf30-4efc-90b7-1fa248f0ca60 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:53.147181 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-75761716-cf30-4efc-90b7-1fa248f0ca60 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:53.148671 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-75761716-cf30-4efc-90b7-1fa248f0ca60 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:53.149892 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-75761716-cf30-4efc-90b7-1fa248f0ca60 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:53.150517 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-75761716-cf30-4efc-90b7-1fa248f0ca60 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:53.151022 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-75761716-cf30-4efc-90b7-1fa248f0ca60 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:53.194315 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-851ae2c0-414a-4a01-807b-dfe170ee2588 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8284fe51decd4db0bf6b3ed1514cc2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87473abf47e74adf844e3ddfa24da3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:53.212735 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-851ae2c0-414a-4a01-807b-dfe170ee2588 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] 10.222.0.20 "GET /compute/v2.1/servers/61ec7cca-1572-496c-ba44-439f04c2a79c" status: 200 len: 1505 microversion: 2.1 time: 0.398264 Oct 04 18:37:53.214774 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1201/2473] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:52 2022] GET /compute/v2.1/servers/61ec7cca-1572-496c-ba44-439f04c2a79c => generated 1505 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:53.230492 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2c102429-a02f-4ae8-9964-989728c9b691 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:53.231633 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2c102429-a02f-4ae8-9964-989728c9b691 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] [instance: b319d463-fa0d-4e2d-b03f-6227475572da] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:53.401610 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-2c102429-a02f-4ae8-9964-989728c9b691 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73127bc6636476482e280eddad7f66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9174b09e32064811a61539c64992ee50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:53.411013 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2c102429-a02f-4ae8-9964-989728c9b691 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] 10.222.0.20 "GET /compute/v2.1/servers/b319d463-fa0d-4e2d-b03f-6227475572da" status: 200 len: 1243 microversion: 2.1 time: 0.192017 Oct 04 18:37:53.413089 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1202/2474] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:53 2022] GET /compute/v2.1/servers/b319d463-fa0d-4e2d-b03f-6227475572da => generated 1243 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:53.420386 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e681ae39-f9da-4867-84fe-a4fc4bc5a65c tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:53.421356 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e681ae39-f9da-4867-84fe-a4fc4bc5a65c tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] [instance: 0bef06d7-ba85-4f48-bd08-228211391394] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:53.455509 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e681ae39-f9da-4867-84fe-a4fc4bc5a65c tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:53.461876 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e681ae39-f9da-4867-84fe-a4fc4bc5a65c tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:53.461876 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e681ae39-f9da-4867-84fe-a4fc4bc5a65c tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:53.461876 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e681ae39-f9da-4867-84fe-a4fc4bc5a65c tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:53.461876 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e681ae39-f9da-4867-84fe-a4fc4bc5a65c tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:53.461876 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e681ae39-f9da-4867-84fe-a4fc4bc5a65c tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:53.488949 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-75761716-cf30-4efc-90b7-1fa248f0ca60 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:53.501868 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-75761716-cf30-4efc-90b7-1fa248f0ca60 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31" status: 200 len: 1392 microversion: 2.1 time: 0.370714 Oct 04 18:37:53.512320 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1273/2475] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:53 2022] GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31 => generated 1392 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:53.614616 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e681ae39-f9da-4867-84fe-a4fc4bc5a65c tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:53.630643 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e681ae39-f9da-4867-84fe-a4fc4bc5a65c tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:53.632628 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e681ae39-f9da-4867-84fe-a4fc4bc5a65c tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:53.634102 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e681ae39-f9da-4867-84fe-a4fc4bc5a65c tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] 10.222.0.20 "GET /compute/v2.1/servers/0bef06d7-ba85-4f48-bd08-228211391394" status: 200 len: 1366 microversion: 2.57 time: 0.219915 Oct 04 18:37:53.636273 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1203/2476] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:53 2022] GET /compute/v2.1/servers/0bef06d7-ba85-4f48-bd08-228211391394 => generated 1366 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:37:53.821404 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-756e1fc2-4be3-4b64-a314-a602baf85ea9 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:53.822796 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-756e1fc2-4be3-4b64-a314-a602baf85ea9 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 474a799f-8e38-49d6-8fff-9ec3e7657ef5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:53.833682 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-756e1fc2-4be3-4b64-a314-a602baf85ea9 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:53.834940 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-756e1fc2-4be3-4b64-a314-a602baf85ea9 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:53.847321 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-756e1fc2-4be3-4b64-a314-a602baf85ea9 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:53.849198 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-756e1fc2-4be3-4b64-a314-a602baf85ea9 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:53.856971 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-756e1fc2-4be3-4b64-a314-a602baf85ea9 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:53.862901 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-756e1fc2-4be3-4b64-a314-a602baf85ea9 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:54.286562 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-756e1fc2-4be3-4b64-a314-a602baf85ea9 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:54.298916 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-756e1fc2-4be3-4b64-a314-a602baf85ea9 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5" status: 200 len: 1542 microversion: 2.1 time: 0.481523 Oct 04 18:37:54.321101 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1274/2477] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:53 2022] GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5 => generated 1542 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:54.332221 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2b899627-2950-4ab6-a9e8-f5c3428f038a tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:54.334774 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2b899627-2950-4ab6-a9e8-f5c3428f038a tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 61ec7cca-1572-496c-ba44-439f04c2a79c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:54.349220 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2b899627-2950-4ab6-a9e8-f5c3428f038a tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:54.350880 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2b899627-2950-4ab6-a9e8-f5c3428f038a tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:54.351967 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2b899627-2950-4ab6-a9e8-f5c3428f038a tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:54.354577 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2b899627-2950-4ab6-a9e8-f5c3428f038a tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:54.372016 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2b899627-2950-4ab6-a9e8-f5c3428f038a tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:54.372016 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2b899627-2950-4ab6-a9e8-f5c3428f038a tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:54.587732 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d0b5ec6b-802b-415e-9fb5-038b6ec4cb55 tempest-KeyPairsV2TestJSON-401364967 tempest-KeyPairsV2TestJSON-401364967-project] Action: 'create', calling method: .version_select at 0x7fe258bd8430>, body: {"keypair": {"name": "tempest-keypair-2141177354", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHCdcPnySEsnpyIfzn/q5Sr1hIigElMbdtt5HvQvR3p+8m8fIiNtojmwEAFG1zP2MOGQkUE6v2ZJ/IZzFgcD1bSF1zrzonyzhVdJwik1uY2NZIpXr3+zA9yuuSz5+hhfig=="}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:54.618904 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2b899627-2950-4ab6-a9e8-f5c3428f038a tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8284fe51decd4db0bf6b3ed1514cc2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87473abf47e74adf844e3ddfa24da3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:54.631032 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2b899627-2950-4ab6-a9e8-f5c3428f038a tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] 10.222.0.20 "GET /compute/v2.1/servers/61ec7cca-1572-496c-ba44-439f04c2a79c" status: 200 len: 1505 microversion: 2.1 time: 0.308629 Oct 04 18:37:54.631931 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1275/2478] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:54 2022] GET /compute/v2.1/servers/61ec7cca-1572-496c-ba44-439f04c2a79c => generated 1505 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:54.638378 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-53adedd4-2df4-4e36-89db-4db3fb41bb45 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:54.639234 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-53adedd4-2df4-4e36-89db-4db3fb41bb45 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] [instance: b319d463-fa0d-4e2d-b03f-6227475572da] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:54.652483 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-d0b5ec6b-802b-415e-9fb5-038b6ec4cb55 tempest-KeyPairsV2TestJSON-401364967 tempest-KeyPairsV2TestJSON-401364967-project] Getting quotas for project f642dcab50a444c5baec00425396c8b8. Resources: {'key_pairs'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:37:54.664146 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-d0b5ec6b-802b-415e-9fb5-038b6ec4cb55 tempest-KeyPairsV2TestJSON-401364967 tempest-KeyPairsV2TestJSON-401364967-project] Getting quotas for user ad2f655574af446eb7d1446be48946be and project f642dcab50a444c5baec00425396c8b8. Resources: {'key_pairs'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:37:54.735343 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-53adedd4-2df4-4e36-89db-4db3fb41bb45 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73127bc6636476482e280eddad7f66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9174b09e32064811a61539c64992ee50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:54.745830 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-53adedd4-2df4-4e36-89db-4db3fb41bb45 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] 10.222.0.20 "GET /compute/v2.1/servers/b319d463-fa0d-4e2d-b03f-6227475572da" status: 200 len: 1243 microversion: 2.1 time: 0.112577 Oct 04 18:37:54.751549 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1276/2479] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:54 2022] GET /compute/v2.1/servers/b319d463-fa0d-4e2d-b03f-6227475572da => generated 1243 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:54.766416 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-934346af-393a-4836-ba82-9345aaec71cb tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:54.767606 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-934346af-393a-4836-ba82-9345aaec71cb tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 98dfffc8-51aa-407a-a374-8e120ec43a31] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:54.774668 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-934346af-393a-4836-ba82-9345aaec71cb tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:54.775665 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-934346af-393a-4836-ba82-9345aaec71cb tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:54.776817 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-934346af-393a-4836-ba82-9345aaec71cb tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:54.777943 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-934346af-393a-4836-ba82-9345aaec71cb tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:54.779328 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-934346af-393a-4836-ba82-9345aaec71cb tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:54.779961 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-934346af-393a-4836-ba82-9345aaec71cb tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:54.786865 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d0b5ec6b-802b-415e-9fb5-038b6ec4cb55 tempest-KeyPairsV2TestJSON-401364967 tempest-KeyPairsV2TestJSON-401364967-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.699327 Oct 04 18:37:54.789375 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1204/2480] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Oct 4 18:37:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:54.795644 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-bd6e0af8-3467-4e7d-9dd8-cba9fd1768d9 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:54.796666 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-bd6e0af8-3467-4e7d-9dd8-cba9fd1768d9 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] [instance: 0bef06d7-ba85-4f48-bd08-228211391394] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:54.804935 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bd6e0af8-3467-4e7d-9dd8-cba9fd1768d9 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:54.805642 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bd6e0af8-3467-4e7d-9dd8-cba9fd1768d9 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:54.811107 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bd6e0af8-3467-4e7d-9dd8-cba9fd1768d9 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:54.811107 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bd6e0af8-3467-4e7d-9dd8-cba9fd1768d9 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:54.811107 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bd6e0af8-3467-4e7d-9dd8-cba9fd1768d9 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:54.811107 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bd6e0af8-3467-4e7d-9dd8-cba9fd1768d9 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:54.948190 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-bd6e0af8-3467-4e7d-9dd8-cba9fd1768d9 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:54.975292 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-bd6e0af8-3467-4e7d-9dd8-cba9fd1768d9 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:54.976988 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-bd6e0af8-3467-4e7d-9dd8-cba9fd1768d9 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:54.983234 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-bd6e0af8-3467-4e7d-9dd8-cba9fd1768d9 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] 10.222.0.20 "GET /compute/v2.1/servers/0bef06d7-ba85-4f48-bd08-228211391394" status: 200 len: 1366 microversion: 2.57 time: 0.187182 Oct 04 18:37:54.984448 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1205/2481] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:54 2022] GET /compute/v2.1/servers/0bef06d7-ba85-4f48-bd08-228211391394 => generated 1366 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:37:55.003106 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0cdd1cbf-e2da-442e-8b3c-5318e3039990 tempest-KeyPairsV2TestJSON-401364967 tempest-KeyPairsV2TestJSON-401364967-project] Calling method '.version_select at 0x7fe258c6c160>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:55.030198 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:55.032519 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0cdd1cbf-e2da-442e-8b3c-5318e3039990 tempest-KeyPairsV2TestJSON-401364967 tempest-KeyPairsV2TestJSON-401364967-project] 10.222.0.20 "GET /compute/v2.1/os-keypairs/tempest-keypair-2141177354" status: 200 len: 498 microversion: 2.1 time: 0.033395 Oct 04 18:37:55.039928 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1206/2482] 10.222.0.20 () {58 vars in 1218 bytes} [Tue Oct 4 18:37:54 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-2141177354 => generated 498 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:55.045618 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ef2a171c-8ab6-48e1-b9bf-14d26ad6a0f1 tempest-KeyPairsV2TestJSON-401364967 tempest-KeyPairsV2TestJSON-401364967-project] Calling method '.version_select at 0x7fe258270280>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:55.060754 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-934346af-393a-4836-ba82-9345aaec71cb tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:55.080679 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-934346af-393a-4836-ba82-9345aaec71cb tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31" status: 200 len: 1392 microversion: 2.1 time: 0.327622 Oct 04 18:37:55.085236 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1277/2483] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:54 2022] GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31 => generated 1392 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:55.201431 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ef2a171c-8ab6-48e1-b9bf-14d26ad6a0f1 tempest-KeyPairsV2TestJSON-401364967 tempest-KeyPairsV2TestJSON-401364967-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2141177354" status: 202 len: 0 microversion: 2.1 time: 0.160062 Oct 04 18:37:55.222957 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1207/2484] 10.222.0.20 () {58 vars in 1221 bytes} [Tue Oct 4 18:37:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2141177354 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:37:55.223216 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-897939cf-fe14-45bb-bdf2-216c598b6fd8 tempest-KeyPairsV2TestJSON-401364967 tempest-KeyPairsV2TestJSON-401364967-project] Action: 'create', calling method: .version_select at 0x7fe258cd6a60>, body: {"keypair": {"name": "tempest-keypair-2080550294", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGQ9gLGBvJ3XNGqKWmUMSMP2irvDFAwjWcHF+FbRSPbjVifUd7MV+iTCvX5a/QiV/TmEoKjsYEexHvJtDGlRMDzb6OvGpTXlbRB5X+aKbLviXgNHQUcQJQ6iobe6NJYTEg=="}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:55.268383 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-897939cf-fe14-45bb-bdf2-216c598b6fd8 tempest-KeyPairsV2TestJSON-401364967 tempest-KeyPairsV2TestJSON-401364967-project] Getting quotas for project f642dcab50a444c5baec00425396c8b8. Resources: {'key_pairs'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:37:55.275623 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-897939cf-fe14-45bb-bdf2-216c598b6fd8 tempest-KeyPairsV2TestJSON-401364967 tempest-KeyPairsV2TestJSON-401364967-project] Getting quotas for user ad2f655574af446eb7d1446be48946be and project f642dcab50a444c5baec00425396c8b8. Resources: {'key_pairs'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:37:55.331471 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9e4b2e03-79a4-49f7-81f5-4f3f1d9034f9 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:55.332498 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-9e4b2e03-79a4-49f7-81f5-4f3f1d9034f9 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 474a799f-8e38-49d6-8fff-9ec3e7657ef5] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:55.341967 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9e4b2e03-79a4-49f7-81f5-4f3f1d9034f9 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:55.342941 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9e4b2e03-79a4-49f7-81f5-4f3f1d9034f9 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:55.343599 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9e4b2e03-79a4-49f7-81f5-4f3f1d9034f9 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:55.344684 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9e4b2e03-79a4-49f7-81f5-4f3f1d9034f9 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:55.345309 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9e4b2e03-79a4-49f7-81f5-4f3f1d9034f9 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:55.347868 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9e4b2e03-79a4-49f7-81f5-4f3f1d9034f9 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:55.394046 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-897939cf-fe14-45bb-bdf2-216c598b6fd8 tempest-KeyPairsV2TestJSON-401364967 tempest-KeyPairsV2TestJSON-401364967-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.182612 Oct 04 18:37:55.400268 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1278/2485] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Oct 4 18:37:55 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:55.408774 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2f9de391-69d8-4fd5-85ac-91464870e91b tempest-KeyPairsV2TestJSON-401364967 tempest-KeyPairsV2TestJSON-401364967-project] Calling method '.version_select at 0x7fe25d131160>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:55.523467 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9e4b2e03-79a4-49f7-81f5-4f3f1d9034f9 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:55.531603 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9e4b2e03-79a4-49f7-81f5-4f3f1d9034f9 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5" status: 200 len: 1542 microversion: 2.1 time: 0.207083 Oct 04 18:37:55.532235 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1208/2486] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:55 2022] GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5 => generated 1542 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:55.561174 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2f9de391-69d8-4fd5-85ac-91464870e91b tempest-KeyPairsV2TestJSON-401364967 tempest-KeyPairsV2TestJSON-401364967-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2080550294" status: 202 len: 0 microversion: 2.1 time: 0.159116 Oct 04 18:37:55.564112 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1279/2487] 10.222.0.20 () {58 vars in 1221 bytes} [Tue Oct 4 18:37:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2080550294 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:37:55.579505 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-16798c88-1f0d-478a-bd37-8ac91a7be221 tempest-KeyPairsV2TestJSON-401364967 tempest-KeyPairsV2TestJSON-401364967-project] Action: 'create', calling method: .version_select at 0x7fe258c2d5e0>, body: {"keypair": {"name": "tempest-keypair-472150926", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:55.600885 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-16798c88-1f0d-478a-bd37-8ac91a7be221 tempest-KeyPairsV2TestJSON-401364967 tempest-KeyPairsV2TestJSON-401364967-project] Getting quotas for project f642dcab50a444c5baec00425396c8b8. Resources: {'key_pairs'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:37:55.605947 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-16798c88-1f0d-478a-bd37-8ac91a7be221 tempest-KeyPairsV2TestJSON-401364967 tempest-KeyPairsV2TestJSON-401364967-project] Getting quotas for user ad2f655574af446eb7d1446be48946be and project f642dcab50a444c5baec00425396c8b8. Resources: {'key_pairs'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:37:55.664313 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d5fd003d-6ea2-433e-b0ca-ec22dfe87e2d tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:55.670588 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d5fd003d-6ea2-433e-b0ca-ec22dfe87e2d tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 61ec7cca-1572-496c-ba44-439f04c2a79c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:55.678591 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d5fd003d-6ea2-433e-b0ca-ec22dfe87e2d tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:55.681054 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d5fd003d-6ea2-433e-b0ca-ec22dfe87e2d tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:55.681810 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d5fd003d-6ea2-433e-b0ca-ec22dfe87e2d tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:55.682813 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d5fd003d-6ea2-433e-b0ca-ec22dfe87e2d tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:55.684018 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d5fd003d-6ea2-433e-b0ca-ec22dfe87e2d tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:55.685083 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d5fd003d-6ea2-433e-b0ca-ec22dfe87e2d tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:55.746292 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-16798c88-1f0d-478a-bd37-8ac91a7be221 tempest-KeyPairsV2TestJSON-401364967 tempest-KeyPairsV2TestJSON-401364967-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 573 microversion: 2.1 time: 0.172676 Oct 04 18:37:55.750114 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1209/2488] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Oct 4 18:37:55 2022] POST /compute/v2.1/os-keypairs => generated 573 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:55.763260 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6328ce32-4c71-4a3a-88f1-f8699a920e91 tempest-KeyPairsV2TestJSON-401364967 tempest-KeyPairsV2TestJSON-401364967-project] Calling method '.version_select at 0x7fe258270f70>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:55.881843 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d5fd003d-6ea2-433e-b0ca-ec22dfe87e2d tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8284fe51decd4db0bf6b3ed1514cc2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87473abf47e74adf844e3ddfa24da3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:55.889990 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d5fd003d-6ea2-433e-b0ca-ec22dfe87e2d tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] 10.222.0.20 "GET /compute/v2.1/servers/61ec7cca-1572-496c-ba44-439f04c2a79c" status: 200 len: 1505 microversion: 2.1 time: 0.232759 Oct 04 18:37:55.890557 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1280/2489] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:55 2022] GET /compute/v2.1/servers/61ec7cca-1572-496c-ba44-439f04c2a79c => generated 1505 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:55.901207 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-93bc906e-3d7c-4e4a-80fe-756f067c7c4b tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:55.902061 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-93bc906e-3d7c-4e4a-80fe-756f067c7c4b tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] [instance: b319d463-fa0d-4e2d-b03f-6227475572da] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:55.909037 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-93bc906e-3d7c-4e4a-80fe-756f067c7c4b tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:55.909529 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-93bc906e-3d7c-4e4a-80fe-756f067c7c4b tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:55.909953 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-93bc906e-3d7c-4e4a-80fe-756f067c7c4b tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:55.910677 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-93bc906e-3d7c-4e4a-80fe-756f067c7c4b tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:55.911132 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-93bc906e-3d7c-4e4a-80fe-756f067c7c4b tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:55.911552 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-93bc906e-3d7c-4e4a-80fe-756f067c7c4b tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:55.915583 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:55.940721 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6328ce32-4c71-4a3a-88f1-f8699a920e91 tempest-KeyPairsV2TestJSON-401364967 tempest-KeyPairsV2TestJSON-401364967-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-472150926" status: 202 len: 0 microversion: 2.1 time: 0.177304 Oct 04 18:37:55.942812 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1210/2490] 10.222.0.20 () {58 vars in 1218 bytes} [Tue Oct 4 18:37:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-472150926 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:37:55.960154 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-42eb4c1a-5faf-45ff-87ff-10b9b1dabb24 tempest-KeyPairsV2TestJSON-401364967 tempest-KeyPairsV2TestJSON-401364967-project] Action: 'create', calling method: .version_select at 0x7fe258200c10>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-106997717", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHw5ObKZ6dvyk28MdF6InwiBBocWcwqdly9fLw1v7thgD97MfN3vHFPqhOFHCTNbqsYtGPODfe1UnORG8mA3Cep4KHG/seg24An+uTTqGfC6FGRya2F1h2F4+v4vYZNMpA=="}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:55.982718 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-42eb4c1a-5faf-45ff-87ff-10b9b1dabb24 tempest-KeyPairsV2TestJSON-401364967 tempest-KeyPairsV2TestJSON-401364967-project] Getting quotas for project f642dcab50a444c5baec00425396c8b8. Resources: {'key_pairs'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:37:55.989266 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-42eb4c1a-5faf-45ff-87ff-10b9b1dabb24 tempest-KeyPairsV2TestJSON-401364967 tempest-KeyPairsV2TestJSON-401364967-project] Getting quotas for user ad2f655574af446eb7d1446be48946be and project f642dcab50a444c5baec00425396c8b8. Resources: {'key_pairs'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:37:56.067122 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-93bc906e-3d7c-4e4a-80fe-756f067c7c4b tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73127bc6636476482e280eddad7f66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9174b09e32064811a61539c64992ee50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:56.077870 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-93bc906e-3d7c-4e4a-80fe-756f067c7c4b tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] 10.222.0.20 "GET /compute/v2.1/servers/b319d463-fa0d-4e2d-b03f-6227475572da" status: 200 len: 1247 microversion: 2.1 time: 0.180647 Oct 04 18:37:56.079156 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1281/2491] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:55 2022] GET /compute/v2.1/servers/b319d463-fa0d-4e2d-b03f-6227475572da => generated 1247 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:56.083616 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3b7b9a10-0ffb-4011-9ccb-ee3b029cff74 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:56.084926 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3b7b9a10-0ffb-4011-9ccb-ee3b029cff74 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] [instance: 0bef06d7-ba85-4f48-bd08-228211391394] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:56.089318 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-42eb4c1a-5faf-45ff-87ff-10b9b1dabb24 tempest-KeyPairsV2TestJSON-401364967 tempest-KeyPairsV2TestJSON-401364967-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.138613 Oct 04 18:37:56.091855 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1211/2492] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Oct 4 18:37:55 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:37:56.108877 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0b73dc29-63fa-44b3-869a-bfea5fef7437 tempest-KeyPairsV2TestJSON-401364967 tempest-KeyPairsV2TestJSON-401364967-project] Action: 'create', calling method: .version_select at 0x7fe258c7a9d0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1929956307", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMkidUZngeqrKh0P4+VxMOjLnhhhBdtuEPvOoPmatzN3ZfJrG++mqByVfhOuXkTdBVoooRmhNaR9tac85T4UuAWcQlanp/cMffRme20WOysuidzvdAHRql8Mics6BGZcA=="}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:56.127883 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3b7b9a10-0ffb-4011-9ccb-ee3b029cff74 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:56.130526 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3b7b9a10-0ffb-4011-9ccb-ee3b029cff74 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:56.131495 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3b7b9a10-0ffb-4011-9ccb-ee3b029cff74 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:56.133408 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3b7b9a10-0ffb-4011-9ccb-ee3b029cff74 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:56.133913 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3b7b9a10-0ffb-4011-9ccb-ee3b029cff74 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:56.134770 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-0b73dc29-63fa-44b3-869a-bfea5fef7437 tempest-KeyPairsV2TestJSON-401364967 tempest-KeyPairsV2TestJSON-401364967-project] Getting quotas for project f642dcab50a444c5baec00425396c8b8. Resources: {'key_pairs'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:37:56.135075 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3b7b9a10-0ffb-4011-9ccb-ee3b029cff74 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:56.143490 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-0b73dc29-63fa-44b3-869a-bfea5fef7437 tempest-KeyPairsV2TestJSON-401364967 tempest-KeyPairsV2TestJSON-401364967-project] Getting quotas for user ad2f655574af446eb7d1446be48946be and project f642dcab50a444c5baec00425396c8b8. Resources: {'key_pairs'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:37:56.237355 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0b73dc29-63fa-44b3-869a-bfea5fef7437 tempest-KeyPairsV2TestJSON-401364967 tempest-KeyPairsV2TestJSON-401364967-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.135947 Oct 04 18:37:56.237977 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1212/2493] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Oct 4 18:37:56 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:56.253909 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e20f3746-af58-4146-bb0b-72d0c1be8f75 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:56.254016 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3b7b9a10-0ffb-4011-9ccb-ee3b029cff74 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:56.254120 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e20f3746-af58-4146-bb0b-72d0c1be8f75 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 98dfffc8-51aa-407a-a374-8e120ec43a31] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:56.255847 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3b7b9a10-0ffb-4011-9ccb-ee3b029cff74 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:56.256579 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e20f3746-af58-4146-bb0b-72d0c1be8f75 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:56.257076 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e20f3746-af58-4146-bb0b-72d0c1be8f75 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:56.257515 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e20f3746-af58-4146-bb0b-72d0c1be8f75 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:56.258014 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3b7b9a10-0ffb-4011-9ccb-ee3b029cff74 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:56.258213 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e20f3746-af58-4146-bb0b-72d0c1be8f75 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:56.258673 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e20f3746-af58-4146-bb0b-72d0c1be8f75 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:56.259099 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e20f3746-af58-4146-bb0b-72d0c1be8f75 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:56.260631 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3b7b9a10-0ffb-4011-9ccb-ee3b029cff74 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] 10.222.0.20 "GET /compute/v2.1/servers/0bef06d7-ba85-4f48-bd08-228211391394" status: 200 len: 1366 microversion: 2.57 time: 0.180907 Oct 04 18:37:56.271851 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1282/2494] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:56 2022] GET /compute/v2.1/servers/0bef06d7-ba85-4f48-bd08-228211391394 => generated 1366 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:37:56.271851 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d9fcaf8c-9d41-4e33-a8ba-c76c3f6b3879 tempest-KeyPairsV2TestJSON-401364967 tempest-KeyPairsV2TestJSON-401364967-project] Action: 'create', calling method: .version_select at 0x7fe25d1319d0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-798873101", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1yyQWWe/E5eU9eu2qgwKGEDaq9hVFJ70A1iXIZK4eX8NQBAIbeg6eGisg5Bq4niXIwpQf2izHBuXOgNbVfvTzTfLml8JSHfPpsYzRR61hsjDiF7ipIcRqwhc18hvURzA=="}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:56.289458 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-d9fcaf8c-9d41-4e33-a8ba-c76c3f6b3879 tempest-KeyPairsV2TestJSON-401364967 tempest-KeyPairsV2TestJSON-401364967-project] Getting quotas for project f642dcab50a444c5baec00425396c8b8. Resources: {'key_pairs'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:37:56.298176 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-d9fcaf8c-9d41-4e33-a8ba-c76c3f6b3879 tempest-KeyPairsV2TestJSON-401364967 tempest-KeyPairsV2TestJSON-401364967-project] Getting quotas for user ad2f655574af446eb7d1446be48946be and project f642dcab50a444c5baec00425396c8b8. Resources: {'key_pairs'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:37:56.409256 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d9fcaf8c-9d41-4e33-a8ba-c76c3f6b3879 tempest-KeyPairsV2TestJSON-401364967 tempest-KeyPairsV2TestJSON-401364967-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.144185 Oct 04 18:37:56.409438 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1283/2495] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Oct 4 18:37:56 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:56.422429 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-fd935228-a546-4541-976a-0e5ee0603c75 tempest-KeyPairsV2TestJSON-401364967 tempest-KeyPairsV2TestJSON-401364967-project] Calling method '.version_select at 0x7fe2583ded30>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:56.432170 n-d-850501-14 devstack@n-api.service[123002]: WARNING oslo_db.sqlalchemy.utils [None req-fd935228-a546-4541-976a-0e5ee0603c75 tempest-KeyPairsV2TestJSON-401364967 tempest-KeyPairsV2TestJSON-401364967-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 04 18:37:56.442772 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-fd935228-a546-4541-976a-0e5ee0603c75 tempest-KeyPairsV2TestJSON-401364967 tempest-KeyPairsV2TestJSON-401364967-project] 10.222.0.20 "GET /compute/v2.1/os-keypairs" status: 200 len: 1092 microversion: 2.1 time: 0.027222 Oct 04 18:37:56.444128 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1284/2496] 10.222.0.20 () {58 vars in 1137 bytes} [Tue Oct 4 18:37:56 2022] GET /compute/v2.1/os-keypairs => generated 1092 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:56.464019 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4e19e2f0-1623-49f9-8449-6363d7dcc3ca tempest-KeyPairsV2TestJSON-401364967 tempest-KeyPairsV2TestJSON-401364967-project] Calling method '.version_select at 0x7fe258bb6820>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:56.524046 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e20f3746-af58-4146-bb0b-72d0c1be8f75 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:56.533309 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e20f3746-af58-4146-bb0b-72d0c1be8f75 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31" status: 200 len: 1392 microversion: 2.1 time: 0.294247 Oct 04 18:37:56.536174 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1213/2497] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:56 2022] GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31 => generated 1392 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:56.542973 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-81718fb8-4c72-4afa-8a6b-22d741741e48 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:56.552454 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-81718fb8-4c72-4afa-8a6b-22d741741e48 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: b219d988-2847-45a0-a3b8-af54cf1a43f8] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:56.552454 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-81718fb8-4c72-4afa-8a6b-22d741741e48 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:56.552454 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-81718fb8-4c72-4afa-8a6b-22d741741e48 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:56.552454 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-81718fb8-4c72-4afa-8a6b-22d741741e48 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:56.552855 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-81718fb8-4c72-4afa-8a6b-22d741741e48 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:56.553114 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-81718fb8-4c72-4afa-8a6b-22d741741e48 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:56.553563 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-81718fb8-4c72-4afa-8a6b-22d741741e48 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:56.582680 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-81718fb8-4c72-4afa-8a6b-22d741741e48 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: b219d988-2847-45a0-a3b8-af54cf1a43f8] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:37:56.626308 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4e19e2f0-1623-49f9-8449-6363d7dcc3ca tempest-KeyPairsV2TestJSON-401364967 tempest-KeyPairsV2TestJSON-401364967-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-798873101" status: 202 len: 0 microversion: 2.1 time: 0.174168 Oct 04 18:37:56.627128 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1285/2498] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Oct 4 18:37:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-798873101 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:37:56.632316 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e0001ad5-f620-4bcc-b5dc-08bbac489000 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:56.632924 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e0001ad5-f620-4bcc-b5dc-08bbac489000 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 474a799f-8e38-49d6-8fff-9ec3e7657ef5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:56.653870 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e0001ad5-f620-4bcc-b5dc-08bbac489000 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:56.653870 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e0001ad5-f620-4bcc-b5dc-08bbac489000 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:56.655964 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e0001ad5-f620-4bcc-b5dc-08bbac489000 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:56.659044 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e0001ad5-f620-4bcc-b5dc-08bbac489000 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:56.660554 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e0001ad5-f620-4bcc-b5dc-08bbac489000 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:56.661384 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e0001ad5-f620-4bcc-b5dc-08bbac489000 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:56.837506 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e0001ad5-f620-4bcc-b5dc-08bbac489000 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:56.848684 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e0001ad5-f620-4bcc-b5dc-08bbac489000 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5" status: 200 len: 1542 microversion: 2.1 time: 0.219947 Oct 04 18:37:56.852291 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1286/2499] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:56 2022] GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5 => generated 1542 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:56.855385 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7479dca7-b779-4857-bd6f-c62c9b1a3263 tempest-KeyPairsV2TestJSON-401364967 tempest-KeyPairsV2TestJSON-401364967-project] Calling method '.version_select at 0x7fe25d133040>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:56.962064 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-81718fb8-4c72-4afa-8a6b-22d741741e48 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8" status: 204 len: 0 microversion: 2.25 time: 0.422520 Oct 04 18:37:56.962833 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1214/2500] 10.222.0.20 () {60 vars in 1280 bytes} [Tue Oct 4 18:37:56 2022] DELETE /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:37:56.964149 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7479dca7-b779-4857-bd6f-c62c9b1a3263 tempest-KeyPairsV2TestJSON-401364967 tempest-KeyPairsV2TestJSON-401364967-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1929956307" status: 202 len: 0 microversion: 2.1 time: 0.112855 Oct 04 18:37:56.966083 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1287/2501] 10.222.0.20 () {58 vars in 1278 bytes} [Tue Oct 4 18:37:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1929956307 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:37:56.974877 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-35f45622-2c7f-4ff2-be12-5473bb5ee205 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:56.975453 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8abfc250-3a79-475a-af19-1e6383e25185 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:56.975658 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-35f45622-2c7f-4ff2-be12-5473bb5ee205 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: b219d988-2847-45a0-a3b8-af54cf1a43f8] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:56.976513 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8abfc250-3a79-475a-af19-1e6383e25185 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 61ec7cca-1572-496c-ba44-439f04c2a79c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:56.983436 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-35f45622-2c7f-4ff2-be12-5473bb5ee205 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:56.983623 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8abfc250-3a79-475a-af19-1e6383e25185 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:56.984039 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-35f45622-2c7f-4ff2-be12-5473bb5ee205 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:56.984190 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8abfc250-3a79-475a-af19-1e6383e25185 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:56.984594 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-35f45622-2c7f-4ff2-be12-5473bb5ee205 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:56.984737 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8abfc250-3a79-475a-af19-1e6383e25185 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:56.985315 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8abfc250-3a79-475a-af19-1e6383e25185 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:56.985591 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-35f45622-2c7f-4ff2-be12-5473bb5ee205 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:56.985777 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8abfc250-3a79-475a-af19-1e6383e25185 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:56.986171 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-35f45622-2c7f-4ff2-be12-5473bb5ee205 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:56.986305 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8abfc250-3a79-475a-af19-1e6383e25185 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:56.986842 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-35f45622-2c7f-4ff2-be12-5473bb5ee205 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:57.243418 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-35f45622-2c7f-4ff2-be12-5473bb5ee205 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:57.250471 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8abfc250-3a79-475a-af19-1e6383e25185 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8284fe51decd4db0bf6b3ed1514cc2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87473abf47e74adf844e3ddfa24da3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:57.256902 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-35f45622-2c7f-4ff2-be12-5473bb5ee205 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:57.260566 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-35f45622-2c7f-4ff2-be12-5473bb5ee205 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:57.261099 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8abfc250-3a79-475a-af19-1e6383e25185 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] 10.222.0.20 "GET /compute/v2.1/servers/61ec7cca-1572-496c-ba44-439f04c2a79c" status: 200 len: 1505 microversion: 2.1 time: 0.296221 Oct 04 18:37:57.261459 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-35f45622-2c7f-4ff2-be12-5473bb5ee205 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8" status: 200 len: 1729 microversion: 2.25 time: 0.289963 Oct 04 18:37:57.262242 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1215/2502] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:56 2022] GET /compute/v2.1/servers/61ec7cca-1572-496c-ba44-439f04c2a79c => generated 1505 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:57.263358 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1288/2503] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:56 2022] GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8 => generated 1729 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:37:57.267452 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4c61cf75-fcf2-4762-adde-f9eceb6ebb5e tempest-KeyPairsV2TestJSON-401364967 tempest-KeyPairsV2TestJSON-401364967-project] Calling method '.version_select at 0x7fe258bd8430>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:57.270383 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-797bd5aa-8a02-44e6-8b5b-72a6b13c2a57 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:57.271308 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-797bd5aa-8a02-44e6-8b5b-72a6b13c2a57 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] [instance: b319d463-fa0d-4e2d-b03f-6227475572da] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:57.278721 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-797bd5aa-8a02-44e6-8b5b-72a6b13c2a57 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:57.280213 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-797bd5aa-8a02-44e6-8b5b-72a6b13c2a57 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:57.280865 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-797bd5aa-8a02-44e6-8b5b-72a6b13c2a57 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:57.281770 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-797bd5aa-8a02-44e6-8b5b-72a6b13c2a57 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:57.282401 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-797bd5aa-8a02-44e6-8b5b-72a6b13c2a57 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:57.286192 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-797bd5aa-8a02-44e6-8b5b-72a6b13c2a57 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:57.397768 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-4c61cf75-fcf2-4762-adde-f9eceb6ebb5e tempest-KeyPairsV2TestJSON-401364967 tempest-KeyPairsV2TestJSON-401364967-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-106997717" status: 202 len: 0 microversion: 2.1 time: 0.133580 Oct 04 18:37:57.398680 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1216/2504] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Oct 4 18:37:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-106997717 => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:37:57.405866 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3e5bb759-3d6e-4fe4-abfc-2be444e81058 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:57.406936 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3e5bb759-3d6e-4fe4-abfc-2be444e81058 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] [instance: 0bef06d7-ba85-4f48-bd08-228211391394] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:57.408025 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-797bd5aa-8a02-44e6-8b5b-72a6b13c2a57 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73127bc6636476482e280eddad7f66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9174b09e32064811a61539c64992ee50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:57.414850 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3e5bb759-3d6e-4fe4-abfc-2be444e81058 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:57.415353 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3e5bb759-3d6e-4fe4-abfc-2be444e81058 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:57.415789 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3e5bb759-3d6e-4fe4-abfc-2be444e81058 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:57.416693 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3e5bb759-3d6e-4fe4-abfc-2be444e81058 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:57.417316 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3e5bb759-3d6e-4fe4-abfc-2be444e81058 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:57.417893 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3e5bb759-3d6e-4fe4-abfc-2be444e81058 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:57.423229 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-797bd5aa-8a02-44e6-8b5b-72a6b13c2a57 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] 10.222.0.20 "GET /compute/v2.1/servers/b319d463-fa0d-4e2d-b03f-6227475572da" status: 200 len: 1295 microversion: 2.1 time: 0.154407 Oct 04 18:37:57.423229 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1289/2505] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:57 2022] GET /compute/v2.1/servers/b319d463-fa0d-4e2d-b03f-6227475572da => generated 1295 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:57.531808 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3e5bb759-3d6e-4fe4-abfc-2be444e81058 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:57.541506 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3e5bb759-3d6e-4fe4-abfc-2be444e81058 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:57.543196 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3e5bb759-3d6e-4fe4-abfc-2be444e81058 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:57.545407 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3e5bb759-3d6e-4fe4-abfc-2be444e81058 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] 10.222.0.20 "GET /compute/v2.1/servers/0bef06d7-ba85-4f48-bd08-228211391394" status: 200 len: 1366 microversion: 2.57 time: 0.145674 Oct 04 18:37:57.546517 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1217/2506] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:57 2022] GET /compute/v2.1/servers/0bef06d7-ba85-4f48-bd08-228211391394 => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:37:57.564441 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0c8f8bd2-0e53-448a-839c-fed4c5dd92bb tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:57.565803 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0c8f8bd2-0e53-448a-839c-fed4c5dd92bb tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 98dfffc8-51aa-407a-a374-8e120ec43a31] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:57.576495 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0c8f8bd2-0e53-448a-839c-fed4c5dd92bb tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:57.577057 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0c8f8bd2-0e53-448a-839c-fed4c5dd92bb tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:57.584359 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0c8f8bd2-0e53-448a-839c-fed4c5dd92bb tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:57.584359 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0c8f8bd2-0e53-448a-839c-fed4c5dd92bb tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:57.584359 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0c8f8bd2-0e53-448a-839c-fed4c5dd92bb tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:57.584359 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0c8f8bd2-0e53-448a-839c-fed4c5dd92bb tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:57.829834 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0c8f8bd2-0e53-448a-839c-fed4c5dd92bb tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:57.843947 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0c8f8bd2-0e53-448a-839c-fed4c5dd92bb tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31" status: 200 len: 1392 microversion: 2.1 time: 0.287264 Oct 04 18:37:57.844724 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1290/2507] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:57 2022] GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31 => generated 1392 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:57.876980 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ac5efd73-8994-4671-b740-140167640cd4 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:57.877775 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ac5efd73-8994-4671-b740-140167640cd4 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 474a799f-8e38-49d6-8fff-9ec3e7657ef5] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:57.885856 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ac5efd73-8994-4671-b740-140167640cd4 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:57.886356 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ac5efd73-8994-4671-b740-140167640cd4 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:57.886829 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ac5efd73-8994-4671-b740-140167640cd4 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:57.888249 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ac5efd73-8994-4671-b740-140167640cd4 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:57.888709 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ac5efd73-8994-4671-b740-140167640cd4 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:57.889143 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ac5efd73-8994-4671-b740-140167640cd4 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:58.192620 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ac5efd73-8994-4671-b740-140167640cd4 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:58.221439 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ac5efd73-8994-4671-b740-140167640cd4 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5" status: 200 len: 1542 microversion: 2.1 time: 0.334635 Oct 04 18:37:58.221439 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1218/2508] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:57 2022] GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5 => generated 1542 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:58.285770 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7aa7027f-ce11-4b05-9bd7-4a76fe13144f tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:58.292251 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7aa7027f-ce11-4b05-9bd7-4a76fe13144f tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 61ec7cca-1572-496c-ba44-439f04c2a79c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:58.298287 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7aa7027f-ce11-4b05-9bd7-4a76fe13144f tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:58.298880 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7aa7027f-ce11-4b05-9bd7-4a76fe13144f tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:58.299391 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7aa7027f-ce11-4b05-9bd7-4a76fe13144f tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:58.301682 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7aa7027f-ce11-4b05-9bd7-4a76fe13144f tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:58.302294 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7aa7027f-ce11-4b05-9bd7-4a76fe13144f tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:58.302524 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ba694042-069a-46bc-b264-f25e058506bd tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:58.303304 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ba694042-069a-46bc-b264-f25e058506bd tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: b219d988-2847-45a0-a3b8-af54cf1a43f8] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:58.303907 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7aa7027f-ce11-4b05-9bd7-4a76fe13144f tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:58.315055 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ba694042-069a-46bc-b264-f25e058506bd tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:58.319587 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ba694042-069a-46bc-b264-f25e058506bd tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:58.320201 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ba694042-069a-46bc-b264-f25e058506bd tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:58.321079 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ba694042-069a-46bc-b264-f25e058506bd tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:58.321550 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ba694042-069a-46bc-b264-f25e058506bd tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:58.324393 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ba694042-069a-46bc-b264-f25e058506bd tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:58.649522 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7aa7027f-ce11-4b05-9bd7-4a76fe13144f tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8284fe51decd4db0bf6b3ed1514cc2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87473abf47e74adf844e3ddfa24da3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:58.665258 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7aa7027f-ce11-4b05-9bd7-4a76fe13144f tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] 10.222.0.20 "GET /compute/v2.1/servers/61ec7cca-1572-496c-ba44-439f04c2a79c" status: 200 len: 1505 microversion: 2.1 time: 0.383697 Oct 04 18:37:58.666072 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1291/2509] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:58 2022] GET /compute/v2.1/servers/61ec7cca-1572-496c-ba44-439f04c2a79c => generated 1505 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:58.684335 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0b23847b-bd0f-4001-b0a7-cb108fdd43fe tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:58.692123 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0b23847b-bd0f-4001-b0a7-cb108fdd43fe tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] [instance: b319d463-fa0d-4e2d-b03f-6227475572da] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:58.699429 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0b23847b-bd0f-4001-b0a7-cb108fdd43fe tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:58.700589 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0b23847b-bd0f-4001-b0a7-cb108fdd43fe tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:58.701374 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0b23847b-bd0f-4001-b0a7-cb108fdd43fe tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:58.702487 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0b23847b-bd0f-4001-b0a7-cb108fdd43fe tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:58.707303 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0b23847b-bd0f-4001-b0a7-cb108fdd43fe tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:58.708184 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0b23847b-bd0f-4001-b0a7-cb108fdd43fe tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:58.802766 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ba694042-069a-46bc-b264-f25e058506bd tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:58.813904 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ba694042-069a-46bc-b264-f25e058506bd tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:58.821980 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ba694042-069a-46bc-b264-f25e058506bd tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:58.832302 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ba694042-069a-46bc-b264-f25e058506bd tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8" status: 200 len: 1729 microversion: 2.25 time: 0.525171 Oct 04 18:37:58.832302 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1219/2510] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:58 2022] GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8 => generated 1729 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:37:58.832302 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2c2ca842-46ac-4437-9fd4-2e4bd6f312aa tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:58.832302 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2c2ca842-46ac-4437-9fd4-2e4bd6f312aa tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] [instance: 0bef06d7-ba85-4f48-bd08-228211391394] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:58.850266 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2c2ca842-46ac-4437-9fd4-2e4bd6f312aa tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:58.857326 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2c2ca842-46ac-4437-9fd4-2e4bd6f312aa tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:58.858010 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2c2ca842-46ac-4437-9fd4-2e4bd6f312aa tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:58.858936 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2c2ca842-46ac-4437-9fd4-2e4bd6f312aa tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:58.867312 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2c2ca842-46ac-4437-9fd4-2e4bd6f312aa tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:58.867312 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2c2ca842-46ac-4437-9fd4-2e4bd6f312aa tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:58.900439 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0b23847b-bd0f-4001-b0a7-cb108fdd43fe tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73127bc6636476482e280eddad7f66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9174b09e32064811a61539c64992ee50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:58.916470 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0b23847b-bd0f-4001-b0a7-cb108fdd43fe tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] 10.222.0.20 "GET /compute/v2.1/servers/b319d463-fa0d-4e2d-b03f-6227475572da" status: 200 len: 1301 microversion: 2.1 time: 0.238953 Oct 04 18:37:58.920357 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1292/2511] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:58 2022] GET /compute/v2.1/servers/b319d463-fa0d-4e2d-b03f-6227475572da => generated 1301 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:58.953407 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2e9eca89-d8d1-420d-95c3-0a40c327dfb8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:58.954531 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2e9eca89-d8d1-420d-95c3-0a40c327dfb8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 98dfffc8-51aa-407a-a374-8e120ec43a31] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:58.968150 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e9eca89-d8d1-420d-95c3-0a40c327dfb8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:58.968886 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e9eca89-d8d1-420d-95c3-0a40c327dfb8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:58.970260 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e9eca89-d8d1-420d-95c3-0a40c327dfb8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:58.970260 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e9eca89-d8d1-420d-95c3-0a40c327dfb8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:58.970858 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e9eca89-d8d1-420d-95c3-0a40c327dfb8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:58.971483 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e9eca89-d8d1-420d-95c3-0a40c327dfb8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:59.060499 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-2c2ca842-46ac-4437-9fd4-2e4bd6f312aa tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:59.080829 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-2c2ca842-46ac-4437-9fd4-2e4bd6f312aa tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:59.082778 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-2c2ca842-46ac-4437-9fd4-2e4bd6f312aa tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:59.084458 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2c2ca842-46ac-4437-9fd4-2e4bd6f312aa tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] 10.222.0.20 "GET /compute/v2.1/servers/0bef06d7-ba85-4f48-bd08-228211391394" status: 200 len: 1366 microversion: 2.57 time: 0.259527 Oct 04 18:37:59.112426 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1220/2512] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:58 2022] GET /compute/v2.1/servers/0bef06d7-ba85-4f48-bd08-228211391394 => generated 1366 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:37:59.229137 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-588f114a-305d-4975-8c76-cdb46dba936d tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:59.229745 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-588f114a-305d-4975-8c76-cdb46dba936d tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 474a799f-8e38-49d6-8fff-9ec3e7657ef5] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:59.242528 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-588f114a-305d-4975-8c76-cdb46dba936d tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:59.244912 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-588f114a-305d-4975-8c76-cdb46dba936d tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:59.246037 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-588f114a-305d-4975-8c76-cdb46dba936d tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:59.248968 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-588f114a-305d-4975-8c76-cdb46dba936d tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:59.250927 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-588f114a-305d-4975-8c76-cdb46dba936d tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:59.256735 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-588f114a-305d-4975-8c76-cdb46dba936d tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:59.333158 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2e9eca89-d8d1-420d-95c3-0a40c327dfb8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:59.362835 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2e9eca89-d8d1-420d-95c3-0a40c327dfb8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31" status: 200 len: 1392 microversion: 2.1 time: 0.418157 Oct 04 18:37:59.363663 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1293/2513] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:58 2022] GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31 => generated 1392 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:59.678863 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-588f114a-305d-4975-8c76-cdb46dba936d tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:59.703827 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a2fe62c8-4ec0-4413-a098-987f816d29c4 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:59.703827 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a2fe62c8-4ec0-4413-a098-987f816d29c4 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 61ec7cca-1572-496c-ba44-439f04c2a79c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:59.711604 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-588f114a-305d-4975-8c76-cdb46dba936d tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5" status: 200 len: 1542 microversion: 2.1 time: 0.487074 Oct 04 18:37:59.715305 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a2fe62c8-4ec0-4413-a098-987f816d29c4 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:59.715857 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a2fe62c8-4ec0-4413-a098-987f816d29c4 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:59.716327 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a2fe62c8-4ec0-4413-a098-987f816d29c4 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:59.717053 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a2fe62c8-4ec0-4413-a098-987f816d29c4 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:59.717514 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a2fe62c8-4ec0-4413-a098-987f816d29c4 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:59.717943 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a2fe62c8-4ec0-4413-a098-987f816d29c4 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:59.720519 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1221/2514] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:59 2022] GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5 => generated 1542 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:37:59.859013 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f1a9bc5e-6747-4f9a-88b6-5a0205d12696 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:59.861034 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f1a9bc5e-6747-4f9a-88b6-5a0205d12696 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: b219d988-2847-45a0-a3b8-af54cf1a43f8] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:59.889246 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f1a9bc5e-6747-4f9a-88b6-5a0205d12696 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:59.890734 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f1a9bc5e-6747-4f9a-88b6-5a0205d12696 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:59.893493 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f1a9bc5e-6747-4f9a-88b6-5a0205d12696 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:59.897939 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f1a9bc5e-6747-4f9a-88b6-5a0205d12696 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:59.898676 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f1a9bc5e-6747-4f9a-88b6-5a0205d12696 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:59.899137 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f1a9bc5e-6747-4f9a-88b6-5a0205d12696 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:59.915929 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:38:00.185556 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f1a9bc5e-6747-4f9a-88b6-5a0205d12696 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:00.210762 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f1a9bc5e-6747-4f9a-88b6-5a0205d12696 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:00.213335 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f1a9bc5e-6747-4f9a-88b6-5a0205d12696 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:00.222189 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f1a9bc5e-6747-4f9a-88b6-5a0205d12696 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8" status: 200 len: 1662 microversion: 2.25 time: 0.367245 Oct 04 18:38:00.223488 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1222/2515] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:59 2022] GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8 => generated 1662 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:00.242860 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8bcc9cf1-5d20-43a2-95d6-f529949cf670 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:00.248794 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8bcc9cf1-5d20-43a2-95d6-f529949cf670 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] [instance: b319d463-fa0d-4e2d-b03f-6227475572da] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:00.265552 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8bcc9cf1-5d20-43a2-95d6-f529949cf670 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:00.265552 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8bcc9cf1-5d20-43a2-95d6-f529949cf670 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:00.265552 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8bcc9cf1-5d20-43a2-95d6-f529949cf670 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:00.265552 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8bcc9cf1-5d20-43a2-95d6-f529949cf670 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:00.265552 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8bcc9cf1-5d20-43a2-95d6-f529949cf670 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:00.265552 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8bcc9cf1-5d20-43a2-95d6-f529949cf670 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:00.612486 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a2fe62c8-4ec0-4413-a098-987f816d29c4 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8284fe51decd4db0bf6b3ed1514cc2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87473abf47e74adf844e3ddfa24da3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:00.634141 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a2fe62c8-4ec0-4413-a098-987f816d29c4 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] 10.222.0.20 "GET /compute/v2.1/servers/61ec7cca-1572-496c-ba44-439f04c2a79c" status: 200 len: 1505 microversion: 2.1 time: 0.943222 Oct 04 18:38:00.638293 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1294/2516] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:59 2022] GET /compute/v2.1/servers/61ec7cca-1572-496c-ba44-439f04c2a79c => generated 1505 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:38:00.650798 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-50c5b6f2-acef-4c20-a6ed-a1e04fb6d944 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:00.654938 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-50c5b6f2-acef-4c20-a6ed-a1e04fb6d944 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] [instance: 0bef06d7-ba85-4f48-bd08-228211391394] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:00.672430 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-50c5b6f2-acef-4c20-a6ed-a1e04fb6d944 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:00.673163 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-50c5b6f2-acef-4c20-a6ed-a1e04fb6d944 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:00.673612 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-50c5b6f2-acef-4c20-a6ed-a1e04fb6d944 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:00.674464 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-50c5b6f2-acef-4c20-a6ed-a1e04fb6d944 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:00.675075 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-50c5b6f2-acef-4c20-a6ed-a1e04fb6d944 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:00.675613 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-50c5b6f2-acef-4c20-a6ed-a1e04fb6d944 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:00.747722 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8bcc9cf1-5d20-43a2-95d6-f529949cf670 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73127bc6636476482e280eddad7f66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9174b09e32064811a61539c64992ee50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:00.757435 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8bcc9cf1-5d20-43a2-95d6-f529949cf670 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] 10.222.0.20 "GET /compute/v2.1/servers/b319d463-fa0d-4e2d-b03f-6227475572da" status: 200 len: 1369 microversion: 2.1 time: 0.531545 Oct 04 18:38:00.763211 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1223/2517] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:00 2022] GET /compute/v2.1/servers/b319d463-fa0d-4e2d-b03f-6227475572da => generated 1369 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:00.774263 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a841e7df-d276-49b9-8187-7f320fef3bc5 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:00.781301 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a841e7df-d276-49b9-8187-7f320fef3bc5 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 98dfffc8-51aa-407a-a374-8e120ec43a31] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:00.792935 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a841e7df-d276-49b9-8187-7f320fef3bc5 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:00.794097 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a841e7df-d276-49b9-8187-7f320fef3bc5 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:00.797807 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a841e7df-d276-49b9-8187-7f320fef3bc5 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:00.798781 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a841e7df-d276-49b9-8187-7f320fef3bc5 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:00.799662 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a841e7df-d276-49b9-8187-7f320fef3bc5 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:00.805613 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a841e7df-d276-49b9-8187-7f320fef3bc5 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:00.852994 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-50c5b6f2-acef-4c20-a6ed-a1e04fb6d944 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:00.897373 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-50c5b6f2-acef-4c20-a6ed-a1e04fb6d944 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:00.898920 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-50c5b6f2-acef-4c20-a6ed-a1e04fb6d944 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:00.900176 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-50c5b6f2-acef-4c20-a6ed-a1e04fb6d944 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] 10.222.0.20 "GET /compute/v2.1/servers/0bef06d7-ba85-4f48-bd08-228211391394" status: 200 len: 1366 microversion: 2.57 time: 0.260805 Oct 04 18:38:00.901101 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1295/2518] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:00 2022] GET /compute/v2.1/servers/0bef06d7-ba85-4f48-bd08-228211391394 => generated 1366 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:00.906724 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a6774d2f-308b-48a2-9d74-ed627243049d tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:00.908998 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a6774d2f-308b-48a2-9d74-ed627243049d tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 474a799f-8e38-49d6-8fff-9ec3e7657ef5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:00.914963 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a6774d2f-308b-48a2-9d74-ed627243049d tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:00.915926 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a6774d2f-308b-48a2-9d74-ed627243049d tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:00.920339 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a6774d2f-308b-48a2-9d74-ed627243049d tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:00.921341 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a6774d2f-308b-48a2-9d74-ed627243049d tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:00.922033 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a6774d2f-308b-48a2-9d74-ed627243049d tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:00.922892 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a6774d2f-308b-48a2-9d74-ed627243049d tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:01.674517 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a6774d2f-308b-48a2-9d74-ed627243049d tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:01.682860 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a6774d2f-308b-48a2-9d74-ed627243049d tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5" status: 200 len: 1542 microversion: 2.1 time: 0.780480 Oct 04 18:38:01.689850 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1296/2519] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:00 2022] GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5 => generated 1542 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:01.756463 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a841e7df-d276-49b9-8187-7f320fef3bc5 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:01.777804 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a841e7df-d276-49b9-8187-7f320fef3bc5 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31" status: 200 len: 1392 microversion: 2.1 time: 1.010770 Oct 04 18:38:01.780895 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1224/2520] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:00 2022] GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31 => generated 1392 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:01.794507 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8e8c5555-a86f-4d15-bcf4-4cd66469005a tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:01.795131 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8e8c5555-a86f-4d15-bcf4-4cd66469005a tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: b219d988-2847-45a0-a3b8-af54cf1a43f8] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:01.823675 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8e8c5555-a86f-4d15-bcf4-4cd66469005a tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:01.826536 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8e8c5555-a86f-4d15-bcf4-4cd66469005a tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:01.827177 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8e8c5555-a86f-4d15-bcf4-4cd66469005a tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:01.828101 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8e8c5555-a86f-4d15-bcf4-4cd66469005a tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:01.830426 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8e8c5555-a86f-4d15-bcf4-4cd66469005a tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:01.831030 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8e8c5555-a86f-4d15-bcf4-4cd66469005a tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:01.955710 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8e8c5555-a86f-4d15-bcf4-4cd66469005a tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:01.956198 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8e8c5555-a86f-4d15-bcf4-4cd66469005a tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:01.974568 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8e8c5555-a86f-4d15-bcf4-4cd66469005a tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:01.974568 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-8e8c5555-a86f-4d15-bcf4-4cd66469005a tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lazy-loading 'fault' on Instance uuid b219d988-2847-45a0-a3b8-af54cf1a43f8 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:38:02.034558 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-2cc9c359-6990-4c19-a732-721f047c063d req-69e4c38d-656a-4c2c-af53-621d8d15a32f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b219d988-2847-45a0-a3b8-af54cf1a43f8", "name": "network-vif-deleted", "tag": "581c676f-096d-4159-ae53-d455ac141b32"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:02.083830 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-2cc9c359-6990-4c19-a732-721f047c063d req-69e4c38d-656a-4c2c-af53-621d8d15a32f service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:02.084447 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-2cc9c359-6990-4c19-a732-721f047c063d req-69e4c38d-656a-4c2c-af53-621d8d15a32f service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:02.092715 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-2cc9c359-6990-4c19-a732-721f047c063d req-69e4c38d-656a-4c2c-af53-621d8d15a32f service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:02.105666 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-2cc9c359-6990-4c19-a732-721f047c063d req-69e4c38d-656a-4c2c-af53-621d8d15a32f service nova] Creating event network-vif-deleted:581c676f-096d-4159-ae53-d455ac141b32 for instance b219d988-2847-45a0-a3b8-af54cf1a43f8 on n-h2-850501-14 Oct 04 18:38:02.114490 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-2cc9c359-6990-4c19-a732-721f047c063d req-69e4c38d-656a-4c2c-af53-621d8d15a32f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.406553 Oct 04 18:38:02.115116 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1297/2521] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:38:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:02.127537 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2cf814e1-2d46-4176-8009-651bfe4543f2 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:02.127537 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2cf814e1-2d46-4176-8009-651bfe4543f2 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 61ec7cca-1572-496c-ba44-439f04c2a79c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:02.132838 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2cf814e1-2d46-4176-8009-651bfe4543f2 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:02.133523 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2cf814e1-2d46-4176-8009-651bfe4543f2 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:02.134305 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2cf814e1-2d46-4176-8009-651bfe4543f2 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:02.135151 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2cf814e1-2d46-4176-8009-651bfe4543f2 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:02.135751 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2cf814e1-2d46-4176-8009-651bfe4543f2 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:02.136509 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2cf814e1-2d46-4176-8009-651bfe4543f2 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:02.326460 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8e8c5555-a86f-4d15-bcf4-4cd66469005a tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:02.342344 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8e8c5555-a86f-4d15-bcf4-4cd66469005a tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:02.356514 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8e8c5555-a86f-4d15-bcf4-4cd66469005a tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:02.360458 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8e8c5555-a86f-4d15-bcf4-4cd66469005a tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8" status: 200 len: 1374 microversion: 2.25 time: 0.577803 Oct 04 18:38:02.361062 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1225/2522] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:01 2022] GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8 => generated 1374 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:02.387788 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-bf626a0d-38e7-42b1-a53d-286b91be9ea1 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:02.389442 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-bf626a0d-38e7-42b1-a53d-286b91be9ea1 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] [instance: b319d463-fa0d-4e2d-b03f-6227475572da] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:02.419747 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bf626a0d-38e7-42b1-a53d-286b91be9ea1 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:02.420601 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bf626a0d-38e7-42b1-a53d-286b91be9ea1 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:02.425152 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bf626a0d-38e7-42b1-a53d-286b91be9ea1 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:02.426005 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bf626a0d-38e7-42b1-a53d-286b91be9ea1 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:02.426484 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bf626a0d-38e7-42b1-a53d-286b91be9ea1 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:02.428504 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bf626a0d-38e7-42b1-a53d-286b91be9ea1 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:02.872592 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:38:03.458105 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2cf814e1-2d46-4176-8009-651bfe4543f2 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8284fe51decd4db0bf6b3ed1514cc2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87473abf47e74adf844e3ddfa24da3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:03.505319 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2cf814e1-2d46-4176-8009-651bfe4543f2 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] 10.222.0.20 "GET /compute/v2.1/servers/61ec7cca-1572-496c-ba44-439f04c2a79c" status: 200 len: 1505 microversion: 2.1 time: 1.385012 Oct 04 18:38:03.507343 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1298/2523] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:02 2022] GET /compute/v2.1/servers/61ec7cca-1572-496c-ba44-439f04c2a79c => generated 1505 bytes in 1391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:03.539268 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-075be4b1-548a-4c4d-a6ea-406a2726b055 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:03.540225 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-075be4b1-548a-4c4d-a6ea-406a2726b055 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] [instance: 0bef06d7-ba85-4f48-bd08-228211391394] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:03.548897 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-075be4b1-548a-4c4d-a6ea-406a2726b055 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:03.549652 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-075be4b1-548a-4c4d-a6ea-406a2726b055 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:03.551036 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-075be4b1-548a-4c4d-a6ea-406a2726b055 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:03.552841 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-075be4b1-548a-4c4d-a6ea-406a2726b055 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:03.553574 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-075be4b1-548a-4c4d-a6ea-406a2726b055 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:03.554146 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-075be4b1-548a-4c4d-a6ea-406a2726b055 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:03.759743 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-075be4b1-548a-4c4d-a6ea-406a2726b055 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:03.770718 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-075be4b1-548a-4c4d-a6ea-406a2726b055 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:03.772197 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-075be4b1-548a-4c4d-a6ea-406a2726b055 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:03.773569 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-075be4b1-548a-4c4d-a6ea-406a2726b055 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] 10.222.0.20 "GET /compute/v2.1/servers/0bef06d7-ba85-4f48-bd08-228211391394" status: 200 len: 1366 microversion: 2.57 time: 0.240714 Oct 04 18:38:03.774355 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1299/2524] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:03 2022] GET /compute/v2.1/servers/0bef06d7-ba85-4f48-bd08-228211391394 => generated 1366 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:03.792132 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c4a75bbb-bc5c-4f1f-b380-015b438514d8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:03.792764 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c4a75bbb-bc5c-4f1f-b380-015b438514d8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 474a799f-8e38-49d6-8fff-9ec3e7657ef5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:03.802904 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-bf626a0d-38e7-42b1-a53d-286b91be9ea1 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73127bc6636476482e280eddad7f66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9174b09e32064811a61539c64992ee50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:03.814422 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c4a75bbb-bc5c-4f1f-b380-015b438514d8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:03.815269 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c4a75bbb-bc5c-4f1f-b380-015b438514d8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:03.815978 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c4a75bbb-bc5c-4f1f-b380-015b438514d8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:03.817030 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c4a75bbb-bc5c-4f1f-b380-015b438514d8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:03.817496 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c4a75bbb-bc5c-4f1f-b380-015b438514d8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:03.819780 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c4a75bbb-bc5c-4f1f-b380-015b438514d8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:03.830594 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-bf626a0d-38e7-42b1-a53d-286b91be9ea1 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] 10.222.0.20 "GET /compute/v2.1/servers/b319d463-fa0d-4e2d-b03f-6227475572da" status: 200 len: 1369 microversion: 2.1 time: 1.465997 Oct 04 18:38:03.832270 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1226/2525] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:02 2022] GET /compute/v2.1/servers/b319d463-fa0d-4e2d-b03f-6227475572da => generated 1369 bytes in 1471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:03.872922 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-fb95067d-1776-4f9a-ba28-e3a1de964764 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:03.873801 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-fb95067d-1776-4f9a-ba28-e3a1de964764 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 98dfffc8-51aa-407a-a374-8e120ec43a31] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:03.895816 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fb95067d-1776-4f9a-ba28-e3a1de964764 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:03.897371 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fb95067d-1776-4f9a-ba28-e3a1de964764 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:03.899718 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fb95067d-1776-4f9a-ba28-e3a1de964764 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:03.902423 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fb95067d-1776-4f9a-ba28-e3a1de964764 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:03.903574 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fb95067d-1776-4f9a-ba28-e3a1de964764 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:03.907843 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fb95067d-1776-4f9a-ba28-e3a1de964764 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:04.408156 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c4a75bbb-bc5c-4f1f-b380-015b438514d8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:04.422331 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c4a75bbb-bc5c-4f1f-b380-015b438514d8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5" status: 200 len: 1542 microversion: 2.1 time: 0.646796 Oct 04 18:38:04.423098 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1300/2526] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:03 2022] GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5 => generated 1542 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:04.427745 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7d24cda0-b5c7-4b8d-82d4-f6f54020ea16 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:04.437373 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7d24cda0-b5c7-4b8d-82d4-f6f54020ea16 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: b219d988-2847-45a0-a3b8-af54cf1a43f8] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:04.455650 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7d24cda0-b5c7-4b8d-82d4-f6f54020ea16 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:04.456296 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7d24cda0-b5c7-4b8d-82d4-f6f54020ea16 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:04.456794 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7d24cda0-b5c7-4b8d-82d4-f6f54020ea16 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:04.457505 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7d24cda0-b5c7-4b8d-82d4-f6f54020ea16 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:04.458062 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7d24cda0-b5c7-4b8d-82d4-f6f54020ea16 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:04.458571 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7d24cda0-b5c7-4b8d-82d4-f6f54020ea16 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:04.489657 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-7d24cda0-b5c7-4b8d-82d4-f6f54020ea16 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] HTTP exception thrown: Instance b219d988-2847-45a0-a3b8-af54cf1a43f8 could not be found. Oct 04 18:38:04.491328 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7d24cda0-b5c7-4b8d-82d4-f6f54020ea16 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Request method failure captured: Oct 04 18:38:04.491328 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8 HTTP/1.1 Oct 04 18:38:04.491328 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:38:04.491328 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:38:04.491328 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:38:04.491328 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:38:04.491328 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:38:04.491328 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:38:04.491328 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:38:04.491328 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:38:04.491328 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPHup0Mt_OyDwnruja4S1gmdmaCVMO4uXecUyp2F0Y8-1G2eggJOcOg62Ru7-OxnxnTV3tLeieUdQsjcRftin5u12YtjniY2GtodDByQDpmATG8MPRb-XNcR4e8kX0gQWaLrGaVgyqdxnogKK8Swq664D-K5SgTZfp2H1qk6W31Bqe5k Oct 04 18:38:04.491328 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:38:04.491328 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:38:04.491328 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:38:04.491328 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:38:04.491328 n-d-850501-14 devstack@n-api.service[123002]: X-Openstack-Nova-Api-Version: 2.25 Oct 04 18:38:04.491328 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:38:04.491328 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:38:04.491328 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 1fdde079f17642c69fb250c78903d69c Oct 04 18:38:04.491328 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-842433930 Oct 04 18:38:04.491328 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:38:04.491328 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:38:04.491328 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1fdde079f17642c69fb250c78903d69c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1fdde079f17642c69fb250c78903d69c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1fdde079f17642c69fb250c78903d69c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1fdde079f17642c69fb250c78903d69c"}]}] Oct 04 18:38:04.491328 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-842433930 Oct 04 18:38:04.491328 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 1fdde079f17642c69fb250c78903d69c Oct 04 18:38:04.491328 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-842433930 Oct 04 18:38:04.491328 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-LiveAutoBlockMigrationV225Test-842433930-project Oct 04 18:38:04.491328 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:38:04.491328 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:38:04.491328 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: f1dec45626f44157a6f4637e668097b4 Oct 04 18:38:04.491328 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-842433930-project Oct 04 18:38:04.491328 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:38:04.491328 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance b219d988-2847-45a0-a3b8-af54cf1a43f8 could not be found. Oct 04 18:38:04.491328 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'b219d988-2847-45a0-a3b8-af54cf1a43f8'} Oct 04 18:38:04.491328 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:38:04.491328 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:38:04.491328 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:38:04.491328 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:38:04.491328 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:38:04.491328 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:38:04.491328 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:38:04.491328 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:38:04.491328 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:38:04.491328 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:38:04.491328 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b219d988-2847-45a0-a3b8-af54cf1a43f8 could not be found. Oct 04 18:38:04.491328 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:38:04.491328 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:38:04.491328 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:38:04.491328 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:38:04.491328 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:38:04.491328 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:38:04.491328 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:38:04.491328 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:38:04.491328 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:38:04.491328 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:38:04.491328 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:38:04.491328 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:38:04.491328 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:38:04.491328 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:38:04.491328 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:38:04.491328 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:38:04.491328 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b219d988-2847-45a0-a3b8-af54cf1a43f8 could not be found. Oct 04 18:38:04.491328 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:38:04.502471 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:38:04.502471 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:38:04.502471 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:38:04.502471 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:38:04.502471 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:38:04.502471 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:38:04.502471 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:38:04.502471 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b219d988-2847-45a0-a3b8-af54cf1a43f8 could not be found. Oct 04 18:38:04.502471 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:38:04.502471 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7d24cda0-b5c7-4b8d-82d4-f6f54020ea16 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Returning 404 to user: Instance b219d988-2847-45a0-a3b8-af54cf1a43f8 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:38:04.502471 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7d24cda0-b5c7-4b8d-82d4-f6f54020ea16 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8" status: 404 len: 111 microversion: 2.25 time: 0.069584 Oct 04 18:38:04.502471 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1301/2527] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:04 2022] GET /compute/v2.1/servers/b219d988-2847-45a0-a3b8-af54cf1a43f8 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:38:04.515831 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-333f5f73-1310-432a-9701-7de2d206a37c req-2e85b74f-ba55-41fe-b094-f1a27037619f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b319d463-fa0d-4e2d-b03f-6227475572da", "tag": "617a3d5c-1b67-469f-ad73-1ceedb040447"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:04.557096 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-333f5f73-1310-432a-9701-7de2d206a37c req-2e85b74f-ba55-41fe-b094-f1a27037619f service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:04.560671 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-333f5f73-1310-432a-9701-7de2d206a37c req-2e85b74f-ba55-41fe-b094-f1a27037619f service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:04.560671 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-333f5f73-1310-432a-9701-7de2d206a37c req-2e85b74f-ba55-41fe-b094-f1a27037619f service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:04.609176 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-333f5f73-1310-432a-9701-7de2d206a37c req-2e85b74f-ba55-41fe-b094-f1a27037619f service nova] Creating event network-changed:617a3d5c-1b67-469f-ad73-1ceedb040447 for instance b319d463-fa0d-4e2d-b03f-6227475572da on n-h1-850501-14 Oct 04 18:38:04.620411 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-fb95067d-1776-4f9a-ba28-e3a1de964764 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:04.635198 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-fb95067d-1776-4f9a-ba28-e3a1de964764 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31" status: 200 len: 1392 microversion: 2.1 time: 0.799339 Oct 04 18:38:04.636045 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1227/2528] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:03 2022] GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31 => generated 1392 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:04.643015 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-333f5f73-1310-432a-9701-7de2d206a37c req-2e85b74f-ba55-41fe-b094-f1a27037619f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139790 Oct 04 18:38:04.645158 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1302/2529] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:38:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:04.645837 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-73232741-d670-43a3-908f-adc79b706194 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '.version_select at 0x7fe258200ca0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:04.657020 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-764a09f4-1d40-445d-b658-5fe38be2d477 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:04.664453 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-764a09f4-1d40-445d-b658-5fe38be2d477 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 61ec7cca-1572-496c-ba44-439f04c2a79c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:04.684095 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-764a09f4-1d40-445d-b658-5fe38be2d477 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:04.685820 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-764a09f4-1d40-445d-b658-5fe38be2d477 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:04.686319 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-764a09f4-1d40-445d-b658-5fe38be2d477 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:04.701770 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-764a09f4-1d40-445d-b658-5fe38be2d477 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:04.702345 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-764a09f4-1d40-445d-b658-5fe38be2d477 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:04.702813 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-764a09f4-1d40-445d-b658-5fe38be2d477 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:04.833699 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-73232741-d670-43a3-908f-adc79b706194 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-265724266" status: 204 len: 0 microversion: 2.25 time: 0.195231 Oct 04 18:38:04.834824 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1228/2530] 10.222.0.20 () {60 vars in 1259 bytes} [Tue Oct 4 18:38:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-265724266 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:38:04.850738 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-05489e7c-ee9d-483c-b267-ad339f38f852 req-9ad0c483-245c-47ce-b528-2c5df2f8cad3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98dfffc8-51aa-407a-a374-8e120ec43a31", "name": "network-vif-unplugged", "status": "completed", "tag": "0f1337d3-c904-4533-8791-cffcbc2b23d5"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:04.891235 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-05489e7c-ee9d-483c-b267-ad339f38f852 req-9ad0c483-245c-47ce-b528-2c5df2f8cad3 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:04.891884 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-05489e7c-ee9d-483c-b267-ad339f38f852 req-9ad0c483-245c-47ce-b528-2c5df2f8cad3 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:04.892430 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-05489e7c-ee9d-483c-b267-ad339f38f852 req-9ad0c483-245c-47ce-b528-2c5df2f8cad3 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:04.915742 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-05489e7c-ee9d-483c-b267-ad339f38f852 req-9ad0c483-245c-47ce-b528-2c5df2f8cad3 service nova] Creating event network-vif-unplugged:0f1337d3-c904-4533-8791-cffcbc2b23d5 for instance 98dfffc8-51aa-407a-a374-8e120ec43a31 on n-h2-850501-14 Oct 04 18:38:04.927557 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-05489e7c-ee9d-483c-b267-ad339f38f852 req-9ad0c483-245c-47ce-b528-2c5df2f8cad3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.091105 Oct 04 18:38:04.930679 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1229/2531] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:38:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:04.944294 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-56d26fe3-77cb-4993-a2df-d5831e71f830 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:04.946478 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-56d26fe3-77cb-4993-a2df-d5831e71f830 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] [instance: 0bef06d7-ba85-4f48-bd08-228211391394] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:04.963512 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-56d26fe3-77cb-4993-a2df-d5831e71f830 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:04.967744 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-56d26fe3-77cb-4993-a2df-d5831e71f830 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:04.968588 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-56d26fe3-77cb-4993-a2df-d5831e71f830 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:04.969594 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-56d26fe3-77cb-4993-a2df-d5831e71f830 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:04.971400 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-56d26fe3-77cb-4993-a2df-d5831e71f830 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:04.972555 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-56d26fe3-77cb-4993-a2df-d5831e71f830 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:05.287821 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-56d26fe3-77cb-4993-a2df-d5831e71f830 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:05.308448 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-56d26fe3-77cb-4993-a2df-d5831e71f830 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:05.311130 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-56d26fe3-77cb-4993-a2df-d5831e71f830 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:05.313099 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-56d26fe3-77cb-4993-a2df-d5831e71f830 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] 10.222.0.20 "GET /compute/v2.1/servers/0bef06d7-ba85-4f48-bd08-228211391394" status: 200 len: 1366 microversion: 2.57 time: 0.380602 Oct 04 18:38:05.314253 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1230/2532] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:04 2022] GET /compute/v2.1/servers/0bef06d7-ba85-4f48-bd08-228211391394 => generated 1366 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:05.331813 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-cbee7973-9783-46c8-a8e9-ab05a4f0e7c0 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:05.332500 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-cbee7973-9783-46c8-a8e9-ab05a4f0e7c0 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] [instance: b319d463-fa0d-4e2d-b03f-6227475572da] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:05.341064 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cbee7973-9783-46c8-a8e9-ab05a4f0e7c0 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:05.341651 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cbee7973-9783-46c8-a8e9-ab05a4f0e7c0 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:05.342105 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cbee7973-9783-46c8-a8e9-ab05a4f0e7c0 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:05.342991 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cbee7973-9783-46c8-a8e9-ab05a4f0e7c0 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:05.343567 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cbee7973-9783-46c8-a8e9-ab05a4f0e7c0 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:05.344147 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cbee7973-9783-46c8-a8e9-ab05a4f0e7c0 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:05.434164 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-764a09f4-1d40-445d-b658-5fe38be2d477 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8284fe51decd4db0bf6b3ed1514cc2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87473abf47e74adf844e3ddfa24da3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:05.442038 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=100 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:38:05.450312 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-764a09f4-1d40-445d-b658-5fe38be2d477 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] 10.222.0.20 "GET /compute/v2.1/servers/61ec7cca-1572-496c-ba44-439f04c2a79c" status: 200 len: 1505 microversion: 2.1 time: 0.799029 Oct 04 18:38:05.476748 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1303/2533] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:04 2022] GET /compute/v2.1/servers/61ec7cca-1572-496c-ba44-439f04c2a79c => generated 1505 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:05.490967 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-305bd527-3807-43b6-a52c-58c929121034 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:05.496937 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-305bd527-3807-43b6-a52c-58c929121034 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 474a799f-8e38-49d6-8fff-9ec3e7657ef5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:05.510100 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-305bd527-3807-43b6-a52c-58c929121034 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:05.513605 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-305bd527-3807-43b6-a52c-58c929121034 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:05.514107 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-305bd527-3807-43b6-a52c-58c929121034 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:05.517531 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-305bd527-3807-43b6-a52c-58c929121034 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:05.517531 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-305bd527-3807-43b6-a52c-58c929121034 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:05.517531 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-305bd527-3807-43b6-a52c-58c929121034 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:05.975317 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-305bd527-3807-43b6-a52c-58c929121034 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:06.018995 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-305bd527-3807-43b6-a52c-58c929121034 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5" status: 200 len: 1542 microversion: 2.1 time: 0.521214 Oct 04 18:38:06.018995 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1304/2534] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:05 2022] GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5 => generated 1542 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:06.019234 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-cbee7973-9783-46c8-a8e9-ab05a4f0e7c0 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73127bc6636476482e280eddad7f66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9174b09e32064811a61539c64992ee50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:06.022623 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-65f6d4b5-be0f-4799-af8b-0e4ae36de052 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:06.023428 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-65f6d4b5-be0f-4799-af8b-0e4ae36de052 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 98dfffc8-51aa-407a-a374-8e120ec43a31] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:06.029887 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-cbee7973-9783-46c8-a8e9-ab05a4f0e7c0 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] 10.222.0.20 "GET /compute/v2.1/servers/b319d463-fa0d-4e2d-b03f-6227475572da" status: 200 len: 1369 microversion: 2.1 time: 0.714409 Oct 04 18:38:06.032751 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-65f6d4b5-be0f-4799-af8b-0e4ae36de052 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:06.032751 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-65f6d4b5-be0f-4799-af8b-0e4ae36de052 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:06.032751 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-65f6d4b5-be0f-4799-af8b-0e4ae36de052 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:06.033645 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-65f6d4b5-be0f-4799-af8b-0e4ae36de052 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:06.034341 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-65f6d4b5-be0f-4799-af8b-0e4ae36de052 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:06.035039 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-65f6d4b5-be0f-4799-af8b-0e4ae36de052 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:06.051802 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1231/2535] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:05 2022] GET /compute/v2.1/servers/b319d463-fa0d-4e2d-b03f-6227475572da => generated 1369 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:06.315154 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=20 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:38:06.342294 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3ce0c6e0-d73e-42d1-ae04-c35b97fc7935 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:06.342913 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3ce0c6e0-d73e-42d1-ae04-c35b97fc7935 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] [instance: 0bef06d7-ba85-4f48-bd08-228211391394] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:06.345981 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=18 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:38:06.359360 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3ce0c6e0-d73e-42d1-ae04-c35b97fc7935 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:06.367338 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3ce0c6e0-d73e-42d1-ae04-c35b97fc7935 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:06.368143 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3ce0c6e0-d73e-42d1-ae04-c35b97fc7935 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:06.369168 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3ce0c6e0-d73e-42d1-ae04-c35b97fc7935 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:06.369808 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3ce0c6e0-d73e-42d1-ae04-c35b97fc7935 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:06.370544 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3ce0c6e0-d73e-42d1-ae04-c35b97fc7935 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:06.525842 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3ce0c6e0-d73e-42d1-ae04-c35b97fc7935 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:06.548224 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3ce0c6e0-d73e-42d1-ae04-c35b97fc7935 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:06.550046 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3ce0c6e0-d73e-42d1-ae04-c35b97fc7935 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:06.560033 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3ce0c6e0-d73e-42d1-ae04-c35b97fc7935 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] 10.222.0.20 "GET /compute/v2.1/servers/0bef06d7-ba85-4f48-bd08-228211391394" status: 200 len: 1366 microversion: 2.57 time: 0.222110 Oct 04 18:38:06.561013 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1232/2536] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:06 2022] GET /compute/v2.1/servers/0bef06d7-ba85-4f48-bd08-228211391394 => generated 1366 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:06.576727 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c3f78122-2709-45e8-adb0-fa8557bf3b87 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:06.577422 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c3f78122-2709-45e8-adb0-fa8557bf3b87 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 61ec7cca-1572-496c-ba44-439f04c2a79c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:06.587068 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=4,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:38:06.597799 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c3f78122-2709-45e8-adb0-fa8557bf3b87 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:06.598746 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c3f78122-2709-45e8-adb0-fa8557bf3b87 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:06.601938 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c3f78122-2709-45e8-adb0-fa8557bf3b87 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:06.603039 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c3f78122-2709-45e8-adb0-fa8557bf3b87 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:06.603707 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c3f78122-2709-45e8-adb0-fa8557bf3b87 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:06.604372 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c3f78122-2709-45e8-adb0-fa8557bf3b87 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:06.921056 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-65f6d4b5-be0f-4799-af8b-0e4ae36de052 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:06.948173 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-65f6d4b5-be0f-4799-af8b-0e4ae36de052 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31" status: 200 len: 1392 microversion: 2.1 time: 0.942453 Oct 04 18:38:06.949055 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1305/2537] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:06 2022] GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31 => generated 1392 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:07.032609 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f0f507d9-689c-44aa-94d8-2d344a041e1b tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:07.038341 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f0f507d9-689c-44aa-94d8-2d344a041e1b tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 474a799f-8e38-49d6-8fff-9ec3e7657ef5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:07.065103 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f0f507d9-689c-44aa-94d8-2d344a041e1b tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:07.069289 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f0f507d9-689c-44aa-94d8-2d344a041e1b tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:07.070851 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f0f507d9-689c-44aa-94d8-2d344a041e1b tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:07.076941 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f0f507d9-689c-44aa-94d8-2d344a041e1b tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:07.079199 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f0f507d9-689c-44aa-94d8-2d344a041e1b tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:07.079797 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f0f507d9-689c-44aa-94d8-2d344a041e1b tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:07.164293 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c3f78122-2709-45e8-adb0-fa8557bf3b87 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8284fe51decd4db0bf6b3ed1514cc2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87473abf47e74adf844e3ddfa24da3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:07.191390 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c3f78122-2709-45e8-adb0-fa8557bf3b87 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] 10.222.0.20 "GET /compute/v2.1/servers/61ec7cca-1572-496c-ba44-439f04c2a79c" status: 200 len: 1505 microversion: 2.1 time: 0.629003 Oct 04 18:38:07.235110 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1233/2538] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:06 2022] GET /compute/v2.1/servers/61ec7cca-1572-496c-ba44-439f04c2a79c => generated 1505 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:07.260252 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-066af131-d5c9-4005-a42c-3c52256a5ac5 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:07.268811 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-066af131-d5c9-4005-a42c-3c52256a5ac5 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] [instance: b319d463-fa0d-4e2d-b03f-6227475572da] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:07.315135 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-066af131-d5c9-4005-a42c-3c52256a5ac5 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:07.317553 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-066af131-d5c9-4005-a42c-3c52256a5ac5 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:07.320617 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-066af131-d5c9-4005-a42c-3c52256a5ac5 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:07.329796 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-066af131-d5c9-4005-a42c-3c52256a5ac5 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:07.331325 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-066af131-d5c9-4005-a42c-3c52256a5ac5 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:07.332668 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-066af131-d5c9-4005-a42c-3c52256a5ac5 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:07.603923 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f0f507d9-689c-44aa-94d8-2d344a041e1b tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:07.631869 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f0f507d9-689c-44aa-94d8-2d344a041e1b tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5" status: 200 len: 1542 microversion: 2.1 time: 0.603040 Oct 04 18:38:07.646194 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1306/2539] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:07 2022] GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5 => generated 1542 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:07.664730 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-40cd560c-ffb3-4bb0-b96f-ef0c52517c6c req-c26db933-4330-4305-93f1-729e6afad313 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98dfffc8-51aa-407a-a374-8e120ec43a31", "tag": "0f1337d3-c904-4533-8791-cffcbc2b23d5"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:07.684811 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=92,nova_api:DELETE=3 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:38:07.697799 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-40cd560c-ffb3-4bb0-b96f-ef0c52517c6c req-c26db933-4330-4305-93f1-729e6afad313 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:07.698316 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-40cd560c-ffb3-4bb0-b96f-ef0c52517c6c req-c26db933-4330-4305-93f1-729e6afad313 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:07.700331 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-40cd560c-ffb3-4bb0-b96f-ef0c52517c6c req-c26db933-4330-4305-93f1-729e6afad313 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:07.747177 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-40cd560c-ffb3-4bb0-b96f-ef0c52517c6c req-c26db933-4330-4305-93f1-729e6afad313 service nova] Creating event network-changed:0f1337d3-c904-4533-8791-cffcbc2b23d5 for instance 98dfffc8-51aa-407a-a374-8e120ec43a31 on n-h2-850501-14 Oct 04 18:38:07.761061 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-40cd560c-ffb3-4bb0-b96f-ef0c52517c6c req-c26db933-4330-4305-93f1-729e6afad313 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113604 Oct 04 18:38:07.764476 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1307/2540] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:38:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:07.785863 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0671eb77-0327-4f71-b871-98c9065450b8 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:07.787126 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0671eb77-0327-4f71-b871-98c9065450b8 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] [instance: 0bef06d7-ba85-4f48-bd08-228211391394] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:07.808752 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0671eb77-0327-4f71-b871-98c9065450b8 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:07.816289 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0671eb77-0327-4f71-b871-98c9065450b8 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:07.817394 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0671eb77-0327-4f71-b871-98c9065450b8 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:07.820750 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0671eb77-0327-4f71-b871-98c9065450b8 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:07.822493 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0671eb77-0327-4f71-b871-98c9065450b8 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:07.823173 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0671eb77-0327-4f71-b871-98c9065450b8 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:08.271618 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0671eb77-0327-4f71-b871-98c9065450b8 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:08.289133 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0671eb77-0327-4f71-b871-98c9065450b8 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:08.296551 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-066af131-d5c9-4005-a42c-3c52256a5ac5 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73127bc6636476482e280eddad7f66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9174b09e32064811a61539c64992ee50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:08.298152 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0671eb77-0327-4f71-b871-98c9065450b8 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:08.302379 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0671eb77-0327-4f71-b871-98c9065450b8 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] 10.222.0.20 "GET /compute/v2.1/servers/0bef06d7-ba85-4f48-bd08-228211391394" status: 200 len: 1366 microversion: 2.57 time: 0.536039 Oct 04 18:38:08.306151 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1308/2541] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:07 2022] GET /compute/v2.1/servers/0bef06d7-ba85-4f48-bd08-228211391394 => generated 1366 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:08.308199 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-066af131-d5c9-4005-a42c-3c52256a5ac5 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] 10.222.0.20 "GET /compute/v2.1/servers/b319d463-fa0d-4e2d-b03f-6227475572da" status: 200 len: 1369 microversion: 2.1 time: 1.071579 Oct 04 18:38:08.310305 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1234/2542] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:07 2022] GET /compute/v2.1/servers/b319d463-fa0d-4e2d-b03f-6227475572da => generated 1369 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:08.326101 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9fc5daa8-c014-4e50-8b5c-f1f175fb81bc tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:08.328079 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9fc5daa8-c014-4e50-8b5c-f1f175fb81bc tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 98dfffc8-51aa-407a-a374-8e120ec43a31] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:08.329247 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-96aa8197-a83a-4b6f-b0c5-242c843e2b4e tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:08.331145 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-96aa8197-a83a-4b6f-b0c5-242c843e2b4e tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 61ec7cca-1572-496c-ba44-439f04c2a79c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:08.348454 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-96aa8197-a83a-4b6f-b0c5-242c843e2b4e tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:08.351384 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9fc5daa8-c014-4e50-8b5c-f1f175fb81bc tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:08.352291 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-96aa8197-a83a-4b6f-b0c5-242c843e2b4e tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:08.353170 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-96aa8197-a83a-4b6f-b0c5-242c843e2b4e tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:08.354127 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-96aa8197-a83a-4b6f-b0c5-242c843e2b4e tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:08.358277 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-96aa8197-a83a-4b6f-b0c5-242c843e2b4e tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:08.358459 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9fc5daa8-c014-4e50-8b5c-f1f175fb81bc tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:08.358736 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9fc5daa8-c014-4e50-8b5c-f1f175fb81bc tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:08.359354 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-96aa8197-a83a-4b6f-b0c5-242c843e2b4e tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:08.360737 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9fc5daa8-c014-4e50-8b5c-f1f175fb81bc tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:08.361313 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9fc5daa8-c014-4e50-8b5c-f1f175fb81bc tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:08.367132 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9fc5daa8-c014-4e50-8b5c-f1f175fb81bc tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:08.828949 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9fc5daa8-c014-4e50-8b5c-f1f175fb81bc tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:08.838748 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9fc5daa8-c014-4e50-8b5c-f1f175fb81bc tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31" status: 200 len: 1392 microversion: 2.1 time: 0.530172 Oct 04 18:38:08.843819 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1309/2543] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:08 2022] GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31 => generated 1392 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:08.857242 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2e698a80-d286-4f29-a486-e248b10db456 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:08.857978 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2e698a80-d286-4f29-a486-e248b10db456 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: 6b629ba0-6245-442f-bf1a-ad1c1a3116bc] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:08.869769 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e698a80-d286-4f29-a486-e248b10db456 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:08.871945 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e698a80-d286-4f29-a486-e248b10db456 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:08.871945 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e698a80-d286-4f29-a486-e248b10db456 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:08.873241 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e698a80-d286-4f29-a486-e248b10db456 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:08.874333 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e698a80-d286-4f29-a486-e248b10db456 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:08.875243 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e698a80-d286-4f29-a486-e248b10db456 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:08.932815 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2e698a80-d286-4f29-a486-e248b10db456 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: 6b629ba0-6245-442f-bf1a-ad1c1a3116bc] Going to try to terminate instance {{(pid=123002) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:38:08.949326 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-96aa8197-a83a-4b6f-b0c5-242c843e2b4e tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8284fe51decd4db0bf6b3ed1514cc2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87473abf47e74adf844e3ddfa24da3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:08.973751 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-96aa8197-a83a-4b6f-b0c5-242c843e2b4e tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] 10.222.0.20 "GET /compute/v2.1/servers/61ec7cca-1572-496c-ba44-439f04c2a79c" status: 200 len: 1505 microversion: 2.1 time: 0.661844 Oct 04 18:38:08.974823 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1235/2544] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:08 2022] GET /compute/v2.1/servers/61ec7cca-1572-496c-ba44-439f04c2a79c => generated 1505 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:09.000009 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9345a75d-891c-41c9-a6f0-4dc61e199d3c tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:09.009012 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-9345a75d-891c-41c9-a6f0-4dc61e199d3c tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 474a799f-8e38-49d6-8fff-9ec3e7657ef5] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:09.018435 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9345a75d-891c-41c9-a6f0-4dc61e199d3c tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:09.019158 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9345a75d-891c-41c9-a6f0-4dc61e199d3c tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:09.019858 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9345a75d-891c-41c9-a6f0-4dc61e199d3c tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:09.028218 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9345a75d-891c-41c9-a6f0-4dc61e199d3c tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:09.028869 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9345a75d-891c-41c9-a6f0-4dc61e199d3c tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:09.032226 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9345a75d-891c-41c9-a6f0-4dc61e199d3c tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:09.298966 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2e698a80-d286-4f29-a486-e248b10db456 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6b629ba0-6245-442f-bf1a-ad1c1a3116bc" status: 204 len: 0 microversion: 2.25 time: 0.453476 Oct 04 18:38:09.299608 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1310/2545] 10.222.0.20 () {60 vars in 1280 bytes} [Tue Oct 4 18:38:08 2022] DELETE /compute/v2.1/servers/6b629ba0-6245-442f-bf1a-ad1c1a3116bc => generated 0 bytes in 455 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:38:09.316897 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-80da672e-7ac6-4e70-92d1-ad9117cd7cae tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:09.320150 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-80da672e-7ac6-4e70-92d1-ad9117cd7cae tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: 6b629ba0-6245-442f-bf1a-ad1c1a3116bc] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:09.386348 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-80da672e-7ac6-4e70-92d1-ad9117cd7cae tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:09.388539 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-80da672e-7ac6-4e70-92d1-ad9117cd7cae tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:09.389056 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-80da672e-7ac6-4e70-92d1-ad9117cd7cae tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:09.391738 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-80da672e-7ac6-4e70-92d1-ad9117cd7cae tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:09.392282 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-80da672e-7ac6-4e70-92d1-ad9117cd7cae tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:09.392729 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-80da672e-7ac6-4e70-92d1-ad9117cd7cae tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:09.400825 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9345a75d-891c-41c9-a6f0-4dc61e199d3c tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:09.426140 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9345a75d-891c-41c9-a6f0-4dc61e199d3c tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5" status: 200 len: 1542 microversion: 2.1 time: 0.430668 Oct 04 18:38:09.426728 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1236/2546] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:08 2022] GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5 => generated 1542 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:09.444035 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5ecb88b6-208f-433f-b3d9-b856518d237f tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:09.453469 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5ecb88b6-208f-433f-b3d9-b856518d237f tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] [instance: 0bef06d7-ba85-4f48-bd08-228211391394] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:09.473930 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5ecb88b6-208f-433f-b3d9-b856518d237f tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:09.486397 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5ecb88b6-208f-433f-b3d9-b856518d237f tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:09.487031 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5ecb88b6-208f-433f-b3d9-b856518d237f tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:09.487862 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5ecb88b6-208f-433f-b3d9-b856518d237f tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:09.489509 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5ecb88b6-208f-433f-b3d9-b856518d237f tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:09.490019 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5ecb88b6-208f-433f-b3d9-b856518d237f tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:09.702690 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5ecb88b6-208f-433f-b3d9-b856518d237f tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:09.721753 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5ecb88b6-208f-433f-b3d9-b856518d237f tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:09.727586 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5ecb88b6-208f-433f-b3d9-b856518d237f tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:09.729372 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5ecb88b6-208f-433f-b3d9-b856518d237f tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] 10.222.0.20 "GET /compute/v2.1/servers/0bef06d7-ba85-4f48-bd08-228211391394" status: 200 len: 1366 microversion: 2.57 time: 0.296363 Oct 04 18:38:09.745055 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1237/2547] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:09 2022] GET /compute/v2.1/servers/0bef06d7-ba85-4f48-bd08-228211391394 => generated 1366 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:09.767693 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a1e95bc7-09ab-485f-af56-2d41908ebe1e tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:09.768611 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a1e95bc7-09ab-485f-af56-2d41908ebe1e tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] [instance: b319d463-fa0d-4e2d-b03f-6227475572da] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:09.783801 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a1e95bc7-09ab-485f-af56-2d41908ebe1e tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:09.784431 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a1e95bc7-09ab-485f-af56-2d41908ebe1e tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:09.784928 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a1e95bc7-09ab-485f-af56-2d41908ebe1e tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:09.787065 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a1e95bc7-09ab-485f-af56-2d41908ebe1e tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:09.789994 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a1e95bc7-09ab-485f-af56-2d41908ebe1e tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:09.790532 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a1e95bc7-09ab-485f-af56-2d41908ebe1e tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:09.849847 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-80da672e-7ac6-4e70-92d1-ad9117cd7cae tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:09.872510 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-80da672e-7ac6-4e70-92d1-ad9117cd7cae tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:09.873983 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-80da672e-7ac6-4e70-92d1-ad9117cd7cae tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:09.875376 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-80da672e-7ac6-4e70-92d1-ad9117cd7cae tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/6b629ba0-6245-442f-bf1a-ad1c1a3116bc" status: 200 len: 1548 microversion: 2.25 time: 0.571309 Oct 04 18:38:09.876001 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1311/2548] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:09 2022] GET /compute/v2.1/servers/6b629ba0-6245-442f-bf1a-ad1c1a3116bc => generated 1548 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:38:09.884317 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8d3be6d2-2bfc-415c-a281-e40ce52f2359 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:09.885228 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8d3be6d2-2bfc-415c-a281-e40ce52f2359 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 98dfffc8-51aa-407a-a374-8e120ec43a31] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:09.970528 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8d3be6d2-2bfc-415c-a281-e40ce52f2359 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:09.970528 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8d3be6d2-2bfc-415c-a281-e40ce52f2359 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:09.970528 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8d3be6d2-2bfc-415c-a281-e40ce52f2359 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:09.970528 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8d3be6d2-2bfc-415c-a281-e40ce52f2359 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:09.970528 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8d3be6d2-2bfc-415c-a281-e40ce52f2359 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:09.970528 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8d3be6d2-2bfc-415c-a281-e40ce52f2359 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:10.194850 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a1e95bc7-09ab-485f-af56-2d41908ebe1e tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73127bc6636476482e280eddad7f66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9174b09e32064811a61539c64992ee50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:10.215915 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a1e95bc7-09ab-485f-af56-2d41908ebe1e tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] 10.222.0.20 "GET /compute/v2.1/servers/b319d463-fa0d-4e2d-b03f-6227475572da" status: 200 len: 1369 microversion: 2.1 time: 0.460994 Oct 04 18:38:10.220126 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1238/2549] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:09 2022] GET /compute/v2.1/servers/b319d463-fa0d-4e2d-b03f-6227475572da => generated 1369 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:10.232256 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ec13041e-0722-4b8f-972d-f39b2bc78501 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:10.232915 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ec13041e-0722-4b8f-972d-f39b2bc78501 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 61ec7cca-1572-496c-ba44-439f04c2a79c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:10.255402 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec13041e-0722-4b8f-972d-f39b2bc78501 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:10.255900 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec13041e-0722-4b8f-972d-f39b2bc78501 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:10.256456 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec13041e-0722-4b8f-972d-f39b2bc78501 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:10.257180 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec13041e-0722-4b8f-972d-f39b2bc78501 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:10.257642 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec13041e-0722-4b8f-972d-f39b2bc78501 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:10.258081 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec13041e-0722-4b8f-972d-f39b2bc78501 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:10.428821 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8d3be6d2-2bfc-415c-a281-e40ce52f2359 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:10.443331 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8d3be6d2-2bfc-415c-a281-e40ce52f2359 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31" status: 200 len: 1392 microversion: 2.1 time: 0.563692 Oct 04 18:38:10.443903 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1312/2550] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:09 2022] GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31 => generated 1392 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:10.458607 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-75aa8403-2aaf-4440-ab50-fc92266cc31b tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:10.461298 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-75aa8403-2aaf-4440-ab50-fc92266cc31b tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 474a799f-8e38-49d6-8fff-9ec3e7657ef5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:10.477405 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-75aa8403-2aaf-4440-ab50-fc92266cc31b tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:10.478544 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-75aa8403-2aaf-4440-ab50-fc92266cc31b tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:10.479091 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-75aa8403-2aaf-4440-ab50-fc92266cc31b tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:10.480119 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-75aa8403-2aaf-4440-ab50-fc92266cc31b tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:10.480442 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-75aa8403-2aaf-4440-ab50-fc92266cc31b tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:10.481848 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-75aa8403-2aaf-4440-ab50-fc92266cc31b tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:10.770628 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ec13041e-0722-4b8f-972d-f39b2bc78501 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8284fe51decd4db0bf6b3ed1514cc2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87473abf47e74adf844e3ddfa24da3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:10.783467 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ec13041e-0722-4b8f-972d-f39b2bc78501 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] 10.222.0.20 "GET /compute/v2.1/servers/61ec7cca-1572-496c-ba44-439f04c2a79c" status: 200 len: 1505 microversion: 2.1 time: 0.562403 Oct 04 18:38:10.784021 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1239/2551] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:10 2022] GET /compute/v2.1/servers/61ec7cca-1572-496c-ba44-439f04c2a79c => generated 1505 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:10.826001 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0e458fe7-1aa3-4d6e-93e5-9bf585d5459e tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:10.827022 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0e458fe7-1aa3-4d6e-93e5-9bf585d5459e tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] [instance: 0bef06d7-ba85-4f48-bd08-228211391394] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:10.845369 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0e458fe7-1aa3-4d6e-93e5-9bf585d5459e tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:10.846893 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0e458fe7-1aa3-4d6e-93e5-9bf585d5459e tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:10.848198 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0e458fe7-1aa3-4d6e-93e5-9bf585d5459e tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:10.848848 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0e458fe7-1aa3-4d6e-93e5-9bf585d5459e tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:10.849335 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0e458fe7-1aa3-4d6e-93e5-9bf585d5459e tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:10.849958 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0e458fe7-1aa3-4d6e-93e5-9bf585d5459e tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:10.857252 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=100 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:38:10.963532 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-75aa8403-2aaf-4440-ab50-fc92266cc31b tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:10.977276 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-75aa8403-2aaf-4440-ab50-fc92266cc31b tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5" status: 200 len: 1542 microversion: 2.1 time: 0.528336 Oct 04 18:38:10.977883 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1313/2552] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:10 2022] GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5 => generated 1542 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:11.010758 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8591e470-a984-44c8-b1a8-ce7cc0c3d998 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:11.010758 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8591e470-a984-44c8-b1a8-ce7cc0c3d998 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: 6b629ba0-6245-442f-bf1a-ad1c1a3116bc] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:11.011585 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8591e470-a984-44c8-b1a8-ce7cc0c3d998 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:11.012184 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8591e470-a984-44c8-b1a8-ce7cc0c3d998 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:11.013106 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8591e470-a984-44c8-b1a8-ce7cc0c3d998 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:11.025183 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8591e470-a984-44c8-b1a8-ce7cc0c3d998 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:11.026095 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8591e470-a984-44c8-b1a8-ce7cc0c3d998 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:11.027197 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8591e470-a984-44c8-b1a8-ce7cc0c3d998 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:11.042668 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0e458fe7-1aa3-4d6e-93e5-9bf585d5459e tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:11.093325 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0e458fe7-1aa3-4d6e-93e5-9bf585d5459e tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:11.095213 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0e458fe7-1aa3-4d6e-93e5-9bf585d5459e tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:11.098991 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0e458fe7-1aa3-4d6e-93e5-9bf585d5459e tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] 10.222.0.20 "GET /compute/v2.1/servers/0bef06d7-ba85-4f48-bd08-228211391394" status: 200 len: 1366 microversion: 2.57 time: 0.311450 Oct 04 18:38:11.100890 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1240/2553] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:10 2022] GET /compute/v2.1/servers/0bef06d7-ba85-4f48-bd08-228211391394 => generated 1366 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:11.256412 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ef836663-bd69-4940-851d-43bfd7bdfa8b tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:11.257986 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ef836663-bd69-4940-851d-43bfd7bdfa8b tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] [instance: b319d463-fa0d-4e2d-b03f-6227475572da] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:11.281712 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ef836663-bd69-4940-851d-43bfd7bdfa8b tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:11.283502 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ef836663-bd69-4940-851d-43bfd7bdfa8b tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:11.284643 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ef836663-bd69-4940-851d-43bfd7bdfa8b tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:11.286540 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ef836663-bd69-4940-851d-43bfd7bdfa8b tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:11.287818 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ef836663-bd69-4940-851d-43bfd7bdfa8b tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:11.289982 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ef836663-bd69-4940-851d-43bfd7bdfa8b tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:11.331163 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8591e470-a984-44c8-b1a8-ce7cc0c3d998 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:11.348411 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8591e470-a984-44c8-b1a8-ce7cc0c3d998 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:11.351401 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8591e470-a984-44c8-b1a8-ce7cc0c3d998 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:11.353929 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8591e470-a984-44c8-b1a8-ce7cc0c3d998 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/6b629ba0-6245-442f-bf1a-ad1c1a3116bc" status: 200 len: 1548 microversion: 2.25 time: 0.357685 Oct 04 18:38:11.357060 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1314/2554] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:10 2022] GET /compute/v2.1/servers/6b629ba0-6245-442f-bf1a-ad1c1a3116bc => generated 1548 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:11.471056 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-071970e7-ebf8-4d90-be5a-24a2265da6da tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:11.471707 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-071970e7-ebf8-4d90-be5a-24a2265da6da tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 98dfffc8-51aa-407a-a374-8e120ec43a31] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:11.478556 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-071970e7-ebf8-4d90-be5a-24a2265da6da tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:11.486232 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-071970e7-ebf8-4d90-be5a-24a2265da6da tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:11.486874 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-071970e7-ebf8-4d90-be5a-24a2265da6da tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:11.487711 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-071970e7-ebf8-4d90-be5a-24a2265da6da tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:11.488309 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-071970e7-ebf8-4d90-be5a-24a2265da6da tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:11.488820 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-071970e7-ebf8-4d90-be5a-24a2265da6da tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:11.642306 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ef836663-bd69-4940-851d-43bfd7bdfa8b tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73127bc6636476482e280eddad7f66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9174b09e32064811a61539c64992ee50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:11.650559 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ef836663-bd69-4940-851d-43bfd7bdfa8b tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] 10.222.0.20 "GET /compute/v2.1/servers/b319d463-fa0d-4e2d-b03f-6227475572da" status: 200 len: 1369 microversion: 2.1 time: 0.399247 Oct 04 18:38:11.676008 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1241/2555] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:11 2022] GET /compute/v2.1/servers/b319d463-fa0d-4e2d-b03f-6227475572da => generated 1369 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:11.746904 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-071970e7-ebf8-4d90-be5a-24a2265da6da tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:11.756174 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-071970e7-ebf8-4d90-be5a-24a2265da6da tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31" status: 200 len: 1392 microversion: 2.1 time: 0.289615 Oct 04 18:38:11.762920 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1315/2556] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:11 2022] GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31 => generated 1392 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:38:11.810364 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5be9ddb9-e846-4421-b9b6-7163f74285d3 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:11.814766 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5be9ddb9-e846-4421-b9b6-7163f74285d3 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 61ec7cca-1572-496c-ba44-439f04c2a79c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:11.817986 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5be9ddb9-e846-4421-b9b6-7163f74285d3 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:11.823234 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5be9ddb9-e846-4421-b9b6-7163f74285d3 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:11.823693 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5be9ddb9-e846-4421-b9b6-7163f74285d3 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:11.824732 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5be9ddb9-e846-4421-b9b6-7163f74285d3 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:11.825361 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5be9ddb9-e846-4421-b9b6-7163f74285d3 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:11.825731 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5be9ddb9-e846-4421-b9b6-7163f74285d3 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:12.009238 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c14d11b2-9e71-460f-8761-2b5d5406a50f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:12.009238 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c14d11b2-9e71-460f-8761-2b5d5406a50f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 474a799f-8e38-49d6-8fff-9ec3e7657ef5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:12.018788 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c14d11b2-9e71-460f-8761-2b5d5406a50f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:12.022198 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c14d11b2-9e71-460f-8761-2b5d5406a50f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:12.023063 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c14d11b2-9e71-460f-8761-2b5d5406a50f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:12.024090 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c14d11b2-9e71-460f-8761-2b5d5406a50f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:12.026640 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c14d11b2-9e71-460f-8761-2b5d5406a50f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:12.028587 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c14d11b2-9e71-460f-8761-2b5d5406a50f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:12.149214 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5be9ddb9-e846-4421-b9b6-7163f74285d3 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8284fe51decd4db0bf6b3ed1514cc2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87473abf47e74adf844e3ddfa24da3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:12.162838 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5be9ddb9-e846-4421-b9b6-7163f74285d3 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] 10.222.0.20 "GET /compute/v2.1/servers/61ec7cca-1572-496c-ba44-439f04c2a79c" status: 200 len: 1505 microversion: 2.1 time: 0.356451 Oct 04 18:38:12.163449 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1242/2557] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:11 2022] GET /compute/v2.1/servers/61ec7cca-1572-496c-ba44-439f04c2a79c => generated 1505 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:12.169171 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-df586418-dff3-42e5-b984-28bbb94e0796 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:12.172821 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-df586418-dff3-42e5-b984-28bbb94e0796 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] [instance: 0bef06d7-ba85-4f48-bd08-228211391394] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:12.185552 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-df586418-dff3-42e5-b984-28bbb94e0796 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:12.186315 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-df586418-dff3-42e5-b984-28bbb94e0796 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:12.188810 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-df586418-dff3-42e5-b984-28bbb94e0796 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:12.189722 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-df586418-dff3-42e5-b984-28bbb94e0796 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:12.192371 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-df586418-dff3-42e5-b984-28bbb94e0796 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:12.193204 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-df586418-dff3-42e5-b984-28bbb94e0796 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:12.466386 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-df586418-dff3-42e5-b984-28bbb94e0796 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:12.485328 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-df586418-dff3-42e5-b984-28bbb94e0796 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:12.486776 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-df586418-dff3-42e5-b984-28bbb94e0796 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:12.487974 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-df586418-dff3-42e5-b984-28bbb94e0796 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] 10.222.0.20 "GET /compute/v2.1/servers/0bef06d7-ba85-4f48-bd08-228211391394" status: 200 len: 1366 microversion: 2.57 time: 0.323261 Oct 04 18:38:12.488901 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1243/2558] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:12 2022] GET /compute/v2.1/servers/0bef06d7-ba85-4f48-bd08-228211391394 => generated 1366 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:12.500139 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-582cec5d-65c5-436d-b76f-786441b3ae2f tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:12.500766 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-582cec5d-65c5-436d-b76f-786441b3ae2f tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: 6b629ba0-6245-442f-bf1a-ad1c1a3116bc] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:12.507007 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-582cec5d-65c5-436d-b76f-786441b3ae2f tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:12.507552 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-582cec5d-65c5-436d-b76f-786441b3ae2f tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:12.507924 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-582cec5d-65c5-436d-b76f-786441b3ae2f tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:12.508643 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-582cec5d-65c5-436d-b76f-786441b3ae2f tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:12.509099 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-582cec5d-65c5-436d-b76f-786441b3ae2f tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:12.513221 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-582cec5d-65c5-436d-b76f-786441b3ae2f tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:12.565265 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c14d11b2-9e71-460f-8761-2b5d5406a50f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:12.595586 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c14d11b2-9e71-460f-8761-2b5d5406a50f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5" status: 200 len: 1542 microversion: 2.1 time: 0.595138 Oct 04 18:38:12.599436 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1316/2559] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:11 2022] GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5 => generated 1542 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:12.675964 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-bf53c97a-cef7-4fb0-9625-3c5963c9e463 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:12.677175 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-bf53c97a-cef7-4fb0-9625-3c5963c9e463 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] [instance: b319d463-fa0d-4e2d-b03f-6227475572da] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:12.717977 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bf53c97a-cef7-4fb0-9625-3c5963c9e463 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:12.719450 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bf53c97a-cef7-4fb0-9625-3c5963c9e463 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:12.719450 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bf53c97a-cef7-4fb0-9625-3c5963c9e463 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:12.720401 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bf53c97a-cef7-4fb0-9625-3c5963c9e463 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:12.723875 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bf53c97a-cef7-4fb0-9625-3c5963c9e463 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:12.726314 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bf53c97a-cef7-4fb0-9625-3c5963c9e463 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:13.545703 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-582cec5d-65c5-436d-b76f-786441b3ae2f tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:13.560456 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-582cec5d-65c5-436d-b76f-786441b3ae2f tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:13.569630 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-582cec5d-65c5-436d-b76f-786441b3ae2f tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:13.571246 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-582cec5d-65c5-436d-b76f-786441b3ae2f tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/6b629ba0-6245-442f-bf1a-ad1c1a3116bc" status: 200 len: 1548 microversion: 2.25 time: 1.081378 Oct 04 18:38:13.573933 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1244/2560] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:12 2022] GET /compute/v2.1/servers/6b629ba0-6245-442f-bf1a-ad1c1a3116bc => generated 1548 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:13.601448 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-baebd1c5-6ba6-463a-84d4-529981bc01da tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:13.608554 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-baebd1c5-6ba6-463a-84d4-529981bc01da tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 98dfffc8-51aa-407a-a374-8e120ec43a31] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:13.640013 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-baebd1c5-6ba6-463a-84d4-529981bc01da tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:13.662012 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-baebd1c5-6ba6-463a-84d4-529981bc01da tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:13.662444 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-baebd1c5-6ba6-463a-84d4-529981bc01da tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:13.663455 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-bf53c97a-cef7-4fb0-9625-3c5963c9e463 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73127bc6636476482e280eddad7f66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9174b09e32064811a61539c64992ee50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:13.665256 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-baebd1c5-6ba6-463a-84d4-529981bc01da tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:13.667731 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-baebd1c5-6ba6-463a-84d4-529981bc01da tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:13.673838 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-baebd1c5-6ba6-463a-84d4-529981bc01da tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:13.674134 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-bf53c97a-cef7-4fb0-9625-3c5963c9e463 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] 10.222.0.20 "GET /compute/v2.1/servers/b319d463-fa0d-4e2d-b03f-6227475572da" status: 200 len: 1369 microversion: 2.1 time: 1.002881 Oct 04 18:38:13.692348 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1317/2561] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:12 2022] GET /compute/v2.1/servers/b319d463-fa0d-4e2d-b03f-6227475572da => generated 1369 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:38:13.710154 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-dd01b2cd-0e66-449b-8999-f308dc19eaab tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:13.710154 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-dd01b2cd-0e66-449b-8999-f308dc19eaab tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 61ec7cca-1572-496c-ba44-439f04c2a79c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:13.723817 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dd01b2cd-0e66-449b-8999-f308dc19eaab tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:13.724759 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dd01b2cd-0e66-449b-8999-f308dc19eaab tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:13.725607 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dd01b2cd-0e66-449b-8999-f308dc19eaab tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:13.726503 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dd01b2cd-0e66-449b-8999-f308dc19eaab tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:13.727116 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dd01b2cd-0e66-449b-8999-f308dc19eaab tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:13.727715 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dd01b2cd-0e66-449b-8999-f308dc19eaab tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:14.008968 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-baebd1c5-6ba6-463a-84d4-529981bc01da tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:14.021754 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-baebd1c5-6ba6-463a-84d4-529981bc01da tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31" status: 200 len: 1392 microversion: 2.1 time: 0.444974 Oct 04 18:38:14.024739 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1245/2562] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:13 2022] GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31 => generated 1392 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:14.041514 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-69de002a-14f2-4d0f-9d0c-4dde32425914 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:14.042396 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-69de002a-14f2-4d0f-9d0c-4dde32425914 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] [instance: 0bef06d7-ba85-4f48-bd08-228211391394] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:14.043995 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-dd01b2cd-0e66-449b-8999-f308dc19eaab tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8284fe51decd4db0bf6b3ed1514cc2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87473abf47e74adf844e3ddfa24da3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:14.054093 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-dd01b2cd-0e66-449b-8999-f308dc19eaab tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] 10.222.0.20 "GET /compute/v2.1/servers/61ec7cca-1572-496c-ba44-439f04c2a79c" status: 200 len: 1505 microversion: 2.1 time: 0.360402 Oct 04 18:38:14.056597 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-69de002a-14f2-4d0f-9d0c-4dde32425914 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:14.060266 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-69de002a-14f2-4d0f-9d0c-4dde32425914 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:14.061019 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-69de002a-14f2-4d0f-9d0c-4dde32425914 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:14.064517 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-69de002a-14f2-4d0f-9d0c-4dde32425914 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:14.065533 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-69de002a-14f2-4d0f-9d0c-4dde32425914 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:14.066133 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-69de002a-14f2-4d0f-9d0c-4dde32425914 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:14.076726 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1318/2563] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:13 2022] GET /compute/v2.1/servers/61ec7cca-1572-496c-ba44-439f04c2a79c => generated 1505 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:14.099998 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ae71aadc-0b7f-446c-919d-177483248bc3 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:14.104553 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ae71aadc-0b7f-446c-919d-177483248bc3 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 474a799f-8e38-49d6-8fff-9ec3e7657ef5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:14.132935 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ae71aadc-0b7f-446c-919d-177483248bc3 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:14.137524 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ae71aadc-0b7f-446c-919d-177483248bc3 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:14.141433 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ae71aadc-0b7f-446c-919d-177483248bc3 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:14.147026 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ae71aadc-0b7f-446c-919d-177483248bc3 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:14.147026 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ae71aadc-0b7f-446c-919d-177483248bc3 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:14.147026 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ae71aadc-0b7f-446c-919d-177483248bc3 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:14.219509 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:38:14.315553 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-69de002a-14f2-4d0f-9d0c-4dde32425914 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:14.327590 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-69de002a-14f2-4d0f-9d0c-4dde32425914 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:14.329097 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-69de002a-14f2-4d0f-9d0c-4dde32425914 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:14.336856 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-69de002a-14f2-4d0f-9d0c-4dde32425914 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] 10.222.0.20 "GET /compute/v2.1/servers/0bef06d7-ba85-4f48-bd08-228211391394" status: 200 len: 1366 microversion: 2.57 time: 0.310842 Oct 04 18:38:14.354198 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1246/2564] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:14 2022] GET /compute/v2.1/servers/0bef06d7-ba85-4f48-bd08-228211391394 => generated 1366 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:14.427331 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-67c8cae9-b175-4f76-8499-f1bc564fd5a4 req-b4eb7c86-731e-40f4-8893-382e5f0d8b85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b629ba0-6245-442f-bf1a-ad1c1a3116bc", "name": "network-vif-deleted", "tag": "d4883fee-1e3e-46f0-9029-6d122a317d39"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:14.441122 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-67c8cae9-b175-4f76-8499-f1bc564fd5a4 req-b4eb7c86-731e-40f4-8893-382e5f0d8b85 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:14.441858 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-67c8cae9-b175-4f76-8499-f1bc564fd5a4 req-b4eb7c86-731e-40f4-8893-382e5f0d8b85 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:14.442679 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-67c8cae9-b175-4f76-8499-f1bc564fd5a4 req-b4eb7c86-731e-40f4-8893-382e5f0d8b85 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:14.458760 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-67c8cae9-b175-4f76-8499-f1bc564fd5a4 req-b4eb7c86-731e-40f4-8893-382e5f0d8b85 service nova] Creating event network-vif-deleted:d4883fee-1e3e-46f0-9029-6d122a317d39 for instance 6b629ba0-6245-442f-bf1a-ad1c1a3116bc on n-h2-850501-14 Oct 04 18:38:14.484472 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-67c8cae9-b175-4f76-8499-f1bc564fd5a4 req-b4eb7c86-731e-40f4-8893-382e5f0d8b85 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061049 Oct 04 18:38:14.485463 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1247/2565] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:38:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:14.571185 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ae71aadc-0b7f-446c-919d-177483248bc3 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:14.582945 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ae71aadc-0b7f-446c-919d-177483248bc3 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5" status: 200 len: 1542 microversion: 2.1 time: 0.503704 Oct 04 18:38:14.584263 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1319/2566] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:14 2022] GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5 => generated 1542 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:14.605704 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3c187977-f976-4bd2-b22f-74f17a3b12e8 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:14.607023 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3c187977-f976-4bd2-b22f-74f17a3b12e8 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: 6b629ba0-6245-442f-bf1a-ad1c1a3116bc] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:14.615127 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3c187977-f976-4bd2-b22f-74f17a3b12e8 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:14.615895 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3c187977-f976-4bd2-b22f-74f17a3b12e8 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:14.618842 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3c187977-f976-4bd2-b22f-74f17a3b12e8 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:14.618842 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3c187977-f976-4bd2-b22f-74f17a3b12e8 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:14.618842 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3c187977-f976-4bd2-b22f-74f17a3b12e8 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:14.618842 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3c187977-f976-4bd2-b22f-74f17a3b12e8 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:14.699133 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6df435b1-a75b-44b6-9c34-6e876ba73a95 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:14.700333 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-6df435b1-a75b-44b6-9c34-6e876ba73a95 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] [instance: b319d463-fa0d-4e2d-b03f-6227475572da] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:14.717332 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3c187977-f976-4bd2-b22f-74f17a3b12e8 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:14.726472 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6df435b1-a75b-44b6-9c34-6e876ba73a95 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:14.730511 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3c187977-f976-4bd2-b22f-74f17a3b12e8 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:14.732744 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3c187977-f976-4bd2-b22f-74f17a3b12e8 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:14.734418 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3c187977-f976-4bd2-b22f-74f17a3b12e8 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/6b629ba0-6245-442f-bf1a-ad1c1a3116bc" status: 200 len: 1506 microversion: 2.25 time: 0.133538 Oct 04 18:38:14.735807 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1248/2567] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:14 2022] GET /compute/v2.1/servers/6b629ba0-6245-442f-bf1a-ad1c1a3116bc => generated 1506 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:38:14.736859 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6df435b1-a75b-44b6-9c34-6e876ba73a95 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:14.738443 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6df435b1-a75b-44b6-9c34-6e876ba73a95 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:14.739542 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6df435b1-a75b-44b6-9c34-6e876ba73a95 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:14.740122 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6df435b1-a75b-44b6-9c34-6e876ba73a95 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:14.740790 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6df435b1-a75b-44b6-9c34-6e876ba73a95 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:14.955409 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-6df435b1-a75b-44b6-9c34-6e876ba73a95 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73127bc6636476482e280eddad7f66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9174b09e32064811a61539c64992ee50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:14.968276 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6df435b1-a75b-44b6-9c34-6e876ba73a95 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] 10.222.0.20 "GET /compute/v2.1/servers/b319d463-fa0d-4e2d-b03f-6227475572da" status: 200 len: 1369 microversion: 2.1 time: 0.271143 Oct 04 18:38:14.970465 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1320/2568] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:14 2022] GET /compute/v2.1/servers/b319d463-fa0d-4e2d-b03f-6227475572da => generated 1369 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:38:15.049944 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b87a75b4-5dc1-438e-8e56-26bf5a2dd3bf tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:15.050875 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b87a75b4-5dc1-438e-8e56-26bf5a2dd3bf tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 98dfffc8-51aa-407a-a374-8e120ec43a31] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:15.062528 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b87a75b4-5dc1-438e-8e56-26bf5a2dd3bf tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:15.063289 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b87a75b4-5dc1-438e-8e56-26bf5a2dd3bf tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:15.068021 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b87a75b4-5dc1-438e-8e56-26bf5a2dd3bf tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:15.068021 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b87a75b4-5dc1-438e-8e56-26bf5a2dd3bf tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:15.068021 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b87a75b4-5dc1-438e-8e56-26bf5a2dd3bf tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:15.068021 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b87a75b4-5dc1-438e-8e56-26bf5a2dd3bf tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:15.090312 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-bf07f06c-2657-4e59-a793-299b03cc8c50 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:15.093931 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-bf07f06c-2657-4e59-a793-299b03cc8c50 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 61ec7cca-1572-496c-ba44-439f04c2a79c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:15.106430 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bf07f06c-2657-4e59-a793-299b03cc8c50 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:15.108729 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bf07f06c-2657-4e59-a793-299b03cc8c50 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:15.114427 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bf07f06c-2657-4e59-a793-299b03cc8c50 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:15.114427 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bf07f06c-2657-4e59-a793-299b03cc8c50 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:15.114427 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bf07f06c-2657-4e59-a793-299b03cc8c50 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:15.115220 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bf07f06c-2657-4e59-a793-299b03cc8c50 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:15.525131 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-bf07f06c-2657-4e59-a793-299b03cc8c50 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8284fe51decd4db0bf6b3ed1514cc2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87473abf47e74adf844e3ddfa24da3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:15.533367 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-bf07f06c-2657-4e59-a793-299b03cc8c50 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] 10.222.0.20 "GET /compute/v2.1/servers/61ec7cca-1572-496c-ba44-439f04c2a79c" status: 200 len: 1505 microversion: 2.1 time: 0.449554 Oct 04 18:38:15.537152 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1321/2569] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:15 2022] GET /compute/v2.1/servers/61ec7cca-1572-496c-ba44-439f04c2a79c => generated 1505 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:38:15.545007 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-dba1615f-a3ff-4f06-95b1-86cc000f82b8 req-8814d959-d741-41a2-99d1-1057e906686e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "474a799f-8e38-49d6-8fff-9ec3e7657ef5", "name": "network-vif-unplugged", "status": "completed", "tag": "a0d7cb42-218d-4bf1-adab-5dbf22e8ab22"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:15.563494 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b87a75b4-5dc1-438e-8e56-26bf5a2dd3bf tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:15.586110 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b87a75b4-5dc1-438e-8e56-26bf5a2dd3bf tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31" status: 200 len: 1392 microversion: 2.1 time: 0.540045 Oct 04 18:38:15.586722 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1249/2570] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:15 2022] GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31 => generated 1392 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:38:15.588606 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-dba1615f-a3ff-4f06-95b1-86cc000f82b8 req-8814d959-d741-41a2-99d1-1057e906686e service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:15.589385 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-dba1615f-a3ff-4f06-95b1-86cc000f82b8 req-8814d959-d741-41a2-99d1-1057e906686e service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:15.593051 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-dba1615f-a3ff-4f06-95b1-86cc000f82b8 req-8814d959-d741-41a2-99d1-1057e906686e service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:15.602805 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9ad35d1d-9f8a-4d5f-9227-b96f38511422 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:15.609689 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-9ad35d1d-9f8a-4d5f-9227-b96f38511422 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] [instance: 0bef06d7-ba85-4f48-bd08-228211391394] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:15.629351 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9ad35d1d-9f8a-4d5f-9227-b96f38511422 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:15.629668 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-dba1615f-a3ff-4f06-95b1-86cc000f82b8 req-8814d959-d741-41a2-99d1-1057e906686e service nova] Creating event network-vif-unplugged:a0d7cb42-218d-4bf1-adab-5dbf22e8ab22 for instance 474a799f-8e38-49d6-8fff-9ec3e7657ef5 on n-h1-850501-14 Oct 04 18:38:15.632903 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9ad35d1d-9f8a-4d5f-9227-b96f38511422 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:15.632903 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9ad35d1d-9f8a-4d5f-9227-b96f38511422 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:15.632903 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9ad35d1d-9f8a-4d5f-9227-b96f38511422 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:15.632903 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9ad35d1d-9f8a-4d5f-9227-b96f38511422 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:15.632903 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9ad35d1d-9f8a-4d5f-9227-b96f38511422 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:15.678361 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [req-dba1615f-a3ff-4f06-95b1-86cc000f82b8 req-8814d959-d741-41a2-99d1-1057e906686e service nova] Instance 474a799f-8e38-49d6-8fff-9ec3e7657ef5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850501-14', 'n-h2-850501-14'} {{(pid=123002) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:38:15.729443 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-dba1615f-a3ff-4f06-95b1-86cc000f82b8 req-8814d959-d741-41a2-99d1-1057e906686e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.190509 Oct 04 18:38:15.750504 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1322/2571] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:38:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:15.757779 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0c7bdb0a-5633-46c8-9339-7ed0276906bb tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:15.759062 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0c7bdb0a-5633-46c8-9339-7ed0276906bb tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 474a799f-8e38-49d6-8fff-9ec3e7657ef5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:15.774935 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0c7bdb0a-5633-46c8-9339-7ed0276906bb tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:15.776365 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0c7bdb0a-5633-46c8-9339-7ed0276906bb tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:15.778638 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0c7bdb0a-5633-46c8-9339-7ed0276906bb tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:15.779972 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0c7bdb0a-5633-46c8-9339-7ed0276906bb tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:15.780901 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0c7bdb0a-5633-46c8-9339-7ed0276906bb tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:15.781869 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0c7bdb0a-5633-46c8-9339-7ed0276906bb tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:15.834843 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9ad35d1d-9f8a-4d5f-9227-b96f38511422 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:15.847279 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9ad35d1d-9f8a-4d5f-9227-b96f38511422 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:15.848875 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9ad35d1d-9f8a-4d5f-9227-b96f38511422 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:15.850183 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9ad35d1d-9f8a-4d5f-9227-b96f38511422 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] 10.222.0.20 "GET /compute/v2.1/servers/0bef06d7-ba85-4f48-bd08-228211391394" status: 200 len: 1372 microversion: 2.57 time: 0.259176 Oct 04 18:38:15.865518 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1250/2572] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:15 2022] GET /compute/v2.1/servers/0bef06d7-ba85-4f48-bd08-228211391394 => generated 1372 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:15.880130 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b92d81ac-23db-42dc-81d0-38bfc47f194b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:15.881551 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b92d81ac-23db-42dc-81d0-38bfc47f194b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: 6b629ba0-6245-442f-bf1a-ad1c1a3116bc] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:15.888488 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b92d81ac-23db-42dc-81d0-38bfc47f194b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:15.889745 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b92d81ac-23db-42dc-81d0-38bfc47f194b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:15.890376 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b92d81ac-23db-42dc-81d0-38bfc47f194b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:15.891415 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b92d81ac-23db-42dc-81d0-38bfc47f194b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:15.892047 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b92d81ac-23db-42dc-81d0-38bfc47f194b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:15.892650 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b92d81ac-23db-42dc-81d0-38bfc47f194b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:15.971917 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b92d81ac-23db-42dc-81d0-38bfc47f194b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:15.972453 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b92d81ac-23db-42dc-81d0-38bfc47f194b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:15.972904 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b92d81ac-23db-42dc-81d0-38bfc47f194b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:15.973362 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-b92d81ac-23db-42dc-81d0-38bfc47f194b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lazy-loading 'fault' on Instance uuid 6b629ba0-6245-442f-bf1a-ad1c1a3116bc {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:38:16.147073 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b92d81ac-23db-42dc-81d0-38bfc47f194b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:16.168581 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b92d81ac-23db-42dc-81d0-38bfc47f194b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:16.168581 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b92d81ac-23db-42dc-81d0-38bfc47f194b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:16.168581 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b92d81ac-23db-42dc-81d0-38bfc47f194b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/6b629ba0-6245-442f-bf1a-ad1c1a3116bc" status: 200 len: 1352 microversion: 2.25 time: 0.298526 Oct 04 18:38:16.168581 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1251/2573] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:15 2022] GET /compute/v2.1/servers/6b629ba0-6245-442f-bf1a-ad1c1a3116bc => generated 1352 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:16.219240 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-daac3e1a-8be4-4e27-a761-08c6f0e6e000 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:16.219240 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-daac3e1a-8be4-4e27-a761-08c6f0e6e000 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] [instance: b319d463-fa0d-4e2d-b03f-6227475572da] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:16.240841 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-daac3e1a-8be4-4e27-a761-08c6f0e6e000 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:16.241415 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-daac3e1a-8be4-4e27-a761-08c6f0e6e000 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:16.243369 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-daac3e1a-8be4-4e27-a761-08c6f0e6e000 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:16.245619 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-daac3e1a-8be4-4e27-a761-08c6f0e6e000 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:16.247203 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-daac3e1a-8be4-4e27-a761-08c6f0e6e000 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:16.247651 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-daac3e1a-8be4-4e27-a761-08c6f0e6e000 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:16.405136 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0c7bdb0a-5633-46c8-9339-7ed0276906bb tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:16.415102 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0c7bdb0a-5633-46c8-9339-7ed0276906bb tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5" status: 200 len: 1541 microversion: 2.1 time: 0.662890 Oct 04 18:38:16.415849 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1323/2574] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:15 2022] GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5 => generated 1541 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:16.566049 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-01c6969d-ec4f-4ddc-a35e-fa6949fb9b7c tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:16.566741 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-01c6969d-ec4f-4ddc-a35e-fa6949fb9b7c tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 61ec7cca-1572-496c-ba44-439f04c2a79c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:16.567633 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-daac3e1a-8be4-4e27-a761-08c6f0e6e000 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73127bc6636476482e280eddad7f66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9174b09e32064811a61539c64992ee50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:16.598954 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-01c6969d-ec4f-4ddc-a35e-fa6949fb9b7c tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:16.599708 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-01c6969d-ec4f-4ddc-a35e-fa6949fb9b7c tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:16.601499 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-01c6969d-ec4f-4ddc-a35e-fa6949fb9b7c tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:16.604752 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-01c6969d-ec4f-4ddc-a35e-fa6949fb9b7c tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:16.605518 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-01c6969d-ec4f-4ddc-a35e-fa6949fb9b7c tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:16.606432 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-01c6969d-ec4f-4ddc-a35e-fa6949fb9b7c tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:16.623557 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-daac3e1a-8be4-4e27-a761-08c6f0e6e000 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] 10.222.0.20 "GET /compute/v2.1/servers/b319d463-fa0d-4e2d-b03f-6227475572da" status: 200 len: 1369 microversion: 2.1 time: 0.429205 Oct 04 18:38:16.640107 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1252/2575] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:16 2022] GET /compute/v2.1/servers/b319d463-fa0d-4e2d-b03f-6227475572da => generated 1369 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:16.650542 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-28da92de-3b72-4a16-ab1d-3163b69331b6 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:16.651377 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-28da92de-3b72-4a16-ab1d-3163b69331b6 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 98dfffc8-51aa-407a-a374-8e120ec43a31] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:16.660546 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-28da92de-3b72-4a16-ab1d-3163b69331b6 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:16.660809 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-28da92de-3b72-4a16-ab1d-3163b69331b6 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:16.661324 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-28da92de-3b72-4a16-ab1d-3163b69331b6 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:16.662281 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-28da92de-3b72-4a16-ab1d-3163b69331b6 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:16.666005 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-28da92de-3b72-4a16-ab1d-3163b69331b6 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:16.669432 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-28da92de-3b72-4a16-ab1d-3163b69331b6 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:17.399051 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-28da92de-3b72-4a16-ab1d-3163b69331b6 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:17.407760 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-28da92de-3b72-4a16-ab1d-3163b69331b6 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31" status: 200 len: 1392 microversion: 2.1 time: 0.779459 Oct 04 18:38:17.428787 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1253/2576] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:16 2022] GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31 => generated 1392 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:17.438720 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e2916c54-b779-4252-916d-4d51983f1398 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:17.445778 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e2916c54-b779-4252-916d-4d51983f1398 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] [instance: 0bef06d7-ba85-4f48-bd08-228211391394] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:17.447935 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e2916c54-b779-4252-916d-4d51983f1398 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:17.448619 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e2916c54-b779-4252-916d-4d51983f1398 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:17.449899 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e2916c54-b779-4252-916d-4d51983f1398 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:17.450960 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e2916c54-b779-4252-916d-4d51983f1398 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:17.451593 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e2916c54-b779-4252-916d-4d51983f1398 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:17.452224 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e2916c54-b779-4252-916d-4d51983f1398 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:17.656847 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-01c6969d-ec4f-4ddc-a35e-fa6949fb9b7c tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8284fe51decd4db0bf6b3ed1514cc2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87473abf47e74adf844e3ddfa24da3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:17.674784 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-01c6969d-ec4f-4ddc-a35e-fa6949fb9b7c tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] 10.222.0.20 "GET /compute/v2.1/servers/61ec7cca-1572-496c-ba44-439f04c2a79c" status: 200 len: 1485 microversion: 2.1 time: 1.114353 Oct 04 18:38:17.679421 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1324/2577] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:16 2022] GET /compute/v2.1/servers/61ec7cca-1572-496c-ba44-439f04c2a79c => generated 1485 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:17.682222 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-221a2644-add5-41a2-92ba-8dcdf078781e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:17.683069 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-221a2644-add5-41a2-92ba-8dcdf078781e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: 6b629ba0-6245-442f-bf1a-ad1c1a3116bc] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:17.691545 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-221a2644-add5-41a2-92ba-8dcdf078781e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:17.692411 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-221a2644-add5-41a2-92ba-8dcdf078781e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:17.693099 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-221a2644-add5-41a2-92ba-8dcdf078781e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:17.694029 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-221a2644-add5-41a2-92ba-8dcdf078781e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:17.694778 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-221a2644-add5-41a2-92ba-8dcdf078781e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:17.695418 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-221a2644-add5-41a2-92ba-8dcdf078781e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:17.718302 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-221a2644-add5-41a2-92ba-8dcdf078781e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] HTTP exception thrown: Instance 6b629ba0-6245-442f-bf1a-ad1c1a3116bc could not be found. Oct 04 18:38:17.722646 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-221a2644-add5-41a2-92ba-8dcdf078781e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Request method failure captured: Oct 04 18:38:17.722646 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/6b629ba0-6245-442f-bf1a-ad1c1a3116bc HTTP/1.1 Oct 04 18:38:17.722646 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:38:17.722646 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:38:17.722646 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:38:17.722646 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:38:17.722646 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:38:17.722646 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:38:17.722646 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:38:17.722646 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:38:17.722646 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPHup0Mt_OyDwnruja4S1gmdmaCVMO4uXecUyp2F0Y8-1G2eggJOcOg62Ru7-OxnxnTV3tLeieUdQsjcRftin5u12YtjniY2GtodDByQDpmATG8MPRb-XNcR4e8kX0gQWaLrGaVgyqdxnogKK8Swq664D-K5SgTZfp2H1qk6W31Bqe5k Oct 04 18:38:17.722646 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:38:17.722646 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:38:17.722646 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:38:17.722646 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:38:17.722646 n-d-850501-14 devstack@n-api.service[123002]: X-Openstack-Nova-Api-Version: 2.25 Oct 04 18:38:17.722646 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:38:17.722646 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:38:17.722646 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 1fdde079f17642c69fb250c78903d69c Oct 04 18:38:17.722646 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-842433930 Oct 04 18:38:17.722646 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:38:17.722646 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:38:17.722646 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1fdde079f17642c69fb250c78903d69c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1fdde079f17642c69fb250c78903d69c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1fdde079f17642c69fb250c78903d69c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1fdde079f17642c69fb250c78903d69c"}]}] Oct 04 18:38:17.722646 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-842433930 Oct 04 18:38:17.722646 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 1fdde079f17642c69fb250c78903d69c Oct 04 18:38:17.722646 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-842433930 Oct 04 18:38:17.722646 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-LiveAutoBlockMigrationV225Test-842433930-project Oct 04 18:38:17.722646 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:38:17.722646 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:38:17.722646 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: f1dec45626f44157a6f4637e668097b4 Oct 04 18:38:17.722646 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-842433930-project Oct 04 18:38:17.722646 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:38:17.722646 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 6b629ba0-6245-442f-bf1a-ad1c1a3116bc could not be found. Oct 04 18:38:17.722646 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '6b629ba0-6245-442f-bf1a-ad1c1a3116bc'} Oct 04 18:38:17.722646 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:38:17.722646 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:38:17.722646 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:38:17.722646 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:38:17.722646 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:38:17.722646 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:38:17.722646 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:38:17.722646 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:38:17.722646 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:38:17.722646 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:38:17.722646 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b629ba0-6245-442f-bf1a-ad1c1a3116bc could not be found. Oct 04 18:38:17.722646 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:38:17.722646 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:38:17.722646 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:38:17.722646 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:38:17.722646 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:38:17.722646 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:38:17.722646 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:38:17.722646 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:38:17.722646 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:38:17.722646 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:38:17.722646 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:38:17.722646 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:38:17.722646 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:38:17.722646 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:38:17.722646 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:38:17.722646 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:38:17.722646 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b629ba0-6245-442f-bf1a-ad1c1a3116bc could not be found. Oct 04 18:38:17.722646 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:38:17.726513 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:38:17.726513 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:38:17.726513 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:38:17.726513 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:38:17.726513 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:38:17.726513 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:38:17.726513 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:38:17.726513 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b629ba0-6245-442f-bf1a-ad1c1a3116bc could not be found. Oct 04 18:38:17.726513 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:38:17.726513 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-221a2644-add5-41a2-92ba-8dcdf078781e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Returning 404 to user: Instance 6b629ba0-6245-442f-bf1a-ad1c1a3116bc could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:38:17.726513 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-221a2644-add5-41a2-92ba-8dcdf078781e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/6b629ba0-6245-442f-bf1a-ad1c1a3116bc" status: 404 len: 111 microversion: 2.25 time: 0.046627 Oct 04 18:38:17.730637 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1325/2578] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:17 2022] GET /compute/v2.1/servers/6b629ba0-6245-442f-bf1a-ad1c1a3116bc => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:38:17.746461 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-66b4674d-2635-4e1c-90c0-0cf3eb9ce405 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:17.747458 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-66b4674d-2635-4e1c-90c0-0cf3eb9ce405 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 474a799f-8e38-49d6-8fff-9ec3e7657ef5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:17.755041 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-66b4674d-2635-4e1c-90c0-0cf3eb9ce405 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:17.755546 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-66b4674d-2635-4e1c-90c0-0cf3eb9ce405 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:17.755975 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-66b4674d-2635-4e1c-90c0-0cf3eb9ce405 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:17.756732 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-66b4674d-2635-4e1c-90c0-0cf3eb9ce405 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:17.757457 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-66b4674d-2635-4e1c-90c0-0cf3eb9ce405 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:17.758391 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-66b4674d-2635-4e1c-90c0-0cf3eb9ce405 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:17.777174 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e2916c54-b779-4252-916d-4d51983f1398 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:17.789687 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e2916c54-b779-4252-916d-4d51983f1398 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:17.795496 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e2916c54-b779-4252-916d-4d51983f1398 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:17.798685 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e2916c54-b779-4252-916d-4d51983f1398 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] 10.222.0.20 "GET /compute/v2.1/servers/0bef06d7-ba85-4f48-bd08-228211391394" status: 200 len: 1372 microversion: 2.57 time: 0.367995 Oct 04 18:38:17.801762 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1254/2579] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:17 2022] GET /compute/v2.1/servers/0bef06d7-ba85-4f48-bd08-228211391394 => generated 1372 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:17.825149 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3eb98a5d-0605-446c-9928-a378d41a8f63 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:17.826249 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3eb98a5d-0605-446c-9928-a378d41a8f63 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] [instance: b319d463-fa0d-4e2d-b03f-6227475572da] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:17.843657 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3eb98a5d-0605-446c-9928-a378d41a8f63 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:17.846261 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3eb98a5d-0605-446c-9928-a378d41a8f63 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:17.848863 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3eb98a5d-0605-446c-9928-a378d41a8f63 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:17.851132 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3eb98a5d-0605-446c-9928-a378d41a8f63 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:17.852816 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3eb98a5d-0605-446c-9928-a378d41a8f63 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:17.854231 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3eb98a5d-0605-446c-9928-a378d41a8f63 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:18.150689 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-66b4674d-2635-4e1c-90c0-0cf3eb9ce405 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:18.170691 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-66b4674d-2635-4e1c-90c0-0cf3eb9ce405 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5" status: 200 len: 1541 microversion: 2.1 time: 0.427494 Oct 04 18:38:18.176297 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1326/2580] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:17 2022] GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5 => generated 1541 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:18.193198 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d36bf1cf-af55-4887-a1f3-153c54d81a55 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:18.193826 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d36bf1cf-af55-4887-a1f3-153c54d81a55 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: 609c8bd3-a9fc-4b16-ba22-c87aa44a822d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:18.214092 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d36bf1cf-af55-4887-a1f3-153c54d81a55 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:18.214664 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d36bf1cf-af55-4887-a1f3-153c54d81a55 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:18.215385 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d36bf1cf-af55-4887-a1f3-153c54d81a55 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:18.216662 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d36bf1cf-af55-4887-a1f3-153c54d81a55 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:18.217266 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d36bf1cf-af55-4887-a1f3-153c54d81a55 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:18.217838 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d36bf1cf-af55-4887-a1f3-153c54d81a55 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:18.243510 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3eb98a5d-0605-446c-9928-a378d41a8f63 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73127bc6636476482e280eddad7f66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9174b09e32064811a61539c64992ee50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:18.255748 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3eb98a5d-0605-446c-9928-a378d41a8f63 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] 10.222.0.20 "GET /compute/v2.1/servers/b319d463-fa0d-4e2d-b03f-6227475572da" status: 200 len: 1369 microversion: 2.1 time: 0.452548 Oct 04 18:38:18.257263 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1255/2581] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:17 2022] GET /compute/v2.1/servers/b319d463-fa0d-4e2d-b03f-6227475572da => generated 1369 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:18.263595 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e62455fc-5e04-4dd7-a419-6d1445fea3a1 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1663729698", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:18.289121 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d36bf1cf-af55-4887-a1f3-153c54d81a55 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: 609c8bd3-a9fc-4b16-ba22-c87aa44a822d] Going to try to terminate instance {{(pid=123002) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:38:18.352624 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.neutron [None req-e62455fc-5e04-4dd7-a419-6d1445fea3a1 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] validate_networks() for [('5f0d6ed8-1b1a-4dd2-afb9-d29b58b254e5', None, None, None, None, None)] {{(pid=123001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:38:18.729691 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d36bf1cf-af55-4887-a1f3-153c54d81a55 tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "DELETE /compute/v2.1/servers/609c8bd3-a9fc-4b16-ba22-c87aa44a822d" status: 204 len: 0 microversion: 2.25 time: 0.553219 Oct 04 18:38:18.733434 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1327/2582] 10.222.0.20 () {60 vars in 1280 bytes} [Tue Oct 4 18:38:18 2022] DELETE /compute/v2.1/servers/609c8bd3-a9fc-4b16-ba22-c87aa44a822d => generated 0 bytes in 559 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:38:18.739459 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-87d13974-a5bf-4fb5-8acd-8e4c6d35c7af tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:18.740683 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-87d13974-a5bf-4fb5-8acd-8e4c6d35c7af tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 98dfffc8-51aa-407a-a374-8e120ec43a31] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:18.762465 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-87d13974-a5bf-4fb5-8acd-8e4c6d35c7af tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:18.764119 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-87d13974-a5bf-4fb5-8acd-8e4c6d35c7af tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:18.766415 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-87d13974-a5bf-4fb5-8acd-8e4c6d35c7af tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:18.772609 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-87d13974-a5bf-4fb5-8acd-8e4c6d35c7af tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:18.772609 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-87d13974-a5bf-4fb5-8acd-8e4c6d35c7af tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:18.772609 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-87d13974-a5bf-4fb5-8acd-8e4c6d35c7af tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:19.257414 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-87d13974-a5bf-4fb5-8acd-8e4c6d35c7af tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:19.270743 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-87d13974-a5bf-4fb5-8acd-8e4c6d35c7af tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31" status: 200 len: 1392 microversion: 2.1 time: 0.535305 Oct 04 18:38:19.271305 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1328/2583] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:18 2022] GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31 => generated 1392 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:19.286967 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2f82f51a-3cde-4c25-91e4-88ddd1b7cb3d tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:19.288404 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2f82f51a-3cde-4c25-91e4-88ddd1b7cb3d tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: 609c8bd3-a9fc-4b16-ba22-c87aa44a822d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:19.306224 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2f82f51a-3cde-4c25-91e4-88ddd1b7cb3d tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:19.306794 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2f82f51a-3cde-4c25-91e4-88ddd1b7cb3d tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:19.307319 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2f82f51a-3cde-4c25-91e4-88ddd1b7cb3d tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:19.308863 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2f82f51a-3cde-4c25-91e4-88ddd1b7cb3d tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:19.309431 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2f82f51a-3cde-4c25-91e4-88ddd1b7cb3d tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:19.312576 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2f82f51a-3cde-4c25-91e4-88ddd1b7cb3d tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:19.743055 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2f82f51a-3cde-4c25-91e4-88ddd1b7cb3d tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:19.766724 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2f82f51a-3cde-4c25-91e4-88ddd1b7cb3d tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:19.770417 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2f82f51a-3cde-4c25-91e4-88ddd1b7cb3d tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:19.778080 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2f82f51a-3cde-4c25-91e4-88ddd1b7cb3d tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/609c8bd3-a9fc-4b16-ba22-c87aa44a822d" status: 200 len: 1564 microversion: 2.25 time: 0.503334 Oct 04 18:38:19.793882 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1329/2584] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:19 2022] GET /compute/v2.1/servers/609c8bd3-a9fc-4b16-ba22-c87aa44a822d => generated 1564 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:19.799723 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2ef78c80-0974-4d21-89ec-75c56f41a354 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:19.809817 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2ef78c80-0974-4d21-89ec-75c56f41a354 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] [instance: 0bef06d7-ba85-4f48-bd08-228211391394] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:19.839779 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2ef78c80-0974-4d21-89ec-75c56f41a354 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:19.844677 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2ef78c80-0974-4d21-89ec-75c56f41a354 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:19.853042 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2ef78c80-0974-4d21-89ec-75c56f41a354 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:19.853042 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2ef78c80-0974-4d21-89ec-75c56f41a354 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:19.853042 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2ef78c80-0974-4d21-89ec-75c56f41a354 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:19.853042 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2ef78c80-0974-4d21-89ec-75c56f41a354 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:20.118664 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2ef78c80-0974-4d21-89ec-75c56f41a354 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:20.138728 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2ef78c80-0974-4d21-89ec-75c56f41a354 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:20.141436 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2ef78c80-0974-4d21-89ec-75c56f41a354 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:20.143306 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2ef78c80-0974-4d21-89ec-75c56f41a354 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] 10.222.0.20 "GET /compute/v2.1/servers/0bef06d7-ba85-4f48-bd08-228211391394" status: 200 len: 1357 microversion: 2.57 time: 0.358777 Oct 04 18:38:20.144483 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1330/2585] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:19 2022] GET /compute/v2.1/servers/0bef06d7-ba85-4f48-bd08-228211391394 => generated 1357 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:20.151537 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-51301dbe-fb1f-47ee-94dd-f45372602bd8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:20.153467 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-51301dbe-fb1f-47ee-94dd-f45372602bd8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 474a799f-8e38-49d6-8fff-9ec3e7657ef5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:20.160972 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-51301dbe-fb1f-47ee-94dd-f45372602bd8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:20.162004 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-51301dbe-fb1f-47ee-94dd-f45372602bd8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:20.162603 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-51301dbe-fb1f-47ee-94dd-f45372602bd8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:20.163773 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-51301dbe-fb1f-47ee-94dd-f45372602bd8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:20.165509 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-51301dbe-fb1f-47ee-94dd-f45372602bd8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:20.166100 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-51301dbe-fb1f-47ee-94dd-f45372602bd8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:20.549202 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-e62455fc-5e04-4dd7-a419-6d1445fea3a1 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:38:20.556464 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-e62455fc-5e04-4dd7-a419-6d1445fea3a1 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:38:20.557950 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-e62455fc-5e04-4dd7-a419-6d1445fea3a1 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:38:20.562498 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-e62455fc-5e04-4dd7-a419-6d1445fea3a1 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:38:20.562498 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-e62455fc-5e04-4dd7-a419-6d1445fea3a1 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:38:20.585679 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e62455fc-5e04-4dd7-a419-6d1445fea3a1 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:20.586390 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e62455fc-5e04-4dd7-a419-6d1445fea3a1 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:20.599916 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e62455fc-5e04-4dd7-a419-6d1445fea3a1 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:20.601184 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e62455fc-5e04-4dd7-a419-6d1445fea3a1 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:20.602418 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e62455fc-5e04-4dd7-a419-6d1445fea3a1 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:20.605035 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e62455fc-5e04-4dd7-a419-6d1445fea3a1 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:20.644354 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-e62455fc-5e04-4dd7-a419-6d1445fea3a1 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Getting quotas for project 87473abf47e74adf844e3ddfa24da3f2. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:38:20.650661 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-e62455fc-5e04-4dd7-a419-6d1445fea3a1 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Getting quotas for user 8284fe51decd4db0bf6b3ed1514cc2c1 and project 87473abf47e74adf844e3ddfa24da3f2. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:38:20.675403 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e62455fc-5e04-4dd7-a419-6d1445fea3a1 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Going to run 1 instances... {{(pid=123001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:38:20.679501 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e62455fc-5e04-4dd7-a419-6d1445fea3a1 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 5965d934-6f27-43ac-bf15-8fd20da48cc1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:38:20.686280 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-51301dbe-fb1f-47ee-94dd-f45372602bd8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:20.698559 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-51301dbe-fb1f-47ee-94dd-f45372602bd8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5" status: 200 len: 1541 microversion: 2.1 time: 0.551513 Oct 04 18:38:20.702900 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1331/2586] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:20 2022] GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5 => generated 1541 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:20.736557 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-db48265c-ae45-4afb-adcd-07e7ac879ce5 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:20.737572 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-db48265c-ae45-4afb-adcd-07e7ac879ce5 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] [instance: b319d463-fa0d-4e2d-b03f-6227475572da] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:20.754410 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-db48265c-ae45-4afb-adcd-07e7ac879ce5 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:20.755775 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-db48265c-ae45-4afb-adcd-07e7ac879ce5 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:20.756395 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-db48265c-ae45-4afb-adcd-07e7ac879ce5 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:20.757470 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-db48265c-ae45-4afb-adcd-07e7ac879ce5 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:20.758246 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-db48265c-ae45-4afb-adcd-07e7ac879ce5 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:20.759865 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-db48265c-ae45-4afb-adcd-07e7ac879ce5 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:21.085979 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e62455fc-5e04-4dd7-a419-6d1445fea3a1 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.826335 Oct 04 18:38:21.087780 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1256/2587] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:38:18 2022] POST /compute/v2.1/servers => generated 383 bytes in 2830 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:38:21.099671 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-dea8cd75-47c1-42c7-82c7-c77c3b4ed96b req-d73547aa-edfd-4994-91f7-1908b9020945 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "474a799f-8e38-49d6-8fff-9ec3e7657ef5", "tag": "a0d7cb42-218d-4bf1-adab-5dbf22e8ab22"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:21.142000 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-dea8cd75-47c1-42c7-82c7-c77c3b4ed96b req-d73547aa-edfd-4994-91f7-1908b9020945 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:21.142938 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-dea8cd75-47c1-42c7-82c7-c77c3b4ed96b req-d73547aa-edfd-4994-91f7-1908b9020945 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:21.144546 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-dea8cd75-47c1-42c7-82c7-c77c3b4ed96b req-d73547aa-edfd-4994-91f7-1908b9020945 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:21.165375 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-dea8cd75-47c1-42c7-82c7-c77c3b4ed96b req-d73547aa-edfd-4994-91f7-1908b9020945 service nova] Creating event network-changed:a0d7cb42-218d-4bf1-adab-5dbf22e8ab22 for instance 474a799f-8e38-49d6-8fff-9ec3e7657ef5 on n-h1-850501-14 Oct 04 18:38:21.174327 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [req-dea8cd75-47c1-42c7-82c7-c77c3b4ed96b req-d73547aa-edfd-4994-91f7-1908b9020945 service nova] Instance 474a799f-8e38-49d6-8fff-9ec3e7657ef5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850501-14', 'n-h2-850501-14'} {{(pid=123001) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:38:21.188217 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-dea8cd75-47c1-42c7-82c7-c77c3b4ed96b req-d73547aa-edfd-4994-91f7-1908b9020945 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098045 Oct 04 18:38:21.189200 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1257/2588] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:38:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:21.479735 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-32bc8bde-7a60-4620-aae7-44f3ae846ee3 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Action: 'create', calling method: .version_select at 0x7fe258bdc5e0>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1383890381", "policies": ["affinity"]}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:21.520273 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-32bc8bde-7a60-4620-aae7-44f3ae846ee3 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Getting quotas for project 0e42e9f6c747493685a49d70d7061a37. Resources: {'server_groups'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:38:21.531604 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-32bc8bde-7a60-4620-aae7-44f3ae846ee3 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Getting quotas for user bc7d2e249cfc4feb92c8486a892b8b6d and project 0e42e9f6c747493685a49d70d7061a37. Resources: {'server_groups'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:38:21.583314 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-db48265c-ae45-4afb-adcd-07e7ac879ce5 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73127bc6636476482e280eddad7f66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9174b09e32064811a61539c64992ee50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:21.632956 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-db48265c-ae45-4afb-adcd-07e7ac879ce5 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] 10.222.0.20 "GET /compute/v2.1/servers/b319d463-fa0d-4e2d-b03f-6227475572da" status: 200 len: 1369 microversion: 2.1 time: 0.927636 Oct 04 18:38:21.639801 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1332/2589] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:20 2022] GET /compute/v2.1/servers/b319d463-fa0d-4e2d-b03f-6227475572da => generated 1369 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:21.664163 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9a43ce1b-e7fc-4275-b54c-7309d2acf2ba tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:21.664923 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9a43ce1b-e7fc-4275-b54c-7309d2acf2ba tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] [instance: 0bef06d7-ba85-4f48-bd08-228211391394] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:21.678903 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9a43ce1b-e7fc-4275-b54c-7309d2acf2ba tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:21.682499 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9a43ce1b-e7fc-4275-b54c-7309d2acf2ba tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:21.684454 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9a43ce1b-e7fc-4275-b54c-7309d2acf2ba tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:21.686642 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9a43ce1b-e7fc-4275-b54c-7309d2acf2ba tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:21.686776 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-32bc8bde-7a60-4620-aae7-44f3ae846ee3 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Getting quotas for project 0e42e9f6c747493685a49d70d7061a37. Resources: {'server_groups'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:38:21.692506 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9a43ce1b-e7fc-4275-b54c-7309d2acf2ba tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:21.693433 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9a43ce1b-e7fc-4275-b54c-7309d2acf2ba tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:21.694402 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-32bc8bde-7a60-4620-aae7-44f3ae846ee3 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Getting quotas for user bc7d2e249cfc4feb92c8486a892b8b6d and project 0e42e9f6c747493685a49d70d7061a37. Resources: {'server_groups'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:38:21.716407 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-32bc8bde-7a60-4620-aae7-44f3ae846ee3 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] 10.222.0.20 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.524193 Oct 04 18:38:21.717796 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1258/2590] 10.222.0.20 () {60 vars in 1174 bytes} [Tue Oct 4 18:38:21 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:21.724884 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-77de8904-6300-4996-90f1-b9a3162e4478 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:21.725981 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-77de8904-6300-4996-90f1-b9a3162e4478 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 98dfffc8-51aa-407a-a374-8e120ec43a31] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:21.742457 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-77de8904-6300-4996-90f1-b9a3162e4478 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:21.743294 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-77de8904-6300-4996-90f1-b9a3162e4478 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:21.743950 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-77de8904-6300-4996-90f1-b9a3162e4478 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:21.745460 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-77de8904-6300-4996-90f1-b9a3162e4478 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:21.746660 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-77de8904-6300-4996-90f1-b9a3162e4478 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:21.747367 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-77de8904-6300-4996-90f1-b9a3162e4478 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:21.767495 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=100 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:38:21.781029 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9a43ce1b-e7fc-4275-b54c-7309d2acf2ba tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] [instance: 0bef06d7-ba85-4f48-bd08-228211391394] Going to try to terminate instance {{(pid=123002) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:38:22.343346 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-77de8904-6300-4996-90f1-b9a3162e4478 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:22.367402 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-77de8904-6300-4996-90f1-b9a3162e4478 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31" status: 200 len: 1382 microversion: 2.1 time: 0.646560 Oct 04 18:38:22.371863 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1259/2591] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:21 2022] GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31 => generated 1382 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:22.381721 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:38:22.575667 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-5eb112d8-a8ea-4a5a-9674-1a50b334114f req-4c4b5996-2dfb-40dc-a5a5-2446b1d2d532 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b319d463-fa0d-4e2d-b03f-6227475572da", "name": "network-vif-plugged", "status": "completed", "tag": "617a3d5c-1b67-469f-ad73-1ceedb040447"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:22.578665 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9a43ce1b-e7fc-4275-b54c-7309d2acf2ba tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0bef06d7-ba85-4f48-bd08-228211391394" status: 204 len: 0 microversion: 2.57 time: 0.931058 Oct 04 18:38:22.579381 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1333/2592] 10.222.0.20 () {60 vars in 1280 bytes} [Tue Oct 4 18:38:21 2022] DELETE /compute/v2.1/servers/0bef06d7-ba85-4f48-bd08-228211391394 => generated 0 bytes in 938 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:38:22.585412 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-157edf69-be47-48fe-935f-d49f6579a31e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:22.586239 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-157edf69-be47-48fe-935f-d49f6579a31e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: 609c8bd3-a9fc-4b16-ba22-c87aa44a822d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:22.606849 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-5eb112d8-a8ea-4a5a-9674-1a50b334114f req-4c4b5996-2dfb-40dc-a5a5-2446b1d2d532 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:22.609087 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-157edf69-be47-48fe-935f-d49f6579a31e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:22.609220 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-5eb112d8-a8ea-4a5a-9674-1a50b334114f req-4c4b5996-2dfb-40dc-a5a5-2446b1d2d532 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:22.609597 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-5eb112d8-a8ea-4a5a-9674-1a50b334114f req-4c4b5996-2dfb-40dc-a5a5-2446b1d2d532 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:22.610529 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-157edf69-be47-48fe-935f-d49f6579a31e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:22.610529 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-157edf69-be47-48fe-935f-d49f6579a31e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:22.612305 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-157edf69-be47-48fe-935f-d49f6579a31e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:22.612305 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-157edf69-be47-48fe-935f-d49f6579a31e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:22.613307 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-157edf69-be47-48fe-935f-d49f6579a31e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:22.650798 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-5eb112d8-a8ea-4a5a-9674-1a50b334114f req-4c4b5996-2dfb-40dc-a5a5-2446b1d2d532 service nova] Creating event network-vif-plugged:617a3d5c-1b67-469f-ad73-1ceedb040447 for instance b319d463-fa0d-4e2d-b03f-6227475572da on n-h1-850501-14 Oct 04 18:38:22.675273 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-5eb112d8-a8ea-4a5a-9674-1a50b334114f req-4c4b5996-2dfb-40dc-a5a5-2446b1d2d532 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.299852 Oct 04 18:38:22.683769 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1260/2593] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:38:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:22.692500 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c94edbbf-e69b-467c-b0b4-a9f278092a05 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:22.695332 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c94edbbf-e69b-467c-b0b4-a9f278092a05 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 5965d934-6f27-43ac-bf15-8fd20da48cc1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:22.788040 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-157edf69-be47-48fe-935f-d49f6579a31e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:22.800701 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-157edf69-be47-48fe-935f-d49f6579a31e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:22.804044 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-157edf69-be47-48fe-935f-d49f6579a31e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:22.809918 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-157edf69-be47-48fe-935f-d49f6579a31e tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/609c8bd3-a9fc-4b16-ba22-c87aa44a822d" status: 200 len: 1347 microversion: 2.25 time: 0.228914 Oct 04 18:38:22.810144 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c94edbbf-e69b-467c-b0b4-a9f278092a05 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8284fe51decd4db0bf6b3ed1514cc2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87473abf47e74adf844e3ddfa24da3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:22.811403 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1334/2594] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:22 2022] GET /compute/v2.1/servers/609c8bd3-a9fc-4b16-ba22-c87aa44a822d => generated 1347 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:22.821346 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-bee3e9cd-2753-4fcd-a0ec-c5edac9c7fe2 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Action: 'create', calling method: .version_select at 0x7fe258353940>, body: {"server_group": {"name": "tempest-server-group-1088418503", "policies": ["affinity"]}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:22.850350 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c94edbbf-e69b-467c-b0b4-a9f278092a05 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] 10.222.0.20 "GET /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1" status: 200 len: 1214 microversion: 2.1 time: 0.172678 Oct 04 18:38:22.851261 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1261/2595] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:22 2022] GET /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1 => generated 1214 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:22.857993 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9dce4590-f290-4c88-a1bd-c340dcee5414 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:22.858860 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-9dce4590-f290-4c88-a1bd-c340dcee5414 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 474a799f-8e38-49d6-8fff-9ec3e7657ef5] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:22.865019 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:38:22.867934 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9dce4590-f290-4c88-a1bd-c340dcee5414 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:22.868822 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9dce4590-f290-4c88-a1bd-c340dcee5414 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:22.869807 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9dce4590-f290-4c88-a1bd-c340dcee5414 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:22.870888 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9dce4590-f290-4c88-a1bd-c340dcee5414 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:22.871894 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9dce4590-f290-4c88-a1bd-c340dcee5414 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:22.872616 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9dce4590-f290-4c88-a1bd-c340dcee5414 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:22.908868 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-bee3e9cd-2753-4fcd-a0ec-c5edac9c7fe2 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Getting quotas for project 0e42e9f6c747493685a49d70d7061a37. Resources: {'server_groups'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:38:22.929216 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-bee3e9cd-2753-4fcd-a0ec-c5edac9c7fe2 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Getting quotas for user bc7d2e249cfc4feb92c8486a892b8b6d and project 0e42e9f6c747493685a49d70d7061a37. Resources: {'server_groups'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:38:23.069855 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9dce4590-f290-4c88-a1bd-c340dcee5414 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:23.083670 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9dce4590-f290-4c88-a1bd-c340dcee5414 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5" status: 200 len: 1473 microversion: 2.1 time: 0.231170 Oct 04 18:38:23.085015 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1262/2596] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:22 2022] GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5 => generated 1473 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:23.090756 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-fc87fd59-ced5-4779-a641-627faf9d5348 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Calling method '.version_select at 0x7fe258bd8a60>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:23.095472 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fc87fd59-ced5-4779-a641-627faf9d5348 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:23.096576 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fc87fd59-ced5-4779-a641-627faf9d5348 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:23.097497 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fc87fd59-ced5-4779-a641-627faf9d5348 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:23.103788 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-bee3e9cd-2753-4fcd-a0ec-c5edac9c7fe2 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Getting quotas for project 0e42e9f6c747493685a49d70d7061a37. Resources: {'server_groups'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:38:23.109517 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-bee3e9cd-2753-4fcd-a0ec-c5edac9c7fe2 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Getting quotas for user bc7d2e249cfc4feb92c8486a892b8b6d and project 0e42e9f6c747493685a49d70d7061a37. Resources: {'server_groups'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:38:23.115823 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-fc87fd59-ced5-4779-a641-627faf9d5348 tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 3152 microversion: 2.1 time: 0.029135 Oct 04 18:38:23.117397 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1263/2597] 10.222.0.20 () {58 vars in 1143 bytes} [Tue Oct 4 18:38:23 2022] GET /compute/v2.1/os-migrations => generated 3152 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:23.123886 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c258c132-6218-4ceb-8489-d4c07c0d41c6 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:23.126973 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c258c132-6218-4ceb-8489-d4c07c0d41c6 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] [instance: 0bef06d7-ba85-4f48-bd08-228211391394] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:23.132630 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=3,nova_api:INSERT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:38:23.135152 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c258c132-6218-4ceb-8489-d4c07c0d41c6 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:23.136178 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c258c132-6218-4ceb-8489-d4c07c0d41c6 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:23.137176 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c258c132-6218-4ceb-8489-d4c07c0d41c6 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:23.137457 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-bee3e9cd-2753-4fcd-a0ec-c5edac9c7fe2 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] 10.222.0.20 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.322304 Oct 04 18:38:23.138068 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1335/2598] 10.222.0.20 () {60 vars in 1173 bytes} [Tue Oct 4 18:38:22 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:23.143754 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c258c132-6218-4ceb-8489-d4c07c0d41c6 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:23.143754 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c258c132-6218-4ceb-8489-d4c07c0d41c6 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:23.143754 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c258c132-6218-4ceb-8489-d4c07c0d41c6 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:23.149603 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-57a17ab9-253a-4728-a904-b3dc8fd8c7c0 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:23.153642 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-57a17ab9-253a-4728-a904-b3dc8fd8c7c0 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] [instance: b319d463-fa0d-4e2d-b03f-6227475572da] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:23.161751 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-57a17ab9-253a-4728-a904-b3dc8fd8c7c0 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:23.164726 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-57a17ab9-253a-4728-a904-b3dc8fd8c7c0 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:23.167967 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-57a17ab9-253a-4728-a904-b3dc8fd8c7c0 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:23.169242 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-57a17ab9-253a-4728-a904-b3dc8fd8c7c0 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:23.169890 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-57a17ab9-253a-4728-a904-b3dc8fd8c7c0 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:23.170558 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-57a17ab9-253a-4728-a904-b3dc8fd8c7c0 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:23.256204 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c258c132-6218-4ceb-8489-d4c07c0d41c6 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:23.271929 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c258c132-6218-4ceb-8489-d4c07c0d41c6 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:23.273755 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c258c132-6218-4ceb-8489-d4c07c0d41c6 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:23.275281 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c258c132-6218-4ceb-8489-d4c07c0d41c6 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] 10.222.0.20 "GET /compute/v2.1/servers/0bef06d7-ba85-4f48-bd08-228211391394" status: 200 len: 1363 microversion: 2.57 time: 0.156649 Oct 04 18:38:23.276717 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1264/2599] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:23 2022] GET /compute/v2.1/servers/0bef06d7-ba85-4f48-bd08-228211391394 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:23.284917 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c73268eb-da50-4ddf-9fec-9d68e4f177bc tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:23.286329 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c73268eb-da50-4ddf-9fec-9d68e4f177bc tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] [instance: 98dfffc8-51aa-407a-a374-8e120ec43a31] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:23.310524 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c73268eb-da50-4ddf-9fec-9d68e4f177bc tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:23.311860 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c73268eb-da50-4ddf-9fec-9d68e4f177bc tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:23.312726 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c73268eb-da50-4ddf-9fec-9d68e4f177bc tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:23.314696 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c73268eb-da50-4ddf-9fec-9d68e4f177bc tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:23.315405 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c73268eb-da50-4ddf-9fec-9d68e4f177bc tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:23.316080 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c73268eb-da50-4ddf-9fec-9d68e4f177bc tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:23.398202 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-57a17ab9-253a-4728-a904-b3dc8fd8c7c0 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73127bc6636476482e280eddad7f66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9174b09e32064811a61539c64992ee50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:23.409611 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-57a17ab9-253a-4728-a904-b3dc8fd8c7c0 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] 10.222.0.20 "GET /compute/v2.1/servers/b319d463-fa0d-4e2d-b03f-6227475572da" status: 200 len: 1369 microversion: 2.1 time: 0.264228 Oct 04 18:38:23.410163 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1336/2600] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:23 2022] GET /compute/v2.1/servers/b319d463-fa0d-4e2d-b03f-6227475572da => generated 1369 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:23.421996 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-991f9543-115a-4ef3-a940-0c1b67307199 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Action: 'create', calling method: .version_select at 0x7fe258353ca0>, body: {"server_group": {"name": "tempest-server-group-1088418503", "policies": ["affinity"]}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:23.478760 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-991f9543-115a-4ef3-a940-0c1b67307199 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Getting quotas for project 0e42e9f6c747493685a49d70d7061a37. Resources: {'server_groups'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:38:23.484998 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-991f9543-115a-4ef3-a940-0c1b67307199 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Getting quotas for user bc7d2e249cfc4feb92c8486a892b8b6d and project 0e42e9f6c747493685a49d70d7061a37. Resources: {'server_groups'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:38:23.594181 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c73268eb-da50-4ddf-9fec-9d68e4f177bc tempest-LiveMigrationTest-1888124202 tempest-LiveMigrationTest-1888124202-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31" status: 200 len: 1535 microversion: 2.1 time: 0.315023 Oct 04 18:38:23.595226 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1265/2601] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:23 2022] GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31 => generated 1535 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:23.601763 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-7ad9754d-5620-47c5-8702-c7859d082d73 req-00ba824e-ac9d-4632-a499-690bfbac4ee0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "609c8bd3-a9fc-4b16-ba22-c87aa44a822d", "name": "network-vif-deleted", "tag": "5cd956ff-e097-4445-a4d4-66c2548f3dc6"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:23.629350 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-7ad9754d-5620-47c5-8702-c7859d082d73 req-00ba824e-ac9d-4632-a499-690bfbac4ee0 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:23.630195 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-7ad9754d-5620-47c5-8702-c7859d082d73 req-00ba824e-ac9d-4632-a499-690bfbac4ee0 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:23.630855 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-7ad9754d-5620-47c5-8702-c7859d082d73 req-00ba824e-ac9d-4632-a499-690bfbac4ee0 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:23.648473 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-991f9543-115a-4ef3-a940-0c1b67307199 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Getting quotas for project 0e42e9f6c747493685a49d70d7061a37. Resources: {'server_groups'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:38:23.653981 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-7ad9754d-5620-47c5-8702-c7859d082d73 req-00ba824e-ac9d-4632-a499-690bfbac4ee0 service nova] Creating event network-vif-deleted:5cd956ff-e097-4445-a4d4-66c2548f3dc6 for instance 609c8bd3-a9fc-4b16-ba22-c87aa44a822d on n-h2-850501-14 Oct 04 18:38:23.660838 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-7ad9754d-5620-47c5-8702-c7859d082d73 req-00ba824e-ac9d-4632-a499-690bfbac4ee0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064173 Oct 04 18:38:23.662532 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-991f9543-115a-4ef3-a940-0c1b67307199 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Getting quotas for user bc7d2e249cfc4feb92c8486a892b8b6d and project 0e42e9f6c747493685a49d70d7061a37. Resources: {'server_groups'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:38:23.663235 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1266/2602] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:38:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:23.671630 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-fee039a1-d6c7-40a5-a3f4-a0d508088302 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:23.672301 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-fee039a1-d6c7-40a5-a3f4-a0d508088302 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 98dfffc8-51aa-407a-a374-8e120ec43a31] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:23.686000 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fee039a1-d6c7-40a5-a3f4-a0d508088302 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:23.686902 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fee039a1-d6c7-40a5-a3f4-a0d508088302 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:23.687749 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fee039a1-d6c7-40a5-a3f4-a0d508088302 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:23.689246 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fee039a1-d6c7-40a5-a3f4-a0d508088302 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:23.703726 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fee039a1-d6c7-40a5-a3f4-a0d508088302 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:23.704944 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fee039a1-d6c7-40a5-a3f4-a0d508088302 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:23.723903 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-991f9543-115a-4ef3-a940-0c1b67307199 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] 10.222.0.20 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.306359 Oct 04 18:38:23.726017 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1337/2603] 10.222.0.20 () {60 vars in 1173 bytes} [Tue Oct 4 18:38:23 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:23.748678 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-13044d64-51c2-45d4-a494-a0e9ebc42f63 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:23.766575 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-fee039a1-d6c7-40a5-a3f4-a0d508088302 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 98dfffc8-51aa-407a-a374-8e120ec43a31] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:38:23.900823 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-13044d64-51c2-45d4-a494-a0e9ebc42f63 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/3c0b88f8-2bee-4d53-9958-aed4deac7af7" status: 204 len: 0 microversion: 2.1 time: 0.160741 Oct 04 18:38:23.901419 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1338/2604] 10.222.0.20 () {58 vars in 1266 bytes} [Tue Oct 4 18:38:23 2022] DELETE /compute/v2.1/os-server-groups/3c0b88f8-2bee-4d53-9958-aed4deac7af7 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:38:23.907614 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a73d2772-a6bf-426c-935c-89513906db1b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:23.908264 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a73d2772-a6bf-426c-935c-89513906db1b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: 609c8bd3-a9fc-4b16-ba22-c87aa44a822d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:23.915197 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a73d2772-a6bf-426c-935c-89513906db1b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:23.915950 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a73d2772-a6bf-426c-935c-89513906db1b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:23.916674 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a73d2772-a6bf-426c-935c-89513906db1b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:23.917688 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a73d2772-a6bf-426c-935c-89513906db1b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:23.918997 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a73d2772-a6bf-426c-935c-89513906db1b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:23.919604 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a73d2772-a6bf-426c-935c-89513906db1b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:23.957460 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a73d2772-a6bf-426c-935c-89513906db1b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:23.958210 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a73d2772-a6bf-426c-935c-89513906db1b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:23.958808 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a73d2772-a6bf-426c-935c-89513906db1b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:23.959422 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-a73d2772-a6bf-426c-935c-89513906db1b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lazy-loading 'fault' on Instance uuid 609c8bd3-a9fc-4b16-ba22-c87aa44a822d {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:38:24.151096 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a73d2772-a6bf-426c-935c-89513906db1b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:24.162316 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a73d2772-a6bf-426c-935c-89513906db1b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:24.167031 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a73d2772-a6bf-426c-935c-89513906db1b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1dec45626f44157a6f4637e668097b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fdde079f17642c69fb250c78903d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:24.174363 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a73d2772-a6bf-426c-935c-89513906db1b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/609c8bd3-a9fc-4b16-ba22-c87aa44a822d" status: 200 len: 1352 microversion: 2.25 time: 0.265769 Oct 04 18:38:24.188167 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1339/2605] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:23 2022] GET /compute/v2.1/servers/609c8bd3-a9fc-4b16-ba22-c87aa44a822d => generated 1352 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:24.188167 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e826e422-5af6-4f82-8702-6e04eb6d4909 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:24.188167 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e826e422-5af6-4f82-8702-6e04eb6d4909 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 5965d934-6f27-43ac-bf15-8fd20da48cc1] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:24.206150 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e826e422-5af6-4f82-8702-6e04eb6d4909 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:24.206150 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e826e422-5af6-4f82-8702-6e04eb6d4909 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:24.206568 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e826e422-5af6-4f82-8702-6e04eb6d4909 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:24.210172 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e826e422-5af6-4f82-8702-6e04eb6d4909 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:24.210653 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e826e422-5af6-4f82-8702-6e04eb6d4909 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:24.211101 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e826e422-5af6-4f82-8702-6e04eb6d4909 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:24.252551 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-fee039a1-d6c7-40a5-a3f4-a0d508088302 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "DELETE /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31" status: 204 len: 0 microversion: 2.1 time: 0.584777 Oct 04 18:38:24.255012 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1267/2606] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:38:23 2022] DELETE /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:38:24.267422 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c5a3f091-5751-441e-922a-32e7411a80dd tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:24.319810 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c5a3f091-5751-441e-922a-32e7411a80dd tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups" status: 200 len: 335 microversion: 2.1 time: 0.061118 Oct 04 18:38:24.321714 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1268/2607] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Oct 4 18:38:24 2022] GET /compute/v2.1/os-server-groups => generated 335 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:24.341771 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7b7d6d75-8fbc-45aa-8e25-bb48b9eaa86a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:24.343741 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7b7d6d75-8fbc-45aa-8e25-bb48b9eaa86a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 474a799f-8e38-49d6-8fff-9ec3e7657ef5] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:24.372665 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7b7d6d75-8fbc-45aa-8e25-bb48b9eaa86a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:24.373515 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7b7d6d75-8fbc-45aa-8e25-bb48b9eaa86a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:24.374320 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7b7d6d75-8fbc-45aa-8e25-bb48b9eaa86a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:24.375418 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7b7d6d75-8fbc-45aa-8e25-bb48b9eaa86a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:24.377934 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7b7d6d75-8fbc-45aa-8e25-bb48b9eaa86a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:24.378908 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7b7d6d75-8fbc-45aa-8e25-bb48b9eaa86a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:24.396320 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e826e422-5af6-4f82-8702-6e04eb6d4909 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8284fe51decd4db0bf6b3ed1514cc2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87473abf47e74adf844e3ddfa24da3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:24.425509 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e826e422-5af6-4f82-8702-6e04eb6d4909 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] 10.222.0.20 "GET /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1" status: 200 len: 1218 microversion: 2.1 time: 0.240535 Oct 04 18:38:24.427932 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1340/2608] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:24 2022] GET /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1 => generated 1218 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:24.452270 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3f0fb943-e887-4ba1-afd6-965891519822 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:24.453574 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3f0fb943-e887-4ba1-afd6-965891519822 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 98dfffc8-51aa-407a-a374-8e120ec43a31] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:24.474718 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f0fb943-e887-4ba1-afd6-965891519822 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:24.478362 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f0fb943-e887-4ba1-afd6-965891519822 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:24.479127 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f0fb943-e887-4ba1-afd6-965891519822 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:24.483636 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f0fb943-e887-4ba1-afd6-965891519822 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:24.484393 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f0fb943-e887-4ba1-afd6-965891519822 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:24.485011 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f0fb943-e887-4ba1-afd6-965891519822 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:24.885698 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7b7d6d75-8fbc-45aa-8e25-bb48b9eaa86a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:24.905403 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7b7d6d75-8fbc-45aa-8e25-bb48b9eaa86a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5" status: 200 len: 1473 microversion: 2.1 time: 0.573666 Oct 04 18:38:24.910391 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1269/2609] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:24 2022] GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5 => generated 1473 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:24.910517 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3f0fb943-e887-4ba1-afd6-965891519822 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:24.919332 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9d8eaff1-4cec-42e1-a5c7-e3d64f73db6e tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:24.919694 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3f0fb943-e887-4ba1-afd6-965891519822 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31" status: 200 len: 1388 microversion: 2.1 time: 0.490443 Oct 04 18:38:24.923819 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-9d8eaff1-4cec-42e1-a5c7-e3d64f73db6e tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] [instance: 0bef06d7-ba85-4f48-bd08-228211391394] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:24.924322 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1341/2610] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:24 2022] GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31 => generated 1388 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:24.929572 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c5931a8d-bdaf-405e-b7e0-e43cf5f9ecb7 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:24.939695 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9d8eaff1-4cec-42e1-a5c7-e3d64f73db6e tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:24.941592 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9d8eaff1-4cec-42e1-a5c7-e3d64f73db6e tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:24.942250 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9d8eaff1-4cec-42e1-a5c7-e3d64f73db6e tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:24.943521 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9d8eaff1-4cec-42e1-a5c7-e3d64f73db6e tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:24.948421 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9d8eaff1-4cec-42e1-a5c7-e3d64f73db6e tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:24.950788 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9d8eaff1-4cec-42e1-a5c7-e3d64f73db6e tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:25.049752 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c5931a8d-bdaf-405e-b7e0-e43cf5f9ecb7 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/a4ca6ff6-cc0c-4e62-9af4-60894159f748" status: 204 len: 0 microversion: 2.1 time: 0.124041 Oct 04 18:38:25.053698 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1342/2611] 10.222.0.20 () {58 vars in 1266 bytes} [Tue Oct 4 18:38:24 2022] DELETE /compute/v2.1/os-server-groups/a4ca6ff6-cc0c-4e62-9af4-60894159f748 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:38:25.055908 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9c8d5de5-f7af-434a-89a6-81f85c8f44c7 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:25.057342 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9c8d5de5-f7af-434a-89a6-81f85c8f44c7 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] [instance: b319d463-fa0d-4e2d-b03f-6227475572da] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:25.072532 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9c8d5de5-f7af-434a-89a6-81f85c8f44c7 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:25.072930 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9c8d5de5-f7af-434a-89a6-81f85c8f44c7 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:25.077522 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9c8d5de5-f7af-434a-89a6-81f85c8f44c7 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:25.078309 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9c8d5de5-f7af-434a-89a6-81f85c8f44c7 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:25.078775 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9c8d5de5-f7af-434a-89a6-81f85c8f44c7 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:25.079324 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9c8d5de5-f7af-434a-89a6-81f85c8f44c7 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:25.098511 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9d8eaff1-4cec-42e1-a5c7-e3d64f73db6e tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:25.120722 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9d8eaff1-4cec-42e1-a5c7-e3d64f73db6e tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:25.135187 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9d8eaff1-4cec-42e1-a5c7-e3d64f73db6e tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:25.152388 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9d8eaff1-4cec-42e1-a5c7-e3d64f73db6e tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] 10.222.0.20 "GET /compute/v2.1/servers/0bef06d7-ba85-4f48-bd08-228211391394" status: 200 len: 1363 microversion: 2.57 time: 0.244900 Oct 04 18:38:25.157716 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1270/2612] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:24 2022] GET /compute/v2.1/servers/0bef06d7-ba85-4f48-bd08-228211391394 => generated 1363 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:25.181623 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e1816b2b-9a25-4e4a-8636-e3cc8b16a76a tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:25.212652 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e1816b2b-9a25-4e4a-8636-e3cc8b16a76a tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.051549 Oct 04 18:38:25.214115 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1271/2613] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Oct 4 18:38:25 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:25.226585 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6ede7550-7dc9-4fab-9254-a53164ea043b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:25.229778 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6ede7550-7dc9-4fab-9254-a53164ea043b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] [instance: 609c8bd3-a9fc-4b16-ba22-c87aa44a822d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:25.239630 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6ede7550-7dc9-4fab-9254-a53164ea043b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:25.240203 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6ede7550-7dc9-4fab-9254-a53164ea043b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:25.240624 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6ede7550-7dc9-4fab-9254-a53164ea043b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:25.241529 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6ede7550-7dc9-4fab-9254-a53164ea043b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:25.242491 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6ede7550-7dc9-4fab-9254-a53164ea043b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:25.243121 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6ede7550-7dc9-4fab-9254-a53164ea043b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:25.249609 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9c8d5de5-f7af-434a-89a6-81f85c8f44c7 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73127bc6636476482e280eddad7f66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9174b09e32064811a61539c64992ee50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:25.262541 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9c8d5de5-f7af-434a-89a6-81f85c8f44c7 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] 10.222.0.20 "GET /compute/v2.1/servers/b319d463-fa0d-4e2d-b03f-6227475572da" status: 200 len: 1369 microversion: 2.1 time: 0.209840 Oct 04 18:38:25.264240 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1343/2614] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:25 2022] GET /compute/v2.1/servers/b319d463-fa0d-4e2d-b03f-6227475572da => generated 1369 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:25.270091 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e393ee54-2047-402b-8700-fba93d610aba tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Action: 'create', calling method: .version_select at 0x7fe258301700>, body: {"server_group": {"name": "tempest-server-group-2006850618", "policies": ["affinity"]}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:25.277885 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-6ede7550-7dc9-4fab-9254-a53164ea043b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] HTTP exception thrown: Instance 609c8bd3-a9fc-4b16-ba22-c87aa44a822d could not be found. Oct 04 18:38:25.277885 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6ede7550-7dc9-4fab-9254-a53164ea043b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Request method failure captured: Oct 04 18:38:25.277885 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/609c8bd3-a9fc-4b16-ba22-c87aa44a822d HTTP/1.1 Oct 04 18:38:25.277885 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:38:25.277885 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:38:25.277885 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:38:25.277885 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:38:25.277885 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:38:25.277885 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:38:25.277885 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:38:25.277885 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:38:25.277885 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPHup0Mt_OyDwnruja4S1gmdmaCVMO4uXecUyp2F0Y8-1G2eggJOcOg62Ru7-OxnxnTV3tLeieUdQsjcRftin5u12YtjniY2GtodDByQDpmATG8MPRb-XNcR4e8kX0gQWaLrGaVgyqdxnogKK8Swq664D-K5SgTZfp2H1qk6W31Bqe5k Oct 04 18:38:25.277885 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:38:25.277885 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:38:25.277885 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:38:25.277885 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:38:25.277885 n-d-850501-14 devstack@n-api.service[123001]: X-Openstack-Nova-Api-Version: 2.25 Oct 04 18:38:25.277885 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:38:25.277885 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:38:25.277885 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 1fdde079f17642c69fb250c78903d69c Oct 04 18:38:25.277885 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-842433930 Oct 04 18:38:25.277885 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:38:25.277885 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:38:25.277885 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1fdde079f17642c69fb250c78903d69c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1fdde079f17642c69fb250c78903d69c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1fdde079f17642c69fb250c78903d69c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1fdde079f17642c69fb250c78903d69c"}]}] Oct 04 18:38:25.277885 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-842433930 Oct 04 18:38:25.277885 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 1fdde079f17642c69fb250c78903d69c Oct 04 18:38:25.277885 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-842433930 Oct 04 18:38:25.277885 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-LiveAutoBlockMigrationV225Test-842433930-project Oct 04 18:38:25.277885 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:38:25.277885 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:38:25.277885 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: f1dec45626f44157a6f4637e668097b4 Oct 04 18:38:25.277885 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-842433930-project Oct 04 18:38:25.277885 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:38:25.277885 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 609c8bd3-a9fc-4b16-ba22-c87aa44a822d could not be found. Oct 04 18:38:25.277885 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '609c8bd3-a9fc-4b16-ba22-c87aa44a822d'} Oct 04 18:38:25.277885 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:38:25.277885 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:38:25.277885 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:38:25.277885 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:38:25.277885 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:38:25.277885 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:38:25.277885 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:38:25.277885 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:38:25.277885 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:38:25.277885 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:38:25.277885 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 609c8bd3-a9fc-4b16-ba22-c87aa44a822d could not be found. Oct 04 18:38:25.277885 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:38:25.277885 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:38:25.277885 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:38:25.277885 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:38:25.277885 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:38:25.277885 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:38:25.277885 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:38:25.277885 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:38:25.277885 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:38:25.277885 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:38:25.277885 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:38:25.277885 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:38:25.277885 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:38:25.277885 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:38:25.277885 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:38:25.282147 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:38:25.282147 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 609c8bd3-a9fc-4b16-ba22-c87aa44a822d could not be found. Oct 04 18:38:25.282147 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:38:25.282147 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:38:25.282147 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:38:25.282147 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:38:25.282147 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:38:25.282147 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:38:25.282147 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:38:25.282147 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:38:25.282147 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 609c8bd3-a9fc-4b16-ba22-c87aa44a822d could not be found. Oct 04 18:38:25.282147 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:38:25.282147 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6ede7550-7dc9-4fab-9254-a53164ea043b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] Returning 404 to user: Instance 609c8bd3-a9fc-4b16-ba22-c87aa44a822d could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:38:25.284272 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6ede7550-7dc9-4fab-9254-a53164ea043b tempest-LiveAutoBlockMigrationV225Test-842433930 tempest-LiveAutoBlockMigrationV225Test-842433930-project] 10.222.0.20 "GET /compute/v2.1/servers/609c8bd3-a9fc-4b16-ba22-c87aa44a822d" status: 404 len: 111 microversion: 2.25 time: 0.062309 Oct 04 18:38:25.285400 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1272/2615] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:25 2022] GET /compute/v2.1/servers/609c8bd3-a9fc-4b16-ba22-c87aa44a822d => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:38:25.316831 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-e393ee54-2047-402b-8700-fba93d610aba tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Getting quotas for project 0e42e9f6c747493685a49d70d7061a37. Resources: {'server_groups'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:38:25.336342 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-e393ee54-2047-402b-8700-fba93d610aba tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Getting quotas for user bc7d2e249cfc4feb92c8486a892b8b6d and project 0e42e9f6c747493685a49d70d7061a37. Resources: {'server_groups'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:38:25.456941 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3d1dccda-de42-493e-a77c-860de47be4e3 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:25.458016 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3d1dccda-de42-493e-a77c-860de47be4e3 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 5965d934-6f27-43ac-bf15-8fd20da48cc1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:25.476813 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3d1dccda-de42-493e-a77c-860de47be4e3 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:25.477370 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3d1dccda-de42-493e-a77c-860de47be4e3 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:25.477814 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3d1dccda-de42-493e-a77c-860de47be4e3 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:25.478520 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3d1dccda-de42-493e-a77c-860de47be4e3 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:25.478977 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3d1dccda-de42-493e-a77c-860de47be4e3 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:25.479391 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3d1dccda-de42-493e-a77c-860de47be4e3 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:25.484462 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-e393ee54-2047-402b-8700-fba93d610aba tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Getting quotas for project 0e42e9f6c747493685a49d70d7061a37. Resources: {'server_groups'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:38:25.504316 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-e393ee54-2047-402b-8700-fba93d610aba tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Getting quotas for user bc7d2e249cfc4feb92c8486a892b8b6d and project 0e42e9f6c747493685a49d70d7061a37. Resources: {'server_groups'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:38:25.556991 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e393ee54-2047-402b-8700-fba93d610aba tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] 10.222.0.20 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.288778 Oct 04 18:38:25.559468 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1344/2616] 10.222.0.20 () {60 vars in 1173 bytes} [Tue Oct 4 18:38:25 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:25.575610 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8af2099b-6cde-4fc2-8e9a-4515fcbc4cdf tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:25.595834 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3d1dccda-de42-493e-a77c-860de47be4e3 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8284fe51decd4db0bf6b3ed1514cc2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87473abf47e74adf844e3ddfa24da3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:25.614913 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3d1dccda-de42-493e-a77c-860de47be4e3 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] 10.222.0.20 "GET /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1" status: 200 len: 1266 microversion: 2.1 time: 0.162829 Oct 04 18:38:25.615643 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1273/2617] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:25 2022] GET /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:25.692533 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8af2099b-6cde-4fc2-8e9a-4515fcbc4cdf tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/c07ec8ff-0f80-4642-ad6c-a261d389ca4c" status: 204 len: 0 microversion: 2.1 time: 0.123445 Oct 04 18:38:25.693602 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1345/2618] 10.222.0.20 () {58 vars in 1266 bytes} [Tue Oct 4 18:38:25 2022] DELETE /compute/v2.1/os-server-groups/c07ec8ff-0f80-4642-ad6c-a261d389ca4c => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:38:25.702941 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f590ed50-461b-4622-94af-1e94e19ed7e4 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:25.731000 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f590ed50-461b-4622-94af-1e94e19ed7e4 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.031415 Oct 04 18:38:25.732625 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1274/2619] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Oct 4 18:38:25 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:25.745308 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b9389adf-a2b9-4055-a173-cf8100a4af8d tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Action: 'create', calling method: .version_select at 0x7fe258353940>, body: {"server_group": {"name": "tempest-server-group-1186345193", "policies": ["anti-affinity"]}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:25.779207 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-b9389adf-a2b9-4055-a173-cf8100a4af8d tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Getting quotas for project 0e42e9f6c747493685a49d70d7061a37. Resources: {'server_groups'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:38:25.789159 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-b9389adf-a2b9-4055-a173-cf8100a4af8d tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Getting quotas for user bc7d2e249cfc4feb92c8486a892b8b6d and project 0e42e9f6c747493685a49d70d7061a37. Resources: {'server_groups'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:38:25.804707 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=4,nova_api:DELETE=9 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:38:25.933082 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c665dde0-9eb8-4960-9ec4-d13b1be10bf5 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:25.934322 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c665dde0-9eb8-4960-9ec4-d13b1be10bf5 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 474a799f-8e38-49d6-8fff-9ec3e7657ef5] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:25.938353 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-b9389adf-a2b9-4055-a173-cf8100a4af8d tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Getting quotas for project 0e42e9f6c747493685a49d70d7061a37. Resources: {'server_groups'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:38:25.943529 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c665dde0-9eb8-4960-9ec4-d13b1be10bf5 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:25.945854 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c665dde0-9eb8-4960-9ec4-d13b1be10bf5 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:25.950615 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c665dde0-9eb8-4960-9ec4-d13b1be10bf5 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:25.951635 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c665dde0-9eb8-4960-9ec4-d13b1be10bf5 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:25.952271 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c665dde0-9eb8-4960-9ec4-d13b1be10bf5 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:25.954155 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-b9389adf-a2b9-4055-a173-cf8100a4af8d tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Getting quotas for user bc7d2e249cfc4feb92c8486a892b8b6d and project 0e42e9f6c747493685a49d70d7061a37. Resources: {'server_groups'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:38:25.954531 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c665dde0-9eb8-4960-9ec4-d13b1be10bf5 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:25.991720 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b9389adf-a2b9-4055-a173-cf8100a4af8d tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] 10.222.0.20 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.250699 Oct 04 18:38:25.993078 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1346/2620] 10.222.0.20 () {60 vars in 1173 bytes} [Tue Oct 4 18:38:25 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:25.999207 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-092ab90c-496d-423b-bf16-2d0ff4219384 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:25.999811 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-092ab90c-496d-423b-bf16-2d0ff4219384 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 98dfffc8-51aa-407a-a374-8e120ec43a31] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:26.006361 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-092ab90c-496d-423b-bf16-2d0ff4219384 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:26.007671 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-092ab90c-496d-423b-bf16-2d0ff4219384 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:26.007917 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-092ab90c-496d-423b-bf16-2d0ff4219384 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:26.008725 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-092ab90c-496d-423b-bf16-2d0ff4219384 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:26.009114 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-092ab90c-496d-423b-bf16-2d0ff4219384 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:26.009543 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-092ab90c-496d-423b-bf16-2d0ff4219384 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:26.216318 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-092ab90c-496d-423b-bf16-2d0ff4219384 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:26.221608 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c665dde0-9eb8-4960-9ec4-d13b1be10bf5 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:26.225072 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-092ab90c-496d-423b-bf16-2d0ff4219384 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31" status: 200 len: 1388 microversion: 2.1 time: 0.230970 Oct 04 18:38:26.226667 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1347/2621] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:25 2022] GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31 => generated 1388 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:26.230676 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8cee7bf4-14d7-42e9-9146-595ad7e41fff tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:26.240597 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c665dde0-9eb8-4960-9ec4-d13b1be10bf5 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5" status: 200 len: 1470 microversion: 2.1 time: 0.311838 Oct 04 18:38:26.241979 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1275/2622] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:25 2022] GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5 => generated 1470 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:38:26.248981 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-89020f97-d931-4e13-8988-0f04d5c51d89 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:26.255032 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-89020f97-d931-4e13-8988-0f04d5c51d89 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] [instance: 0bef06d7-ba85-4f48-bd08-228211391394] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:26.263420 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-89020f97-d931-4e13-8988-0f04d5c51d89 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:26.263912 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-89020f97-d931-4e13-8988-0f04d5c51d89 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:26.264374 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-89020f97-d931-4e13-8988-0f04d5c51d89 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:26.265085 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-89020f97-d931-4e13-8988-0f04d5c51d89 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:26.265651 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-89020f97-d931-4e13-8988-0f04d5c51d89 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:26.266083 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-89020f97-d931-4e13-8988-0f04d5c51d89 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:26.334970 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8cee7bf4-14d7-42e9-9146-595ad7e41fff tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/b086edde-08de-4b15-a685-cfede2c3fc2d" status: 204 len: 0 microversion: 2.1 time: 0.107932 Oct 04 18:38:26.340717 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1348/2623] 10.222.0.20 () {58 vars in 1266 bytes} [Tue Oct 4 18:38:26 2022] DELETE /compute/v2.1/os-server-groups/b086edde-08de-4b15-a685-cfede2c3fc2d => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:38:26.347623 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-18694ce9-a1ec-4be0-8a6d-2c21e490df7c tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:26.348420 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-18694ce9-a1ec-4be0-8a6d-2c21e490df7c tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 474a799f-8e38-49d6-8fff-9ec3e7657ef5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:26.365254 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-18694ce9-a1ec-4be0-8a6d-2c21e490df7c tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:26.366423 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-18694ce9-a1ec-4be0-8a6d-2c21e490df7c tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:26.367228 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-18694ce9-a1ec-4be0-8a6d-2c21e490df7c tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:26.369653 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-18694ce9-a1ec-4be0-8a6d-2c21e490df7c tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:26.370515 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-18694ce9-a1ec-4be0-8a6d-2c21e490df7c tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:26.372173 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-18694ce9-a1ec-4be0-8a6d-2c21e490df7c tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:26.378273 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-89020f97-d931-4e13-8988-0f04d5c51d89 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:26.388549 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-89020f97-d931-4e13-8988-0f04d5c51d89 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:26.390276 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-89020f97-d931-4e13-8988-0f04d5c51d89 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:26.392079 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-89020f97-d931-4e13-8988-0f04d5c51d89 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] 10.222.0.20 "GET /compute/v2.1/servers/0bef06d7-ba85-4f48-bd08-228211391394" status: 200 len: 1363 microversion: 2.57 time: 0.148519 Oct 04 18:38:26.403381 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1276/2624] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:26 2022] GET /compute/v2.1/servers/0bef06d7-ba85-4f48-bd08-228211391394 => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:26.403381 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1e0e0d31-2eb4-4dfc-a3b6-c98b11452ceb tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:26.403381 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1e0e0d31-2eb4-4dfc-a3b6-c98b11452ceb tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] [instance: b319d463-fa0d-4e2d-b03f-6227475572da] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:26.433640 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1e0e0d31-2eb4-4dfc-a3b6-c98b11452ceb tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:26.437216 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1e0e0d31-2eb4-4dfc-a3b6-c98b11452ceb tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:26.437671 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1e0e0d31-2eb4-4dfc-a3b6-c98b11452ceb tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:26.439913 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1e0e0d31-2eb4-4dfc-a3b6-c98b11452ceb tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:26.443681 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1e0e0d31-2eb4-4dfc-a3b6-c98b11452ceb tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:26.444577 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1e0e0d31-2eb4-4dfc-a3b6-c98b11452ceb tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:26.498565 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-18694ce9-a1ec-4be0-8a6d-2c21e490df7c tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:26.499716 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-18694ce9-a1ec-4be0-8a6d-2c21e490df7c tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:26.506134 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-18694ce9-a1ec-4be0-8a6d-2c21e490df7c tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:26.506134 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-18694ce9-a1ec-4be0-8a6d-2c21e490df7c tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:26.506134 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-18694ce9-a1ec-4be0-8a6d-2c21e490df7c tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:26.506134 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-18694ce9-a1ec-4be0-8a6d-2c21e490df7c tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:26.593088 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-18694ce9-a1ec-4be0-8a6d-2c21e490df7c tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Getting quotas for project 552ab59dabe840cb8582c54bedc49b09. Resources: {'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:38:26.604946 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-18694ce9-a1ec-4be0-8a6d-2c21e490df7c tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Getting quotas for user 9b05d1f8b9014e798926f9c496885a4d and project 552ab59dabe840cb8582c54bedc49b09. Resources: {'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:38:26.670806 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1e0e0d31-2eb4-4dfc-a3b6-c98b11452ceb tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73127bc6636476482e280eddad7f66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9174b09e32064811a61539c64992ee50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:26.681949 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1e0e0d31-2eb4-4dfc-a3b6-c98b11452ceb tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] 10.222.0.20 "GET /compute/v2.1/servers/b319d463-fa0d-4e2d-b03f-6227475572da" status: 200 len: 1369 microversion: 2.1 time: 0.287801 Oct 04 18:38:26.684789 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1277/2625] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:26 2022] GET /compute/v2.1/servers/b319d463-fa0d-4e2d-b03f-6227475572da => generated 1369 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:26.706368 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1e1d8edc-4c33-41bf-97bd-d85a19ed1b8d tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:26.716266 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1e1d8edc-4c33-41bf-97bd-d85a19ed1b8d tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.030446 Oct 04 18:38:26.720536 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1278/2626] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Oct 4 18:38:26 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:26.750292 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3312503c-6f6d-4793-92ca-bc5846d79ded tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:26.751602 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3312503c-6f6d-4793-92ca-bc5846d79ded tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 5965d934-6f27-43ac-bf15-8fd20da48cc1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:26.768326 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3312503c-6f6d-4793-92ca-bc5846d79ded tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:26.768326 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3312503c-6f6d-4793-92ca-bc5846d79ded tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:26.768326 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3312503c-6f6d-4793-92ca-bc5846d79ded tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:26.768326 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3312503c-6f6d-4793-92ca-bc5846d79ded tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:26.769932 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3312503c-6f6d-4793-92ca-bc5846d79ded tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:26.770760 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3312503c-6f6d-4793-92ca-bc5846d79ded tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:26.854128 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3312503c-6f6d-4793-92ca-bc5846d79ded tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8284fe51decd4db0bf6b3ed1514cc2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87473abf47e74adf844e3ddfa24da3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:26.863594 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3312503c-6f6d-4793-92ca-bc5846d79ded tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] 10.222.0.20 "GET /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1" status: 200 len: 1266 microversion: 2.1 time: 0.138377 Oct 04 18:38:26.876945 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1279/2627] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:26 2022] GET /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:26.888120 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a9cc0475-039c-4b1c-a4c6-575c15550eb0 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-848508450", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": [{"uuid": "f375e73c-1269-45b0-b190-61ac14b68498"}]}, "os:scheduler_hints": {"group": "566c9cd3-5a33-4703-b552-fa6d89d554f7"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:26.957622 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.neutron [None req-a9cc0475-039c-4b1c-a4c6-575c15550eb0 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] validate_networks() for [('f375e73c-1269-45b0-b190-61ac14b68498', None, None, None, None, None)] {{(pid=123001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:38:27.036262 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-18694ce9-a1ec-4be0-8a6d-2c21e490df7c tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "POST /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5/action" status: 202 len: 0 microversion: 2.1 time: 0.693753 Oct 04 18:38:27.040327 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1349/2628] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:38:26 2022] POST /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5/action => generated 0 bytes in 695 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:38:27.052895 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4b0c7bef-357c-40e9-b7a6-69f9ac1db21e tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:27.053776 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4b0c7bef-357c-40e9-b7a6-69f9ac1db21e tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 474a799f-8e38-49d6-8fff-9ec3e7657ef5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:27.061931 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4b0c7bef-357c-40e9-b7a6-69f9ac1db21e tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:27.062681 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4b0c7bef-357c-40e9-b7a6-69f9ac1db21e tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:27.063490 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4b0c7bef-357c-40e9-b7a6-69f9ac1db21e tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:27.064411 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4b0c7bef-357c-40e9-b7a6-69f9ac1db21e tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:27.064977 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4b0c7bef-357c-40e9-b7a6-69f9ac1db21e tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:27.065512 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4b0c7bef-357c-40e9-b7a6-69f9ac1db21e tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:27.566081 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4b0c7bef-357c-40e9-b7a6-69f9ac1db21e tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:27.581534 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4b0c7bef-357c-40e9-b7a6-69f9ac1db21e tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5" status: 200 len: 1469 microversion: 2.1 time: 0.533792 Oct 04 18:38:27.598300 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1350/2629] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:27 2022] GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5 => generated 1469 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:38:27.607398 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-570ec58d-6ca8-447d-946d-6f5f78f4f3ff tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:27.609138 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-570ec58d-6ca8-447d-946d-6f5f78f4f3ff tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 98dfffc8-51aa-407a-a374-8e120ec43a31] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:27.616328 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-570ec58d-6ca8-447d-946d-6f5f78f4f3ff tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:27.617203 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-570ec58d-6ca8-447d-946d-6f5f78f4f3ff tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:27.618015 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-570ec58d-6ca8-447d-946d-6f5f78f4f3ff tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:27.619694 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-570ec58d-6ca8-447d-946d-6f5f78f4f3ff tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:27.620422 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-570ec58d-6ca8-447d-946d-6f5f78f4f3ff tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:27.621672 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-570ec58d-6ca8-447d-946d-6f5f78f4f3ff tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:28.000159 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-a9cc0475-039c-4b1c-a4c6-575c15550eb0 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:38:28.002531 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-a9cc0475-039c-4b1c-a4c6-575c15550eb0 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:38:28.003039 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-a9cc0475-039c-4b1c-a4c6-575c15550eb0 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:38:28.003466 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-a9cc0475-039c-4b1c-a4c6-575c15550eb0 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:38:28.003895 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-a9cc0475-039c-4b1c-a4c6-575c15550eb0 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:38:28.045664 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-570ec58d-6ca8-447d-946d-6f5f78f4f3ff tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:28.048427 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a9cc0475-039c-4b1c-a4c6-575c15550eb0 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:28.049151 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a9cc0475-039c-4b1c-a4c6-575c15550eb0 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:28.049601 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a9cc0475-039c-4b1c-a4c6-575c15550eb0 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:28.050384 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a9cc0475-039c-4b1c-a4c6-575c15550eb0 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:28.053350 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a9cc0475-039c-4b1c-a4c6-575c15550eb0 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:28.053976 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a9cc0475-039c-4b1c-a4c6-575c15550eb0 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:28.056425 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-570ec58d-6ca8-447d-946d-6f5f78f4f3ff tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31" status: 200 len: 1388 microversion: 2.1 time: 0.456452 Oct 04 18:38:28.057782 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1351/2630] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:27 2022] GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31 => generated 1388 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:28.066298 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e26d171f-c0e4-435e-aa3e-e31853a01a22 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:28.067391 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e26d171f-c0e4-435e-aa3e-e31853a01a22 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] [instance: 0bef06d7-ba85-4f48-bd08-228211391394] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:28.082286 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e26d171f-c0e4-435e-aa3e-e31853a01a22 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:28.084795 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e26d171f-c0e4-435e-aa3e-e31853a01a22 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:28.086549 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e26d171f-c0e4-435e-aa3e-e31853a01a22 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:28.087465 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e26d171f-c0e4-435e-aa3e-e31853a01a22 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:28.088154 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e26d171f-c0e4-435e-aa3e-e31853a01a22 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:28.090421 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e26d171f-c0e4-435e-aa3e-e31853a01a22 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:28.099300 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-a9cc0475-039c-4b1c-a4c6-575c15550eb0 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Getting quotas for project 0e42e9f6c747493685a49d70d7061a37. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:38:28.111831 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-a9cc0475-039c-4b1c-a4c6-575c15550eb0 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Getting quotas for user bc7d2e249cfc4feb92c8486a892b8b6d and project 0e42e9f6c747493685a49d70d7061a37. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:38:28.141544 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a9cc0475-039c-4b1c-a4c6-575c15550eb0 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Going to run 1 instances... {{(pid=123001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:38:28.150248 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a9cc0475-039c-4b1c-a4c6-575c15550eb0 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] [instance: b2fbbb75-1f0b-4095-8a22-df673b44686d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:38:28.195390 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e26d171f-c0e4-435e-aa3e-e31853a01a22 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:28.195881 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e26d171f-c0e4-435e-aa3e-e31853a01a22 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:28.196369 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e26d171f-c0e4-435e-aa3e-e31853a01a22 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:28.196828 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-e26d171f-c0e4-435e-aa3e-e31853a01a22 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lazy-loading 'fault' on Instance uuid 0bef06d7-ba85-4f48-bd08-228211391394 {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:38:28.284510 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e26d171f-c0e4-435e-aa3e-e31853a01a22 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:28.294605 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e26d171f-c0e4-435e-aa3e-e31853a01a22 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:28.296486 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e26d171f-c0e4-435e-aa3e-e31853a01a22 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea07cc36ba87434cbcfa91b218543597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b06f718d51425c8f97973d3a71f69d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:28.297917 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e26d171f-c0e4-435e-aa3e-e31853a01a22 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] 10.222.0.20 "GET /compute/v2.1/servers/0bef06d7-ba85-4f48-bd08-228211391394" status: 200 len: 1368 microversion: 2.57 time: 0.237716 Oct 04 18:38:28.298686 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1352/2631] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:28 2022] GET /compute/v2.1/servers/0bef06d7-ba85-4f48-bd08-228211391394 => generated 1368 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:28.317693 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6f09e926-c81d-4764-8926-0eb91192cd1c tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:28.318558 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-6f09e926-c81d-4764-8926-0eb91192cd1c tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] [instance: b319d463-fa0d-4e2d-b03f-6227475572da] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:28.331774 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6f09e926-c81d-4764-8926-0eb91192cd1c tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:28.332648 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6f09e926-c81d-4764-8926-0eb91192cd1c tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:28.333266 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6f09e926-c81d-4764-8926-0eb91192cd1c tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:28.334140 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6f09e926-c81d-4764-8926-0eb91192cd1c tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:28.334753 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6f09e926-c81d-4764-8926-0eb91192cd1c tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:28.336227 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6f09e926-c81d-4764-8926-0eb91192cd1c tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:28.337959 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-a9cc0475-039c-4b1c-a4c6-575c15550eb0 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Getting quotas for project 0e42e9f6c747493685a49d70d7061a37. Resources: {'server_group_members'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:38:28.349132 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-a9cc0475-039c-4b1c-a4c6-575c15550eb0 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Getting quotas for user bc7d2e249cfc4feb92c8486a892b8b6d and project 0e42e9f6c747493685a49d70d7061a37. Resources: {'server_group_members'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:38:28.468935 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-a9cc0475-039c-4b1c-a4c6-575c15550eb0 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Getting quotas for project 0e42e9f6c747493685a49d70d7061a37. Resources: {'server_group_members'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:38:28.475112 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-a9cc0475-039c-4b1c-a4c6-575c15550eb0 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Getting quotas for user bc7d2e249cfc4feb92c8486a892b8b6d and project 0e42e9f6c747493685a49d70d7061a37. Resources: {'server_group_members'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:38:28.509662 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a9cc0475-039c-4b1c-a4c6-575c15550eb0 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.631624 Oct 04 18:38:28.516844 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1280/2632] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:38:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1640 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:38:28.522002 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-55a56b8c-308f-47bf-967f-58a2227406e1 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:28.523943 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-55a56b8c-308f-47bf-967f-58a2227406e1 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 5965d934-6f27-43ac-bf15-8fd20da48cc1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:28.532622 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-55a56b8c-308f-47bf-967f-58a2227406e1 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:28.533119 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-55a56b8c-308f-47bf-967f-58a2227406e1 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:28.533553 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-55a56b8c-308f-47bf-967f-58a2227406e1 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:28.534329 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-55a56b8c-308f-47bf-967f-58a2227406e1 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:28.534832 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-55a56b8c-308f-47bf-967f-58a2227406e1 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:28.535597 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-55a56b8c-308f-47bf-967f-58a2227406e1 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:28.688819 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-6f09e926-c81d-4764-8926-0eb91192cd1c tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73127bc6636476482e280eddad7f66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9174b09e32064811a61539c64992ee50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:28.721370 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6f09e926-c81d-4764-8926-0eb91192cd1c tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] 10.222.0.20 "GET /compute/v2.1/servers/b319d463-fa0d-4e2d-b03f-6227475572da" status: 200 len: 1556 microversion: 2.1 time: 0.402998 Oct 04 18:38:28.726847 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1353/2633] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:28 2022] GET /compute/v2.1/servers/b319d463-fa0d-4e2d-b03f-6227475572da => generated 1556 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:28.727079 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-3bf1d31d-8855-4ce1-8f18-50a92eb7c956 req-2a3d1c32-13d0-429a-9d19-4dde5ca81192 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "474a799f-8e38-49d6-8fff-9ec3e7657ef5", "name": "network-vif-plugged", "status": "completed", "tag": "a0d7cb42-218d-4bf1-adab-5dbf22e8ab22"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:28.748802 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-3bf1d31d-8855-4ce1-8f18-50a92eb7c956 req-2a3d1c32-13d0-429a-9d19-4dde5ca81192 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:28.749289 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-3bf1d31d-8855-4ce1-8f18-50a92eb7c956 req-2a3d1c32-13d0-429a-9d19-4dde5ca81192 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:28.749725 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-3bf1d31d-8855-4ce1-8f18-50a92eb7c956 req-2a3d1c32-13d0-429a-9d19-4dde5ca81192 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:28.764530 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-55a56b8c-308f-47bf-967f-58a2227406e1 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8284fe51decd4db0bf6b3ed1514cc2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87473abf47e74adf844e3ddfa24da3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:28.769366 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-55a56b8c-308f-47bf-967f-58a2227406e1 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] 10.222.0.20 "GET /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1" status: 200 len: 1272 microversion: 2.1 time: 0.251260 Oct 04 18:38:28.781041 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1281/2634] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:28 2022] GET /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1 => generated 1272 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:28.782801 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-3bf1d31d-8855-4ce1-8f18-50a92eb7c956 req-2a3d1c32-13d0-429a-9d19-4dde5ca81192 service nova] Creating event network-vif-plugged:a0d7cb42-218d-4bf1-adab-5dbf22e8ab22 for instance 474a799f-8e38-49d6-8fff-9ec3e7657ef5 on n-h1-850501-14 Oct 04 18:38:28.799776 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [req-3bf1d31d-8855-4ce1-8f18-50a92eb7c956 req-2a3d1c32-13d0-429a-9d19-4dde5ca81192 service nova] Instance 474a799f-8e38-49d6-8fff-9ec3e7657ef5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850501-14', 'n-h2-850501-14'} {{(pid=123002) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:38:28.801622 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-bd16c7e5-3532-428f-9697-8835a9a3ff30 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:28.802270 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-bd16c7e5-3532-428f-9697-8835a9a3ff30 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] [instance: b2fbbb75-1f0b-4095-8a22-df673b44686d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:28.816455 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-3bf1d31d-8855-4ce1-8f18-50a92eb7c956 req-2a3d1c32-13d0-429a-9d19-4dde5ca81192 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093121 Oct 04 18:38:28.817374 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1354/2635] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:38:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:28.825514 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-93f2ca5b-63d6-40b6-9e31-55512b7b7d8f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:28.826239 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-93f2ca5b-63d6-40b6-9e31-55512b7b7d8f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 474a799f-8e38-49d6-8fff-9ec3e7657ef5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:28.840107 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-93f2ca5b-63d6-40b6-9e31-55512b7b7d8f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:28.843250 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-93f2ca5b-63d6-40b6-9e31-55512b7b7d8f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:28.846065 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-93f2ca5b-63d6-40b6-9e31-55512b7b7d8f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:28.849303 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-93f2ca5b-63d6-40b6-9e31-55512b7b7d8f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:28.851764 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-93f2ca5b-63d6-40b6-9e31-55512b7b7d8f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:28.856591 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-93f2ca5b-63d6-40b6-9e31-55512b7b7d8f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:28.862790 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:38:28.970804 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-bd16c7e5-3532-428f-9697-8835a9a3ff30 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7d2e249cfc4feb92c8486a892b8b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e42e9f6c747493685a49d70d7061a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:28.978100 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-bd16c7e5-3532-428f-9697-8835a9a3ff30 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] 10.222.0.20 "GET /compute/v2.1/servers/b2fbbb75-1f0b-4095-8a22-df673b44686d" status: 200 len: 1212 microversion: 2.1 time: 0.188851 Oct 04 18:38:28.979681 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1282/2636] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:28 2022] GET /compute/v2.1/servers/b2fbbb75-1f0b-4095-8a22-df673b44686d => generated 1212 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:28.994106 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d44371ba-e462-4938-b261-5ab40e3a9798 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:28.998078 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d44371ba-e462-4938-b261-5ab40e3a9798 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] [instance: b319d463-fa0d-4e2d-b03f-6227475572da] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:29.019379 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d44371ba-e462-4938-b261-5ab40e3a9798 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:29.019981 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d44371ba-e462-4938-b261-5ab40e3a9798 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:29.023646 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d44371ba-e462-4938-b261-5ab40e3a9798 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:29.024474 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d44371ba-e462-4938-b261-5ab40e3a9798 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:29.024960 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d44371ba-e462-4938-b261-5ab40e3a9798 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:29.025387 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d44371ba-e462-4938-b261-5ab40e3a9798 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:29.059262 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:38:29.290383 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d44371ba-e462-4938-b261-5ab40e3a9798 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] 10.222.0.20 "GET /compute/v2.1/servers/b319d463-fa0d-4e2d-b03f-6227475572da/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.307932 Oct 04 18:38:29.291269 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1283/2637] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Oct 4 18:38:28 2022] GET /compute/v2.1/servers/b319d463-fa0d-4e2d-b03f-6227475572da/os-interface => generated 285 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:29.303354 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b668383a-3065-4d57-84b8-8ed4626400e4 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:29.304184 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b668383a-3065-4d57-84b8-8ed4626400e4 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 98dfffc8-51aa-407a-a374-8e120ec43a31] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:29.312176 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b668383a-3065-4d57-84b8-8ed4626400e4 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:29.312674 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b668383a-3065-4d57-84b8-8ed4626400e4 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:29.313368 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b668383a-3065-4d57-84b8-8ed4626400e4 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:29.319021 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b668383a-3065-4d57-84b8-8ed4626400e4 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:29.322808 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b668383a-3065-4d57-84b8-8ed4626400e4 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:29.323604 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b668383a-3065-4d57-84b8-8ed4626400e4 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:29.471733 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b668383a-3065-4d57-84b8-8ed4626400e4 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:29.478965 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b668383a-3065-4d57-84b8-8ed4626400e4 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31" status: 200 len: 1346 microversion: 2.1 time: 0.185697 Oct 04 18:38:29.486294 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-93f2ca5b-63d6-40b6-9e31-55512b7b7d8f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:29.496942 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1284/2638] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:29 2022] GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31 => generated 1346 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:29.501395 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-93f2ca5b-63d6-40b6-9e31-55512b7b7d8f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5" status: 200 len: 1469 microversion: 2.1 time: 0.677602 Oct 04 18:38:29.505618 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-4b2f48db-b479-4ff9-8daf-4be719db3149 req-0bededd3-a181-426a-9f0e-ad7577e33b47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98dfffc8-51aa-407a-a374-8e120ec43a31", "name": "network-vif-deleted", "tag": "0f1337d3-c904-4533-8791-cffcbc2b23d5"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:29.513110 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1355/2639] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:28 2022] GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5 => generated 1469 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:29.526297 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-aa4f2230-49d2-4390-aa82-c4a27090b0c7 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:29.532988 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-aa4f2230-49d2-4390-aa82-c4a27090b0c7 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] [instance: 0bef06d7-ba85-4f48-bd08-228211391394] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:29.546600 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aa4f2230-49d2-4390-aa82-c4a27090b0c7 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:29.548999 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-4b2f48db-b479-4ff9-8daf-4be719db3149 req-0bededd3-a181-426a-9f0e-ad7577e33b47 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:29.549653 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-4b2f48db-b479-4ff9-8daf-4be719db3149 req-0bededd3-a181-426a-9f0e-ad7577e33b47 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:29.551950 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aa4f2230-49d2-4390-aa82-c4a27090b0c7 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:29.551950 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aa4f2230-49d2-4390-aa82-c4a27090b0c7 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:29.551950 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aa4f2230-49d2-4390-aa82-c4a27090b0c7 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:29.551950 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aa4f2230-49d2-4390-aa82-c4a27090b0c7 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:29.552813 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-4b2f48db-b479-4ff9-8daf-4be719db3149 req-0bededd3-a181-426a-9f0e-ad7577e33b47 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:29.556962 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aa4f2230-49d2-4390-aa82-c4a27090b0c7 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:29.581944 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-4b2f48db-b479-4ff9-8daf-4be719db3149 req-0bededd3-a181-426a-9f0e-ad7577e33b47 service nova] Creating event network-vif-deleted:0f1337d3-c904-4533-8791-cffcbc2b23d5 for instance 98dfffc8-51aa-407a-a374-8e120ec43a31 on n-h1-850501-14 Oct 04 18:38:29.592091 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-4b2f48db-b479-4ff9-8daf-4be719db3149 req-0bededd3-a181-426a-9f0e-ad7577e33b47 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093806 Oct 04 18:38:29.594110 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-aa4f2230-49d2-4390-aa82-c4a27090b0c7 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] HTTP exception thrown: Instance 0bef06d7-ba85-4f48-bd08-228211391394 could not be found. Oct 04 18:38:29.596129 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1285/2640] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:38:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:29.597522 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-aa4f2230-49d2-4390-aa82-c4a27090b0c7 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Request method failure captured: Oct 04 18:38:29.597522 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/0bef06d7-ba85-4f48-bd08-228211391394 HTTP/1.1 Oct 04 18:38:29.597522 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:38:29.597522 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:38:29.597522 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:38:29.597522 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:38:29.597522 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:38:29.597522 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:38:29.597522 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:38:29.597522 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:38:29.597522 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH1qVMtXTKMKqDn763ioUq02HLGaKk2JHtONPZ5hDplA6cK4EUYcVtUKY2JCL5nhcwoqzt9V3WLpuIBMDr9cmqWC-CoNv7c6ZhQjsHiBJyfzSOnlfXi_6OoZNZGhjzCtza8_rQBcmpzJUtkMqWtawhPeh2585x0Xr449pFAqwLDYM0g Oct 04 18:38:29.597522 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:38:29.597522 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:38:29.597522 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:38:29.597522 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:38:29.597522 n-d-850501-14 devstack@n-api.service[123002]: X-Openstack-Nova-Api-Version: 2.57 Oct 04 18:38:29.597522 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:38:29.597522 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:38:29.597522 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 33b06f718d51425c8f97973d3a71f69d Oct 04 18:38:29.597522 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServerShowV257Test-1110724330 Oct 04 18:38:29.597522 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:38:29.597522 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:38:29.597522 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/33b06f718d51425c8f97973d3a71f69d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_33b06f718d51425c8f97973d3a71f69d", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/33b06f718d51425c8f97973d3a71f69d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/33b06f718d51425c8f97973d3a71f69d"}]}] Oct 04 18:38:29.597522 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServerShowV257Test-1110724330 Oct 04 18:38:29.597522 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 33b06f718d51425c8f97973d3a71f69d Oct 04 18:38:29.597522 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServerShowV257Test-1110724330 Oct 04 18:38:29.597522 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServerShowV257Test-1110724330-project Oct 04 18:38:29.597522 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:38:29.597522 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:38:29.597522 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: ea07cc36ba87434cbcfa91b218543597 Oct 04 18:38:29.597522 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServerShowV257Test-1110724330-project Oct 04 18:38:29.597522 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:38:29.597522 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 0bef06d7-ba85-4f48-bd08-228211391394 could not be found. Oct 04 18:38:29.597522 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '0bef06d7-ba85-4f48-bd08-228211391394'} Oct 04 18:38:29.597522 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:38:29.597522 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:38:29.597522 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:38:29.597522 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:38:29.597522 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:38:29.597522 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:38:29.597522 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:38:29.597522 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:38:29.597522 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:38:29.597522 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:38:29.597522 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bef06d7-ba85-4f48-bd08-228211391394 could not be found. Oct 04 18:38:29.597522 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:38:29.597522 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:38:29.597522 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:38:29.597522 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:38:29.597522 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:38:29.597522 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:38:29.597522 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:38:29.597522 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:38:29.597522 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:38:29.597522 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:38:29.597522 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:38:29.597522 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:38:29.597522 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:38:29.597522 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:38:29.597522 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:38:29.597522 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:38:29.597522 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bef06d7-ba85-4f48-bd08-228211391394 could not be found. Oct 04 18:38:29.597522 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:38:29.597522 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:38:29.597522 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:38:29.602691 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:38:29.602691 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:38:29.602691 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:38:29.602691 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:38:29.602691 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:38:29.602691 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bef06d7-ba85-4f48-bd08-228211391394 could not be found. Oct 04 18:38:29.602691 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:38:29.604259 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-aa4f2230-49d2-4390-aa82-c4a27090b0c7 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] Returning 404 to user: Instance 0bef06d7-ba85-4f48-bd08-228211391394 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:38:29.609349 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-aa4f2230-49d2-4390-aa82-c4a27090b0c7 tempest-ServerShowV257Test-1110724330 tempest-ServerShowV257Test-1110724330-project] 10.222.0.20 "GET /compute/v2.1/servers/0bef06d7-ba85-4f48-bd08-228211391394" status: 404 len: 111 microversion: 2.57 time: 0.090917 Oct 04 18:38:29.609349 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1356/2641] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:29 2022] GET /compute/v2.1/servers/0bef06d7-ba85-4f48-bd08-228211391394 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:38:29.808853 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-61d25a99-57fd-41d4-97d9-2a9067bc0d65 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:29.809866 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-61d25a99-57fd-41d4-97d9-2a9067bc0d65 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 5965d934-6f27-43ac-bf15-8fd20da48cc1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:29.830739 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-61d25a99-57fd-41d4-97d9-2a9067bc0d65 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:29.831400 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-61d25a99-57fd-41d4-97d9-2a9067bc0d65 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:29.832114 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-61d25a99-57fd-41d4-97d9-2a9067bc0d65 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:29.832983 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-61d25a99-57fd-41d4-97d9-2a9067bc0d65 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:29.833588 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-61d25a99-57fd-41d4-97d9-2a9067bc0d65 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:29.845267 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-61d25a99-57fd-41d4-97d9-2a9067bc0d65 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:30.003697 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-65685206-adba-4755-ad75-debe7bf0e62b tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:30.004797 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-65685206-adba-4755-ad75-debe7bf0e62b tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] [instance: b2fbbb75-1f0b-4095-8a22-df673b44686d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:30.118183 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-65685206-adba-4755-ad75-debe7bf0e62b tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7d2e249cfc4feb92c8486a892b8b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e42e9f6c747493685a49d70d7061a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:30.131926 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-65685206-adba-4755-ad75-debe7bf0e62b tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] 10.222.0.20 "GET /compute/v2.1/servers/b2fbbb75-1f0b-4095-8a22-df673b44686d" status: 200 len: 1212 microversion: 2.1 time: 0.132529 Oct 04 18:38:30.163402 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1357/2642] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:29 2022] GET /compute/v2.1/servers/b2fbbb75-1f0b-4095-8a22-df673b44686d => generated 1212 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:38:30.299804 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-61d25a99-57fd-41d4-97d9-2a9067bc0d65 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8284fe51decd4db0bf6b3ed1514cc2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87473abf47e74adf844e3ddfa24da3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:30.307831 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-61d25a99-57fd-41d4-97d9-2a9067bc0d65 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] 10.222.0.20 "GET /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1" status: 200 len: 1314 microversion: 2.1 time: 0.504443 Oct 04 18:38:30.308562 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1286/2643] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:29 2022] GET /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1 => generated 1314 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:30.535225 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a3360304-2de3-43ab-95cf-3c1fa9979b5f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:30.540385 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-84d9f728-260e-44d1-9b9b-e20ac9d945b8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:30.544940 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-84d9f728-260e-44d1-9b9b-e20ac9d945b8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 98dfffc8-51aa-407a-a374-8e120ec43a31] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:30.548402 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a3360304-2de3-43ab-95cf-3c1fa9979b5f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 474a799f-8e38-49d6-8fff-9ec3e7657ef5] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:30.570325 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a3360304-2de3-43ab-95cf-3c1fa9979b5f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:30.570927 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a3360304-2de3-43ab-95cf-3c1fa9979b5f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:30.572000 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-84d9f728-260e-44d1-9b9b-e20ac9d945b8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:30.572650 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a3360304-2de3-43ab-95cf-3c1fa9979b5f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:30.577324 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-84d9f728-260e-44d1-9b9b-e20ac9d945b8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:30.578368 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a3360304-2de3-43ab-95cf-3c1fa9979b5f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:30.579129 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a3360304-2de3-43ab-95cf-3c1fa9979b5f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:30.580354 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-84d9f728-260e-44d1-9b9b-e20ac9d945b8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:30.581297 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-84d9f728-260e-44d1-9b9b-e20ac9d945b8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:30.581938 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a3360304-2de3-43ab-95cf-3c1fa9979b5f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:30.585189 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-84d9f728-260e-44d1-9b9b-e20ac9d945b8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:30.591079 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-84d9f728-260e-44d1-9b9b-e20ac9d945b8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:31.466148 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-84d9f728-260e-44d1-9b9b-e20ac9d945b8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:31.499059 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-84d9f728-260e-44d1-9b9b-e20ac9d945b8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31" status: 200 len: 1184 microversion: 2.1 time: 0.976114 Oct 04 18:38:31.516813 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1358/2644] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:30 2022] GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31 => generated 1184 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:31.521892 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6f0482e7-5ea0-41e6-9b06-3c4e7a1d7e29 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:31.522786 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-6f0482e7-5ea0-41e6-9b06-3c4e7a1d7e29 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] [instance: b2fbbb75-1f0b-4095-8a22-df673b44686d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:31.530524 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6f0482e7-5ea0-41e6-9b06-3c4e7a1d7e29 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:31.531412 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6f0482e7-5ea0-41e6-9b06-3c4e7a1d7e29 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:31.531961 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6f0482e7-5ea0-41e6-9b06-3c4e7a1d7e29 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:31.532834 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6f0482e7-5ea0-41e6-9b06-3c4e7a1d7e29 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:31.533401 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6f0482e7-5ea0-41e6-9b06-3c4e7a1d7e29 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:31.533937 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6f0482e7-5ea0-41e6-9b06-3c4e7a1d7e29 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:31.803498 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-6f0482e7-5ea0-41e6-9b06-3c4e7a1d7e29 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7d2e249cfc4feb92c8486a892b8b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e42e9f6c747493685a49d70d7061a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:31.811777 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6f0482e7-5ea0-41e6-9b06-3c4e7a1d7e29 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] 10.222.0.20 "GET /compute/v2.1/servers/b2fbbb75-1f0b-4095-8a22-df673b44686d" status: 200 len: 1264 microversion: 2.1 time: 0.293511 Oct 04 18:38:31.821309 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1359/2645] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:31 2022] GET /compute/v2.1/servers/b2fbbb75-1f0b-4095-8a22-df673b44686d => generated 1264 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:31.827209 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0ecf7cc3-4272-49f4-830f-efed6b8076fd tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:31.832389 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0ecf7cc3-4272-49f4-830f-efed6b8076fd tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 5965d934-6f27-43ac-bf15-8fd20da48cc1] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:31.844827 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0ecf7cc3-4272-49f4-830f-efed6b8076fd tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:31.845704 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0ecf7cc3-4272-49f4-830f-efed6b8076fd tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:31.851170 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0ecf7cc3-4272-49f4-830f-efed6b8076fd tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:31.852229 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0ecf7cc3-4272-49f4-830f-efed6b8076fd tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:31.852958 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0ecf7cc3-4272-49f4-830f-efed6b8076fd tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:31.853618 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0ecf7cc3-4272-49f4-830f-efed6b8076fd tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:31.920401 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a3360304-2de3-43ab-95cf-3c1fa9979b5f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:31.929465 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a3360304-2de3-43ab-95cf-3c1fa9979b5f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5" status: 200 len: 1469 microversion: 2.1 time: 1.398569 Oct 04 18:38:31.945630 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1287/2646] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:30 2022] GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5 => generated 1469 bytes in 1415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:38:32.429338 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0ecf7cc3-4272-49f4-830f-efed6b8076fd tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8284fe51decd4db0bf6b3ed1514cc2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87473abf47e74adf844e3ddfa24da3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:32.447448 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0ecf7cc3-4272-49f4-830f-efed6b8076fd tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] 10.222.0.20 "GET /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1" status: 200 len: 1314 microversion: 2.1 time: 0.617896 Oct 04 18:38:32.448144 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1360/2647] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:31 2022] GET /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1 => generated 1314 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:32.524571 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-253ee639-bd23-4826-9bac-4304c853aeac tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:32.526282 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-253ee639-bd23-4826-9bac-4304c853aeac tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 98dfffc8-51aa-407a-a374-8e120ec43a31] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:32.542959 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-253ee639-bd23-4826-9bac-4304c853aeac tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:32.544674 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-253ee639-bd23-4826-9bac-4304c853aeac tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:32.545187 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-253ee639-bd23-4826-9bac-4304c853aeac tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:32.546649 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-253ee639-bd23-4826-9bac-4304c853aeac tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:32.571777 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-253ee639-bd23-4826-9bac-4304c853aeac tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:32.573100 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-253ee639-bd23-4826-9bac-4304c853aeac tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:32.852511 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6da106b1-eb36-4d83-b192-9a2d275ab904 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:32.854848 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-6da106b1-eb36-4d83-b192-9a2d275ab904 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] [instance: b2fbbb75-1f0b-4095-8a22-df673b44686d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:32.893511 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6da106b1-eb36-4d83-b192-9a2d275ab904 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:32.895547 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6da106b1-eb36-4d83-b192-9a2d275ab904 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:32.898135 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6da106b1-eb36-4d83-b192-9a2d275ab904 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:32.903172 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6da106b1-eb36-4d83-b192-9a2d275ab904 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:32.904892 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6da106b1-eb36-4d83-b192-9a2d275ab904 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:32.906128 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6da106b1-eb36-4d83-b192-9a2d275ab904 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:33.016975 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-253ee639-bd23-4826-9bac-4304c853aeac tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:33.069376 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-253ee639-bd23-4826-9bac-4304c853aeac tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31" status: 200 len: 1184 microversion: 2.1 time: 0.545686 Oct 04 18:38:33.071732 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1288/2648] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:32 2022] GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31 => generated 1184 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:33.088669 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-32cf6d47-87a4-4e59-b005-70b2fadc154d req-a73ca29c-6745-4c82-b878-cfce735be7d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b319d463-fa0d-4e2d-b03f-6227475572da", "tag": "617a3d5c-1b67-469f-ad73-1ceedb040447"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:33.117686 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-6da106b1-eb36-4d83-b192-9a2d275ab904 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7d2e249cfc4feb92c8486a892b8b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e42e9f6c747493685a49d70d7061a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:33.132238 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:38:33.132238 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-32cf6d47-87a4-4e59-b005-70b2fadc154d req-a73ca29c-6745-4c82-b878-cfce735be7d7 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:33.132238 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-32cf6d47-87a4-4e59-b005-70b2fadc154d req-a73ca29c-6745-4c82-b878-cfce735be7d7 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:33.132784 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6da106b1-eb36-4d83-b192-9a2d275ab904 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] 10.222.0.20 "GET /compute/v2.1/servers/b2fbbb75-1f0b-4095-8a22-df673b44686d" status: 200 len: 1282 microversion: 2.1 time: 0.289006 Oct 04 18:38:33.132965 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-32cf6d47-87a4-4e59-b005-70b2fadc154d req-a73ca29c-6745-4c82-b878-cfce735be7d7 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:33.153290 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1361/2649] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:32 2022] GET /compute/v2.1/servers/b2fbbb75-1f0b-4095-8a22-df673b44686d => generated 1282 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:38:33.174750 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-fb68dacb-8f0c-411f-884a-4ba14696dc19 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:33.180612 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-fb68dacb-8f0c-411f-884a-4ba14696dc19 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 474a799f-8e38-49d6-8fff-9ec3e7657ef5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:33.190928 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-32cf6d47-87a4-4e59-b005-70b2fadc154d req-a73ca29c-6745-4c82-b878-cfce735be7d7 service nova] Creating event network-changed:617a3d5c-1b67-469f-ad73-1ceedb040447 for instance b319d463-fa0d-4e2d-b03f-6227475572da on n-h1-850501-14 Oct 04 18:38:33.203712 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-32cf6d47-87a4-4e59-b005-70b2fadc154d req-a73ca29c-6745-4c82-b878-cfce735be7d7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129522 Oct 04 18:38:33.205125 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1289/2650] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:38:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:33.210721 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fb68dacb-8f0c-411f-884a-4ba14696dc19 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:33.211361 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fb68dacb-8f0c-411f-884a-4ba14696dc19 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:33.211821 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fb68dacb-8f0c-411f-884a-4ba14696dc19 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:33.212594 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fb68dacb-8f0c-411f-884a-4ba14696dc19 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:33.213225 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fb68dacb-8f0c-411f-884a-4ba14696dc19 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:33.213947 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fb68dacb-8f0c-411f-884a-4ba14696dc19 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:33.477176 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a63ff60b-60dd-48f8-8692-fc8a14d28725 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:33.477890 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a63ff60b-60dd-48f8-8692-fc8a14d28725 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 5965d934-6f27-43ac-bf15-8fd20da48cc1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:33.505213 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a63ff60b-60dd-48f8-8692-fc8a14d28725 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:33.505731 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a63ff60b-60dd-48f8-8692-fc8a14d28725 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:33.506180 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a63ff60b-60dd-48f8-8692-fc8a14d28725 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:33.511465 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a63ff60b-60dd-48f8-8692-fc8a14d28725 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:33.527906 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a63ff60b-60dd-48f8-8692-fc8a14d28725 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:33.528624 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a63ff60b-60dd-48f8-8692-fc8a14d28725 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:33.976478 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-fb68dacb-8f0c-411f-884a-4ba14696dc19 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:33.989220 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-fb68dacb-8f0c-411f-884a-4ba14696dc19 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5" status: 200 len: 1535 microversion: 2.1 time: 0.834568 Oct 04 18:38:33.989900 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1362/2651] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:33 2022] GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5 => generated 1535 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:34.107670 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d83f3139-5397-4e88-91fd-68aa77c3ddf7 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:34.110479 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d83f3139-5397-4e88-91fd-68aa77c3ddf7 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 98dfffc8-51aa-407a-a374-8e120ec43a31] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:34.127998 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d83f3139-5397-4e88-91fd-68aa77c3ddf7 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:34.128532 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d83f3139-5397-4e88-91fd-68aa77c3ddf7 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:34.134597 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d83f3139-5397-4e88-91fd-68aa77c3ddf7 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:34.137308 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d83f3139-5397-4e88-91fd-68aa77c3ddf7 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:34.137831 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d83f3139-5397-4e88-91fd-68aa77c3ddf7 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:34.138279 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d83f3139-5397-4e88-91fd-68aa77c3ddf7 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:34.367361 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d83f3139-5397-4e88-91fd-68aa77c3ddf7 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:34.380558 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d83f3139-5397-4e88-91fd-68aa77c3ddf7 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31" status: 200 len: 1184 microversion: 2.1 time: 0.286259 Oct 04 18:38:34.381158 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1363/2652] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:34 2022] GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31 => generated 1184 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:34.409769 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-bb352e65-086c-494a-80c9-8b54a02fcf71 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:34.411041 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-bb352e65-086c-494a-80c9-8b54a02fcf71 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] [instance: b2fbbb75-1f0b-4095-8a22-df673b44686d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:34.423240 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bb352e65-086c-494a-80c9-8b54a02fcf71 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:34.424289 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bb352e65-086c-494a-80c9-8b54a02fcf71 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:34.425284 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bb352e65-086c-494a-80c9-8b54a02fcf71 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:34.426636 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bb352e65-086c-494a-80c9-8b54a02fcf71 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:34.427760 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bb352e65-086c-494a-80c9-8b54a02fcf71 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:34.430628 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bb352e65-086c-494a-80c9-8b54a02fcf71 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:34.739035 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-bb352e65-086c-494a-80c9-8b54a02fcf71 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7d2e249cfc4feb92c8486a892b8b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e42e9f6c747493685a49d70d7061a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:34.752632 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-bb352e65-086c-494a-80c9-8b54a02fcf71 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] 10.222.0.20 "GET /compute/v2.1/servers/b2fbbb75-1f0b-4095-8a22-df673b44686d" status: 200 len: 1270 microversion: 2.1 time: 0.353426 Oct 04 18:38:34.753454 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1364/2653] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:34 2022] GET /compute/v2.1/servers/b2fbbb75-1f0b-4095-8a22-df673b44686d => generated 1270 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:34.774854 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-7591cb57-bfc2-4fdd-a3fa-c9394d45c829 req-f14e8bbc-5e8b-4015-b020-173e4cee94c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "474a799f-8e38-49d6-8fff-9ec3e7657ef5", "name": "network-vif-unplugged", "status": "completed", "tag": "a0d7cb42-218d-4bf1-adab-5dbf22e8ab22"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:34.805687 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-7591cb57-bfc2-4fdd-a3fa-c9394d45c829 req-f14e8bbc-5e8b-4015-b020-173e4cee94c1 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:34.806182 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-7591cb57-bfc2-4fdd-a3fa-c9394d45c829 req-f14e8bbc-5e8b-4015-b020-173e4cee94c1 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:34.810024 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-7591cb57-bfc2-4fdd-a3fa-c9394d45c829 req-f14e8bbc-5e8b-4015-b020-173e4cee94c1 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:34.875365 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-7591cb57-bfc2-4fdd-a3fa-c9394d45c829 req-f14e8bbc-5e8b-4015-b020-173e4cee94c1 service nova] Creating event network-vif-unplugged:a0d7cb42-218d-4bf1-adab-5dbf22e8ab22 for instance 474a799f-8e38-49d6-8fff-9ec3e7657ef5 on n-h2-850501-14 Oct 04 18:38:34.892694 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [req-7591cb57-bfc2-4fdd-a3fa-c9394d45c829 req-f14e8bbc-5e8b-4015-b020-173e4cee94c1 service nova] Instance 474a799f-8e38-49d6-8fff-9ec3e7657ef5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850501-14', 'n-h2-850501-14'} {{(pid=123002) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:38:34.925610 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a63ff60b-60dd-48f8-8692-fc8a14d28725 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8284fe51decd4db0bf6b3ed1514cc2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87473abf47e74adf844e3ddfa24da3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:34.966950 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-7591cb57-bfc2-4fdd-a3fa-c9394d45c829 req-f14e8bbc-5e8b-4015-b020-173e4cee94c1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.212193 Oct 04 18:38:34.969945 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1365/2654] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:38:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:35.000047 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a63ff60b-60dd-48f8-8692-fc8a14d28725 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] 10.222.0.20 "GET /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1" status: 200 len: 1314 microversion: 2.1 time: 1.517938 Oct 04 18:38:35.016303 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1290/2655] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:33 2022] GET /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1 => generated 1314 bytes in 1545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:35.022958 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-15992ea2-5a1d-4042-a895-1940b3c94a8b tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:35.024935 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-15992ea2-5a1d-4042-a895-1940b3c94a8b tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 474a799f-8e38-49d6-8fff-9ec3e7657ef5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:35.040814 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-15992ea2-5a1d-4042-a895-1940b3c94a8b tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:35.068327 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-15992ea2-5a1d-4042-a895-1940b3c94a8b tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:35.077182 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-15992ea2-5a1d-4042-a895-1940b3c94a8b tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:35.080175 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-15992ea2-5a1d-4042-a895-1940b3c94a8b tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:35.080683 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-15992ea2-5a1d-4042-a895-1940b3c94a8b tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:35.081131 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-15992ea2-5a1d-4042-a895-1940b3c94a8b tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:35.414609 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f19d1c31-7c67-4a40-b2e7-9a33c3b83a70 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:35.415450 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f19d1c31-7c67-4a40-b2e7-9a33c3b83a70 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 98dfffc8-51aa-407a-a374-8e120ec43a31] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:35.446913 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f19d1c31-7c67-4a40-b2e7-9a33c3b83a70 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:35.452521 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f19d1c31-7c67-4a40-b2e7-9a33c3b83a70 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:35.455461 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f19d1c31-7c67-4a40-b2e7-9a33c3b83a70 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:35.458530 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f19d1c31-7c67-4a40-b2e7-9a33c3b83a70 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:35.460338 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f19d1c31-7c67-4a40-b2e7-9a33c3b83a70 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:35.460983 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f19d1c31-7c67-4a40-b2e7-9a33c3b83a70 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:36.021916 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f19d1c31-7c67-4a40-b2e7-9a33c3b83a70 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:36.046396 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f19d1c31-7c67-4a40-b2e7-9a33c3b83a70 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31" status: 200 len: 1184 microversion: 2.1 time: 0.639415 Oct 04 18:38:36.048235 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1291/2656] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:35 2022] GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31 => generated 1184 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:36.059965 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-68f6a4fe-98a6-430e-871d-9c77bf3d6b4a tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:36.062057 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-68f6a4fe-98a6-430e-871d-9c77bf3d6b4a tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] [instance: b2fbbb75-1f0b-4095-8a22-df673b44686d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:36.076958 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-68f6a4fe-98a6-430e-871d-9c77bf3d6b4a tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:36.079413 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-68f6a4fe-98a6-430e-871d-9c77bf3d6b4a tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:36.080514 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-68f6a4fe-98a6-430e-871d-9c77bf3d6b4a tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:36.083350 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-68f6a4fe-98a6-430e-871d-9c77bf3d6b4a tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:36.084923 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-68f6a4fe-98a6-430e-871d-9c77bf3d6b4a tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:36.086776 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-68f6a4fe-98a6-430e-871d-9c77bf3d6b4a tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:36.504849 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-15992ea2-5a1d-4042-a895-1940b3c94a8b tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:36.520522 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-15992ea2-5a1d-4042-a895-1940b3c94a8b tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5" status: 200 len: 1535 microversion: 2.1 time: 1.502447 Oct 04 18:38:36.538632 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1366/2657] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:35 2022] GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5 => generated 1535 bytes in 1522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:36.559195 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c5f6af0f-5caf-4d0e-b5e0-e4b5a661b643 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:36.564224 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c5f6af0f-5caf-4d0e-b5e0-e4b5a661b643 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 5965d934-6f27-43ac-bf15-8fd20da48cc1] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:36.566842 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=3 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:38:36.577725 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c5f6af0f-5caf-4d0e-b5e0-e4b5a661b643 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:36.578894 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c5f6af0f-5caf-4d0e-b5e0-e4b5a661b643 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:36.579629 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c5f6af0f-5caf-4d0e-b5e0-e4b5a661b643 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:36.580890 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c5f6af0f-5caf-4d0e-b5e0-e4b5a661b643 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:36.582341 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c5f6af0f-5caf-4d0e-b5e0-e4b5a661b643 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:36.583065 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c5f6af0f-5caf-4d0e-b5e0-e4b5a661b643 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:36.771214 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-68f6a4fe-98a6-430e-871d-9c77bf3d6b4a tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7d2e249cfc4feb92c8486a892b8b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e42e9f6c747493685a49d70d7061a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:36.780496 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-68f6a4fe-98a6-430e-871d-9c77bf3d6b4a tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] 10.222.0.20 "GET /compute/v2.1/servers/b2fbbb75-1f0b-4095-8a22-df673b44686d" status: 200 len: 1312 microversion: 2.1 time: 0.730984 Oct 04 18:38:36.801086 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1292/2658] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:36 2022] GET /compute/v2.1/servers/b2fbbb75-1f0b-4095-8a22-df673b44686d => generated 1312 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:36.845011 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-b30d8883-3d6a-468c-9718-7a0164e82786 req-d3b98490-69fb-46d0-97de-28cf29de13fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5965d934-6f27-43ac-bf15-8fd20da48cc1", "tag": "e3117103-e47a-4f74-bf00-0960c112b84c"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:36.866579 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-b30d8883-3d6a-468c-9718-7a0164e82786 req-d3b98490-69fb-46d0-97de-28cf29de13fe service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:36.867251 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-b30d8883-3d6a-468c-9718-7a0164e82786 req-d3b98490-69fb-46d0-97de-28cf29de13fe service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:36.867710 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-b30d8883-3d6a-468c-9718-7a0164e82786 req-d3b98490-69fb-46d0-97de-28cf29de13fe service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:36.887729 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-b30d8883-3d6a-468c-9718-7a0164e82786 req-d3b98490-69fb-46d0-97de-28cf29de13fe service nova] Creating event network-changed:e3117103-e47a-4f74-bf00-0960c112b84c for instance 5965d934-6f27-43ac-bf15-8fd20da48cc1 on n-h1-850501-14 Oct 04 18:38:36.894061 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-b30d8883-3d6a-468c-9718-7a0164e82786 req-d3b98490-69fb-46d0-97de-28cf29de13fe service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054754 Oct 04 18:38:36.895028 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1293/2659] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:38:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:38:37.076692 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-27e49207-9d45-4b6b-bb59-186f6cedc00e tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:37.080141 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-27e49207-9d45-4b6b-bb59-186f6cedc00e tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 98dfffc8-51aa-407a-a374-8e120ec43a31] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:37.092603 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-27e49207-9d45-4b6b-bb59-186f6cedc00e tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:37.095857 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-27e49207-9d45-4b6b-bb59-186f6cedc00e tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:37.098155 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-27e49207-9d45-4b6b-bb59-186f6cedc00e tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:37.102060 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-27e49207-9d45-4b6b-bb59-186f6cedc00e tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:37.113086 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-27e49207-9d45-4b6b-bb59-186f6cedc00e tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:37.127280 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-27e49207-9d45-4b6b-bb59-186f6cedc00e tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:37.212557 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c5f6af0f-5caf-4d0e-b5e0-e4b5a661b643 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8284fe51decd4db0bf6b3ed1514cc2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87473abf47e74adf844e3ddfa24da3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:37.234411 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c5f6af0f-5caf-4d0e-b5e0-e4b5a661b643 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] 10.222.0.20 "GET /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1" status: 200 len: 1314 microversion: 2.1 time: 0.693184 Oct 04 18:38:37.236666 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1367/2660] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:36 2022] GET /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1 => generated 1314 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:37.387763 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-27e49207-9d45-4b6b-bb59-186f6cedc00e tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:37.399480 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-27e49207-9d45-4b6b-bb59-186f6cedc00e tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31" status: 200 len: 1184 microversion: 2.1 time: 0.328229 Oct 04 18:38:37.402457 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1294/2661] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:37 2022] GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31 => generated 1184 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:38:37.551867 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4fa48a9f-3c64-4f57-a075-6061d7157cf6 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:37.552522 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4fa48a9f-3c64-4f57-a075-6061d7157cf6 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 474a799f-8e38-49d6-8fff-9ec3e7657ef5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:37.584741 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4fa48a9f-3c64-4f57-a075-6061d7157cf6 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:37.590617 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4fa48a9f-3c64-4f57-a075-6061d7157cf6 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:37.593967 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4fa48a9f-3c64-4f57-a075-6061d7157cf6 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:37.598103 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4fa48a9f-3c64-4f57-a075-6061d7157cf6 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:37.598103 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4fa48a9f-3c64-4f57-a075-6061d7157cf6 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:37.598103 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4fa48a9f-3c64-4f57-a075-6061d7157cf6 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:37.812781 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-bb83b661-0b6c-40a6-a5cb-786cddee9280 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:37.813663 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-bb83b661-0b6c-40a6-a5cb-786cddee9280 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] [instance: b2fbbb75-1f0b-4095-8a22-df673b44686d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:37.825880 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bb83b661-0b6c-40a6-a5cb-786cddee9280 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:37.826382 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bb83b661-0b6c-40a6-a5cb-786cddee9280 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:37.826820 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bb83b661-0b6c-40a6-a5cb-786cddee9280 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:37.827716 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bb83b661-0b6c-40a6-a5cb-786cddee9280 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:37.828575 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bb83b661-0b6c-40a6-a5cb-786cddee9280 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:37.829011 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bb83b661-0b6c-40a6-a5cb-786cddee9280 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:38.068200 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=4 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:38:38.595087 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4fa48a9f-3c64-4f57-a075-6061d7157cf6 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:38.611438 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4fa48a9f-3c64-4f57-a075-6061d7157cf6 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5" status: 200 len: 1535 microversion: 2.1 time: 1.063680 Oct 04 18:38:38.615187 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1368/2662] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:37 2022] GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5 => generated 1535 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:38.656327 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-26dc70d6-6bf8-4429-b1c7-048992974c9d tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:38.658004 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-26dc70d6-6bf8-4429-b1c7-048992974c9d tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 5965d934-6f27-43ac-bf15-8fd20da48cc1] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:38.673510 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-26dc70d6-6bf8-4429-b1c7-048992974c9d tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:38.679609 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-26dc70d6-6bf8-4429-b1c7-048992974c9d tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:38.680408 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-26dc70d6-6bf8-4429-b1c7-048992974c9d tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:38.683668 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-26dc70d6-6bf8-4429-b1c7-048992974c9d tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:38.685418 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-26dc70d6-6bf8-4429-b1c7-048992974c9d tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:38.686075 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-26dc70d6-6bf8-4429-b1c7-048992974c9d tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:38.777436 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-bb83b661-0b6c-40a6-a5cb-786cddee9280 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7d2e249cfc4feb92c8486a892b8b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e42e9f6c747493685a49d70d7061a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:38.786306 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-bb83b661-0b6c-40a6-a5cb-786cddee9280 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] 10.222.0.20 "GET /compute/v2.1/servers/b2fbbb75-1f0b-4095-8a22-df673b44686d" status: 200 len: 1312 microversion: 2.1 time: 0.977241 Oct 04 18:38:38.815318 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1295/2663] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:37 2022] GET /compute/v2.1/servers/b2fbbb75-1f0b-4095-8a22-df673b44686d => generated 1312 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:38:38.839766 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6dda433c-8e8b-424c-83e9-abc72c5c80b3 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:38.844776 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6dda433c-8e8b-424c-83e9-abc72c5c80b3 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 98dfffc8-51aa-407a-a374-8e120ec43a31] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:38.861535 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6dda433c-8e8b-424c-83e9-abc72c5c80b3 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:38.864858 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6dda433c-8e8b-424c-83e9-abc72c5c80b3 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:38.866166 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6dda433c-8e8b-424c-83e9-abc72c5c80b3 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:38.870071 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6dda433c-8e8b-424c-83e9-abc72c5c80b3 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:38.870751 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6dda433c-8e8b-424c-83e9-abc72c5c80b3 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:38.871147 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6dda433c-8e8b-424c-83e9-abc72c5c80b3 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:38.978234 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=32 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:38:39.092858 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6dda433c-8e8b-424c-83e9-abc72c5c80b3 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:39.110869 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6dda433c-8e8b-424c-83e9-abc72c5c80b3 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31" status: 200 len: 1184 microversion: 2.1 time: 0.274367 Oct 04 18:38:39.114816 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1296/2664] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:38 2022] GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31 => generated 1184 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:39.127778 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-acccca8e-fc20-4230-b712-3542c5f8712d req-a271defa-422b-49a3-957c-5b786d5707ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "474a799f-8e38-49d6-8fff-9ec3e7657ef5", "tag": "a0d7cb42-218d-4bf1-adab-5dbf22e8ab22"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:39.193563 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-acccca8e-fc20-4230-b712-3542c5f8712d req-a271defa-422b-49a3-957c-5b786d5707ab service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:39.194416 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-acccca8e-fc20-4230-b712-3542c5f8712d req-a271defa-422b-49a3-957c-5b786d5707ab service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:39.195063 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-acccca8e-fc20-4230-b712-3542c5f8712d req-a271defa-422b-49a3-957c-5b786d5707ab service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:39.211852 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-acccca8e-fc20-4230-b712-3542c5f8712d req-a271defa-422b-49a3-957c-5b786d5707ab service nova] Creating event network-changed:a0d7cb42-218d-4bf1-adab-5dbf22e8ab22 for instance 474a799f-8e38-49d6-8fff-9ec3e7657ef5 on n-h2-850501-14 Oct 04 18:38:39.227760 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [req-acccca8e-fc20-4230-b712-3542c5f8712d req-a271defa-422b-49a3-957c-5b786d5707ab service nova] Instance 474a799f-8e38-49d6-8fff-9ec3e7657ef5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850501-14', 'n-h2-850501-14'} {{(pid=123001) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:38:39.242113 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-acccca8e-fc20-4230-b712-3542c5f8712d req-a271defa-422b-49a3-957c-5b786d5707ab service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125384 Oct 04 18:38:39.243868 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1297/2665] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:38:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:39.312352 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-26dc70d6-6bf8-4429-b1c7-048992974c9d tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8284fe51decd4db0bf6b3ed1514cc2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87473abf47e74adf844e3ddfa24da3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:39.326883 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-26dc70d6-6bf8-4429-b1c7-048992974c9d tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] 10.222.0.20 "GET /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1" status: 200 len: 1314 microversion: 2.1 time: 0.708751 Oct 04 18:38:39.328207 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1369/2666] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:38 2022] GET /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1 => generated 1314 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:39.505591 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-392ff2a4-511b-4fcf-846e-dbc5fa31544d req-14dd2648-5556-4402-89d1-885d55d0be88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2fbbb75-1f0b-4095-8a22-df673b44686d", "tag": "12ae1f9b-1e01-4cbc-a20e-08d83f8483a6"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:39.523265 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-392ff2a4-511b-4fcf-846e-dbc5fa31544d req-14dd2648-5556-4402-89d1-885d55d0be88 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:39.524479 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-392ff2a4-511b-4fcf-846e-dbc5fa31544d req-14dd2648-5556-4402-89d1-885d55d0be88 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:39.525315 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-392ff2a4-511b-4fcf-846e-dbc5fa31544d req-14dd2648-5556-4402-89d1-885d55d0be88 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:39.565928 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-392ff2a4-511b-4fcf-846e-dbc5fa31544d req-14dd2648-5556-4402-89d1-885d55d0be88 service nova] Creating event network-changed:12ae1f9b-1e01-4cbc-a20e-08d83f8483a6 for instance b2fbbb75-1f0b-4095-8a22-df673b44686d on n-h2-850501-14 Oct 04 18:38:39.581380 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-392ff2a4-511b-4fcf-846e-dbc5fa31544d req-14dd2648-5556-4402-89d1-885d55d0be88 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082051 Oct 04 18:38:39.586185 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1298/2667] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:38:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:39.642862 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-71057b34-d7b8-48bd-8238-8a472758cf52 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:39.644537 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-71057b34-d7b8-48bd-8238-8a472758cf52 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 474a799f-8e38-49d6-8fff-9ec3e7657ef5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:39.658901 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-71057b34-d7b8-48bd-8238-8a472758cf52 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:39.661178 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-71057b34-d7b8-48bd-8238-8a472758cf52 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:39.662215 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-71057b34-d7b8-48bd-8238-8a472758cf52 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:39.664089 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-71057b34-d7b8-48bd-8238-8a472758cf52 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:39.665006 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-71057b34-d7b8-48bd-8238-8a472758cf52 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:39.669277 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-71057b34-d7b8-48bd-8238-8a472758cf52 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:39.819871 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b777044d-7238-47bf-85a3-4efd745def19 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:39.821401 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b777044d-7238-47bf-85a3-4efd745def19 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] [instance: b2fbbb75-1f0b-4095-8a22-df673b44686d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:39.841146 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b777044d-7238-47bf-85a3-4efd745def19 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:39.842033 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b777044d-7238-47bf-85a3-4efd745def19 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:39.845719 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b777044d-7238-47bf-85a3-4efd745def19 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:39.848000 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b777044d-7238-47bf-85a3-4efd745def19 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:39.862063 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b777044d-7238-47bf-85a3-4efd745def19 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:39.866766 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b777044d-7238-47bf-85a3-4efd745def19 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:40.131759 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=34 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:38:40.342501 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-71057b34-d7b8-48bd-8238-8a472758cf52 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:40.357088 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-71057b34-d7b8-48bd-8238-8a472758cf52 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5" status: 200 len: 1535 microversion: 2.1 time: 0.717645 Oct 04 18:38:40.358198 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1370/2668] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:39 2022] GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5 => generated 1535 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:40.371709 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a678f0c3-1077-4c99-b051-c894179021a6 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:40.372630 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a678f0c3-1077-4c99-b051-c894179021a6 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 98dfffc8-51aa-407a-a374-8e120ec43a31] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:40.380489 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a678f0c3-1077-4c99-b051-c894179021a6 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:40.381525 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a678f0c3-1077-4c99-b051-c894179021a6 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:40.382353 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a678f0c3-1077-4c99-b051-c894179021a6 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:40.383371 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a678f0c3-1077-4c99-b051-c894179021a6 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:40.384104 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a678f0c3-1077-4c99-b051-c894179021a6 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:40.384877 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a678f0c3-1077-4c99-b051-c894179021a6 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:40.420481 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b777044d-7238-47bf-85a3-4efd745def19 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7d2e249cfc4feb92c8486a892b8b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e42e9f6c747493685a49d70d7061a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:40.435691 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b777044d-7238-47bf-85a3-4efd745def19 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] 10.222.0.20 "GET /compute/v2.1/servers/b2fbbb75-1f0b-4095-8a22-df673b44686d" status: 200 len: 1312 microversion: 2.1 time: 0.620051 Oct 04 18:38:40.437022 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1299/2669] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:39 2022] GET /compute/v2.1/servers/b2fbbb75-1f0b-4095-8a22-df673b44686d => generated 1312 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:40.460750 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7db0ae4a-a551-4ed5-81b9-110482e18c6b tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:40.462125 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7db0ae4a-a551-4ed5-81b9-110482e18c6b tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 5965d934-6f27-43ac-bf15-8fd20da48cc1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:40.484962 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7db0ae4a-a551-4ed5-81b9-110482e18c6b tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:40.494464 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7db0ae4a-a551-4ed5-81b9-110482e18c6b tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:40.497062 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7db0ae4a-a551-4ed5-81b9-110482e18c6b tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:40.498066 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7db0ae4a-a551-4ed5-81b9-110482e18c6b tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:40.500924 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7db0ae4a-a551-4ed5-81b9-110482e18c6b tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:40.503065 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7db0ae4a-a551-4ed5-81b9-110482e18c6b tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:40.566878 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a678f0c3-1077-4c99-b051-c894179021a6 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:40.576754 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a678f0c3-1077-4c99-b051-c894179021a6 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31" status: 200 len: 1184 microversion: 2.1 time: 0.217104 Oct 04 18:38:40.577559 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1371/2670] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:40 2022] GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31 => generated 1184 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:40.804715 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7db0ae4a-a551-4ed5-81b9-110482e18c6b tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8284fe51decd4db0bf6b3ed1514cc2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87473abf47e74adf844e3ddfa24da3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:40.816868 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7db0ae4a-a551-4ed5-81b9-110482e18c6b tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] 10.222.0.20 "GET /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1" status: 200 len: 1314 microversion: 2.1 time: 0.378450 Oct 04 18:38:40.817460 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1300/2671] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:40 2022] GET /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1 => generated 1314 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:41.382832 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8fd670ae-d0e2-4f0a-bdaf-bf8617684428 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:41.384085 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8fd670ae-d0e2-4f0a-bdaf-bf8617684428 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 474a799f-8e38-49d6-8fff-9ec3e7657ef5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:41.392744 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8fd670ae-d0e2-4f0a-bdaf-bf8617684428 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:41.393498 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8fd670ae-d0e2-4f0a-bdaf-bf8617684428 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:41.394108 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8fd670ae-d0e2-4f0a-bdaf-bf8617684428 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:41.395041 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8fd670ae-d0e2-4f0a-bdaf-bf8617684428 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:41.395661 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8fd670ae-d0e2-4f0a-bdaf-bf8617684428 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:41.396286 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8fd670ae-d0e2-4f0a-bdaf-bf8617684428 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:41.462663 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-44f39abb-357d-443b-bcf7-33dce0e7f86e tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:41.464202 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-44f39abb-357d-443b-bcf7-33dce0e7f86e tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] [instance: b2fbbb75-1f0b-4095-8a22-df673b44686d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:41.486295 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-44f39abb-357d-443b-bcf7-33dce0e7f86e tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:41.486796 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-44f39abb-357d-443b-bcf7-33dce0e7f86e tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:41.487235 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-44f39abb-357d-443b-bcf7-33dce0e7f86e tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:41.488163 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-44f39abb-357d-443b-bcf7-33dce0e7f86e tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:41.498341 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-44f39abb-357d-443b-bcf7-33dce0e7f86e tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:41.499029 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-44f39abb-357d-443b-bcf7-33dce0e7f86e tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:41.629920 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8fd670ae-d0e2-4f0a-bdaf-bf8617684428 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:41.641930 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8fd670ae-d0e2-4f0a-bdaf-bf8617684428 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5" status: 200 len: 1535 microversion: 2.1 time: 0.263093 Oct 04 18:38:41.643383 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1372/2672] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:41 2022] GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5 => generated 1535 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:41.649040 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-41c76203-2736-4eb4-91c3-0b5b0f7e7eb0 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:41.656581 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-41c76203-2736-4eb4-91c3-0b5b0f7e7eb0 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 98dfffc8-51aa-407a-a374-8e120ec43a31] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:41.680504 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-41c76203-2736-4eb4-91c3-0b5b0f7e7eb0 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:41.681104 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-41c76203-2736-4eb4-91c3-0b5b0f7e7eb0 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:41.681582 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-41c76203-2736-4eb4-91c3-0b5b0f7e7eb0 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:41.683700 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-41c76203-2736-4eb4-91c3-0b5b0f7e7eb0 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:41.684891 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-41c76203-2736-4eb4-91c3-0b5b0f7e7eb0 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:41.685331 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-41c76203-2736-4eb4-91c3-0b5b0f7e7eb0 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:41.776773 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-41c76203-2736-4eb4-91c3-0b5b0f7e7eb0 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:41.777371 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-41c76203-2736-4eb4-91c3-0b5b0f7e7eb0 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:41.777815 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-41c76203-2736-4eb4-91c3-0b5b0f7e7eb0 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:41.778277 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-41c76203-2736-4eb4-91c3-0b5b0f7e7eb0 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lazy-loading 'fault' on Instance uuid 98dfffc8-51aa-407a-a374-8e120ec43a31 {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:38:41.781794 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-44f39abb-357d-443b-bcf7-33dce0e7f86e tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7d2e249cfc4feb92c8486a892b8b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e42e9f6c747493685a49d70d7061a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:41.789928 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-44f39abb-357d-443b-bcf7-33dce0e7f86e tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] 10.222.0.20 "GET /compute/v2.1/servers/b2fbbb75-1f0b-4095-8a22-df673b44686d" status: 200 len: 1312 microversion: 2.1 time: 0.332505 Oct 04 18:38:41.790535 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1301/2673] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:41 2022] GET /compute/v2.1/servers/b2fbbb75-1f0b-4095-8a22-df673b44686d => generated 1312 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:38:41.798019 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=100 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:38:41.843106 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f501f994-0b79-466e-95fb-77db16ae30c1 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:41.843946 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f501f994-0b79-466e-95fb-77db16ae30c1 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 5965d934-6f27-43ac-bf15-8fd20da48cc1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:41.857113 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f501f994-0b79-466e-95fb-77db16ae30c1 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:41.857621 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f501f994-0b79-466e-95fb-77db16ae30c1 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:41.858065 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f501f994-0b79-466e-95fb-77db16ae30c1 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:41.858791 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f501f994-0b79-466e-95fb-77db16ae30c1 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:41.866884 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f501f994-0b79-466e-95fb-77db16ae30c1 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:41.867390 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f501f994-0b79-466e-95fb-77db16ae30c1 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:41.893764 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-41c76203-2736-4eb4-91c3-0b5b0f7e7eb0 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:41.903950 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-41c76203-2736-4eb4-91c3-0b5b0f7e7eb0 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31" status: 200 len: 1189 microversion: 2.1 time: 0.259125 Oct 04 18:38:41.906353 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1373/2674] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:41 2022] GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31 => generated 1189 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:42.098707 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f501f994-0b79-466e-95fb-77db16ae30c1 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8284fe51decd4db0bf6b3ed1514cc2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87473abf47e74adf844e3ddfa24da3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:42.115799 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f501f994-0b79-466e-95fb-77db16ae30c1 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] 10.222.0.20 "GET /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1" status: 200 len: 1314 microversion: 2.1 time: 0.277002 Oct 04 18:38:42.125419 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1302/2675] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:41 2022] GET /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1 => generated 1314 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:38:42.670529 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0b89c530-c329-4bad-99d7-4cb6d5c33362 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:42.671443 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0b89c530-c329-4bad-99d7-4cb6d5c33362 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 474a799f-8e38-49d6-8fff-9ec3e7657ef5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:42.675617 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=2,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:38:42.682218 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0b89c530-c329-4bad-99d7-4cb6d5c33362 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:42.683512 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0b89c530-c329-4bad-99d7-4cb6d5c33362 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:42.686331 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0b89c530-c329-4bad-99d7-4cb6d5c33362 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:42.687252 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0b89c530-c329-4bad-99d7-4cb6d5c33362 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:42.687868 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0b89c530-c329-4bad-99d7-4cb6d5c33362 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:42.689154 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0b89c530-c329-4bad-99d7-4cb6d5c33362 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:42.816268 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-69b473e6-51c6-4386-a1db-b6c6d36d707a tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:42.816929 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-69b473e6-51c6-4386-a1db-b6c6d36d707a tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] [instance: b2fbbb75-1f0b-4095-8a22-df673b44686d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:42.835898 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-69b473e6-51c6-4386-a1db-b6c6d36d707a tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:42.836541 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-69b473e6-51c6-4386-a1db-b6c6d36d707a tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:42.837001 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-69b473e6-51c6-4386-a1db-b6c6d36d707a tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:42.837751 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-69b473e6-51c6-4386-a1db-b6c6d36d707a tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:42.838215 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-69b473e6-51c6-4386-a1db-b6c6d36d707a tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:42.838640 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-69b473e6-51c6-4386-a1db-b6c6d36d707a tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:42.900482 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=100 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:38:42.999086 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0b89c530-c329-4bad-99d7-4cb6d5c33362 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:43.014360 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0b89c530-c329-4bad-99d7-4cb6d5c33362 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5" status: 200 len: 1535 microversion: 2.1 time: 0.350970 Oct 04 18:38:43.019552 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1374/2676] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:42 2022] GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5 => generated 1535 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:43.045368 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4b0cdc0f-eb15-43a9-a899-dc2785b5d62b tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:43.049181 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4b0cdc0f-eb15-43a9-a899-dc2785b5d62b tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 98dfffc8-51aa-407a-a374-8e120ec43a31] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:43.062163 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4b0cdc0f-eb15-43a9-a899-dc2785b5d62b tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:43.063807 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4b0cdc0f-eb15-43a9-a899-dc2785b5d62b tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:43.079123 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4b0cdc0f-eb15-43a9-a899-dc2785b5d62b tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:43.079123 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4b0cdc0f-eb15-43a9-a899-dc2785b5d62b tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:43.079123 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4b0cdc0f-eb15-43a9-a899-dc2785b5d62b tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:43.079123 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4b0cdc0f-eb15-43a9-a899-dc2785b5d62b tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:43.103707 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-4b0cdc0f-eb15-43a9-a899-dc2785b5d62b tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] HTTP exception thrown: Instance 98dfffc8-51aa-407a-a374-8e120ec43a31 could not be found. Oct 04 18:38:43.110393 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4b0cdc0f-eb15-43a9-a899-dc2785b5d62b tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Request method failure captured: Oct 04 18:38:43.110393 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31 HTTP/1.1 Oct 04 18:38:43.110393 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:38:43.110393 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:38:43.110393 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:38:43.110393 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:38:43.110393 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:38:43.110393 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:38:43.110393 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:38:43.110393 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:38:43.110393 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPHulPRClkzd6kBQ81rrBhumMq88AYIanAk2xdeHK5U7wVgRC25-TXMgOlEBZg6WJpOKuV9BZwqY7S9UVeacMmO6BXdoABSwoaanCO5yf8qjOFgEjgLyJbKDRoktuo-EczFm_S4RGYEsRlB3A3Vi9-kDkYqoEQcS34joufFbsOIKcLTo Oct 04 18:38:43.110393 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:38:43.110393 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:38:43.110393 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:38:43.110393 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:38:43.110393 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:38:43.110393 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:38:43.110393 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: dde62f171d474b038f1af39899518211 Oct 04 18:38:43.110393 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-LiveMigrationTest-1583731626 Oct 04 18:38:43.110393 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:38:43.110393 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:38:43.110393 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dde62f171d474b038f1af39899518211"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dde62f171d474b038f1af39899518211", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dde62f171d474b038f1af39899518211"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dde62f171d474b038f1af39899518211"}]}] Oct 04 18:38:43.110393 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-LiveMigrationTest-1583731626 Oct 04 18:38:43.110393 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: dde62f171d474b038f1af39899518211 Oct 04 18:38:43.110393 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-LiveMigrationTest-1583731626 Oct 04 18:38:43.110393 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-LiveMigrationTest-1583731626-project Oct 04 18:38:43.110393 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:38:43.110393 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:38:43.110393 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: c80f2b2dbf824a1d879f5b7edb343f26 Oct 04 18:38:43.110393 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-LiveMigrationTest-1583731626-project Oct 04 18:38:43.110393 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:38:43.110393 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 98dfffc8-51aa-407a-a374-8e120ec43a31 could not be found. Oct 04 18:38:43.110393 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '98dfffc8-51aa-407a-a374-8e120ec43a31'} Oct 04 18:38:43.110393 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:38:43.110393 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:38:43.110393 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:38:43.110393 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:38:43.110393 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:38:43.110393 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:38:43.110393 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:38:43.110393 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:38:43.110393 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:38:43.110393 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:38:43.110393 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98dfffc8-51aa-407a-a374-8e120ec43a31 could not be found. Oct 04 18:38:43.110393 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:38:43.110393 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:38:43.110393 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:38:43.110393 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:38:43.110393 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:38:43.110393 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:38:43.110393 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:38:43.110393 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:38:43.110393 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:38:43.110393 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:38:43.110393 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:38:43.110393 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:38:43.110393 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:38:43.110393 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:38:43.110393 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:38:43.110393 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:38:43.110393 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98dfffc8-51aa-407a-a374-8e120ec43a31 could not be found. Oct 04 18:38:43.110393 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:38:43.110393 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:38:43.110393 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:38:43.123007 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:38:43.123007 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:38:43.123007 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:38:43.123007 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:38:43.123007 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:38:43.123007 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98dfffc8-51aa-407a-a374-8e120ec43a31 could not be found. Oct 04 18:38:43.123007 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:38:43.123007 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4b0cdc0f-eb15-43a9-a899-dc2785b5d62b tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Returning 404 to user: Instance 98dfffc8-51aa-407a-a374-8e120ec43a31 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:38:43.123007 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4b0cdc0f-eb15-43a9-a899-dc2785b5d62b tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31" status: 404 len: 111 microversion: 2.1 time: 0.091069 Oct 04 18:38:43.123007 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1375/2677] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:43 2022] GET /compute/v2.1/servers/98dfffc8-51aa-407a-a374-8e120ec43a31 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:38:43.149447 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-80e10287-6b2d-45b8-ab1f-bba6612c4b31 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:43.157488 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-80e10287-6b2d-45b8-ab1f-bba6612c4b31 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 5965d934-6f27-43ac-bf15-8fd20da48cc1] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:43.209850 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-69b473e6-51c6-4386-a1db-b6c6d36d707a tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7d2e249cfc4feb92c8486a892b8b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e42e9f6c747493685a49d70d7061a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:43.212530 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-80e10287-6b2d-45b8-ab1f-bba6612c4b31 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:43.213037 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-80e10287-6b2d-45b8-ab1f-bba6612c4b31 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:43.213494 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-80e10287-6b2d-45b8-ab1f-bba6612c4b31 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:43.214983 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-80e10287-6b2d-45b8-ab1f-bba6612c4b31 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:43.215449 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-80e10287-6b2d-45b8-ab1f-bba6612c4b31 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:43.216967 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-80e10287-6b2d-45b8-ab1f-bba6612c4b31 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:43.221191 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-69b473e6-51c6-4386-a1db-b6c6d36d707a tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] 10.222.0.20 "GET /compute/v2.1/servers/b2fbbb75-1f0b-4095-8a22-df673b44686d" status: 200 len: 1312 microversion: 2.1 time: 0.408463 Oct 04 18:38:43.222802 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1303/2678] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:42 2022] GET /compute/v2.1/servers/b2fbbb75-1f0b-4095-8a22-df673b44686d => generated 1312 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:43.683635 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-80e10287-6b2d-45b8-ab1f-bba6612c4b31 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8284fe51decd4db0bf6b3ed1514cc2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87473abf47e74adf844e3ddfa24da3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:43.694182 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-80e10287-6b2d-45b8-ab1f-bba6612c4b31 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] 10.222.0.20 "GET /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1" status: 200 len: 1314 microversion: 2.1 time: 0.554983 Oct 04 18:38:43.712916 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1376/2679] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:43 2022] GET /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1 => generated 1314 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:44.050842 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8f5a8284-bad3-4d83-ad24-aea056ebf12a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:44.051739 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8f5a8284-bad3-4d83-ad24-aea056ebf12a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 474a799f-8e38-49d6-8fff-9ec3e7657ef5] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:44.064505 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8f5a8284-bad3-4d83-ad24-aea056ebf12a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:44.065013 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8f5a8284-bad3-4d83-ad24-aea056ebf12a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:44.069305 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8f5a8284-bad3-4d83-ad24-aea056ebf12a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:44.070245 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8f5a8284-bad3-4d83-ad24-aea056ebf12a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:44.071123 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8f5a8284-bad3-4d83-ad24-aea056ebf12a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:44.073054 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8f5a8284-bad3-4d83-ad24-aea056ebf12a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:44.244614 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-efcca4d4-85ba-4616-ac22-989d462c3d0c tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:44.245863 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-efcca4d4-85ba-4616-ac22-989d462c3d0c tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] [instance: b2fbbb75-1f0b-4095-8a22-df673b44686d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:44.265248 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-efcca4d4-85ba-4616-ac22-989d462c3d0c tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:44.271359 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-efcca4d4-85ba-4616-ac22-989d462c3d0c tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:44.271920 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-efcca4d4-85ba-4616-ac22-989d462c3d0c tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:44.274640 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-efcca4d4-85ba-4616-ac22-989d462c3d0c tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:44.275150 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-efcca4d4-85ba-4616-ac22-989d462c3d0c tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:44.279985 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-efcca4d4-85ba-4616-ac22-989d462c3d0c tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:44.723490 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8f5a8284-bad3-4d83-ad24-aea056ebf12a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:44.739943 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8f5a8284-bad3-4d83-ad24-aea056ebf12a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5" status: 200 len: 1535 microversion: 2.1 time: 0.694308 Oct 04 18:38:44.757281 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1304/2680] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:44 2022] GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5 => generated 1535 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:44.783105 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e5559029-41c4-45b8-8bcb-91221d1055fc tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:44.784376 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e5559029-41c4-45b8-8bcb-91221d1055fc tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 5965d934-6f27-43ac-bf15-8fd20da48cc1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:44.794505 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e5559029-41c4-45b8-8bcb-91221d1055fc tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:44.795370 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e5559029-41c4-45b8-8bcb-91221d1055fc tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:44.796290 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e5559029-41c4-45b8-8bcb-91221d1055fc tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:44.797525 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e5559029-41c4-45b8-8bcb-91221d1055fc tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:44.798570 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e5559029-41c4-45b8-8bcb-91221d1055fc tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:44.799463 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e5559029-41c4-45b8-8bcb-91221d1055fc tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:44.849197 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-efcca4d4-85ba-4616-ac22-989d462c3d0c tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7d2e249cfc4feb92c8486a892b8b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e42e9f6c747493685a49d70d7061a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:44.858536 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-efcca4d4-85ba-4616-ac22-989d462c3d0c tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] 10.222.0.20 "GET /compute/v2.1/servers/b2fbbb75-1f0b-4095-8a22-df673b44686d" status: 200 len: 1312 microversion: 2.1 time: 0.618275 Oct 04 18:38:44.868863 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1377/2681] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:44 2022] GET /compute/v2.1/servers/b2fbbb75-1f0b-4095-8a22-df673b44686d => generated 1312 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:45.209737 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e5559029-41c4-45b8-8bcb-91221d1055fc tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8284fe51decd4db0bf6b3ed1514cc2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87473abf47e74adf844e3ddfa24da3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:45.223498 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e5559029-41c4-45b8-8bcb-91221d1055fc tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] 10.222.0.20 "GET /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1" status: 200 len: 1314 microversion: 2.1 time: 0.464654 Oct 04 18:38:45.225903 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1305/2682] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:44 2022] GET /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1 => generated 1314 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:45.768363 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-773667cd-5e62-4b96-8f94-79b0477cda8a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:45.769210 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-773667cd-5e62-4b96-8f94-79b0477cda8a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 474a799f-8e38-49d6-8fff-9ec3e7657ef5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:45.784390 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-773667cd-5e62-4b96-8f94-79b0477cda8a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:45.785153 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-773667cd-5e62-4b96-8f94-79b0477cda8a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:45.785767 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-773667cd-5e62-4b96-8f94-79b0477cda8a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:45.786643 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-773667cd-5e62-4b96-8f94-79b0477cda8a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:45.787260 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-773667cd-5e62-4b96-8f94-79b0477cda8a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:45.787840 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-773667cd-5e62-4b96-8f94-79b0477cda8a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:45.892025 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-478560ab-a6df-4b43-b944-76907de78b99 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:45.892672 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-478560ab-a6df-4b43-b944-76907de78b99 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] [instance: b2fbbb75-1f0b-4095-8a22-df673b44686d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:45.900827 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-478560ab-a6df-4b43-b944-76907de78b99 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:45.901872 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-478560ab-a6df-4b43-b944-76907de78b99 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:45.916839 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-478560ab-a6df-4b43-b944-76907de78b99 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:45.920930 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-478560ab-a6df-4b43-b944-76907de78b99 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:45.921576 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-478560ab-a6df-4b43-b944-76907de78b99 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:45.922340 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-478560ab-a6df-4b43-b944-76907de78b99 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:46.559602 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-773667cd-5e62-4b96-8f94-79b0477cda8a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:46.577546 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-773667cd-5e62-4b96-8f94-79b0477cda8a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5" status: 200 len: 1535 microversion: 2.1 time: 0.813519 Oct 04 18:38:46.586186 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1378/2683] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:45 2022] GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5 => generated 1535 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:46.599085 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-dae7b88b-75ad-43b8-b721-97028a1a43d6 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:46.606285 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-dae7b88b-75ad-43b8-b721-97028a1a43d6 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 5965d934-6f27-43ac-bf15-8fd20da48cc1] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:46.627855 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dae7b88b-75ad-43b8-b721-97028a1a43d6 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:46.632845 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dae7b88b-75ad-43b8-b721-97028a1a43d6 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:46.632845 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dae7b88b-75ad-43b8-b721-97028a1a43d6 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:46.632845 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dae7b88b-75ad-43b8-b721-97028a1a43d6 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:46.632845 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dae7b88b-75ad-43b8-b721-97028a1a43d6 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:46.632845 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dae7b88b-75ad-43b8-b721-97028a1a43d6 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:46.813834 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-478560ab-a6df-4b43-b944-76907de78b99 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7d2e249cfc4feb92c8486a892b8b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e42e9f6c747493685a49d70d7061a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:46.829806 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-478560ab-a6df-4b43-b944-76907de78b99 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] 10.222.0.20 "GET /compute/v2.1/servers/b2fbbb75-1f0b-4095-8a22-df673b44686d" status: 200 len: 1312 microversion: 2.1 time: 0.941729 Oct 04 18:38:46.846561 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1306/2684] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:45 2022] GET /compute/v2.1/servers/b2fbbb75-1f0b-4095-8a22-df673b44686d => generated 1312 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:47.464325 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-2bf1b0b4-9a6f-4ba5-b93f-b6aba71611c1 req-f856e78b-ae7b-43d7-a512-94e06cf018ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5965d934-6f27-43ac-bf15-8fd20da48cc1", "name": "network-vif-plugged", "status": "completed", "tag": "e3117103-e47a-4f74-bf00-0960c112b84c"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:47.487613 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-2bf1b0b4-9a6f-4ba5-b93f-b6aba71611c1 req-f856e78b-ae7b-43d7-a512-94e06cf018ba service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:47.488606 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-2bf1b0b4-9a6f-4ba5-b93f-b6aba71611c1 req-f856e78b-ae7b-43d7-a512-94e06cf018ba service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:47.489261 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-2bf1b0b4-9a6f-4ba5-b93f-b6aba71611c1 req-f856e78b-ae7b-43d7-a512-94e06cf018ba service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:47.515973 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-2bf1b0b4-9a6f-4ba5-b93f-b6aba71611c1 req-f856e78b-ae7b-43d7-a512-94e06cf018ba service nova] Creating event network-vif-plugged:e3117103-e47a-4f74-bf00-0960c112b84c for instance 5965d934-6f27-43ac-bf15-8fd20da48cc1 on n-h1-850501-14 Oct 04 18:38:47.522129 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-2bf1b0b4-9a6f-4ba5-b93f-b6aba71611c1 req-f856e78b-ae7b-43d7-a512-94e06cf018ba service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061912 Oct 04 18:38:47.528404 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1307/2685] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:38:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:38:47.610725 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6e2fb642-8903-4099-83b3-d52b89cb62fb tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:47.611932 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6e2fb642-8903-4099-83b3-d52b89cb62fb tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 474a799f-8e38-49d6-8fff-9ec3e7657ef5] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:47.648204 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6e2fb642-8903-4099-83b3-d52b89cb62fb tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:47.651472 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6e2fb642-8903-4099-83b3-d52b89cb62fb tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:47.661169 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6e2fb642-8903-4099-83b3-d52b89cb62fb tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:47.663672 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6e2fb642-8903-4099-83b3-d52b89cb62fb tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:47.665724 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6e2fb642-8903-4099-83b3-d52b89cb62fb tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:47.670244 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6e2fb642-8903-4099-83b3-d52b89cb62fb tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:47.681367 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-dae7b88b-75ad-43b8-b721-97028a1a43d6 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8284fe51decd4db0bf6b3ed1514cc2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87473abf47e74adf844e3ddfa24da3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:47.686059 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-dae7b88b-75ad-43b8-b721-97028a1a43d6 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] 10.222.0.20 "GET /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1" status: 200 len: 1314 microversion: 2.1 time: 1.098077 Oct 04 18:38:47.691396 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1379/2686] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:46 2022] GET /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1 => generated 1314 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:47.857761 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-67807706-045c-49c5-894a-6d1deb4e5d79 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:47.858374 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-67807706-045c-49c5-894a-6d1deb4e5d79 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] [instance: b2fbbb75-1f0b-4095-8a22-df673b44686d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:47.881101 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-67807706-045c-49c5-894a-6d1deb4e5d79 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:47.881101 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-67807706-045c-49c5-894a-6d1deb4e5d79 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:47.881101 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-67807706-045c-49c5-894a-6d1deb4e5d79 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:47.881101 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-67807706-045c-49c5-894a-6d1deb4e5d79 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:47.881101 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-67807706-045c-49c5-894a-6d1deb4e5d79 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:47.881101 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-67807706-045c-49c5-894a-6d1deb4e5d79 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:48.123876 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6e2fb642-8903-4099-83b3-d52b89cb62fb tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:48.139872 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6e2fb642-8903-4099-83b3-d52b89cb62fb tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5" status: 200 len: 1528 microversion: 2.1 time: 0.530930 Oct 04 18:38:48.140745 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1308/2687] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:47 2022] GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5 => generated 1528 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:38:48.170738 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-343db407-210b-40c4-85da-8d6a76f3a8d5 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:48.171691 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-343db407-210b-40c4-85da-8d6a76f3a8d5 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 474a799f-8e38-49d6-8fff-9ec3e7657ef5] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:48.193748 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-343db407-210b-40c4-85da-8d6a76f3a8d5 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:48.198736 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-343db407-210b-40c4-85da-8d6a76f3a8d5 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:48.198736 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-343db407-210b-40c4-85da-8d6a76f3a8d5 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:48.201063 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-343db407-210b-40c4-85da-8d6a76f3a8d5 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:48.202610 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-343db407-210b-40c4-85da-8d6a76f3a8d5 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:48.204840 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-343db407-210b-40c4-85da-8d6a76f3a8d5 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:48.246204 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-67807706-045c-49c5-894a-6d1deb4e5d79 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7d2e249cfc4feb92c8486a892b8b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e42e9f6c747493685a49d70d7061a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:48.258155 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-67807706-045c-49c5-894a-6d1deb4e5d79 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] 10.222.0.20 "GET /compute/v2.1/servers/b2fbbb75-1f0b-4095-8a22-df673b44686d" status: 200 len: 1312 microversion: 2.1 time: 0.404425 Oct 04 18:38:48.259255 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1380/2688] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:47 2022] GET /compute/v2.1/servers/b2fbbb75-1f0b-4095-8a22-df673b44686d => generated 1312 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:38:48.471877 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-343db407-210b-40c4-85da-8d6a76f3a8d5 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:48.482193 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-343db407-210b-40c4-85da-8d6a76f3a8d5 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5" status: 200 len: 1528 microversion: 2.1 time: 0.317945 Oct 04 18:38:48.511195 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-bf0e1bf8-f2f7-41f4-9760-2344fb930bfe tempest-MigrationsAdminTest-1101631867 tempest-MigrationsAdminTest-1101631867-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:48.516755 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1309/2689] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:48 2022] GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5 => generated 1528 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:38:48.520169 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-bf0e1bf8-f2f7-41f4-9760-2344fb930bfe tempest-MigrationsAdminTest-1101631867 tempest-MigrationsAdminTest-1101631867-project-admin] HTTP exception thrown: Flavor 2016a852-14f5-4c8b-9c97-7c97aa0c71e6 could not be found. Oct 04 18:38:48.529658 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-bf0e1bf8-f2f7-41f4-9760-2344fb930bfe tempest-MigrationsAdminTest-1101631867 tempest-MigrationsAdminTest-1101631867-project-admin] Request method failure captured: Oct 04 18:38:48.529658 n-d-850501-14 devstack@n-api.service[123002]: request: DELETE /compute/v2.1/flavors/2016a852-14f5-4c8b-9c97-7c97aa0c71e6 HTTP/1.1 Oct 04 18:38:48.529658 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:38:48.529658 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:38:48.529658 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:38:48.529658 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:38:48.529658 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:38:48.529658 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:38:48.529658 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:38:48.529658 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:38:48.529658 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPHym0PtUfl9ROKPmffG7IHEWT_Ya_IqK-ZjuhClsb9syVXFrnKq8VlJnRU3f5UuMvKG2fc3ffIexgXJW8pcNWLJ8jKgp6fXB6QjdmXXahV8dObp863-wCvopkaAaHPUkNwrZ-BFzSvFTpS3D7rHFnr206VLXUt7rauHPbCtaBRDNLms Oct 04 18:38:48.529658 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:38:48.529658 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:38:48.529658 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:38:48.529658 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:38:48.529658 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:38:48.529658 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:38:48.529658 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 30e8d60a7c224546bb88676729b4cc04 Oct 04 18:38:48.529658 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-MigrationsAdminTest-1101631867 Oct 04 18:38:48.529658 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member,admin Oct 04 18:38:48.529658 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member,admin Oct 04 18:38:48.529658 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/30e8d60a7c224546bb88676729b4cc04"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_30e8d60a7c224546bb88676729b4cc04", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/30e8d60a7c224546bb88676729b4cc04"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/30e8d60a7c224546bb88676729b4cc04"}]}] Oct 04 18:38:48.529658 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-MigrationsAdminTest-1101631867 Oct 04 18:38:48.529658 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 30e8d60a7c224546bb88676729b4cc04 Oct 04 18:38:48.529658 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-MigrationsAdminTest-1101631867 Oct 04 18:38:48.529658 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-MigrationsAdminTest-1101631867-project-admin Oct 04 18:38:48.529658 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:38:48.529658 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:38:48.529658 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 803e67aad71745aebdd938e7f46fb870 Oct 04 18:38:48.529658 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-MigrationsAdminTest-1101631867-project-admin Oct 04 18:38:48.529658 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:38:48.529658 n-d-850501-14 devstack@n-api.service[123002]: exception: Flavor 2016a852-14f5-4c8b-9c97-7c97aa0c71e6 could not be found. Oct 04 18:38:48.529658 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '2016a852-14f5-4c8b-9c97-7c97aa0c71e6'} Oct 04 18:38:48.529658 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:38:48.529658 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:38:48.529658 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Oct 04 18:38:48.529658 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi flavor.destroy() Oct 04 18:38:48.529658 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 04 18:38:48.529658 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 04 18:38:48.529658 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Oct 04 18:38:48.529658 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Oct 04 18:38:48.529658 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Oct 04 18:38:48.529658 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Oct 04 18:38:48.529658 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:38:48.529658 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:38:48.529658 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Oct 04 18:38:48.529658 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Oct 04 18:38:48.529658 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 2016a852-14f5-4c8b-9c97-7c97aa0c71e6 could not be found. Oct 04 18:38:48.529658 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:38:48.529658 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:38:48.529658 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:38:48.529658 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:38:48.529658 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:38:48.529658 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:38:48.529658 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:38:48.529658 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:38:48.529658 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:38:48.529658 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:38:48.529658 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Oct 04 18:38:48.529658 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:38:48.529658 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 2016a852-14f5-4c8b-9c97-7c97aa0c71e6 could not be found. Oct 04 18:38:48.529658 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:38:48.529658 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:38:48.545052 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:38:48.545052 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:38:48.545052 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:38:48.545052 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:38:48.545052 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:38:48.545052 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:38:48.545052 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 2016a852-14f5-4c8b-9c97-7c97aa0c71e6 could not be found. Oct 04 18:38:48.545052 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:38:48.545052 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-bf0e1bf8-f2f7-41f4-9760-2344fb930bfe tempest-MigrationsAdminTest-1101631867 tempest-MigrationsAdminTest-1101631867-project-admin] Returning 404 to user: Flavor 2016a852-14f5-4c8b-9c97-7c97aa0c71e6 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:38:48.545052 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-bf0e1bf8-f2f7-41f4-9760-2344fb930bfe tempest-MigrationsAdminTest-1101631867 tempest-MigrationsAdminTest-1101631867-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/2016a852-14f5-4c8b-9c97-7c97aa0c71e6" status: 404 len: 109 microversion: 2.1 time: 0.036023 Oct 04 18:38:48.547619 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1381/2690] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:38:48 2022] DELETE /compute/v2.1/flavors/2016a852-14f5-4c8b-9c97-7c97aa0c71e6 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:38:48.730265 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3d88481c-cb2b-4607-bc6c-accd7a53ee5f tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:48.731168 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3d88481c-cb2b-4607-bc6c-accd7a53ee5f tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 5965d934-6f27-43ac-bf15-8fd20da48cc1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:48.742350 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3d88481c-cb2b-4607-bc6c-accd7a53ee5f tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:48.742847 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3d88481c-cb2b-4607-bc6c-accd7a53ee5f tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:48.743287 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3d88481c-cb2b-4607-bc6c-accd7a53ee5f tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:48.744000 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3d88481c-cb2b-4607-bc6c-accd7a53ee5f tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:48.744514 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3d88481c-cb2b-4607-bc6c-accd7a53ee5f tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:48.745227 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3d88481c-cb2b-4607-bc6c-accd7a53ee5f tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:48.817451 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-500863b1-4b46-4fcf-98e2-8f9110a09788 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-590999307", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:48.981300 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-500863b1-4b46-4fcf-98e2-8f9110a09788 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] validate_networks() for None {{(pid=123002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:38:49.126999 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3d88481c-cb2b-4607-bc6c-accd7a53ee5f tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8284fe51decd4db0bf6b3ed1514cc2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87473abf47e74adf844e3ddfa24da3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:49.151636 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3d88481c-cb2b-4607-bc6c-accd7a53ee5f tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] 10.222.0.20 "GET /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1" status: 200 len: 1314 microversion: 2.1 time: 0.424255 Oct 04 18:38:49.156143 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1310/2691] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:48 2022] GET /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1 => generated 1314 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:49.294697 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-55d8c711-adbc-4bd8-8172-c0f948060be7 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:49.299260 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-55d8c711-adbc-4bd8-8172-c0f948060be7 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] [instance: b2fbbb75-1f0b-4095-8a22-df673b44686d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:49.311571 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-55d8c711-adbc-4bd8-8172-c0f948060be7 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:49.314619 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-55d8c711-adbc-4bd8-8172-c0f948060be7 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:49.316307 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-55d8c711-adbc-4bd8-8172-c0f948060be7 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:49.317572 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-55d8c711-adbc-4bd8-8172-c0f948060be7 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:49.322257 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-55d8c711-adbc-4bd8-8172-c0f948060be7 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:49.323990 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-55d8c711-adbc-4bd8-8172-c0f948060be7 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:49.485336 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-500863b1-4b46-4fcf-98e2-8f9110a09788 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:38:49.485863 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-500863b1-4b46-4fcf-98e2-8f9110a09788 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:38:49.487836 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-500863b1-4b46-4fcf-98e2-8f9110a09788 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:38:49.488582 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-500863b1-4b46-4fcf-98e2-8f9110a09788 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:38:49.490232 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-500863b1-4b46-4fcf-98e2-8f9110a09788 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:38:49.517378 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-500863b1-4b46-4fcf-98e2-8f9110a09788 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:49.524143 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-500863b1-4b46-4fcf-98e2-8f9110a09788 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:49.525872 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-500863b1-4b46-4fcf-98e2-8f9110a09788 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:49.527022 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-500863b1-4b46-4fcf-98e2-8f9110a09788 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:49.530620 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-500863b1-4b46-4fcf-98e2-8f9110a09788 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:49.531415 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-500863b1-4b46-4fcf-98e2-8f9110a09788 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:49.593718 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-500863b1-4b46-4fcf-98e2-8f9110a09788 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Getting quotas for project 552ab59dabe840cb8582c54bedc49b09. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:38:49.604928 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-500863b1-4b46-4fcf-98e2-8f9110a09788 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Getting quotas for user 9b05d1f8b9014e798926f9c496885a4d and project 552ab59dabe840cb8582c54bedc49b09. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:38:49.626190 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-500863b1-4b46-4fcf-98e2-8f9110a09788 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Going to run 1 instances... {{(pid=123002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:38:49.626749 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-55d8c711-adbc-4bd8-8172-c0f948060be7 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7d2e249cfc4feb92c8486a892b8b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e42e9f6c747493685a49d70d7061a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:49.629694 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-500863b1-4b46-4fcf-98e2-8f9110a09788 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2e308f41-242e-4ce3-8641-9510e2f13681] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:38:49.646534 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-55d8c711-adbc-4bd8-8172-c0f948060be7 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] 10.222.0.20 "GET /compute/v2.1/servers/b2fbbb75-1f0b-4095-8a22-df673b44686d" status: 200 len: 1312 microversion: 2.1 time: 0.361513 Oct 04 18:38:49.647876 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1311/2692] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:49 2022] GET /compute/v2.1/servers/b2fbbb75-1f0b-4095-8a22-df673b44686d => generated 1312 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:38:49.713410 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-7946bdf3-4c09-497d-b27f-7aca11c9540e req-a83fe369-1b81-45ce-a48a-16d68dc33fd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "474a799f-8e38-49d6-8fff-9ec3e7657ef5", "name": "network-vif-plugged", "status": "completed", "tag": "a0d7cb42-218d-4bf1-adab-5dbf22e8ab22"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:49.743786 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-7946bdf3-4c09-497d-b27f-7aca11c9540e req-a83fe369-1b81-45ce-a48a-16d68dc33fd9 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:49.744413 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-7946bdf3-4c09-497d-b27f-7aca11c9540e req-a83fe369-1b81-45ce-a48a-16d68dc33fd9 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:49.745273 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-7946bdf3-4c09-497d-b27f-7aca11c9540e req-a83fe369-1b81-45ce-a48a-16d68dc33fd9 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:49.763688 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-7946bdf3-4c09-497d-b27f-7aca11c9540e req-a83fe369-1b81-45ce-a48a-16d68dc33fd9 service nova] Creating event network-vif-plugged:a0d7cb42-218d-4bf1-adab-5dbf22e8ab22 for instance 474a799f-8e38-49d6-8fff-9ec3e7657ef5 on n-h2-850501-14 Oct 04 18:38:49.776762 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-7946bdf3-4c09-497d-b27f-7aca11c9540e req-a83fe369-1b81-45ce-a48a-16d68dc33fd9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069783 Oct 04 18:38:49.778571 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1312/2693] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:38:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:49.919484 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-500863b1-4b46-4fcf-98e2-8f9110a09788 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.108537 Oct 04 18:38:49.929751 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1382/2694] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:38:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1119 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 18:38:49.938120 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-74854fc9-2637-41d3-951c-62f4a303cac9 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:49.940711 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-74854fc9-2637-41d3-951c-62f4a303cac9 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2e308f41-242e-4ce3-8641-9510e2f13681] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:50.020859 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-74854fc9-2637-41d3-951c-62f4a303cac9 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:50.031330 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-74854fc9-2637-41d3-951c-62f4a303cac9 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681" status: 200 len: 1212 microversion: 2.1 time: 0.102206 Oct 04 18:38:50.032855 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1313/2695] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:49 2022] GET /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681 => generated 1212 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:50.079159 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f382ea29-9046-4068-92ce-aa76d699461b tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:50.079666 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f382ea29-9046-4068-92ce-aa76d699461b tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 158e9f52-fd16-48d1-87b5-e0dd523e97a4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:50.091394 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f382ea29-9046-4068-92ce-aa76d699461b tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:50.091896 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f382ea29-9046-4068-92ce-aa76d699461b tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:50.092363 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f382ea29-9046-4068-92ce-aa76d699461b tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:50.095729 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f382ea29-9046-4068-92ce-aa76d699461b tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:50.095729 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f382ea29-9046-4068-92ce-aa76d699461b tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:50.097116 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f382ea29-9046-4068-92ce-aa76d699461b tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:50.146721 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f382ea29-9046-4068-92ce-aa76d699461b tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 158e9f52-fd16-48d1-87b5-e0dd523e97a4] Going to try to terminate instance {{(pid=123002) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:38:50.187280 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-22366616-38a9-4fff-8968-00b79c63bb80 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:50.188462 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-22366616-38a9-4fff-8968-00b79c63bb80 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 5965d934-6f27-43ac-bf15-8fd20da48cc1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:50.221658 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-22366616-38a9-4fff-8968-00b79c63bb80 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:50.222163 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-22366616-38a9-4fff-8968-00b79c63bb80 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:50.222598 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-22366616-38a9-4fff-8968-00b79c63bb80 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:50.223311 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-22366616-38a9-4fff-8968-00b79c63bb80 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:50.223763 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-22366616-38a9-4fff-8968-00b79c63bb80 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:50.224229 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-22366616-38a9-4fff-8968-00b79c63bb80 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:50.517218 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f382ea29-9046-4068-92ce-aa76d699461b tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "DELETE /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4" status: 204 len: 0 microversion: 2.1 time: 0.439967 Oct 04 18:38:50.517980 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1383/2696] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:38:50 2022] DELETE /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:38:50.537524 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-fe8d60a4-0344-41be-bee8-157dd0e5f009 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:50.539138 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-fe8d60a4-0344-41be-bee8-157dd0e5f009 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 158e9f52-fd16-48d1-87b5-e0dd523e97a4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:50.554786 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fe8d60a4-0344-41be-bee8-157dd0e5f009 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:50.555284 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fe8d60a4-0344-41be-bee8-157dd0e5f009 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:50.557769 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fe8d60a4-0344-41be-bee8-157dd0e5f009 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:50.561003 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fe8d60a4-0344-41be-bee8-157dd0e5f009 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:50.561844 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fe8d60a4-0344-41be-bee8-157dd0e5f009 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:50.564295 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fe8d60a4-0344-41be-bee8-157dd0e5f009 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:50.608252 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-22366616-38a9-4fff-8968-00b79c63bb80 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8284fe51decd4db0bf6b3ed1514cc2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87473abf47e74adf844e3ddfa24da3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:50.619089 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-22366616-38a9-4fff-8968-00b79c63bb80 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] 10.222.0.20 "GET /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1" status: 200 len: 1499 microversion: 2.1 time: 0.437729 Oct 04 18:38:50.626480 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1314/2697] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:50 2022] GET /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1 => generated 1499 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:50.653117 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-aac56221-5c4d-4f62-86e0-48dbfee77b98 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:50.655688 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-aac56221-5c4d-4f62-86e0-48dbfee77b98 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 5965d934-6f27-43ac-bf15-8fd20da48cc1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:50.662338 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aac56221-5c4d-4f62-86e0-48dbfee77b98 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:50.662820 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aac56221-5c4d-4f62-86e0-48dbfee77b98 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:50.663702 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aac56221-5c4d-4f62-86e0-48dbfee77b98 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:50.664340 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aac56221-5c4d-4f62-86e0-48dbfee77b98 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:50.664953 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aac56221-5c4d-4f62-86e0-48dbfee77b98 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:50.665368 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aac56221-5c4d-4f62-86e0-48dbfee77b98 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:50.721331 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-aac56221-5c4d-4f62-86e0-48dbfee77b98 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lazy-loading 'flavor' on Instance uuid 5965d934-6f27-43ac-bf15-8fd20da48cc1 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:38:50.880296 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-fe8d60a4-0344-41be-bee8-157dd0e5f009 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:50.890734 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-fe8d60a4-0344-41be-bee8-157dd0e5f009 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4" status: 200 len: 1669 microversion: 2.1 time: 0.358835 Oct 04 18:38:50.892172 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1384/2698] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:50 2022] GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4 => generated 1669 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:38:50.897965 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2c87edaf-2f5c-4ec1-9dd0-24bfa6e228f9 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:50.898713 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2c87edaf-2f5c-4ec1-9dd0-24bfa6e228f9 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] [instance: b2fbbb75-1f0b-4095-8a22-df673b44686d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:50.906759 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2c87edaf-2f5c-4ec1-9dd0-24bfa6e228f9 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:50.907269 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2c87edaf-2f5c-4ec1-9dd0-24bfa6e228f9 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:50.907708 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2c87edaf-2f5c-4ec1-9dd0-24bfa6e228f9 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:50.908460 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2c87edaf-2f5c-4ec1-9dd0-24bfa6e228f9 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:50.908932 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2c87edaf-2f5c-4ec1-9dd0-24bfa6e228f9 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:50.909363 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2c87edaf-2f5c-4ec1-9dd0-24bfa6e228f9 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:51.085337 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2c87edaf-2f5c-4ec1-9dd0-24bfa6e228f9 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7d2e249cfc4feb92c8486a892b8b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e42e9f6c747493685a49d70d7061a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:51.094858 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2c87edaf-2f5c-4ec1-9dd0-24bfa6e228f9 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] 10.222.0.20 "GET /compute/v2.1/servers/b2fbbb75-1f0b-4095-8a22-df673b44686d" status: 200 len: 1312 microversion: 2.1 time: 0.201565 Oct 04 18:38:51.100136 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1385/2699] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:50 2022] GET /compute/v2.1/servers/b2fbbb75-1f0b-4095-8a22-df673b44686d => generated 1312 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:51.100298 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-72b74bd6-b688-428e-bddc-87433487d5ef tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:51.100858 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-72b74bd6-b688-428e-bddc-87433487d5ef tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2e308f41-242e-4ce3-8641-9510e2f13681] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:51.122087 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-aac56221-5c4d-4f62-86e0-48dbfee77b98 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] 10.222.0.20 "POST /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1/action" status: 200 len: 32 microversion: 2.1 time: 0.473993 Oct 04 18:38:51.123151 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1315/2700] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:38:50 2022] POST /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1/action => generated 32 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 18:38:51.133512 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-06fd2d07-7e8e-4499-951c-572a52235045 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:51.137546 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-06fd2d07-7e8e-4499-951c-572a52235045 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 5965d934-6f27-43ac-bf15-8fd20da48cc1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:51.148265 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-06fd2d07-7e8e-4499-951c-572a52235045 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:51.152267 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-06fd2d07-7e8e-4499-951c-572a52235045 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:51.156297 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-06fd2d07-7e8e-4499-951c-572a52235045 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:51.158360 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-06fd2d07-7e8e-4499-951c-572a52235045 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:51.160154 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-06fd2d07-7e8e-4499-951c-572a52235045 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:51.161534 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-06fd2d07-7e8e-4499-951c-572a52235045 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:51.181290 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-72b74bd6-b688-428e-bddc-87433487d5ef tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:51.187926 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-72b74bd6-b688-428e-bddc-87433487d5ef tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681" status: 200 len: 1212 microversion: 2.1 time: 0.091118 Oct 04 18:38:51.189860 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1386/2701] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:51 2022] GET /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681 => generated 1212 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:51.409747 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-06fd2d07-7e8e-4499-951c-572a52235045 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8284fe51decd4db0bf6b3ed1514cc2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87473abf47e74adf844e3ddfa24da3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:51.424177 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-06fd2d07-7e8e-4499-951c-572a52235045 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] 10.222.0.20 "GET /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1" status: 200 len: 1505 microversion: 2.1 time: 0.295146 Oct 04 18:38:51.425198 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1316/2702] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:51 2022] GET /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1 => generated 1505 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:51.919735 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-90e756eb-50d1-4e2c-96f6-d86070f79904 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:51.920916 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-90e756eb-50d1-4e2c-96f6-d86070f79904 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 158e9f52-fd16-48d1-87b5-e0dd523e97a4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:51.952809 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-90e756eb-50d1-4e2c-96f6-d86070f79904 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:51.959424 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-90e756eb-50d1-4e2c-96f6-d86070f79904 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:51.959942 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-90e756eb-50d1-4e2c-96f6-d86070f79904 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:51.960723 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-90e756eb-50d1-4e2c-96f6-d86070f79904 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:51.961192 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-90e756eb-50d1-4e2c-96f6-d86070f79904 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:51.961623 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-90e756eb-50d1-4e2c-96f6-d86070f79904 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:52.085056 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-b85bcaed-5138-48a3-8984-ebc387388cb4 req-5484cfdb-59ac-4480-958c-b45d40224a00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2fbbb75-1f0b-4095-8a22-df673b44686d", "name": "network-vif-plugged", "status": "completed", "tag": "12ae1f9b-1e01-4cbc-a20e-08d83f8483a6"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:52.111097 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-b85bcaed-5138-48a3-8984-ebc387388cb4 req-5484cfdb-59ac-4480-958c-b45d40224a00 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:52.111588 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-b85bcaed-5138-48a3-8984-ebc387388cb4 req-5484cfdb-59ac-4480-958c-b45d40224a00 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:52.113924 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-b85bcaed-5138-48a3-8984-ebc387388cb4 req-5484cfdb-59ac-4480-958c-b45d40224a00 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:52.135248 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-b85bcaed-5138-48a3-8984-ebc387388cb4 req-5484cfdb-59ac-4480-958c-b45d40224a00 service nova] Creating event network-vif-plugged:12ae1f9b-1e01-4cbc-a20e-08d83f8483a6 for instance b2fbbb75-1f0b-4095-8a22-df673b44686d on n-h2-850501-14 Oct 04 18:38:52.168661 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-b85bcaed-5138-48a3-8984-ebc387388cb4 req-5484cfdb-59ac-4480-958c-b45d40224a00 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090353 Oct 04 18:38:52.172132 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1317/2703] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:38:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:52.192206 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b83cbcb9-cad7-4743-8b49-9cbd2568b8c5 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:52.192206 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b83cbcb9-cad7-4743-8b49-9cbd2568b8c5 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] [instance: b2fbbb75-1f0b-4095-8a22-df673b44686d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:52.200400 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b83cbcb9-cad7-4743-8b49-9cbd2568b8c5 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:52.206131 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b83cbcb9-cad7-4743-8b49-9cbd2568b8c5 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:52.206926 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b83cbcb9-cad7-4743-8b49-9cbd2568b8c5 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:52.207950 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b83cbcb9-cad7-4743-8b49-9cbd2568b8c5 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:52.210796 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b83cbcb9-cad7-4743-8b49-9cbd2568b8c5 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:52.211558 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b83cbcb9-cad7-4743-8b49-9cbd2568b8c5 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:52.258483 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-90e756eb-50d1-4e2c-96f6-d86070f79904 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:52.276005 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-90e756eb-50d1-4e2c-96f6-d86070f79904 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4" status: 200 len: 1669 microversion: 2.1 time: 0.359486 Oct 04 18:38:52.280490 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1387/2704] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:51 2022] GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4 => generated 1669 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:52.285859 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4c8436fd-aff5-4c55-bd96-819bd2aa3071 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:52.286882 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4c8436fd-aff5-4c55-bd96-819bd2aa3071 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2e308f41-242e-4ce3-8641-9510e2f13681] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:52.310119 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4c8436fd-aff5-4c55-bd96-819bd2aa3071 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:52.314213 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4c8436fd-aff5-4c55-bd96-819bd2aa3071 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:52.315154 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4c8436fd-aff5-4c55-bd96-819bd2aa3071 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:52.316080 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4c8436fd-aff5-4c55-bd96-819bd2aa3071 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:52.324026 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4c8436fd-aff5-4c55-bd96-819bd2aa3071 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:52.325441 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4c8436fd-aff5-4c55-bd96-819bd2aa3071 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:52.543447 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4c8436fd-aff5-4c55-bd96-819bd2aa3071 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:52.563881 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4c8436fd-aff5-4c55-bd96-819bd2aa3071 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681" status: 200 len: 1264 microversion: 2.1 time: 0.281705 Oct 04 18:38:52.571993 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1388/2705] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:52 2022] GET /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681 => generated 1264 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:52.595679 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1625787e-a6a3-4eb4-a3dc-74c60d402400 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:52.601616 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1625787e-a6a3-4eb4-a3dc-74c60d402400 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 5965d934-6f27-43ac-bf15-8fd20da48cc1] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:52.615005 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1625787e-a6a3-4eb4-a3dc-74c60d402400 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:52.616019 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1625787e-a6a3-4eb4-a3dc-74c60d402400 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:52.616641 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1625787e-a6a3-4eb4-a3dc-74c60d402400 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:52.618712 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1625787e-a6a3-4eb4-a3dc-74c60d402400 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:52.623008 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1625787e-a6a3-4eb4-a3dc-74c60d402400 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:52.624350 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1625787e-a6a3-4eb4-a3dc-74c60d402400 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:52.656234 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b83cbcb9-cad7-4743-8b49-9cbd2568b8c5 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7d2e249cfc4feb92c8486a892b8b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e42e9f6c747493685a49d70d7061a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:52.666749 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b83cbcb9-cad7-4743-8b49-9cbd2568b8c5 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] 10.222.0.20 "GET /compute/v2.1/servers/b2fbbb75-1f0b-4095-8a22-df673b44686d" status: 200 len: 1312 microversion: 2.1 time: 0.493004 Oct 04 18:38:52.670775 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1318/2706] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:52 2022] GET /compute/v2.1/servers/b2fbbb75-1f0b-4095-8a22-df673b44686d => generated 1312 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:52.832565 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1625787e-a6a3-4eb4-a3dc-74c60d402400 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8284fe51decd4db0bf6b3ed1514cc2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87473abf47e74adf844e3ddfa24da3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:52.842621 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1625787e-a6a3-4eb4-a3dc-74c60d402400 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] 10.222.0.20 "GET /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1" status: 200 len: 1505 microversion: 2.1 time: 0.257658 Oct 04 18:38:52.852112 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1389/2707] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:52 2022] GET /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1 => generated 1505 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:53.311015 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2956cbd3-eade-44ca-8436-7ebc11c693c7 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:53.311950 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2956cbd3-eade-44ca-8436-7ebc11c693c7 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 158e9f52-fd16-48d1-87b5-e0dd523e97a4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:53.327327 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2956cbd3-eade-44ca-8436-7ebc11c693c7 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:53.332186 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2956cbd3-eade-44ca-8436-7ebc11c693c7 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:53.332186 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2956cbd3-eade-44ca-8436-7ebc11c693c7 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:53.332186 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2956cbd3-eade-44ca-8436-7ebc11c693c7 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:53.332186 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2956cbd3-eade-44ca-8436-7ebc11c693c7 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:53.332186 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2956cbd3-eade-44ca-8436-7ebc11c693c7 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:53.421620 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-2956cbd3-eade-44ca-8436-7ebc11c693c7 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:53.429555 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2956cbd3-eade-44ca-8436-7ebc11c693c7 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4" status: 200 len: 1602 microversion: 2.1 time: 0.125327 Oct 04 18:38:53.447334 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1319/2708] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:53 2022] GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4 => generated 1602 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:53.603300 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7ded7052-3e2e-47de-9fb0-c999cf77fa54 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:53.607042 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7ded7052-3e2e-47de-9fb0-c999cf77fa54 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2e308f41-242e-4ce3-8641-9510e2f13681] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:53.633137 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7ded7052-3e2e-47de-9fb0-c999cf77fa54 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:53.635077 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7ded7052-3e2e-47de-9fb0-c999cf77fa54 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:53.637190 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7ded7052-3e2e-47de-9fb0-c999cf77fa54 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:53.638732 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7ded7052-3e2e-47de-9fb0-c999cf77fa54 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:53.640586 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7ded7052-3e2e-47de-9fb0-c999cf77fa54 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:53.641846 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7ded7052-3e2e-47de-9fb0-c999cf77fa54 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:53.679992 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-8c637e52-9430-4ef7-842f-fb0de8c6de27 req-cd40c4f9-bbc1-4903-a459-4371ffb1fbfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "158e9f52-fd16-48d1-87b5-e0dd523e97a4", "name": "network-vif-deleted", "tag": "339801ef-bddd-45f8-802a-ec8d2e0687e7"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:53.710865 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-8c637e52-9430-4ef7-842f-fb0de8c6de27 req-cd40c4f9-bbc1-4903-a459-4371ffb1fbfc service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:53.713160 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-8c637e52-9430-4ef7-842f-fb0de8c6de27 req-cd40c4f9-bbc1-4903-a459-4371ffb1fbfc service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:53.714604 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-8c637e52-9430-4ef7-842f-fb0de8c6de27 req-cd40c4f9-bbc1-4903-a459-4371ffb1fbfc service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:53.752986 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-8c637e52-9430-4ef7-842f-fb0de8c6de27 req-cd40c4f9-bbc1-4903-a459-4371ffb1fbfc service nova] Creating event network-vif-deleted:339801ef-bddd-45f8-802a-ec8d2e0687e7 for instance 158e9f52-fd16-48d1-87b5-e0dd523e97a4 on n-h2-850501-14 Oct 04 18:38:53.787774 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-8c637e52-9430-4ef7-842f-fb0de8c6de27 req-cd40c4f9-bbc1-4903-a459-4371ffb1fbfc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111705 Oct 04 18:38:53.794393 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1320/2709] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:38:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:53.812141 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-bf6aba40-d872-48ba-b048-b40bf205a1d1 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:53.817528 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-bf6aba40-d872-48ba-b048-b40bf205a1d1 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] [instance: b2fbbb75-1f0b-4095-8a22-df673b44686d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:53.834988 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bf6aba40-d872-48ba-b048-b40bf205a1d1 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:53.837138 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bf6aba40-d872-48ba-b048-b40bf205a1d1 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:53.841993 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bf6aba40-d872-48ba-b048-b40bf205a1d1 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:53.843094 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bf6aba40-d872-48ba-b048-b40bf205a1d1 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:53.843883 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bf6aba40-d872-48ba-b048-b40bf205a1d1 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:53.845528 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bf6aba40-d872-48ba-b048-b40bf205a1d1 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:53.888861 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7ded7052-3e2e-47de-9fb0-c999cf77fa54 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:53.897815 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7ded7052-3e2e-47de-9fb0-c999cf77fa54 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681" status: 200 len: 1270 microversion: 2.1 time: 0.298930 Oct 04 18:38:53.903780 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1390/2710] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:53 2022] GET /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681 => generated 1270 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:53.917746 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b315f4df-4faa-4bef-a259-ba85ed4ec0f1 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:53.923327 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b315f4df-4faa-4bef-a259-ba85ed4ec0f1 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 5965d934-6f27-43ac-bf15-8fd20da48cc1] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:53.939017 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b315f4df-4faa-4bef-a259-ba85ed4ec0f1 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:53.941996 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b315f4df-4faa-4bef-a259-ba85ed4ec0f1 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:53.944158 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b315f4df-4faa-4bef-a259-ba85ed4ec0f1 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:53.944158 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b315f4df-4faa-4bef-a259-ba85ed4ec0f1 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:53.946805 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b315f4df-4faa-4bef-a259-ba85ed4ec0f1 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:53.947524 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b315f4df-4faa-4bef-a259-ba85ed4ec0f1 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:54.222820 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b315f4df-4faa-4bef-a259-ba85ed4ec0f1 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8284fe51decd4db0bf6b3ed1514cc2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87473abf47e74adf844e3ddfa24da3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:54.228638 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:38:54.239948 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b315f4df-4faa-4bef-a259-ba85ed4ec0f1 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] 10.222.0.20 "GET /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1" status: 200 len: 1505 microversion: 2.1 time: 0.333488 Oct 04 18:38:54.246238 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1391/2711] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:53 2022] GET /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1 => generated 1505 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:54.280775 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-bf6aba40-d872-48ba-b048-b40bf205a1d1 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7d2e249cfc4feb92c8486a892b8b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e42e9f6c747493685a49d70d7061a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:54.283145 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:38:54.293688 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-bf6aba40-d872-48ba-b048-b40bf205a1d1 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] 10.222.0.20 "GET /compute/v2.1/servers/b2fbbb75-1f0b-4095-8a22-df673b44686d" status: 200 len: 1312 microversion: 2.1 time: 0.497746 Oct 04 18:38:54.294315 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1321/2712] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:53 2022] GET /compute/v2.1/servers/b2fbbb75-1f0b-4095-8a22-df673b44686d => generated 1312 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:54.419822 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7566ba28-f649-4400-9b62-d5b13776011b tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1854021767", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:54.455006 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3e126c99-4ff1-4a08-9cba-18e2f5176da9 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:54.456029 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3e126c99-4ff1-4a08-9cba-18e2f5176da9 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 158e9f52-fd16-48d1-87b5-e0dd523e97a4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:54.477098 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3e126c99-4ff1-4a08-9cba-18e2f5176da9 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:54.477992 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3e126c99-4ff1-4a08-9cba-18e2f5176da9 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:54.478686 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3e126c99-4ff1-4a08-9cba-18e2f5176da9 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:54.492001 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3e126c99-4ff1-4a08-9cba-18e2f5176da9 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:54.495038 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3e126c99-4ff1-4a08-9cba-18e2f5176da9 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:54.497782 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3e126c99-4ff1-4a08-9cba-18e2f5176da9 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:54.535911 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-7566ba28-f649-4400-9b62-d5b13776011b tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] validate_networks() for None {{(pid=123002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:38:54.678406 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3e126c99-4ff1-4a08-9cba-18e2f5176da9 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:54.681868 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3e126c99-4ff1-4a08-9cba-18e2f5176da9 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:54.685591 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3e126c99-4ff1-4a08-9cba-18e2f5176da9 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:54.686256 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-3e126c99-4ff1-4a08-9cba-18e2f5176da9 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lazy-loading 'fault' on Instance uuid 158e9f52-fd16-48d1-87b5-e0dd523e97a4 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:38:54.935947 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3e126c99-4ff1-4a08-9cba-18e2f5176da9 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:54.951149 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3e126c99-4ff1-4a08-9cba-18e2f5176da9 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4" status: 200 len: 1325 microversion: 2.1 time: 0.497802 Oct 04 18:38:54.965008 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1322/2713] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:54 2022] GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4 => generated 1325 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:54.976736 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-bf9bb1ae-4d40-4b79-a877-3ed43a51b12f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:54.977921 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-bf9bb1ae-4d40-4b79-a877-3ed43a51b12f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2e308f41-242e-4ce3-8641-9510e2f13681] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:54.983809 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bf9bb1ae-4d40-4b79-a877-3ed43a51b12f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:54.984516 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bf9bb1ae-4d40-4b79-a877-3ed43a51b12f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:54.985181 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bf9bb1ae-4d40-4b79-a877-3ed43a51b12f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:54.985904 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bf9bb1ae-4d40-4b79-a877-3ed43a51b12f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:54.986367 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bf9bb1ae-4d40-4b79-a877-3ed43a51b12f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:54.986796 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bf9bb1ae-4d40-4b79-a877-3ed43a51b12f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:55.141700 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-7566ba28-f649-4400-9b62-d5b13776011b tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:38:55.142864 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-7566ba28-f649-4400-9b62-d5b13776011b tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:38:55.144282 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-7566ba28-f649-4400-9b62-d5b13776011b tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:38:55.144943 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-7566ba28-f649-4400-9b62-d5b13776011b tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:38:55.145572 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-7566ba28-f649-4400-9b62-d5b13776011b tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:38:55.161535 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7566ba28-f649-4400-9b62-d5b13776011b tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:55.162395 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7566ba28-f649-4400-9b62-d5b13776011b tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:55.163756 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7566ba28-f649-4400-9b62-d5b13776011b tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:55.164870 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7566ba28-f649-4400-9b62-d5b13776011b tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:55.165547 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7566ba28-f649-4400-9b62-d5b13776011b tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:55.165986 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7566ba28-f649-4400-9b62-d5b13776011b tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:55.186385 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-7566ba28-f649-4400-9b62-d5b13776011b tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Getting quotas for project 1b922a74c1c2448bb770d6b298b2d601. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:38:55.192753 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-7566ba28-f649-4400-9b62-d5b13776011b tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Getting quotas for user f8358c07e2684b749a62becb9f0b7869 and project 1b922a74c1c2448bb770d6b298b2d601. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:38:55.206942 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7566ba28-f649-4400-9b62-d5b13776011b tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Going to run 1 instances... {{(pid=123002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:38:55.209385 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7566ba28-f649-4400-9b62-d5b13776011b tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: c343931b-bc96-4e9e-a5ce-f93454339a53] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:38:55.237121 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-bf9bb1ae-4d40-4b79-a877-3ed43a51b12f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:55.246394 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-bf9bb1ae-4d40-4b79-a877-3ed43a51b12f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681" status: 200 len: 1312 microversion: 2.1 time: 0.274723 Oct 04 18:38:55.247253 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1323/2714] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:54 2022] GET /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681 => generated 1312 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:55.278642 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a64a9620-0569-46e1-a681-57b7b50cd377 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:55.279273 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a64a9620-0569-46e1-a681-57b7b50cd377 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 5965d934-6f27-43ac-bf15-8fd20da48cc1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:55.285663 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a64a9620-0569-46e1-a681-57b7b50cd377 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:55.286161 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a64a9620-0569-46e1-a681-57b7b50cd377 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:55.286604 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a64a9620-0569-46e1-a681-57b7b50cd377 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:55.287470 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a64a9620-0569-46e1-a681-57b7b50cd377 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:55.288156 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a64a9620-0569-46e1-a681-57b7b50cd377 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:55.289067 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a64a9620-0569-46e1-a681-57b7b50cd377 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:55.450506 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a64a9620-0569-46e1-a681-57b7b50cd377 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8284fe51decd4db0bf6b3ed1514cc2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87473abf47e74adf844e3ddfa24da3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:55.459105 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a64a9620-0569-46e1-a681-57b7b50cd377 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] 10.222.0.20 "GET /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1" status: 200 len: 1505 microversion: 2.1 time: 0.185182 Oct 04 18:38:55.463002 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1324/2715] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:55 2022] GET /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1 => generated 1505 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:38:55.466040 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7046ddb6-5230-499e-936e-a3dcd2f02165 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:55.466672 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7046ddb6-5230-499e-936e-a3dcd2f02165 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] [instance: b2fbbb75-1f0b-4095-8a22-df673b44686d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:55.472687 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7046ddb6-5230-499e-936e-a3dcd2f02165 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:55.473179 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7046ddb6-5230-499e-936e-a3dcd2f02165 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:55.473620 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7046ddb6-5230-499e-936e-a3dcd2f02165 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:55.474317 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7046ddb6-5230-499e-936e-a3dcd2f02165 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:55.475093 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7046ddb6-5230-499e-936e-a3dcd2f02165 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:55.475527 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7046ddb6-5230-499e-936e-a3dcd2f02165 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:55.548500 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7566ba28-f649-4400-9b62-d5b13776011b tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.300324 Oct 04 18:38:55.570987 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1392/2716] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:38:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1320 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:38:55.647366 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-153025dd-e9c4-41ef-8c8a-26a97fbe2ab0 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-702589654", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:55.749559 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7046ddb6-5230-499e-936e-a3dcd2f02165 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7d2e249cfc4feb92c8486a892b8b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e42e9f6c747493685a49d70d7061a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:55.758554 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7046ddb6-5230-499e-936e-a3dcd2f02165 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] 10.222.0.20 "GET /compute/v2.1/servers/b2fbbb75-1f0b-4095-8a22-df673b44686d" status: 200 len: 1496 microversion: 2.1 time: 0.297790 Oct 04 18:38:55.782531 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-153025dd-e9c4-41ef-8c8a-26a97fbe2ab0 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] validate_networks() for None {{(pid=123002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:38:55.783201 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1325/2717] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:55 2022] GET /compute/v2.1/servers/b2fbbb75-1f0b-4095-8a22-df673b44686d => generated 1496 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:55.798708 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-728b883c-4886-4167-99ee-a5ee7e396971 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:55.835883 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.compute.server_groups [None req-728b883c-4886-4167-99ee-a5ee7e396971 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Querying cell a6039a6d-a98c-44a9-819b-4eff388d8aa7(cell1) for 1 instances {{(pid=123001) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 04 18:38:55.837275 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-728b883c-4886-4167-99ee-a5ee7e396971 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:55.838135 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-728b883c-4886-4167-99ee-a5ee7e396971 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:55.838760 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-728b883c-4886-4167-99ee-a5ee7e396971 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:55.878049 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-728b883c-4886-4167-99ee-a5ee7e396971 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups/566c9cd3-5a33-4703-b552-fa6d89d554f7" status: 200 len: 222 microversion: 2.1 time: 0.092541 Oct 04 18:38:55.879625 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1326/2718] 10.222.0.20 () {58 vars in 1263 bytes} [Tue Oct 4 18:38:55 2022] GET /compute/v2.1/os-server-groups/566c9cd3-5a33-4703-b552-fa6d89d554f7 => generated 222 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:55.892840 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e7722a45-a662-4b39-9e55-47b83e3b947a tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:55.893266 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e7722a45-a662-4b39-9e55-47b83e3b947a tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] [instance: b2fbbb75-1f0b-4095-8a22-df673b44686d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:55.920992 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e7722a45-a662-4b39-9e55-47b83e3b947a tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:55.920992 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e7722a45-a662-4b39-9e55-47b83e3b947a tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:55.920992 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e7722a45-a662-4b39-9e55-47b83e3b947a tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:55.920992 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e7722a45-a662-4b39-9e55-47b83e3b947a tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:55.920992 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e7722a45-a662-4b39-9e55-47b83e3b947a tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:55.920992 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e7722a45-a662-4b39-9e55-47b83e3b947a tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:55.983051 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e7722a45-a662-4b39-9e55-47b83e3b947a tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] [instance: b2fbbb75-1f0b-4095-8a22-df673b44686d] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:38:56.190262 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-153025dd-e9c4-41ef-8c8a-26a97fbe2ab0 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:38:56.190884 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-153025dd-e9c4-41ef-8c8a-26a97fbe2ab0 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:38:56.191172 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-153025dd-e9c4-41ef-8c8a-26a97fbe2ab0 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:38:56.191588 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-153025dd-e9c4-41ef-8c8a-26a97fbe2ab0 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:38:56.192119 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-153025dd-e9c4-41ef-8c8a-26a97fbe2ab0 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:38:56.205179 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-153025dd-e9c4-41ef-8c8a-26a97fbe2ab0 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:56.208002 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-153025dd-e9c4-41ef-8c8a-26a97fbe2ab0 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:56.208002 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-153025dd-e9c4-41ef-8c8a-26a97fbe2ab0 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:56.208405 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-153025dd-e9c4-41ef-8c8a-26a97fbe2ab0 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:56.211004 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-153025dd-e9c4-41ef-8c8a-26a97fbe2ab0 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:56.211861 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-153025dd-e9c4-41ef-8c8a-26a97fbe2ab0 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:56.245005 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-153025dd-e9c4-41ef-8c8a-26a97fbe2ab0 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Getting quotas for project 1b922a74c1c2448bb770d6b298b2d601. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:38:56.250584 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-153025dd-e9c4-41ef-8c8a-26a97fbe2ab0 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Getting quotas for user f8358c07e2684b749a62becb9f0b7869 and project 1b922a74c1c2448bb770d6b298b2d601. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:38:56.273135 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-153025dd-e9c4-41ef-8c8a-26a97fbe2ab0 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Going to run 1 instances... {{(pid=123002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:38:56.276923 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-153025dd-e9c4-41ef-8c8a-26a97fbe2ab0 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: b4ccd5ac-9465-43d8-9a5f-127152966ce8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:38:56.346363 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e7722a45-a662-4b39-9e55-47b83e3b947a tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b2fbbb75-1f0b-4095-8a22-df673b44686d" status: 204 len: 0 microversion: 2.1 time: 0.458269 Oct 04 18:38:56.348239 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1327/2719] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:38:55 2022] DELETE /compute/v2.1/servers/b2fbbb75-1f0b-4095-8a22-df673b44686d => generated 0 bytes in 462 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:38:56.356637 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-da6d2663-a36c-4fb4-80cb-7153aa0029f8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:56.357728 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-da6d2663-a36c-4fb4-80cb-7153aa0029f8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 158e9f52-fd16-48d1-87b5-e0dd523e97a4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:56.364166 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-da6d2663-a36c-4fb4-80cb-7153aa0029f8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:56.364756 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-da6d2663-a36c-4fb4-80cb-7153aa0029f8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:56.365265 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-da6d2663-a36c-4fb4-80cb-7153aa0029f8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:56.366068 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-da6d2663-a36c-4fb4-80cb-7153aa0029f8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:56.366526 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-da6d2663-a36c-4fb4-80cb-7153aa0029f8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:56.367028 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-da6d2663-a36c-4fb4-80cb-7153aa0029f8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:56.382094 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-da6d2663-a36c-4fb4-80cb-7153aa0029f8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] HTTP exception thrown: Instance 158e9f52-fd16-48d1-87b5-e0dd523e97a4 could not be found. Oct 04 18:38:56.383920 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-da6d2663-a36c-4fb4-80cb-7153aa0029f8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Request method failure captured: Oct 04 18:38:56.383920 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4 HTTP/1.1 Oct 04 18:38:56.383920 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:38:56.383920 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:38:56.383920 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:38:56.383920 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:38:56.383920 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:38:56.383920 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:38:56.383920 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:38:56.383920 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:38:56.383920 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPHulPRClkzd6kBQ81rrBhumMq88AYIanAk2xdeHK5U7wVgRC25-TXMgOlEBZg6WJpOKuV9BZwqY7S9UVeacMmO6BXdoABSwoaanCO5yf8qjOFgEjgLyJbKDRoktuo-EczFm_S4RGYEsRlB3A3Vi9-kDkYqoEQcS34joufFbsOIKcLTo Oct 04 18:38:56.383920 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:38:56.383920 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:38:56.383920 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:38:56.383920 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:38:56.383920 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:38:56.383920 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:38:56.383920 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: dde62f171d474b038f1af39899518211 Oct 04 18:38:56.383920 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-LiveMigrationTest-1583731626 Oct 04 18:38:56.383920 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:38:56.383920 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:38:56.383920 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dde62f171d474b038f1af39899518211"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dde62f171d474b038f1af39899518211", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dde62f171d474b038f1af39899518211"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dde62f171d474b038f1af39899518211"}]}] Oct 04 18:38:56.383920 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-LiveMigrationTest-1583731626 Oct 04 18:38:56.383920 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: dde62f171d474b038f1af39899518211 Oct 04 18:38:56.383920 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-LiveMigrationTest-1583731626 Oct 04 18:38:56.383920 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-LiveMigrationTest-1583731626-project Oct 04 18:38:56.383920 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:38:56.383920 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:38:56.383920 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: c80f2b2dbf824a1d879f5b7edb343f26 Oct 04 18:38:56.383920 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-LiveMigrationTest-1583731626-project Oct 04 18:38:56.383920 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:38:56.383920 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 158e9f52-fd16-48d1-87b5-e0dd523e97a4 could not be found. Oct 04 18:38:56.383920 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '158e9f52-fd16-48d1-87b5-e0dd523e97a4'} Oct 04 18:38:56.383920 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:38:56.383920 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:38:56.383920 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:38:56.383920 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:38:56.383920 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:38:56.383920 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:38:56.383920 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:38:56.383920 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:38:56.383920 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:38:56.383920 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:38:56.383920 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 158e9f52-fd16-48d1-87b5-e0dd523e97a4 could not be found. Oct 04 18:38:56.383920 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:38:56.383920 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:38:56.383920 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:38:56.383920 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:38:56.383920 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:38:56.383920 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:38:56.383920 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:38:56.383920 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:38:56.383920 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:38:56.383920 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:38:56.383920 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:38:56.383920 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:38:56.383920 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:38:56.383920 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:38:56.383920 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:38:56.383920 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:38:56.383920 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 158e9f52-fd16-48d1-87b5-e0dd523e97a4 could not be found. Oct 04 18:38:56.383920 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:38:56.383920 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:38:56.383920 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:38:56.392614 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:38:56.392614 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:38:56.392614 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:38:56.392614 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:38:56.392614 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:38:56.392614 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 158e9f52-fd16-48d1-87b5-e0dd523e97a4 could not be found. Oct 04 18:38:56.392614 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:38:56.392614 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-da6d2663-a36c-4fb4-80cb-7153aa0029f8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Returning 404 to user: Instance 158e9f52-fd16-48d1-87b5-e0dd523e97a4 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:38:56.392614 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-da6d2663-a36c-4fb4-80cb-7153aa0029f8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4" status: 404 len: 111 microversion: 2.1 time: 0.035784 Oct 04 18:38:56.392614 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1328/2720] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:56 2022] GET /compute/v2.1/servers/158e9f52-fd16-48d1-87b5-e0dd523e97a4 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:38:56.392614 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d335ff39-4f96-4c00-9fd9-4e121b7018f3 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:56.392614 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d335ff39-4f96-4c00-9fd9-4e121b7018f3 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2e308f41-242e-4ce3-8641-9510e2f13681] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:56.397845 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d335ff39-4f96-4c00-9fd9-4e121b7018f3 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:56.398355 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d335ff39-4f96-4c00-9fd9-4e121b7018f3 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:56.398799 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d335ff39-4f96-4c00-9fd9-4e121b7018f3 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:56.399492 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d335ff39-4f96-4c00-9fd9-4e121b7018f3 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:56.399953 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d335ff39-4f96-4c00-9fd9-4e121b7018f3 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:56.400416 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d335ff39-4f96-4c00-9fd9-4e121b7018f3 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:56.471687 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-153025dd-e9c4-41ef-8c8a-26a97fbe2ab0 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.828703 Oct 04 18:38:56.481040 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1393/2721] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:38:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 839 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:38:56.490686 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-82b7eac8-01ed-41d6-8622-16b388def317 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:56.492231 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-82b7eac8-01ed-41d6-8622-16b388def317 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] [instance: b2fbbb75-1f0b-4095-8a22-df673b44686d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:56.509737 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-82b7eac8-01ed-41d6-8622-16b388def317 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:56.510852 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-82b7eac8-01ed-41d6-8622-16b388def317 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:56.513858 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-82b7eac8-01ed-41d6-8622-16b388def317 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:56.513858 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-82b7eac8-01ed-41d6-8622-16b388def317 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:56.513858 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-82b7eac8-01ed-41d6-8622-16b388def317 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:56.514324 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-82b7eac8-01ed-41d6-8622-16b388def317 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:56.636816 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d335ff39-4f96-4c00-9fd9-4e121b7018f3 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:56.652469 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d335ff39-4f96-4c00-9fd9-4e121b7018f3 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681" status: 200 len: 1312 microversion: 2.1 time: 0.264409 Oct 04 18:38:56.656073 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1329/2722] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:56 2022] GET /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681 => generated 1312 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:56.674088 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a3e8fea8-bf4b-471f-b8f1-13a8c7c8fd91 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '.version_select at 0x7fe258cd0790>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:56.786407 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a3e8fea8-bf4b-471f-b8f1-13a8c7c8fd91 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1788764597" status: 202 len: 0 microversion: 2.1 time: 0.124877 Oct 04 18:38:56.792413 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1330/2723] 10.222.0.20 () {58 vars in 1221 bytes} [Tue Oct 4 18:38:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1788764597 => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:38:56.799718 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-68a5c5f6-52df-4ff5-95e1-a22c0c4d19a9 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:56.800478 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-68a5c5f6-52df-4ff5-95e1-a22c0c4d19a9 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: b4ccd5ac-9465-43d8-9a5f-127152966ce8] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:56.840040 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:38:56.877599 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-82b7eac8-01ed-41d6-8622-16b388def317 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7d2e249cfc4feb92c8486a892b8b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e42e9f6c747493685a49d70d7061a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:56.896001 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-82b7eac8-01ed-41d6-8622-16b388def317 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] 10.222.0.20 "GET /compute/v2.1/servers/b2fbbb75-1f0b-4095-8a22-df673b44686d" status: 200 len: 1502 microversion: 2.1 time: 0.413403 Oct 04 18:38:56.908241 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1394/2724] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:56 2022] GET /compute/v2.1/servers/b2fbbb75-1f0b-4095-8a22-df673b44686d => generated 1502 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:56.921318 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-968dc38a-1adf-48fa-b31d-029632309563 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:56.922532 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-968dc38a-1adf-48fa-b31d-029632309563 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 5965d934-6f27-43ac-bf15-8fd20da48cc1] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:56.937248 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-968dc38a-1adf-48fa-b31d-029632309563 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:56.937248 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-968dc38a-1adf-48fa-b31d-029632309563 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:56.937248 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-968dc38a-1adf-48fa-b31d-029632309563 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:56.937588 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-68a5c5f6-52df-4ff5-95e1-a22c0c4d19a9 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8358c07e2684b749a62becb9f0b7869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b922a74c1c2448bb770d6b298b2d601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:56.937701 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-968dc38a-1adf-48fa-b31d-029632309563 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:56.937701 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-968dc38a-1adf-48fa-b31d-029632309563 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:56.937701 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-968dc38a-1adf-48fa-b31d-029632309563 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:56.947328 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-68a5c5f6-52df-4ff5-95e1-a22c0c4d19a9 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "GET /compute/v2.1/servers/b4ccd5ac-9465-43d8-9a5f-127152966ce8" status: 200 len: 1213 microversion: 2.1 time: 0.153726 Oct 04 18:38:56.950309 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1331/2725] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:56 2022] GET /compute/v2.1/servers/b4ccd5ac-9465-43d8-9a5f-127152966ce8 => generated 1213 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:57.174202 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-968dc38a-1adf-48fa-b31d-029632309563 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8284fe51decd4db0bf6b3ed1514cc2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87473abf47e74adf844e3ddfa24da3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:57.182392 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-968dc38a-1adf-48fa-b31d-029632309563 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] 10.222.0.20 "GET /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1" status: 200 len: 1505 microversion: 2.1 time: 0.276353 Oct 04 18:38:57.182969 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1395/2726] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:56 2022] GET /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1 => generated 1505 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:57.262530 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-5dadb4de-5538-40cd-a185-2acdfa442967 req-c4183a98-945a-48d5-aa6b-364ceaed99cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e308f41-242e-4ce3-8641-9510e2f13681", "tag": "192de35c-060d-4a11-8df5-09c24dfcc8d0"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:57.287304 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-5dadb4de-5538-40cd-a185-2acdfa442967 req-c4183a98-945a-48d5-aa6b-364ceaed99cf service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:57.289244 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-5dadb4de-5538-40cd-a185-2acdfa442967 req-c4183a98-945a-48d5-aa6b-364ceaed99cf service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:57.289771 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-5dadb4de-5538-40cd-a185-2acdfa442967 req-c4183a98-945a-48d5-aa6b-364ceaed99cf service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:57.305684 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-5dadb4de-5538-40cd-a185-2acdfa442967 req-c4183a98-945a-48d5-aa6b-364ceaed99cf service nova] Creating event network-changed:192de35c-060d-4a11-8df5-09c24dfcc8d0 for instance 2e308f41-242e-4ce3-8641-9510e2f13681 on n-h1-850501-14 Oct 04 18:38:57.313214 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-5dadb4de-5538-40cd-a185-2acdfa442967 req-c4183a98-945a-48d5-aa6b-364ceaed99cf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062952 Oct 04 18:38:57.314508 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1332/2727] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:38:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:57.689965 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e89d77c4-08f9-4e4d-9993-ce901b38d090 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:57.694398 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e89d77c4-08f9-4e4d-9993-ce901b38d090 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2e308f41-242e-4ce3-8641-9510e2f13681] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:57.732071 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e89d77c4-08f9-4e4d-9993-ce901b38d090 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:57.732638 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e89d77c4-08f9-4e4d-9993-ce901b38d090 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:57.738374 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e89d77c4-08f9-4e4d-9993-ce901b38d090 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:57.738374 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e89d77c4-08f9-4e4d-9993-ce901b38d090 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:57.738374 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e89d77c4-08f9-4e4d-9993-ce901b38d090 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:57.738374 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e89d77c4-08f9-4e4d-9993-ce901b38d090 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:57.927918 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1eb606fc-6db0-4f73-a3b2-bcb9899763f3 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:57.929357 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1eb606fc-6db0-4f73-a3b2-bcb9899763f3 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] [instance: b2fbbb75-1f0b-4095-8a22-df673b44686d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:57.945416 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1eb606fc-6db0-4f73-a3b2-bcb9899763f3 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:57.945937 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1eb606fc-6db0-4f73-a3b2-bcb9899763f3 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:57.946488 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1eb606fc-6db0-4f73-a3b2-bcb9899763f3 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:57.947269 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1eb606fc-6db0-4f73-a3b2-bcb9899763f3 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:57.951076 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1eb606fc-6db0-4f73-a3b2-bcb9899763f3 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:57.951924 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1eb606fc-6db0-4f73-a3b2-bcb9899763f3 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:57.968981 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e89d77c4-08f9-4e4d-9993-ce901b38d090 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:57.977647 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e89d77c4-08f9-4e4d-9993-ce901b38d090 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681" status: 200 len: 1312 microversion: 2.1 time: 0.299823 Oct 04 18:38:57.978812 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1396/2728] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:57 2022] GET /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681 => generated 1312 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:57.984388 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a330c484-1e62-4568-b72c-ec72187ad536 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:57.984975 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a330c484-1e62-4568-b72c-ec72187ad536 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 4e1bb5af-9b8b-456f-beb1-aadf2491a8ed] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:57.991304 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a330c484-1e62-4568-b72c-ec72187ad536 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:57.993381 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a330c484-1e62-4568-b72c-ec72187ad536 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:57.993381 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a330c484-1e62-4568-b72c-ec72187ad536 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:57.993381 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a330c484-1e62-4568-b72c-ec72187ad536 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:57.993947 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a330c484-1e62-4568-b72c-ec72187ad536 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:57.994753 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a330c484-1e62-4568-b72c-ec72187ad536 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:58.044008 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a330c484-1e62-4568-b72c-ec72187ad536 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 4e1bb5af-9b8b-456f-beb1-aadf2491a8ed] Going to try to terminate instance {{(pid=123002) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:38:58.128249 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1eb606fc-6db0-4f73-a3b2-bcb9899763f3 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7d2e249cfc4feb92c8486a892b8b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e42e9f6c747493685a49d70d7061a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:58.136214 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1eb606fc-6db0-4f73-a3b2-bcb9899763f3 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] 10.222.0.20 "GET /compute/v2.1/servers/b2fbbb75-1f0b-4095-8a22-df673b44686d" status: 200 len: 1502 microversion: 2.1 time: 0.213377 Oct 04 18:38:58.137015 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1333/2729] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:57 2022] GET /compute/v2.1/servers/b2fbbb75-1f0b-4095-8a22-df673b44686d => generated 1502 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:58.141658 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-de845568-4bed-4f0a-9cc6-6ceddde68d58 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:58.142268 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-de845568-4bed-4f0a-9cc6-6ceddde68d58 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: b4ccd5ac-9465-43d8-9a5f-127152966ce8] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:58.148019 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-de845568-4bed-4f0a-9cc6-6ceddde68d58 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:58.148538 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-de845568-4bed-4f0a-9cc6-6ceddde68d58 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:58.148967 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-de845568-4bed-4f0a-9cc6-6ceddde68d58 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:58.149879 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-de845568-4bed-4f0a-9cc6-6ceddde68d58 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:58.150412 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-de845568-4bed-4f0a-9cc6-6ceddde68d58 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:58.151197 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-de845568-4bed-4f0a-9cc6-6ceddde68d58 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:58.218713 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-de845568-4bed-4f0a-9cc6-6ceddde68d58 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8358c07e2684b749a62becb9f0b7869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b922a74c1c2448bb770d6b298b2d601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:58.226329 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-de845568-4bed-4f0a-9cc6-6ceddde68d58 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "GET /compute/v2.1/servers/b4ccd5ac-9465-43d8-9a5f-127152966ce8" status: 200 len: 1217 microversion: 2.1 time: 0.088279 Oct 04 18:38:58.226981 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1334/2730] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:58 2022] GET /compute/v2.1/servers/b4ccd5ac-9465-43d8-9a5f-127152966ce8 => generated 1217 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:58.232646 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-47ed5b3f-b4ac-475b-9d8c-b776ff2137b6 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:58.233434 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-47ed5b3f-b4ac-475b-9d8c-b776ff2137b6 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 5965d934-6f27-43ac-bf15-8fd20da48cc1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:58.240412 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-47ed5b3f-b4ac-475b-9d8c-b776ff2137b6 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:58.241122 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-47ed5b3f-b4ac-475b-9d8c-b776ff2137b6 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:58.242748 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-47ed5b3f-b4ac-475b-9d8c-b776ff2137b6 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:58.243088 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-47ed5b3f-b4ac-475b-9d8c-b776ff2137b6 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:58.243936 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-47ed5b3f-b4ac-475b-9d8c-b776ff2137b6 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:58.244803 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-47ed5b3f-b4ac-475b-9d8c-b776ff2137b6 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:58.277818 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:38:58.350867 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a330c484-1e62-4568-b72c-ec72187ad536 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4e1bb5af-9b8b-456f-beb1-aadf2491a8ed" status: 204 len: 0 microversion: 2.1 time: 0.369824 Oct 04 18:38:58.352692 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1397/2731] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:38:57 2022] DELETE /compute/v2.1/servers/4e1bb5af-9b8b-456f-beb1-aadf2491a8ed => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:38:58.362180 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-167b0014-10ee-4197-b06f-0c6ffbf147b2 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:58.363258 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-167b0014-10ee-4197-b06f-0c6ffbf147b2 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 4e1bb5af-9b8b-456f-beb1-aadf2491a8ed] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:58.370093 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-167b0014-10ee-4197-b06f-0c6ffbf147b2 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:58.370873 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-167b0014-10ee-4197-b06f-0c6ffbf147b2 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:58.371522 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-167b0014-10ee-4197-b06f-0c6ffbf147b2 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:58.372433 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-167b0014-10ee-4197-b06f-0c6ffbf147b2 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:58.372898 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-167b0014-10ee-4197-b06f-0c6ffbf147b2 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:58.373337 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-167b0014-10ee-4197-b06f-0c6ffbf147b2 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:58.408874 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-47ed5b3f-b4ac-475b-9d8c-b776ff2137b6 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8284fe51decd4db0bf6b3ed1514cc2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87473abf47e74adf844e3ddfa24da3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:58.445341 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-47ed5b3f-b4ac-475b-9d8c-b776ff2137b6 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] 10.222.0.20 "GET /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1" status: 200 len: 1505 microversion: 2.1 time: 0.216861 Oct 04 18:38:58.449511 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1335/2732] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:58 2022] GET /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1 => generated 1505 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:58.577642 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-167b0014-10ee-4197-b06f-0c6ffbf147b2 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:58.586023 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-167b0014-10ee-4197-b06f-0c6ffbf147b2 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/4e1bb5af-9b8b-456f-beb1-aadf2491a8ed" status: 200 len: 1485 microversion: 2.1 time: 0.228434 Oct 04 18:38:58.586665 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1398/2733] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:58 2022] GET /compute/v2.1/servers/4e1bb5af-9b8b-456f-beb1-aadf2491a8ed => generated 1485 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:59.002009 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-982bc827-26ff-45b1-a8b0-927de9f737df tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:59.003029 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-982bc827-26ff-45b1-a8b0-927de9f737df tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2e308f41-242e-4ce3-8641-9510e2f13681] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:59.013482 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-982bc827-26ff-45b1-a8b0-927de9f737df tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:59.014346 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-982bc827-26ff-45b1-a8b0-927de9f737df tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:59.014943 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-982bc827-26ff-45b1-a8b0-927de9f737df tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:59.015808 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-982bc827-26ff-45b1-a8b0-927de9f737df tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:59.016655 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-982bc827-26ff-45b1-a8b0-927de9f737df tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:59.017245 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-982bc827-26ff-45b1-a8b0-927de9f737df tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:59.160083 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-64fe476a-0a2e-4fea-b529-34a55c0fc277 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:59.160730 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-64fe476a-0a2e-4fea-b529-34a55c0fc277 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] [instance: b2fbbb75-1f0b-4095-8a22-df673b44686d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:59.179674 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-64fe476a-0a2e-4fea-b529-34a55c0fc277 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:59.185377 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-64fe476a-0a2e-4fea-b529-34a55c0fc277 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:59.185377 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-64fe476a-0a2e-4fea-b529-34a55c0fc277 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:59.185377 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-64fe476a-0a2e-4fea-b529-34a55c0fc277 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:59.185377 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-64fe476a-0a2e-4fea-b529-34a55c0fc277 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:59.188194 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-64fe476a-0a2e-4fea-b529-34a55c0fc277 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:59.440432 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-64fe476a-0a2e-4fea-b529-34a55c0fc277 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7d2e249cfc4feb92c8486a892b8b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e42e9f6c747493685a49d70d7061a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:59.455116 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-64fe476a-0a2e-4fea-b529-34a55c0fc277 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] 10.222.0.20 "GET /compute/v2.1/servers/b2fbbb75-1f0b-4095-8a22-df673b44686d" status: 200 len: 1460 microversion: 2.1 time: 0.299197 Oct 04 18:38:59.455734 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1399/2734] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:59 2022] GET /compute/v2.1/servers/b2fbbb75-1f0b-4095-8a22-df673b44686d => generated 1460 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:59.470430 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a2bdc9e7-31bf-4e90-9fad-c32ed91f6030 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:59.471069 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a2bdc9e7-31bf-4e90-9fad-c32ed91f6030 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: b4ccd5ac-9465-43d8-9a5f-127152966ce8] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:59.489162 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a2bdc9e7-31bf-4e90-9fad-c32ed91f6030 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:59.489666 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a2bdc9e7-31bf-4e90-9fad-c32ed91f6030 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:59.490112 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a2bdc9e7-31bf-4e90-9fad-c32ed91f6030 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:59.490998 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a2bdc9e7-31bf-4e90-9fad-c32ed91f6030 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:59.491467 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a2bdc9e7-31bf-4e90-9fad-c32ed91f6030 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:59.491900 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a2bdc9e7-31bf-4e90-9fad-c32ed91f6030 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:59.515163 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-982bc827-26ff-45b1-a8b0-927de9f737df tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:59.528842 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-982bc827-26ff-45b1-a8b0-927de9f737df tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681" status: 200 len: 1312 microversion: 2.1 time: 0.531570 Oct 04 18:38:59.529794 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1336/2735] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:58 2022] GET /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681 => generated 1312 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:59.544307 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-9d3c69f8-9499-4364-b6a2-681b1b62498d req-cb95a320-e4e5-4d75-b2e6-004d444ffdde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2fbbb75-1f0b-4095-8a22-df673b44686d", "name": "network-vif-deleted", "tag": "12ae1f9b-1e01-4cbc-a20e-08d83f8483a6"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:59.579060 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-9d3c69f8-9499-4364-b6a2-681b1b62498d req-cb95a320-e4e5-4d75-b2e6-004d444ffdde service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:59.580101 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-9d3c69f8-9499-4364-b6a2-681b1b62498d req-cb95a320-e4e5-4d75-b2e6-004d444ffdde service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:59.583096 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-9d3c69f8-9499-4364-b6a2-681b1b62498d req-cb95a320-e4e5-4d75-b2e6-004d444ffdde service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:59.611575 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-9d3c69f8-9499-4364-b6a2-681b1b62498d req-cb95a320-e4e5-4d75-b2e6-004d444ffdde service nova] Creating event network-vif-deleted:12ae1f9b-1e01-4cbc-a20e-08d83f8483a6 for instance b2fbbb75-1f0b-4095-8a22-df673b44686d on n-h2-850501-14 Oct 04 18:38:59.650900 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-9d3c69f8-9499-4364-b6a2-681b1b62498d req-cb95a320-e4e5-4d75-b2e6-004d444ffdde service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115343 Oct 04 18:38:59.652029 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1337/2736] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:38:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:59.663381 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-841b344c-392b-4708-956f-723e1f30b708 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:59.664408 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-841b344c-392b-4708-956f-723e1f30b708 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 5965d934-6f27-43ac-bf15-8fd20da48cc1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:59.672311 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-841b344c-392b-4708-956f-723e1f30b708 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:59.673160 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-841b344c-392b-4708-956f-723e1f30b708 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:59.673762 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-841b344c-392b-4708-956f-723e1f30b708 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:59.674847 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-841b344c-392b-4708-956f-723e1f30b708 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:59.675542 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-841b344c-392b-4708-956f-723e1f30b708 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:59.676172 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-841b344c-392b-4708-956f-723e1f30b708 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:59.742277 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a2bdc9e7-31bf-4e90-9fad-c32ed91f6030 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8358c07e2684b749a62becb9f0b7869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b922a74c1c2448bb770d6b298b2d601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:59.756319 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a2bdc9e7-31bf-4e90-9fad-c32ed91f6030 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "GET /compute/v2.1/servers/b4ccd5ac-9465-43d8-9a5f-127152966ce8" status: 200 len: 1265 microversion: 2.1 time: 0.294263 Oct 04 18:38:59.783174 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1400/2737] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:59 2022] GET /compute/v2.1/servers/b4ccd5ac-9465-43d8-9a5f-127152966ce8 => generated 1265 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:59.783174 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-fe837402-04da-41fd-afaf-223866e1dd2f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:59.783174 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-fe837402-04da-41fd-afaf-223866e1dd2f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 4e1bb5af-9b8b-456f-beb1-aadf2491a8ed] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:59.789730 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fe837402-04da-41fd-afaf-223866e1dd2f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:59.790554 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fe837402-04da-41fd-afaf-223866e1dd2f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:59.791215 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fe837402-04da-41fd-afaf-223866e1dd2f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:59.792761 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fe837402-04da-41fd-afaf-223866e1dd2f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:59.793445 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fe837402-04da-41fd-afaf-223866e1dd2f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:59.794165 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fe837402-04da-41fd-afaf-223866e1dd2f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:00.237965 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-841b344c-392b-4708-956f-723e1f30b708 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8284fe51decd4db0bf6b3ed1514cc2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87473abf47e74adf844e3ddfa24da3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:00.257503 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-841b344c-392b-4708-956f-723e1f30b708 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] 10.222.0.20 "GET /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1" status: 200 len: 1505 microversion: 2.1 time: 0.604109 Oct 04 18:39:00.258448 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1338/2738] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:59 2022] GET /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1 => generated 1505 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:00.405480 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-fe837402-04da-41fd-afaf-223866e1dd2f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:00.414003 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-fe837402-04da-41fd-afaf-223866e1dd2f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/4e1bb5af-9b8b-456f-beb1-aadf2491a8ed" status: 200 len: 1485 microversion: 2.1 time: 0.646486 Oct 04 18:39:00.420844 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1401/2739] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:59 2022] GET /compute/v2.1/servers/4e1bb5af-9b8b-456f-beb1-aadf2491a8ed => generated 1485 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:00.491005 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-fc217857-19ae-4b6d-9684-77cc7987e984 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:00.492370 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-fc217857-19ae-4b6d-9684-77cc7987e984 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] [instance: b2fbbb75-1f0b-4095-8a22-df673b44686d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:00.505713 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fc217857-19ae-4b6d-9684-77cc7987e984 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:00.507775 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fc217857-19ae-4b6d-9684-77cc7987e984 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:00.509294 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fc217857-19ae-4b6d-9684-77cc7987e984 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:00.511925 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fc217857-19ae-4b6d-9684-77cc7987e984 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:00.512877 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fc217857-19ae-4b6d-9684-77cc7987e984 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:00.521360 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fc217857-19ae-4b6d-9684-77cc7987e984 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:00.555580 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-22082b12-8cb5-435a-b77a-bf145c03d540 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:00.556227 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-22082b12-8cb5-435a-b77a-bf145c03d540 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2e308f41-242e-4ce3-8641-9510e2f13681] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:00.571454 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-22082b12-8cb5-435a-b77a-bf145c03d540 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:00.574049 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-22082b12-8cb5-435a-b77a-bf145c03d540 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:00.574667 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-22082b12-8cb5-435a-b77a-bf145c03d540 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:00.580341 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-22082b12-8cb5-435a-b77a-bf145c03d540 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:00.580916 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-22082b12-8cb5-435a-b77a-bf145c03d540 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:00.581367 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-22082b12-8cb5-435a-b77a-bf145c03d540 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:00.654992 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fc217857-19ae-4b6d-9684-77cc7987e984 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:00.655495 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fc217857-19ae-4b6d-9684-77cc7987e984 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:00.659530 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fc217857-19ae-4b6d-9684-77cc7987e984 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:00.662847 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-fc217857-19ae-4b6d-9684-77cc7987e984 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lazy-loading 'fault' on Instance uuid b2fbbb75-1f0b-4095-8a22-df673b44686d {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:39:00.917860 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-fc217857-19ae-4b6d-9684-77cc7987e984 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7d2e249cfc4feb92c8486a892b8b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e42e9f6c747493685a49d70d7061a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:00.930285 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-fc217857-19ae-4b6d-9684-77cc7987e984 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] 10.222.0.20 "GET /compute/v2.1/servers/b2fbbb75-1f0b-4095-8a22-df673b44686d" status: 200 len: 1302 microversion: 2.1 time: 0.453114 Oct 04 18:39:00.946826 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1339/2740] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:00 2022] GET /compute/v2.1/servers/b2fbbb75-1f0b-4095-8a22-df673b44686d => generated 1302 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:00.955269 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-935de19a-0b72-40f5-b904-10dfdc107a95 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:00.957283 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-935de19a-0b72-40f5-b904-10dfdc107a95 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: b4ccd5ac-9465-43d8-9a5f-127152966ce8] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:00.966243 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-935de19a-0b72-40f5-b904-10dfdc107a95 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:00.967288 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-935de19a-0b72-40f5-b904-10dfdc107a95 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:00.968231 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-935de19a-0b72-40f5-b904-10dfdc107a95 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:00.969147 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-935de19a-0b72-40f5-b904-10dfdc107a95 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:00.970040 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-935de19a-0b72-40f5-b904-10dfdc107a95 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:00.971246 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-935de19a-0b72-40f5-b904-10dfdc107a95 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:00.998076 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:39:01.094922 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-935de19a-0b72-40f5-b904-10dfdc107a95 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8358c07e2684b749a62becb9f0b7869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b922a74c1c2448bb770d6b298b2d601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:01.105506 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-22082b12-8cb5-435a-b77a-bf145c03d540 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:01.115630 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-22082b12-8cb5-435a-b77a-bf145c03d540 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681" status: 200 len: 1312 microversion: 2.1 time: 0.564112 Oct 04 18:39:01.116258 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1402/2741] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:00 2022] GET /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681 => generated 1312 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:01.122883 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-935de19a-0b72-40f5-b904-10dfdc107a95 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "GET /compute/v2.1/servers/b4ccd5ac-9465-43d8-9a5f-127152966ce8" status: 200 len: 1271 microversion: 2.1 time: 0.172708 Oct 04 18:39:01.133733 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1340/2742] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:00 2022] GET /compute/v2.1/servers/b4ccd5ac-9465-43d8-9a5f-127152966ce8 => generated 1271 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:01.281975 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-263fbbed-2cc7-470a-8164-15770a22ddd4 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:01.283329 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-263fbbed-2cc7-470a-8164-15770a22ddd4 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 5965d934-6f27-43ac-bf15-8fd20da48cc1] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:01.301057 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-263fbbed-2cc7-470a-8164-15770a22ddd4 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:01.306364 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-263fbbed-2cc7-470a-8164-15770a22ddd4 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:01.308792 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-263fbbed-2cc7-470a-8164-15770a22ddd4 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:01.309863 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-263fbbed-2cc7-470a-8164-15770a22ddd4 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:01.312086 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-263fbbed-2cc7-470a-8164-15770a22ddd4 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:01.312747 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-263fbbed-2cc7-470a-8164-15770a22ddd4 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:01.650007 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-3573eafa-450b-417f-9f62-a802acb9a117 req-1d39d719-bc63-4ecf-8acd-81c5ae5e9b83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e1bb5af-9b8b-456f-beb1-aadf2491a8ed", "name": "network-vif-deleted", "tag": "1fbe8b1c-48fa-4c89-bb2c-cf691330a2a8"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:01.666018 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-3573eafa-450b-417f-9f62-a802acb9a117 req-1d39d719-bc63-4ecf-8acd-81c5ae5e9b83 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:01.670824 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-3573eafa-450b-417f-9f62-a802acb9a117 req-1d39d719-bc63-4ecf-8acd-81c5ae5e9b83 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:01.679439 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-3573eafa-450b-417f-9f62-a802acb9a117 req-1d39d719-bc63-4ecf-8acd-81c5ae5e9b83 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:01.695618 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-3573eafa-450b-417f-9f62-a802acb9a117 req-1d39d719-bc63-4ecf-8acd-81c5ae5e9b83 service nova] Creating event network-vif-deleted:1fbe8b1c-48fa-4c89-bb2c-cf691330a2a8 for instance 4e1bb5af-9b8b-456f-beb1-aadf2491a8ed on n-h2-850501-14 Oct 04 18:39:01.708409 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-3573eafa-450b-417f-9f62-a802acb9a117 req-1d39d719-bc63-4ecf-8acd-81c5ae5e9b83 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.373705 Oct 04 18:39:01.712974 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1341/2743] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:39:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:39:01.730598 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-58fac010-1ff9-46d7-8a92-1a64a2f6de8f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:01.731689 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-58fac010-1ff9-46d7-8a92-1a64a2f6de8f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 4e1bb5af-9b8b-456f-beb1-aadf2491a8ed] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:01.747689 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-58fac010-1ff9-46d7-8a92-1a64a2f6de8f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:01.749884 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-58fac010-1ff9-46d7-8a92-1a64a2f6de8f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:01.750484 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-58fac010-1ff9-46d7-8a92-1a64a2f6de8f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:01.753065 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-58fac010-1ff9-46d7-8a92-1a64a2f6de8f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:01.754200 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-58fac010-1ff9-46d7-8a92-1a64a2f6de8f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:01.755912 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-58fac010-1ff9-46d7-8a92-1a64a2f6de8f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:01.786837 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-263fbbed-2cc7-470a-8164-15770a22ddd4 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8284fe51decd4db0bf6b3ed1514cc2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87473abf47e74adf844e3ddfa24da3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:01.806147 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-263fbbed-2cc7-470a-8164-15770a22ddd4 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] 10.222.0.20 "GET /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1" status: 200 len: 1505 microversion: 2.1 time: 0.528530 Oct 04 18:39:01.810023 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1403/2744] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:01 2022] GET /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1 => generated 1505 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:01.838635 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-58fac010-1ff9-46d7-8a92-1a64a2f6de8f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:01.839477 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-58fac010-1ff9-46d7-8a92-1a64a2f6de8f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:01.840302 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-58fac010-1ff9-46d7-8a92-1a64a2f6de8f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:01.840973 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-58fac010-1ff9-46d7-8a92-1a64a2f6de8f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lazy-loading 'fault' on Instance uuid 4e1bb5af-9b8b-456f-beb1-aadf2491a8ed {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:39:01.926169 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-58fac010-1ff9-46d7-8a92-1a64a2f6de8f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:01.942458 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-58fac010-1ff9-46d7-8a92-1a64a2f6de8f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/4e1bb5af-9b8b-456f-beb1-aadf2491a8ed" status: 200 len: 1301 microversion: 2.1 time: 0.226236 Oct 04 18:39:01.943063 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1342/2745] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:01 2022] GET /compute/v2.1/servers/4e1bb5af-9b8b-456f-beb1-aadf2491a8ed => generated 1301 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:01.978000 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-28e54161-97d4-4467-889b-9cc098934332 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:01.978625 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-28e54161-97d4-4467-889b-9cc098934332 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] [instance: b2fbbb75-1f0b-4095-8a22-df673b44686d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:01.992866 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-28e54161-97d4-4467-889b-9cc098934332 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:01.993436 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-28e54161-97d4-4467-889b-9cc098934332 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:01.993851 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-28e54161-97d4-4467-889b-9cc098934332 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:01.994928 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-28e54161-97d4-4467-889b-9cc098934332 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:01.995099 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-28e54161-97d4-4467-889b-9cc098934332 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:02.002283 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-28e54161-97d4-4467-889b-9cc098934332 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:02.093506 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-28e54161-97d4-4467-889b-9cc098934332 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:02.094011 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-28e54161-97d4-4467-889b-9cc098934332 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:02.094513 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-28e54161-97d4-4467-889b-9cc098934332 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:02.099245 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-28e54161-97d4-4467-889b-9cc098934332 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lazy-loading 'fault' on Instance uuid b2fbbb75-1f0b-4095-8a22-df673b44686d {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:39:02.141258 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-82b11917-6302-41c1-8aa4-b7dde4fe2b57 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:02.141984 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-82b11917-6302-41c1-8aa4-b7dde4fe2b57 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2e308f41-242e-4ce3-8641-9510e2f13681] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:02.158955 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-82b11917-6302-41c1-8aa4-b7dde4fe2b57 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:02.159487 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-82b11917-6302-41c1-8aa4-b7dde4fe2b57 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:02.159934 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-82b11917-6302-41c1-8aa4-b7dde4fe2b57 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:02.160688 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-82b11917-6302-41c1-8aa4-b7dde4fe2b57 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:02.166460 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-82b11917-6302-41c1-8aa4-b7dde4fe2b57 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:02.166957 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-82b11917-6302-41c1-8aa4-b7dde4fe2b57 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:02.287223 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-28e54161-97d4-4467-889b-9cc098934332 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7d2e249cfc4feb92c8486a892b8b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e42e9f6c747493685a49d70d7061a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:02.317720 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-28e54161-97d4-4467-889b-9cc098934332 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] 10.222.0.20 "GET /compute/v2.1/servers/b2fbbb75-1f0b-4095-8a22-df673b44686d" status: 200 len: 1302 microversion: 2.1 time: 0.344193 Oct 04 18:39:02.356796 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1404/2746] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:01 2022] GET /compute/v2.1/servers/b2fbbb75-1f0b-4095-8a22-df673b44686d => generated 1302 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:02.374406 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f6119a54-33d7-4404-b055-7bda2e7199dc tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:02.375126 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f6119a54-33d7-4404-b055-7bda2e7199dc tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: b4ccd5ac-9465-43d8-9a5f-127152966ce8] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:02.383812 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f6119a54-33d7-4404-b055-7bda2e7199dc tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:02.387259 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f6119a54-33d7-4404-b055-7bda2e7199dc tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:02.388001 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f6119a54-33d7-4404-b055-7bda2e7199dc tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:02.388981 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f6119a54-33d7-4404-b055-7bda2e7199dc tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:02.389629 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f6119a54-33d7-4404-b055-7bda2e7199dc tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:02.393118 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f6119a54-33d7-4404-b055-7bda2e7199dc tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:02.917914 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-82b11917-6302-41c1-8aa4-b7dde4fe2b57 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:02.931347 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-82b11917-6302-41c1-8aa4-b7dde4fe2b57 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681" status: 200 len: 1312 microversion: 2.1 time: 0.793730 Oct 04 18:39:02.932316 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1343/2747] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:02 2022] GET /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681 => generated 1312 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:02.949405 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-372526b5-cba6-48c5-a371-b8756c48617e req-479aee76-c8b7-4e53-a3f7-07002d1e5a16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e308f41-242e-4ce3-8641-9510e2f13681", "name": "network-vif-plugged", "status": "completed", "tag": "192de35c-060d-4a11-8df5-09c24dfcc8d0"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:02.975883 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-372526b5-cba6-48c5-a371-b8756c48617e req-479aee76-c8b7-4e53-a3f7-07002d1e5a16 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:02.977922 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-372526b5-cba6-48c5-a371-b8756c48617e req-479aee76-c8b7-4e53-a3f7-07002d1e5a16 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:02.978565 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-372526b5-cba6-48c5-a371-b8756c48617e req-479aee76-c8b7-4e53-a3f7-07002d1e5a16 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:03.001586 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f6119a54-33d7-4404-b055-7bda2e7199dc tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8358c07e2684b749a62becb9f0b7869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b922a74c1c2448bb770d6b298b2d601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:03.011096 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f6119a54-33d7-4404-b055-7bda2e7199dc tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "GET /compute/v2.1/servers/b4ccd5ac-9465-43d8-9a5f-127152966ce8" status: 200 len: 1313 microversion: 2.1 time: 0.649693 Oct 04 18:39:03.014380 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-372526b5-cba6-48c5-a371-b8756c48617e req-479aee76-c8b7-4e53-a3f7-07002d1e5a16 service nova] Creating event network-vif-plugged:192de35c-060d-4a11-8df5-09c24dfcc8d0 for instance 2e308f41-242e-4ce3-8641-9510e2f13681 on n-h1-850501-14 Oct 04 18:39:03.024386 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-372526b5-cba6-48c5-a371-b8756c48617e req-479aee76-c8b7-4e53-a3f7-07002d1e5a16 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090426 Oct 04 18:39:03.026827 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1344/2748] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:39:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:03.027696 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1405/2749] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:02 2022] GET /compute/v2.1/servers/b4ccd5ac-9465-43d8-9a5f-127152966ce8 => generated 1313 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:03.033255 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d61b5ce1-93ba-4de8-b0db-1035704af4da tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:03.035383 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d61b5ce1-93ba-4de8-b0db-1035704af4da tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 4e1bb5af-9b8b-456f-beb1-aadf2491a8ed] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:03.039567 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d3fbe76f-ab70-4aba-bf10-c04c7bba7102 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:03.042471 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d61b5ce1-93ba-4de8-b0db-1035704af4da tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:03.043062 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d3fbe76f-ab70-4aba-bf10-c04c7bba7102 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 5965d934-6f27-43ac-bf15-8fd20da48cc1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:03.043364 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d61b5ce1-93ba-4de8-b0db-1035704af4da tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:03.044009 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d61b5ce1-93ba-4de8-b0db-1035704af4da tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:03.044962 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d61b5ce1-93ba-4de8-b0db-1035704af4da tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:03.045661 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d61b5ce1-93ba-4de8-b0db-1035704af4da tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:03.046453 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d61b5ce1-93ba-4de8-b0db-1035704af4da tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:03.052760 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d3fbe76f-ab70-4aba-bf10-c04c7bba7102 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:03.053257 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d3fbe76f-ab70-4aba-bf10-c04c7bba7102 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:03.053849 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d3fbe76f-ab70-4aba-bf10-c04c7bba7102 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:03.054562 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d3fbe76f-ab70-4aba-bf10-c04c7bba7102 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:03.055169 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d3fbe76f-ab70-4aba-bf10-c04c7bba7102 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:03.055466 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d3fbe76f-ab70-4aba-bf10-c04c7bba7102 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:03.092138 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d61b5ce1-93ba-4de8-b0db-1035704af4da tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:03.093015 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d61b5ce1-93ba-4de8-b0db-1035704af4da tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:03.093670 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d61b5ce1-93ba-4de8-b0db-1035704af4da tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:03.094343 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-d61b5ce1-93ba-4de8-b0db-1035704af4da tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lazy-loading 'fault' on Instance uuid 4e1bb5af-9b8b-456f-beb1-aadf2491a8ed {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:39:03.216809 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d61b5ce1-93ba-4de8-b0db-1035704af4da tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:03.228549 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d61b5ce1-93ba-4de8-b0db-1035704af4da tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/4e1bb5af-9b8b-456f-beb1-aadf2491a8ed" status: 200 len: 1301 microversion: 2.1 time: 0.199428 Oct 04 18:39:03.230064 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1406/2750] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:03 2022] GET /compute/v2.1/servers/4e1bb5af-9b8b-456f-beb1-aadf2491a8ed => generated 1301 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:03.296278 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d3fbe76f-ab70-4aba-bf10-c04c7bba7102 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8284fe51decd4db0bf6b3ed1514cc2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87473abf47e74adf844e3ddfa24da3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:03.304560 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d3fbe76f-ab70-4aba-bf10-c04c7bba7102 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] 10.222.0.20 "GET /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1" status: 200 len: 1505 microversion: 2.1 time: 0.273787 Oct 04 18:39:03.305717 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1345/2751] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:03 2022] GET /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1 => generated 1505 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:03.347746 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b961c66d-e6cd-41a9-808b-1902d996518a tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:03.348503 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b961c66d-e6cd-41a9-808b-1902d996518a tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] [instance: b2fbbb75-1f0b-4095-8a22-df673b44686d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:03.356653 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b961c66d-e6cd-41a9-808b-1902d996518a tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:03.357364 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b961c66d-e6cd-41a9-808b-1902d996518a tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:03.357802 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b961c66d-e6cd-41a9-808b-1902d996518a tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:03.368721 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b961c66d-e6cd-41a9-808b-1902d996518a tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:03.368721 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b961c66d-e6cd-41a9-808b-1902d996518a tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:03.368721 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b961c66d-e6cd-41a9-808b-1902d996518a tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:03.376442 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-b961c66d-e6cd-41a9-808b-1902d996518a tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] HTTP exception thrown: Instance b2fbbb75-1f0b-4095-8a22-df673b44686d could not be found. Oct 04 18:39:03.378121 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b961c66d-e6cd-41a9-808b-1902d996518a tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Request method failure captured: Oct 04 18:39:03.378121 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/b2fbbb75-1f0b-4095-8a22-df673b44686d HTTP/1.1 Oct 04 18:39:03.378121 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:39:03.378121 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:39:03.378121 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:39:03.378121 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:39:03.378121 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:39:03.378121 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:39:03.378121 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:39:03.378121 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:39:03.378121 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH2beENVg86XB0IOBJgXRtfOz9MNyEZzm1T3BnAnVV3XxUy3BSWr35rMZtOd7BUIMnMQZyXW35c4qbXYkBrrAiLeZi5gd17-aiIWHgScTedbN4TcjlVBNPIJoks9JeryuuLldwUyYrMCrSWCFSHl_LWQp3bocGsqcjyU-FZDfEuunu0 Oct 04 18:39:03.378121 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:39:03.378121 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:39:03.378121 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:39:03.378121 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:39:03.378121 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:39:03.378121 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:39:03.378121 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 0e42e9f6c747493685a49d70d7061a37 Oct 04 18:39:03.378121 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServerGroupTestJSON-892650054 Oct 04 18:39:03.378121 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:39:03.378121 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:39:03.378121 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e42e9f6c747493685a49d70d7061a37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0e42e9f6c747493685a49d70d7061a37", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0e42e9f6c747493685a49d70d7061a37"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e42e9f6c747493685a49d70d7061a37"}]}] Oct 04 18:39:03.378121 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServerGroupTestJSON-892650054 Oct 04 18:39:03.378121 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 0e42e9f6c747493685a49d70d7061a37 Oct 04 18:39:03.378121 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServerGroupTestJSON-892650054 Oct 04 18:39:03.378121 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServerGroupTestJSON-892650054-project Oct 04 18:39:03.378121 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:39:03.378121 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:39:03.378121 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: bc7d2e249cfc4feb92c8486a892b8b6d Oct 04 18:39:03.378121 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServerGroupTestJSON-892650054-project Oct 04 18:39:03.378121 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:39:03.378121 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance b2fbbb75-1f0b-4095-8a22-df673b44686d could not be found. Oct 04 18:39:03.378121 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'b2fbbb75-1f0b-4095-8a22-df673b44686d'} Oct 04 18:39:03.378121 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:39:03.378121 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:03.378121 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:39:03.378121 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:39:03.378121 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:39:03.378121 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:39:03.378121 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:39:03.378121 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:39:03.378121 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:39:03.378121 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:39:03.378121 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2fbbb75-1f0b-4095-8a22-df673b44686d could not be found. Oct 04 18:39:03.378121 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:39:03.378121 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:39:03.378121 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:39:03.378121 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:03.378121 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:39:03.378121 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:39:03.378121 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:39:03.378121 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:39:03.378121 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:39:03.378121 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:39:03.378121 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:39:03.378121 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:39:03.378121 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:39:03.378121 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:39:03.378121 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:39:03.378121 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:39:03.378121 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2fbbb75-1f0b-4095-8a22-df673b44686d could not be found. Oct 04 18:39:03.378121 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:39:03.378121 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:39:03.378121 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:39:03.382252 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:03.382252 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:39:03.382252 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:39:03.382252 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:39:03.382252 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:39:03.382252 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2fbbb75-1f0b-4095-8a22-df673b44686d could not be found. Oct 04 18:39:03.382252 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:39:03.382641 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b961c66d-e6cd-41a9-808b-1902d996518a tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Returning 404 to user: Instance b2fbbb75-1f0b-4095-8a22-df673b44686d could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:39:03.383390 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b961c66d-e6cd-41a9-808b-1902d996518a tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] 10.222.0.20 "GET /compute/v2.1/servers/b2fbbb75-1f0b-4095-8a22-df673b44686d" status: 404 len: 111 microversion: 2.1 time: 0.040628 Oct 04 18:39:03.384182 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1407/2752] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:03 2022] GET /compute/v2.1/servers/b2fbbb75-1f0b-4095-8a22-df673b44686d => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:39:03.396038 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c2a0c855-5bc8-4622-a593-facc43f6ccca tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:03.413429 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.compute.server_groups [None req-c2a0c855-5bc8-4622-a593-facc43f6ccca tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Querying cell a6039a6d-a98c-44a9-819b-4eff388d8aa7(cell1) for 1 instances {{(pid=123001) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 04 18:39:03.414141 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c2a0c855-5bc8-4622-a593-facc43f6ccca tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:03.414793 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c2a0c855-5bc8-4622-a593-facc43f6ccca tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:03.415221 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c2a0c855-5bc8-4622-a593-facc43f6ccca tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:03.428622 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c2a0c855-5bc8-4622-a593-facc43f6ccca tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.036965 Oct 04 18:39:03.429288 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1346/2753] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Oct 4 18:39:03 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:03.443290 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e7aac189-98c5-4045-ae32-f1b6ad895ae7 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:03.463872 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.compute.server_groups [None req-e7aac189-98c5-4045-ae32-f1b6ad895ae7 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Querying cell a6039a6d-a98c-44a9-819b-4eff388d8aa7(cell1) for 1 instances {{(pid=123002) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 04 18:39:03.464857 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e7aac189-98c5-4045-ae32-f1b6ad895ae7 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:03.465491 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e7aac189-98c5-4045-ae32-f1b6ad895ae7 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:03.472681 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e7aac189-98c5-4045-ae32-f1b6ad895ae7 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:03.484190 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:39:03.491349 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e7aac189-98c5-4045-ae32-f1b6ad895ae7 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups/566c9cd3-5a33-4703-b552-fa6d89d554f7" status: 200 len: 184 microversion: 2.1 time: 0.052982 Oct 04 18:39:03.491937 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1408/2754] 10.222.0.20 () {58 vars in 1263 bytes} [Tue Oct 4 18:39:03 2022] GET /compute/v2.1/os-server-groups/566c9cd3-5a33-4703-b552-fa6d89d554f7 => generated 184 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:03.504953 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ee9c93e7-0df3-4084-9dcf-c35972a9aae0 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:03.505447 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ee9c93e7-0df3-4084-9dcf-c35972a9aae0 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] [instance: b2fbbb75-1f0b-4095-8a22-df673b44686d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:03.513857 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ee9c93e7-0df3-4084-9dcf-c35972a9aae0 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:03.514354 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ee9c93e7-0df3-4084-9dcf-c35972a9aae0 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:03.518683 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ee9c93e7-0df3-4084-9dcf-c35972a9aae0 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:03.518683 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ee9c93e7-0df3-4084-9dcf-c35972a9aae0 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:03.518683 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ee9c93e7-0df3-4084-9dcf-c35972a9aae0 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:03.518683 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ee9c93e7-0df3-4084-9dcf-c35972a9aae0 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:03.533114 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-ee9c93e7-0df3-4084-9dcf-c35972a9aae0 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] HTTP exception thrown: Instance b2fbbb75-1f0b-4095-8a22-df673b44686d could not be found. Oct 04 18:39:03.534812 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ee9c93e7-0df3-4084-9dcf-c35972a9aae0 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Request method failure captured: Oct 04 18:39:03.534812 n-d-850501-14 devstack@n-api.service[123001]: request: DELETE /compute/v2.1/servers/b2fbbb75-1f0b-4095-8a22-df673b44686d HTTP/1.1 Oct 04 18:39:03.534812 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:39:03.534812 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:39:03.534812 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:39:03.534812 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:39:03.534812 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:39:03.534812 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:39:03.534812 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:39:03.534812 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:39:03.534812 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPH2beENVg86XB0IOBJgXRtfOz9MNyEZzm1T3BnAnVV3XxUy3BSWr35rMZtOd7BUIMnMQZyXW35c4qbXYkBrrAiLeZi5gd17-aiIWHgScTedbN4TcjlVBNPIJoks9JeryuuLldwUyYrMCrSWCFSHl_LWQp3bocGsqcjyU-FZDfEuunu0 Oct 04 18:39:03.534812 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:39:03.534812 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:39:03.534812 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:39:03.534812 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:39:03.534812 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:39:03.534812 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:39:03.534812 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 0e42e9f6c747493685a49d70d7061a37 Oct 04 18:39:03.534812 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ServerGroupTestJSON-892650054 Oct 04 18:39:03.534812 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:39:03.534812 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:39:03.534812 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e42e9f6c747493685a49d70d7061a37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0e42e9f6c747493685a49d70d7061a37", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0e42e9f6c747493685a49d70d7061a37"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e42e9f6c747493685a49d70d7061a37"}]}] Oct 04 18:39:03.534812 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ServerGroupTestJSON-892650054 Oct 04 18:39:03.534812 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 0e42e9f6c747493685a49d70d7061a37 Oct 04 18:39:03.534812 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ServerGroupTestJSON-892650054 Oct 04 18:39:03.534812 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ServerGroupTestJSON-892650054-project Oct 04 18:39:03.534812 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:39:03.534812 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:39:03.534812 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: bc7d2e249cfc4feb92c8486a892b8b6d Oct 04 18:39:03.534812 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ServerGroupTestJSON-892650054-project Oct 04 18:39:03.534812 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:39:03.534812 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance b2fbbb75-1f0b-4095-8a22-df673b44686d could not be found. Oct 04 18:39:03.534812 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': 'b2fbbb75-1f0b-4095-8a22-df673b44686d'} Oct 04 18:39:03.534812 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:39:03.534812 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:03.534812 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:39:03.534812 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:39:03.534812 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:39:03.534812 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:39:03.534812 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:39:03.534812 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:39:03.534812 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:39:03.534812 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:39:03.534812 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2fbbb75-1f0b-4095-8a22-df673b44686d could not be found. Oct 04 18:39:03.534812 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:39:03.534812 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:39:03.534812 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:39:03.534812 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:03.534812 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:39:03.534812 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:39:03.534812 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:39:03.534812 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:39:03.534812 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:39:03.534812 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:39:03.534812 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:39:03.534812 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:39:03.534812 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:39:03.534812 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:39:03.534812 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:39:03.534812 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:39:03.534812 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:39:03.534812 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:39:03.542674 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2fbbb75-1f0b-4095-8a22-df673b44686d could not be found. Oct 04 18:39:03.542674 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:39:03.542674 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:39:03.542674 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:39:03.542674 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:03.542674 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:39:03.542674 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:39:03.542674 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:39:03.542674 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:39:03.542674 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2fbbb75-1f0b-4095-8a22-df673b44686d could not be found. Oct 04 18:39:03.542674 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:39:03.542674 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ee9c93e7-0df3-4084-9dcf-c35972a9aae0 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Returning 404 to user: Instance b2fbbb75-1f0b-4095-8a22-df673b44686d could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:39:03.542674 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ee9c93e7-0df3-4084-9dcf-c35972a9aae0 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b2fbbb75-1f0b-4095-8a22-df673b44686d" status: 404 len: 111 microversion: 2.1 time: 0.035368 Oct 04 18:39:03.542674 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1347/2755] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:39:03 2022] DELETE /compute/v2.1/servers/b2fbbb75-1f0b-4095-8a22-df673b44686d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:39:03.546399 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b45df4d1-37ef-439d-9284-b953adc146bb tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:03.549881 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b45df4d1-37ef-439d-9284-b953adc146bb tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] [instance: b2fbbb75-1f0b-4095-8a22-df673b44686d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:03.553523 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b45df4d1-37ef-439d-9284-b953adc146bb tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:03.554083 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b45df4d1-37ef-439d-9284-b953adc146bb tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:03.554546 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b45df4d1-37ef-439d-9284-b953adc146bb tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:03.555317 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b45df4d1-37ef-439d-9284-b953adc146bb tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:03.555780 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b45df4d1-37ef-439d-9284-b953adc146bb tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:03.556247 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b45df4d1-37ef-439d-9284-b953adc146bb tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:03.576330 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-b45df4d1-37ef-439d-9284-b953adc146bb tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] HTTP exception thrown: Instance b2fbbb75-1f0b-4095-8a22-df673b44686d could not be found. Oct 04 18:39:03.577954 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b45df4d1-37ef-439d-9284-b953adc146bb tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Request method failure captured: Oct 04 18:39:03.577954 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/b2fbbb75-1f0b-4095-8a22-df673b44686d HTTP/1.1 Oct 04 18:39:03.577954 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:39:03.577954 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:39:03.577954 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:39:03.577954 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:39:03.577954 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:39:03.577954 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:39:03.577954 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:39:03.577954 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:39:03.577954 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH2beENVg86XB0IOBJgXRtfOz9MNyEZzm1T3BnAnVV3XxUy3BSWr35rMZtOd7BUIMnMQZyXW35c4qbXYkBrrAiLeZi5gd17-aiIWHgScTedbN4TcjlVBNPIJoks9JeryuuLldwUyYrMCrSWCFSHl_LWQp3bocGsqcjyU-FZDfEuunu0 Oct 04 18:39:03.577954 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:39:03.577954 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:39:03.577954 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:39:03.577954 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:39:03.577954 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:39:03.577954 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:39:03.577954 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 0e42e9f6c747493685a49d70d7061a37 Oct 04 18:39:03.577954 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServerGroupTestJSON-892650054 Oct 04 18:39:03.577954 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:39:03.577954 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:39:03.577954 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e42e9f6c747493685a49d70d7061a37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0e42e9f6c747493685a49d70d7061a37", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0e42e9f6c747493685a49d70d7061a37"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e42e9f6c747493685a49d70d7061a37"}]}] Oct 04 18:39:03.577954 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServerGroupTestJSON-892650054 Oct 04 18:39:03.577954 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 0e42e9f6c747493685a49d70d7061a37 Oct 04 18:39:03.577954 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServerGroupTestJSON-892650054 Oct 04 18:39:03.577954 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServerGroupTestJSON-892650054-project Oct 04 18:39:03.577954 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:39:03.577954 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:39:03.577954 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: bc7d2e249cfc4feb92c8486a892b8b6d Oct 04 18:39:03.577954 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServerGroupTestJSON-892650054-project Oct 04 18:39:03.577954 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:39:03.577954 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance b2fbbb75-1f0b-4095-8a22-df673b44686d could not be found. Oct 04 18:39:03.577954 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'b2fbbb75-1f0b-4095-8a22-df673b44686d'} Oct 04 18:39:03.577954 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:39:03.577954 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:03.577954 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:39:03.577954 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:39:03.577954 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:39:03.577954 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:39:03.577954 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:39:03.577954 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:39:03.577954 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:39:03.577954 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:39:03.577954 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2fbbb75-1f0b-4095-8a22-df673b44686d could not be found. Oct 04 18:39:03.577954 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:39:03.577954 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:39:03.577954 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:39:03.577954 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:03.577954 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:39:03.577954 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:39:03.577954 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:39:03.577954 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:39:03.577954 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:39:03.577954 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:39:03.577954 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:39:03.577954 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:39:03.577954 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:39:03.577954 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:39:03.577954 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:39:03.577954 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:39:03.577954 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2fbbb75-1f0b-4095-8a22-df673b44686d could not be found. Oct 04 18:39:03.577954 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:39:03.577954 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:39:03.577954 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:39:03.592044 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:03.592044 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:39:03.592044 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:39:03.592044 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:39:03.592044 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:39:03.592044 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2fbbb75-1f0b-4095-8a22-df673b44686d could not be found. Oct 04 18:39:03.592044 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:39:03.592044 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b45df4d1-37ef-439d-9284-b953adc146bb tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Returning 404 to user: Instance b2fbbb75-1f0b-4095-8a22-df673b44686d could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:39:03.592044 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b45df4d1-37ef-439d-9284-b953adc146bb tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] 10.222.0.20 "GET /compute/v2.1/servers/b2fbbb75-1f0b-4095-8a22-df673b44686d" status: 404 len: 111 microversion: 2.1 time: 0.037857 Oct 04 18:39:03.592044 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1409/2756] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:03 2022] GET /compute/v2.1/servers/b2fbbb75-1f0b-4095-8a22-df673b44686d => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:39:03.592688 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1b78c379-cc7c-40cc-bf49-998577e38a75 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:03.596547 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-1b78c379-cc7c-40cc-bf49-998577e38a75 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] HTTP exception thrown: Instance group b086edde-08de-4b15-a685-cfede2c3fc2d could not be found. Oct 04 18:39:03.605740 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1b78c379-cc7c-40cc-bf49-998577e38a75 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Request method failure captured: Oct 04 18:39:03.605740 n-d-850501-14 devstack@n-api.service[123001]: request: DELETE /compute/v2.1/os-server-groups/b086edde-08de-4b15-a685-cfede2c3fc2d HTTP/1.1 Oct 04 18:39:03.605740 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:39:03.605740 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:39:03.605740 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:39:03.605740 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:39:03.605740 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:39:03.605740 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:39:03.605740 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:39:03.605740 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:39:03.605740 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPH2beENVg86XB0IOBJgXRtfOz9MNyEZzm1T3BnAnVV3XxUy3BSWr35rMZtOd7BUIMnMQZyXW35c4qbXYkBrrAiLeZi5gd17-aiIWHgScTedbN4TcjlVBNPIJoks9JeryuuLldwUyYrMCrSWCFSHl_LWQp3bocGsqcjyU-FZDfEuunu0 Oct 04 18:39:03.605740 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:39:03.605740 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:39:03.605740 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:39:03.605740 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:39:03.605740 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:39:03.605740 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:39:03.605740 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 0e42e9f6c747493685a49d70d7061a37 Oct 04 18:39:03.605740 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ServerGroupTestJSON-892650054 Oct 04 18:39:03.605740 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:39:03.605740 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:39:03.605740 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e42e9f6c747493685a49d70d7061a37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0e42e9f6c747493685a49d70d7061a37", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0e42e9f6c747493685a49d70d7061a37"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e42e9f6c747493685a49d70d7061a37"}]}] Oct 04 18:39:03.605740 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ServerGroupTestJSON-892650054 Oct 04 18:39:03.605740 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 0e42e9f6c747493685a49d70d7061a37 Oct 04 18:39:03.605740 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ServerGroupTestJSON-892650054 Oct 04 18:39:03.605740 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ServerGroupTestJSON-892650054-project Oct 04 18:39:03.605740 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:39:03.605740 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:39:03.605740 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: bc7d2e249cfc4feb92c8486a892b8b6d Oct 04 18:39:03.605740 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ServerGroupTestJSON-892650054-project Oct 04 18:39:03.605740 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:39:03.605740 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance group b086edde-08de-4b15-a685-cfede2c3fc2d could not be found. Oct 04 18:39:03.605740 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': 'b086edde-08de-4b15-a685-cfede2c3fc2d'} Oct 04 18:39:03.605740 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:39:03.605740 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:03.605740 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 04 18:39:03.605740 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 04 18:39:03.605740 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:39:03.605740 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:39:03.605740 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 04 18:39:03.605740 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 04 18:39:03.605740 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:39:03.605740 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:39:03.605740 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 04 18:39:03.605740 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 04 18:39:03.605740 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group b086edde-08de-4b15-a685-cfede2c3fc2d could not be found. Oct 04 18:39:03.605740 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:39:03.605740 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:39:03.605740 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:39:03.605740 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:03.605740 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:39:03.605740 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:39:03.605740 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:39:03.605740 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:39:03.605740 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:39:03.605740 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:39:03.605740 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 04 18:39:03.605740 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:39:03.605740 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group b086edde-08de-4b15-a685-cfede2c3fc2d could not be found. Oct 04 18:39:03.605740 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:39:03.605740 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:39:03.605740 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:39:03.605740 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:03.610456 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:39:03.610456 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:39:03.610456 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:39:03.610456 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:39:03.610456 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group b086edde-08de-4b15-a685-cfede2c3fc2d could not be found. Oct 04 18:39:03.610456 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:39:03.610456 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1b78c379-cc7c-40cc-bf49-998577e38a75 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Returning 404 to user: Instance group b086edde-08de-4b15-a685-cfede2c3fc2d could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:39:03.611499 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1b78c379-cc7c-40cc-bf49-998577e38a75 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/b086edde-08de-4b15-a685-cfede2c3fc2d" status: 404 len: 117 microversion: 2.1 time: 0.026904 Oct 04 18:39:03.612192 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1348/2757] 10.222.0.20 () {58 vars in 1266 bytes} [Tue Oct 4 18:39:03 2022] DELETE /compute/v2.1/os-server-groups/b086edde-08de-4b15-a685-cfede2c3fc2d => generated 117 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:39:03.622849 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-26d1219c-c3db-4644-bf92-75cc1d03e39c tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:03.631277 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-26d1219c-c3db-4644-bf92-75cc1d03e39c tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] HTTP exception thrown: Instance group c07ec8ff-0f80-4642-ad6c-a261d389ca4c could not be found. Oct 04 18:39:03.634075 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-26d1219c-c3db-4644-bf92-75cc1d03e39c tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Request method failure captured: Oct 04 18:39:03.634075 n-d-850501-14 devstack@n-api.service[123002]: request: DELETE /compute/v2.1/os-server-groups/c07ec8ff-0f80-4642-ad6c-a261d389ca4c HTTP/1.1 Oct 04 18:39:03.634075 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:39:03.634075 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:39:03.634075 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:39:03.634075 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:39:03.634075 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:39:03.634075 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:39:03.634075 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:39:03.634075 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:39:03.634075 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH2beENVg86XB0IOBJgXRtfOz9MNyEZzm1T3BnAnVV3XxUy3BSWr35rMZtOd7BUIMnMQZyXW35c4qbXYkBrrAiLeZi5gd17-aiIWHgScTedbN4TcjlVBNPIJoks9JeryuuLldwUyYrMCrSWCFSHl_LWQp3bocGsqcjyU-FZDfEuunu0 Oct 04 18:39:03.634075 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:39:03.634075 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:39:03.634075 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:39:03.634075 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:39:03.634075 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:39:03.634075 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:39:03.634075 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 0e42e9f6c747493685a49d70d7061a37 Oct 04 18:39:03.634075 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServerGroupTestJSON-892650054 Oct 04 18:39:03.634075 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:39:03.634075 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:39:03.634075 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e42e9f6c747493685a49d70d7061a37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0e42e9f6c747493685a49d70d7061a37", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0e42e9f6c747493685a49d70d7061a37"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e42e9f6c747493685a49d70d7061a37"}]}] Oct 04 18:39:03.634075 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServerGroupTestJSON-892650054 Oct 04 18:39:03.634075 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 0e42e9f6c747493685a49d70d7061a37 Oct 04 18:39:03.634075 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServerGroupTestJSON-892650054 Oct 04 18:39:03.634075 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServerGroupTestJSON-892650054-project Oct 04 18:39:03.634075 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:39:03.634075 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:39:03.634075 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: bc7d2e249cfc4feb92c8486a892b8b6d Oct 04 18:39:03.634075 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServerGroupTestJSON-892650054-project Oct 04 18:39:03.634075 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:39:03.634075 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance group c07ec8ff-0f80-4642-ad6c-a261d389ca4c could not be found. Oct 04 18:39:03.634075 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'c07ec8ff-0f80-4642-ad6c-a261d389ca4c'} Oct 04 18:39:03.634075 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:39:03.634075 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:03.634075 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 04 18:39:03.634075 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 04 18:39:03.634075 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:39:03.634075 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:39:03.634075 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 04 18:39:03.634075 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 04 18:39:03.634075 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:39:03.634075 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:39:03.634075 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 04 18:39:03.634075 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 04 18:39:03.634075 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group c07ec8ff-0f80-4642-ad6c-a261d389ca4c could not be found. Oct 04 18:39:03.634075 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:39:03.634075 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:39:03.634075 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:39:03.634075 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:03.634075 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:39:03.634075 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:39:03.634075 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:39:03.634075 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:39:03.634075 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:39:03.634075 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:39:03.634075 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 04 18:39:03.634075 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:39:03.634075 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group c07ec8ff-0f80-4642-ad6c-a261d389ca4c could not be found. Oct 04 18:39:03.634075 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:39:03.634075 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:39:03.634075 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:39:03.634075 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:03.640745 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:39:03.640745 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:39:03.640745 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:39:03.640745 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:39:03.640745 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group c07ec8ff-0f80-4642-ad6c-a261d389ca4c could not be found. Oct 04 18:39:03.640745 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:39:03.640745 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-26d1219c-c3db-4644-bf92-75cc1d03e39c tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Returning 404 to user: Instance group c07ec8ff-0f80-4642-ad6c-a261d389ca4c could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:39:03.640745 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-26d1219c-c3db-4644-bf92-75cc1d03e39c tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/c07ec8ff-0f80-4642-ad6c-a261d389ca4c" status: 404 len: 117 microversion: 2.1 time: 0.019453 Oct 04 18:39:03.640745 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1410/2758] 10.222.0.20 () {58 vars in 1266 bytes} [Tue Oct 4 18:39:03 2022] DELETE /compute/v2.1/os-server-groups/c07ec8ff-0f80-4642-ad6c-a261d389ca4c => generated 117 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:39:03.653476 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-96ae2f41-e3be-4cc8-8d71-aa95a4ec6619 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:03.668332 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-96ae2f41-e3be-4cc8-8d71-aa95a4ec6619 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] HTTP exception thrown: Instance group a4ca6ff6-cc0c-4e62-9af4-60894159f748 could not be found. Oct 04 18:39:03.674556 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-96ae2f41-e3be-4cc8-8d71-aa95a4ec6619 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Request method failure captured: Oct 04 18:39:03.674556 n-d-850501-14 devstack@n-api.service[123001]: request: DELETE /compute/v2.1/os-server-groups/a4ca6ff6-cc0c-4e62-9af4-60894159f748 HTTP/1.1 Oct 04 18:39:03.674556 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:39:03.674556 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:39:03.674556 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:39:03.674556 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:39:03.674556 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:39:03.674556 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:39:03.674556 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:39:03.674556 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:39:03.674556 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPH2beENVg86XB0IOBJgXRtfOz9MNyEZzm1T3BnAnVV3XxUy3BSWr35rMZtOd7BUIMnMQZyXW35c4qbXYkBrrAiLeZi5gd17-aiIWHgScTedbN4TcjlVBNPIJoks9JeryuuLldwUyYrMCrSWCFSHl_LWQp3bocGsqcjyU-FZDfEuunu0 Oct 04 18:39:03.674556 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:39:03.674556 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:39:03.674556 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:39:03.674556 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:39:03.674556 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:39:03.674556 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:39:03.674556 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 0e42e9f6c747493685a49d70d7061a37 Oct 04 18:39:03.674556 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ServerGroupTestJSON-892650054 Oct 04 18:39:03.674556 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:39:03.674556 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:39:03.674556 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e42e9f6c747493685a49d70d7061a37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0e42e9f6c747493685a49d70d7061a37", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0e42e9f6c747493685a49d70d7061a37"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e42e9f6c747493685a49d70d7061a37"}]}] Oct 04 18:39:03.674556 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ServerGroupTestJSON-892650054 Oct 04 18:39:03.674556 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 0e42e9f6c747493685a49d70d7061a37 Oct 04 18:39:03.674556 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ServerGroupTestJSON-892650054 Oct 04 18:39:03.674556 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ServerGroupTestJSON-892650054-project Oct 04 18:39:03.674556 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:39:03.674556 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:39:03.674556 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: bc7d2e249cfc4feb92c8486a892b8b6d Oct 04 18:39:03.674556 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ServerGroupTestJSON-892650054-project Oct 04 18:39:03.674556 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:39:03.674556 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance group a4ca6ff6-cc0c-4e62-9af4-60894159f748 could not be found. Oct 04 18:39:03.674556 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': 'a4ca6ff6-cc0c-4e62-9af4-60894159f748'} Oct 04 18:39:03.674556 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:39:03.674556 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:03.674556 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 04 18:39:03.674556 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 04 18:39:03.674556 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:39:03.674556 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:39:03.674556 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 04 18:39:03.674556 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 04 18:39:03.674556 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:39:03.674556 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:39:03.674556 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 04 18:39:03.674556 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 04 18:39:03.674556 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group a4ca6ff6-cc0c-4e62-9af4-60894159f748 could not be found. Oct 04 18:39:03.674556 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:39:03.674556 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:39:03.674556 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:39:03.674556 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:03.674556 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:39:03.674556 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:39:03.674556 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:39:03.674556 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:39:03.674556 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:39:03.674556 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:39:03.674556 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 04 18:39:03.674556 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:39:03.674556 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group a4ca6ff6-cc0c-4e62-9af4-60894159f748 could not be found. Oct 04 18:39:03.674556 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:39:03.674556 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:39:03.674556 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:39:03.674556 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:03.681112 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:39:03.681112 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:39:03.681112 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:39:03.681112 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:39:03.681112 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group a4ca6ff6-cc0c-4e62-9af4-60894159f748 could not be found. Oct 04 18:39:03.681112 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:39:03.681112 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-96ae2f41-e3be-4cc8-8d71-aa95a4ec6619 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Returning 404 to user: Instance group a4ca6ff6-cc0c-4e62-9af4-60894159f748 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:39:03.681112 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-96ae2f41-e3be-4cc8-8d71-aa95a4ec6619 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/a4ca6ff6-cc0c-4e62-9af4-60894159f748" status: 404 len: 117 microversion: 2.1 time: 0.031399 Oct 04 18:39:03.685094 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1349/2759] 10.222.0.20 () {58 vars in 1266 bytes} [Tue Oct 4 18:39:03 2022] DELETE /compute/v2.1/os-server-groups/a4ca6ff6-cc0c-4e62-9af4-60894159f748 => generated 117 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:39:03.686639 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3828edc2-726b-4e23-a1b9-2cf2c3ff19f0 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:03.695600 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-3828edc2-726b-4e23-a1b9-2cf2c3ff19f0 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] HTTP exception thrown: Instance group 3c0b88f8-2bee-4d53-9958-aed4deac7af7 could not be found. Oct 04 18:39:03.698492 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3828edc2-726b-4e23-a1b9-2cf2c3ff19f0 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Request method failure captured: Oct 04 18:39:03.698492 n-d-850501-14 devstack@n-api.service[123002]: request: DELETE /compute/v2.1/os-server-groups/3c0b88f8-2bee-4d53-9958-aed4deac7af7 HTTP/1.1 Oct 04 18:39:03.698492 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:39:03.698492 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:39:03.698492 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:39:03.698492 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:39:03.698492 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:39:03.698492 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:39:03.698492 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:39:03.698492 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:39:03.698492 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH2beENVg86XB0IOBJgXRtfOz9MNyEZzm1T3BnAnVV3XxUy3BSWr35rMZtOd7BUIMnMQZyXW35c4qbXYkBrrAiLeZi5gd17-aiIWHgScTedbN4TcjlVBNPIJoks9JeryuuLldwUyYrMCrSWCFSHl_LWQp3bocGsqcjyU-FZDfEuunu0 Oct 04 18:39:03.698492 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:39:03.698492 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:39:03.698492 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:39:03.698492 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:39:03.698492 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:39:03.698492 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:39:03.698492 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 0e42e9f6c747493685a49d70d7061a37 Oct 04 18:39:03.698492 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServerGroupTestJSON-892650054 Oct 04 18:39:03.698492 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:39:03.698492 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:39:03.698492 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e42e9f6c747493685a49d70d7061a37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0e42e9f6c747493685a49d70d7061a37", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0e42e9f6c747493685a49d70d7061a37"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e42e9f6c747493685a49d70d7061a37"}]}] Oct 04 18:39:03.698492 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServerGroupTestJSON-892650054 Oct 04 18:39:03.698492 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 0e42e9f6c747493685a49d70d7061a37 Oct 04 18:39:03.698492 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServerGroupTestJSON-892650054 Oct 04 18:39:03.698492 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServerGroupTestJSON-892650054-project Oct 04 18:39:03.698492 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:39:03.698492 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:39:03.698492 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: bc7d2e249cfc4feb92c8486a892b8b6d Oct 04 18:39:03.698492 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServerGroupTestJSON-892650054-project Oct 04 18:39:03.698492 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:39:03.698492 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance group 3c0b88f8-2bee-4d53-9958-aed4deac7af7 could not be found. Oct 04 18:39:03.698492 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '3c0b88f8-2bee-4d53-9958-aed4deac7af7'} Oct 04 18:39:03.698492 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:39:03.698492 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:03.698492 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 04 18:39:03.698492 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 04 18:39:03.698492 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:39:03.698492 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:39:03.698492 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 04 18:39:03.698492 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 04 18:39:03.698492 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:39:03.698492 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:39:03.698492 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 04 18:39:03.698492 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 04 18:39:03.698492 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 3c0b88f8-2bee-4d53-9958-aed4deac7af7 could not be found. Oct 04 18:39:03.698492 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:39:03.698492 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:39:03.698492 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:39:03.698492 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:03.698492 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:39:03.698492 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:39:03.698492 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:39:03.698492 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:39:03.698492 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:39:03.698492 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:39:03.698492 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 04 18:39:03.698492 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:39:03.698492 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 3c0b88f8-2bee-4d53-9958-aed4deac7af7 could not be found. Oct 04 18:39:03.698492 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:39:03.698492 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:39:03.698492 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:39:03.698492 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:03.711453 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:39:03.711453 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:39:03.711453 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:39:03.711453 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:39:03.711453 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 3c0b88f8-2bee-4d53-9958-aed4deac7af7 could not be found. Oct 04 18:39:03.711453 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:39:03.711453 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3828edc2-726b-4e23-a1b9-2cf2c3ff19f0 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Returning 404 to user: Instance group 3c0b88f8-2bee-4d53-9958-aed4deac7af7 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:39:03.711453 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3828edc2-726b-4e23-a1b9-2cf2c3ff19f0 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/3c0b88f8-2bee-4d53-9958-aed4deac7af7" status: 404 len: 117 microversion: 2.1 time: 0.018915 Oct 04 18:39:03.711453 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1411/2760] 10.222.0.20 () {58 vars in 1266 bytes} [Tue Oct 4 18:39:03 2022] DELETE /compute/v2.1/os-server-groups/3c0b88f8-2bee-4d53-9958-aed4deac7af7 => generated 117 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:39:03.719348 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5a04208b-5166-45c9-9696-3c227ff006f1 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:03.845492 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5a04208b-5166-45c9-9696-3c227ff006f1 tempest-ServerGroupTestJSON-892650054 tempest-ServerGroupTestJSON-892650054-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/566c9cd3-5a33-4703-b552-fa6d89d554f7" status: 204 len: 0 microversion: 2.1 time: 0.130120 Oct 04 18:39:03.845492 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1350/2761] 10.222.0.20 () {58 vars in 1266 bytes} [Tue Oct 4 18:39:03 2022] DELETE /compute/v2.1/os-server-groups/566c9cd3-5a33-4703-b552-fa6d89d554f7 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:39:03.958904 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c7d7f69c-5ea2-4f53-b21a-5c0772b6112f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:03.960090 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c7d7f69c-5ea2-4f53-b21a-5c0772b6112f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2e308f41-242e-4ce3-8641-9510e2f13681] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:03.968015 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c7d7f69c-5ea2-4f53-b21a-5c0772b6112f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:03.968463 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c7d7f69c-5ea2-4f53-b21a-5c0772b6112f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:03.968904 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c7d7f69c-5ea2-4f53-b21a-5c0772b6112f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:03.969613 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c7d7f69c-5ea2-4f53-b21a-5c0772b6112f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:03.970080 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c7d7f69c-5ea2-4f53-b21a-5c0772b6112f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:03.970514 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c7d7f69c-5ea2-4f53-b21a-5c0772b6112f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:04.035455 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-982a9141-a79b-440b-8d2d-b9dca180726c tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:04.040563 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-982a9141-a79b-440b-8d2d-b9dca180726c tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: b4ccd5ac-9465-43d8-9a5f-127152966ce8] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:04.043864 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-982a9141-a79b-440b-8d2d-b9dca180726c tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:04.044399 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-982a9141-a79b-440b-8d2d-b9dca180726c tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:04.045024 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-982a9141-a79b-440b-8d2d-b9dca180726c tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:04.045974 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-982a9141-a79b-440b-8d2d-b9dca180726c tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:04.046433 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-982a9141-a79b-440b-8d2d-b9dca180726c tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:04.047070 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-982a9141-a79b-440b-8d2d-b9dca180726c tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:04.351216 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c7d7f69c-5ea2-4f53-b21a-5c0772b6112f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:04.372762 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c7d7f69c-5ea2-4f53-b21a-5c0772b6112f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681" status: 200 len: 1312 microversion: 2.1 time: 0.417787 Oct 04 18:39:04.391135 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1412/2762] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:03 2022] GET /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681 => generated 1312 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:04.396666 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-1aa8ab77-48d3-40f9-8206-832f7095cb9c req-51b53eff-fde7-4864-884b-abc645f07e89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4ccd5ac-9465-43d8-9a5f-127152966ce8", "tag": "baaa19b1-78c3-40d1-b1e3-7d1931b20e8b"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:04.410093 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-1aa8ab77-48d3-40f9-8206-832f7095cb9c req-51b53eff-fde7-4864-884b-abc645f07e89 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:04.410894 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-1aa8ab77-48d3-40f9-8206-832f7095cb9c req-51b53eff-fde7-4864-884b-abc645f07e89 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:04.411686 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-1aa8ab77-48d3-40f9-8206-832f7095cb9c req-51b53eff-fde7-4864-884b-abc645f07e89 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:04.432084 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-1aa8ab77-48d3-40f9-8206-832f7095cb9c req-51b53eff-fde7-4864-884b-abc645f07e89 service nova] Creating event network-changed:baaa19b1-78c3-40d1-b1e3-7d1931b20e8b for instance b4ccd5ac-9465-43d8-9a5f-127152966ce8 on n-h2-850501-14 Oct 04 18:39:04.440455 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-1aa8ab77-48d3-40f9-8206-832f7095cb9c req-51b53eff-fde7-4864-884b-abc645f07e89 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053044 Oct 04 18:39:04.441778 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1413/2763] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:39:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:04.460147 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-308e75e2-3b59-484b-b684-e04796c05d04 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:04.465607 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-308e75e2-3b59-484b-b684-e04796c05d04 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 4e1bb5af-9b8b-456f-beb1-aadf2491a8ed] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:04.484478 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-982a9141-a79b-440b-8d2d-b9dca180726c tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8358c07e2684b749a62becb9f0b7869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b922a74c1c2448bb770d6b298b2d601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:04.489279 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-308e75e2-3b59-484b-b684-e04796c05d04 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:04.490223 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-308e75e2-3b59-484b-b684-e04796c05d04 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:04.495653 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-308e75e2-3b59-484b-b684-e04796c05d04 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:04.506036 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-308e75e2-3b59-484b-b684-e04796c05d04 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:04.506036 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-308e75e2-3b59-484b-b684-e04796c05d04 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:04.506036 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-308e75e2-3b59-484b-b684-e04796c05d04 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:04.506289 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-982a9141-a79b-440b-8d2d-b9dca180726c tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "GET /compute/v2.1/servers/b4ccd5ac-9465-43d8-9a5f-127152966ce8" status: 200 len: 1313 microversion: 2.1 time: 0.465430 Oct 04 18:39:04.506289 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1351/2764] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:04 2022] GET /compute/v2.1/servers/b4ccd5ac-9465-43d8-9a5f-127152966ce8 => generated 1313 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:04.509475 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ae2246fa-e1f8-4b4c-b4df-5c3884610594 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:04.510619 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ae2246fa-e1f8-4b4c-b4df-5c3884610594 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 5965d934-6f27-43ac-bf15-8fd20da48cc1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:04.516915 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-308e75e2-3b59-484b-b684-e04796c05d04 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] HTTP exception thrown: Instance 4e1bb5af-9b8b-456f-beb1-aadf2491a8ed could not be found. Oct 04 18:39:04.518219 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ae2246fa-e1f8-4b4c-b4df-5c3884610594 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:04.521072 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-308e75e2-3b59-484b-b684-e04796c05d04 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Request method failure captured: Oct 04 18:39:04.521072 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/4e1bb5af-9b8b-456f-beb1-aadf2491a8ed HTTP/1.1 Oct 04 18:39:04.521072 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:39:04.521072 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:39:04.521072 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:39:04.521072 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:39:04.521072 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:39:04.521072 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:39:04.521072 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:39:04.521072 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:39:04.521072 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPHulPRClkzd6kBQ81rrBhumMq88AYIanAk2xdeHK5U7wVgRC25-TXMgOlEBZg6WJpOKuV9BZwqY7S9UVeacMmO6BXdoABSwoaanCO5yf8qjOFgEjgLyJbKDRoktuo-EczFm_S4RGYEsRlB3A3Vi9-kDkYqoEQcS34joufFbsOIKcLTo Oct 04 18:39:04.521072 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:39:04.521072 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:39:04.521072 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:39:04.521072 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:39:04.521072 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:39:04.521072 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:39:04.521072 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: dde62f171d474b038f1af39899518211 Oct 04 18:39:04.521072 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-LiveMigrationTest-1583731626 Oct 04 18:39:04.521072 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:39:04.521072 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:39:04.521072 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dde62f171d474b038f1af39899518211"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dde62f171d474b038f1af39899518211", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dde62f171d474b038f1af39899518211"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dde62f171d474b038f1af39899518211"}]}] Oct 04 18:39:04.521072 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-LiveMigrationTest-1583731626 Oct 04 18:39:04.521072 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: dde62f171d474b038f1af39899518211 Oct 04 18:39:04.521072 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-LiveMigrationTest-1583731626 Oct 04 18:39:04.521072 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-LiveMigrationTest-1583731626-project Oct 04 18:39:04.521072 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:39:04.521072 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:39:04.521072 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: c80f2b2dbf824a1d879f5b7edb343f26 Oct 04 18:39:04.521072 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-LiveMigrationTest-1583731626-project Oct 04 18:39:04.521072 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:39:04.521072 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 4e1bb5af-9b8b-456f-beb1-aadf2491a8ed could not be found. Oct 04 18:39:04.521072 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '4e1bb5af-9b8b-456f-beb1-aadf2491a8ed'} Oct 04 18:39:04.521072 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:39:04.521072 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:04.521072 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:39:04.521072 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:39:04.521072 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:39:04.521072 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:39:04.521072 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:39:04.521072 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:39:04.521072 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:39:04.521072 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:39:04.521072 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e1bb5af-9b8b-456f-beb1-aadf2491a8ed could not be found. Oct 04 18:39:04.521072 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:39:04.521072 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:39:04.521072 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:39:04.521072 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:04.521072 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:39:04.521072 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:39:04.521072 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:39:04.521072 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:39:04.521072 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:39:04.521072 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:39:04.521072 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:39:04.521072 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:39:04.521072 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:39:04.521072 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:39:04.521072 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:39:04.521072 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:39:04.521072 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e1bb5af-9b8b-456f-beb1-aadf2491a8ed could not be found. Oct 04 18:39:04.521072 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:39:04.521072 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:39:04.521072 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:39:04.526621 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:04.526621 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:39:04.526621 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:39:04.526621 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:39:04.526621 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:39:04.526621 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e1bb5af-9b8b-456f-beb1-aadf2491a8ed could not be found. Oct 04 18:39:04.526621 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:39:04.527036 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ae2246fa-e1f8-4b4c-b4df-5c3884610594 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:04.527115 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ae2246fa-e1f8-4b4c-b4df-5c3884610594 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:04.527987 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ae2246fa-e1f8-4b4c-b4df-5c3884610594 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:04.531429 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-308e75e2-3b59-484b-b684-e04796c05d04 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Returning 404 to user: Instance 4e1bb5af-9b8b-456f-beb1-aadf2491a8ed could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:39:04.533959 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-308e75e2-3b59-484b-b684-e04796c05d04 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/4e1bb5af-9b8b-456f-beb1-aadf2491a8ed" status: 404 len: 111 microversion: 2.1 time: 0.090608 Oct 04 18:39:04.535034 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1414/2765] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:04 2022] GET /compute/v2.1/servers/4e1bb5af-9b8b-456f-beb1-aadf2491a8ed => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:39:04.537032 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ae2246fa-e1f8-4b4c-b4df-5c3884610594 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:04.537773 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ae2246fa-e1f8-4b4c-b4df-5c3884610594 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:04.563295 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c4b01e52-65f9-403e-8d4c-391a4981d598 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:04.565083 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c4b01e52-65f9-403e-8d4c-391a4981d598 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 89738dfe-3844-455a-93d1-d38702038946] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:04.580173 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c4b01e52-65f9-403e-8d4c-391a4981d598 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:04.580173 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c4b01e52-65f9-403e-8d4c-391a4981d598 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:04.580173 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c4b01e52-65f9-403e-8d4c-391a4981d598 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:04.580173 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c4b01e52-65f9-403e-8d4c-391a4981d598 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:04.581211 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c4b01e52-65f9-403e-8d4c-391a4981d598 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:04.581996 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c4b01e52-65f9-403e-8d4c-391a4981d598 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:04.615552 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c4b01e52-65f9-403e-8d4c-391a4981d598 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 89738dfe-3844-455a-93d1-d38702038946] Going to try to terminate instance {{(pid=123002) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:39:05.002690 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ae2246fa-e1f8-4b4c-b4df-5c3884610594 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8284fe51decd4db0bf6b3ed1514cc2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87473abf47e74adf844e3ddfa24da3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:05.029560 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ae2246fa-e1f8-4b4c-b4df-5c3884610594 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] 10.222.0.20 "GET /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1" status: 200 len: 1505 microversion: 2.1 time: 0.524834 Oct 04 18:39:05.030257 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1352/2766] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:04 2022] GET /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1 => generated 1505 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:05.136245 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c4b01e52-65f9-403e-8d4c-391a4981d598 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "DELETE /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946" status: 204 len: 0 microversion: 2.1 time: 0.583780 Oct 04 18:39:05.138742 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1415/2767] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:39:04 2022] DELETE /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946 => generated 0 bytes in 592 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:39:05.151839 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f3556812-48c5-4811-86b0-9600951fa8b8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:05.152579 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f3556812-48c5-4811-86b0-9600951fa8b8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 89738dfe-3844-455a-93d1-d38702038946] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:05.159596 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f3556812-48c5-4811-86b0-9600951fa8b8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:05.160135 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f3556812-48c5-4811-86b0-9600951fa8b8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:05.160605 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f3556812-48c5-4811-86b0-9600951fa8b8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:05.161310 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f3556812-48c5-4811-86b0-9600951fa8b8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:05.161771 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f3556812-48c5-4811-86b0-9600951fa8b8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:05.162308 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f3556812-48c5-4811-86b0-9600951fa8b8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:05.401576 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0336dca5-0de0-443e-ac5f-532857601b31 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:05.403300 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0336dca5-0de0-443e-ac5f-532857601b31 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2e308f41-242e-4ce3-8641-9510e2f13681] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:05.410747 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0336dca5-0de0-443e-ac5f-532857601b31 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:05.411483 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0336dca5-0de0-443e-ac5f-532857601b31 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:05.412107 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0336dca5-0de0-443e-ac5f-532857601b31 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:05.413009 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0336dca5-0de0-443e-ac5f-532857601b31 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:05.413624 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0336dca5-0de0-443e-ac5f-532857601b31 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:05.414199 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0336dca5-0de0-443e-ac5f-532857601b31 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:05.471412 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f3556812-48c5-4811-86b0-9600951fa8b8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:05.480357 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f3556812-48c5-4811-86b0-9600951fa8b8 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946" status: 200 len: 1500 microversion: 2.1 time: 0.332754 Oct 04 18:39:05.481263 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1353/2768] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:05 2022] GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946 => generated 1500 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:05.540842 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e6c2e3b8-d59d-4b04-9946-1d1a1de8c83a tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:05.542493 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e6c2e3b8-d59d-4b04-9946-1d1a1de8c83a tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: b4ccd5ac-9465-43d8-9a5f-127152966ce8] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:05.551234 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e6c2e3b8-d59d-4b04-9946-1d1a1de8c83a tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:05.551833 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e6c2e3b8-d59d-4b04-9946-1d1a1de8c83a tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:05.552360 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e6c2e3b8-d59d-4b04-9946-1d1a1de8c83a tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:05.558003 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e6c2e3b8-d59d-4b04-9946-1d1a1de8c83a tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:05.558003 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e6c2e3b8-d59d-4b04-9946-1d1a1de8c83a tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:05.558003 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e6c2e3b8-d59d-4b04-9946-1d1a1de8c83a tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:05.754989 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0336dca5-0de0-443e-ac5f-532857601b31 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:05.764308 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0336dca5-0de0-443e-ac5f-532857601b31 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681" status: 200 len: 1462 microversion: 2.1 time: 0.368816 Oct 04 18:39:05.765555 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1416/2769] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:05 2022] GET /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681 => generated 1462 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:05.795709 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-afd7a875-4dbe-4809-ac64-54ce27ec3c81 tempest-MigrationsAdminTest-1101631867 tempest-MigrationsAdminTest-1101631867-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:05.796421 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-afd7a875-4dbe-4809-ac64-54ce27ec3c81 tempest-MigrationsAdminTest-1101631867 tempest-MigrationsAdminTest-1101631867-project-admin] [instance: 2e308f41-242e-4ce3-8641-9510e2f13681] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:05.802698 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-afd7a875-4dbe-4809-ac64-54ce27ec3c81 tempest-MigrationsAdminTest-1101631867 tempest-MigrationsAdminTest-1101631867-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:05.806241 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-afd7a875-4dbe-4809-ac64-54ce27ec3c81 tempest-MigrationsAdminTest-1101631867 tempest-MigrationsAdminTest-1101631867-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:05.806241 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-afd7a875-4dbe-4809-ac64-54ce27ec3c81 tempest-MigrationsAdminTest-1101631867 tempest-MigrationsAdminTest-1101631867-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:05.806241 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-afd7a875-4dbe-4809-ac64-54ce27ec3c81 tempest-MigrationsAdminTest-1101631867 tempest-MigrationsAdminTest-1101631867-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:05.806241 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-afd7a875-4dbe-4809-ac64-54ce27ec3c81 tempest-MigrationsAdminTest-1101631867 tempest-MigrationsAdminTest-1101631867-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:05.806241 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-afd7a875-4dbe-4809-ac64-54ce27ec3c81 tempest-MigrationsAdminTest-1101631867 tempest-MigrationsAdminTest-1101631867-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:05.949396 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e6c2e3b8-d59d-4b04-9946-1d1a1de8c83a tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8358c07e2684b749a62becb9f0b7869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b922a74c1c2448bb770d6b298b2d601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:05.957790 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e6c2e3b8-d59d-4b04-9946-1d1a1de8c83a tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "GET /compute/v2.1/servers/b4ccd5ac-9465-43d8-9a5f-127152966ce8" status: 200 len: 1313 microversion: 2.1 time: 0.421106 Oct 04 18:39:05.958387 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1354/2770] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:05 2022] GET /compute/v2.1/servers/b4ccd5ac-9465-43d8-9a5f-127152966ce8 => generated 1313 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:06.056330 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-af010945-968c-4a49-a0ee-85cedc652212 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:06.058137 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-af010945-968c-4a49-a0ee-85cedc652212 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 5965d934-6f27-43ac-bf15-8fd20da48cc1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:06.066118 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-af010945-968c-4a49-a0ee-85cedc652212 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:06.067015 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-af010945-968c-4a49-a0ee-85cedc652212 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:06.067525 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-af010945-968c-4a49-a0ee-85cedc652212 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:06.068363 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-af010945-968c-4a49-a0ee-85cedc652212 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:06.068954 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-af010945-968c-4a49-a0ee-85cedc652212 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:06.069429 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-af010945-968c-4a49-a0ee-85cedc652212 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:06.099187 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-afd7a875-4dbe-4809-ac64-54ce27ec3c81 tempest-MigrationsAdminTest-1101631867 tempest-MigrationsAdminTest-1101631867-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681" status: 200 len: 1615 microversion: 2.1 time: 0.307530 Oct 04 18:39:06.100882 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1417/2771] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:05 2022] GET /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681 => generated 1615 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:06.127663 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2623a722-f979-4796-bd3f-12ccd7879d0e tempest-MigrationsAdminTest-1101631867 tempest-MigrationsAdminTest-1101631867-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:06.129378 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2623a722-f979-4796-bd3f-12ccd7879d0e tempest-MigrationsAdminTest-1101631867 tempest-MigrationsAdminTest-1101631867-project-admin] [instance: 2e308f41-242e-4ce3-8641-9510e2f13681] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:06.144404 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2623a722-f979-4796-bd3f-12ccd7879d0e tempest-MigrationsAdminTest-1101631867 tempest-MigrationsAdminTest-1101631867-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:06.145567 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2623a722-f979-4796-bd3f-12ccd7879d0e tempest-MigrationsAdminTest-1101631867 tempest-MigrationsAdminTest-1101631867-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:06.146185 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2623a722-f979-4796-bd3f-12ccd7879d0e tempest-MigrationsAdminTest-1101631867 tempest-MigrationsAdminTest-1101631867-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:06.147485 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2623a722-f979-4796-bd3f-12ccd7879d0e tempest-MigrationsAdminTest-1101631867 tempest-MigrationsAdminTest-1101631867-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:06.148362 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2623a722-f979-4796-bd3f-12ccd7879d0e tempest-MigrationsAdminTest-1101631867 tempest-MigrationsAdminTest-1101631867-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:06.149087 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2623a722-f979-4796-bd3f-12ccd7879d0e tempest-MigrationsAdminTest-1101631867 tempest-MigrationsAdminTest-1101631867-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:06.204184 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2623a722-f979-4796-bd3f-12ccd7879d0e tempest-MigrationsAdminTest-1101631867 tempest-MigrationsAdminTest-1101631867-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '803e67aad71745aebdd938e7f46fb870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30e8d60a7c224546bb88676729b4cc04', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:06.209447 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2623a722-f979-4796-bd3f-12ccd7879d0e tempest-MigrationsAdminTest-1101631867 tempest-MigrationsAdminTest-1101631867-project-admin] [instance: 2e308f41-242e-4ce3-8641-9510e2f13681] flavor_id is None. Assuming migration. {{(pid=123002) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 04 18:39:06.209447 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2623a722-f979-4796-bd3f-12ccd7879d0e tempest-MigrationsAdminTest-1101631867 tempest-MigrationsAdminTest-1101631867-project-admin] [instance: 2e308f41-242e-4ce3-8641-9510e2f13681] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=123002) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 18:39:06.226828 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=6 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:39:06.265984 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=20 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:39:06.490523 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-af010945-968c-4a49-a0ee-85cedc652212 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8284fe51decd4db0bf6b3ed1514cc2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87473abf47e74adf844e3ddfa24da3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:06.501693 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-af010945-968c-4a49-a0ee-85cedc652212 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] 10.222.0.20 "GET /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1" status: 200 len: 1505 microversion: 2.1 time: 0.450775 Oct 04 18:39:06.516101 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1355/2772] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:06 2022] GET /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1 => generated 1505 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:39:06.516101 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-57f89350-0155-4794-a0b1-517b3c3af2cf tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:06.516101 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-57f89350-0155-4794-a0b1-517b3c3af2cf tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 89738dfe-3844-455a-93d1-d38702038946] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:06.527865 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-57f89350-0155-4794-a0b1-517b3c3af2cf tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:06.527865 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-57f89350-0155-4794-a0b1-517b3c3af2cf tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:06.527865 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-57f89350-0155-4794-a0b1-517b3c3af2cf tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:06.527865 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-57f89350-0155-4794-a0b1-517b3c3af2cf tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:06.528609 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-57f89350-0155-4794-a0b1-517b3c3af2cf tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:06.529271 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-57f89350-0155-4794-a0b1-517b3c3af2cf tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:06.932820 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-57f89350-0155-4794-a0b1-517b3c3af2cf tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:06.964878 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=4 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:39:06.975557 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-57f89350-0155-4794-a0b1-517b3c3af2cf tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946" status: 200 len: 1500 microversion: 2.1 time: 0.471733 Oct 04 18:39:06.978267 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2623a722-f979-4796-bd3f-12ccd7879d0e tempest-MigrationsAdminTest-1101631867 tempest-MigrationsAdminTest-1101631867-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681/action" status: 202 len: 0 microversion: 2.1 time: 0.856022 Oct 04 18:39:06.982179 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1356/2773] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:06 2022] GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946 => generated 1500 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:06.985849 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1418/2774] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:39:06 2022] POST /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681/action => generated 0 bytes in 862 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:39:06.990269 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5d317df1-e550-4701-a8bb-3c4bcc507ee5 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:06.990547 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-aa8813b1-612f-447c-b405-3c0df76d6e01 req-968b3787-03d9-497b-8f66-4d7ceb469986 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c343931b-bc96-4e9e-a5ce-f93454339a53", "tag": "c6bfdac3-3f2e-4291-9771-d9e034cf664e"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:06.993861 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5d317df1-e550-4701-a8bb-3c4bcc507ee5 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: b4ccd5ac-9465-43d8-9a5f-127152966ce8] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:07.009440 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5d317df1-e550-4701-a8bb-3c4bcc507ee5 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:07.010303 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5d317df1-e550-4701-a8bb-3c4bcc507ee5 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:07.011438 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5d317df1-e550-4701-a8bb-3c4bcc507ee5 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:07.012206 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5d317df1-e550-4701-a8bb-3c4bcc507ee5 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:07.012672 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5d317df1-e550-4701-a8bb-3c4bcc507ee5 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:07.013207 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5d317df1-e550-4701-a8bb-3c4bcc507ee5 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:07.021081 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-aa8813b1-612f-447c-b405-3c0df76d6e01 req-968b3787-03d9-497b-8f66-4d7ceb469986 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:07.021597 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-aa8813b1-612f-447c-b405-3c0df76d6e01 req-968b3787-03d9-497b-8f66-4d7ceb469986 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:07.022030 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-aa8813b1-612f-447c-b405-3c0df76d6e01 req-968b3787-03d9-497b-8f66-4d7ceb469986 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:07.051497 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-aa8813b1-612f-447c-b405-3c0df76d6e01 req-968b3787-03d9-497b-8f66-4d7ceb469986 service nova] Creating event network-changed:c6bfdac3-3f2e-4291-9771-d9e034cf664e for instance c343931b-bc96-4e9e-a5ce-f93454339a53 on n-h2-850501-14 Oct 04 18:39:07.057685 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-aa8813b1-612f-447c-b405-3c0df76d6e01 req-968b3787-03d9-497b-8f66-4d7ceb469986 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072992 Oct 04 18:39:07.059234 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1357/2775] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:39:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:07.065553 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8eaab5e2-ff00-4e8f-9f49-6052ffb208d2 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:07.066552 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8eaab5e2-ff00-4e8f-9f49-6052ffb208d2 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2e308f41-242e-4ce3-8641-9510e2f13681] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:07.074967 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8eaab5e2-ff00-4e8f-9f49-6052ffb208d2 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:07.075654 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8eaab5e2-ff00-4e8f-9f49-6052ffb208d2 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:07.076308 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8eaab5e2-ff00-4e8f-9f49-6052ffb208d2 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:07.077328 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8eaab5e2-ff00-4e8f-9f49-6052ffb208d2 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:07.077974 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8eaab5e2-ff00-4e8f-9f49-6052ffb208d2 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:07.078642 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8eaab5e2-ff00-4e8f-9f49-6052ffb208d2 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:07.383900 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5d317df1-e550-4701-a8bb-3c4bcc507ee5 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8358c07e2684b749a62becb9f0b7869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b922a74c1c2448bb770d6b298b2d601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:07.397676 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5d317df1-e550-4701-a8bb-3c4bcc507ee5 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "GET /compute/v2.1/servers/b4ccd5ac-9465-43d8-9a5f-127152966ce8" status: 200 len: 1313 microversion: 2.1 time: 0.413173 Oct 04 18:39:07.398482 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1419/2776] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:06 2022] GET /compute/v2.1/servers/b4ccd5ac-9465-43d8-9a5f-127152966ce8 => generated 1313 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:07.424886 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8eaab5e2-ff00-4e8f-9f49-6052ffb208d2 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:07.439687 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8eaab5e2-ff00-4e8f-9f49-6052ffb208d2 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681" status: 200 len: 1471 microversion: 2.1 time: 0.378740 Oct 04 18:39:07.452927 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1358/2777] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:07 2022] GET /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681 => generated 1471 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:07.543478 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-282c183b-2412-4caf-a149-1147405cf157 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:07.553928 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-282c183b-2412-4caf-a149-1147405cf157 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 5965d934-6f27-43ac-bf15-8fd20da48cc1] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:07.580957 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-282c183b-2412-4caf-a149-1147405cf157 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:07.581444 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-282c183b-2412-4caf-a149-1147405cf157 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:07.583459 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-282c183b-2412-4caf-a149-1147405cf157 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:07.584253 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-282c183b-2412-4caf-a149-1147405cf157 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:07.584718 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-282c183b-2412-4caf-a149-1147405cf157 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:07.585145 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-282c183b-2412-4caf-a149-1147405cf157 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:08.006882 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-15821683-30a6-4cde-b5fa-bc8d38a80037 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:08.007671 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-15821683-30a6-4cde-b5fa-bc8d38a80037 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 89738dfe-3844-455a-93d1-d38702038946] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:08.027216 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-15821683-30a6-4cde-b5fa-bc8d38a80037 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:08.029335 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-15821683-30a6-4cde-b5fa-bc8d38a80037 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:08.030336 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-15821683-30a6-4cde-b5fa-bc8d38a80037 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:08.032113 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-15821683-30a6-4cde-b5fa-bc8d38a80037 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:08.035814 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-15821683-30a6-4cde-b5fa-bc8d38a80037 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:08.036619 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-15821683-30a6-4cde-b5fa-bc8d38a80037 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:08.830464 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-282c183b-2412-4caf-a149-1147405cf157 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8284fe51decd4db0bf6b3ed1514cc2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87473abf47e74adf844e3ddfa24da3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:08.842475 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-282c183b-2412-4caf-a149-1147405cf157 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] 10.222.0.20 "GET /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1" status: 200 len: 1505 microversion: 2.1 time: 1.307457 Oct 04 18:39:08.843097 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1420/2778] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:07 2022] GET /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1 => generated 1505 bytes in 1312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:08.865320 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e6515551-c960-4d52-8ec5-65a2422b0419 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cea98fa2-a5d9-46b5-8c43-265c051c025f"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:08.873860 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e6515551-c960-4d52-8ec5-65a2422b0419 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] [instance: b319d463-fa0d-4e2d-b03f-6227475572da] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:08.884552 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e6515551-c960-4d52-8ec5-65a2422b0419 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:08.886062 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e6515551-c960-4d52-8ec5-65a2422b0419 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:08.886062 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e6515551-c960-4d52-8ec5-65a2422b0419 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:08.886826 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e6515551-c960-4d52-8ec5-65a2422b0419 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:08.887273 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e6515551-c960-4d52-8ec5-65a2422b0419 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:08.891773 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e6515551-c960-4d52-8ec5-65a2422b0419 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:08.960092 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-15821683-30a6-4cde-b5fa-bc8d38a80037 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:08.970441 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-15821683-30a6-4cde-b5fa-bc8d38a80037 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946" status: 200 len: 1500 microversion: 2.1 time: 0.967811 Oct 04 18:39:08.984084 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1359/2779] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:08 2022] GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946 => generated 1500 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:39:09.013383 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6294d7fd-39cd-4e61-8c05-6ba05b5f07b7 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:09.021807 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6294d7fd-39cd-4e61-8c05-6ba05b5f07b7 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: b4ccd5ac-9465-43d8-9a5f-127152966ce8] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:09.052646 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6294d7fd-39cd-4e61-8c05-6ba05b5f07b7 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:09.056557 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6294d7fd-39cd-4e61-8c05-6ba05b5f07b7 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:09.058814 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6294d7fd-39cd-4e61-8c05-6ba05b5f07b7 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:09.061799 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6294d7fd-39cd-4e61-8c05-6ba05b5f07b7 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:09.064637 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6294d7fd-39cd-4e61-8c05-6ba05b5f07b7 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:09.069163 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6294d7fd-39cd-4e61-8c05-6ba05b5f07b7 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:09.538368 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6294d7fd-39cd-4e61-8c05-6ba05b5f07b7 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8358c07e2684b749a62becb9f0b7869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b922a74c1c2448bb770d6b298b2d601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:09.559910 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6294d7fd-39cd-4e61-8c05-6ba05b5f07b7 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "GET /compute/v2.1/servers/b4ccd5ac-9465-43d8-9a5f-127152966ce8" status: 200 len: 1313 microversion: 2.1 time: 0.584175 Oct 04 18:39:09.561116 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1360/2780] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:08 2022] GET /compute/v2.1/servers/b4ccd5ac-9465-43d8-9a5f-127152966ce8 => generated 1313 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:09.601937 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6ffa71f5-fdbf-4179-a2e3-836645b41697 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:09.606152 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6ffa71f5-fdbf-4179-a2e3-836645b41697 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2e308f41-242e-4ce3-8641-9510e2f13681] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:09.615073 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6ffa71f5-fdbf-4179-a2e3-836645b41697 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:09.615585 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6ffa71f5-fdbf-4179-a2e3-836645b41697 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:09.616477 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6ffa71f5-fdbf-4179-a2e3-836645b41697 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:09.617345 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6ffa71f5-fdbf-4179-a2e3-836645b41697 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:09.617798 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6ffa71f5-fdbf-4179-a2e3-836645b41697 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:09.618234 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6ffa71f5-fdbf-4179-a2e3-836645b41697 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:10.014732 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e6515551-c960-4d52-8ec5-65a2422b0419 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] 10.222.0.20 "POST /compute/v2.1/servers/b319d463-fa0d-4e2d-b03f-6227475572da/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.165874 Oct 04 18:39:10.016554 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1421/2781] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Oct 4 18:39:08 2022] POST /compute/v2.1/servers/b319d463-fa0d-4e2d-b03f-6227475572da/os-volume_attachments => generated 194 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:10.017916 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6ffa71f5-fdbf-4179-a2e3-836645b41697 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:10.037701 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e97f0ca1-219c-4552-89e4-6b4748d538b2 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:10.038722 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e97f0ca1-219c-4552-89e4-6b4748d538b2 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 5965d934-6f27-43ac-bf15-8fd20da48cc1] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:10.042772 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6ffa71f5-fdbf-4179-a2e3-836645b41697 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681" status: 200 len: 1471 microversion: 2.1 time: 0.457867 Oct 04 18:39:10.047653 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1361/2782] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:09 2022] GET /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681 => generated 1471 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:10.053185 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e97f0ca1-219c-4552-89e4-6b4748d538b2 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:10.053812 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e97f0ca1-219c-4552-89e4-6b4748d538b2 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:10.054485 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e97f0ca1-219c-4552-89e4-6b4748d538b2 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:10.056213 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e97f0ca1-219c-4552-89e4-6b4748d538b2 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:10.057023 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e97f0ca1-219c-4552-89e4-6b4748d538b2 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:10.057566 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e97f0ca1-219c-4552-89e4-6b4748d538b2 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:10.065377 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-04e0b76c-0d37-49ed-becf-2977c21ed7dd tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:10.066594 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-04e0b76c-0d37-49ed-becf-2977c21ed7dd tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 89738dfe-3844-455a-93d1-d38702038946] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:10.078861 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-04e0b76c-0d37-49ed-becf-2977c21ed7dd tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:10.096485 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-04e0b76c-0d37-49ed-becf-2977c21ed7dd tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:10.096485 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-04e0b76c-0d37-49ed-becf-2977c21ed7dd tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:10.096485 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-04e0b76c-0d37-49ed-becf-2977c21ed7dd tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:10.096485 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-04e0b76c-0d37-49ed-becf-2977c21ed7dd tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:10.096485 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-04e0b76c-0d37-49ed-becf-2977c21ed7dd tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:10.271280 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-04e0b76c-0d37-49ed-becf-2977c21ed7dd tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:10.336176 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-04e0b76c-0d37-49ed-becf-2977c21ed7dd tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946" status: 200 len: 1458 microversion: 2.1 time: 0.286759 Oct 04 18:39:10.338540 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1362/2783] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:10 2022] GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946 => generated 1458 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:10.442363 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-f346f0f6-d4a2-4aac-8c85-01a0e909debc req-8922afc3-267a-48db-bcc3-d7c1f88cf2d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89738dfe-3844-455a-93d1-d38702038946", "name": "network-vif-deleted", "tag": "77050755-1aa5-4d6d-8323-2fb66ab475c5"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:10.468094 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-f346f0f6-d4a2-4aac-8c85-01a0e909debc req-8922afc3-267a-48db-bcc3-d7c1f88cf2d3 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:10.472841 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-f346f0f6-d4a2-4aac-8c85-01a0e909debc req-8922afc3-267a-48db-bcc3-d7c1f88cf2d3 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:10.473709 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-f346f0f6-d4a2-4aac-8c85-01a0e909debc req-8922afc3-267a-48db-bcc3-d7c1f88cf2d3 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:10.485900 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=100 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:39:10.516930 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-f346f0f6-d4a2-4aac-8c85-01a0e909debc req-8922afc3-267a-48db-bcc3-d7c1f88cf2d3 service nova] Creating event network-vif-deleted:77050755-1aa5-4d6d-8323-2fb66ab475c5 for instance 89738dfe-3844-455a-93d1-d38702038946 on n-h2-850501-14 Oct 04 18:39:10.529559 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-f346f0f6-d4a2-4aac-8c85-01a0e909debc req-8922afc3-267a-48db-bcc3-d7c1f88cf2d3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092945 Oct 04 18:39:10.530983 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1363/2784] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:39:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:10.532373 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e97f0ca1-219c-4552-89e4-6b4748d538b2 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8284fe51decd4db0bf6b3ed1514cc2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87473abf47e74adf844e3ddfa24da3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:10.550036 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e97f0ca1-219c-4552-89e4-6b4748d538b2 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] 10.222.0.20 "GET /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1" status: 200 len: 1505 microversion: 2.1 time: 0.531986 Oct 04 18:39:10.551002 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1422/2785] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:10 2022] GET /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1 => generated 1505 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:10.594710 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-38c3baa1-a99f-4633-8672-c82420afa638 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:10.595093 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-38c3baa1-a99f-4633-8672-c82420afa638 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: b4ccd5ac-9465-43d8-9a5f-127152966ce8] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:10.610536 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-38c3baa1-a99f-4633-8672-c82420afa638 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:10.611052 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-38c3baa1-a99f-4633-8672-c82420afa638 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:10.611503 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-38c3baa1-a99f-4633-8672-c82420afa638 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:10.614984 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-38c3baa1-a99f-4633-8672-c82420afa638 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:10.615804 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-38c3baa1-a99f-4633-8672-c82420afa638 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:10.621248 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-38c3baa1-a99f-4633-8672-c82420afa638 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:10.860932 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-38c3baa1-a99f-4633-8672-c82420afa638 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8358c07e2684b749a62becb9f0b7869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b922a74c1c2448bb770d6b298b2d601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:10.870523 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-38c3baa1-a99f-4633-8672-c82420afa638 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "GET /compute/v2.1/servers/b4ccd5ac-9465-43d8-9a5f-127152966ce8" status: 200 len: 1313 microversion: 2.1 time: 0.284862 Oct 04 18:39:10.871922 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1364/2786] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:10 2022] GET /compute/v2.1/servers/b4ccd5ac-9465-43d8-9a5f-127152966ce8 => generated 1313 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:11.082948 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6f84ed57-a999-44f9-b718-d3589fb2468a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:11.085001 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-6f84ed57-a999-44f9-b718-d3589fb2468a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2e308f41-242e-4ce3-8641-9510e2f13681] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:11.103129 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6f84ed57-a999-44f9-b718-d3589fb2468a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:11.103783 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6f84ed57-a999-44f9-b718-d3589fb2468a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:11.107400 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6f84ed57-a999-44f9-b718-d3589fb2468a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:11.108290 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6f84ed57-a999-44f9-b718-d3589fb2468a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:11.111036 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6f84ed57-a999-44f9-b718-d3589fb2468a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:11.112823 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6f84ed57-a999-44f9-b718-d3589fb2468a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:11.307803 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-6f84ed57-a999-44f9-b718-d3589fb2468a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:11.317750 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6f84ed57-a999-44f9-b718-d3589fb2468a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681" status: 200 len: 1471 microversion: 2.1 time: 0.243763 Oct 04 18:39:11.319197 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1423/2787] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:11 2022] GET /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681 => generated 1471 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:11.344511 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-27a20670-0ec5-4a76-b11d-cb71939fdc29 req-e0258989-7b2f-4da5-a99e-ab2d527a2d92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4ccd5ac-9465-43d8-9a5f-127152966ce8", "name": "network-vif-plugged", "status": "completed", "tag": "baaa19b1-78c3-40d1-b1e3-7d1931b20e8b"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:11.357373 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-27a20670-0ec5-4a76-b11d-cb71939fdc29 req-e0258989-7b2f-4da5-a99e-ab2d527a2d92 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:11.358172 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-27a20670-0ec5-4a76-b11d-cb71939fdc29 req-e0258989-7b2f-4da5-a99e-ab2d527a2d92 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:11.358931 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-27a20670-0ec5-4a76-b11d-cb71939fdc29 req-e0258989-7b2f-4da5-a99e-ab2d527a2d92 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:11.369667 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-214fe2ff-7b7f-4b90-96b4-c186d2dc9a67 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:11.371984 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-214fe2ff-7b7f-4b90-96b4-c186d2dc9a67 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 89738dfe-3844-455a-93d1-d38702038946] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:11.380353 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-214fe2ff-7b7f-4b90-96b4-c186d2dc9a67 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:11.380854 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-214fe2ff-7b7f-4b90-96b4-c186d2dc9a67 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:11.381291 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-214fe2ff-7b7f-4b90-96b4-c186d2dc9a67 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:11.384492 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-214fe2ff-7b7f-4b90-96b4-c186d2dc9a67 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:11.386149 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-214fe2ff-7b7f-4b90-96b4-c186d2dc9a67 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:11.386899 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-214fe2ff-7b7f-4b90-96b4-c186d2dc9a67 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:11.389026 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-27a20670-0ec5-4a76-b11d-cb71939fdc29 req-e0258989-7b2f-4da5-a99e-ab2d527a2d92 service nova] Creating event network-vif-plugged:baaa19b1-78c3-40d1-b1e3-7d1931b20e8b for instance b4ccd5ac-9465-43d8-9a5f-127152966ce8 on n-h2-850501-14 Oct 04 18:39:11.393287 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-27a20670-0ec5-4a76-b11d-cb71939fdc29 req-e0258989-7b2f-4da5-a99e-ab2d527a2d92 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053628 Oct 04 18:39:11.393977 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1365/2788] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:39:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:11.466011 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-214fe2ff-7b7f-4b90-96b4-c186d2dc9a67 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:11.469217 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:39:11.490303 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-214fe2ff-7b7f-4b90-96b4-c186d2dc9a67 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946" status: 200 len: 1458 microversion: 2.1 time: 0.125323 Oct 04 18:39:11.500773 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1424/2789] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:11 2022] GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946 => generated 1458 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:39:11.580751 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a101de36-6ef5-4cb9-bc69-0f2bdf720f34 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:11.601324 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a101de36-6ef5-4cb9-bc69-0f2bdf720f34 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 5965d934-6f27-43ac-bf15-8fd20da48cc1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:11.616532 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a101de36-6ef5-4cb9-bc69-0f2bdf720f34 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:11.617037 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a101de36-6ef5-4cb9-bc69-0f2bdf720f34 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:11.617590 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a101de36-6ef5-4cb9-bc69-0f2bdf720f34 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:11.618702 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a101de36-6ef5-4cb9-bc69-0f2bdf720f34 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:11.619396 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a101de36-6ef5-4cb9-bc69-0f2bdf720f34 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:11.620000 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a101de36-6ef5-4cb9-bc69-0f2bdf720f34 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:11.783713 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a101de36-6ef5-4cb9-bc69-0f2bdf720f34 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8284fe51decd4db0bf6b3ed1514cc2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87473abf47e74adf844e3ddfa24da3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:11.792743 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a101de36-6ef5-4cb9-bc69-0f2bdf720f34 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] 10.222.0.20 "GET /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1" status: 200 len: 1505 microversion: 2.1 time: 0.217177 Oct 04 18:39:11.793322 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1366/2790] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:11 2022] GET /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1 => generated 1505 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:11.898094 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-891d10ed-1c1c-4051-bb6e-42e63fb0812b tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:11.898945 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-891d10ed-1c1c-4051-bb6e-42e63fb0812b tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: b4ccd5ac-9465-43d8-9a5f-127152966ce8] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:11.907742 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-891d10ed-1c1c-4051-bb6e-42e63fb0812b tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:11.909020 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-891d10ed-1c1c-4051-bb6e-42e63fb0812b tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:11.909677 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-891d10ed-1c1c-4051-bb6e-42e63fb0812b tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:11.910759 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-891d10ed-1c1c-4051-bb6e-42e63fb0812b tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:11.911685 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-891d10ed-1c1c-4051-bb6e-42e63fb0812b tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:11.912326 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-891d10ed-1c1c-4051-bb6e-42e63fb0812b tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:12.113806 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-891d10ed-1c1c-4051-bb6e-42e63fb0812b tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8358c07e2684b749a62becb9f0b7869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b922a74c1c2448bb770d6b298b2d601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:12.129284 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-891d10ed-1c1c-4051-bb6e-42e63fb0812b tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "GET /compute/v2.1/servers/b4ccd5ac-9465-43d8-9a5f-127152966ce8" status: 200 len: 1313 microversion: 2.1 time: 0.235236 Oct 04 18:39:12.130434 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1425/2791] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:11 2022] GET /compute/v2.1/servers/b4ccd5ac-9465-43d8-9a5f-127152966ce8 => generated 1313 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:39:12.351900 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ff099146-9b3f-46a3-867d-676ffd200f92 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:12.351900 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ff099146-9b3f-46a3-867d-676ffd200f92 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2e308f41-242e-4ce3-8641-9510e2f13681] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:12.365130 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ff099146-9b3f-46a3-867d-676ffd200f92 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:12.365980 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ff099146-9b3f-46a3-867d-676ffd200f92 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:12.366571 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ff099146-9b3f-46a3-867d-676ffd200f92 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:12.367441 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ff099146-9b3f-46a3-867d-676ffd200f92 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:12.368243 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ff099146-9b3f-46a3-867d-676ffd200f92 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:12.370823 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ff099146-9b3f-46a3-867d-676ffd200f92 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:12.516324 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-07f09a64-a50c-4466-9d8f-0b367bd2cdc0 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:12.516934 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-07f09a64-a50c-4466-9d8f-0b367bd2cdc0 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 89738dfe-3844-455a-93d1-d38702038946] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:12.524031 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-07f09a64-a50c-4466-9d8f-0b367bd2cdc0 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:12.532783 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-07f09a64-a50c-4466-9d8f-0b367bd2cdc0 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:12.536647 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-07f09a64-a50c-4466-9d8f-0b367bd2cdc0 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:12.536647 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-07f09a64-a50c-4466-9d8f-0b367bd2cdc0 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:12.536904 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-07f09a64-a50c-4466-9d8f-0b367bd2cdc0 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:12.537340 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-07f09a64-a50c-4466-9d8f-0b367bd2cdc0 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:12.704483 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-07f09a64-a50c-4466-9d8f-0b367bd2cdc0 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:12.725236 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ff099146-9b3f-46a3-867d-676ffd200f92 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:12.737350 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-07f09a64-a50c-4466-9d8f-0b367bd2cdc0 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946" status: 200 len: 1458 microversion: 2.1 time: 0.210780 Oct 04 18:39:12.740034 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ff099146-9b3f-46a3-867d-676ffd200f92 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681" status: 200 len: 1471 microversion: 2.1 time: 0.399031 Oct 04 18:39:12.741156 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1367/2792] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:12 2022] GET /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681 => generated 1471 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:12.751091 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1426/2793] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:12 2022] GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946 => generated 1458 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:39:12.817773 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8763a99a-df8f-4f4f-a167-e0f0b7f1592c tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:12.818558 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8763a99a-df8f-4f4f-a167-e0f0b7f1592c tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 5965d934-6f27-43ac-bf15-8fd20da48cc1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:12.826234 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8763a99a-df8f-4f4f-a167-e0f0b7f1592c tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:12.827115 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8763a99a-df8f-4f4f-a167-e0f0b7f1592c tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:12.827987 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8763a99a-df8f-4f4f-a167-e0f0b7f1592c tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:12.829109 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8763a99a-df8f-4f4f-a167-e0f0b7f1592c tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:12.829720 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8763a99a-df8f-4f4f-a167-e0f0b7f1592c tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:12.830293 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8763a99a-df8f-4f4f-a167-e0f0b7f1592c tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:13.094404 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8763a99a-df8f-4f4f-a167-e0f0b7f1592c tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8284fe51decd4db0bf6b3ed1514cc2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87473abf47e74adf844e3ddfa24da3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:13.106229 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8763a99a-df8f-4f4f-a167-e0f0b7f1592c tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] 10.222.0.20 "GET /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1" status: 200 len: 1505 microversion: 2.1 time: 0.293379 Oct 04 18:39:13.115965 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1368/2794] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:12 2022] GET /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1 => generated 1505 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:13.160019 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f87c4ab0-00cd-428c-8a5e-f1e0108d4fc7 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:13.161951 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f87c4ab0-00cd-428c-8a5e-f1e0108d4fc7 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: b4ccd5ac-9465-43d8-9a5f-127152966ce8] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:13.171870 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f87c4ab0-00cd-428c-8a5e-f1e0108d4fc7 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:13.172471 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f87c4ab0-00cd-428c-8a5e-f1e0108d4fc7 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:13.173134 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f87c4ab0-00cd-428c-8a5e-f1e0108d4fc7 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:13.174055 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f87c4ab0-00cd-428c-8a5e-f1e0108d4fc7 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:13.176839 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f87c4ab0-00cd-428c-8a5e-f1e0108d4fc7 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:13.176839 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f87c4ab0-00cd-428c-8a5e-f1e0108d4fc7 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:13.328712 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f87c4ab0-00cd-428c-8a5e-f1e0108d4fc7 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8358c07e2684b749a62becb9f0b7869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b922a74c1c2448bb770d6b298b2d601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:13.345328 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f87c4ab0-00cd-428c-8a5e-f1e0108d4fc7 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "GET /compute/v2.1/servers/b4ccd5ac-9465-43d8-9a5f-127152966ce8" status: 200 len: 1313 microversion: 2.1 time: 0.189672 Oct 04 18:39:13.345328 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1427/2795] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:13 2022] GET /compute/v2.1/servers/b4ccd5ac-9465-43d8-9a5f-127152966ce8 => generated 1313 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:13.773265 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-95f5ca11-569a-4b6e-9c53-bcc61ce781dc tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:13.773265 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-95f5ca11-569a-4b6e-9c53-bcc61ce781dc tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2e308f41-242e-4ce3-8641-9510e2f13681] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:13.776452 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-95f5ca11-569a-4b6e-9c53-bcc61ce781dc tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:13.777183 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-95f5ca11-569a-4b6e-9c53-bcc61ce781dc tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:13.777773 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-95f5ca11-569a-4b6e-9c53-bcc61ce781dc tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:13.778937 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-95f5ca11-569a-4b6e-9c53-bcc61ce781dc tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:13.779541 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-95f5ca11-569a-4b6e-9c53-bcc61ce781dc tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:13.780153 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5cc62f49-6e38-4e01-bcda-6c33170c4c6a tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:13.780307 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-95f5ca11-569a-4b6e-9c53-bcc61ce781dc tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:13.780766 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5cc62f49-6e38-4e01-bcda-6c33170c4c6a tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 89738dfe-3844-455a-93d1-d38702038946] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:13.798741 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5cc62f49-6e38-4e01-bcda-6c33170c4c6a tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:13.799234 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5cc62f49-6e38-4e01-bcda-6c33170c4c6a tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:13.799663 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5cc62f49-6e38-4e01-bcda-6c33170c4c6a tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:13.803995 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5cc62f49-6e38-4e01-bcda-6c33170c4c6a tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:13.803995 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5cc62f49-6e38-4e01-bcda-6c33170c4c6a tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:13.803995 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5cc62f49-6e38-4e01-bcda-6c33170c4c6a tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:13.896833 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5cc62f49-6e38-4e01-bcda-6c33170c4c6a tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:13.901310 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5cc62f49-6e38-4e01-bcda-6c33170c4c6a tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:13.901839 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5cc62f49-6e38-4e01-bcda-6c33170c4c6a tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:13.902375 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-5cc62f49-6e38-4e01-bcda-6c33170c4c6a tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lazy-loading 'fault' on Instance uuid 89738dfe-3844-455a-93d1-d38702038946 {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:39:13.997844 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5cc62f49-6e38-4e01-bcda-6c33170c4c6a tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:14.010787 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5cc62f49-6e38-4e01-bcda-6c33170c4c6a tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946" status: 200 len: 1300 microversion: 2.1 time: 0.231875 Oct 04 18:39:14.012091 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1428/2796] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:13 2022] GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946 => generated 1300 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:39:14.039804 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-95f5ca11-569a-4b6e-9c53-bcc61ce781dc tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:14.052363 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-95f5ca11-569a-4b6e-9c53-bcc61ce781dc tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681" status: 200 len: 1471 microversion: 2.1 time: 0.289156 Oct 04 18:39:14.053776 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1369/2797] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:13 2022] GET /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681 => generated 1471 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:14.144002 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-48967926-666f-4ace-9fb3-3d751dbdb4ab tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:14.144651 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-48967926-666f-4ace-9fb3-3d751dbdb4ab tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 5965d934-6f27-43ac-bf15-8fd20da48cc1] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:14.152126 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-48967926-666f-4ace-9fb3-3d751dbdb4ab tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:14.152463 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-48967926-666f-4ace-9fb3-3d751dbdb4ab tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:14.152899 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-48967926-666f-4ace-9fb3-3d751dbdb4ab tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:14.153978 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-48967926-666f-4ace-9fb3-3d751dbdb4ab tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:14.154439 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-48967926-666f-4ace-9fb3-3d751dbdb4ab tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:14.154972 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-48967926-666f-4ace-9fb3-3d751dbdb4ab tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:14.362972 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a6c1c590-a896-40d5-802c-53693208e3f4 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:14.363870 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a6c1c590-a896-40d5-802c-53693208e3f4 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: b4ccd5ac-9465-43d8-9a5f-127152966ce8] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:14.370703 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a6c1c590-a896-40d5-802c-53693208e3f4 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:14.371020 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-48967926-666f-4ace-9fb3-3d751dbdb4ab tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8284fe51decd4db0bf6b3ed1514cc2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87473abf47e74adf844e3ddfa24da3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:14.371505 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a6c1c590-a896-40d5-802c-53693208e3f4 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:14.371616 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a6c1c590-a896-40d5-802c-53693208e3f4 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:14.372327 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a6c1c590-a896-40d5-802c-53693208e3f4 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:14.372787 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a6c1c590-a896-40d5-802c-53693208e3f4 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:14.373212 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a6c1c590-a896-40d5-802c-53693208e3f4 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:14.378848 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-48967926-666f-4ace-9fb3-3d751dbdb4ab tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] 10.222.0.20 "GET /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1" status: 200 len: 1505 microversion: 2.1 time: 0.238907 Oct 04 18:39:14.379423 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1429/2798] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:14 2022] GET /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1 => generated 1505 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:14.509366 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a6c1c590-a896-40d5-802c-53693208e3f4 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8358c07e2684b749a62becb9f0b7869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b922a74c1c2448bb770d6b298b2d601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:14.523617 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a6c1c590-a896-40d5-802c-53693208e3f4 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "GET /compute/v2.1/servers/b4ccd5ac-9465-43d8-9a5f-127152966ce8" status: 200 len: 1313 microversion: 2.1 time: 0.164526 Oct 04 18:39:14.524427 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1370/2799] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:14 2022] GET /compute/v2.1/servers/b4ccd5ac-9465-43d8-9a5f-127152966ce8 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:15.035398 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5b205d0f-28a9-435c-9479-3f2f2f115147 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:15.037336 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5b205d0f-28a9-435c-9479-3f2f2f115147 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 89738dfe-3844-455a-93d1-d38702038946] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:15.049157 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5b205d0f-28a9-435c-9479-3f2f2f115147 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:15.049650 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5b205d0f-28a9-435c-9479-3f2f2f115147 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:15.050115 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5b205d0f-28a9-435c-9479-3f2f2f115147 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:15.050817 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5b205d0f-28a9-435c-9479-3f2f2f115147 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:15.051267 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5b205d0f-28a9-435c-9479-3f2f2f115147 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:15.051695 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5b205d0f-28a9-435c-9479-3f2f2f115147 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:15.090980 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6b20a82b-7ae6-4b3a-b17f-f6ddd8caceb7 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:15.093110 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6b20a82b-7ae6-4b3a-b17f-f6ddd8caceb7 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2e308f41-242e-4ce3-8641-9510e2f13681] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:15.109887 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5b205d0f-28a9-435c-9479-3f2f2f115147 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:15.110641 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5b205d0f-28a9-435c-9479-3f2f2f115147 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:15.113575 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5b205d0f-28a9-435c-9479-3f2f2f115147 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:15.114272 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-5b205d0f-28a9-435c-9479-3f2f2f115147 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lazy-loading 'fault' on Instance uuid 89738dfe-3844-455a-93d1-d38702038946 {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:39:15.126775 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6b20a82b-7ae6-4b3a-b17f-f6ddd8caceb7 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:15.131474 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6b20a82b-7ae6-4b3a-b17f-f6ddd8caceb7 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:15.133233 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6b20a82b-7ae6-4b3a-b17f-f6ddd8caceb7 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:15.134456 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6b20a82b-7ae6-4b3a-b17f-f6ddd8caceb7 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:15.139269 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6b20a82b-7ae6-4b3a-b17f-f6ddd8caceb7 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:15.142205 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6b20a82b-7ae6-4b3a-b17f-f6ddd8caceb7 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:15.186910 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5b205d0f-28a9-435c-9479-3f2f2f115147 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f2b2dbf824a1d879f5b7edb343f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde62f171d474b038f1af39899518211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:15.199496 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5b205d0f-28a9-435c-9479-3f2f2f115147 tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946" status: 200 len: 1300 microversion: 2.1 time: 0.167864 Oct 04 18:39:15.200413 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1430/2800] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:15 2022] GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946 => generated 1300 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:15.402528 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-30efff52-61f6-4654-b669-ef2ecdae705a tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:15.403896 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-30efff52-61f6-4654-b669-ef2ecdae705a tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 5965d934-6f27-43ac-bf15-8fd20da48cc1] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:15.412380 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-30efff52-61f6-4654-b669-ef2ecdae705a tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:15.412942 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-30efff52-61f6-4654-b669-ef2ecdae705a tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:15.413399 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-30efff52-61f6-4654-b669-ef2ecdae705a tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:15.428151 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-30efff52-61f6-4654-b669-ef2ecdae705a tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:15.430133 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-30efff52-61f6-4654-b669-ef2ecdae705a tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:15.430731 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-30efff52-61f6-4654-b669-ef2ecdae705a tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:15.472656 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6b20a82b-7ae6-4b3a-b17f-f6ddd8caceb7 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:15.485546 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6b20a82b-7ae6-4b3a-b17f-f6ddd8caceb7 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681" status: 200 len: 1471 microversion: 2.1 time: 0.402535 Oct 04 18:39:15.486820 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1371/2801] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:15 2022] GET /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681 => generated 1471 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:15.547778 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f9e78f08-e551-4471-bd97-9fcb2850a14a tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:15.548989 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f9e78f08-e551-4471-bd97-9fcb2850a14a tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: b4ccd5ac-9465-43d8-9a5f-127152966ce8] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:15.567434 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f9e78f08-e551-4471-bd97-9fcb2850a14a tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:15.568942 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f9e78f08-e551-4471-bd97-9fcb2850a14a tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:15.570155 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f9e78f08-e551-4471-bd97-9fcb2850a14a tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:15.571460 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f9e78f08-e551-4471-bd97-9fcb2850a14a tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:15.575471 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f9e78f08-e551-4471-bd97-9fcb2850a14a tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:15.582376 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f9e78f08-e551-4471-bd97-9fcb2850a14a tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:15.846359 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-30efff52-61f6-4654-b669-ef2ecdae705a tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8284fe51decd4db0bf6b3ed1514cc2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87473abf47e74adf844e3ddfa24da3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:15.871021 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-30efff52-61f6-4654-b669-ef2ecdae705a tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] 10.222.0.20 "GET /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1" status: 200 len: 1505 microversion: 2.1 time: 0.472587 Oct 04 18:39:15.885809 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1431/2802] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:15 2022] GET /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1 => generated 1505 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:39:15.915105 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f9e78f08-e551-4471-bd97-9fcb2850a14a tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8358c07e2684b749a62becb9f0b7869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b922a74c1c2448bb770d6b298b2d601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:15.924335 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f9e78f08-e551-4471-bd97-9fcb2850a14a tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "GET /compute/v2.1/servers/b4ccd5ac-9465-43d8-9a5f-127152966ce8" status: 200 len: 1462 microversion: 2.1 time: 0.380510 Oct 04 18:39:15.935032 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1372/2803] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:15 2022] GET /compute/v2.1/servers/b4ccd5ac-9465-43d8-9a5f-127152966ce8 => generated 1462 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:39:15.956889 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-859c08bc-cd14-4560-9af9-bd1f286d47dc tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:15.957787 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-859c08bc-cd14-4560-9af9-bd1f286d47dc tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: c343931b-bc96-4e9e-a5ce-f93454339a53] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:15.965307 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-859c08bc-cd14-4560-9af9-bd1f286d47dc tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:15.966110 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-859c08bc-cd14-4560-9af9-bd1f286d47dc tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:15.966790 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-859c08bc-cd14-4560-9af9-bd1f286d47dc tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:15.967661 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-859c08bc-cd14-4560-9af9-bd1f286d47dc tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:15.968394 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-859c08bc-cd14-4560-9af9-bd1f286d47dc tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:15.969163 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-859c08bc-cd14-4560-9af9-bd1f286d47dc tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:16.224485 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f0c22dbf-7450-4050-8b7b-92c1f822938f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:16.226388 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f0c22dbf-7450-4050-8b7b-92c1f822938f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] [instance: 89738dfe-3844-455a-93d1-d38702038946] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:16.235149 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-859c08bc-cd14-4560-9af9-bd1f286d47dc tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8358c07e2684b749a62becb9f0b7869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b922a74c1c2448bb770d6b298b2d601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:16.241740 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f0c22dbf-7450-4050-8b7b-92c1f822938f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:16.242438 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f0c22dbf-7450-4050-8b7b-92c1f822938f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:16.243055 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f0c22dbf-7450-4050-8b7b-92c1f822938f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:16.245721 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f0c22dbf-7450-4050-8b7b-92c1f822938f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:16.246327 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-859c08bc-cd14-4560-9af9-bd1f286d47dc tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53" status: 200 len: 1314 microversion: 2.1 time: 0.294719 Oct 04 18:39:16.246614 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f0c22dbf-7450-4050-8b7b-92c1f822938f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:16.252139 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1432/2804] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:15 2022] GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53 => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:16.257708 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f0c22dbf-7450-4050-8b7b-92c1f822938f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:16.270212 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-f0c22dbf-7450-4050-8b7b-92c1f822938f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] HTTP exception thrown: Instance 89738dfe-3844-455a-93d1-d38702038946 could not be found. Oct 04 18:39:16.273692 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f0c22dbf-7450-4050-8b7b-92c1f822938f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Request method failure captured: Oct 04 18:39:16.273692 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946 HTTP/1.1 Oct 04 18:39:16.273692 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:39:16.273692 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:39:16.273692 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:39:16.273692 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:39:16.273692 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:39:16.273692 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:39:16.273692 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:39:16.273692 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:39:16.273692 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPHulPRClkzd6kBQ81rrBhumMq88AYIanAk2xdeHK5U7wVgRC25-TXMgOlEBZg6WJpOKuV9BZwqY7S9UVeacMmO6BXdoABSwoaanCO5yf8qjOFgEjgLyJbKDRoktuo-EczFm_S4RGYEsRlB3A3Vi9-kDkYqoEQcS34joufFbsOIKcLTo Oct 04 18:39:16.273692 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:39:16.273692 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:39:16.273692 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:39:16.273692 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:39:16.273692 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:39:16.273692 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:39:16.273692 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: dde62f171d474b038f1af39899518211 Oct 04 18:39:16.273692 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-LiveMigrationTest-1583731626 Oct 04 18:39:16.273692 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:39:16.273692 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:39:16.273692 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dde62f171d474b038f1af39899518211"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dde62f171d474b038f1af39899518211", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dde62f171d474b038f1af39899518211"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dde62f171d474b038f1af39899518211"}]}] Oct 04 18:39:16.273692 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-LiveMigrationTest-1583731626 Oct 04 18:39:16.273692 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: dde62f171d474b038f1af39899518211 Oct 04 18:39:16.273692 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-LiveMigrationTest-1583731626 Oct 04 18:39:16.273692 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-LiveMigrationTest-1583731626-project Oct 04 18:39:16.273692 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:39:16.273692 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:39:16.273692 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: c80f2b2dbf824a1d879f5b7edb343f26 Oct 04 18:39:16.273692 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-LiveMigrationTest-1583731626-project Oct 04 18:39:16.273692 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:39:16.273692 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 89738dfe-3844-455a-93d1-d38702038946 could not be found. Oct 04 18:39:16.273692 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '89738dfe-3844-455a-93d1-d38702038946'} Oct 04 18:39:16.273692 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:39:16.273692 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:16.273692 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:39:16.273692 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:39:16.273692 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:39:16.273692 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:39:16.273692 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:39:16.273692 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:39:16.273692 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:39:16.273692 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:39:16.273692 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89738dfe-3844-455a-93d1-d38702038946 could not be found. Oct 04 18:39:16.273692 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:39:16.273692 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:39:16.273692 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:39:16.273692 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:16.273692 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:39:16.273692 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:39:16.273692 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:39:16.273692 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:39:16.273692 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:39:16.273692 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:39:16.273692 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:39:16.273692 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:39:16.273692 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:39:16.273692 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:39:16.273692 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:39:16.273692 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:39:16.273692 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89738dfe-3844-455a-93d1-d38702038946 could not be found. Oct 04 18:39:16.273692 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:39:16.273692 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:39:16.273692 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:39:16.279164 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:16.279164 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:39:16.279164 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:39:16.279164 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:39:16.279164 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:39:16.279164 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89738dfe-3844-455a-93d1-d38702038946 could not be found. Oct 04 18:39:16.279164 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:39:16.280793 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f0c22dbf-7450-4050-8b7b-92c1f822938f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] Returning 404 to user: Instance 89738dfe-3844-455a-93d1-d38702038946 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:39:16.282401 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f0c22dbf-7450-4050-8b7b-92c1f822938f tempest-LiveMigrationTest-1583731626 tempest-LiveMigrationTest-1583731626-project] 10.222.0.20 "GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946" status: 404 len: 111 microversion: 2.1 time: 0.062196 Oct 04 18:39:16.283165 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1373/2805] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:16 2022] GET /compute/v2.1/servers/89738dfe-3844-455a-93d1-d38702038946 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:39:16.768355 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c706fd11-7974-468d-b5c7-4847a22f889a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:16.769004 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c706fd11-7974-468d-b5c7-4847a22f889a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2e308f41-242e-4ce3-8641-9510e2f13681] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:16.776802 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c706fd11-7974-468d-b5c7-4847a22f889a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:16.777587 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c706fd11-7974-468d-b5c7-4847a22f889a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:16.778490 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c706fd11-7974-468d-b5c7-4847a22f889a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:16.779366 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c706fd11-7974-468d-b5c7-4847a22f889a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:16.780144 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c706fd11-7974-468d-b5c7-4847a22f889a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:16.780770 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c706fd11-7974-468d-b5c7-4847a22f889a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:16.904457 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b43d9849-1b9c-4ca3-8303-5f4fff6d1aac tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:16.905411 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b43d9849-1b9c-4ca3-8303-5f4fff6d1aac tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 5965d934-6f27-43ac-bf15-8fd20da48cc1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:16.922627 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b43d9849-1b9c-4ca3-8303-5f4fff6d1aac tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:16.925179 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b43d9849-1b9c-4ca3-8303-5f4fff6d1aac tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:16.925758 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b43d9849-1b9c-4ca3-8303-5f4fff6d1aac tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:16.930813 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b43d9849-1b9c-4ca3-8303-5f4fff6d1aac tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:16.931612 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b43d9849-1b9c-4ca3-8303-5f4fff6d1aac tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:16.932635 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b43d9849-1b9c-4ca3-8303-5f4fff6d1aac tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:17.206693 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c706fd11-7974-468d-b5c7-4847a22f889a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:17.222814 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c706fd11-7974-468d-b5c7-4847a22f889a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681" status: 200 len: 1471 microversion: 2.1 time: 0.715779 Oct 04 18:39:17.223647 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1433/2806] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:16 2022] GET /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681 => generated 1471 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:17.274247 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-72a9e292-eef9-471a-9e2f-b62a9767feda tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:17.276188 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-72a9e292-eef9-471a-9e2f-b62a9767feda tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: c343931b-bc96-4e9e-a5ce-f93454339a53] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:17.289888 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-72a9e292-eef9-471a-9e2f-b62a9767feda tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:17.293907 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-72a9e292-eef9-471a-9e2f-b62a9767feda tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:17.294672 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-72a9e292-eef9-471a-9e2f-b62a9767feda tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:17.295663 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-72a9e292-eef9-471a-9e2f-b62a9767feda tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:17.296449 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-72a9e292-eef9-471a-9e2f-b62a9767feda tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:17.297100 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-72a9e292-eef9-471a-9e2f-b62a9767feda tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:17.436799 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b43d9849-1b9c-4ca3-8303-5f4fff6d1aac tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8284fe51decd4db0bf6b3ed1514cc2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87473abf47e74adf844e3ddfa24da3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:17.449302 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b43d9849-1b9c-4ca3-8303-5f4fff6d1aac tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] 10.222.0.20 "GET /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1" status: 200 len: 1505 microversion: 2.1 time: 0.554033 Oct 04 18:39:17.450312 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1374/2807] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:16 2022] GET /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1 => generated 1505 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:17.476776 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-3075945a-a272-4f87-8eb0-e39e46399a9f req-92cf435a-8eaf-4e98-98f7-2ed73f684747 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c343931b-bc96-4e9e-a5ce-f93454339a53", "name": "network-vif-plugged", "status": "completed", "tag": "c6bfdac3-3f2e-4291-9771-d9e034cf664e"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:17.489206 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=3 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:39:17.498638 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-3075945a-a272-4f87-8eb0-e39e46399a9f req-92cf435a-8eaf-4e98-98f7-2ed73f684747 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:17.501920 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-3075945a-a272-4f87-8eb0-e39e46399a9f req-92cf435a-8eaf-4e98-98f7-2ed73f684747 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:17.504437 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-3075945a-a272-4f87-8eb0-e39e46399a9f req-92cf435a-8eaf-4e98-98f7-2ed73f684747 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:17.521063 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-3075945a-a272-4f87-8eb0-e39e46399a9f req-92cf435a-8eaf-4e98-98f7-2ed73f684747 service nova] Creating event network-vif-plugged:c6bfdac3-3f2e-4291-9771-d9e034cf664e for instance c343931b-bc96-4e9e-a5ce-f93454339a53 on n-h2-850501-14 Oct 04 18:39:17.527745 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-3075945a-a272-4f87-8eb0-e39e46399a9f req-92cf435a-8eaf-4e98-98f7-2ed73f684747 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076000 Oct 04 18:39:17.528648 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1375/2808] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:39:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:17.588925 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-72a9e292-eef9-471a-9e2f-b62a9767feda tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8358c07e2684b749a62becb9f0b7869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b922a74c1c2448bb770d6b298b2d601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:17.606123 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-72a9e292-eef9-471a-9e2f-b62a9767feda tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53" status: 200 len: 1314 microversion: 2.1 time: 0.340138 Oct 04 18:39:17.607908 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1434/2809] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:17 2022] GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53 => generated 1314 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:18.251182 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d591afa7-e7e6-4273-b077-ae7d28ecb1c2 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:18.252206 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d591afa7-e7e6-4273-b077-ae7d28ecb1c2 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2e308f41-242e-4ce3-8641-9510e2f13681] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:18.275844 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d591afa7-e7e6-4273-b077-ae7d28ecb1c2 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:18.284636 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d591afa7-e7e6-4273-b077-ae7d28ecb1c2 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:18.285042 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d591afa7-e7e6-4273-b077-ae7d28ecb1c2 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:18.288154 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d591afa7-e7e6-4273-b077-ae7d28ecb1c2 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:18.288681 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d591afa7-e7e6-4273-b077-ae7d28ecb1c2 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:18.291050 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d591afa7-e7e6-4273-b077-ae7d28ecb1c2 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:18.477169 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0d322167-035e-4827-9344-a36c540857ac tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:18.477169 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0d322167-035e-4827-9344-a36c540857ac tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 5965d934-6f27-43ac-bf15-8fd20da48cc1] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:18.487805 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0d322167-035e-4827-9344-a36c540857ac tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:18.492537 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0d322167-035e-4827-9344-a36c540857ac tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:18.493299 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0d322167-035e-4827-9344-a36c540857ac tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:18.493925 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0d322167-035e-4827-9344-a36c540857ac tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:18.498870 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0d322167-035e-4827-9344-a36c540857ac tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:18.499353 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0d322167-035e-4827-9344-a36c540857ac tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:19.012682 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d591afa7-e7e6-4273-b077-ae7d28ecb1c2 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:19.021440 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d591afa7-e7e6-4273-b077-ae7d28ecb1c2 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681" status: 200 len: 1476 microversion: 2.1 time: 0.775539 Oct 04 18:39:19.022693 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1376/2810] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:18 2022] GET /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681 => generated 1476 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:19.029063 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-08c25641-d809-4093-945b-c75e0ece494f tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:19.033050 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-08c25641-d809-4093-945b-c75e0ece494f tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: c343931b-bc96-4e9e-a5ce-f93454339a53] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:19.039305 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-08c25641-d809-4093-945b-c75e0ece494f tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:19.040515 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-08c25641-d809-4093-945b-c75e0ece494f tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:19.041601 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-08c25641-d809-4093-945b-c75e0ece494f tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:19.043057 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-08c25641-d809-4093-945b-c75e0ece494f tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:19.044048 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-08c25641-d809-4093-945b-c75e0ece494f tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:19.044972 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-08c25641-d809-4093-945b-c75e0ece494f tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:19.104265 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0d322167-035e-4827-9344-a36c540857ac tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8284fe51decd4db0bf6b3ed1514cc2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87473abf47e74adf844e3ddfa24da3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:19.116671 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0d322167-035e-4827-9344-a36c540857ac tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] 10.222.0.20 "GET /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1" status: 200 len: 1505 microversion: 2.1 time: 0.645383 Oct 04 18:39:19.118511 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1435/2811] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:18 2022] GET /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1 => generated 1505 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:19.380478 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-08c25641-d809-4093-945b-c75e0ece494f tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8358c07e2684b749a62becb9f0b7869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b922a74c1c2448bb770d6b298b2d601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:19.399885 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-08c25641-d809-4093-945b-c75e0ece494f tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53" status: 200 len: 1314 microversion: 2.1 time: 0.373418 Oct 04 18:39:19.401881 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1377/2812] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:19 2022] GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53 => generated 1314 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:20.057134 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-aeaee6c3-ae25-4ce1-9374-295350333e55 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:20.058537 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-aeaee6c3-ae25-4ce1-9374-295350333e55 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2e308f41-242e-4ce3-8641-9510e2f13681] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:20.067552 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aeaee6c3-ae25-4ce1-9374-295350333e55 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:20.068451 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aeaee6c3-ae25-4ce1-9374-295350333e55 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:20.069080 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aeaee6c3-ae25-4ce1-9374-295350333e55 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:20.070111 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aeaee6c3-ae25-4ce1-9374-295350333e55 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:20.070725 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aeaee6c3-ae25-4ce1-9374-295350333e55 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:20.071420 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aeaee6c3-ae25-4ce1-9374-295350333e55 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:20.145604 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-fb57770a-50a5-43a9-b2cc-7a944b623985 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:20.146407 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-fb57770a-50a5-43a9-b2cc-7a944b623985 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 5965d934-6f27-43ac-bf15-8fd20da48cc1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:20.160576 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fb57770a-50a5-43a9-b2cc-7a944b623985 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:20.162889 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fb57770a-50a5-43a9-b2cc-7a944b623985 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:20.163340 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fb57770a-50a5-43a9-b2cc-7a944b623985 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:20.164119 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fb57770a-50a5-43a9-b2cc-7a944b623985 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:20.164589 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fb57770a-50a5-43a9-b2cc-7a944b623985 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:20.165018 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fb57770a-50a5-43a9-b2cc-7a944b623985 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:20.633387 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-fb57770a-50a5-43a9-b2cc-7a944b623985 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8284fe51decd4db0bf6b3ed1514cc2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87473abf47e74adf844e3ddfa24da3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:20.645755 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-fb57770a-50a5-43a9-b2cc-7a944b623985 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] 10.222.0.20 "GET /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1" status: 200 len: 1505 microversion: 2.1 time: 0.505636 Oct 04 18:39:20.649347 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1378/2813] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:20 2022] GET /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1 => generated 1505 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:39:20.663522 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-aeaee6c3-ae25-4ce1-9374-295350333e55 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:20.668791 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6f4a18cd-32fc-4885-939d-921c9cfc2dda tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:20.669731 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6f4a18cd-32fc-4885-939d-921c9cfc2dda tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: c343931b-bc96-4e9e-a5ce-f93454339a53] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:20.673466 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-aeaee6c3-ae25-4ce1-9374-295350333e55 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681" status: 200 len: 1476 microversion: 2.1 time: 0.626480 Oct 04 18:39:20.675887 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1436/2814] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:20 2022] GET /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681 => generated 1476 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:20.681195 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6f4a18cd-32fc-4885-939d-921c9cfc2dda tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:20.681994 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6f4a18cd-32fc-4885-939d-921c9cfc2dda tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:20.682572 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6f4a18cd-32fc-4885-939d-921c9cfc2dda tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:20.684315 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6f4a18cd-32fc-4885-939d-921c9cfc2dda tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:20.685072 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6f4a18cd-32fc-4885-939d-921c9cfc2dda tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:20.685669 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6f4a18cd-32fc-4885-939d-921c9cfc2dda tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:21.129978 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6f4a18cd-32fc-4885-939d-921c9cfc2dda tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8358c07e2684b749a62becb9f0b7869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b922a74c1c2448bb770d6b298b2d601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:21.160995 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6f4a18cd-32fc-4885-939d-921c9cfc2dda tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53" status: 200 len: 1463 microversion: 2.1 time: 0.507673 Oct 04 18:39:21.162843 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1379/2815] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:20 2022] GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53 => generated 1463 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:21.379297 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6860e7a5-efb1-443e-a079-c9c70f9ce5ad tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-910466340", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "c343931b-bc96-4e9e-a5ce-f93454339a53"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:21.392213 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:UPDATE=2,nova_api:SELECT=98 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:39:21.497364 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-6860e7a5-efb1-443e-a079-c9c70f9ce5ad tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] validate_networks() for None {{(pid=123002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:39:21.675343 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-18e9b2cf-3993-4678-8bf4-a6304c5c7488 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:21.675971 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-18e9b2cf-3993-4678-8bf4-a6304c5c7488 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 5965d934-6f27-43ac-bf15-8fd20da48cc1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:21.687092 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-18e9b2cf-3993-4678-8bf4-a6304c5c7488 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:21.689760 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-18e9b2cf-3993-4678-8bf4-a6304c5c7488 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:21.690212 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-18e9b2cf-3993-4678-8bf4-a6304c5c7488 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:21.690929 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-18e9b2cf-3993-4678-8bf4-a6304c5c7488 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:21.692810 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-18e9b2cf-3993-4678-8bf4-a6304c5c7488 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:21.694447 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-18e9b2cf-3993-4678-8bf4-a6304c5c7488 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:22.199972 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-18e9b2cf-3993-4678-8bf4-a6304c5c7488 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8284fe51decd4db0bf6b3ed1514cc2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87473abf47e74adf844e3ddfa24da3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:22.222111 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-18e9b2cf-3993-4678-8bf4-a6304c5c7488 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] 10.222.0.20 "GET /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1" status: 200 len: 1485 microversion: 2.1 time: 0.552375 Oct 04 18:39:22.236134 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1380/2816] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:21 2022] GET /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1 => generated 1485 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:22.247030 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-6860e7a5-efb1-443e-a079-c9c70f9ce5ad tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:39:22.247030 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-6860e7a5-efb1-443e-a079-c9c70f9ce5ad tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:39:22.247030 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-6860e7a5-efb1-443e-a079-c9c70f9ce5ad tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:39:22.247030 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-6860e7a5-efb1-443e-a079-c9c70f9ce5ad tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:39:22.247030 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-6860e7a5-efb1-443e-a079-c9c70f9ce5ad tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:39:22.253107 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a0210bf5-5723-42c1-a15e-c0226c62f627 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:22.253719 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a0210bf5-5723-42c1-a15e-c0226c62f627 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2e308f41-242e-4ce3-8641-9510e2f13681] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:22.274005 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6860e7a5-efb1-443e-a079-c9c70f9ce5ad tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:22.276846 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6860e7a5-efb1-443e-a079-c9c70f9ce5ad tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:22.277296 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6860e7a5-efb1-443e-a079-c9c70f9ce5ad tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:22.278138 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6860e7a5-efb1-443e-a079-c9c70f9ce5ad tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:22.278599 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6860e7a5-efb1-443e-a079-c9c70f9ce5ad tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:22.279022 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6860e7a5-efb1-443e-a079-c9c70f9ce5ad tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:22.285790 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a0210bf5-5723-42c1-a15e-c0226c62f627 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:22.291208 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a0210bf5-5723-42c1-a15e-c0226c62f627 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:22.291208 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a0210bf5-5723-42c1-a15e-c0226c62f627 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:22.291208 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a0210bf5-5723-42c1-a15e-c0226c62f627 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:22.291208 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a0210bf5-5723-42c1-a15e-c0226c62f627 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:22.291208 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a0210bf5-5723-42c1-a15e-c0226c62f627 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:22.333565 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-6860e7a5-efb1-443e-a079-c9c70f9ce5ad tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Getting quotas for project 1b922a74c1c2448bb770d6b298b2d601. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:39:22.351220 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-6860e7a5-efb1-443e-a079-c9c70f9ce5ad tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Getting quotas for user f8358c07e2684b749a62becb9f0b7869 and project 1b922a74c1c2448bb770d6b298b2d601. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:39:22.379481 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-6860e7a5-efb1-443e-a079-c9c70f9ce5ad tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Going to run 1 instances... {{(pid=123002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:39:22.381895 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-6860e7a5-efb1-443e-a079-c9c70f9ce5ad tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: 2f257e47-8666-45d9-bed4-74cfd7ba8fb1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:39:22.568795 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6860e7a5-efb1-443e-a079-c9c70f9ce5ad tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.193400 Oct 04 18:39:22.582476 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1437/2817] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:39:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1208 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:39:22.592018 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-bf5a91bb-ee0d-4373-a243-a8ac2fc528d7 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:22.595165 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-bf5a91bb-ee0d-4373-a243-a8ac2fc528d7 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 5965d934-6f27-43ac-bf15-8fd20da48cc1] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:22.620382 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bf5a91bb-ee0d-4373-a243-a8ac2fc528d7 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:22.620382 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bf5a91bb-ee0d-4373-a243-a8ac2fc528d7 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:22.620638 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bf5a91bb-ee0d-4373-a243-a8ac2fc528d7 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:22.621455 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bf5a91bb-ee0d-4373-a243-a8ac2fc528d7 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:22.621813 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bf5a91bb-ee0d-4373-a243-a8ac2fc528d7 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:22.622245 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bf5a91bb-ee0d-4373-a243-a8ac2fc528d7 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:22.936827 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a0210bf5-5723-42c1-a15e-c0226c62f627 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:22.973827 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a0210bf5-5723-42c1-a15e-c0226c62f627 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681" status: 200 len: 1476 microversion: 2.1 time: 0.736042 Oct 04 18:39:22.974711 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1381/2818] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:22 2022] GET /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681 => generated 1476 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:23.007453 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6cde0f18-4e0f-4e07-ae71-e5473ec723dd tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:23.013995 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6cde0f18-4e0f-4e07-ae71-e5473ec723dd tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: 2f257e47-8666-45d9-bed4-74cfd7ba8fb1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:23.035948 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-bf5a91bb-ee0d-4373-a243-a8ac2fc528d7 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] 10.222.0.20 "POST /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1/action" status: 202 len: 0 microversion: 2.1 time: 0.450858 Oct 04 18:39:23.038618 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1438/2819] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:39:22 2022] POST /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1/action => generated 0 bytes in 455 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:39:23.054412 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-afea6779-57ab-4a2f-9f32-a10e998a89c1 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:23.059755 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-afea6779-57ab-4a2f-9f32-a10e998a89c1 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 5965d934-6f27-43ac-bf15-8fd20da48cc1] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:23.077397 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-afea6779-57ab-4a2f-9f32-a10e998a89c1 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:23.078541 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-afea6779-57ab-4a2f-9f32-a10e998a89c1 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:23.085381 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-afea6779-57ab-4a2f-9f32-a10e998a89c1 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:23.085381 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-afea6779-57ab-4a2f-9f32-a10e998a89c1 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:23.086170 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-afea6779-57ab-4a2f-9f32-a10e998a89c1 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:23.088120 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-afea6779-57ab-4a2f-9f32-a10e998a89c1 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:23.238096 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6cde0f18-4e0f-4e07-ae71-e5473ec723dd tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8358c07e2684b749a62becb9f0b7869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b922a74c1c2448bb770d6b298b2d601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:23.258598 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6cde0f18-4e0f-4e07-ae71-e5473ec723dd tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "GET /compute/v2.1/servers/2f257e47-8666-45d9-bed4-74cfd7ba8fb1" status: 200 len: 1213 microversion: 2.1 time: 0.258208 Oct 04 18:39:23.262038 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1382/2820] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:22 2022] GET /compute/v2.1/servers/2f257e47-8666-45d9-bed4-74cfd7ba8fb1 => generated 1213 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:23.748390 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-afea6779-57ab-4a2f-9f32-a10e998a89c1 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8284fe51decd4db0bf6b3ed1514cc2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87473abf47e74adf844e3ddfa24da3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:23.758561 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-afea6779-57ab-4a2f-9f32-a10e998a89c1 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] 10.222.0.20 "GET /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1" status: 200 len: 1493 microversion: 2.1 time: 0.711391 Oct 04 18:39:23.759899 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1439/2821] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:23 2022] GET /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1 => generated 1493 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:24.003696 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-87419529-4f56-49d0-9fe5-c4fe994ba577 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:24.005130 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-87419529-4f56-49d0-9fe5-c4fe994ba577 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2e308f41-242e-4ce3-8641-9510e2f13681] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:24.019676 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-87419529-4f56-49d0-9fe5-c4fe994ba577 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:24.033239 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-87419529-4f56-49d0-9fe5-c4fe994ba577 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:24.033839 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-87419529-4f56-49d0-9fe5-c4fe994ba577 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:24.034597 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-87419529-4f56-49d0-9fe5-c4fe994ba577 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:24.035076 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-87419529-4f56-49d0-9fe5-c4fe994ba577 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:24.035501 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-87419529-4f56-49d0-9fe5-c4fe994ba577 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:24.112579 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9e4e025f-eb06-4e1d-bc32-3fc668856cbd tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:24.116689 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9e4e025f-eb06-4e1d-bc32-3fc668856cbd tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] [instance: b319d463-fa0d-4e2d-b03f-6227475572da] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:24.133677 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=100 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:39:24.140444 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9e4e025f-eb06-4e1d-bc32-3fc668856cbd tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:24.140996 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9e4e025f-eb06-4e1d-bc32-3fc668856cbd tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:24.141459 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9e4e025f-eb06-4e1d-bc32-3fc668856cbd tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:24.144552 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9e4e025f-eb06-4e1d-bc32-3fc668856cbd tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:24.146680 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9e4e025f-eb06-4e1d-bc32-3fc668856cbd tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:24.148453 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9e4e025f-eb06-4e1d-bc32-3fc668856cbd tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:24.206121 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:39:24.242420 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9e4e025f-eb06-4e1d-bc32-3fc668856cbd tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] 10.222.0.20 "GET /compute/v2.1/servers/b319d463-fa0d-4e2d-b03f-6227475572da/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.133015 Oct 04 18:39:24.249508 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1440/2822] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 18:39:24 2022] GET /compute/v2.1/servers/b319d463-fa0d-4e2d-b03f-6227475572da/os-volume_attachments => generated 197 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:24.254842 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3f10f89f-6cd9-4c99-93a2-4d207d83853d tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:24.265550 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3f10f89f-6cd9-4c99-93a2-4d207d83853d tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] [instance: b319d463-fa0d-4e2d-b03f-6227475572da] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:24.277920 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f10f89f-6cd9-4c99-93a2-4d207d83853d tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:24.278733 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f10f89f-6cd9-4c99-93a2-4d207d83853d tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:24.291574 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f10f89f-6cd9-4c99-93a2-4d207d83853d tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:24.292669 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f10f89f-6cd9-4c99-93a2-4d207d83853d tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:24.293148 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f10f89f-6cd9-4c99-93a2-4d207d83853d tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:24.294330 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f10f89f-6cd9-4c99-93a2-4d207d83853d tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:24.543593 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-3f10f89f-6cd9-4c99-93a2-4d207d83853d tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lazy-loading 'services' on Instance uuid b319d463-fa0d-4e2d-b03f-6227475572da {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:39:24.699871 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-87419529-4f56-49d0-9fe5-c4fe994ba577 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:24.717171 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-87419529-4f56-49d0-9fe5-c4fe994ba577 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681" status: 200 len: 1476 microversion: 2.1 time: 0.719761 Oct 04 18:39:24.739442 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1383/2823] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:23 2022] GET /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681 => generated 1476 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:24.754669 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4c6cce38-098f-4e2b-8a71-d68b5a72bd24 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:24.758012 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-4c6cce38-098f-4e2b-8a71-d68b5a72bd24 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: 2f257e47-8666-45d9-bed4-74cfd7ba8fb1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:24.785462 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4c6cce38-098f-4e2b-8a71-d68b5a72bd24 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:24.785959 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4c6cce38-098f-4e2b-8a71-d68b5a72bd24 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:24.791897 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4c6cce38-098f-4e2b-8a71-d68b5a72bd24 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:24.794504 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4c6cce38-098f-4e2b-8a71-d68b5a72bd24 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:24.796210 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4c6cce38-098f-4e2b-8a71-d68b5a72bd24 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:24.796724 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4c6cce38-098f-4e2b-8a71-d68b5a72bd24 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:24.992567 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-4c6cce38-098f-4e2b-8a71-d68b5a72bd24 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8358c07e2684b749a62becb9f0b7869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b922a74c1c2448bb770d6b298b2d601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:25.024544 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-4c6cce38-098f-4e2b-8a71-d68b5a72bd24 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "GET /compute/v2.1/servers/2f257e47-8666-45d9-bed4-74cfd7ba8fb1" status: 200 len: 1209 microversion: 2.1 time: 0.280550 Oct 04 18:39:25.028360 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1384/2824] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:24 2022] GET /compute/v2.1/servers/2f257e47-8666-45d9-bed4-74cfd7ba8fb1 => generated 1209 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:25.053827 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4d487046-5b61-427e-987a-f01e3756eeeb tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:25.058366 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-4d487046-5b61-427e-987a-f01e3756eeeb tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 5965d934-6f27-43ac-bf15-8fd20da48cc1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:25.058877 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3f10f89f-6cd9-4c99-93a2-4d207d83853d tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b319d463-fa0d-4e2d-b03f-6227475572da/os-volume_attachments/cea98fa2-a5d9-46b5-8c43-265c051c025f" status: 202 len: 0 microversion: 2.1 time: 0.807317 Oct 04 18:39:25.060380 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1441/2825] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Oct 4 18:39:24 2022] DELETE /compute/v2.1/servers/b319d463-fa0d-4e2d-b03f-6227475572da/os-volume_attachments/cea98fa2-a5d9-46b5-8c43-265c051c025f => generated 0 bytes in 810 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:39:25.103952 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4d487046-5b61-427e-987a-f01e3756eeeb tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:25.106629 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4d487046-5b61-427e-987a-f01e3756eeeb tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:25.109676 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4d487046-5b61-427e-987a-f01e3756eeeb tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:25.124086 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4d487046-5b61-427e-987a-f01e3756eeeb tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:25.124086 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4d487046-5b61-427e-987a-f01e3756eeeb tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:25.124086 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4d487046-5b61-427e-987a-f01e3756eeeb tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:25.522129 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5ebc5406-f7f2-43c0-abf0-5b8d627f9179 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1583930955", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:25.599861 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-5ebc5406-f7f2-43c0-abf0-5b8d627f9179 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] validate_networks() for [('9b686f7b-7ec6-4756-8920-17dbc6944474', None, None, None, None, None)] {{(pid=123002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:39:25.971625 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-4d487046-5b61-427e-987a-f01e3756eeeb tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8284fe51decd4db0bf6b3ed1514cc2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87473abf47e74adf844e3ddfa24da3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:25.991372 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-4d487046-5b61-427e-987a-f01e3756eeeb tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] 10.222.0.20 "GET /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1" status: 200 len: 1493 microversion: 2.1 time: 0.960370 Oct 04 18:39:25.991372 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1385/2826] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:25 2022] GET /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1 => generated 1493 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:25.997194 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ea4dd160-a689-496f-b0bc-ef55d80a5e49 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:25.998071 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ea4dd160-a689-496f-b0bc-ef55d80a5e49 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2e308f41-242e-4ce3-8641-9510e2f13681] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:26.004173 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ea4dd160-a689-496f-b0bc-ef55d80a5e49 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:26.004875 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ea4dd160-a689-496f-b0bc-ef55d80a5e49 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:26.005485 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ea4dd160-a689-496f-b0bc-ef55d80a5e49 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:26.006351 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ea4dd160-a689-496f-b0bc-ef55d80a5e49 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:26.006975 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ea4dd160-a689-496f-b0bc-ef55d80a5e49 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:26.007404 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ea4dd160-a689-496f-b0bc-ef55d80a5e49 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:26.583616 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ea4dd160-a689-496f-b0bc-ef55d80a5e49 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:26.595895 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ea4dd160-a689-496f-b0bc-ef55d80a5e49 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681" status: 200 len: 1476 microversion: 2.1 time: 0.602877 Oct 04 18:39:26.597927 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1386/2827] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:25 2022] GET /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681 => generated 1476 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:26.602540 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-213dc253-b6bb-4278-b77a-ea77cac876c8 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:26.608680 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-213dc253-b6bb-4278-b77a-ea77cac876c8 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: 2f257e47-8666-45d9-bed4-74cfd7ba8fb1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:26.623996 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-213dc253-b6bb-4278-b77a-ea77cac876c8 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:26.627489 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-213dc253-b6bb-4278-b77a-ea77cac876c8 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:26.628042 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-213dc253-b6bb-4278-b77a-ea77cac876c8 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:26.628885 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-213dc253-b6bb-4278-b77a-ea77cac876c8 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:26.629565 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-213dc253-b6bb-4278-b77a-ea77cac876c8 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:26.630181 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-213dc253-b6bb-4278-b77a-ea77cac876c8 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:26.820873 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-213dc253-b6bb-4278-b77a-ea77cac876c8 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8358c07e2684b749a62becb9f0b7869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b922a74c1c2448bb770d6b298b2d601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:26.832153 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-213dc253-b6bb-4278-b77a-ea77cac876c8 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "GET /compute/v2.1/servers/2f257e47-8666-45d9-bed4-74cfd7ba8fb1" status: 200 len: 1283 microversion: 2.1 time: 0.233154 Oct 04 18:39:26.832754 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1387/2828] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:26 2022] GET /compute/v2.1/servers/2f257e47-8666-45d9-bed4-74cfd7ba8fb1 => generated 1283 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:27.013901 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c896d8bc-1b4f-4e0c-b8b9-c347c37276c4 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:27.014524 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c896d8bc-1b4f-4e0c-b8b9-c347c37276c4 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 5965d934-6f27-43ac-bf15-8fd20da48cc1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:27.037734 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c896d8bc-1b4f-4e0c-b8b9-c347c37276c4 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:27.038256 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c896d8bc-1b4f-4e0c-b8b9-c347c37276c4 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:27.038706 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c896d8bc-1b4f-4e0c-b8b9-c347c37276c4 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:27.039490 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c896d8bc-1b4f-4e0c-b8b9-c347c37276c4 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:27.040288 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c896d8bc-1b4f-4e0c-b8b9-c347c37276c4 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:27.043070 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c896d8bc-1b4f-4e0c-b8b9-c347c37276c4 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:28.243200 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-5ebc5406-f7f2-43c0-abf0-5b8d627f9179 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:39:28.245435 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-5ebc5406-f7f2-43c0-abf0-5b8d627f9179 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:39:28.245978 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-5ebc5406-f7f2-43c0-abf0-5b8d627f9179 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:39:28.246400 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-5ebc5406-f7f2-43c0-abf0-5b8d627f9179 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:39:28.246822 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-5ebc5406-f7f2-43c0-abf0-5b8d627f9179 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:39:28.269253 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5ebc5406-f7f2-43c0-abf0-5b8d627f9179 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:28.272741 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5ebc5406-f7f2-43c0-abf0-5b8d627f9179 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:28.275344 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5ebc5406-f7f2-43c0-abf0-5b8d627f9179 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:28.283237 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5ebc5406-f7f2-43c0-abf0-5b8d627f9179 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:28.283795 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5ebc5406-f7f2-43c0-abf0-5b8d627f9179 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:28.284279 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5ebc5406-f7f2-43c0-abf0-5b8d627f9179 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:28.330951 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c896d8bc-1b4f-4e0c-b8b9-c347c37276c4 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8284fe51decd4db0bf6b3ed1514cc2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87473abf47e74adf844e3ddfa24da3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:28.346190 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c896d8bc-1b4f-4e0c-b8b9-c347c37276c4 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] 10.222.0.20 "GET /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1" status: 200 len: 1499 microversion: 2.1 time: 1.335027 Oct 04 18:39:28.346190 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1388/2829] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:27 2022] GET /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1 => generated 1499 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:39:28.373581 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-5ebc5406-f7f2-43c0-abf0-5b8d627f9179 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Getting quotas for project a6edbe27acbc4c9eba33a6f589f6cf8a. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:39:28.377638 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e7fce99a-c558-4d96-a001-34af99f45547 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:28.381249 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e7fce99a-c558-4d96-a001-34af99f45547 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2e308f41-242e-4ce3-8641-9510e2f13681] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:28.387200 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-5ebc5406-f7f2-43c0-abf0-5b8d627f9179 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Getting quotas for user ec13a0273819409b8ecba05e9337ec73 and project a6edbe27acbc4c9eba33a6f589f6cf8a. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:39:28.410767 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e7fce99a-c558-4d96-a001-34af99f45547 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:28.411448 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e7fce99a-c558-4d96-a001-34af99f45547 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:28.413573 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e7fce99a-c558-4d96-a001-34af99f45547 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:28.419195 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e7fce99a-c558-4d96-a001-34af99f45547 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:28.419195 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e7fce99a-c558-4d96-a001-34af99f45547 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:28.419195 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e7fce99a-c558-4d96-a001-34af99f45547 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:28.427867 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5ebc5406-f7f2-43c0-abf0-5b8d627f9179 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Going to run 1 instances... {{(pid=123002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:39:28.433745 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5ebc5406-f7f2-43c0-abf0-5b8d627f9179 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] [instance: 6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:39:28.668471 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5ebc5406-f7f2-43c0-abf0-5b8d627f9179 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.478235 Oct 04 18:39:28.673901 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1442/2830] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:39:25 2022] POST /compute/v2.1/servers => generated 383 bytes in 3486 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:39:28.691265 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d01d384a-8f9d-4332-bf23-93db9422db17 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:28.692148 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d01d384a-8f9d-4332-bf23-93db9422db17 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: 2f257e47-8666-45d9-bed4-74cfd7ba8fb1] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:28.739070 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d01d384a-8f9d-4332-bf23-93db9422db17 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:28.740511 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d01d384a-8f9d-4332-bf23-93db9422db17 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:28.741252 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d01d384a-8f9d-4332-bf23-93db9422db17 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:28.743211 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d01d384a-8f9d-4332-bf23-93db9422db17 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:28.743915 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d01d384a-8f9d-4332-bf23-93db9422db17 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:28.744524 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d01d384a-8f9d-4332-bf23-93db9422db17 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:29.084374 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d01d384a-8f9d-4332-bf23-93db9422db17 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8358c07e2684b749a62becb9f0b7869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b922a74c1c2448bb770d6b298b2d601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:29.099108 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d01d384a-8f9d-4332-bf23-93db9422db17 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "GET /compute/v2.1/servers/2f257e47-8666-45d9-bed4-74cfd7ba8fb1" status: 200 len: 1271 microversion: 2.1 time: 0.423610 Oct 04 18:39:29.104528 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1443/2831] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:28 2022] GET /compute/v2.1/servers/2f257e47-8666-45d9-bed4-74cfd7ba8fb1 => generated 1271 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:29.123645 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-660bc258-e410-412c-bfd0-5eea437db2df tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:29.128184 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-660bc258-e410-412c-bfd0-5eea437db2df tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 5965d934-6f27-43ac-bf15-8fd20da48cc1] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:29.161770 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-660bc258-e410-412c-bfd0-5eea437db2df tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:29.161770 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-660bc258-e410-412c-bfd0-5eea437db2df tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:29.161770 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-660bc258-e410-412c-bfd0-5eea437db2df tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:29.161770 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-660bc258-e410-412c-bfd0-5eea437db2df tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:29.161770 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-660bc258-e410-412c-bfd0-5eea437db2df tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:29.161770 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-660bc258-e410-412c-bfd0-5eea437db2df tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:29.175129 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e7fce99a-c558-4d96-a001-34af99f45547 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:29.190323 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e7fce99a-c558-4d96-a001-34af99f45547 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681" status: 200 len: 1476 microversion: 2.1 time: 0.842082 Oct 04 18:39:29.192607 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1389/2832] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:28 2022] GET /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681 => generated 1476 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:29.205943 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5df68782-058c-441f-8fa3-c7ee7987396d tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:29.207080 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5df68782-058c-441f-8fa3-c7ee7987396d tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] [instance: 6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:29.230271 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-660bc258-e410-412c-bfd0-5eea437db2df tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 5965d934-6f27-43ac-bf15-8fd20da48cc1] Going to try to terminate instance {{(pid=123002) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:39:29.680972 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-660bc258-e410-412c-bfd0-5eea437db2df tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1" status: 204 len: 0 microversion: 2.1 time: 0.568951 Oct 04 18:39:29.689739 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1444/2833] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:39:29 2022] DELETE /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:39:29.694471 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-79b8c267-7134-409d-bf40-6a0b2dc8c641 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:29.695197 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-79b8c267-7134-409d-bf40-6a0b2dc8c641 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 5965d934-6f27-43ac-bf15-8fd20da48cc1] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:29.701223 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5df68782-058c-441f-8fa3-c7ee7987396d tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec13a0273819409b8ecba05e9337ec73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6edbe27acbc4c9eba33a6f589f6cf8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:29.705053 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-79b8c267-7134-409d-bf40-6a0b2dc8c641 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:29.708104 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-79b8c267-7134-409d-bf40-6a0b2dc8c641 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:29.708889 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5df68782-058c-441f-8fa3-c7ee7987396d tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] 10.222.0.20 "GET /compute/v2.1/servers/6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28" status: 200 len: 1223 microversion: 2.1 time: 0.514491 Oct 04 18:39:29.713693 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1390/2834] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:29 2022] GET /compute/v2.1/servers/6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28 => generated 1223 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:29.715417 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-79b8c267-7134-409d-bf40-6a0b2dc8c641 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:29.715417 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-79b8c267-7134-409d-bf40-6a0b2dc8c641 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:29.717341 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-79b8c267-7134-409d-bf40-6a0b2dc8c641 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:29.718035 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-79b8c267-7134-409d-bf40-6a0b2dc8c641 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:30.135273 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0136a030-edb4-4f71-8e2e-9c6a0a214cea tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:30.136733 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0136a030-edb4-4f71-8e2e-9c6a0a214cea tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: 2f257e47-8666-45d9-bed4-74cfd7ba8fb1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:30.187675 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0136a030-edb4-4f71-8e2e-9c6a0a214cea tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:30.194988 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0136a030-edb4-4f71-8e2e-9c6a0a214cea tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:30.195587 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0136a030-edb4-4f71-8e2e-9c6a0a214cea tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:30.205424 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0136a030-edb4-4f71-8e2e-9c6a0a214cea tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:30.212510 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0136a030-edb4-4f71-8e2e-9c6a0a214cea tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:30.213053 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0136a030-edb4-4f71-8e2e-9c6a0a214cea tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:31.099452 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-79b8c267-7134-409d-bf40-6a0b2dc8c641 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8284fe51decd4db0bf6b3ed1514cc2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87473abf47e74adf844e3ddfa24da3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:31.156403 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-79b8c267-7134-409d-bf40-6a0b2dc8c641 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] 10.222.0.20 "GET /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1" status: 200 len: 1505 microversion: 2.1 time: 1.466571 Oct 04 18:39:31.157361 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1445/2835] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:29 2022] GET /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1 => generated 1505 bytes in 1470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:31.162306 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a498cfad-2df5-427c-875d-8500e823100f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:31.168784 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a498cfad-2df5-427c-875d-8500e823100f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2e308f41-242e-4ce3-8641-9510e2f13681] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:31.186446 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a498cfad-2df5-427c-875d-8500e823100f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:31.188296 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a498cfad-2df5-427c-875d-8500e823100f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:31.189211 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a498cfad-2df5-427c-875d-8500e823100f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:31.194785 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a498cfad-2df5-427c-875d-8500e823100f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:31.197395 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a498cfad-2df5-427c-875d-8500e823100f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:31.200010 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a498cfad-2df5-427c-875d-8500e823100f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:31.522624 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0136a030-edb4-4f71-8e2e-9c6a0a214cea tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8358c07e2684b749a62becb9f0b7869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b922a74c1c2448bb770d6b298b2d601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:31.532680 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0136a030-edb4-4f71-8e2e-9c6a0a214cea tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "GET /compute/v2.1/servers/2f257e47-8666-45d9-bed4-74cfd7ba8fb1" status: 200 len: 1313 microversion: 2.1 time: 1.405397 Oct 04 18:39:31.533891 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1391/2836] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:30 2022] GET /compute/v2.1/servers/2f257e47-8666-45d9-bed4-74cfd7ba8fb1 => generated 1313 bytes in 1407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:31.539823 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1aed4550-a47f-43fa-80c5-49f120baedd3 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:31.540840 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1aed4550-a47f-43fa-80c5-49f120baedd3 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] [instance: 6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:31.549713 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1aed4550-a47f-43fa-80c5-49f120baedd3 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:31.554679 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1aed4550-a47f-43fa-80c5-49f120baedd3 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:31.554679 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1aed4550-a47f-43fa-80c5-49f120baedd3 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:31.554679 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1aed4550-a47f-43fa-80c5-49f120baedd3 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:31.554679 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1aed4550-a47f-43fa-80c5-49f120baedd3 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:31.554679 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1aed4550-a47f-43fa-80c5-49f120baedd3 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:31.783058 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1aed4550-a47f-43fa-80c5-49f120baedd3 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec13a0273819409b8ecba05e9337ec73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6edbe27acbc4c9eba33a6f589f6cf8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:31.800892 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1aed4550-a47f-43fa-80c5-49f120baedd3 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] 10.222.0.20 "GET /compute/v2.1/servers/6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28" status: 200 len: 1227 microversion: 2.1 time: 0.263326 Oct 04 18:39:31.801712 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1392/2837] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:31 2022] GET /compute/v2.1/servers/6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28 => generated 1227 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:32.069192 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-40b363f5-a391-42e4-9800-04a8bad3818a tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Action: 'create', calling method: .version_select at 0x7fe258bd89d0>, body: {"keypair": {"name": "tempest-keypair-1898144732", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDVYCThDLkW98Sg30ExmGEY2qboCX2gxGsmr4A0WD+VO6Z1fGlDL/qXh1G6OTa15P36RhBLBajUl4bTICBxekdG1eTxjyx/XnxgU/n8MogqiPJjOGn1jSxUXsS0nDMh03A=="}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:32.070252 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a498cfad-2df5-427c-875d-8500e823100f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:32.085562 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a498cfad-2df5-427c-875d-8500e823100f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681" status: 200 len: 1476 microversion: 2.1 time: 0.926807 Oct 04 18:39:32.086159 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1446/2838] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:31 2022] GET /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681 => generated 1476 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:32.088415 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-40b363f5-a391-42e4-9800-04a8bad3818a tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Getting quotas for project d6dbf28bee1e4a6eb1d3db071823690c. Resources: {'key_pairs'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:39:32.113231 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-40b363f5-a391-42e4-9800-04a8bad3818a tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Getting quotas for user 996abacc15b74496a27b1ecaaea0161b and project d6dbf28bee1e4a6eb1d3db071823690c. Resources: {'key_pairs'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:39:32.184297 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7ec6b6c4-1f1e-4250-8222-d1020ad664c8 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:32.185071 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7ec6b6c4-1f1e-4250-8222-d1020ad664c8 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 5965d934-6f27-43ac-bf15-8fd20da48cc1] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:32.203517 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7ec6b6c4-1f1e-4250-8222-d1020ad664c8 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:32.205758 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7ec6b6c4-1f1e-4250-8222-d1020ad664c8 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:32.213076 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7ec6b6c4-1f1e-4250-8222-d1020ad664c8 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:32.215270 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7ec6b6c4-1f1e-4250-8222-d1020ad664c8 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:32.215847 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7ec6b6c4-1f1e-4250-8222-d1020ad664c8 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:32.219684 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7ec6b6c4-1f1e-4250-8222-d1020ad664c8 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:32.254277 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-40b363f5-a391-42e4-9800-04a8bad3818a tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.193132 Oct 04 18:39:32.255070 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1393/2839] 10.222.0.20 () {62 vars in 1200 bytes} [Tue Oct 4 18:39:32 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 195 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 18:39:32.562750 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0b4dd3af-90e4-429e-a46f-011d64d434ca tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:32.563372 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0b4dd3af-90e4-429e-a46f-011d64d434ca tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: 2f257e47-8666-45d9-bed4-74cfd7ba8fb1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:32.592535 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7ec6b6c4-1f1e-4250-8222-d1020ad664c8 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8284fe51decd4db0bf6b3ed1514cc2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87473abf47e74adf844e3ddfa24da3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:32.600111 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0b4dd3af-90e4-429e-a46f-011d64d434ca tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:32.606953 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7ec6b6c4-1f1e-4250-8222-d1020ad664c8 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] 10.222.0.20 "GET /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1" status: 200 len: 1505 microversion: 2.1 time: 0.427346 Oct 04 18:39:32.609120 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0b4dd3af-90e4-429e-a46f-011d64d434ca tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:32.609742 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0b4dd3af-90e4-429e-a46f-011d64d434ca tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:32.610546 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0b4dd3af-90e4-429e-a46f-011d64d434ca tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:32.611031 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0b4dd3af-90e4-429e-a46f-011d64d434ca tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:32.619486 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0b4dd3af-90e4-429e-a46f-011d64d434ca tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:32.629762 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1447/2840] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:32 2022] GET /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1 => generated 1505 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:39:32.828699 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-29e02569-b956-4ba6-9cd4-80b964f42e16 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:32.834677 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-29e02569-b956-4ba6-9cd4-80b964f42e16 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] [instance: 6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:32.864846 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-29e02569-b956-4ba6-9cd4-80b964f42e16 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:32.869572 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-29e02569-b956-4ba6-9cd4-80b964f42e16 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:32.879558 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-29e02569-b956-4ba6-9cd4-80b964f42e16 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:32.880792 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-29e02569-b956-4ba6-9cd4-80b964f42e16 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:32.883115 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-29e02569-b956-4ba6-9cd4-80b964f42e16 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:32.885373 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-29e02569-b956-4ba6-9cd4-80b964f42e16 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:33.016236 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0b4dd3af-90e4-429e-a46f-011d64d434ca tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8358c07e2684b749a62becb9f0b7869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b922a74c1c2448bb770d6b298b2d601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:33.027569 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0b4dd3af-90e4-429e-a46f-011d64d434ca tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "GET /compute/v2.1/servers/2f257e47-8666-45d9-bed4-74cfd7ba8fb1" status: 200 len: 1313 microversion: 2.1 time: 0.470629 Oct 04 18:39:33.028765 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1394/2841] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:32 2022] GET /compute/v2.1/servers/2f257e47-8666-45d9-bed4-74cfd7ba8fb1 => generated 1313 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:39:33.092979 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-29e02569-b956-4ba6-9cd4-80b964f42e16 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec13a0273819409b8ecba05e9337ec73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6edbe27acbc4c9eba33a6f589f6cf8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:33.108763 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-29e02569-b956-4ba6-9cd4-80b964f42e16 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] 10.222.0.20 "GET /compute/v2.1/servers/6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28" status: 200 len: 1227 microversion: 2.1 time: 0.283800 Oct 04 18:39:33.108763 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1448/2842] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:32 2022] GET /compute/v2.1/servers/6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28 => generated 1227 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:33.141597 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-902c0097-073e-42d6-946f-e2f559058389 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:33.142341 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-902c0097-073e-42d6-946f-e2f559058389 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2e308f41-242e-4ce3-8641-9510e2f13681] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:33.151472 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-902c0097-073e-42d6-946f-e2f559058389 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:33.158955 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-902c0097-073e-42d6-946f-e2f559058389 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:33.166220 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-902c0097-073e-42d6-946f-e2f559058389 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:33.167343 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-902c0097-073e-42d6-946f-e2f559058389 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:33.169880 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-902c0097-073e-42d6-946f-e2f559058389 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:33.170515 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-902c0097-073e-42d6-946f-e2f559058389 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:33.641791 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-694e8593-f4ea-4ca6-b899-32ad16a89926 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:33.643878 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-694e8593-f4ea-4ca6-b899-32ad16a89926 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 5965d934-6f27-43ac-bf15-8fd20da48cc1] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:33.655046 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-694e8593-f4ea-4ca6-b899-32ad16a89926 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:33.656874 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-694e8593-f4ea-4ca6-b899-32ad16a89926 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:33.657612 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-694e8593-f4ea-4ca6-b899-32ad16a89926 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:33.658800 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-694e8593-f4ea-4ca6-b899-32ad16a89926 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:33.660017 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-694e8593-f4ea-4ca6-b899-32ad16a89926 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:33.660945 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-694e8593-f4ea-4ca6-b899-32ad16a89926 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:33.843595 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-902c0097-073e-42d6-946f-e2f559058389 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:33.853889 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-902c0097-073e-42d6-946f-e2f559058389 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681" status: 200 len: 1476 microversion: 2.1 time: 0.729615 Oct 04 18:39:33.867564 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1395/2843] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:33 2022] GET /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681 => generated 1476 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:34.057224 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-36018847-53ff-4724-a4ad-05fa30a2da36 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:34.058549 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-36018847-53ff-4724-a4ad-05fa30a2da36 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: 2f257e47-8666-45d9-bed4-74cfd7ba8fb1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:34.070460 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-36018847-53ff-4724-a4ad-05fa30a2da36 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:34.071148 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-36018847-53ff-4724-a4ad-05fa30a2da36 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:34.072330 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-36018847-53ff-4724-a4ad-05fa30a2da36 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:34.074530 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-36018847-53ff-4724-a4ad-05fa30a2da36 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:34.075187 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-36018847-53ff-4724-a4ad-05fa30a2da36 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:34.076635 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-36018847-53ff-4724-a4ad-05fa30a2da36 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:34.327392 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-694e8593-f4ea-4ca6-b899-32ad16a89926 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8284fe51decd4db0bf6b3ed1514cc2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87473abf47e74adf844e3ddfa24da3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:34.340694 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-694e8593-f4ea-4ca6-b899-32ad16a89926 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] 10.222.0.20 "GET /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1" status: 200 len: 1505 microversion: 2.1 time: 0.704586 Oct 04 18:39:34.343829 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1449/2844] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:33 2022] GET /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1 => generated 1505 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:34.358044 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-57784f18-6ea0-408f-bf64-f89f7c5fe094 req-d77d30f3-a1c8-44cf-a235-7cfa7e4d39ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f257e47-8666-45d9-bed4-74cfd7ba8fb1", "tag": "6e3ada66-c43a-4281-9159-5a8283bd2060"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:34.379018 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-57784f18-6ea0-408f-bf64-f89f7c5fe094 req-d77d30f3-a1c8-44cf-a235-7cfa7e4d39ce service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:34.379513 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-57784f18-6ea0-408f-bf64-f89f7c5fe094 req-d77d30f3-a1c8-44cf-a235-7cfa7e4d39ce service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:34.379956 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-57784f18-6ea0-408f-bf64-f89f7c5fe094 req-d77d30f3-a1c8-44cf-a235-7cfa7e4d39ce service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:34.411681 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-57784f18-6ea0-408f-bf64-f89f7c5fe094 req-d77d30f3-a1c8-44cf-a235-7cfa7e4d39ce service nova] Creating event network-changed:6e3ada66-c43a-4281-9159-5a8283bd2060 for instance 2f257e47-8666-45d9-bed4-74cfd7ba8fb1 on n-h2-850501-14 Oct 04 18:39:34.421018 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-57784f18-6ea0-408f-bf64-f89f7c5fe094 req-d77d30f3-a1c8-44cf-a235-7cfa7e4d39ce service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073512 Oct 04 18:39:34.426580 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1450/2845] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:39:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:34.432949 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-dac66283-6572-469e-9d99-0f13abfec385 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:34.433668 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-dac66283-6572-469e-9d99-0f13abfec385 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] [instance: 6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:34.446105 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dac66283-6572-469e-9d99-0f13abfec385 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:34.447415 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dac66283-6572-469e-9d99-0f13abfec385 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:34.448457 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dac66283-6572-469e-9d99-0f13abfec385 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:34.452606 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dac66283-6572-469e-9d99-0f13abfec385 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:34.452606 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dac66283-6572-469e-9d99-0f13abfec385 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:34.452606 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dac66283-6572-469e-9d99-0f13abfec385 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:35.242683 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-dac66283-6572-469e-9d99-0f13abfec385 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec13a0273819409b8ecba05e9337ec73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6edbe27acbc4c9eba33a6f589f6cf8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:35.252794 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-dac66283-6572-469e-9d99-0f13abfec385 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] 10.222.0.20 "GET /compute/v2.1/servers/6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28" status: 200 len: 1275 microversion: 2.1 time: 0.824827 Oct 04 18:39:35.254048 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1451/2846] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:34 2022] GET /compute/v2.1/servers/6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28 => generated 1275 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:35.261259 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1ae4b311-cfe4-420e-be29-b7bb2a550d81 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:35.262497 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1ae4b311-cfe4-420e-be29-b7bb2a550d81 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2e308f41-242e-4ce3-8641-9510e2f13681] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:35.308609 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-36018847-53ff-4724-a4ad-05fa30a2da36 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8358c07e2684b749a62becb9f0b7869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b922a74c1c2448bb770d6b298b2d601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:35.315819 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1ae4b311-cfe4-420e-be29-b7bb2a550d81 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:35.319417 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1ae4b311-cfe4-420e-be29-b7bb2a550d81 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:35.320178 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1ae4b311-cfe4-420e-be29-b7bb2a550d81 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:35.321109 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1ae4b311-cfe4-420e-be29-b7bb2a550d81 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:35.322750 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1ae4b311-cfe4-420e-be29-b7bb2a550d81 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:35.325470 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1ae4b311-cfe4-420e-be29-b7bb2a550d81 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:35.331101 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-36018847-53ff-4724-a4ad-05fa30a2da36 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "GET /compute/v2.1/servers/2f257e47-8666-45d9-bed4-74cfd7ba8fb1" status: 200 len: 1313 microversion: 2.1 time: 1.277575 Oct 04 18:39:35.334875 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1396/2847] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:34 2022] GET /compute/v2.1/servers/2f257e47-8666-45d9-bed4-74cfd7ba8fb1 => generated 1313 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:39:35.347738 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-3d1e2803-5fb0-4816-a22f-0d71747257f7 req-0766364e-08f9-4784-abd4-311475a03f11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5965d934-6f27-43ac-bf15-8fd20da48cc1", "name": "network-vif-deleted", "tag": "e3117103-e47a-4f74-bf00-0960c112b84c"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:35.375852 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-3d1e2803-5fb0-4816-a22f-0d71747257f7 req-0766364e-08f9-4784-abd4-311475a03f11 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:35.379715 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-3d1e2803-5fb0-4816-a22f-0d71747257f7 req-0766364e-08f9-4784-abd4-311475a03f11 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:35.381371 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-3d1e2803-5fb0-4816-a22f-0d71747257f7 req-0766364e-08f9-4784-abd4-311475a03f11 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:35.440586 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-3d1e2803-5fb0-4816-a22f-0d71747257f7 req-0766364e-08f9-4784-abd4-311475a03f11 service nova] Creating event network-vif-deleted:e3117103-e47a-4f74-bf00-0960c112b84c for instance 5965d934-6f27-43ac-bf15-8fd20da48cc1 on n-h1-850501-14 Oct 04 18:39:35.459626 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-3d1e2803-5fb0-4816-a22f-0d71747257f7 req-0766364e-08f9-4784-abd4-311475a03f11 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121768 Oct 04 18:39:35.464796 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1397/2848] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:39:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:35.484644 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f172eace-07c2-4900-b5e6-dacd6bb1de6f tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:35.485379 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f172eace-07c2-4900-b5e6-dacd6bb1de6f tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 5965d934-6f27-43ac-bf15-8fd20da48cc1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:35.523359 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f172eace-07c2-4900-b5e6-dacd6bb1de6f tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:35.531236 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f172eace-07c2-4900-b5e6-dacd6bb1de6f tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:35.531739 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f172eace-07c2-4900-b5e6-dacd6bb1de6f tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:35.532534 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f172eace-07c2-4900-b5e6-dacd6bb1de6f tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:35.536510 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f172eace-07c2-4900-b5e6-dacd6bb1de6f tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:35.537044 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f172eace-07c2-4900-b5e6-dacd6bb1de6f tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:35.886684 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f172eace-07c2-4900-b5e6-dacd6bb1de6f tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8284fe51decd4db0bf6b3ed1514cc2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87473abf47e74adf844e3ddfa24da3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:35.908159 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f172eace-07c2-4900-b5e6-dacd6bb1de6f tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] 10.222.0.20 "GET /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1" status: 200 len: 1299 microversion: 2.1 time: 0.441688 Oct 04 18:39:35.909478 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1398/2849] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:35 2022] GET /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1 => generated 1299 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:36.265846 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1ae4b311-cfe4-420e-be29-b7bb2a550d81 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:36.276945 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1ae4b311-cfe4-420e-be29-b7bb2a550d81 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681" status: 200 len: 1476 microversion: 2.1 time: 1.021003 Oct 04 18:39:36.277149 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3ec68003-bce0-465f-971d-157b57dce874 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:36.277635 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3ec68003-bce0-465f-971d-157b57dce874 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] [instance: 6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:36.278013 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1452/2850] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:35 2022] GET /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681 => generated 1476 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:36.300591 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3ec68003-bce0-465f-971d-157b57dce874 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:36.301323 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3ec68003-bce0-465f-971d-157b57dce874 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:36.301955 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3ec68003-bce0-465f-971d-157b57dce874 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:36.303004 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3ec68003-bce0-465f-971d-157b57dce874 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:36.303754 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3ec68003-bce0-465f-971d-157b57dce874 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:36.304226 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3ec68003-bce0-465f-971d-157b57dce874 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:36.358844 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-bae4971e-bc93-4d4b-bb1b-e61c20423f1f tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:36.359464 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-bae4971e-bc93-4d4b-bb1b-e61c20423f1f tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: 2f257e47-8666-45d9-bed4-74cfd7ba8fb1] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:36.365465 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bae4971e-bc93-4d4b-bb1b-e61c20423f1f tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:36.371825 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bae4971e-bc93-4d4b-bb1b-e61c20423f1f tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:36.371825 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bae4971e-bc93-4d4b-bb1b-e61c20423f1f tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:36.371825 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bae4971e-bc93-4d4b-bb1b-e61c20423f1f tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:36.371825 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bae4971e-bc93-4d4b-bb1b-e61c20423f1f tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:36.371825 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bae4971e-bc93-4d4b-bb1b-e61c20423f1f tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:36.440126 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3ec68003-bce0-465f-971d-157b57dce874 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec13a0273819409b8ecba05e9337ec73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6edbe27acbc4c9eba33a6f589f6cf8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:36.448618 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3ec68003-bce0-465f-971d-157b57dce874 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] 10.222.0.20 "GET /compute/v2.1/servers/6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28" status: 200 len: 1281 microversion: 2.1 time: 0.176658 Oct 04 18:39:36.449459 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1399/2851] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:36 2022] GET /compute/v2.1/servers/6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28 => generated 1281 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:39:36.517766 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-670e09cd-dd85-4622-bd37-d6ee73670045 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:36.520597 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-670e09cd-dd85-4622-bd37-d6ee73670045 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] [instance: b319d463-fa0d-4e2d-b03f-6227475572da] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:36.526960 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-670e09cd-dd85-4622-bd37-d6ee73670045 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:36.527449 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-670e09cd-dd85-4622-bd37-d6ee73670045 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:36.530014 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-670e09cd-dd85-4622-bd37-d6ee73670045 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:36.530014 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-670e09cd-dd85-4622-bd37-d6ee73670045 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:36.530014 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-670e09cd-dd85-4622-bd37-d6ee73670045 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:36.530014 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-670e09cd-dd85-4622-bd37-d6ee73670045 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:36.562646 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-670e09cd-dd85-4622-bd37-d6ee73670045 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] 10.222.0.20 "GET /compute/v2.1/servers/b319d463-fa0d-4e2d-b03f-6227475572da/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049131 Oct 04 18:39:36.563297 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1400/2852] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 18:39:36 2022] GET /compute/v2.1/servers/b319d463-fa0d-4e2d-b03f-6227475572da/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 18:39:36.642779 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f03514d6-b840-41d1-88e1-93caaea26750 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:36.645835 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f03514d6-b840-41d1-88e1-93caaea26750 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] [instance: b319d463-fa0d-4e2d-b03f-6227475572da] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:36.658864 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f03514d6-b840-41d1-88e1-93caaea26750 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:36.659810 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f03514d6-b840-41d1-88e1-93caaea26750 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:36.660858 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f03514d6-b840-41d1-88e1-93caaea26750 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:36.661929 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f03514d6-b840-41d1-88e1-93caaea26750 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:36.662759 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f03514d6-b840-41d1-88e1-93caaea26750 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:36.663568 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f03514d6-b840-41d1-88e1-93caaea26750 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:36.705329 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f03514d6-b840-41d1-88e1-93caaea26750 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] 10.222.0.20 "GET /compute/v2.1/servers/b319d463-fa0d-4e2d-b03f-6227475572da/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.067667 Oct 04 18:39:36.706020 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1401/2853] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 18:39:36 2022] GET /compute/v2.1/servers/b319d463-fa0d-4e2d-b03f-6227475572da/os-volume_attachments => generated 25 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 18:39:36.782958 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-deb432f6-b409-4adc-a123-fd1d903ee3a1 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:36.783841 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-deb432f6-b409-4adc-a123-fd1d903ee3a1 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] [instance: b319d463-fa0d-4e2d-b03f-6227475572da] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:36.791035 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-deb432f6-b409-4adc-a123-fd1d903ee3a1 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:36.791886 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-deb432f6-b409-4adc-a123-fd1d903ee3a1 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:36.792578 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-deb432f6-b409-4adc-a123-fd1d903ee3a1 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:36.793352 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-deb432f6-b409-4adc-a123-fd1d903ee3a1 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:36.793890 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-deb432f6-b409-4adc-a123-fd1d903ee3a1 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:36.794404 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-deb432f6-b409-4adc-a123-fd1d903ee3a1 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:36.827875 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-deb432f6-b409-4adc-a123-fd1d903ee3a1 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] [instance: b319d463-fa0d-4e2d-b03f-6227475572da] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:39:36.830331 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=100 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:39:36.907950 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-bae4971e-bc93-4d4b-bb1b-e61c20423f1f tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8358c07e2684b749a62becb9f0b7869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b922a74c1c2448bb770d6b298b2d601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:36.916562 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-bae4971e-bc93-4d4b-bb1b-e61c20423f1f tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "GET /compute/v2.1/servers/2f257e47-8666-45d9-bed4-74cfd7ba8fb1" status: 200 len: 1313 microversion: 2.1 time: 0.561523 Oct 04 18:39:36.917520 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1453/2854] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:36 2022] GET /compute/v2.1/servers/2f257e47-8666-45d9-bed4-74cfd7ba8fb1 => generated 1313 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:39:36.936246 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a5d7e449-c3b1-469f-8ac9-10085954f879 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:36.937042 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a5d7e449-c3b1-469f-8ac9-10085954f879 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 5965d934-6f27-43ac-bf15-8fd20da48cc1] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:36.943822 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a5d7e449-c3b1-469f-8ac9-10085954f879 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:36.944349 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a5d7e449-c3b1-469f-8ac9-10085954f879 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:36.944794 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a5d7e449-c3b1-469f-8ac9-10085954f879 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:36.945676 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a5d7e449-c3b1-469f-8ac9-10085954f879 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:36.946144 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a5d7e449-c3b1-469f-8ac9-10085954f879 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:36.947140 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a5d7e449-c3b1-469f-8ac9-10085954f879 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:36.961822 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-a5d7e449-c3b1-469f-8ac9-10085954f879 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] HTTP exception thrown: Instance 5965d934-6f27-43ac-bf15-8fd20da48cc1 could not be found. Oct 04 18:39:36.972206 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a5d7e449-c3b1-469f-8ac9-10085954f879 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Request method failure captured: Oct 04 18:39:36.972206 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1 HTTP/1.1 Oct 04 18:39:36.972206 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:39:36.972206 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:39:36.972206 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:39:36.972206 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:39:36.972206 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:39:36.972206 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:39:36.972206 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:39:36.972206 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:39:36.972206 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH1V_KaVb2tQ7hRh9fQ61hx1Tru1OnzHV0KR45nHegF4jR8bb_6kYVDM8AShrmLIbrmj_5XZh5qqitam9SIncnJFjLQma6UATJPVqQoRbM5nU2MVf7C7o7Cf1WRbudQPi62kcxsp285-EV6tifwkKgk0DmQapz6q5clbpBeX5PZXlmc Oct 04 18:39:36.972206 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:39:36.972206 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:39:36.972206 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:39:36.972206 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:39:36.972206 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:39:36.972206 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:39:36.972206 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 87473abf47e74adf844e3ddfa24da3f2 Oct 04 18:39:36.972206 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServerRescueTestJSON-93809695 Oct 04 18:39:36.972206 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:39:36.972206 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:39:36.972206 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/87473abf47e74adf844e3ddfa24da3f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_87473abf47e74adf844e3ddfa24da3f2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/87473abf47e74adf844e3ddfa24da3f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/87473abf47e74adf844e3ddfa24da3f2"}]}] Oct 04 18:39:36.972206 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServerRescueTestJSON-93809695 Oct 04 18:39:36.972206 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 87473abf47e74adf844e3ddfa24da3f2 Oct 04 18:39:36.972206 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServerRescueTestJSON-93809695 Oct 04 18:39:36.972206 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServerRescueTestJSON-93809695-project Oct 04 18:39:36.972206 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:39:36.972206 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:39:36.972206 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 8284fe51decd4db0bf6b3ed1514cc2c1 Oct 04 18:39:36.972206 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServerRescueTestJSON-93809695-project Oct 04 18:39:36.972206 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:39:36.972206 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 5965d934-6f27-43ac-bf15-8fd20da48cc1 could not be found. Oct 04 18:39:36.972206 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '5965d934-6f27-43ac-bf15-8fd20da48cc1'} Oct 04 18:39:36.972206 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:39:36.972206 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:36.972206 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:39:36.972206 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:39:36.972206 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:39:36.972206 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:39:36.972206 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:39:36.972206 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:39:36.972206 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:39:36.972206 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:39:36.972206 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5965d934-6f27-43ac-bf15-8fd20da48cc1 could not be found. Oct 04 18:39:36.972206 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:39:36.972206 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:39:36.972206 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:39:36.972206 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:36.972206 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:39:36.972206 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:39:36.972206 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:39:36.972206 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:39:36.972206 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:39:36.972206 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:39:36.972206 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:39:36.972206 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:39:36.972206 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:39:36.972206 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:39:36.972206 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:39:36.972206 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:39:36.972206 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5965d934-6f27-43ac-bf15-8fd20da48cc1 could not be found. Oct 04 18:39:36.972206 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:39:36.972206 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:39:36.972206 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:39:36.984139 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:36.984139 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:39:36.984139 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:39:36.984139 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:39:36.984139 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:39:36.984139 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5965d934-6f27-43ac-bf15-8fd20da48cc1 could not be found. Oct 04 18:39:36.984139 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:39:36.984139 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a5d7e449-c3b1-469f-8ac9-10085954f879 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Returning 404 to user: Instance 5965d934-6f27-43ac-bf15-8fd20da48cc1 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:39:36.984139 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a5d7e449-c3b1-469f-8ac9-10085954f879 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] 10.222.0.20 "GET /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1" status: 404 len: 111 microversion: 2.1 time: 0.043955 Oct 04 18:39:36.985413 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1454/2855] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:36 2022] GET /compute/v2.1/servers/5965d934-6f27-43ac-bf15-8fd20da48cc1 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:39:36.993333 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-fe3517c6-3ade-4d56-9f41-fbdd56a9ba1f tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:36.993908 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-fe3517c6-3ade-4d56-9f41-fbdd56a9ba1f tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 61ec7cca-1572-496c-ba44-439f04c2a79c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:37.002738 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fe3517c6-3ade-4d56-9f41-fbdd56a9ba1f tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:37.003320 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fe3517c6-3ade-4d56-9f41-fbdd56a9ba1f tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:37.003991 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fe3517c6-3ade-4d56-9f41-fbdd56a9ba1f tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:37.006450 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fe3517c6-3ade-4d56-9f41-fbdd56a9ba1f tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:37.007074 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fe3517c6-3ade-4d56-9f41-fbdd56a9ba1f tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:37.015532 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fe3517c6-3ade-4d56-9f41-fbdd56a9ba1f tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:37.050279 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-fe3517c6-3ade-4d56-9f41-fbdd56a9ba1f tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 61ec7cca-1572-496c-ba44-439f04c2a79c] Going to try to terminate instance {{(pid=123002) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:39:37.090160 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:39:37.212518 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-deb432f6-b409-4adc-a123-fd1d903ee3a1 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b319d463-fa0d-4e2d-b03f-6227475572da" status: 204 len: 0 microversion: 2.1 time: 0.433096 Oct 04 18:39:37.213669 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1402/2856] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:39:36 2022] DELETE /compute/v2.1/servers/b319d463-fa0d-4e2d-b03f-6227475572da => generated 0 bytes in 435 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:39:37.219070 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-e4ee4fd6-6fa0-4a4c-a39f-e7b1be30598c req-2d82619d-25d3-4e6c-836c-a25d8c47e5db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e308f41-242e-4ce3-8641-9510e2f13681", "name": "network-vif-unplugged", "status": "completed", "tag": "192de35c-060d-4a11-8df5-09c24dfcc8d0"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:37.229423 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-e4ee4fd6-6fa0-4a4c-a39f-e7b1be30598c req-2d82619d-25d3-4e6c-836c-a25d8c47e5db service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:37.230015 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-e4ee4fd6-6fa0-4a4c-a39f-e7b1be30598c req-2d82619d-25d3-4e6c-836c-a25d8c47e5db service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:37.230834 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-e4ee4fd6-6fa0-4a4c-a39f-e7b1be30598c req-2d82619d-25d3-4e6c-836c-a25d8c47e5db service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:37.256732 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-e4ee4fd6-6fa0-4a4c-a39f-e7b1be30598c req-2d82619d-25d3-4e6c-836c-a25d8c47e5db service nova] Creating event network-vif-unplugged:192de35c-060d-4a11-8df5-09c24dfcc8d0 for instance 2e308f41-242e-4ce3-8641-9510e2f13681 on n-h2-850501-14 Oct 04 18:39:37.263010 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [req-e4ee4fd6-6fa0-4a4c-a39f-e7b1be30598c req-2d82619d-25d3-4e6c-836c-a25d8c47e5db service nova] Instance 2e308f41-242e-4ce3-8641-9510e2f13681 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850501-14', 'n-h2-850501-14'} {{(pid=123001) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:39:37.274033 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-e4ee4fd6-6fa0-4a4c-a39f-e7b1be30598c req-2d82619d-25d3-4e6c-836c-a25d8c47e5db service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058703 Oct 04 18:39:37.275287 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1403/2857] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:39:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:37.280296 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0815050b-bdf5-49ae-b2c7-b527b65a20eb tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:37.280991 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0815050b-bdf5-49ae-b2c7-b527b65a20eb tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] [instance: b319d463-fa0d-4e2d-b03f-6227475572da] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:37.287832 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0815050b-bdf5-49ae-b2c7-b527b65a20eb tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:37.288350 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0815050b-bdf5-49ae-b2c7-b527b65a20eb tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:37.288781 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0815050b-bdf5-49ae-b2c7-b527b65a20eb tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:37.289473 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0815050b-bdf5-49ae-b2c7-b527b65a20eb tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:37.290091 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0815050b-bdf5-49ae-b2c7-b527b65a20eb tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:37.290670 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0815050b-bdf5-49ae-b2c7-b527b65a20eb tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:37.338980 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-fe3517c6-3ade-4d56-9f41-fbdd56a9ba1f tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] 10.222.0.20 "DELETE /compute/v2.1/servers/61ec7cca-1572-496c-ba44-439f04c2a79c" status: 204 len: 0 microversion: 2.1 time: 0.351854 Oct 04 18:39:37.339566 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1455/2858] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:39:36 2022] DELETE /compute/v2.1/servers/61ec7cca-1572-496c-ba44-439f04c2a79c => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:39:37.347260 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-efd39f5f-919a-45be-911c-cb542e367689 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:37.347966 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-efd39f5f-919a-45be-911c-cb542e367689 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2e308f41-242e-4ce3-8641-9510e2f13681] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:37.357175 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-efd39f5f-919a-45be-911c-cb542e367689 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:37.357667 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-efd39f5f-919a-45be-911c-cb542e367689 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:37.358151 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-efd39f5f-919a-45be-911c-cb542e367689 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:37.358865 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-efd39f5f-919a-45be-911c-cb542e367689 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:37.359320 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-efd39f5f-919a-45be-911c-cb542e367689 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:37.359735 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-efd39f5f-919a-45be-911c-cb542e367689 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:37.746542 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-efd39f5f-919a-45be-911c-cb542e367689 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:37.755941 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-efd39f5f-919a-45be-911c-cb542e367689 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681" status: 200 len: 1475 microversion: 2.1 time: 0.414953 Oct 04 18:39:37.777590 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0815050b-bdf5-49ae-b2c7-b527b65a20eb tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73127bc6636476482e280eddad7f66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9174b09e32064811a61539c64992ee50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:37.778681 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1456/2859] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:37 2022] GET /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681 => generated 1475 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:37.784491 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-825fb754-dab9-494b-862e-17bbdee046a5 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:37.785278 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-825fb754-dab9-494b-862e-17bbdee046a5 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 61ec7cca-1572-496c-ba44-439f04c2a79c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:37.795282 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-825fb754-dab9-494b-862e-17bbdee046a5 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:37.795985 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-825fb754-dab9-494b-862e-17bbdee046a5 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:37.796850 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-825fb754-dab9-494b-862e-17bbdee046a5 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:37.798460 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-825fb754-dab9-494b-862e-17bbdee046a5 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:37.799231 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-825fb754-dab9-494b-862e-17bbdee046a5 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:37.799965 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-825fb754-dab9-494b-862e-17bbdee046a5 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:37.810366 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0815050b-bdf5-49ae-b2c7-b527b65a20eb tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] 10.222.0.20 "GET /compute/v2.1/servers/b319d463-fa0d-4e2d-b03f-6227475572da" status: 200 len: 1680 microversion: 2.1 time: 0.532292 Oct 04 18:39:37.811147 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1404/2860] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:37 2022] GET /compute/v2.1/servers/b319d463-fa0d-4e2d-b03f-6227475572da => generated 1680 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:37.818952 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-cccf1d09-4d91-4980-901e-c2827f56e31e tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:37.819732 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-cccf1d09-4d91-4980-901e-c2827f56e31e tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] [instance: 6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:37.827000 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cccf1d09-4d91-4980-901e-c2827f56e31e tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:37.828029 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cccf1d09-4d91-4980-901e-c2827f56e31e tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:37.828712 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cccf1d09-4d91-4980-901e-c2827f56e31e tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:37.829925 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cccf1d09-4d91-4980-901e-c2827f56e31e tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:37.834819 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cccf1d09-4d91-4980-901e-c2827f56e31e tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:37.834819 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cccf1d09-4d91-4980-901e-c2827f56e31e tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:38.077256 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-825fb754-dab9-494b-862e-17bbdee046a5 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8284fe51decd4db0bf6b3ed1514cc2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87473abf47e74adf844e3ddfa24da3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:38.086424 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-825fb754-dab9-494b-862e-17bbdee046a5 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] 10.222.0.20 "GET /compute/v2.1/servers/61ec7cca-1572-496c-ba44-439f04c2a79c" status: 200 len: 1491 microversion: 2.1 time: 0.306348 Oct 04 18:39:38.087827 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1457/2861] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:37 2022] GET /compute/v2.1/servers/61ec7cca-1572-496c-ba44-439f04c2a79c => generated 1491 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:38.092782 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1dc43dbe-9c1d-4480-9026-8bd7b5e8ab39 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-623503047", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "b5016a17-8e06-4eaa-bdcf-889879744f57"}, {"port": "97062070-e6e0-48fa-bf25-5e66c4585ef9", "tag": "port-1"}, {"port": "cbad334d-c696-4a06-b1cc-741dd0479d60", "tag": "port-2"}, {"uuid": "a2558344-67b1-4996-b790-fdbc45413110", "tag": "net-1"}, {"uuid": "a2558344-67b1-4996-b790-fdbc45413110"}, {"uuid": "6442cce8-fabf-4d4a-9681-166f8d7e3662", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "6442cce8-fabf-4d4a-9681-166f8d7e3662", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "3bca719d-70ad-474f-aa23-d047606782c7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "a6c03bff-89fb-4476-8cd2-f44d6c0cd60e", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "7c12a65b-f2b4-4659-908c-56b43fac69fc", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--82536796"}], "key_name": "tempest-keypair-1898144732", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:38.135649 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-cccf1d09-4d91-4980-901e-c2827f56e31e tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec13a0273819409b8ecba05e9337ec73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6edbe27acbc4c9eba33a6f589f6cf8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:38.143302 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-cccf1d09-4d91-4980-901e-c2827f56e31e tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] 10.222.0.20 "GET /compute/v2.1/servers/6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28" status: 200 len: 1323 microversion: 2.1 time: 0.331109 Oct 04 18:39:38.143884 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1405/2862] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:37 2022] GET /compute/v2.1/servers/6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28 => generated 1323 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:38.157867 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1d4e4492-ac45-4aad-953f-024b953692d4 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:38.158663 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1d4e4492-ac45-4aad-953f-024b953692d4 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: 2f257e47-8666-45d9-bed4-74cfd7ba8fb1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:38.166057 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1d4e4492-ac45-4aad-953f-024b953692d4 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:38.166688 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1d4e4492-ac45-4aad-953f-024b953692d4 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:38.167167 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1d4e4492-ac45-4aad-953f-024b953692d4 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:38.167922 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1d4e4492-ac45-4aad-953f-024b953692d4 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:38.168399 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1d4e4492-ac45-4aad-953f-024b953692d4 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:38.168838 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1d4e4492-ac45-4aad-953f-024b953692d4 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:38.216619 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-1dc43dbe-9c1d-4480-9026-8bd7b5e8ab39 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] validate_networks() for [('b5016a17-8e06-4eaa-bdcf-889879744f57', None, None, None, None, None), (None, None, '97062070-e6e0-48fa-bf25-5e66c4585ef9', None, None, None), (None, None, 'cbad334d-c696-4a06-b1cc-741dd0479d60', None, None, None), ('a2558344-67b1-4996-b790-fdbc45413110', None, None, None, None, None), ('a2558344-67b1-4996-b790-fdbc45413110', None, None, None, None, None), ('6442cce8-fabf-4d4a-9681-166f8d7e3662', '10.2.2.100', None, None, None, None), ('6442cce8-fabf-4d4a-9681-166f8d7e3662', '10.2.2.200', None, None, None, None)] {{(pid=123002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:39:38.309757 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=4 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:39:38.418279 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=12 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:39:38.569276 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1d4e4492-ac45-4aad-953f-024b953692d4 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8358c07e2684b749a62becb9f0b7869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b922a74c1c2448bb770d6b298b2d601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:38.578073 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1d4e4492-ac45-4aad-953f-024b953692d4 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "GET /compute/v2.1/servers/2f257e47-8666-45d9-bed4-74cfd7ba8fb1" status: 200 len: 1313 microversion: 2.1 time: 0.424307 Oct 04 18:39:38.578649 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1406/2863] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:38 2022] GET /compute/v2.1/servers/2f257e47-8666-45d9-bed4-74cfd7ba8fb1 => generated 1313 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:38.784998 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7f1df860-e2ae-4b84-a87e-5f82207aabf0 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:38.786540 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7f1df860-e2ae-4b84-a87e-5f82207aabf0 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2e308f41-242e-4ce3-8641-9510e2f13681] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:38.796117 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7f1df860-e2ae-4b84-a87e-5f82207aabf0 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:38.796919 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7f1df860-e2ae-4b84-a87e-5f82207aabf0 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:38.800664 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7f1df860-e2ae-4b84-a87e-5f82207aabf0 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:38.801911 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7f1df860-e2ae-4b84-a87e-5f82207aabf0 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:38.802580 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7f1df860-e2ae-4b84-a87e-5f82207aabf0 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:38.803209 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7f1df860-e2ae-4b84-a87e-5f82207aabf0 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:39.414522 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7f1df860-e2ae-4b84-a87e-5f82207aabf0 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:39.425558 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7f1df860-e2ae-4b84-a87e-5f82207aabf0 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681" status: 200 len: 1475 microversion: 2.1 time: 0.644550 Oct 04 18:39:39.427221 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1407/2864] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:38 2022] GET /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681 => generated 1475 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:39.435881 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-65881826-0966-4e6f-bd5c-10dc7578d4b5 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:39.436525 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-65881826-0966-4e6f-bd5c-10dc7578d4b5 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] [instance: b319d463-fa0d-4e2d-b03f-6227475572da] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:39.455617 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-65881826-0966-4e6f-bd5c-10dc7578d4b5 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:39.456176 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-65881826-0966-4e6f-bd5c-10dc7578d4b5 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:39.456636 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-65881826-0966-4e6f-bd5c-10dc7578d4b5 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:39.457987 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-65881826-0966-4e6f-bd5c-10dc7578d4b5 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:39.457987 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-65881826-0966-4e6f-bd5c-10dc7578d4b5 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:39.458421 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-65881826-0966-4e6f-bd5c-10dc7578d4b5 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:39.894680 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-65881826-0966-4e6f-bd5c-10dc7578d4b5 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c73127bc6636476482e280eddad7f66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9174b09e32064811a61539c64992ee50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:39.903490 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-65881826-0966-4e6f-bd5c-10dc7578d4b5 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] 10.222.0.20 "GET /compute/v2.1/servers/b319d463-fa0d-4e2d-b03f-6227475572da" status: 200 len: 1680 microversion: 2.1 time: 0.475193 Oct 04 18:39:39.909104 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1408/2865] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:39 2022] GET /compute/v2.1/servers/b319d463-fa0d-4e2d-b03f-6227475572da => generated 1680 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:39.914214 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c3188898-ab0e-412d-bbcc-ccdd9c489f0f tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:39.916626 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c3188898-ab0e-412d-bbcc-ccdd9c489f0f tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 61ec7cca-1572-496c-ba44-439f04c2a79c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:39.935441 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c3188898-ab0e-412d-bbcc-ccdd9c489f0f tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:39.935441 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c3188898-ab0e-412d-bbcc-ccdd9c489f0f tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:39.935441 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c3188898-ab0e-412d-bbcc-ccdd9c489f0f tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:39.935441 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c3188898-ab0e-412d-bbcc-ccdd9c489f0f tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:39.935441 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c3188898-ab0e-412d-bbcc-ccdd9c489f0f tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:39.935441 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c3188898-ab0e-412d-bbcc-ccdd9c489f0f tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:40.686967 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c3188898-ab0e-412d-bbcc-ccdd9c489f0f tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8284fe51decd4db0bf6b3ed1514cc2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87473abf47e74adf844e3ddfa24da3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:40.699445 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c3188898-ab0e-412d-bbcc-ccdd9c489f0f tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] 10.222.0.20 "GET /compute/v2.1/servers/61ec7cca-1572-496c-ba44-439f04c2a79c" status: 200 len: 1491 microversion: 2.1 time: 0.788862 Oct 04 18:39:40.702484 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1409/2866] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:39 2022] GET /compute/v2.1/servers/61ec7cca-1572-496c-ba44-439f04c2a79c => generated 1491 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:40.725180 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-69fcc2de-318f-4288-b29f-929f67f38ea9 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:40.726508 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-69fcc2de-318f-4288-b29f-929f67f38ea9 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] [instance: 6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:40.736951 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-69fcc2de-318f-4288-b29f-929f67f38ea9 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:40.739698 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-69fcc2de-318f-4288-b29f-929f67f38ea9 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:40.742010 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-69fcc2de-318f-4288-b29f-929f67f38ea9 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:40.742757 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-69fcc2de-318f-4288-b29f-929f67f38ea9 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:40.749752 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-69fcc2de-318f-4288-b29f-929f67f38ea9 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:40.759119 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-69fcc2de-318f-4288-b29f-929f67f38ea9 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:41.074792 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-69fcc2de-318f-4288-b29f-929f67f38ea9 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec13a0273819409b8ecba05e9337ec73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6edbe27acbc4c9eba33a6f589f6cf8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:41.109713 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-69fcc2de-318f-4288-b29f-929f67f38ea9 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] 10.222.0.20 "GET /compute/v2.1/servers/6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28" status: 200 len: 1323 microversion: 2.1 time: 0.405543 Oct 04 18:39:41.110615 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1410/2867] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:40 2022] GET /compute/v2.1/servers/6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28 => generated 1323 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:41.121240 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-f04cce60-3660-44ac-a5b0-9520a5421e08 req-8cd049e3-f84b-4413-9570-74d77e0716e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e308f41-242e-4ce3-8641-9510e2f13681", "tag": "192de35c-060d-4a11-8df5-09c24dfcc8d0"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:41.131744 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-f04cce60-3660-44ac-a5b0-9520a5421e08 req-8cd049e3-f84b-4413-9570-74d77e0716e3 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:41.132839 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-f04cce60-3660-44ac-a5b0-9520a5421e08 req-8cd049e3-f84b-4413-9570-74d77e0716e3 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:41.133522 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-f04cce60-3660-44ac-a5b0-9520a5421e08 req-8cd049e3-f84b-4413-9570-74d77e0716e3 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:41.151351 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-f04cce60-3660-44ac-a5b0-9520a5421e08 req-8cd049e3-f84b-4413-9570-74d77e0716e3 service nova] Creating event network-changed:192de35c-060d-4a11-8df5-09c24dfcc8d0 for instance 2e308f41-242e-4ce3-8641-9510e2f13681 on n-h2-850501-14 Oct 04 18:39:41.159192 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [req-f04cce60-3660-44ac-a5b0-9520a5421e08 req-8cd049e3-f84b-4413-9570-74d77e0716e3 service nova] Instance 2e308f41-242e-4ce3-8641-9510e2f13681 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850501-14', 'n-h2-850501-14'} {{(pid=123001) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:39:41.191997 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-f04cce60-3660-44ac-a5b0-9520a5421e08 req-8cd049e3-f84b-4413-9570-74d77e0716e3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079443 Oct 04 18:39:41.193202 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1411/2868] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:39:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:41.203041 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9c902b8e-22dd-444f-be87-e4bceae2c004 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:41.205265 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-9c902b8e-22dd-444f-be87-e4bceae2c004 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: 2f257e47-8666-45d9-bed4-74cfd7ba8fb1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:41.225408 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9c902b8e-22dd-444f-be87-e4bceae2c004 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:41.228028 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9c902b8e-22dd-444f-be87-e4bceae2c004 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:41.229236 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9c902b8e-22dd-444f-be87-e4bceae2c004 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:41.230300 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9c902b8e-22dd-444f-be87-e4bceae2c004 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:41.231221 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9c902b8e-22dd-444f-be87-e4bceae2c004 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:41.231848 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9c902b8e-22dd-444f-be87-e4bceae2c004 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:41.841210 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9c902b8e-22dd-444f-be87-e4bceae2c004 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8358c07e2684b749a62becb9f0b7869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b922a74c1c2448bb770d6b298b2d601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:41.849091 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9c902b8e-22dd-444f-be87-e4bceae2c004 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "GET /compute/v2.1/servers/2f257e47-8666-45d9-bed4-74cfd7ba8fb1" status: 200 len: 1313 microversion: 2.1 time: 0.652035 Oct 04 18:39:41.854029 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1412/2869] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:41 2022] GET /compute/v2.1/servers/2f257e47-8666-45d9-bed4-74cfd7ba8fb1 => generated 1313 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:42.123496 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d2879576-d6b4-4d4b-aa46-2f4060924cc4 tempest-SecurityGroupsTestAdminJSON-1786065839 tempest-SecurityGroupsTestAdminJSON-1786065839-project] Action: 'create', calling method: .version_select at 0x7fe258156820>, body: {"security_group": {"name": "tempest-securitygroup-1162849132", "description": "tempest-description-2127979536"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:42.134893 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=8 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:39:43.563616 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d2879576-d6b4-4d4b-aa46-2f4060924cc4 tempest-SecurityGroupsTestAdminJSON-1786065839 tempest-SecurityGroupsTestAdminJSON-1786065839-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 1.707805 Oct 04 18:39:43.565959 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1413/2870] 10.222.0.20 () {60 vars in 1180 bytes} [Tue Oct 4 18:39:41 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 1711 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:43.573873 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-18b204fb-de83-4638-814d-bc4442055c06 req-9e054229-cd93-42ac-9db4-0a5f01da16ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b319d463-fa0d-4e2d-b03f-6227475572da", "name": "network-vif-deleted", "tag": "617a3d5c-1b67-469f-ad73-1ceedb040447"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:43.590162 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-18b204fb-de83-4638-814d-bc4442055c06 req-9e054229-cd93-42ac-9db4-0a5f01da16ad service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:43.590652 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-18b204fb-de83-4638-814d-bc4442055c06 req-9e054229-cd93-42ac-9db4-0a5f01da16ad service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:43.591078 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-18b204fb-de83-4638-814d-bc4442055c06 req-9e054229-cd93-42ac-9db4-0a5f01da16ad service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:43.624710 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-18b204fb-de83-4638-814d-bc4442055c06 req-9e054229-cd93-42ac-9db4-0a5f01da16ad service nova] Creating event network-vif-deleted:617a3d5c-1b67-469f-ad73-1ceedb040447 for instance b319d463-fa0d-4e2d-b03f-6227475572da on n-h1-850501-14 Oct 04 18:39:43.636491 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-18b204fb-de83-4638-814d-bc4442055c06 req-9e054229-cd93-42ac-9db4-0a5f01da16ad service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068314 Oct 04 18:39:43.643928 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1414/2871] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:39:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:43.661112 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-be4d7344-d5f0-469c-aea4-e2e1b7c1e852 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:43.662546 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-be4d7344-d5f0-469c-aea4-e2e1b7c1e852 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2e308f41-242e-4ce3-8641-9510e2f13681] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:43.671335 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-be4d7344-d5f0-469c-aea4-e2e1b7c1e852 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:43.674189 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-be4d7344-d5f0-469c-aea4-e2e1b7c1e852 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:43.674785 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-be4d7344-d5f0-469c-aea4-e2e1b7c1e852 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:43.675698 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-be4d7344-d5f0-469c-aea4-e2e1b7c1e852 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:43.676705 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-be4d7344-d5f0-469c-aea4-e2e1b7c1e852 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:43.677313 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-be4d7344-d5f0-469c-aea4-e2e1b7c1e852 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:44.266399 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-be4d7344-d5f0-469c-aea4-e2e1b7c1e852 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:44.275070 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-be4d7344-d5f0-469c-aea4-e2e1b7c1e852 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681" status: 200 len: 1473 microversion: 2.1 time: 0.628740 Oct 04 18:39:44.275954 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1415/2872] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:43 2022] GET /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681 => generated 1473 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:44.280808 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-97f7d8ce-1671-43fb-a640-ef1ce975a9ef tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:44.287024 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-97f7d8ce-1671-43fb-a640-ef1ce975a9ef tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] [instance: b319d463-fa0d-4e2d-b03f-6227475572da] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:44.292991 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:39:44.294537 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-97f7d8ce-1671-43fb-a640-ef1ce975a9ef tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:44.295022 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-97f7d8ce-1671-43fb-a640-ef1ce975a9ef tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:44.295460 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-97f7d8ce-1671-43fb-a640-ef1ce975a9ef tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:44.296187 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-97f7d8ce-1671-43fb-a640-ef1ce975a9ef tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:44.296638 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-97f7d8ce-1671-43fb-a640-ef1ce975a9ef tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:44.297062 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-97f7d8ce-1671-43fb-a640-ef1ce975a9ef tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:44.311310 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-97f7d8ce-1671-43fb-a640-ef1ce975a9ef tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] HTTP exception thrown: Instance b319d463-fa0d-4e2d-b03f-6227475572da could not be found. Oct 04 18:39:44.312980 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-97f7d8ce-1671-43fb-a640-ef1ce975a9ef tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Request method failure captured: Oct 04 18:39:44.312980 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/b319d463-fa0d-4e2d-b03f-6227475572da HTTP/1.1 Oct 04 18:39:44.312980 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:39:44.312980 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:39:44.312980 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:39:44.312980 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:39:44.312980 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:39:44.312980 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:39:44.312980 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:39:44.312980 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:39:44.312980 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPH1HfHEo2cwdjOLtGCHh_IBMA3cE0xV7juOK6IuLShskx370hovWysFmCTVO7WixJ8eJX8zwjq79pWahhPPmnq1rkdoHr5hgv1l_Vx8CkfPoWI6rsIP_-lbMrcO6TYOKvVDJXVbOSvSAnXumgazyPzLqODNtEaRm6L_nZx9-ryOs2A8 Oct 04 18:39:44.312980 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:39:44.312980 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:39:44.312980 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:39:44.312980 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:39:44.312980 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:39:44.312980 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:39:44.312980 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 9174b09e32064811a61539c64992ee50 Oct 04 18:39:44.312980 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-38750755 Oct 04 18:39:44.312980 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:39:44.312980 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:39:44.312980 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9174b09e32064811a61539c64992ee50"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9174b09e32064811a61539c64992ee50", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9174b09e32064811a61539c64992ee50"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9174b09e32064811a61539c64992ee50"}]}] Oct 04 18:39:44.312980 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-38750755 Oct 04 18:39:44.312980 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 9174b09e32064811a61539c64992ee50 Oct 04 18:39:44.312980 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-38750755 Oct 04 18:39:44.312980 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-AttachSCSIVolumeTestJSON-38750755-project Oct 04 18:39:44.312980 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:39:44.312980 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:39:44.312980 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: c73127bc6636476482e280eddad7f66c Oct 04 18:39:44.312980 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-38750755-project Oct 04 18:39:44.312980 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:39:44.312980 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance b319d463-fa0d-4e2d-b03f-6227475572da could not be found. Oct 04 18:39:44.312980 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': 'b319d463-fa0d-4e2d-b03f-6227475572da'} Oct 04 18:39:44.312980 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:39:44.312980 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:44.312980 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:39:44.312980 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:39:44.312980 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:39:44.312980 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:39:44.312980 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:39:44.312980 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:39:44.312980 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:39:44.312980 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:39:44.312980 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b319d463-fa0d-4e2d-b03f-6227475572da could not be found. Oct 04 18:39:44.312980 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:39:44.312980 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:39:44.312980 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:39:44.312980 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:44.312980 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:39:44.312980 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:39:44.312980 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:39:44.312980 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:39:44.312980 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:39:44.312980 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:39:44.312980 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:39:44.312980 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:39:44.312980 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:39:44.312980 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:39:44.312980 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:39:44.312980 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:39:44.312980 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b319d463-fa0d-4e2d-b03f-6227475572da could not be found. Oct 04 18:39:44.312980 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:39:44.312980 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:39:44.312980 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:39:44.318136 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:44.318136 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:39:44.318136 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:39:44.318136 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:39:44.318136 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:39:44.318136 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b319d463-fa0d-4e2d-b03f-6227475572da could not be found. Oct 04 18:39:44.318136 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:39:44.318136 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-97f7d8ce-1671-43fb-a640-ef1ce975a9ef tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Returning 404 to user: Instance b319d463-fa0d-4e2d-b03f-6227475572da could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:39:44.318136 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-97f7d8ce-1671-43fb-a640-ef1ce975a9ef tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] 10.222.0.20 "GET /compute/v2.1/servers/b319d463-fa0d-4e2d-b03f-6227475572da" status: 404 len: 111 microversion: 2.1 time: 0.037575 Oct 04 18:39:44.318136 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1416/2873] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:44 2022] GET /compute/v2.1/servers/b319d463-fa0d-4e2d-b03f-6227475572da => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:39:44.322113 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0fd18c04-59bf-4798-9291-4ec48a7cf89d tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:44.322718 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0fd18c04-59bf-4798-9291-4ec48a7cf89d tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 61ec7cca-1572-496c-ba44-439f04c2a79c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:44.329409 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0fd18c04-59bf-4798-9291-4ec48a7cf89d tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:44.329891 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0fd18c04-59bf-4798-9291-4ec48a7cf89d tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:44.330314 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0fd18c04-59bf-4798-9291-4ec48a7cf89d tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:44.331304 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0fd18c04-59bf-4798-9291-4ec48a7cf89d tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:44.331919 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0fd18c04-59bf-4798-9291-4ec48a7cf89d tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:44.332444 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0fd18c04-59bf-4798-9291-4ec48a7cf89d tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:44.342529 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-1dc43dbe-9c1d-4480-9026-8bd7b5e8ab39 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:39:44.343028 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-1dc43dbe-9c1d-4480-9026-8bd7b5e8ab39 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:39:44.343410 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-1dc43dbe-9c1d-4480-9026-8bd7b5e8ab39 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:39:44.343814 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-1dc43dbe-9c1d-4480-9026-8bd7b5e8ab39 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:39:44.347306 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-1dc43dbe-9c1d-4480-9026-8bd7b5e8ab39 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:39:44.353516 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1dc43dbe-9c1d-4480-9026-8bd7b5e8ab39 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:44.354000 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1dc43dbe-9c1d-4480-9026-8bd7b5e8ab39 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:44.354432 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1dc43dbe-9c1d-4480-9026-8bd7b5e8ab39 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:44.355148 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1dc43dbe-9c1d-4480-9026-8bd7b5e8ab39 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:44.355595 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1dc43dbe-9c1d-4480-9026-8bd7b5e8ab39 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:44.356012 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1dc43dbe-9c1d-4480-9026-8bd7b5e8ab39 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:44.367352 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0fd18c04-59bf-4798-9291-4ec48a7cf89d tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:44.368837 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0fd18c04-59bf-4798-9291-4ec48a7cf89d tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:44.369540 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0fd18c04-59bf-4798-9291-4ec48a7cf89d tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:44.369996 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-0fd18c04-59bf-4798-9291-4ec48a7cf89d tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lazy-loading 'fault' on Instance uuid 61ec7cca-1572-496c-ba44-439f04c2a79c {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:39:44.373081 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-1dc43dbe-9c1d-4480-9026-8bd7b5e8ab39 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Getting quotas for project d6dbf28bee1e4a6eb1d3db071823690c. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:39:44.377748 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-1dc43dbe-9c1d-4480-9026-8bd7b5e8ab39 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Getting quotas for user 996abacc15b74496a27b1ecaaea0161b and project d6dbf28bee1e4a6eb1d3db071823690c. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:39:44.416846 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0fd18c04-59bf-4798-9291-4ec48a7cf89d tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8284fe51decd4db0bf6b3ed1514cc2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87473abf47e74adf844e3ddfa24da3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:44.427663 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0fd18c04-59bf-4798-9291-4ec48a7cf89d tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] 10.222.0.20 "GET /compute/v2.1/servers/61ec7cca-1572-496c-ba44-439f04c2a79c" status: 200 len: 1303 microversion: 2.1 time: 0.110845 Oct 04 18:39:44.428308 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1417/2874] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:44 2022] GET /compute/v2.1/servers/61ec7cca-1572-496c-ba44-439f04c2a79c => generated 1303 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:44.436918 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f0261c50-ae22-4f85-9463-58eb0d675aa5 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:44.437592 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f0261c50-ae22-4f85-9463-58eb0d675aa5 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] [instance: 6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:44.444034 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f0261c50-ae22-4f85-9463-58eb0d675aa5 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:44.444561 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f0261c50-ae22-4f85-9463-58eb0d675aa5 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:44.445079 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f0261c50-ae22-4f85-9463-58eb0d675aa5 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:44.445849 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f0261c50-ae22-4f85-9463-58eb0d675aa5 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:44.446531 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f0261c50-ae22-4f85-9463-58eb0d675aa5 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:44.446853 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f0261c50-ae22-4f85-9463-58eb0d675aa5 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:44.559816 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1dc43dbe-9c1d-4480-9026-8bd7b5e8ab39 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Going to run 1 instances... {{(pid=123002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:39:44.562924 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1dc43dbe-9c1d-4480-9026-8bd7b5e8ab39 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] [instance: 3d3cabc2-fa23-4098-9197-9aaa19a0c663] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='3bca719d-70ad-474f-aa23-d047606782c7',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='a6c03bff-89fb-4476-8cd2-f44d6c0cd60e',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7c12a65b-f2b4-4659-908c-56b43fac69fc',volume_size=None,volume_type=None)] {{(pid=123002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:39:44.681442 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f0261c50-ae22-4f85-9463-58eb0d675aa5 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec13a0273819409b8ecba05e9337ec73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6edbe27acbc4c9eba33a6f589f6cf8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:44.689774 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f0261c50-ae22-4f85-9463-58eb0d675aa5 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] 10.222.0.20 "GET /compute/v2.1/servers/6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28" status: 200 len: 1323 microversion: 2.1 time: 0.257311 Oct 04 18:39:44.690550 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1418/2875] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:44 2022] GET /compute/v2.1/servers/6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28 => generated 1323 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:44.700980 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c03250bd-fad3-4db5-953e-df869417a9a2 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:44.701841 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c03250bd-fad3-4db5-953e-df869417a9a2 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: 2f257e47-8666-45d9-bed4-74cfd7ba8fb1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:44.708764 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c03250bd-fad3-4db5-953e-df869417a9a2 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:44.709533 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c03250bd-fad3-4db5-953e-df869417a9a2 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:44.710242 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c03250bd-fad3-4db5-953e-df869417a9a2 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:44.711154 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c03250bd-fad3-4db5-953e-df869417a9a2 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:44.711651 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c03250bd-fad3-4db5-953e-df869417a9a2 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:44.713045 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c03250bd-fad3-4db5-953e-df869417a9a2 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:44.940519 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c03250bd-fad3-4db5-953e-df869417a9a2 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8358c07e2684b749a62becb9f0b7869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b922a74c1c2448bb770d6b298b2d601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:44.949055 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c03250bd-fad3-4db5-953e-df869417a9a2 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "GET /compute/v2.1/servers/2f257e47-8666-45d9-bed4-74cfd7ba8fb1" status: 200 len: 1313 microversion: 2.1 time: 0.255479 Oct 04 18:39:44.949860 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1419/2876] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:44 2022] GET /compute/v2.1/servers/2f257e47-8666-45d9-bed4-74cfd7ba8fb1 => generated 1313 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:44.965317 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-3f02f241-fa38-421c-b793-94ae2578667e req-9eb1d6f8-7d99-4f70-ab6a-aeca88770c80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28", "tag": "c22b4d3b-0439-436b-bdf6-38e75b8da2dd"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:44.978151 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-3f02f241-fa38-421c-b793-94ae2578667e req-9eb1d6f8-7d99-4f70-ab6a-aeca88770c80 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:44.978638 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-3f02f241-fa38-421c-b793-94ae2578667e req-9eb1d6f8-7d99-4f70-ab6a-aeca88770c80 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:44.979065 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-3f02f241-fa38-421c-b793-94ae2578667e req-9eb1d6f8-7d99-4f70-ab6a-aeca88770c80 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:44.994114 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-3f02f241-fa38-421c-b793-94ae2578667e req-9eb1d6f8-7d99-4f70-ab6a-aeca88770c80 service nova] Creating event network-changed:c22b4d3b-0439-436b-bdf6-38e75b8da2dd for instance 6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28 on n-h1-850501-14 Oct 04 18:39:44.999355 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-3f02f241-fa38-421c-b793-94ae2578667e req-9eb1d6f8-7d99-4f70-ab6a-aeca88770c80 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048166 Oct 04 18:39:45.000927 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1420/2877] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:39:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:45.006508 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a63c0988-f29d-41b1-91ce-e058587a81af tempest-SecurityGroupsTestAdminJSON-1786065839 tempest-SecurityGroupsTestAdminJSON-1786065839-project] Action: 'create', calling method: .version_select at 0x7fe2581ea310>, body: {"security_group": {"name": "tempest-securitygroup-1476486650", "description": "tempest-description-1157595722"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:45.426918 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a63c0988-f29d-41b1-91ce-e058587a81af tempest-SecurityGroupsTestAdminJSON-1786065839 tempest-SecurityGroupsTestAdminJSON-1786065839-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.424775 Oct 04 18:39:45.427596 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1421/2878] 10.222.0.20 () {60 vars in 1180 bytes} [Tue Oct 4 18:39:45 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:45.438258 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-6a515237-7e65-4052-a542-51e4776a9f78 req-25a4b5f5-3627-4add-bc88-30765493ab23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f257e47-8666-45d9-bed4-74cfd7ba8fb1", "name": "network-vif-plugged", "status": "completed", "tag": "6e3ada66-c43a-4281-9159-5a8283bd2060"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:45.448810 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-6a515237-7e65-4052-a542-51e4776a9f78 req-25a4b5f5-3627-4add-bc88-30765493ab23 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:45.449536 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-6a515237-7e65-4052-a542-51e4776a9f78 req-25a4b5f5-3627-4add-bc88-30765493ab23 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:45.449963 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-6a515237-7e65-4052-a542-51e4776a9f78 req-25a4b5f5-3627-4add-bc88-30765493ab23 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:45.453997 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:39:45.463138 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-6a515237-7e65-4052-a542-51e4776a9f78 req-25a4b5f5-3627-4add-bc88-30765493ab23 service nova] Creating event network-vif-plugged:6e3ada66-c43a-4281-9159-5a8283bd2060 for instance 2f257e47-8666-45d9-bed4-74cfd7ba8fb1 on n-h2-850501-14 Oct 04 18:39:45.468285 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-6a515237-7e65-4052-a542-51e4776a9f78 req-25a4b5f5-3627-4add-bc88-30765493ab23 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039281 Oct 04 18:39:45.468976 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1422/2879] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:39:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:45.477018 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-fc0f292a-b92a-445f-9040-0f2261412526 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Calling method '.version_select at 0x7fe2581879d0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:45.562769 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-fc0f292a-b92a-445f-9040-0f2261412526 tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-869337610" status: 202 len: 0 microversion: 2.1 time: 0.089572 Oct 04 18:39:45.563365 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1423/2880] 10.222.0.20 () {58 vars in 1218 bytes} [Tue Oct 4 18:39:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-869337610 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:39:45.568786 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-cef73dee-75c3-402b-b1c5-3386e5c0132b tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:45.572168 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-cef73dee-75c3-402b-b1c5-3386e5c0132b tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2e308f41-242e-4ce3-8641-9510e2f13681] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:45.575778 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cef73dee-75c3-402b-b1c5-3386e5c0132b tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:45.576302 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cef73dee-75c3-402b-b1c5-3386e5c0132b tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:45.576741 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cef73dee-75c3-402b-b1c5-3386e5c0132b tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:45.577435 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cef73dee-75c3-402b-b1c5-3386e5c0132b tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:45.578064 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cef73dee-75c3-402b-b1c5-3386e5c0132b tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:45.578486 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cef73dee-75c3-402b-b1c5-3386e5c0132b tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:45.605047 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1dc43dbe-9c1d-4480-9026-8bd7b5e8ab39 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.42 time: 7.515920 Oct 04 18:39:45.606361 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1458/2881] 10.222.0.20 () {62 vars in 1189 bytes} [Tue Oct 4 18:39:38 2022] POST /compute/v2.1/servers => generated 404 bytes in 7518 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 18:39:45.822360 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-cef73dee-75c3-402b-b1c5-3386e5c0132b tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:45.831554 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-cef73dee-75c3-402b-b1c5-3386e5c0132b tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681" status: 200 len: 1473 microversion: 2.1 time: 0.266299 Oct 04 18:39:45.832502 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1424/2882] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:45 2022] GET /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681 => generated 1473 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:45.854182 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1f737202-01c9-4f9b-88ff-dbce482c1554 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:45.855080 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1f737202-01c9-4f9b-88ff-dbce482c1554 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 61ec7cca-1572-496c-ba44-439f04c2a79c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:45.861482 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1f737202-01c9-4f9b-88ff-dbce482c1554 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:45.861977 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1f737202-01c9-4f9b-88ff-dbce482c1554 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:45.862420 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1f737202-01c9-4f9b-88ff-dbce482c1554 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:45.863122 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1f737202-01c9-4f9b-88ff-dbce482c1554 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:45.863585 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1f737202-01c9-4f9b-88ff-dbce482c1554 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:45.864014 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1f737202-01c9-4f9b-88ff-dbce482c1554 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:45.898044 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1f737202-01c9-4f9b-88ff-dbce482c1554 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:45.898534 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1f737202-01c9-4f9b-88ff-dbce482c1554 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:45.899534 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1f737202-01c9-4f9b-88ff-dbce482c1554 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:45.900239 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-1f737202-01c9-4f9b-88ff-dbce482c1554 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lazy-loading 'fault' on Instance uuid 61ec7cca-1572-496c-ba44-439f04c2a79c {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:39:45.932231 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-176a8faf-0307-458c-985e-9d31d15bfb20 tempest-SecurityGroupsTestAdminJSON-1981209731 tempest-SecurityGroupsTestAdminJSON-1981209731-project-admin] Action: 'create', calling method: .version_select at 0x7fe2592cfc10>, body: {"security_group": {"name": "tempest-securitygroup-796298721", "description": "tempest-description-1361496460"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:45.997499 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1f737202-01c9-4f9b-88ff-dbce482c1554 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8284fe51decd4db0bf6b3ed1514cc2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87473abf47e74adf844e3ddfa24da3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:46.006555 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1f737202-01c9-4f9b-88ff-dbce482c1554 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] 10.222.0.20 "GET /compute/v2.1/servers/61ec7cca-1572-496c-ba44-439f04c2a79c" status: 200 len: 1303 microversion: 2.1 time: 0.160987 Oct 04 18:39:46.007185 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1425/2883] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:45 2022] GET /compute/v2.1/servers/61ec7cca-1572-496c-ba44-439f04c2a79c => generated 1303 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:46.024334 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-00b00e1c-de4b-421e-9c67-452cad5cffc0 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:46.026538 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-00b00e1c-de4b-421e-9c67-452cad5cffc0 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] [instance: 3d3cabc2-fa23-4098-9197-9aaa19a0c663] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:46.125969 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-00b00e1c-de4b-421e-9c67-452cad5cffc0 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:46.140831 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-00b00e1c-de4b-421e-9c67-452cad5cffc0 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:46.142668 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-00b00e1c-de4b-421e-9c67-452cad5cffc0 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:46.143816 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-00b00e1c-de4b-421e-9c67-452cad5cffc0 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] 10.222.0.20 "GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663" status: 200 len: 1285 microversion: 2.42 time: 0.125134 Oct 04 18:39:46.157143 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1426/2884] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:46 2022] GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663 => generated 1285 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:46.157143 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-607dbe7c-4268-4cbe-9e25-d36d47ae00fe req-38c96fb0-3207-4064-9088-c158756abe0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61ec7cca-1572-496c-ba44-439f04c2a79c", "name": "network-vif-deleted", "tag": "1e8e5488-c1ba-4f9a-8944-b4e0b9ce8a0e"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:46.177260 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-607dbe7c-4268-4cbe-9e25-d36d47ae00fe req-38c96fb0-3207-4064-9088-c158756abe0a service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:46.178121 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-607dbe7c-4268-4cbe-9e25-d36d47ae00fe req-38c96fb0-3207-4064-9088-c158756abe0a service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:46.180341 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-607dbe7c-4268-4cbe-9e25-d36d47ae00fe req-38c96fb0-3207-4064-9088-c158756abe0a service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:46.202056 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-607dbe7c-4268-4cbe-9e25-d36d47ae00fe req-38c96fb0-3207-4064-9088-c158756abe0a service nova] Creating event network-vif-deleted:1e8e5488-c1ba-4f9a-8944-b4e0b9ce8a0e for instance 61ec7cca-1572-496c-ba44-439f04c2a79c on n-h2-850501-14 Oct 04 18:39:46.210116 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-607dbe7c-4268-4cbe-9e25-d36d47ae00fe req-38c96fb0-3207-4064-9088-c158756abe0a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063802 Oct 04 18:39:46.212024 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1427/2885] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:39:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:46.219966 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e927a4c7-c573-4541-adad-6d38e865ef14 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:46.221792 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e927a4c7-c573-4541-adad-6d38e865ef14 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] [instance: 6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:46.232336 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e927a4c7-c573-4541-adad-6d38e865ef14 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:46.233067 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e927a4c7-c573-4541-adad-6d38e865ef14 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:46.233964 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e927a4c7-c573-4541-adad-6d38e865ef14 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:46.235552 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e927a4c7-c573-4541-adad-6d38e865ef14 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:46.236324 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e927a4c7-c573-4541-adad-6d38e865ef14 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:46.236973 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e927a4c7-c573-4541-adad-6d38e865ef14 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:46.439292 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e927a4c7-c573-4541-adad-6d38e865ef14 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec13a0273819409b8ecba05e9337ec73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6edbe27acbc4c9eba33a6f589f6cf8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:46.448305 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e927a4c7-c573-4541-adad-6d38e865ef14 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] 10.222.0.20 "GET /compute/v2.1/servers/6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28" status: 200 len: 1323 microversion: 2.1 time: 0.234804 Oct 04 18:39:46.449008 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1428/2886] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:46 2022] GET /compute/v2.1/servers/6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28 => generated 1323 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:46.453840 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7549e63a-f8a9-4f2c-bf17-1738dfd34484 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:46.454642 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7549e63a-f8a9-4f2c-bf17-1738dfd34484 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: 2f257e47-8666-45d9-bed4-74cfd7ba8fb1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:46.460725 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7549e63a-f8a9-4f2c-bf17-1738dfd34484 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:46.461431 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7549e63a-f8a9-4f2c-bf17-1738dfd34484 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:46.462738 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7549e63a-f8a9-4f2c-bf17-1738dfd34484 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:46.463447 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7549e63a-f8a9-4f2c-bf17-1738dfd34484 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:46.463910 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7549e63a-f8a9-4f2c-bf17-1738dfd34484 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:46.464399 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7549e63a-f8a9-4f2c-bf17-1738dfd34484 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:46.777225 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7549e63a-f8a9-4f2c-bf17-1738dfd34484 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8358c07e2684b749a62becb9f0b7869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b922a74c1c2448bb770d6b298b2d601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:46.787988 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7549e63a-f8a9-4f2c-bf17-1738dfd34484 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "GET /compute/v2.1/servers/2f257e47-8666-45d9-bed4-74cfd7ba8fb1" status: 200 len: 1313 microversion: 2.1 time: 0.337662 Oct 04 18:39:46.788937 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1429/2887] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:46 2022] GET /compute/v2.1/servers/2f257e47-8666-45d9-bed4-74cfd7ba8fb1 => generated 1313 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:46.861233 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-487f29a3-c54d-4a2e-b438-f57084c0b6cc tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:46.862701 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-487f29a3-c54d-4a2e-b438-f57084c0b6cc tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2e308f41-242e-4ce3-8641-9510e2f13681] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:46.881350 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-487f29a3-c54d-4a2e-b438-f57084c0b6cc tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:46.882742 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-487f29a3-c54d-4a2e-b438-f57084c0b6cc tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:46.885291 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-487f29a3-c54d-4a2e-b438-f57084c0b6cc tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:46.886233 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-487f29a3-c54d-4a2e-b438-f57084c0b6cc tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:46.889045 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-487f29a3-c54d-4a2e-b438-f57084c0b6cc tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:46.889735 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-487f29a3-c54d-4a2e-b438-f57084c0b6cc tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:47.003882 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-176a8faf-0307-458c-985e-9d31d15bfb20 tempest-SecurityGroupsTestAdminJSON-1981209731 tempest-SecurityGroupsTestAdminJSON-1981209731-project-admin] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.396250 Oct 04 18:39:47.005240 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1459/2888] 10.222.0.20 () {60 vars in 1180 bytes} [Tue Oct 4 18:39:45 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:47.019601 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b477f36b-3421-438e-b2ab-be090cdb6595 tempest-SecurityGroupsTestAdminJSON-1981209731 tempest-SecurityGroupsTestAdminJSON-1981209731-project-admin] Action: 'create', calling method: .version_select at 0x7fe2589050d0>, body: {"security_group": {"name": "tempest-securitygroup-1772482717", "description": "tempest-description-1312962208"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:47.235136 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-487f29a3-c54d-4a2e-b438-f57084c0b6cc tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:47.247608 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-487f29a3-c54d-4a2e-b438-f57084c0b6cc tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681" status: 200 len: 1473 microversion: 2.1 time: 0.391008 Oct 04 18:39:47.248788 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1430/2889] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:46 2022] GET /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681 => generated 1473 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:47.266278 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3e245983-3bcc-4c40-8ef1-863389f86b5d tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:47.267003 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3e245983-3bcc-4c40-8ef1-863389f86b5d tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 61ec7cca-1572-496c-ba44-439f04c2a79c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:47.274637 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3e245983-3bcc-4c40-8ef1-863389f86b5d tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:47.276309 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3e245983-3bcc-4c40-8ef1-863389f86b5d tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:47.276309 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3e245983-3bcc-4c40-8ef1-863389f86b5d tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:47.276507 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3e245983-3bcc-4c40-8ef1-863389f86b5d tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:47.276913 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3e245983-3bcc-4c40-8ef1-863389f86b5d tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:47.277579 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3e245983-3bcc-4c40-8ef1-863389f86b5d tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:47.318200 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3e245983-3bcc-4c40-8ef1-863389f86b5d tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:47.318773 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3e245983-3bcc-4c40-8ef1-863389f86b5d tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:47.319304 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3e245983-3bcc-4c40-8ef1-863389f86b5d tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:47.319828 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-3e245983-3bcc-4c40-8ef1-863389f86b5d tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lazy-loading 'fault' on Instance uuid 61ec7cca-1572-496c-ba44-439f04c2a79c {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:39:47.470909 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3e245983-3bcc-4c40-8ef1-863389f86b5d tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8284fe51decd4db0bf6b3ed1514cc2c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87473abf47e74adf844e3ddfa24da3f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:47.478908 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3e245983-3bcc-4c40-8ef1-863389f86b5d tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] 10.222.0.20 "GET /compute/v2.1/servers/61ec7cca-1572-496c-ba44-439f04c2a79c" status: 200 len: 1303 microversion: 2.1 time: 0.222821 Oct 04 18:39:47.479481 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1431/2890] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:47 2022] GET /compute/v2.1/servers/61ec7cca-1572-496c-ba44-439f04c2a79c => generated 1303 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:47.484424 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e0bdea8f-0ba1-4746-8f3b-dcdae9924306 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:47.485299 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e0bdea8f-0ba1-4746-8f3b-dcdae9924306 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] [instance: 3d3cabc2-fa23-4098-9197-9aaa19a0c663] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:47.609111 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e0bdea8f-0ba1-4746-8f3b-dcdae9924306 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:47.621399 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e0bdea8f-0ba1-4746-8f3b-dcdae9924306 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:47.621399 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e0bdea8f-0ba1-4746-8f3b-dcdae9924306 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:47.621399 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e0bdea8f-0ba1-4746-8f3b-dcdae9924306 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] 10.222.0.20 "GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663" status: 200 len: 1285 microversion: 2.42 time: 0.140054 Oct 04 18:39:47.632969 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1432/2891] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:47 2022] GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663 => generated 1285 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:47.632969 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9da608e6-eb3b-4947-aad0-24c3c7eb9ea1 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:47.632969 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-9da608e6-eb3b-4947-aad0-24c3c7eb9ea1 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] [instance: 6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:47.637202 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9da608e6-eb3b-4947-aad0-24c3c7eb9ea1 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:47.637320 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9da608e6-eb3b-4947-aad0-24c3c7eb9ea1 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:47.637840 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9da608e6-eb3b-4947-aad0-24c3c7eb9ea1 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:47.638463 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9da608e6-eb3b-4947-aad0-24c3c7eb9ea1 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:47.638917 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9da608e6-eb3b-4947-aad0-24c3c7eb9ea1 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:47.642961 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9da608e6-eb3b-4947-aad0-24c3c7eb9ea1 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:47.862236 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9da608e6-eb3b-4947-aad0-24c3c7eb9ea1 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec13a0273819409b8ecba05e9337ec73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6edbe27acbc4c9eba33a6f589f6cf8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:47.870833 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9da608e6-eb3b-4947-aad0-24c3c7eb9ea1 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] 10.222.0.20 "GET /compute/v2.1/servers/6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28" status: 200 len: 1323 microversion: 2.1 time: 0.247564 Oct 04 18:39:47.871616 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1433/2892] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:47 2022] GET /compute/v2.1/servers/6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28 => generated 1323 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:47.876081 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-70bc2e39-6070-421c-9065-15cb17c86e9d tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:47.876704 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-70bc2e39-6070-421c-9065-15cb17c86e9d tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: 2f257e47-8666-45d9-bed4-74cfd7ba8fb1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:47.882695 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-70bc2e39-6070-421c-9065-15cb17c86e9d tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:47.883579 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-70bc2e39-6070-421c-9065-15cb17c86e9d tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:47.884300 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-70bc2e39-6070-421c-9065-15cb17c86e9d tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:47.884971 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-70bc2e39-6070-421c-9065-15cb17c86e9d tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:47.885429 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-70bc2e39-6070-421c-9065-15cb17c86e9d tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:47.885863 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-70bc2e39-6070-421c-9065-15cb17c86e9d tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:47.912520 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b477f36b-3421-438e-b2ab-be090cdb6595 tempest-SecurityGroupsTestAdminJSON-1981209731 tempest-SecurityGroupsTestAdminJSON-1981209731-project-admin] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.894718 Oct 04 18:39:47.919357 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1460/2893] 10.222.0.20 () {60 vars in 1180 bytes} [Tue Oct 4 18:39:47 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:47.926232 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ab860f0a-f624-4426-83df-39cf64bc75be tempest-SecurityGroupsTestAdminJSON-1981209731 tempest-SecurityGroupsTestAdminJSON-1981209731-project-admin] Calling method '.version_select at 0x7fe258905700>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:48.309478 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-70bc2e39-6070-421c-9065-15cb17c86e9d tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8358c07e2684b749a62becb9f0b7869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b922a74c1c2448bb770d6b298b2d601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:48.322589 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-70bc2e39-6070-421c-9065-15cb17c86e9d tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "GET /compute/v2.1/servers/2f257e47-8666-45d9-bed4-74cfd7ba8fb1" status: 200 len: 1313 microversion: 2.1 time: 0.449854 Oct 04 18:39:48.324000 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1434/2894] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:47 2022] GET /compute/v2.1/servers/2f257e47-8666-45d9-bed4-74cfd7ba8fb1 => generated 1313 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:48.329710 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8b1bb994-bbae-4802-9989-50bae4c396c8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:48.330412 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8b1bb994-bbae-4802-9989-50bae4c396c8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2e308f41-242e-4ce3-8641-9510e2f13681] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:48.338706 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8b1bb994-bbae-4802-9989-50bae4c396c8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:48.339284 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8b1bb994-bbae-4802-9989-50bae4c396c8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:48.339939 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8b1bb994-bbae-4802-9989-50bae4c396c8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:48.340874 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8b1bb994-bbae-4802-9989-50bae4c396c8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:48.341408 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8b1bb994-bbae-4802-9989-50bae4c396c8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:48.341902 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8b1bb994-bbae-4802-9989-50bae4c396c8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:48.605322 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8b1bb994-bbae-4802-9989-50bae4c396c8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:48.614774 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8b1bb994-bbae-4802-9989-50bae4c396c8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681" status: 200 len: 1470 microversion: 2.1 time: 0.289417 Oct 04 18:39:48.635768 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1435/2895] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:48 2022] GET /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681 => generated 1470 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:48.641721 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-c1896a83-cb5d-45bd-8de3-2725c51d93cb req-bbe28536-a9d3-44ab-84fd-d95b6a37fa86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28", "name": "network-vif-plugged", "status": "completed", "tag": "c22b4d3b-0439-436b-bdf6-38e75b8da2dd"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:48.656635 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-c1896a83-cb5d-45bd-8de3-2725c51d93cb req-bbe28536-a9d3-44ab-84fd-d95b6a37fa86 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:48.657555 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-c1896a83-cb5d-45bd-8de3-2725c51d93cb req-bbe28536-a9d3-44ab-84fd-d95b6a37fa86 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:48.658000 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-c1896a83-cb5d-45bd-8de3-2725c51d93cb req-bbe28536-a9d3-44ab-84fd-d95b6a37fa86 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:48.700982 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-c1896a83-cb5d-45bd-8de3-2725c51d93cb req-bbe28536-a9d3-44ab-84fd-d95b6a37fa86 service nova] Creating event network-vif-plugged:c22b4d3b-0439-436b-bdf6-38e75b8da2dd for instance 6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28 on n-h1-850501-14 Oct 04 18:39:48.710578 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-c1896a83-cb5d-45bd-8de3-2725c51d93cb req-bbe28536-a9d3-44ab-84fd-d95b6a37fa86 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072220 Oct 04 18:39:48.715234 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1436/2896] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:39:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:48.729202 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-08c973cd-45b0-4ac9-8494-30fb39fcea87 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:48.730730 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-08c973cd-45b0-4ac9-8494-30fb39fcea87 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] [instance: 61ec7cca-1572-496c-ba44-439f04c2a79c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:48.759101 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-08c973cd-45b0-4ac9-8494-30fb39fcea87 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:48.760151 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-08c973cd-45b0-4ac9-8494-30fb39fcea87 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:48.760825 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-08c973cd-45b0-4ac9-8494-30fb39fcea87 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:48.762260 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-08c973cd-45b0-4ac9-8494-30fb39fcea87 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:48.763078 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-08c973cd-45b0-4ac9-8494-30fb39fcea87 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:48.763701 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-08c973cd-45b0-4ac9-8494-30fb39fcea87 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:48.803452 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-08c973cd-45b0-4ac9-8494-30fb39fcea87 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] HTTP exception thrown: Instance 61ec7cca-1572-496c-ba44-439f04c2a79c could not be found. Oct 04 18:39:48.806555 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-08c973cd-45b0-4ac9-8494-30fb39fcea87 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Request method failure captured: Oct 04 18:39:48.806555 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/61ec7cca-1572-496c-ba44-439f04c2a79c HTTP/1.1 Oct 04 18:39:48.806555 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:39:48.806555 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:39:48.806555 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:39:48.806555 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:39:48.806555 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:39:48.806555 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:39:48.806555 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:39:48.806555 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:39:48.806555 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPH1V_KaVb2tQ7hRh9fQ61hx1Tru1OnzHV0KR45nHegF4jR8bb_6kYVDM8AShrmLIbrmj_5XZh5qqitam9SIncnJFjLQma6UATJPVqQoRbM5nU2MVf7C7o7Cf1WRbudQPi62kcxsp285-EV6tifwkKgk0DmQapz6q5clbpBeX5PZXlmc Oct 04 18:39:48.806555 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:39:48.806555 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:39:48.806555 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:39:48.806555 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:39:48.806555 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:39:48.806555 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:39:48.806555 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 87473abf47e74adf844e3ddfa24da3f2 Oct 04 18:39:48.806555 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ServerRescueTestJSON-93809695 Oct 04 18:39:48.806555 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:39:48.806555 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:39:48.806555 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/87473abf47e74adf844e3ddfa24da3f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_87473abf47e74adf844e3ddfa24da3f2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/87473abf47e74adf844e3ddfa24da3f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/87473abf47e74adf844e3ddfa24da3f2"}]}] Oct 04 18:39:48.806555 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ServerRescueTestJSON-93809695 Oct 04 18:39:48.806555 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 87473abf47e74adf844e3ddfa24da3f2 Oct 04 18:39:48.806555 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ServerRescueTestJSON-93809695 Oct 04 18:39:48.806555 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ServerRescueTestJSON-93809695-project Oct 04 18:39:48.806555 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:39:48.806555 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:39:48.806555 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 8284fe51decd4db0bf6b3ed1514cc2c1 Oct 04 18:39:48.806555 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ServerRescueTestJSON-93809695-project Oct 04 18:39:48.806555 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:39:48.806555 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 61ec7cca-1572-496c-ba44-439f04c2a79c could not be found. Oct 04 18:39:48.806555 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '61ec7cca-1572-496c-ba44-439f04c2a79c'} Oct 04 18:39:48.806555 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:39:48.806555 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:48.806555 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:39:48.806555 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:39:48.806555 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:39:48.806555 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:39:48.806555 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:39:48.806555 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:39:48.806555 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:39:48.806555 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:39:48.806555 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61ec7cca-1572-496c-ba44-439f04c2a79c could not be found. Oct 04 18:39:48.806555 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:39:48.806555 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:39:48.806555 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:39:48.806555 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:48.806555 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:39:48.806555 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:39:48.806555 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:39:48.806555 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:39:48.806555 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:39:48.806555 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:39:48.806555 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:39:48.806555 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:39:48.806555 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:39:48.806555 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:39:48.806555 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:39:48.806555 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:39:48.806555 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61ec7cca-1572-496c-ba44-439f04c2a79c could not be found. Oct 04 18:39:48.806555 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:39:48.806555 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:39:48.806555 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:39:48.811033 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:48.811033 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:39:48.811033 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:39:48.811033 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:39:48.811033 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:39:48.811033 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61ec7cca-1572-496c-ba44-439f04c2a79c could not be found. Oct 04 18:39:48.811033 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:39:48.814806 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-08c973cd-45b0-4ac9-8494-30fb39fcea87 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] Returning 404 to user: Instance 61ec7cca-1572-496c-ba44-439f04c2a79c could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:39:48.816865 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-08c973cd-45b0-4ac9-8494-30fb39fcea87 tempest-ServerRescueTestJSON-93809695 tempest-ServerRescueTestJSON-93809695-project] 10.222.0.20 "GET /compute/v2.1/servers/61ec7cca-1572-496c-ba44-439f04c2a79c" status: 404 len: 111 microversion: 2.1 time: 0.099890 Oct 04 18:39:48.818212 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1437/2897] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:48 2022] GET /compute/v2.1/servers/61ec7cca-1572-496c-ba44-439f04c2a79c => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:39:48.824769 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5f626189-a94d-414e-9e44-c328c75d0ceb tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:48.826432 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5f626189-a94d-414e-9e44-c328c75d0ceb tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2e308f41-242e-4ce3-8641-9510e2f13681] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:48.837252 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5f626189-a94d-414e-9e44-c328c75d0ceb tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:48.839091 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5f626189-a94d-414e-9e44-c328c75d0ceb tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:48.839960 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5f626189-a94d-414e-9e44-c328c75d0ceb tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:48.841424 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5f626189-a94d-414e-9e44-c328c75d0ceb tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:48.842080 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5f626189-a94d-414e-9e44-c328c75d0ceb tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:48.842678 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5f626189-a94d-414e-9e44-c328c75d0ceb tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:49.151154 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5f626189-a94d-414e-9e44-c328c75d0ceb tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "POST /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681/action" status: 202 len: 0 microversion: 2.1 time: 0.330339 Oct 04 18:39:49.158485 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1438/2898] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:39:48 2022] POST /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681/action => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:39:49.185002 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1811ebc5-893a-4010-b33c-da6310a87e83 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:49.186829 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1811ebc5-893a-4010-b33c-da6310a87e83 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] [instance: 3d3cabc2-fa23-4098-9197-9aaa19a0c663] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:49.200776 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1811ebc5-893a-4010-b33c-da6310a87e83 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:49.201567 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1811ebc5-893a-4010-b33c-da6310a87e83 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:49.202686 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1811ebc5-893a-4010-b33c-da6310a87e83 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:49.203646 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1811ebc5-893a-4010-b33c-da6310a87e83 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:49.204784 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1811ebc5-893a-4010-b33c-da6310a87e83 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:49.205346 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1811ebc5-893a-4010-b33c-da6310a87e83 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:49.385718 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1811ebc5-893a-4010-b33c-da6310a87e83 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:49.413519 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1811ebc5-893a-4010-b33c-da6310a87e83 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:49.416235 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1811ebc5-893a-4010-b33c-da6310a87e83 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:49.417609 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1811ebc5-893a-4010-b33c-da6310a87e83 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] 10.222.0.20 "GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663" status: 200 len: 1575 microversion: 2.42 time: 0.264069 Oct 04 18:39:49.418853 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1439/2899] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:49 2022] GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663 => generated 1575 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:49.433729 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a6d99f00-a514-4051-80dd-3f289b20c356 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:49.433729 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a6d99f00-a514-4051-80dd-3f289b20c356 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] [instance: 6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:49.445267 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a6d99f00-a514-4051-80dd-3f289b20c356 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:49.446323 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a6d99f00-a514-4051-80dd-3f289b20c356 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:49.446927 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a6d99f00-a514-4051-80dd-3f289b20c356 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:49.448684 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a6d99f00-a514-4051-80dd-3f289b20c356 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:49.449244 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a6d99f00-a514-4051-80dd-3f289b20c356 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:49.449896 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a6d99f00-a514-4051-80dd-3f289b20c356 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:50.354676 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a6d99f00-a514-4051-80dd-3f289b20c356 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec13a0273819409b8ecba05e9337ec73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6edbe27acbc4c9eba33a6f589f6cf8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:50.379285 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a6d99f00-a514-4051-80dd-3f289b20c356 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] 10.222.0.20 "GET /compute/v2.1/servers/6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28" status: 200 len: 1323 microversion: 2.1 time: 0.957383 Oct 04 18:39:50.385599 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1440/2900] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:49 2022] GET /compute/v2.1/servers/6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28 => generated 1323 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:50.402348 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1701e914-d50d-44af-b5f2-0b03d8b1405d tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:50.405352 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1701e914-d50d-44af-b5f2-0b03d8b1405d tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2e308f41-242e-4ce3-8641-9510e2f13681] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:50.414644 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1701e914-d50d-44af-b5f2-0b03d8b1405d tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:50.415873 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1701e914-d50d-44af-b5f2-0b03d8b1405d tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:50.416253 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1701e914-d50d-44af-b5f2-0b03d8b1405d tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:50.417078 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1701e914-d50d-44af-b5f2-0b03d8b1405d tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:50.417835 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1701e914-d50d-44af-b5f2-0b03d8b1405d tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:50.418275 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1701e914-d50d-44af-b5f2-0b03d8b1405d tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:51.489730 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1701e914-d50d-44af-b5f2-0b03d8b1405d tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:51.494129 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:39:51.503867 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1701e914-d50d-44af-b5f2-0b03d8b1405d tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681" status: 200 len: 1469 microversion: 2.1 time: 1.112563 Oct 04 18:39:51.504763 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1441/2901] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:50 2022] GET /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681 => generated 1469 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:51.520549 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-dd8488b3-cefa-4cb1-9374-2ffaaa15a03d tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:51.521957 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-dd8488b3-cefa-4cb1-9374-2ffaaa15a03d tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: 2f257e47-8666-45d9-bed4-74cfd7ba8fb1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:51.532789 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dd8488b3-cefa-4cb1-9374-2ffaaa15a03d tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:51.537236 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dd8488b3-cefa-4cb1-9374-2ffaaa15a03d tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:51.537919 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dd8488b3-cefa-4cb1-9374-2ffaaa15a03d tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:51.539045 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dd8488b3-cefa-4cb1-9374-2ffaaa15a03d tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:51.540597 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dd8488b3-cefa-4cb1-9374-2ffaaa15a03d tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:51.541296 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dd8488b3-cefa-4cb1-9374-2ffaaa15a03d tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:52.343752 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-dd8488b3-cefa-4cb1-9374-2ffaaa15a03d tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8358c07e2684b749a62becb9f0b7869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b922a74c1c2448bb770d6b298b2d601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:52.355305 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-dd8488b3-cefa-4cb1-9374-2ffaaa15a03d tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "GET /compute/v2.1/servers/2f257e47-8666-45d9-bed4-74cfd7ba8fb1" status: 200 len: 1462 microversion: 2.1 time: 0.846716 Oct 04 18:39:52.355305 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1442/2902] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:51 2022] GET /compute/v2.1/servers/2f257e47-8666-45d9-bed4-74cfd7ba8fb1 => generated 1462 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:52.373173 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-db5d1a74-5e43-4d5d-b17d-68a7f1060fba tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:52.374253 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-db5d1a74-5e43-4d5d-b17d-68a7f1060fba tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] [instance: 3d3cabc2-fa23-4098-9197-9aaa19a0c663] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:52.382512 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-db5d1a74-5e43-4d5d-b17d-68a7f1060fba tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:52.385558 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-db5d1a74-5e43-4d5d-b17d-68a7f1060fba tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:52.386176 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-db5d1a74-5e43-4d5d-b17d-68a7f1060fba tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:52.386997 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-db5d1a74-5e43-4d5d-b17d-68a7f1060fba tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:52.392229 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-db5d1a74-5e43-4d5d-b17d-68a7f1060fba tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:52.392771 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-db5d1a74-5e43-4d5d-b17d-68a7f1060fba tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:52.894094 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-db5d1a74-5e43-4d5d-b17d-68a7f1060fba tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:52.908244 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-db5d1a74-5e43-4d5d-b17d-68a7f1060fba tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:52.944559 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-db5d1a74-5e43-4d5d-b17d-68a7f1060fba tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:52.944559 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-db5d1a74-5e43-4d5d-b17d-68a7f1060fba tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] 10.222.0.20 "GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663" status: 200 len: 1704 microversion: 2.42 time: 0.563211 Oct 04 18:39:52.944559 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1443/2903] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:52 2022] GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663 => generated 1704 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:52.944559 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-d6380861-2f6a-43f0-8d55-a8691c07efe0 req-ca7f0949-2822-47bd-bab6-5a724d62e6ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e308f41-242e-4ce3-8641-9510e2f13681", "name": "network-vif-plugged", "status": "completed", "tag": "192de35c-060d-4a11-8df5-09c24dfcc8d0"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:52.950859 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-d6380861-2f6a-43f0-8d55-a8691c07efe0 req-ca7f0949-2822-47bd-bab6-5a724d62e6ef service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:52.951350 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-d6380861-2f6a-43f0-8d55-a8691c07efe0 req-ca7f0949-2822-47bd-bab6-5a724d62e6ef service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:52.951787 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-d6380861-2f6a-43f0-8d55-a8691c07efe0 req-ca7f0949-2822-47bd-bab6-5a724d62e6ef service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:52.970335 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-d6380861-2f6a-43f0-8d55-a8691c07efe0 req-ca7f0949-2822-47bd-bab6-5a724d62e6ef service nova] Creating event network-vif-plugged:192de35c-060d-4a11-8df5-09c24dfcc8d0 for instance 2e308f41-242e-4ce3-8641-9510e2f13681 on n-h2-850501-14 Oct 04 18:39:52.978164 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [req-d6380861-2f6a-43f0-8d55-a8691c07efe0 req-ca7f0949-2822-47bd-bab6-5a724d62e6ef service nova] Instance 2e308f41-242e-4ce3-8641-9510e2f13681 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850501-14', 'n-h2-850501-14'} {{(pid=123001) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:39:52.990994 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-d6380861-2f6a-43f0-8d55-a8691c07efe0 req-ca7f0949-2822-47bd-bab6-5a724d62e6ef service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071393 Oct 04 18:39:52.991948 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1444/2904] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:39:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:52.998723 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-30b60b44-33b2-4967-b781-fd61e50afa35 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:52.999928 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-30b60b44-33b2-4967-b781-fd61e50afa35 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] [instance: 6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:53.006612 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-30b60b44-33b2-4967-b781-fd61e50afa35 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:53.012108 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-30b60b44-33b2-4967-b781-fd61e50afa35 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:53.012108 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-30b60b44-33b2-4967-b781-fd61e50afa35 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:53.012108 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-30b60b44-33b2-4967-b781-fd61e50afa35 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:53.012108 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-30b60b44-33b2-4967-b781-fd61e50afa35 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:53.012108 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-30b60b44-33b2-4967-b781-fd61e50afa35 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:53.640352 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-30b60b44-33b2-4967-b781-fd61e50afa35 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec13a0273819409b8ecba05e9337ec73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6edbe27acbc4c9eba33a6f589f6cf8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:53.653646 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-30b60b44-33b2-4967-b781-fd61e50afa35 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] 10.222.0.20 "GET /compute/v2.1/servers/6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28" status: 200 len: 1517 microversion: 2.1 time: 0.659091 Oct 04 18:39:53.654379 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1445/2905] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:52 2022] GET /compute/v2.1/servers/6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28 => generated 1517 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:53.873573 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-09de1ab6-0743-44c3-86ab-302d512e0de9 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:53.880770 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-09de1ab6-0743-44c3-86ab-302d512e0de9 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Searching by: {'deleted': False, 'project_id': '03b07908694b4f64a35141303a58b518'} {{(pid=123001) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:39:53.891681 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-09de1ab6-0743-44c3-86ab-302d512e0de9 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:53.898652 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-09de1ab6-0743-44c3-86ab-302d512e0de9 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:53.900523 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-09de1ab6-0743-44c3-86ab-302d512e0de9 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:53.901587 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-09de1ab6-0743-44c3-86ab-302d512e0de9 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:53.906480 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-09de1ab6-0743-44c3-86ab-302d512e0de9 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:53.907200 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-09de1ab6-0743-44c3-86ab-302d512e0de9 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:53.966979 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-09de1ab6-0743-44c3-86ab-302d512e0de9 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.310664 Oct 04 18:39:53.969832 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1446/2906] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Oct 4 18:39:53 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:39:53.978274 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2ae51ef7-347d-4d44-b88c-d96e18f4c447 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:53.983384 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2ae51ef7-347d-4d44-b88c-d96e18f4c447 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2e308f41-242e-4ce3-8641-9510e2f13681] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:53.996758 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2ae51ef7-347d-4d44-b88c-d96e18f4c447 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:54.001314 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2ae51ef7-347d-4d44-b88c-d96e18f4c447 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:54.002907 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2ae51ef7-347d-4d44-b88c-d96e18f4c447 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:54.006049 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2ae51ef7-347d-4d44-b88c-d96e18f4c447 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:54.006564 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2ae51ef7-347d-4d44-b88c-d96e18f4c447 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:54.010084 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2ae51ef7-347d-4d44-b88c-d96e18f4c447 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:54.364104 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:39:54.365071 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=17,nova_cell1:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:39:54.385358 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=6 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:39:54.962782 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-2ae51ef7-347d-4d44-b88c-d96e18f4c447 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:54.975726 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2ae51ef7-347d-4d44-b88c-d96e18f4c447 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681" status: 200 len: 1469 microversion: 2.1 time: 1.004404 Oct 04 18:39:54.976738 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1447/2907] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:53 2022] GET /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681 => generated 1469 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:54.986167 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3d4de737-1b12-4572-bd5d-54d969a9a91b tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:54.988244 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3d4de737-1b12-4572-bd5d-54d969a9a91b tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] [instance: b319d463-fa0d-4e2d-b03f-6227475572da] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:55.004403 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3d4de737-1b12-4572-bd5d-54d969a9a91b tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:55.005689 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3d4de737-1b12-4572-bd5d-54d969a9a91b tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:55.006326 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3d4de737-1b12-4572-bd5d-54d969a9a91b tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:55.007236 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3d4de737-1b12-4572-bd5d-54d969a9a91b tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:55.010558 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3d4de737-1b12-4572-bd5d-54d969a9a91b tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:55.011231 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3d4de737-1b12-4572-bd5d-54d969a9a91b tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:55.058852 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-3d4de737-1b12-4572-bd5d-54d969a9a91b tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] HTTP exception thrown: Instance b319d463-fa0d-4e2d-b03f-6227475572da could not be found. Oct 04 18:39:55.067071 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3d4de737-1b12-4572-bd5d-54d969a9a91b tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Request method failure captured: Oct 04 18:39:55.067071 n-d-850501-14 devstack@n-api.service[123001]: request: DELETE /compute/v2.1/servers/b319d463-fa0d-4e2d-b03f-6227475572da HTTP/1.1 Oct 04 18:39:55.067071 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:39:55.067071 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:39:55.067071 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:39:55.067071 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:39:55.067071 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:39:55.067071 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:39:55.067071 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:39:55.067071 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:39:55.067071 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPH1HfHEo2cwdjOLtGCHh_IBMA3cE0xV7juOK6IuLShskx370hovWysFmCTVO7WixJ8eJX8zwjq79pWahhPPmnq1rkdoHr5hgv1l_Vx8CkfPoWI6rsIP_-lbMrcO6TYOKvVDJXVbOSvSAnXumgazyPzLqODNtEaRm6L_nZx9-ryOs2A8 Oct 04 18:39:55.067071 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:39:55.067071 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:39:55.067071 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:39:55.067071 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:39:55.067071 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:39:55.067071 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:39:55.067071 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 9174b09e32064811a61539c64992ee50 Oct 04 18:39:55.067071 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-38750755 Oct 04 18:39:55.067071 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:39:55.067071 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:39:55.067071 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9174b09e32064811a61539c64992ee50"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9174b09e32064811a61539c64992ee50", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9174b09e32064811a61539c64992ee50"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9174b09e32064811a61539c64992ee50"}]}] Oct 04 18:39:55.067071 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-38750755 Oct 04 18:39:55.067071 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 9174b09e32064811a61539c64992ee50 Oct 04 18:39:55.067071 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-38750755 Oct 04 18:39:55.067071 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-AttachSCSIVolumeTestJSON-38750755-project Oct 04 18:39:55.067071 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:39:55.067071 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:39:55.067071 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: c73127bc6636476482e280eddad7f66c Oct 04 18:39:55.067071 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-38750755-project Oct 04 18:39:55.067071 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:39:55.067071 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance b319d463-fa0d-4e2d-b03f-6227475572da could not be found. Oct 04 18:39:55.067071 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': 'b319d463-fa0d-4e2d-b03f-6227475572da'} Oct 04 18:39:55.067071 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:39:55.067071 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:55.067071 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:39:55.067071 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:39:55.067071 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:39:55.067071 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:39:55.067071 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:39:55.067071 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:39:55.067071 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:39:55.067071 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:39:55.067071 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b319d463-fa0d-4e2d-b03f-6227475572da could not be found. Oct 04 18:39:55.067071 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:39:55.067071 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:39:55.067071 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:39:55.067071 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:55.067071 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:39:55.067071 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:39:55.067071 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:39:55.067071 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:39:55.067071 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:39:55.067071 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:39:55.067071 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:39:55.067071 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:39:55.067071 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:39:55.067071 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:39:55.067071 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:39:55.067071 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:39:55.067071 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:39:55.067071 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:39:55.075274 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b319d463-fa0d-4e2d-b03f-6227475572da could not be found. Oct 04 18:39:55.075274 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:39:55.075274 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:39:55.075274 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:39:55.075274 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:55.075274 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:39:55.075274 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:39:55.075274 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:39:55.075274 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:39:55.075274 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b319d463-fa0d-4e2d-b03f-6227475572da could not be found. Oct 04 18:39:55.075274 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:39:55.075274 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3d4de737-1b12-4572-bd5d-54d969a9a91b tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Returning 404 to user: Instance b319d463-fa0d-4e2d-b03f-6227475572da could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:39:55.089605 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3d4de737-1b12-4572-bd5d-54d969a9a91b tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b319d463-fa0d-4e2d-b03f-6227475572da" status: 404 len: 111 microversion: 2.1 time: 0.111452 Oct 04 18:39:55.090393 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1448/2908] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:39:54 2022] DELETE /compute/v2.1/servers/b319d463-fa0d-4e2d-b03f-6227475572da => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:39:55.105479 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0aa82b00-cdb1-4743-b869-551ec5245fd1 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:55.109875 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0aa82b00-cdb1-4743-b869-551ec5245fd1 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] [instance: 6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:55.169248 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0aa82b00-cdb1-4743-b869-551ec5245fd1 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:55.169248 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0aa82b00-cdb1-4743-b869-551ec5245fd1 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:55.170788 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0aa82b00-cdb1-4743-b869-551ec5245fd1 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:55.172703 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0aa82b00-cdb1-4743-b869-551ec5245fd1 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:55.173253 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0aa82b00-cdb1-4743-b869-551ec5245fd1 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:55.174439 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0aa82b00-cdb1-4743-b869-551ec5245fd1 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:55.260718 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-0aa82b00-cdb1-4743-b869-551ec5245fd1 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lazy-loading 'flavor' on Instance uuid 6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:39:55.460934 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=9,nova_api:UPDATE=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:39:55.667200 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0aa82b00-cdb1-4743-b869-551ec5245fd1 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] 10.222.0.20 "POST /compute/v2.1/servers/6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28/action" status: 200 len: 32 microversion: 2.1 time: 0.574296 Oct 04 18:39:55.668339 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1449/2909] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:39:55 2022] POST /compute/v2.1/servers/6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28/action => generated 32 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:39:55.683933 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7405d076-5223-4630-9068-97dcd107b90f tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:55.685296 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7405d076-5223-4630-9068-97dcd107b90f tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] [instance: 3d3cabc2-fa23-4098-9197-9aaa19a0c663] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:55.695334 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7405d076-5223-4630-9068-97dcd107b90f tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:55.696763 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7405d076-5223-4630-9068-97dcd107b90f tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:55.697378 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7405d076-5223-4630-9068-97dcd107b90f tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:55.698266 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7405d076-5223-4630-9068-97dcd107b90f tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:55.700585 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7405d076-5223-4630-9068-97dcd107b90f tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:55.702355 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7405d076-5223-4630-9068-97dcd107b90f tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:56.283054 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ab860f0a-f624-4426-83df-39cf64bc75be tempest-SecurityGroupsTestAdminJSON-1981209731 tempest-SecurityGroupsTestAdminJSON-1981209731-project-admin] 10.222.0.20 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 11678 microversion: 2.1 time: 8.361360 Oct 04 18:39:56.284453 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1461/2910] 10.222.0.20 () {58 vars in 1191 bytes} [Tue Oct 4 18:39:47 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 11678 bytes in 8364 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:39:56.296265 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-fcfeba2e-3b33-4161-bddf-174e738288a8 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:56.315709 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-fcfeba2e-3b33-4161-bddf-174e738288a8 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Searching by: {'deleted': False} {{(pid=123002) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:39:56.327728 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fcfeba2e-3b33-4161-bddf-174e738288a8 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:56.330965 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fcfeba2e-3b33-4161-bddf-174e738288a8 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:56.331806 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fcfeba2e-3b33-4161-bddf-174e738288a8 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:56.339081 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fcfeba2e-3b33-4161-bddf-174e738288a8 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:56.339081 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fcfeba2e-3b33-4161-bddf-174e738288a8 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:56.339081 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fcfeba2e-3b33-4161-bddf-174e738288a8 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:56.411455 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7405d076-5223-4630-9068-97dcd107b90f tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:56.422195 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7405d076-5223-4630-9068-97dcd107b90f tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:56.440513 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7405d076-5223-4630-9068-97dcd107b90f tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:56.446938 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7405d076-5223-4630-9068-97dcd107b90f tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] 10.222.0.20 "GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663" status: 200 len: 1794 microversion: 2.42 time: 0.775724 Oct 04 18:39:56.451537 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1450/2911] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:55 2022] GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663 => generated 1794 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:56.472386 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2880578d-3e5a-435e-b7d0-e6876466fc7d tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:56.474484 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2880578d-3e5a-435e-b7d0-e6876466fc7d tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] [instance: b319d463-fa0d-4e2d-b03f-6227475572da] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:56.497130 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2880578d-3e5a-435e-b7d0-e6876466fc7d tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:56.499740 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2880578d-3e5a-435e-b7d0-e6876466fc7d tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:56.500330 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2880578d-3e5a-435e-b7d0-e6876466fc7d tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:56.501834 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2880578d-3e5a-435e-b7d0-e6876466fc7d tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:56.503940 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2880578d-3e5a-435e-b7d0-e6876466fc7d tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:56.504984 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2880578d-3e5a-435e-b7d0-e6876466fc7d tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:56.547008 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-2880578d-3e5a-435e-b7d0-e6876466fc7d tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] HTTP exception thrown: Instance b319d463-fa0d-4e2d-b03f-6227475572da could not be found. Oct 04 18:39:56.551216 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2880578d-3e5a-435e-b7d0-e6876466fc7d tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Request method failure captured: Oct 04 18:39:56.551216 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/b319d463-fa0d-4e2d-b03f-6227475572da HTTP/1.1 Oct 04 18:39:56.551216 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:39:56.551216 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:39:56.551216 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:39:56.551216 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:39:56.551216 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:39:56.551216 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:39:56.551216 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:39:56.551216 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:39:56.551216 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPH1HfHEo2cwdjOLtGCHh_IBMA3cE0xV7juOK6IuLShskx370hovWysFmCTVO7WixJ8eJX8zwjq79pWahhPPmnq1rkdoHr5hgv1l_Vx8CkfPoWI6rsIP_-lbMrcO6TYOKvVDJXVbOSvSAnXumgazyPzLqODNtEaRm6L_nZx9-ryOs2A8 Oct 04 18:39:56.551216 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:39:56.551216 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:39:56.551216 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:39:56.551216 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:39:56.551216 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:39:56.551216 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:39:56.551216 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 9174b09e32064811a61539c64992ee50 Oct 04 18:39:56.551216 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-38750755 Oct 04 18:39:56.551216 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:39:56.551216 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:39:56.551216 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9174b09e32064811a61539c64992ee50"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9174b09e32064811a61539c64992ee50", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9174b09e32064811a61539c64992ee50"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9174b09e32064811a61539c64992ee50"}]}] Oct 04 18:39:56.551216 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-38750755 Oct 04 18:39:56.551216 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 9174b09e32064811a61539c64992ee50 Oct 04 18:39:56.551216 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-38750755 Oct 04 18:39:56.551216 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-AttachSCSIVolumeTestJSON-38750755-project Oct 04 18:39:56.551216 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:39:56.551216 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:39:56.551216 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: c73127bc6636476482e280eddad7f66c Oct 04 18:39:56.551216 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-38750755-project Oct 04 18:39:56.551216 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:39:56.551216 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance b319d463-fa0d-4e2d-b03f-6227475572da could not be found. Oct 04 18:39:56.551216 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': 'b319d463-fa0d-4e2d-b03f-6227475572da'} Oct 04 18:39:56.551216 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:39:56.551216 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:56.551216 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:39:56.551216 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:39:56.551216 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:39:56.551216 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:39:56.551216 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:39:56.551216 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:39:56.551216 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:39:56.551216 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:39:56.551216 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b319d463-fa0d-4e2d-b03f-6227475572da could not be found. Oct 04 18:39:56.551216 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:39:56.551216 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:39:56.551216 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:39:56.551216 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:56.551216 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:39:56.551216 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:39:56.551216 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:39:56.551216 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:39:56.551216 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:39:56.551216 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:39:56.551216 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:39:56.551216 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:39:56.551216 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:39:56.551216 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:39:56.551216 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:39:56.551216 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:39:56.551216 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b319d463-fa0d-4e2d-b03f-6227475572da could not be found. Oct 04 18:39:56.551216 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:39:56.551216 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:39:56.551216 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:39:56.557534 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:56.557534 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:39:56.557534 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:39:56.557534 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:39:56.557534 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:39:56.557534 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b319d463-fa0d-4e2d-b03f-6227475572da could not be found. Oct 04 18:39:56.557534 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:39:56.559885 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2880578d-3e5a-435e-b7d0-e6876466fc7d tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] Returning 404 to user: Instance b319d463-fa0d-4e2d-b03f-6227475572da could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:39:56.562482 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2880578d-3e5a-435e-b7d0-e6876466fc7d tempest-AttachSCSIVolumeTestJSON-38750755 tempest-AttachSCSIVolumeTestJSON-38750755-project] 10.222.0.20 "GET /compute/v2.1/servers/b319d463-fa0d-4e2d-b03f-6227475572da" status: 404 len: 111 microversion: 2.1 time: 0.108094 Oct 04 18:39:56.567953 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1451/2912] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:56 2022] GET /compute/v2.1/servers/b319d463-fa0d-4e2d-b03f-6227475572da => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:39:56.579061 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-61d30770-7dd8-4e6a-8c2d-34ba718597a4 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:56.580206 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-61d30770-7dd8-4e6a-8c2d-34ba718597a4 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] [instance: 6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:56.591497 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.multi_cell_list [None req-fcfeba2e-3b33-4161-bddf-174e738288a8 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Listed batch of 9 results from cell out of 1000 limit. Returned 9 total so far. {{(pid=123002) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:39:56.597867 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-61d30770-7dd8-4e6a-8c2d-34ba718597a4 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:56.604863 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-61d30770-7dd8-4e6a-8c2d-34ba718597a4 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:56.605503 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-61d30770-7dd8-4e6a-8c2d-34ba718597a4 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:56.606915 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-61d30770-7dd8-4e6a-8c2d-34ba718597a4 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:56.609993 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-61d30770-7dd8-4e6a-8c2d-34ba718597a4 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:56.610674 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-61d30770-7dd8-4e6a-8c2d-34ba718597a4 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:56.690739 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fcfeba2e-3b33-4161-bddf-174e738288a8 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:56.695995 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fcfeba2e-3b33-4161-bddf-174e738288a8 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:56.695995 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fcfeba2e-3b33-4161-bddf-174e738288a8 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:57.617076 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=4 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:39:57.947872 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-61d30770-7dd8-4e6a-8c2d-34ba718597a4 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec13a0273819409b8ecba05e9337ec73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6edbe27acbc4c9eba33a6f589f6cf8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:57.963387 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-61d30770-7dd8-4e6a-8c2d-34ba718597a4 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] 10.222.0.20 "GET /compute/v2.1/servers/6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28" status: 200 len: 1523 microversion: 2.1 time: 1.394106 Oct 04 18:39:57.963387 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1452/2913] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:56 2022] GET /compute/v2.1/servers/6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28 => generated 1523 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:57.975814 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f6fd9452-e873-4c69-b8f1-5634a98b1837 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:57.981923 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f6fd9452-e873-4c69-b8f1-5634a98b1837 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2e308f41-242e-4ce3-8641-9510e2f13681] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:57.997167 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f6fd9452-e873-4c69-b8f1-5634a98b1837 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:57.998275 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f6fd9452-e873-4c69-b8f1-5634a98b1837 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:57.999255 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f6fd9452-e873-4c69-b8f1-5634a98b1837 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:58.001024 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f6fd9452-e873-4c69-b8f1-5634a98b1837 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:58.002349 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f6fd9452-e873-4c69-b8f1-5634a98b1837 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:58.002992 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f6fd9452-e873-4c69-b8f1-5634a98b1837 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:58.473059 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f6fd9452-e873-4c69-b8f1-5634a98b1837 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:58.481863 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f6fd9452-e873-4c69-b8f1-5634a98b1837 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681" status: 200 len: 1469 microversion: 2.1 time: 0.519580 Oct 04 18:39:58.501115 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1453/2914] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:57 2022] GET /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681 => generated 1469 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:58.501115 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2d9e03fa-1ff5-4652-b89d-0bdb6356f62f tempest-SecurityGroupsTestAdminJSON-1786065839 tempest-SecurityGroupsTestAdminJSON-1786065839-project] Calling method '.version_select at 0x7fe2580b4ee0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:58.676689 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-fcfeba2e-3b33-4161-bddf-174e738288a8 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 14779 microversion: 2.1 time: 2.390071 Oct 04 18:39:58.677664 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1462/2915] 10.222.0.20 () {58 vars in 1171 bytes} [Tue Oct 4 18:39:56 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 14779 bytes in 2393 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:39:58.685219 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-db01c9a7-27e4-41b9-ba06-60cf4089c446 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:58.687127 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-db01c9a7-27e4-41b9-ba06-60cf4089c446 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] [instance: 3d3cabc2-fa23-4098-9197-9aaa19a0c663] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:58.700008 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-db01c9a7-27e4-41b9-ba06-60cf4089c446 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:58.701074 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-db01c9a7-27e4-41b9-ba06-60cf4089c446 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:58.701738 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-db01c9a7-27e4-41b9-ba06-60cf4089c446 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:58.703676 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-db01c9a7-27e4-41b9-ba06-60cf4089c446 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:58.704391 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-db01c9a7-27e4-41b9-ba06-60cf4089c446 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:58.705032 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-db01c9a7-27e4-41b9-ba06-60cf4089c446 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:59.139065 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-db01c9a7-27e4-41b9-ba06-60cf4089c446 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:59.177794 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-db01c9a7-27e4-41b9-ba06-60cf4089c446 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:59.183531 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-db01c9a7-27e4-41b9-ba06-60cf4089c446 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:59.190092 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-db01c9a7-27e4-41b9-ba06-60cf4089c446 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] 10.222.0.20 "GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663" status: 200 len: 1839 microversion: 2.42 time: 0.510353 Oct 04 18:39:59.195232 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1463/2916] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:58 2022] GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663 => generated 1839 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:59.213707 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-d4f06fb2-3b39-4b9f-950e-6652f86aa692 req-544ad4f8-6645-434e-aa3d-d0042d48f8dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e308f41-242e-4ce3-8641-9510e2f13681", "name": "network-vif-unplugged", "status": "completed", "tag": "192de35c-060d-4a11-8df5-09c24dfcc8d0"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:59.238864 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-d4f06fb2-3b39-4b9f-950e-6652f86aa692 req-544ad4f8-6645-434e-aa3d-d0042d48f8dc service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:59.239644 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-d4f06fb2-3b39-4b9f-950e-6652f86aa692 req-544ad4f8-6645-434e-aa3d-d0042d48f8dc service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:59.240296 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-d4f06fb2-3b39-4b9f-950e-6652f86aa692 req-544ad4f8-6645-434e-aa3d-d0042d48f8dc service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:59.268244 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-d4f06fb2-3b39-4b9f-950e-6652f86aa692 req-544ad4f8-6645-434e-aa3d-d0042d48f8dc service nova] Creating event network-vif-unplugged:192de35c-060d-4a11-8df5-09c24dfcc8d0 for instance 2e308f41-242e-4ce3-8641-9510e2f13681 on n-h1-850501-14 Oct 04 18:39:59.277041 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [req-d4f06fb2-3b39-4b9f-950e-6652f86aa692 req-544ad4f8-6645-434e-aa3d-d0042d48f8dc service nova] Instance 2e308f41-242e-4ce3-8641-9510e2f13681 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850501-14', 'n-h2-850501-14'} {{(pid=123002) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:39:59.294439 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-d4f06fb2-3b39-4b9f-950e-6652f86aa692 req-544ad4f8-6645-434e-aa3d-d0042d48f8dc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.097179 Oct 04 18:39:59.296535 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1464/2917] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:39:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:59.302582 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a70197a3-f608-4e25-885c-95c93037d10e tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:59.310567 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a70197a3-f608-4e25-885c-95c93037d10e tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Searching by: {'deleted': False, 'project_id': '03b07908694b4f64a35141303a58b518'} {{(pid=123002) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:39:59.316750 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a70197a3-f608-4e25-885c-95c93037d10e tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:59.317964 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a70197a3-f608-4e25-885c-95c93037d10e tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:59.318583 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a70197a3-f608-4e25-885c-95c93037d10e tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:59.319830 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a70197a3-f608-4e25-885c-95c93037d10e tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:59.320751 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a70197a3-f608-4e25-885c-95c93037d10e tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:59.324222 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a70197a3-f608-4e25-885c-95c93037d10e tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:59.338628 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2d9e03fa-1ff5-4652-b89d-0bdb6356f62f tempest-SecurityGroupsTestAdminJSON-1786065839 tempest-SecurityGroupsTestAdminJSON-1786065839-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1113 microversion: 2.1 time: 0.840607 Oct 04 18:39:59.339979 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1454/2918] 10.222.0.20 () {58 vars in 1191 bytes} [Tue Oct 4 18:39:58 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1113 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:59.353533 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-271c31ad-4a9c-49b0-9b53-f2240afb1ad3 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:59.354563 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-271c31ad-4a9c-49b0-9b53-f2240afb1ad3 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] [instance: 6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:59.363487 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-271c31ad-4a9c-49b0-9b53-f2240afb1ad3 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:59.368277 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-271c31ad-4a9c-49b0-9b53-f2240afb1ad3 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:59.369077 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-271c31ad-4a9c-49b0-9b53-f2240afb1ad3 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:59.370739 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a70197a3-f608-4e25-885c-95c93037d10e tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/detail?tenant_id=1b922a74c1c2448bb770d6b298b2d601" status: 200 len: 15 microversion: 2.1 time: 0.072808 Oct 04 18:39:59.372398 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-271c31ad-4a9c-49b0-9b53-f2240afb1ad3 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:59.372529 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1465/2919] 10.222.0.20 () {58 vars in 1231 bytes} [Tue Oct 4 18:39:59 2022] GET /compute/v2.1/servers/detail?tenant_id=1b922a74c1c2448bb770d6b298b2d601 => generated 15 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:39:59.373244 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-271c31ad-4a9c-49b0-9b53-f2240afb1ad3 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:59.373847 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-271c31ad-4a9c-49b0-9b53-f2240afb1ad3 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:59.377580 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3fcce127-ebb6-400a-9974-c631e039ffd5 tempest-SecurityGroupsTestAdminJSON-1981209731 tempest-SecurityGroupsTestAdminJSON-1981209731-project-admin] Calling method '.version_select at 0x7fe259ae7550>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:00.095328 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-271c31ad-4a9c-49b0-9b53-f2240afb1ad3 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec13a0273819409b8ecba05e9337ec73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6edbe27acbc4c9eba33a6f589f6cf8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:00.110109 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-271c31ad-4a9c-49b0-9b53-f2240afb1ad3 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] 10.222.0.20 "GET /compute/v2.1/servers/6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28" status: 200 len: 1523 microversion: 2.1 time: 0.769010 Oct 04 18:40:00.112097 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1455/2920] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:59 2022] GET /compute/v2.1/servers/6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28 => generated 1523 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:00.119860 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-53d2e679-a7de-4201-993a-88cc82a5105d tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:00.126895 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-53d2e679-a7de-4201-993a-88cc82a5105d tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Searching by: {'tenant_id': '1b922a74c1c2448bb770d6b298b2d601', 'deleted': False} {{(pid=123001) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:40:00.135414 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-53d2e679-a7de-4201-993a-88cc82a5105d tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:00.136452 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-53d2e679-a7de-4201-993a-88cc82a5105d tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:00.137169 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-53d2e679-a7de-4201-993a-88cc82a5105d tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:00.138260 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-53d2e679-a7de-4201-993a-88cc82a5105d tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:00.139122 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-53d2e679-a7de-4201-993a-88cc82a5105d tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:00.139912 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-53d2e679-a7de-4201-993a-88cc82a5105d tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:00.193829 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.multi_cell_list [None req-53d2e679-a7de-4201-993a-88cc82a5105d tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=123001) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:40:00.256716 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-53d2e679-a7de-4201-993a-88cc82a5105d tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:00.260748 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-53d2e679-a7de-4201-993a-88cc82a5105d tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:00.261382 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-53d2e679-a7de-4201-993a-88cc82a5105d tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:00.872292 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3fcce127-ebb6-400a-9974-c631e039ffd5 tempest-SecurityGroupsTestAdminJSON-1981209731 tempest-SecurityGroupsTestAdminJSON-1981209731-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/c267c62c-4deb-4898-b21f-62439008f20f" status: 202 len: 0 microversion: 2.1 time: 1.498589 Oct 04 18:40:00.882129 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1466/2921] 10.222.0.20 () {58 vars in 1272 bytes} [Tue Oct 4 18:39:59 2022] DELETE /compute/v2.1/os-security-groups/c267c62c-4deb-4898-b21f-62439008f20f => generated 0 bytes in 1509 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:40:00.895005 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-fcf9e990-86c2-4822-88ef-894f044df14a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:00.897754 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-fcf9e990-86c2-4822-88ef-894f044df14a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2e308f41-242e-4ce3-8641-9510e2f13681] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:00.916301 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-53d2e679-a7de-4201-993a-88cc82a5105d tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=1b922a74c1c2448bb770d6b298b2d601" status: 200 len: 4829 microversion: 2.1 time: 0.798639 Oct 04 18:40:00.918837 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1456/2922] 10.222.0.20 () {58 vars in 1257 bytes} [Tue Oct 4 18:40:00 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=1b922a74c1c2448bb770d6b298b2d601 => generated 4829 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:00.926420 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-383ae771-7109-43b7-bc28-1de7f0fd5be6 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:00.931577 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-383ae771-7109-43b7-bc28-1de7f0fd5be6 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] [instance: 3d3cabc2-fa23-4098-9197-9aaa19a0c663] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:00.938768 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fcf9e990-86c2-4822-88ef-894f044df14a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:00.939723 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fcf9e990-86c2-4822-88ef-894f044df14a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:00.940314 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fcf9e990-86c2-4822-88ef-894f044df14a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:00.943425 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fcf9e990-86c2-4822-88ef-894f044df14a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:00.944033 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fcf9e990-86c2-4822-88ef-894f044df14a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:00.948932 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fcf9e990-86c2-4822-88ef-894f044df14a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:00.952732 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-383ae771-7109-43b7-bc28-1de7f0fd5be6 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:00.953278 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-383ae771-7109-43b7-bc28-1de7f0fd5be6 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:00.953713 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-383ae771-7109-43b7-bc28-1de7f0fd5be6 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:00.954477 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-383ae771-7109-43b7-bc28-1de7f0fd5be6 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:00.954940 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-383ae771-7109-43b7-bc28-1de7f0fd5be6 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:00.955372 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-383ae771-7109-43b7-bc28-1de7f0fd5be6 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:01.498247 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-fcf9e990-86c2-4822-88ef-894f044df14a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:01.511516 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-fcf9e990-86c2-4822-88ef-894f044df14a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681" status: 200 len: 1469 microversion: 2.1 time: 0.624819 Oct 04 18:40:01.523201 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1467/2923] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:00 2022] GET /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681 => generated 1469 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:01.533276 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d636de67-ce7e-4c24-b5b5-5c40de8a53e1 tempest-SecurityGroupsTestAdminJSON-1981209731 tempest-SecurityGroupsTestAdminJSON-1981209731-project-admin] Calling method '.version_select at 0x7fe25977ea60>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:01.557377 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-383ae771-7109-43b7-bc28-1de7f0fd5be6 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:01.569904 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-383ae771-7109-43b7-bc28-1de7f0fd5be6 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:01.584535 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-383ae771-7109-43b7-bc28-1de7f0fd5be6 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:01.584535 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-383ae771-7109-43b7-bc28-1de7f0fd5be6 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] 10.222.0.20 "GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663" status: 200 len: 1839 microversion: 2.42 time: 0.653270 Oct 04 18:40:01.584535 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1457/2924] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:00 2022] GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663 => generated 1839 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:01.584535 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c83bab07-83f4-4b22-9532-f5baaea08135 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:01.584535 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c83bab07-83f4-4b22-9532-f5baaea08135 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Searching by: {'tenant_id': '03b07908694b4f64a35141303a58b518', 'deleted': False} {{(pid=123001) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:40:01.591494 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:40:01.591494 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c83bab07-83f4-4b22-9532-f5baaea08135 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:01.591494 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c83bab07-83f4-4b22-9532-f5baaea08135 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:01.591864 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c83bab07-83f4-4b22-9532-f5baaea08135 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:01.592646 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c83bab07-83f4-4b22-9532-f5baaea08135 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:01.593284 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c83bab07-83f4-4b22-9532-f5baaea08135 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:01.594601 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c83bab07-83f4-4b22-9532-f5baaea08135 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:01.635980 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c83bab07-83f4-4b22-9532-f5baaea08135 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=03b07908694b4f64a35141303a58b518" status: 200 len: 15 microversion: 2.1 time: 0.061009 Oct 04 18:40:01.637005 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1458/2925] 10.222.0.20 () {58 vars in 1257 bytes} [Tue Oct 4 18:40:01 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=03b07908694b4f64a35141303a58b518 => generated 15 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:40:01.642110 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b4f2b0fa-e87e-4961-ae79-4ed20a9a3bd6 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:01.642830 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b4f2b0fa-e87e-4961-ae79-4ed20a9a3bd6 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] [instance: 6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:01.649835 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b4f2b0fa-e87e-4961-ae79-4ed20a9a3bd6 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:01.650663 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b4f2b0fa-e87e-4961-ae79-4ed20a9a3bd6 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:01.651333 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b4f2b0fa-e87e-4961-ae79-4ed20a9a3bd6 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:01.652309 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b4f2b0fa-e87e-4961-ae79-4ed20a9a3bd6 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:01.653050 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b4f2b0fa-e87e-4961-ae79-4ed20a9a3bd6 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:01.653702 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b4f2b0fa-e87e-4961-ae79-4ed20a9a3bd6 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:02.010873 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b4f2b0fa-e87e-4961-ae79-4ed20a9a3bd6 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec13a0273819409b8ecba05e9337ec73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6edbe27acbc4c9eba33a6f589f6cf8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:02.023773 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:40:02.043619 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b4f2b0fa-e87e-4961-ae79-4ed20a9a3bd6 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] 10.222.0.20 "GET /compute/v2.1/servers/6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28" status: 200 len: 1523 microversion: 2.1 time: 0.403717 Oct 04 18:40:02.045478 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1459/2926] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:01 2022] GET /compute/v2.1/servers/6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28 => generated 1523 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:02.055060 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-a0e00850-aaf6-4098-aecc-4618708a5bd6 req-f36b76eb-1d1b-40a0-b9bb-0bd5825b6d9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e308f41-242e-4ce3-8641-9510e2f13681", "tag": "192de35c-060d-4a11-8df5-09c24dfcc8d0"}, {"name": "network-changed", "server_uuid": "3d3cabc2-fa23-4098-9197-9aaa19a0c663", "tag": "3aad2644-bc27-4d77-9ae6-dd56c1d45027"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:40:02.075896 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-a0e00850-aaf6-4098-aecc-4618708a5bd6 req-f36b76eb-1d1b-40a0-b9bb-0bd5825b6d9e service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:02.076969 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-a0e00850-aaf6-4098-aecc-4618708a5bd6 req-f36b76eb-1d1b-40a0-b9bb-0bd5825b6d9e service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:02.078036 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-a0e00850-aaf6-4098-aecc-4618708a5bd6 req-f36b76eb-1d1b-40a0-b9bb-0bd5825b6d9e service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:02.105225 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-a0e00850-aaf6-4098-aecc-4618708a5bd6 req-f36b76eb-1d1b-40a0-b9bb-0bd5825b6d9e service nova] Creating event network-changed:192de35c-060d-4a11-8df5-09c24dfcc8d0 for instance 2e308f41-242e-4ce3-8641-9510e2f13681 on n-h1-850501-14 Oct 04 18:40:02.105752 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-a0e00850-aaf6-4098-aecc-4618708a5bd6 req-f36b76eb-1d1b-40a0-b9bb-0bd5825b6d9e service nova] Creating event network-changed:3aad2644-bc27-4d77-9ae6-dd56c1d45027 for instance 3d3cabc2-fa23-4098-9197-9aaa19a0c663 on n-h1-850501-14 Oct 04 18:40:02.112807 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [req-a0e00850-aaf6-4098-aecc-4618708a5bd6 req-f36b76eb-1d1b-40a0-b9bb-0bd5825b6d9e service nova] Instance 2e308f41-242e-4ce3-8641-9510e2f13681 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850501-14', 'n-h2-850501-14'} {{(pid=123001) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:40:02.137024 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-a0e00850-aaf6-4098-aecc-4618708a5bd6 req-f36b76eb-1d1b-40a0-b9bb-0bd5825b6d9e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.086859 Oct 04 18:40:02.137875 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1460/2927] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:40:02 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:40:02.145691 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c007dc6a-0cad-4c1e-87e4-bdf82d41c323 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:02.152661 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c007dc6a-0cad-4c1e-87e4-bdf82d41c323 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.010504 Oct 04 18:40:02.157714 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1461/2928] 10.222.0.20 () {58 vars in 1189 bytes} [Tue Oct 4 18:40:02 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:40:02.183973 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c243f744-452b-4316-9def-c7ccd678bf1d tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:40:02.186727 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c243f744-452b-4316-9def-c7ccd678bf1d tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] [instance: c343931b-bc96-4e9e-a5ce-f93454339a53] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:02.193836 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c243f744-452b-4316-9def-c7ccd678bf1d tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:02.194895 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c243f744-452b-4316-9def-c7ccd678bf1d tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:02.194895 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c243f744-452b-4316-9def-c7ccd678bf1d tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:02.196513 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c243f744-452b-4316-9def-c7ccd678bf1d tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:02.197514 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c243f744-452b-4316-9def-c7ccd678bf1d tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:02.197514 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c243f744-452b-4316-9def-c7ccd678bf1d tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:02.238939 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d636de67-ce7e-4c24-b5b5-5c40de8a53e1 tempest-SecurityGroupsTestAdminJSON-1981209731 tempest-SecurityGroupsTestAdminJSON-1981209731-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/c56f96d5-cd17-48ba-935a-03a418ab3e5e" status: 202 len: 0 microversion: 2.1 time: 0.713180 Oct 04 18:40:02.241376 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1468/2929] 10.222.0.20 () {58 vars in 1272 bytes} [Tue Oct 4 18:40:01 2022] DELETE /compute/v2.1/os-security-groups/c56f96d5-cd17-48ba-935a-03a418ab3e5e => generated 0 bytes in 717 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:40:02.250762 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0d02d5bb-dd02-4765-b4d4-5c76dd0ba5e8 tempest-SecurityGroupsTestAdminJSON-1786065839 tempest-SecurityGroupsTestAdminJSON-1786065839-project] Calling method '.version_select at 0x7fe259751f70>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:02.519227 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c243f744-452b-4316-9def-c7ccd678bf1d tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53/action" status: 202 len: 0 microversion: 2.1 time: 0.339961 Oct 04 18:40:02.523640 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1462/2930] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:40:02 2022] POST /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53/action => generated 0 bytes in 342 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:40:02.533942 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a43c06f1-d200-42c2-801a-83f4c7d640aa tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:02.541216 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a43c06f1-d200-42c2-801a-83f4c7d640aa tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f8358c07e2684b749a62becb9f0b7869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b922a74c1c2448bb770d6b298b2d601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:02.542413 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a43c06f1-d200-42c2-801a-83f4c7d640aa tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '1b922a74c1c2448bb770d6b298b2d601'} {{(pid=123001) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:40:02.548981 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a43c06f1-d200-42c2-801a-83f4c7d640aa tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:02.549644 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a43c06f1-d200-42c2-801a-83f4c7d640aa tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:02.550747 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a43c06f1-d200-42c2-801a-83f4c7d640aa tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:02.551945 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a43c06f1-d200-42c2-801a-83f4c7d640aa tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:02.552713 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a43c06f1-d200-42c2-801a-83f4c7d640aa tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:02.553293 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a43c06f1-d200-42c2-801a-83f4c7d640aa tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:02.595927 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.multi_cell_list [None req-a43c06f1-d200-42c2-801a-83f4c7d640aa tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123001) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:40:02.644724 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a43c06f1-d200-42c2-801a-83f4c7d640aa tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.119196 Oct 04 18:40:02.646261 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1463/2931] 10.222.0.20 () {58 vars in 1150 bytes} [Tue Oct 4 18:40:02 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:40:02.653672 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d73ee512-da6f-4fde-8270-d490eff4785e tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:02.655052 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d73ee512-da6f-4fde-8270-d490eff4785e tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2e308f41-242e-4ce3-8641-9510e2f13681] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:02.683983 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d73ee512-da6f-4fde-8270-d490eff4785e tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:02.685514 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d73ee512-da6f-4fde-8270-d490eff4785e tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:02.687392 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d73ee512-da6f-4fde-8270-d490eff4785e tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:02.689588 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d73ee512-da6f-4fde-8270-d490eff4785e tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:02.690392 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d73ee512-da6f-4fde-8270-d490eff4785e tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:02.691120 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d73ee512-da6f-4fde-8270-d490eff4785e tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:03.529567 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0d02d5bb-dd02-4765-b4d4-5c76dd0ba5e8 tempest-SecurityGroupsTestAdminJSON-1786065839 tempest-SecurityGroupsTestAdminJSON-1786065839-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/4c5f9d7d-cd25-4ffe-b37d-25b6ed29ff84" status: 202 len: 0 microversion: 2.1 time: 1.283080 Oct 04 18:40:03.530156 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1469/2932] 10.222.0.20 () {58 vars in 1272 bytes} [Tue Oct 4 18:40:02 2022] DELETE /compute/v2.1/os-security-groups/4c5f9d7d-cd25-4ffe-b37d-25b6ed29ff84 => generated 0 bytes in 1284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:40:03.538406 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4af0a4ec-2c64-4875-a008-c6f04846445f tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:03.539647 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4af0a4ec-2c64-4875-a008-c6f04846445f tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] [instance: 3d3cabc2-fa23-4098-9197-9aaa19a0c663] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:03.551411 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d73ee512-da6f-4fde-8270-d490eff4785e tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:03.555992 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4af0a4ec-2c64-4875-a008-c6f04846445f tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:03.556530 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4af0a4ec-2c64-4875-a008-c6f04846445f tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:03.557104 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4af0a4ec-2c64-4875-a008-c6f04846445f tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:03.560553 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4af0a4ec-2c64-4875-a008-c6f04846445f tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:03.561384 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4af0a4ec-2c64-4875-a008-c6f04846445f tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:03.562162 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4af0a4ec-2c64-4875-a008-c6f04846445f tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:03.563553 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d73ee512-da6f-4fde-8270-d490eff4785e tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681" status: 200 len: 1469 microversion: 2.1 time: 0.915994 Oct 04 18:40:03.564510 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1464/2933] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:02 2022] GET /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681 => generated 1469 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:03.576837 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e537261d-e34a-44d4-a4c6-f780b7f31a06 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:40:03.579154 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e537261d-e34a-44d4-a4c6-f780b7f31a06 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] [instance: c343931b-bc96-4e9e-a5ce-f93454339a53] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:03.595542 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e537261d-e34a-44d4-a4c6-f780b7f31a06 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:03.596048 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e537261d-e34a-44d4-a4c6-f780b7f31a06 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:03.598196 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e537261d-e34a-44d4-a4c6-f780b7f31a06 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:03.600768 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e537261d-e34a-44d4-a4c6-f780b7f31a06 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:03.601284 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e537261d-e34a-44d4-a4c6-f780b7f31a06 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:03.604529 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e537261d-e34a-44d4-a4c6-f780b7f31a06 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:04.050780 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e537261d-e34a-44d4-a4c6-f780b7f31a06 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53/action" status: 202 len: 0 microversion: 2.1 time: 0.485169 Oct 04 18:40:04.051996 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1465/2934] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:40:03 2022] POST /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53/action => generated 0 bytes in 487 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:40:04.058390 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e5896a01-55f4-49fe-8ca3-a9b6f7685367 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:04.059866 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e5896a01-55f4-49fe-8ca3-a9b6f7685367 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] [instance: 6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:04.073481 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e5896a01-55f4-49fe-8ca3-a9b6f7685367 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:04.076364 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e5896a01-55f4-49fe-8ca3-a9b6f7685367 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:04.076994 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e5896a01-55f4-49fe-8ca3-a9b6f7685367 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:04.080555 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e5896a01-55f4-49fe-8ca3-a9b6f7685367 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:04.081263 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e5896a01-55f4-49fe-8ca3-a9b6f7685367 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:04.081897 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e5896a01-55f4-49fe-8ca3-a9b6f7685367 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:04.417865 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4af0a4ec-2c64-4875-a008-c6f04846445f tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:04.444771 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4af0a4ec-2c64-4875-a008-c6f04846445f tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:04.450762 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4af0a4ec-2c64-4875-a008-c6f04846445f tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:04.452001 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4af0a4ec-2c64-4875-a008-c6f04846445f tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] 10.222.0.20 "GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663" status: 200 len: 1860 microversion: 2.42 time: 0.917578 Oct 04 18:40:04.452574 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1470/2935] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:03 2022] GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663 => generated 1860 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:04.468514 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-540b4312-f861-417b-a98c-165463fc2f1c tempest-SecurityGroupsTestAdminJSON-1786065839 tempest-SecurityGroupsTestAdminJSON-1786065839-project] Calling method '.version_select at 0x7fe2594ef670>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:04.606967 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e5896a01-55f4-49fe-8ca3-a9b6f7685367 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec13a0273819409b8ecba05e9337ec73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6edbe27acbc4c9eba33a6f589f6cf8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:04.619944 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e5896a01-55f4-49fe-8ca3-a9b6f7685367 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] 10.222.0.20 "GET /compute/v2.1/servers/6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28" status: 200 len: 1523 microversion: 2.1 time: 0.566689 Oct 04 18:40:04.626562 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1466/2936] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:04 2022] GET /compute/v2.1/servers/6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28 => generated 1523 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:04.646112 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1906a27f-e953-4a58-b6bf-c51824d96f3a tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:04.650542 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1906a27f-e953-4a58-b6bf-c51824d96f3a tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] [instance: c343931b-bc96-4e9e-a5ce-f93454339a53] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:04.666050 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1906a27f-e953-4a58-b6bf-c51824d96f3a tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:04.669871 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1906a27f-e953-4a58-b6bf-c51824d96f3a tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:04.670410 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1906a27f-e953-4a58-b6bf-c51824d96f3a tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:04.671541 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1906a27f-e953-4a58-b6bf-c51824d96f3a tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:04.672964 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1906a27f-e953-4a58-b6bf-c51824d96f3a tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:04.675994 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1906a27f-e953-4a58-b6bf-c51824d96f3a tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:05.086430 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1906a27f-e953-4a58-b6bf-c51824d96f3a tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53" status: 200 len: 1616 microversion: 2.1 time: 0.457490 Oct 04 18:40:05.090975 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1467/2937] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:04 2022] GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53 => generated 1616 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:05.126569 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-175213d3-0a85-4027-9ba9-8a12656bb95d req-89df3e7b-b859-4230-becb-53458e5d9e80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d3cabc2-fa23-4098-9197-9aaa19a0c663", "tag": "97062070-e6e0-48fa-bf25-5e66c4585ef9"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:40:05.152285 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-175213d3-0a85-4027-9ba9-8a12656bb95d req-89df3e7b-b859-4230-becb-53458e5d9e80 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:05.153296 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-175213d3-0a85-4027-9ba9-8a12656bb95d req-89df3e7b-b859-4230-becb-53458e5d9e80 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:05.153770 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-175213d3-0a85-4027-9ba9-8a12656bb95d req-89df3e7b-b859-4230-becb-53458e5d9e80 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:05.178926 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-175213d3-0a85-4027-9ba9-8a12656bb95d req-89df3e7b-b859-4230-becb-53458e5d9e80 service nova] Creating event network-changed:97062070-e6e0-48fa-bf25-5e66c4585ef9 for instance 3d3cabc2-fa23-4098-9197-9aaa19a0c663 on n-h1-850501-14 Oct 04 18:40:05.180478 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-540b4312-f861-417b-a98c-165463fc2f1c tempest-SecurityGroupsTestAdminJSON-1786065839 tempest-SecurityGroupsTestAdminJSON-1786065839-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/cd3fa712-28ab-4a8c-a8f4-e26526186bec" status: 202 len: 0 microversion: 2.1 time: 0.722772 Oct 04 18:40:05.181454 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1471/2938] 10.222.0.20 () {58 vars in 1272 bytes} [Tue Oct 4 18:40:04 2022] DELETE /compute/v2.1/os-security-groups/cd3fa712-28ab-4a8c-a8f4-e26526186bec => generated 0 bytes in 725 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:40:05.189415 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-175213d3-0a85-4027-9ba9-8a12656bb95d req-89df3e7b-b859-4230-becb-53458e5d9e80 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094802 Oct 04 18:40:05.190307 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1468/2939] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:40:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:40:05.197614 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d7eeca74-1d9a-47ad-b08d-fff031123b9f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:05.198640 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d7eeca74-1d9a-47ad-b08d-fff031123b9f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2e308f41-242e-4ce3-8641-9510e2f13681] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:05.205535 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d7eeca74-1d9a-47ad-b08d-fff031123b9f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:05.211806 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d7eeca74-1d9a-47ad-b08d-fff031123b9f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:05.211806 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d7eeca74-1d9a-47ad-b08d-fff031123b9f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:05.211806 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d7eeca74-1d9a-47ad-b08d-fff031123b9f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:05.211806 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d7eeca74-1d9a-47ad-b08d-fff031123b9f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:05.211806 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d7eeca74-1d9a-47ad-b08d-fff031123b9f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:05.428318 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2e2bcb86-7389-4e8f-974d-d8bcc859c751 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1662104657", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": "none"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:40:05.491853 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d7eeca74-1d9a-47ad-b08d-fff031123b9f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:05.501935 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d7eeca74-1d9a-47ad-b08d-fff031123b9f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681" status: 200 len: 1462 microversion: 2.1 time: 0.310390 Oct 04 18:40:05.508321 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1469/2940] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:05 2022] GET /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681 => generated 1462 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:05.517550 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ae5f7fdb-baf8-415f-b0f9-4cc3ed3cdca2 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:05.518345 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ae5f7fdb-baf8-415f-b0f9-4cc3ed3cdca2 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] [instance: c343931b-bc96-4e9e-a5ce-f93454339a53] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:05.526471 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ae5f7fdb-baf8-415f-b0f9-4cc3ed3cdca2 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:05.527401 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ae5f7fdb-baf8-415f-b0f9-4cc3ed3cdca2 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:05.527991 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ae5f7fdb-baf8-415f-b0f9-4cc3ed3cdca2 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:05.529924 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ae5f7fdb-baf8-415f-b0f9-4cc3ed3cdca2 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:05.530848 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ae5f7fdb-baf8-415f-b0f9-4cc3ed3cdca2 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:05.531433 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ae5f7fdb-baf8-415f-b0f9-4cc3ed3cdca2 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:05.548759 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-2e2bcb86-7389-4e8f-974d-d8bcc859c751 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:40:05.549339 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-2e2bcb86-7389-4e8f-974d-d8bcc859c751 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:40:05.551985 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-2e2bcb86-7389-4e8f-974d-d8bcc859c751 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:40:05.552574 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-2e2bcb86-7389-4e8f-974d-d8bcc859c751 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:40:05.553175 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-2e2bcb86-7389-4e8f-974d-d8bcc859c751 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:40:05.570742 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e2bcb86-7389-4e8f-974d-d8bcc859c751 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:05.571619 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e2bcb86-7389-4e8f-974d-d8bcc859c751 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:05.573188 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e2bcb86-7389-4e8f-974d-d8bcc859c751 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:05.574201 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e2bcb86-7389-4e8f-974d-d8bcc859c751 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:05.575045 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e2bcb86-7389-4e8f-974d-d8bcc859c751 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:05.575864 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e2bcb86-7389-4e8f-974d-d8bcc859c751 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:05.640961 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-2e2bcb86-7389-4e8f-974d-d8bcc859c751 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Getting quotas for project 4c247547676947a4814e8bd1a782045c. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:40:05.652034 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-2e2bcb86-7389-4e8f-974d-d8bcc859c751 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Getting quotas for user 7e6c724e83e544c58a01df2bedde1b39 and project 4c247547676947a4814e8bd1a782045c. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:40:05.670619 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2e2bcb86-7389-4e8f-974d-d8bcc859c751 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Going to run 1 instances... {{(pid=123002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:40:05.674890 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2e2bcb86-7389-4e8f-974d-d8bcc859c751 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] [instance: 573af785-eb22-4bc0-af0b-eb97d05b9329] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:40:05.903493 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2e2bcb86-7389-4e8f-974d-d8bcc859c751 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.720021 Oct 04 18:40:05.905755 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1472/2941] 10.222.0.20 () {62 vars in 1188 bytes} [Tue Oct 4 18:40:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 723 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 18:40:05.909564 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ae5f7fdb-baf8-415f-b0f9-4cc3ed3cdca2 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53" status: 200 len: 1616 microversion: 2.1 time: 0.404047 Oct 04 18:40:05.913999 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1470/2942] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:05 2022] GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53 => generated 1616 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:05.932631 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d89dc43e-d704-439d-9b68-63d9c98dee7f tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:05.935631 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d89dc43e-d704-439d-9b68-63d9c98dee7f tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] [instance: 3d3cabc2-fa23-4098-9197-9aaa19a0c663] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:05.951575 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d89dc43e-d704-439d-9b68-63d9c98dee7f tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:05.952758 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d89dc43e-d704-439d-9b68-63d9c98dee7f tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:05.953857 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d89dc43e-d704-439d-9b68-63d9c98dee7f tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:05.954955 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d89dc43e-d704-439d-9b68-63d9c98dee7f tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:05.955614 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d89dc43e-d704-439d-9b68-63d9c98dee7f tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:05.956349 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d89dc43e-d704-439d-9b68-63d9c98dee7f tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:06.423988 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-aed61c5c-e9cf-4f0b-9b63-330ad35f8ee6 tempest-MigrationsAdminTest-1101631867 tempest-MigrationsAdminTest-1101631867-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:06.424672 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-aed61c5c-e9cf-4f0b-9b63-330ad35f8ee6 tempest-MigrationsAdminTest-1101631867 tempest-MigrationsAdminTest-1101631867-project-admin] [instance: 2e308f41-242e-4ce3-8641-9510e2f13681] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:06.437827 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aed61c5c-e9cf-4f0b-9b63-330ad35f8ee6 tempest-MigrationsAdminTest-1101631867 tempest-MigrationsAdminTest-1101631867-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:06.438742 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aed61c5c-e9cf-4f0b-9b63-330ad35f8ee6 tempest-MigrationsAdminTest-1101631867 tempest-MigrationsAdminTest-1101631867-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:06.439623 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aed61c5c-e9cf-4f0b-9b63-330ad35f8ee6 tempest-MigrationsAdminTest-1101631867 tempest-MigrationsAdminTest-1101631867-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:06.440566 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aed61c5c-e9cf-4f0b-9b63-330ad35f8ee6 tempest-MigrationsAdminTest-1101631867 tempest-MigrationsAdminTest-1101631867-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:06.441191 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aed61c5c-e9cf-4f0b-9b63-330ad35f8ee6 tempest-MigrationsAdminTest-1101631867 tempest-MigrationsAdminTest-1101631867-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:06.441781 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aed61c5c-e9cf-4f0b-9b63-330ad35f8ee6 tempest-MigrationsAdminTest-1101631867 tempest-MigrationsAdminTest-1101631867-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:06.549827 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d89dc43e-d704-439d-9b68-63d9c98dee7f tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:06.561829 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d89dc43e-d704-439d-9b68-63d9c98dee7f tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:06.563856 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d89dc43e-d704-439d-9b68-63d9c98dee7f tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:06.567073 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d89dc43e-d704-439d-9b68-63d9c98dee7f tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] 10.222.0.20 "GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663" status: 200 len: 1881 microversion: 2.42 time: 0.658712 Oct 04 18:40:06.594909 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1473/2943] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:05 2022] GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663 => generated 1881 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:06.603154 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3b284778-1258-4d07-8abb-5d2460d51cbc tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:06.604954 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3b284778-1258-4d07-8abb-5d2460d51cbc tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] [instance: 6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:06.611039 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3b284778-1258-4d07-8abb-5d2460d51cbc tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:06.611877 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3b284778-1258-4d07-8abb-5d2460d51cbc tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:06.612582 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3b284778-1258-4d07-8abb-5d2460d51cbc tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:06.613516 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3b284778-1258-4d07-8abb-5d2460d51cbc tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:06.614189 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3b284778-1258-4d07-8abb-5d2460d51cbc tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:06.615352 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3b284778-1258-4d07-8abb-5d2460d51cbc tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:06.857653 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-aed61c5c-e9cf-4f0b-9b63-330ad35f8ee6 tempest-MigrationsAdminTest-1101631867 tempest-MigrationsAdminTest-1101631867-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681" status: 200 len: 1615 microversion: 2.1 time: 0.941875 Oct 04 18:40:06.877810 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1471/2944] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:05 2022] GET /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681 => generated 1615 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:06.889628 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-049cff1f-c73b-469f-96cb-a32499f2d02d tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:06.901668 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-049cff1f-c73b-469f-96cb-a32499f2d02d tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] [instance: 573af785-eb22-4bc0-af0b-eb97d05b9329] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:07.002182 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3b284778-1258-4d07-8abb-5d2460d51cbc tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec13a0273819409b8ecba05e9337ec73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6edbe27acbc4c9eba33a6f589f6cf8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:07.025232 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3b284778-1258-4d07-8abb-5d2460d51cbc tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] 10.222.0.20 "GET /compute/v2.1/servers/6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28" status: 200 len: 1523 microversion: 2.1 time: 0.428931 Oct 04 18:40:07.028507 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1474/2945] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:06 2022] GET /compute/v2.1/servers/6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28 => generated 1523 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:07.042315 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4a93fa6f-924f-461f-8de6-6f167154a198 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:07.057372 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4a93fa6f-924f-461f-8de6-6f167154a198 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Searching by: {'host': 'n-h2-850501-14', 'deleted': False} {{(pid=123002) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:40:07.062191 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-049cff1f-c73b-469f-96cb-a32499f2d02d tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:07.090031 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4a93fa6f-924f-461f-8de6-6f167154a198 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:07.090255 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4a93fa6f-924f-461f-8de6-6f167154a198 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:07.090613 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4a93fa6f-924f-461f-8de6-6f167154a198 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:07.091326 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4a93fa6f-924f-461f-8de6-6f167154a198 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:07.091782 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4a93fa6f-924f-461f-8de6-6f167154a198 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:07.092238 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4a93fa6f-924f-461f-8de6-6f167154a198 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:07.113004 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-049cff1f-c73b-469f-96cb-a32499f2d02d tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:07.142336 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-049cff1f-c73b-469f-96cb-a32499f2d02d tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:07.147030 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-049cff1f-c73b-469f-96cb-a32499f2d02d tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] 10.222.0.20 "GET /compute/v2.1/servers/573af785-eb22-4bc0-af0b-eb97d05b9329" status: 200 len: 1278 microversion: 2.47 time: 0.267620 Oct 04 18:40:07.160721 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1472/2946] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:06 2022] GET /compute/v2.1/servers/573af785-eb22-4bc0-af0b-eb97d05b9329 => generated 1278 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:07.184911 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-5a8896eb-21c3-4036-865e-d3ce26035d71 req-81541cd6-1203-4e4b-89e5-ee082651b5f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e308f41-242e-4ce3-8641-9510e2f13681", "name": "network-vif-plugged", "status": "completed", "tag": "192de35c-060d-4a11-8df5-09c24dfcc8d0"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:40:07.250776 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-5a8896eb-21c3-4036-865e-d3ce26035d71 req-81541cd6-1203-4e4b-89e5-ee082651b5f5 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:07.251508 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-5a8896eb-21c3-4036-865e-d3ce26035d71 req-81541cd6-1203-4e4b-89e5-ee082651b5f5 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:07.252148 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-5a8896eb-21c3-4036-865e-d3ce26035d71 req-81541cd6-1203-4e4b-89e5-ee082651b5f5 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:07.310370 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-5a8896eb-21c3-4036-865e-d3ce26035d71 req-81541cd6-1203-4e4b-89e5-ee082651b5f5 service nova] Creating event network-vif-plugged:192de35c-060d-4a11-8df5-09c24dfcc8d0 for instance 2e308f41-242e-4ce3-8641-9510e2f13681 on n-h1-850501-14 Oct 04 18:40:07.346015 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-5a8896eb-21c3-4036-865e-d3ce26035d71 req-81541cd6-1203-4e4b-89e5-ee082651b5f5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.169026 Oct 04 18:40:07.351154 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1473/2947] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:40:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:40:07.370598 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-39d7c02a-fc3b-40e8-b7c5-9b28f735b51b tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:07.374711 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-39d7c02a-fc3b-40e8-b7c5-9b28f735b51b tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2e308f41-242e-4ce3-8641-9510e2f13681] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:07.393780 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-39d7c02a-fc3b-40e8-b7c5-9b28f735b51b tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:07.395338 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-39d7c02a-fc3b-40e8-b7c5-9b28f735b51b tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:07.397227 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-39d7c02a-fc3b-40e8-b7c5-9b28f735b51b tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:07.399724 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-39d7c02a-fc3b-40e8-b7c5-9b28f735b51b tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:07.402560 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-39d7c02a-fc3b-40e8-b7c5-9b28f735b51b tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:07.403371 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.multi_cell_list [None req-4a93fa6f-924f-461f-8de6-6f167154a198 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Listed batch of 5 results from cell out of 1000 limit. Returned 5 total so far. {{(pid=123002) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:40:07.404016 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-39d7c02a-fc3b-40e8-b7c5-9b28f735b51b tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:07.513854 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-39d7c02a-fc3b-40e8-b7c5-9b28f735b51b tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2e308f41-242e-4ce3-8641-9510e2f13681] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:40:07.559267 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4a93fa6f-924f-461f-8de6-6f167154a198 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] 10.222.0.20 "GET /compute/v2.1/servers?host=n-h2-850501-14&all_tenants=1" status: 200 len: 1638 microversion: 2.1 time: 0.529486 Oct 04 18:40:07.561265 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1475/2948] 10.222.0.20 () {58 vars in 1192 bytes} [Tue Oct 4 18:40:07 2022] GET /compute/v2.1/servers?host=n-h2-850501-14&all_tenants=1 => generated 1638 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:07.574394 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-4c1c5783-18ca-4565-8a19-d26f82b6c073 req-6e3f4ed6-ad64-43e6-9371-882d626bb11f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d3cabc2-fa23-4098-9197-9aaa19a0c663", "tag": "cbad334d-c696-4a06-b1cc-741dd0479d60"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:40:07.604395 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-4c1c5783-18ca-4565-8a19-d26f82b6c073 req-6e3f4ed6-ad64-43e6-9371-882d626bb11f service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:07.605160 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-4c1c5783-18ca-4565-8a19-d26f82b6c073 req-6e3f4ed6-ad64-43e6-9371-882d626bb11f service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:07.605800 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-4c1c5783-18ca-4565-8a19-d26f82b6c073 req-6e3f4ed6-ad64-43e6-9371-882d626bb11f service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:07.622300 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-4c1c5783-18ca-4565-8a19-d26f82b6c073 req-6e3f4ed6-ad64-43e6-9371-882d626bb11f service nova] Creating event network-changed:cbad334d-c696-4a06-b1cc-741dd0479d60 for instance 3d3cabc2-fa23-4098-9197-9aaa19a0c663 on n-h1-850501-14 Oct 04 18:40:07.627594 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-4c1c5783-18ca-4565-8a19-d26f82b6c073 req-6e3f4ed6-ad64-43e6-9371-882d626bb11f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063566 Oct 04 18:40:07.628808 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1476/2949] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:40:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:40:07.635373 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-93bc53d2-7036-4ee6-beb8-d14a6b3e8d35 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1690178391", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": "none"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:40:07.704090 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-93bc53d2-7036-4ee6-beb8-d14a6b3e8d35 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:40:07.706933 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-93bc53d2-7036-4ee6-beb8-d14a6b3e8d35 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:40:07.708537 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-93bc53d2-7036-4ee6-beb8-d14a6b3e8d35 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:40:07.729731 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-93bc53d2-7036-4ee6-beb8-d14a6b3e8d35 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:40:07.730254 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-93bc53d2-7036-4ee6-beb8-d14a6b3e8d35 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:40:07.748413 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-93bc53d2-7036-4ee6-beb8-d14a6b3e8d35 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:07.751128 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-93bc53d2-7036-4ee6-beb8-d14a6b3e8d35 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:07.752207 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-93bc53d2-7036-4ee6-beb8-d14a6b3e8d35 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:07.755406 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-93bc53d2-7036-4ee6-beb8-d14a6b3e8d35 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:07.756657 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-93bc53d2-7036-4ee6-beb8-d14a6b3e8d35 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:07.759857 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-93bc53d2-7036-4ee6-beb8-d14a6b3e8d35 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:07.816778 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-93bc53d2-7036-4ee6-beb8-d14a6b3e8d35 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Getting quotas for project 4c247547676947a4814e8bd1a782045c. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:40:07.839700 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-93bc53d2-7036-4ee6-beb8-d14a6b3e8d35 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Getting quotas for user 7e6c724e83e544c58a01df2bedde1b39 and project 4c247547676947a4814e8bd1a782045c. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:40:07.867978 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-93bc53d2-7036-4ee6-beb8-d14a6b3e8d35 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Going to run 1 instances... {{(pid=123002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:40:07.871906 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-93bc53d2-7036-4ee6-beb8-d14a6b3e8d35 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] [instance: 1b0129be-f5f9-4735-a10a-008bddc30ab4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:40:07.971746 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-39d7c02a-fc3b-40e8-b7c5-9b28f735b51b tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681" status: 204 len: 0 microversion: 2.1 time: 0.618043 Oct 04 18:40:07.972873 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1474/2950] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:40:07 2022] DELETE /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681 => generated 0 bytes in 621 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:40:07.979130 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-97c77996-e477-49df-b7c6-b79095d608fe tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:07.986224 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-97c77996-e477-49df-b7c6-b79095d608fe tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=123001) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:40:07.991567 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-97c77996-e477-49df-b7c6-b79095d608fe tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:07.992546 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-97c77996-e477-49df-b7c6-b79095d608fe tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:07.993239 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-97c77996-e477-49df-b7c6-b79095d608fe tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:07.994186 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-97c77996-e477-49df-b7c6-b79095d608fe tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:07.994836 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-97c77996-e477-49df-b7c6-b79095d608fe tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:07.995442 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-97c77996-e477-49df-b7c6-b79095d608fe tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:08.032041 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-93bc53d2-7036-4ee6-beb8-d14a6b3e8d35 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.398525 Oct 04 18:40:08.034677 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1477/2951] 10.222.0.20 () {62 vars in 1188 bytes} [Tue Oct 4 18:40:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 405 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 18:40:08.049489 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-568984a4-9521-4511-9e00-41cd8da9d538 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:08.053154 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-568984a4-9521-4511-9e00-41cd8da9d538 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] [instance: 3d3cabc2-fa23-4098-9197-9aaa19a0c663] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:08.105392 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:40:08.126450 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-568984a4-9521-4511-9e00-41cd8da9d538 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:08.126986 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-568984a4-9521-4511-9e00-41cd8da9d538 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:08.131336 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-568984a4-9521-4511-9e00-41cd8da9d538 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:08.132163 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-568984a4-9521-4511-9e00-41cd8da9d538 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:08.135227 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-568984a4-9521-4511-9e00-41cd8da9d538 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:08.135880 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-568984a4-9521-4511-9e00-41cd8da9d538 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:08.144904 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-97c77996-e477-49df-b7c6-b79095d608fe tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] 10.222.0.20 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.170419 Oct 04 18:40:08.155180 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1475/2952] 10.222.0.20 () {58 vars in 1196 bytes} [Tue Oct 4 18:40:07 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:40:08.176544 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-947e5145-f1d5-409c-bc7a-7fbd82948e23 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:08.177298 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-947e5145-f1d5-409c-bc7a-7fbd82948e23 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2e308f41-242e-4ce3-8641-9510e2f13681] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:08.190128 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-947e5145-f1d5-409c-bc7a-7fbd82948e23 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:08.190672 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-947e5145-f1d5-409c-bc7a-7fbd82948e23 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:08.191118 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-947e5145-f1d5-409c-bc7a-7fbd82948e23 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:08.191840 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-947e5145-f1d5-409c-bc7a-7fbd82948e23 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:08.192328 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-947e5145-f1d5-409c-bc7a-7fbd82948e23 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:08.192761 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-947e5145-f1d5-409c-bc7a-7fbd82948e23 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:08.730689 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-947e5145-f1d5-409c-bc7a-7fbd82948e23 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:08.739008 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-947e5145-f1d5-409c-bc7a-7fbd82948e23 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681" status: 200 len: 1468 microversion: 2.1 time: 0.582470 Oct 04 18:40:08.752352 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-568984a4-9521-4511-9e00-41cd8da9d538 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:08.753484 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1476/2953] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:08 2022] GET /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681 => generated 1468 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:08.763787 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-de79e549-ba51-4a18-878f-1b703910fad7 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:40:08.765341 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-de79e549-ba51-4a18-878f-1b703910fad7 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] [instance: 1b0129be-f5f9-4735-a10a-008bddc30ab4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:08.767166 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-568984a4-9521-4511-9e00-41cd8da9d538 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:08.768959 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-568984a4-9521-4511-9e00-41cd8da9d538 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:08.775007 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-568984a4-9521-4511-9e00-41cd8da9d538 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] 10.222.0.20 "GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663" status: 200 len: 1881 microversion: 2.42 time: 0.739057 Oct 04 18:40:08.780100 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1478/2954] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:08 2022] GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663 => generated 1881 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:08.784689 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-bce11882-c587-4224-96b4-1791e8fef7a8 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:08.785752 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-bce11882-c587-4224-96b4-1791e8fef7a8 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] [instance: 6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:08.795758 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bce11882-c587-4224-96b4-1791e8fef7a8 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:08.796299 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bce11882-c587-4224-96b4-1791e8fef7a8 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:08.797220 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bce11882-c587-4224-96b4-1791e8fef7a8 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:08.798300 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bce11882-c587-4224-96b4-1791e8fef7a8 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:08.798932 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bce11882-c587-4224-96b4-1791e8fef7a8 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:08.799364 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bce11882-c587-4224-96b4-1791e8fef7a8 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:08.818408 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-de79e549-ba51-4a18-878f-1b703910fad7 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] 10.222.0.20 "PUT /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4" status: 200 len: 992 microversion: 2.47 time: 0.063586 Oct 04 18:40:08.818978 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1477/2955] 10.222.0.20 () {62 vars in 1297 bytes} [Tue Oct 4 18:40:08 2022] PUT /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4 => generated 992 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:40:08.824464 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b86f11a2-1ad1-4869-b1a8-28dc1155f646 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:40:08.838420 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b86f11a2-1ad1-4869-b1a8-28dc1155f646 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] [instance: c343931b-bc96-4e9e-a5ce-f93454339a53] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:08.848290 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b86f11a2-1ad1-4869-b1a8-28dc1155f646 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:08.848930 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b86f11a2-1ad1-4869-b1a8-28dc1155f646 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:08.853783 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b86f11a2-1ad1-4869-b1a8-28dc1155f646 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:08.853783 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b86f11a2-1ad1-4869-b1a8-28dc1155f646 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:08.853783 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b86f11a2-1ad1-4869-b1a8-28dc1155f646 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:08.853783 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b86f11a2-1ad1-4869-b1a8-28dc1155f646 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:09.153915 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-bce11882-c587-4224-96b4-1791e8fef7a8 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec13a0273819409b8ecba05e9337ec73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6edbe27acbc4c9eba33a6f589f6cf8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:09.165118 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-bce11882-c587-4224-96b4-1791e8fef7a8 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] 10.222.0.20 "GET /compute/v2.1/servers/6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28" status: 200 len: 1523 microversion: 2.1 time: 0.387862 Oct 04 18:40:09.165922 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1479/2956] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:08 2022] GET /compute/v2.1/servers/6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28 => generated 1523 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:09.178855 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5fde69ea-9a2f-469c-97d9-4288bdc38a61 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:09.181581 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5fde69ea-9a2f-469c-97d9-4288bdc38a61 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] [instance: 1b0129be-f5f9-4735-a10a-008bddc30ab4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:09.207280 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b86f11a2-1ad1-4869-b1a8-28dc1155f646 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53/action" status: 202 len: 0 microversion: 2.1 time: 0.385143 Oct 04 18:40:09.209782 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1478/2957] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:40:08 2022] POST /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53/action => generated 0 bytes in 389 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:40:09.220110 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e5b1e54a-42e7-4c56-a6f1-90d811122420 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:40:09.223397 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e5b1e54a-42e7-4c56-a6f1-90d811122420 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: c343931b-bc96-4e9e-a5ce-f93454339a53] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:09.233442 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e5b1e54a-42e7-4c56-a6f1-90d811122420 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:09.234445 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e5b1e54a-42e7-4c56-a6f1-90d811122420 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:09.238524 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e5b1e54a-42e7-4c56-a6f1-90d811122420 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:09.238524 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e5b1e54a-42e7-4c56-a6f1-90d811122420 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:09.238524 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e5b1e54a-42e7-4c56-a6f1-90d811122420 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:09.238524 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e5b1e54a-42e7-4c56-a6f1-90d811122420 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:09.280276 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5fde69ea-9a2f-469c-97d9-4288bdc38a61 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:09.290660 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5fde69ea-9a2f-469c-97d9-4288bdc38a61 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:09.292771 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5fde69ea-9a2f-469c-97d9-4288bdc38a61 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:09.294084 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5fde69ea-9a2f-469c-97d9-4288bdc38a61 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] 10.222.0.20 "GET /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4" status: 200 len: 1278 microversion: 2.47 time: 0.126679 Oct 04 18:40:09.295095 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1480/2958] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:09 2022] GET /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4 => generated 1278 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:09.392930 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-e5b1e54a-42e7-4c56-a6f1-90d811122420 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:40:09.393548 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-e5b1e54a-42e7-4c56-a6f1-90d811122420 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:40:09.394566 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-e5b1e54a-42e7-4c56-a6f1-90d811122420 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:40:09.395095 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-e5b1e54a-42e7-4c56-a6f1-90d811122420 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:40:09.395633 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-e5b1e54a-42e7-4c56-a6f1-90d811122420 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:40:09.664685 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-b2bd4b0f-8aa3-4ba5-b3d9-e3be9accdfea req-32cdbe5c-aca8-407d-a92a-986c631b4006 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d3cabc2-fa23-4098-9197-9aaa19a0c663", "tag": "c909b4c7-8843-4155-a690-84520be7fb47"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:40:09.689655 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-b2bd4b0f-8aa3-4ba5-b3d9-e3be9accdfea req-32cdbe5c-aca8-407d-a92a-986c631b4006 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:09.690068 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-b2bd4b0f-8aa3-4ba5-b3d9-e3be9accdfea req-32cdbe5c-aca8-407d-a92a-986c631b4006 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:09.690507 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-b2bd4b0f-8aa3-4ba5-b3d9-e3be9accdfea req-32cdbe5c-aca8-407d-a92a-986c631b4006 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:09.725970 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-b2bd4b0f-8aa3-4ba5-b3d9-e3be9accdfea req-32cdbe5c-aca8-407d-a92a-986c631b4006 service nova] Creating event network-changed:c909b4c7-8843-4155-a690-84520be7fb47 for instance 3d3cabc2-fa23-4098-9197-9aaa19a0c663 on n-h1-850501-14 Oct 04 18:40:09.731497 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-b2bd4b0f-8aa3-4ba5-b3d9-e3be9accdfea req-32cdbe5c-aca8-407d-a92a-986c631b4006 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071135 Oct 04 18:40:09.735345 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1481/2959] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:40:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:40:09.740987 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e5b1e54a-42e7-4c56-a6f1-90d811122420 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: c343931b-bc96-4e9e-a5ce-f93454339a53] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:09.768526 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4d9a4705-9e57-4901-a847-2836841d7001 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:09.769241 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4d9a4705-9e57-4901-a847-2836841d7001 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2e308f41-242e-4ce3-8641-9510e2f13681] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:09.779271 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e5b1e54a-42e7-4c56-a6f1-90d811122420 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:09.781236 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e5b1e54a-42e7-4c56-a6f1-90d811122420 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:09.782870 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e5b1e54a-42e7-4c56-a6f1-90d811122420 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:09.782998 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4d9a4705-9e57-4901-a847-2836841d7001 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:09.783497 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4d9a4705-9e57-4901-a847-2836841d7001 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:09.783935 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4d9a4705-9e57-4901-a847-2836841d7001 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:09.784685 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4d9a4705-9e57-4901-a847-2836841d7001 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:09.785138 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4d9a4705-9e57-4901-a847-2836841d7001 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:09.785563 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4d9a4705-9e57-4901-a847-2836841d7001 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:09.787283 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e5b1e54a-42e7-4c56-a6f1-90d811122420 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:09.798307 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e5b1e54a-42e7-4c56-a6f1-90d811122420 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:09.798307 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e5b1e54a-42e7-4c56-a6f1-90d811122420 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:09.906047 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e5b1e54a-42e7-4c56-a6f1-90d811122420 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "POST /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53/action" status: 202 len: 1067 microversion: 2.1 time: 0.691051 Oct 04 18:40:09.907493 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1479/2960] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:40:09 2022] POST /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53/action => generated 1067 bytes in 694 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Oct 04 18:40:09.915671 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f3576e87-dd9e-4a71-b8d3-dacb0ce8182c tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:09.919495 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f3576e87-dd9e-4a71-b8d3-dacb0ce8182c tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] [instance: 3d3cabc2-fa23-4098-9197-9aaa19a0c663] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:09.925968 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f3576e87-dd9e-4a71-b8d3-dacb0ce8182c tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:09.926659 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f3576e87-dd9e-4a71-b8d3-dacb0ce8182c tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:09.927920 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f3576e87-dd9e-4a71-b8d3-dacb0ce8182c tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:09.927920 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f3576e87-dd9e-4a71-b8d3-dacb0ce8182c tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:09.928934 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f3576e87-dd9e-4a71-b8d3-dacb0ce8182c tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:09.932095 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f3576e87-dd9e-4a71-b8d3-dacb0ce8182c tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:10.484027 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4d9a4705-9e57-4901-a847-2836841d7001 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:10.496708 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4d9a4705-9e57-4901-a847-2836841d7001 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681" status: 200 len: 1468 microversion: 2.1 time: 0.733344 Oct 04 18:40:10.501824 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1482/2961] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:09 2022] GET /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681 => generated 1468 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:10.527579 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-06ec2334-b60e-4266-aa61-0c4426f30514 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:10.528378 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-06ec2334-b60e-4266-aa61-0c4426f30514 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: c343931b-bc96-4e9e-a5ce-f93454339a53] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:10.553539 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-06ec2334-b60e-4266-aa61-0c4426f30514 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:10.556164 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-06ec2334-b60e-4266-aa61-0c4426f30514 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:10.556953 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-06ec2334-b60e-4266-aa61-0c4426f30514 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:10.559698 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-06ec2334-b60e-4266-aa61-0c4426f30514 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:10.563558 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-06ec2334-b60e-4266-aa61-0c4426f30514 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:10.564690 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-06ec2334-b60e-4266-aa61-0c4426f30514 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:10.696923 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f3576e87-dd9e-4a71-b8d3-dacb0ce8182c tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:10.731013 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f3576e87-dd9e-4a71-b8d3-dacb0ce8182c tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:10.732844 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f3576e87-dd9e-4a71-b8d3-dacb0ce8182c tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:10.734551 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f3576e87-dd9e-4a71-b8d3-dacb0ce8182c tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] 10.222.0.20 "GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663" status: 200 len: 1881 microversion: 2.42 time: 0.825431 Oct 04 18:40:10.735375 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1480/2962] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:09 2022] GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663 => generated 1881 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:10.750030 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-615d819c-15f6-4c07-a532-1c6c2a73f0af tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:10.751082 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-615d819c-15f6-4c07-a532-1c6c2a73f0af tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] [instance: 6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:10.758759 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-615d819c-15f6-4c07-a532-1c6c2a73f0af tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:10.759502 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-615d819c-15f6-4c07-a532-1c6c2a73f0af tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:10.760157 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-615d819c-15f6-4c07-a532-1c6c2a73f0af tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:10.761054 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-615d819c-15f6-4c07-a532-1c6c2a73f0af tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:10.761953 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-615d819c-15f6-4c07-a532-1c6c2a73f0af tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:10.762475 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-615d819c-15f6-4c07-a532-1c6c2a73f0af tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:11.431329 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-06ec2334-b60e-4266-aa61-0c4426f30514 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8358c07e2684b749a62becb9f0b7869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b922a74c1c2448bb770d6b298b2d601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:11.443258 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-06ec2334-b60e-4266-aa61-0c4426f30514 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53" status: 200 len: 1471 microversion: 2.1 time: 0.940238 Oct 04 18:40:11.445638 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1483/2963] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:10 2022] GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53 => generated 1471 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:11.455905 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c3d489d2-c7cf-451d-9772-2b8a37685b3e tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:11.461380 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c3d489d2-c7cf-451d-9772-2b8a37685b3e tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] [instance: 1b0129be-f5f9-4735-a10a-008bddc30ab4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:11.499935 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c3d489d2-c7cf-451d-9772-2b8a37685b3e tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:11.500715 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c3d489d2-c7cf-451d-9772-2b8a37685b3e tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:11.501323 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c3d489d2-c7cf-451d-9772-2b8a37685b3e tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:11.504032 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c3d489d2-c7cf-451d-9772-2b8a37685b3e tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:11.512357 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c3d489d2-c7cf-451d-9772-2b8a37685b3e tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:11.512769 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c3d489d2-c7cf-451d-9772-2b8a37685b3e tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:11.601474 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-615d819c-15f6-4c07-a532-1c6c2a73f0af tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec13a0273819409b8ecba05e9337ec73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6edbe27acbc4c9eba33a6f589f6cf8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:11.610102 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-615d819c-15f6-4c07-a532-1c6c2a73f0af tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] 10.222.0.20 "GET /compute/v2.1/servers/6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28" status: 200 len: 1523 microversion: 2.1 time: 0.866225 Oct 04 18:40:11.611017 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1481/2964] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:10 2022] GET /compute/v2.1/servers/6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28 => generated 1523 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:11.628250 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1e0fedcc-b9f3-4c8f-87df-903ffcfac91a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:11.629138 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1e0fedcc-b9f3-4c8f-87df-903ffcfac91a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2e308f41-242e-4ce3-8641-9510e2f13681] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:11.646220 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1e0fedcc-b9f3-4c8f-87df-903ffcfac91a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:11.646334 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1e0fedcc-b9f3-4c8f-87df-903ffcfac91a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:11.647657 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1e0fedcc-b9f3-4c8f-87df-903ffcfac91a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:11.651582 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1e0fedcc-b9f3-4c8f-87df-903ffcfac91a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:11.652198 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1e0fedcc-b9f3-4c8f-87df-903ffcfac91a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:11.660007 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1e0fedcc-b9f3-4c8f-87df-903ffcfac91a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:11.698351 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c3d489d2-c7cf-451d-9772-2b8a37685b3e tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:11.710638 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c3d489d2-c7cf-451d-9772-2b8a37685b3e tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:11.723754 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c3d489d2-c7cf-451d-9772-2b8a37685b3e tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:11.723754 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c3d489d2-c7cf-451d-9772-2b8a37685b3e tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] 10.222.0.20 "GET /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4" status: 200 len: 1330 microversion: 2.47 time: 0.271367 Oct 04 18:40:11.731147 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1484/2965] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:11 2022] GET /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4 => generated 1330 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:11.745179 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-dabfe72b-419d-42e2-9932-2fc9610fec83 req-db89bb50-a42e-4d9c-af76-517bcbacf7c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e308f41-242e-4ce3-8641-9510e2f13681", "name": "network-vif-deleted", "tag": "192de35c-060d-4a11-8df5-09c24dfcc8d0"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:40:11.766904 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-dabfe72b-419d-42e2-9932-2fc9610fec83 req-db89bb50-a42e-4d9c-af76-517bcbacf7c5 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:11.768367 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-dabfe72b-419d-42e2-9932-2fc9610fec83 req-db89bb50-a42e-4d9c-af76-517bcbacf7c5 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:11.783765 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-dabfe72b-419d-42e2-9932-2fc9610fec83 req-db89bb50-a42e-4d9c-af76-517bcbacf7c5 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:11.814642 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-dabfe72b-419d-42e2-9932-2fc9610fec83 req-db89bb50-a42e-4d9c-af76-517bcbacf7c5 service nova] Creating event network-vif-deleted:192de35c-060d-4a11-8df5-09c24dfcc8d0 for instance 2e308f41-242e-4ce3-8641-9510e2f13681 on n-h1-850501-14 Oct 04 18:40:11.823951 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-dabfe72b-419d-42e2-9932-2fc9610fec83 req-db89bb50-a42e-4d9c-af76-517bcbacf7c5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089186 Oct 04 18:40:11.827490 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1485/2966] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:40:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:40:11.840786 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-30c2b16c-f56a-4db6-bb25-c40d561f95ec tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:11.844393 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-30c2b16c-f56a-4db6-bb25-c40d561f95ec tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] [instance: 3d3cabc2-fa23-4098-9197-9aaa19a0c663] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:11.859417 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-30c2b16c-f56a-4db6-bb25-c40d561f95ec tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:11.862742 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-30c2b16c-f56a-4db6-bb25-c40d561f95ec tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:11.863454 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-30c2b16c-f56a-4db6-bb25-c40d561f95ec tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:11.864656 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-30c2b16c-f56a-4db6-bb25-c40d561f95ec tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:11.867725 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-30c2b16c-f56a-4db6-bb25-c40d561f95ec tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:11.869609 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-30c2b16c-f56a-4db6-bb25-c40d561f95ec tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:12.050990 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1e0fedcc-b9f3-4c8f-87df-903ffcfac91a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:12.071165 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1e0fedcc-b9f3-4c8f-87df-903ffcfac91a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681" status: 200 len: 1426 microversion: 2.1 time: 0.458755 Oct 04 18:40:12.072576 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1482/2967] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:11 2022] GET /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681 => generated 1426 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:12.077391 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-29fcc133-ec9a-42f6-b909-e520ce640698 req-b0f5346d-e91c-49d2-b18f-a8be2a560943 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d3cabc2-fa23-4098-9197-9aaa19a0c663", "tag": "d87225ab-6eb7-4ee8-a1ae-be2176c6788c"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:40:12.113659 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-29fcc133-ec9a-42f6-b909-e520ce640698 req-b0f5346d-e91c-49d2-b18f-a8be2a560943 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:12.114176 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-29fcc133-ec9a-42f6-b909-e520ce640698 req-b0f5346d-e91c-49d2-b18f-a8be2a560943 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:12.114920 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-29fcc133-ec9a-42f6-b909-e520ce640698 req-b0f5346d-e91c-49d2-b18f-a8be2a560943 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:12.137087 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-29fcc133-ec9a-42f6-b909-e520ce640698 req-b0f5346d-e91c-49d2-b18f-a8be2a560943 service nova] Creating event network-changed:d87225ab-6eb7-4ee8-a1ae-be2176c6788c for instance 3d3cabc2-fa23-4098-9197-9aaa19a0c663 on n-h1-850501-14 Oct 04 18:40:12.178677 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-29fcc133-ec9a-42f6-b909-e520ce640698 req-b0f5346d-e91c-49d2-b18f-a8be2a560943 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077982 Oct 04 18:40:12.179744 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1483/2968] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:40:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:40:12.511549 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-30c2b16c-f56a-4db6-bb25-c40d561f95ec tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:12.516484 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=100 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:40:12.535946 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-30c2b16c-f56a-4db6-bb25-c40d561f95ec tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:12.537443 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-30c2b16c-f56a-4db6-bb25-c40d561f95ec tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:12.538919 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-30c2b16c-f56a-4db6-bb25-c40d561f95ec tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] 10.222.0.20 "GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663" status: 200 len: 1881 microversion: 2.42 time: 0.706126 Oct 04 18:40:12.539621 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1486/2969] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:11 2022] GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663 => generated 1881 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:12.551841 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-be8abca4-c186-4c8c-a465-c78fe6518af2 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:12.552717 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-be8abca4-c186-4c8c-a465-c78fe6518af2 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: c343931b-bc96-4e9e-a5ce-f93454339a53] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:12.563463 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-be8abca4-c186-4c8c-a465-c78fe6518af2 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:12.564555 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-be8abca4-c186-4c8c-a465-c78fe6518af2 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:12.573052 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ed24c826-6bdc-4326-a91f-d94aac11c4e3 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-258416685", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": "none"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:40:12.576747 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-be8abca4-c186-4c8c-a465-c78fe6518af2 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:12.577501 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-be8abca4-c186-4c8c-a465-c78fe6518af2 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:12.578023 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-be8abca4-c186-4c8c-a465-c78fe6518af2 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:12.578463 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-be8abca4-c186-4c8c-a465-c78fe6518af2 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:12.670377 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-ed24c826-6bdc-4326-a91f-d94aac11c4e3 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:40:12.673078 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-ed24c826-6bdc-4326-a91f-d94aac11c4e3 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:40:12.673078 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-ed24c826-6bdc-4326-a91f-d94aac11c4e3 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:40:12.673078 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-ed24c826-6bdc-4326-a91f-d94aac11c4e3 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:40:12.673078 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-ed24c826-6bdc-4326-a91f-d94aac11c4e3 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:40:12.683321 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ed24c826-6bdc-4326-a91f-d94aac11c4e3 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:12.684104 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ed24c826-6bdc-4326-a91f-d94aac11c4e3 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:12.684611 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ed24c826-6bdc-4326-a91f-d94aac11c4e3 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:12.685459 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ed24c826-6bdc-4326-a91f-d94aac11c4e3 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:12.685992 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ed24c826-6bdc-4326-a91f-d94aac11c4e3 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:12.686498 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ed24c826-6bdc-4326-a91f-d94aac11c4e3 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:12.727753 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-ed24c826-6bdc-4326-a91f-d94aac11c4e3 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Getting quotas for project 71340ee8abbf4244a72d7d31ff1134dd. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:40:12.737642 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-ed24c826-6bdc-4326-a91f-d94aac11c4e3 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Getting quotas for user d88c151db7fb4ec0a92ca0e655c0d85f and project 71340ee8abbf4244a72d7d31ff1134dd. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:40:12.755391 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ed24c826-6bdc-4326-a91f-d94aac11c4e3 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Going to run 1 instances... {{(pid=123001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:40:12.758752 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ed24c826-6bdc-4326-a91f-d94aac11c4e3 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] [instance: 0212406a-acc5-4631-90e8-03f4409c07f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:40:12.904382 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ed24c826-6bdc-4326-a91f-d94aac11c4e3 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.548930 Oct 04 18:40:12.912801 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1484/2970] 10.222.0.20 () {62 vars in 1188 bytes} [Tue Oct 4 18:40:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 557 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 18:40:12.932710 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f84038ee-e5af-4381-805b-86909c0316e1 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:12.934911 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f84038ee-e5af-4381-805b-86909c0316e1 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] [instance: 6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:12.949780 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f84038ee-e5af-4381-805b-86909c0316e1 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:12.950288 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f84038ee-e5af-4381-805b-86909c0316e1 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:12.950736 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f84038ee-e5af-4381-805b-86909c0316e1 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:12.952102 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f84038ee-e5af-4381-805b-86909c0316e1 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:12.953214 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f84038ee-e5af-4381-805b-86909c0316e1 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:12.953813 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f84038ee-e5af-4381-805b-86909c0316e1 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:13.500242 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f84038ee-e5af-4381-805b-86909c0316e1 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec13a0273819409b8ecba05e9337ec73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6edbe27acbc4c9eba33a6f589f6cf8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:13.511757 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f84038ee-e5af-4381-805b-86909c0316e1 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] 10.222.0.20 "GET /compute/v2.1/servers/6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28" status: 200 len: 1523 microversion: 2.1 time: 0.598539 Oct 04 18:40:13.524785 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1485/2971] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:12 2022] GET /compute/v2.1/servers/6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28 => generated 1523 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:13.530920 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-be8abca4-c186-4c8c-a465-c78fe6518af2 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8358c07e2684b749a62becb9f0b7869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b922a74c1c2448bb770d6b298b2d601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:13.540439 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b057591c-6f8b-46fd-85cb-8bdaf543c269 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:13.541950 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b057591c-6f8b-46fd-85cb-8bdaf543c269 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] [instance: 1b0129be-f5f9-4735-a10a-008bddc30ab4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:13.554872 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b057591c-6f8b-46fd-85cb-8bdaf543c269 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:13.559982 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b057591c-6f8b-46fd-85cb-8bdaf543c269 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:13.559982 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b057591c-6f8b-46fd-85cb-8bdaf543c269 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:13.561540 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-be8abca4-c186-4c8c-a465-c78fe6518af2 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53" status: 200 len: 1471 microversion: 2.1 time: 1.020841 Oct 04 18:40:13.562759 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b057591c-6f8b-46fd-85cb-8bdaf543c269 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:13.563376 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b057591c-6f8b-46fd-85cb-8bdaf543c269 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:13.563594 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1487/2972] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:12 2022] GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53 => generated 1471 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:13.563841 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b057591c-6f8b-46fd-85cb-8bdaf543c269 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:13.569453 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b8d4fd53-7166-486d-b2a8-a2903cf4fed8 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:40:13.575747 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b8d4fd53-7166-486d-b2a8-a2903cf4fed8 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] [instance: 0212406a-acc5-4631-90e8-03f4409c07f1] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:13.778396 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b8d4fd53-7166-486d-b2a8-a2903cf4fed8 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:13.785774 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b057591c-6f8b-46fd-85cb-8bdaf543c269 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:13.795171 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b057591c-6f8b-46fd-85cb-8bdaf543c269 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:13.797704 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b057591c-6f8b-46fd-85cb-8bdaf543c269 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:13.798409 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b8d4fd53-7166-486d-b2a8-a2903cf4fed8 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:13.799986 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b8d4fd53-7166-486d-b2a8-a2903cf4fed8 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:13.804009 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b057591c-6f8b-46fd-85cb-8bdaf543c269 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] 10.222.0.20 "GET /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4" status: 200 len: 1330 microversion: 2.47 time: 0.269550 Oct 04 18:40:13.817645 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1486/2973] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:13 2022] GET /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4 => generated 1330 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:13.823932 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b8d4fd53-7166-486d-b2a8-a2903cf4fed8 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] 10.222.0.20 "PUT /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1" status: 200 len: 1358 microversion: 2.75 time: 0.258224 Oct 04 18:40:13.830472 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1488/2974] 10.222.0.20 () {62 vars in 1297 bytes} [Tue Oct 4 18:40:13 2022] PUT /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1 => generated 1358 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:13.850740 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-dbca3b2b-80b1-4ed8-89e1-7f54f59e7a71 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:13.853684 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-dbca3b2b-80b1-4ed8-89e1-7f54f59e7a71 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] [instance: 3d3cabc2-fa23-4098-9197-9aaa19a0c663] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:13.859179 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-22cab686-7d5a-4747-8fd3-9d0af51547a8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:13.860109 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-22cab686-7d5a-4747-8fd3-9d0af51547a8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2e308f41-242e-4ce3-8641-9510e2f13681] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:13.865134 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dbca3b2b-80b1-4ed8-89e1-7f54f59e7a71 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:13.868755 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dbca3b2b-80b1-4ed8-89e1-7f54f59e7a71 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:13.869466 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dbca3b2b-80b1-4ed8-89e1-7f54f59e7a71 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:13.873946 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dbca3b2b-80b1-4ed8-89e1-7f54f59e7a71 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:13.874637 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dbca3b2b-80b1-4ed8-89e1-7f54f59e7a71 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:13.876459 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dbca3b2b-80b1-4ed8-89e1-7f54f59e7a71 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:13.877125 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-22cab686-7d5a-4747-8fd3-9d0af51547a8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:13.877678 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-22cab686-7d5a-4747-8fd3-9d0af51547a8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:13.878130 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-22cab686-7d5a-4747-8fd3-9d0af51547a8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:13.879026 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-22cab686-7d5a-4747-8fd3-9d0af51547a8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:13.879495 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-22cab686-7d5a-4747-8fd3-9d0af51547a8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:13.879925 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-22cab686-7d5a-4747-8fd3-9d0af51547a8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:13.909731 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-22cab686-7d5a-4747-8fd3-9d0af51547a8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] HTTP exception thrown: Instance 2e308f41-242e-4ce3-8641-9510e2f13681 could not be found. Oct 04 18:40:13.911443 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-22cab686-7d5a-4747-8fd3-9d0af51547a8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Request method failure captured: Oct 04 18:40:13.911443 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681 HTTP/1.1 Oct 04 18:40:13.911443 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:40:13.911443 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:40:13.911443 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:40:13.911443 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:40:13.911443 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:40:13.911443 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:40:13.911443 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:40:13.911443 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:40:13.911443 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPHylsKzjtTxyxS0lRqrj_KKSHumQgnOG3Ln0f2NoBBXSlSndXbgjyNARvMhAdpUmCrlgZVfzLc5kR-MOiq9TLRM9-w_rTnBF0C_aaOdomrRR_ZDdz3aXjH-fV-MvOq-mBrOl495C0svvDTNQlP-eceEwuANK9BqMrZBbw6QMmsoD0uc Oct 04 18:40:13.911443 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:40:13.911443 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:40:13.911443 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:40:13.911443 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:40:13.911443 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:40:13.911443 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:40:13.911443 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 552ab59dabe840cb8582c54bedc49b09 Oct 04 18:40:13.911443 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-MigrationsAdminTest-1038574730 Oct 04 18:40:13.911443 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:40:13.911443 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:40:13.911443 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/552ab59dabe840cb8582c54bedc49b09"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_552ab59dabe840cb8582c54bedc49b09", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/552ab59dabe840cb8582c54bedc49b09"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/552ab59dabe840cb8582c54bedc49b09"}]}] Oct 04 18:40:13.911443 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-MigrationsAdminTest-1038574730 Oct 04 18:40:13.911443 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 552ab59dabe840cb8582c54bedc49b09 Oct 04 18:40:13.911443 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-MigrationsAdminTest-1038574730 Oct 04 18:40:13.911443 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-MigrationsAdminTest-1038574730-project Oct 04 18:40:13.911443 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:40:13.911443 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:40:13.911443 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 9b05d1f8b9014e798926f9c496885a4d Oct 04 18:40:13.911443 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-MigrationsAdminTest-1038574730-project Oct 04 18:40:13.911443 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:40:13.911443 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 2e308f41-242e-4ce3-8641-9510e2f13681 could not be found. Oct 04 18:40:13.911443 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '2e308f41-242e-4ce3-8641-9510e2f13681'} Oct 04 18:40:13.911443 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:40:13.911443 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:13.911443 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:40:13.911443 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:40:13.911443 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:40:13.911443 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:40:13.911443 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:40:13.911443 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:40:13.911443 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:40:13.911443 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:40:13.911443 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e308f41-242e-4ce3-8641-9510e2f13681 could not be found. Oct 04 18:40:13.911443 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:40:13.911443 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:13.911443 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:40:13.911443 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:13.911443 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:40:13.911443 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:40:13.911443 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:40:13.911443 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:40:13.911443 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:40:13.911443 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:40:13.911443 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:40:13.911443 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:40:13.911443 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:40:13.911443 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:40:13.911443 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:40:13.911443 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:40:13.911443 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e308f41-242e-4ce3-8641-9510e2f13681 could not be found. Oct 04 18:40:13.911443 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:40:13.911443 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:13.911443 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:40:13.917226 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:13.917226 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:40:13.917226 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:40:13.917226 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:40:13.917226 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:40:13.917226 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e308f41-242e-4ce3-8641-9510e2f13681 could not be found. Oct 04 18:40:13.917226 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:40:13.917226 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-22cab686-7d5a-4747-8fd3-9d0af51547a8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Returning 404 to user: Instance 2e308f41-242e-4ce3-8641-9510e2f13681 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:40:13.919118 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-22cab686-7d5a-4747-8fd3-9d0af51547a8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681" status: 404 len: 111 microversion: 2.1 time: 0.100016 Oct 04 18:40:13.922714 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1487/2975] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:13 2022] GET /compute/v2.1/servers/2e308f41-242e-4ce3-8641-9510e2f13681 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:40:13.927248 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-51302e3a-fb5b-42de-8658-60f1a68cf564 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:13.927875 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-51302e3a-fb5b-42de-8658-60f1a68cf564 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] [instance: 0212406a-acc5-4631-90e8-03f4409c07f1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:14.051295 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-51302e3a-fb5b-42de-8658-60f1a68cf564 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:14.064993 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-51302e3a-fb5b-42de-8658-60f1a68cf564 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:14.069266 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-51302e3a-fb5b-42de-8658-60f1a68cf564 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:14.086360 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-51302e3a-fb5b-42de-8658-60f1a68cf564 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] 10.222.0.20 "GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1" status: 200 len: 1358 microversion: 2.75 time: 0.163881 Oct 04 18:40:14.090915 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1488/2976] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:13 2022] GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:14.097754 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-50f696de-1064-4ded-a4a5-0d8139f3b3ee tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:14.098255 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-50f696de-1064-4ded-a4a5-0d8139f3b3ee tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 474a799f-8e38-49d6-8fff-9ec3e7657ef5] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:14.119235 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-50f696de-1064-4ded-a4a5-0d8139f3b3ee tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:14.119738 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-50f696de-1064-4ded-a4a5-0d8139f3b3ee tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:14.120278 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-50f696de-1064-4ded-a4a5-0d8139f3b3ee tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:14.121008 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-50f696de-1064-4ded-a4a5-0d8139f3b3ee tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:14.121480 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-50f696de-1064-4ded-a4a5-0d8139f3b3ee tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:14.121903 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-50f696de-1064-4ded-a4a5-0d8139f3b3ee tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:14.169207 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-50f696de-1064-4ded-a4a5-0d8139f3b3ee tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 474a799f-8e38-49d6-8fff-9ec3e7657ef5] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:40:14.339956 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-dbca3b2b-80b1-4ed8-89e1-7f54f59e7a71 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:14.353328 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-dbca3b2b-80b1-4ed8-89e1-7f54f59e7a71 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:14.355191 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-dbca3b2b-80b1-4ed8-89e1-7f54f59e7a71 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:14.356595 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-dbca3b2b-80b1-4ed8-89e1-7f54f59e7a71 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] 10.222.0.20 "GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663" status: 200 len: 1881 microversion: 2.42 time: 0.523234 Oct 04 18:40:14.372209 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1489/2977] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:13 2022] GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663 => generated 1881 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:14.407248 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:40:14.442195 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-fc439977-88c8-4dbc-ae11-910cc8053d13 req-b91c2175-4861-4458-b148-67b41259c019 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d3cabc2-fa23-4098-9197-9aaa19a0c663", "tag": "aa9d4b51-8919-472c-8e30-368ff36799ac"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:40:14.463586 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-fc439977-88c8-4dbc-ae11-910cc8053d13 req-b91c2175-4861-4458-b148-67b41259c019 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:14.465873 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-fc439977-88c8-4dbc-ae11-910cc8053d13 req-b91c2175-4861-4458-b148-67b41259c019 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:14.466491 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-fc439977-88c8-4dbc-ae11-910cc8053d13 req-b91c2175-4861-4458-b148-67b41259c019 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:14.493380 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-fc439977-88c8-4dbc-ae11-910cc8053d13 req-b91c2175-4861-4458-b148-67b41259c019 service nova] Creating event network-changed:aa9d4b51-8919-472c-8e30-368ff36799ac for instance 3d3cabc2-fa23-4098-9197-9aaa19a0c663 on n-h1-850501-14 Oct 04 18:40:14.500454 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-fc439977-88c8-4dbc-ae11-910cc8053d13 req-b91c2175-4861-4458-b148-67b41259c019 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061299 Oct 04 18:40:14.505510 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1490/2978] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:40:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:40:14.542575 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3f25c7a0-a4fb-4b4f-b619-3c846c22ea5f tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:14.544275 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3f25c7a0-a4fb-4b4f-b619-3c846c22ea5f tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] [instance: 6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:14.555656 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f25c7a0-a4fb-4b4f-b619-3c846c22ea5f tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:14.557990 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f25c7a0-a4fb-4b4f-b619-3c846c22ea5f tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:14.560511 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f25c7a0-a4fb-4b4f-b619-3c846c22ea5f tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:14.561499 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f25c7a0-a4fb-4b4f-b619-3c846c22ea5f tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:14.563234 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f25c7a0-a4fb-4b4f-b619-3c846c22ea5f tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:14.569377 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f25c7a0-a4fb-4b4f-b619-3c846c22ea5f tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:14.589174 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-50f696de-1064-4ded-a4a5-0d8139f3b3ee tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "DELETE /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5" status: 204 len: 0 microversion: 2.1 time: 0.496808 Oct 04 18:40:14.590418 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1489/2979] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:40:14 2022] DELETE /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:40:14.596206 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7cc4f254-cf36-4dab-8a8c-7ae159bf5134 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:14.598811 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7cc4f254-cf36-4dab-8a8c-7ae159bf5134 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: c343931b-bc96-4e9e-a5ce-f93454339a53] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:14.616328 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7cc4f254-cf36-4dab-8a8c-7ae159bf5134 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:14.618116 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7cc4f254-cf36-4dab-8a8c-7ae159bf5134 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:14.620582 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7cc4f254-cf36-4dab-8a8c-7ae159bf5134 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:14.621577 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7cc4f254-cf36-4dab-8a8c-7ae159bf5134 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:14.622989 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7cc4f254-cf36-4dab-8a8c-7ae159bf5134 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:14.624305 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7cc4f254-cf36-4dab-8a8c-7ae159bf5134 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:15.131713 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3f25c7a0-a4fb-4b4f-b619-3c846c22ea5f tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec13a0273819409b8ecba05e9337ec73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6edbe27acbc4c9eba33a6f589f6cf8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:15.140545 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3f25c7a0-a4fb-4b4f-b619-3c846c22ea5f tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] 10.222.0.20 "GET /compute/v2.1/servers/6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28" status: 200 len: 1523 microversion: 2.1 time: 0.603065 Oct 04 18:40:15.146090 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1491/2980] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:14 2022] GET /compute/v2.1/servers/6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28 => generated 1523 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:40:15.149604 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ec01ec82-a663-4baa-af2a-5e62079793fb tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:15.150223 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ec01ec82-a663-4baa-af2a-5e62079793fb tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 474a799f-8e38-49d6-8fff-9ec3e7657ef5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:15.170926 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ec01ec82-a663-4baa-af2a-5e62079793fb tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:15.171763 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ec01ec82-a663-4baa-af2a-5e62079793fb tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:15.174777 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ec01ec82-a663-4baa-af2a-5e62079793fb tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:15.174777 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ec01ec82-a663-4baa-af2a-5e62079793fb tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:15.174777 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ec01ec82-a663-4baa-af2a-5e62079793fb tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:15.174777 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ec01ec82-a663-4baa-af2a-5e62079793fb tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:15.249817 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7cc4f254-cf36-4dab-8a8c-7ae159bf5134 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8358c07e2684b749a62becb9f0b7869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b922a74c1c2448bb770d6b298b2d601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:15.259527 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7cc4f254-cf36-4dab-8a8c-7ae159bf5134 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53" status: 200 len: 1471 microversion: 2.1 time: 0.667645 Oct 04 18:40:15.265491 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1490/2981] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:14 2022] GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53 => generated 1471 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:15.276707 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-76e7055c-b61d-4198-81de-e1f018e53a09 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:15.277349 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-76e7055c-b61d-4198-81de-e1f018e53a09 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] [instance: 1b0129be-f5f9-4735-a10a-008bddc30ab4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:15.300189 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-76e7055c-b61d-4198-81de-e1f018e53a09 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:15.300725 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-76e7055c-b61d-4198-81de-e1f018e53a09 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:15.302945 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-76e7055c-b61d-4198-81de-e1f018e53a09 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:15.303754 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-76e7055c-b61d-4198-81de-e1f018e53a09 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:15.304340 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-76e7055c-b61d-4198-81de-e1f018e53a09 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:15.307515 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-76e7055c-b61d-4198-81de-e1f018e53a09 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:15.347173 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:40:15.481929 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-76e7055c-b61d-4198-81de-e1f018e53a09 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:15.491447 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-76e7055c-b61d-4198-81de-e1f018e53a09 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:15.493843 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-76e7055c-b61d-4198-81de-e1f018e53a09 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:15.495248 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-76e7055c-b61d-4198-81de-e1f018e53a09 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] 10.222.0.20 "GET /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4" status: 200 len: 1348 microversion: 2.47 time: 0.228560 Oct 04 18:40:15.496368 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1491/2982] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:15 2022] GET /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4 => generated 1348 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:15.501006 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9ca7b0b8-27a1-4345-a3a6-c22cb680b3d9 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:15.501902 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-9ca7b0b8-27a1-4345-a3a6-c22cb680b3d9 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] [instance: 0212406a-acc5-4631-90e8-03f4409c07f1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:15.509323 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9ca7b0b8-27a1-4345-a3a6-c22cb680b3d9 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:15.510079 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9ca7b0b8-27a1-4345-a3a6-c22cb680b3d9 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:15.510754 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9ca7b0b8-27a1-4345-a3a6-c22cb680b3d9 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:15.511677 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9ca7b0b8-27a1-4345-a3a6-c22cb680b3d9 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:15.512395 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9ca7b0b8-27a1-4345-a3a6-c22cb680b3d9 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:15.513039 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9ca7b0b8-27a1-4345-a3a6-c22cb680b3d9 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:15.657647 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9ca7b0b8-27a1-4345-a3a6-c22cb680b3d9 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:15.670328 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ec01ec82-a663-4baa-af2a-5e62079793fb tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:15.687363 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9ca7b0b8-27a1-4345-a3a6-c22cb680b3d9 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:15.694557 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9ca7b0b8-27a1-4345-a3a6-c22cb680b3d9 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:15.695822 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ec01ec82-a663-4baa-af2a-5e62079793fb tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5" status: 200 len: 1534 microversion: 2.1 time: 0.537543 Oct 04 18:40:15.696953 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1492/2983] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:15 2022] GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5 => generated 1534 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:15.702551 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-544af2bf-520e-4ec1-b0a2-783899262d0c tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:15.703431 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-544af2bf-520e-4ec1-b0a2-783899262d0c tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] [instance: 3d3cabc2-fa23-4098-9197-9aaa19a0c663] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:15.704769 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9ca7b0b8-27a1-4345-a3a6-c22cb680b3d9 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] 10.222.0.20 "GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1" status: 200 len: 1410 microversion: 2.75 time: 0.207126 Oct 04 18:40:15.732864 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1492/2984] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:15 2022] GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1 => generated 1410 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:15.750056 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-544af2bf-520e-4ec1-b0a2-783899262d0c tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:15.750667 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-544af2bf-520e-4ec1-b0a2-783899262d0c tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:15.751631 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-544af2bf-520e-4ec1-b0a2-783899262d0c tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:15.754602 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-544af2bf-520e-4ec1-b0a2-783899262d0c tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:15.758385 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-544af2bf-520e-4ec1-b0a2-783899262d0c tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:15.759374 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-544af2bf-520e-4ec1-b0a2-783899262d0c tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:16.178153 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0be100b5-480e-47ae-9d27-eb729a255b3e tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:16.178792 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0be100b5-480e-47ae-9d27-eb729a255b3e tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] [instance: 6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:16.202417 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0be100b5-480e-47ae-9d27-eb729a255b3e tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:16.202911 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0be100b5-480e-47ae-9d27-eb729a255b3e tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:16.203353 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0be100b5-480e-47ae-9d27-eb729a255b3e tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:16.204199 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0be100b5-480e-47ae-9d27-eb729a255b3e tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:16.204647 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0be100b5-480e-47ae-9d27-eb729a255b3e tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:16.205243 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0be100b5-480e-47ae-9d27-eb729a255b3e tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:16.511136 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-544af2bf-520e-4ec1-b0a2-783899262d0c tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:16.528742 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-544af2bf-520e-4ec1-b0a2-783899262d0c tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:16.530205 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-544af2bf-520e-4ec1-b0a2-783899262d0c tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:16.532989 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-544af2bf-520e-4ec1-b0a2-783899262d0c tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] 10.222.0.20 "GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663" status: 200 len: 1881 microversion: 2.42 time: 0.834792 Oct 04 18:40:16.535642 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1493/2985] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:15 2022] GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663 => generated 1881 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:16.540580 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-890a398f-1bc3-4b5b-914e-10da2642b979 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:16.550165 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-890a398f-1bc3-4b5b-914e-10da2642b979 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: c343931b-bc96-4e9e-a5ce-f93454339a53] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:16.553411 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:40:16.568526 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-890a398f-1bc3-4b5b-914e-10da2642b979 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:16.569143 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-890a398f-1bc3-4b5b-914e-10da2642b979 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:16.569615 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-890a398f-1bc3-4b5b-914e-10da2642b979 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:16.570523 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-890a398f-1bc3-4b5b-914e-10da2642b979 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:16.571082 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-890a398f-1bc3-4b5b-914e-10da2642b979 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:16.571700 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-890a398f-1bc3-4b5b-914e-10da2642b979 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:16.699230 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0be100b5-480e-47ae-9d27-eb729a255b3e tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec13a0273819409b8ecba05e9337ec73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6edbe27acbc4c9eba33a6f589f6cf8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:16.705481 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0be100b5-480e-47ae-9d27-eb729a255b3e tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] 10.222.0.20 "GET /compute/v2.1/servers/6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28" status: 200 len: 1523 microversion: 2.1 time: 0.538829 Oct 04 18:40:16.706327 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1493/2986] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:16 2022] GET /compute/v2.1/servers/6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28 => generated 1523 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:16.732871 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-22d28f67-7fe6-4948-866b-4fb651cead6d tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:16.733749 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-22d28f67-7fe6-4948-866b-4fb651cead6d tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] [instance: 1b0129be-f5f9-4735-a10a-008bddc30ab4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:16.740187 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-22d28f67-7fe6-4948-866b-4fb651cead6d tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:16.740854 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-22d28f67-7fe6-4948-866b-4fb651cead6d tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:16.741452 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-22d28f67-7fe6-4948-866b-4fb651cead6d tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:16.742425 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-22d28f67-7fe6-4948-866b-4fb651cead6d tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:16.743049 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-22d28f67-7fe6-4948-866b-4fb651cead6d tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:16.743657 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-22d28f67-7fe6-4948-866b-4fb651cead6d tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:16.908363 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-22d28f67-7fe6-4948-866b-4fb651cead6d tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:16.951535 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-22d28f67-7fe6-4948-866b-4fb651cead6d tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:16.951535 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-22d28f67-7fe6-4948-866b-4fb651cead6d tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:16.951535 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-22d28f67-7fe6-4948-866b-4fb651cead6d tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] 10.222.0.20 "GET /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4" status: 200 len: 1336 microversion: 2.47 time: 0.243614 Oct 04 18:40:16.952148 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1494/2987] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:16 2022] GET /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4 => generated 1336 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:16.960362 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0805f992-ef6e-4d90-b4a6-63ec091f37f8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:16.961365 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0805f992-ef6e-4d90-b4a6-63ec091f37f8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 474a799f-8e38-49d6-8fff-9ec3e7657ef5] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:16.968566 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0805f992-ef6e-4d90-b4a6-63ec091f37f8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:16.969270 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0805f992-ef6e-4d90-b4a6-63ec091f37f8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:16.970519 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0805f992-ef6e-4d90-b4a6-63ec091f37f8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:16.971441 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0805f992-ef6e-4d90-b4a6-63ec091f37f8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:16.972134 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0805f992-ef6e-4d90-b4a6-63ec091f37f8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:16.972806 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0805f992-ef6e-4d90-b4a6-63ec091f37f8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:17.016619 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-890a398f-1bc3-4b5b-914e-10da2642b979 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8358c07e2684b749a62becb9f0b7869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b922a74c1c2448bb770d6b298b2d601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:17.026204 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-890a398f-1bc3-4b5b-914e-10da2642b979 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53" status: 200 len: 1471 microversion: 2.1 time: 0.489293 Oct 04 18:40:17.040320 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1494/2988] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:16 2022] GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53 => generated 1471 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:17.047410 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0b7d43fa-d132-4239-911d-0d30afe10388 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:17.048132 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0b7d43fa-d132-4239-911d-0d30afe10388 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] [instance: 0212406a-acc5-4631-90e8-03f4409c07f1] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:17.061142 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0b7d43fa-d132-4239-911d-0d30afe10388 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:17.062044 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0b7d43fa-d132-4239-911d-0d30afe10388 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:17.062704 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0b7d43fa-d132-4239-911d-0d30afe10388 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:17.063782 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0b7d43fa-d132-4239-911d-0d30afe10388 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:17.064900 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0b7d43fa-d132-4239-911d-0d30afe10388 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:17.065547 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0b7d43fa-d132-4239-911d-0d30afe10388 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:17.211933 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0b7d43fa-d132-4239-911d-0d30afe10388 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:17.222323 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0b7d43fa-d132-4239-911d-0d30afe10388 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:17.224020 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0b7d43fa-d132-4239-911d-0d30afe10388 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:17.232244 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0b7d43fa-d132-4239-911d-0d30afe10388 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] 10.222.0.20 "GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1" status: 200 len: 1416 microversion: 2.75 time: 0.203173 Oct 04 18:40:17.233398 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1495/2989] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:17 2022] GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1 => generated 1416 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:17.568126 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ad00f0df-3b59-4077-8c26-2ee14ece7d3d tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:17.568672 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ad00f0df-3b59-4077-8c26-2ee14ece7d3d tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] [instance: 3d3cabc2-fa23-4098-9197-9aaa19a0c663] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:17.576425 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ad00f0df-3b59-4077-8c26-2ee14ece7d3d tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:17.576917 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ad00f0df-3b59-4077-8c26-2ee14ece7d3d tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:17.577350 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ad00f0df-3b59-4077-8c26-2ee14ece7d3d tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:17.578062 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ad00f0df-3b59-4077-8c26-2ee14ece7d3d tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:17.578508 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ad00f0df-3b59-4077-8c26-2ee14ece7d3d tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:17.578926 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ad00f0df-3b59-4077-8c26-2ee14ece7d3d tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:17.784444 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0805f992-ef6e-4d90-b4a6-63ec091f37f8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:17.788196 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=10 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:40:17.813234 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0805f992-ef6e-4d90-b4a6-63ec091f37f8 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5" status: 200 len: 1534 microversion: 2.1 time: 0.859362 Oct 04 18:40:17.821734 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1495/2990] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:16 2022] GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5 => generated 1534 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:17.832544 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-364660e8-6a8c-4bcc-8565-7caaa3864f80 req-7ccc3167-2abd-4900-bb4f-6453d412b6dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d3cabc2-fa23-4098-9197-9aaa19a0c663", "tag": "9a5dee2f-2802-439b-91ce-95cc489ce2fb"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:40:17.848412 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-364660e8-6a8c-4bcc-8565-7caaa3864f80 req-7ccc3167-2abd-4900-bb4f-6453d412b6dd service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:17.849647 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-364660e8-6a8c-4bcc-8565-7caaa3864f80 req-7ccc3167-2abd-4900-bb4f-6453d412b6dd service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:17.850735 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-364660e8-6a8c-4bcc-8565-7caaa3864f80 req-7ccc3167-2abd-4900-bb4f-6453d412b6dd service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:17.874297 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-364660e8-6a8c-4bcc-8565-7caaa3864f80 req-7ccc3167-2abd-4900-bb4f-6453d412b6dd service nova] Creating event network-changed:9a5dee2f-2802-439b-91ce-95cc489ce2fb for instance 3d3cabc2-fa23-4098-9197-9aaa19a0c663 on n-h1-850501-14 Oct 04 18:40:17.883443 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-364660e8-6a8c-4bcc-8565-7caaa3864f80 req-7ccc3167-2abd-4900-bb4f-6453d412b6dd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064469 Oct 04 18:40:17.884677 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1496/2991] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:40:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:40:17.896000 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9663850e-c5c1-4afe-be0e-cda82f7b966e tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:17.896000 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-9663850e-c5c1-4afe-be0e-cda82f7b966e tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] [instance: 6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:17.904695 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9663850e-c5c1-4afe-be0e-cda82f7b966e tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:17.905277 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9663850e-c5c1-4afe-be0e-cda82f7b966e tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:17.905805 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9663850e-c5c1-4afe-be0e-cda82f7b966e tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:17.906579 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9663850e-c5c1-4afe-be0e-cda82f7b966e tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:17.907106 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9663850e-c5c1-4afe-be0e-cda82f7b966e tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:17.907601 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9663850e-c5c1-4afe-be0e-cda82f7b966e tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:18.058061 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ad00f0df-3b59-4077-8c26-2ee14ece7d3d tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:18.070901 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ad00f0df-3b59-4077-8c26-2ee14ece7d3d tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:18.073291 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ad00f0df-3b59-4077-8c26-2ee14ece7d3d tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:18.075095 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ad00f0df-3b59-4077-8c26-2ee14ece7d3d tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] 10.222.0.20 "GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663" status: 200 len: 1881 microversion: 2.42 time: 0.511793 Oct 04 18:40:18.080185 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1496/2992] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:17 2022] GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663 => generated 1881 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:40:18.088594 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b5135fdf-909f-4366-8958-4424864796b7 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:18.091026 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b5135fdf-909f-4366-8958-4424864796b7 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] [instance: 1b0129be-f5f9-4735-a10a-008bddc30ab4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:18.098723 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b5135fdf-909f-4366-8958-4424864796b7 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:18.099502 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b5135fdf-909f-4366-8958-4424864796b7 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:18.099944 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b5135fdf-909f-4366-8958-4424864796b7 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:18.101084 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b5135fdf-909f-4366-8958-4424864796b7 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:18.101907 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b5135fdf-909f-4366-8958-4424864796b7 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:18.102336 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b5135fdf-909f-4366-8958-4424864796b7 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:18.178163 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9663850e-c5c1-4afe-be0e-cda82f7b966e tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec13a0273819409b8ecba05e9337ec73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6edbe27acbc4c9eba33a6f589f6cf8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:18.198510 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9663850e-c5c1-4afe-be0e-cda82f7b966e tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] 10.222.0.20 "GET /compute/v2.1/servers/6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28" status: 200 len: 1523 microversion: 2.1 time: 0.312380 Oct 04 18:40:18.199104 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1497/2993] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:17 2022] GET /compute/v2.1/servers/6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28 => generated 1523 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:18.203994 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b2a32209-e354-4bc1-a80b-b8ea52cca7e1 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:18.204913 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b2a32209-e354-4bc1-a80b-b8ea52cca7e1 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: c343931b-bc96-4e9e-a5ce-f93454339a53] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:18.228621 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b2a32209-e354-4bc1-a80b-b8ea52cca7e1 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:18.229435 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b2a32209-e354-4bc1-a80b-b8ea52cca7e1 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:18.230056 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b2a32209-e354-4bc1-a80b-b8ea52cca7e1 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:18.230947 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b2a32209-e354-4bc1-a80b-b8ea52cca7e1 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:18.231556 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b2a32209-e354-4bc1-a80b-b8ea52cca7e1 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:18.232173 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b2a32209-e354-4bc1-a80b-b8ea52cca7e1 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:18.270966 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b5135fdf-909f-4366-8958-4424864796b7 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:18.282317 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b5135fdf-909f-4366-8958-4424864796b7 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:18.285864 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b5135fdf-909f-4366-8958-4424864796b7 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:18.287452 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b5135fdf-909f-4366-8958-4424864796b7 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] 10.222.0.20 "GET /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4" status: 200 len: 1336 microversion: 2.47 time: 0.205911 Oct 04 18:40:18.313521 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1497/2994] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:18 2022] GET /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4 => generated 1336 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:18.339202 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-cb97f911-3757-4b2f-82c4-249aa7f92dcc tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:18.339783 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-cb97f911-3757-4b2f-82c4-249aa7f92dcc tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] [instance: 0212406a-acc5-4631-90e8-03f4409c07f1] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:18.360209 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cb97f911-3757-4b2f-82c4-249aa7f92dcc tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:18.360209 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cb97f911-3757-4b2f-82c4-249aa7f92dcc tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:18.360209 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cb97f911-3757-4b2f-82c4-249aa7f92dcc tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:18.360209 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cb97f911-3757-4b2f-82c4-249aa7f92dcc tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:18.360515 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cb97f911-3757-4b2f-82c4-249aa7f92dcc tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:18.361594 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cb97f911-3757-4b2f-82c4-249aa7f92dcc tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:18.580378 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b2a32209-e354-4bc1-a80b-b8ea52cca7e1 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8358c07e2684b749a62becb9f0b7869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b922a74c1c2448bb770d6b298b2d601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:18.591601 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b2a32209-e354-4bc1-a80b-b8ea52cca7e1 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53" status: 200 len: 1471 microversion: 2.1 time: 0.390965 Oct 04 18:40:18.594014 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-cb97f911-3757-4b2f-82c4-249aa7f92dcc tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:18.607226 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-cb97f911-3757-4b2f-82c4-249aa7f92dcc tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:18.608711 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-cb97f911-3757-4b2f-82c4-249aa7f92dcc tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:18.608868 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1498/2995] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:18 2022] GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53 => generated 1471 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:18.628501 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-cb97f911-3757-4b2f-82c4-249aa7f92dcc tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] 10.222.0.20 "GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1" status: 200 len: 1416 microversion: 2.75 time: 0.313060 Oct 04 18:40:18.629586 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1498/2996] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:18 2022] GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1 => generated 1416 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:18.844957 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c5120d08-5ec5-4e7b-b11e-973d3d8f1960 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:18.845482 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c5120d08-5ec5-4e7b-b11e-973d3d8f1960 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 474a799f-8e38-49d6-8fff-9ec3e7657ef5] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:18.853908 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c5120d08-5ec5-4e7b-b11e-973d3d8f1960 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:18.857653 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c5120d08-5ec5-4e7b-b11e-973d3d8f1960 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:18.858104 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c5120d08-5ec5-4e7b-b11e-973d3d8f1960 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:18.858829 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c5120d08-5ec5-4e7b-b11e-973d3d8f1960 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:18.859632 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c5120d08-5ec5-4e7b-b11e-973d3d8f1960 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:18.860267 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c5120d08-5ec5-4e7b-b11e-973d3d8f1960 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:18.986290 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c5120d08-5ec5-4e7b-b11e-973d3d8f1960 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:18.997765 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c5120d08-5ec5-4e7b-b11e-973d3d8f1960 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5" status: 200 len: 1492 microversion: 2.1 time: 0.156787 Oct 04 18:40:19.000255 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1499/2997] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:18 2022] GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5 => generated 1492 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:19.104926 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1ceceb81-0c96-46a2-874b-c140d01672dd tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:19.107189 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1ceceb81-0c96-46a2-874b-c140d01672dd tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] [instance: 3d3cabc2-fa23-4098-9197-9aaa19a0c663] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:19.120419 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1ceceb81-0c96-46a2-874b-c140d01672dd tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:19.121399 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1ceceb81-0c96-46a2-874b-c140d01672dd tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:19.122065 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1ceceb81-0c96-46a2-874b-c140d01672dd tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:19.122964 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1ceceb81-0c96-46a2-874b-c140d01672dd tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:19.123973 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1ceceb81-0c96-46a2-874b-c140d01672dd tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:19.124583 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1ceceb81-0c96-46a2-874b-c140d01672dd tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:19.225721 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3cf8aa83-530a-430e-9f89-7201ca1599d3 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:19.227433 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3cf8aa83-530a-430e-9f89-7201ca1599d3 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] [instance: 6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:19.239290 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3cf8aa83-530a-430e-9f89-7201ca1599d3 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:19.244322 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3cf8aa83-530a-430e-9f89-7201ca1599d3 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:19.245507 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3cf8aa83-530a-430e-9f89-7201ca1599d3 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:19.246614 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3cf8aa83-530a-430e-9f89-7201ca1599d3 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:19.247315 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3cf8aa83-530a-430e-9f89-7201ca1599d3 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:19.248166 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3cf8aa83-530a-430e-9f89-7201ca1599d3 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:19.528823 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1ceceb81-0c96-46a2-874b-c140d01672dd tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:19.539504 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1ceceb81-0c96-46a2-874b-c140d01672dd tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:19.541347 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1ceceb81-0c96-46a2-874b-c140d01672dd tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:19.542733 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1ceceb81-0c96-46a2-874b-c140d01672dd tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] 10.222.0.20 "GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663" status: 200 len: 1869 microversion: 2.42 time: 0.444388 Oct 04 18:40:19.543456 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1499/2998] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:19 2022] GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663 => generated 1869 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:19.564716 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3cf8aa83-530a-430e-9f89-7201ca1599d3 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec13a0273819409b8ecba05e9337ec73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6edbe27acbc4c9eba33a6f589f6cf8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:19.567534 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-49d62c73-4863-40e2-a1ab-ae7710ee2954 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:19.570971 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-49d62c73-4863-40e2-a1ab-ae7710ee2954 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] [instance: 1b0129be-f5f9-4735-a10a-008bddc30ab4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:19.573662 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3cf8aa83-530a-430e-9f89-7201ca1599d3 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] 10.222.0.20 "GET /compute/v2.1/servers/6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28" status: 200 len: 1523 microversion: 2.1 time: 0.354125 Oct 04 18:40:19.574673 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1500/2999] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:19 2022] GET /compute/v2.1/servers/6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28 => generated 1523 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:40:19.578880 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-49d62c73-4863-40e2-a1ab-ae7710ee2954 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:19.579605 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-49d62c73-4863-40e2-a1ab-ae7710ee2954 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:19.580179 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-49d62c73-4863-40e2-a1ab-ae7710ee2954 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:19.580979 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-49d62c73-4863-40e2-a1ab-ae7710ee2954 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:19.582157 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-49d62c73-4863-40e2-a1ab-ae7710ee2954 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:19.582679 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-49d62c73-4863-40e2-a1ab-ae7710ee2954 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:19.616234 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4b418efa-2e27-46a8-bf74-44e6afc8269d tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:19.617941 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-4b418efa-2e27-46a8-bf74-44e6afc8269d tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: c343931b-bc96-4e9e-a5ce-f93454339a53] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:19.633164 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4b418efa-2e27-46a8-bf74-44e6afc8269d tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:19.633164 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4b418efa-2e27-46a8-bf74-44e6afc8269d tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:19.633164 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4b418efa-2e27-46a8-bf74-44e6afc8269d tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:19.633842 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4b418efa-2e27-46a8-bf74-44e6afc8269d tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:19.634296 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4b418efa-2e27-46a8-bf74-44e6afc8269d tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:19.634810 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4b418efa-2e27-46a8-bf74-44e6afc8269d tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:19.656367 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-49d62c73-4863-40e2-a1ab-ae7710ee2954 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:19.669885 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-49d62c73-4863-40e2-a1ab-ae7710ee2954 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:19.671504 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-49d62c73-4863-40e2-a1ab-ae7710ee2954 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:19.672993 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-49d62c73-4863-40e2-a1ab-ae7710ee2954 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] 10.222.0.20 "GET /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4" status: 200 len: 1336 microversion: 2.47 time: 0.115382 Oct 04 18:40:19.674146 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1500/3000] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:19 2022] GET /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4 => generated 1336 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:19.680033 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0cceac8c-f3ff-42f4-a632-c2bd15bb8244 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:19.680998 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0cceac8c-f3ff-42f4-a632-c2bd15bb8244 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] [instance: 0212406a-acc5-4631-90e8-03f4409c07f1] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:19.687946 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0cceac8c-f3ff-42f4-a632-c2bd15bb8244 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:19.688784 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0cceac8c-f3ff-42f4-a632-c2bd15bb8244 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:19.689713 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0cceac8c-f3ff-42f4-a632-c2bd15bb8244 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:19.690665 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0cceac8c-f3ff-42f4-a632-c2bd15bb8244 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:19.691294 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0cceac8c-f3ff-42f4-a632-c2bd15bb8244 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:19.691934 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0cceac8c-f3ff-42f4-a632-c2bd15bb8244 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:19.780773 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0cceac8c-f3ff-42f4-a632-c2bd15bb8244 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:19.790148 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0cceac8c-f3ff-42f4-a632-c2bd15bb8244 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:19.791819 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0cceac8c-f3ff-42f4-a632-c2bd15bb8244 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:19.797250 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0cceac8c-f3ff-42f4-a632-c2bd15bb8244 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] 10.222.0.20 "GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1" status: 200 len: 1437 microversion: 2.75 time: 0.121793 Oct 04 18:40:19.797838 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1501/3001] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:19 2022] GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1 => generated 1437 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:19.835899 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-12ccc0bf-3bbe-439d-9989-9606644fa077 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:40:19.839933 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-12ccc0bf-3bbe-439d-9989-9606644fa077 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] [instance: 0212406a-acc5-4631-90e8-03f4409c07f1] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:19.847012 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-12ccc0bf-3bbe-439d-9989-9606644fa077 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:19.847768 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-12ccc0bf-3bbe-439d-9989-9606644fa077 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:19.848454 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-12ccc0bf-3bbe-439d-9989-9606644fa077 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:19.849354 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-12ccc0bf-3bbe-439d-9989-9606644fa077 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:19.849807 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-12ccc0bf-3bbe-439d-9989-9606644fa077 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:19.850225 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-12ccc0bf-3bbe-439d-9989-9606644fa077 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:19.869098 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-4b418efa-2e27-46a8-bf74-44e6afc8269d tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8358c07e2684b749a62becb9f0b7869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b922a74c1c2448bb770d6b298b2d601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:19.877720 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-4b418efa-2e27-46a8-bf74-44e6afc8269d tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53" status: 200 len: 1471 microversion: 2.1 time: 0.265441 Oct 04 18:40:19.896514 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1501/3002] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:19 2022] GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53 => generated 1471 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:40:19.907353 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-ce75fd4b-7b61-422b-9ef7-ea94c2013f2c req-6d96a95a-21a0-4326-ab41-92c1f7ca6726 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "474a799f-8e38-49d6-8fff-9ec3e7657ef5", "name": "network-vif-deleted", "tag": "a0d7cb42-218d-4bf1-adab-5dbf22e8ab22"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:40:19.922452 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-ce75fd4b-7b61-422b-9ef7-ea94c2013f2c req-6d96a95a-21a0-4326-ab41-92c1f7ca6726 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:19.923409 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-ce75fd4b-7b61-422b-9ef7-ea94c2013f2c req-6d96a95a-21a0-4326-ab41-92c1f7ca6726 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:19.923975 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-ce75fd4b-7b61-422b-9ef7-ea94c2013f2c req-6d96a95a-21a0-4326-ab41-92c1f7ca6726 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:19.943459 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-ce75fd4b-7b61-422b-9ef7-ea94c2013f2c req-6d96a95a-21a0-4326-ab41-92c1f7ca6726 service nova] Creating event network-vif-deleted:a0d7cb42-218d-4bf1-adab-5dbf22e8ab22 for instance 474a799f-8e38-49d6-8fff-9ec3e7657ef5 on n-h2-850501-14 Oct 04 18:40:19.946997 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-ce75fd4b-7b61-422b-9ef7-ea94c2013f2c req-6d96a95a-21a0-4326-ab41-92c1f7ca6726 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044178 Oct 04 18:40:19.947766 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1502/3003] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:40:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:40:19.990697 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-12ccc0bf-3bbe-439d-9989-9606644fa077 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:40:19.991395 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-12ccc0bf-3bbe-439d-9989-9606644fa077 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:40:19.992608 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-12ccc0bf-3bbe-439d-9989-9606644fa077 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:40:19.993269 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-12ccc0bf-3bbe-439d-9989-9606644fa077 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:40:19.993914 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-12ccc0bf-3bbe-439d-9989-9606644fa077 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:40:20.028812 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9c81c682-aabc-409d-8aee-d9e5e9687afb tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:20.028812 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-9c81c682-aabc-409d-8aee-d9e5e9687afb tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 474a799f-8e38-49d6-8fff-9ec3e7657ef5] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:20.035910 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9c81c682-aabc-409d-8aee-d9e5e9687afb tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:20.037801 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9c81c682-aabc-409d-8aee-d9e5e9687afb tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:20.037946 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9c81c682-aabc-409d-8aee-d9e5e9687afb tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:20.039892 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9c81c682-aabc-409d-8aee-d9e5e9687afb tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:20.040389 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9c81c682-aabc-409d-8aee-d9e5e9687afb tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:20.040895 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9c81c682-aabc-409d-8aee-d9e5e9687afb tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:20.113123 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9c81c682-aabc-409d-8aee-d9e5e9687afb tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:20.124843 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9c81c682-aabc-409d-8aee-d9e5e9687afb tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5" status: 200 len: 1363 microversion: 2.1 time: 0.102839 Oct 04 18:40:20.132352 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1503/3004] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:20 2022] GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5 => generated 1363 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:40:20.214294 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-12ccc0bf-3bbe-439d-9989-9606644fa077 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] [instance: 0212406a-acc5-4631-90e8-03f4409c07f1] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:20.221122 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-12ccc0bf-3bbe-439d-9989-9606644fa077 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:20.221614 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-12ccc0bf-3bbe-439d-9989-9606644fa077 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:20.222277 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-12ccc0bf-3bbe-439d-9989-9606644fa077 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:20.223348 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-12ccc0bf-3bbe-439d-9989-9606644fa077 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:20.224003 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-12ccc0bf-3bbe-439d-9989-9606644fa077 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:20.224638 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-12ccc0bf-3bbe-439d-9989-9606644fa077 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:20.302890 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-12ccc0bf-3bbe-439d-9989-9606644fa077 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:20.308191 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:40:20.315192 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-12ccc0bf-3bbe-439d-9989-9606644fa077 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:20.317360 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-12ccc0bf-3bbe-439d-9989-9606644fa077 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:20.325208 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-12ccc0bf-3bbe-439d-9989-9606644fa077 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] 10.222.0.20 "POST /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1/action" status: 202 len: 1494 microversion: 2.75 time: 0.500145 Oct 04 18:40:20.336082 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1502/3005] 10.222.0.20 () {62 vars in 1319 bytes} [Tue Oct 4 18:40:19 2022] POST /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1/action => generated 1494 bytes in 502 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 04 18:40:20.356425 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8cacf925-bb9d-456e-b3b7-d9e7ff6fd6e7 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:20.357040 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8cacf925-bb9d-456e-b3b7-d9e7ff6fd6e7 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] [instance: 0212406a-acc5-4631-90e8-03f4409c07f1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:20.363910 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8cacf925-bb9d-456e-b3b7-d9e7ff6fd6e7 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:20.364505 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8cacf925-bb9d-456e-b3b7-d9e7ff6fd6e7 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:20.364976 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8cacf925-bb9d-456e-b3b7-d9e7ff6fd6e7 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:20.365709 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8cacf925-bb9d-456e-b3b7-d9e7ff6fd6e7 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:20.366167 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8cacf925-bb9d-456e-b3b7-d9e7ff6fd6e7 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:20.366617 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8cacf925-bb9d-456e-b3b7-d9e7ff6fd6e7 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:20.446833 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8cacf925-bb9d-456e-b3b7-d9e7ff6fd6e7 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:20.456653 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8cacf925-bb9d-456e-b3b7-d9e7ff6fd6e7 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:20.458473 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8cacf925-bb9d-456e-b3b7-d9e7ff6fd6e7 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:20.465013 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8cacf925-bb9d-456e-b3b7-d9e7ff6fd6e7 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] 10.222.0.20 "GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1" status: 200 len: 1446 microversion: 2.75 time: 0.112480 Oct 04 18:40:20.466273 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1504/3006] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:20 2022] GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1 => generated 1446 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:20.573249 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-fd33db69-4ccb-4dd3-9132-ffbbc54c5bfc tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:20.574002 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-fd33db69-4ccb-4dd3-9132-ffbbc54c5bfc tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] [instance: 3d3cabc2-fa23-4098-9197-9aaa19a0c663] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:20.580326 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fd33db69-4ccb-4dd3-9132-ffbbc54c5bfc tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:20.580814 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fd33db69-4ccb-4dd3-9132-ffbbc54c5bfc tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:20.581249 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fd33db69-4ccb-4dd3-9132-ffbbc54c5bfc tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:20.581943 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fd33db69-4ccb-4dd3-9132-ffbbc54c5bfc tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:20.582396 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fd33db69-4ccb-4dd3-9132-ffbbc54c5bfc tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:20.582820 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fd33db69-4ccb-4dd3-9132-ffbbc54c5bfc tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:20.597410 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-41d63132-1c5d-4598-affc-f02f49816123 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:20.598027 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-41d63132-1c5d-4598-affc-f02f49816123 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] [instance: 6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:20.606043 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-41d63132-1c5d-4598-affc-f02f49816123 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:20.606546 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-41d63132-1c5d-4598-affc-f02f49816123 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:20.607166 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-41d63132-1c5d-4598-affc-f02f49816123 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:20.607765 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-41d63132-1c5d-4598-affc-f02f49816123 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:20.608257 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-41d63132-1c5d-4598-affc-f02f49816123 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:20.611077 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-41d63132-1c5d-4598-affc-f02f49816123 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:20.898333 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-fd33db69-4ccb-4dd3-9132-ffbbc54c5bfc tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:20.906027 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-fd33db69-4ccb-4dd3-9132-ffbbc54c5bfc tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:20.916392 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-41d63132-1c5d-4598-affc-f02f49816123 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec13a0273819409b8ecba05e9337ec73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6edbe27acbc4c9eba33a6f589f6cf8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:20.925423 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-41d63132-1c5d-4598-affc-f02f49816123 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] 10.222.0.20 "GET /compute/v2.1/servers/6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28" status: 200 len: 1523 microversion: 2.1 time: 0.331906 Oct 04 18:40:20.926010 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1505/3007] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:20 2022] GET /compute/v2.1/servers/6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28 => generated 1523 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:20.927030 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-fd33db69-4ccb-4dd3-9132-ffbbc54c5bfc tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:20.928472 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-fd33db69-4ccb-4dd3-9132-ffbbc54c5bfc tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] 10.222.0.20 "GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663" status: 200 len: 1869 microversion: 2.42 time: 0.360567 Oct 04 18:40:20.946611 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1503/3008] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:20 2022] GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663 => generated 1869 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:20.954632 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0b799500-c1a1-48fa-952d-187a69de0479 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:20.955278 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0b799500-c1a1-48fa-952d-187a69de0479 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] [instance: 1b0129be-f5f9-4735-a10a-008bddc30ab4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:20.959761 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-bd9370bd-8b56-4319-8976-020f14f8f756 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:20.961197 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-bd9370bd-8b56-4319-8976-020f14f8f756 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: c343931b-bc96-4e9e-a5ce-f93454339a53] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:20.970583 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bd9370bd-8b56-4319-8976-020f14f8f756 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:20.971352 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bd9370bd-8b56-4319-8976-020f14f8f756 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:20.971796 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bd9370bd-8b56-4319-8976-020f14f8f756 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:20.972543 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bd9370bd-8b56-4319-8976-020f14f8f756 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:20.973001 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bd9370bd-8b56-4319-8976-020f14f8f756 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:20.973540 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0b799500-c1a1-48fa-952d-187a69de0479 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:20.974373 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0b799500-c1a1-48fa-952d-187a69de0479 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:20.974598 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bd9370bd-8b56-4319-8976-020f14f8f756 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:20.974874 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0b799500-c1a1-48fa-952d-187a69de0479 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:20.975607 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0b799500-c1a1-48fa-952d-187a69de0479 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:20.981064 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0b799500-c1a1-48fa-952d-187a69de0479 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:20.981638 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0b799500-c1a1-48fa-952d-187a69de0479 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:21.108869 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0b799500-c1a1-48fa-952d-187a69de0479 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:21.118875 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0b799500-c1a1-48fa-952d-187a69de0479 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:21.120359 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0b799500-c1a1-48fa-952d-187a69de0479 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:21.121699 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0b799500-c1a1-48fa-952d-187a69de0479 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] 10.222.0.20 "GET /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4" status: 200 len: 1336 microversion: 2.47 time: 0.180184 Oct 04 18:40:21.122254 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1506/3009] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:20 2022] GET /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4 => generated 1336 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:21.146723 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9fe3dd40-7f4f-48f3-99ef-3e88f657cd1a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:21.147328 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-9fe3dd40-7f4f-48f3-99ef-3e88f657cd1a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 474a799f-8e38-49d6-8fff-9ec3e7657ef5] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:21.153416 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9fe3dd40-7f4f-48f3-99ef-3e88f657cd1a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:21.153899 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9fe3dd40-7f4f-48f3-99ef-3e88f657cd1a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:21.154410 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9fe3dd40-7f4f-48f3-99ef-3e88f657cd1a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:21.155002 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9fe3dd40-7f4f-48f3-99ef-3e88f657cd1a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:21.155445 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9fe3dd40-7f4f-48f3-99ef-3e88f657cd1a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:21.155862 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9fe3dd40-7f4f-48f3-99ef-3e88f657cd1a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:21.192246 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9fe3dd40-7f4f-48f3-99ef-3e88f657cd1a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:21.192743 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9fe3dd40-7f4f-48f3-99ef-3e88f657cd1a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:21.193174 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9fe3dd40-7f4f-48f3-99ef-3e88f657cd1a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:21.193616 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-9fe3dd40-7f4f-48f3-99ef-3e88f657cd1a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lazy-loading 'fault' on Instance uuid 474a799f-8e38-49d6-8fff-9ec3e7657ef5 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:40:21.206826 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-bd9370bd-8b56-4319-8976-020f14f8f756 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8358c07e2684b749a62becb9f0b7869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b922a74c1c2448bb770d6b298b2d601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:21.215254 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-bd9370bd-8b56-4319-8976-020f14f8f756 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53" status: 200 len: 1471 microversion: 2.1 time: 0.266215 Oct 04 18:40:21.231531 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1504/3010] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:20 2022] GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53 => generated 1471 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:21.243197 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9fe3dd40-7f4f-48f3-99ef-3e88f657cd1a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:21.252439 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9fe3dd40-7f4f-48f3-99ef-3e88f657cd1a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5" status: 200 len: 1368 microversion: 2.1 time: 0.109470 Oct 04 18:40:21.253228 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1507/3011] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:21 2022] GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5 => generated 1368 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:40:21.493079 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7c98deb1-1c01-4d64-8688-bdfb6b3feb7a tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:21.493689 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7c98deb1-1c01-4d64-8688-bdfb6b3feb7a tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] [instance: 0212406a-acc5-4631-90e8-03f4409c07f1] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:21.500142 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c98deb1-1c01-4d64-8688-bdfb6b3feb7a tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:21.500647 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c98deb1-1c01-4d64-8688-bdfb6b3feb7a tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:21.501081 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c98deb1-1c01-4d64-8688-bdfb6b3feb7a tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:21.501801 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c98deb1-1c01-4d64-8688-bdfb6b3feb7a tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:21.502250 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c98deb1-1c01-4d64-8688-bdfb6b3feb7a tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:21.502670 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c98deb1-1c01-4d64-8688-bdfb6b3feb7a tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:21.579133 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7c98deb1-1c01-4d64-8688-bdfb6b3feb7a tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:21.592126 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7c98deb1-1c01-4d64-8688-bdfb6b3feb7a tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:21.594358 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7c98deb1-1c01-4d64-8688-bdfb6b3feb7a tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:21.602430 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7c98deb1-1c01-4d64-8688-bdfb6b3feb7a tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] 10.222.0.20 "GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1" status: 200 len: 1446 microversion: 2.75 time: 0.114147 Oct 04 18:40:21.616280 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1505/3012] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:21 2022] GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1 => generated 1446 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:21.953331 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-bb68c99c-045b-4f69-8013-7e67d385ebb3 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:21.954592 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-bb68c99c-045b-4f69-8013-7e67d385ebb3 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] [instance: 6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:21.959949 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b6e29964-92fc-4437-9b08-eef858f361c4 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:21.961585 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b6e29964-92fc-4437-9b08-eef858f361c4 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] [instance: 3d3cabc2-fa23-4098-9197-9aaa19a0c663] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:21.962539 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bb68c99c-045b-4f69-8013-7e67d385ebb3 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:21.963281 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bb68c99c-045b-4f69-8013-7e67d385ebb3 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:21.963892 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bb68c99c-045b-4f69-8013-7e67d385ebb3 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:21.964905 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bb68c99c-045b-4f69-8013-7e67d385ebb3 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:21.965517 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bb68c99c-045b-4f69-8013-7e67d385ebb3 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:21.966092 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bb68c99c-045b-4f69-8013-7e67d385ebb3 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:21.977330 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b6e29964-92fc-4437-9b08-eef858f361c4 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:21.977330 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b6e29964-92fc-4437-9b08-eef858f361c4 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:21.977330 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b6e29964-92fc-4437-9b08-eef858f361c4 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:21.977330 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b6e29964-92fc-4437-9b08-eef858f361c4 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:21.977330 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b6e29964-92fc-4437-9b08-eef858f361c4 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:21.977330 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b6e29964-92fc-4437-9b08-eef858f361c4 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:22.312899 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-bb68c99c-045b-4f69-8013-7e67d385ebb3 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec13a0273819409b8ecba05e9337ec73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6edbe27acbc4c9eba33a6f589f6cf8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:22.325900 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-bb68c99c-045b-4f69-8013-7e67d385ebb3 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] 10.222.0.20 "GET /compute/v2.1/servers/6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28" status: 200 len: 1523 microversion: 2.1 time: 0.375418 Oct 04 18:40:22.328369 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1508/3013] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:21 2022] GET /compute/v2.1/servers/6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28 => generated 1523 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:40:22.338086 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-01836a10-6a9f-47f4-8717-208d2ab76e37 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:22.339812 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-01836a10-6a9f-47f4-8717-208d2ab76e37 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] [instance: 1b0129be-f5f9-4735-a10a-008bddc30ab4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:22.349820 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-01836a10-6a9f-47f4-8717-208d2ab76e37 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:22.350508 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-01836a10-6a9f-47f4-8717-208d2ab76e37 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:22.352243 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-01836a10-6a9f-47f4-8717-208d2ab76e37 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:22.355456 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-01836a10-6a9f-47f4-8717-208d2ab76e37 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:22.355973 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-01836a10-6a9f-47f4-8717-208d2ab76e37 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:22.356493 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-01836a10-6a9f-47f4-8717-208d2ab76e37 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:22.358951 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b6e29964-92fc-4437-9b08-eef858f361c4 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:22.363595 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=100 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:40:22.393307 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b6e29964-92fc-4437-9b08-eef858f361c4 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:22.395004 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b6e29964-92fc-4437-9b08-eef858f361c4 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:22.396281 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b6e29964-92fc-4437-9b08-eef858f361c4 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] 10.222.0.20 "GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663" status: 200 len: 1869 microversion: 2.42 time: 0.441227 Oct 04 18:40:22.409097 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1506/3014] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:21 2022] GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663 => generated 1869 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:22.425951 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f91102ca-4d1b-4e71-b32a-bddab8ec500e tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:22.426911 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f91102ca-4d1b-4e71-b32a-bddab8ec500e tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: c343931b-bc96-4e9e-a5ce-f93454339a53] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:22.433751 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f91102ca-4d1b-4e71-b32a-bddab8ec500e tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:22.434623 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f91102ca-4d1b-4e71-b32a-bddab8ec500e tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:22.435333 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f91102ca-4d1b-4e71-b32a-bddab8ec500e tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:22.436142 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f91102ca-4d1b-4e71-b32a-bddab8ec500e tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:22.436697 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f91102ca-4d1b-4e71-b32a-bddab8ec500e tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:22.437212 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f91102ca-4d1b-4e71-b32a-bddab8ec500e tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:22.589891 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-01836a10-6a9f-47f4-8717-208d2ab76e37 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:22.600504 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-01836a10-6a9f-47f4-8717-208d2ab76e37 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:22.604312 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-01836a10-6a9f-47f4-8717-208d2ab76e37 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:22.605672 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-01836a10-6a9f-47f4-8717-208d2ab76e37 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] 10.222.0.20 "GET /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4" status: 200 len: 1336 microversion: 2.47 time: 0.275978 Oct 04 18:40:22.606340 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1509/3015] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:22 2022] GET /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4 => generated 1336 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:22.632841 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3db23c3e-6bc4-4fd9-bcf3-d11da1a62739 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:22.633978 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3db23c3e-6bc4-4fd9-bcf3-d11da1a62739 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 474a799f-8e38-49d6-8fff-9ec3e7657ef5] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:22.641195 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3db23c3e-6bc4-4fd9-bcf3-d11da1a62739 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:22.641872 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3db23c3e-6bc4-4fd9-bcf3-d11da1a62739 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:22.642377 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3db23c3e-6bc4-4fd9-bcf3-d11da1a62739 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:22.643337 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3db23c3e-6bc4-4fd9-bcf3-d11da1a62739 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:22.644012 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3db23c3e-6bc4-4fd9-bcf3-d11da1a62739 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:22.644945 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3db23c3e-6bc4-4fd9-bcf3-d11da1a62739 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:22.703739 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=12 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:40:22.712086 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3db23c3e-6bc4-4fd9-bcf3-d11da1a62739 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:22.712828 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3db23c3e-6bc4-4fd9-bcf3-d11da1a62739 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:22.713422 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3db23c3e-6bc4-4fd9-bcf3-d11da1a62739 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:22.714023 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-3db23c3e-6bc4-4fd9-bcf3-d11da1a62739 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lazy-loading 'fault' on Instance uuid 474a799f-8e38-49d6-8fff-9ec3e7657ef5 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:40:22.797081 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3db23c3e-6bc4-4fd9-bcf3-d11da1a62739 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:22.805779 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3db23c3e-6bc4-4fd9-bcf3-d11da1a62739 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5" status: 200 len: 1368 microversion: 2.1 time: 0.187078 Oct 04 18:40:22.806358 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1510/3016] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:22 2022] GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5 => generated 1368 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:22.810911 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a1bc6f5d-274f-403d-b1ad-4cbbfe28e5fe tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:22.811730 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a1bc6f5d-274f-403d-b1ad-4cbbfe28e5fe tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] [instance: 0212406a-acc5-4631-90e8-03f4409c07f1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:22.813785 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f91102ca-4d1b-4e71-b32a-bddab8ec500e tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8358c07e2684b749a62becb9f0b7869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b922a74c1c2448bb770d6b298b2d601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:22.818823 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a1bc6f5d-274f-403d-b1ad-4cbbfe28e5fe tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:22.819318 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a1bc6f5d-274f-403d-b1ad-4cbbfe28e5fe tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:22.820732 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a1bc6f5d-274f-403d-b1ad-4cbbfe28e5fe tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:22.822135 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a1bc6f5d-274f-403d-b1ad-4cbbfe28e5fe tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:22.822766 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a1bc6f5d-274f-403d-b1ad-4cbbfe28e5fe tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:22.823358 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a1bc6f5d-274f-403d-b1ad-4cbbfe28e5fe tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:22.826791 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f91102ca-4d1b-4e71-b32a-bddab8ec500e tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53" status: 200 len: 1471 microversion: 2.1 time: 0.416213 Oct 04 18:40:22.827485 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1507/3017] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:22 2022] GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53 => generated 1471 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:22.937858 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a1bc6f5d-274f-403d-b1ad-4cbbfe28e5fe tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:22.948352 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a1bc6f5d-274f-403d-b1ad-4cbbfe28e5fe tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:22.950402 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a1bc6f5d-274f-403d-b1ad-4cbbfe28e5fe tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:22.955921 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a1bc6f5d-274f-403d-b1ad-4cbbfe28e5fe tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] 10.222.0.20 "GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1" status: 200 len: 1446 microversion: 2.75 time: 0.148579 Oct 04 18:40:22.956765 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1511/3018] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:22 2022] GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1 => generated 1446 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:23.355522 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c617976d-441c-4fad-89a2-d227b1c5864a tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:23.356195 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c617976d-441c-4fad-89a2-d227b1c5864a tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] [instance: 6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:23.363109 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c617976d-441c-4fad-89a2-d227b1c5864a tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:23.363732 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c617976d-441c-4fad-89a2-d227b1c5864a tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:23.364020 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c617976d-441c-4fad-89a2-d227b1c5864a tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:23.364780 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c617976d-441c-4fad-89a2-d227b1c5864a tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:23.365237 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c617976d-441c-4fad-89a2-d227b1c5864a tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:23.365669 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c617976d-441c-4fad-89a2-d227b1c5864a tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:23.432227 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-cc38e9a1-00af-4043-a5f2-2d9c0b07ff33 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:23.432823 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-cc38e9a1-00af-4043-a5f2-2d9c0b07ff33 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] [instance: 3d3cabc2-fa23-4098-9197-9aaa19a0c663] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:23.440328 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cc38e9a1-00af-4043-a5f2-2d9c0b07ff33 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:23.440941 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cc38e9a1-00af-4043-a5f2-2d9c0b07ff33 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:23.441383 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cc38e9a1-00af-4043-a5f2-2d9c0b07ff33 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:23.442249 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cc38e9a1-00af-4043-a5f2-2d9c0b07ff33 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:23.442709 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cc38e9a1-00af-4043-a5f2-2d9c0b07ff33 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:23.443166 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cc38e9a1-00af-4043-a5f2-2d9c0b07ff33 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:23.515902 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c617976d-441c-4fad-89a2-d227b1c5864a tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec13a0273819409b8ecba05e9337ec73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6edbe27acbc4c9eba33a6f589f6cf8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:23.527003 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c617976d-441c-4fad-89a2-d227b1c5864a tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] 10.222.0.20 "GET /compute/v2.1/servers/6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28" status: 200 len: 1523 microversion: 2.1 time: 0.175827 Oct 04 18:40:23.532405 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1508/3019] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:23 2022] GET /compute/v2.1/servers/6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28 => generated 1523 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:23.639143 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c479ca19-9874-4fbe-8685-946d0aaf3097 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:23.640623 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c479ca19-9874-4fbe-8685-946d0aaf3097 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] [instance: 1b0129be-f5f9-4735-a10a-008bddc30ab4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:23.656984 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c479ca19-9874-4fbe-8685-946d0aaf3097 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:23.657849 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c479ca19-9874-4fbe-8685-946d0aaf3097 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:23.658693 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c479ca19-9874-4fbe-8685-946d0aaf3097 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:23.659852 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c479ca19-9874-4fbe-8685-946d0aaf3097 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:23.660795 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c479ca19-9874-4fbe-8685-946d0aaf3097 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:23.661493 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c479ca19-9874-4fbe-8685-946d0aaf3097 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:23.783727 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=18 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:40:23.801771 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c479ca19-9874-4fbe-8685-946d0aaf3097 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:23.815480 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c479ca19-9874-4fbe-8685-946d0aaf3097 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:23.820939 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c479ca19-9874-4fbe-8685-946d0aaf3097 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:23.823463 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c479ca19-9874-4fbe-8685-946d0aaf3097 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] 10.222.0.20 "GET /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4" status: 200 len: 1357 microversion: 2.47 time: 0.191555 Oct 04 18:40:23.824692 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1509/3020] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:23 2022] GET /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4 => generated 1357 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:40:23.846678 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-393e89b4-1846-40d3-b5a5-da08c6491ff0 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:23.849243 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-393e89b4-1846-40d3-b5a5-da08c6491ff0 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 474a799f-8e38-49d6-8fff-9ec3e7657ef5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:23.858021 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-393e89b4-1846-40d3-b5a5-da08c6491ff0 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:23.858770 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-393e89b4-1846-40d3-b5a5-da08c6491ff0 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:23.859414 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-393e89b4-1846-40d3-b5a5-da08c6491ff0 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:23.860856 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-393e89b4-1846-40d3-b5a5-da08c6491ff0 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:23.861500 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-393e89b4-1846-40d3-b5a5-da08c6491ff0 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:23.862227 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-393e89b4-1846-40d3-b5a5-da08c6491ff0 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:23.878048 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-393e89b4-1846-40d3-b5a5-da08c6491ff0 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] HTTP exception thrown: Instance 474a799f-8e38-49d6-8fff-9ec3e7657ef5 could not be found. Oct 04 18:40:23.880208 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-393e89b4-1846-40d3-b5a5-da08c6491ff0 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Request method failure captured: Oct 04 18:40:23.880208 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5 HTTP/1.1 Oct 04 18:40:23.880208 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:40:23.880208 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:40:23.880208 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:40:23.880208 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:40:23.880208 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:40:23.880208 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:40:23.880208 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:40:23.880208 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:40:23.880208 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPHylsKzjtTxyxS0lRqrj_KKSHumQgnOG3Ln0f2NoBBXSlSndXbgjyNARvMhAdpUmCrlgZVfzLc5kR-MOiq9TLRM9-w_rTnBF0C_aaOdomrRR_ZDdz3aXjH-fV-MvOq-mBrOl495C0svvDTNQlP-eceEwuANK9BqMrZBbw6QMmsoD0uc Oct 04 18:40:23.880208 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:40:23.880208 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:40:23.880208 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:40:23.880208 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:40:23.880208 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:40:23.880208 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:40:23.880208 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 552ab59dabe840cb8582c54bedc49b09 Oct 04 18:40:23.880208 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-MigrationsAdminTest-1038574730 Oct 04 18:40:23.880208 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:40:23.880208 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:40:23.880208 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/552ab59dabe840cb8582c54bedc49b09"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_552ab59dabe840cb8582c54bedc49b09", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/552ab59dabe840cb8582c54bedc49b09"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/552ab59dabe840cb8582c54bedc49b09"}]}] Oct 04 18:40:23.880208 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-MigrationsAdminTest-1038574730 Oct 04 18:40:23.880208 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 552ab59dabe840cb8582c54bedc49b09 Oct 04 18:40:23.880208 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-MigrationsAdminTest-1038574730 Oct 04 18:40:23.880208 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-MigrationsAdminTest-1038574730-project Oct 04 18:40:23.880208 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:40:23.880208 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:40:23.880208 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 9b05d1f8b9014e798926f9c496885a4d Oct 04 18:40:23.880208 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-MigrationsAdminTest-1038574730-project Oct 04 18:40:23.880208 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:40:23.880208 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 474a799f-8e38-49d6-8fff-9ec3e7657ef5 could not be found. Oct 04 18:40:23.880208 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '474a799f-8e38-49d6-8fff-9ec3e7657ef5'} Oct 04 18:40:23.880208 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:40:23.880208 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:23.880208 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:40:23.880208 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:40:23.880208 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:40:23.880208 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:40:23.880208 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:40:23.880208 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:40:23.880208 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:40:23.880208 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:40:23.880208 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 474a799f-8e38-49d6-8fff-9ec3e7657ef5 could not be found. Oct 04 18:40:23.880208 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:40:23.880208 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:23.880208 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:40:23.880208 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:23.880208 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:40:23.880208 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:40:23.880208 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:40:23.880208 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:40:23.880208 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:40:23.880208 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:40:23.880208 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:40:23.880208 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:40:23.880208 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:40:23.880208 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:40:23.880208 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:40:23.880208 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:40:23.880208 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 474a799f-8e38-49d6-8fff-9ec3e7657ef5 could not be found. Oct 04 18:40:23.880208 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:40:23.880208 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:23.880208 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:40:23.894057 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:23.894057 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:40:23.894057 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:40:23.894057 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:40:23.894057 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:40:23.894057 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 474a799f-8e38-49d6-8fff-9ec3e7657ef5 could not be found. Oct 04 18:40:23.894057 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:40:23.894057 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-393e89b4-1846-40d3-b5a5-da08c6491ff0 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Returning 404 to user: Instance 474a799f-8e38-49d6-8fff-9ec3e7657ef5 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:40:23.894057 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-393e89b4-1846-40d3-b5a5-da08c6491ff0 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5" status: 404 len: 111 microversion: 2.1 time: 0.055279 Oct 04 18:40:23.894057 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1510/3021] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:23 2022] GET /compute/v2.1/servers/474a799f-8e38-49d6-8fff-9ec3e7657ef5 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:40:23.894969 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-cc38e9a1-00af-4043-a5f2-2d9c0b07ff33 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:23.895090 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4d873a0a-e776-4922-a62f-21788336d030 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:23.895090 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4d873a0a-e776-4922-a62f-21788336d030 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: c343931b-bc96-4e9e-a5ce-f93454339a53] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:23.899882 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-cc38e9a1-00af-4043-a5f2-2d9c0b07ff33 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:23.901342 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-cc38e9a1-00af-4043-a5f2-2d9c0b07ff33 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:23.902488 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4d873a0a-e776-4922-a62f-21788336d030 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:23.902631 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-cc38e9a1-00af-4043-a5f2-2d9c0b07ff33 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] 10.222.0.20 "GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663" status: 200 len: 1869 microversion: 2.42 time: 0.475473 Oct 04 18:40:23.903051 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1512/3022] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:23 2022] GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663 => generated 1869 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:40:23.908909 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4d873a0a-e776-4922-a62f-21788336d030 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:23.910494 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4d873a0a-e776-4922-a62f-21788336d030 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:23.912794 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4d873a0a-e776-4922-a62f-21788336d030 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:23.915221 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4d873a0a-e776-4922-a62f-21788336d030 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:23.918289 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4d873a0a-e776-4922-a62f-21788336d030 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:23.920302 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c8b98f68-9303-4567-a9da-336d03d3996c tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:40:23.935348 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c8b98f68-9303-4567-a9da-336d03d3996c tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] [instance: 1b0129be-f5f9-4735-a10a-008bddc30ab4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:23.942298 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c8b98f68-9303-4567-a9da-336d03d3996c tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:23.943007 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c8b98f68-9303-4567-a9da-336d03d3996c tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:23.943624 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c8b98f68-9303-4567-a9da-336d03d3996c tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:23.944619 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c8b98f68-9303-4567-a9da-336d03d3996c tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:23.945262 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c8b98f68-9303-4567-a9da-336d03d3996c tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:23.948656 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c8b98f68-9303-4567-a9da-336d03d3996c tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:24.049085 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-c8b98f68-9303-4567-a9da-336d03d3996c tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:40:24.049872 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-c8b98f68-9303-4567-a9da-336d03d3996c tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:40:24.050397 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-c8b98f68-9303-4567-a9da-336d03d3996c tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:40:24.051161 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-c8b98f68-9303-4567-a9da-336d03d3996c tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:40:24.051754 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-c8b98f68-9303-4567-a9da-336d03d3996c tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:40:24.062786 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=12 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:40:24.139634 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4d873a0a-e776-4922-a62f-21788336d030 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8358c07e2684b749a62becb9f0b7869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b922a74c1c2448bb770d6b298b2d601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:24.148842 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4d873a0a-e776-4922-a62f-21788336d030 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53" status: 200 len: 1477 microversion: 2.1 time: 0.263873 Oct 04 18:40:24.166699 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1511/3023] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:23 2022] GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53 => generated 1477 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:24.179163 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f755aab3-9652-4c1e-9c1a-4aa87ecbdf0e tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '.version_select at 0x7fe258062e50>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:24.283183 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f755aab3-9652-4c1e-9c1a-4aa87ecbdf0e tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-720708956" status: 202 len: 0 microversion: 2.1 time: 0.115218 Oct 04 18:40:24.285022 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1512/3024] 10.222.0.20 () {58 vars in 1218 bytes} [Tue Oct 4 18:40:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-720708956 => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:40:24.292939 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3bd57866-4c27-462c-bd10-0f4f2ea80c60 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:24.293706 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3bd57866-4c27-462c-bd10-0f4f2ea80c60 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] [instance: 0212406a-acc5-4631-90e8-03f4409c07f1] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:24.302320 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3bd57866-4c27-462c-bd10-0f4f2ea80c60 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:24.302864 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3bd57866-4c27-462c-bd10-0f4f2ea80c60 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:24.303365 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3bd57866-4c27-462c-bd10-0f4f2ea80c60 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:24.304567 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3bd57866-4c27-462c-bd10-0f4f2ea80c60 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:24.305107 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3bd57866-4c27-462c-bd10-0f4f2ea80c60 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:24.305226 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c8b98f68-9303-4567-a9da-336d03d3996c tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] [instance: 1b0129be-f5f9-4735-a10a-008bddc30ab4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:24.305547 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3bd57866-4c27-462c-bd10-0f4f2ea80c60 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:24.322742 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c8b98f68-9303-4567-a9da-336d03d3996c tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:24.324130 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c8b98f68-9303-4567-a9da-336d03d3996c tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:24.326269 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c8b98f68-9303-4567-a9da-336d03d3996c tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:24.327182 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c8b98f68-9303-4567-a9da-336d03d3996c tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:24.327859 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c8b98f68-9303-4567-a9da-336d03d3996c tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:24.328495 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c8b98f68-9303-4567-a9da-336d03d3996c tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:24.368711 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c8b98f68-9303-4567-a9da-336d03d3996c tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] 10.222.0.20 "POST /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4/action" status: 202 len: 1079 microversion: 2.47 time: 0.457178 Oct 04 18:40:24.385620 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1513/3025] 10.222.0.20 () {62 vars in 1319 bytes} [Tue Oct 4 18:40:23 2022] POST /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4/action => generated 1079 bytes in 476 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 04 18:40:24.399942 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-86328c50-6f67-4edd-8b1b-91f34e476705 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:24.402655 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-86328c50-6f67-4edd-8b1b-91f34e476705 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] [instance: 1b0129be-f5f9-4735-a10a-008bddc30ab4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:24.409906 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-86328c50-6f67-4edd-8b1b-91f34e476705 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:24.410701 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-86328c50-6f67-4edd-8b1b-91f34e476705 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:24.411324 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-86328c50-6f67-4edd-8b1b-91f34e476705 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:24.412339 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-86328c50-6f67-4edd-8b1b-91f34e476705 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:24.412986 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-86328c50-6f67-4edd-8b1b-91f34e476705 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:24.414199 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-86328c50-6f67-4edd-8b1b-91f34e476705 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:24.494505 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3bd57866-4c27-462c-bd10-0f4f2ea80c60 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:24.504567 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3bd57866-4c27-462c-bd10-0f4f2ea80c60 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:24.506431 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3bd57866-4c27-462c-bd10-0f4f2ea80c60 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:24.513204 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3bd57866-4c27-462c-bd10-0f4f2ea80c60 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] 10.222.0.20 "GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1" status: 200 len: 1446 microversion: 2.75 time: 0.226885 Oct 04 18:40:24.529064 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1513/3026] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:24 2022] GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1 => generated 1446 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:24.535849 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-86328c50-6f67-4edd-8b1b-91f34e476705 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:24.546949 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-86328c50-6f67-4edd-8b1b-91f34e476705 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:24.548811 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-86328c50-6f67-4edd-8b1b-91f34e476705 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:24.550342 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-86328c50-6f67-4edd-8b1b-91f34e476705 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] 10.222.0.20 "GET /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4" status: 200 len: 1366 microversion: 2.47 time: 0.160278 Oct 04 18:40:24.551476 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1514/3027] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:24 2022] GET /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:40:24.552843 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a3e44760-93ad-4311-87da-a7ee1ff92544 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:24.553698 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a3e44760-93ad-4311-87da-a7ee1ff92544 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] [instance: 6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:24.560570 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a3e44760-93ad-4311-87da-a7ee1ff92544 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:24.561251 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a3e44760-93ad-4311-87da-a7ee1ff92544 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:24.561895 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a3e44760-93ad-4311-87da-a7ee1ff92544 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:24.562911 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a3e44760-93ad-4311-87da-a7ee1ff92544 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:24.563529 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a3e44760-93ad-4311-87da-a7ee1ff92544 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:24.564512 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a3e44760-93ad-4311-87da-a7ee1ff92544 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:24.771179 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a3e44760-93ad-4311-87da-a7ee1ff92544 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec13a0273819409b8ecba05e9337ec73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6edbe27acbc4c9eba33a6f589f6cf8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:24.781060 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a3e44760-93ad-4311-87da-a7ee1ff92544 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] 10.222.0.20 "GET /compute/v2.1/servers/6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28" status: 200 len: 1523 microversion: 2.1 time: 0.232309 Oct 04 18:40:24.781670 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1514/3028] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:24 2022] GET /compute/v2.1/servers/6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28 => generated 1523 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:24.931174 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2a04882d-17bd-43ba-b867-0f816d793668 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:24.931714 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2a04882d-17bd-43ba-b867-0f816d793668 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] [instance: 3d3cabc2-fa23-4098-9197-9aaa19a0c663] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:24.937984 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2a04882d-17bd-43ba-b867-0f816d793668 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:24.938603 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2a04882d-17bd-43ba-b867-0f816d793668 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:24.939036 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2a04882d-17bd-43ba-b867-0f816d793668 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:24.940027 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2a04882d-17bd-43ba-b867-0f816d793668 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:24.940530 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2a04882d-17bd-43ba-b867-0f816d793668 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:24.941071 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2a04882d-17bd-43ba-b867-0f816d793668 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:25.188805 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a2f0ccc2-f0c4-4651-91a7-5e40dff54c55 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:25.190487 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a2f0ccc2-f0c4-4651-91a7-5e40dff54c55 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: c343931b-bc96-4e9e-a5ce-f93454339a53] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:25.200414 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a2f0ccc2-f0c4-4651-91a7-5e40dff54c55 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:25.201097 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a2f0ccc2-f0c4-4651-91a7-5e40dff54c55 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:25.201538 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a2f0ccc2-f0c4-4651-91a7-5e40dff54c55 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:25.202266 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a2f0ccc2-f0c4-4651-91a7-5e40dff54c55 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:25.203199 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a2f0ccc2-f0c4-4651-91a7-5e40dff54c55 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:25.203697 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a2f0ccc2-f0c4-4651-91a7-5e40dff54c55 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:25.327449 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-2a04882d-17bd-43ba-b867-0f816d793668 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:25.359809 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-2a04882d-17bd-43ba-b867-0f816d793668 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:25.361915 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-2a04882d-17bd-43ba-b867-0f816d793668 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:25.364296 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2a04882d-17bd-43ba-b867-0f816d793668 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] 10.222.0.20 "GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663" status: 200 len: 1869 microversion: 2.42 time: 0.438386 Oct 04 18:40:25.382993 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1515/3029] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:24 2022] GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663 => generated 1869 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:25.486804 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a2f0ccc2-f0c4-4651-91a7-5e40dff54c55 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8358c07e2684b749a62becb9f0b7869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b922a74c1c2448bb770d6b298b2d601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:25.499673 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a2f0ccc2-f0c4-4651-91a7-5e40dff54c55 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53" status: 200 len: 1477 microversion: 2.1 time: 0.316951 Oct 04 18:40:25.501358 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1515/3030] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:25 2022] GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53 => generated 1477 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:25.544293 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-662a5675-0529-4374-864d-7d702f5c813b tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:25.545186 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-662a5675-0529-4374-864d-7d702f5c813b tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] [instance: 0212406a-acc5-4631-90e8-03f4409c07f1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:25.552547 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-662a5675-0529-4374-864d-7d702f5c813b tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:25.553344 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-662a5675-0529-4374-864d-7d702f5c813b tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:25.554057 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-662a5675-0529-4374-864d-7d702f5c813b tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:25.554994 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-662a5675-0529-4374-864d-7d702f5c813b tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:25.555642 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-662a5675-0529-4374-864d-7d702f5c813b tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:25.560756 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-662a5675-0529-4374-864d-7d702f5c813b tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:25.587460 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8b1849c5-59c1-4394-a01d-61cce2498cca tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:25.592483 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8b1849c5-59c1-4394-a01d-61cce2498cca tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] [instance: 1b0129be-f5f9-4735-a10a-008bddc30ab4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:25.603689 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8b1849c5-59c1-4394-a01d-61cce2498cca tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:25.604342 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8b1849c5-59c1-4394-a01d-61cce2498cca tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:25.607198 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8b1849c5-59c1-4394-a01d-61cce2498cca tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:25.610824 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8b1849c5-59c1-4394-a01d-61cce2498cca tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:25.611396 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8b1849c5-59c1-4394-a01d-61cce2498cca tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:25.611841 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8b1849c5-59c1-4394-a01d-61cce2498cca tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:25.874490 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-662a5675-0529-4374-864d-7d702f5c813b tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:25.877677 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8b1849c5-59c1-4394-a01d-61cce2498cca tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:25.883799 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-662a5675-0529-4374-864d-7d702f5c813b tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:25.885276 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-662a5675-0529-4374-864d-7d702f5c813b tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:25.890521 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8b1849c5-59c1-4394-a01d-61cce2498cca tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:25.891514 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-662a5675-0529-4374-864d-7d702f5c813b tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] 10.222.0.20 "GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1" status: 200 len: 1446 microversion: 2.75 time: 0.351396 Oct 04 18:40:25.891977 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8b1849c5-59c1-4394-a01d-61cce2498cca tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:25.892785 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1516/3031] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:25 2022] GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1 => generated 1446 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:25.904288 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8b1849c5-59c1-4394-a01d-61cce2498cca tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] 10.222.0.20 "GET /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4" status: 200 len: 1366 microversion: 2.47 time: 0.315226 Oct 04 18:40:25.904288 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1516/3032] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:25 2022] GET /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4 => generated 1366 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:40:25.904490 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-99bb775d-be46-4244-b25d-439ef028ee33 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:25.912707 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-99bb775d-be46-4244-b25d-439ef028ee33 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] [instance: 6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:25.922525 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-99bb775d-be46-4244-b25d-439ef028ee33 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:25.923037 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-99bb775d-be46-4244-b25d-439ef028ee33 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:25.923473 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-99bb775d-be46-4244-b25d-439ef028ee33 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:25.924423 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-99bb775d-be46-4244-b25d-439ef028ee33 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:25.924887 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-99bb775d-be46-4244-b25d-439ef028ee33 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:25.926686 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-99bb775d-be46-4244-b25d-439ef028ee33 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:26.090447 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-b8f21232-f198-47f3-9db1-5b2ab76301f5 req-f5a1f218-3fc8-47c6-981e-ba47442ae802 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c343931b-bc96-4e9e-a5ce-f93454339a53", "name": "network-vif-unplugged", "status": "completed", "tag": "c6bfdac3-3f2e-4291-9771-d9e034cf664e"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:40:26.112088 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-b8f21232-f198-47f3-9db1-5b2ab76301f5 req-f5a1f218-3fc8-47c6-981e-ba47442ae802 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:26.112585 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-b8f21232-f198-47f3-9db1-5b2ab76301f5 req-f5a1f218-3fc8-47c6-981e-ba47442ae802 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:26.113016 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-b8f21232-f198-47f3-9db1-5b2ab76301f5 req-f5a1f218-3fc8-47c6-981e-ba47442ae802 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:26.136496 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-b8f21232-f198-47f3-9db1-5b2ab76301f5 req-f5a1f218-3fc8-47c6-981e-ba47442ae802 service nova] Creating event network-vif-unplugged:c6bfdac3-3f2e-4291-9771-d9e034cf664e for instance c343931b-bc96-4e9e-a5ce-f93454339a53 on n-h2-850501-14 Oct 04 18:40:26.146527 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-b8f21232-f198-47f3-9db1-5b2ab76301f5 req-f5a1f218-3fc8-47c6-981e-ba47442ae802 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060078 Oct 04 18:40:26.150097 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1517/3033] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:40:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:40:26.180966 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-99bb775d-be46-4244-b25d-439ef028ee33 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec13a0273819409b8ecba05e9337ec73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6edbe27acbc4c9eba33a6f589f6cf8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:26.190251 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-99bb775d-be46-4244-b25d-439ef028ee33 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] 10.222.0.20 "GET /compute/v2.1/servers/6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28" status: 200 len: 1523 microversion: 2.1 time: 0.289537 Oct 04 18:40:26.206669 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1517/3034] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:25 2022] GET /compute/v2.1/servers/6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28 => generated 1523 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:26.368323 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0c5a7c7a-a77c-4650-9dd1-5b03ca46b330 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:26.368905 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0c5a7c7a-a77c-4650-9dd1-5b03ca46b330 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 3ead1560-9c23-48ad-a938-6b3179b70035] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:26.377358 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0c5a7c7a-a77c-4650-9dd1-5b03ca46b330 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:26.378036 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0c5a7c7a-a77c-4650-9dd1-5b03ca46b330 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:26.378580 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0c5a7c7a-a77c-4650-9dd1-5b03ca46b330 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:26.380406 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0c5a7c7a-a77c-4650-9dd1-5b03ca46b330 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:26.380955 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0c5a7c7a-a77c-4650-9dd1-5b03ca46b330 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:26.381457 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0c5a7c7a-a77c-4650-9dd1-5b03ca46b330 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:26.394338 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5fe3bc8d-09b4-4b77-b0bc-58f4dd857f74 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:26.394954 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5fe3bc8d-09b4-4b77-b0bc-58f4dd857f74 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] [instance: 3d3cabc2-fa23-4098-9197-9aaa19a0c663] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:26.405924 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5fe3bc8d-09b4-4b77-b0bc-58f4dd857f74 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:26.406680 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5fe3bc8d-09b4-4b77-b0bc-58f4dd857f74 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:26.407171 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5fe3bc8d-09b4-4b77-b0bc-58f4dd857f74 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:26.408163 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5fe3bc8d-09b4-4b77-b0bc-58f4dd857f74 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:26.408815 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5fe3bc8d-09b4-4b77-b0bc-58f4dd857f74 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:26.409301 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5fe3bc8d-09b4-4b77-b0bc-58f4dd857f74 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:26.418187 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0c5a7c7a-a77c-4650-9dd1-5b03ca46b330 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 3ead1560-9c23-48ad-a938-6b3179b70035] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:40:26.620438 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5fe3bc8d-09b4-4b77-b0bc-58f4dd857f74 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:26.630216 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5fe3bc8d-09b4-4b77-b0bc-58f4dd857f74 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:26.631664 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5fe3bc8d-09b4-4b77-b0bc-58f4dd857f74 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:26.632878 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5fe3bc8d-09b4-4b77-b0bc-58f4dd857f74 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] 10.222.0.20 "GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663" status: 200 len: 1869 microversion: 2.42 time: 0.242550 Oct 04 18:40:26.633432 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1518/3035] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:26 2022] GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663 => generated 1869 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:40:26.638204 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e8cac83d-5dd3-4ca5-a8dc-ba6360601d27 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:26.638817 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e8cac83d-5dd3-4ca5-a8dc-ba6360601d27 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: c343931b-bc96-4e9e-a5ce-f93454339a53] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:26.645637 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e8cac83d-5dd3-4ca5-a8dc-ba6360601d27 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:26.646349 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e8cac83d-5dd3-4ca5-a8dc-ba6360601d27 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:26.646947 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e8cac83d-5dd3-4ca5-a8dc-ba6360601d27 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:26.648465 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e8cac83d-5dd3-4ca5-a8dc-ba6360601d27 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:26.649145 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e8cac83d-5dd3-4ca5-a8dc-ba6360601d27 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:26.649728 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e8cac83d-5dd3-4ca5-a8dc-ba6360601d27 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:26.726584 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0c5a7c7a-a77c-4650-9dd1-5b03ca46b330 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035" status: 204 len: 0 microversion: 2.1 time: 0.362034 Oct 04 18:40:26.727462 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1518/3036] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:40:26 2022] DELETE /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:40:26.740896 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1ed60ba6-f8d9-445a-ae23-b1e7033c0e67 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:26.742286 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1ed60ba6-f8d9-445a-ae23-b1e7033c0e67 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 3ead1560-9c23-48ad-a938-6b3179b70035] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:26.749012 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1ed60ba6-f8d9-445a-ae23-b1e7033c0e67 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:26.749701 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1ed60ba6-f8d9-445a-ae23-b1e7033c0e67 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:26.750397 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1ed60ba6-f8d9-445a-ae23-b1e7033c0e67 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:26.751253 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1ed60ba6-f8d9-445a-ae23-b1e7033c0e67 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:26.751855 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1ed60ba6-f8d9-445a-ae23-b1e7033c0e67 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:26.752451 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1ed60ba6-f8d9-445a-ae23-b1e7033c0e67 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:26.857769 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e8cac83d-5dd3-4ca5-a8dc-ba6360601d27 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8358c07e2684b749a62becb9f0b7869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b922a74c1c2448bb770d6b298b2d601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:26.865655 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e8cac83d-5dd3-4ca5-a8dc-ba6360601d27 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53" status: 200 len: 1477 microversion: 2.1 time: 0.230998 Oct 04 18:40:26.873459 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1519/3037] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:26 2022] GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53 => generated 1477 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:26.922809 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-74ecaa1b-1e9e-44c9-bd14-7209300de7ee tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:26.923678 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-74ecaa1b-1e9e-44c9-bd14-7209300de7ee tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] [instance: 0212406a-acc5-4631-90e8-03f4409c07f1] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:26.937108 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1ed60ba6-f8d9-445a-ae23-b1e7033c0e67 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:26.941535 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-74ecaa1b-1e9e-44c9-bd14-7209300de7ee tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:26.942108 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-74ecaa1b-1e9e-44c9-bd14-7209300de7ee tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:26.946008 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1ed60ba6-f8d9-445a-ae23-b1e7033c0e67 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035" status: 200 len: 1467 microversion: 2.1 time: 0.209885 Oct 04 18:40:26.948538 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-74ecaa1b-1e9e-44c9-bd14-7209300de7ee tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:26.950751 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-74ecaa1b-1e9e-44c9-bd14-7209300de7ee tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:26.953566 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-74ecaa1b-1e9e-44c9-bd14-7209300de7ee tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:26.954521 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-74ecaa1b-1e9e-44c9-bd14-7209300de7ee tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:26.962242 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1519/3038] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:26 2022] GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035 => generated 1467 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:26.971925 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e27059a3-370f-4fdc-8c27-83b44aa7bbb9 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:26.973123 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e27059a3-370f-4fdc-8c27-83b44aa7bbb9 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] [instance: 1b0129be-f5f9-4735-a10a-008bddc30ab4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:26.986018 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e27059a3-370f-4fdc-8c27-83b44aa7bbb9 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:26.986441 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e27059a3-370f-4fdc-8c27-83b44aa7bbb9 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:26.987346 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e27059a3-370f-4fdc-8c27-83b44aa7bbb9 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:26.988322 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e27059a3-370f-4fdc-8c27-83b44aa7bbb9 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:26.988948 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e27059a3-370f-4fdc-8c27-83b44aa7bbb9 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:26.989525 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e27059a3-370f-4fdc-8c27-83b44aa7bbb9 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:27.114800 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-74ecaa1b-1e9e-44c9-bd14-7209300de7ee tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:27.121600 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e27059a3-370f-4fdc-8c27-83b44aa7bbb9 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:27.125022 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-74ecaa1b-1e9e-44c9-bd14-7209300de7ee tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:27.126512 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-74ecaa1b-1e9e-44c9-bd14-7209300de7ee tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:27.130973 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e27059a3-370f-4fdc-8c27-83b44aa7bbb9 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:27.133362 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e27059a3-370f-4fdc-8c27-83b44aa7bbb9 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:27.133574 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-74ecaa1b-1e9e-44c9-bd14-7209300de7ee tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] 10.222.0.20 "GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1" status: 200 len: 1446 microversion: 2.75 time: 0.216664 Oct 04 18:40:27.134708 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e27059a3-370f-4fdc-8c27-83b44aa7bbb9 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] 10.222.0.20 "GET /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4" status: 200 len: 1366 microversion: 2.47 time: 0.171410 Oct 04 18:40:27.148248 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1520/3039] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:26 2022] GET /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4 => generated 1366 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:27.148374 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1520/3040] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:26 2022] GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1 => generated 1446 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:40:27.213693 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ad425d5f-25fb-44b5-8f21-5b0cc3d2a5d0 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:27.214260 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ad425d5f-25fb-44b5-8f21-5b0cc3d2a5d0 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] [instance: 6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:27.220411 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ad425d5f-25fb-44b5-8f21-5b0cc3d2a5d0 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:27.221898 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ad425d5f-25fb-44b5-8f21-5b0cc3d2a5d0 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:27.222333 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ad425d5f-25fb-44b5-8f21-5b0cc3d2a5d0 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:27.223022 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ad425d5f-25fb-44b5-8f21-5b0cc3d2a5d0 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:27.223467 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ad425d5f-25fb-44b5-8f21-5b0cc3d2a5d0 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:27.223885 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ad425d5f-25fb-44b5-8f21-5b0cc3d2a5d0 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:27.229989 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=100 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:40:27.533090 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ad425d5f-25fb-44b5-8f21-5b0cc3d2a5d0 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec13a0273819409b8ecba05e9337ec73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6edbe27acbc4c9eba33a6f589f6cf8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:27.565075 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ad425d5f-25fb-44b5-8f21-5b0cc3d2a5d0 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] 10.222.0.20 "GET /compute/v2.1/servers/6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28" status: 200 len: 1523 microversion: 2.1 time: 0.354712 Oct 04 18:40:27.566271 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1521/3041] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:27 2022] GET /compute/v2.1/servers/6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28 => generated 1523 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:40:27.665391 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-81b98b7e-6b43-400f-b19b-3335de94050c tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:27.666224 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-81b98b7e-6b43-400f-b19b-3335de94050c tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] [instance: 3d3cabc2-fa23-4098-9197-9aaa19a0c663] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:27.677155 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-81b98b7e-6b43-400f-b19b-3335de94050c tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:27.682404 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-81b98b7e-6b43-400f-b19b-3335de94050c tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:27.682981 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-81b98b7e-6b43-400f-b19b-3335de94050c tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:27.684791 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-81b98b7e-6b43-400f-b19b-3335de94050c tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:27.686505 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-81b98b7e-6b43-400f-b19b-3335de94050c tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:27.687180 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-81b98b7e-6b43-400f-b19b-3335de94050c tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:27.892553 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a02b0d88-ebba-4139-a2c2-668212c94421 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:27.893169 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a02b0d88-ebba-4139-a2c2-668212c94421 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: c343931b-bc96-4e9e-a5ce-f93454339a53] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:27.903938 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a02b0d88-ebba-4139-a2c2-668212c94421 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:27.905717 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a02b0d88-ebba-4139-a2c2-668212c94421 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:27.906343 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a02b0d88-ebba-4139-a2c2-668212c94421 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:27.907967 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a02b0d88-ebba-4139-a2c2-668212c94421 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:27.909166 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a02b0d88-ebba-4139-a2c2-668212c94421 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:27.911807 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a02b0d88-ebba-4139-a2c2-668212c94421 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:28.106748 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-81b98b7e-6b43-400f-b19b-3335de94050c tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:28.121872 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-81b98b7e-6b43-400f-b19b-3335de94050c tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:28.123632 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-81b98b7e-6b43-400f-b19b-3335de94050c tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:28.125044 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-81b98b7e-6b43-400f-b19b-3335de94050c tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] 10.222.0.20 "GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663" status: 200 len: 1869 microversion: 2.42 time: 0.466102 Oct 04 18:40:28.140155 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1521/3042] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:27 2022] GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663 => generated 1869 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:28.151836 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-290031d7-06a9-4964-bfd0-0f69120ab3df tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:28.152539 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-290031d7-06a9-4964-bfd0-0f69120ab3df tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 3ead1560-9c23-48ad-a938-6b3179b70035] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:28.161046 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-290031d7-06a9-4964-bfd0-0f69120ab3df tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:28.161537 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-290031d7-06a9-4964-bfd0-0f69120ab3df tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:28.161974 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-290031d7-06a9-4964-bfd0-0f69120ab3df tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:28.162674 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-290031d7-06a9-4964-bfd0-0f69120ab3df tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:28.163227 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-290031d7-06a9-4964-bfd0-0f69120ab3df tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:28.163759 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-290031d7-06a9-4964-bfd0-0f69120ab3df tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:28.187536 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:40:28.208186 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a02b0d88-ebba-4139-a2c2-668212c94421 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8358c07e2684b749a62becb9f0b7869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b922a74c1c2448bb770d6b298b2d601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:28.217398 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a02b0d88-ebba-4139-a2c2-668212c94421 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53" status: 200 len: 1477 microversion: 2.1 time: 0.328606 Oct 04 18:40:28.220150 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1522/3043] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:27 2022] GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53 => generated 1477 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:40:28.223929 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-73eb2b58-8a0b-4cb0-b5f9-ac7e62cc4797 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:28.224578 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-73eb2b58-8a0b-4cb0-b5f9-ac7e62cc4797 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] [instance: 0212406a-acc5-4631-90e8-03f4409c07f1] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:28.231238 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-73eb2b58-8a0b-4cb0-b5f9-ac7e62cc4797 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:28.231821 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-73eb2b58-8a0b-4cb0-b5f9-ac7e62cc4797 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:28.232284 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-73eb2b58-8a0b-4cb0-b5f9-ac7e62cc4797 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:28.233016 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-73eb2b58-8a0b-4cb0-b5f9-ac7e62cc4797 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:28.233471 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-73eb2b58-8a0b-4cb0-b5f9-ac7e62cc4797 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:28.234019 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-73eb2b58-8a0b-4cb0-b5f9-ac7e62cc4797 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:28.364047 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-73eb2b58-8a0b-4cb0-b5f9-ac7e62cc4797 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:28.379280 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-73eb2b58-8a0b-4cb0-b5f9-ac7e62cc4797 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:28.380895 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-73eb2b58-8a0b-4cb0-b5f9-ac7e62cc4797 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:28.387232 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-73eb2b58-8a0b-4cb0-b5f9-ac7e62cc4797 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] 10.222.0.20 "GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1" status: 200 len: 1446 microversion: 2.75 time: 0.167533 Oct 04 18:40:28.402873 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1523/3044] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:28 2022] GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1 => generated 1446 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:28.421075 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-68c8f026-6274-4d93-8ce2-eb2069feb16c tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:28.421718 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-68c8f026-6274-4d93-8ce2-eb2069feb16c tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] [instance: 1b0129be-f5f9-4735-a10a-008bddc30ab4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:28.429253 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-290031d7-06a9-4964-bfd0-0f69120ab3df tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:28.430176 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-68c8f026-6274-4d93-8ce2-eb2069feb16c tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:28.433771 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-68c8f026-6274-4d93-8ce2-eb2069feb16c tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:28.434190 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-68c8f026-6274-4d93-8ce2-eb2069feb16c tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:28.434938 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-68c8f026-6274-4d93-8ce2-eb2069feb16c tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:28.435558 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-68c8f026-6274-4d93-8ce2-eb2069feb16c tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:28.436553 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-68c8f026-6274-4d93-8ce2-eb2069feb16c tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:28.439471 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-290031d7-06a9-4964-bfd0-0f69120ab3df tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035" status: 200 len: 1467 microversion: 2.1 time: 0.298190 Oct 04 18:40:28.443073 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1522/3045] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:28 2022] GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035 => generated 1467 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:28.561162 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-68c8f026-6274-4d93-8ce2-eb2069feb16c tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:28.573050 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-68c8f026-6274-4d93-8ce2-eb2069feb16c tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:28.574441 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-68c8f026-6274-4d93-8ce2-eb2069feb16c tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:28.575919 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-68c8f026-6274-4d93-8ce2-eb2069feb16c tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] 10.222.0.20 "GET /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4" status: 200 len: 1366 microversion: 2.47 time: 0.172131 Oct 04 18:40:28.590187 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1524/3046] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:28 2022] GET /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4 => generated 1366 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:28.593048 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-15f161e1-7c22-45ee-9293-62cf32365396 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:28.593929 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-15f161e1-7c22-45ee-9293-62cf32365396 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] [instance: 6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:28.607161 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-15f161e1-7c22-45ee-9293-62cf32365396 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:28.609763 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-15f161e1-7c22-45ee-9293-62cf32365396 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:28.610468 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-15f161e1-7c22-45ee-9293-62cf32365396 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:28.612860 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-15f161e1-7c22-45ee-9293-62cf32365396 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:28.613727 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-15f161e1-7c22-45ee-9293-62cf32365396 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:28.614383 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-15f161e1-7c22-45ee-9293-62cf32365396 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:28.911954 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-15f161e1-7c22-45ee-9293-62cf32365396 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec13a0273819409b8ecba05e9337ec73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6edbe27acbc4c9eba33a6f589f6cf8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:28.922415 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-15f161e1-7c22-45ee-9293-62cf32365396 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] 10.222.0.20 "GET /compute/v2.1/servers/6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28" status: 200 len: 1523 microversion: 2.1 time: 0.335704 Oct 04 18:40:28.923192 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1523/3047] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:28 2022] GET /compute/v2.1/servers/6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28 => generated 1523 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:40:29.157159 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9ee86f7c-64db-468a-8ea2-2b8c927c09db tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:29.157975 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9ee86f7c-64db-468a-8ea2-2b8c927c09db tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] [instance: 3d3cabc2-fa23-4098-9197-9aaa19a0c663] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:29.170901 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9ee86f7c-64db-468a-8ea2-2b8c927c09db tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:29.171397 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9ee86f7c-64db-468a-8ea2-2b8c927c09db tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:29.171835 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9ee86f7c-64db-468a-8ea2-2b8c927c09db tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:29.172571 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9ee86f7c-64db-468a-8ea2-2b8c927c09db tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:29.173659 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9ee86f7c-64db-468a-8ea2-2b8c927c09db tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:29.174099 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9ee86f7c-64db-468a-8ea2-2b8c927c09db tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:29.247988 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-72f8e546-2d1f-49ff-af11-ced482485425 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:29.248566 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-72f8e546-2d1f-49ff-af11-ced482485425 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: c343931b-bc96-4e9e-a5ce-f93454339a53] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:29.255736 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-72f8e546-2d1f-49ff-af11-ced482485425 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:29.260175 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-72f8e546-2d1f-49ff-af11-ced482485425 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:29.260175 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-72f8e546-2d1f-49ff-af11-ced482485425 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:29.260529 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-72f8e546-2d1f-49ff-af11-ced482485425 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:29.263331 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-72f8e546-2d1f-49ff-af11-ced482485425 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:29.264248 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-72f8e546-2d1f-49ff-af11-ced482485425 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:29.653216 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9ee86f7c-64db-468a-8ea2-2b8c927c09db tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:29.671570 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9ee86f7c-64db-468a-8ea2-2b8c927c09db tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:29.674666 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9ee86f7c-64db-468a-8ea2-2b8c927c09db tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:29.677465 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9ee86f7c-64db-468a-8ea2-2b8c927c09db tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] 10.222.0.20 "GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663" status: 200 len: 1869 microversion: 2.42 time: 0.528309 Oct 04 18:40:29.678268 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1525/3048] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:29 2022] GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663 => generated 1869 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:29.683718 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e968f68d-e0c5-4c4e-afed-2bf3b862627b tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:29.684742 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e968f68d-e0c5-4c4e-afed-2bf3b862627b tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] [instance: 0212406a-acc5-4631-90e8-03f4409c07f1] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:29.692735 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e968f68d-e0c5-4c4e-afed-2bf3b862627b tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:29.693592 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e968f68d-e0c5-4c4e-afed-2bf3b862627b tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:29.694888 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e968f68d-e0c5-4c4e-afed-2bf3b862627b tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:29.695787 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e968f68d-e0c5-4c4e-afed-2bf3b862627b tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:29.697279 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e968f68d-e0c5-4c4e-afed-2bf3b862627b tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:29.697879 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e968f68d-e0c5-4c4e-afed-2bf3b862627b tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:29.772694 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-72f8e546-2d1f-49ff-af11-ced482485425 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8358c07e2684b749a62becb9f0b7869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b922a74c1c2448bb770d6b298b2d601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:29.799148 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-72f8e546-2d1f-49ff-af11-ced482485425 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53" status: 200 len: 1477 microversion: 2.1 time: 0.557538 Oct 04 18:40:29.819105 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1524/3049] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:29 2022] GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53 => generated 1477 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:29.831266 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6a639ada-8804-4e61-84ce-70eacfed9e46 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:29.832430 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6a639ada-8804-4e61-84ce-70eacfed9e46 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 3ead1560-9c23-48ad-a938-6b3179b70035] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:29.842211 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6a639ada-8804-4e61-84ce-70eacfed9e46 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:29.845863 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6a639ada-8804-4e61-84ce-70eacfed9e46 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:29.846628 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6a639ada-8804-4e61-84ce-70eacfed9e46 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:29.847649 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6a639ada-8804-4e61-84ce-70eacfed9e46 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:29.848753 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6a639ada-8804-4e61-84ce-70eacfed9e46 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:29.850045 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6a639ada-8804-4e61-84ce-70eacfed9e46 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:29.856644 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e968f68d-e0c5-4c4e-afed-2bf3b862627b tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:29.867309 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e968f68d-e0c5-4c4e-afed-2bf3b862627b tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:29.872779 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e968f68d-e0c5-4c4e-afed-2bf3b862627b tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:29.896100 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e968f68d-e0c5-4c4e-afed-2bf3b862627b tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] 10.222.0.20 "GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1" status: 200 len: 1446 microversion: 2.75 time: 0.215226 Oct 04 18:40:29.907135 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1526/3050] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:29 2022] GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1 => generated 1446 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:29.913032 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3ec64863-0a78-449a-ae7e-74ef54b9597a tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:29.913879 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3ec64863-0a78-449a-ae7e-74ef54b9597a tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] [instance: 1b0129be-f5f9-4735-a10a-008bddc30ab4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:29.927159 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3ec64863-0a78-449a-ae7e-74ef54b9597a tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:29.927659 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3ec64863-0a78-449a-ae7e-74ef54b9597a tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:29.928187 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3ec64863-0a78-449a-ae7e-74ef54b9597a tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:29.929503 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3ec64863-0a78-449a-ae7e-74ef54b9597a tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:29.941529 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3ec64863-0a78-449a-ae7e-74ef54b9597a tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:29.941988 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3ec64863-0a78-449a-ae7e-74ef54b9597a tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:30.372561 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6a639ada-8804-4e61-84ce-70eacfed9e46 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:30.388005 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6a639ada-8804-4e61-84ce-70eacfed9e46 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035" status: 200 len: 1467 microversion: 2.1 time: 0.563271 Oct 04 18:40:30.390262 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1525/3051] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:29 2022] GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035 => generated 1467 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:30.393027 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3ec64863-0a78-449a-ae7e-74ef54b9597a tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:30.396233 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-37980ab6-6bed-4f6d-9a1c-4286b75890f5 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:30.397107 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-37980ab6-6bed-4f6d-9a1c-4286b75890f5 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] [instance: 6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:30.403798 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:40:30.404631 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3ec64863-0a78-449a-ae7e-74ef54b9597a tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:30.405508 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-37980ab6-6bed-4f6d-9a1c-4286b75890f5 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:30.406109 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3ec64863-0a78-449a-ae7e-74ef54b9597a tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:30.407299 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3ec64863-0a78-449a-ae7e-74ef54b9597a tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] 10.222.0.20 "GET /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4" status: 200 len: 1366 microversion: 2.47 time: 0.498853 Oct 04 18:40:30.407864 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1527/3052] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:29 2022] GET /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4 => generated 1366 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:30.411856 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-37980ab6-6bed-4f6d-9a1c-4286b75890f5 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:30.412294 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-37980ab6-6bed-4f6d-9a1c-4286b75890f5 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:30.413742 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-37980ab6-6bed-4f6d-9a1c-4286b75890f5 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:30.422296 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-37980ab6-6bed-4f6d-9a1c-4286b75890f5 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:30.423012 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-37980ab6-6bed-4f6d-9a1c-4286b75890f5 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:30.427351 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-295fa0de-05d1-40bb-831a-d16449c379a9 req-ac7cd08b-120c-4d11-be33-91b7152beb3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c343931b-bc96-4e9e-a5ce-f93454339a53", "name": "network-vif-plugged", "status": "completed", "tag": "c6bfdac3-3f2e-4291-9771-d9e034cf664e"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:40:30.448117 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-295fa0de-05d1-40bb-831a-d16449c379a9 req-ac7cd08b-120c-4d11-be33-91b7152beb3a service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:30.448611 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-295fa0de-05d1-40bb-831a-d16449c379a9 req-ac7cd08b-120c-4d11-be33-91b7152beb3a service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:30.449048 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-295fa0de-05d1-40bb-831a-d16449c379a9 req-ac7cd08b-120c-4d11-be33-91b7152beb3a service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:30.469890 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-295fa0de-05d1-40bb-831a-d16449c379a9 req-ac7cd08b-120c-4d11-be33-91b7152beb3a service nova] Creating event network-vif-plugged:c6bfdac3-3f2e-4291-9771-d9e034cf664e for instance c343931b-bc96-4e9e-a5ce-f93454339a53 on n-h2-850501-14 Oct 04 18:40:30.489081 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-295fa0de-05d1-40bb-831a-d16449c379a9 req-ac7cd08b-120c-4d11-be33-91b7152beb3a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077477 Oct 04 18:40:30.490124 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1528/3053] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:40:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:40:30.597527 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-6e4680e3-12d7-4203-8ca2-1f0484b93958 req-63f76790-596a-417b-8de8-7ad6f81d73a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ead1560-9c23-48ad-a938-6b3179b70035", "name": "network-vif-deleted", "tag": "7d8819bd-e6dc-4ea2-a722-7f903297fff8"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:40:30.609627 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-6e4680e3-12d7-4203-8ca2-1f0484b93958 req-63f76790-596a-417b-8de8-7ad6f81d73a5 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:30.610386 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-6e4680e3-12d7-4203-8ca2-1f0484b93958 req-63f76790-596a-417b-8de8-7ad6f81d73a5 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:30.610984 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-6e4680e3-12d7-4203-8ca2-1f0484b93958 req-63f76790-596a-417b-8de8-7ad6f81d73a5 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:30.627886 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-6e4680e3-12d7-4203-8ca2-1f0484b93958 req-63f76790-596a-417b-8de8-7ad6f81d73a5 service nova] Creating event network-vif-deleted:7d8819bd-e6dc-4ea2-a722-7f903297fff8 for instance 3ead1560-9c23-48ad-a938-6b3179b70035 on n-h1-850501-14 Oct 04 18:40:30.655326 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-6e4680e3-12d7-4203-8ca2-1f0484b93958 req-63f76790-596a-417b-8de8-7ad6f81d73a5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062043 Oct 04 18:40:30.665872 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1529/3054] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:40:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:40:30.715114 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8e43de42-4d23-4d19-8f8d-8152e919826b tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:30.715609 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8e43de42-4d23-4d19-8f8d-8152e919826b tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] [instance: 3d3cabc2-fa23-4098-9197-9aaa19a0c663] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:30.729398 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8e43de42-4d23-4d19-8f8d-8152e919826b tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:30.729398 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8e43de42-4d23-4d19-8f8d-8152e919826b tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:30.730216 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8e43de42-4d23-4d19-8f8d-8152e919826b tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:30.730536 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8e43de42-4d23-4d19-8f8d-8152e919826b tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:30.733218 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8e43de42-4d23-4d19-8f8d-8152e919826b tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:30.733679 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8e43de42-4d23-4d19-8f8d-8152e919826b tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:30.942189 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-37980ab6-6bed-4f6d-9a1c-4286b75890f5 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec13a0273819409b8ecba05e9337ec73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6edbe27acbc4c9eba33a6f589f6cf8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:30.954560 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-37980ab6-6bed-4f6d-9a1c-4286b75890f5 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] 10.222.0.20 "GET /compute/v2.1/servers/6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28" status: 200 len: 1523 microversion: 2.1 time: 0.562865 Oct 04 18:40:30.977032 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1526/3055] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:30 2022] GET /compute/v2.1/servers/6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28 => generated 1523 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:31.126679 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8e43de42-4d23-4d19-8f8d-8152e919826b tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:31.154107 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8e43de42-4d23-4d19-8f8d-8152e919826b tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:31.159910 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8e43de42-4d23-4d19-8f8d-8152e919826b tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:31.166125 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8e43de42-4d23-4d19-8f8d-8152e919826b tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] 10.222.0.20 "GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663" status: 200 len: 1869 microversion: 2.42 time: 0.462645 Oct 04 18:40:31.181486 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1530/3056] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:30 2022] GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663 => generated 1869 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:40:31.193565 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e2934818-467e-404d-9d54-5c31e18887ee tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:31.195982 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e2934818-467e-404d-9d54-5c31e18887ee tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: c343931b-bc96-4e9e-a5ce-f93454339a53] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:31.205489 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e2934818-467e-404d-9d54-5c31e18887ee tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:31.205990 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e2934818-467e-404d-9d54-5c31e18887ee tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:31.206458 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e2934818-467e-404d-9d54-5c31e18887ee tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:31.207321 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e2934818-467e-404d-9d54-5c31e18887ee tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:31.208523 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e2934818-467e-404d-9d54-5c31e18887ee tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:31.208955 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e2934818-467e-404d-9d54-5c31e18887ee tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:31.245799 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b24f750c-2346-4ce2-bf56-b0c6654824e0 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1507005487", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": [{"uuid": "1abca12e-af42-4430-bf6f-473c83612754"}]}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:40:31.328263 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.neutron [None req-b24f750c-2346-4ce2-bf56-b0c6654824e0 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] validate_networks() for [('1abca12e-af42-4430-bf6f-473c83612754', None, None, None, None, None)] {{(pid=123001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:40:31.497404 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e2934818-467e-404d-9d54-5c31e18887ee tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8358c07e2684b749a62becb9f0b7869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b922a74c1c2448bb770d6b298b2d601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:31.508663 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e2934818-467e-404d-9d54-5c31e18887ee tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53" status: 200 len: 1477 microversion: 2.1 time: 0.325971 Oct 04 18:40:31.509927 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1531/3057] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:31 2022] GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53 => generated 1477 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:31.514772 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-815396f3-841b-4a4e-90a6-4eb6d570672e tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:31.515697 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-815396f3-841b-4a4e-90a6-4eb6d570672e tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] [instance: 0212406a-acc5-4631-90e8-03f4409c07f1] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:31.521264 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:40:31.523814 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-815396f3-841b-4a4e-90a6-4eb6d570672e tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:31.524553 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-815396f3-841b-4a4e-90a6-4eb6d570672e tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:31.525207 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-815396f3-841b-4a4e-90a6-4eb6d570672e tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:31.531579 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-815396f3-841b-4a4e-90a6-4eb6d570672e tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:31.531579 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-815396f3-841b-4a4e-90a6-4eb6d570672e tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:31.531579 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-815396f3-841b-4a4e-90a6-4eb6d570672e tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:31.636166 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-815396f3-841b-4a4e-90a6-4eb6d570672e tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:31.645762 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-815396f3-841b-4a4e-90a6-4eb6d570672e tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:31.647804 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-815396f3-841b-4a4e-90a6-4eb6d570672e tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:31.653856 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-815396f3-841b-4a4e-90a6-4eb6d570672e tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] 10.222.0.20 "GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1" status: 200 len: 1446 microversion: 2.75 time: 0.142580 Oct 04 18:40:31.671001 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1532/3058] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:31 2022] GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1 => generated 1446 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:31.684472 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3b476b9c-36db-4d58-a945-730822c4ad06 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:31.686380 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3b476b9c-36db-4d58-a945-730822c4ad06 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 3ead1560-9c23-48ad-a938-6b3179b70035] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:31.693730 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3b476b9c-36db-4d58-a945-730822c4ad06 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:31.695238 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3b476b9c-36db-4d58-a945-730822c4ad06 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:31.695834 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3b476b9c-36db-4d58-a945-730822c4ad06 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:31.696952 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3b476b9c-36db-4d58-a945-730822c4ad06 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:31.697412 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3b476b9c-36db-4d58-a945-730822c4ad06 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:31.697838 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3b476b9c-36db-4d58-a945-730822c4ad06 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:31.731610 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3b476b9c-36db-4d58-a945-730822c4ad06 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:31.732153 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3b476b9c-36db-4d58-a945-730822c4ad06 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:31.732596 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3b476b9c-36db-4d58-a945-730822c4ad06 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:31.733051 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-3b476b9c-36db-4d58-a945-730822c4ad06 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lazy-loading 'fault' on Instance uuid 3ead1560-9c23-48ad-a938-6b3179b70035 {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:40:31.779290 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3b476b9c-36db-4d58-a945-730822c4ad06 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:31.790459 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3b476b9c-36db-4d58-a945-730822c4ad06 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035" status: 200 len: 1302 microversion: 2.1 time: 0.111313 Oct 04 18:40:31.806036 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1533/3059] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:31 2022] GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035 => generated 1302 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:31.813394 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d5ffb35c-ab24-41f9-b221-64436105ccdb tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:31.814604 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d5ffb35c-ab24-41f9-b221-64436105ccdb tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] [instance: 1b0129be-f5f9-4735-a10a-008bddc30ab4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:31.822152 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d5ffb35c-ab24-41f9-b221-64436105ccdb tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:31.822968 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d5ffb35c-ab24-41f9-b221-64436105ccdb tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:31.823622 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d5ffb35c-ab24-41f9-b221-64436105ccdb tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:31.824563 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d5ffb35c-ab24-41f9-b221-64436105ccdb tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:31.825173 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d5ffb35c-ab24-41f9-b221-64436105ccdb tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:31.825809 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d5ffb35c-ab24-41f9-b221-64436105ccdb tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:31.916343 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d5ffb35c-ab24-41f9-b221-64436105ccdb tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:31.926701 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d5ffb35c-ab24-41f9-b221-64436105ccdb tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:31.928720 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d5ffb35c-ab24-41f9-b221-64436105ccdb tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:31.931633 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d5ffb35c-ab24-41f9-b221-64436105ccdb tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] 10.222.0.20 "GET /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4" status: 200 len: 1366 microversion: 2.47 time: 0.123717 Oct 04 18:40:31.932637 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1534/3060] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:31 2022] GET /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4 => generated 1366 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:31.982037 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8866007d-3042-4c8f-a926-217813767454 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:31.983065 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8866007d-3042-4c8f-a926-217813767454 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] [instance: 6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:31.989832 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8866007d-3042-4c8f-a926-217813767454 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:31.990620 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8866007d-3042-4c8f-a926-217813767454 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:31.991655 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8866007d-3042-4c8f-a926-217813767454 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:31.993496 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8866007d-3042-4c8f-a926-217813767454 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:31.994198 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8866007d-3042-4c8f-a926-217813767454 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:31.994874 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8866007d-3042-4c8f-a926-217813767454 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:32.149060 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-b24f750c-2346-4ce2-bf56-b0c6654824e0 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:40:32.150394 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-b24f750c-2346-4ce2-bf56-b0c6654824e0 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:40:32.151039 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-b24f750c-2346-4ce2-bf56-b0c6654824e0 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:40:32.151638 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-b24f750c-2346-4ce2-bf56-b0c6654824e0 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:40:32.153374 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-b24f750c-2346-4ce2-bf56-b0c6654824e0 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:40:32.168721 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b24f750c-2346-4ce2-bf56-b0c6654824e0 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:32.169636 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b24f750c-2346-4ce2-bf56-b0c6654824e0 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:32.170417 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b24f750c-2346-4ce2-bf56-b0c6654824e0 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:32.171672 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b24f750c-2346-4ce2-bf56-b0c6654824e0 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:32.172357 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b24f750c-2346-4ce2-bf56-b0c6654824e0 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:32.175206 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b24f750c-2346-4ce2-bf56-b0c6654824e0 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:32.179707 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8866007d-3042-4c8f-a926-217813767454 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec13a0273819409b8ecba05e9337ec73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6edbe27acbc4c9eba33a6f589f6cf8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:32.193325 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8866007d-3042-4c8f-a926-217813767454 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] 10.222.0.20 "GET /compute/v2.1/servers/6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28" status: 200 len: 1503 microversion: 2.1 time: 0.215089 Oct 04 18:40:32.194672 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1535/3061] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:31 2022] GET /compute/v2.1/servers/6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28 => generated 1503 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:32.195720 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-b24f750c-2346-4ce2-bf56-b0c6654824e0 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Getting quotas for project 08896629a67f488b87a845e57a9ca372. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:40:32.200289 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c111aeff-c76b-48ab-a4a2-4070d1c752d9 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:32.204446 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c111aeff-c76b-48ab-a4a2-4070d1c752d9 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] [instance: 3d3cabc2-fa23-4098-9197-9aaa19a0c663] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:32.207883 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c111aeff-c76b-48ab-a4a2-4070d1c752d9 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:32.208653 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c111aeff-c76b-48ab-a4a2-4070d1c752d9 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:32.209315 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c111aeff-c76b-48ab-a4a2-4070d1c752d9 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:32.211199 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c111aeff-c76b-48ab-a4a2-4070d1c752d9 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:32.212038 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c111aeff-c76b-48ab-a4a2-4070d1c752d9 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:32.212817 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c111aeff-c76b-48ab-a4a2-4070d1c752d9 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:32.215770 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-b24f750c-2346-4ce2-bf56-b0c6654824e0 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Getting quotas for user a3499c88686046b8a80bc3a754f016e9 and project 08896629a67f488b87a845e57a9ca372. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:40:32.231144 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b24f750c-2346-4ce2-bf56-b0c6654824e0 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Going to run 1 instances... {{(pid=123001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:40:32.233603 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b24f750c-2346-4ce2-bf56-b0c6654824e0 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] [instance: d607218c-7a38-4b49-bb51-7e1adfda8c6a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:40:32.386565 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b24f750c-2346-4ce2-bf56-b0c6654824e0 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.408224 Oct 04 18:40:32.394918 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1527/3062] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:40:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1417 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:40:32.402225 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2f0327c7-827f-4530-a896-a7328ea116f9 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Action: 'create', calling method: .version_select at 0x7fe258108310>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1672273147", "description": "tempest-description-102129164"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:40:32.474379 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c111aeff-c76b-48ab-a4a2-4070d1c752d9 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:32.486428 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c111aeff-c76b-48ab-a4a2-4070d1c752d9 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:32.488495 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c111aeff-c76b-48ab-a4a2-4070d1c752d9 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:32.490108 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c111aeff-c76b-48ab-a4a2-4070d1c752d9 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] 10.222.0.20 "GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663" status: 200 len: 1869 microversion: 2.42 time: 0.294249 Oct 04 18:40:32.493248 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1536/3063] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:32 2022] GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663 => generated 1869 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:32.499411 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8c2a004b-d3f2-467b-b007-a05fa400e3ac tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:32.500163 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8c2a004b-d3f2-467b-b007-a05fa400e3ac tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] [instance: d607218c-7a38-4b49-bb51-7e1adfda8c6a] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:32.564940 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8c2a004b-d3f2-467b-b007-a05fa400e3ac tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3499c88686046b8a80bc3a754f016e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08896629a67f488b87a845e57a9ca372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:32.586695 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8c2a004b-d3f2-467b-b007-a05fa400e3ac tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] 10.222.0.20 "GET /compute/v2.1/servers/d607218c-7a38-4b49-bb51-7e1adfda8c6a" status: 200 len: 1224 microversion: 2.1 time: 0.090791 Oct 04 18:40:32.617738 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1537/3064] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:32 2022] GET /compute/v2.1/servers/d607218c-7a38-4b49-bb51-7e1adfda8c6a => generated 1224 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:32.625823 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c5870674-9509-4fb0-9793-3797bfaeb08b tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:32.631366 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c5870674-9509-4fb0-9793-3797bfaeb08b tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: c343931b-bc96-4e9e-a5ce-f93454339a53] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:32.650073 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c5870674-9509-4fb0-9793-3797bfaeb08b tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:32.650073 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c5870674-9509-4fb0-9793-3797bfaeb08b tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:32.650235 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c5870674-9509-4fb0-9793-3797bfaeb08b tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:32.650854 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c5870674-9509-4fb0-9793-3797bfaeb08b tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:32.651312 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c5870674-9509-4fb0-9793-3797bfaeb08b tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:32.651740 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c5870674-9509-4fb0-9793-3797bfaeb08b tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:32.876490 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c5870674-9509-4fb0-9793-3797bfaeb08b tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8358c07e2684b749a62becb9f0b7869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b922a74c1c2448bb770d6b298b2d601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:32.886476 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c5870674-9509-4fb0-9793-3797bfaeb08b tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53" status: 200 len: 1477 microversion: 2.1 time: 0.267504 Oct 04 18:40:32.887239 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1538/3065] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:32 2022] GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53 => generated 1477 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:32.892568 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-19b49ffb-f67e-4b4c-9f28-720b2e938426 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:32.893618 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-19b49ffb-f67e-4b4c-9f28-720b2e938426 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] [instance: 0212406a-acc5-4631-90e8-03f4409c07f1] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:32.901019 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-19b49ffb-f67e-4b4c-9f28-720b2e938426 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:32.901779 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-19b49ffb-f67e-4b4c-9f28-720b2e938426 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:32.902400 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-19b49ffb-f67e-4b4c-9f28-720b2e938426 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:32.904660 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-19b49ffb-f67e-4b4c-9f28-720b2e938426 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:32.904660 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-19b49ffb-f67e-4b4c-9f28-720b2e938426 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:32.904660 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-19b49ffb-f67e-4b4c-9f28-720b2e938426 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:32.934249 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2f0327c7-827f-4530-a896-a7328ea116f9 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 250 microversion: 2.1 time: 0.537718 Oct 04 18:40:32.935039 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1528/3066] 10.222.0.20 () {60 vars in 1180 bytes} [Tue Oct 4 18:40:32 2022] POST /compute/v2.1/os-security-groups => generated 250 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:40:32.948725 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-17afeff2-696e-46f7-a999-7a04c94b03c5 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:32.950350 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-17afeff2-696e-46f7-a999-7a04c94b03c5 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 3ead1560-9c23-48ad-a938-6b3179b70035] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:32.958581 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-17afeff2-696e-46f7-a999-7a04c94b03c5 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:32.959325 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-17afeff2-696e-46f7-a999-7a04c94b03c5 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:32.960826 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-17afeff2-696e-46f7-a999-7a04c94b03c5 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:32.961883 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-17afeff2-696e-46f7-a999-7a04c94b03c5 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:32.962627 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-17afeff2-696e-46f7-a999-7a04c94b03c5 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:32.964304 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-17afeff2-696e-46f7-a999-7a04c94b03c5 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:32.983022 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-17afeff2-696e-46f7-a999-7a04c94b03c5 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] HTTP exception thrown: Instance 3ead1560-9c23-48ad-a938-6b3179b70035 could not be found. Oct 04 18:40:32.984860 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-17afeff2-696e-46f7-a999-7a04c94b03c5 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Request method failure captured: Oct 04 18:40:32.984860 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035 HTTP/1.1 Oct 04 18:40:32.984860 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:40:32.984860 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:40:32.984860 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:40:32.984860 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:40:32.984860 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:40:32.984860 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:40:32.984860 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:40:32.984860 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:40:32.984860 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPHylsKzjtTxyxS0lRqrj_KKSHumQgnOG3Ln0f2NoBBXSlSndXbgjyNARvMhAdpUmCrlgZVfzLc5kR-MOiq9TLRM9-w_rTnBF0C_aaOdomrRR_ZDdz3aXjH-fV-MvOq-mBrOl495C0svvDTNQlP-eceEwuANK9BqMrZBbw6QMmsoD0uc Oct 04 18:40:32.984860 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:40:32.984860 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:40:32.984860 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:40:32.984860 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:40:32.984860 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:40:32.984860 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:40:32.984860 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 552ab59dabe840cb8582c54bedc49b09 Oct 04 18:40:32.984860 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-MigrationsAdminTest-1038574730 Oct 04 18:40:32.984860 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:40:32.984860 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:40:32.984860 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/552ab59dabe840cb8582c54bedc49b09"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_552ab59dabe840cb8582c54bedc49b09", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/552ab59dabe840cb8582c54bedc49b09"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/552ab59dabe840cb8582c54bedc49b09"}]}] Oct 04 18:40:32.984860 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-MigrationsAdminTest-1038574730 Oct 04 18:40:32.984860 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 552ab59dabe840cb8582c54bedc49b09 Oct 04 18:40:32.984860 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-MigrationsAdminTest-1038574730 Oct 04 18:40:32.984860 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-MigrationsAdminTest-1038574730-project Oct 04 18:40:32.984860 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:40:32.984860 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:40:32.984860 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 9b05d1f8b9014e798926f9c496885a4d Oct 04 18:40:32.984860 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-MigrationsAdminTest-1038574730-project Oct 04 18:40:32.984860 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:40:32.984860 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 3ead1560-9c23-48ad-a938-6b3179b70035 could not be found. Oct 04 18:40:32.984860 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '3ead1560-9c23-48ad-a938-6b3179b70035'} Oct 04 18:40:32.984860 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:40:32.984860 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:32.984860 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:40:32.984860 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:40:32.984860 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:40:32.984860 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:40:32.984860 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:40:32.984860 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:40:32.984860 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:40:32.984860 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:40:32.984860 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ead1560-9c23-48ad-a938-6b3179b70035 could not be found. Oct 04 18:40:32.984860 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:40:32.984860 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:32.984860 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:40:32.984860 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:32.984860 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:40:32.984860 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:40:32.984860 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:40:32.984860 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:40:32.984860 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:40:32.984860 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:40:32.984860 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:40:32.984860 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:40:32.984860 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:40:32.984860 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:40:32.984860 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:40:32.984860 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:40:32.984860 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ead1560-9c23-48ad-a938-6b3179b70035 could not be found. Oct 04 18:40:32.984860 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:40:32.984860 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:32.984860 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:40:32.990117 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:32.990117 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:40:32.990117 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:40:32.990117 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:40:32.990117 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:40:32.990117 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ead1560-9c23-48ad-a938-6b3179b70035 could not be found. Oct 04 18:40:32.990117 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:40:32.992247 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-17afeff2-696e-46f7-a999-7a04c94b03c5 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Returning 404 to user: Instance 3ead1560-9c23-48ad-a938-6b3179b70035 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:40:32.993670 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-17afeff2-696e-46f7-a999-7a04c94b03c5 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035" status: 404 len: 111 microversion: 2.1 time: 0.057465 Oct 04 18:40:32.994777 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1529/3067] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:32 2022] GET /compute/v2.1/servers/3ead1560-9c23-48ad-a938-6b3179b70035 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:40:33.000724 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1ff92583-84fc-4fbd-8853-bc67b678387c tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1672273147"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:40:33.001668 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1ff92583-84fc-4fbd-8853-bc67b678387c tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] [instance: 6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:33.009898 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-19b49ffb-f67e-4b4c-9f28-720b2e938426 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:33.011131 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1ff92583-84fc-4fbd-8853-bc67b678387c tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:33.011992 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1ff92583-84fc-4fbd-8853-bc67b678387c tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:33.012639 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1ff92583-84fc-4fbd-8853-bc67b678387c tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:33.013928 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1ff92583-84fc-4fbd-8853-bc67b678387c tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:33.014171 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=100 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:40:33.014873 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1ff92583-84fc-4fbd-8853-bc67b678387c tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:33.015487 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1ff92583-84fc-4fbd-8853-bc67b678387c tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:33.022369 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-19b49ffb-f67e-4b4c-9f28-720b2e938426 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:33.024493 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-19b49ffb-f67e-4b4c-9f28-720b2e938426 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:33.030458 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-19b49ffb-f67e-4b4c-9f28-720b2e938426 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] 10.222.0.20 "GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1" status: 200 len: 1446 microversion: 2.75 time: 0.141716 Oct 04 18:40:33.031525 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1539/3068] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:32 2022] GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1 => generated 1446 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:33.036604 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-03aa3307-d3d8-458a-adba-26cf5b3a3c09 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:33.037307 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-03aa3307-d3d8-458a-adba-26cf5b3a3c09 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] [instance: 1b0129be-f5f9-4735-a10a-008bddc30ab4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:33.043871 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-03aa3307-d3d8-458a-adba-26cf5b3a3c09 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:33.050012 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-03aa3307-d3d8-458a-adba-26cf5b3a3c09 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:33.050012 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-03aa3307-d3d8-458a-adba-26cf5b3a3c09 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:33.050012 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-03aa3307-d3d8-458a-adba-26cf5b3a3c09 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:33.050012 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-03aa3307-d3d8-458a-adba-26cf5b3a3c09 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:33.050012 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-03aa3307-d3d8-458a-adba-26cf5b3a3c09 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:33.171212 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-03aa3307-d3d8-458a-adba-26cf5b3a3c09 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:33.193112 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-03aa3307-d3d8-458a-adba-26cf5b3a3c09 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:33.195228 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-03aa3307-d3d8-458a-adba-26cf5b3a3c09 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:33.196604 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-03aa3307-d3d8-458a-adba-26cf5b3a3c09 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] 10.222.0.20 "GET /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4" status: 200 len: 1366 microversion: 2.47 time: 0.163802 Oct 04 18:40:33.197812 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1540/3069] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:33 2022] GET /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:33.205452 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-60eb4257-52a4-4d62-9043-27a64618616f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:33.205452 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-60eb4257-52a4-4d62-9043-27a64618616f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2fe6c508-f183-40bd-bfd5-23c757e99a05] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:33.220679 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-60eb4257-52a4-4d62-9043-27a64618616f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:33.221181 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-60eb4257-52a4-4d62-9043-27a64618616f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:33.221623 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-60eb4257-52a4-4d62-9043-27a64618616f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:33.222354 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-60eb4257-52a4-4d62-9043-27a64618616f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:33.222800 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-60eb4257-52a4-4d62-9043-27a64618616f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:33.223225 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-60eb4257-52a4-4d62-9043-27a64618616f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:33.233272 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.network.security_group_api [None req-1ff92583-84fc-4fbd-8853-bc67b678387c tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Adding security group 09090d37-07a6-4b28-8916-6dbdfc8793b4 to port c22b4d3b-0439-436b-bdf6-38e75b8da2dd Oct 04 18:40:33.252034 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-60eb4257-52a4-4d62-9043-27a64618616f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2fe6c508-f183-40bd-bfd5-23c757e99a05] Going to try to terminate instance {{(pid=123002) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:40:33.628945 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-60eb4257-52a4-4d62-9043-27a64618616f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05" status: 204 len: 0 microversion: 2.1 time: 0.430194 Oct 04 18:40:33.630518 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1541/3070] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:40:33 2022] DELETE /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:40:33.637719 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-77342bf1-7310-40b7-a322-e7f7e94d2c05 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:33.647811 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-77342bf1-7310-40b7-a322-e7f7e94d2c05 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] [instance: 3d3cabc2-fa23-4098-9197-9aaa19a0c663] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:33.685472 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-77342bf1-7310-40b7-a322-e7f7e94d2c05 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:33.685981 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-77342bf1-7310-40b7-a322-e7f7e94d2c05 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:33.686424 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-77342bf1-7310-40b7-a322-e7f7e94d2c05 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:33.687143 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-77342bf1-7310-40b7-a322-e7f7e94d2c05 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:33.687602 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-77342bf1-7310-40b7-a322-e7f7e94d2c05 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:33.688101 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-77342bf1-7310-40b7-a322-e7f7e94d2c05 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:34.019215 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-77342bf1-7310-40b7-a322-e7f7e94d2c05 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:34.052002 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-77342bf1-7310-40b7-a322-e7f7e94d2c05 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:34.054345 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-77342bf1-7310-40b7-a322-e7f7e94d2c05 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:34.068531 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-77342bf1-7310-40b7-a322-e7f7e94d2c05 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] 10.222.0.20 "GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663" status: 200 len: 1869 microversion: 2.42 time: 0.423831 Oct 04 18:40:34.068531 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1542/3071] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:33 2022] GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663 => generated 1869 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:34.068531 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-59995984-7399-489d-9ef5-340a27a0db7b tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:34.068531 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-59995984-7399-489d-9ef5-340a27a0db7b tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] [instance: d607218c-7a38-4b49-bb51-7e1adfda8c6a] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:34.074698 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-59995984-7399-489d-9ef5-340a27a0db7b tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:34.075419 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-59995984-7399-489d-9ef5-340a27a0db7b tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:34.075812 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-59995984-7399-489d-9ef5-340a27a0db7b tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:34.076705 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-59995984-7399-489d-9ef5-340a27a0db7b tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:34.078251 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-59995984-7399-489d-9ef5-340a27a0db7b tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:34.078750 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-59995984-7399-489d-9ef5-340a27a0db7b tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:34.098257 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1ff92583-84fc-4fbd-8853-bc67b678387c tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] 10.222.0.20 "POST /compute/v2.1/servers/6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28/action" status: 202 len: 0 microversion: 2.1 time: 1.102223 Oct 04 18:40:34.099106 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1530/3072] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:40:32 2022] POST /compute/v2.1/servers/6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28/action => generated 0 bytes in 1104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:40:34.114513 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-464dcf4e-9822-48ba-b5e6-d45e8badf85f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:34.119548 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-464dcf4e-9822-48ba-b5e6-d45e8badf85f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2fe6c508-f183-40bd-bfd5-23c757e99a05] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:34.135664 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-464dcf4e-9822-48ba-b5e6-d45e8badf85f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:34.136461 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-464dcf4e-9822-48ba-b5e6-d45e8badf85f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:34.137056 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-464dcf4e-9822-48ba-b5e6-d45e8badf85f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:34.137922 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-464dcf4e-9822-48ba-b5e6-d45e8badf85f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:34.138558 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-464dcf4e-9822-48ba-b5e6-d45e8badf85f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:34.139140 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-464dcf4e-9822-48ba-b5e6-d45e8badf85f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:34.175780 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-59995984-7399-489d-9ef5-340a27a0db7b tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3499c88686046b8a80bc3a754f016e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08896629a67f488b87a845e57a9ca372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:34.199431 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-59995984-7399-489d-9ef5-340a27a0db7b tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] 10.222.0.20 "GET /compute/v2.1/servers/d607218c-7a38-4b49-bb51-7e1adfda8c6a" status: 200 len: 1228 microversion: 2.1 time: 0.130322 Oct 04 18:40:34.218634 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1543/3073] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:34 2022] GET /compute/v2.1/servers/d607218c-7a38-4b49-bb51-7e1adfda8c6a => generated 1228 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:34.218634 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5bdecc02-83ef-4ada-be4c-a7a2c8fb486a tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:34.218634 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5bdecc02-83ef-4ada-be4c-a7a2c8fb486a tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: c343931b-bc96-4e9e-a5ce-f93454339a53] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:34.243479 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5bdecc02-83ef-4ada-be4c-a7a2c8fb486a tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:34.244310 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5bdecc02-83ef-4ada-be4c-a7a2c8fb486a tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:34.245008 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5bdecc02-83ef-4ada-be4c-a7a2c8fb486a tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:34.247950 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5bdecc02-83ef-4ada-be4c-a7a2c8fb486a tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:34.249102 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5bdecc02-83ef-4ada-be4c-a7a2c8fb486a tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:34.250108 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5bdecc02-83ef-4ada-be4c-a7a2c8fb486a tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:34.506082 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-464dcf4e-9822-48ba-b5e6-d45e8badf85f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:34.523763 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-464dcf4e-9822-48ba-b5e6-d45e8badf85f tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05" status: 200 len: 1469 microversion: 2.1 time: 0.419777 Oct 04 18:40:34.524427 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1531/3074] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:34 2022] GET /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05 => generated 1469 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:34.529927 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b599aa0d-adc3-431b-8e50-1deb8e384160 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:34.530578 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b599aa0d-adc3-431b-8e50-1deb8e384160 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] [instance: 0212406a-acc5-4631-90e8-03f4409c07f1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:34.544450 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b599aa0d-adc3-431b-8e50-1deb8e384160 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:34.546017 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b599aa0d-adc3-431b-8e50-1deb8e384160 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:34.546835 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b599aa0d-adc3-431b-8e50-1deb8e384160 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:34.548520 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b599aa0d-adc3-431b-8e50-1deb8e384160 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:34.560232 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b599aa0d-adc3-431b-8e50-1deb8e384160 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:34.562666 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b599aa0d-adc3-431b-8e50-1deb8e384160 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:34.654964 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5bdecc02-83ef-4ada-be4c-a7a2c8fb486a tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8358c07e2684b749a62becb9f0b7869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b922a74c1c2448bb770d6b298b2d601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:34.665614 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5bdecc02-83ef-4ada-be4c-a7a2c8fb486a tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53" status: 200 len: 1463 microversion: 2.1 time: 0.456244 Oct 04 18:40:34.666555 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1544/3075] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:34 2022] GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53 => generated 1463 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:34.677627 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-80c03a47-136d-4f36-8562-42e59e63e17c tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1672273147"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:40:34.678181 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-80c03a47-136d-4f36-8562-42e59e63e17c tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] [instance: 6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:34.684797 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-80c03a47-136d-4f36-8562-42e59e63e17c tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:34.685361 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-80c03a47-136d-4f36-8562-42e59e63e17c tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:34.686086 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-80c03a47-136d-4f36-8562-42e59e63e17c tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:34.686799 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-80c03a47-136d-4f36-8562-42e59e63e17c tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:34.687257 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-80c03a47-136d-4f36-8562-42e59e63e17c tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:34.687684 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-80c03a47-136d-4f36-8562-42e59e63e17c tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:34.734522 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b599aa0d-adc3-431b-8e50-1deb8e384160 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:34.745520 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b599aa0d-adc3-431b-8e50-1deb8e384160 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:34.747394 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b599aa0d-adc3-431b-8e50-1deb8e384160 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:34.754878 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b599aa0d-adc3-431b-8e50-1deb8e384160 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] 10.222.0.20 "GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1" status: 200 len: 1446 microversion: 2.75 time: 0.228635 Oct 04 18:40:34.756238 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1532/3076] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:34 2022] GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1 => generated 1446 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:34.762447 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-e6e56a7d-8ebd-47c4-ac08-9d1e406f6819 req-55409e91-024c-4084-a297-3051cc25215f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28", "tag": "c22b4d3b-0439-436b-bdf6-38e75b8da2dd"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:40:34.775744 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-e6e56a7d-8ebd-47c4-ac08-9d1e406f6819 req-55409e91-024c-4084-a297-3051cc25215f service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:34.776639 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-e6e56a7d-8ebd-47c4-ac08-9d1e406f6819 req-55409e91-024c-4084-a297-3051cc25215f service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:34.777399 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-e6e56a7d-8ebd-47c4-ac08-9d1e406f6819 req-55409e91-024c-4084-a297-3051cc25215f service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:34.793309 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-e6e56a7d-8ebd-47c4-ac08-9d1e406f6819 req-55409e91-024c-4084-a297-3051cc25215f service nova] Creating event network-changed:c22b4d3b-0439-436b-bdf6-38e75b8da2dd for instance 6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28 on n-h1-850501-14 Oct 04 18:40:34.798635 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-e6e56a7d-8ebd-47c4-ac08-9d1e406f6819 req-55409e91-024c-4084-a297-3051cc25215f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040175 Oct 04 18:40:34.799280 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1533/3077] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:40:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:40:34.805670 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-285ffc7b-83f0-46c7-8946-8e6b5f8dab59 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:34.807444 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-285ffc7b-83f0-46c7-8946-8e6b5f8dab59 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] [instance: 1b0129be-f5f9-4735-a10a-008bddc30ab4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:34.815536 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-285ffc7b-83f0-46c7-8946-8e6b5f8dab59 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:34.816486 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-285ffc7b-83f0-46c7-8946-8e6b5f8dab59 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:34.817112 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-285ffc7b-83f0-46c7-8946-8e6b5f8dab59 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:34.818027 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-285ffc7b-83f0-46c7-8946-8e6b5f8dab59 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:34.818723 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-285ffc7b-83f0-46c7-8946-8e6b5f8dab59 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:34.819403 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-285ffc7b-83f0-46c7-8946-8e6b5f8dab59 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:35.005852 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-285ffc7b-83f0-46c7-8946-8e6b5f8dab59 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:35.017105 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-285ffc7b-83f0-46c7-8946-8e6b5f8dab59 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:35.019142 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-285ffc7b-83f0-46c7-8946-8e6b5f8dab59 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:35.021108 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-285ffc7b-83f0-46c7-8946-8e6b5f8dab59 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] 10.222.0.20 "GET /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4" status: 200 len: 1366 microversion: 2.47 time: 0.220423 Oct 04 18:40:35.022256 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1534/3078] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:34 2022] GET /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4 => generated 1366 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:35.029498 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6d92b48d-eb05-4891-bc61-781dfd259f49 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:35.030447 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6d92b48d-eb05-4891-bc61-781dfd259f49 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: c343931b-bc96-4e9e-a5ce-f93454339a53] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:35.049680 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6d92b48d-eb05-4891-bc61-781dfd259f49 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:35.051445 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6d92b48d-eb05-4891-bc61-781dfd259f49 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:35.052256 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6d92b48d-eb05-4891-bc61-781dfd259f49 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:35.053300 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6d92b48d-eb05-4891-bc61-781dfd259f49 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:35.054836 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6d92b48d-eb05-4891-bc61-781dfd259f49 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:35.055490 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6d92b48d-eb05-4891-bc61-781dfd259f49 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:35.164222 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.network.security_group_api [None req-80c03a47-136d-4f36-8562-42e59e63e17c tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Removing security group 09090d37-07a6-4b28-8916-6dbdfc8793b4 from port c22b4d3b-0439-436b-bdf6-38e75b8da2dd Oct 04 18:40:35.521122 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6d92b48d-eb05-4891-bc61-781dfd259f49 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8358c07e2684b749a62becb9f0b7869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b922a74c1c2448bb770d6b298b2d601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:35.529539 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6d92b48d-eb05-4891-bc61-781dfd259f49 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53" status: 200 len: 1463 microversion: 2.1 time: 0.506094 Oct 04 18:40:35.544425 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1535/3079] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:35 2022] GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53 => generated 1463 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:35.551856 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0946c4aa-5cd3-49d4-a8d4-622695ab563a tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:35.552620 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0946c4aa-5cd3-49d4-a8d4-622695ab563a tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] [instance: 3d3cabc2-fa23-4098-9197-9aaa19a0c663] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:35.566235 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0946c4aa-5cd3-49d4-a8d4-622695ab563a tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:35.566235 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0946c4aa-5cd3-49d4-a8d4-622695ab563a tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:35.566235 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0946c4aa-5cd3-49d4-a8d4-622695ab563a tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:35.566235 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0946c4aa-5cd3-49d4-a8d4-622695ab563a tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:35.566235 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0946c4aa-5cd3-49d4-a8d4-622695ab563a tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:35.566235 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0946c4aa-5cd3-49d4-a8d4-622695ab563a tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:36.392633 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0946c4aa-5cd3-49d4-a8d4-622695ab563a tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:36.402346 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0946c4aa-5cd3-49d4-a8d4-622695ab563a tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:36.403795 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0946c4aa-5cd3-49d4-a8d4-622695ab563a tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:36.404971 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0946c4aa-5cd3-49d4-a8d4-622695ab563a tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] 10.222.0.20 "GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663" status: 200 len: 1869 microversion: 2.42 time: 0.859487 Oct 04 18:40:36.405902 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1536/3080] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:35 2022] GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663 => generated 1869 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:36.420971 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-da6eacd2-194a-4a54-aea1-cbe7f0eb8982 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:36.421601 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-da6eacd2-194a-4a54-aea1-cbe7f0eb8982 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] [instance: d607218c-7a38-4b49-bb51-7e1adfda8c6a] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:36.432528 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-da6eacd2-194a-4a54-aea1-cbe7f0eb8982 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:36.433032 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-da6eacd2-194a-4a54-aea1-cbe7f0eb8982 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:36.433475 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-da6eacd2-194a-4a54-aea1-cbe7f0eb8982 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:36.434182 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-da6eacd2-194a-4a54-aea1-cbe7f0eb8982 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:36.434643 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-da6eacd2-194a-4a54-aea1-cbe7f0eb8982 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:36.435073 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-da6eacd2-194a-4a54-aea1-cbe7f0eb8982 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:36.570781 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-da6eacd2-194a-4a54-aea1-cbe7f0eb8982 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3499c88686046b8a80bc3a754f016e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08896629a67f488b87a845e57a9ca372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:36.578833 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-da6eacd2-194a-4a54-aea1-cbe7f0eb8982 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] 10.222.0.20 "GET /compute/v2.1/servers/d607218c-7a38-4b49-bb51-7e1adfda8c6a" status: 200 len: 1282 microversion: 2.1 time: 0.172138 Oct 04 18:40:36.579411 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1537/3081] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:36 2022] GET /compute/v2.1/servers/d607218c-7a38-4b49-bb51-7e1adfda8c6a => generated 1282 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:36.584017 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b440a556-46b9-40db-8969-9a9b225735c7 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:36.585753 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b440a556-46b9-40db-8969-9a9b225735c7 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2fe6c508-f183-40bd-bfd5-23c757e99a05] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:36.593247 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b440a556-46b9-40db-8969-9a9b225735c7 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:36.594442 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b440a556-46b9-40db-8969-9a9b225735c7 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:36.595248 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b440a556-46b9-40db-8969-9a9b225735c7 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:36.596590 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b440a556-46b9-40db-8969-9a9b225735c7 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:36.597065 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b440a556-46b9-40db-8969-9a9b225735c7 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:36.597505 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b440a556-46b9-40db-8969-9a9b225735c7 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:36.696812 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-80c03a47-136d-4f36-8562-42e59e63e17c tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] 10.222.0.20 "POST /compute/v2.1/servers/6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28/action" status: 202 len: 0 microversion: 2.1 time: 2.028944 Oct 04 18:40:36.698595 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1545/3082] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:40:34 2022] POST /compute/v2.1/servers/6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28/action => generated 0 bytes in 2031 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:40:36.704879 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-10364dfa-ef60-4bc2-8333-de57677a2afd tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:40:36.708730 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-10364dfa-ef60-4bc2-8333-de57677a2afd tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: c343931b-bc96-4e9e-a5ce-f93454339a53] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:36.716038 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-10364dfa-ef60-4bc2-8333-de57677a2afd tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:36.716562 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-10364dfa-ef60-4bc2-8333-de57677a2afd tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:36.718107 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-10364dfa-ef60-4bc2-8333-de57677a2afd tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:36.718507 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-10364dfa-ef60-4bc2-8333-de57677a2afd tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:36.719489 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-10364dfa-ef60-4bc2-8333-de57677a2afd tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:36.720119 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-10364dfa-ef60-4bc2-8333-de57677a2afd tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:36.728972 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b440a556-46b9-40db-8969-9a9b225735c7 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b05d1f8b9014e798926f9c496885a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552ab59dabe840cb8582c54bedc49b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:36.747271 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b440a556-46b9-40db-8969-9a9b225735c7 tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05" status: 200 len: 1427 microversion: 2.1 time: 0.165973 Oct 04 18:40:36.748334 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1538/3083] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:36 2022] GET /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05 => generated 1427 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:36.754021 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3a41d33b-804c-435e-ba72-e72bc9d40747 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:36.754964 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3a41d33b-804c-435e-ba72-e72bc9d40747 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] [instance: 0212406a-acc5-4631-90e8-03f4409c07f1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:36.778024 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3a41d33b-804c-435e-ba72-e72bc9d40747 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:36.778635 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3a41d33b-804c-435e-ba72-e72bc9d40747 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:36.779473 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3a41d33b-804c-435e-ba72-e72bc9d40747 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:36.780320 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3a41d33b-804c-435e-ba72-e72bc9d40747 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:36.780777 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3a41d33b-804c-435e-ba72-e72bc9d40747 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:36.781292 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3a41d33b-804c-435e-ba72-e72bc9d40747 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:36.839975 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-10364dfa-ef60-4bc2-8333-de57677a2afd tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:40:36.840398 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-10364dfa-ef60-4bc2-8333-de57677a2afd tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:40:36.841118 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-10364dfa-ef60-4bc2-8333-de57677a2afd tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:40:36.841745 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-10364dfa-ef60-4bc2-8333-de57677a2afd tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:40:36.842353 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-10364dfa-ef60-4bc2-8333-de57677a2afd tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:40:36.991590 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3a41d33b-804c-435e-ba72-e72bc9d40747 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:37.006311 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3a41d33b-804c-435e-ba72-e72bc9d40747 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:37.007931 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3a41d33b-804c-435e-ba72-e72bc9d40747 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:37.013813 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3a41d33b-804c-435e-ba72-e72bc9d40747 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] 10.222.0.20 "GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1" status: 200 len: 1446 microversion: 2.75 time: 0.264205 Oct 04 18:40:37.028724 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1539/3084] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:36 2022] GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1 => generated 1446 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:37.041370 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5e80c4ae-4829-4e3c-8cd8-b33709c31194 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:37.041998 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5e80c4ae-4829-4e3c-8cd8-b33709c31194 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] [instance: 1b0129be-f5f9-4735-a10a-008bddc30ab4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:37.048621 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5e80c4ae-4829-4e3c-8cd8-b33709c31194 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:37.051788 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5e80c4ae-4829-4e3c-8cd8-b33709c31194 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:37.051788 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5e80c4ae-4829-4e3c-8cd8-b33709c31194 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:37.051788 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5e80c4ae-4829-4e3c-8cd8-b33709c31194 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:37.051788 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5e80c4ae-4829-4e3c-8cd8-b33709c31194 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:37.051788 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5e80c4ae-4829-4e3c-8cd8-b33709c31194 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:37.067634 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-10364dfa-ef60-4bc2-8333-de57677a2afd tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: c343931b-bc96-4e9e-a5ce-f93454339a53] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:37.085676 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-10364dfa-ef60-4bc2-8333-de57677a2afd tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:37.094117 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-10364dfa-ef60-4bc2-8333-de57677a2afd tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:37.094740 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-10364dfa-ef60-4bc2-8333-de57677a2afd tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:37.095497 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-10364dfa-ef60-4bc2-8333-de57677a2afd tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:37.095966 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-10364dfa-ef60-4bc2-8333-de57677a2afd tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:37.096423 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-10364dfa-ef60-4bc2-8333-de57677a2afd tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:37.135261 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-10364dfa-ef60-4bc2-8333-de57677a2afd tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "POST /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53/action" status: 202 len: 1067 microversion: 2.1 time: 0.435148 Oct 04 18:40:37.136956 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1546/3085] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:40:36 2022] POST /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53/action => generated 1067 bytes in 438 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 04 18:40:37.144157 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e414fc67-9e20-4a10-9d21-9a976c3bded6 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Action: 'create', calling method: .version_select at 0x7fe258062790>, body: {"pool": null} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:40:37.154545 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5e80c4ae-4829-4e3c-8cd8-b33709c31194 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:37.167821 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5e80c4ae-4829-4e3c-8cd8-b33709c31194 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:37.169604 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5e80c4ae-4829-4e3c-8cd8-b33709c31194 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:37.170784 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5e80c4ae-4829-4e3c-8cd8-b33709c31194 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] 10.222.0.20 "GET /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4" status: 200 len: 1366 microversion: 2.47 time: 0.140812 Oct 04 18:40:37.171346 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1540/3086] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:37 2022] GET /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4 => generated 1366 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:37.180581 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-f0dbf090-9ef5-44fc-9792-ad2ed9166529 req-5df4d65c-58da-4e10-82da-b40960e0d616 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fe6c508-f183-40bd-bfd5-23c757e99a05", "name": "network-vif-deleted", "tag": "4ffbd68f-521b-46aa-9313-bc62980cacb6"}, {"name": "network-changed", "server_uuid": "6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28", "tag": "c22b4d3b-0439-436b-bdf6-38e75b8da2dd"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:40:37.194754 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-f0dbf090-9ef5-44fc-9792-ad2ed9166529 req-5df4d65c-58da-4e10-82da-b40960e0d616 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:37.195364 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-f0dbf090-9ef5-44fc-9792-ad2ed9166529 req-5df4d65c-58da-4e10-82da-b40960e0d616 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:37.195805 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-f0dbf090-9ef5-44fc-9792-ad2ed9166529 req-5df4d65c-58da-4e10-82da-b40960e0d616 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:37.215821 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-f0dbf090-9ef5-44fc-9792-ad2ed9166529 req-5df4d65c-58da-4e10-82da-b40960e0d616 service nova] Creating event network-vif-deleted:4ffbd68f-521b-46aa-9313-bc62980cacb6 for instance 2fe6c508-f183-40bd-bfd5-23c757e99a05 on n-h2-850501-14 Oct 04 18:40:37.216839 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-f0dbf090-9ef5-44fc-9792-ad2ed9166529 req-5df4d65c-58da-4e10-82da-b40960e0d616 service nova] Creating event network-changed:c22b4d3b-0439-436b-bdf6-38e75b8da2dd for instance 6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28 on n-h1-850501-14 Oct 04 18:40:37.232735 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-f0dbf090-9ef5-44fc-9792-ad2ed9166529 req-5df4d65c-58da-4e10-82da-b40960e0d616 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.059644 Oct 04 18:40:37.233909 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1541/3087] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:40:37 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:40:37.240654 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f4600f80-9b7c-4148-bc70-a115c4f21d74 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:37.242754 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f4600f80-9b7c-4148-bc70-a115c4f21d74 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: c343931b-bc96-4e9e-a5ce-f93454339a53] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:37.251042 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f4600f80-9b7c-4148-bc70-a115c4f21d74 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:37.251820 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f4600f80-9b7c-4148-bc70-a115c4f21d74 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:37.252609 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f4600f80-9b7c-4148-bc70-a115c4f21d74 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:37.253539 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f4600f80-9b7c-4148-bc70-a115c4f21d74 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:37.254409 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f4600f80-9b7c-4148-bc70-a115c4f21d74 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:37.255048 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f4600f80-9b7c-4148-bc70-a115c4f21d74 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:37.755144 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f4600f80-9b7c-4148-bc70-a115c4f21d74 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8358c07e2684b749a62becb9f0b7869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b922a74c1c2448bb770d6b298b2d601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:37.765035 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f4600f80-9b7c-4148-bc70-a115c4f21d74 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53" status: 200 len: 1472 microversion: 2.1 time: 0.529212 Oct 04 18:40:37.765627 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1542/3088] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:37 2022] GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53 => generated 1472 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:37.771114 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-de8bb8b3-27e9-473b-8920-23356e9dc27a tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:37.771939 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-de8bb8b3-27e9-473b-8920-23356e9dc27a tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] [instance: 3d3cabc2-fa23-4098-9197-9aaa19a0c663] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:37.778689 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-de8bb8b3-27e9-473b-8920-23356e9dc27a tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:37.781963 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-de8bb8b3-27e9-473b-8920-23356e9dc27a tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:37.781963 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-de8bb8b3-27e9-473b-8920-23356e9dc27a tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:37.781963 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-de8bb8b3-27e9-473b-8920-23356e9dc27a tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:37.781963 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-de8bb8b3-27e9-473b-8920-23356e9dc27a tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:37.781963 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-de8bb8b3-27e9-473b-8920-23356e9dc27a tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:37.785971 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=100 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:40:38.321844 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-de8bb8b3-27e9-473b-8920-23356e9dc27a tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:38.332368 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-de8bb8b3-27e9-473b-8920-23356e9dc27a tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:38.334053 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-de8bb8b3-27e9-473b-8920-23356e9dc27a tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:38.336165 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-de8bb8b3-27e9-473b-8920-23356e9dc27a tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] 10.222.0.20 "GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663" status: 200 len: 1869 microversion: 2.42 time: 0.569208 Oct 04 18:40:38.337263 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1543/3089] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:37 2022] GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663 => generated 1869 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:38.341932 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3818dd3c-17ca-46f0-acf6-f24000c075ab tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:38.342549 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3818dd3c-17ca-46f0-acf6-f24000c075ab tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] [instance: d607218c-7a38-4b49-bb51-7e1adfda8c6a] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:38.348833 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3818dd3c-17ca-46f0-acf6-f24000c075ab tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:38.349326 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3818dd3c-17ca-46f0-acf6-f24000c075ab tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:38.349769 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3818dd3c-17ca-46f0-acf6-f24000c075ab tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:38.350817 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3818dd3c-17ca-46f0-acf6-f24000c075ab tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:38.351392 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3818dd3c-17ca-46f0-acf6-f24000c075ab tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:38.351828 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3818dd3c-17ca-46f0-acf6-f24000c075ab tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:38.643058 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3818dd3c-17ca-46f0-acf6-f24000c075ab tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3499c88686046b8a80bc3a754f016e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08896629a67f488b87a845e57a9ca372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:38.654262 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3818dd3c-17ca-46f0-acf6-f24000c075ab tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] 10.222.0.20 "GET /compute/v2.1/servers/d607218c-7a38-4b49-bb51-7e1adfda8c6a" status: 200 len: 1324 microversion: 2.1 time: 0.315771 Oct 04 18:40:38.654890 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1544/3090] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:38 2022] GET /compute/v2.1/servers/d607218c-7a38-4b49-bb51-7e1adfda8c6a => generated 1324 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:38.659469 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8cdbc541-6098-4cd9-82c4-dd7e86c3296a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:38.660094 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8cdbc541-6098-4cd9-82c4-dd7e86c3296a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] [instance: 2fe6c508-f183-40bd-bfd5-23c757e99a05] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:38.666378 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8cdbc541-6098-4cd9-82c4-dd7e86c3296a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:38.666876 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8cdbc541-6098-4cd9-82c4-dd7e86c3296a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:38.667307 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8cdbc541-6098-4cd9-82c4-dd7e86c3296a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:38.668004 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8cdbc541-6098-4cd9-82c4-dd7e86c3296a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:38.668493 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8cdbc541-6098-4cd9-82c4-dd7e86c3296a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:38.669729 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8cdbc541-6098-4cd9-82c4-dd7e86c3296a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:38.683011 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-8cdbc541-6098-4cd9-82c4-dd7e86c3296a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] HTTP exception thrown: Instance 2fe6c508-f183-40bd-bfd5-23c757e99a05 could not be found. Oct 04 18:40:38.684687 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8cdbc541-6098-4cd9-82c4-dd7e86c3296a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Request method failure captured: Oct 04 18:40:38.684687 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05 HTTP/1.1 Oct 04 18:40:38.684687 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:40:38.684687 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:40:38.684687 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:40:38.684687 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:40:38.684687 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:40:38.684687 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:40:38.684687 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:40:38.684687 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:40:38.684687 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPHylsKzjtTxyxS0lRqrj_KKSHumQgnOG3Ln0f2NoBBXSlSndXbgjyNARvMhAdpUmCrlgZVfzLc5kR-MOiq9TLRM9-w_rTnBF0C_aaOdomrRR_ZDdz3aXjH-fV-MvOq-mBrOl495C0svvDTNQlP-eceEwuANK9BqMrZBbw6QMmsoD0uc Oct 04 18:40:38.684687 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:40:38.684687 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:40:38.684687 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:40:38.684687 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:40:38.684687 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:40:38.684687 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:40:38.684687 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 552ab59dabe840cb8582c54bedc49b09 Oct 04 18:40:38.684687 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-MigrationsAdminTest-1038574730 Oct 04 18:40:38.684687 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:40:38.684687 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:40:38.684687 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/552ab59dabe840cb8582c54bedc49b09"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_552ab59dabe840cb8582c54bedc49b09", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/552ab59dabe840cb8582c54bedc49b09"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/552ab59dabe840cb8582c54bedc49b09"}]}] Oct 04 18:40:38.684687 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-MigrationsAdminTest-1038574730 Oct 04 18:40:38.684687 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 552ab59dabe840cb8582c54bedc49b09 Oct 04 18:40:38.684687 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-MigrationsAdminTest-1038574730 Oct 04 18:40:38.684687 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-MigrationsAdminTest-1038574730-project Oct 04 18:40:38.684687 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:40:38.684687 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:40:38.684687 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 9b05d1f8b9014e798926f9c496885a4d Oct 04 18:40:38.684687 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-MigrationsAdminTest-1038574730-project Oct 04 18:40:38.684687 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:40:38.684687 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 2fe6c508-f183-40bd-bfd5-23c757e99a05 could not be found. Oct 04 18:40:38.684687 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '2fe6c508-f183-40bd-bfd5-23c757e99a05'} Oct 04 18:40:38.684687 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:40:38.684687 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:38.684687 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:40:38.684687 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:40:38.684687 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:40:38.684687 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:40:38.684687 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:40:38.684687 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:40:38.684687 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:40:38.684687 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:40:38.684687 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2fe6c508-f183-40bd-bfd5-23c757e99a05 could not be found. Oct 04 18:40:38.684687 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:40:38.684687 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:38.684687 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:40:38.684687 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:38.684687 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:40:38.684687 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:40:38.684687 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:40:38.684687 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:40:38.684687 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:40:38.684687 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:40:38.684687 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:40:38.684687 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:40:38.684687 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:40:38.684687 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:40:38.684687 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:40:38.684687 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:40:38.684687 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2fe6c508-f183-40bd-bfd5-23c757e99a05 could not be found. Oct 04 18:40:38.684687 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:40:38.684687 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:38.684687 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:40:38.694728 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:38.694728 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:40:38.694728 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:40:38.694728 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:40:38.694728 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:40:38.694728 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2fe6c508-f183-40bd-bfd5-23c757e99a05 could not be found. Oct 04 18:40:38.694728 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:40:38.694728 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8cdbc541-6098-4cd9-82c4-dd7e86c3296a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] Returning 404 to user: Instance 2fe6c508-f183-40bd-bfd5-23c757e99a05 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:40:38.694728 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8cdbc541-6098-4cd9-82c4-dd7e86c3296a tempest-MigrationsAdminTest-1038574730 tempest-MigrationsAdminTest-1038574730-project] 10.222.0.20 "GET /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05" status: 404 len: 111 microversion: 2.1 time: 0.030223 Oct 04 18:40:38.694728 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1545/3091] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:38 2022] GET /compute/v2.1/servers/2fe6c508-f183-40bd-bfd5-23c757e99a05 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:40:38.694728 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6fd01b21-d2f9-4eec-ad72-df135c974717 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:38.694728 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6fd01b21-d2f9-4eec-ad72-df135c974717 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] [instance: 0212406a-acc5-4631-90e8-03f4409c07f1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:38.699583 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6fd01b21-d2f9-4eec-ad72-df135c974717 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:38.700113 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6fd01b21-d2f9-4eec-ad72-df135c974717 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:38.700579 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6fd01b21-d2f9-4eec-ad72-df135c974717 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:38.701273 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6fd01b21-d2f9-4eec-ad72-df135c974717 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:38.701855 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6fd01b21-d2f9-4eec-ad72-df135c974717 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:38.702283 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6fd01b21-d2f9-4eec-ad72-df135c974717 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:39.080663 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6fd01b21-d2f9-4eec-ad72-df135c974717 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:39.091008 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6fd01b21-d2f9-4eec-ad72-df135c974717 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:39.092475 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6fd01b21-d2f9-4eec-ad72-df135c974717 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:39.098850 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6fd01b21-d2f9-4eec-ad72-df135c974717 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] 10.222.0.20 "GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1" status: 200 len: 1446 microversion: 2.75 time: 0.410870 Oct 04 18:40:39.099489 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1546/3092] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:38 2022] GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1 => generated 1446 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:39.104916 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-44ebd750-160e-4c45-bc15-618cecd3db2d tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:39.105537 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-44ebd750-160e-4c45-bc15-618cecd3db2d tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] [instance: 1b0129be-f5f9-4735-a10a-008bddc30ab4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:39.111792 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-44ebd750-160e-4c45-bc15-618cecd3db2d tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:39.112675 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-44ebd750-160e-4c45-bc15-618cecd3db2d tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:39.113063 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-44ebd750-160e-4c45-bc15-618cecd3db2d tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:39.113782 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-44ebd750-160e-4c45-bc15-618cecd3db2d tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:39.114224 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-44ebd750-160e-4c45-bc15-618cecd3db2d tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:39.114952 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-44ebd750-160e-4c45-bc15-618cecd3db2d tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:39.227299 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-44ebd750-160e-4c45-bc15-618cecd3db2d tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:39.243778 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-44ebd750-160e-4c45-bc15-618cecd3db2d tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:39.246203 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-44ebd750-160e-4c45-bc15-618cecd3db2d tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:39.247069 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-44ebd750-160e-4c45-bc15-618cecd3db2d tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] 10.222.0.20 "GET /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4" status: 200 len: 1366 microversion: 2.47 time: 0.146630 Oct 04 18:40:39.247886 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1547/3093] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:39 2022] GET /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4 => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:39.252835 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1d9f25f3-62d5-436e-a976-033b3152e811 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:39.253790 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1d9f25f3-62d5-436e-a976-033b3152e811 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: c343931b-bc96-4e9e-a5ce-f93454339a53] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:39.262150 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1d9f25f3-62d5-436e-a976-033b3152e811 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:39.263015 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1d9f25f3-62d5-436e-a976-033b3152e811 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:39.263604 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1d9f25f3-62d5-436e-a976-033b3152e811 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:39.265157 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1d9f25f3-62d5-436e-a976-033b3152e811 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:39.266276 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1d9f25f3-62d5-436e-a976-033b3152e811 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:39.266870 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1d9f25f3-62d5-436e-a976-033b3152e811 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:39.626281 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1d9f25f3-62d5-436e-a976-033b3152e811 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8358c07e2684b749a62becb9f0b7869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b922a74c1c2448bb770d6b298b2d601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:39.644945 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1d9f25f3-62d5-436e-a976-033b3152e811 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53" status: 200 len: 1472 microversion: 2.1 time: 0.395710 Oct 04 18:40:39.646091 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1548/3094] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:39 2022] GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53 => generated 1472 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:39.655735 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0a0e9214-8a55-4ce2-810a-38161332493a tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:39.656447 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0a0e9214-8a55-4ce2-810a-38161332493a tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] [instance: 3d3cabc2-fa23-4098-9197-9aaa19a0c663] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:39.663772 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0a0e9214-8a55-4ce2-810a-38161332493a tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:39.664292 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0a0e9214-8a55-4ce2-810a-38161332493a tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:39.664710 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0a0e9214-8a55-4ce2-810a-38161332493a tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:39.665605 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0a0e9214-8a55-4ce2-810a-38161332493a tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:39.666220 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0a0e9214-8a55-4ce2-810a-38161332493a tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:39.666797 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0a0e9214-8a55-4ce2-810a-38161332493a tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:40.069020 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0a0e9214-8a55-4ce2-810a-38161332493a tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:40.078543 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0a0e9214-8a55-4ce2-810a-38161332493a tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:40.080169 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0a0e9214-8a55-4ce2-810a-38161332493a tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:40.081422 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0a0e9214-8a55-4ce2-810a-38161332493a tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] 10.222.0.20 "GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663" status: 200 len: 1869 microversion: 2.42 time: 0.433699 Oct 04 18:40:40.096404 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1549/3095] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:39 2022] GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663 => generated 1869 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:40.106338 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1907030f-cc26-4820-b8d9-d1b615f3f386 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:40.106964 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1907030f-cc26-4820-b8d9-d1b615f3f386 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] [instance: d607218c-7a38-4b49-bb51-7e1adfda8c6a] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:40.114205 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1907030f-cc26-4820-b8d9-d1b615f3f386 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:40.114766 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1907030f-cc26-4820-b8d9-d1b615f3f386 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:40.116786 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1907030f-cc26-4820-b8d9-d1b615f3f386 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:40.118209 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1907030f-cc26-4820-b8d9-d1b615f3f386 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:40.118862 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1907030f-cc26-4820-b8d9-d1b615f3f386 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:40.119613 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1907030f-cc26-4820-b8d9-d1b615f3f386 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:40.408539 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1907030f-cc26-4820-b8d9-d1b615f3f386 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3499c88686046b8a80bc3a754f016e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08896629a67f488b87a845e57a9ca372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:40.417220 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1907030f-cc26-4820-b8d9-d1b615f3f386 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] 10.222.0.20 "GET /compute/v2.1/servers/d607218c-7a38-4b49-bb51-7e1adfda8c6a" status: 200 len: 1324 microversion: 2.1 time: 0.319443 Oct 04 18:40:40.417796 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1550/3096] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:40 2022] GET /compute/v2.1/servers/d607218c-7a38-4b49-bb51-7e1adfda8c6a => generated 1324 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:40.423081 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0dcdd57d-746e-46e0-9df7-444df9900aab tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:40.423690 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0dcdd57d-746e-46e0-9df7-444df9900aab tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] [instance: 0212406a-acc5-4631-90e8-03f4409c07f1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:40.430750 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0dcdd57d-746e-46e0-9df7-444df9900aab tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:40.431299 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0dcdd57d-746e-46e0-9df7-444df9900aab tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:40.431746 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0dcdd57d-746e-46e0-9df7-444df9900aab tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:40.432690 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0dcdd57d-746e-46e0-9df7-444df9900aab tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:40.433156 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0dcdd57d-746e-46e0-9df7-444df9900aab tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:40.433583 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0dcdd57d-746e-46e0-9df7-444df9900aab tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:40.534209 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0dcdd57d-746e-46e0-9df7-444df9900aab tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:40.543027 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0dcdd57d-746e-46e0-9df7-444df9900aab tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:40.544501 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0dcdd57d-746e-46e0-9df7-444df9900aab tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:40.549533 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0dcdd57d-746e-46e0-9df7-444df9900aab tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] 10.222.0.20 "GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1" status: 200 len: 1446 microversion: 2.75 time: 0.130780 Oct 04 18:40:40.550757 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1551/3097] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:40 2022] GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1 => generated 1446 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:40.555611 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f752a6bc-e313-4fff-ab80-9b2825932441 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:40.556490 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f752a6bc-e313-4fff-ab80-9b2825932441 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] [instance: 1b0129be-f5f9-4735-a10a-008bddc30ab4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:40.562340 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f752a6bc-e313-4fff-ab80-9b2825932441 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:40.562812 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f752a6bc-e313-4fff-ab80-9b2825932441 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:40.563246 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f752a6bc-e313-4fff-ab80-9b2825932441 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:40.563944 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f752a6bc-e313-4fff-ab80-9b2825932441 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:40.564690 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f752a6bc-e313-4fff-ab80-9b2825932441 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:40.565115 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f752a6bc-e313-4fff-ab80-9b2825932441 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:40.653643 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e414fc67-9e20-4a10-9d21-9a976c3bded6 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.514731 Oct 04 18:40:40.654757 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1547/3098] 10.222.0.20 () {60 vars in 1170 bytes} [Tue Oct 4 18:40:37 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3517 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:40:40.663751 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-471b6c03-87a6-447e-b917-f55e7e563afe req-52a97565-eb21-45dd-960d-868342c81f85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d607218c-7a38-4b49-bb51-7e1adfda8c6a", "tag": "a4c07b4b-a6d2-4965-9650-3ce3a87b89ee"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:40:40.674262 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-471b6c03-87a6-447e-b917-f55e7e563afe req-52a97565-eb21-45dd-960d-868342c81f85 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:40.675253 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-471b6c03-87a6-447e-b917-f55e7e563afe req-52a97565-eb21-45dd-960d-868342c81f85 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:40.675938 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-471b6c03-87a6-447e-b917-f55e7e563afe req-52a97565-eb21-45dd-960d-868342c81f85 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:40.683216 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f752a6bc-e313-4fff-ab80-9b2825932441 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:40.693346 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-471b6c03-87a6-447e-b917-f55e7e563afe req-52a97565-eb21-45dd-960d-868342c81f85 service nova] Creating event network-changed:a4c07b4b-a6d2-4965-9650-3ce3a87b89ee for instance d607218c-7a38-4b49-bb51-7e1adfda8c6a on n-h2-850501-14 Oct 04 18:40:40.700873 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-471b6c03-87a6-447e-b917-f55e7e563afe req-52a97565-eb21-45dd-960d-868342c81f85 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040594 Oct 04 18:40:40.702027 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1548/3099] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:40:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:40:40.705337 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f752a6bc-e313-4fff-ab80-9b2825932441 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:40.708796 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1b004800-adf3-4777-a2fc-4e09e4308a14 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Action: 'action', calling method: .version_select at 0x7fe25ac093a0>, body: {"addFloatingIp": {"address": "172.25.1.102"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:40:40.708950 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f752a6bc-e313-4fff-ab80-9b2825932441 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:40.710206 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f752a6bc-e313-4fff-ab80-9b2825932441 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] 10.222.0.20 "GET /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4" status: 200 len: 1366 microversion: 2.47 time: 0.159117 Oct 04 18:40:40.710770 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1552/3100] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:40 2022] GET /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:40.728614 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-82192759-948d-443f-a5f0-18d274b996f4 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:40.732594 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-82192759-948d-443f-a5f0-18d274b996f4 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: c343931b-bc96-4e9e-a5ce-f93454339a53] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:40.742942 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1b004800-adf3-4777-a2fc-4e09e4308a14 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] [instance: 6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:40.745055 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-82192759-948d-443f-a5f0-18d274b996f4 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:40.745558 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-82192759-948d-443f-a5f0-18d274b996f4 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:40.746073 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-82192759-948d-443f-a5f0-18d274b996f4 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:40.746775 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-82192759-948d-443f-a5f0-18d274b996f4 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:40.747230 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-82192759-948d-443f-a5f0-18d274b996f4 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:40.747653 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-82192759-948d-443f-a5f0-18d274b996f4 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:40.758372 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1b004800-adf3-4777-a2fc-4e09e4308a14 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:40.759133 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1b004800-adf3-4777-a2fc-4e09e4308a14 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:40.761520 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1b004800-adf3-4777-a2fc-4e09e4308a14 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:40.761520 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1b004800-adf3-4777-a2fc-4e09e4308a14 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:40.761520 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1b004800-adf3-4777-a2fc-4e09e4308a14 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:40.762169 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1b004800-adf3-4777-a2fc-4e09e4308a14 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:40.837941 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1b004800-adf3-4777-a2fc-4e09e4308a14 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Acquiring lock "refresh_cache-6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28" {{(pid=123002) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 18:40:40.839249 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1b004800-adf3-4777-a2fc-4e09e4308a14 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Acquired lock "refresh_cache-6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28" {{(pid=123002) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 18:40:41.203676 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-82192759-948d-443f-a5f0-18d274b996f4 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8358c07e2684b749a62becb9f0b7869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b922a74c1c2448bb770d6b298b2d601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:41.213128 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-82192759-948d-443f-a5f0-18d274b996f4 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53" status: 200 len: 1472 microversion: 2.1 time: 0.498439 Oct 04 18:40:41.213907 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1553/3101] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:40 2022] GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53 => generated 1472 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:41.219048 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a1ea5452-b72f-4bd5-b10d-e808957f10b3 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:41.220224 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a1ea5452-b72f-4bd5-b10d-e808957f10b3 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] [instance: 3d3cabc2-fa23-4098-9197-9aaa19a0c663] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:41.226542 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a1ea5452-b72f-4bd5-b10d-e808957f10b3 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:41.227232 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a1ea5452-b72f-4bd5-b10d-e808957f10b3 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:41.227819 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a1ea5452-b72f-4bd5-b10d-e808957f10b3 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:41.228991 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a1ea5452-b72f-4bd5-b10d-e808957f10b3 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:41.229879 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a1ea5452-b72f-4bd5-b10d-e808957f10b3 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:41.230444 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a1ea5452-b72f-4bd5-b10d-e808957f10b3 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:41.638062 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a1ea5452-b72f-4bd5-b10d-e808957f10b3 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:41.649240 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a1ea5452-b72f-4bd5-b10d-e808957f10b3 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:41.652673 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a1ea5452-b72f-4bd5-b10d-e808957f10b3 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:41.658256 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a1ea5452-b72f-4bd5-b10d-e808957f10b3 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] 10.222.0.20 "GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663" status: 200 len: 1869 microversion: 2.42 time: 0.443153 Oct 04 18:40:41.660514 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1554/3102] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:41 2022] GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663 => generated 1869 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:41.666230 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c2dcc39e-f7ee-4200-bd92-ebf975205835 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:41.666840 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c2dcc39e-f7ee-4200-bd92-ebf975205835 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] [instance: d607218c-7a38-4b49-bb51-7e1adfda8c6a] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:41.681933 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c2dcc39e-f7ee-4200-bd92-ebf975205835 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:41.682437 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c2dcc39e-f7ee-4200-bd92-ebf975205835 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:41.682858 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c2dcc39e-f7ee-4200-bd92-ebf975205835 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:41.683556 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c2dcc39e-f7ee-4200-bd92-ebf975205835 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:41.684005 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c2dcc39e-f7ee-4200-bd92-ebf975205835 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:41.684448 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c2dcc39e-f7ee-4200-bd92-ebf975205835 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:42.187233 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:40:42.224639 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=6 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:40:42.265184 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c2dcc39e-f7ee-4200-bd92-ebf975205835 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3499c88686046b8a80bc3a754f016e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08896629a67f488b87a845e57a9ca372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:42.276003 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c2dcc39e-f7ee-4200-bd92-ebf975205835 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] 10.222.0.20 "GET /compute/v2.1/servers/d607218c-7a38-4b49-bb51-7e1adfda8c6a" status: 200 len: 1324 microversion: 2.1 time: 0.614231 Oct 04 18:40:42.276616 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1555/3103] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:41 2022] GET /compute/v2.1/servers/d607218c-7a38-4b49-bb51-7e1adfda8c6a => generated 1324 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:42.282670 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-487dbf94-55eb-49cc-a6f1-7509f3edae9e tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:42.283945 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-487dbf94-55eb-49cc-a6f1-7509f3edae9e tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] [instance: 0212406a-acc5-4631-90e8-03f4409c07f1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:42.290710 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-487dbf94-55eb-49cc-a6f1-7509f3edae9e tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:42.291432 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-487dbf94-55eb-49cc-a6f1-7509f3edae9e tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:42.292044 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-487dbf94-55eb-49cc-a6f1-7509f3edae9e tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:42.292768 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-487dbf94-55eb-49cc-a6f1-7509f3edae9e tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:42.293225 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-487dbf94-55eb-49cc-a6f1-7509f3edae9e tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:42.293648 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-487dbf94-55eb-49cc-a6f1-7509f3edae9e tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:42.576387 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:40:42.677537 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-487dbf94-55eb-49cc-a6f1-7509f3edae9e tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:42.691234 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-487dbf94-55eb-49cc-a6f1-7509f3edae9e tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:42.693495 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-487dbf94-55eb-49cc-a6f1-7509f3edae9e tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:42.711616 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-487dbf94-55eb-49cc-a6f1-7509f3edae9e tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] 10.222.0.20 "GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1" status: 200 len: 1446 microversion: 2.75 time: 0.433147 Oct 04 18:40:42.712231 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1556/3104] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:42 2022] GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1 => generated 1446 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:42.719138 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e27142fc-1a71-4ecd-a040-e9d62807160a tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:42.720598 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e27142fc-1a71-4ecd-a040-e9d62807160a tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] [instance: 1b0129be-f5f9-4735-a10a-008bddc30ab4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:42.731637 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e27142fc-1a71-4ecd-a040-e9d62807160a tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:42.743998 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e27142fc-1a71-4ecd-a040-e9d62807160a tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:42.744522 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e27142fc-1a71-4ecd-a040-e9d62807160a tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:42.745440 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e27142fc-1a71-4ecd-a040-e9d62807160a tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:42.745889 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e27142fc-1a71-4ecd-a040-e9d62807160a tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:42.746319 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e27142fc-1a71-4ecd-a040-e9d62807160a tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:42.877587 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e27142fc-1a71-4ecd-a040-e9d62807160a tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:42.892192 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e27142fc-1a71-4ecd-a040-e9d62807160a tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:42.898677 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e27142fc-1a71-4ecd-a040-e9d62807160a tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:42.901560 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e27142fc-1a71-4ecd-a040-e9d62807160a tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] 10.222.0.20 "GET /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4" status: 200 len: 1366 microversion: 2.47 time: 0.188357 Oct 04 18:40:42.912294 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1557/3105] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:42 2022] GET /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4 => generated 1366 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:42.922725 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1bf015e5-4cf4-4b5e-b351-e553badb8930 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:42.923920 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1bf015e5-4cf4-4b5e-b351-e553badb8930 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: c343931b-bc96-4e9e-a5ce-f93454339a53] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:42.939785 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1bf015e5-4cf4-4b5e-b351-e553badb8930 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:42.940674 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1bf015e5-4cf4-4b5e-b351-e553badb8930 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:42.940674 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1bf015e5-4cf4-4b5e-b351-e553badb8930 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:42.942221 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1bf015e5-4cf4-4b5e-b351-e553badb8930 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:42.942681 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1bf015e5-4cf4-4b5e-b351-e553badb8930 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:42.943584 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1bf015e5-4cf4-4b5e-b351-e553badb8930 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:43.225000 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1bf015e5-4cf4-4b5e-b351-e553badb8930 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8358c07e2684b749a62becb9f0b7869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b922a74c1c2448bb770d6b298b2d601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:43.243834 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1bf015e5-4cf4-4b5e-b351-e553badb8930 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53" status: 200 len: 1472 microversion: 2.1 time: 0.336494 Oct 04 18:40:43.254729 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1558/3106] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:42 2022] GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53 => generated 1472 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:43.267823 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-1b004800-adf3-4777-a2fc-4e09e4308a14 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] [instance: 6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28] Building network info cache for instance {{(pid=123002) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 18:40:43.276150 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ac7b7d84-64ea-4750-abc1-b6109ae7e16b tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:43.284331 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ac7b7d84-64ea-4750-abc1-b6109ae7e16b tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] [instance: 3d3cabc2-fa23-4098-9197-9aaa19a0c663] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:43.294180 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ac7b7d84-64ea-4750-abc1-b6109ae7e16b tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:43.295156 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ac7b7d84-64ea-4750-abc1-b6109ae7e16b tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:43.296753 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ac7b7d84-64ea-4750-abc1-b6109ae7e16b tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:43.297661 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ac7b7d84-64ea-4750-abc1-b6109ae7e16b tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:43.298481 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ac7b7d84-64ea-4750-abc1-b6109ae7e16b tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:43.299264 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ac7b7d84-64ea-4750-abc1-b6109ae7e16b tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:43.647460 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ac7b7d84-64ea-4750-abc1-b6109ae7e16b tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:43.657377 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ac7b7d84-64ea-4750-abc1-b6109ae7e16b tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:43.658970 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ac7b7d84-64ea-4750-abc1-b6109ae7e16b tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:43.660397 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ac7b7d84-64ea-4750-abc1-b6109ae7e16b tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] 10.222.0.20 "GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663" status: 200 len: 1869 microversion: 2.42 time: 0.402125 Oct 04 18:40:43.661203 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1559/3107] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:43 2022] GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663 => generated 1869 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:43.665954 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-9e7d437c-89f4-488b-be03-5b97e815fcc3 req-bf37c85d-0355-4153-ac84-934e583c6e71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28", "tag": "c22b4d3b-0439-436b-bdf6-38e75b8da2dd"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:40:43.675969 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-9e7d437c-89f4-488b-be03-5b97e815fcc3 req-bf37c85d-0355-4153-ac84-934e583c6e71 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:43.676812 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-9e7d437c-89f4-488b-be03-5b97e815fcc3 req-bf37c85d-0355-4153-ac84-934e583c6e71 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:43.677605 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-9e7d437c-89f4-488b-be03-5b97e815fcc3 req-bf37c85d-0355-4153-ac84-934e583c6e71 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:43.695718 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-9e7d437c-89f4-488b-be03-5b97e815fcc3 req-bf37c85d-0355-4153-ac84-934e583c6e71 service nova] Creating event network-changed:c22b4d3b-0439-436b-bdf6-38e75b8da2dd for instance 6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28 on n-h1-850501-14 Oct 04 18:40:43.701153 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-9e7d437c-89f4-488b-be03-5b97e815fcc3 req-bf37c85d-0355-4153-ac84-934e583c6e71 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038559 Oct 04 18:40:43.701877 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1560/3108] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:40:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:40:43.707547 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c4fdd532-596c-443b-8a0d-5fab80741827 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:43.708388 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c4fdd532-596c-443b-8a0d-5fab80741827 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] [instance: d607218c-7a38-4b49-bb51-7e1adfda8c6a] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:43.727507 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c4fdd532-596c-443b-8a0d-5fab80741827 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:43.728321 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c4fdd532-596c-443b-8a0d-5fab80741827 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:43.729094 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c4fdd532-596c-443b-8a0d-5fab80741827 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:43.730130 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c4fdd532-596c-443b-8a0d-5fab80741827 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:43.730887 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c4fdd532-596c-443b-8a0d-5fab80741827 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:43.732802 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c4fdd532-596c-443b-8a0d-5fab80741827 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:43.738939 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=100 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:40:43.982956 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c4fdd532-596c-443b-8a0d-5fab80741827 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3499c88686046b8a80bc3a754f016e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08896629a67f488b87a845e57a9ca372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:44.009535 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c4fdd532-596c-443b-8a0d-5fab80741827 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] 10.222.0.20 "GET /compute/v2.1/servers/d607218c-7a38-4b49-bb51-7e1adfda8c6a" status: 200 len: 1324 microversion: 2.1 time: 0.304976 Oct 04 18:40:44.038208 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1561/3109] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:43 2022] GET /compute/v2.1/servers/d607218c-7a38-4b49-bb51-7e1adfda8c6a => generated 1324 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:44.180332 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9e777bdd-1a82-46b2-a7a6-279625c1188d tempest-QuotaClassesAdminTestJSON-1603955715 tempest-QuotaClassesAdminTestJSON-1603955715-project-admin] Calling method '.version_select at 0x7fe258108e50>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:44.202301 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9e777bdd-1a82-46b2-a7a6-279625c1188d tempest-QuotaClassesAdminTestJSON-1603955715 tempest-QuotaClassesAdminTestJSON-1603955715-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.166901 Oct 04 18:40:44.203773 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1562/3110] 10.222.0.20 () {58 vars in 1185 bytes} [Tue Oct 4 18:40:44 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:40:44.213906 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4eb5bafc-3d9c-4208-a86e-62ff2a3326ca tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:44.215343 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-4eb5bafc-3d9c-4208-a86e-62ff2a3326ca tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] [instance: 0212406a-acc5-4631-90e8-03f4409c07f1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:44.229508 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4eb5bafc-3d9c-4208-a86e-62ff2a3326ca tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:44.231383 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4eb5bafc-3d9c-4208-a86e-62ff2a3326ca tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:44.232483 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4eb5bafc-3d9c-4208-a86e-62ff2a3326ca tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:44.233417 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4eb5bafc-3d9c-4208-a86e-62ff2a3326ca tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:44.234188 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4eb5bafc-3d9c-4208-a86e-62ff2a3326ca tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:44.234800 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4eb5bafc-3d9c-4208-a86e-62ff2a3326ca tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:44.276190 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-1b004800-adf3-4777-a2fc-4e09e4308a14 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] [instance: 6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28] Updating instance_info_cache with network_info: [{"id": "c22b4d3b-0439-436b-bdf6-38e75b8da2dd", "address": "fa:16:3e:11:ea:d5", "network": {"id": "9b686f7b-7ec6-4756-8920-17dbc6944474", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-769731793-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.1.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "a6edbe27acbc4c9eba33a6f589f6cf8a", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc22b4d3b-04", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=123002) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 18:40:44.332268 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-4eb5bafc-3d9c-4208-a86e-62ff2a3326ca tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:44.346972 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-4eb5bafc-3d9c-4208-a86e-62ff2a3326ca tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:44.348770 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-4eb5bafc-3d9c-4208-a86e-62ff2a3326ca tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:44.358075 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-4eb5bafc-3d9c-4208-a86e-62ff2a3326ca tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] 10.222.0.20 "GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1" status: 200 len: 1446 microversion: 2.75 time: 0.153044 Oct 04 18:40:44.383050 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1563/3111] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:44 2022] GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1 => generated 1446 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:44.391200 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-04bee05d-e173-4766-a510-96a0ad9fa06e tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:44.391825 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-04bee05d-e173-4766-a510-96a0ad9fa06e tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] [instance: 1b0129be-f5f9-4735-a10a-008bddc30ab4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:44.399203 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:40:44.406396 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-04bee05d-e173-4766-a510-96a0ad9fa06e tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:44.406890 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-04bee05d-e173-4766-a510-96a0ad9fa06e tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:44.407327 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-04bee05d-e173-4766-a510-96a0ad9fa06e tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:44.408042 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-04bee05d-e173-4766-a510-96a0ad9fa06e tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:44.408523 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-04bee05d-e173-4766-a510-96a0ad9fa06e tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:44.409040 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-04bee05d-e173-4766-a510-96a0ad9fa06e tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:44.421860 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1b004800-adf3-4777-a2fc-4e09e4308a14 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Releasing lock "refresh_cache-6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28" {{(pid=123002) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 18:40:44.423586 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1b004800-adf3-4777-a2fc-4e09e4308a14 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] 10.222.0.20 "POST /compute/v2.1/servers/6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28/action" status: 202 len: 0 microversion: 2.1 time: 3.720026 Oct 04 18:40:44.429108 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1549/3112] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:40:40 2022] POST /compute/v2.1/servers/6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28/action => generated 0 bytes in 3726 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 04 18:40:44.436510 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-65ab84b5-ad42-42bf-963d-678c9c9f942a tempest-QuotaClassesAdminTestJSON-1603955715 tempest-QuotaClassesAdminTestJSON-1603955715-project-admin] Action: 'update', calling method: .version_select at 0x7fe253ff19d0>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:40:44.540822 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-04bee05d-e173-4766-a510-96a0ad9fa06e tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:44.559144 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-04bee05d-e173-4766-a510-96a0ad9fa06e tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:44.561292 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-04bee05d-e173-4766-a510-96a0ad9fa06e tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:44.563599 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-04bee05d-e173-4766-a510-96a0ad9fa06e tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] 10.222.0.20 "GET /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4" status: 200 len: 1366 microversion: 2.47 time: 0.176718 Oct 04 18:40:44.583993 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1564/3113] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:44 2022] GET /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4 => generated 1366 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:44.588872 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-197764e2-8c3c-4057-8c6b-ddb3d0f80bee tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:44.592887 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-197764e2-8c3c-4057-8c6b-ddb3d0f80bee tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: c343931b-bc96-4e9e-a5ce-f93454339a53] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:44.606780 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-197764e2-8c3c-4057-8c6b-ddb3d0f80bee tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:44.607283 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-197764e2-8c3c-4057-8c6b-ddb3d0f80bee tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:44.607731 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-197764e2-8c3c-4057-8c6b-ddb3d0f80bee tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:44.608744 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-197764e2-8c3c-4057-8c6b-ddb3d0f80bee tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:44.609415 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-197764e2-8c3c-4057-8c6b-ddb3d0f80bee tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:44.609714 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-197764e2-8c3c-4057-8c6b-ddb3d0f80bee tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:44.903419 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-197764e2-8c3c-4057-8c6b-ddb3d0f80bee tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8358c07e2684b749a62becb9f0b7869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b922a74c1c2448bb770d6b298b2d601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:44.923735 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-197764e2-8c3c-4057-8c6b-ddb3d0f80bee tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53" status: 200 len: 1472 microversion: 2.1 time: 0.344244 Oct 04 18:40:44.925614 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1565/3114] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:44 2022] GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53 => generated 1472 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:44.939623 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-935c117e-fd9b-4963-85b8-16bf6f2eef47 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Action: 'action', calling method: .version_select at 0x7fe25ac55ca0>, body: {"removeFloatingIp": {"address": "172.25.1.102"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:40:45.192883 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-935c117e-fd9b-4963-85b8-16bf6f2eef47 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] [instance: 6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:45.200166 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-935c117e-fd9b-4963-85b8-16bf6f2eef47 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:45.209124 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-935c117e-fd9b-4963-85b8-16bf6f2eef47 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:45.209124 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-935c117e-fd9b-4963-85b8-16bf6f2eef47 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:45.209124 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-935c117e-fd9b-4963-85b8-16bf6f2eef47 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:45.209124 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-935c117e-fd9b-4963-85b8-16bf6f2eef47 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:45.209124 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-935c117e-fd9b-4963-85b8-16bf6f2eef47 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:45.533114 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-935c117e-fd9b-4963-85b8-16bf6f2eef47 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Acquiring lock "refresh_cache-6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28" {{(pid=123001) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 18:40:45.533114 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-935c117e-fd9b-4963-85b8-16bf6f2eef47 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Acquired lock "refresh_cache-6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28" {{(pid=123001) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 18:40:45.552438 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-65ab84b5-ad42-42bf-963d-678c9c9f942a tempest-QuotaClassesAdminTestJSON-1603955715 tempest-QuotaClassesAdminTestJSON-1603955715-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 1.122030 Oct 04 18:40:45.553531 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1550/3115] 10.222.0.20 () {60 vars in 1206 bytes} [Tue Oct 4 18:40:44 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:40:45.558432 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a89cfe6b-7ec5-47a4-acb8-1f6774576424 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:45.559047 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a89cfe6b-7ec5-47a4-acb8-1f6774576424 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] [instance: 3d3cabc2-fa23-4098-9197-9aaa19a0c663] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:45.565329 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a89cfe6b-7ec5-47a4-acb8-1f6774576424 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:45.565815 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a89cfe6b-7ec5-47a4-acb8-1f6774576424 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:45.567420 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a89cfe6b-7ec5-47a4-acb8-1f6774576424 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:45.567420 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a89cfe6b-7ec5-47a4-acb8-1f6774576424 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:45.567604 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a89cfe6b-7ec5-47a4-acb8-1f6774576424 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:45.567923 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a89cfe6b-7ec5-47a4-acb8-1f6774576424 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:46.180966 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a89cfe6b-7ec5-47a4-acb8-1f6774576424 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:46.198330 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a89cfe6b-7ec5-47a4-acb8-1f6774576424 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:46.199910 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a89cfe6b-7ec5-47a4-acb8-1f6774576424 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:46.201991 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a89cfe6b-7ec5-47a4-acb8-1f6774576424 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] 10.222.0.20 "GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663" status: 200 len: 1869 microversion: 2.42 time: 0.647658 Oct 04 18:40:46.203915 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1551/3116] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:45 2022] GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663 => generated 1869 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:46.209140 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8a295204-245e-4e2b-9cab-f68d69768093 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:46.210097 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8a295204-245e-4e2b-9cab-f68d69768093 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] [instance: d607218c-7a38-4b49-bb51-7e1adfda8c6a] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:46.214620 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=13,nova_api:INSERT=7 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:40:46.219866 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8a295204-245e-4e2b-9cab-f68d69768093 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:46.220404 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8a295204-245e-4e2b-9cab-f68d69768093 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:46.221021 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8a295204-245e-4e2b-9cab-f68d69768093 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:46.221955 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8a295204-245e-4e2b-9cab-f68d69768093 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:46.222418 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8a295204-245e-4e2b-9cab-f68d69768093 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:46.222855 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8a295204-245e-4e2b-9cab-f68d69768093 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:46.467502 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8a295204-245e-4e2b-9cab-f68d69768093 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3499c88686046b8a80bc3a754f016e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08896629a67f488b87a845e57a9ca372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:46.475729 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8a295204-245e-4e2b-9cab-f68d69768093 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] 10.222.0.20 "GET /compute/v2.1/servers/d607218c-7a38-4b49-bb51-7e1adfda8c6a" status: 200 len: 1324 microversion: 2.1 time: 0.270078 Oct 04 18:40:46.491223 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1552/3117] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:46 2022] GET /compute/v2.1/servers/d607218c-7a38-4b49-bb51-7e1adfda8c6a => generated 1324 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:46.491223 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-99406703-a892-4419-8f48-c80a8f72017e tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:46.491223 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-99406703-a892-4419-8f48-c80a8f72017e tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] [instance: 0212406a-acc5-4631-90e8-03f4409c07f1] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:46.491223 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-99406703-a892-4419-8f48-c80a8f72017e tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:46.491223 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-99406703-a892-4419-8f48-c80a8f72017e tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:46.491223 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-99406703-a892-4419-8f48-c80a8f72017e tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:46.491223 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-99406703-a892-4419-8f48-c80a8f72017e tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:46.491223 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-99406703-a892-4419-8f48-c80a8f72017e tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:46.491223 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-99406703-a892-4419-8f48-c80a8f72017e tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:46.597928 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-99406703-a892-4419-8f48-c80a8f72017e tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:46.607862 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-99406703-a892-4419-8f48-c80a8f72017e tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:46.609352 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-99406703-a892-4419-8f48-c80a8f72017e tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:46.614335 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-99406703-a892-4419-8f48-c80a8f72017e tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] 10.222.0.20 "GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1" status: 200 len: 1446 microversion: 2.75 time: 0.136992 Oct 04 18:40:46.628366 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1553/3118] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:46 2022] GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1 => generated 1446 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:46.632544 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9bd9fc1e-4279-46dc-97a9-d205d307f165 tempest-QuotaClassesAdminTestJSON-1603955715 tempest-QuotaClassesAdminTestJSON-1603955715-project-admin] Calling method '.version_select at 0x7fe253f1ba60>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:46.644199 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9bd9fc1e-4279-46dc-97a9-d205d307f165 tempest-QuotaClassesAdminTestJSON-1603955715 tempest-QuotaClassesAdminTestJSON-1603955715-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.028209 Oct 04 18:40:46.645040 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1554/3119] 10.222.0.20 () {58 vars in 1185 bytes} [Tue Oct 4 18:40:46 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:40:46.651591 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9f9484e2-4569-444e-b981-bfc5cec5552d tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:46.652829 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9f9484e2-4569-444e-b981-bfc5cec5552d tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] [instance: 1b0129be-f5f9-4735-a10a-008bddc30ab4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:46.660458 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9f9484e2-4569-444e-b981-bfc5cec5552d tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:46.660955 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9f9484e2-4569-444e-b981-bfc5cec5552d tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:46.661482 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9f9484e2-4569-444e-b981-bfc5cec5552d tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:46.662193 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9f9484e2-4569-444e-b981-bfc5cec5552d tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:46.663399 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9f9484e2-4569-444e-b981-bfc5cec5552d tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:46.664188 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9f9484e2-4569-444e-b981-bfc5cec5552d tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:46.768312 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9f9484e2-4569-444e-b981-bfc5cec5552d tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:46.794916 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9f9484e2-4569-444e-b981-bfc5cec5552d tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:46.797735 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9f9484e2-4569-444e-b981-bfc5cec5552d tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:46.799329 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9f9484e2-4569-444e-b981-bfc5cec5552d tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] 10.222.0.20 "GET /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4" status: 200 len: 1366 microversion: 2.47 time: 0.153530 Oct 04 18:40:46.801068 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1555/3120] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:46 2022] GET /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:46.820661 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0ccef49c-b15e-4697-8e8a-f4be4e3d81a3 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:46.821507 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0ccef49c-b15e-4697-8e8a-f4be4e3d81a3 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: c343931b-bc96-4e9e-a5ce-f93454339a53] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:46.828363 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0ccef49c-b15e-4697-8e8a-f4be4e3d81a3 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:46.829106 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0ccef49c-b15e-4697-8e8a-f4be4e3d81a3 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:46.829763 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0ccef49c-b15e-4697-8e8a-f4be4e3d81a3 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:46.830736 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0ccef49c-b15e-4697-8e8a-f4be4e3d81a3 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:46.831542 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0ccef49c-b15e-4697-8e8a-f4be4e3d81a3 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:46.832216 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0ccef49c-b15e-4697-8e8a-f4be4e3d81a3 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:46.837175 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:40:46.874419 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.neutron [None req-935c117e-fd9b-4963-85b8-16bf6f2eef47 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] [instance: 6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28] Building network info cache for instance {{(pid=123001) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 18:40:47.142571 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0ccef49c-b15e-4697-8e8a-f4be4e3d81a3 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8358c07e2684b749a62becb9f0b7869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b922a74c1c2448bb770d6b298b2d601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:47.154385 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0ccef49c-b15e-4697-8e8a-f4be4e3d81a3 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53" status: 200 len: 1472 microversion: 2.1 time: 0.350707 Oct 04 18:40:47.154978 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1556/3121] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:46 2022] GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53 => generated 1472 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:47.161138 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ba8be729-0be0-4bc3-9224-4e362a6ae5a1 tempest-QuotaClassesAdminTestJSON-1603955715 tempest-QuotaClassesAdminTestJSON-1603955715-project-admin] Action: 'update', calling method: .version_select at 0x7fe253f1b160>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:40:47.551665 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.neutron [None req-935c117e-fd9b-4963-85b8-16bf6f2eef47 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] [instance: 6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28] Updating instance_info_cache with network_info: [{"id": "c22b4d3b-0439-436b-bdf6-38e75b8da2dd", "address": "fa:16:3e:11:ea:d5", "network": {"id": "9b686f7b-7ec6-4756-8920-17dbc6944474", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-769731793-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "a6edbe27acbc4c9eba33a6f589f6cf8a", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc22b4d3b-04", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=123001) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 18:40:47.564223 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-935c117e-fd9b-4963-85b8-16bf6f2eef47 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Releasing lock "refresh_cache-6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28" {{(pid=123001) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 18:40:47.564223 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-935c117e-fd9b-4963-85b8-16bf6f2eef47 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] 10.222.0.20 "POST /compute/v2.1/servers/6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28/action" status: 202 len: 0 microversion: 2.1 time: 2.636054 Oct 04 18:40:47.564223 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1566/3122] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:40:44 2022] POST /compute/v2.1/servers/6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28/action => generated 0 bytes in 2638 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 04 18:40:47.571661 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-e33a7597-4117-4920-a110-aa27d5a01f2e req-4095ff94-ba22-4fd2-9b29-f0011e43078a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28", "tag": "c22b4d3b-0439-436b-bdf6-38e75b8da2dd"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:40:47.581750 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-e33a7597-4117-4920-a110-aa27d5a01f2e req-4095ff94-ba22-4fd2-9b29-f0011e43078a service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:47.582244 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-e33a7597-4117-4920-a110-aa27d5a01f2e req-4095ff94-ba22-4fd2-9b29-f0011e43078a service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:47.582716 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-e33a7597-4117-4920-a110-aa27d5a01f2e req-4095ff94-ba22-4fd2-9b29-f0011e43078a service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:47.596340 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-e33a7597-4117-4920-a110-aa27d5a01f2e req-4095ff94-ba22-4fd2-9b29-f0011e43078a service nova] Creating event network-changed:c22b4d3b-0439-436b-bdf6-38e75b8da2dd for instance 6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28 on n-h1-850501-14 Oct 04 18:40:47.602724 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-e33a7597-4117-4920-a110-aa27d5a01f2e req-4095ff94-ba22-4fd2-9b29-f0011e43078a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036525 Oct 04 18:40:47.604044 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1567/3123] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:40:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:40:47.610083 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-bb137061-8e06-4a5d-8c2f-fe6fdc12ba5b tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:47.610969 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-bb137061-8e06-4a5d-8c2f-fe6fdc12ba5b tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] [instance: 3d3cabc2-fa23-4098-9197-9aaa19a0c663] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:47.625111 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bb137061-8e06-4a5d-8c2f-fe6fdc12ba5b tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:47.625958 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bb137061-8e06-4a5d-8c2f-fe6fdc12ba5b tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:47.626558 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bb137061-8e06-4a5d-8c2f-fe6fdc12ba5b tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:47.627553 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bb137061-8e06-4a5d-8c2f-fe6fdc12ba5b tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:47.628481 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bb137061-8e06-4a5d-8c2f-fe6fdc12ba5b tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:47.629242 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bb137061-8e06-4a5d-8c2f-fe6fdc12ba5b tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:47.856002 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-bb137061-8e06-4a5d-8c2f-fe6fdc12ba5b tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:47.868191 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-bb137061-8e06-4a5d-8c2f-fe6fdc12ba5b tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:47.869663 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-bb137061-8e06-4a5d-8c2f-fe6fdc12ba5b tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:47.870942 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-bb137061-8e06-4a5d-8c2f-fe6fdc12ba5b tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] 10.222.0.20 "GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663" status: 200 len: 1869 microversion: 2.42 time: 0.265572 Oct 04 18:40:47.872169 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1568/3124] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:47 2022] GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663 => generated 1869 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:47.876992 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5cf31f66-360b-4a86-b165-0beaf96c09ef tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:47.877592 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5cf31f66-360b-4a86-b165-0beaf96c09ef tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] [instance: d607218c-7a38-4b49-bb51-7e1adfda8c6a] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:47.885866 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5cf31f66-360b-4a86-b165-0beaf96c09ef tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:47.886944 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5cf31f66-360b-4a86-b165-0beaf96c09ef tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:47.886944 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5cf31f66-360b-4a86-b165-0beaf96c09ef tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:47.887485 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5cf31f66-360b-4a86-b165-0beaf96c09ef tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:47.887944 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5cf31f66-360b-4a86-b165-0beaf96c09ef tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:47.888626 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5cf31f66-360b-4a86-b165-0beaf96c09ef tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:47.958012 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ba8be729-0be0-4bc3-9224-4e362a6ae5a1 tempest-QuotaClassesAdminTestJSON-1603955715 tempest-QuotaClassesAdminTestJSON-1603955715-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.801646 Oct 04 18:40:47.969562 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1557/3125] 10.222.0.20 () {60 vars in 1206 bytes} [Tue Oct 4 18:40:47 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:40:47.975138 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ee485767-5066-4cc2-a2a5-e79a944dfd31 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Calling method '.version_select at 0x7fe253f1b4c0>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:48.226437 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5cf31f66-360b-4a86-b165-0beaf96c09ef tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3499c88686046b8a80bc3a754f016e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08896629a67f488b87a845e57a9ca372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:48.234307 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5cf31f66-360b-4a86-b165-0beaf96c09ef tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] 10.222.0.20 "GET /compute/v2.1/servers/d607218c-7a38-4b49-bb51-7e1adfda8c6a" status: 200 len: 1324 microversion: 2.1 time: 0.361023 Oct 04 18:40:48.234929 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1569/3126] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:47 2022] GET /compute/v2.1/servers/d607218c-7a38-4b49-bb51-7e1adfda8c6a => generated 1324 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:48.248013 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7a39c404-2db4-422c-a43a-fa055607c5c9 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:48.248739 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7a39c404-2db4-422c-a43a-fa055607c5c9 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] [instance: 0212406a-acc5-4631-90e8-03f4409c07f1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:48.265880 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7a39c404-2db4-422c-a43a-fa055607c5c9 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:48.266373 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7a39c404-2db4-422c-a43a-fa055607c5c9 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:48.266815 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7a39c404-2db4-422c-a43a-fa055607c5c9 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:48.267531 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7a39c404-2db4-422c-a43a-fa055607c5c9 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:48.267982 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7a39c404-2db4-422c-a43a-fa055607c5c9 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:48.270003 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7a39c404-2db4-422c-a43a-fa055607c5c9 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:48.411929 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7a39c404-2db4-422c-a43a-fa055607c5c9 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:48.424313 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7a39c404-2db4-422c-a43a-fa055607c5c9 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:48.425792 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7a39c404-2db4-422c-a43a-fa055607c5c9 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:48.431732 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7a39c404-2db4-422c-a43a-fa055607c5c9 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] 10.222.0.20 "GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1" status: 200 len: 1446 microversion: 2.75 time: 0.195746 Oct 04 18:40:48.432560 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1570/3127] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:48 2022] GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1 => generated 1446 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:48.437248 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2127162b-e344-461e-9137-a19f29bdf689 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:48.437864 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2127162b-e344-461e-9137-a19f29bdf689 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] [instance: 1b0129be-f5f9-4735-a10a-008bddc30ab4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:48.446377 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2127162b-e344-461e-9137-a19f29bdf689 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:48.446894 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2127162b-e344-461e-9137-a19f29bdf689 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:48.447334 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2127162b-e344-461e-9137-a19f29bdf689 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:48.448157 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2127162b-e344-461e-9137-a19f29bdf689 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:48.448617 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2127162b-e344-461e-9137-a19f29bdf689 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:48.449042 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2127162b-e344-461e-9137-a19f29bdf689 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:48.546713 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-2127162b-e344-461e-9137-a19f29bdf689 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:48.557973 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-2127162b-e344-461e-9137-a19f29bdf689 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:48.561635 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-2127162b-e344-461e-9137-a19f29bdf689 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:48.562865 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2127162b-e344-461e-9137-a19f29bdf689 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] 10.222.0.20 "GET /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4" status: 200 len: 1366 microversion: 2.47 time: 0.129560 Oct 04 18:40:48.565351 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1571/3128] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:48 2022] GET /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4 => generated 1366 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:48.573954 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-79399cc2-26c7-4660-80aa-e6931b5740c8 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:48.577702 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-79399cc2-26c7-4660-80aa-e6931b5740c8 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: c343931b-bc96-4e9e-a5ce-f93454339a53] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:48.597671 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-79399cc2-26c7-4660-80aa-e6931b5740c8 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:48.598746 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-79399cc2-26c7-4660-80aa-e6931b5740c8 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:48.599198 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-79399cc2-26c7-4660-80aa-e6931b5740c8 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:48.602511 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-79399cc2-26c7-4660-80aa-e6931b5740c8 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:48.602997 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-79399cc2-26c7-4660-80aa-e6931b5740c8 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:48.609508 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-79399cc2-26c7-4660-80aa-e6931b5740c8 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:48.900811 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-79399cc2-26c7-4660-80aa-e6931b5740c8 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8358c07e2684b749a62becb9f0b7869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b922a74c1c2448bb770d6b298b2d601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:48.910151 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-79399cc2-26c7-4660-80aa-e6931b5740c8 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53" status: 200 len: 1472 microversion: 2.1 time: 0.342848 Oct 04 18:40:48.911570 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1572/3129] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:48 2022] GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53 => generated 1472 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:48.933950 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-fe2768a9-3674-49f0-8566-b2990ef67fa6 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:48.934649 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-fe2768a9-3674-49f0-8566-b2990ef67fa6 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] [instance: 3d3cabc2-fa23-4098-9197-9aaa19a0c663] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:48.942171 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fe2768a9-3674-49f0-8566-b2990ef67fa6 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:48.942743 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fe2768a9-3674-49f0-8566-b2990ef67fa6 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:48.943257 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fe2768a9-3674-49f0-8566-b2990ef67fa6 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:48.945078 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fe2768a9-3674-49f0-8566-b2990ef67fa6 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:48.945622 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fe2768a9-3674-49f0-8566-b2990ef67fa6 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:48.946204 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fe2768a9-3674-49f0-8566-b2990ef67fa6 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:49.322069 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-fe2768a9-3674-49f0-8566-b2990ef67fa6 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:49.336344 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-fe2768a9-3674-49f0-8566-b2990ef67fa6 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:49.338260 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-fe2768a9-3674-49f0-8566-b2990ef67fa6 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:49.339676 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-fe2768a9-3674-49f0-8566-b2990ef67fa6 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] 10.222.0.20 "GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663" status: 200 len: 1869 microversion: 2.42 time: 0.416153 Oct 04 18:40:49.356200 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1573/3130] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:48 2022] GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663 => generated 1869 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:49.356200 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-a020ad9f-1167-43ca-95ad-fd0259abfc63 req-0d99ea7a-ca92-44a2-8780-146afe0bdc97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d607218c-7a38-4b49-bb51-7e1adfda8c6a", "name": "network-vif-plugged", "status": "completed", "tag": "a4c07b4b-a6d2-4965-9650-3ce3a87b89ee"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:40:49.359288 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-a020ad9f-1167-43ca-95ad-fd0259abfc63 req-0d99ea7a-ca92-44a2-8780-146afe0bdc97 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:49.359854 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-a020ad9f-1167-43ca-95ad-fd0259abfc63 req-0d99ea7a-ca92-44a2-8780-146afe0bdc97 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:49.360464 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-a020ad9f-1167-43ca-95ad-fd0259abfc63 req-0d99ea7a-ca92-44a2-8780-146afe0bdc97 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:49.376318 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-a020ad9f-1167-43ca-95ad-fd0259abfc63 req-0d99ea7a-ca92-44a2-8780-146afe0bdc97 service nova] Creating event network-vif-plugged:a4c07b4b-a6d2-4965-9650-3ce3a87b89ee for instance d607218c-7a38-4b49-bb51-7e1adfda8c6a on n-h2-850501-14 Oct 04 18:40:49.379987 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-a020ad9f-1167-43ca-95ad-fd0259abfc63 req-0d99ea7a-ca92-44a2-8780-146afe0bdc97 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038130 Oct 04 18:40:49.383729 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1574/3131] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:40:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:40:49.388734 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6edd6d34-5f99-4e5e-9122-a0ab9b16c80b tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:49.389448 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6edd6d34-5f99-4e5e-9122-a0ab9b16c80b tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] [instance: d607218c-7a38-4b49-bb51-7e1adfda8c6a] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:49.395966 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6edd6d34-5f99-4e5e-9122-a0ab9b16c80b tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:49.396535 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6edd6d34-5f99-4e5e-9122-a0ab9b16c80b tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:49.397838 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6edd6d34-5f99-4e5e-9122-a0ab9b16c80b tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:49.398767 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6edd6d34-5f99-4e5e-9122-a0ab9b16c80b tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:49.399226 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6edd6d34-5f99-4e5e-9122-a0ab9b16c80b tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:49.399656 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6edd6d34-5f99-4e5e-9122-a0ab9b16c80b tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:49.627745 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ee485767-5066-4cc2-a2a5-e79a944dfd31 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/8107fbab-9531-446f-a557-9fcdc649bf1e" status: 202 len: 0 microversion: 2.1 time: 1.656854 Oct 04 18:40:49.629346 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1558/3132] 10.222.0.20 () {58 vars in 1263 bytes} [Tue Oct 4 18:40:47 2022] DELETE /compute/v2.1/os-floating-ips/8107fbab-9531-446f-a557-9fcdc649bf1e => generated 0 bytes in 1659 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:40:49.637074 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c6880704-d71c-4fa8-9a18-ebe2096aa115 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:49.638698 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c6880704-d71c-4fa8-9a18-ebe2096aa115 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] [instance: 0212406a-acc5-4631-90e8-03f4409c07f1] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:49.657546 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c6880704-d71c-4fa8-9a18-ebe2096aa115 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:49.659014 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c6880704-d71c-4fa8-9a18-ebe2096aa115 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:49.661179 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c6880704-d71c-4fa8-9a18-ebe2096aa115 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:49.662175 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c6880704-d71c-4fa8-9a18-ebe2096aa115 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:49.664809 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c6880704-d71c-4fa8-9a18-ebe2096aa115 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:49.666145 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c6880704-d71c-4fa8-9a18-ebe2096aa115 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:49.676752 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6edd6d34-5f99-4e5e-9122-a0ab9b16c80b tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3499c88686046b8a80bc3a754f016e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08896629a67f488b87a845e57a9ca372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:49.684882 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6edd6d34-5f99-4e5e-9122-a0ab9b16c80b tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] 10.222.0.20 "GET /compute/v2.1/servers/d607218c-7a38-4b49-bb51-7e1adfda8c6a" status: 200 len: 1324 microversion: 2.1 time: 0.302268 Oct 04 18:40:49.685469 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1575/3133] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:49 2022] GET /compute/v2.1/servers/d607218c-7a38-4b49-bb51-7e1adfda8c6a => generated 1324 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:49.690832 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e1deee99-d3d9-41a3-b63a-1bd0f3e4c2ad tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:49.691759 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e1deee99-d3d9-41a3-b63a-1bd0f3e4c2ad tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] [instance: 1b0129be-f5f9-4735-a10a-008bddc30ab4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:49.698946 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e1deee99-d3d9-41a3-b63a-1bd0f3e4c2ad tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:49.699725 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e1deee99-d3d9-41a3-b63a-1bd0f3e4c2ad tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:49.700503 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e1deee99-d3d9-41a3-b63a-1bd0f3e4c2ad tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:49.701420 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e1deee99-d3d9-41a3-b63a-1bd0f3e4c2ad tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:49.702100 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e1deee99-d3d9-41a3-b63a-1bd0f3e4c2ad tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:49.702753 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e1deee99-d3d9-41a3-b63a-1bd0f3e4c2ad tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:49.787772 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c6880704-d71c-4fa8-9a18-ebe2096aa115 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:49.799246 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c6880704-d71c-4fa8-9a18-ebe2096aa115 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:49.802167 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c6880704-d71c-4fa8-9a18-ebe2096aa115 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:49.808879 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c6880704-d71c-4fa8-9a18-ebe2096aa115 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] 10.222.0.20 "GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1" status: 200 len: 1446 microversion: 2.75 time: 0.177958 Oct 04 18:40:49.809482 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1559/3134] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:49 2022] GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1 => generated 1446 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:49.817025 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-35c814e3-87e2-4e28-a24a-1f54761c111f tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Calling method '.version_select at 0x7fe253fa2ca0>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:49.847198 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e1deee99-d3d9-41a3-b63a-1bd0f3e4c2ad tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:49.857498 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e1deee99-d3d9-41a3-b63a-1bd0f3e4c2ad tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:49.861318 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e1deee99-d3d9-41a3-b63a-1bd0f3e4c2ad tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:49.880212 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e1deee99-d3d9-41a3-b63a-1bd0f3e4c2ad tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] 10.222.0.20 "GET /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4" status: 200 len: 1366 microversion: 2.47 time: 0.180816 Oct 04 18:40:49.880212 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1576/3135] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:49 2022] GET /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4 => generated 1366 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:49.940517 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1b8eb01f-eebd-46e6-b946-5c1d91aee47a tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:49.941324 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1b8eb01f-eebd-46e6-b946-5c1d91aee47a tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: c343931b-bc96-4e9e-a5ce-f93454339a53] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:49.953140 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1b8eb01f-eebd-46e6-b946-5c1d91aee47a tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:49.953643 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1b8eb01f-eebd-46e6-b946-5c1d91aee47a tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:49.954104 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1b8eb01f-eebd-46e6-b946-5c1d91aee47a tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:49.954853 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1b8eb01f-eebd-46e6-b946-5c1d91aee47a tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:49.955464 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1b8eb01f-eebd-46e6-b946-5c1d91aee47a tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:49.955948 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1b8eb01f-eebd-46e6-b946-5c1d91aee47a tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:50.227832 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1b8eb01f-eebd-46e6-b946-5c1d91aee47a tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8358c07e2684b749a62becb9f0b7869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b922a74c1c2448bb770d6b298b2d601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:50.239063 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1b8eb01f-eebd-46e6-b946-5c1d91aee47a tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53" status: 200 len: 1472 microversion: 2.1 time: 0.304209 Oct 04 18:40:50.239992 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1577/3136] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:49 2022] GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53 => generated 1472 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:40:50.302634 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-35c814e3-87e2-4e28-a24a-1f54761c111f tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/09090d37-07a6-4b28-8916-6dbdfc8793b4" status: 202 len: 0 microversion: 2.1 time: 0.491773 Oct 04 18:40:50.304070 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1560/3137] 10.222.0.20 () {58 vars in 1272 bytes} [Tue Oct 4 18:40:49 2022] DELETE /compute/v2.1/os-security-groups/09090d37-07a6-4b28-8916-6dbdfc8793b4 => generated 0 bytes in 494 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:40:50.312541 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c77e0607-f034-47b3-8a5a-11aead7eb245 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:50.313043 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c77e0607-f034-47b3-8a5a-11aead7eb245 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] [instance: 6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:50.337548 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c77e0607-f034-47b3-8a5a-11aead7eb245 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:50.338211 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c77e0607-f034-47b3-8a5a-11aead7eb245 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:50.338661 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c77e0607-f034-47b3-8a5a-11aead7eb245 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:50.339417 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c77e0607-f034-47b3-8a5a-11aead7eb245 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:50.339947 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c77e0607-f034-47b3-8a5a-11aead7eb245 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:50.341071 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c77e0607-f034-47b3-8a5a-11aead7eb245 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:50.372372 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3ef5600b-625d-42ec-8b2a-6bccf5de654e tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:50.373970 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3ef5600b-625d-42ec-8b2a-6bccf5de654e tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] [instance: 3d3cabc2-fa23-4098-9197-9aaa19a0c663] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:50.380154 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c77e0607-f034-47b3-8a5a-11aead7eb245 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] [instance: 6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:40:50.384901 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3ef5600b-625d-42ec-8b2a-6bccf5de654e tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:50.385441 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3ef5600b-625d-42ec-8b2a-6bccf5de654e tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:50.386524 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3ef5600b-625d-42ec-8b2a-6bccf5de654e tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:50.387253 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3ef5600b-625d-42ec-8b2a-6bccf5de654e tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:50.387702 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3ef5600b-625d-42ec-8b2a-6bccf5de654e tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:50.388350 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3ef5600b-625d-42ec-8b2a-6bccf5de654e tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:50.417875 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:40:50.676388 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c77e0607-f034-47b3-8a5a-11aead7eb245 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28" status: 204 len: 0 microversion: 2.1 time: 0.367790 Oct 04 18:40:50.677153 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1578/3138] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:40:50 2022] DELETE /compute/v2.1/servers/6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:40:50.690307 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-03bdd01d-1b2c-42af-a1ee-4bda63ad3b68 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:50.691716 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-03bdd01d-1b2c-42af-a1ee-4bda63ad3b68 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] [instance: 6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:50.700101 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-03bdd01d-1b2c-42af-a1ee-4bda63ad3b68 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:50.701777 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-03bdd01d-1b2c-42af-a1ee-4bda63ad3b68 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:50.702302 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-03bdd01d-1b2c-42af-a1ee-4bda63ad3b68 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:50.703123 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-03bdd01d-1b2c-42af-a1ee-4bda63ad3b68 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:50.703636 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-03bdd01d-1b2c-42af-a1ee-4bda63ad3b68 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:50.704095 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-03bdd01d-1b2c-42af-a1ee-4bda63ad3b68 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:50.859906 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3ef5600b-625d-42ec-8b2a-6bccf5de654e tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:50.870290 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3ef5600b-625d-42ec-8b2a-6bccf5de654e tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:50.873792 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3ef5600b-625d-42ec-8b2a-6bccf5de654e tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:50.874916 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3ef5600b-625d-42ec-8b2a-6bccf5de654e tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] 10.222.0.20 "GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663" status: 200 len: 1869 microversion: 2.42 time: 0.510860 Oct 04 18:40:50.875626 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1561/3139] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:50 2022] GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663 => generated 1869 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:50.880329 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2611a681-9b8e-43a0-92b5-7efb1043edce tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:50.882522 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2611a681-9b8e-43a0-92b5-7efb1043edce tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] [instance: d607218c-7a38-4b49-bb51-7e1adfda8c6a] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:50.888873 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2611a681-9b8e-43a0-92b5-7efb1043edce tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:50.889373 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2611a681-9b8e-43a0-92b5-7efb1043edce tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:50.889815 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2611a681-9b8e-43a0-92b5-7efb1043edce tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:50.890519 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2611a681-9b8e-43a0-92b5-7efb1043edce tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:50.890978 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2611a681-9b8e-43a0-92b5-7efb1043edce tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:50.891409 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2611a681-9b8e-43a0-92b5-7efb1043edce tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:51.010998 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-03bdd01d-1b2c-42af-a1ee-4bda63ad3b68 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec13a0273819409b8ecba05e9337ec73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6edbe27acbc4c9eba33a6f589f6cf8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:51.019132 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-03bdd01d-1b2c-42af-a1ee-4bda63ad3b68 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] 10.222.0.20 "GET /compute/v2.1/servers/6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28" status: 200 len: 1509 microversion: 2.1 time: 0.335750 Oct 04 18:40:51.019960 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1579/3140] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:50 2022] GET /compute/v2.1/servers/6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28 => generated 1509 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:51.027871 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-96b629df-aede-488a-8be7-a78e67d9c288 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:51.028847 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-96b629df-aede-488a-8be7-a78e67d9c288 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] [instance: 0212406a-acc5-4631-90e8-03f4409c07f1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:51.037010 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-96b629df-aede-488a-8be7-a78e67d9c288 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:51.037611 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-96b629df-aede-488a-8be7-a78e67d9c288 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:51.038085 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-96b629df-aede-488a-8be7-a78e67d9c288 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:51.039184 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-96b629df-aede-488a-8be7-a78e67d9c288 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:51.039653 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-96b629df-aede-488a-8be7-a78e67d9c288 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:51.040115 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-96b629df-aede-488a-8be7-a78e67d9c288 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:51.417744 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-96b629df-aede-488a-8be7-a78e67d9c288 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:51.426626 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-96b629df-aede-488a-8be7-a78e67d9c288 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:51.428933 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-96b629df-aede-488a-8be7-a78e67d9c288 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:51.434078 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-96b629df-aede-488a-8be7-a78e67d9c288 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] 10.222.0.20 "GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1" status: 200 len: 1446 microversion: 2.75 time: 0.412933 Oct 04 18:40:51.434662 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1580/3141] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:51 2022] GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1 => generated 1446 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:51.439303 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9f02b8c2-669e-4a1d-a98b-95e1fc49efae tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:51.440222 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-9f02b8c2-669e-4a1d-a98b-95e1fc49efae tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] [instance: 1b0129be-f5f9-4735-a10a-008bddc30ab4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:51.447723 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9f02b8c2-669e-4a1d-a98b-95e1fc49efae tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:51.448557 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9f02b8c2-669e-4a1d-a98b-95e1fc49efae tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:51.449162 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9f02b8c2-669e-4a1d-a98b-95e1fc49efae tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:51.450056 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9f02b8c2-669e-4a1d-a98b-95e1fc49efae tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:51.450675 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9f02b8c2-669e-4a1d-a98b-95e1fc49efae tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:51.451266 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9f02b8c2-669e-4a1d-a98b-95e1fc49efae tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:51.467482 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2611a681-9b8e-43a0-92b5-7efb1043edce tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3499c88686046b8a80bc3a754f016e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08896629a67f488b87a845e57a9ca372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:51.479177 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2611a681-9b8e-43a0-92b5-7efb1043edce tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] 10.222.0.20 "GET /compute/v2.1/servers/d607218c-7a38-4b49-bb51-7e1adfda8c6a" status: 200 len: 1324 microversion: 2.1 time: 0.601422 Oct 04 18:40:51.494798 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1562/3142] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:50 2022] GET /compute/v2.1/servers/d607218c-7a38-4b49-bb51-7e1adfda8c6a => generated 1324 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:51.500307 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f9717570-389d-45ba-9da9-264c12c46e57 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:51.504372 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f9717570-389d-45ba-9da9-264c12c46e57 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: c343931b-bc96-4e9e-a5ce-f93454339a53] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:51.510502 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f9717570-389d-45ba-9da9-264c12c46e57 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:51.510909 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f9717570-389d-45ba-9da9-264c12c46e57 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:51.511419 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f9717570-389d-45ba-9da9-264c12c46e57 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:51.512492 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f9717570-389d-45ba-9da9-264c12c46e57 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:51.513786 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f9717570-389d-45ba-9da9-264c12c46e57 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:51.514495 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f9717570-389d-45ba-9da9-264c12c46e57 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:51.551200 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9f02b8c2-669e-4a1d-a98b-95e1fc49efae tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:51.563761 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9f02b8c2-669e-4a1d-a98b-95e1fc49efae tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:51.574166 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9f02b8c2-669e-4a1d-a98b-95e1fc49efae tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:51.575426 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9f02b8c2-669e-4a1d-a98b-95e1fc49efae tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] 10.222.0.20 "GET /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4" status: 200 len: 1366 microversion: 2.47 time: 0.139822 Oct 04 18:40:51.577657 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1581/3143] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:51 2022] GET /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4 => generated 1366 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:51.762386 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-dd67a9d5-a724-4491-b5f3-d556ba3192d6 req-298820fe-6a29-4803-af68-9fd31ba3581a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d3cabc2-fa23-4098-9197-9aaa19a0c663", "name": "network-vif-plugged", "status": "completed", "tag": "97062070-e6e0-48fa-bf25-5e66c4585ef9"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:40:51.773559 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-dd67a9d5-a724-4491-b5f3-d556ba3192d6 req-298820fe-6a29-4803-af68-9fd31ba3581a service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:51.774059 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-dd67a9d5-a724-4491-b5f3-d556ba3192d6 req-298820fe-6a29-4803-af68-9fd31ba3581a service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:51.774508 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-dd67a9d5-a724-4491-b5f3-d556ba3192d6 req-298820fe-6a29-4803-af68-9fd31ba3581a service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:51.788240 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-dd67a9d5-a724-4491-b5f3-d556ba3192d6 req-298820fe-6a29-4803-af68-9fd31ba3581a service nova] Creating event network-vif-plugged:97062070-e6e0-48fa-bf25-5e66c4585ef9 for instance 3d3cabc2-fa23-4098-9197-9aaa19a0c663 on n-h1-850501-14 Oct 04 18:40:51.790479 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f9717570-389d-45ba-9da9-264c12c46e57 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8358c07e2684b749a62becb9f0b7869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b922a74c1c2448bb770d6b298b2d601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:51.794132 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-dd67a9d5-a724-4491-b5f3-d556ba3192d6 req-298820fe-6a29-4803-af68-9fd31ba3581a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035604 Oct 04 18:40:51.795342 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1582/3144] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:40:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:40:51.799490 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f9717570-389d-45ba-9da9-264c12c46e57 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53" status: 200 len: 1472 microversion: 2.1 time: 0.303098 Oct 04 18:40:51.800104 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1563/3145] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:51 2022] GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53 => generated 1472 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:51.902872 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7529a6bc-f846-46cd-9f84-e2439cbd177b tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:51.903583 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7529a6bc-f846-46cd-9f84-e2439cbd177b tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] [instance: 3d3cabc2-fa23-4098-9197-9aaa19a0c663] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:51.910293 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7529a6bc-f846-46cd-9f84-e2439cbd177b tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:51.911471 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7529a6bc-f846-46cd-9f84-e2439cbd177b tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:51.911471 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7529a6bc-f846-46cd-9f84-e2439cbd177b tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:51.912113 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7529a6bc-f846-46cd-9f84-e2439cbd177b tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:51.913332 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7529a6bc-f846-46cd-9f84-e2439cbd177b tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:51.913761 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7529a6bc-f846-46cd-9f84-e2439cbd177b tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:52.043015 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-07773039-519d-4967-8936-d0057d8de244 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:52.044837 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-07773039-519d-4967-8936-d0057d8de244 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] [instance: 6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:52.051439 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-07773039-519d-4967-8936-d0057d8de244 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:52.051938 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-07773039-519d-4967-8936-d0057d8de244 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:52.052411 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-07773039-519d-4967-8936-d0057d8de244 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:52.056606 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-07773039-519d-4967-8936-d0057d8de244 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:52.057092 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-07773039-519d-4967-8936-d0057d8de244 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:52.060937 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-07773039-519d-4967-8936-d0057d8de244 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:52.289451 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7529a6bc-f846-46cd-9f84-e2439cbd177b tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:52.306312 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7529a6bc-f846-46cd-9f84-e2439cbd177b tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:52.307760 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7529a6bc-f846-46cd-9f84-e2439cbd177b tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:52.308976 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7529a6bc-f846-46cd-9f84-e2439cbd177b tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] 10.222.0.20 "GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663" status: 200 len: 1869 microversion: 2.42 time: 0.410899 Oct 04 18:40:52.315349 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-07773039-519d-4967-8936-d0057d8de244 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec13a0273819409b8ecba05e9337ec73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6edbe27acbc4c9eba33a6f589f6cf8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:52.326042 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-07773039-519d-4967-8936-d0057d8de244 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] 10.222.0.20 "GET /compute/v2.1/servers/6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28" status: 200 len: 1509 microversion: 2.1 time: 0.286576 Oct 04 18:40:52.327536 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1564/3146] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:52 2022] GET /compute/v2.1/servers/6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28 => generated 1509 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:40:52.332268 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1583/3147] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:51 2022] GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663 => generated 1869 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:52.463407 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-92dd6eea-3436-42b4-9bd0-2b80b40489a4 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:52.464020 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-92dd6eea-3436-42b4-9bd0-2b80b40489a4 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] [instance: 0212406a-acc5-4631-90e8-03f4409c07f1] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:52.472310 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-92dd6eea-3436-42b4-9bd0-2b80b40489a4 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:52.472745 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-92dd6eea-3436-42b4-9bd0-2b80b40489a4 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:52.473175 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-92dd6eea-3436-42b4-9bd0-2b80b40489a4 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:52.473865 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-92dd6eea-3436-42b4-9bd0-2b80b40489a4 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:52.474317 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-92dd6eea-3436-42b4-9bd0-2b80b40489a4 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:52.475031 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-92dd6eea-3436-42b4-9bd0-2b80b40489a4 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:52.505380 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-bc645801-094b-43c1-b7a6-10693b2b8502 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:52.505380 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-bc645801-094b-43c1-b7a6-10693b2b8502 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] [instance: d607218c-7a38-4b49-bb51-7e1adfda8c6a] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:52.519641 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bc645801-094b-43c1-b7a6-10693b2b8502 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:52.520490 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bc645801-094b-43c1-b7a6-10693b2b8502 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:52.521103 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bc645801-094b-43c1-b7a6-10693b2b8502 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:52.522114 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bc645801-094b-43c1-b7a6-10693b2b8502 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:52.523105 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bc645801-094b-43c1-b7a6-10693b2b8502 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:52.523710 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bc645801-094b-43c1-b7a6-10693b2b8502 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:52.575926 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-92dd6eea-3436-42b4-9bd0-2b80b40489a4 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:52.589924 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-92dd6eea-3436-42b4-9bd0-2b80b40489a4 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:52.591620 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-92dd6eea-3436-42b4-9bd0-2b80b40489a4 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:52.603162 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-92dd6eea-3436-42b4-9bd0-2b80b40489a4 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] 10.222.0.20 "GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1" status: 200 len: 1446 microversion: 2.75 time: 0.144032 Oct 04 18:40:52.630107 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1565/3148] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:52 2022] GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1 => generated 1446 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:52.636308 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a7f4fb34-afda-4213-a6e6-f6b0c59f4152 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:52.636922 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a7f4fb34-afda-4213-a6e6-f6b0c59f4152 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] [instance: 1b0129be-f5f9-4735-a10a-008bddc30ab4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:52.643155 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a7f4fb34-afda-4213-a6e6-f6b0c59f4152 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:52.643684 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a7f4fb34-afda-4213-a6e6-f6b0c59f4152 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:52.644087 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a7f4fb34-afda-4213-a6e6-f6b0c59f4152 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:52.644785 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a7f4fb34-afda-4213-a6e6-f6b0c59f4152 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:52.645302 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a7f4fb34-afda-4213-a6e6-f6b0c59f4152 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:52.645732 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a7f4fb34-afda-4213-a6e6-f6b0c59f4152 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:52.744938 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a7f4fb34-afda-4213-a6e6-f6b0c59f4152 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:52.758762 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a7f4fb34-afda-4213-a6e6-f6b0c59f4152 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:52.760736 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a7f4fb34-afda-4213-a6e6-f6b0c59f4152 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:52.767701 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a7f4fb34-afda-4213-a6e6-f6b0c59f4152 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] 10.222.0.20 "GET /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4" status: 200 len: 1366 microversion: 2.47 time: 0.129751 Oct 04 18:40:52.767701 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1566/3149] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:52 2022] GET /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4 => generated 1366 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:52.784276 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-bc645801-094b-43c1-b7a6-10693b2b8502 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3499c88686046b8a80bc3a754f016e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08896629a67f488b87a845e57a9ca372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:52.793577 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-bc645801-094b-43c1-b7a6-10693b2b8502 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] 10.222.0.20 "GET /compute/v2.1/servers/d607218c-7a38-4b49-bb51-7e1adfda8c6a" status: 200 len: 1521 microversion: 2.1 time: 0.294623 Oct 04 18:40:52.794573 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1584/3150] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:52 2022] GET /compute/v2.1/servers/d607218c-7a38-4b49-bb51-7e1adfda8c6a => generated 1521 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:40:52.830026 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8d9fc81e-37e8-4fd2-8761-b7784e417718 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:52.832585 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6c261165-1f78-4d22-8645-96974757577b tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Action: 'create', calling method: .version_select at 0x7fe253edf430>, body: {"pool": null} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:40:52.832912 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8d9fc81e-37e8-4fd2-8761-b7784e417718 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: c343931b-bc96-4e9e-a5ce-f93454339a53] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:52.843384 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8d9fc81e-37e8-4fd2-8761-b7784e417718 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:52.844236 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8d9fc81e-37e8-4fd2-8761-b7784e417718 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:52.844870 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8d9fc81e-37e8-4fd2-8761-b7784e417718 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:52.845936 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8d9fc81e-37e8-4fd2-8761-b7784e417718 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:52.848702 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8d9fc81e-37e8-4fd2-8761-b7784e417718 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:52.849569 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8d9fc81e-37e8-4fd2-8761-b7784e417718 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:53.086977 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8d9fc81e-37e8-4fd2-8761-b7784e417718 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8358c07e2684b749a62becb9f0b7869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b922a74c1c2448bb770d6b298b2d601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:53.095467 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8d9fc81e-37e8-4fd2-8761-b7784e417718 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53" status: 200 len: 1472 microversion: 2.1 time: 0.274208 Oct 04 18:40:53.103644 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1585/3151] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:52 2022] GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53 => generated 1472 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:53.346921 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-70838063-64cd-461d-aa06-489763e3c6c0 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:53.347676 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-70838063-64cd-461d-aa06-489763e3c6c0 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] [instance: 3d3cabc2-fa23-4098-9197-9aaa19a0c663] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:53.354642 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-70838063-64cd-461d-aa06-489763e3c6c0 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:53.355133 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-70838063-64cd-461d-aa06-489763e3c6c0 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:53.355712 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-70838063-64cd-461d-aa06-489763e3c6c0 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:53.356670 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-70838063-64cd-461d-aa06-489763e3c6c0 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:53.357123 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-70838063-64cd-461d-aa06-489763e3c6c0 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:53.357715 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-70838063-64cd-461d-aa06-489763e3c6c0 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:53.657081 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-70838063-64cd-461d-aa06-489763e3c6c0 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:53.677504 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-70838063-64cd-461d-aa06-489763e3c6c0 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:53.681645 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-70838063-64cd-461d-aa06-489763e3c6c0 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:53.683278 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-70838063-64cd-461d-aa06-489763e3c6c0 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] 10.222.0.20 "GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663" status: 200 len: 1869 microversion: 2.42 time: 0.340367 Oct 04 18:40:53.684128 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1586/3152] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:53 2022] GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663 => generated 1869 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:40:53.692043 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-19b0cc28-e2e1-49e3-9090-06db8ac663cb tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:53.693245 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-19b0cc28-e2e1-49e3-9090-06db8ac663cb tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] [instance: 6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:53.701991 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-19b0cc28-e2e1-49e3-9090-06db8ac663cb tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:53.703513 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-19b0cc28-e2e1-49e3-9090-06db8ac663cb tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:53.703513 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-19b0cc28-e2e1-49e3-9090-06db8ac663cb tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:53.703973 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-19b0cc28-e2e1-49e3-9090-06db8ac663cb tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:53.704482 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-19b0cc28-e2e1-49e3-9090-06db8ac663cb tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:53.704912 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-19b0cc28-e2e1-49e3-9090-06db8ac663cb tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:53.967091 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-19b0cc28-e2e1-49e3-9090-06db8ac663cb tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec13a0273819409b8ecba05e9337ec73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6edbe27acbc4c9eba33a6f589f6cf8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:53.979234 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-19b0cc28-e2e1-49e3-9090-06db8ac663cb tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] 10.222.0.20 "GET /compute/v2.1/servers/6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28" status: 200 len: 1509 microversion: 2.1 time: 0.293614 Oct 04 18:40:53.980119 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1587/3153] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:53 2022] GET /compute/v2.1/servers/6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28 => generated 1509 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:53.985855 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-fb6c0eb5-f0fa-415d-8dbd-95b70b1644f8 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:53.987555 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-fb6c0eb5-f0fa-415d-8dbd-95b70b1644f8 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] [instance: 0212406a-acc5-4631-90e8-03f4409c07f1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:53.997263 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fb6c0eb5-f0fa-415d-8dbd-95b70b1644f8 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:53.998059 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fb6c0eb5-f0fa-415d-8dbd-95b70b1644f8 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:54.003149 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fb6c0eb5-f0fa-415d-8dbd-95b70b1644f8 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:54.003149 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fb6c0eb5-f0fa-415d-8dbd-95b70b1644f8 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:54.003149 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fb6c0eb5-f0fa-415d-8dbd-95b70b1644f8 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:54.003149 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fb6c0eb5-f0fa-415d-8dbd-95b70b1644f8 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:54.090917 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-fb6c0eb5-f0fa-415d-8dbd-95b70b1644f8 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:54.100682 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-fb6c0eb5-f0fa-415d-8dbd-95b70b1644f8 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:54.103058 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-fb6c0eb5-f0fa-415d-8dbd-95b70b1644f8 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:54.108737 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-fb6c0eb5-f0fa-415d-8dbd-95b70b1644f8 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] 10.222.0.20 "GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1" status: 200 len: 1446 microversion: 2.75 time: 0.126764 Oct 04 18:40:54.109683 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1588/3154] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:53 2022] GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1 => generated 1446 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:54.114845 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-19714d29-b3da-49b6-8bd0-519f946cb1ce tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:54.116987 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-19714d29-b3da-49b6-8bd0-519f946cb1ce tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] [instance: 1b0129be-f5f9-4735-a10a-008bddc30ab4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:54.127174 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-19714d29-b3da-49b6-8bd0-519f946cb1ce tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:54.127685 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-19714d29-b3da-49b6-8bd0-519f946cb1ce tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:54.133743 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-19714d29-b3da-49b6-8bd0-519f946cb1ce tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:54.138839 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-19714d29-b3da-49b6-8bd0-519f946cb1ce tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:54.139551 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-19714d29-b3da-49b6-8bd0-519f946cb1ce tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:54.140396 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-19714d29-b3da-49b6-8bd0-519f946cb1ce tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:54.211293 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:40:54.266931 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-19714d29-b3da-49b6-8bd0-519f946cb1ce tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:54.283345 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-19714d29-b3da-49b6-8bd0-519f946cb1ce tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:54.285603 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-19714d29-b3da-49b6-8bd0-519f946cb1ce tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:54.286832 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-19714d29-b3da-49b6-8bd0-519f946cb1ce tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] 10.222.0.20 "GET /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4" status: 200 len: 1366 microversion: 2.47 time: 0.176122 Oct 04 18:40:54.300158 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1589/3155] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:54 2022] GET /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4 => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:54.300158 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-31c88e5c-b67e-44bb-b5a9-e11571f44a14 req-be01bdec-4d7b-47e9-8eea-3a5f226d385e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d3cabc2-fa23-4098-9197-9aaa19a0c663", "name": "network-vif-plugged", "status": "completed", "tag": "c909b4c7-8843-4155-a690-84520be7fb47"}, {"server_uuid": "3d3cabc2-fa23-4098-9197-9aaa19a0c663", "name": "network-vif-plugged", "status": "completed", "tag": "9a5dee2f-2802-439b-91ce-95cc489ce2fb"}, {"server_uuid": "3d3cabc2-fa23-4098-9197-9aaa19a0c663", "name": "network-vif-plugged", "status": "completed", "tag": "d87225ab-6eb7-4ee8-a1ae-be2176c6788c"}, {"server_uuid": "3d3cabc2-fa23-4098-9197-9aaa19a0c663", "name": "network-vif-plugged", "status": "completed", "tag": "aa9d4b51-8919-472c-8e30-368ff36799ac"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:40:54.306170 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-31c88e5c-b67e-44bb-b5a9-e11571f44a14 req-be01bdec-4d7b-47e9-8eea-3a5f226d385e service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:54.311553 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-31c88e5c-b67e-44bb-b5a9-e11571f44a14 req-be01bdec-4d7b-47e9-8eea-3a5f226d385e service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:54.311553 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-31c88e5c-b67e-44bb-b5a9-e11571f44a14 req-be01bdec-4d7b-47e9-8eea-3a5f226d385e service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:54.323910 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-31c88e5c-b67e-44bb-b5a9-e11571f44a14 req-be01bdec-4d7b-47e9-8eea-3a5f226d385e service nova] Creating event network-vif-plugged:c909b4c7-8843-4155-a690-84520be7fb47 for instance 3d3cabc2-fa23-4098-9197-9aaa19a0c663 on n-h1-850501-14 Oct 04 18:40:54.324949 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-31c88e5c-b67e-44bb-b5a9-e11571f44a14 req-be01bdec-4d7b-47e9-8eea-3a5f226d385e service nova] Creating event network-vif-plugged:9a5dee2f-2802-439b-91ce-95cc489ce2fb for instance 3d3cabc2-fa23-4098-9197-9aaa19a0c663 on n-h1-850501-14 Oct 04 18:40:54.325747 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-31c88e5c-b67e-44bb-b5a9-e11571f44a14 req-be01bdec-4d7b-47e9-8eea-3a5f226d385e service nova] Creating event network-vif-plugged:d87225ab-6eb7-4ee8-a1ae-be2176c6788c for instance 3d3cabc2-fa23-4098-9197-9aaa19a0c663 on n-h1-850501-14 Oct 04 18:40:54.326265 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-31c88e5c-b67e-44bb-b5a9-e11571f44a14 req-be01bdec-4d7b-47e9-8eea-3a5f226d385e service nova] Creating event network-vif-plugged:aa9d4b51-8919-472c-8e30-368ff36799ac for instance 3d3cabc2-fa23-4098-9197-9aaa19a0c663 on n-h1-850501-14 Oct 04 18:40:54.335900 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-31c88e5c-b67e-44bb-b5a9-e11571f44a14 req-be01bdec-4d7b-47e9-8eea-3a5f226d385e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.046387 Oct 04 18:40:54.338688 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1590/3156] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:40:54 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:40:54.346576 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-773d5344-1bd8-43fe-adb9-2cddef2e657d tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:54.347508 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-773d5344-1bd8-43fe-adb9-2cddef2e657d tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: c343931b-bc96-4e9e-a5ce-f93454339a53] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:54.359427 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-773d5344-1bd8-43fe-adb9-2cddef2e657d tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:54.359937 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-773d5344-1bd8-43fe-adb9-2cddef2e657d tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:54.360413 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-773d5344-1bd8-43fe-adb9-2cddef2e657d tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:54.361141 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-773d5344-1bd8-43fe-adb9-2cddef2e657d tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:54.361605 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-773d5344-1bd8-43fe-adb9-2cddef2e657d tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:54.362105 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-773d5344-1bd8-43fe-adb9-2cddef2e657d tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:54.602304 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-773d5344-1bd8-43fe-adb9-2cddef2e657d tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8358c07e2684b749a62becb9f0b7869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b922a74c1c2448bb770d6b298b2d601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:54.611358 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-773d5344-1bd8-43fe-adb9-2cddef2e657d tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53" status: 200 len: 1472 microversion: 2.1 time: 0.270641 Oct 04 18:40:54.618417 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1591/3157] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:54 2022] GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53 => generated 1472 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:54.811764 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-54e696d8-69de-4a69-9f3d-cb77c7235524 tempest-ServicesAdminNegativeV253TestJSON-1282853298 tempest-ServicesAdminNegativeV253TestJSON-1282853298-project-admin] Action: 'update', calling method: .version_select at 0x7fe2580e3af0>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:40:54.815716 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-54e696d8-69de-4a69-9f3d-cb77c7235524 tempest-ServicesAdminNegativeV253TestJSON-1282853298 tempest-ServicesAdminNegativeV253TestJSON-1282853298-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:54.816290 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-54e696d8-69de-4a69-9f3d-cb77c7235524 tempest-ServicesAdminNegativeV253TestJSON-1282853298 tempest-ServicesAdminNegativeV253TestJSON-1282853298-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:54.816729 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-54e696d8-69de-4a69-9f3d-cb77c7235524 tempest-ServicesAdminNegativeV253TestJSON-1282853298 tempest-ServicesAdminNegativeV253TestJSON-1282853298-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:54.827385 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-54e696d8-69de-4a69-9f3d-cb77c7235524 tempest-ServicesAdminNegativeV253TestJSON-1282853298 tempest-ServicesAdminNegativeV253TestJSON-1282853298-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:54.827385 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-54e696d8-69de-4a69-9f3d-cb77c7235524 tempest-ServicesAdminNegativeV253TestJSON-1282853298 tempest-ServicesAdminNegativeV253TestJSON-1282853298-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:54.827385 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-54e696d8-69de-4a69-9f3d-cb77c7235524 tempest-ServicesAdminNegativeV253TestJSON-1282853298 tempest-ServicesAdminNegativeV253TestJSON-1282853298-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:54.834165 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-54e696d8-69de-4a69-9f3d-cb77c7235524 tempest-ServicesAdminNegativeV253TestJSON-1282853298 tempest-ServicesAdminNegativeV253TestJSON-1282853298-project-admin] HTTP exception thrown: Service d58654c9-7254-47dc-ac8f-02c239db2eab could not be found. Oct 04 18:40:54.835987 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-54e696d8-69de-4a69-9f3d-cb77c7235524 tempest-ServicesAdminNegativeV253TestJSON-1282853298 tempest-ServicesAdminNegativeV253TestJSON-1282853298-project-admin] Request method failure captured: Oct 04 18:40:54.835987 n-d-850501-14 devstack@n-api.service[123001]: request: PUT /compute/v2.1/os-services/d58654c9-7254-47dc-ac8f-02c239db2eab HTTP/1.1 Oct 04 18:40:54.835987 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:40:54.835987 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:40:54.835987 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:40:54.835987 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 56 Oct 04 18:40:54.835987 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:40:54.835987 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:40:54.835987 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:40:54.835987 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:40:54.835987 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPH42DLejGNLfHNQBWWrPa6Ui_s4_u3CTlYmLii4c1FIhxAQuCSIyfWFdCcPlNxDPJflUrK8LLwGsjh9XqVk7PfHjiBA3dJXchEPUxZEcjsmKNbuP9FelrgNiBdEuKLUFjlX-bBxfvFu-kJQ_ajigw0mig7h7QUgOvPNxEuS8jfR2aE8 Oct 04 18:40:54.835987 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:40:54.835987 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:40:54.835987 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:40:54.835987 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:40:54.835987 n-d-850501-14 devstack@n-api.service[123001]: X-Openstack-Nova-Api-Version: 2.53 Oct 04 18:40:54.835987 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:40:54.835987 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:40:54.835987 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: a9fec42b69f9430d986286b8088cbfa1 Oct 04 18:40:54.835987 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1282853298 Oct 04 18:40:54.835987 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member,admin Oct 04 18:40:54.835987 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member,admin Oct 04 18:40:54.835987 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a9fec42b69f9430d986286b8088cbfa1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a9fec42b69f9430d986286b8088cbfa1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a9fec42b69f9430d986286b8088cbfa1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a9fec42b69f9430d986286b8088cbfa1"}]}] Oct 04 18:40:54.835987 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1282853298 Oct 04 18:40:54.835987 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: a9fec42b69f9430d986286b8088cbfa1 Oct 04 18:40:54.835987 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1282853298 Oct 04 18:40:54.835987 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1282853298-project-admin Oct 04 18:40:54.835987 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:40:54.835987 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:40:54.835987 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 3e2ba1ae204a460f9b30fc37f486a6e6 Oct 04 18:40:54.835987 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1282853298-project-admin Oct 04 18:40:54.835987 n-d-850501-14 devstack@n-api.service[123001]: Oct 04 18:40:54.835987 n-d-850501-14 devstack@n-api.service[123001]: {"status": "disabled", "disabled_reason": "maintenance"} Oct 04 18:40:54.835987 n-d-850501-14 devstack@n-api.service[123001]: method: Oct 04 18:40:54.835987 n-d-850501-14 devstack@n-api.service[123001]: exception: Service d58654c9-7254-47dc-ac8f-02c239db2eab could not be found. Oct 04 18:40:54.835987 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': 'd58654c9-7254-47dc-ac8f-02c239db2eab', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Oct 04 18:40:54.835987 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:40:54.835987 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:54.835987 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 04 18:40:54.835987 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 04 18:40:54.835987 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 04 18:40:54.835987 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 04 18:40:54.835987 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 04 18:40:54.835987 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:40:54.835987 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:54.835987 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:40:54.835987 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:54.835987 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 04 18:40:54.835987 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 04 18:40:54.835987 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 04 18:40:54.835987 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 04 18:40:54.835987 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service d58654c9-7254-47dc-ac8f-02c239db2eab could not be found. Oct 04 18:40:54.835987 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:40:54.835987 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:54.835987 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:40:54.835987 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:54.835987 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:40:54.835987 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:40:54.835987 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:40:54.835987 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:40:54.835987 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:40:54.835987 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:40:54.835987 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:40:54.835987 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:40:54.835987 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:40:54.835987 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:40:54.841333 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 04 18:40:54.841333 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:40:54.841333 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service d58654c9-7254-47dc-ac8f-02c239db2eab could not be found. Oct 04 18:40:54.841333 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:40:54.841333 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:54.841333 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:40:54.841333 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:54.841333 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:40:54.841333 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:40:54.841333 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:40:54.841333 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:40:54.841333 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service d58654c9-7254-47dc-ac8f-02c239db2eab could not be found. Oct 04 18:40:54.841333 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:40:54.841333 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-54e696d8-69de-4a69-9f3d-cb77c7235524 tempest-ServicesAdminNegativeV253TestJSON-1282853298 tempest-ServicesAdminNegativeV253TestJSON-1282853298-project-admin] Returning 404 to user: Service d58654c9-7254-47dc-ac8f-02c239db2eab could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:40:54.841333 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-54e696d8-69de-4a69-9f3d-cb77c7235524 tempest-ServicesAdminNegativeV253TestJSON-1282853298 tempest-ServicesAdminNegativeV253TestJSON-1282853298-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-services/d58654c9-7254-47dc-ac8f-02c239db2eab" status: 404 len: 110 microversion: 2.53 time: 0.224576 Oct 04 18:40:54.841333 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1592/3158] 10.222.0.20 () {62 vars in 1309 bytes} [Tue Oct 4 18:40:54 2022] PUT /compute/v2.1/os-services/d58654c9-7254-47dc-ac8f-02c239db2eab => generated 110 bytes in 226 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:40:54.844797 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a5fb8257-6a2c-4729-af73-ad6473e10895 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:54.845427 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a5fb8257-6a2c-4729-af73-ad6473e10895 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] [instance: 3d3cabc2-fa23-4098-9197-9aaa19a0c663] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:54.852346 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a5fb8257-6a2c-4729-af73-ad6473e10895 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:54.852846 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a5fb8257-6a2c-4729-af73-ad6473e10895 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:54.853292 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a5fb8257-6a2c-4729-af73-ad6473e10895 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:54.854057 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a5fb8257-6a2c-4729-af73-ad6473e10895 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:54.854527 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a5fb8257-6a2c-4729-af73-ad6473e10895 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:54.855002 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a5fb8257-6a2c-4729-af73-ad6473e10895 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:55.032784 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6c261165-1f78-4d22-8645-96974757577b tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.213983 Oct 04 18:40:55.046588 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1567/3159] 10.222.0.20 () {60 vars in 1170 bytes} [Tue Oct 4 18:40:52 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:40:55.055452 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-cbc9ec1d-b252-4f2f-a37f-1431b1242a3b req-a2673902-7707-4af4-9e2b-d7fc4bda2de3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28", "name": "network-vif-deleted", "tag": "c22b4d3b-0439-436b-bdf6-38e75b8da2dd"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:40:55.087585 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-cbc9ec1d-b252-4f2f-a37f-1431b1242a3b req-a2673902-7707-4af4-9e2b-d7fc4bda2de3 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:55.089855 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-cbc9ec1d-b252-4f2f-a37f-1431b1242a3b req-a2673902-7707-4af4-9e2b-d7fc4bda2de3 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:55.090467 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-cbc9ec1d-b252-4f2f-a37f-1431b1242a3b req-a2673902-7707-4af4-9e2b-d7fc4bda2de3 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:55.112213 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a5fb8257-6a2c-4729-af73-ad6473e10895 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:55.112992 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-cbc9ec1d-b252-4f2f-a37f-1431b1242a3b req-a2673902-7707-4af4-9e2b-d7fc4bda2de3 service nova] Creating event network-vif-deleted:c22b4d3b-0439-436b-bdf6-38e75b8da2dd for instance 6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28 on n-h1-850501-14 Oct 04 18:40:55.118633 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-cbc9ec1d-b252-4f2f-a37f-1431b1242a3b req-a2673902-7707-4af4-9e2b-d7fc4bda2de3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083873 Oct 04 18:40:55.119864 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1568/3160] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:40:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:40:55.123311 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a5fb8257-6a2c-4729-af73-ad6473e10895 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:55.124866 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a5fb8257-6a2c-4729-af73-ad6473e10895 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:55.126215 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a5fb8257-6a2c-4729-af73-ad6473e10895 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] 10.222.0.20 "GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663" status: 200 len: 1869 microversion: 2.42 time: 0.286831 Oct 04 18:40:55.126654 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a068ef91-6885-405e-bf07-58631f5de2aa tempest-ServicesAdminNegativeV253TestJSON-1282853298 tempest-ServicesAdminNegativeV253TestJSON-1282853298-project-admin] Action: 'update', calling method: .version_select at 0x7fe253f5e820>, body: {"status": "disabled"} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:40:55.127680 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1593/3161] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:54 2022] GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663 => generated 1869 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:55.131595 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a068ef91-6885-405e-bf07-58631f5de2aa tempest-ServicesAdminNegativeV253TestJSON-1282853298 tempest-ServicesAdminNegativeV253TestJSON-1282853298-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:55.133419 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a068ef91-6885-405e-bf07-58631f5de2aa tempest-ServicesAdminNegativeV253TestJSON-1282853298 tempest-ServicesAdminNegativeV253TestJSON-1282853298-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:55.133419 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a068ef91-6885-405e-bf07-58631f5de2aa tempest-ServicesAdminNegativeV253TestJSON-1282853298 tempest-ServicesAdminNegativeV253TestJSON-1282853298-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:55.140808 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a068ef91-6885-405e-bf07-58631f5de2aa tempest-ServicesAdminNegativeV253TestJSON-1282853298 tempest-ServicesAdminNegativeV253TestJSON-1282853298-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:55.141287 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a068ef91-6885-405e-bf07-58631f5de2aa tempest-ServicesAdminNegativeV253TestJSON-1282853298 tempest-ServicesAdminNegativeV253TestJSON-1282853298-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:55.141717 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a068ef91-6885-405e-bf07-58631f5de2aa tempest-ServicesAdminNegativeV253TestJSON-1282853298 tempest-ServicesAdminNegativeV253TestJSON-1282853298-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:55.141888 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-bf097c4e-c88a-48d3-a663-9ffade603e59 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:55.142640 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-bf097c4e-c88a-48d3-a663-9ffade603e59 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] [instance: 6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:55.149498 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-a068ef91-6885-405e-bf07-58631f5de2aa tempest-ServicesAdminNegativeV253TestJSON-1282853298 tempest-ServicesAdminNegativeV253TestJSON-1282853298-project-admin] HTTP exception thrown: Service d58654c9-7254-47dc-ac8f-02c239db2eab could not be found. Oct 04 18:40:55.151548 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a068ef91-6885-405e-bf07-58631f5de2aa tempest-ServicesAdminNegativeV253TestJSON-1282853298 tempest-ServicesAdminNegativeV253TestJSON-1282853298-project-admin] Request method failure captured: Oct 04 18:40:55.151548 n-d-850501-14 devstack@n-api.service[123002]: request: PUT /compute/v2.1/os-services/d58654c9-7254-47dc-ac8f-02c239db2eab HTTP/1.1 Oct 04 18:40:55.151548 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:40:55.151548 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:40:55.151548 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:40:55.151548 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 22 Oct 04 18:40:55.151548 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:40:55.151548 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:40:55.151548 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:40:55.151548 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:40:55.151548 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH42DLejGNLfHNQBWWrPa6Ui_s4_u3CTlYmLii4c1FIhxAQuCSIyfWFdCcPlNxDPJflUrK8LLwGsjh9XqVk7PfHjiBA3dJXchEPUxZEcjsmKNbuP9FelrgNiBdEuKLUFjlX-bBxfvFu-kJQ_ajigw0mig7h7QUgOvPNxEuS8jfR2aE8 Oct 04 18:40:55.151548 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:40:55.151548 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:40:55.151548 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:40:55.151548 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:40:55.151548 n-d-850501-14 devstack@n-api.service[123002]: X-Openstack-Nova-Api-Version: 2.53 Oct 04 18:40:55.151548 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:40:55.151548 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:40:55.151548 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: a9fec42b69f9430d986286b8088cbfa1 Oct 04 18:40:55.151548 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1282853298 Oct 04 18:40:55.151548 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member,admin Oct 04 18:40:55.151548 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member,admin Oct 04 18:40:55.151548 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a9fec42b69f9430d986286b8088cbfa1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a9fec42b69f9430d986286b8088cbfa1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a9fec42b69f9430d986286b8088cbfa1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a9fec42b69f9430d986286b8088cbfa1"}]}] Oct 04 18:40:55.151548 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1282853298 Oct 04 18:40:55.151548 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: a9fec42b69f9430d986286b8088cbfa1 Oct 04 18:40:55.151548 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1282853298 Oct 04 18:40:55.151548 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1282853298-project-admin Oct 04 18:40:55.151548 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:40:55.151548 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:40:55.151548 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 3e2ba1ae204a460f9b30fc37f486a6e6 Oct 04 18:40:55.151548 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1282853298-project-admin Oct 04 18:40:55.151548 n-d-850501-14 devstack@n-api.service[123002]: Oct 04 18:40:55.151548 n-d-850501-14 devstack@n-api.service[123002]: {"status": "disabled"} Oct 04 18:40:55.151548 n-d-850501-14 devstack@n-api.service[123002]: method: Oct 04 18:40:55.151548 n-d-850501-14 devstack@n-api.service[123002]: exception: Service d58654c9-7254-47dc-ac8f-02c239db2eab could not be found. Oct 04 18:40:55.151548 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'd58654c9-7254-47dc-ac8f-02c239db2eab', 'body': {'status': 'disabled'}} Oct 04 18:40:55.151548 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:40:55.151548 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:55.151548 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 04 18:40:55.151548 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 04 18:40:55.151548 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 04 18:40:55.151548 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 04 18:40:55.151548 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 04 18:40:55.151548 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:40:55.151548 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:55.151548 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:40:55.151548 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:55.151548 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 04 18:40:55.151548 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 04 18:40:55.151548 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 04 18:40:55.151548 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 04 18:40:55.151548 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service d58654c9-7254-47dc-ac8f-02c239db2eab could not be found. Oct 04 18:40:55.151548 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:40:55.151548 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:55.151548 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:40:55.151548 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:55.151548 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:40:55.151548 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:40:55.151548 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:40:55.151548 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:40:55.151548 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:40:55.151548 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:40:55.151548 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:40:55.151548 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:40:55.151548 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:40:55.151548 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:40:55.155614 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 04 18:40:55.155614 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:40:55.155614 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service d58654c9-7254-47dc-ac8f-02c239db2eab could not be found. Oct 04 18:40:55.155614 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:40:55.155614 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:55.155614 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:40:55.155614 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:55.155614 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:40:55.155614 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:40:55.155614 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:40:55.155614 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:40:55.155614 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service d58654c9-7254-47dc-ac8f-02c239db2eab could not be found. Oct 04 18:40:55.155614 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:40:55.155614 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a068ef91-6885-405e-bf07-58631f5de2aa tempest-ServicesAdminNegativeV253TestJSON-1282853298 tempest-ServicesAdminNegativeV253TestJSON-1282853298-project-admin] Returning 404 to user: Service d58654c9-7254-47dc-ac8f-02c239db2eab could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:40:55.155614 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a068ef91-6885-405e-bf07-58631f5de2aa tempest-ServicesAdminNegativeV253TestJSON-1282853298 tempest-ServicesAdminNegativeV253TestJSON-1282853298-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-services/d58654c9-7254-47dc-ac8f-02c239db2eab" status: 404 len: 110 microversion: 2.53 time: 0.031735 Oct 04 18:40:55.159069 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bf097c4e-c88a-48d3-a663-9ffade603e59 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:55.159250 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1569/3162] 10.222.0.20 () {62 vars in 1309 bytes} [Tue Oct 4 18:40:55 2022] PUT /compute/v2.1/os-services/d58654c9-7254-47dc-ac8f-02c239db2eab => generated 110 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:40:55.160218 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bf097c4e-c88a-48d3-a663-9ffade603e59 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:55.160992 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bf097c4e-c88a-48d3-a663-9ffade603e59 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:55.162369 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bf097c4e-c88a-48d3-a663-9ffade603e59 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:55.163742 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bf097c4e-c88a-48d3-a663-9ffade603e59 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:55.164265 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bf097c4e-c88a-48d3-a663-9ffade603e59 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:55.165152 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6e0e8515-4a97-4d9f-952c-9510e9038919 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:55.165876 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-6e0e8515-4a97-4d9f-952c-9510e9038919 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] [instance: 0212406a-acc5-4631-90e8-03f4409c07f1] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:55.173112 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6e0e8515-4a97-4d9f-952c-9510e9038919 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:55.175603 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6e0e8515-4a97-4d9f-952c-9510e9038919 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:55.175603 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6e0e8515-4a97-4d9f-952c-9510e9038919 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:55.175603 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6e0e8515-4a97-4d9f-952c-9510e9038919 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:55.175603 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6e0e8515-4a97-4d9f-952c-9510e9038919 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:55.175965 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6e0e8515-4a97-4d9f-952c-9510e9038919 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:55.242826 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-bf097c4e-c88a-48d3-a663-9ffade603e59 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec13a0273819409b8ecba05e9337ec73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6edbe27acbc4c9eba33a6f589f6cf8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:55.254234 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-bf097c4e-c88a-48d3-a663-9ffade603e59 tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] 10.222.0.20 "GET /compute/v2.1/servers/6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28" status: 200 len: 1467 microversion: 2.1 time: 0.125276 Oct 04 18:40:55.254833 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1594/3163] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:55 2022] GET /compute/v2.1/servers/6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28 => generated 1467 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:55.262074 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3ba719cb-d65e-40c8-b1a0-810d39049d3d tempest-ServicesAdminNegativeV253TestJSON-1282853298 tempest-ServicesAdminNegativeV253TestJSON-1282853298-project-admin] Action: 'update', calling method: .version_select at 0x7fe25816a430>, body: {"status": "enabled"} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:40:55.266066 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3ba719cb-d65e-40c8-b1a0-810d39049d3d tempest-ServicesAdminNegativeV253TestJSON-1282853298 tempest-ServicesAdminNegativeV253TestJSON-1282853298-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:55.266737 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3ba719cb-d65e-40c8-b1a0-810d39049d3d tempest-ServicesAdminNegativeV253TestJSON-1282853298 tempest-ServicesAdminNegativeV253TestJSON-1282853298-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:55.267458 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3ba719cb-d65e-40c8-b1a0-810d39049d3d tempest-ServicesAdminNegativeV253TestJSON-1282853298 tempest-ServicesAdminNegativeV253TestJSON-1282853298-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:55.274851 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3ba719cb-d65e-40c8-b1a0-810d39049d3d tempest-ServicesAdminNegativeV253TestJSON-1282853298 tempest-ServicesAdminNegativeV253TestJSON-1282853298-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:55.275603 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3ba719cb-d65e-40c8-b1a0-810d39049d3d tempest-ServicesAdminNegativeV253TestJSON-1282853298 tempest-ServicesAdminNegativeV253TestJSON-1282853298-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:55.277028 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3ba719cb-d65e-40c8-b1a0-810d39049d3d tempest-ServicesAdminNegativeV253TestJSON-1282853298 tempest-ServicesAdminNegativeV253TestJSON-1282853298-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:55.281494 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-6e0e8515-4a97-4d9f-952c-9510e9038919 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:55.284864 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-3ba719cb-d65e-40c8-b1a0-810d39049d3d tempest-ServicesAdminNegativeV253TestJSON-1282853298 tempest-ServicesAdminNegativeV253TestJSON-1282853298-project-admin] HTTP exception thrown: Service d58654c9-7254-47dc-ac8f-02c239db2eab could not be found. Oct 04 18:40:55.286550 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3ba719cb-d65e-40c8-b1a0-810d39049d3d tempest-ServicesAdminNegativeV253TestJSON-1282853298 tempest-ServicesAdminNegativeV253TestJSON-1282853298-project-admin] Request method failure captured: Oct 04 18:40:55.286550 n-d-850501-14 devstack@n-api.service[123001]: request: PUT /compute/v2.1/os-services/d58654c9-7254-47dc-ac8f-02c239db2eab HTTP/1.1 Oct 04 18:40:55.286550 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:40:55.286550 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:40:55.286550 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:40:55.286550 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 21 Oct 04 18:40:55.286550 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:40:55.286550 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:40:55.286550 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:40:55.286550 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:40:55.286550 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPH42DLejGNLfHNQBWWrPa6Ui_s4_u3CTlYmLii4c1FIhxAQuCSIyfWFdCcPlNxDPJflUrK8LLwGsjh9XqVk7PfHjiBA3dJXchEPUxZEcjsmKNbuP9FelrgNiBdEuKLUFjlX-bBxfvFu-kJQ_ajigw0mig7h7QUgOvPNxEuS8jfR2aE8 Oct 04 18:40:55.286550 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:40:55.286550 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:40:55.286550 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:40:55.286550 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:40:55.286550 n-d-850501-14 devstack@n-api.service[123001]: X-Openstack-Nova-Api-Version: 2.53 Oct 04 18:40:55.286550 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:40:55.286550 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:40:55.286550 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: a9fec42b69f9430d986286b8088cbfa1 Oct 04 18:40:55.286550 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1282853298 Oct 04 18:40:55.286550 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member,admin Oct 04 18:40:55.286550 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member,admin Oct 04 18:40:55.286550 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a9fec42b69f9430d986286b8088cbfa1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a9fec42b69f9430d986286b8088cbfa1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a9fec42b69f9430d986286b8088cbfa1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a9fec42b69f9430d986286b8088cbfa1"}]}] Oct 04 18:40:55.286550 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1282853298 Oct 04 18:40:55.286550 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: a9fec42b69f9430d986286b8088cbfa1 Oct 04 18:40:55.286550 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1282853298 Oct 04 18:40:55.286550 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1282853298-project-admin Oct 04 18:40:55.286550 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:40:55.286550 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:40:55.286550 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 3e2ba1ae204a460f9b30fc37f486a6e6 Oct 04 18:40:55.286550 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1282853298-project-admin Oct 04 18:40:55.286550 n-d-850501-14 devstack@n-api.service[123001]: Oct 04 18:40:55.286550 n-d-850501-14 devstack@n-api.service[123001]: {"status": "enabled"} Oct 04 18:40:55.286550 n-d-850501-14 devstack@n-api.service[123001]: method: Oct 04 18:40:55.286550 n-d-850501-14 devstack@n-api.service[123001]: exception: Service d58654c9-7254-47dc-ac8f-02c239db2eab could not be found. Oct 04 18:40:55.286550 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': 'd58654c9-7254-47dc-ac8f-02c239db2eab', 'body': {'status': 'enabled'}} Oct 04 18:40:55.286550 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:40:55.286550 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:55.286550 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 04 18:40:55.286550 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 04 18:40:55.286550 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 04 18:40:55.286550 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 04 18:40:55.286550 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 04 18:40:55.286550 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:40:55.286550 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:55.286550 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:40:55.286550 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:55.286550 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 04 18:40:55.286550 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 04 18:40:55.286550 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 04 18:40:55.286550 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 04 18:40:55.286550 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service d58654c9-7254-47dc-ac8f-02c239db2eab could not be found. Oct 04 18:40:55.286550 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:40:55.286550 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:55.286550 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:40:55.286550 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:55.286550 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:40:55.286550 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:40:55.286550 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:40:55.286550 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:40:55.286550 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:40:55.286550 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:40:55.286550 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:40:55.286550 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:40:55.286550 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:40:55.286550 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:40:55.291222 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 04 18:40:55.291222 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:40:55.291222 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service d58654c9-7254-47dc-ac8f-02c239db2eab could not be found. Oct 04 18:40:55.291222 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:40:55.291222 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:55.291222 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:40:55.291222 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:55.291222 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:40:55.291222 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:40:55.291222 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:40:55.291222 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:40:55.291222 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service d58654c9-7254-47dc-ac8f-02c239db2eab could not be found. Oct 04 18:40:55.291222 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:40:55.291222 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3ba719cb-d65e-40c8-b1a0-810d39049d3d tempest-ServicesAdminNegativeV253TestJSON-1282853298 tempest-ServicesAdminNegativeV253TestJSON-1282853298-project-admin] Returning 404 to user: Service d58654c9-7254-47dc-ac8f-02c239db2eab could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:40:55.291222 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3ba719cb-d65e-40c8-b1a0-810d39049d3d tempest-ServicesAdminNegativeV253TestJSON-1282853298 tempest-ServicesAdminNegativeV253TestJSON-1282853298-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-services/d58654c9-7254-47dc-ac8f-02c239db2eab" status: 404 len: 110 microversion: 2.53 time: 0.030715 Oct 04 18:40:55.293417 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1595/3164] 10.222.0.20 () {62 vars in 1309 bytes} [Tue Oct 4 18:40:55 2022] PUT /compute/v2.1/os-services/d58654c9-7254-47dc-ac8f-02c239db2eab => generated 110 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:40:55.297909 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-6e0e8515-4a97-4d9f-952c-9510e9038919 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:55.298106 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-88ae6197-3315-415a-a890-7138c57ba447 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-38683044", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": [{"uuid": "1abca12e-af42-4430-bf6f-473c83612754"}]}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:40:55.299777 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-6e0e8515-4a97-4d9f-952c-9510e9038919 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:55.310083 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6e0e8515-4a97-4d9f-952c-9510e9038919 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] 10.222.0.20 "GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1" status: 200 len: 1452 microversion: 2.75 time: 0.149768 Oct 04 18:40:55.335139 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1570/3165] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:55 2022] GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1 => generated 1452 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:55.335139 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-24dd0b16-58f2-426c-aeae-a0def8a80166 tempest-ServicesAdminNegativeV253TestJSON-1282853298 tempest-ServicesAdminNegativeV253TestJSON-1282853298-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:55.336653 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-24dd0b16-58f2-426c-aeae-a0def8a80166 tempest-ServicesAdminNegativeV253TestJSON-1282853298 tempest-ServicesAdminNegativeV253TestJSON-1282853298-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:55.336963 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-24dd0b16-58f2-426c-aeae-a0def8a80166 tempest-ServicesAdminNegativeV253TestJSON-1282853298 tempest-ServicesAdminNegativeV253TestJSON-1282853298-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:55.337516 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-24dd0b16-58f2-426c-aeae-a0def8a80166 tempest-ServicesAdminNegativeV253TestJSON-1282853298 tempest-ServicesAdminNegativeV253TestJSON-1282853298-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:55.338403 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-24dd0b16-58f2-426c-aeae-a0def8a80166 tempest-ServicesAdminNegativeV253TestJSON-1282853298 tempest-ServicesAdminNegativeV253TestJSON-1282853298-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:55.338968 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-24dd0b16-58f2-426c-aeae-a0def8a80166 tempest-ServicesAdminNegativeV253TestJSON-1282853298 tempest-ServicesAdminNegativeV253TestJSON-1282853298-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:55.339669 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-24dd0b16-58f2-426c-aeae-a0def8a80166 tempest-ServicesAdminNegativeV253TestJSON-1282853298 tempest-ServicesAdminNegativeV253TestJSON-1282853298-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:55.367851 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-24dd0b16-58f2-426c-aeae-a0def8a80166 tempest-ServicesAdminNegativeV253TestJSON-1282853298 tempest-ServicesAdminNegativeV253TestJSON-1282853298-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.040969 Oct 04 18:40:55.368973 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1571/3166] 10.222.0.20 () {60 vars in 1178 bytes} [Tue Oct 4 18:40:55 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:55.379466 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.neutron [None req-88ae6197-3315-415a-a890-7138c57ba447 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] validate_networks() for [('1abca12e-af42-4430-bf6f-473c83612754', None, None, None, None, None)] {{(pid=123001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:40:55.381638 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3af0b5ad-106a-4854-a58e-a3e96715cbf7 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:55.382303 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3af0b5ad-106a-4854-a58e-a3e96715cbf7 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] [instance: 1b0129be-f5f9-4735-a10a-008bddc30ab4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:55.395547 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3af0b5ad-106a-4854-a58e-a3e96715cbf7 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:55.397510 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3af0b5ad-106a-4854-a58e-a3e96715cbf7 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:55.398056 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3af0b5ad-106a-4854-a58e-a3e96715cbf7 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:55.399714 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3af0b5ad-106a-4854-a58e-a3e96715cbf7 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:55.400605 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3af0b5ad-106a-4854-a58e-a3e96715cbf7 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:55.401042 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3af0b5ad-106a-4854-a58e-a3e96715cbf7 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:55.505046 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3af0b5ad-106a-4854-a58e-a3e96715cbf7 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:55.516194 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3af0b5ad-106a-4854-a58e-a3e96715cbf7 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:55.528369 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3af0b5ad-106a-4854-a58e-a3e96715cbf7 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:55.531143 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3af0b5ad-106a-4854-a58e-a3e96715cbf7 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] 10.222.0.20 "GET /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4" status: 200 len: 1366 microversion: 2.47 time: 0.159503 Oct 04 18:40:55.531719 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1572/3167] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:55 2022] GET /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:55.536830 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a375e43e-9e1b-4cdb-becf-7fd39b3c8bc1 tempest-ServicesAdminNegativeV253TestJSON-1282853298 tempest-ServicesAdminNegativeV253TestJSON-1282853298-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:55.542188 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a375e43e-9e1b-4cdb-becf-7fd39b3c8bc1 tempest-ServicesAdminNegativeV253TestJSON-1282853298 tempest-ServicesAdminNegativeV253TestJSON-1282853298-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:55.543060 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a375e43e-9e1b-4cdb-becf-7fd39b3c8bc1 tempest-ServicesAdminNegativeV253TestJSON-1282853298 tempest-ServicesAdminNegativeV253TestJSON-1282853298-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:55.549905 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a375e43e-9e1b-4cdb-becf-7fd39b3c8bc1 tempest-ServicesAdminNegativeV253TestJSON-1282853298 tempest-ServicesAdminNegativeV253TestJSON-1282853298-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:55.549905 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a375e43e-9e1b-4cdb-becf-7fd39b3c8bc1 tempest-ServicesAdminNegativeV253TestJSON-1282853298 tempest-ServicesAdminNegativeV253TestJSON-1282853298-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:55.549905 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a375e43e-9e1b-4cdb-becf-7fd39b3c8bc1 tempest-ServicesAdminNegativeV253TestJSON-1282853298 tempest-ServicesAdminNegativeV253TestJSON-1282853298-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:55.549905 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a375e43e-9e1b-4cdb-becf-7fd39b3c8bc1 tempest-ServicesAdminNegativeV253TestJSON-1282853298 tempest-ServicesAdminNegativeV253TestJSON-1282853298-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:55.574246 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a375e43e-9e1b-4cdb-becf-7fd39b3c8bc1 tempest-ServicesAdminNegativeV253TestJSON-1282853298 tempest-ServicesAdminNegativeV253TestJSON-1282853298-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.040990 Oct 04 18:40:55.574873 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1573/3168] 10.222.0.20 () {60 vars in 1211 bytes} [Tue Oct 4 18:40:55 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1244 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:55.591119 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4f4f17dc-f6a1-41ab-826d-f70be75f3ac4 tempest-ServicesAdminNegativeV253TestJSON-1282853298 tempest-ServicesAdminNegativeV253TestJSON-1282853298-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:55.595457 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4f4f17dc-f6a1-41ab-826d-f70be75f3ac4 tempest-ServicesAdminNegativeV253TestJSON-1282853298 tempest-ServicesAdminNegativeV253TestJSON-1282853298-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:55.600883 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4f4f17dc-f6a1-41ab-826d-f70be75f3ac4 tempest-ServicesAdminNegativeV253TestJSON-1282853298 tempest-ServicesAdminNegativeV253TestJSON-1282853298-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:55.600883 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4f4f17dc-f6a1-41ab-826d-f70be75f3ac4 tempest-ServicesAdminNegativeV253TestJSON-1282853298 tempest-ServicesAdminNegativeV253TestJSON-1282853298-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:55.600883 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4f4f17dc-f6a1-41ab-826d-f70be75f3ac4 tempest-ServicesAdminNegativeV253TestJSON-1282853298 tempest-ServicesAdminNegativeV253TestJSON-1282853298-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:55.600883 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4f4f17dc-f6a1-41ab-826d-f70be75f3ac4 tempest-ServicesAdminNegativeV253TestJSON-1282853298 tempest-ServicesAdminNegativeV253TestJSON-1282853298-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:55.600883 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4f4f17dc-f6a1-41ab-826d-f70be75f3ac4 tempest-ServicesAdminNegativeV253TestJSON-1282853298 tempest-ServicesAdminNegativeV253TestJSON-1282853298-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:55.636958 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4f4f17dc-f6a1-41ab-826d-f70be75f3ac4 tempest-ServicesAdminNegativeV253TestJSON-1282853298 tempest-ServicesAdminNegativeV253TestJSON-1282853298-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.050189 Oct 04 18:40:55.637920 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1574/3169] 10.222.0.20 () {60 vars in 1178 bytes} [Tue Oct 4 18:40:55 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:55.650125 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-08aa019d-91b9-4020-a405-07dd72590633 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:55.650744 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-08aa019d-91b9-4020-a405-07dd72590633 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: c343931b-bc96-4e9e-a5ce-f93454339a53] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:55.659313 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-08aa019d-91b9-4020-a405-07dd72590633 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:55.659972 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-08aa019d-91b9-4020-a405-07dd72590633 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:55.660473 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-08aa019d-91b9-4020-a405-07dd72590633 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:55.661240 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-08aa019d-91b9-4020-a405-07dd72590633 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:55.661701 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-08aa019d-91b9-4020-a405-07dd72590633 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:55.662205 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-08aa019d-91b9-4020-a405-07dd72590633 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:55.850965 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-08aa019d-91b9-4020-a405-07dd72590633 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8358c07e2684b749a62becb9f0b7869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b922a74c1c2448bb770d6b298b2d601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:55.859202 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-08aa019d-91b9-4020-a405-07dd72590633 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53" status: 200 len: 1472 microversion: 2.1 time: 0.220138 Oct 04 18:40:55.859991 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1575/3170] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:55 2022] GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53 => generated 1472 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:55.865939 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7f85ceeb-b712-4391-9010-3dc0dfe7b8d3 tempest-ServicesAdminNegativeV253TestJSON-1282853298 tempest-ServicesAdminNegativeV253TestJSON-1282853298-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:55.869899 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7f85ceeb-b712-4391-9010-3dc0dfe7b8d3 tempest-ServicesAdminNegativeV253TestJSON-1282853298 tempest-ServicesAdminNegativeV253TestJSON-1282853298-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:55.870478 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7f85ceeb-b712-4391-9010-3dc0dfe7b8d3 tempest-ServicesAdminNegativeV253TestJSON-1282853298 tempest-ServicesAdminNegativeV253TestJSON-1282853298-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:55.870965 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7f85ceeb-b712-4391-9010-3dc0dfe7b8d3 tempest-ServicesAdminNegativeV253TestJSON-1282853298 tempest-ServicesAdminNegativeV253TestJSON-1282853298-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:55.871692 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7f85ceeb-b712-4391-9010-3dc0dfe7b8d3 tempest-ServicesAdminNegativeV253TestJSON-1282853298 tempest-ServicesAdminNegativeV253TestJSON-1282853298-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:55.872170 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7f85ceeb-b712-4391-9010-3dc0dfe7b8d3 tempest-ServicesAdminNegativeV253TestJSON-1282853298 tempest-ServicesAdminNegativeV253TestJSON-1282853298-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:55.872603 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7f85ceeb-b712-4391-9010-3dc0dfe7b8d3 tempest-ServicesAdminNegativeV253TestJSON-1282853298 tempest-ServicesAdminNegativeV253TestJSON-1282853298-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:55.899315 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7f85ceeb-b712-4391-9010-3dc0dfe7b8d3 tempest-ServicesAdminNegativeV253TestJSON-1282853298 tempest-ServicesAdminNegativeV253TestJSON-1282853298-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?host=n-d-850501-14&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.037891 Oct 04 18:40:55.899927 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1576/3171] 10.222.0.20 () {60 vars in 1237 bytes} [Tue Oct 4 18:40:55 2022] GET /compute/v2.1/os-services?host=n-d-850501-14&binary=xxx => generated 16 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:55.911873 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5835e0db-f6b4-4ada-a420-a6a2b7444937 tempest-ServicesAdminNegativeV253TestJSON-1282853298 tempest-ServicesAdminNegativeV253TestJSON-1282853298-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:55.916356 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5835e0db-f6b4-4ada-a420-a6a2b7444937 tempest-ServicesAdminNegativeV253TestJSON-1282853298 tempest-ServicesAdminNegativeV253TestJSON-1282853298-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:55.916996 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5835e0db-f6b4-4ada-a420-a6a2b7444937 tempest-ServicesAdminNegativeV253TestJSON-1282853298 tempest-ServicesAdminNegativeV253TestJSON-1282853298-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:55.917461 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5835e0db-f6b4-4ada-a420-a6a2b7444937 tempest-ServicesAdminNegativeV253TestJSON-1282853298 tempest-ServicesAdminNegativeV253TestJSON-1282853298-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:55.918203 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5835e0db-f6b4-4ada-a420-a6a2b7444937 tempest-ServicesAdminNegativeV253TestJSON-1282853298 tempest-ServicesAdminNegativeV253TestJSON-1282853298-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:55.918639 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5835e0db-f6b4-4ada-a420-a6a2b7444937 tempest-ServicesAdminNegativeV253TestJSON-1282853298 tempest-ServicesAdminNegativeV253TestJSON-1282853298-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:55.919054 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5835e0db-f6b4-4ada-a420-a6a2b7444937 tempest-ServicesAdminNegativeV253TestJSON-1282853298 tempest-ServicesAdminNegativeV253TestJSON-1282853298-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:55.927266 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-88ae6197-3315-415a-a890-7138c57ba447 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:40:55.928874 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-88ae6197-3315-415a-a890-7138c57ba447 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:40:55.929591 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-88ae6197-3315-415a-a890-7138c57ba447 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:40:55.930199 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-88ae6197-3315-415a-a890-7138c57ba447 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:40:55.930670 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-88ae6197-3315-415a-a890-7138c57ba447 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:40:55.942194 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-88ae6197-3315-415a-a890-7138c57ba447 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:55.945209 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-88ae6197-3315-415a-a890-7138c57ba447 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:55.945209 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-88ae6197-3315-415a-a890-7138c57ba447 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:55.945209 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-88ae6197-3315-415a-a890-7138c57ba447 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:55.945209 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-88ae6197-3315-415a-a890-7138c57ba447 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:55.945792 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5835e0db-f6b4-4ada-a420-a6a2b7444937 tempest-ServicesAdminNegativeV253TestJSON-1282853298 tempest-ServicesAdminNegativeV253TestJSON-1282853298-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.036607 Oct 04 18:40:55.945883 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-88ae6197-3315-415a-a890-7138c57ba447 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:55.946022 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1577/3172] 10.222.0.20 () {60 vars in 1178 bytes} [Tue Oct 4 18:40:55 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:40:55.958386 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a61cffc4-a4c3-44fc-8da9-9fe38cec59ce tempest-ServicesAdminNegativeV253TestJSON-1282853298 tempest-ServicesAdminNegativeV253TestJSON-1282853298-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:55.962185 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a61cffc4-a4c3-44fc-8da9-9fe38cec59ce tempest-ServicesAdminNegativeV253TestJSON-1282853298 tempest-ServicesAdminNegativeV253TestJSON-1282853298-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:55.962960 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a61cffc4-a4c3-44fc-8da9-9fe38cec59ce tempest-ServicesAdminNegativeV253TestJSON-1282853298 tempest-ServicesAdminNegativeV253TestJSON-1282853298-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:55.963381 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a61cffc4-a4c3-44fc-8da9-9fe38cec59ce tempest-ServicesAdminNegativeV253TestJSON-1282853298 tempest-ServicesAdminNegativeV253TestJSON-1282853298-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:55.964314 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a61cffc4-a4c3-44fc-8da9-9fe38cec59ce tempest-ServicesAdminNegativeV253TestJSON-1282853298 tempest-ServicesAdminNegativeV253TestJSON-1282853298-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:55.964920 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a61cffc4-a4c3-44fc-8da9-9fe38cec59ce tempest-ServicesAdminNegativeV253TestJSON-1282853298 tempest-ServicesAdminNegativeV253TestJSON-1282853298-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:55.965530 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a61cffc4-a4c3-44fc-8da9-9fe38cec59ce tempest-ServicesAdminNegativeV253TestJSON-1282853298 tempest-ServicesAdminNegativeV253TestJSON-1282853298-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:55.973976 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-88ae6197-3315-415a-a890-7138c57ba447 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Getting quotas for project 08896629a67f488b87a845e57a9ca372. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:40:55.980406 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-88ae6197-3315-415a-a890-7138c57ba447 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Getting quotas for user a3499c88686046b8a80bc3a754f016e9 and project 08896629a67f488b87a845e57a9ca372. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:40:55.989343 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a61cffc4-a4c3-44fc-8da9-9fe38cec59ce tempest-ServicesAdminNegativeV253TestJSON-1282853298 tempest-ServicesAdminNegativeV253TestJSON-1282853298-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.035048 Oct 04 18:40:55.989949 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1578/3173] 10.222.0.20 () {60 vars in 1239 bytes} [Tue Oct 4 18:40:55 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:40:55.993893 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-88ae6197-3315-415a-a890-7138c57ba447 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Going to run 1 instances... {{(pid=123001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:40:55.996332 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-88ae6197-3315-415a-a890-7138c57ba447 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] [instance: d016f22c-47ba-47c6-95bd-87ae9cb4816d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:40:56.126375 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5c207928-7d27-41b1-a0d2-98e4be87ddd6 tempest-ServicesAdminNegativeV253TestJSON-921180823 tempest-ServicesAdminNegativeV253TestJSON-921180823-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:56.129984 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5c207928-7d27-41b1-a0d2-98e4be87ddd6 tempest-ServicesAdminNegativeV253TestJSON-921180823 tempest-ServicesAdminNegativeV253TestJSON-921180823-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'd02b75ab3654457c85357cdfbc862213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5463be0d8d4174ad54c56b2baab59a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:56.131638 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5c207928-7d27-41b1-a0d2-98e4be87ddd6 tempest-ServicesAdminNegativeV253TestJSON-921180823 tempest-ServicesAdminNegativeV253TestJSON-921180823-project] Request method failure captured: Oct 04 18:40:56.131638 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 04 18:40:56.131638 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:40:56.131638 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:40:56.131638 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:40:56.131638 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:40:56.131638 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:40:56.131638 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:40:56.131638 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:40:56.131638 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:40:56.131638 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH407-UFueWrFd98f_2tvhb57i4MpBhFIo7UpSqfj56VcWIChAmVqTaBW5zbFcKNLQNOjabAv_VJmdG6eyXVsaCSHqKFDlId3gXsc7M-RQhDEEksvwp7mv7MV_6mWNeFlvNlcZ3Hq0XR9E7KG884egnwaljz1f7dhi25NRfML9-gN8c Oct 04 18:40:56.131638 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:40:56.131638 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:40:56.131638 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:40:56.131638 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:40:56.131638 n-d-850501-14 devstack@n-api.service[123002]: X-Openstack-Nova-Api-Version: 2.53 Oct 04 18:40:56.131638 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:40:56.131638 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:40:56.131638 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: da5463be0d8d4174ad54c56b2baab59a Oct 04 18:40:56.131638 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-921180823 Oct 04 18:40:56.131638 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:40:56.131638 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:40:56.131638 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/da5463be0d8d4174ad54c56b2baab59a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_da5463be0d8d4174ad54c56b2baab59a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/da5463be0d8d4174ad54c56b2baab59a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/da5463be0d8d4174ad54c56b2baab59a"}]}] Oct 04 18:40:56.131638 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-921180823 Oct 04 18:40:56.131638 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: da5463be0d8d4174ad54c56b2baab59a Oct 04 18:40:56.131638 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-921180823 Oct 04 18:40:56.131638 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServicesAdminNegativeV253TestJSON-921180823-project Oct 04 18:40:56.131638 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:40:56.131638 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:40:56.131638 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: d02b75ab3654457c85357cdfbc862213 Oct 04 18:40:56.131638 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-921180823-project Oct 04 18:40:56.131638 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:40:56.131638 n-d-850501-14 devstack@n-api.service[123002]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 04 18:40:56.131638 n-d-850501-14 devstack@n-api.service[123002]: action_args: {} Oct 04 18:40:56.131638 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:40:56.131638 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:56.131638 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:40:56.131638 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:40:56.131638 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:40:56.131638 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:40:56.131638 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:40:56.131638 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:40:56.131638 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:40:56.131638 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:40:56.131638 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:40:56.131638 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:40:56.131638 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 04 18:40:56.131638 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 04 18:40:56.131638 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:40:56.131638 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:40:56.131638 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:40:56.131638 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:40:56.131638 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:40:56.131638 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:40:56.131638 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:40:56.131638 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:40:56.131638 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:40:56.131638 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:40:56.131638 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:40:56.131638 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:40:56.131638 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:40:56.131638 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:40:56.131638 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 04 18:40:56.146165 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:40:56.146165 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:56.146165 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:40:56.146165 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:56.146165 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:40:56.146165 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:40:56.146165 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:40:56.146165 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:40:56.146165 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 04 18:40:56.146165 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:40:56.146165 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5c207928-7d27-41b1-a0d2-98e4be87ddd6 tempest-ServicesAdminNegativeV253TestJSON-921180823 tempest-ServicesAdminNegativeV253TestJSON-921180823-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:40:56.146165 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5c207928-7d27-41b1-a0d2-98e4be87ddd6 tempest-ServicesAdminNegativeV253TestJSON-921180823 tempest-ServicesAdminNegativeV253TestJSON-921180823-project] 10.222.0.20 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.133314 Oct 04 18:40:56.146165 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1579/3174] 10.222.0.20 () {60 vars in 1178 bytes} [Tue Oct 4 18:40:55 2022] GET /compute/v2.1/os-services => generated 112 bytes in 134 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:40:56.158460 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-aec43e14-9961-4ed8-b7d3-b48ecde245e7 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:56.159754 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-aec43e14-9961-4ed8-b7d3-b48ecde245e7 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] [instance: 3d3cabc2-fa23-4098-9197-9aaa19a0c663] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:56.166468 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aec43e14-9961-4ed8-b7d3-b48ecde245e7 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:56.166974 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aec43e14-9961-4ed8-b7d3-b48ecde245e7 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:56.167564 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aec43e14-9961-4ed8-b7d3-b48ecde245e7 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:56.168278 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aec43e14-9961-4ed8-b7d3-b48ecde245e7 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:56.168805 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aec43e14-9961-4ed8-b7d3-b48ecde245e7 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:56.169296 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aec43e14-9961-4ed8-b7d3-b48ecde245e7 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:56.191456 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-88ae6197-3315-415a-a890-7138c57ba447 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.896928 Oct 04 18:40:56.192839 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1596/3175] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:40:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 899 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:40:56.214749 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-790e0cea-5505-4bf9-b5cd-73e0ac53c3d3 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:56.221019 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-790e0cea-5505-4bf9-b5cd-73e0ac53c3d3 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] [instance: d016f22c-47ba-47c6-95bd-87ae9cb4816d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:56.387302 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-790e0cea-5505-4bf9-b5cd-73e0ac53c3d3 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3499c88686046b8a80bc3a754f016e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08896629a67f488b87a845e57a9ca372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:56.401522 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-790e0cea-5505-4bf9-b5cd-73e0ac53c3d3 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] 10.222.0.20 "GET /compute/v2.1/servers/d016f22c-47ba-47c6-95bd-87ae9cb4816d" status: 200 len: 1222 microversion: 2.1 time: 0.199994 Oct 04 18:40:56.402505 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1597/3176] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:56 2022] GET /compute/v2.1/servers/d016f22c-47ba-47c6-95bd-87ae9cb4816d => generated 1222 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:56.426813 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-42909880-f496-41aa-9803-aab14813e33b tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:56.427460 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-42909880-f496-41aa-9803-aab14813e33b tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] [instance: 6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:56.457042 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-42909880-f496-41aa-9803-aab14813e33b tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:56.457042 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-42909880-f496-41aa-9803-aab14813e33b tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:56.457042 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-42909880-f496-41aa-9803-aab14813e33b tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:56.457042 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-42909880-f496-41aa-9803-aab14813e33b tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:56.457565 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-aec43e14-9961-4ed8-b7d3-b48ecde245e7 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:56.457672 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-42909880-f496-41aa-9803-aab14813e33b tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:56.457672 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-42909880-f496-41aa-9803-aab14813e33b tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:56.467579 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-aec43e14-9961-4ed8-b7d3-b48ecde245e7 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:56.470822 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-aec43e14-9961-4ed8-b7d3-b48ecde245e7 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:56.472378 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-aec43e14-9961-4ed8-b7d3-b48ecde245e7 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] 10.222.0.20 "GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663" status: 200 len: 1869 microversion: 2.42 time: 0.318144 Oct 04 18:40:56.480788 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1580/3177] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:56 2022] GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663 => generated 1869 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:56.502309 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-61cbde3c-7162-4589-950e-b9403c731e34 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:56.504565 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-61cbde3c-7162-4589-950e-b9403c731e34 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] [instance: 0212406a-acc5-4631-90e8-03f4409c07f1] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:56.513401 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-61cbde3c-7162-4589-950e-b9403c731e34 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:56.514025 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-61cbde3c-7162-4589-950e-b9403c731e34 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:56.514558 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-61cbde3c-7162-4589-950e-b9403c731e34 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:56.515551 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-61cbde3c-7162-4589-950e-b9403c731e34 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:56.516590 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-61cbde3c-7162-4589-950e-b9403c731e34 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:56.517220 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-61cbde3c-7162-4589-950e-b9403c731e34 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:56.519655 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-42909880-f496-41aa-9803-aab14813e33b tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:56.520360 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-42909880-f496-41aa-9803-aab14813e33b tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:56.520785 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-42909880-f496-41aa-9803-aab14813e33b tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:56.521283 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-42909880-f496-41aa-9803-aab14813e33b tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lazy-loading 'fault' on Instance uuid 6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:40:56.524516 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:40:56.580392 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-42909880-f496-41aa-9803-aab14813e33b tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec13a0273819409b8ecba05e9337ec73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6edbe27acbc4c9eba33a6f589f6cf8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:56.591668 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-42909880-f496-41aa-9803-aab14813e33b tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] 10.222.0.20 "GET /compute/v2.1/servers/6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28" status: 200 len: 1313 microversion: 2.1 time: 0.171367 Oct 04 18:40:56.592609 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1598/3178] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:56 2022] GET /compute/v2.1/servers/6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28 => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:56.598937 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-9c71bbe5-ea8c-453b-b37a-52d8bcffc621 req-1659a38a-6d35-4dcc-87e5-e2601fec6b24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d3cabc2-fa23-4098-9197-9aaa19a0c663", "name": "network-vif-plugged", "status": "completed", "tag": "3aad2644-bc27-4d77-9ae6-dd56c1d45027"}, {"server_uuid": "3d3cabc2-fa23-4098-9197-9aaa19a0c663", "name": "network-vif-plugged", "status": "completed", "tag": "cbad334d-c696-4a06-b1cc-741dd0479d60"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:40:56.611239 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-9c71bbe5-ea8c-453b-b37a-52d8bcffc621 req-1659a38a-6d35-4dcc-87e5-e2601fec6b24 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:56.611759 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-9c71bbe5-ea8c-453b-b37a-52d8bcffc621 req-1659a38a-6d35-4dcc-87e5-e2601fec6b24 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:56.612245 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-9c71bbe5-ea8c-453b-b37a-52d8bcffc621 req-1659a38a-6d35-4dcc-87e5-e2601fec6b24 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:56.625608 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-61cbde3c-7162-4589-950e-b9403c731e34 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:56.632129 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-9c71bbe5-ea8c-453b-b37a-52d8bcffc621 req-1659a38a-6d35-4dcc-87e5-e2601fec6b24 service nova] Creating event network-vif-plugged:3aad2644-bc27-4d77-9ae6-dd56c1d45027 for instance 3d3cabc2-fa23-4098-9197-9aaa19a0c663 on n-h1-850501-14 Oct 04 18:40:56.632794 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-9c71bbe5-ea8c-453b-b37a-52d8bcffc621 req-1659a38a-6d35-4dcc-87e5-e2601fec6b24 service nova] Creating event network-vif-plugged:cbad334d-c696-4a06-b1cc-741dd0479d60 for instance 3d3cabc2-fa23-4098-9197-9aaa19a0c663 on n-h1-850501-14 Oct 04 18:40:56.634768 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-61cbde3c-7162-4589-950e-b9403c731e34 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:56.636283 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-61cbde3c-7162-4589-950e-b9403c731e34 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:56.639147 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-9c71bbe5-ea8c-453b-b37a-52d8bcffc621 req-1659a38a-6d35-4dcc-87e5-e2601fec6b24 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.045224 Oct 04 18:40:56.639916 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1599/3179] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:40:56 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:40:56.643612 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-61cbde3c-7162-4589-950e-b9403c731e34 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] 10.222.0.20 "GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1" status: 200 len: 1452 microversion: 2.75 time: 0.149508 Oct 04 18:40:56.644529 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1581/3180] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:56 2022] GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1 => generated 1452 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:56.649913 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-df05c192-9f30-4fdc-a1b0-437788ce7d23 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:56.651020 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-df05c192-9f30-4fdc-a1b0-437788ce7d23 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] [instance: 1b0129be-f5f9-4735-a10a-008bddc30ab4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:56.680760 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-df05c192-9f30-4fdc-a1b0-437788ce7d23 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:56.680760 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-df05c192-9f30-4fdc-a1b0-437788ce7d23 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:56.680760 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-df05c192-9f30-4fdc-a1b0-437788ce7d23 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:56.680760 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-df05c192-9f30-4fdc-a1b0-437788ce7d23 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:56.680760 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-df05c192-9f30-4fdc-a1b0-437788ce7d23 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:56.680760 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-df05c192-9f30-4fdc-a1b0-437788ce7d23 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:56.782980 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-df05c192-9f30-4fdc-a1b0-437788ce7d23 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:56.792091 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-df05c192-9f30-4fdc-a1b0-437788ce7d23 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:56.794072 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-df05c192-9f30-4fdc-a1b0-437788ce7d23 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:56.796154 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-df05c192-9f30-4fdc-a1b0-437788ce7d23 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] 10.222.0.20 "GET /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4" status: 200 len: 1366 microversion: 2.47 time: 0.151265 Oct 04 18:40:56.796961 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1600/3181] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:56 2022] GET /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:56.885465 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5847cd73-3656-43b1-a1d3-aaeede2d9553 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:56.886085 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5847cd73-3656-43b1-a1d3-aaeede2d9553 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: c343931b-bc96-4e9e-a5ce-f93454339a53] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:56.893132 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5847cd73-3656-43b1-a1d3-aaeede2d9553 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:56.893785 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5847cd73-3656-43b1-a1d3-aaeede2d9553 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:56.894739 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5847cd73-3656-43b1-a1d3-aaeede2d9553 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:56.896033 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5847cd73-3656-43b1-a1d3-aaeede2d9553 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:56.897634 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5847cd73-3656-43b1-a1d3-aaeede2d9553 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:56.898961 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5847cd73-3656-43b1-a1d3-aaeede2d9553 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:57.105726 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5847cd73-3656-43b1-a1d3-aaeede2d9553 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8358c07e2684b749a62becb9f0b7869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b922a74c1c2448bb770d6b298b2d601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:57.120415 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5847cd73-3656-43b1-a1d3-aaeede2d9553 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53" status: 200 len: 1472 microversion: 2.1 time: 0.239207 Oct 04 18:40:57.121388 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1582/3182] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:56 2022] GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53 => generated 1472 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:57.432883 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8f6e78b4-37fa-40d5-9033-692a0ef66b64 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:57.433622 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8f6e78b4-37fa-40d5-9033-692a0ef66b64 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] [instance: d016f22c-47ba-47c6-95bd-87ae9cb4816d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:57.437383 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:40:57.441814 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8f6e78b4-37fa-40d5-9033-692a0ef66b64 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:57.442334 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8f6e78b4-37fa-40d5-9033-692a0ef66b64 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:57.442764 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8f6e78b4-37fa-40d5-9033-692a0ef66b64 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:57.443504 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8f6e78b4-37fa-40d5-9033-692a0ef66b64 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:57.443965 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8f6e78b4-37fa-40d5-9033-692a0ef66b64 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:57.444427 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8f6e78b4-37fa-40d5-9033-692a0ef66b64 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:57.501646 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4db7fbf0-02b8-48a9-83f4-653c3900b440 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:57.502433 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4db7fbf0-02b8-48a9-83f4-653c3900b440 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] [instance: 3d3cabc2-fa23-4098-9197-9aaa19a0c663] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:57.511728 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8f6e78b4-37fa-40d5-9033-692a0ef66b64 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3499c88686046b8a80bc3a754f016e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08896629a67f488b87a845e57a9ca372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:57.514602 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4db7fbf0-02b8-48a9-83f4-653c3900b440 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:57.515103 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4db7fbf0-02b8-48a9-83f4-653c3900b440 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:57.515538 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4db7fbf0-02b8-48a9-83f4-653c3900b440 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:57.516395 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4db7fbf0-02b8-48a9-83f4-653c3900b440 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:57.516736 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4db7fbf0-02b8-48a9-83f4-653c3900b440 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:57.517239 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4db7fbf0-02b8-48a9-83f4-653c3900b440 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:57.520241 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8f6e78b4-37fa-40d5-9033-692a0ef66b64 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] 10.222.0.20 "GET /compute/v2.1/servers/d016f22c-47ba-47c6-95bd-87ae9cb4816d" status: 200 len: 1226 microversion: 2.1 time: 0.099793 Oct 04 18:40:57.520925 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1601/3183] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:57 2022] GET /compute/v2.1/servers/d016f22c-47ba-47c6-95bd-87ae9cb4816d => generated 1226 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:57.523084 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=100 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:40:57.624358 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0fa1eb95-cc3d-49d9-8746-791971f7f57d tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:57.625429 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0fa1eb95-cc3d-49d9-8746-791971f7f57d tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] [instance: 6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:57.634157 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0fa1eb95-cc3d-49d9-8746-791971f7f57d tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:57.634891 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0fa1eb95-cc3d-49d9-8746-791971f7f57d tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:57.635594 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0fa1eb95-cc3d-49d9-8746-791971f7f57d tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:57.636917 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0fa1eb95-cc3d-49d9-8746-791971f7f57d tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:57.637981 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0fa1eb95-cc3d-49d9-8746-791971f7f57d tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:57.638877 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0fa1eb95-cc3d-49d9-8746-791971f7f57d tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:57.659665 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-0fa1eb95-cc3d-49d9-8746-791971f7f57d tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] HTTP exception thrown: Instance 6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28 could not be found. Oct 04 18:40:57.661670 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0fa1eb95-cc3d-49d9-8746-791971f7f57d tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Request method failure captured: Oct 04 18:40:57.661670 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28 HTTP/1.1 Oct 04 18:40:57.661670 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:40:57.661670 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:40:57.661670 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:40:57.661670 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:40:57.661670 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:40:57.661670 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:40:57.661670 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:40:57.661670 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:40:57.661670 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPH3c6laQNcVLxFlz3r71NEmawLyxJBaFhBhiGaENsS29IS3E2HCIqseDTASYkKJuH5QYeNjXJV1zPhW9vPWmTfrBW9FIidwr2dD8J6DJKiqEYx2uVMZvv1Kutj7M5ZPeJydeQuZfd9hWniqCOrBV8OJIYbhXThvj37Mf8pU7e-tes2Y Oct 04 18:40:57.661670 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:40:57.661670 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:40:57.661670 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:40:57.661670 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:40:57.661670 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:40:57.661670 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:40:57.661670 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: a6edbe27acbc4c9eba33a6f589f6cf8a Oct 04 18:40:57.661670 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-1561027055 Oct 04 18:40:57.661670 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:40:57.661670 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:40:57.661670 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a6edbe27acbc4c9eba33a6f589f6cf8a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a6edbe27acbc4c9eba33a6f589f6cf8a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a6edbe27acbc4c9eba33a6f589f6cf8a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a6edbe27acbc4c9eba33a6f589f6cf8a"}]}] Oct 04 18:40:57.661670 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-1561027055 Oct 04 18:40:57.661670 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: a6edbe27acbc4c9eba33a6f589f6cf8a Oct 04 18:40:57.661670 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-1561027055 Oct 04 18:40:57.661670 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ServerRescueTestJSONUnderV235-1561027055-project Oct 04 18:40:57.661670 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:40:57.661670 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:40:57.661670 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: ec13a0273819409b8ecba05e9337ec73 Oct 04 18:40:57.661670 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-1561027055-project Oct 04 18:40:57.661670 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:40:57.661670 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28 could not be found. Oct 04 18:40:57.661670 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28'} Oct 04 18:40:57.661670 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:40:57.661670 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:57.661670 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:40:57.661670 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:40:57.661670 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:40:57.661670 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:40:57.661670 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:40:57.661670 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:40:57.661670 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:40:57.661670 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:40:57.661670 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28 could not be found. Oct 04 18:40:57.661670 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:40:57.661670 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:57.661670 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:40:57.661670 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:57.661670 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:40:57.661670 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:40:57.661670 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:40:57.661670 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:40:57.661670 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:40:57.661670 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:40:57.661670 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:40:57.661670 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:40:57.661670 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:40:57.661670 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:40:57.661670 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:40:57.661670 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:40:57.661670 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28 could not be found. Oct 04 18:40:57.661670 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:40:57.661670 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:57.666063 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:40:57.666063 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:57.666063 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:40:57.666063 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:40:57.666063 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:40:57.666063 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:40:57.666063 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28 could not be found. Oct 04 18:40:57.666063 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:40:57.666063 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0fa1eb95-cc3d-49d9-8746-791971f7f57d tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] Returning 404 to user: Instance 6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:40:57.666063 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0fa1eb95-cc3d-49d9-8746-791971f7f57d tempest-ServerRescueTestJSONUnderV235-1561027055 tempest-ServerRescueTestJSONUnderV235-1561027055-project] 10.222.0.20 "GET /compute/v2.1/servers/6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28" status: 404 len: 111 microversion: 2.1 time: 0.050189 Oct 04 18:40:57.666813 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1602/3184] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:57 2022] GET /compute/v2.1/servers/6fa4bbcc-e2ef-493d-ad8d-cbc8d248eb28 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:40:57.674708 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-88ede261-4ec3-4931-b8c7-11d902afa642 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:57.675685 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-88ede261-4ec3-4931-b8c7-11d902afa642 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] [instance: 0212406a-acc5-4631-90e8-03f4409c07f1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:57.684604 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-88ede261-4ec3-4931-b8c7-11d902afa642 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:57.685104 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-88ede261-4ec3-4931-b8c7-11d902afa642 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:57.691405 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-88ede261-4ec3-4931-b8c7-11d902afa642 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:57.691405 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-88ede261-4ec3-4931-b8c7-11d902afa642 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:57.691405 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-88ede261-4ec3-4931-b8c7-11d902afa642 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:57.691405 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-88ede261-4ec3-4931-b8c7-11d902afa642 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:57.777844 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-88ede261-4ec3-4931-b8c7-11d902afa642 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:57.792298 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4db7fbf0-02b8-48a9-83f4-653c3900b440 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:57.795097 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-88ede261-4ec3-4931-b8c7-11d902afa642 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:57.797244 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-88ede261-4ec3-4931-b8c7-11d902afa642 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:57.805288 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-88ede261-4ec3-4931-b8c7-11d902afa642 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] 10.222.0.20 "GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1" status: 200 len: 1437 microversion: 2.75 time: 0.135265 Oct 04 18:40:57.806964 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1603/3185] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:57 2022] GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1 => generated 1437 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:57.810319 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4db7fbf0-02b8-48a9-83f4-653c3900b440 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:57.812477 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4db7fbf0-02b8-48a9-83f4-653c3900b440 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:57.826503 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a7c9043e-3c69-4bb2-8c02-9cdeb762bc46 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:57.827127 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a7c9043e-3c69-4bb2-8c02-9cdeb762bc46 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] [instance: 1b0129be-f5f9-4735-a10a-008bddc30ab4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:57.831440 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4db7fbf0-02b8-48a9-83f4-653c3900b440 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] 10.222.0.20 "GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663" status: 200 len: 1869 microversion: 2.42 time: 0.333693 Oct 04 18:40:57.837852 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1583/3186] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:57 2022] GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663 => generated 1869 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:40:57.837978 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a7c9043e-3c69-4bb2-8c02-9cdeb762bc46 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:57.838154 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a7c9043e-3c69-4bb2-8c02-9cdeb762bc46 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:57.839118 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a7c9043e-3c69-4bb2-8c02-9cdeb762bc46 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:57.840376 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a7c9043e-3c69-4bb2-8c02-9cdeb762bc46 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:57.841645 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a7c9043e-3c69-4bb2-8c02-9cdeb762bc46 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:57.842183 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a7c9043e-3c69-4bb2-8c02-9cdeb762bc46 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:57.917057 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a7c9043e-3c69-4bb2-8c02-9cdeb762bc46 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:57.930406 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a7c9043e-3c69-4bb2-8c02-9cdeb762bc46 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:57.932229 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a7c9043e-3c69-4bb2-8c02-9cdeb762bc46 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:57.933454 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a7c9043e-3c69-4bb2-8c02-9cdeb762bc46 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] 10.222.0.20 "GET /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4" status: 200 len: 1366 microversion: 2.47 time: 0.113914 Oct 04 18:40:57.934010 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1604/3187] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:57 2022] GET /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4 => generated 1366 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:57.956160 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=27,nova_cell0:UPDATE=7 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:40:58.147477 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5cd4d2f1-0764-41a5-a11c-983dd85f9938 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:40:58.147606 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-dc27c96e-809c-4048-82f6-b05cc231dfb3 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:58.147606 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-dc27c96e-809c-4048-82f6-b05cc231dfb3 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: c343931b-bc96-4e9e-a5ce-f93454339a53] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:58.150623 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5cd4d2f1-0764-41a5-a11c-983dd85f9938 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] [instance: 0212406a-acc5-4631-90e8-03f4409c07f1] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:58.157455 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dc27c96e-809c-4048-82f6-b05cc231dfb3 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:58.158093 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dc27c96e-809c-4048-82f6-b05cc231dfb3 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:58.158620 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dc27c96e-809c-4048-82f6-b05cc231dfb3 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:58.159070 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=12 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:40:58.159689 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dc27c96e-809c-4048-82f6-b05cc231dfb3 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:58.160155 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dc27c96e-809c-4048-82f6-b05cc231dfb3 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:58.161221 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5cd4d2f1-0764-41a5-a11c-983dd85f9938 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:58.161424 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dc27c96e-809c-4048-82f6-b05cc231dfb3 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:58.163169 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5cd4d2f1-0764-41a5-a11c-983dd85f9938 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:58.163859 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5cd4d2f1-0764-41a5-a11c-983dd85f9938 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:58.165074 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5cd4d2f1-0764-41a5-a11c-983dd85f9938 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:58.165713 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5cd4d2f1-0764-41a5-a11c-983dd85f9938 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:58.166198 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5cd4d2f1-0764-41a5-a11c-983dd85f9938 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:58.256865 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-5cd4d2f1-0764-41a5-a11c-983dd85f9938 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:40:58.258124 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-5cd4d2f1-0764-41a5-a11c-983dd85f9938 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:40:58.258776 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-5cd4d2f1-0764-41a5-a11c-983dd85f9938 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:40:58.259350 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-5cd4d2f1-0764-41a5-a11c-983dd85f9938 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:40:58.260131 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-5cd4d2f1-0764-41a5-a11c-983dd85f9938 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:40:58.338135 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-dc27c96e-809c-4048-82f6-b05cc231dfb3 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8358c07e2684b749a62becb9f0b7869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b922a74c1c2448bb770d6b298b2d601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:58.346738 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-dc27c96e-809c-4048-82f6-b05cc231dfb3 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53" status: 200 len: 1472 microversion: 2.1 time: 0.206059 Oct 04 18:40:58.348420 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1605/3188] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:58 2022] GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53 => generated 1472 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:58.545935 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-11f506cd-b846-4738-b5af-cb1660a24613 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:58.546619 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-11f506cd-b846-4738-b5af-cb1660a24613 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] [instance: d016f22c-47ba-47c6-95bd-87ae9cb4816d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:58.553265 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-11f506cd-b846-4738-b5af-cb1660a24613 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:58.553754 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-11f506cd-b846-4738-b5af-cb1660a24613 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:58.554187 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-11f506cd-b846-4738-b5af-cb1660a24613 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:58.554875 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-11f506cd-b846-4738-b5af-cb1660a24613 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:58.555325 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-11f506cd-b846-4738-b5af-cb1660a24613 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:58.555747 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-11f506cd-b846-4738-b5af-cb1660a24613 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:58.620291 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-11f506cd-b846-4738-b5af-cb1660a24613 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3499c88686046b8a80bc3a754f016e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08896629a67f488b87a845e57a9ca372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:58.628614 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-11f506cd-b846-4738-b5af-cb1660a24613 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] 10.222.0.20 "GET /compute/v2.1/servers/d016f22c-47ba-47c6-95bd-87ae9cb4816d" status: 200 len: 1274 microversion: 2.1 time: 0.087784 Oct 04 18:40:58.629182 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1606/3189] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:58 2022] GET /compute/v2.1/servers/d016f22c-47ba-47c6-95bd-87ae9cb4816d => generated 1274 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:40:58.691146 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5cd4d2f1-0764-41a5-a11c-983dd85f9938 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] [instance: 0212406a-acc5-4631-90e8-03f4409c07f1] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:58.715487 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5cd4d2f1-0764-41a5-a11c-983dd85f9938 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:58.721193 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5cd4d2f1-0764-41a5-a11c-983dd85f9938 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:58.724984 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5cd4d2f1-0764-41a5-a11c-983dd85f9938 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:58.728648 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5cd4d2f1-0764-41a5-a11c-983dd85f9938 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:58.731111 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5cd4d2f1-0764-41a5-a11c-983dd85f9938 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:58.732146 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5cd4d2f1-0764-41a5-a11c-983dd85f9938 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:58.862938 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f29c525e-4c3f-4a78-a5a4-5b106ac4bacb tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:58.863619 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f29c525e-4c3f-4a78-a5a4-5b106ac4bacb tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] [instance: 3d3cabc2-fa23-4098-9197-9aaa19a0c663] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:58.870268 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-5cd4d2f1-0764-41a5-a11c-983dd85f9938 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lazy-loading 'services' on Instance uuid 0212406a-acc5-4631-90e8-03f4409c07f1 {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:40:58.883665 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f29c525e-4c3f-4a78-a5a4-5b106ac4bacb tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:58.884203 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f29c525e-4c3f-4a78-a5a4-5b106ac4bacb tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:58.885652 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f29c525e-4c3f-4a78-a5a4-5b106ac4bacb tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:58.891808 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f29c525e-4c3f-4a78-a5a4-5b106ac4bacb tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:58.891808 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f29c525e-4c3f-4a78-a5a4-5b106ac4bacb tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:58.893020 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f29c525e-4c3f-4a78-a5a4-5b106ac4bacb tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:58.929522 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5cd4d2f1-0764-41a5-a11c-983dd85f9938 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1/action" status: 202 len: 1942 microversion: 2.75 time: 1.096382 Oct 04 18:40:58.930177 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1584/3190] 10.222.0.20 () {62 vars in 1319 bytes} [Tue Oct 4 18:40:57 2022] POST /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1/action => generated 1942 bytes in 1098 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 04 18:40:58.960110 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7cecfde7-1fb1-4a5e-aaf1-42a8a9cf6433 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:58.960736 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7cecfde7-1fb1-4a5e-aaf1-42a8a9cf6433 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] [instance: 0212406a-acc5-4631-90e8-03f4409c07f1] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:58.966763 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7cecfde7-1fb1-4a5e-aaf1-42a8a9cf6433 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:58.967500 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7cecfde7-1fb1-4a5e-aaf1-42a8a9cf6433 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:58.967939 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7cecfde7-1fb1-4a5e-aaf1-42a8a9cf6433 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:58.968674 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7cecfde7-1fb1-4a5e-aaf1-42a8a9cf6433 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:58.969126 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7cecfde7-1fb1-4a5e-aaf1-42a8a9cf6433 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:58.969721 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7cecfde7-1fb1-4a5e-aaf1-42a8a9cf6433 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:59.104539 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-7cecfde7-1fb1-4a5e-aaf1-42a8a9cf6433 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lazy-loading 'services' on Instance uuid 0212406a-acc5-4631-90e8-03f4409c07f1 {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:40:59.131626 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7cecfde7-1fb1-4a5e-aaf1-42a8a9cf6433 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1" status: 200 len: 1929 microversion: 2.75 time: 0.174952 Oct 04 18:40:59.132756 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1585/3191] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:58 2022] GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1 => generated 1929 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:40:59.138797 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1e9ed94b-d30f-4a9a-8919-34bbd1753916 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:59.139643 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1e9ed94b-d30f-4a9a-8919-34bbd1753916 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] [instance: 1b0129be-f5f9-4735-a10a-008bddc30ab4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:59.146069 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1e9ed94b-d30f-4a9a-8919-34bbd1753916 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:59.148997 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1e9ed94b-d30f-4a9a-8919-34bbd1753916 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:59.148997 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1e9ed94b-d30f-4a9a-8919-34bbd1753916 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:59.148997 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1e9ed94b-d30f-4a9a-8919-34bbd1753916 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:59.148997 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1e9ed94b-d30f-4a9a-8919-34bbd1753916 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:59.149942 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1e9ed94b-d30f-4a9a-8919-34bbd1753916 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:59.159498 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f29c525e-4c3f-4a78-a5a4-5b106ac4bacb tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:59.170056 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f29c525e-4c3f-4a78-a5a4-5b106ac4bacb tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:59.171496 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f29c525e-4c3f-4a78-a5a4-5b106ac4bacb tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:59.172986 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f29c525e-4c3f-4a78-a5a4-5b106ac4bacb tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] 10.222.0.20 "GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663" status: 200 len: 2824 microversion: 2.42 time: 0.315547 Oct 04 18:40:59.187804 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1607/3192] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:58 2022] GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663 => generated 2824 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:40:59.204186 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-28d58a03-80e9-480f-956e-c66f167c5fce tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:59.205025 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-28d58a03-80e9-480f-956e-c66f167c5fce tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] [instance: 3d3cabc2-fa23-4098-9197-9aaa19a0c663] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:59.215150 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-28d58a03-80e9-480f-956e-c66f167c5fce tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:59.224284 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-28d58a03-80e9-480f-956e-c66f167c5fce tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:59.225453 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-28d58a03-80e9-480f-956e-c66f167c5fce tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:59.226744 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-28d58a03-80e9-480f-956e-c66f167c5fce tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:59.227361 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-28d58a03-80e9-480f-956e-c66f167c5fce tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:59.228211 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-28d58a03-80e9-480f-956e-c66f167c5fce tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:59.288784 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1e9ed94b-d30f-4a9a-8919-34bbd1753916 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:59.305550 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1e9ed94b-d30f-4a9a-8919-34bbd1753916 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:59.307324 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1e9ed94b-d30f-4a9a-8919-34bbd1753916 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:59.308619 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1e9ed94b-d30f-4a9a-8919-34bbd1753916 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] 10.222.0.20 "GET /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4" status: 200 len: 1372 microversion: 2.47 time: 0.174163 Oct 04 18:40:59.309175 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1586/3193] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:59 2022] GET /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4 => generated 1372 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:59.372586 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b9c94cba-b668-4056-846a-43efebb97fa3 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:59.372908 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b9c94cba-b668-4056-846a-43efebb97fa3 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: c343931b-bc96-4e9e-a5ce-f93454339a53] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:59.397930 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b9c94cba-b668-4056-846a-43efebb97fa3 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:59.400216 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b9c94cba-b668-4056-846a-43efebb97fa3 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:59.400216 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b9c94cba-b668-4056-846a-43efebb97fa3 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:59.400216 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b9c94cba-b668-4056-846a-43efebb97fa3 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:59.400216 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b9c94cba-b668-4056-846a-43efebb97fa3 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:59.400616 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b9c94cba-b668-4056-846a-43efebb97fa3 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:59.459394 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-28d58a03-80e9-480f-956e-c66f167c5fce tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] 10.222.0.20 "GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.258862 Oct 04 18:40:59.460755 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1608/3194] 10.222.0.20 () {60 vars in 1316 bytes} [Tue Oct 4 18:40:59 2022] GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663/os-interface => generated 1830 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:40:59.603247 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b9c94cba-b668-4056-846a-43efebb97fa3 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8358c07e2684b749a62becb9f0b7869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b922a74c1c2448bb770d6b298b2d601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:59.612235 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b9c94cba-b668-4056-846a-43efebb97fa3 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53" status: 200 len: 1472 microversion: 2.1 time: 0.243736 Oct 04 18:40:59.612965 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1587/3195] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:59 2022] GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53 => generated 1472 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:40:59.653604 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-33f3f526-c124-4c09-904e-55e3c17a89b0 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:59.655207 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-33f3f526-c124-4c09-904e-55e3c17a89b0 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] [instance: d016f22c-47ba-47c6-95bd-87ae9cb4816d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:59.666607 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-33f3f526-c124-4c09-904e-55e3c17a89b0 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:59.667362 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-33f3f526-c124-4c09-904e-55e3c17a89b0 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:59.667982 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-33f3f526-c124-4c09-904e-55e3c17a89b0 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:59.668939 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-33f3f526-c124-4c09-904e-55e3c17a89b0 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:59.669545 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-33f3f526-c124-4c09-904e-55e3c17a89b0 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:59.670898 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-33f3f526-c124-4c09-904e-55e3c17a89b0 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:59.793007 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-33f3f526-c124-4c09-904e-55e3c17a89b0 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3499c88686046b8a80bc3a754f016e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08896629a67f488b87a845e57a9ca372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:59.807327 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-33f3f526-c124-4c09-904e-55e3c17a89b0 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] 10.222.0.20 "GET /compute/v2.1/servers/d016f22c-47ba-47c6-95bd-87ae9cb4816d" status: 200 len: 1282 microversion: 2.1 time: 0.160252 Oct 04 18:40:59.823012 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1609/3196] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:59 2022] GET /compute/v2.1/servers/d016f22c-47ba-47c6-95bd-87ae9cb4816d => generated 1282 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:00.164461 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4d293f1c-9547-46b3-962d-91dcac74967f tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:00.165075 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4d293f1c-9547-46b3-962d-91dcac74967f tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] [instance: 0212406a-acc5-4631-90e8-03f4409c07f1] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:00.171606 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4d293f1c-9547-46b3-962d-91dcac74967f tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:00.172180 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4d293f1c-9547-46b3-962d-91dcac74967f tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:00.172718 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4d293f1c-9547-46b3-962d-91dcac74967f tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:00.173747 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4d293f1c-9547-46b3-962d-91dcac74967f tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:00.174384 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4d293f1c-9547-46b3-962d-91dcac74967f tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:00.174806 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4d293f1c-9547-46b3-962d-91dcac74967f tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:00.264911 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-4d293f1c-9547-46b3-962d-91dcac74967f tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lazy-loading 'services' on Instance uuid 0212406a-acc5-4631-90e8-03f4409c07f1 {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:41:00.283336 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4d293f1c-9547-46b3-962d-91dcac74967f tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1" status: 200 len: 1929 microversion: 2.75 time: 0.124851 Oct 04 18:41:00.283926 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1588/3197] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:41:00 2022] GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1 => generated 1929 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:41:00.337682 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a38b5401-0f61-43d7-8d8a-0ea2309f1a96 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:00.338427 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a38b5401-0f61-43d7-8d8a-0ea2309f1a96 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] [instance: 1b0129be-f5f9-4735-a10a-008bddc30ab4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:00.344705 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a38b5401-0f61-43d7-8d8a-0ea2309f1a96 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:00.345215 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a38b5401-0f61-43d7-8d8a-0ea2309f1a96 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:00.349851 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a38b5401-0f61-43d7-8d8a-0ea2309f1a96 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:00.349851 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a38b5401-0f61-43d7-8d8a-0ea2309f1a96 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:00.349851 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a38b5401-0f61-43d7-8d8a-0ea2309f1a96 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:00.349851 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a38b5401-0f61-43d7-8d8a-0ea2309f1a96 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:00.421178 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a38b5401-0f61-43d7-8d8a-0ea2309f1a96 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:00.432577 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a38b5401-0f61-43d7-8d8a-0ea2309f1a96 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:00.434443 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a38b5401-0f61-43d7-8d8a-0ea2309f1a96 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:00.435617 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a38b5401-0f61-43d7-8d8a-0ea2309f1a96 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] 10.222.0.20 "GET /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4" status: 200 len: 1372 microversion: 2.47 time: 0.101963 Oct 04 18:41:00.436201 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1610/3198] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:41:00 2022] GET /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4 => generated 1372 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:41:00.631371 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-54153543-eb1a-41ac-af71-0d0ab29bb852 tempest-AbsoluteLimitsTestJSON-96574155 tempest-AbsoluteLimitsTestJSON-96574155-project] Calling method '.version_select at 0x7fe253e9e040>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:00.636684 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-145e7442-6337-46b0-b257-b603ef89dc50 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:00.637298 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-145e7442-6337-46b0-b257-b603ef89dc50 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: c343931b-bc96-4e9e-a5ce-f93454339a53] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:00.649992 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-145e7442-6337-46b0-b257-b603ef89dc50 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:00.655094 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-145e7442-6337-46b0-b257-b603ef89dc50 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:00.655094 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-145e7442-6337-46b0-b257-b603ef89dc50 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:00.655766 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-54153543-eb1a-41ac-af71-0d0ab29bb852 tempest-AbsoluteLimitsTestJSON-96574155 tempest-AbsoluteLimitsTestJSON-96574155-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:00.655857 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-145e7442-6337-46b0-b257-b603ef89dc50 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:00.655956 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-54153543-eb1a-41ac-af71-0d0ab29bb852 tempest-AbsoluteLimitsTestJSON-96574155 tempest-AbsoluteLimitsTestJSON-96574155-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:00.656039 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-145e7442-6337-46b0-b257-b603ef89dc50 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:00.656354 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-54153543-eb1a-41ac-af71-0d0ab29bb852 tempest-AbsoluteLimitsTestJSON-96574155 tempest-AbsoluteLimitsTestJSON-96574155-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:00.656453 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-145e7442-6337-46b0-b257-b603ef89dc50 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:00.656534 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-54153543-eb1a-41ac-af71-0d0ab29bb852 tempest-AbsoluteLimitsTestJSON-96574155 tempest-AbsoluteLimitsTestJSON-96574155-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:00.656534 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-54153543-eb1a-41ac-af71-0d0ab29bb852 tempest-AbsoluteLimitsTestJSON-96574155 tempest-AbsoluteLimitsTestJSON-96574155-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:00.656534 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-54153543-eb1a-41ac-af71-0d0ab29bb852 tempest-AbsoluteLimitsTestJSON-96574155 tempest-AbsoluteLimitsTestJSON-96574155-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:00.676815 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-54153543-eb1a-41ac-af71-0d0ab29bb852 tempest-AbsoluteLimitsTestJSON-96574155 tempest-AbsoluteLimitsTestJSON-96574155-project] 10.222.0.20 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.165033 Oct 04 18:41:00.688210 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1589/3199] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Oct 4 18:41:00 2022] GET /compute/v2.1/limits => generated 511 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:41:00.812700 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-145e7442-6337-46b0-b257-b603ef89dc50 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8358c07e2684b749a62becb9f0b7869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b922a74c1c2448bb770d6b298b2d601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:00.822519 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-145e7442-6337-46b0-b257-b603ef89dc50 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53" status: 200 len: 1472 microversion: 2.1 time: 0.189527 Oct 04 18:41:00.823504 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1611/3200] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:00 2022] GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53 => generated 1472 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:00.836638 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-05ba685b-5ceb-4a5e-aa4c-335b216bbf67 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:00.837356 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-05ba685b-5ceb-4a5e-aa4c-335b216bbf67 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] [instance: d016f22c-47ba-47c6-95bd-87ae9cb4816d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:00.844081 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-05ba685b-5ceb-4a5e-aa4c-335b216bbf67 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:00.844668 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-05ba685b-5ceb-4a5e-aa4c-335b216bbf67 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:00.845256 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-05ba685b-5ceb-4a5e-aa4c-335b216bbf67 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:00.846026 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-05ba685b-5ceb-4a5e-aa4c-335b216bbf67 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:00.846619 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-05ba685b-5ceb-4a5e-aa4c-335b216bbf67 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:00.847079 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-05ba685b-5ceb-4a5e-aa4c-335b216bbf67 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:00.916584 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-05ba685b-5ceb-4a5e-aa4c-335b216bbf67 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3499c88686046b8a80bc3a754f016e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08896629a67f488b87a845e57a9ca372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:00.924558 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-05ba685b-5ceb-4a5e-aa4c-335b216bbf67 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] 10.222.0.20 "GET /compute/v2.1/servers/d016f22c-47ba-47c6-95bd-87ae9cb4816d" status: 200 len: 1280 microversion: 2.1 time: 0.093582 Oct 04 18:41:00.925143 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1590/3201] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:00 2022] GET /compute/v2.1/servers/d016f22c-47ba-47c6-95bd-87ae9cb4816d => generated 1280 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:01.312880 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6e891f58-fee2-4030-855b-947633f43056 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:01.313698 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6e891f58-fee2-4030-855b-947633f43056 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] [instance: 0212406a-acc5-4631-90e8-03f4409c07f1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:01.322202 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6e891f58-fee2-4030-855b-947633f43056 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:01.322689 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6e891f58-fee2-4030-855b-947633f43056 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:01.323281 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6e891f58-fee2-4030-855b-947633f43056 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:01.324169 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6e891f58-fee2-4030-855b-947633f43056 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:01.324763 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6e891f58-fee2-4030-855b-947633f43056 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:01.325507 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6e891f58-fee2-4030-855b-947633f43056 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:01.422390 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-6e891f58-fee2-4030-855b-947633f43056 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lazy-loading 'services' on Instance uuid 0212406a-acc5-4631-90e8-03f4409c07f1 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:41:01.443118 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6e891f58-fee2-4030-855b-947633f43056 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1" status: 200 len: 1929 microversion: 2.75 time: 0.133725 Oct 04 18:41:01.444623 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1612/3202] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:41:01 2022] GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1 => generated 1929 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:41:01.464770 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6722c342-811a-4fb5-bf1d-e7ff1252fa41 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:01.466079 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-6722c342-811a-4fb5-bf1d-e7ff1252fa41 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] [instance: 1b0129be-f5f9-4735-a10a-008bddc30ab4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:01.472602 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6722c342-811a-4fb5-bf1d-e7ff1252fa41 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:01.473085 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6722c342-811a-4fb5-bf1d-e7ff1252fa41 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:01.473515 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6722c342-811a-4fb5-bf1d-e7ff1252fa41 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:01.474208 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6722c342-811a-4fb5-bf1d-e7ff1252fa41 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:01.475322 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6722c342-811a-4fb5-bf1d-e7ff1252fa41 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:01.475847 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6722c342-811a-4fb5-bf1d-e7ff1252fa41 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:01.541631 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-6722c342-811a-4fb5-bf1d-e7ff1252fa41 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:01.549694 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-6722c342-811a-4fb5-bf1d-e7ff1252fa41 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:01.551229 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-6722c342-811a-4fb5-bf1d-e7ff1252fa41 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:01.552311 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6722c342-811a-4fb5-bf1d-e7ff1252fa41 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] 10.222.0.20 "GET /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4" status: 200 len: 1372 microversion: 2.47 time: 0.091630 Oct 04 18:41:01.552947 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1591/3203] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:41:01 2022] GET /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4 => generated 1372 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:41:01.848410 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ee73e0c4-0e97-42da-8eec-44794a23693f tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:01.851031 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ee73e0c4-0e97-42da-8eec-44794a23693f tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: c343931b-bc96-4e9e-a5ce-f93454339a53] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:01.858334 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ee73e0c4-0e97-42da-8eec-44794a23693f tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:01.859221 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ee73e0c4-0e97-42da-8eec-44794a23693f tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:01.859886 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ee73e0c4-0e97-42da-8eec-44794a23693f tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:01.860885 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ee73e0c4-0e97-42da-8eec-44794a23693f tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:01.861635 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ee73e0c4-0e97-42da-8eec-44794a23693f tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:01.862302 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ee73e0c4-0e97-42da-8eec-44794a23693f tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:01.948865 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3f7abc24-4f52-49a5-a34e-e78126b2dd74 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:01.949840 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3f7abc24-4f52-49a5-a34e-e78126b2dd74 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] [instance: d016f22c-47ba-47c6-95bd-87ae9cb4816d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:01.962347 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f7abc24-4f52-49a5-a34e-e78126b2dd74 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:01.962915 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f7abc24-4f52-49a5-a34e-e78126b2dd74 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:01.963362 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f7abc24-4f52-49a5-a34e-e78126b2dd74 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:01.964191 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f7abc24-4f52-49a5-a34e-e78126b2dd74 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:01.964658 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f7abc24-4f52-49a5-a34e-e78126b2dd74 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:01.965413 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f7abc24-4f52-49a5-a34e-e78126b2dd74 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:02.208386 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3f7abc24-4f52-49a5-a34e-e78126b2dd74 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3499c88686046b8a80bc3a754f016e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08896629a67f488b87a845e57a9ca372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:02.226220 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3f7abc24-4f52-49a5-a34e-e78126b2dd74 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] 10.222.0.20 "GET /compute/v2.1/servers/d016f22c-47ba-47c6-95bd-87ae9cb4816d" status: 200 len: 1280 microversion: 2.1 time: 0.280018 Oct 04 18:41:02.243519 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1592/3204] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:01 2022] GET /compute/v2.1/servers/d016f22c-47ba-47c6-95bd-87ae9cb4816d => generated 1280 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:02.427064 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ee73e0c4-0e97-42da-8eec-44794a23693f tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8358c07e2684b749a62becb9f0b7869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b922a74c1c2448bb770d6b298b2d601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:02.454470 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ee73e0c4-0e97-42da-8eec-44794a23693f tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53" status: 200 len: 1472 microversion: 2.1 time: 0.610012 Oct 04 18:41:02.455380 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1613/3205] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:01 2022] GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53 => generated 1472 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:41:02.475846 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1bf7ab9c-0fbd-43c8-80b8-071f0d32d024 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:02.476618 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1bf7ab9c-0fbd-43c8-80b8-071f0d32d024 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] [instance: 0212406a-acc5-4631-90e8-03f4409c07f1] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:02.486489 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1bf7ab9c-0fbd-43c8-80b8-071f0d32d024 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:02.488668 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1bf7ab9c-0fbd-43c8-80b8-071f0d32d024 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:02.494476 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1bf7ab9c-0fbd-43c8-80b8-071f0d32d024 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:02.494476 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1bf7ab9c-0fbd-43c8-80b8-071f0d32d024 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:02.494476 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1bf7ab9c-0fbd-43c8-80b8-071f0d32d024 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:02.494476 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1bf7ab9c-0fbd-43c8-80b8-071f0d32d024 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:02.578880 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-fbf76149-d3cb-435f-8983-e2a05e4ea8a3 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:02.579700 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-fbf76149-d3cb-435f-8983-e2a05e4ea8a3 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] [instance: 1b0129be-f5f9-4735-a10a-008bddc30ab4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:02.598067 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fbf76149-d3cb-435f-8983-e2a05e4ea8a3 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:02.598678 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fbf76149-d3cb-435f-8983-e2a05e4ea8a3 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:02.599222 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fbf76149-d3cb-435f-8983-e2a05e4ea8a3 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:02.600721 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fbf76149-d3cb-435f-8983-e2a05e4ea8a3 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:02.601279 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fbf76149-d3cb-435f-8983-e2a05e4ea8a3 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:02.604628 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fbf76149-d3cb-435f-8983-e2a05e4ea8a3 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:02.652906 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-1bf7ab9c-0fbd-43c8-80b8-071f0d32d024 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lazy-loading 'services' on Instance uuid 0212406a-acc5-4631-90e8-03f4409c07f1 {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:41:02.674875 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1bf7ab9c-0fbd-43c8-80b8-071f0d32d024 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1" status: 200 len: 1929 microversion: 2.75 time: 0.203783 Oct 04 18:41:02.676140 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1593/3206] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:41:02 2022] GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1 => generated 1929 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:41:02.746314 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-fbf76149-d3cb-435f-8983-e2a05e4ea8a3 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:02.775043 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-fbf76149-d3cb-435f-8983-e2a05e4ea8a3 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:02.777118 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-fbf76149-d3cb-435f-8983-e2a05e4ea8a3 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:02.778979 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-fbf76149-d3cb-435f-8983-e2a05e4ea8a3 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] 10.222.0.20 "GET /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4" status: 200 len: 1372 microversion: 2.47 time: 0.203984 Oct 04 18:41:02.779753 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1614/3207] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:41:02 2022] GET /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4 => generated 1372 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:41:02.890934 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-6f520865-7391-49f4-bc5a-830ebe81b480 req-8ba16175-c87e-4c03-91eb-0c7ca089ffab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d3cabc2-fa23-4098-9197-9aaa19a0c663", "tag": "3aad2644-bc27-4d77-9ae6-dd56c1d45027"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:41:02.908530 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-6f520865-7391-49f4-bc5a-830ebe81b480 req-8ba16175-c87e-4c03-91eb-0c7ca089ffab service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:02.909352 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-6f520865-7391-49f4-bc5a-830ebe81b480 req-8ba16175-c87e-4c03-91eb-0c7ca089ffab service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:02.909982 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-6f520865-7391-49f4-bc5a-830ebe81b480 req-8ba16175-c87e-4c03-91eb-0c7ca089ffab service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:02.936120 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-6f520865-7391-49f4-bc5a-830ebe81b480 req-8ba16175-c87e-4c03-91eb-0c7ca089ffab service nova] Creating event network-changed:3aad2644-bc27-4d77-9ae6-dd56c1d45027 for instance 3d3cabc2-fa23-4098-9197-9aaa19a0c663 on n-h1-850501-14 Oct 04 18:41:02.953138 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-6f520865-7391-49f4-bc5a-830ebe81b480 req-8ba16175-c87e-4c03-91eb-0c7ca089ffab service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065657 Oct 04 18:41:02.954342 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1594/3208] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:41:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:41:03.257613 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-31006040-bfd8-4380-826c-eecb3934db42 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:03.259623 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-31006040-bfd8-4380-826c-eecb3934db42 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] [instance: d016f22c-47ba-47c6-95bd-87ae9cb4816d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:03.275288 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-31006040-bfd8-4380-826c-eecb3934db42 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:03.278067 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-31006040-bfd8-4380-826c-eecb3934db42 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:03.278067 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-31006040-bfd8-4380-826c-eecb3934db42 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:03.279743 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-31006040-bfd8-4380-826c-eecb3934db42 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:03.281028 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-31006040-bfd8-4380-826c-eecb3934db42 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:03.281708 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-31006040-bfd8-4380-826c-eecb3934db42 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:03.482197 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-09e326e1-2ab4-45b7-9cff-071b27e841a6 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:03.483054 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-09e326e1-2ab4-45b7-9cff-071b27e841a6 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: c343931b-bc96-4e9e-a5ce-f93454339a53] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:03.498956 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-09e326e1-2ab4-45b7-9cff-071b27e841a6 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:03.499854 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-09e326e1-2ab4-45b7-9cff-071b27e841a6 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:03.500660 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-09e326e1-2ab4-45b7-9cff-071b27e841a6 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:03.501746 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-09e326e1-2ab4-45b7-9cff-071b27e841a6 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:03.502535 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-09e326e1-2ab4-45b7-9cff-071b27e841a6 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:03.503242 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-09e326e1-2ab4-45b7-9cff-071b27e841a6 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:03.606886 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-31006040-bfd8-4380-826c-eecb3934db42 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3499c88686046b8a80bc3a754f016e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08896629a67f488b87a845e57a9ca372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:03.633119 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-31006040-bfd8-4380-826c-eecb3934db42 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] 10.222.0.20 "GET /compute/v2.1/servers/d016f22c-47ba-47c6-95bd-87ae9cb4816d" status: 200 len: 1322 microversion: 2.1 time: 0.386136 Oct 04 18:41:03.633738 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1615/3209] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:03 2022] GET /compute/v2.1/servers/d016f22c-47ba-47c6-95bd-87ae9cb4816d => generated 1322 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:03.709894 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-42e6f330-7e3b-4042-afc0-963cecba0df9 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:03.710931 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-42e6f330-7e3b-4042-afc0-963cecba0df9 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] [instance: 0212406a-acc5-4631-90e8-03f4409c07f1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:03.724003 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-42e6f330-7e3b-4042-afc0-963cecba0df9 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:03.724768 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-42e6f330-7e3b-4042-afc0-963cecba0df9 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:03.725224 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-42e6f330-7e3b-4042-afc0-963cecba0df9 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:03.727282 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-42e6f330-7e3b-4042-afc0-963cecba0df9 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:03.727838 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-42e6f330-7e3b-4042-afc0-963cecba0df9 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:03.728930 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-42e6f330-7e3b-4042-afc0-963cecba0df9 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:03.763966 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=100 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:41:03.916260 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-42e6f330-7e3b-4042-afc0-963cecba0df9 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lazy-loading 'services' on Instance uuid 0212406a-acc5-4631-90e8-03f4409c07f1 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:41:03.980821 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-42e6f330-7e3b-4042-afc0-963cecba0df9 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1" status: 200 len: 1929 microversion: 2.75 time: 0.275616 Oct 04 18:41:03.986296 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1616/3210] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:41:03 2022] GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1 => generated 1929 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:41:03.995738 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-01befbc3-fcc1-48cc-a298-d6c92295e700 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:04.000356 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-01befbc3-fcc1-48cc-a298-d6c92295e700 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] [instance: 1b0129be-f5f9-4735-a10a-008bddc30ab4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:04.008745 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-09e326e1-2ab4-45b7-9cff-071b27e841a6 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8358c07e2684b749a62becb9f0b7869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b922a74c1c2448bb770d6b298b2d601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:04.018131 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-01befbc3-fcc1-48cc-a298-d6c92295e700 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:04.020723 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-01befbc3-fcc1-48cc-a298-d6c92295e700 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:04.023606 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-09e326e1-2ab4-45b7-9cff-071b27e841a6 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53" status: 200 len: 1472 microversion: 2.1 time: 0.544920 Oct 04 18:41:04.024418 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-01befbc3-fcc1-48cc-a298-d6c92295e700 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:04.025257 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1595/3211] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:03 2022] GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53 => generated 1472 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:41:04.028985 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-01befbc3-fcc1-48cc-a298-d6c92295e700 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:04.028985 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-01befbc3-fcc1-48cc-a298-d6c92295e700 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:04.028985 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-01befbc3-fcc1-48cc-a298-d6c92295e700 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:04.234399 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-01befbc3-fcc1-48cc-a298-d6c92295e700 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:04.254738 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-01befbc3-fcc1-48cc-a298-d6c92295e700 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:04.256674 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-01befbc3-fcc1-48cc-a298-d6c92295e700 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:04.258146 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-01befbc3-fcc1-48cc-a298-d6c92295e700 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] 10.222.0.20 "GET /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4" status: 200 len: 1372 microversion: 2.47 time: 0.270526 Oct 04 18:41:04.259598 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1617/3212] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:41:03 2022] GET /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4 => generated 1372 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:41:04.680150 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-869f81b0-8002-4219-be64-6f1e5d868c9e tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:04.683235 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-869f81b0-8002-4219-be64-6f1e5d868c9e tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] [instance: d016f22c-47ba-47c6-95bd-87ae9cb4816d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:04.699408 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-869f81b0-8002-4219-be64-6f1e5d868c9e tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:04.704159 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-869f81b0-8002-4219-be64-6f1e5d868c9e tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:04.704159 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-869f81b0-8002-4219-be64-6f1e5d868c9e tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:04.704359 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-869f81b0-8002-4219-be64-6f1e5d868c9e tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:04.704812 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-869f81b0-8002-4219-be64-6f1e5d868c9e tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:04.705247 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-869f81b0-8002-4219-be64-6f1e5d868c9e tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:04.940520 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-869f81b0-8002-4219-be64-6f1e5d868c9e tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3499c88686046b8a80bc3a754f016e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08896629a67f488b87a845e57a9ca372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:04.949426 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-869f81b0-8002-4219-be64-6f1e5d868c9e tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] 10.222.0.20 "GET /compute/v2.1/servers/d016f22c-47ba-47c6-95bd-87ae9cb4816d" status: 200 len: 1322 microversion: 2.1 time: 0.284299 Oct 04 18:41:04.951040 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1596/3213] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:04 2022] GET /compute/v2.1/servers/d016f22c-47ba-47c6-95bd-87ae9cb4816d => generated 1322 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:05.015476 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-93e8a650-55bd-4ac0-901b-1fae51086d9d tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:05.016446 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-93e8a650-55bd-4ac0-901b-1fae51086d9d tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] [instance: 0212406a-acc5-4631-90e8-03f4409c07f1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:05.023140 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-93e8a650-55bd-4ac0-901b-1fae51086d9d tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:05.023665 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-93e8a650-55bd-4ac0-901b-1fae51086d9d tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:05.024435 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-93e8a650-55bd-4ac0-901b-1fae51086d9d tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:05.025154 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-93e8a650-55bd-4ac0-901b-1fae51086d9d tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:05.025643 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-93e8a650-55bd-4ac0-901b-1fae51086d9d tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:05.026075 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-93e8a650-55bd-4ac0-901b-1fae51086d9d tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:05.047956 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-415166d3-658f-46c1-b94f-e385c23f7370 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:05.048616 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-415166d3-658f-46c1-b94f-e385c23f7370 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: c343931b-bc96-4e9e-a5ce-f93454339a53] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:05.058533 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-415166d3-658f-46c1-b94f-e385c23f7370 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:05.059299 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-415166d3-658f-46c1-b94f-e385c23f7370 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:05.059910 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-415166d3-658f-46c1-b94f-e385c23f7370 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:05.060805 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-415166d3-658f-46c1-b94f-e385c23f7370 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:05.061429 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-415166d3-658f-46c1-b94f-e385c23f7370 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:05.062046 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-415166d3-658f-46c1-b94f-e385c23f7370 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:05.082499 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:41:05.230610 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-93e8a650-55bd-4ac0-901b-1fae51086d9d tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lazy-loading 'services' on Instance uuid 0212406a-acc5-4631-90e8-03f4409c07f1 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:41:05.258259 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-93e8a650-55bd-4ac0-901b-1fae51086d9d tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1" status: 200 len: 1929 microversion: 2.75 time: 0.247343 Oct 04 18:41:05.259698 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1618/3214] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:41:05 2022] GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1 => generated 1929 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:41:05.265734 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-7757211b-e866-48a3-bfb7-17c015971b64 req-143b72f9-a9a0-462d-9b21-c8fe1f2d0f3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d016f22c-47ba-47c6-95bd-87ae9cb4816d", "tag": "2a64b44b-ed16-469b-a145-c17db566df99"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:41:05.292848 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-7757211b-e866-48a3-bfb7-17c015971b64 req-143b72f9-a9a0-462d-9b21-c8fe1f2d0f3c service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:05.293356 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-7757211b-e866-48a3-bfb7-17c015971b64 req-143b72f9-a9a0-462d-9b21-c8fe1f2d0f3c service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:05.293795 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-7757211b-e866-48a3-bfb7-17c015971b64 req-143b72f9-a9a0-462d-9b21-c8fe1f2d0f3c service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:05.308595 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-7757211b-e866-48a3-bfb7-17c015971b64 req-143b72f9-a9a0-462d-9b21-c8fe1f2d0f3c service nova] Creating event network-changed:2a64b44b-ed16-469b-a145-c17db566df99 for instance d016f22c-47ba-47c6-95bd-87ae9cb4816d on n-h1-850501-14 Oct 04 18:41:05.317981 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-7757211b-e866-48a3-bfb7-17c015971b64 req-143b72f9-a9a0-462d-9b21-c8fe1f2d0f3c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056578 Oct 04 18:41:05.318670 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1619/3215] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:41:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:41:05.324821 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-97eb3ddc-df85-4252-a303-5fa34ad4c402 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:05.325824 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-97eb3ddc-df85-4252-a303-5fa34ad4c402 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] [instance: 1b0129be-f5f9-4735-a10a-008bddc30ab4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:05.334574 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-97eb3ddc-df85-4252-a303-5fa34ad4c402 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:05.335157 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-97eb3ddc-df85-4252-a303-5fa34ad4c402 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:05.335644 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-97eb3ddc-df85-4252-a303-5fa34ad4c402 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:05.336355 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-97eb3ddc-df85-4252-a303-5fa34ad4c402 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:05.336782 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-97eb3ddc-df85-4252-a303-5fa34ad4c402 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:05.337880 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-97eb3ddc-df85-4252-a303-5fa34ad4c402 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:05.456967 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-97eb3ddc-df85-4252-a303-5fa34ad4c402 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:05.467190 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-97eb3ddc-df85-4252-a303-5fa34ad4c402 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:05.468688 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-97eb3ddc-df85-4252-a303-5fa34ad4c402 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:05.470144 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-97eb3ddc-df85-4252-a303-5fa34ad4c402 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] 10.222.0.20 "GET /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4" status: 200 len: 1357 microversion: 2.47 time: 0.149458 Oct 04 18:41:05.489198 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1620/3216] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:41:05 2022] GET /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4 => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:41:05.498441 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b44cf3dd-c21a-435c-97ab-27d330cf1511 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:05.507769 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b44cf3dd-c21a-435c-97ab-27d330cf1511 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:05.514833 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b44cf3dd-c21a-435c-97ab-27d330cf1511 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Searching by: {'deleted': False, 'project_id': '4c247547676947a4814e8bd1a782045c'} {{(pid=123001) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:41:05.517185 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-415166d3-658f-46c1-b94f-e385c23f7370 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8358c07e2684b749a62becb9f0b7869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b922a74c1c2448bb770d6b298b2d601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:05.523489 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b44cf3dd-c21a-435c-97ab-27d330cf1511 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:05.524578 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b44cf3dd-c21a-435c-97ab-27d330cf1511 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:05.525030 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b44cf3dd-c21a-435c-97ab-27d330cf1511 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:05.525771 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b44cf3dd-c21a-435c-97ab-27d330cf1511 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:05.526231 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b44cf3dd-c21a-435c-97ab-27d330cf1511 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:05.526658 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b44cf3dd-c21a-435c-97ab-27d330cf1511 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:05.533098 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-415166d3-658f-46c1-b94f-e385c23f7370 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53" status: 200 len: 1472 microversion: 2.1 time: 0.488978 Oct 04 18:41:05.534126 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1597/3217] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:05 2022] GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53 => generated 1472 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:41:05.653048 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.multi_cell_list [None req-b44cf3dd-c21a-435c-97ab-27d330cf1511 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=123001) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:41:05.772268 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b44cf3dd-c21a-435c-97ab-27d330cf1511 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:05.784852 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b44cf3dd-c21a-435c-97ab-27d330cf1511 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:05.785307 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b44cf3dd-c21a-435c-97ab-27d330cf1511 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:05.785744 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b44cf3dd-c21a-435c-97ab-27d330cf1511 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:05.800322 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b44cf3dd-c21a-435c-97ab-27d330cf1511 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:05.801454 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b44cf3dd-c21a-435c-97ab-27d330cf1511 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:05.889380 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b44cf3dd-c21a-435c-97ab-27d330cf1511 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] 10.222.0.20 "GET /compute/v2.1/servers/detail" status: 200 len: 2707 microversion: 2.47 time: 0.395843 Oct 04 18:41:05.899571 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1621/3218] 10.222.0.20 () {60 vars in 1187 bytes} [Tue Oct 4 18:41:05 2022] GET /compute/v2.1/servers/detail => generated 2707 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:41:05.924208 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b234b234-2694-4527-b37d-2dc600fd8d23 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:05.924734 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b234b234-2694-4527-b37d-2dc600fd8d23 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] [instance: 1b0129be-f5f9-4735-a10a-008bddc30ab4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:05.933065 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b234b234-2694-4527-b37d-2dc600fd8d23 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:05.934183 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b234b234-2694-4527-b37d-2dc600fd8d23 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:05.934788 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b234b234-2694-4527-b37d-2dc600fd8d23 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:05.935539 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b234b234-2694-4527-b37d-2dc600fd8d23 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:05.936458 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b234b234-2694-4527-b37d-2dc600fd8d23 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:05.936893 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b234b234-2694-4527-b37d-2dc600fd8d23 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:05.968344 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b234b234-2694-4527-b37d-2dc600fd8d23 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] [instance: 1b0129be-f5f9-4735-a10a-008bddc30ab4] Going to try to terminate instance {{(pid=123002) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:41:05.973396 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-cc83c465-b4bd-4416-ba41-581369686ed1 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:05.979816 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-cc83c465-b4bd-4416-ba41-581369686ed1 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] [instance: d016f22c-47ba-47c6-95bd-87ae9cb4816d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:05.982928 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cc83c465-b4bd-4416-ba41-581369686ed1 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:05.983484 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cc83c465-b4bd-4416-ba41-581369686ed1 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:05.983951 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cc83c465-b4bd-4416-ba41-581369686ed1 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:05.984700 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cc83c465-b4bd-4416-ba41-581369686ed1 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:05.985159 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cc83c465-b4bd-4416-ba41-581369686ed1 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:05.985636 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cc83c465-b4bd-4416-ba41-581369686ed1 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:06.290644 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-cc83c465-b4bd-4416-ba41-581369686ed1 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3499c88686046b8a80bc3a754f016e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08896629a67f488b87a845e57a9ca372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:06.298416 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-cc83c465-b4bd-4416-ba41-581369686ed1 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] 10.222.0.20 "GET /compute/v2.1/servers/d016f22c-47ba-47c6-95bd-87ae9cb4816d" status: 200 len: 1322 microversion: 2.1 time: 0.330086 Oct 04 18:41:06.308441 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1622/3219] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:05 2022] GET /compute/v2.1/servers/d016f22c-47ba-47c6-95bd-87ae9cb4816d => generated 1322 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:41:06.320156 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-13a73991-a979-4518-b3f9-54230e09704b tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:06.320776 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-13a73991-a979-4518-b3f9-54230e09704b tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] [instance: 0212406a-acc5-4631-90e8-03f4409c07f1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:06.326767 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-13a73991-a979-4518-b3f9-54230e09704b tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:06.327537 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-13a73991-a979-4518-b3f9-54230e09704b tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:06.327664 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-13a73991-a979-4518-b3f9-54230e09704b tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:06.328420 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-13a73991-a979-4518-b3f9-54230e09704b tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:06.328880 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-13a73991-a979-4518-b3f9-54230e09704b tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:06.329306 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-13a73991-a979-4518-b3f9-54230e09704b tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:06.348330 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b234b234-2694-4527-b37d-2dc600fd8d23 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4" status: 204 len: 0 microversion: 2.47 time: 0.427321 Oct 04 18:41:06.348330 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1598/3220] 10.222.0.20 () {60 vars in 1280 bytes} [Tue Oct 4 18:41:05 2022] DELETE /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:41:06.358913 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4b77db2b-7ca8-42bd-ba80-4d1be0ade939 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:06.360331 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4b77db2b-7ca8-42bd-ba80-4d1be0ade939 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] [instance: 1b0129be-f5f9-4735-a10a-008bddc30ab4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:06.367113 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4b77db2b-7ca8-42bd-ba80-4d1be0ade939 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:06.367608 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4b77db2b-7ca8-42bd-ba80-4d1be0ade939 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:06.368347 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4b77db2b-7ca8-42bd-ba80-4d1be0ade939 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:06.369063 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4b77db2b-7ca8-42bd-ba80-4d1be0ade939 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:06.369553 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4b77db2b-7ca8-42bd-ba80-4d1be0ade939 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:06.369979 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4b77db2b-7ca8-42bd-ba80-4d1be0ade939 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:06.449568 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-13a73991-a979-4518-b3f9-54230e09704b tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lazy-loading 'services' on Instance uuid 0212406a-acc5-4631-90e8-03f4409c07f1 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:41:06.470371 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-13a73991-a979-4518-b3f9-54230e09704b tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1" status: 200 len: 1929 microversion: 2.75 time: 0.160527 Oct 04 18:41:06.485736 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1623/3221] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:41:06 2022] GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1 => generated 1929 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:41:06.557875 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d75c4b00-01d0-4305-ada1-8d6bc3b7f41d tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:06.558779 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d75c4b00-01d0-4305-ada1-8d6bc3b7f41d tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: c343931b-bc96-4e9e-a5ce-f93454339a53] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:06.569184 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d75c4b00-01d0-4305-ada1-8d6bc3b7f41d tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:06.569944 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d75c4b00-01d0-4305-ada1-8d6bc3b7f41d tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:06.570571 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d75c4b00-01d0-4305-ada1-8d6bc3b7f41d tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:06.571468 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d75c4b00-01d0-4305-ada1-8d6bc3b7f41d tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:06.572136 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d75c4b00-01d0-4305-ada1-8d6bc3b7f41d tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:06.572731 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d75c4b00-01d0-4305-ada1-8d6bc3b7f41d tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:06.816881 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4b77db2b-7ca8-42bd-ba80-4d1be0ade939 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:06.828690 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4b77db2b-7ca8-42bd-ba80-4d1be0ade939 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:06.830193 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4b77db2b-7ca8-42bd-ba80-4d1be0ade939 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:06.831641 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4b77db2b-7ca8-42bd-ba80-4d1be0ade939 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] 10.222.0.20 "GET /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4" status: 200 len: 1363 microversion: 2.47 time: 0.478140 Oct 04 18:41:06.850852 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1599/3222] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:41:06 2022] GET /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4 => generated 1363 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:41:07.135867 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d75c4b00-01d0-4305-ada1-8d6bc3b7f41d tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8358c07e2684b749a62becb9f0b7869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b922a74c1c2448bb770d6b298b2d601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:07.153406 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d75c4b00-01d0-4305-ada1-8d6bc3b7f41d tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53" status: 200 len: 1472 microversion: 2.1 time: 0.594546 Oct 04 18:41:07.156505 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1624/3223] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:06 2022] GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53 => generated 1472 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:41:07.328069 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-36caad33-cffc-466f-98bb-cf9ecb830a21 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:07.328974 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-36caad33-cffc-466f-98bb-cf9ecb830a21 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] [instance: d016f22c-47ba-47c6-95bd-87ae9cb4816d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:07.342633 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-36caad33-cffc-466f-98bb-cf9ecb830a21 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:07.343759 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-36caad33-cffc-466f-98bb-cf9ecb830a21 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:07.344901 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-36caad33-cffc-466f-98bb-cf9ecb830a21 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:07.346275 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-36caad33-cffc-466f-98bb-cf9ecb830a21 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:07.347986 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-36caad33-cffc-466f-98bb-cf9ecb830a21 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:07.349978 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-36caad33-cffc-466f-98bb-cf9ecb830a21 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:07.501759 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-eaf729d3-abf1-4b42-b861-29377c79bc4d tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:07.502451 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-eaf729d3-abf1-4b42-b861-29377c79bc4d tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] [instance: 0212406a-acc5-4631-90e8-03f4409c07f1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:07.514031 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eaf729d3-abf1-4b42-b861-29377c79bc4d tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:07.516393 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eaf729d3-abf1-4b42-b861-29377c79bc4d tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:07.518841 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eaf729d3-abf1-4b42-b861-29377c79bc4d tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:07.526665 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eaf729d3-abf1-4b42-b861-29377c79bc4d tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:07.526665 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eaf729d3-abf1-4b42-b861-29377c79bc4d tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:07.527839 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eaf729d3-abf1-4b42-b861-29377c79bc4d tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:07.697165 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-eaf729d3-abf1-4b42-b861-29377c79bc4d tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lazy-loading 'services' on Instance uuid 0212406a-acc5-4631-90e8-03f4409c07f1 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:41:07.741391 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-36caad33-cffc-466f-98bb-cf9ecb830a21 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3499c88686046b8a80bc3a754f016e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08896629a67f488b87a845e57a9ca372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:07.751865 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-36caad33-cffc-466f-98bb-cf9ecb830a21 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] 10.222.0.20 "GET /compute/v2.1/servers/d016f22c-47ba-47c6-95bd-87ae9cb4816d" status: 200 len: 1322 microversion: 2.1 time: 0.429146 Oct 04 18:41:07.774881 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1600/3224] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:07 2022] GET /compute/v2.1/servers/d016f22c-47ba-47c6-95bd-87ae9cb4816d => generated 1322 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:07.785785 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-eaf729d3-abf1-4b42-b861-29377c79bc4d tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1" status: 200 len: 1929 microversion: 2.75 time: 0.279671 Oct 04 18:41:07.790625 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1625/3225] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:41:07 2022] GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1 => generated 1929 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:41:07.858758 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-28dcd6fd-7106-4bdd-8b12-e319ea94dcc1 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:07.859563 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-28dcd6fd-7106-4bdd-8b12-e319ea94dcc1 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] [instance: 1b0129be-f5f9-4735-a10a-008bddc30ab4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:07.867153 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-28dcd6fd-7106-4bdd-8b12-e319ea94dcc1 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:07.867970 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-28dcd6fd-7106-4bdd-8b12-e319ea94dcc1 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:07.868634 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-28dcd6fd-7106-4bdd-8b12-e319ea94dcc1 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:07.869526 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-28dcd6fd-7106-4bdd-8b12-e319ea94dcc1 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:07.870167 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-28dcd6fd-7106-4bdd-8b12-e319ea94dcc1 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:07.870997 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-28dcd6fd-7106-4bdd-8b12-e319ea94dcc1 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:07.976415 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-28dcd6fd-7106-4bdd-8b12-e319ea94dcc1 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:07.991967 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-28dcd6fd-7106-4bdd-8b12-e319ea94dcc1 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:07.994634 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-28dcd6fd-7106-4bdd-8b12-e319ea94dcc1 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:07.995984 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-28dcd6fd-7106-4bdd-8b12-e319ea94dcc1 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] 10.222.0.20 "GET /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4" status: 200 len: 1363 microversion: 2.47 time: 0.141384 Oct 04 18:41:07.996608 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1601/3226] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:41:07 2022] GET /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4 => generated 1363 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:41:08.187180 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3baa07a5-6389-4c70-af49-38c4cd14c4d7 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:08.187895 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3baa07a5-6389-4c70-af49-38c4cd14c4d7 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: c343931b-bc96-4e9e-a5ce-f93454339a53] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:08.199638 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3baa07a5-6389-4c70-af49-38c4cd14c4d7 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:08.200303 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3baa07a5-6389-4c70-af49-38c4cd14c4d7 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:08.203244 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3baa07a5-6389-4c70-af49-38c4cd14c4d7 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:08.204073 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3baa07a5-6389-4c70-af49-38c4cd14c4d7 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:08.204756 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3baa07a5-6389-4c70-af49-38c4cd14c4d7 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:08.207208 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3baa07a5-6389-4c70-af49-38c4cd14c4d7 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:08.492896 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3baa07a5-6389-4c70-af49-38c4cd14c4d7 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8358c07e2684b749a62becb9f0b7869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b922a74c1c2448bb770d6b298b2d601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:08.501044 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3baa07a5-6389-4c70-af49-38c4cd14c4d7 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53" status: 200 len: 1472 microversion: 2.1 time: 0.318073 Oct 04 18:41:08.501621 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1626/3227] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:08 2022] GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53 => generated 1472 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:08.779047 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f989ba35-f479-4b9c-b8cc-94def1b834fc tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:08.780369 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f989ba35-f479-4b9c-b8cc-94def1b834fc tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] [instance: d016f22c-47ba-47c6-95bd-87ae9cb4816d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:08.794053 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f989ba35-f479-4b9c-b8cc-94def1b834fc tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:08.794560 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f989ba35-f479-4b9c-b8cc-94def1b834fc tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:08.795553 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f989ba35-f479-4b9c-b8cc-94def1b834fc tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:08.796470 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f989ba35-f479-4b9c-b8cc-94def1b834fc tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:08.797385 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f989ba35-f479-4b9c-b8cc-94def1b834fc tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:08.798153 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f989ba35-f479-4b9c-b8cc-94def1b834fc tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:08.821040 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e93b4e5f-8bce-440a-a415-8f5b4cd9b51e tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:08.825299 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e93b4e5f-8bce-440a-a415-8f5b4cd9b51e tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] [instance: 0212406a-acc5-4631-90e8-03f4409c07f1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:08.827511 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e93b4e5f-8bce-440a-a415-8f5b4cd9b51e tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:08.828003 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e93b4e5f-8bce-440a-a415-8f5b4cd9b51e tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:08.828458 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e93b4e5f-8bce-440a-a415-8f5b4cd9b51e tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:08.829158 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e93b4e5f-8bce-440a-a415-8f5b4cd9b51e tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:08.829611 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e93b4e5f-8bce-440a-a415-8f5b4cd9b51e tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:08.830033 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e93b4e5f-8bce-440a-a415-8f5b4cd9b51e tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:09.007915 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-e93b4e5f-8bce-440a-a415-8f5b4cd9b51e tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lazy-loading 'services' on Instance uuid 0212406a-acc5-4631-90e8-03f4409c07f1 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:41:09.043198 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e93b4e5f-8bce-440a-a415-8f5b4cd9b51e tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1" status: 200 len: 1929 microversion: 2.75 time: 0.225621 Oct 04 18:41:09.043889 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1627/3228] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:41:08 2022] GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1 => generated 1929 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:41:09.050925 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6770d422-1481-48b9-8562-bbb78c8355e7 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:09.052893 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6770d422-1481-48b9-8562-bbb78c8355e7 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] [instance: 1b0129be-f5f9-4735-a10a-008bddc30ab4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:09.063152 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6770d422-1481-48b9-8562-bbb78c8355e7 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:09.066158 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6770d422-1481-48b9-8562-bbb78c8355e7 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:09.066158 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6770d422-1481-48b9-8562-bbb78c8355e7 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:09.066158 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6770d422-1481-48b9-8562-bbb78c8355e7 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:09.075171 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6770d422-1481-48b9-8562-bbb78c8355e7 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:09.076494 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6770d422-1481-48b9-8562-bbb78c8355e7 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:09.220066 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6770d422-1481-48b9-8562-bbb78c8355e7 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:09.252121 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6770d422-1481-48b9-8562-bbb78c8355e7 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:09.254096 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6770d422-1481-48b9-8562-bbb78c8355e7 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:09.257969 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6770d422-1481-48b9-8562-bbb78c8355e7 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] 10.222.0.20 "GET /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4" status: 200 len: 1363 microversion: 2.47 time: 0.212732 Oct 04 18:41:09.269097 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1628/3229] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:41:09 2022] GET /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4 => generated 1363 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:41:09.283296 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f989ba35-f479-4b9c-b8cc-94def1b834fc tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3499c88686046b8a80bc3a754f016e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08896629a67f488b87a845e57a9ca372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:09.298887 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f989ba35-f479-4b9c-b8cc-94def1b834fc tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] 10.222.0.20 "GET /compute/v2.1/servers/d016f22c-47ba-47c6-95bd-87ae9cb4816d" status: 200 len: 1322 microversion: 2.1 time: 0.523821 Oct 04 18:41:09.311578 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1602/3230] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:08 2022] GET /compute/v2.1/servers/d016f22c-47ba-47c6-95bd-87ae9cb4816d => generated 1322 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:09.530250 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e3612eb1-af16-42d7-b56f-2c87ee36f5b8 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:09.535561 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e3612eb1-af16-42d7-b56f-2c87ee36f5b8 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: c343931b-bc96-4e9e-a5ce-f93454339a53] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:09.543800 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e3612eb1-af16-42d7-b56f-2c87ee36f5b8 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:09.547172 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e3612eb1-af16-42d7-b56f-2c87ee36f5b8 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:09.547859 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e3612eb1-af16-42d7-b56f-2c87ee36f5b8 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:09.549122 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e3612eb1-af16-42d7-b56f-2c87ee36f5b8 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:09.549806 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e3612eb1-af16-42d7-b56f-2c87ee36f5b8 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:09.550614 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e3612eb1-af16-42d7-b56f-2c87ee36f5b8 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:09.844936 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e3612eb1-af16-42d7-b56f-2c87ee36f5b8 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8358c07e2684b749a62becb9f0b7869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b922a74c1c2448bb770d6b298b2d601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:09.858551 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e3612eb1-af16-42d7-b56f-2c87ee36f5b8 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53" status: 200 len: 1472 microversion: 2.1 time: 0.336663 Oct 04 18:41:09.860130 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1629/3231] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:09 2022] GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53 => generated 1472 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:10.079588 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-468bb5c6-5b0e-48a7-a3e4-446c0f8aad00 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:10.080833 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-468bb5c6-5b0e-48a7-a3e4-446c0f8aad00 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] [instance: 0212406a-acc5-4631-90e8-03f4409c07f1] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:10.090814 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-468bb5c6-5b0e-48a7-a3e4-446c0f8aad00 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:10.091805 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-468bb5c6-5b0e-48a7-a3e4-446c0f8aad00 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:10.092515 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-468bb5c6-5b0e-48a7-a3e4-446c0f8aad00 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:10.093570 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-468bb5c6-5b0e-48a7-a3e4-446c0f8aad00 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:10.094314 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-468bb5c6-5b0e-48a7-a3e4-446c0f8aad00 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:10.094935 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-468bb5c6-5b0e-48a7-a3e4-446c0f8aad00 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:10.262939 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-468bb5c6-5b0e-48a7-a3e4-446c0f8aad00 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lazy-loading 'services' on Instance uuid 0212406a-acc5-4631-90e8-03f4409c07f1 {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:41:10.287849 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ae29d820-19cb-4f91-9050-bf1b5c76a5fc tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:10.288477 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ae29d820-19cb-4f91-9050-bf1b5c76a5fc tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] [instance: 1b0129be-f5f9-4735-a10a-008bddc30ab4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:10.304529 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ae29d820-19cb-4f91-9050-bf1b5c76a5fc tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:10.305384 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ae29d820-19cb-4f91-9050-bf1b5c76a5fc tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:10.305990 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ae29d820-19cb-4f91-9050-bf1b5c76a5fc tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:10.308960 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ae29d820-19cb-4f91-9050-bf1b5c76a5fc tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:10.310145 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ae29d820-19cb-4f91-9050-bf1b5c76a5fc tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:10.315447 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ae29d820-19cb-4f91-9050-bf1b5c76a5fc tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:10.330934 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-468bb5c6-5b0e-48a7-a3e4-446c0f8aad00 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1" status: 200 len: 1929 microversion: 2.75 time: 0.256646 Oct 04 18:41:10.338491 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1603/3232] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:41:10 2022] GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1 => generated 1929 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:41:10.345324 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9de2b99e-5922-4676-bbbe-e94d1ab9e096 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:10.347273 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9de2b99e-5922-4676-bbbe-e94d1ab9e096 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] [instance: d016f22c-47ba-47c6-95bd-87ae9cb4816d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:10.357695 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9de2b99e-5922-4676-bbbe-e94d1ab9e096 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:10.358519 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9de2b99e-5922-4676-bbbe-e94d1ab9e096 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:10.359273 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9de2b99e-5922-4676-bbbe-e94d1ab9e096 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:10.360411 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9de2b99e-5922-4676-bbbe-e94d1ab9e096 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:10.361176 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9de2b99e-5922-4676-bbbe-e94d1ab9e096 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:10.362466 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9de2b99e-5922-4676-bbbe-e94d1ab9e096 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:10.402625 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ae29d820-19cb-4f91-9050-bf1b5c76a5fc tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:10.403127 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ae29d820-19cb-4f91-9050-bf1b5c76a5fc tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:10.403563 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ae29d820-19cb-4f91-9050-bf1b5c76a5fc tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:10.404008 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-ae29d820-19cb-4f91-9050-bf1b5c76a5fc tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lazy-loading 'fault' on Instance uuid 1b0129be-f5f9-4735-a10a-008bddc30ab4 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:41:10.517335 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ae29d820-19cb-4f91-9050-bf1b5c76a5fc tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:10.528333 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ae29d820-19cb-4f91-9050-bf1b5c76a5fc tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:10.529783 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ae29d820-19cb-4f91-9050-bf1b5c76a5fc tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:10.531260 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ae29d820-19cb-4f91-9050-bf1b5c76a5fc tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] 10.222.0.20 "GET /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4" status: 200 len: 1368 microversion: 2.47 time: 0.247857 Oct 04 18:41:10.532487 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1630/3233] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:41:10 2022] GET /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4 => generated 1368 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:41:10.650881 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:41:10.665702 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=16 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:41:10.886141 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1a2b988c-e343-4fbe-a706-d182cece44d9 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:10.887969 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1a2b988c-e343-4fbe-a706-d182cece44d9 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: c343931b-bc96-4e9e-a5ce-f93454339a53] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:10.897668 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1a2b988c-e343-4fbe-a706-d182cece44d9 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:10.898639 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1a2b988c-e343-4fbe-a706-d182cece44d9 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:10.899681 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1a2b988c-e343-4fbe-a706-d182cece44d9 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:10.900766 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1a2b988c-e343-4fbe-a706-d182cece44d9 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:10.901460 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1a2b988c-e343-4fbe-a706-d182cece44d9 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:10.901894 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1a2b988c-e343-4fbe-a706-d182cece44d9 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:10.907514 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=100 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:41:11.026502 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9de2b99e-5922-4676-bbbe-e94d1ab9e096 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3499c88686046b8a80bc3a754f016e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08896629a67f488b87a845e57a9ca372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:11.055303 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9de2b99e-5922-4676-bbbe-e94d1ab9e096 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] 10.222.0.20 "GET /compute/v2.1/servers/d016f22c-47ba-47c6-95bd-87ae9cb4816d" status: 200 len: 1322 microversion: 2.1 time: 0.715084 Oct 04 18:41:11.056102 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1604/3234] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:10 2022] GET /compute/v2.1/servers/d016f22c-47ba-47c6-95bd-87ae9cb4816d => generated 1322 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:11.164201 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1a2b988c-e343-4fbe-a706-d182cece44d9 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8358c07e2684b749a62becb9f0b7869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b922a74c1c2448bb770d6b298b2d601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:11.175445 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1a2b988c-e343-4fbe-a706-d182cece44d9 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53" status: 200 len: 1478 microversion: 2.1 time: 0.293954 Oct 04 18:41:11.176390 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1631/3235] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:10 2022] GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53 => generated 1478 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:11.373327 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-086b878f-47e9-4fbc-a54b-1a0ba8418636 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:11.375070 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-086b878f-47e9-4fbc-a54b-1a0ba8418636 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] [instance: 0212406a-acc5-4631-90e8-03f4409c07f1] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:11.391183 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-086b878f-47e9-4fbc-a54b-1a0ba8418636 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:11.391700 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-086b878f-47e9-4fbc-a54b-1a0ba8418636 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:11.392193 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-086b878f-47e9-4fbc-a54b-1a0ba8418636 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:11.392959 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-086b878f-47e9-4fbc-a54b-1a0ba8418636 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:11.393430 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-086b878f-47e9-4fbc-a54b-1a0ba8418636 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:11.393853 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-086b878f-47e9-4fbc-a54b-1a0ba8418636 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:11.563052 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-cd0155ff-73c3-4f1d-b286-ddc12696d9f2 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:11.563953 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-cd0155ff-73c3-4f1d-b286-ddc12696d9f2 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] [instance: 1b0129be-f5f9-4735-a10a-008bddc30ab4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:11.576537 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cd0155ff-73c3-4f1d-b286-ddc12696d9f2 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:11.581184 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cd0155ff-73c3-4f1d-b286-ddc12696d9f2 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:11.583384 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cd0155ff-73c3-4f1d-b286-ddc12696d9f2 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:11.585803 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cd0155ff-73c3-4f1d-b286-ddc12696d9f2 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:11.586252 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cd0155ff-73c3-4f1d-b286-ddc12696d9f2 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:11.587710 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cd0155ff-73c3-4f1d-b286-ddc12696d9f2 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:11.656564 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-086b878f-47e9-4fbc-a54b-1a0ba8418636 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lazy-loading 'services' on Instance uuid 0212406a-acc5-4631-90e8-03f4409c07f1 {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:41:11.656819 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cd0155ff-73c3-4f1d-b286-ddc12696d9f2 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:11.657048 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cd0155ff-73c3-4f1d-b286-ddc12696d9f2 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:11.657787 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cd0155ff-73c3-4f1d-b286-ddc12696d9f2 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:11.659300 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-cd0155ff-73c3-4f1d-b286-ddc12696d9f2 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lazy-loading 'fault' on Instance uuid 1b0129be-f5f9-4735-a10a-008bddc30ab4 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:41:11.704230 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-086b878f-47e9-4fbc-a54b-1a0ba8418636 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1" status: 200 len: 1929 microversion: 2.75 time: 0.337613 Oct 04 18:41:11.735131 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1605/3236] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:41:11 2022] GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1 => generated 1929 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:41:11.832811 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-cd0155ff-73c3-4f1d-b286-ddc12696d9f2 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:11.846061 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-cd0155ff-73c3-4f1d-b286-ddc12696d9f2 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:11.848178 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-cd0155ff-73c3-4f1d-b286-ddc12696d9f2 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:11.852123 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-cd0155ff-73c3-4f1d-b286-ddc12696d9f2 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] 10.222.0.20 "GET /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4" status: 200 len: 1368 microversion: 2.47 time: 0.296550 Oct 04 18:41:11.855326 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1632/3237] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:41:11 2022] GET /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4 => generated 1368 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:41:12.083075 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-74ed8b2f-c1d7-4ff4-9c9c-291d7ccb186c tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:12.084275 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-74ed8b2f-c1d7-4ff4-9c9c-291d7ccb186c tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] [instance: d016f22c-47ba-47c6-95bd-87ae9cb4816d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:12.097366 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-74ed8b2f-c1d7-4ff4-9c9c-291d7ccb186c tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:12.097850 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-74ed8b2f-c1d7-4ff4-9c9c-291d7ccb186c tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:12.098730 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-74ed8b2f-c1d7-4ff4-9c9c-291d7ccb186c tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:12.101116 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-74ed8b2f-c1d7-4ff4-9c9c-291d7ccb186c tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:12.101583 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-74ed8b2f-c1d7-4ff4-9c9c-291d7ccb186c tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:12.102012 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-74ed8b2f-c1d7-4ff4-9c9c-291d7ccb186c tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:12.202028 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c2e08f99-c1fe-4b18-a9a5-347b087f8fd1 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:12.203247 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c2e08f99-c1fe-4b18-a9a5-347b087f8fd1 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: c343931b-bc96-4e9e-a5ce-f93454339a53] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:12.210607 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c2e08f99-c1fe-4b18-a9a5-347b087f8fd1 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:12.211352 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c2e08f99-c1fe-4b18-a9a5-347b087f8fd1 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:12.211989 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c2e08f99-c1fe-4b18-a9a5-347b087f8fd1 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:12.212881 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c2e08f99-c1fe-4b18-a9a5-347b087f8fd1 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:12.213505 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c2e08f99-c1fe-4b18-a9a5-347b087f8fd1 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:12.214128 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c2e08f99-c1fe-4b18-a9a5-347b087f8fd1 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:12.592746 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-74ed8b2f-c1d7-4ff4-9c9c-291d7ccb186c tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3499c88686046b8a80bc3a754f016e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08896629a67f488b87a845e57a9ca372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:12.603575 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-74ed8b2f-c1d7-4ff4-9c9c-291d7ccb186c tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] 10.222.0.20 "GET /compute/v2.1/servers/d016f22c-47ba-47c6-95bd-87ae9cb4816d" status: 200 len: 1322 microversion: 2.1 time: 0.524564 Oct 04 18:41:12.607993 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1606/3238] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:12 2022] GET /compute/v2.1/servers/d016f22c-47ba-47c6-95bd-87ae9cb4816d => generated 1322 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:12.622036 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-1cd5f24e-fb55-44eb-8f8b-e9334f29f4e1 req-9db367b7-a66c-4825-ad6a-876743810246 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d016f22c-47ba-47c6-95bd-87ae9cb4816d", "name": "network-vif-plugged", "status": "completed", "tag": "2a64b44b-ed16-469b-a145-c17db566df99"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:41:12.649934 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c2e08f99-c1fe-4b18-a9a5-347b087f8fd1 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8358c07e2684b749a62becb9f0b7869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b922a74c1c2448bb770d6b298b2d601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:12.663067 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c2e08f99-c1fe-4b18-a9a5-347b087f8fd1 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53" status: 200 len: 1478 microversion: 2.1 time: 0.460516 Oct 04 18:41:12.664018 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1633/3239] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:12 2022] GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53 => generated 1478 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:12.683691 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-1cd5f24e-fb55-44eb-8f8b-e9334f29f4e1 req-9db367b7-a66c-4825-ad6a-876743810246 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:12.684326 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-1cd5f24e-fb55-44eb-8f8b-e9334f29f4e1 req-9db367b7-a66c-4825-ad6a-876743810246 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:12.685778 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-1cd5f24e-fb55-44eb-8f8b-e9334f29f4e1 req-9db367b7-a66c-4825-ad6a-876743810246 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:12.699501 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-1cd5f24e-fb55-44eb-8f8b-e9334f29f4e1 req-9db367b7-a66c-4825-ad6a-876743810246 service nova] Creating event network-vif-plugged:2a64b44b-ed16-469b-a145-c17db566df99 for instance d016f22c-47ba-47c6-95bd-87ae9cb4816d on n-h1-850501-14 Oct 04 18:41:12.706311 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-1cd5f24e-fb55-44eb-8f8b-e9334f29f4e1 req-9db367b7-a66c-4825-ad6a-876743810246 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095608 Oct 04 18:41:12.706991 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1607/3240] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:41:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:41:12.737946 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-08bb467b-a333-46d1-95e1-cc785320f20c tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:12.738565 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-08bb467b-a333-46d1-95e1-cc785320f20c tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] [instance: 0212406a-acc5-4631-90e8-03f4409c07f1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:12.752571 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-08bb467b-a333-46d1-95e1-cc785320f20c tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:12.752571 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-08bb467b-a333-46d1-95e1-cc785320f20c tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:12.752571 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-08bb467b-a333-46d1-95e1-cc785320f20c tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:12.752571 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-08bb467b-a333-46d1-95e1-cc785320f20c tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:12.753439 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-08bb467b-a333-46d1-95e1-cc785320f20c tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:12.754060 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-08bb467b-a333-46d1-95e1-cc785320f20c tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:12.882072 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c009973c-ce59-4414-9d7c-e241e7f400f0 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:12.884155 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c009973c-ce59-4414-9d7c-e241e7f400f0 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] [instance: 1b0129be-f5f9-4735-a10a-008bddc30ab4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:12.894577 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c009973c-ce59-4414-9d7c-e241e7f400f0 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:12.897787 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c009973c-ce59-4414-9d7c-e241e7f400f0 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:12.898398 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c009973c-ce59-4414-9d7c-e241e7f400f0 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:12.899994 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c009973c-ce59-4414-9d7c-e241e7f400f0 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:12.903428 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c009973c-ce59-4414-9d7c-e241e7f400f0 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:12.904341 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c009973c-ce59-4414-9d7c-e241e7f400f0 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:12.930798 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-08bb467b-a333-46d1-95e1-cc785320f20c tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lazy-loading 'services' on Instance uuid 0212406a-acc5-4631-90e8-03f4409c07f1 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:41:12.976067 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-08bb467b-a333-46d1-95e1-cc785320f20c tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1" status: 200 len: 1929 microversion: 2.75 time: 0.242499 Oct 04 18:41:12.976700 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1634/3241] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:41:12 2022] GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1 => generated 1929 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:41:12.995189 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c009973c-ce59-4414-9d7c-e241e7f400f0 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:12.995577 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c009973c-ce59-4414-9d7c-e241e7f400f0 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:12.996013 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c009973c-ce59-4414-9d7c-e241e7f400f0 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:12.996640 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-c009973c-ce59-4414-9d7c-e241e7f400f0 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lazy-loading 'fault' on Instance uuid 1b0129be-f5f9-4735-a10a-008bddc30ab4 {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:41:13.156785 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c009973c-ce59-4414-9d7c-e241e7f400f0 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:13.169178 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c009973c-ce59-4414-9d7c-e241e7f400f0 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:13.170624 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c009973c-ce59-4414-9d7c-e241e7f400f0 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:13.201452 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c009973c-ce59-4414-9d7c-e241e7f400f0 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] 10.222.0.20 "GET /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4" status: 200 len: 1368 microversion: 2.47 time: 0.325765 Oct 04 18:41:13.220967 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1608/3242] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:41:12 2022] GET /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4 => generated 1368 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:41:13.230379 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2005ce2c-1ae0-486c-9e2e-9057f72aa3d0 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Action: 'create', calling method: .version_select at 0x7fe2581ea8b0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-207955938", "description": "tempest-description-1267680587"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:41:13.639411 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ad3bd692-576d-4f65-9c5d-083f392e9184 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:13.646107 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ad3bd692-576d-4f65-9c5d-083f392e9184 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] [instance: d016f22c-47ba-47c6-95bd-87ae9cb4816d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:13.663575 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ad3bd692-576d-4f65-9c5d-083f392e9184 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:13.664518 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ad3bd692-576d-4f65-9c5d-083f392e9184 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:13.667017 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ad3bd692-576d-4f65-9c5d-083f392e9184 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:13.667847 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ad3bd692-576d-4f65-9c5d-083f392e9184 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:13.668410 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ad3bd692-576d-4f65-9c5d-083f392e9184 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:13.672944 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ad3bd692-576d-4f65-9c5d-083f392e9184 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:14.010996 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2005ce2c-1ae0-486c-9e2e-9057f72aa3d0 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.959342 Oct 04 18:41:14.010996 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1635/3243] 10.222.0.20 () {60 vars in 1180 bytes} [Tue Oct 4 18:41:13 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:41:14.010996 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3930e6b6-d44f-4779-9de0-ae3727373fe9 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:14.010996 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3930e6b6-d44f-4779-9de0-ae3727373fe9 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: c343931b-bc96-4e9e-a5ce-f93454339a53] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:14.020077 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3930e6b6-d44f-4779-9de0-ae3727373fe9 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:14.022166 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3930e6b6-d44f-4779-9de0-ae3727373fe9 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:14.022166 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3930e6b6-d44f-4779-9de0-ae3727373fe9 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:14.022634 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3930e6b6-d44f-4779-9de0-ae3727373fe9 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:14.023265 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3930e6b6-d44f-4779-9de0-ae3727373fe9 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:14.023690 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3930e6b6-d44f-4779-9de0-ae3727373fe9 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:14.447009 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ad3bd692-576d-4f65-9c5d-083f392e9184 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3499c88686046b8a80bc3a754f016e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08896629a67f488b87a845e57a9ca372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:14.457193 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ad3bd692-576d-4f65-9c5d-083f392e9184 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] 10.222.0.20 "GET /compute/v2.1/servers/d016f22c-47ba-47c6-95bd-87ae9cb4816d" status: 200 len: 1322 microversion: 2.1 time: 0.824450 Oct 04 18:41:14.476339 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1609/3244] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:13 2022] GET /compute/v2.1/servers/d016f22c-47ba-47c6-95bd-87ae9cb4816d => generated 1322 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:14.484433 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-50c8debe-6a16-4823-a081-f4cbd8d197c1 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:14.485294 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-50c8debe-6a16-4823-a081-f4cbd8d197c1 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] [instance: 0212406a-acc5-4631-90e8-03f4409c07f1] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:14.492338 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-50c8debe-6a16-4823-a081-f4cbd8d197c1 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:14.494896 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-50c8debe-6a16-4823-a081-f4cbd8d197c1 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:14.494896 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-50c8debe-6a16-4823-a081-f4cbd8d197c1 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:14.494896 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-50c8debe-6a16-4823-a081-f4cbd8d197c1 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:14.494896 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-50c8debe-6a16-4823-a081-f4cbd8d197c1 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:14.495447 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-50c8debe-6a16-4823-a081-f4cbd8d197c1 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:14.514699 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3930e6b6-d44f-4779-9de0-ae3727373fe9 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8358c07e2684b749a62becb9f0b7869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b922a74c1c2448bb770d6b298b2d601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:14.527143 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3930e6b6-d44f-4779-9de0-ae3727373fe9 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53" status: 200 len: 1478 microversion: 2.1 time: 0.524587 Oct 04 18:41:14.527817 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1636/3245] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:14 2022] GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53 => generated 1478 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:14.540722 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-78aa8ded-a55a-4bbe-9062-00ab8a76d9e8 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Action: 'create', calling method: .version_select at 0x7fe2581ca550>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1384012904", "description": "tempest-description-500467549"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:41:14.608313 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-50c8debe-6a16-4823-a081-f4cbd8d197c1 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lazy-loading 'services' on Instance uuid 0212406a-acc5-4631-90e8-03f4409c07f1 {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:41:14.626440 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-50c8debe-6a16-4823-a081-f4cbd8d197c1 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1" status: 200 len: 1929 microversion: 2.75 time: 0.148570 Oct 04 18:41:14.627121 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1610/3246] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:41:14 2022] GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1 => generated 1929 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:41:14.638497 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-db1b5876-8dbb-41d6-b2e8-b46d4524b1cb tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:14.639163 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-db1b5876-8dbb-41d6-b2e8-b46d4524b1cb tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] [instance: 1b0129be-f5f9-4735-a10a-008bddc30ab4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:14.649082 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-db1b5876-8dbb-41d6-b2e8-b46d4524b1cb tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:14.649636 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-db1b5876-8dbb-41d6-b2e8-b46d4524b1cb tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:14.650045 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-db1b5876-8dbb-41d6-b2e8-b46d4524b1cb tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:14.650694 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-db1b5876-8dbb-41d6-b2e8-b46d4524b1cb tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:14.651258 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-db1b5876-8dbb-41d6-b2e8-b46d4524b1cb tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:14.651569 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-db1b5876-8dbb-41d6-b2e8-b46d4524b1cb tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:14.668186 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-db1b5876-8dbb-41d6-b2e8-b46d4524b1cb tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] HTTP exception thrown: Instance 1b0129be-f5f9-4735-a10a-008bddc30ab4 could not be found. Oct 04 18:41:14.670057 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-db1b5876-8dbb-41d6-b2e8-b46d4524b1cb tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Request method failure captured: Oct 04 18:41:14.670057 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4 HTTP/1.1 Oct 04 18:41:14.670057 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:41:14.670057 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:41:14.670057 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:41:14.670057 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:41:14.670057 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:41:14.670057 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:41:14.670057 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:41:14.670057 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:41:14.670057 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH4EKBVKLugX3SgnNDXsKxue8Annmxt1bGkdJ6DgNHName-pVC77mJNZWUxYwz0CaPQxc_hatf7vT5F5_8TmMZmlIMA5PGRZumfSXsoK0xVYpsWX0kR33R-YT8ms6_RT_a-3TedSPAKRTLwLYvXzPKJZUzDwlmClfpWCQrCmQrVVaqI Oct 04 18:41:14.670057 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:41:14.670057 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:41:14.670057 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:41:14.670057 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:41:14.670057 n-d-850501-14 devstack@n-api.service[123002]: X-Openstack-Nova-Api-Version: 2.47 Oct 04 18:41:14.670057 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:41:14.670057 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:41:14.670057 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 4c247547676947a4814e8bd1a782045c Oct 04 18:41:14.670057 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServerShowV247Test-1983737543 Oct 04 18:41:14.670057 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:41:14.670057 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:41:14.670057 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4c247547676947a4814e8bd1a782045c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4c247547676947a4814e8bd1a782045c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4c247547676947a4814e8bd1a782045c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4c247547676947a4814e8bd1a782045c"}]}] Oct 04 18:41:14.670057 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServerShowV247Test-1983737543 Oct 04 18:41:14.670057 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 4c247547676947a4814e8bd1a782045c Oct 04 18:41:14.670057 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServerShowV247Test-1983737543 Oct 04 18:41:14.670057 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServerShowV247Test-1983737543-project Oct 04 18:41:14.670057 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:41:14.670057 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:41:14.670057 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 7e6c724e83e544c58a01df2bedde1b39 Oct 04 18:41:14.670057 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServerShowV247Test-1983737543-project Oct 04 18:41:14.670057 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:41:14.670057 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 1b0129be-f5f9-4735-a10a-008bddc30ab4 could not be found. Oct 04 18:41:14.670057 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '1b0129be-f5f9-4735-a10a-008bddc30ab4'} Oct 04 18:41:14.670057 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:41:14.670057 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:14.670057 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:41:14.670057 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:41:14.670057 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:41:14.670057 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:41:14.670057 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:41:14.670057 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:41:14.670057 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:41:14.670057 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:41:14.670057 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b0129be-f5f9-4735-a10a-008bddc30ab4 could not be found. Oct 04 18:41:14.670057 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:41:14.670057 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:14.670057 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:41:14.670057 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:14.670057 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:41:14.670057 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:41:14.670057 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:41:14.670057 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:41:14.670057 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:41:14.670057 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:41:14.670057 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:41:14.670057 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:41:14.670057 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:41:14.670057 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:41:14.670057 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:41:14.670057 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:41:14.670057 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b0129be-f5f9-4735-a10a-008bddc30ab4 could not be found. Oct 04 18:41:14.670057 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:41:14.670057 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:14.670057 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:41:14.675262 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:14.675262 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:41:14.675262 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:41:14.675262 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:41:14.675262 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:41:14.675262 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b0129be-f5f9-4735-a10a-008bddc30ab4 could not be found. Oct 04 18:41:14.675262 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:41:14.675262 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-db1b5876-8dbb-41d6-b2e8-b46d4524b1cb tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Returning 404 to user: Instance 1b0129be-f5f9-4735-a10a-008bddc30ab4 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:41:14.675262 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-db1b5876-8dbb-41d6-b2e8-b46d4524b1cb tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] 10.222.0.20 "GET /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4" status: 404 len: 111 microversion: 2.47 time: 0.043503 Oct 04 18:41:14.675262 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1611/3247] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:41:14 2022] GET /compute/v2.1/servers/1b0129be-f5f9-4735-a10a-008bddc30ab4 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:41:14.682507 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-cf1f9ace-4b96-4935-910b-897f2b012bea tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:14.683286 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-cf1f9ace-4b96-4935-910b-897f2b012bea tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] [instance: 573af785-eb22-4bc0-af0b-eb97d05b9329] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:14.690081 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cf1f9ace-4b96-4935-910b-897f2b012bea tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:14.690623 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cf1f9ace-4b96-4935-910b-897f2b012bea tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:14.691061 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cf1f9ace-4b96-4935-910b-897f2b012bea tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:14.694027 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cf1f9ace-4b96-4935-910b-897f2b012bea tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:14.694027 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cf1f9ace-4b96-4935-910b-897f2b012bea tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:14.694027 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cf1f9ace-4b96-4935-910b-897f2b012bea tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:14.713701 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:41:14.729178 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-cf1f9ace-4b96-4935-910b-897f2b012bea tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] [instance: 573af785-eb22-4bc0-af0b-eb97d05b9329] Going to try to terminate instance {{(pid=123002) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:41:15.103779 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-cf1f9ace-4b96-4935-910b-897f2b012bea tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] 10.222.0.20 "DELETE /compute/v2.1/servers/573af785-eb22-4bc0-af0b-eb97d05b9329" status: 204 len: 0 microversion: 2.47 time: 0.426007 Oct 04 18:41:15.111813 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1612/3248] 10.222.0.20 () {60 vars in 1280 bytes} [Tue Oct 4 18:41:14 2022] DELETE /compute/v2.1/servers/573af785-eb22-4bc0-af0b-eb97d05b9329 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:41:15.120973 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-50c5ef7a-24b3-4eca-874c-5649779e1b5e req-c1c50621-887b-4818-a579-cd70a4f55d9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c343931b-bc96-4e9e-a5ce-f93454339a53", "name": "network-vif-unplugged", "status": "completed", "tag": "c6bfdac3-3f2e-4291-9771-d9e034cf664e"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:41:15.139589 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-50c5ef7a-24b3-4eca-874c-5649779e1b5e req-c1c50621-887b-4818-a579-cd70a4f55d9e service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:15.140432 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-50c5ef7a-24b3-4eca-874c-5649779e1b5e req-c1c50621-887b-4818-a579-cd70a4f55d9e service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:15.141322 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-50c5ef7a-24b3-4eca-874c-5649779e1b5e req-c1c50621-887b-4818-a579-cd70a4f55d9e service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:15.162152 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-50c5ef7a-24b3-4eca-874c-5649779e1b5e req-c1c50621-887b-4818-a579-cd70a4f55d9e service nova] Creating event network-vif-unplugged:c6bfdac3-3f2e-4291-9771-d9e034cf664e for instance c343931b-bc96-4e9e-a5ce-f93454339a53 on n-h2-850501-14 Oct 04 18:41:15.167577 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-50c5ef7a-24b3-4eca-874c-5649779e1b5e req-c1c50621-887b-4818-a579-cd70a4f55d9e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055841 Oct 04 18:41:15.168791 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1613/3249] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:41:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:41:15.178444 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4bf9b109-f2b7-40ab-b52e-453a1831764c tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:15.179629 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4bf9b109-f2b7-40ab-b52e-453a1831764c tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] [instance: 573af785-eb22-4bc0-af0b-eb97d05b9329] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:15.186287 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4bf9b109-f2b7-40ab-b52e-453a1831764c tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:15.194939 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4bf9b109-f2b7-40ab-b52e-453a1831764c tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:15.194939 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4bf9b109-f2b7-40ab-b52e-453a1831764c tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:15.194939 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4bf9b109-f2b7-40ab-b52e-453a1831764c tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:15.194939 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4bf9b109-f2b7-40ab-b52e-453a1831764c tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:15.194939 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4bf9b109-f2b7-40ab-b52e-453a1831764c tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:15.302190 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-78aa8ded-a55a-4bbe-9062-00ab8a76d9e8 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.765921 Oct 04 18:41:15.303391 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1637/3250] 10.222.0.20 () {60 vars in 1180 bytes} [Tue Oct 4 18:41:14 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:41:15.340840 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4bf9b109-f2b7-40ab-b52e-453a1831764c tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:15.353129 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4bf9b109-f2b7-40ab-b52e-453a1831764c tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:15.356528 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4bf9b109-f2b7-40ab-b52e-453a1831764c tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:15.357769 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4bf9b109-f2b7-40ab-b52e-453a1831764c tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] 10.222.0.20 "GET /compute/v2.1/servers/573af785-eb22-4bc0-af0b-eb97d05b9329" status: 200 len: 1363 microversion: 2.47 time: 0.187557 Oct 04 18:41:15.360447 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1614/3251] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:41:15 2022] GET /compute/v2.1/servers/573af785-eb22-4bc0-af0b-eb97d05b9329 => generated 1363 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:41:15.403535 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4e9824ae-36cc-4c48-9fd7-61bb674d032a tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-2030763344", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": [{"uuid": "8d61136c-7fa1-4ef0-9194-fdcc075a0dce"}]}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:41:15.491692 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8971f843-3636-471b-8f3c-3446f5d81f42 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:15.492434 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8971f843-3636-471b-8f3c-3446f5d81f42 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] [instance: d016f22c-47ba-47c6-95bd-87ae9cb4816d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:15.499519 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8971f843-3636-471b-8f3c-3446f5d81f42 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:15.500002 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8971f843-3636-471b-8f3c-3446f5d81f42 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:15.500458 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8971f843-3636-471b-8f3c-3446f5d81f42 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:15.501156 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8971f843-3636-471b-8f3c-3446f5d81f42 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:15.501597 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8971f843-3636-471b-8f3c-3446f5d81f42 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:15.502015 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8971f843-3636-471b-8f3c-3446f5d81f42 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:15.537068 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.neutron [None req-4e9824ae-36cc-4c48-9fd7-61bb674d032a tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] validate_networks() for [('8d61136c-7fa1-4ef0-9194-fdcc075a0dce', None, None, None, None, None)] {{(pid=123001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:41:15.566510 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=8 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:41:15.766646 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=10 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:41:15.863440 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8971f843-3636-471b-8f3c-3446f5d81f42 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3499c88686046b8a80bc3a754f016e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08896629a67f488b87a845e57a9ca372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:15.876312 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8971f843-3636-471b-8f3c-3446f5d81f42 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] 10.222.0.20 "GET /compute/v2.1/servers/d016f22c-47ba-47c6-95bd-87ae9cb4816d" status: 200 len: 1519 microversion: 2.1 time: 0.390274 Oct 04 18:41:15.876908 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1615/3252] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:15 2022] GET /compute/v2.1/servers/d016f22c-47ba-47c6-95bd-87ae9cb4816d => generated 1519 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:41:15.886545 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-537ae6ea-3ba2-417d-8b70-6dbf80128784 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:15.887227 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-537ae6ea-3ba2-417d-8b70-6dbf80128784 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: c343931b-bc96-4e9e-a5ce-f93454339a53] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:15.889541 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:41:15.906255 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-537ae6ea-3ba2-417d-8b70-6dbf80128784 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:15.906819 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-537ae6ea-3ba2-417d-8b70-6dbf80128784 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:15.907549 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-537ae6ea-3ba2-417d-8b70-6dbf80128784 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:15.908703 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-537ae6ea-3ba2-417d-8b70-6dbf80128784 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:15.909346 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-537ae6ea-3ba2-417d-8b70-6dbf80128784 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:15.909950 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-537ae6ea-3ba2-417d-8b70-6dbf80128784 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:16.241210 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-537ae6ea-3ba2-417d-8b70-6dbf80128784 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8358c07e2684b749a62becb9f0b7869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b922a74c1c2448bb770d6b298b2d601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:16.258307 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-537ae6ea-3ba2-417d-8b70-6dbf80128784 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53" status: 200 len: 1478 microversion: 2.1 time: 0.380338 Oct 04 18:41:16.259519 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1616/3253] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:15 2022] GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53 => generated 1478 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:16.266360 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-87eb520f-2430-4893-8f71-932b7e11d36a tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:16.267231 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-87eb520f-2430-4893-8f71-932b7e11d36a tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] [instance: 0212406a-acc5-4631-90e8-03f4409c07f1] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:16.275678 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-87eb520f-2430-4893-8f71-932b7e11d36a tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:16.276575 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-87eb520f-2430-4893-8f71-932b7e11d36a tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:16.277206 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-87eb520f-2430-4893-8f71-932b7e11d36a tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:16.278269 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-87eb520f-2430-4893-8f71-932b7e11d36a tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:16.278891 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-87eb520f-2430-4893-8f71-932b7e11d36a tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:16.279617 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-87eb520f-2430-4893-8f71-932b7e11d36a tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:16.456442 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-87eb520f-2430-4893-8f71-932b7e11d36a tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lazy-loading 'services' on Instance uuid 0212406a-acc5-4631-90e8-03f4409c07f1 {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:41:16.482159 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-87eb520f-2430-4893-8f71-932b7e11d36a tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1" status: 200 len: 1929 microversion: 2.75 time: 0.221080 Oct 04 18:41:16.483416 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1617/3254] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:41:16 2022] GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1 => generated 1929 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:41:16.488322 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d2192e17-cbae-4601-be1d-4097389f1d3e tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.1.156"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:41:16.492472 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d2192e17-cbae-4601-be1d-4097389f1d3e tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] [instance: d607218c-7a38-4b49-bb51-7e1adfda8c6a] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:16.498767 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d2192e17-cbae-4601-be1d-4097389f1d3e tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:16.499622 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d2192e17-cbae-4601-be1d-4097389f1d3e tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:16.500339 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d2192e17-cbae-4601-be1d-4097389f1d3e tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:16.501284 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d2192e17-cbae-4601-be1d-4097389f1d3e tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:16.502033 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d2192e17-cbae-4601-be1d-4097389f1d3e tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:16.502683 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d2192e17-cbae-4601-be1d-4097389f1d3e tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:16.531096 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d2192e17-cbae-4601-be1d-4097389f1d3e tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Acquiring lock "refresh_cache-d607218c-7a38-4b49-bb51-7e1adfda8c6a" {{(pid=123002) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 18:41:16.531874 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d2192e17-cbae-4601-be1d-4097389f1d3e tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Acquired lock "refresh_cache-d607218c-7a38-4b49-bb51-7e1adfda8c6a" {{(pid=123002) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 18:41:16.579870 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-4e9824ae-36cc-4c48-9fd7-61bb674d032a tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:41:16.581045 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-4e9824ae-36cc-4c48-9fd7-61bb674d032a tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:41:16.581777 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-4e9824ae-36cc-4c48-9fd7-61bb674d032a tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:41:16.582409 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-4e9824ae-36cc-4c48-9fd7-61bb674d032a tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:41:16.583111 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-4e9824ae-36cc-4c48-9fd7-61bb674d032a tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:41:16.609606 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4e9824ae-36cc-4c48-9fd7-61bb674d032a tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:16.610999 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4e9824ae-36cc-4c48-9fd7-61bb674d032a tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:16.611692 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4e9824ae-36cc-4c48-9fd7-61bb674d032a tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:16.612754 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4e9824ae-36cc-4c48-9fd7-61bb674d032a tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:16.613874 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4e9824ae-36cc-4c48-9fd7-61bb674d032a tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:16.615571 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4e9824ae-36cc-4c48-9fd7-61bb674d032a tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:16.659525 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-4e9824ae-36cc-4c48-9fd7-61bb674d032a tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Getting quotas for project 1b43fba16115404aaa793fb907fd257f. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:41:16.667342 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-4e9824ae-36cc-4c48-9fd7-61bb674d032a tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Getting quotas for user 777a7a51e45b498597f7a1202217575c and project 1b43fba16115404aaa793fb907fd257f. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:41:16.672418 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=100 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:41:16.684165 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-4e9824ae-36cc-4c48-9fd7-61bb674d032a tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Going to run 1 instances... {{(pid=123001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:41:16.686870 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-4e9824ae-36cc-4c48-9fd7-61bb674d032a tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] [instance: 68f2b230-fee6-4a7c-873f-3dfd659b9338] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:41:16.836278 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-4e9824ae-36cc-4c48-9fd7-61bb674d032a tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.439031 Oct 04 18:41:16.837291 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1638/3255] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:41:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1441 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:41:16.853096 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-43d867d8-f2e1-4814-8e89-43e2a4f1c695 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:16.853770 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-43d867d8-f2e1-4814-8e89-43e2a4f1c695 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] [instance: 573af785-eb22-4bc0-af0b-eb97d05b9329] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:16.866593 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-43d867d8-f2e1-4814-8e89-43e2a4f1c695 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:16.867092 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-43d867d8-f2e1-4814-8e89-43e2a4f1c695 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:16.867827 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-43d867d8-f2e1-4814-8e89-43e2a4f1c695 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:16.868785 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-43d867d8-f2e1-4814-8e89-43e2a4f1c695 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:16.869466 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-43d867d8-f2e1-4814-8e89-43e2a4f1c695 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:16.870109 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-43d867d8-f2e1-4814-8e89-43e2a4f1c695 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:17.441628 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-43d867d8-f2e1-4814-8e89-43e2a4f1c695 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:17.453341 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-43d867d8-f2e1-4814-8e89-43e2a4f1c695 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:17.466193 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-43d867d8-f2e1-4814-8e89-43e2a4f1c695 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:17.467454 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-43d867d8-f2e1-4814-8e89-43e2a4f1c695 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] 10.222.0.20 "GET /compute/v2.1/servers/573af785-eb22-4bc0-af0b-eb97d05b9329" status: 200 len: 1363 microversion: 2.47 time: 0.629174 Oct 04 18:41:17.468037 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1639/3256] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:41:16 2022] GET /compute/v2.1/servers/573af785-eb22-4bc0-af0b-eb97d05b9329 => generated 1363 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:41:17.475166 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-92f1b32c-6528-4571-9960-5cd0c9c9a480 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:17.475787 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-92f1b32c-6528-4571-9960-5cd0c9c9a480 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] [instance: 68f2b230-fee6-4a7c-873f-3dfd659b9338] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:17.650754 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-92f1b32c-6528-4571-9960-5cd0c9c9a480 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '777a7a51e45b498597f7a1202217575c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b43fba16115404aaa793fb907fd257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:17.659397 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-92f1b32c-6528-4571-9960-5cd0c9c9a480 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] 10.222.0.20 "GET /compute/v2.1/servers/68f2b230-fee6-4a7c-873f-3dfd659b9338" status: 200 len: 1216 microversion: 2.1 time: 0.190262 Oct 04 18:41:17.660732 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1640/3257] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:17 2022] GET /compute/v2.1/servers/68f2b230-fee6-4a7c-873f-3dfd659b9338 => generated 1216 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:17.667636 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f3d725ea-2f8a-47c6-9535-63974ac50922 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:17.678012 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f3d725ea-2f8a-47c6-9535-63974ac50922 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: c343931b-bc96-4e9e-a5ce-f93454339a53] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:17.690047 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f3d725ea-2f8a-47c6-9535-63974ac50922 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:17.693288 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f3d725ea-2f8a-47c6-9535-63974ac50922 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:17.694180 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f3d725ea-2f8a-47c6-9535-63974ac50922 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:17.694481 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f3d725ea-2f8a-47c6-9535-63974ac50922 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:17.694950 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f3d725ea-2f8a-47c6-9535-63974ac50922 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:17.695385 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f3d725ea-2f8a-47c6-9535-63974ac50922 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:18.249657 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f3d725ea-2f8a-47c6-9535-63974ac50922 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8358c07e2684b749a62becb9f0b7869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b922a74c1c2448bb770d6b298b2d601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:18.264605 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f3d725ea-2f8a-47c6-9535-63974ac50922 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53" status: 200 len: 1478 microversion: 2.1 time: 0.601460 Oct 04 18:41:18.266033 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1641/3258] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:17 2022] GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53 => generated 1478 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:18.275376 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3a650f92-7582-4a8c-90e4-47d8024d8fbf tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:18.279819 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3a650f92-7582-4a8c-90e4-47d8024d8fbf tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] [instance: 0212406a-acc5-4631-90e8-03f4409c07f1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:18.314245 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3a650f92-7582-4a8c-90e4-47d8024d8fbf tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:18.315378 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3a650f92-7582-4a8c-90e4-47d8024d8fbf tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:18.316043 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3a650f92-7582-4a8c-90e4-47d8024d8fbf tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:18.317030 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3a650f92-7582-4a8c-90e4-47d8024d8fbf tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:18.319053 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3a650f92-7582-4a8c-90e4-47d8024d8fbf tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:18.327095 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3a650f92-7582-4a8c-90e4-47d8024d8fbf tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:18.555577 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-3a650f92-7582-4a8c-90e4-47d8024d8fbf tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lazy-loading 'services' on Instance uuid 0212406a-acc5-4631-90e8-03f4409c07f1 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:41:18.629541 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3a650f92-7582-4a8c-90e4-47d8024d8fbf tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1" status: 200 len: 1929 microversion: 2.75 time: 0.361540 Oct 04 18:41:18.635464 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1642/3259] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:41:18 2022] GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1 => generated 1929 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:41:18.658700 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5eeaab90-5f27-41d5-86ee-c392cb6f500a tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:18.672114 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5eeaab90-5f27-41d5-86ee-c392cb6f500a tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] [instance: 573af785-eb22-4bc0-af0b-eb97d05b9329] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:18.691294 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5eeaab90-5f27-41d5-86ee-c392cb6f500a tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:18.694884 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5eeaab90-5f27-41d5-86ee-c392cb6f500a tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:18.697089 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5eeaab90-5f27-41d5-86ee-c392cb6f500a tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:18.700698 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5eeaab90-5f27-41d5-86ee-c392cb6f500a tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:18.701551 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5eeaab90-5f27-41d5-86ee-c392cb6f500a tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:18.702318 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5eeaab90-5f27-41d5-86ee-c392cb6f500a tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:18.908903 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5eeaab90-5f27-41d5-86ee-c392cb6f500a tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:18.909398 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5eeaab90-5f27-41d5-86ee-c392cb6f500a tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:18.910024 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5eeaab90-5f27-41d5-86ee-c392cb6f500a tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:18.910640 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-5eeaab90-5f27-41d5-86ee-c392cb6f500a tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lazy-loading 'fault' on Instance uuid 573af785-eb22-4bc0-af0b-eb97d05b9329 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:41:19.125562 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5eeaab90-5f27-41d5-86ee-c392cb6f500a tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:19.142178 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5eeaab90-5f27-41d5-86ee-c392cb6f500a tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:19.152037 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5eeaab90-5f27-41d5-86ee-c392cb6f500a tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6c724e83e544c58a01df2bedde1b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c247547676947a4814e8bd1a782045c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:19.158739 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5eeaab90-5f27-41d5-86ee-c392cb6f500a tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] 10.222.0.20 "GET /compute/v2.1/servers/573af785-eb22-4bc0-af0b-eb97d05b9329" status: 200 len: 1368 microversion: 2.47 time: 0.518678 Oct 04 18:41:19.160090 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1643/3260] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:41:18 2022] GET /compute/v2.1/servers/573af785-eb22-4bc0-af0b-eb97d05b9329 => generated 1368 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:41:19.171411 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-eed51edf-a6ca-4c03-8b26-0bbf6bcc966b tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:19.183768 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-eed51edf-a6ca-4c03-8b26-0bbf6bcc966b tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] [instance: 68f2b230-fee6-4a7c-873f-3dfd659b9338] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:19.197055 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eed51edf-a6ca-4c03-8b26-0bbf6bcc966b tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:19.200503 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eed51edf-a6ca-4c03-8b26-0bbf6bcc966b tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:19.200975 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eed51edf-a6ca-4c03-8b26-0bbf6bcc966b tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:19.201735 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eed51edf-a6ca-4c03-8b26-0bbf6bcc966b tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:19.202285 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eed51edf-a6ca-4c03-8b26-0bbf6bcc966b tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:19.202636 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eed51edf-a6ca-4c03-8b26-0bbf6bcc966b tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:19.647176 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-eed51edf-a6ca-4c03-8b26-0bbf6bcc966b tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '777a7a51e45b498597f7a1202217575c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b43fba16115404aaa793fb907fd257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:19.656962 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-eed51edf-a6ca-4c03-8b26-0bbf6bcc966b tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] 10.222.0.20 "GET /compute/v2.1/servers/68f2b230-fee6-4a7c-873f-3dfd659b9338" status: 200 len: 1220 microversion: 2.1 time: 0.495441 Oct 04 18:41:19.658166 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1644/3261] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:19 2022] GET /compute/v2.1/servers/68f2b230-fee6-4a7c-873f-3dfd659b9338 => generated 1220 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:19.665381 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a105eb7c-9421-4df9-8e1f-b8f5304b456f tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:19.666681 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a105eb7c-9421-4df9-8e1f-b8f5304b456f tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: c343931b-bc96-4e9e-a5ce-f93454339a53] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:19.674745 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a105eb7c-9421-4df9-8e1f-b8f5304b456f tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:19.675600 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a105eb7c-9421-4df9-8e1f-b8f5304b456f tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:19.676409 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a105eb7c-9421-4df9-8e1f-b8f5304b456f tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:19.677569 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a105eb7c-9421-4df9-8e1f-b8f5304b456f tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:19.678208 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a105eb7c-9421-4df9-8e1f-b8f5304b456f tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:19.678802 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a105eb7c-9421-4df9-8e1f-b8f5304b456f tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:20.250219 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a105eb7c-9421-4df9-8e1f-b8f5304b456f tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8358c07e2684b749a62becb9f0b7869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b922a74c1c2448bb770d6b298b2d601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:20.260147 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a105eb7c-9421-4df9-8e1f-b8f5304b456f tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53" status: 200 len: 1478 microversion: 2.1 time: 0.600539 Oct 04 18:41:20.268402 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1645/3262] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:19 2022] GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53 => generated 1478 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:20.282956 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-6efc61e3-eeb7-4332-9414-39798b515fe6 req-bbd4223b-a73a-48d2-bce6-43e4c16988e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c343931b-bc96-4e9e-a5ce-f93454339a53", "name": "network-vif-plugged", "status": "completed", "tag": "c6bfdac3-3f2e-4291-9771-d9e034cf664e"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:41:20.309713 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-6efc61e3-eeb7-4332-9414-39798b515fe6 req-bbd4223b-a73a-48d2-bce6-43e4c16988e5 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:20.310401 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-6efc61e3-eeb7-4332-9414-39798b515fe6 req-bbd4223b-a73a-48d2-bce6-43e4c16988e5 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:20.311016 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-6efc61e3-eeb7-4332-9414-39798b515fe6 req-bbd4223b-a73a-48d2-bce6-43e4c16988e5 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:20.358253 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-6efc61e3-eeb7-4332-9414-39798b515fe6 req-bbd4223b-a73a-48d2-bce6-43e4c16988e5 service nova] Creating event network-vif-plugged:c6bfdac3-3f2e-4291-9771-d9e034cf664e for instance c343931b-bc96-4e9e-a5ce-f93454339a53 on n-h2-850501-14 Oct 04 18:41:20.370148 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-6efc61e3-eeb7-4332-9414-39798b515fe6 req-bbd4223b-a73a-48d2-bce6-43e4c16988e5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100328 Oct 04 18:41:20.370784 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1646/3263] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:41:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:41:20.384317 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-02dddc2b-ba51-4fa6-95e7-5623e44570fb tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:20.387284 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-02dddc2b-ba51-4fa6-95e7-5623e44570fb tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] [instance: 0212406a-acc5-4631-90e8-03f4409c07f1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:20.397914 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-02dddc2b-ba51-4fa6-95e7-5623e44570fb tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:20.398743 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-02dddc2b-ba51-4fa6-95e7-5623e44570fb tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:20.399722 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-02dddc2b-ba51-4fa6-95e7-5623e44570fb tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:20.400686 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-02dddc2b-ba51-4fa6-95e7-5623e44570fb tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:20.401383 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-02dddc2b-ba51-4fa6-95e7-5623e44570fb tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:20.402704 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-02dddc2b-ba51-4fa6-95e7-5623e44570fb tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:20.697756 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-02dddc2b-ba51-4fa6-95e7-5623e44570fb tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lazy-loading 'services' on Instance uuid 0212406a-acc5-4631-90e8-03f4409c07f1 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:41:20.732400 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-02dddc2b-ba51-4fa6-95e7-5623e44570fb tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1" status: 200 len: 1929 microversion: 2.75 time: 0.359483 Oct 04 18:41:20.733802 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1647/3264] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:41:20 2022] GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1 => generated 1929 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:41:20.738560 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c3bd25d2-cf3e-47c0-95b8-e6cdcae06908 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:20.739725 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c3bd25d2-cf3e-47c0-95b8-e6cdcae06908 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] [instance: 573af785-eb22-4bc0-af0b-eb97d05b9329] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:20.747034 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c3bd25d2-cf3e-47c0-95b8-e6cdcae06908 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:20.747751 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c3bd25d2-cf3e-47c0-95b8-e6cdcae06908 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:20.748761 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c3bd25d2-cf3e-47c0-95b8-e6cdcae06908 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:20.749668 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c3bd25d2-cf3e-47c0-95b8-e6cdcae06908 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:20.750879 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c3bd25d2-cf3e-47c0-95b8-e6cdcae06908 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:20.751469 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c3bd25d2-cf3e-47c0-95b8-e6cdcae06908 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:20.772400 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-c3bd25d2-cf3e-47c0-95b8-e6cdcae06908 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] HTTP exception thrown: Instance 573af785-eb22-4bc0-af0b-eb97d05b9329 could not be found. Oct 04 18:41:20.774976 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c3bd25d2-cf3e-47c0-95b8-e6cdcae06908 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Request method failure captured: Oct 04 18:41:20.774976 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/573af785-eb22-4bc0-af0b-eb97d05b9329 HTTP/1.1 Oct 04 18:41:20.774976 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:41:20.774976 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:41:20.774976 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:41:20.774976 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:41:20.774976 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:41:20.774976 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:41:20.774976 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:41:20.774976 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:41:20.774976 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPH4EKBVKLugX3SgnNDXsKxue8Annmxt1bGkdJ6DgNHName-pVC77mJNZWUxYwz0CaPQxc_hatf7vT5F5_8TmMZmlIMA5PGRZumfSXsoK0xVYpsWX0kR33R-YT8ms6_RT_a-3TedSPAKRTLwLYvXzPKJZUzDwlmClfpWCQrCmQrVVaqI Oct 04 18:41:20.774976 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:41:20.774976 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:41:20.774976 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:41:20.774976 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:41:20.774976 n-d-850501-14 devstack@n-api.service[123001]: X-Openstack-Nova-Api-Version: 2.47 Oct 04 18:41:20.774976 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:41:20.774976 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:41:20.774976 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 4c247547676947a4814e8bd1a782045c Oct 04 18:41:20.774976 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ServerShowV247Test-1983737543 Oct 04 18:41:20.774976 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:41:20.774976 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:41:20.774976 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4c247547676947a4814e8bd1a782045c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4c247547676947a4814e8bd1a782045c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4c247547676947a4814e8bd1a782045c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4c247547676947a4814e8bd1a782045c"}]}] Oct 04 18:41:20.774976 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ServerShowV247Test-1983737543 Oct 04 18:41:20.774976 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 4c247547676947a4814e8bd1a782045c Oct 04 18:41:20.774976 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ServerShowV247Test-1983737543 Oct 04 18:41:20.774976 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ServerShowV247Test-1983737543-project Oct 04 18:41:20.774976 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:41:20.774976 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:41:20.774976 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 7e6c724e83e544c58a01df2bedde1b39 Oct 04 18:41:20.774976 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ServerShowV247Test-1983737543-project Oct 04 18:41:20.774976 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:41:20.774976 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 573af785-eb22-4bc0-af0b-eb97d05b9329 could not be found. Oct 04 18:41:20.774976 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '573af785-eb22-4bc0-af0b-eb97d05b9329'} Oct 04 18:41:20.774976 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:41:20.774976 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:20.774976 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:41:20.774976 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:41:20.774976 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:41:20.774976 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:41:20.774976 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:41:20.774976 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:41:20.774976 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:41:20.774976 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:41:20.774976 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 573af785-eb22-4bc0-af0b-eb97d05b9329 could not be found. Oct 04 18:41:20.774976 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:41:20.774976 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:20.774976 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:41:20.774976 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:20.774976 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:41:20.774976 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:41:20.774976 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:41:20.774976 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:41:20.774976 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:41:20.774976 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:41:20.774976 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:41:20.774976 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:41:20.774976 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:41:20.774976 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:41:20.774976 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:41:20.774976 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:41:20.774976 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 573af785-eb22-4bc0-af0b-eb97d05b9329 could not be found. Oct 04 18:41:20.774976 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:41:20.774976 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:20.774976 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:41:20.780785 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:20.780785 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:41:20.780785 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:41:20.780785 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:41:20.780785 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:41:20.780785 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 573af785-eb22-4bc0-af0b-eb97d05b9329 could not be found. Oct 04 18:41:20.780785 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:41:20.782381 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c3bd25d2-cf3e-47c0-95b8-e6cdcae06908 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] Returning 404 to user: Instance 573af785-eb22-4bc0-af0b-eb97d05b9329 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:41:20.784003 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c3bd25d2-cf3e-47c0-95b8-e6cdcae06908 tempest-ServerShowV247Test-1983737543 tempest-ServerShowV247Test-1983737543-project] 10.222.0.20 "GET /compute/v2.1/servers/573af785-eb22-4bc0-af0b-eb97d05b9329" status: 404 len: 111 microversion: 2.47 time: 0.048934 Oct 04 18:41:20.785129 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1648/3265] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:41:20 2022] GET /compute/v2.1/servers/573af785-eb22-4bc0-af0b-eb97d05b9329 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:41:20.815380 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e5d158c8-dd45-4007-9d81-c147b31bfabd tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:20.815380 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e5d158c8-dd45-4007-9d81-c147b31bfabd tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] [instance: 68f2b230-fee6-4a7c-873f-3dfd659b9338] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:20.831769 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e5d158c8-dd45-4007-9d81-c147b31bfabd tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:20.832307 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e5d158c8-dd45-4007-9d81-c147b31bfabd tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:20.833885 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e5d158c8-dd45-4007-9d81-c147b31bfabd tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:20.834656 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e5d158c8-dd45-4007-9d81-c147b31bfabd tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:20.835126 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e5d158c8-dd45-4007-9d81-c147b31bfabd tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:20.835554 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e5d158c8-dd45-4007-9d81-c147b31bfabd tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:21.006484 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e5d158c8-dd45-4007-9d81-c147b31bfabd tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '777a7a51e45b498597f7a1202217575c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b43fba16115404aaa793fb907fd257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:21.028198 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e5d158c8-dd45-4007-9d81-c147b31bfabd tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] 10.222.0.20 "GET /compute/v2.1/servers/68f2b230-fee6-4a7c-873f-3dfd659b9338" status: 200 len: 1276 microversion: 2.1 time: 0.241626 Oct 04 18:41:21.031211 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1649/3266] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:20 2022] GET /compute/v2.1/servers/68f2b230-fee6-4a7c-873f-3dfd659b9338 => generated 1276 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:21.249573 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-d2192e17-cbae-4601-be1d-4097389f1d3e tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] [instance: d607218c-7a38-4b49-bb51-7e1adfda8c6a] Building network info cache for instance {{(pid=123002) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 18:41:21.267338 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-d90ea2f2-9201-49f7-890c-5c32bd72ca54 req-fe4d4fb5-84bb-4e53-8878-f77ab23fe679 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d607218c-7a38-4b49-bb51-7e1adfda8c6a", "tag": "a4c07b4b-a6d2-4965-9650-3ce3a87b89ee"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:41:21.292334 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-d90ea2f2-9201-49f7-890c-5c32bd72ca54 req-fe4d4fb5-84bb-4e53-8878-f77ab23fe679 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:21.292592 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-d90ea2f2-9201-49f7-890c-5c32bd72ca54 req-fe4d4fb5-84bb-4e53-8878-f77ab23fe679 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:21.293346 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-d90ea2f2-9201-49f7-890c-5c32bd72ca54 req-fe4d4fb5-84bb-4e53-8878-f77ab23fe679 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:21.317602 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-d90ea2f2-9201-49f7-890c-5c32bd72ca54 req-fe4d4fb5-84bb-4e53-8878-f77ab23fe679 service nova] Creating event network-changed:a4c07b4b-a6d2-4965-9650-3ce3a87b89ee for instance d607218c-7a38-4b49-bb51-7e1adfda8c6a on n-h2-850501-14 Oct 04 18:41:21.347278 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-d90ea2f2-9201-49f7-890c-5c32bd72ca54 req-fe4d4fb5-84bb-4e53-8878-f77ab23fe679 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079370 Oct 04 18:41:21.347278 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1650/3267] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:41:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 04 18:41:21.356606 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5bbde465-285d-4764-a591-76dd7e6e2bd7 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:21.356606 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5bbde465-285d-4764-a591-76dd7e6e2bd7 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: c343931b-bc96-4e9e-a5ce-f93454339a53] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:21.365526 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5bbde465-285d-4764-a591-76dd7e6e2bd7 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:21.366209 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5bbde465-285d-4764-a591-76dd7e6e2bd7 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:21.366810 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5bbde465-285d-4764-a591-76dd7e6e2bd7 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:21.367522 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5bbde465-285d-4764-a591-76dd7e6e2bd7 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:21.367971 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5bbde465-285d-4764-a591-76dd7e6e2bd7 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:21.368431 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5bbde465-285d-4764-a591-76dd7e6e2bd7 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:22.619874 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5bbde465-285d-4764-a591-76dd7e6e2bd7 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8358c07e2684b749a62becb9f0b7869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b922a74c1c2448bb770d6b298b2d601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:22.627844 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=100 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:41:22.633220 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5bbde465-285d-4764-a591-76dd7e6e2bd7 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53" status: 200 len: 1478 microversion: 2.1 time: 1.288972 Oct 04 18:41:22.633820 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1651/3268] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:21 2022] GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53 => generated 1478 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:22.648929 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a7a534da-3215-488e-92e0-04372710395f tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:22.650095 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a7a534da-3215-488e-92e0-04372710395f tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] [instance: 0212406a-acc5-4631-90e8-03f4409c07f1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:22.659009 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a7a534da-3215-488e-92e0-04372710395f tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:22.659980 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a7a534da-3215-488e-92e0-04372710395f tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:22.660739 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a7a534da-3215-488e-92e0-04372710395f tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:22.663883 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a7a534da-3215-488e-92e0-04372710395f tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:22.664741 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a7a534da-3215-488e-92e0-04372710395f tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:22.666399 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a7a534da-3215-488e-92e0-04372710395f tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:22.901224 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-a7a534da-3215-488e-92e0-04372710395f tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lazy-loading 'services' on Instance uuid 0212406a-acc5-4631-90e8-03f4409c07f1 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:41:22.947342 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a7a534da-3215-488e-92e0-04372710395f tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1" status: 200 len: 1929 microversion: 2.75 time: 0.307832 Oct 04 18:41:22.949012 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1652/3269] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:41:22 2022] GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1 => generated 1929 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:41:22.959804 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0351480e-69fd-450c-b45d-90c9767ecb82 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:22.961776 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0351480e-69fd-450c-b45d-90c9767ecb82 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] [instance: 68f2b230-fee6-4a7c-873f-3dfd659b9338] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:22.978083 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0351480e-69fd-450c-b45d-90c9767ecb82 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:22.978856 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0351480e-69fd-450c-b45d-90c9767ecb82 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:22.979484 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0351480e-69fd-450c-b45d-90c9767ecb82 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:22.981035 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0351480e-69fd-450c-b45d-90c9767ecb82 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:22.981603 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0351480e-69fd-450c-b45d-90c9767ecb82 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:22.983882 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0351480e-69fd-450c-b45d-90c9767ecb82 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:23.159102 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0351480e-69fd-450c-b45d-90c9767ecb82 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '777a7a51e45b498597f7a1202217575c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b43fba16115404aaa793fb907fd257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:23.179914 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0351480e-69fd-450c-b45d-90c9767ecb82 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] 10.222.0.20 "GET /compute/v2.1/servers/68f2b230-fee6-4a7c-873f-3dfd659b9338" status: 200 len: 1274 microversion: 2.1 time: 0.229043 Oct 04 18:41:23.181888 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1653/3270] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:22 2022] GET /compute/v2.1/servers/68f2b230-fee6-4a7c-873f-3dfd659b9338 => generated 1274 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:23.659168 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-66c93f51-f4c0-46ec-9a7a-1c3aabdc71ec tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:23.660635 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-66c93f51-f4c0-46ec-9a7a-1c3aabdc71ec tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: c343931b-bc96-4e9e-a5ce-f93454339a53] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:23.668222 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-66c93f51-f4c0-46ec-9a7a-1c3aabdc71ec tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:23.669012 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-66c93f51-f4c0-46ec-9a7a-1c3aabdc71ec tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:23.669450 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-66c93f51-f4c0-46ec-9a7a-1c3aabdc71ec tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:23.672807 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-66c93f51-f4c0-46ec-9a7a-1c3aabdc71ec tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:23.673872 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-66c93f51-f4c0-46ec-9a7a-1c3aabdc71ec tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:23.673991 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-66c93f51-f4c0-46ec-9a7a-1c3aabdc71ec tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:24.454921 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-d2192e17-cbae-4601-be1d-4097389f1d3e tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] [instance: d607218c-7a38-4b49-bb51-7e1adfda8c6a] Updating instance_info_cache with network_info: [{"id": "a4c07b4b-a6d2-4965-9650-3ce3a87b89ee", "address": "fa:16:3e:43:0e:5b", "network": {"id": "1abca12e-af42-4430-bf6f-473c83612754", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1832648559-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.1.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "08896629a67f488b87a845e57a9ca372", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa4c07b4b-a6", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=123002) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 18:41:24.495437 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-66c93f51-f4c0-46ec-9a7a-1c3aabdc71ec tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8358c07e2684b749a62becb9f0b7869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b922a74c1c2448bb770d6b298b2d601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:24.504132 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-66c93f51-f4c0-46ec-9a7a-1c3aabdc71ec tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53" status: 200 len: 1463 microversion: 2.1 time: 0.849780 Oct 04 18:41:24.506999 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1654/3271] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:23 2022] GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53 => generated 1463 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:24.513271 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-308263f5-28ec-4ca9-a6e4-aa8826bdd127 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:24.514013 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-308263f5-28ec-4ca9-a6e4-aa8826bdd127 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] [instance: 0212406a-acc5-4631-90e8-03f4409c07f1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:24.520262 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-308263f5-28ec-4ca9-a6e4-aa8826bdd127 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:24.521163 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-308263f5-28ec-4ca9-a6e4-aa8826bdd127 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:24.521916 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-308263f5-28ec-4ca9-a6e4-aa8826bdd127 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:24.522885 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-308263f5-28ec-4ca9-a6e4-aa8826bdd127 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:24.523450 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-308263f5-28ec-4ca9-a6e4-aa8826bdd127 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:24.523987 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-308263f5-28ec-4ca9-a6e4-aa8826bdd127 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:24.573002 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d2192e17-cbae-4601-be1d-4097389f1d3e tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Releasing lock "refresh_cache-d607218c-7a38-4b49-bb51-7e1adfda8c6a" {{(pid=123002) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 18:41:24.574153 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d2192e17-cbae-4601-be1d-4097389f1d3e tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] 10.222.0.20 "POST /compute/v2.1/servers/d607218c-7a38-4b49-bb51-7e1adfda8c6a/action" status: 202 len: 0 microversion: 2.1 time: 8.089530 Oct 04 18:41:24.574778 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1618/3272] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:41:16 2022] POST /compute/v2.1/servers/d607218c-7a38-4b49-bb51-7e1adfda8c6a/action => generated 0 bytes in 8091 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 04 18:41:24.584558 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-27e47604-f0ac-4f63-8c1c-5cd66ba2d2f7 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:24.585419 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-27e47604-f0ac-4f63-8c1c-5cd66ba2d2f7 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] [instance: 68f2b230-fee6-4a7c-873f-3dfd659b9338] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:24.593537 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-27e47604-f0ac-4f63-8c1c-5cd66ba2d2f7 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:24.594323 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-27e47604-f0ac-4f63-8c1c-5cd66ba2d2f7 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:24.594764 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-27e47604-f0ac-4f63-8c1c-5cd66ba2d2f7 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:24.595621 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-27e47604-f0ac-4f63-8c1c-5cd66ba2d2f7 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:24.596256 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-27e47604-f0ac-4f63-8c1c-5cd66ba2d2f7 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:24.596869 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-27e47604-f0ac-4f63-8c1c-5cd66ba2d2f7 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:24.664975 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-308263f5-28ec-4ca9-a6e4-aa8826bdd127 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lazy-loading 'services' on Instance uuid 0212406a-acc5-4631-90e8-03f4409c07f1 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:41:24.695437 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-308263f5-28ec-4ca9-a6e4-aa8826bdd127 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1" status: 200 len: 1929 microversion: 2.75 time: 0.186874 Oct 04 18:41:24.710488 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1655/3273] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:41:24 2022] GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1 => generated 1929 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:41:24.710488 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2bd4a618-cd6e-4c47-970c-b36d581f7db6 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:41:24.712580 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2bd4a618-cd6e-4c47-970c-b36d581f7db6 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] [instance: c343931b-bc96-4e9e-a5ce-f93454339a53] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:24.719912 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2bd4a618-cd6e-4c47-970c-b36d581f7db6 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:24.720952 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2bd4a618-cd6e-4c47-970c-b36d581f7db6 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:24.721514 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2bd4a618-cd6e-4c47-970c-b36d581f7db6 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:24.722876 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2bd4a618-cd6e-4c47-970c-b36d581f7db6 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:24.723131 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2bd4a618-cd6e-4c47-970c-b36d581f7db6 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:24.725305 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2bd4a618-cd6e-4c47-970c-b36d581f7db6 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:24.982497 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-27e47604-f0ac-4f63-8c1c-5cd66ba2d2f7 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '777a7a51e45b498597f7a1202217575c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b43fba16115404aaa793fb907fd257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:25.013854 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-27e47604-f0ac-4f63-8c1c-5cd66ba2d2f7 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] 10.222.0.20 "GET /compute/v2.1/servers/68f2b230-fee6-4a7c-873f-3dfd659b9338" status: 200 len: 1316 microversion: 2.1 time: 0.425749 Oct 04 18:41:25.015051 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1619/3274] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:24 2022] GET /compute/v2.1/servers/68f2b230-fee6-4a7c-873f-3dfd659b9338 => generated 1316 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:25.034431 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a46240aa-b7be-4f50-bbb6-c631319084b7 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.1.156"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:41:25.037453 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a46240aa-b7be-4f50-bbb6-c631319084b7 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] [instance: d016f22c-47ba-47c6-95bd-87ae9cb4816d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:25.046320 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a46240aa-b7be-4f50-bbb6-c631319084b7 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:25.047109 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a46240aa-b7be-4f50-bbb6-c631319084b7 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:25.047661 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a46240aa-b7be-4f50-bbb6-c631319084b7 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:25.048499 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a46240aa-b7be-4f50-bbb6-c631319084b7 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:25.049058 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a46240aa-b7be-4f50-bbb6-c631319084b7 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:25.049486 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a46240aa-b7be-4f50-bbb6-c631319084b7 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:25.079471 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a46240aa-b7be-4f50-bbb6-c631319084b7 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Acquiring lock "refresh_cache-d016f22c-47ba-47c6-95bd-87ae9cb4816d" {{(pid=123002) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 18:41:25.080175 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a46240aa-b7be-4f50-bbb6-c631319084b7 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Acquired lock "refresh_cache-d016f22c-47ba-47c6-95bd-87ae9cb4816d" {{(pid=123002) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 18:41:25.153917 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2bd4a618-cd6e-4c47-970c-b36d581f7db6 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53/action" status: 202 len: 0 microversion: 2.1 time: 0.449307 Oct 04 18:41:25.161067 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1656/3275] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:41:24 2022] POST /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53/action => generated 0 bytes in 460 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:41:25.171082 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-456cf1cc-a9c8-4c49-80d7-9c345eeaf9b4 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:25.172931 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-456cf1cc-a9c8-4c49-80d7-9c345eeaf9b4 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] [instance: c343931b-bc96-4e9e-a5ce-f93454339a53] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:25.186889 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-456cf1cc-a9c8-4c49-80d7-9c345eeaf9b4 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:25.187745 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-456cf1cc-a9c8-4c49-80d7-9c345eeaf9b4 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:25.188636 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-456cf1cc-a9c8-4c49-80d7-9c345eeaf9b4 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:25.195063 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-456cf1cc-a9c8-4c49-80d7-9c345eeaf9b4 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:25.195747 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-456cf1cc-a9c8-4c49-80d7-9c345eeaf9b4 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:25.196253 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-456cf1cc-a9c8-4c49-80d7-9c345eeaf9b4 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:25.241194 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-456cf1cc-a9c8-4c49-80d7-9c345eeaf9b4 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:25.253829 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-456cf1cc-a9c8-4c49-80d7-9c345eeaf9b4 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:25.255292 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-456cf1cc-a9c8-4c49-80d7-9c345eeaf9b4 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:25.256370 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-456cf1cc-a9c8-4c49-80d7-9c345eeaf9b4 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Lazy-loading 'fault' on Instance uuid c343931b-bc96-4e9e-a5ce-f93454339a53 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:41:25.705290 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-456cf1cc-a9c8-4c49-80d7-9c345eeaf9b4 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53" status: 200 len: 1599 microversion: 2.1 time: 0.542836 Oct 04 18:41:25.708715 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1657/3276] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:25 2022] GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53 => generated 1599 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:25.983043 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-feb9560d-4e79-4202-b8c3-22072dcf00ff tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-410315125", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:41:26.049120 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.neutron [None req-feb9560d-4e79-4202-b8c3-22072dcf00ff tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] validate_networks() for [('81c29635-15f6-4834-a34a-2ac984cb21e0', None, None, None, None, None)] {{(pid=123001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:41:26.642073 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:41:27.510707 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-feb9560d-4e79-4202-b8c3-22072dcf00ff tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:41:27.512656 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-feb9560d-4e79-4202-b8c3-22072dcf00ff tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:41:27.513391 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-feb9560d-4e79-4202-b8c3-22072dcf00ff tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:41:27.514125 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-feb9560d-4e79-4202-b8c3-22072dcf00ff tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:41:27.515114 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-feb9560d-4e79-4202-b8c3-22072dcf00ff tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:41:27.540179 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-feb9560d-4e79-4202-b8c3-22072dcf00ff tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:27.544951 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-feb9560d-4e79-4202-b8c3-22072dcf00ff tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:27.544951 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-feb9560d-4e79-4202-b8c3-22072dcf00ff tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:27.544951 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-feb9560d-4e79-4202-b8c3-22072dcf00ff tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:27.544951 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-feb9560d-4e79-4202-b8c3-22072dcf00ff tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:27.544951 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-feb9560d-4e79-4202-b8c3-22072dcf00ff tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:27.584407 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-feb9560d-4e79-4202-b8c3-22072dcf00ff tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Getting quotas for project 9eb391aef10e4684ada5f811ae818f97. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:41:27.593639 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-feb9560d-4e79-4202-b8c3-22072dcf00ff tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Getting quotas for user c4243e3907374e5e9947c17e6288f0e7 and project 9eb391aef10e4684ada5f811ae818f97. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:41:27.617492 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-feb9560d-4e79-4202-b8c3-22072dcf00ff tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Going to run 1 instances... {{(pid=123001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:41:27.620046 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-feb9560d-4e79-4202-b8c3-22072dcf00ff tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: af46589b-8af1-4394-86e3-631c7d483a12] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:41:27.782749 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-feb9560d-4e79-4202-b8c3-22072dcf00ff tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.070530 Oct 04 18:41:27.783837 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1658/3277] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:41:25 2022] POST /compute/v2.1/servers => generated 383 bytes in 2074 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:41:27.795275 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a46512bb-fe6d-45a1-af37-39b714df34e3 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:27.796291 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a46512bb-fe6d-45a1-af37-39b714df34e3 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] [instance: 0212406a-acc5-4631-90e8-03f4409c07f1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:27.810059 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a46512bb-fe6d-45a1-af37-39b714df34e3 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:27.810566 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a46512bb-fe6d-45a1-af37-39b714df34e3 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:27.815268 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a46512bb-fe6d-45a1-af37-39b714df34e3 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:27.816220 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a46512bb-fe6d-45a1-af37-39b714df34e3 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:27.816809 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a46512bb-fe6d-45a1-af37-39b714df34e3 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:27.817367 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a46512bb-fe6d-45a1-af37-39b714df34e3 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:28.187732 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-a46512bb-fe6d-45a1-af37-39b714df34e3 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lazy-loading 'services' on Instance uuid 0212406a-acc5-4631-90e8-03f4409c07f1 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:41:28.236365 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a46512bb-fe6d-45a1-af37-39b714df34e3 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1" status: 200 len: 1929 microversion: 2.75 time: 0.451346 Oct 04 18:41:28.237470 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1659/3278] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:41:27 2022] GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1 => generated 1929 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:41:28.242835 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-07b9be50-f8ee-436f-9e49-cc2851fef045 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:41:28.246356 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-07b9be50-f8ee-436f-9e49-cc2851fef045 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] [instance: c343931b-bc96-4e9e-a5ce-f93454339a53] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:28.262547 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-07b9be50-f8ee-436f-9e49-cc2851fef045 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:28.263053 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-07b9be50-f8ee-436f-9e49-cc2851fef045 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:28.263495 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-07b9be50-f8ee-436f-9e49-cc2851fef045 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:28.264266 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-07b9be50-f8ee-436f-9e49-cc2851fef045 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:28.265876 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-07b9be50-f8ee-436f-9e49-cc2851fef045 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:28.266477 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-07b9be50-f8ee-436f-9e49-cc2851fef045 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:28.636638 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-07b9be50-f8ee-436f-9e49-cc2851fef045 tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53/action" status: 202 len: 0 microversion: 2.1 time: 0.397379 Oct 04 18:41:28.639666 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1660/3279] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:41:28 2022] POST /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53/action => generated 0 bytes in 401 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:41:28.649587 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f2750ab2-10cb-4853-ae36-d6203dd83032 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:28.650889 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f2750ab2-10cb-4853-ae36-d6203dd83032 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] [instance: 68f2b230-fee6-4a7c-873f-3dfd659b9338] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:28.667334 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f2750ab2-10cb-4853-ae36-d6203dd83032 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:28.667928 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f2750ab2-10cb-4853-ae36-d6203dd83032 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:28.668536 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f2750ab2-10cb-4853-ae36-d6203dd83032 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:28.672953 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f2750ab2-10cb-4853-ae36-d6203dd83032 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:28.673683 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f2750ab2-10cb-4853-ae36-d6203dd83032 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:28.674185 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f2750ab2-10cb-4853-ae36-d6203dd83032 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:29.157131 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f2750ab2-10cb-4853-ae36-d6203dd83032 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '777a7a51e45b498597f7a1202217575c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b43fba16115404aaa793fb907fd257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:29.169196 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f2750ab2-10cb-4853-ae36-d6203dd83032 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] 10.222.0.20 "GET /compute/v2.1/servers/68f2b230-fee6-4a7c-873f-3dfd659b9338" status: 200 len: 1316 microversion: 2.1 time: 0.525038 Oct 04 18:41:29.172023 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1661/3280] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:28 2022] GET /compute/v2.1/servers/68f2b230-fee6-4a7c-873f-3dfd659b9338 => generated 1316 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:29.186045 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-dbafd5ed-6c94-44a2-87f3-e7907ad0cc64 req-031c9c73-5cfb-4b48-a186-c4bcee098ff0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68f2b230-fee6-4a7c-873f-3dfd659b9338", "tag": "48ff58dc-2007-4baf-8109-1524f9ab9238"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:41:29.202997 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-dbafd5ed-6c94-44a2-87f3-e7907ad0cc64 req-031c9c73-5cfb-4b48-a186-c4bcee098ff0 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:29.203997 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-dbafd5ed-6c94-44a2-87f3-e7907ad0cc64 req-031c9c73-5cfb-4b48-a186-c4bcee098ff0 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:29.205265 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-dbafd5ed-6c94-44a2-87f3-e7907ad0cc64 req-031c9c73-5cfb-4b48-a186-c4bcee098ff0 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:29.235226 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-dbafd5ed-6c94-44a2-87f3-e7907ad0cc64 req-031c9c73-5cfb-4b48-a186-c4bcee098ff0 service nova] Creating event network-changed:48ff58dc-2007-4baf-8109-1524f9ab9238 for instance 68f2b230-fee6-4a7c-873f-3dfd659b9338 on n-h2-850501-14 Oct 04 18:41:29.248122 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-dbafd5ed-6c94-44a2-87f3-e7907ad0cc64 req-031c9c73-5cfb-4b48-a186-c4bcee098ff0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073911 Oct 04 18:41:29.248753 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1662/3281] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:41:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:41:29.255649 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-03ad5b85-8919-45b8-a271-81138c5f7804 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:29.256463 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-03ad5b85-8919-45b8-a271-81138c5f7804 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: af46589b-8af1-4394-86e3-631c7d483a12] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:29.361412 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-03ad5b85-8919-45b8-a271-81138c5f7804 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:29.443212 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-03ad5b85-8919-45b8-a271-81138c5f7804 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/af46589b-8af1-4394-86e3-631c7d483a12" status: 200 len: 1221 microversion: 2.1 time: 0.159157 Oct 04 18:41:29.443212 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1663/3282] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:29 2022] GET /compute/v2.1/servers/af46589b-8af1-4394-86e3-631c7d483a12 => generated 1221 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:29.490069 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5fd9fe03-ffd2-4d5a-8f46-7935bd030d3f tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:29.490871 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5fd9fe03-ffd2-4d5a-8f46-7935bd030d3f tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] [instance: c343931b-bc96-4e9e-a5ce-f93454339a53] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:29.521542 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5fd9fe03-ffd2-4d5a-8f46-7935bd030d3f tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:29.522108 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5fd9fe03-ffd2-4d5a-8f46-7935bd030d3f tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:29.526464 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5fd9fe03-ffd2-4d5a-8f46-7935bd030d3f tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:29.527658 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5fd9fe03-ffd2-4d5a-8f46-7935bd030d3f tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:29.528205 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5fd9fe03-ffd2-4d5a-8f46-7935bd030d3f tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:29.528724 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5fd9fe03-ffd2-4d5a-8f46-7935bd030d3f tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:29.687192 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.network.neutron [None req-a46240aa-b7be-4f50-bbb6-c631319084b7 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] [instance: d016f22c-47ba-47c6-95bd-87ae9cb4816d] re-assign floating IP 172.25.1.156 from instance d607218c-7a38-4b49-bb51-7e1adfda8c6a Oct 04 18:41:29.800668 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-a46240aa-b7be-4f50-bbb6-c631319084b7 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] [instance: d607218c-7a38-4b49-bb51-7e1adfda8c6a] Building network info cache for instance {{(pid=123002) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 18:41:29.803429 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5fd9fe03-ffd2-4d5a-8f46-7935bd030d3f tempest-ServersAdminTestJSON-142108940 tempest-ServersAdminTestJSON-142108940-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53" status: 200 len: 1616 microversion: 2.1 time: 0.378869 Oct 04 18:41:29.804020 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1664/3283] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:29 2022] GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53 => generated 1616 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:29.809906 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-12f22b0d-988b-47da-bfba-698e490a9b93 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:29.810761 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-12f22b0d-988b-47da-bfba-698e490a9b93 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] [instance: 0212406a-acc5-4631-90e8-03f4409c07f1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:29.821472 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-12f22b0d-988b-47da-bfba-698e490a9b93 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:29.829507 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-12f22b0d-988b-47da-bfba-698e490a9b93 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:29.830427 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-12f22b0d-988b-47da-bfba-698e490a9b93 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:29.831927 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-12f22b0d-988b-47da-bfba-698e490a9b93 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:29.833119 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-12f22b0d-988b-47da-bfba-698e490a9b93 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:29.833781 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-12f22b0d-988b-47da-bfba-698e490a9b93 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:29.983332 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-12f22b0d-988b-47da-bfba-698e490a9b93 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lazy-loading 'services' on Instance uuid 0212406a-acc5-4631-90e8-03f4409c07f1 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:41:30.050757 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-12f22b0d-988b-47da-bfba-698e490a9b93 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1" status: 200 len: 1929 microversion: 2.75 time: 0.245126 Oct 04 18:41:30.053950 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1665/3284] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:41:29 2022] GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1 => generated 1929 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:41:30.070348 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-754a880c-31a9-4e61-9a2e-cb0a153745be tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1694786621", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:41:30.155501 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.neutron [None req-754a880c-31a9-4e61-9a2e-cb0a153745be tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] validate_networks() for [('81c29635-15f6-4834-a34a-2ac984cb21e0', None, None, None, None, None)] {{(pid=123001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:41:30.816785 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-a46240aa-b7be-4f50-bbb6-c631319084b7 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] [instance: d607218c-7a38-4b49-bb51-7e1adfda8c6a] Updating instance_info_cache with network_info: [{"id": "a4c07b4b-a6d2-4965-9650-3ce3a87b89ee", "address": "fa:16:3e:43:0e:5b", "network": {"id": "1abca12e-af42-4430-bf6f-473c83612754", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1832648559-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "08896629a67f488b87a845e57a9ca372", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa4c07b4b-a6", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=123002) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 18:41:30.847120 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-754a880c-31a9-4e61-9a2e-cb0a153745be tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:41:30.848437 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-754a880c-31a9-4e61-9a2e-cb0a153745be tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:41:30.849300 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-754a880c-31a9-4e61-9a2e-cb0a153745be tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:41:30.850093 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-754a880c-31a9-4e61-9a2e-cb0a153745be tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:41:30.850977 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-754a880c-31a9-4e61-9a2e-cb0a153745be tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:41:30.867521 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-754a880c-31a9-4e61-9a2e-cb0a153745be tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:30.868345 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-754a880c-31a9-4e61-9a2e-cb0a153745be tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:30.869611 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-754a880c-31a9-4e61-9a2e-cb0a153745be tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:30.870746 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-754a880c-31a9-4e61-9a2e-cb0a153745be tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:30.871556 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-754a880c-31a9-4e61-9a2e-cb0a153745be tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:30.872298 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-754a880c-31a9-4e61-9a2e-cb0a153745be tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:30.884842 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-a46240aa-b7be-4f50-bbb6-c631319084b7 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] [instance: d016f22c-47ba-47c6-95bd-87ae9cb4816d] Building network info cache for instance {{(pid=123002) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 18:41:30.886880 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:41:30.894365 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:41:30.901562 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-754a880c-31a9-4e61-9a2e-cb0a153745be tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Getting quotas for project 9eb391aef10e4684ada5f811ae818f97. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:41:30.909590 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-754a880c-31a9-4e61-9a2e-cb0a153745be tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Getting quotas for user c4243e3907374e5e9947c17e6288f0e7 and project 9eb391aef10e4684ada5f811ae818f97. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:41:30.926748 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-754a880c-31a9-4e61-9a2e-cb0a153745be tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Going to run 1 instances... {{(pid=123001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:41:30.929422 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-754a880c-31a9-4e61-9a2e-cb0a153745be tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: cd97d817-422a-457d-b653-020350d75d6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:41:31.094352 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-754a880c-31a9-4e61-9a2e-cb0a153745be tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.039166 Oct 04 18:41:31.103048 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1666/3285] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:41:30 2022] POST /compute/v2.1/servers => generated 383 bytes in 1048 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:41:31.108601 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-24021e86-d6d3-4be9-9a15-1975e1fe89e5 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:31.114652 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-24021e86-d6d3-4be9-9a15-1975e1fe89e5 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: 2f257e47-8666-45d9-bed4-74cfd7ba8fb1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:31.121726 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-24021e86-d6d3-4be9-9a15-1975e1fe89e5 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:31.122703 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-24021e86-d6d3-4be9-9a15-1975e1fe89e5 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:31.125077 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-24021e86-d6d3-4be9-9a15-1975e1fe89e5 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:31.137609 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-24021e86-d6d3-4be9-9a15-1975e1fe89e5 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:31.137609 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-24021e86-d6d3-4be9-9a15-1975e1fe89e5 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:31.137609 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-24021e86-d6d3-4be9-9a15-1975e1fe89e5 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:31.171860 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-24021e86-d6d3-4be9-9a15-1975e1fe89e5 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: 2f257e47-8666-45d9-bed4-74cfd7ba8fb1] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:41:31.717635 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-24021e86-d6d3-4be9-9a15-1975e1fe89e5 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2f257e47-8666-45d9-bed4-74cfd7ba8fb1" status: 204 len: 0 microversion: 2.1 time: 0.602690 Oct 04 18:41:31.730683 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1667/3286] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:41:31 2022] DELETE /compute/v2.1/servers/2f257e47-8666-45d9-bed4-74cfd7ba8fb1 => generated 0 bytes in 627 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:41:31.777058 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f9e659b8-909e-4f05-ab99-365e4aaedb81 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:31.780483 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f9e659b8-909e-4f05-ab99-365e4aaedb81 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] [instance: 68f2b230-fee6-4a7c-873f-3dfd659b9338] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:31.818625 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f9e659b8-909e-4f05-ab99-365e4aaedb81 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:31.827773 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f9e659b8-909e-4f05-ab99-365e4aaedb81 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:31.828428 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f9e659b8-909e-4f05-ab99-365e4aaedb81 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:31.835150 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f9e659b8-909e-4f05-ab99-365e4aaedb81 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:31.835616 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f9e659b8-909e-4f05-ab99-365e4aaedb81 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:31.847961 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f9e659b8-909e-4f05-ab99-365e4aaedb81 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:32.274587 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f9e659b8-909e-4f05-ab99-365e4aaedb81 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '777a7a51e45b498597f7a1202217575c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b43fba16115404aaa793fb907fd257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:32.290129 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f9e659b8-909e-4f05-ab99-365e4aaedb81 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] 10.222.0.20 "GET /compute/v2.1/servers/68f2b230-fee6-4a7c-873f-3dfd659b9338" status: 200 len: 1316 microversion: 2.1 time: 0.554225 Oct 04 18:41:32.290129 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1668/3287] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:31 2022] GET /compute/v2.1/servers/68f2b230-fee6-4a7c-873f-3dfd659b9338 => generated 1316 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:32.315722 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e68559e5-3992-4ae7-abdd-af3923f8017b tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:32.316366 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e68559e5-3992-4ae7-abdd-af3923f8017b tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] [instance: 0212406a-acc5-4631-90e8-03f4409c07f1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:32.338124 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e68559e5-3992-4ae7-abdd-af3923f8017b tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:32.338599 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e68559e5-3992-4ae7-abdd-af3923f8017b tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:32.339212 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e68559e5-3992-4ae7-abdd-af3923f8017b tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:32.340154 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e68559e5-3992-4ae7-abdd-af3923f8017b tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:32.340794 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e68559e5-3992-4ae7-abdd-af3923f8017b tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:32.341384 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e68559e5-3992-4ae7-abdd-af3923f8017b tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:32.383869 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-a46240aa-b7be-4f50-bbb6-c631319084b7 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] [instance: d016f22c-47ba-47c6-95bd-87ae9cb4816d] Updating instance_info_cache with network_info: [{"id": "2a64b44b-ed16-469b-a145-c17db566df99", "address": "fa:16:3e:49:7c:6c", "network": {"id": "1abca12e-af42-4430-bf6f-473c83612754", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1832648559-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.1.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "08896629a67f488b87a845e57a9ca372", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap2a64b44b-ed", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=123002) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 18:41:32.437472 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-e68559e5-3992-4ae7-abdd-af3923f8017b tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lazy-loading 'services' on Instance uuid 0212406a-acc5-4631-90e8-03f4409c07f1 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:41:32.462131 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e68559e5-3992-4ae7-abdd-af3923f8017b tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1" status: 200 len: 1935 microversion: 2.75 time: 0.150358 Oct 04 18:41:32.463061 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1669/3288] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:41:32 2022] GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1 => generated 1935 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:41:32.468662 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-91eeb74f-c50c-451b-b5e3-3508d3adc0cf tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:32.471060 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-91eeb74f-c50c-451b-b5e3-3508d3adc0cf tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: cd97d817-422a-457d-b653-020350d75d6e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:32.483816 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a46240aa-b7be-4f50-bbb6-c631319084b7 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Releasing lock "refresh_cache-d016f22c-47ba-47c6-95bd-87ae9cb4816d" {{(pid=123002) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 18:41:32.484969 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a46240aa-b7be-4f50-bbb6-c631319084b7 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] 10.222.0.20 "POST /compute/v2.1/servers/d016f22c-47ba-47c6-95bd-87ae9cb4816d/action" status: 202 len: 0 microversion: 2.1 time: 7.468619 Oct 04 18:41:32.486885 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1620/3289] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:41:25 2022] POST /compute/v2.1/servers/d016f22c-47ba-47c6-95bd-87ae9cb4816d/action => generated 0 bytes in 7471 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 04 18:41:32.493048 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-e1d23e90-a34b-403c-9523-eb7c3dfe551f req-3db61800-3462-45b9-8036-4b650c5e57cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d607218c-7a38-4b49-bb51-7e1adfda8c6a", "tag": "a4c07b4b-a6d2-4965-9650-3ce3a87b89ee"}, {"name": "network-changed", "server_uuid": "d016f22c-47ba-47c6-95bd-87ae9cb4816d", "tag": "2a64b44b-ed16-469b-a145-c17db566df99"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:41:32.521633 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-e1d23e90-a34b-403c-9523-eb7c3dfe551f req-3db61800-3462-45b9-8036-4b650c5e57cc service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:32.523301 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-e1d23e90-a34b-403c-9523-eb7c3dfe551f req-3db61800-3462-45b9-8036-4b650c5e57cc service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:32.524662 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-e1d23e90-a34b-403c-9523-eb7c3dfe551f req-3db61800-3462-45b9-8036-4b650c5e57cc service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:32.556541 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-e1d23e90-a34b-403c-9523-eb7c3dfe551f req-3db61800-3462-45b9-8036-4b650c5e57cc service nova] Creating event network-changed:a4c07b4b-a6d2-4965-9650-3ce3a87b89ee for instance d607218c-7a38-4b49-bb51-7e1adfda8c6a on n-h2-850501-14 Oct 04 18:41:32.557347 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-e1d23e90-a34b-403c-9523-eb7c3dfe551f req-3db61800-3462-45b9-8036-4b650c5e57cc service nova] Creating event network-changed:2a64b44b-ed16-469b-a145-c17db566df99 for instance d016f22c-47ba-47c6-95bd-87ae9cb4816d on n-h1-850501-14 Oct 04 18:41:32.560207 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-91eeb74f-c50c-451b-b5e3-3508d3adc0cf tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:32.571626 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-91eeb74f-c50c-451b-b5e3-3508d3adc0cf tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/cd97d817-422a-457d-b653-020350d75d6e" status: 200 len: 1222 microversion: 2.1 time: 0.107231 Oct 04 18:41:32.572692 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1670/3290] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:32 2022] GET /compute/v2.1/servers/cd97d817-422a-457d-b653-020350d75d6e => generated 1222 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:32.582381 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6f61dfba-77f9-4a77-ab5c-58b4fd705ff3 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:32.583286 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6f61dfba-77f9-4a77-ab5c-58b4fd705ff3 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: 2f257e47-8666-45d9-bed4-74cfd7ba8fb1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:32.593665 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-e1d23e90-a34b-403c-9523-eb7c3dfe551f req-3db61800-3462-45b9-8036-4b650c5e57cc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.104769 Oct 04 18:41:32.594717 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1621/3291] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:41:32 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:41:32.602403 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6f61dfba-77f9-4a77-ab5c-58b4fd705ff3 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:32.603258 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6f61dfba-77f9-4a77-ab5c-58b4fd705ff3 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:32.603884 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6f61dfba-77f9-4a77-ab5c-58b4fd705ff3 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:32.605364 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-487b5624-7400-4cd0-a902-3e7eeb5a38c8 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Action: 'action', calling method: .version_select at 0x7fe25ac094c0>, body: {"removeFloatingIp": {"address": "172.25.1.156"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:41:32.605944 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6f61dfba-77f9-4a77-ab5c-58b4fd705ff3 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:32.606579 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6f61dfba-77f9-4a77-ab5c-58b4fd705ff3 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:32.607167 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6f61dfba-77f9-4a77-ab5c-58b4fd705ff3 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:32.886244 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-487b5624-7400-4cd0-a902-3e7eeb5a38c8 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] [instance: d016f22c-47ba-47c6-95bd-87ae9cb4816d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:32.894219 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-487b5624-7400-4cd0-a902-3e7eeb5a38c8 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:32.894718 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-487b5624-7400-4cd0-a902-3e7eeb5a38c8 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:32.900223 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-487b5624-7400-4cd0-a902-3e7eeb5a38c8 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:32.912574 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-487b5624-7400-4cd0-a902-3e7eeb5a38c8 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:32.912574 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-487b5624-7400-4cd0-a902-3e7eeb5a38c8 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:32.912574 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-487b5624-7400-4cd0-a902-3e7eeb5a38c8 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:32.912983 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6f61dfba-77f9-4a77-ab5c-58b4fd705ff3 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8358c07e2684b749a62becb9f0b7869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b922a74c1c2448bb770d6b298b2d601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:32.924096 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6f61dfba-77f9-4a77-ab5c-58b4fd705ff3 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "GET /compute/v2.1/servers/2f257e47-8666-45d9-bed4-74cfd7ba8fb1" status: 200 len: 1468 microversion: 2.1 time: 0.346387 Oct 04 18:41:32.928367 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1671/3292] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:32 2022] GET /compute/v2.1/servers/2f257e47-8666-45d9-bed4-74cfd7ba8fb1 => generated 1468 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:33.319540 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ec751ae3-7111-4a63-8a1e-8e4c44c80cd2 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:33.320641 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ec751ae3-7111-4a63-8a1e-8e4c44c80cd2 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] [instance: 68f2b230-fee6-4a7c-873f-3dfd659b9338] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:33.336252 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec751ae3-7111-4a63-8a1e-8e4c44c80cd2 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:33.344930 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec751ae3-7111-4a63-8a1e-8e4c44c80cd2 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:33.348661 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec751ae3-7111-4a63-8a1e-8e4c44c80cd2 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:33.348661 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec751ae3-7111-4a63-8a1e-8e4c44c80cd2 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:33.348661 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec751ae3-7111-4a63-8a1e-8e4c44c80cd2 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:33.348661 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec751ae3-7111-4a63-8a1e-8e4c44c80cd2 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:33.503642 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-487b5624-7400-4cd0-a902-3e7eeb5a38c8 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] HTTP exception thrown: Floating IP 172.25.1.156 is not associated with instance d607218c-7a38-4b49-bb51-7e1adfda8c6a. Oct 04 18:41:33.507222 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-487b5624-7400-4cd0-a902-3e7eeb5a38c8 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Request method failure captured: Oct 04 18:41:33.507222 n-d-850501-14 devstack@n-api.service[123002]: request: POST /compute/v2.1/servers/d607218c-7a38-4b49-bb51-7e1adfda8c6a/action HTTP/1.1 Oct 04 18:41:33.507222 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:41:33.507222 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:41:33.507222 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:41:33.507222 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 49 Oct 04 18:41:33.507222 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:41:33.507222 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:41:33.507222 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:41:33.507222 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:41:33.507222 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH4eD217yf6XVOFqMlYQXaYJaKqnvBsQYc1Gm8GlDUTsOrLWfVUla_jrp3eQCE2Vn-hL7Y9tBYMzmsxKvz0-UE2mHeJj-S0GIfgH0DbDeBPDhfT6eDtApX7jkCZ7ZFy6Bsz-wcpwxo6DWQJevz--GkP8t12nIjhIN9LIBTkxi_rrYSc Oct 04 18:41:33.507222 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:41:33.507222 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:41:33.507222 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:41:33.507222 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:41:33.507222 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:41:33.507222 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:41:33.507222 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 08896629a67f488b87a845e57a9ca372 Oct 04 18:41:33.507222 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1861553440 Oct 04 18:41:33.507222 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:41:33.507222 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:41:33.507222 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/08896629a67f488b87a845e57a9ca372"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_08896629a67f488b87a845e57a9ca372", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/08896629a67f488b87a845e57a9ca372"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/08896629a67f488b87a845e57a9ca372"}]}] Oct 04 18:41:33.507222 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1861553440 Oct 04 18:41:33.507222 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 08896629a67f488b87a845e57a9ca372 Oct 04 18:41:33.507222 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1861553440 Oct 04 18:41:33.507222 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-FloatingIPsAssociationTestJSON-1861553440-project Oct 04 18:41:33.507222 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:41:33.507222 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:41:33.507222 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: a3499c88686046b8a80bc3a754f016e9 Oct 04 18:41:33.507222 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1861553440-project Oct 04 18:41:33.507222 n-d-850501-14 devstack@n-api.service[123002]: Oct 04 18:41:33.507222 n-d-850501-14 devstack@n-api.service[123002]: {"removeFloatingIp": {"address": "172.25.1.156"}} Oct 04 18:41:33.507222 n-d-850501-14 devstack@n-api.service[123002]: method: Oct 04 18:41:33.507222 n-d-850501-14 devstack@n-api.service[123002]: exception: Floating IP 172.25.1.156 is not associated with instance d607218c-7a38-4b49-bb51-7e1adfda8c6a. Oct 04 18:41:33.507222 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'd607218c-7a38-4b49-bb51-7e1adfda8c6a', 'body': {'removeFloatingIp': {'address': '172.25.1.156'}}} Oct 04 18:41:33.507222 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:41:33.507222 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:33.507222 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:41:33.507222 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:41:33.507222 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:41:33.507222 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:41:33.507222 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:41:33.507222 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:41:33.507222 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:41:33.507222 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:41:33.507222 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:41:33.507222 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:41:33.507222 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Oct 04 18:41:33.507222 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 18:41:33.507222 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.1.156 is not associated with instance d607218c-7a38-4b49-bb51-7e1adfda8c6a. Oct 04 18:41:33.507222 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:41:33.507222 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:33.507222 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:41:33.507222 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:33.507222 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:41:33.507222 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:41:33.507222 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:41:33.507222 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:41:33.507222 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.1.156 is not associated with instance d607218c-7a38-4b49-bb51-7e1adfda8c6a. Oct 04 18:41:33.507222 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:41:33.512035 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-487b5624-7400-4cd0-a902-3e7eeb5a38c8 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Returning 409 to user: Floating IP 172.25.1.156 is not associated with instance d607218c-7a38-4b49-bb51-7e1adfda8c6a. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:41:33.512035 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-487b5624-7400-4cd0-a902-3e7eeb5a38c8 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] 10.222.0.20 "POST /compute/v2.1/servers/d607218c-7a38-4b49-bb51-7e1adfda8c6a/action" status: 409 len: 146 microversion: 2.1 time: 0.912832 Oct 04 18:41:33.512035 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1622/3293] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:41:32 2022] POST /compute/v2.1/servers/d607218c-7a38-4b49-bb51-7e1adfda8c6a/action => generated 146 bytes in 915 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:41:33.524595 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-dbe7be2c-1b40-4dac-886e-1d8350fb88cf tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:33.525794 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-dbe7be2c-1b40-4dac-886e-1d8350fb88cf tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] [instance: 0212406a-acc5-4631-90e8-03f4409c07f1] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:33.534519 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dbe7be2c-1b40-4dac-886e-1d8350fb88cf tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:33.537558 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dbe7be2c-1b40-4dac-886e-1d8350fb88cf tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:33.538648 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dbe7be2c-1b40-4dac-886e-1d8350fb88cf tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:33.539398 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dbe7be2c-1b40-4dac-886e-1d8350fb88cf tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:33.539870 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dbe7be2c-1b40-4dac-886e-1d8350fb88cf tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:33.540333 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dbe7be2c-1b40-4dac-886e-1d8350fb88cf tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:33.708247 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-dbe7be2c-1b40-4dac-886e-1d8350fb88cf tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lazy-loading 'services' on Instance uuid 0212406a-acc5-4631-90e8-03f4409c07f1 {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:41:33.762079 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-dbe7be2c-1b40-4dac-886e-1d8350fb88cf tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1" status: 200 len: 1935 microversion: 2.75 time: 0.247488 Oct 04 18:41:33.762947 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1623/3294] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:41:33 2022] GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1 => generated 1935 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:41:33.774983 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5ada60f4-3900-445e-80bc-5a945c5327c8 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.1.156"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:41:34.001902 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ec751ae3-7111-4a63-8a1e-8e4c44c80cd2 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '777a7a51e45b498597f7a1202217575c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b43fba16115404aaa793fb907fd257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:34.014140 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ec751ae3-7111-4a63-8a1e-8e4c44c80cd2 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] 10.222.0.20 "GET /compute/v2.1/servers/68f2b230-fee6-4a7c-873f-3dfd659b9338" status: 200 len: 1316 microversion: 2.1 time: 0.698979 Oct 04 18:41:34.026353 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1672/3295] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:33 2022] GET /compute/v2.1/servers/68f2b230-fee6-4a7c-873f-3dfd659b9338 => generated 1316 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:41:34.031537 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ab4b3451-0807-44ac-acfb-4cd8567a4d62 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:34.032466 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ab4b3451-0807-44ac-acfb-4cd8567a4d62 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: cd97d817-422a-457d-b653-020350d75d6e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:34.040025 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ab4b3451-0807-44ac-acfb-4cd8567a4d62 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:34.040760 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ab4b3451-0807-44ac-acfb-4cd8567a4d62 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:34.041373 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ab4b3451-0807-44ac-acfb-4cd8567a4d62 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:34.042289 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ab4b3451-0807-44ac-acfb-4cd8567a4d62 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:34.042927 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ab4b3451-0807-44ac-acfb-4cd8567a4d62 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:34.043514 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ab4b3451-0807-44ac-acfb-4cd8567a4d62 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:34.144868 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ab4b3451-0807-44ac-acfb-4cd8567a4d62 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:34.157127 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ab4b3451-0807-44ac-acfb-4cd8567a4d62 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/cd97d817-422a-457d-b653-020350d75d6e" status: 200 len: 1218 microversion: 2.1 time: 0.129181 Oct 04 18:41:34.175626 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1673/3296] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:34 2022] GET /compute/v2.1/servers/cd97d817-422a-457d-b653-020350d75d6e => generated 1218 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:34.191075 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2ba3cdb3-b6a6-4037-b89f-611f894c029b tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:34.192548 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2ba3cdb3-b6a6-4037-b89f-611f894c029b tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: 2f257e47-8666-45d9-bed4-74cfd7ba8fb1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:34.202358 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2ba3cdb3-b6a6-4037-b89f-611f894c029b tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:34.202943 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2ba3cdb3-b6a6-4037-b89f-611f894c029b tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:34.203490 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2ba3cdb3-b6a6-4037-b89f-611f894c029b tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:34.204351 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2ba3cdb3-b6a6-4037-b89f-611f894c029b tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:34.204871 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2ba3cdb3-b6a6-4037-b89f-611f894c029b tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:34.205404 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2ba3cdb3-b6a6-4037-b89f-611f894c029b tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:34.248600 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5ada60f4-3900-445e-80bc-5a945c5327c8 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] [instance: d016f22c-47ba-47c6-95bd-87ae9cb4816d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:34.256451 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5ada60f4-3900-445e-80bc-5a945c5327c8 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:34.256958 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5ada60f4-3900-445e-80bc-5a945c5327c8 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:34.259123 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5ada60f4-3900-445e-80bc-5a945c5327c8 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:34.263487 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5ada60f4-3900-445e-80bc-5a945c5327c8 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:34.263999 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5ada60f4-3900-445e-80bc-5a945c5327c8 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:34.264651 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5ada60f4-3900-445e-80bc-5a945c5327c8 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:34.705499 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-2ba3cdb3-b6a6-4037-b89f-611f894c029b tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8358c07e2684b749a62becb9f0b7869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b922a74c1c2448bb770d6b298b2d601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:34.718646 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2ba3cdb3-b6a6-4037-b89f-611f894c029b tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "GET /compute/v2.1/servers/2f257e47-8666-45d9-bed4-74cfd7ba8fb1" status: 200 len: 1468 microversion: 2.1 time: 0.540673 Oct 04 18:41:34.720735 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1674/3297] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:34 2022] GET /compute/v2.1/servers/2f257e47-8666-45d9-bed4-74cfd7ba8fb1 => generated 1468 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:34.798008 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6a7d5615-11b1-4b4e-b47f-0cc417179ec9 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:34.798634 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6a7d5615-11b1-4b4e-b47f-0cc417179ec9 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] [instance: 0212406a-acc5-4631-90e8-03f4409c07f1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:34.808577 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6a7d5615-11b1-4b4e-b47f-0cc417179ec9 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:34.810714 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6a7d5615-11b1-4b4e-b47f-0cc417179ec9 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:34.811733 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6a7d5615-11b1-4b4e-b47f-0cc417179ec9 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:34.812749 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6a7d5615-11b1-4b4e-b47f-0cc417179ec9 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:34.814281 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6a7d5615-11b1-4b4e-b47f-0cc417179ec9 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:34.829813 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6a7d5615-11b1-4b4e-b47f-0cc417179ec9 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:35.032742 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5ada60f4-3900-445e-80bc-5a945c5327c8 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Acquiring lock "refresh_cache-d016f22c-47ba-47c6-95bd-87ae9cb4816d" {{(pid=123002) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 18:41:35.038374 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5ada60f4-3900-445e-80bc-5a945c5327c8 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Acquired lock "refresh_cache-d016f22c-47ba-47c6-95bd-87ae9cb4816d" {{(pid=123002) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 18:41:35.057492 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-6a7d5615-11b1-4b4e-b47f-0cc417179ec9 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] Lazy-loading 'services' on Instance uuid 0212406a-acc5-4631-90e8-03f4409c07f1 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:41:35.120711 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6a7d5615-11b1-4b4e-b47f-0cc417179ec9 tempest-ServersAdmin275Test-42333398 tempest-ServersAdmin275Test-42333398-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1" status: 200 len: 1920 microversion: 2.75 time: 0.325593 Oct 04 18:41:35.122958 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1675/3298] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:41:34 2022] GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1 => generated 1920 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:41:35.132324 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-905859cb-c2d8-4ac8-8170-ab201c5be077 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:35.133468 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-905859cb-c2d8-4ac8-8170-ab201c5be077 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] [instance: 68f2b230-fee6-4a7c-873f-3dfd659b9338] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:35.162547 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-905859cb-c2d8-4ac8-8170-ab201c5be077 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:35.163380 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-905859cb-c2d8-4ac8-8170-ab201c5be077 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:35.165713 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-905859cb-c2d8-4ac8-8170-ab201c5be077 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:35.168623 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-905859cb-c2d8-4ac8-8170-ab201c5be077 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:35.170364 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-905859cb-c2d8-4ac8-8170-ab201c5be077 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:35.171418 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-905859cb-c2d8-4ac8-8170-ab201c5be077 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:35.596344 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-905859cb-c2d8-4ac8-8170-ab201c5be077 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '777a7a51e45b498597f7a1202217575c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b43fba16115404aaa793fb907fd257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:35.609957 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-905859cb-c2d8-4ac8-8170-ab201c5be077 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] 10.222.0.20 "GET /compute/v2.1/servers/68f2b230-fee6-4a7c-873f-3dfd659b9338" status: 200 len: 1316 microversion: 2.1 time: 0.484979 Oct 04 18:41:35.610553 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1676/3299] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:35 2022] GET /compute/v2.1/servers/68f2b230-fee6-4a7c-873f-3dfd659b9338 => generated 1316 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:35.621928 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7f1b743b-c34e-48ca-8f96-c01f406b3527 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:35.622461 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7f1b743b-c34e-48ca-8f96-c01f406b3527 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] [instance: 0212406a-acc5-4631-90e8-03f4409c07f1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:35.629235 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7f1b743b-c34e-48ca-8f96-c01f406b3527 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:35.629911 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7f1b743b-c34e-48ca-8f96-c01f406b3527 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:35.630545 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7f1b743b-c34e-48ca-8f96-c01f406b3527 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:35.631420 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7f1b743b-c34e-48ca-8f96-c01f406b3527 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:35.632922 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7f1b743b-c34e-48ca-8f96-c01f406b3527 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:35.634060 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7f1b743b-c34e-48ca-8f96-c01f406b3527 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:35.682473 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7f1b743b-c34e-48ca-8f96-c01f406b3527 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] [instance: 0212406a-acc5-4631-90e8-03f4409c07f1] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:41:36.159195 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7f1b743b-c34e-48ca-8f96-c01f406b3527 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1" status: 204 len: 0 microversion: 2.75 time: 0.547342 Oct 04 18:41:36.167986 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1677/3300] 10.222.0.20 () {60 vars in 1280 bytes} [Tue Oct 4 18:41:35 2022] DELETE /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:41:36.169634 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4f423a5b-242d-4829-ba9a-6154b6c40d71 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:36.170427 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-4f423a5b-242d-4829-ba9a-6154b6c40d71 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: cd97d817-422a-457d-b653-020350d75d6e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:36.194132 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4f423a5b-242d-4829-ba9a-6154b6c40d71 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:36.196538 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4f423a5b-242d-4829-ba9a-6154b6c40d71 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:36.196538 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4f423a5b-242d-4829-ba9a-6154b6c40d71 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:36.196538 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4f423a5b-242d-4829-ba9a-6154b6c40d71 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:36.196538 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4f423a5b-242d-4829-ba9a-6154b6c40d71 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:36.196871 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4f423a5b-242d-4829-ba9a-6154b6c40d71 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:36.815112 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-4f423a5b-242d-4829-ba9a-6154b6c40d71 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:36.829155 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-4f423a5b-242d-4829-ba9a-6154b6c40d71 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/cd97d817-422a-457d-b653-020350d75d6e" status: 200 len: 1274 microversion: 2.1 time: 0.663968 Oct 04 18:41:36.833321 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1678/3301] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:36 2022] GET /compute/v2.1/servers/cd97d817-422a-457d-b653-020350d75d6e => generated 1274 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:36.844362 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-9d0fc1f9-bb41-46e4-b671-331c1ad5dcc9 req-a9a77944-2082-4b39-b1aa-48cf94f7147e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68f2b230-fee6-4a7c-873f-3dfd659b9338", "name": "network-vif-plugged", "status": "completed", "tag": "48ff58dc-2007-4baf-8109-1524f9ab9238"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:41:36.869454 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-9d0fc1f9-bb41-46e4-b671-331c1ad5dcc9 req-a9a77944-2082-4b39-b1aa-48cf94f7147e service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:36.870232 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-9d0fc1f9-bb41-46e4-b671-331c1ad5dcc9 req-a9a77944-2082-4b39-b1aa-48cf94f7147e service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:36.870668 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-9d0fc1f9-bb41-46e4-b671-331c1ad5dcc9 req-a9a77944-2082-4b39-b1aa-48cf94f7147e service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:36.890141 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-5ada60f4-3900-445e-80bc-5a945c5327c8 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] [instance: d016f22c-47ba-47c6-95bd-87ae9cb4816d] Building network info cache for instance {{(pid=123002) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 18:41:36.891285 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-9d0fc1f9-bb41-46e4-b671-331c1ad5dcc9 req-a9a77944-2082-4b39-b1aa-48cf94f7147e service nova] Creating event network-vif-plugged:48ff58dc-2007-4baf-8109-1524f9ab9238 for instance 68f2b230-fee6-4a7c-873f-3dfd659b9338 on n-h2-850501-14 Oct 04 18:41:36.907460 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-9d0fc1f9-bb41-46e4-b671-331c1ad5dcc9 req-a9a77944-2082-4b39-b1aa-48cf94f7147e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076074 Oct 04 18:41:36.908836 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1679/3302] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:41:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:41:36.914438 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-fdc1881e-a422-41bd-8294-7c5b7106a2d6 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:36.925926 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-fdc1881e-a422-41bd-8294-7c5b7106a2d6 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: 2f257e47-8666-45d9-bed4-74cfd7ba8fb1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:36.940921 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fdc1881e-a422-41bd-8294-7c5b7106a2d6 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:36.941423 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fdc1881e-a422-41bd-8294-7c5b7106a2d6 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:36.942515 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fdc1881e-a422-41bd-8294-7c5b7106a2d6 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:36.943233 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fdc1881e-a422-41bd-8294-7c5b7106a2d6 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:36.943694 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fdc1881e-a422-41bd-8294-7c5b7106a2d6 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:36.945903 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fdc1881e-a422-41bd-8294-7c5b7106a2d6 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:37.000644 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fdc1881e-a422-41bd-8294-7c5b7106a2d6 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:37.001409 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fdc1881e-a422-41bd-8294-7c5b7106a2d6 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:37.002003 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fdc1881e-a422-41bd-8294-7c5b7106a2d6 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:37.002651 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-fdc1881e-a422-41bd-8294-7c5b7106a2d6 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lazy-loading 'fault' on Instance uuid 2f257e47-8666-45d9-bed4-74cfd7ba8fb1 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:41:37.148731 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-fdc1881e-a422-41bd-8294-7c5b7106a2d6 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8358c07e2684b749a62becb9f0b7869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b922a74c1c2448bb770d6b298b2d601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:37.151178 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:41:37.170740 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-fdc1881e-a422-41bd-8294-7c5b7106a2d6 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "GET /compute/v2.1/servers/2f257e47-8666-45d9-bed4-74cfd7ba8fb1" status: 200 len: 1303 microversion: 2.1 time: 0.260320 Oct 04 18:41:37.187761 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1680/3303] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:36 2022] GET /compute/v2.1/servers/2f257e47-8666-45d9-bed4-74cfd7ba8fb1 => generated 1303 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:37.187761 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b0cc5b24-40e2-42db-bf72-cec06cc1cd72 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:37.187761 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b0cc5b24-40e2-42db-bf72-cec06cc1cd72 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] [instance: 0212406a-acc5-4631-90e8-03f4409c07f1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:37.196896 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b0cc5b24-40e2-42db-bf72-cec06cc1cd72 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:37.200652 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b0cc5b24-40e2-42db-bf72-cec06cc1cd72 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:37.200652 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b0cc5b24-40e2-42db-bf72-cec06cc1cd72 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:37.200652 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b0cc5b24-40e2-42db-bf72-cec06cc1cd72 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:37.200652 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b0cc5b24-40e2-42db-bf72-cec06cc1cd72 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:37.200652 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b0cc5b24-40e2-42db-bf72-cec06cc1cd72 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:37.318833 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b0cc5b24-40e2-42db-bf72-cec06cc1cd72 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:37.329688 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b0cc5b24-40e2-42db-bf72-cec06cc1cd72 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:37.334477 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b0cc5b24-40e2-42db-bf72-cec06cc1cd72 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:37.343410 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b0cc5b24-40e2-42db-bf72-cec06cc1cd72 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] 10.222.0.20 "GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1" status: 200 len: 1443 microversion: 2.75 time: 0.168489 Oct 04 18:41:37.345503 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1681/3304] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:41:37 2022] GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1 => generated 1443 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:41:37.351424 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-4530526b-fe36-4dbd-b55b-18052fca7c8f req-8f945f7c-7570-40c6-83ab-f94c68cbaa42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f257e47-8666-45d9-bed4-74cfd7ba8fb1", "name": "network-vif-deleted", "tag": "6e3ada66-c43a-4281-9159-5a8283bd2060"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:41:37.384379 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-4530526b-fe36-4dbd-b55b-18052fca7c8f req-8f945f7c-7570-40c6-83ab-f94c68cbaa42 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:37.385784 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-4530526b-fe36-4dbd-b55b-18052fca7c8f req-8f945f7c-7570-40c6-83ab-f94c68cbaa42 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:37.386868 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-4530526b-fe36-4dbd-b55b-18052fca7c8f req-8f945f7c-7570-40c6-83ab-f94c68cbaa42 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:37.409446 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-4530526b-fe36-4dbd-b55b-18052fca7c8f req-8f945f7c-7570-40c6-83ab-f94c68cbaa42 service nova] Creating event network-vif-deleted:6e3ada66-c43a-4281-9159-5a8283bd2060 for instance 2f257e47-8666-45d9-bed4-74cfd7ba8fb1 on n-h2-850501-14 Oct 04 18:41:37.416035 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-4530526b-fe36-4dbd-b55b-18052fca7c8f req-8f945f7c-7570-40c6-83ab-f94c68cbaa42 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069098 Oct 04 18:41:37.417560 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1682/3305] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:41:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:41:37.424459 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b82bf6ab-96c5-4541-92c2-53aadbcb9f7a tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:37.427183 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b82bf6ab-96c5-4541-92c2-53aadbcb9f7a tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] [instance: 68f2b230-fee6-4a7c-873f-3dfd659b9338] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:37.438660 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b82bf6ab-96c5-4541-92c2-53aadbcb9f7a tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:37.439420 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b82bf6ab-96c5-4541-92c2-53aadbcb9f7a tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:37.440383 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b82bf6ab-96c5-4541-92c2-53aadbcb9f7a tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:37.455827 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b82bf6ab-96c5-4541-92c2-53aadbcb9f7a tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:37.456520 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b82bf6ab-96c5-4541-92c2-53aadbcb9f7a tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:37.458253 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b82bf6ab-96c5-4541-92c2-53aadbcb9f7a tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:37.778652 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b82bf6ab-96c5-4541-92c2-53aadbcb9f7a tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '777a7a51e45b498597f7a1202217575c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b43fba16115404aaa793fb907fd257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:37.787884 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b82bf6ab-96c5-4541-92c2-53aadbcb9f7a tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] 10.222.0.20 "GET /compute/v2.1/servers/68f2b230-fee6-4a7c-873f-3dfd659b9338" status: 200 len: 1316 microversion: 2.1 time: 0.368807 Oct 04 18:41:37.803891 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1683/3306] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:37 2022] GET /compute/v2.1/servers/68f2b230-fee6-4a7c-873f-3dfd659b9338 => generated 1316 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:37.810440 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-af2f2ac9-414d-4385-b8a7-33d3c5d75215 req-7733bc96-489f-487a-b05a-a8a46186bf2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d016f22c-47ba-47c6-95bd-87ae9cb4816d", "tag": "2a64b44b-ed16-469b-a145-c17db566df99"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:41:37.822546 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-af2f2ac9-414d-4385-b8a7-33d3c5d75215 req-7733bc96-489f-487a-b05a-a8a46186bf2c service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:37.823334 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-af2f2ac9-414d-4385-b8a7-33d3c5d75215 req-7733bc96-489f-487a-b05a-a8a46186bf2c service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:37.823974 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-af2f2ac9-414d-4385-b8a7-33d3c5d75215 req-7733bc96-489f-487a-b05a-a8a46186bf2c service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:37.836823 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-af2f2ac9-414d-4385-b8a7-33d3c5d75215 req-7733bc96-489f-487a-b05a-a8a46186bf2c service nova] Creating event network-changed:2a64b44b-ed16-469b-a145-c17db566df99 for instance d016f22c-47ba-47c6-95bd-87ae9cb4816d on n-h1-850501-14 Oct 04 18:41:37.842799 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-af2f2ac9-414d-4385-b8a7-33d3c5d75215 req-7733bc96-489f-487a-b05a-a8a46186bf2c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037297 Oct 04 18:41:37.844147 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1684/3307] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:41:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:41:37.871121 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-07d0f924-741a-4d2e-a824-c03bde218886 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:37.873625 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-07d0f924-741a-4d2e-a824-c03bde218886 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: cd97d817-422a-457d-b653-020350d75d6e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:37.884138 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-07d0f924-741a-4d2e-a824-c03bde218886 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:37.885627 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-07d0f924-741a-4d2e-a824-c03bde218886 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:37.886368 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-07d0f924-741a-4d2e-a824-c03bde218886 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:37.887431 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-07d0f924-741a-4d2e-a824-c03bde218886 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:37.888120 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-07d0f924-741a-4d2e-a824-c03bde218886 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:37.891376 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-07d0f924-741a-4d2e-a824-c03bde218886 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:37.951891 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-5ada60f4-3900-445e-80bc-5a945c5327c8 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] [instance: d016f22c-47ba-47c6-95bd-87ae9cb4816d] Updating instance_info_cache with network_info: [{"id": "2a64b44b-ed16-469b-a145-c17db566df99", "address": "fa:16:3e:49:7c:6c", "network": {"id": "1abca12e-af42-4430-bf6f-473c83612754", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1832648559-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "08896629a67f488b87a845e57a9ca372", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap2a64b44b-ed", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=123002) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 18:41:37.962062 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=4,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=3,nova_cell1:RELEASE=3 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:41:37.970684 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-07d0f924-741a-4d2e-a824-c03bde218886 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:37.981233 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-07d0f924-741a-4d2e-a824-c03bde218886 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/cd97d817-422a-457d-b653-020350d75d6e" status: 200 len: 1280 microversion: 2.1 time: 0.126632 Oct 04 18:41:37.982028 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1685/3308] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:37 2022] GET /compute/v2.1/servers/cd97d817-422a-457d-b653-020350d75d6e => generated 1280 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:38.037869 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5ada60f4-3900-445e-80bc-5a945c5327c8 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Releasing lock "refresh_cache-d016f22c-47ba-47c6-95bd-87ae9cb4816d" {{(pid=123002) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 18:41:38.039281 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5ada60f4-3900-445e-80bc-5a945c5327c8 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] 10.222.0.20 "POST /compute/v2.1/servers/d016f22c-47ba-47c6-95bd-87ae9cb4816d/action" status: 202 len: 0 microversion: 2.1 time: 4.275095 Oct 04 18:41:38.039966 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1624/3309] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:41:33 2022] POST /compute/v2.1/servers/d016f22c-47ba-47c6-95bd-87ae9cb4816d/action => generated 0 bytes in 4276 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 04 18:41:38.049574 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-62256033-0835-4443-b470-798774a270eb tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:38.050031 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-62256033-0835-4443-b470-798774a270eb tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] [instance: d016f22c-47ba-47c6-95bd-87ae9cb4816d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:38.057017 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-62256033-0835-4443-b470-798774a270eb tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:38.057502 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-62256033-0835-4443-b470-798774a270eb tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:38.057980 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-62256033-0835-4443-b470-798774a270eb tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:38.058850 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-62256033-0835-4443-b470-798774a270eb tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:38.059418 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-62256033-0835-4443-b470-798774a270eb tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:38.059842 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-62256033-0835-4443-b470-798774a270eb tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:38.090470 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-62256033-0835-4443-b470-798774a270eb tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] [instance: d016f22c-47ba-47c6-95bd-87ae9cb4816d] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:41:38.196339 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a79168a0-ae70-4d88-9173-db42b5fac4d9 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:38.196964 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a79168a0-ae70-4d88-9173-db42b5fac4d9 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: 2f257e47-8666-45d9-bed4-74cfd7ba8fb1] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:38.204650 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a79168a0-ae70-4d88-9173-db42b5fac4d9 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:38.205142 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a79168a0-ae70-4d88-9173-db42b5fac4d9 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:38.205577 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a79168a0-ae70-4d88-9173-db42b5fac4d9 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:38.206273 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a79168a0-ae70-4d88-9173-db42b5fac4d9 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:38.206731 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a79168a0-ae70-4d88-9173-db42b5fac4d9 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:38.207508 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a79168a0-ae70-4d88-9173-db42b5fac4d9 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:38.247421 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a79168a0-ae70-4d88-9173-db42b5fac4d9 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:38.247995 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a79168a0-ae70-4d88-9173-db42b5fac4d9 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:38.248531 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a79168a0-ae70-4d88-9173-db42b5fac4d9 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:38.249069 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-a79168a0-ae70-4d88-9173-db42b5fac4d9 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lazy-loading 'fault' on Instance uuid 2f257e47-8666-45d9-bed4-74cfd7ba8fb1 {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:41:38.331630 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a79168a0-ae70-4d88-9173-db42b5fac4d9 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8358c07e2684b749a62becb9f0b7869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b922a74c1c2448bb770d6b298b2d601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:38.341144 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a79168a0-ae70-4d88-9173-db42b5fac4d9 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "GET /compute/v2.1/servers/2f257e47-8666-45d9-bed4-74cfd7ba8fb1" status: 200 len: 1303 microversion: 2.1 time: 0.148504 Oct 04 18:41:38.342090 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1625/3310] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:38 2022] GET /compute/v2.1/servers/2f257e47-8666-45d9-bed4-74cfd7ba8fb1 => generated 1303 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:38.382778 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-eb12279a-dd86-41a0-9c54-3ba3065dd776 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:38.383496 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-eb12279a-dd86-41a0-9c54-3ba3065dd776 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] [instance: 0212406a-acc5-4631-90e8-03f4409c07f1] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:38.396605 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eb12279a-dd86-41a0-9c54-3ba3065dd776 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:38.397099 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eb12279a-dd86-41a0-9c54-3ba3065dd776 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:38.397725 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eb12279a-dd86-41a0-9c54-3ba3065dd776 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:38.403648 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eb12279a-dd86-41a0-9c54-3ba3065dd776 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:38.403648 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eb12279a-dd86-41a0-9c54-3ba3065dd776 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:38.403648 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eb12279a-dd86-41a0-9c54-3ba3065dd776 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:38.443629 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-62256033-0835-4443-b470-798774a270eb tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d016f22c-47ba-47c6-95bd-87ae9cb4816d" status: 204 len: 0 microversion: 2.1 time: 0.396240 Oct 04 18:41:38.447837 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1686/3311] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:41:38 2022] DELETE /compute/v2.1/servers/d016f22c-47ba-47c6-95bd-87ae9cb4816d => generated 0 bytes in 402 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:41:38.469528 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-aa23d991-7c56-47c4-ad1e-f549e6d07d45 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Action: 'action', calling method: .version_select at 0x7fe25ac55d30>, body: {"addFloatingIp": {"address": "172.25.1.156"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:41:38.471793 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eb12279a-dd86-41a0-9c54-3ba3065dd776 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:38.472798 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eb12279a-dd86-41a0-9c54-3ba3065dd776 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:38.474307 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eb12279a-dd86-41a0-9c54-3ba3065dd776 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:38.475276 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-eb12279a-dd86-41a0-9c54-3ba3065dd776 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lazy-loading 'fault' on Instance uuid 0212406a-acc5-4631-90e8-03f4409c07f1 {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:41:38.479605 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-aa23d991-7c56-47c4-ad1e-f549e6d07d45 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] [instance: d607218c-7a38-4b49-bb51-7e1adfda8c6a] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:38.488412 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aa23d991-7c56-47c4-ad1e-f549e6d07d45 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:38.489082 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aa23d991-7c56-47c4-ad1e-f549e6d07d45 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:38.489778 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aa23d991-7c56-47c4-ad1e-f549e6d07d45 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:38.490800 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aa23d991-7c56-47c4-ad1e-f549e6d07d45 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:38.491366 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aa23d991-7c56-47c4-ad1e-f549e6d07d45 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:38.492558 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aa23d991-7c56-47c4-ad1e-f549e6d07d45 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:38.536325 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aa23d991-7c56-47c4-ad1e-f549e6d07d45 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Acquiring lock "refresh_cache-d607218c-7a38-4b49-bb51-7e1adfda8c6a" {{(pid=123001) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 18:41:38.540819 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aa23d991-7c56-47c4-ad1e-f549e6d07d45 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Acquired lock "refresh_cache-d607218c-7a38-4b49-bb51-7e1adfda8c6a" {{(pid=123001) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 18:41:38.547062 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-eb12279a-dd86-41a0-9c54-3ba3065dd776 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:38.557138 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-eb12279a-dd86-41a0-9c54-3ba3065dd776 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:38.558594 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-eb12279a-dd86-41a0-9c54-3ba3065dd776 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:38.570037 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-eb12279a-dd86-41a0-9c54-3ba3065dd776 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] 10.222.0.20 "GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1" status: 200 len: 1448 microversion: 2.75 time: 0.198095 Oct 04 18:41:38.571239 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1626/3312] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:41:38 2022] GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1 => generated 1448 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:41:38.821560 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-cf2a3ff9-7a15-4626-87fc-a7a4540c49c0 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:38.821560 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-cf2a3ff9-7a15-4626-87fc-a7a4540c49c0 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] [instance: 68f2b230-fee6-4a7c-873f-3dfd659b9338] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:38.846195 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cf2a3ff9-7a15-4626-87fc-a7a4540c49c0 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:38.846824 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cf2a3ff9-7a15-4626-87fc-a7a4540c49c0 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:38.848753 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cf2a3ff9-7a15-4626-87fc-a7a4540c49c0 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:38.853056 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cf2a3ff9-7a15-4626-87fc-a7a4540c49c0 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:38.853655 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cf2a3ff9-7a15-4626-87fc-a7a4540c49c0 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:38.854176 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cf2a3ff9-7a15-4626-87fc-a7a4540c49c0 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:39.277658 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-cf2a3ff9-7a15-4626-87fc-a7a4540c49c0 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '777a7a51e45b498597f7a1202217575c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b43fba16115404aaa793fb907fd257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:39.291526 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-cf2a3ff9-7a15-4626-87fc-a7a4540c49c0 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] 10.222.0.20 "GET /compute/v2.1/servers/68f2b230-fee6-4a7c-873f-3dfd659b9338" status: 200 len: 1316 microversion: 2.1 time: 0.477990 Oct 04 18:41:39.292247 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1627/3313] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:38 2022] GET /compute/v2.1/servers/68f2b230-fee6-4a7c-873f-3dfd659b9338 => generated 1316 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:39.297849 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f7552990-049b-47e1-a9c7-26bea5446333 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:39.298793 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f7552990-049b-47e1-a9c7-26bea5446333 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: cd97d817-422a-457d-b653-020350d75d6e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:39.305637 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f7552990-049b-47e1-a9c7-26bea5446333 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:39.306437 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f7552990-049b-47e1-a9c7-26bea5446333 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:39.307100 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f7552990-049b-47e1-a9c7-26bea5446333 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:39.308007 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f7552990-049b-47e1-a9c7-26bea5446333 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:39.308873 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f7552990-049b-47e1-a9c7-26bea5446333 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:39.309720 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f7552990-049b-47e1-a9c7-26bea5446333 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:39.419867 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f7552990-049b-47e1-a9c7-26bea5446333 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:39.441004 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f7552990-049b-47e1-a9c7-26bea5446333 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/cd97d817-422a-457d-b653-020350d75d6e" status: 200 len: 1280 microversion: 2.1 time: 0.147043 Oct 04 18:41:39.455701 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1628/3314] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:39 2022] GET /compute/v2.1/servers/cd97d817-422a-457d-b653-020350d75d6e => generated 1280 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:39.455701 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-31ed7266-4932-4524-b639-b064c065771f tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:39.456156 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-31ed7266-4932-4524-b639-b064c065771f tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: 2f257e47-8666-45d9-bed4-74cfd7ba8fb1] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:39.478581 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-31ed7266-4932-4524-b639-b064c065771f tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:39.479390 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-31ed7266-4932-4524-b639-b064c065771f tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:39.480011 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-31ed7266-4932-4524-b639-b064c065771f tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:39.481911 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-31ed7266-4932-4524-b639-b064c065771f tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:39.482542 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-31ed7266-4932-4524-b639-b064c065771f tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:39.483129 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-31ed7266-4932-4524-b639-b064c065771f tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:39.506652 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-31ed7266-4932-4524-b639-b064c065771f tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] HTTP exception thrown: Instance 2f257e47-8666-45d9-bed4-74cfd7ba8fb1 could not be found. Oct 04 18:41:39.508810 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-31ed7266-4932-4524-b639-b064c065771f tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Request method failure captured: Oct 04 18:41:39.508810 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/2f257e47-8666-45d9-bed4-74cfd7ba8fb1 HTTP/1.1 Oct 04 18:41:39.508810 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:41:39.508810 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:41:39.508810 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:41:39.508810 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:41:39.508810 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:41:39.508810 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:41:39.508810 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:41:39.508810 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:41:39.508810 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH28pWgq0vOErzfC7Utt0mYTSgOSBv5Y6XwhiyVoauurkgk6KDh8rcG2uOicnp5bqMf1W86RGvXQS6fw10-IgR3JaYUpJKH0HqGff9t7-mtAaL_Q_w5ct4n-gkBuMiWeH5HoxDBz8hxw2NCitfnt35jPqr9GEYzX-ldDn9HisVhsMSw Oct 04 18:41:39.508810 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:41:39.508810 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:41:39.508810 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:41:39.508810 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:41:39.508810 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:41:39.508810 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:41:39.508810 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 1b922a74c1c2448bb770d6b298b2d601 Oct 04 18:41:39.508810 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServersAdminTestJSON-2129699344 Oct 04 18:41:39.508810 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:41:39.508810 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:41:39.508810 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1b922a74c1c2448bb770d6b298b2d601"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1b922a74c1c2448bb770d6b298b2d601", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1b922a74c1c2448bb770d6b298b2d601"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1b922a74c1c2448bb770d6b298b2d601"}]}] Oct 04 18:41:39.508810 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServersAdminTestJSON-2129699344 Oct 04 18:41:39.508810 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 1b922a74c1c2448bb770d6b298b2d601 Oct 04 18:41:39.508810 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServersAdminTestJSON-2129699344 Oct 04 18:41:39.508810 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServersAdminTestJSON-2129699344-project Oct 04 18:41:39.508810 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:41:39.508810 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:41:39.508810 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: f8358c07e2684b749a62becb9f0b7869 Oct 04 18:41:39.508810 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServersAdminTestJSON-2129699344-project Oct 04 18:41:39.508810 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:41:39.508810 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 2f257e47-8666-45d9-bed4-74cfd7ba8fb1 could not be found. Oct 04 18:41:39.508810 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '2f257e47-8666-45d9-bed4-74cfd7ba8fb1'} Oct 04 18:41:39.508810 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:41:39.508810 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:39.508810 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:41:39.508810 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:41:39.508810 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:41:39.508810 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:41:39.508810 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:41:39.508810 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:41:39.508810 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:41:39.508810 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:41:39.508810 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f257e47-8666-45d9-bed4-74cfd7ba8fb1 could not be found. Oct 04 18:41:39.508810 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:41:39.508810 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:39.508810 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:41:39.508810 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:39.508810 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:41:39.508810 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:41:39.508810 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:41:39.508810 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:41:39.508810 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:41:39.508810 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:41:39.508810 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:41:39.508810 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:41:39.508810 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:41:39.508810 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:41:39.508810 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:41:39.508810 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:41:39.508810 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f257e47-8666-45d9-bed4-74cfd7ba8fb1 could not be found. Oct 04 18:41:39.508810 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:41:39.508810 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:39.508810 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:41:39.514119 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:39.514119 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:41:39.514119 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:41:39.514119 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:41:39.514119 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:41:39.514119 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f257e47-8666-45d9-bed4-74cfd7ba8fb1 could not be found. Oct 04 18:41:39.514119 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:41:39.517368 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-31ed7266-4932-4524-b639-b064c065771f tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Returning 404 to user: Instance 2f257e47-8666-45d9-bed4-74cfd7ba8fb1 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:41:39.521288 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-31ed7266-4932-4524-b639-b064c065771f tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "GET /compute/v2.1/servers/2f257e47-8666-45d9-bed4-74cfd7ba8fb1" status: 404 len: 111 microversion: 2.1 time: 0.073221 Oct 04 18:41:39.522561 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1629/3315] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:39 2022] GET /compute/v2.1/servers/2f257e47-8666-45d9-bed4-74cfd7ba8fb1 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:41:39.533761 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d12cf4ce-2e2a-43df-bf80-8af4278bda4b tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:39.534906 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d12cf4ce-2e2a-43df-bf80-8af4278bda4b tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: b4ccd5ac-9465-43d8-9a5f-127152966ce8] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:39.573048 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d12cf4ce-2e2a-43df-bf80-8af4278bda4b tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:39.573901 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d12cf4ce-2e2a-43df-bf80-8af4278bda4b tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:39.575607 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d12cf4ce-2e2a-43df-bf80-8af4278bda4b tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:39.579968 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d12cf4ce-2e2a-43df-bf80-8af4278bda4b tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:39.585040 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d12cf4ce-2e2a-43df-bf80-8af4278bda4b tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:39.585719 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d12cf4ce-2e2a-43df-bf80-8af4278bda4b tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:39.653806 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d12cf4ce-2e2a-43df-bf80-8af4278bda4b tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: b4ccd5ac-9465-43d8-9a5f-127152966ce8] Going to try to terminate instance {{(pid=123002) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:41:40.135527 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d12cf4ce-2e2a-43df-bf80-8af4278bda4b tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b4ccd5ac-9465-43d8-9a5f-127152966ce8" status: 204 len: 0 microversion: 2.1 time: 0.606762 Oct 04 18:41:40.138265 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1630/3316] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:41:39 2022] DELETE /compute/v2.1/servers/b4ccd5ac-9465-43d8-9a5f-127152966ce8 => generated 0 bytes in 609 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:41:40.142235 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b25a3abf-bee1-4f07-85c5-462dfde7d510 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:40.143087 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b25a3abf-bee1-4f07-85c5-462dfde7d510 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] [instance: 0212406a-acc5-4631-90e8-03f4409c07f1] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:40.157373 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b25a3abf-bee1-4f07-85c5-462dfde7d510 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:40.157883 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b25a3abf-bee1-4f07-85c5-462dfde7d510 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:40.158315 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b25a3abf-bee1-4f07-85c5-462dfde7d510 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:40.161545 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b25a3abf-bee1-4f07-85c5-462dfde7d510 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:40.169800 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b25a3abf-bee1-4f07-85c5-462dfde7d510 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:40.170293 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b25a3abf-bee1-4f07-85c5-462dfde7d510 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:40.217275 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b25a3abf-bee1-4f07-85c5-462dfde7d510 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:40.218772 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b25a3abf-bee1-4f07-85c5-462dfde7d510 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:40.219501 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b25a3abf-bee1-4f07-85c5-462dfde7d510 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:40.220208 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-b25a3abf-bee1-4f07-85c5-462dfde7d510 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lazy-loading 'fault' on Instance uuid 0212406a-acc5-4631-90e8-03f4409c07f1 {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:41:40.408724 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b25a3abf-bee1-4f07-85c5-462dfde7d510 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:40.422243 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b25a3abf-bee1-4f07-85c5-462dfde7d510 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:40.424575 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b25a3abf-bee1-4f07-85c5-462dfde7d510 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88c151db7fb4ec0a92ca0e655c0d85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71340ee8abbf4244a72d7d31ff1134dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:40.432735 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b25a3abf-bee1-4f07-85c5-462dfde7d510 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] 10.222.0.20 "GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1" status: 200 len: 1448 microversion: 2.75 time: 0.295239 Oct 04 18:41:40.434570 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1631/3317] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:41:40 2022] GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1 => generated 1448 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:41:40.443963 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1d4e8a5c-f903-4d22-998f-7fb413b6dcbe tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:40.445244 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1d4e8a5c-f903-4d22-998f-7fb413b6dcbe tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: b4ccd5ac-9465-43d8-9a5f-127152966ce8] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:40.454458 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1d4e8a5c-f903-4d22-998f-7fb413b6dcbe tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:40.455919 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1d4e8a5c-f903-4d22-998f-7fb413b6dcbe tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:40.456618 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1d4e8a5c-f903-4d22-998f-7fb413b6dcbe tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:40.459105 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1d4e8a5c-f903-4d22-998f-7fb413b6dcbe tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:40.460550 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1d4e8a5c-f903-4d22-998f-7fb413b6dcbe tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:40.461773 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1d4e8a5c-f903-4d22-998f-7fb413b6dcbe tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:40.887061 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=4 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:41:41.446236 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1d4e8a5c-f903-4d22-998f-7fb413b6dcbe tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8358c07e2684b749a62becb9f0b7869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b922a74c1c2448bb770d6b298b2d601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:41.475295 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1d4e8a5c-f903-4d22-998f-7fb413b6dcbe tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "GET /compute/v2.1/servers/b4ccd5ac-9465-43d8-9a5f-127152966ce8" status: 200 len: 1468 microversion: 2.1 time: 1.039266 Oct 04 18:41:41.477122 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1632/3318] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:40 2022] GET /compute/v2.1/servers/b4ccd5ac-9465-43d8-9a5f-127152966ce8 => generated 1468 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:41.606787 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0b8215c4-16a1-4504-8526-c7fbfb6d6e6e tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-859873506", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": [{"uuid": "ea7ea2b5-3fb7-4eeb-8ba9-cbc81d7265bf"}]}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:41:41.719382 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-0b8215c4-16a1-4504-8526-c7fbfb6d6e6e tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] validate_networks() for [('ea7ea2b5-3fb7-4eeb-8ba9-cbc81d7265bf', None, None, None, None, None)] {{(pid=123002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:41:42.010205 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.neutron [None req-aa23d991-7c56-47c4-ad1e-f549e6d07d45 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] [instance: d607218c-7a38-4b49-bb51-7e1adfda8c6a] Building network info cache for instance {{(pid=123001) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 18:41:42.567038 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=24 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:41:43.179882 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-0b8215c4-16a1-4504-8526-c7fbfb6d6e6e tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:41:43.181347 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-0b8215c4-16a1-4504-8526-c7fbfb6d6e6e tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:41:43.182385 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-0b8215c4-16a1-4504-8526-c7fbfb6d6e6e tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:41:43.183307 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-0b8215c4-16a1-4504-8526-c7fbfb6d6e6e tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:41:43.184389 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-0b8215c4-16a1-4504-8526-c7fbfb6d6e6e tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:41:43.211376 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0b8215c4-16a1-4504-8526-c7fbfb6d6e6e tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:43.212791 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0b8215c4-16a1-4504-8526-c7fbfb6d6e6e tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:43.213436 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0b8215c4-16a1-4504-8526-c7fbfb6d6e6e tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:43.214566 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0b8215c4-16a1-4504-8526-c7fbfb6d6e6e tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:43.215338 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0b8215c4-16a1-4504-8526-c7fbfb6d6e6e tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:43.216586 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0b8215c4-16a1-4504-8526-c7fbfb6d6e6e tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:43.241134 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-0b8215c4-16a1-4504-8526-c7fbfb6d6e6e tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Getting quotas for project a9046b9540144eeba512d79438635ea8. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:41:43.255046 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-0b8215c4-16a1-4504-8526-c7fbfb6d6e6e tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Getting quotas for user 8a6c3725b31449d5bf1ff757ff66c8d7 and project a9046b9540144eeba512d79438635ea8. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:41:43.272379 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0b8215c4-16a1-4504-8526-c7fbfb6d6e6e tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Going to run 1 instances... {{(pid=123002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:41:43.275383 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0b8215c4-16a1-4504-8526-c7fbfb6d6e6e tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 92b36041-4d94-4ae6-b0cd-e51306a17de0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:41:43.479625 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0b8215c4-16a1-4504-8526-c7fbfb6d6e6e tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.001130 Oct 04 18:41:43.489674 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1633/3319] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:41:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 2012 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:41:43.500628 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f397dd96-1500-49d8-a61f-c6c95140b18e tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:43.503639 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f397dd96-1500-49d8-a61f-c6c95140b18e tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] [instance: 68f2b230-fee6-4a7c-873f-3dfd659b9338] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:43.517086 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f397dd96-1500-49d8-a61f-c6c95140b18e tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:43.517786 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f397dd96-1500-49d8-a61f-c6c95140b18e tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:43.518670 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f397dd96-1500-49d8-a61f-c6c95140b18e tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:43.521880 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f397dd96-1500-49d8-a61f-c6c95140b18e tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:43.523217 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f397dd96-1500-49d8-a61f-c6c95140b18e tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:43.523819 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f397dd96-1500-49d8-a61f-c6c95140b18e tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:44.443451 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f397dd96-1500-49d8-a61f-c6c95140b18e tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '777a7a51e45b498597f7a1202217575c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b43fba16115404aaa793fb907fd257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:44.446007 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.neutron [None req-aa23d991-7c56-47c4-ad1e-f549e6d07d45 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] [instance: d607218c-7a38-4b49-bb51-7e1adfda8c6a] Updating instance_info_cache with network_info: [{"id": "a4c07b4b-a6d2-4965-9650-3ce3a87b89ee", "address": "fa:16:3e:43:0e:5b", "network": {"id": "1abca12e-af42-4430-bf6f-473c83612754", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1832648559-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.1.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "08896629a67f488b87a845e57a9ca372", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa4c07b4b-a6", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=123001) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 18:41:44.459143 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f397dd96-1500-49d8-a61f-c6c95140b18e tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] 10.222.0.20 "GET /compute/v2.1/servers/68f2b230-fee6-4a7c-873f-3dfd659b9338" status: 200 len: 1503 microversion: 2.1 time: 0.968112 Oct 04 18:41:44.460612 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1634/3320] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:43 2022] GET /compute/v2.1/servers/68f2b230-fee6-4a7c-873f-3dfd659b9338 => generated 1503 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:44.479914 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f6757391-0e5d-46d2-879d-503da5de019e tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:44.480672 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f6757391-0e5d-46d2-879d-503da5de019e tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: cd97d817-422a-457d-b653-020350d75d6e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:44.487096 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f6757391-0e5d-46d2-879d-503da5de019e tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:44.493850 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f6757391-0e5d-46d2-879d-503da5de019e tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:44.494484 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f6757391-0e5d-46d2-879d-503da5de019e tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:44.495326 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f6757391-0e5d-46d2-879d-503da5de019e tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:44.495871 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f6757391-0e5d-46d2-879d-503da5de019e tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:44.496641 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f6757391-0e5d-46d2-879d-503da5de019e tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:44.629761 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aa23d991-7c56-47c4-ad1e-f549e6d07d45 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Releasing lock "refresh_cache-d607218c-7a38-4b49-bb51-7e1adfda8c6a" {{(pid=123001) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 18:41:44.630747 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-aa23d991-7c56-47c4-ad1e-f549e6d07d45 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] 10.222.0.20 "POST /compute/v2.1/servers/d607218c-7a38-4b49-bb51-7e1adfda8c6a/action" status: 202 len: 0 microversion: 2.1 time: 6.174752 Oct 04 18:41:44.631285 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1687/3321] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:41:38 2022] POST /compute/v2.1/servers/d607218c-7a38-4b49-bb51-7e1adfda8c6a/action => generated 0 bytes in 6176 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 04 18:41:44.638684 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-9f038b07-00ef-4794-b225-79395dc1b9df req-ec44ae22-b017-49bd-bf8d-ddb6d67110bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af46589b-8af1-4394-86e3-631c7d483a12", "tag": "a7154b01-bcf4-44c5-b892-758fe0c61242"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:41:44.663009 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-9f038b07-00ef-4794-b225-79395dc1b9df req-ec44ae22-b017-49bd-bf8d-ddb6d67110bb service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:44.663507 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-9f038b07-00ef-4794-b225-79395dc1b9df req-ec44ae22-b017-49bd-bf8d-ddb6d67110bb service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:44.664486 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-9f038b07-00ef-4794-b225-79395dc1b9df req-ec44ae22-b017-49bd-bf8d-ddb6d67110bb service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:44.698635 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-9f038b07-00ef-4794-b225-79395dc1b9df req-ec44ae22-b017-49bd-bf8d-ddb6d67110bb service nova] Creating event network-changed:a7154b01-bcf4-44c5-b892-758fe0c61242 for instance af46589b-8af1-4394-86e3-631c7d483a12 on n-h2-850501-14 Oct 04 18:41:44.704194 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-9f038b07-00ef-4794-b225-79395dc1b9df req-ec44ae22-b017-49bd-bf8d-ddb6d67110bb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069731 Oct 04 18:41:44.704819 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1688/3322] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:41:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:41:44.713275 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5db7e764-6a8a-4943-9e1c-6fcbd5b03f81 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:44.714334 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5db7e764-6a8a-4943-9e1c-6fcbd5b03f81 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] [instance: 0212406a-acc5-4631-90e8-03f4409c07f1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:44.721730 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5db7e764-6a8a-4943-9e1c-6fcbd5b03f81 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:44.722482 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5db7e764-6a8a-4943-9e1c-6fcbd5b03f81 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:44.724966 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5db7e764-6a8a-4943-9e1c-6fcbd5b03f81 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:44.725898 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5db7e764-6a8a-4943-9e1c-6fcbd5b03f81 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:44.726531 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5db7e764-6a8a-4943-9e1c-6fcbd5b03f81 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:44.727155 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5db7e764-6a8a-4943-9e1c-6fcbd5b03f81 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:44.745602 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-5db7e764-6a8a-4943-9e1c-6fcbd5b03f81 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] HTTP exception thrown: Instance 0212406a-acc5-4631-90e8-03f4409c07f1 could not be found. Oct 04 18:41:44.747552 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5db7e764-6a8a-4943-9e1c-6fcbd5b03f81 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Request method failure captured: Oct 04 18:41:44.747552 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1 HTTP/1.1 Oct 04 18:41:44.747552 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:41:44.747552 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:41:44.747552 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:41:44.747552 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:41:44.747552 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:41:44.747552 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:41:44.747552 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:41:44.747552 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:41:44.747552 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPH4KGicyNUQvHtsRmlPH3Pb4PH67GuR46qQCBqMurDvBUpKYTFGiuLNxP2wtAuUWcwN_FtCnQKolrfqEqAOqOtHA8aG2YVOunHfTxCIxa63sd_yC7k2y2-bx3YdlWr1lEQ-Y_tzBkGedOIgUoY2QL6lLy7V9BJv59SdS4GOle5w1jwM Oct 04 18:41:44.747552 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:41:44.747552 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:41:44.747552 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:41:44.747552 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:41:44.747552 n-d-850501-14 devstack@n-api.service[123001]: X-Openstack-Nova-Api-Version: 2.75 Oct 04 18:41:44.747552 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:41:44.747552 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:41:44.747552 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 71340ee8abbf4244a72d7d31ff1134dd Oct 04 18:41:44.747552 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ServersAdmin275Test-2083801752 Oct 04 18:41:44.747552 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:41:44.747552 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:41:44.747552 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/71340ee8abbf4244a72d7d31ff1134dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_71340ee8abbf4244a72d7d31ff1134dd", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/71340ee8abbf4244a72d7d31ff1134dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/71340ee8abbf4244a72d7d31ff1134dd"}]}] Oct 04 18:41:44.747552 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ServersAdmin275Test-2083801752 Oct 04 18:41:44.747552 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 71340ee8abbf4244a72d7d31ff1134dd Oct 04 18:41:44.747552 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ServersAdmin275Test-2083801752 Oct 04 18:41:44.747552 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ServersAdmin275Test-2083801752-project Oct 04 18:41:44.747552 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:41:44.747552 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:41:44.747552 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: d88c151db7fb4ec0a92ca0e655c0d85f Oct 04 18:41:44.747552 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ServersAdmin275Test-2083801752-project Oct 04 18:41:44.747552 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:41:44.747552 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 0212406a-acc5-4631-90e8-03f4409c07f1 could not be found. Oct 04 18:41:44.747552 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '0212406a-acc5-4631-90e8-03f4409c07f1'} Oct 04 18:41:44.747552 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:41:44.747552 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:44.747552 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:41:44.747552 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:41:44.747552 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:41:44.747552 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:41:44.747552 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:41:44.747552 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:41:44.747552 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:41:44.747552 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:41:44.747552 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0212406a-acc5-4631-90e8-03f4409c07f1 could not be found. Oct 04 18:41:44.747552 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:41:44.747552 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:44.747552 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:41:44.747552 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:44.747552 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:41:44.747552 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:41:44.747552 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:41:44.747552 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:41:44.747552 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:41:44.747552 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:41:44.747552 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:41:44.747552 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:41:44.747552 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:41:44.747552 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:41:44.747552 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:41:44.747552 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:41:44.747552 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0212406a-acc5-4631-90e8-03f4409c07f1 could not be found. Oct 04 18:41:44.747552 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:41:44.747552 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:44.747552 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:41:44.752672 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:44.752672 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:41:44.752672 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:41:44.752672 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:41:44.752672 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:41:44.752672 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0212406a-acc5-4631-90e8-03f4409c07f1 could not be found. Oct 04 18:41:44.752672 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:41:44.755513 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5db7e764-6a8a-4943-9e1c-6fcbd5b03f81 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] Returning 404 to user: Instance 0212406a-acc5-4631-90e8-03f4409c07f1 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:41:44.756720 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5db7e764-6a8a-4943-9e1c-6fcbd5b03f81 tempest-ServersAdmin275Test-2083801752 tempest-ServersAdmin275Test-2083801752-project] 10.222.0.20 "GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1" status: 404 len: 111 microversion: 2.75 time: 0.050479 Oct 04 18:41:44.761001 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1689/3323] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:41:44 2022] GET /compute/v2.1/servers/0212406a-acc5-4631-90e8-03f4409c07f1 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:41:44.765646 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-7fdd7d35-db89-441a-bda4-2ffa9924294d req-ac4ce463-f061-4dd1-867b-7cde3f68709f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d607218c-7a38-4b49-bb51-7e1adfda8c6a", "tag": "a4c07b4b-a6d2-4965-9650-3ce3a87b89ee"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:41:44.783313 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-7fdd7d35-db89-441a-bda4-2ffa9924294d req-ac4ce463-f061-4dd1-867b-7cde3f68709f service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:44.784193 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-7fdd7d35-db89-441a-bda4-2ffa9924294d req-ac4ce463-f061-4dd1-867b-7cde3f68709f service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:44.785165 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-7fdd7d35-db89-441a-bda4-2ffa9924294d req-ac4ce463-f061-4dd1-867b-7cde3f68709f service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:44.807946 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-7fdd7d35-db89-441a-bda4-2ffa9924294d req-ac4ce463-f061-4dd1-867b-7cde3f68709f service nova] Creating event network-changed:a4c07b4b-a6d2-4965-9650-3ce3a87b89ee for instance d607218c-7a38-4b49-bb51-7e1adfda8c6a on n-h2-850501-14 Oct 04 18:41:44.815512 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-7fdd7d35-db89-441a-bda4-2ffa9924294d req-ac4ce463-f061-4dd1-867b-7cde3f68709f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055218 Oct 04 18:41:44.819568 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1690/3324] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:41:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:41:44.824047 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3afd9b67-3442-4e47-ab5f-89577b65e9d2 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:44.826695 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3afd9b67-3442-4e47-ab5f-89577b65e9d2 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: b4ccd5ac-9465-43d8-9a5f-127152966ce8] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:44.836179 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3afd9b67-3442-4e47-ab5f-89577b65e9d2 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:44.837699 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3afd9b67-3442-4e47-ab5f-89577b65e9d2 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:44.839063 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3afd9b67-3442-4e47-ab5f-89577b65e9d2 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:44.840332 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3afd9b67-3442-4e47-ab5f-89577b65e9d2 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:44.841420 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3afd9b67-3442-4e47-ab5f-89577b65e9d2 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:44.842209 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3afd9b67-3442-4e47-ab5f-89577b65e9d2 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:44.979645 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3afd9b67-3442-4e47-ab5f-89577b65e9d2 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8358c07e2684b749a62becb9f0b7869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b922a74c1c2448bb770d6b298b2d601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:44.998632 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3afd9b67-3442-4e47-ab5f-89577b65e9d2 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "GET /compute/v2.1/servers/b4ccd5ac-9465-43d8-9a5f-127152966ce8" status: 200 len: 1426 microversion: 2.1 time: 0.179874 Oct 04 18:41:44.999535 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1691/3325] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:44 2022] GET /compute/v2.1/servers/b4ccd5ac-9465-43d8-9a5f-127152966ce8 => generated 1426 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:45.005011 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d3c34841-45fb-401c-8420-3f40e8840f55 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:45.005679 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d3c34841-45fb-401c-8420-3f40e8840f55 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 92b36041-4d94-4ae6-b0cd-e51306a17de0] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:45.148160 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d3c34841-45fb-401c-8420-3f40e8840f55 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:45.167711 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d3c34841-45fb-401c-8420-3f40e8840f55 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/92b36041-4d94-4ae6-b0cd-e51306a17de0" status: 200 len: 1192 microversion: 2.1 time: 0.166843 Oct 04 18:41:45.168655 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1692/3326] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:44 2022] GET /compute/v2.1/servers/92b36041-4d94-4ae6-b0cd-e51306a17de0 => generated 1192 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:45.173393 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-bfbb11e6-2b1e-4fe1-a305-34fb17200ad2 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-207955938"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:41:45.174145 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-bfbb11e6-2b1e-4fe1-a305-34fb17200ad2 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] [instance: 68f2b230-fee6-4a7c-873f-3dfd659b9338] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:45.181642 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bfbb11e6-2b1e-4fe1-a305-34fb17200ad2 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:45.182139 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bfbb11e6-2b1e-4fe1-a305-34fb17200ad2 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:45.182580 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bfbb11e6-2b1e-4fe1-a305-34fb17200ad2 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:45.183460 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bfbb11e6-2b1e-4fe1-a305-34fb17200ad2 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:45.184103 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bfbb11e6-2b1e-4fe1-a305-34fb17200ad2 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:45.184713 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bfbb11e6-2b1e-4fe1-a305-34fb17200ad2 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:45.320506 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f6757391-0e5d-46d2-879d-503da5de019e tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:45.330494 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f6757391-0e5d-46d2-879d-503da5de019e tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/cd97d817-422a-457d-b653-020350d75d6e" status: 200 len: 1322 microversion: 2.1 time: 0.868546 Oct 04 18:41:45.331069 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1635/3327] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:44 2022] GET /compute/v2.1/servers/cd97d817-422a-457d-b653-020350d75d6e => generated 1322 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:45.336892 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b25e29e3-3ca2-477e-aef4-aa0353493fe8 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Calling method '.version_select at 0x7fe253e075e0>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:45.630114 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.network.security_group_api [None req-bfbb11e6-2b1e-4fe1-a305-34fb17200ad2 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Adding security group 2a9c1330-2010-46aa-85f5-adb49fd1e62a to port 48ff58dc-2007-4baf-8109-1524f9ab9238 Oct 04 18:41:46.127614 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b25e29e3-3ca2-477e-aef4-aa0353493fe8 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] 10.222.0.20 "GET /compute/v2.1/os-floating-ips/c30c685e-4baa-48fd-a741-5eb4264a0ad7" status: 200 len: 185 microversion: 2.1 time: 0.795072 Oct 04 18:41:46.142261 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1636/3328] 10.222.0.20 () {58 vars in 1260 bytes} [Tue Oct 4 18:41:45 2022] GET /compute/v2.1/os-floating-ips/c30c685e-4baa-48fd-a741-5eb4264a0ad7 => generated 185 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:41:46.151930 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7bd00249-b798-4e53-bc40-78bbac8f6f9d tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:46.152575 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7bd00249-b798-4e53-bc40-78bbac8f6f9d tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: b4ccd5ac-9465-43d8-9a5f-127152966ce8] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:46.168479 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:41:46.170730 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7bd00249-b798-4e53-bc40-78bbac8f6f9d tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:46.171390 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7bd00249-b798-4e53-bc40-78bbac8f6f9d tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:46.171982 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7bd00249-b798-4e53-bc40-78bbac8f6f9d tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:46.172903 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7bd00249-b798-4e53-bc40-78bbac8f6f9d tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:46.173509 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7bd00249-b798-4e53-bc40-78bbac8f6f9d tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:46.174085 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7bd00249-b798-4e53-bc40-78bbac8f6f9d tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:46.216600 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7bd00249-b798-4e53-bc40-78bbac8f6f9d tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:46.217295 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7bd00249-b798-4e53-bc40-78bbac8f6f9d tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:46.218045 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7bd00249-b798-4e53-bc40-78bbac8f6f9d tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:46.218897 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-7bd00249-b798-4e53-bc40-78bbac8f6f9d tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lazy-loading 'fault' on Instance uuid b4ccd5ac-9465-43d8-9a5f-127152966ce8 {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:41:46.310102 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7bd00249-b798-4e53-bc40-78bbac8f6f9d tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8358c07e2684b749a62becb9f0b7869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b922a74c1c2448bb770d6b298b2d601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:46.341209 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7bd00249-b798-4e53-bc40-78bbac8f6f9d tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "GET /compute/v2.1/servers/b4ccd5ac-9465-43d8-9a5f-127152966ce8" status: 200 len: 1303 microversion: 2.1 time: 0.195648 Oct 04 18:41:46.342424 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1637/3329] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:46 2022] GET /compute/v2.1/servers/b4ccd5ac-9465-43d8-9a5f-127152966ce8 => generated 1303 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:46.352345 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-bac3361a-eef5-4e49-a9ae-d7025422b233 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.1.156"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:41:46.982610 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-bac3361a-eef5-4e49-a9ae-d7025422b233 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] [instance: d607218c-7a38-4b49-bb51-7e1adfda8c6a] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:46.989336 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bac3361a-eef5-4e49-a9ae-d7025422b233 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:46.989823 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bac3361a-eef5-4e49-a9ae-d7025422b233 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:46.990456 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bac3361a-eef5-4e49-a9ae-d7025422b233 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:46.991160 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bac3361a-eef5-4e49-a9ae-d7025422b233 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:46.992709 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bac3361a-eef5-4e49-a9ae-d7025422b233 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:47.004314 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bac3361a-eef5-4e49-a9ae-d7025422b233 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:47.226024 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-bfbb11e6-2b1e-4fe1-a305-34fb17200ad2 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] 10.222.0.20 "POST /compute/v2.1/servers/68f2b230-fee6-4a7c-873f-3dfd659b9338/action" status: 202 len: 0 microversion: 2.1 time: 2.056272 Oct 04 18:41:47.226734 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1693/3330] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:41:45 2022] POST /compute/v2.1/servers/68f2b230-fee6-4a7c-873f-3dfd659b9338/action => generated 0 bytes in 2058 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:41:47.231642 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f585f457-97b1-4768-90a4-a237c5dfc80e tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:47.232331 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f585f457-97b1-4768-90a4-a237c5dfc80e tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 92b36041-4d94-4ae6-b0cd-e51306a17de0] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:47.253343 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f585f457-97b1-4768-90a4-a237c5dfc80e tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:47.255579 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f585f457-97b1-4768-90a4-a237c5dfc80e tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:47.257947 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f585f457-97b1-4768-90a4-a237c5dfc80e tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:47.263266 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f585f457-97b1-4768-90a4-a237c5dfc80e tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:47.263888 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f585f457-97b1-4768-90a4-a237c5dfc80e tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:47.265283 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f585f457-97b1-4768-90a4-a237c5dfc80e tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:47.505866 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f585f457-97b1-4768-90a4-a237c5dfc80e tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:47.521052 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f585f457-97b1-4768-90a4-a237c5dfc80e tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/92b36041-4d94-4ae6-b0cd-e51306a17de0" status: 200 len: 1262 microversion: 2.1 time: 0.293189 Oct 04 18:41:47.521943 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1694/3331] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:47 2022] GET /compute/v2.1/servers/92b36041-4d94-4ae6-b0cd-e51306a17de0 => generated 1262 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:47.527356 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e82a8b2e-7048-44e2-8902-6bf0852abc83 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:47.528196 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e82a8b2e-7048-44e2-8902-6bf0852abc83 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: cd97d817-422a-457d-b653-020350d75d6e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:47.534749 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e82a8b2e-7048-44e2-8902-6bf0852abc83 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:47.535639 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e82a8b2e-7048-44e2-8902-6bf0852abc83 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:47.536444 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e82a8b2e-7048-44e2-8902-6bf0852abc83 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:47.537387 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e82a8b2e-7048-44e2-8902-6bf0852abc83 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:47.538086 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e82a8b2e-7048-44e2-8902-6bf0852abc83 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:47.542178 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e82a8b2e-7048-44e2-8902-6bf0852abc83 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:48.143021 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bac3361a-eef5-4e49-a9ae-d7025422b233 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Acquiring lock "refresh_cache-d607218c-7a38-4b49-bb51-7e1adfda8c6a" {{(pid=123002) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 18:41:48.144418 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bac3361a-eef5-4e49-a9ae-d7025422b233 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Acquired lock "refresh_cache-d607218c-7a38-4b49-bb51-7e1adfda8c6a" {{(pid=123002) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 18:41:48.360122 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e82a8b2e-7048-44e2-8902-6bf0852abc83 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:48.368088 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e82a8b2e-7048-44e2-8902-6bf0852abc83 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/cd97d817-422a-457d-b653-020350d75d6e" status: 200 len: 1322 microversion: 2.1 time: 0.844759 Oct 04 18:41:48.369358 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1695/3332] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:47 2022] GET /compute/v2.1/servers/cd97d817-422a-457d-b653-020350d75d6e => generated 1322 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:48.375264 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-6c5a72d0-2556-4a6a-bebf-58b942ecdf45 req-6f2398ec-6fa0-4f03-a28a-e6a8bd58cab9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4ccd5ac-9465-43d8-9a5f-127152966ce8", "name": "network-vif-deleted", "tag": "baaa19b1-78c3-40d1-b1e3-7d1931b20e8b"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:41:48.384428 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:41:48.389624 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-6c5a72d0-2556-4a6a-bebf-58b942ecdf45 req-6f2398ec-6fa0-4f03-a28a-e6a8bd58cab9 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:48.390511 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-6c5a72d0-2556-4a6a-bebf-58b942ecdf45 req-6f2398ec-6fa0-4f03-a28a-e6a8bd58cab9 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:48.391175 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-6c5a72d0-2556-4a6a-bebf-58b942ecdf45 req-6f2398ec-6fa0-4f03-a28a-e6a8bd58cab9 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:48.414728 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-6c5a72d0-2556-4a6a-bebf-58b942ecdf45 req-6f2398ec-6fa0-4f03-a28a-e6a8bd58cab9 service nova] Creating event network-vif-deleted:baaa19b1-78c3-40d1-b1e3-7d1931b20e8b for instance b4ccd5ac-9465-43d8-9a5f-127152966ce8 on n-h2-850501-14 Oct 04 18:41:48.424727 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-6c5a72d0-2556-4a6a-bebf-58b942ecdf45 req-6f2398ec-6fa0-4f03-a28a-e6a8bd58cab9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053785 Oct 04 18:41:48.426152 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1696/3333] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:41:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:41:48.432748 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-fdc13d65-0b48-48d0-b8a4-ca61d5b132c6 req-1d67f981-719f-4a15-95dc-47dcb00adda8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d016f22c-47ba-47c6-95bd-87ae9cb4816d", "name": "network-vif-deleted", "tag": "2a64b44b-ed16-469b-a145-c17db566df99"}, {"name": "network-changed", "server_uuid": "cd97d817-422a-457d-b653-020350d75d6e", "tag": "c3dfb6f9-bb0b-461d-9283-7c861531767f"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:41:48.445153 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-fdc13d65-0b48-48d0-b8a4-ca61d5b132c6 req-1d67f981-719f-4a15-95dc-47dcb00adda8 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:48.445634 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-fdc13d65-0b48-48d0-b8a4-ca61d5b132c6 req-1d67f981-719f-4a15-95dc-47dcb00adda8 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:48.446248 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-fdc13d65-0b48-48d0-b8a4-ca61d5b132c6 req-1d67f981-719f-4a15-95dc-47dcb00adda8 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:48.460244 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-fdc13d65-0b48-48d0-b8a4-ca61d5b132c6 req-1d67f981-719f-4a15-95dc-47dcb00adda8 service nova] Creating event network-vif-deleted:2a64b44b-ed16-469b-a145-c17db566df99 for instance d016f22c-47ba-47c6-95bd-87ae9cb4816d on n-h1-850501-14 Oct 04 18:41:48.460762 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-fdc13d65-0b48-48d0-b8a4-ca61d5b132c6 req-1d67f981-719f-4a15-95dc-47dcb00adda8 service nova] Creating event network-changed:c3dfb6f9-bb0b-461d-9283-7c861531767f for instance cd97d817-422a-457d-b653-020350d75d6e on n-h2-850501-14 Oct 04 18:41:48.469775 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-fdc13d65-0b48-48d0-b8a4-ca61d5b132c6 req-1d67f981-719f-4a15-95dc-47dcb00adda8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.041796 Oct 04 18:41:48.470934 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1697/3334] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:41:48 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:41:48.476601 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5f086bb5-e1ae-4ecb-b6d1-a55d10f71fee tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1384012904"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:41:48.477231 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5f086bb5-e1ae-4ecb-b6d1-a55d10f71fee tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] [instance: 68f2b230-fee6-4a7c-873f-3dfd659b9338] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:48.483457 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5f086bb5-e1ae-4ecb-b6d1-a55d10f71fee tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:48.484002 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5f086bb5-e1ae-4ecb-b6d1-a55d10f71fee tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:48.484556 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5f086bb5-e1ae-4ecb-b6d1-a55d10f71fee tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:48.485240 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5f086bb5-e1ae-4ecb-b6d1-a55d10f71fee tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:48.485700 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5f086bb5-e1ae-4ecb-b6d1-a55d10f71fee tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:48.486126 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5f086bb5-e1ae-4ecb-b6d1-a55d10f71fee tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:48.991793 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.network.security_group_api [None req-5f086bb5-e1ae-4ecb-b6d1-a55d10f71fee tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Adding security group 543ea95c-ca29-431c-8070-f2433be82f30 to port 48ff58dc-2007-4baf-8109-1524f9ab9238 Oct 04 18:41:50.646876 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-bac3361a-eef5-4e49-a9ae-d7025422b233 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] [instance: d607218c-7a38-4b49-bb51-7e1adfda8c6a] Building network info cache for instance {{(pid=123002) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 18:41:50.654364 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5f086bb5-e1ae-4ecb-b6d1-a55d10f71fee tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] 10.222.0.20 "POST /compute/v2.1/servers/68f2b230-fee6-4a7c-873f-3dfd659b9338/action" status: 202 len: 0 microversion: 2.1 time: 2.181592 Oct 04 18:41:50.655500 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1698/3335] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:41:48 2022] POST /compute/v2.1/servers/68f2b230-fee6-4a7c-873f-3dfd659b9338/action => generated 0 bytes in 2184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:41:50.661923 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-27ea547e-a6c4-4d07-a6ba-322bd03a572d tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:50.663860 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-27ea547e-a6c4-4d07-a6ba-322bd03a572d tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: b4ccd5ac-9465-43d8-9a5f-127152966ce8] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:50.680326 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-27ea547e-a6c4-4d07-a6ba-322bd03a572d tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:50.683614 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-27ea547e-a6c4-4d07-a6ba-322bd03a572d tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:50.686580 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-27ea547e-a6c4-4d07-a6ba-322bd03a572d tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:50.687767 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-27ea547e-a6c4-4d07-a6ba-322bd03a572d tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:50.688529 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-27ea547e-a6c4-4d07-a6ba-322bd03a572d tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:50.691734 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-27ea547e-a6c4-4d07-a6ba-322bd03a572d tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:50.747331 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-27ea547e-a6c4-4d07-a6ba-322bd03a572d tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] HTTP exception thrown: Instance b4ccd5ac-9465-43d8-9a5f-127152966ce8 could not be found. Oct 04 18:41:50.750930 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-27ea547e-a6c4-4d07-a6ba-322bd03a572d tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Request method failure captured: Oct 04 18:41:50.750930 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/b4ccd5ac-9465-43d8-9a5f-127152966ce8 HTTP/1.1 Oct 04 18:41:50.750930 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:41:50.750930 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:41:50.750930 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:41:50.750930 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:41:50.750930 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:41:50.750930 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:41:50.750930 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:41:50.750930 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:41:50.750930 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPH28pWgq0vOErzfC7Utt0mYTSgOSBv5Y6XwhiyVoauurkgk6KDh8rcG2uOicnp5bqMf1W86RGvXQS6fw10-IgR3JaYUpJKH0HqGff9t7-mtAaL_Q_w5ct4n-gkBuMiWeH5HoxDBz8hxw2NCitfnt35jPqr9GEYzX-ldDn9HisVhsMSw Oct 04 18:41:50.750930 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:41:50.750930 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:41:50.750930 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:41:50.750930 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:41:50.750930 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:41:50.750930 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:41:50.750930 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 1b922a74c1c2448bb770d6b298b2d601 Oct 04 18:41:50.750930 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ServersAdminTestJSON-2129699344 Oct 04 18:41:50.750930 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:41:50.750930 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:41:50.750930 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1b922a74c1c2448bb770d6b298b2d601"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1b922a74c1c2448bb770d6b298b2d601", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1b922a74c1c2448bb770d6b298b2d601"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1b922a74c1c2448bb770d6b298b2d601"}]}] Oct 04 18:41:50.750930 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ServersAdminTestJSON-2129699344 Oct 04 18:41:50.750930 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 1b922a74c1c2448bb770d6b298b2d601 Oct 04 18:41:50.750930 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ServersAdminTestJSON-2129699344 Oct 04 18:41:50.750930 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ServersAdminTestJSON-2129699344-project Oct 04 18:41:50.750930 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:41:50.750930 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:41:50.750930 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: f8358c07e2684b749a62becb9f0b7869 Oct 04 18:41:50.750930 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ServersAdminTestJSON-2129699344-project Oct 04 18:41:50.750930 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:41:50.750930 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance b4ccd5ac-9465-43d8-9a5f-127152966ce8 could not be found. Oct 04 18:41:50.750930 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': 'b4ccd5ac-9465-43d8-9a5f-127152966ce8'} Oct 04 18:41:50.750930 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:41:50.750930 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:50.750930 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:41:50.750930 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:41:50.750930 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:41:50.750930 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:41:50.750930 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:41:50.750930 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:41:50.750930 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:41:50.750930 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:41:50.750930 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4ccd5ac-9465-43d8-9a5f-127152966ce8 could not be found. Oct 04 18:41:50.750930 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:41:50.750930 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:50.750930 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:41:50.750930 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:50.750930 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:41:50.750930 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:41:50.750930 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:41:50.750930 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:41:50.750930 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:41:50.750930 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:41:50.750930 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:41:50.750930 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:41:50.750930 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:41:50.750930 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:41:50.750930 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:41:50.750930 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:41:50.750930 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4ccd5ac-9465-43d8-9a5f-127152966ce8 could not be found. Oct 04 18:41:50.750930 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:41:50.750930 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:50.750930 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:41:50.755745 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:50.755745 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:41:50.755745 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:41:50.755745 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:41:50.755745 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:41:50.755745 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4ccd5ac-9465-43d8-9a5f-127152966ce8 could not be found. Oct 04 18:41:50.755745 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:41:50.756549 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-27ea547e-a6c4-4d07-a6ba-322bd03a572d tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Returning 404 to user: Instance b4ccd5ac-9465-43d8-9a5f-127152966ce8 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:41:50.758802 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-27ea547e-a6c4-4d07-a6ba-322bd03a572d tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "GET /compute/v2.1/servers/b4ccd5ac-9465-43d8-9a5f-127152966ce8" status: 404 len: 111 microversion: 2.1 time: 0.102083 Oct 04 18:41:50.764841 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1699/3336] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:50 2022] GET /compute/v2.1/servers/b4ccd5ac-9465-43d8-9a5f-127152966ce8 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:41:50.770687 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8e25a5bd-d828-4f04-b4a9-d4df8d86ae59 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:50.780997 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8e25a5bd-d828-4f04-b4a9-d4df8d86ae59 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 92b36041-4d94-4ae6-b0cd-e51306a17de0] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:50.794195 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8e25a5bd-d828-4f04-b4a9-d4df8d86ae59 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:50.797074 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8e25a5bd-d828-4f04-b4a9-d4df8d86ae59 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:50.799338 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8e25a5bd-d828-4f04-b4a9-d4df8d86ae59 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:50.802317 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8e25a5bd-d828-4f04-b4a9-d4df8d86ae59 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:50.802928 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8e25a5bd-d828-4f04-b4a9-d4df8d86ae59 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:50.805947 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8e25a5bd-d828-4f04-b4a9-d4df8d86ae59 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:51.259636 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8e25a5bd-d828-4f04-b4a9-d4df8d86ae59 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:51.267582 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8e25a5bd-d828-4f04-b4a9-d4df8d86ae59 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/92b36041-4d94-4ae6-b0cd-e51306a17de0" status: 200 len: 1292 microversion: 2.1 time: 0.501442 Oct 04 18:41:51.268552 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1700/3337] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:50 2022] GET /compute/v2.1/servers/92b36041-4d94-4ae6-b0cd-e51306a17de0 => generated 1292 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:51.287154 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ff6a29ce-a39a-42ff-866a-362543afb9fd tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:51.301857 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ff6a29ce-a39a-42ff-866a-362543afb9fd tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: cd97d817-422a-457d-b653-020350d75d6e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:51.309235 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ff6a29ce-a39a-42ff-866a-362543afb9fd tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:51.309997 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ff6a29ce-a39a-42ff-866a-362543afb9fd tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:51.310636 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ff6a29ce-a39a-42ff-866a-362543afb9fd tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:51.311549 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ff6a29ce-a39a-42ff-866a-362543afb9fd tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:51.320419 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ff6a29ce-a39a-42ff-866a-362543afb9fd tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:51.321243 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ff6a29ce-a39a-42ff-866a-362543afb9fd tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:51.721289 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ff6a29ce-a39a-42ff-866a-362543afb9fd tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:51.739234 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:41:51.747939 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ff6a29ce-a39a-42ff-866a-362543afb9fd tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/cd97d817-422a-457d-b653-020350d75d6e" status: 200 len: 1322 microversion: 2.1 time: 0.477045 Oct 04 18:41:51.751936 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1701/3338] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:51 2022] GET /compute/v2.1/servers/cd97d817-422a-457d-b653-020350d75d6e => generated 1322 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:51.779456 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-32f7a2dd-1cb7-4507-89b2-086f8ebbc3d1 req-a74333f0-64a7-422c-8b47-b9a538e866a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af46589b-8af1-4394-86e3-631c7d483a12", "name": "network-vif-plugged", "status": "completed", "tag": "a7154b01-bcf4-44c5-b892-758fe0c61242"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:41:51.803957 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-32f7a2dd-1cb7-4507-89b2-086f8ebbc3d1 req-a74333f0-64a7-422c-8b47-b9a538e866a5 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:51.804487 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-32f7a2dd-1cb7-4507-89b2-086f8ebbc3d1 req-a74333f0-64a7-422c-8b47-b9a538e866a5 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:51.804926 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-32f7a2dd-1cb7-4507-89b2-086f8ebbc3d1 req-a74333f0-64a7-422c-8b47-b9a538e866a5 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:51.831497 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-32f7a2dd-1cb7-4507-89b2-086f8ebbc3d1 req-a74333f0-64a7-422c-8b47-b9a538e866a5 service nova] Creating event network-vif-plugged:a7154b01-bcf4-44c5-b892-758fe0c61242 for instance af46589b-8af1-4394-86e3-631c7d483a12 on n-h2-850501-14 Oct 04 18:41:51.848227 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-32f7a2dd-1cb7-4507-89b2-086f8ebbc3d1 req-a74333f0-64a7-422c-8b47-b9a538e866a5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091866 Oct 04 18:41:51.848227 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1702/3339] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:41:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:41:51.913085 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-bac3361a-eef5-4e49-a9ae-d7025422b233 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] [instance: d607218c-7a38-4b49-bb51-7e1adfda8c6a] Updating instance_info_cache with network_info: [{"id": "a4c07b4b-a6d2-4965-9650-3ce3a87b89ee", "address": "fa:16:3e:43:0e:5b", "network": {"id": "1abca12e-af42-4430-bf6f-473c83612754", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1832648559-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "08896629a67f488b87a845e57a9ca372", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa4c07b4b-a6", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=123002) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 18:41:51.999494 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bac3361a-eef5-4e49-a9ae-d7025422b233 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Releasing lock "refresh_cache-d607218c-7a38-4b49-bb51-7e1adfda8c6a" {{(pid=123002) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 18:41:52.000557 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-bac3361a-eef5-4e49-a9ae-d7025422b233 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] 10.222.0.20 "POST /compute/v2.1/servers/d607218c-7a38-4b49-bb51-7e1adfda8c6a/action" status: 202 len: 0 microversion: 2.1 time: 5.656207 Oct 04 18:41:52.001802 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1638/3340] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:41:46 2022] POST /compute/v2.1/servers/d607218c-7a38-4b49-bb51-7e1adfda8c6a/action => generated 0 bytes in 5658 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 04 18:41:52.010206 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-2e348a50-ff57-4ac3-bcbc-51a08331a27a req-d64347cc-9bff-42c3-ad04-245190ee198b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68f2b230-fee6-4a7c-873f-3dfd659b9338", "tag": "48ff58dc-2007-4baf-8109-1524f9ab9238"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:41:52.022833 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-2e348a50-ff57-4ac3-bcbc-51a08331a27a req-d64347cc-9bff-42c3-ad04-245190ee198b service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:52.023453 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-2e348a50-ff57-4ac3-bcbc-51a08331a27a req-d64347cc-9bff-42c3-ad04-245190ee198b service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:52.024091 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-2e348a50-ff57-4ac3-bcbc-51a08331a27a req-d64347cc-9bff-42c3-ad04-245190ee198b service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:52.042373 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-2e348a50-ff57-4ac3-bcbc-51a08331a27a req-d64347cc-9bff-42c3-ad04-245190ee198b service nova] Creating event network-changed:48ff58dc-2007-4baf-8109-1524f9ab9238 for instance 68f2b230-fee6-4a7c-873f-3dfd659b9338 on n-h2-850501-14 Oct 04 18:41:52.064839 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-2e348a50-ff57-4ac3-bcbc-51a08331a27a req-d64347cc-9bff-42c3-ad04-245190ee198b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055030 Oct 04 18:41:52.064839 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1639/3341] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:41:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:41:52.071534 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c8dfe336-081e-4206-b50a-02cc0eeed4cb tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:52.072411 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-774ebd68-34dd-41fb-aa14-62206cfb421f tempest-ServicesAdminTestJSON-1273777436 tempest-ServicesAdminTestJSON-1273777436-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:52.072852 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c8dfe336-081e-4206-b50a-02cc0eeed4cb tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] [instance: 68f2b230-fee6-4a7c-873f-3dfd659b9338] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:52.076690 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-774ebd68-34dd-41fb-aa14-62206cfb421f tempest-ServicesAdminTestJSON-1273777436 tempest-ServicesAdminTestJSON-1273777436-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:52.077207 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-774ebd68-34dd-41fb-aa14-62206cfb421f tempest-ServicesAdminTestJSON-1273777436 tempest-ServicesAdminTestJSON-1273777436-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:52.077656 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-774ebd68-34dd-41fb-aa14-62206cfb421f tempest-ServicesAdminTestJSON-1273777436 tempest-ServicesAdminTestJSON-1273777436-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:52.078934 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-774ebd68-34dd-41fb-aa14-62206cfb421f tempest-ServicesAdminTestJSON-1273777436 tempest-ServicesAdminTestJSON-1273777436-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:52.079778 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-774ebd68-34dd-41fb-aa14-62206cfb421f tempest-ServicesAdminTestJSON-1273777436 tempest-ServicesAdminTestJSON-1273777436-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:52.080253 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-774ebd68-34dd-41fb-aa14-62206cfb421f tempest-ServicesAdminTestJSON-1273777436 tempest-ServicesAdminTestJSON-1273777436-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:52.082670 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c8dfe336-081e-4206-b50a-02cc0eeed4cb tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:52.083440 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c8dfe336-081e-4206-b50a-02cc0eeed4cb tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:52.084068 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c8dfe336-081e-4206-b50a-02cc0eeed4cb tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:52.092548 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c8dfe336-081e-4206-b50a-02cc0eeed4cb tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:52.092548 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c8dfe336-081e-4206-b50a-02cc0eeed4cb tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:52.092548 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c8dfe336-081e-4206-b50a-02cc0eeed4cb tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:52.092548 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=3,nova_cell1:RELEASE=2,nova_cell1:SELECT=92,nova_cell1:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:41:52.153789 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-774ebd68-34dd-41fb-aa14-62206cfb421f tempest-ServicesAdminTestJSON-1273777436 tempest-ServicesAdminTestJSON-1273777436-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.304653 Oct 04 18:41:52.155261 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1703/3342] 10.222.0.20 () {58 vars in 1137 bytes} [Tue Oct 4 18:41:51 2022] GET /compute/v2.1/os-services => generated 949 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:41:52.161069 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-22607338-33e3-4a62-a90c-e13cdb1efa13 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:52.161856 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-22607338-33e3-4a62-a90c-e13cdb1efa13 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: c343931b-bc96-4e9e-a5ce-f93454339a53] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:52.171682 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-22607338-33e3-4a62-a90c-e13cdb1efa13 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:52.172365 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-22607338-33e3-4a62-a90c-e13cdb1efa13 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:52.173203 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-22607338-33e3-4a62-a90c-e13cdb1efa13 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:52.173816 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-22607338-33e3-4a62-a90c-e13cdb1efa13 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:52.174705 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-22607338-33e3-4a62-a90c-e13cdb1efa13 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:52.175363 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-22607338-33e3-4a62-a90c-e13cdb1efa13 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:52.217227 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-22607338-33e3-4a62-a90c-e13cdb1efa13 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: c343931b-bc96-4e9e-a5ce-f93454339a53] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:41:52.419015 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c8dfe336-081e-4206-b50a-02cc0eeed4cb tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] 10.222.0.20 "GET /compute/v2.1/servers/68f2b230-fee6-4a7c-873f-3dfd659b9338/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.353832 Oct 04 18:41:52.422638 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1640/3343] 10.222.0.20 () {58 vars in 1293 bytes} [Tue Oct 4 18:41:52 2022] GET /compute/v2.1/servers/68f2b230-fee6-4a7c-873f-3dfd659b9338/os-security-groups => generated 1157 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:52.442165 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-08474e8e-a5d2-4212-ac92-39779e5268c2 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:52.442944 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-08474e8e-a5d2-4212-ac92-39779e5268c2 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] [instance: d016f22c-47ba-47c6-95bd-87ae9cb4816d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:52.449941 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-08474e8e-a5d2-4212-ac92-39779e5268c2 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:52.450695 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-08474e8e-a5d2-4212-ac92-39779e5268c2 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:52.451139 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-08474e8e-a5d2-4212-ac92-39779e5268c2 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:52.451854 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-08474e8e-a5d2-4212-ac92-39779e5268c2 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:52.452337 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-08474e8e-a5d2-4212-ac92-39779e5268c2 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:52.452764 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-08474e8e-a5d2-4212-ac92-39779e5268c2 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:52.471201 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-08474e8e-a5d2-4212-ac92-39779e5268c2 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] HTTP exception thrown: Instance d016f22c-47ba-47c6-95bd-87ae9cb4816d could not be found. Oct 04 18:41:52.474444 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-08474e8e-a5d2-4212-ac92-39779e5268c2 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Request method failure captured: Oct 04 18:41:52.474444 n-d-850501-14 devstack@n-api.service[123002]: request: DELETE /compute/v2.1/servers/d016f22c-47ba-47c6-95bd-87ae9cb4816d HTTP/1.1 Oct 04 18:41:52.474444 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:41:52.474444 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:41:52.474444 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:41:52.474444 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:41:52.474444 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:41:52.474444 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:41:52.474444 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:41:52.474444 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:41:52.474444 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH4eD217yf6XVOFqMlYQXaYJaKqnvBsQYc1Gm8GlDUTsOrLWfVUla_jrp3eQCE2Vn-hL7Y9tBYMzmsxKvz0-UE2mHeJj-S0GIfgH0DbDeBPDhfT6eDtApX7jkCZ7ZFy6Bsz-wcpwxo6DWQJevz--GkP8t12nIjhIN9LIBTkxi_rrYSc Oct 04 18:41:52.474444 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:41:52.474444 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:41:52.474444 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:41:52.474444 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:41:52.474444 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:41:52.474444 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:41:52.474444 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 08896629a67f488b87a845e57a9ca372 Oct 04 18:41:52.474444 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1861553440 Oct 04 18:41:52.474444 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:41:52.474444 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:41:52.474444 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/08896629a67f488b87a845e57a9ca372"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_08896629a67f488b87a845e57a9ca372", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/08896629a67f488b87a845e57a9ca372"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/08896629a67f488b87a845e57a9ca372"}]}] Oct 04 18:41:52.474444 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1861553440 Oct 04 18:41:52.474444 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 08896629a67f488b87a845e57a9ca372 Oct 04 18:41:52.474444 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1861553440 Oct 04 18:41:52.474444 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-FloatingIPsAssociationTestJSON-1861553440-project Oct 04 18:41:52.474444 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:41:52.474444 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:41:52.474444 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: a3499c88686046b8a80bc3a754f016e9 Oct 04 18:41:52.474444 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1861553440-project Oct 04 18:41:52.474444 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:41:52.474444 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance d016f22c-47ba-47c6-95bd-87ae9cb4816d could not be found. Oct 04 18:41:52.474444 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'd016f22c-47ba-47c6-95bd-87ae9cb4816d'} Oct 04 18:41:52.474444 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:41:52.474444 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:52.474444 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:41:52.474444 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:41:52.474444 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:41:52.474444 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:41:52.474444 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:41:52.474444 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:41:52.474444 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:41:52.474444 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:41:52.474444 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d016f22c-47ba-47c6-95bd-87ae9cb4816d could not be found. Oct 04 18:41:52.474444 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:41:52.474444 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:52.474444 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:41:52.474444 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:52.474444 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:41:52.474444 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:41:52.474444 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:41:52.474444 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:41:52.474444 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:41:52.474444 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:41:52.474444 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:41:52.474444 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:41:52.474444 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:41:52.474444 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:41:52.474444 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:41:52.474444 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:41:52.474444 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:41:52.474444 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:41:52.479238 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d016f22c-47ba-47c6-95bd-87ae9cb4816d could not be found. Oct 04 18:41:52.479238 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:41:52.479238 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:52.479238 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:41:52.479238 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:52.479238 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:41:52.479238 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:41:52.479238 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:41:52.479238 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:41:52.479238 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d016f22c-47ba-47c6-95bd-87ae9cb4816d could not be found. Oct 04 18:41:52.479238 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:41:52.479238 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-08474e8e-a5d2-4212-ac92-39779e5268c2 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Returning 404 to user: Instance d016f22c-47ba-47c6-95bd-87ae9cb4816d could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:41:52.479238 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-08474e8e-a5d2-4212-ac92-39779e5268c2 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d016f22c-47ba-47c6-95bd-87ae9cb4816d" status: 404 len: 111 microversion: 2.1 time: 0.050507 Oct 04 18:41:52.479238 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1641/3344] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:41:52 2022] DELETE /compute/v2.1/servers/d016f22c-47ba-47c6-95bd-87ae9cb4816d => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:41:52.482153 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6b982988-8454-478f-abd5-7d8452bc22a3 tempest-ServicesAdminTestJSON-1273777436 tempest-ServicesAdminTestJSON-1273777436-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:52.486011 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6b982988-8454-478f-abd5-7d8452bc22a3 tempest-ServicesAdminTestJSON-1273777436 tempest-ServicesAdminTestJSON-1273777436-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:52.486494 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6b982988-8454-478f-abd5-7d8452bc22a3 tempest-ServicesAdminTestJSON-1273777436 tempest-ServicesAdminTestJSON-1273777436-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:52.487081 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6b982988-8454-478f-abd5-7d8452bc22a3 tempest-ServicesAdminTestJSON-1273777436 tempest-ServicesAdminTestJSON-1273777436-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:52.487895 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6b982988-8454-478f-abd5-7d8452bc22a3 tempest-ServicesAdminTestJSON-1273777436 tempest-ServicesAdminTestJSON-1273777436-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:52.490097 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6b982988-8454-478f-abd5-7d8452bc22a3 tempest-ServicesAdminTestJSON-1273777436 tempest-ServicesAdminTestJSON-1273777436-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:52.490497 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6b982988-8454-478f-abd5-7d8452bc22a3 tempest-ServicesAdminTestJSON-1273777436 tempest-ServicesAdminTestJSON-1273777436-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:52.524739 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6b982988-8454-478f-abd5-7d8452bc22a3 tempest-ServicesAdminTestJSON-1273777436 tempest-ServicesAdminTestJSON-1273777436-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?host=n-d-850501-14" status: 200 len: 581 microversion: 2.1 time: 0.046702 Oct 04 18:41:52.526198 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1642/3345] 10.222.0.20 () {58 vars in 1174 bytes} [Tue Oct 4 18:41:52 2022] GET /compute/v2.1/os-services?host=n-d-850501-14 => generated 581 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:41:52.531263 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6f9e7da2-ea6c-4256-8d19-1839a508f6a9 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:52.531768 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-6f9e7da2-ea6c-4256-8d19-1839a508f6a9 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 92b36041-4d94-4ae6-b0cd-e51306a17de0] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:52.542614 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6f9e7da2-ea6c-4256-8d19-1839a508f6a9 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:52.543511 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6f9e7da2-ea6c-4256-8d19-1839a508f6a9 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:52.544313 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6f9e7da2-ea6c-4256-8d19-1839a508f6a9 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:52.545326 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6f9e7da2-ea6c-4256-8d19-1839a508f6a9 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:52.545947 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6f9e7da2-ea6c-4256-8d19-1839a508f6a9 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:52.546595 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6f9e7da2-ea6c-4256-8d19-1839a508f6a9 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:52.650987 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-22607338-33e3-4a62-a90c-e13cdb1efa13 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53" status: 204 len: 0 microversion: 2.1 time: 0.494280 Oct 04 18:41:52.651598 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1704/3346] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:41:52 2022] DELETE /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:41:52.665457 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-38291f2d-a857-4a08-86c8-0da7cf193121 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Action: 'create', calling method: .version_select at 0x7fe25816aaf0>, body: {"security_group": {"name": " tempest-securitygroup -1159954379 ", "description": "tempest-description-641982060"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:41:52.928164 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-6f9e7da2-ea6c-4256-8d19-1839a508f6a9 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:52.948735 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6f9e7da2-ea6c-4256-8d19-1839a508f6a9 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/92b36041-4d94-4ae6-b0cd-e51306a17de0" status: 200 len: 1292 microversion: 2.1 time: 0.421417 Oct 04 18:41:52.950521 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1643/3347] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:52 2022] GET /compute/v2.1/servers/92b36041-4d94-4ae6-b0cd-e51306a17de0 => generated 1292 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:52.969547 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e3a758be-e2cb-4a27-9d7c-36c0e6904936 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:52.970232 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e3a758be-e2cb-4a27-9d7c-36c0e6904936 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] [instance: d016f22c-47ba-47c6-95bd-87ae9cb4816d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:52.978139 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e3a758be-e2cb-4a27-9d7c-36c0e6904936 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:52.978908 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e3a758be-e2cb-4a27-9d7c-36c0e6904936 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:52.979348 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e3a758be-e2cb-4a27-9d7c-36c0e6904936 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:52.980269 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e3a758be-e2cb-4a27-9d7c-36c0e6904936 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:52.980723 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e3a758be-e2cb-4a27-9d7c-36c0e6904936 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:52.981147 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e3a758be-e2cb-4a27-9d7c-36c0e6904936 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:53.007593 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-e3a758be-e2cb-4a27-9d7c-36c0e6904936 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] HTTP exception thrown: Instance d016f22c-47ba-47c6-95bd-87ae9cb4816d could not be found. Oct 04 18:41:53.011553 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e3a758be-e2cb-4a27-9d7c-36c0e6904936 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Request method failure captured: Oct 04 18:41:53.011553 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/d016f22c-47ba-47c6-95bd-87ae9cb4816d HTTP/1.1 Oct 04 18:41:53.011553 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:41:53.011553 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:41:53.011553 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:41:53.011553 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:41:53.011553 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:41:53.011553 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:41:53.011553 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:41:53.011553 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:41:53.011553 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH4eD217yf6XVOFqMlYQXaYJaKqnvBsQYc1Gm8GlDUTsOrLWfVUla_jrp3eQCE2Vn-hL7Y9tBYMzmsxKvz0-UE2mHeJj-S0GIfgH0DbDeBPDhfT6eDtApX7jkCZ7ZFy6Bsz-wcpwxo6DWQJevz--GkP8t12nIjhIN9LIBTkxi_rrYSc Oct 04 18:41:53.011553 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:41:53.011553 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:41:53.011553 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:41:53.011553 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:41:53.011553 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:41:53.011553 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:41:53.011553 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 08896629a67f488b87a845e57a9ca372 Oct 04 18:41:53.011553 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1861553440 Oct 04 18:41:53.011553 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:41:53.011553 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:41:53.011553 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/08896629a67f488b87a845e57a9ca372"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_08896629a67f488b87a845e57a9ca372", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/08896629a67f488b87a845e57a9ca372"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/08896629a67f488b87a845e57a9ca372"}]}] Oct 04 18:41:53.011553 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1861553440 Oct 04 18:41:53.011553 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 08896629a67f488b87a845e57a9ca372 Oct 04 18:41:53.011553 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1861553440 Oct 04 18:41:53.011553 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-FloatingIPsAssociationTestJSON-1861553440-project Oct 04 18:41:53.011553 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:41:53.011553 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:41:53.011553 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: a3499c88686046b8a80bc3a754f016e9 Oct 04 18:41:53.011553 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1861553440-project Oct 04 18:41:53.011553 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:41:53.011553 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance d016f22c-47ba-47c6-95bd-87ae9cb4816d could not be found. Oct 04 18:41:53.011553 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'd016f22c-47ba-47c6-95bd-87ae9cb4816d'} Oct 04 18:41:53.011553 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:41:53.011553 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:53.011553 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:41:53.011553 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:41:53.011553 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:41:53.011553 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:41:53.011553 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:41:53.011553 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:41:53.011553 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:41:53.011553 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:41:53.011553 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d016f22c-47ba-47c6-95bd-87ae9cb4816d could not be found. Oct 04 18:41:53.011553 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:41:53.011553 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:53.011553 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:41:53.011553 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:53.011553 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:41:53.011553 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:41:53.011553 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:41:53.011553 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:41:53.011553 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:41:53.011553 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:41:53.011553 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:41:53.011553 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:41:53.011553 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:41:53.011553 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:41:53.011553 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:41:53.011553 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:41:53.011553 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d016f22c-47ba-47c6-95bd-87ae9cb4816d could not be found. Oct 04 18:41:53.011553 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:41:53.011553 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:53.017175 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:41:53.017175 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:53.017175 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:41:53.017175 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:41:53.017175 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:41:53.017175 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:41:53.017175 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d016f22c-47ba-47c6-95bd-87ae9cb4816d could not be found. Oct 04 18:41:53.017175 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:41:53.017175 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e3a758be-e2cb-4a27-9d7c-36c0e6904936 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Returning 404 to user: Instance d016f22c-47ba-47c6-95bd-87ae9cb4816d could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:41:53.017175 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e3a758be-e2cb-4a27-9d7c-36c0e6904936 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] 10.222.0.20 "GET /compute/v2.1/servers/d016f22c-47ba-47c6-95bd-87ae9cb4816d" status: 404 len: 111 microversion: 2.1 time: 0.062396 Oct 04 18:41:53.017175 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1644/3348] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:52 2022] GET /compute/v2.1/servers/d016f22c-47ba-47c6-95bd-87ae9cb4816d => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:41:53.021708 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-718738bb-6040-410c-9dff-2e2dc80d5a20 tempest-ServicesAdminTestJSON-1273777436 tempest-ServicesAdminTestJSON-1273777436-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:53.025389 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-718738bb-6040-410c-9dff-2e2dc80d5a20 tempest-ServicesAdminTestJSON-1273777436 tempest-ServicesAdminTestJSON-1273777436-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:53.025874 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-718738bb-6040-410c-9dff-2e2dc80d5a20 tempest-ServicesAdminTestJSON-1273777436 tempest-ServicesAdminTestJSON-1273777436-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:53.026311 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-718738bb-6040-410c-9dff-2e2dc80d5a20 tempest-ServicesAdminTestJSON-1273777436 tempest-ServicesAdminTestJSON-1273777436-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:53.027252 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-718738bb-6040-410c-9dff-2e2dc80d5a20 tempest-ServicesAdminTestJSON-1273777436 tempest-ServicesAdminTestJSON-1273777436-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:53.027874 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-718738bb-6040-410c-9dff-2e2dc80d5a20 tempest-ServicesAdminTestJSON-1273777436 tempest-ServicesAdminTestJSON-1273777436-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:53.028324 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-718738bb-6040-410c-9dff-2e2dc80d5a20 tempest-ServicesAdminTestJSON-1273777436 tempest-ServicesAdminTestJSON-1273777436-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:53.056558 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-718738bb-6040-410c-9dff-2e2dc80d5a20 tempest-ServicesAdminTestJSON-1273777436 tempest-ServicesAdminTestJSON-1273777436-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.038346 Oct 04 18:41:53.057399 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1645/3349] 10.222.0.20 () {58 vars in 1176 bytes} [Tue Oct 4 18:41:53 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:41:53.062589 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5b608c51-a827-4cfe-9718-5242ba7a9079 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:53.065914 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5b608c51-a827-4cfe-9718-5242ba7a9079 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: c343931b-bc96-4e9e-a5ce-f93454339a53] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:53.076735 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5b608c51-a827-4cfe-9718-5242ba7a9079 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:53.077219 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5b608c51-a827-4cfe-9718-5242ba7a9079 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:53.077845 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5b608c51-a827-4cfe-9718-5242ba7a9079 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:53.078549 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5b608c51-a827-4cfe-9718-5242ba7a9079 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:53.079001 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5b608c51-a827-4cfe-9718-5242ba7a9079 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:53.079589 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5b608c51-a827-4cfe-9718-5242ba7a9079 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:53.263454 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=6 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:41:53.373478 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-38291f2d-a857-4a08-86c8-0da7cf193121 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 223 microversion: 2.1 time: 0.715285 Oct 04 18:41:53.374760 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1705/3350] 10.222.0.20 () {60 vars in 1180 bytes} [Tue Oct 4 18:41:52 2022] POST /compute/v2.1/os-security-groups => generated 223 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:41:53.382304 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5b608c51-a827-4cfe-9718-5242ba7a9079 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8358c07e2684b749a62becb9f0b7869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b922a74c1c2448bb770d6b298b2d601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:53.393885 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6abe13e5-abc8-4562-b3c1-a6cc163003b7 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:53.395738 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6abe13e5-abc8-4562-b3c1-a6cc163003b7 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: cd97d817-422a-457d-b653-020350d75d6e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:53.399340 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5b608c51-a827-4cfe-9718-5242ba7a9079 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53" status: 200 len: 1469 microversion: 2.1 time: 0.340669 Oct 04 18:41:53.401331 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1646/3351] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:53 2022] GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53 => generated 1469 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:53.411144 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6abe13e5-abc8-4562-b3c1-a6cc163003b7 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:53.411953 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d6ea0604-4152-4df7-8b52-9607c3adafe6 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Calling method '.version_select at 0x7fe2597b0940>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:53.418415 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6abe13e5-abc8-4562-b3c1-a6cc163003b7 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:53.418958 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6abe13e5-abc8-4562-b3c1-a6cc163003b7 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:53.419895 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6abe13e5-abc8-4562-b3c1-a6cc163003b7 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:53.420666 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6abe13e5-abc8-4562-b3c1-a6cc163003b7 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:53.421252 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6abe13e5-abc8-4562-b3c1-a6cc163003b7 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:53.665487 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6abe13e5-abc8-4562-b3c1-a6cc163003b7 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:53.674146 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6abe13e5-abc8-4562-b3c1-a6cc163003b7 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/cd97d817-422a-457d-b653-020350d75d6e" status: 200 len: 1322 microversion: 2.1 time: 0.298106 Oct 04 18:41:53.674744 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1706/3352] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:53 2022] GET /compute/v2.1/servers/cd97d817-422a-457d-b653-020350d75d6e => generated 1322 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:53.680475 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9df3c9dd-4310-4d48-b984-83b2d194b711 tempest-ServicesAdminTestJSON-1273777436 tempest-ServicesAdminTestJSON-1273777436-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:53.684232 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9df3c9dd-4310-4d48-b984-83b2d194b711 tempest-ServicesAdminTestJSON-1273777436 tempest-ServicesAdminTestJSON-1273777436-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:53.684886 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9df3c9dd-4310-4d48-b984-83b2d194b711 tempest-ServicesAdminTestJSON-1273777436 tempest-ServicesAdminTestJSON-1273777436-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:53.685517 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9df3c9dd-4310-4d48-b984-83b2d194b711 tempest-ServicesAdminTestJSON-1273777436 tempest-ServicesAdminTestJSON-1273777436-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:53.686408 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9df3c9dd-4310-4d48-b984-83b2d194b711 tempest-ServicesAdminTestJSON-1273777436 tempest-ServicesAdminTestJSON-1273777436-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:53.687038 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9df3c9dd-4310-4d48-b984-83b2d194b711 tempest-ServicesAdminTestJSON-1273777436 tempest-ServicesAdminTestJSON-1273777436-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:53.687681 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9df3c9dd-4310-4d48-b984-83b2d194b711 tempest-ServicesAdminTestJSON-1273777436 tempest-ServicesAdminTestJSON-1273777436-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:53.726427 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9df3c9dd-4310-4d48-b984-83b2d194b711 tempest-ServicesAdminTestJSON-1273777436 tempest-ServicesAdminTestJSON-1273777436-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.049863 Oct 04 18:41:53.727159 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1707/3353] 10.222.0.20 () {58 vars in 1137 bytes} [Tue Oct 4 18:41:53 2022] GET /compute/v2.1/os-services => generated 949 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:41:53.731958 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-bc534f58-9ff5-474c-9eff-b290c829d2cf tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Calling method '.version_select at 0x7fe258c7adc0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:53.846275 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-bc534f58-9ff5-474c-9eff-b290c829d2cf tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups/3879092d-d484-4a69-8f34-1bb29afda04b" status: 200 len: 223 microversion: 2.1 time: 0.117820 Oct 04 18:41:53.847112 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1708/3354] 10.222.0.20 () {58 vars in 1269 bytes} [Tue Oct 4 18:41:53 2022] GET /compute/v2.1/os-security-groups/3879092d-d484-4a69-8f34-1bb29afda04b => generated 223 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:41:53.861858 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0f6985a6-854a-4132-b0e8-7a9e4bb4a281 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Calling method '.version_select at 0x7fe258c2d040>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:54.436677 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0f6985a6-854a-4132-b0e8-7a9e4bb4a281 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/3879092d-d484-4a69-8f34-1bb29afda04b" status: 202 len: 0 microversion: 2.1 time: 0.578979 Oct 04 18:41:54.442639 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1709/3355] 10.222.0.20 () {58 vars in 1272 bytes} [Tue Oct 4 18:41:53 2022] DELETE /compute/v2.1/os-security-groups/3879092d-d484-4a69-8f34-1bb29afda04b => generated 0 bytes in 586 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:41:54.449370 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5fbad655-1d26-44d7-a7ea-0808015c979f tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:54.449992 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5fbad655-1d26-44d7-a7ea-0808015c979f tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 92b36041-4d94-4ae6-b0cd-e51306a17de0] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:54.457176 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5fbad655-1d26-44d7-a7ea-0808015c979f tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:54.457875 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5fbad655-1d26-44d7-a7ea-0808015c979f tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:54.458466 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5fbad655-1d26-44d7-a7ea-0808015c979f tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:54.459272 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5fbad655-1d26-44d7-a7ea-0808015c979f tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:54.459782 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5fbad655-1d26-44d7-a7ea-0808015c979f tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:54.460454 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5fbad655-1d26-44d7-a7ea-0808015c979f tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:54.643052 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d6ea0604-4152-4df7-8b52-9607c3adafe6 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/c30c685e-4baa-48fd-a741-5eb4264a0ad7" status: 202 len: 0 microversion: 2.1 time: 1.240484 Oct 04 18:41:54.643846 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1647/3356] 10.222.0.20 () {58 vars in 1263 bytes} [Tue Oct 4 18:41:53 2022] DELETE /compute/v2.1/os-floating-ips/c30c685e-4baa-48fd-a741-5eb4264a0ad7 => generated 0 bytes in 1242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:41:54.650358 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-2b7fc65e-1a73-494e-8645-677d0d4ddf0a req-933fae08-04a8-4e5a-a7e0-304c8d2c19d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d607218c-7a38-4b49-bb51-7e1adfda8c6a", "tag": "a4c07b4b-a6d2-4965-9650-3ce3a87b89ee"}, {"name": "network-changed", "server_uuid": "68f2b230-fee6-4a7c-873f-3dfd659b9338", "tag": "48ff58dc-2007-4baf-8109-1524f9ab9238"}, {"name": "network-changed", "server_uuid": "92b36041-4d94-4ae6-b0cd-e51306a17de0", "tag": "4b73fe8f-ef6c-4798-be58-8cf726b237fe"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:41:54.665802 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-2b7fc65e-1a73-494e-8645-677d0d4ddf0a req-933fae08-04a8-4e5a-a7e0-304c8d2c19d1 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:54.666669 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-2b7fc65e-1a73-494e-8645-677d0d4ddf0a req-933fae08-04a8-4e5a-a7e0-304c8d2c19d1 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:54.667413 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-2b7fc65e-1a73-494e-8645-677d0d4ddf0a req-933fae08-04a8-4e5a-a7e0-304c8d2c19d1 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:54.673600 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5fbad655-1d26-44d7-a7ea-0808015c979f tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:54.684884 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-2b7fc65e-1a73-494e-8645-677d0d4ddf0a req-933fae08-04a8-4e5a-a7e0-304c8d2c19d1 service nova] Creating event network-changed:a4c07b4b-a6d2-4965-9650-3ce3a87b89ee for instance d607218c-7a38-4b49-bb51-7e1adfda8c6a on n-h2-850501-14 Oct 04 18:41:54.685389 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-2b7fc65e-1a73-494e-8645-677d0d4ddf0a req-933fae08-04a8-4e5a-a7e0-304c8d2c19d1 service nova] Creating event network-changed:48ff58dc-2007-4baf-8109-1524f9ab9238 for instance 68f2b230-fee6-4a7c-873f-3dfd659b9338 on n-h2-850501-14 Oct 04 18:41:54.685926 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5fbad655-1d26-44d7-a7ea-0808015c979f tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/92b36041-4d94-4ae6-b0cd-e51306a17de0" status: 200 len: 1292 microversion: 2.1 time: 0.241819 Oct 04 18:41:54.686062 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-2b7fc65e-1a73-494e-8645-677d0d4ddf0a req-933fae08-04a8-4e5a-a7e0-304c8d2c19d1 service nova] Creating event network-changed:4b73fe8f-ef6c-4798-be58-8cf726b237fe for instance 92b36041-4d94-4ae6-b0cd-e51306a17de0 on n-h1-850501-14 Oct 04 18:41:54.688665 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1710/3357] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:54 2022] GET /compute/v2.1/servers/92b36041-4d94-4ae6-b0cd-e51306a17de0 => generated 1292 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:54.697279 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-24298b41-ef60-4867-876b-5589b465c9ea req-c2138610-904d-4b8d-b625-8ce17d92e72e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd97d817-422a-457d-b653-020350d75d6e", "name": "network-vif-plugged", "status": "completed", "tag": "c3dfb6f9-bb0b-461d-9283-7c861531767f"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:41:54.699166 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-2b7fc65e-1a73-494e-8645-677d0d4ddf0a req-933fae08-04a8-4e5a-a7e0-304c8d2c19d1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.053853 Oct 04 18:41:54.700445 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1648/3358] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:41:54 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:41:54.713657 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-24298b41-ef60-4867-876b-5589b465c9ea req-c2138610-904d-4b8d-b625-8ce17d92e72e service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:54.714229 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-24298b41-ef60-4867-876b-5589b465c9ea req-c2138610-904d-4b8d-b625-8ce17d92e72e service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:54.714760 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-24298b41-ef60-4867-876b-5589b465c9ea req-c2138610-904d-4b8d-b625-8ce17d92e72e service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:54.729633 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f752364f-248e-4e4f-adc0-8db34d0e1f18 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:54.730173 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-24298b41-ef60-4867-876b-5589b465c9ea req-c2138610-904d-4b8d-b625-8ce17d92e72e service nova] Creating event network-vif-plugged:c3dfb6f9-bb0b-461d-9283-7c861531767f for instance cd97d817-422a-457d-b653-020350d75d6e on n-h2-850501-14 Oct 04 18:41:54.730290 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f752364f-248e-4e4f-adc0-8db34d0e1f18 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: c343931b-bc96-4e9e-a5ce-f93454339a53] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:54.735238 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-24298b41-ef60-4867-876b-5589b465c9ea req-c2138610-904d-4b8d-b625-8ce17d92e72e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044904 Oct 04 18:41:54.735932 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1711/3359] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:41:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:41:54.745035 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f752364f-248e-4e4f-adc0-8db34d0e1f18 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:54.755897 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f752364f-248e-4e4f-adc0-8db34d0e1f18 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:54.755897 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f752364f-248e-4e4f-adc0-8db34d0e1f18 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:54.755897 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f752364f-248e-4e4f-adc0-8db34d0e1f18 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:54.755897 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f752364f-248e-4e4f-adc0-8db34d0e1f18 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:54.756507 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9d0148af-20a3-4301-9eb5-d08db0cbdd72 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Calling method '.version_select at 0x7fe25813ab80>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:54.756610 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f752364f-248e-4e4f-adc0-8db34d0e1f18 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:54.803288 n-d-850501-14 devstack@n-api.service[123001]: DEBUG neutronclient.v2_0.client [None req-9d0148af-20a3-4301-9eb5-d08db0cbdd72 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3879092d-d484-4a69-8f34-1bb29afda04b does not exist", "detail": ""}} {{(pid=123001) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:41:54.804004 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.security_group_api [None req-9d0148af-20a3-4301-9eb5-d08db0cbdd72 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Neutron security group 3879092d-d484-4a69-8f34-1bb29afda04b not found {{(pid=123001) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 18:41:54.804664 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-9d0148af-20a3-4301-9eb5-d08db0cbdd72 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] HTTP exception thrown: Security group 3879092d-d484-4a69-8f34-1bb29afda04b does not exist Oct 04 18:41:54.804664 n-d-850501-14 devstack@n-api.service[123001]: Neutron server returns request_ids: ['req-c27c4213-0d85-41fa-a70f-3ec0a8e243fb'] Oct 04 18:41:54.807027 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9d0148af-20a3-4301-9eb5-d08db0cbdd72 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Request method failure captured: Oct 04 18:41:54.807027 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/os-security-groups/3879092d-d484-4a69-8f34-1bb29afda04b HTTP/1.1 Oct 04 18:41:54.807027 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:41:54.807027 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:41:54.807027 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:41:54.807027 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:41:54.807027 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:41:54.807027 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:41:54.807027 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:41:54.807027 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:41:54.807027 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPH5IaH15tr5SVoVt4hozZEg3Js8ZWcVBx0oRn243qNZFUMSmPeMa3Gyq91gLee0lw2Klv1E5mNTaxmJJRYhRawPEzSfr-EeZwa66fdrMa4-gu9mqAey6rHA1ZnVCWU_BX1Hua5XpKyhleXrqcIVEtamRhatLhfvMeiTTjEHkZqIKSBQ Oct 04 18:41:54.807027 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:41:54.807027 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:41:54.807027 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:41:54.807027 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:41:54.807027 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:41:54.807027 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:41:54.807027 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 1b43fba16115404aaa793fb907fd257f Oct 04 18:41:54.807027 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-SecurityGroupsTestJSON-752173812 Oct 04 18:41:54.807027 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:41:54.807027 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:41:54.807027 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1b43fba16115404aaa793fb907fd257f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1b43fba16115404aaa793fb907fd257f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1b43fba16115404aaa793fb907fd257f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1b43fba16115404aaa793fb907fd257f"}]}] Oct 04 18:41:54.807027 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-SecurityGroupsTestJSON-752173812 Oct 04 18:41:54.807027 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 1b43fba16115404aaa793fb907fd257f Oct 04 18:41:54.807027 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-752173812 Oct 04 18:41:54.807027 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-SecurityGroupsTestJSON-752173812-project Oct 04 18:41:54.807027 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:41:54.807027 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:41:54.807027 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 777a7a51e45b498597f7a1202217575c Oct 04 18:41:54.807027 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-SecurityGroupsTestJSON-752173812-project Oct 04 18:41:54.807027 n-d-850501-14 devstack@n-api.service[123001]: method: Oct 04 18:41:54.807027 n-d-850501-14 devstack@n-api.service[123001]: exception: Security group 3879092d-d484-4a69-8f34-1bb29afda04b does not exist Oct 04 18:41:54.807027 n-d-850501-14 devstack@n-api.service[123001]: Neutron server returns request_ids: ['req-c27c4213-0d85-41fa-a70f-3ec0a8e243fb'] Oct 04 18:41:54.807027 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '3879092d-d484-4a69-8f34-1bb29afda04b'} Oct 04 18:41:54.807027 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:41:54.807027 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:54.807027 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 18:41:54.807027 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 18:41:54.807027 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:41:54.807027 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:41:54.807027 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 18:41:54.807027 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 18:41:54.807027 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:41:54.807027 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:41:54.807027 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:41:54.807027 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 18:41:54.807027 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:41:54.807027 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:41:54.807027 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:41:54.807027 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:41:54.807027 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:41:54.807027 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:41:54.807027 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:41:54.807027 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:41:54.807027 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:41:54.807027 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:41:54.807027 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:41:54.807027 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:41:54.807027 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:41:54.807027 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:41:54.807027 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 3879092d-d484-4a69-8f34-1bb29afda04b does not exist Oct 04 18:41:54.820094 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c27c4213-0d85-41fa-a70f-3ec0a8e243fb'] Oct 04 18:41:54.820094 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:41:54.820094 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:54.820094 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:41:54.820094 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:54.820094 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 04 18:41:54.820094 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 18:41:54.820094 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 18:41:54.820094 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 18:41:54.820094 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 3879092d-d484-4a69-8f34-1bb29afda04b does not exist Oct 04 18:41:54.820094 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c27c4213-0d85-41fa-a70f-3ec0a8e243fb'] Oct 04 18:41:54.820094 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:41:54.820094 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:54.820094 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:41:54.820094 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:54.820094 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:41:54.820094 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:41:54.820094 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:41:54.820094 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:41:54.820094 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:41:54.820094 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:41:54.820094 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:41:54.820094 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:41:54.820094 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 04 18:41:54.820094 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 18:41:54.820094 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 3879092d-d484-4a69-8f34-1bb29afda04b does not exist Oct 04 18:41:54.820094 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c27c4213-0d85-41fa-a70f-3ec0a8e243fb'] Oct 04 18:41:54.820094 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:41:54.820094 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:54.820094 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:41:54.820094 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:54.820094 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:41:54.820094 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:41:54.820094 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:41:54.820094 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:41:54.820094 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 3879092d-d484-4a69-8f34-1bb29afda04b does not exist Oct 04 18:41:54.820094 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c27c4213-0d85-41fa-a70f-3ec0a8e243fb'] Oct 04 18:41:54.820094 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:41:54.820094 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9d0148af-20a3-4301-9eb5-d08db0cbdd72 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Returning 404 to user: Security group 3879092d-d484-4a69-8f34-1bb29afda04b does not exist Oct 04 18:41:54.820094 n-d-850501-14 devstack@n-api.service[123001]: Neutron server returns request_ids: ['req-c27c4213-0d85-41fa-a70f-3ec0a8e243fb'] {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:41:54.820094 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9d0148af-20a3-4301-9eb5-d08db0cbdd72 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups/3879092d-d484-4a69-8f34-1bb29afda04b" status: 404 len: 194 microversion: 2.1 time: 0.071606 Oct 04 18:41:54.820094 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1712/3360] 10.222.0.20 () {58 vars in 1269 bytes} [Tue Oct 4 18:41:54 2022] GET /compute/v2.1/os-security-groups/3879092d-d484-4a69-8f34-1bb29afda04b => generated 194 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:41:54.823204 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e9d69a64-62a3-46e6-9ef3-8645d07e5d64 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:54.823204 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e9d69a64-62a3-46e6-9ef3-8645d07e5d64 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] [instance: d607218c-7a38-4b49-bb51-7e1adfda8c6a] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:54.829042 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e9d69a64-62a3-46e6-9ef3-8645d07e5d64 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:54.829845 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e9d69a64-62a3-46e6-9ef3-8645d07e5d64 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:54.830479 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e9d69a64-62a3-46e6-9ef3-8645d07e5d64 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:54.831339 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e9d69a64-62a3-46e6-9ef3-8645d07e5d64 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:54.832877 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e9d69a64-62a3-46e6-9ef3-8645d07e5d64 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:54.832877 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e9d69a64-62a3-46e6-9ef3-8645d07e5d64 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:54.866471 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e9d69a64-62a3-46e6-9ef3-8645d07e5d64 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] [instance: d607218c-7a38-4b49-bb51-7e1adfda8c6a] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:41:54.995462 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f752364f-248e-4e4f-adc0-8db34d0e1f18 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8358c07e2684b749a62becb9f0b7869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b922a74c1c2448bb770d6b298b2d601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:55.005572 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f752364f-248e-4e4f-adc0-8db34d0e1f18 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53" status: 200 len: 1469 microversion: 2.1 time: 0.280468 Oct 04 18:41:55.006173 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1649/3361] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:54 2022] GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53 => generated 1469 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:55.011113 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d1cd074e-cecb-40ff-b3a5-54b04807152c tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:55.011727 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d1cd074e-cecb-40ff-b3a5-54b04807152c tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: cd97d817-422a-457d-b653-020350d75d6e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:55.018586 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d1cd074e-cecb-40ff-b3a5-54b04807152c tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:55.019398 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d1cd074e-cecb-40ff-b3a5-54b04807152c tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:55.020006 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d1cd074e-cecb-40ff-b3a5-54b04807152c tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:55.020935 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d1cd074e-cecb-40ff-b3a5-54b04807152c tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:55.021939 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d1cd074e-cecb-40ff-b3a5-54b04807152c tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:55.022549 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d1cd074e-cecb-40ff-b3a5-54b04807152c tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:55.152799 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:41:55.278795 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e9d69a64-62a3-46e6-9ef3-8645d07e5d64 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d607218c-7a38-4b49-bb51-7e1adfda8c6a" status: 204 len: 0 microversion: 2.1 time: 0.468156 Oct 04 18:41:55.279382 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1713/3362] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:41:54 2022] DELETE /compute/v2.1/servers/d607218c-7a38-4b49-bb51-7e1adfda8c6a => generated 0 bytes in 469 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:41:55.286131 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-56c3ed26-69b9-4914-aab5-44d2115ce329 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Action: 'create', calling method: .version_select at 0x7fe258c6c550>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1416710014", "description": "tempest-description-1417460875"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:41:55.797727 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d1cd074e-cecb-40ff-b3a5-54b04807152c tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:55.808705 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d1cd074e-cecb-40ff-b3a5-54b04807152c tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/cd97d817-422a-457d-b653-020350d75d6e" status: 200 len: 1322 microversion: 2.1 time: 0.801290 Oct 04 18:41:55.809281 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1650/3363] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:55 2022] GET /compute/v2.1/servers/cd97d817-422a-457d-b653-020350d75d6e => generated 1322 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:55.815561 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-83a05959-1d2e-48a5-a107-251405aa5275 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:55.817234 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-83a05959-1d2e-48a5-a107-251405aa5275 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] [instance: d607218c-7a38-4b49-bb51-7e1adfda8c6a] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:55.824834 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-83a05959-1d2e-48a5-a107-251405aa5275 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:55.825625 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-83a05959-1d2e-48a5-a107-251405aa5275 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:55.826222 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-83a05959-1d2e-48a5-a107-251405aa5275 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:55.830757 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-83a05959-1d2e-48a5-a107-251405aa5275 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:55.830757 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-83a05959-1d2e-48a5-a107-251405aa5275 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:55.830757 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-83a05959-1d2e-48a5-a107-251405aa5275 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:56.083717 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-83a05959-1d2e-48a5-a107-251405aa5275 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3499c88686046b8a80bc3a754f016e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08896629a67f488b87a845e57a9ca372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:56.092775 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-83a05959-1d2e-48a5-a107-251405aa5275 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] 10.222.0.20 "GET /compute/v2.1/servers/d607218c-7a38-4b49-bb51-7e1adfda8c6a" status: 200 len: 1527 microversion: 2.1 time: 0.282290 Oct 04 18:41:56.104712 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1651/3364] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:55 2022] GET /compute/v2.1/servers/d607218c-7a38-4b49-bb51-7e1adfda8c6a => generated 1527 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:56.115328 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5582ec96-9859-4407-a447-2bdb24fc97cc tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:56.116183 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5582ec96-9859-4407-a447-2bdb24fc97cc tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 92b36041-4d94-4ae6-b0cd-e51306a17de0] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:56.122582 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5582ec96-9859-4407-a447-2bdb24fc97cc tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:56.123335 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5582ec96-9859-4407-a447-2bdb24fc97cc tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:56.123948 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5582ec96-9859-4407-a447-2bdb24fc97cc tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:56.124836 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5582ec96-9859-4407-a447-2bdb24fc97cc tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:56.125452 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5582ec96-9859-4407-a447-2bdb24fc97cc tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:56.126041 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5582ec96-9859-4407-a447-2bdb24fc97cc tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:56.390278 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5582ec96-9859-4407-a447-2bdb24fc97cc tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:56.396305 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-56c3ed26-69b9-4914-aab5-44d2115ce329 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.115190 Oct 04 18:41:56.397899 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1714/3365] 10.222.0.20 () {60 vars in 1180 bytes} [Tue Oct 4 18:41:55 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:41:56.400374 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5582ec96-9859-4407-a447-2bdb24fc97cc tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/92b36041-4d94-4ae6-b0cd-e51306a17de0" status: 200 len: 1292 microversion: 2.1 time: 0.294246 Oct 04 18:41:56.403835 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c5c4d281-9dac-41f4-87dd-56724c3e8442 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:56.405961 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c5c4d281-9dac-41f4-87dd-56724c3e8442 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: c343931b-bc96-4e9e-a5ce-f93454339a53] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:56.411292 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1652/3366] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:56 2022] GET /compute/v2.1/servers/92b36041-4d94-4ae6-b0cd-e51306a17de0 => generated 1292 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:56.415590 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c5c4d281-9dac-41f4-87dd-56724c3e8442 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:56.416483 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c5c4d281-9dac-41f4-87dd-56724c3e8442 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:56.417174 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c5c4d281-9dac-41f4-87dd-56724c3e8442 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:56.418004 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d50ec4b6-ce6c-4642-bfec-7199ed0fe86b tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Action: 'create', calling method: .version_select at 0x7fe253f1b9d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-842165817", "description": "tempest-description-1628391493"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:41:56.418181 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c5c4d281-9dac-41f4-87dd-56724c3e8442 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:56.418716 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c5c4d281-9dac-41f4-87dd-56724c3e8442 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:56.422384 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c5c4d281-9dac-41f4-87dd-56724c3e8442 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:56.771095 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c5c4d281-9dac-41f4-87dd-56724c3e8442 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8358c07e2684b749a62becb9f0b7869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b922a74c1c2448bb770d6b298b2d601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:56.781910 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c5c4d281-9dac-41f4-87dd-56724c3e8442 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53" status: 200 len: 1469 microversion: 2.1 time: 0.382866 Oct 04 18:41:56.782882 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1715/3367] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:56 2022] GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53 => generated 1469 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:56.832847 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f0c4ce8a-fb37-46a3-b711-1b5dcef56835 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:56.837042 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f0c4ce8a-fb37-46a3-b711-1b5dcef56835 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: cd97d817-422a-457d-b653-020350d75d6e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:56.840812 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f0c4ce8a-fb37-46a3-b711-1b5dcef56835 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:56.841305 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f0c4ce8a-fb37-46a3-b711-1b5dcef56835 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:56.842434 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f0c4ce8a-fb37-46a3-b711-1b5dcef56835 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:56.843460 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f0c4ce8a-fb37-46a3-b711-1b5dcef56835 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:56.843921 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f0c4ce8a-fb37-46a3-b711-1b5dcef56835 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:56.844374 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f0c4ce8a-fb37-46a3-b711-1b5dcef56835 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:57.033607 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f0c4ce8a-fb37-46a3-b711-1b5dcef56835 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:57.043040 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f0c4ce8a-fb37-46a3-b711-1b5dcef56835 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/cd97d817-422a-457d-b653-020350d75d6e" status: 200 len: 1322 microversion: 2.1 time: 0.214597 Oct 04 18:41:57.043910 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1716/3368] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:56 2022] GET /compute/v2.1/servers/cd97d817-422a-457d-b653-020350d75d6e => generated 1322 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:57.049547 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d50ec4b6-ce6c-4642-bfec-7199ed0fe86b tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.636613 Oct 04 18:41:57.051485 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1653/3369] 10.222.0.20 () {60 vars in 1180 bytes} [Tue Oct 4 18:41:56 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:41:57.066711 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f924d70d-27ae-4531-9914-2c8b32f5d185 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Action: 'create', calling method: .version_select at 0x7fe258c6c550>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2031555920", "description": "tempest-description-2039756091"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:41:57.119819 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8df2299a-f370-4601-a036-f8d9d1d97393 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:57.120914 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8df2299a-f370-4601-a036-f8d9d1d97393 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] [instance: d607218c-7a38-4b49-bb51-7e1adfda8c6a] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:57.130003 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8df2299a-f370-4601-a036-f8d9d1d97393 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:57.130977 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8df2299a-f370-4601-a036-f8d9d1d97393 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:57.131693 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8df2299a-f370-4601-a036-f8d9d1d97393 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:57.134986 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8df2299a-f370-4601-a036-f8d9d1d97393 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:57.135588 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8df2299a-f370-4601-a036-f8d9d1d97393 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:57.136206 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8df2299a-f370-4601-a036-f8d9d1d97393 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:57.328660 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8df2299a-f370-4601-a036-f8d9d1d97393 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3499c88686046b8a80bc3a754f016e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08896629a67f488b87a845e57a9ca372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:57.341729 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8df2299a-f370-4601-a036-f8d9d1d97393 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] 10.222.0.20 "GET /compute/v2.1/servers/d607218c-7a38-4b49-bb51-7e1adfda8c6a" status: 200 len: 1527 microversion: 2.1 time: 0.227338 Oct 04 18:41:57.352090 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1654/3370] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:57 2022] GET /compute/v2.1/servers/d607218c-7a38-4b49-bb51-7e1adfda8c6a => generated 1527 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:41:57.424159 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2105f18e-4607-4a66-b7d4-ac1f535e8d13 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:57.433607 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2105f18e-4607-4a66-b7d4-ac1f535e8d13 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 92b36041-4d94-4ae6-b0cd-e51306a17de0] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:57.441339 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2105f18e-4607-4a66-b7d4-ac1f535e8d13 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:57.442062 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2105f18e-4607-4a66-b7d4-ac1f535e8d13 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:57.442981 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2105f18e-4607-4a66-b7d4-ac1f535e8d13 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:57.444122 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2105f18e-4607-4a66-b7d4-ac1f535e8d13 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:57.444743 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2105f18e-4607-4a66-b7d4-ac1f535e8d13 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:57.446305 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2105f18e-4607-4a66-b7d4-ac1f535e8d13 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:57.575137 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f924d70d-27ae-4531-9914-2c8b32f5d185 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.513567 Oct 04 18:41:57.576490 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1717/3371] 10.222.0.20 () {60 vars in 1180 bytes} [Tue Oct 4 18:41:57 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:41:57.603924 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-60a8a878-8958-4c52-b9ff-47e5f06b2068 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Calling method '.version_select at 0x7fe258c2d820>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:57.792882 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2105f18e-4607-4a66-b7d4-ac1f535e8d13 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:57.805042 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2105f18e-4607-4a66-b7d4-ac1f535e8d13 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/92b36041-4d94-4ae6-b0cd-e51306a17de0" status: 200 len: 1292 microversion: 2.1 time: 0.384733 Oct 04 18:41:57.805632 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1655/3372] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:57 2022] GET /compute/v2.1/servers/92b36041-4d94-4ae6-b0cd-e51306a17de0 => generated 1292 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:41:57.810293 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-17afad16-5afd-47f8-be44-e6404ae0ee48 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:57.812238 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-17afad16-5afd-47f8-be44-e6404ae0ee48 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: c343931b-bc96-4e9e-a5ce-f93454339a53] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:57.858887 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-17afad16-5afd-47f8-be44-e6404ae0ee48 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:57.858887 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-17afad16-5afd-47f8-be44-e6404ae0ee48 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:57.858887 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-17afad16-5afd-47f8-be44-e6404ae0ee48 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:57.858887 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-17afad16-5afd-47f8-be44-e6404ae0ee48 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:57.862150 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-17afad16-5afd-47f8-be44-e6404ae0ee48 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:57.862930 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-17afad16-5afd-47f8-be44-e6404ae0ee48 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:58.014020 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-17afad16-5afd-47f8-be44-e6404ae0ee48 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8358c07e2684b749a62becb9f0b7869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b922a74c1c2448bb770d6b298b2d601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:58.032700 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-17afad16-5afd-47f8-be44-e6404ae0ee48 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53" status: 200 len: 1427 microversion: 2.1 time: 0.225716 Oct 04 18:41:58.033617 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1656/3373] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:57 2022] GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53 => generated 1427 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:58.044089 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-c3cf3f69-3332-4b0e-a32e-d9deea65ddb5 req-208d6bc5-0a6f-442d-af24-00e66083a273 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92b36041-4d94-4ae6-b0cd-e51306a17de0", "name": "network-vif-plugged", "status": "completed", "tag": "4b73fe8f-ef6c-4798-be58-8cf726b237fe"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:41:58.073040 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-c3cf3f69-3332-4b0e-a32e-d9deea65ddb5 req-208d6bc5-0a6f-442d-af24-00e66083a273 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:58.074254 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-c3cf3f69-3332-4b0e-a32e-d9deea65ddb5 req-208d6bc5-0a6f-442d-af24-00e66083a273 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:58.075676 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-c3cf3f69-3332-4b0e-a32e-d9deea65ddb5 req-208d6bc5-0a6f-442d-af24-00e66083a273 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:58.096573 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-60a8a878-8958-4c52-b9ff-47e5f06b2068 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups" status: 200 len: 1834 microversion: 2.1 time: 0.509937 Oct 04 18:41:58.097859 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1718/3374] 10.222.0.20 () {58 vars in 1158 bytes} [Tue Oct 4 18:41:57 2022] GET /compute/v2.1/os-security-groups => generated 1834 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:58.104208 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-d881cb74-183d-41ab-8f1c-84bc4e6e9aba req-d19f92e7-d456-42ea-a991-ff9da5a20a5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c343931b-bc96-4e9e-a5ce-f93454339a53", "name": "network-vif-deleted", "tag": "c6bfdac3-3f2e-4291-9771-d9e034cf664e"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:41:58.121115 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-c3cf3f69-3332-4b0e-a32e-d9deea65ddb5 req-208d6bc5-0a6f-442d-af24-00e66083a273 service nova] Creating event network-vif-plugged:4b73fe8f-ef6c-4798-be58-8cf726b237fe for instance 92b36041-4d94-4ae6-b0cd-e51306a17de0 on n-h1-850501-14 Oct 04 18:41:58.127758 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-c3cf3f69-3332-4b0e-a32e-d9deea65ddb5 req-208d6bc5-0a6f-442d-af24-00e66083a273 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092460 Oct 04 18:41:58.134110 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1657/3375] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:41:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:41:58.139968 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-d881cb74-183d-41ab-8f1c-84bc4e6e9aba req-d19f92e7-d456-42ea-a991-ff9da5a20a5e service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:58.140639 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-d881cb74-183d-41ab-8f1c-84bc4e6e9aba req-d19f92e7-d456-42ea-a991-ff9da5a20a5e service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:58.141142 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-d881cb74-183d-41ab-8f1c-84bc4e6e9aba req-d19f92e7-d456-42ea-a991-ff9da5a20a5e service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:58.161375 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-91a43256-50a3-4ca0-bf67-85ca3fc87ba7 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:58.162530 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-91a43256-50a3-4ca0-bf67-85ca3fc87ba7 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: cd97d817-422a-457d-b653-020350d75d6e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:58.170330 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-d881cb74-183d-41ab-8f1c-84bc4e6e9aba req-d19f92e7-d456-42ea-a991-ff9da5a20a5e service nova] Creating event network-vif-deleted:c6bfdac3-3f2e-4291-9771-d9e034cf664e for instance c343931b-bc96-4e9e-a5ce-f93454339a53 on n-h2-850501-14 Oct 04 18:41:58.177264 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-d881cb74-183d-41ab-8f1c-84bc4e6e9aba req-d19f92e7-d456-42ea-a991-ff9da5a20a5e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077065 Oct 04 18:41:58.178539 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1719/3376] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:41:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:41:58.184910 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-cb74d7ed-381a-4807-b674-8338f9757523 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Calling method '.version_select at 0x7fe258cd00d0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:58.201302 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-91a43256-50a3-4ca0-bf67-85ca3fc87ba7 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:58.201822 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-91a43256-50a3-4ca0-bf67-85ca3fc87ba7 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:58.202262 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-91a43256-50a3-4ca0-bf67-85ca3fc87ba7 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:58.203012 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-91a43256-50a3-4ca0-bf67-85ca3fc87ba7 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:58.203461 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-91a43256-50a3-4ca0-bf67-85ca3fc87ba7 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:58.205209 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-91a43256-50a3-4ca0-bf67-85ca3fc87ba7 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:58.686850 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-91a43256-50a3-4ca0-bf67-85ca3fc87ba7 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:58.701300 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-91a43256-50a3-4ca0-bf67-85ca3fc87ba7 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/cd97d817-422a-457d-b653-020350d75d6e" status: 200 len: 1322 microversion: 2.1 time: 0.564861 Oct 04 18:41:58.702553 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1658/3377] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:58 2022] GET /compute/v2.1/servers/cd97d817-422a-457d-b653-020350d75d6e => generated 1322 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:58.728515 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f9251e07-df27-4ecd-ab95-f701f9d095b3 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:58.729582 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f9251e07-df27-4ecd-ab95-f701f9d095b3 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] [instance: d607218c-7a38-4b49-bb51-7e1adfda8c6a] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:58.738266 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f9251e07-df27-4ecd-ab95-f701f9d095b3 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:58.738266 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f9251e07-df27-4ecd-ab95-f701f9d095b3 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:58.739116 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f9251e07-df27-4ecd-ab95-f701f9d095b3 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:58.739335 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f9251e07-df27-4ecd-ab95-f701f9d095b3 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:58.740382 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f9251e07-df27-4ecd-ab95-f701f9d095b3 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:58.741512 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f9251e07-df27-4ecd-ab95-f701f9d095b3 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:58.984619 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f9251e07-df27-4ecd-ab95-f701f9d095b3 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3499c88686046b8a80bc3a754f016e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08896629a67f488b87a845e57a9ca372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:58.994134 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f9251e07-df27-4ecd-ab95-f701f9d095b3 tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] 10.222.0.20 "GET /compute/v2.1/servers/d607218c-7a38-4b49-bb51-7e1adfda8c6a" status: 200 len: 1527 microversion: 2.1 time: 0.289574 Oct 04 18:41:59.002093 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1659/3378] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:58 2022] GET /compute/v2.1/servers/d607218c-7a38-4b49-bb51-7e1adfda8c6a => generated 1527 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:59.002093 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4668504d-7061-46cd-badc-6693f32d26bd tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:59.002093 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4668504d-7061-46cd-badc-6693f32d26bd tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 92b36041-4d94-4ae6-b0cd-e51306a17de0] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:59.008876 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4668504d-7061-46cd-badc-6693f32d26bd tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:59.009602 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4668504d-7061-46cd-badc-6693f32d26bd tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:59.010244 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4668504d-7061-46cd-badc-6693f32d26bd tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:59.011158 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4668504d-7061-46cd-badc-6693f32d26bd tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:59.011770 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4668504d-7061-46cd-badc-6693f32d26bd tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:59.012559 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4668504d-7061-46cd-badc-6693f32d26bd tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:59.072676 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-cb74d7ed-381a-4807-b674-8338f9757523 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/b70c1b65-e895-4f6f-bb94-734fd798853e" status: 202 len: 0 microversion: 2.1 time: 0.892555 Oct 04 18:41:59.073800 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1720/3379] 10.222.0.20 () {58 vars in 1272 bytes} [Tue Oct 4 18:41:58 2022] DELETE /compute/v2.1/os-security-groups/b70c1b65-e895-4f6f-bb94-734fd798853e => generated 0 bytes in 894 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:41:59.079393 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-479ac982-10f9-4c2c-8fe3-4dad91fa6674 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:59.080453 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-479ac982-10f9-4c2c-8fe3-4dad91fa6674 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: c343931b-bc96-4e9e-a5ce-f93454339a53] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:59.088322 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-479ac982-10f9-4c2c-8fe3-4dad91fa6674 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:59.088830 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-479ac982-10f9-4c2c-8fe3-4dad91fa6674 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:59.093096 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-479ac982-10f9-4c2c-8fe3-4dad91fa6674 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:59.093096 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-479ac982-10f9-4c2c-8fe3-4dad91fa6674 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:59.093096 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-479ac982-10f9-4c2c-8fe3-4dad91fa6674 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:59.093096 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-479ac982-10f9-4c2c-8fe3-4dad91fa6674 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:59.125188 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-479ac982-10f9-4c2c-8fe3-4dad91fa6674 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:59.125881 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-479ac982-10f9-4c2c-8fe3-4dad91fa6674 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:59.126491 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-479ac982-10f9-4c2c-8fe3-4dad91fa6674 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:59.127107 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-479ac982-10f9-4c2c-8fe3-4dad91fa6674 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lazy-loading 'fault' on Instance uuid c343931b-bc96-4e9e-a5ce-f93454339a53 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:41:59.186873 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-479ac982-10f9-4c2c-8fe3-4dad91fa6674 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8358c07e2684b749a62becb9f0b7869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b922a74c1c2448bb770d6b298b2d601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:59.195917 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-479ac982-10f9-4c2c-8fe3-4dad91fa6674 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53" status: 200 len: 1304 microversion: 2.1 time: 0.120620 Oct 04 18:41:59.197437 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1721/3380] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:59 2022] GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53 => generated 1304 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:59.202543 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-205279e2-5001-4223-a87c-99ff264910b9 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Calling method '.version_select at 0x7fe258b110d0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:59.258304 n-d-850501-14 devstack@n-api.service[123001]: DEBUG neutronclient.v2_0.client [None req-205279e2-5001-4223-a87c-99ff264910b9 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b70c1b65-e895-4f6f-bb94-734fd798853e does not exist", "detail": ""}} {{(pid=123001) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:41:59.259122 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.security_group_api [None req-205279e2-5001-4223-a87c-99ff264910b9 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Neutron security group b70c1b65-e895-4f6f-bb94-734fd798853e not found {{(pid=123001) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 18:41:59.260362 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-205279e2-5001-4223-a87c-99ff264910b9 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] HTTP exception thrown: Security group b70c1b65-e895-4f6f-bb94-734fd798853e does not exist Oct 04 18:41:59.260362 n-d-850501-14 devstack@n-api.service[123001]: Neutron server returns request_ids: ['req-6e6a561e-097c-4c7c-9222-f7c0d084d598'] Oct 04 18:41:59.265596 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4668504d-7061-46cd-badc-6693f32d26bd tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:59.266212 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-205279e2-5001-4223-a87c-99ff264910b9 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Request method failure captured: Oct 04 18:41:59.266212 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/os-security-groups/b70c1b65-e895-4f6f-bb94-734fd798853e HTTP/1.1 Oct 04 18:41:59.266212 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:41:59.266212 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:41:59.266212 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:41:59.266212 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:41:59.266212 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:41:59.266212 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:41:59.266212 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:41:59.266212 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:41:59.266212 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPH5IaH15tr5SVoVt4hozZEg3Js8ZWcVBx0oRn243qNZFUMSmPeMa3Gyq91gLee0lw2Klv1E5mNTaxmJJRYhRawPEzSfr-EeZwa66fdrMa4-gu9mqAey6rHA1ZnVCWU_BX1Hua5XpKyhleXrqcIVEtamRhatLhfvMeiTTjEHkZqIKSBQ Oct 04 18:41:59.266212 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:41:59.266212 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:41:59.266212 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:41:59.266212 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:41:59.266212 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:41:59.266212 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:41:59.266212 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 1b43fba16115404aaa793fb907fd257f Oct 04 18:41:59.266212 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-SecurityGroupsTestJSON-752173812 Oct 04 18:41:59.266212 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:41:59.266212 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:41:59.266212 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1b43fba16115404aaa793fb907fd257f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1b43fba16115404aaa793fb907fd257f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1b43fba16115404aaa793fb907fd257f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1b43fba16115404aaa793fb907fd257f"}]}] Oct 04 18:41:59.266212 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-SecurityGroupsTestJSON-752173812 Oct 04 18:41:59.266212 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 1b43fba16115404aaa793fb907fd257f Oct 04 18:41:59.266212 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-752173812 Oct 04 18:41:59.266212 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-SecurityGroupsTestJSON-752173812-project Oct 04 18:41:59.266212 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:41:59.266212 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:41:59.266212 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 777a7a51e45b498597f7a1202217575c Oct 04 18:41:59.266212 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-SecurityGroupsTestJSON-752173812-project Oct 04 18:41:59.266212 n-d-850501-14 devstack@n-api.service[123001]: method: Oct 04 18:41:59.266212 n-d-850501-14 devstack@n-api.service[123001]: exception: Security group b70c1b65-e895-4f6f-bb94-734fd798853e does not exist Oct 04 18:41:59.266212 n-d-850501-14 devstack@n-api.service[123001]: Neutron server returns request_ids: ['req-6e6a561e-097c-4c7c-9222-f7c0d084d598'] Oct 04 18:41:59.266212 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': 'b70c1b65-e895-4f6f-bb94-734fd798853e'} Oct 04 18:41:59.266212 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:41:59.266212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:59.266212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 18:41:59.266212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 18:41:59.266212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:41:59.266212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:41:59.266212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 18:41:59.266212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 18:41:59.266212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:41:59.266212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:41:59.266212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:41:59.266212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 18:41:59.266212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:41:59.266212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:41:59.266212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:41:59.266212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:41:59.266212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:41:59.266212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:41:59.266212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:41:59.266212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:41:59.266212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:41:59.266212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:41:59.266212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:41:59.266212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:41:59.266212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:41:59.266212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:41:59.266212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b70c1b65-e895-4f6f-bb94-734fd798853e does not exist Oct 04 18:41:59.271230 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6e6a561e-097c-4c7c-9222-f7c0d084d598'] Oct 04 18:41:59.271230 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:41:59.271230 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:59.271230 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:41:59.271230 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:59.271230 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 04 18:41:59.271230 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 18:41:59.271230 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 18:41:59.271230 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 18:41:59.271230 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b70c1b65-e895-4f6f-bb94-734fd798853e does not exist Oct 04 18:41:59.271230 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6e6a561e-097c-4c7c-9222-f7c0d084d598'] Oct 04 18:41:59.271230 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:41:59.271230 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:59.271230 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:41:59.271230 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:59.271230 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:41:59.271230 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:41:59.271230 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:41:59.271230 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:41:59.271230 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:41:59.271230 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:41:59.271230 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:41:59.271230 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:41:59.271230 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 04 18:41:59.271230 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 18:41:59.271230 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b70c1b65-e895-4f6f-bb94-734fd798853e does not exist Oct 04 18:41:59.271230 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6e6a561e-097c-4c7c-9222-f7c0d084d598'] Oct 04 18:41:59.271230 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:41:59.271230 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:59.271230 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:41:59.271230 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:59.271230 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:41:59.271230 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:41:59.271230 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:41:59.271230 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:41:59.271230 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b70c1b65-e895-4f6f-bb94-734fd798853e does not exist Oct 04 18:41:59.271230 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6e6a561e-097c-4c7c-9222-f7c0d084d598'] Oct 04 18:41:59.271230 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:41:59.271230 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-205279e2-5001-4223-a87c-99ff264910b9 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Returning 404 to user: Security group b70c1b65-e895-4f6f-bb94-734fd798853e does not exist Oct 04 18:41:59.271230 n-d-850501-14 devstack@n-api.service[123001]: Neutron server returns request_ids: ['req-6e6a561e-097c-4c7c-9222-f7c0d084d598'] {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:41:59.271230 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-205279e2-5001-4223-a87c-99ff264910b9 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups/b70c1b65-e895-4f6f-bb94-734fd798853e" status: 404 len: 194 microversion: 2.1 time: 0.065745 Oct 04 18:41:59.271230 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1722/3381] 10.222.0.20 () {58 vars in 1269 bytes} [Tue Oct 4 18:41:59 2022] GET /compute/v2.1/os-security-groups/b70c1b65-e895-4f6f-bb94-734fd798853e => generated 194 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:41:59.274671 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1e41276b-14cd-4207-913f-a792972e630f tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Calling method '.version_select at 0x7fe258d329d0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:59.277395 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4668504d-7061-46cd-badc-6693f32d26bd tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/92b36041-4d94-4ae6-b0cd-e51306a17de0" status: 200 len: 1292 microversion: 2.1 time: 0.280472 Oct 04 18:41:59.280129 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1660/3382] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:58 2022] GET /compute/v2.1/servers/92b36041-4d94-4ae6-b0cd-e51306a17de0 => generated 1292 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:59.654314 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1e41276b-14cd-4207-913f-a792972e630f tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/40235627-7776-4a06-9a50-8bc64fa29196" status: 202 len: 0 microversion: 2.1 time: 0.384709 Oct 04 18:41:59.660701 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1723/3383] 10.222.0.20 () {58 vars in 1272 bytes} [Tue Oct 4 18:41:59 2022] DELETE /compute/v2.1/os-security-groups/40235627-7776-4a06-9a50-8bc64fa29196 => generated 0 bytes in 391 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:41:59.667005 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-366d4cf7-2ccd-4830-9ae2-b57bc41d984c tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Calling method '.version_select at 0x7fe253e82160>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:59.729997 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7660aaeb-8857-4e3c-8cc2-fa568a15fd9f tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:59.730619 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7660aaeb-8857-4e3c-8cc2-fa568a15fd9f tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: cd97d817-422a-457d-b653-020350d75d6e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:59.747283 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7660aaeb-8857-4e3c-8cc2-fa568a15fd9f tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:59.747847 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7660aaeb-8857-4e3c-8cc2-fa568a15fd9f tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:59.752490 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7660aaeb-8857-4e3c-8cc2-fa568a15fd9f tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:59.754313 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7660aaeb-8857-4e3c-8cc2-fa568a15fd9f tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:59.755794 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7660aaeb-8857-4e3c-8cc2-fa568a15fd9f tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:59.757272 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7660aaeb-8857-4e3c-8cc2-fa568a15fd9f tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:59.765043 n-d-850501-14 devstack@n-api.service[123002]: DEBUG neutronclient.v2_0.client [None req-366d4cf7-2ccd-4830-9ae2-b57bc41d984c tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 40235627-7776-4a06-9a50-8bc64fa29196 does not exist", "detail": ""}} {{(pid=123002) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:41:59.765671 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.security_group_api [None req-366d4cf7-2ccd-4830-9ae2-b57bc41d984c tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Neutron security group 40235627-7776-4a06-9a50-8bc64fa29196 not found {{(pid=123002) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 18:41:59.766198 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-366d4cf7-2ccd-4830-9ae2-b57bc41d984c tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] HTTP exception thrown: Security group 40235627-7776-4a06-9a50-8bc64fa29196 does not exist Oct 04 18:41:59.766198 n-d-850501-14 devstack@n-api.service[123002]: Neutron server returns request_ids: ['req-2ae0ddef-5da7-4dea-8928-00be56fd897f'] Oct 04 18:41:59.771243 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-366d4cf7-2ccd-4830-9ae2-b57bc41d984c tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Request method failure captured: Oct 04 18:41:59.771243 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/os-security-groups/40235627-7776-4a06-9a50-8bc64fa29196 HTTP/1.1 Oct 04 18:41:59.771243 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:41:59.771243 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:41:59.771243 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:41:59.771243 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:41:59.771243 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:41:59.771243 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:41:59.771243 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:41:59.771243 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:41:59.771243 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH5IaH15tr5SVoVt4hozZEg3Js8ZWcVBx0oRn243qNZFUMSmPeMa3Gyq91gLee0lw2Klv1E5mNTaxmJJRYhRawPEzSfr-EeZwa66fdrMa4-gu9mqAey6rHA1ZnVCWU_BX1Hua5XpKyhleXrqcIVEtamRhatLhfvMeiTTjEHkZqIKSBQ Oct 04 18:41:59.771243 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:41:59.771243 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:41:59.771243 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:41:59.771243 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:41:59.771243 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:41:59.771243 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:41:59.771243 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 1b43fba16115404aaa793fb907fd257f Oct 04 18:41:59.771243 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-SecurityGroupsTestJSON-752173812 Oct 04 18:41:59.771243 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:41:59.771243 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:41:59.771243 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1b43fba16115404aaa793fb907fd257f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1b43fba16115404aaa793fb907fd257f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1b43fba16115404aaa793fb907fd257f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1b43fba16115404aaa793fb907fd257f"}]}] Oct 04 18:41:59.771243 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-SecurityGroupsTestJSON-752173812 Oct 04 18:41:59.771243 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 1b43fba16115404aaa793fb907fd257f Oct 04 18:41:59.771243 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-752173812 Oct 04 18:41:59.771243 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-SecurityGroupsTestJSON-752173812-project Oct 04 18:41:59.771243 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:41:59.771243 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:41:59.771243 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 777a7a51e45b498597f7a1202217575c Oct 04 18:41:59.771243 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-SecurityGroupsTestJSON-752173812-project Oct 04 18:41:59.771243 n-d-850501-14 devstack@n-api.service[123002]: method: Oct 04 18:41:59.771243 n-d-850501-14 devstack@n-api.service[123002]: exception: Security group 40235627-7776-4a06-9a50-8bc64fa29196 does not exist Oct 04 18:41:59.771243 n-d-850501-14 devstack@n-api.service[123002]: Neutron server returns request_ids: ['req-2ae0ddef-5da7-4dea-8928-00be56fd897f'] Oct 04 18:41:59.771243 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '40235627-7776-4a06-9a50-8bc64fa29196'} Oct 04 18:41:59.771243 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:41:59.771243 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:59.771243 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 18:41:59.771243 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 18:41:59.771243 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:41:59.771243 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:41:59.771243 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 18:41:59.771243 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 18:41:59.771243 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:41:59.771243 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:41:59.771243 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:41:59.771243 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 18:41:59.771243 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:41:59.771243 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:41:59.771243 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:41:59.771243 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:41:59.771243 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:41:59.771243 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:41:59.771243 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:41:59.771243 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:41:59.771243 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:41:59.771243 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:41:59.771243 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:41:59.771243 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:41:59.771243 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:41:59.771243 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:41:59.771243 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 40235627-7776-4a06-9a50-8bc64fa29196 does not exist Oct 04 18:41:59.783739 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2ae0ddef-5da7-4dea-8928-00be56fd897f'] Oct 04 18:41:59.783739 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:41:59.783739 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:59.783739 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:41:59.783739 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:59.783739 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 04 18:41:59.783739 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 18:41:59.783739 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 18:41:59.783739 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 18:41:59.783739 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 40235627-7776-4a06-9a50-8bc64fa29196 does not exist Oct 04 18:41:59.783739 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2ae0ddef-5da7-4dea-8928-00be56fd897f'] Oct 04 18:41:59.783739 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:41:59.783739 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:59.783739 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:41:59.783739 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:59.783739 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:41:59.783739 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:41:59.783739 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:41:59.783739 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:41:59.783739 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:41:59.783739 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:41:59.783739 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:41:59.783739 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:41:59.783739 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 04 18:41:59.783739 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 18:41:59.783739 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 40235627-7776-4a06-9a50-8bc64fa29196 does not exist Oct 04 18:41:59.783739 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2ae0ddef-5da7-4dea-8928-00be56fd897f'] Oct 04 18:41:59.783739 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:41:59.783739 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:59.783739 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:41:59.783739 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:59.783739 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:41:59.783739 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:41:59.783739 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:41:59.783739 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:41:59.783739 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 40235627-7776-4a06-9a50-8bc64fa29196 does not exist Oct 04 18:41:59.783739 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2ae0ddef-5da7-4dea-8928-00be56fd897f'] Oct 04 18:41:59.783739 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:41:59.783739 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-366d4cf7-2ccd-4830-9ae2-b57bc41d984c tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Returning 404 to user: Security group 40235627-7776-4a06-9a50-8bc64fa29196 does not exist Oct 04 18:41:59.783739 n-d-850501-14 devstack@n-api.service[123002]: Neutron server returns request_ids: ['req-2ae0ddef-5da7-4dea-8928-00be56fd897f'] {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:41:59.783739 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-366d4cf7-2ccd-4830-9ae2-b57bc41d984c tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups/40235627-7776-4a06-9a50-8bc64fa29196" status: 404 len: 194 microversion: 2.1 time: 0.111908 Oct 04 18:41:59.783739 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1661/3384] 10.222.0.20 () {58 vars in 1269 bytes} [Tue Oct 4 18:41:59 2022] GET /compute/v2.1/os-security-groups/40235627-7776-4a06-9a50-8bc64fa29196 => generated 194 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:41:59.791922 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-519e7f9c-59e3-4682-85be-2d30126378d0 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Calling method '.version_select at 0x7fe253eb5a60>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:00.094099 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7660aaeb-8857-4e3c-8cc2-fa568a15fd9f tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:00.107654 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7660aaeb-8857-4e3c-8cc2-fa568a15fd9f tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/cd97d817-422a-457d-b653-020350d75d6e" status: 200 len: 1515 microversion: 2.1 time: 0.381491 Oct 04 18:42:00.123828 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1724/3385] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:59 2022] GET /compute/v2.1/servers/cd97d817-422a-457d-b653-020350d75d6e => generated 1515 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:00.133827 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-80d8929c-b9bb-4fe3-b06a-05ca313245bd tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:00.134484 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-80d8929c-b9bb-4fe3-b06a-05ca313245bd tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] [instance: d607218c-7a38-4b49-bb51-7e1adfda8c6a] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:00.140524 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-80d8929c-b9bb-4fe3-b06a-05ca313245bd tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:00.141003 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-80d8929c-b9bb-4fe3-b06a-05ca313245bd tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:00.141624 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-80d8929c-b9bb-4fe3-b06a-05ca313245bd tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:00.142481 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-80d8929c-b9bb-4fe3-b06a-05ca313245bd tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:00.143100 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-80d8929c-b9bb-4fe3-b06a-05ca313245bd tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:00.143659 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-80d8929c-b9bb-4fe3-b06a-05ca313245bd tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:00.180661 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-80d8929c-b9bb-4fe3-b06a-05ca313245bd tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:00.181143 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-80d8929c-b9bb-4fe3-b06a-05ca313245bd tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:00.181577 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-80d8929c-b9bb-4fe3-b06a-05ca313245bd tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:00.182051 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-80d8929c-b9bb-4fe3-b06a-05ca313245bd tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lazy-loading 'fault' on Instance uuid d607218c-7a38-4b49-bb51-7e1adfda8c6a {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:42:00.225443 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-80d8929c-b9bb-4fe3-b06a-05ca313245bd tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3499c88686046b8a80bc3a754f016e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08896629a67f488b87a845e57a9ca372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:00.233725 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-80d8929c-b9bb-4fe3-b06a-05ca313245bd tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] 10.222.0.20 "GET /compute/v2.1/servers/d607218c-7a38-4b49-bb51-7e1adfda8c6a" status: 200 len: 1314 microversion: 2.1 time: 0.108328 Oct 04 18:42:00.234300 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1725/3386] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:00 2022] GET /compute/v2.1/servers/d607218c-7a38-4b49-bb51-7e1adfda8c6a => generated 1314 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:00.325696 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-519e7f9c-59e3-4682-85be-2d30126378d0 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/e12df1cb-1eb8-4dd5-aaee-a4d52d5b973a" status: 202 len: 0 microversion: 2.1 time: 0.546181 Oct 04 18:42:00.326310 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1662/3387] 10.222.0.20 () {58 vars in 1272 bytes} [Tue Oct 4 18:41:59 2022] DELETE /compute/v2.1/os-security-groups/e12df1cb-1eb8-4dd5-aaee-a4d52d5b973a => generated 0 bytes in 548 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:42:00.337163 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-650908f4-496f-4d12-9d01-08cb5fbdc55e tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:00.342559 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-650908f4-496f-4d12-9d01-08cb5fbdc55e tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: cd97d817-422a-457d-b653-020350d75d6e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:00.362360 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-650908f4-496f-4d12-9d01-08cb5fbdc55e tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:00.363992 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-650908f4-496f-4d12-9d01-08cb5fbdc55e tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:00.366448 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-650908f4-496f-4d12-9d01-08cb5fbdc55e tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:00.370624 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-650908f4-496f-4d12-9d01-08cb5fbdc55e tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:00.371172 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-650908f4-496f-4d12-9d01-08cb5fbdc55e tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:00.372213 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-650908f4-496f-4d12-9d01-08cb5fbdc55e tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:00.428675 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-650908f4-496f-4d12-9d01-08cb5fbdc55e tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lazy-loading 'flavor' on Instance uuid cd97d817-422a-457d-b653-020350d75d6e {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:42:00.446503 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-af9bb560-f8e5-4b97-bda1-bdb259b06ff1 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-1022207510", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:00.518460 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.neutron [None req-af9bb560-f8e5-4b97-bda1-bdb259b06ff1 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] validate_networks() for None {{(pid=123001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:42:00.622101 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:42:00.833803 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-af9bb560-f8e5-4b97-bda1-bdb259b06ff1 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:42:00.834260 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-af9bb560-f8e5-4b97-bda1-bdb259b06ff1 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:42:00.834744 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-af9bb560-f8e5-4b97-bda1-bdb259b06ff1 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:42:00.835158 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-af9bb560-f8e5-4b97-bda1-bdb259b06ff1 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:42:00.835573 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-af9bb560-f8e5-4b97-bda1-bdb259b06ff1 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:42:00.844527 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-af9bb560-f8e5-4b97-bda1-bdb259b06ff1 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:00.845008 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-af9bb560-f8e5-4b97-bda1-bdb259b06ff1 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:00.845460 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-af9bb560-f8e5-4b97-bda1-bdb259b06ff1 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:00.846168 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-af9bb560-f8e5-4b97-bda1-bdb259b06ff1 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:00.846622 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-af9bb560-f8e5-4b97-bda1-bdb259b06ff1 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:00.851943 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-af9bb560-f8e5-4b97-bda1-bdb259b06ff1 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:00.853958 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-650908f4-496f-4d12-9d01-08cb5fbdc55e tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "POST /compute/v2.1/servers/cd97d817-422a-457d-b653-020350d75d6e/action" status: 200 len: 32 microversion: 2.1 time: 0.526353 Oct 04 18:42:00.855172 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1663/3388] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:42:00 2022] POST /compute/v2.1/servers/cd97d817-422a-457d-b653-020350d75d6e/action => generated 32 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:42:00.868424 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-be076d48-a470-44d0-b4dc-f716115becc6 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:00.870246 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-be076d48-a470-44d0-b4dc-f716115becc6 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] [instance: c343931b-bc96-4e9e-a5ce-f93454339a53] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:00.887565 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-af9bb560-f8e5-4b97-bda1-bdb259b06ff1 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Getting quotas for project 6dd0b1764f314627906bcab7b4ed8a8c. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:42:00.887947 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-be076d48-a470-44d0-b4dc-f716115becc6 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:00.887947 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-be076d48-a470-44d0-b4dc-f716115becc6 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:00.887947 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-be076d48-a470-44d0-b4dc-f716115becc6 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:00.887947 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-be076d48-a470-44d0-b4dc-f716115becc6 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:00.887947 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-be076d48-a470-44d0-b4dc-f716115becc6 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:00.887947 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-be076d48-a470-44d0-b4dc-f716115becc6 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:00.888516 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-af9bb560-f8e5-4b97-bda1-bdb259b06ff1 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Getting quotas for user 33e2e6b962134c77b85f0c7ac8a6b746 and project 6dd0b1764f314627906bcab7b4ed8a8c. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:42:00.897685 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-af9bb560-f8e5-4b97-bda1-bdb259b06ff1 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Going to run 1 instances... {{(pid=123001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:42:00.898006 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-be076d48-a470-44d0-b4dc-f716115becc6 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] HTTP exception thrown: Instance c343931b-bc96-4e9e-a5ce-f93454339a53 could not be found. Oct 04 18:42:00.900265 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-be076d48-a470-44d0-b4dc-f716115becc6 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Request method failure captured: Oct 04 18:42:00.900265 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53 HTTP/1.1 Oct 04 18:42:00.900265 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:42:00.900265 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:42:00.900265 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:42:00.900265 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:42:00.900265 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:42:00.900265 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:42:00.900265 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:42:00.900265 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:42:00.900265 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH28pWgq0vOErzfC7Utt0mYTSgOSBv5Y6XwhiyVoauurkgk6KDh8rcG2uOicnp5bqMf1W86RGvXQS6fw10-IgR3JaYUpJKH0HqGff9t7-mtAaL_Q_w5ct4n-gkBuMiWeH5HoxDBz8hxw2NCitfnt35jPqr9GEYzX-ldDn9HisVhsMSw Oct 04 18:42:00.900265 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:42:00.900265 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:42:00.900265 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:42:00.900265 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:42:00.900265 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:42:00.900265 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:42:00.900265 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 1b922a74c1c2448bb770d6b298b2d601 Oct 04 18:42:00.900265 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServersAdminTestJSON-2129699344 Oct 04 18:42:00.900265 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:42:00.900265 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:42:00.900265 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1b922a74c1c2448bb770d6b298b2d601"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1b922a74c1c2448bb770d6b298b2d601", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1b922a74c1c2448bb770d6b298b2d601"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1b922a74c1c2448bb770d6b298b2d601"}]}] Oct 04 18:42:00.900265 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServersAdminTestJSON-2129699344 Oct 04 18:42:00.900265 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 1b922a74c1c2448bb770d6b298b2d601 Oct 04 18:42:00.900265 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServersAdminTestJSON-2129699344 Oct 04 18:42:00.900265 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServersAdminTestJSON-2129699344-project Oct 04 18:42:00.900265 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:42:00.900265 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:42:00.900265 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: f8358c07e2684b749a62becb9f0b7869 Oct 04 18:42:00.900265 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServersAdminTestJSON-2129699344-project Oct 04 18:42:00.900265 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:42:00.900265 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance c343931b-bc96-4e9e-a5ce-f93454339a53 could not be found. Oct 04 18:42:00.900265 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'c343931b-bc96-4e9e-a5ce-f93454339a53'} Oct 04 18:42:00.900265 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:42:00.900265 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:00.900265 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:42:00.900265 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:42:00.900265 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:42:00.900265 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:42:00.900265 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:42:00.900265 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:42:00.900265 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:42:00.900265 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:42:00.900265 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c343931b-bc96-4e9e-a5ce-f93454339a53 could not be found. Oct 04 18:42:00.900265 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:00.900265 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:42:00.900265 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:00.900265 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:00.900265 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:42:00.900265 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:42:00.900265 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:42:00.900265 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:42:00.900265 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:42:00.900265 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:42:00.900265 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:42:00.900265 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:42:00.900265 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:42:00.900265 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:42:00.900265 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:42:00.900265 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:42:00.900265 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c343931b-bc96-4e9e-a5ce-f93454339a53 could not be found. Oct 04 18:42:00.900265 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:00.900265 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:42:00.900265 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:00.917838 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:00.917838 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:42:00.917838 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:42:00.917838 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:42:00.917838 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:42:00.917838 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c343931b-bc96-4e9e-a5ce-f93454339a53 could not be found. Oct 04 18:42:00.917838 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:00.918998 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-af9bb560-f8e5-4b97-bda1-bdb259b06ff1 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] [instance: fc051dca-45a8-4241-b8a5-29b49903da93] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:42:00.919125 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-be076d48-a470-44d0-b4dc-f716115becc6 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] Returning 404 to user: Instance c343931b-bc96-4e9e-a5ce-f93454339a53 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:42:00.919125 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-be076d48-a470-44d0-b4dc-f716115becc6 tempest-ServersAdminTestJSON-2129699344 tempest-ServersAdminTestJSON-2129699344-project] 10.222.0.20 "GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53" status: 404 len: 111 microversion: 2.1 time: 0.048131 Oct 04 18:42:00.919125 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1664/3389] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:00 2022] GET /compute/v2.1/servers/c343931b-bc96-4e9e-a5ce-f93454339a53 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:42:00.919125 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-3e83ef50-9c85-4715-ba6e-9b6b03a6a507 req-2e90cd72-071f-43b2-a601-b7f877fee027 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d607218c-7a38-4b49-bb51-7e1adfda8c6a", "name": "network-vif-deleted", "tag": "a4c07b4b-a6d2-4965-9650-3ce3a87b89ee"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:00.922029 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-3e83ef50-9c85-4715-ba6e-9b6b03a6a507 req-2e90cd72-071f-43b2-a601-b7f877fee027 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:00.922520 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-3e83ef50-9c85-4715-ba6e-9b6b03a6a507 req-2e90cd72-071f-43b2-a601-b7f877fee027 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:00.923158 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-3e83ef50-9c85-4715-ba6e-9b6b03a6a507 req-2e90cd72-071f-43b2-a601-b7f877fee027 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:00.936170 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-3e83ef50-9c85-4715-ba6e-9b6b03a6a507 req-2e90cd72-071f-43b2-a601-b7f877fee027 service nova] Creating event network-vif-deleted:a4c07b4b-a6d2-4965-9650-3ce3a87b89ee for instance d607218c-7a38-4b49-bb51-7e1adfda8c6a on n-h2-850501-14 Oct 04 18:42:00.943077 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-3e83ef50-9c85-4715-ba6e-9b6b03a6a507 req-2e90cd72-071f-43b2-a601-b7f877fee027 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036419 Oct 04 18:42:00.944202 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1665/3390] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:42:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:42:00.951707 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2d039bca-de51-4b0b-b57a-e3c5996d55c7 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:00.952478 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2d039bca-de51-4b0b-b57a-e3c5996d55c7 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 92b36041-4d94-4ae6-b0cd-e51306a17de0] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:00.959702 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2d039bca-de51-4b0b-b57a-e3c5996d55c7 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:00.960658 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2d039bca-de51-4b0b-b57a-e3c5996d55c7 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:00.961274 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2d039bca-de51-4b0b-b57a-e3c5996d55c7 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:00.962147 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2d039bca-de51-4b0b-b57a-e3c5996d55c7 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:00.962764 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2d039bca-de51-4b0b-b57a-e3c5996d55c7 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:00.963360 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2d039bca-de51-4b0b-b57a-e3c5996d55c7 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:01.023438 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-af9bb560-f8e5-4b97-bda1-bdb259b06ff1 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.788082 Oct 04 18:42:01.024588 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1726/3391] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:42:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 790 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:42:01.038752 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5ff79147-043b-420b-af67-c166ba333ae4 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Calling method '.version_select at 0x7fe2590da4c0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:01.086881 n-d-850501-14 devstack@n-api.service[123001]: DEBUG neutronclient.v2_0.client [None req-5ff79147-043b-420b-af67-c166ba333ae4 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e12df1cb-1eb8-4dd5-aaee-a4d52d5b973a does not exist", "detail": ""}} {{(pid=123001) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:42:01.086881 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.security_group_api [None req-5ff79147-043b-420b-af67-c166ba333ae4 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Neutron security group e12df1cb-1eb8-4dd5-aaee-a4d52d5b973a not found {{(pid=123001) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 18:42:01.086881 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-5ff79147-043b-420b-af67-c166ba333ae4 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] HTTP exception thrown: Security group e12df1cb-1eb8-4dd5-aaee-a4d52d5b973a does not exist Oct 04 18:42:01.086881 n-d-850501-14 devstack@n-api.service[123001]: Neutron server returns request_ids: ['req-c72795f7-fb71-4ed0-b60d-469fa3f08b18'] Oct 04 18:42:01.086881 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5ff79147-043b-420b-af67-c166ba333ae4 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Request method failure captured: Oct 04 18:42:01.086881 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/os-security-groups/e12df1cb-1eb8-4dd5-aaee-a4d52d5b973a HTTP/1.1 Oct 04 18:42:01.086881 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:42:01.086881 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:42:01.086881 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:42:01.086881 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:42:01.086881 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:42:01.086881 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:42:01.086881 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:42:01.086881 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:42:01.086881 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPH5IaH15tr5SVoVt4hozZEg3Js8ZWcVBx0oRn243qNZFUMSmPeMa3Gyq91gLee0lw2Klv1E5mNTaxmJJRYhRawPEzSfr-EeZwa66fdrMa4-gu9mqAey6rHA1ZnVCWU_BX1Hua5XpKyhleXrqcIVEtamRhatLhfvMeiTTjEHkZqIKSBQ Oct 04 18:42:01.086881 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:42:01.086881 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:42:01.086881 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:42:01.086881 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:42:01.086881 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:42:01.086881 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:42:01.086881 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 1b43fba16115404aaa793fb907fd257f Oct 04 18:42:01.086881 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-SecurityGroupsTestJSON-752173812 Oct 04 18:42:01.086881 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:42:01.086881 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:42:01.086881 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1b43fba16115404aaa793fb907fd257f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1b43fba16115404aaa793fb907fd257f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1b43fba16115404aaa793fb907fd257f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1b43fba16115404aaa793fb907fd257f"}]}] Oct 04 18:42:01.086881 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-SecurityGroupsTestJSON-752173812 Oct 04 18:42:01.086881 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 1b43fba16115404aaa793fb907fd257f Oct 04 18:42:01.086881 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-752173812 Oct 04 18:42:01.086881 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-SecurityGroupsTestJSON-752173812-project Oct 04 18:42:01.086881 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:42:01.086881 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:42:01.086881 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 777a7a51e45b498597f7a1202217575c Oct 04 18:42:01.086881 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-SecurityGroupsTestJSON-752173812-project Oct 04 18:42:01.086881 n-d-850501-14 devstack@n-api.service[123001]: method: Oct 04 18:42:01.086881 n-d-850501-14 devstack@n-api.service[123001]: exception: Security group e12df1cb-1eb8-4dd5-aaee-a4d52d5b973a does not exist Oct 04 18:42:01.086881 n-d-850501-14 devstack@n-api.service[123001]: Neutron server returns request_ids: ['req-c72795f7-fb71-4ed0-b60d-469fa3f08b18'] Oct 04 18:42:01.086881 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': 'e12df1cb-1eb8-4dd5-aaee-a4d52d5b973a'} Oct 04 18:42:01.086881 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:42:01.086881 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:01.086881 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 18:42:01.086881 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 18:42:01.086881 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:42:01.086881 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:42:01.086881 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 18:42:01.086881 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 18:42:01.086881 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:42:01.086881 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:42:01.086881 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:42:01.086881 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 18:42:01.086881 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:42:01.086881 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:42:01.086881 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:42:01.086881 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:42:01.091554 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:42:01.091554 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:42:01.091554 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:42:01.091554 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:42:01.091554 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:42:01.091554 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:42:01.091554 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:42:01.091554 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:42:01.091554 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:42:01.091554 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:42:01.091554 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e12df1cb-1eb8-4dd5-aaee-a4d52d5b973a does not exist Oct 04 18:42:01.091554 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c72795f7-fb71-4ed0-b60d-469fa3f08b18'] Oct 04 18:42:01.091554 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:42:01.091554 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:42:01.091554 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:42:01.091554 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:01.091554 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 04 18:42:01.091554 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 18:42:01.091554 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 18:42:01.091554 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 18:42:01.091554 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e12df1cb-1eb8-4dd5-aaee-a4d52d5b973a does not exist Oct 04 18:42:01.091554 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c72795f7-fb71-4ed0-b60d-469fa3f08b18'] Oct 04 18:42:01.091554 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:42:01.091554 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:42:01.091554 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:42:01.091554 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:01.091554 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:42:01.091554 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:42:01.091554 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:42:01.091554 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:42:01.091554 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:42:01.091554 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:42:01.091554 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:42:01.091554 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:42:01.091554 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 04 18:42:01.091554 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 18:42:01.091554 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e12df1cb-1eb8-4dd5-aaee-a4d52d5b973a does not exist Oct 04 18:42:01.091554 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c72795f7-fb71-4ed0-b60d-469fa3f08b18'] Oct 04 18:42:01.091554 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:42:01.091554 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:42:01.091554 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:42:01.091554 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:01.091554 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:42:01.091554 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:42:01.091554 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:42:01.091554 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:42:01.091554 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e12df1cb-1eb8-4dd5-aaee-a4d52d5b973a does not exist Oct 04 18:42:01.091554 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c72795f7-fb71-4ed0-b60d-469fa3f08b18'] Oct 04 18:42:01.091554 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:42:01.091554 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5ff79147-043b-420b-af67-c166ba333ae4 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Returning 404 to user: Security group e12df1cb-1eb8-4dd5-aaee-a4d52d5b973a does not exist Oct 04 18:42:01.091554 n-d-850501-14 devstack@n-api.service[123001]: Neutron server returns request_ids: ['req-c72795f7-fb71-4ed0-b60d-469fa3f08b18'] {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:42:01.091554 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5ff79147-043b-420b-af67-c166ba333ae4 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups/e12df1cb-1eb8-4dd5-aaee-a4d52d5b973a" status: 404 len: 194 microversion: 2.1 time: 0.061829 Oct 04 18:42:01.098527 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1727/3392] 10.222.0.20 () {58 vars in 1269 bytes} [Tue Oct 4 18:42:01 2022] GET /compute/v2.1/os-security-groups/e12df1cb-1eb8-4dd5-aaee-a4d52d5b973a => generated 194 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:42:01.104487 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-00adba98-abda-4251-81b4-58c6fec6274b tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:01.106858 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-00adba98-abda-4251-81b4-58c6fec6274b tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: cd97d817-422a-457d-b653-020350d75d6e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:01.116735 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-00adba98-abda-4251-81b4-58c6fec6274b tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:01.117444 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-00adba98-abda-4251-81b4-58c6fec6274b tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:01.119182 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-00adba98-abda-4251-81b4-58c6fec6274b tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:01.120015 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-00adba98-abda-4251-81b4-58c6fec6274b tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:01.121846 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-00adba98-abda-4251-81b4-58c6fec6274b tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:01.122614 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-00adba98-abda-4251-81b4-58c6fec6274b tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:01.293367 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2d039bca-de51-4b0b-b57a-e3c5996d55c7 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:01.312456 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2d039bca-de51-4b0b-b57a-e3c5996d55c7 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/92b36041-4d94-4ae6-b0cd-e51306a17de0" status: 200 len: 1473 microversion: 2.1 time: 0.363298 Oct 04 18:42:01.312456 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1666/3393] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:00 2022] GET /compute/v2.1/servers/92b36041-4d94-4ae6-b0cd-e51306a17de0 => generated 1473 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:01.327967 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1b7da708-7ba8-4a4a-bb3c-7ec8f51ad7a7 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:01.334049 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1b7da708-7ba8-4a4a-bb3c-7ec8f51ad7a7 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] [instance: fc051dca-45a8-4241-b8a5-29b49903da93] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:01.423347 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1b7da708-7ba8-4a4a-bb3c-7ec8f51ad7a7 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e2e6b962134c77b85f0c7ac8a6b746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd0b1764f314627906bcab7b4ed8a8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:01.435862 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1b7da708-7ba8-4a4a-bb3c-7ec8f51ad7a7 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] 10.222.0.20 "GET /compute/v2.1/servers/fc051dca-45a8-4241-b8a5-29b49903da93" status: 200 len: 1214 microversion: 2.1 time: 0.123406 Oct 04 18:42:01.453715 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1667/3394] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:01 2022] GET /compute/v2.1/servers/fc051dca-45a8-4241-b8a5-29b49903da93 => generated 1214 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:01.460545 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-00adba98-abda-4251-81b4-58c6fec6274b tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:01.470284 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8abf8bee-ce8d-4dde-bef5-a1044708309e tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Calling method '.version_select at 0x7fe253eb5040>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:01.478809 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-00adba98-abda-4251-81b4-58c6fec6274b tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/cd97d817-422a-457d-b653-020350d75d6e" status: 200 len: 1521 microversion: 2.1 time: 0.382430 Oct 04 18:42:01.479420 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1728/3395] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:01 2022] GET /compute/v2.1/servers/cd97d817-422a-457d-b653-020350d75d6e => generated 1521 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:01.498118 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ec718924-28a4-4ae2-b969-5a943e7fbb2d tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:01.499499 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ec718924-28a4-4ae2-b969-5a943e7fbb2d tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] [instance: d607218c-7a38-4b49-bb51-7e1adfda8c6a] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:01.514154 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec718924-28a4-4ae2-b969-5a943e7fbb2d tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:01.516241 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec718924-28a4-4ae2-b969-5a943e7fbb2d tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:01.516241 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec718924-28a4-4ae2-b969-5a943e7fbb2d tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:01.516241 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec718924-28a4-4ae2-b969-5a943e7fbb2d tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:01.516241 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec718924-28a4-4ae2-b969-5a943e7fbb2d tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:01.516658 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec718924-28a4-4ae2-b969-5a943e7fbb2d tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:01.533315 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-ec718924-28a4-4ae2-b969-5a943e7fbb2d tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] HTTP exception thrown: Instance d607218c-7a38-4b49-bb51-7e1adfda8c6a could not be found. Oct 04 18:42:01.536205 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ec718924-28a4-4ae2-b969-5a943e7fbb2d tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Request method failure captured: Oct 04 18:42:01.536205 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/d607218c-7a38-4b49-bb51-7e1adfda8c6a HTTP/1.1 Oct 04 18:42:01.536205 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:42:01.536205 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:42:01.536205 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:42:01.536205 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:42:01.536205 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:42:01.536205 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:42:01.536205 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:42:01.536205 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:42:01.536205 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPH4eD217yf6XVOFqMlYQXaYJaKqnvBsQYc1Gm8GlDUTsOrLWfVUla_jrp3eQCE2Vn-hL7Y9tBYMzmsxKvz0-UE2mHeJj-S0GIfgH0DbDeBPDhfT6eDtApX7jkCZ7ZFy6Bsz-wcpwxo6DWQJevz--GkP8t12nIjhIN9LIBTkxi_rrYSc Oct 04 18:42:01.536205 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:42:01.536205 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:42:01.536205 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:42:01.536205 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:42:01.536205 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:42:01.536205 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:42:01.536205 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 08896629a67f488b87a845e57a9ca372 Oct 04 18:42:01.536205 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1861553440 Oct 04 18:42:01.536205 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:42:01.536205 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:42:01.536205 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/08896629a67f488b87a845e57a9ca372"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_08896629a67f488b87a845e57a9ca372", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/08896629a67f488b87a845e57a9ca372"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/08896629a67f488b87a845e57a9ca372"}]}] Oct 04 18:42:01.536205 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1861553440 Oct 04 18:42:01.536205 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 08896629a67f488b87a845e57a9ca372 Oct 04 18:42:01.536205 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1861553440 Oct 04 18:42:01.536205 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-FloatingIPsAssociationTestJSON-1861553440-project Oct 04 18:42:01.536205 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:42:01.536205 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:42:01.536205 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: a3499c88686046b8a80bc3a754f016e9 Oct 04 18:42:01.536205 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1861553440-project Oct 04 18:42:01.536205 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:42:01.536205 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance d607218c-7a38-4b49-bb51-7e1adfda8c6a could not be found. Oct 04 18:42:01.536205 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': 'd607218c-7a38-4b49-bb51-7e1adfda8c6a'} Oct 04 18:42:01.536205 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:42:01.536205 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:01.536205 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:42:01.536205 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:42:01.536205 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:42:01.536205 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:42:01.536205 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:42:01.536205 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:42:01.536205 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:42:01.536205 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:42:01.536205 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d607218c-7a38-4b49-bb51-7e1adfda8c6a could not be found. Oct 04 18:42:01.536205 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:42:01.536205 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:42:01.536205 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:42:01.536205 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:01.536205 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:42:01.536205 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:42:01.536205 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:42:01.536205 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:42:01.536205 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:42:01.536205 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:42:01.536205 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:42:01.536205 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:42:01.536205 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:42:01.536205 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:42:01.536205 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:42:01.536205 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:42:01.536205 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d607218c-7a38-4b49-bb51-7e1adfda8c6a could not be found. Oct 04 18:42:01.536205 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:42:01.536205 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:42:01.546172 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:42:01.546172 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:01.546172 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:42:01.546172 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:42:01.546172 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:42:01.546172 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:42:01.546172 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d607218c-7a38-4b49-bb51-7e1adfda8c6a could not be found. Oct 04 18:42:01.546172 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:42:01.546172 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ec718924-28a4-4ae2-b969-5a943e7fbb2d tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] Returning 404 to user: Instance d607218c-7a38-4b49-bb51-7e1adfda8c6a could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:42:01.546172 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ec718924-28a4-4ae2-b969-5a943e7fbb2d tempest-FloatingIPsAssociationTestJSON-1861553440 tempest-FloatingIPsAssociationTestJSON-1861553440-project] 10.222.0.20 "GET /compute/v2.1/servers/d607218c-7a38-4b49-bb51-7e1adfda8c6a" status: 404 len: 111 microversion: 2.1 time: 0.061893 Oct 04 18:42:01.546172 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1729/3396] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:01 2022] GET /compute/v2.1/servers/d607218c-7a38-4b49-bb51-7e1adfda8c6a => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:42:01.551432 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0f4c8a56-e08d-4896-99b7-5cdb23bcd90b tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1547748353", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:01.632107 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.neutron [None req-0f4c8a56-e08d-4896-99b7-5cdb23bcd90b tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] validate_networks() for [('ea7ea2b5-3fb7-4eeb-8ba9-cbc81d7265bf', None, None, None, None, None)] {{(pid=123001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:42:01.856252 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8abf8bee-ce8d-4dde-bef5-a1044708309e tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.401078 Oct 04 18:42:01.857152 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1668/3397] 10.222.0.20 () {58 vars in 1158 bytes} [Tue Oct 4 18:42:01 2022] GET /compute/v2.1/os-security-groups => generated 1157 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:01.877255 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3539b273-22fe-4fc4-a098-75e0e01fb644 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Action: 'create', calling method: .version_select at 0x7fe253e82700>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-621020011", "description": "tempest-description-411269234"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:02.365113 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-0f4c8a56-e08d-4896-99b7-5cdb23bcd90b tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:42:02.365620 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-0f4c8a56-e08d-4896-99b7-5cdb23bcd90b tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:42:02.365997 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-0f4c8a56-e08d-4896-99b7-5cdb23bcd90b tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:42:02.366400 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-0f4c8a56-e08d-4896-99b7-5cdb23bcd90b tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:42:02.366811 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-0f4c8a56-e08d-4896-99b7-5cdb23bcd90b tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:42:02.379377 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0f4c8a56-e08d-4896-99b7-5cdb23bcd90b tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:02.379377 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0f4c8a56-e08d-4896-99b7-5cdb23bcd90b tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:02.379377 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0f4c8a56-e08d-4896-99b7-5cdb23bcd90b tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:02.380382 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0f4c8a56-e08d-4896-99b7-5cdb23bcd90b tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:02.381340 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0f4c8a56-e08d-4896-99b7-5cdb23bcd90b tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:02.381772 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0f4c8a56-e08d-4896-99b7-5cdb23bcd90b tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:02.389328 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:42:02.402477 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-0f4c8a56-e08d-4896-99b7-5cdb23bcd90b tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Getting quotas for project a9046b9540144eeba512d79438635ea8. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:42:02.407760 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-0f4c8a56-e08d-4896-99b7-5cdb23bcd90b tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Getting quotas for user 8a6c3725b31449d5bf1ff757ff66c8d7 and project a9046b9540144eeba512d79438635ea8. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:42:02.421377 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0f4c8a56-e08d-4896-99b7-5cdb23bcd90b tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Going to run 1 instances... {{(pid=123001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:42:02.431158 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0f4c8a56-e08d-4896-99b7-5cdb23bcd90b tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 5d0453aa-4e6d-4362-885b-4a2b91a826f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:42:02.584774 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0f4c8a56-e08d-4896-99b7-5cdb23bcd90b tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.040451 Oct 04 18:42:02.586328 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1730/3398] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:42:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1043 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:42:02.591483 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-69fd7dd4-adc9-48d6-8b4b-9c0241a2c54c tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:02.592825 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-69fd7dd4-adc9-48d6-8b4b-9c0241a2c54c tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] [instance: fc051dca-45a8-4241-b8a5-29b49903da93] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:02.615001 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3539b273-22fe-4fc4-a098-75e0e01fb644 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.742692 Oct 04 18:42:02.616071 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1669/3399] 10.222.0.20 () {60 vars in 1180 bytes} [Tue Oct 4 18:42:01 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:42:02.620449 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a8e8f62a-e0e0-40f9-9af7-ec93dd3c1dda tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:02.621050 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a8e8f62a-e0e0-40f9-9af7-ec93dd3c1dda tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: cd97d817-422a-457d-b653-020350d75d6e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:02.639476 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a8e8f62a-e0e0-40f9-9af7-ec93dd3c1dda tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:02.641557 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a8e8f62a-e0e0-40f9-9af7-ec93dd3c1dda tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:02.642439 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a8e8f62a-e0e0-40f9-9af7-ec93dd3c1dda tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:02.643632 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a8e8f62a-e0e0-40f9-9af7-ec93dd3c1dda tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:02.645959 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a8e8f62a-e0e0-40f9-9af7-ec93dd3c1dda tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:02.648414 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a8e8f62a-e0e0-40f9-9af7-ec93dd3c1dda tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:02.677827 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-69fd7dd4-adc9-48d6-8b4b-9c0241a2c54c tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e2e6b962134c77b85f0c7ac8a6b746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd0b1764f314627906bcab7b4ed8a8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:02.689038 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-69fd7dd4-adc9-48d6-8b4b-9c0241a2c54c tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] 10.222.0.20 "GET /compute/v2.1/servers/fc051dca-45a8-4241-b8a5-29b49903da93" status: 200 len: 1214 microversion: 2.1 time: 0.101579 Oct 04 18:42:02.699543 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1731/3400] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:02 2022] GET /compute/v2.1/servers/fc051dca-45a8-4241-b8a5-29b49903da93 => generated 1214 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:02.716586 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-74b52716-9b9e-483b-840d-a1bc7ee7e92f tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:02.716586 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-74b52716-9b9e-483b-840d-a1bc7ee7e92f tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 5d0453aa-4e6d-4362-885b-4a2b91a826f6] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:02.720323 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:42:02.741822 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-74b52716-9b9e-483b-840d-a1bc7ee7e92f tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 5d0453aa-4e6d-4362-885b-4a2b91a826f6] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:42:02.934586 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a8e8f62a-e0e0-40f9-9af7-ec93dd3c1dda tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:02.949657 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a8e8f62a-e0e0-40f9-9af7-ec93dd3c1dda tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/cd97d817-422a-457d-b653-020350d75d6e" status: 200 len: 1521 microversion: 2.1 time: 0.332905 Oct 04 18:42:02.969358 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1670/3401] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:02 2022] GET /compute/v2.1/servers/cd97d817-422a-457d-b653-020350d75d6e => generated 1521 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:02.984987 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-cff5ba40-fc48-44cb-89b7-8a5e229944e3 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Action: 'create', calling method: .version_select at 0x7fe253e0c5e0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2067297716", "description": "tempest-description-1136949385"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:03.042587 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=6 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:42:03.308828 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-74b52716-9b9e-483b-840d-a1bc7ee7e92f tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5d0453aa-4e6d-4362-885b-4a2b91a826f6" status: 204 len: 0 microversion: 2.1 time: 0.607583 Oct 04 18:42:03.311959 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1732/3402] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:42:02 2022] DELETE /compute/v2.1/servers/5d0453aa-4e6d-4362-885b-4a2b91a826f6 => generated 0 bytes in 610 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:42:03.322129 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b6768b27-e07f-4f78-b951-39345bee5b63 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:03.323236 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b6768b27-e07f-4f78-b951-39345bee5b63 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 5d0453aa-4e6d-4362-885b-4a2b91a826f6] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:03.341044 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-b6768b27-e07f-4f78-b951-39345bee5b63 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] HTTP exception thrown: Instance 5d0453aa-4e6d-4362-885b-4a2b91a826f6 could not be found. Oct 04 18:42:03.346602 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b6768b27-e07f-4f78-b951-39345bee5b63 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Request method failure captured: Oct 04 18:42:03.346602 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/5d0453aa-4e6d-4362-885b-4a2b91a826f6 HTTP/1.1 Oct 04 18:42:03.346602 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:42:03.346602 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:42:03.346602 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:42:03.346602 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:42:03.346602 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:42:03.346602 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:42:03.346602 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:42:03.346602 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:42:03.346602 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPH5kaFyiFSIO0ZP4CMGEO428dJiNuEG6R-LLS8mNsVetgcf6w0D7DIrYZ_G7YOzpJ5huW8oCnx3-jlxIKVdxxsS18taUnXx6Xt5KnL4IkhJLGYxbDrAUBLCXM7M3o65rqEELwzRRnK71NdjnupluHpvvCSPBSNhy32oTLBkDAxSrOgs Oct 04 18:42:03.346602 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:42:03.346602 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:42:03.346602 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:42:03.346602 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:42:03.346602 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:42:03.346602 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:42:03.346602 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: a9046b9540144eeba512d79438635ea8 Oct 04 18:42:03.346602 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ServersTestJSON-380527700 Oct 04 18:42:03.346602 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:42:03.346602 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:42:03.346602 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a9046b9540144eeba512d79438635ea8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a9046b9540144eeba512d79438635ea8", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a9046b9540144eeba512d79438635ea8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a9046b9540144eeba512d79438635ea8"}]}] Oct 04 18:42:03.346602 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ServersTestJSON-380527700 Oct 04 18:42:03.346602 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: a9046b9540144eeba512d79438635ea8 Oct 04 18:42:03.346602 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ServersTestJSON-380527700 Oct 04 18:42:03.346602 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ServersTestJSON-380527700-project Oct 04 18:42:03.346602 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:42:03.346602 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:42:03.346602 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 8a6c3725b31449d5bf1ff757ff66c8d7 Oct 04 18:42:03.346602 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ServersTestJSON-380527700-project Oct 04 18:42:03.346602 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:42:03.346602 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 5d0453aa-4e6d-4362-885b-4a2b91a826f6 could not be found. Oct 04 18:42:03.346602 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '5d0453aa-4e6d-4362-885b-4a2b91a826f6'} Oct 04 18:42:03.346602 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:42:03.346602 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:03.346602 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2932, in _get_instance Oct 04 18:42:03.346602 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi build_req = objects.BuildRequest.get_by_instance_uuid( Oct 04 18:42:03.346602 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:42:03.346602 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:42:03.346602 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 177, in get_by_instance_uuid Oct 04 18:42:03.346602 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi db_req = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 04 18:42:03.346602 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:42:03.346602 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:42:03.346602 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 172, in _get_by_instance_uuid_from_db Oct 04 18:42:03.346602 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.BuildRequestNotFound(uuid=instance_uuid) Oct 04 18:42:03.346602 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.BuildRequestNotFound: BuildRequest not found for instance 5d0453aa-4e6d-4362-885b-4a2b91a826f6 Oct 04 18:42:03.346602 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:42:03.346602 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:42:03.346602 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:42:03.346602 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:03.346602 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:42:03.346602 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:42:03.346602 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:42:03.346602 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:42:03.346602 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2944, in _get_instance Oct 04 18:42:03.346602 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:42:03.346602 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d0453aa-4e6d-4362-885b-4a2b91a826f6 could not be found. Oct 04 18:42:03.346602 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:42:03.346602 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:42:03.346602 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:42:03.346602 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:03.346602 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:42:03.346602 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:42:03.362314 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:42:03.362314 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:42:03.362314 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:42:03.362314 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:42:03.362314 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:42:03.362314 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:42:03.362314 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:42:03.362314 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:42:03.362314 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:42:03.362314 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:42:03.362314 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d0453aa-4e6d-4362-885b-4a2b91a826f6 could not be found. Oct 04 18:42:03.362314 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:42:03.362314 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:42:03.362314 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:42:03.362314 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:03.362314 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:42:03.362314 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:42:03.362314 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:42:03.362314 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:42:03.362314 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d0453aa-4e6d-4362-885b-4a2b91a826f6 could not be found. Oct 04 18:42:03.362314 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:42:03.362314 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b6768b27-e07f-4f78-b951-39345bee5b63 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Returning 404 to user: Instance 5d0453aa-4e6d-4362-885b-4a2b91a826f6 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:42:03.362314 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b6768b27-e07f-4f78-b951-39345bee5b63 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/5d0453aa-4e6d-4362-885b-4a2b91a826f6" status: 404 len: 111 microversion: 2.1 time: 0.035264 Oct 04 18:42:03.362314 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1733/3403] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:03 2022] GET /compute/v2.1/servers/5d0453aa-4e6d-4362-885b-4a2b91a826f6 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:42:03.480787 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c3230e9f-ae16-407f-8f5f-eb32720caec1 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-946307474", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "ea7ea2b5-3fb7-4eeb-8ba9-cbc81d7265bf"}]}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:03.583238 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.neutron [None req-c3230e9f-ae16-407f-8f5f-eb32720caec1 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] validate_networks() for [('ea7ea2b5-3fb7-4eeb-8ba9-cbc81d7265bf', None, None, None, None, None)] {{(pid=123001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:42:03.640302 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-cff5ba40-fc48-44cb-89b7-8a5e229944e3 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.668980 Oct 04 18:42:03.641748 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1671/3404] 10.222.0.20 () {60 vars in 1180 bytes} [Tue Oct 4 18:42:02 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:42:03.718687 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-44dc7bcf-4124-4d05-a2d9-fccbbe00457d tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:03.719814 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-44dc7bcf-4124-4d05-a2d9-fccbbe00457d tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] [instance: fc051dca-45a8-4241-b8a5-29b49903da93] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:03.730111 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-44dc7bcf-4124-4d05-a2d9-fccbbe00457d tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:03.731491 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-44dc7bcf-4124-4d05-a2d9-fccbbe00457d tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:03.732269 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-44dc7bcf-4124-4d05-a2d9-fccbbe00457d tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:03.734593 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-44dc7bcf-4124-4d05-a2d9-fccbbe00457d tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:03.735280 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-44dc7bcf-4124-4d05-a2d9-fccbbe00457d tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:03.739145 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-44dc7bcf-4124-4d05-a2d9-fccbbe00457d tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:03.871495 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-44dc7bcf-4124-4d05-a2d9-fccbbe00457d tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e2e6b962134c77b85f0c7ac8a6b746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd0b1764f314627906bcab7b4ed8a8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:03.882996 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-44dc7bcf-4124-4d05-a2d9-fccbbe00457d tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] 10.222.0.20 "GET /compute/v2.1/servers/fc051dca-45a8-4241-b8a5-29b49903da93" status: 200 len: 1266 microversion: 2.1 time: 0.170741 Oct 04 18:42:03.883589 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1672/3405] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:03 2022] GET /compute/v2.1/servers/fc051dca-45a8-4241-b8a5-29b49903da93 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:42:03.892367 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-eee16ce2-c987-4c7f-b668-32691a8c4c23 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-156616132", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": [{"uuid": "8d61136c-7fa1-4ef0-9194-fdcc075a0dce"}]}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:03.959066 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-eee16ce2-c987-4c7f-b668-32691a8c4c23 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] validate_networks() for [('8d61136c-7fa1-4ef0-9194-fdcc075a0dce', None, None, None, None, None)] {{(pid=123002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:42:05.027929 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-c3230e9f-ae16-407f-8f5f-eb32720caec1 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:42:05.029002 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-c3230e9f-ae16-407f-8f5f-eb32720caec1 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:42:05.030581 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-c3230e9f-ae16-407f-8f5f-eb32720caec1 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:42:05.031074 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-c3230e9f-ae16-407f-8f5f-eb32720caec1 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:42:05.031823 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-c3230e9f-ae16-407f-8f5f-eb32720caec1 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:42:05.058550 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c3230e9f-ae16-407f-8f5f-eb32720caec1 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:05.059547 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c3230e9f-ae16-407f-8f5f-eb32720caec1 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:05.060388 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c3230e9f-ae16-407f-8f5f-eb32720caec1 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:05.061500 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c3230e9f-ae16-407f-8f5f-eb32720caec1 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:05.062570 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c3230e9f-ae16-407f-8f5f-eb32720caec1 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:05.063346 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c3230e9f-ae16-407f-8f5f-eb32720caec1 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:05.094091 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-c3230e9f-ae16-407f-8f5f-eb32720caec1 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Getting quotas for project a9046b9540144eeba512d79438635ea8. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:42:05.100885 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-c3230e9f-ae16-407f-8f5f-eb32720caec1 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Getting quotas for user 8a6c3725b31449d5bf1ff757ff66c8d7 and project a9046b9540144eeba512d79438635ea8. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:42:05.120093 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c3230e9f-ae16-407f-8f5f-eb32720caec1 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Going to run 1 instances... {{(pid=123001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:42:05.122845 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c3230e9f-ae16-407f-8f5f-eb32720caec1 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: af3e9546-9a60-424a-8d98-234b08364d1d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:42:05.321362 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c3230e9f-ae16-407f-8f5f-eb32720caec1 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.846068 Oct 04 18:42:05.330335 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1734/3406] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:42:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1856 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 18:42:05.335427 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0dea2c14-e1e0-405c-94ec-bebadcb3ffdc tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:05.336439 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0dea2c14-e1e0-405c-94ec-bebadcb3ffdc tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: cd97d817-422a-457d-b653-020350d75d6e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:05.343732 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0dea2c14-e1e0-405c-94ec-bebadcb3ffdc tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:05.344474 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0dea2c14-e1e0-405c-94ec-bebadcb3ffdc tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:05.345139 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0dea2c14-e1e0-405c-94ec-bebadcb3ffdc tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:05.345992 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0dea2c14-e1e0-405c-94ec-bebadcb3ffdc tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:05.346601 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0dea2c14-e1e0-405c-94ec-bebadcb3ffdc tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:05.347843 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0dea2c14-e1e0-405c-94ec-bebadcb3ffdc tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:05.561000 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-eee16ce2-c987-4c7f-b668-32691a8c4c23 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:42:05.562973 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-eee16ce2-c987-4c7f-b668-32691a8c4c23 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:42:05.563638 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-eee16ce2-c987-4c7f-b668-32691a8c4c23 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:42:05.565766 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-eee16ce2-c987-4c7f-b668-32691a8c4c23 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:42:05.566886 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-eee16ce2-c987-4c7f-b668-32691a8c4c23 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:42:05.582737 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eee16ce2-c987-4c7f-b668-32691a8c4c23 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:05.585233 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eee16ce2-c987-4c7f-b668-32691a8c4c23 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:05.585582 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eee16ce2-c987-4c7f-b668-32691a8c4c23 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:05.588346 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eee16ce2-c987-4c7f-b668-32691a8c4c23 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:05.589054 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eee16ce2-c987-4c7f-b668-32691a8c4c23 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:05.591803 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eee16ce2-c987-4c7f-b668-32691a8c4c23 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:05.642739 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-eee16ce2-c987-4c7f-b668-32691a8c4c23 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Getting quotas for project 1b43fba16115404aaa793fb907fd257f. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:42:05.658519 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-eee16ce2-c987-4c7f-b668-32691a8c4c23 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Getting quotas for user 777a7a51e45b498597f7a1202217575c and project 1b43fba16115404aaa793fb907fd257f. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:42:05.681536 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-eee16ce2-c987-4c7f-b668-32691a8c4c23 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Going to run 1 instances... {{(pid=123002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:42:05.681715 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0dea2c14-e1e0-405c-94ec-bebadcb3ffdc tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:05.681840 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-eee16ce2-c987-4c7f-b668-32691a8c4c23 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] [instance: e245e3c8-b2eb-4f0f-8dec-c7bc290bd356] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:42:05.695440 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0dea2c14-e1e0-405c-94ec-bebadcb3ffdc tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/cd97d817-422a-457d-b653-020350d75d6e" status: 200 len: 1521 microversion: 2.1 time: 0.361456 Oct 04 18:42:05.697506 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1735/3407] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:05 2022] GET /compute/v2.1/servers/cd97d817-422a-457d-b653-020350d75d6e => generated 1521 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:05.703473 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f346248f-db95-4975-a048-96fded0fc142 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:05.704420 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f346248f-db95-4975-a048-96fded0fc142 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] [instance: fc051dca-45a8-4241-b8a5-29b49903da93] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:05.715310 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f346248f-db95-4975-a048-96fded0fc142 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:05.716094 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f346248f-db95-4975-a048-96fded0fc142 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:05.716708 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f346248f-db95-4975-a048-96fded0fc142 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:05.717678 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f346248f-db95-4975-a048-96fded0fc142 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:05.718148 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f346248f-db95-4975-a048-96fded0fc142 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:05.718588 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f346248f-db95-4975-a048-96fded0fc142 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:05.846510 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f346248f-db95-4975-a048-96fded0fc142 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e2e6b962134c77b85f0c7ac8a6b746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd0b1764f314627906bcab7b4ed8a8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:05.855640 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f346248f-db95-4975-a048-96fded0fc142 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] 10.222.0.20 "GET /compute/v2.1/servers/fc051dca-45a8-4241-b8a5-29b49903da93" status: 200 len: 1272 microversion: 2.1 time: 0.156457 Oct 04 18:42:05.856256 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1736/3408] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:05 2022] GET /compute/v2.1/servers/fc051dca-45a8-4241-b8a5-29b49903da93 => generated 1272 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:05.861207 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d513e566-f127-40d6-a006-338876e07cc3 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:05.862010 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d513e566-f127-40d6-a006-338876e07cc3 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: af3e9546-9a60-424a-8d98-234b08364d1d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:05.951943 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d513e566-f127-40d6-a006-338876e07cc3 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:05.960492 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d513e566-f127-40d6-a006-338876e07cc3 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/af3e9546-9a60-424a-8d98-234b08364d1d" status: 200 len: 1220 microversion: 2.1 time: 0.103170 Oct 04 18:42:05.986346 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1737/3409] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:05 2022] GET /compute/v2.1/servers/af3e9546-9a60-424a-8d98-234b08364d1d => generated 1220 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:05.997892 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-eee16ce2-c987-4c7f-b668-32691a8c4c23 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.109209 Oct 04 18:42:06.001911 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1673/3410] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:42:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 2114 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:42:06.017013 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-eb048641-b454-4ca2-b25e-ef18b08947e6 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:06.018544 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-eb048641-b454-4ca2-b25e-ef18b08947e6 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] [instance: e245e3c8-b2eb-4f0f-8dec-c7bc290bd356] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:06.343186 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-eb048641-b454-4ca2-b25e-ef18b08947e6 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '777a7a51e45b498597f7a1202217575c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b43fba16115404aaa793fb907fd257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:06.352260 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-eb048641-b454-4ca2-b25e-ef18b08947e6 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] 10.222.0.20 "GET /compute/v2.1/servers/e245e3c8-b2eb-4f0f-8dec-c7bc290bd356" status: 200 len: 1215 microversion: 2.1 time: 0.338927 Oct 04 18:42:06.353037 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1738/3411] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:06 2022] GET /compute/v2.1/servers/e245e3c8-b2eb-4f0f-8dec-c7bc290bd356 => generated 1215 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:06.727915 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7c4f66a4-021a-4ee1-801b-97a7bac0911f tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:06.728890 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7c4f66a4-021a-4ee1-801b-97a7bac0911f tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: cd97d817-422a-457d-b653-020350d75d6e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:06.735735 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c4f66a4-021a-4ee1-801b-97a7bac0911f tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:06.736525 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c4f66a4-021a-4ee1-801b-97a7bac0911f tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:06.736962 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c4f66a4-021a-4ee1-801b-97a7bac0911f tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:06.738270 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c4f66a4-021a-4ee1-801b-97a7bac0911f tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:06.738438 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c4f66a4-021a-4ee1-801b-97a7bac0911f tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:06.739101 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c4f66a4-021a-4ee1-801b-97a7bac0911f tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:06.882277 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1ef93626-2f5b-4d4e-8758-73b8ebab8c20 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:06.883175 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1ef93626-2f5b-4d4e-8758-73b8ebab8c20 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] [instance: fc051dca-45a8-4241-b8a5-29b49903da93] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:06.891069 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1ef93626-2f5b-4d4e-8758-73b8ebab8c20 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:06.891928 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1ef93626-2f5b-4d4e-8758-73b8ebab8c20 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:06.892548 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1ef93626-2f5b-4d4e-8758-73b8ebab8c20 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:06.893745 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1ef93626-2f5b-4d4e-8758-73b8ebab8c20 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:06.894762 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1ef93626-2f5b-4d4e-8758-73b8ebab8c20 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:06.895413 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1ef93626-2f5b-4d4e-8758-73b8ebab8c20 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:07.065027 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1ef93626-2f5b-4d4e-8758-73b8ebab8c20 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e2e6b962134c77b85f0c7ac8a6b746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd0b1764f314627906bcab7b4ed8a8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:07.080807 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1ef93626-2f5b-4d4e-8758-73b8ebab8c20 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] 10.222.0.20 "GET /compute/v2.1/servers/fc051dca-45a8-4241-b8a5-29b49903da93" status: 200 len: 1272 microversion: 2.1 time: 0.204058 Oct 04 18:42:07.082839 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1739/3412] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:06 2022] GET /compute/v2.1/servers/fc051dca-45a8-4241-b8a5-29b49903da93 => generated 1272 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:07.091300 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e8422bcd-3765-4125-8914-4e77004c2ea9 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:07.093216 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e8422bcd-3765-4125-8914-4e77004c2ea9 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: af3e9546-9a60-424a-8d98-234b08364d1d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:07.104151 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e8422bcd-3765-4125-8914-4e77004c2ea9 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:07.104559 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e8422bcd-3765-4125-8914-4e77004c2ea9 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:07.105003 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e8422bcd-3765-4125-8914-4e77004c2ea9 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:07.105715 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e8422bcd-3765-4125-8914-4e77004c2ea9 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:07.106176 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e8422bcd-3765-4125-8914-4e77004c2ea9 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:07.106603 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e8422bcd-3765-4125-8914-4e77004c2ea9 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:07.232520 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7c4f66a4-021a-4ee1-801b-97a7bac0911f tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:07.243373 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7c4f66a4-021a-4ee1-801b-97a7bac0911f tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/cd97d817-422a-457d-b653-020350d75d6e" status: 200 len: 1521 microversion: 2.1 time: 0.521843 Oct 04 18:42:07.244026 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1674/3413] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:06 2022] GET /compute/v2.1/servers/cd97d817-422a-457d-b653-020350d75d6e => generated 1521 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:07.244440 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e8422bcd-3765-4125-8914-4e77004c2ea9 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:07.265093 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e8422bcd-3765-4125-8914-4e77004c2ea9 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/af3e9546-9a60-424a-8d98-234b08364d1d" status: 200 len: 1224 microversion: 2.1 time: 0.180359 Oct 04 18:42:07.265859 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1740/3414] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:07 2022] GET /compute/v2.1/servers/af3e9546-9a60-424a-8d98-234b08364d1d => generated 1224 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:07.376505 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2b367811-02eb-4a3c-9298-e5cad725c0f0 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:07.379048 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2b367811-02eb-4a3c-9298-e5cad725c0f0 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] [instance: e245e3c8-b2eb-4f0f-8dec-c7bc290bd356] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:07.387473 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2b367811-02eb-4a3c-9298-e5cad725c0f0 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:07.388199 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2b367811-02eb-4a3c-9298-e5cad725c0f0 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:07.388662 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2b367811-02eb-4a3c-9298-e5cad725c0f0 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:07.389906 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2b367811-02eb-4a3c-9298-e5cad725c0f0 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:07.390361 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2b367811-02eb-4a3c-9298-e5cad725c0f0 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:07.391077 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2b367811-02eb-4a3c-9298-e5cad725c0f0 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:07.417135 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5660e77b-a8db-414c-a4ee-621d60d6c9bc tempest-TenantUsagesNegativeTestJSON-1210921814 tempest-TenantUsagesNegativeTestJSON-1210921814-project-admin] 10.222.0.20 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-03T18%3A42%3A07.159618&end=2022-10-05T18%3A42%3A07.159618" status: 404 len: 112 microversion: - time: 0.171404 Oct 04 18:42:07.418145 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1675/3415] 10.222.0.20 () {58 vars in 1316 bytes} [Tue Oct 4 18:42:07 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-03T18%3A42%3A07.159618&end=2022-10-05T18%3A42%3A07.159618 => generated 112 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 04 18:42:07.427629 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2e549194-5d48-4c4f-b5a8-84c6aac817ba tempest-TenantUsagesNegativeTestJSON-1210921814 tempest-TenantUsagesNegativeTestJSON-1210921814-project-admin] Calling method '.version_select at 0x7fe253f15670>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:07.434300 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-2e549194-5d48-4c4f-b5a8-84c6aac817ba tempest-TenantUsagesNegativeTestJSON-1210921814 tempest-TenantUsagesNegativeTestJSON-1210921814-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Oct 04 18:42:07.441966 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2e549194-5d48-4c4f-b5a8-84c6aac817ba tempest-TenantUsagesNegativeTestJSON-1210921814 tempest-TenantUsagesNegativeTestJSON-1210921814-project-admin] Request method failure captured: Oct 04 18:42:07.441966 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/os-simple-tenant-usage/6d11c80e64a3442484030f8460cf1571?start=2022-10-05T18%3A42%3A07.159618&end=2022-10-03T18%3A42%3A07.159618 HTTP/1.1 Oct 04 18:42:07.441966 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:42:07.441966 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:42:07.441966 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:42:07.441966 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:42:07.441966 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:42:07.441966 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:42:07.441966 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:42:07.441966 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:42:07.441966 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH5_dV4BQXhxJ3InwyOeAwcHb_qVZIauBGvrWLIUVKxR8677QxYg8q52F4AN795zGTxljfPNOdcuqRhqDQzHN2ooKu444dswbOXZmmpwAIvHtZYZA-c5nRNrlZ5Qt5GG3xZiPATIq4AE7Cjz0BX5ccU_kTGZGUBpTc2zNV8GjsRrwgQ Oct 04 18:42:07.441966 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:42:07.441966 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:42:07.441966 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:42:07.441966 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:42:07.441966 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:42:07.441966 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:42:07.441966 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 7ba80b28d3404c3199663a5450f817a5 Oct 04 18:42:07.441966 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1210921814 Oct 04 18:42:07.441966 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member,admin Oct 04 18:42:07.441966 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member,admin Oct 04 18:42:07.441966 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7ba80b28d3404c3199663a5450f817a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7ba80b28d3404c3199663a5450f817a5", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7ba80b28d3404c3199663a5450f817a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7ba80b28d3404c3199663a5450f817a5"}]}] Oct 04 18:42:07.441966 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1210921814 Oct 04 18:42:07.441966 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 7ba80b28d3404c3199663a5450f817a5 Oct 04 18:42:07.441966 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1210921814 Oct 04 18:42:07.441966 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-TenantUsagesNegativeTestJSON-1210921814-project-admin Oct 04 18:42:07.441966 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:42:07.441966 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:42:07.441966 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 1385a0019fca4d87940875b7b7403ea4 Oct 04 18:42:07.441966 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1210921814-project-admin Oct 04 18:42:07.441966 n-d-850501-14 devstack@n-api.service[123002]: method: Oct 04 18:42:07.441966 n-d-850501-14 devstack@n-api.service[123002]: exception: Invalid start time. The start time cannot occur after the end time. Oct 04 18:42:07.441966 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '6d11c80e64a3442484030f8460cf1571'} Oct 04 18:42:07.441966 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:42:07.441966 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:07.441966 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:42:07.441966 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:42:07.441966 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:42:07.441966 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:42:07.441966 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:42:07.441966 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:42:07.441966 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:42:07.441966 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:42:07.441966 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:42:07.441966 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:42:07.441966 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Oct 04 18:42:07.441966 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 04 18:42:07.441966 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Oct 04 18:42:07.441966 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Oct 04 18:42:07.441966 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Oct 04 18:42:07.441966 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 04 18:42:07.441966 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Oct 04 18:42:07.441966 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:07.441966 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:42:07.441966 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:07.441966 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:07.441966 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:42:07.441966 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:42:07.441966 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:42:07.441966 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:42:07.441966 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Oct 04 18:42:07.441966 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:07.448636 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2e549194-5d48-4c4f-b5a8-84c6aac817ba tempest-TenantUsagesNegativeTestJSON-1210921814 tempest-TenantUsagesNegativeTestJSON-1210921814-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:42:07.448636 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2e549194-5d48-4c4f-b5a8-84c6aac817ba tempest-TenantUsagesNegativeTestJSON-1210921814 tempest-TenantUsagesNegativeTestJSON-1210921814-project-admin] 10.222.0.20 "GET /compute/v2.1/os-simple-tenant-usage/6d11c80e64a3442484030f8460cf1571?start=2022-10-05T18%3A42%3A07.159618&end=2022-10-03T18%3A42%3A07.159618" status: 400 len: 111 microversion: 2.1 time: 0.022910 Oct 04 18:42:07.448636 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1676/3416] 10.222.0.20 () {58 vars in 1412 bytes} [Tue Oct 4 18:42:07 2022] GET /compute/v2.1/os-simple-tenant-usage/6d11c80e64a3442484030f8460cf1571?start=2022-10-05T18%3A42%3A07.159618&end=2022-10-03T18%3A42%3A07.159618 => generated 111 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 04 18:42:07.509790 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-2b367811-02eb-4a3c-9298-e5cad725c0f0 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '777a7a51e45b498597f7a1202217575c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b43fba16115404aaa793fb907fd257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:07.524607 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2b367811-02eb-4a3c-9298-e5cad725c0f0 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] 10.222.0.20 "GET /compute/v2.1/servers/e245e3c8-b2eb-4f0f-8dec-c7bc290bd356" status: 200 len: 1219 microversion: 2.1 time: 0.152577 Oct 04 18:42:07.526065 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1741/3417] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:07 2022] GET /compute/v2.1/servers/e245e3c8-b2eb-4f0f-8dec-c7bc290bd356 => generated 1219 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:42:07.613028 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ff3f8b56-a352-4d47-a37c-e2987a26ae7e tempest-TenantUsagesNegativeTestJSON-1249571103 tempest-TenantUsagesNegativeTestJSON-1249571103-project] Calling method '.version_select at 0x7fe253f1b0d0>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:07.616661 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ff3f8b56-a352-4d47-a37c-e2987a26ae7e tempest-TenantUsagesNegativeTestJSON-1249571103 tempest-TenantUsagesNegativeTestJSON-1249571103-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '9357d13c8b0a4e09956454f25bc3de75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d11c80e64a3442484030f8460cf1571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:07.619198 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ff3f8b56-a352-4d47-a37c-e2987a26ae7e tempest-TenantUsagesNegativeTestJSON-1249571103 tempest-TenantUsagesNegativeTestJSON-1249571103-project] Request method failure captured: Oct 04 18:42:07.619198 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-03T18%3A42%3A07.159618&end=2022-10-05T18%3A42%3A07.159618&detailed=1 HTTP/1.1 Oct 04 18:42:07.619198 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:42:07.619198 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:42:07.619198 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:42:07.619198 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:42:07.619198 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:42:07.619198 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:42:07.619198 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:42:07.619198 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:42:07.619198 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH5-R61hNTjr727PQw7nFNT34Ds-IfLec07VNQSNL-Mbi2X5U-kynE2Pk5hJzVN9phAliFY1tcnIfdq6fz9b3D-1g2vI5dfGr1TV8cT4dsl5hQtHnrg2pd_LDtNwtqrUqssrDamJgzTMNxNzpvGbEbxZvutrZKSAkm0_PmUh2vW59ZQ Oct 04 18:42:07.619198 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:42:07.619198 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:42:07.619198 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:42:07.619198 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:42:07.619198 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:42:07.619198 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:42:07.619198 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 6d11c80e64a3442484030f8460cf1571 Oct 04 18:42:07.619198 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1249571103 Oct 04 18:42:07.619198 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:42:07.619198 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:42:07.619198 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6d11c80e64a3442484030f8460cf1571"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6d11c80e64a3442484030f8460cf1571", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6d11c80e64a3442484030f8460cf1571"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6d11c80e64a3442484030f8460cf1571"}]}] Oct 04 18:42:07.619198 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1249571103 Oct 04 18:42:07.619198 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 6d11c80e64a3442484030f8460cf1571 Oct 04 18:42:07.619198 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1249571103 Oct 04 18:42:07.619198 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-TenantUsagesNegativeTestJSON-1249571103-project Oct 04 18:42:07.619198 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:42:07.619198 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:42:07.619198 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 9357d13c8b0a4e09956454f25bc3de75 Oct 04 18:42:07.619198 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1249571103-project Oct 04 18:42:07.619198 n-d-850501-14 devstack@n-api.service[123002]: method: Oct 04 18:42:07.619198 n-d-850501-14 devstack@n-api.service[123002]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 04 18:42:07.619198 n-d-850501-14 devstack@n-api.service[123002]: action_args: {} Oct 04 18:42:07.619198 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:42:07.619198 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:07.619198 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:42:07.619198 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:42:07.619198 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:42:07.619198 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:42:07.619198 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:42:07.619198 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:42:07.619198 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:42:07.619198 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:42:07.619198 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:42:07.619198 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:42:07.619198 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Oct 04 18:42:07.619198 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 04 18:42:07.619198 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Oct 04 18:42:07.619198 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Oct 04 18:42:07.619198 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:42:07.619198 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:42:07.619198 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:42:07.619198 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:42:07.619198 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:42:07.619198 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:42:07.619198 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:42:07.619198 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:42:07.619198 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:42:07.619198 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:42:07.619198 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:42:07.619198 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:42:07.619198 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:42:07.633268 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:42:07.633268 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 04 18:42:07.633268 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:07.633268 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:42:07.633268 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:07.633268 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:07.633268 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:42:07.633268 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:42:07.633268 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:42:07.633268 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:42:07.633268 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 04 18:42:07.633268 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:07.633268 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ff3f8b56-a352-4d47-a37c-e2987a26ae7e tempest-TenantUsagesNegativeTestJSON-1249571103 tempest-TenantUsagesNegativeTestJSON-1249571103-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:42:07.633268 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ff3f8b56-a352-4d47-a37c-e2987a26ae7e tempest-TenantUsagesNegativeTestJSON-1249571103 tempest-TenantUsagesNegativeTestJSON-1249571103-project] 10.222.0.20 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-03T18%3A42%3A07.159618&end=2022-10-05T18%3A42%3A07.159618&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.166265 Oct 04 18:42:07.633268 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1677/3418] 10.222.0.20 () {58 vars in 1335 bytes} [Tue Oct 4 18:42:07 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-03T18%3A42%3A07.159618&end=2022-10-05T18%3A42%3A07.159618&detailed=1 => generated 123 bytes in 168 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:42:08.105875 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-967b2bc9-b7b5-43b3-bacf-4fe3fbac0329 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:08.106599 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-967b2bc9-b7b5-43b3-bacf-4fe3fbac0329 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] [instance: fc051dca-45a8-4241-b8a5-29b49903da93] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:08.128997 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-967b2bc9-b7b5-43b3-bacf-4fe3fbac0329 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:08.131016 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-967b2bc9-b7b5-43b3-bacf-4fe3fbac0329 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:08.132007 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-967b2bc9-b7b5-43b3-bacf-4fe3fbac0329 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:08.139789 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-967b2bc9-b7b5-43b3-bacf-4fe3fbac0329 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:08.144312 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-967b2bc9-b7b5-43b3-bacf-4fe3fbac0329 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:08.145683 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-967b2bc9-b7b5-43b3-bacf-4fe3fbac0329 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:08.277040 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-46f60bad-2539-457c-b842-6940dedf16a1 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:08.278256 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-46f60bad-2539-457c-b842-6940dedf16a1 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: cd97d817-422a-457d-b653-020350d75d6e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:08.291246 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-46f60bad-2539-457c-b842-6940dedf16a1 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:08.293114 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-46f60bad-2539-457c-b842-6940dedf16a1 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:08.293738 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-46f60bad-2539-457c-b842-6940dedf16a1 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:08.294956 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-46f60bad-2539-457c-b842-6940dedf16a1 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:08.295586 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-46f60bad-2539-457c-b842-6940dedf16a1 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:08.296681 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-46f60bad-2539-457c-b842-6940dedf16a1 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:08.808446 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-967b2bc9-b7b5-43b3-bacf-4fe3fbac0329 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e2e6b962134c77b85f0c7ac8a6b746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd0b1764f314627906bcab7b4ed8a8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:08.819571 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-967b2bc9-b7b5-43b3-bacf-4fe3fbac0329 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] 10.222.0.20 "GET /compute/v2.1/servers/fc051dca-45a8-4241-b8a5-29b49903da93" status: 200 len: 1314 microversion: 2.1 time: 0.717731 Oct 04 18:42:08.840719 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1742/3419] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:08 2022] GET /compute/v2.1/servers/fc051dca-45a8-4241-b8a5-29b49903da93 => generated 1314 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:08.849200 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1da76163-04bf-436a-8572-b8b9a35f4245 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:08.850598 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1da76163-04bf-436a-8572-b8b9a35f4245 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: af3e9546-9a60-424a-8d98-234b08364d1d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:08.857935 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1da76163-04bf-436a-8572-b8b9a35f4245 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:08.859041 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1da76163-04bf-436a-8572-b8b9a35f4245 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:08.859728 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1da76163-04bf-436a-8572-b8b9a35f4245 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:08.861224 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1da76163-04bf-436a-8572-b8b9a35f4245 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:08.861959 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1da76163-04bf-436a-8572-b8b9a35f4245 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:08.862724 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1da76163-04bf-436a-8572-b8b9a35f4245 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:09.051263 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1da76163-04bf-436a-8572-b8b9a35f4245 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:09.060870 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-46f60bad-2539-457c-b842-6940dedf16a1 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:09.066497 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1da76163-04bf-436a-8572-b8b9a35f4245 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/af3e9546-9a60-424a-8d98-234b08364d1d" status: 200 len: 1290 microversion: 2.1 time: 0.221759 Oct 04 18:42:09.068799 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1743/3420] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:08 2022] GET /compute/v2.1/servers/af3e9546-9a60-424a-8d98-234b08364d1d => generated 1290 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:09.082808 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d245ec3d-8e28-456f-b960-75cf2468e6c8 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:09.098156 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d245ec3d-8e28-456f-b960-75cf2468e6c8 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] [instance: e245e3c8-b2eb-4f0f-8dec-c7bc290bd356] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:09.098344 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-46f60bad-2539-457c-b842-6940dedf16a1 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/cd97d817-422a-457d-b653-020350d75d6e" status: 200 len: 1521 microversion: 2.1 time: 0.818934 Oct 04 18:42:09.098344 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1678/3421] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:08 2022] GET /compute/v2.1/servers/cd97d817-422a-457d-b653-020350d75d6e => generated 1521 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:09.106319 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d245ec3d-8e28-456f-b960-75cf2468e6c8 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:09.108603 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d245ec3d-8e28-456f-b960-75cf2468e6c8 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:09.109687 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d245ec3d-8e28-456f-b960-75cf2468e6c8 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:09.111327 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d245ec3d-8e28-456f-b960-75cf2468e6c8 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:09.111985 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d245ec3d-8e28-456f-b960-75cf2468e6c8 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:09.113598 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d245ec3d-8e28-456f-b960-75cf2468e6c8 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:09.292219 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d245ec3d-8e28-456f-b960-75cf2468e6c8 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '777a7a51e45b498597f7a1202217575c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b43fba16115404aaa793fb907fd257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:09.296033 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d245ec3d-8e28-456f-b960-75cf2468e6c8 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] 10.222.0.20 "GET /compute/v2.1/servers/e245e3c8-b2eb-4f0f-8dec-c7bc290bd356" status: 200 len: 1267 microversion: 2.1 time: 0.222394 Oct 04 18:42:09.296675 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1744/3422] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:09 2022] GET /compute/v2.1/servers/e245e3c8-b2eb-4f0f-8dec-c7bc290bd356 => generated 1267 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:09.850624 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-bb636512-52b2-4141-b074-429ae1a2df8e tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:09.852041 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-bb636512-52b2-4141-b074-429ae1a2df8e tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] [instance: fc051dca-45a8-4241-b8a5-29b49903da93] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:09.872533 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bb636512-52b2-4141-b074-429ae1a2df8e tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:09.873062 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bb636512-52b2-4141-b074-429ae1a2df8e tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:09.879676 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bb636512-52b2-4141-b074-429ae1a2df8e tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:09.880830 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bb636512-52b2-4141-b074-429ae1a2df8e tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:09.881403 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bb636512-52b2-4141-b074-429ae1a2df8e tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:09.881853 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bb636512-52b2-4141-b074-429ae1a2df8e tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:10.097342 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d46ccb2b-5eb6-41e1-abfd-1a65c4deffd1 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:10.099059 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d46ccb2b-5eb6-41e1-abfd-1a65c4deffd1 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: af3e9546-9a60-424a-8d98-234b08364d1d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:10.108291 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d46ccb2b-5eb6-41e1-abfd-1a65c4deffd1 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:10.109259 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d46ccb2b-5eb6-41e1-abfd-1a65c4deffd1 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:10.110183 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d46ccb2b-5eb6-41e1-abfd-1a65c4deffd1 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:10.111688 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d46ccb2b-5eb6-41e1-abfd-1a65c4deffd1 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:10.113136 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d46ccb2b-5eb6-41e1-abfd-1a65c4deffd1 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:10.113785 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d46ccb2b-5eb6-41e1-abfd-1a65c4deffd1 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:10.280132 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d46ccb2b-5eb6-41e1-abfd-1a65c4deffd1 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:10.289557 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d46ccb2b-5eb6-41e1-abfd-1a65c4deffd1 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/af3e9546-9a60-424a-8d98-234b08364d1d" status: 200 len: 1278 microversion: 2.1 time: 0.197311 Oct 04 18:42:10.289770 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-bb636512-52b2-4141-b074-429ae1a2df8e tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e2e6b962134c77b85f0c7ac8a6b746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd0b1764f314627906bcab7b4ed8a8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:10.291149 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1745/3423] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:10 2022] GET /compute/v2.1/servers/af3e9546-9a60-424a-8d98-234b08364d1d => generated 1278 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:10.301545 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b2105cad-1d54-497e-a66a-199d5f5d069f tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:10.302644 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b2105cad-1d54-497e-a66a-199d5f5d069f tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: cd97d817-422a-457d-b653-020350d75d6e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:10.306196 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-bb636512-52b2-4141-b074-429ae1a2df8e tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] 10.222.0.20 "GET /compute/v2.1/servers/fc051dca-45a8-4241-b8a5-29b49903da93" status: 200 len: 1314 microversion: 2.1 time: 0.462423 Oct 04 18:42:10.306798 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1679/3424] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:09 2022] GET /compute/v2.1/servers/fc051dca-45a8-4241-b8a5-29b49903da93 => generated 1314 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:42:10.326992 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7915210d-b543-42dd-a7b6-2a7cc53aad87 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:10.327721 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7915210d-b543-42dd-a7b6-2a7cc53aad87 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] [instance: e245e3c8-b2eb-4f0f-8dec-c7bc290bd356] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:10.335306 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b2105cad-1d54-497e-a66a-199d5f5d069f tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:10.335577 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7915210d-b543-42dd-a7b6-2a7cc53aad87 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:10.336310 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7915210d-b543-42dd-a7b6-2a7cc53aad87 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:10.336981 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7915210d-b543-42dd-a7b6-2a7cc53aad87 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:10.337111 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b2105cad-1d54-497e-a66a-199d5f5d069f tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:10.337642 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b2105cad-1d54-497e-a66a-199d5f5d069f tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:10.338189 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7915210d-b543-42dd-a7b6-2a7cc53aad87 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:10.339051 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b2105cad-1d54-497e-a66a-199d5f5d069f tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:10.339244 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7915210d-b543-42dd-a7b6-2a7cc53aad87 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:10.339833 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7915210d-b543-42dd-a7b6-2a7cc53aad87 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:10.339959 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b2105cad-1d54-497e-a66a-199d5f5d069f tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:10.340537 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b2105cad-1d54-497e-a66a-199d5f5d069f tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:10.490308 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7915210d-b543-42dd-a7b6-2a7cc53aad87 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '777a7a51e45b498597f7a1202217575c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b43fba16115404aaa793fb907fd257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:10.501446 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7915210d-b543-42dd-a7b6-2a7cc53aad87 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] 10.222.0.20 "GET /compute/v2.1/servers/e245e3c8-b2eb-4f0f-8dec-c7bc290bd356" status: 200 len: 1273 microversion: 2.1 time: 0.182395 Oct 04 18:42:10.502285 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1680/3425] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:10 2022] GET /compute/v2.1/servers/e245e3c8-b2eb-4f0f-8dec-c7bc290bd356 => generated 1273 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:10.661920 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b2105cad-1d54-497e-a66a-199d5f5d069f tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:10.669975 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b2105cad-1d54-497e-a66a-199d5f5d069f tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/cd97d817-422a-457d-b653-020350d75d6e" status: 200 len: 1521 microversion: 2.1 time: 0.377565 Oct 04 18:42:10.670559 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1746/3426] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:10 2022] GET /compute/v2.1/servers/cd97d817-422a-457d-b653-020350d75d6e => generated 1521 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:11.161991 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-e297903d-ba5e-4c6f-88c2-5be118c2012f req-bba25776-5c5a-4015-97ee-2afdca413551 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc051dca-45a8-4241-b8a5-29b49903da93", "tag": "e9c024cc-8326-49d2-a3f0-1c293e02d3ca"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:11.176607 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-e297903d-ba5e-4c6f-88c2-5be118c2012f req-bba25776-5c5a-4015-97ee-2afdca413551 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:11.177178 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-e297903d-ba5e-4c6f-88c2-5be118c2012f req-bba25776-5c5a-4015-97ee-2afdca413551 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:11.177984 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-e297903d-ba5e-4c6f-88c2-5be118c2012f req-bba25776-5c5a-4015-97ee-2afdca413551 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:11.196720 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-e297903d-ba5e-4c6f-88c2-5be118c2012f req-bba25776-5c5a-4015-97ee-2afdca413551 service nova] Creating event network-changed:e9c024cc-8326-49d2-a3f0-1c293e02d3ca for instance fc051dca-45a8-4241-b8a5-29b49903da93 on n-h1-850501-14 Oct 04 18:42:11.203427 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-e297903d-ba5e-4c6f-88c2-5be118c2012f req-bba25776-5c5a-4015-97ee-2afdca413551 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049030 Oct 04 18:42:11.207436 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1681/3427] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:42:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:42:11.331427 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-fa4b3660-96a3-4d2a-a6bf-25e35e002eb6 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:11.332612 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-fa4b3660-96a3-4d2a-a6bf-25e35e002eb6 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: af3e9546-9a60-424a-8d98-234b08364d1d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:11.340317 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fa4b3660-96a3-4d2a-a6bf-25e35e002eb6 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:11.340988 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fa4b3660-96a3-4d2a-a6bf-25e35e002eb6 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:11.341591 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fa4b3660-96a3-4d2a-a6bf-25e35e002eb6 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:11.342565 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fa4b3660-96a3-4d2a-a6bf-25e35e002eb6 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:11.343187 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fa4b3660-96a3-4d2a-a6bf-25e35e002eb6 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:11.345795 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fa4b3660-96a3-4d2a-a6bf-25e35e002eb6 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:11.345942 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-80101adc-70dd-41d5-9942-a87eab6c62a3 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:11.345942 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-80101adc-70dd-41d5-9942-a87eab6c62a3 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] [instance: fc051dca-45a8-4241-b8a5-29b49903da93] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:11.356922 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-80101adc-70dd-41d5-9942-a87eab6c62a3 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:11.360390 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-80101adc-70dd-41d5-9942-a87eab6c62a3 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:11.361215 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-80101adc-70dd-41d5-9942-a87eab6c62a3 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:11.362237 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-80101adc-70dd-41d5-9942-a87eab6c62a3 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:11.363552 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-80101adc-70dd-41d5-9942-a87eab6c62a3 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:11.364540 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-80101adc-70dd-41d5-9942-a87eab6c62a3 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:12.163517 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-80101adc-70dd-41d5-9942-a87eab6c62a3 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e2e6b962134c77b85f0c7ac8a6b746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd0b1764f314627906bcab7b4ed8a8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:12.173991 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-fa4b3660-96a3-4d2a-a6bf-25e35e002eb6 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:12.177948 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-80101adc-70dd-41d5-9942-a87eab6c62a3 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] 10.222.0.20 "GET /compute/v2.1/servers/fc051dca-45a8-4241-b8a5-29b49903da93" status: 200 len: 1314 microversion: 2.1 time: 0.834944 Oct 04 18:42:12.182472 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-fa4b3660-96a3-4d2a-a6bf-25e35e002eb6 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/af3e9546-9a60-424a-8d98-234b08364d1d" status: 200 len: 1320 microversion: 2.1 time: 0.854950 Oct 04 18:42:12.188681 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1747/3428] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:11 2022] GET /compute/v2.1/servers/af3e9546-9a60-424a-8d98-234b08364d1d => generated 1320 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:12.191973 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1682/3429] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:11 2022] GET /compute/v2.1/servers/fc051dca-45a8-4241-b8a5-29b49903da93 => generated 1314 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:12.198541 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b8eca3b9-be2e-4039-83a5-a72143c3b638 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:12.199150 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b8eca3b9-be2e-4039-83a5-a72143c3b638 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] [instance: e245e3c8-b2eb-4f0f-8dec-c7bc290bd356] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:12.217386 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b8eca3b9-be2e-4039-83a5-a72143c3b638 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:12.217933 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b8eca3b9-be2e-4039-83a5-a72143c3b638 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:12.218480 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b8eca3b9-be2e-4039-83a5-a72143c3b638 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:12.219247 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b8eca3b9-be2e-4039-83a5-a72143c3b638 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:12.219351 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0b6c6223-419d-4e11-9a46-d163398f2aa1 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:12.219574 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b8eca3b9-be2e-4039-83a5-a72143c3b638 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:12.219994 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b8eca3b9-be2e-4039-83a5-a72143c3b638 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:12.221084 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0b6c6223-419d-4e11-9a46-d163398f2aa1 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: cd97d817-422a-457d-b653-020350d75d6e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:12.235515 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0b6c6223-419d-4e11-9a46-d163398f2aa1 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:12.237060 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0b6c6223-419d-4e11-9a46-d163398f2aa1 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:12.238720 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0b6c6223-419d-4e11-9a46-d163398f2aa1 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:12.240283 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0b6c6223-419d-4e11-9a46-d163398f2aa1 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:12.241944 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0b6c6223-419d-4e11-9a46-d163398f2aa1 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:12.243092 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0b6c6223-419d-4e11-9a46-d163398f2aa1 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:12.645064 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b8eca3b9-be2e-4039-83a5-a72143c3b638 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '777a7a51e45b498597f7a1202217575c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b43fba16115404aaa793fb907fd257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:12.650558 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0b6c6223-419d-4e11-9a46-d163398f2aa1 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:12.665344 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0b6c6223-419d-4e11-9a46-d163398f2aa1 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/cd97d817-422a-457d-b653-020350d75d6e" status: 200 len: 1521 microversion: 2.1 time: 0.470360 Oct 04 18:42:12.666473 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b8eca3b9-be2e-4039-83a5-a72143c3b638 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] 10.222.0.20 "GET /compute/v2.1/servers/e245e3c8-b2eb-4f0f-8dec-c7bc290bd356" status: 200 len: 1315 microversion: 2.1 time: 0.475508 Oct 04 18:42:12.668724 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1683/3430] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:12 2022] GET /compute/v2.1/servers/cd97d817-422a-457d-b653-020350d75d6e => generated 1521 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:12.676959 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1748/3431] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:12 2022] GET /compute/v2.1/servers/e245e3c8-b2eb-4f0f-8dec-c7bc290bd356 => generated 1315 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:13.232026 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-471b95e4-9cbd-4e14-a2be-d3a839b2ce44 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:13.233379 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-18f91106-b57b-4d43-b6c8-a295ca4befe4 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:13.234005 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-18f91106-b57b-4d43-b6c8-a295ca4befe4 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] [instance: fc051dca-45a8-4241-b8a5-29b49903da93] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:13.234782 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-471b95e4-9cbd-4e14-a2be-d3a839b2ce44 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: af3e9546-9a60-424a-8d98-234b08364d1d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:13.250169 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-18f91106-b57b-4d43-b6c8-a295ca4befe4 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:13.250640 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-471b95e4-9cbd-4e14-a2be-d3a839b2ce44 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:13.251376 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-471b95e4-9cbd-4e14-a2be-d3a839b2ce44 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:13.251890 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-471b95e4-9cbd-4e14-a2be-d3a839b2ce44 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:13.252660 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-471b95e4-9cbd-4e14-a2be-d3a839b2ce44 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:13.254780 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-471b95e4-9cbd-4e14-a2be-d3a839b2ce44 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:13.255024 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-18f91106-b57b-4d43-b6c8-a295ca4befe4 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:13.255677 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-18f91106-b57b-4d43-b6c8-a295ca4befe4 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:13.256341 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-471b95e4-9cbd-4e14-a2be-d3a839b2ce44 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:13.260211 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-18f91106-b57b-4d43-b6c8-a295ca4befe4 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:13.260211 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-18f91106-b57b-4d43-b6c8-a295ca4befe4 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:13.260211 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-18f91106-b57b-4d43-b6c8-a295ca4befe4 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:13.601004 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-471b95e4-9cbd-4e14-a2be-d3a839b2ce44 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:13.609736 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-471b95e4-9cbd-4e14-a2be-d3a839b2ce44 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/af3e9546-9a60-424a-8d98-234b08364d1d" status: 200 len: 1320 microversion: 2.1 time: 0.394503 Oct 04 18:42:13.616371 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1749/3432] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:13 2022] GET /compute/v2.1/servers/af3e9546-9a60-424a-8d98-234b08364d1d => generated 1320 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:13.621647 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-22d048e5-8fe7-4d4d-8c4b-521685323a53 req-7685e847-0392-4b8d-b9fb-b5893c167a42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af3e9546-9a60-424a-8d98-234b08364d1d", "tag": "10a557bc-1e48-40fa-94eb-267f53693475"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:13.642034 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-22d048e5-8fe7-4d4d-8c4b-521685323a53 req-7685e847-0392-4b8d-b9fb-b5893c167a42 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:13.643009 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-22d048e5-8fe7-4d4d-8c4b-521685323a53 req-7685e847-0392-4b8d-b9fb-b5893c167a42 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:13.644696 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-22d048e5-8fe7-4d4d-8c4b-521685323a53 req-7685e847-0392-4b8d-b9fb-b5893c167a42 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:13.657601 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-22d048e5-8fe7-4d4d-8c4b-521685323a53 req-7685e847-0392-4b8d-b9fb-b5893c167a42 service nova] Creating event network-changed:10a557bc-1e48-40fa-94eb-267f53693475 for instance af3e9546-9a60-424a-8d98-234b08364d1d on n-h2-850501-14 Oct 04 18:42:13.663899 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-22d048e5-8fe7-4d4d-8c4b-521685323a53 req-7685e847-0392-4b8d-b9fb-b5893c167a42 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045803 Oct 04 18:42:13.664975 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1750/3433] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:42:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:42:13.680797 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-18f91106-b57b-4d43-b6c8-a295ca4befe4 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e2e6b962134c77b85f0c7ac8a6b746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd0b1764f314627906bcab7b4ed8a8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:13.689876 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-18f91106-b57b-4d43-b6c8-a295ca4befe4 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] 10.222.0.20 "GET /compute/v2.1/servers/fc051dca-45a8-4241-b8a5-29b49903da93" status: 200 len: 1314 microversion: 2.1 time: 0.476651 Oct 04 18:42:13.690811 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1684/3434] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:13 2022] GET /compute/v2.1/servers/fc051dca-45a8-4241-b8a5-29b49903da93 => generated 1314 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:42:13.691018 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8a601116-4ec0-4cf0-af84-9e60c9c7e045 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:13.691869 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8a601116-4ec0-4cf0-af84-9e60c9c7e045 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] [instance: e245e3c8-b2eb-4f0f-8dec-c7bc290bd356] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:13.696817 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-668988d0-9378-4dea-b1f8-8e4000aa9edb tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:13.697788 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-668988d0-9378-4dea-b1f8-8e4000aa9edb tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: cd97d817-422a-457d-b653-020350d75d6e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:13.704360 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-668988d0-9378-4dea-b1f8-8e4000aa9edb tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:13.705073 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-668988d0-9378-4dea-b1f8-8e4000aa9edb tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:13.705376 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8a601116-4ec0-4cf0-af84-9e60c9c7e045 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:13.706412 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8a601116-4ec0-4cf0-af84-9e60c9c7e045 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:13.706829 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-668988d0-9378-4dea-b1f8-8e4000aa9edb tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:13.707827 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-668988d0-9378-4dea-b1f8-8e4000aa9edb tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:13.707973 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8a601116-4ec0-4cf0-af84-9e60c9c7e045 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:13.708334 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-668988d0-9378-4dea-b1f8-8e4000aa9edb tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:13.708837 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-668988d0-9378-4dea-b1f8-8e4000aa9edb tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:13.709748 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8a601116-4ec0-4cf0-af84-9e60c9c7e045 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:13.710263 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8a601116-4ec0-4cf0-af84-9e60c9c7e045 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:13.710705 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8a601116-4ec0-4cf0-af84-9e60c9c7e045 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:13.937648 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8a601116-4ec0-4cf0-af84-9e60c9c7e045 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '777a7a51e45b498597f7a1202217575c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b43fba16115404aaa793fb907fd257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:13.953217 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8a601116-4ec0-4cf0-af84-9e60c9c7e045 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] 10.222.0.20 "GET /compute/v2.1/servers/e245e3c8-b2eb-4f0f-8dec-c7bc290bd356" status: 200 len: 1315 microversion: 2.1 time: 0.266790 Oct 04 18:42:13.955473 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1751/3435] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:13 2022] GET /compute/v2.1/servers/e245e3c8-b2eb-4f0f-8dec-c7bc290bd356 => generated 1315 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:42:14.038504 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-668988d0-9378-4dea-b1f8-8e4000aa9edb tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:14.049039 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-668988d0-9378-4dea-b1f8-8e4000aa9edb tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/cd97d817-422a-457d-b653-020350d75d6e" status: 200 len: 1521 microversion: 2.1 time: 0.356585 Oct 04 18:42:14.050739 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1685/3436] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:13 2022] GET /compute/v2.1/servers/cd97d817-422a-457d-b653-020350d75d6e => generated 1521 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:14.643015 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3e738a54-1e18-4b35-8b62-6e98fbe2eef1 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:14.644457 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3e738a54-1e18-4b35-8b62-6e98fbe2eef1 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: af3e9546-9a60-424a-8d98-234b08364d1d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:14.655896 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3e738a54-1e18-4b35-8b62-6e98fbe2eef1 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:14.656422 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3e738a54-1e18-4b35-8b62-6e98fbe2eef1 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:14.657042 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3e738a54-1e18-4b35-8b62-6e98fbe2eef1 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:14.657974 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3e738a54-1e18-4b35-8b62-6e98fbe2eef1 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:14.659714 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3e738a54-1e18-4b35-8b62-6e98fbe2eef1 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:14.660381 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3e738a54-1e18-4b35-8b62-6e98fbe2eef1 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:14.717562 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8e84aa28-9ef5-4d6f-be87-d93348a64c0b tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:14.717921 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8e84aa28-9ef5-4d6f-be87-d93348a64c0b tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] [instance: fc051dca-45a8-4241-b8a5-29b49903da93] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:14.725304 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:42:14.739129 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8e84aa28-9ef5-4d6f-be87-d93348a64c0b tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:14.740560 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8e84aa28-9ef5-4d6f-be87-d93348a64c0b tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:14.741387 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8e84aa28-9ef5-4d6f-be87-d93348a64c0b tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:14.742528 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8e84aa28-9ef5-4d6f-be87-d93348a64c0b tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:14.744934 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8e84aa28-9ef5-4d6f-be87-d93348a64c0b tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:14.745385 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8e84aa28-9ef5-4d6f-be87-d93348a64c0b tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:14.984512 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3e738a54-1e18-4b35-8b62-6e98fbe2eef1 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:14.994845 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3e738a54-1e18-4b35-8b62-6e98fbe2eef1 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/af3e9546-9a60-424a-8d98-234b08364d1d" status: 200 len: 1320 microversion: 2.1 time: 0.355911 Oct 04 18:42:14.995431 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1752/3437] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:14 2022] GET /compute/v2.1/servers/af3e9546-9a60-424a-8d98-234b08364d1d => generated 1320 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:15.014362 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-df2ed388-ccf7-4a0c-83f8-803cdb2e9732 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:15.015561 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-df2ed388-ccf7-4a0c-83f8-803cdb2e9732 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] [instance: e245e3c8-b2eb-4f0f-8dec-c7bc290bd356] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:15.023932 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-df2ed388-ccf7-4a0c-83f8-803cdb2e9732 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:15.024473 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-df2ed388-ccf7-4a0c-83f8-803cdb2e9732 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:15.025085 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-df2ed388-ccf7-4a0c-83f8-803cdb2e9732 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:15.025851 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-df2ed388-ccf7-4a0c-83f8-803cdb2e9732 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:15.026316 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-df2ed388-ccf7-4a0c-83f8-803cdb2e9732 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:15.026750 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-df2ed388-ccf7-4a0c-83f8-803cdb2e9732 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:15.040404 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8e84aa28-9ef5-4d6f-be87-d93348a64c0b tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e2e6b962134c77b85f0c7ac8a6b746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd0b1764f314627906bcab7b4ed8a8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:15.053730 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8e84aa28-9ef5-4d6f-be87-d93348a64c0b tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] 10.222.0.20 "GET /compute/v2.1/servers/fc051dca-45a8-4241-b8a5-29b49903da93" status: 200 len: 1314 microversion: 2.1 time: 0.342606 Oct 04 18:42:15.070970 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1686/3438] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:14 2022] GET /compute/v2.1/servers/fc051dca-45a8-4241-b8a5-29b49903da93 => generated 1314 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:42:15.079149 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-68c1e849-2ea1-4298-a163-2ca1a07914a3 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:15.079765 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-68c1e849-2ea1-4298-a163-2ca1a07914a3 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: cd97d817-422a-457d-b653-020350d75d6e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:15.080852 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=10 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:42:15.087411 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-68c1e849-2ea1-4298-a163-2ca1a07914a3 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:15.088153 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-68c1e849-2ea1-4298-a163-2ca1a07914a3 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:15.088784 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-68c1e849-2ea1-4298-a163-2ca1a07914a3 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:15.090002 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-68c1e849-2ea1-4298-a163-2ca1a07914a3 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:15.090625 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-68c1e849-2ea1-4298-a163-2ca1a07914a3 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:15.091353 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-68c1e849-2ea1-4298-a163-2ca1a07914a3 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:15.326960 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-df2ed388-ccf7-4a0c-83f8-803cdb2e9732 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '777a7a51e45b498597f7a1202217575c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b43fba16115404aaa793fb907fd257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:15.331299 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=100 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:42:15.336355 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-df2ed388-ccf7-4a0c-83f8-803cdb2e9732 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] 10.222.0.20 "GET /compute/v2.1/servers/e245e3c8-b2eb-4f0f-8dec-c7bc290bd356" status: 200 len: 1315 microversion: 2.1 time: 0.328860 Oct 04 18:42:15.352594 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1753/3439] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:15 2022] GET /compute/v2.1/servers/e245e3c8-b2eb-4f0f-8dec-c7bc290bd356 => generated 1315 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:15.357037 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-68c1e849-2ea1-4298-a163-2ca1a07914a3 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:15.365072 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-68c1e849-2ea1-4298-a163-2ca1a07914a3 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/cd97d817-422a-457d-b653-020350d75d6e" status: 200 len: 1521 microversion: 2.1 time: 0.292716 Oct 04 18:42:15.365931 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1687/3440] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:15 2022] GET /compute/v2.1/servers/cd97d817-422a-457d-b653-020350d75d6e => generated 1521 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:15.591891 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c60b6f48-81a3-4620-a6c1-968587b192ae tempest-ImagesMetadataTestJSON-321833850 tempest-ImagesMetadataTestJSON-321833850-project] Calling method '.version_select at 0x7fe2580e3af0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:15.644631 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c60b6f48-81a3-4620-a6c1-968587b192ae tempest-ImagesMetadataTestJSON-321833850 tempest-ImagesMetadataTestJSON-321833850-project] 10.222.0.20 "GET /compute/v2.1/images/c2fee294-dda0-4e9d-bac4-8396d5113073" status: 200 len: 637 microversion: 2.1 time: 0.056049 Oct 04 18:42:15.647328 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1754/3441] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:42:15 2022] GET /compute/v2.1/images/c2fee294-dda0-4e9d-bac4-8396d5113073 => generated 637 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:42:15.662284 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-99a5eba2-9813-448b-b084-66e73aecac11 tempest-ImagesMetadataTestJSON-321833850 tempest-ImagesMetadataTestJSON-321833850-project] Action: 'update_all', calling method: .version_select at 0x7fe253e4d940>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:15.673499 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:42:15.676837 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=8 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:42:15.690010 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-4336ba44-20c9-4d73-a206-12bda62421f2 req-b8dd0cfc-113d-4af3-a646-e0084e516bd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e245e3c8-b2eb-4f0f-8dec-c7bc290bd356", "tag": "de5db3a4-1f99-4a92-a78e-f59449b5343b"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:15.704684 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-4336ba44-20c9-4d73-a206-12bda62421f2 req-b8dd0cfc-113d-4af3-a646-e0084e516bd2 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:15.704973 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-4336ba44-20c9-4d73-a206-12bda62421f2 req-b8dd0cfc-113d-4af3-a646-e0084e516bd2 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:15.705418 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-4336ba44-20c9-4d73-a206-12bda62421f2 req-b8dd0cfc-113d-4af3-a646-e0084e516bd2 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:15.737424 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-4336ba44-20c9-4d73-a206-12bda62421f2 req-b8dd0cfc-113d-4af3-a646-e0084e516bd2 service nova] Creating event network-changed:de5db3a4-1f99-4a92-a78e-f59449b5343b for instance e245e3c8-b2eb-4f0f-8dec-c7bc290bd356 on n-h2-850501-14 Oct 04 18:42:15.740032 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-99a5eba2-9813-448b-b084-66e73aecac11 tempest-ImagesMetadataTestJSON-321833850 tempest-ImagesMetadataTestJSON-321833850-project] Getting quotas for project a23165622fd848ae99ed5673b29a5b9a. Resources: dict_keys(['metadata_items']) {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:42:15.743151 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-4336ba44-20c9-4d73-a206-12bda62421f2 req-b8dd0cfc-113d-4af3-a646-e0084e516bd2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059485 Oct 04 18:42:15.743762 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1755/3442] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:42:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:42:15.746135 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-99a5eba2-9813-448b-b084-66e73aecac11 tempest-ImagesMetadataTestJSON-321833850 tempest-ImagesMetadataTestJSON-321833850-project] Getting quotas for user 5980ed1491e44e25933d6297feffc0c6 and project a23165622fd848ae99ed5673b29a5b9a. Resources: dict_keys(['metadata_items']) {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:42:16.020101 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5f34f618-9747-495f-b3eb-47164f52efc9 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:16.020722 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5f34f618-9747-495f-b3eb-47164f52efc9 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: af3e9546-9a60-424a-8d98-234b08364d1d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:16.030282 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5f34f618-9747-495f-b3eb-47164f52efc9 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:16.031011 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5f34f618-9747-495f-b3eb-47164f52efc9 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:16.031463 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5f34f618-9747-495f-b3eb-47164f52efc9 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:16.032210 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5f34f618-9747-495f-b3eb-47164f52efc9 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:16.032671 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5f34f618-9747-495f-b3eb-47164f52efc9 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:16.033266 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5f34f618-9747-495f-b3eb-47164f52efc9 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:16.251235 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-99a5eba2-9813-448b-b084-66e73aecac11 tempest-ImagesMetadataTestJSON-321833850 tempest-ImagesMetadataTestJSON-321833850-project] 10.222.0.20 "PUT /compute/v2.1/images/c2fee294-dda0-4e9d-bac4-8396d5113073/metadata" status: 200 len: 61 microversion: 2.1 time: 0.594285 Oct 04 18:42:16.254016 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1688/3443] 10.222.0.20 () {60 vars in 1280 bytes} [Tue Oct 4 18:42:15 2022] PUT /compute/v2.1/images/c2fee294-dda0-4e9d-bac4-8396d5113073/metadata => generated 61 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:42:16.265603 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-859a3351-6799-4956-93c1-70c8e7533a46 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:16.267209 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-859a3351-6799-4956-93c1-70c8e7533a46 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] [instance: fc051dca-45a8-4241-b8a5-29b49903da93] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:16.290232 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-859a3351-6799-4956-93c1-70c8e7533a46 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:16.290232 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-859a3351-6799-4956-93c1-70c8e7533a46 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:16.290232 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-859a3351-6799-4956-93c1-70c8e7533a46 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:16.290232 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-859a3351-6799-4956-93c1-70c8e7533a46 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:16.290232 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-859a3351-6799-4956-93c1-70c8e7533a46 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:16.290989 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-859a3351-6799-4956-93c1-70c8e7533a46 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:16.349404 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=26 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:42:16.793645 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5f34f618-9747-495f-b3eb-47164f52efc9 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:16.813213 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5f34f618-9747-495f-b3eb-47164f52efc9 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/af3e9546-9a60-424a-8d98-234b08364d1d" status: 200 len: 1320 microversion: 2.1 time: 0.797967 Oct 04 18:42:16.814399 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1756/3444] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:16 2022] GET /compute/v2.1/servers/af3e9546-9a60-424a-8d98-234b08364d1d => generated 1320 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:16.821244 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b24f0256-3ea7-4992-9abf-481449ee7a91 tempest-ImagesMetadataTestJSON-321833850 tempest-ImagesMetadataTestJSON-321833850-project] Calling method '.version_select at 0x7fe2594cee50>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:16.912942 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-859a3351-6799-4956-93c1-70c8e7533a46 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e2e6b962134c77b85f0c7ac8a6b746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd0b1764f314627906bcab7b4ed8a8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:16.923741 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-859a3351-6799-4956-93c1-70c8e7533a46 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] 10.222.0.20 "GET /compute/v2.1/servers/fc051dca-45a8-4241-b8a5-29b49903da93" status: 200 len: 1314 microversion: 2.1 time: 0.667492 Oct 04 18:42:16.927748 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1689/3445] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:16 2022] GET /compute/v2.1/servers/fc051dca-45a8-4241-b8a5-29b49903da93 => generated 1314 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:16.959996 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4b2e84d9-9566-4dd5-ae5e-a47a6627afeb tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:16.961379 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4b2e84d9-9566-4dd5-ae5e-a47a6627afeb tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] [instance: e245e3c8-b2eb-4f0f-8dec-c7bc290bd356] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:17.006097 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4b2e84d9-9566-4dd5-ae5e-a47a6627afeb tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:17.007140 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4b2e84d9-9566-4dd5-ae5e-a47a6627afeb tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:17.007809 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4b2e84d9-9566-4dd5-ae5e-a47a6627afeb tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:17.008668 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4b2e84d9-9566-4dd5-ae5e-a47a6627afeb tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:17.010267 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4b2e84d9-9566-4dd5-ae5e-a47a6627afeb tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:17.010891 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4b2e84d9-9566-4dd5-ae5e-a47a6627afeb tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:17.038222 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:42:17.283124 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b24f0256-3ea7-4992-9abf-481449ee7a91 tempest-ImagesMetadataTestJSON-321833850 tempest-ImagesMetadataTestJSON-321833850-project] 10.222.0.20 "DELETE /compute/v2.1/images/c2fee294-dda0-4e9d-bac4-8396d5113073/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.466340 Oct 04 18:42:17.283713 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1757/3446] 10.222.0.20 () {58 vars in 1296 bytes} [Tue Oct 4 18:42:16 2022] DELETE /compute/v2.1/images/c2fee294-dda0-4e9d-bac4-8396d5113073/metadata/os_version => generated 0 bytes in 468 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:42:17.290553 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d6680672-ae1b-4443-ab62-85198be5890d tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:17.291415 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d6680672-ae1b-4443-ab62-85198be5890d tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: cd97d817-422a-457d-b653-020350d75d6e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:17.299203 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d6680672-ae1b-4443-ab62-85198be5890d tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:17.305468 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d6680672-ae1b-4443-ab62-85198be5890d tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:17.305468 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d6680672-ae1b-4443-ab62-85198be5890d tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:17.305468 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d6680672-ae1b-4443-ab62-85198be5890d tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:17.305468 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d6680672-ae1b-4443-ab62-85198be5890d tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:17.305468 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d6680672-ae1b-4443-ab62-85198be5890d tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:17.343774 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4b2e84d9-9566-4dd5-ae5e-a47a6627afeb tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '777a7a51e45b498597f7a1202217575c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b43fba16115404aaa793fb907fd257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:17.357683 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4b2e84d9-9566-4dd5-ae5e-a47a6627afeb tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] 10.222.0.20 "GET /compute/v2.1/servers/e245e3c8-b2eb-4f0f-8dec-c7bc290bd356" status: 200 len: 1315 microversion: 2.1 time: 0.424272 Oct 04 18:42:17.372384 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1690/3447] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:16 2022] GET /compute/v2.1/servers/e245e3c8-b2eb-4f0f-8dec-c7bc290bd356 => generated 1315 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:17.374891 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a3276941-778a-49f2-be9c-1e728f971b6c tempest-ImagesMetadataTestJSON-321833850 tempest-ImagesMetadataTestJSON-321833850-project] Calling method '.version_select at 0x7fe253f1b820>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:17.451048 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a3276941-778a-49f2-be9c-1e728f971b6c tempest-ImagesMetadataTestJSON-321833850 tempest-ImagesMetadataTestJSON-321833850-project] 10.222.0.20 "GET /compute/v2.1/images/c2fee294-dda0-4e9d-bac4-8396d5113073/metadata" status: 200 len: 37 microversion: 2.1 time: 0.086906 Oct 04 18:42:17.456592 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1691/3448] 10.222.0.20 () {58 vars in 1260 bytes} [Tue Oct 4 18:42:17 2022] GET /compute/v2.1/images/c2fee294-dda0-4e9d-bac4-8396d5113073/metadata => generated 37 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:42:17.476122 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-066e776a-1e11-4ebe-9d58-54141dd89d90 tempest-ImagesMetadataTestJSON-321833850 tempest-ImagesMetadataTestJSON-321833850-project] Action: 'update_all', calling method: .version_select at 0x7fe253e82b80>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:17.600976 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-066e776a-1e11-4ebe-9d58-54141dd89d90 tempest-ImagesMetadataTestJSON-321833850 tempest-ImagesMetadataTestJSON-321833850-project] Getting quotas for project a23165622fd848ae99ed5673b29a5b9a. Resources: dict_keys(['metadata_items']) {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:42:17.608246 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-066e776a-1e11-4ebe-9d58-54141dd89d90 tempest-ImagesMetadataTestJSON-321833850 tempest-ImagesMetadataTestJSON-321833850-project] Getting quotas for user 5980ed1491e44e25933d6297feffc0c6 and project a23165622fd848ae99ed5673b29a5b9a. Resources: dict_keys(['metadata_items']) {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:42:17.713540 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d6680672-ae1b-4443-ab62-85198be5890d tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:17.733262 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d6680672-ae1b-4443-ab62-85198be5890d tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/cd97d817-422a-457d-b653-020350d75d6e" status: 200 len: 1521 microversion: 2.1 time: 0.445404 Oct 04 18:42:17.733262 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1758/3449] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:17 2022] GET /compute/v2.1/servers/cd97d817-422a-457d-b653-020350d75d6e => generated 1521 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:17.842156 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0bf16787-9c58-4d91-a090-319b57baf6b6 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:17.844605 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0bf16787-9c58-4d91-a090-319b57baf6b6 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: af3e9546-9a60-424a-8d98-234b08364d1d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:17.853776 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0bf16787-9c58-4d91-a090-319b57baf6b6 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:17.854665 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0bf16787-9c58-4d91-a090-319b57baf6b6 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:17.855344 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0bf16787-9c58-4d91-a090-319b57baf6b6 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:17.856671 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0bf16787-9c58-4d91-a090-319b57baf6b6 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:17.858758 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0bf16787-9c58-4d91-a090-319b57baf6b6 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:17.864594 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0bf16787-9c58-4d91-a090-319b57baf6b6 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:18.109761 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0bf16787-9c58-4d91-a090-319b57baf6b6 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:18.111098 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-066e776a-1e11-4ebe-9d58-54141dd89d90 tempest-ImagesMetadataTestJSON-321833850 tempest-ImagesMetadataTestJSON-321833850-project] 10.222.0.20 "PUT /compute/v2.1/images/c2fee294-dda0-4e9d-bac4-8396d5113073/metadata" status: 200 len: 61 microversion: 2.1 time: 0.641128 Oct 04 18:42:18.111717 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1692/3450] 10.222.0.20 () {60 vars in 1280 bytes} [Tue Oct 4 18:42:17 2022] PUT /compute/v2.1/images/c2fee294-dda0-4e9d-bac4-8396d5113073/metadata => generated 61 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 18:42:18.123939 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1cd1ead1-d874-429c-bd6d-14223ba957de tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:18.124596 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1cd1ead1-d874-429c-bd6d-14223ba957de tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] [instance: fc051dca-45a8-4241-b8a5-29b49903da93] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:18.129556 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0bf16787-9c58-4d91-a090-319b57baf6b6 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/af3e9546-9a60-424a-8d98-234b08364d1d" status: 200 len: 1320 microversion: 2.1 time: 0.294752 Oct 04 18:42:18.130168 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1759/3451] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:17 2022] GET /compute/v2.1/servers/af3e9546-9a60-424a-8d98-234b08364d1d => generated 1320 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:42:18.144647 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-30904449-8e9c-4b64-905e-1a5a62e99f83 req-e68bb6e0-ed00-4b7b-b107-b3b926f67db7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc051dca-45a8-4241-b8a5-29b49903da93", "name": "network-vif-plugged", "status": "completed", "tag": "e9c024cc-8326-49d2-a3f0-1c293e02d3ca"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:18.160072 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1cd1ead1-d874-429c-bd6d-14223ba957de tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:18.161304 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1cd1ead1-d874-429c-bd6d-14223ba957de tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:18.162861 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1cd1ead1-d874-429c-bd6d-14223ba957de tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:18.163856 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1cd1ead1-d874-429c-bd6d-14223ba957de tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:18.164524 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1cd1ead1-d874-429c-bd6d-14223ba957de tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:18.165219 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1cd1ead1-d874-429c-bd6d-14223ba957de tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:18.169200 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-30904449-8e9c-4b64-905e-1a5a62e99f83 req-e68bb6e0-ed00-4b7b-b107-b3b926f67db7 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:18.170074 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-30904449-8e9c-4b64-905e-1a5a62e99f83 req-e68bb6e0-ed00-4b7b-b107-b3b926f67db7 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:18.170526 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-30904449-8e9c-4b64-905e-1a5a62e99f83 req-e68bb6e0-ed00-4b7b-b107-b3b926f67db7 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:18.187438 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-30904449-8e9c-4b64-905e-1a5a62e99f83 req-e68bb6e0-ed00-4b7b-b107-b3b926f67db7 service nova] Creating event network-vif-plugged:e9c024cc-8326-49d2-a3f0-1c293e02d3ca for instance fc051dca-45a8-4241-b8a5-29b49903da93 on n-h1-850501-14 Oct 04 18:42:18.200183 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-30904449-8e9c-4b64-905e-1a5a62e99f83 req-e68bb6e0-ed00-4b7b-b107-b3b926f67db7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065025 Oct 04 18:42:18.203841 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1760/3452] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:42:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:42:18.245760 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3795dc6b-5cd7-4a4a-9633-91e44eba5c2f tempest-ImagesMetadataTestJSON-321833850 tempest-ImagesMetadataTestJSON-321833850-project] Calling method '.version_select at 0x7fe2581eaca0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:18.321845 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3795dc6b-5cd7-4a4a-9633-91e44eba5c2f tempest-ImagesMetadataTestJSON-321833850 tempest-ImagesMetadataTestJSON-321833850-project] 10.222.0.20 "GET /compute/v2.1/images/c2fee294-dda0-4e9d-bac4-8396d5113073/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.115548 Oct 04 18:42:18.332519 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1761/3453] 10.222.0.20 () {58 vars in 1290 bytes} [Tue Oct 4 18:42:18 2022] GET /compute/v2.1/images/c2fee294-dda0-4e9d-bac4-8396d5113073/metadata/os_distro => generated 33 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:42:18.337851 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8640b778-8b55-46fa-8f81-b67b3fde16ba tempest-ImagesMetadataTestJSON-321833850 tempest-ImagesMetadataTestJSON-321833850-project] Action: 'update_all', calling method: .version_select at 0x7fe258e20dc0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:18.408018 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-8640b778-8b55-46fa-8f81-b67b3fde16ba tempest-ImagesMetadataTestJSON-321833850 tempest-ImagesMetadataTestJSON-321833850-project] Getting quotas for project a23165622fd848ae99ed5673b29a5b9a. Resources: dict_keys(['metadata_items']) {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:42:18.425328 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-8640b778-8b55-46fa-8f81-b67b3fde16ba tempest-ImagesMetadataTestJSON-321833850 tempest-ImagesMetadataTestJSON-321833850-project] Getting quotas for user 5980ed1491e44e25933d6297feffc0c6 and project a23165622fd848ae99ed5673b29a5b9a. Resources: dict_keys(['metadata_items']) {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:42:18.679304 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8640b778-8b55-46fa-8f81-b67b3fde16ba tempest-ImagesMetadataTestJSON-321833850 tempest-ImagesMetadataTestJSON-321833850-project] 10.222.0.20 "PUT /compute/v2.1/images/c2fee294-dda0-4e9d-bac4-8396d5113073/metadata" status: 200 len: 61 microversion: 2.1 time: 0.345518 Oct 04 18:42:18.680028 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1762/3454] 10.222.0.20 () {60 vars in 1280 bytes} [Tue Oct 4 18:42:18 2022] PUT /compute/v2.1/images/c2fee294-dda0-4e9d-bac4-8396d5113073/metadata => generated 61 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:42:18.689533 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-716c1e93-a581-4340-8ad9-129907543299 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:18.693013 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-716c1e93-a581-4340-8ad9-129907543299 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] [instance: e245e3c8-b2eb-4f0f-8dec-c7bc290bd356] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:18.726727 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-716c1e93-a581-4340-8ad9-129907543299 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:18.726727 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-716c1e93-a581-4340-8ad9-129907543299 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:18.726727 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-716c1e93-a581-4340-8ad9-129907543299 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:18.731700 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-716c1e93-a581-4340-8ad9-129907543299 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:18.732443 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-716c1e93-a581-4340-8ad9-129907543299 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:18.732844 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-716c1e93-a581-4340-8ad9-129907543299 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:18.863513 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1cd1ead1-d874-429c-bd6d-14223ba957de tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e2e6b962134c77b85f0c7ac8a6b746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd0b1764f314627906bcab7b4ed8a8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:18.876576 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1cd1ead1-d874-429c-bd6d-14223ba957de tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] 10.222.0.20 "GET /compute/v2.1/servers/fc051dca-45a8-4241-b8a5-29b49903da93" status: 200 len: 1314 microversion: 2.1 time: 0.762220 Oct 04 18:42:18.878951 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1693/3455] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:18 2022] GET /compute/v2.1/servers/fc051dca-45a8-4241-b8a5-29b49903da93 => generated 1314 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:18.897771 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5c86237d-a665-444b-9f4e-4e50b197e40e tempest-ImagesMetadataTestJSON-321833850 tempest-ImagesMetadataTestJSON-321833850-project] Calling method '.version_select at 0x7fe253fa2e50>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:18.956635 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5c86237d-a665-444b-9f4e-4e50b197e40e tempest-ImagesMetadataTestJSON-321833850 tempest-ImagesMetadataTestJSON-321833850-project] 10.222.0.20 "GET /compute/v2.1/images/c2fee294-dda0-4e9d-bac4-8396d5113073/metadata" status: 200 len: 61 microversion: 2.1 time: 0.074683 Oct 04 18:42:18.956635 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1694/3456] 10.222.0.20 () {58 vars in 1260 bytes} [Tue Oct 4 18:42:18 2022] GET /compute/v2.1/images/c2fee294-dda0-4e9d-bac4-8396d5113073/metadata => generated 61 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:42:18.970011 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-90509b0e-9469-4093-8140-0719649f4ffe tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:18.970641 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-90509b0e-9469-4093-8140-0719649f4ffe tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: cd97d817-422a-457d-b653-020350d75d6e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:18.990255 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-90509b0e-9469-4093-8140-0719649f4ffe tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:18.994273 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-90509b0e-9469-4093-8140-0719649f4ffe tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:18.994947 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-90509b0e-9469-4093-8140-0719649f4ffe tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:18.995900 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-90509b0e-9469-4093-8140-0719649f4ffe tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:18.999053 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-90509b0e-9469-4093-8140-0719649f4ffe tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:18.999785 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-90509b0e-9469-4093-8140-0719649f4ffe tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:19.105585 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-716c1e93-a581-4340-8ad9-129907543299 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '777a7a51e45b498597f7a1202217575c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b43fba16115404aaa793fb907fd257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:19.132267 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-716c1e93-a581-4340-8ad9-129907543299 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] 10.222.0.20 "GET /compute/v2.1/servers/e245e3c8-b2eb-4f0f-8dec-c7bc290bd356" status: 200 len: 1315 microversion: 2.1 time: 0.435371 Oct 04 18:42:19.132267 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1763/3457] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:18 2022] GET /compute/v2.1/servers/e245e3c8-b2eb-4f0f-8dec-c7bc290bd356 => generated 1315 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:19.139578 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5bf85a66-fd43-44bf-864b-6a5a7e122b40 tempest-ImagesMetadataTestJSON-321833850 tempest-ImagesMetadataTestJSON-321833850-project] Action: 'update_all', calling method: .version_select at 0x7fe258c6c700>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:19.196604 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:42:19.207211 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-5bf85a66-fd43-44bf-864b-6a5a7e122b40 tempest-ImagesMetadataTestJSON-321833850 tempest-ImagesMetadataTestJSON-321833850-project] Getting quotas for project a23165622fd848ae99ed5673b29a5b9a. Resources: dict_keys(['metadata_items']) {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:42:19.215189 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-5bf85a66-fd43-44bf-864b-6a5a7e122b40 tempest-ImagesMetadataTestJSON-321833850 tempest-ImagesMetadataTestJSON-321833850-project] Getting quotas for user 5980ed1491e44e25933d6297feffc0c6 and project a23165622fd848ae99ed5673b29a5b9a. Resources: dict_keys(['metadata_items']) {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:42:19.433312 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5bf85a66-fd43-44bf-864b-6a5a7e122b40 tempest-ImagesMetadataTestJSON-321833850 tempest-ImagesMetadataTestJSON-321833850-project] 10.222.0.20 "PUT /compute/v2.1/images/c2fee294-dda0-4e9d-bac4-8396d5113073/metadata" status: 200 len: 61 microversion: 2.1 time: 0.299061 Oct 04 18:42:19.434318 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1764/3458] 10.222.0.20 () {60 vars in 1280 bytes} [Tue Oct 4 18:42:19 2022] PUT /compute/v2.1/images/c2fee294-dda0-4e9d-bac4-8396d5113073/metadata => generated 61 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:42:19.439634 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6bbfba4f-1c32-47c5-be5f-9717fe5fdf24 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:19.441760 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6bbfba4f-1c32-47c5-be5f-9717fe5fdf24 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: af3e9546-9a60-424a-8d98-234b08364d1d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:19.450328 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6bbfba4f-1c32-47c5-be5f-9717fe5fdf24 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:19.451041 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6bbfba4f-1c32-47c5-be5f-9717fe5fdf24 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:19.451885 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6bbfba4f-1c32-47c5-be5f-9717fe5fdf24 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:19.453121 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6bbfba4f-1c32-47c5-be5f-9717fe5fdf24 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:19.453816 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6bbfba4f-1c32-47c5-be5f-9717fe5fdf24 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:19.454472 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6bbfba4f-1c32-47c5-be5f-9717fe5fdf24 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:19.464908 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-90509b0e-9469-4093-8140-0719649f4ffe tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:19.474119 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-90509b0e-9469-4093-8140-0719649f4ffe tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/cd97d817-422a-457d-b653-020350d75d6e" status: 200 len: 1521 microversion: 2.1 time: 0.510392 Oct 04 18:42:19.478807 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1695/3459] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:18 2022] GET /compute/v2.1/servers/cd97d817-422a-457d-b653-020350d75d6e => generated 1521 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:19.485134 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-acea2072-b83d-483a-ada7-16e20c628589 tempest-ImagesMetadataTestJSON-321833850 tempest-ImagesMetadataTestJSON-321833850-project] Action: 'update_all', calling method: .version_select at 0x7fe253f55940>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:19.576397 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-acea2072-b83d-483a-ada7-16e20c628589 tempest-ImagesMetadataTestJSON-321833850 tempest-ImagesMetadataTestJSON-321833850-project] Getting quotas for project a23165622fd848ae99ed5673b29a5b9a. Resources: dict_keys(['metadata_items']) {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:42:19.592328 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-acea2072-b83d-483a-ada7-16e20c628589 tempest-ImagesMetadataTestJSON-321833850 tempest-ImagesMetadataTestJSON-321833850-project] Getting quotas for user 5980ed1491e44e25933d6297feffc0c6 and project a23165622fd848ae99ed5673b29a5b9a. Resources: dict_keys(['metadata_items']) {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:42:19.750145 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6bbfba4f-1c32-47c5-be5f-9717fe5fdf24 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:19.759529 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6bbfba4f-1c32-47c5-be5f-9717fe5fdf24 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/af3e9546-9a60-424a-8d98-234b08364d1d" status: 200 len: 1320 microversion: 2.1 time: 0.323722 Oct 04 18:42:19.772920 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1765/3460] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:19 2022] GET /compute/v2.1/servers/af3e9546-9a60-424a-8d98-234b08364d1d => generated 1320 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:19.901903 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d85d6f46-6a6a-45c1-86d5-6446d8b06658 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:19.902530 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d85d6f46-6a6a-45c1-86d5-6446d8b06658 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] [instance: fc051dca-45a8-4241-b8a5-29b49903da93] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:19.912864 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d85d6f46-6a6a-45c1-86d5-6446d8b06658 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:19.913359 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d85d6f46-6a6a-45c1-86d5-6446d8b06658 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:19.913800 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d85d6f46-6a6a-45c1-86d5-6446d8b06658 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:19.920294 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d85d6f46-6a6a-45c1-86d5-6446d8b06658 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:19.920779 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d85d6f46-6a6a-45c1-86d5-6446d8b06658 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:19.921278 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d85d6f46-6a6a-45c1-86d5-6446d8b06658 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:20.077721 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-acea2072-b83d-483a-ada7-16e20c628589 tempest-ImagesMetadataTestJSON-321833850 tempest-ImagesMetadataTestJSON-321833850-project] 10.222.0.20 "PUT /compute/v2.1/images/c2fee294-dda0-4e9d-bac4-8396d5113073/metadata" status: 200 len: 64 microversion: 2.1 time: 0.597704 Oct 04 18:42:20.079258 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1696/3461] 10.222.0.20 () {60 vars in 1280 bytes} [Tue Oct 4 18:42:19 2022] PUT /compute/v2.1/images/c2fee294-dda0-4e9d-bac4-8396d5113073/metadata => generated 64 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:42:20.090990 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5edf48bc-1bc9-4f22-8aa5-69cc0cefb5cb tempest-ImagesMetadataTestJSON-321833850 tempest-ImagesMetadataTestJSON-321833850-project] Calling method '.version_select at 0x7fe253e07e50>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:20.131511 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d85d6f46-6a6a-45c1-86d5-6446d8b06658 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e2e6b962134c77b85f0c7ac8a6b746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd0b1764f314627906bcab7b4ed8a8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:20.142046 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d85d6f46-6a6a-45c1-86d5-6446d8b06658 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] 10.222.0.20 "GET /compute/v2.1/servers/fc051dca-45a8-4241-b8a5-29b49903da93" status: 200 len: 1314 microversion: 2.1 time: 0.244304 Oct 04 18:42:20.142632 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1766/3462] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:19 2022] GET /compute/v2.1/servers/fc051dca-45a8-4241-b8a5-29b49903da93 => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:42:20.144615 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5edf48bc-1bc9-4f22-8aa5-69cc0cefb5cb tempest-ImagesMetadataTestJSON-321833850 tempest-ImagesMetadataTestJSON-321833850-project] 10.222.0.20 "GET /compute/v2.1/images/c2fee294-dda0-4e9d-bac4-8396d5113073/metadata" status: 200 len: 64 microversion: 2.1 time: 0.059309 Oct 04 18:42:20.148090 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ad1d538b-6e79-44a6-933d-0d2c08e19a41 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:20.149003 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ad1d538b-6e79-44a6-933d-0d2c08e19a41 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] [instance: e245e3c8-b2eb-4f0f-8dec-c7bc290bd356] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:20.152000 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1697/3463] 10.222.0.20 () {58 vars in 1260 bytes} [Tue Oct 4 18:42:20 2022] GET /compute/v2.1/images/c2fee294-dda0-4e9d-bac4-8396d5113073/metadata => generated 64 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 18:42:20.157675 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-da7e1e83-b191-4479-9629-19058f0b8f23 tempest-ImagesMetadataTestJSON-321833850 tempest-ImagesMetadataTestJSON-321833850-project] Action: 'update_all', calling method: .version_select at 0x7fe253ff1160>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:20.157865 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ad1d538b-6e79-44a6-933d-0d2c08e19a41 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:20.160211 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ad1d538b-6e79-44a6-933d-0d2c08e19a41 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:20.160747 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ad1d538b-6e79-44a6-933d-0d2c08e19a41 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:20.162019 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ad1d538b-6e79-44a6-933d-0d2c08e19a41 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:20.162543 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ad1d538b-6e79-44a6-933d-0d2c08e19a41 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:20.163023 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ad1d538b-6e79-44a6-933d-0d2c08e19a41 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:20.226158 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-da7e1e83-b191-4479-9629-19058f0b8f23 tempest-ImagesMetadataTestJSON-321833850 tempest-ImagesMetadataTestJSON-321833850-project] Getting quotas for project a23165622fd848ae99ed5673b29a5b9a. Resources: dict_keys(['metadata_items']) {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:42:20.231977 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-da7e1e83-b191-4479-9629-19058f0b8f23 tempest-ImagesMetadataTestJSON-321833850 tempest-ImagesMetadataTestJSON-321833850-project] Getting quotas for user 5980ed1491e44e25933d6297feffc0c6 and project a23165622fd848ae99ed5673b29a5b9a. Resources: dict_keys(['metadata_items']) {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:42:20.406201 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ad1d538b-6e79-44a6-933d-0d2c08e19a41 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '777a7a51e45b498597f7a1202217575c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b43fba16115404aaa793fb907fd257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:20.417060 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ad1d538b-6e79-44a6-933d-0d2c08e19a41 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] 10.222.0.20 "GET /compute/v2.1/servers/e245e3c8-b2eb-4f0f-8dec-c7bc290bd356" status: 200 len: 1315 microversion: 2.1 time: 0.272883 Oct 04 18:42:20.417939 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1767/3464] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:20 2022] GET /compute/v2.1/servers/e245e3c8-b2eb-4f0f-8dec-c7bc290bd356 => generated 1315 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:20.507859 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-075c4b25-e645-4376-8815-e22165ef6d15 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:20.509211 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-075c4b25-e645-4376-8815-e22165ef6d15 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: cd97d817-422a-457d-b653-020350d75d6e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:20.516551 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-075c4b25-e645-4376-8815-e22165ef6d15 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:20.517241 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-075c4b25-e645-4376-8815-e22165ef6d15 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:20.517858 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-075c4b25-e645-4376-8815-e22165ef6d15 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:20.520764 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-075c4b25-e645-4376-8815-e22165ef6d15 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:20.521936 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-075c4b25-e645-4376-8815-e22165ef6d15 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:20.522553 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-075c4b25-e645-4376-8815-e22165ef6d15 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:20.698271 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-075c4b25-e645-4376-8815-e22165ef6d15 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:20.707695 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-075c4b25-e645-4376-8815-e22165ef6d15 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/cd97d817-422a-457d-b653-020350d75d6e" status: 200 len: 1521 microversion: 2.1 time: 0.209862 Oct 04 18:42:20.707940 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-da7e1e83-b191-4479-9629-19058f0b8f23 tempest-ImagesMetadataTestJSON-321833850 tempest-ImagesMetadataTestJSON-321833850-project] 10.222.0.20 "PUT /compute/v2.1/images/c2fee294-dda0-4e9d-bac4-8396d5113073/metadata" status: 200 len: 61 microversion: 2.1 time: 0.554402 Oct 04 18:42:20.709009 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1698/3465] 10.222.0.20 () {60 vars in 1280 bytes} [Tue Oct 4 18:42:20 2022] PUT /compute/v2.1/images/c2fee294-dda0-4e9d-bac4-8396d5113073/metadata => generated 61 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:42:20.709680 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1768/3466] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:20 2022] GET /compute/v2.1/servers/cd97d817-422a-457d-b653-020350d75d6e => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:20.734458 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2b54cb58-a02d-4cc8-af92-cd42782d260b tempest-ImagesMetadataTestJSON-321833850 tempest-ImagesMetadataTestJSON-321833850-project] Action: 'update', calling method: .version_select at 0x7fe253e0cca0>, body: {"meta": {"os_version": "alt"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:20.785144 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9ea50476-daa1-49df-bc63-ffa6eec08e6c tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:20.786067 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-9ea50476-daa1-49df-bc63-ffa6eec08e6c tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: af3e9546-9a60-424a-8d98-234b08364d1d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:20.792081 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-2b54cb58-a02d-4cc8-af92-cd42782d260b tempest-ImagesMetadataTestJSON-321833850 tempest-ImagesMetadataTestJSON-321833850-project] Getting quotas for project a23165622fd848ae99ed5673b29a5b9a. Resources: dict_keys(['metadata_items']) {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:42:20.798057 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9ea50476-daa1-49df-bc63-ffa6eec08e6c tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:20.798196 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-2b54cb58-a02d-4cc8-af92-cd42782d260b tempest-ImagesMetadataTestJSON-321833850 tempest-ImagesMetadataTestJSON-321833850-project] Getting quotas for user 5980ed1491e44e25933d6297feffc0c6 and project a23165622fd848ae99ed5673b29a5b9a. Resources: dict_keys(['metadata_items']) {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:42:20.798562 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9ea50476-daa1-49df-bc63-ffa6eec08e6c tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:20.808654 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9ea50476-daa1-49df-bc63-ffa6eec08e6c tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:20.808654 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9ea50476-daa1-49df-bc63-ffa6eec08e6c tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:20.808654 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9ea50476-daa1-49df-bc63-ffa6eec08e6c tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:20.808654 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9ea50476-daa1-49df-bc63-ffa6eec08e6c tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:20.995150 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9ea50476-daa1-49df-bc63-ffa6eec08e6c tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:21.004319 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9ea50476-daa1-49df-bc63-ffa6eec08e6c tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/af3e9546-9a60-424a-8d98-234b08364d1d" status: 200 len: 1320 microversion: 2.1 time: 0.224583 Oct 04 18:42:21.004942 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1769/3467] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:20 2022] GET /compute/v2.1/servers/af3e9546-9a60-424a-8d98-234b08364d1d => generated 1320 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:42:21.168633 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-79fb69c9-6eca-473c-b863-5ee0caf74cf5 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:21.169300 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-79fb69c9-6eca-473c-b863-5ee0caf74cf5 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] [instance: fc051dca-45a8-4241-b8a5-29b49903da93] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:21.176500 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-79fb69c9-6eca-473c-b863-5ee0caf74cf5 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:21.176994 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-79fb69c9-6eca-473c-b863-5ee0caf74cf5 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:21.177430 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-79fb69c9-6eca-473c-b863-5ee0caf74cf5 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:21.178237 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-79fb69c9-6eca-473c-b863-5ee0caf74cf5 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:21.178683 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-79fb69c9-6eca-473c-b863-5ee0caf74cf5 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:21.179272 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-79fb69c9-6eca-473c-b863-5ee0caf74cf5 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:21.257893 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2b54cb58-a02d-4cc8-af92-cd42782d260b tempest-ImagesMetadataTestJSON-321833850 tempest-ImagesMetadataTestJSON-321833850-project] 10.222.0.20 "PUT /compute/v2.1/images/c2fee294-dda0-4e9d-bac4-8396d5113073/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.536097 Oct 04 18:42:21.259098 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1699/3468] 10.222.0.20 () {60 vars in 1313 bytes} [Tue Oct 4 18:42:20 2022] PUT /compute/v2.1/images/c2fee294-dda0-4e9d-bac4-8396d5113073/metadata/os_version => generated 31 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:42:21.269733 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f6b578f4-acda-4839-8d0d-48f5224035f2 tempest-ImagesMetadataTestJSON-321833850 tempest-ImagesMetadataTestJSON-321833850-project] Calling method '.version_select at 0x7fe253f55ca0>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:21.323877 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f6b578f4-acda-4839-8d0d-48f5224035f2 tempest-ImagesMetadataTestJSON-321833850 tempest-ImagesMetadataTestJSON-321833850-project] 10.222.0.20 "GET /compute/v2.1/images/c2fee294-dda0-4e9d-bac4-8396d5113073/metadata" status: 200 len: 58 microversion: 2.1 time: 0.058925 Oct 04 18:42:21.325849 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1700/3469] 10.222.0.20 () {58 vars in 1260 bytes} [Tue Oct 4 18:42:21 2022] GET /compute/v2.1/images/c2fee294-dda0-4e9d-bac4-8396d5113073/metadata => generated 58 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:42:21.338283 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-cb8aabe1-00a9-4347-b451-8577ae9b0480 tempest-ImagesMetadataTestJSON-321833850 tempest-ImagesMetadataTestJSON-321833850-project] Action: 'update_all', calling method: .version_select at 0x7fe253ff1f70>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:21.403459 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-79fb69c9-6eca-473c-b863-5ee0caf74cf5 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e2e6b962134c77b85f0c7ac8a6b746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd0b1764f314627906bcab7b4ed8a8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:21.405729 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-cb8aabe1-00a9-4347-b451-8577ae9b0480 tempest-ImagesMetadataTestJSON-321833850 tempest-ImagesMetadataTestJSON-321833850-project] Getting quotas for project a23165622fd848ae99ed5673b29a5b9a. Resources: dict_keys(['metadata_items']) {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:42:21.414252 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-cb8aabe1-00a9-4347-b451-8577ae9b0480 tempest-ImagesMetadataTestJSON-321833850 tempest-ImagesMetadataTestJSON-321833850-project] Getting quotas for user 5980ed1491e44e25933d6297feffc0c6 and project a23165622fd848ae99ed5673b29a5b9a. Resources: dict_keys(['metadata_items']) {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:42:21.417171 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-79fb69c9-6eca-473c-b863-5ee0caf74cf5 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] 10.222.0.20 "GET /compute/v2.1/servers/fc051dca-45a8-4241-b8a5-29b49903da93" status: 200 len: 1463 microversion: 2.1 time: 0.251728 Oct 04 18:42:21.418705 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1770/3470] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:21 2022] GET /compute/v2.1/servers/fc051dca-45a8-4241-b8a5-29b49903da93 => generated 1463 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:42:21.447615 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c084d67b-acad-475e-9f78-f8c16ebcc0c7 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:21.448759 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c084d67b-acad-475e-9f78-f8c16ebcc0c7 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] [instance: e245e3c8-b2eb-4f0f-8dec-c7bc290bd356] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:21.456365 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c084d67b-acad-475e-9f78-f8c16ebcc0c7 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:21.457381 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c084d67b-acad-475e-9f78-f8c16ebcc0c7 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:21.458226 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c084d67b-acad-475e-9f78-f8c16ebcc0c7 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:21.459427 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c084d67b-acad-475e-9f78-f8c16ebcc0c7 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:21.460291 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c084d67b-acad-475e-9f78-f8c16ebcc0c7 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:21.461010 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c084d67b-acad-475e-9f78-f8c16ebcc0c7 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:21.683172 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c084d67b-acad-475e-9f78-f8c16ebcc0c7 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '777a7a51e45b498597f7a1202217575c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b43fba16115404aaa793fb907fd257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:21.698729 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c084d67b-acad-475e-9f78-f8c16ebcc0c7 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] 10.222.0.20 "GET /compute/v2.1/servers/e245e3c8-b2eb-4f0f-8dec-c7bc290bd356" status: 200 len: 1315 microversion: 2.1 time: 0.256181 Oct 04 18:42:21.700116 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1771/3471] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:21 2022] GET /compute/v2.1/servers/e245e3c8-b2eb-4f0f-8dec-c7bc290bd356 => generated 1315 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:42:21.950188 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-cb8aabe1-00a9-4347-b451-8577ae9b0480 tempest-ImagesMetadataTestJSON-321833850 tempest-ImagesMetadataTestJSON-321833850-project] 10.222.0.20 "PUT /compute/v2.1/images/c2fee294-dda0-4e9d-bac4-8396d5113073/metadata" status: 200 len: 61 microversion: 2.1 time: 0.616709 Oct 04 18:42:21.960021 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1701/3472] 10.222.0.20 () {60 vars in 1280 bytes} [Tue Oct 4 18:42:21 2022] PUT /compute/v2.1/images/c2fee294-dda0-4e9d-bac4-8396d5113073/metadata => generated 61 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:42:21.989530 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-842ba20f-fad9-4f52-9b74-0ef5b4de8d11 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:21.992283 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-842ba20f-fad9-4f52-9b74-0ef5b4de8d11 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: cd97d817-422a-457d-b653-020350d75d6e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:21.994446 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-aba5d0bd-8a63-4ba9-865d-6b39e35e3ec7 tempest-TenantUsagesTestJSON-585373841 tempest-TenantUsagesTestJSON-585373841-project-admin] Calling method '.version_select at 0x7fe2590daee0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:22.007084 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aba5d0bd-8a63-4ba9-865d-6b39e35e3ec7 tempest-TenantUsagesTestJSON-585373841 tempest-TenantUsagesTestJSON-585373841-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:22.007574 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aba5d0bd-8a63-4ba9-865d-6b39e35e3ec7 tempest-TenantUsagesTestJSON-585373841 tempest-TenantUsagesTestJSON-585373841-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:22.013958 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aba5d0bd-8a63-4ba9-865d-6b39e35e3ec7 tempest-TenantUsagesTestJSON-585373841 tempest-TenantUsagesTestJSON-585373841-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:22.014148 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-842ba20f-fad9-4f52-9b74-0ef5b4de8d11 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:22.014148 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-842ba20f-fad9-4f52-9b74-0ef5b4de8d11 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:22.017677 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-842ba20f-fad9-4f52-9b74-0ef5b4de8d11 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:22.019874 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-842ba20f-fad9-4f52-9b74-0ef5b4de8d11 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:22.020395 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-842ba20f-fad9-4f52-9b74-0ef5b4de8d11 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:22.020842 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-842ba20f-fad9-4f52-9b74-0ef5b4de8d11 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:22.026997 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aba5d0bd-8a63-4ba9-865d-6b39e35e3ec7 tempest-TenantUsagesTestJSON-585373841 tempest-TenantUsagesTestJSON-585373841-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:22.027492 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aba5d0bd-8a63-4ba9-865d-6b39e35e3ec7 tempest-TenantUsagesTestJSON-585373841 tempest-TenantUsagesTestJSON-585373841-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:22.027935 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aba5d0bd-8a63-4ba9-865d-6b39e35e3ec7 tempest-TenantUsagesTestJSON-585373841 tempest-TenantUsagesTestJSON-585373841-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:22.050067 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-aba5d0bd-8a63-4ba9-865d-6b39e35e3ec7 tempest-TenantUsagesTestJSON-585373841 tempest-TenantUsagesTestJSON-585373841-project-admin] 10.222.0.20 "GET /compute/v2.1/os-simple-tenant-usage/6dd0b1764f314627906bcab7b4ed8a8c?start=2022-10-03T18%3A42%3A21.440536&end=2022-10-05T18%3A42%3A21.440536" status: 200 len: 695 microversion: 2.1 time: 0.348500 Oct 04 18:42:22.051513 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1772/3473] 10.222.0.20 () {58 vars in 1412 bytes} [Tue Oct 4 18:42:21 2022] GET /compute/v2.1/os-simple-tenant-usage/6dd0b1764f314627906bcab7b4ed8a8c?start=2022-10-03T18%3A42%3A21.440536&end=2022-10-05T18%3A42%3A21.440536 => generated 695 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:42:22.056756 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-aa3e86fb-a7ac-4781-a0b8-5c6c751d71cf tempest-ImagesMetadataTestJSON-321833850 tempest-ImagesMetadataTestJSON-321833850-project] Action: 'create', calling method: .version_select at 0x7fe258d4b310>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:22.146319 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-aa3e86fb-a7ac-4781-a0b8-5c6c751d71cf tempest-ImagesMetadataTestJSON-321833850 tempest-ImagesMetadataTestJSON-321833850-project] Getting quotas for project a23165622fd848ae99ed5673b29a5b9a. Resources: dict_keys(['metadata_items']) {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:42:22.155373 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-aa3e86fb-a7ac-4781-a0b8-5c6c751d71cf tempest-ImagesMetadataTestJSON-321833850 tempest-ImagesMetadataTestJSON-321833850-project] Getting quotas for user 5980ed1491e44e25933d6297feffc0c6 and project a23165622fd848ae99ed5673b29a5b9a. Resources: dict_keys(['metadata_items']) {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:42:22.365772 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-842ba20f-fad9-4f52-9b74-0ef5b4de8d11 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:22.374015 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-842ba20f-fad9-4f52-9b74-0ef5b4de8d11 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/cd97d817-422a-457d-b653-020350d75d6e" status: 200 len: 1521 microversion: 2.1 time: 0.408005 Oct 04 18:42:22.374596 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1702/3474] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:21 2022] GET /compute/v2.1/servers/cd97d817-422a-457d-b653-020350d75d6e => generated 1521 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:22.382407 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3d76cfa0-853d-429c-9000-224e763f6c6f tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:22.383257 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3d76cfa0-853d-429c-9000-224e763f6c6f tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: af3e9546-9a60-424a-8d98-234b08364d1d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:22.397353 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3d76cfa0-853d-429c-9000-224e763f6c6f tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:22.404509 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3d76cfa0-853d-429c-9000-224e763f6c6f tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:22.404509 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3d76cfa0-853d-429c-9000-224e763f6c6f tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:22.404509 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3d76cfa0-853d-429c-9000-224e763f6c6f tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:22.404509 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3d76cfa0-853d-429c-9000-224e763f6c6f tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:22.404509 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3d76cfa0-853d-429c-9000-224e763f6c6f tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:22.690992 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3d76cfa0-853d-429c-9000-224e763f6c6f tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:22.704341 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3d76cfa0-853d-429c-9000-224e763f6c6f tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/af3e9546-9a60-424a-8d98-234b08364d1d" status: 200 len: 1320 microversion: 2.1 time: 0.328217 Oct 04 18:42:22.705123 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1703/3475] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:22 2022] GET /compute/v2.1/servers/af3e9546-9a60-424a-8d98-234b08364d1d => generated 1320 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:22.724797 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ee7ce68e-311f-4f30-b240-f49c8fedce9f tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Calling method '.version_select at 0x7fe253e4d940>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:22.735182 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ee7ce68e-311f-4f30-b240-f49c8fedce9f tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:22.735993 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ee7ce68e-311f-4f30-b240-f49c8fedce9f tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:22.737335 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ee7ce68e-311f-4f30-b240-f49c8fedce9f tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:22.760593 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ee7ce68e-311f-4f30-b240-f49c8fedce9f tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:22.767695 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ee7ce68e-311f-4f30-b240-f49c8fedce9f tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:22.767695 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ee7ce68e-311f-4f30-b240-f49c8fedce9f tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:22.785998 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ee7ce68e-311f-4f30-b240-f49c8fedce9f tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] 10.222.0.20 "GET /compute/v2.1/os-simple-tenant-usage/6dd0b1764f314627906bcab7b4ed8a8c?start=2022-10-03T18%3A42%3A21.440536&end=2022-10-05T18%3A42%3A21.440536" status: 200 len: 695 microversion: 2.1 time: 0.077415 Oct 04 18:42:22.787439 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1704/3476] 10.222.0.20 () {58 vars in 1412 bytes} [Tue Oct 4 18:42:22 2022] GET /compute/v2.1/os-simple-tenant-usage/6dd0b1764f314627906bcab7b4ed8a8c?start=2022-10-03T18%3A42%3A21.440536&end=2022-10-05T18%3A42%3A21.440536 => generated 695 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:42:22.793663 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-90831cfe-9e07-4065-a905-ed2bcc2a35eb tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:22.795151 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-90831cfe-9e07-4065-a905-ed2bcc2a35eb tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] [instance: e245e3c8-b2eb-4f0f-8dec-c7bc290bd356] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:22.803180 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-90831cfe-9e07-4065-a905-ed2bcc2a35eb tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:22.803893 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-90831cfe-9e07-4065-a905-ed2bcc2a35eb tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:22.804566 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-90831cfe-9e07-4065-a905-ed2bcc2a35eb tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:22.805445 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-90831cfe-9e07-4065-a905-ed2bcc2a35eb tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:22.806135 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-90831cfe-9e07-4065-a905-ed2bcc2a35eb tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:22.806790 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-90831cfe-9e07-4065-a905-ed2bcc2a35eb tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:22.915465 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-aa3e86fb-a7ac-4781-a0b8-5c6c751d71cf tempest-ImagesMetadataTestJSON-321833850 tempest-ImagesMetadataTestJSON-321833850-project] 10.222.0.20 "POST /compute/v2.1/images/c2fee294-dda0-4e9d-bac4-8396d5113073/metadata" status: 200 len: 85 microversion: 2.1 time: 0.862505 Oct 04 18:42:22.916796 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1773/3477] 10.222.0.20 () {60 vars in 1281 bytes} [Tue Oct 4 18:42:22 2022] POST /compute/v2.1/images/c2fee294-dda0-4e9d-bac4-8396d5113073/metadata => generated 85 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:42:22.936999 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-231fbf75-8699-4cc9-8ee5-8710b98d4d08 tempest-TenantUsagesTestJSON-585373841 tempest-TenantUsagesTestJSON-585373841-project-admin] Calling method '.version_select at 0x7fe258c214c0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:22.964314 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-231fbf75-8699-4cc9-8ee5-8710b98d4d08 tempest-TenantUsagesTestJSON-585373841 tempest-TenantUsagesTestJSON-585373841-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:22.964996 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-231fbf75-8699-4cc9-8ee5-8710b98d4d08 tempest-TenantUsagesTestJSON-585373841 tempest-TenantUsagesTestJSON-585373841-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:22.965634 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-231fbf75-8699-4cc9-8ee5-8710b98d4d08 tempest-TenantUsagesTestJSON-585373841 tempest-TenantUsagesTestJSON-585373841-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:22.985555 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-231fbf75-8699-4cc9-8ee5-8710b98d4d08 tempest-TenantUsagesTestJSON-585373841 tempest-TenantUsagesTestJSON-585373841-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:22.986288 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-231fbf75-8699-4cc9-8ee5-8710b98d4d08 tempest-TenantUsagesTestJSON-585373841 tempest-TenantUsagesTestJSON-585373841-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:22.987959 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-231fbf75-8699-4cc9-8ee5-8710b98d4d08 tempest-TenantUsagesTestJSON-585373841 tempest-TenantUsagesTestJSON-585373841-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:23.042535 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-90831cfe-9e07-4065-a905-ed2bcc2a35eb tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '777a7a51e45b498597f7a1202217575c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b43fba16115404aaa793fb907fd257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:23.053994 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-90831cfe-9e07-4065-a905-ed2bcc2a35eb tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] 10.222.0.20 "GET /compute/v2.1/servers/e245e3c8-b2eb-4f0f-8dec-c7bc290bd356" status: 200 len: 1315 microversion: 2.1 time: 0.265674 Oct 04 18:42:23.059085 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1705/3478] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:22 2022] GET /compute/v2.1/servers/e245e3c8-b2eb-4f0f-8dec-c7bc290bd356 => generated 1315 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:23.062413 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-009cdd6a-9b8d-4ba7-8ec5-abdc73f002aa tempest-ImagesMetadataTestJSON-321833850 tempest-ImagesMetadataTestJSON-321833850-project] Calling method '.version_select at 0x7fe253ff1430>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:23.117932 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-009cdd6a-9b8d-4ba7-8ec5-abdc73f002aa tempest-ImagesMetadataTestJSON-321833850 tempest-ImagesMetadataTestJSON-321833850-project] 10.222.0.20 "GET /compute/v2.1/images/c2fee294-dda0-4e9d-bac4-8396d5113073/metadata" status: 200 len: 85 microversion: 2.1 time: 0.061071 Oct 04 18:42:23.118968 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1706/3479] 10.222.0.20 () {58 vars in 1260 bytes} [Tue Oct 4 18:42:23 2022] GET /compute/v2.1/images/c2fee294-dda0-4e9d-bac4-8396d5113073/metadata => generated 85 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:42:23.123952 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-fda7c707-49a1-4064-965f-e6d6b10022db req-a4498833-a150-4114-899a-6758681938b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af3e9546-9a60-424a-8d98-234b08364d1d", "name": "network-vif-plugged", "status": "completed", "tag": "10a557bc-1e48-40fa-94eb-267f53693475"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:23.157195 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-fda7c707-49a1-4064-965f-e6d6b10022db req-a4498833-a150-4114-899a-6758681938b4 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:23.158028 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-fda7c707-49a1-4064-965f-e6d6b10022db req-a4498833-a150-4114-899a-6758681938b4 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:23.159159 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-fda7c707-49a1-4064-965f-e6d6b10022db req-a4498833-a150-4114-899a-6758681938b4 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:23.179444 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-fda7c707-49a1-4064-965f-e6d6b10022db req-a4498833-a150-4114-899a-6758681938b4 service nova] Creating event network-vif-plugged:10a557bc-1e48-40fa-94eb-267f53693475 for instance af3e9546-9a60-424a-8d98-234b08364d1d on n-h2-850501-14 Oct 04 18:42:23.197082 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-fda7c707-49a1-4064-965f-e6d6b10022db req-a4498833-a150-4114-899a-6758681938b4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076415 Oct 04 18:42:23.198187 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1707/3480] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:42:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:42:23.215788 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-231fbf75-8699-4cc9-8ee5-8710b98d4d08 tempest-TenantUsagesTestJSON-585373841 tempest-TenantUsagesTestJSON-585373841-project-admin] 10.222.0.20 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-03T18%3A42%3A21.440536&end=2022-10-05T18%3A42%3A21.440536&detailed=1" status: 200 len: 40118 microversion: 2.1 time: 0.297677 Oct 04 18:42:23.216654 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1774/3481] 10.222.0.20 () {58 vars in 1335 bytes} [Tue Oct 4 18:42:22 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-03T18%3A42%3A21.440536&end=2022-10-05T18%3A42%3A21.440536&detailed=1 => generated 40118 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:42:23.273108 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8ec0c7d3-a2ab-4ea9-993a-ef9491ad3839 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:23.274005 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8ec0c7d3-a2ab-4ea9-993a-ef9491ad3839 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] [instance: fc051dca-45a8-4241-b8a5-29b49903da93] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:23.282324 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8ec0c7d3-a2ab-4ea9-993a-ef9491ad3839 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:23.296631 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8ec0c7d3-a2ab-4ea9-993a-ef9491ad3839 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:23.298798 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8ec0c7d3-a2ab-4ea9-993a-ef9491ad3839 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:23.300511 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8ec0c7d3-a2ab-4ea9-993a-ef9491ad3839 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:23.301158 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8ec0c7d3-a2ab-4ea9-993a-ef9491ad3839 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:23.301747 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8ec0c7d3-a2ab-4ea9-993a-ef9491ad3839 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:23.334966 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8ec0c7d3-a2ab-4ea9-993a-ef9491ad3839 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] [instance: fc051dca-45a8-4241-b8a5-29b49903da93] Going to try to terminate instance {{(pid=123002) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:42:23.399483 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e925ca38-f4cb-4ba7-b1e3-bc8b4d4cdc48 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:23.400479 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e925ca38-f4cb-4ba7-b1e3-bc8b4d4cdc48 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: cd97d817-422a-457d-b653-020350d75d6e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:23.408452 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e925ca38-f4cb-4ba7-b1e3-bc8b4d4cdc48 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:23.409960 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e925ca38-f4cb-4ba7-b1e3-bc8b4d4cdc48 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:23.410699 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e925ca38-f4cb-4ba7-b1e3-bc8b4d4cdc48 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:23.411759 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e925ca38-f4cb-4ba7-b1e3-bc8b4d4cdc48 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:23.412486 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e925ca38-f4cb-4ba7-b1e3-bc8b4d4cdc48 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:23.413173 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e925ca38-f4cb-4ba7-b1e3-bc8b4d4cdc48 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:23.662687 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e925ca38-f4cb-4ba7-b1e3-bc8b4d4cdc48 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:23.674237 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e925ca38-f4cb-4ba7-b1e3-bc8b4d4cdc48 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/cd97d817-422a-457d-b653-020350d75d6e" status: 200 len: 1521 microversion: 2.1 time: 0.279589 Oct 04 18:42:23.675264 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1775/3482] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:23 2022] GET /compute/v2.1/servers/cd97d817-422a-457d-b653-020350d75d6e => generated 1521 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:42:23.731102 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-70adfe8c-5eef-41b2-9dd5-b6ddcafee78a tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:23.733308 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-70adfe8c-5eef-41b2-9dd5-b6ddcafee78a tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: af3e9546-9a60-424a-8d98-234b08364d1d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:23.746501 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-70adfe8c-5eef-41b2-9dd5-b6ddcafee78a tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:23.750428 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-70adfe8c-5eef-41b2-9dd5-b6ddcafee78a tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:23.756363 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-70adfe8c-5eef-41b2-9dd5-b6ddcafee78a tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:23.756363 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-70adfe8c-5eef-41b2-9dd5-b6ddcafee78a tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:23.756363 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-70adfe8c-5eef-41b2-9dd5-b6ddcafee78a tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:23.756363 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-70adfe8c-5eef-41b2-9dd5-b6ddcafee78a tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:23.775964 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8ec0c7d3-a2ab-4ea9-993a-ef9491ad3839 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] 10.222.0.20 "DELETE /compute/v2.1/servers/fc051dca-45a8-4241-b8a5-29b49903da93" status: 204 len: 0 microversion: 2.1 time: 0.508879 Oct 04 18:42:23.779300 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1708/3483] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:42:23 2022] DELETE /compute/v2.1/servers/fc051dca-45a8-4241-b8a5-29b49903da93 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:42:23.787257 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ec34d335-5218-4361-8aa3-72f3612eb556 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:23.787963 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ec34d335-5218-4361-8aa3-72f3612eb556 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] [instance: fc051dca-45a8-4241-b8a5-29b49903da93] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:23.815944 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ec34d335-5218-4361-8aa3-72f3612eb556 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:23.820933 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ec34d335-5218-4361-8aa3-72f3612eb556 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:23.821399 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ec34d335-5218-4361-8aa3-72f3612eb556 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:23.822157 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ec34d335-5218-4361-8aa3-72f3612eb556 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:23.822627 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ec34d335-5218-4361-8aa3-72f3612eb556 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:23.823054 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ec34d335-5218-4361-8aa3-72f3612eb556 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:24.153422 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ec34d335-5218-4361-8aa3-72f3612eb556 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e2e6b962134c77b85f0c7ac8a6b746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd0b1764f314627906bcab7b4ed8a8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:24.160375 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-70adfe8c-5eef-41b2-9dd5-b6ddcafee78a tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:24.176625 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-70adfe8c-5eef-41b2-9dd5-b6ddcafee78a tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/af3e9546-9a60-424a-8d98-234b08364d1d" status: 200 len: 1320 microversion: 2.1 time: 0.448849 Oct 04 18:42:24.177470 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1776/3484] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:23 2022] GET /compute/v2.1/servers/af3e9546-9a60-424a-8d98-234b08364d1d => generated 1320 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:42:24.182921 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8e4529e3-6bf6-4b2c-b6e8-44b29a5216e5 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:24.183910 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8e4529e3-6bf6-4b2c-b6e8-44b29a5216e5 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] [instance: e245e3c8-b2eb-4f0f-8dec-c7bc290bd356] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:24.187634 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ec34d335-5218-4361-8aa3-72f3612eb556 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] 10.222.0.20 "GET /compute/v2.1/servers/fc051dca-45a8-4241-b8a5-29b49903da93" status: 200 len: 1469 microversion: 2.1 time: 0.400496 Oct 04 18:42:24.189340 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1709/3485] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:23 2022] GET /compute/v2.1/servers/fc051dca-45a8-4241-b8a5-29b49903da93 => generated 1469 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:24.206116 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8e4529e3-6bf6-4b2c-b6e8-44b29a5216e5 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:24.207914 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8e4529e3-6bf6-4b2c-b6e8-44b29a5216e5 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:24.208875 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8e4529e3-6bf6-4b2c-b6e8-44b29a5216e5 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:24.209758 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8e4529e3-6bf6-4b2c-b6e8-44b29a5216e5 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:24.210295 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8e4529e3-6bf6-4b2c-b6e8-44b29a5216e5 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:24.210968 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8e4529e3-6bf6-4b2c-b6e8-44b29a5216e5 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:24.404816 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8e4529e3-6bf6-4b2c-b6e8-44b29a5216e5 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '777a7a51e45b498597f7a1202217575c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b43fba16115404aaa793fb907fd257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:24.417370 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8e4529e3-6bf6-4b2c-b6e8-44b29a5216e5 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] 10.222.0.20 "GET /compute/v2.1/servers/e245e3c8-b2eb-4f0f-8dec-c7bc290bd356" status: 200 len: 1315 microversion: 2.1 time: 0.237241 Oct 04 18:42:24.417996 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1777/3486] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:24 2022] GET /compute/v2.1/servers/e245e3c8-b2eb-4f0f-8dec-c7bc290bd356 => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:24.712845 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b38458e2-343a-4d1e-88a0-95c3a97aae9c tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:24.714087 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b38458e2-343a-4d1e-88a0-95c3a97aae9c tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: cd97d817-422a-457d-b653-020350d75d6e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:24.723690 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b38458e2-343a-4d1e-88a0-95c3a97aae9c tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:24.724457 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b38458e2-343a-4d1e-88a0-95c3a97aae9c tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:24.725111 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b38458e2-343a-4d1e-88a0-95c3a97aae9c tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:24.726177 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b38458e2-343a-4d1e-88a0-95c3a97aae9c tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:24.726925 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b38458e2-343a-4d1e-88a0-95c3a97aae9c tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:24.727610 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b38458e2-343a-4d1e-88a0-95c3a97aae9c tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:24.890207 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b38458e2-343a-4d1e-88a0-95c3a97aae9c tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:24.902342 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b38458e2-343a-4d1e-88a0-95c3a97aae9c tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/cd97d817-422a-457d-b653-020350d75d6e" status: 200 len: 1521 microversion: 2.1 time: 0.197045 Oct 04 18:42:24.903114 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1710/3487] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:24 2022] GET /compute/v2.1/servers/cd97d817-422a-457d-b653-020350d75d6e => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:25.210612 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e4589522-367b-4edb-95a6-e897e4542d54 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:25.212235 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e4589522-367b-4edb-95a6-e897e4542d54 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: af3e9546-9a60-424a-8d98-234b08364d1d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:25.223467 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-fb8ce8d6-6214-45aa-ab68-c3a20276cdf5 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:25.229090 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-fb8ce8d6-6214-45aa-ab68-c3a20276cdf5 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] [instance: fc051dca-45a8-4241-b8a5-29b49903da93] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:25.235057 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e4589522-367b-4edb-95a6-e897e4542d54 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:25.239425 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e4589522-367b-4edb-95a6-e897e4542d54 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:25.240588 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e4589522-367b-4edb-95a6-e897e4542d54 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:25.242743 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e4589522-367b-4edb-95a6-e897e4542d54 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:25.243401 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e4589522-367b-4edb-95a6-e897e4542d54 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:25.244297 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e4589522-367b-4edb-95a6-e897e4542d54 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:25.256814 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fb8ce8d6-6214-45aa-ab68-c3a20276cdf5 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:25.257834 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fb8ce8d6-6214-45aa-ab68-c3a20276cdf5 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:25.257834 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fb8ce8d6-6214-45aa-ab68-c3a20276cdf5 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:25.261124 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fb8ce8d6-6214-45aa-ab68-c3a20276cdf5 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:25.261915 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fb8ce8d6-6214-45aa-ab68-c3a20276cdf5 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:25.262376 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fb8ce8d6-6214-45aa-ab68-c3a20276cdf5 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:25.794707 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e4589522-367b-4edb-95a6-e897e4542d54 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:25.812545 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e4589522-367b-4edb-95a6-e897e4542d54 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/af3e9546-9a60-424a-8d98-234b08364d1d" status: 200 len: 1501 microversion: 2.1 time: 0.609012 Oct 04 18:42:25.823980 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1778/3488] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:25 2022] GET /compute/v2.1/servers/af3e9546-9a60-424a-8d98-234b08364d1d => generated 1501 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:25.833766 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1f149c77-c8dc-46fe-9eb8-eeba23f84dc2 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:25.834721 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1f149c77-c8dc-46fe-9eb8-eeba23f84dc2 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] [instance: e245e3c8-b2eb-4f0f-8dec-c7bc290bd356] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:25.835824 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-fb8ce8d6-6214-45aa-ab68-c3a20276cdf5 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e2e6b962134c77b85f0c7ac8a6b746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd0b1764f314627906bcab7b4ed8a8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:25.843136 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1f149c77-c8dc-46fe-9eb8-eeba23f84dc2 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:25.844181 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1f149c77-c8dc-46fe-9eb8-eeba23f84dc2 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:25.844514 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1f149c77-c8dc-46fe-9eb8-eeba23f84dc2 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:25.845310 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1f149c77-c8dc-46fe-9eb8-eeba23f84dc2 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:25.845958 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1f149c77-c8dc-46fe-9eb8-eeba23f84dc2 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:25.846174 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-fb8ce8d6-6214-45aa-ab68-c3a20276cdf5 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] 10.222.0.20 "GET /compute/v2.1/servers/fc051dca-45a8-4241-b8a5-29b49903da93" status: 200 len: 1469 microversion: 2.1 time: 0.628440 Oct 04 18:42:25.846844 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1f149c77-c8dc-46fe-9eb8-eeba23f84dc2 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:25.850576 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1711/3489] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:25 2022] GET /compute/v2.1/servers/fc051dca-45a8-4241-b8a5-29b49903da93 => generated 1469 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:25.858796 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c53b95b9-6ce2-4ead-8798-f3b01b0cfd7d tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:25.862605 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c53b95b9-6ce2-4ead-8798-f3b01b0cfd7d tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: af3e9546-9a60-424a-8d98-234b08364d1d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:25.871326 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=100 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:42:25.878517 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c53b95b9-6ce2-4ead-8798-f3b01b0cfd7d tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:25.879025 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c53b95b9-6ce2-4ead-8798-f3b01b0cfd7d tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:25.879470 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c53b95b9-6ce2-4ead-8798-f3b01b0cfd7d tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:25.882348 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c53b95b9-6ce2-4ead-8798-f3b01b0cfd7d tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:25.882881 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c53b95b9-6ce2-4ead-8798-f3b01b0cfd7d tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:25.884542 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c53b95b9-6ce2-4ead-8798-f3b01b0cfd7d tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:26.195770 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1f149c77-c8dc-46fe-9eb8-eeba23f84dc2 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '777a7a51e45b498597f7a1202217575c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b43fba16115404aaa793fb907fd257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:26.206113 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1f149c77-c8dc-46fe-9eb8-eeba23f84dc2 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] 10.222.0.20 "GET /compute/v2.1/servers/e245e3c8-b2eb-4f0f-8dec-c7bc290bd356" status: 200 len: 1315 microversion: 2.1 time: 0.377327 Oct 04 18:42:26.208038 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1779/3490] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:25 2022] GET /compute/v2.1/servers/e245e3c8-b2eb-4f0f-8dec-c7bc290bd356 => generated 1315 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:26.215670 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-19615900-b6a4-4b69-8d40-e1e6a6a5af83 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:26.217289 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-19615900-b6a4-4b69-8d40-e1e6a6a5af83 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: cd97d817-422a-457d-b653-020350d75d6e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:26.226345 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-19615900-b6a4-4b69-8d40-e1e6a6a5af83 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:26.227028 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-19615900-b6a4-4b69-8d40-e1e6a6a5af83 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:26.227837 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-19615900-b6a4-4b69-8d40-e1e6a6a5af83 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:26.228756 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-19615900-b6a4-4b69-8d40-e1e6a6a5af83 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:26.229435 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-19615900-b6a4-4b69-8d40-e1e6a6a5af83 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:26.230033 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-19615900-b6a4-4b69-8d40-e1e6a6a5af83 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:26.339975 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c53b95b9-6ce2-4ead-8798-f3b01b0cfd7d tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:26.365409 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c53b95b9-6ce2-4ead-8798-f3b01b0cfd7d tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/af3e9546-9a60-424a-8d98-234b08364d1d" status: 200 len: 1501 microversion: 2.1 time: 0.513262 Oct 04 18:42:26.368859 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1712/3491] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:25 2022] GET /compute/v2.1/servers/af3e9546-9a60-424a-8d98-234b08364d1d => generated 1501 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:26.404130 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-78f0d79e-b5ef-408d-92cf-276acc4e1469 req-6d313546-aa1f-405e-a7e8-32caf38c9c47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e245e3c8-b2eb-4f0f-8dec-c7bc290bd356", "name": "network-vif-plugged", "status": "completed", "tag": "de5db3a4-1f99-4a92-a78e-f59449b5343b"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:26.429414 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-78f0d79e-b5ef-408d-92cf-276acc4e1469 req-6d313546-aa1f-405e-a7e8-32caf38c9c47 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:26.431677 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-78f0d79e-b5ef-408d-92cf-276acc4e1469 req-6d313546-aa1f-405e-a7e8-32caf38c9c47 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:26.436017 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-78f0d79e-b5ef-408d-92cf-276acc4e1469 req-6d313546-aa1f-405e-a7e8-32caf38c9c47 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:26.459243 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-78f0d79e-b5ef-408d-92cf-276acc4e1469 req-6d313546-aa1f-405e-a7e8-32caf38c9c47 service nova] Creating event network-vif-plugged:de5db3a4-1f99-4a92-a78e-f59449b5343b for instance e245e3c8-b2eb-4f0f-8dec-c7bc290bd356 on n-h2-850501-14 Oct 04 18:42:26.472739 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-78f0d79e-b5ef-408d-92cf-276acc4e1469 req-6d313546-aa1f-405e-a7e8-32caf38c9c47 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083502 Oct 04 18:42:26.473576 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1713/3492] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:42:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:42:26.481971 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f9e22bcb-444d-40b6-9af7-674cd367202d tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:26.487700 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f9e22bcb-444d-40b6-9af7-674cd367202d tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: af3e9546-9a60-424a-8d98-234b08364d1d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:26.492617 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f9e22bcb-444d-40b6-9af7-674cd367202d tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:26.494678 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f9e22bcb-444d-40b6-9af7-674cd367202d tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:26.495356 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f9e22bcb-444d-40b6-9af7-674cd367202d tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:26.496483 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f9e22bcb-444d-40b6-9af7-674cd367202d tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:26.498629 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f9e22bcb-444d-40b6-9af7-674cd367202d tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:26.499270 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f9e22bcb-444d-40b6-9af7-674cd367202d tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:26.559818 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f9e22bcb-444d-40b6-9af7-674cd367202d tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: af3e9546-9a60-424a-8d98-234b08364d1d] Going to try to terminate instance {{(pid=123002) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:42:26.681283 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-19615900-b6a4-4b69-8d40-e1e6a6a5af83 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:26.701089 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-19615900-b6a4-4b69-8d40-e1e6a6a5af83 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/cd97d817-422a-457d-b653-020350d75d6e" status: 200 len: 1521 microversion: 2.1 time: 0.488757 Oct 04 18:42:26.702080 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1780/3493] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:26 2022] GET /compute/v2.1/servers/cd97d817-422a-457d-b653-020350d75d6e => generated 1521 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:26.708111 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-abab77da-2e48-40c4-ba52-8ad410ed311e req-d289d235-e901-4ef7-8fc8-715df5de92cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc051dca-45a8-4241-b8a5-29b49903da93", "name": "network-vif-deleted", "tag": "e9c024cc-8326-49d2-a3f0-1c293e02d3ca"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:26.739762 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-abab77da-2e48-40c4-ba52-8ad410ed311e req-d289d235-e901-4ef7-8fc8-715df5de92cc service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:26.748278 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-abab77da-2e48-40c4-ba52-8ad410ed311e req-d289d235-e901-4ef7-8fc8-715df5de92cc service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:26.749266 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-abab77da-2e48-40c4-ba52-8ad410ed311e req-d289d235-e901-4ef7-8fc8-715df5de92cc service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:26.775694 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-abab77da-2e48-40c4-ba52-8ad410ed311e req-d289d235-e901-4ef7-8fc8-715df5de92cc service nova] Creating event network-vif-deleted:e9c024cc-8326-49d2-a3f0-1c293e02d3ca for instance fc051dca-45a8-4241-b8a5-29b49903da93 on n-h1-850501-14 Oct 04 18:42:26.783370 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-abab77da-2e48-40c4-ba52-8ad410ed311e req-d289d235-e901-4ef7-8fc8-715df5de92cc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078258 Oct 04 18:42:26.784221 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1781/3494] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:42:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:42:26.875490 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-220b5316-479b-43f8-bb43-acf9f71d74f0 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:26.876485 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-220b5316-479b-43f8-bb43-acf9f71d74f0 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] [instance: fc051dca-45a8-4241-b8a5-29b49903da93] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:26.900993 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-220b5316-479b-43f8-bb43-acf9f71d74f0 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:26.901971 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-220b5316-479b-43f8-bb43-acf9f71d74f0 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:26.902716 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-220b5316-479b-43f8-bb43-acf9f71d74f0 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:26.903569 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-220b5316-479b-43f8-bb43-acf9f71d74f0 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:26.905426 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-220b5316-479b-43f8-bb43-acf9f71d74f0 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:26.907016 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-220b5316-479b-43f8-bb43-acf9f71d74f0 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:26.953192 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-220b5316-479b-43f8-bb43-acf9f71d74f0 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:26.954076 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-220b5316-479b-43f8-bb43-acf9f71d74f0 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:26.954610 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-220b5316-479b-43f8-bb43-acf9f71d74f0 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:26.955122 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-220b5316-479b-43f8-bb43-acf9f71d74f0 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Lazy-loading 'fault' on Instance uuid fc051dca-45a8-4241-b8a5-29b49903da93 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:42:27.008484 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-220b5316-479b-43f8-bb43-acf9f71d74f0 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e2e6b962134c77b85f0c7ac8a6b746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd0b1764f314627906bcab7b4ed8a8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:27.021622 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f9e22bcb-444d-40b6-9af7-674cd367202d tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "DELETE /compute/v2.1/servers/af3e9546-9a60-424a-8d98-234b08364d1d" status: 204 len: 0 microversion: 2.1 time: 0.546087 Oct 04 18:42:27.028573 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1714/3495] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:42:26 2022] DELETE /compute/v2.1/servers/af3e9546-9a60-424a-8d98-234b08364d1d => generated 0 bytes in 548 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:42:27.028735 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-220b5316-479b-43f8-bb43-acf9f71d74f0 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] 10.222.0.20 "GET /compute/v2.1/servers/fc051dca-45a8-4241-b8a5-29b49903da93" status: 200 len: 1304 microversion: 2.1 time: 0.156666 Oct 04 18:42:27.029086 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1782/3496] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:26 2022] GET /compute/v2.1/servers/fc051dca-45a8-4241-b8a5-29b49903da93 => generated 1304 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:27.044087 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-cde3019d-c6e1-4f54-b32d-61f5c428dfea tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:27.057130 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-cde3019d-c6e1-4f54-b32d-61f5c428dfea tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: af3e9546-9a60-424a-8d98-234b08364d1d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:27.075626 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cde3019d-c6e1-4f54-b32d-61f5c428dfea tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:27.076176 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cde3019d-c6e1-4f54-b32d-61f5c428dfea tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:27.077284 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cde3019d-c6e1-4f54-b32d-61f5c428dfea tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:27.078042 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cde3019d-c6e1-4f54-b32d-61f5c428dfea tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:27.078527 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cde3019d-c6e1-4f54-b32d-61f5c428dfea tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:27.080089 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cde3019d-c6e1-4f54-b32d-61f5c428dfea tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:27.233952 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-becaa77f-f807-4b98-b6b4-d3d654552c0f tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:27.234571 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-becaa77f-f807-4b98-b6b4-d3d654552c0f tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] [instance: e245e3c8-b2eb-4f0f-8dec-c7bc290bd356] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:27.241568 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-becaa77f-f807-4b98-b6b4-d3d654552c0f tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:27.242052 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-becaa77f-f807-4b98-b6b4-d3d654552c0f tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:27.242488 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-becaa77f-f807-4b98-b6b4-d3d654552c0f tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:27.243185 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-becaa77f-f807-4b98-b6b4-d3d654552c0f tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:27.243669 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-becaa77f-f807-4b98-b6b4-d3d654552c0f tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:27.244333 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-becaa77f-f807-4b98-b6b4-d3d654552c0f tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:27.419554 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-cde3019d-c6e1-4f54-b32d-61f5c428dfea tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:27.425248 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:42:27.430616 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-cde3019d-c6e1-4f54-b32d-61f5c428dfea tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/af3e9546-9a60-424a-8d98-234b08364d1d" status: 200 len: 1507 microversion: 2.1 time: 0.392803 Oct 04 18:42:27.480116 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1715/3497] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:27 2022] GET /compute/v2.1/servers/af3e9546-9a60-424a-8d98-234b08364d1d => generated 1507 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:27.518347 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-becaa77f-f807-4b98-b6b4-d3d654552c0f tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '777a7a51e45b498597f7a1202217575c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b43fba16115404aaa793fb907fd257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:27.546448 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-becaa77f-f807-4b98-b6b4-d3d654552c0f tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] 10.222.0.20 "GET /compute/v2.1/servers/e245e3c8-b2eb-4f0f-8dec-c7bc290bd356" status: 200 len: 1315 microversion: 2.1 time: 0.314839 Oct 04 18:42:27.548414 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1783/3498] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:27 2022] GET /compute/v2.1/servers/e245e3c8-b2eb-4f0f-8dec-c7bc290bd356 => generated 1315 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:27.725936 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-476d967e-2eb4-47dd-9ead-ce32d3e1ef16 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:27.726691 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-476d967e-2eb4-47dd-9ead-ce32d3e1ef16 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: cd97d817-422a-457d-b653-020350d75d6e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:27.735727 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-476d967e-2eb4-47dd-9ead-ce32d3e1ef16 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:27.737483 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-476d967e-2eb4-47dd-9ead-ce32d3e1ef16 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:27.738443 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-476d967e-2eb4-47dd-9ead-ce32d3e1ef16 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:27.739472 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-476d967e-2eb4-47dd-9ead-ce32d3e1ef16 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:27.740369 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-476d967e-2eb4-47dd-9ead-ce32d3e1ef16 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:27.741158 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-476d967e-2eb4-47dd-9ead-ce32d3e1ef16 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:28.035910 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-476d967e-2eb4-47dd-9ead-ce32d3e1ef16 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:28.051111 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-476d967e-2eb4-47dd-9ead-ce32d3e1ef16 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/cd97d817-422a-457d-b653-020350d75d6e" status: 200 len: 1521 microversion: 2.1 time: 0.329899 Oct 04 18:42:28.053045 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1716/3499] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:27 2022] GET /compute/v2.1/servers/cd97d817-422a-457d-b653-020350d75d6e => generated 1521 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:28.072736 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f880d6a0-ab35-4390-a322-afa299313947 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:28.073436 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f880d6a0-ab35-4390-a322-afa299313947 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] [instance: fc051dca-45a8-4241-b8a5-29b49903da93] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:28.082275 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f880d6a0-ab35-4390-a322-afa299313947 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:28.083811 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f880d6a0-ab35-4390-a322-afa299313947 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:28.084483 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f880d6a0-ab35-4390-a322-afa299313947 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:28.086523 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f880d6a0-ab35-4390-a322-afa299313947 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:28.086523 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f880d6a0-ab35-4390-a322-afa299313947 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:28.087075 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f880d6a0-ab35-4390-a322-afa299313947 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:28.106539 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-f880d6a0-ab35-4390-a322-afa299313947 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] HTTP exception thrown: Instance fc051dca-45a8-4241-b8a5-29b49903da93 could not be found. Oct 04 18:42:28.109887 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f880d6a0-ab35-4390-a322-afa299313947 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Request method failure captured: Oct 04 18:42:28.109887 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/fc051dca-45a8-4241-b8a5-29b49903da93 HTTP/1.1 Oct 04 18:42:28.109887 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:42:28.109887 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:42:28.109887 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:42:28.109887 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:42:28.109887 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:42:28.109887 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:42:28.109887 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:42:28.109887 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:42:28.109887 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPH52JdAkODqPHLL0bKaK2txttlqN9lpSwRIj4jpRG0Z_aspHexkfXMlPYlxjTdIMINZfpKU4RH_d40IUbAuHQX1ZyC1iwLnfG7IqwLH5cqE0UwT8oTsEW1w22SSjeTiwVL0tayXAWyFy1ikZ4B96FdiSZCWaTBzSRu9prb4iVWm8oAM Oct 04 18:42:28.109887 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:42:28.109887 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:42:28.109887 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:42:28.109887 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:42:28.109887 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:42:28.109887 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:42:28.109887 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 6dd0b1764f314627906bcab7b4ed8a8c Oct 04 18:42:28.109887 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-TenantUsagesTestJSON-1925814432 Oct 04 18:42:28.109887 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:42:28.109887 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:42:28.109887 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6dd0b1764f314627906bcab7b4ed8a8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6dd0b1764f314627906bcab7b4ed8a8c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6dd0b1764f314627906bcab7b4ed8a8c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6dd0b1764f314627906bcab7b4ed8a8c"}]}] Oct 04 18:42:28.109887 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-TenantUsagesTestJSON-1925814432 Oct 04 18:42:28.109887 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 6dd0b1764f314627906bcab7b4ed8a8c Oct 04 18:42:28.109887 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-TenantUsagesTestJSON-1925814432 Oct 04 18:42:28.109887 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-TenantUsagesTestJSON-1925814432-project Oct 04 18:42:28.109887 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:42:28.109887 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:42:28.109887 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 33e2e6b962134c77b85f0c7ac8a6b746 Oct 04 18:42:28.109887 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-TenantUsagesTestJSON-1925814432-project Oct 04 18:42:28.109887 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:42:28.109887 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance fc051dca-45a8-4241-b8a5-29b49903da93 could not be found. Oct 04 18:42:28.109887 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': 'fc051dca-45a8-4241-b8a5-29b49903da93'} Oct 04 18:42:28.109887 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:42:28.109887 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:28.109887 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:42:28.109887 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:42:28.109887 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:42:28.109887 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:42:28.109887 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:42:28.109887 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:42:28.109887 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:42:28.109887 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:42:28.109887 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc051dca-45a8-4241-b8a5-29b49903da93 could not be found. Oct 04 18:42:28.109887 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:42:28.109887 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:42:28.109887 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:42:28.109887 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:28.109887 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:42:28.109887 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:42:28.109887 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:42:28.109887 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:42:28.109887 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:42:28.109887 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:42:28.109887 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:42:28.109887 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:42:28.109887 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:42:28.109887 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:42:28.109887 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:42:28.109887 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:42:28.109887 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc051dca-45a8-4241-b8a5-29b49903da93 could not be found. Oct 04 18:42:28.109887 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:42:28.109887 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:42:28.109887 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:42:28.114203 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:28.114203 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:42:28.114203 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:42:28.114203 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:42:28.114203 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:42:28.114203 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc051dca-45a8-4241-b8a5-29b49903da93 could not be found. Oct 04 18:42:28.114203 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:42:28.114203 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f880d6a0-ab35-4390-a322-afa299313947 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] Returning 404 to user: Instance fc051dca-45a8-4241-b8a5-29b49903da93 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:42:28.114203 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f880d6a0-ab35-4390-a322-afa299313947 tempest-TenantUsagesTestJSON-1925814432 tempest-TenantUsagesTestJSON-1925814432-project] 10.222.0.20 "GET /compute/v2.1/servers/fc051dca-45a8-4241-b8a5-29b49903da93" status: 404 len: 111 microversion: 2.1 time: 0.062534 Oct 04 18:42:28.114203 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1784/3500] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:28 2022] GET /compute/v2.1/servers/fc051dca-45a8-4241-b8a5-29b49903da93 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:42:28.456428 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3b89365a-be43-4b6d-b689-f0eb1a5a69e2 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:28.457262 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3b89365a-be43-4b6d-b689-f0eb1a5a69e2 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: af3e9546-9a60-424a-8d98-234b08364d1d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:28.460816 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:42:28.465140 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3b89365a-be43-4b6d-b689-f0eb1a5a69e2 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:28.465675 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3b89365a-be43-4b6d-b689-f0eb1a5a69e2 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:28.466060 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3b89365a-be43-4b6d-b689-f0eb1a5a69e2 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:28.466810 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3b89365a-be43-4b6d-b689-f0eb1a5a69e2 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:28.467264 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3b89365a-be43-4b6d-b689-f0eb1a5a69e2 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:28.467685 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3b89365a-be43-4b6d-b689-f0eb1a5a69e2 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:28.578466 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b23fcd86-2c91-4f45-85fe-395b24e52eef tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:28.579081 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b23fcd86-2c91-4f45-85fe-395b24e52eef tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] [instance: e245e3c8-b2eb-4f0f-8dec-c7bc290bd356] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:28.599385 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b23fcd86-2c91-4f45-85fe-395b24e52eef tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:28.599882 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b23fcd86-2c91-4f45-85fe-395b24e52eef tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:28.600345 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b23fcd86-2c91-4f45-85fe-395b24e52eef tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:28.603340 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b23fcd86-2c91-4f45-85fe-395b24e52eef tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:28.608203 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b23fcd86-2c91-4f45-85fe-395b24e52eef tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:28.608203 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b23fcd86-2c91-4f45-85fe-395b24e52eef tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:28.707481 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3b89365a-be43-4b6d-b689-f0eb1a5a69e2 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:28.718948 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3b89365a-be43-4b6d-b689-f0eb1a5a69e2 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/af3e9546-9a60-424a-8d98-234b08364d1d" status: 200 len: 1507 microversion: 2.1 time: 0.266573 Oct 04 18:42:28.732232 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1717/3501] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:28 2022] GET /compute/v2.1/servers/af3e9546-9a60-424a-8d98-234b08364d1d => generated 1507 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:29.048113 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8ac3f793-e926-4d84-84f8-61a1d9478095 tempest-ImagesMetadataNegativeTestJSON-517472497 tempest-ImagesMetadataNegativeTestJSON-517472497-project] Calling method '.version_select at 0x7fe2580625e0>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:29.060388 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b23fcd86-2c91-4f45-85fe-395b24e52eef tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '777a7a51e45b498597f7a1202217575c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b43fba16115404aaa793fb907fd257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:29.074263 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-8ac3f793-e926-4d84-84f8-61a1d9478095 tempest-ImagesMetadataNegativeTestJSON-517472497 tempest-ImagesMetadataNegativeTestJSON-517472497-project] HTTP exception thrown: Image not found. Oct 04 18:42:29.075225 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b23fcd86-2c91-4f45-85fe-395b24e52eef tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] 10.222.0.20 "GET /compute/v2.1/servers/e245e3c8-b2eb-4f0f-8dec-c7bc290bd356" status: 200 len: 1315 microversion: 2.1 time: 0.506117 Oct 04 18:42:29.075804 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1785/3502] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:28 2022] GET /compute/v2.1/servers/e245e3c8-b2eb-4f0f-8dec-c7bc290bd356 => generated 1315 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:42:29.081552 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8ac3f793-e926-4d84-84f8-61a1d9478095 tempest-ImagesMetadataNegativeTestJSON-517472497 tempest-ImagesMetadataNegativeTestJSON-517472497-project] Request method failure captured: Oct 04 18:42:29.081552 n-d-850501-14 devstack@n-api.service[123002]: request: DELETE /compute/v2.1/images/2cd665f5-e114-4d10-b91e-5a76e36b44b1/metadata/os_distro HTTP/1.1 Oct 04 18:42:29.081552 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:42:29.081552 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:42:29.081552 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:42:29.081552 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:42:29.081552 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:42:29.081552 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:42:29.081552 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:42:29.081552 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:42:29.081552 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH6UgAOuYwAKgFMrByEel3XhPzn8_hqrCbLe24GuCIaJQIQ0XKlTctu2fhtxcww92LtqKCl5in_fwck_h-sQCwsJmAo4PY659ovyzr5dLzZejNzQZpHHmKlGhCL_xgdq5riG8ZGq8J0ErtgzOSEKpE1sTMmZZmR62Zoc11L5rN9Mgr8 Oct 04 18:42:29.081552 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:42:29.081552 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:42:29.081552 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:42:29.081552 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:42:29.081552 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:42:29.081552 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:42:29.081552 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: ba78c0e1d83a4250a7088ba24699327b Oct 04 18:42:29.081552 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-517472497 Oct 04 18:42:29.081552 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:42:29.081552 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:42:29.081552 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ba78c0e1d83a4250a7088ba24699327b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ba78c0e1d83a4250a7088ba24699327b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ba78c0e1d83a4250a7088ba24699327b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ba78c0e1d83a4250a7088ba24699327b"}]}] Oct 04 18:42:29.081552 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-517472497 Oct 04 18:42:29.081552 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: ba78c0e1d83a4250a7088ba24699327b Oct 04 18:42:29.081552 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-517472497 Oct 04 18:42:29.081552 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ImagesMetadataNegativeTestJSON-517472497-project Oct 04 18:42:29.081552 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:42:29.081552 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:42:29.081552 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: a681b13296a7411cb5a19a76a10ce90d Oct 04 18:42:29.081552 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-517472497-project Oct 04 18:42:29.081552 n-d-850501-14 devstack@n-api.service[123002]: method: Oct 04 18:42:29.081552 n-d-850501-14 devstack@n-api.service[123002]: exception: Image not found. Oct 04 18:42:29.081552 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'image_id': '2cd665f5-e114-4d10-b91e-5a76e36b44b1', 'id': 'os_distro'} Oct 04 18:42:29.081552 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:42:29.081552 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:29.081552 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 18:42:29.081552 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 18:42:29.081552 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:42:29.081552 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:42:29.081552 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 18:42:29.081552 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 18:42:29.081552 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:42:29.081552 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:42:29.081552 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 18:42:29.081552 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 18:42:29.081552 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 18:42:29.081552 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 18:42:29.081552 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:42:29.081552 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:42:29.081552 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:42:29.081552 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:42:29.081552 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 2cd665f5-e114-4d10-b91e-5a76e36b44b1 Oct 04 18:42:29.081552 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:29.081552 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:42:29.081552 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:29.081552 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:29.081552 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 04 18:42:29.081552 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 04 18:42:29.081552 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 18:42:29.081552 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 18:42:29.081552 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 18:42:29.081552 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 18:42:29.085612 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 18:42:29.085612 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 18:42:29.085612 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 18:42:29.085612 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 18:42:29.085612 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:42:29.085612 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:42:29.085612 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 18:42:29.085612 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 18:42:29.085612 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:42:29.085612 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:42:29.085612 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 18:42:29.085612 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 18:42:29.085612 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 18:42:29.085612 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 18:42:29.085612 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:42:29.085612 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:42:29.085612 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:42:29.085612 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:42:29.085612 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2cd665f5-e114-4d10-b91e-5a76e36b44b1 could not be found. Oct 04 18:42:29.085612 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:29.085612 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:42:29.085612 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:29.085612 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:29.085612 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:42:29.085612 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:42:29.085612 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:42:29.085612 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:42:29.085612 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:42:29.085612 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:42:29.085612 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:42:29.085612 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:42:29.085612 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Oct 04 18:42:29.085612 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 04 18:42:29.085612 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 04 18:42:29.085612 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 18:42:29.085612 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:42:29.085612 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:29.085612 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:42:29.085612 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:29.085612 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:29.085612 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:42:29.085612 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:42:29.085612 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:42:29.085612 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:42:29.085612 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:42:29.085612 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:29.085612 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8ac3f793-e926-4d84-84f8-61a1d9478095 tempest-ImagesMetadataNegativeTestJSON-517472497 tempest-ImagesMetadataNegativeTestJSON-517472497-project] Returning 404 to user: Image not found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:42:29.085612 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8ac3f793-e926-4d84-84f8-61a1d9478095 tempest-ImagesMetadataNegativeTestJSON-517472497 tempest-ImagesMetadataNegativeTestJSON-517472497-project] 10.222.0.20 "DELETE /compute/v2.1/images/2cd665f5-e114-4d10-b91e-5a76e36b44b1/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.230816 Oct 04 18:42:29.090510 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1718/3503] 10.222.0.20 () {58 vars in 1293 bytes} [Tue Oct 4 18:42:28 2022] DELETE /compute/v2.1/images/2cd665f5-e114-4d10-b91e-5a76e36b44b1/metadata/os_distro => generated 62 bytes in 237 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 04 18:42:29.100297 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9fa0e9c9-d26f-4ac4-8152-ae514ad9c0e2 tempest-ImagesMetadataNegativeTestJSON-517472497 tempest-ImagesMetadataNegativeTestJSON-517472497-project] Calling method '.version_select at 0x7fe253fc9940>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:29.104028 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-dd55c26b-d4ba-4e7a-990b-26d579465212 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:29.104863 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-dd55c26b-d4ba-4e7a-990b-26d579465212 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: cd97d817-422a-457d-b653-020350d75d6e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:29.113795 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dd55c26b-d4ba-4e7a-990b-26d579465212 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:29.114299 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dd55c26b-d4ba-4e7a-990b-26d579465212 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:29.114734 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dd55c26b-d4ba-4e7a-990b-26d579465212 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:29.115439 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dd55c26b-d4ba-4e7a-990b-26d579465212 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:29.115893 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dd55c26b-d4ba-4e7a-990b-26d579465212 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:29.116343 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dd55c26b-d4ba-4e7a-990b-26d579465212 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:29.127730 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-9fa0e9c9-d26f-4ac4-8152-ae514ad9c0e2 tempest-ImagesMetadataNegativeTestJSON-517472497 tempest-ImagesMetadataNegativeTestJSON-517472497-project] HTTP exception thrown: Image not found. Oct 04 18:42:29.130532 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9fa0e9c9-d26f-4ac4-8152-ae514ad9c0e2 tempest-ImagesMetadataNegativeTestJSON-517472497 tempest-ImagesMetadataNegativeTestJSON-517472497-project] Request method failure captured: Oct 04 18:42:29.130532 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/images/e1f73a4c-cdd4-4854-b175-c0a20bcf80e0/metadata/os_version HTTP/1.1 Oct 04 18:42:29.130532 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:42:29.130532 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:42:29.130532 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:42:29.130532 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:42:29.130532 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:42:29.130532 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:42:29.130532 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:42:29.130532 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:42:29.130532 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH6UgAOuYwAKgFMrByEel3XhPzn8_hqrCbLe24GuCIaJQIQ0XKlTctu2fhtxcww92LtqKCl5in_fwck_h-sQCwsJmAo4PY659ovyzr5dLzZejNzQZpHHmKlGhCL_xgdq5riG8ZGq8J0ErtgzOSEKpE1sTMmZZmR62Zoc11L5rN9Mgr8 Oct 04 18:42:29.130532 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:42:29.130532 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:42:29.130532 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:42:29.130532 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:42:29.130532 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:42:29.130532 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:42:29.130532 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: ba78c0e1d83a4250a7088ba24699327b Oct 04 18:42:29.130532 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-517472497 Oct 04 18:42:29.130532 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:42:29.130532 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:42:29.130532 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ba78c0e1d83a4250a7088ba24699327b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ba78c0e1d83a4250a7088ba24699327b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ba78c0e1d83a4250a7088ba24699327b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ba78c0e1d83a4250a7088ba24699327b"}]}] Oct 04 18:42:29.130532 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-517472497 Oct 04 18:42:29.130532 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: ba78c0e1d83a4250a7088ba24699327b Oct 04 18:42:29.130532 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-517472497 Oct 04 18:42:29.130532 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ImagesMetadataNegativeTestJSON-517472497-project Oct 04 18:42:29.130532 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:42:29.130532 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:42:29.130532 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: a681b13296a7411cb5a19a76a10ce90d Oct 04 18:42:29.130532 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-517472497-project Oct 04 18:42:29.130532 n-d-850501-14 devstack@n-api.service[123002]: method: Oct 04 18:42:29.130532 n-d-850501-14 devstack@n-api.service[123002]: exception: Image not found. Oct 04 18:42:29.130532 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'image_id': 'e1f73a4c-cdd4-4854-b175-c0a20bcf80e0', 'id': 'os_version'} Oct 04 18:42:29.130532 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:42:29.130532 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:29.130532 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 18:42:29.130532 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 18:42:29.130532 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:42:29.130532 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:42:29.130532 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 18:42:29.130532 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 18:42:29.130532 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:42:29.130532 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:42:29.130532 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 18:42:29.130532 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 18:42:29.130532 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 18:42:29.130532 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 18:42:29.130532 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:42:29.130532 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:42:29.130532 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:42:29.130532 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:42:29.130532 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID e1f73a4c-cdd4-4854-b175-c0a20bcf80e0 Oct 04 18:42:29.130532 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:29.130532 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:42:29.130532 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:29.130532 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:29.130532 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 04 18:42:29.130532 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 04 18:42:29.130532 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 18:42:29.130532 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 18:42:29.130532 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 18:42:29.130532 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 18:42:29.135676 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 18:42:29.135676 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 18:42:29.135676 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 18:42:29.135676 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 18:42:29.135676 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:42:29.135676 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:42:29.135676 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 18:42:29.135676 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 18:42:29.135676 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:42:29.135676 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:42:29.135676 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 18:42:29.135676 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 18:42:29.135676 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 18:42:29.135676 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 18:42:29.135676 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:42:29.135676 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:42:29.135676 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:42:29.135676 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:42:29.135676 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e1f73a4c-cdd4-4854-b175-c0a20bcf80e0 could not be found. Oct 04 18:42:29.135676 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:29.135676 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:42:29.135676 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:29.135676 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:29.135676 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:42:29.135676 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:42:29.135676 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:42:29.135676 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:42:29.135676 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:42:29.135676 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:42:29.135676 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:42:29.135676 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:42:29.135676 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Oct 04 18:42:29.135676 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 04 18:42:29.135676 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 04 18:42:29.135676 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 18:42:29.135676 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:42:29.135676 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:29.135676 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:42:29.135676 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:29.135676 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:29.135676 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:42:29.135676 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:42:29.135676 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:42:29.135676 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:42:29.135676 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:42:29.135676 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:29.141084 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9fa0e9c9-d26f-4ac4-8152-ae514ad9c0e2 tempest-ImagesMetadataNegativeTestJSON-517472497 tempest-ImagesMetadataNegativeTestJSON-517472497-project] Returning 404 to user: Image not found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:42:29.141829 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9fa0e9c9-d26f-4ac4-8152-ae514ad9c0e2 tempest-ImagesMetadataNegativeTestJSON-517472497 tempest-ImagesMetadataNegativeTestJSON-517472497-project] 10.222.0.20 "GET /compute/v2.1/images/e1f73a4c-cdd4-4854-b175-c0a20bcf80e0/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.051691 Oct 04 18:42:29.142589 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1719/3504] 10.222.0.20 () {58 vars in 1293 bytes} [Tue Oct 4 18:42:29 2022] GET /compute/v2.1/images/e1f73a4c-cdd4-4854-b175-c0a20bcf80e0/metadata/os_version => generated 62 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:42:29.152514 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-88779b56-a4ee-4b7c-9de7-e80bb4e57714 tempest-ImagesMetadataNegativeTestJSON-517472497 tempest-ImagesMetadataNegativeTestJSON-517472497-project] Calling method '.version_select at 0x7fe258062790>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:29.177982 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-88779b56-a4ee-4b7c-9de7-e80bb4e57714 tempest-ImagesMetadataNegativeTestJSON-517472497 tempest-ImagesMetadataNegativeTestJSON-517472497-project] HTTP exception thrown: Image not found. Oct 04 18:42:29.181890 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-88779b56-a4ee-4b7c-9de7-e80bb4e57714 tempest-ImagesMetadataNegativeTestJSON-517472497 tempest-ImagesMetadataNegativeTestJSON-517472497-project] Request method failure captured: Oct 04 18:42:29.181890 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/images/7a959a4f-2550-443a-b418-b21fc8464635/metadata HTTP/1.1 Oct 04 18:42:29.181890 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:42:29.181890 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:42:29.181890 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:42:29.181890 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:42:29.181890 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:42:29.181890 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:42:29.181890 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:42:29.181890 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:42:29.181890 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH6UgAOuYwAKgFMrByEel3XhPzn8_hqrCbLe24GuCIaJQIQ0XKlTctu2fhtxcww92LtqKCl5in_fwck_h-sQCwsJmAo4PY659ovyzr5dLzZejNzQZpHHmKlGhCL_xgdq5riG8ZGq8J0ErtgzOSEKpE1sTMmZZmR62Zoc11L5rN9Mgr8 Oct 04 18:42:29.181890 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:42:29.181890 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:42:29.181890 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:42:29.181890 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:42:29.181890 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:42:29.181890 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:42:29.181890 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: ba78c0e1d83a4250a7088ba24699327b Oct 04 18:42:29.181890 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-517472497 Oct 04 18:42:29.181890 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:42:29.181890 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:42:29.181890 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ba78c0e1d83a4250a7088ba24699327b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ba78c0e1d83a4250a7088ba24699327b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ba78c0e1d83a4250a7088ba24699327b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ba78c0e1d83a4250a7088ba24699327b"}]}] Oct 04 18:42:29.181890 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-517472497 Oct 04 18:42:29.181890 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: ba78c0e1d83a4250a7088ba24699327b Oct 04 18:42:29.181890 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-517472497 Oct 04 18:42:29.181890 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ImagesMetadataNegativeTestJSON-517472497-project Oct 04 18:42:29.181890 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:42:29.181890 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:42:29.181890 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: a681b13296a7411cb5a19a76a10ce90d Oct 04 18:42:29.181890 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-517472497-project Oct 04 18:42:29.181890 n-d-850501-14 devstack@n-api.service[123002]: method: Oct 04 18:42:29.181890 n-d-850501-14 devstack@n-api.service[123002]: exception: Image not found. Oct 04 18:42:29.181890 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'image_id': '7a959a4f-2550-443a-b418-b21fc8464635'} Oct 04 18:42:29.181890 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:42:29.181890 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:29.181890 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 18:42:29.181890 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 18:42:29.181890 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:42:29.181890 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:42:29.181890 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 18:42:29.181890 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 18:42:29.181890 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:42:29.181890 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:42:29.181890 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 18:42:29.181890 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 18:42:29.181890 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 18:42:29.181890 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 18:42:29.181890 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:42:29.181890 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:42:29.181890 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:42:29.181890 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:42:29.181890 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 7a959a4f-2550-443a-b418-b21fc8464635 Oct 04 18:42:29.181890 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:29.181890 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:42:29.181890 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:29.181890 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:29.181890 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 04 18:42:29.181890 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 04 18:42:29.181890 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 18:42:29.181890 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 18:42:29.181890 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 18:42:29.181890 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 18:42:29.187379 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 18:42:29.187379 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 18:42:29.187379 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 18:42:29.187379 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 18:42:29.187379 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:42:29.187379 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:42:29.187379 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 18:42:29.187379 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 18:42:29.187379 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:42:29.187379 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:42:29.187379 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 18:42:29.187379 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 18:42:29.187379 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 18:42:29.187379 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 18:42:29.187379 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:42:29.187379 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:42:29.187379 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:42:29.187379 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:42:29.187379 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7a959a4f-2550-443a-b418-b21fc8464635 could not be found. Oct 04 18:42:29.187379 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:29.187379 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:42:29.187379 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:29.187379 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:29.187379 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:42:29.187379 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:42:29.187379 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:42:29.187379 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:42:29.187379 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:42:29.187379 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:42:29.187379 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:42:29.187379 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:42:29.187379 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Oct 04 18:42:29.187379 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 04 18:42:29.187379 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 04 18:42:29.187379 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 18:42:29.187379 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:42:29.187379 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:29.187379 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:42:29.187379 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:29.187379 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:29.187379 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:42:29.187379 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:42:29.187379 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:42:29.187379 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:42:29.187379 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:42:29.187379 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:29.187379 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-88779b56-a4ee-4b7c-9de7-e80bb4e57714 tempest-ImagesMetadataNegativeTestJSON-517472497 tempest-ImagesMetadataNegativeTestJSON-517472497-project] Returning 404 to user: Image not found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:42:29.187379 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-88779b56-a4ee-4b7c-9de7-e80bb4e57714 tempest-ImagesMetadataNegativeTestJSON-517472497 tempest-ImagesMetadataNegativeTestJSON-517472497-project] 10.222.0.20 "GET /compute/v2.1/images/7a959a4f-2550-443a-b418-b21fc8464635/metadata" status: 404 len: 62 microversion: 2.1 time: 0.035430 Oct 04 18:42:29.187379 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1720/3505] 10.222.0.20 () {58 vars in 1260 bytes} [Tue Oct 4 18:42:29 2022] GET /compute/v2.1/images/7a959a4f-2550-443a-b418-b21fc8464635/metadata => generated 62 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 04 18:42:29.211328 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c04e9002-386a-460e-bc74-314919bfef23 tempest-ImagesMetadataNegativeTestJSON-517472497 tempest-ImagesMetadataNegativeTestJSON-517472497-project] Action: 'update_all', calling method: .version_select at 0x7fe2597b03a0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:29.249838 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-c04e9002-386a-460e-bc74-314919bfef23 tempest-ImagesMetadataNegativeTestJSON-517472497 tempest-ImagesMetadataNegativeTestJSON-517472497-project] HTTP exception thrown: Image not found. Oct 04 18:42:29.251942 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c04e9002-386a-460e-bc74-314919bfef23 tempest-ImagesMetadataNegativeTestJSON-517472497 tempest-ImagesMetadataNegativeTestJSON-517472497-project] Request method failure captured: Oct 04 18:42:29.251942 n-d-850501-14 devstack@n-api.service[123002]: request: PUT /compute/v2.1/images/c70ca416-c453-4fcd-992c-9355966ba7f0/metadata HTTP/1.1 Oct 04 18:42:29.251942 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:42:29.251942 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:42:29.251942 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:42:29.251942 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 57 Oct 04 18:42:29.251942 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:42:29.251942 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:42:29.251942 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:42:29.251942 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:42:29.251942 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH6UgAOuYwAKgFMrByEel3XhPzn8_hqrCbLe24GuCIaJQIQ0XKlTctu2fhtxcww92LtqKCl5in_fwck_h-sQCwsJmAo4PY659ovyzr5dLzZejNzQZpHHmKlGhCL_xgdq5riG8ZGq8J0ErtgzOSEKpE1sTMmZZmR62Zoc11L5rN9Mgr8 Oct 04 18:42:29.251942 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:42:29.251942 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:42:29.251942 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:42:29.251942 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:42:29.251942 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:42:29.251942 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:42:29.251942 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: ba78c0e1d83a4250a7088ba24699327b Oct 04 18:42:29.251942 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-517472497 Oct 04 18:42:29.251942 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:42:29.251942 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:42:29.251942 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ba78c0e1d83a4250a7088ba24699327b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ba78c0e1d83a4250a7088ba24699327b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ba78c0e1d83a4250a7088ba24699327b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ba78c0e1d83a4250a7088ba24699327b"}]}] Oct 04 18:42:29.251942 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-517472497 Oct 04 18:42:29.251942 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: ba78c0e1d83a4250a7088ba24699327b Oct 04 18:42:29.251942 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-517472497 Oct 04 18:42:29.251942 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ImagesMetadataNegativeTestJSON-517472497-project Oct 04 18:42:29.251942 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:42:29.251942 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:42:29.251942 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: a681b13296a7411cb5a19a76a10ce90d Oct 04 18:42:29.251942 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-517472497-project Oct 04 18:42:29.251942 n-d-850501-14 devstack@n-api.service[123002]: Oct 04 18:42:29.251942 n-d-850501-14 devstack@n-api.service[123002]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 04 18:42:29.251942 n-d-850501-14 devstack@n-api.service[123002]: method: Oct 04 18:42:29.251942 n-d-850501-14 devstack@n-api.service[123002]: exception: Image not found. Oct 04 18:42:29.251942 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'image_id': 'c70ca416-c453-4fcd-992c-9355966ba7f0', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 04 18:42:29.251942 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:42:29.251942 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:29.251942 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 18:42:29.251942 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 18:42:29.251942 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:42:29.251942 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:42:29.251942 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 18:42:29.251942 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 18:42:29.251942 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:42:29.251942 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:42:29.251942 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 18:42:29.251942 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 18:42:29.251942 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 18:42:29.251942 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 18:42:29.251942 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:42:29.251942 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:42:29.251942 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:42:29.251942 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:42:29.251942 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID c70ca416-c453-4fcd-992c-9355966ba7f0 Oct 04 18:42:29.251942 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:29.251942 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:42:29.251942 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:29.251942 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:29.251942 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 04 18:42:29.251942 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 04 18:42:29.251942 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 18:42:29.251942 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 18:42:29.251942 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 18:42:29.251942 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 18:42:29.257214 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 18:42:29.257214 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 18:42:29.257214 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 18:42:29.257214 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 18:42:29.257214 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:42:29.257214 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:42:29.257214 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 18:42:29.257214 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 18:42:29.257214 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:42:29.257214 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:42:29.257214 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 18:42:29.257214 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 18:42:29.257214 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 18:42:29.257214 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 18:42:29.257214 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:42:29.257214 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:42:29.257214 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:42:29.257214 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:42:29.257214 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c70ca416-c453-4fcd-992c-9355966ba7f0 could not be found. Oct 04 18:42:29.257214 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:29.257214 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:42:29.257214 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:29.257214 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:29.257214 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:42:29.257214 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:42:29.257214 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:42:29.257214 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:42:29.257214 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:42:29.257214 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:42:29.257214 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:42:29.257214 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:42:29.257214 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:42:29.257214 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:42:29.257214 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Oct 04 18:42:29.257214 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 04 18:42:29.257214 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 04 18:42:29.257214 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 18:42:29.257214 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:42:29.257214 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:29.257214 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:42:29.257214 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:29.257214 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:29.257214 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:42:29.257214 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:42:29.257214 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:42:29.257214 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:42:29.257214 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:42:29.257214 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:29.257214 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c04e9002-386a-460e-bc74-314919bfef23 tempest-ImagesMetadataNegativeTestJSON-517472497 tempest-ImagesMetadataNegativeTestJSON-517472497-project] Returning 404 to user: Image not found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:42:29.257214 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c04e9002-386a-460e-bc74-314919bfef23 tempest-ImagesMetadataNegativeTestJSON-517472497 tempest-ImagesMetadataNegativeTestJSON-517472497-project] 10.222.0.20 "PUT /compute/v2.1/images/c70ca416-c453-4fcd-992c-9355966ba7f0/metadata" status: 404 len: 62 microversion: 2.1 time: 0.065047 Oct 04 18:42:29.257214 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1721/3506] 10.222.0.20 () {60 vars in 1280 bytes} [Tue Oct 4 18:42:29 2022] PUT /compute/v2.1/images/c70ca416-c453-4fcd-992c-9355966ba7f0/metadata => generated 62 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:42:29.266918 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-17b3f084-e60c-45e6-b8e0-d2b34c7ba992 tempest-ImagesMetadataNegativeTestJSON-517472497 tempest-ImagesMetadataNegativeTestJSON-517472497-project] Action: 'update', calling method: .version_select at 0x7fe253fc9430>, body: {"meta": {"os_distro": "alt"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:29.311202 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-17b3f084-e60c-45e6-b8e0-d2b34c7ba992 tempest-ImagesMetadataNegativeTestJSON-517472497 tempest-ImagesMetadataNegativeTestJSON-517472497-project] HTTP exception thrown: Image not found. Oct 04 18:42:29.314341 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-17b3f084-e60c-45e6-b8e0-d2b34c7ba992 tempest-ImagesMetadataNegativeTestJSON-517472497 tempest-ImagesMetadataNegativeTestJSON-517472497-project] Request method failure captured: Oct 04 18:42:29.314341 n-d-850501-14 devstack@n-api.service[123002]: request: PUT /compute/v2.1/images/6e0dd18a-4306-426d-a357-2725c279ae9f/metadata/os_distro HTTP/1.1 Oct 04 18:42:29.314341 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:42:29.314341 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:42:29.314341 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:42:29.314341 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 30 Oct 04 18:42:29.314341 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:42:29.314341 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:42:29.314341 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:42:29.314341 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:42:29.314341 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH6UgAOuYwAKgFMrByEel3XhPzn8_hqrCbLe24GuCIaJQIQ0XKlTctu2fhtxcww92LtqKCl5in_fwck_h-sQCwsJmAo4PY659ovyzr5dLzZejNzQZpHHmKlGhCL_xgdq5riG8ZGq8J0ErtgzOSEKpE1sTMmZZmR62Zoc11L5rN9Mgr8 Oct 04 18:42:29.314341 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:42:29.314341 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:42:29.314341 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:42:29.314341 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:42:29.314341 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:42:29.314341 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:42:29.314341 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: ba78c0e1d83a4250a7088ba24699327b Oct 04 18:42:29.314341 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-517472497 Oct 04 18:42:29.314341 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:42:29.314341 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:42:29.314341 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ba78c0e1d83a4250a7088ba24699327b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ba78c0e1d83a4250a7088ba24699327b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ba78c0e1d83a4250a7088ba24699327b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ba78c0e1d83a4250a7088ba24699327b"}]}] Oct 04 18:42:29.314341 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-517472497 Oct 04 18:42:29.314341 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: ba78c0e1d83a4250a7088ba24699327b Oct 04 18:42:29.314341 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-517472497 Oct 04 18:42:29.314341 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ImagesMetadataNegativeTestJSON-517472497-project Oct 04 18:42:29.314341 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:42:29.314341 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:42:29.314341 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: a681b13296a7411cb5a19a76a10ce90d Oct 04 18:42:29.314341 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-517472497-project Oct 04 18:42:29.314341 n-d-850501-14 devstack@n-api.service[123002]: Oct 04 18:42:29.314341 n-d-850501-14 devstack@n-api.service[123002]: {"meta": {"os_distro": "alt"}} Oct 04 18:42:29.314341 n-d-850501-14 devstack@n-api.service[123002]: method: Oct 04 18:42:29.314341 n-d-850501-14 devstack@n-api.service[123002]: exception: Image not found. Oct 04 18:42:29.314341 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'image_id': '6e0dd18a-4306-426d-a357-2725c279ae9f', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Oct 04 18:42:29.314341 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:42:29.314341 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:29.314341 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 18:42:29.314341 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 18:42:29.314341 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:42:29.314341 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:42:29.314341 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 18:42:29.314341 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 18:42:29.314341 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:42:29.314341 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:42:29.314341 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 18:42:29.314341 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 18:42:29.314341 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 18:42:29.314341 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 18:42:29.314341 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:42:29.314341 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:42:29.314341 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:42:29.314341 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:42:29.314341 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 6e0dd18a-4306-426d-a357-2725c279ae9f Oct 04 18:42:29.314341 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:29.314341 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:42:29.314341 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:29.314341 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:29.314341 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 04 18:42:29.314341 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 04 18:42:29.314341 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 18:42:29.314341 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 18:42:29.314341 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 18:42:29.314341 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 18:42:29.321489 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 18:42:29.321489 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 18:42:29.321489 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 18:42:29.321489 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 18:42:29.321489 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:42:29.321489 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:42:29.321489 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 18:42:29.321489 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 18:42:29.321489 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:42:29.321489 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:42:29.321489 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 18:42:29.321489 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 18:42:29.321489 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 18:42:29.321489 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 18:42:29.321489 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:42:29.321489 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:42:29.321489 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:42:29.321489 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:42:29.321489 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6e0dd18a-4306-426d-a357-2725c279ae9f could not be found. Oct 04 18:42:29.321489 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:29.321489 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:42:29.321489 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:29.321489 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:29.321489 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:42:29.321489 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:42:29.321489 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:42:29.321489 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:42:29.321489 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:42:29.321489 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:42:29.321489 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:42:29.321489 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:42:29.321489 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:42:29.321489 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:42:29.321489 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Oct 04 18:42:29.321489 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 04 18:42:29.321489 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 04 18:42:29.321489 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 18:42:29.321489 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:42:29.321489 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:29.321489 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:42:29.321489 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:29.321489 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:29.321489 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:42:29.321489 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:42:29.321489 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:42:29.321489 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:42:29.321489 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:42:29.321489 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:29.321489 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-17b3f084-e60c-45e6-b8e0-d2b34c7ba992 tempest-ImagesMetadataNegativeTestJSON-517472497 tempest-ImagesMetadataNegativeTestJSON-517472497-project] Returning 404 to user: Image not found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:42:29.321489 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-17b3f084-e60c-45e6-b8e0-d2b34c7ba992 tempest-ImagesMetadataNegativeTestJSON-517472497 tempest-ImagesMetadataNegativeTestJSON-517472497-project] 10.222.0.20 "PUT /compute/v2.1/images/6e0dd18a-4306-426d-a357-2725c279ae9f/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.057814 Oct 04 18:42:29.326188 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1722/3507] 10.222.0.20 () {60 vars in 1310 bytes} [Tue Oct 4 18:42:29 2022] PUT /compute/v2.1/images/6e0dd18a-4306-426d-a357-2725c279ae9f/metadata/os_distro => generated 62 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 04 18:42:29.333445 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e805a6e4-d00f-47fc-abd9-b0dbe0e0d5ca tempest-ImagesMetadataNegativeTestJSON-517472497 tempest-ImagesMetadataNegativeTestJSON-517472497-project] Action: 'create', calling method: .version_select at 0x7fe253e64ee0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:29.373538 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-e805a6e4-d00f-47fc-abd9-b0dbe0e0d5ca tempest-ImagesMetadataNegativeTestJSON-517472497 tempest-ImagesMetadataNegativeTestJSON-517472497-project] HTTP exception thrown: Image not found. Oct 04 18:42:29.378483 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e805a6e4-d00f-47fc-abd9-b0dbe0e0d5ca tempest-ImagesMetadataNegativeTestJSON-517472497 tempest-ImagesMetadataNegativeTestJSON-517472497-project] Request method failure captured: Oct 04 18:42:29.378483 n-d-850501-14 devstack@n-api.service[123002]: request: POST /compute/v2.1/images/47fbf631-3cd0-48a9-9181-61bd8c7e901e/metadata HTTP/1.1 Oct 04 18:42:29.378483 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:42:29.378483 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:42:29.378483 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:42:29.378483 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 57 Oct 04 18:42:29.378483 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:42:29.378483 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:42:29.378483 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:42:29.378483 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:42:29.378483 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH6UgAOuYwAKgFMrByEel3XhPzn8_hqrCbLe24GuCIaJQIQ0XKlTctu2fhtxcww92LtqKCl5in_fwck_h-sQCwsJmAo4PY659ovyzr5dLzZejNzQZpHHmKlGhCL_xgdq5riG8ZGq8J0ErtgzOSEKpE1sTMmZZmR62Zoc11L5rN9Mgr8 Oct 04 18:42:29.378483 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:42:29.378483 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:42:29.378483 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:42:29.378483 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:42:29.378483 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:42:29.378483 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:42:29.378483 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: ba78c0e1d83a4250a7088ba24699327b Oct 04 18:42:29.378483 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-517472497 Oct 04 18:42:29.378483 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:42:29.378483 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:42:29.378483 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ba78c0e1d83a4250a7088ba24699327b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ba78c0e1d83a4250a7088ba24699327b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ba78c0e1d83a4250a7088ba24699327b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ba78c0e1d83a4250a7088ba24699327b"}]}] Oct 04 18:42:29.378483 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-517472497 Oct 04 18:42:29.378483 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: ba78c0e1d83a4250a7088ba24699327b Oct 04 18:42:29.378483 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-517472497 Oct 04 18:42:29.378483 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ImagesMetadataNegativeTestJSON-517472497-project Oct 04 18:42:29.378483 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:42:29.378483 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:42:29.378483 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: a681b13296a7411cb5a19a76a10ce90d Oct 04 18:42:29.378483 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-517472497-project Oct 04 18:42:29.378483 n-d-850501-14 devstack@n-api.service[123002]: Oct 04 18:42:29.378483 n-d-850501-14 devstack@n-api.service[123002]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 04 18:42:29.378483 n-d-850501-14 devstack@n-api.service[123002]: method: Oct 04 18:42:29.378483 n-d-850501-14 devstack@n-api.service[123002]: exception: Image not found. Oct 04 18:42:29.378483 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'image_id': '47fbf631-3cd0-48a9-9181-61bd8c7e901e', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 04 18:42:29.378483 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:42:29.378483 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:29.378483 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 18:42:29.378483 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 18:42:29.378483 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:42:29.378483 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:42:29.378483 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 18:42:29.378483 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 18:42:29.378483 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:42:29.378483 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:42:29.378483 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 18:42:29.378483 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 18:42:29.378483 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 18:42:29.378483 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 18:42:29.378483 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:42:29.378483 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:42:29.378483 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:42:29.378483 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:42:29.378483 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 47fbf631-3cd0-48a9-9181-61bd8c7e901e Oct 04 18:42:29.378483 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:29.378483 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:42:29.378483 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:29.378483 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:29.378483 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 04 18:42:29.378483 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 04 18:42:29.378483 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 18:42:29.378483 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 18:42:29.378483 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 18:42:29.378483 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 18:42:29.382896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 18:42:29.382896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 18:42:29.382896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 18:42:29.382896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 18:42:29.382896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:42:29.382896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:42:29.382896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 18:42:29.382896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 18:42:29.382896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:42:29.382896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:42:29.382896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 18:42:29.382896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 18:42:29.382896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 18:42:29.382896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 18:42:29.382896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:42:29.382896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:42:29.382896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:42:29.382896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:42:29.382896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 47fbf631-3cd0-48a9-9181-61bd8c7e901e could not be found. Oct 04 18:42:29.382896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:29.382896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:42:29.382896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:29.382896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:29.382896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:42:29.382896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:42:29.382896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:42:29.382896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:42:29.382896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:42:29.382896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:42:29.382896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:42:29.382896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:42:29.382896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:42:29.382896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:42:29.382896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Oct 04 18:42:29.382896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 04 18:42:29.382896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 04 18:42:29.382896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 18:42:29.382896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:42:29.382896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:29.382896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:42:29.382896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:29.382896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:29.382896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:42:29.382896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:42:29.382896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:42:29.382896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:42:29.382896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:42:29.382896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:29.382896 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e805a6e4-d00f-47fc-abd9-b0dbe0e0d5ca tempest-ImagesMetadataNegativeTestJSON-517472497 tempest-ImagesMetadataNegativeTestJSON-517472497-project] Returning 404 to user: Image not found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:42:29.389288 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e805a6e4-d00f-47fc-abd9-b0dbe0e0d5ca tempest-ImagesMetadataNegativeTestJSON-517472497 tempest-ImagesMetadataNegativeTestJSON-517472497-project] 10.222.0.20 "POST /compute/v2.1/images/47fbf631-3cd0-48a9-9181-61bd8c7e901e/metadata" status: 404 len: 62 microversion: 2.1 time: 0.050371 Oct 04 18:42:29.389288 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1723/3508] 10.222.0.20 () {60 vars in 1281 bytes} [Tue Oct 4 18:42:29 2022] POST /compute/v2.1/images/47fbf631-3cd0-48a9-9181-61bd8c7e901e/metadata => generated 62 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:42:29.577128 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-dd55c26b-d4ba-4e7a-990b-26d579465212 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:29.616418 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-dd55c26b-d4ba-4e7a-990b-26d579465212 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/cd97d817-422a-457d-b653-020350d75d6e" status: 200 len: 1521 microversion: 2.1 time: 0.538249 Oct 04 18:42:29.617818 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1786/3509] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:29 2022] GET /compute/v2.1/servers/cd97d817-422a-457d-b653-020350d75d6e => generated 1521 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:29.745340 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ea12764b-2679-41dd-b6b3-dcacbacf02c8 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:29.745950 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ea12764b-2679-41dd-b6b3-dcacbacf02c8 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: af3e9546-9a60-424a-8d98-234b08364d1d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:29.768547 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ea12764b-2679-41dd-b6b3-dcacbacf02c8 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:29.768547 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ea12764b-2679-41dd-b6b3-dcacbacf02c8 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:29.768547 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ea12764b-2679-41dd-b6b3-dcacbacf02c8 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:29.768547 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ea12764b-2679-41dd-b6b3-dcacbacf02c8 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:29.768547 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ea12764b-2679-41dd-b6b3-dcacbacf02c8 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:29.768547 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ea12764b-2679-41dd-b6b3-dcacbacf02c8 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:30.100019 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ceba3675-13ee-44e4-8d88-186a9e74e295 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:30.101014 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ceba3675-13ee-44e4-8d88-186a9e74e295 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] [instance: e245e3c8-b2eb-4f0f-8dec-c7bc290bd356] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:30.117327 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ceba3675-13ee-44e4-8d88-186a9e74e295 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:30.117895 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ceba3675-13ee-44e4-8d88-186a9e74e295 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:30.120479 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ceba3675-13ee-44e4-8d88-186a9e74e295 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:30.121727 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ceba3675-13ee-44e4-8d88-186a9e74e295 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:30.123300 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ceba3675-13ee-44e4-8d88-186a9e74e295 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:30.124537 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ceba3675-13ee-44e4-8d88-186a9e74e295 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:30.701937 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ea12764b-2679-41dd-b6b3-dcacbacf02c8 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:30.714114 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ea12764b-2679-41dd-b6b3-dcacbacf02c8 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/af3e9546-9a60-424a-8d98-234b08364d1d" status: 200 len: 1507 microversion: 2.1 time: 0.972689 Oct 04 18:42:30.715795 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1724/3510] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:29 2022] GET /compute/v2.1/servers/af3e9546-9a60-424a-8d98-234b08364d1d => generated 1507 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:30.732731 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c5d17688-d429-4a5a-ba82-52b8b3571f82 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:30.733935 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c5d17688-d429-4a5a-ba82-52b8b3571f82 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: cd97d817-422a-457d-b653-020350d75d6e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:30.742956 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c5d17688-d429-4a5a-ba82-52b8b3571f82 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:30.744017 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c5d17688-d429-4a5a-ba82-52b8b3571f82 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:30.744707 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c5d17688-d429-4a5a-ba82-52b8b3571f82 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:30.745658 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c5d17688-d429-4a5a-ba82-52b8b3571f82 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:30.747001 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c5d17688-d429-4a5a-ba82-52b8b3571f82 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:30.748351 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c5d17688-d429-4a5a-ba82-52b8b3571f82 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:30.802575 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ceba3675-13ee-44e4-8d88-186a9e74e295 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '777a7a51e45b498597f7a1202217575c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b43fba16115404aaa793fb907fd257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:30.810878 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ceba3675-13ee-44e4-8d88-186a9e74e295 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] 10.222.0.20 "GET /compute/v2.1/servers/e245e3c8-b2eb-4f0f-8dec-c7bc290bd356" status: 200 len: 1503 microversion: 2.1 time: 0.715261 Oct 04 18:42:30.816847 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1787/3511] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:30 2022] GET /compute/v2.1/servers/e245e3c8-b2eb-4f0f-8dec-c7bc290bd356 => generated 1503 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:42:30.845018 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e81e5e1a-dca4-465d-b0e8-98333cb29f15 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-621020011"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:30.846467 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e81e5e1a-dca4-465d-b0e8-98333cb29f15 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] [instance: e245e3c8-b2eb-4f0f-8dec-c7bc290bd356] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:30.854219 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e81e5e1a-dca4-465d-b0e8-98333cb29f15 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:30.855694 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e81e5e1a-dca4-465d-b0e8-98333cb29f15 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:30.856608 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e81e5e1a-dca4-465d-b0e8-98333cb29f15 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:30.857586 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e81e5e1a-dca4-465d-b0e8-98333cb29f15 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:30.858434 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e81e5e1a-dca4-465d-b0e8-98333cb29f15 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:30.859197 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e81e5e1a-dca4-465d-b0e8-98333cb29f15 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:31.176326 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c5d17688-d429-4a5a-ba82-52b8b3571f82 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:31.193457 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c5d17688-d429-4a5a-ba82-52b8b3571f82 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/cd97d817-422a-457d-b653-020350d75d6e" status: 200 len: 1521 microversion: 2.1 time: 0.473612 Oct 04 18:42:31.194097 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1725/3512] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:30 2022] GET /compute/v2.1/servers/cd97d817-422a-457d-b653-020350d75d6e => generated 1521 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:31.241587 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.network.security_group_api [None req-e81e5e1a-dca4-465d-b0e8-98333cb29f15 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Adding security group ae97ac67-b778-4af4-8d61-0e3c1acb10ce to port de5db3a4-1f99-4a92-a78e-f59449b5343b Oct 04 18:42:31.583111 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-c25e9d43-7852-44e2-967d-ddd45af4663c req-ac14ed45-2c93-4d9d-a2be-d4d632d38aac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af3e9546-9a60-424a-8d98-234b08364d1d", "name": "network-vif-deleted", "tag": "10a557bc-1e48-40fa-94eb-267f53693475"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:31.592683 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=24 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:42:31.619730 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-c25e9d43-7852-44e2-967d-ddd45af4663c req-ac14ed45-2c93-4d9d-a2be-d4d632d38aac service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:31.622897 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-c25e9d43-7852-44e2-967d-ddd45af4663c req-ac14ed45-2c93-4d9d-a2be-d4d632d38aac service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:31.628398 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-c25e9d43-7852-44e2-967d-ddd45af4663c req-ac14ed45-2c93-4d9d-a2be-d4d632d38aac service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:31.668457 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-c25e9d43-7852-44e2-967d-ddd45af4663c req-ac14ed45-2c93-4d9d-a2be-d4d632d38aac service nova] Creating event network-vif-deleted:10a557bc-1e48-40fa-94eb-267f53693475 for instance af3e9546-9a60-424a-8d98-234b08364d1d on n-h2-850501-14 Oct 04 18:42:31.688449 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-c25e9d43-7852-44e2-967d-ddd45af4663c req-ac14ed45-2c93-4d9d-a2be-d4d632d38aac service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106339 Oct 04 18:42:31.693348 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1726/3513] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:42:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:42:31.744446 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7c2217e8-f355-44a2-afeb-32a79e5935e5 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:31.750765 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7c2217e8-f355-44a2-afeb-32a79e5935e5 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: af3e9546-9a60-424a-8d98-234b08364d1d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:31.761287 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c2217e8-f355-44a2-afeb-32a79e5935e5 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:31.774798 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c2217e8-f355-44a2-afeb-32a79e5935e5 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:31.779433 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c2217e8-f355-44a2-afeb-32a79e5935e5 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:31.779433 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c2217e8-f355-44a2-afeb-32a79e5935e5 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:31.779433 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c2217e8-f355-44a2-afeb-32a79e5935e5 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:31.779433 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c2217e8-f355-44a2-afeb-32a79e5935e5 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:32.050558 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7c2217e8-f355-44a2-afeb-32a79e5935e5 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:32.079299 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7c2217e8-f355-44a2-afeb-32a79e5935e5 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/af3e9546-9a60-424a-8d98-234b08364d1d" status: 200 len: 1305 microversion: 2.1 time: 0.340406 Oct 04 18:42:32.098896 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1727/3514] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:31 2022] GET /compute/v2.1/servers/af3e9546-9a60-424a-8d98-234b08364d1d => generated 1305 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:32.185918 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=12 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:42:32.218214 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-93b56cbc-0d27-42b9-b749-fdeca21049de tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:32.219421 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-93b56cbc-0d27-42b9-b749-fdeca21049de tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: cd97d817-422a-457d-b653-020350d75d6e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:32.253363 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-93b56cbc-0d27-42b9-b749-fdeca21049de tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:32.256804 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-93b56cbc-0d27-42b9-b749-fdeca21049de tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:32.257628 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-93b56cbc-0d27-42b9-b749-fdeca21049de tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:32.263914 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-93b56cbc-0d27-42b9-b749-fdeca21049de tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:32.271519 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-93b56cbc-0d27-42b9-b749-fdeca21049de tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:32.271519 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-93b56cbc-0d27-42b9-b749-fdeca21049de tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:32.759912 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:42:32.929653 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-93b56cbc-0d27-42b9-b749-fdeca21049de tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:32.951033 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-93b56cbc-0d27-42b9-b749-fdeca21049de tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/cd97d817-422a-457d-b653-020350d75d6e" status: 200 len: 1521 microversion: 2.1 time: 0.736995 Oct 04 18:42:32.954623 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1728/3515] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:32 2022] GET /compute/v2.1/servers/cd97d817-422a-457d-b653-020350d75d6e => generated 1521 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:42:32.985875 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=4 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:42:33.106409 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2f28a9ab-aa70-47a1-8c07-29425bccd8bf tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:33.109527 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2f28a9ab-aa70-47a1-8c07-29425bccd8bf tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: af3e9546-9a60-424a-8d98-234b08364d1d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:33.115410 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2f28a9ab-aa70-47a1-8c07-29425bccd8bf tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:33.120330 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e81e5e1a-dca4-465d-b0e8-98333cb29f15 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] 10.222.0.20 "POST /compute/v2.1/servers/e245e3c8-b2eb-4f0f-8dec-c7bc290bd356/action" status: 202 len: 0 microversion: 2.1 time: 2.282446 Oct 04 18:42:33.121533 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1788/3516] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:42:30 2022] POST /compute/v2.1/servers/e245e3c8-b2eb-4f0f-8dec-c7bc290bd356/action => generated 0 bytes in 2284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:42:33.125399 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2f28a9ab-aa70-47a1-8c07-29425bccd8bf tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:33.126262 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2f28a9ab-aa70-47a1-8c07-29425bccd8bf tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:33.129046 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2f28a9ab-aa70-47a1-8c07-29425bccd8bf tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:33.129621 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2f28a9ab-aa70-47a1-8c07-29425bccd8bf tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:33.130118 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2f28a9ab-aa70-47a1-8c07-29425bccd8bf tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:33.133039 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b26eae62-2d1e-4ddb-894c-8b7851c08945 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Calling method '.version_select at 0x7fe25910c0d0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:33.195910 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2f28a9ab-aa70-47a1-8c07-29425bccd8bf tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:33.197099 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2f28a9ab-aa70-47a1-8c07-29425bccd8bf tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:33.201384 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2f28a9ab-aa70-47a1-8c07-29425bccd8bf tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:33.201384 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-2f28a9ab-aa70-47a1-8c07-29425bccd8bf tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lazy-loading 'fault' on Instance uuid af3e9546-9a60-424a-8d98-234b08364d1d {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:42:33.305831 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2f28a9ab-aa70-47a1-8c07-29425bccd8bf tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:33.318051 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2f28a9ab-aa70-47a1-8c07-29425bccd8bf tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/af3e9546-9a60-424a-8d98-234b08364d1d" status: 200 len: 1310 microversion: 2.1 time: 0.215823 Oct 04 18:42:33.320806 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1729/3517] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:33 2022] GET /compute/v2.1/servers/af3e9546-9a60-424a-8d98-234b08364d1d => generated 1310 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:33.327024 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-22b6e9d5-ed73-488b-ab41-49fdd61299ca req-c3829fc0-ba3c-4421-a60f-8afce8f04e00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e245e3c8-b2eb-4f0f-8dec-c7bc290bd356", "tag": "de5db3a4-1f99-4a92-a78e-f59449b5343b"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:33.361341 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-22b6e9d5-ed73-488b-ab41-49fdd61299ca req-c3829fc0-ba3c-4421-a60f-8afce8f04e00 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:33.363721 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-22b6e9d5-ed73-488b-ab41-49fdd61299ca req-c3829fc0-ba3c-4421-a60f-8afce8f04e00 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:33.364432 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-22b6e9d5-ed73-488b-ab41-49fdd61299ca req-c3829fc0-ba3c-4421-a60f-8afce8f04e00 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:33.399497 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-22b6e9d5-ed73-488b-ab41-49fdd61299ca req-c3829fc0-ba3c-4421-a60f-8afce8f04e00 service nova] Creating event network-changed:de5db3a4-1f99-4a92-a78e-f59449b5343b for instance e245e3c8-b2eb-4f0f-8dec-c7bc290bd356 on n-h2-850501-14 Oct 04 18:42:33.412560 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-22b6e9d5-ed73-488b-ab41-49fdd61299ca req-c3829fc0-ba3c-4421-a60f-8afce8f04e00 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087733 Oct 04 18:42:33.414290 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1730/3518] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:42:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:42:33.472114 n-d-850501-14 devstack@n-api.service[123001]: DEBUG neutronclient.v2_0.client [None req-b26eae62-2d1e-4ddb-894c-8b7851c08945 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group ae97ac67-b778-4af4-8d61-0e3c1acb10ce in use.", "detail": ""}} {{(pid=123001) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:42:33.473014 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-b26eae62-2d1e-4ddb-894c-8b7851c08945 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] HTTP exception thrown: Security Group ae97ac67-b778-4af4-8d61-0e3c1acb10ce in use. Oct 04 18:42:33.473014 n-d-850501-14 devstack@n-api.service[123001]: Neutron server returns request_ids: ['req-c71b70d3-94be-4150-a681-66142f5fa235'] Oct 04 18:42:33.476288 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b26eae62-2d1e-4ddb-894c-8b7851c08945 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Request method failure captured: Oct 04 18:42:33.476288 n-d-850501-14 devstack@n-api.service[123001]: request: DELETE /compute/v2.1/os-security-groups/ae97ac67-b778-4af4-8d61-0e3c1acb10ce HTTP/1.1 Oct 04 18:42:33.476288 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:42:33.476288 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:42:33.476288 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:42:33.476288 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:42:33.476288 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:42:33.476288 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:42:33.476288 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:42:33.476288 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:42:33.476288 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPH5IaH15tr5SVoVt4hozZEg3Js8ZWcVBx0oRn243qNZFUMSmPeMa3Gyq91gLee0lw2Klv1E5mNTaxmJJRYhRawPEzSfr-EeZwa66fdrMa4-gu9mqAey6rHA1ZnVCWU_BX1Hua5XpKyhleXrqcIVEtamRhatLhfvMeiTTjEHkZqIKSBQ Oct 04 18:42:33.476288 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:42:33.476288 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:42:33.476288 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:42:33.476288 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:42:33.476288 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:42:33.476288 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:42:33.476288 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 1b43fba16115404aaa793fb907fd257f Oct 04 18:42:33.476288 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-SecurityGroupsTestJSON-752173812 Oct 04 18:42:33.476288 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:42:33.476288 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:42:33.476288 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1b43fba16115404aaa793fb907fd257f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1b43fba16115404aaa793fb907fd257f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1b43fba16115404aaa793fb907fd257f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1b43fba16115404aaa793fb907fd257f"}]}] Oct 04 18:42:33.476288 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-SecurityGroupsTestJSON-752173812 Oct 04 18:42:33.476288 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 1b43fba16115404aaa793fb907fd257f Oct 04 18:42:33.476288 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-752173812 Oct 04 18:42:33.476288 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-SecurityGroupsTestJSON-752173812-project Oct 04 18:42:33.476288 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:42:33.476288 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:42:33.476288 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 777a7a51e45b498597f7a1202217575c Oct 04 18:42:33.476288 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-SecurityGroupsTestJSON-752173812-project Oct 04 18:42:33.476288 n-d-850501-14 devstack@n-api.service[123001]: method: Oct 04 18:42:33.476288 n-d-850501-14 devstack@n-api.service[123001]: exception: Security Group ae97ac67-b778-4af4-8d61-0e3c1acb10ce in use. Oct 04 18:42:33.476288 n-d-850501-14 devstack@n-api.service[123001]: Neutron server returns request_ids: ['req-c71b70d3-94be-4150-a681-66142f5fa235'] Oct 04 18:42:33.476288 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': 'ae97ac67-b778-4af4-8d61-0e3c1acb10ce'} Oct 04 18:42:33.476288 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:42:33.476288 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:33.476288 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 04 18:42:33.476288 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 04 18:42:33.476288 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:42:33.476288 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:42:33.476288 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 04 18:42:33.476288 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 04 18:42:33.476288 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:42:33.476288 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:42:33.476288 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 04 18:42:33.476288 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 04 18:42:33.476288 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:42:33.476288 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:42:33.476288 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:42:33.476288 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:42:33.476288 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:42:33.476288 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:42:33.476288 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:42:33.476288 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:42:33.476288 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:42:33.476288 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:42:33.476288 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:42:33.476288 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:42:33.476288 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:42:33.476288 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:42:33.476288 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group ae97ac67-b778-4af4-8d61-0e3c1acb10ce in use. Oct 04 18:42:33.489295 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c71b70d3-94be-4150-a681-66142f5fa235'] Oct 04 18:42:33.489295 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:42:33.489295 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:42:33.489295 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:42:33.489295 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:33.489295 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 04 18:42:33.489295 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 04 18:42:33.489295 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 04 18:42:33.489295 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 04 18:42:33.489295 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group ae97ac67-b778-4af4-8d61-0e3c1acb10ce in use. Oct 04 18:42:33.489295 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c71b70d3-94be-4150-a681-66142f5fa235'] Oct 04 18:42:33.489295 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:42:33.489295 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:42:33.489295 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:42:33.489295 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:33.489295 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:42:33.489295 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:42:33.489295 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:42:33.489295 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:42:33.489295 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:42:33.489295 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:42:33.489295 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:42:33.489295 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:42:33.489295 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 04 18:42:33.489295 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 18:42:33.489295 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group ae97ac67-b778-4af4-8d61-0e3c1acb10ce in use. Oct 04 18:42:33.489295 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c71b70d3-94be-4150-a681-66142f5fa235'] Oct 04 18:42:33.489295 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:42:33.489295 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:42:33.489295 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:42:33.489295 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:33.489295 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:42:33.489295 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:42:33.489295 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:42:33.489295 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:42:33.489295 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group ae97ac67-b778-4af4-8d61-0e3c1acb10ce in use. Oct 04 18:42:33.489295 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c71b70d3-94be-4150-a681-66142f5fa235'] Oct 04 18:42:33.489295 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:42:33.489295 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b26eae62-2d1e-4ddb-894c-8b7851c08945 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Returning 400 to user: Security Group ae97ac67-b778-4af4-8d61-0e3c1acb10ce in use. Oct 04 18:42:33.489295 n-d-850501-14 devstack@n-api.service[123001]: Neutron server returns request_ids: ['req-c71b70d3-94be-4150-a681-66142f5fa235'] {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:42:33.489295 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b26eae62-2d1e-4ddb-894c-8b7851c08945 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/ae97ac67-b778-4af4-8d61-0e3c1acb10ce" status: 400 len: 185 microversion: 2.1 time: 0.352381 Oct 04 18:42:33.489295 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1789/3519] 10.222.0.20 () {58 vars in 1272 bytes} [Tue Oct 4 18:42:33 2022] DELETE /compute/v2.1/os-security-groups/ae97ac67-b778-4af4-8d61-0e3c1acb10ce => generated 185 bytes in 354 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:42:33.494239 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2f4efd5e-3a81-4f02-a85d-b8c360fded1d tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:33.494239 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2f4efd5e-3a81-4f02-a85d-b8c360fded1d tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] [instance: e245e3c8-b2eb-4f0f-8dec-c7bc290bd356] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:33.521440 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2f4efd5e-3a81-4f02-a85d-b8c360fded1d tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:33.521950 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2f4efd5e-3a81-4f02-a85d-b8c360fded1d tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:33.523903 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2f4efd5e-3a81-4f02-a85d-b8c360fded1d tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:33.528119 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2f4efd5e-3a81-4f02-a85d-b8c360fded1d tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:33.528614 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2f4efd5e-3a81-4f02-a85d-b8c360fded1d tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:33.529187 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2f4efd5e-3a81-4f02-a85d-b8c360fded1d tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:33.883725 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2f4efd5e-3a81-4f02-a85d-b8c360fded1d tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] 10.222.0.20 "POST /compute/v2.1/servers/e245e3c8-b2eb-4f0f-8dec-c7bc290bd356/action" status: 202 len: 0 microversion: 2.1 time: 0.398970 Oct 04 18:42:33.885795 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1731/3520] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:42:33 2022] POST /compute/v2.1/servers/e245e3c8-b2eb-4f0f-8dec-c7bc290bd356/action => generated 0 bytes in 402 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:42:33.895265 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5e71042d-aedf-4bd2-aa4e-3afd1cac5cf5 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:33.895889 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5e71042d-aedf-4bd2-aa4e-3afd1cac5cf5 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] [instance: e245e3c8-b2eb-4f0f-8dec-c7bc290bd356] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:33.911993 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5e71042d-aedf-4bd2-aa4e-3afd1cac5cf5 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:33.912515 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5e71042d-aedf-4bd2-aa4e-3afd1cac5cf5 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:33.913148 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5e71042d-aedf-4bd2-aa4e-3afd1cac5cf5 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:33.917707 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5e71042d-aedf-4bd2-aa4e-3afd1cac5cf5 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:33.918365 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5e71042d-aedf-4bd2-aa4e-3afd1cac5cf5 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:33.918997 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5e71042d-aedf-4bd2-aa4e-3afd1cac5cf5 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:33.977320 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-cce21c30-9465-4f77-98d7-b9bac2aa78dd tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:33.978360 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-cce21c30-9465-4f77-98d7-b9bac2aa78dd tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: cd97d817-422a-457d-b653-020350d75d6e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:33.990977 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cce21c30-9465-4f77-98d7-b9bac2aa78dd tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:33.995886 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cce21c30-9465-4f77-98d7-b9bac2aa78dd tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:33.996690 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cce21c30-9465-4f77-98d7-b9bac2aa78dd tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:33.997746 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cce21c30-9465-4f77-98d7-b9bac2aa78dd tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:34.000134 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cce21c30-9465-4f77-98d7-b9bac2aa78dd tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:34.003096 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cce21c30-9465-4f77-98d7-b9bac2aa78dd tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:34.398929 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-cce21c30-9465-4f77-98d7-b9bac2aa78dd tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:34.414762 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-cce21c30-9465-4f77-98d7-b9bac2aa78dd tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/cd97d817-422a-457d-b653-020350d75d6e" status: 200 len: 1521 microversion: 2.1 time: 0.435100 Oct 04 18:42:34.430014 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1732/3521] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:33 2022] GET /compute/v2.1/servers/cd97d817-422a-457d-b653-020350d75d6e => generated 1521 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:34.449662 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ebf8f97d-688b-4851-98f6-8b808be24e31 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:34.449662 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ebf8f97d-688b-4851-98f6-8b808be24e31 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: af3e9546-9a60-424a-8d98-234b08364d1d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:34.458054 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ebf8f97d-688b-4851-98f6-8b808be24e31 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:34.458555 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ebf8f97d-688b-4851-98f6-8b808be24e31 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:34.458986 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ebf8f97d-688b-4851-98f6-8b808be24e31 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:34.470377 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ebf8f97d-688b-4851-98f6-8b808be24e31 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:34.470999 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ebf8f97d-688b-4851-98f6-8b808be24e31 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:34.471437 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ebf8f97d-688b-4851-98f6-8b808be24e31 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:34.502758 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-ebf8f97d-688b-4851-98f6-8b808be24e31 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] HTTP exception thrown: Instance af3e9546-9a60-424a-8d98-234b08364d1d could not be found. Oct 04 18:42:34.504709 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ebf8f97d-688b-4851-98f6-8b808be24e31 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Request method failure captured: Oct 04 18:42:34.504709 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/af3e9546-9a60-424a-8d98-234b08364d1d HTTP/1.1 Oct 04 18:42:34.504709 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:42:34.504709 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:42:34.504709 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:42:34.504709 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:42:34.504709 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:42:34.504709 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:42:34.504709 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:42:34.504709 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:42:34.504709 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH5kaFyiFSIO0ZP4CMGEO428dJiNuEG6R-LLS8mNsVetgcf6w0D7DIrYZ_G7YOzpJ5huW8oCnx3-jlxIKVdxxsS18taUnXx6Xt5KnL4IkhJLGYxbDrAUBLCXM7M3o65rqEELwzRRnK71NdjnupluHpvvCSPBSNhy32oTLBkDAxSrOgs Oct 04 18:42:34.504709 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:42:34.504709 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:42:34.504709 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:42:34.504709 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:42:34.504709 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:42:34.504709 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:42:34.504709 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: a9046b9540144eeba512d79438635ea8 Oct 04 18:42:34.504709 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServersTestJSON-380527700 Oct 04 18:42:34.504709 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:42:34.504709 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:42:34.504709 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a9046b9540144eeba512d79438635ea8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a9046b9540144eeba512d79438635ea8", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a9046b9540144eeba512d79438635ea8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a9046b9540144eeba512d79438635ea8"}]}] Oct 04 18:42:34.504709 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServersTestJSON-380527700 Oct 04 18:42:34.504709 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: a9046b9540144eeba512d79438635ea8 Oct 04 18:42:34.504709 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServersTestJSON-380527700 Oct 04 18:42:34.504709 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServersTestJSON-380527700-project Oct 04 18:42:34.504709 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:42:34.504709 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:42:34.504709 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 8a6c3725b31449d5bf1ff757ff66c8d7 Oct 04 18:42:34.504709 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServersTestJSON-380527700-project Oct 04 18:42:34.504709 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:42:34.504709 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance af3e9546-9a60-424a-8d98-234b08364d1d could not be found. Oct 04 18:42:34.504709 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'af3e9546-9a60-424a-8d98-234b08364d1d'} Oct 04 18:42:34.504709 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:42:34.504709 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:34.504709 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:42:34.504709 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:42:34.504709 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:42:34.504709 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:42:34.504709 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:42:34.504709 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:42:34.504709 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:42:34.504709 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:42:34.504709 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af3e9546-9a60-424a-8d98-234b08364d1d could not be found. Oct 04 18:42:34.504709 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:34.504709 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:42:34.504709 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:34.504709 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:34.504709 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:42:34.504709 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:42:34.504709 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:42:34.504709 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:42:34.504709 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:42:34.504709 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:42:34.504709 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:42:34.504709 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:42:34.504709 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:42:34.504709 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:42:34.504709 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:42:34.504709 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:42:34.504709 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af3e9546-9a60-424a-8d98-234b08364d1d could not be found. Oct 04 18:42:34.504709 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:34.504709 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:42:34.504709 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:34.504709 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:34.509610 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:42:34.509610 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:42:34.509610 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:42:34.509610 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:42:34.509610 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af3e9546-9a60-424a-8d98-234b08364d1d could not be found. Oct 04 18:42:34.509610 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:34.509610 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ebf8f97d-688b-4851-98f6-8b808be24e31 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Returning 404 to user: Instance af3e9546-9a60-424a-8d98-234b08364d1d could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:42:34.509610 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ebf8f97d-688b-4851-98f6-8b808be24e31 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/af3e9546-9a60-424a-8d98-234b08364d1d" status: 404 len: 111 microversion: 2.1 time: 0.074163 Oct 04 18:42:34.509610 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1733/3522] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:34 2022] GET /compute/v2.1/servers/af3e9546-9a60-424a-8d98-234b08364d1d => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:42:34.540787 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-acbeb258-fc88-4028-bf8e-b5a90897944d tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Action: 'create', calling method: .version_select at 0x7fe253e4daf0>, body: {"keypair": {"name": "tempest-key-1713997289", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEH9fTejdZRQY9dmdwF5AWVsVY6+Q3s8tpPI57nWLrCiG56qMmaL+3jfXIIVSfwcrh1H2sXxQ4pk5RmeIHI1L6gOhMyLK8DA9Ghb/ygYxoLjD1BhSQrIbdvOjYhuv33MvQ=="}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:34.559205 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-acbeb258-fc88-4028-bf8e-b5a90897944d tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Getting quotas for project a9046b9540144eeba512d79438635ea8. Resources: {'key_pairs'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:42:34.567982 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-acbeb258-fc88-4028-bf8e-b5a90897944d tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Getting quotas for user 8a6c3725b31449d5bf1ff757ff66c8d7 and project a9046b9540144eeba512d79438635ea8. Resources: {'key_pairs'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:42:34.713786 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-acbeb258-fc88-4028-bf8e-b5a90897944d tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.190093 Oct 04 18:42:34.715243 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1734/3523] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Oct 4 18:42:34 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:42:34.725439 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f5380583-dfdd-4ffa-ace8-6781570a7025 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '.version_select at 0x7fe253f1b670>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:34.735088 n-d-850501-14 devstack@n-api.service[123002]: WARNING oslo_db.sqlalchemy.utils [None req-f5380583-dfdd-4ffa-ace8-6781570a7025 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 04 18:42:34.753400 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f5380583-dfdd-4ffa-ace8-6781570a7025 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.031815 Oct 04 18:42:34.753976 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1735/3524] 10.222.0.20 () {58 vars in 1137 bytes} [Tue Oct 4 18:42:34 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:42:34.782232 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5e71042d-aedf-4bd2-aa4e-3afd1cac5cf5 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '777a7a51e45b498597f7a1202217575c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b43fba16115404aaa793fb907fd257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:34.805165 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5e71042d-aedf-4bd2-aa4e-3afd1cac5cf5 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] 10.222.0.20 "GET /compute/v2.1/servers/e245e3c8-b2eb-4f0f-8dec-c7bc290bd356" status: 200 len: 1573 microversion: 2.1 time: 0.912120 Oct 04 18:42:34.805745 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1790/3525] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:33 2022] GET /compute/v2.1/servers/e245e3c8-b2eb-4f0f-8dec-c7bc290bd356 => generated 1573 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:34.970973 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-49905549-6417-4ed2-8106-8a3d6718fd41 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1059750903", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "key_name": "tempest-key-1713997289", "networks": [{"uuid": "ea7ea2b5-3fb7-4eeb-8ba9-cbc81d7265bf"}]}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:35.098244 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.neutron [None req-49905549-6417-4ed2-8106-8a3d6718fd41 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] validate_networks() for [('ea7ea2b5-3fb7-4eeb-8ba9-cbc81d7265bf', None, None, None, None, None)] {{(pid=123001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:42:35.225716 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a5cce032-22ed-4bc8-9004-71a9ce03c56b tempest-KeyPairsV22TestJSON-616639178 tempest-KeyPairsV22TestJSON-616639178-project] Action: 'create', calling method: .version_select at 0x7fe258857310>, body: {"keypair": {"name": "tempest-keypair-1624786991", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCaftPBH9i8SKo0VK/VWbZ2QgM33c0SSVBlaFY0a92zYri4SbCRqpQ44zfHJ9W4oGrThfnR3XBpWF7bBstybxp+wBm7Uq2/Y8GVR0jbZ+Xu0B3WFSAdcruWisGTMyj0PWQ=="}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:35.251587 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-a5cce032-22ed-4bc8-9004-71a9ce03c56b tempest-KeyPairsV22TestJSON-616639178 tempest-KeyPairsV22TestJSON-616639178-project] Getting quotas for project b0714d53d5b0409295986aad5c53ad37. Resources: {'key_pairs'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:42:35.259491 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-a5cce032-22ed-4bc8-9004-71a9ce03c56b tempest-KeyPairsV22TestJSON-616639178 tempest-KeyPairsV22TestJSON-616639178-project] Getting quotas for user b1e3fec0499746abbc22043645deca9f and project b0714d53d5b0409295986aad5c53ad37. Resources: {'key_pairs'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:42:35.391957 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a5cce032-22ed-4bc8-9004-71a9ce03c56b tempest-KeyPairsV22TestJSON-616639178 tempest-KeyPairsV22TestJSON-616639178-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.479693 Oct 04 18:42:35.394955 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1736/3526] 10.222.0.20 () {62 vars in 1199 bytes} [Tue Oct 4 18:42:34 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 483 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 04 18:42:35.405332 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8083fec2-9d23-4314-a864-5f2e7220f379 tempest-KeyPairsV22TestJSON-616639178 tempest-KeyPairsV22TestJSON-616639178-project] Calling method '.version_select at 0x7fe253f99820>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:35.415888 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8083fec2-9d23-4314-a864-5f2e7220f379 tempest-KeyPairsV22TestJSON-616639178 tempest-KeyPairsV22TestJSON-616639178-project] 10.222.0.20 "GET /compute/v2.1/os-keypairs/tempest-keypair-1624786991" status: 200 len: 513 microversion: 2.2 time: 0.014420 Oct 04 18:42:35.425421 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1737/3527] 10.222.0.20 () {60 vars in 1258 bytes} [Tue Oct 4 18:42:35 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1624786991 => generated 513 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:42:35.438861 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-dbc0fe7e-6d58-4c91-973e-8979c85d5b54 tempest-KeyPairsV22TestJSON-616639178 tempest-KeyPairsV22TestJSON-616639178-project] Calling method '.version_select at 0x7fe253e82160>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:35.542181 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-dbc0fe7e-6d58-4c91-973e-8979c85d5b54 tempest-KeyPairsV22TestJSON-616639178 tempest-KeyPairsV22TestJSON-616639178-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1624786991" status: 204 len: 0 microversion: 2.2 time: 0.115557 Oct 04 18:42:35.543053 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1738/3528] 10.222.0.20 () {60 vars in 1261 bytes} [Tue Oct 4 18:42:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1624786991 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:42:35.552824 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f2b67460-bc5a-42c7-89ae-39030d4eeabe tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:35.555698 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f2b67460-bc5a-42c7-89ae-39030d4eeabe tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: cd97d817-422a-457d-b653-020350d75d6e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:35.569223 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f2b67460-bc5a-42c7-89ae-39030d4eeabe tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:35.569993 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f2b67460-bc5a-42c7-89ae-39030d4eeabe tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:35.570518 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f2b67460-bc5a-42c7-89ae-39030d4eeabe tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:35.571540 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f2b67460-bc5a-42c7-89ae-39030d4eeabe tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:35.572244 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f2b67460-bc5a-42c7-89ae-39030d4eeabe tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:35.572936 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f2b67460-bc5a-42c7-89ae-39030d4eeabe tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:36.160552 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f2b67460-bc5a-42c7-89ae-39030d4eeabe tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:36.169741 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f2b67460-bc5a-42c7-89ae-39030d4eeabe tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/cd97d817-422a-457d-b653-020350d75d6e" status: 200 len: 1501 microversion: 2.1 time: 0.621952 Oct 04 18:42:36.170316 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1739/3529] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:35 2022] GET /compute/v2.1/servers/cd97d817-422a-457d-b653-020350d75d6e => generated 1501 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:36.179140 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-baf893e7-737d-46ef-ba5d-e6df3ab3eb3c tempest-KeyPairsV22TestJSON-616639178 tempest-KeyPairsV22TestJSON-616639178-project] Action: 'create', calling method: .version_select at 0x7fe259467dc0>, body: {"keypair": {"name": "tempest-keypair-1258620846", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDRiy3gNVpihZVTIqONcFWptgFqhMAlRyNZkigyyLV6HNXgviAeIwNRNIztAHK3lWJGVFXtNuP8sOFmwQtY9cbEfPjWhsGTDmz3LO/YYdmghnpDAIzDPm6BQj60rPWKq0A=="}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:36.197774 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-baf893e7-737d-46ef-ba5d-e6df3ab3eb3c tempest-KeyPairsV22TestJSON-616639178 tempest-KeyPairsV22TestJSON-616639178-project] Getting quotas for project b0714d53d5b0409295986aad5c53ad37. Resources: {'key_pairs'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:42:36.203676 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-baf893e7-737d-46ef-ba5d-e6df3ab3eb3c tempest-KeyPairsV22TestJSON-616639178 tempest-KeyPairsV22TestJSON-616639178-project] Getting quotas for user b1e3fec0499746abbc22043645deca9f and project b0714d53d5b0409295986aad5c53ad37. Resources: {'key_pairs'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:42:36.308078 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-baf893e7-737d-46ef-ba5d-e6df3ab3eb3c tempest-KeyPairsV22TestJSON-616639178 tempest-KeyPairsV22TestJSON-616639178-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.136583 Oct 04 18:42:36.309094 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1740/3530] 10.222.0.20 () {62 vars in 1199 bytes} [Tue Oct 4 18:42:36 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 138 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 04 18:42:36.315953 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b93d79a1-fb6c-4b67-a2db-328f6f6c1ebc tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:36.318001 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b93d79a1-fb6c-4b67-a2db-328f6f6c1ebc tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] [instance: e245e3c8-b2eb-4f0f-8dec-c7bc290bd356] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:36.323950 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b93d79a1-fb6c-4b67-a2db-328f6f6c1ebc tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:36.324474 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b93d79a1-fb6c-4b67-a2db-328f6f6c1ebc tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:36.329838 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b93d79a1-fb6c-4b67-a2db-328f6f6c1ebc tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:36.339464 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b93d79a1-fb6c-4b67-a2db-328f6f6c1ebc tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:36.340743 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b93d79a1-fb6c-4b67-a2db-328f6f6c1ebc tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:36.341372 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b93d79a1-fb6c-4b67-a2db-328f6f6c1ebc tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:36.487856 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-49905549-6417-4ed2-8106-8a3d6718fd41 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:42:36.489088 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-49905549-6417-4ed2-8106-8a3d6718fd41 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:42:36.490082 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-49905549-6417-4ed2-8106-8a3d6718fd41 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:42:36.496121 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-49905549-6417-4ed2-8106-8a3d6718fd41 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:42:36.496121 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-49905549-6417-4ed2-8106-8a3d6718fd41 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:42:36.501254 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-49905549-6417-4ed2-8106-8a3d6718fd41 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:36.502001 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-49905549-6417-4ed2-8106-8a3d6718fd41 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:36.502524 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-49905549-6417-4ed2-8106-8a3d6718fd41 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:36.503425 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-49905549-6417-4ed2-8106-8a3d6718fd41 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:36.503879 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-49905549-6417-4ed2-8106-8a3d6718fd41 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:36.504467 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-49905549-6417-4ed2-8106-8a3d6718fd41 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:36.527665 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-49905549-6417-4ed2-8106-8a3d6718fd41 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Getting quotas for project a9046b9540144eeba512d79438635ea8. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:42:36.536309 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-49905549-6417-4ed2-8106-8a3d6718fd41 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Getting quotas for user 8a6c3725b31449d5bf1ff757ff66c8d7 and project a9046b9540144eeba512d79438635ea8. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:42:36.557296 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-49905549-6417-4ed2-8106-8a3d6718fd41 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Going to run 1 instances... {{(pid=123001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:42:36.559798 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-49905549-6417-4ed2-8106-8a3d6718fd41 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 6dc7155a-e90b-4ca9-8778-02bf31eff4bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:42:36.608771 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b93d79a1-fb6c-4b67-a2db-328f6f6c1ebc tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '777a7a51e45b498597f7a1202217575c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b43fba16115404aaa793fb907fd257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:36.618066 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b93d79a1-fb6c-4b67-a2db-328f6f6c1ebc tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] 10.222.0.20 "GET /compute/v2.1/servers/e245e3c8-b2eb-4f0f-8dec-c7bc290bd356" status: 200 len: 1578 microversion: 2.1 time: 0.307604 Oct 04 18:42:36.618988 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1741/3531] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:36 2022] GET /compute/v2.1/servers/e245e3c8-b2eb-4f0f-8dec-c7bc290bd356 => generated 1578 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:36.633392 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-df2d2ff8-1981-42c2-bbc4-3e2908c9fab8 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:36.634564 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-df2d2ff8-1981-42c2-bbc4-3e2908c9fab8 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: af46589b-8af1-4394-86e3-631c7d483a12] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:36.641728 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-df2d2ff8-1981-42c2-bbc4-3e2908c9fab8 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:36.642503 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-df2d2ff8-1981-42c2-bbc4-3e2908c9fab8 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:36.642951 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-df2d2ff8-1981-42c2-bbc4-3e2908c9fab8 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:36.643794 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-df2d2ff8-1981-42c2-bbc4-3e2908c9fab8 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:36.644364 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-df2d2ff8-1981-42c2-bbc4-3e2908c9fab8 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:36.644804 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-df2d2ff8-1981-42c2-bbc4-3e2908c9fab8 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:36.743212 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-49905549-6417-4ed2-8106-8a3d6718fd41 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.776939 Oct 04 18:42:36.744604 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1791/3532] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:42:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1779 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:42:36.749769 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-923571a9-cac7-4b2e-bf6b-45121fac3670 tempest-KeyPairsV22TestJSON-616639178 tempest-KeyPairsV22TestJSON-616639178-project] Calling method '.version_select at 0x7fe2581eaca0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:36.755501 n-d-850501-14 devstack@n-api.service[123001]: ERROR oslo.messaging._drivers.impl_rabbit [None req-923571a9-cac7-4b2e-bf6b-45121fac3670 tempest-KeyPairsV22TestJSON-616639178 tempest-KeyPairsV22TestJSON-616639178-project] [6c8ce3ae-b440-4b28-996b-33b11441f461] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 18:42:37.155105 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-df2d2ff8-1981-42c2-bbc4-3e2908c9fab8 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:37.166088 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-df2d2ff8-1981-42c2-bbc4-3e2908c9fab8 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/af46589b-8af1-4394-86e3-631c7d483a12" status: 200 len: 1514 microversion: 2.1 time: 0.545689 Oct 04 18:42:37.167157 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1742/3533] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:36 2022] GET /compute/v2.1/servers/af46589b-8af1-4394-86e3-631c7d483a12 => generated 1514 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:37.173715 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-47e5b247-354a-4301-aa68-059e5274b8e6 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:37.174848 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-47e5b247-354a-4301-aa68-059e5274b8e6 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 6dc7155a-e90b-4ca9-8778-02bf31eff4bd] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:37.306316 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-47e5b247-354a-4301-aa68-059e5274b8e6 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:37.313285 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-47e5b247-354a-4301-aa68-059e5274b8e6 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/6dc7155a-e90b-4ca9-8778-02bf31eff4bd" status: 200 len: 1229 microversion: 2.1 time: 0.144940 Oct 04 18:42:37.314830 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1743/3534] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:37 2022] GET /compute/v2.1/servers/6dc7155a-e90b-4ca9-8778-02bf31eff4bd => generated 1229 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:37.333151 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2109dade-a21a-42ee-b6ab-e193335bfbb5 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:37.335845 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2109dade-a21a-42ee-b6ab-e193335bfbb5 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: b129ccc9-d87d-4233-885b-2497aece73fd] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:37.343227 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-2109dade-a21a-42ee-b6ab-e193335bfbb5 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] HTTP exception thrown: Instance b129ccc9-d87d-4233-885b-2497aece73fd could not be found. Oct 04 18:42:37.348981 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2109dade-a21a-42ee-b6ab-e193335bfbb5 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Request method failure captured: Oct 04 18:42:37.348981 n-d-850501-14 devstack@n-api.service[123002]: request: POST /compute/v2.1/servers/b129ccc9-d87d-4233-885b-2497aece73fd/action HTTP/1.1 Oct 04 18:42:37.348981 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:42:37.348981 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:42:37.348981 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:42:37.348981 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 14 Oct 04 18:42:37.348981 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:42:37.348981 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:42:37.348981 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:42:37.348981 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:42:37.348981 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH5VeoXXX4R-gl3WW_fAsW_7hDIEWiZR35lPoIuJDBMUw75w4Z-93EJDy38x5YiA26dGCEdjKEzqMCUM4kpma5PpB_mUiDb0rAatpoM-ionDMXIgsOp1o3NTgluOHECynM7nFlIuW8aS-v8Gnb5xnrVGhYXFRV6ahForfC1sBHmJ1HA Oct 04 18:42:37.348981 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:42:37.348981 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:42:37.348981 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:42:37.348981 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:42:37.348981 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:42:37.348981 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:42:37.348981 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 9eb391aef10e4684ada5f811ae818f97 Oct 04 18:42:37.348981 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-124944821 Oct 04 18:42:37.348981 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:42:37.348981 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:42:37.348981 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9eb391aef10e4684ada5f811ae818f97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9eb391aef10e4684ada5f811ae818f97", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9eb391aef10e4684ada5f811ae818f97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9eb391aef10e4684ada5f811ae818f97"}]}] Oct 04 18:42:37.348981 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServerRescueNegativeTestJSON-124944821 Oct 04 18:42:37.348981 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 9eb391aef10e4684ada5f811ae818f97 Oct 04 18:42:37.348981 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-124944821 Oct 04 18:42:37.348981 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServerRescueNegativeTestJSON-124944821-project Oct 04 18:42:37.348981 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:42:37.348981 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:42:37.348981 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: c4243e3907374e5e9947c17e6288f0e7 Oct 04 18:42:37.348981 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServerRescueNegativeTestJSON-124944821-project Oct 04 18:42:37.348981 n-d-850501-14 devstack@n-api.service[123002]: Oct 04 18:42:37.348981 n-d-850501-14 devstack@n-api.service[123002]: {"rescue": {}} Oct 04 18:42:37.348981 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:42:37.348981 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance b129ccc9-d87d-4233-885b-2497aece73fd could not be found. Oct 04 18:42:37.348981 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'b129ccc9-d87d-4233-885b-2497aece73fd', 'body': {'rescue': {}}} Oct 04 18:42:37.348981 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:42:37.348981 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:37.348981 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:42:37.348981 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:42:37.348981 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:42:37.348981 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:42:37.348981 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:42:37.348981 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:42:37.348981 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b129ccc9-d87d-4233-885b-2497aece73fd could not be found. Oct 04 18:42:37.348981 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:37.348981 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:42:37.348981 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:37.348981 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:37.348981 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:42:37.348981 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:42:37.348981 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:42:37.348981 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:42:37.348981 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:42:37.348981 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:42:37.348981 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:42:37.348981 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:42:37.348981 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Oct 04 18:42:37.348981 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 04 18:42:37.348981 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:42:37.348981 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:42:37.348981 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b129ccc9-d87d-4233-885b-2497aece73fd could not be found. Oct 04 18:42:37.348981 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:37.348981 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:42:37.348981 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:37.348981 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:37.359479 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:42:37.359479 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:42:37.359479 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:42:37.359479 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:42:37.359479 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b129ccc9-d87d-4233-885b-2497aece73fd could not be found. Oct 04 18:42:37.359479 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:37.359479 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2109dade-a21a-42ee-b6ab-e193335bfbb5 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Returning 404 to user: Instance b129ccc9-d87d-4233-885b-2497aece73fd could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:42:37.359479 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2109dade-a21a-42ee-b6ab-e193335bfbb5 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "POST /compute/v2.1/servers/b129ccc9-d87d-4233-885b-2497aece73fd/action" status: 404 len: 111 microversion: 2.1 time: 0.034186 Oct 04 18:42:37.359479 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1744/3535] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:42:37 2022] POST /compute/v2.1/servers/b129ccc9-d87d-4233-885b-2497aece73fd/action => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:42:37.359479 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6155ac7e-a4eb-4248-a149-d8139091a17f tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe259444dc0>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:37.403448 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6155ac7e-a4eb-4248-a149-d8139091a17f tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/images/d2f208e9-736a-414a-b95a-a8af52e6828b" status: 200 len: 662 microversion: 2.1 time: 0.051150 Oct 04 18:42:37.403962 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1745/3536] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:42:37 2022] GET /compute/v2.1/images/d2f208e9-736a-414a-b95a-a8af52e6828b => generated 662 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:42:37.409452 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e80eee5e-d261-442b-ab8a-2ababe0454b6 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:37.410906 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e80eee5e-d261-442b-ab8a-2ababe0454b6 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: af46589b-8af1-4394-86e3-631c7d483a12] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:37.419026 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e80eee5e-d261-442b-ab8a-2ababe0454b6 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:37.419522 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e80eee5e-d261-442b-ab8a-2ababe0454b6 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:37.419968 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e80eee5e-d261-442b-ab8a-2ababe0454b6 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:37.420923 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e80eee5e-d261-442b-ab8a-2ababe0454b6 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:37.421777 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e80eee5e-d261-442b-ab8a-2ababe0454b6 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:37.422654 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e80eee5e-d261-442b-ab8a-2ababe0454b6 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:37.698359 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e80eee5e-d261-442b-ab8a-2ababe0454b6 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "POST /compute/v2.1/servers/af46589b-8af1-4394-86e3-631c7d483a12/action" status: 202 len: 0 microversion: 2.1 time: 0.292980 Oct 04 18:42:37.699900 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1746/3537] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:42:37 2022] POST /compute/v2.1/servers/af46589b-8af1-4394-86e3-631c7d483a12/action => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:42:37.719310 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7ff1f1d0-ada2-4397-a7d8-290743ecb993 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe253e82e50>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:37.769339 n-d-850501-14 devstack@n-api.service[123001]: INFO oslo.messaging._drivers.impl_rabbit [None req-923571a9-cac7-4b2e-bf6b-45121fac3670 tempest-KeyPairsV22TestJSON-616639178 tempest-KeyPairsV22TestJSON-616639178-project] [6c8ce3ae-b440-4b28-996b-33b11441f461] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 58428. Oct 04 18:42:37.802589 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7ff1f1d0-ada2-4397-a7d8-290743ecb993 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/images/d2f208e9-736a-414a-b95a-a8af52e6828b" status: 200 len: 662 microversion: 2.1 time: 0.101242 Oct 04 18:42:37.808198 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1747/3538] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:42:37 2022] GET /compute/v2.1/images/d2f208e9-736a-414a-b95a-a8af52e6828b => generated 662 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:42:37.813141 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e3546e6b-06ce-4bf6-91f7-1a46ac86bdec tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:37.815113 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e3546e6b-06ce-4bf6-91f7-1a46ac86bdec tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] [instance: e245e3c8-b2eb-4f0f-8dec-c7bc290bd356] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:37.823346 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e3546e6b-06ce-4bf6-91f7-1a46ac86bdec tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:37.824085 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e3546e6b-06ce-4bf6-91f7-1a46ac86bdec tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:37.824681 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e3546e6b-06ce-4bf6-91f7-1a46ac86bdec tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:37.825551 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e3546e6b-06ce-4bf6-91f7-1a46ac86bdec tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:37.826100 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e3546e6b-06ce-4bf6-91f7-1a46ac86bdec tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:37.826762 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e3546e6b-06ce-4bf6-91f7-1a46ac86bdec tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:37.832211 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:42:37.909923 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-923571a9-cac7-4b2e-bf6b-45121fac3670 tempest-KeyPairsV22TestJSON-616639178 tempest-KeyPairsV22TestJSON-616639178-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1258620846" status: 204 len: 0 microversion: 2.2 time: 1.162937 Oct 04 18:42:37.911856 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1792/3539] 10.222.0.20 () {60 vars in 1261 bytes} [Tue Oct 4 18:42:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1258620846 => generated 0 bytes in 1167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:42:37.926341 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f2dc9822-4bb5-46f7-8ffa-dbf6e8b4c1ef tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:37.927009 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f2dc9822-4bb5-46f7-8ffa-dbf6e8b4c1ef tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: af46589b-8af1-4394-86e3-631c7d483a12] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:37.934847 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f2dc9822-4bb5-46f7-8ffa-dbf6e8b4c1ef tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:37.935488 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f2dc9822-4bb5-46f7-8ffa-dbf6e8b4c1ef tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:37.936115 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f2dc9822-4bb5-46f7-8ffa-dbf6e8b4c1ef tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:37.937005 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f2dc9822-4bb5-46f7-8ffa-dbf6e8b4c1ef tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:37.937626 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f2dc9822-4bb5-46f7-8ffa-dbf6e8b4c1ef tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:37.938573 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f2dc9822-4bb5-46f7-8ffa-dbf6e8b4c1ef tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:38.301377 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e3546e6b-06ce-4bf6-91f7-1a46ac86bdec tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '777a7a51e45b498597f7a1202217575c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b43fba16115404aaa793fb907fd257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:38.309819 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e3546e6b-06ce-4bf6-91f7-1a46ac86bdec tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] 10.222.0.20 "GET /compute/v2.1/servers/e245e3c8-b2eb-4f0f-8dec-c7bc290bd356" status: 200 len: 1571 microversion: 2.1 time: 0.500478 Oct 04 18:42:38.310500 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1748/3540] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:37 2022] GET /compute/v2.1/servers/e245e3c8-b2eb-4f0f-8dec-c7bc290bd356 => generated 1571 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:38.313926 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f2dc9822-4bb5-46f7-8ffa-dbf6e8b4c1ef tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:38.327145 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f2dc9822-4bb5-46f7-8ffa-dbf6e8b4c1ef tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/af46589b-8af1-4394-86e3-631c7d483a12" status: 200 len: 1519 microversion: 2.1 time: 0.413551 Oct 04 18:42:38.328672 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1793/3541] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:37 2022] GET /compute/v2.1/servers/af46589b-8af1-4394-86e3-631c7d483a12 => generated 1519 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:38.330386 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e3266cfb-235f-4888-b2aa-f1b1f5eb2ef7 tempest-KeyPairsV22TestJSON-616639178 tempest-KeyPairsV22TestJSON-616639178-project] Action: 'create', calling method: .version_select at 0x7fe2594670d0>, body: {"keypair": {"name": "tempest-keypair-193303905", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:38.343924 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-aaf17275-7cd5-4ad9-9c3a-94b1ea90b2b4 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2067297716"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:38.344773 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-aaf17275-7cd5-4ad9-9c3a-94b1ea90b2b4 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] [instance: e245e3c8-b2eb-4f0f-8dec-c7bc290bd356] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:38.363346 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aaf17275-7cd5-4ad9-9c3a-94b1ea90b2b4 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:38.363848 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aaf17275-7cd5-4ad9-9c3a-94b1ea90b2b4 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:38.364325 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aaf17275-7cd5-4ad9-9c3a-94b1ea90b2b4 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:38.365041 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aaf17275-7cd5-4ad9-9c3a-94b1ea90b2b4 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:38.365530 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aaf17275-7cd5-4ad9-9c3a-94b1ea90b2b4 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:38.367961 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aaf17275-7cd5-4ad9-9c3a-94b1ea90b2b4 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:38.373323 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-e3266cfb-235f-4888-b2aa-f1b1f5eb2ef7 tempest-KeyPairsV22TestJSON-616639178 tempest-KeyPairsV22TestJSON-616639178-project] Getting quotas for project b0714d53d5b0409295986aad5c53ad37. Resources: {'key_pairs'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:42:38.397180 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-e3266cfb-235f-4888-b2aa-f1b1f5eb2ef7 tempest-KeyPairsV22TestJSON-616639178 tempest-KeyPairsV22TestJSON-616639178-project] Getting quotas for user b1e3fec0499746abbc22043645deca9f and project b0714d53d5b0409295986aad5c53ad37. Resources: {'key_pairs'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:42:38.611740 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e3266cfb-235f-4888-b2aa-f1b1f5eb2ef7 tempest-KeyPairsV22TestJSON-616639178 tempest-KeyPairsV22TestJSON-616639178-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 588 microversion: 2.2 time: 0.288932 Oct 04 18:42:38.611740 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1749/3542] 10.222.0.20 () {62 vars in 1199 bytes} [Tue Oct 4 18:42:38 2022] POST /compute/v2.1/os-keypairs => generated 588 bytes in 291 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 04 18:42:38.619939 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e0ffe40c-7733-4bce-97d4-71bdf2561927 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:38.620817 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e0ffe40c-7733-4bce-97d4-71bdf2561927 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 6dc7155a-e90b-4ca9-8778-02bf31eff4bd] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:38.630507 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e0ffe40c-7733-4bce-97d4-71bdf2561927 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:38.631344 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e0ffe40c-7733-4bce-97d4-71bdf2561927 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:38.634829 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e0ffe40c-7733-4bce-97d4-71bdf2561927 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:38.634829 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e0ffe40c-7733-4bce-97d4-71bdf2561927 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:38.635231 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e0ffe40c-7733-4bce-97d4-71bdf2561927 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:38.635871 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e0ffe40c-7733-4bce-97d4-71bdf2561927 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:38.645081 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.network.security_group_api [None req-aaf17275-7cd5-4ad9-9c3a-94b1ea90b2b4 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Adding security group e844db73-1f78-41b1-bfff-a04e58f82fc1 to port de5db3a4-1f99-4a92-a78e-f59449b5343b Oct 04 18:42:38.787586 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e0ffe40c-7733-4bce-97d4-71bdf2561927 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:38.798377 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e0ffe40c-7733-4bce-97d4-71bdf2561927 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/6dc7155a-e90b-4ca9-8778-02bf31eff4bd" status: 200 len: 1281 microversion: 2.1 time: 0.188270 Oct 04 18:42:38.799793 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1750/3543] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:38 2022] GET /compute/v2.1/servers/6dc7155a-e90b-4ca9-8778-02bf31eff4bd => generated 1281 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:38.824006 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f1ce6df3-7e4b-4223-9f9d-acce3888e43a tempest-KeyPairsV22TestJSON-616639178 tempest-KeyPairsV22TestJSON-616639178-project] Calling method '.version_select at 0x7fe253e4d9d0>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:38.837945 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:42:38.944524 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f1ce6df3-7e4b-4223-9f9d-acce3888e43a tempest-KeyPairsV22TestJSON-616639178 tempest-KeyPairsV22TestJSON-616639178-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-193303905" status: 204 len: 0 microversion: 2.2 time: 0.125031 Oct 04 18:42:38.945461 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1751/3544] 10.222.0.20 () {60 vars in 1258 bytes} [Tue Oct 4 18:42:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-193303905 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:42:38.959366 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ca833a9a-7a53-443c-80c9-7b5dedf6aebb tempest-KeyPairsV22TestJSON-616639178 tempest-KeyPairsV22TestJSON-616639178-project] Action: 'create', calling method: .version_select at 0x7fe2592d71f0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-770270925", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEyE6iuM/5o96ZdoYzVqm5PWJSlsIY81WikBXMSX2iSCGXZbEp5Hr3sbSnk39lalFBAtU4d3g1HtM4I3ZJZrFPJeQsXYKn+fWPmRihiff89FjM7Ch+4Zs8Aqwcshd9BmDA=="}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:38.998156 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-ca833a9a-7a53-443c-80c9-7b5dedf6aebb tempest-KeyPairsV22TestJSON-616639178 tempest-KeyPairsV22TestJSON-616639178-project] Getting quotas for project b0714d53d5b0409295986aad5c53ad37. Resources: {'key_pairs'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:42:39.013369 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-ca833a9a-7a53-443c-80c9-7b5dedf6aebb tempest-KeyPairsV22TestJSON-616639178 tempest-KeyPairsV22TestJSON-616639178-project] Getting quotas for user b1e3fec0499746abbc22043645deca9f and project b0714d53d5b0409295986aad5c53ad37. Resources: {'key_pairs'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:42:39.155331 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ca833a9a-7a53-443c-80c9-7b5dedf6aebb tempest-KeyPairsV22TestJSON-616639178 tempest-KeyPairsV22TestJSON-616639178-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.201218 Oct 04 18:42:39.168100 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1752/3545] 10.222.0.20 () {62 vars in 1199 bytes} [Tue Oct 4 18:42:38 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 214 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 04 18:42:39.363527 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-aaf17275-7cd5-4ad9-9c3a-94b1ea90b2b4 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] 10.222.0.20 "POST /compute/v2.1/servers/e245e3c8-b2eb-4f0f-8dec-c7bc290bd356/action" status: 202 len: 0 microversion: 2.1 time: 1.030837 Oct 04 18:42:39.364326 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1794/3546] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:42:38 2022] POST /compute/v2.1/servers/e245e3c8-b2eb-4f0f-8dec-c7bc290bd356/action => generated 0 bytes in 1032 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:42:39.369657 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-205fd5f9-24c4-41b9-a3f1-3207d3c12e77 tempest-KeyPairsV22TestJSON-616639178 tempest-KeyPairsV22TestJSON-616639178-project] Action: 'create', calling method: .version_select at 0x7fe258e20c10>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-958668294", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvdcvKtOT8K/QmcOh37QXhtcLH9EAZjU9scenDB/7mXVCK+kJUQRsaOI6xbGe4kDz30yYM1P65jKzFhM114MDyRY6VaRHFsjJR4f3flmk07F9nxzC/2RPQxnwujxvG6Gw=="}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:39.383276 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d021ccc4-6111-46ce-bd7f-cbf540dfade7 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Action: 'create', calling method: .version_select at 0x7fe253fc9550>, body: {"keypair": {"name": "tempest-keypair-48070174", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBX57D3cJAfjTj7isdip+X8SoYbZr+xqVmqANb18/yU6BDapv+po2fq9wgl4HqYln74N8UKAQF8pZZ53MQhWAzVSeBlQZD4iMs5UGP9yHfc+w0ZnK7ZHpaVwyoLBG2LEQQ=="}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:39.389311 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-205fd5f9-24c4-41b9-a3f1-3207d3c12e77 tempest-KeyPairsV22TestJSON-616639178 tempest-KeyPairsV22TestJSON-616639178-project] Getting quotas for project b0714d53d5b0409295986aad5c53ad37. Resources: {'key_pairs'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:42:39.396969 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-205fd5f9-24c4-41b9-a3f1-3207d3c12e77 tempest-KeyPairsV22TestJSON-616639178 tempest-KeyPairsV22TestJSON-616639178-project] Getting quotas for user b1e3fec0499746abbc22043645deca9f and project b0714d53d5b0409295986aad5c53ad37. Resources: {'key_pairs'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:42:39.403966 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-d021ccc4-6111-46ce-bd7f-cbf540dfade7 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Getting quotas for project 7c0b095138354810949093e7ea03b8bf. Resources: {'key_pairs'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:42:39.415352 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:42:39.417060 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-d021ccc4-6111-46ce-bd7f-cbf540dfade7 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Getting quotas for user 0a02cd1108b947b186202f6d15e6cf0e and project 7c0b095138354810949093e7ea03b8bf. Resources: {'key_pairs'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:42:39.514204 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-205fd5f9-24c4-41b9-a3f1-3207d3c12e77 tempest-KeyPairsV22TestJSON-616639178 tempest-KeyPairsV22TestJSON-616639178-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.148443 Oct 04 18:42:39.515795 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1795/3547] 10.222.0.20 () {62 vars in 1199 bytes} [Tue Oct 4 18:42:39 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 151 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 04 18:42:39.521721 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-852b8af4-7fb7-466a-a0a8-691847b49aee tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:39.522542 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-852b8af4-7fb7-466a-a0a8-691847b49aee tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: af46589b-8af1-4394-86e3-631c7d483a12] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:39.530437 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-852b8af4-7fb7-466a-a0a8-691847b49aee tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:39.530938 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-852b8af4-7fb7-466a-a0a8-691847b49aee tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:39.531381 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-852b8af4-7fb7-466a-a0a8-691847b49aee tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:39.532227 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-852b8af4-7fb7-466a-a0a8-691847b49aee tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:39.532635 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-852b8af4-7fb7-466a-a0a8-691847b49aee tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:39.534206 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-852b8af4-7fb7-466a-a0a8-691847b49aee tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:39.582966 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d021ccc4-6111-46ce-bd7f-cbf540dfade7 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.408063 Oct 04 18:42:39.582966 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1753/3548] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Oct 4 18:42:39 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:42:39.594423 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a0656a81-4c4b-49a5-ad26-b8f04a90bd54 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Calling method '.version_select at 0x7fe253f1b040>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:39.809634 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-852b8af4-7fb7-466a-a0a8-691847b49aee tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:39.832428 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-852b8af4-7fb7-466a-a0a8-691847b49aee tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/af46589b-8af1-4394-86e3-631c7d483a12" status: 200 len: 1499 microversion: 2.1 time: 0.315178 Oct 04 18:42:39.840682 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1796/3549] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:39 2022] GET /compute/v2.1/servers/af46589b-8af1-4394-86e3-631c7d483a12 => generated 1499 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:39.863612 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-38dfe817-fae6-47e0-8e8c-8ab34d67e681 req-757944d6-a7dd-4922-ad8e-69b17e2f0330 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e245e3c8-b2eb-4f0f-8dec-c7bc290bd356", "tag": "de5db3a4-1f99-4a92-a78e-f59449b5343b"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:39.895044 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-38dfe817-fae6-47e0-8e8c-8ab34d67e681 req-757944d6-a7dd-4922-ad8e-69b17e2f0330 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:39.895874 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-38dfe817-fae6-47e0-8e8c-8ab34d67e681 req-757944d6-a7dd-4922-ad8e-69b17e2f0330 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:39.897149 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-38dfe817-fae6-47e0-8e8c-8ab34d67e681 req-757944d6-a7dd-4922-ad8e-69b17e2f0330 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:39.911553 n-d-850501-14 devstack@n-api.service[123002]: DEBUG neutronclient.v2_0.client [None req-a0656a81-4c4b-49a5-ad26-b8f04a90bd54 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group e844db73-1f78-41b1-bfff-a04e58f82fc1 in use.", "detail": ""}} {{(pid=123002) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:42:39.912567 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-a0656a81-4c4b-49a5-ad26-b8f04a90bd54 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] HTTP exception thrown: Security Group e844db73-1f78-41b1-bfff-a04e58f82fc1 in use. Oct 04 18:42:39.912567 n-d-850501-14 devstack@n-api.service[123002]: Neutron server returns request_ids: ['req-984948fc-15c4-46cf-8b2c-eff8d712b790'] Oct 04 18:42:39.915293 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a0656a81-4c4b-49a5-ad26-b8f04a90bd54 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Request method failure captured: Oct 04 18:42:39.915293 n-d-850501-14 devstack@n-api.service[123002]: request: DELETE /compute/v2.1/os-security-groups/e844db73-1f78-41b1-bfff-a04e58f82fc1 HTTP/1.1 Oct 04 18:42:39.915293 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:42:39.915293 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:42:39.915293 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:42:39.915293 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:42:39.915293 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:42:39.915293 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:42:39.915293 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:42:39.915293 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:42:39.915293 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH5IaH15tr5SVoVt4hozZEg3Js8ZWcVBx0oRn243qNZFUMSmPeMa3Gyq91gLee0lw2Klv1E5mNTaxmJJRYhRawPEzSfr-EeZwa66fdrMa4-gu9mqAey6rHA1ZnVCWU_BX1Hua5XpKyhleXrqcIVEtamRhatLhfvMeiTTjEHkZqIKSBQ Oct 04 18:42:39.915293 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:42:39.915293 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:42:39.915293 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:42:39.915293 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:42:39.915293 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:42:39.915293 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:42:39.915293 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 1b43fba16115404aaa793fb907fd257f Oct 04 18:42:39.915293 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-SecurityGroupsTestJSON-752173812 Oct 04 18:42:39.915293 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:42:39.915293 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:42:39.915293 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1b43fba16115404aaa793fb907fd257f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1b43fba16115404aaa793fb907fd257f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1b43fba16115404aaa793fb907fd257f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1b43fba16115404aaa793fb907fd257f"}]}] Oct 04 18:42:39.915293 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-SecurityGroupsTestJSON-752173812 Oct 04 18:42:39.915293 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 1b43fba16115404aaa793fb907fd257f Oct 04 18:42:39.915293 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-752173812 Oct 04 18:42:39.915293 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-SecurityGroupsTestJSON-752173812-project Oct 04 18:42:39.915293 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:42:39.915293 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:42:39.915293 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 777a7a51e45b498597f7a1202217575c Oct 04 18:42:39.915293 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-SecurityGroupsTestJSON-752173812-project Oct 04 18:42:39.915293 n-d-850501-14 devstack@n-api.service[123002]: method: Oct 04 18:42:39.915293 n-d-850501-14 devstack@n-api.service[123002]: exception: Security Group e844db73-1f78-41b1-bfff-a04e58f82fc1 in use. Oct 04 18:42:39.915293 n-d-850501-14 devstack@n-api.service[123002]: Neutron server returns request_ids: ['req-984948fc-15c4-46cf-8b2c-eff8d712b790'] Oct 04 18:42:39.915293 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'e844db73-1f78-41b1-bfff-a04e58f82fc1'} Oct 04 18:42:39.915293 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:42:39.915293 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:39.915293 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 04 18:42:39.915293 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 04 18:42:39.915293 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:42:39.915293 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:42:39.915293 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 04 18:42:39.915293 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 04 18:42:39.915293 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:42:39.915293 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:42:39.915293 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 04 18:42:39.915293 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 04 18:42:39.915293 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:42:39.915293 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:42:39.915293 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:42:39.915293 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:42:39.915293 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:42:39.915293 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:42:39.915293 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:42:39.915293 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:42:39.915293 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:42:39.915293 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:42:39.915293 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:42:39.915293 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:42:39.915293 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:42:39.915293 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:42:39.915293 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group e844db73-1f78-41b1-bfff-a04e58f82fc1 in use. Oct 04 18:42:39.924868 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-984948fc-15c4-46cf-8b2c-eff8d712b790'] Oct 04 18:42:39.924868 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:39.924868 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:42:39.924868 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:39.924868 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:39.924868 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 04 18:42:39.924868 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 04 18:42:39.924868 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 04 18:42:39.924868 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 04 18:42:39.924868 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group e844db73-1f78-41b1-bfff-a04e58f82fc1 in use. Oct 04 18:42:39.924868 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-984948fc-15c4-46cf-8b2c-eff8d712b790'] Oct 04 18:42:39.924868 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:39.924868 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:42:39.924868 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:39.924868 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:39.924868 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:42:39.924868 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:42:39.924868 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:42:39.924868 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:42:39.924868 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:42:39.924868 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:42:39.924868 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:42:39.924868 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:42:39.924868 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 04 18:42:39.924868 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 18:42:39.924868 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group e844db73-1f78-41b1-bfff-a04e58f82fc1 in use. Oct 04 18:42:39.924868 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-984948fc-15c4-46cf-8b2c-eff8d712b790'] Oct 04 18:42:39.924868 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:39.924868 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:42:39.924868 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:39.924868 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:39.924868 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:42:39.924868 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:42:39.924868 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:42:39.924868 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:42:39.924868 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group e844db73-1f78-41b1-bfff-a04e58f82fc1 in use. Oct 04 18:42:39.924868 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-984948fc-15c4-46cf-8b2c-eff8d712b790'] Oct 04 18:42:39.924868 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:39.924868 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a0656a81-4c4b-49a5-ad26-b8f04a90bd54 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Returning 400 to user: Security Group e844db73-1f78-41b1-bfff-a04e58f82fc1 in use. Oct 04 18:42:39.924868 n-d-850501-14 devstack@n-api.service[123002]: Neutron server returns request_ids: ['req-984948fc-15c4-46cf-8b2c-eff8d712b790'] {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:42:39.928284 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-38dfe817-fae6-47e0-8e8c-8ab34d67e681 req-757944d6-a7dd-4922-ad8e-69b17e2f0330 service nova] Creating event network-changed:de5db3a4-1f99-4a92-a78e-f59449b5343b for instance e245e3c8-b2eb-4f0f-8dec-c7bc290bd356 on n-h2-850501-14 Oct 04 18:42:39.928386 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a0656a81-4c4b-49a5-ad26-b8f04a90bd54 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/e844db73-1f78-41b1-bfff-a04e58f82fc1" status: 400 len: 185 microversion: 2.1 time: 0.328176 Oct 04 18:42:39.928386 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1754/3550] 10.222.0.20 () {58 vars in 1272 bytes} [Tue Oct 4 18:42:39 2022] DELETE /compute/v2.1/os-security-groups/e844db73-1f78-41b1-bfff-a04e58f82fc1 => generated 185 bytes in 337 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:42:39.931470 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-38dfe817-fae6-47e0-8e8c-8ab34d67e681 req-757944d6-a7dd-4922-ad8e-69b17e2f0330 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087824 Oct 04 18:42:39.933910 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1797/3551] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:42:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:42:39.934340 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b13a67e9-a31f-4e84-972d-f1f59c6467a6 tempest-KeyPairsV22TestJSON-616639178 tempest-KeyPairsV22TestJSON-616639178-project] Action: 'create', calling method: .version_select at 0x7fe259869670>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-821114477", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIYTb483IChcagU9gwV2N8YO0NoOaVSo2ezP1/vffsl2tJCM1XEdjAghT/0ca+2lN2BrWcR2vfl6kR+1zIsNWBxLspSu0bxyzg0U+rrAbLWUPRtPm8uGY6YFabDiJ5WAKA=="}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:39.949316 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3dd23ad1-75fd-440b-bda6-db56c6de48d6 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:39.950270 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3dd23ad1-75fd-440b-bda6-db56c6de48d6 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 6dc7155a-e90b-4ca9-8778-02bf31eff4bd] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:39.966460 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-b13a67e9-a31f-4e84-972d-f1f59c6467a6 tempest-KeyPairsV22TestJSON-616639178 tempest-KeyPairsV22TestJSON-616639178-project] Getting quotas for project b0714d53d5b0409295986aad5c53ad37. Resources: {'key_pairs'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:42:39.967138 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3dd23ad1-75fd-440b-bda6-db56c6de48d6 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:39.972247 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3dd23ad1-75fd-440b-bda6-db56c6de48d6 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:39.972247 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3dd23ad1-75fd-440b-bda6-db56c6de48d6 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:39.972247 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3dd23ad1-75fd-440b-bda6-db56c6de48d6 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:39.972247 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3dd23ad1-75fd-440b-bda6-db56c6de48d6 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:39.972247 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3dd23ad1-75fd-440b-bda6-db56c6de48d6 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:39.988669 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-b13a67e9-a31f-4e84-972d-f1f59c6467a6 tempest-KeyPairsV22TestJSON-616639178 tempest-KeyPairsV22TestJSON-616639178-project] Getting quotas for user b1e3fec0499746abbc22043645deca9f and project b0714d53d5b0409295986aad5c53ad37. Resources: {'key_pairs'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:42:40.169629 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b13a67e9-a31f-4e84-972d-f1f59c6467a6 tempest-KeyPairsV22TestJSON-616639178 tempest-KeyPairsV22TestJSON-616639178-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.245693 Oct 04 18:42:40.171692 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1755/3552] 10.222.0.20 () {62 vars in 1199 bytes} [Tue Oct 4 18:42:39 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 252 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 04 18:42:40.185833 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1f735fec-9823-4a43-8dc5-0169426d8c0a tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:40.202011 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1f735fec-9823-4a43-8dc5-0169426d8c0a tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: af46589b-8af1-4394-86e3-631c7d483a12] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:40.218457 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1f735fec-9823-4a43-8dc5-0169426d8c0a tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:40.219407 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1f735fec-9823-4a43-8dc5-0169426d8c0a tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:40.220290 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1f735fec-9823-4a43-8dc5-0169426d8c0a tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:40.222501 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1f735fec-9823-4a43-8dc5-0169426d8c0a tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:40.223219 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1f735fec-9823-4a43-8dc5-0169426d8c0a tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:40.223971 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1f735fec-9823-4a43-8dc5-0169426d8c0a tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:40.264264 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-1f735fec-9823-4a43-8dc5-0169426d8c0a tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lazy-loading 'flavor' on Instance uuid af46589b-8af1-4394-86e3-631c7d483a12 {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:42:40.284029 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-1f735fec-9823-4a43-8dc5-0169426d8c0a tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] HTTP exception thrown: Cannot 'rescue' instance af46589b-8af1-4394-86e3-631c7d483a12 while it is in vm_state paused Oct 04 18:42:40.289658 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1f735fec-9823-4a43-8dc5-0169426d8c0a tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Request method failure captured: Oct 04 18:42:40.289658 n-d-850501-14 devstack@n-api.service[123002]: request: POST /compute/v2.1/servers/af46589b-8af1-4394-86e3-631c7d483a12/action HTTP/1.1 Oct 04 18:42:40.289658 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:42:40.289658 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:42:40.289658 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:42:40.289658 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 14 Oct 04 18:42:40.289658 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:42:40.289658 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:42:40.289658 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:42:40.289658 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:42:40.289658 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH5VeoXXX4R-gl3WW_fAsW_7hDIEWiZR35lPoIuJDBMUw75w4Z-93EJDy38x5YiA26dGCEdjKEzqMCUM4kpma5PpB_mUiDb0rAatpoM-ionDMXIgsOp1o3NTgluOHECynM7nFlIuW8aS-v8Gnb5xnrVGhYXFRV6ahForfC1sBHmJ1HA Oct 04 18:42:40.289658 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:42:40.289658 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:42:40.289658 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:42:40.289658 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:42:40.289658 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:42:40.289658 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:42:40.289658 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 9eb391aef10e4684ada5f811ae818f97 Oct 04 18:42:40.289658 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-124944821 Oct 04 18:42:40.289658 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:42:40.289658 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:42:40.289658 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9eb391aef10e4684ada5f811ae818f97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9eb391aef10e4684ada5f811ae818f97", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9eb391aef10e4684ada5f811ae818f97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9eb391aef10e4684ada5f811ae818f97"}]}] Oct 04 18:42:40.289658 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServerRescueNegativeTestJSON-124944821 Oct 04 18:42:40.289658 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 9eb391aef10e4684ada5f811ae818f97 Oct 04 18:42:40.289658 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-124944821 Oct 04 18:42:40.289658 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServerRescueNegativeTestJSON-124944821-project Oct 04 18:42:40.289658 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:42:40.289658 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:42:40.289658 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: c4243e3907374e5e9947c17e6288f0e7 Oct 04 18:42:40.289658 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServerRescueNegativeTestJSON-124944821-project Oct 04 18:42:40.289658 n-d-850501-14 devstack@n-api.service[123002]: Oct 04 18:42:40.289658 n-d-850501-14 devstack@n-api.service[123002]: {"rescue": {}} Oct 04 18:42:40.289658 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:42:40.289658 n-d-850501-14 devstack@n-api.service[123002]: exception: Cannot 'rescue' instance af46589b-8af1-4394-86e3-631c7d483a12 while it is in vm_state paused Oct 04 18:42:40.289658 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'af46589b-8af1-4394-86e3-631c7d483a12', 'body': {'rescue': {}}} Oct 04 18:42:40.289658 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:42:40.289658 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:40.289658 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Oct 04 18:42:40.289658 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Oct 04 18:42:40.289658 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 04 18:42:40.289658 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 18:42:40.289658 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:42:40.289658 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:42:40.289658 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 18:42:40.289658 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 18:42:40.289658 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance af46589b-8af1-4394-86e3-631c7d483a12 in vm_state paused. Cannot rescue while the instance is in this state. Oct 04 18:42:40.289658 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:40.289658 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:42:40.289658 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:40.289658 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:40.289658 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:42:40.289658 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:42:40.289658 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:42:40.289658 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:42:40.289658 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:42:40.289658 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:42:40.289658 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:42:40.289658 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:42:40.289658 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Oct 04 18:42:40.289658 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 04 18:42:40.289658 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 18:42:40.289658 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 18:42:40.289658 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance af46589b-8af1-4394-86e3-631c7d483a12 while it is in vm_state paused Oct 04 18:42:40.289658 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:40.294927 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:42:40.294927 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:40.294927 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:40.294927 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:42:40.294927 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:42:40.294927 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:42:40.294927 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:42:40.294927 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance af46589b-8af1-4394-86e3-631c7d483a12 while it is in vm_state paused Oct 04 18:42:40.294927 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:40.297068 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1f735fec-9823-4a43-8dc5-0169426d8c0a tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Returning 409 to user: Cannot 'rescue' instance af46589b-8af1-4394-86e3-631c7d483a12 while it is in vm_state paused {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:42:40.298735 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1f735fec-9823-4a43-8dc5-0169426d8c0a tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "POST /compute/v2.1/servers/af46589b-8af1-4394-86e3-631c7d483a12/action" status: 409 len: 144 microversion: 2.1 time: 0.123982 Oct 04 18:42:40.299935 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1756/3553] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:42:40 2022] POST /compute/v2.1/servers/af46589b-8af1-4394-86e3-631c7d483a12/action => generated 144 bytes in 127 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:42:40.305489 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d37f8ba5-2e25-460a-877c-2f69d62631bc tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe258062790>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:40.378018 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d37f8ba5-2e25-460a-877c-2f69d62631bc tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/images/c2d74af2-6145-47cb-afce-79b914979a49" status: 200 len: 661 microversion: 2.1 time: 0.076428 Oct 04 18:42:40.379472 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1757/3554] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:42:40 2022] GET /compute/v2.1/images/c2d74af2-6145-47cb-afce-79b914979a49 => generated 661 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:42:40.386435 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e10f926c-1214-47cd-a380-4f467f634d9c tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:40.387861 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e10f926c-1214-47cd-a380-4f467f634d9c tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] [instance: e245e3c8-b2eb-4f0f-8dec-c7bc290bd356] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:40.408950 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e10f926c-1214-47cd-a380-4f467f634d9c tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:40.409924 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e10f926c-1214-47cd-a380-4f467f634d9c tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:40.412230 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e10f926c-1214-47cd-a380-4f467f634d9c tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:40.413890 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e10f926c-1214-47cd-a380-4f467f634d9c tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:40.419939 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3dd23ad1-75fd-440b-bda6-db56c6de48d6 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:40.436931 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e10f926c-1214-47cd-a380-4f467f634d9c tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:40.437408 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e10f926c-1214-47cd-a380-4f467f634d9c tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:40.450081 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3dd23ad1-75fd-440b-bda6-db56c6de48d6 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/6dc7155a-e90b-4ca9-8778-02bf31eff4bd" status: 200 len: 1289 microversion: 2.1 time: 0.511163 Oct 04 18:42:40.450724 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1798/3555] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:39 2022] GET /compute/v2.1/servers/6dc7155a-e90b-4ca9-8778-02bf31eff4bd => generated 1289 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:40.475035 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-889df739-7d5f-404c-89fc-63c638f41395 tempest-KeyPairsV22TestJSON-616639178 tempest-KeyPairsV22TestJSON-616639178-project] Calling method '.version_select at 0x7fe259846040>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:40.487483 n-d-850501-14 devstack@n-api.service[123001]: WARNING oslo_db.sqlalchemy.utils [None req-889df739-7d5f-404c-89fc-63c638f41395 tempest-KeyPairsV22TestJSON-616639178 tempest-KeyPairsV22TestJSON-616639178-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 04 18:42:40.496793 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-889df739-7d5f-404c-89fc-63c638f41395 tempest-KeyPairsV22TestJSON-616639178 tempest-KeyPairsV22TestJSON-616639178-project] 10.222.0.20 "GET /compute/v2.1/os-keypairs" status: 200 len: 1139 microversion: 2.2 time: 0.044964 Oct 04 18:42:40.497392 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1799/3556] 10.222.0.20 () {60 vars in 1177 bytes} [Tue Oct 4 18:42:40 2022] GET /compute/v2.1/os-keypairs => generated 1139 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:40.509290 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-bb1b32b0-9a90-4713-b280-57833f9bcdb2 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:40.510100 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-bb1b32b0-9a90-4713-b280-57833f9bcdb2 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: af46589b-8af1-4394-86e3-631c7d483a12] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:40.510312 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e10f926c-1214-47cd-a380-4f467f634d9c tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] [instance: e245e3c8-b2eb-4f0f-8dec-c7bc290bd356] Going to try to terminate instance {{(pid=123002) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:42:40.518100 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bb1b32b0-9a90-4713-b280-57833f9bcdb2 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:40.518846 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bb1b32b0-9a90-4713-b280-57833f9bcdb2 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:40.519463 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bb1b32b0-9a90-4713-b280-57833f9bcdb2 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:40.520390 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bb1b32b0-9a90-4713-b280-57833f9bcdb2 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:40.521169 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bb1b32b0-9a90-4713-b280-57833f9bcdb2 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:40.521865 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bb1b32b0-9a90-4713-b280-57833f9bcdb2 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:40.825927 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-bb1b32b0-9a90-4713-b280-57833f9bcdb2 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "POST /compute/v2.1/servers/af46589b-8af1-4394-86e3-631c7d483a12/action" status: 202 len: 0 microversion: 2.1 time: 0.322520 Oct 04 18:42:40.827439 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1800/3557] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:42:40 2022] POST /compute/v2.1/servers/af46589b-8af1-4394-86e3-631c7d483a12/action => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:42:40.837446 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-aa83bf83-6cc3-457d-b6b8-ec079a80016e tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe2590db310>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:40.906826 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e10f926c-1214-47cd-a380-4f467f634d9c tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e245e3c8-b2eb-4f0f-8dec-c7bc290bd356" status: 204 len: 0 microversion: 2.1 time: 0.524915 Oct 04 18:42:40.915109 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1758/3558] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:42:40 2022] DELETE /compute/v2.1/servers/e245e3c8-b2eb-4f0f-8dec-c7bc290bd356 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:42:40.920217 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e6a97dc4-89b4-4723-826b-b377856cd313 tempest-KeyPairsV22TestJSON-616639178 tempest-KeyPairsV22TestJSON-616639178-project] Calling method '.version_select at 0x7fe259359f70>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:40.927521 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-aa83bf83-6cc3-457d-b6b8-ec079a80016e tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/images/c2d74af2-6145-47cb-afce-79b914979a49" status: 200 len: 661 microversion: 2.1 time: 0.097831 Oct 04 18:42:40.928408 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1801/3559] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:42:40 2022] GET /compute/v2.1/images/c2d74af2-6145-47cb-afce-79b914979a49 => generated 661 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:42:40.951455 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-bb3d6f73-9c81-4898-8b29-548e1ee540f3 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:40.952226 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-bb3d6f73-9c81-4898-8b29-548e1ee540f3 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: af46589b-8af1-4394-86e3-631c7d483a12] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:40.977696 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bb3d6f73-9c81-4898-8b29-548e1ee540f3 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:40.980220 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bb3d6f73-9c81-4898-8b29-548e1ee540f3 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:40.981483 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bb3d6f73-9c81-4898-8b29-548e1ee540f3 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:40.984007 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bb3d6f73-9c81-4898-8b29-548e1ee540f3 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:40.984761 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bb3d6f73-9c81-4898-8b29-548e1ee540f3 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:40.986553 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bb3d6f73-9c81-4898-8b29-548e1ee540f3 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:41.165421 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e6a97dc4-89b4-4723-826b-b377856cd313 tempest-KeyPairsV22TestJSON-616639178 tempest-KeyPairsV22TestJSON-616639178-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-821114477" status: 204 len: 0 microversion: 2.2 time: 0.255978 Oct 04 18:42:41.169589 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1759/3560] 10.222.0.20 () {60 vars in 1318 bytes} [Tue Oct 4 18:42:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-821114477 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:42:41.176393 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f79de981-bb4a-4b7d-8df6-18c25130f9c8 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:41.185766 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f79de981-bb4a-4b7d-8df6-18c25130f9c8 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] [instance: e245e3c8-b2eb-4f0f-8dec-c7bc290bd356] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:41.197191 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f79de981-bb4a-4b7d-8df6-18c25130f9c8 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:41.197191 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f79de981-bb4a-4b7d-8df6-18c25130f9c8 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:41.197191 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f79de981-bb4a-4b7d-8df6-18c25130f9c8 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:41.198071 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f79de981-bb4a-4b7d-8df6-18c25130f9c8 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:41.198941 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f79de981-bb4a-4b7d-8df6-18c25130f9c8 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:41.200221 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f79de981-bb4a-4b7d-8df6-18c25130f9c8 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:41.246205 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-bb3d6f73-9c81-4898-8b29-548e1ee540f3 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:41.250214 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:42:41.255622 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-bb3d6f73-9c81-4898-8b29-548e1ee540f3 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/af46589b-8af1-4394-86e3-631c7d483a12" status: 200 len: 1506 microversion: 2.1 time: 0.307960 Oct 04 18:42:41.256543 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1802/3561] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:40 2022] GET /compute/v2.1/servers/af46589b-8af1-4394-86e3-631c7d483a12 => generated 1506 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:41.261834 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1c2cc347-19cc-4ad9-b4e7-0a2a0f428864 tempest-KeyPairsV22TestJSON-616639178 tempest-KeyPairsV22TestJSON-616639178-project] Calling method '.version_select at 0x7fe2590fe820>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:41.366149 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1c2cc347-19cc-4ad9-b4e7-0a2a0f428864 tempest-KeyPairsV22TestJSON-616639178 tempest-KeyPairsV22TestJSON-616639178-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-958668294" status: 204 len: 0 microversion: 2.2 time: 0.108173 Oct 04 18:42:41.367492 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1803/3562] 10.222.0.20 () {60 vars in 1318 bytes} [Tue Oct 4 18:42:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-958668294 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:42:41.380642 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3ce6c296-2ebc-430b-8d0c-23936e4de512 tempest-KeyPairsV22TestJSON-616639178 tempest-KeyPairsV22TestJSON-616639178-project] Calling method '.version_select at 0x7fe2582bfc10>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:41.530301 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3ce6c296-2ebc-430b-8d0c-23936e4de512 tempest-KeyPairsV22TestJSON-616639178 tempest-KeyPairsV22TestJSON-616639178-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-770270925" status: 204 len: 0 microversion: 2.2 time: 0.156234 Oct 04 18:42:41.536270 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1804/3563] 10.222.0.20 () {60 vars in 1318 bytes} [Tue Oct 4 18:42:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-770270925 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:42:41.544968 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a38aa48e-c04a-4fcf-94e1-4aa3a6e73eca tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:41.547314 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a38aa48e-c04a-4fcf-94e1-4aa3a6e73eca tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 6dc7155a-e90b-4ca9-8778-02bf31eff4bd] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:41.577998 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a38aa48e-c04a-4fcf-94e1-4aa3a6e73eca tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:41.578701 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a38aa48e-c04a-4fcf-94e1-4aa3a6e73eca tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:41.581496 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a38aa48e-c04a-4fcf-94e1-4aa3a6e73eca tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:41.583978 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a38aa48e-c04a-4fcf-94e1-4aa3a6e73eca tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:41.586585 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a38aa48e-c04a-4fcf-94e1-4aa3a6e73eca tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:41.587824 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a38aa48e-c04a-4fcf-94e1-4aa3a6e73eca tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:41.597319 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f79de981-bb4a-4b7d-8df6-18c25130f9c8 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '777a7a51e45b498597f7a1202217575c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b43fba16115404aaa793fb907fd257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:41.618325 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f79de981-bb4a-4b7d-8df6-18c25130f9c8 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] 10.222.0.20 "GET /compute/v2.1/servers/e245e3c8-b2eb-4f0f-8dec-c7bc290bd356" status: 200 len: 1646 microversion: 2.1 time: 0.446582 Oct 04 18:42:41.624392 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1760/3564] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:41 2022] GET /compute/v2.1/servers/e245e3c8-b2eb-4f0f-8dec-c7bc290bd356 => generated 1646 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:41.633268 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3245c029-5f33-4208-aa3f-171aaf76c072 tempest-KeyPairsV22TestJSON-616639178 tempest-KeyPairsV22TestJSON-616639178-project] Action: 'create', calling method: .version_select at 0x7fe258a8d310>, body: {"keypair": {"name": "tempest-keypair-1110529417", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHH4NSEpgi0ecE368akCIBUtT4KAR5DTe3Ptw7K35yqq1drE7BhiIEPWux7MhzYYdFhTyeiuEn2he3S/tNyczEyN+W409oXw3bjaf8GClgtziC8cxUSKGsw79fyi3OM8Ng=="}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:41.681443 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-3245c029-5f33-4208-aa3f-171aaf76c072 tempest-KeyPairsV22TestJSON-616639178 tempest-KeyPairsV22TestJSON-616639178-project] Getting quotas for project b0714d53d5b0409295986aad5c53ad37. Resources: {'key_pairs'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:42:41.693061 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-3245c029-5f33-4208-aa3f-171aaf76c072 tempest-KeyPairsV22TestJSON-616639178 tempest-KeyPairsV22TestJSON-616639178-project] Getting quotas for user b1e3fec0499746abbc22043645deca9f and project b0714d53d5b0409295986aad5c53ad37. Resources: {'key_pairs'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:42:41.822466 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3245c029-5f33-4208-aa3f-171aaf76c072 tempest-KeyPairsV22TestJSON-616639178 tempest-KeyPairsV22TestJSON-616639178-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.196590 Oct 04 18:42:41.829088 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1761/3565] 10.222.0.20 () {62 vars in 1199 bytes} [Tue Oct 4 18:42:41 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 198 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 04 18:42:41.835952 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1e1f48fb-bb69-43e6-9fae-043e6aff8f72 tempest-KeyPairsV22TestJSON-616639178 tempest-KeyPairsV22TestJSON-616639178-project] Calling method '.version_select at 0x7fe253e82e50>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:41.849322 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1e1f48fb-bb69-43e6-9fae-043e6aff8f72 tempest-KeyPairsV22TestJSON-616639178 tempest-KeyPairsV22TestJSON-616639178-project] 10.222.0.20 "GET /compute/v2.1/os-keypairs/tempest-keypair-1110529417" status: 200 len: 513 microversion: 2.2 time: 0.017062 Oct 04 18:42:41.849974 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1762/3566] 10.222.0.20 () {60 vars in 1258 bytes} [Tue Oct 4 18:42:41 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1110529417 => generated 513 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:42:41.862154 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3c0d17e4-e083-4cc3-b58b-eea2602f25c2 tempest-KeyPairsV22TestJSON-616639178 tempest-KeyPairsV22TestJSON-616639178-project] Calling method '.version_select at 0x7fe259467dc0>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:41.867691 n-d-850501-14 devstack@n-api.service[123002]: WARNING oslo_db.sqlalchemy.utils [None req-3c0d17e4-e083-4cc3-b58b-eea2602f25c2 tempest-KeyPairsV22TestJSON-616639178 tempest-KeyPairsV22TestJSON-616639178-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 04 18:42:41.875320 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3c0d17e4-e083-4cc3-b58b-eea2602f25c2 tempest-KeyPairsV22TestJSON-616639178 tempest-KeyPairsV22TestJSON-616639178-project] 10.222.0.20 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.017338 Oct 04 18:42:41.875916 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1763/3567] 10.222.0.20 () {60 vars in 1177 bytes} [Tue Oct 4 18:42:41 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:42:41.888371 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-42c40702-b403-4c4b-8b1e-909d7235e07c tempest-KeyPairsV22TestJSON-616639178 tempest-KeyPairsV22TestJSON-616639178-project] Calling method '.version_select at 0x7fe258857ee0>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:41.986281 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a38aa48e-c04a-4fcf-94e1-4aa3a6e73eca tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:42.006737 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-42c40702-b403-4c4b-8b1e-909d7235e07c tempest-KeyPairsV22TestJSON-616639178 tempest-KeyPairsV22TestJSON-616639178-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1110529417" status: 204 len: 0 microversion: 2.2 time: 0.122089 Oct 04 18:42:42.007821 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1764/3568] 10.222.0.20 () {60 vars in 1261 bytes} [Tue Oct 4 18:42:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1110529417 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:42:42.020771 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a38aa48e-c04a-4fcf-94e1-4aa3a6e73eca tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/6dc7155a-e90b-4ca9-8778-02bf31eff4bd" status: 200 len: 1329 microversion: 2.1 time: 0.467232 Oct 04 18:42:42.021375 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1805/3569] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:41 2022] GET /compute/v2.1/servers/6dc7155a-e90b-4ca9-8778-02bf31eff4bd => generated 1329 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:42.030081 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9ac2e864-fd03-44df-a9dd-3823417df240 tempest-KeyPairsV22TestJSON-616639178 tempest-KeyPairsV22TestJSON-616639178-project] Action: 'create', calling method: .version_select at 0x7fe253fd0b80>, body: {"keypair": {"name": "tempest-keypair-1724021481", "type": "x509"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:42.063704 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-9ac2e864-fd03-44df-a9dd-3823417df240 tempest-KeyPairsV22TestJSON-616639178 tempest-KeyPairsV22TestJSON-616639178-project] Getting quotas for project b0714d53d5b0409295986aad5c53ad37. Resources: {'key_pairs'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:42:42.070051 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-9ac2e864-fd03-44df-a9dd-3823417df240 tempest-KeyPairsV22TestJSON-616639178 tempest-KeyPairsV22TestJSON-616639178-project] Getting quotas for user b1e3fec0499746abbc22043645deca9f and project b0714d53d5b0409295986aad5c53ad37. Resources: {'key_pairs'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:42:42.089058 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.processutils [None req-9ac2e864-fd03-44df-a9dd-3823417df240 tempest-KeyPairsV22TestJSON-616639178 tempest-KeyPairsV22TestJSON-616639178-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmp6lp1qfzn/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp6lp1qfzn/temp.key -subj /CN=b1e3fec0499746abbc22043645deca9f -extensions v3_req_client {{(pid=123002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 04 18:42:42.288406 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b9441a08-5338-449f-b45b-a911bcf8da0e tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:42.290058 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b9441a08-5338-449f-b45b-a911bcf8da0e tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: af46589b-8af1-4394-86e3-631c7d483a12] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:42.306803 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b9441a08-5338-449f-b45b-a911bcf8da0e tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:42.307803 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b9441a08-5338-449f-b45b-a911bcf8da0e tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:42.308558 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b9441a08-5338-449f-b45b-a911bcf8da0e tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:42.309538 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b9441a08-5338-449f-b45b-a911bcf8da0e tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:42.310462 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b9441a08-5338-449f-b45b-a911bcf8da0e tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:42.311187 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b9441a08-5338-449f-b45b-a911bcf8da0e tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:42.563473 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.processutils [None req-9ac2e864-fd03-44df-a9dd-3823417df240 tempest-KeyPairsV22TestJSON-616639178 tempest-KeyPairsV22TestJSON-616639178-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmp6lp1qfzn/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp6lp1qfzn/temp.key -subj /CN=b1e3fec0499746abbc22043645deca9f -extensions v3_req_client" returned: 0 in 0.474s {{(pid=123002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 04 18:42:42.567286 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.processutils [None req-9ac2e864-fd03-44df-a9dd-3823417df240 tempest-KeyPairsV22TestJSON-616639178 tempest-KeyPairsV22TestJSON-616639178-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmp6lp1qfzn/temp.key -password pass: {{(pid=123002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 04 18:42:42.606286 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.processutils [None req-9ac2e864-fd03-44df-a9dd-3823417df240 tempest-KeyPairsV22TestJSON-616639178 tempest-KeyPairsV22TestJSON-616639178-project] CMD "openssl pkcs12 -export -inkey /tmp/tmp6lp1qfzn/temp.key -password pass:" returned: 0 in 0.038s {{(pid=123002) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 04 18:42:42.781989 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-9ac2e864-fd03-44df-a9dd-3823417df240 tempest-KeyPairsV22TestJSON-616639178 tempest-KeyPairsV22TestJSON-616639178-project] Getting quotas for project b0714d53d5b0409295986aad5c53ad37. Resources: {'key_pairs'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:42:42.782190 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b9441a08-5338-449f-b45b-a911bcf8da0e tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:42.791334 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-9ac2e864-fd03-44df-a9dd-3823417df240 tempest-KeyPairsV22TestJSON-616639178 tempest-KeyPairsV22TestJSON-616639178-project] Getting quotas for user b1e3fec0499746abbc22043645deca9f and project b0714d53d5b0409295986aad5c53ad37. Resources: {'key_pairs'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:42:42.797039 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b9441a08-5338-449f-b45b-a911bcf8da0e tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/af46589b-8af1-4394-86e3-631c7d483a12" status: 200 len: 1506 microversion: 2.1 time: 0.518214 Oct 04 18:42:42.797959 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1806/3570] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:42 2022] GET /compute/v2.1/servers/af46589b-8af1-4394-86e3-631c7d483a12 => generated 1506 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:42.805379 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-39ead4f3-ac8f-4182-9c05-29d00d185d0f tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:42.806122 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-39ead4f3-ac8f-4182-9c05-29d00d185d0f tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] [instance: e245e3c8-b2eb-4f0f-8dec-c7bc290bd356] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:42.812608 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-39ead4f3-ac8f-4182-9c05-29d00d185d0f tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:42.813252 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-39ead4f3-ac8f-4182-9c05-29d00d185d0f tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:42.813787 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-39ead4f3-ac8f-4182-9c05-29d00d185d0f tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:42.815830 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-39ead4f3-ac8f-4182-9c05-29d00d185d0f tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:42.817294 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-39ead4f3-ac8f-4182-9c05-29d00d185d0f tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:42.819066 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-39ead4f3-ac8f-4182-9c05-29d00d185d0f tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:42.833218 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9ac2e864-fd03-44df-a9dd-3823417df240 tempest-KeyPairsV22TestJSON-616639178 tempest-KeyPairsV22TestJSON-616639178-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 0.815497 Oct 04 18:42:42.834687 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1765/3571] 10.222.0.20 () {62 vars in 1198 bytes} [Tue Oct 4 18:42:42 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 818 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:42:42.850478 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9d596cc0-f437-441f-b1a7-d79fb0f8f07a tempest-KeyPairsV22TestJSON-616639178 tempest-KeyPairsV22TestJSON-616639178-project] Calling method '.version_select at 0x7fe253f1bdc0>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:42.872836 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9d596cc0-f437-441f-b1a7-d79fb0f8f07a tempest-KeyPairsV22TestJSON-616639178 tempest-KeyPairsV22TestJSON-616639178-project] 10.222.0.20 "GET /compute/v2.1/os-keypairs/tempest-keypair-1724021481" status: 200 len: 1534 microversion: 2.2 time: 0.028157 Oct 04 18:42:42.872836 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1766/3572] 10.222.0.20 () {60 vars in 1258 bytes} [Tue Oct 4 18:42:42 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1724021481 => generated 1534 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:42.886004 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0257a843-da91-4222-9bce-292babd09079 tempest-KeyPairsV22TestJSON-616639178 tempest-KeyPairsV22TestJSON-616639178-project] Calling method '.version_select at 0x7fe253e64790>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:42.896328 n-d-850501-14 devstack@n-api.service[123002]: WARNING oslo_db.sqlalchemy.utils [None req-0257a843-da91-4222-9bce-292babd09079 tempest-KeyPairsV22TestJSON-616639178 tempest-KeyPairsV22TestJSON-616639178-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 04 18:42:42.902896 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0257a843-da91-4222-9bce-292babd09079 tempest-KeyPairsV22TestJSON-616639178 tempest-KeyPairsV22TestJSON-616639178-project] 10.222.0.20 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.022064 Oct 04 18:42:42.904150 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1767/3573] 10.222.0.20 () {60 vars in 1177 bytes} [Tue Oct 4 18:42:42 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:42.918811 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2c6bd4df-129d-4435-bfb6-1109baef178c tempest-KeyPairsV22TestJSON-616639178 tempest-KeyPairsV22TestJSON-616639178-project] Calling method '.version_select at 0x7fe253e0c820>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:42.930499 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:DELETE=3,nova_api:SELECT=91,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:42:43.053619 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2c6bd4df-129d-4435-bfb6-1109baef178c tempest-KeyPairsV22TestJSON-616639178 tempest-KeyPairsV22TestJSON-616639178-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1724021481" status: 204 len: 0 microversion: 2.2 time: 0.131840 Oct 04 18:42:43.059511 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1768/3574] 10.222.0.20 () {60 vars in 1261 bytes} [Tue Oct 4 18:42:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1724021481 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:42:43.075449 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2a7647f3-9517-414f-99fe-cf66542cd035 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:43.075449 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2a7647f3-9517-414f-99fe-cf66542cd035 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 6dc7155a-e90b-4ca9-8778-02bf31eff4bd] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:43.083285 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2a7647f3-9517-414f-99fe-cf66542cd035 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:43.083942 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2a7647f3-9517-414f-99fe-cf66542cd035 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:43.084536 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2a7647f3-9517-414f-99fe-cf66542cd035 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:43.085462 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2a7647f3-9517-414f-99fe-cf66542cd035 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:43.086084 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2a7647f3-9517-414f-99fe-cf66542cd035 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:43.086622 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2a7647f3-9517-414f-99fe-cf66542cd035 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:43.411934 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-39ead4f3-ac8f-4182-9c05-29d00d185d0f tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '777a7a51e45b498597f7a1202217575c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b43fba16115404aaa793fb907fd257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:43.419830 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-39ead4f3-ac8f-4182-9c05-29d00d185d0f tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] 10.222.0.20 "GET /compute/v2.1/servers/e245e3c8-b2eb-4f0f-8dec-c7bc290bd356" status: 200 len: 1646 microversion: 2.1 time: 0.619539 Oct 04 18:42:43.420657 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1807/3575] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:42 2022] GET /compute/v2.1/servers/e245e3c8-b2eb-4f0f-8dec-c7bc290bd356 => generated 1646 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:43.441239 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-df07c19f-0a16-4ddf-a5db-e2a53f216ff5 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe258c7ae50>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:43.488479 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-df07c19f-0a16-4ddf-a5db-e2a53f216ff5 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/images/b65b417c-791d-426d-8551-3644174bf59d" status: 200 len: 662 microversion: 2.1 time: 0.063529 Oct 04 18:42:43.489037 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1808/3576] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:42:43 2022] GET /compute/v2.1/images/b65b417c-791d-426d-8551-3644174bf59d => generated 662 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:42:43.503936 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ebd4308d-51d3-4197-941f-034420584365 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe25911eb80>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:43.547541 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2a7647f3-9517-414f-99fe-cf66542cd035 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:43.552755 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ebd4308d-51d3-4197-941f-034420584365 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/images/b65b417c-791d-426d-8551-3644174bf59d" status: 200 len: 662 microversion: 2.1 time: 0.053124 Oct 04 18:42:43.553572 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1809/3577] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:42:43 2022] GET /compute/v2.1/images/b65b417c-791d-426d-8551-3644174bf59d => generated 662 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:42:43.558736 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2a7647f3-9517-414f-99fe-cf66542cd035 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/6dc7155a-e90b-4ca9-8778-02bf31eff4bd" status: 200 len: 1329 microversion: 2.1 time: 0.496190 Oct 04 18:42:43.559705 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1769/3578] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:43 2022] GET /compute/v2.1/servers/6dc7155a-e90b-4ca9-8778-02bf31eff4bd => generated 1329 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:43.642191 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c4b9ea74-746a-4e32-a56d-df28c251842e tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-70522707", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:43.782985 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.neutron [None req-c4b9ea74-746a-4e32-a56d-df28c251842e tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] validate_networks() for None {{(pid=123001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:42:43.836154 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f3a4e96b-5452-426c-9ac5-84d7e9a5cd12 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:43.837680 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f3a4e96b-5452-426c-9ac5-84d7e9a5cd12 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: af46589b-8af1-4394-86e3-631c7d483a12] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:43.851928 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f3a4e96b-5452-426c-9ac5-84d7e9a5cd12 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:43.865043 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f3a4e96b-5452-426c-9ac5-84d7e9a5cd12 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:43.866246 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f3a4e96b-5452-426c-9ac5-84d7e9a5cd12 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:43.867282 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f3a4e96b-5452-426c-9ac5-84d7e9a5cd12 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:43.868049 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f3a4e96b-5452-426c-9ac5-84d7e9a5cd12 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:43.868866 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f3a4e96b-5452-426c-9ac5-84d7e9a5cd12 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:44.637992 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f3a4e96b-5452-426c-9ac5-84d7e9a5cd12 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:44.648740 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f3a4e96b-5452-426c-9ac5-84d7e9a5cd12 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/af46589b-8af1-4394-86e3-631c7d483a12" status: 200 len: 1514 microversion: 2.1 time: 0.826825 Oct 04 18:42:44.649686 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1770/3579] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:43 2022] GET /compute/v2.1/servers/af46589b-8af1-4394-86e3-631c7d483a12 => generated 1514 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:44.668024 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-9b98a45b-98db-44fb-b842-4a6bb65cda6d req-71269923-4a15-4bd1-a814-9468911d5c23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e245e3c8-b2eb-4f0f-8dec-c7bc290bd356", "name": "network-vif-deleted", "tag": "de5db3a4-1f99-4a92-a78e-f59449b5343b"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:44.684280 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-9b98a45b-98db-44fb-b842-4a6bb65cda6d req-71269923-4a15-4bd1-a814-9468911d5c23 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:44.684280 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-9b98a45b-98db-44fb-b842-4a6bb65cda6d req-71269923-4a15-4bd1-a814-9468911d5c23 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:44.684280 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-9b98a45b-98db-44fb-b842-4a6bb65cda6d req-71269923-4a15-4bd1-a814-9468911d5c23 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:44.694028 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-9b98a45b-98db-44fb-b842-4a6bb65cda6d req-71269923-4a15-4bd1-a814-9468911d5c23 service nova] Creating event network-vif-deleted:de5db3a4-1f99-4a92-a78e-f59449b5343b for instance e245e3c8-b2eb-4f0f-8dec-c7bc290bd356 on n-h2-850501-14 Oct 04 18:42:44.700193 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-9b98a45b-98db-44fb-b842-4a6bb65cda6d req-71269923-4a15-4bd1-a814-9468911d5c23 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049133 Oct 04 18:42:44.700974 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1771/3580] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:42:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:42:44.710014 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-795c553a-f86a-4780-9751-ed15589d4944 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:44.710014 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-795c553a-f86a-4780-9751-ed15589d4944 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] [instance: e245e3c8-b2eb-4f0f-8dec-c7bc290bd356] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:44.715721 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-795c553a-f86a-4780-9751-ed15589d4944 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:44.716566 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-795c553a-f86a-4780-9751-ed15589d4944 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:44.717233 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-795c553a-f86a-4780-9751-ed15589d4944 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:44.718147 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-795c553a-f86a-4780-9751-ed15589d4944 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:44.718829 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-795c553a-f86a-4780-9751-ed15589d4944 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:44.719485 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-795c553a-f86a-4780-9751-ed15589d4944 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:44.746246 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-c4b9ea74-746a-4e32-a56d-df28c251842e tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:42:44.749241 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-c4b9ea74-746a-4e32-a56d-df28c251842e tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:42:44.749241 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-c4b9ea74-746a-4e32-a56d-df28c251842e tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:42:44.749241 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-c4b9ea74-746a-4e32-a56d-df28c251842e tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:42:44.750275 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-c4b9ea74-746a-4e32-a56d-df28c251842e tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:42:44.774517 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-795c553a-f86a-4780-9751-ed15589d4944 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:44.775102 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-795c553a-f86a-4780-9751-ed15589d4944 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:44.775579 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c4b9ea74-746a-4e32-a56d-df28c251842e tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:44.775703 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-795c553a-f86a-4780-9751-ed15589d4944 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:44.784263 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c4b9ea74-746a-4e32-a56d-df28c251842e tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:44.784996 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-795c553a-f86a-4780-9751-ed15589d4944 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lazy-loading 'fault' on Instance uuid e245e3c8-b2eb-4f0f-8dec-c7bc290bd356 {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:42:44.785114 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c4b9ea74-746a-4e32-a56d-df28c251842e tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:44.785114 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c4b9ea74-746a-4e32-a56d-df28c251842e tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:44.785114 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c4b9ea74-746a-4e32-a56d-df28c251842e tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:44.785114 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c4b9ea74-746a-4e32-a56d-df28c251842e tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:44.807141 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-c4b9ea74-746a-4e32-a56d-df28c251842e tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Getting quotas for project 8596483de9f14de9a88cdb787841fd3c. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:42:44.813684 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-c4b9ea74-746a-4e32-a56d-df28c251842e tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Getting quotas for user 9e8d2814c23a4aa9806d56ce99c89e57 and project 8596483de9f14de9a88cdb787841fd3c. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:42:44.828925 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c4b9ea74-746a-4e32-a56d-df28c251842e tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Going to run 1 instances... {{(pid=123001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:42:44.832522 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c4b9ea74-746a-4e32-a56d-df28c251842e tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] [instance: 6905c432-0fb3-4f5a-84bb-0ffcb08e2b3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:42:44.853827 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-795c553a-f86a-4780-9751-ed15589d4944 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '777a7a51e45b498597f7a1202217575c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b43fba16115404aaa793fb907fd257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:44.869488 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-795c553a-f86a-4780-9751-ed15589d4944 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] 10.222.0.20 "GET /compute/v2.1/servers/e245e3c8-b2eb-4f0f-8dec-c7bc290bd356" status: 200 len: 1305 microversion: 2.1 time: 0.167000 Oct 04 18:42:44.870420 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1772/3581] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:44 2022] GET /compute/v2.1/servers/e245e3c8-b2eb-4f0f-8dec-c7bc290bd356 => generated 1305 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:44.885796 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e450ea0e-2dc0-4293-add1-dbaab809a8fe tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:44.886478 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e450ea0e-2dc0-4293-add1-dbaab809a8fe tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 6dc7155a-e90b-4ca9-8778-02bf31eff4bd] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:44.899224 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e450ea0e-2dc0-4293-add1-dbaab809a8fe tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:44.900047 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e450ea0e-2dc0-4293-add1-dbaab809a8fe tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:44.900752 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e450ea0e-2dc0-4293-add1-dbaab809a8fe tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:44.901910 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e450ea0e-2dc0-4293-add1-dbaab809a8fe tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:44.902458 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e450ea0e-2dc0-4293-add1-dbaab809a8fe tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:44.903043 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e450ea0e-2dc0-4293-add1-dbaab809a8fe tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:45.061033 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c4b9ea74-746a-4e32-a56d-df28c251842e tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.422885 Oct 04 18:42:45.062269 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1810/3582] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:42:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1425 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:42:45.069930 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-3a7b9f0d-8b30-4f48-9ebe-07137ed532bb req-83fdd614-6074-4b1a-bdfc-d9fc83982000 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dc7155a-e90b-4ca9-8778-02bf31eff4bd", "tag": "9bc5f07a-266e-4414-b9fe-5cff3fe5fca9"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:45.082797 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-3a7b9f0d-8b30-4f48-9ebe-07137ed532bb req-83fdd614-6074-4b1a-bdfc-d9fc83982000 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:45.083292 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-3a7b9f0d-8b30-4f48-9ebe-07137ed532bb req-83fdd614-6074-4b1a-bdfc-d9fc83982000 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:45.083787 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-3a7b9f0d-8b30-4f48-9ebe-07137ed532bb req-83fdd614-6074-4b1a-bdfc-d9fc83982000 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:45.100331 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-3a7b9f0d-8b30-4f48-9ebe-07137ed532bb req-83fdd614-6074-4b1a-bdfc-d9fc83982000 service nova] Creating event network-changed:9bc5f07a-266e-4414-b9fe-5cff3fe5fca9 for instance 6dc7155a-e90b-4ca9-8778-02bf31eff4bd on n-h1-850501-14 Oct 04 18:42:45.117039 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-3a7b9f0d-8b30-4f48-9ebe-07137ed532bb req-83fdd614-6074-4b1a-bdfc-d9fc83982000 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052255 Oct 04 18:42:45.118067 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1811/3583] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:42:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:42:45.288295 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e450ea0e-2dc0-4293-add1-dbaab809a8fe tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:45.292695 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1f821703-7cb4-4782-bf36-01e2d91c54e6 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-6440898", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:45.302543 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e450ea0e-2dc0-4293-add1-dbaab809a8fe tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/6dc7155a-e90b-4ca9-8778-02bf31eff4bd" status: 200 len: 1329 microversion: 2.1 time: 0.431017 Oct 04 18:42:45.303165 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1773/3584] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:44 2022] GET /compute/v2.1/servers/6dc7155a-e90b-4ca9-8778-02bf31eff4bd => generated 1329 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:45.393298 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.neutron [None req-1f821703-7cb4-4782-bf36-01e2d91c54e6 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] validate_networks() for None {{(pid=123001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:42:45.757767 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-808abe53-e637-4668-9351-4d50cd60e5d0 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:45.758714 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-808abe53-e637-4668-9351-4d50cd60e5d0 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] [instance: 3d3cabc2-fa23-4098-9197-9aaa19a0c663] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:45.770001 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-808abe53-e637-4668-9351-4d50cd60e5d0 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:45.774813 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-808abe53-e637-4668-9351-4d50cd60e5d0 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:45.775809 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-808abe53-e637-4668-9351-4d50cd60e5d0 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:45.776789 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-808abe53-e637-4668-9351-4d50cd60e5d0 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:45.778187 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-808abe53-e637-4668-9351-4d50cd60e5d0 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:45.779620 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-808abe53-e637-4668-9351-4d50cd60e5d0 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:46.553029 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-808abe53-e637-4668-9351-4d50cd60e5d0 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:46.566355 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-808abe53-e637-4668-9351-4d50cd60e5d0 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:46.572324 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-808abe53-e637-4668-9351-4d50cd60e5d0 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:46.573678 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-808abe53-e637-4668-9351-4d50cd60e5d0 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] 10.222.0.20 "GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663" status: 200 len: 2942 microversion: 2.42 time: 0.820611 Oct 04 18:42:46.577523 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1774/3585] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:42:45 2022] GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663 => generated 2942 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:42:46.579036 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8935dd25-95f3-4cec-836b-60fe1ba77d9c tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:46.580352 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8935dd25-95f3-4cec-836b-60fe1ba77d9c tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] [instance: e245e3c8-b2eb-4f0f-8dec-c7bc290bd356] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:46.586663 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8935dd25-95f3-4cec-836b-60fe1ba77d9c tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:46.587159 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8935dd25-95f3-4cec-836b-60fe1ba77d9c tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:46.587594 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8935dd25-95f3-4cec-836b-60fe1ba77d9c tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:46.589594 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8935dd25-95f3-4cec-836b-60fe1ba77d9c tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:46.591663 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8935dd25-95f3-4cec-836b-60fe1ba77d9c tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:46.593045 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8935dd25-95f3-4cec-836b-60fe1ba77d9c tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:46.611976 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-1f821703-7cb4-4782-bf36-01e2d91c54e6 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:42:46.611976 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-1f821703-7cb4-4782-bf36-01e2d91c54e6 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:42:46.611976 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-1f821703-7cb4-4782-bf36-01e2d91c54e6 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:42:46.611976 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-1f821703-7cb4-4782-bf36-01e2d91c54e6 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:42:46.612872 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-1f821703-7cb4-4782-bf36-01e2d91c54e6 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:42:46.615658 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-8935dd25-95f3-4cec-836b-60fe1ba77d9c tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] HTTP exception thrown: Instance e245e3c8-b2eb-4f0f-8dec-c7bc290bd356 could not be found. Oct 04 18:42:46.625795 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8935dd25-95f3-4cec-836b-60fe1ba77d9c tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Request method failure captured: Oct 04 18:42:46.625795 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/e245e3c8-b2eb-4f0f-8dec-c7bc290bd356 HTTP/1.1 Oct 04 18:42:46.625795 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:42:46.625795 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:42:46.625795 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:42:46.625795 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:42:46.625795 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:42:46.625795 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:42:46.625795 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:42:46.625795 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:42:46.625795 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH5IaH15tr5SVoVt4hozZEg3Js8ZWcVBx0oRn243qNZFUMSmPeMa3Gyq91gLee0lw2Klv1E5mNTaxmJJRYhRawPEzSfr-EeZwa66fdrMa4-gu9mqAey6rHA1ZnVCWU_BX1Hua5XpKyhleXrqcIVEtamRhatLhfvMeiTTjEHkZqIKSBQ Oct 04 18:42:46.625795 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:42:46.625795 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:42:46.625795 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:42:46.625795 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:42:46.625795 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:42:46.625795 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:42:46.625795 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 1b43fba16115404aaa793fb907fd257f Oct 04 18:42:46.625795 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-SecurityGroupsTestJSON-752173812 Oct 04 18:42:46.625795 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:42:46.625795 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:42:46.625795 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1b43fba16115404aaa793fb907fd257f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1b43fba16115404aaa793fb907fd257f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1b43fba16115404aaa793fb907fd257f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1b43fba16115404aaa793fb907fd257f"}]}] Oct 04 18:42:46.625795 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-SecurityGroupsTestJSON-752173812 Oct 04 18:42:46.625795 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 1b43fba16115404aaa793fb907fd257f Oct 04 18:42:46.625795 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-752173812 Oct 04 18:42:46.625795 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-SecurityGroupsTestJSON-752173812-project Oct 04 18:42:46.625795 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:42:46.625795 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:42:46.625795 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 777a7a51e45b498597f7a1202217575c Oct 04 18:42:46.625795 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-SecurityGroupsTestJSON-752173812-project Oct 04 18:42:46.625795 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:42:46.625795 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance e245e3c8-b2eb-4f0f-8dec-c7bc290bd356 could not be found. Oct 04 18:42:46.625795 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'e245e3c8-b2eb-4f0f-8dec-c7bc290bd356'} Oct 04 18:42:46.625795 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:42:46.625795 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:46.625795 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:42:46.625795 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:42:46.625795 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:42:46.625795 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:42:46.625795 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:42:46.625795 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:42:46.625795 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:42:46.625795 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:42:46.625795 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e245e3c8-b2eb-4f0f-8dec-c7bc290bd356 could not be found. Oct 04 18:42:46.625795 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:46.625795 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:42:46.625795 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:46.625795 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:46.625795 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:42:46.625795 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:42:46.625795 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:42:46.625795 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:42:46.625795 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:42:46.625795 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:42:46.625795 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:42:46.625795 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:42:46.625795 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:42:46.625795 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:42:46.625795 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:42:46.625795 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:42:46.625795 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e245e3c8-b2eb-4f0f-8dec-c7bc290bd356 could not be found. Oct 04 18:42:46.625795 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:46.625795 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:42:46.625795 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:46.631821 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:46.631821 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:42:46.631821 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:42:46.631821 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:42:46.631821 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:42:46.631821 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e245e3c8-b2eb-4f0f-8dec-c7bc290bd356 could not be found. Oct 04 18:42:46.631821 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:46.632394 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1f821703-7cb4-4782-bf36-01e2d91c54e6 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:46.632394 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1f821703-7cb4-4782-bf36-01e2d91c54e6 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:46.632394 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1f821703-7cb4-4782-bf36-01e2d91c54e6 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:46.632394 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1f821703-7cb4-4782-bf36-01e2d91c54e6 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:46.632394 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1f821703-7cb4-4782-bf36-01e2d91c54e6 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:46.632394 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1f821703-7cb4-4782-bf36-01e2d91c54e6 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:46.637923 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8935dd25-95f3-4cec-836b-60fe1ba77d9c tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Returning 404 to user: Instance e245e3c8-b2eb-4f0f-8dec-c7bc290bd356 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:42:46.639084 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8935dd25-95f3-4cec-836b-60fe1ba77d9c tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] 10.222.0.20 "GET /compute/v2.1/servers/e245e3c8-b2eb-4f0f-8dec-c7bc290bd356" status: 404 len: 111 microversion: 2.1 time: 0.063898 Oct 04 18:42:46.640841 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1775/3586] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:46 2022] GET /compute/v2.1/servers/e245e3c8-b2eb-4f0f-8dec-c7bc290bd356 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:42:46.648298 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-093b2292-c3c9-4aef-a7bb-07fbe2b79074 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:46.649179 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-093b2292-c3c9-4aef-a7bb-07fbe2b79074 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 6dc7155a-e90b-4ca9-8778-02bf31eff4bd] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:46.654131 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-1f821703-7cb4-4782-bf36-01e2d91c54e6 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Getting quotas for project 8596483de9f14de9a88cdb787841fd3c. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:42:46.661885 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-093b2292-c3c9-4aef-a7bb-07fbe2b79074 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:46.662464 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-093b2292-c3c9-4aef-a7bb-07fbe2b79074 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:46.662910 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-093b2292-c3c9-4aef-a7bb-07fbe2b79074 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:46.665096 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-1f821703-7cb4-4782-bf36-01e2d91c54e6 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Getting quotas for user 9e8d2814c23a4aa9806d56ce99c89e57 and project 8596483de9f14de9a88cdb787841fd3c. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:42:46.665239 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-093b2292-c3c9-4aef-a7bb-07fbe2b79074 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:46.665446 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-093b2292-c3c9-4aef-a7bb-07fbe2b79074 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:46.665888 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-093b2292-c3c9-4aef-a7bb-07fbe2b79074 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:46.691379 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1f821703-7cb4-4782-bf36-01e2d91c54e6 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Going to run 1 instances... {{(pid=123001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:42:46.711149 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1f821703-7cb4-4782-bf36-01e2d91c54e6 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] [instance: 471125af-1ec3-44b3-bb69-36b04a03fdd5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:42:46.957935 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-093b2292-c3c9-4aef-a7bb-07fbe2b79074 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:46.972656 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-093b2292-c3c9-4aef-a7bb-07fbe2b79074 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/6dc7155a-e90b-4ca9-8778-02bf31eff4bd" status: 200 len: 1329 microversion: 2.1 time: 0.329783 Oct 04 18:42:46.980415 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1776/3587] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:46 2022] GET /compute/v2.1/servers/6dc7155a-e90b-4ca9-8778-02bf31eff4bd => generated 1329 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:46.980415 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-28e615a9-1575-4306-b9c2-51363b4fb413 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:46.980415 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-28e615a9-1575-4306-b9c2-51363b4fb413 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] [instance: 3d3cabc2-fa23-4098-9197-9aaa19a0c663] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:46.997325 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-28e615a9-1575-4306-b9c2-51363b4fb413 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:46.998074 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-28e615a9-1575-4306-b9c2-51363b4fb413 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:46.998694 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-28e615a9-1575-4306-b9c2-51363b4fb413 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:46.999592 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-28e615a9-1575-4306-b9c2-51363b4fb413 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:47.000245 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-28e615a9-1575-4306-b9c2-51363b4fb413 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:47.000473 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1f821703-7cb4-4782-bf36-01e2d91c54e6 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.722707 Oct 04 18:42:47.001030 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-28e615a9-1575-4306-b9c2-51363b4fb413 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:47.005566 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1812/3588] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:42:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1733 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:42:47.020366 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-89c255e0-0e49-4e7e-9d6e-090d37ce9f9a tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Calling method '.version_select at 0x7fe25911e160>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:47.209395 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-28e615a9-1575-4306-b9c2-51363b4fb413 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] 10.222.0.20 "GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.234802 Oct 04 18:42:47.210911 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1777/3589] 10.222.0.20 () {60 vars in 1316 bytes} [Tue Oct 4 18:42:46 2022] GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663/os-interface => generated 1830 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:42:47.217724 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-468ecb86-d0c0-4dc6-a3d6-a49a5dcca2e1 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:47.218901 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-468ecb86-d0c0-4dc6-a3d6-a49a5dcca2e1 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] [instance: 471125af-1ec3-44b3-bb69-36b04a03fdd5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:47.354563 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-468ecb86-d0c0-4dc6-a3d6-a49a5dcca2e1 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8d2814c23a4aa9806d56ce99c89e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8596483de9f14de9a88cdb787841fd3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:47.358686 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-468ecb86-d0c0-4dc6-a3d6-a49a5dcca2e1 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/servers/471125af-1ec3-44b3-bb69-36b04a03fdd5" status: 200 len: 1215 microversion: 2.1 time: 0.146474 Oct 04 18:42:47.359811 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1778/3590] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:47 2022] GET /compute/v2.1/servers/471125af-1ec3-44b3-bb69-36b04a03fdd5 => generated 1215 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:47.365981 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-885f1457-8784-46e1-8aea-513d9f160329 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-74308870", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": [{"uuid": "33e34336-0572-4bd5-9655-75f9cdb067ea"}], "security_groups": [{"name": "tempest-securitygroup--1648847128"}], "key_name": "tempest-keypair-48070174", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:47.515810 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-89c255e0-0e49-4e7e-9d6e-090d37ce9f9a tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/ae97ac67-b778-4af4-8d61-0e3c1acb10ce" status: 202 len: 0 microversion: 2.1 time: 0.506213 Oct 04 18:42:47.517624 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1813/3591] 10.222.0.20 () {58 vars in 1272 bytes} [Tue Oct 4 18:42:47 2022] DELETE /compute/v2.1/os-security-groups/ae97ac67-b778-4af4-8d61-0e3c1acb10ce => generated 0 bytes in 510 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:42:47.531249 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2f3df4ab-c71a-49e5-8a59-b05ef54cc280 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Calling method '.version_select at 0x7fe2590f4280>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:47.549288 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-885f1457-8784-46e1-8aea-513d9f160329 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] validate_networks() for [('33e34336-0572-4bd5-9655-75f9cdb067ea', None, None, None, None, None)] {{(pid=123002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:42:48.691007 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-885f1457-8784-46e1-8aea-513d9f160329 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:42:48.692529 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-885f1457-8784-46e1-8aea-513d9f160329 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:42:48.693029 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-885f1457-8784-46e1-8aea-513d9f160329 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:42:48.693637 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-885f1457-8784-46e1-8aea-513d9f160329 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:42:48.694232 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-885f1457-8784-46e1-8aea-513d9f160329 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:42:48.703857 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-885f1457-8784-46e1-8aea-513d9f160329 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:48.705536 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-885f1457-8784-46e1-8aea-513d9f160329 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:48.706206 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-885f1457-8784-46e1-8aea-513d9f160329 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:48.706965 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-885f1457-8784-46e1-8aea-513d9f160329 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:48.707428 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-885f1457-8784-46e1-8aea-513d9f160329 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:48.707852 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-885f1457-8784-46e1-8aea-513d9f160329 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:48.734538 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-885f1457-8784-46e1-8aea-513d9f160329 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Getting quotas for project 7c0b095138354810949093e7ea03b8bf. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:42:48.743188 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-885f1457-8784-46e1-8aea-513d9f160329 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Getting quotas for user 0a02cd1108b947b186202f6d15e6cf0e and project 7c0b095138354810949093e7ea03b8bf. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:42:48.758900 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-885f1457-8784-46e1-8aea-513d9f160329 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Going to run 1 instances... {{(pid=123002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:42:48.761515 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-885f1457-8784-46e1-8aea-513d9f160329 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] [instance: 6cc94ec4-3e28-41e0-808e-9cd2263bca7d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:42:48.765253 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2f3df4ab-c71a-49e5-8a59-b05ef54cc280 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/e844db73-1f78-41b1-bfff-a04e58f82fc1" status: 202 len: 0 microversion: 2.1 time: 1.243209 Oct 04 18:42:48.766813 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1814/3592] 10.222.0.20 () {58 vars in 1272 bytes} [Tue Oct 4 18:42:47 2022] DELETE /compute/v2.1/os-security-groups/e844db73-1f78-41b1-bfff-a04e58f82fc1 => generated 0 bytes in 1245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:42:48.773152 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-10a3a070-cdb9-4737-8a9f-9adb11a064f1 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:48.776822 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-10a3a070-cdb9-4737-8a9f-9adb11a064f1 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: af46589b-8af1-4394-86e3-631c7d483a12] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:48.785220 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-10a3a070-cdb9-4737-8a9f-9adb11a064f1 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:48.786029 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-10a3a070-cdb9-4737-8a9f-9adb11a064f1 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:48.786840 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-10a3a070-cdb9-4737-8a9f-9adb11a064f1 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:48.787925 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-10a3a070-cdb9-4737-8a9f-9adb11a064f1 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:48.788800 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-10a3a070-cdb9-4737-8a9f-9adb11a064f1 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:48.789441 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-10a3a070-cdb9-4737-8a9f-9adb11a064f1 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:48.833001 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-10a3a070-cdb9-4737-8a9f-9adb11a064f1 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lazy-loading 'flavor' on Instance uuid af46589b-8af1-4394-86e3-631c7d483a12 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:42:49.010799 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-885f1457-8784-46e1-8aea-513d9f160329 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.649589 Oct 04 18:42:49.011907 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1779/3593] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:42:47 2022] POST /compute/v2.1/servers => generated 406 bytes in 1651 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:42:49.018249 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-42294625-03e2-4ecb-b368-bf3974f03f7a tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:49.019107 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-42294625-03e2-4ecb-b368-bf3974f03f7a tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 6dc7155a-e90b-4ca9-8778-02bf31eff4bd] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:49.026417 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-42294625-03e2-4ecb-b368-bf3974f03f7a tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:49.027096 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-42294625-03e2-4ecb-b368-bf3974f03f7a tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:49.032161 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-42294625-03e2-4ecb-b368-bf3974f03f7a tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:49.033136 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-42294625-03e2-4ecb-b368-bf3974f03f7a tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:49.034401 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-42294625-03e2-4ecb-b368-bf3974f03f7a tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:49.034847 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-42294625-03e2-4ecb-b368-bf3974f03f7a tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:49.300377 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-10a3a070-cdb9-4737-8a9f-9adb11a064f1 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "POST /compute/v2.1/servers/af46589b-8af1-4394-86e3-631c7d483a12/action" status: 200 len: 32 microversion: 2.1 time: 0.531343 Oct 04 18:42:49.312312 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1815/3594] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:42:48 2022] POST /compute/v2.1/servers/af46589b-8af1-4394-86e3-631c7d483a12/action => generated 32 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:42:49.334637 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-02acd35a-6d28-45d5-8519-3c870f180b02 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:49.336202 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-02acd35a-6d28-45d5-8519-3c870f180b02 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] [instance: 471125af-1ec3-44b3-bb69-36b04a03fdd5] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:49.351780 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-02acd35a-6d28-45d5-8519-3c870f180b02 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:49.352836 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-02acd35a-6d28-45d5-8519-3c870f180b02 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:49.353531 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-02acd35a-6d28-45d5-8519-3c870f180b02 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:49.354581 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-02acd35a-6d28-45d5-8519-3c870f180b02 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:49.355264 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-02acd35a-6d28-45d5-8519-3c870f180b02 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:49.356342 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-02acd35a-6d28-45d5-8519-3c870f180b02 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:49.416536 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-42294625-03e2-4ecb-b368-bf3974f03f7a tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:49.429148 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-42294625-03e2-4ecb-b368-bf3974f03f7a tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/6dc7155a-e90b-4ca9-8778-02bf31eff4bd" status: 200 len: 1329 microversion: 2.1 time: 0.412817 Oct 04 18:42:49.431774 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1780/3595] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:49 2022] GET /compute/v2.1/servers/6dc7155a-e90b-4ca9-8778-02bf31eff4bd => generated 1329 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:49.442354 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-fb6c4288-ba78-4f14-8fed-af09bcd8b02b tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Action: 'create', calling method: .version_select at 0x7fe253fd0a60>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1852874450", "description": "tempest-description-507440760"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:49.506408 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-02acd35a-6d28-45d5-8519-3c870f180b02 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8d2814c23a4aa9806d56ce99c89e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8596483de9f14de9a88cdb787841fd3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:49.536800 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-02acd35a-6d28-45d5-8519-3c870f180b02 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/servers/471125af-1ec3-44b3-bb69-36b04a03fdd5" status: 200 len: 1211 microversion: 2.1 time: 0.221740 Oct 04 18:42:49.537837 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1816/3596] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:49 2022] GET /compute/v2.1/servers/471125af-1ec3-44b3-bb69-36b04a03fdd5 => generated 1211 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:49.552581 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5e27352d-3c6d-46f1-9924-17835731c3d2 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:49.555627 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5e27352d-3c6d-46f1-9924-17835731c3d2 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] [instance: 6cc94ec4-3e28-41e0-808e-9cd2263bca7d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:49.678054 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5e27352d-3c6d-46f1-9924-17835731c3d2 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a02cd1108b947b186202f6d15e6cf0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c0b095138354810949093e7ea03b8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:49.690905 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5e27352d-3c6d-46f1-9924-17835731c3d2 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] 10.222.0.20 "GET /compute/v2.1/servers/6cc94ec4-3e28-41e0-808e-9cd2263bca7d" status: 200 len: 1238 microversion: 2.1 time: 0.148252 Oct 04 18:42:49.693498 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1817/3597] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:49 2022] GET /compute/v2.1/servers/6cc94ec4-3e28-41e0-808e-9cd2263bca7d => generated 1238 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:49.710897 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-df201bc6-e083-47d7-9f2f-87af6cb94b28 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:49.713859 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-df201bc6-e083-47d7-9f2f-87af6cb94b28 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: af46589b-8af1-4394-86e3-631c7d483a12] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:49.752204 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-df201bc6-e083-47d7-9f2f-87af6cb94b28 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:49.754341 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-df201bc6-e083-47d7-9f2f-87af6cb94b28 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:49.754810 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-df201bc6-e083-47d7-9f2f-87af6cb94b28 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:49.755558 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-df201bc6-e083-47d7-9f2f-87af6cb94b28 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:49.763420 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-df201bc6-e083-47d7-9f2f-87af6cb94b28 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:49.765023 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-df201bc6-e083-47d7-9f2f-87af6cb94b28 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:50.088888 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-fb6c4288-ba78-4f14-8fed-af09bcd8b02b tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.655803 Oct 04 18:42:50.089497 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1781/3598] 10.222.0.20 () {60 vars in 1180 bytes} [Tue Oct 4 18:42:49 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:42:50.104525 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2daee7f7-c891-4e31-9933-f9baeb448819 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Action: 'update', calling method: .version_select at 0x7fe259812160>, body: {"security_group": {"name": "tempest-sg-hth-1317230251", "description": "tempest-description-hth-296394093"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:50.520305 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-df201bc6-e083-47d7-9f2f-87af6cb94b28 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:50.529779 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-df201bc6-e083-47d7-9f2f-87af6cb94b28 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/af46589b-8af1-4394-86e3-631c7d483a12" status: 200 len: 1520 microversion: 2.1 time: 0.832545 Oct 04 18:42:50.540894 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1818/3599] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:49 2022] GET /compute/v2.1/servers/af46589b-8af1-4394-86e3-631c7d483a12 => generated 1520 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:50.546046 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2879d09d-77d8-499b-9949-389ee600dbf8 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:50.546827 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2879d09d-77d8-499b-9949-389ee600dbf8 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 6dc7155a-e90b-4ca9-8778-02bf31eff4bd] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:50.555899 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2879d09d-77d8-499b-9949-389ee600dbf8 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:50.555899 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2879d09d-77d8-499b-9949-389ee600dbf8 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:50.555899 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2879d09d-77d8-499b-9949-389ee600dbf8 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:50.557135 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2879d09d-77d8-499b-9949-389ee600dbf8 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:50.557820 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2879d09d-77d8-499b-9949-389ee600dbf8 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:50.558462 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2879d09d-77d8-499b-9949-389ee600dbf8 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:50.922097 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-2879d09d-77d8-499b-9949-389ee600dbf8 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:50.941281 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2879d09d-77d8-499b-9949-389ee600dbf8 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/6dc7155a-e90b-4ca9-8778-02bf31eff4bd" status: 200 len: 1329 microversion: 2.1 time: 0.398269 Oct 04 18:42:50.956089 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1819/3600] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:50 2022] GET /compute/v2.1/servers/6dc7155a-e90b-4ca9-8778-02bf31eff4bd => generated 1329 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:50.956089 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f6d813d2-27b4-470f-8226-c5b6982a85f4 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:50.956731 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f6d813d2-27b4-470f-8226-c5b6982a85f4 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] [instance: 471125af-1ec3-44b3-bb69-36b04a03fdd5] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:50.967993 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f6d813d2-27b4-470f-8226-c5b6982a85f4 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:50.969349 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f6d813d2-27b4-470f-8226-c5b6982a85f4 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:50.970052 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f6d813d2-27b4-470f-8226-c5b6982a85f4 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:50.971619 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f6d813d2-27b4-470f-8226-c5b6982a85f4 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:50.973207 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f6d813d2-27b4-470f-8226-c5b6982a85f4 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:50.973922 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f6d813d2-27b4-470f-8226-c5b6982a85f4 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:51.171620 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f6d813d2-27b4-470f-8226-c5b6982a85f4 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8d2814c23a4aa9806d56ce99c89e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8596483de9f14de9a88cdb787841fd3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:51.198451 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f6d813d2-27b4-470f-8226-c5b6982a85f4 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/servers/471125af-1ec3-44b3-bb69-36b04a03fdd5" status: 200 len: 1273 microversion: 2.1 time: 0.249866 Oct 04 18:42:51.204138 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1820/3601] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:50 2022] GET /compute/v2.1/servers/471125af-1ec3-44b3-bb69-36b04a03fdd5 => generated 1273 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:51.214138 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ef8d05dc-c078-4653-a641-a29334fe6588 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:51.218143 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ef8d05dc-c078-4653-a641-a29334fe6588 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] [instance: 6cc94ec4-3e28-41e0-808e-9cd2263bca7d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:51.229886 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ef8d05dc-c078-4653-a641-a29334fe6588 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:51.230380 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ef8d05dc-c078-4653-a641-a29334fe6588 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:51.235183 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ef8d05dc-c078-4653-a641-a29334fe6588 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:51.235183 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ef8d05dc-c078-4653-a641-a29334fe6588 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:51.235183 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ef8d05dc-c078-4653-a641-a29334fe6588 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:51.235183 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ef8d05dc-c078-4653-a641-a29334fe6588 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:51.332886 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2daee7f7-c891-4e31-9933-f9baeb448819 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] 10.222.0.20 "PUT /compute/v2.1/os-security-groups/32505766-4a62-4585-bbe6-59a6ea4536f9" status: 200 len: 217 microversion: 2.1 time: 1.232300 Oct 04 18:42:51.334681 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1782/3602] 10.222.0.20 () {60 vars in 1290 bytes} [Tue Oct 4 18:42:50 2022] PUT /compute/v2.1/os-security-groups/32505766-4a62-4585-bbe6-59a6ea4536f9 => generated 217 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:42:51.359190 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-58f3e686-8a23-4472-8faf-cfac79e43bc4 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Calling method '.version_select at 0x7fe2588574c0>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:51.789622 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ef8d05dc-c078-4653-a641-a29334fe6588 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a02cd1108b947b186202f6d15e6cf0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c0b095138354810949093e7ea03b8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:51.799744 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ef8d05dc-c078-4653-a641-a29334fe6588 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] 10.222.0.20 "GET /compute/v2.1/servers/6cc94ec4-3e28-41e0-808e-9cd2263bca7d" status: 200 len: 1234 microversion: 2.1 time: 0.596530 Oct 04 18:42:51.819437 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1821/3603] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:51 2022] GET /compute/v2.1/servers/6cc94ec4-3e28-41e0-808e-9cd2263bca7d => generated 1234 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:51.831628 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ff3e6435-c8c9-49d0-b5ea-f986d7a4fe88 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:51.832332 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ff3e6435-c8c9-49d0-b5ea-f986d7a4fe88 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: af46589b-8af1-4394-86e3-631c7d483a12] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:51.843636 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ff3e6435-c8c9-49d0-b5ea-f986d7a4fe88 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:51.855005 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ff3e6435-c8c9-49d0-b5ea-f986d7a4fe88 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:51.855671 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ff3e6435-c8c9-49d0-b5ea-f986d7a4fe88 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:51.856612 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ff3e6435-c8c9-49d0-b5ea-f986d7a4fe88 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:51.857274 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ff3e6435-c8c9-49d0-b5ea-f986d7a4fe88 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:51.858061 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ff3e6435-c8c9-49d0-b5ea-f986d7a4fe88 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:51.918930 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-58f3e686-8a23-4472-8faf-cfac79e43bc4 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups/32505766-4a62-4585-bbe6-59a6ea4536f9" status: 200 len: 217 microversion: 2.1 time: 0.569543 Oct 04 18:42:51.930892 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1783/3604] 10.222.0.20 () {58 vars in 1269 bytes} [Tue Oct 4 18:42:51 2022] GET /compute/v2.1/os-security-groups/32505766-4a62-4585-bbe6-59a6ea4536f9 => generated 217 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:42:51.936829 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-25254458-70f8-4680-b239-bc9ec3d193d7 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Calling method '.version_select at 0x7fe25926edc0>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:52.508088 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ff3e6435-c8c9-49d0-b5ea-f986d7a4fe88 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:52.532834 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ff3e6435-c8c9-49d0-b5ea-f986d7a4fe88 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/af46589b-8af1-4394-86e3-631c7d483a12" status: 200 len: 1520 microversion: 2.1 time: 0.698019 Oct 04 18:42:52.532834 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1822/3605] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:51 2022] GET /compute/v2.1/servers/af46589b-8af1-4394-86e3-631c7d483a12 => generated 1520 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:52.538328 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b8eca6da-9757-4f41-9ddd-a083fb933441 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:52.539605 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b8eca6da-9757-4f41-9ddd-a083fb933441 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 6dc7155a-e90b-4ca9-8778-02bf31eff4bd] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:52.555912 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b8eca6da-9757-4f41-9ddd-a083fb933441 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:52.556655 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b8eca6da-9757-4f41-9ddd-a083fb933441 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:52.557259 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b8eca6da-9757-4f41-9ddd-a083fb933441 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:52.558137 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b8eca6da-9757-4f41-9ddd-a083fb933441 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:52.558758 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b8eca6da-9757-4f41-9ddd-a083fb933441 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:52.559349 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b8eca6da-9757-4f41-9ddd-a083fb933441 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:53.110278 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b8eca6da-9757-4f41-9ddd-a083fb933441 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:53.126659 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b8eca6da-9757-4f41-9ddd-a083fb933441 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/6dc7155a-e90b-4ca9-8778-02bf31eff4bd" status: 200 len: 1329 microversion: 2.1 time: 0.606147 Oct 04 18:42:53.134269 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1823/3606] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:52 2022] GET /compute/v2.1/servers/6dc7155a-e90b-4ca9-8778-02bf31eff4bd => generated 1329 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:53.137911 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7b1af3b7-3317-44c3-8a9e-024dbd8d2bc2 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:53.138743 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7b1af3b7-3317-44c3-8a9e-024dbd8d2bc2 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] [instance: 471125af-1ec3-44b3-bb69-36b04a03fdd5] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:53.159480 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7b1af3b7-3317-44c3-8a9e-024dbd8d2bc2 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:53.160382 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7b1af3b7-3317-44c3-8a9e-024dbd8d2bc2 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:53.161006 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7b1af3b7-3317-44c3-8a9e-024dbd8d2bc2 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:53.161994 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7b1af3b7-3317-44c3-8a9e-024dbd8d2bc2 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:53.162474 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7b1af3b7-3317-44c3-8a9e-024dbd8d2bc2 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:53.165549 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7b1af3b7-3317-44c3-8a9e-024dbd8d2bc2 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:53.340462 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7b1af3b7-3317-44c3-8a9e-024dbd8d2bc2 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8d2814c23a4aa9806d56ce99c89e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8596483de9f14de9a88cdb787841fd3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:53.352307 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7b1af3b7-3317-44c3-8a9e-024dbd8d2bc2 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/servers/471125af-1ec3-44b3-bb69-36b04a03fdd5" status: 200 len: 1273 microversion: 2.1 time: 0.220528 Oct 04 18:42:53.352980 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1824/3607] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:53 2022] GET /compute/v2.1/servers/471125af-1ec3-44b3-bb69-36b04a03fdd5 => generated 1273 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:53.364737 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-32419294-6e2d-4525-8c0f-bb072c20b74a req-85a289d8-7d61-4909-bfd2-9b7589d2e43e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dc7155a-e90b-4ca9-8778-02bf31eff4bd", "name": "network-vif-plugged", "status": "completed", "tag": "9bc5f07a-266e-4414-b9fe-5cff3fe5fca9"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:53.374210 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-25254458-70f8-4680-b239-bc9ec3d193d7 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/32505766-4a62-4585-bbe6-59a6ea4536f9" status: 202 len: 0 microversion: 2.1 time: 1.441871 Oct 04 18:42:53.386055 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1784/3608] 10.222.0.20 () {58 vars in 1272 bytes} [Tue Oct 4 18:42:51 2022] DELETE /compute/v2.1/os-security-groups/32505766-4a62-4585-bbe6-59a6ea4536f9 => generated 0 bytes in 1454 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:42:53.391554 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-32419294-6e2d-4525-8c0f-bb072c20b74a req-85a289d8-7d61-4909-bfd2-9b7589d2e43e service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:53.394064 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-32419294-6e2d-4525-8c0f-bb072c20b74a req-85a289d8-7d61-4909-bfd2-9b7589d2e43e service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:53.394852 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-32419294-6e2d-4525-8c0f-bb072c20b74a req-85a289d8-7d61-4909-bfd2-9b7589d2e43e service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:53.396821 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9e87954e-8ef1-4eb8-b0bb-3e2959812310 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:53.397715 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9e87954e-8ef1-4eb8-b0bb-3e2959812310 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] [instance: 6cc94ec4-3e28-41e0-808e-9cd2263bca7d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:53.404231 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9e87954e-8ef1-4eb8-b0bb-3e2959812310 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:53.404964 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9e87954e-8ef1-4eb8-b0bb-3e2959812310 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:53.405575 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9e87954e-8ef1-4eb8-b0bb-3e2959812310 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:53.406819 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9e87954e-8ef1-4eb8-b0bb-3e2959812310 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:53.407588 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9e87954e-8ef1-4eb8-b0bb-3e2959812310 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:53.408410 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9e87954e-8ef1-4eb8-b0bb-3e2959812310 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:53.443876 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-32419294-6e2d-4525-8c0f-bb072c20b74a req-85a289d8-7d61-4909-bfd2-9b7589d2e43e service nova] Creating event network-vif-plugged:9bc5f07a-266e-4414-b9fe-5cff3fe5fca9 for instance 6dc7155a-e90b-4ca9-8778-02bf31eff4bd on n-h1-850501-14 Oct 04 18:42:53.475912 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-32419294-6e2d-4525-8c0f-bb072c20b74a req-85a289d8-7d61-4909-bfd2-9b7589d2e43e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121545 Oct 04 18:42:53.477159 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1825/3609] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:42:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:42:53.482736 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8a81fee9-39ac-4de1-b11e-e1d6ca18707a tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:53.493077 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8a81fee9-39ac-4de1-b11e-e1d6ca18707a tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] [instance: e245e3c8-b2eb-4f0f-8dec-c7bc290bd356] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:53.520498 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8a81fee9-39ac-4de1-b11e-e1d6ca18707a tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:53.523125 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8a81fee9-39ac-4de1-b11e-e1d6ca18707a tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:53.523682 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8a81fee9-39ac-4de1-b11e-e1d6ca18707a tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:53.525727 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8a81fee9-39ac-4de1-b11e-e1d6ca18707a tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:53.533397 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8a81fee9-39ac-4de1-b11e-e1d6ca18707a tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:53.533397 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8a81fee9-39ac-4de1-b11e-e1d6ca18707a tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:53.556492 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-8a81fee9-39ac-4de1-b11e-e1d6ca18707a tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] HTTP exception thrown: Instance e245e3c8-b2eb-4f0f-8dec-c7bc290bd356 could not be found. Oct 04 18:42:53.562394 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8a81fee9-39ac-4de1-b11e-e1d6ca18707a tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Request method failure captured: Oct 04 18:42:53.562394 n-d-850501-14 devstack@n-api.service[123001]: request: DELETE /compute/v2.1/servers/e245e3c8-b2eb-4f0f-8dec-c7bc290bd356 HTTP/1.1 Oct 04 18:42:53.562394 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:42:53.562394 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:42:53.562394 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:42:53.562394 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:42:53.562394 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:42:53.562394 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:42:53.562394 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:42:53.562394 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:42:53.562394 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPH5IaH15tr5SVoVt4hozZEg3Js8ZWcVBx0oRn243qNZFUMSmPeMa3Gyq91gLee0lw2Klv1E5mNTaxmJJRYhRawPEzSfr-EeZwa66fdrMa4-gu9mqAey6rHA1ZnVCWU_BX1Hua5XpKyhleXrqcIVEtamRhatLhfvMeiTTjEHkZqIKSBQ Oct 04 18:42:53.562394 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:42:53.562394 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:42:53.562394 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:42:53.562394 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:42:53.562394 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:42:53.562394 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:42:53.562394 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 1b43fba16115404aaa793fb907fd257f Oct 04 18:42:53.562394 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-SecurityGroupsTestJSON-752173812 Oct 04 18:42:53.562394 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:42:53.562394 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:42:53.562394 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1b43fba16115404aaa793fb907fd257f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1b43fba16115404aaa793fb907fd257f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1b43fba16115404aaa793fb907fd257f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1b43fba16115404aaa793fb907fd257f"}]}] Oct 04 18:42:53.562394 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-SecurityGroupsTestJSON-752173812 Oct 04 18:42:53.562394 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 1b43fba16115404aaa793fb907fd257f Oct 04 18:42:53.562394 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-752173812 Oct 04 18:42:53.562394 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-SecurityGroupsTestJSON-752173812-project Oct 04 18:42:53.562394 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:42:53.562394 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:42:53.562394 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 777a7a51e45b498597f7a1202217575c Oct 04 18:42:53.562394 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-SecurityGroupsTestJSON-752173812-project Oct 04 18:42:53.562394 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:42:53.562394 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance e245e3c8-b2eb-4f0f-8dec-c7bc290bd356 could not be found. Oct 04 18:42:53.562394 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': 'e245e3c8-b2eb-4f0f-8dec-c7bc290bd356'} Oct 04 18:42:53.562394 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:42:53.562394 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:53.562394 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:42:53.562394 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:42:53.562394 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:42:53.562394 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:42:53.562394 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:42:53.562394 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:42:53.562394 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:42:53.562394 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:42:53.562394 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e245e3c8-b2eb-4f0f-8dec-c7bc290bd356 could not be found. Oct 04 18:42:53.562394 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:42:53.562394 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:42:53.562394 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:42:53.562394 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:53.562394 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:42:53.562394 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:42:53.562394 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:42:53.562394 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:42:53.562394 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:42:53.562394 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:42:53.562394 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:42:53.562394 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:42:53.562394 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:42:53.562394 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:42:53.562394 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:42:53.562394 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:42:53.562394 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:42:53.562394 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:42:53.568000 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e245e3c8-b2eb-4f0f-8dec-c7bc290bd356 could not be found. Oct 04 18:42:53.568000 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:42:53.568000 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:42:53.568000 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:42:53.568000 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:53.568000 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:42:53.568000 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:42:53.568000 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:42:53.568000 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:42:53.568000 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e245e3c8-b2eb-4f0f-8dec-c7bc290bd356 could not be found. Oct 04 18:42:53.568000 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:42:53.568000 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8a81fee9-39ac-4de1-b11e-e1d6ca18707a tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Returning 404 to user: Instance e245e3c8-b2eb-4f0f-8dec-c7bc290bd356 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:42:53.569924 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8a81fee9-39ac-4de1-b11e-e1d6ca18707a tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e245e3c8-b2eb-4f0f-8dec-c7bc290bd356" status: 404 len: 111 microversion: 2.1 time: 0.091146 Oct 04 18:42:53.570993 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1826/3610] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:42:53 2022] DELETE /compute/v2.1/servers/e245e3c8-b2eb-4f0f-8dec-c7bc290bd356 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:42:53.580106 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-549cc4fe-d85c-4649-903b-3095d7fd43f2 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:53.581034 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-549cc4fe-d85c-4649-903b-3095d7fd43f2 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: af46589b-8af1-4394-86e3-631c7d483a12] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:53.588887 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-549cc4fe-d85c-4649-903b-3095d7fd43f2 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:53.590078 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-549cc4fe-d85c-4649-903b-3095d7fd43f2 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:53.592821 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-549cc4fe-d85c-4649-903b-3095d7fd43f2 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:53.594097 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-549cc4fe-d85c-4649-903b-3095d7fd43f2 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:53.596088 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-549cc4fe-d85c-4649-903b-3095d7fd43f2 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:53.596867 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-549cc4fe-d85c-4649-903b-3095d7fd43f2 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:53.639766 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9e87954e-8ef1-4eb8-b0bb-3e2959812310 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a02cd1108b947b186202f6d15e6cf0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c0b095138354810949093e7ea03b8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:53.663514 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9e87954e-8ef1-4eb8-b0bb-3e2959812310 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] 10.222.0.20 "GET /compute/v2.1/servers/6cc94ec4-3e28-41e0-808e-9cd2263bca7d" status: 200 len: 1296 microversion: 2.1 time: 0.263346 Oct 04 18:42:53.668001 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1785/3611] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:53 2022] GET /compute/v2.1/servers/6cc94ec4-3e28-41e0-808e-9cd2263bca7d => generated 1296 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:53.676618 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c5a9a9f3-5f46-4b9b-94ca-a68e8bc62c10 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:53.686547 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c5a9a9f3-5f46-4b9b-94ca-a68e8bc62c10 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] [instance: e245e3c8-b2eb-4f0f-8dec-c7bc290bd356] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:53.700161 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c5a9a9f3-5f46-4b9b-94ca-a68e8bc62c10 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:53.702850 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c5a9a9f3-5f46-4b9b-94ca-a68e8bc62c10 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:53.704626 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c5a9a9f3-5f46-4b9b-94ca-a68e8bc62c10 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:53.705645 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c5a9a9f3-5f46-4b9b-94ca-a68e8bc62c10 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:53.710127 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c5a9a9f3-5f46-4b9b-94ca-a68e8bc62c10 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:53.712370 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c5a9a9f3-5f46-4b9b-94ca-a68e8bc62c10 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:53.734021 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:42:53.759130 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-c5a9a9f3-5f46-4b9b-94ca-a68e8bc62c10 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] HTTP exception thrown: Instance e245e3c8-b2eb-4f0f-8dec-c7bc290bd356 could not be found. Oct 04 18:42:53.761481 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c5a9a9f3-5f46-4b9b-94ca-a68e8bc62c10 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Request method failure captured: Oct 04 18:42:53.761481 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/e245e3c8-b2eb-4f0f-8dec-c7bc290bd356 HTTP/1.1 Oct 04 18:42:53.761481 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:42:53.761481 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:42:53.761481 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:42:53.761481 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:42:53.761481 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:42:53.761481 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:42:53.761481 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:42:53.761481 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:42:53.761481 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH5IaH15tr5SVoVt4hozZEg3Js8ZWcVBx0oRn243qNZFUMSmPeMa3Gyq91gLee0lw2Klv1E5mNTaxmJJRYhRawPEzSfr-EeZwa66fdrMa4-gu9mqAey6rHA1ZnVCWU_BX1Hua5XpKyhleXrqcIVEtamRhatLhfvMeiTTjEHkZqIKSBQ Oct 04 18:42:53.761481 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:42:53.761481 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:42:53.761481 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:42:53.761481 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:42:53.761481 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:42:53.761481 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:42:53.761481 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 1b43fba16115404aaa793fb907fd257f Oct 04 18:42:53.761481 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-SecurityGroupsTestJSON-752173812 Oct 04 18:42:53.761481 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:42:53.761481 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:42:53.761481 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1b43fba16115404aaa793fb907fd257f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1b43fba16115404aaa793fb907fd257f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1b43fba16115404aaa793fb907fd257f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1b43fba16115404aaa793fb907fd257f"}]}] Oct 04 18:42:53.761481 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-SecurityGroupsTestJSON-752173812 Oct 04 18:42:53.761481 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 1b43fba16115404aaa793fb907fd257f Oct 04 18:42:53.761481 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-752173812 Oct 04 18:42:53.761481 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-SecurityGroupsTestJSON-752173812-project Oct 04 18:42:53.761481 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:42:53.761481 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:42:53.761481 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 777a7a51e45b498597f7a1202217575c Oct 04 18:42:53.761481 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-SecurityGroupsTestJSON-752173812-project Oct 04 18:42:53.761481 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:42:53.761481 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance e245e3c8-b2eb-4f0f-8dec-c7bc290bd356 could not be found. Oct 04 18:42:53.761481 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'e245e3c8-b2eb-4f0f-8dec-c7bc290bd356'} Oct 04 18:42:53.761481 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:42:53.761481 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:53.761481 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:42:53.761481 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:42:53.761481 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:42:53.761481 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:42:53.761481 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:42:53.761481 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:42:53.761481 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:42:53.761481 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:42:53.761481 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e245e3c8-b2eb-4f0f-8dec-c7bc290bd356 could not be found. Oct 04 18:42:53.761481 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:53.761481 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:42:53.761481 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:53.761481 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:53.761481 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:42:53.761481 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:42:53.761481 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:42:53.761481 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:42:53.761481 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:42:53.761481 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:42:53.761481 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:42:53.761481 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:42:53.761481 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:42:53.761481 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:42:53.761481 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:42:53.761481 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:42:53.761481 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e245e3c8-b2eb-4f0f-8dec-c7bc290bd356 could not be found. Oct 04 18:42:53.761481 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:53.761481 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:42:53.761481 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:53.766867 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:53.766867 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:42:53.766867 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:42:53.766867 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:42:53.766867 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:42:53.766867 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e245e3c8-b2eb-4f0f-8dec-c7bc290bd356 could not be found. Oct 04 18:42:53.766867 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:53.766867 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c5a9a9f3-5f46-4b9b-94ca-a68e8bc62c10 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Returning 404 to user: Instance e245e3c8-b2eb-4f0f-8dec-c7bc290bd356 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:42:53.766867 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c5a9a9f3-5f46-4b9b-94ca-a68e8bc62c10 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] 10.222.0.20 "GET /compute/v2.1/servers/e245e3c8-b2eb-4f0f-8dec-c7bc290bd356" status: 404 len: 111 microversion: 2.1 time: 0.093749 Oct 04 18:42:53.766867 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1786/3612] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:53 2022] GET /compute/v2.1/servers/e245e3c8-b2eb-4f0f-8dec-c7bc290bd356 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:42:53.773416 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2c715f21-6019-4823-a010-94fc56c859c9 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Calling method '.version_select at 0x7fe258a8d820>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:53.869907 n-d-850501-14 devstack@n-api.service[123002]: DEBUG neutronclient.v2_0.client [None req-2c715f21-6019-4823-a010-94fc56c859c9 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e844db73-1f78-41b1-bfff-a04e58f82fc1 does not exist", "detail": ""}} {{(pid=123002) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:42:53.870819 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.security_group_api [None req-2c715f21-6019-4823-a010-94fc56c859c9 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Neutron security group e844db73-1f78-41b1-bfff-a04e58f82fc1 not found {{(pid=123002) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 18:42:53.871562 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-2c715f21-6019-4823-a010-94fc56c859c9 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] HTTP exception thrown: Security group e844db73-1f78-41b1-bfff-a04e58f82fc1 does not exist Oct 04 18:42:53.871562 n-d-850501-14 devstack@n-api.service[123002]: Neutron server returns request_ids: ['req-fe6d77a9-551e-4601-9a0c-9c9093dc9b97'] Oct 04 18:42:53.876457 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2c715f21-6019-4823-a010-94fc56c859c9 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Request method failure captured: Oct 04 18:42:53.876457 n-d-850501-14 devstack@n-api.service[123002]: request: DELETE /compute/v2.1/os-security-groups/e844db73-1f78-41b1-bfff-a04e58f82fc1 HTTP/1.1 Oct 04 18:42:53.876457 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:42:53.876457 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:42:53.876457 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:42:53.876457 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:42:53.876457 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:42:53.876457 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:42:53.876457 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:42:53.876457 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:42:53.876457 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH5IaH15tr5SVoVt4hozZEg3Js8ZWcVBx0oRn243qNZFUMSmPeMa3Gyq91gLee0lw2Klv1E5mNTaxmJJRYhRawPEzSfr-EeZwa66fdrMa4-gu9mqAey6rHA1ZnVCWU_BX1Hua5XpKyhleXrqcIVEtamRhatLhfvMeiTTjEHkZqIKSBQ Oct 04 18:42:53.876457 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:42:53.876457 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:42:53.876457 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:42:53.876457 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:42:53.876457 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:42:53.876457 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:42:53.876457 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 1b43fba16115404aaa793fb907fd257f Oct 04 18:42:53.876457 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-SecurityGroupsTestJSON-752173812 Oct 04 18:42:53.876457 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:42:53.876457 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:42:53.876457 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1b43fba16115404aaa793fb907fd257f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1b43fba16115404aaa793fb907fd257f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1b43fba16115404aaa793fb907fd257f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1b43fba16115404aaa793fb907fd257f"}]}] Oct 04 18:42:53.876457 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-SecurityGroupsTestJSON-752173812 Oct 04 18:42:53.876457 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 1b43fba16115404aaa793fb907fd257f Oct 04 18:42:53.876457 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-752173812 Oct 04 18:42:53.876457 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-SecurityGroupsTestJSON-752173812-project Oct 04 18:42:53.876457 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:42:53.876457 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:42:53.876457 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 777a7a51e45b498597f7a1202217575c Oct 04 18:42:53.876457 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-SecurityGroupsTestJSON-752173812-project Oct 04 18:42:53.876457 n-d-850501-14 devstack@n-api.service[123002]: method: Oct 04 18:42:53.876457 n-d-850501-14 devstack@n-api.service[123002]: exception: Security group e844db73-1f78-41b1-bfff-a04e58f82fc1 does not exist Oct 04 18:42:53.876457 n-d-850501-14 devstack@n-api.service[123002]: Neutron server returns request_ids: ['req-fe6d77a9-551e-4601-9a0c-9c9093dc9b97'] Oct 04 18:42:53.876457 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'e844db73-1f78-41b1-bfff-a04e58f82fc1'} Oct 04 18:42:53.876457 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:42:53.876457 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:53.876457 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 18:42:53.876457 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 18:42:53.876457 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:42:53.876457 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:42:53.876457 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 18:42:53.876457 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 18:42:53.876457 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:42:53.876457 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:42:53.876457 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:42:53.876457 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 18:42:53.876457 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:42:53.876457 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:42:53.876457 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:42:53.876457 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:42:53.876457 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:42:53.876457 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:42:53.876457 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:42:53.876457 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:42:53.876457 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:42:53.876457 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:42:53.876457 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:42:53.876457 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:42:53.876457 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:42:53.876457 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:42:53.876457 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e844db73-1f78-41b1-bfff-a04e58f82fc1 does not exist Oct 04 18:42:53.882186 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fe6d77a9-551e-4601-9a0c-9c9093dc9b97'] Oct 04 18:42:53.882186 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:53.882186 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:42:53.882186 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:53.882186 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:53.882186 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 04 18:42:53.882186 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 18:42:53.882186 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 18:42:53.882186 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 18:42:53.882186 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e844db73-1f78-41b1-bfff-a04e58f82fc1 does not exist Oct 04 18:42:53.882186 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fe6d77a9-551e-4601-9a0c-9c9093dc9b97'] Oct 04 18:42:53.882186 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:53.882186 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:42:53.882186 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:53.882186 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:53.882186 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:42:53.882186 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:42:53.882186 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:42:53.882186 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:42:53.882186 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:42:53.882186 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:42:53.882186 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:42:53.882186 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:42:53.882186 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 04 18:42:53.882186 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 18:42:53.882186 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e844db73-1f78-41b1-bfff-a04e58f82fc1 does not exist Oct 04 18:42:53.882186 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fe6d77a9-551e-4601-9a0c-9c9093dc9b97'] Oct 04 18:42:53.882186 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:53.882186 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:42:53.882186 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:53.882186 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:53.882186 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:42:53.882186 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:42:53.882186 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:42:53.882186 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:42:53.882186 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e844db73-1f78-41b1-bfff-a04e58f82fc1 does not exist Oct 04 18:42:53.882186 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fe6d77a9-551e-4601-9a0c-9c9093dc9b97'] Oct 04 18:42:53.882186 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:53.891510 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2c715f21-6019-4823-a010-94fc56c859c9 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Returning 404 to user: Security group e844db73-1f78-41b1-bfff-a04e58f82fc1 does not exist Oct 04 18:42:53.891510 n-d-850501-14 devstack@n-api.service[123002]: Neutron server returns request_ids: ['req-fe6d77a9-551e-4601-9a0c-9c9093dc9b97'] {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:42:53.895279 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2c715f21-6019-4823-a010-94fc56c859c9 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/e844db73-1f78-41b1-bfff-a04e58f82fc1" status: 404 len: 194 microversion: 2.1 time: 0.124124 Oct 04 18:42:53.898743 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1787/3613] 10.222.0.20 () {58 vars in 1272 bytes} [Tue Oct 4 18:42:53 2022] DELETE /compute/v2.1/os-security-groups/e844db73-1f78-41b1-bfff-a04e58f82fc1 => generated 194 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:42:53.906085 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a59e7d30-a006-4fb9-b086-8e7697421c77 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Calling method '.version_select at 0x7fe253f1bf70>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:54.003061 n-d-850501-14 devstack@n-api.service[123002]: DEBUG neutronclient.v2_0.client [None req-a59e7d30-a006-4fb9-b086-8e7697421c77 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ae97ac67-b778-4af4-8d61-0e3c1acb10ce does not exist", "detail": ""}} {{(pid=123002) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:42:54.005130 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.security_group_api [None req-a59e7d30-a006-4fb9-b086-8e7697421c77 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Neutron security group ae97ac67-b778-4af4-8d61-0e3c1acb10ce not found {{(pid=123002) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 18:42:54.005836 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-a59e7d30-a006-4fb9-b086-8e7697421c77 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] HTTP exception thrown: Security group ae97ac67-b778-4af4-8d61-0e3c1acb10ce does not exist Oct 04 18:42:54.005836 n-d-850501-14 devstack@n-api.service[123002]: Neutron server returns request_ids: ['req-12f1819f-6f3b-4fe5-b7bd-238bb8056a47'] Oct 04 18:42:54.008136 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a59e7d30-a006-4fb9-b086-8e7697421c77 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Request method failure captured: Oct 04 18:42:54.008136 n-d-850501-14 devstack@n-api.service[123002]: request: DELETE /compute/v2.1/os-security-groups/ae97ac67-b778-4af4-8d61-0e3c1acb10ce HTTP/1.1 Oct 04 18:42:54.008136 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:42:54.008136 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:42:54.008136 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:42:54.008136 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:42:54.008136 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:42:54.008136 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:42:54.008136 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:42:54.008136 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:42:54.008136 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH5IaH15tr5SVoVt4hozZEg3Js8ZWcVBx0oRn243qNZFUMSmPeMa3Gyq91gLee0lw2Klv1E5mNTaxmJJRYhRawPEzSfr-EeZwa66fdrMa4-gu9mqAey6rHA1ZnVCWU_BX1Hua5XpKyhleXrqcIVEtamRhatLhfvMeiTTjEHkZqIKSBQ Oct 04 18:42:54.008136 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:42:54.008136 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:42:54.008136 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:42:54.008136 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:42:54.008136 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:42:54.008136 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:42:54.008136 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 1b43fba16115404aaa793fb907fd257f Oct 04 18:42:54.008136 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-SecurityGroupsTestJSON-752173812 Oct 04 18:42:54.008136 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:42:54.008136 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:42:54.008136 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1b43fba16115404aaa793fb907fd257f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1b43fba16115404aaa793fb907fd257f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1b43fba16115404aaa793fb907fd257f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1b43fba16115404aaa793fb907fd257f"}]}] Oct 04 18:42:54.008136 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-SecurityGroupsTestJSON-752173812 Oct 04 18:42:54.008136 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 1b43fba16115404aaa793fb907fd257f Oct 04 18:42:54.008136 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-752173812 Oct 04 18:42:54.008136 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-SecurityGroupsTestJSON-752173812-project Oct 04 18:42:54.008136 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:42:54.008136 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:42:54.008136 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 777a7a51e45b498597f7a1202217575c Oct 04 18:42:54.008136 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-SecurityGroupsTestJSON-752173812-project Oct 04 18:42:54.008136 n-d-850501-14 devstack@n-api.service[123002]: method: Oct 04 18:42:54.008136 n-d-850501-14 devstack@n-api.service[123002]: exception: Security group ae97ac67-b778-4af4-8d61-0e3c1acb10ce does not exist Oct 04 18:42:54.008136 n-d-850501-14 devstack@n-api.service[123002]: Neutron server returns request_ids: ['req-12f1819f-6f3b-4fe5-b7bd-238bb8056a47'] Oct 04 18:42:54.008136 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'ae97ac67-b778-4af4-8d61-0e3c1acb10ce'} Oct 04 18:42:54.008136 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:42:54.008136 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:54.008136 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 18:42:54.008136 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 18:42:54.008136 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:42:54.008136 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:42:54.008136 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 18:42:54.008136 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 18:42:54.008136 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:42:54.008136 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:42:54.008136 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:42:54.008136 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 18:42:54.008136 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:42:54.008136 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:42:54.008136 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:42:54.008136 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:42:54.008136 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:42:54.008136 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:42:54.008136 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:42:54.008136 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:42:54.008136 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:42:54.008136 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:42:54.008136 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:42:54.008136 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:42:54.008136 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:42:54.008136 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:42:54.008136 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group ae97ac67-b778-4af4-8d61-0e3c1acb10ce does not exist Oct 04 18:42:54.018648 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-12f1819f-6f3b-4fe5-b7bd-238bb8056a47'] Oct 04 18:42:54.018648 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:54.018648 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:42:54.018648 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:54.018648 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:54.018648 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 04 18:42:54.018648 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 18:42:54.018648 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 18:42:54.018648 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 18:42:54.018648 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group ae97ac67-b778-4af4-8d61-0e3c1acb10ce does not exist Oct 04 18:42:54.018648 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-12f1819f-6f3b-4fe5-b7bd-238bb8056a47'] Oct 04 18:42:54.018648 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:54.018648 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:42:54.018648 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:54.018648 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:54.018648 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:42:54.018648 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:42:54.018648 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:42:54.018648 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:42:54.018648 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:42:54.018648 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:42:54.018648 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:42:54.018648 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:42:54.018648 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 04 18:42:54.018648 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 18:42:54.018648 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group ae97ac67-b778-4af4-8d61-0e3c1acb10ce does not exist Oct 04 18:42:54.018648 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-12f1819f-6f3b-4fe5-b7bd-238bb8056a47'] Oct 04 18:42:54.018648 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:54.018648 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:42:54.018648 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:54.018648 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:54.018648 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:42:54.018648 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:42:54.018648 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:42:54.018648 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:42:54.018648 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group ae97ac67-b778-4af4-8d61-0e3c1acb10ce does not exist Oct 04 18:42:54.018648 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-12f1819f-6f3b-4fe5-b7bd-238bb8056a47'] Oct 04 18:42:54.018648 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:54.018648 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a59e7d30-a006-4fb9-b086-8e7697421c77 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Returning 404 to user: Security group ae97ac67-b778-4af4-8d61-0e3c1acb10ce does not exist Oct 04 18:42:54.018648 n-d-850501-14 devstack@n-api.service[123002]: Neutron server returns request_ids: ['req-12f1819f-6f3b-4fe5-b7bd-238bb8056a47'] {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:42:54.018648 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a59e7d30-a006-4fb9-b086-8e7697421c77 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/ae97ac67-b778-4af4-8d61-0e3c1acb10ce" status: 404 len: 194 microversion: 2.1 time: 0.109843 Oct 04 18:42:54.018648 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1788/3614] 10.222.0.20 () {58 vars in 1272 bytes} [Tue Oct 4 18:42:53 2022] DELETE /compute/v2.1/os-security-groups/ae97ac67-b778-4af4-8d61-0e3c1acb10ce => generated 194 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:42:54.023843 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8bf831b6-2cfc-4b75-beed-95b35b7b4d63 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Calling method '.version_select at 0x7fe253f1b0d0>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:54.041829 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-549cc4fe-d85c-4649-903b-3095d7fd43f2 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:54.043064 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:42:54.064449 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-549cc4fe-d85c-4649-903b-3095d7fd43f2 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/af46589b-8af1-4394-86e3-631c7d483a12" status: 200 len: 1520 microversion: 2.1 time: 0.480701 Oct 04 18:42:54.064449 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1827/3615] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:53 2022] GET /compute/v2.1/servers/af46589b-8af1-4394-86e3-631c7d483a12 => generated 1520 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:54.098906 n-d-850501-14 devstack@n-api.service[123002]: DEBUG neutronclient.v2_0.client [None req-8bf831b6-2cfc-4b75-beed-95b35b7b4d63 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e12df1cb-1eb8-4dd5-aaee-a4d52d5b973a does not exist", "detail": ""}} {{(pid=123002) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:42:54.099601 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.security_group_api [None req-8bf831b6-2cfc-4b75-beed-95b35b7b4d63 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Neutron security group e12df1cb-1eb8-4dd5-aaee-a4d52d5b973a not found {{(pid=123002) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 18:42:54.100297 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-8bf831b6-2cfc-4b75-beed-95b35b7b4d63 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] HTTP exception thrown: Security group e12df1cb-1eb8-4dd5-aaee-a4d52d5b973a does not exist Oct 04 18:42:54.100297 n-d-850501-14 devstack@n-api.service[123002]: Neutron server returns request_ids: ['req-1d180397-f93e-460a-951f-53a20bb71844'] Oct 04 18:42:54.102955 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8bf831b6-2cfc-4b75-beed-95b35b7b4d63 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Request method failure captured: Oct 04 18:42:54.102955 n-d-850501-14 devstack@n-api.service[123002]: request: DELETE /compute/v2.1/os-security-groups/e12df1cb-1eb8-4dd5-aaee-a4d52d5b973a HTTP/1.1 Oct 04 18:42:54.102955 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:42:54.102955 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:42:54.102955 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:42:54.102955 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:42:54.102955 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:42:54.102955 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:42:54.102955 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:42:54.102955 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:42:54.102955 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH5IaH15tr5SVoVt4hozZEg3Js8ZWcVBx0oRn243qNZFUMSmPeMa3Gyq91gLee0lw2Klv1E5mNTaxmJJRYhRawPEzSfr-EeZwa66fdrMa4-gu9mqAey6rHA1ZnVCWU_BX1Hua5XpKyhleXrqcIVEtamRhatLhfvMeiTTjEHkZqIKSBQ Oct 04 18:42:54.102955 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:42:54.102955 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:42:54.102955 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:42:54.102955 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:42:54.102955 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:42:54.102955 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:42:54.102955 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 1b43fba16115404aaa793fb907fd257f Oct 04 18:42:54.102955 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-SecurityGroupsTestJSON-752173812 Oct 04 18:42:54.102955 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:42:54.102955 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:42:54.102955 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1b43fba16115404aaa793fb907fd257f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1b43fba16115404aaa793fb907fd257f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1b43fba16115404aaa793fb907fd257f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1b43fba16115404aaa793fb907fd257f"}]}] Oct 04 18:42:54.102955 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-SecurityGroupsTestJSON-752173812 Oct 04 18:42:54.102955 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 1b43fba16115404aaa793fb907fd257f Oct 04 18:42:54.102955 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-752173812 Oct 04 18:42:54.102955 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-SecurityGroupsTestJSON-752173812-project Oct 04 18:42:54.102955 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:42:54.102955 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:42:54.102955 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 777a7a51e45b498597f7a1202217575c Oct 04 18:42:54.102955 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-SecurityGroupsTestJSON-752173812-project Oct 04 18:42:54.102955 n-d-850501-14 devstack@n-api.service[123002]: method: Oct 04 18:42:54.102955 n-d-850501-14 devstack@n-api.service[123002]: exception: Security group e12df1cb-1eb8-4dd5-aaee-a4d52d5b973a does not exist Oct 04 18:42:54.102955 n-d-850501-14 devstack@n-api.service[123002]: Neutron server returns request_ids: ['req-1d180397-f93e-460a-951f-53a20bb71844'] Oct 04 18:42:54.102955 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'e12df1cb-1eb8-4dd5-aaee-a4d52d5b973a'} Oct 04 18:42:54.102955 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:42:54.102955 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:54.102955 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 18:42:54.102955 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 18:42:54.102955 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:42:54.102955 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:42:54.102955 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 18:42:54.102955 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 18:42:54.102955 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:42:54.102955 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:42:54.102955 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:42:54.102955 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 18:42:54.102955 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:42:54.102955 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:42:54.102955 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:42:54.102955 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:42:54.102955 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:42:54.102955 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:42:54.102955 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:42:54.102955 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:42:54.102955 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:42:54.102955 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:42:54.102955 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:42:54.102955 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:42:54.102955 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:42:54.102955 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:42:54.102955 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e12df1cb-1eb8-4dd5-aaee-a4d52d5b973a does not exist Oct 04 18:42:54.108999 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1d180397-f93e-460a-951f-53a20bb71844'] Oct 04 18:42:54.108999 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:54.108999 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:42:54.108999 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:54.108999 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:54.108999 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 04 18:42:54.108999 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 18:42:54.108999 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 18:42:54.108999 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 18:42:54.108999 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e12df1cb-1eb8-4dd5-aaee-a4d52d5b973a does not exist Oct 04 18:42:54.108999 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1d180397-f93e-460a-951f-53a20bb71844'] Oct 04 18:42:54.108999 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:54.108999 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:42:54.108999 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:54.108999 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:54.108999 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:42:54.108999 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:42:54.108999 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:42:54.108999 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:42:54.108999 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:42:54.108999 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:42:54.108999 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:42:54.108999 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:42:54.108999 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 04 18:42:54.108999 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 18:42:54.108999 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e12df1cb-1eb8-4dd5-aaee-a4d52d5b973a does not exist Oct 04 18:42:54.108999 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1d180397-f93e-460a-951f-53a20bb71844'] Oct 04 18:42:54.108999 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:54.108999 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:42:54.108999 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:54.108999 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:54.108999 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:42:54.108999 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:42:54.108999 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:42:54.108999 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:42:54.108999 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e12df1cb-1eb8-4dd5-aaee-a4d52d5b973a does not exist Oct 04 18:42:54.108999 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1d180397-f93e-460a-951f-53a20bb71844'] Oct 04 18:42:54.108999 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:42:54.108999 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8bf831b6-2cfc-4b75-beed-95b35b7b4d63 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Returning 404 to user: Security group e12df1cb-1eb8-4dd5-aaee-a4d52d5b973a does not exist Oct 04 18:42:54.108999 n-d-850501-14 devstack@n-api.service[123002]: Neutron server returns request_ids: ['req-1d180397-f93e-460a-951f-53a20bb71844'] {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:42:54.108999 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8bf831b6-2cfc-4b75-beed-95b35b7b4d63 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/e12df1cb-1eb8-4dd5-aaee-a4d52d5b973a" status: 404 len: 194 microversion: 2.1 time: 0.092699 Oct 04 18:42:54.115692 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1789/3616] 10.222.0.20 () {58 vars in 1272 bytes} [Tue Oct 4 18:42:54 2022] DELETE /compute/v2.1/os-security-groups/e12df1cb-1eb8-4dd5-aaee-a4d52d5b973a => generated 194 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:42:54.119989 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3b6ca5a9-4872-492f-987b-0db5bdcd9026 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Calling method '.version_select at 0x7fe259146d30>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:54.160809 n-d-850501-14 devstack@n-api.service[123001]: DEBUG neutronclient.v2_0.client [None req-3b6ca5a9-4872-492f-987b-0db5bdcd9026 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 40235627-7776-4a06-9a50-8bc64fa29196 does not exist", "detail": ""}} {{(pid=123001) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:42:54.167125 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.security_group_api [None req-3b6ca5a9-4872-492f-987b-0db5bdcd9026 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Neutron security group 40235627-7776-4a06-9a50-8bc64fa29196 not found {{(pid=123001) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 18:42:54.167125 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-3b6ca5a9-4872-492f-987b-0db5bdcd9026 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] HTTP exception thrown: Security group 40235627-7776-4a06-9a50-8bc64fa29196 does not exist Oct 04 18:42:54.167125 n-d-850501-14 devstack@n-api.service[123001]: Neutron server returns request_ids: ['req-74697557-f569-4441-9bff-f31075f52e29'] Oct 04 18:42:54.167125 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3b6ca5a9-4872-492f-987b-0db5bdcd9026 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Request method failure captured: Oct 04 18:42:54.167125 n-d-850501-14 devstack@n-api.service[123001]: request: DELETE /compute/v2.1/os-security-groups/40235627-7776-4a06-9a50-8bc64fa29196 HTTP/1.1 Oct 04 18:42:54.167125 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:42:54.167125 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:42:54.167125 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:42:54.167125 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:42:54.167125 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:42:54.167125 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:42:54.167125 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:42:54.167125 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:42:54.167125 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPH5IaH15tr5SVoVt4hozZEg3Js8ZWcVBx0oRn243qNZFUMSmPeMa3Gyq91gLee0lw2Klv1E5mNTaxmJJRYhRawPEzSfr-EeZwa66fdrMa4-gu9mqAey6rHA1ZnVCWU_BX1Hua5XpKyhleXrqcIVEtamRhatLhfvMeiTTjEHkZqIKSBQ Oct 04 18:42:54.167125 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:42:54.167125 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:42:54.167125 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:42:54.167125 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:42:54.167125 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:42:54.167125 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:42:54.167125 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 1b43fba16115404aaa793fb907fd257f Oct 04 18:42:54.167125 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-SecurityGroupsTestJSON-752173812 Oct 04 18:42:54.167125 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:42:54.167125 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:42:54.167125 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1b43fba16115404aaa793fb907fd257f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1b43fba16115404aaa793fb907fd257f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1b43fba16115404aaa793fb907fd257f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1b43fba16115404aaa793fb907fd257f"}]}] Oct 04 18:42:54.167125 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-SecurityGroupsTestJSON-752173812 Oct 04 18:42:54.167125 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 1b43fba16115404aaa793fb907fd257f Oct 04 18:42:54.167125 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-752173812 Oct 04 18:42:54.167125 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-SecurityGroupsTestJSON-752173812-project Oct 04 18:42:54.167125 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:42:54.167125 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:42:54.167125 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 777a7a51e45b498597f7a1202217575c Oct 04 18:42:54.167125 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-SecurityGroupsTestJSON-752173812-project Oct 04 18:42:54.167125 n-d-850501-14 devstack@n-api.service[123001]: method: Oct 04 18:42:54.167125 n-d-850501-14 devstack@n-api.service[123001]: exception: Security group 40235627-7776-4a06-9a50-8bc64fa29196 does not exist Oct 04 18:42:54.167125 n-d-850501-14 devstack@n-api.service[123001]: Neutron server returns request_ids: ['req-74697557-f569-4441-9bff-f31075f52e29'] Oct 04 18:42:54.167125 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '40235627-7776-4a06-9a50-8bc64fa29196'} Oct 04 18:42:54.167125 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:42:54.167125 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:54.167125 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 18:42:54.167125 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 18:42:54.167125 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:42:54.167125 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:42:54.167125 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 18:42:54.167125 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 18:42:54.167125 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:42:54.167125 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:42:54.167125 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:42:54.167125 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 18:42:54.167125 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:42:54.167125 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:42:54.167125 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:42:54.167125 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:42:54.167125 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:42:54.167125 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:42:54.167125 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:42:54.167125 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:42:54.167125 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:42:54.170991 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:42:54.170991 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:42:54.170991 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:42:54.170991 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:42:54.170991 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:42:54.170991 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 40235627-7776-4a06-9a50-8bc64fa29196 does not exist Oct 04 18:42:54.170991 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-74697557-f569-4441-9bff-f31075f52e29'] Oct 04 18:42:54.170991 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:42:54.170991 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:42:54.170991 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:42:54.170991 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:54.170991 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 04 18:42:54.170991 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 18:42:54.170991 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 18:42:54.170991 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 18:42:54.170991 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 40235627-7776-4a06-9a50-8bc64fa29196 does not exist Oct 04 18:42:54.170991 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-74697557-f569-4441-9bff-f31075f52e29'] Oct 04 18:42:54.170991 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:42:54.170991 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:42:54.170991 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:42:54.170991 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:54.170991 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:42:54.170991 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:42:54.170991 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:42:54.170991 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:42:54.170991 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:42:54.170991 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:42:54.170991 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:42:54.170991 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:42:54.170991 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 04 18:42:54.170991 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 18:42:54.170991 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 40235627-7776-4a06-9a50-8bc64fa29196 does not exist Oct 04 18:42:54.170991 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-74697557-f569-4441-9bff-f31075f52e29'] Oct 04 18:42:54.170991 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:42:54.170991 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:42:54.170991 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:42:54.170991 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:54.170991 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:42:54.170991 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:42:54.170991 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:42:54.170991 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:42:54.170991 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 40235627-7776-4a06-9a50-8bc64fa29196 does not exist Oct 04 18:42:54.170991 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-74697557-f569-4441-9bff-f31075f52e29'] Oct 04 18:42:54.170991 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:42:54.170991 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3b6ca5a9-4872-492f-987b-0db5bdcd9026 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Returning 404 to user: Security group 40235627-7776-4a06-9a50-8bc64fa29196 does not exist Oct 04 18:42:54.170991 n-d-850501-14 devstack@n-api.service[123001]: Neutron server returns request_ids: ['req-74697557-f569-4441-9bff-f31075f52e29'] {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:42:54.170991 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3b6ca5a9-4872-492f-987b-0db5bdcd9026 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/40235627-7776-4a06-9a50-8bc64fa29196" status: 404 len: 194 microversion: 2.1 time: 0.050110 Oct 04 18:42:54.170991 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1828/3617] 10.222.0.20 () {58 vars in 1272 bytes} [Tue Oct 4 18:42:54 2022] DELETE /compute/v2.1/os-security-groups/40235627-7776-4a06-9a50-8bc64fa29196 => generated 194 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:42:54.178937 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-93c2d032-83ce-4e89-9a1e-641150a1c0ac tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:54.180182 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-93c2d032-83ce-4e89-9a1e-641150a1c0ac tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 6dc7155a-e90b-4ca9-8778-02bf31eff4bd] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:54.181119 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-29e44db8-7241-45b1-820e-617e8b75bcd4 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Calling method '.version_select at 0x7fe25831fc10>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:54.200015 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-93c2d032-83ce-4e89-9a1e-641150a1c0ac tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:54.201559 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-93c2d032-83ce-4e89-9a1e-641150a1c0ac tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:54.201800 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-93c2d032-83ce-4e89-9a1e-641150a1c0ac tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:54.202435 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-93c2d032-83ce-4e89-9a1e-641150a1c0ac tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:54.205030 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-93c2d032-83ce-4e89-9a1e-641150a1c0ac tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:54.205559 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-93c2d032-83ce-4e89-9a1e-641150a1c0ac tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:54.264892 n-d-850501-14 devstack@n-api.service[123001]: DEBUG neutronclient.v2_0.client [None req-29e44db8-7241-45b1-820e-617e8b75bcd4 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b70c1b65-e895-4f6f-bb94-734fd798853e does not exist", "detail": ""}} {{(pid=123001) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:42:54.265669 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.security_group_api [None req-29e44db8-7241-45b1-820e-617e8b75bcd4 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Neutron security group b70c1b65-e895-4f6f-bb94-734fd798853e not found {{(pid=123001) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 18:42:54.266368 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-29e44db8-7241-45b1-820e-617e8b75bcd4 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] HTTP exception thrown: Security group b70c1b65-e895-4f6f-bb94-734fd798853e does not exist Oct 04 18:42:54.266368 n-d-850501-14 devstack@n-api.service[123001]: Neutron server returns request_ids: ['req-7bd38ee0-f927-41cf-aced-7f995455d55b'] Oct 04 18:42:54.270346 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-29e44db8-7241-45b1-820e-617e8b75bcd4 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Request method failure captured: Oct 04 18:42:54.270346 n-d-850501-14 devstack@n-api.service[123001]: request: DELETE /compute/v2.1/os-security-groups/b70c1b65-e895-4f6f-bb94-734fd798853e HTTP/1.1 Oct 04 18:42:54.270346 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:42:54.270346 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:42:54.270346 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:42:54.270346 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:42:54.270346 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:42:54.270346 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:42:54.270346 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:42:54.270346 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:42:54.270346 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPH5IaH15tr5SVoVt4hozZEg3Js8ZWcVBx0oRn243qNZFUMSmPeMa3Gyq91gLee0lw2Klv1E5mNTaxmJJRYhRawPEzSfr-EeZwa66fdrMa4-gu9mqAey6rHA1ZnVCWU_BX1Hua5XpKyhleXrqcIVEtamRhatLhfvMeiTTjEHkZqIKSBQ Oct 04 18:42:54.270346 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:42:54.270346 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:42:54.270346 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:42:54.270346 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:42:54.270346 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:42:54.270346 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:42:54.270346 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 1b43fba16115404aaa793fb907fd257f Oct 04 18:42:54.270346 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-SecurityGroupsTestJSON-752173812 Oct 04 18:42:54.270346 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:42:54.270346 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:42:54.270346 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1b43fba16115404aaa793fb907fd257f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1b43fba16115404aaa793fb907fd257f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1b43fba16115404aaa793fb907fd257f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1b43fba16115404aaa793fb907fd257f"}]}] Oct 04 18:42:54.270346 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-SecurityGroupsTestJSON-752173812 Oct 04 18:42:54.270346 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 1b43fba16115404aaa793fb907fd257f Oct 04 18:42:54.270346 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-752173812 Oct 04 18:42:54.270346 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-SecurityGroupsTestJSON-752173812-project Oct 04 18:42:54.270346 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:42:54.270346 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:42:54.270346 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 777a7a51e45b498597f7a1202217575c Oct 04 18:42:54.270346 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-SecurityGroupsTestJSON-752173812-project Oct 04 18:42:54.270346 n-d-850501-14 devstack@n-api.service[123001]: method: Oct 04 18:42:54.270346 n-d-850501-14 devstack@n-api.service[123001]: exception: Security group b70c1b65-e895-4f6f-bb94-734fd798853e does not exist Oct 04 18:42:54.270346 n-d-850501-14 devstack@n-api.service[123001]: Neutron server returns request_ids: ['req-7bd38ee0-f927-41cf-aced-7f995455d55b'] Oct 04 18:42:54.270346 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': 'b70c1b65-e895-4f6f-bb94-734fd798853e'} Oct 04 18:42:54.270346 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:42:54.270346 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:54.270346 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 18:42:54.270346 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 18:42:54.270346 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:42:54.270346 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:42:54.270346 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 18:42:54.270346 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 18:42:54.270346 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:42:54.270346 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:42:54.270346 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:42:54.270346 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 18:42:54.270346 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:42:54.270346 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:42:54.270346 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:42:54.270346 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:42:54.270346 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:42:54.270346 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:42:54.270346 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:42:54.270346 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:42:54.270346 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:42:54.270346 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:42:54.270346 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:42:54.270346 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:42:54.270346 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:42:54.270346 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:42:54.270346 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b70c1b65-e895-4f6f-bb94-734fd798853e does not exist Oct 04 18:42:54.274377 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7bd38ee0-f927-41cf-aced-7f995455d55b'] Oct 04 18:42:54.274377 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:42:54.274377 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:42:54.274377 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:42:54.274377 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:54.274377 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 04 18:42:54.274377 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 18:42:54.274377 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 18:42:54.274377 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 18:42:54.274377 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b70c1b65-e895-4f6f-bb94-734fd798853e does not exist Oct 04 18:42:54.274377 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7bd38ee0-f927-41cf-aced-7f995455d55b'] Oct 04 18:42:54.274377 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:42:54.274377 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:42:54.274377 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:42:54.274377 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:54.274377 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:42:54.274377 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:42:54.274377 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:42:54.274377 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:42:54.274377 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:42:54.274377 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:42:54.274377 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:42:54.274377 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:42:54.274377 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 04 18:42:54.274377 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 18:42:54.274377 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b70c1b65-e895-4f6f-bb94-734fd798853e does not exist Oct 04 18:42:54.274377 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7bd38ee0-f927-41cf-aced-7f995455d55b'] Oct 04 18:42:54.274377 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:42:54.274377 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:42:54.274377 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:42:54.274377 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:54.274377 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:42:54.274377 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:42:54.274377 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:42:54.274377 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:42:54.274377 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b70c1b65-e895-4f6f-bb94-734fd798853e does not exist Oct 04 18:42:54.274377 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7bd38ee0-f927-41cf-aced-7f995455d55b'] Oct 04 18:42:54.274377 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:42:54.277778 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-29e44db8-7241-45b1-820e-617e8b75bcd4 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Returning 404 to user: Security group b70c1b65-e895-4f6f-bb94-734fd798853e does not exist Oct 04 18:42:54.277778 n-d-850501-14 devstack@n-api.service[123001]: Neutron server returns request_ids: ['req-7bd38ee0-f927-41cf-aced-7f995455d55b'] {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:42:54.278825 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-29e44db8-7241-45b1-820e-617e8b75bcd4 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/b70c1b65-e895-4f6f-bb94-734fd798853e" status: 404 len: 194 microversion: 2.1 time: 0.107197 Oct 04 18:42:54.279385 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1829/3618] 10.222.0.20 () {58 vars in 1272 bytes} [Tue Oct 4 18:42:54 2022] DELETE /compute/v2.1/os-security-groups/b70c1b65-e895-4f6f-bb94-734fd798853e => generated 194 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:42:54.288850 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b42768e0-de3c-4e9b-af3b-05fd42f5e552 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Calling method '.version_select at 0x7fe259146430>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:54.403095 n-d-850501-14 devstack@n-api.service[123001]: DEBUG neutronclient.v2_0.client [None req-b42768e0-de3c-4e9b-af3b-05fd42f5e552 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3879092d-d484-4a69-8f34-1bb29afda04b does not exist", "detail": ""}} {{(pid=123001) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:42:54.403690 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.security_group_api [None req-b42768e0-de3c-4e9b-af3b-05fd42f5e552 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Neutron security group 3879092d-d484-4a69-8f34-1bb29afda04b not found {{(pid=123001) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 18:42:54.404235 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-b42768e0-de3c-4e9b-af3b-05fd42f5e552 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] HTTP exception thrown: Security group 3879092d-d484-4a69-8f34-1bb29afda04b does not exist Oct 04 18:42:54.404235 n-d-850501-14 devstack@n-api.service[123001]: Neutron server returns request_ids: ['req-d478aa30-92dc-4640-b865-f35824ebe5fe'] Oct 04 18:42:54.407543 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b42768e0-de3c-4e9b-af3b-05fd42f5e552 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Request method failure captured: Oct 04 18:42:54.407543 n-d-850501-14 devstack@n-api.service[123001]: request: DELETE /compute/v2.1/os-security-groups/3879092d-d484-4a69-8f34-1bb29afda04b HTTP/1.1 Oct 04 18:42:54.407543 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:42:54.407543 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:42:54.407543 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:42:54.407543 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:42:54.407543 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:42:54.407543 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:42:54.407543 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:42:54.407543 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:42:54.407543 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPH5IaH15tr5SVoVt4hozZEg3Js8ZWcVBx0oRn243qNZFUMSmPeMa3Gyq91gLee0lw2Klv1E5mNTaxmJJRYhRawPEzSfr-EeZwa66fdrMa4-gu9mqAey6rHA1ZnVCWU_BX1Hua5XpKyhleXrqcIVEtamRhatLhfvMeiTTjEHkZqIKSBQ Oct 04 18:42:54.407543 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:42:54.407543 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:42:54.407543 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:42:54.407543 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:42:54.407543 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:42:54.407543 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:42:54.407543 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 1b43fba16115404aaa793fb907fd257f Oct 04 18:42:54.407543 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-SecurityGroupsTestJSON-752173812 Oct 04 18:42:54.407543 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:42:54.407543 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:42:54.407543 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1b43fba16115404aaa793fb907fd257f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1b43fba16115404aaa793fb907fd257f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1b43fba16115404aaa793fb907fd257f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1b43fba16115404aaa793fb907fd257f"}]}] Oct 04 18:42:54.407543 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-SecurityGroupsTestJSON-752173812 Oct 04 18:42:54.407543 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 1b43fba16115404aaa793fb907fd257f Oct 04 18:42:54.407543 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-752173812 Oct 04 18:42:54.407543 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-SecurityGroupsTestJSON-752173812-project Oct 04 18:42:54.407543 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:42:54.407543 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:42:54.407543 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 777a7a51e45b498597f7a1202217575c Oct 04 18:42:54.407543 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-SecurityGroupsTestJSON-752173812-project Oct 04 18:42:54.407543 n-d-850501-14 devstack@n-api.service[123001]: method: Oct 04 18:42:54.407543 n-d-850501-14 devstack@n-api.service[123001]: exception: Security group 3879092d-d484-4a69-8f34-1bb29afda04b does not exist Oct 04 18:42:54.407543 n-d-850501-14 devstack@n-api.service[123001]: Neutron server returns request_ids: ['req-d478aa30-92dc-4640-b865-f35824ebe5fe'] Oct 04 18:42:54.407543 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '3879092d-d484-4a69-8f34-1bb29afda04b'} Oct 04 18:42:54.407543 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:42:54.407543 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:54.407543 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 18:42:54.407543 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 18:42:54.407543 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:42:54.407543 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:42:54.407543 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 18:42:54.407543 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 18:42:54.407543 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:42:54.407543 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:42:54.407543 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:42:54.407543 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 18:42:54.407543 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:42:54.407543 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:42:54.407543 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:42:54.407543 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:42:54.407543 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:42:54.407543 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:42:54.407543 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:42:54.407543 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:42:54.407543 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:42:54.407543 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:42:54.407543 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:42:54.407543 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:42:54.407543 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:42:54.407543 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:42:54.407543 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 3879092d-d484-4a69-8f34-1bb29afda04b does not exist Oct 04 18:42:54.411880 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d478aa30-92dc-4640-b865-f35824ebe5fe'] Oct 04 18:42:54.411880 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:42:54.411880 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:42:54.411880 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:42:54.411880 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:54.411880 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 04 18:42:54.411880 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 18:42:54.411880 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 18:42:54.411880 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 18:42:54.411880 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 3879092d-d484-4a69-8f34-1bb29afda04b does not exist Oct 04 18:42:54.411880 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d478aa30-92dc-4640-b865-f35824ebe5fe'] Oct 04 18:42:54.411880 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:42:54.411880 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:42:54.411880 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:42:54.411880 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:54.411880 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:42:54.411880 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:42:54.411880 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:42:54.411880 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:42:54.411880 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:42:54.411880 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:42:54.411880 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:42:54.411880 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:42:54.411880 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 04 18:42:54.411880 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 18:42:54.411880 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 3879092d-d484-4a69-8f34-1bb29afda04b does not exist Oct 04 18:42:54.411880 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d478aa30-92dc-4640-b865-f35824ebe5fe'] Oct 04 18:42:54.411880 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:42:54.411880 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:42:54.411880 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:42:54.411880 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:42:54.411880 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:42:54.411880 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:42:54.411880 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:42:54.411880 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:42:54.411880 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 3879092d-d484-4a69-8f34-1bb29afda04b does not exist Oct 04 18:42:54.411880 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d478aa30-92dc-4640-b865-f35824ebe5fe'] Oct 04 18:42:54.411880 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:42:54.416255 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b42768e0-de3c-4e9b-af3b-05fd42f5e552 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Returning 404 to user: Security group 3879092d-d484-4a69-8f34-1bb29afda04b does not exist Oct 04 18:42:54.416255 n-d-850501-14 devstack@n-api.service[123001]: Neutron server returns request_ids: ['req-d478aa30-92dc-4640-b865-f35824ebe5fe'] {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:42:54.418184 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b42768e0-de3c-4e9b-af3b-05fd42f5e552 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/3879092d-d484-4a69-8f34-1bb29afda04b" status: 404 len: 194 microversion: 2.1 time: 0.129271 Oct 04 18:42:54.419038 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1830/3619] 10.222.0.20 () {58 vars in 1272 bytes} [Tue Oct 4 18:42:54 2022] DELETE /compute/v2.1/os-security-groups/3879092d-d484-4a69-8f34-1bb29afda04b => generated 194 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:42:54.424909 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-cf851130-67a9-460b-8e86-5bb876535536 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:54.425880 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-cf851130-67a9-460b-8e86-5bb876535536 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] [instance: 471125af-1ec3-44b3-bb69-36b04a03fdd5] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:54.441212 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cf851130-67a9-460b-8e86-5bb876535536 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:54.443066 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cf851130-67a9-460b-8e86-5bb876535536 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:54.443517 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cf851130-67a9-460b-8e86-5bb876535536 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:54.444274 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cf851130-67a9-460b-8e86-5bb876535536 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:54.444734 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cf851130-67a9-460b-8e86-5bb876535536 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:54.450313 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cf851130-67a9-460b-8e86-5bb876535536 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:54.682608 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-93c2d032-83ce-4e89-9a1e-641150a1c0ac tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:54.698325 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-93c2d032-83ce-4e89-9a1e-641150a1c0ac tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/6dc7155a-e90b-4ca9-8778-02bf31eff4bd" status: 200 len: 1329 microversion: 2.1 time: 0.541600 Oct 04 18:42:54.700094 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1790/3620] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:54 2022] GET /compute/v2.1/servers/6dc7155a-e90b-4ca9-8778-02bf31eff4bd => generated 1329 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:54.736022 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ae893945-a729-4b0a-8636-77e283750bae tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:54.736815 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ae893945-a729-4b0a-8636-77e283750bae tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] [instance: 68f2b230-fee6-4a7c-873f-3dfd659b9338] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:54.747452 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ae893945-a729-4b0a-8636-77e283750bae tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:54.754647 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ae893945-a729-4b0a-8636-77e283750bae tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:54.754647 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ae893945-a729-4b0a-8636-77e283750bae tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:54.754647 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ae893945-a729-4b0a-8636-77e283750bae tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:54.754647 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ae893945-a729-4b0a-8636-77e283750bae tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:54.754647 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ae893945-a729-4b0a-8636-77e283750bae tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:54.799715 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ae893945-a729-4b0a-8636-77e283750bae tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] [instance: 68f2b230-fee6-4a7c-873f-3dfd659b9338] Going to try to terminate instance {{(pid=123002) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:42:54.976522 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-cf851130-67a9-460b-8e86-5bb876535536 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8d2814c23a4aa9806d56ce99c89e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8596483de9f14de9a88cdb787841fd3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:54.984948 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-cf851130-67a9-460b-8e86-5bb876535536 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/servers/471125af-1ec3-44b3-bb69-36b04a03fdd5" status: 200 len: 1315 microversion: 2.1 time: 0.564559 Oct 04 18:42:54.987344 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1831/3621] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:54 2022] GET /compute/v2.1/servers/471125af-1ec3-44b3-bb69-36b04a03fdd5 => generated 1315 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:54.993049 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-31d5caca-0b16-49f0-aa09-8f9b45fba52c tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:54.993586 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-31d5caca-0b16-49f0-aa09-8f9b45fba52c tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] [instance: 6cc94ec4-3e28-41e0-808e-9cd2263bca7d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:54.999573 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-31d5caca-0b16-49f0-aa09-8f9b45fba52c tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:55.000339 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-31d5caca-0b16-49f0-aa09-8f9b45fba52c tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:55.000772 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-31d5caca-0b16-49f0-aa09-8f9b45fba52c tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:55.002101 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-31d5caca-0b16-49f0-aa09-8f9b45fba52c tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:55.002562 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-31d5caca-0b16-49f0-aa09-8f9b45fba52c tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:55.002985 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-31d5caca-0b16-49f0-aa09-8f9b45fba52c tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:55.185971 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ae893945-a729-4b0a-8636-77e283750bae tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] 10.222.0.20 "DELETE /compute/v2.1/servers/68f2b230-fee6-4a7c-873f-3dfd659b9338" status: 204 len: 0 microversion: 2.1 time: 0.481492 Oct 04 18:42:55.186616 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1791/3622] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:42:54 2022] DELETE /compute/v2.1/servers/68f2b230-fee6-4a7c-873f-3dfd659b9338 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:42:55.194314 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f295f21e-9eaa-43c7-b892-064feb620568 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:55.195980 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f295f21e-9eaa-43c7-b892-064feb620568 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: af46589b-8af1-4394-86e3-631c7d483a12] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:55.206037 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f295f21e-9eaa-43c7-b892-064feb620568 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:55.206768 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f295f21e-9eaa-43c7-b892-064feb620568 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:55.207231 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f295f21e-9eaa-43c7-b892-064feb620568 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:55.207977 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f295f21e-9eaa-43c7-b892-064feb620568 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:55.208499 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f295f21e-9eaa-43c7-b892-064feb620568 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:55.208938 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f295f21e-9eaa-43c7-b892-064feb620568 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:55.815204 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-31d5caca-0b16-49f0-aa09-8f9b45fba52c tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a02cd1108b947b186202f6d15e6cf0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c0b095138354810949093e7ea03b8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:55.825511 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-31d5caca-0b16-49f0-aa09-8f9b45fba52c tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] 10.222.0.20 "GET /compute/v2.1/servers/6cc94ec4-3e28-41e0-808e-9cd2263bca7d" status: 200 len: 1364 microversion: 2.1 time: 0.836605 Oct 04 18:42:55.834105 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1832/3623] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:54 2022] GET /compute/v2.1/servers/6cc94ec4-3e28-41e0-808e-9cd2263bca7d => generated 1364 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:55.844860 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-af629e12-2d8e-4e7f-afb9-f4e55e0d0632 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:55.845518 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-af629e12-2d8e-4e7f-afb9-f4e55e0d0632 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] [instance: 68f2b230-fee6-4a7c-873f-3dfd659b9338] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:55.856346 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-af629e12-2d8e-4e7f-afb9-f4e55e0d0632 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:55.857183 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-af629e12-2d8e-4e7f-afb9-f4e55e0d0632 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:55.858115 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-af629e12-2d8e-4e7f-afb9-f4e55e0d0632 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:55.859058 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-af629e12-2d8e-4e7f-afb9-f4e55e0d0632 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:55.859751 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-af629e12-2d8e-4e7f-afb9-f4e55e0d0632 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:55.861419 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-af629e12-2d8e-4e7f-afb9-f4e55e0d0632 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:55.891156 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f295f21e-9eaa-43c7-b892-064feb620568 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:55.902322 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f295f21e-9eaa-43c7-b892-064feb620568 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/af46589b-8af1-4394-86e3-631c7d483a12" status: 200 len: 1520 microversion: 2.1 time: 0.714451 Oct 04 18:42:55.916915 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1792/3624] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:55 2022] GET /compute/v2.1/servers/af46589b-8af1-4394-86e3-631c7d483a12 => generated 1520 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:55.921789 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-111075ce-9a52-42bc-8e98-7e03d1a314b4 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:55.924989 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-111075ce-9a52-42bc-8e98-7e03d1a314b4 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 6dc7155a-e90b-4ca9-8778-02bf31eff4bd] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:55.930240 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-111075ce-9a52-42bc-8e98-7e03d1a314b4 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:55.931105 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-111075ce-9a52-42bc-8e98-7e03d1a314b4 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:55.931694 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-111075ce-9a52-42bc-8e98-7e03d1a314b4 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:55.932798 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-111075ce-9a52-42bc-8e98-7e03d1a314b4 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:55.933536 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-111075ce-9a52-42bc-8e98-7e03d1a314b4 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:55.934217 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-111075ce-9a52-42bc-8e98-7e03d1a314b4 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:56.351672 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-111075ce-9a52-42bc-8e98-7e03d1a314b4 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:56.362802 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-111075ce-9a52-42bc-8e98-7e03d1a314b4 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/6dc7155a-e90b-4ca9-8778-02bf31eff4bd" status: 200 len: 1509 microversion: 2.1 time: 0.444761 Oct 04 18:42:56.365006 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-af629e12-2d8e-4e7f-afb9-f4e55e0d0632 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '777a7a51e45b498597f7a1202217575c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b43fba16115404aaa793fb907fd257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:56.375867 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-af629e12-2d8e-4e7f-afb9-f4e55e0d0632 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] 10.222.0.20 "GET /compute/v2.1/servers/68f2b230-fee6-4a7c-873f-3dfd659b9338" status: 200 len: 1646 microversion: 2.1 time: 0.540338 Oct 04 18:42:56.376817 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1793/3625] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:55 2022] GET /compute/v2.1/servers/6dc7155a-e90b-4ca9-8778-02bf31eff4bd => generated 1509 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:56.389404 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1833/3626] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:55 2022] GET /compute/v2.1/servers/68f2b230-fee6-4a7c-873f-3dfd659b9338 => generated 1646 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:56.390044 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-971d7621-c66d-4d30-b9b6-0f9fb9b6b361 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:56.392951 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-971d7621-c66d-4d30-b9b6-0f9fb9b6b361 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] [instance: 471125af-1ec3-44b3-bb69-36b04a03fdd5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:56.397804 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-971d7621-c66d-4d30-b9b6-0f9fb9b6b361 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:56.399166 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-971d7621-c66d-4d30-b9b6-0f9fb9b6b361 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:56.399889 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-971d7621-c66d-4d30-b9b6-0f9fb9b6b361 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:56.401033 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-971d7621-c66d-4d30-b9b6-0f9fb9b6b361 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:56.401832 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-971d7621-c66d-4d30-b9b6-0f9fb9b6b361 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:56.402431 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-971d7621-c66d-4d30-b9b6-0f9fb9b6b361 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:56.402562 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-290c1dc9-0afb-4c38-aec8-6ac413b68138 req-0418f95e-dddf-428b-914d-07ccd32c97b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6905c432-0fb3-4f5a-84bb-0ffcb08e2b3c", "tag": "457c88d9-9246-435c-b1a5-58b0c6c6185d"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:56.417696 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-290c1dc9-0afb-4c38-aec8-6ac413b68138 req-0418f95e-dddf-428b-914d-07ccd32c97b8 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:56.418293 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-290c1dc9-0afb-4c38-aec8-6ac413b68138 req-0418f95e-dddf-428b-914d-07ccd32c97b8 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:56.418794 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-290c1dc9-0afb-4c38-aec8-6ac413b68138 req-0418f95e-dddf-428b-914d-07ccd32c97b8 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:56.437174 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-290c1dc9-0afb-4c38-aec8-6ac413b68138 req-0418f95e-dddf-428b-914d-07ccd32c97b8 service nova] Creating event network-changed:457c88d9-9246-435c-b1a5-58b0c6c6185d for instance 6905c432-0fb3-4f5a-84bb-0ffcb08e2b3c on n-h1-850501-14 Oct 04 18:42:56.444335 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-290c1dc9-0afb-4c38-aec8-6ac413b68138 req-0418f95e-dddf-428b-914d-07ccd32c97b8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053545 Oct 04 18:42:56.445698 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1834/3627] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:42:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:42:56.452595 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-db21ad69-7480-4475-befa-d5430ff2b544 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:56.453632 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-db21ad69-7480-4475-befa-d5430ff2b544 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 6dc7155a-e90b-4ca9-8778-02bf31eff4bd] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:56.462497 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7,nova_api:DELETE=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:42:56.464358 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-db21ad69-7480-4475-befa-d5430ff2b544 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:56.464846 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-db21ad69-7480-4475-befa-d5430ff2b544 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:56.465280 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-db21ad69-7480-4475-befa-d5430ff2b544 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:56.469018 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-db21ad69-7480-4475-befa-d5430ff2b544 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:56.469018 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-db21ad69-7480-4475-befa-d5430ff2b544 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:56.469018 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-db21ad69-7480-4475-befa-d5430ff2b544 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:56.644395 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=6 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:42:56.846439 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-971d7621-c66d-4d30-b9b6-0f9fb9b6b361 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8d2814c23a4aa9806d56ce99c89e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8596483de9f14de9a88cdb787841fd3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:56.854616 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-971d7621-c66d-4d30-b9b6-0f9fb9b6b361 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/servers/471125af-1ec3-44b3-bb69-36b04a03fdd5" status: 200 len: 1315 microversion: 2.1 time: 0.475105 Oct 04 18:42:56.870333 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1794/3628] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:56 2022] GET /compute/v2.1/servers/471125af-1ec3-44b3-bb69-36b04a03fdd5 => generated 1315 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:56.870333 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3f86a2e6-74a5-4fc7-8c79-69174ddc9d13 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:56.870333 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3f86a2e6-74a5-4fc7-8c79-69174ddc9d13 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] [instance: 6cc94ec4-3e28-41e0-808e-9cd2263bca7d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:56.870906 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f86a2e6-74a5-4fc7-8c79-69174ddc9d13 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:56.871301 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f86a2e6-74a5-4fc7-8c79-69174ddc9d13 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:56.886193 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f86a2e6-74a5-4fc7-8c79-69174ddc9d13 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:56.887743 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f86a2e6-74a5-4fc7-8c79-69174ddc9d13 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:56.888490 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f86a2e6-74a5-4fc7-8c79-69174ddc9d13 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:56.888947 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f86a2e6-74a5-4fc7-8c79-69174ddc9d13 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:56.905062 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-db21ad69-7480-4475-befa-d5430ff2b544 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:56.913992 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-db21ad69-7480-4475-befa-d5430ff2b544 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/6dc7155a-e90b-4ca9-8778-02bf31eff4bd" status: 200 len: 1509 microversion: 2.1 time: 0.467001 Oct 04 18:42:56.925447 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1835/3629] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:56 2022] GET /compute/v2.1/servers/6dc7155a-e90b-4ca9-8778-02bf31eff4bd => generated 1509 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:56.940418 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3a8f1c24-b621-418c-8eb0-d324b4117350 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:56.941557 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3a8f1c24-b621-418c-8eb0-d324b4117350 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 6dc7155a-e90b-4ca9-8778-02bf31eff4bd] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:56.948235 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3a8f1c24-b621-418c-8eb0-d324b4117350 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:56.949129 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3a8f1c24-b621-418c-8eb0-d324b4117350 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:56.949822 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3a8f1c24-b621-418c-8eb0-d324b4117350 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:56.950774 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3a8f1c24-b621-418c-8eb0-d324b4117350 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:56.951472 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3a8f1c24-b621-418c-8eb0-d324b4117350 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:56.952286 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3a8f1c24-b621-418c-8eb0-d324b4117350 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:56.984902 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3a8f1c24-b621-418c-8eb0-d324b4117350 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 6dc7155a-e90b-4ca9-8778-02bf31eff4bd] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:42:57.220735 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3f86a2e6-74a5-4fc7-8c79-69174ddc9d13 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a02cd1108b947b186202f6d15e6cf0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c0b095138354810949093e7ea03b8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:57.234132 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3f86a2e6-74a5-4fc7-8c79-69174ddc9d13 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] 10.222.0.20 "GET /compute/v2.1/servers/6cc94ec4-3e28-41e0-808e-9cd2263bca7d" status: 200 len: 1364 microversion: 2.1 time: 0.377498 Oct 04 18:42:57.249285 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1795/3630] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:56 2022] GET /compute/v2.1/servers/6cc94ec4-3e28-41e0-808e-9cd2263bca7d => generated 1364 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:57.256477 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f454a3e0-41a3-471d-b0b2-7d1942210d92 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:57.257421 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f454a3e0-41a3-471d-b0b2-7d1942210d92 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: af46589b-8af1-4394-86e3-631c7d483a12] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:57.264384 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f454a3e0-41a3-471d-b0b2-7d1942210d92 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:57.265115 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f454a3e0-41a3-471d-b0b2-7d1942210d92 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:57.265821 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f454a3e0-41a3-471d-b0b2-7d1942210d92 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:57.267250 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f454a3e0-41a3-471d-b0b2-7d1942210d92 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:57.267935 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f454a3e0-41a3-471d-b0b2-7d1942210d92 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:57.268610 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f454a3e0-41a3-471d-b0b2-7d1942210d92 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:57.289555 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3a8f1c24-b621-418c-8eb0-d324b4117350 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6dc7155a-e90b-4ca9-8778-02bf31eff4bd" status: 204 len: 0 microversion: 2.1 time: 0.353301 Oct 04 18:42:57.290737 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1836/3631] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:42:56 2022] DELETE /compute/v2.1/servers/6dc7155a-e90b-4ca9-8778-02bf31eff4bd => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:42:57.342122 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5339449e-7a74-4187-b5fd-c8cd55652f7c tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:57.355721 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5339449e-7a74-4187-b5fd-c8cd55652f7c tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 6dc7155a-e90b-4ca9-8778-02bf31eff4bd] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:57.372874 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5339449e-7a74-4187-b5fd-c8cd55652f7c tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:57.374122 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5339449e-7a74-4187-b5fd-c8cd55652f7c tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:57.374919 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5339449e-7a74-4187-b5fd-c8cd55652f7c tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:57.375658 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5339449e-7a74-4187-b5fd-c8cd55652f7c tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:57.376774 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5339449e-7a74-4187-b5fd-c8cd55652f7c tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:57.378236 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5339449e-7a74-4187-b5fd-c8cd55652f7c tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:57.547339 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f454a3e0-41a3-471d-b0b2-7d1942210d92 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:57.556651 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f454a3e0-41a3-471d-b0b2-7d1942210d92 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/af46589b-8af1-4394-86e3-631c7d483a12" status: 200 len: 1520 microversion: 2.1 time: 0.305908 Oct 04 18:42:57.557663 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1796/3632] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:57 2022] GET /compute/v2.1/servers/af46589b-8af1-4394-86e3-631c7d483a12 => generated 1520 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:57.578914 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e72dde01-4939-4bc3-88e1-a0417463ddcd tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:57.580309 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e72dde01-4939-4bc3-88e1-a0417463ddcd tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] [instance: 68f2b230-fee6-4a7c-873f-3dfd659b9338] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:57.588632 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e72dde01-4939-4bc3-88e1-a0417463ddcd tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:57.589415 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e72dde01-4939-4bc3-88e1-a0417463ddcd tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:57.590201 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e72dde01-4939-4bc3-88e1-a0417463ddcd tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:57.591333 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e72dde01-4939-4bc3-88e1-a0417463ddcd tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:57.591967 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e72dde01-4939-4bc3-88e1-a0417463ddcd tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:57.599992 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e72dde01-4939-4bc3-88e1-a0417463ddcd tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:57.770636 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5339449e-7a74-4187-b5fd-c8cd55652f7c tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:57.794484 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5339449e-7a74-4187-b5fd-c8cd55652f7c tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/6dc7155a-e90b-4ca9-8778-02bf31eff4bd" status: 200 len: 1515 microversion: 2.1 time: 0.483439 Oct 04 18:42:57.796190 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1837/3633] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:57 2022] GET /compute/v2.1/servers/6dc7155a-e90b-4ca9-8778-02bf31eff4bd => generated 1515 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:57.884737 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-19234184-e717-4113-b9e1-c76424157815 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:57.886228 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-19234184-e717-4113-b9e1-c76424157815 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] [instance: 471125af-1ec3-44b3-bb69-36b04a03fdd5] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:57.902220 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-19234184-e717-4113-b9e1-c76424157815 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:57.903083 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-19234184-e717-4113-b9e1-c76424157815 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:57.903773 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-19234184-e717-4113-b9e1-c76424157815 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:57.904754 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-19234184-e717-4113-b9e1-c76424157815 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:57.905522 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-19234184-e717-4113-b9e1-c76424157815 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:57.908880 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-19234184-e717-4113-b9e1-c76424157815 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:57.997037 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e72dde01-4939-4bc3-88e1-a0417463ddcd tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '777a7a51e45b498597f7a1202217575c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b43fba16115404aaa793fb907fd257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:58.011246 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e72dde01-4939-4bc3-88e1-a0417463ddcd tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] 10.222.0.20 "GET /compute/v2.1/servers/68f2b230-fee6-4a7c-873f-3dfd659b9338" status: 200 len: 1646 microversion: 2.1 time: 0.441397 Oct 04 18:42:58.021334 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1797/3634] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:57 2022] GET /compute/v2.1/servers/68f2b230-fee6-4a7c-873f-3dfd659b9338 => generated 1646 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:58.210450 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-19234184-e717-4113-b9e1-c76424157815 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8d2814c23a4aa9806d56ce99c89e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8596483de9f14de9a88cdb787841fd3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:58.220840 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-19234184-e717-4113-b9e1-c76424157815 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/servers/471125af-1ec3-44b3-bb69-36b04a03fdd5" status: 200 len: 1315 microversion: 2.1 time: 0.346225 Oct 04 18:42:58.221791 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1838/3635] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:57 2022] GET /compute/v2.1/servers/471125af-1ec3-44b3-bb69-36b04a03fdd5 => generated 1315 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:58.259780 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4dc79026-ec1f-4c11-80a6-232b442adc22 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:58.260419 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4dc79026-ec1f-4c11-80a6-232b442adc22 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] [instance: 6cc94ec4-3e28-41e0-808e-9cd2263bca7d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:58.273100 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4dc79026-ec1f-4c11-80a6-232b442adc22 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:58.273821 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4dc79026-ec1f-4c11-80a6-232b442adc22 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:58.274595 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4dc79026-ec1f-4c11-80a6-232b442adc22 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:58.275414 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4dc79026-ec1f-4c11-80a6-232b442adc22 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:58.275939 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4dc79026-ec1f-4c11-80a6-232b442adc22 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:58.276802 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4dc79026-ec1f-4c11-80a6-232b442adc22 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:58.475567 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-dc4f4b10-39cb-4f94-96ee-5dd391d5bb25 req-5397dbb7-1382-443a-a54f-af6623acb643 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "471125af-1ec3-44b3-bb69-36b04a03fdd5", "tag": "ac57cdde-4dc1-45e0-be2d-97a36a8bb374"}, {"name": "network-changed", "server_uuid": "6cc94ec4-3e28-41e0-808e-9cd2263bca7d", "tag": "1556befc-7a17-4e26-aa0f-68b9c412823d"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:58.496100 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-dc4f4b10-39cb-4f94-96ee-5dd391d5bb25 req-5397dbb7-1382-443a-a54f-af6623acb643 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:58.500021 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-dc4f4b10-39cb-4f94-96ee-5dd391d5bb25 req-5397dbb7-1382-443a-a54f-af6623acb643 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:58.501493 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-dc4f4b10-39cb-4f94-96ee-5dd391d5bb25 req-5397dbb7-1382-443a-a54f-af6623acb643 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:58.520554 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-dc4f4b10-39cb-4f94-96ee-5dd391d5bb25 req-5397dbb7-1382-443a-a54f-af6623acb643 service nova] Creating event network-changed:ac57cdde-4dc1-45e0-be2d-97a36a8bb374 for instance 471125af-1ec3-44b3-bb69-36b04a03fdd5 on n-h1-850501-14 Oct 04 18:42:58.521938 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-dc4f4b10-39cb-4f94-96ee-5dd391d5bb25 req-5397dbb7-1382-443a-a54f-af6623acb643 service nova] Creating event network-changed:1556befc-7a17-4e26-aa0f-68b9c412823d for instance 6cc94ec4-3e28-41e0-808e-9cd2263bca7d on n-h2-850501-14 Oct 04 18:42:58.533083 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-dc4f4b10-39cb-4f94-96ee-5dd391d5bb25 req-5397dbb7-1382-443a-a54f-af6623acb643 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.061989 Oct 04 18:42:58.534091 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1839/3636] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:42:58 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:42:58.592865 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-dfd8f346-05e5-4bb2-8a6d-dc70b6975546 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:58.596735 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-dfd8f346-05e5-4bb2-8a6d-dc70b6975546 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: af46589b-8af1-4394-86e3-631c7d483a12] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:58.605074 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dfd8f346-05e5-4bb2-8a6d-dc70b6975546 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:58.605959 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dfd8f346-05e5-4bb2-8a6d-dc70b6975546 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:58.606778 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dfd8f346-05e5-4bb2-8a6d-dc70b6975546 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:58.607768 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dfd8f346-05e5-4bb2-8a6d-dc70b6975546 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:58.608479 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dfd8f346-05e5-4bb2-8a6d-dc70b6975546 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:58.609761 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dfd8f346-05e5-4bb2-8a6d-dc70b6975546 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:58.719463 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:42:58.754864 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=50 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:42:58.997231 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4dc79026-ec1f-4c11-80a6-232b442adc22 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a02cd1108b947b186202f6d15e6cf0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c0b095138354810949093e7ea03b8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:59.013464 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4dc79026-ec1f-4c11-80a6-232b442adc22 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] 10.222.0.20 "GET /compute/v2.1/servers/6cc94ec4-3e28-41e0-808e-9cd2263bca7d" status: 200 len: 1364 microversion: 2.1 time: 0.757495 Oct 04 18:42:59.046789 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1798/3637] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:58 2022] GET /compute/v2.1/servers/6cc94ec4-3e28-41e0-808e-9cd2263bca7d => generated 1364 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:59.046970 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-dfd8f346-05e5-4bb2-8a6d-dc70b6975546 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:59.049075 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-66c9e1df-f3b4-48c8-8885-300de30aeac4 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:59.050359 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-66c9e1df-f3b4-48c8-8885-300de30aeac4 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 6dc7155a-e90b-4ca9-8778-02bf31eff4bd] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:59.050833 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-dfd8f346-05e5-4bb2-8a6d-dc70b6975546 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/af46589b-8af1-4394-86e3-631c7d483a12" status: 200 len: 1520 microversion: 2.1 time: 0.467421 Oct 04 18:42:59.052420 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1840/3638] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:58 2022] GET /compute/v2.1/servers/af46589b-8af1-4394-86e3-631c7d483a12 => generated 1520 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:59.060088 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-66c9e1df-f3b4-48c8-8885-300de30aeac4 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:59.060573 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-66c9e1df-f3b4-48c8-8885-300de30aeac4 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:59.061412 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-66c9e1df-f3b4-48c8-8885-300de30aeac4 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:59.062153 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-66c9e1df-f3b4-48c8-8885-300de30aeac4 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:59.062639 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-66c9e1df-f3b4-48c8-8885-300de30aeac4 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:59.063383 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-66c9e1df-f3b4-48c8-8885-300de30aeac4 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:59.076284 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f69409fa-ceba-48d2-b7e4-f77097527155 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:59.076284 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f69409fa-ceba-48d2-b7e4-f77097527155 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] [instance: 68f2b230-fee6-4a7c-873f-3dfd659b9338] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:59.105314 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f69409fa-ceba-48d2-b7e4-f77097527155 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:59.105314 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f69409fa-ceba-48d2-b7e4-f77097527155 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:59.105314 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f69409fa-ceba-48d2-b7e4-f77097527155 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:59.110531 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f69409fa-ceba-48d2-b7e4-f77097527155 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:59.111511 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f69409fa-ceba-48d2-b7e4-f77097527155 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:59.112187 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f69409fa-ceba-48d2-b7e4-f77097527155 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:59.164306 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f69409fa-ceba-48d2-b7e4-f77097527155 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:59.165091 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f69409fa-ceba-48d2-b7e4-f77097527155 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:59.165716 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f69409fa-ceba-48d2-b7e4-f77097527155 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:59.166360 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-f69409fa-ceba-48d2-b7e4-f77097527155 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lazy-loading 'fault' on Instance uuid 68f2b230-fee6-4a7c-873f-3dfd659b9338 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:42:59.232668 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f69409fa-ceba-48d2-b7e4-f77097527155 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '777a7a51e45b498597f7a1202217575c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b43fba16115404aaa793fb907fd257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:59.243971 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f69409fa-ceba-48d2-b7e4-f77097527155 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] 10.222.0.20 "GET /compute/v2.1/servers/68f2b230-fee6-4a7c-873f-3dfd659b9338" status: 200 len: 1306 microversion: 2.1 time: 0.190249 Oct 04 18:42:59.261318 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1841/3639] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:59 2022] GET /compute/v2.1/servers/68f2b230-fee6-4a7c-873f-3dfd659b9338 => generated 1306 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:59.267511 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9cdd6829-50b5-465d-b406-6e63e7895697 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:59.268162 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-9cdd6829-50b5-465d-b406-6e63e7895697 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] [instance: 471125af-1ec3-44b3-bb69-36b04a03fdd5] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:59.275623 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9cdd6829-50b5-465d-b406-6e63e7895697 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:59.276356 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9cdd6829-50b5-465d-b406-6e63e7895697 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:59.276574 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9cdd6829-50b5-465d-b406-6e63e7895697 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:59.277292 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9cdd6829-50b5-465d-b406-6e63e7895697 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:59.278235 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9cdd6829-50b5-465d-b406-6e63e7895697 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:59.278772 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9cdd6829-50b5-465d-b406-6e63e7895697 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:59.676111 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-66c9e1df-f3b4-48c8-8885-300de30aeac4 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:59.691215 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=24 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:42:59.694909 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-66c9e1df-f3b4-48c8-8885-300de30aeac4 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/6dc7155a-e90b-4ca9-8778-02bf31eff4bd" status: 200 len: 1515 microversion: 2.1 time: 0.654706 Oct 04 18:42:59.695911 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1799/3640] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:59 2022] GET /compute/v2.1/servers/6dc7155a-e90b-4ca9-8778-02bf31eff4bd => generated 1515 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:42:59.795505 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9cdd6829-50b5-465d-b406-6e63e7895697 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8d2814c23a4aa9806d56ce99c89e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8596483de9f14de9a88cdb787841fd3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:59.807307 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9cdd6829-50b5-465d-b406-6e63e7895697 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/servers/471125af-1ec3-44b3-bb69-36b04a03fdd5" status: 200 len: 1315 microversion: 2.1 time: 0.544749 Oct 04 18:42:59.808728 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1842/3641] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:59 2022] GET /compute/v2.1/servers/471125af-1ec3-44b3-bb69-36b04a03fdd5 => generated 1315 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:00.046010 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-06343750-167a-46bf-9542-6801ec69af7e tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:00.059304 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-06343750-167a-46bf-9542-6801ec69af7e tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] [instance: 6cc94ec4-3e28-41e0-808e-9cd2263bca7d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:00.076917 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-06343750-167a-46bf-9542-6801ec69af7e tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:00.078224 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-06343750-167a-46bf-9542-6801ec69af7e tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:00.078721 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3066e986-1320-4acd-958d-5b372213c034 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:00.080205 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3066e986-1320-4acd-958d-5b372213c034 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: af46589b-8af1-4394-86e3-631c7d483a12] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:00.081772 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-06343750-167a-46bf-9542-6801ec69af7e tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:00.083361 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-06343750-167a-46bf-9542-6801ec69af7e tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:00.085739 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-06343750-167a-46bf-9542-6801ec69af7e tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:00.086798 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-06343750-167a-46bf-9542-6801ec69af7e tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:00.101649 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3066e986-1320-4acd-958d-5b372213c034 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:00.102461 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3066e986-1320-4acd-958d-5b372213c034 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:00.104920 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3066e986-1320-4acd-958d-5b372213c034 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:00.106315 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3066e986-1320-4acd-958d-5b372213c034 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:00.108682 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3066e986-1320-4acd-958d-5b372213c034 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:00.109668 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3066e986-1320-4acd-958d-5b372213c034 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:00.555936 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3066e986-1320-4acd-958d-5b372213c034 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:00.572444 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-06343750-167a-46bf-9542-6801ec69af7e tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a02cd1108b947b186202f6d15e6cf0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c0b095138354810949093e7ea03b8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:00.577655 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3066e986-1320-4acd-958d-5b372213c034 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/af46589b-8af1-4394-86e3-631c7d483a12" status: 200 len: 1520 microversion: 2.1 time: 0.502732 Oct 04 18:43:00.580137 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-06343750-167a-46bf-9542-6801ec69af7e tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] 10.222.0.20 "GET /compute/v2.1/servers/6cc94ec4-3e28-41e0-808e-9cd2263bca7d" status: 200 len: 1364 microversion: 2.1 time: 0.541857 Oct 04 18:43:00.598400 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1800/3642] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:00 2022] GET /compute/v2.1/servers/6cc94ec4-3e28-41e0-808e-9cd2263bca7d => generated 1364 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:00.603653 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e2ecebef-08f9-4b74-9936-cc109b9c43e7 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:00.604307 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e2ecebef-08f9-4b74-9936-cc109b9c43e7 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] [instance: 68f2b230-fee6-4a7c-873f-3dfd659b9338] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:00.605068 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1843/3643] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:00 2022] GET /compute/v2.1/servers/af46589b-8af1-4394-86e3-631c7d483a12 => generated 1520 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:00.613188 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e2ecebef-08f9-4b74-9936-cc109b9c43e7 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:00.613414 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-586e375d-a3c6-453e-9e61-08ab3c7f55c1 req-edda8438-99d1-469c-965b-9412103c3d8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68f2b230-fee6-4a7c-873f-3dfd659b9338", "name": "network-vif-deleted", "tag": "48ff58dc-2007-4baf-8109-1524f9ab9238"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:43:00.613679 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e2ecebef-08f9-4b74-9936-cc109b9c43e7 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:00.614126 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e2ecebef-08f9-4b74-9936-cc109b9c43e7 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:00.614835 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e2ecebef-08f9-4b74-9936-cc109b9c43e7 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:00.615291 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e2ecebef-08f9-4b74-9936-cc109b9c43e7 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:00.615719 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e2ecebef-08f9-4b74-9936-cc109b9c43e7 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:00.623117 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-586e375d-a3c6-453e-9e61-08ab3c7f55c1 req-edda8438-99d1-469c-965b-9412103c3d8e service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:00.623597 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-586e375d-a3c6-453e-9e61-08ab3c7f55c1 req-edda8438-99d1-469c-965b-9412103c3d8e service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:00.624029 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-586e375d-a3c6-453e-9e61-08ab3c7f55c1 req-edda8438-99d1-469c-965b-9412103c3d8e service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:00.635917 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-586e375d-a3c6-453e-9e61-08ab3c7f55c1 req-edda8438-99d1-469c-965b-9412103c3d8e service nova] Creating event network-vif-deleted:48ff58dc-2007-4baf-8109-1524f9ab9238 for instance 68f2b230-fee6-4a7c-873f-3dfd659b9338 on n-h2-850501-14 Oct 04 18:43:00.640749 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-586e375d-a3c6-453e-9e61-08ab3c7f55c1 req-edda8438-99d1-469c-965b-9412103c3d8e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034245 Oct 04 18:43:00.642165 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1844/3644] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:43:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:43:00.653723 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e2ecebef-08f9-4b74-9936-cc109b9c43e7 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:00.653723 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e2ecebef-08f9-4b74-9936-cc109b9c43e7 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:00.653723 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e2ecebef-08f9-4b74-9936-cc109b9c43e7 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:00.653991 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-e2ecebef-08f9-4b74-9936-cc109b9c43e7 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lazy-loading 'fault' on Instance uuid 68f2b230-fee6-4a7c-873f-3dfd659b9338 {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:43:00.724038 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4305aff4-e733-4d36-9bd0-5e7c160a4a0b tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:00.724779 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-4305aff4-e733-4d36-9bd0-5e7c160a4a0b tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 6dc7155a-e90b-4ca9-8778-02bf31eff4bd] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:00.733170 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4305aff4-e733-4d36-9bd0-5e7c160a4a0b tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:00.733765 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4305aff4-e733-4d36-9bd0-5e7c160a4a0b tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:00.734207 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4305aff4-e733-4d36-9bd0-5e7c160a4a0b tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:00.734973 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4305aff4-e733-4d36-9bd0-5e7c160a4a0b tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:00.736455 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4305aff4-e733-4d36-9bd0-5e7c160a4a0b tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:00.737055 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4305aff4-e733-4d36-9bd0-5e7c160a4a0b tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:00.794733 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e2ecebef-08f9-4b74-9936-cc109b9c43e7 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '777a7a51e45b498597f7a1202217575c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b43fba16115404aaa793fb907fd257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:00.805925 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e2ecebef-08f9-4b74-9936-cc109b9c43e7 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] 10.222.0.20 "GET /compute/v2.1/servers/68f2b230-fee6-4a7c-873f-3dfd659b9338" status: 200 len: 1306 microversion: 2.1 time: 0.206090 Oct 04 18:43:00.807782 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1801/3645] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:00 2022] GET /compute/v2.1/servers/68f2b230-fee6-4a7c-873f-3dfd659b9338 => generated 1306 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:00.831582 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d89ae8fd-7913-49ad-ba97-4b16d83fecb9 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:00.832433 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d89ae8fd-7913-49ad-ba97-4b16d83fecb9 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] [instance: 471125af-1ec3-44b3-bb69-36b04a03fdd5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:00.839753 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d89ae8fd-7913-49ad-ba97-4b16d83fecb9 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:00.840286 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d89ae8fd-7913-49ad-ba97-4b16d83fecb9 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:00.840932 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d89ae8fd-7913-49ad-ba97-4b16d83fecb9 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:00.841824 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d89ae8fd-7913-49ad-ba97-4b16d83fecb9 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:00.842282 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d89ae8fd-7913-49ad-ba97-4b16d83fecb9 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:00.842874 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d89ae8fd-7913-49ad-ba97-4b16d83fecb9 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:00.884676 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-4305aff4-e733-4d36-9bd0-5e7c160a4a0b tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:00.895198 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-4305aff4-e733-4d36-9bd0-5e7c160a4a0b tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/6dc7155a-e90b-4ca9-8778-02bf31eff4bd" status: 200 len: 1473 microversion: 2.1 time: 0.179847 Oct 04 18:43:00.896083 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1845/3646] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:00 2022] GET /compute/v2.1/servers/6dc7155a-e90b-4ca9-8778-02bf31eff4bd => generated 1473 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:43:00.906725 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-a516bde6-f433-477f-ba75-4f11907795cd req-5ab41127-c11d-4a63-abad-39d977e852f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dc7155a-e90b-4ca9-8778-02bf31eff4bd", "name": "network-vif-deleted", "tag": "9bc5f07a-266e-4414-b9fe-5cff3fe5fca9"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:43:00.919441 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-a516bde6-f433-477f-ba75-4f11907795cd req-5ab41127-c11d-4a63-abad-39d977e852f5 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:00.920370 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-a516bde6-f433-477f-ba75-4f11907795cd req-5ab41127-c11d-4a63-abad-39d977e852f5 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:00.927504 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-a516bde6-f433-477f-ba75-4f11907795cd req-5ab41127-c11d-4a63-abad-39d977e852f5 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:00.938765 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-a516bde6-f433-477f-ba75-4f11907795cd req-5ab41127-c11d-4a63-abad-39d977e852f5 service nova] Creating event network-vif-deleted:9bc5f07a-266e-4414-b9fe-5cff3fe5fca9 for instance 6dc7155a-e90b-4ca9-8778-02bf31eff4bd on n-h1-850501-14 Oct 04 18:43:00.945889 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-a516bde6-f433-477f-ba75-4f11907795cd req-5ab41127-c11d-4a63-abad-39d977e852f5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043778 Oct 04 18:43:00.946982 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1846/3647] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:43:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:43:01.263848 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d89ae8fd-7913-49ad-ba97-4b16d83fecb9 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8d2814c23a4aa9806d56ce99c89e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8596483de9f14de9a88cdb787841fd3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:01.271924 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d89ae8fd-7913-49ad-ba97-4b16d83fecb9 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/servers/471125af-1ec3-44b3-bb69-36b04a03fdd5" status: 200 len: 1315 microversion: 2.1 time: 0.444646 Oct 04 18:43:01.272623 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1802/3648] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:00 2022] GET /compute/v2.1/servers/471125af-1ec3-44b3-bb69-36b04a03fdd5 => generated 1315 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:01.607840 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a7959ce3-b869-432a-9aa6-4340c9ce4cfc tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:01.608589 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a7959ce3-b869-432a-9aa6-4340c9ce4cfc tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] [instance: 6cc94ec4-3e28-41e0-808e-9cd2263bca7d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:01.617763 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c47ccbb8-684e-44a0-a49d-e4ffc534ef50 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:01.618784 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c47ccbb8-684e-44a0-a49d-e4ffc534ef50 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: af46589b-8af1-4394-86e3-631c7d483a12] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:01.618916 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a7959ce3-b869-432a-9aa6-4340c9ce4cfc tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:01.619518 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a7959ce3-b869-432a-9aa6-4340c9ce4cfc tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:01.620121 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a7959ce3-b869-432a-9aa6-4340c9ce4cfc tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:01.621803 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a7959ce3-b869-432a-9aa6-4340c9ce4cfc tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:01.623911 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a7959ce3-b869-432a-9aa6-4340c9ce4cfc tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:01.625533 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a7959ce3-b869-432a-9aa6-4340c9ce4cfc tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:01.628188 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c47ccbb8-684e-44a0-a49d-e4ffc534ef50 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:01.629042 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c47ccbb8-684e-44a0-a49d-e4ffc534ef50 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:01.630029 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c47ccbb8-684e-44a0-a49d-e4ffc534ef50 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:01.631279 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c47ccbb8-684e-44a0-a49d-e4ffc534ef50 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:01.633465 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c47ccbb8-684e-44a0-a49d-e4ffc534ef50 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:01.634098 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c47ccbb8-684e-44a0-a49d-e4ffc534ef50 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:02.131400 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a7959ce3-b869-432a-9aa6-4340c9ce4cfc tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a02cd1108b947b186202f6d15e6cf0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c0b095138354810949093e7ea03b8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:02.148129 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a7959ce3-b869-432a-9aa6-4340c9ce4cfc tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] 10.222.0.20 "GET /compute/v2.1/servers/6cc94ec4-3e28-41e0-808e-9cd2263bca7d" status: 200 len: 1364 microversion: 2.1 time: 0.545451 Oct 04 18:43:02.159348 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1847/3649] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:01 2022] GET /compute/v2.1/servers/6cc94ec4-3e28-41e0-808e-9cd2263bca7d => generated 1364 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:43:02.164541 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-08c9a8c4-d1c5-47e3-bca4-6aadfcb58c49 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:02.165441 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-08c9a8c4-d1c5-47e3-bca4-6aadfcb58c49 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] [instance: 68f2b230-fee6-4a7c-873f-3dfd659b9338] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:02.186491 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-08c9a8c4-d1c5-47e3-bca4-6aadfcb58c49 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:02.196495 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-08c9a8c4-d1c5-47e3-bca4-6aadfcb58c49 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:02.196495 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-08c9a8c4-d1c5-47e3-bca4-6aadfcb58c49 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:02.196495 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-08c9a8c4-d1c5-47e3-bca4-6aadfcb58c49 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:02.196495 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-08c9a8c4-d1c5-47e3-bca4-6aadfcb58c49 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:02.197097 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c47ccbb8-684e-44a0-a49d-e4ffc534ef50 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:02.197979 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-08c9a8c4-d1c5-47e3-bca4-6aadfcb58c49 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:02.203321 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:43:02.220193 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c47ccbb8-684e-44a0-a49d-e4ffc534ef50 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/af46589b-8af1-4394-86e3-631c7d483a12" status: 200 len: 1520 microversion: 2.1 time: 0.604428 Oct 04 18:43:02.221533 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1803/3650] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:01 2022] GET /compute/v2.1/servers/af46589b-8af1-4394-86e3-631c7d483a12 => generated 1520 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:43:02.231330 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9c42119d-a6c6-476a-bd71-de80b4de6a8f tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:02.232410 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9c42119d-a6c6-476a-bd71-de80b4de6a8f tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 6dc7155a-e90b-4ca9-8778-02bf31eff4bd] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:02.244841 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9c42119d-a6c6-476a-bd71-de80b4de6a8f tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:02.245661 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9c42119d-a6c6-476a-bd71-de80b4de6a8f tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:02.246944 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9c42119d-a6c6-476a-bd71-de80b4de6a8f tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:02.248456 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9c42119d-a6c6-476a-bd71-de80b4de6a8f tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:02.249091 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9c42119d-a6c6-476a-bd71-de80b4de6a8f tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:02.249682 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9c42119d-a6c6-476a-bd71-de80b4de6a8f tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:02.274526 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-08c9a8c4-d1c5-47e3-bca4-6aadfcb58c49 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:02.274526 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-08c9a8c4-d1c5-47e3-bca4-6aadfcb58c49 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:02.274526 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-08c9a8c4-d1c5-47e3-bca4-6aadfcb58c49 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:02.274526 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-08c9a8c4-d1c5-47e3-bca4-6aadfcb58c49 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lazy-loading 'fault' on Instance uuid 68f2b230-fee6-4a7c-873f-3dfd659b9338 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:43:02.281169 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:43:02.322894 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9c42119d-a6c6-476a-bd71-de80b4de6a8f tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:02.323439 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9c42119d-a6c6-476a-bd71-de80b4de6a8f tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:02.323877 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9c42119d-a6c6-476a-bd71-de80b4de6a8f tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:02.324361 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-9c42119d-a6c6-476a-bd71-de80b4de6a8f tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lazy-loading 'fault' on Instance uuid 6dc7155a-e90b-4ca9-8778-02bf31eff4bd {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:43:02.370044 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-08c9a8c4-d1c5-47e3-bca4-6aadfcb58c49 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '777a7a51e45b498597f7a1202217575c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b43fba16115404aaa793fb907fd257f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:02.392974 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-08c9a8c4-d1c5-47e3-bca4-6aadfcb58c49 tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] 10.222.0.20 "GET /compute/v2.1/servers/68f2b230-fee6-4a7c-873f-3dfd659b9338" status: 200 len: 1306 microversion: 2.1 time: 0.230623 Oct 04 18:43:02.395297 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1848/3651] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:02 2022] GET /compute/v2.1/servers/68f2b230-fee6-4a7c-873f-3dfd659b9338 => generated 1306 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:02.402950 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1a3d658d-5e6e-47d1-97a6-c4591eb0886f tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:02.404103 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1a3d658d-5e6e-47d1-97a6-c4591eb0886f tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] [instance: 471125af-1ec3-44b3-bb69-36b04a03fdd5] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:02.417897 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1a3d658d-5e6e-47d1-97a6-c4591eb0886f tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:02.422448 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1a3d658d-5e6e-47d1-97a6-c4591eb0886f tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:02.422448 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1a3d658d-5e6e-47d1-97a6-c4591eb0886f tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:02.422448 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1a3d658d-5e6e-47d1-97a6-c4591eb0886f tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:02.422448 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1a3d658d-5e6e-47d1-97a6-c4591eb0886f tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:02.422448 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1a3d658d-5e6e-47d1-97a6-c4591eb0886f tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:02.759901 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9c42119d-a6c6-476a-bd71-de80b4de6a8f tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:02.774166 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9c42119d-a6c6-476a-bd71-de80b4de6a8f tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/6dc7155a-e90b-4ca9-8778-02bf31eff4bd" status: 200 len: 1319 microversion: 2.1 time: 0.551245 Oct 04 18:43:02.777699 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1804/3652] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:02 2022] GET /compute/v2.1/servers/6dc7155a-e90b-4ca9-8778-02bf31eff4bd => generated 1319 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:02.940072 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1a3d658d-5e6e-47d1-97a6-c4591eb0886f tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8d2814c23a4aa9806d56ce99c89e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8596483de9f14de9a88cdb787841fd3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:02.948525 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1a3d658d-5e6e-47d1-97a6-c4591eb0886f tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/servers/471125af-1ec3-44b3-bb69-36b04a03fdd5" status: 200 len: 1315 microversion: 2.1 time: 0.551788 Oct 04 18:43:02.949126 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1849/3653] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:02 2022] GET /compute/v2.1/servers/471125af-1ec3-44b3-bb69-36b04a03fdd5 => generated 1315 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:03.230704 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4e7b9bb4-4424-4e28-bdba-6231f7a7ee9a tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:03.231499 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-4e7b9bb4-4424-4e28-bdba-6231f7a7ee9a tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] [instance: 6cc94ec4-3e28-41e0-808e-9cd2263bca7d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:03.243480 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4e7b9bb4-4424-4e28-bdba-6231f7a7ee9a tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:03.243984 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4e7b9bb4-4424-4e28-bdba-6231f7a7ee9a tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:03.246795 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4e7b9bb4-4424-4e28-bdba-6231f7a7ee9a tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:03.247533 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4e7b9bb4-4424-4e28-bdba-6231f7a7ee9a tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:03.247996 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4e7b9bb4-4424-4e28-bdba-6231f7a7ee9a tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:03.248451 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4e7b9bb4-4424-4e28-bdba-6231f7a7ee9a tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:03.273070 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-28d92926-837f-42be-a21c-8b7db0282641 tempest-SecurityGroupsNegativeTestJSON-1630376305 tempest-SecurityGroupsNegativeTestJSON-1630376305-project] Calling method '.version_select at 0x7fe259467b80>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:03.295838 n-d-850501-14 devstack@n-api.service[123002]: DEBUG neutronclient.v2_0.client [None req-28d92926-837f-42be-a21c-8b7db0282641 tempest-SecurityGroupsNegativeTestJSON-1630376305 tempest-SecurityGroupsNegativeTestJSON-1630376305-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 1ab3b254-f7dd-44dd-b741-94e12377c8c1 does not exist", "detail": ""}} {{(pid=123002) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:43:03.296556 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.security_group_api [None req-28d92926-837f-42be-a21c-8b7db0282641 tempest-SecurityGroupsNegativeTestJSON-1630376305 tempest-SecurityGroupsNegativeTestJSON-1630376305-project] Neutron security group 1ab3b254-f7dd-44dd-b741-94e12377c8c1 not found {{(pid=123002) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 18:43:03.297080 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-28d92926-837f-42be-a21c-8b7db0282641 tempest-SecurityGroupsNegativeTestJSON-1630376305 tempest-SecurityGroupsNegativeTestJSON-1630376305-project] HTTP exception thrown: Security group 1ab3b254-f7dd-44dd-b741-94e12377c8c1 does not exist Oct 04 18:43:03.297080 n-d-850501-14 devstack@n-api.service[123002]: Neutron server returns request_ids: ['req-7125c61c-5e69-4c29-9f2b-3c6b17f6b69f'] Oct 04 18:43:03.299233 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-28d92926-837f-42be-a21c-8b7db0282641 tempest-SecurityGroupsNegativeTestJSON-1630376305 tempest-SecurityGroupsNegativeTestJSON-1630376305-project] Request method failure captured: Oct 04 18:43:03.299233 n-d-850501-14 devstack@n-api.service[123002]: request: DELETE /compute/v2.1/os-security-groups/1ab3b254-f7dd-44dd-b741-94e12377c8c1 HTTP/1.1 Oct 04 18:43:03.299233 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:43:03.299233 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:43:03.299233 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:43:03.299233 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:43:03.299233 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:43:03.299233 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:43:03.299233 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:43:03.299233 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:43:03.299233 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH63KNlRoiv15mgLha6yVcIPbOxjSNrTZ96yCu9HZcigWsGzIRUORuy9WjwLvt3oujIkARPXEal-6wG3XoYUTfr1SYnk_MkPUj48nAa7ye-K6AW64mM_XnBqIDttzrIMFHEmmBoNrHI_E5l-mz7pURwd1u8JzhKE7UZ0lCkC9nUgkm8 Oct 04 18:43:03.299233 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:43:03.299233 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:43:03.299233 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:43:03.299233 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:43:03.299233 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:43:03.299233 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:43:03.299233 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: f89b3ef5c94d45ad8eed20081f14166c Oct 04 18:43:03.299233 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1630376305 Oct 04 18:43:03.299233 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:43:03.299233 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:43:03.299233 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f89b3ef5c94d45ad8eed20081f14166c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f89b3ef5c94d45ad8eed20081f14166c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f89b3ef5c94d45ad8eed20081f14166c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f89b3ef5c94d45ad8eed20081f14166c"}]}] Oct 04 18:43:03.299233 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1630376305 Oct 04 18:43:03.299233 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: f89b3ef5c94d45ad8eed20081f14166c Oct 04 18:43:03.299233 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1630376305 Oct 04 18:43:03.299233 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-SecurityGroupsNegativeTestJSON-1630376305-project Oct 04 18:43:03.299233 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:43:03.299233 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:43:03.299233 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: a4dbccf68b2145dab798c387cbdb564f Oct 04 18:43:03.299233 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1630376305-project Oct 04 18:43:03.299233 n-d-850501-14 devstack@n-api.service[123002]: method: Oct 04 18:43:03.299233 n-d-850501-14 devstack@n-api.service[123002]: exception: Security group 1ab3b254-f7dd-44dd-b741-94e12377c8c1 does not exist Oct 04 18:43:03.299233 n-d-850501-14 devstack@n-api.service[123002]: Neutron server returns request_ids: ['req-7125c61c-5e69-4c29-9f2b-3c6b17f6b69f'] Oct 04 18:43:03.299233 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '1ab3b254-f7dd-44dd-b741-94e12377c8c1'} Oct 04 18:43:03.299233 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:43:03.299233 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:43:03.299233 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 18:43:03.299233 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 18:43:03.299233 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:43:03.299233 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:43:03.299233 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 18:43:03.299233 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 18:43:03.299233 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:43:03.299233 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:43:03.299233 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:43:03.299233 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 18:43:03.299233 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:43:03.299233 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:43:03.299233 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:43:03.299233 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:43:03.299233 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:43:03.299233 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:43:03.299233 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:43:03.299233 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:43:03.299233 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:43:03.299233 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:43:03.299233 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:43:03.299233 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:43:03.299233 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:43:03.299233 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:43:03.299233 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 1ab3b254-f7dd-44dd-b741-94e12377c8c1 does not exist Oct 04 18:43:03.309900 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7125c61c-5e69-4c29-9f2b-3c6b17f6b69f'] Oct 04 18:43:03.309900 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:43:03.309900 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:43:03.309900 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:43:03.309900 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:43:03.309900 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 04 18:43:03.309900 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 18:43:03.309900 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 18:43:03.309900 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 18:43:03.309900 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 1ab3b254-f7dd-44dd-b741-94e12377c8c1 does not exist Oct 04 18:43:03.309900 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7125c61c-5e69-4c29-9f2b-3c6b17f6b69f'] Oct 04 18:43:03.309900 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:43:03.309900 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:43:03.309900 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:43:03.309900 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:43:03.309900 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:43:03.309900 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:43:03.309900 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:43:03.309900 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:43:03.309900 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:43:03.309900 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:43:03.309900 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:43:03.309900 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:43:03.309900 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 04 18:43:03.309900 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 18:43:03.309900 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 1ab3b254-f7dd-44dd-b741-94e12377c8c1 does not exist Oct 04 18:43:03.309900 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7125c61c-5e69-4c29-9f2b-3c6b17f6b69f'] Oct 04 18:43:03.309900 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:43:03.309900 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:43:03.309900 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:43:03.309900 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:43:03.309900 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:43:03.309900 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:43:03.309900 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:43:03.309900 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:43:03.309900 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 1ab3b254-f7dd-44dd-b741-94e12377c8c1 does not exist Oct 04 18:43:03.309900 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7125c61c-5e69-4c29-9f2b-3c6b17f6b69f'] Oct 04 18:43:03.309900 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:43:03.309900 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-28d92926-837f-42be-a21c-8b7db0282641 tempest-SecurityGroupsNegativeTestJSON-1630376305 tempest-SecurityGroupsNegativeTestJSON-1630376305-project] Returning 404 to user: Security group 1ab3b254-f7dd-44dd-b741-94e12377c8c1 does not exist Oct 04 18:43:03.309900 n-d-850501-14 devstack@n-api.service[123002]: Neutron server returns request_ids: ['req-7125c61c-5e69-4c29-9f2b-3c6b17f6b69f'] {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:43:03.309900 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-28d92926-837f-42be-a21c-8b7db0282641 tempest-SecurityGroupsNegativeTestJSON-1630376305 tempest-SecurityGroupsNegativeTestJSON-1630376305-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/1ab3b254-f7dd-44dd-b741-94e12377c8c1" status: 404 len: 194 microversion: 2.1 time: 0.161875 Oct 04 18:43:03.309900 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1805/3654] 10.222.0.20 () {58 vars in 1272 bytes} [Tue Oct 4 18:43:03 2022] DELETE /compute/v2.1/os-security-groups/1ab3b254-f7dd-44dd-b741-94e12377c8c1 => generated 194 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:43:03.317537 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-fc7b13a8-f913-49b5-a3c9-5c84bff9bf8d tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:03.317809 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-fc7b13a8-f913-49b5-a3c9-5c84bff9bf8d tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: af46589b-8af1-4394-86e3-631c7d483a12] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:03.333600 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fc7b13a8-f913-49b5-a3c9-5c84bff9bf8d tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:03.335533 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fc7b13a8-f913-49b5-a3c9-5c84bff9bf8d tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:03.335533 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fc7b13a8-f913-49b5-a3c9-5c84bff9bf8d tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:03.335533 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fc7b13a8-f913-49b5-a3c9-5c84bff9bf8d tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:03.335839 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fc7b13a8-f913-49b5-a3c9-5c84bff9bf8d tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:03.340203 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fc7b13a8-f913-49b5-a3c9-5c84bff9bf8d tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:03.511330 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-4e7b9bb4-4424-4e28-bdba-6231f7a7ee9a tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a02cd1108b947b186202f6d15e6cf0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c0b095138354810949093e7ea03b8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:03.527417 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-4e7b9bb4-4424-4e28-bdba-6231f7a7ee9a tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] 10.222.0.20 "GET /compute/v2.1/servers/6cc94ec4-3e28-41e0-808e-9cd2263bca7d" status: 200 len: 1364 microversion: 2.1 time: 0.302081 Oct 04 18:43:03.543073 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1850/3655] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:03 2022] GET /compute/v2.1/servers/6cc94ec4-3e28-41e0-808e-9cd2263bca7d => generated 1364 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:03.543073 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6504527a-8649-4c40-a0ed-12c51d78d9f8 tempest-SecurityGroupsNegativeTestJSON-1630376305 tempest-SecurityGroupsNegativeTestJSON-1630376305-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.004404 Oct 04 18:43:03.544732 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1851/3656] 10.222.0.20 () {58 vars in 1164 bytes} [Tue Oct 4 18:43:03 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 16 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 04 18:43:03.550992 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-481af150-251d-492a-ac41-bf71c482380c tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:03.551849 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-481af150-251d-492a-ac41-bf71c482380c tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] [instance: 68f2b230-fee6-4a7c-873f-3dfd659b9338] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:03.558241 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-481af150-251d-492a-ac41-bf71c482380c tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:03.558925 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-481af150-251d-492a-ac41-bf71c482380c tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:03.559537 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-481af150-251d-492a-ac41-bf71c482380c tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:03.560441 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-481af150-251d-492a-ac41-bf71c482380c tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:03.561046 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-481af150-251d-492a-ac41-bf71c482380c tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:03.561627 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-481af150-251d-492a-ac41-bf71c482380c tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:03.579389 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-481af150-251d-492a-ac41-bf71c482380c tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] HTTP exception thrown: Instance 68f2b230-fee6-4a7c-873f-3dfd659b9338 could not be found. Oct 04 18:43:03.582269 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-481af150-251d-492a-ac41-bf71c482380c tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Request method failure captured: Oct 04 18:43:03.582269 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/68f2b230-fee6-4a7c-873f-3dfd659b9338 HTTP/1.1 Oct 04 18:43:03.582269 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:43:03.582269 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:43:03.582269 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:43:03.582269 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:43:03.582269 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:43:03.582269 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:43:03.582269 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:43:03.582269 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:43:03.582269 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPH5IaH15tr5SVoVt4hozZEg3Js8ZWcVBx0oRn243qNZFUMSmPeMa3Gyq91gLee0lw2Klv1E5mNTaxmJJRYhRawPEzSfr-EeZwa66fdrMa4-gu9mqAey6rHA1ZnVCWU_BX1Hua5XpKyhleXrqcIVEtamRhatLhfvMeiTTjEHkZqIKSBQ Oct 04 18:43:03.582269 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:43:03.582269 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:43:03.582269 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:43:03.582269 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:43:03.582269 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:43:03.582269 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:43:03.582269 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 1b43fba16115404aaa793fb907fd257f Oct 04 18:43:03.582269 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-SecurityGroupsTestJSON-752173812 Oct 04 18:43:03.582269 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:43:03.582269 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:43:03.582269 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1b43fba16115404aaa793fb907fd257f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1b43fba16115404aaa793fb907fd257f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1b43fba16115404aaa793fb907fd257f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1b43fba16115404aaa793fb907fd257f"}]}] Oct 04 18:43:03.582269 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-SecurityGroupsTestJSON-752173812 Oct 04 18:43:03.582269 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 1b43fba16115404aaa793fb907fd257f Oct 04 18:43:03.582269 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-752173812 Oct 04 18:43:03.582269 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-SecurityGroupsTestJSON-752173812-project Oct 04 18:43:03.582269 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:43:03.582269 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:43:03.582269 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 777a7a51e45b498597f7a1202217575c Oct 04 18:43:03.582269 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-SecurityGroupsTestJSON-752173812-project Oct 04 18:43:03.582269 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:43:03.582269 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 68f2b230-fee6-4a7c-873f-3dfd659b9338 could not be found. Oct 04 18:43:03.582269 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '68f2b230-fee6-4a7c-873f-3dfd659b9338'} Oct 04 18:43:03.582269 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:43:03.582269 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:43:03.582269 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:43:03.582269 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:43:03.582269 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:43:03.582269 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:43:03.582269 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:43:03.582269 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:43:03.582269 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:43:03.582269 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:43:03.582269 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68f2b230-fee6-4a7c-873f-3dfd659b9338 could not be found. Oct 04 18:43:03.582269 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:43:03.582269 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:43:03.582269 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:43:03.582269 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:43:03.582269 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:43:03.582269 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:43:03.582269 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:43:03.582269 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:43:03.582269 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:43:03.582269 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:43:03.582269 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:43:03.582269 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:43:03.582269 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:43:03.582269 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:43:03.582269 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:43:03.582269 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:43:03.582269 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68f2b230-fee6-4a7c-873f-3dfd659b9338 could not be found. Oct 04 18:43:03.582269 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:43:03.582269 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:43:03.582269 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:43:03.586997 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:43:03.586997 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:43:03.586997 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:43:03.586997 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:43:03.586997 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:43:03.586997 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68f2b230-fee6-4a7c-873f-3dfd659b9338 could not be found. Oct 04 18:43:03.586997 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:43:03.588915 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-481af150-251d-492a-ac41-bf71c482380c tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Returning 404 to user: Instance 68f2b230-fee6-4a7c-873f-3dfd659b9338 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:43:03.590000 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-481af150-251d-492a-ac41-bf71c482380c tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] 10.222.0.20 "GET /compute/v2.1/servers/68f2b230-fee6-4a7c-873f-3dfd659b9338" status: 404 len: 111 microversion: 2.1 time: 0.044025 Oct 04 18:43:03.594162 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1852/3657] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:03 2022] GET /compute/v2.1/servers/68f2b230-fee6-4a7c-873f-3dfd659b9338 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:43:03.601039 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-cb11ac1c-6748-4b38-b655-13bf5da65193 tempest-SecurityGroupsNegativeTestJSON-1630376305 tempest-SecurityGroupsNegativeTestJSON-1630376305-project] Calling method '.version_select at 0x7fe2582d49d0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:03.605174 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-fc7b13a8-f913-49b5-a3c9-5c84bff9bf8d tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:03.620625 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-fc7b13a8-f913-49b5-a3c9-5c84bff9bf8d tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/af46589b-8af1-4394-86e3-631c7d483a12" status: 200 len: 1520 microversion: 2.1 time: 0.318250 Oct 04 18:43:03.621226 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1806/3658] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:03 2022] GET /compute/v2.1/servers/af46589b-8af1-4394-86e3-631c7d483a12 => generated 1520 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:03.633019 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-445096ce-0906-4ed2-9b4d-307e94ee9f9f tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Calling method '.version_select at 0x7fe253ff13a0>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:03.919075 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-cb11ac1c-6748-4b38-b655-13bf5da65193 tempest-SecurityGroupsNegativeTestJSON-1630376305 tempest-SecurityGroupsNegativeTestJSON-1630376305-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.322503 Oct 04 18:43:03.921527 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1853/3659] 10.222.0.20 () {58 vars in 1158 bytes} [Tue Oct 4 18:43:03 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:43:03.937405 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-03f78284-b1ca-4367-861a-1da2a617d8f2 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:03.938127 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-03f78284-b1ca-4367-861a-1da2a617d8f2 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 6dc7155a-e90b-4ca9-8778-02bf31eff4bd] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:03.946116 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-03f78284-b1ca-4367-861a-1da2a617d8f2 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:03.946792 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-03f78284-b1ca-4367-861a-1da2a617d8f2 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:03.947034 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-03f78284-b1ca-4367-861a-1da2a617d8f2 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:03.948521 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-03f78284-b1ca-4367-861a-1da2a617d8f2 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:03.949148 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-03f78284-b1ca-4367-861a-1da2a617d8f2 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:03.949593 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-03f78284-b1ca-4367-861a-1da2a617d8f2 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:03.968273 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-03f78284-b1ca-4367-861a-1da2a617d8f2 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] HTTP exception thrown: Instance 6dc7155a-e90b-4ca9-8778-02bf31eff4bd could not be found. Oct 04 18:43:03.969939 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-03f78284-b1ca-4367-861a-1da2a617d8f2 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Request method failure captured: Oct 04 18:43:03.969939 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/6dc7155a-e90b-4ca9-8778-02bf31eff4bd HTTP/1.1 Oct 04 18:43:03.969939 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:43:03.969939 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:43:03.969939 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:43:03.969939 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:43:03.969939 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:43:03.969939 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:43:03.969939 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:43:03.969939 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:43:03.969939 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPH5kaFyiFSIO0ZP4CMGEO428dJiNuEG6R-LLS8mNsVetgcf6w0D7DIrYZ_G7YOzpJ5huW8oCnx3-jlxIKVdxxsS18taUnXx6Xt5KnL4IkhJLGYxbDrAUBLCXM7M3o65rqEELwzRRnK71NdjnupluHpvvCSPBSNhy32oTLBkDAxSrOgs Oct 04 18:43:03.969939 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:43:03.969939 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:43:03.969939 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:43:03.969939 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:43:03.969939 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:43:03.969939 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:43:03.969939 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: a9046b9540144eeba512d79438635ea8 Oct 04 18:43:03.969939 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ServersTestJSON-380527700 Oct 04 18:43:03.969939 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:43:03.969939 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:43:03.969939 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a9046b9540144eeba512d79438635ea8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a9046b9540144eeba512d79438635ea8", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a9046b9540144eeba512d79438635ea8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a9046b9540144eeba512d79438635ea8"}]}] Oct 04 18:43:03.969939 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ServersTestJSON-380527700 Oct 04 18:43:03.969939 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: a9046b9540144eeba512d79438635ea8 Oct 04 18:43:03.969939 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ServersTestJSON-380527700 Oct 04 18:43:03.969939 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ServersTestJSON-380527700-project Oct 04 18:43:03.969939 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:43:03.969939 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:43:03.969939 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 8a6c3725b31449d5bf1ff757ff66c8d7 Oct 04 18:43:03.969939 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ServersTestJSON-380527700-project Oct 04 18:43:03.969939 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:43:03.969939 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 6dc7155a-e90b-4ca9-8778-02bf31eff4bd could not be found. Oct 04 18:43:03.969939 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '6dc7155a-e90b-4ca9-8778-02bf31eff4bd'} Oct 04 18:43:03.969939 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:43:03.969939 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:43:03.969939 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:43:03.969939 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:43:03.969939 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:43:03.969939 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:43:03.969939 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:43:03.969939 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:43:03.969939 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:43:03.969939 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:43:03.969939 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dc7155a-e90b-4ca9-8778-02bf31eff4bd could not be found. Oct 04 18:43:03.969939 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:43:03.969939 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:43:03.969939 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:43:03.969939 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:43:03.969939 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:43:03.969939 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:43:03.969939 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:43:03.969939 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:43:03.969939 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:43:03.969939 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:43:03.969939 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:43:03.969939 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:43:03.969939 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:43:03.969939 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:43:03.969939 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:43:03.969939 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:43:03.969939 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dc7155a-e90b-4ca9-8778-02bf31eff4bd could not be found. Oct 04 18:43:03.969939 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:43:03.969939 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:43:03.969939 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:43:03.969939 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:43:03.975865 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:43:03.975865 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:43:03.975865 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:43:03.975865 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:43:03.975865 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dc7155a-e90b-4ca9-8778-02bf31eff4bd could not be found. Oct 04 18:43:03.975865 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:43:03.975865 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-03f78284-b1ca-4367-861a-1da2a617d8f2 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Returning 404 to user: Instance 6dc7155a-e90b-4ca9-8778-02bf31eff4bd could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:43:03.975865 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-03f78284-b1ca-4367-861a-1da2a617d8f2 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/6dc7155a-e90b-4ca9-8778-02bf31eff4bd" status: 404 len: 111 microversion: 2.1 time: 0.047190 Oct 04 18:43:03.975865 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1854/3660] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:03 2022] GET /compute/v2.1/servers/6dc7155a-e90b-4ca9-8778-02bf31eff4bd => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:43:03.979157 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8013e6ae-ccee-4a88-af63-65ca34f99c24 tempest-SecurityGroupsNegativeTestJSON-1630376305 tempest-SecurityGroupsNegativeTestJSON-1630376305-project] Calling method '.version_select at 0x7fe25910cb80>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:04.131158 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-445096ce-0906-4ed2-9b4d-307e94ee9f9f tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/543ea95c-ca29-431c-8070-f2433be82f30" status: 202 len: 0 microversion: 2.1 time: 0.506643 Oct 04 18:43:04.131874 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1807/3661] 10.222.0.20 () {58 vars in 1272 bytes} [Tue Oct 4 18:43:03 2022] DELETE /compute/v2.1/os-security-groups/543ea95c-ca29-431c-8070-f2433be82f30 => generated 0 bytes in 508 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:43:04.138610 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8142eae8-3cf9-4d5d-b705-a362f7e421c5 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:04.139646 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8142eae8-3cf9-4d5d-b705-a362f7e421c5 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] [instance: 471125af-1ec3-44b3-bb69-36b04a03fdd5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:04.147512 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8142eae8-3cf9-4d5d-b705-a362f7e421c5 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:04.148174 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8142eae8-3cf9-4d5d-b705-a362f7e421c5 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:04.148843 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8142eae8-3cf9-4d5d-b705-a362f7e421c5 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:04.149775 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8142eae8-3cf9-4d5d-b705-a362f7e421c5 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:04.150439 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8142eae8-3cf9-4d5d-b705-a362f7e421c5 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:04.151069 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8142eae8-3cf9-4d5d-b705-a362f7e421c5 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:04.273551 n-d-850501-14 devstack@n-api.service[123001]: DEBUG neutronclient.v2_0.client [None req-8013e6ae-ccee-4a88-af63-65ca34f99c24 tempest-SecurityGroupsNegativeTestJSON-1630376305 tempest-SecurityGroupsNegativeTestJSON-1630376305-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=123001) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:43:04.274353 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-8013e6ae-ccee-4a88-af63-65ca34f99c24 tempest-SecurityGroupsNegativeTestJSON-1630376305 tempest-SecurityGroupsNegativeTestJSON-1630376305-project] HTTP exception thrown: Insufficient rights for removing default security group. Oct 04 18:43:04.274353 n-d-850501-14 devstack@n-api.service[123001]: Neutron server returns request_ids: ['req-6f0cc053-7060-4426-9940-e23c6e0ffc96'] Oct 04 18:43:04.276371 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8013e6ae-ccee-4a88-af63-65ca34f99c24 tempest-SecurityGroupsNegativeTestJSON-1630376305 tempest-SecurityGroupsNegativeTestJSON-1630376305-project] Request method failure captured: Oct 04 18:43:04.276371 n-d-850501-14 devstack@n-api.service[123001]: request: DELETE /compute/v2.1/os-security-groups/b86bd04c-8cc2-47ff-bdb5-37f53429a3a5 HTTP/1.1 Oct 04 18:43:04.276371 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:43:04.276371 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:43:04.276371 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:43:04.276371 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:43:04.276371 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:43:04.276371 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:43:04.276371 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:43:04.276371 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:43:04.276371 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPH63KNlRoiv15mgLha6yVcIPbOxjSNrTZ96yCu9HZcigWsGzIRUORuy9WjwLvt3oujIkARPXEal-6wG3XoYUTfr1SYnk_MkPUj48nAa7ye-K6AW64mM_XnBqIDttzrIMFHEmmBoNrHI_E5l-mz7pURwd1u8JzhKE7UZ0lCkC9nUgkm8 Oct 04 18:43:04.276371 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:43:04.276371 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:43:04.276371 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:43:04.276371 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:43:04.276371 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:43:04.276371 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:43:04.276371 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: f89b3ef5c94d45ad8eed20081f14166c Oct 04 18:43:04.276371 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1630376305 Oct 04 18:43:04.276371 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:43:04.276371 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:43:04.276371 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f89b3ef5c94d45ad8eed20081f14166c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f89b3ef5c94d45ad8eed20081f14166c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f89b3ef5c94d45ad8eed20081f14166c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f89b3ef5c94d45ad8eed20081f14166c"}]}] Oct 04 18:43:04.276371 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1630376305 Oct 04 18:43:04.276371 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: f89b3ef5c94d45ad8eed20081f14166c Oct 04 18:43:04.276371 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1630376305 Oct 04 18:43:04.276371 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-SecurityGroupsNegativeTestJSON-1630376305-project Oct 04 18:43:04.276371 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:43:04.276371 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:43:04.276371 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: a4dbccf68b2145dab798c387cbdb564f Oct 04 18:43:04.276371 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1630376305-project Oct 04 18:43:04.276371 n-d-850501-14 devstack@n-api.service[123001]: method: Oct 04 18:43:04.276371 n-d-850501-14 devstack@n-api.service[123001]: exception: Insufficient rights for removing default security group. Oct 04 18:43:04.276371 n-d-850501-14 devstack@n-api.service[123001]: Neutron server returns request_ids: ['req-6f0cc053-7060-4426-9940-e23c6e0ffc96'] Oct 04 18:43:04.276371 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': 'b86bd04c-8cc2-47ff-bdb5-37f53429a3a5'} Oct 04 18:43:04.276371 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:43:04.276371 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:43:04.276371 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 04 18:43:04.276371 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 04 18:43:04.276371 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:43:04.276371 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:43:04.276371 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 04 18:43:04.276371 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 04 18:43:04.276371 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:43:04.276371 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:43:04.276371 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 04 18:43:04.276371 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 04 18:43:04.276371 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:43:04.276371 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:43:04.276371 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:43:04.276371 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:43:04.276371 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:43:04.276371 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:43:04.276371 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:43:04.276371 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:43:04.276371 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:43:04.276371 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:43:04.276371 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:43:04.276371 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:43:04.276371 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:43:04.276371 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:43:04.276371 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Oct 04 18:43:04.281221 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6f0cc053-7060-4426-9940-e23c6e0ffc96'] Oct 04 18:43:04.281221 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:43:04.281221 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:43:04.281221 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:43:04.281221 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:43:04.281221 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 04 18:43:04.281221 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 04 18:43:04.281221 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 04 18:43:04.281221 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 04 18:43:04.281221 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Oct 04 18:43:04.281221 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6f0cc053-7060-4426-9940-e23c6e0ffc96'] Oct 04 18:43:04.281221 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:43:04.281221 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:43:04.281221 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:43:04.281221 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:43:04.281221 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:43:04.281221 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:43:04.281221 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:43:04.281221 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:43:04.281221 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:43:04.281221 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:43:04.281221 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:43:04.281221 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:43:04.281221 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 04 18:43:04.281221 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 18:43:04.281221 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Oct 04 18:43:04.281221 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6f0cc053-7060-4426-9940-e23c6e0ffc96'] Oct 04 18:43:04.281221 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:43:04.281221 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:43:04.281221 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:43:04.281221 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:43:04.281221 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:43:04.281221 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:43:04.281221 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:43:04.281221 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:43:04.281221 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Oct 04 18:43:04.281221 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6f0cc053-7060-4426-9940-e23c6e0ffc96'] Oct 04 18:43:04.281221 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:43:04.281221 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8013e6ae-ccee-4a88-af63-65ca34f99c24 tempest-SecurityGroupsNegativeTestJSON-1630376305 tempest-SecurityGroupsNegativeTestJSON-1630376305-project] Returning 400 to user: Insufficient rights for removing default security group. Oct 04 18:43:04.281221 n-d-850501-14 devstack@n-api.service[123001]: Neutron server returns request_ids: ['req-6f0cc053-7060-4426-9940-e23c6e0ffc96'] {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:43:04.281221 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8013e6ae-ccee-4a88-af63-65ca34f99c24 tempest-SecurityGroupsNegativeTestJSON-1630376305 tempest-SecurityGroupsNegativeTestJSON-1630376305-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/b86bd04c-8cc2-47ff-bdb5-37f53429a3a5" status: 400 len: 182 microversion: 2.1 time: 0.305897 Oct 04 18:43:04.290369 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1855/3662] 10.222.0.20 () {58 vars in 1272 bytes} [Tue Oct 4 18:43:03 2022] DELETE /compute/v2.1/os-security-groups/b86bd04c-8cc2-47ff-bdb5-37f53429a3a5 => generated 182 bytes in 309 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:43:04.290369 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-54f26e88-4820-4f9b-89d2-7856a4eb261a tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '.version_select at 0x7fe2582d41f0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:04.380606 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8142eae8-3cf9-4d5d-b705-a362f7e421c5 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8d2814c23a4aa9806d56ce99c89e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8596483de9f14de9a88cdb787841fd3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:04.382021 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-54f26e88-4820-4f9b-89d2-7856a4eb261a tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-key-1713997289" status: 202 len: 0 microversion: 2.1 time: 0.099173 Oct 04 18:43:04.382605 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1856/3663] 10.222.0.20 () {58 vars in 1209 bytes} [Tue Oct 4 18:43:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-1713997289 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:43:04.387715 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d1b7abf9-8edb-458b-9946-368dcf97f35c tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] Calling method '.version_select at 0x7fe2582d4700>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:04.396842 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8142eae8-3cf9-4d5d-b705-a362f7e421c5 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/servers/471125af-1ec3-44b3-bb69-36b04a03fdd5" status: 200 len: 1315 microversion: 2.1 time: 0.263386 Oct 04 18:43:04.413639 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1808/3664] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:04 2022] GET /compute/v2.1/servers/471125af-1ec3-44b3-bb69-36b04a03fdd5 => generated 1315 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:04.421727 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9d23db29-7353-45b2-bc1d-8e0a6206c31a tempest-SecurityGroupsNegativeTestJSON-1630376305 tempest-SecurityGroupsNegativeTestJSON-1630376305-project] Calling method '.version_select at 0x7fe259467c10>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:04.502243 n-d-850501-14 devstack@n-api.service[123002]: DEBUG neutronclient.v2_0.client [None req-9d23db29-7353-45b2-bc1d-8e0a6206c31a tempest-SecurityGroupsNegativeTestJSON-1630376305 tempest-SecurityGroupsNegativeTestJSON-1630376305-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e98982de-f72c-45ff-b6db-97796e7fb4ca does not exist", "detail": ""}} {{(pid=123002) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:43:04.502243 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.security_group_api [None req-9d23db29-7353-45b2-bc1d-8e0a6206c31a tempest-SecurityGroupsNegativeTestJSON-1630376305 tempest-SecurityGroupsNegativeTestJSON-1630376305-project] Neutron security group e98982de-f72c-45ff-b6db-97796e7fb4ca not found {{(pid=123002) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 18:43:04.502243 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-9d23db29-7353-45b2-bc1d-8e0a6206c31a tempest-SecurityGroupsNegativeTestJSON-1630376305 tempest-SecurityGroupsNegativeTestJSON-1630376305-project] HTTP exception thrown: Security group e98982de-f72c-45ff-b6db-97796e7fb4ca does not exist Oct 04 18:43:04.502243 n-d-850501-14 devstack@n-api.service[123002]: Neutron server returns request_ids: ['req-b4473645-33fe-439d-a824-dd18b6201cf4'] Oct 04 18:43:04.504268 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9d23db29-7353-45b2-bc1d-8e0a6206c31a tempest-SecurityGroupsNegativeTestJSON-1630376305 tempest-SecurityGroupsNegativeTestJSON-1630376305-project] Request method failure captured: Oct 04 18:43:04.504268 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/os-security-groups/e98982de-f72c-45ff-b6db-97796e7fb4ca HTTP/1.1 Oct 04 18:43:04.504268 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:43:04.504268 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:43:04.504268 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:43:04.504268 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:43:04.504268 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:43:04.504268 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:43:04.504268 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:43:04.504268 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:43:04.504268 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH63KNlRoiv15mgLha6yVcIPbOxjSNrTZ96yCu9HZcigWsGzIRUORuy9WjwLvt3oujIkARPXEal-6wG3XoYUTfr1SYnk_MkPUj48nAa7ye-K6AW64mM_XnBqIDttzrIMFHEmmBoNrHI_E5l-mz7pURwd1u8JzhKE7UZ0lCkC9nUgkm8 Oct 04 18:43:04.504268 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:43:04.504268 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:43:04.504268 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:43:04.504268 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:43:04.504268 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:43:04.504268 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:43:04.504268 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: f89b3ef5c94d45ad8eed20081f14166c Oct 04 18:43:04.504268 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1630376305 Oct 04 18:43:04.504268 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:43:04.504268 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:43:04.504268 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f89b3ef5c94d45ad8eed20081f14166c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f89b3ef5c94d45ad8eed20081f14166c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f89b3ef5c94d45ad8eed20081f14166c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f89b3ef5c94d45ad8eed20081f14166c"}]}] Oct 04 18:43:04.504268 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1630376305 Oct 04 18:43:04.504268 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: f89b3ef5c94d45ad8eed20081f14166c Oct 04 18:43:04.504268 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1630376305 Oct 04 18:43:04.504268 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-SecurityGroupsNegativeTestJSON-1630376305-project Oct 04 18:43:04.504268 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:43:04.504268 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:43:04.504268 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: a4dbccf68b2145dab798c387cbdb564f Oct 04 18:43:04.504268 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1630376305-project Oct 04 18:43:04.504268 n-d-850501-14 devstack@n-api.service[123002]: method: Oct 04 18:43:04.504268 n-d-850501-14 devstack@n-api.service[123002]: exception: Security group e98982de-f72c-45ff-b6db-97796e7fb4ca does not exist Oct 04 18:43:04.504268 n-d-850501-14 devstack@n-api.service[123002]: Neutron server returns request_ids: ['req-b4473645-33fe-439d-a824-dd18b6201cf4'] Oct 04 18:43:04.504268 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'e98982de-f72c-45ff-b6db-97796e7fb4ca'} Oct 04 18:43:04.504268 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:43:04.504268 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:43:04.504268 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 18:43:04.504268 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 18:43:04.504268 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:43:04.504268 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:43:04.504268 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 18:43:04.504268 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 18:43:04.504268 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:43:04.504268 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:43:04.504268 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:43:04.504268 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 18:43:04.504268 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:43:04.504268 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:43:04.504268 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:43:04.504268 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:43:04.504268 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:43:04.504268 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:43:04.504268 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:43:04.504268 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:43:04.504268 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:43:04.504268 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:43:04.504268 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:43:04.504268 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:43:04.504268 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:43:04.504268 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:43:04.504268 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e98982de-f72c-45ff-b6db-97796e7fb4ca does not exist Oct 04 18:43:04.512028 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b4473645-33fe-439d-a824-dd18b6201cf4'] Oct 04 18:43:04.512028 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:43:04.512028 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:43:04.512028 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:43:04.512028 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:43:04.512028 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 04 18:43:04.512028 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 18:43:04.512028 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 18:43:04.512028 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 18:43:04.512028 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e98982de-f72c-45ff-b6db-97796e7fb4ca does not exist Oct 04 18:43:04.512028 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b4473645-33fe-439d-a824-dd18b6201cf4'] Oct 04 18:43:04.512028 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:43:04.512028 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:43:04.512028 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:43:04.512028 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:43:04.512028 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:43:04.512028 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:43:04.512028 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:43:04.512028 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:43:04.512028 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:43:04.512028 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:43:04.512028 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:43:04.512028 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:43:04.512028 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 04 18:43:04.512028 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 18:43:04.512028 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e98982de-f72c-45ff-b6db-97796e7fb4ca does not exist Oct 04 18:43:04.512028 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b4473645-33fe-439d-a824-dd18b6201cf4'] Oct 04 18:43:04.512028 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:43:04.512028 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:43:04.512028 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:43:04.512028 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:43:04.512028 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:43:04.512028 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:43:04.512028 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:43:04.512028 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:43:04.512028 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e98982de-f72c-45ff-b6db-97796e7fb4ca does not exist Oct 04 18:43:04.512028 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b4473645-33fe-439d-a824-dd18b6201cf4'] Oct 04 18:43:04.512028 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:43:04.526624 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9d23db29-7353-45b2-bc1d-8e0a6206c31a tempest-SecurityGroupsNegativeTestJSON-1630376305 tempest-SecurityGroupsNegativeTestJSON-1630376305-project] Returning 404 to user: Security group e98982de-f72c-45ff-b6db-97796e7fb4ca does not exist Oct 04 18:43:04.526624 n-d-850501-14 devstack@n-api.service[123002]: Neutron server returns request_ids: ['req-b4473645-33fe-439d-a824-dd18b6201cf4'] {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:43:04.529414 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9d23db29-7353-45b2-bc1d-8e0a6206c31a tempest-SecurityGroupsNegativeTestJSON-1630376305 tempest-SecurityGroupsNegativeTestJSON-1630376305-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups/e98982de-f72c-45ff-b6db-97796e7fb4ca" status: 404 len: 194 microversion: 2.1 time: 0.113027 Oct 04 18:43:04.531131 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1809/3665] 10.222.0.20 () {58 vars in 1269 bytes} [Tue Oct 4 18:43:04 2022] GET /compute/v2.1/os-security-groups/e98982de-f72c-45ff-b6db-97796e7fb4ca => generated 194 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:43:04.546433 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6572dd91-cb03-4e7f-994f-6f388029a95e tempest-SecurityGroupsNegativeTestJSON-1630376305 tempest-SecurityGroupsNegativeTestJSON-1630376305-project] Action: 'update', calling method: .version_select at 0x7fe2587e7dc0>, body: {"security_group": {"name": "tempest-sg-623510404", "description": "tempest-description-961819143"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:43:04.589973 n-d-850501-14 devstack@n-api.service[123002]: DEBUG neutronclient.v2_0.client [None req-6572dd91-cb03-4e7f-994f-6f388029a95e tempest-SecurityGroupsNegativeTestJSON-1630376305 tempest-SecurityGroupsNegativeTestJSON-1630376305-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 35ed72da-1b73-4b8a-ac1d-d81ecd282643 does not exist", "detail": ""}} {{(pid=123002) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:43:04.590843 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.security_group_api [None req-6572dd91-cb03-4e7f-994f-6f388029a95e tempest-SecurityGroupsNegativeTestJSON-1630376305 tempest-SecurityGroupsNegativeTestJSON-1630376305-project] Neutron security group 35ed72da-1b73-4b8a-ac1d-d81ecd282643 not found {{(pid=123002) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 18:43:04.595009 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-6572dd91-cb03-4e7f-994f-6f388029a95e tempest-SecurityGroupsNegativeTestJSON-1630376305 tempest-SecurityGroupsNegativeTestJSON-1630376305-project] HTTP exception thrown: Security group 35ed72da-1b73-4b8a-ac1d-d81ecd282643 does not exist Oct 04 18:43:04.595009 n-d-850501-14 devstack@n-api.service[123002]: Neutron server returns request_ids: ['req-02d97ce8-2fe6-48a3-9cf1-f1bb716d6c50'] Oct 04 18:43:04.600410 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6572dd91-cb03-4e7f-994f-6f388029a95e tempest-SecurityGroupsNegativeTestJSON-1630376305 tempest-SecurityGroupsNegativeTestJSON-1630376305-project] Request method failure captured: Oct 04 18:43:04.600410 n-d-850501-14 devstack@n-api.service[123002]: request: PUT /compute/v2.1/os-security-groups/35ed72da-1b73-4b8a-ac1d-d81ecd282643 HTTP/1.1 Oct 04 18:43:04.600410 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:43:04.600410 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:43:04.600410 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:43:04.600410 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 100 Oct 04 18:43:04.600410 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:43:04.600410 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:43:04.600410 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:43:04.600410 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:43:04.600410 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH63KNlRoiv15mgLha6yVcIPbOxjSNrTZ96yCu9HZcigWsGzIRUORuy9WjwLvt3oujIkARPXEal-6wG3XoYUTfr1SYnk_MkPUj48nAa7ye-K6AW64mM_XnBqIDttzrIMFHEmmBoNrHI_E5l-mz7pURwd1u8JzhKE7UZ0lCkC9nUgkm8 Oct 04 18:43:04.600410 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:43:04.600410 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:43:04.600410 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:43:04.600410 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:43:04.600410 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:43:04.600410 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:43:04.600410 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: f89b3ef5c94d45ad8eed20081f14166c Oct 04 18:43:04.600410 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1630376305 Oct 04 18:43:04.600410 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:43:04.600410 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:43:04.600410 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f89b3ef5c94d45ad8eed20081f14166c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f89b3ef5c94d45ad8eed20081f14166c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f89b3ef5c94d45ad8eed20081f14166c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f89b3ef5c94d45ad8eed20081f14166c"}]}] Oct 04 18:43:04.600410 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1630376305 Oct 04 18:43:04.600410 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: f89b3ef5c94d45ad8eed20081f14166c Oct 04 18:43:04.600410 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1630376305 Oct 04 18:43:04.600410 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-SecurityGroupsNegativeTestJSON-1630376305-project Oct 04 18:43:04.600410 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:43:04.600410 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:43:04.600410 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: a4dbccf68b2145dab798c387cbdb564f Oct 04 18:43:04.600410 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1630376305-project Oct 04 18:43:04.600410 n-d-850501-14 devstack@n-api.service[123002]: Oct 04 18:43:04.600410 n-d-850501-14 devstack@n-api.service[123002]: {"security_group": {"name": "tempest-sg-623510404", "description": "tempest-description-961819143"}} Oct 04 18:43:04.600410 n-d-850501-14 devstack@n-api.service[123002]: method: Oct 04 18:43:04.600410 n-d-850501-14 devstack@n-api.service[123002]: exception: Security group 35ed72da-1b73-4b8a-ac1d-d81ecd282643 does not exist Oct 04 18:43:04.600410 n-d-850501-14 devstack@n-api.service[123002]: Neutron server returns request_ids: ['req-02d97ce8-2fe6-48a3-9cf1-f1bb716d6c50'] Oct 04 18:43:04.600410 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '35ed72da-1b73-4b8a-ac1d-d81ecd282643', 'body': {'security_group': {'name': 'tempest-sg-623510404', 'description': 'tempest-description-961819143'}}} Oct 04 18:43:04.600410 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:43:04.600410 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:43:04.600410 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 18:43:04.600410 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 18:43:04.600410 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:43:04.600410 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:43:04.600410 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 18:43:04.600410 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 18:43:04.600410 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:43:04.600410 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:43:04.600410 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:43:04.600410 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 18:43:04.600410 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:43:04.600410 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:43:04.600410 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:43:04.600410 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:43:04.600410 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:43:04.600410 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:43:04.600410 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:43:04.600410 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:43:04.600410 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:43:04.600410 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:43:04.600410 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:43:04.600410 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:43:04.600410 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:43:04.605214 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:43:04.605214 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 35ed72da-1b73-4b8a-ac1d-d81ecd282643 does not exist Oct 04 18:43:04.605214 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-02d97ce8-2fe6-48a3-9cf1-f1bb716d6c50'] Oct 04 18:43:04.605214 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:43:04.605214 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:43:04.605214 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:43:04.605214 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:43:04.605214 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Oct 04 18:43:04.605214 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 18:43:04.605214 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 18:43:04.605214 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 18:43:04.605214 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 35ed72da-1b73-4b8a-ac1d-d81ecd282643 does not exist Oct 04 18:43:04.605214 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-02d97ce8-2fe6-48a3-9cf1-f1bb716d6c50'] Oct 04 18:43:04.605214 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:43:04.605214 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:43:04.605214 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:43:04.605214 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:43:04.605214 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:43:04.605214 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:43:04.605214 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:43:04.605214 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:43:04.605214 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:43:04.605214 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:43:04.605214 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:43:04.605214 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:43:04.605214 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Oct 04 18:43:04.605214 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 18:43:04.605214 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 35ed72da-1b73-4b8a-ac1d-d81ecd282643 does not exist Oct 04 18:43:04.605214 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-02d97ce8-2fe6-48a3-9cf1-f1bb716d6c50'] Oct 04 18:43:04.605214 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:43:04.605214 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:43:04.605214 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:43:04.605214 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:43:04.605214 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:43:04.605214 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:43:04.605214 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:43:04.605214 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:43:04.605214 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 35ed72da-1b73-4b8a-ac1d-d81ecd282643 does not exist Oct 04 18:43:04.605214 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-02d97ce8-2fe6-48a3-9cf1-f1bb716d6c50'] Oct 04 18:43:04.605214 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:43:04.615772 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6572dd91-cb03-4e7f-994f-6f388029a95e tempest-SecurityGroupsNegativeTestJSON-1630376305 tempest-SecurityGroupsNegativeTestJSON-1630376305-project] Returning 404 to user: Security group 35ed72da-1b73-4b8a-ac1d-d81ecd282643 does not exist Oct 04 18:43:04.615772 n-d-850501-14 devstack@n-api.service[123002]: Neutron server returns request_ids: ['req-02d97ce8-2fe6-48a3-9cf1-f1bb716d6c50'] {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:43:04.617141 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6572dd91-cb03-4e7f-994f-6f388029a95e tempest-SecurityGroupsNegativeTestJSON-1630376305 tempest-SecurityGroupsNegativeTestJSON-1630376305-project] 10.222.0.20 "PUT /compute/v2.1/os-security-groups/35ed72da-1b73-4b8a-ac1d-d81ecd282643" status: 404 len: 194 microversion: 2.1 time: 0.080419 Oct 04 18:43:04.621417 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1810/3666] 10.222.0.20 () {60 vars in 1290 bytes} [Tue Oct 4 18:43:04 2022] PUT /compute/v2.1/os-security-groups/35ed72da-1b73-4b8a-ac1d-d81ecd282643 => generated 194 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:43:04.627179 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-28dbf594-9282-4c30-8ef2-59f6c432e9a3 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:04.630330 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-28dbf594-9282-4c30-8ef2-59f6c432e9a3 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] [instance: 6cc94ec4-3e28-41e0-808e-9cd2263bca7d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:04.645216 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-28dbf594-9282-4c30-8ef2-59f6c432e9a3 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:04.645476 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-28dbf594-9282-4c30-8ef2-59f6c432e9a3 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:04.649069 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-28dbf594-9282-4c30-8ef2-59f6c432e9a3 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:04.649880 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-28dbf594-9282-4c30-8ef2-59f6c432e9a3 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:04.650350 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-28dbf594-9282-4c30-8ef2-59f6c432e9a3 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:04.650786 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-28dbf594-9282-4c30-8ef2-59f6c432e9a3 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:05.089042 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-28dbf594-9282-4c30-8ef2-59f6c432e9a3 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a02cd1108b947b186202f6d15e6cf0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c0b095138354810949093e7ea03b8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:05.097495 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-28dbf594-9282-4c30-8ef2-59f6c432e9a3 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] 10.222.0.20 "GET /compute/v2.1/servers/6cc94ec4-3e28-41e0-808e-9cd2263bca7d" status: 200 len: 1364 microversion: 2.1 time: 0.474734 Oct 04 18:43:05.098345 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1811/3667] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:04 2022] GET /compute/v2.1/servers/6cc94ec4-3e28-41e0-808e-9cd2263bca7d => generated 1364 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:05.103602 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-326594b5-ae39-4185-86cb-599eedaabb15 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-902687355", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": [{"uuid": "ea7ea2b5-3fb7-4eeb-8ba9-cbc81d7265bf"}]}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:43:05.182758 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-326594b5-ae39-4185-86cb-599eedaabb15 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] validate_networks() for [('ea7ea2b5-3fb7-4eeb-8ba9-cbc81d7265bf', None, None, None, None, None)] {{(pid=123002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:43:05.229441 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d1b7abf9-8edb-458b-9946-368dcf97f35c tempest-SecurityGroupsTestJSON-752173812 tempest-SecurityGroupsTestJSON-752173812-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/2a9c1330-2010-46aa-85f5-adb49fd1e62a" status: 202 len: 0 microversion: 2.1 time: 0.845396 Oct 04 18:43:05.231558 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1857/3668] 10.222.0.20 () {58 vars in 1272 bytes} [Tue Oct 4 18:43:04 2022] DELETE /compute/v2.1/os-security-groups/2a9c1330-2010-46aa-85f5-adb49fd1e62a => generated 0 bytes in 848 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:43:05.238234 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-096ddbf1-d10a-4061-a742-5c9ce4a10c92 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:05.241322 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-096ddbf1-d10a-4061-a742-5c9ce4a10c92 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: af46589b-8af1-4394-86e3-631c7d483a12] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:05.249971 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-096ddbf1-d10a-4061-a742-5c9ce4a10c92 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:05.251396 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-096ddbf1-d10a-4061-a742-5c9ce4a10c92 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:05.253437 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-096ddbf1-d10a-4061-a742-5c9ce4a10c92 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:05.254436 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-096ddbf1-d10a-4061-a742-5c9ce4a10c92 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:05.255622 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-096ddbf1-d10a-4061-a742-5c9ce4a10c92 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:05.256310 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-096ddbf1-d10a-4061-a742-5c9ce4a10c92 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:05.602349 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-096ddbf1-d10a-4061-a742-5c9ce4a10c92 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:05.634349 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-096ddbf1-d10a-4061-a742-5c9ce4a10c92 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/af46589b-8af1-4394-86e3-631c7d483a12" status: 200 len: 1520 microversion: 2.1 time: 0.401191 Oct 04 18:43:05.651578 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1858/3669] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:05 2022] GET /compute/v2.1/servers/af46589b-8af1-4394-86e3-631c7d483a12 => generated 1520 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:05.651777 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-ee5cbfc5-ca14-4fa6-a762-adde494e14d2 req-7e830943-d1ff-4fd1-8220-f7e65a298cbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cc94ec4-3e28-41e0-808e-9cd2263bca7d", "name": "network-vif-plugged", "status": "completed", "tag": "1556befc-7a17-4e26-aa0f-68b9c412823d"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:43:05.684412 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-ee5cbfc5-ca14-4fa6-a762-adde494e14d2 req-7e830943-d1ff-4fd1-8220-f7e65a298cbe service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:05.687311 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-ee5cbfc5-ca14-4fa6-a762-adde494e14d2 req-7e830943-d1ff-4fd1-8220-f7e65a298cbe service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:05.687902 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-ee5cbfc5-ca14-4fa6-a762-adde494e14d2 req-7e830943-d1ff-4fd1-8220-f7e65a298cbe service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:05.729750 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-ee5cbfc5-ca14-4fa6-a762-adde494e14d2 req-7e830943-d1ff-4fd1-8220-f7e65a298cbe service nova] Creating event network-vif-plugged:1556befc-7a17-4e26-aa0f-68b9c412823d for instance 6cc94ec4-3e28-41e0-808e-9cd2263bca7d on n-h2-850501-14 Oct 04 18:43:05.739534 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-ee5cbfc5-ca14-4fa6-a762-adde494e14d2 req-7e830943-d1ff-4fd1-8220-f7e65a298cbe service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099059 Oct 04 18:43:05.745367 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1859/3670] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:43:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:43:05.749830 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-14dfea5f-bffd-433e-915a-f0bcfb07ce9e tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:05.751693 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-14dfea5f-bffd-433e-915a-f0bcfb07ce9e tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] [instance: 471125af-1ec3-44b3-bb69-36b04a03fdd5] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:05.767358 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-14dfea5f-bffd-433e-915a-f0bcfb07ce9e tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:05.771393 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-14dfea5f-bffd-433e-915a-f0bcfb07ce9e tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:05.771393 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-14dfea5f-bffd-433e-915a-f0bcfb07ce9e tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:05.771393 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-14dfea5f-bffd-433e-915a-f0bcfb07ce9e tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:05.771393 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-14dfea5f-bffd-433e-915a-f0bcfb07ce9e tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:05.771393 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-14dfea5f-bffd-433e-915a-f0bcfb07ce9e tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:06.201648 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-14dfea5f-bffd-433e-915a-f0bcfb07ce9e tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8d2814c23a4aa9806d56ce99c89e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8596483de9f14de9a88cdb787841fd3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:06.210654 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-14dfea5f-bffd-433e-915a-f0bcfb07ce9e tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/servers/471125af-1ec3-44b3-bb69-36b04a03fdd5" status: 200 len: 1315 microversion: 2.1 time: 0.467944 Oct 04 18:43:06.213661 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1860/3671] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:05 2022] GET /compute/v2.1/servers/471125af-1ec3-44b3-bb69-36b04a03fdd5 => generated 1315 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:06.226890 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-22c3f16d-3699-46ae-972a-35040e6b1cce tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:06.227734 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-22c3f16d-3699-46ae-972a-35040e6b1cce tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] [instance: 6cc94ec4-3e28-41e0-808e-9cd2263bca7d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:06.261104 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-22c3f16d-3699-46ae-972a-35040e6b1cce tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:06.261104 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-22c3f16d-3699-46ae-972a-35040e6b1cce tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:06.261104 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-22c3f16d-3699-46ae-972a-35040e6b1cce tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:06.261104 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-22c3f16d-3699-46ae-972a-35040e6b1cce tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:06.261104 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-22c3f16d-3699-46ae-972a-35040e6b1cce tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:06.261104 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-22c3f16d-3699-46ae-972a-35040e6b1cce tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:06.342163 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-326594b5-ae39-4185-86cb-599eedaabb15 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:43:06.342163 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-326594b5-ae39-4185-86cb-599eedaabb15 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:43:06.342163 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-326594b5-ae39-4185-86cb-599eedaabb15 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:43:06.342163 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-326594b5-ae39-4185-86cb-599eedaabb15 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:43:06.342163 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-326594b5-ae39-4185-86cb-599eedaabb15 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:43:06.342163 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:43:06.357614 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-326594b5-ae39-4185-86cb-599eedaabb15 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:06.358110 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-326594b5-ae39-4185-86cb-599eedaabb15 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:06.358549 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-326594b5-ae39-4185-86cb-599eedaabb15 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:06.359294 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-326594b5-ae39-4185-86cb-599eedaabb15 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:06.359751 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-326594b5-ae39-4185-86cb-599eedaabb15 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:06.360949 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-326594b5-ae39-4185-86cb-599eedaabb15 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:06.422920 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-326594b5-ae39-4185-86cb-599eedaabb15 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Getting quotas for project a9046b9540144eeba512d79438635ea8. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:43:06.442032 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-326594b5-ae39-4185-86cb-599eedaabb15 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Getting quotas for user 8a6c3725b31449d5bf1ff757ff66c8d7 and project a9046b9540144eeba512d79438635ea8. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:43:06.470410 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-326594b5-ae39-4185-86cb-599eedaabb15 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Going to run 1 instances... {{(pid=123002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:43:06.479082 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-326594b5-ae39-4185-86cb-599eedaabb15 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 766fe762-0e33-4174-a817-827f782572d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:43:06.633146 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-22c3f16d-3699-46ae-972a-35040e6b1cce tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a02cd1108b947b186202f6d15e6cf0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c0b095138354810949093e7ea03b8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:06.640841 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-22c3f16d-3699-46ae-972a-35040e6b1cce tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] 10.222.0.20 "GET /compute/v2.1/servers/6cc94ec4-3e28-41e0-808e-9cd2263bca7d" status: 200 len: 1364 microversion: 2.1 time: 0.425885 Oct 04 18:43:06.641501 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1861/3672] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:06 2022] GET /compute/v2.1/servers/6cc94ec4-3e28-41e0-808e-9cd2263bca7d => generated 1364 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:06.658835 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d4bfe672-24b5-496d-bcc1-5a0eccc0c24c tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:06.659452 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d4bfe672-24b5-496d-bcc1-5a0eccc0c24c tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: af46589b-8af1-4394-86e3-631c7d483a12] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:06.675983 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d4bfe672-24b5-496d-bcc1-5a0eccc0c24c tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:06.676502 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d4bfe672-24b5-496d-bcc1-5a0eccc0c24c tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:06.678603 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d4bfe672-24b5-496d-bcc1-5a0eccc0c24c tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:06.678603 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d4bfe672-24b5-496d-bcc1-5a0eccc0c24c tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:06.678603 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d4bfe672-24b5-496d-bcc1-5a0eccc0c24c tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:06.678603 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d4bfe672-24b5-496d-bcc1-5a0eccc0c24c tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:06.693975 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-326594b5-ae39-4185-86cb-599eedaabb15 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.594228 Oct 04 18:43:06.700858 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1812/3673] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:43:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1602 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:43:06.713183 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8540285e-8980-4955-ac99-df02f620e65d tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:06.713960 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8540285e-8980-4955-ac99-df02f620e65d tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 766fe762-0e33-4174-a817-827f782572d9] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:06.825541 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8540285e-8980-4955-ac99-df02f620e65d tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:06.835835 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8540285e-8980-4955-ac99-df02f620e65d tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/766fe762-0e33-4174-a817-827f782572d9" status: 200 len: 1208 microversion: 2.1 time: 0.127468 Oct 04 18:43:06.839844 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1813/3674] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:06 2022] GET /compute/v2.1/servers/766fe762-0e33-4174-a817-827f782572d9 => generated 1208 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:43:07.013539 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d4bfe672-24b5-496d-bcc1-5a0eccc0c24c tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:07.028100 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d4bfe672-24b5-496d-bcc1-5a0eccc0c24c tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/af46589b-8af1-4394-86e3-631c7d483a12" status: 200 len: 1500 microversion: 2.1 time: 0.373929 Oct 04 18:43:07.040982 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1862/3675] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:06 2022] GET /compute/v2.1/servers/af46589b-8af1-4394-86e3-631c7d483a12 => generated 1500 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:43:07.055169 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8478be73-50ce-4170-9da3-a796c121c7ac tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "be6c0a1b-db93-431f-ba14-560a9c6b7492"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:43:07.058478 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8478be73-50ce-4170-9da3-a796c121c7ac tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: af46589b-8af1-4394-86e3-631c7d483a12] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:07.067189 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8478be73-50ce-4170-9da3-a796c121c7ac tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:07.067737 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8478be73-50ce-4170-9da3-a796c121c7ac tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:07.068299 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8478be73-50ce-4170-9da3-a796c121c7ac tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:07.069036 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8478be73-50ce-4170-9da3-a796c121c7ac tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:07.069481 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8478be73-50ce-4170-9da3-a796c121c7ac tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:07.070475 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8478be73-50ce-4170-9da3-a796c121c7ac tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:07.099265 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-8478be73-50ce-4170-9da3-a796c121c7ac tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] HTTP exception thrown: Cannot 'attach_volume' instance af46589b-8af1-4394-86e3-631c7d483a12 while it is in vm_state rescued Oct 04 18:43:07.111589 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8478be73-50ce-4170-9da3-a796c121c7ac tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Request method failure captured: Oct 04 18:43:07.111589 n-d-850501-14 devstack@n-api.service[123002]: request: POST /compute/v2.1/servers/af46589b-8af1-4394-86e3-631c7d483a12/os-volume_attachments HTTP/1.1 Oct 04 18:43:07.111589 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:43:07.111589 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:43:07.111589 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:43:07.111589 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 74 Oct 04 18:43:07.111589 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:43:07.111589 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:43:07.111589 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:43:07.111589 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:43:07.111589 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH5VeoXXX4R-gl3WW_fAsW_7hDIEWiZR35lPoIuJDBMUw75w4Z-93EJDy38x5YiA26dGCEdjKEzqMCUM4kpma5PpB_mUiDb0rAatpoM-ionDMXIgsOp1o3NTgluOHECynM7nFlIuW8aS-v8Gnb5xnrVGhYXFRV6ahForfC1sBHmJ1HA Oct 04 18:43:07.111589 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:43:07.111589 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:43:07.111589 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:43:07.111589 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:43:07.111589 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:43:07.111589 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:43:07.111589 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 9eb391aef10e4684ada5f811ae818f97 Oct 04 18:43:07.111589 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-124944821 Oct 04 18:43:07.111589 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:43:07.111589 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:43:07.111589 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9eb391aef10e4684ada5f811ae818f97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9eb391aef10e4684ada5f811ae818f97", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9eb391aef10e4684ada5f811ae818f97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9eb391aef10e4684ada5f811ae818f97"}]}] Oct 04 18:43:07.111589 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServerRescueNegativeTestJSON-124944821 Oct 04 18:43:07.111589 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 9eb391aef10e4684ada5f811ae818f97 Oct 04 18:43:07.111589 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-124944821 Oct 04 18:43:07.111589 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServerRescueNegativeTestJSON-124944821-project Oct 04 18:43:07.111589 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:43:07.111589 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:43:07.111589 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: c4243e3907374e5e9947c17e6288f0e7 Oct 04 18:43:07.111589 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServerRescueNegativeTestJSON-124944821-project Oct 04 18:43:07.111589 n-d-850501-14 devstack@n-api.service[123002]: Oct 04 18:43:07.111589 n-d-850501-14 devstack@n-api.service[123002]: {"volumeAttachment": {"volumeId": "be6c0a1b-db93-431f-ba14-560a9c6b7492"}} Oct 04 18:43:07.111589 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:43:07.111589 n-d-850501-14 devstack@n-api.service[123002]: exception: Cannot 'attach_volume' instance af46589b-8af1-4394-86e3-631c7d483a12 while it is in vm_state rescued Oct 04 18:43:07.111589 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'server_id': 'af46589b-8af1-4394-86e3-631c7d483a12', 'body': {'volumeAttachment': {'volumeId': 'be6c0a1b-db93-431f-ba14-560a9c6b7492'}}} Oct 04 18:43:07.111589 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:43:07.111589 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:43:07.111589 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 04 18:43:07.111589 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 04 18:43:07.111589 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:43:07.111589 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:43:07.111589 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 18:43:07.111589 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 18:43:07.111589 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance af46589b-8af1-4394-86e3-631c7d483a12 in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 04 18:43:07.111589 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:43:07.111589 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:43:07.111589 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:43:07.111589 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:43:07.111589 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:43:07.111589 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:43:07.111589 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:43:07.111589 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:43:07.111589 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:43:07.111589 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:43:07.111589 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:43:07.111589 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:43:07.111589 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:43:07.111589 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:43:07.111589 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:43:07.111589 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:43:07.111589 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 04 18:43:07.111589 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 18:43:07.117355 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 18:43:07.117355 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 18:43:07.117355 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance af46589b-8af1-4394-86e3-631c7d483a12 while it is in vm_state rescued Oct 04 18:43:07.117355 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:43:07.117355 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:43:07.117355 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:43:07.117355 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:43:07.117355 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:43:07.117355 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:43:07.117355 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:43:07.117355 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:43:07.117355 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance af46589b-8af1-4394-86e3-631c7d483a12 while it is in vm_state rescued Oct 04 18:43:07.117355 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:43:07.117355 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8478be73-50ce-4170-9da3-a796c121c7ac tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Returning 409 to user: Cannot 'attach_volume' instance af46589b-8af1-4394-86e3-631c7d483a12 while it is in vm_state rescued {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:43:07.118965 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8478be73-50ce-4170-9da3-a796c121c7ac tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "POST /compute/v2.1/servers/af46589b-8af1-4394-86e3-631c7d483a12/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.066255 Oct 04 18:43:07.118965 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1814/3676] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Oct 4 18:43:07 2022] POST /compute/v2.1/servers/af46589b-8af1-4394-86e3-631c7d483a12/os-volume_attachments => generated 152 bytes in 68 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:43:07.129346 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3b285806-798c-46d8-b11b-8476e6a24d3d tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:43:07.130151 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3b285806-798c-46d8-b11b-8476e6a24d3d tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: af46589b-8af1-4394-86e3-631c7d483a12] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:07.145925 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3b285806-798c-46d8-b11b-8476e6a24d3d tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:07.146684 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3b285806-798c-46d8-b11b-8476e6a24d3d tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:07.147526 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3b285806-798c-46d8-b11b-8476e6a24d3d tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:07.148521 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3b285806-798c-46d8-b11b-8476e6a24d3d tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:07.149157 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3b285806-798c-46d8-b11b-8476e6a24d3d tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:07.149759 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3b285806-798c-46d8-b11b-8476e6a24d3d tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:07.238817 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-39d40237-54d5-4932-9118-e5e0a1dd3290 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:07.245182 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-39d40237-54d5-4932-9118-e5e0a1dd3290 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] [instance: 471125af-1ec3-44b3-bb69-36b04a03fdd5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:07.270705 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-39d40237-54d5-4932-9118-e5e0a1dd3290 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:07.273009 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-39d40237-54d5-4932-9118-e5e0a1dd3290 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:07.274458 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-39d40237-54d5-4932-9118-e5e0a1dd3290 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:07.275417 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-39d40237-54d5-4932-9118-e5e0a1dd3290 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:07.276427 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-39d40237-54d5-4932-9118-e5e0a1dd3290 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:07.277214 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-39d40237-54d5-4932-9118-e5e0a1dd3290 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:07.394428 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3b285806-798c-46d8-b11b-8476e6a24d3d tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "POST /compute/v2.1/servers/af46589b-8af1-4394-86e3-631c7d483a12/action" status: 202 len: 0 microversion: 2.1 time: 0.270190 Oct 04 18:43:07.396632 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1863/3677] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:43:07 2022] POST /compute/v2.1/servers/af46589b-8af1-4394-86e3-631c7d483a12/action => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:43:07.431152 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-de34ce8c-c356-4e04-805a-32fac1b1dc98 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:07.431152 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-de34ce8c-c356-4e04-805a-32fac1b1dc98 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: af46589b-8af1-4394-86e3-631c7d483a12] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:07.437263 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-de34ce8c-c356-4e04-805a-32fac1b1dc98 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:07.438539 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-de34ce8c-c356-4e04-805a-32fac1b1dc98 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:07.439189 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-de34ce8c-c356-4e04-805a-32fac1b1dc98 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:07.442556 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-de34ce8c-c356-4e04-805a-32fac1b1dc98 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:07.443438 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-de34ce8c-c356-4e04-805a-32fac1b1dc98 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:07.444047 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-de34ce8c-c356-4e04-805a-32fac1b1dc98 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:07.765398 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-39d40237-54d5-4932-9118-e5e0a1dd3290 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8d2814c23a4aa9806d56ce99c89e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8596483de9f14de9a88cdb787841fd3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:07.779034 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-39d40237-54d5-4932-9118-e5e0a1dd3290 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/servers/471125af-1ec3-44b3-bb69-36b04a03fdd5" status: 200 len: 1315 microversion: 2.1 time: 0.541174 Oct 04 18:43:07.779034 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1815/3678] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:07 2022] GET /compute/v2.1/servers/471125af-1ec3-44b3-bb69-36b04a03fdd5 => generated 1315 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:43:07.792373 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9605e61d-4c32-4fb7-85b1-91d00ca92180 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:07.793335 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9605e61d-4c32-4fb7-85b1-91d00ca92180 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] [instance: 6cc94ec4-3e28-41e0-808e-9cd2263bca7d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:07.800882 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9605e61d-4c32-4fb7-85b1-91d00ca92180 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:07.802119 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9605e61d-4c32-4fb7-85b1-91d00ca92180 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:07.802376 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9605e61d-4c32-4fb7-85b1-91d00ca92180 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:07.803249 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9605e61d-4c32-4fb7-85b1-91d00ca92180 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:07.803717 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9605e61d-4c32-4fb7-85b1-91d00ca92180 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:07.804198 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9605e61d-4c32-4fb7-85b1-91d00ca92180 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:07.821810 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-de34ce8c-c356-4e04-805a-32fac1b1dc98 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:07.839377 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-de34ce8c-c356-4e04-805a-32fac1b1dc98 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/af46589b-8af1-4394-86e3-631c7d483a12" status: 200 len: 1508 microversion: 2.1 time: 0.439693 Oct 04 18:43:07.842284 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1864/3679] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:07 2022] GET /compute/v2.1/servers/af46589b-8af1-4394-86e3-631c7d483a12 => generated 1508 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:43:07.859770 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-384c5d68-1f00-4aaa-a429-fefdaacea1c6 req-4722d64b-6305-40f9-9504-2383841da4e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6905c432-0fb3-4f5a-84bb-0ffcb08e2b3c", "name": "network-vif-plugged", "status": "completed", "tag": "457c88d9-9246-435c-b1a5-58b0c6c6185d"}, {"server_uuid": "471125af-1ec3-44b3-bb69-36b04a03fdd5", "name": "network-vif-plugged", "status": "completed", "tag": "ac57cdde-4dc1-45e0-be2d-97a36a8bb374"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:43:07.876895 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-384c5d68-1f00-4aaa-a429-fefdaacea1c6 req-4722d64b-6305-40f9-9504-2383841da4e0 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:07.878459 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-384c5d68-1f00-4aaa-a429-fefdaacea1c6 req-4722d64b-6305-40f9-9504-2383841da4e0 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:07.879166 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-384c5d68-1f00-4aaa-a429-fefdaacea1c6 req-4722d64b-6305-40f9-9504-2383841da4e0 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:07.902097 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-384c5d68-1f00-4aaa-a429-fefdaacea1c6 req-4722d64b-6305-40f9-9504-2383841da4e0 service nova] Creating event network-vif-plugged:457c88d9-9246-435c-b1a5-58b0c6c6185d for instance 6905c432-0fb3-4f5a-84bb-0ffcb08e2b3c on n-h1-850501-14 Oct 04 18:43:07.903476 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-384c5d68-1f00-4aaa-a429-fefdaacea1c6 req-4722d64b-6305-40f9-9504-2383841da4e0 service nova] Creating event network-vif-plugged:ac57cdde-4dc1-45e0-be2d-97a36a8bb374 for instance 471125af-1ec3-44b3-bb69-36b04a03fdd5 on n-h1-850501-14 Oct 04 18:43:07.914148 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-384c5d68-1f00-4aaa-a429-fefdaacea1c6 req-4722d64b-6305-40f9-9504-2383841da4e0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.068291 Oct 04 18:43:07.916017 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1865/3680] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:43:07 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:43:07.923580 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1ff54720-32f3-4cf9-837a-335277b92c29 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:07.924581 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1ff54720-32f3-4cf9-837a-335277b92c29 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 766fe762-0e33-4174-a817-827f782572d9] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:08.403315 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1ff54720-32f3-4cf9-837a-335277b92c29 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:08.404523 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1ff54720-32f3-4cf9-837a-335277b92c29 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/766fe762-0e33-4174-a817-827f782572d9" status: 200 len: 1208 microversion: 2.1 time: 0.486961 Oct 04 18:43:08.417032 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1866/3681] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:07 2022] GET /compute/v2.1/servers/766fe762-0e33-4174-a817-827f782572d9 => generated 1208 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:08.510261 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9605e61d-4c32-4fb7-85b1-91d00ca92180 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a02cd1108b947b186202f6d15e6cf0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c0b095138354810949093e7ea03b8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:08.525819 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9605e61d-4c32-4fb7-85b1-91d00ca92180 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] 10.222.0.20 "GET /compute/v2.1/servers/6cc94ec4-3e28-41e0-808e-9cd2263bca7d" status: 200 len: 1364 microversion: 2.1 time: 0.748699 Oct 04 18:43:08.527415 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1816/3682] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:07 2022] GET /compute/v2.1/servers/6cc94ec4-3e28-41e0-808e-9cd2263bca7d => generated 1364 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:08.798936 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f58b2abc-0dd7-4fa0-812e-36740fa4aa96 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:08.799799 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f58b2abc-0dd7-4fa0-812e-36740fa4aa96 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] [instance: 471125af-1ec3-44b3-bb69-36b04a03fdd5] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:08.816595 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f58b2abc-0dd7-4fa0-812e-36740fa4aa96 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:08.817299 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f58b2abc-0dd7-4fa0-812e-36740fa4aa96 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:08.817916 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f58b2abc-0dd7-4fa0-812e-36740fa4aa96 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:08.818796 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f58b2abc-0dd7-4fa0-812e-36740fa4aa96 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:08.819259 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f58b2abc-0dd7-4fa0-812e-36740fa4aa96 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:08.819685 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f58b2abc-0dd7-4fa0-812e-36740fa4aa96 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:08.873772 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c0e84301-2b1f-4872-9c2a-90d38a2704ad tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:08.877293 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c0e84301-2b1f-4872-9c2a-90d38a2704ad tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: af46589b-8af1-4394-86e3-631c7d483a12] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:08.893576 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c0e84301-2b1f-4872-9c2a-90d38a2704ad tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:08.899273 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c0e84301-2b1f-4872-9c2a-90d38a2704ad tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:08.900870 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c0e84301-2b1f-4872-9c2a-90d38a2704ad tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:08.903128 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c0e84301-2b1f-4872-9c2a-90d38a2704ad tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:08.904979 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c0e84301-2b1f-4872-9c2a-90d38a2704ad tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:08.909957 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c0e84301-2b1f-4872-9c2a-90d38a2704ad tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:09.215864 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f58b2abc-0dd7-4fa0-812e-36740fa4aa96 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8d2814c23a4aa9806d56ce99c89e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8596483de9f14de9a88cdb787841fd3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:09.240431 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f58b2abc-0dd7-4fa0-812e-36740fa4aa96 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/servers/471125af-1ec3-44b3-bb69-36b04a03fdd5" status: 200 len: 1315 microversion: 2.1 time: 0.445600 Oct 04 18:43:09.259925 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1867/3683] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:08 2022] GET /compute/v2.1/servers/471125af-1ec3-44b3-bb69-36b04a03fdd5 => generated 1315 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:09.268387 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c0e84301-2b1f-4872-9c2a-90d38a2704ad tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:09.284290 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c0e84301-2b1f-4872-9c2a-90d38a2704ad tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/af46589b-8af1-4394-86e3-631c7d483a12" status: 200 len: 1508 microversion: 2.1 time: 0.420304 Oct 04 18:43:09.300177 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1817/3684] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:08 2022] GET /compute/v2.1/servers/af46589b-8af1-4394-86e3-631c7d483a12 => generated 1508 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:09.433061 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a3bd06a4-7e84-476b-8bb6-ffc1773a5b27 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:09.434455 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a3bd06a4-7e84-476b-8bb6-ffc1773a5b27 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 766fe762-0e33-4174-a817-827f782572d9] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:09.441784 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a3bd06a4-7e84-476b-8bb6-ffc1773a5b27 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:09.442277 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a3bd06a4-7e84-476b-8bb6-ffc1773a5b27 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:09.442784 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a3bd06a4-7e84-476b-8bb6-ffc1773a5b27 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:09.443401 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a3bd06a4-7e84-476b-8bb6-ffc1773a5b27 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:09.443849 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a3bd06a4-7e84-476b-8bb6-ffc1773a5b27 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:09.444293 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a3bd06a4-7e84-476b-8bb6-ffc1773a5b27 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:09.542426 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a3bd06a4-7e84-476b-8bb6-ffc1773a5b27 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:09.556317 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a3bd06a4-7e84-476b-8bb6-ffc1773a5b27 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/766fe762-0e33-4174-a817-827f782572d9" status: 200 len: 1260 microversion: 2.1 time: 0.126516 Oct 04 18:43:09.556523 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-793ccf34-4d5e-4b66-8ac1-4532959ab4da tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:09.557383 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-793ccf34-4d5e-4b66-8ac1-4532959ab4da tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] [instance: 6cc94ec4-3e28-41e0-808e-9cd2263bca7d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:09.557545 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1868/3685] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:09 2022] GET /compute/v2.1/servers/766fe762-0e33-4174-a817-827f782572d9 => generated 1260 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:09.583079 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-793ccf34-4d5e-4b66-8ac1-4532959ab4da tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:09.583946 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-793ccf34-4d5e-4b66-8ac1-4532959ab4da tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:09.584657 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-793ccf34-4d5e-4b66-8ac1-4532959ab4da tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:09.585681 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-793ccf34-4d5e-4b66-8ac1-4532959ab4da tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:09.586405 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-793ccf34-4d5e-4b66-8ac1-4532959ab4da tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:09.593640 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-793ccf34-4d5e-4b66-8ac1-4532959ab4da tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:09.898529 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-793ccf34-4d5e-4b66-8ac1-4532959ab4da tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a02cd1108b947b186202f6d15e6cf0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c0b095138354810949093e7ea03b8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:09.912759 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-793ccf34-4d5e-4b66-8ac1-4532959ab4da tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] 10.222.0.20 "GET /compute/v2.1/servers/6cc94ec4-3e28-41e0-808e-9cd2263bca7d" status: 200 len: 1554 microversion: 2.1 time: 0.361415 Oct 04 18:43:09.913922 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1818/3686] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:09 2022] GET /compute/v2.1/servers/6cc94ec4-3e28-41e0-808e-9cd2263bca7d => generated 1554 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:09.943360 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-54b44d50-712d-4615-864a-3b7265bf2cf5 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:09.944151 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-54b44d50-712d-4615-864a-3b7265bf2cf5 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] [instance: 6cc94ec4-3e28-41e0-808e-9cd2263bca7d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:09.954803 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-54b44d50-712d-4615-864a-3b7265bf2cf5 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:09.955307 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-54b44d50-712d-4615-864a-3b7265bf2cf5 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:09.955749 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-54b44d50-712d-4615-864a-3b7265bf2cf5 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:09.956502 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-54b44d50-712d-4615-864a-3b7265bf2cf5 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:09.956999 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-54b44d50-712d-4615-864a-3b7265bf2cf5 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:09.957428 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-54b44d50-712d-4615-864a-3b7265bf2cf5 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:10.107595 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-54b44d50-712d-4615-864a-3b7265bf2cf5 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] 10.222.0.20 "GET /compute/v2.1/servers/6cc94ec4-3e28-41e0-808e-9cd2263bca7d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.168292 Oct 04 18:43:10.108585 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1869/3687] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Oct 4 18:43:09 2022] GET /compute/v2.1/servers/6cc94ec4-3e28-41e0-808e-9cd2263bca7d/os-interface => generated 284 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:43:10.276214 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8e1b4d0f-8753-43f3-9920-045c81e06d6d tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:10.285668 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8e1b4d0f-8753-43f3-9920-045c81e06d6d tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] [instance: 471125af-1ec3-44b3-bb69-36b04a03fdd5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:10.285668 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8e1b4d0f-8753-43f3-9920-045c81e06d6d tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:10.286229 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8e1b4d0f-8753-43f3-9920-045c81e06d6d tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:10.286766 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8e1b4d0f-8753-43f3-9920-045c81e06d6d tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:10.287759 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8e1b4d0f-8753-43f3-9920-045c81e06d6d tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:10.288486 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8e1b4d0f-8753-43f3-9920-045c81e06d6d tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:10.288923 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8e1b4d0f-8753-43f3-9920-045c81e06d6d tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:10.309429 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0e17be7d-57aa-4fe1-adc3-2b058ca515d8 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:10.310335 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0e17be7d-57aa-4fe1-adc3-2b058ca515d8 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: af46589b-8af1-4394-86e3-631c7d483a12] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:10.319626 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0e17be7d-57aa-4fe1-adc3-2b058ca515d8 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:10.320563 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0e17be7d-57aa-4fe1-adc3-2b058ca515d8 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:10.321238 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0e17be7d-57aa-4fe1-adc3-2b058ca515d8 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:10.322223 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0e17be7d-57aa-4fe1-adc3-2b058ca515d8 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:10.322909 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0e17be7d-57aa-4fe1-adc3-2b058ca515d8 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:10.323505 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0e17be7d-57aa-4fe1-adc3-2b058ca515d8 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:10.819982 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8e1b4d0f-8753-43f3-9920-045c81e06d6d tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8d2814c23a4aa9806d56ce99c89e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8596483de9f14de9a88cdb787841fd3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:10.830671 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8e1b4d0f-8753-43f3-9920-045c81e06d6d tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/servers/471125af-1ec3-44b3-bb69-36b04a03fdd5" status: 200 len: 1465 microversion: 2.1 time: 0.566901 Oct 04 18:43:10.840946 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1819/3688] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:10 2022] GET /compute/v2.1/servers/471125af-1ec3-44b3-bb69-36b04a03fdd5 => generated 1465 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:10.840946 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-dd5d1f07-1996-4972-b781-df85e13f30c4 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:10.840946 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-dd5d1f07-1996-4972-b781-df85e13f30c4 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 766fe762-0e33-4174-a817-827f782572d9] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:10.862397 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dd5d1f07-1996-4972-b781-df85e13f30c4 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:10.862961 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dd5d1f07-1996-4972-b781-df85e13f30c4 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:10.863380 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dd5d1f07-1996-4972-b781-df85e13f30c4 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:10.864150 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dd5d1f07-1996-4972-b781-df85e13f30c4 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:10.864790 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dd5d1f07-1996-4972-b781-df85e13f30c4 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:10.865384 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dd5d1f07-1996-4972-b781-df85e13f30c4 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:10.925469 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0e17be7d-57aa-4fe1-adc3-2b058ca515d8 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:10.937644 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0e17be7d-57aa-4fe1-adc3-2b058ca515d8 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/af46589b-8af1-4394-86e3-631c7d483a12" status: 200 len: 1508 microversion: 2.1 time: 0.632242 Oct 04 18:43:10.941755 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1870/3689] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:10 2022] GET /compute/v2.1/servers/af46589b-8af1-4394-86e3-631c7d483a12 => generated 1508 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:10.947613 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8207f2b4-e81a-4da4-8889-3279617934f2 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:10.948486 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8207f2b4-e81a-4da4-8889-3279617934f2 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] [instance: 6905c432-0fb3-4f5a-84bb-0ffcb08e2b3c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:10.956863 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8207f2b4-e81a-4da4-8889-3279617934f2 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:10.957542 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8207f2b4-e81a-4da4-8889-3279617934f2 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:10.958150 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8207f2b4-e81a-4da4-8889-3279617934f2 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:10.959272 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8207f2b4-e81a-4da4-8889-3279617934f2 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:10.959898 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8207f2b4-e81a-4da4-8889-3279617934f2 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:10.960514 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8207f2b4-e81a-4da4-8889-3279617934f2 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:11.036026 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-dd5d1f07-1996-4972-b781-df85e13f30c4 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:11.046759 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-dd5d1f07-1996-4972-b781-df85e13f30c4 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/766fe762-0e33-4174-a817-827f782572d9" status: 200 len: 1260 microversion: 2.1 time: 0.212817 Oct 04 18:43:11.049548 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1820/3690] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:10 2022] GET /compute/v2.1/servers/766fe762-0e33-4174-a817-827f782572d9 => generated 1260 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:11.350047 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8207f2b4-e81a-4da4-8889-3279617934f2 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8d2814c23a4aa9806d56ce99c89e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8596483de9f14de9a88cdb787841fd3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:11.361198 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8207f2b4-e81a-4da4-8889-3279617934f2 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/servers/6905c432-0fb3-4f5a-84bb-0ffcb08e2b3c" status: 200 len: 1466 microversion: 2.1 time: 0.417789 Oct 04 18:43:11.361805 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1871/3691] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:10 2022] GET /compute/v2.1/servers/6905c432-0fb3-4f5a-84bb-0ffcb08e2b3c => generated 1466 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:11.388878 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-673c9aac-e152-4b24-9526-d013fc001d3d tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1449841651"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:43:11.391587 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-673c9aac-e152-4b24-9526-d013fc001d3d tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] [instance: 6905c432-0fb3-4f5a-84bb-0ffcb08e2b3c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:11.401071 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-673c9aac-e152-4b24-9526-d013fc001d3d tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:11.401569 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-673c9aac-e152-4b24-9526-d013fc001d3d tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:11.402257 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-673c9aac-e152-4b24-9526-d013fc001d3d tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:11.403775 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-673c9aac-e152-4b24-9526-d013fc001d3d tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:11.404445 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-673c9aac-e152-4b24-9526-d013fc001d3d tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:11.405169 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-673c9aac-e152-4b24-9526-d013fc001d3d tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:11.925308 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-673c9aac-e152-4b24-9526-d013fc001d3d tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "POST /compute/v2.1/servers/6905c432-0fb3-4f5a-84bb-0ffcb08e2b3c/action" status: 202 len: 0 microversion: 2.1 time: 0.540278 Oct 04 18:43:11.925969 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1821/3692] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:43:11 2022] POST /compute/v2.1/servers/6905c432-0fb3-4f5a-84bb-0ffcb08e2b3c/action => generated 0 bytes in 542 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 18:43:11.937110 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5dadfbac-7371-4878-b337-23c83236f4f9 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe258c2d550>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:11.967182 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1b8ce747-0cd4-4b8d-8e2d-44d7744a3ba2 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:11.968243 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1b8ce747-0cd4-4b8d-8e2d-44d7744a3ba2 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: af46589b-8af1-4394-86e3-631c7d483a12] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:11.976819 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1b8ce747-0cd4-4b8d-8e2d-44d7744a3ba2 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:11.977303 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1b8ce747-0cd4-4b8d-8e2d-44d7744a3ba2 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:11.978388 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1b8ce747-0cd4-4b8d-8e2d-44d7744a3ba2 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:11.979278 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1b8ce747-0cd4-4b8d-8e2d-44d7744a3ba2 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:11.980163 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1b8ce747-0cd4-4b8d-8e2d-44d7744a3ba2 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:11.981040 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1b8ce747-0cd4-4b8d-8e2d-44d7744a3ba2 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:11.992821 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5dadfbac-7371-4878-b337-23c83236f4f9 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/images/5c609fc9-3cfe-4683-9148-134d915f048c" status: 200 len: 1455 microversion: 2.1 time: 0.059953 Oct 04 18:43:11.993502 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1872/3693] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:43:11 2022] GET /compute/v2.1/images/5c609fc9-3cfe-4683-9148-134d915f048c => generated 1455 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:12.076281 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-72102982-f3c7-47dc-94c8-1e163d5d61df tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:12.076281 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-72102982-f3c7-47dc-94c8-1e163d5d61df tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 766fe762-0e33-4174-a817-827f782572d9] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:12.092767 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-72102982-f3c7-47dc-94c8-1e163d5d61df tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:12.093623 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-72102982-f3c7-47dc-94c8-1e163d5d61df tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:12.094274 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-72102982-f3c7-47dc-94c8-1e163d5d61df tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:12.097955 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-72102982-f3c7-47dc-94c8-1e163d5d61df tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:12.098676 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-72102982-f3c7-47dc-94c8-1e163d5d61df tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:12.099853 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-72102982-f3c7-47dc-94c8-1e163d5d61df tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:12.147251 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:43:12.209070 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1b8ce747-0cd4-4b8d-8e2d-44d7744a3ba2 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:12.217285 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1b8ce747-0cd4-4b8d-8e2d-44d7744a3ba2 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/af46589b-8af1-4394-86e3-631c7d483a12" status: 200 len: 1514 microversion: 2.1 time: 0.258651 Oct 04 18:43:12.217958 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1822/3694] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:11 2022] GET /compute/v2.1/servers/af46589b-8af1-4394-86e3-631c7d483a12 => generated 1514 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:43:12.235202 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-72102982-f3c7-47dc-94c8-1e163d5d61df tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:12.256272 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-72102982-f3c7-47dc-94c8-1e163d5d61df tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/766fe762-0e33-4174-a817-827f782572d9" status: 200 len: 1266 microversion: 2.1 time: 0.182421 Oct 04 18:43:12.256272 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1873/3695] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:12 2022] GET /compute/v2.1/servers/766fe762-0e33-4174-a817-827f782572d9 => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:12.987349 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-448aaf26-f4fe-4c74-a583-801f8801afc6 req-de45d2eb-47b4-4ad1-af1c-d4ba323f9d88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6cc94ec4-3e28-41e0-808e-9cd2263bca7d", "tag": "1556befc-7a17-4e26-aa0f-68b9c412823d"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:43:13.011906 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-448aaf26-f4fe-4c74-a583-801f8801afc6 req-de45d2eb-47b4-4ad1-af1c-d4ba323f9d88 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:13.012604 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-448aaf26-f4fe-4c74-a583-801f8801afc6 req-de45d2eb-47b4-4ad1-af1c-d4ba323f9d88 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:13.013066 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-448aaf26-f4fe-4c74-a583-801f8801afc6 req-de45d2eb-47b4-4ad1-af1c-d4ba323f9d88 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:13.017146 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ff5e6d45-7d4c-4ff7-9fc1-2c035675b9f6 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe258c2d280>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:13.034734 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-448aaf26-f4fe-4c74-a583-801f8801afc6 req-de45d2eb-47b4-4ad1-af1c-d4ba323f9d88 service nova] Creating event network-changed:1556befc-7a17-4e26-aa0f-68b9c412823d for instance 6cc94ec4-3e28-41e0-808e-9cd2263bca7d on n-h2-850501-14 Oct 04 18:43:13.052673 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-448aaf26-f4fe-4c74-a583-801f8801afc6 req-de45d2eb-47b4-4ad1-af1c-d4ba323f9d88 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.333409 Oct 04 18:43:13.053656 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1823/3696] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:43:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:43:13.118768 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ff5e6d45-7d4c-4ff7-9fc1-2c035675b9f6 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/images/5c609fc9-3cfe-4683-9148-134d915f048c" status: 200 len: 1455 microversion: 2.1 time: 0.113600 Oct 04 18:43:13.121491 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1874/3697] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:43:13 2022] GET /compute/v2.1/images/5c609fc9-3cfe-4683-9148-134d915f048c => generated 1455 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:13.293038 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1b64fb9e-00ee-4aca-b380-11208558fbad tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:13.293735 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1b64fb9e-00ee-4aca-b380-11208558fbad tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 766fe762-0e33-4174-a817-827f782572d9] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:13.302992 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1b64fb9e-00ee-4aca-b380-11208558fbad tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:13.303842 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1b64fb9e-00ee-4aca-b380-11208558fbad tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:13.305135 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1b64fb9e-00ee-4aca-b380-11208558fbad tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:13.306639 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1b64fb9e-00ee-4aca-b380-11208558fbad tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:13.308141 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1b64fb9e-00ee-4aca-b380-11208558fbad tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:13.308766 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1b64fb9e-00ee-4aca-b380-11208558fbad tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:13.664555 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1b64fb9e-00ee-4aca-b380-11208558fbad tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:13.682721 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1b64fb9e-00ee-4aca-b380-11208558fbad tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/766fe762-0e33-4174-a817-827f782572d9" status: 200 len: 1308 microversion: 2.1 time: 0.390243 Oct 04 18:43:13.686490 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1824/3698] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:13 2022] GET /compute/v2.1/servers/766fe762-0e33-4174-a817-827f782572d9 => generated 1308 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:14.142673 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-96511148-2494-43d9-b16d-4500789f5d5f tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe2582d49d0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:14.225695 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-96511148-2494-43d9-b16d-4500789f5d5f tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/images/5c609fc9-3cfe-4683-9148-134d915f048c" status: 200 len: 1455 microversion: 2.1 time: 0.089557 Oct 04 18:43:14.226946 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1875/3699] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:43:14 2022] GET /compute/v2.1/images/5c609fc9-3cfe-4683-9148-134d915f048c => generated 1455 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:14.714126 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d1aa53dd-982b-4b48-8168-62bdaa8ecd56 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:14.734429 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d1aa53dd-982b-4b48-8168-62bdaa8ecd56 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 766fe762-0e33-4174-a817-827f782572d9] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:14.748600 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d1aa53dd-982b-4b48-8168-62bdaa8ecd56 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:14.749457 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d1aa53dd-982b-4b48-8168-62bdaa8ecd56 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:14.750266 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d1aa53dd-982b-4b48-8168-62bdaa8ecd56 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:14.752834 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d1aa53dd-982b-4b48-8168-62bdaa8ecd56 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:14.753527 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d1aa53dd-982b-4b48-8168-62bdaa8ecd56 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:14.754329 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d1aa53dd-982b-4b48-8168-62bdaa8ecd56 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:14.939349 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d1aa53dd-982b-4b48-8168-62bdaa8ecd56 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:14.951580 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d1aa53dd-982b-4b48-8168-62bdaa8ecd56 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/766fe762-0e33-4174-a817-827f782572d9" status: 200 len: 1308 microversion: 2.1 time: 0.244107 Oct 04 18:43:14.952840 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1825/3700] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:14 2022] GET /compute/v2.1/servers/766fe762-0e33-4174-a817-827f782572d9 => generated 1308 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:15.246812 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e523390b-31bb-4ab2-b209-09019e158b05 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe2590fe040>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:15.296048 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-278f4fd9-4b37-448e-9d54-f46150a2e81d tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Action: 'create', calling method: .version_select at 0x7fe258857160>, body: {"keypair": {"name": "tempest-keypair-507887397", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBHDmI3zgcURPkaToZQ88a2ORDScDWRIbhuL9rfaVxjQonfaElFXUabLh41dbA5lTTFUj/MfR+efF93SzNAI+IkOis0NzlVhNF2QIDGmNBQHc64BuitWfdocY9AhUvd4dA=="}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:43:15.311997 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e523390b-31bb-4ab2-b209-09019e158b05 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/images/5c609fc9-3cfe-4683-9148-134d915f048c" status: 200 len: 1455 microversion: 2.1 time: 0.073751 Oct 04 18:43:15.315264 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1876/3701] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:43:15 2022] GET /compute/v2.1/images/5c609fc9-3cfe-4683-9148-134d915f048c => generated 1455 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:43:15.317584 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-278f4fd9-4b37-448e-9d54-f46150a2e81d tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Getting quotas for project 9eb391aef10e4684ada5f811ae818f97. Resources: {'key_pairs'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:43:15.324303 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-278f4fd9-4b37-448e-9d54-f46150a2e81d tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Getting quotas for user c4243e3907374e5e9947c17e6288f0e7 and project 9eb391aef10e4684ada5f811ae818f97. Resources: {'key_pairs'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:43:15.407619 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-5c2ea731-1923-4057-8f62-50338a082dc8 req-6749e900-e516-48df-bb80-3ea47b8c5c92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "766fe762-0e33-4174-a817-827f782572d9", "tag": "2764711d-cd2e-4597-8667-8645e399a5d7"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:43:15.418959 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-5c2ea731-1923-4057-8f62-50338a082dc8 req-6749e900-e516-48df-bb80-3ea47b8c5c92 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:15.419574 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-5c2ea731-1923-4057-8f62-50338a082dc8 req-6749e900-e516-48df-bb80-3ea47b8c5c92 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:15.420076 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-5c2ea731-1923-4057-8f62-50338a082dc8 req-6749e900-e516-48df-bb80-3ea47b8c5c92 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:15.432428 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-5c2ea731-1923-4057-8f62-50338a082dc8 req-6749e900-e516-48df-bb80-3ea47b8c5c92 service nova] Creating event network-changed:2764711d-cd2e-4597-8667-8645e399a5d7 for instance 766fe762-0e33-4174-a817-827f782572d9 on n-h2-850501-14 Oct 04 18:43:15.437702 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-5c2ea731-1923-4057-8f62-50338a082dc8 req-6749e900-e516-48df-bb80-3ea47b8c5c92 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034377 Oct 04 18:43:15.438973 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1877/3702] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:43:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:43:15.455520 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-278f4fd9-4b37-448e-9d54-f46150a2e81d tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.164275 Oct 04 18:43:15.458899 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1826/3703] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Oct 4 18:43:15 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:43:15.753917 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d9ef7b2a-cb09-4a44-b993-dc148e988567 tempest-AZV2TestJSON-986993457 tempest-AZV2TestJSON-986993457-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:15.755623 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d9ef7b2a-cb09-4a44-b993-dc148e988567 tempest-AZV2TestJSON-986993457 tempest-AZV2TestJSON-986993457-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:15.756139 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d9ef7b2a-cb09-4a44-b993-dc148e988567 tempest-AZV2TestJSON-986993457 tempest-AZV2TestJSON-986993457-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:15.756769 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d9ef7b2a-cb09-4a44-b993-dc148e988567 tempest-AZV2TestJSON-986993457 tempest-AZV2TestJSON-986993457-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:15.757505 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d9ef7b2a-cb09-4a44-b993-dc148e988567 tempest-AZV2TestJSON-986993457 tempest-AZV2TestJSON-986993457-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:15.757959 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d9ef7b2a-cb09-4a44-b993-dc148e988567 tempest-AZV2TestJSON-986993457 tempest-AZV2TestJSON-986993457-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:15.760180 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d9ef7b2a-cb09-4a44-b993-dc148e988567 tempest-AZV2TestJSON-986993457 tempest-AZV2TestJSON-986993457-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:15.819533 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d9ef7b2a-cb09-4a44-b993-dc148e988567 tempest-AZV2TestJSON-986993457 tempest-AZV2TestJSON-986993457-project] 10.222.0.20 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.369103 Oct 04 18:43:15.823886 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1878/3704] 10.222.0.20 () {58 vars in 1164 bytes} [Tue Oct 4 18:43:15 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 18:43:15.977956 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8f7a7098-fcf6-492e-bfe6-35a093531cb8 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:15.978488 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8f7a7098-fcf6-492e-bfe6-35a093531cb8 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 766fe762-0e33-4174-a817-827f782572d9] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:15.991350 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8f7a7098-fcf6-492e-bfe6-35a093531cb8 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:15.991350 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8f7a7098-fcf6-492e-bfe6-35a093531cb8 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:15.991350 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8f7a7098-fcf6-492e-bfe6-35a093531cb8 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:15.991350 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8f7a7098-fcf6-492e-bfe6-35a093531cb8 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:15.991350 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8f7a7098-fcf6-492e-bfe6-35a093531cb8 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:15.991350 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8f7a7098-fcf6-492e-bfe6-35a093531cb8 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:15.995239 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:43:16.140702 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8f7a7098-fcf6-492e-bfe6-35a093531cb8 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:16.152845 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8f7a7098-fcf6-492e-bfe6-35a093531cb8 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/766fe762-0e33-4174-a817-827f782572d9" status: 200 len: 1308 microversion: 2.1 time: 0.179734 Oct 04 18:43:16.154476 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1827/3705] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:15 2022] GET /compute/v2.1/servers/766fe762-0e33-4174-a817-827f782572d9 => generated 1308 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:16.331524 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b445416d-fa91-4169-96c0-e343d14e7fda tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe2590a8310>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:16.398101 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b445416d-fa91-4169-96c0-e343d14e7fda tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/images/5c609fc9-3cfe-4683-9148-134d915f048c" status: 200 len: 1455 microversion: 2.1 time: 0.071708 Oct 04 18:43:16.405455 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1879/3706] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:43:16 2022] GET /compute/v2.1/images/5c609fc9-3cfe-4683-9148-134d915f048c => generated 1455 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:17.178405 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c3250971-6b20-41a0-a4ac-b996959b8c36 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:17.179586 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c3250971-6b20-41a0-a4ac-b996959b8c36 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 766fe762-0e33-4174-a817-827f782572d9] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:17.181821 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:43:17.193321 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c3250971-6b20-41a0-a4ac-b996959b8c36 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:17.194879 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c3250971-6b20-41a0-a4ac-b996959b8c36 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:17.196279 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c3250971-6b20-41a0-a4ac-b996959b8c36 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:17.197279 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c3250971-6b20-41a0-a4ac-b996959b8c36 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:17.198018 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c3250971-6b20-41a0-a4ac-b996959b8c36 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:17.198671 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c3250971-6b20-41a0-a4ac-b996959b8c36 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:17.383458 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c3250971-6b20-41a0-a4ac-b996959b8c36 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:17.396301 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c3250971-6b20-41a0-a4ac-b996959b8c36 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/766fe762-0e33-4174-a817-827f782572d9" status: 200 len: 1308 microversion: 2.1 time: 0.221339 Oct 04 18:43:17.397779 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1828/3707] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:17 2022] GET /compute/v2.1/servers/766fe762-0e33-4174-a817-827f782572d9 => generated 1308 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:17.417588 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-87af74e0-c58e-4072-8b9f-8811af127e4a tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe25921c1f0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:17.481095 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-87af74e0-c58e-4072-8b9f-8811af127e4a tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/images/5c609fc9-3cfe-4683-9148-134d915f048c" status: 200 len: 1455 microversion: 2.1 time: 0.070386 Oct 04 18:43:17.482264 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1880/3708] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:43:17 2022] GET /compute/v2.1/images/5c609fc9-3cfe-4683-9148-134d915f048c => generated 1455 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:17.991836 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-4d2cc3d8-4c10-45f8-9401-4d33ebdefccc req-e04c7f39-3e18-40ee-850f-70c36f19dd1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6905c432-0fb3-4f5a-84bb-0ffcb08e2b3c", "name": "network-vif-plugged", "status": "completed", "tag": "457c88d9-9246-435c-b1a5-58b0c6c6185d"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:43:18.030119 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-4d2cc3d8-4c10-45f8-9401-4d33ebdefccc req-e04c7f39-3e18-40ee-850f-70c36f19dd1b service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:18.038998 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-4d2cc3d8-4c10-45f8-9401-4d33ebdefccc req-e04c7f39-3e18-40ee-850f-70c36f19dd1b service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:18.046791 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-4d2cc3d8-4c10-45f8-9401-4d33ebdefccc req-e04c7f39-3e18-40ee-850f-70c36f19dd1b service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:18.123379 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-4d2cc3d8-4c10-45f8-9401-4d33ebdefccc req-e04c7f39-3e18-40ee-850f-70c36f19dd1b service nova] Creating event network-vif-plugged:457c88d9-9246-435c-b1a5-58b0c6c6185d for instance 6905c432-0fb3-4f5a-84bb-0ffcb08e2b3c on n-h1-850501-14 Oct 04 18:43:18.138232 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-4d2cc3d8-4c10-45f8-9401-4d33ebdefccc req-e04c7f39-3e18-40ee-850f-70c36f19dd1b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149875 Oct 04 18:43:18.141496 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1829/3709] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:43:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:43:18.419857 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:43:18.425303 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9833c938-7a61-42fc-9746-569aad6ba316 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:18.426233 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-9833c938-7a61-42fc-9746-569aad6ba316 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 766fe762-0e33-4174-a817-827f782572d9] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:18.435149 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9833c938-7a61-42fc-9746-569aad6ba316 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:18.435844 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9833c938-7a61-42fc-9746-569aad6ba316 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:18.436475 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9833c938-7a61-42fc-9746-569aad6ba316 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:18.447528 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9833c938-7a61-42fc-9746-569aad6ba316 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:18.448531 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9833c938-7a61-42fc-9746-569aad6ba316 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:18.449226 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9833c938-7a61-42fc-9746-569aad6ba316 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:18.499719 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8fe9127d-907b-4709-8602-548dc68f2828 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe259335040>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:18.604267 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8fe9127d-907b-4709-8602-548dc68f2828 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/images/5c609fc9-3cfe-4683-9148-134d915f048c" status: 200 len: 1455 microversion: 2.1 time: 0.108749 Oct 04 18:43:18.606931 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1830/3710] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:43:18 2022] GET /compute/v2.1/images/5c609fc9-3cfe-4683-9148-134d915f048c => generated 1455 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:18.854438 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9833c938-7a61-42fc-9746-569aad6ba316 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:18.866330 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9833c938-7a61-42fc-9746-569aad6ba316 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/766fe762-0e33-4174-a817-827f782572d9" status: 200 len: 1308 microversion: 2.1 time: 0.447083 Oct 04 18:43:18.867162 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1881/3711] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:18 2022] GET /compute/v2.1/servers/766fe762-0e33-4174-a817-827f782572d9 => generated 1308 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:19.628274 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-bc9c5582-b380-4312-94d4-fe7d604bb3a7 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1315337352", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": "none"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:43:19.630830 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3ff43788-c9eb-43d8-be0e-abe7fbabdc92 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe253e1cf70>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:19.800582 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3ff43788-c9eb-43d8-be0e-abe7fbabdc92 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/images/5c609fc9-3cfe-4683-9148-134d915f048c" status: 200 len: 1455 microversion: 2.1 time: 0.183340 Oct 04 18:43:19.801456 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1882/3712] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:43:19 2022] GET /compute/v2.1/images/5c609fc9-3cfe-4683-9148-134d915f048c => generated 1455 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:19.814838 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-bc9c5582-b380-4312-94d4-fe7d604bb3a7 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:43:19.815276 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-bc9c5582-b380-4312-94d4-fe7d604bb3a7 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:43:19.816353 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-bc9c5582-b380-4312-94d4-fe7d604bb3a7 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:43:19.817038 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-bc9c5582-b380-4312-94d4-fe7d604bb3a7 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:43:19.817462 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-bc9c5582-b380-4312-94d4-fe7d604bb3a7 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:43:19.855279 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bc9c5582-b380-4312-94d4-fe7d604bb3a7 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:19.857419 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bc9c5582-b380-4312-94d4-fe7d604bb3a7 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:19.860676 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bc9c5582-b380-4312-94d4-fe7d604bb3a7 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:19.861664 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bc9c5582-b380-4312-94d4-fe7d604bb3a7 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:19.862191 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bc9c5582-b380-4312-94d4-fe7d604bb3a7 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:19.862904 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bc9c5582-b380-4312-94d4-fe7d604bb3a7 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:19.897787 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1eb7ee72-803c-4fbd-b48b-3db39929a73f tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:19.898662 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1eb7ee72-803c-4fbd-b48b-3db39929a73f tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 766fe762-0e33-4174-a817-827f782572d9] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:19.923101 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1eb7ee72-803c-4fbd-b48b-3db39929a73f tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:19.923750 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1eb7ee72-803c-4fbd-b48b-3db39929a73f tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:19.924323 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1eb7ee72-803c-4fbd-b48b-3db39929a73f tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:19.925139 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1eb7ee72-803c-4fbd-b48b-3db39929a73f tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:19.925839 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1eb7ee72-803c-4fbd-b48b-3db39929a73f tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:19.929267 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1eb7ee72-803c-4fbd-b48b-3db39929a73f tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:19.940244 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-bc9c5582-b380-4312-94d4-fe7d604bb3a7 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Getting quotas for project f920618391404d5aa7eb1d4c40b185a7. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:43:19.951528 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-bc9c5582-b380-4312-94d4-fe7d604bb3a7 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Getting quotas for user 72d0740437c04bceaa138b37cd1babd8 and project f920618391404d5aa7eb1d4c40b185a7. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:43:20.002120 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-bc9c5582-b380-4312-94d4-fe7d604bb3a7 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Going to run 1 instances... {{(pid=123002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:43:20.006386 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-bc9c5582-b380-4312-94d4-fe7d604bb3a7 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] [instance: 3a41fe60-b7d3-4560-af99-292f1478f419] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:43:20.210423 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-bc9c5582-b380-4312-94d4-fe7d604bb3a7 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.858375 Oct 04 18:43:20.220823 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1831/3713] 10.222.0.20 () {62 vars in 1188 bytes} [Tue Oct 4 18:43:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 869 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 18:43:20.226176 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3d6ce06b-a3b6-4522-b154-a2211a754861 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:20.227009 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3d6ce06b-a3b6-4522-b154-a2211a754861 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] [instance: 3a41fe60-b7d3-4560-af99-292f1478f419] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:20.269642 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1eb7ee72-803c-4fbd-b48b-3db39929a73f tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:20.285843 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1eb7ee72-803c-4fbd-b48b-3db39929a73f tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/766fe762-0e33-4174-a817-827f782572d9" status: 200 len: 1308 microversion: 2.1 time: 0.393542 Oct 04 18:43:20.287268 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1883/3714] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:19 2022] GET /compute/v2.1/servers/766fe762-0e33-4174-a817-827f782572d9 => generated 1308 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:20.337284 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3d6ce06b-a3b6-4522-b154-a2211a754861 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:20.348486 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3d6ce06b-a3b6-4522-b154-a2211a754861 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:20.350747 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3d6ce06b-a3b6-4522-b154-a2211a754861 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:20.352259 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3d6ce06b-a3b6-4522-b154-a2211a754861 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] 10.222.0.20 "GET /compute/v2.1/servers/3a41fe60-b7d3-4560-af99-292f1478f419" status: 200 len: 1278 microversion: 2.54 time: 0.129892 Oct 04 18:43:20.354054 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1832/3715] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:43:20 2022] GET /compute/v2.1/servers/3a41fe60-b7d3-4560-af99-292f1478f419 => generated 1278 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:43:20.553406 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e0bee19a-2f69-40c6-8d5e-d0540f485aab tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-888197297", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "81c29635-15f6-4834-a34a-2ac984cb21e0"}], "security_groups": [{"name": "tempest-securitygroup--161477827"}], "key_name": "tempest-keypair-507887397", "user_data": "}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:43:20.816731 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-984da8ce-a0f9-41d7-be14-e54693839712 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe258905f70>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:20.828882 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.neutron [None req-e0bee19a-2f69-40c6-8d5e-d0540f485aab tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] validate_networks() for [('81c29635-15f6-4834-a34a-2ac984cb21e0', None, None, None, None, None)] {{(pid=123001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:43:20.908995 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-984da8ce-a0f9-41d7-be14-e54693839712 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/images/5c609fc9-3cfe-4683-9148-134d915f048c" status: 200 len: 1455 microversion: 2.1 time: 0.096946 Oct 04 18:43:20.912508 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1833/3716] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:43:20 2022] GET /compute/v2.1/images/5c609fc9-3cfe-4683-9148-134d915f048c => generated 1455 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:43:21.315428 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-555e7633-96cf-43f0-b139-053b065d8559 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:21.316432 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-555e7633-96cf-43f0-b139-053b065d8559 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 766fe762-0e33-4174-a817-827f782572d9] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:21.334863 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-555e7633-96cf-43f0-b139-053b065d8559 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:21.336516 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-555e7633-96cf-43f0-b139-053b065d8559 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:21.337212 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-555e7633-96cf-43f0-b139-053b065d8559 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:21.344114 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-555e7633-96cf-43f0-b139-053b065d8559 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:21.346179 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-555e7633-96cf-43f0-b139-053b065d8559 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:21.347475 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-555e7633-96cf-43f0-b139-053b065d8559 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:21.830838 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-e0bee19a-2f69-40c6-8d5e-d0540f485aab tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:43:21.833189 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-e0bee19a-2f69-40c6-8d5e-d0540f485aab tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:43:21.836788 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-e0bee19a-2f69-40c6-8d5e-d0540f485aab tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:43:21.837475 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-e0bee19a-2f69-40c6-8d5e-d0540f485aab tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:43:21.840743 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-e0bee19a-2f69-40c6-8d5e-d0540f485aab tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:43:21.853395 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e0bee19a-2f69-40c6-8d5e-d0540f485aab tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:21.854158 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e0bee19a-2f69-40c6-8d5e-d0540f485aab tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:21.855885 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e0bee19a-2f69-40c6-8d5e-d0540f485aab tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:21.857527 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e0bee19a-2f69-40c6-8d5e-d0540f485aab tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:21.863804 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e0bee19a-2f69-40c6-8d5e-d0540f485aab tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:21.863804 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e0bee19a-2f69-40c6-8d5e-d0540f485aab tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:21.906029 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-e0bee19a-2f69-40c6-8d5e-d0540f485aab tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Getting quotas for project 9eb391aef10e4684ada5f811ae818f97. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:43:21.913474 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:43:21.915994 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-e0bee19a-2f69-40c6-8d5e-d0540f485aab tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Getting quotas for user c4243e3907374e5e9947c17e6288f0e7 and project 9eb391aef10e4684ada5f811ae818f97. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:43:21.929089 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-555e7633-96cf-43f0-b139-053b065d8559 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:21.939787 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-555e7633-96cf-43f0-b139-053b065d8559 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/766fe762-0e33-4174-a817-827f782572d9" status: 200 len: 1308 microversion: 2.1 time: 0.629322 Oct 04 18:43:21.951876 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1834/3717] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:21 2022] GET /compute/v2.1/servers/766fe762-0e33-4174-a817-827f782572d9 => generated 1308 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:43:21.966228 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5ccd5c5c-61ed-4c42-a3c5-52b20fd6544f tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:21.967055 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5ccd5c5c-61ed-4c42-a3c5-52b20fd6544f tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] [instance: 3a41fe60-b7d3-4560-af99-292f1478f419] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:21.973812 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5ccd5c5c-61ed-4c42-a3c5-52b20fd6544f tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:21.974313 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5ccd5c5c-61ed-4c42-a3c5-52b20fd6544f tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:21.974764 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5ccd5c5c-61ed-4c42-a3c5-52b20fd6544f tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:21.975487 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5ccd5c5c-61ed-4c42-a3c5-52b20fd6544f tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:21.975948 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5ccd5c5c-61ed-4c42-a3c5-52b20fd6544f tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:21.976427 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5ccd5c5c-61ed-4c42-a3c5-52b20fd6544f tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:22.000858 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e0bee19a-2f69-40c6-8d5e-d0540f485aab tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Going to run 1 instances... {{(pid=123001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:43:22.009869 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e0bee19a-2f69-40c6-8d5e-d0540f485aab tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: 4d6dfac0-958d-4698-a050-6539caebe52c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:43:22.080476 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5ccd5c5c-61ed-4c42-a3c5-52b20fd6544f tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:22.106842 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5ccd5c5c-61ed-4c42-a3c5-52b20fd6544f tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:22.108713 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5ccd5c5c-61ed-4c42-a3c5-52b20fd6544f tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:22.119519 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5ccd5c5c-61ed-4c42-a3c5-52b20fd6544f tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] 10.222.0.20 "GET /compute/v2.1/servers/3a41fe60-b7d3-4560-af99-292f1478f419" status: 200 len: 1282 microversion: 2.54 time: 0.157230 Oct 04 18:43:22.119519 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1835/3718] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:43:21 2022] GET /compute/v2.1/servers/3a41fe60-b7d3-4560-af99-292f1478f419 => generated 1282 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:43:22.123577 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6f0169b3-f5e3-4ae0-a3e0-21cf14a3a5ab tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe258857550>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:22.200413 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e0bee19a-2f69-40c6-8d5e-d0540f485aab tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.646675 Oct 04 18:43:22.214578 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1884/3719] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:43:20 2022] POST /compute/v2.1/servers => generated 408 bytes in 1668 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:43:22.217992 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6f0169b3-f5e3-4ae0-a3e0-21cf14a3a5ab tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/images/5c609fc9-3cfe-4683-9148-134d915f048c" status: 200 len: 1455 microversion: 2.1 time: 0.098777 Oct 04 18:43:22.220689 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1836/3720] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:43:22 2022] GET /compute/v2.1/images/5c609fc9-3cfe-4683-9148-134d915f048c => generated 1455 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:22.223486 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7eb1b466-872d-4fe3-ae1a-11313a65c1d1 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:22.225071 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7eb1b466-872d-4fe3-ae1a-11313a65c1d1 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: 4d6dfac0-958d-4698-a050-6539caebe52c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:22.342800 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7eb1b466-872d-4fe3-ae1a-11313a65c1d1 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:22.352271 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7eb1b466-872d-4fe3-ae1a-11313a65c1d1 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c" status: 200 len: 1244 microversion: 2.1 time: 0.135313 Oct 04 18:43:22.353677 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1885/3721] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:22 2022] GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c => generated 1244 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:22.977790 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-886fb3ed-5939-450d-834a-01f7f2612f0f tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:22.977790 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-886fb3ed-5939-450d-834a-01f7f2612f0f tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 766fe762-0e33-4174-a817-827f782572d9] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:22.977790 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-886fb3ed-5939-450d-834a-01f7f2612f0f tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:22.977790 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-886fb3ed-5939-450d-834a-01f7f2612f0f tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:22.977790 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-886fb3ed-5939-450d-834a-01f7f2612f0f tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:22.979053 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-886fb3ed-5939-450d-834a-01f7f2612f0f tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:22.979053 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-886fb3ed-5939-450d-834a-01f7f2612f0f tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:22.979626 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-886fb3ed-5939-450d-834a-01f7f2612f0f tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:23.147523 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e70d7eda-8226-4738-b781-024e9253e075 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:23.154962 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e70d7eda-8226-4738-b781-024e9253e075 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] [instance: 3a41fe60-b7d3-4560-af99-292f1478f419] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:23.163755 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e70d7eda-8226-4738-b781-024e9253e075 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:23.164567 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e70d7eda-8226-4738-b781-024e9253e075 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:23.165707 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e70d7eda-8226-4738-b781-024e9253e075 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:23.168586 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e70d7eda-8226-4738-b781-024e9253e075 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:23.169293 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e70d7eda-8226-4738-b781-024e9253e075 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:23.169961 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e70d7eda-8226-4738-b781-024e9253e075 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:23.238564 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-886fb3ed-5939-450d-834a-01f7f2612f0f tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:23.266725 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-886fb3ed-5939-450d-834a-01f7f2612f0f tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/766fe762-0e33-4174-a817-827f782572d9" status: 200 len: 1308 microversion: 2.1 time: 0.299496 Oct 04 18:43:23.270483 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1837/3722] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:22 2022] GET /compute/v2.1/servers/766fe762-0e33-4174-a817-827f782572d9 => generated 1308 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:23.294347 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8f6e50c5-b0f7-43a2-8586-9946bf367709 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe258a8d310>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:23.329828 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e70d7eda-8226-4738-b781-024e9253e075 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:23.347305 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e70d7eda-8226-4738-b781-024e9253e075 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:23.350018 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e70d7eda-8226-4738-b781-024e9253e075 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:23.355277 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e70d7eda-8226-4738-b781-024e9253e075 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] 10.222.0.20 "GET /compute/v2.1/servers/3a41fe60-b7d3-4560-af99-292f1478f419" status: 200 len: 1330 microversion: 2.54 time: 0.212582 Oct 04 18:43:23.373715 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1886/3723] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:43:23 2022] GET /compute/v2.1/servers/3a41fe60-b7d3-4560-af99-292f1478f419 => generated 1330 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:43:23.382722 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-564937b3-cfa0-4f13-bf37-15d3253fba00 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:23.385167 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-564937b3-cfa0-4f13-bf37-15d3253fba00 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: 4d6dfac0-958d-4698-a050-6539caebe52c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:23.410509 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8f6e50c5-b0f7-43a2-8586-9946bf367709 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/images/5c609fc9-3cfe-4683-9148-134d915f048c" status: 200 len: 1455 microversion: 2.1 time: 0.138704 Oct 04 18:43:23.418387 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1838/3724] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:43:23 2022] GET /compute/v2.1/images/5c609fc9-3cfe-4683-9148-134d915f048c => generated 1455 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:23.446118 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-564937b3-cfa0-4f13-bf37-15d3253fba00 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:23.455349 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-564937b3-cfa0-4f13-bf37-15d3253fba00 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c" status: 200 len: 1244 microversion: 2.1 time: 0.080230 Oct 04 18:43:23.456430 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1887/3725] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:23 2022] GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c => generated 1244 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:24.304419 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-61c6293b-59d3-4d8b-a0bf-a2731e84d51f tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:24.305226 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-61c6293b-59d3-4d8b-a0bf-a2731e84d51f tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 766fe762-0e33-4174-a817-827f782572d9] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:24.365109 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-61c6293b-59d3-4d8b-a0bf-a2731e84d51f tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:24.365682 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-61c6293b-59d3-4d8b-a0bf-a2731e84d51f tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:24.370427 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-61c6293b-59d3-4d8b-a0bf-a2731e84d51f tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:24.373489 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-61c6293b-59d3-4d8b-a0bf-a2731e84d51f tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:24.376338 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-61c6293b-59d3-4d8b-a0bf-a2731e84d51f tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:24.376852 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-61c6293b-59d3-4d8b-a0bf-a2731e84d51f tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:24.388225 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a5aa2e68-ec85-4de6-8644-daafd36e8006 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:24.392910 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a5aa2e68-ec85-4de6-8644-daafd36e8006 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] [instance: 3a41fe60-b7d3-4560-af99-292f1478f419] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:24.404560 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a5aa2e68-ec85-4de6-8644-daafd36e8006 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:24.406078 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a5aa2e68-ec85-4de6-8644-daafd36e8006 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:24.408717 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a5aa2e68-ec85-4de6-8644-daafd36e8006 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:24.410597 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a5aa2e68-ec85-4de6-8644-daafd36e8006 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:24.429318 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a5aa2e68-ec85-4de6-8644-daafd36e8006 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:24.429318 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a5aa2e68-ec85-4de6-8644-daafd36e8006 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:24.506007 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a5aa2e68-ec85-4de6-8644-daafd36e8006 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:24.519371 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a5aa2e68-ec85-4de6-8644-daafd36e8006 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:24.521497 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a5aa2e68-ec85-4de6-8644-daafd36e8006 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:24.532978 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a5aa2e68-ec85-4de6-8644-daafd36e8006 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] 10.222.0.20 "GET /compute/v2.1/servers/3a41fe60-b7d3-4560-af99-292f1478f419" status: 200 len: 1338 microversion: 2.54 time: 0.149980 Oct 04 18:43:24.535084 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1888/3726] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:43:24 2022] GET /compute/v2.1/servers/3a41fe60-b7d3-4560-af99-292f1478f419 => generated 1338 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:43:24.563005 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-028531e8-dad3-4567-8b6f-0788b8021916 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe2582d4e50>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:24.658361 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-028531e8-dad3-4567-8b6f-0788b8021916 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/images/5c609fc9-3cfe-4683-9148-134d915f048c" status: 200 len: 1455 microversion: 2.1 time: 0.112626 Oct 04 18:43:24.662512 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1889/3727] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:43:24 2022] GET /compute/v2.1/images/5c609fc9-3cfe-4683-9148-134d915f048c => generated 1455 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:24.667540 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b5ce4158-6af1-45e1-b6a1-6fc761ce8adc tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:24.697737 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b5ce4158-6af1-45e1-b6a1-6fc761ce8adc tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: 4d6dfac0-958d-4698-a050-6539caebe52c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:24.738314 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b5ce4158-6af1-45e1-b6a1-6fc761ce8adc tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:24.740843 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b5ce4158-6af1-45e1-b6a1-6fc761ce8adc tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:24.741304 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b5ce4158-6af1-45e1-b6a1-6fc761ce8adc tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:24.742055 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b5ce4158-6af1-45e1-b6a1-6fc761ce8adc tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:24.742522 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b5ce4158-6af1-45e1-b6a1-6fc761ce8adc tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:24.742959 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b5ce4158-6af1-45e1-b6a1-6fc761ce8adc tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:24.878844 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-61c6293b-59d3-4d8b-a0bf-a2731e84d51f tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:24.891112 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-61c6293b-59d3-4d8b-a0bf-a2731e84d51f tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/766fe762-0e33-4174-a817-827f782572d9" status: 200 len: 1308 microversion: 2.1 time: 0.596950 Oct 04 18:43:24.892464 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1839/3728] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:24 2022] GET /compute/v2.1/servers/766fe762-0e33-4174-a817-827f782572d9 => generated 1308 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:24.945026 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b5ce4158-6af1-45e1-b6a1-6fc761ce8adc tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:24.978573 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b5ce4158-6af1-45e1-b6a1-6fc761ce8adc tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c" status: 200 len: 1240 microversion: 2.1 time: 0.314688 Oct 04 18:43:24.979458 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1890/3729] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:24 2022] GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c => generated 1240 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:25.573462 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9262fc4a-79a6-427b-8804-ca5c345d4ab3 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:25.574213 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-9262fc4a-79a6-427b-8804-ca5c345d4ab3 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] [instance: 3a41fe60-b7d3-4560-af99-292f1478f419] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:25.590234 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9262fc4a-79a6-427b-8804-ca5c345d4ab3 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:25.590641 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9262fc4a-79a6-427b-8804-ca5c345d4ab3 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:25.594543 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9262fc4a-79a6-427b-8804-ca5c345d4ab3 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:25.603143 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9262fc4a-79a6-427b-8804-ca5c345d4ab3 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:25.603686 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9262fc4a-79a6-427b-8804-ca5c345d4ab3 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:25.604167 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9262fc4a-79a6-427b-8804-ca5c345d4ab3 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:25.659076 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-361a2690-23e8-4f5d-bcb4-32f10ac37b11 req-567851c5-a0bd-4401-b744-5e2ae35c1af9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "766fe762-0e33-4174-a817-827f782572d9", "name": "network-vif-plugged", "status": "completed", "tag": "2764711d-cd2e-4597-8667-8645e399a5d7"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:43:25.686656 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-361a2690-23e8-4f5d-bcb4-32f10ac37b11 req-567851c5-a0bd-4401-b744-5e2ae35c1af9 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:25.687145 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-361a2690-23e8-4f5d-bcb4-32f10ac37b11 req-567851c5-a0bd-4401-b744-5e2ae35c1af9 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:25.687914 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-361a2690-23e8-4f5d-bcb4-32f10ac37b11 req-567851c5-a0bd-4401-b744-5e2ae35c1af9 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:25.731299 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9262fc4a-79a6-427b-8804-ca5c345d4ab3 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:25.737880 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-361a2690-23e8-4f5d-bcb4-32f10ac37b11 req-567851c5-a0bd-4401-b744-5e2ae35c1af9 service nova] Creating event network-vif-plugged:2764711d-cd2e-4597-8667-8645e399a5d7 for instance 766fe762-0e33-4174-a817-827f782572d9 on n-h2-850501-14 Oct 04 18:43:25.747962 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9262fc4a-79a6-427b-8804-ca5c345d4ab3 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:25.747962 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9262fc4a-79a6-427b-8804-ca5c345d4ab3 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:25.749730 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9262fc4a-79a6-427b-8804-ca5c345d4ab3 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] 10.222.0.20 "GET /compute/v2.1/servers/3a41fe60-b7d3-4560-af99-292f1478f419" status: 200 len: 1336 microversion: 2.54 time: 0.181339 Oct 04 18:43:25.761647 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-361a2690-23e8-4f5d-bcb4-32f10ac37b11 req-567851c5-a0bd-4401-b744-5e2ae35c1af9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.392237 Oct 04 18:43:25.761647 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1840/3730] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:43:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:43:25.779118 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1891/3731] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:43:25 2022] GET /compute/v2.1/servers/3a41fe60-b7d3-4560-af99-292f1478f419 => generated 1336 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:43:25.781876 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-54617ef1-46de-443a-8760-2921d5c031ee tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe259433ee0>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:25.895159 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-54617ef1-46de-443a-8760-2921d5c031ee tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/images/5c609fc9-3cfe-4683-9148-134d915f048c" status: 200 len: 1455 microversion: 2.1 time: 0.126995 Oct 04 18:43:25.900712 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1841/3732] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:43:25 2022] GET /compute/v2.1/images/5c609fc9-3cfe-4683-9148-134d915f048c => generated 1455 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:25.918092 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-59c67fc0-f517-402a-b278-cc871f49720e tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:25.919542 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-59c67fc0-f517-402a-b278-cc871f49720e tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 766fe762-0e33-4174-a817-827f782572d9] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:25.931815 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-59c67fc0-f517-402a-b278-cc871f49720e tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:25.932355 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-59c67fc0-f517-402a-b278-cc871f49720e tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:25.932798 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-59c67fc0-f517-402a-b278-cc871f49720e tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:25.933512 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-59c67fc0-f517-402a-b278-cc871f49720e tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:25.933963 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-59c67fc0-f517-402a-b278-cc871f49720e tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:25.934388 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-59c67fc0-f517-402a-b278-cc871f49720e tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:26.010132 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2da652b9-926c-402b-a181-512c23bbc8a8 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:26.011264 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2da652b9-926c-402b-a181-512c23bbc8a8 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: 4d6dfac0-958d-4698-a050-6539caebe52c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:26.030270 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2da652b9-926c-402b-a181-512c23bbc8a8 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:26.032930 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2da652b9-926c-402b-a181-512c23bbc8a8 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:26.033664 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2da652b9-926c-402b-a181-512c23bbc8a8 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:26.034623 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2da652b9-926c-402b-a181-512c23bbc8a8 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:26.037942 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2da652b9-926c-402b-a181-512c23bbc8a8 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:26.038571 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2da652b9-926c-402b-a181-512c23bbc8a8 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:26.222605 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2da652b9-926c-402b-a181-512c23bbc8a8 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:26.246767 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2da652b9-926c-402b-a181-512c23bbc8a8 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c" status: 200 len: 1296 microversion: 2.1 time: 0.240920 Oct 04 18:43:26.273098 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1842/3733] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:26 2022] GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c => generated 1296 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:26.273351 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-59c67fc0-f517-402a-b278-cc871f49720e tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:26.285041 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-59c67fc0-f517-402a-b278-cc871f49720e tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/766fe762-0e33-4174-a817-827f782572d9" status: 200 len: 1308 microversion: 2.1 time: 0.372184 Oct 04 18:43:26.286183 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1892/3734] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:25 2022] GET /compute/v2.1/servers/766fe762-0e33-4174-a817-827f782572d9 => generated 1308 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:26.780315 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-204c93fd-c657-4b7e-bcfb-f65232db812c tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:26.795253 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-204c93fd-c657-4b7e-bcfb-f65232db812c tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] [instance: 3a41fe60-b7d3-4560-af99-292f1478f419] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:26.804990 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-204c93fd-c657-4b7e-bcfb-f65232db812c tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:26.805814 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-204c93fd-c657-4b7e-bcfb-f65232db812c tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:26.806469 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-204c93fd-c657-4b7e-bcfb-f65232db812c tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:26.807442 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-204c93fd-c657-4b7e-bcfb-f65232db812c tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:26.808200 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-204c93fd-c657-4b7e-bcfb-f65232db812c tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:26.808801 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-204c93fd-c657-4b7e-bcfb-f65232db812c tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:26.912217 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8d78eae4-1608-47fa-9139-11518a84cbee tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe25911e5e0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:26.990517 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8d78eae4-1608-47fa-9139-11518a84cbee tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/images/5c609fc9-3cfe-4683-9148-134d915f048c" status: 200 len: 1455 microversion: 2.1 time: 0.082395 Oct 04 18:43:26.991667 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1893/3735] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:43:26 2022] GET /compute/v2.1/images/5c609fc9-3cfe-4683-9148-134d915f048c => generated 1455 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:27.005778 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-204c93fd-c657-4b7e-bcfb-f65232db812c tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:27.028475 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-204c93fd-c657-4b7e-bcfb-f65232db812c tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:27.030546 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-204c93fd-c657-4b7e-bcfb-f65232db812c tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:27.033228 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-204c93fd-c657-4b7e-bcfb-f65232db812c tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] 10.222.0.20 "GET /compute/v2.1/servers/3a41fe60-b7d3-4560-af99-292f1478f419" status: 200 len: 1336 microversion: 2.54 time: 0.259587 Oct 04 18:43:27.034177 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1843/3736] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:43:26 2022] GET /compute/v2.1/servers/3a41fe60-b7d3-4560-af99-292f1478f419 => generated 1336 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:43:27.271551 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-55a88725-472d-4a74-a8d2-3c1c11f73182 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:27.272215 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-55a88725-472d-4a74-a8d2-3c1c11f73182 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: 4d6dfac0-958d-4698-a050-6539caebe52c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:27.290136 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-55a88725-472d-4a74-a8d2-3c1c11f73182 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:27.290922 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-55a88725-472d-4a74-a8d2-3c1c11f73182 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:27.291536 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-55a88725-472d-4a74-a8d2-3c1c11f73182 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:27.292485 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-55a88725-472d-4a74-a8d2-3c1c11f73182 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:27.293101 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-55a88725-472d-4a74-a8d2-3c1c11f73182 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:27.293687 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-55a88725-472d-4a74-a8d2-3c1c11f73182 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:27.309767 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d564da37-7f03-4658-a2f6-4608069214ef tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:27.310394 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d564da37-7f03-4658-a2f6-4608069214ef tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 766fe762-0e33-4174-a817-827f782572d9] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:27.323399 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d564da37-7f03-4658-a2f6-4608069214ef tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:27.329914 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d564da37-7f03-4658-a2f6-4608069214ef tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:27.330488 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d564da37-7f03-4658-a2f6-4608069214ef tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:27.331366 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d564da37-7f03-4658-a2f6-4608069214ef tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:27.340721 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d564da37-7f03-4658-a2f6-4608069214ef tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:27.341510 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d564da37-7f03-4658-a2f6-4608069214ef tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:27.413220 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-55a88725-472d-4a74-a8d2-3c1c11f73182 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:27.438692 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-55a88725-472d-4a74-a8d2-3c1c11f73182 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c" status: 200 len: 1296 microversion: 2.1 time: 0.171010 Oct 04 18:43:27.439909 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1894/3737] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:27 2022] GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c => generated 1296 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:27.629275 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d564da37-7f03-4658-a2f6-4608069214ef tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:27.640715 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d564da37-7f03-4658-a2f6-4608069214ef tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/766fe762-0e33-4174-a817-827f782572d9" status: 200 len: 1308 microversion: 2.1 time: 0.335645 Oct 04 18:43:27.662850 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1844/3738] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:27 2022] GET /compute/v2.1/servers/766fe762-0e33-4174-a817-827f782572d9 => generated 1308 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:43:28.007601 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0d6c97a5-4862-43ed-9f5b-ec2b33979dbf tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe259091dc0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:28.137449 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0d6c97a5-4862-43ed-9f5b-ec2b33979dbf tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/images/5c609fc9-3cfe-4683-9148-134d915f048c" status: 200 len: 1455 microversion: 2.1 time: 0.134489 Oct 04 18:43:28.138192 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1895/3739] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:43:28 2022] GET /compute/v2.1/images/5c609fc9-3cfe-4683-9148-134d915f048c => generated 1455 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:43:28.149985 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0e0b7ef7-217a-4236-8f99-e5e94d5fb3ff tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:28.159448 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0e0b7ef7-217a-4236-8f99-e5e94d5fb3ff tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] [instance: 3a41fe60-b7d3-4560-af99-292f1478f419] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:28.174663 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0e0b7ef7-217a-4236-8f99-e5e94d5fb3ff tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:28.174663 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0e0b7ef7-217a-4236-8f99-e5e94d5fb3ff tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:28.174663 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0e0b7ef7-217a-4236-8f99-e5e94d5fb3ff tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:28.174663 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0e0b7ef7-217a-4236-8f99-e5e94d5fb3ff tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:28.174663 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0e0b7ef7-217a-4236-8f99-e5e94d5fb3ff tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:28.174663 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0e0b7ef7-217a-4236-8f99-e5e94d5fb3ff tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:28.385372 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0e0b7ef7-217a-4236-8f99-e5e94d5fb3ff tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:28.432034 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0e0b7ef7-217a-4236-8f99-e5e94d5fb3ff tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:28.441155 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0e0b7ef7-217a-4236-8f99-e5e94d5fb3ff tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:28.449902 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0e0b7ef7-217a-4236-8f99-e5e94d5fb3ff tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] 10.222.0.20 "GET /compute/v2.1/servers/3a41fe60-b7d3-4560-af99-292f1478f419" status: 200 len: 1357 microversion: 2.54 time: 0.310347 Oct 04 18:43:28.468289 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1896/3740] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:43:28 2022] GET /compute/v2.1/servers/3a41fe60-b7d3-4560-af99-292f1478f419 => generated 1357 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:43:28.485638 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5eb8a3a0-d326-443f-b08b-125e2a8bfcf9 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:28.486262 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5eb8a3a0-d326-443f-b08b-125e2a8bfcf9 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: 4d6dfac0-958d-4698-a050-6539caebe52c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:28.503142 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5eb8a3a0-d326-443f-b08b-125e2a8bfcf9 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:28.504632 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5eb8a3a0-d326-443f-b08b-125e2a8bfcf9 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:28.505139 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5eb8a3a0-d326-443f-b08b-125e2a8bfcf9 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:28.506689 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5eb8a3a0-d326-443f-b08b-125e2a8bfcf9 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:28.507498 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5eb8a3a0-d326-443f-b08b-125e2a8bfcf9 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:28.508144 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5eb8a3a0-d326-443f-b08b-125e2a8bfcf9 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:28.568517 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7d41974f-ae2c-4a3c-86f5-724665348d5c tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Action: 'create', calling method: .version_select at 0x7fe25834c280>, body: {"keypair": {"name": "tempest-keypair-299362034", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP3+HtLfS9TPSdoSCg3HD1Dvvs7BFEArwL9TWaUs1vsfl3/Oi2UwRwsKxaZyFMZ4dIT4ko3PJ8Vioe7r2qEnZ41yWNBAyO5qovjeqCxbWeSn+/wT2niRQkHCq/VUygKbnQ=="}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:43:28.607727 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-7d41974f-ae2c-4a3c-86f5-724665348d5c tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Getting quotas for project e9a4914508df43b0afac3ffdf3b85b36. Resources: {'key_pairs'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:43:28.613289 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:43:28.623105 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-7d41974f-ae2c-4a3c-86f5-724665348d5c tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Getting quotas for user e54eaa927e2848869093e0ec11904929 and project e9a4914508df43b0afac3ffdf3b85b36. Resources: {'key_pairs'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:43:28.690540 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5eb8a3a0-d326-443f-b08b-125e2a8bfcf9 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:28.701202 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5eb8a3a0-d326-443f-b08b-125e2a8bfcf9 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c" status: 200 len: 1302 microversion: 2.1 time: 0.228968 Oct 04 18:43:28.703590 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1897/3741] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:28 2022] GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c => generated 1302 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:28.717122 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ba0d95bf-699a-41cb-9f7b-98dbd262771d tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Action: 'create', calling method: .version_select at 0x7fe259091310>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1792855981", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHfP4lDjEWlEan7PkNNa15R2sOKrABXtjWA1B3/PWyyIjG2u9gNezQOtpcdLYnHVoE36SEN1EqDdsVFnsE0KVq8yOKJgffA49FBJ0SRRscqkREa9DBM2ZaeRWrlcYMWhxQ=="}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:43:28.724332 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7d41974f-ae2c-4a3c-86f5-724665348d5c tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.670154 Oct 04 18:43:28.730776 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1845/3742] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Oct 4 18:43:28 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:43:28.730776 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-88ea57ef-9edd-4449-8bcb-55a41ef78c38 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:28.737895 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-88ea57ef-9edd-4449-8bcb-55a41ef78c38 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 766fe762-0e33-4174-a817-827f782572d9] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:28.744602 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-88ea57ef-9edd-4449-8bcb-55a41ef78c38 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:28.745094 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-88ea57ef-9edd-4449-8bcb-55a41ef78c38 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:28.745529 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-88ea57ef-9edd-4449-8bcb-55a41ef78c38 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:28.746231 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-88ea57ef-9edd-4449-8bcb-55a41ef78c38 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:28.746679 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-88ea57ef-9edd-4449-8bcb-55a41ef78c38 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:28.747100 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-88ea57ef-9edd-4449-8bcb-55a41ef78c38 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:28.787291 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-ba0d95bf-699a-41cb-9f7b-98dbd262771d tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Getting quotas for project f920618391404d5aa7eb1d4c40b185a7. Resources: {'key_pairs'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:43:28.796501 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-ba0d95bf-699a-41cb-9f7b-98dbd262771d tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Getting quotas for user 72d0740437c04bceaa138b37cd1babd8 and project f920618391404d5aa7eb1d4c40b185a7. Resources: {'key_pairs'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:43:28.926801 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ba0d95bf-699a-41cb-9f7b-98dbd262771d tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 0.221066 Oct 04 18:43:28.927826 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1898/3743] 10.222.0.20 () {62 vars in 1200 bytes} [Tue Oct 4 18:43:28 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 223 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 18:43:28.941794 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6aaeb541-f199-492a-ad65-b81be5a30e31 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1792855981", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:43:28.944941 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6aaeb541-f199-492a-ad65-b81be5a30e31 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] [instance: 3a41fe60-b7d3-4560-af99-292f1478f419] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:28.965308 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6aaeb541-f199-492a-ad65-b81be5a30e31 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:28.966198 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6aaeb541-f199-492a-ad65-b81be5a30e31 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:28.967271 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6aaeb541-f199-492a-ad65-b81be5a30e31 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:28.967488 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6aaeb541-f199-492a-ad65-b81be5a30e31 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:28.968150 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6aaeb541-f199-492a-ad65-b81be5a30e31 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:28.968782 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6aaeb541-f199-492a-ad65-b81be5a30e31 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:29.002476 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-88ea57ef-9edd-4449-8bcb-55a41ef78c38 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:29.015363 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-88ea57ef-9edd-4449-8bcb-55a41ef78c38 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/766fe762-0e33-4174-a817-827f782572d9" status: 200 len: 1488 microversion: 2.1 time: 0.288615 Oct 04 18:43:29.016180 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1846/3744] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:28 2022] GET /compute/v2.1/servers/766fe762-0e33-4174-a817-827f782572d9 => generated 1488 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:29.135141 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-6aaeb541-f199-492a-ad65-b81be5a30e31 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:43:29.141400 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-6aaeb541-f199-492a-ad65-b81be5a30e31 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:43:29.142157 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-6aaeb541-f199-492a-ad65-b81be5a30e31 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:43:29.142743 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-6aaeb541-f199-492a-ad65-b81be5a30e31 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:43:29.143350 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-6aaeb541-f199-492a-ad65-b81be5a30e31 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:43:29.154091 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1611a81b-a955-4301-a28c-5c6a95b4a12d tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe259335790>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:29.241800 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1611a81b-a955-4301-a28c-5c6a95b4a12d tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/images/5c609fc9-3cfe-4683-9148-134d915f048c" status: 200 len: 1455 microversion: 2.1 time: 0.091326 Oct 04 18:43:29.247471 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1847/3745] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:43:29 2022] GET /compute/v2.1/images/5c609fc9-3cfe-4683-9148-134d915f048c => generated 1455 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:43:29.313932 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-275015c6-3a73-445c-bb08-0cec34db7585 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-902687355", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": [{"uuid": "ea7ea2b5-3fb7-4eeb-8ba9-cbc81d7265bf"}]}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:43:29.403524 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-275015c6-3a73-445c-bb08-0cec34db7585 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] validate_networks() for [('ea7ea2b5-3fb7-4eeb-8ba9-cbc81d7265bf', None, None, None, None, None)] {{(pid=123002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:43:29.558973 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6aaeb541-f199-492a-ad65-b81be5a30e31 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] [instance: 3a41fe60-b7d3-4560-af99-292f1478f419] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:29.580850 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6aaeb541-f199-492a-ad65-b81be5a30e31 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:29.581770 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6aaeb541-f199-492a-ad65-b81be5a30e31 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:29.585190 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6aaeb541-f199-492a-ad65-b81be5a30e31 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:29.588567 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6aaeb541-f199-492a-ad65-b81be5a30e31 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:29.589453 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6aaeb541-f199-492a-ad65-b81be5a30e31 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:29.590125 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6aaeb541-f199-492a-ad65-b81be5a30e31 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:29.700312 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6aaeb541-f199-492a-ad65-b81be5a30e31 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] 10.222.0.20 "POST /compute/v2.1/servers/3a41fe60-b7d3-4560-af99-292f1478f419/action" status: 202 len: 1140 microversion: 2.54 time: 0.765048 Oct 04 18:43:29.702390 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1899/3746] 10.222.0.20 () {62 vars in 1320 bytes} [Tue Oct 4 18:43:28 2022] POST /compute/v2.1/servers/3a41fe60-b7d3-4560-af99-292f1478f419/action => generated 1140 bytes in 768 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 04 18:43:29.739703 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1e88fecd-9142-4806-b7cd-599ded1c7fa9 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:29.741988 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1e88fecd-9142-4806-b7cd-599ded1c7fa9 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] [instance: 3a41fe60-b7d3-4560-af99-292f1478f419] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:29.758179 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1e88fecd-9142-4806-b7cd-599ded1c7fa9 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:29.760231 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1e88fecd-9142-4806-b7cd-599ded1c7fa9 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:29.760696 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1e88fecd-9142-4806-b7cd-599ded1c7fa9 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:29.763394 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1e88fecd-9142-4806-b7cd-599ded1c7fa9 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:29.766664 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1e88fecd-9142-4806-b7cd-599ded1c7fa9 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:29.767224 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1e88fecd-9142-4806-b7cd-599ded1c7fa9 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:29.900049 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:43:30.002832 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1e88fecd-9142-4806-b7cd-599ded1c7fa9 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:30.024724 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1e88fecd-9142-4806-b7cd-599ded1c7fa9 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:30.028904 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1e88fecd-9142-4806-b7cd-599ded1c7fa9 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:30.030706 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1e88fecd-9142-4806-b7cd-599ded1c7fa9 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] 10.222.0.20 "GET /compute/v2.1/servers/3a41fe60-b7d3-4560-af99-292f1478f419" status: 200 len: 1409 microversion: 2.54 time: 0.299947 Oct 04 18:43:30.056614 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1900/3747] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:43:29 2022] GET /compute/v2.1/servers/3a41fe60-b7d3-4560-af99-292f1478f419 => generated 1409 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:43:30.072153 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3d8cf6c5-1d51-4ab0-bc14-680a88a561bc tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:30.081136 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3d8cf6c5-1d51-4ab0-bc14-680a88a561bc tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: 4d6dfac0-958d-4698-a050-6539caebe52c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:30.096616 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3d8cf6c5-1d51-4ab0-bc14-680a88a561bc tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:30.101813 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3d8cf6c5-1d51-4ab0-bc14-680a88a561bc tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:30.102582 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3d8cf6c5-1d51-4ab0-bc14-680a88a561bc tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:30.109095 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3d8cf6c5-1d51-4ab0-bc14-680a88a561bc tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:30.110566 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3d8cf6c5-1d51-4ab0-bc14-680a88a561bc tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:30.112084 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3d8cf6c5-1d51-4ab0-bc14-680a88a561bc tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:30.548819 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3d8cf6c5-1d51-4ab0-bc14-680a88a561bc tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:30.552279 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:43:30.558417 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3d8cf6c5-1d51-4ab0-bc14-680a88a561bc tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c" status: 200 len: 1369 microversion: 2.1 time: 0.500300 Oct 04 18:43:30.574616 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1901/3748] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:30 2022] GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c => generated 1369 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:30.581678 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9b174647-261c-46a6-80c6-96468039ec0f tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe253dc68b0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:30.594880 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-275015c6-3a73-445c-bb08-0cec34db7585 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:43:30.595418 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-275015c6-3a73-445c-bb08-0cec34db7585 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:43:30.595932 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-275015c6-3a73-445c-bb08-0cec34db7585 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:43:30.596467 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-275015c6-3a73-445c-bb08-0cec34db7585 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:43:30.596883 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-275015c6-3a73-445c-bb08-0cec34db7585 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:43:30.615839 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=25 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:43:30.617546 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-275015c6-3a73-445c-bb08-0cec34db7585 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:30.618033 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-275015c6-3a73-445c-bb08-0cec34db7585 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:30.618665 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-275015c6-3a73-445c-bb08-0cec34db7585 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:30.619568 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-275015c6-3a73-445c-bb08-0cec34db7585 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:30.620698 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-275015c6-3a73-445c-bb08-0cec34db7585 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:30.621431 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-275015c6-3a73-445c-bb08-0cec34db7585 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:30.663590 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9b174647-261c-46a6-80c6-96468039ec0f tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/images/5c609fc9-3cfe-4683-9148-134d915f048c" status: 200 len: 1455 microversion: 2.1 time: 0.097912 Oct 04 18:43:30.668194 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1902/3749] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:43:30 2022] GET /compute/v2.1/images/5c609fc9-3cfe-4683-9148-134d915f048c => generated 1455 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:30.692664 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-275015c6-3a73-445c-bb08-0cec34db7585 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Getting quotas for project a9046b9540144eeba512d79438635ea8. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:43:30.709976 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-275015c6-3a73-445c-bb08-0cec34db7585 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Getting quotas for user 8a6c3725b31449d5bf1ff757ff66c8d7 and project a9046b9540144eeba512d79438635ea8. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:43:30.740553 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-275015c6-3a73-445c-bb08-0cec34db7585 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Going to run 1 instances... {{(pid=123002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:43:30.744522 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-275015c6-3a73-445c-bb08-0cec34db7585 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 8e11c130-e748-4008-ad1b-9c959b4d908c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:43:30.983691 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-275015c6-3a73-445c-bb08-0cec34db7585 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.673613 Oct 04 18:43:30.986511 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1848/3750] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:43:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1678 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 18:43:30.999448 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7151ecb7-e667-4465-b45f-e2d63beb9806 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:31.001293 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7151ecb7-e667-4465-b45f-e2d63beb9806 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 8e11c130-e748-4008-ad1b-9c959b4d908c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:31.064940 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-bc9eac23-d484-45bf-b78d-ff9c21b8b3d2 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:31.065570 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-bc9eac23-d484-45bf-b78d-ff9c21b8b3d2 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] [instance: 3a41fe60-b7d3-4560-af99-292f1478f419] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:31.097503 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bc9eac23-d484-45bf-b78d-ff9c21b8b3d2 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:31.100674 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bc9eac23-d484-45bf-b78d-ff9c21b8b3d2 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:31.101343 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bc9eac23-d484-45bf-b78d-ff9c21b8b3d2 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:31.102929 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bc9eac23-d484-45bf-b78d-ff9c21b8b3d2 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:31.105707 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bc9eac23-d484-45bf-b78d-ff9c21b8b3d2 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:31.106924 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bc9eac23-d484-45bf-b78d-ff9c21b8b3d2 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:31.372659 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7151ecb7-e667-4465-b45f-e2d63beb9806 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:31.382625 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7151ecb7-e667-4465-b45f-e2d63beb9806 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/8e11c130-e748-4008-ad1b-9c959b4d908c" status: 200 len: 1208 microversion: 2.1 time: 0.388165 Oct 04 18:43:31.391166 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1903/3751] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:30 2022] GET /compute/v2.1/servers/8e11c130-e748-4008-ad1b-9c959b4d908c => generated 1208 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:31.424998 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-bc9eac23-d484-45bf-b78d-ff9c21b8b3d2 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:31.440332 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-bc9eac23-d484-45bf-b78d-ff9c21b8b3d2 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:31.445350 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-bc9eac23-d484-45bf-b78d-ff9c21b8b3d2 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:31.446876 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-bc9eac23-d484-45bf-b78d-ff9c21b8b3d2 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] 10.222.0.20 "GET /compute/v2.1/servers/3a41fe60-b7d3-4560-af99-292f1478f419" status: 200 len: 1409 microversion: 2.54 time: 0.387846 Oct 04 18:43:31.448465 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1849/3752] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:43:31 2022] GET /compute/v2.1/servers/3a41fe60-b7d3-4560-af99-292f1478f419 => generated 1409 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:43:31.584030 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-57c9e351-4eef-4ead-972c-2e18c7cc9438 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:31.585145 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-57c9e351-4eef-4ead-972c-2e18c7cc9438 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: 4d6dfac0-958d-4698-a050-6539caebe52c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:31.605610 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-57c9e351-4eef-4ead-972c-2e18c7cc9438 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:31.607436 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-57c9e351-4eef-4ead-972c-2e18c7cc9438 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:31.610763 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-57c9e351-4eef-4ead-972c-2e18c7cc9438 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:31.615955 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-57c9e351-4eef-4ead-972c-2e18c7cc9438 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:31.616794 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-57c9e351-4eef-4ead-972c-2e18c7cc9438 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:31.620634 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-57c9e351-4eef-4ead-972c-2e18c7cc9438 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:31.688507 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-44b43619-b265-4b86-84c7-0c4550d07969 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe258905d30>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:31.793361 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-44b43619-b265-4b86-84c7-0c4550d07969 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/images/5c609fc9-3cfe-4683-9148-134d915f048c" status: 200 len: 1455 microversion: 2.1 time: 0.107288 Oct 04 18:43:31.806934 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1850/3753] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:43:31 2022] GET /compute/v2.1/images/5c609fc9-3cfe-4683-9148-134d915f048c => generated 1455 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:31.883340 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=4 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:43:32.057377 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-c1b20440-83fe-4a49-a8b7-d10245fff427 req-f69bc090-7cc3-4e1e-a2c6-2da62a873b8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d6dfac0-958d-4698-a050-6539caebe52c", "tag": "b3bc4ab3-40de-48c0-8c27-0fbd4d0780d1"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:43:32.068787 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-57c9e351-4eef-4ead-972c-2e18c7cc9438 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:32.077143 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-57c9e351-4eef-4ead-972c-2e18c7cc9438 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c" status: 200 len: 1369 microversion: 2.1 time: 0.497446 Oct 04 18:43:32.097342 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1904/3754] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:31 2022] GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c => generated 1369 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:32.128268 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-c1b20440-83fe-4a49-a8b7-d10245fff427 req-f69bc090-7cc3-4e1e-a2c6-2da62a873b8d service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:32.128593 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-c1b20440-83fe-4a49-a8b7-d10245fff427 req-f69bc090-7cc3-4e1e-a2c6-2da62a873b8d service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:32.129022 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-c1b20440-83fe-4a49-a8b7-d10245fff427 req-f69bc090-7cc3-4e1e-a2c6-2da62a873b8d service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:32.145159 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-c1b20440-83fe-4a49-a8b7-d10245fff427 req-f69bc090-7cc3-4e1e-a2c6-2da62a873b8d service nova] Creating event network-changed:b3bc4ab3-40de-48c0-8c27-0fbd4d0780d1 for instance 4d6dfac0-958d-4698-a050-6539caebe52c on n-h1-850501-14 Oct 04 18:43:32.154237 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-c1b20440-83fe-4a49-a8b7-d10245fff427 req-f69bc090-7cc3-4e1e-a2c6-2da62a873b8d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101313 Oct 04 18:43:32.157069 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1851/3755] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:43:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:43:32.411708 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c2581c9b-5776-4238-80e3-743c6080eb37 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:32.412642 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c2581c9b-5776-4238-80e3-743c6080eb37 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 8e11c130-e748-4008-ad1b-9c959b4d908c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:32.481411 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-971d0e13-71eb-46ad-b96c-c81d51e8786b tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:32.482124 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-971d0e13-71eb-46ad-b96c-c81d51e8786b tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] [instance: 3a41fe60-b7d3-4560-af99-292f1478f419] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:32.525069 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-971d0e13-71eb-46ad-b96c-c81d51e8786b tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:32.526023 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-971d0e13-71eb-46ad-b96c-c81d51e8786b tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:32.526712 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-971d0e13-71eb-46ad-b96c-c81d51e8786b tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:32.531644 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-971d0e13-71eb-46ad-b96c-c81d51e8786b tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:32.532407 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-971d0e13-71eb-46ad-b96c-c81d51e8786b tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:32.533027 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-971d0e13-71eb-46ad-b96c-c81d51e8786b tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:32.644574 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c2581c9b-5776-4238-80e3-743c6080eb37 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:32.653022 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c2581c9b-5776-4238-80e3-743c6080eb37 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/8e11c130-e748-4008-ad1b-9c959b4d908c" status: 200 len: 1208 microversion: 2.1 time: 0.247432 Oct 04 18:43:32.673538 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1905/3756] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:32 2022] GET /compute/v2.1/servers/8e11c130-e748-4008-ad1b-9c959b4d908c => generated 1208 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:32.770404 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-971d0e13-71eb-46ad-b96c-c81d51e8786b tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:32.784481 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-971d0e13-71eb-46ad-b96c-c81d51e8786b tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:32.788866 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-971d0e13-71eb-46ad-b96c-c81d51e8786b tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:32.788866 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-971d0e13-71eb-46ad-b96c-c81d51e8786b tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] 10.222.0.20 "GET /compute/v2.1/servers/3a41fe60-b7d3-4560-af99-292f1478f419" status: 200 len: 1409 microversion: 2.54 time: 0.313614 Oct 04 18:43:32.806271 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1852/3757] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:43:32 2022] GET /compute/v2.1/servers/3a41fe60-b7d3-4560-af99-292f1478f419 => generated 1409 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:43:32.816346 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d0d63b9a-71c6-4397-98c3-d3919ff0dd12 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe253dc6550>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:32.894876 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d0d63b9a-71c6-4397-98c3-d3919ff0dd12 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/images/5c609fc9-3cfe-4683-9148-134d915f048c" status: 200 len: 1455 microversion: 2.1 time: 0.082220 Oct 04 18:43:32.896087 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1906/3758] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:43:32 2022] GET /compute/v2.1/images/5c609fc9-3cfe-4683-9148-134d915f048c => generated 1455 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:33.050415 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6576d206-7a61-4f69-99f0-d173cf1f834b tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-666718114", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "7e2570d1-59c2-4da3-8ec4-aa352a7f8be0"}], "security_groups": [{"name": "tempest-securitygroup--596309946"}], "key_name": "tempest-keypair-299362034", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:43:33.107556 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-11de6db3-2816-4fdb-abed-47c04d269ef8 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:33.107556 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-11de6db3-2816-4fdb-abed-47c04d269ef8 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: 4d6dfac0-958d-4698-a050-6539caebe52c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:33.118246 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-11de6db3-2816-4fdb-abed-47c04d269ef8 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:33.119509 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-11de6db3-2816-4fdb-abed-47c04d269ef8 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:33.121275 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-11de6db3-2816-4fdb-abed-47c04d269ef8 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:33.123926 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-11de6db3-2816-4fdb-abed-47c04d269ef8 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:33.125579 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-11de6db3-2816-4fdb-abed-47c04d269ef8 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:33.126155 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-11de6db3-2816-4fdb-abed-47c04d269ef8 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:33.335254 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-6576d206-7a61-4f69-99f0-d173cf1f834b tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] validate_networks() for [('7e2570d1-59c2-4da3-8ec4-aa352a7f8be0', None, None, None, None, None)] {{(pid=123002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:43:34.034203 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-11de6db3-2816-4fdb-abed-47c04d269ef8 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:34.056838 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-11de6db3-2816-4fdb-abed-47c04d269ef8 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c" status: 200 len: 1369 microversion: 2.1 time: 0.958407 Oct 04 18:43:34.063882 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1907/3759] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:33 2022] GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c => generated 1369 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:34.076650 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e31b6f4c-daf1-43e4-97de-62ac47137284 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:34.083440 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e31b6f4c-daf1-43e4-97de-62ac47137284 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 8e11c130-e748-4008-ad1b-9c959b4d908c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:34.092443 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e31b6f4c-daf1-43e4-97de-62ac47137284 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:34.098335 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e31b6f4c-daf1-43e4-97de-62ac47137284 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:34.098335 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e31b6f4c-daf1-43e4-97de-62ac47137284 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:34.098335 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e31b6f4c-daf1-43e4-97de-62ac47137284 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:34.098335 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e31b6f4c-daf1-43e4-97de-62ac47137284 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:34.106876 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e31b6f4c-daf1-43e4-97de-62ac47137284 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:34.356824 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e31b6f4c-daf1-43e4-97de-62ac47137284 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:34.378622 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e31b6f4c-daf1-43e4-97de-62ac47137284 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/8e11c130-e748-4008-ad1b-9c959b4d908c" status: 200 len: 1260 microversion: 2.1 time: 0.306011 Oct 04 18:43:34.395895 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1908/3760] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:34 2022] GET /compute/v2.1/servers/8e11c130-e748-4008-ad1b-9c959b4d908c => generated 1260 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:34.406404 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d28eeb84-4d61-465f-83eb-e5a1300cad8a tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:34.412230 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d28eeb84-4d61-465f-83eb-e5a1300cad8a tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] [instance: 3a41fe60-b7d3-4560-af99-292f1478f419] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:34.427368 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d28eeb84-4d61-465f-83eb-e5a1300cad8a tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:34.428623 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d28eeb84-4d61-465f-83eb-e5a1300cad8a tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:34.429488 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d28eeb84-4d61-465f-83eb-e5a1300cad8a tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:34.430646 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d28eeb84-4d61-465f-83eb-e5a1300cad8a tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:34.431368 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d28eeb84-4d61-465f-83eb-e5a1300cad8a tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:34.433661 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d28eeb84-4d61-465f-83eb-e5a1300cad8a tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:34.604399 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d28eeb84-4d61-465f-83eb-e5a1300cad8a tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:34.624987 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d28eeb84-4d61-465f-83eb-e5a1300cad8a tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:34.632213 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d28eeb84-4d61-465f-83eb-e5a1300cad8a tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:34.633814 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d28eeb84-4d61-465f-83eb-e5a1300cad8a tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] 10.222.0.20 "GET /compute/v2.1/servers/3a41fe60-b7d3-4560-af99-292f1478f419" status: 200 len: 1409 microversion: 2.54 time: 0.236814 Oct 04 18:43:34.634631 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1909/3761] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:43:34 2022] GET /compute/v2.1/servers/3a41fe60-b7d3-4560-af99-292f1478f419 => generated 1409 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:43:34.645843 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-212c9c98-a752-490f-8bd6-430d66782e26 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe25921c1f0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:34.741074 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-212c9c98-a752-490f-8bd6-430d66782e26 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/images/5c609fc9-3cfe-4683-9148-134d915f048c" status: 200 len: 1455 microversion: 2.1 time: 0.105173 Oct 04 18:43:34.741668 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1910/3762] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:43:34 2022] GET /compute/v2.1/images/5c609fc9-3cfe-4683-9148-134d915f048c => generated 1455 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:34.928127 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-6576d206-7a61-4f69-99f0-d173cf1f834b tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Getting quotas for project e9a4914508df43b0afac3ffdf3b85b36. Resources: dict_keys(['metadata_items']) {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:43:34.937447 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-6576d206-7a61-4f69-99f0-d173cf1f834b tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Getting quotas for user e54eaa927e2848869093e0ec11904929 and project e9a4914508df43b0afac3ffdf3b85b36. Resources: dict_keys(['metadata_items']) {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:43:34.984689 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-6576d206-7a61-4f69-99f0-d173cf1f834b tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:43:34.985131 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-6576d206-7a61-4f69-99f0-d173cf1f834b tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:43:34.985623 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-6576d206-7a61-4f69-99f0-d173cf1f834b tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:43:34.986041 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-6576d206-7a61-4f69-99f0-d173cf1f834b tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:43:34.986458 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-6576d206-7a61-4f69-99f0-d173cf1f834b tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:43:35.011808 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6576d206-7a61-4f69-99f0-d173cf1f834b tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:35.012339 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6576d206-7a61-4f69-99f0-d173cf1f834b tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:35.012784 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6576d206-7a61-4f69-99f0-d173cf1f834b tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:35.013535 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6576d206-7a61-4f69-99f0-d173cf1f834b tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:35.016249 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6576d206-7a61-4f69-99f0-d173cf1f834b tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:35.016696 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6576d206-7a61-4f69-99f0-d173cf1f834b tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:35.089310 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-6576d206-7a61-4f69-99f0-d173cf1f834b tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Getting quotas for project e9a4914508df43b0afac3ffdf3b85b36. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:43:35.090088 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-14a0aca1-8eab-44b4-aa55-a74c596a8938 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:35.092272 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-14a0aca1-8eab-44b4-aa55-a74c596a8938 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: 4d6dfac0-958d-4698-a050-6539caebe52c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:35.107385 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-14a0aca1-8eab-44b4-aa55-a74c596a8938 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:35.109574 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-14a0aca1-8eab-44b4-aa55-a74c596a8938 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:35.113269 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-14a0aca1-8eab-44b4-aa55-a74c596a8938 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:35.116624 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-14a0aca1-8eab-44b4-aa55-a74c596a8938 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:35.117339 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-6576d206-7a61-4f69-99f0-d173cf1f834b tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Getting quotas for user e54eaa927e2848869093e0ec11904929 and project e9a4914508df43b0afac3ffdf3b85b36. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:43:35.117885 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-14a0aca1-8eab-44b4-aa55-a74c596a8938 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:35.118670 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-14a0aca1-8eab-44b4-aa55-a74c596a8938 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:35.164205 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-6576d206-7a61-4f69-99f0-d173cf1f834b tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Going to run 1 instances... {{(pid=123002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:43:35.170016 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-6576d206-7a61-4f69-99f0-d173cf1f834b tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] [instance: 0c9b24a2-ed48-4175-89ef-c8b7971acd39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:43:35.316839 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6576d206-7a61-4f69-99f0-d173cf1f834b tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.270992 Oct 04 18:43:35.318445 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1853/3763] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:43:33 2022] POST /compute/v2.1/servers => generated 408 bytes in 2273 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:43:35.332253 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2afb6096-ee4b-4de0-951a-5baa59eb7448 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:35.335466 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2afb6096-ee4b-4de0-951a-5baa59eb7448 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] [instance: 0c9b24a2-ed48-4175-89ef-c8b7971acd39] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:35.452077 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2afb6096-ee4b-4de0-951a-5baa59eb7448 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e54eaa927e2848869093e0ec11904929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a4914508df43b0afac3ffdf3b85b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:35.468743 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2afb6096-ee4b-4de0-951a-5baa59eb7448 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] 10.222.0.20 "GET /compute/v2.1/servers/0c9b24a2-ed48-4175-89ef-c8b7971acd39" status: 200 len: 1276 microversion: 2.1 time: 0.142720 Oct 04 18:43:35.470800 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1854/3764] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:35 2022] GET /compute/v2.1/servers/0c9b24a2-ed48-4175-89ef-c8b7971acd39 => generated 1276 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:43:35.483055 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-eeeddfa7-ab35-4e16-9b79-4991b8466ce5 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:35.485473 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-eeeddfa7-ab35-4e16-9b79-4991b8466ce5 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 8e11c130-e748-4008-ad1b-9c959b4d908c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:35.508583 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-14a0aca1-8eab-44b4-aa55-a74c596a8938 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:35.517856 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eeeddfa7-ab35-4e16-9b79-4991b8466ce5 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:35.518297 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eeeddfa7-ab35-4e16-9b79-4991b8466ce5 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:35.518818 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eeeddfa7-ab35-4e16-9b79-4991b8466ce5 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:35.519534 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eeeddfa7-ab35-4e16-9b79-4991b8466ce5 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:35.519960 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eeeddfa7-ab35-4e16-9b79-4991b8466ce5 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:35.522728 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-14a0aca1-8eab-44b4-aa55-a74c596a8938 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c" status: 200 len: 1369 microversion: 2.1 time: 0.439827 Oct 04 18:43:35.526854 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1911/3765] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:35 2022] GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c => generated 1369 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:35.527123 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eeeddfa7-ab35-4e16-9b79-4991b8466ce5 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:35.667186 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-fa0dcf6f-e1ae-4c56-8ec5-6f50293bc78b tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:35.667984 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-fa0dcf6f-e1ae-4c56-8ec5-6f50293bc78b tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] [instance: 3a41fe60-b7d3-4560-af99-292f1478f419] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:35.677033 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fa0dcf6f-e1ae-4c56-8ec5-6f50293bc78b tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:35.677535 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fa0dcf6f-e1ae-4c56-8ec5-6f50293bc78b tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:35.681467 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fa0dcf6f-e1ae-4c56-8ec5-6f50293bc78b tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:35.681467 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fa0dcf6f-e1ae-4c56-8ec5-6f50293bc78b tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:35.681467 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fa0dcf6f-e1ae-4c56-8ec5-6f50293bc78b tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:35.681467 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fa0dcf6f-e1ae-4c56-8ec5-6f50293bc78b tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:35.689593 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-eeeddfa7-ab35-4e16-9b79-4991b8466ce5 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:35.699991 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-eeeddfa7-ab35-4e16-9b79-4991b8466ce5 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/8e11c130-e748-4008-ad1b-9c959b4d908c" status: 200 len: 1266 microversion: 2.1 time: 0.226516 Oct 04 18:43:35.715081 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1855/3766] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:35 2022] GET /compute/v2.1/servers/8e11c130-e748-4008-ad1b-9c959b4d908c => generated 1266 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:35.757572 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4c1d6881-4fa9-44d2-be40-7c177f6d3716 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe259599d30>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:35.866289 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-fa0dcf6f-e1ae-4c56-8ec5-6f50293bc78b tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:35.871636 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4c1d6881-4fa9-44d2-be40-7c177f6d3716 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/images/5c609fc9-3cfe-4683-9148-134d915f048c" status: 200 len: 1455 microversion: 2.1 time: 0.118380 Oct 04 18:43:35.882372 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1856/3767] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:43:35 2022] GET /compute/v2.1/images/5c609fc9-3cfe-4683-9148-134d915f048c => generated 1455 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:35.898387 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-fa0dcf6f-e1ae-4c56-8ec5-6f50293bc78b tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:35.899936 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-fa0dcf6f-e1ae-4c56-8ec5-6f50293bc78b tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:35.901186 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-fa0dcf6f-e1ae-4c56-8ec5-6f50293bc78b tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] 10.222.0.20 "GET /compute/v2.1/servers/3a41fe60-b7d3-4560-af99-292f1478f419" status: 200 len: 1409 microversion: 2.54 time: 0.238936 Oct 04 18:43:35.902075 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1912/3768] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:43:35 2022] GET /compute/v2.1/servers/3a41fe60-b7d3-4560-af99-292f1478f419 => generated 1409 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:43:36.494402 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e08ec4ff-b97a-4d44-b63f-d288ba3e18f4 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:36.495627 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e08ec4ff-b97a-4d44-b63f-d288ba3e18f4 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] [instance: 0c9b24a2-ed48-4175-89ef-c8b7971acd39] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:36.545942 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-89ca193a-8ab4-4cf0-8f49-d34cdf4bd6f6 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:36.547269 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-89ca193a-8ab4-4cf0-8f49-d34cdf4bd6f6 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: 4d6dfac0-958d-4698-a050-6539caebe52c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:36.558656 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-89ca193a-8ab4-4cf0-8f49-d34cdf4bd6f6 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:36.559160 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-89ca193a-8ab4-4cf0-8f49-d34cdf4bd6f6 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:36.559607 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-89ca193a-8ab4-4cf0-8f49-d34cdf4bd6f6 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:36.560348 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-89ca193a-8ab4-4cf0-8f49-d34cdf4bd6f6 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:36.568014 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-89ca193a-8ab4-4cf0-8f49-d34cdf4bd6f6 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:36.568814 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-89ca193a-8ab4-4cf0-8f49-d34cdf4bd6f6 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:36.636680 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e08ec4ff-b97a-4d44-b63f-d288ba3e18f4 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e54eaa927e2848869093e0ec11904929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a4914508df43b0afac3ffdf3b85b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:36.650133 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e08ec4ff-b97a-4d44-b63f-d288ba3e18f4 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] 10.222.0.20 "GET /compute/v2.1/servers/0c9b24a2-ed48-4175-89ef-c8b7971acd39" status: 200 len: 1276 microversion: 2.1 time: 0.160126 Oct 04 18:43:36.668637 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1857/3769] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:36 2022] GET /compute/v2.1/servers/0c9b24a2-ed48-4175-89ef-c8b7971acd39 => generated 1276 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:36.732456 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d3980e81-cbe5-49dc-b493-3c94a3480230 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:36.738185 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d3980e81-cbe5-49dc-b493-3c94a3480230 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 8e11c130-e748-4008-ad1b-9c959b4d908c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:36.750858 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d3980e81-cbe5-49dc-b493-3c94a3480230 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:36.753469 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d3980e81-cbe5-49dc-b493-3c94a3480230 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:36.754758 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d3980e81-cbe5-49dc-b493-3c94a3480230 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:36.755604 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d3980e81-cbe5-49dc-b493-3c94a3480230 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:36.758224 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d3980e81-cbe5-49dc-b493-3c94a3480230 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:36.758790 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d3980e81-cbe5-49dc-b493-3c94a3480230 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:36.810975 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-89ca193a-8ab4-4cf0-8f49-d34cdf4bd6f6 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:36.823044 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-89ca193a-8ab4-4cf0-8f49-d34cdf4bd6f6 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c" status: 200 len: 1369 microversion: 2.1 time: 0.280839 Oct 04 18:43:36.824331 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1913/3770] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:36 2022] GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c => generated 1369 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:36.898742 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5a316048-5df0-4fd4-a17c-a31ae4231551 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe253de60d0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:37.012231 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5a316048-5df0-4fd4-a17c-a31ae4231551 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/images/5c609fc9-3cfe-4683-9148-134d915f048c" status: 200 len: 1455 microversion: 2.1 time: 0.119750 Oct 04 18:43:37.021931 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1914/3771] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:43:36 2022] GET /compute/v2.1/images/5c609fc9-3cfe-4683-9148-134d915f048c => generated 1455 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:37.027088 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c705b233-2c9b-4d2e-a5d1-c53683de5150 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:37.027963 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c705b233-2c9b-4d2e-a5d1-c53683de5150 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] [instance: 3a41fe60-b7d3-4560-af99-292f1478f419] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:37.035050 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c705b233-2c9b-4d2e-a5d1-c53683de5150 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:37.035832 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c705b233-2c9b-4d2e-a5d1-c53683de5150 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:37.037209 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c705b233-2c9b-4d2e-a5d1-c53683de5150 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:37.037490 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c705b233-2c9b-4d2e-a5d1-c53683de5150 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:37.038268 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c705b233-2c9b-4d2e-a5d1-c53683de5150 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:37.038908 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c705b233-2c9b-4d2e-a5d1-c53683de5150 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:37.113425 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d3980e81-cbe5-49dc-b493-3c94a3480230 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:37.127587 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d3980e81-cbe5-49dc-b493-3c94a3480230 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/8e11c130-e748-4008-ad1b-9c959b4d908c" status: 200 len: 1308 microversion: 2.1 time: 0.402280 Oct 04 18:43:37.130031 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1858/3772] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:36 2022] GET /compute/v2.1/servers/8e11c130-e748-4008-ad1b-9c959b4d908c => generated 1308 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:37.150311 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c705b233-2c9b-4d2e-a5d1-c53683de5150 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:37.160935 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c705b233-2c9b-4d2e-a5d1-c53683de5150 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:37.162610 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c705b233-2c9b-4d2e-a5d1-c53683de5150 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:37.164294 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c705b233-2c9b-4d2e-a5d1-c53683de5150 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] 10.222.0.20 "GET /compute/v2.1/servers/3a41fe60-b7d3-4560-af99-292f1478f419" status: 200 len: 1409 microversion: 2.54 time: 0.141080 Oct 04 18:43:37.165119 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1915/3773] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:43:37 2022] GET /compute/v2.1/servers/3a41fe60-b7d3-4560-af99-292f1478f419 => generated 1409 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:43:37.458579 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-4973117d-2dda-4bf1-a71a-560e14478a6b req-490c7c38-a27d-4de2-a4f7-c2e5367f37a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e11c130-e748-4008-ad1b-9c959b4d908c", "tag": "fa986f0d-87ea-488c-be0e-10e65cf98dc3"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:43:37.468997 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-4973117d-2dda-4bf1-a71a-560e14478a6b req-490c7c38-a27d-4de2-a4f7-c2e5367f37a7 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:37.469553 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-4973117d-2dda-4bf1-a71a-560e14478a6b req-490c7c38-a27d-4de2-a4f7-c2e5367f37a7 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:37.470251 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-4973117d-2dda-4bf1-a71a-560e14478a6b req-490c7c38-a27d-4de2-a4f7-c2e5367f37a7 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:37.483671 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-4973117d-2dda-4bf1-a71a-560e14478a6b req-490c7c38-a27d-4de2-a4f7-c2e5367f37a7 service nova] Creating event network-changed:fa986f0d-87ea-488c-be0e-10e65cf98dc3 for instance 8e11c130-e748-4008-ad1b-9c959b4d908c on n-h2-850501-14 Oct 04 18:43:37.491836 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-4973117d-2dda-4bf1-a71a-560e14478a6b req-490c7c38-a27d-4de2-a4f7-c2e5367f37a7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035318 Oct 04 18:43:37.493089 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1859/3774] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:43:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:43:37.679097 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-074fa5a6-e3cf-465e-ace2-cd075d0ab755 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:37.681752 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-074fa5a6-e3cf-465e-ace2-cd075d0ab755 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] [instance: 0c9b24a2-ed48-4175-89ef-c8b7971acd39] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:37.692615 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-074fa5a6-e3cf-465e-ace2-cd075d0ab755 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:37.693753 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-074fa5a6-e3cf-465e-ace2-cd075d0ab755 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:37.694775 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-074fa5a6-e3cf-465e-ace2-cd075d0ab755 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:37.695720 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-074fa5a6-e3cf-465e-ace2-cd075d0ab755 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:37.696444 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-074fa5a6-e3cf-465e-ace2-cd075d0ab755 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:37.697372 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-074fa5a6-e3cf-465e-ace2-cd075d0ab755 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:37.814445 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-074fa5a6-e3cf-465e-ace2-cd075d0ab755 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e54eaa927e2848869093e0ec11904929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a4914508df43b0afac3ffdf3b85b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:37.830600 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-074fa5a6-e3cf-465e-ace2-cd075d0ab755 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] 10.222.0.20 "GET /compute/v2.1/servers/0c9b24a2-ed48-4175-89ef-c8b7971acd39" status: 200 len: 1272 microversion: 2.1 time: 0.152482 Oct 04 18:43:37.830745 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1916/3775] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:37 2022] GET /compute/v2.1/servers/0c9b24a2-ed48-4175-89ef-c8b7971acd39 => generated 1272 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:37.855090 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-cdfa3529-3ecb-43ac-b185-3e905cc08b3d tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:37.857050 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-cdfa3529-3ecb-43ac-b185-3e905cc08b3d tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: 4d6dfac0-958d-4698-a050-6539caebe52c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:37.880314 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cdfa3529-3ecb-43ac-b185-3e905cc08b3d tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:37.889206 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cdfa3529-3ecb-43ac-b185-3e905cc08b3d tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:37.889206 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cdfa3529-3ecb-43ac-b185-3e905cc08b3d tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:37.889206 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cdfa3529-3ecb-43ac-b185-3e905cc08b3d tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:37.889206 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cdfa3529-3ecb-43ac-b185-3e905cc08b3d tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:37.889206 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cdfa3529-3ecb-43ac-b185-3e905cc08b3d tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:37.917484 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=100 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:43:38.028738 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-893b57dc-e5ff-4398-ad0c-bf0e2041723b tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe259091e50>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:38.090825 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-893b57dc-e5ff-4398-ad0c-bf0e2041723b tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/images/5c609fc9-3cfe-4683-9148-134d915f048c" status: 200 len: 1455 microversion: 2.1 time: 0.063786 Oct 04 18:43:38.090825 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1917/3776] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:43:38 2022] GET /compute/v2.1/images/5c609fc9-3cfe-4683-9148-134d915f048c => generated 1455 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:38.103947 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-cdfa3529-3ecb-43ac-b185-3e905cc08b3d tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:38.113947 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-cdfa3529-3ecb-43ac-b185-3e905cc08b3d tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c" status: 200 len: 1369 microversion: 2.1 time: 0.268936 Oct 04 18:43:38.118036 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1860/3777] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:37 2022] GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c => generated 1369 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:43:38.157379 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a61b23ac-9a6d-4dd8-a10a-1922a3fd48f4 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:38.158273 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a61b23ac-9a6d-4dd8-a10a-1922a3fd48f4 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 8e11c130-e748-4008-ad1b-9c959b4d908c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:38.165651 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a61b23ac-9a6d-4dd8-a10a-1922a3fd48f4 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:38.166140 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a61b23ac-9a6d-4dd8-a10a-1922a3fd48f4 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:38.166580 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a61b23ac-9a6d-4dd8-a10a-1922a3fd48f4 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:38.167285 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a61b23ac-9a6d-4dd8-a10a-1922a3fd48f4 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:38.167740 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a61b23ac-9a6d-4dd8-a10a-1922a3fd48f4 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:38.168188 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a61b23ac-9a6d-4dd8-a10a-1922a3fd48f4 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:38.204509 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3c85d288-4271-4f1f-9658-13662d59eaa9 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:38.205260 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3c85d288-4271-4f1f-9658-13662d59eaa9 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] [instance: 3a41fe60-b7d3-4560-af99-292f1478f419] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:38.214791 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3c85d288-4271-4f1f-9658-13662d59eaa9 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:38.215296 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3c85d288-4271-4f1f-9658-13662d59eaa9 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:38.215803 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3c85d288-4271-4f1f-9658-13662d59eaa9 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:38.216548 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3c85d288-4271-4f1f-9658-13662d59eaa9 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:38.217032 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3c85d288-4271-4f1f-9658-13662d59eaa9 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:38.217552 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3c85d288-4271-4f1f-9658-13662d59eaa9 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:38.318788 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3c85d288-4271-4f1f-9658-13662d59eaa9 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:38.337388 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3c85d288-4271-4f1f-9658-13662d59eaa9 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:38.340967 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3c85d288-4271-4f1f-9658-13662d59eaa9 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:38.345382 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3c85d288-4271-4f1f-9658-13662d59eaa9 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] 10.222.0.20 "GET /compute/v2.1/servers/3a41fe60-b7d3-4560-af99-292f1478f419" status: 200 len: 1409 microversion: 2.54 time: 0.150445 Oct 04 18:43:38.346013 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1861/3778] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:43:38 2022] GET /compute/v2.1/servers/3a41fe60-b7d3-4560-af99-292f1478f419 => generated 1409 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:43:38.395160 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a61b23ac-9a6d-4dd8-a10a-1922a3fd48f4 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:38.404445 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a61b23ac-9a6d-4dd8-a10a-1922a3fd48f4 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/8e11c130-e748-4008-ad1b-9c959b4d908c" status: 200 len: 1308 microversion: 2.1 time: 0.257010 Oct 04 18:43:38.419852 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1918/3779] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:38 2022] GET /compute/v2.1/servers/8e11c130-e748-4008-ad1b-9c959b4d908c => generated 1308 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:38.857313 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e3541128-6aa0-4ebe-9cb4-ef379a010a39 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:38.858338 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e3541128-6aa0-4ebe-9cb4-ef379a010a39 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] [instance: 0c9b24a2-ed48-4175-89ef-c8b7971acd39] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:38.865714 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e3541128-6aa0-4ebe-9cb4-ef379a010a39 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:38.866282 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e3541128-6aa0-4ebe-9cb4-ef379a010a39 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:38.866797 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e3541128-6aa0-4ebe-9cb4-ef379a010a39 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:38.867614 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e3541128-6aa0-4ebe-9cb4-ef379a010a39 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:38.868162 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e3541128-6aa0-4ebe-9cb4-ef379a010a39 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:38.868656 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e3541128-6aa0-4ebe-9cb4-ef379a010a39 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:38.937454 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e3541128-6aa0-4ebe-9cb4-ef379a010a39 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e54eaa927e2848869093e0ec11904929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a4914508df43b0afac3ffdf3b85b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:38.946136 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e3541128-6aa0-4ebe-9cb4-ef379a010a39 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] 10.222.0.20 "GET /compute/v2.1/servers/0c9b24a2-ed48-4175-89ef-c8b7971acd39" status: 200 len: 1336 microversion: 2.1 time: 0.092575 Oct 04 18:43:38.946728 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1862/3780] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:38 2022] GET /compute/v2.1/servers/0c9b24a2-ed48-4175-89ef-c8b7971acd39 => generated 1336 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:39.105669 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-dcb24747-163d-4ff4-89b5-47c15cc8bf95 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe2582d4c10>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:39.147953 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-343901c7-986d-4a21-b3ac-5f07192ec958 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:39.149310 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-343901c7-986d-4a21-b3ac-5f07192ec958 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: 4d6dfac0-958d-4698-a050-6539caebe52c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:39.156619 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-343901c7-986d-4a21-b3ac-5f07192ec958 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:39.157619 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-343901c7-986d-4a21-b3ac-5f07192ec958 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:39.158065 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-343901c7-986d-4a21-b3ac-5f07192ec958 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:39.158848 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-343901c7-986d-4a21-b3ac-5f07192ec958 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:39.159313 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-343901c7-986d-4a21-b3ac-5f07192ec958 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:39.159745 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-343901c7-986d-4a21-b3ac-5f07192ec958 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:39.161246 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-dcb24747-163d-4ff4-89b5-47c15cc8bf95 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/images/5c609fc9-3cfe-4683-9148-134d915f048c" status: 200 len: 1464 microversion: 2.1 time: 0.059644 Oct 04 18:43:39.162046 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1919/3781] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:43:39 2022] GET /compute/v2.1/images/5c609fc9-3cfe-4683-9148-134d915f048c => generated 1464 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:39.179820 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-406c08c5-4cbf-4a65-81c4-e161d539d719 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe253dd4ee0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:39.241331 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-406c08c5-4cbf-4a65-81c4-e161d539d719 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/images/5c609fc9-3cfe-4683-9148-134d915f048c" status: 200 len: 1464 microversion: 2.1 time: 0.065279 Oct 04 18:43:39.241917 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1920/3782] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:43:39 2022] GET /compute/v2.1/images/5c609fc9-3cfe-4683-9148-134d915f048c => generated 1464 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:39.257407 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-65e225f7-77fe-44fc-bc58-adcfdd8fbe8c tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:39.258152 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-65e225f7-77fe-44fc-bc58-adcfdd8fbe8c tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] [instance: 6905c432-0fb3-4f5a-84bb-0ffcb08e2b3c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:39.270015 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-65e225f7-77fe-44fc-bc58-adcfdd8fbe8c tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:39.270015 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-65e225f7-77fe-44fc-bc58-adcfdd8fbe8c tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:39.270015 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-65e225f7-77fe-44fc-bc58-adcfdd8fbe8c tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:39.270015 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-65e225f7-77fe-44fc-bc58-adcfdd8fbe8c tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:39.270015 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-65e225f7-77fe-44fc-bc58-adcfdd8fbe8c tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:39.270015 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-65e225f7-77fe-44fc-bc58-adcfdd8fbe8c tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:39.356201 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-343901c7-986d-4a21-b3ac-5f07192ec958 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:39.365920 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-343901c7-986d-4a21-b3ac-5f07192ec958 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c" status: 200 len: 1369 microversion: 2.1 time: 0.222268 Oct 04 18:43:39.366507 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1863/3783] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:39 2022] GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c => generated 1369 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:39.378117 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3e439d21-6083-4ca3-af58-cec69333ec77 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:39.378743 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3e439d21-6083-4ca3-af58-cec69333ec77 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] [instance: 3a41fe60-b7d3-4560-af99-292f1478f419] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:39.385157 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3e439d21-6083-4ca3-af58-cec69333ec77 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:39.385664 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3e439d21-6083-4ca3-af58-cec69333ec77 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:39.386329 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3e439d21-6083-4ca3-af58-cec69333ec77 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:39.387158 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3e439d21-6083-4ca3-af58-cec69333ec77 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:39.387623 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3e439d21-6083-4ca3-af58-cec69333ec77 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:39.388081 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3e439d21-6083-4ca3-af58-cec69333ec77 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:39.442115 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-65e225f7-77fe-44fc-bc58-adcfdd8fbe8c tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8d2814c23a4aa9806d56ce99c89e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8596483de9f14de9a88cdb787841fd3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:39.449978 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-65e225f7-77fe-44fc-bc58-adcfdd8fbe8c tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/servers/6905c432-0fb3-4f5a-84bb-0ffcb08e2b3c" status: 200 len: 1466 microversion: 2.1 time: 0.197072 Oct 04 18:43:39.450694 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1921/3784] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:39 2022] GET /compute/v2.1/servers/6905c432-0fb3-4f5a-84bb-0ffcb08e2b3c => generated 1466 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:43:39.455782 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-84fef40f-139f-401d-9070-88b70f399c1c tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:39.458781 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3e439d21-6083-4ca3-af58-cec69333ec77 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:39.460773 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-84fef40f-139f-401d-9070-88b70f399c1c tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 8e11c130-e748-4008-ad1b-9c959b4d908c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:39.466795 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-84fef40f-139f-401d-9070-88b70f399c1c tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:39.467173 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3e439d21-6083-4ca3-af58-cec69333ec77 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:39.471730 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-84fef40f-139f-401d-9070-88b70f399c1c tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:39.471730 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-84fef40f-139f-401d-9070-88b70f399c1c tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:39.471730 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-84fef40f-139f-401d-9070-88b70f399c1c tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:39.471730 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-84fef40f-139f-401d-9070-88b70f399c1c tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:39.472337 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3e439d21-6083-4ca3-af58-cec69333ec77 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:39.472458 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-84fef40f-139f-401d-9070-88b70f399c1c tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:39.472561 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3e439d21-6083-4ca3-af58-cec69333ec77 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] 10.222.0.20 "GET /compute/v2.1/servers/3a41fe60-b7d3-4560-af99-292f1478f419" status: 200 len: 1409 microversion: 2.54 time: 0.103540 Oct 04 18:43:39.472901 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1864/3785] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:43:39 2022] GET /compute/v2.1/servers/3a41fe60-b7d3-4560-af99-292f1478f419 => generated 1409 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:43:39.477859 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-94a8dd00-8048-4889-8e24-2103bdf84420 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-86247597"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:43:39.480326 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-94a8dd00-8048-4889-8e24-2103bdf84420 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] [instance: 471125af-1ec3-44b3-bb69-36b04a03fdd5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:39.486479 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-94a8dd00-8048-4889-8e24-2103bdf84420 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:39.487182 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-94a8dd00-8048-4889-8e24-2103bdf84420 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:39.487628 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-94a8dd00-8048-4889-8e24-2103bdf84420 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:39.488359 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-94a8dd00-8048-4889-8e24-2103bdf84420 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:39.488821 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-94a8dd00-8048-4889-8e24-2103bdf84420 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:39.489257 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-94a8dd00-8048-4889-8e24-2103bdf84420 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:39.606524 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-84fef40f-139f-401d-9070-88b70f399c1c tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:39.614898 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-84fef40f-139f-401d-9070-88b70f399c1c tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/8e11c130-e748-4008-ad1b-9c959b4d908c" status: 200 len: 1308 microversion: 2.1 time: 0.163440 Oct 04 18:43:39.615465 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1922/3786] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:39 2022] GET /compute/v2.1/servers/8e11c130-e748-4008-ad1b-9c959b4d908c => generated 1308 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:39.952312 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-94a8dd00-8048-4889-8e24-2103bdf84420 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "POST /compute/v2.1/servers/471125af-1ec3-44b3-bb69-36b04a03fdd5/action" status: 202 len: 0 microversion: 2.1 time: 0.477929 Oct 04 18:43:39.953454 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1865/3787] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:43:39 2022] POST /compute/v2.1/servers/471125af-1ec3-44b3-bb69-36b04a03fdd5/action => generated 0 bytes in 480 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 18:43:39.968395 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3f1ac52e-e9b4-4e8d-ab46-360bba60b768 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe253de6280>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:39.971603 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ad1d137a-40bd-411b-b676-955d8043dfff tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:39.976136 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ad1d137a-40bd-411b-b676-955d8043dfff tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] [instance: 0c9b24a2-ed48-4175-89ef-c8b7971acd39] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:39.979842 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ad1d137a-40bd-411b-b676-955d8043dfff tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:39.980366 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ad1d137a-40bd-411b-b676-955d8043dfff tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:39.980808 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ad1d137a-40bd-411b-b676-955d8043dfff tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:39.981702 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ad1d137a-40bd-411b-b676-955d8043dfff tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:39.982341 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ad1d137a-40bd-411b-b676-955d8043dfff tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:39.982778 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ad1d137a-40bd-411b-b676-955d8043dfff tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:40.015957 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3f1ac52e-e9b4-4e8d-ab46-360bba60b768 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/images/de3254af-72ec-481e-91a9-f950ae382b0e" status: 200 len: 1453 microversion: 2.1 time: 0.055000 Oct 04 18:43:40.016581 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1923/3788] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:43:39 2022] GET /compute/v2.1/images/de3254af-72ec-481e-91a9-f950ae382b0e => generated 1453 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:40.021128 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-2fb48369-0279-408a-b93d-4700cd1f096c req-ff2184ca-6bb8-43f6-8385-2a3dff04bd4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d6dfac0-958d-4698-a050-6539caebe52c", "name": "network-vif-plugged", "status": "completed", "tag": "b3bc4ab3-40de-48c0-8c27-0fbd4d0780d1"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:43:40.030924 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-2fb48369-0279-408a-b93d-4700cd1f096c req-ff2184ca-6bb8-43f6-8385-2a3dff04bd4d service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:40.031428 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-2fb48369-0279-408a-b93d-4700cd1f096c req-ff2184ca-6bb8-43f6-8385-2a3dff04bd4d service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:40.031829 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-2fb48369-0279-408a-b93d-4700cd1f096c req-ff2184ca-6bb8-43f6-8385-2a3dff04bd4d service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:40.043773 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-2fb48369-0279-408a-b93d-4700cd1f096c req-ff2184ca-6bb8-43f6-8385-2a3dff04bd4d service nova] Creating event network-vif-plugged:b3bc4ab3-40de-48c0-8c27-0fbd4d0780d1 for instance 4d6dfac0-958d-4698-a050-6539caebe52c on n-h1-850501-14 Oct 04 18:43:40.049327 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-2fb48369-0279-408a-b93d-4700cd1f096c req-ff2184ca-6bb8-43f6-8385-2a3dff04bd4d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031654 Oct 04 18:43:40.049918 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1924/3789] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:43:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:43:40.055421 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ad1d137a-40bd-411b-b676-955d8043dfff tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e54eaa927e2848869093e0ec11904929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a4914508df43b0afac3ffdf3b85b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:40.064803 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ad1d137a-40bd-411b-b676-955d8043dfff tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] 10.222.0.20 "GET /compute/v2.1/servers/0c9b24a2-ed48-4175-89ef-c8b7971acd39" status: 200 len: 1346 microversion: 2.1 time: 0.098014 Oct 04 18:43:40.071540 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1866/3790] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:39 2022] GET /compute/v2.1/servers/0c9b24a2-ed48-4175-89ef-c8b7971acd39 => generated 1346 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:43:40.395312 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-696b2249-eb01-49c6-a257-bdb1cd6dc479 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:40.396015 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-696b2249-eb01-49c6-a257-bdb1cd6dc479 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: 4d6dfac0-958d-4698-a050-6539caebe52c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:40.402232 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-696b2249-eb01-49c6-a257-bdb1cd6dc479 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:40.402714 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-696b2249-eb01-49c6-a257-bdb1cd6dc479 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:40.403148 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-696b2249-eb01-49c6-a257-bdb1cd6dc479 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:40.403834 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-696b2249-eb01-49c6-a257-bdb1cd6dc479 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:40.404338 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-696b2249-eb01-49c6-a257-bdb1cd6dc479 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:40.404767 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-696b2249-eb01-49c6-a257-bdb1cd6dc479 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:40.498078 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-50a5be00-9a29-4db1-931e-4d8ea66326ae tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:40.498698 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-50a5be00-9a29-4db1-931e-4d8ea66326ae tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] [instance: 3a41fe60-b7d3-4560-af99-292f1478f419] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:40.507790 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-50a5be00-9a29-4db1-931e-4d8ea66326ae tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:40.508319 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-50a5be00-9a29-4db1-931e-4d8ea66326ae tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:40.508765 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-50a5be00-9a29-4db1-931e-4d8ea66326ae tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:40.509473 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-50a5be00-9a29-4db1-931e-4d8ea66326ae tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:40.509936 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-50a5be00-9a29-4db1-931e-4d8ea66326ae tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:40.510365 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-50a5be00-9a29-4db1-931e-4d8ea66326ae tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:40.545255 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-696b2249-eb01-49c6-a257-bdb1cd6dc479 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:40.554771 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-696b2249-eb01-49c6-a257-bdb1cd6dc479 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c" status: 200 len: 1369 microversion: 2.1 time: 0.165091 Oct 04 18:43:40.556654 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1925/3791] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:40 2022] GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c => generated 1369 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:40.585878 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-50a5be00-9a29-4db1-931e-4d8ea66326ae tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:40.592687 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-50a5be00-9a29-4db1-931e-4d8ea66326ae tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:40.594781 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-50a5be00-9a29-4db1-931e-4d8ea66326ae tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:40.595938 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-50a5be00-9a29-4db1-931e-4d8ea66326ae tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] 10.222.0.20 "GET /compute/v2.1/servers/3a41fe60-b7d3-4560-af99-292f1478f419" status: 200 len: 1409 microversion: 2.54 time: 0.101827 Oct 04 18:43:40.596526 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1867/3792] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:43:40 2022] GET /compute/v2.1/servers/3a41fe60-b7d3-4560-af99-292f1478f419 => generated 1409 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:43:40.638796 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ba19ceb9-3f87-4b8b-9744-e5053d4131f9 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:40.639405 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ba19ceb9-3f87-4b8b-9744-e5053d4131f9 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 8e11c130-e748-4008-ad1b-9c959b4d908c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:40.646147 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ba19ceb9-3f87-4b8b-9744-e5053d4131f9 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:40.646629 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ba19ceb9-3f87-4b8b-9744-e5053d4131f9 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:40.647059 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ba19ceb9-3f87-4b8b-9744-e5053d4131f9 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:40.647777 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ba19ceb9-3f87-4b8b-9744-e5053d4131f9 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:40.648252 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ba19ceb9-3f87-4b8b-9744-e5053d4131f9 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:40.648673 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ba19ceb9-3f87-4b8b-9744-e5053d4131f9 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:40.802748 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ba19ceb9-3f87-4b8b-9744-e5053d4131f9 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:40.810861 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ba19ceb9-3f87-4b8b-9744-e5053d4131f9 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/8e11c130-e748-4008-ad1b-9c959b4d908c" status: 200 len: 1308 microversion: 2.1 time: 0.176255 Oct 04 18:43:40.811445 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1926/3793] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:40 2022] GET /compute/v2.1/servers/8e11c130-e748-4008-ad1b-9c959b4d908c => generated 1308 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:41.031721 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-da85de51-c611-4f54-96ff-857b78f26afd tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe258905e50>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:41.077381 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-da85de51-c611-4f54-96ff-857b78f26afd tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/images/de3254af-72ec-481e-91a9-f950ae382b0e" status: 200 len: 1453 microversion: 2.1 time: 0.049649 Oct 04 18:43:41.077961 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1868/3794] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:43:41 2022] GET /compute/v2.1/images/de3254af-72ec-481e-91a9-f950ae382b0e => generated 1453 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:41.090167 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5fe11fb5-0d1c-4176-a584-e36bbf91089c tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:41.090167 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5fe11fb5-0d1c-4176-a584-e36bbf91089c tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] [instance: 0c9b24a2-ed48-4175-89ef-c8b7971acd39] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:41.096364 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5fe11fb5-0d1c-4176-a584-e36bbf91089c tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:41.096845 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5fe11fb5-0d1c-4176-a584-e36bbf91089c tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:41.097275 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5fe11fb5-0d1c-4176-a584-e36bbf91089c tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:41.097959 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5fe11fb5-0d1c-4176-a584-e36bbf91089c tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:41.098454 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5fe11fb5-0d1c-4176-a584-e36bbf91089c tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:41.098885 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5fe11fb5-0d1c-4176-a584-e36bbf91089c tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:41.161521 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5fe11fb5-0d1c-4176-a584-e36bbf91089c tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e54eaa927e2848869093e0ec11904929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a4914508df43b0afac3ffdf3b85b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:41.169195 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5fe11fb5-0d1c-4176-a584-e36bbf91089c tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] 10.222.0.20 "GET /compute/v2.1/servers/0c9b24a2-ed48-4175-89ef-c8b7971acd39" status: 200 len: 1346 microversion: 2.1 time: 0.084475 Oct 04 18:43:41.169758 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1927/3795] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:41 2022] GET /compute/v2.1/servers/0c9b24a2-ed48-4175-89ef-c8b7971acd39 => generated 1346 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:43:41.584612 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d838b4f4-5282-4f0a-b4fe-d97817a3e09e tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:41.585627 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d838b4f4-5282-4f0a-b4fe-d97817a3e09e tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: 4d6dfac0-958d-4698-a050-6539caebe52c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:41.594808 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d838b4f4-5282-4f0a-b4fe-d97817a3e09e tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:41.595390 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d838b4f4-5282-4f0a-b4fe-d97817a3e09e tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:41.596152 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d838b4f4-5282-4f0a-b4fe-d97817a3e09e tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:41.597023 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d838b4f4-5282-4f0a-b4fe-d97817a3e09e tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:41.597559 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d838b4f4-5282-4f0a-b4fe-d97817a3e09e tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:41.598211 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d838b4f4-5282-4f0a-b4fe-d97817a3e09e tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:41.622451 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-fc20055d-7193-48b4-82e4-b3f381b5d2ed tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:41.624790 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-fc20055d-7193-48b4-82e4-b3f381b5d2ed tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] [instance: 3a41fe60-b7d3-4560-af99-292f1478f419] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:41.639548 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fc20055d-7193-48b4-82e4-b3f381b5d2ed tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:41.640351 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fc20055d-7193-48b4-82e4-b3f381b5d2ed tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:41.641213 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fc20055d-7193-48b4-82e4-b3f381b5d2ed tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:41.641940 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fc20055d-7193-48b4-82e4-b3f381b5d2ed tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:41.642389 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fc20055d-7193-48b4-82e4-b3f381b5d2ed tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:41.642901 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fc20055d-7193-48b4-82e4-b3f381b5d2ed tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:41.782982 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-fc20055d-7193-48b4-82e4-b3f381b5d2ed tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:41.798247 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-fc20055d-7193-48b4-82e4-b3f381b5d2ed tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:41.807388 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-fc20055d-7193-48b4-82e4-b3f381b5d2ed tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:41.807388 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-fc20055d-7193-48b4-82e4-b3f381b5d2ed tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] 10.222.0.20 "GET /compute/v2.1/servers/3a41fe60-b7d3-4560-af99-292f1478f419" status: 200 len: 1409 microversion: 2.54 time: 0.186449 Oct 04 18:43:41.807388 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1928/3796] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:43:41 2022] GET /compute/v2.1/servers/3a41fe60-b7d3-4560-af99-292f1478f419 => generated 1409 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:43:41.835842 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8000ee90-c75e-4074-9256-e58301cc5091 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:41.836814 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8000ee90-c75e-4074-9256-e58301cc5091 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 8e11c130-e748-4008-ad1b-9c959b4d908c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:41.840841 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:43:41.856261 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8000ee90-c75e-4074-9256-e58301cc5091 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:41.856873 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8000ee90-c75e-4074-9256-e58301cc5091 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:41.857445 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8000ee90-c75e-4074-9256-e58301cc5091 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:41.857581 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d838b4f4-5282-4f0a-b4fe-d97817a3e09e tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:41.858346 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8000ee90-c75e-4074-9256-e58301cc5091 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:41.859025 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8000ee90-c75e-4074-9256-e58301cc5091 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:41.859585 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8000ee90-c75e-4074-9256-e58301cc5091 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:41.869642 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d838b4f4-5282-4f0a-b4fe-d97817a3e09e tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c" status: 200 len: 1369 microversion: 2.1 time: 0.288010 Oct 04 18:43:41.870639 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1869/3797] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:41 2022] GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c => generated 1369 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:41.890770 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=100 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:43:42.041840 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8000ee90-c75e-4074-9256-e58301cc5091 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:42.049448 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8000ee90-c75e-4074-9256-e58301cc5091 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/8e11c130-e748-4008-ad1b-9c959b4d908c" status: 200 len: 1308 microversion: 2.1 time: 0.218072 Oct 04 18:43:42.050020 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1929/3798] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:41 2022] GET /compute/v2.1/servers/8e11c130-e748-4008-ad1b-9c959b4d908c => generated 1308 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:42.069929 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-a6710cc1-00c3-4816-8fe3-024aa97adcdc req-8ee746e5-f36d-4145-b4bc-8876c2fcc645 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6905c432-0fb3-4f5a-84bb-0ffcb08e2b3c", "name": "network-vif-unplugged", "status": "completed", "tag": "457c88d9-9246-435c-b1a5-58b0c6c6185d"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:43:42.083846 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-a6710cc1-00c3-4816-8fe3-024aa97adcdc req-8ee746e5-f36d-4145-b4bc-8876c2fcc645 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:42.084456 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-a6710cc1-00c3-4816-8fe3-024aa97adcdc req-8ee746e5-f36d-4145-b4bc-8876c2fcc645 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:42.084893 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-a6710cc1-00c3-4816-8fe3-024aa97adcdc req-8ee746e5-f36d-4145-b4bc-8876c2fcc645 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:42.095333 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1b4178ea-a56c-4d91-bbf5-e2a795b6163a tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe25831f040>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:42.097328 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-a6710cc1-00c3-4816-8fe3-024aa97adcdc req-8ee746e5-f36d-4145-b4bc-8876c2fcc645 service nova] Creating event network-vif-unplugged:457c88d9-9246-435c-b1a5-58b0c6c6185d for instance 6905c432-0fb3-4f5a-84bb-0ffcb08e2b3c on n-h1-850501-14 Oct 04 18:43:42.102613 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-a6710cc1-00c3-4816-8fe3-024aa97adcdc req-8ee746e5-f36d-4145-b4bc-8876c2fcc645 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036739 Oct 04 18:43:42.103738 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1870/3799] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:43:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:43:42.157017 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1b4178ea-a56c-4d91-bbf5-e2a795b6163a tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/images/de3254af-72ec-481e-91a9-f950ae382b0e" status: 200 len: 1453 microversion: 2.1 time: 0.067689 Oct 04 18:43:42.165337 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1930/3800] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:43:42 2022] GET /compute/v2.1/images/de3254af-72ec-481e-91a9-f950ae382b0e => generated 1453 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:42.199015 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-747c0339-276c-4402-b724-8c78a77f1ea4 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:42.199782 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-747c0339-276c-4402-b724-8c78a77f1ea4 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] [instance: 0c9b24a2-ed48-4175-89ef-c8b7971acd39] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:42.206166 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-747c0339-276c-4402-b724-8c78a77f1ea4 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:42.206664 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-747c0339-276c-4402-b724-8c78a77f1ea4 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:42.207332 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-747c0339-276c-4402-b724-8c78a77f1ea4 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:42.208029 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-747c0339-276c-4402-b724-8c78a77f1ea4 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:42.208729 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-747c0339-276c-4402-b724-8c78a77f1ea4 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:42.209342 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-747c0339-276c-4402-b724-8c78a77f1ea4 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:42.526056 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-747c0339-276c-4402-b724-8c78a77f1ea4 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e54eaa927e2848869093e0ec11904929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a4914508df43b0afac3ffdf3b85b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:42.536753 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-747c0339-276c-4402-b724-8c78a77f1ea4 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] 10.222.0.20 "GET /compute/v2.1/servers/0c9b24a2-ed48-4175-89ef-c8b7971acd39" status: 200 len: 1401 microversion: 2.1 time: 0.346606 Oct 04 18:43:42.541112 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1871/3801] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:42 2022] GET /compute/v2.1/servers/0c9b24a2-ed48-4175-89ef-c8b7971acd39 => generated 1401 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:42.832445 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=18 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:43:42.836664 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-61deb400-01af-4e98-8ff1-8982a85047a4 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:42.838289 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-61deb400-01af-4e98-8ff1-8982a85047a4 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] [instance: 3a41fe60-b7d3-4560-af99-292f1478f419] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:42.846313 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-61deb400-01af-4e98-8ff1-8982a85047a4 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:42.846313 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-61deb400-01af-4e98-8ff1-8982a85047a4 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:42.846313 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-61deb400-01af-4e98-8ff1-8982a85047a4 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:42.846761 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-61deb400-01af-4e98-8ff1-8982a85047a4 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:42.847272 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-61deb400-01af-4e98-8ff1-8982a85047a4 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:42.847709 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-61deb400-01af-4e98-8ff1-8982a85047a4 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:42.905565 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-befed4a3-c344-4337-9b23-c47c31c2abe0 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:42.906776 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-befed4a3-c344-4337-9b23-c47c31c2abe0 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: 4d6dfac0-958d-4698-a050-6539caebe52c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:42.913688 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-befed4a3-c344-4337-9b23-c47c31c2abe0 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:42.914316 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-befed4a3-c344-4337-9b23-c47c31c2abe0 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:42.915201 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-befed4a3-c344-4337-9b23-c47c31c2abe0 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:42.915593 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-61deb400-01af-4e98-8ff1-8982a85047a4 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:42.915745 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-befed4a3-c344-4337-9b23-c47c31c2abe0 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:42.916223 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-befed4a3-c344-4337-9b23-c47c31c2abe0 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:42.916934 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-befed4a3-c344-4337-9b23-c47c31c2abe0 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:42.926567 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-61deb400-01af-4e98-8ff1-8982a85047a4 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:42.928012 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-61deb400-01af-4e98-8ff1-8982a85047a4 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:42.929240 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-61deb400-01af-4e98-8ff1-8982a85047a4 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] 10.222.0.20 "GET /compute/v2.1/servers/3a41fe60-b7d3-4560-af99-292f1478f419" status: 200 len: 1409 microversion: 2.54 time: 0.098387 Oct 04 18:43:42.929807 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1931/3802] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:43:42 2022] GET /compute/v2.1/servers/3a41fe60-b7d3-4560-af99-292f1478f419 => generated 1409 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:43:43.068499 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-befed4a3-c344-4337-9b23-c47c31c2abe0 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:43.078394 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-66f2e6a0-5de4-47dd-94d3-ee96fe3dd9ff tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:43.079187 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-66f2e6a0-5de4-47dd-94d3-ee96fe3dd9ff tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 8e11c130-e748-4008-ad1b-9c959b4d908c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:43.091064 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-66f2e6a0-5de4-47dd-94d3-ee96fe3dd9ff tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:43.091655 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-befed4a3-c344-4337-9b23-c47c31c2abe0 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c" status: 200 len: 1562 microversion: 2.1 time: 0.189229 Oct 04 18:43:43.093750 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-66f2e6a0-5de4-47dd-94d3-ee96fe3dd9ff tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:43.094442 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-66f2e6a0-5de4-47dd-94d3-ee96fe3dd9ff tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:43.095389 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-66f2e6a0-5de4-47dd-94d3-ee96fe3dd9ff tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:43.096088 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-66f2e6a0-5de4-47dd-94d3-ee96fe3dd9ff tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:43.098122 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-66f2e6a0-5de4-47dd-94d3-ee96fe3dd9ff tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:43.104625 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1872/3803] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:42 2022] GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c => generated 1562 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:43:43.120138 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5277308f-5017-4b30-9d84-6bca2edebf35 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:43.120645 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5277308f-5017-4b30-9d84-6bca2edebf35 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: 4d6dfac0-958d-4698-a050-6539caebe52c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:43.127633 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5277308f-5017-4b30-9d84-6bca2edebf35 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:43.128165 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5277308f-5017-4b30-9d84-6bca2edebf35 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:43.128612 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5277308f-5017-4b30-9d84-6bca2edebf35 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:43.129326 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5277308f-5017-4b30-9d84-6bca2edebf35 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:43.129788 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5277308f-5017-4b30-9d84-6bca2edebf35 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:43.130861 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5277308f-5017-4b30-9d84-6bca2edebf35 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:43.244871 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5277308f-5017-4b30-9d84-6bca2edebf35 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.128707 Oct 04 18:43:43.246421 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1873/3804] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Oct 4 18:43:43 2022] GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c/os-interface => generated 284 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:43:43.252895 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b8d38af3-9d92-4240-8b9d-d07f81188ead tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe259599940>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:43.313796 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b8d38af3-9d92-4240-8b9d-d07f81188ead tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/images/de3254af-72ec-481e-91a9-f950ae382b0e" status: 200 len: 1453 microversion: 2.1 time: 0.065937 Oct 04 18:43:43.314953 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1874/3805] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:43:43 2022] GET /compute/v2.1/images/de3254af-72ec-481e-91a9-f950ae382b0e => generated 1453 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:43.381976 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-66f2e6a0-5de4-47dd-94d3-ee96fe3dd9ff tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:43.391484 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-66f2e6a0-5de4-47dd-94d3-ee96fe3dd9ff tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/8e11c130-e748-4008-ad1b-9c959b4d908c" status: 200 len: 1308 microversion: 2.1 time: 0.318654 Oct 04 18:43:43.392089 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1932/3806] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:43 2022] GET /compute/v2.1/servers/8e11c130-e748-4008-ad1b-9c959b4d908c => generated 1308 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:43:43.501481 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-a2dbccd6-5b6b-4ed4-8837-3193067a9ced req-16b0f3eb-ac95-401b-b527-88823f48a54c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c9b24a2-ed48-4175-89ef-c8b7971acd39", "tag": "cc638c0b-6f43-4ac9-b7bb-c32809d8d85f"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:43:43.521762 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-a2dbccd6-5b6b-4ed4-8837-3193067a9ced req-16b0f3eb-ac95-401b-b527-88823f48a54c service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:43.524800 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-a2dbccd6-5b6b-4ed4-8837-3193067a9ced req-16b0f3eb-ac95-401b-b527-88823f48a54c service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:43.525425 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-a2dbccd6-5b6b-4ed4-8837-3193067a9ced req-16b0f3eb-ac95-401b-b527-88823f48a54c service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:43.540661 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-a2dbccd6-5b6b-4ed4-8837-3193067a9ced req-16b0f3eb-ac95-401b-b527-88823f48a54c service nova] Creating event network-changed:cc638c0b-6f43-4ac9-b7bb-c32809d8d85f for instance 0c9b24a2-ed48-4175-89ef-c8b7971acd39 on n-h2-850501-14 Oct 04 18:43:43.547897 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-a2dbccd6-5b6b-4ed4-8837-3193067a9ced req-16b0f3eb-ac95-401b-b527-88823f48a54c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051297 Oct 04 18:43:43.549186 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1875/3807] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:43:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:43:43.561027 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e1a5b7aa-0909-456e-9d7d-401367b82b0e tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:43.561730 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e1a5b7aa-0909-456e-9d7d-401367b82b0e tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] [instance: 0c9b24a2-ed48-4175-89ef-c8b7971acd39] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:43.575358 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e1a5b7aa-0909-456e-9d7d-401367b82b0e tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:43.576110 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e1a5b7aa-0909-456e-9d7d-401367b82b0e tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:43.576845 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e1a5b7aa-0909-456e-9d7d-401367b82b0e tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:43.577839 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e1a5b7aa-0909-456e-9d7d-401367b82b0e tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:43.578354 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e1a5b7aa-0909-456e-9d7d-401367b82b0e tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:43.578910 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e1a5b7aa-0909-456e-9d7d-401367b82b0e tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:43.903467 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e1a5b7aa-0909-456e-9d7d-401367b82b0e tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e54eaa927e2848869093e0ec11904929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a4914508df43b0afac3ffdf3b85b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:43.914484 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e1a5b7aa-0909-456e-9d7d-401367b82b0e tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] 10.222.0.20 "GET /compute/v2.1/servers/0c9b24a2-ed48-4175-89ef-c8b7971acd39" status: 200 len: 1401 microversion: 2.1 time: 0.355778 Oct 04 18:43:43.915252 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1933/3808] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:43 2022] GET /compute/v2.1/servers/0c9b24a2-ed48-4175-89ef-c8b7971acd39 => generated 1401 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:43.963533 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b375e923-e4bf-4f36-a972-a32803609870 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:43.964907 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b375e923-e4bf-4f36-a972-a32803609870 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] [instance: 3a41fe60-b7d3-4560-af99-292f1478f419] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:43.977684 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:43:43.977684 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b375e923-e4bf-4f36-a972-a32803609870 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:43.977684 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b375e923-e4bf-4f36-a972-a32803609870 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:43.977684 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b375e923-e4bf-4f36-a972-a32803609870 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:43.978271 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b375e923-e4bf-4f36-a972-a32803609870 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:43.979401 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b375e923-e4bf-4f36-a972-a32803609870 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:43.979834 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b375e923-e4bf-4f36-a972-a32803609870 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:44.082258 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b375e923-e4bf-4f36-a972-a32803609870 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:44.092613 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b375e923-e4bf-4f36-a972-a32803609870 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:44.092613 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b375e923-e4bf-4f36-a972-a32803609870 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:44.100253 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b375e923-e4bf-4f36-a972-a32803609870 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] 10.222.0.20 "GET /compute/v2.1/servers/3a41fe60-b7d3-4560-af99-292f1478f419" status: 200 len: 1409 microversion: 2.54 time: 0.143012 Oct 04 18:43:44.100707 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1876/3809] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:43:43 2022] GET /compute/v2.1/servers/3a41fe60-b7d3-4560-af99-292f1478f419 => generated 1409 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:43:44.331093 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-cc6949ac-906f-4ee6-b26a-de70f6f37ce4 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe258c219d0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:44.377968 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-cc6949ac-906f-4ee6-b26a-de70f6f37ce4 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/images/de3254af-72ec-481e-91a9-f950ae382b0e" status: 200 len: 1453 microversion: 2.1 time: 0.051337 Oct 04 18:43:44.379288 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1934/3810] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:43:44 2022] GET /compute/v2.1/images/de3254af-72ec-481e-91a9-f950ae382b0e => generated 1453 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:44.416299 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8e7adec6-da64-40ad-af8c-ce121a3993f5 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:44.417242 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8e7adec6-da64-40ad-af8c-ce121a3993f5 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 8e11c130-e748-4008-ad1b-9c959b4d908c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:44.431427 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8e7adec6-da64-40ad-af8c-ce121a3993f5 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:44.431938 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8e7adec6-da64-40ad-af8c-ce121a3993f5 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:44.432406 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8e7adec6-da64-40ad-af8c-ce121a3993f5 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:44.435896 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8e7adec6-da64-40ad-af8c-ce121a3993f5 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:44.436472 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8e7adec6-da64-40ad-af8c-ce121a3993f5 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:44.436933 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8e7adec6-da64-40ad-af8c-ce121a3993f5 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:44.698804 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-61678378-ec8b-40be-8102-c1699b4a5075 req-00e42308-af9d-4ee6-9ed1-483be3e8ee60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d6dfac0-958d-4698-a050-6539caebe52c", "tag": "b3bc4ab3-40de-48c0-8c27-0fbd4d0780d1"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:43:44.709028 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-61678378-ec8b-40be-8102-c1699b4a5075 req-00e42308-af9d-4ee6-9ed1-483be3e8ee60 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:44.709764 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-61678378-ec8b-40be-8102-c1699b4a5075 req-00e42308-af9d-4ee6-9ed1-483be3e8ee60 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:44.710200 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-61678378-ec8b-40be-8102-c1699b4a5075 req-00e42308-af9d-4ee6-9ed1-483be3e8ee60 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:44.723305 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8e7adec6-da64-40ad-af8c-ce121a3993f5 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:44.723593 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-61678378-ec8b-40be-8102-c1699b4a5075 req-00e42308-af9d-4ee6-9ed1-483be3e8ee60 service nova] Creating event network-changed:b3bc4ab3-40de-48c0-8c27-0fbd4d0780d1 for instance 4d6dfac0-958d-4698-a050-6539caebe52c on n-h1-850501-14 Oct 04 18:43:44.730212 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-61678378-ec8b-40be-8102-c1699b4a5075 req-00e42308-af9d-4ee6-9ed1-483be3e8ee60 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034359 Oct 04 18:43:44.730615 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1935/3811] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:43:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:43:44.740740 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8e7adec6-da64-40ad-af8c-ce121a3993f5 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/8e11c130-e748-4008-ad1b-9c959b4d908c" status: 200 len: 1308 microversion: 2.1 time: 0.329623 Oct 04 18:43:44.762217 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1877/3812] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:44 2022] GET /compute/v2.1/servers/8e11c130-e748-4008-ad1b-9c959b4d908c => generated 1308 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:44.943019 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-08ab9b6a-dfe7-43dc-bf82-64733668c10e tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:44.943633 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-08ab9b6a-dfe7-43dc-bf82-64733668c10e tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] [instance: 0c9b24a2-ed48-4175-89ef-c8b7971acd39] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:44.960674 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-08ab9b6a-dfe7-43dc-bf82-64733668c10e tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:44.961213 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-08ab9b6a-dfe7-43dc-bf82-64733668c10e tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:44.962593 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-08ab9b6a-dfe7-43dc-bf82-64733668c10e tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:44.964636 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-08ab9b6a-dfe7-43dc-bf82-64733668c10e tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:44.966433 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-08ab9b6a-dfe7-43dc-bf82-64733668c10e tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:44.966911 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-08ab9b6a-dfe7-43dc-bf82-64733668c10e tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:45.127758 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6074d42a-f3a8-4a08-a06f-6d945e0799dc tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:45.129136 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-6074d42a-f3a8-4a08-a06f-6d945e0799dc tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] [instance: 3a41fe60-b7d3-4560-af99-292f1478f419] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:45.131327 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=4 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:43:45.141960 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6074d42a-f3a8-4a08-a06f-6d945e0799dc tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:45.147447 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6074d42a-f3a8-4a08-a06f-6d945e0799dc tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:45.147447 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6074d42a-f3a8-4a08-a06f-6d945e0799dc tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:45.147447 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6074d42a-f3a8-4a08-a06f-6d945e0799dc tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:45.147447 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6074d42a-f3a8-4a08-a06f-6d945e0799dc tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:45.147447 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6074d42a-f3a8-4a08-a06f-6d945e0799dc tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:45.477177 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-6074d42a-f3a8-4a08-a06f-6d945e0799dc tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:45.489895 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-6074d42a-f3a8-4a08-a06f-6d945e0799dc tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:45.492713 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-6074d42a-f3a8-4a08-a06f-6d945e0799dc tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:45.495000 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6074d42a-f3a8-4a08-a06f-6d945e0799dc tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] 10.222.0.20 "GET /compute/v2.1/servers/3a41fe60-b7d3-4560-af99-292f1478f419" status: 200 len: 1409 microversion: 2.54 time: 0.371840 Oct 04 18:43:45.496158 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1878/3813] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:43:45 2022] GET /compute/v2.1/servers/3a41fe60-b7d3-4560-af99-292f1478f419 => generated 1409 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:43:45.507287 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b41cf681-c026-4d59-9937-275c25108f8b tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe2598700d0>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:45.569529 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b41cf681-c026-4d59-9937-275c25108f8b tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/images/de3254af-72ec-481e-91a9-f950ae382b0e" status: 200 len: 1453 microversion: 2.1 time: 0.068749 Oct 04 18:43:45.570505 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1879/3814] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:43:45 2022] GET /compute/v2.1/images/de3254af-72ec-481e-91a9-f950ae382b0e => generated 1453 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:45.591386 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-08ab9b6a-dfe7-43dc-bf82-64733668c10e tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e54eaa927e2848869093e0ec11904929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a4914508df43b0afac3ffdf3b85b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:45.600839 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-08ab9b6a-dfe7-43dc-bf82-64733668c10e tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] 10.222.0.20 "GET /compute/v2.1/servers/0c9b24a2-ed48-4175-89ef-c8b7971acd39" status: 200 len: 1401 microversion: 2.1 time: 0.662992 Oct 04 18:43:45.604601 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1936/3815] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:44 2022] GET /compute/v2.1/servers/0c9b24a2-ed48-4175-89ef-c8b7971acd39 => generated 1401 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:45.763026 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8a63668b-7e13-4ff2-9efd-ba64186ba580 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:45.763651 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8a63668b-7e13-4ff2-9efd-ba64186ba580 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 8e11c130-e748-4008-ad1b-9c959b4d908c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:45.766285 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-c88180c7-318b-4a7c-a7f4-9bebed535d03 req-0041e0ae-92b9-4b27-a85e-826fbc52915a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e11c130-e748-4008-ad1b-9c959b4d908c", "name": "network-vif-plugged", "status": "completed", "tag": "fa986f0d-87ea-488c-be0e-10e65cf98dc3"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:43:45.780682 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8a63668b-7e13-4ff2-9efd-ba64186ba580 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:45.781245 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8a63668b-7e13-4ff2-9efd-ba64186ba580 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:45.788152 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8a63668b-7e13-4ff2-9efd-ba64186ba580 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:45.789512 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8a63668b-7e13-4ff2-9efd-ba64186ba580 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:45.790344 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8a63668b-7e13-4ff2-9efd-ba64186ba580 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:45.791006 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8a63668b-7e13-4ff2-9efd-ba64186ba580 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:45.791557 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-c88180c7-318b-4a7c-a7f4-9bebed535d03 req-0041e0ae-92b9-4b27-a85e-826fbc52915a service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:45.799757 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-c88180c7-318b-4a7c-a7f4-9bebed535d03 req-0041e0ae-92b9-4b27-a85e-826fbc52915a service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:45.800360 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-c88180c7-318b-4a7c-a7f4-9bebed535d03 req-0041e0ae-92b9-4b27-a85e-826fbc52915a service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:45.840415 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-c88180c7-318b-4a7c-a7f4-9bebed535d03 req-0041e0ae-92b9-4b27-a85e-826fbc52915a service nova] Creating event network-vif-plugged:fa986f0d-87ea-488c-be0e-10e65cf98dc3 for instance 8e11c130-e748-4008-ad1b-9c959b4d908c on n-h2-850501-14 Oct 04 18:43:45.847802 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-c88180c7-318b-4a7c-a7f4-9bebed535d03 req-0041e0ae-92b9-4b27-a85e-826fbc52915a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093443 Oct 04 18:43:45.853057 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1880/3816] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:43:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:43:46.039788 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8a63668b-7e13-4ff2-9efd-ba64186ba580 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:46.051722 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8a63668b-7e13-4ff2-9efd-ba64186ba580 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/8e11c130-e748-4008-ad1b-9c959b4d908c" status: 200 len: 1308 microversion: 2.1 time: 0.292678 Oct 04 18:43:46.055286 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1937/3817] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:45 2022] GET /compute/v2.1/servers/8e11c130-e748-4008-ad1b-9c959b4d908c => generated 1308 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:46.522732 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ac3274fb-c938-4a21-9a6c-f4414df430c6 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:46.523830 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ac3274fb-c938-4a21-9a6c-f4414df430c6 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] [instance: 3a41fe60-b7d3-4560-af99-292f1478f419] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:46.538812 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ac3274fb-c938-4a21-9a6c-f4414df430c6 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:46.539656 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ac3274fb-c938-4a21-9a6c-f4414df430c6 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:46.542766 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ac3274fb-c938-4a21-9a6c-f4414df430c6 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:46.545336 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ac3274fb-c938-4a21-9a6c-f4414df430c6 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:46.546675 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ac3274fb-c938-4a21-9a6c-f4414df430c6 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:46.548963 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ac3274fb-c938-4a21-9a6c-f4414df430c6 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:46.567573 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:43:46.587068 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b9237e4e-e7a7-466c-b281-09cd65bae2b2 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe253de6b80>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:46.652871 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=19 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:43:46.695000 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b9237e4e-e7a7-466c-b281-09cd65bae2b2 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/images/de3254af-72ec-481e-91a9-f950ae382b0e" status: 200 len: 1453 microversion: 2.1 time: 0.112638 Oct 04 18:43:46.695945 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1938/3818] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:43:46 2022] GET /compute/v2.1/images/de3254af-72ec-481e-91a9-f950ae382b0e => generated 1453 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:43:46.707871 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ac76681e-d686-4a91-98bd-a0fbac11b4f3 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:46.709456 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ac76681e-d686-4a91-98bd-a0fbac11b4f3 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] [instance: 0c9b24a2-ed48-4175-89ef-c8b7971acd39] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:46.712873 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ac3274fb-c938-4a21-9a6c-f4414df430c6 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:46.717979 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ac76681e-d686-4a91-98bd-a0fbac11b4f3 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:46.719102 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ac76681e-d686-4a91-98bd-a0fbac11b4f3 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:46.720236 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ac76681e-d686-4a91-98bd-a0fbac11b4f3 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:46.720989 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ac76681e-d686-4a91-98bd-a0fbac11b4f3 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:46.721828 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ac76681e-d686-4a91-98bd-a0fbac11b4f3 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:46.722328 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ac76681e-d686-4a91-98bd-a0fbac11b4f3 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:46.723196 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ac3274fb-c938-4a21-9a6c-f4414df430c6 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:46.724993 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ac3274fb-c938-4a21-9a6c-f4414df430c6 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:46.726911 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ac3274fb-c938-4a21-9a6c-f4414df430c6 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] 10.222.0.20 "GET /compute/v2.1/servers/3a41fe60-b7d3-4560-af99-292f1478f419" status: 200 len: 1409 microversion: 2.54 time: 0.208561 Oct 04 18:43:46.729646 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1881/3819] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:43:46 2022] GET /compute/v2.1/servers/3a41fe60-b7d3-4560-af99-292f1478f419 => generated 1409 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:43:46.931688 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ac76681e-d686-4a91-98bd-a0fbac11b4f3 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e54eaa927e2848869093e0ec11904929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a4914508df43b0afac3ffdf3b85b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:46.942543 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ac76681e-d686-4a91-98bd-a0fbac11b4f3 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] 10.222.0.20 "GET /compute/v2.1/servers/0c9b24a2-ed48-4175-89ef-c8b7971acd39" status: 200 len: 1401 microversion: 2.1 time: 0.245250 Oct 04 18:43:46.947112 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1939/3820] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:46 2022] GET /compute/v2.1/servers/0c9b24a2-ed48-4175-89ef-c8b7971acd39 => generated 1401 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:47.083336 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-877a25f9-6770-4283-8cc9-ddce1151aa27 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:47.084086 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-877a25f9-6770-4283-8cc9-ddce1151aa27 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 8e11c130-e748-4008-ad1b-9c959b4d908c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:47.096882 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-877a25f9-6770-4283-8cc9-ddce1151aa27 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:47.097656 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-877a25f9-6770-4283-8cc9-ddce1151aa27 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:47.098285 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-877a25f9-6770-4283-8cc9-ddce1151aa27 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:47.099179 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-877a25f9-6770-4283-8cc9-ddce1151aa27 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:47.100084 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-877a25f9-6770-4283-8cc9-ddce1151aa27 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:47.100792 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-877a25f9-6770-4283-8cc9-ddce1151aa27 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:47.291415 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-877a25f9-6770-4283-8cc9-ddce1151aa27 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:47.301038 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-877a25f9-6770-4283-8cc9-ddce1151aa27 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/8e11c130-e748-4008-ad1b-9c959b4d908c" status: 200 len: 1308 microversion: 2.1 time: 0.227293 Oct 04 18:43:47.319288 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1882/3821] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:47 2022] GET /compute/v2.1/servers/8e11c130-e748-4008-ad1b-9c959b4d908c => generated 1308 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:47.711705 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8ed8ecf0-54db-4569-b3fd-323dfaea8d26 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe253e1ca60>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:47.763470 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c80599eb-6887-4347-8974-a77e1025cd17 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:47.770577 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8ed8ecf0-54db-4569-b3fd-323dfaea8d26 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/images/de3254af-72ec-481e-91a9-f950ae382b0e" status: 200 len: 1453 microversion: 2.1 time: 0.062749 Oct 04 18:43:47.771567 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c80599eb-6887-4347-8974-a77e1025cd17 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] [instance: 3a41fe60-b7d3-4560-af99-292f1478f419] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:47.781362 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1940/3822] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:43:47 2022] GET /compute/v2.1/images/de3254af-72ec-481e-91a9-f950ae382b0e => generated 1453 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:47.797377 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c80599eb-6887-4347-8974-a77e1025cd17 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:47.797905 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c80599eb-6887-4347-8974-a77e1025cd17 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:47.798339 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c80599eb-6887-4347-8974-a77e1025cd17 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:47.799084 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c80599eb-6887-4347-8974-a77e1025cd17 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:47.799673 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c80599eb-6887-4347-8974-a77e1025cd17 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:47.805210 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c80599eb-6887-4347-8974-a77e1025cd17 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:47.889304 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c80599eb-6887-4347-8974-a77e1025cd17 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:47.899358 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c80599eb-6887-4347-8974-a77e1025cd17 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:47.901616 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c80599eb-6887-4347-8974-a77e1025cd17 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:47.903715 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c80599eb-6887-4347-8974-a77e1025cd17 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] 10.222.0.20 "GET /compute/v2.1/servers/3a41fe60-b7d3-4560-af99-292f1478f419" status: 200 len: 1409 microversion: 2.54 time: 0.146243 Oct 04 18:43:47.904553 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1883/3823] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:43:47 2022] GET /compute/v2.1/servers/3a41fe60-b7d3-4560-af99-292f1478f419 => generated 1409 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:43:47.976992 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-72c816a8-f03e-466b-8928-6b99c4a6d4e1 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:47.982555 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-30c56bf0-5a8f-4bb9-8745-b0c3182cf3ed req-10129f23-f224-4360-804f-ab666b41e7df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "471125af-1ec3-44b3-bb69-36b04a03fdd5", "name": "network-vif-plugged", "status": "completed", "tag": "ac57cdde-4dc1-45e0-be2d-97a36a8bb374"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:43:47.989541 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-72c816a8-f03e-466b-8928-6b99c4a6d4e1 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] [instance: 0c9b24a2-ed48-4175-89ef-c8b7971acd39] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:48.000834 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-72c816a8-f03e-466b-8928-6b99c4a6d4e1 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:48.004348 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-30c56bf0-5a8f-4bb9-8745-b0c3182cf3ed req-10129f23-f224-4360-804f-ab666b41e7df service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:48.005208 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-72c816a8-f03e-466b-8928-6b99c4a6d4e1 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:48.005820 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-72c816a8-f03e-466b-8928-6b99c4a6d4e1 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:48.006896 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-72c816a8-f03e-466b-8928-6b99c4a6d4e1 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:48.007530 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-72c816a8-f03e-466b-8928-6b99c4a6d4e1 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:48.007957 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-72c816a8-f03e-466b-8928-6b99c4a6d4e1 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:48.013470 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-30c56bf0-5a8f-4bb9-8745-b0c3182cf3ed req-10129f23-f224-4360-804f-ab666b41e7df service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:48.014157 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-30c56bf0-5a8f-4bb9-8745-b0c3182cf3ed req-10129f23-f224-4360-804f-ab666b41e7df service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:48.027651 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-30c56bf0-5a8f-4bb9-8745-b0c3182cf3ed req-10129f23-f224-4360-804f-ab666b41e7df service nova] Creating event network-vif-plugged:ac57cdde-4dc1-45e0-be2d-97a36a8bb374 for instance 471125af-1ec3-44b3-bb69-36b04a03fdd5 on n-h1-850501-14 Oct 04 18:43:48.034797 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-30c56bf0-5a8f-4bb9-8745-b0c3182cf3ed req-10129f23-f224-4360-804f-ab666b41e7df service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055690 Oct 04 18:43:48.035681 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1884/3824] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:43:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:43:48.185068 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-72c816a8-f03e-466b-8928-6b99c4a6d4e1 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e54eaa927e2848869093e0ec11904929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a4914508df43b0afac3ffdf3b85b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:48.195204 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-72c816a8-f03e-466b-8928-6b99c4a6d4e1 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] 10.222.0.20 "GET /compute/v2.1/servers/0c9b24a2-ed48-4175-89ef-c8b7971acd39" status: 200 len: 1401 microversion: 2.1 time: 0.227752 Oct 04 18:43:48.208302 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1941/3825] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:47 2022] GET /compute/v2.1/servers/0c9b24a2-ed48-4175-89ef-c8b7971acd39 => generated 1401 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:48.326392 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-65cd6437-eba9-4f06-aec4-c1359d126700 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:48.327905 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-65cd6437-eba9-4f06-aec4-c1359d126700 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 8e11c130-e748-4008-ad1b-9c959b4d908c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:48.344219 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-65cd6437-eba9-4f06-aec4-c1359d126700 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:48.344714 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-65cd6437-eba9-4f06-aec4-c1359d126700 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:48.345149 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-65cd6437-eba9-4f06-aec4-c1359d126700 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:48.345846 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-65cd6437-eba9-4f06-aec4-c1359d126700 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:48.346327 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-65cd6437-eba9-4f06-aec4-c1359d126700 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:48.346754 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-65cd6437-eba9-4f06-aec4-c1359d126700 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:48.540461 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-65cd6437-eba9-4f06-aec4-c1359d126700 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:48.551268 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-65cd6437-eba9-4f06-aec4-c1359d126700 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/8e11c130-e748-4008-ad1b-9c959b4d908c" status: 200 len: 1308 microversion: 2.1 time: 0.227414 Oct 04 18:43:48.551268 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1885/3826] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:48 2022] GET /compute/v2.1/servers/8e11c130-e748-4008-ad1b-9c959b4d908c => generated 1308 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:48.797196 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-59eb1d58-fdb8-428d-976a-697bee3a97fc tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe253de6b80>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:48.854845 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-59eb1d58-fdb8-428d-976a-697bee3a97fc tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/images/de3254af-72ec-481e-91a9-f950ae382b0e" status: 200 len: 1453 microversion: 2.1 time: 0.062320 Oct 04 18:43:48.855548 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1942/3827] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:43:48 2022] GET /compute/v2.1/images/de3254af-72ec-481e-91a9-f950ae382b0e => generated 1453 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:48.931949 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-037ad817-0616-4f49-a237-cfceeb8ec45a tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:48.932928 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-037ad817-0616-4f49-a237-cfceeb8ec45a tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] [instance: 3a41fe60-b7d3-4560-af99-292f1478f419] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:48.942229 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-037ad817-0616-4f49-a237-cfceeb8ec45a tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:48.942867 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-037ad817-0616-4f49-a237-cfceeb8ec45a tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:48.943372 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-037ad817-0616-4f49-a237-cfceeb8ec45a tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:48.944191 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-037ad817-0616-4f49-a237-cfceeb8ec45a tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:48.944729 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-037ad817-0616-4f49-a237-cfceeb8ec45a tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:48.945355 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-037ad817-0616-4f49-a237-cfceeb8ec45a tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:49.026308 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-037ad817-0616-4f49-a237-cfceeb8ec45a tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:49.037064 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-037ad817-0616-4f49-a237-cfceeb8ec45a tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:49.038658 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-037ad817-0616-4f49-a237-cfceeb8ec45a tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:49.039912 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-037ad817-0616-4f49-a237-cfceeb8ec45a tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] 10.222.0.20 "GET /compute/v2.1/servers/3a41fe60-b7d3-4560-af99-292f1478f419" status: 200 len: 1409 microversion: 2.54 time: 0.112293 Oct 04 18:43:49.042388 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1886/3828] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:43:48 2022] GET /compute/v2.1/servers/3a41fe60-b7d3-4560-af99-292f1478f419 => generated 1409 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:43:49.222114 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-05cedfba-c3d2-4e1b-b158-28d4b3b9ff77 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:49.222742 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-05cedfba-c3d2-4e1b-b158-28d4b3b9ff77 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] [instance: 0c9b24a2-ed48-4175-89ef-c8b7971acd39] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:49.229461 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-05cedfba-c3d2-4e1b-b158-28d4b3b9ff77 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:49.230000 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-05cedfba-c3d2-4e1b-b158-28d4b3b9ff77 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:49.230565 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-05cedfba-c3d2-4e1b-b158-28d4b3b9ff77 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:49.231347 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-05cedfba-c3d2-4e1b-b158-28d4b3b9ff77 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:49.231884 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-05cedfba-c3d2-4e1b-b158-28d4b3b9ff77 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:49.232404 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-05cedfba-c3d2-4e1b-b158-28d4b3b9ff77 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:49.383783 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-05cedfba-c3d2-4e1b-b158-28d4b3b9ff77 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e54eaa927e2848869093e0ec11904929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a4914508df43b0afac3ffdf3b85b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:49.393277 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-05cedfba-c3d2-4e1b-b158-28d4b3b9ff77 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] 10.222.0.20 "GET /compute/v2.1/servers/0c9b24a2-ed48-4175-89ef-c8b7971acd39" status: 200 len: 1401 microversion: 2.1 time: 0.175744 Oct 04 18:43:49.393869 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1943/3829] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:49 2022] GET /compute/v2.1/servers/0c9b24a2-ed48-4175-89ef-c8b7971acd39 => generated 1401 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:49.587346 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-349c69c6-f956-4c60-828d-10f42c4f7e47 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:49.588400 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-349c69c6-f956-4c60-828d-10f42c4f7e47 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 8e11c130-e748-4008-ad1b-9c959b4d908c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:49.595120 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-349c69c6-f956-4c60-828d-10f42c4f7e47 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:49.595832 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-349c69c6-f956-4c60-828d-10f42c4f7e47 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:49.596303 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-349c69c6-f956-4c60-828d-10f42c4f7e47 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:49.597072 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-349c69c6-f956-4c60-828d-10f42c4f7e47 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:49.597535 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-349c69c6-f956-4c60-828d-10f42c4f7e47 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:49.598469 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-349c69c6-f956-4c60-828d-10f42c4f7e47 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:49.826571 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-349c69c6-f956-4c60-828d-10f42c4f7e47 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:49.842269 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-349c69c6-f956-4c60-828d-10f42c4f7e47 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/8e11c130-e748-4008-ad1b-9c959b4d908c" status: 200 len: 1308 microversion: 2.1 time: 0.258619 Oct 04 18:43:49.844004 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1887/3830] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:49 2022] GET /compute/v2.1/servers/8e11c130-e748-4008-ad1b-9c959b4d908c => generated 1308 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:49.880454 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8d4f34c4-23d8-41cf-b49c-02b4888ea1bd tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe253e1cee0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:49.961689 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8d4f34c4-23d8-41cf-b49c-02b4888ea1bd tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/images/de3254af-72ec-481e-91a9-f950ae382b0e" status: 200 len: 1453 microversion: 2.1 time: 0.091297 Oct 04 18:43:49.972667 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1944/3831] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:43:49 2022] GET /compute/v2.1/images/de3254af-72ec-481e-91a9-f950ae382b0e => generated 1453 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:50.072715 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-17109a09-5a3f-4e3d-a927-9f8f099d9816 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:50.073548 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-17109a09-5a3f-4e3d-a927-9f8f099d9816 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] [instance: 3a41fe60-b7d3-4560-af99-292f1478f419] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:50.083803 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-17109a09-5a3f-4e3d-a927-9f8f099d9816 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:50.086105 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-17109a09-5a3f-4e3d-a927-9f8f099d9816 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:50.086886 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-17109a09-5a3f-4e3d-a927-9f8f099d9816 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:50.087826 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-17109a09-5a3f-4e3d-a927-9f8f099d9816 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:50.089063 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-17109a09-5a3f-4e3d-a927-9f8f099d9816 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:50.089780 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-17109a09-5a3f-4e3d-a927-9f8f099d9816 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:50.189719 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-17109a09-5a3f-4e3d-a927-9f8f099d9816 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:50.207394 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-17109a09-5a3f-4e3d-a927-9f8f099d9816 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:50.209795 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-17109a09-5a3f-4e3d-a927-9f8f099d9816 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:50.211372 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-17109a09-5a3f-4e3d-a927-9f8f099d9816 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] 10.222.0.20 "GET /compute/v2.1/servers/3a41fe60-b7d3-4560-af99-292f1478f419" status: 200 len: 1409 microversion: 2.54 time: 0.146553 Oct 04 18:43:50.216246 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1888/3832] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:43:50 2022] GET /compute/v2.1/servers/3a41fe60-b7d3-4560-af99-292f1478f419 => generated 1409 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:43:50.418635 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3f6085f6-692a-4639-aa14-5980eecfe38a tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:50.419795 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3f6085f6-692a-4639-aa14-5980eecfe38a tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] [instance: 0c9b24a2-ed48-4175-89ef-c8b7971acd39] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:50.431964 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3f6085f6-692a-4639-aa14-5980eecfe38a tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:50.433246 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3f6085f6-692a-4639-aa14-5980eecfe38a tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:50.434297 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3f6085f6-692a-4639-aa14-5980eecfe38a tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:50.435874 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3f6085f6-692a-4639-aa14-5980eecfe38a tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:50.436943 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3f6085f6-692a-4639-aa14-5980eecfe38a tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:50.438628 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3f6085f6-692a-4639-aa14-5980eecfe38a tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:50.598774 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3f6085f6-692a-4639-aa14-5980eecfe38a tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e54eaa927e2848869093e0ec11904929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a4914508df43b0afac3ffdf3b85b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:50.606957 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3f6085f6-692a-4639-aa14-5980eecfe38a tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] 10.222.0.20 "GET /compute/v2.1/servers/0c9b24a2-ed48-4175-89ef-c8b7971acd39" status: 200 len: 1401 microversion: 2.1 time: 0.193799 Oct 04 18:43:50.607775 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1945/3833] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:50 2022] GET /compute/v2.1/servers/0c9b24a2-ed48-4175-89ef-c8b7971acd39 => generated 1401 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:50.880739 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-675556dd-9074-45c9-a131-0f4c11b9ed14 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:50.881499 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-675556dd-9074-45c9-a131-0f4c11b9ed14 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 8e11c130-e748-4008-ad1b-9c959b4d908c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:50.888800 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-675556dd-9074-45c9-a131-0f4c11b9ed14 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:50.889469 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-675556dd-9074-45c9-a131-0f4c11b9ed14 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:50.889770 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-675556dd-9074-45c9-a131-0f4c11b9ed14 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:50.890487 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-675556dd-9074-45c9-a131-0f4c11b9ed14 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:50.890941 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-675556dd-9074-45c9-a131-0f4c11b9ed14 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:50.891351 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-675556dd-9074-45c9-a131-0f4c11b9ed14 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:50.982670 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4c785af9-f89d-4ce7-af32-26f83ae93cf2 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe253d85670>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:51.054201 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-4c785af9-f89d-4ce7-af32-26f83ae93cf2 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/images/de3254af-72ec-481e-91a9-f950ae382b0e" status: 200 len: 1453 microversion: 2.1 time: 0.075553 Oct 04 18:43:51.054812 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1946/3834] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:43:50 2022] GET /compute/v2.1/images/de3254af-72ec-481e-91a9-f950ae382b0e => generated 1453 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:51.127790 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-675556dd-9074-45c9-a131-0f4c11b9ed14 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:51.135982 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-675556dd-9074-45c9-a131-0f4c11b9ed14 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/8e11c130-e748-4008-ad1b-9c959b4d908c" status: 200 len: 1488 microversion: 2.1 time: 0.259218 Oct 04 18:43:51.137058 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1889/3835] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:50 2022] GET /compute/v2.1/servers/8e11c130-e748-4008-ad1b-9c959b4d908c => generated 1488 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:43:51.166348 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-02cb332b-f674-48a4-9f55-f51d645834f6 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:51.167440 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-02cb332b-f674-48a4-9f55-f51d645834f6 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 766fe762-0e33-4174-a817-827f782572d9] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:51.174697 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-02cb332b-f674-48a4-9f55-f51d645834f6 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:51.175542 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-02cb332b-f674-48a4-9f55-f51d645834f6 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:51.176429 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-02cb332b-f674-48a4-9f55-f51d645834f6 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:51.177220 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-02cb332b-f674-48a4-9f55-f51d645834f6 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:51.177754 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-02cb332b-f674-48a4-9f55-f51d645834f6 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:51.178494 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-02cb332b-f674-48a4-9f55-f51d645834f6 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:51.247723 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-60068ad1-6381-49bc-8ea5-4e6085a7574d tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:51.248303 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-60068ad1-6381-49bc-8ea5-4e6085a7574d tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] [instance: 3a41fe60-b7d3-4560-af99-292f1478f419] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:51.261722 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-60068ad1-6381-49bc-8ea5-4e6085a7574d tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:51.264019 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-60068ad1-6381-49bc-8ea5-4e6085a7574d tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:51.266240 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-60068ad1-6381-49bc-8ea5-4e6085a7574d tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:51.267860 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-60068ad1-6381-49bc-8ea5-4e6085a7574d tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:51.267860 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-60068ad1-6381-49bc-8ea5-4e6085a7574d tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:51.268581 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-60068ad1-6381-49bc-8ea5-4e6085a7574d tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:51.373765 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-60068ad1-6381-49bc-8ea5-4e6085a7574d tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:51.385568 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-60068ad1-6381-49bc-8ea5-4e6085a7574d tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:51.387224 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-02cb332b-f674-48a4-9f55-f51d645834f6 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:51.395150 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-60068ad1-6381-49bc-8ea5-4e6085a7574d tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:51.408727 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-02cb332b-f674-48a4-9f55-f51d645834f6 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/766fe762-0e33-4174-a817-827f782572d9" status: 200 len: 1488 microversion: 2.1 time: 0.238083 Oct 04 18:43:51.408893 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-60068ad1-6381-49bc-8ea5-4e6085a7574d tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] 10.222.0.20 "GET /compute/v2.1/servers/3a41fe60-b7d3-4560-af99-292f1478f419" status: 200 len: 1409 microversion: 2.54 time: 0.157166 Oct 04 18:43:51.408893 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1890/3836] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:43:51 2022] GET /compute/v2.1/servers/3a41fe60-b7d3-4560-af99-292f1478f419 => generated 1409 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:43:51.409115 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1947/3837] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:51 2022] GET /compute/v2.1/servers/766fe762-0e33-4174-a817-827f782572d9 => generated 1488 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:43:51.451131 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5d71ff63-ecd0-48d2-9159-09b6aaa93ead tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:51.451131 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5d71ff63-ecd0-48d2-9159-09b6aaa93ead tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 8e11c130-e748-4008-ad1b-9c959b4d908c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:51.460038 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5d71ff63-ecd0-48d2-9159-09b6aaa93ead tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:51.460843 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5d71ff63-ecd0-48d2-9159-09b6aaa93ead tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:51.461453 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5d71ff63-ecd0-48d2-9159-09b6aaa93ead tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:51.462157 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5d71ff63-ecd0-48d2-9159-09b6aaa93ead tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:51.462604 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5d71ff63-ecd0-48d2-9159-09b6aaa93ead tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:51.463062 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5d71ff63-ecd0-48d2-9159-09b6aaa93ead tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:51.632185 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-80e86343-b1d8-4cb3-8253-efa9dfd5e3a8 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:51.632975 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-80e86343-b1d8-4cb3-8253-efa9dfd5e3a8 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] [instance: 0c9b24a2-ed48-4175-89ef-c8b7971acd39] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:51.645166 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-80e86343-b1d8-4cb3-8253-efa9dfd5e3a8 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:51.646158 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-80e86343-b1d8-4cb3-8253-efa9dfd5e3a8 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:51.646724 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-80e86343-b1d8-4cb3-8253-efa9dfd5e3a8 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:51.653643 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-80e86343-b1d8-4cb3-8253-efa9dfd5e3a8 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:51.654227 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-80e86343-b1d8-4cb3-8253-efa9dfd5e3a8 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:51.654822 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-80e86343-b1d8-4cb3-8253-efa9dfd5e3a8 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:51.674645 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5d71ff63-ecd0-48d2-9159-09b6aaa93ead tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:51.691367 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5d71ff63-ecd0-48d2-9159-09b6aaa93ead tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/8e11c130-e748-4008-ad1b-9c959b4d908c" status: 200 len: 1488 microversion: 2.1 time: 0.242476 Oct 04 18:43:51.693475 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1891/3838] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:51 2022] GET /compute/v2.1/servers/8e11c130-e748-4008-ad1b-9c959b4d908c => generated 1488 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:51.730895 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-dc66f6a6-fa33-4c2a-be00-a54269d14285 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:51.740956 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-dc66f6a6-fa33-4c2a-be00-a54269d14285 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 8e11c130-e748-4008-ad1b-9c959b4d908c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:51.752955 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dc66f6a6-fa33-4c2a-be00-a54269d14285 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:51.753543 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dc66f6a6-fa33-4c2a-be00-a54269d14285 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:51.754149 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dc66f6a6-fa33-4c2a-be00-a54269d14285 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:51.755163 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dc66f6a6-fa33-4c2a-be00-a54269d14285 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:51.755737 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dc66f6a6-fa33-4c2a-be00-a54269d14285 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:51.756640 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dc66f6a6-fa33-4c2a-be00-a54269d14285 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:51.797235 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-dc66f6a6-fa33-4c2a-be00-a54269d14285 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 8e11c130-e748-4008-ad1b-9c959b4d908c] Going to try to terminate instance {{(pid=123002) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:43:51.896538 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-80e86343-b1d8-4cb3-8253-efa9dfd5e3a8 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e54eaa927e2848869093e0ec11904929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a4914508df43b0afac3ffdf3b85b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:51.909338 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-80e86343-b1d8-4cb3-8253-efa9dfd5e3a8 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] 10.222.0.20 "GET /compute/v2.1/servers/0c9b24a2-ed48-4175-89ef-c8b7971acd39" status: 200 len: 1401 microversion: 2.1 time: 0.282012 Oct 04 18:43:51.924326 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1948/3839] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:51 2022] GET /compute/v2.1/servers/0c9b24a2-ed48-4175-89ef-c8b7971acd39 => generated 1401 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:43:51.933696 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-4c20c5d1-c002-4b7c-b48f-b49699424e38 req-8bd0e643-270e-484a-9bc2-9043ad14f807 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c9b24a2-ed48-4175-89ef-c8b7971acd39", "name": "network-vif-plugged", "status": "completed", "tag": "cc638c0b-6f43-4ac9-b7bb-c32809d8d85f"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:43:51.980414 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-4c20c5d1-c002-4b7c-b48f-b49699424e38 req-8bd0e643-270e-484a-9bc2-9043ad14f807 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:51.981552 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-4c20c5d1-c002-4b7c-b48f-b49699424e38 req-8bd0e643-270e-484a-9bc2-9043ad14f807 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:51.982064 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-4c20c5d1-c002-4b7c-b48f-b49699424e38 req-8bd0e643-270e-484a-9bc2-9043ad14f807 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:51.998290 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-4c20c5d1-c002-4b7c-b48f-b49699424e38 req-8bd0e643-270e-484a-9bc2-9043ad14f807 service nova] Creating event network-vif-plugged:cc638c0b-6f43-4ac9-b7bb-c32809d8d85f for instance 0c9b24a2-ed48-4175-89ef-c8b7971acd39 on n-h2-850501-14 Oct 04 18:43:52.005101 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-4c20c5d1-c002-4b7c-b48f-b49699424e38 req-8bd0e643-270e-484a-9bc2-9043ad14f807 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078718 Oct 04 18:43:52.006031 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1949/3840] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:43:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:43:52.093060 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1891a437-b6b5-4b50-a108-ab7f5e389eb9 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe253e1cee0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:52.181313 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1891a437-b6b5-4b50-a108-ab7f5e389eb9 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/images/de3254af-72ec-481e-91a9-f950ae382b0e" status: 200 len: 1453 microversion: 2.1 time: 0.113379 Oct 04 18:43:52.182502 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1950/3841] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:43:52 2022] GET /compute/v2.1/images/de3254af-72ec-481e-91a9-f950ae382b0e => generated 1453 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:52.241689 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-dc66f6a6-fa33-4c2a-be00-a54269d14285 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8e11c130-e748-4008-ad1b-9c959b4d908c" status: 204 len: 0 microversion: 2.1 time: 0.522340 Oct 04 18:43:52.242620 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1892/3842] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:43:51 2022] DELETE /compute/v2.1/servers/8e11c130-e748-4008-ad1b-9c959b4d908c => generated 0 bytes in 525 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:43:52.254540 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-51f70296-1e77-4146-aca2-5d65e55ccbfd tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:52.256080 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-51f70296-1e77-4146-aca2-5d65e55ccbfd tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 8e11c130-e748-4008-ad1b-9c959b4d908c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:52.270281 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-51f70296-1e77-4146-aca2-5d65e55ccbfd tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:52.272417 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-51f70296-1e77-4146-aca2-5d65e55ccbfd tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:52.278302 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-51f70296-1e77-4146-aca2-5d65e55ccbfd tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:52.279228 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-51f70296-1e77-4146-aca2-5d65e55ccbfd tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:52.279787 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-51f70296-1e77-4146-aca2-5d65e55ccbfd tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:52.281638 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-51f70296-1e77-4146-aca2-5d65e55ccbfd tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:52.450104 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-354e2570-e50b-4c48-9c13-0959838848e9 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:52.452749 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-354e2570-e50b-4c48-9c13-0959838848e9 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] [instance: 3a41fe60-b7d3-4560-af99-292f1478f419] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:52.477881 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-51f70296-1e77-4146-aca2-5d65e55ccbfd tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:52.486539 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-354e2570-e50b-4c48-9c13-0959838848e9 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:52.495458 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-354e2570-e50b-4c48-9c13-0959838848e9 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:52.500595 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-51f70296-1e77-4146-aca2-5d65e55ccbfd tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/8e11c130-e748-4008-ad1b-9c959b4d908c" status: 200 len: 1494 microversion: 2.1 time: 0.249962 Oct 04 18:43:52.502274 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-354e2570-e50b-4c48-9c13-0959838848e9 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:52.503307 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1951/3843] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:52 2022] GET /compute/v2.1/servers/8e11c130-e748-4008-ad1b-9c959b4d908c => generated 1494 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:52.503454 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-354e2570-e50b-4c48-9c13-0959838848e9 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:52.504727 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-354e2570-e50b-4c48-9c13-0959838848e9 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:52.510557 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-354e2570-e50b-4c48-9c13-0959838848e9 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:52.627200 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-354e2570-e50b-4c48-9c13-0959838848e9 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:52.637642 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-354e2570-e50b-4c48-9c13-0959838848e9 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:52.639976 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-354e2570-e50b-4c48-9c13-0959838848e9 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:52.641436 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-354e2570-e50b-4c48-9c13-0959838848e9 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] 10.222.0.20 "GET /compute/v2.1/servers/3a41fe60-b7d3-4560-af99-292f1478f419" status: 200 len: 1409 microversion: 2.54 time: 0.198044 Oct 04 18:43:52.642669 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1893/3844] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:43:52 2022] GET /compute/v2.1/servers/3a41fe60-b7d3-4560-af99-292f1478f419 => generated 1409 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:43:52.938708 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-67133746-08ae-4e67-8d1e-8d2a3eeeb416 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:52.939785 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-67133746-08ae-4e67-8d1e-8d2a3eeeb416 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] [instance: 0c9b24a2-ed48-4175-89ef-c8b7971acd39] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:52.948303 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-67133746-08ae-4e67-8d1e-8d2a3eeeb416 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:52.949823 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-67133746-08ae-4e67-8d1e-8d2a3eeeb416 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:52.949823 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-67133746-08ae-4e67-8d1e-8d2a3eeeb416 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:52.950962 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-67133746-08ae-4e67-8d1e-8d2a3eeeb416 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:52.951304 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-67133746-08ae-4e67-8d1e-8d2a3eeeb416 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:52.952518 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-67133746-08ae-4e67-8d1e-8d2a3eeeb416 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:53.126597 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-67133746-08ae-4e67-8d1e-8d2a3eeeb416 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e54eaa927e2848869093e0ec11904929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a4914508df43b0afac3ffdf3b85b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:53.136884 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-67133746-08ae-4e67-8d1e-8d2a3eeeb416 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] 10.222.0.20 "GET /compute/v2.1/servers/0c9b24a2-ed48-4175-89ef-c8b7971acd39" status: 200 len: 1401 microversion: 2.1 time: 0.206628 Oct 04 18:43:53.137525 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1952/3845] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:52 2022] GET /compute/v2.1/servers/0c9b24a2-ed48-4175-89ef-c8b7971acd39 => generated 1401 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:53.204630 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-fd6ec753-c314-4c0f-8652-16fe93737fd9 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe25d1cc790>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:53.270996 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-fd6ec753-c314-4c0f-8652-16fe93737fd9 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/images/de3254af-72ec-481e-91a9-f950ae382b0e" status: 200 len: 1453 microversion: 2.1 time: 0.072113 Oct 04 18:43:53.272997 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1894/3846] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:43:53 2022] GET /compute/v2.1/images/de3254af-72ec-481e-91a9-f950ae382b0e => generated 1453 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:53.531283 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3430d3c4-e762-45ac-ae09-c7a3e200b3fe tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:53.532824 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3430d3c4-e762-45ac-ae09-c7a3e200b3fe tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 8e11c130-e748-4008-ad1b-9c959b4d908c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:53.540908 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3430d3c4-e762-45ac-ae09-c7a3e200b3fe tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:53.713908 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3430d3c4-e762-45ac-ae09-c7a3e200b3fe tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:53.713908 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3430d3c4-e762-45ac-ae09-c7a3e200b3fe tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:53.713908 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3430d3c4-e762-45ac-ae09-c7a3e200b3fe tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:53.713908 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3430d3c4-e762-45ac-ae09-c7a3e200b3fe tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:53.713908 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3430d3c4-e762-45ac-ae09-c7a3e200b3fe tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:53.715575 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b54147d9-2dfd-4f30-acb1-56da11b00940 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:53.715575 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b54147d9-2dfd-4f30-acb1-56da11b00940 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] [instance: 3a41fe60-b7d3-4560-af99-292f1478f419] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:53.715575 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b54147d9-2dfd-4f30-acb1-56da11b00940 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:53.715575 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b54147d9-2dfd-4f30-acb1-56da11b00940 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:53.715575 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b54147d9-2dfd-4f30-acb1-56da11b00940 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:53.715575 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b54147d9-2dfd-4f30-acb1-56da11b00940 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:53.715575 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b54147d9-2dfd-4f30-acb1-56da11b00940 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:53.715575 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b54147d9-2dfd-4f30-acb1-56da11b00940 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:53.716368 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3430d3c4-e762-45ac-ae09-c7a3e200b3fe tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:53.716368 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3430d3c4-e762-45ac-ae09-c7a3e200b3fe tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/8e11c130-e748-4008-ad1b-9c959b4d908c" status: 200 len: 1494 microversion: 2.1 time: 0.181805 Oct 04 18:43:53.716368 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1953/3847] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:53 2022] GET /compute/v2.1/servers/8e11c130-e748-4008-ad1b-9c959b4d908c => generated 1494 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:53.755165 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b54147d9-2dfd-4f30-acb1-56da11b00940 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:53.763883 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b54147d9-2dfd-4f30-acb1-56da11b00940 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:53.766131 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b54147d9-2dfd-4f30-acb1-56da11b00940 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:53.767385 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b54147d9-2dfd-4f30-acb1-56da11b00940 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] 10.222.0.20 "GET /compute/v2.1/servers/3a41fe60-b7d3-4560-af99-292f1478f419" status: 200 len: 1409 microversion: 2.54 time: 0.097453 Oct 04 18:43:53.767945 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1895/3848] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:43:53 2022] GET /compute/v2.1/servers/3a41fe60-b7d3-4560-af99-292f1478f419 => generated 1409 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:43:54.163015 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4538573a-9295-4efd-927d-68ca5ae3ce3e tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:54.163597 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-4538573a-9295-4efd-927d-68ca5ae3ce3e tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] [instance: 0c9b24a2-ed48-4175-89ef-c8b7971acd39] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:54.171330 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4538573a-9295-4efd-927d-68ca5ae3ce3e tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:54.201375 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4538573a-9295-4efd-927d-68ca5ae3ce3e tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:54.201375 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4538573a-9295-4efd-927d-68ca5ae3ce3e tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:54.201375 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4538573a-9295-4efd-927d-68ca5ae3ce3e tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:54.201375 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4538573a-9295-4efd-927d-68ca5ae3ce3e tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:54.201375 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4538573a-9295-4efd-927d-68ca5ae3ce3e tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:54.294900 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-209b18f3-02c6-42cc-8703-87754db70a40 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe25d1cc790>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:54.322786 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-4538573a-9295-4efd-927d-68ca5ae3ce3e tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e54eaa927e2848869093e0ec11904929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a4914508df43b0afac3ffdf3b85b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:54.331498 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-4538573a-9295-4efd-927d-68ca5ae3ce3e tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] 10.222.0.20 "GET /compute/v2.1/servers/0c9b24a2-ed48-4175-89ef-c8b7971acd39" status: 200 len: 1401 microversion: 2.1 time: 0.172894 Oct 04 18:43:54.332153 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1954/3849] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:54 2022] GET /compute/v2.1/servers/0c9b24a2-ed48-4175-89ef-c8b7971acd39 => generated 1401 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:54.367847 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-209b18f3-02c6-42cc-8703-87754db70a40 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/images/de3254af-72ec-481e-91a9-f950ae382b0e" status: 200 len: 1453 microversion: 2.1 time: 0.058301 Oct 04 18:43:54.367847 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1896/3850] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:43:54 2022] GET /compute/v2.1/images/de3254af-72ec-481e-91a9-f950ae382b0e => generated 1453 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:43:54.734957 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8233233f-8ea4-4e17-a8ab-67c0b74c232a tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:54.735570 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8233233f-8ea4-4e17-a8ab-67c0b74c232a tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 8e11c130-e748-4008-ad1b-9c959b4d908c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:54.750054 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8233233f-8ea4-4e17-a8ab-67c0b74c232a tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:54.750984 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8233233f-8ea4-4e17-a8ab-67c0b74c232a tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:54.751615 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8233233f-8ea4-4e17-a8ab-67c0b74c232a tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:54.752525 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8233233f-8ea4-4e17-a8ab-67c0b74c232a tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:54.753148 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8233233f-8ea4-4e17-a8ab-67c0b74c232a tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:54.753877 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8233233f-8ea4-4e17-a8ab-67c0b74c232a tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:54.758971 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=100 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:43:54.799148 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-10286279-6e34-48c9-b115-33ccf49b1233 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:54.801402 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-10286279-6e34-48c9-b115-33ccf49b1233 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] [instance: 3a41fe60-b7d3-4560-af99-292f1478f419] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:54.815096 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-10286279-6e34-48c9-b115-33ccf49b1233 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:54.816982 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-10286279-6e34-48c9-b115-33ccf49b1233 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:54.817723 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-10286279-6e34-48c9-b115-33ccf49b1233 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:54.819052 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-10286279-6e34-48c9-b115-33ccf49b1233 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:54.819761 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-10286279-6e34-48c9-b115-33ccf49b1233 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:54.820550 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-10286279-6e34-48c9-b115-33ccf49b1233 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:54.956822 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-10286279-6e34-48c9-b115-33ccf49b1233 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:54.970982 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-10286279-6e34-48c9-b115-33ccf49b1233 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:54.976024 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-10286279-6e34-48c9-b115-33ccf49b1233 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:54.977552 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-10286279-6e34-48c9-b115-33ccf49b1233 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] 10.222.0.20 "GET /compute/v2.1/servers/3a41fe60-b7d3-4560-af99-292f1478f419" status: 200 len: 1409 microversion: 2.54 time: 0.187472 Oct 04 18:43:54.991590 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1897/3851] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:43:54 2022] GET /compute/v2.1/servers/3a41fe60-b7d3-4560-af99-292f1478f419 => generated 1409 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:43:55.064638 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8233233f-8ea4-4e17-a8ab-67c0b74c232a tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:55.074378 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8233233f-8ea4-4e17-a8ab-67c0b74c232a tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/8e11c130-e748-4008-ad1b-9c959b4d908c" status: 200 len: 1494 microversion: 2.1 time: 0.343219 Oct 04 18:43:55.076170 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1955/3852] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:54 2022] GET /compute/v2.1/servers/8e11c130-e748-4008-ad1b-9c959b4d908c => generated 1494 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:55.359307 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-38970dcd-53e2-4cf5-b6f2-b6d0d4ce4d9d tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:55.365828 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b933e606-f347-4c37-b499-600a9ebcf87b tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe253de8d30>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:55.372131 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-38970dcd-53e2-4cf5-b6f2-b6d0d4ce4d9d tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] [instance: 0c9b24a2-ed48-4175-89ef-c8b7971acd39] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:55.384386 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-38970dcd-53e2-4cf5-b6f2-b6d0d4ce4d9d tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:55.385212 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-38970dcd-53e2-4cf5-b6f2-b6d0d4ce4d9d tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:55.385840 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-38970dcd-53e2-4cf5-b6f2-b6d0d4ce4d9d tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:55.386722 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-38970dcd-53e2-4cf5-b6f2-b6d0d4ce4d9d tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:55.387338 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-38970dcd-53e2-4cf5-b6f2-b6d0d4ce4d9d tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:55.387924 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-38970dcd-53e2-4cf5-b6f2-b6d0d4ce4d9d tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:55.446614 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b933e606-f347-4c37-b499-600a9ebcf87b tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/images/de3254af-72ec-481e-91a9-f950ae382b0e" status: 200 len: 1453 microversion: 2.1 time: 0.084554 Oct 04 18:43:55.456480 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1956/3853] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:43:55 2022] GET /compute/v2.1/images/de3254af-72ec-481e-91a9-f950ae382b0e => generated 1453 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:55.621792 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-75ecbbd8-7f2d-4b11-813b-2598e35da5b1 req-d663d667-8491-4074-84a8-edd0a4215b17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e11c130-e748-4008-ad1b-9c959b4d908c", "name": "network-vif-deleted", "tag": "fa986f0d-87ea-488c-be0e-10e65cf98dc3"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:43:55.635652 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-75ecbbd8-7f2d-4b11-813b-2598e35da5b1 req-d663d667-8491-4074-84a8-edd0a4215b17 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:55.636452 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-75ecbbd8-7f2d-4b11-813b-2598e35da5b1 req-d663d667-8491-4074-84a8-edd0a4215b17 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:55.638008 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-75ecbbd8-7f2d-4b11-813b-2598e35da5b1 req-d663d667-8491-4074-84a8-edd0a4215b17 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:55.659466 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-75ecbbd8-7f2d-4b11-813b-2598e35da5b1 req-d663d667-8491-4074-84a8-edd0a4215b17 service nova] Creating event network-vif-deleted:fa986f0d-87ea-488c-be0e-10e65cf98dc3 for instance 8e11c130-e748-4008-ad1b-9c959b4d908c on n-h2-850501-14 Oct 04 18:43:55.665112 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-75ecbbd8-7f2d-4b11-813b-2598e35da5b1 req-d663d667-8491-4074-84a8-edd0a4215b17 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050937 Oct 04 18:43:55.670571 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1957/3854] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:43:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:43:55.763411 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-38970dcd-53e2-4cf5-b6f2-b6d0d4ce4d9d tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e54eaa927e2848869093e0ec11904929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a4914508df43b0afac3ffdf3b85b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:55.774376 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:43:55.783647 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-38970dcd-53e2-4cf5-b6f2-b6d0d4ce4d9d tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] 10.222.0.20 "GET /compute/v2.1/servers/0c9b24a2-ed48-4175-89ef-c8b7971acd39" status: 200 len: 1587 microversion: 2.1 time: 0.429128 Oct 04 18:43:55.789641 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1898/3855] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:55 2022] GET /compute/v2.1/servers/0c9b24a2-ed48-4175-89ef-c8b7971acd39 => generated 1587 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:55.822650 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5e5ffb4d-eaaa-4a69-ba6e-01bea3dde3ba tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:55.824213 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5e5ffb4d-eaaa-4a69-ba6e-01bea3dde3ba tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] [instance: 0c9b24a2-ed48-4175-89ef-c8b7971acd39] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:55.840535 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5e5ffb4d-eaaa-4a69-ba6e-01bea3dde3ba tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:55.843878 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5e5ffb4d-eaaa-4a69-ba6e-01bea3dde3ba tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:55.843878 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5e5ffb4d-eaaa-4a69-ba6e-01bea3dde3ba tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:55.843878 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5e5ffb4d-eaaa-4a69-ba6e-01bea3dde3ba tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:55.843878 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5e5ffb4d-eaaa-4a69-ba6e-01bea3dde3ba tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:55.843878 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5e5ffb4d-eaaa-4a69-ba6e-01bea3dde3ba tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:55.974232 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5e5ffb4d-eaaa-4a69-ba6e-01bea3dde3ba tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] 10.222.0.20 "GET /compute/v2.1/servers/0c9b24a2-ed48-4175-89ef-c8b7971acd39/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.161382 Oct 04 18:43:55.974833 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1958/3856] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Oct 4 18:43:55 2022] GET /compute/v2.1/servers/0c9b24a2-ed48-4175-89ef-c8b7971acd39/os-interface => generated 284 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:43:56.005683 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-dc7e412d-31a8-4fc0-984d-ebd027412786 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:56.006310 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-dc7e412d-31a8-4fc0-984d-ebd027412786 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] [instance: 3a41fe60-b7d3-4560-af99-292f1478f419] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:56.014626 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dc7e412d-31a8-4fc0-984d-ebd027412786 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:56.015693 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dc7e412d-31a8-4fc0-984d-ebd027412786 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:56.016389 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dc7e412d-31a8-4fc0-984d-ebd027412786 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:56.017823 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dc7e412d-31a8-4fc0-984d-ebd027412786 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:56.018980 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dc7e412d-31a8-4fc0-984d-ebd027412786 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:56.019651 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dc7e412d-31a8-4fc0-984d-ebd027412786 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:56.103110 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-330e7924-34bd-434e-a19f-46f9c9666b22 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:56.104856 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-330e7924-34bd-434e-a19f-46f9c9666b22 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 8e11c130-e748-4008-ad1b-9c959b4d908c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:56.117142 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-330e7924-34bd-434e-a19f-46f9c9666b22 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:56.118040 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-330e7924-34bd-434e-a19f-46f9c9666b22 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:56.118814 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-330e7924-34bd-434e-a19f-46f9c9666b22 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:56.119910 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-330e7924-34bd-434e-a19f-46f9c9666b22 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:56.121028 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-330e7924-34bd-434e-a19f-46f9c9666b22 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:56.121691 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-330e7924-34bd-434e-a19f-46f9c9666b22 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:56.137861 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-dc7e412d-31a8-4fc0-984d-ebd027412786 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:56.149529 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-dc7e412d-31a8-4fc0-984d-ebd027412786 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:56.151174 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-dc7e412d-31a8-4fc0-984d-ebd027412786 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:56.152763 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-dc7e412d-31a8-4fc0-984d-ebd027412786 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] 10.222.0.20 "GET /compute/v2.1/servers/3a41fe60-b7d3-4560-af99-292f1478f419" status: 200 len: 1409 microversion: 2.54 time: 0.151005 Oct 04 18:43:56.153917 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1899/3857] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:43:56 2022] GET /compute/v2.1/servers/3a41fe60-b7d3-4560-af99-292f1478f419 => generated 1409 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:43:56.183907 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-330e7924-34bd-434e-a19f-46f9c9666b22 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:56.185303 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-330e7924-34bd-434e-a19f-46f9c9666b22 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:56.186920 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-330e7924-34bd-434e-a19f-46f9c9666b22 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:56.188048 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-330e7924-34bd-434e-a19f-46f9c9666b22 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lazy-loading 'fault' on Instance uuid 8e11c130-e748-4008-ad1b-9c959b4d908c {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:43:56.271901 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-330e7924-34bd-434e-a19f-46f9c9666b22 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:56.295035 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-330e7924-34bd-434e-a19f-46f9c9666b22 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/8e11c130-e748-4008-ad1b-9c959b4d908c" status: 200 len: 1298 microversion: 2.1 time: 0.186089 Oct 04 18:43:56.310428 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1959/3858] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:56 2022] GET /compute/v2.1/servers/8e11c130-e748-4008-ad1b-9c959b4d908c => generated 1298 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:56.463961 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-281eca4f-66fa-4aa3-bc45-658eb840c111 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe258baa4c0>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:56.537945 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-281eca4f-66fa-4aa3-bc45-658eb840c111 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/images/de3254af-72ec-481e-91a9-f950ae382b0e" status: 200 len: 1453 microversion: 2.1 time: 0.077646 Oct 04 18:43:56.539905 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1900/3859] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:43:56 2022] GET /compute/v2.1/images/de3254af-72ec-481e-91a9-f950ae382b0e => generated 1453 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:57.184879 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1f90dc9e-5612-45fd-b03b-d27442d36637 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:57.186137 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1f90dc9e-5612-45fd-b03b-d27442d36637 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] [instance: 3a41fe60-b7d3-4560-af99-292f1478f419] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:57.203539 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1f90dc9e-5612-45fd-b03b-d27442d36637 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:57.209610 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1f90dc9e-5612-45fd-b03b-d27442d36637 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:57.210351 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1f90dc9e-5612-45fd-b03b-d27442d36637 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:57.211662 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1f90dc9e-5612-45fd-b03b-d27442d36637 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:57.214225 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1f90dc9e-5612-45fd-b03b-d27442d36637 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:57.214874 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1f90dc9e-5612-45fd-b03b-d27442d36637 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:57.328746 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1f90dc9e-5612-45fd-b03b-d27442d36637 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:57.331024 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0625ad39-424c-48ef-b6a4-4a6d1df1d513 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:57.331768 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0625ad39-424c-48ef-b6a4-4a6d1df1d513 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 8e11c130-e748-4008-ad1b-9c959b4d908c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:57.338547 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1f90dc9e-5612-45fd-b03b-d27442d36637 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:57.340126 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1f90dc9e-5612-45fd-b03b-d27442d36637 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:57.341531 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1f90dc9e-5612-45fd-b03b-d27442d36637 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] 10.222.0.20 "GET /compute/v2.1/servers/3a41fe60-b7d3-4560-af99-292f1478f419" status: 200 len: 1409 microversion: 2.54 time: 0.162134 Oct 04 18:43:57.342302 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0625ad39-424c-48ef-b6a4-4a6d1df1d513 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:57.342927 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0625ad39-424c-48ef-b6a4-4a6d1df1d513 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:57.351954 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0625ad39-424c-48ef-b6a4-4a6d1df1d513 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:57.352797 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0625ad39-424c-48ef-b6a4-4a6d1df1d513 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:57.353292 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0625ad39-424c-48ef-b6a4-4a6d1df1d513 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:57.353830 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0625ad39-424c-48ef-b6a4-4a6d1df1d513 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:57.353966 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1960/3860] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:43:57 2022] GET /compute/v2.1/servers/3a41fe60-b7d3-4560-af99-292f1478f419 => generated 1409 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:43:57.386775 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-0625ad39-424c-48ef-b6a4-4a6d1df1d513 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] HTTP exception thrown: Instance 8e11c130-e748-4008-ad1b-9c959b4d908c could not be found. Oct 04 18:43:57.391686 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0625ad39-424c-48ef-b6a4-4a6d1df1d513 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Request method failure captured: Oct 04 18:43:57.391686 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/8e11c130-e748-4008-ad1b-9c959b4d908c HTTP/1.1 Oct 04 18:43:57.391686 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:43:57.391686 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:43:57.391686 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:43:57.391686 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:43:57.391686 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:43:57.391686 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:43:57.391686 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:43:57.391686 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:43:57.391686 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH5kaFyiFSIO0ZP4CMGEO428dJiNuEG6R-LLS8mNsVetgcf6w0D7DIrYZ_G7YOzpJ5huW8oCnx3-jlxIKVdxxsS18taUnXx6Xt5KnL4IkhJLGYxbDrAUBLCXM7M3o65rqEELwzRRnK71NdjnupluHpvvCSPBSNhy32oTLBkDAxSrOgs Oct 04 18:43:57.391686 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:43:57.391686 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:43:57.391686 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:43:57.391686 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:43:57.391686 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:43:57.391686 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:43:57.391686 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: a9046b9540144eeba512d79438635ea8 Oct 04 18:43:57.391686 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServersTestJSON-380527700 Oct 04 18:43:57.391686 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:43:57.391686 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:43:57.391686 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a9046b9540144eeba512d79438635ea8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a9046b9540144eeba512d79438635ea8", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a9046b9540144eeba512d79438635ea8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a9046b9540144eeba512d79438635ea8"}]}] Oct 04 18:43:57.391686 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServersTestJSON-380527700 Oct 04 18:43:57.391686 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: a9046b9540144eeba512d79438635ea8 Oct 04 18:43:57.391686 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServersTestJSON-380527700 Oct 04 18:43:57.391686 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServersTestJSON-380527700-project Oct 04 18:43:57.391686 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:43:57.391686 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:43:57.391686 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 8a6c3725b31449d5bf1ff757ff66c8d7 Oct 04 18:43:57.391686 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServersTestJSON-380527700-project Oct 04 18:43:57.391686 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:43:57.391686 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 8e11c130-e748-4008-ad1b-9c959b4d908c could not be found. Oct 04 18:43:57.391686 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '8e11c130-e748-4008-ad1b-9c959b4d908c'} Oct 04 18:43:57.391686 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:43:57.391686 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:43:57.391686 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:43:57.391686 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:43:57.391686 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:43:57.391686 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:43:57.391686 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:43:57.391686 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:43:57.391686 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:43:57.391686 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:43:57.391686 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e11c130-e748-4008-ad1b-9c959b4d908c could not be found. Oct 04 18:43:57.391686 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:43:57.391686 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:43:57.391686 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:43:57.391686 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:43:57.391686 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:43:57.391686 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:43:57.391686 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:43:57.391686 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:43:57.391686 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:43:57.391686 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:43:57.391686 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:43:57.391686 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:43:57.391686 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:43:57.391686 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:43:57.391686 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:43:57.391686 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:43:57.391686 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e11c130-e748-4008-ad1b-9c959b4d908c could not be found. Oct 04 18:43:57.391686 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:43:57.391686 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:43:57.391686 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:43:57.391686 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:43:57.397016 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:43:57.397016 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:43:57.397016 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:43:57.397016 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:43:57.397016 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e11c130-e748-4008-ad1b-9c959b4d908c could not be found. Oct 04 18:43:57.397016 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:43:57.397016 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0625ad39-424c-48ef-b6a4-4a6d1df1d513 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Returning 404 to user: Instance 8e11c130-e748-4008-ad1b-9c959b4d908c could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:43:57.397016 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0625ad39-424c-48ef-b6a4-4a6d1df1d513 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/8e11c130-e748-4008-ad1b-9c959b4d908c" status: 404 len: 111 microversion: 2.1 time: 0.066929 Oct 04 18:43:57.400008 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1901/3861] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:57 2022] GET /compute/v2.1/servers/8e11c130-e748-4008-ad1b-9c959b4d908c => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:43:57.409785 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3f6d8387-8b3c-4770-89f3-c335a2809b7e tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:57.410426 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3f6d8387-8b3c-4770-89f3-c335a2809b7e tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 766fe762-0e33-4174-a817-827f782572d9] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:57.417191 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3f6d8387-8b3c-4770-89f3-c335a2809b7e tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:57.418034 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3f6d8387-8b3c-4770-89f3-c335a2809b7e tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:57.418648 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3f6d8387-8b3c-4770-89f3-c335a2809b7e tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:57.420087 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3f6d8387-8b3c-4770-89f3-c335a2809b7e tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:57.421470 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3f6d8387-8b3c-4770-89f3-c335a2809b7e tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:57.422122 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3f6d8387-8b3c-4770-89f3-c335a2809b7e tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:57.458271 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3f6d8387-8b3c-4770-89f3-c335a2809b7e tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 766fe762-0e33-4174-a817-827f782572d9] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:43:57.557593 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9d79af51-4b90-4761-82c4-8734b0400612 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe25d19f700>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:57.618096 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9d79af51-4b90-4761-82c4-8734b0400612 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/images/de3254af-72ec-481e-91a9-f950ae382b0e" status: 200 len: 1453 microversion: 2.1 time: 0.064616 Oct 04 18:43:57.627044 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1902/3862] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:43:57 2022] GET /compute/v2.1/images/de3254af-72ec-481e-91a9-f950ae382b0e => generated 1453 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:57.741459 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3f6d8387-8b3c-4770-89f3-c335a2809b7e tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "DELETE /compute/v2.1/servers/766fe762-0e33-4174-a817-827f782572d9" status: 204 len: 0 microversion: 2.1 time: 0.336469 Oct 04 18:43:57.746933 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1961/3863] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:43:57 2022] DELETE /compute/v2.1/servers/766fe762-0e33-4174-a817-827f782572d9 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:43:57.752687 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-31ba7eb4-ae67-4731-8c35-fe24a71d9ec5 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:57.755213 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-31ba7eb4-ae67-4731-8c35-fe24a71d9ec5 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 766fe762-0e33-4174-a817-827f782572d9] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:57.765338 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-31ba7eb4-ae67-4731-8c35-fe24a71d9ec5 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:57.765834 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-31ba7eb4-ae67-4731-8c35-fe24a71d9ec5 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:57.766277 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-31ba7eb4-ae67-4731-8c35-fe24a71d9ec5 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:57.766992 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-31ba7eb4-ae67-4731-8c35-fe24a71d9ec5 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:57.767474 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-31ba7eb4-ae67-4731-8c35-fe24a71d9ec5 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:57.767878 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-31ba7eb4-ae67-4731-8c35-fe24a71d9ec5 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:57.999552 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-31ba7eb4-ae67-4731-8c35-fe24a71d9ec5 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:58.009647 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-31ba7eb4-ae67-4731-8c35-fe24a71d9ec5 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/766fe762-0e33-4174-a817-827f782572d9" status: 200 len: 1494 microversion: 2.1 time: 0.261281 Oct 04 18:43:58.023122 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1903/3864] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:57 2022] GET /compute/v2.1/servers/766fe762-0e33-4174-a817-827f782572d9 => generated 1494 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:58.095739 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e47de9c3-0f86-414f-9b0d-eb9941afede6 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:58.097003 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-a355cee8-352c-4602-8299-f210802fa471 req-5d1bc9f8-8e5e-40d4-90be-a5d564e13a7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c9b24a2-ed48-4175-89ef-c8b7971acd39", "tag": "cc638c0b-6f43-4ac9-b7bb-c32809d8d85f"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:43:58.099394 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e47de9c3-0f86-414f-9b0d-eb9941afede6 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] [instance: 0c9b24a2-ed48-4175-89ef-c8b7971acd39] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:58.112773 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-a355cee8-352c-4602-8299-f210802fa471 req-5d1bc9f8-8e5e-40d4-90be-a5d564e13a7a service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:58.113260 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-a355cee8-352c-4602-8299-f210802fa471 req-5d1bc9f8-8e5e-40d4-90be-a5d564e13a7a service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:58.113829 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-a355cee8-352c-4602-8299-f210802fa471 req-5d1bc9f8-8e5e-40d4-90be-a5d564e13a7a service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:58.115619 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e47de9c3-0f86-414f-9b0d-eb9941afede6 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:58.116347 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e47de9c3-0f86-414f-9b0d-eb9941afede6 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:58.119385 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e47de9c3-0f86-414f-9b0d-eb9941afede6 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:58.119385 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e47de9c3-0f86-414f-9b0d-eb9941afede6 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:58.120738 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e47de9c3-0f86-414f-9b0d-eb9941afede6 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:58.122753 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e47de9c3-0f86-414f-9b0d-eb9941afede6 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:58.132586 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-a355cee8-352c-4602-8299-f210802fa471 req-5d1bc9f8-8e5e-40d4-90be-a5d564e13a7a service nova] Creating event network-changed:cc638c0b-6f43-4ac9-b7bb-c32809d8d85f for instance 0c9b24a2-ed48-4175-89ef-c8b7971acd39 on n-h2-850501-14 Oct 04 18:43:58.154898 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-a355cee8-352c-4602-8299-f210802fa471 req-5d1bc9f8-8e5e-40d4-90be-a5d564e13a7a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061332 Oct 04 18:43:58.157328 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1904/3865] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:43:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:43:58.320358 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e47de9c3-0f86-414f-9b0d-eb9941afede6 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e54eaa927e2848869093e0ec11904929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a4914508df43b0afac3ffdf3b85b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:58.329916 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e47de9c3-0f86-414f-9b0d-eb9941afede6 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] 10.222.0.20 "GET /compute/v2.1/servers/0c9b24a2-ed48-4175-89ef-c8b7971acd39" status: 200 len: 1587 microversion: 2.1 time: 0.239176 Oct 04 18:43:58.332152 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1962/3866] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:58 2022] GET /compute/v2.1/servers/0c9b24a2-ed48-4175-89ef-c8b7971acd39 => generated 1587 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:58.371095 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a09c1f05-b828-415e-ad8e-8d78c3009ab9 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:58.371809 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a09c1f05-b828-415e-ad8e-8d78c3009ab9 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] [instance: 3a41fe60-b7d3-4560-af99-292f1478f419] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:58.399637 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a09c1f05-b828-415e-ad8e-8d78c3009ab9 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:58.403718 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a09c1f05-b828-415e-ad8e-8d78c3009ab9 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:58.404213 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a09c1f05-b828-415e-ad8e-8d78c3009ab9 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:58.405011 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a09c1f05-b828-415e-ad8e-8d78c3009ab9 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:58.405481 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a09c1f05-b828-415e-ad8e-8d78c3009ab9 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:58.409806 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a09c1f05-b828-415e-ad8e-8d78c3009ab9 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:58.507437 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a09c1f05-b828-415e-ad8e-8d78c3009ab9 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:58.526362 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a09c1f05-b828-415e-ad8e-8d78c3009ab9 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:58.527731 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a09c1f05-b828-415e-ad8e-8d78c3009ab9 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:58.528984 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a09c1f05-b828-415e-ad8e-8d78c3009ab9 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] 10.222.0.20 "GET /compute/v2.1/servers/3a41fe60-b7d3-4560-af99-292f1478f419" status: 200 len: 1409 microversion: 2.54 time: 0.162319 Oct 04 18:43:58.532735 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1905/3867] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:43:58 2022] GET /compute/v2.1/servers/3a41fe60-b7d3-4560-af99-292f1478f419 => generated 1409 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:43:58.638294 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-20253c22-c6b2-4eed-a747-b2bad2416fd1 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe253de68b0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:58.710816 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-20253c22-c6b2-4eed-a747-b2bad2416fd1 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/images/de3254af-72ec-481e-91a9-f950ae382b0e" status: 200 len: 1453 microversion: 2.1 time: 0.079663 Oct 04 18:43:58.716042 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1963/3868] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:43:58 2022] GET /compute/v2.1/images/de3254af-72ec-481e-91a9-f950ae382b0e => generated 1453 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:59.037208 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-de290c2e-9b2a-47d7-b9ac-c8b69d84c333 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:59.038489 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-de290c2e-9b2a-47d7-b9ac-c8b69d84c333 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 766fe762-0e33-4174-a817-827f782572d9] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:59.046751 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-de290c2e-9b2a-47d7-b9ac-c8b69d84c333 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:59.048793 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-de290c2e-9b2a-47d7-b9ac-c8b69d84c333 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:59.048793 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-de290c2e-9b2a-47d7-b9ac-c8b69d84c333 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:59.049148 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-de290c2e-9b2a-47d7-b9ac-c8b69d84c333 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:59.049624 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-de290c2e-9b2a-47d7-b9ac-c8b69d84c333 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:59.050160 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-de290c2e-9b2a-47d7-b9ac-c8b69d84c333 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:59.265477 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-de290c2e-9b2a-47d7-b9ac-c8b69d84c333 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:59.274487 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-de290c2e-9b2a-47d7-b9ac-c8b69d84c333 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/766fe762-0e33-4174-a817-827f782572d9" status: 200 len: 1494 microversion: 2.1 time: 0.241347 Oct 04 18:43:59.294526 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1906/3869] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:59 2022] GET /compute/v2.1/servers/766fe762-0e33-4174-a817-827f782572d9 => generated 1494 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:59.557188 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e6f66eaf-bdf6-4546-9a3b-f9a7e1f98462 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:59.561514 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e6f66eaf-bdf6-4546-9a3b-f9a7e1f98462 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] [instance: 3a41fe60-b7d3-4560-af99-292f1478f419] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:59.569523 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e6f66eaf-bdf6-4546-9a3b-f9a7e1f98462 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:59.570396 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e6f66eaf-bdf6-4546-9a3b-f9a7e1f98462 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:59.571338 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e6f66eaf-bdf6-4546-9a3b-f9a7e1f98462 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:59.572337 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e6f66eaf-bdf6-4546-9a3b-f9a7e1f98462 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:59.573284 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e6f66eaf-bdf6-4546-9a3b-f9a7e1f98462 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:59.573941 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e6f66eaf-bdf6-4546-9a3b-f9a7e1f98462 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:59.683858 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e6f66eaf-bdf6-4546-9a3b-f9a7e1f98462 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:59.699688 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e6f66eaf-bdf6-4546-9a3b-f9a7e1f98462 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:59.703413 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e6f66eaf-bdf6-4546-9a3b-f9a7e1f98462 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:59.705185 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e6f66eaf-bdf6-4546-9a3b-f9a7e1f98462 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] 10.222.0.20 "GET /compute/v2.1/servers/3a41fe60-b7d3-4560-af99-292f1478f419" status: 200 len: 1409 microversion: 2.54 time: 0.153231 Oct 04 18:43:59.706200 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1964/3870] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:43:59 2022] GET /compute/v2.1/servers/3a41fe60-b7d3-4560-af99-292f1478f419 => generated 1409 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:43:59.763380 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-88861ff1-94a9-49bf-9dc9-382b93f38db6 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe25d36d040>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:59.863838 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-88861ff1-94a9-49bf-9dc9-382b93f38db6 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/images/de3254af-72ec-481e-91a9-f950ae382b0e" status: 200 len: 1453 microversion: 2.1 time: 0.078316 Oct 04 18:43:59.864607 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1907/3871] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:43:59 2022] GET /compute/v2.1/images/de3254af-72ec-481e-91a9-f950ae382b0e => generated 1453 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:00.303980 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9aa82255-1489-41ef-a034-3d8ef20d05e3 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:00.305075 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-9aa82255-1489-41ef-a034-3d8ef20d05e3 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 766fe762-0e33-4174-a817-827f782572d9] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:00.315422 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9aa82255-1489-41ef-a034-3d8ef20d05e3 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:00.318710 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9aa82255-1489-41ef-a034-3d8ef20d05e3 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:00.318710 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9aa82255-1489-41ef-a034-3d8ef20d05e3 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:00.318710 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9aa82255-1489-41ef-a034-3d8ef20d05e3 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:00.319802 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9aa82255-1489-41ef-a034-3d8ef20d05e3 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:00.320641 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9aa82255-1489-41ef-a034-3d8ef20d05e3 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:00.392646 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9aa82255-1489-41ef-a034-3d8ef20d05e3 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:00.404085 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9aa82255-1489-41ef-a034-3d8ef20d05e3 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/766fe762-0e33-4174-a817-827f782572d9" status: 200 len: 1452 microversion: 2.1 time: 0.106215 Oct 04 18:44:00.404745 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1965/3872] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:00 2022] GET /compute/v2.1/servers/766fe762-0e33-4174-a817-827f782572d9 => generated 1452 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:00.489871 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-b7639e40-0808-4e2e-818a-7243cab08755 req-8b634a51-9def-4eeb-ad87-79f7c8379960 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "766fe762-0e33-4174-a817-827f782572d9", "name": "network-vif-deleted", "tag": "2764711d-cd2e-4597-8667-8645e399a5d7"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:00.504935 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-b7639e40-0808-4e2e-818a-7243cab08755 req-8b634a51-9def-4eeb-ad87-79f7c8379960 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:00.506504 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-b7639e40-0808-4e2e-818a-7243cab08755 req-8b634a51-9def-4eeb-ad87-79f7c8379960 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:00.507290 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-b7639e40-0808-4e2e-818a-7243cab08755 req-8b634a51-9def-4eeb-ad87-79f7c8379960 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:00.522697 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-b7639e40-0808-4e2e-818a-7243cab08755 req-8b634a51-9def-4eeb-ad87-79f7c8379960 service nova] Creating event network-vif-deleted:2764711d-cd2e-4597-8667-8645e399a5d7 for instance 766fe762-0e33-4174-a817-827f782572d9 on n-h2-850501-14 Oct 04 18:44:00.529901 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-b7639e40-0808-4e2e-818a-7243cab08755 req-8b634a51-9def-4eeb-ad87-79f7c8379960 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047982 Oct 04 18:44:00.531375 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1908/3873] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:44:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:44:00.734785 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9ea4b7c3-1d88-4d2c-8e5c-5006a446b9d2 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:00.735406 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-9ea4b7c3-1d88-4d2c-8e5c-5006a446b9d2 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] [instance: 3a41fe60-b7d3-4560-af99-292f1478f419] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:00.744443 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9ea4b7c3-1d88-4d2c-8e5c-5006a446b9d2 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:00.744443 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9ea4b7c3-1d88-4d2c-8e5c-5006a446b9d2 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:00.744888 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9ea4b7c3-1d88-4d2c-8e5c-5006a446b9d2 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:00.745598 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9ea4b7c3-1d88-4d2c-8e5c-5006a446b9d2 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:00.746059 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9ea4b7c3-1d88-4d2c-8e5c-5006a446b9d2 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:00.746490 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9ea4b7c3-1d88-4d2c-8e5c-5006a446b9d2 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:00.841262 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9ea4b7c3-1d88-4d2c-8e5c-5006a446b9d2 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:00.848415 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9ea4b7c3-1d88-4d2c-8e5c-5006a446b9d2 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:00.850294 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9ea4b7c3-1d88-4d2c-8e5c-5006a446b9d2 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:00.852200 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9ea4b7c3-1d88-4d2c-8e5c-5006a446b9d2 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] 10.222.0.20 "GET /compute/v2.1/servers/3a41fe60-b7d3-4560-af99-292f1478f419" status: 200 len: 1409 microversion: 2.54 time: 0.121894 Oct 04 18:44:00.852895 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1966/3874] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:44:00 2022] GET /compute/v2.1/servers/3a41fe60-b7d3-4560-af99-292f1478f419 => generated 1409 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:44:00.881328 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5a372fd2-0709-459c-b3d6-6343fa9513f8 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe25d330700>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:00.943011 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5a372fd2-0709-459c-b3d6-6343fa9513f8 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/images/de3254af-72ec-481e-91a9-f950ae382b0e" status: 200 len: 1462 microversion: 2.1 time: 0.065979 Oct 04 18:44:00.943604 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1909/3875] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:44:00 2022] GET /compute/v2.1/images/de3254af-72ec-481e-91a9-f950ae382b0e => generated 1462 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:00.958232 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a1bff29c-703b-4a78-b1c8-7ec892b1589d tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe2582d4790>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:01.010253 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a1bff29c-703b-4a78-b1c8-7ec892b1589d tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/images/de3254af-72ec-481e-91a9-f950ae382b0e" status: 200 len: 1462 microversion: 2.1 time: 0.055313 Oct 04 18:44:01.015026 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1967/3876] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:44:00 2022] GET /compute/v2.1/images/de3254af-72ec-481e-91a9-f950ae382b0e => generated 1462 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:01.026092 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2c02bd31-5aa7-46f6-9e51-48211402dc1e tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:01.026885 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2c02bd31-5aa7-46f6-9e51-48211402dc1e tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] [instance: 471125af-1ec3-44b3-bb69-36b04a03fdd5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:01.034386 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2c02bd31-5aa7-46f6-9e51-48211402dc1e tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:01.034903 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2c02bd31-5aa7-46f6-9e51-48211402dc1e tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:01.035317 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2c02bd31-5aa7-46f6-9e51-48211402dc1e tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:01.038092 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2c02bd31-5aa7-46f6-9e51-48211402dc1e tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:01.038092 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2c02bd31-5aa7-46f6-9e51-48211402dc1e tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:01.038092 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2c02bd31-5aa7-46f6-9e51-48211402dc1e tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:01.192538 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2c02bd31-5aa7-46f6-9e51-48211402dc1e tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8d2814c23a4aa9806d56ce99c89e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8596483de9f14de9a88cdb787841fd3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:01.201047 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2c02bd31-5aa7-46f6-9e51-48211402dc1e tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/servers/471125af-1ec3-44b3-bb69-36b04a03fdd5" status: 200 len: 1465 microversion: 2.1 time: 0.178821 Oct 04 18:44:01.201562 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1910/3877] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:01 2022] GET /compute/v2.1/servers/471125af-1ec3-44b3-bb69-36b04a03fdd5 => generated 1465 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:44:01.234046 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6509e4db-9247-43ee-b929-1f59547e2481 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-428038158"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:01.244250 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6509e4db-9247-43ee-b929-1f59547e2481 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] [instance: 6905c432-0fb3-4f5a-84bb-0ffcb08e2b3c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:01.251729 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6509e4db-9247-43ee-b929-1f59547e2481 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:01.252165 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6509e4db-9247-43ee-b929-1f59547e2481 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:01.252612 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6509e4db-9247-43ee-b929-1f59547e2481 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:01.253322 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6509e4db-9247-43ee-b929-1f59547e2481 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:01.253783 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6509e4db-9247-43ee-b929-1f59547e2481 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:01.254440 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6509e4db-9247-43ee-b929-1f59547e2481 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:01.434031 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-df0deb49-9541-41eb-8556-c8dc0144773a tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:01.434658 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-df0deb49-9541-41eb-8556-c8dc0144773a tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 766fe762-0e33-4174-a817-827f782572d9] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:01.441740 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-df0deb49-9541-41eb-8556-c8dc0144773a tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:01.442224 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-df0deb49-9541-41eb-8556-c8dc0144773a tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:01.442660 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-df0deb49-9541-41eb-8556-c8dc0144773a tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:01.443356 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-df0deb49-9541-41eb-8556-c8dc0144773a tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:01.444214 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-df0deb49-9541-41eb-8556-c8dc0144773a tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:01.444793 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-df0deb49-9541-41eb-8556-c8dc0144773a tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:01.478827 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-df0deb49-9541-41eb-8556-c8dc0144773a tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:01.479424 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-df0deb49-9541-41eb-8556-c8dc0144773a tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:01.479884 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-df0deb49-9541-41eb-8556-c8dc0144773a tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:01.480370 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-df0deb49-9541-41eb-8556-c8dc0144773a tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lazy-loading 'fault' on Instance uuid 766fe762-0e33-4174-a817-827f782572d9 {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:44:01.536975 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-df0deb49-9541-41eb-8556-c8dc0144773a tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:01.546424 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-df0deb49-9541-41eb-8556-c8dc0144773a tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/766fe762-0e33-4174-a817-827f782572d9" status: 200 len: 1298 microversion: 2.1 time: 0.116408 Oct 04 18:44:01.547185 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1911/3878] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:01 2022] GET /compute/v2.1/servers/766fe762-0e33-4174-a817-827f782572d9 => generated 1298 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:01.765638 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6509e4db-9247-43ee-b929-1f59547e2481 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "POST /compute/v2.1/servers/6905c432-0fb3-4f5a-84bb-0ffcb08e2b3c/action" status: 202 len: 0 microversion: 2.1 time: 0.544099 Oct 04 18:44:01.766492 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1968/3879] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:44:01 2022] POST /compute/v2.1/servers/6905c432-0fb3-4f5a-84bb-0ffcb08e2b3c/action => generated 0 bytes in 546 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 18:44:01.776732 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-533150cc-2439-414b-a17f-93352d83b462 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe258c70040>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:01.824947 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-533150cc-2439-414b-a17f-93352d83b462 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/images/c852d54e-6bd8-46c7-8b65-bb79b0be25e6" status: 200 len: 1454 microversion: 2.1 time: 0.052026 Oct 04 18:44:01.825865 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1912/3880] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:44:01 2022] GET /compute/v2.1/images/c852d54e-6bd8-46c7-8b65-bb79b0be25e6 => generated 1454 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:44:01.879089 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-882a5b20-6c7c-4984-a026-736ae710d5af tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:01.879809 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-882a5b20-6c7c-4984-a026-736ae710d5af tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] [instance: 3a41fe60-b7d3-4560-af99-292f1478f419] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:01.885990 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-882a5b20-6c7c-4984-a026-736ae710d5af tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:01.886479 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-882a5b20-6c7c-4984-a026-736ae710d5af tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:01.886921 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-882a5b20-6c7c-4984-a026-736ae710d5af tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:01.887615 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-882a5b20-6c7c-4984-a026-736ae710d5af tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:01.888089 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-882a5b20-6c7c-4984-a026-736ae710d5af tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:01.888524 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-882a5b20-6c7c-4984-a026-736ae710d5af tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:01.968312 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-882a5b20-6c7c-4984-a026-736ae710d5af tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:01.978348 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-882a5b20-6c7c-4984-a026-736ae710d5af tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:01.979796 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-882a5b20-6c7c-4984-a026-736ae710d5af tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:01.981012 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-882a5b20-6c7c-4984-a026-736ae710d5af tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] 10.222.0.20 "GET /compute/v2.1/servers/3a41fe60-b7d3-4560-af99-292f1478f419" status: 200 len: 1409 microversion: 2.54 time: 0.106530 Oct 04 18:44:01.981581 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1969/3881] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:44:01 2022] GET /compute/v2.1/servers/3a41fe60-b7d3-4560-af99-292f1478f419 => generated 1409 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:44:02.571183 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ee93cec4-b676-475e-8546-3d181f6ca9c6 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:02.571802 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ee93cec4-b676-475e-8546-3d181f6ca9c6 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 766fe762-0e33-4174-a817-827f782572d9] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:02.579550 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ee93cec4-b676-475e-8546-3d181f6ca9c6 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:02.580038 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ee93cec4-b676-475e-8546-3d181f6ca9c6 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:02.580502 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ee93cec4-b676-475e-8546-3d181f6ca9c6 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:02.581205 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ee93cec4-b676-475e-8546-3d181f6ca9c6 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:02.581668 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ee93cec4-b676-475e-8546-3d181f6ca9c6 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:02.582099 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ee93cec4-b676-475e-8546-3d181f6ca9c6 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:02.596780 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-ee93cec4-b676-475e-8546-3d181f6ca9c6 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] HTTP exception thrown: Instance 766fe762-0e33-4174-a817-827f782572d9 could not be found. Oct 04 18:44:02.598446 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ee93cec4-b676-475e-8546-3d181f6ca9c6 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Request method failure captured: Oct 04 18:44:02.598446 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/766fe762-0e33-4174-a817-827f782572d9 HTTP/1.1 Oct 04 18:44:02.598446 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:44:02.598446 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:44:02.598446 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:44:02.598446 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:44:02.598446 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:44:02.598446 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:44:02.598446 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:44:02.598446 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:44:02.598446 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH5kaFyiFSIO0ZP4CMGEO428dJiNuEG6R-LLS8mNsVetgcf6w0D7DIrYZ_G7YOzpJ5huW8oCnx3-jlxIKVdxxsS18taUnXx6Xt5KnL4IkhJLGYxbDrAUBLCXM7M3o65rqEELwzRRnK71NdjnupluHpvvCSPBSNhy32oTLBkDAxSrOgs Oct 04 18:44:02.598446 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:44:02.598446 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:44:02.598446 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:44:02.598446 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:44:02.598446 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:44:02.598446 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:44:02.598446 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: a9046b9540144eeba512d79438635ea8 Oct 04 18:44:02.598446 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServersTestJSON-380527700 Oct 04 18:44:02.598446 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:44:02.598446 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:44:02.598446 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a9046b9540144eeba512d79438635ea8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a9046b9540144eeba512d79438635ea8", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a9046b9540144eeba512d79438635ea8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a9046b9540144eeba512d79438635ea8"}]}] Oct 04 18:44:02.598446 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServersTestJSON-380527700 Oct 04 18:44:02.598446 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: a9046b9540144eeba512d79438635ea8 Oct 04 18:44:02.598446 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServersTestJSON-380527700 Oct 04 18:44:02.598446 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServersTestJSON-380527700-project Oct 04 18:44:02.598446 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:44:02.598446 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:44:02.598446 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 8a6c3725b31449d5bf1ff757ff66c8d7 Oct 04 18:44:02.598446 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServersTestJSON-380527700-project Oct 04 18:44:02.598446 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:44:02.598446 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 766fe762-0e33-4174-a817-827f782572d9 could not be found. Oct 04 18:44:02.598446 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '766fe762-0e33-4174-a817-827f782572d9'} Oct 04 18:44:02.598446 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:44:02.598446 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:44:02.598446 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:44:02.598446 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:44:02.598446 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:44:02.598446 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:44:02.598446 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:44:02.598446 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:44:02.598446 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:44:02.598446 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:44:02.598446 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 766fe762-0e33-4174-a817-827f782572d9 could not be found. Oct 04 18:44:02.598446 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:44:02.598446 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:44:02.598446 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:44:02.598446 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:44:02.598446 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:44:02.598446 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:44:02.598446 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:44:02.598446 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:44:02.598446 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:44:02.598446 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:44:02.598446 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:44:02.598446 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:44:02.598446 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:44:02.598446 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:44:02.598446 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:44:02.598446 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:44:02.598446 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 766fe762-0e33-4174-a817-827f782572d9 could not be found. Oct 04 18:44:02.598446 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:44:02.598446 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:44:02.598446 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:44:02.598446 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:44:02.604354 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:44:02.604354 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:44:02.604354 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:44:02.604354 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:44:02.604354 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 766fe762-0e33-4174-a817-827f782572d9 could not be found. Oct 04 18:44:02.604354 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:44:02.604354 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ee93cec4-b676-475e-8546-3d181f6ca9c6 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Returning 404 to user: Instance 766fe762-0e33-4174-a817-827f782572d9 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:44:02.604354 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ee93cec4-b676-475e-8546-3d181f6ca9c6 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/766fe762-0e33-4174-a817-827f782572d9" status: 404 len: 111 microversion: 2.1 time: 0.033850 Oct 04 18:44:02.604354 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1913/3882] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:02 2022] GET /compute/v2.1/servers/766fe762-0e33-4174-a817-827f782572d9 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:44:02.706918 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0ce08ce7-675c-4845-a115-18d46b524791 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-3787333", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": [{"uuid": "ea7ea2b5-3fb7-4eeb-8ba9-cbc81d7265bf"}]}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:02.765613 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.neutron [None req-0ce08ce7-675c-4845-a115-18d46b524791 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] validate_networks() for [('ea7ea2b5-3fb7-4eeb-8ba9-cbc81d7265bf', None, None, None, None, None)] {{(pid=123001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:44:02.842259 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-470ad690-b1d9-4af8-a548-5149568e290e tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe258c70ee0>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:02.891440 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-470ad690-b1d9-4af8-a548-5149568e290e tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/images/c852d54e-6bd8-46c7-8b65-bb79b0be25e6" status: 200 len: 1454 microversion: 2.1 time: 0.053540 Oct 04 18:44:02.892022 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1914/3883] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:44:02 2022] GET /compute/v2.1/images/c852d54e-6bd8-46c7-8b65-bb79b0be25e6 => generated 1454 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:44:03.007812 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-006091f1-5b45-4505-9538-13fe9b19224b tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:03.008486 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-006091f1-5b45-4505-9538-13fe9b19224b tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] [instance: 3a41fe60-b7d3-4560-af99-292f1478f419] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:03.016332 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-006091f1-5b45-4505-9538-13fe9b19224b tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:03.022967 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-006091f1-5b45-4505-9538-13fe9b19224b tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:03.022967 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-006091f1-5b45-4505-9538-13fe9b19224b tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:03.022967 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-006091f1-5b45-4505-9538-13fe9b19224b tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:03.022967 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-006091f1-5b45-4505-9538-13fe9b19224b tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:03.022967 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-006091f1-5b45-4505-9538-13fe9b19224b tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:03.137470 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-006091f1-5b45-4505-9538-13fe9b19224b tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:03.146110 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-006091f1-5b45-4505-9538-13fe9b19224b tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:03.147604 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-006091f1-5b45-4505-9538-13fe9b19224b tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:03.148857 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-006091f1-5b45-4505-9538-13fe9b19224b tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] 10.222.0.20 "GET /compute/v2.1/servers/3a41fe60-b7d3-4560-af99-292f1478f419" status: 200 len: 1409 microversion: 2.54 time: 0.145512 Oct 04 18:44:03.159167 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1915/3884] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:44:03 2022] GET /compute/v2.1/servers/3a41fe60-b7d3-4560-af99-292f1478f419 => generated 1409 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:44:03.291045 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-0ce08ce7-675c-4845-a115-18d46b524791 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:44:03.291716 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-0ce08ce7-675c-4845-a115-18d46b524791 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:44:03.292103 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-0ce08ce7-675c-4845-a115-18d46b524791 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:44:03.292704 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-0ce08ce7-675c-4845-a115-18d46b524791 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:44:03.293118 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-0ce08ce7-675c-4845-a115-18d46b524791 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:44:03.302823 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0ce08ce7-675c-4845-a115-18d46b524791 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:03.303304 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0ce08ce7-675c-4845-a115-18d46b524791 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:03.303728 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0ce08ce7-675c-4845-a115-18d46b524791 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:03.304711 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0ce08ce7-675c-4845-a115-18d46b524791 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:03.305166 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0ce08ce7-675c-4845-a115-18d46b524791 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:03.305944 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0ce08ce7-675c-4845-a115-18d46b524791 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:03.326254 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-0ce08ce7-675c-4845-a115-18d46b524791 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Getting quotas for project a9046b9540144eeba512d79438635ea8. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:44:03.333751 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-0ce08ce7-675c-4845-a115-18d46b524791 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Getting quotas for user 8a6c3725b31449d5bf1ff757ff66c8d7 and project a9046b9540144eeba512d79438635ea8. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:44:03.347168 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0ce08ce7-675c-4845-a115-18d46b524791 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Going to run 1 instances... {{(pid=123001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:44:03.349543 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0ce08ce7-675c-4845-a115-18d46b524791 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 160438e8-8561-4edd-9bc8-d0722f35259f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:44:03.470255 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0ce08ce7-675c-4845-a115-18d46b524791 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.766990 Oct 04 18:44:03.471017 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1970/3885] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:44:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 769 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:44:03.483907 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c6390c5f-ea28-4cb8-9959-c3a081d7e109 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:03.484644 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c6390c5f-ea28-4cb8-9959-c3a081d7e109 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 160438e8-8561-4edd-9bc8-d0722f35259f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:03.543590 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c6390c5f-ea28-4cb8-9959-c3a081d7e109 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:03.551002 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c6390c5f-ea28-4cb8-9959-c3a081d7e109 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/160438e8-8561-4edd-9bc8-d0722f35259f" status: 200 len: 1206 microversion: 2.1 time: 0.072450 Oct 04 18:44:03.551595 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1916/3886] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:03 2022] GET /compute/v2.1/servers/160438e8-8561-4edd-9bc8-d0722f35259f => generated 1206 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:03.908315 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-803989cc-1476-4f9c-ba13-e77dc2638377 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe253e1c1f0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:03.960952 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-803989cc-1476-4f9c-ba13-e77dc2638377 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/images/c852d54e-6bd8-46c7-8b65-bb79b0be25e6" status: 200 len: 1454 microversion: 2.1 time: 0.057938 Oct 04 18:44:03.961619 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1971/3887] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:44:03 2022] GET /compute/v2.1/images/c852d54e-6bd8-46c7-8b65-bb79b0be25e6 => generated 1454 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:03.981707 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-1bab9ea8-5601-443a-b0fd-6507bee97cfc req-1ff956de-e852-4d2e-a7f0-c9445934eb36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "471125af-1ec3-44b3-bb69-36b04a03fdd5", "name": "network-vif-unplugged", "status": "completed", "tag": "ac57cdde-4dc1-45e0-be2d-97a36a8bb374"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:03.995680 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-1bab9ea8-5601-443a-b0fd-6507bee97cfc req-1ff956de-e852-4d2e-a7f0-c9445934eb36 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:03.996204 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-1bab9ea8-5601-443a-b0fd-6507bee97cfc req-1ff956de-e852-4d2e-a7f0-c9445934eb36 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:03.996647 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-1bab9ea8-5601-443a-b0fd-6507bee97cfc req-1ff956de-e852-4d2e-a7f0-c9445934eb36 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:04.008080 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-1bab9ea8-5601-443a-b0fd-6507bee97cfc req-1ff956de-e852-4d2e-a7f0-c9445934eb36 service nova] Creating event network-vif-unplugged:ac57cdde-4dc1-45e0-be2d-97a36a8bb374 for instance 471125af-1ec3-44b3-bb69-36b04a03fdd5 on n-h1-850501-14 Oct 04 18:44:04.013246 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-1bab9ea8-5601-443a-b0fd-6507bee97cfc req-1ff956de-e852-4d2e-a7f0-c9445934eb36 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036121 Oct 04 18:44:04.013867 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1917/3888] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:44:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:44:04.180636 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1c3f3be5-c684-4a77-9912-a86b2f657efe tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:04.181473 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1c3f3be5-c684-4a77-9912-a86b2f657efe tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] [instance: 3a41fe60-b7d3-4560-af99-292f1478f419] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:04.188514 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1c3f3be5-c684-4a77-9912-a86b2f657efe tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:04.188999 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1c3f3be5-c684-4a77-9912-a86b2f657efe tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:04.189432 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1c3f3be5-c684-4a77-9912-a86b2f657efe tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:04.190125 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1c3f3be5-c684-4a77-9912-a86b2f657efe tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:04.190585 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1c3f3be5-c684-4a77-9912-a86b2f657efe tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:04.191271 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1c3f3be5-c684-4a77-9912-a86b2f657efe tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:04.265575 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1c3f3be5-c684-4a77-9912-a86b2f657efe tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:04.274054 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1c3f3be5-c684-4a77-9912-a86b2f657efe tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:04.275507 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1c3f3be5-c684-4a77-9912-a86b2f657efe tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:04.276732 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1c3f3be5-c684-4a77-9912-a86b2f657efe tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] 10.222.0.20 "GET /compute/v2.1/servers/3a41fe60-b7d3-4560-af99-292f1478f419" status: 200 len: 1415 microversion: 2.54 time: 0.100089 Oct 04 18:44:04.277296 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1972/3889] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:44:04 2022] GET /compute/v2.1/servers/3a41fe60-b7d3-4560-af99-292f1478f419 => generated 1415 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:44:04.576868 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-fdb48a15-aa32-4a62-8605-fabed17dac84 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:04.577574 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-fdb48a15-aa32-4a62-8605-fabed17dac84 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 160438e8-8561-4edd-9bc8-d0722f35259f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:04.583778 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fdb48a15-aa32-4a62-8605-fabed17dac84 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:04.584292 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fdb48a15-aa32-4a62-8605-fabed17dac84 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:04.584721 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fdb48a15-aa32-4a62-8605-fabed17dac84 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:04.585410 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fdb48a15-aa32-4a62-8605-fabed17dac84 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:04.585858 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fdb48a15-aa32-4a62-8605-fabed17dac84 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:04.586280 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fdb48a15-aa32-4a62-8605-fabed17dac84 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:04.665935 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-fdb48a15-aa32-4a62-8605-fabed17dac84 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:04.672034 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-fdb48a15-aa32-4a62-8605-fabed17dac84 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/160438e8-8561-4edd-9bc8-d0722f35259f" status: 200 len: 1210 microversion: 2.1 time: 0.100394 Oct 04 18:44:04.672855 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1918/3890] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:04 2022] GET /compute/v2.1/servers/160438e8-8561-4edd-9bc8-d0722f35259f => generated 1210 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:04.977876 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-dc16ea13-6ea5-4489-b008-f1ad5f597304 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe253da0d30>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:05.032992 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-dc16ea13-6ea5-4489-b008-f1ad5f597304 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/images/c852d54e-6bd8-46c7-8b65-bb79b0be25e6" status: 200 len: 1454 microversion: 2.1 time: 0.059165 Oct 04 18:44:05.034370 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1973/3891] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:44:04 2022] GET /compute/v2.1/images/c852d54e-6bd8-46c7-8b65-bb79b0be25e6 => generated 1454 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:05.303255 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-809c7a61-ac2c-4a19-9520-d2218113334e tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:05.303885 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-809c7a61-ac2c-4a19-9520-d2218113334e tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] [instance: 3a41fe60-b7d3-4560-af99-292f1478f419] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:05.311966 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-809c7a61-ac2c-4a19-9520-d2218113334e tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:05.312477 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-809c7a61-ac2c-4a19-9520-d2218113334e tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:05.312911 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-809c7a61-ac2c-4a19-9520-d2218113334e tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:05.313626 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-809c7a61-ac2c-4a19-9520-d2218113334e tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:05.314077 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-809c7a61-ac2c-4a19-9520-d2218113334e tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:05.314531 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-809c7a61-ac2c-4a19-9520-d2218113334e tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:05.391433 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-809c7a61-ac2c-4a19-9520-d2218113334e tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:05.399428 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-809c7a61-ac2c-4a19-9520-d2218113334e tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:05.400928 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-809c7a61-ac2c-4a19-9520-d2218113334e tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:05.402146 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-809c7a61-ac2c-4a19-9520-d2218113334e tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] 10.222.0.20 "GET /compute/v2.1/servers/3a41fe60-b7d3-4560-af99-292f1478f419" status: 200 len: 1415 microversion: 2.54 time: 0.103139 Oct 04 18:44:05.402759 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1919/3892] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:44:05 2022] GET /compute/v2.1/servers/3a41fe60-b7d3-4560-af99-292f1478f419 => generated 1415 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:44:05.695157 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-951d7b51-0e01-4ae3-af29-6f1fe0e3ca85 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:05.695794 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-951d7b51-0e01-4ae3-af29-6f1fe0e3ca85 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 160438e8-8561-4edd-9bc8-d0722f35259f] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:05.702440 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-951d7b51-0e01-4ae3-af29-6f1fe0e3ca85 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:05.703050 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-951d7b51-0e01-4ae3-af29-6f1fe0e3ca85 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:05.703477 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-951d7b51-0e01-4ae3-af29-6f1fe0e3ca85 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:05.704208 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-951d7b51-0e01-4ae3-af29-6f1fe0e3ca85 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:05.704669 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-951d7b51-0e01-4ae3-af29-6f1fe0e3ca85 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:05.705098 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-951d7b51-0e01-4ae3-af29-6f1fe0e3ca85 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:05.778764 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-951d7b51-0e01-4ae3-af29-6f1fe0e3ca85 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:05.787270 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-951d7b51-0e01-4ae3-af29-6f1fe0e3ca85 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/160438e8-8561-4edd-9bc8-d0722f35259f" status: 200 len: 1202 microversion: 2.1 time: 0.096282 Oct 04 18:44:05.787918 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1974/3893] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:05 2022] GET /compute/v2.1/servers/160438e8-8561-4edd-9bc8-d0722f35259f => generated 1202 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:06.049667 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f7aa3b46-01e3-453d-b018-c3836032107a tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe25d109ca0>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:06.097561 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f7aa3b46-01e3-453d-b018-c3836032107a tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/images/c852d54e-6bd8-46c7-8b65-bb79b0be25e6" status: 200 len: 1454 microversion: 2.1 time: 0.052511 Oct 04 18:44:06.103020 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1920/3894] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:44:06 2022] GET /compute/v2.1/images/c852d54e-6bd8-46c7-8b65-bb79b0be25e6 => generated 1454 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:06.429910 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-89bd604f-3747-47c6-b45e-d0d8fd879e38 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:06.430523 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-89bd604f-3747-47c6-b45e-d0d8fd879e38 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] [instance: 3a41fe60-b7d3-4560-af99-292f1478f419] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:06.437715 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-89bd604f-3747-47c6-b45e-d0d8fd879e38 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:06.438276 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-89bd604f-3747-47c6-b45e-d0d8fd879e38 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:06.438715 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-89bd604f-3747-47c6-b45e-d0d8fd879e38 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:06.439501 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-89bd604f-3747-47c6-b45e-d0d8fd879e38 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:06.440237 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-89bd604f-3747-47c6-b45e-d0d8fd879e38 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:06.440413 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-89bd604f-3747-47c6-b45e-d0d8fd879e38 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:06.445045 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:44:06.510705 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-89bd604f-3747-47c6-b45e-d0d8fd879e38 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:06.520691 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-89bd604f-3747-47c6-b45e-d0d8fd879e38 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:06.522126 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-89bd604f-3747-47c6-b45e-d0d8fd879e38 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:06.523296 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-89bd604f-3747-47c6-b45e-d0d8fd879e38 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] 10.222.0.20 "GET /compute/v2.1/servers/3a41fe60-b7d3-4560-af99-292f1478f419" status: 200 len: 1400 microversion: 2.54 time: 0.097544 Oct 04 18:44:06.523849 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1975/3895] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:44:06 2022] GET /compute/v2.1/servers/3a41fe60-b7d3-4560-af99-292f1478f419 => generated 1400 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:44:06.553949 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-38be4bfc-275d-4685-ac2e-7980b05cf7e0 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Calling method '.version_select at 0x7fe25d19fb80>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:06.655220 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-38be4bfc-275d-4685-ac2e-7980b05cf7e0 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1792855981" status: 204 len: 0 microversion: 2.54 time: 0.105479 Oct 04 18:44:06.655852 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1921/3896] 10.222.0.20 () {60 vars in 1319 bytes} [Tue Oct 4 18:44:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1792855981 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:44:06.678450 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b1d111ef-a1aa-4903-ab17-49fafd481319 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:06.679124 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b1d111ef-a1aa-4903-ab17-49fafd481319 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] [instance: 3a41fe60-b7d3-4560-af99-292f1478f419] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:06.686197 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b1d111ef-a1aa-4903-ab17-49fafd481319 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:06.686757 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b1d111ef-a1aa-4903-ab17-49fafd481319 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:06.687270 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b1d111ef-a1aa-4903-ab17-49fafd481319 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:06.688024 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b1d111ef-a1aa-4903-ab17-49fafd481319 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:06.688581 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b1d111ef-a1aa-4903-ab17-49fafd481319 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:06.689001 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b1d111ef-a1aa-4903-ab17-49fafd481319 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:06.715741 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b1d111ef-a1aa-4903-ab17-49fafd481319 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] [instance: 3a41fe60-b7d3-4560-af99-292f1478f419] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:44:06.812382 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-638755a6-34b1-4ffe-b2d0-88e5baad230d tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:06.813007 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-638755a6-34b1-4ffe-b2d0-88e5baad230d tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 160438e8-8561-4edd-9bc8-d0722f35259f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:06.819485 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-638755a6-34b1-4ffe-b2d0-88e5baad230d tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:06.819979 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-638755a6-34b1-4ffe-b2d0-88e5baad230d tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:06.820450 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-638755a6-34b1-4ffe-b2d0-88e5baad230d tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:06.821154 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-638755a6-34b1-4ffe-b2d0-88e5baad230d tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:06.821617 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-638755a6-34b1-4ffe-b2d0-88e5baad230d tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:06.822049 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-638755a6-34b1-4ffe-b2d0-88e5baad230d tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:06.890761 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-638755a6-34b1-4ffe-b2d0-88e5baad230d tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:06.898731 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-638755a6-34b1-4ffe-b2d0-88e5baad230d tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/160438e8-8561-4edd-9bc8-d0722f35259f" status: 200 len: 1258 microversion: 2.1 time: 0.090266 Oct 04 18:44:06.899349 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1922/3897] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:06 2022] GET /compute/v2.1/servers/160438e8-8561-4edd-9bc8-d0722f35259f => generated 1258 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:07.113869 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-23c238df-7e88-40ea-97ee-8727f5f34429 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe25d109f70>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:07.151827 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b1d111ef-a1aa-4903-ab17-49fafd481319 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3a41fe60-b7d3-4560-af99-292f1478f419" status: 204 len: 0 microversion: 2.54 time: 0.477493 Oct 04 18:44:07.152660 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1976/3898] 10.222.0.20 () {60 vars in 1280 bytes} [Tue Oct 4 18:44:06 2022] DELETE /compute/v2.1/servers/3a41fe60-b7d3-4560-af99-292f1478f419 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:44:07.162204 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ee94aaa2-57f1-4aa0-9eca-bf5223698552 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:07.163158 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ee94aaa2-57f1-4aa0-9eca-bf5223698552 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] [instance: 3a41fe60-b7d3-4560-af99-292f1478f419] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:07.165358 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-23c238df-7e88-40ea-97ee-8727f5f34429 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/images/c852d54e-6bd8-46c7-8b65-bb79b0be25e6" status: 200 len: 1454 microversion: 2.1 time: 0.055550 Oct 04 18:44:07.166389 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1923/3899] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:44:07 2022] GET /compute/v2.1/images/c852d54e-6bd8-46c7-8b65-bb79b0be25e6 => generated 1454 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:44:07.169952 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ee94aaa2-57f1-4aa0-9eca-bf5223698552 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:07.170634 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ee94aaa2-57f1-4aa0-9eca-bf5223698552 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:07.171362 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ee94aaa2-57f1-4aa0-9eca-bf5223698552 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:07.172225 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ee94aaa2-57f1-4aa0-9eca-bf5223698552 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:07.172794 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ee94aaa2-57f1-4aa0-9eca-bf5223698552 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:07.173317 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ee94aaa2-57f1-4aa0-9eca-bf5223698552 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:07.256780 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ee94aaa2-57f1-4aa0-9eca-bf5223698552 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:07.267532 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ee94aaa2-57f1-4aa0-9eca-bf5223698552 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:07.269157 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ee94aaa2-57f1-4aa0-9eca-bf5223698552 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:07.270669 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ee94aaa2-57f1-4aa0-9eca-bf5223698552 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] 10.222.0.20 "GET /compute/v2.1/servers/3a41fe60-b7d3-4560-af99-292f1478f419" status: 200 len: 1406 microversion: 2.54 time: 0.112962 Oct 04 18:44:07.271570 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1977/3900] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:44:07 2022] GET /compute/v2.1/servers/3a41fe60-b7d3-4560-af99-292f1478f419 => generated 1406 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:44:07.923159 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b9b0e4d3-d20c-40d9-b48b-20e964d0bae0 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:07.923816 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b9b0e4d3-d20c-40d9-b48b-20e964d0bae0 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 160438e8-8561-4edd-9bc8-d0722f35259f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:07.931007 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b9b0e4d3-d20c-40d9-b48b-20e964d0bae0 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:07.931494 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b9b0e4d3-d20c-40d9-b48b-20e964d0bae0 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:07.931974 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b9b0e4d3-d20c-40d9-b48b-20e964d0bae0 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:07.933299 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b9b0e4d3-d20c-40d9-b48b-20e964d0bae0 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:07.933874 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b9b0e4d3-d20c-40d9-b48b-20e964d0bae0 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:07.934524 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b9b0e4d3-d20c-40d9-b48b-20e964d0bae0 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:08.152800 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-8c240966-4668-4f4f-a3b2-4e496afe5fcd req-c0e21c95-30fa-4861-abbd-2ddb3d71b580 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6905c432-0fb3-4f5a-84bb-0ffcb08e2b3c", "name": "network-vif-plugged", "status": "completed", "tag": "457c88d9-9246-435c-b1a5-58b0c6c6185d"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:08.169228 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:44:08.174310 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-8c240966-4668-4f4f-a3b2-4e496afe5fcd req-c0e21c95-30fa-4861-abbd-2ddb3d71b580 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:08.178020 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-8c240966-4668-4f4f-a3b2-4e496afe5fcd req-c0e21c95-30fa-4861-abbd-2ddb3d71b580 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:08.178020 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-8c240966-4668-4f4f-a3b2-4e496afe5fcd req-c0e21c95-30fa-4861-abbd-2ddb3d71b580 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:08.200739 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-8c240966-4668-4f4f-a3b2-4e496afe5fcd req-c0e21c95-30fa-4861-abbd-2ddb3d71b580 service nova] Creating event network-vif-plugged:457c88d9-9246-435c-b1a5-58b0c6c6185d for instance 6905c432-0fb3-4f5a-84bb-0ffcb08e2b3c on n-h1-850501-14 Oct 04 18:44:08.206654 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-8c240966-4668-4f4f-a3b2-4e496afe5fcd req-c0e21c95-30fa-4861-abbd-2ddb3d71b580 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057395 Oct 04 18:44:08.207931 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1978/3901] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:44:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:44:08.210779 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b9b0e4d3-d20c-40d9-b48b-20e964d0bae0 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:08.214511 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-94237639-d225-4817-b02d-d334b162b52b tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe253dc6ca0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:08.222058 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b9b0e4d3-d20c-40d9-b48b-20e964d0bae0 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/160438e8-8561-4edd-9bc8-d0722f35259f" status: 200 len: 1306 microversion: 2.1 time: 0.303889 Oct 04 18:44:08.238435 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1924/3902] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:07 2022] GET /compute/v2.1/servers/160438e8-8561-4edd-9bc8-d0722f35259f => generated 1306 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:08.267538 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-94237639-d225-4817-b02d-d334b162b52b tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/images/c852d54e-6bd8-46c7-8b65-bb79b0be25e6" status: 200 len: 1454 microversion: 2.1 time: 0.058170 Oct 04 18:44:08.268163 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1979/3903] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:44:08 2022] GET /compute/v2.1/images/c852d54e-6bd8-46c7-8b65-bb79b0be25e6 => generated 1454 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:08.297765 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c7ff6bfa-424b-49ff-9104-88cada70579a tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:08.298397 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c7ff6bfa-424b-49ff-9104-88cada70579a tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] [instance: 3a41fe60-b7d3-4560-af99-292f1478f419] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:08.305352 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c7ff6bfa-424b-49ff-9104-88cada70579a tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:08.305852 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c7ff6bfa-424b-49ff-9104-88cada70579a tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:08.306293 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c7ff6bfa-424b-49ff-9104-88cada70579a tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:08.306999 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c7ff6bfa-424b-49ff-9104-88cada70579a tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:08.307461 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c7ff6bfa-424b-49ff-9104-88cada70579a tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:08.309398 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c7ff6bfa-424b-49ff-9104-88cada70579a tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:08.393933 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c7ff6bfa-424b-49ff-9104-88cada70579a tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:08.402205 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c7ff6bfa-424b-49ff-9104-88cada70579a tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:08.403634 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c7ff6bfa-424b-49ff-9104-88cada70579a tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:08.405270 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c7ff6bfa-424b-49ff-9104-88cada70579a tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] 10.222.0.20 "GET /compute/v2.1/servers/3a41fe60-b7d3-4560-af99-292f1478f419" status: 200 len: 1406 microversion: 2.54 time: 0.112012 Oct 04 18:44:08.406411 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1925/3904] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:44:08 2022] GET /compute/v2.1/servers/3a41fe60-b7d3-4560-af99-292f1478f419 => generated 1406 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:44:09.054340 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5377762a-f082-44a0-8bdf-78fb6c9c48c0 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1831115068", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": [{"uuid": "644535cf-9b91-40c3-82ab-18934c438766"}]}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:09.106234 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.neutron [None req-5377762a-f082-44a0-8bdf-78fb6c9c48c0 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] validate_networks() for [('644535cf-9b91-40c3-82ab-18934c438766', None, None, None, None, None)] {{(pid=123001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:44:09.246958 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d8ef15ef-93f7-471c-ba4c-3c3568998567 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:09.247565 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d8ef15ef-93f7-471c-ba4c-3c3568998567 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 160438e8-8561-4edd-9bc8-d0722f35259f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:09.261993 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d8ef15ef-93f7-471c-ba4c-3c3568998567 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:09.262507 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d8ef15ef-93f7-471c-ba4c-3c3568998567 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:09.264087 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d8ef15ef-93f7-471c-ba4c-3c3568998567 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:09.264941 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d8ef15ef-93f7-471c-ba4c-3c3568998567 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:09.265399 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d8ef15ef-93f7-471c-ba4c-3c3568998567 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:09.265826 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d8ef15ef-93f7-471c-ba4c-3c3568998567 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:09.599407 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d8ef15ef-93f7-471c-ba4c-3c3568998567 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:09.608368 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d8ef15ef-93f7-471c-ba4c-3c3568998567 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/160438e8-8561-4edd-9bc8-d0722f35259f" status: 200 len: 1306 microversion: 2.1 time: 0.364540 Oct 04 18:44:09.608951 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1926/3905] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:09 2022] GET /compute/v2.1/servers/160438e8-8561-4edd-9bc8-d0722f35259f => generated 1306 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:44:09.614046 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4d52a8f0-e4df-4b70-8107-aa7fe0eb777f tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe2596ebd30>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:09.662603 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4d52a8f0-e4df-4b70-8107-aa7fe0eb777f tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/images/c852d54e-6bd8-46c7-8b65-bb79b0be25e6" status: 200 len: 1454 microversion: 2.1 time: 0.052496 Oct 04 18:44:09.663196 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1927/3906] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:44:09 2022] GET /compute/v2.1/images/c852d54e-6bd8-46c7-8b65-bb79b0be25e6 => generated 1454 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:09.667981 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7342adba-caa8-4c98-b29e-8d85befd98db tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:09.668640 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7342adba-caa8-4c98-b29e-8d85befd98db tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] [instance: 3a41fe60-b7d3-4560-af99-292f1478f419] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:09.675629 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7342adba-caa8-4c98-b29e-8d85befd98db tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:09.676165 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7342adba-caa8-4c98-b29e-8d85befd98db tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:09.683138 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7342adba-caa8-4c98-b29e-8d85befd98db tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:09.683138 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7342adba-caa8-4c98-b29e-8d85befd98db tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:09.683138 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7342adba-caa8-4c98-b29e-8d85befd98db tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:09.683138 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7342adba-caa8-4c98-b29e-8d85befd98db tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:09.714621 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7342adba-caa8-4c98-b29e-8d85befd98db tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:09.715115 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7342adba-caa8-4c98-b29e-8d85befd98db tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:09.715551 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7342adba-caa8-4c98-b29e-8d85befd98db tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:09.716006 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-7342adba-caa8-4c98-b29e-8d85befd98db tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lazy-loading 'fault' on Instance uuid 3a41fe60-b7d3-4560-af99-292f1478f419 {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:44:10.014704 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7342adba-caa8-4c98-b29e-8d85befd98db tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:10.035278 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7342adba-caa8-4c98-b29e-8d85befd98db tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:10.046661 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7342adba-caa8-4c98-b29e-8d85befd98db tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '72d0740437c04bceaa138b37cd1babd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f920618391404d5aa7eb1d4c40b185a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:10.048754 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7342adba-caa8-4c98-b29e-8d85befd98db tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] 10.222.0.20 "GET /compute/v2.1/servers/3a41fe60-b7d3-4560-af99-292f1478f419" status: 200 len: 1411 microversion: 2.54 time: 0.384343 Oct 04 18:44:10.060890 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1928/3907] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:44:09 2022] GET /compute/v2.1/servers/3a41fe60-b7d3-4560-af99-292f1478f419 => generated 1411 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:44:10.227334 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-5377762a-f082-44a0-8bdf-78fb6c9c48c0 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:44:10.228544 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-5377762a-f082-44a0-8bdf-78fb6c9c48c0 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:44:10.229250 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-5377762a-f082-44a0-8bdf-78fb6c9c48c0 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:44:10.229666 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-5377762a-f082-44a0-8bdf-78fb6c9c48c0 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:44:10.230107 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-5377762a-f082-44a0-8bdf-78fb6c9c48c0 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:44:10.240969 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5377762a-f082-44a0-8bdf-78fb6c9c48c0 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:10.242095 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5377762a-f082-44a0-8bdf-78fb6c9c48c0 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:10.242916 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5377762a-f082-44a0-8bdf-78fb6c9c48c0 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:10.243980 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5377762a-f082-44a0-8bdf-78fb6c9c48c0 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:10.244529 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5377762a-f082-44a0-8bdf-78fb6c9c48c0 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:10.244985 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5377762a-f082-44a0-8bdf-78fb6c9c48c0 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:10.270762 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-5377762a-f082-44a0-8bdf-78fb6c9c48c0 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Getting quotas for project b7e700f423d84c08b35b4eceae2ff6ef. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:44:10.277078 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-5377762a-f082-44a0-8bdf-78fb6c9c48c0 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Getting quotas for user cdfd40fbb91e4c5a8b5a060a6667fa7b and project b7e700f423d84c08b35b4eceae2ff6ef. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:44:10.297396 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5377762a-f082-44a0-8bdf-78fb6c9c48c0 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Going to run 1 instances... {{(pid=123001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:44:10.299857 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5377762a-f082-44a0-8bdf-78fb6c9c48c0 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] [instance: 298850cf-74ca-4aa2-83c4-03602d5b2260] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:44:10.461194 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5377762a-f082-44a0-8bdf-78fb6c9c48c0 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.552741 Oct 04 18:44:10.469254 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1980/3908] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:44:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1561 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:44:10.477936 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-5b684635-e2d6-4ca1-81ba-0d881fe39309 req-9106dce8-68a4-4321-9776-5be90c69e41a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "160438e8-8561-4edd-9bc8-d0722f35259f", "tag": "66c47011-7f0a-437e-a047-7ff6ea0be179"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:10.478729 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3ed9c971-5041-4319-983f-cbdf2742d441 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:10.479575 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3ed9c971-5041-4319-983f-cbdf2742d441 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] [instance: 298850cf-74ca-4aa2-83c4-03602d5b2260] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:10.490031 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-5b684635-e2d6-4ca1-81ba-0d881fe39309 req-9106dce8-68a4-4321-9776-5be90c69e41a service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:10.490659 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-5b684635-e2d6-4ca1-81ba-0d881fe39309 req-9106dce8-68a4-4321-9776-5be90c69e41a service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:10.491393 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-5b684635-e2d6-4ca1-81ba-0d881fe39309 req-9106dce8-68a4-4321-9776-5be90c69e41a service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:10.504150 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=100 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:44:10.506216 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-5b684635-e2d6-4ca1-81ba-0d881fe39309 req-9106dce8-68a4-4321-9776-5be90c69e41a service nova] Creating event network-changed:66c47011-7f0a-437e-a047-7ff6ea0be179 for instance 160438e8-8561-4edd-9bc8-d0722f35259f on n-h1-850501-14 Oct 04 18:44:10.512560 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-5b684635-e2d6-4ca1-81ba-0d881fe39309 req-9106dce8-68a4-4321-9776-5be90c69e41a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.157537 Oct 04 18:44:10.514839 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1929/3909] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:44:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:44:10.592779 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3ed9c971-5041-4319-983f-cbdf2742d441 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdfd40fbb91e4c5a8b5a060a6667fa7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e700f423d84c08b35b4eceae2ff6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:10.600822 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3ed9c971-5041-4319-983f-cbdf2742d441 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] 10.222.0.20 "GET /compute/v2.1/servers/298850cf-74ca-4aa2-83c4-03602d5b2260" status: 200 len: 1214 microversion: 2.1 time: 0.130398 Oct 04 18:44:10.601425 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1981/3910] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:10 2022] GET /compute/v2.1/servers/298850cf-74ca-4aa2-83c4-03602d5b2260 => generated 1214 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:10.632232 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7b329cd0-98c2-425b-a85e-30ab559a6f18 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:10.633071 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7b329cd0-98c2-425b-a85e-30ab559a6f18 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 160438e8-8561-4edd-9bc8-d0722f35259f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:10.642213 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7b329cd0-98c2-425b-a85e-30ab559a6f18 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:10.645497 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7b329cd0-98c2-425b-a85e-30ab559a6f18 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:10.645497 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7b329cd0-98c2-425b-a85e-30ab559a6f18 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:10.645497 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7b329cd0-98c2-425b-a85e-30ab559a6f18 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:10.645497 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7b329cd0-98c2-425b-a85e-30ab559a6f18 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:10.645497 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7b329cd0-98c2-425b-a85e-30ab559a6f18 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:10.678840 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-499dd25b-85d9-45bc-be05-b772ef97978d tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe253d858b0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:10.787030 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-499dd25b-85d9-45bc-be05-b772ef97978d tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/images/c852d54e-6bd8-46c7-8b65-bb79b0be25e6" status: 200 len: 1454 microversion: 2.1 time: 0.111974 Oct 04 18:44:10.797827 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1982/3911] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:44:10 2022] GET /compute/v2.1/images/c852d54e-6bd8-46c7-8b65-bb79b0be25e6 => generated 1454 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:10.986646 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7b329cd0-98c2-425b-a85e-30ab559a6f18 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:11.004144 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7b329cd0-98c2-425b-a85e-30ab559a6f18 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/160438e8-8561-4edd-9bc8-d0722f35259f" status: 200 len: 1306 microversion: 2.1 time: 0.375635 Oct 04 18:44:11.005182 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1930/3912] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:10 2022] GET /compute/v2.1/servers/160438e8-8561-4edd-9bc8-d0722f35259f => generated 1306 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:11.083693 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-78f6e0d6-caae-4fae-96a7-1e253fa96954 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:11.084802 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-78f6e0d6-caae-4fae-96a7-1e253fa96954 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] [instance: 3a41fe60-b7d3-4560-af99-292f1478f419] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:11.094546 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-78f6e0d6-caae-4fae-96a7-1e253fa96954 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:11.095351 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-78f6e0d6-caae-4fae-96a7-1e253fa96954 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:11.096034 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-78f6e0d6-caae-4fae-96a7-1e253fa96954 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:11.096970 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-78f6e0d6-caae-4fae-96a7-1e253fa96954 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:11.097832 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-78f6e0d6-caae-4fae-96a7-1e253fa96954 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:11.099445 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-78f6e0d6-caae-4fae-96a7-1e253fa96954 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:11.120253 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-78f6e0d6-caae-4fae-96a7-1e253fa96954 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] HTTP exception thrown: Instance 3a41fe60-b7d3-4560-af99-292f1478f419 could not be found. Oct 04 18:44:11.121976 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-78f6e0d6-caae-4fae-96a7-1e253fa96954 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Request method failure captured: Oct 04 18:44:11.121976 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/3a41fe60-b7d3-4560-af99-292f1478f419 HTTP/1.1 Oct 04 18:44:11.121976 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:44:11.121976 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:44:11.121976 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:44:11.121976 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:44:11.121976 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:44:11.121976 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:44:11.121976 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:44:11.121976 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:44:11.121976 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPH7HzlKae55tCTFPTIOaR2HvCGffidTyQe_t26LqoeaNxdgkd_L-ZXVJ-H61Z32gANLrWKNt6Y7X9ON94Rq2A0MMR20Zo_rhTvSUBGBSygsSaHbn6efFwmjWPOVsP4I8YC0TIqm8ICSN15H0OkV1WKOwPjj4z0rgLTltLBoa3-rawSk Oct 04 18:44:11.121976 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:44:11.121976 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:44:11.121976 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:44:11.121976 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:44:11.121976 n-d-850501-14 devstack@n-api.service[123001]: X-Openstack-Nova-Api-Version: 2.54 Oct 04 18:44:11.121976 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:44:11.121976 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:44:11.121976 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: f920618391404d5aa7eb1d4c40b185a7 Oct 04 18:44:11.121976 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ServerShowV254Test-614772900 Oct 04 18:44:11.121976 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:44:11.121976 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:44:11.121976 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f920618391404d5aa7eb1d4c40b185a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f920618391404d5aa7eb1d4c40b185a7", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f920618391404d5aa7eb1d4c40b185a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f920618391404d5aa7eb1d4c40b185a7"}]}] Oct 04 18:44:11.121976 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ServerShowV254Test-614772900 Oct 04 18:44:11.121976 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: f920618391404d5aa7eb1d4c40b185a7 Oct 04 18:44:11.121976 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ServerShowV254Test-614772900 Oct 04 18:44:11.121976 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ServerShowV254Test-614772900-project Oct 04 18:44:11.121976 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:44:11.121976 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:44:11.121976 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 72d0740437c04bceaa138b37cd1babd8 Oct 04 18:44:11.121976 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ServerShowV254Test-614772900-project Oct 04 18:44:11.121976 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:44:11.121976 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 3a41fe60-b7d3-4560-af99-292f1478f419 could not be found. Oct 04 18:44:11.121976 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '3a41fe60-b7d3-4560-af99-292f1478f419'} Oct 04 18:44:11.121976 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:44:11.121976 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:44:11.121976 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:44:11.121976 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:44:11.121976 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:44:11.121976 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:44:11.121976 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:44:11.121976 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:44:11.121976 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:44:11.121976 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:44:11.121976 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a41fe60-b7d3-4560-af99-292f1478f419 could not be found. Oct 04 18:44:11.121976 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:44:11.121976 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:44:11.121976 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:44:11.121976 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:44:11.121976 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:44:11.121976 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:44:11.121976 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:44:11.121976 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:44:11.121976 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:44:11.121976 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:44:11.121976 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:44:11.121976 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:44:11.121976 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:44:11.121976 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:44:11.121976 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:44:11.121976 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:44:11.121976 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a41fe60-b7d3-4560-af99-292f1478f419 could not be found. Oct 04 18:44:11.121976 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:44:11.121976 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:44:11.121976 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:44:11.128027 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:44:11.128027 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:44:11.128027 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:44:11.128027 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:44:11.128027 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:44:11.128027 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a41fe60-b7d3-4560-af99-292f1478f419 could not be found. Oct 04 18:44:11.128027 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:44:11.129583 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-78f6e0d6-caae-4fae-96a7-1e253fa96954 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] Returning 404 to user: Instance 3a41fe60-b7d3-4560-af99-292f1478f419 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:44:11.130918 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-78f6e0d6-caae-4fae-96a7-1e253fa96954 tempest-ServerShowV254Test-614772900 tempest-ServerShowV254Test-614772900-project] 10.222.0.20 "GET /compute/v2.1/servers/3a41fe60-b7d3-4560-af99-292f1478f419" status: 404 len: 111 microversion: 2.54 time: 0.051609 Oct 04 18:44:11.132026 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1983/3913] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:44:11 2022] GET /compute/v2.1/servers/3a41fe60-b7d3-4560-af99-292f1478f419 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:44:11.626875 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-20c81bf1-5d50-469e-85c8-65d5d753bece tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:11.627478 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-20c81bf1-5d50-469e-85c8-65d5d753bece tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] [instance: 298850cf-74ca-4aa2-83c4-03602d5b2260] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:11.630860 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:44:11.733976 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-20c81bf1-5d50-469e-85c8-65d5d753bece tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdfd40fbb91e4c5a8b5a060a6667fa7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e700f423d84c08b35b4eceae2ff6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:11.746832 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-20c81bf1-5d50-469e-85c8-65d5d753bece tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] 10.222.0.20 "GET /compute/v2.1/servers/298850cf-74ca-4aa2-83c4-03602d5b2260" status: 200 len: 1214 microversion: 2.1 time: 0.123912 Oct 04 18:44:11.747823 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1931/3914] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:11 2022] GET /compute/v2.1/servers/298850cf-74ca-4aa2-83c4-03602d5b2260 => generated 1214 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:11.805320 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-154dfc98-a219-4725-89ce-20d0f1028c0f tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe2582d41f0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:11.872751 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-154dfc98-a219-4725-89ce-20d0f1028c0f tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/images/c852d54e-6bd8-46c7-8b65-bb79b0be25e6" status: 200 len: 1454 microversion: 2.1 time: 0.072363 Oct 04 18:44:11.882425 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1984/3915] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:44:11 2022] GET /compute/v2.1/images/c852d54e-6bd8-46c7-8b65-bb79b0be25e6 => generated 1454 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:12.028569 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-98b4d294-b281-4672-a79a-ee262cbf2dd2 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:12.030505 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-98b4d294-b281-4672-a79a-ee262cbf2dd2 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 160438e8-8561-4edd-9bc8-d0722f35259f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:12.038361 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-98b4d294-b281-4672-a79a-ee262cbf2dd2 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:12.038868 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-98b4d294-b281-4672-a79a-ee262cbf2dd2 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:12.039355 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-98b4d294-b281-4672-a79a-ee262cbf2dd2 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:12.040122 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-98b4d294-b281-4672-a79a-ee262cbf2dd2 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:12.040640 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-98b4d294-b281-4672-a79a-ee262cbf2dd2 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:12.041257 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-98b4d294-b281-4672-a79a-ee262cbf2dd2 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:12.230418 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-98b4d294-b281-4672-a79a-ee262cbf2dd2 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:12.240737 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-98b4d294-b281-4672-a79a-ee262cbf2dd2 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/160438e8-8561-4edd-9bc8-d0722f35259f" status: 200 len: 1306 microversion: 2.1 time: 0.216400 Oct 04 18:44:12.241825 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1932/3916] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:12 2022] GET /compute/v2.1/servers/160438e8-8561-4edd-9bc8-d0722f35259f => generated 1306 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:12.774651 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0b534f4f-bed7-498f-a2c3-c6a0039c745a tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:12.775400 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0b534f4f-bed7-498f-a2c3-c6a0039c745a tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] [instance: 298850cf-74ca-4aa2-83c4-03602d5b2260] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:12.798096 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0b534f4f-bed7-498f-a2c3-c6a0039c745a tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:12.798586 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0b534f4f-bed7-498f-a2c3-c6a0039c745a tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:12.803141 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0b534f4f-bed7-498f-a2c3-c6a0039c745a tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:12.803141 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0b534f4f-bed7-498f-a2c3-c6a0039c745a tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:12.803141 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0b534f4f-bed7-498f-a2c3-c6a0039c745a tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:12.803141 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0b534f4f-bed7-498f-a2c3-c6a0039c745a tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:12.897597 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ce3d37a2-bfdc-43cc-b626-bcc06a561025 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe2596ebd30>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:12.908204 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0b534f4f-bed7-498f-a2c3-c6a0039c745a tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdfd40fbb91e4c5a8b5a060a6667fa7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e700f423d84c08b35b4eceae2ff6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:12.921662 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0b534f4f-bed7-498f-a2c3-c6a0039c745a tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] 10.222.0.20 "GET /compute/v2.1/servers/298850cf-74ca-4aa2-83c4-03602d5b2260" status: 200 len: 1266 microversion: 2.1 time: 0.154763 Oct 04 18:44:12.940821 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1985/3917] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:12 2022] GET /compute/v2.1/servers/298850cf-74ca-4aa2-83c4-03602d5b2260 => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:12.959281 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ce3d37a2-bfdc-43cc-b626-bcc06a561025 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/images/c852d54e-6bd8-46c7-8b65-bb79b0be25e6" status: 200 len: 1454 microversion: 2.1 time: 0.072124 Oct 04 18:44:12.985396 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1933/3918] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:44:12 2022] GET /compute/v2.1/images/c852d54e-6bd8-46c7-8b65-bb79b0be25e6 => generated 1454 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:13.265117 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-73ba18e9-b2b4-4482-955c-5e48ec362827 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:13.265780 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-73ba18e9-b2b4-4482-955c-5e48ec362827 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 160438e8-8561-4edd-9bc8-d0722f35259f] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:13.273038 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-73ba18e9-b2b4-4482-955c-5e48ec362827 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:13.273523 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-73ba18e9-b2b4-4482-955c-5e48ec362827 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:13.273958 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-73ba18e9-b2b4-4482-955c-5e48ec362827 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:13.274646 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-73ba18e9-b2b4-4482-955c-5e48ec362827 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:13.275099 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-73ba18e9-b2b4-4482-955c-5e48ec362827 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:13.275528 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-73ba18e9-b2b4-4482-955c-5e48ec362827 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:13.419708 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-73ba18e9-b2b4-4482-955c-5e48ec362827 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:13.427880 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-73ba18e9-b2b4-4482-955c-5e48ec362827 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/160438e8-8561-4edd-9bc8-d0722f35259f" status: 200 len: 1306 microversion: 2.1 time: 0.166893 Oct 04 18:44:13.428487 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1986/3919] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:13 2022] GET /compute/v2.1/servers/160438e8-8561-4edd-9bc8-d0722f35259f => generated 1306 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:13.953936 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-da3f1e8e-8abf-4785-8aa7-d751a7a64ea2 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:13.955024 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-da3f1e8e-8abf-4785-8aa7-d751a7a64ea2 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] [instance: 298850cf-74ca-4aa2-83c4-03602d5b2260] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:13.997546 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-be2f3b04-065a-489e-ba7b-6d50e0231c92 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe253de6c10>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:14.003646 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-da3f1e8e-8abf-4785-8aa7-d751a7a64ea2 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:14.004491 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-da3f1e8e-8abf-4785-8aa7-d751a7a64ea2 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:14.005274 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-da3f1e8e-8abf-4785-8aa7-d751a7a64ea2 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:14.006468 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-da3f1e8e-8abf-4785-8aa7-d751a7a64ea2 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:14.007307 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-da3f1e8e-8abf-4785-8aa7-d751a7a64ea2 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:14.008043 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-da3f1e8e-8abf-4785-8aa7-d751a7a64ea2 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:14.096380 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-be2f3b04-065a-489e-ba7b-6d50e0231c92 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/images/c852d54e-6bd8-46c7-8b65-bb79b0be25e6" status: 200 len: 1454 microversion: 2.1 time: 0.106176 Oct 04 18:44:14.098571 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1987/3920] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:44:13 2022] GET /compute/v2.1/images/c852d54e-6bd8-46c7-8b65-bb79b0be25e6 => generated 1454 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:14.268232 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-da3f1e8e-8abf-4785-8aa7-d751a7a64ea2 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdfd40fbb91e4c5a8b5a060a6667fa7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e700f423d84c08b35b4eceae2ff6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:14.277994 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-da3f1e8e-8abf-4785-8aa7-d751a7a64ea2 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] 10.222.0.20 "GET /compute/v2.1/servers/298850cf-74ca-4aa2-83c4-03602d5b2260" status: 200 len: 1274 microversion: 2.1 time: 0.334626 Oct 04 18:44:14.278596 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1934/3921] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:13 2022] GET /compute/v2.1/servers/298850cf-74ca-4aa2-83c4-03602d5b2260 => generated 1274 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:44:14.457387 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-63c2253a-1209-43a6-a9fa-056fdc67780f tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:14.458380 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-63c2253a-1209-43a6-a9fa-056fdc67780f tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 160438e8-8561-4edd-9bc8-d0722f35259f] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:14.466379 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-63c2253a-1209-43a6-a9fa-056fdc67780f tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:14.467516 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-63c2253a-1209-43a6-a9fa-056fdc67780f tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:14.468605 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-63c2253a-1209-43a6-a9fa-056fdc67780f tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:14.469558 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-63c2253a-1209-43a6-a9fa-056fdc67780f tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:14.470249 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-63c2253a-1209-43a6-a9fa-056fdc67780f tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:14.471278 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-63c2253a-1209-43a6-a9fa-056fdc67780f tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:14.570809 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-da3f1e8e-8abf-4785-8aa7-d751a7a64ea2 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:14.571812 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-da3f1e8e-8abf-4785-8aa7-d751a7a64ea2 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] 10.222.0.20 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001380 Oct 04 18:44:14.579526 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1935/3922] 10.222.0.20 () {56 vars in 886 bytes} [Tue Oct 4 18:44:14 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 04 18:44:14.696919 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-63c2253a-1209-43a6-a9fa-056fdc67780f tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:14.706220 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-63c2253a-1209-43a6-a9fa-056fdc67780f tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/160438e8-8561-4edd-9bc8-d0722f35259f" status: 200 len: 1306 microversion: 2.1 time: 0.256669 Oct 04 18:44:14.707215 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1988/3923] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:14 2022] GET /compute/v2.1/servers/160438e8-8561-4edd-9bc8-d0722f35259f => generated 1306 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:15.127441 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-08e97f74-512c-4666-bff1-47a0cb02bb2b tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe258905430>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:15.222733 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-08e97f74-512c-4666-bff1-47a0cb02bb2b tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/images/c852d54e-6bd8-46c7-8b65-bb79b0be25e6" status: 200 len: 1454 microversion: 2.1 time: 0.102047 Oct 04 18:44:15.223927 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1936/3924] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:44:15 2022] GET /compute/v2.1/images/c852d54e-6bd8-46c7-8b65-bb79b0be25e6 => generated 1454 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:15.305792 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-01b695ce-252a-47fb-9e36-852b4dfdaa25 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:15.307433 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-01b695ce-252a-47fb-9e36-852b4dfdaa25 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] [instance: 298850cf-74ca-4aa2-83c4-03602d5b2260] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:15.323272 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-01b695ce-252a-47fb-9e36-852b4dfdaa25 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:15.325584 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-01b695ce-252a-47fb-9e36-852b4dfdaa25 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:15.326262 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-01b695ce-252a-47fb-9e36-852b4dfdaa25 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:15.327608 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-01b695ce-252a-47fb-9e36-852b4dfdaa25 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:15.328886 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-01b695ce-252a-47fb-9e36-852b4dfdaa25 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:15.329684 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-01b695ce-252a-47fb-9e36-852b4dfdaa25 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:15.555007 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-01b695ce-252a-47fb-9e36-852b4dfdaa25 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdfd40fbb91e4c5a8b5a060a6667fa7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e700f423d84c08b35b4eceae2ff6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:15.573338 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-01b695ce-252a-47fb-9e36-852b4dfdaa25 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] 10.222.0.20 "GET /compute/v2.1/servers/298850cf-74ca-4aa2-83c4-03602d5b2260" status: 200 len: 1314 microversion: 2.1 time: 0.273992 Oct 04 18:44:15.577271 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1989/3925] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:15 2022] GET /compute/v2.1/servers/298850cf-74ca-4aa2-83c4-03602d5b2260 => generated 1314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:15.739520 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-40d26749-21ec-4611-b1bf-5bd592662f80 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:15.740165 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-40d26749-21ec-4611-b1bf-5bd592662f80 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 160438e8-8561-4edd-9bc8-d0722f35259f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:15.754112 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-40d26749-21ec-4611-b1bf-5bd592662f80 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:15.754919 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-40d26749-21ec-4611-b1bf-5bd592662f80 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:15.758933 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-40d26749-21ec-4611-b1bf-5bd592662f80 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:15.758933 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-40d26749-21ec-4611-b1bf-5bd592662f80 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:15.758933 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-40d26749-21ec-4611-b1bf-5bd592662f80 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:15.758933 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-40d26749-21ec-4611-b1bf-5bd592662f80 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:15.982220 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-40d26749-21ec-4611-b1bf-5bd592662f80 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:15.992430 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-40d26749-21ec-4611-b1bf-5bd592662f80 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/160438e8-8561-4edd-9bc8-d0722f35259f" status: 200 len: 1306 microversion: 2.1 time: 0.260582 Oct 04 18:44:16.010641 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1937/3926] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:15 2022] GET /compute/v2.1/servers/160438e8-8561-4edd-9bc8-d0722f35259f => generated 1306 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:44:16.247031 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-27975cd6-0e96-47f0-af4e-e67e893da83f tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe2592cf310>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:16.258700 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-6ffecf05-7324-4fa3-a33d-5116386c2fda req-fd850610-e4f1-4db6-b863-fe0607536fe2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "298850cf-74ca-4aa2-83c4-03602d5b2260", "tag": "332d0839-706c-4b8e-9a0a-2d5c9bed6f46"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:16.284369 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-6ffecf05-7324-4fa3-a33d-5116386c2fda req-fd850610-e4f1-4db6-b863-fe0607536fe2 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:16.285337 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-6ffecf05-7324-4fa3-a33d-5116386c2fda req-fd850610-e4f1-4db6-b863-fe0607536fe2 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:16.286059 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-6ffecf05-7324-4fa3-a33d-5116386c2fda req-fd850610-e4f1-4db6-b863-fe0607536fe2 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:16.305071 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-6ffecf05-7324-4fa3-a33d-5116386c2fda req-fd850610-e4f1-4db6-b863-fe0607536fe2 service nova] Creating event network-changed:332d0839-706c-4b8e-9a0a-2d5c9bed6f46 for instance 298850cf-74ca-4aa2-83c4-03602d5b2260 on n-h2-850501-14 Oct 04 18:44:16.312941 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-6ffecf05-7324-4fa3-a33d-5116386c2fda req-fd850610-e4f1-4db6-b863-fe0607536fe2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084885 Oct 04 18:44:16.314957 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1990/3927] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:44:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:44:16.359577 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-27975cd6-0e96-47f0-af4e-e67e893da83f tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/images/c852d54e-6bd8-46c7-8b65-bb79b0be25e6" status: 200 len: 1454 microversion: 2.1 time: 0.123306 Oct 04 18:44:16.365020 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1938/3928] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:44:16 2022] GET /compute/v2.1/images/c852d54e-6bd8-46c7-8b65-bb79b0be25e6 => generated 1454 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:16.609960 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f6d5628d-d5d8-4eff-aec1-dad7a24604bb tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:16.609960 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f6d5628d-d5d8-4eff-aec1-dad7a24604bb tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] [instance: 298850cf-74ca-4aa2-83c4-03602d5b2260] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:16.636517 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f6d5628d-d5d8-4eff-aec1-dad7a24604bb tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:16.641371 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f6d5628d-d5d8-4eff-aec1-dad7a24604bb tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:16.641371 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f6d5628d-d5d8-4eff-aec1-dad7a24604bb tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:16.641371 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f6d5628d-d5d8-4eff-aec1-dad7a24604bb tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:16.641371 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f6d5628d-d5d8-4eff-aec1-dad7a24604bb tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:16.641371 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f6d5628d-d5d8-4eff-aec1-dad7a24604bb tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:16.666776 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-d554ae2d-158a-44e1-91ba-791f95208295 req-93ce59b9-d7ad-4060-afd9-46d48de7dcd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "160438e8-8561-4edd-9bc8-d0722f35259f", "name": "network-vif-plugged", "status": "completed", "tag": "66c47011-7f0a-437e-a047-7ff6ea0be179"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:16.694238 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-d554ae2d-158a-44e1-91ba-791f95208295 req-93ce59b9-d7ad-4060-afd9-46d48de7dcd4 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:16.696352 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-d554ae2d-158a-44e1-91ba-791f95208295 req-93ce59b9-d7ad-4060-afd9-46d48de7dcd4 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:16.697022 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-d554ae2d-158a-44e1-91ba-791f95208295 req-93ce59b9-d7ad-4060-afd9-46d48de7dcd4 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:16.719212 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-d554ae2d-158a-44e1-91ba-791f95208295 req-93ce59b9-d7ad-4060-afd9-46d48de7dcd4 service nova] Creating event network-vif-plugged:66c47011-7f0a-437e-a047-7ff6ea0be179 for instance 160438e8-8561-4edd-9bc8-d0722f35259f on n-h1-850501-14 Oct 04 18:44:16.730972 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-d554ae2d-158a-44e1-91ba-791f95208295 req-93ce59b9-d7ad-4060-afd9-46d48de7dcd4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067009 Oct 04 18:44:16.732181 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1939/3929] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:44:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:44:17.020946 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f6d5628d-d5d8-4eff-aec1-dad7a24604bb tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdfd40fbb91e4c5a8b5a060a6667fa7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e700f423d84c08b35b4eceae2ff6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:17.021632 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3c7a6b80-9170-4a58-b1c7-cc0528ff05c0 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:17.022376 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3c7a6b80-9170-4a58-b1c7-cc0528ff05c0 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 160438e8-8561-4edd-9bc8-d0722f35259f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:17.031333 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f6d5628d-d5d8-4eff-aec1-dad7a24604bb tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] 10.222.0.20 "GET /compute/v2.1/servers/298850cf-74ca-4aa2-83c4-03602d5b2260" status: 200 len: 1314 microversion: 2.1 time: 0.434036 Oct 04 18:44:17.050213 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1991/3930] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:16 2022] GET /compute/v2.1/servers/298850cf-74ca-4aa2-83c4-03602d5b2260 => generated 1314 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:17.052206 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3c7a6b80-9170-4a58-b1c7-cc0528ff05c0 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:17.052953 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3c7a6b80-9170-4a58-b1c7-cc0528ff05c0 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:17.053596 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3c7a6b80-9170-4a58-b1c7-cc0528ff05c0 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:17.057386 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3c7a6b80-9170-4a58-b1c7-cc0528ff05c0 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:17.058185 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3c7a6b80-9170-4a58-b1c7-cc0528ff05c0 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:17.058802 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3c7a6b80-9170-4a58-b1c7-cc0528ff05c0 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:17.277107 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3c7a6b80-9170-4a58-b1c7-cc0528ff05c0 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:17.296780 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3c7a6b80-9170-4a58-b1c7-cc0528ff05c0 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/160438e8-8561-4edd-9bc8-d0722f35259f" status: 200 len: 1306 microversion: 2.1 time: 0.280093 Oct 04 18:44:17.297620 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1940/3931] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:17 2022] GET /compute/v2.1/servers/160438e8-8561-4edd-9bc8-d0722f35259f => generated 1306 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:44:17.375989 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1b808734-3caa-4c6a-bf79-69d0fb02e50f tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe253d85670>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:17.452084 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1b808734-3caa-4c6a-bf79-69d0fb02e50f tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/images/c852d54e-6bd8-46c7-8b65-bb79b0be25e6" status: 200 len: 1454 microversion: 2.1 time: 0.079925 Oct 04 18:44:17.452699 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1992/3932] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:44:17 2022] GET /compute/v2.1/images/c852d54e-6bd8-46c7-8b65-bb79b0be25e6 => generated 1454 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:17.672344 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3c7a6b80-9170-4a58-b1c7-cc0528ff05c0 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:17.673350 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3c7a6b80-9170-4a58-b1c7-cc0528ff05c0 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001372 Oct 04 18:44:17.673690 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1941/3933] 10.222.0.20 () {56 vars in 886 bytes} [Tue Oct 4 18:44:17 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 04 18:44:17.681785 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1b808734-3caa-4c6a-bf79-69d0fb02e50f tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:17.682891 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1b808734-3caa-4c6a-bf79-69d0fb02e50f tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.001648 Oct 04 18:44:17.690365 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1993/3934] 10.222.0.20 () {54 vars in 1035 bytes} [Tue Oct 4 18:44:17 2022] GET /compute/v2/ => generated 379 bytes in 9 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Oct 04 18:44:17.692919 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3c7a6b80-9170-4a58-b1c7-cc0528ff05c0 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:17.693976 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3c7a6b80-9170-4a58-b1c7-cc0528ff05c0 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001765 Oct 04 18:44:17.694392 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1942/3935] 10.222.0.20 () {54 vars in 1041 bytes} [Tue Oct 4 18:44:17 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:44:17.703657 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1b808734-3caa-4c6a-bf79-69d0fb02e50f tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:17.704708 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1b808734-3caa-4c6a-bf79-69d0fb02e50f tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001339 Oct 04 18:44:17.705274 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1994/3936] 10.222.0.20 () {56 vars in 886 bytes} [Tue Oct 4 18:44:17 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 04 18:44:18.063642 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b7241a17-aeb1-4c64-855e-539503a2b6f7 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:18.064286 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b7241a17-aeb1-4c64-855e-539503a2b6f7 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] [instance: 298850cf-74ca-4aa2-83c4-03602d5b2260] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:18.070957 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b7241a17-aeb1-4c64-855e-539503a2b6f7 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:18.071441 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b7241a17-aeb1-4c64-855e-539503a2b6f7 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:18.071879 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b7241a17-aeb1-4c64-855e-539503a2b6f7 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:18.072601 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b7241a17-aeb1-4c64-855e-539503a2b6f7 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:18.073054 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b7241a17-aeb1-4c64-855e-539503a2b6f7 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:18.073488 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b7241a17-aeb1-4c64-855e-539503a2b6f7 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:18.230872 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b7241a17-aeb1-4c64-855e-539503a2b6f7 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdfd40fbb91e4c5a8b5a060a6667fa7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e700f423d84c08b35b4eceae2ff6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:18.245242 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b7241a17-aeb1-4c64-855e-539503a2b6f7 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] 10.222.0.20 "GET /compute/v2.1/servers/298850cf-74ca-4aa2-83c4-03602d5b2260" status: 200 len: 1314 microversion: 2.1 time: 0.188048 Oct 04 18:44:18.245939 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1943/3937] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:18 2022] GET /compute/v2.1/servers/298850cf-74ca-4aa2-83c4-03602d5b2260 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:18.323532 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-80db93ad-b96e-4e2f-a93e-90c732473d53 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:18.324300 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-80db93ad-b96e-4e2f-a93e-90c732473d53 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 160438e8-8561-4edd-9bc8-d0722f35259f] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:18.346015 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-80db93ad-b96e-4e2f-a93e-90c732473d53 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:18.351060 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-80db93ad-b96e-4e2f-a93e-90c732473d53 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:18.352894 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-80db93ad-b96e-4e2f-a93e-90c732473d53 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:18.354232 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-80db93ad-b96e-4e2f-a93e-90c732473d53 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:18.355474 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-80db93ad-b96e-4e2f-a93e-90c732473d53 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:18.356355 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-80db93ad-b96e-4e2f-a93e-90c732473d53 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:18.468551 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-09ec260a-f712-4ec4-b6d3-8c3d27758ec7 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe2588b3820>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:18.559016 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-09ec260a-f712-4ec4-b6d3-8c3d27758ec7 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/images/c852d54e-6bd8-46c7-8b65-bb79b0be25e6" status: 200 len: 1454 microversion: 2.1 time: 0.095865 Oct 04 18:44:18.559914 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1944/3938] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:44:18 2022] GET /compute/v2.1/images/c852d54e-6bd8-46c7-8b65-bb79b0be25e6 => generated 1454 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:44:18.574235 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-80db93ad-b96e-4e2f-a93e-90c732473d53 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:18.586709 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-80db93ad-b96e-4e2f-a93e-90c732473d53 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/160438e8-8561-4edd-9bc8-d0722f35259f" status: 200 len: 1306 microversion: 2.1 time: 0.268412 Oct 04 18:44:18.587292 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1995/3939] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:18 2022] GET /compute/v2.1/servers/160438e8-8561-4edd-9bc8-d0722f35259f => generated 1306 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:19.275625 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f19a438e-dc65-47bd-bc9e-7b7be32f9e60 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:19.277228 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f19a438e-dc65-47bd-bc9e-7b7be32f9e60 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] [instance: 298850cf-74ca-4aa2-83c4-03602d5b2260] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:19.300186 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f19a438e-dc65-47bd-bc9e-7b7be32f9e60 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:19.300803 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f19a438e-dc65-47bd-bc9e-7b7be32f9e60 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:19.301771 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f19a438e-dc65-47bd-bc9e-7b7be32f9e60 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:19.302734 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f19a438e-dc65-47bd-bc9e-7b7be32f9e60 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:19.305414 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f19a438e-dc65-47bd-bc9e-7b7be32f9e60 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:19.307198 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f19a438e-dc65-47bd-bc9e-7b7be32f9e60 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:19.526112 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f19a438e-dc65-47bd-bc9e-7b7be32f9e60 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdfd40fbb91e4c5a8b5a060a6667fa7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e700f423d84c08b35b4eceae2ff6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:19.535530 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f19a438e-dc65-47bd-bc9e-7b7be32f9e60 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] 10.222.0.20 "GET /compute/v2.1/servers/298850cf-74ca-4aa2-83c4-03602d5b2260" status: 200 len: 1314 microversion: 2.1 time: 0.269707 Oct 04 18:44:19.536598 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1945/3940] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:19 2022] GET /compute/v2.1/servers/298850cf-74ca-4aa2-83c4-03602d5b2260 => generated 1314 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:19.578280 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-68c30812-af11-454f-90e0-83ceb558159f tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe2582bf430>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:19.612299 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d7d9b3f5-8dd1-4bf5-845d-12f35a819a20 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:19.613158 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d7d9b3f5-8dd1-4bf5-845d-12f35a819a20 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 160438e8-8561-4edd-9bc8-d0722f35259f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:19.620555 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d7d9b3f5-8dd1-4bf5-845d-12f35a819a20 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:19.631283 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d7d9b3f5-8dd1-4bf5-845d-12f35a819a20 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:19.632015 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d7d9b3f5-8dd1-4bf5-845d-12f35a819a20 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:19.633255 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d7d9b3f5-8dd1-4bf5-845d-12f35a819a20 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:19.635351 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d7d9b3f5-8dd1-4bf5-845d-12f35a819a20 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:19.635973 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d7d9b3f5-8dd1-4bf5-845d-12f35a819a20 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:19.659943 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-68c30812-af11-454f-90e0-83ceb558159f tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/images/c852d54e-6bd8-46c7-8b65-bb79b0be25e6" status: 200 len: 1454 microversion: 2.1 time: 0.086470 Oct 04 18:44:19.660854 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1996/3941] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:44:19 2022] GET /compute/v2.1/images/c852d54e-6bd8-46c7-8b65-bb79b0be25e6 => generated 1454 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:19.820232 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d7d9b3f5-8dd1-4bf5-845d-12f35a819a20 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:19.844233 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d7d9b3f5-8dd1-4bf5-845d-12f35a819a20 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/160438e8-8561-4edd-9bc8-d0722f35259f" status: 200 len: 1486 microversion: 2.1 time: 0.221463 Oct 04 18:44:19.844233 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1946/3942] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:19 2022] GET /compute/v2.1/servers/160438e8-8561-4edd-9bc8-d0722f35259f => generated 1486 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:19.856651 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-af7f75c6-05bb-4112-88a2-73d240e8abd0 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:19.862292 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-af7f75c6-05bb-4112-88a2-73d240e8abd0 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 160438e8-8561-4edd-9bc8-d0722f35259f] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:19.867859 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-af7f75c6-05bb-4112-88a2-73d240e8abd0 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:19.868751 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-af7f75c6-05bb-4112-88a2-73d240e8abd0 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:19.869242 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-af7f75c6-05bb-4112-88a2-73d240e8abd0 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:19.869953 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-af7f75c6-05bb-4112-88a2-73d240e8abd0 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:19.870409 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-af7f75c6-05bb-4112-88a2-73d240e8abd0 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:19.870831 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-af7f75c6-05bb-4112-88a2-73d240e8abd0 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:20.023287 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-af7f75c6-05bb-4112-88a2-73d240e8abd0 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "PUT /compute/v2.1/servers/160438e8-8561-4edd-9bc8-d0722f35259f" status: 200 len: 1081 microversion: 2.1 time: 0.170936 Oct 04 18:44:20.023924 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1997/3943] 10.222.0.20 () {60 vars in 1256 bytes} [Tue Oct 4 18:44:19 2022] PUT /compute/v2.1/servers/160438e8-8561-4edd-9bc8-d0722f35259f => generated 1081 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:20.045742 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f3dfc782-6e3a-48a7-b8a8-aeab3186a608 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:20.046803 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f3dfc782-6e3a-48a7-b8a8-aeab3186a608 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 160438e8-8561-4edd-9bc8-d0722f35259f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:20.054868 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f3dfc782-6e3a-48a7-b8a8-aeab3186a608 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:20.055828 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f3dfc782-6e3a-48a7-b8a8-aeab3186a608 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:20.056372 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f3dfc782-6e3a-48a7-b8a8-aeab3186a608 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:20.057182 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f3dfc782-6e3a-48a7-b8a8-aeab3186a608 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:20.057809 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f3dfc782-6e3a-48a7-b8a8-aeab3186a608 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:20.058406 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f3dfc782-6e3a-48a7-b8a8-aeab3186a608 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:20.222851 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f3dfc782-6e3a-48a7-b8a8-aeab3186a608 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:20.232498 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f3dfc782-6e3a-48a7-b8a8-aeab3186a608 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/160438e8-8561-4edd-9bc8-d0722f35259f" status: 200 len: 1507 microversion: 2.1 time: 0.191528 Oct 04 18:44:20.233930 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1947/3944] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:20 2022] GET /compute/v2.1/servers/160438e8-8561-4edd-9bc8-d0722f35259f => generated 1507 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:20.261229 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d07e14db-1bb4-41ef-9eb6-556df8b8adb9 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:20.262136 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d07e14db-1bb4-41ef-9eb6-556df8b8adb9 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 160438e8-8561-4edd-9bc8-d0722f35259f] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:20.269039 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=4 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:44:20.271018 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d07e14db-1bb4-41ef-9eb6-556df8b8adb9 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:20.271941 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d07e14db-1bb4-41ef-9eb6-556df8b8adb9 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:20.272695 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d07e14db-1bb4-41ef-9eb6-556df8b8adb9 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:20.273639 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d07e14db-1bb4-41ef-9eb6-556df8b8adb9 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:20.274323 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d07e14db-1bb4-41ef-9eb6-556df8b8adb9 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:20.274913 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d07e14db-1bb4-41ef-9eb6-556df8b8adb9 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:20.432101 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d07e14db-1bb4-41ef-9eb6-556df8b8adb9 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:20.440317 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d07e14db-1bb4-41ef-9eb6-556df8b8adb9 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/160438e8-8561-4edd-9bc8-d0722f35259f" status: 200 len: 1507 microversion: 2.1 time: 0.183059 Oct 04 18:44:20.440911 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1998/3945] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:20 2022] GET /compute/v2.1/servers/160438e8-8561-4edd-9bc8-d0722f35259f => generated 1507 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:20.463601 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-fd4bf5c4-3b2e-49e4-8716-fa79a74e7c3e tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:20.464019 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-fd4bf5c4-3b2e-49e4-8716-fa79a74e7c3e tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 160438e8-8561-4edd-9bc8-d0722f35259f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:20.471864 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fd4bf5c4-3b2e-49e4-8716-fa79a74e7c3e tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:20.472675 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fd4bf5c4-3b2e-49e4-8716-fa79a74e7c3e tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:20.473119 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fd4bf5c4-3b2e-49e4-8716-fa79a74e7c3e tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:20.473835 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fd4bf5c4-3b2e-49e4-8716-fa79a74e7c3e tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:20.474296 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fd4bf5c4-3b2e-49e4-8716-fa79a74e7c3e tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:20.475091 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fd4bf5c4-3b2e-49e4-8716-fa79a74e7c3e tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:20.508097 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-fd4bf5c4-3b2e-49e4-8716-fa79a74e7c3e tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 160438e8-8561-4edd-9bc8-d0722f35259f] Going to try to terminate instance {{(pid=123002) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:44:20.561209 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0f4a5b67-90e9-443f-b8fe-0edae5fa0035 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:20.566984 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0f4a5b67-90e9-443f-b8fe-0edae5fa0035 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] [instance: 298850cf-74ca-4aa2-83c4-03602d5b2260] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:20.570384 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0f4a5b67-90e9-443f-b8fe-0edae5fa0035 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:20.571119 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0f4a5b67-90e9-443f-b8fe-0edae5fa0035 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:20.574224 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0f4a5b67-90e9-443f-b8fe-0edae5fa0035 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:20.575107 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0f4a5b67-90e9-443f-b8fe-0edae5fa0035 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:20.575845 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0f4a5b67-90e9-443f-b8fe-0edae5fa0035 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:20.577216 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0f4a5b67-90e9-443f-b8fe-0edae5fa0035 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:20.601090 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=14 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:44:20.785209 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0f4a5b67-90e9-443f-b8fe-0edae5fa0035 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdfd40fbb91e4c5a8b5a060a6667fa7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e700f423d84c08b35b4eceae2ff6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:20.795230 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0f4a5b67-90e9-443f-b8fe-0edae5fa0035 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] 10.222.0.20 "GET /compute/v2.1/servers/298850cf-74ca-4aa2-83c4-03602d5b2260" status: 200 len: 1314 microversion: 2.1 time: 0.238753 Oct 04 18:44:20.819137 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 1999/3946] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:20 2022] GET /compute/v2.1/servers/298850cf-74ca-4aa2-83c4-03602d5b2260 => generated 1314 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:44:20.826408 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1ee20492-cab2-4d65-bcff-552bf489c74a tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe2582d4c10>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:20.848556 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-fd4bf5c4-3b2e-49e4-8716-fa79a74e7c3e tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "DELETE /compute/v2.1/servers/160438e8-8561-4edd-9bc8-d0722f35259f" status: 204 len: 0 microversion: 2.1 time: 0.387461 Oct 04 18:44:20.850162 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1948/3947] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:44:20 2022] DELETE /compute/v2.1/servers/160438e8-8561-4edd-9bc8-d0722f35259f => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:44:20.867739 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5c5e2591-5c93-4567-8eb1-6973704cd411 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:20.873242 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5c5e2591-5c93-4567-8eb1-6973704cd411 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 160438e8-8561-4edd-9bc8-d0722f35259f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:20.897431 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5c5e2591-5c93-4567-8eb1-6973704cd411 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:20.899152 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5c5e2591-5c93-4567-8eb1-6973704cd411 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:20.900990 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5c5e2591-5c93-4567-8eb1-6973704cd411 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:20.902532 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5c5e2591-5c93-4567-8eb1-6973704cd411 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:20.904422 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1ee20492-cab2-4d65-bcff-552bf489c74a tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/images/c852d54e-6bd8-46c7-8b65-bb79b0be25e6" status: 200 len: 1454 microversion: 2.1 time: 0.084019 Oct 04 18:44:20.905777 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5c5e2591-5c93-4567-8eb1-6973704cd411 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:20.906452 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5c5e2591-5c93-4567-8eb1-6973704cd411 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:20.913107 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2000/3948] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:44:20 2022] GET /compute/v2.1/images/c852d54e-6bd8-46c7-8b65-bb79b0be25e6 => generated 1454 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:21.095775 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5c5e2591-5c93-4567-8eb1-6973704cd411 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:21.104494 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5c5e2591-5c93-4567-8eb1-6973704cd411 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/160438e8-8561-4edd-9bc8-d0722f35259f" status: 200 len: 1513 microversion: 2.1 time: 0.249281 Oct 04 18:44:21.105146 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1949/3949] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:20 2022] GET /compute/v2.1/servers/160438e8-8561-4edd-9bc8-d0722f35259f => generated 1513 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:44:21.826743 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c9a48ac0-b84d-49be-916a-ce7adfd82853 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:21.827364 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c9a48ac0-b84d-49be-916a-ce7adfd82853 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] [instance: 298850cf-74ca-4aa2-83c4-03602d5b2260] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:21.833965 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c9a48ac0-b84d-49be-916a-ce7adfd82853 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:21.834467 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c9a48ac0-b84d-49be-916a-ce7adfd82853 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:21.835052 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c9a48ac0-b84d-49be-916a-ce7adfd82853 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:21.835866 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c9a48ac0-b84d-49be-916a-ce7adfd82853 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:21.836794 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c9a48ac0-b84d-49be-916a-ce7adfd82853 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:21.837370 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c9a48ac0-b84d-49be-916a-ce7adfd82853 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:21.920549 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-24cb3d0e-a0ec-4df3-b51e-51ddfb704960 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe25d1248b0>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:21.928016 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=4 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:44:21.976085 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-24cb3d0e-a0ec-4df3-b51e-51ddfb704960 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/images/c852d54e-6bd8-46c7-8b65-bb79b0be25e6" status: 200 len: 1454 microversion: 2.1 time: 0.060087 Oct 04 18:44:21.976939 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1950/3950] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:44:21 2022] GET /compute/v2.1/images/c852d54e-6bd8-46c7-8b65-bb79b0be25e6 => generated 1454 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:44:21.987286 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c9a48ac0-b84d-49be-916a-ce7adfd82853 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdfd40fbb91e4c5a8b5a060a6667fa7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e700f423d84c08b35b4eceae2ff6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:21.995621 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c9a48ac0-b84d-49be-916a-ce7adfd82853 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] 10.222.0.20 "GET /compute/v2.1/servers/298850cf-74ca-4aa2-83c4-03602d5b2260" status: 200 len: 1314 microversion: 2.1 time: 0.173971 Oct 04 18:44:21.996287 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2001/3951] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:21 2022] GET /compute/v2.1/servers/298850cf-74ca-4aa2-83c4-03602d5b2260 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:22.135824 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c877c872-b7b4-4767-a1b1-44b1d301a235 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:22.136481 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c877c872-b7b4-4767-a1b1-44b1d301a235 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 160438e8-8561-4edd-9bc8-d0722f35259f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:22.151337 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c877c872-b7b4-4767-a1b1-44b1d301a235 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:22.151822 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c877c872-b7b4-4767-a1b1-44b1d301a235 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:22.152313 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c877c872-b7b4-4767-a1b1-44b1d301a235 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:22.152996 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c877c872-b7b4-4767-a1b1-44b1d301a235 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:22.153452 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c877c872-b7b4-4767-a1b1-44b1d301a235 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:22.154318 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c877c872-b7b4-4767-a1b1-44b1d301a235 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:22.307046 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c877c872-b7b4-4767-a1b1-44b1d301a235 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:22.317170 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c877c872-b7b4-4767-a1b1-44b1d301a235 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/160438e8-8561-4edd-9bc8-d0722f35259f" status: 200 len: 1513 microversion: 2.1 time: 0.185207 Oct 04 18:44:22.319313 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1951/3952] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:22 2022] GET /compute/v2.1/servers/160438e8-8561-4edd-9bc8-d0722f35259f => generated 1513 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:22.992819 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-32aaf7b1-b244-4f61-86cc-94c08d1b3c71 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe253d8fee0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:23.025481 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-61ad6680-aae6-4bf4-85a4-b7016083c1a0 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:23.026859 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-61ad6680-aae6-4bf4-85a4-b7016083c1a0 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] [instance: 298850cf-74ca-4aa2-83c4-03602d5b2260] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:23.068369 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-61ad6680-aae6-4bf4-85a4-b7016083c1a0 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:23.068369 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-61ad6680-aae6-4bf4-85a4-b7016083c1a0 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:23.068821 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-61ad6680-aae6-4bf4-85a4-b7016083c1a0 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:23.069749 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-61ad6680-aae6-4bf4-85a4-b7016083c1a0 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:23.071804 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-61ad6680-aae6-4bf4-85a4-b7016083c1a0 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:23.072575 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-61ad6680-aae6-4bf4-85a4-b7016083c1a0 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:23.081441 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-32aaf7b1-b244-4f61-86cc-94c08d1b3c71 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/images/c852d54e-6bd8-46c7-8b65-bb79b0be25e6" status: 200 len: 1454 microversion: 2.1 time: 0.091296 Oct 04 18:44:23.082122 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2002/3953] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:44:22 2022] GET /compute/v2.1/images/c852d54e-6bd8-46c7-8b65-bb79b0be25e6 => generated 1454 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:23.089316 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-1ef56430-a954-4fff-834e-c73b521b42c0 req-60810ff4-44be-4798-af66-b2fe361440e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "160438e8-8561-4edd-9bc8-d0722f35259f", "name": "network-vif-deleted", "tag": "66c47011-7f0a-437e-a047-7ff6ea0be179"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:23.106815 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-1ef56430-a954-4fff-834e-c73b521b42c0 req-60810ff4-44be-4798-af66-b2fe361440e6 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:23.107677 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-1ef56430-a954-4fff-834e-c73b521b42c0 req-60810ff4-44be-4798-af66-b2fe361440e6 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:23.108343 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-1ef56430-a954-4fff-834e-c73b521b42c0 req-60810ff4-44be-4798-af66-b2fe361440e6 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:23.113855 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:44:23.125944 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-1ef56430-a954-4fff-834e-c73b521b42c0 req-60810ff4-44be-4798-af66-b2fe361440e6 service nova] Creating event network-vif-deleted:66c47011-7f0a-437e-a047-7ff6ea0be179 for instance 160438e8-8561-4edd-9bc8-d0722f35259f on n-h1-850501-14 Oct 04 18:44:23.134953 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-1ef56430-a954-4fff-834e-c73b521b42c0 req-60810ff4-44be-4798-af66-b2fe361440e6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046392 Oct 04 18:44:23.135998 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2003/3954] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:44:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:44:23.314714 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-61ad6680-aae6-4bf4-85a4-b7016083c1a0 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdfd40fbb91e4c5a8b5a060a6667fa7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e700f423d84c08b35b4eceae2ff6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:23.326367 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-61ad6680-aae6-4bf4-85a4-b7016083c1a0 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] 10.222.0.20 "GET /compute/v2.1/servers/298850cf-74ca-4aa2-83c4-03602d5b2260" status: 200 len: 1314 microversion: 2.1 time: 0.309856 Oct 04 18:44:23.342921 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1952/3955] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:23 2022] GET /compute/v2.1/servers/298850cf-74ca-4aa2-83c4-03602d5b2260 => generated 1314 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:23.346173 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-73db08f9-25fc-4736-8b37-59ad9d797978 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:23.346897 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-73db08f9-25fc-4736-8b37-59ad9d797978 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 160438e8-8561-4edd-9bc8-d0722f35259f] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:23.353755 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-73db08f9-25fc-4736-8b37-59ad9d797978 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:23.354252 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-73db08f9-25fc-4736-8b37-59ad9d797978 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:23.354694 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-73db08f9-25fc-4736-8b37-59ad9d797978 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:23.355552 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-73db08f9-25fc-4736-8b37-59ad9d797978 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:23.356237 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-73db08f9-25fc-4736-8b37-59ad9d797978 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:23.357441 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-73db08f9-25fc-4736-8b37-59ad9d797978 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:23.410798 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-73db08f9-25fc-4736-8b37-59ad9d797978 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:23.411188 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-73db08f9-25fc-4736-8b37-59ad9d797978 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:23.411632 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-73db08f9-25fc-4736-8b37-59ad9d797978 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:23.412117 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-73db08f9-25fc-4736-8b37-59ad9d797978 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lazy-loading 'fault' on Instance uuid 160438e8-8561-4edd-9bc8-d0722f35259f {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:44:23.459658 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-73db08f9-25fc-4736-8b37-59ad9d797978 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:23.468675 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-73db08f9-25fc-4736-8b37-59ad9d797978 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/160438e8-8561-4edd-9bc8-d0722f35259f" status: 200 len: 1317 microversion: 2.1 time: 0.127201 Oct 04 18:44:23.486378 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2004/3956] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:23 2022] GET /compute/v2.1/servers/160438e8-8561-4edd-9bc8-d0722f35259f => generated 1317 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:24.064717 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-afadaca9-d8da-463c-9567-15b9300e0da2 req-d529dba0-380c-4c5b-a4c5-11393543fa42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "298850cf-74ca-4aa2-83c4-03602d5b2260", "name": "network-vif-plugged", "status": "completed", "tag": "332d0839-706c-4b8e-9a0a-2d5c9bed6f46"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:24.076936 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-afadaca9-d8da-463c-9567-15b9300e0da2 req-d529dba0-380c-4c5b-a4c5-11393543fa42 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:24.077414 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-afadaca9-d8da-463c-9567-15b9300e0da2 req-d529dba0-380c-4c5b-a4c5-11393543fa42 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:24.077863 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-afadaca9-d8da-463c-9567-15b9300e0da2 req-d529dba0-380c-4c5b-a4c5-11393543fa42 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:24.089033 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-afadaca9-d8da-463c-9567-15b9300e0da2 req-d529dba0-380c-4c5b-a4c5-11393543fa42 service nova] Creating event network-vif-plugged:332d0839-706c-4b8e-9a0a-2d5c9bed6f46 for instance 298850cf-74ca-4aa2-83c4-03602d5b2260 on n-h2-850501-14 Oct 04 18:44:24.095456 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-afadaca9-d8da-463c-9567-15b9300e0da2 req-d529dba0-380c-4c5b-a4c5-11393543fa42 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036990 Oct 04 18:44:24.099425 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1953/3957] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:44:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:44:24.099984 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f13402f5-16db-40d6-9daf-d1fa8b3ffed1 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe253d56ee0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:24.146020 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f13402f5-16db-40d6-9daf-d1fa8b3ffed1 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/images/c852d54e-6bd8-46c7-8b65-bb79b0be25e6" status: 200 len: 1463 microversion: 2.1 time: 0.053026 Oct 04 18:44:24.146601 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2005/3958] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:44:24 2022] GET /compute/v2.1/images/c852d54e-6bd8-46c7-8b65-bb79b0be25e6 => generated 1463 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:44:24.162328 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-147a4b32-f2eb-4218-825d-926459e4694b tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe25d2ad790>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:24.229851 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-147a4b32-f2eb-4218-825d-926459e4694b tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/images/c852d54e-6bd8-46c7-8b65-bb79b0be25e6" status: 200 len: 1463 microversion: 2.1 time: 0.072407 Oct 04 18:44:24.230025 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1954/3959] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:44:24 2022] GET /compute/v2.1/images/c852d54e-6bd8-46c7-8b65-bb79b0be25e6 => generated 1463 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:24.246684 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b71d0f25-182a-479d-9796-ee5a6a48be49 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:24.248084 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b71d0f25-182a-479d-9796-ee5a6a48be49 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] [instance: 6905c432-0fb3-4f5a-84bb-0ffcb08e2b3c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:24.255051 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b71d0f25-182a-479d-9796-ee5a6a48be49 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:24.255577 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b71d0f25-182a-479d-9796-ee5a6a48be49 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:24.256022 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b71d0f25-182a-479d-9796-ee5a6a48be49 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:24.256760 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b71d0f25-182a-479d-9796-ee5a6a48be49 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:24.257246 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b71d0f25-182a-479d-9796-ee5a6a48be49 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:24.257801 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b71d0f25-182a-479d-9796-ee5a6a48be49 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:24.351414 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-13ab49ed-062a-427e-ac9c-6a63b34ef2aa tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:24.352217 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-13ab49ed-062a-427e-ac9c-6a63b34ef2aa tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] [instance: 298850cf-74ca-4aa2-83c4-03602d5b2260] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:24.361067 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-13ab49ed-062a-427e-ac9c-6a63b34ef2aa tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:24.361858 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-13ab49ed-062a-427e-ac9c-6a63b34ef2aa tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:24.362476 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-13ab49ed-062a-427e-ac9c-6a63b34ef2aa tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:24.363685 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-13ab49ed-062a-427e-ac9c-6a63b34ef2aa tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:24.364532 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-13ab49ed-062a-427e-ac9c-6a63b34ef2aa tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:24.365147 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-13ab49ed-062a-427e-ac9c-6a63b34ef2aa tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:24.451085 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b71d0f25-182a-479d-9796-ee5a6a48be49 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8d2814c23a4aa9806d56ce99c89e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8596483de9f14de9a88cdb787841fd3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:24.459557 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b71d0f25-182a-479d-9796-ee5a6a48be49 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/servers/6905c432-0fb3-4f5a-84bb-0ffcb08e2b3c" status: 200 len: 1479 microversion: 2.1 time: 0.218633 Oct 04 18:44:24.460900 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2006/3960] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:24 2022] GET /compute/v2.1/servers/6905c432-0fb3-4f5a-84bb-0ffcb08e2b3c => generated 1479 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:24.493365 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-018eb262-702e-4db5-88ff-cee1d9ccee57 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:24.493984 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-018eb262-702e-4db5-88ff-cee1d9ccee57 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 160438e8-8561-4edd-9bc8-d0722f35259f] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:24.500900 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-018eb262-702e-4db5-88ff-cee1d9ccee57 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:24.501658 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-018eb262-702e-4db5-88ff-cee1d9ccee57 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:24.502345 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-018eb262-702e-4db5-88ff-cee1d9ccee57 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:24.503230 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-018eb262-702e-4db5-88ff-cee1d9ccee57 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:24.503865 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-018eb262-702e-4db5-88ff-cee1d9ccee57 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:24.504501 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-018eb262-702e-4db5-88ff-cee1d9ccee57 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:24.524964 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-018eb262-702e-4db5-88ff-cee1d9ccee57 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] HTTP exception thrown: Instance 160438e8-8561-4edd-9bc8-d0722f35259f could not be found. Oct 04 18:44:24.526829 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-018eb262-702e-4db5-88ff-cee1d9ccee57 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Request method failure captured: Oct 04 18:44:24.526829 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/160438e8-8561-4edd-9bc8-d0722f35259f HTTP/1.1 Oct 04 18:44:24.526829 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:44:24.526829 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:44:24.526829 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:44:24.526829 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:44:24.526829 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:44:24.526829 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:44:24.526829 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:44:24.526829 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:44:24.526829 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPH5kaFyiFSIO0ZP4CMGEO428dJiNuEG6R-LLS8mNsVetgcf6w0D7DIrYZ_G7YOzpJ5huW8oCnx3-jlxIKVdxxsS18taUnXx6Xt5KnL4IkhJLGYxbDrAUBLCXM7M3o65rqEELwzRRnK71NdjnupluHpvvCSPBSNhy32oTLBkDAxSrOgs Oct 04 18:44:24.526829 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:44:24.526829 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:44:24.526829 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:44:24.526829 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:44:24.526829 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:44:24.526829 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:44:24.526829 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: a9046b9540144eeba512d79438635ea8 Oct 04 18:44:24.526829 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ServersTestJSON-380527700 Oct 04 18:44:24.526829 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:44:24.526829 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:44:24.526829 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a9046b9540144eeba512d79438635ea8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a9046b9540144eeba512d79438635ea8", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a9046b9540144eeba512d79438635ea8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a9046b9540144eeba512d79438635ea8"}]}] Oct 04 18:44:24.526829 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ServersTestJSON-380527700 Oct 04 18:44:24.526829 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: a9046b9540144eeba512d79438635ea8 Oct 04 18:44:24.526829 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ServersTestJSON-380527700 Oct 04 18:44:24.526829 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ServersTestJSON-380527700-project Oct 04 18:44:24.526829 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:44:24.526829 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:44:24.526829 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 8a6c3725b31449d5bf1ff757ff66c8d7 Oct 04 18:44:24.526829 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ServersTestJSON-380527700-project Oct 04 18:44:24.526829 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:44:24.526829 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 160438e8-8561-4edd-9bc8-d0722f35259f could not be found. Oct 04 18:44:24.526829 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '160438e8-8561-4edd-9bc8-d0722f35259f'} Oct 04 18:44:24.526829 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:44:24.526829 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:44:24.526829 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:44:24.526829 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:44:24.526829 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:44:24.526829 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:44:24.526829 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:44:24.526829 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:44:24.526829 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:44:24.526829 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:44:24.526829 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 160438e8-8561-4edd-9bc8-d0722f35259f could not be found. Oct 04 18:44:24.526829 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:44:24.526829 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:44:24.526829 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:44:24.526829 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:44:24.526829 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:44:24.526829 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:44:24.526829 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:44:24.526829 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:44:24.526829 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:44:24.526829 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:44:24.526829 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:44:24.526829 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:44:24.526829 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:44:24.526829 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:44:24.526829 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:44:24.526829 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:44:24.526829 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 160438e8-8561-4edd-9bc8-d0722f35259f could not be found. Oct 04 18:44:24.526829 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:44:24.526829 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:44:24.526829 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:44:24.526829 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:44:24.532672 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:44:24.532672 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:44:24.532672 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:44:24.532672 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:44:24.532672 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 160438e8-8561-4edd-9bc8-d0722f35259f could not be found. Oct 04 18:44:24.532672 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:44:24.534620 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-018eb262-702e-4db5-88ff-cee1d9ccee57 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Returning 404 to user: Instance 160438e8-8561-4edd-9bc8-d0722f35259f could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:44:24.535739 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-018eb262-702e-4db5-88ff-cee1d9ccee57 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/160438e8-8561-4edd-9bc8-d0722f35259f" status: 404 len: 111 microversion: 2.1 time: 0.046363 Oct 04 18:44:24.537951 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2007/3961] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:24 2022] GET /compute/v2.1/servers/160438e8-8561-4edd-9bc8-d0722f35259f => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:44:24.588497 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-13ab49ed-062a-427e-ac9c-6a63b34ef2aa tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdfd40fbb91e4c5a8b5a060a6667fa7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e700f423d84c08b35b4eceae2ff6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:24.599351 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-13ab49ed-062a-427e-ac9c-6a63b34ef2aa tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] 10.222.0.20 "GET /compute/v2.1/servers/298850cf-74ca-4aa2-83c4-03602d5b2260" status: 200 len: 1314 microversion: 2.1 time: 0.252371 Oct 04 18:44:24.599936 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1955/3962] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:24 2022] GET /compute/v2.1/servers/298850cf-74ca-4aa2-83c4-03602d5b2260 => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:44:24.661718 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f8515071-df3d-4dd8-8cf4-a7b3c8f0b425 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1517092664", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": [{"uuid": "ea7ea2b5-3fb7-4eeb-8ba9-cbc81d7265bf"}]}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:24.720119 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.neutron [None req-f8515071-df3d-4dd8-8cf4-a7b3c8f0b425 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] validate_networks() for [('ea7ea2b5-3fb7-4eeb-8ba9-cbc81d7265bf', None, None, None, None, None)] {{(pid=123001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:44:25.114041 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-f8515071-df3d-4dd8-8cf4-a7b3c8f0b425 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:44:25.114831 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-f8515071-df3d-4dd8-8cf4-a7b3c8f0b425 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:44:25.115134 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-f8515071-df3d-4dd8-8cf4-a7b3c8f0b425 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:44:25.115876 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-f8515071-df3d-4dd8-8cf4-a7b3c8f0b425 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:44:25.116711 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-f8515071-df3d-4dd8-8cf4-a7b3c8f0b425 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:44:25.130975 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f8515071-df3d-4dd8-8cf4-a7b3c8f0b425 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:25.131690 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f8515071-df3d-4dd8-8cf4-a7b3c8f0b425 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:25.132279 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f8515071-df3d-4dd8-8cf4-a7b3c8f0b425 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:25.133053 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f8515071-df3d-4dd8-8cf4-a7b3c8f0b425 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:25.133599 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f8515071-df3d-4dd8-8cf4-a7b3c8f0b425 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:25.134262 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f8515071-df3d-4dd8-8cf4-a7b3c8f0b425 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:25.156298 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-f8515071-df3d-4dd8-8cf4-a7b3c8f0b425 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Getting quotas for project a9046b9540144eeba512d79438635ea8. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:44:25.161936 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-f8515071-df3d-4dd8-8cf4-a7b3c8f0b425 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Getting quotas for user 8a6c3725b31449d5bf1ff757ff66c8d7 and project a9046b9540144eeba512d79438635ea8. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:44:25.175030 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f8515071-df3d-4dd8-8cf4-a7b3c8f0b425 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Going to run 1 instances... {{(pid=123001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:44:25.177386 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f8515071-df3d-4dd8-8cf4-a7b3c8f0b425 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:44:25.347014 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f8515071-df3d-4dd8-8cf4-a7b3c8f0b425 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.690359 Oct 04 18:44:25.347662 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2008/3963] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:44:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 692 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:44:25.359604 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d34994ef-4089-4140-98a1-36a4a1393fbb tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:25.360265 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d34994ef-4089-4140-98a1-36a4a1393fbb tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:25.423299 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d34994ef-4089-4140-98a1-36a4a1393fbb tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:25.430750 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d34994ef-4089-4140-98a1-36a4a1393fbb tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51" status: 200 len: 1209 microversion: 2.1 time: 0.075633 Oct 04 18:44:25.431341 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1956/3964] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:25 2022] GET /compute/v2.1/servers/c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51 => generated 1209 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:25.486332 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a892954c-5faf-4cca-8e42-0f177a5e704b tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:25.486959 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a892954c-5faf-4cca-8e42-0f177a5e704b tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] [instance: 6905c432-0fb3-4f5a-84bb-0ffcb08e2b3c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:25.493387 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a892954c-5faf-4cca-8e42-0f177a5e704b tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:25.493795 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a892954c-5faf-4cca-8e42-0f177a5e704b tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:25.494245 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a892954c-5faf-4cca-8e42-0f177a5e704b tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:25.494974 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a892954c-5faf-4cca-8e42-0f177a5e704b tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:25.495545 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a892954c-5faf-4cca-8e42-0f177a5e704b tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:25.495966 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a892954c-5faf-4cca-8e42-0f177a5e704b tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:25.622900 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-dd7cdd00-2f22-455d-9180-d2b8fe079fe6 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:25.623520 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-dd7cdd00-2f22-455d-9180-d2b8fe079fe6 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] [instance: 298850cf-74ca-4aa2-83c4-03602d5b2260] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:25.630167 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dd7cdd00-2f22-455d-9180-d2b8fe079fe6 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:25.630648 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dd7cdd00-2f22-455d-9180-d2b8fe079fe6 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:25.631081 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dd7cdd00-2f22-455d-9180-d2b8fe079fe6 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:25.631779 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dd7cdd00-2f22-455d-9180-d2b8fe079fe6 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:25.632281 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dd7cdd00-2f22-455d-9180-d2b8fe079fe6 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:25.632706 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dd7cdd00-2f22-455d-9180-d2b8fe079fe6 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:25.636837 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:44:25.652463 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a892954c-5faf-4cca-8e42-0f177a5e704b tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8d2814c23a4aa9806d56ce99c89e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8596483de9f14de9a88cdb787841fd3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:25.660418 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a892954c-5faf-4cca-8e42-0f177a5e704b tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/servers/6905c432-0fb3-4f5a-84bb-0ffcb08e2b3c" status: 200 len: 1466 microversion: 2.1 time: 0.178617 Oct 04 18:44:25.660983 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2009/3965] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:25 2022] GET /compute/v2.1/servers/6905c432-0fb3-4f5a-84bb-0ffcb08e2b3c => generated 1466 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:25.695285 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-20c22181-263d-458b-9dbb-ae6ad6de4c21 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe253da0700>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:25.774182 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-dd7cdd00-2f22-455d-9180-d2b8fe079fe6 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdfd40fbb91e4c5a8b5a060a6667fa7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e700f423d84c08b35b4eceae2ff6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:25.783303 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-dd7cdd00-2f22-455d-9180-d2b8fe079fe6 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] 10.222.0.20 "GET /compute/v2.1/servers/298850cf-74ca-4aa2-83c4-03602d5b2260" status: 200 len: 1314 microversion: 2.1 time: 0.164812 Oct 04 18:44:25.784263 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1957/3966] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:25 2022] GET /compute/v2.1/servers/298850cf-74ca-4aa2-83c4-03602d5b2260 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:44:25.814485 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-20c22181-263d-458b-9dbb-ae6ad6de4c21 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/images?changes-since=2022-10-04T18%3A42%3A41Z" status: 200 len: 1901 microversion: 2.1 time: 0.123236 Oct 04 18:44:25.825002 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2010/3967] 10.222.0.20 () {58 vars in 1199 bytes} [Tue Oct 4 18:44:25 2022] GET /compute/v2.1/images?changes-since=2022-10-04T18%3A42%3A41Z => generated 1901 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:44:25.830828 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f3be0d4d-c359-43cc-a834-4ea3b74b3e95 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe259467ca0>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:25.886506 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f3be0d4d-c359-43cc-a834-4ea3b74b3e95 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1907972850" status: 200 len: 485 microversion: 2.1 time: 0.059577 Oct 04 18:44:25.887520 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1958/3968] 10.222.0.20 () {58 vars in 1231 bytes} [Tue Oct 4 18:44:25 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1907972850 => generated 485 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:44:25.901011 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-51a88957-4126-4cb6-a977-f1183173b2b0 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe253d56280>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:25.998149 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-51a88957-4126-4cb6-a977-f1183173b2b0 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/images?server=6905c432-0fb3-4f5a-84bb-0ffcb08e2b3c" status: 200 len: 957 microversion: 2.1 time: 0.100401 Oct 04 18:44:25.998849 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2011/3969] 10.222.0.20 () {58 vars in 1209 bytes} [Tue Oct 4 18:44:25 2022] GET /compute/v2.1/images?server=6905c432-0fb3-4f5a-84bb-0ffcb08e2b3c => generated 957 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:44:26.012335 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-881330c5-82ce-47f1-8f6c-533288e854c8 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe2588f95e0>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:26.066474 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-881330c5-82ce-47f1-8f6c-533288e854c8 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.20%2Fcompute%2Fv2.1%2Fservers%2F471125af-1ec3-44b3-bb69-36b04a03fdd5" status: 200 len: 483 microversion: 2.1 time: 0.057801 Oct 04 18:44:26.073569 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1959/3970] 10.222.0.20 () {58 vars in 1317 bytes} [Tue Oct 4 18:44:26 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.20%2Fcompute%2Fv2.1%2Fservers%2F471125af-1ec3-44b3-bb69-36b04a03fdd5 => generated 483 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:44:26.079817 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-56c6458a-8292-47f0-8a64-bbe4702c94f0 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe253da0310>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:26.131166 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-56c6458a-8292-47f0-8a64-bbe4702c94f0 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.20%2Fcompute%2Fservers%2F471125af-1ec3-44b3-bb69-36b04a03fdd5" status: 200 len: 483 microversion: 2.1 time: 0.055680 Oct 04 18:44:26.131963 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2012/3971] 10.222.0.20 () {58 vars in 1303 bytes} [Tue Oct 4 18:44:26 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.20%2Fcompute%2Fservers%2F471125af-1ec3-44b3-bb69-36b04a03fdd5 => generated 483 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:44:26.146167 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d1c460b3-a119-4476-a847-5ef199fcb8c7 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe2592cf670>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:26.263493 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d1c460b3-a119-4476-a847-5ef199fcb8c7 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3279 microversion: 2.1 time: 0.120700 Oct 04 18:44:26.267776 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1960/3972] 10.222.0.20 () {58 vars in 1149 bytes} [Tue Oct 4 18:44:26 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3279 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:26.283280 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9c0f2335-bc97-4414-8355-c02321521da3 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe253de8d30>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:26.353135 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9c0f2335-bc97-4414-8355-c02321521da3 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1428 microversion: 2.1 time: 0.076301 Oct 04 18:44:26.353745 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2013/3973] 10.222.0.20 () {58 vars in 1149 bytes} [Tue Oct 4 18:44:26 2022] GET /compute/v2.1/images?type=snapshot => generated 1428 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:26.368728 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-82a079fd-5105-4d1f-af71-40644790c66b tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe2588b3820>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:26.422830 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-82a079fd-5105-4d1f-af71-40644790c66b tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/images?limit=1" status: 200 len: 621 microversion: 2.1 time: 0.058737 Oct 04 18:44:26.423550 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1961/3974] 10.222.0.20 () {58 vars in 1137 bytes} [Tue Oct 4 18:44:26 2022] GET /compute/v2.1/images?limit=1 => generated 621 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:44:26.437594 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ccd17e41-785c-4235-abca-24af69133289 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe253de6430>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:26.458552 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5117827c-c49a-4001-9d63-9a1b4d340791 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:26.459178 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5117827c-c49a-4001-9d63-9a1b4d340791 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:26.465776 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5117827c-c49a-4001-9d63-9a1b4d340791 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:26.466450 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5117827c-c49a-4001-9d63-9a1b4d340791 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:26.466900 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5117827c-c49a-4001-9d63-9a1b4d340791 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:26.467613 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5117827c-c49a-4001-9d63-9a1b4d340791 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:26.468117 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5117827c-c49a-4001-9d63-9a1b4d340791 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:26.474041 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5117827c-c49a-4001-9d63-9a1b4d340791 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:26.540641 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5117827c-c49a-4001-9d63-9a1b4d340791 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:26.550095 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5117827c-c49a-4001-9d63-9a1b4d340791 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51" status: 200 len: 1213 microversion: 2.1 time: 0.095506 Oct 04 18:44:26.550730 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1962/3975] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:26 2022] GET /compute/v2.1/servers/c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51 => generated 1213 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:44:26.556072 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-8685df88-7d0a-4296-a948-bfae272c8591 req-831c8fb9-ef64-444b-8a67-02f5bf35f12d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6905c432-0fb3-4f5a-84bb-0ffcb08e2b3c", "name": "network-vif-unplugged", "status": "completed", "tag": "457c88d9-9246-435c-b1a5-58b0c6c6185d"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:26.567216 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-8685df88-7d0a-4296-a948-bfae272c8591 req-831c8fb9-ef64-444b-8a67-02f5bf35f12d service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:26.568027 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-8685df88-7d0a-4296-a948-bfae272c8591 req-831c8fb9-ef64-444b-8a67-02f5bf35f12d service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:26.568486 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-8685df88-7d0a-4296-a948-bfae272c8591 req-831c8fb9-ef64-444b-8a67-02f5bf35f12d service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:26.582525 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-8685df88-7d0a-4296-a948-bfae272c8591 req-831c8fb9-ef64-444b-8a67-02f5bf35f12d service nova] Creating event network-vif-unplugged:457c88d9-9246-435c-b1a5-58b0c6c6185d for instance 6905c432-0fb3-4f5a-84bb-0ffcb08e2b3c on n-h1-850501-14 Oct 04 18:44:26.588852 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-8685df88-7d0a-4296-a948-bfae272c8591 req-831c8fb9-ef64-444b-8a67-02f5bf35f12d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036627 Oct 04 18:44:26.589590 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1963/3976] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:44:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:44:26.650385 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ccd17e41-785c-4235-abca-24af69133289 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/images/detail?changes-since=2022-10-04T18%3A42%3A35Z" status: 200 len: 6332 microversion: 2.1 time: 0.217386 Oct 04 18:44:26.665819 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2014/3977] 10.222.0.20 () {58 vars in 1220 bytes} [Tue Oct 4 18:44:26 2022] GET /compute/v2.1/images/detail?changes-since=2022-10-04T18%3A42%3A35Z => generated 6332 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:26.674665 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-40e052e2-53b9-450d-948f-8439f19377e5 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe25d124160>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:26.732605 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-40e052e2-53b9-450d-948f-8439f19377e5 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1907972850" status: 200 len: 665 microversion: 2.1 time: 0.063167 Oct 04 18:44:26.736756 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1964/3978] 10.222.0.20 () {58 vars in 1252 bytes} [Tue Oct 4 18:44:26 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1907972850 => generated 665 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:44:26.750100 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5e3b6bdd-72e0-4e69-9ace-884e2ed7cf3c tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe253de8160>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:26.810541 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9ff3da8a-3a1b-4adf-b23b-e008e5b0a261 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:26.811521 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9ff3da8a-3a1b-4adf-b23b-e008e5b0a261 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] [instance: 298850cf-74ca-4aa2-83c4-03602d5b2260] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:26.818269 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5e3b6bdd-72e0-4e69-9ace-884e2ed7cf3c tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.20%2Fcompute%2Fv2.1%2Fservers%2F471125af-1ec3-44b3-bb69-36b04a03fdd5" status: 200 len: 1465 microversion: 2.1 time: 0.072634 Oct 04 18:44:26.818647 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9ff3da8a-3a1b-4adf-b23b-e008e5b0a261 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:26.819147 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9ff3da8a-3a1b-4adf-b23b-e008e5b0a261 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:26.819584 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9ff3da8a-3a1b-4adf-b23b-e008e5b0a261 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:26.819818 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2015/3979] 10.222.0.20 () {58 vars in 1338 bytes} [Tue Oct 4 18:44:26 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.20%2Fcompute%2Fv2.1%2Fservers%2F471125af-1ec3-44b3-bb69-36b04a03fdd5 => generated 1465 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:26.820335 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9ff3da8a-3a1b-4adf-b23b-e008e5b0a261 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:26.820953 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9ff3da8a-3a1b-4adf-b23b-e008e5b0a261 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:26.821605 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9ff3da8a-3a1b-4adf-b23b-e008e5b0a261 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:26.837905 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a2bd187f-06a2-40f9-b1aa-6889d2e59758 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe253da0940>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:26.908854 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a2bd187f-06a2-40f9-b1aa-6889d2e59758 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.20%2Fcompute%2Fservers%2F471125af-1ec3-44b3-bb69-36b04a03fdd5" status: 200 len: 1465 microversion: 2.1 time: 0.074701 Oct 04 18:44:26.920834 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2016/3980] 10.222.0.20 () {58 vars in 1324 bytes} [Tue Oct 4 18:44:26 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.20%2Fcompute%2Fservers%2F471125af-1ec3-44b3-bb69-36b04a03fdd5 => generated 1465 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:44:26.926069 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-fd8caf91-f952-42c1-b86f-1aa2ba07df18 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe25921c160>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:27.021739 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9ff3da8a-3a1b-4adf-b23b-e008e5b0a261 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdfd40fbb91e4c5a8b5a060a6667fa7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e700f423d84c08b35b4eceae2ff6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:27.031699 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9ff3da8a-3a1b-4adf-b23b-e008e5b0a261 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] 10.222.0.20 "GET /compute/v2.1/servers/298850cf-74ca-4aa2-83c4-03602d5b2260" status: 200 len: 1499 microversion: 2.1 time: 0.227426 Oct 04 18:44:27.032424 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1965/3981] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:26 2022] GET /compute/v2.1/servers/298850cf-74ca-4aa2-83c4-03602d5b2260 => generated 1499 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:27.038438 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-fd8caf91-f952-42c1-b86f-1aa2ba07df18 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7107 microversion: 2.1 time: 0.116085 Oct 04 18:44:27.039377 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2017/3982] 10.222.0.20 () {58 vars in 1170 bytes} [Tue Oct 4 18:44:26 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7107 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:44:27.086164 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4a462829-f925-4109-9a10-08e398389575 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe25d1244c0>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:27.168159 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4a462829-f925-4109-9a10-08e398389575 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4374 microversion: 2.1 time: 0.094032 Oct 04 18:44:27.168465 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1966/3983] 10.222.0.20 () {58 vars in 1170 bytes} [Tue Oct 4 18:44:27 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4374 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:27.197093 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b1d73cc7-ee57-4026-b058-76fe0d3f4026 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe258d92160>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:27.284080 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b1d73cc7-ee57-4026-b058-76fe0d3f4026 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/images/f545e662-10b3-46b1-88bb-6e66dd294559" status: 200 len: 784 microversion: 2.1 time: 0.092948 Oct 04 18:44:27.284661 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2018/3984] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Oct 4 18:44:27 2022] GET /compute/v2.1/images/f545e662-10b3-46b1-88bb-6e66dd294559 => generated 784 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:44:27.301182 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-088fdf4b-e9cf-4955-97ad-362d1f4e5610 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe2588f95e0>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:27.365888 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-088fdf4b-e9cf-4955-97ad-362d1f4e5610 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1610 microversion: 2.1 time: 0.068459 Oct 04 18:44:27.366618 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1967/3985] 10.222.0.20 () {58 vars in 1158 bytes} [Tue Oct 4 18:44:27 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1610 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:27.383785 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0b8437f4-1b92-4923-b000-a9e5385deb37 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe253d56dc0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:27.577326 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-906b36b7-2512-4b75-a6eb-0b04726512cf tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:27.578416 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-906b36b7-2512-4b75-a6eb-0b04726512cf tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:27.590831 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-906b36b7-2512-4b75-a6eb-0b04726512cf tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:27.591698 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-906b36b7-2512-4b75-a6eb-0b04726512cf tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:27.592325 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-906b36b7-2512-4b75-a6eb-0b04726512cf tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:27.593685 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-906b36b7-2512-4b75-a6eb-0b04726512cf tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:27.594513 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-906b36b7-2512-4b75-a6eb-0b04726512cf tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:27.595166 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-906b36b7-2512-4b75-a6eb-0b04726512cf tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:27.679310 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-906b36b7-2512-4b75-a6eb-0b04726512cf tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:27.689745 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-906b36b7-2512-4b75-a6eb-0b04726512cf tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51" status: 200 len: 1261 microversion: 2.1 time: 0.118730 Oct 04 18:44:27.690871 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1968/3986] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:27 2022] GET /compute/v2.1/servers/c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51 => generated 1261 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:28.714706 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7831f165-e0ec-4077-ad88-f131d12b65a6 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:28.716038 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7831f165-e0ec-4077-ad88-f131d12b65a6 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:28.725786 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7831f165-e0ec-4077-ad88-f131d12b65a6 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:28.726864 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7831f165-e0ec-4077-ad88-f131d12b65a6 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:28.727649 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7831f165-e0ec-4077-ad88-f131d12b65a6 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:28.728879 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7831f165-e0ec-4077-ad88-f131d12b65a6 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:28.729587 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7831f165-e0ec-4077-ad88-f131d12b65a6 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:28.730240 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7831f165-e0ec-4077-ad88-f131d12b65a6 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:28.822629 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7831f165-e0ec-4077-ad88-f131d12b65a6 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:28.844797 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7831f165-e0ec-4077-ad88-f131d12b65a6 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51" status: 200 len: 1267 microversion: 2.1 time: 0.134921 Oct 04 18:44:28.845683 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1969/3987] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:28 2022] GET /compute/v2.1/servers/c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51 => generated 1267 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:28.902035 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-cde85dc5-7627-49c5-9277-200b908fb53f tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ae6b3d01-f8b3-4c58-b22c-d64349fe6b57"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:28.905937 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-cde85dc5-7627-49c5-9277-200b908fb53f tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: 4d6dfac0-958d-4698-a050-6539caebe52c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:28.912348 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cde85dc5-7627-49c5-9277-200b908fb53f tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:28.912856 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cde85dc5-7627-49c5-9277-200b908fb53f tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:28.913301 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cde85dc5-7627-49c5-9277-200b908fb53f tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:28.914034 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cde85dc5-7627-49c5-9277-200b908fb53f tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:28.914493 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cde85dc5-7627-49c5-9277-200b908fb53f tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:28.915129 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cde85dc5-7627-49c5-9277-200b908fb53f tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:28.987660 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0b8437f4-1b92-4923-b000-a9e5385deb37 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "DELETE /compute/v2.1/images/c852d54e-6bd8-46c7-8b65-bb79b0be25e6" status: 204 len: 0 microversion: 2.1 time: 1.607563 Oct 04 18:44:28.991969 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2019/3988] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:27 2022] DELETE /compute/v2.1/images/c852d54e-6bd8-46c7-8b65-bb79b0be25e6 => generated 0 bytes in 1609 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:44:29.007507 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-091253f3-e8b3-45ab-b031-e301d192974e tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe253d664c0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:29.972255 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-cde85dc5-7627-49c5-9277-200b908fb53f tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "POST /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.074351 Oct 04 18:44:29.973251 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1970/3989] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Oct 4 18:44:28 2022] POST /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c/os-volume_attachments => generated 194 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:44:29.995946 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-139059fc-48c3-44c5-b881-935a2b4b4ae7 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2a72350d-1f0b-4742-8641-5773ece51bb7"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:30.010369 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-139059fc-48c3-44c5-b881-935a2b4b4ae7 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] [instance: 6cc94ec4-3e28-41e0-808e-9cd2263bca7d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:30.019952 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-139059fc-48c3-44c5-b881-935a2b4b4ae7 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:30.020478 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-139059fc-48c3-44c5-b881-935a2b4b4ae7 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:30.020927 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-139059fc-48c3-44c5-b881-935a2b4b4ae7 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:30.022009 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-139059fc-48c3-44c5-b881-935a2b4b4ae7 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:30.022486 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-139059fc-48c3-44c5-b881-935a2b4b4ae7 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:30.022888 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-139059fc-48c3-44c5-b881-935a2b4b4ae7 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:30.985614 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-091253f3-e8b3-45ab-b031-e301d192974e tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "DELETE /compute/v2.1/images/de3254af-72ec-481e-91a9-f950ae382b0e" status: 204 len: 0 microversion: 2.1 time: 1.986601 Oct 04 18:44:30.986323 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2020/3990] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:28 2022] DELETE /compute/v2.1/images/de3254af-72ec-481e-91a9-f950ae382b0e => generated 0 bytes in 1991 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:44:30.992191 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-605d747a-8530-4ead-8ca1-122eb1f566b2 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:30.992816 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-605d747a-8530-4ead-8ca1-122eb1f566b2 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:31.009636 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-605d747a-8530-4ead-8ca1-122eb1f566b2 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:31.010129 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-605d747a-8530-4ead-8ca1-122eb1f566b2 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:31.010991 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-605d747a-8530-4ead-8ca1-122eb1f566b2 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:31.011714 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-605d747a-8530-4ead-8ca1-122eb1f566b2 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:31.012223 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-605d747a-8530-4ead-8ca1-122eb1f566b2 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:31.012773 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-605d747a-8530-4ead-8ca1-122eb1f566b2 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:31.419687 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-605d747a-8530-4ead-8ca1-122eb1f566b2 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:31.454562 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-605d747a-8530-4ead-8ca1-122eb1f566b2 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51" status: 200 len: 1309 microversion: 2.1 time: 0.467298 Oct 04 18:44:31.455155 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2021/3991] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:30 2022] GET /compute/v2.1/servers/c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51 => generated 1309 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:31.467822 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-47c7bb72-96d2-4f4b-b3ca-b4e7ef46bfef req-9930e252-b8e0-473d-abfc-7921db696bc1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51", "tag": "ba761f8a-a7dc-4031-8338-91b1b35f26e2"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:31.489070 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-139059fc-48c3-44c5-b881-935a2b4b4ae7 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] 10.222.0.20 "POST /compute/v2.1/servers/6cc94ec4-3e28-41e0-808e-9cd2263bca7d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.494664 Oct 04 18:44:31.490672 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1971/3992] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Oct 4 18:44:29 2022] POST /compute/v2.1/servers/6cc94ec4-3e28-41e0-808e-9cd2263bca7d/os-volume_attachments => generated 194 bytes in 1507 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:44:31.501590 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2b8de9fb-1419-4c3e-ad57-5cb769e0216f tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe25d109790>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:31.506644 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-47c7bb72-96d2-4f4b-b3ca-b4e7ef46bfef req-9930e252-b8e0-473d-abfc-7921db696bc1 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:31.507122 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-47c7bb72-96d2-4f4b-b3ca-b4e7ef46bfef req-9930e252-b8e0-473d-abfc-7921db696bc1 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:31.511623 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-47c7bb72-96d2-4f4b-b3ca-b4e7ef46bfef req-9930e252-b8e0-473d-abfc-7921db696bc1 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:31.545697 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-47c7bb72-96d2-4f4b-b3ca-b4e7ef46bfef req-9930e252-b8e0-473d-abfc-7921db696bc1 service nova] Creating event network-changed:ba761f8a-a7dc-4031-8338-91b1b35f26e2 for instance c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51 on n-h1-850501-14 Oct 04 18:44:31.552219 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-47c7bb72-96d2-4f4b-b3ca-b4e7ef46bfef req-9930e252-b8e0-473d-abfc-7921db696bc1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093683 Oct 04 18:44:31.552838 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2022/3993] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:44:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:44:32.480956 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0fdda8f7-d652-4c15-91cc-c2fec37c540a tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:32.483000 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0fdda8f7-d652-4c15-91cc-c2fec37c540a tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:32.490086 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0fdda8f7-d652-4c15-91cc-c2fec37c540a tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:32.490660 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0fdda8f7-d652-4c15-91cc-c2fec37c540a tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:32.491170 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0fdda8f7-d652-4c15-91cc-c2fec37c540a tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:32.491968 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0fdda8f7-d652-4c15-91cc-c2fec37c540a tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:32.492644 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0fdda8f7-d652-4c15-91cc-c2fec37c540a tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:32.493064 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0fdda8f7-d652-4c15-91cc-c2fec37c540a tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:32.819462 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0fdda8f7-d652-4c15-91cc-c2fec37c540a tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:32.834364 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0fdda8f7-d652-4c15-91cc-c2fec37c540a tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51" status: 200 len: 1309 microversion: 2.1 time: 0.359215 Oct 04 18:44:32.835091 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2023/3994] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:32 2022] GET /compute/v2.1/servers/c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51 => generated 1309 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:44:33.147804 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2b8de9fb-1419-4c3e-ad57-5cb769e0216f tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "DELETE /compute/v2.1/images/5c609fc9-3cfe-4683-9148-134d915f048c" status: 204 len: 0 microversion: 2.1 time: 1.654717 Oct 04 18:44:33.148407 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1972/3995] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:31 2022] DELETE /compute/v2.1/images/5c609fc9-3cfe-4683-9148-134d915f048c => generated 0 bytes in 1657 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:44:33.156359 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a66bd7b4-0b3e-44ae-be70-b023a30723ab tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:33.157230 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a66bd7b4-0b3e-44ae-be70-b023a30723ab tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] [instance: 471125af-1ec3-44b3-bb69-36b04a03fdd5] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:33.173917 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a66bd7b4-0b3e-44ae-be70-b023a30723ab tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:33.174709 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a66bd7b4-0b3e-44ae-be70-b023a30723ab tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:33.175303 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a66bd7b4-0b3e-44ae-be70-b023a30723ab tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:33.176229 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a66bd7b4-0b3e-44ae-be70-b023a30723ab tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:33.176863 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a66bd7b4-0b3e-44ae-be70-b023a30723ab tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:33.177449 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a66bd7b4-0b3e-44ae-be70-b023a30723ab tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:33.255141 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a66bd7b4-0b3e-44ae-be70-b023a30723ab tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] [instance: 471125af-1ec3-44b3-bb69-36b04a03fdd5] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:44:33.619690 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a66bd7b4-0b3e-44ae-be70-b023a30723ab tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "DELETE /compute/v2.1/servers/471125af-1ec3-44b3-bb69-36b04a03fdd5" status: 204 len: 0 microversion: 2.1 time: 0.466942 Oct 04 18:44:33.620669 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2024/3996] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:44:33 2022] DELETE /compute/v2.1/servers/471125af-1ec3-44b3-bb69-36b04a03fdd5 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:44:33.629668 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d98f893d-4f95-42fb-87f1-489ba4c202d5 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:33.630499 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d98f893d-4f95-42fb-87f1-489ba4c202d5 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] [instance: 471125af-1ec3-44b3-bb69-36b04a03fdd5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:33.637416 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d98f893d-4f95-42fb-87f1-489ba4c202d5 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:33.638344 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d98f893d-4f95-42fb-87f1-489ba4c202d5 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:33.639207 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d98f893d-4f95-42fb-87f1-489ba4c202d5 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:33.640324 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d98f893d-4f95-42fb-87f1-489ba4c202d5 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:33.640980 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d98f893d-4f95-42fb-87f1-489ba4c202d5 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:33.641633 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d98f893d-4f95-42fb-87f1-489ba4c202d5 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:33.791642 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d98f893d-4f95-42fb-87f1-489ba4c202d5 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8d2814c23a4aa9806d56ce99c89e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8596483de9f14de9a88cdb787841fd3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:33.801199 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d98f893d-4f95-42fb-87f1-489ba4c202d5 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/servers/471125af-1ec3-44b3-bb69-36b04a03fdd5" status: 200 len: 1471 microversion: 2.1 time: 0.175951 Oct 04 18:44:33.814498 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1973/3997] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:33 2022] GET /compute/v2.1/servers/471125af-1ec3-44b3-bb69-36b04a03fdd5 => generated 1471 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:44:33.858589 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-03b00078-3462-4bb8-9a52-b9a3a1b134a1 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:33.859305 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-03b00078-3462-4bb8-9a52-b9a3a1b134a1 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:33.865606 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-03b00078-3462-4bb8-9a52-b9a3a1b134a1 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:33.866550 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-03b00078-3462-4bb8-9a52-b9a3a1b134a1 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:33.866550 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-03b00078-3462-4bb8-9a52-b9a3a1b134a1 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:33.867215 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-03b00078-3462-4bb8-9a52-b9a3a1b134a1 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:33.867770 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-03b00078-3462-4bb8-9a52-b9a3a1b134a1 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:33.868227 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-03b00078-3462-4bb8-9a52-b9a3a1b134a1 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:34.010207 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-03b00078-3462-4bb8-9a52-b9a3a1b134a1 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:34.018643 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-03b00078-3462-4bb8-9a52-b9a3a1b134a1 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51" status: 200 len: 1309 microversion: 2.1 time: 0.165314 Oct 04 18:44:34.019209 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2025/3998] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:33 2022] GET /compute/v2.1/servers/c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51 => generated 1309 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:34.829722 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b702a6e3-a858-4355-bd7f-244e2f341f0b tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:34.830348 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b702a6e3-a858-4355-bd7f-244e2f341f0b tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] [instance: 471125af-1ec3-44b3-bb69-36b04a03fdd5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:34.837491 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b702a6e3-a858-4355-bd7f-244e2f341f0b tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:34.838010 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b702a6e3-a858-4355-bd7f-244e2f341f0b tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:34.838427 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b702a6e3-a858-4355-bd7f-244e2f341f0b tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:34.841076 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b702a6e3-a858-4355-bd7f-244e2f341f0b tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:34.841076 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b702a6e3-a858-4355-bd7f-244e2f341f0b tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:34.841076 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b702a6e3-a858-4355-bd7f-244e2f341f0b tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:35.042766 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-cabb25a6-9bc9-4ad8-8c81-c685d27e4ccd tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:35.043433 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-cabb25a6-9bc9-4ad8-8c81-c685d27e4ccd tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:35.058373 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cabb25a6-9bc9-4ad8-8c81-c685d27e4ccd tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:35.058868 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cabb25a6-9bc9-4ad8-8c81-c685d27e4ccd tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:35.059914 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cabb25a6-9bc9-4ad8-8c81-c685d27e4ccd tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:35.063677 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cabb25a6-9bc9-4ad8-8c81-c685d27e4ccd tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:35.067045 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cabb25a6-9bc9-4ad8-8c81-c685d27e4ccd tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:35.067733 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cabb25a6-9bc9-4ad8-8c81-c685d27e4ccd tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:35.103311 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b702a6e3-a858-4355-bd7f-244e2f341f0b tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8d2814c23a4aa9806d56ce99c89e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8596483de9f14de9a88cdb787841fd3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:35.111506 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b702a6e3-a858-4355-bd7f-244e2f341f0b tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/servers/471125af-1ec3-44b3-bb69-36b04a03fdd5" status: 200 len: 1471 microversion: 2.1 time: 0.286584 Oct 04 18:44:35.112109 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1974/3999] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:34 2022] GET /compute/v2.1/servers/471125af-1ec3-44b3-bb69-36b04a03fdd5 => generated 1471 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:35.144494 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:44:35.175077 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=6 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:44:35.325272 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-cabb25a6-9bc9-4ad8-8c81-c685d27e4ccd tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:35.335050 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-cabb25a6-9bc9-4ad8-8c81-c685d27e4ccd tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51" status: 200 len: 1309 microversion: 2.1 time: 0.296735 Oct 04 18:44:35.335666 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2026/4000] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:35 2022] GET /compute/v2.1/servers/c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51 => generated 1309 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:35.851339 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-7c92a58a-6c08-411b-9524-5f2478a3720b req-273b2a07-3498-452d-9e24-10a87ecdda9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "471125af-1ec3-44b3-bb69-36b04a03fdd5", "name": "network-vif-deleted", "tag": "ac57cdde-4dc1-45e0-be2d-97a36a8bb374"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:35.857285 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:44:35.864669 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-7c92a58a-6c08-411b-9524-5f2478a3720b req-273b2a07-3498-452d-9e24-10a87ecdda9c service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:35.865194 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-7c92a58a-6c08-411b-9524-5f2478a3720b req-273b2a07-3498-452d-9e24-10a87ecdda9c service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:35.865633 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-7c92a58a-6c08-411b-9524-5f2478a3720b req-273b2a07-3498-452d-9e24-10a87ecdda9c service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:35.877389 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-7c92a58a-6c08-411b-9524-5f2478a3720b req-273b2a07-3498-452d-9e24-10a87ecdda9c service nova] Creating event network-vif-deleted:ac57cdde-4dc1-45e0-be2d-97a36a8bb374 for instance 471125af-1ec3-44b3-bb69-36b04a03fdd5 on n-h1-850501-14 Oct 04 18:44:35.882632 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-7c92a58a-6c08-411b-9524-5f2478a3720b req-273b2a07-3498-452d-9e24-10a87ecdda9c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035035 Oct 04 18:44:35.883266 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1975/4001] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:44:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:44:36.137995 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-06fbd605-501a-4a65-ae5e-6d4a0f4574f1 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:36.138969 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-06fbd605-501a-4a65-ae5e-6d4a0f4574f1 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] [instance: 471125af-1ec3-44b3-bb69-36b04a03fdd5] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:36.151235 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-06fbd605-501a-4a65-ae5e-6d4a0f4574f1 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:36.156283 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-06fbd605-501a-4a65-ae5e-6d4a0f4574f1 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:36.156283 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-06fbd605-501a-4a65-ae5e-6d4a0f4574f1 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:36.156283 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-06fbd605-501a-4a65-ae5e-6d4a0f4574f1 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:36.156283 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-06fbd605-501a-4a65-ae5e-6d4a0f4574f1 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:36.156283 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-06fbd605-501a-4a65-ae5e-6d4a0f4574f1 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:36.226790 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-06fbd605-501a-4a65-ae5e-6d4a0f4574f1 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8d2814c23a4aa9806d56ce99c89e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8596483de9f14de9a88cdb787841fd3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:36.237634 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-06fbd605-501a-4a65-ae5e-6d4a0f4574f1 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/servers/471125af-1ec3-44b3-bb69-36b04a03fdd5" status: 200 len: 1300 microversion: 2.1 time: 0.104570 Oct 04 18:44:36.238527 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2027/4002] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:36 2022] GET /compute/v2.1/servers/471125af-1ec3-44b3-bb69-36b04a03fdd5 => generated 1300 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:36.363378 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a72b86fb-b438-4668-9410-887916c12349 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:36.364113 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a72b86fb-b438-4668-9410-887916c12349 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:36.374016 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a72b86fb-b438-4668-9410-887916c12349 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:36.374806 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a72b86fb-b438-4668-9410-887916c12349 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:36.375539 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a72b86fb-b438-4668-9410-887916c12349 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:36.376668 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a72b86fb-b438-4668-9410-887916c12349 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:36.377139 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a72b86fb-b438-4668-9410-887916c12349 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:36.377779 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a72b86fb-b438-4668-9410-887916c12349 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:36.580322 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a72b86fb-b438-4668-9410-887916c12349 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:36.590004 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a72b86fb-b438-4668-9410-887916c12349 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51" status: 200 len: 1309 microversion: 2.1 time: 0.231200 Oct 04 18:44:36.596612 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1976/4003] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:36 2022] GET /compute/v2.1/servers/c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51 => generated 1309 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:36.706266 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-1b8a6c77-bf39-436d-96e9-f9740439b9a0 req-6bb8f9a6-97a8-4bb5-93e4-4341e05d9d77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51", "name": "network-vif-plugged", "status": "completed", "tag": "ba761f8a-a7dc-4031-8338-91b1b35f26e2"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:36.732860 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-1b8a6c77-bf39-436d-96e9-f9740439b9a0 req-6bb8f9a6-97a8-4bb5-93e4-4341e05d9d77 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:36.733295 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-1b8a6c77-bf39-436d-96e9-f9740439b9a0 req-6bb8f9a6-97a8-4bb5-93e4-4341e05d9d77 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:36.733731 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-1b8a6c77-bf39-436d-96e9-f9740439b9a0 req-6bb8f9a6-97a8-4bb5-93e4-4341e05d9d77 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:36.746099 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-1b8a6c77-bf39-436d-96e9-f9740439b9a0 req-6bb8f9a6-97a8-4bb5-93e4-4341e05d9d77 service nova] Creating event network-vif-plugged:ba761f8a-a7dc-4031-8338-91b1b35f26e2 for instance c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51 on n-h1-850501-14 Oct 04 18:44:36.753660 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-1b8a6c77-bf39-436d-96e9-f9740439b9a0 req-6bb8f9a6-97a8-4bb5-93e4-4341e05d9d77 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052734 Oct 04 18:44:36.753660 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2028/4004] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:44:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:44:37.262657 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e9fd2efd-8dbb-4540-839d-98a515debcfe tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:37.263593 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e9fd2efd-8dbb-4540-839d-98a515debcfe tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] [instance: 471125af-1ec3-44b3-bb69-36b04a03fdd5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:37.271024 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e9fd2efd-8dbb-4540-839d-98a515debcfe tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:37.271553 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e9fd2efd-8dbb-4540-839d-98a515debcfe tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:37.272032 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e9fd2efd-8dbb-4540-839d-98a515debcfe tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:37.272775 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e9fd2efd-8dbb-4540-839d-98a515debcfe tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:37.273234 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e9fd2efd-8dbb-4540-839d-98a515debcfe tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:37.273667 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e9fd2efd-8dbb-4540-839d-98a515debcfe tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:37.310224 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e9fd2efd-8dbb-4540-839d-98a515debcfe tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:37.310787 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e9fd2efd-8dbb-4540-839d-98a515debcfe tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:37.311227 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e9fd2efd-8dbb-4540-839d-98a515debcfe tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:37.311683 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-e9fd2efd-8dbb-4540-839d-98a515debcfe tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lazy-loading 'fault' on Instance uuid 471125af-1ec3-44b3-bb69-36b04a03fdd5 {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:44:37.367810 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e9fd2efd-8dbb-4540-839d-98a515debcfe tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8d2814c23a4aa9806d56ce99c89e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8596483de9f14de9a88cdb787841fd3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:37.377037 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e9fd2efd-8dbb-4540-839d-98a515debcfe tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/servers/471125af-1ec3-44b3-bb69-36b04a03fdd5" status: 200 len: 1305 microversion: 2.1 time: 0.118499 Oct 04 18:44:37.377897 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1977/4005] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:37 2022] GET /compute/v2.1/servers/471125af-1ec3-44b3-bb69-36b04a03fdd5 => generated 1305 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:37.615346 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e87456cc-793f-4bed-80e5-ec2f0f7f1793 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:37.616139 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e87456cc-793f-4bed-80e5-ec2f0f7f1793 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:37.623067 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e87456cc-793f-4bed-80e5-ec2f0f7f1793 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:37.623609 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e87456cc-793f-4bed-80e5-ec2f0f7f1793 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:37.624041 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e87456cc-793f-4bed-80e5-ec2f0f7f1793 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:37.624752 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e87456cc-793f-4bed-80e5-ec2f0f7f1793 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:37.625372 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e87456cc-793f-4bed-80e5-ec2f0f7f1793 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:37.625808 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e87456cc-793f-4bed-80e5-ec2f0f7f1793 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:37.790843 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e87456cc-793f-4bed-80e5-ec2f0f7f1793 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:37.803052 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e87456cc-793f-4bed-80e5-ec2f0f7f1793 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51" status: 200 len: 1309 microversion: 2.1 time: 0.192187 Oct 04 18:44:37.803644 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2029/4006] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:37 2022] GET /compute/v2.1/servers/c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51 => generated 1309 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:38.401192 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-94f4924a-08cd-4084-b8e5-c45e25cd6767 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:38.401898 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-94f4924a-08cd-4084-b8e5-c45e25cd6767 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] [instance: 471125af-1ec3-44b3-bb69-36b04a03fdd5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:38.409520 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-94f4924a-08cd-4084-b8e5-c45e25cd6767 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:38.410702 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-94f4924a-08cd-4084-b8e5-c45e25cd6767 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:38.411212 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-94f4924a-08cd-4084-b8e5-c45e25cd6767 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:38.411990 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-94f4924a-08cd-4084-b8e5-c45e25cd6767 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:38.412723 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-94f4924a-08cd-4084-b8e5-c45e25cd6767 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:38.413541 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-94f4924a-08cd-4084-b8e5-c45e25cd6767 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:38.429572 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-94f4924a-08cd-4084-b8e5-c45e25cd6767 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] HTTP exception thrown: Instance 471125af-1ec3-44b3-bb69-36b04a03fdd5 could not be found. Oct 04 18:44:38.431672 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-94f4924a-08cd-4084-b8e5-c45e25cd6767 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Request method failure captured: Oct 04 18:44:38.431672 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/471125af-1ec3-44b3-bb69-36b04a03fdd5 HTTP/1.1 Oct 04 18:44:38.431672 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:44:38.431672 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:44:38.431672 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:44:38.431672 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:44:38.431672 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:44:38.431672 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:44:38.431672 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:44:38.431672 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:44:38.431672 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH6apmN4aEauMOESGJLQzSG1Usma4DWCea4_fgo5fOVtFXdBacTK2P9fQTGYj0MsTF9z-kjbM51w827pGAXAAWcPohV3MELfvvrMPGUW6NnjCTVorlnyPyNoMjDgKv92Elezbap5MsiKygxCTPq7WAI0Z6uEpDgQCTmb0465MCFS3Eg Oct 04 18:44:38.431672 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:44:38.431672 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:44:38.431672 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:44:38.431672 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:44:38.431672 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:44:38.431672 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:44:38.431672 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 8596483de9f14de9a88cdb787841fd3c Oct 04 18:44:38.431672 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ListImageFiltersTestJSON-1802727151 Oct 04 18:44:38.431672 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:44:38.431672 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:44:38.431672 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8596483de9f14de9a88cdb787841fd3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8596483de9f14de9a88cdb787841fd3c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8596483de9f14de9a88cdb787841fd3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8596483de9f14de9a88cdb787841fd3c"}]}] Oct 04 18:44:38.431672 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ListImageFiltersTestJSON-1802727151 Oct 04 18:44:38.431672 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 8596483de9f14de9a88cdb787841fd3c Oct 04 18:44:38.431672 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1802727151 Oct 04 18:44:38.431672 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ListImageFiltersTestJSON-1802727151-project Oct 04 18:44:38.431672 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:44:38.431672 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:44:38.431672 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 9e8d2814c23a4aa9806d56ce99c89e57 Oct 04 18:44:38.431672 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ListImageFiltersTestJSON-1802727151-project Oct 04 18:44:38.431672 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:44:38.431672 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 471125af-1ec3-44b3-bb69-36b04a03fdd5 could not be found. Oct 04 18:44:38.431672 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '471125af-1ec3-44b3-bb69-36b04a03fdd5'} Oct 04 18:44:38.431672 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:44:38.431672 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:44:38.431672 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:44:38.431672 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:44:38.431672 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:44:38.431672 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:44:38.431672 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:44:38.431672 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:44:38.431672 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:44:38.431672 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:44:38.431672 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 471125af-1ec3-44b3-bb69-36b04a03fdd5 could not be found. Oct 04 18:44:38.431672 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:44:38.431672 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:44:38.431672 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:44:38.431672 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:44:38.431672 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:44:38.431672 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:44:38.431672 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:44:38.431672 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:44:38.431672 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:44:38.431672 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:44:38.431672 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:44:38.431672 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:44:38.431672 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:44:38.431672 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:44:38.431672 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:44:38.431672 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:44:38.431672 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 471125af-1ec3-44b3-bb69-36b04a03fdd5 could not be found. Oct 04 18:44:38.431672 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:44:38.431672 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:44:38.431672 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:44:38.438103 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:44:38.438103 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:44:38.438103 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:44:38.438103 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:44:38.438103 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:44:38.438103 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 471125af-1ec3-44b3-bb69-36b04a03fdd5 could not be found. Oct 04 18:44:38.438103 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:44:38.438103 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-94f4924a-08cd-4084-b8e5-c45e25cd6767 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Returning 404 to user: Instance 471125af-1ec3-44b3-bb69-36b04a03fdd5 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:44:38.438103 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-94f4924a-08cd-4084-b8e5-c45e25cd6767 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/servers/471125af-1ec3-44b3-bb69-36b04a03fdd5" status: 404 len: 111 microversion: 2.1 time: 0.035979 Oct 04 18:44:38.438103 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1978/4007] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:38 2022] GET /compute/v2.1/servers/471125af-1ec3-44b3-bb69-36b04a03fdd5 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:44:38.442830 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f0ccf174-a2d4-42f0-9642-f010365cc02b tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:38.443332 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f0ccf174-a2d4-42f0-9642-f010365cc02b tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] [instance: 6905c432-0fb3-4f5a-84bb-0ffcb08e2b3c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:38.452134 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f0ccf174-a2d4-42f0-9642-f010365cc02b tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:38.452726 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f0ccf174-a2d4-42f0-9642-f010365cc02b tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:38.453172 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f0ccf174-a2d4-42f0-9642-f010365cc02b tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:38.454076 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f0ccf174-a2d4-42f0-9642-f010365cc02b tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:38.454536 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f0ccf174-a2d4-42f0-9642-f010365cc02b tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:38.455455 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f0ccf174-a2d4-42f0-9642-f010365cc02b tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:38.508701 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f0ccf174-a2d4-42f0-9642-f010365cc02b tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] [instance: 6905c432-0fb3-4f5a-84bb-0ffcb08e2b3c] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:44:38.753556 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:44:38.827296 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9b933d73-cab2-472a-bd6c-599ea9cf557b tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:38.828222 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9b933d73-cab2-472a-bd6c-599ea9cf557b tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:38.835056 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9b933d73-cab2-472a-bd6c-599ea9cf557b tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:38.835670 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9b933d73-cab2-472a-bd6c-599ea9cf557b tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:38.836244 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9b933d73-cab2-472a-bd6c-599ea9cf557b tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:38.836964 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9b933d73-cab2-472a-bd6c-599ea9cf557b tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:38.837481 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9b933d73-cab2-472a-bd6c-599ea9cf557b tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:38.838020 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9b933d73-cab2-472a-bd6c-599ea9cf557b tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:38.850421 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f0ccf174-a2d4-42f0-9642-f010365cc02b tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6905c432-0fb3-4f5a-84bb-0ffcb08e2b3c" status: 204 len: 0 microversion: 2.1 time: 0.411092 Oct 04 18:44:38.851353 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2030/4008] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:44:38 2022] DELETE /compute/v2.1/servers/6905c432-0fb3-4f5a-84bb-0ffcb08e2b3c => generated 0 bytes in 413 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:44:38.863672 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-425253cd-eb28-466f-aca0-951ccbf2ce87 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:38.864541 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-425253cd-eb28-466f-aca0-951ccbf2ce87 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] [instance: 6905c432-0fb3-4f5a-84bb-0ffcb08e2b3c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:38.883537 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-425253cd-eb28-466f-aca0-951ccbf2ce87 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:38.884146 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-425253cd-eb28-466f-aca0-951ccbf2ce87 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:38.884643 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-425253cd-eb28-466f-aca0-951ccbf2ce87 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:38.885753 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-425253cd-eb28-466f-aca0-951ccbf2ce87 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:38.886413 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-425253cd-eb28-466f-aca0-951ccbf2ce87 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:38.888024 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-425253cd-eb28-466f-aca0-951ccbf2ce87 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:38.915613 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:44:39.117567 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9b933d73-cab2-472a-bd6c-599ea9cf557b tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:39.126619 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9b933d73-cab2-472a-bd6c-599ea9cf557b tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51" status: 200 len: 1489 microversion: 2.1 time: 0.303514 Oct 04 18:44:39.136782 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1979/4009] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:38 2022] GET /compute/v2.1/servers/c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51 => generated 1489 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:44:39.139012 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-425253cd-eb28-466f-aca0-951ccbf2ce87 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8d2814c23a4aa9806d56ce99c89e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8596483de9f14de9a88cdb787841fd3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:39.148715 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-425253cd-eb28-466f-aca0-951ccbf2ce87 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/servers/6905c432-0fb3-4f5a-84bb-0ffcb08e2b3c" status: 200 len: 1472 microversion: 2.1 time: 0.292319 Oct 04 18:44:39.154139 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2031/4010] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:38 2022] GET /compute/v2.1/servers/6905c432-0fb3-4f5a-84bb-0ffcb08e2b3c => generated 1472 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:39.154492 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1ae3eddb-ba8b-4682-8988-f2b2963c2485 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:39.154492 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1ae3eddb-ba8b-4682-8988-f2b2963c2485 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] [instance: 298850cf-74ca-4aa2-83c4-03602d5b2260] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:39.157793 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-408404b1-fbc3-4745-8392-688eb7b88d08 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-217455620"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:39.158449 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1ae3eddb-ba8b-4682-8988-f2b2963c2485 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:39.159149 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1ae3eddb-ba8b-4682-8988-f2b2963c2485 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:39.159938 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1ae3eddb-ba8b-4682-8988-f2b2963c2485 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:39.161198 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1ae3eddb-ba8b-4682-8988-f2b2963c2485 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:39.161735 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1ae3eddb-ba8b-4682-8988-f2b2963c2485 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:39.162175 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1ae3eddb-ba8b-4682-8988-f2b2963c2485 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:39.162533 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-408404b1-fbc3-4745-8392-688eb7b88d08 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:39.179645 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-408404b1-fbc3-4745-8392-688eb7b88d08 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:39.180789 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-408404b1-fbc3-4745-8392-688eb7b88d08 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:39.182611 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-408404b1-fbc3-4745-8392-688eb7b88d08 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:39.184018 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-408404b1-fbc3-4745-8392-688eb7b88d08 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:39.185525 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-408404b1-fbc3-4745-8392-688eb7b88d08 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:39.186521 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-408404b1-fbc3-4745-8392-688eb7b88d08 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:39.195426 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1ae3eddb-ba8b-4682-8988-f2b2963c2485 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] [instance: 298850cf-74ca-4aa2-83c4-03602d5b2260] Going to try to terminate instance {{(pid=123002) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:44:39.201384 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:44:39.404181 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-408404b1-fbc3-4745-8392-688eb7b88d08 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "PUT /compute/v2.1/servers/c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51" status: 200 len: 1073 microversion: 2.1 time: 0.253179 Oct 04 18:44:39.418276 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2032/4011] 10.222.0.20 () {60 vars in 1256 bytes} [Tue Oct 4 18:44:39 2022] PUT /compute/v2.1/servers/c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51 => generated 1073 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:39.423521 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d04515cc-4260-4e78-984d-dd76c0278bd9 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:39.424161 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d04515cc-4260-4e78-984d-dd76c0278bd9 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:39.430211 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d04515cc-4260-4e78-984d-dd76c0278bd9 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:39.430688 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d04515cc-4260-4e78-984d-dd76c0278bd9 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:39.431122 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d04515cc-4260-4e78-984d-dd76c0278bd9 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:39.443629 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d04515cc-4260-4e78-984d-dd76c0278bd9 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:39.444182 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d04515cc-4260-4e78-984d-dd76c0278bd9 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:39.444617 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d04515cc-4260-4e78-984d-dd76c0278bd9 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:39.550192 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1ae3eddb-ba8b-4682-8988-f2b2963c2485 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] 10.222.0.20 "DELETE /compute/v2.1/servers/298850cf-74ca-4aa2-83c4-03602d5b2260" status: 204 len: 0 microversion: 2.1 time: 0.411935 Oct 04 18:44:39.550736 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1980/4012] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:44:39 2022] DELETE /compute/v2.1/servers/298850cf-74ca-4aa2-83c4-03602d5b2260 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:44:39.560701 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-afb2b442-075d-4223-b9df-26501122f3fb tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:39.562609 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-afb2b442-075d-4223-b9df-26501122f3fb tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] [instance: 298850cf-74ca-4aa2-83c4-03602d5b2260] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:39.571592 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-afb2b442-075d-4223-b9df-26501122f3fb tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:39.572856 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-afb2b442-075d-4223-b9df-26501122f3fb tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:39.573979 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-afb2b442-075d-4223-b9df-26501122f3fb tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:39.575675 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-afb2b442-075d-4223-b9df-26501122f3fb tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:39.576430 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-afb2b442-075d-4223-b9df-26501122f3fb tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:39.577060 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-afb2b442-075d-4223-b9df-26501122f3fb tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:39.612661 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d04515cc-4260-4e78-984d-dd76c0278bd9 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:39.621317 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d04515cc-4260-4e78-984d-dd76c0278bd9 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51" status: 200 len: 1499 microversion: 2.1 time: 0.201700 Oct 04 18:44:39.622157 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2033/4013] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:39 2022] GET /compute/v2.1/servers/c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51 => generated 1499 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:39.644369 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2b5015ee-b43f-442d-ab02-3a7ce2eedd89 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:39.645332 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2b5015ee-b43f-442d-ab02-3a7ce2eedd89 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:39.651766 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2b5015ee-b43f-442d-ab02-3a7ce2eedd89 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:39.652575 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2b5015ee-b43f-442d-ab02-3a7ce2eedd89 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:39.653662 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2b5015ee-b43f-442d-ab02-3a7ce2eedd89 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:39.657406 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2b5015ee-b43f-442d-ab02-3a7ce2eedd89 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:39.657406 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2b5015ee-b43f-442d-ab02-3a7ce2eedd89 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:39.657406 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2b5015ee-b43f-442d-ab02-3a7ce2eedd89 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:39.799454 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-afb2b442-075d-4223-b9df-26501122f3fb tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdfd40fbb91e4c5a8b5a060a6667fa7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e700f423d84c08b35b4eceae2ff6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:39.802421 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-afb2b442-075d-4223-b9df-26501122f3fb tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] 10.222.0.20 "GET /compute/v2.1/servers/298850cf-74ca-4aa2-83c4-03602d5b2260" status: 200 len: 1505 microversion: 2.1 time: 0.247043 Oct 04 18:44:39.803006 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1981/4014] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:39 2022] GET /compute/v2.1/servers/298850cf-74ca-4aa2-83c4-03602d5b2260 => generated 1505 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:44:39.842156 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-2b5015ee-b43f-442d-ab02-3a7ce2eedd89 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:39.849067 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2b5015ee-b43f-442d-ab02-3a7ce2eedd89 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51" status: 200 len: 1499 microversion: 2.1 time: 0.208411 Oct 04 18:44:39.849921 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2034/4015] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:39 2022] GET /compute/v2.1/servers/c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51 => generated 1499 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:44:39.874014 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6a1ce231-96b8-4014-917f-1e5f9887bb73 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:39.881568 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6a1ce231-96b8-4014-917f-1e5f9887bb73 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:39.882302 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6a1ce231-96b8-4014-917f-1e5f9887bb73 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:39.882745 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6a1ce231-96b8-4014-917f-1e5f9887bb73 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:39.910508 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-6a1ce231-96b8-4014-917f-1e5f9887bb73 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51] Going to try to stop instance {{(pid=123002) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 18:44:40.182262 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9df63ed5-8041-4df2-924b-e16b3a944c29 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:40.182858 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-9df63ed5-8041-4df2-924b-e16b3a944c29 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] [instance: 6905c432-0fb3-4f5a-84bb-0ffcb08e2b3c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:40.189182 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9df63ed5-8041-4df2-924b-e16b3a944c29 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:40.189664 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9df63ed5-8041-4df2-924b-e16b3a944c29 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:40.190100 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9df63ed5-8041-4df2-924b-e16b3a944c29 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:40.190789 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9df63ed5-8041-4df2-924b-e16b3a944c29 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:40.191511 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9df63ed5-8041-4df2-924b-e16b3a944c29 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:40.191928 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9df63ed5-8041-4df2-924b-e16b3a944c29 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:40.217136 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6a1ce231-96b8-4014-917f-1e5f9887bb73 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "POST /compute/v2.1/servers/c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51/action" status: 202 len: 0 microversion: 2.1 time: 0.348377 Oct 04 18:44:40.218352 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1982/4016] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:44:39 2022] POST /compute/v2.1/servers/c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51/action => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:44:40.229037 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-73ff0954-845a-4b5e-b903-9df0d5ffb516 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:40.229851 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-73ff0954-845a-4b5e-b903-9df0d5ffb516 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:40.237716 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-73ff0954-845a-4b5e-b903-9df0d5ffb516 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:40.238618 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-73ff0954-845a-4b5e-b903-9df0d5ffb516 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:40.239522 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-73ff0954-845a-4b5e-b903-9df0d5ffb516 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:40.240540 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-73ff0954-845a-4b5e-b903-9df0d5ffb516 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:40.244539 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-73ff0954-845a-4b5e-b903-9df0d5ffb516 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:40.245187 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-73ff0954-845a-4b5e-b903-9df0d5ffb516 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:40.411653 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9df63ed5-8041-4df2-924b-e16b3a944c29 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8d2814c23a4aa9806d56ce99c89e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8596483de9f14de9a88cdb787841fd3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:40.428221 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9df63ed5-8041-4df2-924b-e16b3a944c29 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/servers/6905c432-0fb3-4f5a-84bb-0ffcb08e2b3c" status: 200 len: 1472 microversion: 2.1 time: 0.249932 Oct 04 18:44:40.431286 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2035/4017] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:40 2022] GET /compute/v2.1/servers/6905c432-0fb3-4f5a-84bb-0ffcb08e2b3c => generated 1472 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:44:40.442264 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-73ff0954-845a-4b5e-b903-9df0d5ffb516 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:40.452027 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-73ff0954-845a-4b5e-b903-9df0d5ffb516 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51" status: 200 len: 1509 microversion: 2.1 time: 0.228515 Oct 04 18:44:40.452975 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1983/4018] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:40 2022] GET /compute/v2.1/servers/c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51 => generated 1509 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:40.828110 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-bc25ec7a-f586-489b-9c06-f85cdc661c5c tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:40.828814 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-bc25ec7a-f586-489b-9c06-f85cdc661c5c tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] [instance: 298850cf-74ca-4aa2-83c4-03602d5b2260] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:40.836427 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bc25ec7a-f586-489b-9c06-f85cdc661c5c tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:40.837442 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bc25ec7a-f586-489b-9c06-f85cdc661c5c tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:40.837952 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bc25ec7a-f586-489b-9c06-f85cdc661c5c tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:40.839113 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bc25ec7a-f586-489b-9c06-f85cdc661c5c tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:40.840170 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bc25ec7a-f586-489b-9c06-f85cdc661c5c tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:40.841357 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bc25ec7a-f586-489b-9c06-f85cdc661c5c tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:41.046609 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-bc25ec7a-f586-489b-9c06-f85cdc661c5c tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdfd40fbb91e4c5a8b5a060a6667fa7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e700f423d84c08b35b4eceae2ff6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:41.055535 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-bc25ec7a-f586-489b-9c06-f85cdc661c5c tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] 10.222.0.20 "GET /compute/v2.1/servers/298850cf-74ca-4aa2-83c4-03602d5b2260" status: 200 len: 1505 microversion: 2.1 time: 0.232783 Oct 04 18:44:41.056185 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2036/4019] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:40 2022] GET /compute/v2.1/servers/298850cf-74ca-4aa2-83c4-03602d5b2260 => generated 1505 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:41.260676 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-859c45b5-3e09-4584-91ba-cc3f6270acf3 req-fa8e7349-388b-4958-b5d9-16259839c675 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6905c432-0fb3-4f5a-84bb-0ffcb08e2b3c", "name": "network-vif-deleted", "tag": "457c88d9-9246-435c-b1a5-58b0c6c6185d"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:41.272114 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-859c45b5-3e09-4584-91ba-cc3f6270acf3 req-fa8e7349-388b-4958-b5d9-16259839c675 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:41.272639 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-859c45b5-3e09-4584-91ba-cc3f6270acf3 req-fa8e7349-388b-4958-b5d9-16259839c675 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:41.274439 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-859c45b5-3e09-4584-91ba-cc3f6270acf3 req-fa8e7349-388b-4958-b5d9-16259839c675 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:41.286995 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-859c45b5-3e09-4584-91ba-cc3f6270acf3 req-fa8e7349-388b-4958-b5d9-16259839c675 service nova] Creating event network-vif-deleted:457c88d9-9246-435c-b1a5-58b0c6c6185d for instance 6905c432-0fb3-4f5a-84bb-0ffcb08e2b3c on n-h1-850501-14 Oct 04 18:44:41.292065 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-859c45b5-3e09-4584-91ba-cc3f6270acf3 req-fa8e7349-388b-4958-b5d9-16259839c675 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035237 Oct 04 18:44:41.292886 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1984/4020] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:44:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:44:41.453243 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9bff4abb-92bd-4980-9c0a-cbb0484acb03 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:41.453863 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-9bff4abb-92bd-4980-9c0a-cbb0484acb03 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] [instance: 6905c432-0fb3-4f5a-84bb-0ffcb08e2b3c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:41.463254 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9bff4abb-92bd-4980-9c0a-cbb0484acb03 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:41.464167 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9bff4abb-92bd-4980-9c0a-cbb0484acb03 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:41.464825 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9bff4abb-92bd-4980-9c0a-cbb0484acb03 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:41.467254 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9bff4abb-92bd-4980-9c0a-cbb0484acb03 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:41.467928 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9bff4abb-92bd-4980-9c0a-cbb0484acb03 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:41.469292 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9bff4abb-92bd-4980-9c0a-cbb0484acb03 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:41.478576 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-63e6d679-1a23-403b-9569-ef906cd39879 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:41.479872 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-63e6d679-1a23-403b-9569-ef906cd39879 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:41.491474 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-63e6d679-1a23-403b-9569-ef906cd39879 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:41.492528 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-63e6d679-1a23-403b-9569-ef906cd39879 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:41.493384 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-63e6d679-1a23-403b-9569-ef906cd39879 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:41.494940 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-63e6d679-1a23-403b-9569-ef906cd39879 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:41.495681 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-63e6d679-1a23-403b-9569-ef906cd39879 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:41.496378 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-63e6d679-1a23-403b-9569-ef906cd39879 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:41.573906 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9bff4abb-92bd-4980-9c0a-cbb0484acb03 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8d2814c23a4aa9806d56ce99c89e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8596483de9f14de9a88cdb787841fd3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:41.585201 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9bff4abb-92bd-4980-9c0a-cbb0484acb03 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/servers/6905c432-0fb3-4f5a-84bb-0ffcb08e2b3c" status: 200 len: 1301 microversion: 2.1 time: 0.136311 Oct 04 18:44:41.597210 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2037/4021] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:41 2022] GET /compute/v2.1/servers/6905c432-0fb3-4f5a-84bb-0ffcb08e2b3c => generated 1301 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:41.679656 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-63e6d679-1a23-403b-9569-ef906cd39879 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:41.689160 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-63e6d679-1a23-403b-9569-ef906cd39879 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51" status: 200 len: 1509 microversion: 2.1 time: 0.217229 Oct 04 18:44:41.690046 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1985/4022] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:41 2022] GET /compute/v2.1/servers/c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51 => generated 1509 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:44:41.933999 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-53937236-699b-4550-a38b-adcc7f409892 req-e73c6000-2371-495f-bf07-8f871b7ad025 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "298850cf-74ca-4aa2-83c4-03602d5b2260", "name": "network-vif-deleted", "tag": "332d0839-706c-4b8e-9a0a-2d5c9bed6f46"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:41.945327 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-53937236-699b-4550-a38b-adcc7f409892 req-e73c6000-2371-495f-bf07-8f871b7ad025 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:41.945801 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-53937236-699b-4550-a38b-adcc7f409892 req-e73c6000-2371-495f-bf07-8f871b7ad025 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:41.946263 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-53937236-699b-4550-a38b-adcc7f409892 req-e73c6000-2371-495f-bf07-8f871b7ad025 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:41.958419 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-53937236-699b-4550-a38b-adcc7f409892 req-e73c6000-2371-495f-bf07-8f871b7ad025 service nova] Creating event network-vif-deleted:332d0839-706c-4b8e-9a0a-2d5c9bed6f46 for instance 298850cf-74ca-4aa2-83c4-03602d5b2260 on n-h2-850501-14 Oct 04 18:44:41.963573 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-53937236-699b-4550-a38b-adcc7f409892 req-e73c6000-2371-495f-bf07-8f871b7ad025 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033251 Oct 04 18:44:41.964359 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2038/4023] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:44:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:44:42.081770 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-97aff4a5-8491-48d7-9463-3000b98fd643 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:42.082369 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-97aff4a5-8491-48d7-9463-3000b98fd643 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] [instance: 298850cf-74ca-4aa2-83c4-03602d5b2260] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:42.088507 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-97aff4a5-8491-48d7-9463-3000b98fd643 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:42.088995 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-97aff4a5-8491-48d7-9463-3000b98fd643 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:42.089432 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-97aff4a5-8491-48d7-9463-3000b98fd643 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:42.090346 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-97aff4a5-8491-48d7-9463-3000b98fd643 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:42.091487 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-97aff4a5-8491-48d7-9463-3000b98fd643 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:42.092143 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-97aff4a5-8491-48d7-9463-3000b98fd643 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:42.167214 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-97aff4a5-8491-48d7-9463-3000b98fd643 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdfd40fbb91e4c5a8b5a060a6667fa7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e700f423d84c08b35b4eceae2ff6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:42.187109 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-97aff4a5-8491-48d7-9463-3000b98fd643 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] 10.222.0.20 "GET /compute/v2.1/servers/298850cf-74ca-4aa2-83c4-03602d5b2260" status: 200 len: 1463 microversion: 2.1 time: 0.109488 Oct 04 18:44:42.198353 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1986/4024] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:42 2022] GET /compute/v2.1/servers/298850cf-74ca-4aa2-83c4-03602d5b2260 => generated 1463 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:42.609806 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ec26e1eb-ac32-44c1-a38e-3b85fb4bcc1d tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:42.610501 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ec26e1eb-ac32-44c1-a38e-3b85fb4bcc1d tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] [instance: 6905c432-0fb3-4f5a-84bb-0ffcb08e2b3c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:42.616658 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec26e1eb-ac32-44c1-a38e-3b85fb4bcc1d tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:42.621116 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec26e1eb-ac32-44c1-a38e-3b85fb4bcc1d tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:42.621116 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec26e1eb-ac32-44c1-a38e-3b85fb4bcc1d tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:42.621116 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec26e1eb-ac32-44c1-a38e-3b85fb4bcc1d tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:42.621116 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec26e1eb-ac32-44c1-a38e-3b85fb4bcc1d tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:42.621116 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec26e1eb-ac32-44c1-a38e-3b85fb4bcc1d tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:42.650094 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec26e1eb-ac32-44c1-a38e-3b85fb4bcc1d tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:42.650563 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec26e1eb-ac32-44c1-a38e-3b85fb4bcc1d tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:42.650989 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec26e1eb-ac32-44c1-a38e-3b85fb4bcc1d tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:42.651428 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-ec26e1eb-ac32-44c1-a38e-3b85fb4bcc1d tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lazy-loading 'fault' on Instance uuid 6905c432-0fb3-4f5a-84bb-0ffcb08e2b3c {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:44:42.695830 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ec26e1eb-ac32-44c1-a38e-3b85fb4bcc1d tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8d2814c23a4aa9806d56ce99c89e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8596483de9f14de9a88cdb787841fd3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:42.704436 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ec26e1eb-ac32-44c1-a38e-3b85fb4bcc1d tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/servers/6905c432-0fb3-4f5a-84bb-0ffcb08e2b3c" status: 200 len: 1306 microversion: 2.1 time: 0.099427 Oct 04 18:44:42.705011 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2039/4025] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:42 2022] GET /compute/v2.1/servers/6905c432-0fb3-4f5a-84bb-0ffcb08e2b3c => generated 1306 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:42.723542 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3a85b0a8-9e4c-41b9-984f-b2863d4efc84 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:42.727962 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3a85b0a8-9e4c-41b9-984f-b2863d4efc84 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:42.730434 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:44:42.735996 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3a85b0a8-9e4c-41b9-984f-b2863d4efc84 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:42.736818 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3a85b0a8-9e4c-41b9-984f-b2863d4efc84 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:42.737404 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3a85b0a8-9e4c-41b9-984f-b2863d4efc84 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:42.737952 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3a85b0a8-9e4c-41b9-984f-b2863d4efc84 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:42.738532 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3a85b0a8-9e4c-41b9-984f-b2863d4efc84 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:42.739042 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3a85b0a8-9e4c-41b9-984f-b2863d4efc84 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:42.890756 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3a85b0a8-9e4c-41b9-984f-b2863d4efc84 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:42.899162 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3a85b0a8-9e4c-41b9-984f-b2863d4efc84 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51" status: 200 len: 1509 microversion: 2.1 time: 0.186797 Oct 04 18:44:42.920460 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1987/4026] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:42 2022] GET /compute/v2.1/servers/c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51 => generated 1509 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:43.212736 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b87d048a-23ba-418c-b411-709dbc18d955 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:43.213344 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b87d048a-23ba-418c-b411-709dbc18d955 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] [instance: 298850cf-74ca-4aa2-83c4-03602d5b2260] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:43.220197 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b87d048a-23ba-418c-b411-709dbc18d955 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:43.220684 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b87d048a-23ba-418c-b411-709dbc18d955 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:43.221115 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b87d048a-23ba-418c-b411-709dbc18d955 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:43.224372 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b87d048a-23ba-418c-b411-709dbc18d955 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:43.224372 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b87d048a-23ba-418c-b411-709dbc18d955 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:43.224372 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b87d048a-23ba-418c-b411-709dbc18d955 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:43.255378 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b87d048a-23ba-418c-b411-709dbc18d955 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:43.255872 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b87d048a-23ba-418c-b411-709dbc18d955 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:43.256931 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b87d048a-23ba-418c-b411-709dbc18d955 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:43.256931 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-b87d048a-23ba-418c-b411-709dbc18d955 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Lazy-loading 'fault' on Instance uuid 298850cf-74ca-4aa2-83c4-03602d5b2260 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:44:43.298505 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b87d048a-23ba-418c-b411-709dbc18d955 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdfd40fbb91e4c5a8b5a060a6667fa7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e700f423d84c08b35b4eceae2ff6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:43.305512 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b87d048a-23ba-418c-b411-709dbc18d955 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] 10.222.0.20 "GET /compute/v2.1/servers/298850cf-74ca-4aa2-83c4-03602d5b2260" status: 200 len: 1304 microversion: 2.1 time: 0.096678 Oct 04 18:44:43.306269 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2040/4027] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:43 2022] GET /compute/v2.1/servers/298850cf-74ca-4aa2-83c4-03602d5b2260 => generated 1304 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:43.734034 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1aa161fc-cbc9-40e3-b2cd-f3ab4d1bfe3b tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:43.734658 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1aa161fc-cbc9-40e3-b2cd-f3ab4d1bfe3b tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] [instance: 6905c432-0fb3-4f5a-84bb-0ffcb08e2b3c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:43.741926 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1aa161fc-cbc9-40e3-b2cd-f3ab4d1bfe3b tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:43.744933 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1aa161fc-cbc9-40e3-b2cd-f3ab4d1bfe3b tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:43.744933 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1aa161fc-cbc9-40e3-b2cd-f3ab4d1bfe3b tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:43.744933 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1aa161fc-cbc9-40e3-b2cd-f3ab4d1bfe3b tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:43.744933 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1aa161fc-cbc9-40e3-b2cd-f3ab4d1bfe3b tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:43.744933 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1aa161fc-cbc9-40e3-b2cd-f3ab4d1bfe3b tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:43.759310 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-1aa161fc-cbc9-40e3-b2cd-f3ab4d1bfe3b tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] HTTP exception thrown: Instance 6905c432-0fb3-4f5a-84bb-0ffcb08e2b3c could not be found. Oct 04 18:44:43.761007 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1aa161fc-cbc9-40e3-b2cd-f3ab4d1bfe3b tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Request method failure captured: Oct 04 18:44:43.761007 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/6905c432-0fb3-4f5a-84bb-0ffcb08e2b3c HTTP/1.1 Oct 04 18:44:43.761007 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:44:43.761007 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:44:43.761007 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:44:43.761007 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:44:43.761007 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:44:43.761007 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:44:43.761007 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:44:43.761007 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:44:43.761007 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH6apmN4aEauMOESGJLQzSG1Usma4DWCea4_fgo5fOVtFXdBacTK2P9fQTGYj0MsTF9z-kjbM51w827pGAXAAWcPohV3MELfvvrMPGUW6NnjCTVorlnyPyNoMjDgKv92Elezbap5MsiKygxCTPq7WAI0Z6uEpDgQCTmb0465MCFS3Eg Oct 04 18:44:43.761007 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:44:43.761007 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:44:43.761007 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:44:43.761007 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:44:43.761007 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:44:43.761007 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:44:43.761007 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 8596483de9f14de9a88cdb787841fd3c Oct 04 18:44:43.761007 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ListImageFiltersTestJSON-1802727151 Oct 04 18:44:43.761007 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:44:43.761007 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:44:43.761007 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8596483de9f14de9a88cdb787841fd3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8596483de9f14de9a88cdb787841fd3c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8596483de9f14de9a88cdb787841fd3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8596483de9f14de9a88cdb787841fd3c"}]}] Oct 04 18:44:43.761007 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ListImageFiltersTestJSON-1802727151 Oct 04 18:44:43.761007 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 8596483de9f14de9a88cdb787841fd3c Oct 04 18:44:43.761007 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1802727151 Oct 04 18:44:43.761007 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ListImageFiltersTestJSON-1802727151-project Oct 04 18:44:43.761007 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:44:43.761007 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:44:43.761007 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 9e8d2814c23a4aa9806d56ce99c89e57 Oct 04 18:44:43.761007 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ListImageFiltersTestJSON-1802727151-project Oct 04 18:44:43.761007 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:44:43.761007 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 6905c432-0fb3-4f5a-84bb-0ffcb08e2b3c could not be found. Oct 04 18:44:43.761007 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '6905c432-0fb3-4f5a-84bb-0ffcb08e2b3c'} Oct 04 18:44:43.761007 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:44:43.761007 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:44:43.761007 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:44:43.761007 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:44:43.761007 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:44:43.761007 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:44:43.761007 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:44:43.761007 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:44:43.761007 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:44:43.761007 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:44:43.761007 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6905c432-0fb3-4f5a-84bb-0ffcb08e2b3c could not be found. Oct 04 18:44:43.761007 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:44:43.761007 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:44:43.761007 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:44:43.761007 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:44:43.761007 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:44:43.761007 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:44:43.761007 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:44:43.761007 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:44:43.761007 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:44:43.761007 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:44:43.761007 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:44:43.761007 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:44:43.761007 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:44:43.761007 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:44:43.761007 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:44:43.761007 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:44:43.761007 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6905c432-0fb3-4f5a-84bb-0ffcb08e2b3c could not be found. Oct 04 18:44:43.761007 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:44:43.761007 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:44:43.761007 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:44:43.767477 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:44:43.767477 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:44:43.767477 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:44:43.767477 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:44:43.767477 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:44:43.767477 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6905c432-0fb3-4f5a-84bb-0ffcb08e2b3c could not be found. Oct 04 18:44:43.767477 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:44:43.767477 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1aa161fc-cbc9-40e3-b2cd-f3ab4d1bfe3b tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Returning 404 to user: Instance 6905c432-0fb3-4f5a-84bb-0ffcb08e2b3c could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:44:43.767477 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1aa161fc-cbc9-40e3-b2cd-f3ab4d1bfe3b tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "GET /compute/v2.1/servers/6905c432-0fb3-4f5a-84bb-0ffcb08e2b3c" status: 404 len: 111 microversion: 2.1 time: 0.033357 Oct 04 18:44:43.767477 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1988/4028] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:43 2022] GET /compute/v2.1/servers/6905c432-0fb3-4f5a-84bb-0ffcb08e2b3c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:44:43.772313 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2b90f473-7d96-4ad1-a7e6-62db31f30822 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe25921c160>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:43.930089 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3af65879-e363-4dfa-a687-c67e21c281a2 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:43.930089 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3af65879-e363-4dfa-a687-c67e21c281a2 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:43.937389 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3af65879-e363-4dfa-a687-c67e21c281a2 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:43.938157 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3af65879-e363-4dfa-a687-c67e21c281a2 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:43.938759 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3af65879-e363-4dfa-a687-c67e21c281a2 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:43.939828 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3af65879-e363-4dfa-a687-c67e21c281a2 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:43.940533 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3af65879-e363-4dfa-a687-c67e21c281a2 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:43.941121 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3af65879-e363-4dfa-a687-c67e21c281a2 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:44.097477 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3af65879-e363-4dfa-a687-c67e21c281a2 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:44.110242 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3af65879-e363-4dfa-a687-c67e21c281a2 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51" status: 200 len: 1509 microversion: 2.1 time: 0.184064 Oct 04 18:44:44.120327 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1989/4029] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:43 2022] GET /compute/v2.1/servers/c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51 => generated 1509 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:44:44.330061 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-64137af5-5cf8-42a5-a9a5-fbb9aec05d59 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:44.335759 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-64137af5-5cf8-42a5-a9a5-fbb9aec05d59 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] [instance: 298850cf-74ca-4aa2-83c4-03602d5b2260] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:44.343235 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-64137af5-5cf8-42a5-a9a5-fbb9aec05d59 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:44.344933 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-64137af5-5cf8-42a5-a9a5-fbb9aec05d59 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:44.344933 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-64137af5-5cf8-42a5-a9a5-fbb9aec05d59 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:44.345150 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-64137af5-5cf8-42a5-a9a5-fbb9aec05d59 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:44.345540 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-64137af5-5cf8-42a5-a9a5-fbb9aec05d59 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:44.345966 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-64137af5-5cf8-42a5-a9a5-fbb9aec05d59 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:44.363735 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-64137af5-5cf8-42a5-a9a5-fbb9aec05d59 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] HTTP exception thrown: Instance 298850cf-74ca-4aa2-83c4-03602d5b2260 could not be found. Oct 04 18:44:44.365335 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-64137af5-5cf8-42a5-a9a5-fbb9aec05d59 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Request method failure captured: Oct 04 18:44:44.365335 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/298850cf-74ca-4aa2-83c4-03602d5b2260 HTTP/1.1 Oct 04 18:44:44.365335 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:44:44.365335 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:44:44.365335 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:44:44.365335 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:44:44.365335 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:44:44.365335 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:44:44.365335 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:44:44.365335 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:44:44.365335 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH72WykXgarAjeCZPbDbuXQgiX4YXHGF9S7sskXBL38KJGO1U9WAywqoxwP73gBKIbJ4uO6eq8Plk2KKXWfI04iMXaNn4-MKSL_pYB0RYZFAb5g4bTE0SV_MVwFncJuLBEOAqIT3dQj4Lr-03WVG_qSJqufiNuaTqEFK4x19r21mxdc Oct 04 18:44:44.365335 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:44:44.365335 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:44:44.365335 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:44:44.365335 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:44:44.365335 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:44:44.365335 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:44:44.365335 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: b7e700f423d84c08b35b4eceae2ff6ef Oct 04 18:44:44.365335 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-VolumesActionsTest-36395939 Oct 04 18:44:44.365335 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:44:44.365335 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:44:44.365335 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b7e700f423d84c08b35b4eceae2ff6ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b7e700f423d84c08b35b4eceae2ff6ef", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b7e700f423d84c08b35b4eceae2ff6ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b7e700f423d84c08b35b4eceae2ff6ef"}]}] Oct 04 18:44:44.365335 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-VolumesActionsTest-36395939 Oct 04 18:44:44.365335 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: b7e700f423d84c08b35b4eceae2ff6ef Oct 04 18:44:44.365335 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-VolumesActionsTest-36395939 Oct 04 18:44:44.365335 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-VolumesActionsTest-36395939-project Oct 04 18:44:44.365335 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:44:44.365335 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:44:44.365335 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: cdfd40fbb91e4c5a8b5a060a6667fa7b Oct 04 18:44:44.365335 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-VolumesActionsTest-36395939-project Oct 04 18:44:44.365335 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:44:44.365335 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 298850cf-74ca-4aa2-83c4-03602d5b2260 could not be found. Oct 04 18:44:44.365335 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '298850cf-74ca-4aa2-83c4-03602d5b2260'} Oct 04 18:44:44.365335 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:44:44.365335 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:44:44.365335 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:44:44.365335 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:44:44.365335 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:44:44.365335 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:44:44.365335 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:44:44.365335 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:44:44.365335 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:44:44.365335 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:44:44.365335 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 298850cf-74ca-4aa2-83c4-03602d5b2260 could not be found. Oct 04 18:44:44.365335 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:44:44.365335 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:44:44.365335 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:44:44.365335 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:44:44.365335 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:44:44.365335 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:44:44.365335 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:44:44.365335 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:44:44.365335 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:44:44.365335 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:44:44.365335 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:44:44.365335 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:44:44.365335 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:44:44.365335 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:44:44.365335 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:44:44.365335 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:44:44.365335 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 298850cf-74ca-4aa2-83c4-03602d5b2260 could not be found. Oct 04 18:44:44.365335 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:44:44.365335 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:44:44.365335 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:44:44.376489 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:44:44.376489 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:44:44.376489 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:44:44.376489 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:44:44.376489 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:44:44.376489 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 298850cf-74ca-4aa2-83c4-03602d5b2260 could not be found. Oct 04 18:44:44.376489 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:44:44.376489 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-64137af5-5cf8-42a5-a9a5-fbb9aec05d59 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] Returning 404 to user: Instance 298850cf-74ca-4aa2-83c4-03602d5b2260 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:44:44.376489 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-64137af5-5cf8-42a5-a9a5-fbb9aec05d59 tempest-VolumesActionsTest-36395939 tempest-VolumesActionsTest-36395939-project] 10.222.0.20 "GET /compute/v2.1/servers/298850cf-74ca-4aa2-83c4-03602d5b2260" status: 404 len: 111 microversion: 2.1 time: 0.041187 Oct 04 18:44:44.376489 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1990/4030] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:44 2022] GET /compute/v2.1/servers/298850cf-74ca-4aa2-83c4-03602d5b2260 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:44:44.608048 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2b90f473-7d96-4ad1-a7e6-62db31f30822 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "DELETE /compute/v2.1/images/b65b417c-791d-426d-8551-3644174bf59d" status: 204 len: 0 microversion: 2.1 time: 0.839875 Oct 04 18:44:44.612502 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2041/4031] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:43 2022] DELETE /compute/v2.1/images/b65b417c-791d-426d-8551-3644174bf59d => generated 0 bytes in 842 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:44:44.617214 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-21f6995f-c472-4bbb-aef8-f6c144a42863 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe2596eb160>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:45.140524 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7775481c-cebf-49b1-a3bb-93260e456b6f tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:45.141290 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7775481c-cebf-49b1-a3bb-93260e456b6f tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:45.149789 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7775481c-cebf-49b1-a3bb-93260e456b6f tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:45.150476 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7775481c-cebf-49b1-a3bb-93260e456b6f tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:45.151103 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7775481c-cebf-49b1-a3bb-93260e456b6f tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:45.152542 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7775481c-cebf-49b1-a3bb-93260e456b6f tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:45.153023 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7775481c-cebf-49b1-a3bb-93260e456b6f tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:45.153461 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7775481c-cebf-49b1-a3bb-93260e456b6f tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:45.309221 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7775481c-cebf-49b1-a3bb-93260e456b6f tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:45.317935 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7775481c-cebf-49b1-a3bb-93260e456b6f tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51" status: 200 len: 1509 microversion: 2.1 time: 0.185452 Oct 04 18:44:45.318507 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2042/4032] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:45 2022] GET /compute/v2.1/servers/c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51 => generated 1509 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:44:45.323377 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d1b6ed6e-4aa0-4b25-99d2-a2c3d38e582c tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:45.325742 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d1b6ed6e-4aa0-4b25-99d2-a2c3d38e582c tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: 4d6dfac0-958d-4698-a050-6539caebe52c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:45.332298 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d1b6ed6e-4aa0-4b25-99d2-a2c3d38e582c tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:45.332784 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d1b6ed6e-4aa0-4b25-99d2-a2c3d38e582c tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:45.333229 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d1b6ed6e-4aa0-4b25-99d2-a2c3d38e582c tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:45.333926 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d1b6ed6e-4aa0-4b25-99d2-a2c3d38e582c tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:45.334390 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d1b6ed6e-4aa0-4b25-99d2-a2c3d38e582c tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:45.334822 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d1b6ed6e-4aa0-4b25-99d2-a2c3d38e582c tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:45.358326 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-d1b6ed6e-4aa0-4b25-99d2-a2c3d38e582c tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lazy-loading 'flavor' on Instance uuid 4d6dfac0-958d-4698-a050-6539caebe52c {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:44:45.366792 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-21f6995f-c472-4bbb-aef8-f6c144a42863 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "DELETE /compute/v2.1/images/c2d74af2-6145-47cb-afce-79b914979a49" status: 204 len: 0 microversion: 2.1 time: 0.753445 Oct 04 18:44:45.370982 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1991/4033] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:44 2022] DELETE /compute/v2.1/images/c2d74af2-6145-47cb-afce-79b914979a49 => generated 0 bytes in 755 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:44:45.376842 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-cb3e3f7f-df2d-4d4a-a9bc-a5299266a1c7 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] Calling method '.version_select at 0x7fe25d2ad790>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:45.840442 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d1b6ed6e-4aa0-4b25-99d2-a2c3d38e582c tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "POST /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c/action" status: 200 len: 32 microversion: 2.1 time: 0.520419 Oct 04 18:44:45.846593 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2043/4034] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:44:45 2022] POST /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c/action => generated 32 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:44:45.852539 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-894ffd41-524e-4766-8dd0-f8ab3a7cf0c2 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:45.853359 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-894ffd41-524e-4766-8dd0-f8ab3a7cf0c2 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: 4d6dfac0-958d-4698-a050-6539caebe52c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:45.862059 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-894ffd41-524e-4766-8dd0-f8ab3a7cf0c2 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:45.862794 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-894ffd41-524e-4766-8dd0-f8ab3a7cf0c2 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:45.863339 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-894ffd41-524e-4766-8dd0-f8ab3a7cf0c2 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:45.864324 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-894ffd41-524e-4766-8dd0-f8ab3a7cf0c2 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:45.865001 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-894ffd41-524e-4766-8dd0-f8ab3a7cf0c2 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:45.865647 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-894ffd41-524e-4766-8dd0-f8ab3a7cf0c2 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:46.108872 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-894ffd41-524e-4766-8dd0-f8ab3a7cf0c2 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:46.122128 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-894ffd41-524e-4766-8dd0-f8ab3a7cf0c2 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c" status: 200 len: 1733 microversion: 2.1 time: 0.273448 Oct 04 18:44:46.123180 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2044/4035] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:45 2022] GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c => generated 1733 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:46.143973 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-cb3e3f7f-df2d-4d4a-a9bc-a5299266a1c7 tempest-ListImageFiltersTestJSON-1802727151 tempest-ListImageFiltersTestJSON-1802727151-project] 10.222.0.20 "DELETE /compute/v2.1/images/d2f208e9-736a-414a-b95a-a8af52e6828b" status: 204 len: 0 microversion: 2.1 time: 0.771781 Oct 04 18:44:46.144859 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1992/4036] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:45 2022] DELETE /compute/v2.1/images/d2f208e9-736a-414a-b95a-a8af52e6828b => generated 0 bytes in 773 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:44:46.342881 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-900f4454-ed78-4b91-90d5-7655b4a1290c tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:46.343490 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-900f4454-ed78-4b91-90d5-7655b4a1290c tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:46.354670 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-900f4454-ed78-4b91-90d5-7655b4a1290c tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:46.355560 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-900f4454-ed78-4b91-90d5-7655b4a1290c tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:46.356213 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-900f4454-ed78-4b91-90d5-7655b4a1290c tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:46.357959 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-900f4454-ed78-4b91-90d5-7655b4a1290c tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:46.359118 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-900f4454-ed78-4b91-90d5-7655b4a1290c tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:46.361894 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-900f4454-ed78-4b91-90d5-7655b4a1290c tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:46.637914 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-900f4454-ed78-4b91-90d5-7655b4a1290c tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:46.652580 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-900f4454-ed78-4b91-90d5-7655b4a1290c tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51" status: 200 len: 1509 microversion: 2.1 time: 0.314116 Oct 04 18:44:46.676170 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2045/4037] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:46 2022] GET /compute/v2.1/servers/c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51 => generated 1509 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:47.159922 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c6300764-e4f2-4c6e-b5a7-d5b6d077ac2c tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:47.167250 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c6300764-e4f2-4c6e-b5a7-d5b6d077ac2c tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: 4d6dfac0-958d-4698-a050-6539caebe52c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:47.183091 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c6300764-e4f2-4c6e-b5a7-d5b6d077ac2c tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:47.183597 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c6300764-e4f2-4c6e-b5a7-d5b6d077ac2c tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:47.184043 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c6300764-e4f2-4c6e-b5a7-d5b6d077ac2c tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:47.184803 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c6300764-e4f2-4c6e-b5a7-d5b6d077ac2c tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:47.188615 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c6300764-e4f2-4c6e-b5a7-d5b6d077ac2c tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:47.188615 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c6300764-e4f2-4c6e-b5a7-d5b6d077ac2c tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:47.364482 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c6300764-e4f2-4c6e-b5a7-d5b6d077ac2c tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:47.377341 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c6300764-e4f2-4c6e-b5a7-d5b6d077ac2c tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c" status: 200 len: 1733 microversion: 2.1 time: 0.223580 Oct 04 18:44:47.378580 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1993/4038] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:47 2022] GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c => generated 1733 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:47.682942 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9288d525-cbb6-4261-937a-f63e193d3093 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:47.683660 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9288d525-cbb6-4261-937a-f63e193d3093 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:47.693917 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9288d525-cbb6-4261-937a-f63e193d3093 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:47.693917 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9288d525-cbb6-4261-937a-f63e193d3093 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:47.693917 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9288d525-cbb6-4261-937a-f63e193d3093 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:47.693917 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9288d525-cbb6-4261-937a-f63e193d3093 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:47.693917 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9288d525-cbb6-4261-937a-f63e193d3093 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:47.694879 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9288d525-cbb6-4261-937a-f63e193d3093 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:47.876084 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9288d525-cbb6-4261-937a-f63e193d3093 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:47.884378 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9288d525-cbb6-4261-937a-f63e193d3093 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51" status: 200 len: 1509 microversion: 2.1 time: 0.205411 Oct 04 18:44:47.885358 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1994/4039] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:47 2022] GET /compute/v2.1/servers/c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51 => generated 1509 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:44:47.935000 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b576b615-b4dc-4671-85d4-d99dbf1ed757 tempest-VolumesAdminNegativeTest-1982715801 tempest-VolumesAdminNegativeTest-1982715801-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "90a30b2a-4232-4507-8cc7-5c269a206e85"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:47.942203 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b576b615-b4dc-4671-85d4-d99dbf1ed757 tempest-VolumesAdminNegativeTest-1982715801 tempest-VolumesAdminNegativeTest-1982715801-project-admin] [instance: 6cc94ec4-3e28-41e0-808e-9cd2263bca7d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:47.949096 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b576b615-b4dc-4671-85d4-d99dbf1ed757 tempest-VolumesAdminNegativeTest-1982715801 tempest-VolumesAdminNegativeTest-1982715801-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:47.951680 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b576b615-b4dc-4671-85d4-d99dbf1ed757 tempest-VolumesAdminNegativeTest-1982715801 tempest-VolumesAdminNegativeTest-1982715801-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:47.951680 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b576b615-b4dc-4671-85d4-d99dbf1ed757 tempest-VolumesAdminNegativeTest-1982715801 tempest-VolumesAdminNegativeTest-1982715801-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:47.951680 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b576b615-b4dc-4671-85d4-d99dbf1ed757 tempest-VolumesAdminNegativeTest-1982715801 tempest-VolumesAdminNegativeTest-1982715801-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:47.952582 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b576b615-b4dc-4671-85d4-d99dbf1ed757 tempest-VolumesAdminNegativeTest-1982715801 tempest-VolumesAdminNegativeTest-1982715801-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:47.953016 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b576b615-b4dc-4671-85d4-d99dbf1ed757 tempest-VolumesAdminNegativeTest-1982715801 tempest-VolumesAdminNegativeTest-1982715801-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:47.971441 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:44:48.088904 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-b576b615-b4dc-4671-85d4-d99dbf1ed757 tempest-VolumesAdminNegativeTest-1982715801 tempest-VolumesAdminNegativeTest-1982715801-project-admin] HTTP exception thrown: Volume 90a30b2a-4232-4507-8cc7-5c269a206e85 could not be found. Oct 04 18:44:48.127614 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b576b615-b4dc-4671-85d4-d99dbf1ed757 tempest-VolumesAdminNegativeTest-1982715801 tempest-VolumesAdminNegativeTest-1982715801-project-admin] Request method failure captured: Oct 04 18:44:48.127614 n-d-850501-14 devstack@n-api.service[123001]: request: PUT /compute/v2.1/servers/6cc94ec4-3e28-41e0-808e-9cd2263bca7d/os-volume_attachments/2a72350d-1f0b-4742-8641-5773ece51bb7 HTTP/1.1 Oct 04 18:44:48.127614 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:44:48.127614 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:44:48.127614 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:44:48.127614 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 74 Oct 04 18:44:48.127614 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:44:48.127614 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:44:48.127614 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:44:48.127614 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:44:48.127614 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPH6e77kqMoECxl1oKpbQaBp84UEulG7hqvYM-hsN36Q_5BQxQW9dkO1lZwGDhHNINBxpB-zWyXKF7s1J4LOXgyE0Ya6usIQl_5zzS9FFgQgFANwjihEfUBsDu3SNaXfwz9BVkKSaUAU0cmouzGJWfVaPFMFS-sWSVA11aZinn5-l0UQ Oct 04 18:44:48.127614 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:44:48.127614 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:44:48.127614 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:44:48.127614 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:44:48.127614 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:44:48.127614 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:44:48.127614 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 946a7917acfc43f9bcc64c541b7aebe8 Oct 04 18:44:48.127614 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-VolumesAdminNegativeTest-1982715801 Oct 04 18:44:48.127614 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member,admin Oct 04 18:44:48.127614 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member,admin Oct 04 18:44:48.127614 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/946a7917acfc43f9bcc64c541b7aebe8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_946a7917acfc43f9bcc64c541b7aebe8", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/946a7917acfc43f9bcc64c541b7aebe8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/946a7917acfc43f9bcc64c541b7aebe8"}]}] Oct 04 18:44:48.127614 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-VolumesAdminNegativeTest-1982715801 Oct 04 18:44:48.127614 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 946a7917acfc43f9bcc64c541b7aebe8 Oct 04 18:44:48.127614 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1982715801 Oct 04 18:44:48.127614 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-VolumesAdminNegativeTest-1982715801-project-admin Oct 04 18:44:48.127614 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:44:48.127614 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:44:48.127614 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 20ac605698744c7badcae6046b164335 Oct 04 18:44:48.127614 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-VolumesAdminNegativeTest-1982715801-project-admin Oct 04 18:44:48.127614 n-d-850501-14 devstack@n-api.service[123001]: Oct 04 18:44:48.127614 n-d-850501-14 devstack@n-api.service[123001]: {"volumeAttachment": {"volumeId": "90a30b2a-4232-4507-8cc7-5c269a206e85"}} Oct 04 18:44:48.127614 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:44:48.127614 n-d-850501-14 devstack@n-api.service[123001]: exception: Volume 90a30b2a-4232-4507-8cc7-5c269a206e85 could not be found. Oct 04 18:44:48.127614 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'server_id': '6cc94ec4-3e28-41e0-808e-9cd2263bca7d', 'id': '2a72350d-1f0b-4742-8641-5773ece51bb7', 'body': {'volumeAttachment': {'volumeId': '90a30b2a-4232-4507-8cc7-5c269a206e85'}}} Oct 04 18:44:48.127614 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:44:48.127614 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:44:48.127614 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 18:44:48.127614 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 18:44:48.127614 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 18:44:48.127614 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 18:44:48.127614 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 18:44:48.127614 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 18:44:48.127614 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 18:44:48.127614 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 18:44:48.127614 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 18:44:48.127614 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 18:44:48.127614 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:44:48.127614 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:44:48.127614 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:44:48.127614 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:44:48.127614 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 90a30b2a-4232-4507-8cc7-5c269a206e85 could not be found. (HTTP 404) (Request-ID: req-527184ad-226e-4f78-9810-1e94ff39b3ea) Oct 04 18:44:48.127614 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:44:48.127614 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:44:48.127614 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:44:48.127614 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:44:48.127614 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Oct 04 18:44:48.127614 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Oct 04 18:44:48.127614 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 18:44:48.127614 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 18:44:48.127614 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 18:44:48.133303 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 18:44:48.133303 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 18:44:48.133303 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 18:44:48.133303 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 18:44:48.133303 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 18:44:48.133303 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 18:44:48.133303 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 18:44:48.133303 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 18:44:48.133303 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 18:44:48.133303 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 18:44:48.133303 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 18:44:48.133303 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 18:44:48.133303 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 18:44:48.133303 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:44:48.133303 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:44:48.133303 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:44:48.133303 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:44:48.133303 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 90a30b2a-4232-4507-8cc7-5c269a206e85 could not be found. Oct 04 18:44:48.133303 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:44:48.133303 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:44:48.133303 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:44:48.133303 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:44:48.133303 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:44:48.133303 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:44:48.133303 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:44:48.133303 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:44:48.133303 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:44:48.133303 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:44:48.133303 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:44:48.133303 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:44:48.133303 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:44:48.133303 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:44:48.133303 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 04 18:44:48.133303 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 04 18:44:48.133303 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Oct 04 18:44:48.133303 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 04 18:44:48.133303 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 90a30b2a-4232-4507-8cc7-5c269a206e85 could not be found. Oct 04 18:44:48.133303 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:44:48.133303 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:44:48.133303 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:44:48.133303 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:44:48.133303 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:44:48.133303 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:44:48.133303 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:44:48.133303 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:44:48.133303 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 90a30b2a-4232-4507-8cc7-5c269a206e85 could not be found. Oct 04 18:44:48.133303 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:44:48.140941 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b576b615-b4dc-4671-85d4-d99dbf1ed757 tempest-VolumesAdminNegativeTest-1982715801 tempest-VolumesAdminNegativeTest-1982715801-project-admin] Returning 400 to user: Volume 90a30b2a-4232-4507-8cc7-5c269a206e85 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:44:48.143018 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b576b615-b4dc-4671-85d4-d99dbf1ed757 tempest-VolumesAdminNegativeTest-1982715801 tempest-VolumesAdminNegativeTest-1982715801-project-admin] 10.222.0.20 "PUT /compute/v2.1/servers/6cc94ec4-3e28-41e0-808e-9cd2263bca7d/os-volume_attachments/2a72350d-1f0b-4742-8641-5773ece51bb7" status: 400 len: 107 microversion: 2.1 time: 0.662291 Oct 04 18:44:48.145136 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2046/4040] 10.222.0.20 () {60 vars in 1433 bytes} [Tue Oct 4 18:44:47 2022] PUT /compute/v2.1/servers/6cc94ec4-3e28-41e0-808e-9cd2263bca7d/os-volume_attachments/2a72350d-1f0b-4742-8641-5773ece51bb7 => generated 107 bytes in 666 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:44:48.216187 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9727d646-cfe3-42e3-8ba1-55d1e988ebee tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:48.217299 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9727d646-cfe3-42e3-8ba1-55d1e988ebee tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] [instance: 6cc94ec4-3e28-41e0-808e-9cd2263bca7d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:48.224991 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9727d646-cfe3-42e3-8ba1-55d1e988ebee tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:48.225553 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9727d646-cfe3-42e3-8ba1-55d1e988ebee tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:48.226061 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9727d646-cfe3-42e3-8ba1-55d1e988ebee tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:48.227057 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9727d646-cfe3-42e3-8ba1-55d1e988ebee tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:48.228107 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9727d646-cfe3-42e3-8ba1-55d1e988ebee tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:48.233126 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9727d646-cfe3-42e3-8ba1-55d1e988ebee tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:48.333775 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-9727d646-cfe3-42e3-8ba1-55d1e988ebee tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lazy-loading 'services' on Instance uuid 6cc94ec4-3e28-41e0-808e-9cd2263bca7d {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:44:48.404418 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-013a4252-ca7c-44e7-b3f1-17190e00269f tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:48.405253 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-013a4252-ca7c-44e7-b3f1-17190e00269f tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: 4d6dfac0-958d-4698-a050-6539caebe52c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:48.414038 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-013a4252-ca7c-44e7-b3f1-17190e00269f tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:48.414881 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-013a4252-ca7c-44e7-b3f1-17190e00269f tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:48.415505 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-013a4252-ca7c-44e7-b3f1-17190e00269f tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:48.416537 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-013a4252-ca7c-44e7-b3f1-17190e00269f tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:48.417214 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-013a4252-ca7c-44e7-b3f1-17190e00269f tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:48.417991 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-013a4252-ca7c-44e7-b3f1-17190e00269f tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:48.604862 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-013a4252-ca7c-44e7-b3f1-17190e00269f tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:48.611574 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9727d646-cfe3-42e3-8ba1-55d1e988ebee tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6cc94ec4-3e28-41e0-808e-9cd2263bca7d/os-volume_attachments/2a72350d-1f0b-4742-8641-5773ece51bb7" status: 202 len: 0 microversion: 2.1 time: 0.399422 Oct 04 18:44:48.613570 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1995/4041] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Oct 4 18:44:48 2022] DELETE /compute/v2.1/servers/6cc94ec4-3e28-41e0-808e-9cd2263bca7d/os-volume_attachments/2a72350d-1f0b-4742-8641-5773ece51bb7 => generated 0 bytes in 401 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:44:48.616826 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-013a4252-ca7c-44e7-b3f1-17190e00269f tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c" status: 200 len: 1733 microversion: 2.1 time: 0.218697 Oct 04 18:44:48.617913 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2047/4042] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:48 2022] GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c => generated 1733 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:44:48.622268 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d99cb957-f003-4666-b4b2-0af11c104dd5 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:48.626432 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d99cb957-f003-4666-b4b2-0af11c104dd5 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] [instance: 6cc94ec4-3e28-41e0-808e-9cd2263bca7d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:48.635230 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d99cb957-f003-4666-b4b2-0af11c104dd5 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:48.635876 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d99cb957-f003-4666-b4b2-0af11c104dd5 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:48.636456 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d99cb957-f003-4666-b4b2-0af11c104dd5 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:48.637457 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d99cb957-f003-4666-b4b2-0af11c104dd5 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:48.638010 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d99cb957-f003-4666-b4b2-0af11c104dd5 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:48.639148 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d99cb957-f003-4666-b4b2-0af11c104dd5 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:48.677481 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d99cb957-f003-4666-b4b2-0af11c104dd5 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] 10.222.0.20 "GET /compute/v2.1/servers/6cc94ec4-3e28-41e0-808e-9cd2263bca7d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058611 Oct 04 18:44:48.677481 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1996/4043] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 18:44:48 2022] GET /compute/v2.1/servers/6cc94ec4-3e28-41e0-808e-9cd2263bca7d/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:44:48.909750 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6f831cbf-32f7-42ff-96ac-b6304bb16ee4 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:48.910435 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6f831cbf-32f7-42ff-96ac-b6304bb16ee4 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:48.916710 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6f831cbf-32f7-42ff-96ac-b6304bb16ee4 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:48.917198 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6f831cbf-32f7-42ff-96ac-b6304bb16ee4 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:48.917626 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6f831cbf-32f7-42ff-96ac-b6304bb16ee4 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:48.918323 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6f831cbf-32f7-42ff-96ac-b6304bb16ee4 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:48.918781 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6f831cbf-32f7-42ff-96ac-b6304bb16ee4 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:48.919203 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6f831cbf-32f7-42ff-96ac-b6304bb16ee4 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:49.106597 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6f831cbf-32f7-42ff-96ac-b6304bb16ee4 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:49.115866 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6f831cbf-32f7-42ff-96ac-b6304bb16ee4 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51" status: 200 len: 1509 microversion: 2.1 time: 0.210011 Oct 04 18:44:49.116923 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2048/4044] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:48 2022] GET /compute/v2.1/servers/c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51 => generated 1509 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:49.641528 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-da430ac6-cabe-4e91-88d0-d67e40f40ba9 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:49.642320 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-da430ac6-cabe-4e91-88d0-d67e40f40ba9 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: 4d6dfac0-958d-4698-a050-6539caebe52c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:49.658327 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-da430ac6-cabe-4e91-88d0-d67e40f40ba9 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:49.658988 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-da430ac6-cabe-4e91-88d0-d67e40f40ba9 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:49.659594 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-da430ac6-cabe-4e91-88d0-d67e40f40ba9 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:49.660447 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-da430ac6-cabe-4e91-88d0-d67e40f40ba9 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:49.661014 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-da430ac6-cabe-4e91-88d0-d67e40f40ba9 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:49.662989 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-da430ac6-cabe-4e91-88d0-d67e40f40ba9 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:49.694750 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f2813255-b1ed-4ec9-9f76-1bd49ebe4927 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:49.698199 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f2813255-b1ed-4ec9-9f76-1bd49ebe4927 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] [instance: 6cc94ec4-3e28-41e0-808e-9cd2263bca7d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:49.734666 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f2813255-b1ed-4ec9-9f76-1bd49ebe4927 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:49.735433 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f2813255-b1ed-4ec9-9f76-1bd49ebe4927 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:49.736072 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f2813255-b1ed-4ec9-9f76-1bd49ebe4927 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:49.737210 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f2813255-b1ed-4ec9-9f76-1bd49ebe4927 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:49.738252 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f2813255-b1ed-4ec9-9f76-1bd49ebe4927 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:49.738969 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f2813255-b1ed-4ec9-9f76-1bd49ebe4927 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:49.807292 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f2813255-b1ed-4ec9-9f76-1bd49ebe4927 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] 10.222.0.20 "GET /compute/v2.1/servers/6cc94ec4-3e28-41e0-808e-9cd2263bca7d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.120752 Oct 04 18:44:49.811647 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2049/4045] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 18:44:49 2022] GET /compute/v2.1/servers/6cc94ec4-3e28-41e0-808e-9cd2263bca7d/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:44:50.010882 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-da430ac6-cabe-4e91-88d0-d67e40f40ba9 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:50.024199 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-da430ac6-cabe-4e91-88d0-d67e40f40ba9 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c" status: 200 len: 1733 microversion: 2.1 time: 0.387481 Oct 04 18:44:50.029894 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1997/4046] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:49 2022] GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c => generated 1733 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:50.139712 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e6409e59-4ae5-47ca-b752-340d207d1d3e tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:50.140550 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e6409e59-4ae5-47ca-b752-340d207d1d3e tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:50.146816 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e6409e59-4ae5-47ca-b752-340d207d1d3e tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:50.147597 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e6409e59-4ae5-47ca-b752-340d207d1d3e tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:50.148133 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e6409e59-4ae5-47ca-b752-340d207d1d3e tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:50.148903 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e6409e59-4ae5-47ca-b752-340d207d1d3e tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:50.149471 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e6409e59-4ae5-47ca-b752-340d207d1d3e tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:50.149921 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e6409e59-4ae5-47ca-b752-340d207d1d3e tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:50.390476 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e6409e59-4ae5-47ca-b752-340d207d1d3e tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:50.400334 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e6409e59-4ae5-47ca-b752-340d207d1d3e tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51" status: 200 len: 1509 microversion: 2.1 time: 0.265289 Oct 04 18:44:50.400919 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2050/4047] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:50 2022] GET /compute/v2.1/servers/c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51 => generated 1509 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:50.823517 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7aaa1622-524e-4f2c-aaac-918e22e9ad00 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:50.826465 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7aaa1622-524e-4f2c-aaac-918e22e9ad00 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] [instance: 6cc94ec4-3e28-41e0-808e-9cd2263bca7d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:50.842777 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7aaa1622-524e-4f2c-aaac-918e22e9ad00 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:50.843207 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7aaa1622-524e-4f2c-aaac-918e22e9ad00 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:50.843663 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7aaa1622-524e-4f2c-aaac-918e22e9ad00 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:50.848735 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7aaa1622-524e-4f2c-aaac-918e22e9ad00 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:50.849298 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7aaa1622-524e-4f2c-aaac-918e22e9ad00 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:50.849756 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7aaa1622-524e-4f2c-aaac-918e22e9ad00 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:50.860742 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:44:50.928095 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7aaa1622-524e-4f2c-aaac-918e22e9ad00 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] 10.222.0.20 "GET /compute/v2.1/servers/6cc94ec4-3e28-41e0-808e-9cd2263bca7d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108802 Oct 04 18:44:50.937896 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1998/4048] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 18:44:50 2022] GET /compute/v2.1/servers/6cc94ec4-3e28-41e0-808e-9cd2263bca7d/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:44:51.054583 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-36e2ec94-e041-45c1-ac6a-d17cef63ab38 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:51.055257 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-36e2ec94-e041-45c1-ac6a-d17cef63ab38 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: 4d6dfac0-958d-4698-a050-6539caebe52c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:51.064806 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-36e2ec94-e041-45c1-ac6a-d17cef63ab38 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:51.068030 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-36e2ec94-e041-45c1-ac6a-d17cef63ab38 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:51.068552 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-36e2ec94-e041-45c1-ac6a-d17cef63ab38 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:51.071047 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-36e2ec94-e041-45c1-ac6a-d17cef63ab38 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:51.071774 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-36e2ec94-e041-45c1-ac6a-d17cef63ab38 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:51.073227 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-36e2ec94-e041-45c1-ac6a-d17cef63ab38 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:51.429167 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-20c2cdb1-826f-4ec3-873e-b50a0aa8353d tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:51.430176 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-20c2cdb1-826f-4ec3-873e-b50a0aa8353d tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:51.444887 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-20c2cdb1-826f-4ec3-873e-b50a0aa8353d tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:51.445937 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-20c2cdb1-826f-4ec3-873e-b50a0aa8353d tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:51.447870 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-20c2cdb1-826f-4ec3-873e-b50a0aa8353d tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:51.455932 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-20c2cdb1-826f-4ec3-873e-b50a0aa8353d tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:51.457339 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-20c2cdb1-826f-4ec3-873e-b50a0aa8353d tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:51.458034 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-20c2cdb1-826f-4ec3-873e-b50a0aa8353d tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:51.870801 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-36e2ec94-e041-45c1-ac6a-d17cef63ab38 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:51.884313 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-36e2ec94-e041-45c1-ac6a-d17cef63ab38 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c" status: 200 len: 1733 microversion: 2.1 time: 0.833920 Oct 04 18:44:51.909330 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2051/4049] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:51 2022] GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c => generated 1733 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:51.937969 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-20c2cdb1-826f-4ec3-873e-b50a0aa8353d tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:51.946367 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-51268179-4cb1-4d06-9630-6a03772d7ae0 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:51.955936 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-51268179-4cb1-4d06-9630-6a03772d7ae0 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] [instance: 6cc94ec4-3e28-41e0-808e-9cd2263bca7d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:51.956137 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-20c2cdb1-826f-4ec3-873e-b50a0aa8353d tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51" status: 200 len: 1509 microversion: 2.1 time: 0.529190 Oct 04 18:44:51.956137 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 1999/4050] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:51 2022] GET /compute/v2.1/servers/c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51 => generated 1509 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:51.963337 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-51268179-4cb1-4d06-9630-6a03772d7ae0 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:51.967566 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-51268179-4cb1-4d06-9630-6a03772d7ae0 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:51.971906 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-51268179-4cb1-4d06-9630-6a03772d7ae0 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:51.973835 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-51268179-4cb1-4d06-9630-6a03772d7ae0 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:51.976468 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-51268179-4cb1-4d06-9630-6a03772d7ae0 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:51.977196 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-51268179-4cb1-4d06-9630-6a03772d7ae0 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:52.062778 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-51268179-4cb1-4d06-9630-6a03772d7ae0 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] 10.222.0.20 "GET /compute/v2.1/servers/6cc94ec4-3e28-41e0-808e-9cd2263bca7d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.120622 Oct 04 18:44:52.067743 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2052/4051] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 18:44:51 2022] GET /compute/v2.1/servers/6cc94ec4-3e28-41e0-808e-9cd2263bca7d/os-volume_attachments => generated 197 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:44:52.923401 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-024ee0ca-9fbe-4495-a88e-baf05ffb7dcf tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:52.925979 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-024ee0ca-9fbe-4495-a88e-baf05ffb7dcf tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: 4d6dfac0-958d-4698-a050-6539caebe52c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:52.933571 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-024ee0ca-9fbe-4495-a88e-baf05ffb7dcf tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:52.934157 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-024ee0ca-9fbe-4495-a88e-baf05ffb7dcf tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:52.938285 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-024ee0ca-9fbe-4495-a88e-baf05ffb7dcf tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:52.938285 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-024ee0ca-9fbe-4495-a88e-baf05ffb7dcf tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:52.938285 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-024ee0ca-9fbe-4495-a88e-baf05ffb7dcf tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:52.942433 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-024ee0ca-9fbe-4495-a88e-baf05ffb7dcf tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:53.235587 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b12a880f-535e-4be8-87c7-5682f25d2f05 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:53.236283 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b12a880f-535e-4be8-87c7-5682f25d2f05 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] [instance: 3d3cabc2-fa23-4098-9197-9aaa19a0c663] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:53.251421 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b12a880f-535e-4be8-87c7-5682f25d2f05 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:53.253790 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b12a880f-535e-4be8-87c7-5682f25d2f05 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:53.255971 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b12a880f-535e-4be8-87c7-5682f25d2f05 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:53.256983 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b12a880f-535e-4be8-87c7-5682f25d2f05 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:53.259006 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b12a880f-535e-4be8-87c7-5682f25d2f05 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:53.262758 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b12a880f-535e-4be8-87c7-5682f25d2f05 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:53.306110 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b12a880f-535e-4be8-87c7-5682f25d2f05 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] [instance: 3d3cabc2-fa23-4098-9197-9aaa19a0c663] Going to try to terminate instance {{(pid=123002) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:44:53.455265 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-024ee0ca-9fbe-4495-a88e-baf05ffb7dcf tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:53.472447 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-024ee0ca-9fbe-4495-a88e-baf05ffb7dcf tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c" status: 200 len: 1733 microversion: 2.1 time: 0.558647 Oct 04 18:44:53.481596 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2053/4052] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:52 2022] GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c => generated 1733 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:53.489825 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0f7d173e-e046-41f6-ae42-7fc3169fe823 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:53.490786 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0f7d173e-e046-41f6-ae42-7fc3169fe823 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:53.507321 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0f7d173e-e046-41f6-ae42-7fc3169fe823 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:53.508761 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0f7d173e-e046-41f6-ae42-7fc3169fe823 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:53.509669 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0f7d173e-e046-41f6-ae42-7fc3169fe823 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:53.511518 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0f7d173e-e046-41f6-ae42-7fc3169fe823 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:53.512235 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0f7d173e-e046-41f6-ae42-7fc3169fe823 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:53.513096 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0f7d173e-e046-41f6-ae42-7fc3169fe823 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:53.710300 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b12a880f-535e-4be8-87c7-5682f25d2f05 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663" status: 204 len: 0 microversion: 2.42 time: 0.966442 Oct 04 18:44:53.711649 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2000/4053] 10.222.0.20 () {60 vars in 1280 bytes} [Tue Oct 4 18:44:52 2022] DELETE /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663 => generated 0 bytes in 969 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:44:53.719188 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1b6b73a4-ad44-4e23-9b07-8d5a2f32e2e7 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:53.722894 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1b6b73a4-ad44-4e23-9b07-8d5a2f32e2e7 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] [instance: 6cc94ec4-3e28-41e0-808e-9cd2263bca7d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:53.737067 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1b6b73a4-ad44-4e23-9b07-8d5a2f32e2e7 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:53.739522 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1b6b73a4-ad44-4e23-9b07-8d5a2f32e2e7 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:53.740556 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1b6b73a4-ad44-4e23-9b07-8d5a2f32e2e7 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:53.742290 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1b6b73a4-ad44-4e23-9b07-8d5a2f32e2e7 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:53.746407 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1b6b73a4-ad44-4e23-9b07-8d5a2f32e2e7 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:53.748607 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1b6b73a4-ad44-4e23-9b07-8d5a2f32e2e7 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:53.815313 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1b6b73a4-ad44-4e23-9b07-8d5a2f32e2e7 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] 10.222.0.20 "GET /compute/v2.1/servers/6cc94ec4-3e28-41e0-808e-9cd2263bca7d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099684 Oct 04 18:44:53.817213 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2001/4054] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 18:44:53 2022] GET /compute/v2.1/servers/6cc94ec4-3e28-41e0-808e-9cd2263bca7d/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:44:53.832628 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0f7d173e-e046-41f6-ae42-7fc3169fe823 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:53.848954 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-bc2fdfe5-5f99-41fd-ab96-293e62b12969 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:53.860044 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0f7d173e-e046-41f6-ae42-7fc3169fe823 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51" status: 200 len: 1509 microversion: 2.1 time: 0.362585 Oct 04 18:44:53.889983 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-bc2fdfe5-5f99-41fd-ab96-293e62b12969 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] [instance: 3d3cabc2-fa23-4098-9197-9aaa19a0c663] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:53.890834 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2054/4055] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:53 2022] GET /compute/v2.1/servers/c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51 => generated 1509 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:53.901329 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bc2fdfe5-5f99-41fd-ab96-293e62b12969 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:53.902042 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bc2fdfe5-5f99-41fd-ab96-293e62b12969 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:53.902665 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bc2fdfe5-5f99-41fd-ab96-293e62b12969 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:53.903636 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bc2fdfe5-5f99-41fd-ab96-293e62b12969 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:53.905126 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bc2fdfe5-5f99-41fd-ab96-293e62b12969 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:53.905789 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bc2fdfe5-5f99-41fd-ab96-293e62b12969 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:54.241625 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-bc2fdfe5-5f99-41fd-ab96-293e62b12969 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:54.254242 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-bc2fdfe5-5f99-41fd-ab96-293e62b12969 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:54.256515 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-bc2fdfe5-5f99-41fd-ab96-293e62b12969 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:54.258045 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-bc2fdfe5-5f99-41fd-ab96-293e62b12969 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] 10.222.0.20 "GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663" status: 200 len: 2948 microversion: 2.42 time: 0.439577 Oct 04 18:44:54.258817 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2002/4056] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:44:53 2022] GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663 => generated 2948 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:44:54.508743 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-642b390c-02c9-4522-aaeb-8e75ebf2ca66 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:54.509376 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-642b390c-02c9-4522-aaeb-8e75ebf2ca66 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: 4d6dfac0-958d-4698-a050-6539caebe52c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:54.526655 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-642b390c-02c9-4522-aaeb-8e75ebf2ca66 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:54.527460 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-642b390c-02c9-4522-aaeb-8e75ebf2ca66 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:54.530576 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-642b390c-02c9-4522-aaeb-8e75ebf2ca66 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:54.533936 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-642b390c-02c9-4522-aaeb-8e75ebf2ca66 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:54.533936 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-642b390c-02c9-4522-aaeb-8e75ebf2ca66 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:54.534452 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-642b390c-02c9-4522-aaeb-8e75ebf2ca66 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:54.778766 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-642b390c-02c9-4522-aaeb-8e75ebf2ca66 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:54.791984 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-642b390c-02c9-4522-aaeb-8e75ebf2ca66 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c" status: 200 len: 1733 microversion: 2.1 time: 0.283875 Oct 04 18:44:54.793090 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2055/4057] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:54 2022] GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c => generated 1733 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:54.829701 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e8b7815f-9f8a-491a-a1bc-4f26438bdc2b tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:54.832168 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e8b7815f-9f8a-491a-a1bc-4f26438bdc2b tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] [instance: 6cc94ec4-3e28-41e0-808e-9cd2263bca7d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:54.841452 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e8b7815f-9f8a-491a-a1bc-4f26438bdc2b tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:54.844729 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e8b7815f-9f8a-491a-a1bc-4f26438bdc2b tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:54.847423 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e8b7815f-9f8a-491a-a1bc-4f26438bdc2b tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:54.849505 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e8b7815f-9f8a-491a-a1bc-4f26438bdc2b tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:54.850254 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e8b7815f-9f8a-491a-a1bc-4f26438bdc2b tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:54.851828 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e8b7815f-9f8a-491a-a1bc-4f26438bdc2b tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:54.893483 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-268e8396-d2b2-4e41-b808-aaacd4440dfd tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:54.894544 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-268e8396-d2b2-4e41-b808-aaacd4440dfd tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:54.895529 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e8b7815f-9f8a-491a-a1bc-4f26438bdc2b tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] 10.222.0.20 "GET /compute/v2.1/servers/6cc94ec4-3e28-41e0-808e-9cd2263bca7d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070728 Oct 04 18:44:54.901294 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2003/4058] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 18:44:54 2022] GET /compute/v2.1/servers/6cc94ec4-3e28-41e0-808e-9cd2263bca7d/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:44:54.902845 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-268e8396-d2b2-4e41-b808-aaacd4440dfd tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:54.903794 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-268e8396-d2b2-4e41-b808-aaacd4440dfd tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:54.904681 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-268e8396-d2b2-4e41-b808-aaacd4440dfd tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:54.905614 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-268e8396-d2b2-4e41-b808-aaacd4440dfd tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:54.906130 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-268e8396-d2b2-4e41-b808-aaacd4440dfd tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:54.911506 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-268e8396-d2b2-4e41-b808-aaacd4440dfd tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:55.172112 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-268e8396-d2b2-4e41-b808-aaacd4440dfd tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:55.183147 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-268e8396-d2b2-4e41-b808-aaacd4440dfd tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51" status: 200 len: 1509 microversion: 2.1 time: 0.296041 Oct 04 18:44:55.184328 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2056/4059] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:54 2022] GET /compute/v2.1/servers/c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51 => generated 1509 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:55.300154 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-97a4963b-5f55-40d4-b736-dfeb4dc5fac1 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:55.301832 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-97a4963b-5f55-40d4-b736-dfeb4dc5fac1 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] [instance: 3d3cabc2-fa23-4098-9197-9aaa19a0c663] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:55.322640 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-97a4963b-5f55-40d4-b736-dfeb4dc5fac1 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:55.323473 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-97a4963b-5f55-40d4-b736-dfeb4dc5fac1 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:55.323629 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-97a4963b-5f55-40d4-b736-dfeb4dc5fac1 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:55.333961 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-97a4963b-5f55-40d4-b736-dfeb4dc5fac1 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:55.333961 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-97a4963b-5f55-40d4-b736-dfeb4dc5fac1 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:55.333961 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-97a4963b-5f55-40d4-b736-dfeb4dc5fac1 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:55.796553 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-97a4963b-5f55-40d4-b736-dfeb4dc5fac1 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:55.812660 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-97a4963b-5f55-40d4-b736-dfeb4dc5fac1 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:55.818743 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-23b47c3c-3af3-456a-a083-a699b8c0944b tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:55.822233 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-97a4963b-5f55-40d4-b736-dfeb4dc5fac1 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:55.822464 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-23b47c3c-3af3-456a-a083-a699b8c0944b tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: 4d6dfac0-958d-4698-a050-6539caebe52c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:55.822591 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-97a4963b-5f55-40d4-b736-dfeb4dc5fac1 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] 10.222.0.20 "GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663" status: 200 len: 2948 microversion: 2.42 time: 0.530819 Oct 04 18:44:55.830604 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-23b47c3c-3af3-456a-a083-a699b8c0944b tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:55.833966 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-23b47c3c-3af3-456a-a083-a699b8c0944b tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:55.835868 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-23b47c3c-3af3-456a-a083-a699b8c0944b tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:55.837479 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-23b47c3c-3af3-456a-a083-a699b8c0944b tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:55.839085 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-23b47c3c-3af3-456a-a083-a699b8c0944b tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:55.842854 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-23b47c3c-3af3-456a-a083-a699b8c0944b tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:55.846593 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2004/4060] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:44:55 2022] GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663 => generated 2948 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:44:55.910375 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2f6cc4c5-645f-4fa4-b707-095f2cd792eb tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:55.912809 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2f6cc4c5-645f-4fa4-b707-095f2cd792eb tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] [instance: 6cc94ec4-3e28-41e0-808e-9cd2263bca7d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:55.928707 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2f6cc4c5-645f-4fa4-b707-095f2cd792eb tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:55.931485 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2f6cc4c5-645f-4fa4-b707-095f2cd792eb tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:55.933548 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2f6cc4c5-645f-4fa4-b707-095f2cd792eb tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:55.940663 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2f6cc4c5-645f-4fa4-b707-095f2cd792eb tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:55.941038 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2f6cc4c5-645f-4fa4-b707-095f2cd792eb tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:55.941752 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2f6cc4c5-645f-4fa4-b707-095f2cd792eb tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:56.049338 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2f6cc4c5-645f-4fa4-b707-095f2cd792eb tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] 10.222.0.20 "GET /compute/v2.1/servers/6cc94ec4-3e28-41e0-808e-9cd2263bca7d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.144161 Oct 04 18:44:56.050229 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2005/4061] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 18:44:55 2022] GET /compute/v2.1/servers/6cc94ec4-3e28-41e0-808e-9cd2263bca7d/os-volume_attachments => generated 197 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:44:56.212427 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-000a81a1-c387-4307-bfaf-5ab326046b93 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:56.213054 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-000a81a1-c387-4307-bfaf-5ab326046b93 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:56.222390 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-000a81a1-c387-4307-bfaf-5ab326046b93 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:56.222891 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-000a81a1-c387-4307-bfaf-5ab326046b93 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:56.223333 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-000a81a1-c387-4307-bfaf-5ab326046b93 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:56.224046 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-000a81a1-c387-4307-bfaf-5ab326046b93 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:56.224524 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-000a81a1-c387-4307-bfaf-5ab326046b93 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:56.224952 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-000a81a1-c387-4307-bfaf-5ab326046b93 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:56.408874 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-23b47c3c-3af3-456a-a083-a699b8c0944b tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:56.459775 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-23b47c3c-3af3-456a-a083-a699b8c0944b tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c" status: 200 len: 1733 microversion: 2.1 time: 0.641393 Oct 04 18:44:56.460480 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2057/4062] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:55 2022] GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c => generated 1733 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:56.590600 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-000a81a1-c387-4307-bfaf-5ab326046b93 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:56.607969 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-000a81a1-c387-4307-bfaf-5ab326046b93 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51" status: 200 len: 1509 microversion: 2.1 time: 0.399073 Oct 04 18:44:56.613026 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2006/4063] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:56 2022] GET /compute/v2.1/servers/c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51 => generated 1509 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:44:56.855596 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c1c513b6-e3a8-47f5-9bbb-a3bb716a6d7d tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:56.857665 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c1c513b6-e3a8-47f5-9bbb-a3bb716a6d7d tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] [instance: 3d3cabc2-fa23-4098-9197-9aaa19a0c663] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:56.886199 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c1c513b6-e3a8-47f5-9bbb-a3bb716a6d7d tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:56.886885 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c1c513b6-e3a8-47f5-9bbb-a3bb716a6d7d tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:56.891222 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c1c513b6-e3a8-47f5-9bbb-a3bb716a6d7d tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:56.892643 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c1c513b6-e3a8-47f5-9bbb-a3bb716a6d7d tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:56.893228 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c1c513b6-e3a8-47f5-9bbb-a3bb716a6d7d tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:56.894037 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c1c513b6-e3a8-47f5-9bbb-a3bb716a6d7d tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:57.064423 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b3d53303-52f4-4dae-a623-5c5fe10d2c41 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:57.067428 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b3d53303-52f4-4dae-a623-5c5fe10d2c41 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] [instance: 6cc94ec4-3e28-41e0-808e-9cd2263bca7d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:57.086758 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b3d53303-52f4-4dae-a623-5c5fe10d2c41 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:57.087737 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b3d53303-52f4-4dae-a623-5c5fe10d2c41 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:57.088835 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b3d53303-52f4-4dae-a623-5c5fe10d2c41 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:57.089922 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b3d53303-52f4-4dae-a623-5c5fe10d2c41 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:57.090625 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b3d53303-52f4-4dae-a623-5c5fe10d2c41 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:57.091286 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b3d53303-52f4-4dae-a623-5c5fe10d2c41 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:57.162806 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b3d53303-52f4-4dae-a623-5c5fe10d2c41 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] 10.222.0.20 "GET /compute/v2.1/servers/6cc94ec4-3e28-41e0-808e-9cd2263bca7d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103774 Oct 04 18:44:57.163830 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2007/4064] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 18:44:57 2022] GET /compute/v2.1/servers/6cc94ec4-3e28-41e0-808e-9cd2263bca7d/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:44:57.322628 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c1c513b6-e3a8-47f5-9bbb-a3bb716a6d7d tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:57.337221 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c1c513b6-e3a8-47f5-9bbb-a3bb716a6d7d tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:57.338662 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c1c513b6-e3a8-47f5-9bbb-a3bb716a6d7d tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:57.340022 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c1c513b6-e3a8-47f5-9bbb-a3bb716a6d7d tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] 10.222.0.20 "GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663" status: 200 len: 2948 microversion: 2.42 time: 0.489182 Oct 04 18:44:57.348832 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2058/4065] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:44:56 2022] GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663 => generated 2948 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:44:57.485101 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-df61d3a4-7707-4cef-a335-9f232a0dd021 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:57.486101 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-df61d3a4-7707-4cef-a335-9f232a0dd021 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: 4d6dfac0-958d-4698-a050-6539caebe52c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:57.503692 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-df61d3a4-7707-4cef-a335-9f232a0dd021 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:57.504271 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-df61d3a4-7707-4cef-a335-9f232a0dd021 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:57.504731 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-df61d3a4-7707-4cef-a335-9f232a0dd021 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:57.505517 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-df61d3a4-7707-4cef-a335-9f232a0dd021 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:57.505982 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-df61d3a4-7707-4cef-a335-9f232a0dd021 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:57.506409 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-df61d3a4-7707-4cef-a335-9f232a0dd021 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:57.643449 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2d9404e1-586a-4e9e-926b-b951aaeeaf1d tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:57.644082 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2d9404e1-586a-4e9e-926b-b951aaeeaf1d tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:57.655861 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2d9404e1-586a-4e9e-926b-b951aaeeaf1d tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:57.656391 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2d9404e1-586a-4e9e-926b-b951aaeeaf1d tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:57.656847 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2d9404e1-586a-4e9e-926b-b951aaeeaf1d tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:57.657532 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2d9404e1-586a-4e9e-926b-b951aaeeaf1d tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:57.658208 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2d9404e1-586a-4e9e-926b-b951aaeeaf1d tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:57.658803 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2d9404e1-586a-4e9e-926b-b951aaeeaf1d tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:58.088347 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-df61d3a4-7707-4cef-a335-9f232a0dd021 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:58.100016 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-df61d3a4-7707-4cef-a335-9f232a0dd021 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c" status: 200 len: 1733 microversion: 2.1 time: 0.620434 Oct 04 18:44:58.112841 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2008/4066] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:57 2022] GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c => generated 1733 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:58.139380 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-2d9404e1-586a-4e9e-926b-b951aaeeaf1d tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:58.150483 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2d9404e1-586a-4e9e-926b-b951aaeeaf1d tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51" status: 200 len: 1509 microversion: 2.1 time: 0.510871 Oct 04 18:44:58.151080 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2059/4067] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:57 2022] GET /compute/v2.1/servers/c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51 => generated 1509 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:44:58.176475 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-46b80da8-1d61-46d6-969b-dd88f5a60ae9 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:58.180645 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-46b80da8-1d61-46d6-969b-dd88f5a60ae9 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] [instance: 6cc94ec4-3e28-41e0-808e-9cd2263bca7d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:58.195751 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-46b80da8-1d61-46d6-969b-dd88f5a60ae9 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:58.199003 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-46b80da8-1d61-46d6-969b-dd88f5a60ae9 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:58.199469 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-46b80da8-1d61-46d6-969b-dd88f5a60ae9 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:58.200262 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-46b80da8-1d61-46d6-969b-dd88f5a60ae9 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:58.202150 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-46b80da8-1d61-46d6-969b-dd88f5a60ae9 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:58.204745 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-46b80da8-1d61-46d6-969b-dd88f5a60ae9 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:58.285129 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-46b80da8-1d61-46d6-969b-dd88f5a60ae9 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] 10.222.0.20 "GET /compute/v2.1/servers/6cc94ec4-3e28-41e0-808e-9cd2263bca7d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.113195 Oct 04 18:44:58.291976 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2009/4068] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 18:44:58 2022] GET /compute/v2.1/servers/6cc94ec4-3e28-41e0-808e-9cd2263bca7d/os-volume_attachments => generated 25 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:44:58.382010 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1fb4e0a3-4613-48ed-831d-1fb66df2da81 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:58.382926 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1fb4e0a3-4613-48ed-831d-1fb66df2da81 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] [instance: 3d3cabc2-fa23-4098-9197-9aaa19a0c663] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:58.419642 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1fb4e0a3-4613-48ed-831d-1fb66df2da81 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:58.425227 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1fb4e0a3-4613-48ed-831d-1fb66df2da81 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:58.428387 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1fb4e0a3-4613-48ed-831d-1fb66df2da81 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:58.429450 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1fb4e0a3-4613-48ed-831d-1fb66df2da81 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:58.431580 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1fb4e0a3-4613-48ed-831d-1fb66df2da81 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:58.435705 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1fb4e0a3-4613-48ed-831d-1fb66df2da81 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:58.654532 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-91a50d53-8459-4282-8aca-056ffe529bc1 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-25018900", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": [{"uuid": "33e34336-0572-4bd5-9655-75f9cdb067ea"}]}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:58.766319 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-91a50d53-8459-4282-8aca-056ffe529bc1 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] validate_networks() for [('33e34336-0572-4bd5-9655-75f9cdb067ea', None, None, None, None, None)] {{(pid=123002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:44:59.432263 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1fb4e0a3-4613-48ed-831d-1fb66df2da81 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:59.449149 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1fb4e0a3-4613-48ed-831d-1fb66df2da81 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:59.454937 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1fb4e0a3-4613-48ed-831d-1fb66df2da81 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:59.456440 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1fb4e0a3-4613-48ed-831d-1fb66df2da81 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] 10.222.0.20 "GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663" status: 200 len: 2927 microversion: 2.42 time: 1.079815 Oct 04 18:44:59.457337 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2060/4069] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:44:58 2022] GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663 => generated 2927 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:44:59.462594 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e22450b5-ea0e-44a8-ae69-f52a0d614cb3 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:59.463201 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e22450b5-ea0e-44a8-ae69-f52a0d614cb3 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: 4d6dfac0-958d-4698-a050-6539caebe52c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:59.470437 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e22450b5-ea0e-44a8-ae69-f52a0d614cb3 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:59.470920 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e22450b5-ea0e-44a8-ae69-f52a0d614cb3 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:59.471350 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e22450b5-ea0e-44a8-ae69-f52a0d614cb3 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:59.472044 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e22450b5-ea0e-44a8-ae69-f52a0d614cb3 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:59.472518 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e22450b5-ea0e-44a8-ae69-f52a0d614cb3 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:59.472950 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e22450b5-ea0e-44a8-ae69-f52a0d614cb3 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:59.694894 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e22450b5-ea0e-44a8-ae69-f52a0d614cb3 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:59.708506 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e22450b5-ea0e-44a8-ae69-f52a0d614cb3 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c" status: 200 len: 1733 microversion: 2.1 time: 0.249852 Oct 04 18:44:59.721055 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2061/4070] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:59 2022] GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c => generated 1733 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:59.740198 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-abadc634-0b3e-4872-8626-4e8ba1635d5e tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:59.741798 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-abadc634-0b3e-4872-8626-4e8ba1635d5e tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:59.763118 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-abadc634-0b3e-4872-8626-4e8ba1635d5e tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:59.766908 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-abadc634-0b3e-4872-8626-4e8ba1635d5e tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:59.767842 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-abadc634-0b3e-4872-8626-4e8ba1635d5e tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:59.770952 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-abadc634-0b3e-4872-8626-4e8ba1635d5e tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:59.772174 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-abadc634-0b3e-4872-8626-4e8ba1635d5e tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:59.775007 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-abadc634-0b3e-4872-8626-4e8ba1635d5e tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:00.272358 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-abadc634-0b3e-4872-8626-4e8ba1635d5e tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:00.282419 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-abadc634-0b3e-4872-8626-4e8ba1635d5e tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51" status: 200 len: 1509 microversion: 2.1 time: 0.558960 Oct 04 18:45:00.288455 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2062/4071] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:59 2022] GET /compute/v2.1/servers/c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51 => generated 1509 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:00.381396 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-91a50d53-8459-4282-8aca-056ffe529bc1 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:45:00.381906 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-91a50d53-8459-4282-8aca-056ffe529bc1 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:45:00.382305 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-91a50d53-8459-4282-8aca-056ffe529bc1 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:45:00.382726 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-91a50d53-8459-4282-8aca-056ffe529bc1 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:45:00.383316 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-91a50d53-8459-4282-8aca-056ffe529bc1 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:45:00.407360 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-91a50d53-8459-4282-8aca-056ffe529bc1 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:00.407861 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-91a50d53-8459-4282-8aca-056ffe529bc1 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:00.408345 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-91a50d53-8459-4282-8aca-056ffe529bc1 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:00.409086 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-91a50d53-8459-4282-8aca-056ffe529bc1 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:00.409542 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-91a50d53-8459-4282-8aca-056ffe529bc1 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:00.423318 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-91a50d53-8459-4282-8aca-056ffe529bc1 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:00.488340 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-91a50d53-8459-4282-8aca-056ffe529bc1 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Getting quotas for project 7c0b095138354810949093e7ea03b8bf. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:45:00.499817 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-91a50d53-8459-4282-8aca-056ffe529bc1 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Getting quotas for user 0a02cd1108b947b186202f6d15e6cf0e and project 7c0b095138354810949093e7ea03b8bf. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:45:00.520623 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-91a50d53-8459-4282-8aca-056ffe529bc1 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Going to run 1 instances... {{(pid=123002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:45:00.526373 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-91a50d53-8459-4282-8aca-056ffe529bc1 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] [instance: d46bd79f-eda9-4149-b4aa-788520147af7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:45:00.562705 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e5cc36e9-faee-4bf3-b1ed-df9a17c43632 tempest-SecurityGroupRulesNegativeTestJSON-748897975 tempest-SecurityGroupRulesNegativeTestJSON-748897975-project] Action: 'create', calling method: .version_select at 0x7fe253da0940>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-10943236", "description": "tempest-description-143815765"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:45:00.768294 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-91a50d53-8459-4282-8aca-056ffe529bc1 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.119265 Oct 04 18:45:00.769361 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2010/4072] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:44:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 2121 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 18:45:00.774524 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-6faa349a-d8f7-45bd-976d-a56941c09555 req-a5e519c3-9619-49a1-9cf7-c5659603f5ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d3cabc2-fa23-4098-9197-9aaa19a0c663", "name": "network-vif-unplugged", "status": "completed", "tag": "9a5dee2f-2802-439b-91ce-95cc489ce2fb"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:45:00.786098 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-6faa349a-d8f7-45bd-976d-a56941c09555 req-a5e519c3-9619-49a1-9cf7-c5659603f5ba service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:00.786733 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-6faa349a-d8f7-45bd-976d-a56941c09555 req-a5e519c3-9619-49a1-9cf7-c5659603f5ba service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:00.788126 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-6faa349a-d8f7-45bd-976d-a56941c09555 req-a5e519c3-9619-49a1-9cf7-c5659603f5ba service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:00.808168 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-6faa349a-d8f7-45bd-976d-a56941c09555 req-a5e519c3-9619-49a1-9cf7-c5659603f5ba service nova] Creating event network-vif-unplugged:9a5dee2f-2802-439b-91ce-95cc489ce2fb for instance 3d3cabc2-fa23-4098-9197-9aaa19a0c663 on n-h1-850501-14 Oct 04 18:45:00.816007 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-6faa349a-d8f7-45bd-976d-a56941c09555 req-a5e519c3-9619-49a1-9cf7-c5659603f5ba service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045239 Oct 04 18:45:00.818106 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2011/4073] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:45:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:45:00.828453 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-610d0b4f-5578-44fb-ba63-fd6ea0bf06b1 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:00.829354 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-610d0b4f-5578-44fb-ba63-fd6ea0bf06b1 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] [instance: 3d3cabc2-fa23-4098-9197-9aaa19a0c663] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:00.858705 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-610d0b4f-5578-44fb-ba63-fd6ea0bf06b1 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:00.859807 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-610d0b4f-5578-44fb-ba63-fd6ea0bf06b1 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:00.860918 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-610d0b4f-5578-44fb-ba63-fd6ea0bf06b1 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:00.861485 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-610d0b4f-5578-44fb-ba63-fd6ea0bf06b1 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:00.861974 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-610d0b4f-5578-44fb-ba63-fd6ea0bf06b1 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:00.862881 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-610d0b4f-5578-44fb-ba63-fd6ea0bf06b1 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:01.251138 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-610d0b4f-5578-44fb-ba63-fd6ea0bf06b1 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:01.265834 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-610d0b4f-5578-44fb-ba63-fd6ea0bf06b1 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:01.272043 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-610d0b4f-5578-44fb-ba63-fd6ea0bf06b1 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:01.273542 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-610d0b4f-5578-44fb-ba63-fd6ea0bf06b1 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] 10.222.0.20 "GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663" status: 200 len: 2861 microversion: 2.42 time: 0.454089 Oct 04 18:45:01.282073 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2012/4074] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:45:00 2022] GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663 => generated 2861 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:45:01.296494 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e5cc36e9-faee-4bf3-b1ed-df9a17c43632 tempest-SecurityGroupRulesNegativeTestJSON-748897975 tempest-SecurityGroupRulesNegativeTestJSON-748897975-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 253 microversion: 2.1 time: 1.000686 Oct 04 18:45:01.297742 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2063/4075] 10.222.0.20 () {60 vars in 1180 bytes} [Tue Oct 4 18:45:00 2022] POST /compute/v2.1/os-security-groups => generated 253 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:45:01.321560 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-270bfb08-e272-44d8-bc47-751e3d5c10d1 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:01.323534 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-270bfb08-e272-44d8-bc47-751e3d5c10d1 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] [instance: d46bd79f-eda9-4149-b4aa-788520147af7] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:01.332924 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e7f4a27e-6a4c-4033-ae50-d7ccb97bcad5 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:01.333623 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e7f4a27e-6a4c-4033-ae50-d7ccb97bcad5 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: 4d6dfac0-958d-4698-a050-6539caebe52c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:01.352948 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e7f4a27e-6a4c-4033-ae50-d7ccb97bcad5 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:01.353544 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e7f4a27e-6a4c-4033-ae50-d7ccb97bcad5 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:01.360987 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e7f4a27e-6a4c-4033-ae50-d7ccb97bcad5 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:01.362555 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e7f4a27e-6a4c-4033-ae50-d7ccb97bcad5 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:01.363049 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e7f4a27e-6a4c-4033-ae50-d7ccb97bcad5 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:01.363492 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e7f4a27e-6a4c-4033-ae50-d7ccb97bcad5 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:01.422690 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-270bfb08-e272-44d8-bc47-751e3d5c10d1 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a02cd1108b947b186202f6d15e6cf0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c0b095138354810949093e7ea03b8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:01.442987 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-270bfb08-e272-44d8-bc47-751e3d5c10d1 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] 10.222.0.20 "GET /compute/v2.1/servers/d46bd79f-eda9-4149-b4aa-788520147af7" status: 200 len: 1216 microversion: 2.1 time: 0.140470 Oct 04 18:45:01.446828 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2064/4076] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:01 2022] GET /compute/v2.1/servers/d46bd79f-eda9-4149-b4aa-788520147af7 => generated 1216 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:01.453848 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-d3125502-6d62-4741-83c8-70cda6544c82 req-35158551-b5b7-4e29-becb-745091c552f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d3cabc2-fa23-4098-9197-9aaa19a0c663", "name": "network-vif-deleted", "tag": "aa9d4b51-8919-472c-8e30-368ff36799ac"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:45:01.475829 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-d3125502-6d62-4741-83c8-70cda6544c82 req-35158551-b5b7-4e29-becb-745091c552f5 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:01.475829 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-d3125502-6d62-4741-83c8-70cda6544c82 req-35158551-b5b7-4e29-becb-745091c552f5 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:01.476249 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-d3125502-6d62-4741-83c8-70cda6544c82 req-35158551-b5b7-4e29-becb-745091c552f5 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:01.517072 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-d3125502-6d62-4741-83c8-70cda6544c82 req-35158551-b5b7-4e29-becb-745091c552f5 service nova] Creating event network-vif-deleted:aa9d4b51-8919-472c-8e30-368ff36799ac for instance 3d3cabc2-fa23-4098-9197-9aaa19a0c663 on n-h1-850501-14 Oct 04 18:45:01.531256 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-d3125502-6d62-4741-83c8-70cda6544c82 req-35158551-b5b7-4e29-becb-745091c552f5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081122 Oct 04 18:45:01.533444 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2065/4077] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:45:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:45:01.539637 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b7080081-98ed-4f7b-8e77-190f7e2f7834 tempest-SecurityGroupRulesNegativeTestJSON-748897975 tempest-SecurityGroupRulesNegativeTestJSON-748897975-project] Action: 'create', calling method: .version_select at 0x7fe253da0040>, body: {"security_group_rule": {"parent_group_id": "2889963d-43ad-4218-9392-52d7c11b6902", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:45:01.674484 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e7f4a27e-6a4c-4033-ae50-d7ccb97bcad5 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:01.683903 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e7f4a27e-6a4c-4033-ae50-d7ccb97bcad5 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c" status: 200 len: 1733 microversion: 2.1 time: 0.385853 Oct 04 18:45:01.706722 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2013/4078] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:01 2022] GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c => generated 1733 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:01.735989 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5781a30a-eb8d-4f74-b5b3-6c2d167eed67 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:01.744795 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5781a30a-eb8d-4f74-b5b3-6c2d167eed67 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:01.787779 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5781a30a-eb8d-4f74-b5b3-6c2d167eed67 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:01.792010 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5781a30a-eb8d-4f74-b5b3-6c2d167eed67 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:01.796348 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5781a30a-eb8d-4f74-b5b3-6c2d167eed67 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:01.811670 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5781a30a-eb8d-4f74-b5b3-6c2d167eed67 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:01.812267 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5781a30a-eb8d-4f74-b5b3-6c2d167eed67 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:01.815946 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5781a30a-eb8d-4f74-b5b3-6c2d167eed67 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:01.885754 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:02.270523 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5781a30a-eb8d-4f74-b5b3-6c2d167eed67 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:02.280797 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5781a30a-eb8d-4f74-b5b3-6c2d167eed67 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51" status: 200 len: 1509 microversion: 2.1 time: 0.561367 Oct 04 18:45:02.281400 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2014/4079] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:01 2022] GET /compute/v2.1/servers/c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51 => generated 1509 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:02.319960 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3c0fc985-e2a5-4ed6-915d-236508f6ef12 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:02.320626 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3c0fc985-e2a5-4ed6-915d-236508f6ef12 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] [instance: 3d3cabc2-fa23-4098-9197-9aaa19a0c663] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:02.331729 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3c0fc985-e2a5-4ed6-915d-236508f6ef12 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:02.337770 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3c0fc985-e2a5-4ed6-915d-236508f6ef12 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:02.338332 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3c0fc985-e2a5-4ed6-915d-236508f6ef12 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:02.339097 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3c0fc985-e2a5-4ed6-915d-236508f6ef12 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:02.339586 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3c0fc985-e2a5-4ed6-915d-236508f6ef12 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:02.340015 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3c0fc985-e2a5-4ed6-915d-236508f6ef12 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:02.665238 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3c0fc985-e2a5-4ed6-915d-236508f6ef12 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:02.680539 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3c0fc985-e2a5-4ed6-915d-236508f6ef12 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:02.682384 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3c0fc985-e2a5-4ed6-915d-236508f6ef12 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:02.685667 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3c0fc985-e2a5-4ed6-915d-236508f6ef12 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] 10.222.0.20 "GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663" status: 200 len: 2747 microversion: 2.42 time: 0.370028 Oct 04 18:45:02.689396 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2015/4080] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:45:02 2022] GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663 => generated 2747 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:45:02.704861 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2126074c-4584-47ce-bd23-a0131797a876 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:02.705754 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2126074c-4584-47ce-bd23-a0131797a876 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] [instance: d46bd79f-eda9-4149-b4aa-788520147af7] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:02.721587 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2126074c-4584-47ce-bd23-a0131797a876 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:02.722474 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2126074c-4584-47ce-bd23-a0131797a876 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:02.723141 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2126074c-4584-47ce-bd23-a0131797a876 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:02.727826 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2126074c-4584-47ce-bd23-a0131797a876 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:02.728666 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2126074c-4584-47ce-bd23-a0131797a876 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:02.729371 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2126074c-4584-47ce-bd23-a0131797a876 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:02.891896 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2126074c-4584-47ce-bd23-a0131797a876 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a02cd1108b947b186202f6d15e6cf0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c0b095138354810949093e7ea03b8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:02.911542 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2126074c-4584-47ce-bd23-a0131797a876 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] 10.222.0.20 "GET /compute/v2.1/servers/d46bd79f-eda9-4149-b4aa-788520147af7" status: 200 len: 1220 microversion: 2.1 time: 0.216352 Oct 04 18:45:02.911542 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2016/4081] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:02 2022] GET /compute/v2.1/servers/d46bd79f-eda9-4149-b4aa-788520147af7 => generated 1220 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:02.914445 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2de53a69-c329-43b0-a22f-cf02a347c170 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:02.915316 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2de53a69-c329-43b0-a22f-cf02a347c170 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: 4d6dfac0-958d-4698-a050-6539caebe52c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:02.924661 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2de53a69-c329-43b0-a22f-cf02a347c170 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:02.925584 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2de53a69-c329-43b0-a22f-cf02a347c170 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:02.926279 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2de53a69-c329-43b0-a22f-cf02a347c170 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:02.927331 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2de53a69-c329-43b0-a22f-cf02a347c170 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:02.927893 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2de53a69-c329-43b0-a22f-cf02a347c170 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:02.928484 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2de53a69-c329-43b0-a22f-cf02a347c170 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:03.028859 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b7080081-98ed-4f7b-8e77-190f7e2f7834 tempest-SecurityGroupRulesNegativeTestJSON-748897975 tempest-SecurityGroupRulesNegativeTestJSON-748897975-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.493559 Oct 04 18:45:03.036628 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2066/4082] 10.222.0.20 () {60 vars in 1195 bytes} [Tue Oct 4 18:45:01 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1502 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:45:03.041878 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-139a018f-784d-4210-8e8a-96b31dfde59a req-328251be-4e5c-4c94-8a32-4c2457323c27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d3cabc2-fa23-4098-9197-9aaa19a0c663", "name": "network-vif-unplugged", "status": "completed", "tag": "c909b4c7-8843-4155-a690-84520be7fb47"}, {"server_uuid": "3d3cabc2-fa23-4098-9197-9aaa19a0c663", "name": "network-vif-unplugged", "status": "completed", "tag": "d87225ab-6eb7-4ee8-a1ae-be2176c6788c"}, {"server_uuid": "3d3cabc2-fa23-4098-9197-9aaa19a0c663", "name": "network-vif-unplugged", "status": "completed", "tag": "3aad2644-bc27-4d77-9ae6-dd56c1d45027"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:45:03.070194 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-139a018f-784d-4210-8e8a-96b31dfde59a req-328251be-4e5c-4c94-8a32-4c2457323c27 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:03.070984 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-139a018f-784d-4210-8e8a-96b31dfde59a req-328251be-4e5c-4c94-8a32-4c2457323c27 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:03.076120 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-139a018f-784d-4210-8e8a-96b31dfde59a req-328251be-4e5c-4c94-8a32-4c2457323c27 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:03.085265 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=100 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:03.104815 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-139a018f-784d-4210-8e8a-96b31dfde59a req-328251be-4e5c-4c94-8a32-4c2457323c27 service nova] Creating event network-vif-unplugged:c909b4c7-8843-4155-a690-84520be7fb47 for instance 3d3cabc2-fa23-4098-9197-9aaa19a0c663 on n-h1-850501-14 Oct 04 18:45:03.105325 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-139a018f-784d-4210-8e8a-96b31dfde59a req-328251be-4e5c-4c94-8a32-4c2457323c27 service nova] Creating event network-vif-unplugged:d87225ab-6eb7-4ee8-a1ae-be2176c6788c for instance 3d3cabc2-fa23-4098-9197-9aaa19a0c663 on n-h1-850501-14 Oct 04 18:45:03.106038 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-139a018f-784d-4210-8e8a-96b31dfde59a req-328251be-4e5c-4c94-8a32-4c2457323c27 service nova] Creating event network-vif-unplugged:3aad2644-bc27-4d77-9ae6-dd56c1d45027 for instance 3d3cabc2-fa23-4098-9197-9aaa19a0c663 on n-h1-850501-14 Oct 04 18:45:03.145938 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-139a018f-784d-4210-8e8a-96b31dfde59a req-328251be-4e5c-4c94-8a32-4c2457323c27 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.105750 Oct 04 18:45:03.146779 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2067/4083] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:45:03 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:45:03.168230 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a42353cc-0c2c-4ca2-82f4-cc9ea608587d tempest-SecurityGroupRulesNegativeTestJSON-748897975 tempest-SecurityGroupRulesNegativeTestJSON-748897975-project] Action: 'create', calling method: .version_select at 0x7fe253cc8e50>, body: {"security_group_rule": {"parent_group_id": "2889963d-43ad-4218-9392-52d7c11b6902", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:45:03.175661 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2de53a69-c329-43b0-a22f-cf02a347c170 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:03.187911 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2de53a69-c329-43b0-a22f-cf02a347c170 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c" status: 200 len: 1733 microversion: 2.1 time: 0.278320 Oct 04 18:45:03.190605 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2017/4084] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:02 2022] GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c => generated 1733 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:03.275959 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-a42353cc-0c2c-4ca2-82f4-cc9ea608587d tempest-SecurityGroupRulesNegativeTestJSON-748897975 tempest-SecurityGroupRulesNegativeTestJSON-748897975-project] HTTP exception thrown: This rule already exists in group 2889963d-43ad-4218-9392-52d7c11b6902 Oct 04 18:45:03.277610 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a42353cc-0c2c-4ca2-82f4-cc9ea608587d tempest-SecurityGroupRulesNegativeTestJSON-748897975 tempest-SecurityGroupRulesNegativeTestJSON-748897975-project] Request method failure captured: Oct 04 18:45:03.277610 n-d-850501-14 devstack@n-api.service[123001]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 04 18:45:03.277610 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:45:03.277610 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:45:03.277610 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:45:03.277610 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 138 Oct 04 18:45:03.277610 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:45:03.277610 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:45:03.277610 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:45:03.277610 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:45:03.277610 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPH8rMMcZilhK-hQ2-CZ__JiJW0z-J6pBaF2Ts3X3ngDZdkfXOeJggfTHIAkxWgbtdBIrb9PXlpCkJp51_InNIsMjN_3DOnjJp3hQu-ZozT2ns_owLl7legXSNNTm2bVS3-_Tho0-3RHKt3X4wQbYM0cNhz2SoJMytuq_UZ0fi0xOSP8 Oct 04 18:45:03.277610 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:45:03.277610 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:45:03.277610 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:45:03.277610 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:45:03.277610 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:45:03.277610 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:45:03.277610 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 6364f18579384dd6a58c0adb85fca10c Oct 04 18:45:03.277610 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-748897975 Oct 04 18:45:03.277610 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:45:03.277610 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:45:03.277610 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6364f18579384dd6a58c0adb85fca10c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6364f18579384dd6a58c0adb85fca10c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6364f18579384dd6a58c0adb85fca10c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6364f18579384dd6a58c0adb85fca10c"}]}, {"type": "tempest-ServicesTestJSON-Type-1888557797", "name": "tempest-ServicesTestJSON-Service-1064384932", "endpoints": []}] Oct 04 18:45:03.277610 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-748897975 Oct 04 18:45:03.277610 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 6364f18579384dd6a58c0adb85fca10c Oct 04 18:45:03.277610 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-748897975 Oct 04 18:45:03.277610 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-748897975-project Oct 04 18:45:03.277610 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:45:03.277610 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:45:03.277610 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: af2b22bb26cc4eb4afe3a8e219e1a480 Oct 04 18:45:03.277610 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-748897975-project Oct 04 18:45:03.277610 n-d-850501-14 devstack@n-api.service[123001]: Oct 04 18:45:03.277610 n-d-850501-14 devstack@n-api.service[123001]: {"security_group_rule": {"parent_group_id": "2889963d-43ad-4218-9392-52d7c11b6902", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 04 18:45:03.277610 n-d-850501-14 devstack@n-api.service[123001]: method: Oct 04 18:45:03.277610 n-d-850501-14 devstack@n-api.service[123001]: exception: This rule already exists in group 2889963d-43ad-4218-9392-52d7c11b6902 Oct 04 18:45:03.277610 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'body': {'security_group_rule': {'parent_group_id': '2889963d-43ad-4218-9392-52d7c11b6902', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 04 18:45:03.277610 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:45:03.277610 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:03.277610 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Oct 04 18:45:03.277610 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Oct 04 18:45:03.277610 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Oct 04 18:45:03.277610 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 04 18:45:03.277610 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 2889963d-43ad-4218-9392-52d7c11b6902 Oct 04 18:45:03.277610 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:45:03.277610 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:03.277610 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:45:03.277610 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:03.277610 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:45:03.277610 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:45:03.277610 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:45:03.277610 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:45:03.277610 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:45:03.277610 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:45:03.277610 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:45:03.277610 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:45:03.277610 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Oct 04 18:45:03.277610 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 18:45:03.277610 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 2889963d-43ad-4218-9392-52d7c11b6902 Oct 04 18:45:03.277610 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:45:03.277610 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:03.277610 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:45:03.277610 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:03.277610 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:45:03.283645 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:45:03.283645 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:45:03.283645 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:45:03.283645 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 2889963d-43ad-4218-9392-52d7c11b6902 Oct 04 18:45:03.283645 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:45:03.288476 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a42353cc-0c2c-4ca2-82f4-cc9ea608587d tempest-SecurityGroupRulesNegativeTestJSON-748897975 tempest-SecurityGroupRulesNegativeTestJSON-748897975-project] Returning 400 to user: This rule already exists in group 2889963d-43ad-4218-9392-52d7c11b6902 {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:45:03.288476 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a42353cc-0c2c-4ca2-82f4-cc9ea608587d tempest-SecurityGroupRulesNegativeTestJSON-748897975 tempest-SecurityGroupRulesNegativeTestJSON-748897975-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.138489 Oct 04 18:45:03.288476 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2068/4085] 10.222.0.20 () {60 vars in 1195 bytes} [Tue Oct 4 18:45:03 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 140 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:45:03.298226 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6c08e170-186a-4f78-93b4-352d538f828c tempest-SecurityGroupRulesNegativeTestJSON-748897975 tempest-SecurityGroupRulesNegativeTestJSON-748897975-project] Calling method '.version_select at 0x7fe25836f700>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:03.310851 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7125df05-7477-4d2d-88b0-228b479abcb6 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:03.316846 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7125df05-7477-4d2d-88b0-228b479abcb6 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:03.332267 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7125df05-7477-4d2d-88b0-228b479abcb6 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:03.335536 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7125df05-7477-4d2d-88b0-228b479abcb6 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:03.337683 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7125df05-7477-4d2d-88b0-228b479abcb6 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:03.338674 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7125df05-7477-4d2d-88b0-228b479abcb6 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:03.339143 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7125df05-7477-4d2d-88b0-228b479abcb6 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:03.342408 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7125df05-7477-4d2d-88b0-228b479abcb6 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:03.661318 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7125df05-7477-4d2d-88b0-228b479abcb6 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:03.673358 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7125df05-7477-4d2d-88b0-228b479abcb6 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51" status: 200 len: 1509 microversion: 2.1 time: 0.368586 Oct 04 18:45:03.675680 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2069/4086] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:03 2022] GET /compute/v2.1/servers/c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51 => generated 1509 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:03.682225 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-23b30b7d-bd3d-43a9-83ba-e0a4a2222090 req-adc03936-d650-4918-aea3-2fce6eafc9d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d3cabc2-fa23-4098-9197-9aaa19a0c663", "name": "network-vif-deleted", "tag": "3aad2644-bc27-4d77-9ae6-dd56c1d45027"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:45:03.701367 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-23b30b7d-bd3d-43a9-83ba-e0a4a2222090 req-adc03936-d650-4918-aea3-2fce6eafc9d2 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:03.702869 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-23b30b7d-bd3d-43a9-83ba-e0a4a2222090 req-adc03936-d650-4918-aea3-2fce6eafc9d2 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:03.703485 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-23b30b7d-bd3d-43a9-83ba-e0a4a2222090 req-adc03936-d650-4918-aea3-2fce6eafc9d2 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:03.730868 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-23b30b7d-bd3d-43a9-83ba-e0a4a2222090 req-adc03936-d650-4918-aea3-2fce6eafc9d2 service nova] Creating event network-vif-deleted:3aad2644-bc27-4d77-9ae6-dd56c1d45027 for instance 3d3cabc2-fa23-4098-9197-9aaa19a0c663 on n-h1-850501-14 Oct 04 18:45:03.740392 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-23b30b7d-bd3d-43a9-83ba-e0a4a2222090 req-adc03936-d650-4918-aea3-2fce6eafc9d2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062660 Oct 04 18:45:03.741610 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2070/4087] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:45:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:45:03.754582 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0ac4ac95-66b9-4050-a300-0cf39a0570a0 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:03.757611 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0ac4ac95-66b9-4050-a300-0cf39a0570a0 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] [instance: 3d3cabc2-fa23-4098-9197-9aaa19a0c663] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:03.765804 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6c08e170-186a-4f78-93b4-352d538f828c tempest-SecurityGroupRulesNegativeTestJSON-748897975 tempest-SecurityGroupRulesNegativeTestJSON-748897975-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-group-rules/82d90865-9dc8-4f57-8f44-15a1ef26967a" status: 202 len: 0 microversion: 2.1 time: 0.473812 Oct 04 18:45:03.766409 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2018/4088] 10.222.0.20 () {58 vars in 1287 bytes} [Tue Oct 4 18:45:03 2022] DELETE /compute/v2.1/os-security-group-rules/82d90865-9dc8-4f57-8f44-15a1ef26967a => generated 0 bytes in 475 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:45:03.781756 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-fac2e393-ef47-4b1f-afa1-5862d45b1f78 tempest-SecurityGroupRulesNegativeTestJSON-748897975 tempest-SecurityGroupRulesNegativeTestJSON-748897975-project] Action: 'create', calling method: .version_select at 0x7fe258bdd790>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1373446993", "description": "tempest-description-130158771"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:45:03.799805 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0ac4ac95-66b9-4050-a300-0cf39a0570a0 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:03.799805 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0ac4ac95-66b9-4050-a300-0cf39a0570a0 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:03.799805 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0ac4ac95-66b9-4050-a300-0cf39a0570a0 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:03.799805 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0ac4ac95-66b9-4050-a300-0cf39a0570a0 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:03.799805 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0ac4ac95-66b9-4050-a300-0cf39a0570a0 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:03.822088 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0ac4ac95-66b9-4050-a300-0cf39a0570a0 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:04.092680 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0ac4ac95-66b9-4050-a300-0cf39a0570a0 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:04.109302 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0ac4ac95-66b9-4050-a300-0cf39a0570a0 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:04.114993 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0ac4ac95-66b9-4050-a300-0cf39a0570a0 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:04.119767 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0ac4ac95-66b9-4050-a300-0cf39a0570a0 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] 10.222.0.20 "GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663" status: 200 len: 2702 microversion: 2.42 time: 0.373658 Oct 04 18:45:04.119767 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2071/4089] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:45:03 2022] GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663 => generated 2702 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:45:04.132115 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-70639639-987e-426c-8f19-eadd567a707a tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:04.133068 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-70639639-987e-426c-8f19-eadd567a707a tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] [instance: d46bd79f-eda9-4149-b4aa-788520147af7] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:04.142580 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-70639639-987e-426c-8f19-eadd567a707a tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:04.143902 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-70639639-987e-426c-8f19-eadd567a707a tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:04.146045 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-70639639-987e-426c-8f19-eadd567a707a tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:04.148953 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-70639639-987e-426c-8f19-eadd567a707a tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:04.149442 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-70639639-987e-426c-8f19-eadd567a707a tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:04.149880 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-70639639-987e-426c-8f19-eadd567a707a tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:04.296693 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-70639639-987e-426c-8f19-eadd567a707a tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a02cd1108b947b186202f6d15e6cf0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c0b095138354810949093e7ea03b8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:04.306204 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-70639639-987e-426c-8f19-eadd567a707a tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] 10.222.0.20 "GET /compute/v2.1/servers/d46bd79f-eda9-4149-b4aa-788520147af7" status: 200 len: 1276 microversion: 2.1 time: 0.187914 Oct 04 18:45:04.312082 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2072/4090] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:04 2022] GET /compute/v2.1/servers/d46bd79f-eda9-4149-b4aa-788520147af7 => generated 1276 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:04.325187 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-90137dd5-816a-426c-a73b-b0372443c8b8 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:04.330705 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-90137dd5-816a-426c-a73b-b0372443c8b8 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: 4d6dfac0-958d-4698-a050-6539caebe52c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:04.361172 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-90137dd5-816a-426c-a73b-b0372443c8b8 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:04.361172 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-90137dd5-816a-426c-a73b-b0372443c8b8 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:04.361172 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-90137dd5-816a-426c-a73b-b0372443c8b8 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:04.361172 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-90137dd5-816a-426c-a73b-b0372443c8b8 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:04.361172 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-90137dd5-816a-426c-a73b-b0372443c8b8 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:04.361172 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-90137dd5-816a-426c-a73b-b0372443c8b8 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:04.526521 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-fac2e393-ef47-4b1f-afa1-5862d45b1f78 tempest-SecurityGroupRulesNegativeTestJSON-748897975 tempest-SecurityGroupRulesNegativeTestJSON-748897975-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.754710 Oct 04 18:45:04.527588 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2019/4091] 10.222.0.20 () {60 vars in 1180 bytes} [Tue Oct 4 18:45:03 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:45:04.542028 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0004c575-8525-4a99-8fae-99859e831dcb tempest-SecurityGroupRulesNegativeTestJSON-748897975 tempest-SecurityGroupRulesNegativeTestJSON-748897975-project] Action: 'create', calling method: .version_select at 0x7fe253dc1b80>, body: {"security_group_rule": {"parent_group_id": "e09e1602-8545-49db-85b9-480963a1c719", "ip_protocol": "tcp", "from_port": 32398074, "to_port": 22}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:45:05.121021 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-0004c575-8525-4a99-8fae-99859e831dcb tempest-SecurityGroupRulesNegativeTestJSON-748897975 tempest-SecurityGroupRulesNegativeTestJSON-748897975-project] HTTP exception thrown: Invalid port range 32398074:22. Former value cannot be greater than the later Oct 04 18:45:05.127896 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0004c575-8525-4a99-8fae-99859e831dcb tempest-SecurityGroupRulesNegativeTestJSON-748897975 tempest-SecurityGroupRulesNegativeTestJSON-748897975-project] Request method failure captured: Oct 04 18:45:05.127896 n-d-850501-14 devstack@n-api.service[123002]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 04 18:45:05.127896 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:45:05.127896 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:45:05.127896 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:45:05.127896 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 144 Oct 04 18:45:05.127896 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:45:05.127896 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:45:05.127896 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:45:05.127896 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:45:05.127896 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH8rMMcZilhK-hQ2-CZ__JiJW0z-J6pBaF2Ts3X3ngDZdkfXOeJggfTHIAkxWgbtdBIrb9PXlpCkJp51_InNIsMjN_3DOnjJp3hQu-ZozT2ns_owLl7legXSNNTm2bVS3-_Tho0-3RHKt3X4wQbYM0cNhz2SoJMytuq_UZ0fi0xOSP8 Oct 04 18:45:05.127896 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:45:05.127896 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:45:05.127896 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:45:05.127896 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:45:05.127896 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:45:05.127896 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:45:05.127896 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 6364f18579384dd6a58c0adb85fca10c Oct 04 18:45:05.127896 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-748897975 Oct 04 18:45:05.127896 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:45:05.127896 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:45:05.127896 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6364f18579384dd6a58c0adb85fca10c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6364f18579384dd6a58c0adb85fca10c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6364f18579384dd6a58c0adb85fca10c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6364f18579384dd6a58c0adb85fca10c"}]}, {"type": "tempest-ServicesTestJSON-Type-1888557797", "name": "tempest-ServicesTestJSON-Service-1064384932", "endpoints": []}] Oct 04 18:45:05.127896 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-748897975 Oct 04 18:45:05.127896 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 6364f18579384dd6a58c0adb85fca10c Oct 04 18:45:05.127896 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-748897975 Oct 04 18:45:05.127896 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-748897975-project Oct 04 18:45:05.127896 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:45:05.127896 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:45:05.127896 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: af2b22bb26cc4eb4afe3a8e219e1a480 Oct 04 18:45:05.127896 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-748897975-project Oct 04 18:45:05.127896 n-d-850501-14 devstack@n-api.service[123002]: Oct 04 18:45:05.127896 n-d-850501-14 devstack@n-api.service[123002]: {"security_group_rule": {"parent_group_id": "e09e1602-8545-49db-85b9-480963a1c719", "ip_protocol": "tcp", "from_port": 32398074, "to_port": 22}} Oct 04 18:45:05.127896 n-d-850501-14 devstack@n-api.service[123002]: method: Oct 04 18:45:05.127896 n-d-850501-14 devstack@n-api.service[123002]: exception: Invalid port range 32398074:22. Former value cannot be greater than the later Oct 04 18:45:05.127896 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'e09e1602-8545-49db-85b9-480963a1c719', 'ip_protocol': 'tcp', 'from_port': 32398074, 'to_port': 22}}} Oct 04 18:45:05.127896 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:45:05.127896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:05.127896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 04 18:45:05.127896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 04 18:45:05.127896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 04 18:45:05.127896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 04 18:45:05.127896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 04 18:45:05.127896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 04 18:45:05.127896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 04 18:45:05.127896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 04 18:45:05.127896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 32398074:22. Former value cannot be greater than the later Oct 04 18:45:05.127896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:45:05.127896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:05.127896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:45:05.127896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:05.127896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:45:05.127896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:45:05.127896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:45:05.127896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:45:05.127896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:45:05.127896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:45:05.127896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:45:05.127896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:45:05.127896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 04 18:45:05.127896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 18:45:05.132566 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 32398074:22. Former value cannot be greater than the later Oct 04 18:45:05.132566 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:45:05.132566 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:05.132566 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:45:05.132566 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:05.132566 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:45:05.132566 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:45:05.132566 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:45:05.132566 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:45:05.132566 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 32398074:22. Former value cannot be greater than the later Oct 04 18:45:05.132566 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:45:05.138795 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0004c575-8525-4a99-8fae-99859e831dcb tempest-SecurityGroupRulesNegativeTestJSON-748897975 tempest-SecurityGroupRulesNegativeTestJSON-748897975-project] Returning 400 to user: Invalid port range 32398074:22. Former value cannot be greater than the later {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:45:05.139475 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0004c575-8525-4a99-8fae-99859e831dcb tempest-SecurityGroupRulesNegativeTestJSON-748897975 tempest-SecurityGroupRulesNegativeTestJSON-748897975-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 121 microversion: 2.1 time: 0.601998 Oct 04 18:45:05.152814 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2020/4092] 10.222.0.20 () {60 vars in 1195 bytes} [Tue Oct 4 18:45:04 2022] POST /compute/v2.1/os-security-group-rules => generated 121 bytes in 617 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 04 18:45:05.163906 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ea016e6e-7e11-4a64-83dc-204f5f8c487a tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:05.164854 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ea016e6e-7e11-4a64-83dc-204f5f8c487a tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:05.173807 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ea016e6e-7e11-4a64-83dc-204f5f8c487a tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:05.174428 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ea016e6e-7e11-4a64-83dc-204f5f8c487a tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:05.175023 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ea016e6e-7e11-4a64-83dc-204f5f8c487a tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:05.175845 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ea016e6e-7e11-4a64-83dc-204f5f8c487a tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:05.176470 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ea016e6e-7e11-4a64-83dc-204f5f8c487a tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:05.177089 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ea016e6e-7e11-4a64-83dc-204f5f8c487a tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:05.208998 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-90137dd5-816a-426c-a73b-b0372443c8b8 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:05.232749 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-90137dd5-816a-426c-a73b-b0372443c8b8 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c" status: 200 len: 1733 microversion: 2.1 time: 0.919202 Oct 04 18:45:05.243911 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2073/4093] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:04 2022] GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c => generated 1733 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:05.260958 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-caf4b35b-475a-4129-bf31-cf9c114a54a4 tempest-SecurityGroupRulesNegativeTestJSON-748897975 tempest-SecurityGroupRulesNegativeTestJSON-748897975-project] Action: 'create', calling method: .version_select at 0x7fe253da0a60>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-68883282", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:45:05.272311 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-caf4b35b-475a-4129-bf31-cf9c114a54a4 tempest-SecurityGroupRulesNegativeTestJSON-748897975 tempest-SecurityGroupRulesNegativeTestJSON-748897975-project] HTTP exception thrown: Security group id should be uuid Oct 04 18:45:05.274212 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-caf4b35b-475a-4129-bf31-cf9c114a54a4 tempest-SecurityGroupRulesNegativeTestJSON-748897975 tempest-SecurityGroupRulesNegativeTestJSON-748897975-project] Request method failure captured: Oct 04 18:45:05.274212 n-d-850501-14 devstack@n-api.service[123001]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 04 18:45:05.274212 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:45:05.274212 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:45:05.274212 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:45:05.274212 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 129 Oct 04 18:45:05.274212 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:45:05.274212 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:45:05.274212 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:45:05.274212 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:45:05.274212 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPH8rMMcZilhK-hQ2-CZ__JiJW0z-J6pBaF2Ts3X3ngDZdkfXOeJggfTHIAkxWgbtdBIrb9PXlpCkJp51_InNIsMjN_3DOnjJp3hQu-ZozT2ns_owLl7legXSNNTm2bVS3-_Tho0-3RHKt3X4wQbYM0cNhz2SoJMytuq_UZ0fi0xOSP8 Oct 04 18:45:05.274212 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:45:05.274212 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:45:05.274212 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:45:05.274212 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:45:05.274212 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:45:05.274212 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:45:05.274212 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 6364f18579384dd6a58c0adb85fca10c Oct 04 18:45:05.274212 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-748897975 Oct 04 18:45:05.274212 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:45:05.274212 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:45:05.274212 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6364f18579384dd6a58c0adb85fca10c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6364f18579384dd6a58c0adb85fca10c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6364f18579384dd6a58c0adb85fca10c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6364f18579384dd6a58c0adb85fca10c"}]}, {"type": "tempest-ServicesTestJSON-Type-1888557797", "name": "tempest-ServicesTestJSON-Service-1064384932", "endpoints": []}] Oct 04 18:45:05.274212 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-748897975 Oct 04 18:45:05.274212 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 6364f18579384dd6a58c0adb85fca10c Oct 04 18:45:05.274212 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-748897975 Oct 04 18:45:05.274212 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-748897975-project Oct 04 18:45:05.274212 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:45:05.274212 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:45:05.274212 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: af2b22bb26cc4eb4afe3a8e219e1a480 Oct 04 18:45:05.274212 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-748897975-project Oct 04 18:45:05.274212 n-d-850501-14 devstack@n-api.service[123001]: Oct 04 18:45:05.274212 n-d-850501-14 devstack@n-api.service[123001]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-68883282", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 04 18:45:05.274212 n-d-850501-14 devstack@n-api.service[123001]: method: Oct 04 18:45:05.274212 n-d-850501-14 devstack@n-api.service[123001]: exception: Security group id should be uuid Oct 04 18:45:05.274212 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-68883282', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 04 18:45:05.274212 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:45:05.274212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:05.274212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Oct 04 18:45:05.274212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Oct 04 18:45:05.274212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Oct 04 18:45:05.274212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 04 18:45:05.274212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Oct 04 18:45:05.274212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:45:05.274212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:05.274212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:45:05.274212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:05.274212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:45:05.274212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:45:05.274212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:45:05.274212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:45:05.274212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:45:05.274212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:45:05.274212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:45:05.274212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:45:05.274212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 04 18:45:05.274212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 18:45:05.274212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Oct 04 18:45:05.274212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:45:05.274212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:05.274212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:45:05.274212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:05.274212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:45:05.274212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:45:05.279952 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:45:05.279952 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:45:05.279952 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Oct 04 18:45:05.279952 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:45:05.281169 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-caf4b35b-475a-4129-bf31-cf9c114a54a4 tempest-SecurityGroupRulesNegativeTestJSON-748897975 tempest-SecurityGroupRulesNegativeTestJSON-748897975-project] Returning 400 to user: Security group id should be uuid {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:45:05.284019 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-caf4b35b-475a-4129-bf31-cf9c114a54a4 tempest-SecurityGroupRulesNegativeTestJSON-748897975 tempest-SecurityGroupRulesNegativeTestJSON-748897975-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.036885 Oct 04 18:45:05.284019 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2074/4094] 10.222.0.20 () {60 vars in 1195 bytes} [Tue Oct 4 18:45:05 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 18:45:05.313171 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-95252c41-d245-4e19-8d97-237d6816e1f0 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:05.313808 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-95252c41-d245-4e19-8d97-237d6816e1f0 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] [instance: 3d3cabc2-fa23-4098-9197-9aaa19a0c663] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:05.334337 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-95252c41-d245-4e19-8d97-237d6816e1f0 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:05.335124 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-95252c41-d245-4e19-8d97-237d6816e1f0 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:05.335643 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-95252c41-d245-4e19-8d97-237d6816e1f0 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:05.336454 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-95252c41-d245-4e19-8d97-237d6816e1f0 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:05.337271 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-95252c41-d245-4e19-8d97-237d6816e1f0 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:05.338515 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-95252c41-d245-4e19-8d97-237d6816e1f0 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:05.852521 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ea016e6e-7e11-4a64-83dc-204f5f8c487a tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:05.895119 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ea016e6e-7e11-4a64-83dc-204f5f8c487a tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51" status: 200 len: 1509 microversion: 2.1 time: 0.737033 Oct 04 18:45:05.895119 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2021/4095] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:05 2022] GET /compute/v2.1/servers/c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51 => generated 1509 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:05.904964 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-45d2f6c7-e596-4caa-a892-a963dadc705e tempest-SecurityGroupRulesNegativeTestJSON-748897975 tempest-SecurityGroupRulesNegativeTestJSON-748897975-project] Action: 'create', calling method: .version_select at 0x7fe25891c310>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1137097450", "description": "tempest-description-1923259868"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:45:06.060652 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-95252c41-d245-4e19-8d97-237d6816e1f0 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:06.086313 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-95252c41-d245-4e19-8d97-237d6816e1f0 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:06.092615 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-95252c41-d245-4e19-8d97-237d6816e1f0 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:06.096065 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-95252c41-d245-4e19-8d97-237d6816e1f0 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] 10.222.0.20 "GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663" status: 200 len: 2366 microversion: 2.42 time: 0.811020 Oct 04 18:45:06.097896 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2075/4096] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:45:05 2022] GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663 => generated 2366 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:45:06.132282 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a56c8b7b-0aba-4fe5-bf87-bc3ed312989f tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:06.134389 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a56c8b7b-0aba-4fe5-bf87-bc3ed312989f tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] [instance: d46bd79f-eda9-4149-b4aa-788520147af7] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:06.157803 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a56c8b7b-0aba-4fe5-bf87-bc3ed312989f tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:06.157947 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a56c8b7b-0aba-4fe5-bf87-bc3ed312989f tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:06.158384 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a56c8b7b-0aba-4fe5-bf87-bc3ed312989f tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:06.171641 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a56c8b7b-0aba-4fe5-bf87-bc3ed312989f tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:06.176399 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a56c8b7b-0aba-4fe5-bf87-bc3ed312989f tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:06.176920 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a56c8b7b-0aba-4fe5-bf87-bc3ed312989f tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:06.484285 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a56c8b7b-0aba-4fe5-bf87-bc3ed312989f tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a02cd1108b947b186202f6d15e6cf0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c0b095138354810949093e7ea03b8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:06.484285 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a56c8b7b-0aba-4fe5-bf87-bc3ed312989f tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] 10.222.0.20 "GET /compute/v2.1/servers/d46bd79f-eda9-4149-b4aa-788520147af7" status: 200 len: 1274 microversion: 2.1 time: 0.280186 Oct 04 18:45:06.484285 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2076/4097] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:06 2022] GET /compute/v2.1/servers/d46bd79f-eda9-4149-b4aa-788520147af7 => generated 1274 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:06.484285 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-b1b714e6-a00e-4e0f-b711-1b92bd38f0a7 req-8bab0ed1-ca8d-48d9-9635-7a181a91bf20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d3cabc2-fa23-4098-9197-9aaa19a0c663", "name": "network-vif-deleted", "tag": "d87225ab-6eb7-4ee8-a1ae-be2176c6788c"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:45:06.484285 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-b1b714e6-a00e-4e0f-b711-1b92bd38f0a7 req-8bab0ed1-ca8d-48d9-9635-7a181a91bf20 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:06.484285 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-b1b714e6-a00e-4e0f-b711-1b92bd38f0a7 req-8bab0ed1-ca8d-48d9-9635-7a181a91bf20 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:06.484285 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-b1b714e6-a00e-4e0f-b711-1b92bd38f0a7 req-8bab0ed1-ca8d-48d9-9635-7a181a91bf20 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:06.578169 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-b1b714e6-a00e-4e0f-b711-1b92bd38f0a7 req-8bab0ed1-ca8d-48d9-9635-7a181a91bf20 service nova] Creating event network-vif-deleted:d87225ab-6eb7-4ee8-a1ae-be2176c6788c for instance 3d3cabc2-fa23-4098-9197-9aaa19a0c663 on n-h1-850501-14 Oct 04 18:45:06.578169 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-b1b714e6-a00e-4e0f-b711-1b92bd38f0a7 req-8bab0ed1-ca8d-48d9-9635-7a181a91bf20 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133251 Oct 04 18:45:06.578169 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2077/4098] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:45:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:45:06.578169 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c5fbf2b6-9081-4a60-b0ef-d134975c6988 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:06.578169 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c5fbf2b6-9081-4a60-b0ef-d134975c6988 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: 4d6dfac0-958d-4698-a050-6539caebe52c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:06.591582 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c5fbf2b6-9081-4a60-b0ef-d134975c6988 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:06.594212 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c5fbf2b6-9081-4a60-b0ef-d134975c6988 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:06.595053 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c5fbf2b6-9081-4a60-b0ef-d134975c6988 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:06.598488 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c5fbf2b6-9081-4a60-b0ef-d134975c6988 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:06.599411 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c5fbf2b6-9081-4a60-b0ef-d134975c6988 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:06.604501 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c5fbf2b6-9081-4a60-b0ef-d134975c6988 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:06.837713 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-45d2f6c7-e596-4caa-a892-a963dadc705e tempest-SecurityGroupRulesNegativeTestJSON-748897975 tempest-SecurityGroupRulesNegativeTestJSON-748897975-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.941047 Oct 04 18:45:06.838306 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2022/4099] 10.222.0.20 () {60 vars in 1180 bytes} [Tue Oct 4 18:45:05 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:45:06.861095 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-245f42af-3e91-42f6-b113-ed2a83001ab6 tempest-SecurityGroupRulesNegativeTestJSON-748897975 tempest-SecurityGroupRulesNegativeTestJSON-748897975-project] Action: 'create', calling method: .version_select at 0x7fe259708700>, body: {"security_group_rule": {"parent_group_id": "750b0536-d753-4eb7-b65a-709de14c9987", "ip_protocol": "tempest-999-416242224", "from_port": 22, "to_port": 22}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:45:07.115291 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-245f42af-3e91-42f6-b113-ed2a83001ab6 tempest-SecurityGroupRulesNegativeTestJSON-748897975 tempest-SecurityGroupRulesNegativeTestJSON-748897975-project] HTTP exception thrown: Invalid IP protocol tempest-999-416242224. Oct 04 18:45:07.117539 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-245f42af-3e91-42f6-b113-ed2a83001ab6 tempest-SecurityGroupRulesNegativeTestJSON-748897975 tempest-SecurityGroupRulesNegativeTestJSON-748897975-project] Request method failure captured: Oct 04 18:45:07.117539 n-d-850501-14 devstack@n-api.service[123002]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 04 18:45:07.117539 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:45:07.117539 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:45:07.117539 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:45:07.117539 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 156 Oct 04 18:45:07.117539 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:45:07.117539 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:45:07.117539 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:45:07.117539 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:45:07.117539 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH8rMMcZilhK-hQ2-CZ__JiJW0z-J6pBaF2Ts3X3ngDZdkfXOeJggfTHIAkxWgbtdBIrb9PXlpCkJp51_InNIsMjN_3DOnjJp3hQu-ZozT2ns_owLl7legXSNNTm2bVS3-_Tho0-3RHKt3X4wQbYM0cNhz2SoJMytuq_UZ0fi0xOSP8 Oct 04 18:45:07.117539 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:45:07.117539 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:45:07.117539 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:45:07.117539 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:45:07.117539 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:45:07.117539 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:45:07.117539 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 6364f18579384dd6a58c0adb85fca10c Oct 04 18:45:07.117539 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-748897975 Oct 04 18:45:07.117539 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:45:07.117539 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:45:07.117539 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6364f18579384dd6a58c0adb85fca10c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6364f18579384dd6a58c0adb85fca10c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6364f18579384dd6a58c0adb85fca10c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6364f18579384dd6a58c0adb85fca10c"}]}, {"type": "tempest-ServicesTestJSON-Type-1888557797", "name": "tempest-ServicesTestJSON-Service-1064384932", "endpoints": []}] Oct 04 18:45:07.117539 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-748897975 Oct 04 18:45:07.117539 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 6364f18579384dd6a58c0adb85fca10c Oct 04 18:45:07.117539 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-748897975 Oct 04 18:45:07.117539 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-748897975-project Oct 04 18:45:07.117539 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:45:07.117539 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:45:07.117539 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: af2b22bb26cc4eb4afe3a8e219e1a480 Oct 04 18:45:07.117539 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-748897975-project Oct 04 18:45:07.117539 n-d-850501-14 devstack@n-api.service[123002]: Oct 04 18:45:07.117539 n-d-850501-14 devstack@n-api.service[123002]: {"security_group_rule": {"parent_group_id": "750b0536-d753-4eb7-b65a-709de14c9987", "ip_protocol": "tempest-999-416242224", "from_port": 22, "to_port": 22}} Oct 04 18:45:07.117539 n-d-850501-14 devstack@n-api.service[123002]: method: Oct 04 18:45:07.117539 n-d-850501-14 devstack@n-api.service[123002]: exception: Invalid IP protocol tempest-999-416242224. Oct 04 18:45:07.117539 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'body': {'security_group_rule': {'parent_group_id': '750b0536-d753-4eb7-b65a-709de14c9987', 'ip_protocol': 'tempest-999-416242224', 'from_port': 22, 'to_port': 22}}} Oct 04 18:45:07.117539 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:45:07.117539 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:07.117539 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 04 18:45:07.117539 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 04 18:45:07.117539 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 04 18:45:07.117539 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 04 18:45:07.117539 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 04 18:45:07.117539 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 04 18:45:07.117539 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Oct 04 18:45:07.117539 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Oct 04 18:45:07.117539 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-416242224. Oct 04 18:45:07.117539 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:45:07.117539 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:07.117539 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:45:07.117539 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:07.117539 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:45:07.117539 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:45:07.117539 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:45:07.117539 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:45:07.117539 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:45:07.117539 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:45:07.117539 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:45:07.117539 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:45:07.117539 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 04 18:45:07.117539 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 18:45:07.117539 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-416242224. Oct 04 18:45:07.117539 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:45:07.123254 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:07.123254 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:45:07.123254 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:07.123254 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:45:07.123254 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:45:07.123254 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:45:07.123254 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:45:07.123254 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-416242224. Oct 04 18:45:07.123254 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:45:07.131964 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-245f42af-3e91-42f6-b113-ed2a83001ab6 tempest-SecurityGroupRulesNegativeTestJSON-748897975 tempest-SecurityGroupRulesNegativeTestJSON-748897975-project] Returning 400 to user: Invalid IP protocol tempest-999-416242224. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:45:07.131964 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-245f42af-3e91-42f6-b113-ed2a83001ab6 tempest-SecurityGroupRulesNegativeTestJSON-748897975 tempest-SecurityGroupRulesNegativeTestJSON-748897975-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 86 microversion: 2.1 time: 0.276024 Oct 04 18:45:07.131964 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2023/4100] 10.222.0.20 () {60 vars in 1195 bytes} [Tue Oct 4 18:45:06 2022] POST /compute/v2.1/os-security-group-rules => generated 86 bytes in 277 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 18:45:07.143556 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2399d0ec-b41a-46e3-9454-0559045847de tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:07.146940 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2399d0ec-b41a-46e3-9454-0559045847de tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:07.159242 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2399d0ec-b41a-46e3-9454-0559045847de tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:07.167403 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2399d0ec-b41a-46e3-9454-0559045847de tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:07.169624 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2399d0ec-b41a-46e3-9454-0559045847de tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:07.185133 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2399d0ec-b41a-46e3-9454-0559045847de tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:07.185133 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2399d0ec-b41a-46e3-9454-0559045847de tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:07.186337 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2399d0ec-b41a-46e3-9454-0559045847de tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:07.187417 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c5fbf2b6-9081-4a60-b0ef-d134975c6988 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:07.208213 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c5fbf2b6-9081-4a60-b0ef-d134975c6988 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c" status: 200 len: 1733 microversion: 2.1 time: 0.669040 Oct 04 18:45:07.208213 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2078/4101] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:06 2022] GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c => generated 1733 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:07.216333 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-428d9625-f0b2-48bb-b83e-a6218150f6e5 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:07.217289 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-428d9625-f0b2-48bb-b83e-a6218150f6e5 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] [instance: 3d3cabc2-fa23-4098-9197-9aaa19a0c663] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:07.233558 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-428d9625-f0b2-48bb-b83e-a6218150f6e5 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:07.234348 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-428d9625-f0b2-48bb-b83e-a6218150f6e5 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:07.235046 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-428d9625-f0b2-48bb-b83e-a6218150f6e5 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:07.236739 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-428d9625-f0b2-48bb-b83e-a6218150f6e5 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:07.237433 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-428d9625-f0b2-48bb-b83e-a6218150f6e5 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:07.237875 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-428d9625-f0b2-48bb-b83e-a6218150f6e5 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:07.376793 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-428d9625-f0b2-48bb-b83e-a6218150f6e5 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:07.405906 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-428d9625-f0b2-48bb-b83e-a6218150f6e5 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:07.407339 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-428d9625-f0b2-48bb-b83e-a6218150f6e5 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:07.408873 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-428d9625-f0b2-48bb-b83e-a6218150f6e5 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] 10.222.0.20 "GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663" status: 200 len: 2142 microversion: 2.42 time: 0.201005 Oct 04 18:45:07.412610 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2079/4102] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:45:07 2022] GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663 => generated 2142 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:45:07.433343 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4997d5ef-2d22-4b90-a6be-2a847877e2fd tempest-SecurityGroupRulesNegativeTestJSON-748897975 tempest-SecurityGroupRulesNegativeTestJSON-748897975-project] Action: 'create', calling method: .version_select at 0x7fe253e1c940>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1447638892", "description": "tempest-description-373926754"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:45:07.559001 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2399d0ec-b41a-46e3-9454-0559045847de tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:07.572294 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2399d0ec-b41a-46e3-9454-0559045847de tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51" status: 200 len: 1486 microversion: 2.1 time: 0.441779 Oct 04 18:45:07.572985 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2024/4103] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:07 2022] GET /compute/v2.1/servers/c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51 => generated 1486 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:07.609877 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-653d5b9c-3c7f-44c3-b1f8-7008e8325590 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:07.610563 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-653d5b9c-3c7f-44c3-b1f8-7008e8325590 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] [instance: d46bd79f-eda9-4149-b4aa-788520147af7] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:07.630947 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-653d5b9c-3c7f-44c3-b1f8-7008e8325590 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:07.631452 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-653d5b9c-3c7f-44c3-b1f8-7008e8325590 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:07.631880 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-653d5b9c-3c7f-44c3-b1f8-7008e8325590 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:07.632652 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-653d5b9c-3c7f-44c3-b1f8-7008e8325590 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:07.633104 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-653d5b9c-3c7f-44c3-b1f8-7008e8325590 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:07.633529 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-653d5b9c-3c7f-44c3-b1f8-7008e8325590 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:08.052848 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-653d5b9c-3c7f-44c3-b1f8-7008e8325590 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a02cd1108b947b186202f6d15e6cf0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c0b095138354810949093e7ea03b8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:08.063855 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-653d5b9c-3c7f-44c3-b1f8-7008e8325590 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] 10.222.0.20 "GET /compute/v2.1/servers/d46bd79f-eda9-4149-b4aa-788520147af7" status: 200 len: 1316 microversion: 2.1 time: 0.474771 Oct 04 18:45:08.067232 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2025/4104] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:07 2022] GET /compute/v2.1/servers/d46bd79f-eda9-4149-b4aa-788520147af7 => generated 1316 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:08.079454 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ca5d8336-9142-47f4-9151-38778dbdd911 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-672512948"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:45:08.103230 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ca5d8336-9142-47f4-9151-38778dbdd911 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:08.113496 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ca5d8336-9142-47f4-9151-38778dbdd911 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:08.114481 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ca5d8336-9142-47f4-9151-38778dbdd911 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:08.115175 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ca5d8336-9142-47f4-9151-38778dbdd911 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:08.119550 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ca5d8336-9142-47f4-9151-38778dbdd911 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:08.120320 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ca5d8336-9142-47f4-9151-38778dbdd911 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:08.121027 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ca5d8336-9142-47f4-9151-38778dbdd911 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:08.244630 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-4997d5ef-2d22-4b90-a6be-2a847877e2fd tempest-SecurityGroupRulesNegativeTestJSON-748897975 tempest-SecurityGroupRulesNegativeTestJSON-748897975-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.827893 Oct 04 18:45:08.244630 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2080/4105] 10.222.0.20 () {60 vars in 1180 bytes} [Tue Oct 4 18:45:07 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:45:08.250043 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-eb1b28bc-8783-473b-b87d-6f50e7a6ae73 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:08.250940 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-eb1b28bc-8783-473b-b87d-6f50e7a6ae73 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: 4d6dfac0-958d-4698-a050-6539caebe52c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:08.259638 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:08.261914 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eb1b28bc-8783-473b-b87d-6f50e7a6ae73 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:08.262468 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eb1b28bc-8783-473b-b87d-6f50e7a6ae73 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:08.262922 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eb1b28bc-8783-473b-b87d-6f50e7a6ae73 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:08.263674 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eb1b28bc-8783-473b-b87d-6f50e7a6ae73 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:08.264368 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eb1b28bc-8783-473b-b87d-6f50e7a6ae73 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:08.267096 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eb1b28bc-8783-473b-b87d-6f50e7a6ae73 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:08.271088 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ca5d8336-9142-47f4-9151-38778dbdd911 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "PUT /compute/v2.1/servers/c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51" status: 200 len: 1059 microversion: 2.1 time: 0.200662 Oct 04 18:45:08.272037 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2026/4106] 10.222.0.20 () {60 vars in 1256 bytes} [Tue Oct 4 18:45:08 2022] PUT /compute/v2.1/servers/c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51 => generated 1059 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:08.281906 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5f3d6e1b-d83a-4427-b8c1-58b8ad72a062 tempest-SecurityGroupRulesNegativeTestJSON-748897975 tempest-SecurityGroupRulesNegativeTestJSON-748897975-project] Action: 'create', calling method: .version_select at 0x7fe25d19f3a0>, body: {"security_group_rule": {"parent_group_id": "904c9235-b5b4-49b6-b75c-e72bee2a05d1", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:45:08.528765 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-5f3d6e1b-d83a-4427-b8c1-58b8ad72a062 tempest-SecurityGroupRulesNegativeTestJSON-748897975 tempest-SecurityGroupRulesNegativeTestJSON-748897975-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Oct 04 18:45:08.530675 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5f3d6e1b-d83a-4427-b8c1-58b8ad72a062 tempest-SecurityGroupRulesNegativeTestJSON-748897975 tempest-SecurityGroupRulesNegativeTestJSON-748897975-project] Request method failure captured: Oct 04 18:45:08.530675 n-d-850501-14 devstack@n-api.service[123002]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 04 18:45:08.530675 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:45:08.530675 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:45:08.530675 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:45:08.530675 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 138 Oct 04 18:45:08.530675 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:45:08.530675 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:45:08.530675 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:45:08.530675 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:45:08.530675 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH8rMMcZilhK-hQ2-CZ__JiJW0z-J6pBaF2Ts3X3ngDZdkfXOeJggfTHIAkxWgbtdBIrb9PXlpCkJp51_InNIsMjN_3DOnjJp3hQu-ZozT2ns_owLl7legXSNNTm2bVS3-_Tho0-3RHKt3X4wQbYM0cNhz2SoJMytuq_UZ0fi0xOSP8 Oct 04 18:45:08.530675 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:45:08.530675 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:45:08.530675 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:45:08.530675 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:45:08.530675 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:45:08.530675 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:45:08.530675 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 6364f18579384dd6a58c0adb85fca10c Oct 04 18:45:08.530675 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-748897975 Oct 04 18:45:08.530675 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:45:08.530675 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:45:08.530675 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6364f18579384dd6a58c0adb85fca10c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6364f18579384dd6a58c0adb85fca10c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6364f18579384dd6a58c0adb85fca10c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6364f18579384dd6a58c0adb85fca10c"}]}, {"type": "tempest-ServicesTestJSON-Type-1888557797", "name": "tempest-ServicesTestJSON-Service-1064384932", "endpoints": []}] Oct 04 18:45:08.530675 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-748897975 Oct 04 18:45:08.530675 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 6364f18579384dd6a58c0adb85fca10c Oct 04 18:45:08.530675 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-748897975 Oct 04 18:45:08.530675 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-748897975-project Oct 04 18:45:08.530675 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:45:08.530675 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:45:08.530675 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: af2b22bb26cc4eb4afe3a8e219e1a480 Oct 04 18:45:08.530675 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-748897975-project Oct 04 18:45:08.530675 n-d-850501-14 devstack@n-api.service[123002]: Oct 04 18:45:08.530675 n-d-850501-14 devstack@n-api.service[123002]: {"security_group_rule": {"parent_group_id": "904c9235-b5b4-49b6-b75c-e72bee2a05d1", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Oct 04 18:45:08.530675 n-d-850501-14 devstack@n-api.service[123002]: method: Oct 04 18:45:08.530675 n-d-850501-14 devstack@n-api.service[123002]: exception: Invalid port range 22:21. Former value cannot be greater than the later Oct 04 18:45:08.530675 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'body': {'security_group_rule': {'parent_group_id': '904c9235-b5b4-49b6-b75c-e72bee2a05d1', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Oct 04 18:45:08.530675 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:45:08.530675 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:08.530675 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 04 18:45:08.530675 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 04 18:45:08.530675 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 04 18:45:08.530675 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 04 18:45:08.530675 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 04 18:45:08.530675 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 04 18:45:08.530675 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 04 18:45:08.530675 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 04 18:45:08.530675 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Oct 04 18:45:08.530675 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:45:08.530675 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:08.530675 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:45:08.530675 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:08.530675 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:45:08.530675 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:45:08.530675 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:45:08.530675 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:45:08.530675 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:45:08.530675 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:45:08.530675 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:45:08.530675 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:45:08.530675 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 04 18:45:08.530675 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 18:45:08.536649 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Oct 04 18:45:08.536649 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:45:08.536649 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:08.536649 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:45:08.536649 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:08.536649 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:45:08.536649 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:45:08.536649 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:45:08.536649 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:45:08.536649 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Oct 04 18:45:08.536649 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:45:08.536649 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5f3d6e1b-d83a-4427-b8c1-58b8ad72a062 tempest-SecurityGroupRulesNegativeTestJSON-748897975 tempest-SecurityGroupRulesNegativeTestJSON-748897975-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:45:08.536649 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5f3d6e1b-d83a-4427-b8c1-58b8ad72a062 tempest-SecurityGroupRulesNegativeTestJSON-748897975 tempest-SecurityGroupRulesNegativeTestJSON-748897975-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.258839 Oct 04 18:45:08.538587 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2027/4107] 10.222.0.20 () {60 vars in 1195 bytes} [Tue Oct 4 18:45:08 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 264 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:45:08.543297 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-fec619b0-71e4-4b5a-aca3-dd8da75aef87 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:08.544514 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-fec619b0-71e4-4b5a-aca3-dd8da75aef87 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:08.552600 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fec619b0-71e4-4b5a-aca3-dd8da75aef87 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:08.553875 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fec619b0-71e4-4b5a-aca3-dd8da75aef87 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:08.554872 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fec619b0-71e4-4b5a-aca3-dd8da75aef87 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:08.555768 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fec619b0-71e4-4b5a-aca3-dd8da75aef87 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:08.556413 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fec619b0-71e4-4b5a-aca3-dd8da75aef87 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:08.557002 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fec619b0-71e4-4b5a-aca3-dd8da75aef87 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:08.669188 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-eb1b28bc-8783-473b-b87d-6f50e7a6ae73 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:08.678979 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-eb1b28bc-8783-473b-b87d-6f50e7a6ae73 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c" status: 200 len: 1733 microversion: 2.1 time: 0.434984 Oct 04 18:45:08.679915 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2081/4108] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:08 2022] GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c => generated 1733 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:08.687134 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a2135bba-973f-4466-80d7-0e3de2c449ee tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:08.687975 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a2135bba-973f-4466-80d7-0e3de2c449ee tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] [instance: 3d3cabc2-fa23-4098-9197-9aaa19a0c663] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:08.695885 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a2135bba-973f-4466-80d7-0e3de2c449ee tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:08.696886 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a2135bba-973f-4466-80d7-0e3de2c449ee tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:08.698171 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a2135bba-973f-4466-80d7-0e3de2c449ee tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:08.699384 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a2135bba-973f-4466-80d7-0e3de2c449ee tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:08.700102 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a2135bba-973f-4466-80d7-0e3de2c449ee tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:08.700711 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a2135bba-973f-4466-80d7-0e3de2c449ee tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:08.851320 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a2135bba-973f-4466-80d7-0e3de2c449ee tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:08.878924 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a2135bba-973f-4466-80d7-0e3de2c449ee tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:08.878924 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a2135bba-973f-4466-80d7-0e3de2c449ee tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:08.880849 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a2135bba-973f-4466-80d7-0e3de2c449ee tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] 10.222.0.20 "GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663" status: 200 len: 1604 microversion: 2.42 time: 0.199765 Oct 04 18:45:08.881606 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2082/4109] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:45:08 2022] GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663 => generated 1604 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:45:08.899067 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-fec619b0-71e4-4b5a-aca3-dd8da75aef87 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:08.907716 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-fec619b0-71e4-4b5a-aca3-dd8da75aef87 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51" status: 200 len: 1486 microversion: 2.1 time: 0.368973 Oct 04 18:45:08.914271 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2c19f99d-b001-44f5-af18-92e782cc4156 tempest-SecurityGroupRulesNegativeTestJSON-748897975 tempest-SecurityGroupRulesNegativeTestJSON-748897975-project] Action: 'create', calling method: .version_select at 0x7fe253e1c820>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1528627750", "description": "tempest-description-1942085037"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:45:08.915366 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2028/4110] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:08 2022] GET /compute/v2.1/servers/c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51 => generated 1486 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:08.921264 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-497cb908-71e2-4524-8643-c8947d90a481 req-413f9ae8-aa4b-48c9-83e9-1e013228e7a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d3cabc2-fa23-4098-9197-9aaa19a0c663", "name": "network-vif-deleted", "tag": "c909b4c7-8843-4155-a690-84520be7fb47"}, {"server_uuid": "3d3cabc2-fa23-4098-9197-9aaa19a0c663", "name": "network-vif-deleted", "tag": "9a5dee2f-2802-439b-91ce-95cc489ce2fb"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:45:08.946646 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-497cb908-71e2-4524-8643-c8947d90a481 req-413f9ae8-aa4b-48c9-83e9-1e013228e7a7 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:08.948943 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-497cb908-71e2-4524-8643-c8947d90a481 req-413f9ae8-aa4b-48c9-83e9-1e013228e7a7 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:08.949583 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-497cb908-71e2-4524-8643-c8947d90a481 req-413f9ae8-aa4b-48c9-83e9-1e013228e7a7 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:08.973254 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-497cb908-71e2-4524-8643-c8947d90a481 req-413f9ae8-aa4b-48c9-83e9-1e013228e7a7 service nova] Creating event network-vif-deleted:c909b4c7-8843-4155-a690-84520be7fb47 for instance 3d3cabc2-fa23-4098-9197-9aaa19a0c663 on n-h1-850501-14 Oct 04 18:45:08.978812 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-497cb908-71e2-4524-8643-c8947d90a481 req-413f9ae8-aa4b-48c9-83e9-1e013228e7a7 service nova] Creating event network-vif-deleted:9a5dee2f-2802-439b-91ce-95cc489ce2fb for instance 3d3cabc2-fa23-4098-9197-9aaa19a0c663 on n-h1-850501-14 Oct 04 18:45:08.990428 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-497cb908-71e2-4524-8643-c8947d90a481 req-413f9ae8-aa4b-48c9-83e9-1e013228e7a7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.073446 Oct 04 18:45:08.993073 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2029/4111] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:45:08 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:45:09.005848 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-16a392b8-dfa6-4933-91a6-7490022ce7bd tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:09.006569 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-16a392b8-dfa6-4933-91a6-7490022ce7bd tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:09.020798 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-16a392b8-dfa6-4933-91a6-7490022ce7bd tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:09.021706 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-16a392b8-dfa6-4933-91a6-7490022ce7bd tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:09.022730 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-16a392b8-dfa6-4933-91a6-7490022ce7bd tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:09.024341 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-16a392b8-dfa6-4933-91a6-7490022ce7bd tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:09.025280 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-16a392b8-dfa6-4933-91a6-7490022ce7bd tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:09.025717 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-16a392b8-dfa6-4933-91a6-7490022ce7bd tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:09.359917 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-16a392b8-dfa6-4933-91a6-7490022ce7bd tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:09.375518 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-16a392b8-dfa6-4933-91a6-7490022ce7bd tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51" status: 200 len: 1486 microversion: 2.1 time: 0.380849 Oct 04 18:45:09.394748 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2030/4112] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:08 2022] GET /compute/v2.1/servers/c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51 => generated 1486 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:09.417039 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8a075e6b-9ddc-4df2-b844-dae849fbd59d tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:09.419069 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8a075e6b-9ddc-4df2-b844-dae849fbd59d tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] [instance: d46bd79f-eda9-4149-b4aa-788520147af7] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:09.428690 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8a075e6b-9ddc-4df2-b844-dae849fbd59d tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:09.429569 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8a075e6b-9ddc-4df2-b844-dae849fbd59d tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:09.430280 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8a075e6b-9ddc-4df2-b844-dae849fbd59d tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:09.431229 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8a075e6b-9ddc-4df2-b844-dae849fbd59d tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:09.431928 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8a075e6b-9ddc-4df2-b844-dae849fbd59d tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:09.432731 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8a075e6b-9ddc-4df2-b844-dae849fbd59d tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:09.516492 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2c19f99d-b001-44f5-af18-92e782cc4156 tempest-SecurityGroupRulesNegativeTestJSON-748897975 tempest-SecurityGroupRulesNegativeTestJSON-748897975-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.610543 Oct 04 18:45:09.524955 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2083/4113] 10.222.0.20 () {60 vars in 1180 bytes} [Tue Oct 4 18:45:08 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:45:09.524955 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-6f069b64-8677-4c00-a6f0-55aa6f1fd531 req-69429931-26c9-4273-96dd-22d0d084c545 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d46bd79f-eda9-4149-b4aa-788520147af7", "tag": "85f7dba4-0186-43c3-94c9-1a65ff915600"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:45:09.550304 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-6f069b64-8677-4c00-a6f0-55aa6f1fd531 req-69429931-26c9-4273-96dd-22d0d084c545 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:09.550792 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-6f069b64-8677-4c00-a6f0-55aa6f1fd531 req-69429931-26c9-4273-96dd-22d0d084c545 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:09.551229 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-6f069b64-8677-4c00-a6f0-55aa6f1fd531 req-69429931-26c9-4273-96dd-22d0d084c545 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:09.591630 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-6f069b64-8677-4c00-a6f0-55aa6f1fd531 req-69429931-26c9-4273-96dd-22d0d084c545 service nova] Creating event network-changed:85f7dba4-0186-43c3-94c9-1a65ff915600 for instance d46bd79f-eda9-4149-b4aa-788520147af7 on n-h1-850501-14 Oct 04 18:45:09.606585 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-6f069b64-8677-4c00-a6f0-55aa6f1fd531 req-69429931-26c9-4273-96dd-22d0d084c545 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087270 Oct 04 18:45:09.607828 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2084/4114] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:45:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:45:09.626309 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-83faceef-b42f-4ee0-843b-8e632a8180b0 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:09.627111 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-83faceef-b42f-4ee0-843b-8e632a8180b0 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:09.635077 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-83faceef-b42f-4ee0-843b-8e632a8180b0 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:09.635318 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-83faceef-b42f-4ee0-843b-8e632a8180b0 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:09.635725 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-83faceef-b42f-4ee0-843b-8e632a8180b0 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:09.636480 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-83faceef-b42f-4ee0-843b-8e632a8180b0 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:09.638735 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-83faceef-b42f-4ee0-843b-8e632a8180b0 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:09.639752 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-83faceef-b42f-4ee0-843b-8e632a8180b0 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:09.674980 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-83faceef-b42f-4ee0-843b-8e632a8180b0 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:45:09.721128 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8a075e6b-9ddc-4df2-b844-dae849fbd59d tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a02cd1108b947b186202f6d15e6cf0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c0b095138354810949093e7ea03b8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:09.732574 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8a075e6b-9ddc-4df2-b844-dae849fbd59d tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] 10.222.0.20 "GET /compute/v2.1/servers/d46bd79f-eda9-4149-b4aa-788520147af7" status: 200 len: 1316 microversion: 2.1 time: 0.336355 Oct 04 18:45:09.733910 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2031/4115] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:09 2022] GET /compute/v2.1/servers/d46bd79f-eda9-4149-b4aa-788520147af7 => generated 1316 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:09.753127 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-93fd6ab1-7cdc-4c06-95cd-c29fa12596ac tempest-SecurityGroupRulesNegativeTestJSON-748897975 tempest-SecurityGroupRulesNegativeTestJSON-748897975-project] Action: 'create', calling method: .version_select at 0x7fe253dd4d30>, body: {"security_group_rule": {"parent_group_id": "7715ecd1-e995-4ec7-967e-ce55f6f5f051", "ip_protocol": "tcp", "from_port": 22, "to_port": 1818951102}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:45:09.887981 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-93fd6ab1-7cdc-4c06-95cd-c29fa12596ac tempest-SecurityGroupRulesNegativeTestJSON-748897975 tempest-SecurityGroupRulesNegativeTestJSON-748897975-project] HTTP exception thrown: Invalid port range 22:1818951102. Valid TCP ports should be between 1-65535 Oct 04 18:45:09.890754 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-93fd6ab1-7cdc-4c06-95cd-c29fa12596ac tempest-SecurityGroupRulesNegativeTestJSON-748897975 tempest-SecurityGroupRulesNegativeTestJSON-748897975-project] Request method failure captured: Oct 04 18:45:09.890754 n-d-850501-14 devstack@n-api.service[123002]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 04 18:45:09.890754 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:45:09.890754 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:45:09.890754 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:45:09.890754 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 146 Oct 04 18:45:09.890754 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:45:09.890754 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:45:09.890754 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:45:09.890754 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:45:09.890754 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH8rMMcZilhK-hQ2-CZ__JiJW0z-J6pBaF2Ts3X3ngDZdkfXOeJggfTHIAkxWgbtdBIrb9PXlpCkJp51_InNIsMjN_3DOnjJp3hQu-ZozT2ns_owLl7legXSNNTm2bVS3-_Tho0-3RHKt3X4wQbYM0cNhz2SoJMytuq_UZ0fi0xOSP8 Oct 04 18:45:09.890754 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:45:09.890754 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:45:09.890754 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:45:09.890754 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:45:09.890754 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:45:09.890754 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:45:09.890754 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 6364f18579384dd6a58c0adb85fca10c Oct 04 18:45:09.890754 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-748897975 Oct 04 18:45:09.890754 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:45:09.890754 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:45:09.890754 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6364f18579384dd6a58c0adb85fca10c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6364f18579384dd6a58c0adb85fca10c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6364f18579384dd6a58c0adb85fca10c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6364f18579384dd6a58c0adb85fca10c"}]}, {"type": "tempest-ServicesTestJSON-Type-1888557797", "name": "tempest-ServicesTestJSON-Service-1064384932", "endpoints": []}] Oct 04 18:45:09.890754 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-748897975 Oct 04 18:45:09.890754 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 6364f18579384dd6a58c0adb85fca10c Oct 04 18:45:09.890754 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-748897975 Oct 04 18:45:09.890754 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-748897975-project Oct 04 18:45:09.890754 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:45:09.890754 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:45:09.890754 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: af2b22bb26cc4eb4afe3a8e219e1a480 Oct 04 18:45:09.890754 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-748897975-project Oct 04 18:45:09.890754 n-d-850501-14 devstack@n-api.service[123002]: Oct 04 18:45:09.890754 n-d-850501-14 devstack@n-api.service[123002]: {"security_group_rule": {"parent_group_id": "7715ecd1-e995-4ec7-967e-ce55f6f5f051", "ip_protocol": "tcp", "from_port": 22, "to_port": 1818951102}} Oct 04 18:45:09.890754 n-d-850501-14 devstack@n-api.service[123002]: method: Oct 04 18:45:09.890754 n-d-850501-14 devstack@n-api.service[123002]: exception: Invalid port range 22:1818951102. Valid TCP ports should be between 1-65535 Oct 04 18:45:09.890754 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'body': {'security_group_rule': {'parent_group_id': '7715ecd1-e995-4ec7-967e-ce55f6f5f051', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 1818951102}}} Oct 04 18:45:09.890754 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:45:09.890754 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:09.890754 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 04 18:45:09.890754 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 04 18:45:09.890754 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 04 18:45:09.890754 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 04 18:45:09.890754 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 04 18:45:09.890754 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 04 18:45:09.890754 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Oct 04 18:45:09.890754 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 04 18:45:09.890754 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:1818951102. Valid TCP ports should be between 1-65535 Oct 04 18:45:09.890754 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:45:09.890754 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:09.890754 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:45:09.890754 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:09.890754 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:45:09.890754 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:45:09.890754 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:45:09.890754 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:45:09.890754 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:45:09.890754 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:45:09.890754 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:45:09.890754 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:45:09.890754 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 04 18:45:09.890754 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 18:45:09.903367 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:1818951102. Valid TCP ports should be between 1-65535 Oct 04 18:45:09.903367 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:45:09.903367 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:09.903367 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:45:09.903367 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:09.903367 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:45:09.903367 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:45:09.903367 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:45:09.903367 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:45:09.903367 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:1818951102. Valid TCP ports should be between 1-65535 Oct 04 18:45:09.903367 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:45:09.903367 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-93fd6ab1-7cdc-4c06-95cd-c29fa12596ac tempest-SecurityGroupRulesNegativeTestJSON-748897975 tempest-SecurityGroupRulesNegativeTestJSON-748897975-project] Returning 400 to user: Invalid port range 22:1818951102. Valid TCP ports should be between 1-65535 {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:45:09.903367 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-93fd6ab1-7cdc-4c06-95cd-c29fa12596ac tempest-SecurityGroupRulesNegativeTestJSON-748897975 tempest-SecurityGroupRulesNegativeTestJSON-748897975-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.159423 Oct 04 18:45:09.903367 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2032/4116] 10.222.0.20 () {60 vars in 1195 bytes} [Tue Oct 4 18:45:09 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 160 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:45:09.911759 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c89dc2cf-558a-4b09-a94c-1c371161d256 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:09.912536 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c89dc2cf-558a-4b09-a94c-1c371161d256 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: 4d6dfac0-958d-4698-a050-6539caebe52c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:09.936893 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c89dc2cf-558a-4b09-a94c-1c371161d256 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:09.937417 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c89dc2cf-558a-4b09-a94c-1c371161d256 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:09.937837 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c89dc2cf-558a-4b09-a94c-1c371161d256 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:09.941953 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c89dc2cf-558a-4b09-a94c-1c371161d256 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:09.944909 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c89dc2cf-558a-4b09-a94c-1c371161d256 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:09.947864 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c89dc2cf-558a-4b09-a94c-1c371161d256 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:10.034156 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-83faceef-b42f-4ee0-843b-8e632a8180b0 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51" status: 204 len: 0 microversion: 2.1 time: 0.424396 Oct 04 18:45:10.038598 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2085/4117] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:45:09 2022] DELETE /compute/v2.1/servers/c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:45:10.044379 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f3e36977-1ee0-4d3b-b485-8d8b47ee47f4 tempest-SecurityGroupRulesNegativeTestJSON-748897975 tempest-SecurityGroupRulesNegativeTestJSON-748897975-project] Action: 'create', calling method: .version_select at 0x7fe258d20a60>, body: {"security_group_rule": {"parent_group_id": "ed376e57-1a66-45e2-9ec4-1713d2fbb9d0", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:45:10.121005 n-d-850501-14 devstack@n-api.service[123001]: DEBUG neutronclient.v2_0.client [None req-f3e36977-1ee0-4d3b-b485-8d8b47ee47f4 tempest-SecurityGroupRulesNegativeTestJSON-748897975 tempest-SecurityGroupRulesNegativeTestJSON-748897975-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ed376e57-1a66-45e2-9ec4-1713d2fbb9d0 does not exist", "detail": ""}} {{(pid=123001) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:45:10.126240 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.security_group_api [None req-f3e36977-1ee0-4d3b-b485-8d8b47ee47f4 tempest-SecurityGroupRulesNegativeTestJSON-748897975 tempest-SecurityGroupRulesNegativeTestJSON-748897975-project] Neutron security group ed376e57-1a66-45e2-9ec4-1713d2fbb9d0 not found {{(pid=123001) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 18:45:10.127675 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-f3e36977-1ee0-4d3b-b485-8d8b47ee47f4 tempest-SecurityGroupRulesNegativeTestJSON-748897975 tempest-SecurityGroupRulesNegativeTestJSON-748897975-project] HTTP exception thrown: Security group ed376e57-1a66-45e2-9ec4-1713d2fbb9d0 does not exist Oct 04 18:45:10.127675 n-d-850501-14 devstack@n-api.service[123001]: Neutron server returns request_ids: ['req-5e91a1e3-2589-4915-a05b-f505feaf5b92'] Oct 04 18:45:10.130646 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f3e36977-1ee0-4d3b-b485-8d8b47ee47f4 tempest-SecurityGroupRulesNegativeTestJSON-748897975 tempest-SecurityGroupRulesNegativeTestJSON-748897975-project] Request method failure captured: Oct 04 18:45:10.130646 n-d-850501-14 devstack@n-api.service[123001]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 04 18:45:10.130646 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:45:10.130646 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:45:10.130646 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:45:10.130646 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 138 Oct 04 18:45:10.130646 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:45:10.130646 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:45:10.130646 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:45:10.130646 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:45:10.130646 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPH8rMMcZilhK-hQ2-CZ__JiJW0z-J6pBaF2Ts3X3ngDZdkfXOeJggfTHIAkxWgbtdBIrb9PXlpCkJp51_InNIsMjN_3DOnjJp3hQu-ZozT2ns_owLl7legXSNNTm2bVS3-_Tho0-3RHKt3X4wQbYM0cNhz2SoJMytuq_UZ0fi0xOSP8 Oct 04 18:45:10.130646 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:45:10.130646 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:45:10.130646 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:45:10.130646 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:45:10.130646 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:45:10.130646 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:45:10.130646 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 6364f18579384dd6a58c0adb85fca10c Oct 04 18:45:10.130646 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-748897975 Oct 04 18:45:10.130646 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:45:10.130646 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:45:10.130646 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6364f18579384dd6a58c0adb85fca10c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6364f18579384dd6a58c0adb85fca10c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6364f18579384dd6a58c0adb85fca10c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6364f18579384dd6a58c0adb85fca10c"}]}, {"type": "tempest-ServicesTestJSON-Type-1888557797", "name": "tempest-ServicesTestJSON-Service-1064384932", "endpoints": []}] Oct 04 18:45:10.130646 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-748897975 Oct 04 18:45:10.130646 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 6364f18579384dd6a58c0adb85fca10c Oct 04 18:45:10.130646 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-748897975 Oct 04 18:45:10.130646 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-748897975-project Oct 04 18:45:10.130646 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:45:10.130646 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:45:10.130646 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: af2b22bb26cc4eb4afe3a8e219e1a480 Oct 04 18:45:10.130646 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-748897975-project Oct 04 18:45:10.130646 n-d-850501-14 devstack@n-api.service[123001]: Oct 04 18:45:10.130646 n-d-850501-14 devstack@n-api.service[123001]: {"security_group_rule": {"parent_group_id": "ed376e57-1a66-45e2-9ec4-1713d2fbb9d0", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 04 18:45:10.130646 n-d-850501-14 devstack@n-api.service[123001]: method: Oct 04 18:45:10.130646 n-d-850501-14 devstack@n-api.service[123001]: exception: Security group ed376e57-1a66-45e2-9ec4-1713d2fbb9d0 does not exist Oct 04 18:45:10.130646 n-d-850501-14 devstack@n-api.service[123001]: Neutron server returns request_ids: ['req-5e91a1e3-2589-4915-a05b-f505feaf5b92'] Oct 04 18:45:10.130646 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'ed376e57-1a66-45e2-9ec4-1713d2fbb9d0', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 04 18:45:10.130646 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:45:10.130646 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:10.130646 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 18:45:10.130646 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 18:45:10.130646 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:45:10.130646 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:45:10.130646 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 18:45:10.130646 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 18:45:10.130646 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:45:10.130646 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:45:10.130646 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:45:10.130646 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 18:45:10.130646 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:45:10.130646 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:45:10.130646 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:45:10.130646 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:45:10.130646 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:45:10.130646 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:45:10.130646 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:45:10.130646 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:45:10.130646 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:45:10.130646 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:45:10.130646 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:45:10.130646 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:45:10.135763 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:45:10.135763 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:45:10.135763 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group ed376e57-1a66-45e2-9ec4-1713d2fbb9d0 does not exist Oct 04 18:45:10.135763 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5e91a1e3-2589-4915-a05b-f505feaf5b92'] Oct 04 18:45:10.135763 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:45:10.135763 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:10.135763 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:45:10.135763 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:10.135763 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Oct 04 18:45:10.135763 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Oct 04 18:45:10.135763 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 18:45:10.135763 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 18:45:10.135763 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group ed376e57-1a66-45e2-9ec4-1713d2fbb9d0 does not exist Oct 04 18:45:10.135763 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5e91a1e3-2589-4915-a05b-f505feaf5b92'] Oct 04 18:45:10.135763 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:45:10.135763 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:10.135763 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:45:10.135763 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:10.135763 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:45:10.135763 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:45:10.135763 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:45:10.135763 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:45:10.135763 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:45:10.135763 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:45:10.135763 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:45:10.135763 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:45:10.135763 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Oct 04 18:45:10.135763 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 18:45:10.135763 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group ed376e57-1a66-45e2-9ec4-1713d2fbb9d0 does not exist Oct 04 18:45:10.135763 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5e91a1e3-2589-4915-a05b-f505feaf5b92'] Oct 04 18:45:10.135763 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:45:10.135763 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:10.135763 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:45:10.135763 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:10.135763 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:45:10.135763 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:45:10.135763 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:45:10.135763 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:45:10.135763 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group ed376e57-1a66-45e2-9ec4-1713d2fbb9d0 does not exist Oct 04 18:45:10.135763 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5e91a1e3-2589-4915-a05b-f505feaf5b92'] Oct 04 18:45:10.135763 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:45:10.150382 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f3e36977-1ee0-4d3b-b485-8d8b47ee47f4 tempest-SecurityGroupRulesNegativeTestJSON-748897975 tempest-SecurityGroupRulesNegativeTestJSON-748897975-project] Returning 404 to user: Security group ed376e57-1a66-45e2-9ec4-1713d2fbb9d0 does not exist Oct 04 18:45:10.150382 n-d-850501-14 devstack@n-api.service[123001]: Neutron server returns request_ids: ['req-5e91a1e3-2589-4915-a05b-f505feaf5b92'] {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:45:10.167313 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f3e36977-1ee0-4d3b-b485-8d8b47ee47f4 tempest-SecurityGroupRulesNegativeTestJSON-748897975 tempest-SecurityGroupRulesNegativeTestJSON-748897975-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.115323 Oct 04 18:45:10.168162 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2086/4118] 10.222.0.20 () {60 vars in 1195 bytes} [Tue Oct 4 18:45:10 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:45:10.175665 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-153f97cd-08ad-4be4-a467-e0189a5a574f tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:10.178948 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-153f97cd-08ad-4be4-a467-e0189a5a574f tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] [instance: 3d3cabc2-fa23-4098-9197-9aaa19a0c663] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:10.188703 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-153f97cd-08ad-4be4-a467-e0189a5a574f tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:10.189620 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-153f97cd-08ad-4be4-a467-e0189a5a574f tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:10.190382 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-153f97cd-08ad-4be4-a467-e0189a5a574f tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:10.191981 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-153f97cd-08ad-4be4-a467-e0189a5a574f tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:10.192823 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-153f97cd-08ad-4be4-a467-e0189a5a574f tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:10.193486 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-153f97cd-08ad-4be4-a467-e0189a5a574f tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:10.296714 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-153f97cd-08ad-4be4-a467-e0189a5a574f tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:10.308474 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-153f97cd-08ad-4be4-a467-e0189a5a574f tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:10.312006 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-153f97cd-08ad-4be4-a467-e0189a5a574f tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:10.313609 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-153f97cd-08ad-4be4-a467-e0189a5a574f tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] 10.222.0.20 "GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663" status: 200 len: 1604 microversion: 2.42 time: 0.143695 Oct 04 18:45:10.315037 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2087/4119] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:45:10 2022] GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663 => generated 1604 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:45:10.321911 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b6e1928a-9c19-4e4c-b720-e8a6d9fec30c tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:10.322591 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b6e1928a-9c19-4e4c-b720-e8a6d9fec30c tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:10.330725 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b6e1928a-9c19-4e4c-b720-e8a6d9fec30c tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:10.330985 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c89dc2cf-558a-4b09-a94c-1c371161d256 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:10.332003 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b6e1928a-9c19-4e4c-b720-e8a6d9fec30c tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:10.332692 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b6e1928a-9c19-4e4c-b720-e8a6d9fec30c tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:10.333686 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b6e1928a-9c19-4e4c-b720-e8a6d9fec30c tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:10.334351 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b6e1928a-9c19-4e4c-b720-e8a6d9fec30c tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:10.334975 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b6e1928a-9c19-4e4c-b720-e8a6d9fec30c tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:10.353285 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c89dc2cf-558a-4b09-a94c-1c371161d256 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c" status: 200 len: 1733 microversion: 2.1 time: 0.457181 Oct 04 18:45:10.354584 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2033/4120] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:09 2022] GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c => generated 1733 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:10.361296 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0e5c1dfa-ee48-4a11-b0b6-04d9838db321 tempest-SecurityGroupRulesNegativeTestJSON-748897975 tempest-SecurityGroupRulesNegativeTestJSON-748897975-project] Calling method '.version_select at 0x7fe25d107670>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:10.393021 n-d-850501-14 devstack@n-api.service[123002]: DEBUG neutronclient.v2_0.client [None req-0e5c1dfa-ee48-4a11-b0b6-04d9838db321 tempest-SecurityGroupRulesNegativeTestJSON-748897975 tempest-SecurityGroupRulesNegativeTestJSON-748897975-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule d22f5ffa-053f-4fc0-abd8-a209a5dafa7d does not exist", "detail": ""}} {{(pid=123002) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:45:10.393961 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.security_group_api [None req-0e5c1dfa-ee48-4a11-b0b6-04d9838db321 tempest-SecurityGroupRulesNegativeTestJSON-748897975 tempest-SecurityGroupRulesNegativeTestJSON-748897975-project] Neutron security group rule d22f5ffa-053f-4fc0-abd8-a209a5dafa7d not found {{(pid=123002) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Oct 04 18:45:10.396016 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-0e5c1dfa-ee48-4a11-b0b6-04d9838db321 tempest-SecurityGroupRulesNegativeTestJSON-748897975 tempest-SecurityGroupRulesNegativeTestJSON-748897975-project] HTTP exception thrown: Security group rule d22f5ffa-053f-4fc0-abd8-a209a5dafa7d does not exist Oct 04 18:45:10.396016 n-d-850501-14 devstack@n-api.service[123002]: Neutron server returns request_ids: ['req-bf9cb2f0-ab51-4bbb-87bf-ea4d16bfb41a'] Oct 04 18:45:10.401202 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0e5c1dfa-ee48-4a11-b0b6-04d9838db321 tempest-SecurityGroupRulesNegativeTestJSON-748897975 tempest-SecurityGroupRulesNegativeTestJSON-748897975-project] Request method failure captured: Oct 04 18:45:10.401202 n-d-850501-14 devstack@n-api.service[123002]: request: DELETE /compute/v2.1/os-security-group-rules/d22f5ffa-053f-4fc0-abd8-a209a5dafa7d HTTP/1.1 Oct 04 18:45:10.401202 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:45:10.401202 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:45:10.401202 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:45:10.401202 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:45:10.401202 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:45:10.401202 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:45:10.401202 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:45:10.401202 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:45:10.401202 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH8rMMcZilhK-hQ2-CZ__JiJW0z-J6pBaF2Ts3X3ngDZdkfXOeJggfTHIAkxWgbtdBIrb9PXlpCkJp51_InNIsMjN_3DOnjJp3hQu-ZozT2ns_owLl7legXSNNTm2bVS3-_Tho0-3RHKt3X4wQbYM0cNhz2SoJMytuq_UZ0fi0xOSP8 Oct 04 18:45:10.401202 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:45:10.401202 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:45:10.401202 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:45:10.401202 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:45:10.401202 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:45:10.401202 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:45:10.401202 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 6364f18579384dd6a58c0adb85fca10c Oct 04 18:45:10.401202 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-748897975 Oct 04 18:45:10.401202 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:45:10.401202 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:45:10.401202 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6364f18579384dd6a58c0adb85fca10c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6364f18579384dd6a58c0adb85fca10c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6364f18579384dd6a58c0adb85fca10c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6364f18579384dd6a58c0adb85fca10c"}]}, {"type": "tempest-ServicesTestJSON-Type-1888557797", "name": "tempest-ServicesTestJSON-Service-1064384932", "endpoints": []}] Oct 04 18:45:10.401202 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-748897975 Oct 04 18:45:10.401202 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 6364f18579384dd6a58c0adb85fca10c Oct 04 18:45:10.401202 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-748897975 Oct 04 18:45:10.401202 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-748897975-project Oct 04 18:45:10.401202 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:45:10.401202 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:45:10.401202 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: af2b22bb26cc4eb4afe3a8e219e1a480 Oct 04 18:45:10.401202 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-748897975-project Oct 04 18:45:10.401202 n-d-850501-14 devstack@n-api.service[123002]: method: Oct 04 18:45:10.401202 n-d-850501-14 devstack@n-api.service[123002]: exception: Security group rule d22f5ffa-053f-4fc0-abd8-a209a5dafa7d does not exist Oct 04 18:45:10.401202 n-d-850501-14 devstack@n-api.service[123002]: Neutron server returns request_ids: ['req-bf9cb2f0-ab51-4bbb-87bf-ea4d16bfb41a'] Oct 04 18:45:10.401202 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'd22f5ffa-053f-4fc0-abd8-a209a5dafa7d'} Oct 04 18:45:10.401202 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:45:10.401202 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:10.401202 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Oct 04 18:45:10.401202 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Oct 04 18:45:10.401202 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:45:10.401202 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:45:10.401202 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Oct 04 18:45:10.401202 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Oct 04 18:45:10.401202 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:45:10.401202 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:45:10.401202 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:45:10.401202 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 18:45:10.401202 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:45:10.401202 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:45:10.401202 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:45:10.401202 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:45:10.401202 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:45:10.401202 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:45:10.401202 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:45:10.401202 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:45:10.401202 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:45:10.401202 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:45:10.401202 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:45:10.401202 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:45:10.401202 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:45:10.401202 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:45:10.411381 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule d22f5ffa-053f-4fc0-abd8-a209a5dafa7d does not exist Oct 04 18:45:10.411381 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bf9cb2f0-ab51-4bbb-87bf-ea4d16bfb41a'] Oct 04 18:45:10.411381 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:45:10.411381 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:10.411381 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:45:10.411381 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:10.411381 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Oct 04 18:45:10.411381 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Oct 04 18:45:10.411381 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Oct 04 18:45:10.411381 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 18:45:10.411381 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule d22f5ffa-053f-4fc0-abd8-a209a5dafa7d does not exist Oct 04 18:45:10.411381 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bf9cb2f0-ab51-4bbb-87bf-ea4d16bfb41a'] Oct 04 18:45:10.411381 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:45:10.411381 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:10.411381 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:45:10.411381 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:10.411381 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:45:10.411381 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:45:10.411381 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:45:10.411381 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:45:10.411381 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:45:10.411381 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:45:10.411381 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:45:10.411381 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:45:10.411381 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Oct 04 18:45:10.411381 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 18:45:10.411381 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule d22f5ffa-053f-4fc0-abd8-a209a5dafa7d does not exist Oct 04 18:45:10.411381 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bf9cb2f0-ab51-4bbb-87bf-ea4d16bfb41a'] Oct 04 18:45:10.411381 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:45:10.411381 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:10.411381 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:45:10.411381 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:10.411381 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:45:10.411381 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:45:10.411381 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:45:10.411381 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:45:10.411381 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule d22f5ffa-053f-4fc0-abd8-a209a5dafa7d does not exist Oct 04 18:45:10.411381 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bf9cb2f0-ab51-4bbb-87bf-ea4d16bfb41a'] Oct 04 18:45:10.411381 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:45:10.411381 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0e5c1dfa-ee48-4a11-b0b6-04d9838db321 tempest-SecurityGroupRulesNegativeTestJSON-748897975 tempest-SecurityGroupRulesNegativeTestJSON-748897975-project] Returning 404 to user: Security group rule d22f5ffa-053f-4fc0-abd8-a209a5dafa7d does not exist Oct 04 18:45:10.411381 n-d-850501-14 devstack@n-api.service[123002]: Neutron server returns request_ids: ['req-bf9cb2f0-ab51-4bbb-87bf-ea4d16bfb41a'] {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:45:10.411381 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0e5c1dfa-ee48-4a11-b0b6-04d9838db321 tempest-SecurityGroupRulesNegativeTestJSON-748897975 tempest-SecurityGroupRulesNegativeTestJSON-748897975-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-group-rules/d22f5ffa-053f-4fc0-abd8-a209a5dafa7d" status: 404 len: 199 microversion: 2.1 time: 0.048319 Oct 04 18:45:10.411381 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2034/4121] 10.222.0.20 () {58 vars in 1287 bytes} [Tue Oct 4 18:45:10 2022] DELETE /compute/v2.1/os-security-group-rules/d22f5ffa-053f-4fc0-abd8-a209a5dafa7d => generated 199 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:45:10.417505 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b2f055ff-a03f-47f8-9b59-00b250d3d4cb tempest-SecurityGroupRulesNegativeTestJSON-748897975 tempest-SecurityGroupRulesNegativeTestJSON-748897975-project] Calling method '.version_select at 0x7fe2582f1160>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:10.450326 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:10.513148 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=6 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:10.625860 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b6e1928a-9c19-4e4c-b720-e8a6d9fec30c tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:10.634083 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b6e1928a-9c19-4e4c-b720-e8a6d9fec30c tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51" status: 200 len: 1492 microversion: 2.1 time: 0.317529 Oct 04 18:45:10.635281 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2088/4122] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:10 2022] GET /compute/v2.1/servers/c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51 => generated 1492 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:10.757802 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1c12f124-889a-4182-8c9b-0defcdfa9139 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:10.758841 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1c12f124-889a-4182-8c9b-0defcdfa9139 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] [instance: d46bd79f-eda9-4149-b4aa-788520147af7] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:10.768834 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1c12f124-889a-4182-8c9b-0defcdfa9139 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:10.769475 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1c12f124-889a-4182-8c9b-0defcdfa9139 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:10.770558 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1c12f124-889a-4182-8c9b-0defcdfa9139 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:10.771279 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1c12f124-889a-4182-8c9b-0defcdfa9139 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:10.771900 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1c12f124-889a-4182-8c9b-0defcdfa9139 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:10.772360 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1c12f124-889a-4182-8c9b-0defcdfa9139 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:10.856189 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b2f055ff-a03f-47f8-9b59-00b250d3d4cb tempest-SecurityGroupRulesNegativeTestJSON-748897975 tempest-SecurityGroupRulesNegativeTestJSON-748897975-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/7715ecd1-e995-4ec7-967e-ce55f6f5f051" status: 202 len: 0 microversion: 2.1 time: 0.444705 Oct 04 18:45:10.857249 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2035/4123] 10.222.0.20 () {58 vars in 1272 bytes} [Tue Oct 4 18:45:10 2022] DELETE /compute/v2.1/os-security-groups/7715ecd1-e995-4ec7-967e-ce55f6f5f051 => generated 0 bytes in 446 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:45:10.865082 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9a025111-d3a4-4aa8-8187-6999fb2fa3af tempest-SecurityGroupRulesNegativeTestJSON-748897975 tempest-SecurityGroupRulesNegativeTestJSON-748897975-project] Calling method '.version_select at 0x7fe253dd40d0>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:11.018349 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1c12f124-889a-4182-8c9b-0defcdfa9139 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a02cd1108b947b186202f6d15e6cf0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c0b095138354810949093e7ea03b8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:11.022148 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:11.030602 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1c12f124-889a-4182-8c9b-0defcdfa9139 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] 10.222.0.20 "GET /compute/v2.1/servers/d46bd79f-eda9-4149-b4aa-788520147af7" status: 200 len: 1316 microversion: 2.1 time: 0.276650 Oct 04 18:45:11.043521 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2089/4124] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:10 2022] GET /compute/v2.1/servers/d46bd79f-eda9-4149-b4aa-788520147af7 => generated 1316 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:45:11.352810 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-520740f5-23e4-40a2-8ee9-da0d0959fb4f tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:11.352810 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-520740f5-23e4-40a2-8ee9-da0d0959fb4f tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] [instance: 3d3cabc2-fa23-4098-9197-9aaa19a0c663] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:11.353040 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9a025111-d3a4-4aa8-8187-6999fb2fa3af tempest-SecurityGroupRulesNegativeTestJSON-748897975 tempest-SecurityGroupRulesNegativeTestJSON-748897975-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/904c9235-b5b4-49b6-b75c-e72bee2a05d1" status: 202 len: 0 microversion: 2.1 time: 0.489635 Oct 04 18:45:11.355121 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2036/4125] 10.222.0.20 () {58 vars in 1272 bytes} [Tue Oct 4 18:45:10 2022] DELETE /compute/v2.1/os-security-groups/904c9235-b5b4-49b6-b75c-e72bee2a05d1 => generated 0 bytes in 494 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:45:11.358899 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-520740f5-23e4-40a2-8ee9-da0d0959fb4f tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:11.359405 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-520740f5-23e4-40a2-8ee9-da0d0959fb4f tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:11.359851 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-520740f5-23e4-40a2-8ee9-da0d0959fb4f tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:11.360598 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-520740f5-23e4-40a2-8ee9-da0d0959fb4f tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:11.363206 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a4428b60-67c6-4ac4-9730-4fa378609127 tempest-SecurityGroupRulesNegativeTestJSON-748897975 tempest-SecurityGroupRulesNegativeTestJSON-748897975-project] Calling method '.version_select at 0x7fe25836f0d0>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:11.363684 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-520740f5-23e4-40a2-8ee9-da0d0959fb4f tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:11.363792 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-520740f5-23e4-40a2-8ee9-da0d0959fb4f tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:11.449034 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:11.522033 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-520740f5-23e4-40a2-8ee9-da0d0959fb4f tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:11.536837 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-520740f5-23e4-40a2-8ee9-da0d0959fb4f tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:11.538546 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-520740f5-23e4-40a2-8ee9-da0d0959fb4f tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:11.541395 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-520740f5-23e4-40a2-8ee9-da0d0959fb4f tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] 10.222.0.20 "GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663" status: 200 len: 1604 microversion: 2.42 time: 0.200238 Oct 04 18:45:11.542409 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2090/4126] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:45:11 2022] GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663 => generated 1604 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:45:11.549979 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2cfeefec-f06d-4af4-a77e-3a0d29747d1c tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:11.550956 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2cfeefec-f06d-4af4-a77e-3a0d29747d1c tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: 4d6dfac0-958d-4698-a050-6539caebe52c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:11.559767 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2cfeefec-f06d-4af4-a77e-3a0d29747d1c tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:11.560770 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2cfeefec-f06d-4af4-a77e-3a0d29747d1c tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:11.561662 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2cfeefec-f06d-4af4-a77e-3a0d29747d1c tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:11.562535 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2cfeefec-f06d-4af4-a77e-3a0d29747d1c tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:11.563136 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2cfeefec-f06d-4af4-a77e-3a0d29747d1c tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:11.563849 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2cfeefec-f06d-4af4-a77e-3a0d29747d1c tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:11.772376 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-2cfeefec-f06d-4af4-a77e-3a0d29747d1c tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:11.779855 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2cfeefec-f06d-4af4-a77e-3a0d29747d1c tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c" status: 200 len: 1733 microversion: 2.1 time: 0.234201 Oct 04 18:45:11.780704 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2091/4127] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:11 2022] GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c => generated 1733 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:11.785369 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-781dfbfa-1c4e-4b56-a7f9-bd03216ae7dc tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:11.786230 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-781dfbfa-1c4e-4b56-a7f9-bd03216ae7dc tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:11.792630 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-781dfbfa-1c4e-4b56-a7f9-bd03216ae7dc tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:11.793456 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-781dfbfa-1c4e-4b56-a7f9-bd03216ae7dc tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:11.795018 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-781dfbfa-1c4e-4b56-a7f9-bd03216ae7dc tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:11.795975 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-781dfbfa-1c4e-4b56-a7f9-bd03216ae7dc tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:11.796728 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-781dfbfa-1c4e-4b56-a7f9-bd03216ae7dc tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:11.797163 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-781dfbfa-1c4e-4b56-a7f9-bd03216ae7dc tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:11.851148 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a4428b60-67c6-4ac4-9730-4fa378609127 tempest-SecurityGroupRulesNegativeTestJSON-748897975 tempest-SecurityGroupRulesNegativeTestJSON-748897975-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/750b0536-d753-4eb7-b65a-709de14c9987" status: 202 len: 0 microversion: 2.1 time: 0.492847 Oct 04 18:45:11.852585 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2037/4128] 10.222.0.20 () {58 vars in 1272 bytes} [Tue Oct 4 18:45:11 2022] DELETE /compute/v2.1/os-security-groups/750b0536-d753-4eb7-b65a-709de14c9987 => generated 0 bytes in 497 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:45:11.867909 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2a234690-0c78-4473-95ee-33f4aadf5c76 tempest-SecurityGroupRulesNegativeTestJSON-748897975 tempest-SecurityGroupRulesNegativeTestJSON-748897975-project] Calling method '.version_select at 0x7fe258b7ac10>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:12.026234 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-781dfbfa-1c4e-4b56-a7f9-bd03216ae7dc tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:12.039401 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-781dfbfa-1c4e-4b56-a7f9-bd03216ae7dc tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51" status: 200 len: 1492 microversion: 2.1 time: 0.257034 Oct 04 18:45:12.040244 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2092/4129] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:11 2022] GET /compute/v2.1/servers/c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51 => generated 1492 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:12.054609 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-346b3f1c-2d29-48bd-aba5-e1554b9913aa tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:12.055720 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-346b3f1c-2d29-48bd-aba5-e1554b9913aa tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] [instance: d46bd79f-eda9-4149-b4aa-788520147af7] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:12.063709 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-346b3f1c-2d29-48bd-aba5-e1554b9913aa tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:12.064718 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-346b3f1c-2d29-48bd-aba5-e1554b9913aa tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:12.065168 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-346b3f1c-2d29-48bd-aba5-e1554b9913aa tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:12.066038 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-346b3f1c-2d29-48bd-aba5-e1554b9913aa tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:12.067138 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-346b3f1c-2d29-48bd-aba5-e1554b9913aa tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:12.067760 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-346b3f1c-2d29-48bd-aba5-e1554b9913aa tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:12.243994 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2a234690-0c78-4473-95ee-33f4aadf5c76 tempest-SecurityGroupRulesNegativeTestJSON-748897975 tempest-SecurityGroupRulesNegativeTestJSON-748897975-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/e09e1602-8545-49db-85b9-480963a1c719" status: 202 len: 0 microversion: 2.1 time: 0.387738 Oct 04 18:45:12.244621 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2038/4130] 10.222.0.20 () {58 vars in 1272 bytes} [Tue Oct 4 18:45:11 2022] DELETE /compute/v2.1/os-security-groups/e09e1602-8545-49db-85b9-480963a1c719 => generated 0 bytes in 389 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:45:12.255181 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-77d35cde-75e1-480e-b092-840c04242112 tempest-SecurityGroupRulesNegativeTestJSON-748897975 tempest-SecurityGroupRulesNegativeTestJSON-748897975-project] Calling method '.version_select at 0x7fe259708a60>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:12.386158 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-346b3f1c-2d29-48bd-aba5-e1554b9913aa tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a02cd1108b947b186202f6d15e6cf0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c0b095138354810949093e7ea03b8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:12.403569 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-346b3f1c-2d29-48bd-aba5-e1554b9913aa tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] 10.222.0.20 "GET /compute/v2.1/servers/d46bd79f-eda9-4149-b4aa-788520147af7" status: 200 len: 1316 microversion: 2.1 time: 0.352269 Oct 04 18:45:12.405292 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2093/4131] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:12 2022] GET /compute/v2.1/servers/d46bd79f-eda9-4149-b4aa-788520147af7 => generated 1316 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:12.572166 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6a6217a2-1f47-4b96-b7c5-ded4db379b76 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:12.573283 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6a6217a2-1f47-4b96-b7c5-ded4db379b76 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] [instance: 3d3cabc2-fa23-4098-9197-9aaa19a0c663] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:12.583429 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6a6217a2-1f47-4b96-b7c5-ded4db379b76 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:12.584971 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6a6217a2-1f47-4b96-b7c5-ded4db379b76 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:12.586095 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6a6217a2-1f47-4b96-b7c5-ded4db379b76 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:12.587723 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6a6217a2-1f47-4b96-b7c5-ded4db379b76 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:12.588571 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6a6217a2-1f47-4b96-b7c5-ded4db379b76 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:12.589833 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6a6217a2-1f47-4b96-b7c5-ded4db379b76 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:12.699179 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6a6217a2-1f47-4b96-b7c5-ded4db379b76 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:12.710590 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6a6217a2-1f47-4b96-b7c5-ded4db379b76 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:12.717410 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6a6217a2-1f47-4b96-b7c5-ded4db379b76 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:12.721805 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6a6217a2-1f47-4b96-b7c5-ded4db379b76 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] 10.222.0.20 "GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663" status: 200 len: 1604 microversion: 2.42 time: 0.153197 Oct 04 18:45:12.726520 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2094/4132] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:45:12 2022] GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663 => generated 1604 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:45:12.805222 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-cd3dd76b-d34f-468b-80bf-11690ff9c250 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:12.805994 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-cd3dd76b-d34f-468b-80bf-11690ff9c250 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: 4d6dfac0-958d-4698-a050-6539caebe52c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:12.815987 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cd3dd76b-d34f-468b-80bf-11690ff9c250 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:12.817528 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cd3dd76b-d34f-468b-80bf-11690ff9c250 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:12.818804 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cd3dd76b-d34f-468b-80bf-11690ff9c250 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:12.819546 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cd3dd76b-d34f-468b-80bf-11690ff9c250 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:12.822922 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cd3dd76b-d34f-468b-80bf-11690ff9c250 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:12.822922 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cd3dd76b-d34f-468b-80bf-11690ff9c250 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:12.870701 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-77d35cde-75e1-480e-b092-840c04242112 tempest-SecurityGroupRulesNegativeTestJSON-748897975 tempest-SecurityGroupRulesNegativeTestJSON-748897975-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/2889963d-43ad-4218-9392-52d7c11b6902" status: 202 len: 0 microversion: 2.1 time: 0.620634 Oct 04 18:45:12.871286 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2039/4133] 10.222.0.20 () {58 vars in 1272 bytes} [Tue Oct 4 18:45:12 2022] DELETE /compute/v2.1/os-security-groups/2889963d-43ad-4218-9392-52d7c11b6902 => generated 0 bytes in 622 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:45:13.027002 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-cd3dd76b-d34f-468b-80bf-11690ff9c250 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:13.048397 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-cd3dd76b-d34f-468b-80bf-11690ff9c250 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c" status: 200 len: 1733 microversion: 2.1 time: 0.247620 Oct 04 18:45:13.049067 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2095/4134] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:12 2022] GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c => generated 1733 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:45:13.078719 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d23f116e-c7b0-4ee2-a949-509a882a6291 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:13.082171 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d23f116e-c7b0-4ee2-a949-509a882a6291 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:13.120860 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d23f116e-c7b0-4ee2-a949-509a882a6291 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:13.124112 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d23f116e-c7b0-4ee2-a949-509a882a6291 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:13.127018 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d23f116e-c7b0-4ee2-a949-509a882a6291 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:13.128083 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d23f116e-c7b0-4ee2-a949-509a882a6291 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:13.128840 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d23f116e-c7b0-4ee2-a949-509a882a6291 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:13.129820 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d23f116e-c7b0-4ee2-a949-509a882a6291 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:13.261335 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d23f116e-c7b0-4ee2-a949-509a882a6291 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:13.288413 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d23f116e-c7b0-4ee2-a949-509a882a6291 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51" status: 200 len: 1450 microversion: 2.1 time: 0.218683 Oct 04 18:45:13.291816 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2040/4135] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:13 2022] GET /compute/v2.1/servers/c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51 => generated 1450 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:13.340918 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-92182691-7605-4818-a646-8ded55b4ca90 req-9bdd30d6-a1ce-4577-85e8-c5d991077b7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51", "name": "network-vif-deleted", "tag": "ba761f8a-a7dc-4031-8338-91b1b35f26e2"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:45:13.386439 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-92182691-7605-4818-a646-8ded55b4ca90 req-9bdd30d6-a1ce-4577-85e8-c5d991077b7d service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:13.387748 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-92182691-7605-4818-a646-8ded55b4ca90 req-9bdd30d6-a1ce-4577-85e8-c5d991077b7d service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:13.388452 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-92182691-7605-4818-a646-8ded55b4ca90 req-9bdd30d6-a1ce-4577-85e8-c5d991077b7d service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:13.413294 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-92182691-7605-4818-a646-8ded55b4ca90 req-9bdd30d6-a1ce-4577-85e8-c5d991077b7d service nova] Creating event network-vif-deleted:ba761f8a-a7dc-4031-8338-91b1b35f26e2 for instance c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51 on n-h1-850501-14 Oct 04 18:45:13.422717 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-92182691-7605-4818-a646-8ded55b4ca90 req-9bdd30d6-a1ce-4577-85e8-c5d991077b7d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100375 Oct 04 18:45:13.435927 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-45005535-cb0d-4c9e-8b24-2627188e2950 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:13.437349 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-45005535-cb0d-4c9e-8b24-2627188e2950 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] [instance: d46bd79f-eda9-4149-b4aa-788520147af7] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:13.440630 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2096/4136] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:45:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:45:13.447886 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-45005535-cb0d-4c9e-8b24-2627188e2950 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:13.448792 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-45005535-cb0d-4c9e-8b24-2627188e2950 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:13.449447 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-45005535-cb0d-4c9e-8b24-2627188e2950 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:13.450382 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-45005535-cb0d-4c9e-8b24-2627188e2950 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:13.451034 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-45005535-cb0d-4c9e-8b24-2627188e2950 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:13.451629 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-45005535-cb0d-4c9e-8b24-2627188e2950 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:13.728804 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-45005535-cb0d-4c9e-8b24-2627188e2950 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a02cd1108b947b186202f6d15e6cf0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c0b095138354810949093e7ea03b8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:13.754019 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-45005535-cb0d-4c9e-8b24-2627188e2950 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] 10.222.0.20 "GET /compute/v2.1/servers/d46bd79f-eda9-4149-b4aa-788520147af7" status: 200 len: 1316 microversion: 2.1 time: 0.328623 Oct 04 18:45:13.757274 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-435b61c7-34d9-4da1-8dd7-9597fab8830d tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:13.757274 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-435b61c7-34d9-4da1-8dd7-9597fab8830d tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] [instance: 3d3cabc2-fa23-4098-9197-9aaa19a0c663] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:13.759310 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2041/4137] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:13 2022] GET /compute/v2.1/servers/d46bd79f-eda9-4149-b4aa-788520147af7 => generated 1316 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:45:13.766878 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-435b61c7-34d9-4da1-8dd7-9597fab8830d tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:13.771752 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-435b61c7-34d9-4da1-8dd7-9597fab8830d tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:13.772240 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-435b61c7-34d9-4da1-8dd7-9597fab8830d tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:13.774446 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-435b61c7-34d9-4da1-8dd7-9597fab8830d tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:13.779471 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-435b61c7-34d9-4da1-8dd7-9597fab8830d tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:13.786048 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-435b61c7-34d9-4da1-8dd7-9597fab8830d tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:13.946612 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-435b61c7-34d9-4da1-8dd7-9597fab8830d tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:13.962249 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-435b61c7-34d9-4da1-8dd7-9597fab8830d tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:13.964047 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-435b61c7-34d9-4da1-8dd7-9597fab8830d tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:13.965795 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-435b61c7-34d9-4da1-8dd7-9597fab8830d tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] 10.222.0.20 "GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663" status: 200 len: 1604 microversion: 2.42 time: 0.216351 Oct 04 18:45:13.981340 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2097/4138] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:45:13 2022] GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663 => generated 1604 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:45:14.072862 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3c674f55-9032-43ee-aeb9-3607583d22f6 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:14.077663 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-582039a8-688b-44e8-8f53-fc8876132f17 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:14.078604 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-582039a8-688b-44e8-8f53-fc8876132f17 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: 4d6dfac0-958d-4698-a050-6539caebe52c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:14.080570 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3c674f55-9032-43ee-aeb9-3607583d22f6 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e54eaa927e2848869093e0ec11904929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a4914508df43b0afac3ffdf3b85b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:14.081494 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3c674f55-9032-43ee-aeb9-3607583d22f6 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Searching by: {'deleted': False, 'project_id': 'e9a4914508df43b0afac3ffdf3b85b36'} {{(pid=123002) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:45:14.087455 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-582039a8-688b-44e8-8f53-fc8876132f17 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:14.094274 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-582039a8-688b-44e8-8f53-fc8876132f17 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:14.094530 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:14.098036 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-582039a8-688b-44e8-8f53-fc8876132f17 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:14.101435 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-582039a8-688b-44e8-8f53-fc8876132f17 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:14.101435 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-582039a8-688b-44e8-8f53-fc8876132f17 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:14.101435 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-582039a8-688b-44e8-8f53-fc8876132f17 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:14.101783 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3c674f55-9032-43ee-aeb9-3607583d22f6 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:14.101783 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3c674f55-9032-43ee-aeb9-3607583d22f6 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:14.102196 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3c674f55-9032-43ee-aeb9-3607583d22f6 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:14.103288 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3c674f55-9032-43ee-aeb9-3607583d22f6 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:14.105113 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3c674f55-9032-43ee-aeb9-3607583d22f6 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:14.106386 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3c674f55-9032-43ee-aeb9-3607583d22f6 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:14.169980 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.multi_cell_list [None req-3c674f55-9032-43ee-aeb9-3607583d22f6 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123002) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:45:14.227912 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3c674f55-9032-43ee-aeb9-3607583d22f6 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 339 microversion: 2.1 time: 0.158868 Oct 04 18:45:14.230652 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2042/4139] 10.222.0.20 () {58 vars in 1125 bytes} [Tue Oct 4 18:45:14 2022] GET /compute/v2.1/servers => generated 339 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:45:14.253128 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-926a071f-3893-4b4c-b4ee-6352eac0cd49 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:14.260506 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-926a071f-3893-4b4c-b4ee-6352eac0cd49 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e54eaa927e2848869093e0ec11904929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a4914508df43b0afac3ffdf3b85b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:14.262935 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-926a071f-3893-4b4c-b4ee-6352eac0cd49 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Searching by: {'deleted': False, 'project_id': 'e9a4914508df43b0afac3ffdf3b85b36'} {{(pid=123002) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:45:14.276354 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-926a071f-3893-4b4c-b4ee-6352eac0cd49 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:14.278933 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-926a071f-3893-4b4c-b4ee-6352eac0cd49 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:14.278933 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-926a071f-3893-4b4c-b4ee-6352eac0cd49 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:14.279428 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-926a071f-3893-4b4c-b4ee-6352eac0cd49 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:14.280218 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-926a071f-3893-4b4c-b4ee-6352eac0cd49 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:14.280831 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-926a071f-3893-4b4c-b4ee-6352eac0cd49 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:14.334523 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.multi_cell_list [None req-926a071f-3893-4b4c-b4ee-6352eac0cd49 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123002) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:45:14.380634 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:14.430855 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-926a071f-3893-4b4c-b4ee-6352eac0cd49 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e54eaa927e2848869093e0ec11904929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a4914508df43b0afac3ffdf3b85b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:14.448502 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-926a071f-3893-4b4c-b4ee-6352eac0cd49 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:14.449412 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-926a071f-3893-4b4c-b4ee-6352eac0cd49 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:14.450667 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-926a071f-3893-4b4c-b4ee-6352eac0cd49 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:14.467390 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-582039a8-688b-44e8-8f53-fc8876132f17 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:14.476436 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-582039a8-688b-44e8-8f53-fc8876132f17 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c" status: 200 len: 1733 microversion: 2.1 time: 0.403630 Oct 04 18:45:14.509417 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2098/4140] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:14 2022] GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c => generated 1733 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:14.520859 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-04c62bd9-8f26-4807-b09f-0d6c13e8d2b6 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:14.523872 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-04c62bd9-8f26-4807-b09f-0d6c13e8d2b6 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:14.534610 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-04c62bd9-8f26-4807-b09f-0d6c13e8d2b6 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:14.535512 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-04c62bd9-8f26-4807-b09f-0d6c13e8d2b6 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:14.536349 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-04c62bd9-8f26-4807-b09f-0d6c13e8d2b6 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:14.537308 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-04c62bd9-8f26-4807-b09f-0d6c13e8d2b6 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:14.538364 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-04c62bd9-8f26-4807-b09f-0d6c13e8d2b6 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:14.539208 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-04c62bd9-8f26-4807-b09f-0d6c13e8d2b6 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:14.591967 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-04c62bd9-8f26-4807-b09f-0d6c13e8d2b6 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:14.592911 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-04c62bd9-8f26-4807-b09f-0d6c13e8d2b6 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:14.593744 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-04c62bd9-8f26-4807-b09f-0d6c13e8d2b6 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:14.594542 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-04c62bd9-8f26-4807-b09f-0d6c13e8d2b6 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lazy-loading 'fault' on Instance uuid c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:45:14.694955 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-04c62bd9-8f26-4807-b09f-0d6c13e8d2b6 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:14.704539 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-926a071f-3893-4b4c-b4ee-6352eac0cd49 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] 10.222.0.20 "GET /compute/v2.1/servers/detail" status: 200 len: 1709 microversion: 2.1 time: 0.456664 Oct 04 18:45:14.705432 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2043/4141] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Oct 4 18:45:14 2022] GET /compute/v2.1/servers/detail => generated 1709 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:45:14.709970 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-04c62bd9-8f26-4807-b09f-0d6c13e8d2b6 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51" status: 200 len: 1309 microversion: 2.1 time: 0.198890 Oct 04 18:45:14.711024 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2099/4142] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:14 2022] GET /compute/v2.1/servers/c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51 => generated 1309 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:14.737386 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-77664f57-b45a-4aa5-afe2-1ebf785b833c tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:14.749859 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-77664f57-b45a-4aa5-afe2-1ebf785b833c tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018536 Oct 04 18:45:14.751796 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2044/4143] 10.222.0.20 () {58 vars in 1137 bytes} [Tue Oct 4 18:45:14 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:45:14.793160 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-01d19458-4984-4dc6-aac9-36c5a3735c5d tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:14.793843 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-01d19458-4984-4dc6-aac9-36c5a3735c5d tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] [instance: d46bd79f-eda9-4149-b4aa-788520147af7] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:14.806037 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-01d19458-4984-4dc6-aac9-36c5a3735c5d tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:14.806668 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-01d19458-4984-4dc6-aac9-36c5a3735c5d tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:14.807113 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-01d19458-4984-4dc6-aac9-36c5a3735c5d tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:14.807841 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-01d19458-4984-4dc6-aac9-36c5a3735c5d tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:14.808322 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-01d19458-4984-4dc6-aac9-36c5a3735c5d tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:14.808752 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-01d19458-4984-4dc6-aac9-36c5a3735c5d tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:14.940262 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-e1c3dbf2-6075-46ba-9558-d39ee0774770 req-1d5858d8-9958-4abf-9d4a-799c82f19cac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d46bd79f-eda9-4149-b4aa-788520147af7", "name": "network-vif-plugged", "status": "completed", "tag": "85f7dba4-0186-43c3-94c9-1a65ff915600"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:45:14.969732 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-e1c3dbf2-6075-46ba-9558-d39ee0774770 req-1d5858d8-9958-4abf-9d4a-799c82f19cac service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:14.982355 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-e1c3dbf2-6075-46ba-9558-d39ee0774770 req-1d5858d8-9958-4abf-9d4a-799c82f19cac service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:14.982634 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-e1c3dbf2-6075-46ba-9558-d39ee0774770 req-1d5858d8-9958-4abf-9d4a-799c82f19cac service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:15.026636 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-e1c3dbf2-6075-46ba-9558-d39ee0774770 req-1d5858d8-9958-4abf-9d4a-799c82f19cac service nova] Creating event network-vif-plugged:85f7dba4-0186-43c3-94c9-1a65ff915600 for instance d46bd79f-eda9-4149-b4aa-788520147af7 on n-h1-850501-14 Oct 04 18:45:15.033367 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-e1c3dbf2-6075-46ba-9558-d39ee0774770 req-1d5858d8-9958-4abf-9d4a-799c82f19cac service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095338 Oct 04 18:45:15.034010 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2045/4144] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:45:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:45:15.073844 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-01984e28-ed5c-4654-aad5-5179aca16e43 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:15.079282 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-01984e28-ed5c-4654-aad5-5179aca16e43 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] [instance: 3d3cabc2-fa23-4098-9197-9aaa19a0c663] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:15.115687 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-01984e28-ed5c-4654-aad5-5179aca16e43 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:15.119674 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-01984e28-ed5c-4654-aad5-5179aca16e43 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:15.122200 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-01984e28-ed5c-4654-aad5-5179aca16e43 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:15.123152 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-01984e28-ed5c-4654-aad5-5179aca16e43 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:15.125634 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-01984e28-ed5c-4654-aad5-5179aca16e43 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:15.126262 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-01984e28-ed5c-4654-aad5-5179aca16e43 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:15.269880 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-01d19458-4984-4dc6-aac9-36c5a3735c5d tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a02cd1108b947b186202f6d15e6cf0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c0b095138354810949093e7ea03b8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:15.283088 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-01d19458-4984-4dc6-aac9-36c5a3735c5d tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] 10.222.0.20 "GET /compute/v2.1/servers/d46bd79f-eda9-4149-b4aa-788520147af7" status: 200 len: 1316 microversion: 2.1 time: 0.499640 Oct 04 18:45:15.283713 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2100/4145] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:14 2022] GET /compute/v2.1/servers/d46bd79f-eda9-4149-b4aa-788520147af7 => generated 1316 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:15.305913 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8168738c-9275-4450-99a8-d41492ad73c2 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:15.307792 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8168738c-9275-4450-99a8-d41492ad73c2 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] [instance: 0c9b24a2-ed48-4175-89ef-c8b7971acd39] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:15.321228 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8168738c-9275-4450-99a8-d41492ad73c2 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:15.321721 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8168738c-9275-4450-99a8-d41492ad73c2 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:15.326222 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8168738c-9275-4450-99a8-d41492ad73c2 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:15.327097 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8168738c-9275-4450-99a8-d41492ad73c2 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:15.328249 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-01984e28-ed5c-4654-aad5-5179aca16e43 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:15.330450 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8168738c-9275-4450-99a8-d41492ad73c2 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:15.330938 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8168738c-9275-4450-99a8-d41492ad73c2 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:15.344675 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-01984e28-ed5c-4654-aad5-5179aca16e43 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:15.346111 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-01984e28-ed5c-4654-aad5-5179aca16e43 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:15.352863 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-01984e28-ed5c-4654-aad5-5179aca16e43 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] 10.222.0.20 "GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663" status: 200 len: 1604 microversion: 2.42 time: 0.314509 Oct 04 18:45:15.355575 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2046/4146] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:45:15 2022] GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663 => generated 1604 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:45:15.387088 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8168738c-9275-4450-99a8-d41492ad73c2 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] [instance: 0c9b24a2-ed48-4175-89ef-c8b7971acd39] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:45:15.508526 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-960cc7b8-91ab-40b1-8338-a60d5892ccde tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:15.509091 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-960cc7b8-91ab-40b1-8338-a60d5892ccde tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: 4d6dfac0-958d-4698-a050-6539caebe52c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:15.517509 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-960cc7b8-91ab-40b1-8338-a60d5892ccde tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:15.518752 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-960cc7b8-91ab-40b1-8338-a60d5892ccde tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:15.519377 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-960cc7b8-91ab-40b1-8338-a60d5892ccde tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:15.520440 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-960cc7b8-91ab-40b1-8338-a60d5892ccde tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:15.521172 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-960cc7b8-91ab-40b1-8338-a60d5892ccde tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:15.521770 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-960cc7b8-91ab-40b1-8338-a60d5892ccde tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:15.705827 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-960cc7b8-91ab-40b1-8338-a60d5892ccde tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:15.725061 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-960cc7b8-91ab-40b1-8338-a60d5892ccde tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c" status: 200 len: 1713 microversion: 2.1 time: 0.222260 Oct 04 18:45:15.727422 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2047/4147] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:15 2022] GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c => generated 1713 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:45:15.744554 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d008a71e-5e11-4b53-bb04-53798f7cb73d tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:15.745897 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d008a71e-5e11-4b53-bb04-53798f7cb73d tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:15.764463 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d008a71e-5e11-4b53-bb04-53798f7cb73d tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:15.767996 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d008a71e-5e11-4b53-bb04-53798f7cb73d tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:15.768699 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d008a71e-5e11-4b53-bb04-53798f7cb73d tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:15.776984 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8168738c-9275-4450-99a8-d41492ad73c2 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0c9b24a2-ed48-4175-89ef-c8b7971acd39" status: 204 len: 0 microversion: 2.1 time: 0.484793 Oct 04 18:45:15.776984 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2101/4148] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:45:15 2022] DELETE /compute/v2.1/servers/0c9b24a2-ed48-4175-89ef-c8b7971acd39 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:45:15.777389 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d008a71e-5e11-4b53-bb04-53798f7cb73d tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:15.777389 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d008a71e-5e11-4b53-bb04-53798f7cb73d tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:15.777389 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d008a71e-5e11-4b53-bb04-53798f7cb73d tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:15.783562 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-cf2a04c2-b27e-4cbb-ac30-f21435869e09 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:15.784735 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-cf2a04c2-b27e-4cbb-ac30-f21435869e09 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] [instance: 0c9b24a2-ed48-4175-89ef-c8b7971acd39] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:15.792014 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cf2a04c2-b27e-4cbb-ac30-f21435869e09 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:15.792778 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cf2a04c2-b27e-4cbb-ac30-f21435869e09 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:15.794002 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cf2a04c2-b27e-4cbb-ac30-f21435869e09 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:15.795128 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cf2a04c2-b27e-4cbb-ac30-f21435869e09 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:15.795771 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cf2a04c2-b27e-4cbb-ac30-f21435869e09 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:15.796391 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cf2a04c2-b27e-4cbb-ac30-f21435869e09 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:15.832657 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-d008a71e-5e11-4b53-bb04-53798f7cb73d tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] HTTP exception thrown: Instance c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51 could not be found. Oct 04 18:45:15.843184 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d008a71e-5e11-4b53-bb04-53798f7cb73d tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Request method failure captured: Oct 04 18:45:15.843184 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51 HTTP/1.1 Oct 04 18:45:15.843184 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:45:15.843184 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:45:15.843184 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:45:15.843184 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:45:15.843184 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:45:15.843184 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:45:15.843184 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:45:15.843184 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:45:15.843184 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH5kaFyiFSIO0ZP4CMGEO428dJiNuEG6R-LLS8mNsVetgcf6w0D7DIrYZ_G7YOzpJ5huW8oCnx3-jlxIKVdxxsS18taUnXx6Xt5KnL4IkhJLGYxbDrAUBLCXM7M3o65rqEELwzRRnK71NdjnupluHpvvCSPBSNhy32oTLBkDAxSrOgs Oct 04 18:45:15.843184 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:45:15.843184 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:45:15.843184 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:45:15.843184 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:45:15.843184 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:45:15.843184 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:45:15.843184 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: a9046b9540144eeba512d79438635ea8 Oct 04 18:45:15.843184 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServersTestJSON-380527700 Oct 04 18:45:15.843184 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:45:15.843184 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:45:15.843184 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a9046b9540144eeba512d79438635ea8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a9046b9540144eeba512d79438635ea8", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a9046b9540144eeba512d79438635ea8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a9046b9540144eeba512d79438635ea8"}]}] Oct 04 18:45:15.843184 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServersTestJSON-380527700 Oct 04 18:45:15.843184 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: a9046b9540144eeba512d79438635ea8 Oct 04 18:45:15.843184 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServersTestJSON-380527700 Oct 04 18:45:15.843184 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServersTestJSON-380527700-project Oct 04 18:45:15.843184 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:45:15.843184 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:45:15.843184 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 8a6c3725b31449d5bf1ff757ff66c8d7 Oct 04 18:45:15.843184 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServersTestJSON-380527700-project Oct 04 18:45:15.843184 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:45:15.843184 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51 could not be found. Oct 04 18:45:15.843184 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51'} Oct 04 18:45:15.843184 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:45:15.843184 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:15.843184 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:45:15.843184 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:45:15.843184 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:45:15.843184 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:45:15.843184 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:45:15.843184 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:45:15.843184 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:45:15.843184 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:45:15.843184 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51 could not be found. Oct 04 18:45:15.843184 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:45:15.843184 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:15.843184 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:45:15.843184 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:15.843184 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:45:15.843184 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:45:15.843184 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:45:15.843184 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:45:15.843184 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:45:15.843184 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:45:15.843184 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:45:15.843184 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:45:15.843184 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:45:15.843184 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:45:15.843184 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:45:15.843184 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:45:15.843184 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51 could not be found. Oct 04 18:45:15.843184 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:45:15.843184 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:15.843184 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:45:15.843184 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:15.850341 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:45:15.850341 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:45:15.850341 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:45:15.850341 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:45:15.850341 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51 could not be found. Oct 04 18:45:15.850341 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:45:15.850341 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d008a71e-5e11-4b53-bb04-53798f7cb73d tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Returning 404 to user: Instance c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:45:15.850341 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d008a71e-5e11-4b53-bb04-53798f7cb73d tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51" status: 404 len: 111 microversion: 2.1 time: 0.106667 Oct 04 18:45:15.855173 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2048/4149] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:15 2022] GET /compute/v2.1/servers/c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:45:15.874693 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-53e84384-acd7-4b8a-b7bc-c6e7174cd5cb tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:15.874693 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-53e84384-acd7-4b8a-b7bc-c6e7174cd5cb tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:15.889403 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-53e84384-acd7-4b8a-b7bc-c6e7174cd5cb tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:15.890083 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-53e84384-acd7-4b8a-b7bc-c6e7174cd5cb tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:15.890533 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-53e84384-acd7-4b8a-b7bc-c6e7174cd5cb tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:15.891262 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-53e84384-acd7-4b8a-b7bc-c6e7174cd5cb tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:15.900870 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-53e84384-acd7-4b8a-b7bc-c6e7174cd5cb tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:15.906673 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-53e84384-acd7-4b8a-b7bc-c6e7174cd5cb tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:15.951117 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-53e84384-acd7-4b8a-b7bc-c6e7174cd5cb tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] HTTP exception thrown: Instance c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51 could not be found. Oct 04 18:45:15.953614 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-53e84384-acd7-4b8a-b7bc-c6e7174cd5cb tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Request method failure captured: Oct 04 18:45:15.953614 n-d-850501-14 devstack@n-api.service[123002]: request: DELETE /compute/v2.1/servers/c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51 HTTP/1.1 Oct 04 18:45:15.953614 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:45:15.953614 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:45:15.953614 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:45:15.953614 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:45:15.953614 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:45:15.953614 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:45:15.953614 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:45:15.953614 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:45:15.953614 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH5kaFyiFSIO0ZP4CMGEO428dJiNuEG6R-LLS8mNsVetgcf6w0D7DIrYZ_G7YOzpJ5huW8oCnx3-jlxIKVdxxsS18taUnXx6Xt5KnL4IkhJLGYxbDrAUBLCXM7M3o65rqEELwzRRnK71NdjnupluHpvvCSPBSNhy32oTLBkDAxSrOgs Oct 04 18:45:15.953614 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:45:15.953614 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:45:15.953614 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:45:15.953614 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:45:15.953614 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:45:15.953614 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:45:15.953614 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: a9046b9540144eeba512d79438635ea8 Oct 04 18:45:15.953614 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServersTestJSON-380527700 Oct 04 18:45:15.953614 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:45:15.953614 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:45:15.953614 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a9046b9540144eeba512d79438635ea8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a9046b9540144eeba512d79438635ea8", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a9046b9540144eeba512d79438635ea8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a9046b9540144eeba512d79438635ea8"}]}] Oct 04 18:45:15.953614 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServersTestJSON-380527700 Oct 04 18:45:15.953614 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: a9046b9540144eeba512d79438635ea8 Oct 04 18:45:15.953614 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServersTestJSON-380527700 Oct 04 18:45:15.953614 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServersTestJSON-380527700-project Oct 04 18:45:15.953614 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:45:15.953614 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:45:15.953614 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 8a6c3725b31449d5bf1ff757ff66c8d7 Oct 04 18:45:15.953614 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServersTestJSON-380527700-project Oct 04 18:45:15.953614 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:45:15.953614 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51 could not be found. Oct 04 18:45:15.953614 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51'} Oct 04 18:45:15.953614 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:45:15.953614 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:15.953614 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:45:15.953614 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:45:15.953614 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:45:15.953614 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:45:15.953614 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:45:15.953614 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:45:15.953614 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:45:15.953614 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:45:15.953614 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51 could not be found. Oct 04 18:45:15.953614 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:45:15.953614 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:15.953614 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:45:15.953614 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:15.953614 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:45:15.953614 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:45:15.953614 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:45:15.953614 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:45:15.953614 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:45:15.953614 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:45:15.953614 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:45:15.953614 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:45:15.953614 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:45:15.953614 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:45:15.953614 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:45:15.953614 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:45:15.953614 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:45:15.953614 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:45:15.953614 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51 could not be found. Oct 04 18:45:15.961616 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:45:15.961616 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:15.961616 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:45:15.961616 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:15.961616 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:45:15.961616 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:45:15.961616 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:45:15.961616 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:45:15.961616 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51 could not be found. Oct 04 18:45:15.961616 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:45:15.961616 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-53e84384-acd7-4b8a-b7bc-c6e7174cd5cb tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Returning 404 to user: Instance c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:45:15.961616 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-53e84384-acd7-4b8a-b7bc-c6e7174cd5cb tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51" status: 404 len: 111 microversion: 2.1 time: 0.101945 Oct 04 18:45:15.966352 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2049/4150] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:45:15 2022] DELETE /compute/v2.1/servers/c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:45:15.979978 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e5208e4c-ff06-4299-adf2-43d38add1354 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:15.980833 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e5208e4c-ff06-4299-adf2-43d38add1354 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:16.003493 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e5208e4c-ff06-4299-adf2-43d38add1354 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:16.004553 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e5208e4c-ff06-4299-adf2-43d38add1354 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:16.009396 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e5208e4c-ff06-4299-adf2-43d38add1354 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:16.009396 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e5208e4c-ff06-4299-adf2-43d38add1354 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:16.009396 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e5208e4c-ff06-4299-adf2-43d38add1354 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:16.009396 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e5208e4c-ff06-4299-adf2-43d38add1354 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:16.030476 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-e5208e4c-ff06-4299-adf2-43d38add1354 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] HTTP exception thrown: Instance c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51 could not be found. Oct 04 18:45:16.033769 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e5208e4c-ff06-4299-adf2-43d38add1354 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Request method failure captured: Oct 04 18:45:16.033769 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51 HTTP/1.1 Oct 04 18:45:16.033769 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:45:16.033769 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:45:16.033769 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:45:16.033769 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:45:16.033769 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:45:16.033769 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:45:16.033769 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:45:16.033769 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:45:16.033769 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH5kaFyiFSIO0ZP4CMGEO428dJiNuEG6R-LLS8mNsVetgcf6w0D7DIrYZ_G7YOzpJ5huW8oCnx3-jlxIKVdxxsS18taUnXx6Xt5KnL4IkhJLGYxbDrAUBLCXM7M3o65rqEELwzRRnK71NdjnupluHpvvCSPBSNhy32oTLBkDAxSrOgs Oct 04 18:45:16.033769 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:45:16.033769 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:45:16.033769 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:45:16.033769 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:45:16.033769 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:45:16.033769 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:45:16.033769 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: a9046b9540144eeba512d79438635ea8 Oct 04 18:45:16.033769 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServersTestJSON-380527700 Oct 04 18:45:16.033769 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:45:16.033769 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:45:16.033769 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a9046b9540144eeba512d79438635ea8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a9046b9540144eeba512d79438635ea8", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a9046b9540144eeba512d79438635ea8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a9046b9540144eeba512d79438635ea8"}]}] Oct 04 18:45:16.033769 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServersTestJSON-380527700 Oct 04 18:45:16.033769 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: a9046b9540144eeba512d79438635ea8 Oct 04 18:45:16.033769 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServersTestJSON-380527700 Oct 04 18:45:16.033769 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServersTestJSON-380527700-project Oct 04 18:45:16.033769 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:45:16.033769 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:45:16.033769 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 8a6c3725b31449d5bf1ff757ff66c8d7 Oct 04 18:45:16.033769 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServersTestJSON-380527700-project Oct 04 18:45:16.033769 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:45:16.033769 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51 could not be found. Oct 04 18:45:16.033769 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51'} Oct 04 18:45:16.033769 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:45:16.033769 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:16.033769 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:45:16.033769 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:45:16.033769 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:45:16.033769 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:45:16.033769 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:45:16.033769 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:45:16.033769 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:45:16.033769 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:45:16.033769 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51 could not be found. Oct 04 18:45:16.033769 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:45:16.033769 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:16.033769 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:45:16.033769 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:16.033769 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:45:16.033769 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:45:16.033769 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:45:16.033769 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:45:16.033769 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:45:16.033769 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:45:16.033769 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:45:16.033769 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:45:16.033769 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:45:16.033769 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:45:16.033769 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:45:16.033769 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:45:16.033769 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51 could not be found. Oct 04 18:45:16.033769 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:45:16.033769 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:16.033769 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:45:16.033769 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:16.043720 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:45:16.043720 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:45:16.043720 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:45:16.043720 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:45:16.043720 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51 could not be found. Oct 04 18:45:16.043720 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:45:16.043720 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e5208e4c-ff06-4299-adf2-43d38add1354 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Returning 404 to user: Instance c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:45:16.043720 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e5208e4c-ff06-4299-adf2-43d38add1354 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51" status: 404 len: 111 microversion: 2.1 time: 0.067148 Oct 04 18:45:16.043720 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2050/4151] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:15 2022] GET /compute/v2.1/servers/c7a80f4f-1545-41c8-9a9b-45f2cfc0ca51 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:45:16.048109 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-599a6741-a59e-452c-beb1-66cf2bfe3ec9 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:16.048592 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-599a6741-a59e-452c-beb1-66cf2bfe3ec9 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: 4d6dfac0-958d-4698-a050-6539caebe52c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:16.054907 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-599a6741-a59e-452c-beb1-66cf2bfe3ec9 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:16.055661 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-599a6741-a59e-452c-beb1-66cf2bfe3ec9 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:16.056210 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-599a6741-a59e-452c-beb1-66cf2bfe3ec9 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:16.057299 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-599a6741-a59e-452c-beb1-66cf2bfe3ec9 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:16.057443 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-599a6741-a59e-452c-beb1-66cf2bfe3ec9 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:16.057827 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-599a6741-a59e-452c-beb1-66cf2bfe3ec9 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:16.101505 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-cf2a04c2-b27e-4cbb-ac30-f21435869e09 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e54eaa927e2848869093e0ec11904929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a4914508df43b0afac3ffdf3b85b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:16.113296 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-cf2a04c2-b27e-4cbb-ac30-f21435869e09 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] 10.222.0.20 "GET /compute/v2.1/servers/0c9b24a2-ed48-4175-89ef-c8b7971acd39" status: 200 len: 1712 microversion: 2.1 time: 0.334250 Oct 04 18:45:16.115002 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2102/4152] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:15 2022] GET /compute/v2.1/servers/0c9b24a2-ed48-4175-89ef-c8b7971acd39 => generated 1712 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:45:16.120454 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b13e38b1-0e11-4784-a598-d453eec57d14 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:16.121196 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b13e38b1-0e11-4784-a598-d453eec57d14 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 160438e8-8561-4edd-9bc8-d0722f35259f] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:16.129796 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b13e38b1-0e11-4784-a598-d453eec57d14 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:16.130582 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b13e38b1-0e11-4784-a598-d453eec57d14 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:16.131182 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b13e38b1-0e11-4784-a598-d453eec57d14 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:16.132118 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b13e38b1-0e11-4784-a598-d453eec57d14 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:16.132719 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b13e38b1-0e11-4784-a598-d453eec57d14 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:16.133290 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b13e38b1-0e11-4784-a598-d453eec57d14 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:16.152463 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-b13e38b1-0e11-4784-a598-d453eec57d14 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] HTTP exception thrown: Instance 160438e8-8561-4edd-9bc8-d0722f35259f could not be found. Oct 04 18:45:16.157543 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b13e38b1-0e11-4784-a598-d453eec57d14 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Request method failure captured: Oct 04 18:45:16.157543 n-d-850501-14 devstack@n-api.service[123001]: request: DELETE /compute/v2.1/servers/160438e8-8561-4edd-9bc8-d0722f35259f HTTP/1.1 Oct 04 18:45:16.157543 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:45:16.157543 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:45:16.157543 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:45:16.157543 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:45:16.157543 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:45:16.157543 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:45:16.157543 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:45:16.157543 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:45:16.157543 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPH5kaFyiFSIO0ZP4CMGEO428dJiNuEG6R-LLS8mNsVetgcf6w0D7DIrYZ_G7YOzpJ5huW8oCnx3-jlxIKVdxxsS18taUnXx6Xt5KnL4IkhJLGYxbDrAUBLCXM7M3o65rqEELwzRRnK71NdjnupluHpvvCSPBSNhy32oTLBkDAxSrOgs Oct 04 18:45:16.157543 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:45:16.157543 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:45:16.157543 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:45:16.157543 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:45:16.157543 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:45:16.157543 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:45:16.157543 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: a9046b9540144eeba512d79438635ea8 Oct 04 18:45:16.157543 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ServersTestJSON-380527700 Oct 04 18:45:16.157543 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:45:16.157543 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:45:16.157543 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a9046b9540144eeba512d79438635ea8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a9046b9540144eeba512d79438635ea8", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a9046b9540144eeba512d79438635ea8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a9046b9540144eeba512d79438635ea8"}]}] Oct 04 18:45:16.157543 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ServersTestJSON-380527700 Oct 04 18:45:16.157543 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: a9046b9540144eeba512d79438635ea8 Oct 04 18:45:16.157543 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ServersTestJSON-380527700 Oct 04 18:45:16.157543 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ServersTestJSON-380527700-project Oct 04 18:45:16.157543 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:45:16.157543 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:45:16.157543 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 8a6c3725b31449d5bf1ff757ff66c8d7 Oct 04 18:45:16.157543 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ServersTestJSON-380527700-project Oct 04 18:45:16.157543 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:45:16.157543 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 160438e8-8561-4edd-9bc8-d0722f35259f could not be found. Oct 04 18:45:16.157543 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '160438e8-8561-4edd-9bc8-d0722f35259f'} Oct 04 18:45:16.157543 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:45:16.157543 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:16.157543 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:45:16.157543 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:45:16.157543 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:45:16.157543 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:45:16.157543 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:45:16.157543 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:45:16.157543 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:45:16.157543 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:45:16.157543 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 160438e8-8561-4edd-9bc8-d0722f35259f could not be found. Oct 04 18:45:16.157543 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:45:16.157543 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:16.157543 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:45:16.157543 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:16.157543 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:45:16.157543 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:45:16.157543 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:45:16.157543 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:45:16.157543 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:45:16.157543 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:45:16.157543 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:45:16.157543 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:45:16.157543 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:45:16.157543 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:45:16.157543 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:45:16.157543 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:45:16.157543 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:45:16.157543 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:45:16.157543 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 160438e8-8561-4edd-9bc8-d0722f35259f could not be found. Oct 04 18:45:16.163206 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:45:16.163206 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:16.163206 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:45:16.163206 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:16.163206 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:45:16.163206 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:45:16.163206 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:45:16.163206 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:45:16.163206 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 160438e8-8561-4edd-9bc8-d0722f35259f could not be found. Oct 04 18:45:16.163206 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:45:16.163206 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b13e38b1-0e11-4784-a598-d453eec57d14 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Returning 404 to user: Instance 160438e8-8561-4edd-9bc8-d0722f35259f could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:45:16.163206 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b13e38b1-0e11-4784-a598-d453eec57d14 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "DELETE /compute/v2.1/servers/160438e8-8561-4edd-9bc8-d0722f35259f" status: 404 len: 111 microversion: 2.1 time: 0.042897 Oct 04 18:45:16.165613 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2103/4153] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:45:16 2022] DELETE /compute/v2.1/servers/160438e8-8561-4edd-9bc8-d0722f35259f => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:45:16.173769 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3918644a-50a4-486c-b2ea-a8bba1663f42 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:16.178043 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3918644a-50a4-486c-b2ea-a8bba1663f42 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 160438e8-8561-4edd-9bc8-d0722f35259f] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:16.194117 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3918644a-50a4-486c-b2ea-a8bba1663f42 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:16.194825 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3918644a-50a4-486c-b2ea-a8bba1663f42 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:16.197119 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3918644a-50a4-486c-b2ea-a8bba1663f42 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:16.199316 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3918644a-50a4-486c-b2ea-a8bba1663f42 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:16.203146 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3918644a-50a4-486c-b2ea-a8bba1663f42 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:16.203398 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-599a6741-a59e-452c-beb1-66cf2bfe3ec9 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] HTTP exception thrown: Cannot 'detach_volume' instance 4d6dfac0-958d-4698-a050-6539caebe52c while it is in vm_state rescued Oct 04 18:45:16.204452 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3918644a-50a4-486c-b2ea-a8bba1663f42 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:16.204984 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-599a6741-a59e-452c-beb1-66cf2bfe3ec9 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Request method failure captured: Oct 04 18:45:16.204984 n-d-850501-14 devstack@n-api.service[123002]: request: DELETE /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c/os-volume_attachments/ae6b3d01-f8b3-4c58-b22c-d64349fe6b57 HTTP/1.1 Oct 04 18:45:16.204984 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:45:16.204984 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:45:16.204984 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:45:16.204984 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:45:16.204984 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:45:16.204984 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:45:16.204984 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:45:16.204984 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:45:16.204984 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH5VeoXXX4R-gl3WW_fAsW_7hDIEWiZR35lPoIuJDBMUw75w4Z-93EJDy38x5YiA26dGCEdjKEzqMCUM4kpma5PpB_mUiDb0rAatpoM-ionDMXIgsOp1o3NTgluOHECynM7nFlIuW8aS-v8Gnb5xnrVGhYXFRV6ahForfC1sBHmJ1HA Oct 04 18:45:16.204984 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:45:16.204984 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:45:16.204984 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:45:16.204984 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:45:16.204984 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:45:16.204984 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:45:16.204984 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 9eb391aef10e4684ada5f811ae818f97 Oct 04 18:45:16.204984 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-124944821 Oct 04 18:45:16.204984 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:45:16.204984 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:45:16.204984 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9eb391aef10e4684ada5f811ae818f97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9eb391aef10e4684ada5f811ae818f97", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9eb391aef10e4684ada5f811ae818f97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9eb391aef10e4684ada5f811ae818f97"}]}] Oct 04 18:45:16.204984 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServerRescueNegativeTestJSON-124944821 Oct 04 18:45:16.204984 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 9eb391aef10e4684ada5f811ae818f97 Oct 04 18:45:16.204984 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-124944821 Oct 04 18:45:16.204984 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServerRescueNegativeTestJSON-124944821-project Oct 04 18:45:16.204984 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:45:16.204984 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:45:16.204984 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: c4243e3907374e5e9947c17e6288f0e7 Oct 04 18:45:16.204984 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServerRescueNegativeTestJSON-124944821-project Oct 04 18:45:16.204984 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:45:16.204984 n-d-850501-14 devstack@n-api.service[123002]: exception: Cannot 'detach_volume' instance 4d6dfac0-958d-4698-a050-6539caebe52c while it is in vm_state rescued Oct 04 18:45:16.204984 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'server_id': '4d6dfac0-958d-4698-a050-6539caebe52c', 'id': 'ae6b3d01-f8b3-4c58-b22c-d64349fe6b57'} Oct 04 18:45:16.204984 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:45:16.204984 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:16.204984 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 04 18:45:16.204984 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 04 18:45:16.204984 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:45:16.204984 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:45:16.204984 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 18:45:16.204984 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 18:45:16.204984 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4d6dfac0-958d-4698-a050-6539caebe52c in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 04 18:45:16.204984 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:45:16.204984 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:16.204984 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:45:16.204984 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:16.204984 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:45:16.204984 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:45:16.204984 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:45:16.204984 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:45:16.204984 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:45:16.204984 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:45:16.204984 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 04 18:45:16.204984 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 18:45:16.204984 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 18:45:16.204984 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 18:45:16.204984 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 4d6dfac0-958d-4698-a050-6539caebe52c while it is in vm_state rescued Oct 04 18:45:16.204984 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:45:16.204984 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:16.204984 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:45:16.204984 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:16.210592 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:45:16.210592 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:45:16.210592 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:45:16.210592 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:45:16.210592 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 4d6dfac0-958d-4698-a050-6539caebe52c while it is in vm_state rescued Oct 04 18:45:16.210592 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:45:16.210592 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-599a6741-a59e-452c-beb1-66cf2bfe3ec9 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Returning 409 to user: Cannot 'detach_volume' instance 4d6dfac0-958d-4698-a050-6539caebe52c while it is in vm_state rescued {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:45:16.210592 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-599a6741-a59e-452c-beb1-66cf2bfe3ec9 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c/os-volume_attachments/ae6b3d01-f8b3-4c58-b22c-d64349fe6b57" status: 409 len: 152 microversion: 2.1 time: 0.164699 Oct 04 18:45:16.212451 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2051/4154] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Oct 4 18:45:16 2022] DELETE /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c/os-volume_attachments/ae6b3d01-f8b3-4c58-b22c-d64349fe6b57 => generated 152 bytes in 170 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:45:16.223760 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f3e635a4-e715-4e74-8389-0c554a3cfa25 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:45:16.224362 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f3e635a4-e715-4e74-8389-0c554a3cfa25 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: 4d6dfac0-958d-4698-a050-6539caebe52c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:16.235778 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f3e635a4-e715-4e74-8389-0c554a3cfa25 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:16.244283 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f3e635a4-e715-4e74-8389-0c554a3cfa25 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:16.244283 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f3e635a4-e715-4e74-8389-0c554a3cfa25 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:16.244283 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f3e635a4-e715-4e74-8389-0c554a3cfa25 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:16.244283 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f3e635a4-e715-4e74-8389-0c554a3cfa25 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:16.244283 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f3e635a4-e715-4e74-8389-0c554a3cfa25 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:16.247165 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-3918644a-50a4-486c-b2ea-a8bba1663f42 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] HTTP exception thrown: Instance 160438e8-8561-4edd-9bc8-d0722f35259f could not be found. Oct 04 18:45:16.248995 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3918644a-50a4-486c-b2ea-a8bba1663f42 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Request method failure captured: Oct 04 18:45:16.248995 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/160438e8-8561-4edd-9bc8-d0722f35259f HTTP/1.1 Oct 04 18:45:16.248995 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:45:16.248995 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:45:16.248995 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:45:16.248995 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:45:16.248995 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:45:16.248995 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:45:16.248995 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:45:16.248995 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:45:16.248995 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPH5kaFyiFSIO0ZP4CMGEO428dJiNuEG6R-LLS8mNsVetgcf6w0D7DIrYZ_G7YOzpJ5huW8oCnx3-jlxIKVdxxsS18taUnXx6Xt5KnL4IkhJLGYxbDrAUBLCXM7M3o65rqEELwzRRnK71NdjnupluHpvvCSPBSNhy32oTLBkDAxSrOgs Oct 04 18:45:16.248995 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:45:16.248995 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:45:16.248995 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:45:16.248995 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:45:16.248995 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:45:16.248995 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:45:16.248995 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: a9046b9540144eeba512d79438635ea8 Oct 04 18:45:16.248995 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ServersTestJSON-380527700 Oct 04 18:45:16.248995 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:45:16.248995 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:45:16.248995 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a9046b9540144eeba512d79438635ea8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a9046b9540144eeba512d79438635ea8", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a9046b9540144eeba512d79438635ea8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a9046b9540144eeba512d79438635ea8"}]}] Oct 04 18:45:16.248995 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ServersTestJSON-380527700 Oct 04 18:45:16.248995 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: a9046b9540144eeba512d79438635ea8 Oct 04 18:45:16.248995 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ServersTestJSON-380527700 Oct 04 18:45:16.248995 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ServersTestJSON-380527700-project Oct 04 18:45:16.248995 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:45:16.248995 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:45:16.248995 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 8a6c3725b31449d5bf1ff757ff66c8d7 Oct 04 18:45:16.248995 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ServersTestJSON-380527700-project Oct 04 18:45:16.248995 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:45:16.248995 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 160438e8-8561-4edd-9bc8-d0722f35259f could not be found. Oct 04 18:45:16.248995 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '160438e8-8561-4edd-9bc8-d0722f35259f'} Oct 04 18:45:16.248995 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:45:16.248995 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:16.248995 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:45:16.248995 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:45:16.248995 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:45:16.248995 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:45:16.248995 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:45:16.248995 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:45:16.248995 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:45:16.248995 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:45:16.248995 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 160438e8-8561-4edd-9bc8-d0722f35259f could not be found. Oct 04 18:45:16.248995 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:45:16.248995 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:16.248995 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:45:16.248995 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:16.248995 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:45:16.248995 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:45:16.248995 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:45:16.248995 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:45:16.248995 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:45:16.248995 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:45:16.248995 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:45:16.248995 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:45:16.248995 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:45:16.248995 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:45:16.248995 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:45:16.248995 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:45:16.248995 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 160438e8-8561-4edd-9bc8-d0722f35259f could not be found. Oct 04 18:45:16.248995 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:45:16.248995 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:16.248995 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:45:16.248995 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:16.254709 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:45:16.254709 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:45:16.254709 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:45:16.254709 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:45:16.254709 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 160438e8-8561-4edd-9bc8-d0722f35259f could not be found. Oct 04 18:45:16.254709 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:45:16.255449 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3918644a-50a4-486c-b2ea-a8bba1663f42 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Returning 404 to user: Instance 160438e8-8561-4edd-9bc8-d0722f35259f could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:45:16.269139 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3918644a-50a4-486c-b2ea-a8bba1663f42 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/160438e8-8561-4edd-9bc8-d0722f35259f" status: 404 len: 111 microversion: 2.1 time: 0.102089 Oct 04 18:45:16.272640 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2104/4155] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:16 2022] GET /compute/v2.1/servers/160438e8-8561-4edd-9bc8-d0722f35259f => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:45:16.279681 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-79cc1f56-fe71-433c-8bd3-ebad97b0a756 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:16.280365 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-79cc1f56-fe71-433c-8bd3-ebad97b0a756 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 8e11c130-e748-4008-ad1b-9c959b4d908c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:16.295756 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-79cc1f56-fe71-433c-8bd3-ebad97b0a756 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:16.302314 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-79cc1f56-fe71-433c-8bd3-ebad97b0a756 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:16.302912 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-79cc1f56-fe71-433c-8bd3-ebad97b0a756 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:16.303760 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-79cc1f56-fe71-433c-8bd3-ebad97b0a756 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:16.304378 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-79cc1f56-fe71-433c-8bd3-ebad97b0a756 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:16.304924 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-79cc1f56-fe71-433c-8bd3-ebad97b0a756 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:16.326560 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-79cc1f56-fe71-433c-8bd3-ebad97b0a756 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] HTTP exception thrown: Instance 8e11c130-e748-4008-ad1b-9c959b4d908c could not be found. Oct 04 18:45:16.328932 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-79cc1f56-fe71-433c-8bd3-ebad97b0a756 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Request method failure captured: Oct 04 18:45:16.328932 n-d-850501-14 devstack@n-api.service[123001]: request: DELETE /compute/v2.1/servers/8e11c130-e748-4008-ad1b-9c959b4d908c HTTP/1.1 Oct 04 18:45:16.328932 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:45:16.328932 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:45:16.328932 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:45:16.328932 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:45:16.328932 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:45:16.328932 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:45:16.328932 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:45:16.328932 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:45:16.328932 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPH5kaFyiFSIO0ZP4CMGEO428dJiNuEG6R-LLS8mNsVetgcf6w0D7DIrYZ_G7YOzpJ5huW8oCnx3-jlxIKVdxxsS18taUnXx6Xt5KnL4IkhJLGYxbDrAUBLCXM7M3o65rqEELwzRRnK71NdjnupluHpvvCSPBSNhy32oTLBkDAxSrOgs Oct 04 18:45:16.328932 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:45:16.328932 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:45:16.328932 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:45:16.328932 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:45:16.328932 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:45:16.328932 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:45:16.328932 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: a9046b9540144eeba512d79438635ea8 Oct 04 18:45:16.328932 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ServersTestJSON-380527700 Oct 04 18:45:16.328932 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:45:16.328932 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:45:16.328932 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a9046b9540144eeba512d79438635ea8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a9046b9540144eeba512d79438635ea8", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a9046b9540144eeba512d79438635ea8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a9046b9540144eeba512d79438635ea8"}]}] Oct 04 18:45:16.328932 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ServersTestJSON-380527700 Oct 04 18:45:16.328932 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: a9046b9540144eeba512d79438635ea8 Oct 04 18:45:16.328932 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ServersTestJSON-380527700 Oct 04 18:45:16.328932 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ServersTestJSON-380527700-project Oct 04 18:45:16.328932 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:45:16.328932 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:45:16.328932 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 8a6c3725b31449d5bf1ff757ff66c8d7 Oct 04 18:45:16.328932 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ServersTestJSON-380527700-project Oct 04 18:45:16.328932 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:45:16.328932 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 8e11c130-e748-4008-ad1b-9c959b4d908c could not be found. Oct 04 18:45:16.328932 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '8e11c130-e748-4008-ad1b-9c959b4d908c'} Oct 04 18:45:16.328932 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:45:16.328932 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:16.328932 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:45:16.328932 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:45:16.328932 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:45:16.328932 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:45:16.328932 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:45:16.328932 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:45:16.328932 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:45:16.328932 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:45:16.328932 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e11c130-e748-4008-ad1b-9c959b4d908c could not be found. Oct 04 18:45:16.328932 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:45:16.328932 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:16.328932 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:45:16.328932 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:16.328932 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:45:16.328932 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:45:16.328932 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:45:16.328932 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:45:16.328932 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:45:16.328932 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:45:16.328932 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:45:16.328932 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:45:16.328932 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:45:16.328932 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:45:16.328932 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:45:16.328932 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:45:16.328932 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:45:16.328932 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:45:16.328932 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e11c130-e748-4008-ad1b-9c959b4d908c could not be found. Oct 04 18:45:16.333560 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:45:16.333560 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:16.333560 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:45:16.333560 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:16.333560 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:45:16.333560 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:45:16.333560 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:45:16.333560 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:45:16.333560 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e11c130-e748-4008-ad1b-9c959b4d908c could not be found. Oct 04 18:45:16.333560 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:45:16.342176 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-79cc1f56-fe71-433c-8bd3-ebad97b0a756 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Returning 404 to user: Instance 8e11c130-e748-4008-ad1b-9c959b4d908c could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:45:16.342176 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-79cc1f56-fe71-433c-8bd3-ebad97b0a756 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8e11c130-e748-4008-ad1b-9c959b4d908c" status: 404 len: 111 microversion: 2.1 time: 0.064799 Oct 04 18:45:16.342176 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2105/4156] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:45:16 2022] DELETE /compute/v2.1/servers/8e11c130-e748-4008-ad1b-9c959b4d908c => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:45:16.346206 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-259d4742-42e1-4fd5-be68-b9de2fd5246b tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:16.347101 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-259d4742-42e1-4fd5-be68-b9de2fd5246b tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] [instance: d46bd79f-eda9-4149-b4aa-788520147af7] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:16.359985 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-259d4742-42e1-4fd5-be68-b9de2fd5246b tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:16.360914 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-259d4742-42e1-4fd5-be68-b9de2fd5246b tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:16.361617 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-259d4742-42e1-4fd5-be68-b9de2fd5246b tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:16.363262 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-259d4742-42e1-4fd5-be68-b9de2fd5246b tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:16.366220 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-259d4742-42e1-4fd5-be68-b9de2fd5246b tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:16.366932 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-259d4742-42e1-4fd5-be68-b9de2fd5246b tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:16.446182 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f3e635a4-e715-4e74-8389-0c554a3cfa25 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "POST /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c/action" status: 202 len: 0 microversion: 2.1 time: 0.233426 Oct 04 18:45:16.452143 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2052/4157] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:45:16 2022] POST /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c/action => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:45:16.459353 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ca5813e5-638b-4ea3-97a4-c48062eca175 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:16.460338 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ca5813e5-638b-4ea3-97a4-c48062eca175 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 8e11c130-e748-4008-ad1b-9c959b4d908c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:16.477338 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ca5813e5-638b-4ea3-97a4-c48062eca175 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:16.482551 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ca5813e5-638b-4ea3-97a4-c48062eca175 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:16.482551 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ca5813e5-638b-4ea3-97a4-c48062eca175 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:16.482551 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ca5813e5-638b-4ea3-97a4-c48062eca175 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:16.482551 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ca5813e5-638b-4ea3-97a4-c48062eca175 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:16.482551 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ca5813e5-638b-4ea3-97a4-c48062eca175 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:16.524263 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-ca5813e5-638b-4ea3-97a4-c48062eca175 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] HTTP exception thrown: Instance 8e11c130-e748-4008-ad1b-9c959b4d908c could not be found. Oct 04 18:45:16.526418 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ca5813e5-638b-4ea3-97a4-c48062eca175 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Request method failure captured: Oct 04 18:45:16.526418 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/8e11c130-e748-4008-ad1b-9c959b4d908c HTTP/1.1 Oct 04 18:45:16.526418 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:45:16.526418 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:45:16.526418 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:45:16.526418 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:45:16.526418 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:45:16.526418 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:45:16.526418 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:45:16.526418 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:45:16.526418 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH5kaFyiFSIO0ZP4CMGEO428dJiNuEG6R-LLS8mNsVetgcf6w0D7DIrYZ_G7YOzpJ5huW8oCnx3-jlxIKVdxxsS18taUnXx6Xt5KnL4IkhJLGYxbDrAUBLCXM7M3o65rqEELwzRRnK71NdjnupluHpvvCSPBSNhy32oTLBkDAxSrOgs Oct 04 18:45:16.526418 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:45:16.526418 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:45:16.526418 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:45:16.526418 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:45:16.526418 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:45:16.526418 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:45:16.526418 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: a9046b9540144eeba512d79438635ea8 Oct 04 18:45:16.526418 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServersTestJSON-380527700 Oct 04 18:45:16.526418 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:45:16.526418 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:45:16.526418 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a9046b9540144eeba512d79438635ea8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a9046b9540144eeba512d79438635ea8", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a9046b9540144eeba512d79438635ea8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a9046b9540144eeba512d79438635ea8"}]}] Oct 04 18:45:16.526418 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServersTestJSON-380527700 Oct 04 18:45:16.526418 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: a9046b9540144eeba512d79438635ea8 Oct 04 18:45:16.526418 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServersTestJSON-380527700 Oct 04 18:45:16.526418 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServersTestJSON-380527700-project Oct 04 18:45:16.526418 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:45:16.526418 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:45:16.526418 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 8a6c3725b31449d5bf1ff757ff66c8d7 Oct 04 18:45:16.526418 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServersTestJSON-380527700-project Oct 04 18:45:16.526418 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:45:16.526418 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 8e11c130-e748-4008-ad1b-9c959b4d908c could not be found. Oct 04 18:45:16.526418 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '8e11c130-e748-4008-ad1b-9c959b4d908c'} Oct 04 18:45:16.526418 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:45:16.526418 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:16.526418 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:45:16.526418 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:45:16.526418 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:45:16.526418 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:45:16.526418 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:45:16.526418 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:45:16.526418 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:45:16.526418 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:45:16.526418 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e11c130-e748-4008-ad1b-9c959b4d908c could not be found. Oct 04 18:45:16.526418 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:45:16.526418 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:16.526418 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:45:16.526418 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:16.526418 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:45:16.526418 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:45:16.526418 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:45:16.526418 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:45:16.526418 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:45:16.526418 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:45:16.526418 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:45:16.526418 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:45:16.526418 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:45:16.526418 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:45:16.526418 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:45:16.526418 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:45:16.526418 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e11c130-e748-4008-ad1b-9c959b4d908c could not be found. Oct 04 18:45:16.526418 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:45:16.526418 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:16.526418 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:45:16.526418 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:16.532800 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:45:16.532800 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:45:16.532800 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:45:16.532800 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:45:16.532800 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e11c130-e748-4008-ad1b-9c959b4d908c could not be found. Oct 04 18:45:16.532800 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:45:16.534772 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ca5813e5-638b-4ea3-97a4-c48062eca175 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Returning 404 to user: Instance 8e11c130-e748-4008-ad1b-9c959b4d908c could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:45:16.535825 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ca5813e5-638b-4ea3-97a4-c48062eca175 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/8e11c130-e748-4008-ad1b-9c959b4d908c" status: 404 len: 111 microversion: 2.1 time: 0.082478 Oct 04 18:45:16.537319 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2053/4158] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:16 2022] GET /compute/v2.1/servers/8e11c130-e748-4008-ad1b-9c959b4d908c => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:45:16.544326 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-50ad5a21-2297-46c2-827d-52d0f9030b00 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:16.545734 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-50ad5a21-2297-46c2-827d-52d0f9030b00 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] [instance: 3d3cabc2-fa23-4098-9197-9aaa19a0c663] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:16.554822 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-50ad5a21-2297-46c2-827d-52d0f9030b00 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:16.555609 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-50ad5a21-2297-46c2-827d-52d0f9030b00 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:16.556269 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-50ad5a21-2297-46c2-827d-52d0f9030b00 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:16.557166 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-50ad5a21-2297-46c2-827d-52d0f9030b00 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:16.557796 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-50ad5a21-2297-46c2-827d-52d0f9030b00 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:16.558420 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-50ad5a21-2297-46c2-827d-52d0f9030b00 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:16.624407 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-259d4742-42e1-4fd5-be68-b9de2fd5246b tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a02cd1108b947b186202f6d15e6cf0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c0b095138354810949093e7ea03b8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:16.633873 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-259d4742-42e1-4fd5-be68-b9de2fd5246b tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] 10.222.0.20 "GET /compute/v2.1/servers/d46bd79f-eda9-4149-b4aa-788520147af7" status: 200 len: 1316 microversion: 2.1 time: 0.292859 Oct 04 18:45:16.634472 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2106/4159] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:16 2022] GET /compute/v2.1/servers/d46bd79f-eda9-4149-b4aa-788520147af7 => generated 1316 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:16.641200 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ad0619a2-a243-48d8-aada-b1c8b4a13460 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:16.641828 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ad0619a2-a243-48d8-aada-b1c8b4a13460 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: 4d6dfac0-958d-4698-a050-6539caebe52c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:16.648747 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ad0619a2-a243-48d8-aada-b1c8b4a13460 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:16.649305 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ad0619a2-a243-48d8-aada-b1c8b4a13460 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:16.649954 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ad0619a2-a243-48d8-aada-b1c8b4a13460 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:16.657593 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ad0619a2-a243-48d8-aada-b1c8b4a13460 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:16.657593 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ad0619a2-a243-48d8-aada-b1c8b4a13460 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:16.657593 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ad0619a2-a243-48d8-aada-b1c8b4a13460 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:16.659702 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:16.674157 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-50ad5a21-2297-46c2-827d-52d0f9030b00 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:16.735126 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-50ad5a21-2297-46c2-827d-52d0f9030b00 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:16.739651 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-50ad5a21-2297-46c2-827d-52d0f9030b00 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:16.747782 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-50ad5a21-2297-46c2-827d-52d0f9030b00 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] 10.222.0.20 "GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663" status: 200 len: 1604 microversion: 2.42 time: 0.202505 Oct 04 18:45:16.759018 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2054/4160] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:45:16 2022] GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663 => generated 1604 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:45:16.769647 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-83cf00bd-8d74-4fe8-83dd-18a50197bcf0 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:16.771110 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-83cf00bd-8d74-4fe8-83dd-18a50197bcf0 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 766fe762-0e33-4174-a817-827f782572d9] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:16.789194 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-83cf00bd-8d74-4fe8-83dd-18a50197bcf0 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:16.793535 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-83cf00bd-8d74-4fe8-83dd-18a50197bcf0 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:16.795930 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-83cf00bd-8d74-4fe8-83dd-18a50197bcf0 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:16.796734 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-83cf00bd-8d74-4fe8-83dd-18a50197bcf0 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:16.797253 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-83cf00bd-8d74-4fe8-83dd-18a50197bcf0 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:16.797657 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-83cf00bd-8d74-4fe8-83dd-18a50197bcf0 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:16.825576 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-83cf00bd-8d74-4fe8-83dd-18a50197bcf0 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] HTTP exception thrown: Instance 766fe762-0e33-4174-a817-827f782572d9 could not be found. Oct 04 18:45:16.828807 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-83cf00bd-8d74-4fe8-83dd-18a50197bcf0 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Request method failure captured: Oct 04 18:45:16.828807 n-d-850501-14 devstack@n-api.service[123002]: request: DELETE /compute/v2.1/servers/766fe762-0e33-4174-a817-827f782572d9 HTTP/1.1 Oct 04 18:45:16.828807 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:45:16.828807 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:45:16.828807 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:45:16.828807 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:45:16.828807 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:45:16.828807 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:45:16.828807 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:45:16.828807 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:45:16.828807 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH5kaFyiFSIO0ZP4CMGEO428dJiNuEG6R-LLS8mNsVetgcf6w0D7DIrYZ_G7YOzpJ5huW8oCnx3-jlxIKVdxxsS18taUnXx6Xt5KnL4IkhJLGYxbDrAUBLCXM7M3o65rqEELwzRRnK71NdjnupluHpvvCSPBSNhy32oTLBkDAxSrOgs Oct 04 18:45:16.828807 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:45:16.828807 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:45:16.828807 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:45:16.828807 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:45:16.828807 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:45:16.828807 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:45:16.828807 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: a9046b9540144eeba512d79438635ea8 Oct 04 18:45:16.828807 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServersTestJSON-380527700 Oct 04 18:45:16.828807 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:45:16.828807 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:45:16.828807 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a9046b9540144eeba512d79438635ea8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a9046b9540144eeba512d79438635ea8", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a9046b9540144eeba512d79438635ea8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a9046b9540144eeba512d79438635ea8"}]}] Oct 04 18:45:16.828807 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServersTestJSON-380527700 Oct 04 18:45:16.828807 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: a9046b9540144eeba512d79438635ea8 Oct 04 18:45:16.828807 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServersTestJSON-380527700 Oct 04 18:45:16.828807 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServersTestJSON-380527700-project Oct 04 18:45:16.828807 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:45:16.828807 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:45:16.828807 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 8a6c3725b31449d5bf1ff757ff66c8d7 Oct 04 18:45:16.828807 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServersTestJSON-380527700-project Oct 04 18:45:16.828807 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:45:16.828807 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 766fe762-0e33-4174-a817-827f782572d9 could not be found. Oct 04 18:45:16.828807 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '766fe762-0e33-4174-a817-827f782572d9'} Oct 04 18:45:16.828807 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:45:16.828807 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:16.828807 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:45:16.828807 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:45:16.828807 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:45:16.828807 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:45:16.828807 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:45:16.828807 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:45:16.828807 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:45:16.828807 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:45:16.828807 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 766fe762-0e33-4174-a817-827f782572d9 could not be found. Oct 04 18:45:16.828807 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:45:16.828807 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:16.828807 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:45:16.828807 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:16.828807 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:45:16.828807 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:45:16.828807 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:45:16.828807 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:45:16.828807 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:45:16.828807 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:45:16.828807 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:45:16.828807 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:45:16.828807 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:45:16.828807 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:45:16.828807 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:45:16.828807 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:45:16.828807 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:45:16.828807 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:45:16.828807 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 766fe762-0e33-4174-a817-827f782572d9 could not be found. Oct 04 18:45:16.834359 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:45:16.834359 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:16.834359 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:45:16.834359 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:16.834359 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:45:16.834359 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:45:16.834359 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:45:16.834359 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:45:16.834359 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 766fe762-0e33-4174-a817-827f782572d9 could not be found. Oct 04 18:45:16.834359 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:45:16.834359 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-83cf00bd-8d74-4fe8-83dd-18a50197bcf0 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Returning 404 to user: Instance 766fe762-0e33-4174-a817-827f782572d9 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:45:16.834359 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-83cf00bd-8d74-4fe8-83dd-18a50197bcf0 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "DELETE /compute/v2.1/servers/766fe762-0e33-4174-a817-827f782572d9" status: 404 len: 111 microversion: 2.1 time: 0.070452 Oct 04 18:45:16.835940 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2055/4161] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:45:16 2022] DELETE /compute/v2.1/servers/766fe762-0e33-4174-a817-827f782572d9 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:45:16.842637 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-42035b8a-f5de-4c77-9ea7-b73d9ea2bcd7 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:16.844068 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-42035b8a-f5de-4c77-9ea7-b73d9ea2bcd7 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 766fe762-0e33-4174-a817-827f782572d9] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:16.850855 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-42035b8a-f5de-4c77-9ea7-b73d9ea2bcd7 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:16.851354 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-42035b8a-f5de-4c77-9ea7-b73d9ea2bcd7 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:16.851783 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-42035b8a-f5de-4c77-9ea7-b73d9ea2bcd7 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:16.852902 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-42035b8a-f5de-4c77-9ea7-b73d9ea2bcd7 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:16.853516 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-42035b8a-f5de-4c77-9ea7-b73d9ea2bcd7 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:16.854262 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-42035b8a-f5de-4c77-9ea7-b73d9ea2bcd7 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:16.884536 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-42035b8a-f5de-4c77-9ea7-b73d9ea2bcd7 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] HTTP exception thrown: Instance 766fe762-0e33-4174-a817-827f782572d9 could not be found. Oct 04 18:45:16.886288 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-42035b8a-f5de-4c77-9ea7-b73d9ea2bcd7 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Request method failure captured: Oct 04 18:45:16.886288 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/766fe762-0e33-4174-a817-827f782572d9 HTTP/1.1 Oct 04 18:45:16.886288 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:45:16.886288 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:45:16.886288 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:45:16.886288 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:45:16.886288 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:45:16.886288 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:45:16.886288 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:45:16.886288 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:45:16.886288 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH5kaFyiFSIO0ZP4CMGEO428dJiNuEG6R-LLS8mNsVetgcf6w0D7DIrYZ_G7YOzpJ5huW8oCnx3-jlxIKVdxxsS18taUnXx6Xt5KnL4IkhJLGYxbDrAUBLCXM7M3o65rqEELwzRRnK71NdjnupluHpvvCSPBSNhy32oTLBkDAxSrOgs Oct 04 18:45:16.886288 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:45:16.886288 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:45:16.886288 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:45:16.886288 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:45:16.886288 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:45:16.886288 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:45:16.886288 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: a9046b9540144eeba512d79438635ea8 Oct 04 18:45:16.886288 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServersTestJSON-380527700 Oct 04 18:45:16.886288 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:45:16.886288 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:45:16.886288 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a9046b9540144eeba512d79438635ea8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a9046b9540144eeba512d79438635ea8", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a9046b9540144eeba512d79438635ea8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a9046b9540144eeba512d79438635ea8"}]}] Oct 04 18:45:16.886288 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServersTestJSON-380527700 Oct 04 18:45:16.886288 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: a9046b9540144eeba512d79438635ea8 Oct 04 18:45:16.886288 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServersTestJSON-380527700 Oct 04 18:45:16.886288 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServersTestJSON-380527700-project Oct 04 18:45:16.886288 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:45:16.886288 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:45:16.886288 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 8a6c3725b31449d5bf1ff757ff66c8d7 Oct 04 18:45:16.886288 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServersTestJSON-380527700-project Oct 04 18:45:16.886288 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:45:16.886288 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 766fe762-0e33-4174-a817-827f782572d9 could not be found. Oct 04 18:45:16.886288 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '766fe762-0e33-4174-a817-827f782572d9'} Oct 04 18:45:16.886288 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:45:16.886288 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:16.886288 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:45:16.886288 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:45:16.886288 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:45:16.886288 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:45:16.886288 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:45:16.886288 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:45:16.886288 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:45:16.886288 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:45:16.886288 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 766fe762-0e33-4174-a817-827f782572d9 could not be found. Oct 04 18:45:16.886288 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:45:16.886288 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:16.886288 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:45:16.886288 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:16.886288 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:45:16.886288 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:45:16.886288 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:45:16.886288 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:45:16.886288 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:45:16.886288 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:45:16.886288 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:45:16.886288 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:45:16.886288 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:45:16.886288 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:45:16.886288 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:45:16.886288 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:45:16.886288 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 766fe762-0e33-4174-a817-827f782572d9 could not be found. Oct 04 18:45:16.886288 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:45:16.886288 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:16.886288 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:45:16.886288 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:16.900378 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:45:16.900378 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:45:16.900378 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:45:16.900378 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:45:16.900378 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 766fe762-0e33-4174-a817-827f782572d9 could not be found. Oct 04 18:45:16.900378 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:45:16.900378 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-42035b8a-f5de-4c77-9ea7-b73d9ea2bcd7 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Returning 404 to user: Instance 766fe762-0e33-4174-a817-827f782572d9 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:45:16.900378 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-42035b8a-f5de-4c77-9ea7-b73d9ea2bcd7 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/766fe762-0e33-4174-a817-827f782572d9" status: 404 len: 111 microversion: 2.1 time: 0.051049 Oct 04 18:45:16.900378 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2056/4162] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:16 2022] GET /compute/v2.1/servers/766fe762-0e33-4174-a817-827f782572d9 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:45:16.917175 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7b0842c6-8ee4-4a4a-b6ea-5ceca7a33a5b tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:16.918227 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7b0842c6-8ee4-4a4a-b6ea-5ceca7a33a5b tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 6dc7155a-e90b-4ca9-8778-02bf31eff4bd] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:16.939537 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7b0842c6-8ee4-4a4a-b6ea-5ceca7a33a5b tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:16.940599 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7b0842c6-8ee4-4a4a-b6ea-5ceca7a33a5b tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:16.942237 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7b0842c6-8ee4-4a4a-b6ea-5ceca7a33a5b tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:16.945037 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7b0842c6-8ee4-4a4a-b6ea-5ceca7a33a5b tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:16.945842 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7b0842c6-8ee4-4a4a-b6ea-5ceca7a33a5b tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:16.946448 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7b0842c6-8ee4-4a4a-b6ea-5ceca7a33a5b tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:16.967077 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-7b0842c6-8ee4-4a4a-b6ea-5ceca7a33a5b tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] HTTP exception thrown: Instance 6dc7155a-e90b-4ca9-8778-02bf31eff4bd could not be found. Oct 04 18:45:16.969401 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7b0842c6-8ee4-4a4a-b6ea-5ceca7a33a5b tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Request method failure captured: Oct 04 18:45:16.969401 n-d-850501-14 devstack@n-api.service[123002]: request: DELETE /compute/v2.1/servers/6dc7155a-e90b-4ca9-8778-02bf31eff4bd HTTP/1.1 Oct 04 18:45:16.969401 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:45:16.969401 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:45:16.969401 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:45:16.969401 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:45:16.969401 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:45:16.969401 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:45:16.969401 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:45:16.969401 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:45:16.969401 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH5kaFyiFSIO0ZP4CMGEO428dJiNuEG6R-LLS8mNsVetgcf6w0D7DIrYZ_G7YOzpJ5huW8oCnx3-jlxIKVdxxsS18taUnXx6Xt5KnL4IkhJLGYxbDrAUBLCXM7M3o65rqEELwzRRnK71NdjnupluHpvvCSPBSNhy32oTLBkDAxSrOgs Oct 04 18:45:16.969401 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:45:16.969401 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:45:16.969401 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:45:16.969401 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:45:16.969401 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:45:16.969401 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:45:16.969401 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: a9046b9540144eeba512d79438635ea8 Oct 04 18:45:16.969401 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServersTestJSON-380527700 Oct 04 18:45:16.969401 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:45:16.969401 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:45:16.969401 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a9046b9540144eeba512d79438635ea8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a9046b9540144eeba512d79438635ea8", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a9046b9540144eeba512d79438635ea8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a9046b9540144eeba512d79438635ea8"}]}] Oct 04 18:45:16.969401 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServersTestJSON-380527700 Oct 04 18:45:16.969401 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: a9046b9540144eeba512d79438635ea8 Oct 04 18:45:16.969401 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServersTestJSON-380527700 Oct 04 18:45:16.969401 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServersTestJSON-380527700-project Oct 04 18:45:16.969401 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:45:16.969401 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:45:16.969401 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 8a6c3725b31449d5bf1ff757ff66c8d7 Oct 04 18:45:16.969401 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServersTestJSON-380527700-project Oct 04 18:45:16.969401 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:45:16.969401 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 6dc7155a-e90b-4ca9-8778-02bf31eff4bd could not be found. Oct 04 18:45:16.969401 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '6dc7155a-e90b-4ca9-8778-02bf31eff4bd'} Oct 04 18:45:16.969401 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:45:16.969401 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:16.969401 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:45:16.969401 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:45:16.969401 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:45:16.969401 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:45:16.969401 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:45:16.969401 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:45:16.969401 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:45:16.969401 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:45:16.969401 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dc7155a-e90b-4ca9-8778-02bf31eff4bd could not be found. Oct 04 18:45:16.969401 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:45:16.969401 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:16.969401 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:45:16.969401 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:16.969401 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:45:16.969401 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:45:16.969401 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:45:16.969401 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:45:16.969401 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:45:16.969401 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:45:16.969401 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:45:16.969401 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:45:16.969401 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:45:16.969401 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:45:16.969401 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:45:16.969401 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:45:16.969401 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:45:16.969401 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:45:16.969401 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dc7155a-e90b-4ca9-8778-02bf31eff4bd could not be found. Oct 04 18:45:16.977360 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:45:16.977360 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:16.977360 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:45:16.977360 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:16.977360 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:45:16.977360 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:45:16.977360 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:45:16.977360 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:45:16.977360 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dc7155a-e90b-4ca9-8778-02bf31eff4bd could not be found. Oct 04 18:45:16.977360 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:45:16.977360 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7b0842c6-8ee4-4a4a-b6ea-5ceca7a33a5b tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Returning 404 to user: Instance 6dc7155a-e90b-4ca9-8778-02bf31eff4bd could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:45:16.977360 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7b0842c6-8ee4-4a4a-b6ea-5ceca7a33a5b tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6dc7155a-e90b-4ca9-8778-02bf31eff4bd" status: 404 len: 111 microversion: 2.1 time: 0.059016 Oct 04 18:45:16.977360 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2057/4163] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:45:16 2022] DELETE /compute/v2.1/servers/6dc7155a-e90b-4ca9-8778-02bf31eff4bd => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:45:16.980155 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-020f130e-90af-48ad-8a0e-00e8b2533d57 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:16.981198 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-020f130e-90af-48ad-8a0e-00e8b2533d57 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 6dc7155a-e90b-4ca9-8778-02bf31eff4bd] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:16.988530 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-020f130e-90af-48ad-8a0e-00e8b2533d57 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:16.989021 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-020f130e-90af-48ad-8a0e-00e8b2533d57 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:16.989521 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-020f130e-90af-48ad-8a0e-00e8b2533d57 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:16.990298 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-020f130e-90af-48ad-8a0e-00e8b2533d57 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:16.990897 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-020f130e-90af-48ad-8a0e-00e8b2533d57 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:16.991357 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-020f130e-90af-48ad-8a0e-00e8b2533d57 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:17.000385 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ad0619a2-a243-48d8-aada-b1c8b4a13460 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:17.018727 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ad0619a2-a243-48d8-aada-b1c8b4a13460 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c" status: 200 len: 1721 microversion: 2.1 time: 0.383171 Oct 04 18:45:17.019897 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2107/4164] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:16 2022] GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c => generated 1721 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:17.038815 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-020f130e-90af-48ad-8a0e-00e8b2533d57 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] HTTP exception thrown: Instance 6dc7155a-e90b-4ca9-8778-02bf31eff4bd could not be found. Oct 04 18:45:17.048239 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-020f130e-90af-48ad-8a0e-00e8b2533d57 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Request method failure captured: Oct 04 18:45:17.048239 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/6dc7155a-e90b-4ca9-8778-02bf31eff4bd HTTP/1.1 Oct 04 18:45:17.048239 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:45:17.048239 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:45:17.048239 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:45:17.048239 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:45:17.048239 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:45:17.048239 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:45:17.048239 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:45:17.048239 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:45:17.048239 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH5kaFyiFSIO0ZP4CMGEO428dJiNuEG6R-LLS8mNsVetgcf6w0D7DIrYZ_G7YOzpJ5huW8oCnx3-jlxIKVdxxsS18taUnXx6Xt5KnL4IkhJLGYxbDrAUBLCXM7M3o65rqEELwzRRnK71NdjnupluHpvvCSPBSNhy32oTLBkDAxSrOgs Oct 04 18:45:17.048239 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:45:17.048239 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:45:17.048239 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:45:17.048239 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:45:17.048239 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:45:17.048239 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:45:17.048239 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: a9046b9540144eeba512d79438635ea8 Oct 04 18:45:17.048239 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServersTestJSON-380527700 Oct 04 18:45:17.048239 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:45:17.048239 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:45:17.048239 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a9046b9540144eeba512d79438635ea8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a9046b9540144eeba512d79438635ea8", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a9046b9540144eeba512d79438635ea8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a9046b9540144eeba512d79438635ea8"}]}] Oct 04 18:45:17.048239 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServersTestJSON-380527700 Oct 04 18:45:17.048239 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: a9046b9540144eeba512d79438635ea8 Oct 04 18:45:17.048239 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServersTestJSON-380527700 Oct 04 18:45:17.048239 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServersTestJSON-380527700-project Oct 04 18:45:17.048239 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:45:17.048239 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:45:17.048239 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 8a6c3725b31449d5bf1ff757ff66c8d7 Oct 04 18:45:17.048239 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServersTestJSON-380527700-project Oct 04 18:45:17.048239 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:45:17.048239 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 6dc7155a-e90b-4ca9-8778-02bf31eff4bd could not be found. Oct 04 18:45:17.048239 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '6dc7155a-e90b-4ca9-8778-02bf31eff4bd'} Oct 04 18:45:17.048239 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:45:17.048239 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:17.048239 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:45:17.048239 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:45:17.048239 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:45:17.048239 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:45:17.048239 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:45:17.048239 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:45:17.048239 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:45:17.048239 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:45:17.048239 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dc7155a-e90b-4ca9-8778-02bf31eff4bd could not be found. Oct 04 18:45:17.048239 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:45:17.048239 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:17.048239 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:45:17.048239 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:17.048239 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:45:17.048239 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:45:17.048239 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:45:17.048239 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:45:17.048239 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:45:17.048239 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:45:17.048239 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:45:17.048239 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:45:17.048239 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:45:17.048239 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:45:17.048239 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:45:17.048239 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:45:17.048239 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dc7155a-e90b-4ca9-8778-02bf31eff4bd could not be found. Oct 04 18:45:17.048239 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:45:17.048239 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:17.048239 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:45:17.048239 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:17.054300 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:45:17.054300 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:45:17.054300 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:45:17.054300 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:45:17.054300 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dc7155a-e90b-4ca9-8778-02bf31eff4bd could not be found. Oct 04 18:45:17.054300 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:45:17.054300 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-020f130e-90af-48ad-8a0e-00e8b2533d57 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Returning 404 to user: Instance 6dc7155a-e90b-4ca9-8778-02bf31eff4bd could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:45:17.054300 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-020f130e-90af-48ad-8a0e-00e8b2533d57 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/6dc7155a-e90b-4ca9-8778-02bf31eff4bd" status: 404 len: 111 microversion: 2.1 time: 0.073928 Oct 04 18:45:17.054300 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2058/4165] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:16 2022] GET /compute/v2.1/servers/6dc7155a-e90b-4ca9-8778-02bf31eff4bd => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:45:17.064837 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-11236964-083a-4c72-a390-f8c39b23ea3b tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:17.068197 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-11236964-083a-4c72-a390-f8c39b23ea3b tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: af3e9546-9a60-424a-8d98-234b08364d1d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:17.078320 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-11236964-083a-4c72-a390-f8c39b23ea3b tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:17.086713 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-11236964-083a-4c72-a390-f8c39b23ea3b tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:17.086713 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-11236964-083a-4c72-a390-f8c39b23ea3b tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:17.086713 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-11236964-083a-4c72-a390-f8c39b23ea3b tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:17.087491 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-11236964-083a-4c72-a390-f8c39b23ea3b tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:17.088024 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-11236964-083a-4c72-a390-f8c39b23ea3b tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:17.129055 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-11236964-083a-4c72-a390-f8c39b23ea3b tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] HTTP exception thrown: Instance af3e9546-9a60-424a-8d98-234b08364d1d could not be found. Oct 04 18:45:17.130804 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-11236964-083a-4c72-a390-f8c39b23ea3b tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Request method failure captured: Oct 04 18:45:17.130804 n-d-850501-14 devstack@n-api.service[123001]: request: DELETE /compute/v2.1/servers/af3e9546-9a60-424a-8d98-234b08364d1d HTTP/1.1 Oct 04 18:45:17.130804 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:45:17.130804 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:45:17.130804 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:45:17.130804 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:45:17.130804 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:45:17.130804 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:45:17.130804 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:45:17.130804 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:45:17.130804 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPH5kaFyiFSIO0ZP4CMGEO428dJiNuEG6R-LLS8mNsVetgcf6w0D7DIrYZ_G7YOzpJ5huW8oCnx3-jlxIKVdxxsS18taUnXx6Xt5KnL4IkhJLGYxbDrAUBLCXM7M3o65rqEELwzRRnK71NdjnupluHpvvCSPBSNhy32oTLBkDAxSrOgs Oct 04 18:45:17.130804 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:45:17.130804 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:45:17.130804 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:45:17.130804 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:45:17.130804 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:45:17.130804 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:45:17.130804 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: a9046b9540144eeba512d79438635ea8 Oct 04 18:45:17.130804 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ServersTestJSON-380527700 Oct 04 18:45:17.130804 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:45:17.130804 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:45:17.130804 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a9046b9540144eeba512d79438635ea8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a9046b9540144eeba512d79438635ea8", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a9046b9540144eeba512d79438635ea8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a9046b9540144eeba512d79438635ea8"}]}] Oct 04 18:45:17.130804 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ServersTestJSON-380527700 Oct 04 18:45:17.130804 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: a9046b9540144eeba512d79438635ea8 Oct 04 18:45:17.130804 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ServersTestJSON-380527700 Oct 04 18:45:17.130804 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ServersTestJSON-380527700-project Oct 04 18:45:17.130804 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:45:17.130804 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:45:17.130804 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 8a6c3725b31449d5bf1ff757ff66c8d7 Oct 04 18:45:17.130804 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ServersTestJSON-380527700-project Oct 04 18:45:17.130804 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:45:17.130804 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance af3e9546-9a60-424a-8d98-234b08364d1d could not be found. Oct 04 18:45:17.130804 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': 'af3e9546-9a60-424a-8d98-234b08364d1d'} Oct 04 18:45:17.130804 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:45:17.130804 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:17.130804 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:45:17.130804 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:45:17.130804 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:45:17.130804 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:45:17.130804 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:45:17.130804 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:45:17.130804 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:45:17.130804 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:45:17.130804 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af3e9546-9a60-424a-8d98-234b08364d1d could not be found. Oct 04 18:45:17.130804 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:45:17.130804 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:17.130804 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:45:17.130804 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:17.130804 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:45:17.130804 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:45:17.130804 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:45:17.130804 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:45:17.130804 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:45:17.130804 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:45:17.130804 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:45:17.130804 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:45:17.130804 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:45:17.130804 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:45:17.130804 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:45:17.130804 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:45:17.130804 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:45:17.130804 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:45:17.130804 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af3e9546-9a60-424a-8d98-234b08364d1d could not be found. Oct 04 18:45:17.138275 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:45:17.138275 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:17.138275 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:45:17.138275 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:17.138275 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:45:17.138275 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:45:17.138275 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:45:17.138275 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:45:17.138275 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af3e9546-9a60-424a-8d98-234b08364d1d could not be found. Oct 04 18:45:17.138275 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:45:17.138275 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-11236964-083a-4c72-a390-f8c39b23ea3b tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Returning 404 to user: Instance af3e9546-9a60-424a-8d98-234b08364d1d could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:45:17.141980 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ecf44665-d833-4f24-ba22-1208e49101fe tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:17.142499 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-11236964-083a-4c72-a390-f8c39b23ea3b tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "DELETE /compute/v2.1/servers/af3e9546-9a60-424a-8d98-234b08364d1d" status: 404 len: 111 microversion: 2.1 time: 0.083356 Oct 04 18:45:17.142661 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ecf44665-d833-4f24-ba22-1208e49101fe tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] [instance: 0c9b24a2-ed48-4175-89ef-c8b7971acd39] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:17.143306 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2108/4166] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:45:17 2022] DELETE /compute/v2.1/servers/af3e9546-9a60-424a-8d98-234b08364d1d => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:45:17.153657 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9e1b7a2a-6034-423d-8311-427fee91c6e4 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:17.156861 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ecf44665-d833-4f24-ba22-1208e49101fe tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:17.159365 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-9e1b7a2a-6034-423d-8311-427fee91c6e4 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: af3e9546-9a60-424a-8d98-234b08364d1d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:17.160366 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ecf44665-d833-4f24-ba22-1208e49101fe tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:17.160824 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ecf44665-d833-4f24-ba22-1208e49101fe tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:17.161570 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ecf44665-d833-4f24-ba22-1208e49101fe tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:17.164638 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ecf44665-d833-4f24-ba22-1208e49101fe tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:17.165094 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ecf44665-d833-4f24-ba22-1208e49101fe tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:17.195364 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9e1b7a2a-6034-423d-8311-427fee91c6e4 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:17.197660 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9e1b7a2a-6034-423d-8311-427fee91c6e4 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:17.198605 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9e1b7a2a-6034-423d-8311-427fee91c6e4 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:17.200910 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9e1b7a2a-6034-423d-8311-427fee91c6e4 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:17.203674 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9e1b7a2a-6034-423d-8311-427fee91c6e4 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:17.206228 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9e1b7a2a-6034-423d-8311-427fee91c6e4 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:17.243947 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-9e1b7a2a-6034-423d-8311-427fee91c6e4 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] HTTP exception thrown: Instance af3e9546-9a60-424a-8d98-234b08364d1d could not be found. Oct 04 18:45:17.248867 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9e1b7a2a-6034-423d-8311-427fee91c6e4 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Request method failure captured: Oct 04 18:45:17.248867 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/af3e9546-9a60-424a-8d98-234b08364d1d HTTP/1.1 Oct 04 18:45:17.248867 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:45:17.248867 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:45:17.248867 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:45:17.248867 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:45:17.248867 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:45:17.248867 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:45:17.248867 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:45:17.248867 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:45:17.248867 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPH5kaFyiFSIO0ZP4CMGEO428dJiNuEG6R-LLS8mNsVetgcf6w0D7DIrYZ_G7YOzpJ5huW8oCnx3-jlxIKVdxxsS18taUnXx6Xt5KnL4IkhJLGYxbDrAUBLCXM7M3o65rqEELwzRRnK71NdjnupluHpvvCSPBSNhy32oTLBkDAxSrOgs Oct 04 18:45:17.248867 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:45:17.248867 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:45:17.248867 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:45:17.248867 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:45:17.248867 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:45:17.248867 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:45:17.248867 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: a9046b9540144eeba512d79438635ea8 Oct 04 18:45:17.248867 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ServersTestJSON-380527700 Oct 04 18:45:17.248867 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:45:17.248867 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:45:17.248867 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a9046b9540144eeba512d79438635ea8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a9046b9540144eeba512d79438635ea8", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a9046b9540144eeba512d79438635ea8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a9046b9540144eeba512d79438635ea8"}]}] Oct 04 18:45:17.248867 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ServersTestJSON-380527700 Oct 04 18:45:17.248867 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: a9046b9540144eeba512d79438635ea8 Oct 04 18:45:17.248867 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ServersTestJSON-380527700 Oct 04 18:45:17.248867 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ServersTestJSON-380527700-project Oct 04 18:45:17.248867 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:45:17.248867 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:45:17.248867 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 8a6c3725b31449d5bf1ff757ff66c8d7 Oct 04 18:45:17.248867 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ServersTestJSON-380527700-project Oct 04 18:45:17.248867 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:45:17.248867 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance af3e9546-9a60-424a-8d98-234b08364d1d could not be found. Oct 04 18:45:17.248867 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': 'af3e9546-9a60-424a-8d98-234b08364d1d'} Oct 04 18:45:17.248867 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:45:17.248867 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:17.248867 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:45:17.248867 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:45:17.248867 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:45:17.248867 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:45:17.248867 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:45:17.248867 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:45:17.248867 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:45:17.248867 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:45:17.248867 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af3e9546-9a60-424a-8d98-234b08364d1d could not be found. Oct 04 18:45:17.248867 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:45:17.248867 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:17.248867 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:45:17.248867 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:17.248867 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:45:17.248867 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:45:17.248867 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:45:17.248867 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:45:17.248867 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:45:17.248867 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:45:17.248867 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:45:17.248867 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:45:17.248867 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:45:17.248867 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:45:17.248867 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:45:17.248867 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:45:17.248867 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af3e9546-9a60-424a-8d98-234b08364d1d could not be found. Oct 04 18:45:17.248867 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:45:17.248867 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:17.248867 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:45:17.248867 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:17.253710 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:45:17.253710 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:45:17.253710 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:45:17.253710 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:45:17.253710 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af3e9546-9a60-424a-8d98-234b08364d1d could not be found. Oct 04 18:45:17.253710 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:45:17.257889 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9e1b7a2a-6034-423d-8311-427fee91c6e4 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Returning 404 to user: Instance af3e9546-9a60-424a-8d98-234b08364d1d could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:45:17.260448 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9e1b7a2a-6034-423d-8311-427fee91c6e4 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/af3e9546-9a60-424a-8d98-234b08364d1d" status: 404 len: 111 microversion: 2.1 time: 0.112713 Oct 04 18:45:17.268475 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2109/4167] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:17 2022] GET /compute/v2.1/servers/af3e9546-9a60-424a-8d98-234b08364d1d => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:45:17.274759 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2d683734-db31-417c-95ab-b3fa74fe8ee5 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:17.276038 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2d683734-db31-417c-95ab-b3fa74fe8ee5 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 5d0453aa-4e6d-4362-885b-4a2b91a826f6] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:17.284463 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-2d683734-db31-417c-95ab-b3fa74fe8ee5 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] HTTP exception thrown: Instance 5d0453aa-4e6d-4362-885b-4a2b91a826f6 could not be found. Oct 04 18:45:17.286302 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2d683734-db31-417c-95ab-b3fa74fe8ee5 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Request method failure captured: Oct 04 18:45:17.286302 n-d-850501-14 devstack@n-api.service[123001]: request: DELETE /compute/v2.1/servers/5d0453aa-4e6d-4362-885b-4a2b91a826f6 HTTP/1.1 Oct 04 18:45:17.286302 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:45:17.286302 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:45:17.286302 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:45:17.286302 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:45:17.286302 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:45:17.286302 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:45:17.286302 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:45:17.286302 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:45:17.286302 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPH5kaFyiFSIO0ZP4CMGEO428dJiNuEG6R-LLS8mNsVetgcf6w0D7DIrYZ_G7YOzpJ5huW8oCnx3-jlxIKVdxxsS18taUnXx6Xt5KnL4IkhJLGYxbDrAUBLCXM7M3o65rqEELwzRRnK71NdjnupluHpvvCSPBSNhy32oTLBkDAxSrOgs Oct 04 18:45:17.286302 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:45:17.286302 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:45:17.286302 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:45:17.286302 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:45:17.286302 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:45:17.286302 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:45:17.286302 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: a9046b9540144eeba512d79438635ea8 Oct 04 18:45:17.286302 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ServersTestJSON-380527700 Oct 04 18:45:17.286302 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:45:17.286302 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:45:17.286302 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a9046b9540144eeba512d79438635ea8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a9046b9540144eeba512d79438635ea8", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a9046b9540144eeba512d79438635ea8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a9046b9540144eeba512d79438635ea8"}]}] Oct 04 18:45:17.286302 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ServersTestJSON-380527700 Oct 04 18:45:17.286302 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: a9046b9540144eeba512d79438635ea8 Oct 04 18:45:17.286302 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ServersTestJSON-380527700 Oct 04 18:45:17.286302 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ServersTestJSON-380527700-project Oct 04 18:45:17.286302 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:45:17.286302 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:45:17.286302 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 8a6c3725b31449d5bf1ff757ff66c8d7 Oct 04 18:45:17.286302 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ServersTestJSON-380527700-project Oct 04 18:45:17.286302 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:45:17.286302 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 5d0453aa-4e6d-4362-885b-4a2b91a826f6 could not be found. Oct 04 18:45:17.286302 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '5d0453aa-4e6d-4362-885b-4a2b91a826f6'} Oct 04 18:45:17.286302 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:45:17.286302 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:17.286302 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:45:17.286302 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:45:17.286302 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:45:17.286302 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:45:17.286302 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:45:17.286302 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:45:17.286302 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d0453aa-4e6d-4362-885b-4a2b91a826f6 could not be found. Oct 04 18:45:17.286302 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:45:17.286302 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:17.286302 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:45:17.286302 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:17.286302 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:45:17.286302 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:45:17.286302 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:45:17.286302 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:45:17.286302 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:45:17.286302 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:45:17.286302 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:45:17.286302 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:45:17.286302 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:45:17.286302 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:45:17.286302 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:45:17.286302 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:45:17.286302 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:45:17.286302 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:45:17.286302 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d0453aa-4e6d-4362-885b-4a2b91a826f6 could not be found. Oct 04 18:45:17.286302 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:45:17.286302 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:17.286302 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:45:17.292571 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:17.292571 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:45:17.292571 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:45:17.292571 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:45:17.292571 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:45:17.292571 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d0453aa-4e6d-4362-885b-4a2b91a826f6 could not be found. Oct 04 18:45:17.292571 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:45:17.294920 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2d683734-db31-417c-95ab-b3fa74fe8ee5 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Returning 404 to user: Instance 5d0453aa-4e6d-4362-885b-4a2b91a826f6 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:45:17.296945 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2d683734-db31-417c-95ab-b3fa74fe8ee5 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5d0453aa-4e6d-4362-885b-4a2b91a826f6" status: 404 len: 111 microversion: 2.1 time: 0.026103 Oct 04 18:45:17.301655 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2110/4168] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:45:17 2022] DELETE /compute/v2.1/servers/5d0453aa-4e6d-4362-885b-4a2b91a826f6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:45:17.307376 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0f227a20-01da-4c36-81c1-c938e6dd753e tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:17.308451 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0f227a20-01da-4c36-81c1-c938e6dd753e tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 5d0453aa-4e6d-4362-885b-4a2b91a826f6] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:17.315264 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-0f227a20-01da-4c36-81c1-c938e6dd753e tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] HTTP exception thrown: Instance 5d0453aa-4e6d-4362-885b-4a2b91a826f6 could not be found. Oct 04 18:45:17.317438 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0f227a20-01da-4c36-81c1-c938e6dd753e tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Request method failure captured: Oct 04 18:45:17.317438 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/5d0453aa-4e6d-4362-885b-4a2b91a826f6 HTTP/1.1 Oct 04 18:45:17.317438 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:45:17.317438 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:45:17.317438 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:45:17.317438 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:45:17.317438 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:45:17.317438 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:45:17.317438 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:45:17.317438 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:45:17.317438 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPH5kaFyiFSIO0ZP4CMGEO428dJiNuEG6R-LLS8mNsVetgcf6w0D7DIrYZ_G7YOzpJ5huW8oCnx3-jlxIKVdxxsS18taUnXx6Xt5KnL4IkhJLGYxbDrAUBLCXM7M3o65rqEELwzRRnK71NdjnupluHpvvCSPBSNhy32oTLBkDAxSrOgs Oct 04 18:45:17.317438 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:45:17.317438 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:45:17.317438 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:45:17.317438 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:45:17.317438 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:45:17.317438 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:45:17.317438 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: a9046b9540144eeba512d79438635ea8 Oct 04 18:45:17.317438 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ServersTestJSON-380527700 Oct 04 18:45:17.317438 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:45:17.317438 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:45:17.317438 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a9046b9540144eeba512d79438635ea8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a9046b9540144eeba512d79438635ea8", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a9046b9540144eeba512d79438635ea8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a9046b9540144eeba512d79438635ea8"}]}] Oct 04 18:45:17.317438 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ServersTestJSON-380527700 Oct 04 18:45:17.317438 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: a9046b9540144eeba512d79438635ea8 Oct 04 18:45:17.317438 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ServersTestJSON-380527700 Oct 04 18:45:17.317438 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ServersTestJSON-380527700-project Oct 04 18:45:17.317438 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:45:17.317438 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:45:17.317438 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 8a6c3725b31449d5bf1ff757ff66c8d7 Oct 04 18:45:17.317438 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ServersTestJSON-380527700-project Oct 04 18:45:17.317438 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:45:17.317438 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 5d0453aa-4e6d-4362-885b-4a2b91a826f6 could not be found. Oct 04 18:45:17.317438 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '5d0453aa-4e6d-4362-885b-4a2b91a826f6'} Oct 04 18:45:17.317438 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:45:17.317438 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:17.317438 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:45:17.317438 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:45:17.317438 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:45:17.317438 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:45:17.317438 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:45:17.317438 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:45:17.317438 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d0453aa-4e6d-4362-885b-4a2b91a826f6 could not be found. Oct 04 18:45:17.317438 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:45:17.317438 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:17.317438 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:45:17.317438 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:17.317438 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:45:17.317438 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:45:17.317438 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:45:17.317438 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:45:17.317438 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:45:17.317438 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:45:17.317438 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:45:17.317438 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:45:17.317438 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:45:17.317438 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:45:17.317438 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:45:17.317438 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:45:17.317438 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d0453aa-4e6d-4362-885b-4a2b91a826f6 could not be found. Oct 04 18:45:17.317438 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:45:17.317438 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:17.317438 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:45:17.317438 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:17.317438 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:45:17.317438 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:45:17.322082 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:45:17.322082 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:45:17.322082 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d0453aa-4e6d-4362-885b-4a2b91a826f6 could not be found. Oct 04 18:45:17.322082 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:45:17.323838 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0f227a20-01da-4c36-81c1-c938e6dd753e tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Returning 404 to user: Instance 5d0453aa-4e6d-4362-885b-4a2b91a826f6 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:45:17.326512 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0f227a20-01da-4c36-81c1-c938e6dd753e tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/5d0453aa-4e6d-4362-885b-4a2b91a826f6" status: 404 len: 111 microversion: 2.1 time: 0.023595 Oct 04 18:45:17.328556 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2111/4169] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:17 2022] GET /compute/v2.1/servers/5d0453aa-4e6d-4362-885b-4a2b91a826f6 => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:45:17.337155 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2a8eb902-63a6-4592-b61c-0d520290cd97 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:17.346284 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2a8eb902-63a6-4592-b61c-0d520290cd97 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 92b36041-4d94-4ae6-b0cd-e51306a17de0] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:17.357492 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2a8eb902-63a6-4592-b61c-0d520290cd97 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:17.358361 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2a8eb902-63a6-4592-b61c-0d520290cd97 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:17.359022 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2a8eb902-63a6-4592-b61c-0d520290cd97 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:17.365159 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2a8eb902-63a6-4592-b61c-0d520290cd97 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:17.365971 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2a8eb902-63a6-4592-b61c-0d520290cd97 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:17.366587 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2a8eb902-63a6-4592-b61c-0d520290cd97 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:17.426644 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2a8eb902-63a6-4592-b61c-0d520290cd97 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 92b36041-4d94-4ae6-b0cd-e51306a17de0] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:45:17.438942 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ecf44665-d833-4f24-ba22-1208e49101fe tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e54eaa927e2848869093e0ec11904929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a4914508df43b0afac3ffdf3b85b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:17.451492 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ecf44665-d833-4f24-ba22-1208e49101fe tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] 10.222.0.20 "GET /compute/v2.1/servers/0c9b24a2-ed48-4175-89ef-c8b7971acd39" status: 200 len: 1712 microversion: 2.1 time: 0.314342 Oct 04 18:45:17.470491 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2059/4170] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:17 2022] GET /compute/v2.1/servers/0c9b24a2-ed48-4175-89ef-c8b7971acd39 => generated 1712 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:45:17.668082 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-64614cee-2361-4da8-84a8-4715f76e2a9b tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:17.670184 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-64614cee-2361-4da8-84a8-4715f76e2a9b tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] [instance: d46bd79f-eda9-4149-b4aa-788520147af7] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:17.682038 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-64614cee-2361-4da8-84a8-4715f76e2a9b tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:17.684843 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-64614cee-2361-4da8-84a8-4715f76e2a9b tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:17.686506 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-64614cee-2361-4da8-84a8-4715f76e2a9b tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:17.689087 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-64614cee-2361-4da8-84a8-4715f76e2a9b tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:17.690454 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-64614cee-2361-4da8-84a8-4715f76e2a9b tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:17.692687 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-64614cee-2361-4da8-84a8-4715f76e2a9b tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:17.846128 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2a8eb902-63a6-4592-b61c-0d520290cd97 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "DELETE /compute/v2.1/servers/92b36041-4d94-4ae6-b0cd-e51306a17de0" status: 204 len: 0 microversion: 2.1 time: 0.510307 Oct 04 18:45:17.849909 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2112/4171] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:45:17 2022] DELETE /compute/v2.1/servers/92b36041-4d94-4ae6-b0cd-e51306a17de0 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:45:17.855342 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9e61c422-17ea-45d8-a308-f6286f3d91eb tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:17.859888 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-9e61c422-17ea-45d8-a308-f6286f3d91eb tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] [instance: 3d3cabc2-fa23-4098-9197-9aaa19a0c663] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:17.874777 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9e61c422-17ea-45d8-a308-f6286f3d91eb tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:17.875476 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9e61c422-17ea-45d8-a308-f6286f3d91eb tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:17.876086 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9e61c422-17ea-45d8-a308-f6286f3d91eb tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:17.876848 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9e61c422-17ea-45d8-a308-f6286f3d91eb tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:17.877298 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9e61c422-17ea-45d8-a308-f6286f3d91eb tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:17.879352 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9e61c422-17ea-45d8-a308-f6286f3d91eb tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:18.572047 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9e61c422-17ea-45d8-a308-f6286f3d91eb tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:18.608603 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9e61c422-17ea-45d8-a308-f6286f3d91eb tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:18.610311 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9e61c422-17ea-45d8-a308-f6286f3d91eb tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:18.611479 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9e61c422-17ea-45d8-a308-f6286f3d91eb tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] 10.222.0.20 "GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663" status: 200 len: 1604 microversion: 2.42 time: 0.762689 Oct 04 18:45:18.616596 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2113/4172] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:45:17 2022] GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663 => generated 1604 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:45:18.623104 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e66423a4-b482-454e-bb66-68a7595da218 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:18.623947 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e66423a4-b482-454e-bb66-68a7595da218 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 92b36041-4d94-4ae6-b0cd-e51306a17de0] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:18.631367 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e66423a4-b482-454e-bb66-68a7595da218 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:18.632107 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e66423a4-b482-454e-bb66-68a7595da218 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:18.632897 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e66423a4-b482-454e-bb66-68a7595da218 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:18.633841 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e66423a4-b482-454e-bb66-68a7595da218 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:18.634580 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e66423a4-b482-454e-bb66-68a7595da218 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:18.635328 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e66423a4-b482-454e-bb66-68a7595da218 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:18.855516 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-64614cee-2361-4da8-84a8-4715f76e2a9b tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a02cd1108b947b186202f6d15e6cf0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c0b095138354810949093e7ea03b8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:18.868886 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-64614cee-2361-4da8-84a8-4715f76e2a9b tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] 10.222.0.20 "GET /compute/v2.1/servers/d46bd79f-eda9-4149-b4aa-788520147af7" status: 200 len: 1507 microversion: 2.1 time: 1.205724 Oct 04 18:45:18.872631 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2060/4173] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:17 2022] GET /compute/v2.1/servers/d46bd79f-eda9-4149-b4aa-788520147af7 => generated 1507 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:18.901594 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-49e630c3-f13c-4cce-bf75-17a5bc3551bf tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:18.911087 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-49e630c3-f13c-4cce-bf75-17a5bc3551bf tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: 4d6dfac0-958d-4698-a050-6539caebe52c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:18.924945 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-49e630c3-f13c-4cce-bf75-17a5bc3551bf tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:18.930360 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-49e630c3-f13c-4cce-bf75-17a5bc3551bf tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:18.931507 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-49e630c3-f13c-4cce-bf75-17a5bc3551bf tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:18.935616 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-49e630c3-f13c-4cce-bf75-17a5bc3551bf tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:18.936785 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-49e630c3-f13c-4cce-bf75-17a5bc3551bf tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:18.937470 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-49e630c3-f13c-4cce-bf75-17a5bc3551bf tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:19.118463 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e66423a4-b482-454e-bb66-68a7595da218 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:19.132920 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e66423a4-b482-454e-bb66-68a7595da218 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/92b36041-4d94-4ae6-b0cd-e51306a17de0" status: 200 len: 1479 microversion: 2.1 time: 0.513095 Oct 04 18:45:19.135314 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2114/4174] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:18 2022] GET /compute/v2.1/servers/92b36041-4d94-4ae6-b0cd-e51306a17de0 => generated 1479 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:19.148590 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-57e6af01-d73b-42cf-82f2-07be80914511 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:19.149237 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-57e6af01-d73b-42cf-82f2-07be80914511 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] [instance: 0c9b24a2-ed48-4175-89ef-c8b7971acd39] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:19.179270 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-57e6af01-d73b-42cf-82f2-07be80914511 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:19.180528 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-57e6af01-d73b-42cf-82f2-07be80914511 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:19.184972 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-57e6af01-d73b-42cf-82f2-07be80914511 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:19.186126 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-57e6af01-d73b-42cf-82f2-07be80914511 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:19.189005 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-57e6af01-d73b-42cf-82f2-07be80914511 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:19.194741 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-57e6af01-d73b-42cf-82f2-07be80914511 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:19.488403 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-57e6af01-d73b-42cf-82f2-07be80914511 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e54eaa927e2848869093e0ec11904929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a4914508df43b0afac3ffdf3b85b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:19.500273 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-57e6af01-d73b-42cf-82f2-07be80914511 tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] 10.222.0.20 "GET /compute/v2.1/servers/0c9b24a2-ed48-4175-89ef-c8b7971acd39" status: 200 len: 1645 microversion: 2.1 time: 0.363502 Oct 04 18:45:19.502634 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2115/4175] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:19 2022] GET /compute/v2.1/servers/0c9b24a2-ed48-4175-89ef-c8b7971acd39 => generated 1645 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:19.630659 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-49e630c3-f13c-4cce-bf75-17a5bc3551bf tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:19.641901 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-45cfa60b-3da9-4955-a5f1-967abcf6b763 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:19.642492 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-45cfa60b-3da9-4955-a5f1-967abcf6b763 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] [instance: 3d3cabc2-fa23-4098-9197-9aaa19a0c663] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:19.644664 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-49e630c3-f13c-4cce-bf75-17a5bc3551bf tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c" status: 200 len: 1721 microversion: 2.1 time: 0.768643 Oct 04 18:45:19.646161 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2061/4176] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:18 2022] GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c => generated 1721 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:19.649628 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-45cfa60b-3da9-4955-a5f1-967abcf6b763 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:19.650118 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-45cfa60b-3da9-4955-a5f1-967abcf6b763 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:19.658394 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-45cfa60b-3da9-4955-a5f1-967abcf6b763 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:19.658394 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-45cfa60b-3da9-4955-a5f1-967abcf6b763 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:19.658394 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-45cfa60b-3da9-4955-a5f1-967abcf6b763 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:19.658394 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-45cfa60b-3da9-4955-a5f1-967abcf6b763 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:19.896413 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-33da832f-5263-4871-8552-63be8289ef94 req-1d828788-9fb8-4ef6-93f4-b8aefc7e5e05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c9b24a2-ed48-4175-89ef-c8b7971acd39", "name": "network-vif-deleted", "tag": "cc638c0b-6f43-4ac9-b7bb-c32809d8d85f"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:45:19.945676 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-33da832f-5263-4871-8552-63be8289ef94 req-1d828788-9fb8-4ef6-93f4-b8aefc7e5e05 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:19.949278 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-33da832f-5263-4871-8552-63be8289ef94 req-1d828788-9fb8-4ef6-93f4-b8aefc7e5e05 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:19.952176 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-33da832f-5263-4871-8552-63be8289ef94 req-1d828788-9fb8-4ef6-93f4-b8aefc7e5e05 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:20.036204 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-33da832f-5263-4871-8552-63be8289ef94 req-1d828788-9fb8-4ef6-93f4-b8aefc7e5e05 service nova] Creating event network-vif-deleted:cc638c0b-6f43-4ac9-b7bb-c32809d8d85f for instance 0c9b24a2-ed48-4175-89ef-c8b7971acd39 on n-h2-850501-14 Oct 04 18:45:20.060938 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-33da832f-5263-4871-8552-63be8289ef94 req-1d828788-9fb8-4ef6-93f4-b8aefc7e5e05 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165024 Oct 04 18:45:20.061559 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2062/4177] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:45:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 04 18:45:20.145830 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-45cfa60b-3da9-4955-a5f1-967abcf6b763 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:20.163718 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1fa5713e-776b-4df6-8e99-878adc9c6596 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:20.164502 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1fa5713e-776b-4df6-8e99-878adc9c6596 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 92b36041-4d94-4ae6-b0cd-e51306a17de0] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:20.180759 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-45cfa60b-3da9-4955-a5f1-967abcf6b763 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:20.181286 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1fa5713e-776b-4df6-8e99-878adc9c6596 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:20.186522 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1fa5713e-776b-4df6-8e99-878adc9c6596 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:20.187121 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1fa5713e-776b-4df6-8e99-878adc9c6596 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:20.192578 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1fa5713e-776b-4df6-8e99-878adc9c6596 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:20.194365 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-45cfa60b-3da9-4955-a5f1-967abcf6b763 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:20.198944 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-45cfa60b-3da9-4955-a5f1-967abcf6b763 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] 10.222.0.20 "GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663" status: 200 len: 1604 microversion: 2.42 time: 0.557488 Oct 04 18:45:20.211474 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1fa5713e-776b-4df6-8e99-878adc9c6596 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:20.214563 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1fa5713e-776b-4df6-8e99-878adc9c6596 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:20.226438 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2116/4178] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:45:19 2022] GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663 => generated 1604 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:45:20.530887 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f231b5eb-bea3-43fd-93e7-c534bd87ca8b tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:20.531789 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f231b5eb-bea3-43fd-93e7-c534bd87ca8b tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] [instance: 0c9b24a2-ed48-4175-89ef-c8b7971acd39] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:20.550676 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f231b5eb-bea3-43fd-93e7-c534bd87ca8b tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:20.552627 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f231b5eb-bea3-43fd-93e7-c534bd87ca8b tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:20.553084 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f231b5eb-bea3-43fd-93e7-c534bd87ca8b tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:20.553826 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f231b5eb-bea3-43fd-93e7-c534bd87ca8b tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:20.561966 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f231b5eb-bea3-43fd-93e7-c534bd87ca8b tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:20.562531 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f231b5eb-bea3-43fd-93e7-c534bd87ca8b tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:20.695432 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f231b5eb-bea3-43fd-93e7-c534bd87ca8b tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:20.695432 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f231b5eb-bea3-43fd-93e7-c534bd87ca8b tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:20.695432 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f231b5eb-bea3-43fd-93e7-c534bd87ca8b tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:20.695432 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-f231b5eb-bea3-43fd-93e7-c534bd87ca8b tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lazy-loading 'fault' on Instance uuid 0c9b24a2-ed48-4175-89ef-c8b7971acd39 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:45:20.826993 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f231b5eb-bea3-43fd-93e7-c534bd87ca8b tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e54eaa927e2848869093e0ec11904929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a4914508df43b0afac3ffdf3b85b36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:20.862246 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f231b5eb-bea3-43fd-93e7-c534bd87ca8b tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] 10.222.0.20 "GET /compute/v2.1/servers/0c9b24a2-ed48-4175-89ef-c8b7971acd39" status: 200 len: 1366 microversion: 2.1 time: 0.336487 Oct 04 18:45:20.864768 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2117/4179] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:20 2022] GET /compute/v2.1/servers/0c9b24a2-ed48-4175-89ef-c8b7971acd39 => generated 1366 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:45:20.885793 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1d1884e9-c966-4d4c-91e8-896d44c521f0 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:20.887367 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1d1884e9-c966-4d4c-91e8-896d44c521f0 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: 4d6dfac0-958d-4698-a050-6539caebe52c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:20.902309 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1d1884e9-c966-4d4c-91e8-896d44c521f0 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:20.903978 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1d1884e9-c966-4d4c-91e8-896d44c521f0 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:20.904665 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1d1884e9-c966-4d4c-91e8-896d44c521f0 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:20.906152 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1d1884e9-c966-4d4c-91e8-896d44c521f0 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:20.919946 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1d1884e9-c966-4d4c-91e8-896d44c521f0 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:20.923114 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1d1884e9-c966-4d4c-91e8-896d44c521f0 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:21.026523 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1fa5713e-776b-4df6-8e99-878adc9c6596 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:21.063169 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1fa5713e-776b-4df6-8e99-878adc9c6596 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/92b36041-4d94-4ae6-b0cd-e51306a17de0" status: 200 len: 1479 microversion: 2.1 time: 0.905957 Oct 04 18:45:21.068997 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2063/4180] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:20 2022] GET /compute/v2.1/servers/92b36041-4d94-4ae6-b0cd-e51306a17de0 => generated 1479 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:21.233279 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-febda28c-c17e-4357-8540-b0f8ed067001 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:21.234306 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-febda28c-c17e-4357-8540-b0f8ed067001 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] [instance: 3d3cabc2-fa23-4098-9197-9aaa19a0c663] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:21.252822 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-febda28c-c17e-4357-8540-b0f8ed067001 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:21.252822 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-febda28c-c17e-4357-8540-b0f8ed067001 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:21.252822 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-febda28c-c17e-4357-8540-b0f8ed067001 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:21.254092 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-febda28c-c17e-4357-8540-b0f8ed067001 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:21.254785 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-febda28c-c17e-4357-8540-b0f8ed067001 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:21.255710 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-febda28c-c17e-4357-8540-b0f8ed067001 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:21.545244 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-febda28c-c17e-4357-8540-b0f8ed067001 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:21.570191 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-febda28c-c17e-4357-8540-b0f8ed067001 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:21.575377 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-febda28c-c17e-4357-8540-b0f8ed067001 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:21.578417 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-febda28c-c17e-4357-8540-b0f8ed067001 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] 10.222.0.20 "GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663" status: 200 len: 1604 microversion: 2.42 time: 0.350744 Oct 04 18:45:21.579067 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2064/4181] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:45:21 2022] GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663 => generated 1604 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:45:21.617656 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1d1884e9-c966-4d4c-91e8-896d44c521f0 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:21.640784 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1d1884e9-c966-4d4c-91e8-896d44c521f0 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c" status: 200 len: 1727 microversion: 2.1 time: 0.758702 Oct 04 18:45:21.641775 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2118/4182] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:20 2022] GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c => generated 1727 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:21.678349 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-69f19446-41e4-419d-96fa-34ae879ce551 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:21.678855 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-69f19446-41e4-419d-96fa-34ae879ce551 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: 4d6dfac0-958d-4698-a050-6539caebe52c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:21.693853 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-69f19446-41e4-419d-96fa-34ae879ce551 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:21.694349 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-69f19446-41e4-419d-96fa-34ae879ce551 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:21.694780 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-69f19446-41e4-419d-96fa-34ae879ce551 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:21.701835 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-69f19446-41e4-419d-96fa-34ae879ce551 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:21.702431 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-69f19446-41e4-419d-96fa-34ae879ce551 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:21.703967 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-69f19446-41e4-419d-96fa-34ae879ce551 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:21.895293 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-70a6ee92-a112-4de1-879f-88d85263c9ec tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:21.896033 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-70a6ee92-a112-4de1-879f-88d85263c9ec tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] [instance: 0c9b24a2-ed48-4175-89ef-c8b7971acd39] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:21.906017 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-69f19446-41e4-419d-96fa-34ae879ce551 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.234626 Oct 04 18:45:21.906234 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-70a6ee92-a112-4de1-879f-88d85263c9ec tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:21.906618 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2065/4183] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Oct 4 18:45:21 2022] GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c/os-interface => generated 284 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:45:21.907247 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-70a6ee92-a112-4de1-879f-88d85263c9ec tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:21.909083 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-70a6ee92-a112-4de1-879f-88d85263c9ec tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:21.909805 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-70a6ee92-a112-4de1-879f-88d85263c9ec tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:21.910268 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-70a6ee92-a112-4de1-879f-88d85263c9ec tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:21.910700 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-70a6ee92-a112-4de1-879f-88d85263c9ec tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:21.949326 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-70a6ee92-a112-4de1-879f-88d85263c9ec tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] HTTP exception thrown: Instance 0c9b24a2-ed48-4175-89ef-c8b7971acd39 could not be found. Oct 04 18:45:21.954704 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-70a6ee92-a112-4de1-879f-88d85263c9ec tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Request method failure captured: Oct 04 18:45:21.954704 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/0c9b24a2-ed48-4175-89ef-c8b7971acd39 HTTP/1.1 Oct 04 18:45:21.954704 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:45:21.954704 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:45:21.954704 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:45:21.954704 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:45:21.954704 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:45:21.954704 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:45:21.954704 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:45:21.954704 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:45:21.954704 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPH7PgRXlAULgQwpZMIXfsRriXs-eDQXXYAgVfeG4HdbbJ_C_0JQl0huhnKPgIioV64Me3OhFqo66ULtTZMlHzRyXPq43deUK5WtxOD3xJOFiSthvBfgbCVgMOVTI5FOVyCbyzll1PkF3di7bLVFNv-RHEE_WMaUGpWro-0Nof2b8tkM Oct 04 18:45:21.954704 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:45:21.954704 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:45:21.954704 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:45:21.954704 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:45:21.954704 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:45:21.954704 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:45:21.954704 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: e9a4914508df43b0afac3ffdf3b85b36 Oct 04 18:45:21.954704 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ServersTestManualDisk-1728645234 Oct 04 18:45:21.954704 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:45:21.954704 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:45:21.954704 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e9a4914508df43b0afac3ffdf3b85b36"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e9a4914508df43b0afac3ffdf3b85b36", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e9a4914508df43b0afac3ffdf3b85b36"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e9a4914508df43b0afac3ffdf3b85b36"}]}] Oct 04 18:45:21.954704 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ServersTestManualDisk-1728645234 Oct 04 18:45:21.954704 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: e9a4914508df43b0afac3ffdf3b85b36 Oct 04 18:45:21.954704 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ServersTestManualDisk-1728645234 Oct 04 18:45:21.954704 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ServersTestManualDisk-1728645234-project Oct 04 18:45:21.954704 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:45:21.954704 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:45:21.954704 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: e54eaa927e2848869093e0ec11904929 Oct 04 18:45:21.954704 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ServersTestManualDisk-1728645234-project Oct 04 18:45:21.954704 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:45:21.954704 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 0c9b24a2-ed48-4175-89ef-c8b7971acd39 could not be found. Oct 04 18:45:21.954704 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '0c9b24a2-ed48-4175-89ef-c8b7971acd39'} Oct 04 18:45:21.954704 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:45:21.954704 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:21.954704 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:45:21.954704 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:45:21.954704 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:45:21.954704 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:45:21.954704 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:45:21.954704 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:45:21.954704 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:45:21.954704 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:45:21.954704 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c9b24a2-ed48-4175-89ef-c8b7971acd39 could not be found. Oct 04 18:45:21.954704 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:45:21.954704 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:21.954704 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:45:21.954704 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:21.954704 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:45:21.954704 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:45:21.954704 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:45:21.954704 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:45:21.954704 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:45:21.954704 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:45:21.954704 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:45:21.954704 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:45:21.954704 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:45:21.954704 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:45:21.954704 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:45:21.954704 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:45:21.954704 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c9b24a2-ed48-4175-89ef-c8b7971acd39 could not be found. Oct 04 18:45:21.954704 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:45:21.954704 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:21.954704 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:45:21.962158 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:21.962158 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:45:21.962158 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:45:21.962158 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:45:21.962158 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:45:21.962158 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c9b24a2-ed48-4175-89ef-c8b7971acd39 could not be found. Oct 04 18:45:21.962158 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:45:21.966255 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-70a6ee92-a112-4de1-879f-88d85263c9ec tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Returning 404 to user: Instance 0c9b24a2-ed48-4175-89ef-c8b7971acd39 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:45:21.968888 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-70a6ee92-a112-4de1-879f-88d85263c9ec tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] 10.222.0.20 "GET /compute/v2.1/servers/0c9b24a2-ed48-4175-89ef-c8b7971acd39" status: 404 len: 111 microversion: 2.1 time: 0.079543 Oct 04 18:45:21.971521 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2119/4184] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:21 2022] GET /compute/v2.1/servers/0c9b24a2-ed48-4175-89ef-c8b7971acd39 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:45:21.980005 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9c69e9cc-df59-44a3-8f4b-bc50c580582e tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] Calling method '.version_select at 0x7fe253d8eaf0>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:22.098274 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a5b12f46-6451-4fd0-817f-4cfdee2bccbd tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:22.098617 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a5b12f46-6451-4fd0-817f-4cfdee2bccbd tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 92b36041-4d94-4ae6-b0cd-e51306a17de0] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:22.108181 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a5b12f46-6451-4fd0-817f-4cfdee2bccbd tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:22.108883 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a5b12f46-6451-4fd0-817f-4cfdee2bccbd tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:22.109501 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a5b12f46-6451-4fd0-817f-4cfdee2bccbd tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:22.110412 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a5b12f46-6451-4fd0-817f-4cfdee2bccbd tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:22.111087 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a5b12f46-6451-4fd0-817f-4cfdee2bccbd tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:22.112971 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a5b12f46-6451-4fd0-817f-4cfdee2bccbd tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:22.128247 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9c69e9cc-df59-44a3-8f4b-bc50c580582e tempest-ServersTestManualDisk-1728645234 tempest-ServersTestManualDisk-1728645234-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-299362034" status: 202 len: 0 microversion: 2.1 time: 0.152601 Oct 04 18:45:22.128842 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2066/4185] 10.222.0.20 () {58 vars in 1218 bytes} [Tue Oct 4 18:45:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-299362034 => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:45:22.186937 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-2fe44d58-2a2f-4107-a5eb-c2f1e62bf03a req-2dc2a2bd-8fec-41c2-a394-7744a0aaeafe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92b36041-4d94-4ae6-b0cd-e51306a17de0", "name": "network-vif-deleted", "tag": "4b73fe8f-ef6c-4798-be58-8cf726b237fe"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:45:22.230179 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-2fe44d58-2a2f-4107-a5eb-c2f1e62bf03a req-2dc2a2bd-8fec-41c2-a394-7744a0aaeafe service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:22.252848 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-2fe44d58-2a2f-4107-a5eb-c2f1e62bf03a req-2dc2a2bd-8fec-41c2-a394-7744a0aaeafe service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:22.253334 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-2fe44d58-2a2f-4107-a5eb-c2f1e62bf03a req-2dc2a2bd-8fec-41c2-a394-7744a0aaeafe service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:22.276242 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a5b12f46-6451-4fd0-817f-4cfdee2bccbd tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:22.280429 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a5b12f46-6451-4fd0-817f-4cfdee2bccbd tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:22.280930 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a5b12f46-6451-4fd0-817f-4cfdee2bccbd tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:22.291635 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-a5b12f46-6451-4fd0-817f-4cfdee2bccbd tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lazy-loading 'fault' on Instance uuid 92b36041-4d94-4ae6-b0cd-e51306a17de0 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:45:22.320104 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-2fe44d58-2a2f-4107-a5eb-c2f1e62bf03a req-2dc2a2bd-8fec-41c2-a394-7744a0aaeafe service nova] Creating event network-vif-deleted:4b73fe8f-ef6c-4798-be58-8cf726b237fe for instance 92b36041-4d94-4ae6-b0cd-e51306a17de0 on n-h1-850501-14 Oct 04 18:45:22.342430 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-2fe44d58-2a2f-4107-a5eb-c2f1e62bf03a req-2dc2a2bd-8fec-41c2-a394-7744a0aaeafe service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159874 Oct 04 18:45:22.343518 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2067/4186] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:45:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:45:22.411083 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a5b12f46-6451-4fd0-817f-4cfdee2bccbd tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6c3725b31449d5bf1ff757ff66c8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9046b9540144eeba512d79438635ea8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:22.424583 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a5b12f46-6451-4fd0-817f-4cfdee2bccbd tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/92b36041-4d94-4ae6-b0cd-e51306a17de0" status: 200 len: 1282 microversion: 2.1 time: 0.328018 Oct 04 18:45:22.426167 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2120/4187] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:22 2022] GET /compute/v2.1/servers/92b36041-4d94-4ae6-b0cd-e51306a17de0 => generated 1282 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:22.608099 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8f6bb428-20d8-4ea3-8918-ed8729ba5539 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:22.616346 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8f6bb428-20d8-4ea3-8918-ed8729ba5539 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] [instance: 3d3cabc2-fa23-4098-9197-9aaa19a0c663] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:22.636636 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8f6bb428-20d8-4ea3-8918-ed8729ba5539 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:22.637762 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8f6bb428-20d8-4ea3-8918-ed8729ba5539 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:22.642811 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8f6bb428-20d8-4ea3-8918-ed8729ba5539 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:22.643696 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8f6bb428-20d8-4ea3-8918-ed8729ba5539 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:22.647316 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8f6bb428-20d8-4ea3-8918-ed8729ba5539 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:22.648911 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8f6bb428-20d8-4ea3-8918-ed8729ba5539 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:22.703057 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:22.899007 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8f6bb428-20d8-4ea3-8918-ed8729ba5539 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:22.919251 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8f6bb428-20d8-4ea3-8918-ed8729ba5539 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:22.921032 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8f6bb428-20d8-4ea3-8918-ed8729ba5539 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:22.923983 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8f6bb428-20d8-4ea3-8918-ed8729ba5539 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] 10.222.0.20 "GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663" status: 200 len: 1604 microversion: 2.42 time: 0.320714 Oct 04 18:45:22.926349 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2068/4188] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:45:22 2022] GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663 => generated 1604 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:45:23.454788 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a71141d6-25a7-49b1-83e0-ea2189c517e0 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:23.455415 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a71141d6-25a7-49b1-83e0-ea2189c517e0 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] [instance: 92b36041-4d94-4ae6-b0cd-e51306a17de0] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:23.459261 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:23.462780 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a71141d6-25a7-49b1-83e0-ea2189c517e0 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:23.463275 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a71141d6-25a7-49b1-83e0-ea2189c517e0 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:23.472724 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a71141d6-25a7-49b1-83e0-ea2189c517e0 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:23.474074 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a71141d6-25a7-49b1-83e0-ea2189c517e0 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:23.474559 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a71141d6-25a7-49b1-83e0-ea2189c517e0 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:23.474992 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a71141d6-25a7-49b1-83e0-ea2189c517e0 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:23.506634 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-a71141d6-25a7-49b1-83e0-ea2189c517e0 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] HTTP exception thrown: Instance 92b36041-4d94-4ae6-b0cd-e51306a17de0 could not be found. Oct 04 18:45:23.511828 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a71141d6-25a7-49b1-83e0-ea2189c517e0 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Request method failure captured: Oct 04 18:45:23.511828 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/92b36041-4d94-4ae6-b0cd-e51306a17de0 HTTP/1.1 Oct 04 18:45:23.511828 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:45:23.511828 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:45:23.511828 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:45:23.511828 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:45:23.511828 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:45:23.511828 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:45:23.511828 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:45:23.511828 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:45:23.511828 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPH5kaFyiFSIO0ZP4CMGEO428dJiNuEG6R-LLS8mNsVetgcf6w0D7DIrYZ_G7YOzpJ5huW8oCnx3-jlxIKVdxxsS18taUnXx6Xt5KnL4IkhJLGYxbDrAUBLCXM7M3o65rqEELwzRRnK71NdjnupluHpvvCSPBSNhy32oTLBkDAxSrOgs Oct 04 18:45:23.511828 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:45:23.511828 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:45:23.511828 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:45:23.511828 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:45:23.511828 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:45:23.511828 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:45:23.511828 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: a9046b9540144eeba512d79438635ea8 Oct 04 18:45:23.511828 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ServersTestJSON-380527700 Oct 04 18:45:23.511828 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:45:23.511828 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:45:23.511828 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a9046b9540144eeba512d79438635ea8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a9046b9540144eeba512d79438635ea8", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a9046b9540144eeba512d79438635ea8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a9046b9540144eeba512d79438635ea8"}]}] Oct 04 18:45:23.511828 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ServersTestJSON-380527700 Oct 04 18:45:23.511828 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: a9046b9540144eeba512d79438635ea8 Oct 04 18:45:23.511828 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ServersTestJSON-380527700 Oct 04 18:45:23.511828 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ServersTestJSON-380527700-project Oct 04 18:45:23.511828 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:45:23.511828 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:45:23.511828 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 8a6c3725b31449d5bf1ff757ff66c8d7 Oct 04 18:45:23.511828 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ServersTestJSON-380527700-project Oct 04 18:45:23.511828 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:45:23.511828 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 92b36041-4d94-4ae6-b0cd-e51306a17de0 could not be found. Oct 04 18:45:23.511828 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '92b36041-4d94-4ae6-b0cd-e51306a17de0'} Oct 04 18:45:23.511828 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:45:23.511828 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:23.511828 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:45:23.511828 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:45:23.511828 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:45:23.511828 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:45:23.511828 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:45:23.511828 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:45:23.511828 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:45:23.511828 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:45:23.511828 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92b36041-4d94-4ae6-b0cd-e51306a17de0 could not be found. Oct 04 18:45:23.511828 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:45:23.511828 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:23.511828 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:45:23.511828 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:23.511828 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:45:23.511828 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:45:23.511828 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:45:23.511828 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:45:23.511828 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:45:23.511828 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:45:23.511828 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:45:23.511828 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:45:23.511828 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:45:23.511828 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:45:23.511828 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:45:23.511828 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:45:23.511828 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92b36041-4d94-4ae6-b0cd-e51306a17de0 could not be found. Oct 04 18:45:23.511828 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:45:23.511828 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:23.511828 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:45:23.511828 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:23.517470 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:45:23.517470 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:45:23.517470 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:45:23.517470 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:45:23.517470 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92b36041-4d94-4ae6-b0cd-e51306a17de0 could not be found. Oct 04 18:45:23.517470 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:45:23.520788 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a71141d6-25a7-49b1-83e0-ea2189c517e0 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] Returning 404 to user: Instance 92b36041-4d94-4ae6-b0cd-e51306a17de0 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:45:23.522967 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a71141d6-25a7-49b1-83e0-ea2189c517e0 tempest-ServersTestJSON-380527700 tempest-ServersTestJSON-380527700-project] 10.222.0.20 "GET /compute/v2.1/servers/92b36041-4d94-4ae6-b0cd-e51306a17de0" status: 404 len: 111 microversion: 2.1 time: 0.074282 Oct 04 18:45:23.531125 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2121/4189] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:23 2022] GET /compute/v2.1/servers/92b36041-4d94-4ae6-b0cd-e51306a17de0 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:45:23.779707 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b09b6dc8-3976-4e31-9eb1-f89808cfa469 tempest-VolumesAdminNegativeTest-1982715801 tempest-VolumesAdminNegativeTest-1982715801-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "7cbaf719-bce5-4569-adad-22865d7823f8"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:45:23.789396 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b09b6dc8-3976-4e31-9eb1-f89808cfa469 tempest-VolumesAdminNegativeTest-1982715801 tempest-VolumesAdminNegativeTest-1982715801-project-admin] [instance: d46bd79f-eda9-4149-b4aa-788520147af7] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:23.835604 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b09b6dc8-3976-4e31-9eb1-f89808cfa469 tempest-VolumesAdminNegativeTest-1982715801 tempest-VolumesAdminNegativeTest-1982715801-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:23.836250 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b09b6dc8-3976-4e31-9eb1-f89808cfa469 tempest-VolumesAdminNegativeTest-1982715801 tempest-VolumesAdminNegativeTest-1982715801-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:23.836703 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b09b6dc8-3976-4e31-9eb1-f89808cfa469 tempest-VolumesAdminNegativeTest-1982715801 tempest-VolumesAdminNegativeTest-1982715801-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:23.837440 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b09b6dc8-3976-4e31-9eb1-f89808cfa469 tempest-VolumesAdminNegativeTest-1982715801 tempest-VolumesAdminNegativeTest-1982715801-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:23.844233 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b09b6dc8-3976-4e31-9eb1-f89808cfa469 tempest-VolumesAdminNegativeTest-1982715801 tempest-VolumesAdminNegativeTest-1982715801-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:23.845133 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b09b6dc8-3976-4e31-9eb1-f89808cfa469 tempest-VolumesAdminNegativeTest-1982715801 tempest-VolumesAdminNegativeTest-1982715801-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:23.959943 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2874519e-67ed-47f1-9499-72a52883ce5f tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:23.960592 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2874519e-67ed-47f1-9499-72a52883ce5f tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] [instance: 3d3cabc2-fa23-4098-9197-9aaa19a0c663] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:23.973182 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2874519e-67ed-47f1-9499-72a52883ce5f tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:23.973689 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2874519e-67ed-47f1-9499-72a52883ce5f tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:23.974129 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2874519e-67ed-47f1-9499-72a52883ce5f tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:23.974843 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2874519e-67ed-47f1-9499-72a52883ce5f tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:23.975289 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2874519e-67ed-47f1-9499-72a52883ce5f tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:23.981726 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2874519e-67ed-47f1-9499-72a52883ce5f tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:24.111768 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-2874519e-67ed-47f1-9499-72a52883ce5f tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:24.124199 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-2874519e-67ed-47f1-9499-72a52883ce5f tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:24.131416 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-2874519e-67ed-47f1-9499-72a52883ce5f tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:24.132714 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2874519e-67ed-47f1-9499-72a52883ce5f tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] 10.222.0.20 "GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663" status: 200 len: 1604 microversion: 2.42 time: 0.177849 Oct 04 18:45:24.133288 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2122/4190] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:45:23 2022] GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663 => generated 1604 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:45:24.166508 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-b09b6dc8-3976-4e31-9eb1-f89808cfa469 tempest-VolumesAdminNegativeTest-1982715801 tempest-VolumesAdminNegativeTest-1982715801-project-admin] HTTP exception thrown: Volume 677a4cbb-2401-4186-b175-94969dbb8be3 could not be found. Oct 04 18:45:24.173749 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b09b6dc8-3976-4e31-9eb1-f89808cfa469 tempest-VolumesAdminNegativeTest-1982715801 tempest-VolumesAdminNegativeTest-1982715801-project-admin] Request method failure captured: Oct 04 18:45:24.173749 n-d-850501-14 devstack@n-api.service[123002]: request: PUT /compute/v2.1/servers/d46bd79f-eda9-4149-b4aa-788520147af7/os-volume_attachments/677a4cbb-2401-4186-b175-94969dbb8be3 HTTP/1.1 Oct 04 18:45:24.173749 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:45:24.173749 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:45:24.173749 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:45:24.173749 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 74 Oct 04 18:45:24.173749 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:45:24.173749 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:45:24.173749 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:45:24.173749 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:45:24.173749 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH6e77kqMoECxl1oKpbQaBp84UEulG7hqvYM-hsN36Q_5BQxQW9dkO1lZwGDhHNINBxpB-zWyXKF7s1J4LOXgyE0Ya6usIQl_5zzS9FFgQgFANwjihEfUBsDu3SNaXfwz9BVkKSaUAU0cmouzGJWfVaPFMFS-sWSVA11aZinn5-l0UQ Oct 04 18:45:24.173749 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:45:24.173749 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:45:24.173749 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:45:24.173749 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:45:24.173749 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:45:24.173749 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:45:24.173749 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 946a7917acfc43f9bcc64c541b7aebe8 Oct 04 18:45:24.173749 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-VolumesAdminNegativeTest-1982715801 Oct 04 18:45:24.173749 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member,admin Oct 04 18:45:24.173749 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member,admin Oct 04 18:45:24.173749 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/946a7917acfc43f9bcc64c541b7aebe8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_946a7917acfc43f9bcc64c541b7aebe8", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/946a7917acfc43f9bcc64c541b7aebe8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/946a7917acfc43f9bcc64c541b7aebe8"}]}] Oct 04 18:45:24.173749 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-VolumesAdminNegativeTest-1982715801 Oct 04 18:45:24.173749 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 946a7917acfc43f9bcc64c541b7aebe8 Oct 04 18:45:24.173749 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1982715801 Oct 04 18:45:24.173749 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-VolumesAdminNegativeTest-1982715801-project-admin Oct 04 18:45:24.173749 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:45:24.173749 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:45:24.173749 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 20ac605698744c7badcae6046b164335 Oct 04 18:45:24.173749 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-VolumesAdminNegativeTest-1982715801-project-admin Oct 04 18:45:24.173749 n-d-850501-14 devstack@n-api.service[123002]: Oct 04 18:45:24.173749 n-d-850501-14 devstack@n-api.service[123002]: {"volumeAttachment": {"volumeId": "7cbaf719-bce5-4569-adad-22865d7823f8"}} Oct 04 18:45:24.173749 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:45:24.173749 n-d-850501-14 devstack@n-api.service[123002]: exception: Volume 677a4cbb-2401-4186-b175-94969dbb8be3 could not be found. Oct 04 18:45:24.173749 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'server_id': 'd46bd79f-eda9-4149-b4aa-788520147af7', 'id': '677a4cbb-2401-4186-b175-94969dbb8be3', 'body': {'volumeAttachment': {'volumeId': '7cbaf719-bce5-4569-adad-22865d7823f8'}}} Oct 04 18:45:24.173749 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:45:24.173749 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:24.173749 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 18:45:24.173749 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 18:45:24.173749 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 18:45:24.173749 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 18:45:24.173749 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 18:45:24.173749 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 18:45:24.173749 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 18:45:24.173749 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 18:45:24.173749 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 18:45:24.173749 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 18:45:24.173749 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:45:24.173749 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:45:24.173749 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:45:24.173749 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:45:24.173749 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 677a4cbb-2401-4186-b175-94969dbb8be3 could not be found. (HTTP 404) (Request-ID: req-82b5f174-ecb1-4168-97c4-2455f85eb40f) Oct 04 18:45:24.173749 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:45:24.173749 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:24.173749 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:45:24.173749 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:24.173749 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Oct 04 18:45:24.173749 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Oct 04 18:45:24.173749 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 18:45:24.173749 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 18:45:24.173749 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 18:45:24.178843 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 18:45:24.178843 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 18:45:24.178843 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 18:45:24.178843 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 18:45:24.178843 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 18:45:24.178843 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 18:45:24.178843 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 18:45:24.178843 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 18:45:24.178843 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 18:45:24.178843 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 18:45:24.178843 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 18:45:24.178843 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 18:45:24.178843 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 18:45:24.178843 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:45:24.178843 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:45:24.178843 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:45:24.178843 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:45:24.178843 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 677a4cbb-2401-4186-b175-94969dbb8be3 could not be found. Oct 04 18:45:24.178843 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:45:24.178843 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:24.178843 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:45:24.178843 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:24.178843 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:45:24.178843 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:45:24.178843 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:45:24.178843 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:45:24.178843 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:45:24.178843 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:45:24.178843 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:45:24.178843 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:45:24.178843 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:45:24.178843 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:45:24.178843 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 04 18:45:24.178843 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 04 18:45:24.178843 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Oct 04 18:45:24.178843 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:45:24.178843 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 677a4cbb-2401-4186-b175-94969dbb8be3 could not be found. Oct 04 18:45:24.178843 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:45:24.178843 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:24.178843 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:45:24.178843 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:24.178843 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:45:24.178843 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:45:24.178843 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:45:24.178843 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:45:24.178843 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 677a4cbb-2401-4186-b175-94969dbb8be3 could not be found. Oct 04 18:45:24.178843 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:45:24.178843 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b09b6dc8-3976-4e31-9eb1-f89808cfa469 tempest-VolumesAdminNegativeTest-1982715801 tempest-VolumesAdminNegativeTest-1982715801-project-admin] Returning 404 to user: Volume 677a4cbb-2401-4186-b175-94969dbb8be3 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:45:24.189586 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b09b6dc8-3976-4e31-9eb1-f89808cfa469 tempest-VolumesAdminNegativeTest-1982715801 tempest-VolumesAdminNegativeTest-1982715801-project-admin] 10.222.0.20 "PUT /compute/v2.1/servers/d46bd79f-eda9-4149-b4aa-788520147af7/os-volume_attachments/677a4cbb-2401-4186-b175-94969dbb8be3" status: 404 len: 109 microversion: 2.1 time: 0.414547 Oct 04 18:45:24.189586 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2069/4191] 10.222.0.20 () {60 vars in 1433 bytes} [Tue Oct 4 18:45:23 2022] PUT /compute/v2.1/servers/d46bd79f-eda9-4149-b4aa-788520147af7/os-volume_attachments/677a4cbb-2401-4186-b175-94969dbb8be3 => generated 109 bytes in 416 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:45:24.803521 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-6378c667-c237-4120-84dc-b860167291b6 req-dfa1f501-5404-46d7-b901-6f4adea0b176 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d6dfac0-958d-4698-a050-6539caebe52c", "tag": "b3bc4ab3-40de-48c0-8c27-0fbd4d0780d1"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:45:24.831736 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-6378c667-c237-4120-84dc-b860167291b6 req-dfa1f501-5404-46d7-b901-6f4adea0b176 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:24.832395 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-6378c667-c237-4120-84dc-b860167291b6 req-dfa1f501-5404-46d7-b901-6f4adea0b176 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:24.832844 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-6378c667-c237-4120-84dc-b860167291b6 req-dfa1f501-5404-46d7-b901-6f4adea0b176 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:24.867269 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-6378c667-c237-4120-84dc-b860167291b6 req-dfa1f501-5404-46d7-b901-6f4adea0b176 service nova] Creating event network-changed:b3bc4ab3-40de-48c0-8c27-0fbd4d0780d1 for instance 4d6dfac0-958d-4698-a050-6539caebe52c on n-h1-850501-14 Oct 04 18:45:24.886479 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-6378c667-c237-4120-84dc-b860167291b6 req-dfa1f501-5404-46d7-b901-6f4adea0b176 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085985 Oct 04 18:45:24.889288 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2123/4192] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:45:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:45:25.158993 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=4 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:25.161164 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:25.169322 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-92b018c1-7a54-4e77-b404-fb21b10e277d tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:25.171375 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-92b018c1-7a54-4e77-b404-fb21b10e277d tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] [instance: 3d3cabc2-fa23-4098-9197-9aaa19a0c663] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:25.187476 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-92b018c1-7a54-4e77-b404-fb21b10e277d tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:25.189160 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-92b018c1-7a54-4e77-b404-fb21b10e277d tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:25.193992 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-92b018c1-7a54-4e77-b404-fb21b10e277d tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:25.195972 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-92b018c1-7a54-4e77-b404-fb21b10e277d tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:25.197345 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-92b018c1-7a54-4e77-b404-fb21b10e277d tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:25.198030 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-92b018c1-7a54-4e77-b404-fb21b10e277d tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:25.525292 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-92b018c1-7a54-4e77-b404-fb21b10e277d tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:25.541922 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-92b018c1-7a54-4e77-b404-fb21b10e277d tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:25.543408 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-92b018c1-7a54-4e77-b404-fb21b10e277d tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:25.544648 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-92b018c1-7a54-4e77-b404-fb21b10e277d tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] 10.222.0.20 "GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663" status: 200 len: 1604 microversion: 2.42 time: 0.386402 Oct 04 18:45:25.545195 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2070/4193] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:45:25 2022] GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663 => generated 1604 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:45:26.579295 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c2d45b18-b089-4b97-970a-33413838fc9f tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:26.580732 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c2d45b18-b089-4b97-970a-33413838fc9f tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] [instance: 3d3cabc2-fa23-4098-9197-9aaa19a0c663] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:26.594650 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c2d45b18-b089-4b97-970a-33413838fc9f tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:26.595519 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c2d45b18-b089-4b97-970a-33413838fc9f tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:26.596161 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c2d45b18-b089-4b97-970a-33413838fc9f tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:26.597040 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c2d45b18-b089-4b97-970a-33413838fc9f tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:26.597704 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c2d45b18-b089-4b97-970a-33413838fc9f tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:26.598460 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c2d45b18-b089-4b97-970a-33413838fc9f tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:26.903338 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-5281e971-8d27-4b46-8034-889ab921ea1e req-a49d6d0a-ee4b-42fd-8069-07ed9adb2d8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d6dfac0-958d-4698-a050-6539caebe52c", "tag": "b3bc4ab3-40de-48c0-8c27-0fbd4d0780d1"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:45:26.919849 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-5281e971-8d27-4b46-8034-889ab921ea1e req-a49d6d0a-ee4b-42fd-8069-07ed9adb2d8f service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:26.924459 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-5281e971-8d27-4b46-8034-889ab921ea1e req-a49d6d0a-ee4b-42fd-8069-07ed9adb2d8f service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:26.925215 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-5281e971-8d27-4b46-8034-889ab921ea1e req-a49d6d0a-ee4b-42fd-8069-07ed9adb2d8f service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:26.974310 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-5281e971-8d27-4b46-8034-889ab921ea1e req-a49d6d0a-ee4b-42fd-8069-07ed9adb2d8f service nova] Creating event network-changed:b3bc4ab3-40de-48c0-8c27-0fbd4d0780d1 for instance 4d6dfac0-958d-4698-a050-6539caebe52c on n-h1-850501-14 Oct 04 18:45:26.974310 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-5281e971-8d27-4b46-8034-889ab921ea1e req-a49d6d0a-ee4b-42fd-8069-07ed9adb2d8f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063159 Oct 04 18:45:26.974310 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2071/4194] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:45:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:45:27.111671 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c2d45b18-b089-4b97-970a-33413838fc9f tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:27.136359 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c2d45b18-b089-4b97-970a-33413838fc9f tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:27.143846 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c2d45b18-b089-4b97-970a-33413838fc9f tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:27.145694 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c2d45b18-b089-4b97-970a-33413838fc9f tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] 10.222.0.20 "GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663" status: 200 len: 1604 microversion: 2.42 time: 0.571810 Oct 04 18:45:27.147297 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2124/4195] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:45:26 2022] GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663 => generated 1604 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:45:28.179073 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9a0f1e2b-e729-4aa7-ad8b-2b1d954f804a tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:28.182980 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9a0f1e2b-e729-4aa7-ad8b-2b1d954f804a tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] [instance: 3d3cabc2-fa23-4098-9197-9aaa19a0c663] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:28.209706 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9a0f1e2b-e729-4aa7-ad8b-2b1d954f804a tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:28.209706 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9a0f1e2b-e729-4aa7-ad8b-2b1d954f804a tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:28.209706 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9a0f1e2b-e729-4aa7-ad8b-2b1d954f804a tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:28.209706 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9a0f1e2b-e729-4aa7-ad8b-2b1d954f804a tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:28.209706 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9a0f1e2b-e729-4aa7-ad8b-2b1d954f804a tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:28.209706 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9a0f1e2b-e729-4aa7-ad8b-2b1d954f804a tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:28.330460 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9a0f1e2b-e729-4aa7-ad8b-2b1d954f804a tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:28.350936 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9a0f1e2b-e729-4aa7-ad8b-2b1d954f804a tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:28.356833 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9a0f1e2b-e729-4aa7-ad8b-2b1d954f804a tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:28.360320 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9a0f1e2b-e729-4aa7-ad8b-2b1d954f804a tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] 10.222.0.20 "GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663" status: 200 len: 1604 microversion: 2.42 time: 0.184162 Oct 04 18:45:28.362177 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2072/4196] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:45:28 2022] GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663 => generated 1604 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:45:29.389458 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-51f8bd88-c573-4901-840d-780de770bfcc tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:29.389928 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-51f8bd88-c573-4901-840d-780de770bfcc tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] [instance: 3d3cabc2-fa23-4098-9197-9aaa19a0c663] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:29.403804 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-51f8bd88-c573-4901-840d-780de770bfcc tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:29.404336 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-51f8bd88-c573-4901-840d-780de770bfcc tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:29.404778 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-51f8bd88-c573-4901-840d-780de770bfcc tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:29.408334 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-51f8bd88-c573-4901-840d-780de770bfcc tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:29.411398 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-51f8bd88-c573-4901-840d-780de770bfcc tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:29.413065 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-51f8bd88-c573-4901-840d-780de770bfcc tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:29.794778 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-51f8bd88-c573-4901-840d-780de770bfcc tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:29.811857 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-51f8bd88-c573-4901-840d-780de770bfcc tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:29.818541 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-51f8bd88-c573-4901-840d-780de770bfcc tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:29.819838 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-51f8bd88-c573-4901-840d-780de770bfcc tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] 10.222.0.20 "GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663" status: 200 len: 1604 microversion: 2.42 time: 0.434952 Oct 04 18:45:29.820678 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2125/4197] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:45:29 2022] GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663 => generated 1604 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:45:30.348714 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6e68f7ba-1061-4bf0-8a1d-fa02f97db118 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:30.349844 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-6e68f7ba-1061-4bf0-8a1d-fa02f97db118 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] [instance: d46bd79f-eda9-4149-b4aa-788520147af7] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:30.379311 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6e68f7ba-1061-4bf0-8a1d-fa02f97db118 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:30.382623 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6e68f7ba-1061-4bf0-8a1d-fa02f97db118 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:30.386801 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6e68f7ba-1061-4bf0-8a1d-fa02f97db118 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:30.391199 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6e68f7ba-1061-4bf0-8a1d-fa02f97db118 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:30.391899 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6e68f7ba-1061-4bf0-8a1d-fa02f97db118 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:30.394957 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6e68f7ba-1061-4bf0-8a1d-fa02f97db118 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:30.524804 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-6e68f7ba-1061-4bf0-8a1d-fa02f97db118 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] [instance: d46bd79f-eda9-4149-b4aa-788520147af7] Going to try to terminate instance {{(pid=123002) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:45:30.854709 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8d6ba158-5ae3-4003-8654-a8bd6c89bd83 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:30.856530 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8d6ba158-5ae3-4003-8654-a8bd6c89bd83 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] [instance: 3d3cabc2-fa23-4098-9197-9aaa19a0c663] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:30.866432 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8d6ba158-5ae3-4003-8654-a8bd6c89bd83 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:30.867393 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8d6ba158-5ae3-4003-8654-a8bd6c89bd83 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:30.869362 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8d6ba158-5ae3-4003-8654-a8bd6c89bd83 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:30.870296 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8d6ba158-5ae3-4003-8654-a8bd6c89bd83 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:30.871861 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8d6ba158-5ae3-4003-8654-a8bd6c89bd83 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:30.873008 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8d6ba158-5ae3-4003-8654-a8bd6c89bd83 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:30.963224 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6e68f7ba-1061-4bf0-8a1d-fa02f97db118 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d46bd79f-eda9-4149-b4aa-788520147af7" status: 204 len: 0 microversion: 2.1 time: 0.618484 Oct 04 18:45:30.966542 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2073/4198] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:45:30 2022] DELETE /compute/v2.1/servers/d46bd79f-eda9-4149-b4aa-788520147af7 => generated 0 bytes in 624 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:45:30.979023 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9b7a0f89-4a08-423d-a844-5c50f7e7b109 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:30.979777 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9b7a0f89-4a08-423d-a844-5c50f7e7b109 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] [instance: d46bd79f-eda9-4149-b4aa-788520147af7] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:30.998076 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9b7a0f89-4a08-423d-a844-5c50f7e7b109 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:31.000571 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9b7a0f89-4a08-423d-a844-5c50f7e7b109 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:31.001069 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9b7a0f89-4a08-423d-a844-5c50f7e7b109 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:31.001817 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9b7a0f89-4a08-423d-a844-5c50f7e7b109 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:31.002276 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9b7a0f89-4a08-423d-a844-5c50f7e7b109 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:31.002712 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9b7a0f89-4a08-423d-a844-5c50f7e7b109 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:31.454593 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8d6ba158-5ae3-4003-8654-a8bd6c89bd83 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:31.456654 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:31.475219 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8d6ba158-5ae3-4003-8654-a8bd6c89bd83 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:31.476698 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8d6ba158-5ae3-4003-8654-a8bd6c89bd83 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:31.483383 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8d6ba158-5ae3-4003-8654-a8bd6c89bd83 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] 10.222.0.20 "GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663" status: 200 len: 1604 microversion: 2.42 time: 0.629111 Oct 04 18:45:31.483383 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2126/4199] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:45:30 2022] GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663 => generated 1604 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:45:32.490355 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9b7a0f89-4a08-423d-a844-5c50f7e7b109 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a02cd1108b947b186202f6d15e6cf0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c0b095138354810949093e7ea03b8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:32.505646 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-128b5e4b-7cda-4278-b6e1-0ead53d61fce tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:32.506917 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-128b5e4b-7cda-4278-b6e1-0ead53d61fce tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] [instance: 3d3cabc2-fa23-4098-9197-9aaa19a0c663] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:32.521565 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9b7a0f89-4a08-423d-a844-5c50f7e7b109 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] 10.222.0.20 "GET /compute/v2.1/servers/d46bd79f-eda9-4149-b4aa-788520147af7" status: 200 len: 1513 microversion: 2.1 time: 1.550180 Oct 04 18:45:32.537312 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2074/4200] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:30 2022] GET /compute/v2.1/servers/d46bd79f-eda9-4149-b4aa-788520147af7 => generated 1513 bytes in 1566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:32.546726 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-128b5e4b-7cda-4278-b6e1-0ead53d61fce tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:32.546726 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-128b5e4b-7cda-4278-b6e1-0ead53d61fce tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:32.546726 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-128b5e4b-7cda-4278-b6e1-0ead53d61fce tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:32.546726 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-128b5e4b-7cda-4278-b6e1-0ead53d61fce tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:32.546726 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-128b5e4b-7cda-4278-b6e1-0ead53d61fce tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:32.546726 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-128b5e4b-7cda-4278-b6e1-0ead53d61fce tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:32.718358 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-128b5e4b-7cda-4278-b6e1-0ead53d61fce tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:32.732496 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-128b5e4b-7cda-4278-b6e1-0ead53d61fce tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:32.734175 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-128b5e4b-7cda-4278-b6e1-0ead53d61fce tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '996abacc15b74496a27b1ecaaea0161b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dbf28bee1e4a6eb1d3db071823690c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:32.744562 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-128b5e4b-7cda-4278-b6e1-0ead53d61fce tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] 10.222.0.20 "GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663" status: 200 len: 1604 microversion: 2.42 time: 0.239105 Oct 04 18:45:32.751106 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2127/4201] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:45:32 2022] GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663 => generated 1604 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:45:33.557455 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c5f8b70e-484c-4c35-a5bf-708e39b1f55e tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:33.559389 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c5f8b70e-484c-4c35-a5bf-708e39b1f55e tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] [instance: d46bd79f-eda9-4149-b4aa-788520147af7] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:33.572678 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c5f8b70e-484c-4c35-a5bf-708e39b1f55e tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:33.573311 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c5f8b70e-484c-4c35-a5bf-708e39b1f55e tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:33.576743 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c5f8b70e-484c-4c35-a5bf-708e39b1f55e tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:33.578021 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c5f8b70e-484c-4c35-a5bf-708e39b1f55e tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:33.578503 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c5f8b70e-484c-4c35-a5bf-708e39b1f55e tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:33.579218 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c5f8b70e-484c-4c35-a5bf-708e39b1f55e tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:33.777336 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-193adf42-58dd-4a60-9775-f6f4e62dc054 req-f0dae075-8be7-437b-bd82-62e55b2c59bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d46bd79f-eda9-4149-b4aa-788520147af7", "name": "network-vif-deleted", "tag": "85f7dba4-0186-43c3-94c9-1a65ff915600"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:45:33.799623 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-193adf42-58dd-4a60-9775-f6f4e62dc054 req-f0dae075-8be7-437b-bd82-62e55b2c59bd service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:33.800145 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-193adf42-58dd-4a60-9775-f6f4e62dc054 req-f0dae075-8be7-437b-bd82-62e55b2c59bd service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:33.807523 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-193adf42-58dd-4a60-9775-f6f4e62dc054 req-f0dae075-8be7-437b-bd82-62e55b2c59bd service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:33.875064 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-193adf42-58dd-4a60-9775-f6f4e62dc054 req-f0dae075-8be7-437b-bd82-62e55b2c59bd service nova] Creating event network-vif-deleted:85f7dba4-0186-43c3-94c9-1a65ff915600 for instance d46bd79f-eda9-4149-b4aa-788520147af7 on n-h1-850501-14 Oct 04 18:45:33.904991 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-193adf42-58dd-4a60-9775-f6f4e62dc054 req-f0dae075-8be7-437b-bd82-62e55b2c59bd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121568 Oct 04 18:45:33.905474 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2128/4202] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:45:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:45:33.937345 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-66b80f72-d221-47de-ae04-c75ede2338b8 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:33.942028 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-66b80f72-d221-47de-ae04-c75ede2338b8 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] [instance: 3d3cabc2-fa23-4098-9197-9aaa19a0c663] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:33.963900 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-66b80f72-d221-47de-ae04-c75ede2338b8 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:33.965961 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-66b80f72-d221-47de-ae04-c75ede2338b8 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:33.966484 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-66b80f72-d221-47de-ae04-c75ede2338b8 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:33.967434 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-66b80f72-d221-47de-ae04-c75ede2338b8 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:33.970762 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-66b80f72-d221-47de-ae04-c75ede2338b8 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:33.971452 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-66b80f72-d221-47de-ae04-c75ede2338b8 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:33.984448 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c5f8b70e-484c-4c35-a5bf-708e39b1f55e tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a02cd1108b947b186202f6d15e6cf0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c0b095138354810949093e7ea03b8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:33.998516 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c5f8b70e-484c-4c35-a5bf-708e39b1f55e tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] 10.222.0.20 "GET /compute/v2.1/servers/d46bd79f-eda9-4149-b4aa-788520147af7" status: 200 len: 1471 microversion: 2.1 time: 0.447721 Oct 04 18:45:33.999149 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2075/4203] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:33 2022] GET /compute/v2.1/servers/d46bd79f-eda9-4149-b4aa-788520147af7 => generated 1471 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:34.023291 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-66b80f72-d221-47de-ae04-c75ede2338b8 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] HTTP exception thrown: Instance 3d3cabc2-fa23-4098-9197-9aaa19a0c663 could not be found. Oct 04 18:45:34.025039 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-66b80f72-d221-47de-ae04-c75ede2338b8 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Request method failure captured: Oct 04 18:45:34.025039 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663 HTTP/1.1 Oct 04 18:45:34.025039 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:45:34.025039 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:45:34.025039 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:45:34.025039 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:45:34.025039 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:45:34.025039 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:45:34.025039 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:45:34.025039 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:45:34.025039 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPH2TKXiNvVU1oM6801sfUx9KYOSnIvdJyC0_oMn9LITXApsfGVuyWsTIT6b7FrQGpgwG3W6znpQ2s0wvCCjTewduAjeZIAN8HutUAowhl1As8FWw0JzoxMVtjdXvTFZ5wHQKnkOcygS4eRrqQHvO023FfHIw5s0gZZ00nyuCQy5Sedc Oct 04 18:45:34.025039 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:45:34.025039 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:45:34.025039 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:45:34.025039 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:45:34.025039 n-d-850501-14 devstack@n-api.service[123001]: X-Openstack-Nova-Api-Version: 2.42 Oct 04 18:45:34.025039 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:45:34.025039 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:45:34.025039 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: d6dbf28bee1e4a6eb1d3db071823690c Oct 04 18:45:34.025039 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1615012660 Oct 04 18:45:34.025039 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:45:34.025039 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:45:34.025039 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d6dbf28bee1e4a6eb1d3db071823690c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d6dbf28bee1e4a6eb1d3db071823690c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d6dbf28bee1e4a6eb1d3db071823690c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d6dbf28bee1e4a6eb1d3db071823690c"}]}] Oct 04 18:45:34.025039 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1615012660 Oct 04 18:45:34.025039 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: d6dbf28bee1e4a6eb1d3db071823690c Oct 04 18:45:34.025039 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1615012660 Oct 04 18:45:34.025039 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-TaggedBootDevicesTest_v242-1615012660-project Oct 04 18:45:34.025039 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:45:34.025039 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:45:34.025039 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 996abacc15b74496a27b1ecaaea0161b Oct 04 18:45:34.025039 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1615012660-project Oct 04 18:45:34.025039 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:45:34.025039 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 3d3cabc2-fa23-4098-9197-9aaa19a0c663 could not be found. Oct 04 18:45:34.025039 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '3d3cabc2-fa23-4098-9197-9aaa19a0c663'} Oct 04 18:45:34.025039 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:45:34.025039 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:34.025039 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:45:34.025039 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:45:34.025039 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:45:34.025039 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:45:34.025039 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:45:34.025039 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:45:34.025039 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:45:34.025039 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:45:34.025039 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d3cabc2-fa23-4098-9197-9aaa19a0c663 could not be found. Oct 04 18:45:34.025039 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:45:34.025039 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:34.025039 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:45:34.025039 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:34.025039 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:45:34.025039 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:45:34.025039 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:45:34.025039 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:45:34.025039 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:45:34.025039 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:45:34.025039 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:45:34.025039 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:45:34.025039 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:45:34.025039 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:45:34.025039 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:45:34.025039 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:45:34.025039 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d3cabc2-fa23-4098-9197-9aaa19a0c663 could not be found. Oct 04 18:45:34.025039 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:45:34.025039 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:34.031444 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:45:34.031444 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:34.031444 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:45:34.031444 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:45:34.031444 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:45:34.031444 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:45:34.031444 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d3cabc2-fa23-4098-9197-9aaa19a0c663 could not be found. Oct 04 18:45:34.031444 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:45:34.031444 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-66b80f72-d221-47de-ae04-c75ede2338b8 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Returning 404 to user: Instance 3d3cabc2-fa23-4098-9197-9aaa19a0c663 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:45:34.031444 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-66b80f72-d221-47de-ae04-c75ede2338b8 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] 10.222.0.20 "GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663" status: 404 len: 111 microversion: 2.42 time: 0.116589 Oct 04 18:45:34.031444 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2129/4204] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:45:33 2022] GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:45:34.036888 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d56e6834-28df-41bc-b83b-a25f00987410 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Calling method '.version_select at 0x7fe253d6b3a0>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:34.156935 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d56e6834-28df-41bc-b83b-a25f00987410 tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1898144732" status: 204 len: 0 microversion: 2.42 time: 0.123892 Oct 04 18:45:34.158084 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2076/4205] 10.222.0.20 () {60 vars in 1262 bytes} [Tue Oct 4 18:45:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1898144732 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:45:35.023061 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a0d26f3a-df33-46f3-b4cf-edd093140271 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:35.024444 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a0d26f3a-df33-46f3-b4cf-edd093140271 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] [instance: d46bd79f-eda9-4149-b4aa-788520147af7] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:35.039947 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a0d26f3a-df33-46f3-b4cf-edd093140271 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:35.039947 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a0d26f3a-df33-46f3-b4cf-edd093140271 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:35.046290 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a0d26f3a-df33-46f3-b4cf-edd093140271 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:35.049237 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a0d26f3a-df33-46f3-b4cf-edd093140271 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:35.050314 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a0d26f3a-df33-46f3-b4cf-edd093140271 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:35.051007 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a0d26f3a-df33-46f3-b4cf-edd093140271 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:35.103576 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a0d26f3a-df33-46f3-b4cf-edd093140271 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:35.103576 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a0d26f3a-df33-46f3-b4cf-edd093140271 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:35.103576 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a0d26f3a-df33-46f3-b4cf-edd093140271 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:35.103576 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-a0d26f3a-df33-46f3-b4cf-edd093140271 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lazy-loading 'fault' on Instance uuid d46bd79f-eda9-4149-b4aa-788520147af7 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:45:35.411230 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a0d26f3a-df33-46f3-b4cf-edd093140271 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a02cd1108b947b186202f6d15e6cf0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c0b095138354810949093e7ea03b8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:35.428537 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a0d26f3a-df33-46f3-b4cf-edd093140271 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] 10.222.0.20 "GET /compute/v2.1/servers/d46bd79f-eda9-4149-b4aa-788520147af7" status: 200 len: 1306 microversion: 2.1 time: 0.407611 Oct 04 18:45:35.431971 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2130/4206] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:35 2022] GET /compute/v2.1/servers/d46bd79f-eda9-4149-b4aa-788520147af7 => generated 1306 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:36.457711 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3fcb0071-5e51-4f08-8bde-4ab09b7217af tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:36.458326 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3fcb0071-5e51-4f08-8bde-4ab09b7217af tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] [instance: d46bd79f-eda9-4149-b4aa-788520147af7] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:36.471085 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3fcb0071-5e51-4f08-8bde-4ab09b7217af tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:36.473050 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3fcb0071-5e51-4f08-8bde-4ab09b7217af tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:36.474201 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3fcb0071-5e51-4f08-8bde-4ab09b7217af tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:36.477666 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3fcb0071-5e51-4f08-8bde-4ab09b7217af tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:36.477666 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3fcb0071-5e51-4f08-8bde-4ab09b7217af tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:36.477666 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3fcb0071-5e51-4f08-8bde-4ab09b7217af tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:36.496580 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-3fcb0071-5e51-4f08-8bde-4ab09b7217af tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] HTTP exception thrown: Instance d46bd79f-eda9-4149-b4aa-788520147af7 could not be found. Oct 04 18:45:36.499653 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3fcb0071-5e51-4f08-8bde-4ab09b7217af tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Request method failure captured: Oct 04 18:45:36.499653 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/d46bd79f-eda9-4149-b4aa-788520147af7 HTTP/1.1 Oct 04 18:45:36.499653 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:45:36.499653 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:45:36.499653 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:45:36.499653 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:45:36.499653 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:45:36.499653 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:45:36.499653 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:45:36.499653 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:45:36.499653 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH6QCP_Mm0u_zJh3rlv9TOj2Igoda6-vR7WYG5pDNwbZBlQ7sbPpjY0VEaE5QXUvC0WQ6PYlSiWdLFTUbCyGwPyR0jMju-zeSdiC9nOtHASOWuZbWw1Hzq9GIth4UjavECzVg7p5cgN_6ok47SHAeSSzKwMOXfjtGGRwiVrRnPz4T6M Oct 04 18:45:36.499653 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:45:36.499653 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:45:36.499653 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:45:36.499653 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:45:36.499653 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:45:36.499653 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:45:36.499653 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 7c0b095138354810949093e7ea03b8bf Oct 04 18:45:36.499653 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-VolumesAdminNegativeTest-1617871381 Oct 04 18:45:36.499653 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:45:36.499653 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:45:36.499653 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7c0b095138354810949093e7ea03b8bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7c0b095138354810949093e7ea03b8bf", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7c0b095138354810949093e7ea03b8bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7c0b095138354810949093e7ea03b8bf"}]}] Oct 04 18:45:36.499653 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-VolumesAdminNegativeTest-1617871381 Oct 04 18:45:36.499653 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 7c0b095138354810949093e7ea03b8bf Oct 04 18:45:36.499653 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1617871381 Oct 04 18:45:36.499653 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-VolumesAdminNegativeTest-1617871381-project Oct 04 18:45:36.499653 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:45:36.499653 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:45:36.499653 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 0a02cd1108b947b186202f6d15e6cf0e Oct 04 18:45:36.499653 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-VolumesAdminNegativeTest-1617871381-project Oct 04 18:45:36.499653 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:45:36.499653 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance d46bd79f-eda9-4149-b4aa-788520147af7 could not be found. Oct 04 18:45:36.499653 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'd46bd79f-eda9-4149-b4aa-788520147af7'} Oct 04 18:45:36.499653 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:45:36.499653 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:36.499653 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:45:36.499653 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:45:36.499653 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:45:36.499653 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:45:36.499653 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:45:36.499653 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:45:36.499653 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:45:36.499653 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:45:36.499653 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d46bd79f-eda9-4149-b4aa-788520147af7 could not be found. Oct 04 18:45:36.499653 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:45:36.499653 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:36.499653 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:45:36.499653 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:36.499653 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:45:36.499653 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:45:36.499653 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:45:36.499653 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:45:36.499653 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:45:36.499653 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:45:36.499653 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:45:36.499653 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:45:36.499653 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:45:36.499653 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:45:36.499653 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:45:36.499653 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:45:36.499653 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d46bd79f-eda9-4149-b4aa-788520147af7 could not be found. Oct 04 18:45:36.499653 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:45:36.499653 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:36.499653 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:45:36.504564 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:36.504564 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:45:36.504564 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:45:36.504564 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:45:36.504564 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:45:36.504564 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d46bd79f-eda9-4149-b4aa-788520147af7 could not be found. Oct 04 18:45:36.504564 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:45:36.513526 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3fcb0071-5e51-4f08-8bde-4ab09b7217af tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Returning 404 to user: Instance d46bd79f-eda9-4149-b4aa-788520147af7 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:45:36.517729 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3fcb0071-5e51-4f08-8bde-4ab09b7217af tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] 10.222.0.20 "GET /compute/v2.1/servers/d46bd79f-eda9-4149-b4aa-788520147af7" status: 404 len: 111 microversion: 2.1 time: 0.061494 Oct 04 18:45:36.517729 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2077/4207] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:36 2022] GET /compute/v2.1/servers/d46bd79f-eda9-4149-b4aa-788520147af7 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:45:42.477951 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-763c96b5-9ba8-4a59-bd7d-faf4baacf82e tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:42.478458 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-763c96b5-9ba8-4a59-bd7d-faf4baacf82e tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] [instance: 6cc94ec4-3e28-41e0-808e-9cd2263bca7d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:42.492488 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-763c96b5-9ba8-4a59-bd7d-faf4baacf82e tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:42.493429 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-763c96b5-9ba8-4a59-bd7d-faf4baacf82e tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:42.496908 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-763c96b5-9ba8-4a59-bd7d-faf4baacf82e tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:42.498356 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-763c96b5-9ba8-4a59-bd7d-faf4baacf82e tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:42.499529 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-763c96b5-9ba8-4a59-bd7d-faf4baacf82e tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:42.504903 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-763c96b5-9ba8-4a59-bd7d-faf4baacf82e tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:42.565683 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-763c96b5-9ba8-4a59-bd7d-faf4baacf82e tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] [instance: 6cc94ec4-3e28-41e0-808e-9cd2263bca7d] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:45:42.950202 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-763c96b5-9ba8-4a59-bd7d-faf4baacf82e tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6cc94ec4-3e28-41e0-808e-9cd2263bca7d" status: 204 len: 0 microversion: 2.1 time: 0.476170 Oct 04 18:45:42.951068 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2131/4208] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:45:42 2022] DELETE /compute/v2.1/servers/6cc94ec4-3e28-41e0-808e-9cd2263bca7d => generated 0 bytes in 478 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:45:42.960582 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e0aca26f-e2d5-4c48-a952-ef32241bb181 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:42.961218 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e0aca26f-e2d5-4c48-a952-ef32241bb181 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] [instance: 6cc94ec4-3e28-41e0-808e-9cd2263bca7d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:42.973797 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e0aca26f-e2d5-4c48-a952-ef32241bb181 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:42.977446 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e0aca26f-e2d5-4c48-a952-ef32241bb181 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:42.978080 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e0aca26f-e2d5-4c48-a952-ef32241bb181 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:42.981757 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e0aca26f-e2d5-4c48-a952-ef32241bb181 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:42.983405 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e0aca26f-e2d5-4c48-a952-ef32241bb181 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:42.985805 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e0aca26f-e2d5-4c48-a952-ef32241bb181 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:43.287233 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e0aca26f-e2d5-4c48-a952-ef32241bb181 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a02cd1108b947b186202f6d15e6cf0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c0b095138354810949093e7ea03b8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:43.299567 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e0aca26f-e2d5-4c48-a952-ef32241bb181 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] 10.222.0.20 "GET /compute/v2.1/servers/6cc94ec4-3e28-41e0-808e-9cd2263bca7d" status: 200 len: 1679 microversion: 2.1 time: 0.342200 Oct 04 18:45:43.302485 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2078/4209] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:42 2022] GET /compute/v2.1/servers/6cc94ec4-3e28-41e0-808e-9cd2263bca7d => generated 1679 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:43.907247 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4ea9e05d-b177-4e0c-bfd1-5014bd51890b tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:43.907862 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-4ea9e05d-b177-4e0c-bfd1-5014bd51890b tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] [instance: 3d3cabc2-fa23-4098-9197-9aaa19a0c663] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:43.922877 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4ea9e05d-b177-4e0c-bfd1-5014bd51890b tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:43.923380 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4ea9e05d-b177-4e0c-bfd1-5014bd51890b tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:43.923809 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4ea9e05d-b177-4e0c-bfd1-5014bd51890b tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:43.924556 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4ea9e05d-b177-4e0c-bfd1-5014bd51890b tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:43.925014 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4ea9e05d-b177-4e0c-bfd1-5014bd51890b tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:43.925442 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4ea9e05d-b177-4e0c-bfd1-5014bd51890b tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:43.953007 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-4ea9e05d-b177-4e0c-bfd1-5014bd51890b tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] HTTP exception thrown: Instance 3d3cabc2-fa23-4098-9197-9aaa19a0c663 could not be found. Oct 04 18:45:43.955111 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4ea9e05d-b177-4e0c-bfd1-5014bd51890b tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Request method failure captured: Oct 04 18:45:43.955111 n-d-850501-14 devstack@n-api.service[123001]: request: DELETE /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663 HTTP/1.1 Oct 04 18:45:43.955111 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:45:43.955111 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:45:43.955111 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:45:43.955111 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:45:43.955111 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:45:43.955111 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:45:43.955111 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:45:43.955111 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:45:43.955111 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPH2TKXiNvVU1oM6801sfUx9KYOSnIvdJyC0_oMn9LITXApsfGVuyWsTIT6b7FrQGpgwG3W6znpQ2s0wvCCjTewduAjeZIAN8HutUAowhl1As8FWw0JzoxMVtjdXvTFZ5wHQKnkOcygS4eRrqQHvO023FfHIw5s0gZZ00nyuCQy5Sedc Oct 04 18:45:43.955111 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:45:43.955111 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:45:43.955111 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:45:43.955111 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:45:43.955111 n-d-850501-14 devstack@n-api.service[123001]: X-Openstack-Nova-Api-Version: 2.42 Oct 04 18:45:43.955111 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:45:43.955111 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:45:43.955111 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: d6dbf28bee1e4a6eb1d3db071823690c Oct 04 18:45:43.955111 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1615012660 Oct 04 18:45:43.955111 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:45:43.955111 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:45:43.955111 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d6dbf28bee1e4a6eb1d3db071823690c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d6dbf28bee1e4a6eb1d3db071823690c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d6dbf28bee1e4a6eb1d3db071823690c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d6dbf28bee1e4a6eb1d3db071823690c"}]}] Oct 04 18:45:43.955111 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1615012660 Oct 04 18:45:43.955111 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: d6dbf28bee1e4a6eb1d3db071823690c Oct 04 18:45:43.955111 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1615012660 Oct 04 18:45:43.955111 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-TaggedBootDevicesTest_v242-1615012660-project Oct 04 18:45:43.955111 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:45:43.955111 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:45:43.955111 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 996abacc15b74496a27b1ecaaea0161b Oct 04 18:45:43.955111 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1615012660-project Oct 04 18:45:43.955111 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:45:43.955111 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 3d3cabc2-fa23-4098-9197-9aaa19a0c663 could not be found. Oct 04 18:45:43.955111 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '3d3cabc2-fa23-4098-9197-9aaa19a0c663'} Oct 04 18:45:43.955111 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:45:43.955111 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:43.955111 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:45:43.955111 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:45:43.955111 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:45:43.955111 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:45:43.955111 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:45:43.955111 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:45:43.955111 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:45:43.955111 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:45:43.955111 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d3cabc2-fa23-4098-9197-9aaa19a0c663 could not be found. Oct 04 18:45:43.955111 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:45:43.955111 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:43.955111 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:45:43.955111 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:43.955111 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:45:43.955111 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:45:43.955111 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:45:43.955111 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:45:43.955111 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:45:43.955111 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:45:43.955111 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:45:43.955111 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:45:43.955111 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:45:43.955111 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:45:43.955111 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:45:43.955111 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:45:43.955111 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:45:43.955111 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:45:43.959734 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d3cabc2-fa23-4098-9197-9aaa19a0c663 could not be found. Oct 04 18:45:43.959734 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:45:43.959734 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:43.959734 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:45:43.959734 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:43.959734 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:45:43.959734 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:45:43.959734 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:45:43.959734 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:45:43.959734 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d3cabc2-fa23-4098-9197-9aaa19a0c663 could not be found. Oct 04 18:45:43.959734 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:45:43.962586 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4ea9e05d-b177-4e0c-bfd1-5014bd51890b tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Returning 404 to user: Instance 3d3cabc2-fa23-4098-9197-9aaa19a0c663 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:45:43.963901 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-4ea9e05d-b177-4e0c-bfd1-5014bd51890b tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663" status: 404 len: 111 microversion: 2.42 time: 0.061345 Oct 04 18:45:43.965706 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2132/4210] 10.222.0.20 () {60 vars in 1280 bytes} [Tue Oct 4 18:45:43 2022] DELETE /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:45:43.975919 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-baa49491-6114-465f-b9f2-4608f3aca22c tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:43.977508 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-baa49491-6114-465f-b9f2-4608f3aca22c tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] [instance: 3d3cabc2-fa23-4098-9197-9aaa19a0c663] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:43.993896 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-baa49491-6114-465f-b9f2-4608f3aca22c tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:43.994766 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-baa49491-6114-465f-b9f2-4608f3aca22c tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:43.997806 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-baa49491-6114-465f-b9f2-4608f3aca22c tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:43.998864 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-baa49491-6114-465f-b9f2-4608f3aca22c tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:44.000769 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-baa49491-6114-465f-b9f2-4608f3aca22c tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:44.002687 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-baa49491-6114-465f-b9f2-4608f3aca22c tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:44.038132 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-baa49491-6114-465f-b9f2-4608f3aca22c tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] HTTP exception thrown: Instance 3d3cabc2-fa23-4098-9197-9aaa19a0c663 could not be found. Oct 04 18:45:44.039884 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-baa49491-6114-465f-b9f2-4608f3aca22c tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Request method failure captured: Oct 04 18:45:44.039884 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663 HTTP/1.1 Oct 04 18:45:44.039884 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:45:44.039884 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:45:44.039884 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:45:44.039884 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:45:44.039884 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:45:44.039884 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:45:44.039884 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:45:44.039884 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:45:44.039884 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH2TKXiNvVU1oM6801sfUx9KYOSnIvdJyC0_oMn9LITXApsfGVuyWsTIT6b7FrQGpgwG3W6znpQ2s0wvCCjTewduAjeZIAN8HutUAowhl1As8FWw0JzoxMVtjdXvTFZ5wHQKnkOcygS4eRrqQHvO023FfHIw5s0gZZ00nyuCQy5Sedc Oct 04 18:45:44.039884 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:45:44.039884 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:45:44.039884 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:45:44.039884 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:45:44.039884 n-d-850501-14 devstack@n-api.service[123002]: X-Openstack-Nova-Api-Version: 2.42 Oct 04 18:45:44.039884 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:45:44.039884 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:45:44.039884 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: d6dbf28bee1e4a6eb1d3db071823690c Oct 04 18:45:44.039884 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1615012660 Oct 04 18:45:44.039884 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:45:44.039884 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:45:44.039884 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d6dbf28bee1e4a6eb1d3db071823690c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d6dbf28bee1e4a6eb1d3db071823690c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d6dbf28bee1e4a6eb1d3db071823690c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d6dbf28bee1e4a6eb1d3db071823690c"}]}] Oct 04 18:45:44.039884 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1615012660 Oct 04 18:45:44.039884 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: d6dbf28bee1e4a6eb1d3db071823690c Oct 04 18:45:44.039884 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1615012660 Oct 04 18:45:44.039884 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-TaggedBootDevicesTest_v242-1615012660-project Oct 04 18:45:44.039884 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:45:44.039884 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:45:44.039884 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 996abacc15b74496a27b1ecaaea0161b Oct 04 18:45:44.039884 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1615012660-project Oct 04 18:45:44.039884 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:45:44.039884 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 3d3cabc2-fa23-4098-9197-9aaa19a0c663 could not be found. Oct 04 18:45:44.039884 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '3d3cabc2-fa23-4098-9197-9aaa19a0c663'} Oct 04 18:45:44.039884 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:45:44.039884 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:44.039884 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:45:44.039884 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:45:44.039884 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:45:44.039884 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:45:44.039884 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:45:44.039884 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:45:44.039884 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:45:44.039884 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:45:44.039884 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d3cabc2-fa23-4098-9197-9aaa19a0c663 could not be found. Oct 04 18:45:44.039884 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:45:44.039884 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:44.039884 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:45:44.039884 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:44.039884 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:45:44.039884 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:45:44.039884 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:45:44.039884 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:45:44.039884 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:45:44.039884 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:45:44.039884 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:45:44.039884 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:45:44.039884 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:45:44.039884 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:45:44.039884 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:45:44.039884 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:45:44.039884 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d3cabc2-fa23-4098-9197-9aaa19a0c663 could not be found. Oct 04 18:45:44.039884 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:45:44.039884 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:44.045996 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:45:44.045996 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:44.045996 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:45:44.045996 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:45:44.045996 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:45:44.045996 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:45:44.045996 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d3cabc2-fa23-4098-9197-9aaa19a0c663 could not be found. Oct 04 18:45:44.045996 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:45:44.045996 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-baa49491-6114-465f-b9f2-4608f3aca22c tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] Returning 404 to user: Instance 3d3cabc2-fa23-4098-9197-9aaa19a0c663 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:45:44.045996 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-baa49491-6114-465f-b9f2-4608f3aca22c tempest-TaggedBootDevicesTest_v242-1615012660 tempest-TaggedBootDevicesTest_v242-1615012660-project] 10.222.0.20 "GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663" status: 404 len: 111 microversion: 2.42 time: 0.071572 Oct 04 18:45:44.045996 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2079/4211] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:45:43 2022] GET /compute/v2.1/servers/3d3cabc2-fa23-4098-9197-9aaa19a0c663 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:45:44.326900 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6995bace-f28f-4f25-a272-af4581e8b972 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:44.327635 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6995bace-f28f-4f25-a272-af4581e8b972 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] [instance: 6cc94ec4-3e28-41e0-808e-9cd2263bca7d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:44.342735 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6995bace-f28f-4f25-a272-af4581e8b972 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:44.343436 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6995bace-f28f-4f25-a272-af4581e8b972 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:44.344920 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6995bace-f28f-4f25-a272-af4581e8b972 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:44.349036 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6995bace-f28f-4f25-a272-af4581e8b972 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:44.350365 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6995bace-f28f-4f25-a272-af4581e8b972 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:44.350922 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6995bace-f28f-4f25-a272-af4581e8b972 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:44.659067 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6995bace-f28f-4f25-a272-af4581e8b972 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a02cd1108b947b186202f6d15e6cf0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c0b095138354810949093e7ea03b8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:44.717904 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6995bace-f28f-4f25-a272-af4581e8b972 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] 10.222.0.20 "GET /compute/v2.1/servers/6cc94ec4-3e28-41e0-808e-9cd2263bca7d" status: 200 len: 1679 microversion: 2.1 time: 0.396767 Oct 04 18:45:44.727455 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2133/4212] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:44 2022] GET /compute/v2.1/servers/6cc94ec4-3e28-41e0-808e-9cd2263bca7d => generated 1679 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:45.751644 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3f5f8b1b-c810-45e8-a920-c508b87f883b tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:45.759539 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3f5f8b1b-c810-45e8-a920-c508b87f883b tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] [instance: 6cc94ec4-3e28-41e0-808e-9cd2263bca7d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:45.778954 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:45.784049 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f5f8b1b-c810-45e8-a920-c508b87f883b tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:45.785131 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f5f8b1b-c810-45e8-a920-c508b87f883b tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:45.787512 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f5f8b1b-c810-45e8-a920-c508b87f883b tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:45.789304 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f5f8b1b-c810-45e8-a920-c508b87f883b tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:45.800821 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f5f8b1b-c810-45e8-a920-c508b87f883b tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:45.801612 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f5f8b1b-c810-45e8-a920-c508b87f883b tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:46.849624 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3f5f8b1b-c810-45e8-a920-c508b87f883b tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a02cd1108b947b186202f6d15e6cf0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c0b095138354810949093e7ea03b8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:46.873239 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3f5f8b1b-c810-45e8-a920-c508b87f883b tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] 10.222.0.20 "GET /compute/v2.1/servers/6cc94ec4-3e28-41e0-808e-9cd2263bca7d" status: 200 len: 1679 microversion: 2.1 time: 1.123752 Oct 04 18:45:46.876457 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2080/4213] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:45 2022] GET /compute/v2.1/servers/6cc94ec4-3e28-41e0-808e-9cd2263bca7d => generated 1679 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:47.778112 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-3becbc8f-3060-4129-bed1-faf03073e24d req-9f8924e1-12ed-4397-9fa4-7eb198a9ed65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cc94ec4-3e28-41e0-808e-9cd2263bca7d", "name": "network-vif-deleted", "tag": "1556befc-7a17-4e26-aa0f-68b9c412823d"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:45:47.811903 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-3becbc8f-3060-4129-bed1-faf03073e24d req-9f8924e1-12ed-4397-9fa4-7eb198a9ed65 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:47.815265 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-3becbc8f-3060-4129-bed1-faf03073e24d req-9f8924e1-12ed-4397-9fa4-7eb198a9ed65 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:47.819657 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-3becbc8f-3060-4129-bed1-faf03073e24d req-9f8924e1-12ed-4397-9fa4-7eb198a9ed65 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:47.877362 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-3becbc8f-3060-4129-bed1-faf03073e24d req-9f8924e1-12ed-4397-9fa4-7eb198a9ed65 service nova] Creating event network-vif-deleted:1556befc-7a17-4e26-aa0f-68b9c412823d for instance 6cc94ec4-3e28-41e0-808e-9cd2263bca7d on n-h2-850501-14 Oct 04 18:45:47.893450 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-3becbc8f-3060-4129-bed1-faf03073e24d req-9f8924e1-12ed-4397-9fa4-7eb198a9ed65 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119963 Oct 04 18:45:47.901226 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c778443f-2ee4-4b8f-9df2-e1d30db971a4 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:47.906118 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2134/4214] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:45:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:45:47.906556 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c778443f-2ee4-4b8f-9df2-e1d30db971a4 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] [instance: 6cc94ec4-3e28-41e0-808e-9cd2263bca7d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:47.922052 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c778443f-2ee4-4b8f-9df2-e1d30db971a4 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:47.922553 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c778443f-2ee4-4b8f-9df2-e1d30db971a4 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:47.927368 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c778443f-2ee4-4b8f-9df2-e1d30db971a4 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:47.929629 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c778443f-2ee4-4b8f-9df2-e1d30db971a4 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:47.930120 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c778443f-2ee4-4b8f-9df2-e1d30db971a4 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:47.934104 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c778443f-2ee4-4b8f-9df2-e1d30db971a4 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:48.159562 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c778443f-2ee4-4b8f-9df2-e1d30db971a4 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a02cd1108b947b186202f6d15e6cf0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c0b095138354810949093e7ea03b8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:48.189051 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c778443f-2ee4-4b8f-9df2-e1d30db971a4 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] 10.222.0.20 "GET /compute/v2.1/servers/6cc94ec4-3e28-41e0-808e-9cd2263bca7d" status: 200 len: 1611 microversion: 2.1 time: 0.286418 Oct 04 18:45:48.204089 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2081/4215] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:47 2022] GET /compute/v2.1/servers/6cc94ec4-3e28-41e0-808e-9cd2263bca7d => generated 1611 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:49.217911 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-493ecfb9-1aa3-4f4b-887e-edb747698182 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:49.218626 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-493ecfb9-1aa3-4f4b-887e-edb747698182 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] [instance: 6cc94ec4-3e28-41e0-808e-9cd2263bca7d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:49.228801 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-493ecfb9-1aa3-4f4b-887e-edb747698182 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:49.231122 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-493ecfb9-1aa3-4f4b-887e-edb747698182 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:49.231944 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-493ecfb9-1aa3-4f4b-887e-edb747698182 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:49.234229 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-493ecfb9-1aa3-4f4b-887e-edb747698182 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:49.235703 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-493ecfb9-1aa3-4f4b-887e-edb747698182 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:49.238718 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-493ecfb9-1aa3-4f4b-887e-edb747698182 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:49.311253 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-493ecfb9-1aa3-4f4b-887e-edb747698182 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:49.311679 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-493ecfb9-1aa3-4f4b-887e-edb747698182 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:49.314518 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-493ecfb9-1aa3-4f4b-887e-edb747698182 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:49.316203 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-493ecfb9-1aa3-4f4b-887e-edb747698182 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lazy-loading 'fault' on Instance uuid 6cc94ec4-3e28-41e0-808e-9cd2263bca7d {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:45:49.856687 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-493ecfb9-1aa3-4f4b-887e-edb747698182 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a02cd1108b947b186202f6d15e6cf0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c0b095138354810949093e7ea03b8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:49.867808 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-493ecfb9-1aa3-4f4b-887e-edb747698182 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] 10.222.0.20 "GET /compute/v2.1/servers/6cc94ec4-3e28-41e0-808e-9cd2263bca7d" status: 200 len: 1328 microversion: 2.1 time: 0.654198 Oct 04 18:45:49.882853 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2135/4216] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:49 2022] GET /compute/v2.1/servers/6cc94ec4-3e28-41e0-808e-9cd2263bca7d => generated 1328 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:50.896679 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-cd9dd62a-6ba7-4220-b93a-394e34ab8e45 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:50.898362 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-cd9dd62a-6ba7-4220-b93a-394e34ab8e45 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] [instance: 6cc94ec4-3e28-41e0-808e-9cd2263bca7d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:50.935827 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cd9dd62a-6ba7-4220-b93a-394e34ab8e45 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:50.936620 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cd9dd62a-6ba7-4220-b93a-394e34ab8e45 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:50.937708 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cd9dd62a-6ba7-4220-b93a-394e34ab8e45 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:50.938437 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cd9dd62a-6ba7-4220-b93a-394e34ab8e45 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:50.940469 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cd9dd62a-6ba7-4220-b93a-394e34ab8e45 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:50.943152 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cd9dd62a-6ba7-4220-b93a-394e34ab8e45 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:50.982918 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-cd9dd62a-6ba7-4220-b93a-394e34ab8e45 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] HTTP exception thrown: Instance 6cc94ec4-3e28-41e0-808e-9cd2263bca7d could not be found. Oct 04 18:45:50.988401 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-cd9dd62a-6ba7-4220-b93a-394e34ab8e45 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Request method failure captured: Oct 04 18:45:50.988401 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/6cc94ec4-3e28-41e0-808e-9cd2263bca7d HTTP/1.1 Oct 04 18:45:50.988401 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:45:50.988401 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:45:50.988401 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:45:50.988401 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:45:50.988401 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:45:50.988401 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:45:50.988401 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:45:50.988401 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:45:50.988401 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH6QCP_Mm0u_zJh3rlv9TOj2Igoda6-vR7WYG5pDNwbZBlQ7sbPpjY0VEaE5QXUvC0WQ6PYlSiWdLFTUbCyGwPyR0jMju-zeSdiC9nOtHASOWuZbWw1Hzq9GIth4UjavECzVg7p5cgN_6ok47SHAeSSzKwMOXfjtGGRwiVrRnPz4T6M Oct 04 18:45:50.988401 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:45:50.988401 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:45:50.988401 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:45:50.988401 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:45:50.988401 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:45:50.988401 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:45:50.988401 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 7c0b095138354810949093e7ea03b8bf Oct 04 18:45:50.988401 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-VolumesAdminNegativeTest-1617871381 Oct 04 18:45:50.988401 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:45:50.988401 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:45:50.988401 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7c0b095138354810949093e7ea03b8bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7c0b095138354810949093e7ea03b8bf", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7c0b095138354810949093e7ea03b8bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7c0b095138354810949093e7ea03b8bf"}]}] Oct 04 18:45:50.988401 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-VolumesAdminNegativeTest-1617871381 Oct 04 18:45:50.988401 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 7c0b095138354810949093e7ea03b8bf Oct 04 18:45:50.988401 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1617871381 Oct 04 18:45:50.988401 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-VolumesAdminNegativeTest-1617871381-project Oct 04 18:45:50.988401 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:45:50.988401 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:45:50.988401 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 0a02cd1108b947b186202f6d15e6cf0e Oct 04 18:45:50.988401 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-VolumesAdminNegativeTest-1617871381-project Oct 04 18:45:50.988401 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:45:50.988401 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 6cc94ec4-3e28-41e0-808e-9cd2263bca7d could not be found. Oct 04 18:45:50.988401 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '6cc94ec4-3e28-41e0-808e-9cd2263bca7d'} Oct 04 18:45:50.988401 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:45:50.988401 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:50.988401 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:45:50.988401 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:45:50.988401 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:45:50.988401 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:45:50.988401 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:45:50.988401 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:45:50.988401 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:45:50.988401 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:45:50.988401 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cc94ec4-3e28-41e0-808e-9cd2263bca7d could not be found. Oct 04 18:45:50.988401 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:45:50.988401 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:50.988401 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:45:50.988401 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:50.988401 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:45:50.988401 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:45:50.988401 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:45:50.988401 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:45:50.988401 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:45:50.988401 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:45:50.988401 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:45:50.988401 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:45:50.988401 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:45:50.988401 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:45:50.988401 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:45:50.988401 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:45:50.988401 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cc94ec4-3e28-41e0-808e-9cd2263bca7d could not be found. Oct 04 18:45:50.988401 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:45:50.988401 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:50.988401 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:45:50.994271 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:50.994271 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:45:50.994271 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:45:50.994271 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:45:50.994271 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:45:50.994271 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cc94ec4-3e28-41e0-808e-9cd2263bca7d could not be found. Oct 04 18:45:50.994271 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:45:50.994271 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-cd9dd62a-6ba7-4220-b93a-394e34ab8e45 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Returning 404 to user: Instance 6cc94ec4-3e28-41e0-808e-9cd2263bca7d could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:45:50.994271 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-cd9dd62a-6ba7-4220-b93a-394e34ab8e45 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] 10.222.0.20 "GET /compute/v2.1/servers/6cc94ec4-3e28-41e0-808e-9cd2263bca7d" status: 404 len: 111 microversion: 2.1 time: 0.102301 Oct 04 18:45:51.001611 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2082/4217] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:50 2022] GET /compute/v2.1/servers/6cc94ec4-3e28-41e0-808e-9cd2263bca7d => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:45:51.004386 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5b13981a-f4a6-4ab8-b273-424a09c155c7 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] Calling method '.version_select at 0x7fe253da0d30>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:51.009931 n-d-850501-14 devstack@n-api.service[123001]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5b13981a-f4a6-4ab8-b273-424a09c155c7 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] [6c8ce3ae-b440-4b28-996b-33b11441f461] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 18:45:52.021929 n-d-850501-14 devstack@n-api.service[123001]: INFO oslo.messaging._drivers.impl_rabbit [None req-5b13981a-f4a6-4ab8-b273-424a09c155c7 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] [6c8ce3ae-b440-4b28-996b-33b11441f461] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 35248. Oct 04 18:45:52.137731 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5b13981a-f4a6-4ab8-b273-424a09c155c7 tempest-VolumesAdminNegativeTest-1617871381 tempest-VolumesAdminNegativeTest-1617871381-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-48070174" status: 202 len: 0 microversion: 2.1 time: 1.135168 Oct 04 18:45:52.138738 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2136/4218] 10.222.0.20 () {58 vars in 1215 bytes} [Tue Oct 4 18:45:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-48070174 => generated 0 bytes in 1140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:45:54.322110 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4c989fb8-b3e4-4a92-8a5b-5fe241edd839 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:54.324108 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4c989fb8-b3e4-4a92-8a5b-5fe241edd839 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: 4d6dfac0-958d-4698-a050-6539caebe52c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:54.342447 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4c989fb8-b3e4-4a92-8a5b-5fe241edd839 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:54.344458 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4c989fb8-b3e4-4a92-8a5b-5fe241edd839 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:54.347381 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4c989fb8-b3e4-4a92-8a5b-5fe241edd839 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:54.348339 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4c989fb8-b3e4-4a92-8a5b-5fe241edd839 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:54.357865 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4c989fb8-b3e4-4a92-8a5b-5fe241edd839 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:54.363331 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4c989fb8-b3e4-4a92-8a5b-5fe241edd839 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:54.377385 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:54.642847 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-4c989fb8-b3e4-4a92-8a5b-5fe241edd839 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lazy-loading 'services' on Instance uuid 4d6dfac0-958d-4698-a050-6539caebe52c {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:45:55.083987 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4c989fb8-b3e4-4a92-8a5b-5fe241edd839 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c/os-volume_attachments/ae6b3d01-f8b3-4c58-b22c-d64349fe6b57" status: 202 len: 0 microversion: 2.1 time: 0.765694 Oct 04 18:45:55.085075 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2083/4219] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Oct 4 18:45:54 2022] DELETE /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c/os-volume_attachments/ae6b3d01-f8b3-4c58-b22c-d64349fe6b57 => generated 0 bytes in 768 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:45:55.094184 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b15872ab-48d5-4c60-8f19-58e3f96cac9a tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:55.096805 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b15872ab-48d5-4c60-8f19-58e3f96cac9a tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: 4d6dfac0-958d-4698-a050-6539caebe52c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:55.108337 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:55.121357 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b15872ab-48d5-4c60-8f19-58e3f96cac9a tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:55.122021 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b15872ab-48d5-4c60-8f19-58e3f96cac9a tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:55.123324 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b15872ab-48d5-4c60-8f19-58e3f96cac9a tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:55.128510 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b15872ab-48d5-4c60-8f19-58e3f96cac9a tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:55.129940 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b15872ab-48d5-4c60-8f19-58e3f96cac9a tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:55.130923 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b15872ab-48d5-4c60-8f19-58e3f96cac9a tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:55.197652 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b15872ab-48d5-4c60-8f19-58e3f96cac9a tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107737 Oct 04 18:45:55.201960 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2137/4220] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 18:45:55 2022] GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:45:56.214813 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d6c77674-2e32-4666-93a0-00eebf100f42 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:56.220445 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d6c77674-2e32-4666-93a0-00eebf100f42 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: 4d6dfac0-958d-4698-a050-6539caebe52c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:56.233125 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d6c77674-2e32-4666-93a0-00eebf100f42 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:56.233627 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d6c77674-2e32-4666-93a0-00eebf100f42 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:56.234072 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d6c77674-2e32-4666-93a0-00eebf100f42 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:56.243779 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d6c77674-2e32-4666-93a0-00eebf100f42 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:56.244568 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d6c77674-2e32-4666-93a0-00eebf100f42 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:56.246845 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d6c77674-2e32-4666-93a0-00eebf100f42 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:56.369595 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d6c77674-2e32-4666-93a0-00eebf100f42 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.150230 Oct 04 18:45:56.372015 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2084/4221] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 18:45:56 2022] GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c/os-volume_attachments => generated 197 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:45:56.936158 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c11ff464-e49f-4a8b-ac55-ccf85b59eee7 tempest-PortsAdminExtendedAttrsTestJSON-1318000261 tempest-PortsAdminExtendedAttrsTestJSON-1318000261-project-admin] Calling method '.version_select at 0x7fe2582d4790>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:56.939131 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c11ff464-e49f-4a8b-ac55-ccf85b59eee7 tempest-PortsAdminExtendedAttrsTestJSON-1318000261 tempest-PortsAdminExtendedAttrsTestJSON-1318000261-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:56.939766 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c11ff464-e49f-4a8b-ac55-ccf85b59eee7 tempest-PortsAdminExtendedAttrsTestJSON-1318000261 tempest-PortsAdminExtendedAttrsTestJSON-1318000261-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:56.940409 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c11ff464-e49f-4a8b-ac55-ccf85b59eee7 tempest-PortsAdminExtendedAttrsTestJSON-1318000261 tempest-PortsAdminExtendedAttrsTestJSON-1318000261-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:57.006923 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c11ff464-e49f-4a8b-ac55-ccf85b59eee7 tempest-PortsAdminExtendedAttrsTestJSON-1318000261 tempest-PortsAdminExtendedAttrsTestJSON-1318000261-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:57.014410 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c11ff464-e49f-4a8b-ac55-ccf85b59eee7 tempest-PortsAdminExtendedAttrsTestJSON-1318000261 tempest-PortsAdminExtendedAttrsTestJSON-1318000261-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:57.014872 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c11ff464-e49f-4a8b-ac55-ccf85b59eee7 tempest-PortsAdminExtendedAttrsTestJSON-1318000261 tempest-PortsAdminExtendedAttrsTestJSON-1318000261-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:57.046360 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c11ff464-e49f-4a8b-ac55-ccf85b59eee7 tempest-PortsAdminExtendedAttrsTestJSON-1318000261 tempest-PortsAdminExtendedAttrsTestJSON-1318000261-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:57.050487 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c11ff464-e49f-4a8b-ac55-ccf85b59eee7 tempest-PortsAdminExtendedAttrsTestJSON-1318000261 tempest-PortsAdminExtendedAttrsTestJSON-1318000261-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:57.051312 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c11ff464-e49f-4a8b-ac55-ccf85b59eee7 tempest-PortsAdminExtendedAttrsTestJSON-1318000261 tempest-PortsAdminExtendedAttrsTestJSON-1318000261-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:57.064102 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c11ff464-e49f-4a8b-ac55-ccf85b59eee7 tempest-PortsAdminExtendedAttrsTestJSON-1318000261 tempest-PortsAdminExtendedAttrsTestJSON-1318000261-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.537709 Oct 04 18:45:57.067261 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2138/4222] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Oct 4 18:45:56 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:45:57.384972 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0abbb093-760a-4c6b-a2a6-8fbf047a8d09 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:57.388796 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0abbb093-760a-4c6b-a2a6-8fbf047a8d09 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: 4d6dfac0-958d-4698-a050-6539caebe52c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:57.406908 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0abbb093-760a-4c6b-a2a6-8fbf047a8d09 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:57.417959 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0abbb093-760a-4c6b-a2a6-8fbf047a8d09 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:57.418424 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0abbb093-760a-4c6b-a2a6-8fbf047a8d09 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:57.420200 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0abbb093-760a-4c6b-a2a6-8fbf047a8d09 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:57.420678 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0abbb093-760a-4c6b-a2a6-8fbf047a8d09 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:57.421111 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0abbb093-760a-4c6b-a2a6-8fbf047a8d09 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:57.568738 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0abbb093-760a-4c6b-a2a6-8fbf047a8d09 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.185802 Oct 04 18:45:57.573862 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2085/4223] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 18:45:57 2022] GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c/os-volume_attachments => generated 197 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:45:58.582029 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-eaa84e61-f5f3-4524-ae23-686fcccbea41 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:58.584756 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-eaa84e61-f5f3-4524-ae23-686fcccbea41 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: 4d6dfac0-958d-4698-a050-6539caebe52c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:58.623010 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eaa84e61-f5f3-4524-ae23-686fcccbea41 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:58.623901 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eaa84e61-f5f3-4524-ae23-686fcccbea41 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:58.626886 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eaa84e61-f5f3-4524-ae23-686fcccbea41 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:58.627584 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eaa84e61-f5f3-4524-ae23-686fcccbea41 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:58.628069 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eaa84e61-f5f3-4524-ae23-686fcccbea41 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:58.635918 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eaa84e61-f5f3-4524-ae23-686fcccbea41 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:58.802313 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-eaa84e61-f5f3-4524-ae23-686fcccbea41 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.225187 Oct 04 18:45:58.805121 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2139/4224] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 18:45:58 2022] GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c/os-volume_attachments => generated 197 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:45:59.817171 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-379f9ec6-1c89-4f04-94ee-97269285080a tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:59.821167 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-379f9ec6-1c89-4f04-94ee-97269285080a tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: 4d6dfac0-958d-4698-a050-6539caebe52c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:59.837265 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-379f9ec6-1c89-4f04-94ee-97269285080a tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:59.839887 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-379f9ec6-1c89-4f04-94ee-97269285080a tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:59.840675 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-379f9ec6-1c89-4f04-94ee-97269285080a tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:59.841601 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-379f9ec6-1c89-4f04-94ee-97269285080a tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:59.843010 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-379f9ec6-1c89-4f04-94ee-97269285080a tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:59.844687 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-379f9ec6-1c89-4f04-94ee-97269285080a tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:59.972755 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-379f9ec6-1c89-4f04-94ee-97269285080a tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.159785 Oct 04 18:45:59.973999 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2086/4225] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 18:45:59 2022] GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c/os-volume_attachments => generated 197 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:46:00.987763 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b974d4c1-108c-48d0-858a-6aae9e84ee9e tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:00.990820 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b974d4c1-108c-48d0-858a-6aae9e84ee9e tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: 4d6dfac0-958d-4698-a050-6539caebe52c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:01.013246 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b974d4c1-108c-48d0-858a-6aae9e84ee9e tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:01.013741 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b974d4c1-108c-48d0-858a-6aae9e84ee9e tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:01.014186 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b974d4c1-108c-48d0-858a-6aae9e84ee9e tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:01.014899 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b974d4c1-108c-48d0-858a-6aae9e84ee9e tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:01.015348 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b974d4c1-108c-48d0-858a-6aae9e84ee9e tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:01.015774 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b974d4c1-108c-48d0-858a-6aae9e84ee9e tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:01.158299 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b974d4c1-108c-48d0-858a-6aae9e84ee9e tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.175860 Oct 04 18:46:01.165841 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2140/4226] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 18:46:00 2022] GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c/os-volume_attachments => generated 197 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:46:02.171919 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7c262112-e715-4beb-8c98-c4cc4f574e0a tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:02.175309 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7c262112-e715-4beb-8c98-c4cc4f574e0a tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: 4d6dfac0-958d-4698-a050-6539caebe52c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:02.206456 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c262112-e715-4beb-8c98-c4cc4f574e0a tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:02.210025 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c262112-e715-4beb-8c98-c4cc4f574e0a tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:02.210327 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c262112-e715-4beb-8c98-c4cc4f574e0a tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:02.211063 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c262112-e715-4beb-8c98-c4cc4f574e0a tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:02.219870 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c262112-e715-4beb-8c98-c4cc4f574e0a tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:02.220407 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c262112-e715-4beb-8c98-c4cc4f574e0a tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:02.317249 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7c262112-e715-4beb-8c98-c4cc4f574e0a tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.143822 Oct 04 18:46:02.322398 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2087/4227] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 18:46:02 2022] GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c/os-volume_attachments => generated 197 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:46:03.329897 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b86aebc3-bce9-4bf1-9813-8ed4e1965cc7 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:03.332816 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b86aebc3-bce9-4bf1-9813-8ed4e1965cc7 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: 4d6dfac0-958d-4698-a050-6539caebe52c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:03.353617 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b86aebc3-bce9-4bf1-9813-8ed4e1965cc7 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:03.357381 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b86aebc3-bce9-4bf1-9813-8ed4e1965cc7 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:03.359704 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b86aebc3-bce9-4bf1-9813-8ed4e1965cc7 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:03.361012 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b86aebc3-bce9-4bf1-9813-8ed4e1965cc7 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:03.380397 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b86aebc3-bce9-4bf1-9813-8ed4e1965cc7 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:03.381074 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b86aebc3-bce9-4bf1-9813-8ed4e1965cc7 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:03.481764 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b86aebc3-bce9-4bf1-9813-8ed4e1965cc7 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.155743 Oct 04 18:46:03.482908 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2141/4228] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 18:46:03 2022] GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c/os-volume_attachments => generated 197 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:46:04.498497 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-272e6d1e-7445-4a67-be7b-855cce0cf271 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:04.498497 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-272e6d1e-7445-4a67-be7b-855cce0cf271 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: 4d6dfac0-958d-4698-a050-6539caebe52c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:04.514487 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-272e6d1e-7445-4a67-be7b-855cce0cf271 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:04.514990 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-272e6d1e-7445-4a67-be7b-855cce0cf271 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:04.515440 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-272e6d1e-7445-4a67-be7b-855cce0cf271 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:04.516192 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-272e6d1e-7445-4a67-be7b-855cce0cf271 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:04.516657 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-272e6d1e-7445-4a67-be7b-855cce0cf271 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:04.536606 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-272e6d1e-7445-4a67-be7b-855cce0cf271 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:04.623609 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-39bb6624-e6a9-4b8e-84e8-104fc63e36e3 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Action: 'create', calling method: .version_select at 0x7fe253d6b700>, body: {"keypair": {"name": "tempest-keypair-1474378313", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOoZag0fcoBoinlNdG2NvuIKQnXVlNJ8b0KXvbKHQwqu44c2lGunHChOV1FyZ0KSXuMlYSvateyvYZ1XMwZht7fvXRfzijLvQIVTRTdGEbJ6LhnGSxJZtxEi1JXanqRIeQ=="}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:04.657096 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-39bb6624-e6a9-4b8e-84e8-104fc63e36e3 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Getting quotas for project 57d8fd392d5b4e8798cb51fe0e54ad3b. Resources: {'key_pairs'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:46:04.668322 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-272e6d1e-7445-4a67-be7b-855cce0cf271 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.177767 Oct 04 18:46:04.669536 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2142/4229] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 18:46:04 2022] GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c/os-volume_attachments => generated 197 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:46:04.690932 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-39bb6624-e6a9-4b8e-84e8-104fc63e36e3 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Getting quotas for user ee7fee2b098d4eb8bdc8df2a929cdede and project 57d8fd392d5b4e8798cb51fe0e54ad3b. Resources: {'key_pairs'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:46:04.847922 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-39bb6624-e6a9-4b8e-84e8-104fc63e36e3 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.362429 Oct 04 18:46:04.854602 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2088/4230] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Oct 4 18:46:04 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:46:05.682542 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-18081a49-437c-430e-b872-b94ca80ab9c1 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:05.684864 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-18081a49-437c-430e-b872-b94ca80ab9c1 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: 4d6dfac0-958d-4698-a050-6539caebe52c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:05.705685 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-18081a49-437c-430e-b872-b94ca80ab9c1 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:05.706194 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-18081a49-437c-430e-b872-b94ca80ab9c1 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:05.706631 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-18081a49-437c-430e-b872-b94ca80ab9c1 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:05.712953 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-18081a49-437c-430e-b872-b94ca80ab9c1 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:05.714176 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-18081a49-437c-430e-b872-b94ca80ab9c1 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:05.714806 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-18081a49-437c-430e-b872-b94ca80ab9c1 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:05.857813 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:46:05.903684 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-18081a49-437c-430e-b872-b94ca80ab9c1 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.226245 Oct 04 18:46:05.911273 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2143/4231] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 18:46:05 2022] GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c/os-volume_attachments => generated 197 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:46:06.921364 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f3098515-c60d-4c35-aef5-8b5e8b382d26 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:06.924992 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f3098515-c60d-4c35-aef5-8b5e8b382d26 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: 4d6dfac0-958d-4698-a050-6539caebe52c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:06.945186 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f3098515-c60d-4c35-aef5-8b5e8b382d26 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:06.948871 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f3098515-c60d-4c35-aef5-8b5e8b382d26 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:06.949624 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f3098515-c60d-4c35-aef5-8b5e8b382d26 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:06.951786 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f3098515-c60d-4c35-aef5-8b5e8b382d26 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:06.955435 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f3098515-c60d-4c35-aef5-8b5e8b382d26 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:06.956160 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f3098515-c60d-4c35-aef5-8b5e8b382d26 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:07.084447 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f3098515-c60d-4c35-aef5-8b5e8b382d26 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.169216 Oct 04 18:46:07.085667 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2089/4232] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 18:46:06 2022] GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c/os-volume_attachments => generated 197 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:46:08.105896 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-fde9fdd3-0a30-4152-9d8e-71fac6799c20 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:08.108170 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-fde9fdd3-0a30-4152-9d8e-71fac6799c20 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: 4d6dfac0-958d-4698-a050-6539caebe52c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:08.125707 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fde9fdd3-0a30-4152-9d8e-71fac6799c20 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:08.126665 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fde9fdd3-0a30-4152-9d8e-71fac6799c20 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:08.133700 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fde9fdd3-0a30-4152-9d8e-71fac6799c20 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:08.135417 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fde9fdd3-0a30-4152-9d8e-71fac6799c20 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:08.138761 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fde9fdd3-0a30-4152-9d8e-71fac6799c20 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:08.139415 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fde9fdd3-0a30-4152-9d8e-71fac6799c20 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:08.225165 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-fde9fdd3-0a30-4152-9d8e-71fac6799c20 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.129842 Oct 04 18:46:08.226066 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2144/4233] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 18:46:08 2022] GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c/os-volume_attachments => generated 25 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:46:08.341406 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5ab0a25f-070d-4f9e-8ed6-91392be95e04 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:08.344121 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5ab0a25f-070d-4f9e-8ed6-91392be95e04 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: cd97d817-422a-457d-b653-020350d75d6e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:08.355542 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5ab0a25f-070d-4f9e-8ed6-91392be95e04 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:08.356036 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5ab0a25f-070d-4f9e-8ed6-91392be95e04 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:08.356497 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5ab0a25f-070d-4f9e-8ed6-91392be95e04 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:08.357200 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5ab0a25f-070d-4f9e-8ed6-91392be95e04 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:08.357649 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5ab0a25f-070d-4f9e-8ed6-91392be95e04 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:08.358070 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5ab0a25f-070d-4f9e-8ed6-91392be95e04 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:08.531717 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-5ab0a25f-070d-4f9e-8ed6-91392be95e04 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] HTTP exception thrown: Cannot 'reboot' instance cd97d817-422a-457d-b653-020350d75d6e while it is in vm_state rescued Oct 04 18:46:08.545211 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5ab0a25f-070d-4f9e-8ed6-91392be95e04 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Request method failure captured: Oct 04 18:46:08.545211 n-d-850501-14 devstack@n-api.service[123002]: request: POST /compute/v2.1/servers/cd97d817-422a-457d-b653-020350d75d6e/action HTTP/1.1 Oct 04 18:46:08.545211 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:46:08.545211 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:46:08.545211 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:46:08.545211 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 28 Oct 04 18:46:08.545211 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:46:08.545211 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:46:08.545211 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:46:08.545211 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:46:08.545211 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH5VeoXXX4R-gl3WW_fAsW_7hDIEWiZR35lPoIuJDBMUw75w4Z-93EJDy38x5YiA26dGCEdjKEzqMCUM4kpma5PpB_mUiDb0rAatpoM-ionDMXIgsOp1o3NTgluOHECynM7nFlIuW8aS-v8Gnb5xnrVGhYXFRV6ahForfC1sBHmJ1HA Oct 04 18:46:08.545211 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:46:08.545211 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:46:08.545211 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:46:08.545211 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:46:08.545211 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:46:08.545211 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:46:08.545211 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 9eb391aef10e4684ada5f811ae818f97 Oct 04 18:46:08.545211 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-124944821 Oct 04 18:46:08.545211 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:46:08.545211 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:46:08.545211 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9eb391aef10e4684ada5f811ae818f97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9eb391aef10e4684ada5f811ae818f97", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9eb391aef10e4684ada5f811ae818f97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9eb391aef10e4684ada5f811ae818f97"}]}] Oct 04 18:46:08.545211 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServerRescueNegativeTestJSON-124944821 Oct 04 18:46:08.545211 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 9eb391aef10e4684ada5f811ae818f97 Oct 04 18:46:08.545211 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-124944821 Oct 04 18:46:08.545211 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServerRescueNegativeTestJSON-124944821-project Oct 04 18:46:08.545211 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:46:08.545211 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:46:08.545211 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: c4243e3907374e5e9947c17e6288f0e7 Oct 04 18:46:08.545211 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServerRescueNegativeTestJSON-124944821-project Oct 04 18:46:08.545211 n-d-850501-14 devstack@n-api.service[123002]: Oct 04 18:46:08.545211 n-d-850501-14 devstack@n-api.service[123002]: {"reboot": {"type": "HARD"}} Oct 04 18:46:08.545211 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:46:08.545211 n-d-850501-14 devstack@n-api.service[123002]: exception: Cannot 'reboot' instance cd97d817-422a-457d-b653-020350d75d6e while it is in vm_state rescued Oct 04 18:46:08.545211 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'cd97d817-422a-457d-b653-020350d75d6e', 'body': {'reboot': {'type': 'HARD'}}} Oct 04 18:46:08.545211 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:46:08.545211 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:46:08.545211 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Oct 04 18:46:08.545211 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Oct 04 18:46:08.545211 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:46:08.545211 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:46:08.545211 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Oct 04 18:46:08.545211 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Oct 04 18:46:08.545211 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 18:46:08.545211 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 18:46:08.545211 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance cd97d817-422a-457d-b653-020350d75d6e in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Oct 04 18:46:08.545211 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:46:08.545211 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:46:08.545211 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:46:08.545211 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:46:08.545211 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:46:08.545211 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:46:08.545211 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:46:08.545211 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:46:08.545211 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:46:08.545211 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:46:08.545211 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:46:08.545211 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:46:08.545211 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Oct 04 18:46:08.545211 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 18:46:08.545211 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 18:46:08.545211 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 18:46:08.554061 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance cd97d817-422a-457d-b653-020350d75d6e while it is in vm_state rescued Oct 04 18:46:08.554061 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:46:08.554061 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:46:08.554061 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:46:08.554061 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:46:08.554061 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:46:08.554061 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:46:08.554061 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:46:08.554061 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:46:08.554061 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance cd97d817-422a-457d-b653-020350d75d6e while it is in vm_state rescued Oct 04 18:46:08.554061 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:46:08.554061 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5ab0a25f-070d-4f9e-8ed6-91392be95e04 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Returning 409 to user: Cannot 'reboot' instance cd97d817-422a-457d-b653-020350d75d6e while it is in vm_state rescued {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:46:08.554061 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5ab0a25f-070d-4f9e-8ed6-91392be95e04 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "POST /compute/v2.1/servers/cd97d817-422a-457d-b653-020350d75d6e/action" status: 409 len: 145 microversion: 2.1 time: 0.209843 Oct 04 18:46:08.554061 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2090/4234] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:46:08 2022] POST /compute/v2.1/servers/cd97d817-422a-457d-b653-020350d75d6e/action => generated 145 bytes in 211 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 04 18:46:08.558236 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9d72420c-1443-4b44-9485-70eb1d554a7b tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:08.562603 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-9d72420c-1443-4b44-9485-70eb1d554a7b tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: cd97d817-422a-457d-b653-020350d75d6e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:08.589324 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9d72420c-1443-4b44-9485-70eb1d554a7b tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:08.589889 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9d72420c-1443-4b44-9485-70eb1d554a7b tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:08.590339 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9d72420c-1443-4b44-9485-70eb1d554a7b tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:08.591067 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9d72420c-1443-4b44-9485-70eb1d554a7b tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:08.591524 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9d72420c-1443-4b44-9485-70eb1d554a7b tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:08.591950 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9d72420c-1443-4b44-9485-70eb1d554a7b tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:08.660799 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-9d72420c-1443-4b44-9485-70eb1d554a7b tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] HTTP exception thrown: Cannot 'rebuild' instance cd97d817-422a-457d-b653-020350d75d6e while it is in vm_state rescued Oct 04 18:46:08.676608 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9d72420c-1443-4b44-9485-70eb1d554a7b tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Request method failure captured: Oct 04 18:46:08.676608 n-d-850501-14 devstack@n-api.service[123001]: request: POST /compute/v2.1/servers/cd97d817-422a-457d-b653-020350d75d6e/action HTTP/1.1 Oct 04 18:46:08.676608 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:46:08.676608 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:46:08.676608 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:46:08.676608 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 65 Oct 04 18:46:08.676608 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:46:08.676608 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:46:08.676608 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:46:08.676608 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:46:08.676608 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPH5VeoXXX4R-gl3WW_fAsW_7hDIEWiZR35lPoIuJDBMUw75w4Z-93EJDy38x5YiA26dGCEdjKEzqMCUM4kpma5PpB_mUiDb0rAatpoM-ionDMXIgsOp1o3NTgluOHECynM7nFlIuW8aS-v8Gnb5xnrVGhYXFRV6ahForfC1sBHmJ1HA Oct 04 18:46:08.676608 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:46:08.676608 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:46:08.676608 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:46:08.676608 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:46:08.676608 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:46:08.676608 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:46:08.676608 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 9eb391aef10e4684ada5f811ae818f97 Oct 04 18:46:08.676608 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-124944821 Oct 04 18:46:08.676608 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:46:08.676608 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:46:08.676608 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9eb391aef10e4684ada5f811ae818f97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9eb391aef10e4684ada5f811ae818f97", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9eb391aef10e4684ada5f811ae818f97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9eb391aef10e4684ada5f811ae818f97"}]}] Oct 04 18:46:08.676608 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ServerRescueNegativeTestJSON-124944821 Oct 04 18:46:08.676608 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 9eb391aef10e4684ada5f811ae818f97 Oct 04 18:46:08.676608 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-124944821 Oct 04 18:46:08.676608 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ServerRescueNegativeTestJSON-124944821-project Oct 04 18:46:08.676608 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:46:08.676608 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:46:08.676608 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: c4243e3907374e5e9947c17e6288f0e7 Oct 04 18:46:08.676608 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ServerRescueNegativeTestJSON-124944821-project Oct 04 18:46:08.676608 n-d-850501-14 devstack@n-api.service[123001]: Oct 04 18:46:08.676608 n-d-850501-14 devstack@n-api.service[123001]: {"rebuild": {"imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559"}} Oct 04 18:46:08.676608 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:46:08.676608 n-d-850501-14 devstack@n-api.service[123001]: exception: Cannot 'rebuild' instance cd97d817-422a-457d-b653-020350d75d6e while it is in vm_state rescued Oct 04 18:46:08.676608 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': 'cd97d817-422a-457d-b653-020350d75d6e', 'body': {'rebuild': {'imageRef': 'f545e662-10b3-46b1-88bb-6e66dd294559'}}} Oct 04 18:46:08.676608 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:46:08.676608 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:46:08.676608 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Oct 04 18:46:08.676608 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Oct 04 18:46:08.676608 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 04 18:46:08.676608 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 18:46:08.676608 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 18:46:08.676608 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 18:46:08.676608 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:46:08.676608 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:46:08.676608 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 18:46:08.676608 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 18:46:08.676608 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance cd97d817-422a-457d-b653-020350d75d6e in vm_state rescued. Cannot rebuild while the instance is in this state. Oct 04 18:46:08.676608 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:46:08.676608 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:46:08.676608 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:46:08.676608 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:46:08.676608 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:46:08.676608 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:46:08.676608 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:46:08.676608 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:46:08.676608 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:46:08.676608 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:46:08.676608 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:46:08.676608 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:46:08.676608 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:46:08.676608 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:46:08.676608 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:46:08.682969 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:46:08.682969 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 04 18:46:08.682969 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Oct 04 18:46:08.682969 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 18:46:08.682969 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 18:46:08.682969 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 18:46:08.682969 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance cd97d817-422a-457d-b653-020350d75d6e while it is in vm_state rescued Oct 04 18:46:08.682969 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:46:08.682969 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:46:08.682969 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:46:08.682969 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:46:08.682969 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:46:08.682969 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:46:08.682969 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:46:08.682969 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:46:08.682969 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance cd97d817-422a-457d-b653-020350d75d6e while it is in vm_state rescued Oct 04 18:46:08.682969 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:46:08.682969 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9d72420c-1443-4b44-9485-70eb1d554a7b tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Returning 409 to user: Cannot 'rebuild' instance cd97d817-422a-457d-b653-020350d75d6e while it is in vm_state rescued {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:46:08.682969 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9d72420c-1443-4b44-9485-70eb1d554a7b tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "POST /compute/v2.1/servers/cd97d817-422a-457d-b653-020350d75d6e/action" status: 409 len: 146 microversion: 2.1 time: 0.125893 Oct 04 18:46:08.685588 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2145/4235] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:46:08 2022] POST /compute/v2.1/servers/cd97d817-422a-457d-b653-020350d75d6e/action => generated 146 bytes in 133 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:46:08.690709 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f3e8c688-0979-4289-a1f1-ec89cf3d4569 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:08.691276 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f3e8c688-0979-4289-a1f1-ec89cf3d4569 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: 4d6dfac0-958d-4698-a050-6539caebe52c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:08.716421 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f3e8c688-0979-4289-a1f1-ec89cf3d4569 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:08.720951 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f3e8c688-0979-4289-a1f1-ec89cf3d4569 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:08.721458 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f3e8c688-0979-4289-a1f1-ec89cf3d4569 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:08.725519 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f3e8c688-0979-4289-a1f1-ec89cf3d4569 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:08.734329 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f3e8c688-0979-4289-a1f1-ec89cf3d4569 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:08.738358 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f3e8c688-0979-4289-a1f1-ec89cf3d4569 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:08.913610 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f3e8c688-0979-4289-a1f1-ec89cf3d4569 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: 4d6dfac0-958d-4698-a050-6539caebe52c] Going to try to terminate instance {{(pid=123002) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:46:09.516611 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f3e8c688-0979-4289-a1f1-ec89cf3d4569 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c" status: 204 len: 0 microversion: 2.1 time: 0.830851 Oct 04 18:46:09.517849 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2091/4236] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:46:08 2022] DELETE /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c => generated 0 bytes in 833 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:46:09.528538 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d61c9969-b4cd-4d15-9e0c-40950f85a791 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:09.529242 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d61c9969-b4cd-4d15-9e0c-40950f85a791 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: 4d6dfac0-958d-4698-a050-6539caebe52c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:09.543584 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d61c9969-b4cd-4d15-9e0c-40950f85a791 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:09.544326 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d61c9969-b4cd-4d15-9e0c-40950f85a791 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:09.544926 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d61c9969-b4cd-4d15-9e0c-40950f85a791 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:09.546637 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d61c9969-b4cd-4d15-9e0c-40950f85a791 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:09.548940 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d61c9969-b4cd-4d15-9e0c-40950f85a791 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:09.549643 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d61c9969-b4cd-4d15-9e0c-40950f85a791 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:10.742749 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d61c9969-b4cd-4d15-9e0c-40950f85a791 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:10.753429 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d61c9969-b4cd-4d15-9e0c-40950f85a791 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c" status: 200 len: 1687 microversion: 2.1 time: 1.230936 Oct 04 18:46:10.760643 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2146/4237] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:09 2022] GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c => generated 1687 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:11.810293 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a4748f01-49b5-4141-bf33-ae6a25097983 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:11.811048 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a4748f01-49b5-4141-bf33-ae6a25097983 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: 4d6dfac0-958d-4698-a050-6539caebe52c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:11.821926 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a4748f01-49b5-4141-bf33-ae6a25097983 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:11.822590 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a4748f01-49b5-4141-bf33-ae6a25097983 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:11.823694 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a4748f01-49b5-4141-bf33-ae6a25097983 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:11.824616 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a4748f01-49b5-4141-bf33-ae6a25097983 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:11.825227 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a4748f01-49b5-4141-bf33-ae6a25097983 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:11.825857 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a4748f01-49b5-4141-bf33-ae6a25097983 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:12.386510 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-79065c13-ab39-48df-9031-521ac98f02a3 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1697655676", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": [{"uuid": "334d1b7e-7632-43fb-8807-6117cf357d4f"}]}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:12.602373 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.neutron [None req-79065c13-ab39-48df-9031-521ac98f02a3 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] validate_networks() for [('334d1b7e-7632-43fb-8807-6117cf357d4f', None, None, None, None, None)] {{(pid=123001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:46:12.802207 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a4748f01-49b5-4141-bf33-ae6a25097983 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:12.818032 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a4748f01-49b5-4141-bf33-ae6a25097983 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c" status: 200 len: 1687 microversion: 2.1 time: 1.034261 Oct 04 18:46:12.833025 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2092/4238] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:11 2022] GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c => generated 1687 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:13.847195 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b8efc4c0-30c9-4b77-a51c-050d65552e77 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:13.849276 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b8efc4c0-30c9-4b77-a51c-050d65552e77 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: 4d6dfac0-958d-4698-a050-6539caebe52c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:13.862669 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b8efc4c0-30c9-4b77-a51c-050d65552e77 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:13.865371 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b8efc4c0-30c9-4b77-a51c-050d65552e77 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:13.868739 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b8efc4c0-30c9-4b77-a51c-050d65552e77 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:13.871956 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b8efc4c0-30c9-4b77-a51c-050d65552e77 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:13.873318 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b8efc4c0-30c9-4b77-a51c-050d65552e77 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:13.873917 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b8efc4c0-30c9-4b77-a51c-050d65552e77 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:14.620020 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b8efc4c0-30c9-4b77-a51c-050d65552e77 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:14.649296 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b8efc4c0-30c9-4b77-a51c-050d65552e77 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c" status: 200 len: 1687 microversion: 2.1 time: 0.789777 Oct 04 18:46:14.654719 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2093/4239] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:13 2022] GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c => generated 1687 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:15.013752 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-79065c13-ab39-48df-9031-521ac98f02a3 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:46:15.014507 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-79065c13-ab39-48df-9031-521ac98f02a3 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:46:15.015388 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-79065c13-ab39-48df-9031-521ac98f02a3 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:46:15.015962 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-79065c13-ab39-48df-9031-521ac98f02a3 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:46:15.016620 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-79065c13-ab39-48df-9031-521ac98f02a3 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:46:15.035778 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-79065c13-ab39-48df-9031-521ac98f02a3 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:15.036654 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-79065c13-ab39-48df-9031-521ac98f02a3 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:15.037470 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-79065c13-ab39-48df-9031-521ac98f02a3 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:15.038800 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-79065c13-ab39-48df-9031-521ac98f02a3 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:15.039595 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-79065c13-ab39-48df-9031-521ac98f02a3 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:15.040624 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-79065c13-ab39-48df-9031-521ac98f02a3 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:15.088514 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-79065c13-ab39-48df-9031-521ac98f02a3 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Getting quotas for project b6c6b9deecde44b5953d22b38b5b0ff1. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:46:15.102338 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-79065c13-ab39-48df-9031-521ac98f02a3 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Getting quotas for user 5b4eb70f22ba4872b890a4f160cc1805 and project b6c6b9deecde44b5953d22b38b5b0ff1. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:46:15.139957 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-79065c13-ab39-48df-9031-521ac98f02a3 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Going to run 1 instances... {{(pid=123001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:46:15.145667 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-79065c13-ab39-48df-9031-521ac98f02a3 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:46:15.401658 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-79065c13-ab39-48df-9031-521ac98f02a3 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.555589 Oct 04 18:46:15.407368 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2147/4240] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:46:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 3570 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 18:46:15.420310 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-cc5422bd-ed9f-4cd3-bee4-11113aaba765 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:15.422086 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-cc5422bd-ed9f-4cd3-bee4-11113aaba765 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:15.437273 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=4 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:46:15.649407 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-cc5422bd-ed9f-4cd3-bee4-11113aaba765 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:15.668102 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-cc5422bd-ed9f-4cd3-bee4-11113aaba765 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1217 microversion: 2.1 time: 0.251953 Oct 04 18:46:15.675588 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2094/4241] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:15 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1217 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:46:15.679366 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2dc8017d-04da-4c1c-984e-e4c69d8919a1 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:15.681142 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2dc8017d-04da-4c1c-984e-e4c69d8919a1 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: 4d6dfac0-958d-4698-a050-6539caebe52c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:15.717110 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2dc8017d-04da-4c1c-984e-e4c69d8919a1 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:15.724778 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2dc8017d-04da-4c1c-984e-e4c69d8919a1 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:15.729016 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2dc8017d-04da-4c1c-984e-e4c69d8919a1 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:15.729665 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2dc8017d-04da-4c1c-984e-e4c69d8919a1 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:15.731557 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2dc8017d-04da-4c1c-984e-e4c69d8919a1 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:15.733173 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2dc8017d-04da-4c1c-984e-e4c69d8919a1 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:15.770969 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b8d28d6c-38cb-4703-ac7c-68e981a0e9e6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1777772629", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5739801d-d64f-45ac-b67b-5773a9d23794"}], "security_groups": [{"name": "tempest-securitygroup--1517989812"}], "key_name": "tempest-keypair-1474378313", "user_data": "}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:15.934225 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-2dc8017d-04da-4c1c-984e-e4c69d8919a1 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:15.949002 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2dc8017d-04da-4c1c-984e-e4c69d8919a1 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c" status: 200 len: 1620 microversion: 2.1 time: 0.274787 Oct 04 18:46:15.950054 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2148/4242] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:15 2022] GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c => generated 1620 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:16.271369 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-b8d28d6c-38cb-4703-ac7c-68e981a0e9e6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] validate_networks() for [('5739801d-d64f-45ac-b67b-5773a9d23794', None, None, None, None, None)] {{(pid=123002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:46:16.518999 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-824416ca-a2a5-4e26-8b92-9447bfd0227d req-01824d4b-3f64-430f-ad99-0901db4ccf87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d6dfac0-958d-4698-a050-6539caebe52c", "name": "network-vif-deleted", "tag": "b3bc4ab3-40de-48c0-8c27-0fbd4d0780d1"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:16.578834 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-824416ca-a2a5-4e26-8b92-9447bfd0227d req-01824d4b-3f64-430f-ad99-0901db4ccf87 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:16.584522 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-824416ca-a2a5-4e26-8b92-9447bfd0227d req-01824d4b-3f64-430f-ad99-0901db4ccf87 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:16.597676 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-824416ca-a2a5-4e26-8b92-9447bfd0227d req-01824d4b-3f64-430f-ad99-0901db4ccf87 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:16.658508 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-824416ca-a2a5-4e26-8b92-9447bfd0227d req-01824d4b-3f64-430f-ad99-0901db4ccf87 service nova] Creating event network-vif-deleted:b3bc4ab3-40de-48c0-8c27-0fbd4d0780d1 for instance 4d6dfac0-958d-4698-a050-6539caebe52c on n-h1-850501-14 Oct 04 18:46:16.670138 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-824416ca-a2a5-4e26-8b92-9447bfd0227d req-01824d4b-3f64-430f-ad99-0901db4ccf87 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163373 Oct 04 18:46:16.679419 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2149/4243] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:46:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:46:16.702905 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a1fac37a-f9c7-4f2e-ba01-18dd2c5fa10e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:16.703612 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a1fac37a-f9c7-4f2e-ba01-18dd2c5fa10e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:16.799819 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:46:17.108480 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a1fac37a-f9c7-4f2e-ba01-18dd2c5fa10e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:17.128184 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a1fac37a-f9c7-4f2e-ba01-18dd2c5fa10e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1217 microversion: 2.1 time: 0.421320 Oct 04 18:46:17.128847 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2150/4244] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:16 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1217 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:17.152518 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-65fb5f5e-910a-43ae-8937-69e65741ccfa tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:17.154146 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-65fb5f5e-910a-43ae-8937-69e65741ccfa tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: 4d6dfac0-958d-4698-a050-6539caebe52c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:17.179240 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-65fb5f5e-910a-43ae-8937-69e65741ccfa tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:17.189620 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-65fb5f5e-910a-43ae-8937-69e65741ccfa tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:17.197311 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-65fb5f5e-910a-43ae-8937-69e65741ccfa tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:17.199600 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-65fb5f5e-910a-43ae-8937-69e65741ccfa tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:17.200934 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-65fb5f5e-910a-43ae-8937-69e65741ccfa tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:17.202921 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-65fb5f5e-910a-43ae-8937-69e65741ccfa tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:17.288824 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-65fb5f5e-910a-43ae-8937-69e65741ccfa tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:17.289330 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-65fb5f5e-910a-43ae-8937-69e65741ccfa tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:17.289771 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-65fb5f5e-910a-43ae-8937-69e65741ccfa tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:17.294157 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-65fb5f5e-910a-43ae-8937-69e65741ccfa tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lazy-loading 'fault' on Instance uuid 4d6dfac0-958d-4698-a050-6539caebe52c {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:46:17.564391 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-65fb5f5e-910a-43ae-8937-69e65741ccfa tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:17.590122 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-65fb5f5e-910a-43ae-8937-69e65741ccfa tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c" status: 200 len: 1334 microversion: 2.1 time: 0.460128 Oct 04 18:46:17.601557 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2151/4245] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:17 2022] GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c => generated 1334 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:18.155207 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-21c5bc46-8e1b-4b02-93ab-8f7c081f8c9c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:18.155974 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-21c5bc46-8e1b-4b02-93ab-8f7c081f8c9c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:18.168988 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-21c5bc46-8e1b-4b02-93ab-8f7c081f8c9c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:18.169995 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-21c5bc46-8e1b-4b02-93ab-8f7c081f8c9c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:18.172892 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-21c5bc46-8e1b-4b02-93ab-8f7c081f8c9c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:18.173816 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-21c5bc46-8e1b-4b02-93ab-8f7c081f8c9c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:18.174490 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-21c5bc46-8e1b-4b02-93ab-8f7c081f8c9c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:18.175064 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-21c5bc46-8e1b-4b02-93ab-8f7c081f8c9c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:18.238967 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-b8d28d6c-38cb-4703-ac7c-68e981a0e9e6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:46:18.240580 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-b8d28d6c-38cb-4703-ac7c-68e981a0e9e6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:46:18.241241 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-b8d28d6c-38cb-4703-ac7c-68e981a0e9e6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:46:18.242155 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-b8d28d6c-38cb-4703-ac7c-68e981a0e9e6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:46:18.242721 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-b8d28d6c-38cb-4703-ac7c-68e981a0e9e6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:46:18.280149 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b8d28d6c-38cb-4703-ac7c-68e981a0e9e6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:18.280641 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b8d28d6c-38cb-4703-ac7c-68e981a0e9e6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:18.281087 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b8d28d6c-38cb-4703-ac7c-68e981a0e9e6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:18.284637 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b8d28d6c-38cb-4703-ac7c-68e981a0e9e6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:18.285318 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b8d28d6c-38cb-4703-ac7c-68e981a0e9e6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:18.287068 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b8d28d6c-38cb-4703-ac7c-68e981a0e9e6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:18.331933 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-b8d28d6c-38cb-4703-ac7c-68e981a0e9e6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Getting quotas for project 57d8fd392d5b4e8798cb51fe0e54ad3b. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:46:18.343575 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-21c5bc46-8e1b-4b02-93ab-8f7c081f8c9c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:18.353813 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-21c5bc46-8e1b-4b02-93ab-8f7c081f8c9c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1213 microversion: 2.1 time: 0.202491 Oct 04 18:46:18.360287 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2152/4246] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:18 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1213 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:46:18.373028 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-b8d28d6c-38cb-4703-ac7c-68e981a0e9e6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Getting quotas for user ee7fee2b098d4eb8bdc8df2a929cdede and project 57d8fd392d5b4e8798cb51fe0e54ad3b. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:46:18.418746 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b8d28d6c-38cb-4703-ac7c-68e981a0e9e6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Going to run 1 instances... {{(pid=123002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:46:18.425291 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b8d28d6c-38cb-4703-ac7c-68e981a0e9e6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:46:18.607797 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b8d28d6c-38cb-4703-ac7c-68e981a0e9e6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.842819 Oct 04 18:46:18.616185 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2095/4247] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:46:15 2022] POST /compute/v2.1/servers => generated 409 bytes in 2851 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:46:18.616541 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-22773820-6a97-4fc3-a354-4418fe522a84 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:18.617162 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-22773820-6a97-4fc3-a354-4418fe522a84 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: 4d6dfac0-958d-4698-a050-6539caebe52c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:18.635973 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-22773820-6a97-4fc3-a354-4418fe522a84 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:18.636974 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a6a0fef2-9e54-4b11-a8aa-18cd2761e9a1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:18.637522 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-22773820-6a97-4fc3-a354-4418fe522a84 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:18.637969 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-22773820-6a97-4fc3-a354-4418fe522a84 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:18.638334 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a6a0fef2-9e54-4b11-a8aa-18cd2761e9a1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:18.638699 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-22773820-6a97-4fc3-a354-4418fe522a84 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:18.643047 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-22773820-6a97-4fc3-a354-4418fe522a84 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:18.643644 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-22773820-6a97-4fc3-a354-4418fe522a84 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:18.711683 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-22773820-6a97-4fc3-a354-4418fe522a84 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] HTTP exception thrown: Instance 4d6dfac0-958d-4698-a050-6539caebe52c could not be found. Oct 04 18:46:18.726248 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-22773820-6a97-4fc3-a354-4418fe522a84 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Request method failure captured: Oct 04 18:46:18.726248 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c HTTP/1.1 Oct 04 18:46:18.726248 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:46:18.726248 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:46:18.726248 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:46:18.726248 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:46:18.726248 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:46:18.726248 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:46:18.726248 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:46:18.726248 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:46:18.726248 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPH5VeoXXX4R-gl3WW_fAsW_7hDIEWiZR35lPoIuJDBMUw75w4Z-93EJDy38x5YiA26dGCEdjKEzqMCUM4kpma5PpB_mUiDb0rAatpoM-ionDMXIgsOp1o3NTgluOHECynM7nFlIuW8aS-v8Gnb5xnrVGhYXFRV6ahForfC1sBHmJ1HA Oct 04 18:46:18.726248 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:46:18.726248 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:46:18.726248 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:46:18.726248 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:46:18.726248 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:46:18.726248 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:46:18.726248 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 9eb391aef10e4684ada5f811ae818f97 Oct 04 18:46:18.726248 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-124944821 Oct 04 18:46:18.726248 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:46:18.726248 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:46:18.726248 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9eb391aef10e4684ada5f811ae818f97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9eb391aef10e4684ada5f811ae818f97", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9eb391aef10e4684ada5f811ae818f97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9eb391aef10e4684ada5f811ae818f97"}]}] Oct 04 18:46:18.726248 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ServerRescueNegativeTestJSON-124944821 Oct 04 18:46:18.726248 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 9eb391aef10e4684ada5f811ae818f97 Oct 04 18:46:18.726248 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-124944821 Oct 04 18:46:18.726248 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ServerRescueNegativeTestJSON-124944821-project Oct 04 18:46:18.726248 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:46:18.726248 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:46:18.726248 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: c4243e3907374e5e9947c17e6288f0e7 Oct 04 18:46:18.726248 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ServerRescueNegativeTestJSON-124944821-project Oct 04 18:46:18.726248 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:46:18.726248 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 4d6dfac0-958d-4698-a050-6539caebe52c could not be found. Oct 04 18:46:18.726248 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '4d6dfac0-958d-4698-a050-6539caebe52c'} Oct 04 18:46:18.726248 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:46:18.726248 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:46:18.726248 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:46:18.726248 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:46:18.726248 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:46:18.726248 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:46:18.726248 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:46:18.726248 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:46:18.726248 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:46:18.726248 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:46:18.726248 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d6dfac0-958d-4698-a050-6539caebe52c could not be found. Oct 04 18:46:18.726248 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:46:18.726248 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:46:18.726248 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:46:18.726248 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:46:18.726248 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:46:18.726248 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:46:18.726248 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:46:18.726248 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:46:18.726248 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:46:18.726248 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:46:18.726248 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:46:18.726248 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:46:18.726248 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:46:18.726248 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:46:18.726248 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:46:18.726248 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:46:18.726248 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d6dfac0-958d-4698-a050-6539caebe52c could not be found. Oct 04 18:46:18.726248 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:46:18.726248 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:46:18.730214 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:46:18.730214 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:46:18.730214 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:46:18.730214 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:46:18.730214 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:46:18.730214 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:46:18.730214 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d6dfac0-958d-4698-a050-6539caebe52c could not be found. Oct 04 18:46:18.730214 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:46:18.736159 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-22773820-6a97-4fc3-a354-4418fe522a84 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Returning 404 to user: Instance 4d6dfac0-958d-4698-a050-6539caebe52c could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:46:18.738000 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-22773820-6a97-4fc3-a354-4418fe522a84 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c" status: 404 len: 111 microversion: 2.1 time: 0.126331 Oct 04 18:46:18.746834 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2153/4248] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:18 2022] GET /compute/v2.1/servers/4d6dfac0-958d-4698-a050-6539caebe52c => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:46:18.786810 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-856ed374-a509-4e35-a170-05959c6c7668 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '.version_select at 0x7fe2582d43a0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:18.887583 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a6a0fef2-9e54-4b11-a8aa-18cd2761e9a1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:18.907403 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a6a0fef2-9e54-4b11-a8aa-18cd2761e9a1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1239 microversion: 2.1 time: 0.288929 Oct 04 18:46:18.909942 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2096/4249] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:18 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1239 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:18.966321 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-856ed374-a509-4e35-a170-05959c6c7668 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-507887397" status: 202 len: 0 microversion: 2.1 time: 0.218155 Oct 04 18:46:18.970341 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2154/4250] 10.222.0.20 () {58 vars in 1218 bytes} [Tue Oct 4 18:46:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-507887397 => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:46:19.389365 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8ecf625e-62d9-4bfe-b586-4270dea33c98 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:19.391182 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8ecf625e-62d9-4bfe-b586-4270dea33c98 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:19.404699 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8ecf625e-62d9-4bfe-b586-4270dea33c98 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:19.406616 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8ecf625e-62d9-4bfe-b586-4270dea33c98 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:19.407740 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8ecf625e-62d9-4bfe-b586-4270dea33c98 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:19.410393 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8ecf625e-62d9-4bfe-b586-4270dea33c98 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:19.411045 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8ecf625e-62d9-4bfe-b586-4270dea33c98 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:19.412421 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8ecf625e-62d9-4bfe-b586-4270dea33c98 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:19.795592 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8ecf625e-62d9-4bfe-b586-4270dea33c98 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:19.813585 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8ecf625e-62d9-4bfe-b586-4270dea33c98 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1287 microversion: 2.1 time: 0.431377 Oct 04 18:46:19.817038 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2097/4251] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:19 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1287 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:19.935880 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b06faec4-08de-4583-a03a-f89b90aab9f1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:19.936750 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b06faec4-08de-4583-a03a-f89b90aab9f1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:20.069003 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b06faec4-08de-4583-a03a-f89b90aab9f1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:20.161737 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b06faec4-08de-4583-a03a-f89b90aab9f1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1239 microversion: 2.1 time: 0.148324 Oct 04 18:46:20.161737 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2155/4252] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:19 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1239 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:20.849341 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ffb293e7-c520-438d-b26b-96cadf7b5e70 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:20.849999 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ffb293e7-c520-438d-b26b-96cadf7b5e70 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:20.860102 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ffb293e7-c520-438d-b26b-96cadf7b5e70 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:20.860593 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ffb293e7-c520-438d-b26b-96cadf7b5e70 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:20.861184 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ffb293e7-c520-438d-b26b-96cadf7b5e70 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:20.862053 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ffb293e7-c520-438d-b26b-96cadf7b5e70 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:20.862917 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ffb293e7-c520-438d-b26b-96cadf7b5e70 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:20.863509 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ffb293e7-c520-438d-b26b-96cadf7b5e70 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:20.966838 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ffb293e7-c520-438d-b26b-96cadf7b5e70 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:20.982809 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ffb293e7-c520-438d-b26b-96cadf7b5e70 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1275 microversion: 2.1 time: 0.138789 Oct 04 18:46:20.989272 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2098/4253] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:20 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1275 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:21.162887 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-62106cbf-4380-479d-b001-192e9eb64985 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:21.164522 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-62106cbf-4380-479d-b001-192e9eb64985 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:21.176988 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-62106cbf-4380-479d-b001-192e9eb64985 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:21.177644 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-62106cbf-4380-479d-b001-192e9eb64985 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:21.179505 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-62106cbf-4380-479d-b001-192e9eb64985 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:21.180322 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-62106cbf-4380-479d-b001-192e9eb64985 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:21.180962 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-62106cbf-4380-479d-b001-192e9eb64985 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:21.181629 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-62106cbf-4380-479d-b001-192e9eb64985 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:21.323239 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-62106cbf-4380-479d-b001-192e9eb64985 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:21.391781 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-62106cbf-4380-479d-b001-192e9eb64985 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1243 microversion: 2.1 time: 0.209964 Oct 04 18:46:21.391781 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2156/4254] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:21 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1243 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:22.013768 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-84b64c14-d0f6-43e0-9bd3-7118767f4c69 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:22.016821 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-84b64c14-d0f6-43e0-9bd3-7118767f4c69 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:22.028982 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-84b64c14-d0f6-43e0-9bd3-7118767f4c69 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:22.030908 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-84b64c14-d0f6-43e0-9bd3-7118767f4c69 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:22.031755 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-84b64c14-d0f6-43e0-9bd3-7118767f4c69 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:22.032641 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-84b64c14-d0f6-43e0-9bd3-7118767f4c69 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:22.033357 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-84b64c14-d0f6-43e0-9bd3-7118767f4c69 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:22.034146 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-84b64c14-d0f6-43e0-9bd3-7118767f4c69 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:22.199215 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-84b64c14-d0f6-43e0-9bd3-7118767f4c69 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:22.214631 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-84b64c14-d0f6-43e0-9bd3-7118767f4c69 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1275 microversion: 2.1 time: 0.206912 Oct 04 18:46:22.229027 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2099/4255] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:22 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1275 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:22.406964 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-75902e22-64d4-4ab1-be2d-c67c0f36be14 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:22.407592 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-75902e22-64d4-4ab1-be2d-c67c0f36be14 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:22.426480 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-75902e22-64d4-4ab1-be2d-c67c0f36be14 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:22.427193 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-75902e22-64d4-4ab1-be2d-c67c0f36be14 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:22.427791 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-75902e22-64d4-4ab1-be2d-c67c0f36be14 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:22.428754 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-75902e22-64d4-4ab1-be2d-c67c0f36be14 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:22.429986 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-75902e22-64d4-4ab1-be2d-c67c0f36be14 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:22.430580 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-75902e22-64d4-4ab1-be2d-c67c0f36be14 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:22.668181 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-75902e22-64d4-4ab1-be2d-c67c0f36be14 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:22.677387 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-75902e22-64d4-4ab1-be2d-c67c0f36be14 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1291 microversion: 2.1 time: 0.273813 Oct 04 18:46:22.701354 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2157/4256] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:22 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1291 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:23.241725 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7620b149-f4db-4f47-ad67-5e4ff480986a tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:23.242138 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7620b149-f4db-4f47-ad67-5e4ff480986a tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:23.254601 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7620b149-f4db-4f47-ad67-5e4ff480986a tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:23.255178 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7620b149-f4db-4f47-ad67-5e4ff480986a tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:23.257468 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7620b149-f4db-4f47-ad67-5e4ff480986a tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:23.258019 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7620b149-f4db-4f47-ad67-5e4ff480986a tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:23.258359 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7620b149-f4db-4f47-ad67-5e4ff480986a tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:23.258805 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7620b149-f4db-4f47-ad67-5e4ff480986a tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:23.711996 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-03382c1e-83f6-4475-838b-a980cf46e42c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:23.715322 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-03382c1e-83f6-4475-838b-a980cf46e42c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:23.740923 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-03382c1e-83f6-4475-838b-a980cf46e42c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:23.746437 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-03382c1e-83f6-4475-838b-a980cf46e42c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:23.747157 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-03382c1e-83f6-4475-838b-a980cf46e42c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:23.754193 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-03382c1e-83f6-4475-838b-a980cf46e42c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:23.755402 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-03382c1e-83f6-4475-838b-a980cf46e42c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:23.757016 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-03382c1e-83f6-4475-838b-a980cf46e42c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:24.296530 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-03382c1e-83f6-4475-838b-a980cf46e42c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:24.308546 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-03382c1e-83f6-4475-838b-a980cf46e42c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1297 microversion: 2.1 time: 0.601510 Oct 04 18:46:24.321861 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2158/4257] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:23 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1297 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:46:24.770614 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7620b149-f4db-4f47-ad67-5e4ff480986a tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:24.786521 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7620b149-f4db-4f47-ad67-5e4ff480986a tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1317 microversion: 2.1 time: 1.548965 Oct 04 18:46:24.787645 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2100/4258] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:23 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1317 bytes in 1553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:25.338494 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e686f73d-b6c6-4b02-a1a1-da442dadd7ce tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:25.339753 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e686f73d-b6c6-4b02-a1a1-da442dadd7ce tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:25.348123 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:46:25.361231 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e686f73d-b6c6-4b02-a1a1-da442dadd7ce tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:25.361739 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e686f73d-b6c6-4b02-a1a1-da442dadd7ce tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:25.362192 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e686f73d-b6c6-4b02-a1a1-da442dadd7ce tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:25.368755 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e686f73d-b6c6-4b02-a1a1-da442dadd7ce tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:25.369464 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e686f73d-b6c6-4b02-a1a1-da442dadd7ce tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:25.370010 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e686f73d-b6c6-4b02-a1a1-da442dadd7ce tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:25.814185 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9c94d4f8-7021-4c84-ba22-ceb1498d4e0c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:25.814724 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9c94d4f8-7021-4c84-ba22-ceb1498d4e0c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:25.835731 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9c94d4f8-7021-4c84-ba22-ceb1498d4e0c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:25.841102 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9c94d4f8-7021-4c84-ba22-ceb1498d4e0c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:25.841812 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9c94d4f8-7021-4c84-ba22-ceb1498d4e0c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:25.843885 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9c94d4f8-7021-4c84-ba22-ceb1498d4e0c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:25.844544 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9c94d4f8-7021-4c84-ba22-ceb1498d4e0c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:25.846437 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9c94d4f8-7021-4c84-ba22-ceb1498d4e0c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:25.867938 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e686f73d-b6c6-4b02-a1a1-da442dadd7ce tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:25.882758 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e686f73d-b6c6-4b02-a1a1-da442dadd7ce tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1297 microversion: 2.1 time: 0.551602 Oct 04 18:46:25.888730 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2159/4259] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:25 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1297 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:25.907558 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:46:26.387917 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9c94d4f8-7021-4c84-ba22-ceb1498d4e0c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:26.410861 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9c94d4f8-7021-4c84-ba22-ceb1498d4e0c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1317 microversion: 2.1 time: 0.600529 Oct 04 18:46:26.434497 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2101/4260] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:25 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1317 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:46:26.911478 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9c40a264-f53a-40a1-a5b9-bf95a04c7d9c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:26.925670 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-9c40a264-f53a-40a1-a5b9-bf95a04c7d9c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:26.952192 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9c40a264-f53a-40a1-a5b9-bf95a04c7d9c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:26.953151 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9c40a264-f53a-40a1-a5b9-bf95a04c7d9c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:26.953944 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9c40a264-f53a-40a1-a5b9-bf95a04c7d9c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:26.961521 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9c40a264-f53a-40a1-a5b9-bf95a04c7d9c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:26.962576 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9c40a264-f53a-40a1-a5b9-bf95a04c7d9c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:26.964417 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9c40a264-f53a-40a1-a5b9-bf95a04c7d9c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:27.402577 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-016b48b5-079a-4bba-96ce-6a5921beafd4 req-144d1b3d-2cea-405e-ba67-79c5c66644ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95fb1a13-7441-4f74-ad81-5a9413496545", "tag": "73befc4a-98f7-414e-8302-6ba3a3fd9481"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:27.423600 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-016b48b5-079a-4bba-96ce-6a5921beafd4 req-144d1b3d-2cea-405e-ba67-79c5c66644ec service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:27.424416 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-016b48b5-079a-4bba-96ce-6a5921beafd4 req-144d1b3d-2cea-405e-ba67-79c5c66644ec service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:27.425124 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-016b48b5-079a-4bba-96ce-6a5921beafd4 req-144d1b3d-2cea-405e-ba67-79c5c66644ec service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:27.508646 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-016b48b5-079a-4bba-96ce-6a5921beafd4 req-144d1b3d-2cea-405e-ba67-79c5c66644ec service nova] Creating event network-changed:73befc4a-98f7-414e-8302-6ba3a3fd9481 for instance 95fb1a13-7441-4f74-ad81-5a9413496545 on n-h1-850501-14 Oct 04 18:46:27.521113 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-016b48b5-079a-4bba-96ce-6a5921beafd4 req-144d1b3d-2cea-405e-ba67-79c5c66644ec service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123398 Oct 04 18:46:27.522079 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2102/4261] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:46:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:46:27.532022 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9112f5f5-1100-4f31-a474-a34b77efcf0d tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:27.532757 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9112f5f5-1100-4f31-a474-a34b77efcf0d tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:27.549416 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9112f5f5-1100-4f31-a474-a34b77efcf0d tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:27.549920 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9112f5f5-1100-4f31-a474-a34b77efcf0d tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:27.550344 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9112f5f5-1100-4f31-a474-a34b77efcf0d tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:27.551072 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9112f5f5-1100-4f31-a474-a34b77efcf0d tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:27.552511 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9112f5f5-1100-4f31-a474-a34b77efcf0d tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:27.552949 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9112f5f5-1100-4f31-a474-a34b77efcf0d tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:27.756223 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9c40a264-f53a-40a1-a5b9-bf95a04c7d9c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:27.776796 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9c40a264-f53a-40a1-a5b9-bf95a04c7d9c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1365 microversion: 2.1 time: 0.863632 Oct 04 18:46:27.794046 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2160/4262] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:26 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1365 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:28.111342 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9112f5f5-1100-4f31-a474-a34b77efcf0d tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:28.127158 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9112f5f5-1100-4f31-a474-a34b77efcf0d tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1317 microversion: 2.1 time: 0.603786 Oct 04 18:46:28.127718 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2103/4263] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:27 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1317 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:28.799055 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9303fb31-0ef6-49bb-8862-e9f15b0354de tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:28.799737 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-9303fb31-0ef6-49bb-8862-e9f15b0354de tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:28.806382 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:46:28.826470 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9303fb31-0ef6-49bb-8862-e9f15b0354de tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:28.826969 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9303fb31-0ef6-49bb-8862-e9f15b0354de tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:28.827406 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9303fb31-0ef6-49bb-8862-e9f15b0354de tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:28.828171 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9303fb31-0ef6-49bb-8862-e9f15b0354de tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:28.828625 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9303fb31-0ef6-49bb-8862-e9f15b0354de tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:28.829050 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9303fb31-0ef6-49bb-8862-e9f15b0354de tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:29.153803 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f6d312da-bdf4-4456-9f0b-692e620128d6 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:29.155214 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f6d312da-bdf4-4456-9f0b-692e620128d6 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:29.157884 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:46:29.159719 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=10 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:46:29.172721 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f6d312da-bdf4-4456-9f0b-692e620128d6 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:29.173373 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f6d312da-bdf4-4456-9f0b-692e620128d6 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:29.173914 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f6d312da-bdf4-4456-9f0b-692e620128d6 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:29.174763 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f6d312da-bdf4-4456-9f0b-692e620128d6 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:29.175450 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f6d312da-bdf4-4456-9f0b-692e620128d6 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:29.175956 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f6d312da-bdf4-4456-9f0b-692e620128d6 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:30.070912 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9303fb31-0ef6-49bb-8862-e9f15b0354de tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:30.078139 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=10 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:46:30.083794 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9303fb31-0ef6-49bb-8862-e9f15b0354de tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1365 microversion: 2.1 time: 1.288771 Oct 04 18:46:30.087084 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2161/4264] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:28 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1365 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:30.096210 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-127b35fe-44d5-4cd1-a5a4-232f569e25fb req-bf96ee45-dd9b-4fc1-9827-d00824cdc784 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e208f85-0513-43f4-8a2c-38baa2886238", "tag": "caad0bda-801d-4a85-94c7-4bb13cb984c3"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:30.107826 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-127b35fe-44d5-4cd1-a5a4-232f569e25fb req-bf96ee45-dd9b-4fc1-9827-d00824cdc784 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:30.109095 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-127b35fe-44d5-4cd1-a5a4-232f569e25fb req-bf96ee45-dd9b-4fc1-9827-d00824cdc784 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:30.110041 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-127b35fe-44d5-4cd1-a5a4-232f569e25fb req-bf96ee45-dd9b-4fc1-9827-d00824cdc784 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:30.131582 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-127b35fe-44d5-4cd1-a5a4-232f569e25fb req-bf96ee45-dd9b-4fc1-9827-d00824cdc784 service nova] Creating event network-changed:caad0bda-801d-4a85-94c7-4bb13cb984c3 for instance 2e208f85-0513-43f4-8a2c-38baa2886238 on n-h2-850501-14 Oct 04 18:46:30.137649 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-127b35fe-44d5-4cd1-a5a4-232f569e25fb req-bf96ee45-dd9b-4fc1-9827-d00824cdc784 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048999 Oct 04 18:46:30.139093 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2162/4265] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:46:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:46:31.114532 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0a4a5072-f819-4c6a-9e27-6d43ae25b115 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:31.117486 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0a4a5072-f819-4c6a-9e27-6d43ae25b115 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:31.144568 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0a4a5072-f819-4c6a-9e27-6d43ae25b115 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:31.148849 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0a4a5072-f819-4c6a-9e27-6d43ae25b115 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:31.151258 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0a4a5072-f819-4c6a-9e27-6d43ae25b115 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:31.152148 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0a4a5072-f819-4c6a-9e27-6d43ae25b115 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:31.152721 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0a4a5072-f819-4c6a-9e27-6d43ae25b115 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:31.155080 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0a4a5072-f819-4c6a-9e27-6d43ae25b115 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:31.226539 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f6d312da-bdf4-4456-9f0b-692e620128d6 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:31.233856 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f6d312da-bdf4-4456-9f0b-692e620128d6 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1317 microversion: 2.1 time: 2.084012 Oct 04 18:46:31.238373 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2104/4266] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:29 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1317 bytes in 2089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:46:32.254897 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0a4a5072-f819-4c6a-9e27-6d43ae25b115 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:32.264411 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-90f0b876-0f50-4d01-a526-92aec7f48a0b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:32.265626 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-90f0b876-0f50-4d01-a526-92aec7f48a0b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:32.282734 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0a4a5072-f819-4c6a-9e27-6d43ae25b115 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1365 microversion: 2.1 time: 1.172522 Oct 04 18:46:32.298780 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2163/4267] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:31 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1365 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:32.304037 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-90f0b876-0f50-4d01-a526-92aec7f48a0b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:32.304825 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-90f0b876-0f50-4d01-a526-92aec7f48a0b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:32.310616 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-90f0b876-0f50-4d01-a526-92aec7f48a0b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:32.311758 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-90f0b876-0f50-4d01-a526-92aec7f48a0b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:32.313328 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-90f0b876-0f50-4d01-a526-92aec7f48a0b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:32.314273 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-90f0b876-0f50-4d01-a526-92aec7f48a0b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:33.182937 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-90f0b876-0f50-4d01-a526-92aec7f48a0b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:33.203540 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-90f0b876-0f50-4d01-a526-92aec7f48a0b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1317 microversion: 2.1 time: 0.949292 Oct 04 18:46:33.219382 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2105/4268] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:32 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1317 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:33.317224 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1de83ff1-d722-4623-9679-5fad7256d797 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:33.318557 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1de83ff1-d722-4623-9679-5fad7256d797 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:33.327430 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1de83ff1-d722-4623-9679-5fad7256d797 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:33.328355 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1de83ff1-d722-4623-9679-5fad7256d797 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:33.329022 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1de83ff1-d722-4623-9679-5fad7256d797 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:33.330077 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1de83ff1-d722-4623-9679-5fad7256d797 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:33.330761 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1de83ff1-d722-4623-9679-5fad7256d797 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:33.331448 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1de83ff1-d722-4623-9679-5fad7256d797 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:33.632956 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1de83ff1-d722-4623-9679-5fad7256d797 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:33.647317 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1de83ff1-d722-4623-9679-5fad7256d797 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1365 microversion: 2.1 time: 0.335541 Oct 04 18:46:33.663977 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2164/4269] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:33 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1365 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:34.271748 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-553cd954-a24f-4183-8b81-38cecbaae6b3 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:34.275872 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-553cd954-a24f-4183-8b81-38cecbaae6b3 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:34.336531 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-553cd954-a24f-4183-8b81-38cecbaae6b3 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:34.340655 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-553cd954-a24f-4183-8b81-38cecbaae6b3 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:34.341203 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-553cd954-a24f-4183-8b81-38cecbaae6b3 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:34.347854 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-553cd954-a24f-4183-8b81-38cecbaae6b3 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:34.348411 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-553cd954-a24f-4183-8b81-38cecbaae6b3 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:34.354168 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-553cd954-a24f-4183-8b81-38cecbaae6b3 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:34.679028 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-55bcece3-b369-4001-a47b-26cc4738a169 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:34.679652 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-55bcece3-b369-4001-a47b-26cc4738a169 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:34.691306 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-55bcece3-b369-4001-a47b-26cc4738a169 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:34.708633 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-55bcece3-b369-4001-a47b-26cc4738a169 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:34.728230 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-55bcece3-b369-4001-a47b-26cc4738a169 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:34.730116 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-55bcece3-b369-4001-a47b-26cc4738a169 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:34.730835 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-55bcece3-b369-4001-a47b-26cc4738a169 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:34.731439 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-55bcece3-b369-4001-a47b-26cc4738a169 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:34.759434 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=100 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:46:35.018183 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-553cd954-a24f-4183-8b81-38cecbaae6b3 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:35.031815 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-553cd954-a24f-4183-8b81-38cecbaae6b3 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1317 microversion: 2.1 time: 0.785377 Oct 04 18:46:35.033717 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2106/4270] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:34 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1317 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:35.087274 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-55bcece3-b369-4001-a47b-26cc4738a169 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:35.102103 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-55bcece3-b369-4001-a47b-26cc4738a169 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1365 microversion: 2.1 time: 0.427764 Oct 04 18:46:35.105171 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2165/4271] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:34 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1365 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:46:35.617222 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-d8b53eb0-58a9-4552-860f-a8b59b3b5d61 req-7ca9f91d-7560-4313-b212-002ed3c4f61d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95fb1a13-7441-4f74-ad81-5a9413496545", "name": "network-vif-plugged", "status": "completed", "tag": "73befc4a-98f7-414e-8302-6ba3a3fd9481"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:35.641628 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-d8b53eb0-58a9-4552-860f-a8b59b3b5d61 req-7ca9f91d-7560-4313-b212-002ed3c4f61d service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:35.642494 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-d8b53eb0-58a9-4552-860f-a8b59b3b5d61 req-7ca9f91d-7560-4313-b212-002ed3c4f61d service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:35.643208 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-d8b53eb0-58a9-4552-860f-a8b59b3b5d61 req-7ca9f91d-7560-4313-b212-002ed3c4f61d service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:35.685158 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-d8b53eb0-58a9-4552-860f-a8b59b3b5d61 req-7ca9f91d-7560-4313-b212-002ed3c4f61d service nova] Creating event network-vif-plugged:73befc4a-98f7-414e-8302-6ba3a3fd9481 for instance 95fb1a13-7441-4f74-ad81-5a9413496545 on n-h1-850501-14 Oct 04 18:46:35.700235 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-d8b53eb0-58a9-4552-860f-a8b59b3b5d61 req-7ca9f91d-7560-4313-b212-002ed3c4f61d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086279 Oct 04 18:46:35.703257 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2107/4272] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:46:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:46:35.998740 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2fd672a4-8521-4cc9-a2ad-6511aea03f96 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:35.999376 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2fd672a4-8521-4cc9-a2ad-6511aea03f96 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: cd97d817-422a-457d-b653-020350d75d6e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:36.017127 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2fd672a4-8521-4cc9-a2ad-6511aea03f96 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:36.019385 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2fd672a4-8521-4cc9-a2ad-6511aea03f96 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:36.019876 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2fd672a4-8521-4cc9-a2ad-6511aea03f96 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:36.022124 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2fd672a4-8521-4cc9-a2ad-6511aea03f96 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:36.022621 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2fd672a4-8521-4cc9-a2ad-6511aea03f96 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:36.024457 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2fd672a4-8521-4cc9-a2ad-6511aea03f96 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:36.061673 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-872f9117-d6d6-4876-99b4-a3350769075f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:36.062388 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-872f9117-d6d6-4876-99b4-a3350769075f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:36.077127 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-872f9117-d6d6-4876-99b4-a3350769075f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:36.077922 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-872f9117-d6d6-4876-99b4-a3350769075f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:36.079351 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-872f9117-d6d6-4876-99b4-a3350769075f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:36.082322 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-872f9117-d6d6-4876-99b4-a3350769075f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:36.083104 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-872f9117-d6d6-4876-99b4-a3350769075f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:36.084291 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-872f9117-d6d6-4876-99b4-a3350769075f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:36.129570 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2fd672a4-8521-4cc9-a2ad-6511aea03f96 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: cd97d817-422a-457d-b653-020350d75d6e] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:46:36.388900 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-872f9117-d6d6-4876-99b4-a3350769075f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:36.398810 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-872f9117-d6d6-4876-99b4-a3350769075f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1317 microversion: 2.1 time: 0.340518 Oct 04 18:46:36.400514 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2108/4273] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:36 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1317 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:46:36.405850 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8561b3f4-45f8-469d-84a7-15cf2d639174 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:36.406988 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8561b3f4-45f8-469d-84a7-15cf2d639174 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:36.413875 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8561b3f4-45f8-469d-84a7-15cf2d639174 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:36.414713 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8561b3f4-45f8-469d-84a7-15cf2d639174 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:36.428626 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8561b3f4-45f8-469d-84a7-15cf2d639174 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:36.428957 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8561b3f4-45f8-469d-84a7-15cf2d639174 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:36.429687 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8561b3f4-45f8-469d-84a7-15cf2d639174 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:36.430353 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8561b3f4-45f8-469d-84a7-15cf2d639174 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:36.577268 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2fd672a4-8521-4cc9-a2ad-6511aea03f96 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "DELETE /compute/v2.1/servers/cd97d817-422a-457d-b653-020350d75d6e" status: 204 len: 0 microversion: 2.1 time: 0.583555 Oct 04 18:46:36.577745 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2166/4274] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:46:35 2022] DELETE /compute/v2.1/servers/cd97d817-422a-457d-b653-020350d75d6e => generated 0 bytes in 585 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:46:36.596301 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ab0f66e2-e328-41f9-95fc-39c3d934af13 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:36.597273 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ab0f66e2-e328-41f9-95fc-39c3d934af13 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: cd97d817-422a-457d-b653-020350d75d6e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:36.609963 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ab0f66e2-e328-41f9-95fc-39c3d934af13 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:36.610736 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ab0f66e2-e328-41f9-95fc-39c3d934af13 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:36.624508 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ab0f66e2-e328-41f9-95fc-39c3d934af13 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:36.624508 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ab0f66e2-e328-41f9-95fc-39c3d934af13 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:36.624508 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ab0f66e2-e328-41f9-95fc-39c3d934af13 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:36.630953 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ab0f66e2-e328-41f9-95fc-39c3d934af13 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:37.412612 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8561b3f4-45f8-469d-84a7-15cf2d639174 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:37.426052 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8561b3f4-45f8-469d-84a7-15cf2d639174 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1365 microversion: 2.1 time: 1.020561 Oct 04 18:46:37.432012 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2109/4275] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:36 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1365 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:37.437004 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5d237a11-0b1a-411c-a409-1fac46cbc83a tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:37.439842 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5d237a11-0b1a-411c-a409-1fac46cbc83a tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:37.461467 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5d237a11-0b1a-411c-a409-1fac46cbc83a tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:37.462627 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5d237a11-0b1a-411c-a409-1fac46cbc83a tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:37.466765 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5d237a11-0b1a-411c-a409-1fac46cbc83a tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:37.470268 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5d237a11-0b1a-411c-a409-1fac46cbc83a tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:37.470268 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5d237a11-0b1a-411c-a409-1fac46cbc83a tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:37.470268 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5d237a11-0b1a-411c-a409-1fac46cbc83a tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:37.616598 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ab0f66e2-e328-41f9-95fc-39c3d934af13 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:37.629354 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ab0f66e2-e328-41f9-95fc-39c3d934af13 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/cd97d817-422a-457d-b653-020350d75d6e" status: 200 len: 1507 microversion: 2.1 time: 1.039210 Oct 04 18:46:37.629956 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2167/4276] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:36 2022] GET /compute/v2.1/servers/cd97d817-422a-457d-b653-020350d75d6e => generated 1507 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:37.740453 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-dd5d5b29-73f3-4129-b5cb-f55f02134311 req-8448406a-0000-49c3-b71a-83dfdf24bf1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e208f85-0513-43f4-8a2c-38baa2886238", "name": "network-vif-plugged", "status": "completed", "tag": "caad0bda-801d-4a85-94c7-4bb13cb984c3"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:37.750344 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5d237a11-0b1a-411c-a409-1fac46cbc83a tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:37.754583 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5d237a11-0b1a-411c-a409-1fac46cbc83a tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1504 microversion: 2.1 time: 0.321218 Oct 04 18:46:37.755946 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2110/4277] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:37 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1504 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:37.779797 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-dd5d5b29-73f3-4129-b5cb-f55f02134311 req-8448406a-0000-49c3-b71a-83dfdf24bf1d service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:37.780835 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-dd5d5b29-73f3-4129-b5cb-f55f02134311 req-8448406a-0000-49c3-b71a-83dfdf24bf1d service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:37.781416 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-dd5d5b29-73f3-4129-b5cb-f55f02134311 req-8448406a-0000-49c3-b71a-83dfdf24bf1d service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:37.808602 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-dd5d5b29-73f3-4129-b5cb-f55f02134311 req-8448406a-0000-49c3-b71a-83dfdf24bf1d service nova] Creating event network-vif-plugged:caad0bda-801d-4a85-94c7-4bb13cb984c3 for instance 2e208f85-0513-43f4-8a2c-38baa2886238 on n-h2-850501-14 Oct 04 18:46:37.814195 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-dd5d5b29-73f3-4129-b5cb-f55f02134311 req-8448406a-0000-49c3-b71a-83dfdf24bf1d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077881 Oct 04 18:46:37.819231 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2168/4278] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:46:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:46:38.094535 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0e402391-3be1-43c0-bc94-717f97e45bed tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1898916443", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": [{"uuid": "334d1b7e-7632-43fb-8807-6117cf357d4f"}]}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:38.216890 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-0e402391-3be1-43c0-bc94-717f97e45bed tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] validate_networks() for [('334d1b7e-7632-43fb-8807-6117cf357d4f', None, None, None, None, None)] {{(pid=123002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:46:38.463258 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ea8a5d7d-5c99-43b0-b318-f5d9d8f4c21f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:38.463989 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ea8a5d7d-5c99-43b0-b318-f5d9d8f4c21f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:38.477678 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ea8a5d7d-5c99-43b0-b318-f5d9d8f4c21f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:38.482256 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ea8a5d7d-5c99-43b0-b318-f5d9d8f4c21f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:38.482944 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ea8a5d7d-5c99-43b0-b318-f5d9d8f4c21f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:38.484038 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ea8a5d7d-5c99-43b0-b318-f5d9d8f4c21f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:38.484668 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ea8a5d7d-5c99-43b0-b318-f5d9d8f4c21f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:38.485223 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ea8a5d7d-5c99-43b0-b318-f5d9d8f4c21f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:38.991114 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ea8a5d7d-5c99-43b0-b318-f5d9d8f4c21f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:39.029392 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ea8a5d7d-5c99-43b0-b318-f5d9d8f4c21f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1365 microversion: 2.1 time: 0.571353 Oct 04 18:46:39.052157 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2169/4279] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:38 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1365 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:39.052157 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f1aeeb3b-0e20-42da-9652-5aca69126e2a tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:39.052157 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f1aeeb3b-0e20-42da-9652-5aca69126e2a tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: cd97d817-422a-457d-b653-020350d75d6e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:39.083015 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f1aeeb3b-0e20-42da-9652-5aca69126e2a tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:39.083834 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f1aeeb3b-0e20-42da-9652-5aca69126e2a tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:39.085590 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f1aeeb3b-0e20-42da-9652-5aca69126e2a tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:39.088786 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f1aeeb3b-0e20-42da-9652-5aca69126e2a tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:39.090398 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f1aeeb3b-0e20-42da-9652-5aca69126e2a tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:39.093664 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f1aeeb3b-0e20-42da-9652-5aca69126e2a tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:39.431364 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-0e402391-3be1-43c0-bc94-717f97e45bed tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:46:39.431848 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-0e402391-3be1-43c0-bc94-717f97e45bed tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:46:39.432292 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-0e402391-3be1-43c0-bc94-717f97e45bed tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:46:39.432710 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-0e402391-3be1-43c0-bc94-717f97e45bed tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:46:39.433128 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-0e402391-3be1-43c0-bc94-717f97e45bed tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:46:39.437278 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f1aeeb3b-0e20-42da-9652-5aca69126e2a tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:39.445466 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f1aeeb3b-0e20-42da-9652-5aca69126e2a tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/cd97d817-422a-457d-b653-020350d75d6e" status: 200 len: 1507 microversion: 2.1 time: 0.402945 Oct 04 18:46:39.446103 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2170/4280] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:39 2022] GET /compute/v2.1/servers/cd97d817-422a-457d-b653-020350d75d6e => generated 1507 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:39.450132 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0e402391-3be1-43c0-bc94-717f97e45bed tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:39.450638 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0e402391-3be1-43c0-bc94-717f97e45bed tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:39.451078 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0e402391-3be1-43c0-bc94-717f97e45bed tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:39.451971 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0e402391-3be1-43c0-bc94-717f97e45bed tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:39.452941 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0e402391-3be1-43c0-bc94-717f97e45bed tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:39.453527 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0e402391-3be1-43c0-bc94-717f97e45bed tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:39.475029 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-0e402391-3be1-43c0-bc94-717f97e45bed tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Getting quotas for project b6c6b9deecde44b5953d22b38b5b0ff1. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:46:39.481714 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-0e402391-3be1-43c0-bc94-717f97e45bed tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Getting quotas for user 5b4eb70f22ba4872b890a4f160cc1805 and project b6c6b9deecde44b5953d22b38b5b0ff1. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:46:39.496139 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0e402391-3be1-43c0-bc94-717f97e45bed tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Going to run 1 instances... {{(pid=123002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:46:39.498992 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0e402391-3be1-43c0-bc94-717f97e45bed tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: e6b3ee80-2e17-4135-9f45-bef437385e0c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:46:39.722358 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1c05431f-c222-419b-ba55-bbc9e35e1a28 tempest-FlavorsV2TestJSON-435467634 tempest-FlavorsV2TestJSON-435467634-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:39.732491 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1c05431f-c222-419b-ba55-bbc9e35e1a28 tempest-FlavorsV2TestJSON-435467634 tempest-FlavorsV2TestJSON-435467634-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.285270 Oct 04 18:46:39.734725 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0e402391-3be1-43c0-bc94-717f97e45bed tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.643977 Oct 04 18:46:39.738492 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2171/4282] 10.222.0.20 () {58 vars in 1137 bytes} [Tue Oct 4 18:46:39 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:46:39.745332 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2111/4282] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:46:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1646 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:46:39.751383 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0d6b8eae-158b-4ffd-a998-72d6847ec996 tempest-FlavorsV2TestJSON-435467634 tempest-FlavorsV2TestJSON-435467634-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:39.754899 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-cb170d09-1cf8-47a7-b53e-897f6ed85d68 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:39.755649 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-cb170d09-1cf8-47a7-b53e-897f6ed85d68 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: e6b3ee80-2e17-4135-9f45-bef437385e0c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:39.792892 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0d6b8eae-158b-4ffd-a998-72d6847ec996 tempest-FlavorsV2TestJSON-435467634 tempest-FlavorsV2TestJSON-435467634-project] 10.222.0.20 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.046027 Oct 04 18:46:39.808416 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2112/4283] 10.222.0.20 () {58 vars in 1125 bytes} [Tue Oct 4 18:46:39 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:39.824769 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-33369453-fb31-4320-8bb7-3d14dee23657 tempest-FlavorsV2TestJSON-435467634 tempest-FlavorsV2TestJSON-435467634-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:39.841507 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-33369453-fb31-4320-8bb7-3d14dee23657 tempest-FlavorsV2TestJSON-435467634 tempest-FlavorsV2TestJSON-435467634-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.022138 Oct 04 18:46:39.850159 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2113/4284] 10.222.0.20 () {58 vars in 1137 bytes} [Tue Oct 4 18:46:39 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:46:39.861905 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-cbc46c01-c4c2-4e96-9c4e-84f3ae4ea926 tempest-FlavorsV2TestJSON-435467634 tempest-FlavorsV2TestJSON-435467634-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:39.872162 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-cb170d09-1cf8-47a7-b53e-897f6ed85d68 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:39.876927 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-cbc46c01-c4c2-4e96-9c4e-84f3ae4ea926 tempest-FlavorsV2TestJSON-435467634 tempest-FlavorsV2TestJSON-435467634-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.019015 Oct 04 18:46:39.880762 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2114/4285] 10.222.0.20 () {58 vars in 1137 bytes} [Tue Oct 4 18:46:39 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:46:39.882024 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-cb170d09-1cf8-47a7-b53e-897f6ed85d68 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/e6b3ee80-2e17-4135-9f45-bef437385e0c" status: 200 len: 1217 microversion: 2.1 time: 0.139125 Oct 04 18:46:39.892112 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2172/4286] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:39 2022] GET /compute/v2.1/servers/e6b3ee80-2e17-4135-9f45-bef437385e0c => generated 1217 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:39.903745 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7d8aefb5-ee07-45f7-b710-6e6f1d11d1dd tempest-FlavorsV2TestJSON-435467634 tempest-FlavorsV2TestJSON-435467634-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:39.933077 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7d8aefb5-ee07-45f7-b710-6e6f1d11d1dd tempest-FlavorsV2TestJSON-435467634 tempest-FlavorsV2TestJSON-435467634-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.033110 Oct 04 18:46:39.933819 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2115/4287] 10.222.0.20 () {58 vars in 1165 bytes} [Tue Oct 4 18:46:39 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:39.953933 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1e5381e4-a02e-46de-8cde-b31223d0318a tempest-FlavorsV2TestJSON-435467634 tempest-FlavorsV2TestJSON-435467634-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:39.963147 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1e5381e4-a02e-46de-8cde-b31223d0318a tempest-FlavorsV2TestJSON-435467634 tempest-FlavorsV2TestJSON-435467634-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013465 Oct 04 18:46:39.963974 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2173/4288] 10.222.0.20 () {58 vars in 1137 bytes} [Tue Oct 4 18:46:39 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:46:39.981225 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ec3e0ce8-4dff-4507-af32-6c39e15ad56c tempest-FlavorsV2TestJSON-435467634 tempest-FlavorsV2TestJSON-435467634-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:40.019899 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ec3e0ce8-4dff-4507-af32-6c39e15ad56c tempest-FlavorsV2TestJSON-435467634 tempest-FlavorsV2TestJSON-435467634-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.047331 Oct 04 18:46:40.039507 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b631e526-46d4-4359-854a-af7b8ec8781f tempest-FlavorsV2TestJSON-435467634 tempest-FlavorsV2TestJSON-435467634-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:40.044313 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2116/4289] 10.222.0.20 () {58 vars in 1169 bytes} [Tue Oct 4 18:46:39 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:40.066711 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7e0e7d04-2156-43fa-9bb0-4732abca3dff tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:40.067784 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7e0e7d04-2156-43fa-9bb0-4732abca3dff tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:40.076494 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b631e526-46d4-4359-854a-af7b8ec8781f tempest-FlavorsV2TestJSON-435467634 tempest-FlavorsV2TestJSON-435467634-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.041170 Oct 04 18:46:40.079363 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2174/4290] 10.222.0.20 () {58 vars in 1161 bytes} [Tue Oct 4 18:46:40 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:46:40.094190 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7e0e7d04-2156-43fa-9bb0-4732abca3dff tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:40.094886 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7e0e7d04-2156-43fa-9bb0-4732abca3dff tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:40.096778 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7e0e7d04-2156-43fa-9bb0-4732abca3dff tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:40.097757 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7e0e7d04-2156-43fa-9bb0-4732abca3dff tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:40.100074 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7f45aa95-c4c7-479a-82ed-39cb32957cbe tempest-FlavorsV2TestJSON-435467634 tempest-FlavorsV2TestJSON-435467634-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:40.100911 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7e0e7d04-2156-43fa-9bb0-4732abca3dff tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:40.101518 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7e0e7d04-2156-43fa-9bb0-4732abca3dff tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:40.115346 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7f45aa95-c4c7-479a-82ed-39cb32957cbe tempest-FlavorsV2TestJSON-435467634 tempest-FlavorsV2TestJSON-435467634-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.023570 Oct 04 18:46:40.121343 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2175/4291] 10.222.0.20 () {58 vars in 1137 bytes} [Tue Oct 4 18:46:40 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:46:40.135695 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-09ffd55b-d73d-4547-bbf7-1901c171d677 tempest-FlavorsV2TestJSON-435467634 tempest-FlavorsV2TestJSON-435467634-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:40.184803 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-09ffd55b-d73d-4547-bbf7-1901c171d677 tempest-FlavorsV2TestJSON-435467634 tempest-FlavorsV2TestJSON-435467634-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.053205 Oct 04 18:46:40.198291 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2176/4292] 10.222.0.20 () {58 vars in 1167 bytes} [Tue Oct 4 18:46:40 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:46:40.208568 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-17a17d56-b92a-4f90-87ce-35560372d7bc tempest-FlavorsV2TestJSON-435467634 tempest-FlavorsV2TestJSON-435467634-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:40.225792 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-17a17d56-b92a-4f90-87ce-35560372d7bc tempest-FlavorsV2TestJSON-435467634 tempest-FlavorsV2TestJSON-435467634-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.023794 Oct 04 18:46:40.230764 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2177/4293] 10.222.0.20 () {58 vars in 1137 bytes} [Tue Oct 4 18:46:40 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:46:40.267000 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-085b0c37-fbe5-4a76-ad24-3c38b3214acc tempest-FlavorsV2TestJSON-435467634 tempest-FlavorsV2TestJSON-435467634-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:40.301644 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-085b0c37-fbe5-4a76-ad24-3c38b3214acc tempest-FlavorsV2TestJSON-435467634 tempest-FlavorsV2TestJSON-435467634-project] 10.222.0.20 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.040520 Oct 04 18:46:40.302511 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2178/4294] 10.222.0.20 () {58 vars in 1144 bytes} [Tue Oct 4 18:46:40 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:46:40.321684 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-493f6707-5606-40f5-a4bb-b2187bead629 tempest-FlavorsV2TestJSON-435467634 tempest-FlavorsV2TestJSON-435467634-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:40.333913 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-493f6707-5606-40f5-a4bb-b2187bead629 tempest-FlavorsV2TestJSON-435467634 tempest-FlavorsV2TestJSON-435467634-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018711 Oct 04 18:46:40.334924 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2179/4295] 10.222.0.20 () {58 vars in 1137 bytes} [Tue Oct 4 18:46:40 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:46:40.349457 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5b715dd3-a272-4f59-a949-9e23d6688b57 tempest-FlavorsV2TestJSON-435467634 tempest-FlavorsV2TestJSON-435467634-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:40.384972 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5b715dd3-a272-4f59-a949-9e23d6688b57 tempest-FlavorsV2TestJSON-435467634 tempest-FlavorsV2TestJSON-435467634-project] 10.222.0.20 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.039718 Oct 04 18:46:40.385812 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2180/4296] 10.222.0.20 () {58 vars in 1148 bytes} [Tue Oct 4 18:46:40 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:40.406531 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b5fc5084-d51e-4901-aef6-211cba0303a3 tempest-FlavorsV2TestJSON-435467634 tempest-FlavorsV2TestJSON-435467634-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:40.429621 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b5fc5084-d51e-4901-aef6-211cba0303a3 tempest-FlavorsV2TestJSON-435467634 tempest-FlavorsV2TestJSON-435467634-project] 10.222.0.20 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.032250 Oct 04 18:46:40.457980 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2181/4297] 10.222.0.20 () {58 vars in 1140 bytes} [Tue Oct 4 18:46:40 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:46:40.470838 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f1b29de2-cc3d-45f4-aaf6-ad3dbd5a7431 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:40.471585 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f1b29de2-cc3d-45f4-aaf6-ad3dbd5a7431 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: cd97d817-422a-457d-b653-020350d75d6e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:40.511460 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f1b29de2-cc3d-45f4-aaf6-ad3dbd5a7431 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:40.511876 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f1b29de2-cc3d-45f4-aaf6-ad3dbd5a7431 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:40.512359 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f1b29de2-cc3d-45f4-aaf6-ad3dbd5a7431 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:40.513088 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f1b29de2-cc3d-45f4-aaf6-ad3dbd5a7431 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:40.513563 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f1b29de2-cc3d-45f4-aaf6-ad3dbd5a7431 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:40.513990 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f1b29de2-cc3d-45f4-aaf6-ad3dbd5a7431 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:40.723578 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7e0e7d04-2156-43fa-9bb0-4732abca3dff tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:40.733890 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7e0e7d04-2156-43fa-9bb0-4732abca3dff tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1365 microversion: 2.1 time: 0.671534 Oct 04 18:46:40.736801 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2117/4298] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:40 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1365 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:46:40.742232 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2d65ba76-9212-42c0-a039-8b10200a5a61 tempest-FlavorsV2TestJSON-435467634 tempest-FlavorsV2TestJSON-435467634-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:40.749921 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f1b29de2-cc3d-45f4-aaf6-ad3dbd5a7431 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:40.762235 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f1b29de2-cc3d-45f4-aaf6-ad3dbd5a7431 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/cd97d817-422a-457d-b653-020350d75d6e" status: 200 len: 1465 microversion: 2.1 time: 0.295048 Oct 04 18:46:40.778567 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2182/4299] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:40 2022] GET /compute/v2.1/servers/cd97d817-422a-457d-b653-020350d75d6e => generated 1465 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:40.783704 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-8b552913-2877-4486-8f98-0b8cab92014e req-27c4b1d9-c3ac-4dc8-9031-2956d80e50c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd97d817-422a-457d-b653-020350d75d6e", "name": "network-vif-deleted", "tag": "c3dfb6f9-bb0b-461d-9283-7c861531767f"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:40.792046 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2d65ba76-9212-42c0-a039-8b10200a5a61 tempest-FlavorsV2TestJSON-435467634 tempest-FlavorsV2TestJSON-435467634-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.053365 Oct 04 18:46:40.797385 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2118/4300] 10.222.0.20 () {58 vars in 1137 bytes} [Tue Oct 4 18:46:40 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:46:40.804518 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3594f316-2fe6-4b10-acc7-ee48680b530a tempest-FlavorsV2TestJSON-435467634 tempest-FlavorsV2TestJSON-435467634-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:40.810678 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-8b552913-2877-4486-8f98-0b8cab92014e req-27c4b1d9-c3ac-4dc8-9031-2956d80e50c1 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:40.811166 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-8b552913-2877-4486-8f98-0b8cab92014e req-27c4b1d9-c3ac-4dc8-9031-2956d80e50c1 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:40.818057 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-8b552913-2877-4486-8f98-0b8cab92014e req-27c4b1d9-c3ac-4dc8-9031-2956d80e50c1 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:40.861201 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-8b552913-2877-4486-8f98-0b8cab92014e req-27c4b1d9-c3ac-4dc8-9031-2956d80e50c1 service nova] Creating event network-vif-deleted:c3dfb6f9-bb0b-461d-9283-7c861531767f for instance cd97d817-422a-457d-b653-020350d75d6e on n-h2-850501-14 Oct 04 18:46:40.870119 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-8b552913-2877-4486-8f98-0b8cab92014e req-27c4b1d9-c3ac-4dc8-9031-2956d80e50c1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089994 Oct 04 18:46:40.871473 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2183/4301] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:46:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:46:40.907051 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4f1f9fe1-5cf6-41e3-84dd-c009ae56ef90 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:40.908040 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-4f1f9fe1-5cf6-41e3-84dd-c009ae56ef90 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: e6b3ee80-2e17-4135-9f45-bef437385e0c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:40.916746 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3594f316-2fe6-4b10-acc7-ee48680b530a tempest-FlavorsV2TestJSON-435467634 tempest-FlavorsV2TestJSON-435467634-project] 10.222.0.20 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.115852 Oct 04 18:46:40.920335 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2119/4302] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Oct 4 18:46:40 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:40.935091 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5e1a69bd-154e-45ff-b8a5-d3f08766659f tempest-FlavorsV2TestJSON-435467634 tempest-FlavorsV2TestJSON-435467634-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:40.966995 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5e1a69bd-154e-45ff-b8a5-d3f08766659f tempest-FlavorsV2TestJSON-435467634 tempest-FlavorsV2TestJSON-435467634-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.036531 Oct 04 18:46:40.968173 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2120/4303] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Oct 4 18:46:40 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:46:40.987054 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e79c0bb0-e7ef-430b-859c-cbe89c16e3ec tempest-FlavorsV2TestJSON-435467634 tempest-FlavorsV2TestJSON-435467634-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:41.004501 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e79c0bb0-e7ef-430b-859c-cbe89c16e3ec tempest-FlavorsV2TestJSON-435467634 tempest-FlavorsV2TestJSON-435467634-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018660 Oct 04 18:46:41.012111 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2121/4304] 10.222.0.20 () {58 vars in 1137 bytes} [Tue Oct 4 18:46:40 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:46:41.183965 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-4f1f9fe1-5cf6-41e3-84dd-c009ae56ef90 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:41.197823 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-4f1f9fe1-5cf6-41e3-84dd-c009ae56ef90 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/e6b3ee80-2e17-4135-9f45-bef437385e0c" status: 200 len: 1217 microversion: 2.1 time: 0.295025 Oct 04 18:46:41.204939 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2184/4305] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:40 2022] GET /compute/v2.1/servers/e6b3ee80-2e17-4135-9f45-bef437385e0c => generated 1217 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:41.766542 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-90cb36f2-9e62-4f03-97df-a1f6426f624d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:41.767170 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-90cb36f2-9e62-4f03-97df-a1f6426f624d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:41.784326 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-90cb36f2-9e62-4f03-97df-a1f6426f624d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:41.786953 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-90cb36f2-9e62-4f03-97df-a1f6426f624d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:41.794178 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-fc5d4e05-c6ad-42a2-86aa-3d378027d298 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:41.795587 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-fc5d4e05-c6ad-42a2-86aa-3d378027d298 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: cd97d817-422a-457d-b653-020350d75d6e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:41.803828 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-90cb36f2-9e62-4f03-97df-a1f6426f624d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:41.804765 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-90cb36f2-9e62-4f03-97df-a1f6426f624d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:41.807148 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-90cb36f2-9e62-4f03-97df-a1f6426f624d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:41.808921 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-90cb36f2-9e62-4f03-97df-a1f6426f624d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:41.824445 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fc5d4e05-c6ad-42a2-86aa-3d378027d298 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:41.824445 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fc5d4e05-c6ad-42a2-86aa-3d378027d298 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:41.824445 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fc5d4e05-c6ad-42a2-86aa-3d378027d298 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:41.827248 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fc5d4e05-c6ad-42a2-86aa-3d378027d298 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:41.833699 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fc5d4e05-c6ad-42a2-86aa-3d378027d298 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:41.834660 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fc5d4e05-c6ad-42a2-86aa-3d378027d298 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:41.882455 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fc5d4e05-c6ad-42a2-86aa-3d378027d298 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:41.883206 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fc5d4e05-c6ad-42a2-86aa-3d378027d298 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:41.884413 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fc5d4e05-c6ad-42a2-86aa-3d378027d298 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:41.885132 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-fc5d4e05-c6ad-42a2-86aa-3d378027d298 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lazy-loading 'fault' on Instance uuid cd97d817-422a-457d-b653-020350d75d6e {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:46:41.938038 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-fc5d4e05-c6ad-42a2-86aa-3d378027d298 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:41.951194 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-fc5d4e05-c6ad-42a2-86aa-3d378027d298 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/cd97d817-422a-457d-b653-020350d75d6e" status: 200 len: 1312 microversion: 2.1 time: 0.159572 Oct 04 18:46:41.955304 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2185/4306] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:41 2022] GET /compute/v2.1/servers/cd97d817-422a-457d-b653-020350d75d6e => generated 1312 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:46:42.171152 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-90cb36f2-9e62-4f03-97df-a1f6426f624d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:42.185014 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-90cb36f2-9e62-4f03-97df-a1f6426f624d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1553 microversion: 2.1 time: 0.429347 Oct 04 18:46:42.186292 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2122/4307] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:41 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1553 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:42.226331 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-cbd74987-ea33-4fcf-b141-e6cb8cf79381 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:42.227117 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5e2f2571-cf1b-4230-a4a6-f7265bba8c72 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:42.228373 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5e2f2571-cf1b-4230-a4a6-f7265bba8c72 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:42.232682 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-cbd74987-ea33-4fcf-b141-e6cb8cf79381 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: e6b3ee80-2e17-4135-9f45-bef437385e0c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:42.243744 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cbd74987-ea33-4fcf-b141-e6cb8cf79381 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:42.244327 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cbd74987-ea33-4fcf-b141-e6cb8cf79381 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:42.245477 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cbd74987-ea33-4fcf-b141-e6cb8cf79381 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:42.247644 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cbd74987-ea33-4fcf-b141-e6cb8cf79381 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:42.248207 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cbd74987-ea33-4fcf-b141-e6cb8cf79381 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:42.248650 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cbd74987-ea33-4fcf-b141-e6cb8cf79381 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:42.256008 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5e2f2571-cf1b-4230-a4a6-f7265bba8c72 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:42.258268 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5e2f2571-cf1b-4230-a4a6-f7265bba8c72 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:42.258795 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5e2f2571-cf1b-4230-a4a6-f7265bba8c72 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:42.259908 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5e2f2571-cf1b-4230-a4a6-f7265bba8c72 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:42.260415 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5e2f2571-cf1b-4230-a4a6-f7265bba8c72 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:42.260854 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5e2f2571-cf1b-4230-a4a6-f7265bba8c72 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:42.413390 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5e2f2571-cf1b-4230-a4a6-f7265bba8c72 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.195908 Oct 04 18:46:42.415227 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2186/4308] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Oct 4 18:46:42 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238/os-interface => generated 285 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:46:42.549855 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-cbd74987-ea33-4fcf-b141-e6cb8cf79381 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:42.557720 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-cbd74987-ea33-4fcf-b141-e6cb8cf79381 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/e6b3ee80-2e17-4135-9f45-bef437385e0c" status: 200 len: 1269 microversion: 2.1 time: 0.334926 Oct 04 18:46:42.558840 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2123/4309] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:42 2022] GET /compute/v2.1/servers/e6b3ee80-2e17-4135-9f45-bef437385e0c => generated 1269 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:46:42.975307 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9bb1a957-c660-411f-9d3d-085e3ceb930f tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:42.976516 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-9bb1a957-c660-411f-9d3d-085e3ceb930f tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: cd97d817-422a-457d-b653-020350d75d6e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:42.993476 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9bb1a957-c660-411f-9d3d-085e3ceb930f tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:42.994365 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9bb1a957-c660-411f-9d3d-085e3ceb930f tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:42.994814 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9bb1a957-c660-411f-9d3d-085e3ceb930f tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:42.995529 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9bb1a957-c660-411f-9d3d-085e3ceb930f tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:42.995982 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9bb1a957-c660-411f-9d3d-085e3ceb930f tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:42.996444 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9bb1a957-c660-411f-9d3d-085e3ceb930f tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:43.015877 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-9bb1a957-c660-411f-9d3d-085e3ceb930f tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] HTTP exception thrown: Instance cd97d817-422a-457d-b653-020350d75d6e could not be found. Oct 04 18:46:43.026477 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9bb1a957-c660-411f-9d3d-085e3ceb930f tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Request method failure captured: Oct 04 18:46:43.026477 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/cd97d817-422a-457d-b653-020350d75d6e HTTP/1.1 Oct 04 18:46:43.026477 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:46:43.026477 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:46:43.026477 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:46:43.026477 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:46:43.026477 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:46:43.026477 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:46:43.026477 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:46:43.026477 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:46:43.026477 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPH5VeoXXX4R-gl3WW_fAsW_7hDIEWiZR35lPoIuJDBMUw75w4Z-93EJDy38x5YiA26dGCEdjKEzqMCUM4kpma5PpB_mUiDb0rAatpoM-ionDMXIgsOp1o3NTgluOHECynM7nFlIuW8aS-v8Gnb5xnrVGhYXFRV6ahForfC1sBHmJ1HA Oct 04 18:46:43.026477 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:46:43.026477 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:46:43.026477 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:46:43.026477 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:46:43.026477 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:46:43.026477 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:46:43.026477 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 9eb391aef10e4684ada5f811ae818f97 Oct 04 18:46:43.026477 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-124944821 Oct 04 18:46:43.026477 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:46:43.026477 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:46:43.026477 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9eb391aef10e4684ada5f811ae818f97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9eb391aef10e4684ada5f811ae818f97", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9eb391aef10e4684ada5f811ae818f97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9eb391aef10e4684ada5f811ae818f97"}]}] Oct 04 18:46:43.026477 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ServerRescueNegativeTestJSON-124944821 Oct 04 18:46:43.026477 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 9eb391aef10e4684ada5f811ae818f97 Oct 04 18:46:43.026477 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-124944821 Oct 04 18:46:43.026477 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ServerRescueNegativeTestJSON-124944821-project Oct 04 18:46:43.026477 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:46:43.026477 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:46:43.026477 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: c4243e3907374e5e9947c17e6288f0e7 Oct 04 18:46:43.026477 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ServerRescueNegativeTestJSON-124944821-project Oct 04 18:46:43.026477 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:46:43.026477 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance cd97d817-422a-457d-b653-020350d75d6e could not be found. Oct 04 18:46:43.026477 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': 'cd97d817-422a-457d-b653-020350d75d6e'} Oct 04 18:46:43.026477 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:46:43.026477 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:46:43.026477 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:46:43.026477 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:46:43.026477 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:46:43.026477 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:46:43.026477 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:46:43.026477 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:46:43.026477 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:46:43.026477 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:46:43.026477 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd97d817-422a-457d-b653-020350d75d6e could not be found. Oct 04 18:46:43.026477 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:46:43.026477 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:46:43.026477 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:46:43.026477 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:46:43.026477 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:46:43.026477 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:46:43.026477 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:46:43.026477 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:46:43.026477 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:46:43.026477 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:46:43.026477 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:46:43.026477 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:46:43.026477 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:46:43.026477 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:46:43.026477 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:46:43.026477 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:46:43.026477 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd97d817-422a-457d-b653-020350d75d6e could not be found. Oct 04 18:46:43.026477 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:46:43.026477 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:46:43.039081 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:46:43.039081 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:46:43.039081 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:46:43.039081 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:46:43.039081 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:46:43.039081 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:46:43.039081 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd97d817-422a-457d-b653-020350d75d6e could not be found. Oct 04 18:46:43.039081 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:46:43.039081 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9bb1a957-c660-411f-9d3d-085e3ceb930f tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Returning 404 to user: Instance cd97d817-422a-457d-b653-020350d75d6e could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:46:43.040961 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9bb1a957-c660-411f-9d3d-085e3ceb930f tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/cd97d817-422a-457d-b653-020350d75d6e" status: 404 len: 111 microversion: 2.1 time: 0.068280 Oct 04 18:46:43.046768 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2187/4310] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:42 2022] GET /compute/v2.1/servers/cd97d817-422a-457d-b653-020350d75d6e => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:46:43.050259 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c8ea6148-9f5f-486a-bc49-ac07db78327b tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:43.050797 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c8ea6148-9f5f-486a-bc49-ac07db78327b tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: af46589b-8af1-4394-86e3-631c7d483a12] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:43.061490 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c8ea6148-9f5f-486a-bc49-ac07db78327b tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:43.061996 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c8ea6148-9f5f-486a-bc49-ac07db78327b tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:43.062445 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c8ea6148-9f5f-486a-bc49-ac07db78327b tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:43.063181 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c8ea6148-9f5f-486a-bc49-ac07db78327b tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:43.070098 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c8ea6148-9f5f-486a-bc49-ac07db78327b tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:43.070098 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c8ea6148-9f5f-486a-bc49-ac07db78327b tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:43.121870 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c8ea6148-9f5f-486a-bc49-ac07db78327b tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: af46589b-8af1-4394-86e3-631c7d483a12] Going to try to terminate instance {{(pid=123002) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:46:43.583169 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-502bce34-3207-4903-bdc3-5a9e21b5a85e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:43.584572 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-502bce34-3207-4903-bdc3-5a9e21b5a85e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: e6b3ee80-2e17-4135-9f45-bef437385e0c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:43.597293 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c8ea6148-9f5f-486a-bc49-ac07db78327b tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "DELETE /compute/v2.1/servers/af46589b-8af1-4394-86e3-631c7d483a12" status: 204 len: 0 microversion: 2.1 time: 0.550879 Oct 04 18:46:43.598086 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-502bce34-3207-4903-bdc3-5a9e21b5a85e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:43.598708 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2124/4311] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:46:43 2022] DELETE /compute/v2.1/servers/af46589b-8af1-4394-86e3-631c7d483a12 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:46:43.600683 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-502bce34-3207-4903-bdc3-5a9e21b5a85e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:43.601570 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-502bce34-3207-4903-bdc3-5a9e21b5a85e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:43.607285 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-502bce34-3207-4903-bdc3-5a9e21b5a85e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:43.607285 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-502bce34-3207-4903-bdc3-5a9e21b5a85e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:43.607285 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-502bce34-3207-4903-bdc3-5a9e21b5a85e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:43.610353 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-fb9dc692-055f-485e-9ae2-9017b3b969f1 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:43.611084 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-fb9dc692-055f-485e-9ae2-9017b3b969f1 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: af46589b-8af1-4394-86e3-631c7d483a12] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:43.617694 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fb9dc692-055f-485e-9ae2-9017b3b969f1 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:43.619125 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fb9dc692-055f-485e-9ae2-9017b3b969f1 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:43.621067 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fb9dc692-055f-485e-9ae2-9017b3b969f1 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:43.621990 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fb9dc692-055f-485e-9ae2-9017b3b969f1 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:43.622688 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fb9dc692-055f-485e-9ae2-9017b3b969f1 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:43.623285 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fb9dc692-055f-485e-9ae2-9017b3b969f1 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:44.074042 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-502bce34-3207-4903-bdc3-5a9e21b5a85e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:44.091783 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-502bce34-3207-4903-bdc3-5a9e21b5a85e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/e6b3ee80-2e17-4135-9f45-bef437385e0c" status: 200 len: 1287 microversion: 2.1 time: 0.512741 Oct 04 18:46:44.092929 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2188/4312] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:43 2022] GET /compute/v2.1/servers/e6b3ee80-2e17-4135-9f45-bef437385e0c => generated 1287 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:44.246417 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-fb9dc692-055f-485e-9ae2-9017b3b969f1 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:44.266324 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-fb9dc692-055f-485e-9ae2-9017b3b969f1 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/af46589b-8af1-4394-86e3-631c7d483a12" status: 200 len: 1520 microversion: 2.1 time: 0.662822 Oct 04 18:46:44.267224 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2125/4313] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:43 2022] GET /compute/v2.1/servers/af46589b-8af1-4394-86e3-631c7d483a12 => generated 1520 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:46:44.893214 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-8370f5f0-0460-4593-b807-7a40296b4d97 req-20864f2a-5dcd-4d7f-8c5d-cdd6a6776a28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e208f85-0513-43f4-8a2c-38baa2886238", "tag": "caad0bda-801d-4a85-94c7-4bb13cb984c3"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:44.911021 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-8370f5f0-0460-4593-b807-7a40296b4d97 req-20864f2a-5dcd-4d7f-8c5d-cdd6a6776a28 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:44.912421 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-8370f5f0-0460-4593-b807-7a40296b4d97 req-20864f2a-5dcd-4d7f-8c5d-cdd6a6776a28 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:44.913377 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-8370f5f0-0460-4593-b807-7a40296b4d97 req-20864f2a-5dcd-4d7f-8c5d-cdd6a6776a28 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:44.929963 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-8370f5f0-0460-4593-b807-7a40296b4d97 req-20864f2a-5dcd-4d7f-8c5d-cdd6a6776a28 service nova] Creating event network-changed:caad0bda-801d-4a85-94c7-4bb13cb984c3 for instance 2e208f85-0513-43f4-8a2c-38baa2886238 on n-h2-850501-14 Oct 04 18:46:44.937921 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-8370f5f0-0460-4593-b807-7a40296b4d97 req-20864f2a-5dcd-4d7f-8c5d-cdd6a6776a28 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048205 Oct 04 18:46:44.945145 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2189/4314] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:46:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:46:45.125060 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-406f30f6-e444-4391-828b-5ce5c03959f3 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:45.125911 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-406f30f6-e444-4391-828b-5ce5c03959f3 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: e6b3ee80-2e17-4135-9f45-bef437385e0c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:45.131911 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:46:45.141977 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-406f30f6-e444-4391-828b-5ce5c03959f3 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:45.145803 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-406f30f6-e444-4391-828b-5ce5c03959f3 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:45.147520 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-406f30f6-e444-4391-828b-5ce5c03959f3 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:45.148625 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-406f30f6-e444-4391-828b-5ce5c03959f3 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:45.155646 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-406f30f6-e444-4391-828b-5ce5c03959f3 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:45.165510 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-406f30f6-e444-4391-828b-5ce5c03959f3 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:45.293148 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6e6a37aa-aa10-49ee-9697-834738fce012 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:45.294309 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6e6a37aa-aa10-49ee-9697-834738fce012 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: af46589b-8af1-4394-86e3-631c7d483a12] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:45.310390 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6e6a37aa-aa10-49ee-9697-834738fce012 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:45.314887 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6e6a37aa-aa10-49ee-9697-834738fce012 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:45.315715 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6e6a37aa-aa10-49ee-9697-834738fce012 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:45.316730 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6e6a37aa-aa10-49ee-9697-834738fce012 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:45.320571 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6e6a37aa-aa10-49ee-9697-834738fce012 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:45.321865 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6e6a37aa-aa10-49ee-9697-834738fce012 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:45.416322 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-406f30f6-e444-4391-828b-5ce5c03959f3 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:45.427358 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-406f30f6-e444-4391-828b-5ce5c03959f3 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/e6b3ee80-2e17-4135-9f45-bef437385e0c" status: 200 len: 1317 microversion: 2.1 time: 0.310823 Oct 04 18:46:45.433519 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2126/4315] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:45 2022] GET /compute/v2.1/servers/e6b3ee80-2e17-4135-9f45-bef437385e0c => generated 1317 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:45.656685 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6e6a37aa-aa10-49ee-9697-834738fce012 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:45.669398 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6e6a37aa-aa10-49ee-9697-834738fce012 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/af46589b-8af1-4394-86e3-631c7d483a12" status: 200 len: 1520 microversion: 2.1 time: 0.383050 Oct 04 18:46:45.670207 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2190/4316] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:45 2022] GET /compute/v2.1/servers/af46589b-8af1-4394-86e3-631c7d483a12 => generated 1520 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:46:46.469221 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6c5ab875-b287-464e-9976-d89f66b6f92e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:46.470772 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-6c5ab875-b287-464e-9976-d89f66b6f92e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: e6b3ee80-2e17-4135-9f45-bef437385e0c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:46.494638 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6c5ab875-b287-464e-9976-d89f66b6f92e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:46.495539 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6c5ab875-b287-464e-9976-d89f66b6f92e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:46.496256 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6c5ab875-b287-464e-9976-d89f66b6f92e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:46.497219 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6c5ab875-b287-464e-9976-d89f66b6f92e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:46.507464 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6c5ab875-b287-464e-9976-d89f66b6f92e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:46.507464 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6c5ab875-b287-464e-9976-d89f66b6f92e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:46.568600 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:46:46.694718 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ea47b4ac-1760-42ac-b321-d189bc8eb438 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:46.696686 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ea47b4ac-1760-42ac-b321-d189bc8eb438 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: af46589b-8af1-4394-86e3-631c7d483a12] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:46.705787 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ea47b4ac-1760-42ac-b321-d189bc8eb438 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:46.706930 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ea47b4ac-1760-42ac-b321-d189bc8eb438 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:46.707481 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ea47b4ac-1760-42ac-b321-d189bc8eb438 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:46.708246 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ea47b4ac-1760-42ac-b321-d189bc8eb438 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:46.708869 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ea47b4ac-1760-42ac-b321-d189bc8eb438 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:46.709467 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ea47b4ac-1760-42ac-b321-d189bc8eb438 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:46.829388 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-6c5ab875-b287-464e-9976-d89f66b6f92e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:46.864380 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6c5ab875-b287-464e-9976-d89f66b6f92e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/e6b3ee80-2e17-4135-9f45-bef437385e0c" status: 200 len: 1317 microversion: 2.1 time: 0.402328 Oct 04 18:46:46.865326 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2127/4317] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:46 2022] GET /compute/v2.1/servers/e6b3ee80-2e17-4135-9f45-bef437385e0c => generated 1317 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:47.028855 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ea47b4ac-1760-42ac-b321-d189bc8eb438 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:47.037001 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ea47b4ac-1760-42ac-b321-d189bc8eb438 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/af46589b-8af1-4394-86e3-631c7d483a12" status: 200 len: 1520 microversion: 2.1 time: 0.346417 Oct 04 18:46:47.037575 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2191/4318] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:46 2022] GET /compute/v2.1/servers/af46589b-8af1-4394-86e3-631c7d483a12 => generated 1520 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:46:47.891139 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-31291965-1610-4cb7-b123-1476ee5acb31 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:47.892638 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-31291965-1610-4cb7-b123-1476ee5acb31 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: e6b3ee80-2e17-4135-9f45-bef437385e0c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:47.905592 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-31291965-1610-4cb7-b123-1476ee5acb31 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:47.909828 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-31291965-1610-4cb7-b123-1476ee5acb31 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:47.913344 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-31291965-1610-4cb7-b123-1476ee5acb31 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:47.914413 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-31291965-1610-4cb7-b123-1476ee5acb31 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:47.915141 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-31291965-1610-4cb7-b123-1476ee5acb31 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:47.915898 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-31291965-1610-4cb7-b123-1476ee5acb31 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:48.061103 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-aaf12dbd-d477-4113-8360-0a74e634aff5 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:48.062305 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-aaf12dbd-d477-4113-8360-0a74e634aff5 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: af46589b-8af1-4394-86e3-631c7d483a12] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:48.070957 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aaf12dbd-d477-4113-8360-0a74e634aff5 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:48.071820 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aaf12dbd-d477-4113-8360-0a74e634aff5 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:48.072507 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aaf12dbd-d477-4113-8360-0a74e634aff5 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:48.073405 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aaf12dbd-d477-4113-8360-0a74e634aff5 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:48.074008 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aaf12dbd-d477-4113-8360-0a74e634aff5 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:48.074616 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aaf12dbd-d477-4113-8360-0a74e634aff5 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:48.291698 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-31291965-1610-4cb7-b123-1476ee5acb31 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:48.311802 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-31291965-1610-4cb7-b123-1476ee5acb31 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/e6b3ee80-2e17-4135-9f45-bef437385e0c" status: 200 len: 1317 microversion: 2.1 time: 0.426564 Oct 04 18:46:48.313875 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2128/4319] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:47 2022] GET /compute/v2.1/servers/e6b3ee80-2e17-4135-9f45-bef437385e0c => generated 1317 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:48.338481 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-cc8d6731-aa70-413d-aadb-96ee59a60c7c req-092a9dc1-2bca-4163-9684-e2fe06ae12d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6b3ee80-2e17-4135-9f45-bef437385e0c", "tag": "7702716d-6017-4093-9875-90fa3f1194a9"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:48.350158 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-cc8d6731-aa70-413d-aadb-96ee59a60c7c req-092a9dc1-2bca-4163-9684-e2fe06ae12d4 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:48.350909 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-cc8d6731-aa70-413d-aadb-96ee59a60c7c req-092a9dc1-2bca-4163-9684-e2fe06ae12d4 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:48.351632 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-cc8d6731-aa70-413d-aadb-96ee59a60c7c req-092a9dc1-2bca-4163-9684-e2fe06ae12d4 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:48.369028 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-cc8d6731-aa70-413d-aadb-96ee59a60c7c req-092a9dc1-2bca-4163-9684-e2fe06ae12d4 service nova] Creating event network-changed:7702716d-6017-4093-9875-90fa3f1194a9 for instance e6b3ee80-2e17-4135-9f45-bef437385e0c on n-h1-850501-14 Oct 04 18:46:48.375131 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-cc8d6731-aa70-413d-aadb-96ee59a60c7c req-092a9dc1-2bca-4163-9684-e2fe06ae12d4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041322 Oct 04 18:46:48.375742 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2129/4320] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:46:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:46:48.458486 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-aaf12dbd-d477-4113-8360-0a74e634aff5 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:48.475865 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-aaf12dbd-d477-4113-8360-0a74e634aff5 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/af46589b-8af1-4394-86e3-631c7d483a12" status: 200 len: 1520 microversion: 2.1 time: 0.415784 Oct 04 18:46:48.488086 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2192/4321] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:48 2022] GET /compute/v2.1/servers/af46589b-8af1-4394-86e3-631c7d483a12 => generated 1520 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:46:49.346332 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ef9a91cd-0245-4d9d-adea-7aeef427f8be tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:49.350702 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ef9a91cd-0245-4d9d-adea-7aeef427f8be tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: e6b3ee80-2e17-4135-9f45-bef437385e0c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:49.384155 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ef9a91cd-0245-4d9d-adea-7aeef427f8be tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:49.400452 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ef9a91cd-0245-4d9d-adea-7aeef427f8be tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:49.400452 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ef9a91cd-0245-4d9d-adea-7aeef427f8be tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:49.400452 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ef9a91cd-0245-4d9d-adea-7aeef427f8be tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:49.400452 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ef9a91cd-0245-4d9d-adea-7aeef427f8be tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:49.400452 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ef9a91cd-0245-4d9d-adea-7aeef427f8be tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:49.465424 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:46:49.490668 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=6 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:46:49.503062 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c4cc8270-d6bf-4db3-bd45-73935b62f59e tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:49.504593 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c4cc8270-d6bf-4db3-bd45-73935b62f59e tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: af46589b-8af1-4394-86e3-631c7d483a12] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:49.516615 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c4cc8270-d6bf-4db3-bd45-73935b62f59e tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:49.518214 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c4cc8270-d6bf-4db3-bd45-73935b62f59e tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:49.520161 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c4cc8270-d6bf-4db3-bd45-73935b62f59e tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:49.522765 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c4cc8270-d6bf-4db3-bd45-73935b62f59e tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:49.523317 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c4cc8270-d6bf-4db3-bd45-73935b62f59e tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:49.526316 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c4cc8270-d6bf-4db3-bd45-73935b62f59e tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:49.609747 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c4cc8270-d6bf-4db3-bd45-73935b62f59e tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:49.610406 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c4cc8270-d6bf-4db3-bd45-73935b62f59e tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:49.610861 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c4cc8270-d6bf-4db3-bd45-73935b62f59e tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:49.611326 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-c4cc8270-d6bf-4db3-bd45-73935b62f59e tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lazy-loading 'fault' on Instance uuid af46589b-8af1-4394-86e3-631c7d483a12 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:46:49.734288 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c4cc8270-d6bf-4db3-bd45-73935b62f59e tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4243e3907374e5e9947c17e6288f0e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb391aef10e4684ada5f811ae818f97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:49.751410 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c4cc8270-d6bf-4db3-bd45-73935b62f59e tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/af46589b-8af1-4394-86e3-631c7d483a12" status: 200 len: 1311 microversion: 2.1 time: 0.251956 Oct 04 18:46:49.752374 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2193/4322] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:49 2022] GET /compute/v2.1/servers/af46589b-8af1-4394-86e3-631c7d483a12 => generated 1311 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:46:49.789868 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ef9a91cd-0245-4d9d-adea-7aeef427f8be tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:49.805915 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ef9a91cd-0245-4d9d-adea-7aeef427f8be tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/e6b3ee80-2e17-4135-9f45-bef437385e0c" status: 200 len: 1317 microversion: 2.1 time: 0.469212 Oct 04 18:46:49.806483 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2130/4323] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:49 2022] GET /compute/v2.1/servers/e6b3ee80-2e17-4135-9f45-bef437385e0c => generated 1317 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:50.445179 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-570ba4a4-ea21-4154-8f62-b3dfa44ffd60 req-382b4c37-00e8-4631-b12c-ef80296734df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af46589b-8af1-4394-86e3-631c7d483a12", "name": "network-vif-deleted", "tag": "a7154b01-bcf4-44c5-b892-758fe0c61242"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:50.459146 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-570ba4a4-ea21-4154-8f62-b3dfa44ffd60 req-382b4c37-00e8-4631-b12c-ef80296734df service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:50.466088 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-570ba4a4-ea21-4154-8f62-b3dfa44ffd60 req-382b4c37-00e8-4631-b12c-ef80296734df service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:50.466689 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-570ba4a4-ea21-4154-8f62-b3dfa44ffd60 req-382b4c37-00e8-4631-b12c-ef80296734df service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:50.501664 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-570ba4a4-ea21-4154-8f62-b3dfa44ffd60 req-382b4c37-00e8-4631-b12c-ef80296734df service nova] Creating event network-vif-deleted:a7154b01-bcf4-44c5-b892-758fe0c61242 for instance af46589b-8af1-4394-86e3-631c7d483a12 on n-h2-850501-14 Oct 04 18:46:50.519454 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-570ba4a4-ea21-4154-8f62-b3dfa44ffd60 req-382b4c37-00e8-4631-b12c-ef80296734df service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095833 Oct 04 18:46:50.521471 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2194/4324] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:46:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:46:50.778541 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a1c1df99-b89a-4c70-9a01-7aa297e62d10 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:50.779388 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a1c1df99-b89a-4c70-9a01-7aa297e62d10 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] [instance: af46589b-8af1-4394-86e3-631c7d483a12] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:50.786403 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a1c1df99-b89a-4c70-9a01-7aa297e62d10 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:50.787159 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a1c1df99-b89a-4c70-9a01-7aa297e62d10 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:50.787770 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a1c1df99-b89a-4c70-9a01-7aa297e62d10 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:50.795828 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a1c1df99-b89a-4c70-9a01-7aa297e62d10 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:50.795828 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a1c1df99-b89a-4c70-9a01-7aa297e62d10 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:50.795828 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a1c1df99-b89a-4c70-9a01-7aa297e62d10 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:50.807967 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-a1c1df99-b89a-4c70-9a01-7aa297e62d10 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] HTTP exception thrown: Instance af46589b-8af1-4394-86e3-631c7d483a12 could not be found. Oct 04 18:46:50.810094 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a1c1df99-b89a-4c70-9a01-7aa297e62d10 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Request method failure captured: Oct 04 18:46:50.810094 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/af46589b-8af1-4394-86e3-631c7d483a12 HTTP/1.1 Oct 04 18:46:50.810094 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:46:50.810094 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:46:50.810094 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:46:50.810094 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:46:50.810094 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:46:50.810094 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:46:50.810094 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:46:50.810094 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:46:50.810094 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH5VeoXXX4R-gl3WW_fAsW_7hDIEWiZR35lPoIuJDBMUw75w4Z-93EJDy38x5YiA26dGCEdjKEzqMCUM4kpma5PpB_mUiDb0rAatpoM-ionDMXIgsOp1o3NTgluOHECynM7nFlIuW8aS-v8Gnb5xnrVGhYXFRV6ahForfC1sBHmJ1HA Oct 04 18:46:50.810094 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:46:50.810094 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:46:50.810094 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:46:50.810094 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:46:50.810094 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:46:50.810094 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:46:50.810094 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 9eb391aef10e4684ada5f811ae818f97 Oct 04 18:46:50.810094 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-124944821 Oct 04 18:46:50.810094 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:46:50.810094 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:46:50.810094 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9eb391aef10e4684ada5f811ae818f97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9eb391aef10e4684ada5f811ae818f97", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9eb391aef10e4684ada5f811ae818f97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9eb391aef10e4684ada5f811ae818f97"}]}] Oct 04 18:46:50.810094 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServerRescueNegativeTestJSON-124944821 Oct 04 18:46:50.810094 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 9eb391aef10e4684ada5f811ae818f97 Oct 04 18:46:50.810094 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-124944821 Oct 04 18:46:50.810094 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServerRescueNegativeTestJSON-124944821-project Oct 04 18:46:50.810094 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:46:50.810094 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:46:50.810094 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: c4243e3907374e5e9947c17e6288f0e7 Oct 04 18:46:50.810094 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServerRescueNegativeTestJSON-124944821-project Oct 04 18:46:50.810094 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:46:50.810094 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance af46589b-8af1-4394-86e3-631c7d483a12 could not be found. Oct 04 18:46:50.810094 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'af46589b-8af1-4394-86e3-631c7d483a12'} Oct 04 18:46:50.810094 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:46:50.810094 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:46:50.810094 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:46:50.810094 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:46:50.810094 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:46:50.810094 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:46:50.810094 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:46:50.810094 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:46:50.810094 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:46:50.810094 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:46:50.810094 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af46589b-8af1-4394-86e3-631c7d483a12 could not be found. Oct 04 18:46:50.810094 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:46:50.810094 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:46:50.810094 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:46:50.810094 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:46:50.810094 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:46:50.810094 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:46:50.810094 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:46:50.810094 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:46:50.810094 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:46:50.810094 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:46:50.810094 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:46:50.810094 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:46:50.810094 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:46:50.810094 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:46:50.810094 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:46:50.810094 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:46:50.810094 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af46589b-8af1-4394-86e3-631c7d483a12 could not be found. Oct 04 18:46:50.810094 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:46:50.810094 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:46:50.814035 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:46:50.814035 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:46:50.814035 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:46:50.814035 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:46:50.814035 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:46:50.814035 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:46:50.814035 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af46589b-8af1-4394-86e3-631c7d483a12 could not be found. Oct 04 18:46:50.814035 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:46:50.817243 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a1c1df99-b89a-4c70-9a01-7aa297e62d10 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] Returning 404 to user: Instance af46589b-8af1-4394-86e3-631c7d483a12 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:46:50.823527 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a1c1df99-b89a-4c70-9a01-7aa297e62d10 tempest-ServerRescueNegativeTestJSON-124944821 tempest-ServerRescueNegativeTestJSON-124944821-project] 10.222.0.20 "GET /compute/v2.1/servers/af46589b-8af1-4394-86e3-631c7d483a12" status: 404 len: 111 microversion: 2.1 time: 0.045955 Oct 04 18:46:50.823527 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2131/4325] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:50 2022] GET /compute/v2.1/servers/af46589b-8af1-4394-86e3-631c7d483a12 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:46:50.832638 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4089b2de-c41b-42c8-a7d7-cf309a1a7764 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:50.833758 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-4089b2de-c41b-42c8-a7d7-cf309a1a7764 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: e6b3ee80-2e17-4135-9f45-bef437385e0c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:50.842053 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4089b2de-c41b-42c8-a7d7-cf309a1a7764 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:50.842904 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4089b2de-c41b-42c8-a7d7-cf309a1a7764 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:50.843547 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4089b2de-c41b-42c8-a7d7-cf309a1a7764 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:50.844506 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4089b2de-c41b-42c8-a7d7-cf309a1a7764 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:50.845184 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4089b2de-c41b-42c8-a7d7-cf309a1a7764 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:50.845844 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4089b2de-c41b-42c8-a7d7-cf309a1a7764 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:50.866020 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:46:51.197798 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=4 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:46:51.269400 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-4089b2de-c41b-42c8-a7d7-cf309a1a7764 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:51.279886 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-4089b2de-c41b-42c8-a7d7-cf309a1a7764 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/e6b3ee80-2e17-4135-9f45-bef437385e0c" status: 200 len: 1317 microversion: 2.1 time: 0.452780 Oct 04 18:46:51.285698 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2195/4326] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:50 2022] GET /compute/v2.1/servers/e6b3ee80-2e17-4135-9f45-bef437385e0c => generated 1317 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:52.319208 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-836312c5-26f9-4b67-9e47-a62f14a22e7a tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:52.321087 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-836312c5-26f9-4b67-9e47-a62f14a22e7a tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: e6b3ee80-2e17-4135-9f45-bef437385e0c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:52.357954 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-836312c5-26f9-4b67-9e47-a62f14a22e7a tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:52.357954 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-836312c5-26f9-4b67-9e47-a62f14a22e7a tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:52.360552 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-836312c5-26f9-4b67-9e47-a62f14a22e7a tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:52.362675 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-836312c5-26f9-4b67-9e47-a62f14a22e7a tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:52.365657 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-836312c5-26f9-4b67-9e47-a62f14a22e7a tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:52.377613 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-836312c5-26f9-4b67-9e47-a62f14a22e7a tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:53.260718 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-836312c5-26f9-4b67-9e47-a62f14a22e7a tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:53.292385 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-836312c5-26f9-4b67-9e47-a62f14a22e7a tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/e6b3ee80-2e17-4135-9f45-bef437385e0c" status: 200 len: 1317 microversion: 2.1 time: 0.962674 Oct 04 18:46:53.292385 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2132/4327] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:52 2022] GET /compute/v2.1/servers/e6b3ee80-2e17-4135-9f45-bef437385e0c => generated 1317 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:54.309400 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-51ac5c47-9634-4af3-b07b-8f025842045f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:54.311210 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-51ac5c47-9634-4af3-b07b-8f025842045f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: e6b3ee80-2e17-4135-9f45-bef437385e0c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:54.354748 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-51ac5c47-9634-4af3-b07b-8f025842045f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:54.355310 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-51ac5c47-9634-4af3-b07b-8f025842045f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:54.355793 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-51ac5c47-9634-4af3-b07b-8f025842045f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:54.356555 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-51ac5c47-9634-4af3-b07b-8f025842045f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:54.368446 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-51ac5c47-9634-4af3-b07b-8f025842045f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:54.369040 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-51ac5c47-9634-4af3-b07b-8f025842045f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:54.933904 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-51ac5c47-9634-4af3-b07b-8f025842045f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:54.943454 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-51ac5c47-9634-4af3-b07b-8f025842045f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/e6b3ee80-2e17-4135-9f45-bef437385e0c" status: 200 len: 1317 microversion: 2.1 time: 0.641438 Oct 04 18:46:54.973290 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2196/4328] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:54 2022] GET /compute/v2.1/servers/e6b3ee80-2e17-4135-9f45-bef437385e0c => generated 1317 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:56.000285 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2bbf16bd-c753-4ecd-9afa-da0801888162 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:56.002482 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2bbf16bd-c753-4ecd-9afa-da0801888162 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: e6b3ee80-2e17-4135-9f45-bef437385e0c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:56.011318 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2bbf16bd-c753-4ecd-9afa-da0801888162 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:56.012293 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2bbf16bd-c753-4ecd-9afa-da0801888162 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:56.013767 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2bbf16bd-c753-4ecd-9afa-da0801888162 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:56.015248 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2bbf16bd-c753-4ecd-9afa-da0801888162 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:56.035896 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2bbf16bd-c753-4ecd-9afa-da0801888162 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:56.036791 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2bbf16bd-c753-4ecd-9afa-da0801888162 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:56.385782 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2bbf16bd-c753-4ecd-9afa-da0801888162 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:56.401137 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2bbf16bd-c753-4ecd-9afa-da0801888162 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/e6b3ee80-2e17-4135-9f45-bef437385e0c" status: 200 len: 1317 microversion: 2.1 time: 0.409688 Oct 04 18:46:56.403734 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2133/4329] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:55 2022] GET /compute/v2.1/servers/e6b3ee80-2e17-4135-9f45-bef437385e0c => generated 1317 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:57.429074 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-43a770ea-ffa1-41f5-980b-915c454dbe27 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:57.442519 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-43a770ea-ffa1-41f5-980b-915c454dbe27 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: e6b3ee80-2e17-4135-9f45-bef437385e0c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:57.474617 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-43a770ea-ffa1-41f5-980b-915c454dbe27 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:57.486025 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-43a770ea-ffa1-41f5-980b-915c454dbe27 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:57.486025 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-43a770ea-ffa1-41f5-980b-915c454dbe27 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:57.486025 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-43a770ea-ffa1-41f5-980b-915c454dbe27 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:57.486025 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-43a770ea-ffa1-41f5-980b-915c454dbe27 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:57.489749 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-43a770ea-ffa1-41f5-980b-915c454dbe27 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:57.854300 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-db84afe0-b544-4d1f-9bde-f18d7a8734da req-ad9fefb3-d5ae-4e11-ab1b-3d0c7e85d842 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6b3ee80-2e17-4135-9f45-bef437385e0c", "name": "network-vif-plugged", "status": "completed", "tag": "7702716d-6017-4093-9875-90fa3f1194a9"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:57.876225 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-db84afe0-b544-4d1f-9bde-f18d7a8734da req-ad9fefb3-d5ae-4e11-ab1b-3d0c7e85d842 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:57.876806 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-db84afe0-b544-4d1f-9bde-f18d7a8734da req-ad9fefb3-d5ae-4e11-ab1b-3d0c7e85d842 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:57.877479 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-db84afe0-b544-4d1f-9bde-f18d7a8734da req-ad9fefb3-d5ae-4e11-ab1b-3d0c7e85d842 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:57.908989 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-db84afe0-b544-4d1f-9bde-f18d7a8734da req-ad9fefb3-d5ae-4e11-ab1b-3d0c7e85d842 service nova] Creating event network-vif-plugged:7702716d-6017-4093-9875-90fa3f1194a9 for instance e6b3ee80-2e17-4135-9f45-bef437385e0c on n-h1-850501-14 Oct 04 18:46:57.919343 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-db84afe0-b544-4d1f-9bde-f18d7a8734da req-ad9fefb3-d5ae-4e11-ab1b-3d0c7e85d842 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069354 Oct 04 18:46:57.925084 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2134/4330] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:46:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:46:58.170248 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-43a770ea-ffa1-41f5-980b-915c454dbe27 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:58.190683 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-43a770ea-ffa1-41f5-980b-915c454dbe27 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/e6b3ee80-2e17-4135-9f45-bef437385e0c" status: 200 len: 1317 microversion: 2.1 time: 0.763438 Oct 04 18:46:58.202181 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2197/4331] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:57 2022] GET /compute/v2.1/servers/e6b3ee80-2e17-4135-9f45-bef437385e0c => generated 1317 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:58.896277 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4956425a-9c73-4aa8-9b5b-23bbaee00ecb tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-2038001982", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": [{"uuid": "78884083-8fd9-4713-bf20-70c3db5a4715"}]}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:59.058029 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-4956425a-9c73-4aa8-9b5b-23bbaee00ecb tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] validate_networks() for [('78884083-8fd9-4713-bf20-70c3db5a4715', None, None, None, None, None)] {{(pid=123002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:46:59.228634 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a34ec45a-0644-49ca-a1da-daefaadfeb44 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:59.233499 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a34ec45a-0644-49ca-a1da-daefaadfeb44 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: e6b3ee80-2e17-4135-9f45-bef437385e0c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:59.237956 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:46:59.264203 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a34ec45a-0644-49ca-a1da-daefaadfeb44 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:59.265025 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a34ec45a-0644-49ca-a1da-daefaadfeb44 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:59.269067 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a34ec45a-0644-49ca-a1da-daefaadfeb44 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:59.272776 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a34ec45a-0644-49ca-a1da-daefaadfeb44 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:59.273515 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a34ec45a-0644-49ca-a1da-daefaadfeb44 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:59.277697 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a34ec45a-0644-49ca-a1da-daefaadfeb44 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:59.947259 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a34ec45a-0644-49ca-a1da-daefaadfeb44 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:59.955950 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a34ec45a-0644-49ca-a1da-daefaadfeb44 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/e6b3ee80-2e17-4135-9f45-bef437385e0c" status: 200 len: 1317 microversion: 2.1 time: 0.735528 Oct 04 18:46:59.976259 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2198/4332] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:59 2022] GET /compute/v2.1/servers/e6b3ee80-2e17-4135-9f45-bef437385e0c => generated 1317 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:47:00.316657 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-4956425a-9c73-4aa8-9b5b-23bbaee00ecb tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:47:00.317491 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-4956425a-9c73-4aa8-9b5b-23bbaee00ecb tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:47:00.317639 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-4956425a-9c73-4aa8-9b5b-23bbaee00ecb tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:47:00.318048 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-4956425a-9c73-4aa8-9b5b-23bbaee00ecb tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:47:00.318462 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-4956425a-9c73-4aa8-9b5b-23bbaee00ecb tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:47:00.339443 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4956425a-9c73-4aa8-9b5b-23bbaee00ecb tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:00.340196 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4956425a-9c73-4aa8-9b5b-23bbaee00ecb tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:00.340354 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4956425a-9c73-4aa8-9b5b-23bbaee00ecb tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:00.341064 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4956425a-9c73-4aa8-9b5b-23bbaee00ecb tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:00.341513 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4956425a-9c73-4aa8-9b5b-23bbaee00ecb tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:00.341927 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4956425a-9c73-4aa8-9b5b-23bbaee00ecb tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:00.369491 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-4956425a-9c73-4aa8-9b5b-23bbaee00ecb tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Getting quotas for project 7917de0ff5be4d238981ea714d837fe0. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:47:00.379582 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-4956425a-9c73-4aa8-9b5b-23bbaee00ecb tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Getting quotas for user 4cce9172582d4efd8fc31251d4bfe63c and project 7917de0ff5be4d238981ea714d837fe0. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:47:00.399509 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4956425a-9c73-4aa8-9b5b-23bbaee00ecb tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Going to run 1 instances... {{(pid=123002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:47:00.401587 n-d-850501-14 devstack@n-api.service[123002]: WARNING nova.utils [None req-4956425a-9c73-4aa8-9b5b-23bbaee00ecb tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-2038001982 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-203800198 Oct 04 18:47:00.407464 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4956425a-9c73-4aa8-9b5b-23bbaee00ecb tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] [instance: 89ad7c7f-cba8-4fbe-8442-63a74c482c6b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:47:00.622746 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4956425a-9c73-4aa8-9b5b-23bbaee00ecb tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.024560 Oct 04 18:47:00.636179 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b97e56f8-040a-4e82-9dfa-dc538940e669 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:00.636963 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b97e56f8-040a-4e82-9dfa-dc538940e669 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] [instance: 89ad7c7f-cba8-4fbe-8442-63a74c482c6b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:00.642858 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2135/4333] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:46:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 2047 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:47:00.745605 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b97e56f8-040a-4e82-9dfa-dc538940e669 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cce9172582d4efd8fc31251d4bfe63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7917de0ff5be4d238981ea714d837fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:00.761253 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b97e56f8-040a-4e82-9dfa-dc538940e669 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] 10.222.0.20 "GET /compute/v2.1/servers/89ad7c7f-cba8-4fbe-8442-63a74c482c6b" status: 200 len: 1232 microversion: 2.1 time: 0.125664 Oct 04 18:47:00.766816 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2199/4334] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:00 2022] GET /compute/v2.1/servers/89ad7c7f-cba8-4fbe-8442-63a74c482c6b => generated 1232 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:47:00.986897 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e9b4b56a-e6c8-402f-b4ca-03b9bd3f56d9 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:00.987751 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e9b4b56a-e6c8-402f-b4ca-03b9bd3f56d9 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: e6b3ee80-2e17-4135-9f45-bef437385e0c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:01.018711 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e9b4b56a-e6c8-402f-b4ca-03b9bd3f56d9 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:01.024685 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e9b4b56a-e6c8-402f-b4ca-03b9bd3f56d9 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:01.027235 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e9b4b56a-e6c8-402f-b4ca-03b9bd3f56d9 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:01.035899 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e9b4b56a-e6c8-402f-b4ca-03b9bd3f56d9 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:01.039607 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e9b4b56a-e6c8-402f-b4ca-03b9bd3f56d9 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:01.045766 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e9b4b56a-e6c8-402f-b4ca-03b9bd3f56d9 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:01.375344 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e9b4b56a-e6c8-402f-b4ca-03b9bd3f56d9 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:01.392737 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e9b4b56a-e6c8-402f-b4ca-03b9bd3f56d9 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/e6b3ee80-2e17-4135-9f45-bef437385e0c" status: 200 len: 1505 microversion: 2.1 time: 0.412532 Oct 04 18:47:01.394295 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2136/4335] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:00 2022] GET /compute/v2.1/servers/e6b3ee80-2e17-4135-9f45-bef437385e0c => generated 1505 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:01.418631 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4bef8d9c-1907-46b0-acf4-e4fa9299bb81 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:01.420284 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-4bef8d9c-1907-46b0-acf4-e4fa9299bb81 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: e6b3ee80-2e17-4135-9f45-bef437385e0c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:01.430238 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4bef8d9c-1907-46b0-acf4-e4fa9299bb81 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:01.433031 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4bef8d9c-1907-46b0-acf4-e4fa9299bb81 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:01.433731 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4bef8d9c-1907-46b0-acf4-e4fa9299bb81 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:01.434684 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4bef8d9c-1907-46b0-acf4-e4fa9299bb81 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:01.435369 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4bef8d9c-1907-46b0-acf4-e4fa9299bb81 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:01.435998 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4bef8d9c-1907-46b0-acf4-e4fa9299bb81 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:01.503335 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-4bef8d9c-1907-46b0-acf4-e4fa9299bb81 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: e6b3ee80-2e17-4135-9f45-bef437385e0c] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:47:01.795355 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-bc26e028-73ab-4bba-99ac-9dc8081cab42 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:01.797140 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-bc26e028-73ab-4bba-99ac-9dc8081cab42 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] [instance: 89ad7c7f-cba8-4fbe-8442-63a74c482c6b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:01.932572 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-bc26e028-73ab-4bba-99ac-9dc8081cab42 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cce9172582d4efd8fc31251d4bfe63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7917de0ff5be4d238981ea714d837fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:01.949777 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-bc26e028-73ab-4bba-99ac-9dc8081cab42 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] 10.222.0.20 "GET /compute/v2.1/servers/89ad7c7f-cba8-4fbe-8442-63a74c482c6b" status: 200 len: 1232 microversion: 2.1 time: 0.158789 Oct 04 18:47:01.958466 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2137/4336] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:01 2022] GET /compute/v2.1/servers/89ad7c7f-cba8-4fbe-8442-63a74c482c6b => generated 1232 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:01.988396 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-4bef8d9c-1907-46b0-acf4-e4fa9299bb81 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e6b3ee80-2e17-4135-9f45-bef437385e0c" status: 204 len: 0 microversion: 2.1 time: 0.568268 Oct 04 18:47:01.992935 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2200/4337] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:47:01 2022] DELETE /compute/v2.1/servers/e6b3ee80-2e17-4135-9f45-bef437385e0c => generated 0 bytes in 576 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:47:02.000721 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-84d9d3d0-f7d8-4650-ba49-c237f3a275dd tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:02.001332 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-84d9d3d0-f7d8-4650-ba49-c237f3a275dd tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: e6b3ee80-2e17-4135-9f45-bef437385e0c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:02.032379 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-84d9d3d0-f7d8-4650-ba49-c237f3a275dd tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:02.032871 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-84d9d3d0-f7d8-4650-ba49-c237f3a275dd tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:02.033307 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-84d9d3d0-f7d8-4650-ba49-c237f3a275dd tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:02.034850 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-84d9d3d0-f7d8-4650-ba49-c237f3a275dd tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:02.035317 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-84d9d3d0-f7d8-4650-ba49-c237f3a275dd tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:02.035747 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-84d9d3d0-f7d8-4650-ba49-c237f3a275dd tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:02.363923 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-84d9d3d0-f7d8-4650-ba49-c237f3a275dd tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:02.420213 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-84d9d3d0-f7d8-4650-ba49-c237f3a275dd tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/e6b3ee80-2e17-4135-9f45-bef437385e0c" status: 200 len: 1511 microversion: 2.1 time: 0.423135 Oct 04 18:47:02.422458 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2138/4338] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:01 2022] GET /compute/v2.1/servers/e6b3ee80-2e17-4135-9f45-bef437385e0c => generated 1511 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:02.980961 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-fb1ee66f-7066-4272-9d61-2e92cc9b9c2f tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:02.981857 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-fb1ee66f-7066-4272-9d61-2e92cc9b9c2f tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] [instance: 89ad7c7f-cba8-4fbe-8442-63a74c482c6b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:02.998314 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fb1ee66f-7066-4272-9d61-2e92cc9b9c2f tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:02.999998 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fb1ee66f-7066-4272-9d61-2e92cc9b9c2f tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:03.000670 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fb1ee66f-7066-4272-9d61-2e92cc9b9c2f tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:03.001581 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fb1ee66f-7066-4272-9d61-2e92cc9b9c2f tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:03.004314 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fb1ee66f-7066-4272-9d61-2e92cc9b9c2f tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:03.016716 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fb1ee66f-7066-4272-9d61-2e92cc9b9c2f tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:03.627316 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5aeb7e1d-7417-4221-befc-f7cba43f451f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-2127458354", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": [{"uuid": "773447f8-5421-4dc5-aacf-857d60ccc335"}]}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:03.745167 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-5aeb7e1d-7417-4221-befc-f7cba43f451f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] validate_networks() for [('773447f8-5421-4dc5-aacf-857d60ccc335', None, None, None, None, None)] {{(pid=123002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:47:04.558678 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-fb1ee66f-7066-4272-9d61-2e92cc9b9c2f tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cce9172582d4efd8fc31251d4bfe63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7917de0ff5be4d238981ea714d837fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:04.576587 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-fb1ee66f-7066-4272-9d61-2e92cc9b9c2f tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] 10.222.0.20 "GET /compute/v2.1/servers/89ad7c7f-cba8-4fbe-8442-63a74c482c6b" status: 200 len: 1236 microversion: 2.1 time: 1.592668 Oct 04 18:47:04.591327 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2201/4339] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:02 2022] GET /compute/v2.1/servers/89ad7c7f-cba8-4fbe-8442-63a74c482c6b => generated 1236 bytes in 1604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:04.591327 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-205ec32d-66ea-4c16-9796-03217929a1aa tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:04.591327 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-205ec32d-66ea-4c16-9796-03217929a1aa tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: e6b3ee80-2e17-4135-9f45-bef437385e0c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:04.613354 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-205ec32d-66ea-4c16-9796-03217929a1aa tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:04.615307 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-205ec32d-66ea-4c16-9796-03217929a1aa tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:04.616867 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-205ec32d-66ea-4c16-9796-03217929a1aa tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:04.616867 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-205ec32d-66ea-4c16-9796-03217929a1aa tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:04.617068 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-205ec32d-66ea-4c16-9796-03217929a1aa tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:04.617438 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-205ec32d-66ea-4c16-9796-03217929a1aa tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:04.974593 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-205ec32d-66ea-4c16-9796-03217929a1aa tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:04.983564 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-205ec32d-66ea-4c16-9796-03217929a1aa tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/e6b3ee80-2e17-4135-9f45-bef437385e0c" status: 200 len: 1469 microversion: 2.1 time: 0.404881 Oct 04 18:47:05.004250 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2202/4340] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:04 2022] GET /compute/v2.1/servers/e6b3ee80-2e17-4135-9f45-bef437385e0c => generated 1469 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:05.062715 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-ceef7693-6576-4d6e-a286-e28d749e4642 req-b8d18b76-5c9c-4ea5-910a-fa8bd7f9edec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6b3ee80-2e17-4135-9f45-bef437385e0c", "name": "network-vif-deleted", "tag": "7702716d-6017-4093-9875-90fa3f1194a9"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:05.090500 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-ceef7693-6576-4d6e-a286-e28d749e4642 req-b8d18b76-5c9c-4ea5-910a-fa8bd7f9edec service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:05.092351 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-ceef7693-6576-4d6e-a286-e28d749e4642 req-b8d18b76-5c9c-4ea5-910a-fa8bd7f9edec service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:05.093958 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-ceef7693-6576-4d6e-a286-e28d749e4642 req-b8d18b76-5c9c-4ea5-910a-fa8bd7f9edec service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:05.148608 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-ceef7693-6576-4d6e-a286-e28d749e4642 req-b8d18b76-5c9c-4ea5-910a-fa8bd7f9edec service nova] Creating event network-vif-deleted:7702716d-6017-4093-9875-90fa3f1194a9 for instance e6b3ee80-2e17-4135-9f45-bef437385e0c on n-h1-850501-14 Oct 04 18:47:05.174524 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-ceef7693-6576-4d6e-a286-e28d749e4642 req-b8d18b76-5c9c-4ea5-910a-fa8bd7f9edec service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115398 Oct 04 18:47:05.181817 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2203/4341] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:47:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:47:05.602513 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-995db480-5ec7-4b51-b533-d55eb66ffc34 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:05.605307 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-995db480-5ec7-4b51-b533-d55eb66ffc34 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] [instance: 89ad7c7f-cba8-4fbe-8442-63a74c482c6b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:05.619979 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-995db480-5ec7-4b51-b533-d55eb66ffc34 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:05.620541 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-995db480-5ec7-4b51-b533-d55eb66ffc34 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:05.620971 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-995db480-5ec7-4b51-b533-d55eb66ffc34 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:05.629275 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-995db480-5ec7-4b51-b533-d55eb66ffc34 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:05.631037 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-995db480-5ec7-4b51-b533-d55eb66ffc34 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:05.631642 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-995db480-5ec7-4b51-b533-d55eb66ffc34 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:06.018437 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-5aeb7e1d-7417-4221-befc-f7cba43f451f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:47:06.018965 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-5aeb7e1d-7417-4221-befc-f7cba43f451f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:47:06.019545 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-5aeb7e1d-7417-4221-befc-f7cba43f451f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:47:06.020106 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-5aeb7e1d-7417-4221-befc-f7cba43f451f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:47:06.020612 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-5aeb7e1d-7417-4221-befc-f7cba43f451f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:47:06.044529 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5aeb7e1d-7417-4221-befc-f7cba43f451f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:06.046163 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5aeb7e1d-7417-4221-befc-f7cba43f451f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:06.050507 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5aeb7e1d-7417-4221-befc-f7cba43f451f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:06.050507 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5aeb7e1d-7417-4221-befc-f7cba43f451f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:06.051566 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5aeb7e1d-7417-4221-befc-f7cba43f451f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:06.052282 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5aeb7e1d-7417-4221-befc-f7cba43f451f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:06.150841 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-5aeb7e1d-7417-4221-befc-f7cba43f451f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Getting quotas for project e4bae9055ba74017a261df156ecdd347. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:47:06.178424 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-5aeb7e1d-7417-4221-befc-f7cba43f451f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Getting quotas for user 032b060beb9645c4bea314ae44277b35 and project e4bae9055ba74017a261df156ecdd347. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:47:06.251195 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5aeb7e1d-7417-4221-befc-f7cba43f451f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Going to run 1 instances... {{(pid=123002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:47:06.254940 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5aeb7e1d-7417-4221-befc-f7cba43f451f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: 60694294-78ff-49f7-9d07-bb5915eae69e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:47:06.435743 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-995db480-5ec7-4b51-b533-d55eb66ffc34 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cce9172582d4efd8fc31251d4bfe63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7917de0ff5be4d238981ea714d837fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:06.488853 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5aeb7e1d-7417-4221-befc-f7cba43f451f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.197813 Oct 04 18:47:06.492474 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2139/4342] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:47:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 3205 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:47:06.500463 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-995db480-5ec7-4b51-b533-d55eb66ffc34 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] 10.222.0.20 "GET /compute/v2.1/servers/89ad7c7f-cba8-4fbe-8442-63a74c482c6b" status: 200 len: 1290 microversion: 2.1 time: 0.902326 Oct 04 18:47:06.504009 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2204/4343] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:05 2022] GET /compute/v2.1/servers/89ad7c7f-cba8-4fbe-8442-63a74c482c6b => generated 1290 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:06.506968 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0aeffab9-d497-45da-8da1-23cbf66d1eb1 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:06.510406 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0aeffab9-d497-45da-8da1-23cbf66d1eb1 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: e6b3ee80-2e17-4135-9f45-bef437385e0c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:06.529618 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0aeffab9-d497-45da-8da1-23cbf66d1eb1 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:06.533037 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0aeffab9-d497-45da-8da1-23cbf66d1eb1 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:06.534546 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0aeffab9-d497-45da-8da1-23cbf66d1eb1 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:06.537673 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0aeffab9-d497-45da-8da1-23cbf66d1eb1 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:06.539680 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0aeffab9-d497-45da-8da1-23cbf66d1eb1 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:06.540415 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0aeffab9-d497-45da-8da1-23cbf66d1eb1 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:06.541175 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6418b204-d3b8-4f4e-ac71-2673caae1378 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:06.545080 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6418b204-d3b8-4f4e-ac71-2673caae1378 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: 60694294-78ff-49f7-9d07-bb5915eae69e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:06.626641 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0aeffab9-d497-45da-8da1-23cbf66d1eb1 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:06.627736 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0aeffab9-d497-45da-8da1-23cbf66d1eb1 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:06.628509 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0aeffab9-d497-45da-8da1-23cbf66d1eb1 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:06.630267 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-0aeffab9-d497-45da-8da1-23cbf66d1eb1 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lazy-loading 'fault' on Instance uuid e6b3ee80-2e17-4135-9f45-bef437385e0c {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:47:06.746204 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0aeffab9-d497-45da-8da1-23cbf66d1eb1 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:06.754366 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0aeffab9-d497-45da-8da1-23cbf66d1eb1 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/e6b3ee80-2e17-4135-9f45-bef437385e0c" status: 200 len: 1307 microversion: 2.1 time: 0.260510 Oct 04 18:47:06.754956 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2140/4344] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:06 2022] GET /compute/v2.1/servers/e6b3ee80-2e17-4135-9f45-bef437385e0c => generated 1307 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:06.827383 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6418b204-d3b8-4f4e-ac71-2673caae1378 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:06.837179 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6418b204-d3b8-4f4e-ac71-2673caae1378 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/60694294-78ff-49f7-9d07-bb5915eae69e" status: 200 len: 1218 microversion: 2.1 time: 0.327625 Oct 04 18:47:06.837719 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2205/4345] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:06 2022] GET /compute/v2.1/servers/60694294-78ff-49f7-9d07-bb5915eae69e => generated 1218 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:07.533722 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e1b5c429-7a51-493a-8721-9636257ab98e tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:07.535990 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e1b5c429-7a51-493a-8721-9636257ab98e tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] [instance: 89ad7c7f-cba8-4fbe-8442-63a74c482c6b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:07.553502 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e1b5c429-7a51-493a-8721-9636257ab98e tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:07.556622 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e1b5c429-7a51-493a-8721-9636257ab98e tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:07.559141 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e1b5c429-7a51-493a-8721-9636257ab98e tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:07.568190 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e1b5c429-7a51-493a-8721-9636257ab98e tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:07.568190 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e1b5c429-7a51-493a-8721-9636257ab98e tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:07.568190 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e1b5c429-7a51-493a-8721-9636257ab98e tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:07.874079 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b4f75bd7-ccf0-4d35-8150-3efa8c7c753b tempest-VolumesSnapshotsTestJSON-1497841961 tempest-VolumesSnapshotsTestJSON-1497841961-project] Action: 'create', calling method: .version_select at 0x7fe258d4b1f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1241012980"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:07.899329 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e1b5c429-7a51-493a-8721-9636257ab98e tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cce9172582d4efd8fc31251d4bfe63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7917de0ff5be4d238981ea714d837fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:07.911886 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e1b5c429-7a51-493a-8721-9636257ab98e tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] 10.222.0.20 "GET /compute/v2.1/servers/89ad7c7f-cba8-4fbe-8442-63a74c482c6b" status: 200 len: 1332 microversion: 2.1 time: 0.380116 Oct 04 18:47:07.915784 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2141/4346] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:07 2022] GET /compute/v2.1/servers/89ad7c7f-cba8-4fbe-8442-63a74c482c6b => generated 1332 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:07.923979 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-da49a199-6286-4596-bd5d-a0d943e7112f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:07.924653 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-da49a199-6286-4596-bd5d-a0d943e7112f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: e6b3ee80-2e17-4135-9f45-bef437385e0c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:07.940225 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-da49a199-6286-4596-bd5d-a0d943e7112f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:07.940745 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-da49a199-6286-4596-bd5d-a0d943e7112f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:07.944657 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-da49a199-6286-4596-bd5d-a0d943e7112f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:07.950866 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-da49a199-6286-4596-bd5d-a0d943e7112f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:07.951491 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-da49a199-6286-4596-bd5d-a0d943e7112f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:07.951941 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-da49a199-6286-4596-bd5d-a0d943e7112f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:07.987580 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-da49a199-6286-4596-bd5d-a0d943e7112f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] HTTP exception thrown: Instance e6b3ee80-2e17-4135-9f45-bef437385e0c could not be found. Oct 04 18:47:07.989289 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-da49a199-6286-4596-bd5d-a0d943e7112f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Request method failure captured: Oct 04 18:47:07.989289 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/e6b3ee80-2e17-4135-9f45-bef437385e0c HTTP/1.1 Oct 04 18:47:07.989289 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:47:07.989289 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:47:07.989289 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:47:07.989289 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:47:07.989289 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:47:07.989289 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:47:07.989289 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:47:07.989289 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:47:07.989289 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH9zAVdj2h4kh6QqBpYrS2CJMhbcXf529VUNrZoZOYhS2tkLYBgw6AHy860DK9jQ3xATqZvC9lQuxt-_H5qKsAI41eznf32K6QSGqVcHXegpVHrDueww23ZMVCBM3D_hH0NTzh4447rgHqcrC-OZE48IfZrRJ9KPLPjAHT57T3mcPIc Oct 04 18:47:07.989289 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:47:07.989289 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:47:07.989289 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:47:07.989289 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:47:07.989289 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:47:07.989289 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:47:07.989289 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: b6c6b9deecde44b5953d22b38b5b0ff1 Oct 04 18:47:07.989289 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:47:07.989289 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:47:07.989289 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:47:07.989289 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6c6b9deecde44b5953d22b38b5b0ff1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b6c6b9deecde44b5953d22b38b5b0ff1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b6c6b9deecde44b5953d22b38b5b0ff1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6c6b9deecde44b5953d22b38b5b0ff1"}]}] Oct 04 18:47:07.989289 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:47:07.989289 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: b6c6b9deecde44b5953d22b38b5b0ff1 Oct 04 18:47:07.989289 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:47:07.989289 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServersNegativeTestJSON-626077540-project Oct 04 18:47:07.989289 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:47:07.989289 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:47:07.989289 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 5b4eb70f22ba4872b890a4f160cc1805 Oct 04 18:47:07.989289 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServersNegativeTestJSON-626077540-project Oct 04 18:47:07.989289 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:47:07.989289 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance e6b3ee80-2e17-4135-9f45-bef437385e0c could not be found. Oct 04 18:47:07.989289 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'e6b3ee80-2e17-4135-9f45-bef437385e0c'} Oct 04 18:47:07.989289 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:47:07.989289 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:07.989289 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:47:07.989289 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:47:07.989289 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:47:07.989289 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:47:07.989289 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:47:07.989289 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:47:07.989289 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:47:07.989289 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:47:07.989289 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6b3ee80-2e17-4135-9f45-bef437385e0c could not be found. Oct 04 18:47:07.989289 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:47:07.989289 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:07.989289 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:47:07.989289 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:07.989289 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:07.989289 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:07.989289 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:47:07.989289 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:47:07.989289 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:47:07.989289 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:47:07.989289 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:47:07.989289 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:47:07.989289 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:47:07.989289 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:47:07.989289 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:47:07.989289 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:47:07.989289 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6b3ee80-2e17-4135-9f45-bef437385e0c could not be found. Oct 04 18:47:07.989289 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:47:07.989289 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:07.989289 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:47:07.995583 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:07.995583 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:07.995583 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:07.995583 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:47:07.995583 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:47:07.995583 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6b3ee80-2e17-4135-9f45-bef437385e0c could not be found. Oct 04 18:47:07.995583 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:47:07.995583 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-da49a199-6286-4596-bd5d-a0d943e7112f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Returning 404 to user: Instance e6b3ee80-2e17-4135-9f45-bef437385e0c could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:47:07.995583 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-da49a199-6286-4596-bd5d-a0d943e7112f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/e6b3ee80-2e17-4135-9f45-bef437385e0c" status: 404 len: 111 microversion: 2.1 time: 0.073874 Oct 04 18:47:08.004487 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2142/4347] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:07 2022] GET /compute/v2.1/servers/e6b3ee80-2e17-4135-9f45-bef437385e0c => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:47:08.010119 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5244d58b-6a63-4d89-a039-c790a2920472 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:08.010735 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5244d58b-6a63-4d89-a039-c790a2920472 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: 60694294-78ff-49f7-9d07-bb5915eae69e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:08.192876 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5244d58b-6a63-4d89-a039-c790a2920472 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:08.217762 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5244d58b-6a63-4d89-a039-c790a2920472 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/60694294-78ff-49f7-9d07-bb5915eae69e" status: 200 len: 1218 microversion: 2.1 time: 0.210804 Oct 04 18:47:08.220308 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2143/4348] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:08 2022] GET /compute/v2.1/servers/60694294-78ff-49f7-9d07-bb5915eae69e => generated 1218 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:08.226664 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c51d0694-0b62-4903-bc91-331abafe4ff8 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:08.227695 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c51d0694-0b62-4903-bc91-331abafe4ff8 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:08.251020 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c51d0694-0b62-4903-bc91-331abafe4ff8 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:08.253477 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c51d0694-0b62-4903-bc91-331abafe4ff8 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:08.254762 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c51d0694-0b62-4903-bc91-331abafe4ff8 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:08.256446 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c51d0694-0b62-4903-bc91-331abafe4ff8 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:08.257118 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c51d0694-0b62-4903-bc91-331abafe4ff8 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:08.258371 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c51d0694-0b62-4903-bc91-331abafe4ff8 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:08.561161 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c51d0694-0b62-4903-bc91-331abafe4ff8 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:08.573049 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c51d0694-0b62-4903-bc91-331abafe4ff8 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1504 microversion: 2.1 time: 0.350717 Oct 04 18:47:08.605015 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2144/4349] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:08 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1504 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:08.766372 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-82dc23da-8109-427e-a5b1-f70068fba391 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": [{"uuid": "334d1b7e-7632-43fb-8807-6117cf357d4f"}]}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:08.777633 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-82dc23da-8109-427e-a5b1-f70068fba391 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Request method failure captured: Oct 04 18:47:08.777633 n-d-850501-14 devstack@n-api.service[123002]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:47:08.777633 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:47:08.777633 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:47:08.777633 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:47:08.777633 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 163 Oct 04 18:47:08.777633 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:47:08.777633 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:47:08.777633 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:47:08.777633 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:47:08.777633 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH9zAVdj2h4kh6QqBpYrS2CJMhbcXf529VUNrZoZOYhS2tkLYBgw6AHy860DK9jQ3xATqZvC9lQuxt-_H5qKsAI41eznf32K6QSGqVcHXegpVHrDueww23ZMVCBM3D_hH0NTzh4447rgHqcrC-OZE48IfZrRJ9KPLPjAHT57T3mcPIc Oct 04 18:47:08.777633 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:47:08.777633 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:47:08.777633 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:47:08.777633 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:47:08.777633 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:47:08.777633 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:47:08.777633 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: b6c6b9deecde44b5953d22b38b5b0ff1 Oct 04 18:47:08.777633 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:47:08.777633 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:47:08.777633 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:47:08.777633 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6c6b9deecde44b5953d22b38b5b0ff1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b6c6b9deecde44b5953d22b38b5b0ff1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b6c6b9deecde44b5953d22b38b5b0ff1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6c6b9deecde44b5953d22b38b5b0ff1"}]}] Oct 04 18:47:08.777633 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:47:08.777633 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: b6c6b9deecde44b5953d22b38b5b0ff1 Oct 04 18:47:08.777633 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:47:08.777633 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServersNegativeTestJSON-626077540-project Oct 04 18:47:08.777633 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:47:08.777633 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:47:08.777633 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 5b4eb70f22ba4872b890a4f160cc1805 Oct 04 18:47:08.777633 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServersNegativeTestJSON-626077540-project Oct 04 18:47:08.777633 n-d-850501-14 devstack@n-api.service[123002]: Oct 04 18:47:08.777633 n-d-850501-14 devstack@n-api.service[123002]: {"server": {"name": 12345, "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": [{"uuid": "334d1b7e-7632-43fb-8807-6117cf357d4f"}]}} Oct 04 18:47:08.777633 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:47:08.777633 n-d-850501-14 devstack@n-api.service[123002]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 04 18:47:08.777633 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'body': {'server': {'name': 12345, 'imageRef': 'f545e662-10b3-46b1-88bb-6e66dd294559', 'flavorRef': '452', 'networks': [{'uuid': '334d1b7e-7632-43fb-8807-6117cf357d4f'}]}}} Oct 04 18:47:08.777633 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:47:08.777633 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:08.777633 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:47:08.777633 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:47:08.777633 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:47:08.777633 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:47:08.777633 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Oct 04 18:47:08.777633 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:47:08.777633 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Oct 04 18:47:08.777633 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 18:47:08.777633 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:47:08.777633 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 18:47:08.777633 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi 12345 Oct 04 18:47:08.777633 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:47:08.777633 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:08.777633 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:47:08.777633 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:08.777633 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:08.777633 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:08.777633 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:47:08.777633 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:47:08.777633 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:47:08.777633 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:47:08.777633 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:47:08.777633 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:47:08.777633 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:47:08.777633 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:47:08.777633 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:47:08.777633 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:47:08.777633 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:47:08.782057 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:47:08.782057 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 04 18:47:08.782057 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:47:08.782057 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:08.782057 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:47:08.782057 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:08.782057 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:08.782057 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:08.782057 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:47:08.782057 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:47:08.782057 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 04 18:47:08.782057 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:47:08.782057 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-82dc23da-8109-427e-a5b1-f70068fba391 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:47:08.782057 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-82dc23da-8109-427e-a5b1-f70068fba391 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.015994 Oct 04 18:47:08.785687 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2145/4350] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:47:08 2022] POST /compute/v2.1/servers => generated 127 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 04 18:47:08.795847 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d26e0804-c340-409b-9db8-3389d2f66948 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:08.796735 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d26e0804-c340-409b-9db8-3389d2f66948 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:08.809287 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d26e0804-c340-409b-9db8-3389d2f66948 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:08.812270 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d26e0804-c340-409b-9db8-3389d2f66948 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:08.813263 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d26e0804-c340-409b-9db8-3389d2f66948 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:08.814332 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d26e0804-c340-409b-9db8-3389d2f66948 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:08.815113 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d26e0804-c340-409b-9db8-3389d2f66948 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:08.815850 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d26e0804-c340-409b-9db8-3389d2f66948 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:09.062834 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b4f75bd7-ccf0-4d35-8150-3efa8c7c753b tempest-VolumesSnapshotsTestJSON-1497841961 tempest-VolumesSnapshotsTestJSON-1497841961-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.493307 Oct 04 18:47:09.076529 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2206/4351] 10.222.0.20 () {60 vars in 1155 bytes} [Tue Oct 4 18:47:07 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 1507 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 04 18:47:09.086959 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d8bd7ed9-fb1f-4b3e-bfd3-7ea788884071 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:09.094760 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d8bd7ed9-fb1f-4b3e-bfd3-7ea788884071 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] [instance: 89ad7c7f-cba8-4fbe-8442-63a74c482c6b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:09.109160 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d8bd7ed9-fb1f-4b3e-bfd3-7ea788884071 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:09.109855 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d8bd7ed9-fb1f-4b3e-bfd3-7ea788884071 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:09.110611 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d8bd7ed9-fb1f-4b3e-bfd3-7ea788884071 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:09.114124 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d8bd7ed9-fb1f-4b3e-bfd3-7ea788884071 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:09.114805 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d8bd7ed9-fb1f-4b3e-bfd3-7ea788884071 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:09.117688 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d8bd7ed9-fb1f-4b3e-bfd3-7ea788884071 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:09.175654 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d26e0804-c340-409b-9db8-3389d2f66948 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:09.188963 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d26e0804-c340-409b-9db8-3389d2f66948 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1504 microversion: 2.1 time: 0.398728 Oct 04 18:47:09.189533 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2146/4352] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:08 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1504 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:47:09.202867 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4061945d-64fa-4af4-917f-b9c49acd8be8 tempest-VolumesSnapshotsTestJSON-1497841961 tempest-VolumesSnapshotsTestJSON-1497841961-project] Calling method '.version_select at 0x7fe253c84040>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:09.307461 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4061945d-64fa-4af4-917f-b9c49acd8be8 tempest-VolumesSnapshotsTestJSON-1497841961 tempest-VolumesSnapshotsTestJSON-1497841961-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/a57525c2-b2cd-46b3-a342-a357b5b312fd" status: 200 len: 345 microversion: 2.1 time: 0.107067 Oct 04 18:47:09.307461 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2147/4353] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Oct 4 18:47:09 2022] GET /compute/v2.1/os-volumes/a57525c2-b2cd-46b3-a342-a357b5b312fd => generated 345 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:47:09.307461 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4078cd66-f427-4d7d-b207-8170c3e3ee6f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:09.307461 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4078cd66-f427-4d7d-b207-8170c3e3ee6f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:09.323659 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4078cd66-f427-4d7d-b207-8170c3e3ee6f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:09.324357 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4078cd66-f427-4d7d-b207-8170c3e3ee6f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:09.325018 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4078cd66-f427-4d7d-b207-8170c3e3ee6f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:09.325754 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4078cd66-f427-4d7d-b207-8170c3e3ee6f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:09.326216 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4078cd66-f427-4d7d-b207-8170c3e3ee6f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:09.326646 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4078cd66-f427-4d7d-b207-8170c3e3ee6f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:09.574905 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4078cd66-f427-4d7d-b207-8170c3e3ee6f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:09.586711 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4078cd66-f427-4d7d-b207-8170c3e3ee6f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1504 microversion: 2.1 time: 0.286130 Oct 04 18:47:09.588584 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2148/4354] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:09 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1504 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:09.594392 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f11b07a2-45b6-4049-878e-501e0156c8a1 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:09.594946 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f11b07a2-45b6-4049-878e-501e0156c8a1 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: 60694294-78ff-49f7-9d07-bb5915eae69e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:09.619023 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f11b07a2-45b6-4049-878e-501e0156c8a1 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:09.619531 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f11b07a2-45b6-4049-878e-501e0156c8a1 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:09.619978 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f11b07a2-45b6-4049-878e-501e0156c8a1 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:09.620732 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f11b07a2-45b6-4049-878e-501e0156c8a1 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:09.621193 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f11b07a2-45b6-4049-878e-501e0156c8a1 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:09.621627 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f11b07a2-45b6-4049-878e-501e0156c8a1 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:09.671290 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d8bd7ed9-fb1f-4b3e-bfd3-7ea788884071 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cce9172582d4efd8fc31251d4bfe63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7917de0ff5be4d238981ea714d837fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:09.679911 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d8bd7ed9-fb1f-4b3e-bfd3-7ea788884071 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] 10.222.0.20 "GET /compute/v2.1/servers/89ad7c7f-cba8-4fbe-8442-63a74c482c6b" status: 200 len: 1332 microversion: 2.1 time: 0.601274 Oct 04 18:47:09.686849 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2207/4355] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:09 2022] GET /compute/v2.1/servers/89ad7c7f-cba8-4fbe-8442-63a74c482c6b => generated 1332 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:09.724131 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-246959c1-8f97-4f1a-abe3-c0544a1a21df req-09a7fe86-b160-411c-b0bd-f5811616c0f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89ad7c7f-cba8-4fbe-8442-63a74c482c6b", "tag": "48ca997a-f5b9-4dbe-8306-95ea1bef682b"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:09.745906 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-246959c1-8f97-4f1a-abe3-c0544a1a21df req-09a7fe86-b160-411c-b0bd-f5811616c0f2 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:09.746403 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-246959c1-8f97-4f1a-abe3-c0544a1a21df req-09a7fe86-b160-411c-b0bd-f5811616c0f2 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:09.746841 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-246959c1-8f97-4f1a-abe3-c0544a1a21df req-09a7fe86-b160-411c-b0bd-f5811616c0f2 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:09.799889 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-246959c1-8f97-4f1a-abe3-c0544a1a21df req-09a7fe86-b160-411c-b0bd-f5811616c0f2 service nova] Creating event network-changed:48ca997a-f5b9-4dbe-8306-95ea1bef682b for instance 89ad7c7f-cba8-4fbe-8442-63a74c482c6b on n-h2-850501-14 Oct 04 18:47:09.802567 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f11b07a2-45b6-4049-878e-501e0156c8a1 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:09.814106 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-246959c1-8f97-4f1a-abe3-c0544a1a21df req-09a7fe86-b160-411c-b0bd-f5811616c0f2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124234 Oct 04 18:47:09.814928 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2208/4356] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:47:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:47:09.818969 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f11b07a2-45b6-4049-878e-501e0156c8a1 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/60694294-78ff-49f7-9d07-bb5915eae69e" status: 200 len: 1270 microversion: 2.1 time: 0.229100 Oct 04 18:47:09.822788 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2149/4357] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:09 2022] GET /compute/v2.1/servers/60694294-78ff-49f7-9d07-bb5915eae69e => generated 1270 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:10.316301 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4077e8a4-19f3-461a-a3df-a0a7d5da1a9e tempest-VolumesSnapshotsTestJSON-1497841961 tempest-VolumesSnapshotsTestJSON-1497841961-project] Calling method '.version_select at 0x7fe258ca1700>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:10.419907 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-4077e8a4-19f3-461a-a3df-a0a7d5da1a9e tempest-VolumesSnapshotsTestJSON-1497841961 tempest-VolumesSnapshotsTestJSON-1497841961-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/a57525c2-b2cd-46b3-a342-a357b5b312fd" status: 200 len: 345 microversion: 2.1 time: 0.109641 Oct 04 18:47:10.427082 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2209/4358] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Oct 4 18:47:10 2022] GET /compute/v2.1/os-volumes/a57525c2-b2cd-46b3-a342-a357b5b312fd => generated 345 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:47:10.720931 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-03b77ff7-d440-4ef8-ba12-c731932dcfb5 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:10.721748 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-03b77ff7-d440-4ef8-ba12-c731932dcfb5 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] [instance: 89ad7c7f-cba8-4fbe-8442-63a74c482c6b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:10.746016 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-03b77ff7-d440-4ef8-ba12-c731932dcfb5 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:10.750888 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-03b77ff7-d440-4ef8-ba12-c731932dcfb5 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:10.752854 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-03b77ff7-d440-4ef8-ba12-c731932dcfb5 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:10.754128 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-03b77ff7-d440-4ef8-ba12-c731932dcfb5 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:10.768635 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-03b77ff7-d440-4ef8-ba12-c731932dcfb5 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:10.770256 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-03b77ff7-d440-4ef8-ba12-c731932dcfb5 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:10.852095 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-707cae81-ccf9-4a21-86f0-1b639b86b0c3 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:10.852869 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-707cae81-ccf9-4a21-86f0-1b639b86b0c3 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: 60694294-78ff-49f7-9d07-bb5915eae69e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:10.869992 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-707cae81-ccf9-4a21-86f0-1b639b86b0c3 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:10.870503 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-707cae81-ccf9-4a21-86f0-1b639b86b0c3 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:10.873999 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-707cae81-ccf9-4a21-86f0-1b639b86b0c3 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:10.874946 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-707cae81-ccf9-4a21-86f0-1b639b86b0c3 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:10.875564 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-707cae81-ccf9-4a21-86f0-1b639b86b0c3 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:10.883579 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-707cae81-ccf9-4a21-86f0-1b639b86b0c3 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:11.037417 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-707cae81-ccf9-4a21-86f0-1b639b86b0c3 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:11.051423 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-707cae81-ccf9-4a21-86f0-1b639b86b0c3 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/60694294-78ff-49f7-9d07-bb5915eae69e" status: 200 len: 1276 microversion: 2.1 time: 0.206910 Oct 04 18:47:11.057830 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2210/4359] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:10 2022] GET /compute/v2.1/servers/60694294-78ff-49f7-9d07-bb5915eae69e => generated 1276 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:11.268217 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-03b77ff7-d440-4ef8-ba12-c731932dcfb5 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cce9172582d4efd8fc31251d4bfe63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7917de0ff5be4d238981ea714d837fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:11.280930 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-03b77ff7-d440-4ef8-ba12-c731932dcfb5 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] 10.222.0.20 "GET /compute/v2.1/servers/89ad7c7f-cba8-4fbe-8442-63a74c482c6b" status: 200 len: 1332 microversion: 2.1 time: 0.573704 Oct 04 18:47:11.281410 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2150/4360] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:10 2022] GET /compute/v2.1/servers/89ad7c7f-cba8-4fbe-8442-63a74c482c6b => generated 1332 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:11.434283 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-21414f4d-6ce4-437d-bd51-08f3db552aa3 tempest-VolumesSnapshotsTestJSON-1497841961 tempest-VolumesSnapshotsTestJSON-1497841961-project] Calling method '.version_select at 0x7fe2590db9d0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:11.546427 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-21414f4d-6ce4-437d-bd51-08f3db552aa3 tempest-VolumesSnapshotsTestJSON-1497841961 tempest-VolumesSnapshotsTestJSON-1497841961-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/a57525c2-b2cd-46b3-a342-a357b5b312fd" status: 200 len: 346 microversion: 2.1 time: 0.115945 Oct 04 18:47:11.555576 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2211/4361] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Oct 4 18:47:11 2022] GET /compute/v2.1/os-volumes/a57525c2-b2cd-46b3-a342-a357b5b312fd => generated 346 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:47:11.562124 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-401b88d8-240d-4ffc-8903-72baaff43c55 tempest-VolumesSnapshotsTestJSON-1497841961 tempest-VolumesSnapshotsTestJSON-1497841961-project] Action: 'create', calling method: .version_select at 0x7fe253cf5b80>, body: {"snapshot": {"volume_id": "a57525c2-b2cd-46b3-a342-a357b5b312fd", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-567595078"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:12.083462 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a2896719-b57d-427c-94ea-29d9876f7443 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:12.084102 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a2896719-b57d-427c-94ea-29d9876f7443 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: 60694294-78ff-49f7-9d07-bb5915eae69e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:12.098246 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a2896719-b57d-427c-94ea-29d9876f7443 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:12.098764 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a2896719-b57d-427c-94ea-29d9876f7443 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:12.099209 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a2896719-b57d-427c-94ea-29d9876f7443 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:12.099929 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a2896719-b57d-427c-94ea-29d9876f7443 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:12.100466 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a2896719-b57d-427c-94ea-29d9876f7443 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:12.101018 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a2896719-b57d-427c-94ea-29d9876f7443 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:12.318421 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-401b88d8-240d-4ffc-8903-72baaff43c55 tempest-VolumesSnapshotsTestJSON-1497841961 tempest-VolumesSnapshotsTestJSON-1497841961-project] 10.222.0.20 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.760911 Oct 04 18:47:12.325204 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2151/4362] 10.222.0.20 () {60 vars in 1162 bytes} [Tue Oct 4 18:47:11 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:47:12.329993 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-80b1f7fc-8406-4aae-b2fa-c30836ce8769 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:12.330787 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-80b1f7fc-8406-4aae-b2fa-c30836ce8769 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] [instance: 89ad7c7f-cba8-4fbe-8442-63a74c482c6b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:12.349583 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-80b1f7fc-8406-4aae-b2fa-c30836ce8769 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:12.350080 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-80b1f7fc-8406-4aae-b2fa-c30836ce8769 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:12.350512 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-80b1f7fc-8406-4aae-b2fa-c30836ce8769 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:12.351320 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-80b1f7fc-8406-4aae-b2fa-c30836ce8769 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:12.351774 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-80b1f7fc-8406-4aae-b2fa-c30836ce8769 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:12.352311 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-80b1f7fc-8406-4aae-b2fa-c30836ce8769 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:12.593536 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a2896719-b57d-427c-94ea-29d9876f7443 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:12.632556 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a2896719-b57d-427c-94ea-29d9876f7443 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/60694294-78ff-49f7-9d07-bb5915eae69e" status: 200 len: 1276 microversion: 2.1 time: 0.552833 Oct 04 18:47:12.640664 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2212/4363] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:12 2022] GET /compute/v2.1/servers/60694294-78ff-49f7-9d07-bb5915eae69e => generated 1276 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:47:12.659140 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f0e9a0b8-bc7b-421c-aeba-f71e76d20d2f tempest-VolumesSnapshotsTestJSON-1497841961 tempest-VolumesSnapshotsTestJSON-1497841961-project] Calling method '.version_select at 0x7fe2580ce790>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:12.799905 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f0e9a0b8-bc7b-421c-aeba-f71e76d20d2f tempest-VolumesSnapshotsTestJSON-1497841961 tempest-VolumesSnapshotsTestJSON-1497841961-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/007eb3b1-d1f0-4736-880e-90b8f5827849" status: 200 len: 286 microversion: 2.1 time: 0.157867 Oct 04 18:47:12.800598 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2213/4364] 10.222.0.20 () {58 vars in 1251 bytes} [Tue Oct 4 18:47:12 2022] GET /compute/v2.1/os-snapshots/007eb3b1-d1f0-4736-880e-90b8f5827849 => generated 286 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:47:12.808155 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-80b1f7fc-8406-4aae-b2fa-c30836ce8769 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cce9172582d4efd8fc31251d4bfe63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7917de0ff5be4d238981ea714d837fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:12.816580 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-01a6a49d-0e87-444c-b422-9f57c4a9f9dd tempest-VolumesSnapshotsTestJSON-1497841961 tempest-VolumesSnapshotsTestJSON-1497841961-project] Calling method '.version_select at 0x7fe258c7aca0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:12.821127 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=100 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:47:12.831618 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-80b1f7fc-8406-4aae-b2fa-c30836ce8769 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] 10.222.0.20 "GET /compute/v2.1/servers/89ad7c7f-cba8-4fbe-8442-63a74c482c6b" status: 200 len: 1332 microversion: 2.1 time: 0.505210 Oct 04 18:47:12.837918 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2152/4365] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:12 2022] GET /compute/v2.1/servers/89ad7c7f-cba8-4fbe-8442-63a74c482c6b => generated 1332 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:12.949890 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-01a6a49d-0e87-444c-b422-9f57c4a9f9dd tempest-VolumesSnapshotsTestJSON-1497841961 tempest-VolumesSnapshotsTestJSON-1497841961-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.136868 Oct 04 18:47:12.951346 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2214/4366] 10.222.0.20 () {58 vars in 1140 bytes} [Tue Oct 4 18:47:12 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:47:12.966380 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f990b01b-9d02-4140-bff8-fb18251d9cef tempest-VolumesSnapshotsTestJSON-1497841961 tempest-VolumesSnapshotsTestJSON-1497841961-project] Calling method '.version_select at 0x7fe253d57af0>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:13.084805 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f990b01b-9d02-4140-bff8-fb18251d9cef tempest-VolumesSnapshotsTestJSON-1497841961 tempest-VolumesSnapshotsTestJSON-1497841961-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/007eb3b1-d1f0-4736-880e-90b8f5827849" status: 200 len: 286 microversion: 2.1 time: 0.126172 Oct 04 18:47:13.086468 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2153/4367] 10.222.0.20 () {58 vars in 1251 bytes} [Tue Oct 4 18:47:12 2022] GET /compute/v2.1/os-snapshots/007eb3b1-d1f0-4736-880e-90b8f5827849 => generated 286 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:47:13.668829 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-081f0aee-aedd-4965-b478-572f8ebb6f4c tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:13.670144 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-081f0aee-aedd-4965-b478-572f8ebb6f4c tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: 60694294-78ff-49f7-9d07-bb5915eae69e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:13.684767 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-081f0aee-aedd-4965-b478-572f8ebb6f4c tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:13.696602 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-081f0aee-aedd-4965-b478-572f8ebb6f4c tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:13.697269 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-081f0aee-aedd-4965-b478-572f8ebb6f4c tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:13.698237 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-081f0aee-aedd-4965-b478-572f8ebb6f4c tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:13.698896 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-081f0aee-aedd-4965-b478-572f8ebb6f4c tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:13.699514 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-081f0aee-aedd-4965-b478-572f8ebb6f4c tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:13.874965 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3ac58dba-a7e4-4448-8c86-91805d7334b9 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:13.880099 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3ac58dba-a7e4-4448-8c86-91805d7334b9 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] [instance: 89ad7c7f-cba8-4fbe-8442-63a74c482c6b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:13.922700 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3ac58dba-a7e4-4448-8c86-91805d7334b9 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:13.923216 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3ac58dba-a7e4-4448-8c86-91805d7334b9 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:13.923715 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3ac58dba-a7e4-4448-8c86-91805d7334b9 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:13.938676 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3ac58dba-a7e4-4448-8c86-91805d7334b9 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:13.939209 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3ac58dba-a7e4-4448-8c86-91805d7334b9 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:13.940824 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3ac58dba-a7e4-4448-8c86-91805d7334b9 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:14.796845 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-081f0aee-aedd-4965-b478-572f8ebb6f4c tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:14.807824 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-081f0aee-aedd-4965-b478-572f8ebb6f4c tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/60694294-78ff-49f7-9d07-bb5915eae69e" status: 200 len: 1318 microversion: 2.1 time: 1.145107 Oct 04 18:47:14.811257 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2215/4368] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:13 2022] GET /compute/v2.1/servers/60694294-78ff-49f7-9d07-bb5915eae69e => generated 1318 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:14.821999 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-631d179d-d351-4653-9094-7556e990212a tempest-VolumesSnapshotsTestJSON-1497841961 tempest-VolumesSnapshotsTestJSON-1497841961-project] Calling method '.version_select at 0x7fe258c7adc0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:14.884522 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-631d179d-d351-4653-9094-7556e990212a tempest-VolumesSnapshotsTestJSON-1497841961 tempest-VolumesSnapshotsTestJSON-1497841961-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/007eb3b1-d1f0-4736-880e-90b8f5827849" status: 200 len: 286 microversion: 2.1 time: 0.070475 Oct 04 18:47:14.885287 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2216/4369] 10.222.0.20 () {58 vars in 1251 bytes} [Tue Oct 4 18:47:14 2022] GET /compute/v2.1/os-snapshots/007eb3b1-d1f0-4736-880e-90b8f5827849 => generated 286 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:47:14.891415 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c2db718d-a967-49b3-9bfe-4b7f0557007a tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1137106238", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "4adbc183-9717-4f26-9d5f-d67e6323b821", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "334d1b7e-7632-43fb-8807-6117cf357d4f"}]}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:14.972104 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3ac58dba-a7e4-4448-8c86-91805d7334b9 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cce9172582d4efd8fc31251d4bfe63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7917de0ff5be4d238981ea714d837fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:14.983737 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3ac58dba-a7e4-4448-8c86-91805d7334b9 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] 10.222.0.20 "GET /compute/v2.1/servers/89ad7c7f-cba8-4fbe-8442-63a74c482c6b" status: 200 len: 1332 microversion: 2.1 time: 1.123190 Oct 04 18:47:15.005871 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2154/4370] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:13 2022] GET /compute/v2.1/servers/89ad7c7f-cba8-4fbe-8442-63a74c482c6b => generated 1332 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:15.042838 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-c2db718d-a967-49b3-9bfe-4b7f0557007a tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] HTTP exception thrown: Block Device 4adbc183-9717-4f26-9d5f-d67e6323b821 is not bootable. Oct 04 18:47:15.057832 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c2db718d-a967-49b3-9bfe-4b7f0557007a tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Request method failure captured: Oct 04 18:47:15.057832 n-d-850501-14 devstack@n-api.service[123001]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:47:15.057832 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:47:15.057832 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:47:15.057832 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:47:15.057832 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 358 Oct 04 18:47:15.057832 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:47:15.057832 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:47:15.057832 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:47:15.057832 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:47:15.057832 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPH9zAVdj2h4kh6QqBpYrS2CJMhbcXf529VUNrZoZOYhS2tkLYBgw6AHy860DK9jQ3xATqZvC9lQuxt-_H5qKsAI41eznf32K6QSGqVcHXegpVHrDueww23ZMVCBM3D_hH0NTzh4447rgHqcrC-OZE48IfZrRJ9KPLPjAHT57T3mcPIc Oct 04 18:47:15.057832 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:47:15.057832 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:47:15.057832 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:47:15.057832 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:47:15.057832 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:47:15.057832 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:47:15.057832 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: b6c6b9deecde44b5953d22b38b5b0ff1 Oct 04 18:47:15.057832 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:47:15.057832 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:47:15.057832 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:47:15.057832 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6c6b9deecde44b5953d22b38b5b0ff1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b6c6b9deecde44b5953d22b38b5b0ff1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b6c6b9deecde44b5953d22b38b5b0ff1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6c6b9deecde44b5953d22b38b5b0ff1"}]}] Oct 04 18:47:15.057832 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:47:15.057832 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: b6c6b9deecde44b5953d22b38b5b0ff1 Oct 04 18:47:15.057832 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:47:15.057832 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ServersNegativeTestJSON-626077540-project Oct 04 18:47:15.057832 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:47:15.057832 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:47:15.057832 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 5b4eb70f22ba4872b890a4f160cc1805 Oct 04 18:47:15.057832 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ServersNegativeTestJSON-626077540-project Oct 04 18:47:15.057832 n-d-850501-14 devstack@n-api.service[123001]: Oct 04 18:47:15.057832 n-d-850501-14 devstack@n-api.service[123001]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1137106238", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "4adbc183-9717-4f26-9d5f-d67e6323b821", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "334d1b7e-7632-43fb-8807-6117cf357d4f"}]}} Oct 04 18:47:15.057832 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:47:15.057832 n-d-850501-14 devstack@n-api.service[123001]: exception: Block Device 4adbc183-9717-4f26-9d5f-d67e6323b821 is not bootable. Oct 04 18:47:15.057832 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1137106238', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '4adbc183-9717-4f26-9d5f-d67e6323b821'}], 'networks': [{'uuid': '334d1b7e-7632-43fb-8807-6117cf357d4f'}]}}} Oct 04 18:47:15.057832 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:47:15.057832 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:15.057832 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 18:47:15.057832 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 18:47:15.057832 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 18:47:15.057832 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 18:47:15.057832 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Oct 04 18:47:15.057832 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Oct 04 18:47:15.057832 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Oct 04 18:47:15.057832 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Oct 04 18:47:15.057832 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 4adbc183-9717-4f26-9d5f-d67e6323b821 is not bootable. Oct 04 18:47:15.057832 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:47:15.057832 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:15.057832 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:47:15.057832 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:15.057832 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:15.057832 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:15.057832 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:47:15.057832 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:47:15.057832 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:47:15.057832 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:47:15.057832 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:47:15.057832 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:47:15.057832 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:47:15.067461 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:47:15.067461 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:47:15.067461 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:47:15.067461 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 18:47:15.067461 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 04 18:47:15.067461 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 04 18:47:15.067461 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 4adbc183-9717-4f26-9d5f-d67e6323b821 is not bootable. Oct 04 18:47:15.067461 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:47:15.067461 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:15.067461 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:47:15.067461 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:15.067461 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:15.067461 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:15.067461 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:47:15.067461 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:47:15.067461 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 4adbc183-9717-4f26-9d5f-d67e6323b821 is not bootable. Oct 04 18:47:15.067461 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:47:15.067461 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c2db718d-a967-49b3-9bfe-4b7f0557007a tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Returning 400 to user: Block Device 4adbc183-9717-4f26-9d5f-d67e6323b821 is not bootable. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:47:15.067461 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c2db718d-a967-49b3-9bfe-4b7f0557007a tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.173156 Oct 04 18:47:15.067461 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2217/4371] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:47:14 2022] POST /compute/v2.1/servers => generated 110 bytes in 174 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:47:15.069534 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d8beca81-18ee-46ec-82f6-aa07cef801ea tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:15.071444 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d8beca81-18ee-46ec-82f6-aa07cef801ea tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:15.078660 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d8beca81-18ee-46ec-82f6-aa07cef801ea tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:15.083661 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d8beca81-18ee-46ec-82f6-aa07cef801ea tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:15.086403 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d8beca81-18ee-46ec-82f6-aa07cef801ea tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:15.087293 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d8beca81-18ee-46ec-82f6-aa07cef801ea tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:15.088539 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d8beca81-18ee-46ec-82f6-aa07cef801ea tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:15.089751 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d8beca81-18ee-46ec-82f6-aa07cef801ea tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:15.708697 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d8beca81-18ee-46ec-82f6-aa07cef801ea tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:15.721782 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d8beca81-18ee-46ec-82f6-aa07cef801ea tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1504 microversion: 2.1 time: 0.655664 Oct 04 18:47:15.725558 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2155/4372] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:15 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1504 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:15.760209 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-372f44be-9409-4cf9-813e-906f6e95e85b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:15.760756 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-372f44be-9409-4cf9-813e-906f6e95e85b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:15.768701 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-372f44be-9409-4cf9-813e-906f6e95e85b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:15.769192 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-372f44be-9409-4cf9-813e-906f6e95e85b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:15.769627 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-372f44be-9409-4cf9-813e-906f6e95e85b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:15.770335 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-372f44be-9409-4cf9-813e-906f6e95e85b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:15.770799 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-372f44be-9409-4cf9-813e-906f6e95e85b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:15.771215 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-372f44be-9409-4cf9-813e-906f6e95e85b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:15.842371 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3fa9cd3a-a256-4a82-a055-cf04746b5ed2 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:15.842371 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3fa9cd3a-a256-4a82-a055-cf04746b5ed2 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: 60694294-78ff-49f7-9d07-bb5915eae69e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:15.857509 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3fa9cd3a-a256-4a82-a055-cf04746b5ed2 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:15.858459 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3fa9cd3a-a256-4a82-a055-cf04746b5ed2 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:15.859146 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3fa9cd3a-a256-4a82-a055-cf04746b5ed2 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:15.860034 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3fa9cd3a-a256-4a82-a055-cf04746b5ed2 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:15.860943 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3fa9cd3a-a256-4a82-a055-cf04746b5ed2 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:15.861303 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3fa9cd3a-a256-4a82-a055-cf04746b5ed2 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:16.089480 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=4 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:47:16.144514 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-372f44be-9409-4cf9-813e-906f6e95e85b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:16.162016 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-372f44be-9409-4cf9-813e-906f6e95e85b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1504 microversion: 2.1 time: 0.407466 Oct 04 18:47:16.165392 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2218/4373] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:15 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1504 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:16.173820 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3fa9cd3a-a256-4a82-a055-cf04746b5ed2 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:16.186299 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3fa9cd3a-a256-4a82-a055-cf04746b5ed2 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/60694294-78ff-49f7-9d07-bb5915eae69e" status: 200 len: 1318 microversion: 2.1 time: 0.351017 Oct 04 18:47:16.188040 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-79ce2c1b-98b7-4a35-a04f-b7cffc86307d tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Action: 'create', calling method: .version_select at 0x7fe253d8fc10>, body: {"keypair": {"name": "tempest-keypair-1491919207", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBkm9KpLA/0bgGo3ixPPPmCqvRBebpVNeJAYHoJqW/DtRjuqY8xKZcDcVkrN2mKpAIQqilrWnlr7W1mHLm0HWPjc9X5drpeN/OWOEKea0C5KsQAMr6aR1ODlt2Gidm5HQg=="}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:16.188564 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2156/4374] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:15 2022] GET /compute/v2.1/servers/60694294-78ff-49f7-9d07-bb5915eae69e => generated 1318 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:47:16.195069 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9804b513-26cc-45ae-ae68-eed0eb879e5c tempest-VolumesSnapshotsTestJSON-1497841961 tempest-VolumesSnapshotsTestJSON-1497841961-project] Calling method '.version_select at 0x7fe253d7f700>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:16.231579 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-79ce2c1b-98b7-4a35-a04f-b7cffc86307d tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Getting quotas for project 7bc171af3b14473983188dbd7fb01227. Resources: {'key_pairs'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:47:16.244269 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-79ce2c1b-98b7-4a35-a04f-b7cffc86307d tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Getting quotas for user a18012de566645afb138207e20fb4cf0 and project 7bc171af3b14473983188dbd7fb01227. Resources: {'key_pairs'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:47:16.246186 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9804b513-26cc-45ae-ae68-eed0eb879e5c tempest-VolumesSnapshotsTestJSON-1497841961 tempest-VolumesSnapshotsTestJSON-1497841961-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/007eb3b1-d1f0-4736-880e-90b8f5827849" status: 200 len: 287 microversion: 2.1 time: 0.056453 Oct 04 18:47:16.246931 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2157/4375] 10.222.0.20 () {58 vars in 1251 bytes} [Tue Oct 4 18:47:16 2022] GET /compute/v2.1/os-snapshots/007eb3b1-d1f0-4736-880e-90b8f5827849 => generated 287 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:47:16.252470 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-d6731c7c-8398-49bb-b122-e8ab1a7646d5 req-e3faae0f-f40f-4d2b-87ce-502595fbb23e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60694294-78ff-49f7-9d07-bb5915eae69e", "tag": "6ded5837-6eb6-4f11-b5bf-4145870ee7b8"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:16.275759 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-d6731c7c-8398-49bb-b122-e8ab1a7646d5 req-e3faae0f-f40f-4d2b-87ce-502595fbb23e service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:16.276968 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-d6731c7c-8398-49bb-b122-e8ab1a7646d5 req-e3faae0f-f40f-4d2b-87ce-502595fbb23e service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:16.277548 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-d6731c7c-8398-49bb-b122-e8ab1a7646d5 req-e3faae0f-f40f-4d2b-87ce-502595fbb23e service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:16.295017 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-d6731c7c-8398-49bb-b122-e8ab1a7646d5 req-e3faae0f-f40f-4d2b-87ce-502595fbb23e service nova] Creating event network-changed:6ded5837-6eb6-4f11-b5bf-4145870ee7b8 for instance 60694294-78ff-49f7-9d07-bb5915eae69e on n-h1-850501-14 Oct 04 18:47:16.301265 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-d6731c7c-8398-49bb-b122-e8ab1a7646d5 req-e3faae0f-f40f-4d2b-87ce-502595fbb23e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052733 Oct 04 18:47:16.302220 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2158/4376] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:47:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:47:16.310045 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8b6a7d90-1d11-47d8-97c0-6f2df82736c8 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:16.312206 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8b6a7d90-1d11-47d8-97c0-6f2df82736c8 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] [instance: 89ad7c7f-cba8-4fbe-8442-63a74c482c6b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:16.320755 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8b6a7d90-1d11-47d8-97c0-6f2df82736c8 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:16.321889 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8b6a7d90-1d11-47d8-97c0-6f2df82736c8 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:16.322539 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8b6a7d90-1d11-47d8-97c0-6f2df82736c8 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:16.340257 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8b6a7d90-1d11-47d8-97c0-6f2df82736c8 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:16.340257 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8b6a7d90-1d11-47d8-97c0-6f2df82736c8 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:16.340257 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8b6a7d90-1d11-47d8-97c0-6f2df82736c8 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:16.369836 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-79ce2c1b-98b7-4a35-a04f-b7cffc86307d tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.203052 Oct 04 18:47:16.371416 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2219/4377] 10.222.0.20 () {62 vars in 1200 bytes} [Tue Oct 4 18:47:16 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 205 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 18:47:16.376867 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-30a7d08c-ee33-4748-a1fa-cfa339bfc8c6 tempest-VolumesSnapshotsTestJSON-1497841961 tempest-VolumesSnapshotsTestJSON-1497841961-project] Calling method '.version_select at 0x7fe253cc8820>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:16.547301 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-30a7d08c-ee33-4748-a1fa-cfa339bfc8c6 tempest-VolumesSnapshotsTestJSON-1497841961 tempest-VolumesSnapshotsTestJSON-1497841961-project] 10.222.0.20 "DELETE /compute/v2.1/os-snapshots/007eb3b1-d1f0-4736-880e-90b8f5827849" status: 202 len: 0 microversion: 2.1 time: 0.174295 Oct 04 18:47:16.550920 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2220/4378] 10.222.0.20 () {58 vars in 1254 bytes} [Tue Oct 4 18:47:16 2022] DELETE /compute/v2.1/os-snapshots/007eb3b1-d1f0-4736-880e-90b8f5827849 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:47:16.556552 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-35cd7d5e-1067-45db-b99c-df5311242e38 tempest-VolumesSnapshotsTestJSON-1497841961 tempest-VolumesSnapshotsTestJSON-1497841961-project] Calling method '.version_select at 0x7fe258c6cc10>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:16.604581 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-35cd7d5e-1067-45db-b99c-df5311242e38 tempest-VolumesSnapshotsTestJSON-1497841961 tempest-VolumesSnapshotsTestJSON-1497841961-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/007eb3b1-d1f0-4736-880e-90b8f5827849" status: 200 len: 286 microversion: 2.1 time: 0.052092 Oct 04 18:47:16.605665 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2221/4379] 10.222.0.20 () {58 vars in 1251 bytes} [Tue Oct 4 18:47:16 2022] GET /compute/v2.1/os-snapshots/007eb3b1-d1f0-4736-880e-90b8f5827849 => generated 286 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:47:16.654300 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8b6a7d90-1d11-47d8-97c0-6f2df82736c8 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cce9172582d4efd8fc31251d4bfe63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7917de0ff5be4d238981ea714d837fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:16.675469 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8b6a7d90-1d11-47d8-97c0-6f2df82736c8 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] 10.222.0.20 "GET /compute/v2.1/servers/89ad7c7f-cba8-4fbe-8442-63a74c482c6b" status: 200 len: 1332 microversion: 2.1 time: 0.371539 Oct 04 18:47:16.676587 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2159/4380] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:16 2022] GET /compute/v2.1/servers/89ad7c7f-cba8-4fbe-8442-63a74c482c6b => generated 1332 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:17.214690 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-80f4a128-3765-4ed4-a8c6-bbd3377ac2fd tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:17.215585 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-80f4a128-3765-4ed4-a8c6-bbd3377ac2fd tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: 60694294-78ff-49f7-9d07-bb5915eae69e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:17.235598 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-80f4a128-3765-4ed4-a8c6-bbd3377ac2fd tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:17.238373 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-80f4a128-3765-4ed4-a8c6-bbd3377ac2fd tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:17.242755 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-80f4a128-3765-4ed4-a8c6-bbd3377ac2fd tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:17.242755 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-80f4a128-3765-4ed4-a8c6-bbd3377ac2fd tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:17.242755 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-80f4a128-3765-4ed4-a8c6-bbd3377ac2fd tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:17.242755 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-80f4a128-3765-4ed4-a8c6-bbd3377ac2fd tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:17.532209 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-80f4a128-3765-4ed4-a8c6-bbd3377ac2fd tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:17.543035 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-80f4a128-3765-4ed4-a8c6-bbd3377ac2fd tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/60694294-78ff-49f7-9d07-bb5915eae69e" status: 200 len: 1318 microversion: 2.1 time: 0.332883 Oct 04 18:47:17.563863 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2222/4381] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:17 2022] GET /compute/v2.1/servers/60694294-78ff-49f7-9d07-bb5915eae69e => generated 1318 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:17.626748 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b724c228-8407-40a5-b538-45f6442ba191 tempest-VolumesSnapshotsTestJSON-1497841961 tempest-VolumesSnapshotsTestJSON-1497841961-project] Calling method '.version_select at 0x7fe253c920d0>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:17.701800 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b724c228-8407-40a5-b538-45f6442ba191 tempest-VolumesSnapshotsTestJSON-1497841961 tempest-VolumesSnapshotsTestJSON-1497841961-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/007eb3b1-d1f0-4736-880e-90b8f5827849" status: 200 len: 286 microversion: 2.1 time: 0.085974 Oct 04 18:47:17.703352 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2160/4382] 10.222.0.20 () {58 vars in 1251 bytes} [Tue Oct 4 18:47:17 2022] GET /compute/v2.1/os-snapshots/007eb3b1-d1f0-4736-880e-90b8f5827849 => generated 286 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:47:17.705875 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7c62f6d2-14e0-4783-ab23-ae07a156c471 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:17.706638 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7c62f6d2-14e0-4783-ab23-ae07a156c471 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] [instance: 89ad7c7f-cba8-4fbe-8442-63a74c482c6b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:17.733250 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7c62f6d2-14e0-4783-ab23-ae07a156c471 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:17.734105 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7c62f6d2-14e0-4783-ab23-ae07a156c471 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:17.736603 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7c62f6d2-14e0-4783-ab23-ae07a156c471 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:17.737802 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7c62f6d2-14e0-4783-ab23-ae07a156c471 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:17.738419 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7c62f6d2-14e0-4783-ab23-ae07a156c471 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:17.739020 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7c62f6d2-14e0-4783-ab23-ae07a156c471 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:18.063090 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7c62f6d2-14e0-4783-ab23-ae07a156c471 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cce9172582d4efd8fc31251d4bfe63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7917de0ff5be4d238981ea714d837fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:18.065540 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:47:18.080488 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7c62f6d2-14e0-4783-ab23-ae07a156c471 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] 10.222.0.20 "GET /compute/v2.1/servers/89ad7c7f-cba8-4fbe-8442-63a74c482c6b" status: 200 len: 1332 microversion: 2.1 time: 0.383728 Oct 04 18:47:18.084133 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2223/4383] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:17 2022] GET /compute/v2.1/servers/89ad7c7f-cba8-4fbe-8442-63a74c482c6b => generated 1332 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:18.571310 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d30bc974-0123-4eea-accb-4f7d404f1197 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:18.571623 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d30bc974-0123-4eea-accb-4f7d404f1197 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: 60694294-78ff-49f7-9d07-bb5915eae69e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:18.586196 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=16 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:47:18.587023 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=6 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:47:18.588495 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d30bc974-0123-4eea-accb-4f7d404f1197 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:18.588990 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d30bc974-0123-4eea-accb-4f7d404f1197 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:18.593128 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d30bc974-0123-4eea-accb-4f7d404f1197 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:18.594739 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d30bc974-0123-4eea-accb-4f7d404f1197 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:18.595247 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d30bc974-0123-4eea-accb-4f7d404f1197 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:18.595782 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d30bc974-0123-4eea-accb-4f7d404f1197 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:18.729569 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8cf55e72-958e-4ab6-aca5-36d1e2c606f6 tempest-VolumesSnapshotsTestJSON-1497841961 tempest-VolumesSnapshotsTestJSON-1497841961-project] Calling method '.version_select at 0x7fe258e20af0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:18.855878 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8cf55e72-958e-4ab6-aca5-36d1e2c606f6 tempest-VolumesSnapshotsTestJSON-1497841961 tempest-VolumesSnapshotsTestJSON-1497841961-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/007eb3b1-d1f0-4736-880e-90b8f5827849" status: 200 len: 286 microversion: 2.1 time: 0.143396 Oct 04 18:47:18.857399 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2224/4384] 10.222.0.20 () {58 vars in 1251 bytes} [Tue Oct 4 18:47:18 2022] GET /compute/v2.1/os-snapshots/007eb3b1-d1f0-4736-880e-90b8f5827849 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:47:19.088554 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-13ebce34-c1b7-4807-936f-51928a5265bc req-af2ed9c8-c245-42ec-8e5d-da198c718344 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89ad7c7f-cba8-4fbe-8442-63a74c482c6b", "name": "network-vif-plugged", "status": "completed", "tag": "48ca997a-f5b9-4dbe-8306-95ea1bef682b"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:19.141283 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-13ebce34-c1b7-4807-936f-51928a5265bc req-af2ed9c8-c245-42ec-8e5d-da198c718344 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:19.141817 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-13ebce34-c1b7-4807-936f-51928a5265bc req-af2ed9c8-c245-42ec-8e5d-da198c718344 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:19.142382 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-13ebce34-c1b7-4807-936f-51928a5265bc req-af2ed9c8-c245-42ec-8e5d-da198c718344 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:19.188998 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d30bc974-0123-4eea-accb-4f7d404f1197 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:19.196906 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-13ebce34-c1b7-4807-936f-51928a5265bc req-af2ed9c8-c245-42ec-8e5d-da198c718344 service nova] Creating event network-vif-plugged:48ca997a-f5b9-4dbe-8306-95ea1bef682b for instance 89ad7c7f-cba8-4fbe-8442-63a74c482c6b on n-h2-850501-14 Oct 04 18:47:19.201561 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d30bc974-0123-4eea-accb-4f7d404f1197 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/60694294-78ff-49f7-9d07-bb5915eae69e" status: 200 len: 1318 microversion: 2.1 time: 0.635727 Oct 04 18:47:19.202227 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2161/4385] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:18 2022] GET /compute/v2.1/servers/60694294-78ff-49f7-9d07-bb5915eae69e => generated 1318 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:19.211869 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-13ebce34-c1b7-4807-936f-51928a5265bc req-af2ed9c8-c245-42ec-8e5d-da198c718344 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131887 Oct 04 18:47:19.212540 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2225/4386] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:47:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:47:19.232371 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3f8187b9-6605-4fea-8183-8e122a58c98b tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:19.233000 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3f8187b9-6605-4fea-8183-8e122a58c98b tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] [instance: 89ad7c7f-cba8-4fbe-8442-63a74c482c6b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:19.248556 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f8187b9-6605-4fea-8183-8e122a58c98b tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:19.248556 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f8187b9-6605-4fea-8183-8e122a58c98b tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:19.250276 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f8187b9-6605-4fea-8183-8e122a58c98b tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:19.254765 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f8187b9-6605-4fea-8183-8e122a58c98b tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:19.255533 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f8187b9-6605-4fea-8183-8e122a58c98b tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:19.257430 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f8187b9-6605-4fea-8183-8e122a58c98b tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:19.624445 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3f8187b9-6605-4fea-8183-8e122a58c98b tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cce9172582d4efd8fc31251d4bfe63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7917de0ff5be4d238981ea714d837fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:19.634588 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3f8187b9-6605-4fea-8183-8e122a58c98b tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] 10.222.0.20 "GET /compute/v2.1/servers/89ad7c7f-cba8-4fbe-8442-63a74c482c6b" status: 200 len: 1332 microversion: 2.1 time: 0.412021 Oct 04 18:47:19.638509 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2162/4387] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:19 2022] GET /compute/v2.1/servers/89ad7c7f-cba8-4fbe-8442-63a74c482c6b => generated 1332 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:19.872949 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ddc76b67-7121-4310-b437-441803c162ca tempest-VolumesSnapshotsTestJSON-1497841961 tempest-VolumesSnapshotsTestJSON-1497841961-project] Calling method '.version_select at 0x7fe2580ce670>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:19.924319 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-ddc76b67-7121-4310-b437-441803c162ca tempest-VolumesSnapshotsTestJSON-1497841961 tempest-VolumesSnapshotsTestJSON-1497841961-project] HTTP exception thrown: Snapshot 007eb3b1-d1f0-4736-880e-90b8f5827849 could not be found. Oct 04 18:47:19.931028 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ddc76b67-7121-4310-b437-441803c162ca tempest-VolumesSnapshotsTestJSON-1497841961 tempest-VolumesSnapshotsTestJSON-1497841961-project] Request method failure captured: Oct 04 18:47:19.931028 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/os-snapshots/007eb3b1-d1f0-4736-880e-90b8f5827849 HTTP/1.1 Oct 04 18:47:19.931028 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:47:19.931028 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:47:19.931028 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:47:19.931028 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:47:19.931028 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:47:19.931028 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:47:19.931028 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:47:19.931028 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:47:19.931028 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPH-rhtGIi882q12U85eDyk0AsHmL1tLPvaETAYQUqciMWVXc0miwQ_NF-Q9UKcB-f1EGV9SCZQKIC0UdadkWgnDmo_BsVbgHPErWrO8WYAQiRR5Sif8wv-K8oVTB5ZrWVfY-KmWwGAxLQ1Jg0IB0IaqlyH9j61--LKRVRPTQlI5MPYw Oct 04 18:47:19.931028 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:47:19.931028 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:47:19.931028 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:47:19.931028 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:47:19.931028 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:47:19.931028 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:47:19.931028 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 0ebeabd56c3b47159e9f5e98aaccccaa Oct 04 18:47:19.931028 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1497841961 Oct 04 18:47:19.931028 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:47:19.931028 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:47:19.931028 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0ebeabd56c3b47159e9f5e98aaccccaa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0ebeabd56c3b47159e9f5e98aaccccaa", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0ebeabd56c3b47159e9f5e98aaccccaa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0ebeabd56c3b47159e9f5e98aaccccaa"}]}] Oct 04 18:47:19.931028 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1497841961 Oct 04 18:47:19.931028 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 0ebeabd56c3b47159e9f5e98aaccccaa Oct 04 18:47:19.931028 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1497841961 Oct 04 18:47:19.931028 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-VolumesSnapshotsTestJSON-1497841961-project Oct 04 18:47:19.931028 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:47:19.931028 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:47:19.931028 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 4361e90ed75c4029a55dbd8b037c9b1a Oct 04 18:47:19.931028 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1497841961-project Oct 04 18:47:19.931028 n-d-850501-14 devstack@n-api.service[123001]: method: Oct 04 18:47:19.931028 n-d-850501-14 devstack@n-api.service[123001]: exception: Snapshot 007eb3b1-d1f0-4736-880e-90b8f5827849 could not be found. Oct 04 18:47:19.931028 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '007eb3b1-d1f0-4736-880e-90b8f5827849'} Oct 04 18:47:19.931028 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:47:19.931028 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:19.931028 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 04 18:47:19.931028 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 04 18:47:19.931028 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 04 18:47:19.931028 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 04 18:47:19.931028 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 04 18:47:19.931028 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 04 18:47:19.931028 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 18:47:19.931028 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 18:47:19.931028 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 18:47:19.931028 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 18:47:19.931028 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:47:19.931028 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:47:19.931028 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:47:19.931028 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:47:19.931028 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 007eb3b1-d1f0-4736-880e-90b8f5827849 could not be found. (HTTP 404) (Request-ID: req-52ef04ca-b184-4af6-a1a9-e171beeea9d0) Oct 04 18:47:19.931028 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:47:19.931028 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:19.931028 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:47:19.931028 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:19.931028 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 04 18:47:19.931028 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 04 18:47:19.931028 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 18:47:19.931028 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 18:47:19.931028 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 04 18:47:19.931028 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 04 18:47:19.931028 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 18:47:19.931028 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 18:47:19.935081 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 04 18:47:19.935081 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 04 18:47:19.935081 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 04 18:47:19.935081 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 04 18:47:19.935081 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 04 18:47:19.935081 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 04 18:47:19.935081 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 18:47:19.935081 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 18:47:19.935081 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 18:47:19.935081 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 18:47:19.935081 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:47:19.935081 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:47:19.935081 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:47:19.935081 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:47:19.935081 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 007eb3b1-d1f0-4736-880e-90b8f5827849 could not be found. Oct 04 18:47:19.935081 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:47:19.935081 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:19.935081 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:47:19.935081 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:19.935081 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:19.935081 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:19.935081 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:47:19.935081 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:47:19.935081 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:47:19.935081 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:47:19.935081 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:47:19.935081 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:47:19.935081 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 04 18:47:19.935081 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:47:19.935081 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 007eb3b1-d1f0-4736-880e-90b8f5827849 could not be found. Oct 04 18:47:19.935081 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:47:19.935081 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:19.935081 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:47:19.935081 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:19.935081 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:19.935081 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:19.935081 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:47:19.935081 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:47:19.935081 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 007eb3b1-d1f0-4736-880e-90b8f5827849 could not be found. Oct 04 18:47:19.935081 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:47:19.935081 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ddc76b67-7121-4310-b437-441803c162ca tempest-VolumesSnapshotsTestJSON-1497841961 tempest-VolumesSnapshotsTestJSON-1497841961-project] Returning 404 to user: Snapshot 007eb3b1-d1f0-4736-880e-90b8f5827849 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:47:19.935081 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ddc76b67-7121-4310-b437-441803c162ca tempest-VolumesSnapshotsTestJSON-1497841961 tempest-VolumesSnapshotsTestJSON-1497841961-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/007eb3b1-d1f0-4736-880e-90b8f5827849" status: 404 len: 111 microversion: 2.1 time: 0.067218 Oct 04 18:47:19.935081 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2226/4388] 10.222.0.20 () {58 vars in 1251 bytes} [Tue Oct 4 18:47:19 2022] GET /compute/v2.1/os-snapshots/007eb3b1-d1f0-4736-880e-90b8f5827849 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:47:19.943915 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-22df9123-8d46-4031-978f-be620423eebc tempest-VolumesSnapshotsTestJSON-1497841961 tempest-VolumesSnapshotsTestJSON-1497841961-project] Calling method '.version_select at 0x7fe253d200d0>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:20.235743 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4ff6da63-fcdc-45c5-852e-5977c2165103 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:20.236980 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-4ff6da63-fcdc-45c5-852e-5977c2165103 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: 60694294-78ff-49f7-9d07-bb5915eae69e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:20.248560 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4ff6da63-fcdc-45c5-852e-5977c2165103 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:20.252524 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4ff6da63-fcdc-45c5-852e-5977c2165103 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:20.252524 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4ff6da63-fcdc-45c5-852e-5977c2165103 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:20.252524 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4ff6da63-fcdc-45c5-852e-5977c2165103 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:20.252524 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4ff6da63-fcdc-45c5-852e-5977c2165103 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:20.252524 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4ff6da63-fcdc-45c5-852e-5977c2165103 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:20.262888 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-22df9123-8d46-4031-978f-be620423eebc tempest-VolumesSnapshotsTestJSON-1497841961 tempest-VolumesSnapshotsTestJSON-1497841961-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/a57525c2-b2cd-46b3-a342-a357b5b312fd" status: 202 len: 0 microversion: 2.1 time: 0.323204 Oct 04 18:47:20.263732 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2163/4389] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Oct 4 18:47:19 2022] DELETE /compute/v2.1/os-volumes/a57525c2-b2cd-46b3-a342-a357b5b312fd => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:47:20.272778 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-516c7619-1650-492a-aa32-2fa0d98874ad tempest-VolumesSnapshotsTestJSON-1497841961 tempest-VolumesSnapshotsTestJSON-1497841961-project] Calling method '.version_select at 0x7fe253c92940>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:20.457733 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-516c7619-1650-492a-aa32-2fa0d98874ad tempest-VolumesSnapshotsTestJSON-1497841961 tempest-VolumesSnapshotsTestJSON-1497841961-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/a57525c2-b2cd-46b3-a342-a357b5b312fd" status: 200 len: 345 microversion: 2.1 time: 0.189190 Oct 04 18:47:20.465366 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2164/4390] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Oct 4 18:47:20 2022] GET /compute/v2.1/os-volumes/a57525c2-b2cd-46b3-a342-a357b5b312fd => generated 345 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:47:20.485829 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0e25434e-a0f7-4342-9174-4d6060b1f6c0 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2010216262", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "f545e662-10b3-46b1-88bb-6e66dd294559", "destination_type": "local"}, {"source_type": "volume", "uuid": "efa2d4d5-d9cd-4228-94da-07f1540c7e04", "destination_type": "invalid"}], "networks": [{"uuid": "334d1b7e-7632-43fb-8807-6117cf357d4f"}]}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:20.493363 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0e25434e-a0f7-4342-9174-4d6060b1f6c0 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Request method failure captured: Oct 04 18:47:20.493363 n-d-850501-14 devstack@n-api.service[123002]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:47:20.493363 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:47:20.493363 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:47:20.493363 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:47:20.493363 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 495 Oct 04 18:47:20.493363 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:47:20.493363 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:47:20.493363 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:47:20.493363 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:47:20.493363 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH9zAVdj2h4kh6QqBpYrS2CJMhbcXf529VUNrZoZOYhS2tkLYBgw6AHy860DK9jQ3xATqZvC9lQuxt-_H5qKsAI41eznf32K6QSGqVcHXegpVHrDueww23ZMVCBM3D_hH0NTzh4447rgHqcrC-OZE48IfZrRJ9KPLPjAHT57T3mcPIc Oct 04 18:47:20.493363 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:47:20.493363 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:47:20.493363 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:47:20.493363 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:47:20.493363 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:47:20.493363 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:47:20.493363 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: b6c6b9deecde44b5953d22b38b5b0ff1 Oct 04 18:47:20.493363 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:47:20.493363 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:47:20.493363 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:47:20.493363 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6c6b9deecde44b5953d22b38b5b0ff1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b6c6b9deecde44b5953d22b38b5b0ff1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b6c6b9deecde44b5953d22b38b5b0ff1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6c6b9deecde44b5953d22b38b5b0ff1"}]}] Oct 04 18:47:20.493363 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:47:20.493363 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: b6c6b9deecde44b5953d22b38b5b0ff1 Oct 04 18:47:20.493363 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:47:20.493363 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServersNegativeTestJSON-626077540-project Oct 04 18:47:20.493363 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:47:20.493363 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:47:20.493363 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 5b4eb70f22ba4872b890a4f160cc1805 Oct 04 18:47:20.493363 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServersNegativeTestJSON-626077540-project Oct 04 18:47:20.493363 n-d-850501-14 devstack@n-api.service[123002]: Oct 04 18:47:20.493363 n-d-850501-14 devstack@n-api.service[123002]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2010216262", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "f545e662-10b3-46b1-88bb-6e66dd294559", "destination_type": "local"}, {"source_type": "volume", "uuid": "efa2d4d5-d9cd-4228-94da-07f1540c7e04", "destination_type": "invalid"}], "networks": [{"uuid": "334d1b7e-7632-43fb-8807-6117cf357d4f"}]}} Oct 04 18:47:20.493363 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:47:20.493363 n-d-850501-14 devstack@n-api.service[123002]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 04 18:47:20.493363 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2010216262', 'imageRef': 'f545e662-10b3-46b1-88bb-6e66dd294559', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': 'f545e662-10b3-46b1-88bb-6e66dd294559', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': 'efa2d4d5-d9cd-4228-94da-07f1540c7e04', 'destination_type': 'invalid'}], 'networks': [{'uuid': '334d1b7e-7632-43fb-8807-6117cf357d4f'}]}}} Oct 04 18:47:20.493363 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:47:20.493363 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:20.493363 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:47:20.493363 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:47:20.493363 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:47:20.493363 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:47:20.493363 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Oct 04 18:47:20.493363 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:47:20.493363 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Oct 04 18:47:20.493363 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Oct 04 18:47:20.493363 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:47:20.493363 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Oct 04 18:47:20.493363 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi 'invalid' Oct 04 18:47:20.493363 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:47:20.493363 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:20.493363 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:47:20.493363 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:20.493363 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:20.493363 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:20.493363 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:47:20.493363 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:47:20.493363 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:47:20.493363 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:47:20.498732 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:47:20.498732 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:47:20.498732 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:47:20.498732 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:47:20.498732 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:47:20.498732 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:47:20.498732 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:47:20.498732 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:47:20.498732 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 04 18:47:20.498732 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:47:20.498732 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:20.498732 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:47:20.498732 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:20.498732 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:20.498732 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:20.498732 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:47:20.498732 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:47:20.498732 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 04 18:47:20.498732 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:47:20.511711 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0e25434e-a0f7-4342-9174-4d6060b1f6c0 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:47:20.511711 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0e25434e-a0f7-4342-9174-4d6060b1f6c0 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.021093 Oct 04 18:47:20.511711 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2165/4391] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:47:20 2022] POST /compute/v2.1/servers => generated 155 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 04 18:47:20.521193 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-31a3045d-d8f6-4b40-9d49-de09a590861b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:20.521921 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-31a3045d-d8f6-4b40-9d49-de09a590861b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:20.544073 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-31a3045d-d8f6-4b40-9d49-de09a590861b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:20.549178 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-31a3045d-d8f6-4b40-9d49-de09a590861b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:20.549809 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-31a3045d-d8f6-4b40-9d49-de09a590861b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:20.550622 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-31a3045d-d8f6-4b40-9d49-de09a590861b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:20.551101 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-31a3045d-d8f6-4b40-9d49-de09a590861b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:20.551528 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-31a3045d-d8f6-4b40-9d49-de09a590861b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:20.592320 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-4ff6da63-fcdc-45c5-852e-5977c2165103 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:20.605482 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-4ff6da63-fcdc-45c5-852e-5977c2165103 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/60694294-78ff-49f7-9d07-bb5915eae69e" status: 200 len: 1318 microversion: 2.1 time: 0.378300 Oct 04 18:47:20.607715 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2227/4392] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:20 2022] GET /compute/v2.1/servers/60694294-78ff-49f7-9d07-bb5915eae69e => generated 1318 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:20.665699 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-aecdc3e5-01dc-47e6-8a6f-e04e852f940a tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:20.666824 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-aecdc3e5-01dc-47e6-8a6f-e04e852f940a tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] [instance: 89ad7c7f-cba8-4fbe-8442-63a74c482c6b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:20.681583 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aecdc3e5-01dc-47e6-8a6f-e04e852f940a tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:20.683514 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aecdc3e5-01dc-47e6-8a6f-e04e852f940a tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:20.684919 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aecdc3e5-01dc-47e6-8a6f-e04e852f940a tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:20.686726 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aecdc3e5-01dc-47e6-8a6f-e04e852f940a tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:20.688743 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aecdc3e5-01dc-47e6-8a6f-e04e852f940a tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:20.689359 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aecdc3e5-01dc-47e6-8a6f-e04e852f940a tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:21.289641 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-aecdc3e5-01dc-47e6-8a6f-e04e852f940a tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cce9172582d4efd8fc31251d4bfe63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7917de0ff5be4d238981ea714d837fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:21.301260 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-aecdc3e5-01dc-47e6-8a6f-e04e852f940a tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] 10.222.0.20 "GET /compute/v2.1/servers/89ad7c7f-cba8-4fbe-8442-63a74c482c6b" status: 200 len: 1332 microversion: 2.1 time: 0.641840 Oct 04 18:47:21.319106 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2228/4393] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:20 2022] GET /compute/v2.1/servers/89ad7c7f-cba8-4fbe-8442-63a74c482c6b => generated 1332 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:47:21.334954 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-31a3045d-d8f6-4b40-9d49-de09a590861b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:21.345056 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-31a3045d-d8f6-4b40-9d49-de09a590861b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1504 microversion: 2.1 time: 0.831969 Oct 04 18:47:21.346300 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2166/4394] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:20 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1504 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:47:21.379847 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-cd6062c7-c9f5-47dc-a301-155d0950009f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:21.380626 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-cd6062c7-c9f5-47dc-a301-155d0950009f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:21.395163 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cd6062c7-c9f5-47dc-a301-155d0950009f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:21.396983 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cd6062c7-c9f5-47dc-a301-155d0950009f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:21.399866 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cd6062c7-c9f5-47dc-a301-155d0950009f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:21.401058 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cd6062c7-c9f5-47dc-a301-155d0950009f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:21.401712 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cd6062c7-c9f5-47dc-a301-155d0950009f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:21.402338 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cd6062c7-c9f5-47dc-a301-155d0950009f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:21.473979 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3e794eb9-2ec4-4b22-bff0-32802e7f227e tempest-VolumesSnapshotsTestJSON-1497841961 tempest-VolumesSnapshotsTestJSON-1497841961-project] Calling method '.version_select at 0x7fe253cf3f70>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:21.563517 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3e794eb9-2ec4-4b22-bff0-32802e7f227e tempest-VolumesSnapshotsTestJSON-1497841961 tempest-VolumesSnapshotsTestJSON-1497841961-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/a57525c2-b2cd-46b3-a342-a357b5b312fd" status: 200 len: 345 microversion: 2.1 time: 0.093965 Oct 04 18:47:21.564916 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2167/4395] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Oct 4 18:47:21 2022] GET /compute/v2.1/os-volumes/a57525c2-b2cd-46b3-a342-a357b5b312fd => generated 345 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:47:21.636552 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b8e30a1e-7b22-4189-a31d-6f328542e09f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:21.637468 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b8e30a1e-7b22-4189-a31d-6f328542e09f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: 60694294-78ff-49f7-9d07-bb5915eae69e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:21.652761 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b8e30a1e-7b22-4189-a31d-6f328542e09f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:21.654618 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b8e30a1e-7b22-4189-a31d-6f328542e09f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:21.655286 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b8e30a1e-7b22-4189-a31d-6f328542e09f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:21.657845 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b8e30a1e-7b22-4189-a31d-6f328542e09f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:21.659627 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b8e30a1e-7b22-4189-a31d-6f328542e09f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:21.661379 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b8e30a1e-7b22-4189-a31d-6f328542e09f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:22.353180 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-cd6062c7-c9f5-47dc-a301-155d0950009f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:22.369315 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-cd6062c7-c9f5-47dc-a301-155d0950009f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1504 microversion: 2.1 time: 0.997275 Oct 04 18:47:22.385538 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2229/4396] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:21 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1504 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:22.408740 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5bc77b02-99e5-4857-b13f-5cbe7ce08864 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1537533392", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "71aa3110-4175-485a-9bed-d9c847d4709e"}, {"port": "0c6f4307-90ef-4d56-82f7-ae7b40c2cd81", "tag": "port-1"}, {"port": "66c99c11-ceb2-4608-8f5b-878ab722f616", "tag": "port-2"}, {"uuid": "b3ab1311-9cd5-46aa-9166-c86cab1d0cea", "tag": "net-1"}, {"uuid": "b3ab1311-9cd5-46aa-9166-c86cab1d0cea"}, {"uuid": "48f26c50-031d-4a4f-820a-f8517d4ab4fa", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "48f26c50-031d-4a4f-820a-f8517d4ab4fa", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "aa40f47e-6e78-4e22-b9e1-4e3be0f8bdbc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "3076917a-7f21-4864-8e57-997469806177", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "bc851d53-3d19-4404-b6f4-59c7cd314052", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--2095929950"}], "key_name": "tempest-keypair-1491919207", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:22.491724 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b8e30a1e-7b22-4189-a31d-6f328542e09f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:22.504398 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b8e30a1e-7b22-4189-a31d-6f328542e09f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/60694294-78ff-49f7-9d07-bb5915eae69e" status: 200 len: 1318 microversion: 2.1 time: 0.874504 Oct 04 18:47:22.505507 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2168/4397] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:21 2022] GET /compute/v2.1/servers/60694294-78ff-49f7-9d07-bb5915eae69e => generated 1318 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:22.533979 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-022ed5d6-c012-46b9-aa1e-a34e7e56cdbc tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:22.534971 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-022ed5d6-c012-46b9-aa1e-a34e7e56cdbc tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] [instance: 89ad7c7f-cba8-4fbe-8442-63a74c482c6b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:22.544561 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-022ed5d6-c012-46b9-aa1e-a34e7e56cdbc tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:22.545101 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-022ed5d6-c012-46b9-aa1e-a34e7e56cdbc tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:22.545741 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-022ed5d6-c012-46b9-aa1e-a34e7e56cdbc tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:22.546666 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-022ed5d6-c012-46b9-aa1e-a34e7e56cdbc tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:22.547285 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-022ed5d6-c012-46b9-aa1e-a34e7e56cdbc tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:22.547861 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-022ed5d6-c012-46b9-aa1e-a34e7e56cdbc tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:22.581273 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.neutron [None req-5bc77b02-99e5-4857-b13f-5cbe7ce08864 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] validate_networks() for [('71aa3110-4175-485a-9bed-d9c847d4709e', None, None, None, None, None), (None, None, '0c6f4307-90ef-4d56-82f7-ae7b40c2cd81', None, None, None), (None, None, '66c99c11-ceb2-4608-8f5b-878ab722f616', None, None, None), ('b3ab1311-9cd5-46aa-9166-c86cab1d0cea', None, None, None, None, None), ('b3ab1311-9cd5-46aa-9166-c86cab1d0cea', None, None, None, None, None), ('48f26c50-031d-4a4f-820a-f8517d4ab4fa', '10.2.2.100', None, None, None, None), ('48f26c50-031d-4a4f-820a-f8517d4ab4fa', '10.2.2.200', None, None, None, None)] {{(pid=123001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:47:22.979775 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-022ed5d6-c012-46b9-aa1e-a34e7e56cdbc tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cce9172582d4efd8fc31251d4bfe63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7917de0ff5be4d238981ea714d837fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:22.989392 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-022ed5d6-c012-46b9-aa1e-a34e7e56cdbc tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] 10.222.0.20 "GET /compute/v2.1/servers/89ad7c7f-cba8-4fbe-8442-63a74c482c6b" status: 200 len: 1536 microversion: 2.1 time: 0.482448 Oct 04 18:47:22.990607 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2169/4398] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:22 2022] GET /compute/v2.1/servers/89ad7c7f-cba8-4fbe-8442-63a74c482c6b => generated 1536 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:22.995735 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e672f1d9-0d69-44e4-b68f-72242c051145 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2059161807", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "334d1b7e-7632-43fb-8807-6117cf357d4f"}]}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:23.001427 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e672f1d9-0d69-44e4-b68f-72242c051145 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Request method failure captured: Oct 04 18:47:23.001427 n-d-850501-14 devstack@n-api.service[123002]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:47:23.001427 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:47:23.001427 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:47:23.001427 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:47:23.001427 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 492 Oct 04 18:47:23.001427 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:47:23.001427 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:47:23.001427 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:47:23.001427 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:47:23.001427 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH9zAVdj2h4kh6QqBpYrS2CJMhbcXf529VUNrZoZOYhS2tkLYBgw6AHy860DK9jQ3xATqZvC9lQuxt-_H5qKsAI41eznf32K6QSGqVcHXegpVHrDueww23ZMVCBM3D_hH0NTzh4447rgHqcrC-OZE48IfZrRJ9KPLPjAHT57T3mcPIc Oct 04 18:47:23.001427 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:47:23.001427 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:47:23.001427 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:47:23.001427 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:47:23.001427 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:47:23.001427 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:47:23.001427 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: b6c6b9deecde44b5953d22b38b5b0ff1 Oct 04 18:47:23.001427 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:47:23.001427 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:47:23.001427 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:47:23.001427 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6c6b9deecde44b5953d22b38b5b0ff1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b6c6b9deecde44b5953d22b38b5b0ff1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b6c6b9deecde44b5953d22b38b5b0ff1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6c6b9deecde44b5953d22b38b5b0ff1"}]}] Oct 04 18:47:23.001427 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:47:23.001427 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: b6c6b9deecde44b5953d22b38b5b0ff1 Oct 04 18:47:23.001427 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:47:23.001427 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServersNegativeTestJSON-626077540-project Oct 04 18:47:23.001427 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:47:23.001427 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:47:23.001427 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 5b4eb70f22ba4872b890a4f160cc1805 Oct 04 18:47:23.001427 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServersNegativeTestJSON-626077540-project Oct 04 18:47:23.001427 n-d-850501-14 devstack@n-api.service[123002]: Oct 04 18:47:23.001427 n-d-850501-14 devstack@n-api.service[123002]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2059161807", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "334d1b7e-7632-43fb-8807-6117cf357d4f"}]}} Oct 04 18:47:23.001427 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:47:23.001427 n-d-850501-14 devstack@n-api.service[123002]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 04 18:47:23.001427 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2059161807', 'imageRef': 'f545e662-10b3-46b1-88bb-6e66dd294559', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '334d1b7e-7632-43fb-8807-6117cf357d4f'}]}}} Oct 04 18:47:23.001427 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:47:23.001427 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:23.001427 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:47:23.001427 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:47:23.001427 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:47:23.001427 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:47:23.001427 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 04 18:47:23.001427 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:47:23.001427 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Oct 04 18:47:23.001427 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Oct 04 18:47:23.001427 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:47:23.001427 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Oct 04 18:47:23.004416 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Oct 04 18:47:23.004416 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:47:23.004416 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:23.004416 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:47:23.004416 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:23.004416 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:23.004416 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:23.004416 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:47:23.004416 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:47:23.004416 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:47:23.004416 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:47:23.004416 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:47:23.004416 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:47:23.004416 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:47:23.004416 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:47:23.004416 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:47:23.004416 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:47:23.004416 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:47:23.004416 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:47:23.004416 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 04 18:47:23.004416 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:47:23.004416 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:23.004416 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:47:23.004416 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:23.004416 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:23.004416 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:23.004416 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:47:23.004416 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:47:23.004416 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 04 18:47:23.004416 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:47:23.007817 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e672f1d9-0d69-44e4-b68f-72242c051145 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:47:23.008990 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e672f1d9-0d69-44e4-b68f-72242c051145 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.016920 Oct 04 18:47:23.013636 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2170/4399] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:47:22 2022] POST /compute/v2.1/servers => generated 624 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:47:23.019898 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b992cc92-7026-4399-81bc-c289fa06430b tempest-VolumesSnapshotsTestJSON-1497841961 tempest-VolumesSnapshotsTestJSON-1497841961-project] Calling method '.version_select at 0x7fe253cf3790>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:23.088515 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b992cc92-7026-4399-81bc-c289fa06430b tempest-VolumesSnapshotsTestJSON-1497841961 tempest-VolumesSnapshotsTestJSON-1497841961-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/a57525c2-b2cd-46b3-a342-a357b5b312fd" status: 200 len: 345 microversion: 2.1 time: 0.073511 Oct 04 18:47:23.090354 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2171/4400] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Oct 4 18:47:23 2022] GET /compute/v2.1/os-volumes/a57525c2-b2cd-46b3-a342-a357b5b312fd => generated 345 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:47:23.096963 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-47c32b87-af39-440b-9437-db84236abd2e tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Action: 'create', calling method: .version_select at 0x7fe253ca95e0>, body: {"pool": "c44df1aa-f2af-499a-b6e4-d012aa353460"} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:26.193268 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-47c32b87-af39-440b-9437-db84236abd2e tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.101209 Oct 04 18:47:26.201572 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2172/4401] 10.222.0.20 () {60 vars in 1170 bytes} [Tue Oct 4 18:47:23 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:47:26.207264 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-81cc4534-49b8-4e88-8142-d0db2b89a75c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:26.207833 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-81cc4534-49b8-4e88-8142-d0db2b89a75c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:26.221445 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-81cc4534-49b8-4e88-8142-d0db2b89a75c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:26.221445 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-81cc4534-49b8-4e88-8142-d0db2b89a75c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:26.221445 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-81cc4534-49b8-4e88-8142-d0db2b89a75c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:26.221700 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-81cc4534-49b8-4e88-8142-d0db2b89a75c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:26.223792 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-81cc4534-49b8-4e88-8142-d0db2b89a75c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:26.228006 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-81cc4534-49b8-4e88-8142-d0db2b89a75c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:26.264156 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=8 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:47:26.481973 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-81cc4534-49b8-4e88-8142-d0db2b89a75c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:26.490177 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-81cc4534-49b8-4e88-8142-d0db2b89a75c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1504 microversion: 2.1 time: 0.287449 Oct 04 18:47:26.490761 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2173/4402] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:26 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1504 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:26.515698 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7902cc6c-b790-448e-aed4-1b22f5cbb480 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:26.516352 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7902cc6c-b790-448e-aed4-1b22f5cbb480 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: 60694294-78ff-49f7-9d07-bb5915eae69e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:26.523040 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7902cc6c-b790-448e-aed4-1b22f5cbb480 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:26.523817 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7902cc6c-b790-448e-aed4-1b22f5cbb480 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:26.524453 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7902cc6c-b790-448e-aed4-1b22f5cbb480 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:26.525601 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7902cc6c-b790-448e-aed4-1b22f5cbb480 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:26.526204 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7902cc6c-b790-448e-aed4-1b22f5cbb480 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:26.526870 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7902cc6c-b790-448e-aed4-1b22f5cbb480 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:26.694896 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-5bc77b02-99e5-4857-b13f-5cbe7ce08864 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:47:26.695270 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-5bc77b02-99e5-4857-b13f-5cbe7ce08864 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:47:26.695914 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-5bc77b02-99e5-4857-b13f-5cbe7ce08864 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:47:26.696518 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-5bc77b02-99e5-4857-b13f-5cbe7ce08864 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:47:26.697182 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-5bc77b02-99e5-4857-b13f-5cbe7ce08864 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:47:26.711576 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5bc77b02-99e5-4857-b13f-5cbe7ce08864 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:26.712380 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5bc77b02-99e5-4857-b13f-5cbe7ce08864 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:26.713413 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5bc77b02-99e5-4857-b13f-5cbe7ce08864 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:26.715100 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5bc77b02-99e5-4857-b13f-5cbe7ce08864 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:26.715973 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5bc77b02-99e5-4857-b13f-5cbe7ce08864 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:26.716596 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5bc77b02-99e5-4857-b13f-5cbe7ce08864 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:26.739207 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7902cc6c-b790-448e-aed4-1b22f5cbb480 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:26.744420 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-5bc77b02-99e5-4857-b13f-5cbe7ce08864 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Getting quotas for project 7bc171af3b14473983188dbd7fb01227. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:47:26.749056 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7902cc6c-b790-448e-aed4-1b22f5cbb480 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/60694294-78ff-49f7-9d07-bb5915eae69e" status: 200 len: 1318 microversion: 2.1 time: 0.245412 Oct 04 18:47:26.750459 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2174/4403] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:26 2022] GET /compute/v2.1/servers/60694294-78ff-49f7-9d07-bb5915eae69e => generated 1318 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:26.750832 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-5bc77b02-99e5-4857-b13f-5cbe7ce08864 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Getting quotas for user a18012de566645afb138207e20fb4cf0 and project 7bc171af3b14473983188dbd7fb01227. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:47:26.755919 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-e9897322-331d-48ee-abce-ca4e058d1ebc req-dd084429-beb2-48a6-b5ba-48dac3da2d3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60694294-78ff-49f7-9d07-bb5915eae69e", "name": "network-vif-plugged", "status": "completed", "tag": "6ded5837-6eb6-4f11-b5bf-4145870ee7b8"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:26.767469 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-e9897322-331d-48ee-abce-ca4e058d1ebc req-dd084429-beb2-48a6-b5ba-48dac3da2d3e service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:26.768104 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-e9897322-331d-48ee-abce-ca4e058d1ebc req-dd084429-beb2-48a6-b5ba-48dac3da2d3e service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:26.768639 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-e9897322-331d-48ee-abce-ca4e058d1ebc req-dd084429-beb2-48a6-b5ba-48dac3da2d3e service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:26.781290 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-e9897322-331d-48ee-abce-ca4e058d1ebc req-dd084429-beb2-48a6-b5ba-48dac3da2d3e service nova] Creating event network-vif-plugged:6ded5837-6eb6-4f11-b5bf-4145870ee7b8 for instance 60694294-78ff-49f7-9d07-bb5915eae69e on n-h1-850501-14 Oct 04 18:47:26.787364 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-e9897322-331d-48ee-abce-ca4e058d1ebc req-dd084429-beb2-48a6-b5ba-48dac3da2d3e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035101 Oct 04 18:47:26.788953 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2175/4404] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:47:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:47:26.795441 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-66a64886-b717-4ad1-9215-a69c15e5a266 tempest-VolumesSnapshotsTestJSON-1497841961 tempest-VolumesSnapshotsTestJSON-1497841961-project] Calling method '.version_select at 0x7fe253ca9d30>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:26.830653 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-66a64886-b717-4ad1-9215-a69c15e5a266 tempest-VolumesSnapshotsTestJSON-1497841961 tempest-VolumesSnapshotsTestJSON-1497841961-project] HTTP exception thrown: Volume a57525c2-b2cd-46b3-a342-a357b5b312fd could not be found. Oct 04 18:47:26.832750 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-66a64886-b717-4ad1-9215-a69c15e5a266 tempest-VolumesSnapshotsTestJSON-1497841961 tempest-VolumesSnapshotsTestJSON-1497841961-project] Request method failure captured: Oct 04 18:47:26.832750 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/os-volumes/a57525c2-b2cd-46b3-a342-a357b5b312fd HTTP/1.1 Oct 04 18:47:26.832750 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:47:26.832750 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:47:26.832750 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:47:26.832750 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:47:26.832750 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:47:26.832750 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:47:26.832750 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:47:26.832750 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:47:26.832750 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH-rhtGIi882q12U85eDyk0AsHmL1tLPvaETAYQUqciMWVXc0miwQ_NF-Q9UKcB-f1EGV9SCZQKIC0UdadkWgnDmo_BsVbgHPErWrO8WYAQiRR5Sif8wv-K8oVTB5ZrWVfY-KmWwGAxLQ1Jg0IB0IaqlyH9j61--LKRVRPTQlI5MPYw Oct 04 18:47:26.832750 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:47:26.832750 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:47:26.832750 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:47:26.832750 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:47:26.832750 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:47:26.832750 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:47:26.832750 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 0ebeabd56c3b47159e9f5e98aaccccaa Oct 04 18:47:26.832750 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1497841961 Oct 04 18:47:26.832750 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:47:26.832750 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:47:26.832750 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0ebeabd56c3b47159e9f5e98aaccccaa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0ebeabd56c3b47159e9f5e98aaccccaa", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0ebeabd56c3b47159e9f5e98aaccccaa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0ebeabd56c3b47159e9f5e98aaccccaa"}]}] Oct 04 18:47:26.832750 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1497841961 Oct 04 18:47:26.832750 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 0ebeabd56c3b47159e9f5e98aaccccaa Oct 04 18:47:26.832750 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1497841961 Oct 04 18:47:26.832750 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-VolumesSnapshotsTestJSON-1497841961-project Oct 04 18:47:26.832750 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:47:26.832750 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:47:26.832750 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 4361e90ed75c4029a55dbd8b037c9b1a Oct 04 18:47:26.832750 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1497841961-project Oct 04 18:47:26.832750 n-d-850501-14 devstack@n-api.service[123002]: method: Oct 04 18:47:26.832750 n-d-850501-14 devstack@n-api.service[123002]: exception: Volume a57525c2-b2cd-46b3-a342-a357b5b312fd could not be found. Oct 04 18:47:26.832750 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'a57525c2-b2cd-46b3-a342-a357b5b312fd'} Oct 04 18:47:26.832750 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:47:26.832750 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:26.832750 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 18:47:26.832750 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 18:47:26.832750 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 18:47:26.832750 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 18:47:26.832750 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 18:47:26.832750 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 18:47:26.832750 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 18:47:26.832750 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 18:47:26.832750 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 18:47:26.832750 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 18:47:26.832750 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:47:26.832750 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:47:26.832750 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:47:26.832750 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:47:26.832750 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a57525c2-b2cd-46b3-a342-a357b5b312fd could not be found. (HTTP 404) (Request-ID: req-0bfda738-9502-475d-8fac-71099be0bbf6) Oct 04 18:47:26.832750 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:47:26.832750 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:26.832750 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:47:26.832750 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:26.832750 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 04 18:47:26.832750 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 04 18:47:26.832750 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 18:47:26.832750 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 18:47:26.832750 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 18:47:26.832750 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 18:47:26.832750 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 18:47:26.832750 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 18:47:26.832750 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 18:47:26.837835 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 18:47:26.837835 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 18:47:26.837835 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 18:47:26.837835 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 18:47:26.837835 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 18:47:26.837835 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 18:47:26.837835 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 18:47:26.837835 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 18:47:26.837835 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 18:47:26.837835 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:47:26.837835 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:47:26.837835 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:47:26.837835 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:47:26.837835 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a57525c2-b2cd-46b3-a342-a357b5b312fd could not be found. Oct 04 18:47:26.837835 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:47:26.837835 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:26.837835 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:47:26.837835 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:26.837835 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:26.837835 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:26.837835 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:47:26.837835 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:47:26.837835 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:47:26.837835 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:47:26.837835 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:47:26.837835 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:47:26.837835 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 04 18:47:26.837835 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:47:26.837835 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a57525c2-b2cd-46b3-a342-a357b5b312fd could not be found. Oct 04 18:47:26.837835 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:47:26.837835 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:26.837835 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:47:26.837835 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:26.837835 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:26.837835 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:26.837835 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:47:26.837835 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:47:26.837835 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a57525c2-b2cd-46b3-a342-a357b5b312fd could not be found. Oct 04 18:47:26.837835 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:47:26.841745 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-66a64886-b717-4ad1-9215-a69c15e5a266 tempest-VolumesSnapshotsTestJSON-1497841961 tempest-VolumesSnapshotsTestJSON-1497841961-project] Returning 404 to user: Volume a57525c2-b2cd-46b3-a342-a357b5b312fd could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:47:26.842759 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-66a64886-b717-4ad1-9215-a69c15e5a266 tempest-VolumesSnapshotsTestJSON-1497841961 tempest-VolumesSnapshotsTestJSON-1497841961-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/a57525c2-b2cd-46b3-a342-a357b5b312fd" status: 404 len: 109 microversion: 2.1 time: 0.052457 Oct 04 18:47:26.849225 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2176/4405] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Oct 4 18:47:26 2022] GET /compute/v2.1/os-volumes/a57525c2-b2cd-46b3-a342-a357b5b312fd => generated 109 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:47:26.855504 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f340e352-d3db-4c10-b976-f5ab8dbe123e tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.1.20"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:26.859039 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f340e352-d3db-4c10-b976-f5ab8dbe123e tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] [instance: 89ad7c7f-cba8-4fbe-8442-63a74c482c6b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:26.867615 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f340e352-d3db-4c10-b976-f5ab8dbe123e tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:26.868165 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f340e352-d3db-4c10-b976-f5ab8dbe123e tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:26.873508 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f340e352-d3db-4c10-b976-f5ab8dbe123e tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:26.873508 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f340e352-d3db-4c10-b976-f5ab8dbe123e tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:26.873508 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f340e352-d3db-4c10-b976-f5ab8dbe123e tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:26.873508 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f340e352-d3db-4c10-b976-f5ab8dbe123e tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:26.900466 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f340e352-d3db-4c10-b976-f5ab8dbe123e tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Acquiring lock "refresh_cache-89ad7c7f-cba8-4fbe-8442-63a74c482c6b" {{(pid=123002) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 18:47:26.901108 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f340e352-d3db-4c10-b976-f5ab8dbe123e tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Acquired lock "refresh_cache-89ad7c7f-cba8-4fbe-8442-63a74c482c6b" {{(pid=123002) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 18:47:26.974682 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5bc77b02-99e5-4857-b13f-5cbe7ce08864 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Going to run 1 instances... {{(pid=123001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:47:26.980335 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5bc77b02-99e5-4857-b13f-5cbe7ce08864 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] [instance: 317c7bd8-4f1e-4210-bb33-087557a1f4d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='aa40f47e-6e78-4e22-b9e1-4e3be0f8bdbc',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='3076917a-7f21-4864-8e57-997469806177',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bc851d53-3d19-4404-b6f4-59c7cd314052',volume_size=None,volume_type=None)] {{(pid=123001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:47:28.047658 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5bc77b02-99e5-4857-b13f-5cbe7ce08864 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 5.659765 Oct 04 18:47:28.050208 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2230/4406] 10.222.0.20 () {62 vars in 1189 bytes} [Tue Oct 4 18:47:22 2022] POST /compute/v2.1/servers => generated 406 bytes in 5664 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 18:47:28.057410 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-80b624b3-78d2-453f-9e8c-8237d6c707ee tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:28.064834 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-80b624b3-78d2-453f-9e8c-8237d6c707ee tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:28.066087 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-80b624b3-78d2-453f-9e8c-8237d6c707ee tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:28.066727 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-80b624b3-78d2-453f-9e8c-8237d6c707ee tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:28.067619 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-80b624b3-78d2-453f-9e8c-8237d6c707ee tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:28.068570 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-80b624b3-78d2-453f-9e8c-8237d6c707ee tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:28.070870 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-80b624b3-78d2-453f-9e8c-8237d6c707ee tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:28.071538 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-80b624b3-78d2-453f-9e8c-8237d6c707ee tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:28.406655 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-80b624b3-78d2-453f-9e8c-8237d6c707ee tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:28.416097 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-80b624b3-78d2-453f-9e8c-8237d6c707ee tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1504 microversion: 2.1 time: 0.363697 Oct 04 18:47:28.416097 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2231/4407] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:28 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1504 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:28.420712 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-229a2e3a-56a6-4398-8586-110706527fea tempest-VolumesSnapshotsTestJSON-1497841961 tempest-VolumesSnapshotsTestJSON-1497841961-project] Calling method '.version_select at 0x7fe258ca1c10>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:28.469988 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-229a2e3a-56a6-4398-8586-110706527fea tempest-VolumesSnapshotsTestJSON-1497841961 tempest-VolumesSnapshotsTestJSON-1497841961-project] HTTP exception thrown: Volume a57525c2-b2cd-46b3-a342-a357b5b312fd could not be found. Oct 04 18:47:28.473287 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-229a2e3a-56a6-4398-8586-110706527fea tempest-VolumesSnapshotsTestJSON-1497841961 tempest-VolumesSnapshotsTestJSON-1497841961-project] Request method failure captured: Oct 04 18:47:28.473287 n-d-850501-14 devstack@n-api.service[123001]: request: DELETE /compute/v2.1/os-volumes/a57525c2-b2cd-46b3-a342-a357b5b312fd HTTP/1.1 Oct 04 18:47:28.473287 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:47:28.473287 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:47:28.473287 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:47:28.473287 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:47:28.473287 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:47:28.473287 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:47:28.473287 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:47:28.473287 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:47:28.473287 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPH-rhtGIi882q12U85eDyk0AsHmL1tLPvaETAYQUqciMWVXc0miwQ_NF-Q9UKcB-f1EGV9SCZQKIC0UdadkWgnDmo_BsVbgHPErWrO8WYAQiRR5Sif8wv-K8oVTB5ZrWVfY-KmWwGAxLQ1Jg0IB0IaqlyH9j61--LKRVRPTQlI5MPYw Oct 04 18:47:28.473287 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:47:28.473287 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:47:28.473287 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:47:28.473287 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:47:28.473287 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:47:28.473287 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:47:28.473287 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 0ebeabd56c3b47159e9f5e98aaccccaa Oct 04 18:47:28.473287 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1497841961 Oct 04 18:47:28.473287 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:47:28.473287 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:47:28.473287 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0ebeabd56c3b47159e9f5e98aaccccaa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0ebeabd56c3b47159e9f5e98aaccccaa", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0ebeabd56c3b47159e9f5e98aaccccaa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0ebeabd56c3b47159e9f5e98aaccccaa"}]}] Oct 04 18:47:28.473287 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1497841961 Oct 04 18:47:28.473287 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 0ebeabd56c3b47159e9f5e98aaccccaa Oct 04 18:47:28.473287 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1497841961 Oct 04 18:47:28.473287 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-VolumesSnapshotsTestJSON-1497841961-project Oct 04 18:47:28.473287 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:47:28.473287 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:47:28.473287 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 4361e90ed75c4029a55dbd8b037c9b1a Oct 04 18:47:28.473287 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1497841961-project Oct 04 18:47:28.473287 n-d-850501-14 devstack@n-api.service[123001]: method: Oct 04 18:47:28.473287 n-d-850501-14 devstack@n-api.service[123001]: exception: Volume a57525c2-b2cd-46b3-a342-a357b5b312fd could not be found. Oct 04 18:47:28.473287 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': 'a57525c2-b2cd-46b3-a342-a357b5b312fd'} Oct 04 18:47:28.473287 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:47:28.473287 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:28.473287 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 18:47:28.473287 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 18:47:28.473287 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 18:47:28.473287 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 18:47:28.473287 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 18:47:28.473287 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 18:47:28.473287 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 18:47:28.473287 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 18:47:28.473287 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 18:47:28.473287 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 18:47:28.473287 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:47:28.473287 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:47:28.473287 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:47:28.473287 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:47:28.473287 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a57525c2-b2cd-46b3-a342-a357b5b312fd could not be found. (HTTP 404) (Request-ID: req-a601711c-96ac-42ee-a510-bc7bbcc3fabc) Oct 04 18:47:28.473287 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:47:28.473287 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:28.473287 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:47:28.473287 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:28.473287 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 04 18:47:28.473287 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 04 18:47:28.473287 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 18:47:28.473287 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 18:47:28.473287 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 18:47:28.473287 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 18:47:28.473287 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 18:47:28.473287 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 18:47:28.473287 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 18:47:28.477414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 18:47:28.477414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 18:47:28.477414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 18:47:28.477414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 18:47:28.477414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 18:47:28.477414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 18:47:28.477414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 18:47:28.477414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 18:47:28.477414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 18:47:28.477414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:47:28.477414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:47:28.477414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:47:28.477414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:47:28.477414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a57525c2-b2cd-46b3-a342-a357b5b312fd could not be found. Oct 04 18:47:28.477414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:47:28.477414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:28.477414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:47:28.477414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:28.477414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:28.477414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:28.477414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:47:28.477414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:47:28.477414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:47:28.477414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:47:28.477414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:47:28.477414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:47:28.477414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 04 18:47:28.477414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:47:28.477414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a57525c2-b2cd-46b3-a342-a357b5b312fd could not be found. Oct 04 18:47:28.477414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:47:28.477414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:28.477414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:47:28.477414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:28.477414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:28.477414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:28.477414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:47:28.477414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:47:28.477414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a57525c2-b2cd-46b3-a342-a357b5b312fd could not be found. Oct 04 18:47:28.477414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:47:28.477414 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-229a2e3a-56a6-4398-8586-110706527fea tempest-VolumesSnapshotsTestJSON-1497841961 tempest-VolumesSnapshotsTestJSON-1497841961-project] Returning 404 to user: Volume a57525c2-b2cd-46b3-a342-a357b5b312fd could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:47:28.477414 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-229a2e3a-56a6-4398-8586-110706527fea tempest-VolumesSnapshotsTestJSON-1497841961 tempest-VolumesSnapshotsTestJSON-1497841961-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/a57525c2-b2cd-46b3-a342-a357b5b312fd" status: 404 len: 109 microversion: 2.1 time: 0.056540 Oct 04 18:47:28.489749 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2232/4408] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Oct 4 18:47:28 2022] DELETE /compute/v2.1/os-volumes/a57525c2-b2cd-46b3-a342-a357b5b312fd => generated 109 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:47:28.497188 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-13438cc2-257f-438a-9c93-414fdf5f3bb3 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:28.497819 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-13438cc2-257f-438a-9c93-414fdf5f3bb3 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: 60694294-78ff-49f7-9d07-bb5915eae69e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:28.504898 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-13438cc2-257f-438a-9c93-414fdf5f3bb3 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:28.505391 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-13438cc2-257f-438a-9c93-414fdf5f3bb3 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:28.505831 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-13438cc2-257f-438a-9c93-414fdf5f3bb3 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:28.507119 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-13438cc2-257f-438a-9c93-414fdf5f3bb3 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:28.508380 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-13438cc2-257f-438a-9c93-414fdf5f3bb3 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:28.508806 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-13438cc2-257f-438a-9c93-414fdf5f3bb3 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:28.806452 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-13438cc2-257f-438a-9c93-414fdf5f3bb3 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:28.819198 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-13438cc2-257f-438a-9c93-414fdf5f3bb3 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/60694294-78ff-49f7-9d07-bb5915eae69e" status: 200 len: 1507 microversion: 2.1 time: 0.336327 Oct 04 18:47:28.820032 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2233/4409] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:28 2022] GET /compute/v2.1/servers/60694294-78ff-49f7-9d07-bb5915eae69e => generated 1507 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:28.826528 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-df167cfd-8c08-46b9-8f73-48942da710a8 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:28.827410 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-df167cfd-8c08-46b9-8f73-48942da710a8 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] [instance: 317c7bd8-4f1e-4210-bb33-087557a1f4d6] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:28.901458 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-df167cfd-8c08-46b9-8f73-48942da710a8 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:28.911040 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-df167cfd-8c08-46b9-8f73-48942da710a8 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:28.913575 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-df167cfd-8c08-46b9-8f73-48942da710a8 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:28.915468 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-df167cfd-8c08-46b9-8f73-48942da710a8 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] 10.222.0.20 "GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6" status: 200 len: 1286 microversion: 2.32 time: 0.092655 Oct 04 18:47:28.916659 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2234/4410] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:47:28 2022] GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6 => generated 1286 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:47:28.922278 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-232d4cf0-c75d-4509-bfb3-1953e649e04a tempest-VolumesSnapshotsTestJSON-1497841961 tempest-VolumesSnapshotsTestJSON-1497841961-project] Calling method '.version_select at 0x7fe258ca1ca0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:28.984857 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-232d4cf0-c75d-4509-bfb3-1953e649e04a tempest-VolumesSnapshotsTestJSON-1497841961 tempest-VolumesSnapshotsTestJSON-1497841961-project] HTTP exception thrown: Volume a57525c2-b2cd-46b3-a342-a357b5b312fd could not be found. Oct 04 18:47:28.984857 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-232d4cf0-c75d-4509-bfb3-1953e649e04a tempest-VolumesSnapshotsTestJSON-1497841961 tempest-VolumesSnapshotsTestJSON-1497841961-project] Request method failure captured: Oct 04 18:47:28.984857 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/os-volumes/a57525c2-b2cd-46b3-a342-a357b5b312fd HTTP/1.1 Oct 04 18:47:28.984857 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:47:28.984857 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:47:28.984857 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:47:28.984857 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:47:28.984857 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:47:28.984857 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:47:28.984857 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:47:28.984857 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:47:28.984857 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPH-rhtGIi882q12U85eDyk0AsHmL1tLPvaETAYQUqciMWVXc0miwQ_NF-Q9UKcB-f1EGV9SCZQKIC0UdadkWgnDmo_BsVbgHPErWrO8WYAQiRR5Sif8wv-K8oVTB5ZrWVfY-KmWwGAxLQ1Jg0IB0IaqlyH9j61--LKRVRPTQlI5MPYw Oct 04 18:47:28.984857 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:47:28.984857 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:47:28.984857 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:47:28.984857 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:47:28.984857 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:47:28.984857 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:47:28.984857 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 0ebeabd56c3b47159e9f5e98aaccccaa Oct 04 18:47:28.984857 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1497841961 Oct 04 18:47:28.984857 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:47:28.984857 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:47:28.984857 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0ebeabd56c3b47159e9f5e98aaccccaa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0ebeabd56c3b47159e9f5e98aaccccaa", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0ebeabd56c3b47159e9f5e98aaccccaa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0ebeabd56c3b47159e9f5e98aaccccaa"}]}] Oct 04 18:47:28.984857 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1497841961 Oct 04 18:47:28.984857 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 0ebeabd56c3b47159e9f5e98aaccccaa Oct 04 18:47:28.984857 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1497841961 Oct 04 18:47:28.984857 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-VolumesSnapshotsTestJSON-1497841961-project Oct 04 18:47:28.984857 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:47:28.984857 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:47:28.984857 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 4361e90ed75c4029a55dbd8b037c9b1a Oct 04 18:47:28.984857 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1497841961-project Oct 04 18:47:28.984857 n-d-850501-14 devstack@n-api.service[123001]: method: Oct 04 18:47:28.984857 n-d-850501-14 devstack@n-api.service[123001]: exception: Volume a57525c2-b2cd-46b3-a342-a357b5b312fd could not be found. Oct 04 18:47:28.984857 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': 'a57525c2-b2cd-46b3-a342-a357b5b312fd'} Oct 04 18:47:28.984857 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:47:28.984857 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:28.984857 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 18:47:28.984857 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 18:47:28.984857 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 18:47:28.984857 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 18:47:28.984857 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 18:47:28.984857 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 18:47:28.984857 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 18:47:28.984857 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 18:47:28.984857 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 18:47:28.984857 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 18:47:28.984857 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:47:28.984857 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:47:28.984857 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:47:28.984857 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:47:28.984857 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a57525c2-b2cd-46b3-a342-a357b5b312fd could not be found. (HTTP 404) (Request-ID: req-302f9b73-54e1-4153-b997-e5f2169964ee) Oct 04 18:47:28.984857 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:47:28.984857 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:28.984857 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:47:28.984857 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:28.984857 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 04 18:47:28.984857 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 04 18:47:28.984857 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 18:47:28.984857 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 18:47:28.984857 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 18:47:28.984857 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 18:47:28.988464 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 18:47:28.988464 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 18:47:28.988464 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 18:47:28.988464 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 18:47:28.988464 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 18:47:28.988464 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 18:47:28.988464 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 18:47:28.988464 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 18:47:28.988464 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 18:47:28.988464 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 18:47:28.988464 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 18:47:28.988464 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 18:47:28.988464 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:47:28.988464 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:47:28.988464 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:47:28.988464 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:47:28.988464 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a57525c2-b2cd-46b3-a342-a357b5b312fd could not be found. Oct 04 18:47:28.988464 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:47:28.988464 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:28.988464 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:47:28.988464 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:28.988464 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:28.988464 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:28.988464 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:47:28.988464 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:47:28.988464 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:47:28.988464 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:47:28.988464 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:47:28.988464 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:47:28.988464 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 04 18:47:28.988464 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:47:28.988464 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a57525c2-b2cd-46b3-a342-a357b5b312fd could not be found. Oct 04 18:47:28.988464 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:47:28.988464 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:28.988464 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:47:28.988464 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:28.988464 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:28.988464 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:28.988464 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:47:28.988464 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:47:28.988464 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a57525c2-b2cd-46b3-a342-a357b5b312fd could not be found. Oct 04 18:47:28.988464 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:47:28.994489 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-232d4cf0-c75d-4509-bfb3-1953e649e04a tempest-VolumesSnapshotsTestJSON-1497841961 tempest-VolumesSnapshotsTestJSON-1497841961-project] Returning 404 to user: Volume a57525c2-b2cd-46b3-a342-a357b5b312fd could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:47:28.996551 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-232d4cf0-c75d-4509-bfb3-1953e649e04a tempest-VolumesSnapshotsTestJSON-1497841961 tempest-VolumesSnapshotsTestJSON-1497841961-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/a57525c2-b2cd-46b3-a342-a357b5b312fd" status: 404 len: 109 microversion: 2.1 time: 0.078744 Oct 04 18:47:28.997237 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2235/4411] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Oct 4 18:47:28 2022] GET /compute/v2.1/os-volumes/a57525c2-b2cd-46b3-a342-a357b5b312fd => generated 109 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:47:29.009510 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-16c7a258-c675-46d3-8bb6-28f7cc07773b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": [{"uuid": "334d1b7e-7632-43fb-8807-6117cf357d4f"}]}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:29.017598 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-16c7a258-c675-46d3-8bb6-28f7cc07773b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Request method failure captured: Oct 04 18:47:29.017598 n-d-850501-14 devstack@n-api.service[123001]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:47:29.017598 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:47:29.017598 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:47:29.017598 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:47:29.017598 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 416 Oct 04 18:47:29.017598 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:47:29.017598 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:47:29.017598 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:47:29.017598 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:47:29.017598 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPH9zAVdj2h4kh6QqBpYrS2CJMhbcXf529VUNrZoZOYhS2tkLYBgw6AHy860DK9jQ3xATqZvC9lQuxt-_H5qKsAI41eznf32K6QSGqVcHXegpVHrDueww23ZMVCBM3D_hH0NTzh4447rgHqcrC-OZE48IfZrRJ9KPLPjAHT57T3mcPIc Oct 04 18:47:29.017598 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:47:29.017598 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:47:29.017598 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:47:29.017598 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:47:29.017598 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:47:29.017598 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:47:29.017598 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: b6c6b9deecde44b5953d22b38b5b0ff1 Oct 04 18:47:29.017598 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:47:29.017598 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:47:29.017598 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:47:29.017598 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6c6b9deecde44b5953d22b38b5b0ff1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b6c6b9deecde44b5953d22b38b5b0ff1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b6c6b9deecde44b5953d22b38b5b0ff1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6c6b9deecde44b5953d22b38b5b0ff1"}]}] Oct 04 18:47:29.017598 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:47:29.017598 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: b6c6b9deecde44b5953d22b38b5b0ff1 Oct 04 18:47:29.017598 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:47:29.017598 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ServersNegativeTestJSON-626077540-project Oct 04 18:47:29.017598 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:47:29.017598 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:47:29.017598 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 5b4eb70f22ba4872b890a4f160cc1805 Oct 04 18:47:29.017598 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ServersNegativeTestJSON-626077540-project Oct 04 18:47:29.017598 n-d-850501-14 devstack@n-api.service[123001]: Oct 04 18:47:29.017598 n-d-850501-14 devstack@n-api.service[123001]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": [{"uuid": "334d1b7e-7632-43fb-8807-6117cf357d4f"}]}} Oct 04 18:47:29.017598 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:47:29.017598 n-d-850501-14 devstack@n-api.service[123001]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 18:47:29.017598 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': 'f545e662-10b3-46b1-88bb-6e66dd294559', 'flavorRef': '452', 'networks': [{'uuid': '334d1b7e-7632-43fb-8807-6117cf357d4f'}]}}} Oct 04 18:47:29.017598 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:47:29.017598 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:29.017598 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:47:29.017598 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:47:29.017598 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:47:29.017598 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:47:29.017598 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 18:47:29.017598 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:47:29.017598 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 04 18:47:29.017598 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 18:47:29.017598 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:47:29.017598 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 18:47:29.017598 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 04 18:47:29.017598 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:47:29.017598 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:29.024559 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:47:29.024559 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:29.024559 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:29.024559 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:29.024559 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:47:29.024559 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:47:29.024559 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:47:29.024559 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:47:29.024559 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:47:29.024559 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:47:29.024559 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:47:29.024559 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:47:29.024559 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:47:29.024559 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:47:29.024559 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:47:29.024559 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:47:29.024559 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 18:47:29.024559 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:47:29.024559 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:29.024559 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:47:29.024559 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:29.024559 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:29.024559 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:29.024559 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:47:29.024559 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:47:29.024559 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 18:47:29.024559 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:47:29.024559 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-16c7a258-c675-46d3-8bb6-28f7cc07773b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:47:29.026170 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-f340e352-d3db-4c10-b976-f5ab8dbe123e tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] [instance: 89ad7c7f-cba8-4fbe-8442-63a74c482c6b] Building network info cache for instance {{(pid=123002) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 18:47:29.033633 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-16c7a258-c675-46d3-8bb6-28f7cc07773b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.032837 Oct 04 18:47:29.033633 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2236/4412] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:47:28 2022] POST /compute/v2.1/servers => generated 619 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:47:29.038448 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f54149dc-eb45-497f-b97c-502348378161 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:29.039344 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f54149dc-eb45-497f-b97c-502348378161 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: 60694294-78ff-49f7-9d07-bb5915eae69e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:29.050621 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f54149dc-eb45-497f-b97c-502348378161 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:29.052158 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f54149dc-eb45-497f-b97c-502348378161 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:29.052842 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f54149dc-eb45-497f-b97c-502348378161 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:29.054356 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f54149dc-eb45-497f-b97c-502348378161 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:29.055053 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f54149dc-eb45-497f-b97c-502348378161 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:29.055698 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f54149dc-eb45-497f-b97c-502348378161 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:29.381952 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f54149dc-eb45-497f-b97c-502348378161 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:29.394572 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f54149dc-eb45-497f-b97c-502348378161 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/60694294-78ff-49f7-9d07-bb5915eae69e" status: 200 len: 1507 microversion: 2.1 time: 0.361396 Oct 04 18:47:29.400711 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2237/4413] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:29 2022] GET /compute/v2.1/servers/60694294-78ff-49f7-9d07-bb5915eae69e => generated 1507 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:29.408756 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-20e5019e-3b4f-46d7-8f01-17e33f7b9f9b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:29.409472 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-20e5019e-3b4f-46d7-8f01-17e33f7b9f9b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:29.427116 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-20e5019e-3b4f-46d7-8f01-17e33f7b9f9b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:29.427676 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-20e5019e-3b4f-46d7-8f01-17e33f7b9f9b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:29.428081 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-20e5019e-3b4f-46d7-8f01-17e33f7b9f9b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:29.432217 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-20e5019e-3b4f-46d7-8f01-17e33f7b9f9b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:29.432712 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-20e5019e-3b4f-46d7-8f01-17e33f7b9f9b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:29.433156 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-20e5019e-3b4f-46d7-8f01-17e33f7b9f9b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:29.779741 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-20e5019e-3b4f-46d7-8f01-17e33f7b9f9b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:29.790880 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-20e5019e-3b4f-46d7-8f01-17e33f7b9f9b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1504 microversion: 2.1 time: 0.387649 Oct 04 18:47:29.797500 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2238/4414] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:29 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1504 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:29.802059 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-b166e16b-f5d1-4bf8-a1fd-aa89b14f26ea req-aaa6c470-361f-4941-91fd-dbb041288fbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89ad7c7f-cba8-4fbe-8442-63a74c482c6b", "tag": "48ca997a-f5b9-4dbe-8306-95ea1bef682b"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:29.821249 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:47:29.831215 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-b166e16b-f5d1-4bf8-a1fd-aa89b14f26ea req-aaa6c470-361f-4941-91fd-dbb041288fbc service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:29.831789 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-b166e16b-f5d1-4bf8-a1fd-aa89b14f26ea req-aaa6c470-361f-4941-91fd-dbb041288fbc service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:29.832356 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-b166e16b-f5d1-4bf8-a1fd-aa89b14f26ea req-aaa6c470-361f-4941-91fd-dbb041288fbc service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:29.865469 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-b166e16b-f5d1-4bf8-a1fd-aa89b14f26ea req-aaa6c470-361f-4941-91fd-dbb041288fbc service nova] Creating event network-changed:48ca997a-f5b9-4dbe-8306-95ea1bef682b for instance 89ad7c7f-cba8-4fbe-8442-63a74c482c6b on n-h2-850501-14 Oct 04 18:47:29.873370 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-b166e16b-f5d1-4bf8-a1fd-aa89b14f26ea req-aaa6c470-361f-4941-91fd-dbb041288fbc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077672 Oct 04 18:47:29.876152 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2239/4415] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:47:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:47:29.889427 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a26f06ac-83d3-4022-8382-ad7f433032bf tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "OS-DCF:diskConfig": "AUTO"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:29.893417 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a26f06ac-83d3-4022-8382-ad7f433032bf tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: 60694294-78ff-49f7-9d07-bb5915eae69e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:29.900810 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a26f06ac-83d3-4022-8382-ad7f433032bf tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:29.901292 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a26f06ac-83d3-4022-8382-ad7f433032bf tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:29.901723 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a26f06ac-83d3-4022-8382-ad7f433032bf tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:29.902687 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a26f06ac-83d3-4022-8382-ad7f433032bf tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:29.903138 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a26f06ac-83d3-4022-8382-ad7f433032bf tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:29.903745 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a26f06ac-83d3-4022-8382-ad7f433032bf tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:30.076447 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-a26f06ac-83d3-4022-8382-ad7f433032bf tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:47:30.079083 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-a26f06ac-83d3-4022-8382-ad7f433032bf tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:47:30.079778 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-a26f06ac-83d3-4022-8382-ad7f433032bf tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:47:30.080409 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-a26f06ac-83d3-4022-8382-ad7f433032bf tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:47:30.080980 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-a26f06ac-83d3-4022-8382-ad7f433032bf tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:47:30.247445 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-f340e352-d3db-4c10-b976-f5ab8dbe123e tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] [instance: 89ad7c7f-cba8-4fbe-8442-63a74c482c6b] Updating instance_info_cache with network_info: [{"id": "48ca997a-f5b9-4dbe-8306-95ea1bef682b", "address": "fa:16:3e:c1:f3:74", "network": {"id": "78884083-8fd9-4713-bf20-70c3db5a4715", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-349008263-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.1.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "7917de0ff5be4d238981ea714d837fe0", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap48ca997a-f5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=123002) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 18:47:30.311322 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f340e352-d3db-4c10-b976-f5ab8dbe123e tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Releasing lock "refresh_cache-89ad7c7f-cba8-4fbe-8442-63a74c482c6b" {{(pid=123002) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 18:47:30.312519 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f340e352-d3db-4c10-b976-f5ab8dbe123e tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] 10.222.0.20 "POST /compute/v2.1/servers/89ad7c7f-cba8-4fbe-8442-63a74c482c6b/action" status: 202 len: 0 microversion: 2.1 time: 3.462119 Oct 04 18:47:30.313619 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2177/4416] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:47:26 2022] POST /compute/v2.1/servers/89ad7c7f-cba8-4fbe-8442-63a74c482c6b/action => generated 0 bytes in 3463 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 04 18:47:30.320237 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b51c38a2-9665-464e-9241-6fd47416f0ab tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:30.324316 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b51c38a2-9665-464e-9241-6fd47416f0ab tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:30.348589 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b51c38a2-9665-464e-9241-6fd47416f0ab tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:30.349095 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b51c38a2-9665-464e-9241-6fd47416f0ab tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:30.349627 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b51c38a2-9665-464e-9241-6fd47416f0ab tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:30.350605 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b51c38a2-9665-464e-9241-6fd47416f0ab tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:30.351301 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b51c38a2-9665-464e-9241-6fd47416f0ab tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:30.351890 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b51c38a2-9665-464e-9241-6fd47416f0ab tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:30.420318 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a26f06ac-83d3-4022-8382-ad7f433032bf tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: 60694294-78ff-49f7-9d07-bb5915eae69e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:30.436786 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a26f06ac-83d3-4022-8382-ad7f433032bf tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:30.438581 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a26f06ac-83d3-4022-8382-ad7f433032bf tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:30.440963 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a26f06ac-83d3-4022-8382-ad7f433032bf tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:30.442388 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a26f06ac-83d3-4022-8382-ad7f433032bf tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:30.444575 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a26f06ac-83d3-4022-8382-ad7f433032bf tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:30.445231 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a26f06ac-83d3-4022-8382-ad7f433032bf tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:30.502335 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a26f06ac-83d3-4022-8382-ad7f433032bf tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "POST /compute/v2.1/servers/60694294-78ff-49f7-9d07-bb5915eae69e/action" status: 202 len: 1109 microversion: 2.1 time: 0.623239 Oct 04 18:47:30.504666 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2240/4417] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:47:29 2022] POST /compute/v2.1/servers/60694294-78ff-49f7-9d07-bb5915eae69e/action => generated 1109 bytes in 628 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 04 18:47:30.516149 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-af511aed-0180-465a-a9b0-09072bd2439c tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:30.517283 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-af511aed-0180-465a-a9b0-09072bd2439c tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] [instance: 317c7bd8-4f1e-4210-bb33-087557a1f4d6] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:30.525154 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-af511aed-0180-465a-a9b0-09072bd2439c tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:30.525992 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-af511aed-0180-465a-a9b0-09072bd2439c tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:30.526630 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-af511aed-0180-465a-a9b0-09072bd2439c tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:30.527557 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-af511aed-0180-465a-a9b0-09072bd2439c tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:30.528238 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-af511aed-0180-465a-a9b0-09072bd2439c tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:30.529779 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-af511aed-0180-465a-a9b0-09072bd2439c tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:30.671985 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b51c38a2-9665-464e-9241-6fd47416f0ab tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:30.683006 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b51c38a2-9665-464e-9241-6fd47416f0ab tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1504 microversion: 2.1 time: 0.367989 Oct 04 18:47:30.702034 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2178/4418] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:30 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1504 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:30.721134 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-af511aed-0180-465a-a9b0-09072bd2439c tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:30.739770 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-85ee8068-ca89-41dc-8ca3-19ba400bd165 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Action: 'create', calling method: .version_select at 0x7fe253cf5d30>, body: {"pool": "c44df1aa-f2af-499a-b6e4-d012aa353460"} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:30.747758 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-af511aed-0180-465a-a9b0-09072bd2439c tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:30.757271 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-af511aed-0180-465a-a9b0-09072bd2439c tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:30.761230 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-af511aed-0180-465a-a9b0-09072bd2439c tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] 10.222.0.20 "GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6" status: 200 len: 1528 microversion: 2.32 time: 0.247518 Oct 04 18:47:30.765938 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2241/4419] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:47:30 2022] GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6 => generated 1528 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:47:30.782122 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-adce8842-25b7-41af-943e-2782081f29e9 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:30.789028 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-adce8842-25b7-41af-943e-2782081f29e9 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: 60694294-78ff-49f7-9d07-bb5915eae69e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:30.809158 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-adce8842-25b7-41af-943e-2782081f29e9 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:30.811840 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-adce8842-25b7-41af-943e-2782081f29e9 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:30.812507 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-adce8842-25b7-41af-943e-2782081f29e9 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:30.815780 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-adce8842-25b7-41af-943e-2782081f29e9 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:30.819743 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-adce8842-25b7-41af-943e-2782081f29e9 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:30.820905 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-adce8842-25b7-41af-943e-2782081f29e9 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:31.200646 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-adce8842-25b7-41af-943e-2782081f29e9 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:31.214148 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-adce8842-25b7-41af-943e-2782081f29e9 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/60694294-78ff-49f7-9d07-bb5915eae69e" status: 200 len: 1514 microversion: 2.1 time: 0.445598 Oct 04 18:47:31.215336 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2242/4420] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:30 2022] GET /compute/v2.1/servers/60694294-78ff-49f7-9d07-bb5915eae69e => generated 1514 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:31.225780 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-31f3ff36-5352-4fd1-8d49-af1bc517d8f5 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1968038775", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": -1, "networks": [{"uuid": "334d1b7e-7632-43fb-8807-6117cf357d4f"}]}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:31.238885 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-31f3ff36-5352-4fd1-8d49-af1bc517d8f5 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] HTTP exception thrown: Flavor -1 could not be found. Oct 04 18:47:31.244560 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-31f3ff36-5352-4fd1-8d49-af1bc517d8f5 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Request method failure captured: Oct 04 18:47:31.244560 n-d-850501-14 devstack@n-api.service[123001]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:47:31.244560 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:47:31.244560 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:47:31.244560 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:47:31.244560 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 206 Oct 04 18:47:31.244560 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:47:31.244560 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:47:31.244560 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:47:31.244560 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:47:31.244560 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPH9zAVdj2h4kh6QqBpYrS2CJMhbcXf529VUNrZoZOYhS2tkLYBgw6AHy860DK9jQ3xATqZvC9lQuxt-_H5qKsAI41eznf32K6QSGqVcHXegpVHrDueww23ZMVCBM3D_hH0NTzh4447rgHqcrC-OZE48IfZrRJ9KPLPjAHT57T3mcPIc Oct 04 18:47:31.244560 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:47:31.244560 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:47:31.244560 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:47:31.244560 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:47:31.244560 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:47:31.244560 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:47:31.244560 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: b6c6b9deecde44b5953d22b38b5b0ff1 Oct 04 18:47:31.244560 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:47:31.244560 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:47:31.244560 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:47:31.244560 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6c6b9deecde44b5953d22b38b5b0ff1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b6c6b9deecde44b5953d22b38b5b0ff1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b6c6b9deecde44b5953d22b38b5b0ff1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6c6b9deecde44b5953d22b38b5b0ff1"}]}] Oct 04 18:47:31.244560 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:47:31.244560 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: b6c6b9deecde44b5953d22b38b5b0ff1 Oct 04 18:47:31.244560 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:47:31.244560 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ServersNegativeTestJSON-626077540-project Oct 04 18:47:31.244560 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:47:31.244560 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:47:31.244560 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 5b4eb70f22ba4872b890a4f160cc1805 Oct 04 18:47:31.244560 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ServersNegativeTestJSON-626077540-project Oct 04 18:47:31.244560 n-d-850501-14 devstack@n-api.service[123001]: Oct 04 18:47:31.244560 n-d-850501-14 devstack@n-api.service[123001]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1968038775", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": -1, "networks": [{"uuid": "334d1b7e-7632-43fb-8807-6117cf357d4f"}]}} Oct 04 18:47:31.244560 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:47:31.244560 n-d-850501-14 devstack@n-api.service[123001]: exception: Flavor -1 could not be found. Oct 04 18:47:31.244560 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1968038775', 'imageRef': 'f545e662-10b3-46b1-88bb-6e66dd294559', 'flavorRef': -1, 'networks': [{'uuid': '334d1b7e-7632-43fb-8807-6117cf357d4f'}]}}} Oct 04 18:47:31.244560 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:47:31.244560 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:31.244560 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 04 18:47:31.244560 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 04 18:47:31.244560 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 18:47:31.244560 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 18:47:31.244560 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:47:31.244560 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:47:31.244560 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 18:47:31.244560 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 18:47:31.244560 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 18:47:31.244560 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:47:31.244560 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 18:47:31.244560 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 18:47:31.244560 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Oct 04 18:47:31.244560 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:47:31.244560 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:31.244560 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:47:31.244560 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:31.244560 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:31.244560 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:31.244560 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:47:31.244560 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:47:31.244560 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:47:31.244560 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:47:31.244560 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:47:31.244560 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:47:31.253698 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:47:31.253698 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:47:31.253698 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:47:31.253698 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:47:31.253698 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 18:47:31.253698 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 04 18:47:31.253698 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 04 18:47:31.253698 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Oct 04 18:47:31.253698 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:47:31.253698 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:31.253698 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:47:31.253698 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:31.253698 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:31.253698 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:31.253698 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:47:31.253698 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:47:31.253698 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Oct 04 18:47:31.253698 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:47:31.253698 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-31f3ff36-5352-4fd1-8d49-af1bc517d8f5 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:47:31.253698 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-31f3ff36-5352-4fd1-8d49-af1bc517d8f5 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.029673 Oct 04 18:47:31.253698 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2243/4421] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:47:31 2022] POST /compute/v2.1/servers => generated 73 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 18:47:31.259087 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0eee232b-0ea1-472f-836c-1636dd1cbbdf tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:31.259714 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0eee232b-0ea1-472f-836c-1636dd1cbbdf tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:31.267901 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0eee232b-0ea1-472f-836c-1636dd1cbbdf tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:31.268702 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0eee232b-0ea1-472f-836c-1636dd1cbbdf tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:31.269155 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0eee232b-0ea1-472f-836c-1636dd1cbbdf tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:31.269876 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0eee232b-0ea1-472f-836c-1636dd1cbbdf tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:31.270338 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0eee232b-0ea1-472f-836c-1636dd1cbbdf tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:31.270776 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0eee232b-0ea1-472f-836c-1636dd1cbbdf tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:31.560591 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0eee232b-0ea1-472f-836c-1636dd1cbbdf tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:31.575545 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0eee232b-0ea1-472f-836c-1636dd1cbbdf tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1504 microversion: 2.1 time: 0.323789 Oct 04 18:47:31.577057 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2244/4422] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:31 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1504 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:31.606985 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-02427ad9-e34f-4a92-96cc-c15d74784a40 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:31.607815 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-02427ad9-e34f-4a92-96cc-c15d74784a40 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:31.621526 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-02427ad9-e34f-4a92-96cc-c15d74784a40 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:31.622357 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-02427ad9-e34f-4a92-96cc-c15d74784a40 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:31.622877 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-02427ad9-e34f-4a92-96cc-c15d74784a40 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:31.623676 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-02427ad9-e34f-4a92-96cc-c15d74784a40 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:31.624172 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-02427ad9-e34f-4a92-96cc-c15d74784a40 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:31.626018 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-02427ad9-e34f-4a92-96cc-c15d74784a40 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:31.917246 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-02427ad9-e34f-4a92-96cc-c15d74784a40 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:31.940971 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-02427ad9-e34f-4a92-96cc-c15d74784a40 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1504 microversion: 2.1 time: 0.335361 Oct 04 18:47:31.942831 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2245/4423] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:31 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1504 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:47:31.955707 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f04a33c7-acda-48cb-b842-49c6f2cebfd4 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:31.957462 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f04a33c7-acda-48cb-b842-49c6f2cebfd4 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] [instance: 317c7bd8-4f1e-4210-bb33-087557a1f4d6] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:31.973931 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f04a33c7-acda-48cb-b842-49c6f2cebfd4 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:31.974717 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f04a33c7-acda-48cb-b842-49c6f2cebfd4 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:31.976305 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f04a33c7-acda-48cb-b842-49c6f2cebfd4 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:31.977381 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f04a33c7-acda-48cb-b842-49c6f2cebfd4 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:31.978162 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f04a33c7-acda-48cb-b842-49c6f2cebfd4 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:31.978878 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f04a33c7-acda-48cb-b842-49c6f2cebfd4 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:32.106044 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f04a33c7-acda-48cb-b842-49c6f2cebfd4 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:32.121758 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f04a33c7-acda-48cb-b842-49c6f2cebfd4 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:32.124986 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f04a33c7-acda-48cb-b842-49c6f2cebfd4 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:32.127907 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f04a33c7-acda-48cb-b842-49c6f2cebfd4 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] 10.222.0.20 "GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6" status: 200 len: 1584 microversion: 2.32 time: 0.183947 Oct 04 18:47:32.129498 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2246/4424] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:47:31 2022] GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6 => generated 1584 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:47:32.166237 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-92b2e27b-fdd4-4096-9559-1192015af92a tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1091101712", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "334d1b7e-7632-43fb-8807-6117cf357d4f"}]}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:32.171665 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-92b2e27b-fdd4-4096-9559-1192015af92a tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Request method failure captured: Oct 04 18:47:32.171665 n-d-850501-14 devstack@n-api.service[123001]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:47:32.171665 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:47:32.171665 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:47:32.171665 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:47:32.171665 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 173 Oct 04 18:47:32.171665 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:47:32.171665 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:47:32.171665 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:47:32.171665 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:47:32.171665 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPH9zAVdj2h4kh6QqBpYrS2CJMhbcXf529VUNrZoZOYhS2tkLYBgw6AHy860DK9jQ3xATqZvC9lQuxt-_H5qKsAI41eznf32K6QSGqVcHXegpVHrDueww23ZMVCBM3D_hH0NTzh4447rgHqcrC-OZE48IfZrRJ9KPLPjAHT57T3mcPIc Oct 04 18:47:32.171665 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:47:32.171665 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:47:32.171665 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:47:32.171665 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:47:32.171665 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:47:32.171665 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:47:32.171665 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: b6c6b9deecde44b5953d22b38b5b0ff1 Oct 04 18:47:32.171665 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:47:32.171665 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:47:32.171665 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:47:32.171665 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6c6b9deecde44b5953d22b38b5b0ff1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b6c6b9deecde44b5953d22b38b5b0ff1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b6c6b9deecde44b5953d22b38b5b0ff1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6c6b9deecde44b5953d22b38b5b0ff1"}]}] Oct 04 18:47:32.171665 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:47:32.171665 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: b6c6b9deecde44b5953d22b38b5b0ff1 Oct 04 18:47:32.171665 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:47:32.171665 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ServersNegativeTestJSON-626077540-project Oct 04 18:47:32.171665 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:47:32.171665 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:47:32.171665 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 5b4eb70f22ba4872b890a4f160cc1805 Oct 04 18:47:32.171665 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ServersNegativeTestJSON-626077540-project Oct 04 18:47:32.171665 n-d-850501-14 devstack@n-api.service[123001]: Oct 04 18:47:32.171665 n-d-850501-14 devstack@n-api.service[123001]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1091101712", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "334d1b7e-7632-43fb-8807-6117cf357d4f"}]}} Oct 04 18:47:32.171665 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:47:32.171665 n-d-850501-14 devstack@n-api.service[123001]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 04 18:47:32.171665 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1091101712', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '334d1b7e-7632-43fb-8807-6117cf357d4f'}]}}} Oct 04 18:47:32.171665 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:47:32.171665 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:32.171665 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:47:32.171665 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:47:32.171665 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:47:32.171665 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:47:32.171665 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Oct 04 18:47:32.171665 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:47:32.171665 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Oct 04 18:47:32.171665 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Oct 04 18:47:32.171665 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Oct 04 18:47:32.171665 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:47:32.171665 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 18:47:32.171665 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi -1 Oct 04 18:47:32.171665 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:47:32.171665 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:32.171665 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:47:32.171665 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:32.171665 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:32.171665 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:32.171665 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:47:32.171665 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:47:32.171665 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:47:32.171665 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:47:32.171665 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:47:32.171665 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:47:32.171665 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:47:32.171665 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:47:32.171665 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:47:32.171665 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:47:32.176093 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:47:32.176093 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:47:32.176093 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 04 18:47:32.176093 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:47:32.176093 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:32.176093 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:47:32.176093 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:32.176093 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:32.176093 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:32.176093 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:47:32.176093 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:47:32.176093 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 04 18:47:32.176093 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:47:32.179325 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-92b2e27b-fdd4-4096-9559-1192015af92a tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:47:32.180403 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-92b2e27b-fdd4-4096-9559-1192015af92a tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.019314 Oct 04 18:47:32.184920 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2247/4425] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:47:32 2022] POST /compute/v2.1/servers => generated 145 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:47:32.191091 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0c7be9f9-2446-49dc-8048-068c97b41493 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:32.191901 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0c7be9f9-2446-49dc-8048-068c97b41493 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:32.202437 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0c7be9f9-2446-49dc-8048-068c97b41493 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:32.203102 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0c7be9f9-2446-49dc-8048-068c97b41493 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:32.203364 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0c7be9f9-2446-49dc-8048-068c97b41493 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:32.204102 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0c7be9f9-2446-49dc-8048-068c97b41493 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:32.204559 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0c7be9f9-2446-49dc-8048-068c97b41493 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:32.204987 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0c7be9f9-2446-49dc-8048-068c97b41493 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:32.232950 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:47:32.657917 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0c7be9f9-2446-49dc-8048-068c97b41493 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:32.669134 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0c7be9f9-2446-49dc-8048-068c97b41493 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1504 microversion: 2.1 time: 0.482822 Oct 04 18:47:32.670126 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2248/4426] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:32 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1504 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:32.675624 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ca431a44-2ca2-4f92-896c-b5cca119b186 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:32.676354 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ca431a44-2ca2-4f92-896c-b5cca119b186 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: 60694294-78ff-49f7-9d07-bb5915eae69e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:32.685754 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ca431a44-2ca2-4f92-896c-b5cca119b186 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:32.686339 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ca431a44-2ca2-4f92-896c-b5cca119b186 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:32.687001 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ca431a44-2ca2-4f92-896c-b5cca119b186 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:32.688046 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ca431a44-2ca2-4f92-896c-b5cca119b186 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:32.688605 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ca431a44-2ca2-4f92-896c-b5cca119b186 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:32.689142 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ca431a44-2ca2-4f92-896c-b5cca119b186 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:33.591103 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ca431a44-2ca2-4f92-896c-b5cca119b186 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:33.612070 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ca431a44-2ca2-4f92-896c-b5cca119b186 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/60694294-78ff-49f7-9d07-bb5915eae69e" status: 200 len: 1514 microversion: 2.1 time: 0.928528 Oct 04 18:47:33.612070 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2249/4427] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:32 2022] GET /compute/v2.1/servers/60694294-78ff-49f7-9d07-bb5915eae69e => generated 1514 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:33.612070 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-96890b6a-52a9-4bac-8b3e-bef3ed990d23 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:33.612070 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-96890b6a-52a9-4bac-8b3e-bef3ed990d23 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:33.621622 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-96890b6a-52a9-4bac-8b3e-bef3ed990d23 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:33.622121 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-96890b6a-52a9-4bac-8b3e-bef3ed990d23 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:33.622550 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-96890b6a-52a9-4bac-8b3e-bef3ed990d23 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:33.623264 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-96890b6a-52a9-4bac-8b3e-bef3ed990d23 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:33.623713 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-96890b6a-52a9-4bac-8b3e-bef3ed990d23 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:33.624147 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-96890b6a-52a9-4bac-8b3e-bef3ed990d23 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:34.029511 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-96890b6a-52a9-4bac-8b3e-bef3ed990d23 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:34.045315 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-96890b6a-52a9-4bac-8b3e-bef3ed990d23 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1504 microversion: 2.1 time: 0.435948 Oct 04 18:47:34.045315 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2250/4428] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:33 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1504 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:34.062644 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-30ff3fdb-f964-4025-854c-1ebe84fa4126 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:34.077754 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-30ff3fdb-f964-4025-854c-1ebe84fa4126 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] [instance: 317c7bd8-4f1e-4210-bb33-087557a1f4d6] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:34.099669 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-30ff3fdb-f964-4025-854c-1ebe84fa4126 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:34.101890 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-30ff3fdb-f964-4025-854c-1ebe84fa4126 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:34.103371 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-30ff3fdb-f964-4025-854c-1ebe84fa4126 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:34.106468 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-30ff3fdb-f964-4025-854c-1ebe84fa4126 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:34.106980 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-30ff3fdb-f964-4025-854c-1ebe84fa4126 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:34.110403 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-30ff3fdb-f964-4025-854c-1ebe84fa4126 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:34.736648 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-30ff3fdb-f964-4025-854c-1ebe84fa4126 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:34.752851 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-30ff3fdb-f964-4025-854c-1ebe84fa4126 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:34.755460 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-30ff3fdb-f964-4025-854c-1ebe84fa4126 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:34.757817 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-30ff3fdb-f964-4025-854c-1ebe84fa4126 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] 10.222.0.20 "GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6" status: 200 len: 1662 microversion: 2.32 time: 0.717142 Oct 04 18:47:34.774855 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2251/4429] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:47:34 2022] GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6 => generated 1662 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:47:34.790864 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a3afdbda-bcd3-4ac3-8f5f-7aed985420d7 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1981026181", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:34.797739 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-a3afdbda-bcd3-4ac3-8f5f-7aed985420d7 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 04 18:47:34.799668 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a3afdbda-bcd3-4ac3-8f5f-7aed985420d7 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Request method failure captured: Oct 04 18:47:34.799668 n-d-850501-14 devstack@n-api.service[123001]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:47:34.799668 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:47:34.799668 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:47:34.799668 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:47:34.799668 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 216 Oct 04 18:47:34.799668 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:47:34.799668 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:47:34.799668 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:47:34.799668 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:47:34.799668 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPH9zAVdj2h4kh6QqBpYrS2CJMhbcXf529VUNrZoZOYhS2tkLYBgw6AHy860DK9jQ3xATqZvC9lQuxt-_H5qKsAI41eznf32K6QSGqVcHXegpVHrDueww23ZMVCBM3D_hH0NTzh4447rgHqcrC-OZE48IfZrRJ9KPLPjAHT57T3mcPIc Oct 04 18:47:34.799668 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:47:34.799668 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:47:34.799668 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:47:34.799668 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:47:34.799668 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:47:34.799668 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:47:34.799668 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: b6c6b9deecde44b5953d22b38b5b0ff1 Oct 04 18:47:34.799668 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:47:34.799668 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:47:34.799668 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:47:34.799668 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6c6b9deecde44b5953d22b38b5b0ff1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b6c6b9deecde44b5953d22b38b5b0ff1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b6c6b9deecde44b5953d22b38b5b0ff1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6c6b9deecde44b5953d22b38b5b0ff1"}]}] Oct 04 18:47:34.799668 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:47:34.799668 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: b6c6b9deecde44b5953d22b38b5b0ff1 Oct 04 18:47:34.799668 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:47:34.799668 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ServersNegativeTestJSON-626077540-project Oct 04 18:47:34.799668 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:47:34.799668 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:47:34.799668 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 5b4eb70f22ba4872b890a4f160cc1805 Oct 04 18:47:34.799668 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ServersNegativeTestJSON-626077540-project Oct 04 18:47:34.799668 n-d-850501-14 devstack@n-api.service[123001]: Oct 04 18:47:34.799668 n-d-850501-14 devstack@n-api.service[123001]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1981026181", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Oct 04 18:47:34.799668 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:47:34.799668 n-d-850501-14 devstack@n-api.service[123001]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 04 18:47:34.799668 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1981026181', 'imageRef': 'f545e662-10b3-46b1-88bb-6e66dd294559', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Oct 04 18:47:34.799668 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:47:34.799668 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:34.799668 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:34.799668 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:34.799668 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:47:34.799668 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:47:34.799668 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:47:34.799668 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:47:34.799668 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:47:34.799668 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:47:34.799668 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:47:34.799668 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:47:34.799668 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:47:34.799668 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:47:34.799668 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 18:47:34.799668 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Oct 04 18:47:34.799668 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Oct 04 18:47:34.799668 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Oct 04 18:47:34.799668 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Oct 04 18:47:34.799668 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Oct 04 18:47:34.799668 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self._validate_network_id( Oct 04 18:47:34.799668 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Oct 04 18:47:34.799668 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 04 18:47:34.799668 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 04 18:47:34.799668 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:47:34.799668 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:34.799668 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:47:34.803302 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:34.803302 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:34.803302 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:34.803302 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:47:34.803302 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:47:34.803302 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 04 18:47:34.803302 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:47:34.808664 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a3afdbda-bcd3-4ac3-8f5f-7aed985420d7 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:47:34.814941 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a3afdbda-bcd3-4ac3-8f5f-7aed985420d7 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.030087 Oct 04 18:47:34.819473 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2252/4430] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:47:34 2022] POST /compute/v2.1/servers => generated 123 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:47:34.835112 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0c108ee3-6758-4e36-8773-d79ad2d148cd tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:34.839109 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0c108ee3-6758-4e36-8773-d79ad2d148cd tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: 60694294-78ff-49f7-9d07-bb5915eae69e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:34.863394 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0c108ee3-6758-4e36-8773-d79ad2d148cd tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:34.866546 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0c108ee3-6758-4e36-8773-d79ad2d148cd tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:34.867949 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0c108ee3-6758-4e36-8773-d79ad2d148cd tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:34.870316 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0c108ee3-6758-4e36-8773-d79ad2d148cd tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:34.876975 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0c108ee3-6758-4e36-8773-d79ad2d148cd tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:34.876975 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0c108ee3-6758-4e36-8773-d79ad2d148cd tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:34.891665 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-85ee8068-ca89-41dc-8ca3-19ba400bd165 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.187842 Oct 04 18:47:34.901460 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2179/4431] 10.222.0.20 () {60 vars in 1170 bytes} [Tue Oct 4 18:47:30 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:47:34.909615 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-18059d44-5561-4184-b97a-394ad19c3305 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:34.910390 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-18059d44-5561-4184-b97a-394ad19c3305 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:34.934913 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-18059d44-5561-4184-b97a-394ad19c3305 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:34.935499 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-18059d44-5561-4184-b97a-394ad19c3305 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:34.940525 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-18059d44-5561-4184-b97a-394ad19c3305 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:34.940525 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-18059d44-5561-4184-b97a-394ad19c3305 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:34.940525 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-18059d44-5561-4184-b97a-394ad19c3305 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:34.940525 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-18059d44-5561-4184-b97a-394ad19c3305 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:35.375196 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0c108ee3-6758-4e36-8773-d79ad2d148cd tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:35.394374 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0c108ee3-6758-4e36-8773-d79ad2d148cd tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/60694294-78ff-49f7-9d07-bb5915eae69e" status: 200 len: 1514 microversion: 2.1 time: 0.575714 Oct 04 18:47:35.396319 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2253/4432] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:34 2022] GET /compute/v2.1/servers/60694294-78ff-49f7-9d07-bb5915eae69e => generated 1514 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:35.417634 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d598d784-b200-42ee-a02b-d3b8c62e0642 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.1.34"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:35.425499 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d598d784-b200-42ee-a02b-d3b8c62e0642 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] [instance: 89ad7c7f-cba8-4fbe-8442-63a74c482c6b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:35.447303 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d598d784-b200-42ee-a02b-d3b8c62e0642 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:35.453509 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-18059d44-5561-4184-b97a-394ad19c3305 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:35.464361 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d598d784-b200-42ee-a02b-d3b8c62e0642 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:35.464993 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d598d784-b200-42ee-a02b-d3b8c62e0642 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:35.465747 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d598d784-b200-42ee-a02b-d3b8c62e0642 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:35.466436 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d598d784-b200-42ee-a02b-d3b8c62e0642 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:35.467142 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d598d784-b200-42ee-a02b-d3b8c62e0642 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:35.471682 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-18059d44-5561-4184-b97a-394ad19c3305 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1504 microversion: 2.1 time: 0.574529 Oct 04 18:47:35.471682 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2180/4433] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:34 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1504 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:35.498214 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-99601ae0-66af-4a21-8e59-2a847bccc459 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:35.500742 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-99601ae0-66af-4a21-8e59-2a847bccc459 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:35.508341 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-99601ae0-66af-4a21-8e59-2a847bccc459 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:35.509293 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-99601ae0-66af-4a21-8e59-2a847bccc459 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:35.509949 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-99601ae0-66af-4a21-8e59-2a847bccc459 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:35.511157 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-99601ae0-66af-4a21-8e59-2a847bccc459 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:35.511802 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-99601ae0-66af-4a21-8e59-2a847bccc459 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:35.512438 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-99601ae0-66af-4a21-8e59-2a847bccc459 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:35.521194 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d598d784-b200-42ee-a02b-d3b8c62e0642 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Acquiring lock "refresh_cache-89ad7c7f-cba8-4fbe-8442-63a74c482c6b" {{(pid=123001) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 18:47:35.523234 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d598d784-b200-42ee-a02b-d3b8c62e0642 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Acquired lock "refresh_cache-89ad7c7f-cba8-4fbe-8442-63a74c482c6b" {{(pid=123001) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 18:47:36.132444 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-99601ae0-66af-4a21-8e59-2a847bccc459 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:36.141103 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:47:36.145461 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-99601ae0-66af-4a21-8e59-2a847bccc459 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1504 microversion: 2.1 time: 0.653298 Oct 04 18:47:36.165669 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2181/4434] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:35 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1504 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:36.181998 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-78a4c04e-1da4-4392-939d-4d9c338f600b tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:36.184967 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-78a4c04e-1da4-4392-939d-4d9c338f600b tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] [instance: 317c7bd8-4f1e-4210-bb33-087557a1f4d6] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:36.201686 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-78a4c04e-1da4-4392-939d-4d9c338f600b tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:36.203884 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-78a4c04e-1da4-4392-939d-4d9c338f600b tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:36.204681 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-78a4c04e-1da4-4392-939d-4d9c338f600b tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:36.206832 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-78a4c04e-1da4-4392-939d-4d9c338f600b tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:36.218872 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-78a4c04e-1da4-4392-939d-4d9c338f600b tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:36.219688 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-78a4c04e-1da4-4392-939d-4d9c338f600b tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:36.730807 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:47:36.755319 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-78a4c04e-1da4-4392-939d-4d9c338f600b tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:36.769442 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-78a4c04e-1da4-4392-939d-4d9c338f600b tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:36.771779 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-78a4c04e-1da4-4392-939d-4d9c338f600b tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:36.773920 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-78a4c04e-1da4-4392-939d-4d9c338f600b tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] 10.222.0.20 "GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6" status: 200 len: 1756 microversion: 2.32 time: 0.604861 Oct 04 18:47:36.778084 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2182/4435] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:47:36 2022] GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6 => generated 1756 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:47:36.790706 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-dd778311-011e-404d-95d5-73f4e823a923 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:36.791337 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-dd778311-011e-404d-95d5-73f4e823a923 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: 60694294-78ff-49f7-9d07-bb5915eae69e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:36.802755 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dd778311-011e-404d-95d5-73f4e823a923 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:36.806958 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dd778311-011e-404d-95d5-73f4e823a923 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:36.809146 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dd778311-011e-404d-95d5-73f4e823a923 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:36.813758 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dd778311-011e-404d-95d5-73f4e823a923 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:36.814420 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dd778311-011e-404d-95d5-73f4e823a923 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:36.815174 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dd778311-011e-404d-95d5-73f4e823a923 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:36.835834 n-d-850501-14 devstack@n-api.service[123001]: DEBUG neutronclient.v2_0.client [None req-d598d784-b200-42ee-a02b-d3b8c62e0642 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.1.34 (3c1fb2f8-6185-4c57-a50d-cff26c0a3556) with port 48ca997a-f5b9-4dbe-8306-95ea1bef682b using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network c44df1aa-f2af-499a-b6e4-d012aa353460.", "detail": ""}} {{(pid=123001) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:47:36.837976 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d598d784-b200-42ee-a02b-d3b8c62e0642 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Releasing lock "refresh_cache-89ad7c7f-cba8-4fbe-8442-63a74c482c6b" {{(pid=123001) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 18:47:36.840695 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-d598d784-b200-42ee-a02b-d3b8c62e0642 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] HTTP exception thrown: Cannot associate floating IP 172.25.1.34 (3c1fb2f8-6185-4c57-a50d-cff26c0a3556) with port 48ca997a-f5b9-4dbe-8306-95ea1bef682b using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network c44df1aa-f2af-499a-b6e4-d012aa353460. Oct 04 18:47:36.840695 n-d-850501-14 devstack@n-api.service[123001]: Neutron server returns request_ids: ['req-a3dc75a1-f397-4496-9dca-a0768ea96b12'] Oct 04 18:47:36.845770 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d598d784-b200-42ee-a02b-d3b8c62e0642 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Request method failure captured: Oct 04 18:47:36.845770 n-d-850501-14 devstack@n-api.service[123001]: request: POST /compute/v2.1/servers/89ad7c7f-cba8-4fbe-8442-63a74c482c6b/action HTTP/1.1 Oct 04 18:47:36.845770 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:47:36.845770 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:47:36.845770 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:47:36.845770 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 45 Oct 04 18:47:36.845770 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:47:36.845770 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:47:36.845770 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:47:36.845770 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:47:36.845770 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPH-iHdlfIs8wUZ8D13z2XqYsPOmHk20-rCkSWPnuA-n6pjNAtEvLYTycHlthpYrA0CWkfc_Pcer2VGB2UiVmHgYJJnfG6Qx9QxIT0Yc0m5vU1an7o1snrk-vvplhYOk62QzkkiDeurqhqaBAaL-x1ajV-4MWIhKCk1GvrLRGJkadaxA Oct 04 18:47:36.845770 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:47:36.845770 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:47:36.845770 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:47:36.845770 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:47:36.845770 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:47:36.845770 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:47:36.845770 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 7917de0ff5be4d238981ea714d837fe0 Oct 04 18:47:36.845770 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 Oct 04 18:47:36.845770 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:47:36.845770 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:47:36.845770 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7917de0ff5be4d238981ea714d837fe0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7917de0ff5be4d238981ea714d837fe0", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7917de0ff5be4d238981ea714d837fe0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7917de0ff5be4d238981ea714d837fe0"}]}] Oct 04 18:47:36.845770 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 Oct 04 18:47:36.845770 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 7917de0ff5be4d238981ea714d837fe0 Oct 04 18:47:36.845770 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 Oct 04 18:47:36.845770 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project Oct 04 18:47:36.845770 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:47:36.845770 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:47:36.845770 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 4cce9172582d4efd8fc31251d4bfe63c Oct 04 18:47:36.845770 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project Oct 04 18:47:36.845770 n-d-850501-14 devstack@n-api.service[123001]: Oct 04 18:47:36.845770 n-d-850501-14 devstack@n-api.service[123001]: {"addFloatingIp": {"address": "172.25.1.34"}} Oct 04 18:47:36.845770 n-d-850501-14 devstack@n-api.service[123001]: method: Oct 04 18:47:36.845770 n-d-850501-14 devstack@n-api.service[123001]: exception: Cannot associate floating IP 172.25.1.34 (3c1fb2f8-6185-4c57-a50d-cff26c0a3556) with port 48ca997a-f5b9-4dbe-8306-95ea1bef682b using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network c44df1aa-f2af-499a-b6e4-d012aa353460. Oct 04 18:47:36.845770 n-d-850501-14 devstack@n-api.service[123001]: Neutron server returns request_ids: ['req-a3dc75a1-f397-4496-9dca-a0768ea96b12'] Oct 04 18:47:36.845770 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '89ad7c7f-cba8-4fbe-8442-63a74c482c6b', 'body': {'addFloatingIp': {'address': '172.25.1.34'}}} Oct 04 18:47:36.845770 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:47:36.845770 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:36.845770 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Oct 04 18:47:36.845770 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Oct 04 18:47:36.845770 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:47:36.845770 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:47:36.845770 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Oct 04 18:47:36.845770 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Oct 04 18:47:36.845770 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:47:36.845770 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:47:36.845770 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Oct 04 18:47:36.845770 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Oct 04 18:47:36.845770 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:47:36.845770 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:47:36.845770 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Oct 04 18:47:36.845770 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Oct 04 18:47:36.845770 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:47:36.845770 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:47:36.845770 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:47:36.845770 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:47:36.845770 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:47:36.845770 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:47:36.845770 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:47:36.845770 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:47:36.849335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:47:36.849335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:47:36.849335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:47:36.849335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:47:36.849335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:47:36.849335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:47:36.849335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.1.34 (3c1fb2f8-6185-4c57-a50d-cff26c0a3556) with port 48ca997a-f5b9-4dbe-8306-95ea1bef682b using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network c44df1aa-f2af-499a-b6e4-d012aa353460. Oct 04 18:47:36.849335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a3dc75a1-f397-4496-9dca-a0768ea96b12'] Oct 04 18:47:36.849335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:47:36.849335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:36.849335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:47:36.849335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:36.849335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 04 18:47:36.849335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 04 18:47:36.849335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 04 18:47:36.849335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 04 18:47:36.849335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Oct 04 18:47:36.849335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Oct 04 18:47:36.849335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.1.34 (3c1fb2f8-6185-4c57-a50d-cff26c0a3556) with port 48ca997a-f5b9-4dbe-8306-95ea1bef682b using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network c44df1aa-f2af-499a-b6e4-d012aa353460. Oct 04 18:47:36.849335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a3dc75a1-f397-4496-9dca-a0768ea96b12'] Oct 04 18:47:36.849335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:47:36.849335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:36.849335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:47:36.849335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:36.849335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:36.849335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:36.849335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:47:36.849335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:47:36.849335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:47:36.849335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:47:36.849335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:47:36.849335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:47:36.849335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:47:36.849335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:47:36.849335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Oct 04 18:47:36.849335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Oct 04 18:47:36.849335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.1.34 (3c1fb2f8-6185-4c57-a50d-cff26c0a3556) with port 48ca997a-f5b9-4dbe-8306-95ea1bef682b using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network c44df1aa-f2af-499a-b6e4-d012aa353460. Oct 04 18:47:36.849335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a3dc75a1-f397-4496-9dca-a0768ea96b12'] Oct 04 18:47:36.849335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:47:36.849335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:36.849335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:47:36.849335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:36.849335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:36.849335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:36.849335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:47:36.849335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:47:36.849335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.1.34 (3c1fb2f8-6185-4c57-a50d-cff26c0a3556) with port 48ca997a-f5b9-4dbe-8306-95ea1bef682b using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network c44df1aa-f2af-499a-b6e4-d012aa353460. Oct 04 18:47:36.849335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a3dc75a1-f397-4496-9dca-a0768ea96b12'] Oct 04 18:47:36.849335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:47:36.855964 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d598d784-b200-42ee-a02b-d3b8c62e0642 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Returning 400 to user: Cannot associate floating IP 172.25.1.34 (3c1fb2f8-6185-4c57-a50d-cff26c0a3556) with port 48ca997a-f5b9-4dbe-8306-95ea1bef682b using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network c44df1aa-f2af-499a-b6e4-d012aa353460. Oct 04 18:47:36.855964 n-d-850501-14 devstack@n-api.service[123001]: Neutron server returns request_ids: ['req-a3dc75a1-f397-4496-9dca-a0768ea96b12'] {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:47:36.857921 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d598d784-b200-42ee-a02b-d3b8c62e0642 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] 10.222.0.20 "POST /compute/v2.1/servers/89ad7c7f-cba8-4fbe-8442-63a74c482c6b/action" status: 400 len: 381 microversion: 2.1 time: 1.458189 Oct 04 18:47:36.862592 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2254/4436] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:47:35 2022] POST /compute/v2.1/servers/89ad7c7f-cba8-4fbe-8442-63a74c482c6b/action => generated 381 bytes in 1464 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:47:36.875762 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-efc88fe4-51d6-4ce6-9632-0cdab6f30605 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-666390776", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "key_name": "tempest-key-126249800", "networks": [{"uuid": "334d1b7e-7632-43fb-8807-6117cf357d4f"}]}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:36.967684 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.neutron [None req-efc88fe4-51d6-4ce6-9632-0cdab6f30605 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] validate_networks() for [('334d1b7e-7632-43fb-8807-6117cf357d4f', None, None, None, None, None)] {{(pid=123001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:47:37.215371 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-dd778311-011e-404d-95d5-73f4e823a923 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:37.223978 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-dd778311-011e-404d-95d5-73f4e823a923 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/60694294-78ff-49f7-9d07-bb5915eae69e" status: 200 len: 1514 microversion: 2.1 time: 0.444522 Oct 04 18:47:37.226502 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2183/4437] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:36 2022] GET /compute/v2.1/servers/60694294-78ff-49f7-9d07-bb5915eae69e => generated 1514 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:37.231492 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-95495e0c-4c07-4f6d-8e99-97a14162ae13 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Calling method '.version_select at 0x7fe253ca9790>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:37.848727 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-efc88fe4-51d6-4ce6-9632-0cdab6f30605 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] HTTP exception thrown: Invalid key_name provided. Oct 04 18:47:37.853030 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-efc88fe4-51d6-4ce6-9632-0cdab6f30605 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Request method failure captured: Oct 04 18:47:37.853030 n-d-850501-14 devstack@n-api.service[123001]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:47:37.853030 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:47:37.853030 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:47:37.853030 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:47:37.853030 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 245 Oct 04 18:47:37.853030 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:47:37.853030 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:47:37.853030 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:47:37.853030 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:47:37.853030 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPH9zAVdj2h4kh6QqBpYrS2CJMhbcXf529VUNrZoZOYhS2tkLYBgw6AHy860DK9jQ3xATqZvC9lQuxt-_H5qKsAI41eznf32K6QSGqVcHXegpVHrDueww23ZMVCBM3D_hH0NTzh4447rgHqcrC-OZE48IfZrRJ9KPLPjAHT57T3mcPIc Oct 04 18:47:37.853030 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:47:37.853030 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:47:37.853030 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:47:37.853030 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:47:37.853030 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:47:37.853030 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:47:37.853030 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: b6c6b9deecde44b5953d22b38b5b0ff1 Oct 04 18:47:37.853030 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:47:37.853030 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:47:37.853030 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:47:37.853030 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6c6b9deecde44b5953d22b38b5b0ff1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b6c6b9deecde44b5953d22b38b5b0ff1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b6c6b9deecde44b5953d22b38b5b0ff1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6c6b9deecde44b5953d22b38b5b0ff1"}]}] Oct 04 18:47:37.853030 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:47:37.853030 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: b6c6b9deecde44b5953d22b38b5b0ff1 Oct 04 18:47:37.853030 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:47:37.853030 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ServersNegativeTestJSON-626077540-project Oct 04 18:47:37.853030 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:47:37.853030 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:47:37.853030 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 5b4eb70f22ba4872b890a4f160cc1805 Oct 04 18:47:37.853030 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ServersNegativeTestJSON-626077540-project Oct 04 18:47:37.853030 n-d-850501-14 devstack@n-api.service[123001]: Oct 04 18:47:37.853030 n-d-850501-14 devstack@n-api.service[123001]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-666390776", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "key_name": "tempest-key-126249800", "networks": [{"uuid": "334d1b7e-7632-43fb-8807-6117cf357d4f"}]}} Oct 04 18:47:37.853030 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:47:37.853030 n-d-850501-14 devstack@n-api.service[123001]: exception: Invalid key_name provided. Oct 04 18:47:37.853030 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-666390776', 'imageRef': 'f545e662-10b3-46b1-88bb-6e66dd294559', 'flavorRef': '452', 'key_name': 'tempest-key-126249800', 'networks': [{'uuid': '334d1b7e-7632-43fb-8807-6117cf357d4f'}]}}} Oct 04 18:47:37.853030 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:47:37.853030 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:37.853030 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 18:47:37.853030 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 18:47:37.853030 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 18:47:37.853030 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 18:47:37.853030 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 18:47:37.853030 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 18:47:37.853030 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Oct 04 18:47:37.853030 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Oct 04 18:47:37.853030 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:47:37.853030 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:47:37.853030 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 04 18:47:37.853030 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 04 18:47:37.853030 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 04 18:47:37.853030 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 04 18:47:37.853030 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:47:37.853030 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:47:37.853030 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 04 18:47:37.853030 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 04 18:47:37.853030 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-126249800 not found for user 5b4eb70f22ba4872b890a4f160cc1805 Oct 04 18:47:37.853030 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:47:37.853030 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:37.853030 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:47:37.853030 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:37.853030 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:37.858205 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:37.858205 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:47:37.858205 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:47:37.858205 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:47:37.858205 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:47:37.858205 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:47:37.858205 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:47:37.858205 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:47:37.858205 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:47:37.858205 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:47:37.858205 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:47:37.858205 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 18:47:37.858205 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Oct 04 18:47:37.858205 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 04 18:47:37.858205 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Oct 04 18:47:37.858205 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:47:37.858205 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:37.858205 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:47:37.858205 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:37.858205 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:37.858205 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:37.858205 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:47:37.858205 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:47:37.858205 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Oct 04 18:47:37.858205 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:47:37.865966 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-efc88fe4-51d6-4ce6-9632-0cdab6f30605 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Returning 400 to user: Invalid key_name provided. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:47:37.867515 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-efc88fe4-51d6-4ce6-9632-0cdab6f30605 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 1.002407 Oct 04 18:47:37.869341 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2255/4438] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:47:36 2022] POST /compute/v2.1/servers => generated 70 bytes in 1006 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 18:47:37.876491 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5b03c767-ac25-4393-b094-81e1dab28376 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:37.876491 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5b03c767-ac25-4393-b094-81e1dab28376 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] [instance: 317c7bd8-4f1e-4210-bb33-087557a1f4d6] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:37.884365 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5b03c767-ac25-4393-b094-81e1dab28376 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:37.940085 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5b03c767-ac25-4393-b094-81e1dab28376 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:37.940085 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5b03c767-ac25-4393-b094-81e1dab28376 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:37.940085 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5b03c767-ac25-4393-b094-81e1dab28376 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:37.940085 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5b03c767-ac25-4393-b094-81e1dab28376 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:37.940085 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5b03c767-ac25-4393-b094-81e1dab28376 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:38.251228 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5b03c767-ac25-4393-b094-81e1dab28376 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:38.270684 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5b03c767-ac25-4393-b094-81e1dab28376 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:38.273280 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5b03c767-ac25-4393-b094-81e1dab28376 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:38.274752 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5b03c767-ac25-4393-b094-81e1dab28376 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] 10.222.0.20 "GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6" status: 200 len: 1756 microversion: 2.32 time: 0.404030 Oct 04 18:47:38.275517 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2256/4439] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:47:37 2022] GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6 => generated 1756 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:47:38.292685 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-fddf0946-7fe3-4a1a-a909-c3cf1c0b0463 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:38.293845 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-fddf0946-7fe3-4a1a-a909-c3cf1c0b0463 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:38.303511 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fddf0946-7fe3-4a1a-a909-c3cf1c0b0463 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:38.304005 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fddf0946-7fe3-4a1a-a909-c3cf1c0b0463 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:38.305532 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fddf0946-7fe3-4a1a-a909-c3cf1c0b0463 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:38.306582 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fddf0946-7fe3-4a1a-a909-c3cf1c0b0463 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:38.307050 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fddf0946-7fe3-4a1a-a909-c3cf1c0b0463 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:38.307485 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fddf0946-7fe3-4a1a-a909-c3cf1c0b0463 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:38.704647 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-fddf0946-7fe3-4a1a-a909-c3cf1c0b0463 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:38.720149 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-fddf0946-7fe3-4a1a-a909-c3cf1c0b0463 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1504 microversion: 2.1 time: 0.443259 Oct 04 18:47:38.723030 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2257/4440] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:38 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1504 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:38.752431 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ac0246a2-6817-407a-aca2-854c54bb0a91 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:38.752431 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ac0246a2-6817-407a-aca2-854c54bb0a91 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: 60694294-78ff-49f7-9d07-bb5915eae69e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:38.760547 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ac0246a2-6817-407a-aca2-854c54bb0a91 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:38.766088 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ac0246a2-6817-407a-aca2-854c54bb0a91 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:38.772873 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ac0246a2-6817-407a-aca2-854c54bb0a91 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:38.772873 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ac0246a2-6817-407a-aca2-854c54bb0a91 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:38.772873 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ac0246a2-6817-407a-aca2-854c54bb0a91 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:38.772873 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ac0246a2-6817-407a-aca2-854c54bb0a91 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:38.907234 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=8 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:47:39.045482 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ac0246a2-6817-407a-aca2-854c54bb0a91 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:39.053890 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ac0246a2-6817-407a-aca2-854c54bb0a91 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/60694294-78ff-49f7-9d07-bb5915eae69e" status: 200 len: 1514 microversion: 2.1 time: 0.324714 Oct 04 18:47:39.055081 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2258/4441] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:38 2022] GET /compute/v2.1/servers/60694294-78ff-49f7-9d07-bb5915eae69e => generated 1514 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:39.063653 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-087b1c54-ddfb-45b8-ba99-5242d1d671ed tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:39.065316 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-087b1c54-ddfb-45b8-ba99-5242d1d671ed tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:39.089475 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-087b1c54-ddfb-45b8-ba99-5242d1d671ed tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:39.090187 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-087b1c54-ddfb-45b8-ba99-5242d1d671ed tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:39.092480 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-087b1c54-ddfb-45b8-ba99-5242d1d671ed tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:39.093414 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-087b1c54-ddfb-45b8-ba99-5242d1d671ed tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:39.096972 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-087b1c54-ddfb-45b8-ba99-5242d1d671ed tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:39.099103 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-087b1c54-ddfb-45b8-ba99-5242d1d671ed tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:39.370824 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-95495e0c-4c07-4f6d-8e99-97a14162ae13 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/3c1fb2f8-6185-4c57-a50d-cff26c0a3556" status: 202 len: 0 microversion: 2.1 time: 2.142933 Oct 04 18:47:39.371810 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2184/4442] 10.222.0.20 () {58 vars in 1263 bytes} [Tue Oct 4 18:47:37 2022] DELETE /compute/v2.1/os-floating-ips/3c1fb2f8-6185-4c57-a50d-cff26c0a3556 => generated 0 bytes in 2145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:47:39.377223 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b2e5dbe0-0530-474a-a199-bcdcd45258e3 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:39.377856 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b2e5dbe0-0530-474a-a199-bcdcd45258e3 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] [instance: 317c7bd8-4f1e-4210-bb33-087557a1f4d6] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:39.393711 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-087b1c54-ddfb-45b8-ba99-5242d1d671ed tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:39.403150 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b2e5dbe0-0530-474a-a199-bcdcd45258e3 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:39.403150 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b2e5dbe0-0530-474a-a199-bcdcd45258e3 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:39.403150 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b2e5dbe0-0530-474a-a199-bcdcd45258e3 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:39.403150 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b2e5dbe0-0530-474a-a199-bcdcd45258e3 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:39.403150 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b2e5dbe0-0530-474a-a199-bcdcd45258e3 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:39.403150 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b2e5dbe0-0530-474a-a199-bcdcd45258e3 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:39.403744 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-087b1c54-ddfb-45b8-ba99-5242d1d671ed tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1504 microversion: 2.1 time: 0.344516 Oct 04 18:47:39.403860 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2259/4443] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:39 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1504 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:39.408805 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-fef2f39f-d743-4a9a-94c2-ae9cf65f806c tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.1.20"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:39.764270 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-fef2f39f-d743-4a9a-94c2-ae9cf65f806c tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] [instance: 89ad7c7f-cba8-4fbe-8442-63a74c482c6b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:39.782097 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fef2f39f-d743-4a9a-94c2-ae9cf65f806c tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:39.786559 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fef2f39f-d743-4a9a-94c2-ae9cf65f806c tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:39.786559 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fef2f39f-d743-4a9a-94c2-ae9cf65f806c tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:39.786559 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fef2f39f-d743-4a9a-94c2-ae9cf65f806c tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:39.786559 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fef2f39f-d743-4a9a-94c2-ae9cf65f806c tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:39.787934 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b2e5dbe0-0530-474a-a199-bcdcd45258e3 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:39.789499 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fef2f39f-d743-4a9a-94c2-ae9cf65f806c tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:39.809292 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b2e5dbe0-0530-474a-a199-bcdcd45258e3 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:39.813420 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b2e5dbe0-0530-474a-a199-bcdcd45258e3 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:39.814882 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b2e5dbe0-0530-474a-a199-bcdcd45258e3 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] 10.222.0.20 "GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6" status: 200 len: 1803 microversion: 2.32 time: 0.441932 Oct 04 18:47:39.815629 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2185/4444] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:47:39 2022] GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6 => generated 1803 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:47:39.826136 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-29531ae7-3585-4f3e-b18e-bac1b4419843 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1236327233", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "334d1b7e-7632-43fb-8807-6117cf357d4f"}]}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:40.033131 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.security_group_api [None req-29531ae7-3585-4f3e-b18e-bac1b4419843 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Neutron security group does_not_exist not found {{(pid=123002) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Oct 04 18:47:40.034317 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-29531ae7-3585-4f3e-b18e-bac1b4419843 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Oct 04 18:47:40.044957 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-29531ae7-3585-4f3e-b18e-bac1b4419843 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Request method failure captured: Oct 04 18:47:40.044957 n-d-850501-14 devstack@n-api.service[123002]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:47:40.044957 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:47:40.044957 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:47:40.044957 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:47:40.044957 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 258 Oct 04 18:47:40.044957 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:47:40.044957 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:47:40.044957 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:47:40.044957 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:47:40.044957 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH9zAVdj2h4kh6QqBpYrS2CJMhbcXf529VUNrZoZOYhS2tkLYBgw6AHy860DK9jQ3xATqZvC9lQuxt-_H5qKsAI41eznf32K6QSGqVcHXegpVHrDueww23ZMVCBM3D_hH0NTzh4447rgHqcrC-OZE48IfZrRJ9KPLPjAHT57T3mcPIc Oct 04 18:47:40.044957 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:47:40.044957 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:47:40.044957 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:47:40.044957 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:47:40.044957 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:47:40.044957 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:47:40.044957 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: b6c6b9deecde44b5953d22b38b5b0ff1 Oct 04 18:47:40.044957 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:47:40.044957 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:47:40.044957 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:47:40.044957 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6c6b9deecde44b5953d22b38b5b0ff1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b6c6b9deecde44b5953d22b38b5b0ff1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b6c6b9deecde44b5953d22b38b5b0ff1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6c6b9deecde44b5953d22b38b5b0ff1"}]}] Oct 04 18:47:40.044957 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:47:40.044957 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: b6c6b9deecde44b5953d22b38b5b0ff1 Oct 04 18:47:40.044957 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:47:40.044957 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServersNegativeTestJSON-626077540-project Oct 04 18:47:40.044957 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:47:40.044957 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:47:40.044957 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 5b4eb70f22ba4872b890a4f160cc1805 Oct 04 18:47:40.044957 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServersNegativeTestJSON-626077540-project Oct 04 18:47:40.044957 n-d-850501-14 devstack@n-api.service[123002]: Oct 04 18:47:40.044957 n-d-850501-14 devstack@n-api.service[123002]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1236327233", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "334d1b7e-7632-43fb-8807-6117cf357d4f"}]}} Oct 04 18:47:40.044957 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:47:40.044957 n-d-850501-14 devstack@n-api.service[123002]: exception: Unable to find security_group with name or id 'does_not_exist' Oct 04 18:47:40.044957 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1236327233', 'imageRef': 'f545e662-10b3-46b1-88bb-6e66dd294559', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '334d1b7e-7632-43fb-8807-6117cf357d4f'}]}}} Oct 04 18:47:40.044957 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:47:40.044957 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:40.044957 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Oct 04 18:47:40.044957 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Oct 04 18:47:40.044957 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:47:40.044957 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:47:40.044957 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Oct 04 18:47:40.044957 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 04 18:47:40.044957 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Oct 04 18:47:40.044957 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:47:40.044957 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:40.044957 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:47:40.044957 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:40.044957 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Oct 04 18:47:40.044957 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Oct 04 18:47:40.044957 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:47:40.044957 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:47:40.044957 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Oct 04 18:47:40.044957 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 04 18:47:40.044957 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Oct 04 18:47:40.044957 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:47:40.044957 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:40.044957 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:47:40.044957 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:40.044957 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Oct 04 18:47:40.044957 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Oct 04 18:47:40.050028 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Oct 04 18:47:40.050028 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Oct 04 18:47:40.050028 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Oct 04 18:47:40.050028 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Oct 04 18:47:40.050028 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:47:40.050028 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:47:40.050028 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Oct 04 18:47:40.050028 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Oct 04 18:47:40.050028 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Oct 04 18:47:40.050028 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:47:40.050028 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:40.050028 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:47:40.050028 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:40.050028 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 18:47:40.050028 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 18:47:40.050028 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 18:47:40.050028 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 18:47:40.050028 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 18:47:40.050028 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 18:47:40.050028 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Oct 04 18:47:40.050028 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Oct 04 18:47:40.050028 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Oct 04 18:47:40.050028 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Oct 04 18:47:40.050028 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Oct 04 18:47:40.050028 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 18:47:40.050028 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Oct 04 18:47:40.050028 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:47:40.050028 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:40.050028 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:47:40.050028 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:40.050028 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:40.050028 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:40.050028 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:47:40.050028 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:47:40.050028 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:47:40.050028 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:47:40.050028 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:47:40.050028 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:47:40.050028 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:47:40.050028 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:47:40.050028 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:47:40.050028 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:47:40.050028 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 18:47:40.050028 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 04 18:47:40.050028 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 04 18:47:40.050028 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Oct 04 18:47:40.050028 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:47:40.050028 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:40.050028 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:47:40.050028 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:40.050028 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:40.050028 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:40.050028 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:47:40.050028 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:47:40.050028 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Oct 04 18:47:40.050028 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:47:40.057555 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-29531ae7-3585-4f3e-b18e-bac1b4419843 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:47:40.059536 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-29531ae7-3585-4f3e-b18e-bac1b4419843 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.242550 Oct 04 18:47:40.060449 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2186/4445] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:47:39 2022] POST /compute/v2.1/servers => generated 106 bytes in 244 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:47:40.071516 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-54878996-839e-4293-8da2-154b4a671317 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:40.075287 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-54878996-839e-4293-8da2-154b4a671317 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:40.085717 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-54878996-839e-4293-8da2-154b4a671317 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:40.092114 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-54878996-839e-4293-8da2-154b4a671317 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:40.092114 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-54878996-839e-4293-8da2-154b4a671317 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:40.092114 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-54878996-839e-4293-8da2-154b4a671317 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:40.092114 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-54878996-839e-4293-8da2-154b4a671317 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:40.092114 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-54878996-839e-4293-8da2-154b4a671317 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:40.109654 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fef2f39f-d743-4a9a-94c2-ae9cf65f806c tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Acquiring lock "refresh_cache-89ad7c7f-cba8-4fbe-8442-63a74c482c6b" {{(pid=123001) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 18:47:40.110151 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fef2f39f-d743-4a9a-94c2-ae9cf65f806c tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Acquired lock "refresh_cache-89ad7c7f-cba8-4fbe-8442-63a74c482c6b" {{(pid=123001) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 18:47:40.418088 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-54878996-839e-4293-8da2-154b4a671317 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:40.426830 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-54878996-839e-4293-8da2-154b4a671317 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1504 microversion: 2.1 time: 0.361668 Oct 04 18:47:40.430263 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2187/4446] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:40 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1504 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:47:40.457490 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-fe16b8c7-6105-44f7-a5a3-a8cac99f2cca tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:40.458485 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-fe16b8c7-6105-44f7-a5a3-a8cac99f2cca tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: 60694294-78ff-49f7-9d07-bb5915eae69e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:40.466445 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fe16b8c7-6105-44f7-a5a3-a8cac99f2cca tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:40.467244 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fe16b8c7-6105-44f7-a5a3-a8cac99f2cca tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:40.467881 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fe16b8c7-6105-44f7-a5a3-a8cac99f2cca tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:40.468833 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fe16b8c7-6105-44f7-a5a3-a8cac99f2cca tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:40.469367 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fe16b8c7-6105-44f7-a5a3-a8cac99f2cca tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:40.469922 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fe16b8c7-6105-44f7-a5a3-a8cac99f2cca tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:40.813998 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-fe16b8c7-6105-44f7-a5a3-a8cac99f2cca tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:40.822440 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-fe16b8c7-6105-44f7-a5a3-a8cac99f2cca tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/60694294-78ff-49f7-9d07-bb5915eae69e" status: 200 len: 1514 microversion: 2.1 time: 0.390793 Oct 04 18:47:40.823628 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2188/4447] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:40 2022] GET /compute/v2.1/servers/60694294-78ff-49f7-9d07-bb5915eae69e => generated 1514 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:40.828647 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-83535b77-36eb-42cc-aaef-2ccdf75e3bdd tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:40.839326 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-83535b77-36eb-42cc-aaef-2ccdf75e3bdd tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:40.839326 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-83535b77-36eb-42cc-aaef-2ccdf75e3bdd tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:40.839326 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-83535b77-36eb-42cc-aaef-2ccdf75e3bdd tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:40.839326 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-83535b77-36eb-42cc-aaef-2ccdf75e3bdd tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:40.839326 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-83535b77-36eb-42cc-aaef-2ccdf75e3bdd tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:40.839326 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-83535b77-36eb-42cc-aaef-2ccdf75e3bdd tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:40.839326 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-83535b77-36eb-42cc-aaef-2ccdf75e3bdd tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:41.155926 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-83535b77-36eb-42cc-aaef-2ccdf75e3bdd tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:41.170365 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-83535b77-36eb-42cc-aaef-2ccdf75e3bdd tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1504 microversion: 2.1 time: 0.345398 Oct 04 18:47:41.174391 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2189/4448] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:40 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1504 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:41.182781 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a85920eb-9e98-4ecd-a583-4b7a4c3ea70f tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:41.185078 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a85920eb-9e98-4ecd-a583-4b7a4c3ea70f tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] [instance: 317c7bd8-4f1e-4210-bb33-087557a1f4d6] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:41.197387 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a85920eb-9e98-4ecd-a583-4b7a4c3ea70f tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:41.200543 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a85920eb-9e98-4ecd-a583-4b7a4c3ea70f tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:41.202033 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a85920eb-9e98-4ecd-a583-4b7a4c3ea70f tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:41.202958 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a85920eb-9e98-4ecd-a583-4b7a4c3ea70f tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:41.203691 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a85920eb-9e98-4ecd-a583-4b7a4c3ea70f tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:41.204335 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a85920eb-9e98-4ecd-a583-4b7a4c3ea70f tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:41.613314 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.neutron [None req-fef2f39f-d743-4a9a-94c2-ae9cf65f806c tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] [instance: 89ad7c7f-cba8-4fbe-8442-63a74c482c6b] Building network info cache for instance {{(pid=123001) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 18:47:41.775587 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a85920eb-9e98-4ecd-a583-4b7a4c3ea70f tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:41.789002 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a85920eb-9e98-4ecd-a583-4b7a4c3ea70f tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:41.790960 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a85920eb-9e98-4ecd-a583-4b7a4c3ea70f tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:41.793249 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a85920eb-9e98-4ecd-a583-4b7a4c3ea70f tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] 10.222.0.20 "GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6" status: 200 len: 1850 microversion: 2.32 time: 0.617681 Oct 04 18:47:41.794561 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2190/4449] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:47:41 2022] GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6 => generated 1850 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:47:41.800919 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4c0a2ed9-ad28-4ed5-8ca9-2b7c1f08ffc8 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:41.801678 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4c0a2ed9-ad28-4ed5-8ca9-2b7c1f08ffc8 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: fe870426-b96b-4fcb-a5ca-602dba3c432c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:41.810849 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-4c0a2ed9-ad28-4ed5-8ca9-2b7c1f08ffc8 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] HTTP exception thrown: Instance fe870426-b96b-4fcb-a5ca-602dba3c432c could not be found. Oct 04 18:47:41.812808 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4c0a2ed9-ad28-4ed5-8ca9-2b7c1f08ffc8 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Request method failure captured: Oct 04 18:47:41.812808 n-d-850501-14 devstack@n-api.service[123002]: request: DELETE /compute/v2.1/servers/fe870426-b96b-4fcb-a5ca-602dba3c432c HTTP/1.1 Oct 04 18:47:41.812808 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:47:41.812808 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:47:41.812808 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:47:41.812808 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:47:41.812808 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:47:41.812808 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:47:41.812808 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:47:41.812808 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:47:41.812808 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH9zAVdj2h4kh6QqBpYrS2CJMhbcXf529VUNrZoZOYhS2tkLYBgw6AHy860DK9jQ3xATqZvC9lQuxt-_H5qKsAI41eznf32K6QSGqVcHXegpVHrDueww23ZMVCBM3D_hH0NTzh4447rgHqcrC-OZE48IfZrRJ9KPLPjAHT57T3mcPIc Oct 04 18:47:41.812808 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:47:41.812808 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:47:41.812808 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:47:41.812808 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:47:41.812808 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:47:41.812808 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:47:41.812808 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: b6c6b9deecde44b5953d22b38b5b0ff1 Oct 04 18:47:41.812808 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:47:41.812808 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:47:41.812808 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:47:41.812808 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6c6b9deecde44b5953d22b38b5b0ff1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b6c6b9deecde44b5953d22b38b5b0ff1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b6c6b9deecde44b5953d22b38b5b0ff1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6c6b9deecde44b5953d22b38b5b0ff1"}]}] Oct 04 18:47:41.812808 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:47:41.812808 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: b6c6b9deecde44b5953d22b38b5b0ff1 Oct 04 18:47:41.812808 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:47:41.812808 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServersNegativeTestJSON-626077540-project Oct 04 18:47:41.812808 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:47:41.812808 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:47:41.812808 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 5b4eb70f22ba4872b890a4f160cc1805 Oct 04 18:47:41.812808 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServersNegativeTestJSON-626077540-project Oct 04 18:47:41.812808 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:47:41.812808 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance fe870426-b96b-4fcb-a5ca-602dba3c432c could not be found. Oct 04 18:47:41.812808 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'fe870426-b96b-4fcb-a5ca-602dba3c432c'} Oct 04 18:47:41.812808 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:47:41.812808 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:41.812808 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:47:41.812808 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:47:41.812808 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:47:41.812808 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:47:41.812808 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:47:41.812808 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:47:41.812808 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe870426-b96b-4fcb-a5ca-602dba3c432c could not be found. Oct 04 18:47:41.812808 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:47:41.812808 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:41.812808 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:47:41.812808 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:41.812808 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:41.812808 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:41.812808 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:47:41.812808 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:47:41.812808 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:47:41.812808 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:47:41.812808 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:47:41.812808 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:47:41.812808 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:47:41.812808 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:47:41.812808 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:47:41.812808 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:47:41.812808 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:47:41.812808 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:47:41.812808 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe870426-b96b-4fcb-a5ca-602dba3c432c could not be found. Oct 04 18:47:41.812808 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:47:41.812808 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:41.817466 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:47:41.817466 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:41.817466 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:41.817466 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:41.817466 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:47:41.817466 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:47:41.817466 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe870426-b96b-4fcb-a5ca-602dba3c432c could not be found. Oct 04 18:47:41.817466 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:47:41.819471 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4c0a2ed9-ad28-4ed5-8ca9-2b7c1f08ffc8 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Returning 404 to user: Instance fe870426-b96b-4fcb-a5ca-602dba3c432c could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:47:41.820604 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4c0a2ed9-ad28-4ed5-8ca9-2b7c1f08ffc8 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "DELETE /compute/v2.1/servers/fe870426-b96b-4fcb-a5ca-602dba3c432c" status: 404 len: 111 microversion: 2.1 time: 0.024954 Oct 04 18:47:41.821715 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2191/4450] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:47:41 2022] DELETE /compute/v2.1/servers/fe870426-b96b-4fcb-a5ca-602dba3c432c => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:47:41.826585 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-d0c12c99-8bcf-4a58-948e-e5eecb59d9db req-f5aad0c4-bd3e-49bd-8564-7c936c60bd0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89ad7c7f-cba8-4fbe-8442-63a74c482c6b", "tag": "48ca997a-f5b9-4dbe-8306-95ea1bef682b"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:41.841196 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-d0c12c99-8bcf-4a58-948e-e5eecb59d9db req-f5aad0c4-bd3e-49bd-8564-7c936c60bd0c service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:41.848875 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-d0c12c99-8bcf-4a58-948e-e5eecb59d9db req-f5aad0c4-bd3e-49bd-8564-7c936c60bd0c service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:41.850744 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-d0c12c99-8bcf-4a58-948e-e5eecb59d9db req-f5aad0c4-bd3e-49bd-8564-7c936c60bd0c service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:41.879964 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-d0c12c99-8bcf-4a58-948e-e5eecb59d9db req-f5aad0c4-bd3e-49bd-8564-7c936c60bd0c service nova] Creating event network-changed:48ca997a-f5b9-4dbe-8306-95ea1bef682b for instance 89ad7c7f-cba8-4fbe-8442-63a74c482c6b on n-h2-850501-14 Oct 04 18:47:41.891758 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-d0c12c99-8bcf-4a58-948e-e5eecb59d9db req-f5aad0c4-bd3e-49bd-8564-7c936c60bd0c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068503 Oct 04 18:47:41.893092 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2192/4451] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:47:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:47:41.899787 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7f835baa-59c6-42f6-92cf-3a054bef09d2 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:41.901047 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7f835baa-59c6-42f6-92cf-3a054bef09d2 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:41.911701 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7f835baa-59c6-42f6-92cf-3a054bef09d2 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:41.913096 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7f835baa-59c6-42f6-92cf-3a054bef09d2 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:41.913795 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7f835baa-59c6-42f6-92cf-3a054bef09d2 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:41.914729 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7f835baa-59c6-42f6-92cf-3a054bef09d2 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:41.915530 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7f835baa-59c6-42f6-92cf-3a054bef09d2 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:41.916263 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7f835baa-59c6-42f6-92cf-3a054bef09d2 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:42.438146 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7f835baa-59c6-42f6-92cf-3a054bef09d2 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:42.452683 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7f835baa-59c6-42f6-92cf-3a054bef09d2 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1504 microversion: 2.1 time: 0.558146 Oct 04 18:47:42.472438 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2193/4452] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:41 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1504 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:42.479639 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-68eccab0-5fb6-4ddf-9b3a-ab328a71924f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:42.482503 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-68eccab0-5fb6-4ddf-9b3a-ab328a71924f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: 60694294-78ff-49f7-9d07-bb5915eae69e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:42.500416 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-68eccab0-5fb6-4ddf-9b3a-ab328a71924f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:42.501500 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-68eccab0-5fb6-4ddf-9b3a-ab328a71924f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:42.502191 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-68eccab0-5fb6-4ddf-9b3a-ab328a71924f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:42.504918 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-68eccab0-5fb6-4ddf-9b3a-ab328a71924f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:42.505899 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-68eccab0-5fb6-4ddf-9b3a-ab328a71924f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:42.508504 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-68eccab0-5fb6-4ddf-9b3a-ab328a71924f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:42.891185 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-68eccab0-5fb6-4ddf-9b3a-ab328a71924f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:42.908675 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-68eccab0-5fb6-4ddf-9b3a-ab328a71924f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/60694294-78ff-49f7-9d07-bb5915eae69e" status: 200 len: 1514 microversion: 2.1 time: 0.436847 Oct 04 18:47:42.911284 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2194/4453] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:42 2022] GET /compute/v2.1/servers/60694294-78ff-49f7-9d07-bb5915eae69e => generated 1514 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:42.924817 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-461544bb-b627-4f84-8b2a-b6f5df2d4503 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:42.925798 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-461544bb-b627-4f84-8b2a-b6f5df2d4503 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:42.956288 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-461544bb-b627-4f84-8b2a-b6f5df2d4503 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:42.959916 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-461544bb-b627-4f84-8b2a-b6f5df2d4503 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:42.963196 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-461544bb-b627-4f84-8b2a-b6f5df2d4503 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:42.964871 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-461544bb-b627-4f84-8b2a-b6f5df2d4503 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:42.969841 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-461544bb-b627-4f84-8b2a-b6f5df2d4503 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:42.970954 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-461544bb-b627-4f84-8b2a-b6f5df2d4503 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:43.192325 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.neutron [None req-fef2f39f-d743-4a9a-94c2-ae9cf65f806c tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] [instance: 89ad7c7f-cba8-4fbe-8442-63a74c482c6b] Updating instance_info_cache with network_info: [{"id": "48ca997a-f5b9-4dbe-8306-95ea1bef682b", "address": "fa:16:3e:c1:f3:74", "network": {"id": "78884083-8fd9-4713-bf20-70c3db5a4715", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-349008263-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "7917de0ff5be4d238981ea714d837fe0", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap48ca997a-f5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=123001) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 18:47:43.214946 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-461544bb-b627-4f84-8b2a-b6f5df2d4503 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:43.248453 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-461544bb-b627-4f84-8b2a-b6f5df2d4503 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1504 microversion: 2.1 time: 0.307724 Oct 04 18:47:43.248453 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2195/4454] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:42 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1504 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:43.248453 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-07576a62-6af3-4948-a437-4cc490059a41 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:43.248453 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-07576a62-6af3-4948-a437-4cc490059a41 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] [instance: 317c7bd8-4f1e-4210-bb33-087557a1f4d6] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:43.252433 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-07576a62-6af3-4948-a437-4cc490059a41 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:43.253863 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-07576a62-6af3-4948-a437-4cc490059a41 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:43.255195 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-07576a62-6af3-4948-a437-4cc490059a41 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:43.257397 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-07576a62-6af3-4948-a437-4cc490059a41 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:43.262388 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-07576a62-6af3-4948-a437-4cc490059a41 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:43.262975 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-07576a62-6af3-4948-a437-4cc490059a41 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:43.616575 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-07576a62-6af3-4948-a437-4cc490059a41 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:43.638154 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-07576a62-6af3-4948-a437-4cc490059a41 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:43.640711 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-07576a62-6af3-4948-a437-4cc490059a41 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:43.667458 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-07576a62-6af3-4948-a437-4cc490059a41 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] 10.222.0.20 "GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6" status: 200 len: 1850 microversion: 2.32 time: 0.415334 Oct 04 18:47:43.667458 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2196/4455] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:47:43 2022] GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6 => generated 1850 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:47:43.667458 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d419eaa3-917c-439c-b5f8-7df580dcf912 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:43.667458 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d419eaa3-917c-439c-b5f8-7df580dcf912 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Failed to fetch instance by id 9223372036854775808 {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 04 18:47:43.667458 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-d419eaa3-917c-439c-b5f8-7df580dcf912 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Oct 04 18:47:43.667458 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d419eaa3-917c-439c-b5f8-7df580dcf912 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Request method failure captured: Oct 04 18:47:43.667458 n-d-850501-14 devstack@n-api.service[123002]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Oct 04 18:47:43.667458 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:47:43.667458 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:47:43.667458 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:47:43.667458 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:47:43.667458 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:47:43.667458 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:47:43.667458 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:47:43.667458 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:47:43.667458 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH9zAVdj2h4kh6QqBpYrS2CJMhbcXf529VUNrZoZOYhS2tkLYBgw6AHy860DK9jQ3xATqZvC9lQuxt-_H5qKsAI41eznf32K6QSGqVcHXegpVHrDueww23ZMVCBM3D_hH0NTzh4447rgHqcrC-OZE48IfZrRJ9KPLPjAHT57T3mcPIc Oct 04 18:47:43.667458 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:47:43.667458 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:47:43.667458 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:47:43.667458 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:47:43.667458 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:47:43.667458 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:47:43.667458 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: b6c6b9deecde44b5953d22b38b5b0ff1 Oct 04 18:47:43.667458 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:47:43.667458 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:47:43.667458 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:47:43.667458 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6c6b9deecde44b5953d22b38b5b0ff1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b6c6b9deecde44b5953d22b38b5b0ff1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b6c6b9deecde44b5953d22b38b5b0ff1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6c6b9deecde44b5953d22b38b5b0ff1"}]}] Oct 04 18:47:43.667458 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:47:43.667458 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: b6c6b9deecde44b5953d22b38b5b0ff1 Oct 04 18:47:43.667458 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:47:43.667458 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServersNegativeTestJSON-626077540-project Oct 04 18:47:43.667458 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:47:43.667458 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:47:43.667458 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 5b4eb70f22ba4872b890a4f160cc1805 Oct 04 18:47:43.667458 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServersNegativeTestJSON-626077540-project Oct 04 18:47:43.667458 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:47:43.667458 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 9223372036854775808 could not be found. Oct 04 18:47:43.667458 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '9223372036854775808'} Oct 04 18:47:43.667458 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:47:43.667458 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:43.667458 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:47:43.667458 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:47:43.667458 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 04 18:47:43.667458 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 04 18:47:43.667458 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Oct 04 18:47:43.667458 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:47:43.667458 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:43.667458 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:47:43.667458 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:43.667458 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:43.667458 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:43.667458 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:47:43.670363 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:47:43.670363 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:47:43.670363 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:47:43.670363 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:47:43.670363 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:47:43.670363 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:47:43.670363 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:47:43.670363 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:47:43.670363 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:47:43.670363 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:47:43.670363 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:47:43.670363 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Oct 04 18:47:43.670363 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:47:43.670363 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:43.670363 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:47:43.670363 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:43.670363 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:43.670363 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:43.670363 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:47:43.670363 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:47:43.670363 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Oct 04 18:47:43.670363 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:47:43.670363 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d419eaa3-917c-439c-b5f8-7df580dcf912 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:47:43.670363 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d419eaa3-917c-439c-b5f8-7df580dcf912 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.011417 Oct 04 18:47:43.670363 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2197/4456] 10.222.0.20 () {58 vars in 1188 bytes} [Tue Oct 4 18:47:43 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:47:43.695949 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-17fcb907-7c34-4bfc-8ea2-08f1f3f7bcd8 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:43.697715 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-17fcb907-7c34-4bfc-8ea2-08f1f3f7bcd8 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:43.726497 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-17fcb907-7c34-4bfc-8ea2-08f1f3f7bcd8 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:43.727120 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-17fcb907-7c34-4bfc-8ea2-08f1f3f7bcd8 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:43.727575 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-17fcb907-7c34-4bfc-8ea2-08f1f3f7bcd8 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:43.728325 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-17fcb907-7c34-4bfc-8ea2-08f1f3f7bcd8 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:43.728777 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-17fcb907-7c34-4bfc-8ea2-08f1f3f7bcd8 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:43.729392 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-17fcb907-7c34-4bfc-8ea2-08f1f3f7bcd8 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:43.963239 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fef2f39f-d743-4a9a-94c2-ae9cf65f806c tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Releasing lock "refresh_cache-89ad7c7f-cba8-4fbe-8442-63a74c482c6b" {{(pid=123001) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 18:47:43.965389 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-fef2f39f-d743-4a9a-94c2-ae9cf65f806c tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] 10.222.0.20 "POST /compute/v2.1/servers/89ad7c7f-cba8-4fbe-8442-63a74c482c6b/action" status: 202 len: 0 microversion: 2.1 time: 4.559754 Oct 04 18:47:43.975661 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2260/4457] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:47:39 2022] POST /compute/v2.1/servers/89ad7c7f-cba8-4fbe-8442-63a74c482c6b/action => generated 0 bytes in 4571 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 04 18:47:43.999928 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-17fcb907-7c34-4bfc-8ea2-08f1f3f7bcd8 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:44.001653 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-80a0591a-2edc-4ab9-96e8-8e5a7ee4d460 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:44.016984 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-17fcb907-7c34-4bfc-8ea2-08f1f3f7bcd8 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1504 microversion: 2.1 time: 0.338708 Oct 04 18:47:44.017382 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2198/4458] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:43 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1504 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:47:44.020570 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-80a0591a-2edc-4ab9-96e8-8e5a7ee4d460 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: 60694294-78ff-49f7-9d07-bb5915eae69e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:44.022871 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-508139e5-2e5a-4ed4-8c0f-cdd39f50ae86 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Calling method '.version_select at 0x7fe258cc29d0>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:44.055700 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-80a0591a-2edc-4ab9-96e8-8e5a7ee4d460 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:44.058481 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-80a0591a-2edc-4ab9-96e8-8e5a7ee4d460 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:44.061221 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-80a0591a-2edc-4ab9-96e8-8e5a7ee4d460 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:44.067700 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-80a0591a-2edc-4ab9-96e8-8e5a7ee4d460 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:44.067700 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-80a0591a-2edc-4ab9-96e8-8e5a7ee4d460 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:44.067700 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-80a0591a-2edc-4ab9-96e8-8e5a7ee4d460 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:44.781421 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-80a0591a-2edc-4ab9-96e8-8e5a7ee4d460 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:44.805181 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-80a0591a-2edc-4ab9-96e8-8e5a7ee4d460 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/60694294-78ff-49f7-9d07-bb5915eae69e" status: 200 len: 1514 microversion: 2.1 time: 0.818785 Oct 04 18:47:44.810258 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2261/4459] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:43 2022] GET /compute/v2.1/servers/60694294-78ff-49f7-9d07-bb5915eae69e => generated 1514 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:44.822413 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-5d10f5f9-02b9-445f-88fb-3f0cce8e231a req-9aa786af-b436-4add-9522-9fe379798286 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "317c7bd8-4f1e-4210-bb33-087557a1f4d6", "tag": "f77c8e43-6a46-4f2a-aef7-77f61d8b7f1a"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:44.847798 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-5d10f5f9-02b9-445f-88fb-3f0cce8e231a req-9aa786af-b436-4add-9522-9fe379798286 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:44.849907 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-5d10f5f9-02b9-445f-88fb-3f0cce8e231a req-9aa786af-b436-4add-9522-9fe379798286 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:44.857500 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-5d10f5f9-02b9-445f-88fb-3f0cce8e231a req-9aa786af-b436-4add-9522-9fe379798286 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:44.875223 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-5d10f5f9-02b9-445f-88fb-3f0cce8e231a req-9aa786af-b436-4add-9522-9fe379798286 service nova] Creating event network-changed:f77c8e43-6a46-4f2a-aef7-77f61d8b7f1a for instance 317c7bd8-4f1e-4210-bb33-087557a1f4d6 on n-h1-850501-14 Oct 04 18:47:44.882331 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-5d10f5f9-02b9-445f-88fb-3f0cce8e231a req-9aa786af-b436-4add-9522-9fe379798286 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068146 Oct 04 18:47:44.883595 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2262/4460] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:47:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:47:44.903206 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-dc53f456-496e-4513-b8e2-33b26075a680 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:44.903936 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-dc53f456-496e-4513-b8e2-33b26075a680 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:44.913319 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dc53f456-496e-4513-b8e2-33b26075a680 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:44.913819 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dc53f456-496e-4513-b8e2-33b26075a680 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:44.914260 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dc53f456-496e-4513-b8e2-33b26075a680 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:44.914982 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dc53f456-496e-4513-b8e2-33b26075a680 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:44.915437 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dc53f456-496e-4513-b8e2-33b26075a680 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:44.915866 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dc53f456-496e-4513-b8e2-33b26075a680 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:45.422297 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-dc53f456-496e-4513-b8e2-33b26075a680 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:45.431479 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-dc53f456-496e-4513-b8e2-33b26075a680 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1504 microversion: 2.1 time: 0.545923 Oct 04 18:47:45.433228 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2263/4461] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:44 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1504 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:45.441905 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-91578fcc-4d00-46a4-af16-ea3460205482 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:45.443176 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-91578fcc-4d00-46a4-af16-ea3460205482 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] [instance: 317c7bd8-4f1e-4210-bb33-087557a1f4d6] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:45.453055 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-91578fcc-4d00-46a4-af16-ea3460205482 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:45.453853 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-91578fcc-4d00-46a4-af16-ea3460205482 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:45.455153 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-91578fcc-4d00-46a4-af16-ea3460205482 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:45.456367 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-91578fcc-4d00-46a4-af16-ea3460205482 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:45.457073 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-91578fcc-4d00-46a4-af16-ea3460205482 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:45.457702 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-91578fcc-4d00-46a4-af16-ea3460205482 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:45.726898 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-508139e5-2e5a-4ed4-8c0f-cdd39f50ae86 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/2199843d-a53d-4a59-afa9-b1bf5821184c" status: 202 len: 0 microversion: 2.1 time: 1.708365 Oct 04 18:47:45.728575 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2199/4462] 10.222.0.20 () {58 vars in 1263 bytes} [Tue Oct 4 18:47:44 2022] DELETE /compute/v2.1/os-floating-ips/2199843d-a53d-4a59-afa9-b1bf5821184c => generated 0 bytes in 1710 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:47:45.735894 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c22afeac-ed2e-4fa7-a536-3138e0110f3e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:45.736772 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c22afeac-ed2e-4fa7-a536-3138e0110f3e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Failed to fetch instance by id -1 {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 04 18:47:45.737528 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-c22afeac-ed2e-4fa7-a536-3138e0110f3e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] HTTP exception thrown: Instance -1 could not be found. Oct 04 18:47:45.742509 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c22afeac-ed2e-4fa7-a536-3138e0110f3e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Request method failure captured: Oct 04 18:47:45.742509 n-d-850501-14 devstack@n-api.service[123002]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Oct 04 18:47:45.742509 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:47:45.742509 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:47:45.742509 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:47:45.742509 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:47:45.742509 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:47:45.742509 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:47:45.742509 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:47:45.742509 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:47:45.742509 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH9zAVdj2h4kh6QqBpYrS2CJMhbcXf529VUNrZoZOYhS2tkLYBgw6AHy860DK9jQ3xATqZvC9lQuxt-_H5qKsAI41eznf32K6QSGqVcHXegpVHrDueww23ZMVCBM3D_hH0NTzh4447rgHqcrC-OZE48IfZrRJ9KPLPjAHT57T3mcPIc Oct 04 18:47:45.742509 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:47:45.742509 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:47:45.742509 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:47:45.742509 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:47:45.742509 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:47:45.742509 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:47:45.742509 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: b6c6b9deecde44b5953d22b38b5b0ff1 Oct 04 18:47:45.742509 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:47:45.742509 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:47:45.742509 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:47:45.742509 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6c6b9deecde44b5953d22b38b5b0ff1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b6c6b9deecde44b5953d22b38b5b0ff1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b6c6b9deecde44b5953d22b38b5b0ff1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6c6b9deecde44b5953d22b38b5b0ff1"}]}] Oct 04 18:47:45.742509 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:47:45.742509 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: b6c6b9deecde44b5953d22b38b5b0ff1 Oct 04 18:47:45.742509 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:47:45.742509 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServersNegativeTestJSON-626077540-project Oct 04 18:47:45.742509 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:47:45.742509 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:47:45.742509 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 5b4eb70f22ba4872b890a4f160cc1805 Oct 04 18:47:45.742509 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServersNegativeTestJSON-626077540-project Oct 04 18:47:45.742509 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:47:45.742509 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance -1 could not be found. Oct 04 18:47:45.742509 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '-1'} Oct 04 18:47:45.742509 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:47:45.742509 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:45.742509 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:47:45.742509 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:47:45.742509 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 04 18:47:45.742509 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 04 18:47:45.742509 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Oct 04 18:47:45.742509 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:47:45.742509 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:45.742509 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:47:45.742509 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:45.742509 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:45.742509 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:45.742509 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:47:45.742509 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:47:45.742509 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:47:45.742509 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:47:45.742509 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:47:45.742509 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:47:45.742509 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:47:45.742509 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:47:45.742509 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:47:45.742509 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:47:45.742509 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:47:45.742509 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:47:45.742509 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Oct 04 18:47:45.742509 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:47:45.742509 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:45.742509 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:47:45.742509 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:45.742509 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:45.742509 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:45.746271 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:47:45.746271 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:47:45.746271 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Oct 04 18:47:45.746271 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:47:45.748323 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c22afeac-ed2e-4fa7-a536-3138e0110f3e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Returning 404 to user: Instance -1 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:47:45.749438 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c22afeac-ed2e-4fa7-a536-3138e0110f3e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.019630 Oct 04 18:47:45.754936 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2200/4463] 10.222.0.20 () {58 vars in 1137 bytes} [Tue Oct 4 18:47:45 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:47:45.768181 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-75aeb648-f8e2-4d7e-9844-c0e7e5a14428 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:45.776276 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-75aeb648-f8e2-4d7e-9844-c0e7e5a14428 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Request method failure captured: Oct 04 18:47:45.776276 n-d-850501-14 devstack@n-api.service[123002]: request: POST /compute/v2.1/servers/89ad7c7f-cba8-4fbe-8442-63a74c482c6b/action HTTP/1.1 Oct 04 18:47:45.776276 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:47:45.776276 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:47:45.776276 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:47:45.776276 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 34 Oct 04 18:47:45.776276 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:47:45.776276 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:47:45.776276 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:47:45.776276 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:47:45.776276 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH-iHdlfIs8wUZ8D13z2XqYsPOmHk20-rCkSWPnuA-n6pjNAtEvLYTycHlthpYrA0CWkfc_Pcer2VGB2UiVmHgYJJnfG6Qx9QxIT0Yc0m5vU1an7o1snrk-vvplhYOk62QzkkiDeurqhqaBAaL-x1ajV-4MWIhKCk1GvrLRGJkadaxA Oct 04 18:47:45.776276 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:47:45.776276 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:47:45.776276 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:47:45.776276 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:47:45.776276 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:47:45.776276 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:47:45.776276 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 7917de0ff5be4d238981ea714d837fe0 Oct 04 18:47:45.776276 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 Oct 04 18:47:45.776276 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:47:45.776276 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:47:45.776276 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7917de0ff5be4d238981ea714d837fe0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7917de0ff5be4d238981ea714d837fe0", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7917de0ff5be4d238981ea714d837fe0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7917de0ff5be4d238981ea714d837fe0"}]}] Oct 04 18:47:45.776276 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 Oct 04 18:47:45.776276 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 7917de0ff5be4d238981ea714d837fe0 Oct 04 18:47:45.776276 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 Oct 04 18:47:45.776276 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project Oct 04 18:47:45.776276 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:47:45.776276 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:47:45.776276 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 4cce9172582d4efd8fc31251d4bfe63c Oct 04 18:47:45.776276 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project Oct 04 18:47:45.776276 n-d-850501-14 devstack@n-api.service[123002]: Oct 04 18:47:45.776276 n-d-850501-14 devstack@n-api.service[123002]: {"addFloatingIp": {"address": ""}} Oct 04 18:47:45.776276 n-d-850501-14 devstack@n-api.service[123002]: method: Oct 04 18:47:45.776276 n-d-850501-14 devstack@n-api.service[123002]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 04 18:47:45.776276 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '89ad7c7f-cba8-4fbe-8442-63a74c482c6b', 'body': {'addFloatingIp': {'address': ''}}} Oct 04 18:47:45.776276 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:47:45.776276 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:45.776276 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:47:45.776276 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:47:45.776276 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:47:45.776276 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:47:45.776276 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Oct 04 18:47:45.776276 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:47:45.776276 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Oct 04 18:47:45.776276 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Oct 04 18:47:45.776276 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:47:45.776276 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Oct 04 18:47:45.776276 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi '' Oct 04 18:47:45.776276 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:47:45.776276 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:45.776276 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:47:45.776276 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:45.776276 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:45.776276 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:45.776276 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:47:45.776276 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:47:45.776276 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:47:45.776276 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:47:45.776276 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:47:45.776276 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:47:45.776276 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:47:45.776276 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:47:45.776276 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:47:45.776276 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:47:45.776276 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:47:45.779935 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:47:45.779935 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 04 18:47:45.779935 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:47:45.779935 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:45.779935 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:47:45.779935 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:45.779935 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:45.779935 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:45.779935 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:47:45.779935 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:47:45.779935 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 04 18:47:45.779935 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:47:45.787794 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-75aeb648-f8e2-4d7e-9844-c0e7e5a14428 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:47:45.789014 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-75aeb648-f8e2-4d7e-9844-c0e7e5a14428 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] 10.222.0.20 "POST /compute/v2.1/servers/89ad7c7f-cba8-4fbe-8442-63a74c482c6b/action" status: 400 len: 142 microversion: 2.1 time: 0.032243 Oct 04 18:47:45.798017 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2201/4464] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:47:45 2022] POST /compute/v2.1/servers/89ad7c7f-cba8-4fbe-8442-63a74c482c6b/action => generated 142 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:47:45.798254 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-91578fcc-4d00-46a4-af16-ea3460205482 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:45.805983 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e4f1d87a-008f-4b57-bebf-f9202a5fef36 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:45.806589 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-91578fcc-4d00-46a4-af16-ea3460205482 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:45.807941 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e4f1d87a-008f-4b57-bebf-f9202a5fef36 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:45.809535 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-91578fcc-4d00-46a4-af16-ea3460205482 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:45.811178 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-91578fcc-4d00-46a4-af16-ea3460205482 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] 10.222.0.20 "GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6" status: 200 len: 1871 microversion: 2.32 time: 0.376355 Oct 04 18:47:45.812370 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2264/4465] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:47:45 2022] GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6 => generated 1871 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:47:45.820783 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e4f1d87a-008f-4b57-bebf-f9202a5fef36 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:45.822074 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e4f1d87a-008f-4b57-bebf-f9202a5fef36 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:45.823258 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e4f1d87a-008f-4b57-bebf-f9202a5fef36 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:45.824746 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e4f1d87a-008f-4b57-bebf-f9202a5fef36 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:45.825984 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e4f1d87a-008f-4b57-bebf-f9202a5fef36 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:45.827171 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e4f1d87a-008f-4b57-bebf-f9202a5fef36 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:45.831016 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-bfaf8ce0-6023-4c47-8b7d-703dd05f4e4c tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:45.840543 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-bfaf8ce0-6023-4c47-8b7d-703dd05f4e4c tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] [instance: 89ad7c7f-cba8-4fbe-8442-63a74c482c6b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:45.861811 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bfaf8ce0-6023-4c47-8b7d-703dd05f4e4c tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:45.866899 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bfaf8ce0-6023-4c47-8b7d-703dd05f4e4c tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:45.866899 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bfaf8ce0-6023-4c47-8b7d-703dd05f4e4c tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:45.866899 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bfaf8ce0-6023-4c47-8b7d-703dd05f4e4c tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:45.866899 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bfaf8ce0-6023-4c47-8b7d-703dd05f4e4c tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:45.866899 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bfaf8ce0-6023-4c47-8b7d-703dd05f4e4c tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:45.904418 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bfaf8ce0-6023-4c47-8b7d-703dd05f4e4c tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Acquiring lock "refresh_cache-89ad7c7f-cba8-4fbe-8442-63a74c482c6b" {{(pid=123001) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 18:47:45.904841 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bfaf8ce0-6023-4c47-8b7d-703dd05f4e4c tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Acquired lock "refresh_cache-89ad7c7f-cba8-4fbe-8442-63a74c482c6b" {{(pid=123001) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 18:47:46.080457 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bfaf8ce0-6023-4c47-8b7d-703dd05f4e4c tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Releasing lock "refresh_cache-89ad7c7f-cba8-4fbe-8442-63a74c482c6b" {{(pid=123001) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 18:47:46.081276 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-bfaf8ce0-6023-4c47-8b7d-703dd05f4e4c tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] HTTP exception thrown: floating IP not found Oct 04 18:47:46.083122 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-bfaf8ce0-6023-4c47-8b7d-703dd05f4e4c tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Request method failure captured: Oct 04 18:47:46.083122 n-d-850501-14 devstack@n-api.service[123001]: request: POST /compute/v2.1/servers/89ad7c7f-cba8-4fbe-8442-63a74c482c6b/action HTTP/1.1 Oct 04 18:47:46.083122 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:47:46.083122 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:47:46.083122 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:47:46.083122 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 41 Oct 04 18:47:46.083122 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:47:46.083122 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:47:46.083122 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:47:46.083122 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:47:46.083122 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPH-iHdlfIs8wUZ8D13z2XqYsPOmHk20-rCkSWPnuA-n6pjNAtEvLYTycHlthpYrA0CWkfc_Pcer2VGB2UiVmHgYJJnfG6Qx9QxIT0Yc0m5vU1an7o1snrk-vvplhYOk62QzkkiDeurqhqaBAaL-x1ajV-4MWIhKCk1GvrLRGJkadaxA Oct 04 18:47:46.083122 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:47:46.083122 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:47:46.083122 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:47:46.083122 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:47:46.083122 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:47:46.083122 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:47:46.083122 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 7917de0ff5be4d238981ea714d837fe0 Oct 04 18:47:46.083122 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 Oct 04 18:47:46.083122 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:47:46.083122 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:47:46.083122 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7917de0ff5be4d238981ea714d837fe0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7917de0ff5be4d238981ea714d837fe0", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7917de0ff5be4d238981ea714d837fe0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7917de0ff5be4d238981ea714d837fe0"}]}] Oct 04 18:47:46.083122 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 Oct 04 18:47:46.083122 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 7917de0ff5be4d238981ea714d837fe0 Oct 04 18:47:46.083122 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 Oct 04 18:47:46.083122 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project Oct 04 18:47:46.083122 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:47:46.083122 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:47:46.083122 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 4cce9172582d4efd8fc31251d4bfe63c Oct 04 18:47:46.083122 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project Oct 04 18:47:46.083122 n-d-850501-14 devstack@n-api.service[123001]: Oct 04 18:47:46.083122 n-d-850501-14 devstack@n-api.service[123001]: {"addFloatingIp": {"address": "0.0.0.0"}} Oct 04 18:47:46.083122 n-d-850501-14 devstack@n-api.service[123001]: method: Oct 04 18:47:46.083122 n-d-850501-14 devstack@n-api.service[123001]: exception: floating IP not found Oct 04 18:47:46.083122 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '89ad7c7f-cba8-4fbe-8442-63a74c482c6b', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Oct 04 18:47:46.083122 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:47:46.083122 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:46.083122 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 04 18:47:46.083122 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 04 18:47:46.083122 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 04 18:47:46.083122 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 04 18:47:46.083122 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Oct 04 18:47:46.083122 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Oct 04 18:47:46.083122 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 04 18:47:46.083122 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 04 18:47:46.083122 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 04 18:47:46.083122 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:47:46.083122 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:46.083122 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:47:46.083122 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:46.083122 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:46.083122 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:46.083122 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:47:46.083122 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:47:46.083122 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:47:46.083122 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:47:46.083122 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:47:46.083122 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:47:46.083122 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:47:46.083122 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:47:46.083122 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Oct 04 18:47:46.083122 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 18:47:46.083122 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Oct 04 18:47:46.083122 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:47:46.088685 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:46.088685 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:47:46.088685 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:46.088685 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:46.088685 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:46.088685 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:47:46.088685 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:47:46.088685 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Oct 04 18:47:46.088685 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:47:46.088685 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-bfaf8ce0-6023-4c47-8b7d-703dd05f4e4c tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Returning 404 to user: floating IP not found {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:47:46.088685 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-bfaf8ce0-6023-4c47-8b7d-703dd05f4e4c tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] 10.222.0.20 "POST /compute/v2.1/servers/89ad7c7f-cba8-4fbe-8442-63a74c482c6b/action" status: 404 len: 67 microversion: 2.1 time: 0.272877 Oct 04 18:47:46.089690 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2265/4466] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:47:45 2022] POST /compute/v2.1/servers/89ad7c7f-cba8-4fbe-8442-63a74c482c6b/action => generated 67 bytes in 276 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:47:46.099021 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0f712efc-4792-4a66-b3b8-9f70a323a2e9 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:46.105416 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0f712efc-4792-4a66-b3b8-9f70a323a2e9 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: 60694294-78ff-49f7-9d07-bb5915eae69e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:46.118305 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0f712efc-4792-4a66-b3b8-9f70a323a2e9 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:46.118462 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0f712efc-4792-4a66-b3b8-9f70a323a2e9 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:46.118804 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0f712efc-4792-4a66-b3b8-9f70a323a2e9 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:46.119790 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0f712efc-4792-4a66-b3b8-9f70a323a2e9 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:46.123254 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0f712efc-4792-4a66-b3b8-9f70a323a2e9 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:46.123784 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0f712efc-4792-4a66-b3b8-9f70a323a2e9 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:46.164036 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e4f1d87a-008f-4b57-bebf-f9202a5fef36 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:46.169747 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e4f1d87a-008f-4b57-bebf-f9202a5fef36 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1504 microversion: 2.1 time: 0.374791 Oct 04 18:47:46.171308 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2202/4467] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:45 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1504 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:46.179264 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f82b77ee-a903-4179-8817-694de43f2cbe tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:46.616688 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-f82b77ee-a903-4179-8817-694de43f2cbe tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Oct 04 18:47:46.619828 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f82b77ee-a903-4179-8817-694de43f2cbe tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Request method failure captured: Oct 04 18:47:46.619828 n-d-850501-14 devstack@n-api.service[123002]: request: POST /compute/v2.1/servers/89ad7c7f-cba8-4fbe-8442-63a74c482c6b/action HTTP/1.1 Oct 04 18:47:46.619828 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:47:46.619828 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:47:46.619828 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:47:46.619828 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 44 Oct 04 18:47:46.619828 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:47:46.619828 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:47:46.619828 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:47:46.619828 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:47:46.619828 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH-iHdlfIs8wUZ8D13z2XqYsPOmHk20-rCkSWPnuA-n6pjNAtEvLYTycHlthpYrA0CWkfc_Pcer2VGB2UiVmHgYJJnfG6Qx9QxIT0Yc0m5vU1an7o1snrk-vvplhYOk62QzkkiDeurqhqaBAaL-x1ajV-4MWIhKCk1GvrLRGJkadaxA Oct 04 18:47:46.619828 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:47:46.619828 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:47:46.619828 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:47:46.619828 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:47:46.619828 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:47:46.619828 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:47:46.619828 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 7917de0ff5be4d238981ea714d837fe0 Oct 04 18:47:46.619828 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 Oct 04 18:47:46.619828 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:47:46.619828 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:47:46.619828 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7917de0ff5be4d238981ea714d837fe0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7917de0ff5be4d238981ea714d837fe0", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7917de0ff5be4d238981ea714d837fe0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7917de0ff5be4d238981ea714d837fe0"}]}] Oct 04 18:47:46.619828 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 Oct 04 18:47:46.619828 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 7917de0ff5be4d238981ea714d837fe0 Oct 04 18:47:46.619828 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 Oct 04 18:47:46.619828 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project Oct 04 18:47:46.619828 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:47:46.619828 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:47:46.619828 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 4cce9172582d4efd8fc31251d4bfe63c Oct 04 18:47:46.619828 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project Oct 04 18:47:46.619828 n-d-850501-14 devstack@n-api.service[123002]: Oct 04 18:47:46.619828 n-d-850501-14 devstack@n-api.service[123002]: {"removeFloatingIp": {"address": "0.0.0.0"}} Oct 04 18:47:46.619828 n-d-850501-14 devstack@n-api.service[123002]: method: Oct 04 18:47:46.619828 n-d-850501-14 devstack@n-api.service[123002]: exception: Floating IP not found for address 0.0.0.0. Oct 04 18:47:46.619828 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '89ad7c7f-cba8-4fbe-8442-63a74c482c6b', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Oct 04 18:47:46.619828 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:47:46.619828 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:46.619828 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Oct 04 18:47:46.619828 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Oct 04 18:47:46.619828 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Oct 04 18:47:46.619828 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Oct 04 18:47:46.619828 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 04 18:47:46.619828 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 04 18:47:46.619828 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 04 18:47:46.619828 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:47:46.619828 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:46.619828 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:47:46.619828 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:46.619828 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:46.619828 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:46.619828 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:47:46.619828 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:47:46.619828 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:47:46.619828 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:47:46.619828 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:47:46.619828 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:47:46.619828 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:47:46.619828 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:47:46.619828 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Oct 04 18:47:46.619828 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Oct 04 18:47:46.619828 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Oct 04 18:47:46.619828 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Oct 04 18:47:46.623617 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Oct 04 18:47:46.623617 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:47:46.623617 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:46.623617 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:47:46.623617 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:46.623617 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:46.623617 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:46.623617 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:47:46.623617 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:47:46.623617 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Oct 04 18:47:46.623617 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:47:46.626211 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f82b77ee-a903-4179-8817-694de43f2cbe tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:47:46.627969 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f82b77ee-a903-4179-8817-694de43f2cbe tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] 10.222.0.20 "POST /compute/v2.1/servers/89ad7c7f-cba8-4fbe-8442-63a74c482c6b/action" status: 404 len: 88 microversion: 2.1 time: 0.453927 Oct 04 18:47:46.629684 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2203/4468] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:47:46 2022] POST /compute/v2.1/servers/89ad7c7f-cba8-4fbe-8442-63a74c482c6b/action => generated 88 bytes in 456 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:47:46.642414 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-52875bf5-2145-4445-b520-250f03647c07 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:46.643261 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-52875bf5-2145-4445-b520-250f03647c07 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:46.662973 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-52875bf5-2145-4445-b520-250f03647c07 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:46.663672 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-52875bf5-2145-4445-b520-250f03647c07 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:46.665293 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-52875bf5-2145-4445-b520-250f03647c07 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:46.667430 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-52875bf5-2145-4445-b520-250f03647c07 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:46.667923 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-52875bf5-2145-4445-b520-250f03647c07 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:46.669186 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-52875bf5-2145-4445-b520-250f03647c07 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:46.823960 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0f712efc-4792-4a66-b3b8-9f70a323a2e9 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:46.845957 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0f712efc-4792-4a66-b3b8-9f70a323a2e9 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/60694294-78ff-49f7-9d07-bb5915eae69e" status: 200 len: 1514 microversion: 2.1 time: 0.755120 Oct 04 18:47:46.865138 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2266/4469] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:46 2022] GET /compute/v2.1/servers/60694294-78ff-49f7-9d07-bb5915eae69e => generated 1514 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:46.877644 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2a17542a-3234-4315-9c5a-a0b4a7e0558a tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:46.879545 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2a17542a-3234-4315-9c5a-a0b4a7e0558a tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] [instance: 89ad7c7f-cba8-4fbe-8442-63a74c482c6b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:46.880663 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-52875bf5-2145-4445-b520-250f03647c07 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:46.891175 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-52875bf5-2145-4445-b520-250f03647c07 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1504 microversion: 2.1 time: 0.259943 Oct 04 18:47:46.891759 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2204/4470] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:46 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1504 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:46.906299 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2a17542a-3234-4315-9c5a-a0b4a7e0558a tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:46.906299 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2a17542a-3234-4315-9c5a-a0b4a7e0558a tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:46.906299 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2a17542a-3234-4315-9c5a-a0b4a7e0558a tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:46.906299 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2a17542a-3234-4315-9c5a-a0b4a7e0558a tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:46.906299 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2a17542a-3234-4315-9c5a-a0b4a7e0558a tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:46.906299 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2a17542a-3234-4315-9c5a-a0b4a7e0558a tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:46.907122 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-210f9478-c722-45cb-ba0a-16b978ac6578 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:46.907808 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-210f9478-c722-45cb-ba0a-16b978ac6578 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] [instance: 317c7bd8-4f1e-4210-bb33-087557a1f4d6] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:46.917973 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-210f9478-c722-45cb-ba0a-16b978ac6578 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:46.918767 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-210f9478-c722-45cb-ba0a-16b978ac6578 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:46.919500 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-210f9478-c722-45cb-ba0a-16b978ac6578 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:46.920430 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-210f9478-c722-45cb-ba0a-16b978ac6578 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:46.921044 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-210f9478-c722-45cb-ba0a-16b978ac6578 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:46.921628 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-210f9478-c722-45cb-ba0a-16b978ac6578 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:46.953526 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:47:46.963266 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2a17542a-3234-4315-9c5a-a0b4a7e0558a tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] [instance: 89ad7c7f-cba8-4fbe-8442-63a74c482c6b] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:47:47.223722 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-210f9478-c722-45cb-ba0a-16b978ac6578 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:47.245725 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-210f9478-c722-45cb-ba0a-16b978ac6578 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:47.248333 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-210f9478-c722-45cb-ba0a-16b978ac6578 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:47.249813 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-210f9478-c722-45cb-ba0a-16b978ac6578 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] 10.222.0.20 "GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6" status: 200 len: 1871 microversion: 2.32 time: 0.356919 Oct 04 18:47:47.266548 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2205/4471] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:47:46 2022] GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6 => generated 1871 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:47:47.282385 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9c22b21e-b50b-4857-866f-a3eadaca9ee8 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:47.283065 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9c22b21e-b50b-4857-866f-a3eadaca9ee8 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 80da67ee-578f-417c-b1b0-068a6cb52b3c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:47.297318 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-9c22b21e-b50b-4857-866f-a3eadaca9ee8 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] HTTP exception thrown: Instance 80da67ee-578f-417c-b1b0-068a6cb52b3c could not be found. Oct 04 18:47:47.315210 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9c22b21e-b50b-4857-866f-a3eadaca9ee8 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Request method failure captured: Oct 04 18:47:47.315210 n-d-850501-14 devstack@n-api.service[123002]: request: POST /compute/v2.1/servers/80da67ee-578f-417c-b1b0-068a6cb52b3c/action HTTP/1.1 Oct 04 18:47:47.315210 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:47:47.315210 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:47:47.315210 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:47:47.315210 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 19 Oct 04 18:47:47.315210 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:47:47.315210 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:47:47.315210 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:47:47.315210 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:47:47.315210 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH9zAVdj2h4kh6QqBpYrS2CJMhbcXf529VUNrZoZOYhS2tkLYBgw6AHy860DK9jQ3xATqZvC9lQuxt-_H5qKsAI41eznf32K6QSGqVcHXegpVHrDueww23ZMVCBM3D_hH0NTzh4447rgHqcrC-OZE48IfZrRJ9KPLPjAHT57T3mcPIc Oct 04 18:47:47.315210 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:47:47.315210 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:47:47.315210 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:47:47.315210 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:47:47.315210 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:47:47.315210 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:47:47.315210 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: b6c6b9deecde44b5953d22b38b5b0ff1 Oct 04 18:47:47.315210 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:47:47.315210 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:47:47.315210 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:47:47.315210 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6c6b9deecde44b5953d22b38b5b0ff1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b6c6b9deecde44b5953d22b38b5b0ff1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b6c6b9deecde44b5953d22b38b5b0ff1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6c6b9deecde44b5953d22b38b5b0ff1"}]}] Oct 04 18:47:47.315210 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:47:47.315210 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: b6c6b9deecde44b5953d22b38b5b0ff1 Oct 04 18:47:47.315210 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:47:47.315210 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServersNegativeTestJSON-626077540-project Oct 04 18:47:47.315210 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:47:47.315210 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:47:47.315210 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 5b4eb70f22ba4872b890a4f160cc1805 Oct 04 18:47:47.315210 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServersNegativeTestJSON-626077540-project Oct 04 18:47:47.315210 n-d-850501-14 devstack@n-api.service[123002]: Oct 04 18:47:47.315210 n-d-850501-14 devstack@n-api.service[123002]: {"forceDelete": {}} Oct 04 18:47:47.315210 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:47:47.315210 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 80da67ee-578f-417c-b1b0-068a6cb52b3c could not be found. Oct 04 18:47:47.315210 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '80da67ee-578f-417c-b1b0-068a6cb52b3c', 'body': {'forceDelete': {}}} Oct 04 18:47:47.315210 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:47:47.315210 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:47.315210 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:47:47.315210 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:47:47.315210 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:47:47.315210 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:47:47.315210 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:47:47.315210 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:47:47.315210 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80da67ee-578f-417c-b1b0-068a6cb52b3c could not be found. Oct 04 18:47:47.315210 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:47:47.315210 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:47.315210 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:47:47.315210 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:47.315210 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:47.315210 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:47.315210 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:47:47.315210 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:47:47.315210 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:47:47.315210 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:47:47.315210 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Oct 04 18:47:47.315210 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 04 18:47:47.315210 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:47:47.315210 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:47:47.315210 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80da67ee-578f-417c-b1b0-068a6cb52b3c could not be found. Oct 04 18:47:47.315210 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:47:47.315210 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:47.315210 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:47:47.315210 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:47.315210 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:47.315210 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:47.320448 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:47:47.320448 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:47:47.320448 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80da67ee-578f-417c-b1b0-068a6cb52b3c could not be found. Oct 04 18:47:47.320448 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:47:47.320448 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9c22b21e-b50b-4857-866f-a3eadaca9ee8 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Returning 404 to user: Instance 80da67ee-578f-417c-b1b0-068a6cb52b3c could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:47:47.320448 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9c22b21e-b50b-4857-866f-a3eadaca9ee8 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "POST /compute/v2.1/servers/80da67ee-578f-417c-b1b0-068a6cb52b3c/action" status: 404 len: 111 microversion: 2.1 time: 0.050151 Oct 04 18:47:47.320448 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2206/4472] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:47:47 2022] POST /compute/v2.1/servers/80da67ee-578f-417c-b1b0-068a6cb52b3c/action => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:47:47.325845 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-02164d6f-f00f-45f2-8cd9-d9c53b71f663 req-67f2a88b-e1e4-4e4e-8dc4-772fe96dea65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "317c7bd8-4f1e-4210-bb33-087557a1f4d6", "tag": "0c6f4307-90ef-4d56-82f7-ae7b40c2cd81"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:47.340238 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-02164d6f-f00f-45f2-8cd9-d9c53b71f663 req-67f2a88b-e1e4-4e4e-8dc4-772fe96dea65 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:47.341129 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-02164d6f-f00f-45f2-8cd9-d9c53b71f663 req-67f2a88b-e1e4-4e4e-8dc4-772fe96dea65 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:47.341733 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-02164d6f-f00f-45f2-8cd9-d9c53b71f663 req-67f2a88b-e1e4-4e4e-8dc4-772fe96dea65 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:47.354528 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-02164d6f-f00f-45f2-8cd9-d9c53b71f663 req-67f2a88b-e1e4-4e4e-8dc4-772fe96dea65 service nova] Creating event network-changed:0c6f4307-90ef-4d56-82f7-ae7b40c2cd81 for instance 317c7bd8-4f1e-4210-bb33-087557a1f4d6 on n-h1-850501-14 Oct 04 18:47:47.360306 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-02164d6f-f00f-45f2-8cd9-d9c53b71f663 req-67f2a88b-e1e4-4e4e-8dc4-772fe96dea65 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040175 Oct 04 18:47:47.361687 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2207/4473] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:47:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:47:47.366318 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2a17542a-3234-4315-9c5a-a0b4a7e0558a tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] 10.222.0.20 "DELETE /compute/v2.1/servers/89ad7c7f-cba8-4fbe-8442-63a74c482c6b" status: 204 len: 0 microversion: 2.1 time: 0.498596 Oct 04 18:47:47.367413 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2267/4474] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:47:46 2022] DELETE /compute/v2.1/servers/89ad7c7f-cba8-4fbe-8442-63a74c482c6b => generated 0 bytes in 501 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:47:47.369962 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-066c4932-1298-483c-92be-e69eba347f6d tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:47.371323 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-066c4932-1298-483c-92be-e69eba347f6d tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:47.378599 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0fca3878-f3d7-46c3-a581-b58b053a0fff tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:47.378966 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-066c4932-1298-483c-92be-e69eba347f6d tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:47.379628 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-066c4932-1298-483c-92be-e69eba347f6d tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:47.380545 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-066c4932-1298-483c-92be-e69eba347f6d tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:47.381720 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-066c4932-1298-483c-92be-e69eba347f6d tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:47.382337 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-066c4932-1298-483c-92be-e69eba347f6d tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:47.382456 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0fca3878-f3d7-46c3-a581-b58b053a0fff tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] [instance: 89ad7c7f-cba8-4fbe-8442-63a74c482c6b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:47.383019 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-066c4932-1298-483c-92be-e69eba347f6d tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:47.398580 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0fca3878-f3d7-46c3-a581-b58b053a0fff tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:47.399452 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0fca3878-f3d7-46c3-a581-b58b053a0fff tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:47.401090 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0fca3878-f3d7-46c3-a581-b58b053a0fff tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:47.403124 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0fca3878-f3d7-46c3-a581-b58b053a0fff tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:47.403124 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0fca3878-f3d7-46c3-a581-b58b053a0fff tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:47.405741 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0fca3878-f3d7-46c3-a581-b58b053a0fff tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:47.708264 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-066c4932-1298-483c-92be-e69eba347f6d tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:47.715028 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=100 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:47:47.729064 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-066c4932-1298-483c-92be-e69eba347f6d tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1504 microversion: 2.1 time: 0.365895 Oct 04 18:47:47.732309 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2208/4475] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:47 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1504 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:47.760326 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f8163799-0c9d-45cc-91ca-747cc94dc0d3 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:47.760956 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f8163799-0c9d-45cc-91ca-747cc94dc0d3 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:47.785890 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f8163799-0c9d-45cc-91ca-747cc94dc0d3 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:47.786526 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f8163799-0c9d-45cc-91ca-747cc94dc0d3 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:47.792674 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f8163799-0c9d-45cc-91ca-747cc94dc0d3 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:47.794100 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f8163799-0c9d-45cc-91ca-747cc94dc0d3 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:47.794608 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f8163799-0c9d-45cc-91ca-747cc94dc0d3 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:47.795057 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f8163799-0c9d-45cc-91ca-747cc94dc0d3 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:48.111862 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f8163799-0c9d-45cc-91ca-747cc94dc0d3 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:48.121902 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f8163799-0c9d-45cc-91ca-747cc94dc0d3 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1504 microversion: 2.1 time: 0.365427 Oct 04 18:47:48.136216 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2209/4476] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:47 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1504 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:47:48.144204 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2849272b-1d51-4aef-b247-5bcbe2c1fcc4 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:48.144204 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2849272b-1d51-4aef-b247-5bcbe2c1fcc4 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: 60694294-78ff-49f7-9d07-bb5915eae69e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:48.150623 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2849272b-1d51-4aef-b247-5bcbe2c1fcc4 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:48.151445 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2849272b-1d51-4aef-b247-5bcbe2c1fcc4 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:48.152150 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2849272b-1d51-4aef-b247-5bcbe2c1fcc4 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:48.153279 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2849272b-1d51-4aef-b247-5bcbe2c1fcc4 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:48.153970 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2849272b-1d51-4aef-b247-5bcbe2c1fcc4 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:48.154616 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2849272b-1d51-4aef-b247-5bcbe2c1fcc4 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:48.166745 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0fca3878-f3d7-46c3-a581-b58b053a0fff tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cce9172582d4efd8fc31251d4bfe63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7917de0ff5be4d238981ea714d837fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:48.210457 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0fca3878-f3d7-46c3-a581-b58b053a0fff tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] 10.222.0.20 "GET /compute/v2.1/servers/89ad7c7f-cba8-4fbe-8442-63a74c482c6b" status: 200 len: 1542 microversion: 2.1 time: 0.828003 Oct 04 18:47:48.211498 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2268/4477] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:47 2022] GET /compute/v2.1/servers/89ad7c7f-cba8-4fbe-8442-63a74c482c6b => generated 1542 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:48.222793 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-74861ff2-2b9c-400d-92f1-d3c832643a84 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:48.232090 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-74861ff2-2b9c-400d-92f1-d3c832643a84 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 70291ede-2088-444e-8a6a-13f1c0388b6f] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:48.251259 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-74861ff2-2b9c-400d-92f1-d3c832643a84 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] HTTP exception thrown: Instance 70291ede-2088-444e-8a6a-13f1c0388b6f could not be found. Oct 04 18:47:48.258008 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-74861ff2-2b9c-400d-92f1-d3c832643a84 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Request method failure captured: Oct 04 18:47:48.258008 n-d-850501-14 devstack@n-api.service[123001]: request: POST /compute/v2.1/servers/70291ede-2088-444e-8a6a-13f1c0388b6f/action HTTP/1.1 Oct 04 18:47:48.258008 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:47:48.258008 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:47:48.258008 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:47:48.258008 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 39 Oct 04 18:47:48.258008 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:47:48.258008 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:47:48.258008 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:47:48.258008 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:47:48.258008 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPH9zAVdj2h4kh6QqBpYrS2CJMhbcXf529VUNrZoZOYhS2tkLYBgw6AHy860DK9jQ3xATqZvC9lQuxt-_H5qKsAI41eznf32K6QSGqVcHXegpVHrDueww23ZMVCBM3D_hH0NTzh4447rgHqcrC-OZE48IfZrRJ9KPLPjAHT57T3mcPIc Oct 04 18:47:48.258008 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:47:48.258008 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:47:48.258008 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:47:48.258008 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:47:48.258008 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:47:48.258008 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:47:48.258008 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: b6c6b9deecde44b5953d22b38b5b0ff1 Oct 04 18:47:48.258008 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:47:48.258008 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:47:48.258008 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:47:48.258008 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6c6b9deecde44b5953d22b38b5b0ff1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b6c6b9deecde44b5953d22b38b5b0ff1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b6c6b9deecde44b5953d22b38b5b0ff1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6c6b9deecde44b5953d22b38b5b0ff1"}]}] Oct 04 18:47:48.258008 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:47:48.258008 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: b6c6b9deecde44b5953d22b38b5b0ff1 Oct 04 18:47:48.258008 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:47:48.258008 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ServersNegativeTestJSON-626077540-project Oct 04 18:47:48.258008 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:47:48.258008 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:47:48.258008 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 5b4eb70f22ba4872b890a4f160cc1805 Oct 04 18:47:48.258008 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ServersNegativeTestJSON-626077540-project Oct 04 18:47:48.258008 n-d-850501-14 devstack@n-api.service[123001]: Oct 04 18:47:48.258008 n-d-850501-14 devstack@n-api.service[123001]: {"os-getConsoleOutput": {"length": 10}} Oct 04 18:47:48.258008 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:47:48.258008 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 70291ede-2088-444e-8a6a-13f1c0388b6f could not be found. Oct 04 18:47:48.258008 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '70291ede-2088-444e-8a6a-13f1c0388b6f', 'body': {'os-getConsoleOutput': {'length': 10}}} Oct 04 18:47:48.258008 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:47:48.258008 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:48.258008 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:47:48.258008 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:47:48.258008 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:47:48.258008 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:47:48.258008 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:47:48.258008 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:47:48.258008 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70291ede-2088-444e-8a6a-13f1c0388b6f could not be found. Oct 04 18:47:48.258008 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:47:48.258008 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:48.258008 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:47:48.258008 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:48.258008 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:48.258008 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:48.258008 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:47:48.258008 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:47:48.258008 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:47:48.258008 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:47:48.258008 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:47:48.258008 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:47:48.258008 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Oct 04 18:47:48.258008 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 04 18:47:48.258008 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:47:48.258008 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:47:48.258008 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70291ede-2088-444e-8a6a-13f1c0388b6f could not be found. Oct 04 18:47:48.258008 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:47:48.258008 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:48.258008 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:47:48.258008 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:48.262369 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:48.262369 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:48.262369 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:47:48.262369 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:47:48.262369 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70291ede-2088-444e-8a6a-13f1c0388b6f could not be found. Oct 04 18:47:48.262369 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:47:48.263605 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-74861ff2-2b9c-400d-92f1-d3c832643a84 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Returning 404 to user: Instance 70291ede-2088-444e-8a6a-13f1c0388b6f could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:47:48.264989 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-74861ff2-2b9c-400d-92f1-d3c832643a84 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "POST /compute/v2.1/servers/70291ede-2088-444e-8a6a-13f1c0388b6f/action" status: 404 len: 111 microversion: 2.1 time: 0.050780 Oct 04 18:47:48.266018 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2269/4478] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:47:48 2022] POST /compute/v2.1/servers/70291ede-2088-444e-8a6a-13f1c0388b6f/action => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:47:48.280040 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-767a9811-eefd-47a3-b36d-3db6e78f6c11 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:48.282206 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-767a9811-eefd-47a3-b36d-3db6e78f6c11 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] [instance: 317c7bd8-4f1e-4210-bb33-087557a1f4d6] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:48.303943 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-767a9811-eefd-47a3-b36d-3db6e78f6c11 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:48.309251 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-767a9811-eefd-47a3-b36d-3db6e78f6c11 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:48.309251 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-767a9811-eefd-47a3-b36d-3db6e78f6c11 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:48.310077 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-767a9811-eefd-47a3-b36d-3db6e78f6c11 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:48.310762 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-767a9811-eefd-47a3-b36d-3db6e78f6c11 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:48.311404 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-767a9811-eefd-47a3-b36d-3db6e78f6c11 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:48.781267 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-767a9811-eefd-47a3-b36d-3db6e78f6c11 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:48.793845 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-767a9811-eefd-47a3-b36d-3db6e78f6c11 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:48.795317 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-767a9811-eefd-47a3-b36d-3db6e78f6c11 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:48.797978 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-767a9811-eefd-47a3-b36d-3db6e78f6c11 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] 10.222.0.20 "GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6" status: 200 len: 1892 microversion: 2.32 time: 0.524050 Oct 04 18:47:48.798731 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2270/4479] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:47:48 2022] GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6 => generated 1892 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:47:48.810063 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d7da16c6-503d-4038-bf00-4d2da30817ef tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:48.813865 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d7da16c6-503d-4038-bf00-4d2da30817ef tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:48.824683 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2849272b-1d51-4aef-b247-5bcbe2c1fcc4 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:48.833298 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d7da16c6-503d-4038-bf00-4d2da30817ef tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:48.834060 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d7da16c6-503d-4038-bf00-4d2da30817ef tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:48.834714 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2849272b-1d51-4aef-b247-5bcbe2c1fcc4 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/60694294-78ff-49f7-9d07-bb5915eae69e" status: 200 len: 1514 microversion: 2.1 time: 0.710347 Oct 04 18:47:48.836586 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2210/4480] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:48 2022] GET /compute/v2.1/servers/60694294-78ff-49f7-9d07-bb5915eae69e => generated 1514 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:48.849768 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d7da16c6-503d-4038-bf00-4d2da30817ef tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:48.851492 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d7da16c6-503d-4038-bf00-4d2da30817ef tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:48.851997 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d7da16c6-503d-4038-bf00-4d2da30817ef tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:48.852557 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d7da16c6-503d-4038-bf00-4d2da30817ef tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:49.113857 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d7da16c6-503d-4038-bf00-4d2da30817ef tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:49.131796 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d7da16c6-503d-4038-bf00-4d2da30817ef tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1504 microversion: 2.1 time: 0.331082 Oct 04 18:47:49.132634 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2271/4481] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:48 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1504 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:49.163251 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-978bcd0c-f97f-4f47-8e48-8fcb3eaba4b7 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:49.164100 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-978bcd0c-f97f-4f47-8e48-8fcb3eaba4b7 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:49.184011 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-978bcd0c-f97f-4f47-8e48-8fcb3eaba4b7 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:49.184570 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-978bcd0c-f97f-4f47-8e48-8fcb3eaba4b7 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:49.185028 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-978bcd0c-f97f-4f47-8e48-8fcb3eaba4b7 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:49.185777 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-978bcd0c-f97f-4f47-8e48-8fcb3eaba4b7 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:49.186244 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-978bcd0c-f97f-4f47-8e48-8fcb3eaba4b7 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:49.186678 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-978bcd0c-f97f-4f47-8e48-8fcb3eaba4b7 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:49.239498 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8ffbfaaa-9251-4102-9047-f796d0632cdf tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:49.240405 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8ffbfaaa-9251-4102-9047-f796d0632cdf tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] [instance: 89ad7c7f-cba8-4fbe-8442-63a74c482c6b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:49.249314 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8ffbfaaa-9251-4102-9047-f796d0632cdf tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:49.249880 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8ffbfaaa-9251-4102-9047-f796d0632cdf tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:49.250446 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8ffbfaaa-9251-4102-9047-f796d0632cdf tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:49.251359 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8ffbfaaa-9251-4102-9047-f796d0632cdf tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:49.251828 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8ffbfaaa-9251-4102-9047-f796d0632cdf tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:49.252691 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8ffbfaaa-9251-4102-9047-f796d0632cdf tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:49.548527 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-978bcd0c-f97f-4f47-8e48-8fcb3eaba4b7 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:49.548939 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8ffbfaaa-9251-4102-9047-f796d0632cdf tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cce9172582d4efd8fc31251d4bfe63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7917de0ff5be4d238981ea714d837fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:49.551968 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-978bcd0c-f97f-4f47-8e48-8fcb3eaba4b7 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1504 microversion: 2.1 time: 0.393507 Oct 04 18:47:49.553873 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8ffbfaaa-9251-4102-9047-f796d0632cdf tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] 10.222.0.20 "GET /compute/v2.1/servers/89ad7c7f-cba8-4fbe-8442-63a74c482c6b" status: 200 len: 1542 microversion: 2.1 time: 0.319063 Oct 04 18:47:49.555804 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2211/4482] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:49 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1504 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:49.564649 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2272/4483] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:49 2022] GET /compute/v2.1/servers/89ad7c7f-cba8-4fbe-8442-63a74c482c6b => generated 1542 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:49.575937 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-c4d62315-5b42-40f0-bb1a-61f469446299 req-6bdd90bc-ec40-4d3f-ae77-f30560f35361 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "317c7bd8-4f1e-4210-bb33-087557a1f4d6", "tag": "66c99c11-ceb2-4608-8f5b-878ab722f616"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:49.584182 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8744258d-651d-434d-88de-0ad22731903f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:49.588627 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-c4d62315-5b42-40f0-bb1a-61f469446299 req-6bdd90bc-ec40-4d3f-ae77-f30560f35361 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:49.589109 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-c4d62315-5b42-40f0-bb1a-61f469446299 req-6bdd90bc-ec40-4d3f-ae77-f30560f35361 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:49.589540 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-c4d62315-5b42-40f0-bb1a-61f469446299 req-6bdd90bc-ec40-4d3f-ae77-f30560f35361 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:49.590775 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8744258d-651d-434d-88de-0ad22731903f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 77b5e1b9-fb97-4bb7-be39-7a72e22c4e2f] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:49.604555 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-c4d62315-5b42-40f0-bb1a-61f469446299 req-6bdd90bc-ec40-4d3f-ae77-f30560f35361 service nova] Creating event network-changed:66c99c11-ceb2-4608-8f5b-878ab722f616 for instance 317c7bd8-4f1e-4210-bb33-087557a1f4d6 on n-h1-850501-14 Oct 04 18:47:49.608124 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-8744258d-651d-434d-88de-0ad22731903f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] HTTP exception thrown: Instance 77b5e1b9-fb97-4bb7-be39-7a72e22c4e2f could not be found. Oct 04 18:47:49.610069 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-c4d62315-5b42-40f0-bb1a-61f469446299 req-6bdd90bc-ec40-4d3f-ae77-f30560f35361 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044173 Oct 04 18:47:49.611369 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2212/4484] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:47:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:47:49.612335 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8744258d-651d-434d-88de-0ad22731903f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Request method failure captured: Oct 04 18:47:49.612335 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/77b5e1b9-fb97-4bb7-be39-7a72e22c4e2f HTTP/1.1 Oct 04 18:47:49.612335 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:47:49.612335 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:47:49.612335 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:47:49.612335 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:47:49.612335 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:47:49.612335 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:47:49.612335 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:47:49.612335 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:47:49.612335 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPH9zAVdj2h4kh6QqBpYrS2CJMhbcXf529VUNrZoZOYhS2tkLYBgw6AHy860DK9jQ3xATqZvC9lQuxt-_H5qKsAI41eznf32K6QSGqVcHXegpVHrDueww23ZMVCBM3D_hH0NTzh4447rgHqcrC-OZE48IfZrRJ9KPLPjAHT57T3mcPIc Oct 04 18:47:49.612335 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:47:49.612335 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:47:49.612335 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:47:49.612335 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:47:49.612335 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:47:49.612335 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:47:49.612335 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: b6c6b9deecde44b5953d22b38b5b0ff1 Oct 04 18:47:49.612335 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:47:49.612335 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:47:49.612335 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:47:49.612335 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6c6b9deecde44b5953d22b38b5b0ff1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b6c6b9deecde44b5953d22b38b5b0ff1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b6c6b9deecde44b5953d22b38b5b0ff1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6c6b9deecde44b5953d22b38b5b0ff1"}]}] Oct 04 18:47:49.612335 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:47:49.612335 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: b6c6b9deecde44b5953d22b38b5b0ff1 Oct 04 18:47:49.612335 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:47:49.612335 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ServersNegativeTestJSON-626077540-project Oct 04 18:47:49.612335 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:47:49.612335 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:47:49.612335 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 5b4eb70f22ba4872b890a4f160cc1805 Oct 04 18:47:49.612335 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ServersNegativeTestJSON-626077540-project Oct 04 18:47:49.612335 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:47:49.612335 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 77b5e1b9-fb97-4bb7-be39-7a72e22c4e2f could not be found. Oct 04 18:47:49.612335 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '77b5e1b9-fb97-4bb7-be39-7a72e22c4e2f'} Oct 04 18:47:49.612335 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:47:49.612335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:49.612335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:47:49.612335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:47:49.612335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:47:49.612335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:47:49.612335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:47:49.612335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:47:49.612335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77b5e1b9-fb97-4bb7-be39-7a72e22c4e2f could not be found. Oct 04 18:47:49.612335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:47:49.612335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:49.612335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:47:49.612335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:49.612335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:49.612335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:49.612335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:47:49.612335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:47:49.612335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:47:49.612335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:47:49.612335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:47:49.612335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:47:49.612335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:47:49.612335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:47:49.612335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:47:49.612335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:47:49.612335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77b5e1b9-fb97-4bb7-be39-7a72e22c4e2f could not be found. Oct 04 18:47:49.612335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:47:49.612335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:49.612335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:47:49.612335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:49.612335 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:49.618095 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:49.618095 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:47:49.618095 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:47:49.618095 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77b5e1b9-fb97-4bb7-be39-7a72e22c4e2f could not be found. Oct 04 18:47:49.618095 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:47:49.618095 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8744258d-651d-434d-88de-0ad22731903f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Returning 404 to user: Instance 77b5e1b9-fb97-4bb7-be39-7a72e22c4e2f could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:47:49.618095 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8744258d-651d-434d-88de-0ad22731903f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/77b5e1b9-fb97-4bb7-be39-7a72e22c4e2f" status: 404 len: 111 microversion: 2.1 time: 0.035318 Oct 04 18:47:49.618095 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2273/4485] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:49 2022] GET /compute/v2.1/servers/77b5e1b9-fb97-4bb7-be39-7a72e22c4e2f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:47:49.647396 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e9a76b30-ff47-4828-a54e-576e3cf03762 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:49.648629 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e9a76b30-ff47-4828-a54e-576e3cf03762 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:49.656810 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e9a76b30-ff47-4828-a54e-576e3cf03762 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:49.657899 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e9a76b30-ff47-4828-a54e-576e3cf03762 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:49.658653 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e9a76b30-ff47-4828-a54e-576e3cf03762 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:49.659571 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e9a76b30-ff47-4828-a54e-576e3cf03762 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:49.660401 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e9a76b30-ff47-4828-a54e-576e3cf03762 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:49.660999 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e9a76b30-ff47-4828-a54e-576e3cf03762 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:49.829001 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1458f9e7-336a-474e-98a0-de5f904dde84 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:49.829881 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1458f9e7-336a-474e-98a0-de5f904dde84 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] [instance: 317c7bd8-4f1e-4210-bb33-087557a1f4d6] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:49.840197 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1458f9e7-336a-474e-98a0-de5f904dde84 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:49.840975 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1458f9e7-336a-474e-98a0-de5f904dde84 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:49.841658 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1458f9e7-336a-474e-98a0-de5f904dde84 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:49.842679 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1458f9e7-336a-474e-98a0-de5f904dde84 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:49.843372 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1458f9e7-336a-474e-98a0-de5f904dde84 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:49.844100 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1458f9e7-336a-474e-98a0-de5f904dde84 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:50.151958 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e9a76b30-ff47-4828-a54e-576e3cf03762 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:50.168306 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e9a76b30-ff47-4828-a54e-576e3cf03762 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1504 microversion: 2.1 time: 0.526480 Oct 04 18:47:50.169725 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2213/4486] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:49 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1504 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:50.175342 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e9c51b7e-2154-4f1a-af28-e4109d5374b8 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:50.179453 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e9c51b7e-2154-4f1a-af28-e4109d5374b8 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: 60694294-78ff-49f7-9d07-bb5915eae69e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:50.190690 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e9c51b7e-2154-4f1a-af28-e4109d5374b8 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:50.198839 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e9c51b7e-2154-4f1a-af28-e4109d5374b8 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:50.199313 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e9c51b7e-2154-4f1a-af28-e4109d5374b8 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:50.201561 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e9c51b7e-2154-4f1a-af28-e4109d5374b8 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:50.202035 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e9c51b7e-2154-4f1a-af28-e4109d5374b8 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:50.202469 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e9c51b7e-2154-4f1a-af28-e4109d5374b8 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:50.262216 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1458f9e7-336a-474e-98a0-de5f904dde84 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:50.281041 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1458f9e7-336a-474e-98a0-de5f904dde84 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:50.289802 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1458f9e7-336a-474e-98a0-de5f904dde84 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:50.293314 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1458f9e7-336a-474e-98a0-de5f904dde84 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] 10.222.0.20 "GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6" status: 200 len: 1892 microversion: 2.32 time: 0.468383 Oct 04 18:47:50.295431 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2274/4487] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:47:49 2022] GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6 => generated 1892 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:47:50.319378 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-faf46909-bfcf-4e46-b0ba-c97312ed9571 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:50.319378 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-faf46909-bfcf-4e46-b0ba-c97312ed9571 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:50.337218 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-faf46909-bfcf-4e46-b0ba-c97312ed9571 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:50.343462 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-faf46909-bfcf-4e46-b0ba-c97312ed9571 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:50.344175 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-faf46909-bfcf-4e46-b0ba-c97312ed9571 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:50.345083 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-faf46909-bfcf-4e46-b0ba-c97312ed9571 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:50.345743 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-faf46909-bfcf-4e46-b0ba-c97312ed9571 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:50.346333 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-faf46909-bfcf-4e46-b0ba-c97312ed9571 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:50.641435 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e9c51b7e-2154-4f1a-af28-e4109d5374b8 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:50.658972 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e9c51b7e-2154-4f1a-af28-e4109d5374b8 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/60694294-78ff-49f7-9d07-bb5915eae69e" status: 200 len: 1514 microversion: 2.1 time: 0.487589 Oct 04 18:47:50.659506 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2214/4488] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:50 2022] GET /compute/v2.1/servers/60694294-78ff-49f7-9d07-bb5915eae69e => generated 1514 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:50.679785 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c87a145e-b12d-4a9f-94c7-35e2c1be0f47 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:50.680469 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c87a145e-b12d-4a9f-94c7-35e2c1be0f47 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:50.682495 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=78 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:47:50.682732 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-faf46909-bfcf-4e46-b0ba-c97312ed9571 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:50.690872 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c87a145e-b12d-4a9f-94c7-35e2c1be0f47 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:50.691380 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c87a145e-b12d-4a9f-94c7-35e2c1be0f47 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:50.691818 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c87a145e-b12d-4a9f-94c7-35e2c1be0f47 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:50.692528 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-faf46909-bfcf-4e46-b0ba-c97312ed9571 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1672 microversion: 2.1 time: 0.395562 Oct 04 18:47:50.692813 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c87a145e-b12d-4a9f-94c7-35e2c1be0f47 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:50.693386 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2275/4489] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:50 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1672 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:50.698310 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c87a145e-b12d-4a9f-94c7-35e2c1be0f47 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:50.698854 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c87a145e-b12d-4a9f-94c7-35e2c1be0f47 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:50.718269 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8be434ea-d05f-455d-9889-35fb6e066a9e tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:50.718882 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8be434ea-d05f-455d-9889-35fb6e066a9e tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] [instance: 89ad7c7f-cba8-4fbe-8442-63a74c482c6b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:50.761820 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8be434ea-d05f-455d-9889-35fb6e066a9e tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:50.762033 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8be434ea-d05f-455d-9889-35fb6e066a9e tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:50.762634 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8be434ea-d05f-455d-9889-35fb6e066a9e tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:50.765102 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8be434ea-d05f-455d-9889-35fb6e066a9e tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:50.767756 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8be434ea-d05f-455d-9889-35fb6e066a9e tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:50.768424 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8be434ea-d05f-455d-9889-35fb6e066a9e tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:51.391383 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8be434ea-d05f-455d-9889-35fb6e066a9e tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cce9172582d4efd8fc31251d4bfe63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7917de0ff5be4d238981ea714d837fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:51.413413 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8be434ea-d05f-455d-9889-35fb6e066a9e tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] 10.222.0.20 "GET /compute/v2.1/servers/89ad7c7f-cba8-4fbe-8442-63a74c482c6b" status: 200 len: 1542 microversion: 2.1 time: 0.699520 Oct 04 18:47:51.414023 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2276/4490] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:50 2022] GET /compute/v2.1/servers/89ad7c7f-cba8-4fbe-8442-63a74c482c6b => generated 1542 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:51.441463 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-fab4e7a7-a1f9-4fb1-9b3b-aa4712ae9158 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:51.442358 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-fab4e7a7-a1f9-4fb1-9b3b-aa4712ae9158 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:51.452145 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fab4e7a7-a1f9-4fb1-9b3b-aa4712ae9158 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:51.452145 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fab4e7a7-a1f9-4fb1-9b3b-aa4712ae9158 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:51.452145 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fab4e7a7-a1f9-4fb1-9b3b-aa4712ae9158 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:51.452145 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fab4e7a7-a1f9-4fb1-9b3b-aa4712ae9158 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:51.452145 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fab4e7a7-a1f9-4fb1-9b3b-aa4712ae9158 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:51.452145 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fab4e7a7-a1f9-4fb1-9b3b-aa4712ae9158 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:51.653297 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c87a145e-b12d-4a9f-94c7-35e2c1be0f47 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:51.675749 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c87a145e-b12d-4a9f-94c7-35e2c1be0f47 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1504 microversion: 2.1 time: 1.004339 Oct 04 18:47:51.677122 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2215/4491] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:50 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1504 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:51.701407 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ed96430e-7a76-47ef-be11-319b6b13dab9 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:51.702943 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ed96430e-7a76-47ef-be11-319b6b13dab9 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] [instance: 317c7bd8-4f1e-4210-bb33-087557a1f4d6] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:51.739132 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ed96430e-7a76-47ef-be11-319b6b13dab9 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:51.741220 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ed96430e-7a76-47ef-be11-319b6b13dab9 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:51.742717 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ed96430e-7a76-47ef-be11-319b6b13dab9 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:51.745211 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ed96430e-7a76-47ef-be11-319b6b13dab9 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:51.745939 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ed96430e-7a76-47ef-be11-319b6b13dab9 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:51.748354 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ed96430e-7a76-47ef-be11-319b6b13dab9 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:51.821378 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-fab4e7a7-a1f9-4fb1-9b3b-aa4712ae9158 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:51.832765 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-fab4e7a7-a1f9-4fb1-9b3b-aa4712ae9158 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1672 microversion: 2.1 time: 0.403120 Oct 04 18:47:51.833711 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2277/4492] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:51 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1672 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:51.869874 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d5d8c547-25dc-4f63-adad-b7e150d4f21a tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:51.882787 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d5d8c547-25dc-4f63-adad-b7e150d4f21a tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: 60694294-78ff-49f7-9d07-bb5915eae69e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:51.905584 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d5d8c547-25dc-4f63-adad-b7e150d4f21a tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:51.906213 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d5d8c547-25dc-4f63-adad-b7e150d4f21a tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:51.906770 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d5d8c547-25dc-4f63-adad-b7e150d4f21a tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:51.907635 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d5d8c547-25dc-4f63-adad-b7e150d4f21a tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:51.908263 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d5d8c547-25dc-4f63-adad-b7e150d4f21a tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:51.908797 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d5d8c547-25dc-4f63-adad-b7e150d4f21a tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:52.344654 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d5d8c547-25dc-4f63-adad-b7e150d4f21a tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:52.356518 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d5d8c547-25dc-4f63-adad-b7e150d4f21a tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/60694294-78ff-49f7-9d07-bb5915eae69e" status: 200 len: 1514 microversion: 2.1 time: 0.495472 Oct 04 18:47:52.357455 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2278/4493] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:51 2022] GET /compute/v2.1/servers/60694294-78ff-49f7-9d07-bb5915eae69e => generated 1514 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:52.362570 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b58f54df-66e7-4151-8dd2-6074831651b4 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:52.363183 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b58f54df-66e7-4151-8dd2-6074831651b4 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:52.385381 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b58f54df-66e7-4151-8dd2-6074831651b4 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:52.385880 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b58f54df-66e7-4151-8dd2-6074831651b4 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:52.386315 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b58f54df-66e7-4151-8dd2-6074831651b4 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:52.387072 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b58f54df-66e7-4151-8dd2-6074831651b4 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:52.387505 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b58f54df-66e7-4151-8dd2-6074831651b4 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:52.387931 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b58f54df-66e7-4151-8dd2-6074831651b4 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:52.539174 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ed96430e-7a76-47ef-be11-319b6b13dab9 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:52.550590 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ed96430e-7a76-47ef-be11-319b6b13dab9 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:52.555307 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ed96430e-7a76-47ef-be11-319b6b13dab9 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:52.558667 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ed96430e-7a76-47ef-be11-319b6b13dab9 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] 10.222.0.20 "GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6" status: 200 len: 1892 microversion: 2.32 time: 0.879896 Oct 04 18:47:52.559550 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2216/4494] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:47:51 2022] GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6 => generated 1892 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:47:52.572093 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-2785df21-b90f-4f38-99fc-5352efeb5eda req-bbc54856-1101-46a3-a832-b4860d6a03a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89ad7c7f-cba8-4fbe-8442-63a74c482c6b", "name": "network-vif-deleted", "tag": "48ca997a-f5b9-4dbe-8306-95ea1bef682b"}, {"name": "network-changed", "server_uuid": "317c7bd8-4f1e-4210-bb33-087557a1f4d6", "tag": "88a546f7-13bd-4f6e-b36e-3c743eeface0"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:52.597094 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-2785df21-b90f-4f38-99fc-5352efeb5eda req-bbc54856-1101-46a3-a832-b4860d6a03a5 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:52.598630 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-2785df21-b90f-4f38-99fc-5352efeb5eda req-bbc54856-1101-46a3-a832-b4860d6a03a5 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:52.601014 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-2785df21-b90f-4f38-99fc-5352efeb5eda req-bbc54856-1101-46a3-a832-b4860d6a03a5 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:52.630061 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-2785df21-b90f-4f38-99fc-5352efeb5eda req-bbc54856-1101-46a3-a832-b4860d6a03a5 service nova] Creating event network-vif-deleted:48ca997a-f5b9-4dbe-8306-95ea1bef682b for instance 89ad7c7f-cba8-4fbe-8442-63a74c482c6b on n-h2-850501-14 Oct 04 18:47:52.632920 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-2785df21-b90f-4f38-99fc-5352efeb5eda req-bbc54856-1101-46a3-a832-b4860d6a03a5 service nova] Creating event network-changed:88a546f7-13bd-4f6e-b36e-3c743eeface0 for instance 317c7bd8-4f1e-4210-bb33-087557a1f4d6 on n-h1-850501-14 Oct 04 18:47:52.649894 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-2785df21-b90f-4f38-99fc-5352efeb5eda req-bbc54856-1101-46a3-a832-b4860d6a03a5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.087148 Oct 04 18:47:52.650434 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2217/4495] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:47:52 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:47:52.664451 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ffc0e480-f48c-451d-b3b8-b0ff165148d6 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-616548118", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "334d1b7e-7632-43fb-8807-6117cf357d4f"}]}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:52.684841 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ffc0e480-f48c-451d-b3b8-b0ff165148d6 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Request method failure captured: Oct 04 18:47:52.684841 n-d-850501-14 devstack@n-api.service[123002]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:47:52.684841 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:47:52.684841 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:47:52.684841 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:47:52.684841 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 237 Oct 04 18:47:52.684841 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:47:52.684841 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:47:52.684841 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:47:52.684841 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:47:52.684841 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH9zAVdj2h4kh6QqBpYrS2CJMhbcXf529VUNrZoZOYhS2tkLYBgw6AHy860DK9jQ3xATqZvC9lQuxt-_H5qKsAI41eznf32K6QSGqVcHXegpVHrDueww23ZMVCBM3D_hH0NTzh4447rgHqcrC-OZE48IfZrRJ9KPLPjAHT57T3mcPIc Oct 04 18:47:52.684841 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:47:52.684841 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:47:52.684841 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:47:52.684841 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:47:52.684841 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:47:52.684841 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:47:52.684841 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: b6c6b9deecde44b5953d22b38b5b0ff1 Oct 04 18:47:52.684841 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:47:52.684841 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:47:52.684841 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:47:52.684841 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6c6b9deecde44b5953d22b38b5b0ff1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b6c6b9deecde44b5953d22b38b5b0ff1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b6c6b9deecde44b5953d22b38b5b0ff1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6c6b9deecde44b5953d22b38b5b0ff1"}]}] Oct 04 18:47:52.684841 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:47:52.684841 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: b6c6b9deecde44b5953d22b38b5b0ff1 Oct 04 18:47:52.684841 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:47:52.684841 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServersNegativeTestJSON-626077540-project Oct 04 18:47:52.684841 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:47:52.684841 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:47:52.684841 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 5b4eb70f22ba4872b890a4f160cc1805 Oct 04 18:47:52.684841 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServersNegativeTestJSON-626077540-project Oct 04 18:47:52.684841 n-d-850501-14 devstack@n-api.service[123002]: Oct 04 18:47:52.684841 n-d-850501-14 devstack@n-api.service[123002]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-616548118", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "334d1b7e-7632-43fb-8807-6117cf357d4f"}]}} Oct 04 18:47:52.684841 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:47:52.684841 n-d-850501-14 devstack@n-api.service[123002]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 04 18:47:52.684841 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-616548118', 'imageRef': 'f545e662-10b3-46b1-88bb-6e66dd294559', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '334d1b7e-7632-43fb-8807-6117cf357d4f'}]}}} Oct 04 18:47:52.684841 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:47:52.684841 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:52.684841 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 04 18:47:52.684841 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 04 18:47:52.684841 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Oct 04 18:47:52.684841 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Oct 04 18:47:52.684841 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Oct 04 18:47:52.684841 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 04 18:47:52.684841 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Oct 04 18:47:52.684841 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Oct 04 18:47:52.684841 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Oct 04 18:47:52.684841 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:47:52.684841 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 04 18:47:52.684841 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:47:52.684841 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:52.684841 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:47:52.684841 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:47:52.684841 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:47:52.684841 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:47:52.684841 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Oct 04 18:47:52.684841 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:47:52.684841 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Oct 04 18:47:52.684841 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Oct 04 18:47:52.684841 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:47:52.684841 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 18:47:52.684841 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Oct 04 18:47:52.684841 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:47:52.684841 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:52.684841 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:47:52.684841 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:52.688777 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:52.688777 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:52.688777 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:47:52.688777 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:47:52.688777 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:47:52.688777 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:47:52.688777 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:47:52.688777 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:47:52.688777 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:47:52.688777 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:47:52.688777 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:47:52.688777 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:47:52.688777 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:47:52.688777 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:47:52.688777 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 04 18:47:52.688777 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:47:52.688777 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:52.688777 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:47:52.688777 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:52.688777 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:52.688777 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:52.688777 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:47:52.688777 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:47:52.688777 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 04 18:47:52.688777 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:47:52.688777 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ffc0e480-f48c-451d-b3b8-b0ff165148d6 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:47:52.688777 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ffc0e480-f48c-451d-b3b8-b0ff165148d6 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.034891 Oct 04 18:47:52.688777 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2218/4496] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:47:52 2022] POST /compute/v2.1/servers => generated 139 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:47:52.693866 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-02025646-c7d2-4fa9-b00e-70839bc78552 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:52.699212 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-02025646-c7d2-4fa9-b00e-70839bc78552 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] [instance: 89ad7c7f-cba8-4fbe-8442-63a74c482c6b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:52.716882 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-02025646-c7d2-4fa9-b00e-70839bc78552 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:52.717370 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-02025646-c7d2-4fa9-b00e-70839bc78552 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:52.717826 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-02025646-c7d2-4fa9-b00e-70839bc78552 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:52.718544 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-02025646-c7d2-4fa9-b00e-70839bc78552 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:52.719008 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-02025646-c7d2-4fa9-b00e-70839bc78552 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:52.719626 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-02025646-c7d2-4fa9-b00e-70839bc78552 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:52.796419 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-02025646-c7d2-4fa9-b00e-70839bc78552 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:52.796839 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-02025646-c7d2-4fa9-b00e-70839bc78552 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:52.797462 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-02025646-c7d2-4fa9-b00e-70839bc78552 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:52.800258 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-02025646-c7d2-4fa9-b00e-70839bc78552 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Lazy-loading 'fault' on Instance uuid 89ad7c7f-cba8-4fbe-8442-63a74c482c6b {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:47:53.432686 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-02025646-c7d2-4fa9-b00e-70839bc78552 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cce9172582d4efd8fc31251d4bfe63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7917de0ff5be4d238981ea714d837fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:53.464560 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-02025646-c7d2-4fa9-b00e-70839bc78552 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] 10.222.0.20 "GET /compute/v2.1/servers/89ad7c7f-cba8-4fbe-8442-63a74c482c6b" status: 200 len: 1322 microversion: 2.1 time: 0.776108 Oct 04 18:47:53.467886 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2219/4497] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:52 2022] GET /compute/v2.1/servers/89ad7c7f-cba8-4fbe-8442-63a74c482c6b => generated 1322 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:53.481713 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-dde71f67-b516-4548-83ba-1ee86385e120 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:53.482459 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-dde71f67-b516-4548-83ba-1ee86385e120 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:53.500760 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dde71f67-b516-4548-83ba-1ee86385e120 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:53.502630 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dde71f67-b516-4548-83ba-1ee86385e120 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:53.505856 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dde71f67-b516-4548-83ba-1ee86385e120 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:53.507469 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dde71f67-b516-4548-83ba-1ee86385e120 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:53.509680 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dde71f67-b516-4548-83ba-1ee86385e120 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:53.510162 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dde71f67-b516-4548-83ba-1ee86385e120 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:53.664510 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b58f54df-66e7-4151-8dd2-6074831651b4 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:53.681825 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b58f54df-66e7-4151-8dd2-6074831651b4 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1672 microversion: 2.1 time: 1.323219 Oct 04 18:47:53.700905 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2279/4498] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:52 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1672 bytes in 1343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:53.711032 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-854639a4-6dc1-491b-8c43-9e55f4b5316f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:53.712568 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-854639a4-6dc1-491b-8c43-9e55f4b5316f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: 60694294-78ff-49f7-9d07-bb5915eae69e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:53.721887 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-854639a4-6dc1-491b-8c43-9e55f4b5316f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:53.722650 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-854639a4-6dc1-491b-8c43-9e55f4b5316f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:53.723246 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-854639a4-6dc1-491b-8c43-9e55f4b5316f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:53.725560 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-854639a4-6dc1-491b-8c43-9e55f4b5316f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:53.726689 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-854639a4-6dc1-491b-8c43-9e55f4b5316f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:53.727885 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-854639a4-6dc1-491b-8c43-9e55f4b5316f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:53.790186 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-dde71f67-b516-4548-83ba-1ee86385e120 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:53.822453 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-dde71f67-b516-4548-83ba-1ee86385e120 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1504 microversion: 2.1 time: 0.353261 Oct 04 18:47:53.824634 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2220/4499] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:53 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1504 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:53.831496 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-fba8627e-a83a-409c-bcf3-22447fd9ad88 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:53.832366 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-fba8627e-a83a-409c-bcf3-22447fd9ad88 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] [instance: 317c7bd8-4f1e-4210-bb33-087557a1f4d6] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:53.843240 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fba8627e-a83a-409c-bcf3-22447fd9ad88 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:53.844625 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fba8627e-a83a-409c-bcf3-22447fd9ad88 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:53.845258 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fba8627e-a83a-409c-bcf3-22447fd9ad88 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:53.848106 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fba8627e-a83a-409c-bcf3-22447fd9ad88 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:53.849773 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fba8627e-a83a-409c-bcf3-22447fd9ad88 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:53.850389 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fba8627e-a83a-409c-bcf3-22447fd9ad88 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:54.451046 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-854639a4-6dc1-491b-8c43-9e55f4b5316f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:54.461164 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-854639a4-6dc1-491b-8c43-9e55f4b5316f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/60694294-78ff-49f7-9d07-bb5915eae69e" status: 200 len: 1514 microversion: 2.1 time: 0.758627 Oct 04 18:47:54.462088 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2280/4500] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:53 2022] GET /compute/v2.1/servers/60694294-78ff-49f7-9d07-bb5915eae69e => generated 1514 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:54.468136 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ec89cb8f-1d2b-48e2-9f33-2d1bb1131325 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-882744342"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:54.471759 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ec89cb8f-1d2b-48e2-9f33-2d1bb1131325 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:54.478884 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec89cb8f-1d2b-48e2-9f33-2d1bb1131325 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:54.479672 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec89cb8f-1d2b-48e2-9f33-2d1bb1131325 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:54.480154 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec89cb8f-1d2b-48e2-9f33-2d1bb1131325 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:54.480894 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec89cb8f-1d2b-48e2-9f33-2d1bb1131325 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:54.481512 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec89cb8f-1d2b-48e2-9f33-2d1bb1131325 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:54.481950 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec89cb8f-1d2b-48e2-9f33-2d1bb1131325 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:54.719491 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-fba8627e-a83a-409c-bcf3-22447fd9ad88 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:54.732432 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-fba8627e-a83a-409c-bcf3-22447fd9ad88 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:54.734515 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-fba8627e-a83a-409c-bcf3-22447fd9ad88 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:54.735932 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-fba8627e-a83a-409c-bcf3-22447fd9ad88 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] 10.222.0.20 "GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6" status: 200 len: 1892 microversion: 2.32 time: 0.910057 Oct 04 18:47:54.748505 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2221/4501] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:47:53 2022] GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6 => generated 1892 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:47:54.761307 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2a7f7301-b5aa-475c-ab3e-233148cf81bc tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:54.762257 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2a7f7301-b5aa-475c-ab3e-233148cf81bc tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:54.770175 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2a7f7301-b5aa-475c-ab3e-233148cf81bc tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:54.771448 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2a7f7301-b5aa-475c-ab3e-233148cf81bc tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:54.772151 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2a7f7301-b5aa-475c-ab3e-233148cf81bc tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:54.773270 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2a7f7301-b5aa-475c-ab3e-233148cf81bc tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:54.774007 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2a7f7301-b5aa-475c-ab3e-233148cf81bc tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:54.774667 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2a7f7301-b5aa-475c-ab3e-233148cf81bc tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:55.194882 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ec89cb8f-1d2b-48e2-9f33-2d1bb1131325 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "POST /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238/action" status: 202 len: 0 microversion: 2.1 time: 0.731170 Oct 04 18:47:55.198939 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2281/4502] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:47:54 2022] POST /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238/action => generated 0 bytes in 733 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 04 18:47:55.209542 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-fb679565-fd9c-41b2-b01b-464920c1e121 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:55.210482 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-fb679565-fd9c-41b2-b01b-464920c1e121 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] [instance: 89ad7c7f-cba8-4fbe-8442-63a74c482c6b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:55.231073 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fb679565-fd9c-41b2-b01b-464920c1e121 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:55.232189 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fb679565-fd9c-41b2-b01b-464920c1e121 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:55.232825 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fb679565-fd9c-41b2-b01b-464920c1e121 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:55.233796 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fb679565-fd9c-41b2-b01b-464920c1e121 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:55.235120 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fb679565-fd9c-41b2-b01b-464920c1e121 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:55.235774 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fb679565-fd9c-41b2-b01b-464920c1e121 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:55.252723 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2a7f7301-b5aa-475c-ab3e-233148cf81bc tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:55.275038 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-fb679565-fd9c-41b2-b01b-464920c1e121 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] HTTP exception thrown: Instance 89ad7c7f-cba8-4fbe-8442-63a74c482c6b could not be found. Oct 04 18:47:55.277062 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2a7f7301-b5aa-475c-ab3e-233148cf81bc tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1504 microversion: 2.1 time: 0.521715 Oct 04 18:47:55.280685 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-fb679565-fd9c-41b2-b01b-464920c1e121 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Request method failure captured: Oct 04 18:47:55.280685 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/89ad7c7f-cba8-4fbe-8442-63a74c482c6b HTTP/1.1 Oct 04 18:47:55.280685 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:47:55.280685 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:47:55.280685 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:47:55.280685 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:47:55.280685 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:47:55.280685 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:47:55.280685 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:47:55.280685 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:47:55.280685 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPH-iHdlfIs8wUZ8D13z2XqYsPOmHk20-rCkSWPnuA-n6pjNAtEvLYTycHlthpYrA0CWkfc_Pcer2VGB2UiVmHgYJJnfG6Qx9QxIT0Yc0m5vU1an7o1snrk-vvplhYOk62QzkkiDeurqhqaBAaL-x1ajV-4MWIhKCk1GvrLRGJkadaxA Oct 04 18:47:55.280685 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:47:55.280685 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:47:55.280685 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:47:55.280685 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:47:55.280685 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:47:55.280685 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:47:55.280685 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 7917de0ff5be4d238981ea714d837fe0 Oct 04 18:47:55.280685 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 Oct 04 18:47:55.280685 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:47:55.280685 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:47:55.280685 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7917de0ff5be4d238981ea714d837fe0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7917de0ff5be4d238981ea714d837fe0", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7917de0ff5be4d238981ea714d837fe0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7917de0ff5be4d238981ea714d837fe0"}]}] Oct 04 18:47:55.280685 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 Oct 04 18:47:55.280685 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 7917de0ff5be4d238981ea714d837fe0 Oct 04 18:47:55.280685 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 Oct 04 18:47:55.280685 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project Oct 04 18:47:55.280685 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:47:55.280685 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:47:55.280685 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 4cce9172582d4efd8fc31251d4bfe63c Oct 04 18:47:55.280685 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project Oct 04 18:47:55.280685 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:47:55.280685 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 89ad7c7f-cba8-4fbe-8442-63a74c482c6b could not be found. Oct 04 18:47:55.280685 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '89ad7c7f-cba8-4fbe-8442-63a74c482c6b'} Oct 04 18:47:55.280685 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:47:55.280685 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:55.280685 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:47:55.280685 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:47:55.280685 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:47:55.280685 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:47:55.280685 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:47:55.280685 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:47:55.280685 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:47:55.280685 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:47:55.280685 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89ad7c7f-cba8-4fbe-8442-63a74c482c6b could not be found. Oct 04 18:47:55.280685 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:47:55.280685 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:55.280685 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:47:55.280685 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:55.280685 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:55.280685 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:55.280685 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:47:55.280685 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:47:55.280685 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:47:55.280685 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:47:55.280685 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:47:55.280685 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:47:55.280685 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:47:55.280685 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:47:55.280685 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:47:55.280685 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:47:55.280685 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89ad7c7f-cba8-4fbe-8442-63a74c482c6b could not be found. Oct 04 18:47:55.280685 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:47:55.285452 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:55.285452 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:47:55.285452 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:55.285452 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:55.285452 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:55.285452 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:47:55.285452 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:47:55.285452 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89ad7c7f-cba8-4fbe-8442-63a74c482c6b could not be found. Oct 04 18:47:55.285452 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:47:55.289124 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-fb679565-fd9c-41b2-b01b-464920c1e121 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] Returning 404 to user: Instance 89ad7c7f-cba8-4fbe-8442-63a74c482c6b could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:47:55.291349 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-fb679565-fd9c-41b2-b01b-464920c1e121 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603 tempest-FloatingIPsAssociationNegativeTestJSON-1113941603-project] 10.222.0.20 "GET /compute/v2.1/servers/89ad7c7f-cba8-4fbe-8442-63a74c482c6b" status: 404 len: 111 microversion: 2.1 time: 0.090735 Oct 04 18:47:55.296027 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2282/4503] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:55 2022] GET /compute/v2.1/servers/89ad7c7f-cba8-4fbe-8442-63a74c482c6b => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:47:55.296427 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2222/4504] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:54 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1504 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:55.306337 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-c266f0f6-1bbe-458a-95c2-6d80728cb9a3 req-bda2b63f-095d-48fb-93b2-91a94fbeed83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "317c7bd8-4f1e-4210-bb33-087557a1f4d6", "tag": "2db3b2e9-5704-4a97-af2f-ad3b3aff8b6c"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:55.348406 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-c266f0f6-1bbe-458a-95c2-6d80728cb9a3 req-bda2b63f-095d-48fb-93b2-91a94fbeed83 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:55.350171 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-c266f0f6-1bbe-458a-95c2-6d80728cb9a3 req-bda2b63f-095d-48fb-93b2-91a94fbeed83 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:55.350836 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-c266f0f6-1bbe-458a-95c2-6d80728cb9a3 req-bda2b63f-095d-48fb-93b2-91a94fbeed83 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:55.365342 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-c266f0f6-1bbe-458a-95c2-6d80728cb9a3 req-bda2b63f-095d-48fb-93b2-91a94fbeed83 service nova] Creating event network-changed:2db3b2e9-5704-4a97-af2f-ad3b3aff8b6c for instance 317c7bd8-4f1e-4210-bb33-087557a1f4d6 on n-h1-850501-14 Oct 04 18:47:55.371174 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-c266f0f6-1bbe-458a-95c2-6d80728cb9a3 req-bda2b63f-095d-48fb-93b2-91a94fbeed83 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073072 Oct 04 18:47:55.376128 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2283/4505] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:47:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:47:55.486871 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a354b633-5845-43a3-ac2a-e814c73ea544 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:55.488204 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a354b633-5845-43a3-ac2a-e814c73ea544 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: 60694294-78ff-49f7-9d07-bb5915eae69e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:55.501389 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a354b633-5845-43a3-ac2a-e814c73ea544 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:55.502279 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a354b633-5845-43a3-ac2a-e814c73ea544 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:55.502956 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a354b633-5845-43a3-ac2a-e814c73ea544 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:55.505756 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a354b633-5845-43a3-ac2a-e814c73ea544 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:55.506463 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a354b633-5845-43a3-ac2a-e814c73ea544 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:55.507130 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a354b633-5845-43a3-ac2a-e814c73ea544 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:55.614121 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ae1bdcae-f4d7-4e78-831c-2d6252c64125 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1316451347", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "334d1b7e-7632-43fb-8807-6117cf357d4f"}]}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:55.620690 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ae1bdcae-f4d7-4e78-831c-2d6252c64125 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Request method failure captured: Oct 04 18:47:55.620690 n-d-850501-14 devstack@n-api.service[123001]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:47:55.620690 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:47:55.620690 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:47:55.620690 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:47:55.620690 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 235 Oct 04 18:47:55.620690 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:47:55.620690 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:47:55.620690 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:47:55.620690 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:47:55.620690 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPH9zAVdj2h4kh6QqBpYrS2CJMhbcXf529VUNrZoZOYhS2tkLYBgw6AHy860DK9jQ3xATqZvC9lQuxt-_H5qKsAI41eznf32K6QSGqVcHXegpVHrDueww23ZMVCBM3D_hH0NTzh4447rgHqcrC-OZE48IfZrRJ9KPLPjAHT57T3mcPIc Oct 04 18:47:55.620690 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:47:55.620690 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:47:55.620690 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:47:55.620690 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:47:55.620690 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:47:55.620690 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:47:55.620690 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: b6c6b9deecde44b5953d22b38b5b0ff1 Oct 04 18:47:55.620690 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:47:55.620690 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:47:55.620690 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:47:55.620690 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6c6b9deecde44b5953d22b38b5b0ff1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b6c6b9deecde44b5953d22b38b5b0ff1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b6c6b9deecde44b5953d22b38b5b0ff1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6c6b9deecde44b5953d22b38b5b0ff1"}]}] Oct 04 18:47:55.620690 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:47:55.620690 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: b6c6b9deecde44b5953d22b38b5b0ff1 Oct 04 18:47:55.620690 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:47:55.620690 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ServersNegativeTestJSON-626077540-project Oct 04 18:47:55.620690 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:47:55.620690 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:47:55.620690 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 5b4eb70f22ba4872b890a4f160cc1805 Oct 04 18:47:55.620690 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ServersNegativeTestJSON-626077540-project Oct 04 18:47:55.620690 n-d-850501-14 devstack@n-api.service[123001]: Oct 04 18:47:55.620690 n-d-850501-14 devstack@n-api.service[123001]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1316451347", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "334d1b7e-7632-43fb-8807-6117cf357d4f"}]}} Oct 04 18:47:55.620690 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:47:55.620690 n-d-850501-14 devstack@n-api.service[123001]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 04 18:47:55.620690 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1316451347', 'imageRef': 'f545e662-10b3-46b1-88bb-6e66dd294559', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '334d1b7e-7632-43fb-8807-6117cf357d4f'}]}}} Oct 04 18:47:55.620690 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:47:55.620690 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:55.620690 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 04 18:47:55.620690 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 04 18:47:55.620690 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Oct 04 18:47:55.620690 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Oct 04 18:47:55.620690 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Oct 04 18:47:55.620690 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 04 18:47:55.620690 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Oct 04 18:47:55.620690 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Oct 04 18:47:55.620690 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Oct 04 18:47:55.620690 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:47:55.620690 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 04 18:47:55.620690 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:47:55.620690 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:55.620690 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:47:55.620690 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:47:55.620690 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:47:55.620690 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:47:55.620690 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Oct 04 18:47:55.620690 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:47:55.620690 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Oct 04 18:47:55.620690 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Oct 04 18:47:55.620690 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:47:55.620690 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 18:47:55.620690 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi 'notvalid' Oct 04 18:47:55.620690 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:47:55.620690 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:55.620690 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:47:55.620690 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:55.625269 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:55.625269 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:55.625269 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:47:55.625269 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:47:55.625269 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:47:55.625269 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:47:55.625269 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:47:55.625269 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:47:55.625269 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:47:55.625269 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:47:55.625269 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:47:55.625269 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:47:55.625269 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:47:55.625269 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:47:55.625269 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 04 18:47:55.625269 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:47:55.625269 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:55.625269 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:47:55.625269 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:55.625269 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:55.625269 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:55.625269 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:47:55.625269 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:47:55.625269 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 04 18:47:55.625269 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:47:55.627133 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ae1bdcae-f4d7-4e78-831c-2d6252c64125 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:47:55.628547 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ae1bdcae-f4d7-4e78-831c-2d6252c64125 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.018924 Oct 04 18:47:55.629876 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2284/4506] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:47:55 2022] POST /compute/v2.1/servers => generated 133 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 04 18:47:55.660154 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ae9f0aee-71e6-4528-898a-a7cb5eb4e3a4 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:55.661089 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ae9f0aee-71e6-4528-898a-a7cb5eb4e3a4 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:55.696710 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ae9f0aee-71e6-4528-898a-a7cb5eb4e3a4 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:55.697485 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ae9f0aee-71e6-4528-898a-a7cb5eb4e3a4 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:55.698937 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ae9f0aee-71e6-4528-898a-a7cb5eb4e3a4 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:55.702840 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ae9f0aee-71e6-4528-898a-a7cb5eb4e3a4 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:55.706724 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ae9f0aee-71e6-4528-898a-a7cb5eb4e3a4 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:55.707810 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ae9f0aee-71e6-4528-898a-a7cb5eb4e3a4 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:55.752214 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:47:55.898284 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a354b633-5845-43a3-ac2a-e814c73ea544 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:55.908012 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a354b633-5845-43a3-ac2a-e814c73ea544 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/60694294-78ff-49f7-9d07-bb5915eae69e" status: 200 len: 1514 microversion: 2.1 time: 0.424882 Oct 04 18:47:55.920987 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2223/4507] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:55 2022] GET /compute/v2.1/servers/60694294-78ff-49f7-9d07-bb5915eae69e => generated 1514 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:55.931506 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-fc065a7d-04de-4281-9d05-b4d2eb84155a tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:55.933324 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-fc065a7d-04de-4281-9d05-b4d2eb84155a tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] [instance: 317c7bd8-4f1e-4210-bb33-087557a1f4d6] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:55.940395 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fc065a7d-04de-4281-9d05-b4d2eb84155a tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:55.941227 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fc065a7d-04de-4281-9d05-b4d2eb84155a tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:55.941933 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fc065a7d-04de-4281-9d05-b4d2eb84155a tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:55.944019 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fc065a7d-04de-4281-9d05-b4d2eb84155a tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:55.944752 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fc065a7d-04de-4281-9d05-b4d2eb84155a tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:55.945373 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fc065a7d-04de-4281-9d05-b4d2eb84155a tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:55.967861 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ae9f0aee-71e6-4528-898a-a7cb5eb4e3a4 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:55.978910 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ae9f0aee-71e6-4528-898a-a7cb5eb4e3a4 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1504 microversion: 2.1 time: 0.332583 Oct 04 18:47:55.992990 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2285/4508] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:55 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1504 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:56.011478 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-998066b1-5657-4e85-bbdb-1830718a5d5f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:56.012323 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-998066b1-5657-4e85-bbdb-1830718a5d5f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:56.015969 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:47:56.024894 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-998066b1-5657-4e85-bbdb-1830718a5d5f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:56.025626 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-998066b1-5657-4e85-bbdb-1830718a5d5f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:56.026224 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-998066b1-5657-4e85-bbdb-1830718a5d5f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:56.027086 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-998066b1-5657-4e85-bbdb-1830718a5d5f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:56.027689 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-998066b1-5657-4e85-bbdb-1830718a5d5f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:56.029552 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-998066b1-5657-4e85-bbdb-1830718a5d5f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:56.398295 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-fc065a7d-04de-4281-9d05-b4d2eb84155a tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:56.409678 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-fc065a7d-04de-4281-9d05-b4d2eb84155a tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:56.411135 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-fc065a7d-04de-4281-9d05-b4d2eb84155a tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:56.413101 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-fc065a7d-04de-4281-9d05-b4d2eb84155a tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] 10.222.0.20 "GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6" status: 200 len: 1892 microversion: 2.32 time: 0.490631 Oct 04 18:47:56.413735 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2224/4509] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:47:55 2022] GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6 => generated 1892 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:47:56.427924 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-998066b1-5657-4e85-bbdb-1830718a5d5f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:56.439674 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-998066b1-5657-4e85-bbdb-1830718a5d5f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1504 microversion: 2.1 time: 0.438421 Oct 04 18:47:56.444845 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2286/4510] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:56 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1504 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:47:56.481636 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b8424338-d1da-4b24-b309-6afb15ab6511 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:56.482499 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b8424338-d1da-4b24-b309-6afb15ab6511 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 710e8b93-313d-4019-a40e-3ccdf215fc88] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:56.494330 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-b8424338-d1da-4b24-b309-6afb15ab6511 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] HTTP exception thrown: Instance 710e8b93-313d-4019-a40e-3ccdf215fc88 could not be found. Oct 04 18:47:56.502444 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b8424338-d1da-4b24-b309-6afb15ab6511 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Request method failure captured: Oct 04 18:47:56.502444 n-d-850501-14 devstack@n-api.service[123002]: request: POST /compute/v2.1/servers/710e8b93-313d-4019-a40e-3ccdf215fc88/action HTTP/1.1 Oct 04 18:47:56.502444 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:47:56.502444 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:47:56.502444 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:47:56.502444 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 13 Oct 04 18:47:56.502444 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:47:56.502444 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:47:56.502444 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:47:56.502444 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:47:56.502444 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH9zAVdj2h4kh6QqBpYrS2CJMhbcXf529VUNrZoZOYhS2tkLYBgw6AHy860DK9jQ3xATqZvC9lQuxt-_H5qKsAI41eznf32K6QSGqVcHXegpVHrDueww23ZMVCBM3D_hH0NTzh4447rgHqcrC-OZE48IfZrRJ9KPLPjAHT57T3mcPIc Oct 04 18:47:56.502444 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:47:56.502444 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:47:56.502444 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:47:56.502444 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:47:56.502444 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:47:56.502444 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:47:56.502444 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: b6c6b9deecde44b5953d22b38b5b0ff1 Oct 04 18:47:56.502444 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:47:56.502444 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:47:56.502444 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:47:56.502444 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6c6b9deecde44b5953d22b38b5b0ff1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b6c6b9deecde44b5953d22b38b5b0ff1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b6c6b9deecde44b5953d22b38b5b0ff1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6c6b9deecde44b5953d22b38b5b0ff1"}]}] Oct 04 18:47:56.502444 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:47:56.502444 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: b6c6b9deecde44b5953d22b38b5b0ff1 Oct 04 18:47:56.502444 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:47:56.502444 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServersNegativeTestJSON-626077540-project Oct 04 18:47:56.502444 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:47:56.502444 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:47:56.502444 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 5b4eb70f22ba4872b890a4f160cc1805 Oct 04 18:47:56.502444 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServersNegativeTestJSON-626077540-project Oct 04 18:47:56.502444 n-d-850501-14 devstack@n-api.service[123002]: Oct 04 18:47:56.502444 n-d-850501-14 devstack@n-api.service[123002]: {"pause": {}} Oct 04 18:47:56.502444 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:47:56.502444 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 710e8b93-313d-4019-a40e-3ccdf215fc88 could not be found. Oct 04 18:47:56.502444 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '710e8b93-313d-4019-a40e-3ccdf215fc88', 'body': {'pause': {}}} Oct 04 18:47:56.502444 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:47:56.502444 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:56.502444 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:47:56.502444 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:47:56.502444 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:47:56.502444 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:47:56.502444 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:47:56.502444 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:47:56.502444 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 710e8b93-313d-4019-a40e-3ccdf215fc88 could not be found. Oct 04 18:47:56.502444 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:47:56.502444 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:56.502444 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:47:56.502444 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:56.502444 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:56.502444 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:56.502444 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:47:56.502444 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:47:56.502444 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:47:56.502444 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:47:56.502444 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Oct 04 18:47:56.502444 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 04 18:47:56.502444 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:47:56.502444 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:47:56.502444 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 710e8b93-313d-4019-a40e-3ccdf215fc88 could not be found. Oct 04 18:47:56.502444 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:47:56.502444 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:56.502444 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:47:56.502444 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:56.502444 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:56.502444 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:56.508774 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:47:56.508774 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:47:56.508774 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 710e8b93-313d-4019-a40e-3ccdf215fc88 could not be found. Oct 04 18:47:56.508774 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:47:56.510430 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b8424338-d1da-4b24-b309-6afb15ab6511 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Returning 404 to user: Instance 710e8b93-313d-4019-a40e-3ccdf215fc88 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:47:56.511526 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b8424338-d1da-4b24-b309-6afb15ab6511 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "POST /compute/v2.1/servers/710e8b93-313d-4019-a40e-3ccdf215fc88/action" status: 404 len: 111 microversion: 2.1 time: 0.037320 Oct 04 18:47:56.512472 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2225/4511] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:47:56 2022] POST /compute/v2.1/servers/710e8b93-313d-4019-a40e-3ccdf215fc88/action => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:47:56.525488 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-63fef957-31eb-4ec4-b101-66964d57a037 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:56.526362 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-63fef957-31eb-4ec4-b101-66964d57a037 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:56.542153 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-63fef957-31eb-4ec4-b101-66964d57a037 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:56.543901 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-63fef957-31eb-4ec4-b101-66964d57a037 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:56.544805 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-63fef957-31eb-4ec4-b101-66964d57a037 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:56.546712 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-63fef957-31eb-4ec4-b101-66964d57a037 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:56.550588 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-63fef957-31eb-4ec4-b101-66964d57a037 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:56.551225 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-63fef957-31eb-4ec4-b101-66964d57a037 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:56.884719 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-63fef957-31eb-4ec4-b101-66964d57a037 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:56.893126 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-63fef957-31eb-4ec4-b101-66964d57a037 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1504 microversion: 2.1 time: 0.376122 Oct 04 18:47:56.899579 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2287/4512] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:56 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1504 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:56.924966 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d268c0f4-9f5e-4627-af67-81cb3e5ab782 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:56.925661 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d268c0f4-9f5e-4627-af67-81cb3e5ab782 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:56.939676 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-fee4ff79-9785-4218-a483-8a0104312680 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:56.940662 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-fee4ff79-9785-4218-a483-8a0104312680 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: 60694294-78ff-49f7-9d07-bb5915eae69e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:56.951233 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fee4ff79-9785-4218-a483-8a0104312680 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:56.951726 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fee4ff79-9785-4218-a483-8a0104312680 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:56.953727 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d268c0f4-9f5e-4627-af67-81cb3e5ab782 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:56.954207 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d268c0f4-9f5e-4627-af67-81cb3e5ab782 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:56.954642 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d268c0f4-9f5e-4627-af67-81cb3e5ab782 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:56.955344 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d268c0f4-9f5e-4627-af67-81cb3e5ab782 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:56.955891 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d268c0f4-9f5e-4627-af67-81cb3e5ab782 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:56.956846 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fee4ff79-9785-4218-a483-8a0104312680 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:56.957568 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fee4ff79-9785-4218-a483-8a0104312680 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:56.958008 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fee4ff79-9785-4218-a483-8a0104312680 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:56.958988 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d268c0f4-9f5e-4627-af67-81cb3e5ab782 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:56.962086 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fee4ff79-9785-4218-a483-8a0104312680 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:57.248729 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d268c0f4-9f5e-4627-af67-81cb3e5ab782 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:57.262553 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d268c0f4-9f5e-4627-af67-81cb3e5ab782 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1504 microversion: 2.1 time: 0.341455 Oct 04 18:47:57.263945 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2226/4513] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:56 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1504 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:57.288565 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-79d68282-a5a5-46a9-a1c6-1b831bb4a349 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:57.289026 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-79d68282-a5a5-46a9-a1c6-1b831bb4a349 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:57.295481 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-79d68282-a5a5-46a9-a1c6-1b831bb4a349 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:57.295968 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-79d68282-a5a5-46a9-a1c6-1b831bb4a349 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:57.296428 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-79d68282-a5a5-46a9-a1c6-1b831bb4a349 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:57.297131 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-79d68282-a5a5-46a9-a1c6-1b831bb4a349 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:57.297813 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-79d68282-a5a5-46a9-a1c6-1b831bb4a349 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:57.298403 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-79d68282-a5a5-46a9-a1c6-1b831bb4a349 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:57.312170 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-fee4ff79-9785-4218-a483-8a0104312680 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:57.328257 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-fee4ff79-9785-4218-a483-8a0104312680 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/60694294-78ff-49f7-9d07-bb5915eae69e" status: 200 len: 1514 microversion: 2.1 time: 0.393109 Oct 04 18:47:57.340417 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2288/4514] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:56 2022] GET /compute/v2.1/servers/60694294-78ff-49f7-9d07-bb5915eae69e => generated 1514 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:47:57.387733 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:47:57.446831 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a13c078b-e5d8-4640-90fa-8860a221eba6 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:57.452106 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a13c078b-e5d8-4640-90fa-8860a221eba6 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] [instance: 317c7bd8-4f1e-4210-bb33-087557a1f4d6] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:57.455909 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a13c078b-e5d8-4640-90fa-8860a221eba6 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:57.457074 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a13c078b-e5d8-4640-90fa-8860a221eba6 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:57.457789 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a13c078b-e5d8-4640-90fa-8860a221eba6 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:57.459990 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a13c078b-e5d8-4640-90fa-8860a221eba6 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:57.460699 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a13c078b-e5d8-4640-90fa-8860a221eba6 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:57.461590 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a13c078b-e5d8-4640-90fa-8860a221eba6 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:57.639842 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-79d68282-a5a5-46a9-a1c6-1b831bb4a349 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "POST /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545/action" status: 202 len: 0 microversion: 2.1 time: 0.356570 Oct 04 18:47:57.640989 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2227/4515] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:47:57 2022] POST /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545/action => generated 0 bytes in 359 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:47:57.650801 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-1c23c2a9-6052-48e7-9ced-f442dacad9cd req-7e447539-ae56-4d38-9812-d2caea19ea12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "317c7bd8-4f1e-4210-bb33-087557a1f4d6", "tag": "722c07ac-b873-4605-a9eb-4abf62e975df"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:57.667844 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-1c23c2a9-6052-48e7-9ced-f442dacad9cd req-7e447539-ae56-4d38-9812-d2caea19ea12 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:57.668928 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-1c23c2a9-6052-48e7-9ced-f442dacad9cd req-7e447539-ae56-4d38-9812-d2caea19ea12 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:57.670099 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-1c23c2a9-6052-48e7-9ced-f442dacad9cd req-7e447539-ae56-4d38-9812-d2caea19ea12 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:57.685072 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-1c23c2a9-6052-48e7-9ced-f442dacad9cd req-7e447539-ae56-4d38-9812-d2caea19ea12 service nova] Creating event network-changed:722c07ac-b873-4605-a9eb-4abf62e975df for instance 317c7bd8-4f1e-4210-bb33-087557a1f4d6 on n-h1-850501-14 Oct 04 18:47:57.705600 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-1c23c2a9-6052-48e7-9ced-f442dacad9cd req-7e447539-ae56-4d38-9812-d2caea19ea12 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062987 Oct 04 18:47:57.707644 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2228/4516] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:47:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:47:57.716136 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1dcf20ce-32b7-4ae0-9c1a-9f553d3368cd tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:57.717271 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1dcf20ce-32b7-4ae0-9c1a-9f553d3368cd tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:57.725404 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1dcf20ce-32b7-4ae0-9c1a-9f553d3368cd tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:57.727956 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1dcf20ce-32b7-4ae0-9c1a-9f553d3368cd tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:57.727956 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1dcf20ce-32b7-4ae0-9c1a-9f553d3368cd tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:57.727956 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1dcf20ce-32b7-4ae0-9c1a-9f553d3368cd tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:57.728516 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1dcf20ce-32b7-4ae0-9c1a-9f553d3368cd tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:57.729312 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1dcf20ce-32b7-4ae0-9c1a-9f553d3368cd tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:57.741068 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a13c078b-e5d8-4640-90fa-8860a221eba6 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:57.771738 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a13c078b-e5d8-4640-90fa-8860a221eba6 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:57.780676 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a13c078b-e5d8-4640-90fa-8860a221eba6 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:57.784202 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a13c078b-e5d8-4640-90fa-8860a221eba6 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] 10.222.0.20 "GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6" status: 200 len: 1892 microversion: 2.32 time: 0.343088 Oct 04 18:47:57.808698 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2289/4517] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:47:57 2022] GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6 => generated 1892 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:47:58.363268 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-75063693-301d-4b5c-be18-d78db3620cea tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:58.364182 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-75063693-301d-4b5c-be18-d78db3620cea tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: 60694294-78ff-49f7-9d07-bb5915eae69e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:58.383394 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-75063693-301d-4b5c-be18-d78db3620cea tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:58.383897 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-75063693-301d-4b5c-be18-d78db3620cea tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:58.385108 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-75063693-301d-4b5c-be18-d78db3620cea tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:58.385487 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-75063693-301d-4b5c-be18-d78db3620cea tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:58.386087 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-75063693-301d-4b5c-be18-d78db3620cea tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:58.386531 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-75063693-301d-4b5c-be18-d78db3620cea tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:58.568018 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1dcf20ce-32b7-4ae0-9c1a-9f553d3368cd tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:58.577909 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1dcf20ce-32b7-4ae0-9c1a-9f553d3368cd tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1509 microversion: 2.1 time: 0.868504 Oct 04 18:47:58.578809 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2229/4518] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:57 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1509 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:58.669343 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-75063693-301d-4b5c-be18-d78db3620cea tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:58.701965 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-75063693-301d-4b5c-be18-d78db3620cea tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/60694294-78ff-49f7-9d07-bb5915eae69e" status: 200 len: 1520 microversion: 2.1 time: 0.347790 Oct 04 18:47:58.703432 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2290/4519] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:58 2022] GET /compute/v2.1/servers/60694294-78ff-49f7-9d07-bb5915eae69e => generated 1520 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:58.823676 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7c18016c-ece7-47e2-9e00-d72b7d565ab4 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:58.825710 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7c18016c-ece7-47e2-9e00-d72b7d565ab4 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] [instance: 317c7bd8-4f1e-4210-bb33-087557a1f4d6] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:58.834763 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c18016c-ece7-47e2-9e00-d72b7d565ab4 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:58.835763 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c18016c-ece7-47e2-9e00-d72b7d565ab4 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:58.836609 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c18016c-ece7-47e2-9e00-d72b7d565ab4 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:58.841111 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c18016c-ece7-47e2-9e00-d72b7d565ab4 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:58.841111 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c18016c-ece7-47e2-9e00-d72b7d565ab4 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:58.841111 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c18016c-ece7-47e2-9e00-d72b7d565ab4 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:59.251630 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7c18016c-ece7-47e2-9e00-d72b7d565ab4 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:59.267988 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7c18016c-ece7-47e2-9e00-d72b7d565ab4 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:59.269494 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7c18016c-ece7-47e2-9e00-d72b7d565ab4 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:59.271615 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7c18016c-ece7-47e2-9e00-d72b7d565ab4 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] 10.222.0.20 "GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6" status: 200 len: 1880 microversion: 2.32 time: 0.453418 Oct 04 18:47:59.274125 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2230/4520] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:47:58 2022] GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6 => generated 1880 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:47:59.610075 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-cae03f07-3cf0-43c7-bead-b9b386e3e411 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:59.611364 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-cae03f07-3cf0-43c7-bead-b9b386e3e411 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:59.619731 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cae03f07-3cf0-43c7-bead-b9b386e3e411 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:59.620535 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cae03f07-3cf0-43c7-bead-b9b386e3e411 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:59.621054 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cae03f07-3cf0-43c7-bead-b9b386e3e411 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:59.621881 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cae03f07-3cf0-43c7-bead-b9b386e3e411 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:59.622428 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cae03f07-3cf0-43c7-bead-b9b386e3e411 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:59.623073 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cae03f07-3cf0-43c7-bead-b9b386e3e411 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:59.732287 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-fa6a4a20-b5c0-4e07-8e2b-1de084230c64 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:59.733200 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-fa6a4a20-b5c0-4e07-8e2b-1de084230c64 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: 60694294-78ff-49f7-9d07-bb5915eae69e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:59.743523 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fa6a4a20-b5c0-4e07-8e2b-1de084230c64 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:59.744520 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fa6a4a20-b5c0-4e07-8e2b-1de084230c64 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:59.745328 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fa6a4a20-b5c0-4e07-8e2b-1de084230c64 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:59.746935 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fa6a4a20-b5c0-4e07-8e2b-1de084230c64 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:59.747760 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fa6a4a20-b5c0-4e07-8e2b-1de084230c64 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:59.748940 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fa6a4a20-b5c0-4e07-8e2b-1de084230c64 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:00.019460 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-cae03f07-3cf0-43c7-bead-b9b386e3e411 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:00.044857 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-cae03f07-3cf0-43c7-bead-b9b386e3e411 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1489 microversion: 2.1 time: 0.434368 Oct 04 18:48:00.056176 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2291/4521] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:59 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1489 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:00.056412 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-fa6a4a20-b5c0-4e07-8e2b-1de084230c64 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:00.068107 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-fa6a4a20-b5c0-4e07-8e2b-1de084230c64 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/60694294-78ff-49f7-9d07-bb5915eae69e" status: 200 len: 1520 microversion: 2.1 time: 0.336006 Oct 04 18:48:00.068107 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2231/4522] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:59 2022] GET /compute/v2.1/servers/60694294-78ff-49f7-9d07-bb5915eae69e => generated 1520 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:00.068298 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-3777d1b4-7248-44a2-8073-37352681c7de req-72c58501-9c2f-416c-8d21-e5b98b9dcdc1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "317c7bd8-4f1e-4210-bb33-087557a1f4d6", "tag": "53730d23-3a07-4884-9751-67c1b4d3e3f1"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:48:00.076686 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-753424d5-03ae-4b8e-9776-405f501e4c54 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:48:00.077238 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-753424d5-03ae-4b8e-9776-405f501e4c54 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:00.084284 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-753424d5-03ae-4b8e-9776-405f501e4c54 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:00.084968 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-753424d5-03ae-4b8e-9776-405f501e4c54 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:00.085555 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-753424d5-03ae-4b8e-9776-405f501e4c54 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:00.086408 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-753424d5-03ae-4b8e-9776-405f501e4c54 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:00.088372 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-753424d5-03ae-4b8e-9776-405f501e4c54 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:00.088372 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-753424d5-03ae-4b8e-9776-405f501e4c54 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:00.088582 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-3777d1b4-7248-44a2-8073-37352681c7de req-72c58501-9c2f-416c-8d21-e5b98b9dcdc1 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:00.088824 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-3777d1b4-7248-44a2-8073-37352681c7de req-72c58501-9c2f-416c-8d21-e5b98b9dcdc1 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:00.089330 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-3777d1b4-7248-44a2-8073-37352681c7de req-72c58501-9c2f-416c-8d21-e5b98b9dcdc1 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:00.102264 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-3777d1b4-7248-44a2-8073-37352681c7de req-72c58501-9c2f-416c-8d21-e5b98b9dcdc1 service nova] Creating event network-changed:53730d23-3a07-4884-9751-67c1b4d3e3f1 for instance 317c7bd8-4f1e-4210-bb33-087557a1f4d6 on n-h1-850501-14 Oct 04 18:48:00.114244 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-753424d5-03ae-4b8e-9776-405f501e4c54 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] HTTP exception thrown: Cannot 'pause' instance 95fb1a13-7441-4f74-ad81-5a9413496545 while it is in vm_state paused Oct 04 18:48:00.116560 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-753424d5-03ae-4b8e-9776-405f501e4c54 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Request method failure captured: Oct 04 18:48:00.116560 n-d-850501-14 devstack@n-api.service[123002]: request: POST /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545/action HTTP/1.1 Oct 04 18:48:00.116560 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:48:00.116560 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:48:00.116560 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:48:00.116560 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 13 Oct 04 18:48:00.116560 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:48:00.116560 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:48:00.116560 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:48:00.116560 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:48:00.116560 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH9zAVdj2h4kh6QqBpYrS2CJMhbcXf529VUNrZoZOYhS2tkLYBgw6AHy860DK9jQ3xATqZvC9lQuxt-_H5qKsAI41eznf32K6QSGqVcHXegpVHrDueww23ZMVCBM3D_hH0NTzh4447rgHqcrC-OZE48IfZrRJ9KPLPjAHT57T3mcPIc Oct 04 18:48:00.116560 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:48:00.116560 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:48:00.116560 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:48:00.116560 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:48:00.116560 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:48:00.116560 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:48:00.116560 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: b6c6b9deecde44b5953d22b38b5b0ff1 Oct 04 18:48:00.116560 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:48:00.116560 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:48:00.116560 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:48:00.116560 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6c6b9deecde44b5953d22b38b5b0ff1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b6c6b9deecde44b5953d22b38b5b0ff1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b6c6b9deecde44b5953d22b38b5b0ff1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6c6b9deecde44b5953d22b38b5b0ff1"}]}] Oct 04 18:48:00.116560 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:48:00.116560 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: b6c6b9deecde44b5953d22b38b5b0ff1 Oct 04 18:48:00.116560 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:48:00.116560 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServersNegativeTestJSON-626077540-project Oct 04 18:48:00.116560 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:48:00.116560 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:48:00.116560 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 5b4eb70f22ba4872b890a4f160cc1805 Oct 04 18:48:00.116560 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServersNegativeTestJSON-626077540-project Oct 04 18:48:00.116560 n-d-850501-14 devstack@n-api.service[123002]: Oct 04 18:48:00.116560 n-d-850501-14 devstack@n-api.service[123002]: {"pause": {}} Oct 04 18:48:00.116560 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:48:00.116560 n-d-850501-14 devstack@n-api.service[123002]: exception: Cannot 'pause' instance 95fb1a13-7441-4f74-ad81-5a9413496545 while it is in vm_state paused Oct 04 18:48:00.116560 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '95fb1a13-7441-4f74-ad81-5a9413496545', 'body': {'pause': {}}} Oct 04 18:48:00.116560 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:48:00.116560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:00.116560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Oct 04 18:48:00.116560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Oct 04 18:48:00.116560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:48:00.116560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:48:00.116560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 18:48:00.116560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 18:48:00.116560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 95fb1a13-7441-4f74-ad81-5a9413496545 in vm_state paused. Cannot pause while the instance is in this state. Oct 04 18:48:00.116560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:48:00.116560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:48:00.116560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:48:00.116560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:00.116560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:48:00.116560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:48:00.116560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:48:00.116560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:48:00.116560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:48:00.116560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:48:00.116560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Oct 04 18:48:00.116560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 18:48:00.116560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 18:48:00.116560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 18:48:00.116560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 95fb1a13-7441-4f74-ad81-5a9413496545 while it is in vm_state paused Oct 04 18:48:00.116560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:48:00.116560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:48:00.116560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:48:00.116560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:00.116560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:48:00.121246 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:48:00.121246 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:48:00.121246 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:48:00.121246 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 95fb1a13-7441-4f74-ad81-5a9413496545 while it is in vm_state paused Oct 04 18:48:00.121246 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:48:00.122856 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-753424d5-03ae-4b8e-9776-405f501e4c54 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Returning 409 to user: Cannot 'pause' instance 95fb1a13-7441-4f74-ad81-5a9413496545 while it is in vm_state paused {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:48:00.123869 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-753424d5-03ae-4b8e-9776-405f501e4c54 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "POST /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545/action" status: 409 len: 143 microversion: 2.1 time: 0.051497 Oct 04 18:48:00.124964 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2232/4523] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:48:00 2022] POST /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545/action => generated 143 bytes in 53 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:48:00.126568 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-3777d1b4-7248-44a2-8073-37352681c7de req-72c58501-9c2f-416c-8d21-e5b98b9dcdc1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076503 Oct 04 18:48:00.127307 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2292/4524] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:48:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:48:00.135071 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-46bd0304-4c7d-45e6-8d65-3509083c8427 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:48:00.135071 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-46bd0304-4c7d-45e6-8d65-3509083c8427 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:00.143410 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-46bd0304-4c7d-45e6-8d65-3509083c8427 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:00.143901 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-46bd0304-4c7d-45e6-8d65-3509083c8427 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:00.144650 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-46bd0304-4c7d-45e6-8d65-3509083c8427 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:00.146039 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-46bd0304-4c7d-45e6-8d65-3509083c8427 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:00.147745 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-46bd0304-4c7d-45e6-8d65-3509083c8427 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:00.149048 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-46bd0304-4c7d-45e6-8d65-3509083c8427 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:00.307064 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-aa5f9886-7520-45d4-8c66-9fc746ae2693 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:00.308038 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-aa5f9886-7520-45d4-8c66-9fc746ae2693 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] [instance: 317c7bd8-4f1e-4210-bb33-087557a1f4d6] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:00.316628 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aa5f9886-7520-45d4-8c66-9fc746ae2693 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:00.317839 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aa5f9886-7520-45d4-8c66-9fc746ae2693 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:00.319102 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aa5f9886-7520-45d4-8c66-9fc746ae2693 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:00.320324 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aa5f9886-7520-45d4-8c66-9fc746ae2693 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:00.321728 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aa5f9886-7520-45d4-8c66-9fc746ae2693 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:00.322153 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aa5f9886-7520-45d4-8c66-9fc746ae2693 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:00.545655 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-46bd0304-4c7d-45e6-8d65-3509083c8427 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "POST /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545/action" status: 202 len: 0 microversion: 2.1 time: 0.414554 Oct 04 18:48:00.545655 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2233/4525] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:48:00 2022] POST /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545/action => generated 0 bytes in 416 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:48:00.554573 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f6040e98-e1ec-4b14-8b0c-767b2d49a852 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:00.556124 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f6040e98-e1ec-4b14-8b0c-767b2d49a852 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:00.567013 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f6040e98-e1ec-4b14-8b0c-767b2d49a852 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:00.568789 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f6040e98-e1ec-4b14-8b0c-767b2d49a852 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:00.572657 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f6040e98-e1ec-4b14-8b0c-767b2d49a852 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:00.576442 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f6040e98-e1ec-4b14-8b0c-767b2d49a852 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:00.577271 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f6040e98-e1ec-4b14-8b0c-767b2d49a852 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:00.578034 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f6040e98-e1ec-4b14-8b0c-767b2d49a852 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:00.703770 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-aa5f9886-7520-45d4-8c66-9fc746ae2693 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:00.740881 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-aa5f9886-7520-45d4-8c66-9fc746ae2693 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:00.742790 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-aa5f9886-7520-45d4-8c66-9fc746ae2693 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:00.766575 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-aa5f9886-7520-45d4-8c66-9fc746ae2693 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] 10.222.0.20 "GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6" status: 200 len: 1880 microversion: 2.32 time: 0.458943 Oct 04 18:48:00.768298 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2293/4526] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:48:00 2022] GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6 => generated 1880 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:48:00.861355 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f6040e98-e1ec-4b14-8b0c-767b2d49a852 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:00.877525 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f6040e98-e1ec-4b14-8b0c-767b2d49a852 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1496 microversion: 2.1 time: 0.328070 Oct 04 18:48:00.892475 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2234/4527] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:00 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1496 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:01.098241 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a665cacc-3056-4343-acb9-40cbde7fc275 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:01.099150 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a665cacc-3056-4343-acb9-40cbde7fc275 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: 60694294-78ff-49f7-9d07-bb5915eae69e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:01.133974 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a665cacc-3056-4343-acb9-40cbde7fc275 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:01.133974 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a665cacc-3056-4343-acb9-40cbde7fc275 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:01.133974 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a665cacc-3056-4343-acb9-40cbde7fc275 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:01.133974 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a665cacc-3056-4343-acb9-40cbde7fc275 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:01.133974 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a665cacc-3056-4343-acb9-40cbde7fc275 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:01.133974 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a665cacc-3056-4343-acb9-40cbde7fc275 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:01.211379 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-3bd936bb-a0a7-4f29-b216-b4687441463e req-e36f25a6-5ce2-4e1b-9466-f40778023bd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e208f85-0513-43f4-8a2c-38baa2886238", "name": "network-vif-plugged", "status": "completed", "tag": "caad0bda-801d-4a85-94c7-4bb13cb984c3"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:48:01.257074 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-3bd936bb-a0a7-4f29-b216-b4687441463e req-e36f25a6-5ce2-4e1b-9466-f40778023bd7 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:01.257578 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-3bd936bb-a0a7-4f29-b216-b4687441463e req-e36f25a6-5ce2-4e1b-9466-f40778023bd7 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:01.261037 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-3bd936bb-a0a7-4f29-b216-b4687441463e req-e36f25a6-5ce2-4e1b-9466-f40778023bd7 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:01.286630 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-3bd936bb-a0a7-4f29-b216-b4687441463e req-e36f25a6-5ce2-4e1b-9466-f40778023bd7 service nova] Creating event network-vif-plugged:caad0bda-801d-4a85-94c7-4bb13cb984c3 for instance 2e208f85-0513-43f4-8a2c-38baa2886238 on n-h2-850501-14 Oct 04 18:48:01.292395 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-3bd936bb-a0a7-4f29-b216-b4687441463e req-e36f25a6-5ce2-4e1b-9466-f40778023bd7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085016 Oct 04 18:48:01.293687 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2235/4528] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:48:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:48:01.621183 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a665cacc-3056-4343-acb9-40cbde7fc275 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:01.631859 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a665cacc-3056-4343-acb9-40cbde7fc275 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/60694294-78ff-49f7-9d07-bb5915eae69e" status: 200 len: 1520 microversion: 2.1 time: 0.549558 Oct 04 18:48:01.645498 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2294/4529] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:01 2022] GET /compute/v2.1/servers/60694294-78ff-49f7-9d07-bb5915eae69e => generated 1520 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:01.799079 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2348e7be-3c22-4bac-badb-d13a3b3a725b tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:01.799815 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2348e7be-3c22-4bac-badb-d13a3b3a725b tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] [instance: 317c7bd8-4f1e-4210-bb33-087557a1f4d6] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:01.812638 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2348e7be-3c22-4bac-badb-d13a3b3a725b tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:01.812638 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2348e7be-3c22-4bac-badb-d13a3b3a725b tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:01.812638 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2348e7be-3c22-4bac-badb-d13a3b3a725b tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:01.812638 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2348e7be-3c22-4bac-badb-d13a3b3a725b tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:01.813112 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2348e7be-3c22-4bac-badb-d13a3b3a725b tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:01.814248 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2348e7be-3c22-4bac-badb-d13a3b3a725b tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:01.907582 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6b27ba93-188a-4b29-a468-8d926d079fab tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:01.908580 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6b27ba93-188a-4b29-a468-8d926d079fab tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:01.918054 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6b27ba93-188a-4b29-a468-8d926d079fab tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:01.918577 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6b27ba93-188a-4b29-a468-8d926d079fab tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:01.919423 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6b27ba93-188a-4b29-a468-8d926d079fab tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:01.922432 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6b27ba93-188a-4b29-a468-8d926d079fab tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:01.922908 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6b27ba93-188a-4b29-a468-8d926d079fab tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:01.923349 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6b27ba93-188a-4b29-a468-8d926d079fab tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:02.273027 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2348e7be-3c22-4bac-badb-d13a3b3a725b tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:02.287481 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2348e7be-3c22-4bac-badb-d13a3b3a725b tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:02.288989 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2348e7be-3c22-4bac-badb-d13a3b3a725b tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:02.290182 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2348e7be-3c22-4bac-badb-d13a3b3a725b tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] 10.222.0.20 "GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6" status: 200 len: 1880 microversion: 2.32 time: 0.496923 Oct 04 18:48:02.297389 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2236/4530] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:48:01 2022] GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6 => generated 1880 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:48:02.331468 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6b27ba93-188a-4b29-a468-8d926d079fab tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:02.358041 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6b27ba93-188a-4b29-a468-8d926d079fab tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1504 microversion: 2.1 time: 0.439675 Oct 04 18:48:02.358041 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2295/4531] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:01 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1504 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:02.380475 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d9be4e86-9f78-4581-aacb-378b6a5b755f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:02.381127 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d9be4e86-9f78-4581-aacb-378b6a5b755f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:02.391100 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d9be4e86-9f78-4581-aacb-378b6a5b755f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:02.393927 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d9be4e86-9f78-4581-aacb-378b6a5b755f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:02.393927 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d9be4e86-9f78-4581-aacb-378b6a5b755f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:02.393927 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d9be4e86-9f78-4581-aacb-378b6a5b755f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:02.393927 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d9be4e86-9f78-4581-aacb-378b6a5b755f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:02.396417 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d9be4e86-9f78-4581-aacb-378b6a5b755f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:02.667790 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-574d1ec8-628e-4876-8457-b1044078afea tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:02.668085 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d9be4e86-9f78-4581-aacb-378b6a5b755f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:02.669275 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-574d1ec8-628e-4876-8457-b1044078afea tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: 60694294-78ff-49f7-9d07-bb5915eae69e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:02.678984 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-574d1ec8-628e-4876-8457-b1044078afea tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:02.680070 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-574d1ec8-628e-4876-8457-b1044078afea tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:02.680771 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-574d1ec8-628e-4876-8457-b1044078afea tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:02.681854 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-574d1ec8-628e-4876-8457-b1044078afea tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:02.682518 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-574d1ec8-628e-4876-8457-b1044078afea tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:02.683121 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-574d1ec8-628e-4876-8457-b1044078afea tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:02.700230 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d9be4e86-9f78-4581-aacb-378b6a5b755f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1504 microversion: 2.1 time: 0.310092 Oct 04 18:48:02.700230 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2237/4532] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:02 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1504 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:02.716073 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-10f93bc6-6668-4181-a8b8-7d151d57fdde tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:48:02.718473 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-10f93bc6-6668-4181-a8b8-7d151d57fdde tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: e6b3ee80-2e17-4135-9f45-bef437385e0c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:02.725462 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-10f93bc6-6668-4181-a8b8-7d151d57fdde tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:02.726946 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-10f93bc6-6668-4181-a8b8-7d151d57fdde tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:02.727585 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-10f93bc6-6668-4181-a8b8-7d151d57fdde tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:02.729369 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-10f93bc6-6668-4181-a8b8-7d151d57fdde tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:02.730031 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-10f93bc6-6668-4181-a8b8-7d151d57fdde tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:02.730931 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-10f93bc6-6668-4181-a8b8-7d151d57fdde tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:02.752452 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-10f93bc6-6668-4181-a8b8-7d151d57fdde tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] HTTP exception thrown: Instance e6b3ee80-2e17-4135-9f45-bef437385e0c could not be found. Oct 04 18:48:02.755446 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-10f93bc6-6668-4181-a8b8-7d151d57fdde tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Request method failure captured: Oct 04 18:48:02.755446 n-d-850501-14 devstack@n-api.service[123002]: request: POST /compute/v2.1/servers/e6b3ee80-2e17-4135-9f45-bef437385e0c/action HTTP/1.1 Oct 04 18:48:02.755446 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:48:02.755446 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:48:02.755446 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:48:02.755446 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 28 Oct 04 18:48:02.755446 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:48:02.755446 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:48:02.755446 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:48:02.755446 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:48:02.755446 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH9zAVdj2h4kh6QqBpYrS2CJMhbcXf529VUNrZoZOYhS2tkLYBgw6AHy860DK9jQ3xATqZvC9lQuxt-_H5qKsAI41eznf32K6QSGqVcHXegpVHrDueww23ZMVCBM3D_hH0NTzh4447rgHqcrC-OZE48IfZrRJ9KPLPjAHT57T3mcPIc Oct 04 18:48:02.755446 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:48:02.755446 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:48:02.755446 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:48:02.755446 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:48:02.755446 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:48:02.755446 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:48:02.755446 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: b6c6b9deecde44b5953d22b38b5b0ff1 Oct 04 18:48:02.755446 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:48:02.755446 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:48:02.755446 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:48:02.755446 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6c6b9deecde44b5953d22b38b5b0ff1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b6c6b9deecde44b5953d22b38b5b0ff1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b6c6b9deecde44b5953d22b38b5b0ff1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6c6b9deecde44b5953d22b38b5b0ff1"}]}] Oct 04 18:48:02.755446 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:48:02.755446 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: b6c6b9deecde44b5953d22b38b5b0ff1 Oct 04 18:48:02.755446 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:48:02.755446 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServersNegativeTestJSON-626077540-project Oct 04 18:48:02.755446 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:48:02.755446 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:48:02.755446 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 5b4eb70f22ba4872b890a4f160cc1805 Oct 04 18:48:02.755446 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServersNegativeTestJSON-626077540-project Oct 04 18:48:02.755446 n-d-850501-14 devstack@n-api.service[123002]: Oct 04 18:48:02.755446 n-d-850501-14 devstack@n-api.service[123002]: {"reboot": {"type": "SOFT"}} Oct 04 18:48:02.755446 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:48:02.755446 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance e6b3ee80-2e17-4135-9f45-bef437385e0c could not be found. Oct 04 18:48:02.755446 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'e6b3ee80-2e17-4135-9f45-bef437385e0c', 'body': {'reboot': {'type': 'SOFT'}}} Oct 04 18:48:02.755446 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:48:02.755446 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:02.755446 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:48:02.755446 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:48:02.755446 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:48:02.755446 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:48:02.755446 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:48:02.755446 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:48:02.755446 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:48:02.755446 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:48:02.755446 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6b3ee80-2e17-4135-9f45-bef437385e0c could not be found. Oct 04 18:48:02.755446 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:48:02.755446 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:48:02.755446 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:48:02.755446 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:02.755446 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:48:02.755446 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:48:02.755446 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:48:02.755446 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:48:02.755446 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:48:02.755446 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:48:02.755446 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:48:02.755446 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:48:02.755446 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 04 18:48:02.755446 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 04 18:48:02.755446 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:48:02.755446 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:48:02.755446 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:48:02.755446 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:48:02.766099 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6b3ee80-2e17-4135-9f45-bef437385e0c could not be found. Oct 04 18:48:02.766099 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:48:02.766099 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:48:02.766099 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:48:02.766099 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:02.766099 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:48:02.766099 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:48:02.766099 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:48:02.766099 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:48:02.766099 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6b3ee80-2e17-4135-9f45-bef437385e0c could not be found. Oct 04 18:48:02.766099 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:48:02.766099 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-10f93bc6-6668-4181-a8b8-7d151d57fdde tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Returning 404 to user: Instance e6b3ee80-2e17-4135-9f45-bef437385e0c could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:48:02.766099 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-10f93bc6-6668-4181-a8b8-7d151d57fdde tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "POST /compute/v2.1/servers/e6b3ee80-2e17-4135-9f45-bef437385e0c/action" status: 404 len: 111 microversion: 2.1 time: 0.045979 Oct 04 18:48:02.766099 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2238/4533] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:48:02 2022] POST /compute/v2.1/servers/e6b3ee80-2e17-4135-9f45-bef437385e0c/action => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:48:02.773848 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-13491bd8-4c29-4390-a040-d2b63b03b94f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:02.774683 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-13491bd8-4c29-4390-a040-d2b63b03b94f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:02.784684 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-13491bd8-4c29-4390-a040-d2b63b03b94f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:02.785457 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-13491bd8-4c29-4390-a040-d2b63b03b94f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:02.786516 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-13491bd8-4c29-4390-a040-d2b63b03b94f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:02.788170 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-13491bd8-4c29-4390-a040-d2b63b03b94f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:02.788842 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-13491bd8-4c29-4390-a040-d2b63b03b94f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:02.789627 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-13491bd8-4c29-4390-a040-d2b63b03b94f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:02.982903 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-574d1ec8-628e-4876-8457-b1044078afea tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:02.995119 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-574d1ec8-628e-4876-8457-b1044078afea tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/60694294-78ff-49f7-9d07-bb5915eae69e" status: 200 len: 1520 microversion: 2.1 time: 0.331255 Oct 04 18:48:03.028206 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2296/4534] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:02 2022] GET /compute/v2.1/servers/60694294-78ff-49f7-9d07-bb5915eae69e => generated 1520 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:03.060041 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-13491bd8-4c29-4390-a040-d2b63b03b94f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:03.070733 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-13491bd8-4c29-4390-a040-d2b63b03b94f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1504 microversion: 2.1 time: 0.301728 Oct 04 18:48:03.071735 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2239/4535] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:02 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1504 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:03.096813 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2eadbc4b-ad04-46f2-9edc-476d49098c26 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:03.097576 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2eadbc4b-ad04-46f2-9edc-476d49098c26 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:03.104654 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2eadbc4b-ad04-46f2-9edc-476d49098c26 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:03.105471 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2eadbc4b-ad04-46f2-9edc-476d49098c26 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:03.106118 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2eadbc4b-ad04-46f2-9edc-476d49098c26 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:03.107561 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2eadbc4b-ad04-46f2-9edc-476d49098c26 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:03.108446 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2eadbc4b-ad04-46f2-9edc-476d49098c26 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:03.108976 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2eadbc4b-ad04-46f2-9edc-476d49098c26 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:03.323415 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2fcddda6-a483-4719-9903-0a6a05dfa6f3 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:03.323932 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2fcddda6-a483-4719-9903-0a6a05dfa6f3 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] [instance: 317c7bd8-4f1e-4210-bb33-087557a1f4d6] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:03.331541 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2fcddda6-a483-4719-9903-0a6a05dfa6f3 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:03.332468 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2fcddda6-a483-4719-9903-0a6a05dfa6f3 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:03.333664 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2fcddda6-a483-4719-9903-0a6a05dfa6f3 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:03.334582 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2fcddda6-a483-4719-9903-0a6a05dfa6f3 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:03.335208 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2fcddda6-a483-4719-9903-0a6a05dfa6f3 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:03.335845 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2fcddda6-a483-4719-9903-0a6a05dfa6f3 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:03.863389 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-2eadbc4b-ad04-46f2-9edc-476d49098c26 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:03.876375 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2eadbc4b-ad04-46f2-9edc-476d49098c26 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1504 microversion: 2.1 time: 0.783571 Oct 04 18:48:03.877972 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2297/4536] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:03 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1504 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:03.914406 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2fcddda6-a483-4719-9903-0a6a05dfa6f3 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:03.914668 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-c73a94d8-0661-416b-b820-54175b5d3741 req-a4224e31-9d78-40d4-a180-34699b8957c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60694294-78ff-49f7-9d07-bb5915eae69e", "name": "network-vif-plugged", "status": "completed", "tag": "6ded5837-6eb6-4f11-b5bf-4145870ee7b8"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:48:03.919544 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-c73a94d8-0661-416b-b820-54175b5d3741 req-a4224e31-9d78-40d4-a180-34699b8957c8 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:03.920038 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-c73a94d8-0661-416b-b820-54175b5d3741 req-a4224e31-9d78-40d4-a180-34699b8957c8 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:03.920784 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-c73a94d8-0661-416b-b820-54175b5d3741 req-a4224e31-9d78-40d4-a180-34699b8957c8 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:03.932636 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2fcddda6-a483-4719-9903-0a6a05dfa6f3 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:03.934197 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2fcddda6-a483-4719-9903-0a6a05dfa6f3 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:03.935692 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2fcddda6-a483-4719-9903-0a6a05dfa6f3 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] 10.222.0.20 "GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6" status: 200 len: 1880 microversion: 2.32 time: 0.616274 Oct 04 18:48:03.936902 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2240/4537] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:48:03 2022] GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6 => generated 1880 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:48:03.942797 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-682b123c-e4d0-46a5-99bc-6b9163d57665 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:48:03.945964 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-682b123c-e4d0-46a5-99bc-6b9163d57665 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: ce4b97db-7174-4ae5-9c12-8e79f7fe01b4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:03.958681 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-c73a94d8-0661-416b-b820-54175b5d3741 req-a4224e31-9d78-40d4-a180-34699b8957c8 service nova] Creating event network-vif-plugged:6ded5837-6eb6-4f11-b5bf-4145870ee7b8 for instance 60694294-78ff-49f7-9d07-bb5915eae69e on n-h1-850501-14 Oct 04 18:48:03.963270 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-682b123c-e4d0-46a5-99bc-6b9163d57665 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] HTTP exception thrown: Instance ce4b97db-7174-4ae5-9c12-8e79f7fe01b4 could not be found. Oct 04 18:48:03.965014 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-c73a94d8-0661-416b-b820-54175b5d3741 req-a4224e31-9d78-40d4-a180-34699b8957c8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085074 Oct 04 18:48:03.965805 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-682b123c-e4d0-46a5-99bc-6b9163d57665 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Request method failure captured: Oct 04 18:48:03.965805 n-d-850501-14 devstack@n-api.service[123002]: request: POST /compute/v2.1/servers/ce4b97db-7174-4ae5-9c12-8e79f7fe01b4/action HTTP/1.1 Oct 04 18:48:03.965805 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:48:03.965805 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:48:03.965805 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:48:03.965805 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 28 Oct 04 18:48:03.965805 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:48:03.965805 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:48:03.965805 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:48:03.965805 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:48:03.965805 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH9zAVdj2h4kh6QqBpYrS2CJMhbcXf529VUNrZoZOYhS2tkLYBgw6AHy860DK9jQ3xATqZvC9lQuxt-_H5qKsAI41eznf32K6QSGqVcHXegpVHrDueww23ZMVCBM3D_hH0NTzh4447rgHqcrC-OZE48IfZrRJ9KPLPjAHT57T3mcPIc Oct 04 18:48:03.965805 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:48:03.965805 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:48:03.965805 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:48:03.965805 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:48:03.965805 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:48:03.965805 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:48:03.965805 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: b6c6b9deecde44b5953d22b38b5b0ff1 Oct 04 18:48:03.965805 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:48:03.965805 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:48:03.965805 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:48:03.965805 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6c6b9deecde44b5953d22b38b5b0ff1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b6c6b9deecde44b5953d22b38b5b0ff1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b6c6b9deecde44b5953d22b38b5b0ff1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6c6b9deecde44b5953d22b38b5b0ff1"}]}] Oct 04 18:48:03.965805 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:48:03.965805 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: b6c6b9deecde44b5953d22b38b5b0ff1 Oct 04 18:48:03.965805 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:48:03.965805 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServersNegativeTestJSON-626077540-project Oct 04 18:48:03.965805 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:48:03.965805 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:48:03.965805 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 5b4eb70f22ba4872b890a4f160cc1805 Oct 04 18:48:03.965805 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServersNegativeTestJSON-626077540-project Oct 04 18:48:03.965805 n-d-850501-14 devstack@n-api.service[123002]: Oct 04 18:48:03.965805 n-d-850501-14 devstack@n-api.service[123002]: {"reboot": {"type": "SOFT"}} Oct 04 18:48:03.965805 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:48:03.965805 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance ce4b97db-7174-4ae5-9c12-8e79f7fe01b4 could not be found. Oct 04 18:48:03.965805 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'ce4b97db-7174-4ae5-9c12-8e79f7fe01b4', 'body': {'reboot': {'type': 'SOFT'}}} Oct 04 18:48:03.965805 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:48:03.965805 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:03.965805 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:48:03.965805 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:48:03.965805 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:48:03.965805 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:48:03.965805 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:48:03.965805 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:48:03.965805 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce4b97db-7174-4ae5-9c12-8e79f7fe01b4 could not be found. Oct 04 18:48:03.965805 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:48:03.965805 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:48:03.965805 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:48:03.965805 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:03.965805 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:48:03.965805 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:48:03.965805 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:48:03.965805 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:48:03.965805 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:48:03.965805 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:48:03.965805 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:48:03.965805 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:48:03.965805 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 04 18:48:03.965805 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 04 18:48:03.965805 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:48:03.965805 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:48:03.965805 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:48:03.965805 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:48:03.965805 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce4b97db-7174-4ae5-9c12-8e79f7fe01b4 could not be found. Oct 04 18:48:03.965805 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:48:03.969572 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:48:03.969572 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:48:03.969572 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:03.969572 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:48:03.969572 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:48:03.969572 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:48:03.969572 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:48:03.969572 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce4b97db-7174-4ae5-9c12-8e79f7fe01b4 could not be found. Oct 04 18:48:03.969572 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:48:03.970586 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2298/4538] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:48:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:48:03.971689 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-682b123c-e4d0-46a5-99bc-6b9163d57665 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Returning 404 to user: Instance ce4b97db-7174-4ae5-9c12-8e79f7fe01b4 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:48:03.972833 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-682b123c-e4d0-46a5-99bc-6b9163d57665 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "POST /compute/v2.1/servers/ce4b97db-7174-4ae5-9c12-8e79f7fe01b4/action" status: 404 len: 111 microversion: 2.1 time: 0.034646 Oct 04 18:48:03.974236 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2241/4539] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:48:03 2022] POST /compute/v2.1/servers/ce4b97db-7174-4ae5-9c12-8e79f7fe01b4/action => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:48:04.016421 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3abdd2fd-831b-4444-a3f3-15dcb95dd1c5 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:04.017511 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3abdd2fd-831b-4444-a3f3-15dcb95dd1c5 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:04.040829 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8cbe5da0-85d7-4250-b34d-b8a674171a9a tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:04.041819 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8cbe5da0-85d7-4250-b34d-b8a674171a9a tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: 60694294-78ff-49f7-9d07-bb5915eae69e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:04.045023 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3abdd2fd-831b-4444-a3f3-15dcb95dd1c5 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:04.045532 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3abdd2fd-831b-4444-a3f3-15dcb95dd1c5 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:04.045998 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3abdd2fd-831b-4444-a3f3-15dcb95dd1c5 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:04.049783 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8cbe5da0-85d7-4250-b34d-b8a674171a9a tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:04.050557 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8cbe5da0-85d7-4250-b34d-b8a674171a9a tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:04.051060 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3abdd2fd-831b-4444-a3f3-15dcb95dd1c5 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:04.051439 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8cbe5da0-85d7-4250-b34d-b8a674171a9a tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:04.052987 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8cbe5da0-85d7-4250-b34d-b8a674171a9a tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:04.053614 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3abdd2fd-831b-4444-a3f3-15dcb95dd1c5 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:04.053842 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8cbe5da0-85d7-4250-b34d-b8a674171a9a tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:04.054108 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3abdd2fd-831b-4444-a3f3-15dcb95dd1c5 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:04.054679 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8cbe5da0-85d7-4250-b34d-b8a674171a9a tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:04.517790 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3abdd2fd-831b-4444-a3f3-15dcb95dd1c5 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:04.537299 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8cbe5da0-85d7-4250-b34d-b8a674171a9a tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:04.551407 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3abdd2fd-831b-4444-a3f3-15dcb95dd1c5 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1504 microversion: 2.1 time: 0.551978 Oct 04 18:48:04.555560 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8cbe5da0-85d7-4250-b34d-b8a674171a9a tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/60694294-78ff-49f7-9d07-bb5915eae69e" status: 200 len: 1520 microversion: 2.1 time: 0.520039 Oct 04 18:48:04.556533 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2299/4540] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:03 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1504 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:04.572610 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2242/4541] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:04 2022] GET /compute/v2.1/servers/60694294-78ff-49f7-9d07-bb5915eae69e => generated 1520 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:04.600913 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b21652d1-a7c5-4608-81af-db0266927041 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:04.601926 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b21652d1-a7c5-4608-81af-db0266927041 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:04.609024 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b21652d1-a7c5-4608-81af-db0266927041 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:04.609814 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b21652d1-a7c5-4608-81af-db0266927041 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:04.610416 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b21652d1-a7c5-4608-81af-db0266927041 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:04.611329 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b21652d1-a7c5-4608-81af-db0266927041 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:04.611964 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b21652d1-a7c5-4608-81af-db0266927041 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:04.612563 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b21652d1-a7c5-4608-81af-db0266927041 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:04.873318 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b21652d1-a7c5-4608-81af-db0266927041 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:04.883505 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b21652d1-a7c5-4608-81af-db0266927041 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1504 microversion: 2.1 time: 0.286346 Oct 04 18:48:04.907653 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2300/4542] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:04 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1504 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:04.911996 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-232215ac-0884-4a3b-a83d-6966288fc06b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:48:04.915560 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-232215ac-0884-4a3b-a83d-6966288fc06b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: e6b3ee80-2e17-4135-9f45-bef437385e0c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:04.921871 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-232215ac-0884-4a3b-a83d-6966288fc06b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:04.922348 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-232215ac-0884-4a3b-a83d-6966288fc06b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:04.922821 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-232215ac-0884-4a3b-a83d-6966288fc06b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:04.923463 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-232215ac-0884-4a3b-a83d-6966288fc06b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:04.923909 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-232215ac-0884-4a3b-a83d-6966288fc06b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:04.942893 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-232215ac-0884-4a3b-a83d-6966288fc06b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:04.963057 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-87b5dccf-ccd2-4d52-8c8c-fba2bb737569 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:04.964010 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-87b5dccf-ccd2-4d52-8c8c-fba2bb737569 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] [instance: 317c7bd8-4f1e-4210-bb33-087557a1f4d6] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:04.977137 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-87b5dccf-ccd2-4d52-8c8c-fba2bb737569 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:04.977137 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-87b5dccf-ccd2-4d52-8c8c-fba2bb737569 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:04.977137 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-87b5dccf-ccd2-4d52-8c8c-fba2bb737569 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:04.977360 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-232215ac-0884-4a3b-a83d-6966288fc06b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] HTTP exception thrown: Instance e6b3ee80-2e17-4135-9f45-bef437385e0c could not be found. Oct 04 18:48:04.979466 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-87b5dccf-ccd2-4d52-8c8c-fba2bb737569 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:04.980183 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-232215ac-0884-4a3b-a83d-6966288fc06b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Request method failure captured: Oct 04 18:48:04.980183 n-d-850501-14 devstack@n-api.service[123002]: request: POST /compute/v2.1/servers/e6b3ee80-2e17-4135-9f45-bef437385e0c/action HTTP/1.1 Oct 04 18:48:04.980183 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:48:04.980183 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:48:04.980183 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:48:04.980183 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 65 Oct 04 18:48:04.980183 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:48:04.980183 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:48:04.980183 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:48:04.980183 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:48:04.980183 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH9zAVdj2h4kh6QqBpYrS2CJMhbcXf529VUNrZoZOYhS2tkLYBgw6AHy860DK9jQ3xATqZvC9lQuxt-_H5qKsAI41eznf32K6QSGqVcHXegpVHrDueww23ZMVCBM3D_hH0NTzh4447rgHqcrC-OZE48IfZrRJ9KPLPjAHT57T3mcPIc Oct 04 18:48:04.980183 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:48:04.980183 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:48:04.980183 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:48:04.980183 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:48:04.980183 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:48:04.980183 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:48:04.980183 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: b6c6b9deecde44b5953d22b38b5b0ff1 Oct 04 18:48:04.980183 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:48:04.980183 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:48:04.980183 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:48:04.980183 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6c6b9deecde44b5953d22b38b5b0ff1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b6c6b9deecde44b5953d22b38b5b0ff1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b6c6b9deecde44b5953d22b38b5b0ff1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6c6b9deecde44b5953d22b38b5b0ff1"}]}] Oct 04 18:48:04.980183 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:48:04.980183 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: b6c6b9deecde44b5953d22b38b5b0ff1 Oct 04 18:48:04.980183 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:48:04.980183 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServersNegativeTestJSON-626077540-project Oct 04 18:48:04.980183 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:48:04.980183 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:48:04.980183 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 5b4eb70f22ba4872b890a4f160cc1805 Oct 04 18:48:04.980183 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServersNegativeTestJSON-626077540-project Oct 04 18:48:04.980183 n-d-850501-14 devstack@n-api.service[123002]: Oct 04 18:48:04.980183 n-d-850501-14 devstack@n-api.service[123002]: {"rebuild": {"imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559"}} Oct 04 18:48:04.980183 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:48:04.980183 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance e6b3ee80-2e17-4135-9f45-bef437385e0c could not be found. Oct 04 18:48:04.980183 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'e6b3ee80-2e17-4135-9f45-bef437385e0c', 'body': {'rebuild': {'imageRef': 'f545e662-10b3-46b1-88bb-6e66dd294559'}}} Oct 04 18:48:04.980183 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:48:04.980183 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:04.980183 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:48:04.980183 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:48:04.980183 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:48:04.980183 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:48:04.980183 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:48:04.980183 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:48:04.980183 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:48:04.980183 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:48:04.980183 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6b3ee80-2e17-4135-9f45-bef437385e0c could not be found. Oct 04 18:48:04.980183 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:48:04.980183 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:48:04.980183 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:48:04.980183 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:04.980183 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:48:04.980183 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:48:04.980183 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:48:04.980183 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:48:04.980183 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:48:04.980183 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:48:04.980183 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:48:04.980183 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:48:04.980183 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:48:04.980183 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:48:04.980183 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:48:04.980183 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:48:04.980183 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 04 18:48:04.980183 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 04 18:48:04.987259 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 04 18:48:04.987259 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:48:04.987259 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:48:04.987259 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:48:04.987259 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:48:04.987259 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6b3ee80-2e17-4135-9f45-bef437385e0c could not be found. Oct 04 18:48:04.987259 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:48:04.987259 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:48:04.987259 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:48:04.987259 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:04.987259 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:48:04.987259 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:48:04.987259 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:48:04.987259 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:48:04.987259 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6b3ee80-2e17-4135-9f45-bef437385e0c could not be found. Oct 04 18:48:04.987259 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:48:04.987259 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-232215ac-0884-4a3b-a83d-6966288fc06b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Returning 404 to user: Instance e6b3ee80-2e17-4135-9f45-bef437385e0c could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:48:04.987259 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-232215ac-0884-4a3b-a83d-6966288fc06b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "POST /compute/v2.1/servers/e6b3ee80-2e17-4135-9f45-bef437385e0c/action" status: 404 len: 111 microversion: 2.1 time: 0.075186 Oct 04 18:48:04.987259 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2243/4543] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:48:04 2022] POST /compute/v2.1/servers/e6b3ee80-2e17-4135-9f45-bef437385e0c/action => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:48:04.991605 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-87b5dccf-ccd2-4d52-8c8c-fba2bb737569 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:04.992365 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-87b5dccf-ccd2-4d52-8c8c-fba2bb737569 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:05.001623 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d1f2225f-33b3-48b8-a7ad-f36af9f99ccf tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:05.005441 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d1f2225f-33b3-48b8-a7ad-f36af9f99ccf tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:05.015663 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d1f2225f-33b3-48b8-a7ad-f36af9f99ccf tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:05.016407 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d1f2225f-33b3-48b8-a7ad-f36af9f99ccf tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:05.017053 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d1f2225f-33b3-48b8-a7ad-f36af9f99ccf tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:05.018141 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d1f2225f-33b3-48b8-a7ad-f36af9f99ccf tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:05.018808 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d1f2225f-33b3-48b8-a7ad-f36af9f99ccf tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:05.019822 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d1f2225f-33b3-48b8-a7ad-f36af9f99ccf tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:05.477398 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d1f2225f-33b3-48b8-a7ad-f36af9f99ccf tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:05.487865 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d1f2225f-33b3-48b8-a7ad-f36af9f99ccf tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1504 microversion: 2.1 time: 0.499571 Oct 04 18:48:05.489603 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2244/4544] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:04 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1504 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:05.512829 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-87b5dccf-ccd2-4d52-8c8c-fba2bb737569 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:05.525324 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e7009a69-4473-488b-b90f-e593a3f9bc0b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:05.526252 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e7009a69-4473-488b-b90f-e593a3f9bc0b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:05.530232 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-87b5dccf-ccd2-4d52-8c8c-fba2bb737569 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:05.533768 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-87b5dccf-ccd2-4d52-8c8c-fba2bb737569 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:05.534514 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e7009a69-4473-488b-b90f-e593a3f9bc0b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:05.534980 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-87b5dccf-ccd2-4d52-8c8c-fba2bb737569 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] 10.222.0.20 "GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6" status: 200 len: 1880 microversion: 2.32 time: 0.577035 Oct 04 18:48:05.535084 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e7009a69-4473-488b-b90f-e593a3f9bc0b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:05.535608 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e7009a69-4473-488b-b90f-e593a3f9bc0b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:05.535738 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2301/4545] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:48:04 2022] GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6 => generated 1880 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:48:05.537401 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e7009a69-4473-488b-b90f-e593a3f9bc0b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:05.539532 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e7009a69-4473-488b-b90f-e593a3f9bc0b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:05.540080 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e7009a69-4473-488b-b90f-e593a3f9bc0b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:05.593604 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a329ccc3-86c3-4b06-a9ea-4f8a249922b1 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:05.595022 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a329ccc3-86c3-4b06-a9ea-4f8a249922b1 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: 60694294-78ff-49f7-9d07-bb5915eae69e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:05.604744 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a329ccc3-86c3-4b06-a9ea-4f8a249922b1 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:05.605605 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a329ccc3-86c3-4b06-a9ea-4f8a249922b1 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:05.606225 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a329ccc3-86c3-4b06-a9ea-4f8a249922b1 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:05.607189 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a329ccc3-86c3-4b06-a9ea-4f8a249922b1 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:05.613407 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a329ccc3-86c3-4b06-a9ea-4f8a249922b1 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:05.613407 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a329ccc3-86c3-4b06-a9ea-4f8a249922b1 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:05.946604 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e7009a69-4473-488b-b90f-e593a3f9bc0b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:05.958571 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a329ccc3-86c3-4b06-a9ea-4f8a249922b1 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:05.962187 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e7009a69-4473-488b-b90f-e593a3f9bc0b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1504 microversion: 2.1 time: 0.443841 Oct 04 18:48:05.963568 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2245/4546] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:05 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1504 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:05.971423 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a329ccc3-86c3-4b06-a9ea-4f8a249922b1 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/60694294-78ff-49f7-9d07-bb5915eae69e" status: 200 len: 1520 microversion: 2.1 time: 0.383775 Oct 04 18:48:05.972543 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2302/4547] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:05 2022] GET /compute/v2.1/servers/60694294-78ff-49f7-9d07-bb5915eae69e => generated 1520 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:06.004142 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-98e50a1d-13b4-4846-ae8f-1b8a5b7b46fd tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:48:06.009014 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-98e50a1d-13b4-4846-ae8f-1b8a5b7b46fd tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: bc5822e3-737b-46f3-bde4-7c4909266c79] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:06.015283 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-98e50a1d-13b4-4846-ae8f-1b8a5b7b46fd tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] HTTP exception thrown: Instance bc5822e3-737b-46f3-bde4-7c4909266c79 could not be found. Oct 04 18:48:06.017430 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-98e50a1d-13b4-4846-ae8f-1b8a5b7b46fd tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Request method failure captured: Oct 04 18:48:06.017430 n-d-850501-14 devstack@n-api.service[123002]: request: POST /compute/v2.1/servers/bc5822e3-737b-46f3-bde4-7c4909266c79/action HTTP/1.1 Oct 04 18:48:06.017430 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:48:06.017430 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:48:06.017430 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:48:06.017430 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 65 Oct 04 18:48:06.017430 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:48:06.017430 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:48:06.017430 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:48:06.017430 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:48:06.017430 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH9zAVdj2h4kh6QqBpYrS2CJMhbcXf529VUNrZoZOYhS2tkLYBgw6AHy860DK9jQ3xATqZvC9lQuxt-_H5qKsAI41eznf32K6QSGqVcHXegpVHrDueww23ZMVCBM3D_hH0NTzh4447rgHqcrC-OZE48IfZrRJ9KPLPjAHT57T3mcPIc Oct 04 18:48:06.017430 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:48:06.017430 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:48:06.017430 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:48:06.017430 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:48:06.017430 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:48:06.017430 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:48:06.017430 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: b6c6b9deecde44b5953d22b38b5b0ff1 Oct 04 18:48:06.017430 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:48:06.017430 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:48:06.017430 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:48:06.017430 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6c6b9deecde44b5953d22b38b5b0ff1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b6c6b9deecde44b5953d22b38b5b0ff1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b6c6b9deecde44b5953d22b38b5b0ff1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6c6b9deecde44b5953d22b38b5b0ff1"}]}] Oct 04 18:48:06.017430 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:48:06.017430 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: b6c6b9deecde44b5953d22b38b5b0ff1 Oct 04 18:48:06.017430 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:48:06.017430 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServersNegativeTestJSON-626077540-project Oct 04 18:48:06.017430 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:48:06.017430 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:48:06.017430 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 5b4eb70f22ba4872b890a4f160cc1805 Oct 04 18:48:06.017430 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServersNegativeTestJSON-626077540-project Oct 04 18:48:06.017430 n-d-850501-14 devstack@n-api.service[123002]: Oct 04 18:48:06.017430 n-d-850501-14 devstack@n-api.service[123002]: {"rebuild": {"imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559"}} Oct 04 18:48:06.017430 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:48:06.017430 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance bc5822e3-737b-46f3-bde4-7c4909266c79 could not be found. Oct 04 18:48:06.017430 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'bc5822e3-737b-46f3-bde4-7c4909266c79', 'body': {'rebuild': {'imageRef': 'f545e662-10b3-46b1-88bb-6e66dd294559'}}} Oct 04 18:48:06.017430 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:48:06.017430 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:06.017430 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:48:06.017430 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:48:06.017430 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:48:06.017430 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:48:06.017430 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:48:06.017430 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:48:06.017430 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc5822e3-737b-46f3-bde4-7c4909266c79 could not be found. Oct 04 18:48:06.017430 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:48:06.017430 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:48:06.017430 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:48:06.017430 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:06.017430 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:48:06.017430 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:48:06.017430 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:48:06.017430 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:48:06.017430 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:48:06.017430 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:48:06.017430 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:48:06.017430 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:48:06.017430 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:48:06.017430 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:48:06.017430 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:48:06.017430 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:48:06.017430 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 04 18:48:06.017430 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 04 18:48:06.017430 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 04 18:48:06.017430 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:48:06.029058 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:48:06.029058 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:48:06.029058 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:48:06.029058 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc5822e3-737b-46f3-bde4-7c4909266c79 could not be found. Oct 04 18:48:06.029058 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:48:06.029058 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:48:06.029058 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:48:06.029058 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:06.029058 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:48:06.029058 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:48:06.029058 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:48:06.029058 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:48:06.029058 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc5822e3-737b-46f3-bde4-7c4909266c79 could not be found. Oct 04 18:48:06.029058 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:48:06.029058 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-98e50a1d-13b4-4846-ae8f-1b8a5b7b46fd tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Returning 404 to user: Instance bc5822e3-737b-46f3-bde4-7c4909266c79 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:48:06.029058 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-98e50a1d-13b4-4846-ae8f-1b8a5b7b46fd tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "POST /compute/v2.1/servers/bc5822e3-737b-46f3-bde4-7c4909266c79/action" status: 404 len: 111 microversion: 2.1 time: 0.021328 Oct 04 18:48:06.029058 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2246/4548] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:48:05 2022] POST /compute/v2.1/servers/bc5822e3-737b-46f3-bde4-7c4909266c79/action => generated 111 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:48:06.037641 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c56117ca-af47-4085-90c7-eb8c544714ff tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:06.037925 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c56117ca-af47-4085-90c7-eb8c544714ff tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:06.045754 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c56117ca-af47-4085-90c7-eb8c544714ff tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:06.046350 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c56117ca-af47-4085-90c7-eb8c544714ff tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:06.051760 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c56117ca-af47-4085-90c7-eb8c544714ff tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:06.051760 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c56117ca-af47-4085-90c7-eb8c544714ff tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:06.051760 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c56117ca-af47-4085-90c7-eb8c544714ff tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:06.051760 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c56117ca-af47-4085-90c7-eb8c544714ff tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:06.091227 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=100 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:48:06.569576 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2e01b58e-a771-4e12-a1f2-31e0a0db1300 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:06.570333 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2e01b58e-a771-4e12-a1f2-31e0a0db1300 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] [instance: 317c7bd8-4f1e-4210-bb33-087557a1f4d6] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:06.590216 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e01b58e-a771-4e12-a1f2-31e0a0db1300 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:06.593422 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e01b58e-a771-4e12-a1f2-31e0a0db1300 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:06.594472 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e01b58e-a771-4e12-a1f2-31e0a0db1300 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:06.594859 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e01b58e-a771-4e12-a1f2-31e0a0db1300 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:06.595421 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e01b58e-a771-4e12-a1f2-31e0a0db1300 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:06.596088 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e01b58e-a771-4e12-a1f2-31e0a0db1300 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:06.634754 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c56117ca-af47-4085-90c7-eb8c544714ff tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:06.644336 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c56117ca-af47-4085-90c7-eb8c544714ff tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1504 microversion: 2.1 time: 0.613081 Oct 04 18:48:06.644766 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2303/4549] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:06 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1504 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:06.679876 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-760a3418-8d03-4190-bde1-ad8bb0c76caa tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:06.680599 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-760a3418-8d03-4190-bde1-ad8bb0c76caa tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:06.693499 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-760a3418-8d03-4190-bde1-ad8bb0c76caa tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:06.693987 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-760a3418-8d03-4190-bde1-ad8bb0c76caa tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:06.694601 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-760a3418-8d03-4190-bde1-ad8bb0c76caa tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:06.695487 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-760a3418-8d03-4190-bde1-ad8bb0c76caa tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:06.696121 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-760a3418-8d03-4190-bde1-ad8bb0c76caa tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:06.696875 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-760a3418-8d03-4190-bde1-ad8bb0c76caa tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:07.307362 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-760a3418-8d03-4190-bde1-ad8bb0c76caa tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:07.321276 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-760a3418-8d03-4190-bde1-ad8bb0c76caa tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1504 microversion: 2.1 time: 0.646924 Oct 04 18:48:07.322667 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2304/4550] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:06 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1504 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:48:07.329923 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-21d7fe3d-581c-4e2a-b5f5-61d7b28bc2fc tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:07.338736 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2e01b58e-a771-4e12-a1f2-31e0a0db1300 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:07.344512 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-21d7fe3d-581c-4e2a-b5f5-61d7b28bc2fc tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: 60694294-78ff-49f7-9d07-bb5915eae69e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:07.356349 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-21d7fe3d-581c-4e2a-b5f5-61d7b28bc2fc tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:07.357017 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-21d7fe3d-581c-4e2a-b5f5-61d7b28bc2fc tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:07.357632 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-21d7fe3d-581c-4e2a-b5f5-61d7b28bc2fc tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:07.362307 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2e01b58e-a771-4e12-a1f2-31e0a0db1300 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:07.363982 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2e01b58e-a771-4e12-a1f2-31e0a0db1300 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:07.367748 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2e01b58e-a771-4e12-a1f2-31e0a0db1300 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] 10.222.0.20 "GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6" status: 200 len: 1880 microversion: 2.32 time: 0.803327 Oct 04 18:48:07.368540 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2247/4551] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:48:06 2022] GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6 => generated 1880 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:48:07.374753 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-21d7fe3d-581c-4e2a-b5f5-61d7b28bc2fc tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:07.374753 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-21d7fe3d-581c-4e2a-b5f5-61d7b28bc2fc tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:07.374753 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-21d7fe3d-581c-4e2a-b5f5-61d7b28bc2fc tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:07.389955 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-eb670dd0-b7e2-44c4-b4c4-13f402c66e16 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:48:07.401436 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-eb670dd0-b7e2-44c4-b4c4-13f402c66e16 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 071c738b-9157-490d-9e0f-b5b5a3c333bd] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:07.432366 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-eb670dd0-b7e2-44c4-b4c4-13f402c66e16 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] HTTP exception thrown: Instance 071c738b-9157-490d-9e0f-b5b5a3c333bd could not be found. Oct 04 18:48:07.434004 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-eb670dd0-b7e2-44c4-b4c4-13f402c66e16 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Request method failure captured: Oct 04 18:48:07.434004 n-d-850501-14 devstack@n-api.service[123002]: request: POST /compute/v2.1/servers/071c738b-9157-490d-9e0f-b5b5a3c333bd/action HTTP/1.1 Oct 04 18:48:07.434004 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:48:07.434004 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:48:07.434004 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:48:07.434004 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 15 Oct 04 18:48:07.434004 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:48:07.434004 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:48:07.434004 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:48:07.434004 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:48:07.434004 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH9zAVdj2h4kh6QqBpYrS2CJMhbcXf529VUNrZoZOYhS2tkLYBgw6AHy860DK9jQ3xATqZvC9lQuxt-_H5qKsAI41eznf32K6QSGqVcHXegpVHrDueww23ZMVCBM3D_hH0NTzh4447rgHqcrC-OZE48IfZrRJ9KPLPjAHT57T3mcPIc Oct 04 18:48:07.434004 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:48:07.434004 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:48:07.434004 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:48:07.434004 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:48:07.434004 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:48:07.434004 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:48:07.434004 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: b6c6b9deecde44b5953d22b38b5b0ff1 Oct 04 18:48:07.434004 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:48:07.434004 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:48:07.434004 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:48:07.434004 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6c6b9deecde44b5953d22b38b5b0ff1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b6c6b9deecde44b5953d22b38b5b0ff1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b6c6b9deecde44b5953d22b38b5b0ff1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6c6b9deecde44b5953d22b38b5b0ff1"}]}] Oct 04 18:48:07.434004 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:48:07.434004 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: b6c6b9deecde44b5953d22b38b5b0ff1 Oct 04 18:48:07.434004 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:48:07.434004 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServersNegativeTestJSON-626077540-project Oct 04 18:48:07.434004 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:48:07.434004 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:48:07.434004 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 5b4eb70f22ba4872b890a4f160cc1805 Oct 04 18:48:07.434004 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServersNegativeTestJSON-626077540-project Oct 04 18:48:07.434004 n-d-850501-14 devstack@n-api.service[123002]: Oct 04 18:48:07.434004 n-d-850501-14 devstack@n-api.service[123002]: {"restore": {}} Oct 04 18:48:07.434004 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:48:07.434004 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 071c738b-9157-490d-9e0f-b5b5a3c333bd could not be found. Oct 04 18:48:07.434004 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '071c738b-9157-490d-9e0f-b5b5a3c333bd', 'body': {'restore': {}}} Oct 04 18:48:07.434004 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:48:07.434004 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:07.434004 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:48:07.434004 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:48:07.434004 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:48:07.434004 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:48:07.434004 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:48:07.434004 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:48:07.434004 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 071c738b-9157-490d-9e0f-b5b5a3c333bd could not be found. Oct 04 18:48:07.434004 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:48:07.434004 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:48:07.434004 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:48:07.434004 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:07.434004 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:48:07.434004 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:48:07.434004 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:48:07.434004 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:48:07.434004 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:48:07.434004 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:48:07.434004 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Oct 04 18:48:07.434004 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 04 18:48:07.434004 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:48:07.434004 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:48:07.434004 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 071c738b-9157-490d-9e0f-b5b5a3c333bd could not be found. Oct 04 18:48:07.434004 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:48:07.434004 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:48:07.434004 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:48:07.434004 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:07.434004 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:48:07.434004 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:48:07.439145 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:48:07.439145 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:48:07.439145 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 071c738b-9157-490d-9e0f-b5b5a3c333bd could not be found. Oct 04 18:48:07.439145 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:48:07.439145 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-eb670dd0-b7e2-44c4-b4c4-13f402c66e16 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Returning 404 to user: Instance 071c738b-9157-490d-9e0f-b5b5a3c333bd could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:48:07.439145 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-eb670dd0-b7e2-44c4-b4c4-13f402c66e16 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "POST /compute/v2.1/servers/071c738b-9157-490d-9e0f-b5b5a3c333bd/action" status: 404 len: 111 microversion: 2.1 time: 0.059396 Oct 04 18:48:07.439145 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2248/4552] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:48:07 2022] POST /compute/v2.1/servers/071c738b-9157-490d-9e0f-b5b5a3c333bd/action => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:48:07.471672 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-47344567-da2f-4532-aab4-7670d88809bc tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:07.474789 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-47344567-da2f-4532-aab4-7670d88809bc tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:07.501616 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-47344567-da2f-4532-aab4-7670d88809bc tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:07.502157 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-47344567-da2f-4532-aab4-7670d88809bc tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:07.502605 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-47344567-da2f-4532-aab4-7670d88809bc tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:07.503609 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-47344567-da2f-4532-aab4-7670d88809bc tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:07.513281 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-47344567-da2f-4532-aab4-7670d88809bc tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:07.513947 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-47344567-da2f-4532-aab4-7670d88809bc tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:07.545343 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:48:07.952275 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-21d7fe3d-581c-4e2a-b5f5-61d7b28bc2fc tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:07.965288 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-21d7fe3d-581c-4e2a-b5f5-61d7b28bc2fc tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/60694294-78ff-49f7-9d07-bb5915eae69e" status: 200 len: 1505 microversion: 2.1 time: 0.641129 Oct 04 18:48:07.970637 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2305/4553] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:07 2022] GET /compute/v2.1/servers/60694294-78ff-49f7-9d07-bb5915eae69e => generated 1505 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:07.997973 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4a572264-3556-481f-8e26-33d66cec51f2 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:07.998626 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-4a572264-3556-481f-8e26-33d66cec51f2 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: 60694294-78ff-49f7-9d07-bb5915eae69e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:08.012255 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-47344567-da2f-4532-aab4-7670d88809bc tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:08.012734 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4a572264-3556-481f-8e26-33d66cec51f2 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:08.014212 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4a572264-3556-481f-8e26-33d66cec51f2 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:08.024641 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4a572264-3556-481f-8e26-33d66cec51f2 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:08.024641 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4a572264-3556-481f-8e26-33d66cec51f2 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:08.024641 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4a572264-3556-481f-8e26-33d66cec51f2 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:08.024641 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4a572264-3556-481f-8e26-33d66cec51f2 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:08.024956 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-47344567-da2f-4532-aab4-7670d88809bc tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1504 microversion: 2.1 time: 0.572892 Oct 04 18:48:08.024956 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2249/4554] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:07 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1504 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:08.054519 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-178edb67-2447-48f5-959c-2e726f65c046 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:08.058049 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-178edb67-2447-48f5-959c-2e726f65c046 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:08.071254 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-178edb67-2447-48f5-959c-2e726f65c046 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:08.072297 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-178edb67-2447-48f5-959c-2e726f65c046 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:08.073550 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-178edb67-2447-48f5-959c-2e726f65c046 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:08.075162 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-178edb67-2447-48f5-959c-2e726f65c046 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:08.076538 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-178edb67-2447-48f5-959c-2e726f65c046 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:08.079585 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-178edb67-2447-48f5-959c-2e726f65c046 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:08.377171 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-4a572264-3556-481f-8e26-33d66cec51f2 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:08.391996 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-4a572264-3556-481f-8e26-33d66cec51f2 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/60694294-78ff-49f7-9d07-bb5915eae69e" status: 200 len: 1505 microversion: 2.1 time: 0.399230 Oct 04 18:48:08.392615 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2306/4555] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:07 2022] GET /compute/v2.1/servers/60694294-78ff-49f7-9d07-bb5915eae69e => generated 1505 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:48:08.418776 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4bfe2b77-76e5-4959-9abf-a1ac52124dcc tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:08.419558 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-4bfe2b77-76e5-4959-9abf-a1ac52124dcc tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] [instance: 317c7bd8-4f1e-4210-bb33-087557a1f4d6] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:08.426699 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4bfe2b77-76e5-4959-9abf-a1ac52124dcc tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:08.427986 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4bfe2b77-76e5-4959-9abf-a1ac52124dcc tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:08.428663 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4bfe2b77-76e5-4959-9abf-a1ac52124dcc tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:08.429505 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4bfe2b77-76e5-4959-9abf-a1ac52124dcc tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:08.430204 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4bfe2b77-76e5-4959-9abf-a1ac52124dcc tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:08.430730 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4bfe2b77-76e5-4959-9abf-a1ac52124dcc tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:08.434970 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-178edb67-2447-48f5-959c-2e726f65c046 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:08.447102 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-178edb67-2447-48f5-959c-2e726f65c046 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1504 microversion: 2.1 time: 0.397464 Oct 04 18:48:08.449164 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2250/4556] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:08 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1504 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:48:08.480410 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-da7f8a2c-681b-4ae9-b36e-c1f39ca1d091 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:08.481172 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-da7f8a2c-681b-4ae9-b36e-c1f39ca1d091 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: 60694294-78ff-49f7-9d07-bb5915eae69e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:08.497479 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-da7f8a2c-681b-4ae9-b36e-c1f39ca1d091 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:08.501857 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-da7f8a2c-681b-4ae9-b36e-c1f39ca1d091 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:08.502375 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-da7f8a2c-681b-4ae9-b36e-c1f39ca1d091 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:08.503108 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-da7f8a2c-681b-4ae9-b36e-c1f39ca1d091 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:08.503780 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-da7f8a2c-681b-4ae9-b36e-c1f39ca1d091 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:08.504101 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-da7f8a2c-681b-4ae9-b36e-c1f39ca1d091 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:08.570856 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-da7f8a2c-681b-4ae9-b36e-c1f39ca1d091 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: 60694294-78ff-49f7-9d07-bb5915eae69e] Going to try to terminate instance {{(pid=123002) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:48:08.923403 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-4bfe2b77-76e5-4959-9abf-a1ac52124dcc tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:08.939234 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-4bfe2b77-76e5-4959-9abf-a1ac52124dcc tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:08.941635 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-4bfe2b77-76e5-4959-9abf-a1ac52124dcc tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:08.944195 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-4bfe2b77-76e5-4959-9abf-a1ac52124dcc tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] 10.222.0.20 "GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6" status: 200 len: 1880 microversion: 2.32 time: 0.531879 Oct 04 18:48:08.956082 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2307/4557] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:48:08 2022] GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6 => generated 1880 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:48:08.968468 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e9fb931c-5d23-4963-b3ac-93d8c8f3b065 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:48:08.968468 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e9fb931c-5d23-4963-b3ac-93d8c8f3b065 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:08.971855 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e9fb931c-5d23-4963-b3ac-93d8c8f3b065 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:08.972562 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e9fb931c-5d23-4963-b3ac-93d8c8f3b065 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:08.973152 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e9fb931c-5d23-4963-b3ac-93d8c8f3b065 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:08.974784 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e9fb931c-5d23-4963-b3ac-93d8c8f3b065 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:08.975472 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e9fb931c-5d23-4963-b3ac-93d8c8f3b065 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:08.976176 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e9fb931c-5d23-4963-b3ac-93d8c8f3b065 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:09.038523 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-e9fb931c-5d23-4963-b3ac-93d8c8f3b065 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] HTTP exception thrown: Cannot 'restore' instance 95fb1a13-7441-4f74-ad81-5a9413496545 while it is in vm_state active Oct 04 18:48:09.043567 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e9fb931c-5d23-4963-b3ac-93d8c8f3b065 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Request method failure captured: Oct 04 18:48:09.043567 n-d-850501-14 devstack@n-api.service[123001]: request: POST /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545/action HTTP/1.1 Oct 04 18:48:09.043567 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:48:09.043567 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:48:09.043567 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:48:09.043567 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 15 Oct 04 18:48:09.043567 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:48:09.043567 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:48:09.043567 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:48:09.043567 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:48:09.043567 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPH9zAVdj2h4kh6QqBpYrS2CJMhbcXf529VUNrZoZOYhS2tkLYBgw6AHy860DK9jQ3xATqZvC9lQuxt-_H5qKsAI41eznf32K6QSGqVcHXegpVHrDueww23ZMVCBM3D_hH0NTzh4447rgHqcrC-OZE48IfZrRJ9KPLPjAHT57T3mcPIc Oct 04 18:48:09.043567 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:48:09.043567 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:48:09.043567 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:48:09.043567 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:48:09.043567 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:48:09.043567 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:48:09.043567 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: b6c6b9deecde44b5953d22b38b5b0ff1 Oct 04 18:48:09.043567 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:48:09.043567 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:48:09.043567 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:48:09.043567 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6c6b9deecde44b5953d22b38b5b0ff1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b6c6b9deecde44b5953d22b38b5b0ff1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b6c6b9deecde44b5953d22b38b5b0ff1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6c6b9deecde44b5953d22b38b5b0ff1"}]}] Oct 04 18:48:09.043567 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:48:09.043567 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: b6c6b9deecde44b5953d22b38b5b0ff1 Oct 04 18:48:09.043567 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:48:09.043567 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ServersNegativeTestJSON-626077540-project Oct 04 18:48:09.043567 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:48:09.043567 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:48:09.043567 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 5b4eb70f22ba4872b890a4f160cc1805 Oct 04 18:48:09.043567 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ServersNegativeTestJSON-626077540-project Oct 04 18:48:09.043567 n-d-850501-14 devstack@n-api.service[123001]: Oct 04 18:48:09.043567 n-d-850501-14 devstack@n-api.service[123001]: {"restore": {}} Oct 04 18:48:09.043567 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:48:09.043567 n-d-850501-14 devstack@n-api.service[123001]: exception: Cannot 'restore' instance 95fb1a13-7441-4f74-ad81-5a9413496545 while it is in vm_state active Oct 04 18:48:09.043567 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '95fb1a13-7441-4f74-ad81-5a9413496545', 'body': {'restore': {}}} Oct 04 18:48:09.043567 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:48:09.043567 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:09.043567 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Oct 04 18:48:09.043567 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Oct 04 18:48:09.043567 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:48:09.043567 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:48:09.043567 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 18:48:09.043567 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 18:48:09.043567 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 95fb1a13-7441-4f74-ad81-5a9413496545 in vm_state active. Cannot restore while the instance is in this state. Oct 04 18:48:09.043567 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:48:09.043567 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:48:09.043567 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:48:09.043567 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:09.043567 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:48:09.043567 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:48:09.043567 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:48:09.043567 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:48:09.043567 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:48:09.043567 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:48:09.043567 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Oct 04 18:48:09.043567 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 18:48:09.043567 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 18:48:09.043567 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 18:48:09.043567 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 95fb1a13-7441-4f74-ad81-5a9413496545 while it is in vm_state active Oct 04 18:48:09.043567 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:48:09.043567 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:48:09.043567 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:48:09.043567 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:09.043567 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:48:09.053780 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:48:09.053780 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:48:09.053780 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:48:09.053780 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 95fb1a13-7441-4f74-ad81-5a9413496545 while it is in vm_state active Oct 04 18:48:09.053780 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:48:09.053780 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e9fb931c-5d23-4963-b3ac-93d8c8f3b065 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Returning 409 to user: Cannot 'restore' instance 95fb1a13-7441-4f74-ad81-5a9413496545 while it is in vm_state active {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:48:09.055698 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e9fb931c-5d23-4963-b3ac-93d8c8f3b065 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "POST /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545/action" status: 409 len: 145 microversion: 2.1 time: 0.107954 Oct 04 18:48:09.056932 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2308/4558] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:48:08 2022] POST /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545/action => generated 145 bytes in 110 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:48:09.070316 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5e0f7b82-372e-423d-a1f9-f5654561d691 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:09.071849 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5e0f7b82-372e-423d-a1f9-f5654561d691 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:09.079893 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5e0f7b82-372e-423d-a1f9-f5654561d691 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:09.080575 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5e0f7b82-372e-423d-a1f9-f5654561d691 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:09.081173 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5e0f7b82-372e-423d-a1f9-f5654561d691 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:09.082045 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5e0f7b82-372e-423d-a1f9-f5654561d691 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:09.083806 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5e0f7b82-372e-423d-a1f9-f5654561d691 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:09.084480 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5e0f7b82-372e-423d-a1f9-f5654561d691 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:09.118301 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-da7f8a2c-681b-4ae9-b36e-c1f39ca1d091 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "DELETE /compute/v2.1/servers/60694294-78ff-49f7-9d07-bb5915eae69e" status: 204 len: 0 microversion: 2.1 time: 0.651458 Oct 04 18:48:09.120834 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2251/4559] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:48:08 2022] DELETE /compute/v2.1/servers/60694294-78ff-49f7-9d07-bb5915eae69e => generated 0 bytes in 655 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:48:09.397697 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9c611115-74d0-4c86-86bb-50523b8abe2f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1616576569", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": [{"uuid": "773447f8-5421-4dc5-aacf-857d60ccc335"}]}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:48:09.481301 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-9c611115-74d0-4c86-86bb-50523b8abe2f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] validate_networks() for [('773447f8-5421-4dc5-aacf-857d60ccc335', None, None, None, None, None)] {{(pid=123002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:48:09.589014 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5e0f7b82-372e-423d-a1f9-f5654561d691 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:09.609695 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5e0f7b82-372e-423d-a1f9-f5654561d691 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1504 microversion: 2.1 time: 0.542129 Oct 04 18:48:09.621351 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2309/4560] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:09 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1504 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:09.639049 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-04cbeecc-e259-45e3-a3b2-0dbd64c8c7e6 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:09.640142 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-04cbeecc-e259-45e3-a3b2-0dbd64c8c7e6 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:09.651828 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-04cbeecc-e259-45e3-a3b2-0dbd64c8c7e6 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:09.654601 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-04cbeecc-e259-45e3-a3b2-0dbd64c8c7e6 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:09.655264 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-04cbeecc-e259-45e3-a3b2-0dbd64c8c7e6 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:09.656225 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-04cbeecc-e259-45e3-a3b2-0dbd64c8c7e6 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:09.656921 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-04cbeecc-e259-45e3-a3b2-0dbd64c8c7e6 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:09.658513 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-04cbeecc-e259-45e3-a3b2-0dbd64c8c7e6 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:10.046903 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-04cbeecc-e259-45e3-a3b2-0dbd64c8c7e6 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:10.062256 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-04cbeecc-e259-45e3-a3b2-0dbd64c8c7e6 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1504 microversion: 2.1 time: 0.428266 Oct 04 18:48:10.064229 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2310/4561] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:09 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1504 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:10.070666 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-537f6dc7-ff56-4f36-b813-564d49358a9c tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:10.075470 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-537f6dc7-ff56-4f36-b813-564d49358a9c tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] [instance: 317c7bd8-4f1e-4210-bb33-087557a1f4d6] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:10.098653 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-537f6dc7-ff56-4f36-b813-564d49358a9c tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:10.098653 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-537f6dc7-ff56-4f36-b813-564d49358a9c tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:10.098653 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-537f6dc7-ff56-4f36-b813-564d49358a9c tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:10.098653 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-537f6dc7-ff56-4f36-b813-564d49358a9c tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:10.099866 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-537f6dc7-ff56-4f36-b813-564d49358a9c tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:10.101605 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-537f6dc7-ff56-4f36-b813-564d49358a9c tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:11.298205 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-537f6dc7-ff56-4f36-b813-564d49358a9c tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:11.315128 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-537f6dc7-ff56-4f36-b813-564d49358a9c tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:11.324536 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-537f6dc7-ff56-4f36-b813-564d49358a9c tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:11.329311 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-537f6dc7-ff56-4f36-b813-564d49358a9c tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] 10.222.0.20 "GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6" status: 200 len: 1880 microversion: 2.32 time: 1.260576 Oct 04 18:48:11.341082 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2311/4562] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:48:10 2022] GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6 => generated 1880 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:48:11.348685 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2c0baca3-5a76-4b34-8acc-5f3eeae3591b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:48:11.352004 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2c0baca3-5a76-4b34-8acc-5f3eeae3591b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 2330b2f4-4ccb-4ff3-a2b9-86e465c177ba] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:11.357073 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-2c0baca3-5a76-4b34-8acc-5f3eeae3591b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] HTTP exception thrown: Instance 2330b2f4-4ccb-4ff3-a2b9-86e465c177ba could not be found. Oct 04 18:48:11.370527 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2c0baca3-5a76-4b34-8acc-5f3eeae3591b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Request method failure captured: Oct 04 18:48:11.370527 n-d-850501-14 devstack@n-api.service[123001]: request: POST /compute/v2.1/servers/2330b2f4-4ccb-4ff3-a2b9-86e465c177ba/action HTTP/1.1 Oct 04 18:48:11.370527 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:48:11.370527 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:48:11.370527 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:48:11.370527 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 14 Oct 04 18:48:11.370527 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:48:11.370527 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:48:11.370527 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:48:11.370527 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:48:11.370527 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPH9zAVdj2h4kh6QqBpYrS2CJMhbcXf529VUNrZoZOYhS2tkLYBgw6AHy860DK9jQ3xATqZvC9lQuxt-_H5qKsAI41eznf32K6QSGqVcHXegpVHrDueww23ZMVCBM3D_hH0NTzh4447rgHqcrC-OZE48IfZrRJ9KPLPjAHT57T3mcPIc Oct 04 18:48:11.370527 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:48:11.370527 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:48:11.370527 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:48:11.370527 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:48:11.370527 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:48:11.370527 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:48:11.370527 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: b6c6b9deecde44b5953d22b38b5b0ff1 Oct 04 18:48:11.370527 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:48:11.370527 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:48:11.370527 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:48:11.370527 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6c6b9deecde44b5953d22b38b5b0ff1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b6c6b9deecde44b5953d22b38b5b0ff1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b6c6b9deecde44b5953d22b38b5b0ff1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6c6b9deecde44b5953d22b38b5b0ff1"}]}] Oct 04 18:48:11.370527 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:48:11.370527 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: b6c6b9deecde44b5953d22b38b5b0ff1 Oct 04 18:48:11.370527 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:48:11.370527 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ServersNegativeTestJSON-626077540-project Oct 04 18:48:11.370527 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:48:11.370527 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:48:11.370527 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 5b4eb70f22ba4872b890a4f160cc1805 Oct 04 18:48:11.370527 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ServersNegativeTestJSON-626077540-project Oct 04 18:48:11.370527 n-d-850501-14 devstack@n-api.service[123001]: Oct 04 18:48:11.370527 n-d-850501-14 devstack@n-api.service[123001]: {"resume": {}} Oct 04 18:48:11.370527 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:48:11.370527 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 2330b2f4-4ccb-4ff3-a2b9-86e465c177ba could not be found. Oct 04 18:48:11.370527 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '2330b2f4-4ccb-4ff3-a2b9-86e465c177ba', 'body': {'resume': {}}} Oct 04 18:48:11.370527 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:48:11.370527 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:11.370527 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:48:11.370527 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:48:11.370527 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:48:11.370527 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:48:11.370527 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:48:11.370527 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:48:11.370527 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2330b2f4-4ccb-4ff3-a2b9-86e465c177ba could not be found. Oct 04 18:48:11.370527 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:48:11.370527 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:48:11.370527 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:48:11.370527 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:11.370527 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:48:11.370527 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:48:11.370527 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:48:11.370527 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:48:11.370527 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:48:11.370527 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:48:11.370527 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Oct 04 18:48:11.370527 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 04 18:48:11.370527 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:48:11.370527 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:48:11.370527 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2330b2f4-4ccb-4ff3-a2b9-86e465c177ba could not be found. Oct 04 18:48:11.370527 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:48:11.370527 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:48:11.370527 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:48:11.370527 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:11.370527 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:48:11.370527 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:48:11.374650 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:48:11.374650 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:48:11.374650 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2330b2f4-4ccb-4ff3-a2b9-86e465c177ba could not be found. Oct 04 18:48:11.374650 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:48:11.377480 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2c0baca3-5a76-4b34-8acc-5f3eeae3591b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Returning 404 to user: Instance 2330b2f4-4ccb-4ff3-a2b9-86e465c177ba could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:48:11.378545 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2c0baca3-5a76-4b34-8acc-5f3eeae3591b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "POST /compute/v2.1/servers/2330b2f4-4ccb-4ff3-a2b9-86e465c177ba/action" status: 404 len: 111 microversion: 2.1 time: 0.047497 Oct 04 18:48:11.383867 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2312/4563] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:48:11 2022] POST /compute/v2.1/servers/2330b2f4-4ccb-4ff3-a2b9-86e465c177ba/action => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:48:11.392025 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-486852c7-0f29-43a7-8612-c63df249ea56 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:11.392967 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-486852c7-0f29-43a7-8612-c63df249ea56 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:11.411839 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-486852c7-0f29-43a7-8612-c63df249ea56 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:11.412630 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-486852c7-0f29-43a7-8612-c63df249ea56 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:11.414101 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-486852c7-0f29-43a7-8612-c63df249ea56 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:11.416437 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-486852c7-0f29-43a7-8612-c63df249ea56 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:11.417088 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-486852c7-0f29-43a7-8612-c63df249ea56 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:11.420798 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-486852c7-0f29-43a7-8612-c63df249ea56 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:11.748894 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-9c611115-74d0-4c86-86bb-50523b8abe2f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:48:11.749868 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-9c611115-74d0-4c86-86bb-50523b8abe2f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:48:11.750521 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-9c611115-74d0-4c86-86bb-50523b8abe2f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:48:11.751108 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-9c611115-74d0-4c86-86bb-50523b8abe2f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:48:11.751735 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-9c611115-74d0-4c86-86bb-50523b8abe2f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:48:11.771952 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9c611115-74d0-4c86-86bb-50523b8abe2f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:11.778527 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9c611115-74d0-4c86-86bb-50523b8abe2f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:11.780873 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9c611115-74d0-4c86-86bb-50523b8abe2f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:11.781972 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9c611115-74d0-4c86-86bb-50523b8abe2f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:11.784501 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9c611115-74d0-4c86-86bb-50523b8abe2f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:11.785393 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9c611115-74d0-4c86-86bb-50523b8abe2f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:11.824803 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-486852c7-0f29-43a7-8612-c63df249ea56 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:11.840695 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-486852c7-0f29-43a7-8612-c63df249ea56 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1504 microversion: 2.1 time: 0.455424 Oct 04 18:48:11.842558 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2313/4564] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:11 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1504 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:11.847772 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-9c611115-74d0-4c86-86bb-50523b8abe2f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Getting quotas for project e4bae9055ba74017a261df156ecdd347. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:48:11.862970 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-d19a29b0-15e0-4a70-a35e-33efc48517f6 req-50902ff8-6c34-4192-a332-26172000d491 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60694294-78ff-49f7-9d07-bb5915eae69e", "name": "network-vif-deleted", "tag": "6ded5837-6eb6-4f11-b5bf-4145870ee7b8"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:48:11.882607 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-9c611115-74d0-4c86-86bb-50523b8abe2f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Getting quotas for user 032b060beb9645c4bea314ae44277b35 and project e4bae9055ba74017a261df156ecdd347. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:48:11.903770 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-d19a29b0-15e0-4a70-a35e-33efc48517f6 req-50902ff8-6c34-4192-a332-26172000d491 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:11.906483 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-d19a29b0-15e0-4a70-a35e-33efc48517f6 req-50902ff8-6c34-4192-a332-26172000d491 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:11.907063 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-d19a29b0-15e0-4a70-a35e-33efc48517f6 req-50902ff8-6c34-4192-a332-26172000d491 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:11.911924 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9c611115-74d0-4c86-86bb-50523b8abe2f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Going to run 1 instances... {{(pid=123002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:48:11.918662 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9c611115-74d0-4c86-86bb-50523b8abe2f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: 406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:48:11.935943 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-d19a29b0-15e0-4a70-a35e-33efc48517f6 req-50902ff8-6c34-4192-a332-26172000d491 service nova] Creating event network-vif-deleted:6ded5837-6eb6-4f11-b5bf-4145870ee7b8 for instance 60694294-78ff-49f7-9d07-bb5915eae69e on n-h1-850501-14 Oct 04 18:48:11.942355 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-d19a29b0-15e0-4a70-a35e-33efc48517f6 req-50902ff8-6c34-4192-a332-26172000d491 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095454 Oct 04 18:48:11.946880 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2314/4565] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:48:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:48:11.953390 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-810deec1-8850-4b66-b829-43594c24036c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:11.954675 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-810deec1-8850-4b66-b829-43594c24036c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:11.962240 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-810deec1-8850-4b66-b829-43594c24036c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:11.962844 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-810deec1-8850-4b66-b829-43594c24036c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:11.963342 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-810deec1-8850-4b66-b829-43594c24036c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:11.964489 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-810deec1-8850-4b66-b829-43594c24036c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:11.965062 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-810deec1-8850-4b66-b829-43594c24036c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:11.965597 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-810deec1-8850-4b66-b829-43594c24036c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:12.140332 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9c611115-74d0-4c86-86bb-50523b8abe2f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.748475 Oct 04 18:48:12.142138 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2252/4566] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:48:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 2751 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:48:12.155032 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-73168fbd-7fed-4f5a-9f0d-d5c435d745c7 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:12.156487 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-73168fbd-7fed-4f5a-9f0d-d5c435d745c7 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: 406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:12.361308 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-73168fbd-7fed-4f5a-9f0d-d5c435d745c7 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:12.401695 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-73168fbd-7fed-4f5a-9f0d-d5c435d745c7 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a" status: 200 len: 1218 microversion: 2.1 time: 0.251957 Oct 04 18:48:12.404742 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2253/4567] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:12 2022] GET /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a => generated 1218 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:12.415388 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a4bf5606-3811-4eca-b86d-4d95805995f0 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:12.416429 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a4bf5606-3811-4eca-b86d-4d95805995f0 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] [instance: 317c7bd8-4f1e-4210-bb33-087557a1f4d6] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:12.423456 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:48:12.435269 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a4bf5606-3811-4eca-b86d-4d95805995f0 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:12.436035 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a4bf5606-3811-4eca-b86d-4d95805995f0 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:12.436855 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a4bf5606-3811-4eca-b86d-4d95805995f0 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:12.437793 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a4bf5606-3811-4eca-b86d-4d95805995f0 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:12.438739 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a4bf5606-3811-4eca-b86d-4d95805995f0 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:12.439330 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a4bf5606-3811-4eca-b86d-4d95805995f0 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:12.488680 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-810deec1-8850-4b66-b829-43594c24036c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:12.502712 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-810deec1-8850-4b66-b829-43594c24036c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1504 microversion: 2.1 time: 0.554445 Oct 04 18:48:12.516133 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2315/4568] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:11 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1504 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:12.528522 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3ef66908-2adc-40f2-908e-8918cb592a8c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:48:12.529133 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3ef66908-2adc-40f2-908e-8918cb592a8c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:12.535974 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3ef66908-2adc-40f2-908e-8918cb592a8c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:12.537370 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3ef66908-2adc-40f2-908e-8918cb592a8c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:12.537934 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3ef66908-2adc-40f2-908e-8918cb592a8c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:12.538747 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3ef66908-2adc-40f2-908e-8918cb592a8c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:12.539672 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3ef66908-2adc-40f2-908e-8918cb592a8c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:12.546745 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3ef66908-2adc-40f2-908e-8918cb592a8c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:12.584597 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-3ef66908-2adc-40f2-908e-8918cb592a8c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] HTTP exception thrown: Cannot 'resume' instance 95fb1a13-7441-4f74-ad81-5a9413496545 while it is in vm_state active Oct 04 18:48:12.587295 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3ef66908-2adc-40f2-908e-8918cb592a8c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Request method failure captured: Oct 04 18:48:12.587295 n-d-850501-14 devstack@n-api.service[123001]: request: POST /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545/action HTTP/1.1 Oct 04 18:48:12.587295 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:48:12.587295 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:48:12.587295 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:48:12.587295 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 14 Oct 04 18:48:12.587295 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:48:12.587295 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:48:12.587295 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:48:12.587295 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:48:12.587295 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPH9zAVdj2h4kh6QqBpYrS2CJMhbcXf529VUNrZoZOYhS2tkLYBgw6AHy860DK9jQ3xATqZvC9lQuxt-_H5qKsAI41eznf32K6QSGqVcHXegpVHrDueww23ZMVCBM3D_hH0NTzh4447rgHqcrC-OZE48IfZrRJ9KPLPjAHT57T3mcPIc Oct 04 18:48:12.587295 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:48:12.587295 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:48:12.587295 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:48:12.587295 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:48:12.587295 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:48:12.587295 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:48:12.587295 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: b6c6b9deecde44b5953d22b38b5b0ff1 Oct 04 18:48:12.587295 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:48:12.587295 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:48:12.587295 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:48:12.587295 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6c6b9deecde44b5953d22b38b5b0ff1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b6c6b9deecde44b5953d22b38b5b0ff1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b6c6b9deecde44b5953d22b38b5b0ff1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6c6b9deecde44b5953d22b38b5b0ff1"}]}] Oct 04 18:48:12.587295 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:48:12.587295 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: b6c6b9deecde44b5953d22b38b5b0ff1 Oct 04 18:48:12.587295 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:48:12.587295 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ServersNegativeTestJSON-626077540-project Oct 04 18:48:12.587295 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:48:12.587295 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:48:12.587295 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 5b4eb70f22ba4872b890a4f160cc1805 Oct 04 18:48:12.587295 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ServersNegativeTestJSON-626077540-project Oct 04 18:48:12.587295 n-d-850501-14 devstack@n-api.service[123001]: Oct 04 18:48:12.587295 n-d-850501-14 devstack@n-api.service[123001]: {"resume": {}} Oct 04 18:48:12.587295 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:48:12.587295 n-d-850501-14 devstack@n-api.service[123001]: exception: Cannot 'resume' instance 95fb1a13-7441-4f74-ad81-5a9413496545 while it is in vm_state active Oct 04 18:48:12.587295 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '95fb1a13-7441-4f74-ad81-5a9413496545', 'body': {'resume': {}}} Oct 04 18:48:12.587295 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:48:12.587295 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:12.587295 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Oct 04 18:48:12.587295 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Oct 04 18:48:12.587295 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:48:12.587295 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:48:12.587295 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 04 18:48:12.587295 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 18:48:12.587295 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 18:48:12.587295 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 18:48:12.587295 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 95fb1a13-7441-4f74-ad81-5a9413496545 in vm_state active. Cannot resume while the instance is in this state. Oct 04 18:48:12.587295 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:48:12.587295 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:48:12.587295 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:48:12.587295 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:12.587295 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:48:12.587295 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:48:12.587295 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:48:12.587295 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:48:12.587295 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:48:12.587295 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:48:12.587295 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Oct 04 18:48:12.587295 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 18:48:12.587295 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 18:48:12.587295 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 18:48:12.587295 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 95fb1a13-7441-4f74-ad81-5a9413496545 while it is in vm_state active Oct 04 18:48:12.587295 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:48:12.587295 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:48:12.587295 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:48:12.592534 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:12.592534 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:48:12.592534 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:48:12.592534 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:48:12.592534 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:48:12.592534 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 95fb1a13-7441-4f74-ad81-5a9413496545 while it is in vm_state active Oct 04 18:48:12.592534 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:48:12.594165 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3ef66908-2adc-40f2-908e-8918cb592a8c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Returning 409 to user: Cannot 'resume' instance 95fb1a13-7441-4f74-ad81-5a9413496545 while it is in vm_state active {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:48:12.595263 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3ef66908-2adc-40f2-908e-8918cb592a8c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "POST /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545/action" status: 409 len: 144 microversion: 2.1 time: 0.071729 Oct 04 18:48:12.596409 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2316/4569] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:48:12 2022] POST /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545/action => generated 144 bytes in 74 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:48:12.608672 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e200d5d1-5fbd-4c74-8e40-f044a49f80f1 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:12.609568 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e200d5d1-5fbd-4c74-8e40-f044a49f80f1 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:12.621223 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e200d5d1-5fbd-4c74-8e40-f044a49f80f1 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:12.688710 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e200d5d1-5fbd-4c74-8e40-f044a49f80f1 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:12.688710 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e200d5d1-5fbd-4c74-8e40-f044a49f80f1 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:12.688710 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e200d5d1-5fbd-4c74-8e40-f044a49f80f1 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:12.688710 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e200d5d1-5fbd-4c74-8e40-f044a49f80f1 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:12.688710 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e200d5d1-5fbd-4c74-8e40-f044a49f80f1 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:12.775041 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a4bf5606-3811-4eca-b86d-4d95805995f0 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:12.784899 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a4bf5606-3811-4eca-b86d-4d95805995f0 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:12.806259 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a4bf5606-3811-4eca-b86d-4d95805995f0 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:12.807477 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a4bf5606-3811-4eca-b86d-4d95805995f0 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] 10.222.0.20 "GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6" status: 200 len: 1880 microversion: 2.32 time: 0.401440 Oct 04 18:48:12.820744 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2254/4570] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:48:12 2022] GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6 => generated 1880 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:48:12.935985 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e200d5d1-5fbd-4c74-8e40-f044a49f80f1 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:12.954149 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e200d5d1-5fbd-4c74-8e40-f044a49f80f1 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1504 microversion: 2.1 time: 0.350905 Oct 04 18:48:12.955710 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2317/4571] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:12 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1504 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:12.988839 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-dd9a19d0-f01d-45cb-ada4-e1fc9f9ff107 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:12.989124 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-dd9a19d0-f01d-45cb-ada4-e1fc9f9ff107 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:13.002399 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dd9a19d0-f01d-45cb-ada4-e1fc9f9ff107 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:13.010737 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dd9a19d0-f01d-45cb-ada4-e1fc9f9ff107 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:13.011605 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dd9a19d0-f01d-45cb-ada4-e1fc9f9ff107 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:13.018619 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dd9a19d0-f01d-45cb-ada4-e1fc9f9ff107 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:13.019175 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dd9a19d0-f01d-45cb-ada4-e1fc9f9ff107 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:13.019661 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dd9a19d0-f01d-45cb-ada4-e1fc9f9ff107 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:13.436835 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-32e70e15-cfc3-4c3c-91a5-025da3500d47 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:13.439201 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-32e70e15-cfc3-4c3c-91a5-025da3500d47 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: 406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:13.577184 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-dd9a19d0-f01d-45cb-ada4-e1fc9f9ff107 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:13.592984 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-dd9a19d0-f01d-45cb-ada4-e1fc9f9ff107 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1504 microversion: 2.1 time: 0.606237 Oct 04 18:48:13.626272 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2255/4572] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:12 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1504 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:13.709899 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-32e70e15-cfc3-4c3c-91a5-025da3500d47 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:13.741706 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-32e70e15-cfc3-4c3c-91a5-025da3500d47 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a" status: 200 len: 1218 microversion: 2.1 time: 0.305301 Oct 04 18:48:13.772799 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2318/4573] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:13 2022] GET /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a => generated 1218 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:13.837424 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0463c5b1-6d1b-4972-9070-e8465d35e139 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:13.838162 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0463c5b1-6d1b-4972-9070-e8465d35e139 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] [instance: 317c7bd8-4f1e-4210-bb33-087557a1f4d6] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:13.867804 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0463c5b1-6d1b-4972-9070-e8465d35e139 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:13.878281 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0463c5b1-6d1b-4972-9070-e8465d35e139 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:13.882291 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0463c5b1-6d1b-4972-9070-e8465d35e139 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:13.886277 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0463c5b1-6d1b-4972-9070-e8465d35e139 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:13.891415 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0463c5b1-6d1b-4972-9070-e8465d35e139 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:13.892693 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0463c5b1-6d1b-4972-9070-e8465d35e139 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:14.136041 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2ae7a9a4-7471-4541-961e-742042f9ab14 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": [{"uuid": "334d1b7e-7632-43fb-8807-6117cf357d4f"}]}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:48:14.141583 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2ae7a9a4-7471-4541-961e-742042f9ab14 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Request method failure captured: Oct 04 18:48:14.141583 n-d-850501-14 devstack@n-api.service[123001]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:48:14.141583 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:48:14.141583 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:48:14.141583 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:48:14.141583 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 160 Oct 04 18:48:14.141583 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:48:14.141583 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:48:14.141583 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:48:14.141583 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:48:14.141583 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPH9zAVdj2h4kh6QqBpYrS2CJMhbcXf529VUNrZoZOYhS2tkLYBgw6AHy860DK9jQ3xATqZvC9lQuxt-_H5qKsAI41eznf32K6QSGqVcHXegpVHrDueww23ZMVCBM3D_hH0NTzh4447rgHqcrC-OZE48IfZrRJ9KPLPjAHT57T3mcPIc Oct 04 18:48:14.141583 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:48:14.141583 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:48:14.141583 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:48:14.141583 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:48:14.141583 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:48:14.141583 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:48:14.141583 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: b6c6b9deecde44b5953d22b38b5b0ff1 Oct 04 18:48:14.141583 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:48:14.141583 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:48:14.141583 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:48:14.141583 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6c6b9deecde44b5953d22b38b5b0ff1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b6c6b9deecde44b5953d22b38b5b0ff1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b6c6b9deecde44b5953d22b38b5b0ff1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6c6b9deecde44b5953d22b38b5b0ff1"}]}] Oct 04 18:48:14.141583 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:48:14.141583 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: b6c6b9deecde44b5953d22b38b5b0ff1 Oct 04 18:48:14.141583 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:48:14.141583 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ServersNegativeTestJSON-626077540-project Oct 04 18:48:14.141583 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:48:14.141583 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:48:14.141583 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 5b4eb70f22ba4872b890a4f160cc1805 Oct 04 18:48:14.141583 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ServersNegativeTestJSON-626077540-project Oct 04 18:48:14.141583 n-d-850501-14 devstack@n-api.service[123001]: Oct 04 18:48:14.141583 n-d-850501-14 devstack@n-api.service[123001]: {"server": {"name": "", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": [{"uuid": "334d1b7e-7632-43fb-8807-6117cf357d4f"}]}} Oct 04 18:48:14.141583 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:48:14.141583 n-d-850501-14 devstack@n-api.service[123001]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 04 18:48:14.141583 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'body': {'server': {'name': '', 'imageRef': 'f545e662-10b3-46b1-88bb-6e66dd294559', 'flavorRef': '452', 'networks': [{'uuid': '334d1b7e-7632-43fb-8807-6117cf357d4f'}]}}} Oct 04 18:48:14.141583 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:48:14.141583 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:14.141583 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:48:14.141583 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:48:14.141583 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:48:14.141583 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:48:14.141583 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 04 18:48:14.141583 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:48:14.141583 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 04 18:48:14.141583 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 18:48:14.141583 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:48:14.141583 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 18:48:14.141583 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi '' Oct 04 18:48:14.141583 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:48:14.141583 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:48:14.141583 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:48:14.141583 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:14.141583 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:48:14.141583 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:48:14.141583 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:48:14.141583 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:48:14.141583 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:48:14.141583 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:48:14.141583 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:48:14.141583 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:48:14.141583 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:48:14.141583 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:48:14.141583 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:48:14.141583 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:48:14.141583 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:48:14.147589 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:48:14.147589 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 04 18:48:14.147589 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:48:14.147589 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:48:14.147589 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:48:14.147589 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:14.147589 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:48:14.147589 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:48:14.147589 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:48:14.147589 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:48:14.147589 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 04 18:48:14.147589 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:48:14.147589 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2ae7a9a4-7471-4541-961e-742042f9ab14 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:48:14.151433 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2ae7a9a4-7471-4541-961e-742042f9ab14 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.019341 Oct 04 18:48:14.155375 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2319/4574] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:48:14 2022] POST /compute/v2.1/servers => generated 108 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 04 18:48:14.182001 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-61af3f2d-dc18-46f2-98f2-9f5b47e53526 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:14.186170 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-61af3f2d-dc18-46f2-98f2-9f5b47e53526 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:14.205835 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-61af3f2d-dc18-46f2-98f2-9f5b47e53526 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:14.208922 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-61af3f2d-dc18-46f2-98f2-9f5b47e53526 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:14.210494 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-61af3f2d-dc18-46f2-98f2-9f5b47e53526 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:14.212129 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-61af3f2d-dc18-46f2-98f2-9f5b47e53526 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:14.215484 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-61af3f2d-dc18-46f2-98f2-9f5b47e53526 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:14.216251 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-61af3f2d-dc18-46f2-98f2-9f5b47e53526 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:14.721732 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0463c5b1-6d1b-4972-9070-e8465d35e139 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:14.765473 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0463c5b1-6d1b-4972-9070-e8465d35e139 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:14.773607 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0463c5b1-6d1b-4972-9070-e8465d35e139 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:14.778592 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0463c5b1-6d1b-4972-9070-e8465d35e139 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] 10.222.0.20 "GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6" status: 200 len: 1880 microversion: 2.32 time: 0.945676 Oct 04 18:48:14.791110 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2256/4575] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:48:13 2022] GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6 => generated 1880 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:48:14.816867 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-09d548ab-55e2-40d9-b08b-259e7c1ce54c tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:14.821831 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-09d548ab-55e2-40d9-b08b-259e7c1ce54c tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: 406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:14.844978 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-09d548ab-55e2-40d9-b08b-259e7c1ce54c tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:14.846181 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-09d548ab-55e2-40d9-b08b-259e7c1ce54c tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:14.847723 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-09d548ab-55e2-40d9-b08b-259e7c1ce54c tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:14.849368 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-09d548ab-55e2-40d9-b08b-259e7c1ce54c tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:14.851470 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-09d548ab-55e2-40d9-b08b-259e7c1ce54c tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:14.852615 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-09d548ab-55e2-40d9-b08b-259e7c1ce54c tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:14.914469 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-61af3f2d-dc18-46f2-98f2-9f5b47e53526 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:14.922817 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-61af3f2d-dc18-46f2-98f2-9f5b47e53526 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1504 microversion: 2.1 time: 0.762140 Oct 04 18:48:14.926917 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2320/4576] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:14 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1504 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:14.959462 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-affb6c0d-ac1c-40bc-9824-5e4b4ad4ed83 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:14.960531 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-affb6c0d-ac1c-40bc-9824-5e4b4ad4ed83 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:14.978467 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-affb6c0d-ac1c-40bc-9824-5e4b4ad4ed83 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:14.979680 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-affb6c0d-ac1c-40bc-9824-5e4b4ad4ed83 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:14.980557 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-affb6c0d-ac1c-40bc-9824-5e4b4ad4ed83 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:14.981578 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-affb6c0d-ac1c-40bc-9824-5e4b4ad4ed83 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:14.982258 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-affb6c0d-ac1c-40bc-9824-5e4b4ad4ed83 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:14.982963 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-affb6c0d-ac1c-40bc-9824-5e4b4ad4ed83 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:15.401503 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-affb6c0d-ac1c-40bc-9824-5e4b4ad4ed83 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:15.416092 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-affb6c0d-ac1c-40bc-9824-5e4b4ad4ed83 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1504 microversion: 2.1 time: 0.459770 Oct 04 18:48:15.419470 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2321/4577] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:14 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1504 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:15.444376 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-66e557e0-f5a1-4005-bf8d-c7841966c790 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:48:15.445064 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-66e557e0-f5a1-4005-bf8d-c7841966c790 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: cc7e7428-cc90-4610-a47d-613676ded559] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:15.457193 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-66e557e0-f5a1-4005-bf8d-c7841966c790 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] HTTP exception thrown: Instance cc7e7428-cc90-4610-a47d-613676ded559 could not be found. Oct 04 18:48:15.467681 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-66e557e0-f5a1-4005-bf8d-c7841966c790 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Request method failure captured: Oct 04 18:48:15.467681 n-d-850501-14 devstack@n-api.service[123001]: request: POST /compute/v2.1/servers/cc7e7428-cc90-4610-a47d-613676ded559/action HTTP/1.1 Oct 04 18:48:15.467681 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:48:15.467681 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:48:15.467681 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:48:15.467681 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 14 Oct 04 18:48:15.467681 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:48:15.467681 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:48:15.467681 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:48:15.467681 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:48:15.467681 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPH9zAVdj2h4kh6QqBpYrS2CJMhbcXf529VUNrZoZOYhS2tkLYBgw6AHy860DK9jQ3xATqZvC9lQuxt-_H5qKsAI41eznf32K6QSGqVcHXegpVHrDueww23ZMVCBM3D_hH0NTzh4447rgHqcrC-OZE48IfZrRJ9KPLPjAHT57T3mcPIc Oct 04 18:48:15.467681 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:48:15.467681 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:48:15.467681 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:48:15.467681 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:48:15.467681 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:48:15.467681 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:48:15.467681 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: b6c6b9deecde44b5953d22b38b5b0ff1 Oct 04 18:48:15.467681 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:48:15.467681 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:48:15.467681 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:48:15.467681 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6c6b9deecde44b5953d22b38b5b0ff1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b6c6b9deecde44b5953d22b38b5b0ff1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b6c6b9deecde44b5953d22b38b5b0ff1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6c6b9deecde44b5953d22b38b5b0ff1"}]}] Oct 04 18:48:15.467681 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:48:15.467681 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: b6c6b9deecde44b5953d22b38b5b0ff1 Oct 04 18:48:15.467681 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:48:15.467681 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ServersNegativeTestJSON-626077540-project Oct 04 18:48:15.467681 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:48:15.467681 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:48:15.467681 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 5b4eb70f22ba4872b890a4f160cc1805 Oct 04 18:48:15.467681 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ServersNegativeTestJSON-626077540-project Oct 04 18:48:15.467681 n-d-850501-14 devstack@n-api.service[123001]: Oct 04 18:48:15.467681 n-d-850501-14 devstack@n-api.service[123001]: {"shelve": {}} Oct 04 18:48:15.467681 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:48:15.467681 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance cc7e7428-cc90-4610-a47d-613676ded559 could not be found. Oct 04 18:48:15.467681 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': 'cc7e7428-cc90-4610-a47d-613676ded559', 'body': {'shelve': {}}} Oct 04 18:48:15.467681 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:48:15.467681 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:15.467681 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:48:15.467681 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:48:15.467681 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:48:15.467681 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:48:15.467681 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:48:15.467681 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:48:15.467681 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc7e7428-cc90-4610-a47d-613676ded559 could not be found. Oct 04 18:48:15.467681 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:48:15.467681 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:48:15.467681 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:48:15.467681 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:15.467681 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:48:15.467681 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:48:15.467681 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:48:15.467681 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:48:15.467681 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:48:15.467681 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:48:15.467681 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Oct 04 18:48:15.467681 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 04 18:48:15.467681 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:48:15.467681 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:48:15.467681 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc7e7428-cc90-4610-a47d-613676ded559 could not be found. Oct 04 18:48:15.467681 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:48:15.467681 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:48:15.467681 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:48:15.467681 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:15.467681 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:48:15.467681 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:48:15.477047 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:48:15.477047 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:48:15.477047 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc7e7428-cc90-4610-a47d-613676ded559 could not be found. Oct 04 18:48:15.477047 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:48:15.477047 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-66e557e0-f5a1-4005-bf8d-c7841966c790 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Returning 404 to user: Instance cc7e7428-cc90-4610-a47d-613676ded559 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:48:15.477047 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-66e557e0-f5a1-4005-bf8d-c7841966c790 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "POST /compute/v2.1/servers/cc7e7428-cc90-4610-a47d-613676ded559/action" status: 404 len: 111 microversion: 2.1 time: 0.031984 Oct 04 18:48:15.477047 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2322/4578] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:48:15 2022] POST /compute/v2.1/servers/cc7e7428-cc90-4610-a47d-613676ded559/action => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:48:15.482258 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-551bd260-2d86-491c-ac45-451340a6b820 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:15.482897 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-551bd260-2d86-491c-ac45-451340a6b820 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:15.502424 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-551bd260-2d86-491c-ac45-451340a6b820 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:15.504772 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-551bd260-2d86-491c-ac45-451340a6b820 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:15.505302 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-551bd260-2d86-491c-ac45-451340a6b820 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:15.506336 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-551bd260-2d86-491c-ac45-451340a6b820 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:15.508520 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-551bd260-2d86-491c-ac45-451340a6b820 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:15.509884 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-551bd260-2d86-491c-ac45-451340a6b820 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:16.142003 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-09d548ab-55e2-40d9-b08b-259e7c1ce54c tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:16.171692 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-09d548ab-55e2-40d9-b08b-259e7c1ce54c tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a" status: 200 len: 1222 microversion: 2.1 time: 1.376789 Oct 04 18:48:16.183275 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2257/4579] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:14 2022] GET /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a => generated 1222 bytes in 1391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:16.217294 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-29ba7719-0c13-4310-b835-22cabb1cacaf tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:16.219371 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-29ba7719-0c13-4310-b835-22cabb1cacaf tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] [instance: 317c7bd8-4f1e-4210-bb33-087557a1f4d6] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:16.251511 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-29ba7719-0c13-4310-b835-22cabb1cacaf tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:16.261751 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-29ba7719-0c13-4310-b835-22cabb1cacaf tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:16.262328 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-29ba7719-0c13-4310-b835-22cabb1cacaf tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:16.264705 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-29ba7719-0c13-4310-b835-22cabb1cacaf tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:16.265491 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-29ba7719-0c13-4310-b835-22cabb1cacaf tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:16.270367 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-29ba7719-0c13-4310-b835-22cabb1cacaf tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:16.614811 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-551bd260-2d86-491c-ac45-451340a6b820 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:16.642015 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-551bd260-2d86-491c-ac45-451340a6b820 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1504 microversion: 2.1 time: 1.163366 Oct 04 18:48:16.643296 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2323/4580] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:15 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1504 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:48:16.673581 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-54c0eaba-4faa-4427-9db1-6d186d1d699b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:16.674217 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-54c0eaba-4faa-4427-9db1-6d186d1d699b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:16.688851 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-54c0eaba-4faa-4427-9db1-6d186d1d699b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:16.692455 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-54c0eaba-4faa-4427-9db1-6d186d1d699b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:16.708480 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-54c0eaba-4faa-4427-9db1-6d186d1d699b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:16.709293 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-54c0eaba-4faa-4427-9db1-6d186d1d699b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:16.712358 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-54c0eaba-4faa-4427-9db1-6d186d1d699b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:16.714395 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-54c0eaba-4faa-4427-9db1-6d186d1d699b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:17.680094 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-29ba7719-0c13-4310-b835-22cabb1cacaf tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:17.692933 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-29ba7719-0c13-4310-b835-22cabb1cacaf tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:17.694511 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-29ba7719-0c13-4310-b835-22cabb1cacaf tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:17.695743 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-29ba7719-0c13-4310-b835-22cabb1cacaf tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] 10.222.0.20 "GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6" status: 200 len: 1880 microversion: 2.32 time: 1.507710 Oct 04 18:48:17.716123 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2258/4581] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:48:16 2022] GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6 => generated 1880 bytes in 1531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:48:17.734592 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-11e0eb00-5a17-4707-a87f-5830b98c5e29 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:17.741320 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-11e0eb00-5a17-4707-a87f-5830b98c5e29 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: 406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:17.773236 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-11e0eb00-5a17-4707-a87f-5830b98c5e29 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:17.775947 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-11e0eb00-5a17-4707-a87f-5830b98c5e29 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:17.789207 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-11e0eb00-5a17-4707-a87f-5830b98c5e29 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:17.790186 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-11e0eb00-5a17-4707-a87f-5830b98c5e29 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:17.792694 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-11e0eb00-5a17-4707-a87f-5830b98c5e29 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:17.795679 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-11e0eb00-5a17-4707-a87f-5830b98c5e29 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:17.938810 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-11e0eb00-5a17-4707-a87f-5830b98c5e29 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:17.945140 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-54c0eaba-4faa-4427-9db1-6d186d1d699b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:17.950866 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-11e0eb00-5a17-4707-a87f-5830b98c5e29 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a" status: 200 len: 1276 microversion: 2.1 time: 0.230572 Oct 04 18:48:17.956326 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-54c0eaba-4faa-4427-9db1-6d186d1d699b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1504 microversion: 2.1 time: 1.288446 Oct 04 18:48:17.959081 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2324/4582] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:16 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1504 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:48:17.965162 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2259/4583] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:17 2022] GET /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a => generated 1276 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:17.999943 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5c2e4c61-eb37-4ba1-85f8-b6d3573c3c67 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:48:18.000667 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5c2e4c61-eb37-4ba1-85f8-b6d3573c3c67 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:18.021989 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5c2e4c61-eb37-4ba1-85f8-b6d3573c3c67 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:18.022491 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5c2e4c61-eb37-4ba1-85f8-b6d3573c3c67 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:18.022933 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5c2e4c61-eb37-4ba1-85f8-b6d3573c3c67 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:18.023652 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5c2e4c61-eb37-4ba1-85f8-b6d3573c3c67 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:18.031435 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5c2e4c61-eb37-4ba1-85f8-b6d3573c3c67 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:18.032130 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5c2e4c61-eb37-4ba1-85f8-b6d3573c3c67 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:18.093139 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=100 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:48:18.105523 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-5c2e4c61-eb37-4ba1-85f8-b6d3573c3c67 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lazy-loading 'flavor' on Instance uuid 95fb1a13-7441-4f74-ad81-5a9413496545 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:48:18.747235 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-52cedde9-7eb6-4ca1-a246-81415d5a6f18 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:18.748282 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-52cedde9-7eb6-4ca1-a246-81415d5a6f18 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] [instance: 317c7bd8-4f1e-4210-bb33-087557a1f4d6] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:18.770200 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-52cedde9-7eb6-4ca1-a246-81415d5a6f18 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:18.772549 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-52cedde9-7eb6-4ca1-a246-81415d5a6f18 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:18.774406 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-52cedde9-7eb6-4ca1-a246-81415d5a6f18 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:18.778626 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-52cedde9-7eb6-4ca1-a246-81415d5a6f18 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:18.780023 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-52cedde9-7eb6-4ca1-a246-81415d5a6f18 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:18.782317 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-52cedde9-7eb6-4ca1-a246-81415d5a6f18 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:19.003015 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5c2e4c61-eb37-4ba1-85f8-b6d3573c3c67 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "POST /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545/action" status: 202 len: 0 microversion: 2.1 time: 1.019186 Oct 04 18:48:19.023529 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2325/4584] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:48:17 2022] POST /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545/action => generated 0 bytes in 1038 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:48:19.043240 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-51e8dce9-87e1-459a-a987-1013639c1a74 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:19.047766 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-51e8dce9-87e1-459a-a987-1013639c1a74 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: 406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:19.074471 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-51e8dce9-87e1-459a-a987-1013639c1a74 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:19.074471 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-51e8dce9-87e1-459a-a987-1013639c1a74 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:19.074471 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-51e8dce9-87e1-459a-a987-1013639c1a74 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:19.077299 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-51e8dce9-87e1-459a-a987-1013639c1a74 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:19.078548 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-51e8dce9-87e1-459a-a987-1013639c1a74 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:19.079691 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-51e8dce9-87e1-459a-a987-1013639c1a74 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:20.532738 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-52cedde9-7eb6-4ca1-a246-81415d5a6f18 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:20.553190 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-52cedde9-7eb6-4ca1-a246-81415d5a6f18 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:20.556843 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-52cedde9-7eb6-4ca1-a246-81415d5a6f18 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:20.568143 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-52cedde9-7eb6-4ca1-a246-81415d5a6f18 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] 10.222.0.20 "GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6" status: 200 len: 1880 microversion: 2.32 time: 1.824220 Oct 04 18:48:20.576166 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2260/4585] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:48:18 2022] GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6 => generated 1880 bytes in 1834 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:48:20.586698 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9d14995a-c80f-42eb-a893-33951cd4617f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:20.601368 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9d14995a-c80f-42eb-a893-33951cd4617f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:20.620134 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9d14995a-c80f-42eb-a893-33951cd4617f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:20.621759 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9d14995a-c80f-42eb-a893-33951cd4617f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:20.624658 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9d14995a-c80f-42eb-a893-33951cd4617f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:20.627358 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9d14995a-c80f-42eb-a893-33951cd4617f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:20.632440 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9d14995a-c80f-42eb-a893-33951cd4617f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:20.633215 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9d14995a-c80f-42eb-a893-33951cd4617f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:21.244168 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-51e8dce9-87e1-459a-a987-1013639c1a74 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:21.252455 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-51e8dce9-87e1-459a-a987-1013639c1a74 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a" status: 200 len: 1318 microversion: 2.1 time: 2.227980 Oct 04 18:48:21.275349 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2326/4586] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:19 2022] GET /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a => generated 1318 bytes in 2254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:21.808695 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:48:21.882226 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9d14995a-c80f-42eb-a893-33951cd4617f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:21.898052 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9d14995a-c80f-42eb-a893-33951cd4617f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1510 microversion: 2.1 time: 1.318361 Oct 04 18:48:21.904354 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2261/4587] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:20 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1510 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:21.918632 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-fa774f5a-cb45-454e-8eca-55c83799261b tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:21.930306 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-fa774f5a-cb45-454e-8eca-55c83799261b tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] [instance: 317c7bd8-4f1e-4210-bb33-087557a1f4d6] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:21.955389 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fa774f5a-cb45-454e-8eca-55c83799261b tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:21.971720 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fa774f5a-cb45-454e-8eca-55c83799261b tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:21.972691 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fa774f5a-cb45-454e-8eca-55c83799261b tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:21.975196 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fa774f5a-cb45-454e-8eca-55c83799261b tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:21.976634 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fa774f5a-cb45-454e-8eca-55c83799261b tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:21.984799 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fa774f5a-cb45-454e-8eca-55c83799261b tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:22.011031 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-f40cb25e-253d-487b-82bb-e98c59df8afd req-751013d7-6ab4-444a-bb10-7c24ee7a1067 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a", "tag": "25667d58-f07b-4faa-8414-20c890cec66d"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:48:22.038433 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-f40cb25e-253d-487b-82bb-e98c59df8afd req-751013d7-6ab4-444a-bb10-7c24ee7a1067 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:22.038433 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-f40cb25e-253d-487b-82bb-e98c59df8afd req-751013d7-6ab4-444a-bb10-7c24ee7a1067 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:22.045207 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-f40cb25e-253d-487b-82bb-e98c59df8afd req-751013d7-6ab4-444a-bb10-7c24ee7a1067 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:22.084023 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-f40cb25e-253d-487b-82bb-e98c59df8afd req-751013d7-6ab4-444a-bb10-7c24ee7a1067 service nova] Creating event network-changed:25667d58-f07b-4faa-8414-20c890cec66d for instance 406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a on n-h2-850501-14 Oct 04 18:48:22.100953 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-f40cb25e-253d-487b-82bb-e98c59df8afd req-751013d7-6ab4-444a-bb10-7c24ee7a1067 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.723523 Oct 04 18:48:22.101583 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2327/4588] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:48:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:48:22.283569 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f793635c-fa11-456f-be52-b6437e444e2f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:22.284314 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f793635c-fa11-456f-be52-b6437e444e2f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: 406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:22.297199 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f793635c-fa11-456f-be52-b6437e444e2f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:22.299470 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f793635c-fa11-456f-be52-b6437e444e2f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:22.301757 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f793635c-fa11-456f-be52-b6437e444e2f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:22.303373 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f793635c-fa11-456f-be52-b6437e444e2f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:22.306089 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f793635c-fa11-456f-be52-b6437e444e2f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:22.307394 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f793635c-fa11-456f-be52-b6437e444e2f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:22.398235 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=8 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:48:23.419217 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-fa774f5a-cb45-454e-8eca-55c83799261b tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:23.419217 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-fa774f5a-cb45-454e-8eca-55c83799261b tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:23.419217 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-fa774f5a-cb45-454e-8eca-55c83799261b tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:23.419217 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-fa774f5a-cb45-454e-8eca-55c83799261b tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] 10.222.0.20 "GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6" status: 200 len: 1880 microversion: 2.32 time: 1.494251 Oct 04 18:48:23.422004 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2262/4589] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:48:21 2022] GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6 => generated 1880 bytes in 1516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:48:23.434215 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-547c0f6f-b45c-4232-8900-8540f2b19219 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:23.434599 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-547c0f6f-b45c-4232-8900-8540f2b19219 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:23.446829 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-547c0f6f-b45c-4232-8900-8540f2b19219 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:23.447380 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-547c0f6f-b45c-4232-8900-8540f2b19219 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:23.448136 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-547c0f6f-b45c-4232-8900-8540f2b19219 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:23.449088 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-547c0f6f-b45c-4232-8900-8540f2b19219 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:23.449784 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-547c0f6f-b45c-4232-8900-8540f2b19219 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:23.450487 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-547c0f6f-b45c-4232-8900-8540f2b19219 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:23.609401 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f793635c-fa11-456f-be52-b6437e444e2f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:23.633002 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f793635c-fa11-456f-be52-b6437e444e2f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a" status: 200 len: 1318 microversion: 2.1 time: 1.353689 Oct 04 18:48:23.634124 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2328/4590] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:22 2022] GET /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a => generated 1318 bytes in 1356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:23.800035 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-547c0f6f-b45c-4232-8900-8540f2b19219 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:23.813557 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-547c0f6f-b45c-4232-8900-8540f2b19219 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1510 microversion: 2.1 time: 0.390120 Oct 04 18:48:23.814473 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2263/4591] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:23 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1510 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:24.447160 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5b7bc51b-1633-4786-8448-3dc918782114 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:24.470496 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5b7bc51b-1633-4786-8448-3dc918782114 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] [instance: 317c7bd8-4f1e-4210-bb33-087557a1f4d6] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:24.528973 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:48:24.544314 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5b7bc51b-1633-4786-8448-3dc918782114 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:24.551364 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5b7bc51b-1633-4786-8448-3dc918782114 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:24.556811 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5b7bc51b-1633-4786-8448-3dc918782114 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:24.560225 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5b7bc51b-1633-4786-8448-3dc918782114 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:24.564200 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5b7bc51b-1633-4786-8448-3dc918782114 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:24.570149 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5b7bc51b-1633-4786-8448-3dc918782114 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:24.658955 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-cd0fe0d2-cd6a-4a28-99d1-c259296ec3a8 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:24.661340 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-cd0fe0d2-cd6a-4a28-99d1-c259296ec3a8 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: 406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:24.675945 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cd0fe0d2-cd6a-4a28-99d1-c259296ec3a8 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:24.678101 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cd0fe0d2-cd6a-4a28-99d1-c259296ec3a8 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:24.678730 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cd0fe0d2-cd6a-4a28-99d1-c259296ec3a8 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:24.681543 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cd0fe0d2-cd6a-4a28-99d1-c259296ec3a8 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:24.682214 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cd0fe0d2-cd6a-4a28-99d1-c259296ec3a8 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:24.683634 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cd0fe0d2-cd6a-4a28-99d1-c259296ec3a8 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:25.523179 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-cd0fe0d2-cd6a-4a28-99d1-c259296ec3a8 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:25.533379 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-cd0fe0d2-cd6a-4a28-99d1-c259296ec3a8 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a" status: 200 len: 1318 microversion: 2.1 time: 0.879802 Oct 04 18:48:25.547578 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5b7bc51b-1633-4786-8448-3dc918782114 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:25.552797 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2264/4592] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:24 2022] GET /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a => generated 1318 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:48:25.588970 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5b7bc51b-1633-4786-8448-3dc918782114 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:25.594233 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-adcc5529-7787-452b-bbfc-710a1eea51c2 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:25.595280 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-adcc5529-7787-452b-bbfc-710a1eea51c2 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:25.605536 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-adcc5529-7787-452b-bbfc-710a1eea51c2 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:25.607491 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-adcc5529-7787-452b-bbfc-710a1eea51c2 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:25.608012 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5b7bc51b-1633-4786-8448-3dc918782114 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:25.608396 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-adcc5529-7787-452b-bbfc-710a1eea51c2 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:25.609287 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-adcc5529-7787-452b-bbfc-710a1eea51c2 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:25.611188 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-adcc5529-7787-452b-bbfc-710a1eea51c2 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:25.611806 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-adcc5529-7787-452b-bbfc-710a1eea51c2 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:25.614790 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5b7bc51b-1633-4786-8448-3dc918782114 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] 10.222.0.20 "GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6" status: 200 len: 1880 microversion: 2.32 time: 1.178547 Oct 04 18:48:25.616591 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2329/4593] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:48:24 2022] GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6 => generated 1880 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:48:25.971949 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-adcc5529-7787-452b-bbfc-710a1eea51c2 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:25.976236 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:48:25.989478 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-adcc5529-7787-452b-bbfc-710a1eea51c2 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1510 microversion: 2.1 time: 0.427990 Oct 04 18:48:26.021610 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2265/4594] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:25 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1510 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:26.573004 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-79f93f41-cca4-4536-9036-e29bf6c97f1d tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:26.574249 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-79f93f41-cca4-4536-9036-e29bf6c97f1d tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: 406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:26.591610 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-79f93f41-cca4-4536-9036-e29bf6c97f1d tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:26.593260 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-79f93f41-cca4-4536-9036-e29bf6c97f1d tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:26.593751 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-79f93f41-cca4-4536-9036-e29bf6c97f1d tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:26.594634 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-79f93f41-cca4-4536-9036-e29bf6c97f1d tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:26.596694 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-79f93f41-cca4-4536-9036-e29bf6c97f1d tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:26.598680 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-79f93f41-cca4-4536-9036-e29bf6c97f1d tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:26.650431 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-01d2b344-1e9c-422f-8963-8212f42cdab1 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:26.651307 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-01d2b344-1e9c-422f-8963-8212f42cdab1 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] [instance: 317c7bd8-4f1e-4210-bb33-087557a1f4d6] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:26.671636 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-01d2b344-1e9c-422f-8963-8212f42cdab1 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:26.678181 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-01d2b344-1e9c-422f-8963-8212f42cdab1 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:26.679846 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-01d2b344-1e9c-422f-8963-8212f42cdab1 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:26.681236 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-01d2b344-1e9c-422f-8963-8212f42cdab1 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:26.685154 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-01d2b344-1e9c-422f-8963-8212f42cdab1 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:26.685805 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-01d2b344-1e9c-422f-8963-8212f42cdab1 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:27.118693 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-79f93f41-cca4-4536-9036-e29bf6c97f1d tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:27.133100 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-79f93f41-cca4-4536-9036-e29bf6c97f1d tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a" status: 200 len: 1318 microversion: 2.1 time: 0.564966 Oct 04 18:48:27.136882 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2330/4595] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:26 2022] GET /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a => generated 1318 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:27.252439 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-01d2b344-1e9c-422f-8963-8212f42cdab1 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:27.285886 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-01d2b344-1e9c-422f-8963-8212f42cdab1 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:27.305999 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-01d2b344-1e9c-422f-8963-8212f42cdab1 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:27.307334 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-01d2b344-1e9c-422f-8963-8212f42cdab1 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] 10.222.0.20 "GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6" status: 200 len: 1880 microversion: 2.32 time: 0.662205 Oct 04 18:48:27.316020 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2266/4596] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:48:26 2022] GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6 => generated 1880 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:48:27.329171 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-88fdc9fd-422e-46f3-8fd6-b2dd2c5b500d tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:27.334819 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-88fdc9fd-422e-46f3-8fd6-b2dd2c5b500d tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:27.362207 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-88fdc9fd-422e-46f3-8fd6-b2dd2c5b500d tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:27.362757 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-88fdc9fd-422e-46f3-8fd6-b2dd2c5b500d tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:27.371417 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-88fdc9fd-422e-46f3-8fd6-b2dd2c5b500d tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:27.374096 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-88fdc9fd-422e-46f3-8fd6-b2dd2c5b500d tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:27.375431 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-88fdc9fd-422e-46f3-8fd6-b2dd2c5b500d tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:27.376505 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-88fdc9fd-422e-46f3-8fd6-b2dd2c5b500d tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:27.635322 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1a25a1af-7c59-420e-aeec-df24b2c46229 tempest-FloatingIPDetailsNegativeTestJSON-1362770338 tempest-FloatingIPDetailsNegativeTestJSON-1362770338-project] Calling method '.version_select at 0x7fe258b11ee0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:27.876474 n-d-850501-14 devstack@n-api.service[123001]: DEBUG neutronclient.v2_0.client [None req-1a25a1af-7c59-420e-aeec-df24b2c46229 tempest-FloatingIPDetailsNegativeTestJSON-1362770338 tempest-FloatingIPDetailsNegativeTestJSON-1362770338-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP c79308f0-ac57-42dd-b07a-73b439a2ffb7 could not be found", "detail": ""}} {{(pid=123001) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:48:27.881719 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-1a25a1af-7c59-420e-aeec-df24b2c46229 tempest-FloatingIPDetailsNegativeTestJSON-1362770338 tempest-FloatingIPDetailsNegativeTestJSON-1362770338-project] HTTP exception thrown: Floating IP not found for ID c79308f0-ac57-42dd-b07a-73b439a2ffb7 Oct 04 18:48:27.885352 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1a25a1af-7c59-420e-aeec-df24b2c46229 tempest-FloatingIPDetailsNegativeTestJSON-1362770338 tempest-FloatingIPDetailsNegativeTestJSON-1362770338-project] Request method failure captured: Oct 04 18:48:27.885352 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/os-floating-ips/c79308f0-ac57-42dd-b07a-73b439a2ffb7 HTTP/1.1 Oct 04 18:48:27.885352 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:48:27.885352 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:48:27.885352 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:48:27.885352 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:48:27.885352 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:48:27.885352 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:48:27.885352 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:48:27.885352 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:48:27.885352 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPH_6SdoVHdXUQQ3FmFkEBa0h7g1WyZVtn1K_3Z7-AYXy6LGhK4Am9371uRYfd-VIPDv6SLBIdj70PWySda3Yp3a6KVPVo5CPmHrMFOft7pq8TVBIJKN8wUHwMJ-m3DRKf4NWd4HskFXM44u3VutPPUk_qYYeSISN4g9KMbwOcMFovZQ Oct 04 18:48:27.885352 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:48:27.885352 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:48:27.885352 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:48:27.885352 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:48:27.885352 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:48:27.885352 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:48:27.885352 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 302430cb460f4f1f88a29cbbd56462d4 Oct 04 18:48:27.885352 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-1362770338 Oct 04 18:48:27.885352 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:48:27.885352 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:48:27.885352 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/302430cb460f4f1f88a29cbbd56462d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_302430cb460f4f1f88a29cbbd56462d4", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/302430cb460f4f1f88a29cbbd56462d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/302430cb460f4f1f88a29cbbd56462d4"}]}] Oct 04 18:48:27.885352 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-1362770338 Oct 04 18:48:27.885352 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 302430cb460f4f1f88a29cbbd56462d4 Oct 04 18:48:27.885352 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-1362770338 Oct 04 18:48:27.885352 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-1362770338-project Oct 04 18:48:27.885352 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:48:27.885352 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:48:27.885352 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 7c257d5ed8504cdaaa7d8daab053ef4f Oct 04 18:48:27.885352 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-1362770338-project Oct 04 18:48:27.885352 n-d-850501-14 devstack@n-api.service[123001]: method: Oct 04 18:48:27.885352 n-d-850501-14 devstack@n-api.service[123001]: exception: Floating IP not found for ID c79308f0-ac57-42dd-b07a-73b439a2ffb7 Oct 04 18:48:27.885352 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': 'c79308f0-ac57-42dd-b07a-73b439a2ffb7'} Oct 04 18:48:27.885352 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:48:27.885352 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:27.885352 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 04 18:48:27.885352 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 04 18:48:27.885352 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:48:27.885352 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:48:27.885352 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 04 18:48:27.885352 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 04 18:48:27.885352 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:48:27.885352 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:48:27.885352 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:48:27.885352 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 18:48:27.885352 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:48:27.885352 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:48:27.885352 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:48:27.885352 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:48:27.885352 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:48:27.885352 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:48:27.885352 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:48:27.885352 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:48:27.885352 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:48:27.885352 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:48:27.885352 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:48:27.885352 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:48:27.885352 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:48:27.885352 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:48:27.885352 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP c79308f0-ac57-42dd-b07a-73b439a2ffb7 could not be found Oct 04 18:48:27.890052 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7428b085-0ae9-4c3c-8178-f2702fcc6750'] Oct 04 18:48:27.890052 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:48:27.890052 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:48:27.890052 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:48:27.890052 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:27.890052 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 04 18:48:27.890052 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 04 18:48:27.890052 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 04 18:48:27.890052 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 04 18:48:27.890052 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID c79308f0-ac57-42dd-b07a-73b439a2ffb7. Oct 04 18:48:27.890052 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:48:27.890052 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:48:27.890052 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:48:27.890052 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:27.890052 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:48:27.890052 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:48:27.890052 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:48:27.890052 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:48:27.890052 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:48:27.890052 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:48:27.890052 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:48:27.890052 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:48:27.890052 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 04 18:48:27.890052 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 18:48:27.890052 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID c79308f0-ac57-42dd-b07a-73b439a2ffb7 Oct 04 18:48:27.890052 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:48:27.890052 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:48:27.890052 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:48:27.890052 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:27.890052 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:48:27.890052 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:48:27.890052 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:48:27.890052 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:48:27.890052 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID c79308f0-ac57-42dd-b07a-73b439a2ffb7 Oct 04 18:48:27.890052 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:48:27.893579 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1a25a1af-7c59-420e-aeec-df24b2c46229 tempest-FloatingIPDetailsNegativeTestJSON-1362770338 tempest-FloatingIPDetailsNegativeTestJSON-1362770338-project] Returning 404 to user: Floating IP not found for ID c79308f0-ac57-42dd-b07a-73b439a2ffb7 {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:48:27.894988 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1a25a1af-7c59-420e-aeec-df24b2c46229 tempest-FloatingIPDetailsNegativeTestJSON-1362770338 tempest-FloatingIPDetailsNegativeTestJSON-1362770338-project] 10.222.0.20 "GET /compute/v2.1/os-floating-ips/c79308f0-ac57-42dd-b07a-73b439a2ffb7" status: 404 len: 111 microversion: 2.1 time: 0.756834 Oct 04 18:48:27.896130 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2331/4597] 10.222.0.20 () {58 vars in 1260 bytes} [Tue Oct 4 18:48:27 2022] GET /compute/v2.1/os-floating-ips/c79308f0-ac57-42dd-b07a-73b439a2ffb7 => generated 111 bytes in 758 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:48:27.976730 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-88fdc9fd-422e-46f3-8fd6-b2dd2c5b500d tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:27.989386 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-88fdc9fd-422e-46f3-8fd6-b2dd2c5b500d tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1510 microversion: 2.1 time: 0.670929 Oct 04 18:48:27.997124 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2267/4598] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:27 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1510 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:28.159464 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-87eada3c-5d04-4b36-9391-259f4897b37d tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:28.160310 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-87eada3c-5d04-4b36-9391-259f4897b37d tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: 406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:28.163620 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=90 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:48:28.175405 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-87eada3c-5d04-4b36-9391-259f4897b37d tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:28.177789 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-87eada3c-5d04-4b36-9391-259f4897b37d tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:28.178442 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-87eada3c-5d04-4b36-9391-259f4897b37d tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:28.180181 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-87eada3c-5d04-4b36-9391-259f4897b37d tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:28.183559 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-87eada3c-5d04-4b36-9391-259f4897b37d tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:28.184435 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-87eada3c-5d04-4b36-9391-259f4897b37d tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:28.340468 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-fc84152e-5d96-402c-b1fc-5fa4078e781a tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:28.341596 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-fc84152e-5d96-402c-b1fc-5fa4078e781a tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] [instance: 317c7bd8-4f1e-4210-bb33-087557a1f4d6] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:28.366190 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fc84152e-5d96-402c-b1fc-5fa4078e781a tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:28.371276 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fc84152e-5d96-402c-b1fc-5fa4078e781a tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:28.374127 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fc84152e-5d96-402c-b1fc-5fa4078e781a tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:28.374956 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fc84152e-5d96-402c-b1fc-5fa4078e781a tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:28.375356 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fc84152e-5d96-402c-b1fc-5fa4078e781a tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:28.375785 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fc84152e-5d96-402c-b1fc-5fa4078e781a tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:28.795976 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-87eada3c-5d04-4b36-9391-259f4897b37d tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:28.818690 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-87eada3c-5d04-4b36-9391-259f4897b37d tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a" status: 200 len: 1318 microversion: 2.1 time: 0.659254 Oct 04 18:48:28.819002 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2332/4599] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:28 2022] GET /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a => generated 1318 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:28.971708 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-fc84152e-5d96-402c-b1fc-5fa4078e781a tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:28.984679 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-fc84152e-5d96-402c-b1fc-5fa4078e781a tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:28.989302 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-fc84152e-5d96-402c-b1fc-5fa4078e781a tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:28.996221 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-fc84152e-5d96-402c-b1fc-5fa4078e781a tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] 10.222.0.20 "GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6" status: 200 len: 1880 microversion: 2.32 time: 0.662275 Oct 04 18:48:29.023860 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f83a7b8f-dac2-4296-a6b2-69588e0e7ba8 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:29.024806 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f83a7b8f-dac2-4296-a6b2-69588e0e7ba8 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:29.028813 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2268/4600] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:48:28 2022] GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6 => generated 1880 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:48:29.036417 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f83a7b8f-dac2-4296-a6b2-69588e0e7ba8 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:29.037370 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f83a7b8f-dac2-4296-a6b2-69588e0e7ba8 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:29.038006 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f83a7b8f-dac2-4296-a6b2-69588e0e7ba8 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:29.039482 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f83a7b8f-dac2-4296-a6b2-69588e0e7ba8 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:29.040128 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f83a7b8f-dac2-4296-a6b2-69588e0e7ba8 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:29.046063 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f83a7b8f-dac2-4296-a6b2-69588e0e7ba8 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:29.518875 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f83a7b8f-dac2-4296-a6b2-69588e0e7ba8 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:29.544210 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f83a7b8f-dac2-4296-a6b2-69588e0e7ba8 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1510 microversion: 2.1 time: 0.512598 Oct 04 18:48:29.544210 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2333/4601] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:29 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1510 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:48:29.846964 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3958d803-b569-4d2f-8fae-e412f34a8633 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:29.848293 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3958d803-b569-4d2f-8fae-e412f34a8633 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: 406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:29.863658 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3958d803-b569-4d2f-8fae-e412f34a8633 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:29.864895 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3958d803-b569-4d2f-8fae-e412f34a8633 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:29.867255 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3958d803-b569-4d2f-8fae-e412f34a8633 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:29.871150 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3958d803-b569-4d2f-8fae-e412f34a8633 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:29.873020 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3958d803-b569-4d2f-8fae-e412f34a8633 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:29.874041 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3958d803-b569-4d2f-8fae-e412f34a8633 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:30.029675 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-def40e96-83f5-4730-9a95-79d1da6993ef tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:30.031074 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-def40e96-83f5-4730-9a95-79d1da6993ef tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] [instance: 317c7bd8-4f1e-4210-bb33-087557a1f4d6] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:30.045272 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-def40e96-83f5-4730-9a95-79d1da6993ef tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:30.048700 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-def40e96-83f5-4730-9a95-79d1da6993ef tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:30.054856 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-def40e96-83f5-4730-9a95-79d1da6993ef tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:30.056501 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-def40e96-83f5-4730-9a95-79d1da6993ef tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:30.057930 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-def40e96-83f5-4730-9a95-79d1da6993ef tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:30.063444 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-def40e96-83f5-4730-9a95-79d1da6993ef tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:30.479115 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3958d803-b569-4d2f-8fae-e412f34a8633 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:30.487239 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3958d803-b569-4d2f-8fae-e412f34a8633 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a" status: 200 len: 1318 microversion: 2.1 time: 0.645186 Oct 04 18:48:30.489924 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2269/4602] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:29 2022] GET /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a => generated 1318 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:30.558242 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d3442787-094e-439f-a536-f44904e6d422 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:30.558990 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d3442787-094e-439f-a536-f44904e6d422 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:30.574305 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d3442787-094e-439f-a536-f44904e6d422 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:30.578306 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d3442787-094e-439f-a536-f44904e6d422 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:30.580502 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d3442787-094e-439f-a536-f44904e6d422 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:30.583991 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d3442787-094e-439f-a536-f44904e6d422 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:30.585516 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d3442787-094e-439f-a536-f44904e6d422 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:30.587591 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d3442787-094e-439f-a536-f44904e6d422 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:30.694104 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-def40e96-83f5-4730-9a95-79d1da6993ef tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:30.724859 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-def40e96-83f5-4730-9a95-79d1da6993ef tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:30.736206 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-def40e96-83f5-4730-9a95-79d1da6993ef tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:30.737891 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-def40e96-83f5-4730-9a95-79d1da6993ef tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] 10.222.0.20 "GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6" status: 200 len: 1880 microversion: 2.32 time: 0.713709 Oct 04 18:48:30.741911 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2334/4603] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:48:30 2022] GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6 => generated 1880 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:48:31.469204 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d3442787-094e-439f-a536-f44904e6d422 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:31.486210 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d3442787-094e-439f-a536-f44904e6d422 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1531 microversion: 2.1 time: 0.930739 Oct 04 18:48:31.488130 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2270/4604] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:30 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1531 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:31.526148 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a89318be-f78f-486a-887a-2b495a2455bd tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:31.527376 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a89318be-f78f-486a-887a-2b495a2455bd tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: 406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:31.544324 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a89318be-f78f-486a-887a-2b495a2455bd tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:31.551693 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a89318be-f78f-486a-887a-2b495a2455bd tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:31.556176 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a89318be-f78f-486a-887a-2b495a2455bd tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:31.556176 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a89318be-f78f-486a-887a-2b495a2455bd tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:31.556176 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a89318be-f78f-486a-887a-2b495a2455bd tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:31.556176 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a89318be-f78f-486a-887a-2b495a2455bd tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:31.773320 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-362e79be-dc4e-49ec-9042-c51cc5aa4845 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:31.779058 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-362e79be-dc4e-49ec-9042-c51cc5aa4845 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] [instance: 317c7bd8-4f1e-4210-bb33-087557a1f4d6] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:31.800916 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-362e79be-dc4e-49ec-9042-c51cc5aa4845 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:31.804857 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-362e79be-dc4e-49ec-9042-c51cc5aa4845 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:31.806185 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-362e79be-dc4e-49ec-9042-c51cc5aa4845 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:31.811022 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-362e79be-dc4e-49ec-9042-c51cc5aa4845 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:31.811604 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-362e79be-dc4e-49ec-9042-c51cc5aa4845 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:31.812758 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-362e79be-dc4e-49ec-9042-c51cc5aa4845 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:32.034802 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a89318be-f78f-486a-887a-2b495a2455bd tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:32.052136 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a89318be-f78f-486a-887a-2b495a2455bd tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a" status: 200 len: 1318 microversion: 2.1 time: 0.536537 Oct 04 18:48:32.052709 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2335/4605] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:31 2022] GET /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a => generated 1318 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:32.158276 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-362e79be-dc4e-49ec-9042-c51cc5aa4845 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:32.179647 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-362e79be-dc4e-49ec-9042-c51cc5aa4845 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:32.196833 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-362e79be-dc4e-49ec-9042-c51cc5aa4845 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:32.201507 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-362e79be-dc4e-49ec-9042-c51cc5aa4845 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] 10.222.0.20 "GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6" status: 200 len: 1880 microversion: 2.32 time: 0.432059 Oct 04 18:48:32.205622 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2271/4606] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:48:31 2022] GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6 => generated 1880 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:48:32.525087 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ec33da3b-12f0-413e-9cdd-2f68b566bb10 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:32.535569 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ec33da3b-12f0-413e-9cdd-2f68b566bb10 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:32.553960 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec33da3b-12f0-413e-9cdd-2f68b566bb10 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:32.554729 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec33da3b-12f0-413e-9cdd-2f68b566bb10 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:32.567686 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec33da3b-12f0-413e-9cdd-2f68b566bb10 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:32.569056 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec33da3b-12f0-413e-9cdd-2f68b566bb10 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:32.574033 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec33da3b-12f0-413e-9cdd-2f68b566bb10 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:32.574673 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec33da3b-12f0-413e-9cdd-2f68b566bb10 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:33.150638 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-9bc9a73e-2cc8-452d-98a7-de769f96e7da req-97accbd8-079e-406d-9da3-7bf91eca68dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a", "name": "network-vif-plugged", "status": "completed", "tag": "25667d58-f07b-4faa-8414-20c890cec66d"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:48:33.173076 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-9bc9a73e-2cc8-452d-98a7-de769f96e7da req-97accbd8-079e-406d-9da3-7bf91eca68dd service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:33.173878 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-9bc9a73e-2cc8-452d-98a7-de769f96e7da req-97accbd8-079e-406d-9da3-7bf91eca68dd service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:33.174510 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-9bc9a73e-2cc8-452d-98a7-de769f96e7da req-97accbd8-079e-406d-9da3-7bf91eca68dd service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:33.214623 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-9bc9a73e-2cc8-452d-98a7-de769f96e7da req-97accbd8-079e-406d-9da3-7bf91eca68dd service nova] Creating event network-vif-plugged:25667d58-f07b-4faa-8414-20c890cec66d for instance 406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a on n-h2-850501-14 Oct 04 18:48:33.224215 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-9bc9a73e-2cc8-452d-98a7-de769f96e7da req-97accbd8-079e-406d-9da3-7bf91eca68dd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.685049 Oct 04 18:48:33.224753 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2272/4607] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:48:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:48:33.240303 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9c7c6773-ad96-4f10-8435-58291d3743db tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:33.245357 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9c7c6773-ad96-4f10-8435-58291d3743db tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: 406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:33.336897 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9c7c6773-ad96-4f10-8435-58291d3743db tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:33.336897 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9c7c6773-ad96-4f10-8435-58291d3743db tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:33.336897 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9c7c6773-ad96-4f10-8435-58291d3743db tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:33.336897 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9c7c6773-ad96-4f10-8435-58291d3743db tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:33.336897 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9c7c6773-ad96-4f10-8435-58291d3743db tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:33.336897 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9c7c6773-ad96-4f10-8435-58291d3743db tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:33.851151 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ec33da3b-12f0-413e-9cdd-2f68b566bb10 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:33.864330 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ec33da3b-12f0-413e-9cdd-2f68b566bb10 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1526 microversion: 2.1 time: 1.345294 Oct 04 18:48:33.864937 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2336/4608] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:32 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1526 bytes in 1347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:33.884489 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5bbaf837-e136-4422-91c7-b2d9cafb6d3f tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:33.885112 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5bbaf837-e136-4422-91c7-b2d9cafb6d3f tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] [instance: 317c7bd8-4f1e-4210-bb33-087557a1f4d6] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:33.892182 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5bbaf837-e136-4422-91c7-b2d9cafb6d3f tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:33.897188 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5bbaf837-e136-4422-91c7-b2d9cafb6d3f tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:33.901224 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5bbaf837-e136-4422-91c7-b2d9cafb6d3f tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:33.902223 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5bbaf837-e136-4422-91c7-b2d9cafb6d3f tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:33.905045 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5bbaf837-e136-4422-91c7-b2d9cafb6d3f tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:33.907826 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5bbaf837-e136-4422-91c7-b2d9cafb6d3f tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:33.943784 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9c7c6773-ad96-4f10-8435-58291d3743db tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:33.956452 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9c7c6773-ad96-4f10-8435-58291d3743db tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a" status: 200 len: 1318 microversion: 2.1 time: 0.729510 Oct 04 18:48:33.958422 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2273/4609] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:33 2022] GET /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a => generated 1318 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:34.892985 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5635a078-3644-44e8-9525-eb1347bfb5b7 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:34.895850 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5635a078-3644-44e8-9525-eb1347bfb5b7 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:34.935225 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5635a078-3644-44e8-9525-eb1347bfb5b7 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:34.938655 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5635a078-3644-44e8-9525-eb1347bfb5b7 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:34.939342 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5635a078-3644-44e8-9525-eb1347bfb5b7 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:34.940477 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5635a078-3644-44e8-9525-eb1347bfb5b7 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:34.942687 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5635a078-3644-44e8-9525-eb1347bfb5b7 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:34.949190 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5635a078-3644-44e8-9525-eb1347bfb5b7 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:34.997165 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5bbaf837-e136-4422-91c7-b2d9cafb6d3f tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:35.045506 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5bbaf837-e136-4422-91c7-b2d9cafb6d3f tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:35.055628 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5bbaf837-e136-4422-91c7-b2d9cafb6d3f tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:35.058420 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5bbaf837-e136-4422-91c7-b2d9cafb6d3f tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] 10.222.0.20 "GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6" status: 200 len: 1880 microversion: 2.32 time: 1.192520 Oct 04 18:48:35.071546 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2337/4610] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:48:33 2022] GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6 => generated 1880 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:48:35.096206 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-081b5117-64ef-4b56-ba10-c6b8c3acca7a tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:35.099387 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-081b5117-64ef-4b56-ba10-c6b8c3acca7a tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: 406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:35.134534 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-081b5117-64ef-4b56-ba10-c6b8c3acca7a tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:35.141477 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-081b5117-64ef-4b56-ba10-c6b8c3acca7a tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:35.150025 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-081b5117-64ef-4b56-ba10-c6b8c3acca7a tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:35.160571 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-081b5117-64ef-4b56-ba10-c6b8c3acca7a tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:35.173003 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-081b5117-64ef-4b56-ba10-c6b8c3acca7a tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:35.178125 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-081b5117-64ef-4b56-ba10-c6b8c3acca7a tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:35.701307 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-081b5117-64ef-4b56-ba10-c6b8c3acca7a tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:35.716448 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-081b5117-64ef-4b56-ba10-c6b8c3acca7a tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a" status: 200 len: 1318 microversion: 2.1 time: 0.640599 Oct 04 18:48:35.717091 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2338/4611] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:35 2022] GET /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a => generated 1318 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:35.747589 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5635a078-3644-44e8-9525-eb1347bfb5b7 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:35.759890 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5635a078-3644-44e8-9525-eb1347bfb5b7 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1526 microversion: 2.1 time: 0.871312 Oct 04 18:48:35.762035 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2274/4612] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:34 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1526 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:36.102809 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-821080e1-dbff-4dbd-9d3f-e130273c06cf tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:36.108685 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-821080e1-dbff-4dbd-9d3f-e130273c06cf tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] [instance: 317c7bd8-4f1e-4210-bb33-087557a1f4d6] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:36.153013 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-821080e1-dbff-4dbd-9d3f-e130273c06cf tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:36.153013 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-821080e1-dbff-4dbd-9d3f-e130273c06cf tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:36.153013 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-821080e1-dbff-4dbd-9d3f-e130273c06cf tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:36.153013 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-821080e1-dbff-4dbd-9d3f-e130273c06cf tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:36.153013 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-821080e1-dbff-4dbd-9d3f-e130273c06cf tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:36.153013 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-821080e1-dbff-4dbd-9d3f-e130273c06cf tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:36.442707 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-821080e1-dbff-4dbd-9d3f-e130273c06cf tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:36.453604 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-821080e1-dbff-4dbd-9d3f-e130273c06cf tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:36.455540 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-821080e1-dbff-4dbd-9d3f-e130273c06cf tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:36.474230 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-821080e1-dbff-4dbd-9d3f-e130273c06cf tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] 10.222.0.20 "GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6" status: 200 len: 1880 microversion: 2.32 time: 0.363197 Oct 04 18:48:36.475393 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2339/4613] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:48:36 2022] GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6 => generated 1880 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:48:36.744874 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-de131a6e-d57d-4642-9287-33339df2e488 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:36.744874 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-de131a6e-d57d-4642-9287-33339df2e488 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: 406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:36.769556 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-de131a6e-d57d-4642-9287-33339df2e488 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:36.770462 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-de131a6e-d57d-4642-9287-33339df2e488 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:36.771142 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-de131a6e-d57d-4642-9287-33339df2e488 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:36.772539 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-de131a6e-d57d-4642-9287-33339df2e488 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:36.779964 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-de131a6e-d57d-4642-9287-33339df2e488 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:36.785461 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-de131a6e-d57d-4642-9287-33339df2e488 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:36.786105 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1ae81b61-c93b-4700-b35c-ce98558ebb91 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:36.787444 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1ae81b61-c93b-4700-b35c-ce98558ebb91 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:36.809724 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1ae81b61-c93b-4700-b35c-ce98558ebb91 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:36.810664 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1ae81b61-c93b-4700-b35c-ce98558ebb91 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:36.812390 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1ae81b61-c93b-4700-b35c-ce98558ebb91 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:36.818386 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1ae81b61-c93b-4700-b35c-ce98558ebb91 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:36.820675 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1ae81b61-c93b-4700-b35c-ce98558ebb91 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:36.822049 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1ae81b61-c93b-4700-b35c-ce98558ebb91 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:37.273241 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1ae81b61-c93b-4700-b35c-ce98558ebb91 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:37.290011 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-de131a6e-d57d-4642-9287-33339df2e488 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:37.297663 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1ae81b61-c93b-4700-b35c-ce98558ebb91 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1526 microversion: 2.1 time: 0.516219 Oct 04 18:48:37.298633 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2340/4614] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:36 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1526 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:48:37.311816 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-bd086927-2160-47c5-a3f6-d4db0b67ca3a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:37.316799 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-bd086927-2160-47c5-a3f6-d4db0b67ca3a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:37.318694 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-de131a6e-d57d-4642-9287-33339df2e488 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a" status: 200 len: 1507 microversion: 2.1 time: 0.581037 Oct 04 18:48:37.322136 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2275/4615] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:36 2022] GET /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a => generated 1507 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:37.336462 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bd086927-2160-47c5-a3f6-d4db0b67ca3a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:37.337394 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bd086927-2160-47c5-a3f6-d4db0b67ca3a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:37.338033 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bd086927-2160-47c5-a3f6-d4db0b67ca3a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:37.338936 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bd086927-2160-47c5-a3f6-d4db0b67ca3a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:37.340262 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bd086927-2160-47c5-a3f6-d4db0b67ca3a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:37.340903 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bd086927-2160-47c5-a3f6-d4db0b67ca3a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:37.354288 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e5aea455-65ef-4fc7-8883-7e4e2ea50c9b tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:37.365623 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e5aea455-65ef-4fc7-8883-7e4e2ea50c9b tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: 406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:37.371188 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e5aea455-65ef-4fc7-8883-7e4e2ea50c9b tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:37.371687 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e5aea455-65ef-4fc7-8883-7e4e2ea50c9b tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:37.372153 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e5aea455-65ef-4fc7-8883-7e4e2ea50c9b tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:37.372864 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e5aea455-65ef-4fc7-8883-7e4e2ea50c9b tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:37.376922 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e5aea455-65ef-4fc7-8883-7e4e2ea50c9b tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:37.380233 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e5aea455-65ef-4fc7-8883-7e4e2ea50c9b tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:37.753606 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-bd086927-2160-47c5-a3f6-d4db0b67ca3a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:37.757931 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:48:37.764520 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-bd086927-2160-47c5-a3f6-d4db0b67ca3a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1685 microversion: 2.1 time: 0.464484 Oct 04 18:48:37.765887 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2341/4616] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:37 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1685 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:37.772685 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-04d82e0f-c28b-410f-acb8-b72710df9c7e tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:37.774038 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-04d82e0f-c28b-410f-acb8-b72710df9c7e tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] [instance: 317c7bd8-4f1e-4210-bb33-087557a1f4d6] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:37.781535 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-04d82e0f-c28b-410f-acb8-b72710df9c7e tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:37.782409 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-04d82e0f-c28b-410f-acb8-b72710df9c7e tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:37.783027 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-04d82e0f-c28b-410f-acb8-b72710df9c7e tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:37.783900 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-04d82e0f-c28b-410f-acb8-b72710df9c7e tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:37.784831 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-04d82e0f-c28b-410f-acb8-b72710df9c7e tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:37.785754 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-04d82e0f-c28b-410f-acb8-b72710df9c7e tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:37.890699 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e5aea455-65ef-4fc7-8883-7e4e2ea50c9b tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:37.901285 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e5aea455-65ef-4fc7-8883-7e4e2ea50c9b tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a" status: 200 len: 1507 microversion: 2.1 time: 0.553301 Oct 04 18:48:37.904658 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2276/4617] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:37 2022] GET /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a => generated 1507 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:48:37.935917 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4f3d0abe-4f1b-4e04-ac2f-90bc0d7300c6 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:48:37.937752 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4f3d0abe-4f1b-4e04-ac2f-90bc0d7300c6 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: 406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:37.951628 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4f3d0abe-4f1b-4e04-ac2f-90bc0d7300c6 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:37.952615 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4f3d0abe-4f1b-4e04-ac2f-90bc0d7300c6 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:37.955507 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4f3d0abe-4f1b-4e04-ac2f-90bc0d7300c6 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:37.958578 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4f3d0abe-4f1b-4e04-ac2f-90bc0d7300c6 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:37.959248 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4f3d0abe-4f1b-4e04-ac2f-90bc0d7300c6 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:37.967532 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4f3d0abe-4f1b-4e04-ac2f-90bc0d7300c6 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:38.313087 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-04d82e0f-c28b-410f-acb8-b72710df9c7e tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:38.343552 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-04d82e0f-c28b-410f-acb8-b72710df9c7e tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:38.346464 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-04d82e0f-c28b-410f-acb8-b72710df9c7e tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:38.348547 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-04d82e0f-c28b-410f-acb8-b72710df9c7e tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] 10.222.0.20 "GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6" status: 200 len: 1880 microversion: 2.32 time: 0.580896 Oct 04 18:48:38.358596 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4f3d0abe-4f1b-4e04-ac2f-90bc0d7300c6 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "PUT /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a" status: 200 len: 1079 microversion: 2.1 time: 0.428149 Oct 04 18:48:38.364286 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2277/4618] 10.222.0.20 () {60 vars in 1256 bytes} [Tue Oct 4 18:48:37 2022] PUT /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a => generated 1079 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:48:38.367186 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2342/4619] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:48:37 2022] GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6 => generated 1880 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:48:38.385973 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4bf0b5e0-c001-43ab-bffb-b405a3b1979b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:38.394456 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f4c3dd2c-c4fa-4516-a5e6-559aff0dcf8a tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:38.395959 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4bf0b5e0-c001-43ab-bffb-b405a3b1979b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:38.399287 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f4c3dd2c-c4fa-4516-a5e6-559aff0dcf8a tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: 406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:38.417082 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4bf0b5e0-c001-43ab-bffb-b405a3b1979b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:38.418017 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4bf0b5e0-c001-43ab-bffb-b405a3b1979b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:38.418679 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4bf0b5e0-c001-43ab-bffb-b405a3b1979b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:38.422274 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f4c3dd2c-c4fa-4516-a5e6-559aff0dcf8a tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:38.422777 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4bf0b5e0-c001-43ab-bffb-b405a3b1979b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:38.423362 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4bf0b5e0-c001-43ab-bffb-b405a3b1979b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:38.423785 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f4c3dd2c-c4fa-4516-a5e6-559aff0dcf8a tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:38.424899 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f4c3dd2c-c4fa-4516-a5e6-559aff0dcf8a tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:38.427159 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f4c3dd2c-c4fa-4516-a5e6-559aff0dcf8a tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:38.427938 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4bf0b5e0-c001-43ab-bffb-b405a3b1979b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:38.428545 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f4c3dd2c-c4fa-4516-a5e6-559aff0dcf8a tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:38.429621 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f4c3dd2c-c4fa-4516-a5e6-559aff0dcf8a tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:38.686384 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4bf0b5e0-c001-43ab-bffb-b405a3b1979b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:38.701723 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4bf0b5e0-c001-43ab-bffb-b405a3b1979b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1526 microversion: 2.1 time: 0.335782 Oct 04 18:48:38.702434 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2278/4620] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:38 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1526 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:38.745669 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f4c3dd2c-c4fa-4516-a5e6-559aff0dcf8a tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:38.755944 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f4c3dd2c-c4fa-4516-a5e6-559aff0dcf8a tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a" status: 200 len: 1505 microversion: 2.1 time: 0.379833 Oct 04 18:48:38.772314 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2343/4621] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:38 2022] GET /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a => generated 1505 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:38.780561 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7efebb8c-ae9e-467d-9299-61303626df3d tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:38.781739 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7efebb8c-ae9e-467d-9299-61303626df3d tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: 406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:38.792503 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7efebb8c-ae9e-467d-9299-61303626df3d tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:38.793285 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7efebb8c-ae9e-467d-9299-61303626df3d tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:38.794055 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7efebb8c-ae9e-467d-9299-61303626df3d tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:38.795278 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7efebb8c-ae9e-467d-9299-61303626df3d tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:38.796077 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7efebb8c-ae9e-467d-9299-61303626df3d tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:38.796675 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7efebb8c-ae9e-467d-9299-61303626df3d tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:38.796950 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2b0a1e5f-1c5e-46c3-95ca-0483138650e8 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:38.797970 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2b0a1e5f-1c5e-46c3-95ca-0483138650e8 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:38.812433 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2b0a1e5f-1c5e-46c3-95ca-0483138650e8 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:38.813002 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2b0a1e5f-1c5e-46c3-95ca-0483138650e8 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:38.813637 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2b0a1e5f-1c5e-46c3-95ca-0483138650e8 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:38.814401 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2b0a1e5f-1c5e-46c3-95ca-0483138650e8 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:38.814868 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2b0a1e5f-1c5e-46c3-95ca-0483138650e8 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:38.815301 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2b0a1e5f-1c5e-46c3-95ca-0483138650e8 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:39.059264 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7efebb8c-ae9e-467d-9299-61303626df3d tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:39.072444 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7efebb8c-ae9e-467d-9299-61303626df3d tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a" status: 200 len: 1505 microversion: 2.1 time: 0.295903 Oct 04 18:48:39.075422 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2279/4622] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:38 2022] GET /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a => generated 1505 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:39.103499 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8bdc50b6-236b-42f0-9aaf-e3be19738c3a tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:48:39.108012 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8bdc50b6-236b-42f0-9aaf-e3be19738c3a tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: 406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:39.121697 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8bdc50b6-236b-42f0-9aaf-e3be19738c3a tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:39.122918 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8bdc50b6-236b-42f0-9aaf-e3be19738c3a tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:39.124446 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8bdc50b6-236b-42f0-9aaf-e3be19738c3a tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:39.127808 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8bdc50b6-236b-42f0-9aaf-e3be19738c3a tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:39.130328 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8bdc50b6-236b-42f0-9aaf-e3be19738c3a tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:39.130980 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8bdc50b6-236b-42f0-9aaf-e3be19738c3a tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:39.243976 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-2b0a1e5f-1c5e-46c3-95ca-0483138650e8 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:39.255054 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2b0a1e5f-1c5e-46c3-95ca-0483138650e8 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1672 microversion: 2.1 time: 0.459280 Oct 04 18:48:39.269142 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2344/4623] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:38 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1672 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:48:39.283637 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-44c85957-b103-47d1-977b-cbc3724aa82c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-343883937"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:48:39.289130 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-44c85957-b103-47d1-977b-cbc3724aa82c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:39.304016 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-44c85957-b103-47d1-977b-cbc3724aa82c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:39.305547 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-44c85957-b103-47d1-977b-cbc3724aa82c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:39.306270 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-44c85957-b103-47d1-977b-cbc3724aa82c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:39.308210 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-44c85957-b103-47d1-977b-cbc3724aa82c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:39.312066 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-44c85957-b103-47d1-977b-cbc3724aa82c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:39.312710 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-44c85957-b103-47d1-977b-cbc3724aa82c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:40.037274 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-8bdc50b6-236b-42f0-9aaf-e3be19738c3a tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:48:40.037864 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-8bdc50b6-236b-42f0-9aaf-e3be19738c3a tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:48:40.038495 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-8bdc50b6-236b-42f0-9aaf-e3be19738c3a tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:48:40.039161 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-8bdc50b6-236b-42f0-9aaf-e3be19738c3a tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:48:40.039840 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-8bdc50b6-236b-42f0-9aaf-e3be19738c3a tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:48:40.452489 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8bdc50b6-236b-42f0-9aaf-e3be19738c3a tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: 406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:40.460231 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8bdc50b6-236b-42f0-9aaf-e3be19738c3a tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:40.460963 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8bdc50b6-236b-42f0-9aaf-e3be19738c3a tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:40.461704 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8bdc50b6-236b-42f0-9aaf-e3be19738c3a tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:40.462571 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8bdc50b6-236b-42f0-9aaf-e3be19738c3a tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:40.463242 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8bdc50b6-236b-42f0-9aaf-e3be19738c3a tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:40.463843 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8bdc50b6-236b-42f0-9aaf-e3be19738c3a tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:40.469031 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:48:40.496153 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8bdc50b6-236b-42f0-9aaf-e3be19738c3a tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "POST /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a/action" status: 202 len: 1111 microversion: 2.1 time: 1.397080 Oct 04 18:48:40.512340 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2280/4624] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:48:39 2022] POST /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a/action => generated 1111 bytes in 1414 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Oct 04 18:48:40.517824 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6cab262e-352b-41a6-b77d-23ebaebceaa2 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:40.518675 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-6cab262e-352b-41a6-b77d-23ebaebceaa2 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] [instance: 317c7bd8-4f1e-4210-bb33-087557a1f4d6] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:40.531615 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6cab262e-352b-41a6-b77d-23ebaebceaa2 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:40.533124 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6cab262e-352b-41a6-b77d-23ebaebceaa2 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:40.533746 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6cab262e-352b-41a6-b77d-23ebaebceaa2 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:40.534665 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6cab262e-352b-41a6-b77d-23ebaebceaa2 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:40.535503 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6cab262e-352b-41a6-b77d-23ebaebceaa2 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:40.536010 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6cab262e-352b-41a6-b77d-23ebaebceaa2 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:40.656398 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-44c85957-b103-47d1-977b-cbc3724aa82c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "POST /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238/action" status: 202 len: 0 microversion: 2.1 time: 1.377853 Oct 04 18:48:40.662038 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2345/4625] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:48:39 2022] POST /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238/action => generated 0 bytes in 1381 msecs (HTTP/1.1 202) 10 headers in 456 bytes (2 switches on core 0) Oct 04 18:48:40.678831 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8106a18d-4543-4e9b-ade2-24c2a4dc337c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:40.687473 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8106a18d-4543-4e9b-ade2-24c2a4dc337c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:40.729487 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8106a18d-4543-4e9b-ade2-24c2a4dc337c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:40.733713 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8106a18d-4543-4e9b-ade2-24c2a4dc337c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:40.734320 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8106a18d-4543-4e9b-ade2-24c2a4dc337c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:40.739414 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8106a18d-4543-4e9b-ade2-24c2a4dc337c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:40.740046 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8106a18d-4543-4e9b-ade2-24c2a4dc337c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:40.744902 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8106a18d-4543-4e9b-ade2-24c2a4dc337c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:40.914243 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-6cab262e-352b-41a6-b77d-23ebaebceaa2 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:40.939575 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-6cab262e-352b-41a6-b77d-23ebaebceaa2 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:40.945713 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-6cab262e-352b-41a6-b77d-23ebaebceaa2 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:40.954633 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6cab262e-352b-41a6-b77d-23ebaebceaa2 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] 10.222.0.20 "GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6" status: 200 len: 1880 microversion: 2.32 time: 0.436747 Oct 04 18:48:40.956851 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2281/4626] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:48:40 2022] GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6 => generated 1880 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:48:40.979988 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8b8b8136-eb0b-4124-a386-4bfccb93cbba tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:40.982984 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8b8b8136-eb0b-4124-a386-4bfccb93cbba tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: 406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:41.021067 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8b8b8136-eb0b-4124-a386-4bfccb93cbba tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:41.021599 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8b8b8136-eb0b-4124-a386-4bfccb93cbba tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:41.023788 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8b8b8136-eb0b-4124-a386-4bfccb93cbba tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:41.030759 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8b8b8136-eb0b-4124-a386-4bfccb93cbba tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:41.030759 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8b8b8136-eb0b-4124-a386-4bfccb93cbba tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:41.030759 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8b8b8136-eb0b-4124-a386-4bfccb93cbba tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:41.237496 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8106a18d-4543-4e9b-ade2-24c2a4dc337c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:41.247423 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8106a18d-4543-4e9b-ade2-24c2a4dc337c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1526 microversion: 2.1 time: 0.582275 Oct 04 18:48:41.248004 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2346/4627] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:40 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1526 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:41.252859 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-433e51f8-22e8-4bec-976e-9893cb61013a req-9a38141a-a093-4658-9b55-57c35edf43f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "317c7bd8-4f1e-4210-bb33-087557a1f4d6", "name": "network-vif-plugged", "status": "completed", "tag": "2db3b2e9-5704-4a97-af2f-ad3b3aff8b6c"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:48:41.265665 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-433e51f8-22e8-4bec-976e-9893cb61013a req-9a38141a-a093-4658-9b55-57c35edf43f7 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:41.266354 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-433e51f8-22e8-4bec-976e-9893cb61013a req-9a38141a-a093-4658-9b55-57c35edf43f7 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:41.266841 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-433e51f8-22e8-4bec-976e-9893cb61013a req-9a38141a-a093-4658-9b55-57c35edf43f7 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:41.330933 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-433e51f8-22e8-4bec-976e-9893cb61013a req-9a38141a-a093-4658-9b55-57c35edf43f7 service nova] Creating event network-vif-plugged:2db3b2e9-5704-4a97-af2f-ad3b3aff8b6c for instance 317c7bd8-4f1e-4210-bb33-087557a1f4d6 on n-h1-850501-14 Oct 04 18:48:41.366739 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-433e51f8-22e8-4bec-976e-9893cb61013a req-9a38141a-a093-4658-9b55-57c35edf43f7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113472 Oct 04 18:48:41.375712 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2347/4628] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:48:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:48:41.490529 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8b8b8136-eb0b-4124-a386-4bfccb93cbba tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:41.506131 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8b8b8136-eb0b-4124-a386-4bfccb93cbba tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a" status: 200 len: 1516 microversion: 2.1 time: 0.547719 Oct 04 18:48:41.526861 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2282/4629] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:40 2022] GET /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a => generated 1516 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:41.987263 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d444ddfe-d39e-485e-a451-eae43ab47c8d tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:41.989904 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d444ddfe-d39e-485e-a451-eae43ab47c8d tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] [instance: 317c7bd8-4f1e-4210-bb33-087557a1f4d6] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:41.995808 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d444ddfe-d39e-485e-a451-eae43ab47c8d tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:41.996328 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d444ddfe-d39e-485e-a451-eae43ab47c8d tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:41.996775 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d444ddfe-d39e-485e-a451-eae43ab47c8d tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:41.998544 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d444ddfe-d39e-485e-a451-eae43ab47c8d tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:41.998784 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d444ddfe-d39e-485e-a451-eae43ab47c8d tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:41.999323 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d444ddfe-d39e-485e-a451-eae43ab47c8d tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:42.282773 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-26254be1-d810-4ada-a8e1-d258e83877f8 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:42.282773 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-26254be1-d810-4ada-a8e1-d258e83877f8 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:42.317993 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-26254be1-d810-4ada-a8e1-d258e83877f8 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:42.319898 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-26254be1-d810-4ada-a8e1-d258e83877f8 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:42.321068 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-26254be1-d810-4ada-a8e1-d258e83877f8 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:42.323191 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-26254be1-d810-4ada-a8e1-d258e83877f8 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:42.323819 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-26254be1-d810-4ada-a8e1-d258e83877f8 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:42.324409 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-26254be1-d810-4ada-a8e1-d258e83877f8 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:43.002768 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d444ddfe-d39e-485e-a451-eae43ab47c8d tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:43.023637 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d444ddfe-d39e-485e-a451-eae43ab47c8d tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:43.025502 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d444ddfe-d39e-485e-a451-eae43ab47c8d tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:43.027041 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d444ddfe-d39e-485e-a451-eae43ab47c8d tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] 10.222.0.20 "GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6" status: 200 len: 1880 microversion: 2.32 time: 1.044941 Oct 04 18:48:43.051169 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2348/4630] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:48:41 2022] GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6 => generated 1880 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:48:43.064981 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7a2ea9a8-54ff-4e7d-a900-22f13c149b23 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:43.065768 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7a2ea9a8-54ff-4e7d-a900-22f13c149b23 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: 406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:43.098615 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7a2ea9a8-54ff-4e7d-a900-22f13c149b23 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:43.099285 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7a2ea9a8-54ff-4e7d-a900-22f13c149b23 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:43.099727 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7a2ea9a8-54ff-4e7d-a900-22f13c149b23 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:43.100530 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7a2ea9a8-54ff-4e7d-a900-22f13c149b23 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:43.101179 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7a2ea9a8-54ff-4e7d-a900-22f13c149b23 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:43.101776 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7a2ea9a8-54ff-4e7d-a900-22f13c149b23 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:43.415786 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-26254be1-d810-4ada-a8e1-d258e83877f8 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:43.431780 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-26254be1-d810-4ada-a8e1-d258e83877f8 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1526 microversion: 2.1 time: 1.160302 Oct 04 18:48:43.435925 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2283/4631] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:42 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1526 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:43.468007 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-5844ad68-f577-40cd-a316-ca18be5c4161 req-15614129-cf28-43e2-9edc-c86f107874c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e208f85-0513-43f4-8a2c-38baa2886238", "name": "network-vif-unplugged", "status": "completed", "tag": "caad0bda-801d-4a85-94c7-4bb13cb984c3"}, {"server_uuid": "317c7bd8-4f1e-4210-bb33-087557a1f4d6", "name": "network-vif-plugged", "status": "completed", "tag": "0c6f4307-90ef-4d56-82f7-ae7b40c2cd81"}, {"server_uuid": "95fb1a13-7441-4f74-ad81-5a9413496545", "name": "network-vif-plugged", "status": "completed", "tag": "73befc4a-98f7-414e-8302-6ba3a3fd9481"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:48:43.506286 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=64 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:48:43.519740 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-5844ad68-f577-40cd-a316-ca18be5c4161 req-15614129-cf28-43e2-9edc-c86f107874c9 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:43.521723 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-5844ad68-f577-40cd-a316-ca18be5c4161 req-15614129-cf28-43e2-9edc-c86f107874c9 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:43.522363 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-5844ad68-f577-40cd-a316-ca18be5c4161 req-15614129-cf28-43e2-9edc-c86f107874c9 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:43.581339 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-5844ad68-f577-40cd-a316-ca18be5c4161 req-15614129-cf28-43e2-9edc-c86f107874c9 service nova] Creating event network-vif-unplugged:caad0bda-801d-4a85-94c7-4bb13cb984c3 for instance 2e208f85-0513-43f4-8a2c-38baa2886238 on n-h2-850501-14 Oct 04 18:48:43.583388 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-5844ad68-f577-40cd-a316-ca18be5c4161 req-15614129-cf28-43e2-9edc-c86f107874c9 service nova] Creating event network-vif-plugged:0c6f4307-90ef-4d56-82f7-ae7b40c2cd81 for instance 317c7bd8-4f1e-4210-bb33-087557a1f4d6 on n-h1-850501-14 Oct 04 18:48:43.584639 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-5844ad68-f577-40cd-a316-ca18be5c4161 req-15614129-cf28-43e2-9edc-c86f107874c9 service nova] Creating event network-vif-plugged:73befc4a-98f7-414e-8302-6ba3a3fd9481 for instance 95fb1a13-7441-4f74-ad81-5a9413496545 on n-h1-850501-14 Oct 04 18:48:43.624017 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-5844ad68-f577-40cd-a316-ca18be5c4161 req-15614129-cf28-43e2-9edc-c86f107874c9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.182243 Oct 04 18:48:43.636157 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2284/4632] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:48:43 2022] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:48:43.695987 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7a2ea9a8-54ff-4e7d-a900-22f13c149b23 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:43.708106 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7a2ea9a8-54ff-4e7d-a900-22f13c149b23 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a" status: 200 len: 1516 microversion: 2.1 time: 0.652783 Oct 04 18:48:43.714247 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2349/4633] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:43 2022] GET /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a => generated 1516 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:44.056185 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6ea190d7-6ec5-4437-8965-b89789a1fcb5 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:44.059972 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-6ea190d7-6ec5-4437-8965-b89789a1fcb5 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] [instance: 317c7bd8-4f1e-4210-bb33-087557a1f4d6] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:44.070442 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6ea190d7-6ec5-4437-8965-b89789a1fcb5 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:44.071175 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6ea190d7-6ec5-4437-8965-b89789a1fcb5 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:44.072497 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6ea190d7-6ec5-4437-8965-b89789a1fcb5 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:44.073400 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6ea190d7-6ec5-4437-8965-b89789a1fcb5 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:44.074026 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6ea190d7-6ec5-4437-8965-b89789a1fcb5 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:44.074619 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6ea190d7-6ec5-4437-8965-b89789a1fcb5 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:44.459319 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-94b49b10-02db-4209-b01c-d7c2369f5edc tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:44.460030 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-94b49b10-02db-4209-b01c-d7c2369f5edc tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:44.475927 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-94b49b10-02db-4209-b01c-d7c2369f5edc tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:44.476745 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-94b49b10-02db-4209-b01c-d7c2369f5edc tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:44.477193 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-94b49b10-02db-4209-b01c-d7c2369f5edc tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:44.477890 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-94b49b10-02db-4209-b01c-d7c2369f5edc tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:44.478347 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-94b49b10-02db-4209-b01c-d7c2369f5edc tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:44.478770 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-94b49b10-02db-4209-b01c-d7c2369f5edc tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:44.484819 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-6ea190d7-6ec5-4437-8965-b89789a1fcb5 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:44.502761 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-6ea190d7-6ec5-4437-8965-b89789a1fcb5 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:44.508168 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-6ea190d7-6ec5-4437-8965-b89789a1fcb5 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:44.509766 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6ea190d7-6ec5-4437-8965-b89789a1fcb5 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] 10.222.0.20 "GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6" status: 200 len: 1880 microversion: 2.32 time: 0.458038 Oct 04 18:48:44.512746 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2285/4634] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:48:44 2022] GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6 => generated 1880 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:48:44.733685 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-cf28f482-a4b3-411c-a7a3-1a5e085b3731 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:44.734316 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-cf28f482-a4b3-411c-a7a3-1a5e085b3731 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: 406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:44.750050 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cf28f482-a4b3-411c-a7a3-1a5e085b3731 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:44.750584 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cf28f482-a4b3-411c-a7a3-1a5e085b3731 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:44.751042 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cf28f482-a4b3-411c-a7a3-1a5e085b3731 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:44.752382 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cf28f482-a4b3-411c-a7a3-1a5e085b3731 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:44.752856 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cf28f482-a4b3-411c-a7a3-1a5e085b3731 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:44.753374 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cf28f482-a4b3-411c-a7a3-1a5e085b3731 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:44.838161 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-94b49b10-02db-4209-b01c-d7c2369f5edc tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:44.853287 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-94b49b10-02db-4209-b01c-d7c2369f5edc tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1526 microversion: 2.1 time: 0.398083 Oct 04 18:48:44.856561 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2350/4635] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:44 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1526 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:45.262721 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-cf28f482-a4b3-411c-a7a3-1a5e085b3731 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:45.276555 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-cf28f482-a4b3-411c-a7a3-1a5e085b3731 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a" status: 200 len: 1516 microversion: 2.1 time: 0.548338 Oct 04 18:48:45.277769 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2286/4636] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:44 2022] GET /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a => generated 1516 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:45.542946 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-fa95216c-eea0-4544-ae74-3de7f0d9330e tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:45.548737 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-fa95216c-eea0-4544-ae74-3de7f0d9330e tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] [instance: 317c7bd8-4f1e-4210-bb33-087557a1f4d6] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:45.556468 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fa95216c-eea0-4544-ae74-3de7f0d9330e tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:45.557251 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fa95216c-eea0-4544-ae74-3de7f0d9330e tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:45.557864 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fa95216c-eea0-4544-ae74-3de7f0d9330e tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:45.559230 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fa95216c-eea0-4544-ae74-3de7f0d9330e tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:45.560421 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fa95216c-eea0-4544-ae74-3de7f0d9330e tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:45.561413 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fa95216c-eea0-4544-ae74-3de7f0d9330e tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:45.804546 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-5f86107a-ff2c-45c0-ae2f-ee93234600e5 req-2b87ef62-3077-4932-9b47-4af357235697 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "317c7bd8-4f1e-4210-bb33-087557a1f4d6", "name": "network-vif-plugged", "status": "completed", "tag": "f77c8e43-6a46-4f2a-aef7-77f61d8b7f1a"}, {"server_uuid": "317c7bd8-4f1e-4210-bb33-087557a1f4d6", "name": "network-vif-plugged", "status": "completed", "tag": "722c07ac-b873-4605-a9eb-4abf62e975df"}, {"server_uuid": "317c7bd8-4f1e-4210-bb33-087557a1f4d6", "name": "network-vif-plugged", "status": "completed", "tag": "88a546f7-13bd-4f6e-b36e-3c743eeface0"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:48:45.844872 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-5f86107a-ff2c-45c0-ae2f-ee93234600e5 req-2b87ef62-3077-4932-9b47-4af357235697 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:45.849603 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-5f86107a-ff2c-45c0-ae2f-ee93234600e5 req-2b87ef62-3077-4932-9b47-4af357235697 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:45.851171 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-5f86107a-ff2c-45c0-ae2f-ee93234600e5 req-2b87ef62-3077-4932-9b47-4af357235697 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:45.890892 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-5f86107a-ff2c-45c0-ae2f-ee93234600e5 req-2b87ef62-3077-4932-9b47-4af357235697 service nova] Creating event network-vif-plugged:f77c8e43-6a46-4f2a-aef7-77f61d8b7f1a for instance 317c7bd8-4f1e-4210-bb33-087557a1f4d6 on n-h1-850501-14 Oct 04 18:48:45.891572 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-5f86107a-ff2c-45c0-ae2f-ee93234600e5 req-2b87ef62-3077-4932-9b47-4af357235697 service nova] Creating event network-vif-plugged:722c07ac-b873-4605-a9eb-4abf62e975df for instance 317c7bd8-4f1e-4210-bb33-087557a1f4d6 on n-h1-850501-14 Oct 04 18:48:45.897749 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-5f86107a-ff2c-45c0-ae2f-ee93234600e5 req-2b87ef62-3077-4932-9b47-4af357235697 service nova] Creating event network-vif-plugged:88a546f7-13bd-4f6e-b36e-3c743eeface0 for instance 317c7bd8-4f1e-4210-bb33-087557a1f4d6 on n-h1-850501-14 Oct 04 18:48:45.905092 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-5f86107a-ff2c-45c0-ae2f-ee93234600e5 req-2b87ef62-3077-4932-9b47-4af357235697 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.104994 Oct 04 18:48:45.908218 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2287/4637] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:48:45 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:48:45.926236 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-539d54ea-1834-4c96-9ae2-7b931de9aa8e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:45.927235 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-539d54ea-1834-4c96-9ae2-7b931de9aa8e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:45.942057 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-539d54ea-1834-4c96-9ae2-7b931de9aa8e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:45.944554 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-539d54ea-1834-4c96-9ae2-7b931de9aa8e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:45.947262 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-539d54ea-1834-4c96-9ae2-7b931de9aa8e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:45.948495 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-539d54ea-1834-4c96-9ae2-7b931de9aa8e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:45.949066 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-539d54ea-1834-4c96-9ae2-7b931de9aa8e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:45.949758 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-539d54ea-1834-4c96-9ae2-7b931de9aa8e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:46.276810 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-539d54ea-1834-4c96-9ae2-7b931de9aa8e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:46.286954 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-539d54ea-1834-4c96-9ae2-7b931de9aa8e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1526 microversion: 2.1 time: 0.376640 Oct 04 18:48:46.290444 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2288/4638] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:45 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1526 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:46.306563 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-83ff4132-4e06-4530-8253-7381c8e166dd tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:46.307513 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-83ff4132-4e06-4530-8253-7381c8e166dd tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: 406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:46.323067 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-83ff4132-4e06-4530-8253-7381c8e166dd tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:46.323970 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-83ff4132-4e06-4530-8253-7381c8e166dd tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:46.324702 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-83ff4132-4e06-4530-8253-7381c8e166dd tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:46.325698 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-83ff4132-4e06-4530-8253-7381c8e166dd tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:46.329674 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-83ff4132-4e06-4530-8253-7381c8e166dd tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:46.330371 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-83ff4132-4e06-4530-8253-7381c8e166dd tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:46.398210 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-fa95216c-eea0-4544-ae74-3de7f0d9330e tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:46.417404 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-fa95216c-eea0-4544-ae74-3de7f0d9330e tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:46.420454 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-fa95216c-eea0-4544-ae74-3de7f0d9330e tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:46.425206 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-fa95216c-eea0-4544-ae74-3de7f0d9330e tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] 10.222.0.20 "GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6" status: 200 len: 1880 microversion: 2.32 time: 0.887516 Oct 04 18:48:46.434223 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2351/4639] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:48:45 2022] GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6 => generated 1880 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:48:46.959639 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-83ff4132-4e06-4530-8253-7381c8e166dd tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:46.972991 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-83ff4132-4e06-4530-8253-7381c8e166dd tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a" status: 200 len: 1516 microversion: 2.1 time: 0.670379 Oct 04 18:48:46.988500 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2289/4640] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:46 2022] GET /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a => generated 1516 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:47.323174 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-209001d5-9c5d-4f87-9625-ea1013d7ef71 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:47.323713 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-209001d5-9c5d-4f87-9625-ea1013d7ef71 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:47.352182 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-209001d5-9c5d-4f87-9625-ea1013d7ef71 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:47.355422 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-209001d5-9c5d-4f87-9625-ea1013d7ef71 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:47.355422 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-209001d5-9c5d-4f87-9625-ea1013d7ef71 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:47.361105 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-209001d5-9c5d-4f87-9625-ea1013d7ef71 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:47.368115 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-209001d5-9c5d-4f87-9625-ea1013d7ef71 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:47.369013 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-209001d5-9c5d-4f87-9625-ea1013d7ef71 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:47.464732 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-40732e05-0137-44d7-bacc-99c71f33dd7a tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:47.465405 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-40732e05-0137-44d7-bacc-99c71f33dd7a tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] [instance: 317c7bd8-4f1e-4210-bb33-087557a1f4d6] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:47.478426 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-40732e05-0137-44d7-bacc-99c71f33dd7a tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:47.480772 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-40732e05-0137-44d7-bacc-99c71f33dd7a tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:47.483088 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-40732e05-0137-44d7-bacc-99c71f33dd7a tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:47.485325 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-40732e05-0137-44d7-bacc-99c71f33dd7a tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:47.486132 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-40732e05-0137-44d7-bacc-99c71f33dd7a tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:47.488895 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-40732e05-0137-44d7-bacc-99c71f33dd7a tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:48.117934 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-209001d5-9c5d-4f87-9625-ea1013d7ef71 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:48.130899 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-209001d5-9c5d-4f87-9625-ea1013d7ef71 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1526 microversion: 2.1 time: 0.812456 Oct 04 18:48:48.132244 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2352/4641] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:47 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1526 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:48.159926 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-7edc536a-01c7-4028-8c5e-f6cd9ff7b02b req-25b3bad6-3b97-4285-8b23-b2319650e50a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "317c7bd8-4f1e-4210-bb33-087557a1f4d6", "name": "network-vif-plugged", "status": "completed", "tag": "53730d23-3a07-4884-9751-67c1b4d3e3f1"}, {"server_uuid": "317c7bd8-4f1e-4210-bb33-087557a1f4d6", "name": "network-vif-plugged", "status": "completed", "tag": "66c99c11-ceb2-4608-8f5b-878ab722f616"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:48:48.176770 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-40732e05-0137-44d7-bacc-99c71f33dd7a tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:48.190263 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-40732e05-0137-44d7-bacc-99c71f33dd7a tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:48.193185 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-40732e05-0137-44d7-bacc-99c71f33dd7a tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:48.195719 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-40732e05-0137-44d7-bacc-99c71f33dd7a tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] 10.222.0.20 "GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6" status: 200 len: 1880 microversion: 2.32 time: 0.736382 Oct 04 18:48:48.196738 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2290/4642] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:48:47 2022] GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6 => generated 1880 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:48:48.203046 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-81087f38-9205-40d8-bff7-8a88e73847f5 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:48.204278 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-81087f38-9205-40d8-bff7-8a88e73847f5 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: 406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:48.214009 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-81087f38-9205-40d8-bff7-8a88e73847f5 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:48.216565 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-81087f38-9205-40d8-bff7-8a88e73847f5 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:48.216565 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-81087f38-9205-40d8-bff7-8a88e73847f5 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:48.217292 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-81087f38-9205-40d8-bff7-8a88e73847f5 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:48.218025 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-81087f38-9205-40d8-bff7-8a88e73847f5 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:48.218668 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-81087f38-9205-40d8-bff7-8a88e73847f5 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:48.230461 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-7edc536a-01c7-4028-8c5e-f6cd9ff7b02b req-25b3bad6-3b97-4285-8b23-b2319650e50a service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:48.230956 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-7edc536a-01c7-4028-8c5e-f6cd9ff7b02b req-25b3bad6-3b97-4285-8b23-b2319650e50a service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:48.231399 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-7edc536a-01c7-4028-8c5e-f6cd9ff7b02b req-25b3bad6-3b97-4285-8b23-b2319650e50a service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:48.317168 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-7edc536a-01c7-4028-8c5e-f6cd9ff7b02b req-25b3bad6-3b97-4285-8b23-b2319650e50a service nova] Creating event network-vif-plugged:53730d23-3a07-4884-9751-67c1b4d3e3f1 for instance 317c7bd8-4f1e-4210-bb33-087557a1f4d6 on n-h1-850501-14 Oct 04 18:48:48.317961 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-7edc536a-01c7-4028-8c5e-f6cd9ff7b02b req-25b3bad6-3b97-4285-8b23-b2319650e50a service nova] Creating event network-vif-plugged:66c99c11-ceb2-4608-8f5b-878ab722f616 for instance 317c7bd8-4f1e-4210-bb33-087557a1f4d6 on n-h1-850501-14 Oct 04 18:48:48.339387 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-7edc536a-01c7-4028-8c5e-f6cd9ff7b02b req-25b3bad6-3b97-4285-8b23-b2319650e50a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.205648 Oct 04 18:48:48.341846 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2353/4643] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:48:48 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:48:48.557874 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-81087f38-9205-40d8-bff7-8a88e73847f5 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:48.568470 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-81087f38-9205-40d8-bff7-8a88e73847f5 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a" status: 200 len: 1516 microversion: 2.1 time: 0.370349 Oct 04 18:48:48.573475 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2291/4644] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:48 2022] GET /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a => generated 1516 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:49.170170 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-55a42812-2021-4d70-9ecd-1765546b55d4 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:49.170998 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-55a42812-2021-4d70-9ecd-1765546b55d4 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:49.189751 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-55a42812-2021-4d70-9ecd-1765546b55d4 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:49.191868 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-55a42812-2021-4d70-9ecd-1765546b55d4 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:49.207259 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-55a42812-2021-4d70-9ecd-1765546b55d4 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:49.210180 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-55a42812-2021-4d70-9ecd-1765546b55d4 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:49.219167 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-55a42812-2021-4d70-9ecd-1765546b55d4 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:49.219167 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-55a42812-2021-4d70-9ecd-1765546b55d4 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:49.235104 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8aaf6009-5745-49a1-9249-82eda466bc07 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:49.235757 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8aaf6009-5745-49a1-9249-82eda466bc07 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] [instance: 317c7bd8-4f1e-4210-bb33-087557a1f4d6] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:49.259056 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8aaf6009-5745-49a1-9249-82eda466bc07 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:49.261387 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8aaf6009-5745-49a1-9249-82eda466bc07 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:49.262386 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8aaf6009-5745-49a1-9249-82eda466bc07 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:49.263903 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8aaf6009-5745-49a1-9249-82eda466bc07 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:49.266076 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8aaf6009-5745-49a1-9249-82eda466bc07 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:49.267316 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8aaf6009-5745-49a1-9249-82eda466bc07 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:49.784277 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-55a42812-2021-4d70-9ecd-1765546b55d4 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:49.801478 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-55a42812-2021-4d70-9ecd-1765546b55d4 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1526 microversion: 2.1 time: 0.643834 Oct 04 18:48:49.802083 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2354/4645] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:49 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1526 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:49.828145 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ab3bf92b-b70d-41ab-ac0d-a302b30868c8 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:49.830563 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8aaf6009-5745-49a1-9249-82eda466bc07 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:49.833856 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ab3bf92b-b70d-41ab-ac0d-a302b30868c8 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: 406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:49.842832 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8aaf6009-5745-49a1-9249-82eda466bc07 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:49.844561 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8aaf6009-5745-49a1-9249-82eda466bc07 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:49.848947 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8aaf6009-5745-49a1-9249-82eda466bc07 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] 10.222.0.20 "GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6" status: 200 len: 1880 microversion: 2.32 time: 0.624082 Oct 04 18:48:49.863761 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ab3bf92b-b70d-41ab-ac0d-a302b30868c8 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:49.864523 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2292/4646] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:48:49 2022] GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6 => generated 1880 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:48:49.866726 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ab3bf92b-b70d-41ab-ac0d-a302b30868c8 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:49.867249 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ab3bf92b-b70d-41ab-ac0d-a302b30868c8 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:49.872596 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ab3bf92b-b70d-41ab-ac0d-a302b30868c8 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:49.875671 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ab3bf92b-b70d-41ab-ac0d-a302b30868c8 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:49.875671 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ab3bf92b-b70d-41ab-ac0d-a302b30868c8 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:50.231486 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ab3bf92b-b70d-41ab-ac0d-a302b30868c8 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:50.263340 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ab3bf92b-b70d-41ab-ac0d-a302b30868c8 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a" status: 200 len: 1516 microversion: 2.1 time: 0.444901 Oct 04 18:48:50.264017 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2355/4647] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:49 2022] GET /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a => generated 1516 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:50.562515 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-36933cec-b8dc-4a07-8022-f25dbb2f9f41 req-66cef2e4-49d0-4b35-bea0-6f5db7c88fa1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e208f85-0513-43f4-8a2c-38baa2886238", "name": "network-vif-plugged", "status": "completed", "tag": "caad0bda-801d-4a85-94c7-4bb13cb984c3"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:48:50.604966 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-36933cec-b8dc-4a07-8022-f25dbb2f9f41 req-66cef2e4-49d0-4b35-bea0-6f5db7c88fa1 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:50.609088 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-36933cec-b8dc-4a07-8022-f25dbb2f9f41 req-66cef2e4-49d0-4b35-bea0-6f5db7c88fa1 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:50.615137 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-36933cec-b8dc-4a07-8022-f25dbb2f9f41 req-66cef2e4-49d0-4b35-bea0-6f5db7c88fa1 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:50.674499 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-36933cec-b8dc-4a07-8022-f25dbb2f9f41 req-66cef2e4-49d0-4b35-bea0-6f5db7c88fa1 service nova] Creating event network-vif-plugged:caad0bda-801d-4a85-94c7-4bb13cb984c3 for instance 2e208f85-0513-43f4-8a2c-38baa2886238 on n-h2-850501-14 Oct 04 18:48:50.694592 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-36933cec-b8dc-4a07-8022-f25dbb2f9f41 req-66cef2e4-49d0-4b35-bea0-6f5db7c88fa1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134878 Oct 04 18:48:50.695617 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2293/4648] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:48:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:48:50.848803 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e1443499-fd9e-4018-b9bb-4f123c9ab228 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:50.852935 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e1443499-fd9e-4018-b9bb-4f123c9ab228 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:50.886034 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2c5a02a4-0a08-4fac-8afa-01ff0cdc7654 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:50.886905 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2c5a02a4-0a08-4fac-8afa-01ff0cdc7654 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] [instance: 317c7bd8-4f1e-4210-bb33-087557a1f4d6] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:50.889734 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e1443499-fd9e-4018-b9bb-4f123c9ab228 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:50.890274 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e1443499-fd9e-4018-b9bb-4f123c9ab228 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:50.890725 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e1443499-fd9e-4018-b9bb-4f123c9ab228 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:50.891457 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e1443499-fd9e-4018-b9bb-4f123c9ab228 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:50.891924 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e1443499-fd9e-4018-b9bb-4f123c9ab228 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:50.892382 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e1443499-fd9e-4018-b9bb-4f123c9ab228 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:50.908496 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2c5a02a4-0a08-4fac-8afa-01ff0cdc7654 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:50.910349 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2c5a02a4-0a08-4fac-8afa-01ff0cdc7654 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:50.910971 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2c5a02a4-0a08-4fac-8afa-01ff0cdc7654 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:50.914331 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2c5a02a4-0a08-4fac-8afa-01ff0cdc7654 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:50.916106 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2c5a02a4-0a08-4fac-8afa-01ff0cdc7654 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:50.918886 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2c5a02a4-0a08-4fac-8afa-01ff0cdc7654 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:51.321884 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e1443499-fd9e-4018-b9bb-4f123c9ab228 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:51.342169 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e1443499-fd9e-4018-b9bb-4f123c9ab228 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1526 microversion: 2.1 time: 0.494475 Oct 04 18:48:51.356475 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2356/4649] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:50 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1526 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:51.375503 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e6c9bd46-9af0-40a2-9d98-75f06769f198 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:51.376516 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e6c9bd46-9af0-40a2-9d98-75f06769f198 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: 406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:51.388920 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e6c9bd46-9af0-40a2-9d98-75f06769f198 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:51.392832 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e6c9bd46-9af0-40a2-9d98-75f06769f198 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:51.394593 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e6c9bd46-9af0-40a2-9d98-75f06769f198 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:51.397486 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e6c9bd46-9af0-40a2-9d98-75f06769f198 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:51.398141 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e6c9bd46-9af0-40a2-9d98-75f06769f198 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:51.401379 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e6c9bd46-9af0-40a2-9d98-75f06769f198 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:51.461748 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2c5a02a4-0a08-4fac-8afa-01ff0cdc7654 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:51.482811 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2c5a02a4-0a08-4fac-8afa-01ff0cdc7654 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:51.495044 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2c5a02a4-0a08-4fac-8afa-01ff0cdc7654 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:51.500480 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2c5a02a4-0a08-4fac-8afa-01ff0cdc7654 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] 10.222.0.20 "GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6" status: 200 len: 2832 microversion: 2.32 time: 0.621962 Oct 04 18:48:51.504267 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2294/4650] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:48:50 2022] GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6 => generated 2832 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:48:51.537701 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4faff2be-1aa2-49c6-b1de-41c2433200d8 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:51.539303 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4faff2be-1aa2-49c6-b1de-41c2433200d8 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] [instance: 317c7bd8-4f1e-4210-bb33-087557a1f4d6] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:51.563189 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4faff2be-1aa2-49c6-b1de-41c2433200d8 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:51.563758 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4faff2be-1aa2-49c6-b1de-41c2433200d8 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:51.564331 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4faff2be-1aa2-49c6-b1de-41c2433200d8 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:51.564959 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4faff2be-1aa2-49c6-b1de-41c2433200d8 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:51.577497 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4faff2be-1aa2-49c6-b1de-41c2433200d8 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:51.582716 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4faff2be-1aa2-49c6-b1de-41c2433200d8 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:51.750036 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e6c9bd46-9af0-40a2-9d98-75f06769f198 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:51.764261 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e6c9bd46-9af0-40a2-9d98-75f06769f198 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a" status: 200 len: 1516 microversion: 2.1 time: 0.398508 Oct 04 18:48:51.772986 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2357/4651] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:51 2022] GET /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a => generated 1516 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:51.838622 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4faff2be-1aa2-49c6-b1de-41c2433200d8 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] 10.222.0.20 "GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.306348 Oct 04 18:48:51.839597 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2295/4652] 10.222.0.20 () {60 vars in 1316 bytes} [Tue Oct 4 18:48:51 2022] GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6/os-interface => generated 1831 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:48:52.371616 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4952bea8-966a-4dfd-bea1-267d25f4fc9e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:52.373498 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-4952bea8-966a-4dfd-bea1-267d25f4fc9e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:52.389946 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4952bea8-966a-4dfd-bea1-267d25f4fc9e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:52.390426 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4952bea8-966a-4dfd-bea1-267d25f4fc9e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:52.390868 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4952bea8-966a-4dfd-bea1-267d25f4fc9e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:52.391588 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4952bea8-966a-4dfd-bea1-267d25f4fc9e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:52.392088 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4952bea8-966a-4dfd-bea1-267d25f4fc9e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:52.392507 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4952bea8-966a-4dfd-bea1-267d25f4fc9e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:52.465263 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:48:52.811569 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0f20d904-d34f-4da6-b17a-646292e0e180 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:52.814200 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-4952bea8-966a-4dfd-bea1-267d25f4fc9e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:52.832456 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0f20d904-d34f-4da6-b17a-646292e0e180 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: 406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:52.832456 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0f20d904-d34f-4da6-b17a-646292e0e180 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:52.832456 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0f20d904-d34f-4da6-b17a-646292e0e180 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:52.832456 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0f20d904-d34f-4da6-b17a-646292e0e180 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:52.832456 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0f20d904-d34f-4da6-b17a-646292e0e180 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:52.832456 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0f20d904-d34f-4da6-b17a-646292e0e180 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:52.832456 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0f20d904-d34f-4da6-b17a-646292e0e180 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:52.840506 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-4952bea8-966a-4dfd-bea1-267d25f4fc9e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1526 microversion: 2.1 time: 0.471529 Oct 04 18:48:52.841127 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2358/4653] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:52 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1526 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:53.228094 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0f20d904-d34f-4da6-b17a-646292e0e180 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:53.236664 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0f20d904-d34f-4da6-b17a-646292e0e180 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a" status: 200 len: 1516 microversion: 2.1 time: 0.429846 Oct 04 18:48:53.238942 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2296/4654] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:52 2022] GET /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a => generated 1516 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:53.869917 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b968bd05-0c7f-45ea-944b-0c5e52cf3b24 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:53.870488 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b968bd05-0c7f-45ea-944b-0c5e52cf3b24 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:53.897519 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b968bd05-0c7f-45ea-944b-0c5e52cf3b24 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:53.902831 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b968bd05-0c7f-45ea-944b-0c5e52cf3b24 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:53.904705 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b968bd05-0c7f-45ea-944b-0c5e52cf3b24 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:53.905633 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b968bd05-0c7f-45ea-944b-0c5e52cf3b24 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:53.913881 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b968bd05-0c7f-45ea-944b-0c5e52cf3b24 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:53.914641 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b968bd05-0c7f-45ea-944b-0c5e52cf3b24 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:54.266710 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9d4ef4e7-c208-472f-bf52-d6d98078bc34 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:54.268644 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9d4ef4e7-c208-472f-bf52-d6d98078bc34 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: 406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:54.286900 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9d4ef4e7-c208-472f-bf52-d6d98078bc34 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:54.289621 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9d4ef4e7-c208-472f-bf52-d6d98078bc34 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:54.292532 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9d4ef4e7-c208-472f-bf52-d6d98078bc34 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:54.295592 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9d4ef4e7-c208-472f-bf52-d6d98078bc34 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:54.301056 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9d4ef4e7-c208-472f-bf52-d6d98078bc34 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:54.301752 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9d4ef4e7-c208-472f-bf52-d6d98078bc34 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:54.390033 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b968bd05-0c7f-45ea-944b-0c5e52cf3b24 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:54.422644 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b968bd05-0c7f-45ea-944b-0c5e52cf3b24 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1526 microversion: 2.1 time: 0.557994 Oct 04 18:48:54.443428 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2359/4655] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:53 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1526 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:54.738660 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9d4ef4e7-c208-472f-bf52-d6d98078bc34 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:54.791045 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9d4ef4e7-c208-472f-bf52-d6d98078bc34 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a" status: 200 len: 1516 microversion: 2.1 time: 0.528910 Oct 04 18:48:54.801562 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2297/4656] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:54 2022] GET /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a => generated 1516 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:48:55.470460 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2865a8b7-1135-4848-8fbd-4bc1f231f8f2 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:55.471073 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2865a8b7-1135-4848-8fbd-4bc1f231f8f2 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:55.492816 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2865a8b7-1135-4848-8fbd-4bc1f231f8f2 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:55.492816 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2865a8b7-1135-4848-8fbd-4bc1f231f8f2 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:55.498101 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2865a8b7-1135-4848-8fbd-4bc1f231f8f2 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:55.504545 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2865a8b7-1135-4848-8fbd-4bc1f231f8f2 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:55.505114 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2865a8b7-1135-4848-8fbd-4bc1f231f8f2 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:55.508467 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2865a8b7-1135-4848-8fbd-4bc1f231f8f2 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:55.826250 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-14e246f9-b790-4518-85f0-745aaadb30f3 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:55.827461 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-14e246f9-b790-4518-85f0-745aaadb30f3 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: 406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:55.852514 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-14e246f9-b790-4518-85f0-745aaadb30f3 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:55.853498 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-14e246f9-b790-4518-85f0-745aaadb30f3 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:55.860782 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-14e246f9-b790-4518-85f0-745aaadb30f3 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:55.862571 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-14e246f9-b790-4518-85f0-745aaadb30f3 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:55.864497 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-14e246f9-b790-4518-85f0-745aaadb30f3 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:55.873607 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-14e246f9-b790-4518-85f0-745aaadb30f3 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:55.952541 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-2865a8b7-1135-4848-8fbd-4bc1f231f8f2 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:55.961023 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2865a8b7-1135-4848-8fbd-4bc1f231f8f2 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1526 microversion: 2.1 time: 0.495384 Oct 04 18:48:55.968536 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2360/4657] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:55 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1526 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:56.450101 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-14e246f9-b790-4518-85f0-745aaadb30f3 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:56.487472 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-14e246f9-b790-4518-85f0-745aaadb30f3 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a" status: 200 len: 1516 microversion: 2.1 time: 0.652166 Oct 04 18:48:56.511238 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2298/4658] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:55 2022] GET /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a => generated 1516 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:56.995967 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ea955f64-a5ff-4220-b30d-1b26f4d1db88 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:56.996665 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ea955f64-a5ff-4220-b30d-1b26f4d1db88 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:57.011648 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ea955f64-a5ff-4220-b30d-1b26f4d1db88 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:57.012181 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ea955f64-a5ff-4220-b30d-1b26f4d1db88 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:57.015557 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ea955f64-a5ff-4220-b30d-1b26f4d1db88 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:57.016557 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ea955f64-a5ff-4220-b30d-1b26f4d1db88 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:57.023450 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ea955f64-a5ff-4220-b30d-1b26f4d1db88 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:57.023761 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ea955f64-a5ff-4220-b30d-1b26f4d1db88 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:57.399593 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-0f97a39f-8af9-4f9d-bf36-f018c693b8bc req-94efb25e-fb57-4fbb-b818-fb794b3430f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "317c7bd8-4f1e-4210-bb33-087557a1f4d6", "tag": "f77c8e43-6a46-4f2a-aef7-77f61d8b7f1a"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:48:57.417737 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-0f97a39f-8af9-4f9d-bf36-f018c693b8bc req-94efb25e-fb57-4fbb-b818-fb794b3430f6 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:57.436178 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-0f97a39f-8af9-4f9d-bf36-f018c693b8bc req-94efb25e-fb57-4fbb-b818-fb794b3430f6 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:57.436902 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-0f97a39f-8af9-4f9d-bf36-f018c693b8bc req-94efb25e-fb57-4fbb-b818-fb794b3430f6 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:57.479939 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-0f97a39f-8af9-4f9d-bf36-f018c693b8bc req-94efb25e-fb57-4fbb-b818-fb794b3430f6 service nova] Creating event network-changed:f77c8e43-6a46-4f2a-aef7-77f61d8b7f1a for instance 317c7bd8-4f1e-4210-bb33-087557a1f4d6 on n-h1-850501-14 Oct 04 18:48:57.510298 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-0f97a39f-8af9-4f9d-bf36-f018c693b8bc req-94efb25e-fb57-4fbb-b818-fb794b3430f6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108501 Oct 04 18:48:57.511310 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2299/4659] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:48:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:48:57.530108 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c6d31c75-ae74-4024-803b-9506e30d644f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:57.530975 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c6d31c75-ae74-4024-803b-9506e30d644f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: 406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:57.545371 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c6d31c75-ae74-4024-803b-9506e30d644f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:57.545897 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c6d31c75-ae74-4024-803b-9506e30d644f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:57.546349 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c6d31c75-ae74-4024-803b-9506e30d644f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:57.547087 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c6d31c75-ae74-4024-803b-9506e30d644f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:57.547547 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c6d31c75-ae74-4024-803b-9506e30d644f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:57.547978 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c6d31c75-ae74-4024-803b-9506e30d644f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:57.573278 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=100 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:48:58.100921 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ea955f64-a5ff-4220-b30d-1b26f4d1db88 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:58.114998 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ea955f64-a5ff-4220-b30d-1b26f4d1db88 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1526 microversion: 2.1 time: 1.125899 Oct 04 18:48:58.128864 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2361/4660] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:56 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1526 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:58.412708 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c6d31c75-ae74-4024-803b-9506e30d644f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:58.428974 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c6d31c75-ae74-4024-803b-9506e30d644f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a" status: 200 len: 1516 microversion: 2.1 time: 0.916366 Oct 04 18:48:58.437872 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2300/4661] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:57 2022] GET /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a => generated 1516 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:58.559996 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2836fa39-2c92-4b5a-9ff6-a629d7c41381 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1731942374", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": [{"uuid": "8e684a5f-0995-474b-b515-28954add873e"}]}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:48:58.610518 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=60 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:48:59.155065 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a2576f0c-36a1-4aa6-b160-0ac39848763e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:59.156004 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a2576f0c-36a1-4aa6-b160-0ac39848763e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:59.166271 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a2576f0c-36a1-4aa6-b160-0ac39848763e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:59.176866 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a2576f0c-36a1-4aa6-b160-0ac39848763e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:59.177573 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a2576f0c-36a1-4aa6-b160-0ac39848763e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:59.178518 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a2576f0c-36a1-4aa6-b160-0ac39848763e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:59.181019 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a2576f0c-36a1-4aa6-b160-0ac39848763e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:59.181640 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a2576f0c-36a1-4aa6-b160-0ac39848763e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:59.727719 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a2576f0c-36a1-4aa6-b160-0ac39848763e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:59.738476 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a2576f0c-36a1-4aa6-b160-0ac39848763e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1526 microversion: 2.1 time: 0.587405 Oct 04 18:48:59.739076 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2301/4662] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:59 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1526 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:48:59.761587 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3f40c0c1-dbe9-4a57-86e1-8e1bc2019f5e tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:59.774169 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3f40c0c1-dbe9-4a57-86e1-8e1bc2019f5e tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: 406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:59.791520 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f40c0c1-dbe9-4a57-86e1-8e1bc2019f5e tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:59.794426 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f40c0c1-dbe9-4a57-86e1-8e1bc2019f5e tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:59.795640 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f40c0c1-dbe9-4a57-86e1-8e1bc2019f5e tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:59.801073 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f40c0c1-dbe9-4a57-86e1-8e1bc2019f5e tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:59.801958 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f40c0c1-dbe9-4a57-86e1-8e1bc2019f5e tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:59.805387 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f40c0c1-dbe9-4a57-86e1-8e1bc2019f5e tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:00.347607 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3f40c0c1-dbe9-4a57-86e1-8e1bc2019f5e tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:00.359381 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3f40c0c1-dbe9-4a57-86e1-8e1bc2019f5e tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a" status: 200 len: 1516 microversion: 2.1 time: 0.604118 Oct 04 18:49:00.361079 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2302/4663] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:59 2022] GET /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a => generated 1516 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:00.766352 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-341309a9-c350-4aa3-9d1e-93c066ff6b1c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:00.767139 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-341309a9-c350-4aa3-9d1e-93c066ff6b1c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:00.781147 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-341309a9-c350-4aa3-9d1e-93c066ff6b1c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:00.781700 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-341309a9-c350-4aa3-9d1e-93c066ff6b1c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:00.782158 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-341309a9-c350-4aa3-9d1e-93c066ff6b1c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:00.784529 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-341309a9-c350-4aa3-9d1e-93c066ff6b1c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:00.785196 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-341309a9-c350-4aa3-9d1e-93c066ff6b1c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:00.785852 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-341309a9-c350-4aa3-9d1e-93c066ff6b1c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:00.848517 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.neutron [None req-2836fa39-2c92-4b5a-9ff6-a629d7c41381 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] validate_networks() for [('8e684a5f-0995-474b-b515-28954add873e', None, None, None, None, None)] {{(pid=123001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:49:01.284969 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-341309a9-c350-4aa3-9d1e-93c066ff6b1c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:01.304650 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-341309a9-c350-4aa3-9d1e-93c066ff6b1c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1526 microversion: 2.1 time: 0.542683 Oct 04 18:49:01.321026 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2303/4664] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:00 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1526 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:49:01.396236 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-62738bf1-cb6f-4db5-8d3d-5b98e6eb55f2 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:01.396882 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-62738bf1-cb6f-4db5-8d3d-5b98e6eb55f2 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: 406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:01.407133 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-62738bf1-cb6f-4db5-8d3d-5b98e6eb55f2 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:01.407841 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-62738bf1-cb6f-4db5-8d3d-5b98e6eb55f2 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:01.409421 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-62738bf1-cb6f-4db5-8d3d-5b98e6eb55f2 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:01.411904 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-62738bf1-cb6f-4db5-8d3d-5b98e6eb55f2 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:01.413092 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-62738bf1-cb6f-4db5-8d3d-5b98e6eb55f2 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:01.413761 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-62738bf1-cb6f-4db5-8d3d-5b98e6eb55f2 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:01.947938 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-62738bf1-cb6f-4db5-8d3d-5b98e6eb55f2 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:01.955171 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-62738bf1-cb6f-4db5-8d3d-5b98e6eb55f2 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a" status: 200 len: 1516 microversion: 2.1 time: 0.570106 Oct 04 18:49:01.972096 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2304/4665] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:01 2022] GET /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a => generated 1516 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:49:02.016717 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-2836fa39-2c92-4b5a-9ff6-a629d7c41381 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:49:02.017470 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-2836fa39-2c92-4b5a-9ff6-a629d7c41381 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:49:02.019194 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-2836fa39-2c92-4b5a-9ff6-a629d7c41381 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:49:02.019872 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-2836fa39-2c92-4b5a-9ff6-a629d7c41381 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:49:02.020770 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-2836fa39-2c92-4b5a-9ff6-a629d7c41381 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:49:02.033135 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2836fa39-2c92-4b5a-9ff6-a629d7c41381 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:02.035054 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2836fa39-2c92-4b5a-9ff6-a629d7c41381 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:02.035696 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2836fa39-2c92-4b5a-9ff6-a629d7c41381 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:02.038001 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2836fa39-2c92-4b5a-9ff6-a629d7c41381 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:02.038770 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2836fa39-2c92-4b5a-9ff6-a629d7c41381 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:02.039444 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2836fa39-2c92-4b5a-9ff6-a629d7c41381 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:02.069032 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-2836fa39-2c92-4b5a-9ff6-a629d7c41381 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Getting quotas for project 4154ec20e0354ee6a425ba853b8efe67. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:49:02.077215 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-2836fa39-2c92-4b5a-9ff6-a629d7c41381 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Getting quotas for user c56b67cede6b46f5a36a723d361b3245 and project 4154ec20e0354ee6a425ba853b8efe67. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:49:02.096785 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2836fa39-2c92-4b5a-9ff6-a629d7c41381 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Going to run 1 instances... {{(pid=123001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:49:02.100488 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2836fa39-2c92-4b5a-9ff6-a629d7c41381 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: 0e392b33-c106-4158-b4be-8972aa5794f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:49:02.264220 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2836fa39-2c92-4b5a-9ff6-a629d7c41381 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.128919 Oct 04 18:49:02.268445 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2362/4666] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:48:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 4138 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:49:02.281504 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-392dd063-7619-4502-bd55-7ee282ab4f2e tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:02.282324 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-392dd063-7619-4502-bd55-7ee282ab4f2e tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: 0e392b33-c106-4158-b4be-8972aa5794f4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:02.333106 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1bc8a972-ea11-462c-a642-9ace5a7d9dc6 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:02.334248 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1bc8a972-ea11-462c-a642-9ace5a7d9dc6 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:02.350641 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1bc8a972-ea11-462c-a642-9ace5a7d9dc6 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:02.353000 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1bc8a972-ea11-462c-a642-9ace5a7d9dc6 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:02.354665 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1bc8a972-ea11-462c-a642-9ace5a7d9dc6 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:02.357136 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1bc8a972-ea11-462c-a642-9ace5a7d9dc6 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:02.359958 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1bc8a972-ea11-462c-a642-9ace5a7d9dc6 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:02.359958 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1bc8a972-ea11-462c-a642-9ace5a7d9dc6 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:02.462469 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-392dd063-7619-4502-bd55-7ee282ab4f2e tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:02.481166 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-392dd063-7619-4502-bd55-7ee282ab4f2e tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/0e392b33-c106-4158-b4be-8972aa5794f4" status: 200 len: 1215 microversion: 2.1 time: 0.205514 Oct 04 18:49:02.485252 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2305/4667] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:02 2022] GET /compute/v2.1/servers/0e392b33-c106-4158-b4be-8972aa5794f4 => generated 1215 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:02.655740 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1bc8a972-ea11-462c-a642-9ace5a7d9dc6 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:02.671549 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1bc8a972-ea11-462c-a642-9ace5a7d9dc6 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1508 microversion: 2.1 time: 0.342852 Oct 04 18:49:02.672624 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2363/4668] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:02 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1508 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:02.999795 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9bf17ee2-1fa8-4700-932c-37f85cc4b9f8 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:03.003097 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9bf17ee2-1fa8-4700-932c-37f85cc4b9f8 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: 406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:03.025846 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9bf17ee2-1fa8-4700-932c-37f85cc4b9f8 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:03.031689 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9bf17ee2-1fa8-4700-932c-37f85cc4b9f8 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:03.031689 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9bf17ee2-1fa8-4700-932c-37f85cc4b9f8 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:03.032690 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9bf17ee2-1fa8-4700-932c-37f85cc4b9f8 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:03.034917 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9bf17ee2-1fa8-4700-932c-37f85cc4b9f8 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:03.037613 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9bf17ee2-1fa8-4700-932c-37f85cc4b9f8 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:03.513244 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5e43cc20-8237-4e54-9a31-6b99887080df tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:03.513949 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5e43cc20-8237-4e54-9a31-6b99887080df tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: 0e392b33-c106-4158-b4be-8972aa5794f4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:03.585269 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9bf17ee2-1fa8-4700-932c-37f85cc4b9f8 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:03.598430 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9bf17ee2-1fa8-4700-932c-37f85cc4b9f8 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a" status: 200 len: 1516 microversion: 2.1 time: 0.609195 Oct 04 18:49:03.600377 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2306/4669] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:02 2022] GET /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a => generated 1516 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:03.667632 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5e43cc20-8237-4e54-9a31-6b99887080df tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:03.701670 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8694422f-b9f1-410b-b9b6-0f365fa44676 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:03.702447 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8694422f-b9f1-410b-b9b6-0f365fa44676 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:03.717622 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5e43cc20-8237-4e54-9a31-6b99887080df tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/0e392b33-c106-4158-b4be-8972aa5794f4" status: 200 len: 1215 microversion: 2.1 time: 0.206514 Oct 04 18:49:03.720641 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8694422f-b9f1-410b-b9b6-0f365fa44676 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:03.722750 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2364/4670] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:03 2022] GET /compute/v2.1/servers/0e392b33-c106-4158-b4be-8972aa5794f4 => generated 1215 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:03.724791 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8694422f-b9f1-410b-b9b6-0f365fa44676 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:03.726793 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8694422f-b9f1-410b-b9b6-0f365fa44676 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:03.728721 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8694422f-b9f1-410b-b9b6-0f365fa44676 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:03.729366 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8694422f-b9f1-410b-b9b6-0f365fa44676 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:03.731215 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8694422f-b9f1-410b-b9b6-0f365fa44676 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:03.958993 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8694422f-b9f1-410b-b9b6-0f365fa44676 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:03.974231 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8694422f-b9f1-410b-b9b6-0f365fa44676 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1508 microversion: 2.1 time: 0.276574 Oct 04 18:49:03.988428 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2307/4671] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:03 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1508 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:04.453632 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-b93952f9-55b3-4cba-a30c-3db40fda8a7a req-ba00e0b1-4b62-4064-8e5c-84670a2e28ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95fb1a13-7441-4f74-ad81-5a9413496545", "name": "network-vif-unplugged", "status": "completed", "tag": "73befc4a-98f7-414e-8302-6ba3a3fd9481"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:49:04.486267 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-b93952f9-55b3-4cba-a30c-3db40fda8a7a req-ba00e0b1-4b62-4064-8e5c-84670a2e28ff service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:04.489950 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-b93952f9-55b3-4cba-a30c-3db40fda8a7a req-ba00e0b1-4b62-4064-8e5c-84670a2e28ff service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:04.490622 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-b93952f9-55b3-4cba-a30c-3db40fda8a7a req-ba00e0b1-4b62-4064-8e5c-84670a2e28ff service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:04.519638 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-b93952f9-55b3-4cba-a30c-3db40fda8a7a req-ba00e0b1-4b62-4064-8e5c-84670a2e28ff service nova] Creating event network-vif-unplugged:73befc4a-98f7-414e-8302-6ba3a3fd9481 for instance 95fb1a13-7441-4f74-ad81-5a9413496545 on n-h1-850501-14 Oct 04 18:49:04.541191 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-b93952f9-55b3-4cba-a30c-3db40fda8a7a req-ba00e0b1-4b62-4064-8e5c-84670a2e28ff service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.091310 Oct 04 18:49:04.550258 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2365/4672] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:49:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:49:04.632436 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-60b199ca-18d1-424a-ab5d-9782c498dfd0 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:04.633369 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-60b199ca-18d1-424a-ab5d-9782c498dfd0 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: 406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:04.647939 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-60b199ca-18d1-424a-ab5d-9782c498dfd0 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:04.654594 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-60b199ca-18d1-424a-ab5d-9782c498dfd0 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:04.655847 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-60b199ca-18d1-424a-ab5d-9782c498dfd0 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:04.656853 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-60b199ca-18d1-424a-ab5d-9782c498dfd0 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:04.666683 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-60b199ca-18d1-424a-ab5d-9782c498dfd0 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:04.666683 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-60b199ca-18d1-424a-ab5d-9782c498dfd0 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:04.753926 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-31a12aa8-2faa-45d6-9538-2cb4b2181cb7 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:04.754584 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-31a12aa8-2faa-45d6-9538-2cb4b2181cb7 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: 0e392b33-c106-4158-b4be-8972aa5794f4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:04.776406 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-31a12aa8-2faa-45d6-9538-2cb4b2181cb7 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:04.776920 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-31a12aa8-2faa-45d6-9538-2cb4b2181cb7 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:04.777374 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-31a12aa8-2faa-45d6-9538-2cb4b2181cb7 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:04.778100 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-31a12aa8-2faa-45d6-9538-2cb4b2181cb7 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:04.804229 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-31a12aa8-2faa-45d6-9538-2cb4b2181cb7 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:04.811076 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-31a12aa8-2faa-45d6-9538-2cb4b2181cb7 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:05.039962 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-60b199ca-18d1-424a-ab5d-9782c498dfd0 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:05.051810 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-60b199ca-18d1-424a-ab5d-9782c498dfd0 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a" status: 200 len: 1516 microversion: 2.1 time: 0.425194 Oct 04 18:49:05.053980 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2308/4673] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:04 2022] GET /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a => generated 1516 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:05.061245 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1fab1e89-878c-4268-ac68-fc0e96f995fd tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:05.061604 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1fab1e89-878c-4268-ac68-fc0e96f995fd tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:05.069171 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1fab1e89-878c-4268-ac68-fc0e96f995fd tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:05.069678 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1fab1e89-878c-4268-ac68-fc0e96f995fd tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:05.070125 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1fab1e89-878c-4268-ac68-fc0e96f995fd tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:05.071093 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1fab1e89-878c-4268-ac68-fc0e96f995fd tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:05.071569 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1fab1e89-878c-4268-ac68-fc0e96f995fd tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:05.072021 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1fab1e89-878c-4268-ac68-fc0e96f995fd tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:05.078018 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-31a12aa8-2faa-45d6-9538-2cb4b2181cb7 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:05.103264 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-31a12aa8-2faa-45d6-9538-2cb4b2181cb7 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/0e392b33-c106-4158-b4be-8972aa5794f4" status: 200 len: 1219 microversion: 2.1 time: 0.356505 Oct 04 18:49:05.123043 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2366/4674] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:04 2022] GET /compute/v2.1/servers/0e392b33-c106-4158-b4be-8972aa5794f4 => generated 1219 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:05.293497 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1fab1e89-878c-4268-ac68-fc0e96f995fd tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:05.302666 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1fab1e89-878c-4268-ac68-fc0e96f995fd tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1508 microversion: 2.1 time: 0.247591 Oct 04 18:49:05.313960 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2309/4675] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:05 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1508 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:06.081932 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6d3de131-ddea-4914-b934-8c4479c51e1b tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:06.082580 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6d3de131-ddea-4914-b934-8c4479c51e1b tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: 406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:06.093744 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6d3de131-ddea-4914-b934-8c4479c51e1b tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:06.096426 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6d3de131-ddea-4914-b934-8c4479c51e1b tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:06.096426 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6d3de131-ddea-4914-b934-8c4479c51e1b tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:06.096426 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6d3de131-ddea-4914-b934-8c4479c51e1b tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:06.096774 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6d3de131-ddea-4914-b934-8c4479c51e1b tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:06.097488 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6d3de131-ddea-4914-b934-8c4479c51e1b tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:06.130589 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-79c560a6-a72c-4dd3-abdb-d7589c2d1f89 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:06.131272 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-79c560a6-a72c-4dd3-abdb-d7589c2d1f89 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: 0e392b33-c106-4158-b4be-8972aa5794f4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:06.161168 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-79c560a6-a72c-4dd3-abdb-d7589c2d1f89 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:06.162234 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-79c560a6-a72c-4dd3-abdb-d7589c2d1f89 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:06.162702 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-79c560a6-a72c-4dd3-abdb-d7589c2d1f89 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:06.166081 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-79c560a6-a72c-4dd3-abdb-d7589c2d1f89 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:06.167557 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-79c560a6-a72c-4dd3-abdb-d7589c2d1f89 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:06.169803 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-79c560a6-a72c-4dd3-abdb-d7589c2d1f89 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:06.385459 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-79c560a6-a72c-4dd3-abdb-d7589c2d1f89 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:06.398316 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-79c560a6-a72c-4dd3-abdb-d7589c2d1f89 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/0e392b33-c106-4158-b4be-8972aa5794f4" status: 200 len: 1267 microversion: 2.1 time: 0.272801 Oct 04 18:49:06.404210 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2310/4676] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:06 2022] GET /compute/v2.1/servers/0e392b33-c106-4158-b4be-8972aa5794f4 => generated 1267 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:49:06.434698 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e0632f18-0190-4531-8360-ed9bd595523c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:06.437076 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e0632f18-0190-4531-8360-ed9bd595523c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:06.449255 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6d3de131-ddea-4914-b934-8c4479c51e1b tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:06.463199 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e0632f18-0190-4531-8360-ed9bd595523c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:06.463932 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e0632f18-0190-4531-8360-ed9bd595523c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:06.464564 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e0632f18-0190-4531-8360-ed9bd595523c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:06.465464 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e0632f18-0190-4531-8360-ed9bd595523c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:06.466341 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e0632f18-0190-4531-8360-ed9bd595523c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:06.466936 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e0632f18-0190-4531-8360-ed9bd595523c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:06.467769 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6d3de131-ddea-4914-b934-8c4479c51e1b tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a" status: 200 len: 1516 microversion: 2.1 time: 0.391000 Oct 04 18:49:06.469804 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2367/4677] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:06 2022] GET /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a => generated 1516 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:06.746668 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e0632f18-0190-4531-8360-ed9bd595523c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:06.755728 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e0632f18-0190-4531-8360-ed9bd595523c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1511 microversion: 2.1 time: 0.346654 Oct 04 18:49:06.758856 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2311/4678] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:06 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1511 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:06.794026 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-800ab315-c5bb-4105-b96d-4884a4621d54 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:06.795049 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-800ab315-c5bb-4105-b96d-4884a4621d54 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:06.805699 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-800ab315-c5bb-4105-b96d-4884a4621d54 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:06.806616 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-800ab315-c5bb-4105-b96d-4884a4621d54 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:06.807240 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-800ab315-c5bb-4105-b96d-4884a4621d54 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:06.808247 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-800ab315-c5bb-4105-b96d-4884a4621d54 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:06.808892 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-800ab315-c5bb-4105-b96d-4884a4621d54 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:06.809801 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-800ab315-c5bb-4105-b96d-4884a4621d54 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:07.248591 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-800ab315-c5bb-4105-b96d-4884a4621d54 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:07.263223 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-800ab315-c5bb-4105-b96d-4884a4621d54 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1511 microversion: 2.1 time: 0.475354 Oct 04 18:49:07.264107 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2368/4679] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:06 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1511 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:07.428624 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ddc77b92-27cc-4501-99f0-9267e481804b tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:07.429912 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ddc77b92-27cc-4501-99f0-9267e481804b tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: 0e392b33-c106-4158-b4be-8972aa5794f4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:07.450183 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ddc77b92-27cc-4501-99f0-9267e481804b tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:07.451603 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ddc77b92-27cc-4501-99f0-9267e481804b tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:07.454343 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ddc77b92-27cc-4501-99f0-9267e481804b tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:07.456547 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ddc77b92-27cc-4501-99f0-9267e481804b tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:07.461498 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ddc77b92-27cc-4501-99f0-9267e481804b tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:07.462294 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ddc77b92-27cc-4501-99f0-9267e481804b tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:07.496455 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-64f4baba-bbbd-400e-a512-bae7687aaf87 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:07.499631 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-64f4baba-bbbd-400e-a512-bae7687aaf87 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: 406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:07.519523 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-64f4baba-bbbd-400e-a512-bae7687aaf87 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:07.524909 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-64f4baba-bbbd-400e-a512-bae7687aaf87 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:07.525778 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-64f4baba-bbbd-400e-a512-bae7687aaf87 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:07.528831 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-64f4baba-bbbd-400e-a512-bae7687aaf87 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:07.531029 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-64f4baba-bbbd-400e-a512-bae7687aaf87 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:07.535159 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-64f4baba-bbbd-400e-a512-bae7687aaf87 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:07.648598 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ddc77b92-27cc-4501-99f0-9267e481804b tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:07.659724 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ddc77b92-27cc-4501-99f0-9267e481804b tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/0e392b33-c106-4158-b4be-8972aa5794f4" status: 200 len: 1275 microversion: 2.1 time: 0.236938 Oct 04 18:49:07.667542 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2312/4680] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:07 2022] GET /compute/v2.1/servers/0e392b33-c106-4158-b4be-8972aa5794f4 => generated 1275 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:07.806476 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-64f4baba-bbbd-400e-a512-bae7687aaf87 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:07.828196 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-64f4baba-bbbd-400e-a512-bae7687aaf87 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a" status: 200 len: 1516 microversion: 2.1 time: 0.324205 Oct 04 18:49:07.828196 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2369/4681] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:07 2022] GET /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a => generated 1516 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:08.012806 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-26981e1a-c56c-4412-aabb-6d442cf1f8f6 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:49:08.013711 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-26981e1a-c56c-4412-aabb-6d442cf1f8f6 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:08.028294 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-26981e1a-c56c-4412-aabb-6d442cf1f8f6 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:08.029014 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-26981e1a-c56c-4412-aabb-6d442cf1f8f6 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:08.029922 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-26981e1a-c56c-4412-aabb-6d442cf1f8f6 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:08.032863 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-26981e1a-c56c-4412-aabb-6d442cf1f8f6 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:08.036158 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-26981e1a-c56c-4412-aabb-6d442cf1f8f6 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:08.037784 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-26981e1a-c56c-4412-aabb-6d442cf1f8f6 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:08.099623 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-26981e1a-c56c-4412-aabb-6d442cf1f8f6 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lazy-loading 'flavor' on Instance uuid 95fb1a13-7441-4f74-ad81-5a9413496545 {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:49:08.151061 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-26981e1a-c56c-4412-aabb-6d442cf1f8f6 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] HTTP exception thrown: Cannot 'shelve' instance 95fb1a13-7441-4f74-ad81-5a9413496545 while it is in vm_state shelved_offloaded Oct 04 18:49:08.153181 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-26981e1a-c56c-4412-aabb-6d442cf1f8f6 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Request method failure captured: Oct 04 18:49:08.153181 n-d-850501-14 devstack@n-api.service[123002]: request: POST /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545/action HTTP/1.1 Oct 04 18:49:08.153181 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:49:08.153181 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:49:08.153181 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:49:08.153181 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 14 Oct 04 18:49:08.153181 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:49:08.153181 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:49:08.153181 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:49:08.153181 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:49:08.153181 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH9zAVdj2h4kh6QqBpYrS2CJMhbcXf529VUNrZoZOYhS2tkLYBgw6AHy860DK9jQ3xATqZvC9lQuxt-_H5qKsAI41eznf32K6QSGqVcHXegpVHrDueww23ZMVCBM3D_hH0NTzh4447rgHqcrC-OZE48IfZrRJ9KPLPjAHT57T3mcPIc Oct 04 18:49:08.153181 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:49:08.153181 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:49:08.153181 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:49:08.153181 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:49:08.153181 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:49:08.153181 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:49:08.153181 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: b6c6b9deecde44b5953d22b38b5b0ff1 Oct 04 18:49:08.153181 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:49:08.153181 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:49:08.153181 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:49:08.153181 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6c6b9deecde44b5953d22b38b5b0ff1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b6c6b9deecde44b5953d22b38b5b0ff1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b6c6b9deecde44b5953d22b38b5b0ff1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6c6b9deecde44b5953d22b38b5b0ff1"}]}] Oct 04 18:49:08.153181 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:49:08.153181 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: b6c6b9deecde44b5953d22b38b5b0ff1 Oct 04 18:49:08.153181 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:49:08.153181 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServersNegativeTestJSON-626077540-project Oct 04 18:49:08.153181 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:49:08.153181 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:49:08.153181 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 5b4eb70f22ba4872b890a4f160cc1805 Oct 04 18:49:08.153181 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServersNegativeTestJSON-626077540-project Oct 04 18:49:08.153181 n-d-850501-14 devstack@n-api.service[123002]: Oct 04 18:49:08.153181 n-d-850501-14 devstack@n-api.service[123002]: {"shelve": {}} Oct 04 18:49:08.153181 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:49:08.153181 n-d-850501-14 devstack@n-api.service[123002]: exception: Cannot 'shelve' instance 95fb1a13-7441-4f74-ad81-5a9413496545 while it is in vm_state shelved_offloaded Oct 04 18:49:08.153181 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '95fb1a13-7441-4f74-ad81-5a9413496545', 'body': {'shelve': {}}} Oct 04 18:49:08.153181 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:49:08.153181 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:49:08.153181 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Oct 04 18:49:08.153181 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Oct 04 18:49:08.153181 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 04 18:49:08.153181 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 18:49:08.153181 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 04 18:49:08.153181 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 18:49:08.153181 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 18:49:08.153181 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 18:49:08.153181 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:49:08.153181 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:49:08.153181 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 18:49:08.153181 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 18:49:08.153181 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 95fb1a13-7441-4f74-ad81-5a9413496545 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Oct 04 18:49:08.153181 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:49:08.153181 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:49:08.153181 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:49:08.153181 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:49:08.153181 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:49:08.153181 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:49:08.153181 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:49:08.153181 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:49:08.153181 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:49:08.153181 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:49:08.153181 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Oct 04 18:49:08.153181 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 18:49:08.153181 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 18:49:08.153181 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 18:49:08.159171 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 95fb1a13-7441-4f74-ad81-5a9413496545 while it is in vm_state shelved_offloaded Oct 04 18:49:08.159171 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:49:08.159171 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:49:08.159171 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:49:08.159171 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:49:08.159171 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:49:08.159171 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:49:08.159171 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:49:08.159171 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:49:08.159171 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 95fb1a13-7441-4f74-ad81-5a9413496545 while it is in vm_state shelved_offloaded Oct 04 18:49:08.159171 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:49:08.159171 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-26981e1a-c56c-4412-aabb-6d442cf1f8f6 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Returning 409 to user: Cannot 'shelve' instance 95fb1a13-7441-4f74-ad81-5a9413496545 while it is in vm_state shelved_offloaded {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:49:08.159171 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-26981e1a-c56c-4412-aabb-6d442cf1f8f6 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "POST /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545/action" status: 409 len: 155 microversion: 2.1 time: 0.146425 Oct 04 18:49:08.159171 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2313/4682] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:49:08 2022] POST /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545/action => generated 155 bytes in 148 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:49:08.167178 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-bdeba057-6f65-45a4-856c-ac7ac09722da tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:49:08.167810 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-bdeba057-6f65-45a4-856c-ac7ac09722da tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:08.190313 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bdeba057-6f65-45a4-856c-ac7ac09722da tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:08.194319 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bdeba057-6f65-45a4-856c-ac7ac09722da tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:08.194897 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bdeba057-6f65-45a4-856c-ac7ac09722da tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:08.195662 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bdeba057-6f65-45a4-856c-ac7ac09722da tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:08.196146 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bdeba057-6f65-45a4-856c-ac7ac09722da tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:08.202054 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bdeba057-6f65-45a4-856c-ac7ac09722da tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:08.297778 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-bdeba057-6f65-45a4-856c-ac7ac09722da tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=123001) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 18:49:08.699783 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-157290ef-aec6-4ce6-8fb7-341d3853b3a8 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:08.699783 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-157290ef-aec6-4ce6-8fb7-341d3853b3a8 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: 0e392b33-c106-4158-b4be-8972aa5794f4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:08.703087 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-157290ef-aec6-4ce6-8fb7-341d3853b3a8 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:08.703585 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-157290ef-aec6-4ce6-8fb7-341d3853b3a8 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:08.704031 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-157290ef-aec6-4ce6-8fb7-341d3853b3a8 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:08.704783 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-157290ef-aec6-4ce6-8fb7-341d3853b3a8 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:08.705813 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-157290ef-aec6-4ce6-8fb7-341d3853b3a8 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:08.706254 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-157290ef-aec6-4ce6-8fb7-341d3853b3a8 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:08.731663 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-bdeba057-6f65-45a4-856c-ac7ac09722da tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "POST /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545/action" status: 202 len: 0 microversion: 2.1 time: 0.571192 Oct 04 18:49:08.745270 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2370/4683] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:49:08 2022] POST /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545/action => generated 0 bytes in 583 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:49:08.757265 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c050c602-b0fc-4cce-9e42-f4b5bef9acbc tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:08.764418 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c050c602-b0fc-4cce-9e42-f4b5bef9acbc tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:08.789345 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c050c602-b0fc-4cce-9e42-f4b5bef9acbc tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:08.792654 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c050c602-b0fc-4cce-9e42-f4b5bef9acbc tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:08.793304 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c050c602-b0fc-4cce-9e42-f4b5bef9acbc tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:08.800171 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c050c602-b0fc-4cce-9e42-f4b5bef9acbc tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:08.808117 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c050c602-b0fc-4cce-9e42-f4b5bef9acbc tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:08.809782 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c050c602-b0fc-4cce-9e42-f4b5bef9acbc tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:09.345221 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c050c602-b0fc-4cce-9e42-f4b5bef9acbc tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:09.386003 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c050c602-b0fc-4cce-9e42-f4b5bef9acbc tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1459 microversion: 2.1 time: 0.639373 Oct 04 18:49:09.387112 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2371/4684] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:08 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1459 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:09.406309 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8f62a343-38b5-4ced-a924-cb64e1c43bcf tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:09.407883 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8f62a343-38b5-4ced-a924-cb64e1c43bcf tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: 406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:09.425162 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-157290ef-aec6-4ce6-8fb7-341d3853b3a8 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:09.437712 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-157290ef-aec6-4ce6-8fb7-341d3853b3a8 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/0e392b33-c106-4158-b4be-8972aa5794f4" status: 200 len: 1315 microversion: 2.1 time: 0.745990 Oct 04 18:49:09.440316 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2314/4685] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:08 2022] GET /compute/v2.1/servers/0e392b33-c106-4158-b4be-8972aa5794f4 => generated 1315 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:09.442572 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8f62a343-38b5-4ced-a924-cb64e1c43bcf tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:09.444523 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8f62a343-38b5-4ced-a924-cb64e1c43bcf tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:09.446496 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8f62a343-38b5-4ced-a924-cb64e1c43bcf tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:09.447474 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8f62a343-38b5-4ced-a924-cb64e1c43bcf tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:09.448916 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8f62a343-38b5-4ced-a924-cb64e1c43bcf tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:09.450002 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8f62a343-38b5-4ced-a924-cb64e1c43bcf tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:09.672668 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8f62a343-38b5-4ced-a924-cb64e1c43bcf tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:09.682718 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8f62a343-38b5-4ced-a924-cb64e1c43bcf tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a" status: 200 len: 1534 microversion: 2.1 time: 0.294353 Oct 04 18:49:09.683511 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2372/4686] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:09 2022] GET /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a => generated 1534 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:10.415974 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c9897fee-4454-4224-b9c4-ffea3ed4018c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:10.417234 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c9897fee-4454-4224-b9c4-ffea3ed4018c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:10.428111 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c9897fee-4454-4224-b9c4-ffea3ed4018c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:10.429055 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c9897fee-4454-4224-b9c4-ffea3ed4018c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:10.430869 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c9897fee-4454-4224-b9c4-ffea3ed4018c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:10.432595 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c9897fee-4454-4224-b9c4-ffea3ed4018c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:10.433443 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c9897fee-4454-4224-b9c4-ffea3ed4018c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:10.435295 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c9897fee-4454-4224-b9c4-ffea3ed4018c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:10.466767 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9f78bc71-6d2b-4253-ae26-bf4c8d5ec895 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:10.468076 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-9f78bc71-6d2b-4253-ae26-bf4c8d5ec895 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: 0e392b33-c106-4158-b4be-8972aa5794f4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:10.482544 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9f78bc71-6d2b-4253-ae26-bf4c8d5ec895 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:10.487965 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9f78bc71-6d2b-4253-ae26-bf4c8d5ec895 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:10.495039 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9f78bc71-6d2b-4253-ae26-bf4c8d5ec895 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:10.496428 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9f78bc71-6d2b-4253-ae26-bf4c8d5ec895 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:10.497504 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9f78bc71-6d2b-4253-ae26-bf4c8d5ec895 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:10.498333 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9f78bc71-6d2b-4253-ae26-bf4c8d5ec895 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:10.882491 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9f78bc71-6d2b-4253-ae26-bf4c8d5ec895 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:10.898990 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9f78bc71-6d2b-4253-ae26-bf4c8d5ec895 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/0e392b33-c106-4158-b4be-8972aa5794f4" status: 200 len: 1315 microversion: 2.1 time: 0.433953 Oct 04 18:49:10.900416 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2373/4687] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:10 2022] GET /compute/v2.1/servers/0e392b33-c106-4158-b4be-8972aa5794f4 => generated 1315 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:49:10.917077 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0dc7ade3-25ec-48a5-b6ce-66c233103bca tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:10.919098 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0dc7ade3-25ec-48a5-b6ce-66c233103bca tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: 406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:10.958342 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0dc7ade3-25ec-48a5-b6ce-66c233103bca tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:10.960193 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0dc7ade3-25ec-48a5-b6ce-66c233103bca tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:10.961369 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c9897fee-4454-4224-b9c4-ffea3ed4018c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:10.962179 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0dc7ade3-25ec-48a5-b6ce-66c233103bca tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:10.965491 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0dc7ade3-25ec-48a5-b6ce-66c233103bca tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:10.970081 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0dc7ade3-25ec-48a5-b6ce-66c233103bca tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:10.971706 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0dc7ade3-25ec-48a5-b6ce-66c233103bca tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:10.991401 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c9897fee-4454-4224-b9c4-ffea3ed4018c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1459 microversion: 2.1 time: 0.566375 Oct 04 18:49:10.991401 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2315/4688] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:10 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1459 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:10.999210 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-cceeb063-54fe-4103-9b4f-910d4d15b835 req-b0cac222-78d8-4185-9d10-c5198ee84fb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e392b33-c106-4158-b4be-8972aa5794f4", "tag": "cc7230e3-6e5f-49f8-a0fc-82fea2c1bf39"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:49:11.011968 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-cceeb063-54fe-4103-9b4f-910d4d15b835 req-b0cac222-78d8-4185-9d10-c5198ee84fb1 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:11.013206 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-cceeb063-54fe-4103-9b4f-910d4d15b835 req-b0cac222-78d8-4185-9d10-c5198ee84fb1 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:11.014397 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-cceeb063-54fe-4103-9b4f-910d4d15b835 req-b0cac222-78d8-4185-9d10-c5198ee84fb1 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:11.037817 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-cceeb063-54fe-4103-9b4f-910d4d15b835 req-b0cac222-78d8-4185-9d10-c5198ee84fb1 service nova] Creating event network-changed:cc7230e3-6e5f-49f8-a0fc-82fea2c1bf39 for instance 0e392b33-c106-4158-b4be-8972aa5794f4 on n-h1-850501-14 Oct 04 18:49:11.051125 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-cceeb063-54fe-4103-9b4f-910d4d15b835 req-b0cac222-78d8-4185-9d10-c5198ee84fb1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066876 Oct 04 18:49:11.055998 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2316/4689] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:49:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:49:11.210229 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0dc7ade3-25ec-48a5-b6ce-66c233103bca tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:11.228643 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0dc7ade3-25ec-48a5-b6ce-66c233103bca tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a" status: 200 len: 1522 microversion: 2.1 time: 0.326706 Oct 04 18:49:11.229692 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2374/4690] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:10 2022] GET /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a => generated 1522 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:11.433992 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-06f692b6-8abf-47c0-8848-2e4d9df59727 req-a9f3ce2c-07f1-48ac-852b-4a504f141b97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a", "name": "network-vif-unplugged", "status": "completed", "tag": "25667d58-f07b-4faa-8414-20c890cec66d"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:49:11.476616 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-06f692b6-8abf-47c0-8848-2e4d9df59727 req-a9f3ce2c-07f1-48ac-852b-4a504f141b97 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:11.477223 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-06f692b6-8abf-47c0-8848-2e4d9df59727 req-a9f3ce2c-07f1-48ac-852b-4a504f141b97 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:11.477878 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-06f692b6-8abf-47c0-8848-2e4d9df59727 req-a9f3ce2c-07f1-48ac-852b-4a504f141b97 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:11.512434 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-06f692b6-8abf-47c0-8848-2e4d9df59727 req-a9f3ce2c-07f1-48ac-852b-4a504f141b97 service nova] Creating event network-vif-unplugged:25667d58-f07b-4faa-8414-20c890cec66d for instance 406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a on n-h2-850501-14 Oct 04 18:49:11.524081 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-06f692b6-8abf-47c0-8848-2e4d9df59727 req-a9f3ce2c-07f1-48ac-852b-4a504f141b97 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.097219 Oct 04 18:49:11.526813 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2317/4691] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:49:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:49:11.930571 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b09dc5da-5c57-43d6-8d36-68e5f5fbf7fd tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:11.933664 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b09dc5da-5c57-43d6-8d36-68e5f5fbf7fd tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: 0e392b33-c106-4158-b4be-8972aa5794f4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:11.946745 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b09dc5da-5c57-43d6-8d36-68e5f5fbf7fd tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:11.946745 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b09dc5da-5c57-43d6-8d36-68e5f5fbf7fd tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:11.946745 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b09dc5da-5c57-43d6-8d36-68e5f5fbf7fd tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:11.947672 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b09dc5da-5c57-43d6-8d36-68e5f5fbf7fd tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:11.948157 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b09dc5da-5c57-43d6-8d36-68e5f5fbf7fd tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:11.948649 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b09dc5da-5c57-43d6-8d36-68e5f5fbf7fd tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:12.011974 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-17759b15-45eb-48ee-b112-ffa2a9b66832 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:12.012991 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-17759b15-45eb-48ee-b112-ffa2a9b66832 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:12.059070 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:49:12.060776 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-17759b15-45eb-48ee-b112-ffa2a9b66832 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:12.063133 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-17759b15-45eb-48ee-b112-ffa2a9b66832 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:12.066471 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-17759b15-45eb-48ee-b112-ffa2a9b66832 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:12.067934 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-17759b15-45eb-48ee-b112-ffa2a9b66832 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:12.071867 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-17759b15-45eb-48ee-b112-ffa2a9b66832 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:12.073398 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-17759b15-45eb-48ee-b112-ffa2a9b66832 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:12.480025 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:49:12.520521 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b09dc5da-5c57-43d6-8d36-68e5f5fbf7fd tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:12.532373 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b09dc5da-5c57-43d6-8d36-68e5f5fbf7fd tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/0e392b33-c106-4158-b4be-8972aa5794f4" status: 200 len: 1315 microversion: 2.1 time: 0.607878 Oct 04 18:49:12.534770 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2375/4692] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:11 2022] GET /compute/v2.1/servers/0e392b33-c106-4158-b4be-8972aa5794f4 => generated 1315 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:12.548549 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-07225b6e-3ebb-4364-ab83-de19f0aa593f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:12.554166 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-07225b6e-3ebb-4364-ab83-de19f0aa593f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: 406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:12.577919 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-07225b6e-3ebb-4364-ab83-de19f0aa593f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:12.578509 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-07225b6e-3ebb-4364-ab83-de19f0aa593f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:12.578871 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-07225b6e-3ebb-4364-ab83-de19f0aa593f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:12.579580 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-07225b6e-3ebb-4364-ab83-de19f0aa593f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:12.580107 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-07225b6e-3ebb-4364-ab83-de19f0aa593f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:12.580536 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-07225b6e-3ebb-4364-ab83-de19f0aa593f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:12.601462 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-17759b15-45eb-48ee-b112-ffa2a9b66832 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:12.614717 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-17759b15-45eb-48ee-b112-ffa2a9b66832 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1459 microversion: 2.1 time: 0.607902 Oct 04 18:49:12.620738 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2318/4693] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:12 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1459 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:49:12.653606 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:49:12.879483 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-07225b6e-3ebb-4364-ab83-de19f0aa593f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:12.902347 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-07225b6e-3ebb-4364-ab83-de19f0aa593f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a" status: 200 len: 1522 microversion: 2.1 time: 0.366289 Oct 04 18:49:12.919953 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2376/4694] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:12 2022] GET /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a => generated 1522 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:13.557424 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-58a31ce1-22c3-44f2-85e3-f97d1da20f0b tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:13.558720 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-58a31ce1-22c3-44f2-85e3-f97d1da20f0b tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: 0e392b33-c106-4158-b4be-8972aa5794f4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:13.570586 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-58a31ce1-22c3-44f2-85e3-f97d1da20f0b tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:13.571818 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-58a31ce1-22c3-44f2-85e3-f97d1da20f0b tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:13.575812 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-58a31ce1-22c3-44f2-85e3-f97d1da20f0b tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:13.577321 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-58a31ce1-22c3-44f2-85e3-f97d1da20f0b tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:13.579010 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-58a31ce1-22c3-44f2-85e3-f97d1da20f0b tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:13.579702 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-58a31ce1-22c3-44f2-85e3-f97d1da20f0b tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:13.590533 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=100 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:49:13.648123 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-cdf28275-3bdc-4850-b0d7-2ceda545c0d1 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:13.648772 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-cdf28275-3bdc-4850-b0d7-2ceda545c0d1 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:13.660581 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cdf28275-3bdc-4850-b0d7-2ceda545c0d1 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:13.664839 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cdf28275-3bdc-4850-b0d7-2ceda545c0d1 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:13.667627 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cdf28275-3bdc-4850-b0d7-2ceda545c0d1 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:13.672125 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cdf28275-3bdc-4850-b0d7-2ceda545c0d1 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:13.672888 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cdf28275-3bdc-4850-b0d7-2ceda545c0d1 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:13.674307 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cdf28275-3bdc-4850-b0d7-2ceda545c0d1 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:13.694632 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=8 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:49:14.239948 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-cdf28275-3bdc-4850-b0d7-2ceda545c0d1 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:14.253857 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-cdf28275-3bdc-4850-b0d7-2ceda545c0d1 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1517 microversion: 2.1 time: 0.608575 Oct 04 18:49:14.254492 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2377/4695] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:13 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1517 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:49:14.270394 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-179c2d6e-f15d-4edf-b73e-5cc3228f8f29 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:14.270703 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-58a31ce1-22c3-44f2-85e3-f97d1da20f0b tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:14.271506 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-179c2d6e-f15d-4edf-b73e-5cc3228f8f29 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: 406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:14.284918 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-179c2d6e-f15d-4edf-b73e-5cc3228f8f29 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:14.285549 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-58a31ce1-22c3-44f2-85e3-f97d1da20f0b tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/0e392b33-c106-4158-b4be-8972aa5794f4" status: 200 len: 1315 microversion: 2.1 time: 0.732129 Oct 04 18:49:14.285994 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-179c2d6e-f15d-4edf-b73e-5cc3228f8f29 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:14.286701 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-179c2d6e-f15d-4edf-b73e-5cc3228f8f29 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:14.288579 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-179c2d6e-f15d-4edf-b73e-5cc3228f8f29 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:14.289204 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-179c2d6e-f15d-4edf-b73e-5cc3228f8f29 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:14.290303 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-179c2d6e-f15d-4edf-b73e-5cc3228f8f29 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:14.297793 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2319/4696] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:13 2022] GET /compute/v2.1/servers/0e392b33-c106-4158-b4be-8972aa5794f4 => generated 1315 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:14.630715 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-179c2d6e-f15d-4edf-b73e-5cc3228f8f29 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:14.640032 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-179c2d6e-f15d-4edf-b73e-5cc3228f8f29 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a" status: 200 len: 1522 microversion: 2.1 time: 0.382885 Oct 04 18:49:14.640652 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2378/4697] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:14 2022] GET /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a => generated 1522 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:15.285075 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9bdee4ee-8627-453d-ae20-2ab52a27842e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:15.285710 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9bdee4ee-8627-453d-ae20-2ab52a27842e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:15.289639 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=74 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:49:15.302361 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9bdee4ee-8627-453d-ae20-2ab52a27842e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:15.302871 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9bdee4ee-8627-453d-ae20-2ab52a27842e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:15.303317 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9bdee4ee-8627-453d-ae20-2ab52a27842e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:15.304039 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9bdee4ee-8627-453d-ae20-2ab52a27842e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:15.304549 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9bdee4ee-8627-453d-ae20-2ab52a27842e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:15.304984 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9bdee4ee-8627-453d-ae20-2ab52a27842e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:15.313010 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b82cba15-e45c-4120-8098-dfde7c3f77cd tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:15.313638 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b82cba15-e45c-4120-8098-dfde7c3f77cd tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: 0e392b33-c106-4158-b4be-8972aa5794f4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:15.324099 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b82cba15-e45c-4120-8098-dfde7c3f77cd tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:15.328720 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b82cba15-e45c-4120-8098-dfde7c3f77cd tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:15.331072 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b82cba15-e45c-4120-8098-dfde7c3f77cd tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:15.334243 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b82cba15-e45c-4120-8098-dfde7c3f77cd tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:15.339560 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b82cba15-e45c-4120-8098-dfde7c3f77cd tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:15.339560 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b82cba15-e45c-4120-8098-dfde7c3f77cd tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:15.680864 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9bdee4ee-8627-453d-ae20-2ab52a27842e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:15.693603 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9bdee4ee-8627-453d-ae20-2ab52a27842e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1517 microversion: 2.1 time: 0.413158 Oct 04 18:49:15.704154 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2320/4698] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:15 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1517 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:15.704154 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-92b6d980-f2cf-48ca-8401-b88ac28f7459 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:15.704154 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-92b6d980-f2cf-48ca-8401-b88ac28f7459 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: 406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:15.722965 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-92b6d980-f2cf-48ca-8401-b88ac28f7459 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:15.724236 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-92b6d980-f2cf-48ca-8401-b88ac28f7459 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:15.724236 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-92b6d980-f2cf-48ca-8401-b88ac28f7459 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:15.724866 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-92b6d980-f2cf-48ca-8401-b88ac28f7459 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:15.734352 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-92b6d980-f2cf-48ca-8401-b88ac28f7459 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:15.734851 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-92b6d980-f2cf-48ca-8401-b88ac28f7459 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:15.780655 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b82cba15-e45c-4120-8098-dfde7c3f77cd tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:15.791705 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b82cba15-e45c-4120-8098-dfde7c3f77cd tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/0e392b33-c106-4158-b4be-8972aa5794f4" status: 200 len: 1315 microversion: 2.1 time: 0.482481 Oct 04 18:49:15.792322 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2379/4699] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:15 2022] GET /compute/v2.1/servers/0e392b33-c106-4158-b4be-8972aa5794f4 => generated 1315 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:49:15.820085 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-4e55fa9c-d8ea-47fc-9882-e97e5cf123eb req-c1a7a4c9-a3b8-45d3-88d7-5f87267b8489 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95fb1a13-7441-4f74-ad81-5a9413496545", "tag": "73befc4a-98f7-414e-8302-6ba3a3fd9481"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:49:15.842702 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-4e55fa9c-d8ea-47fc-9882-e97e5cf123eb req-c1a7a4c9-a3b8-45d3-88d7-5f87267b8489 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:15.847755 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-4e55fa9c-d8ea-47fc-9882-e97e5cf123eb req-c1a7a4c9-a3b8-45d3-88d7-5f87267b8489 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:15.848521 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-4e55fa9c-d8ea-47fc-9882-e97e5cf123eb req-c1a7a4c9-a3b8-45d3-88d7-5f87267b8489 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:15.871710 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-4e55fa9c-d8ea-47fc-9882-e97e5cf123eb req-c1a7a4c9-a3b8-45d3-88d7-5f87267b8489 service nova] Creating event network-changed:73befc4a-98f7-414e-8302-6ba3a3fd9481 for instance 95fb1a13-7441-4f74-ad81-5a9413496545 on n-h2-850501-14 Oct 04 18:49:15.885428 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-4e55fa9c-d8ea-47fc-9882-e97e5cf123eb req-c1a7a4c9-a3b8-45d3-88d7-5f87267b8489 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072854 Oct 04 18:49:15.891849 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2380/4700] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:49:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:49:16.063122 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-593727c8-240f-47b5-9d65-e4fd6c80013b req-a8a8d213-b4d4-43b8-9b3f-6e118028cee0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a", "name": "network-vif-plugged", "status": "completed", "tag": "25667d58-f07b-4faa-8414-20c890cec66d"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:49:16.076751 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-593727c8-240f-47b5-9d65-e4fd6c80013b req-a8a8d213-b4d4-43b8-9b3f-6e118028cee0 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:16.076751 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-593727c8-240f-47b5-9d65-e4fd6c80013b req-a8a8d213-b4d4-43b8-9b3f-6e118028cee0 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:16.076751 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-593727c8-240f-47b5-9d65-e4fd6c80013b req-a8a8d213-b4d4-43b8-9b3f-6e118028cee0 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:16.104136 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-593727c8-240f-47b5-9d65-e4fd6c80013b req-a8a8d213-b4d4-43b8-9b3f-6e118028cee0 service nova] Creating event network-vif-plugged:25667d58-f07b-4faa-8414-20c890cec66d for instance 406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a on n-h2-850501-14 Oct 04 18:49:16.110873 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-593727c8-240f-47b5-9d65-e4fd6c80013b req-a8a8d213-b4d4-43b8-9b3f-6e118028cee0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052361 Oct 04 18:49:16.112638 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2381/4701] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:49:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:49:16.586398 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-92b6d980-f2cf-48ca-8401-b88ac28f7459 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:16.602498 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-92b6d980-f2cf-48ca-8401-b88ac28f7459 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a" status: 200 len: 1522 microversion: 2.1 time: 0.906822 Oct 04 18:49:16.603296 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2321/4702] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:15 2022] GET /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a => generated 1522 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:16.726818 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1ca5bc06-4113-4700-b141-1db5dc01a258 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:16.728311 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1ca5bc06-4113-4700-b141-1db5dc01a258 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:16.743077 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1ca5bc06-4113-4700-b141-1db5dc01a258 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:16.743879 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1ca5bc06-4113-4700-b141-1db5dc01a258 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:16.746069 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1ca5bc06-4113-4700-b141-1db5dc01a258 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:16.747699 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1ca5bc06-4113-4700-b141-1db5dc01a258 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:16.751149 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1ca5bc06-4113-4700-b141-1db5dc01a258 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:16.751757 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1ca5bc06-4113-4700-b141-1db5dc01a258 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:16.815438 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1c9f8f69-dc5d-4953-a9a1-997d62213ad0 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:16.816903 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1c9f8f69-dc5d-4953-a9a1-997d62213ad0 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: 0e392b33-c106-4158-b4be-8972aa5794f4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:16.823457 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1c9f8f69-dc5d-4953-a9a1-997d62213ad0 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:16.824243 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1c9f8f69-dc5d-4953-a9a1-997d62213ad0 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:16.824874 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1c9f8f69-dc5d-4953-a9a1-997d62213ad0 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:16.825834 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1c9f8f69-dc5d-4953-a9a1-997d62213ad0 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:16.827321 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1c9f8f69-dc5d-4953-a9a1-997d62213ad0 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:16.827983 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1c9f8f69-dc5d-4953-a9a1-997d62213ad0 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:17.303734 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1ca5bc06-4113-4700-b141-1db5dc01a258 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:17.310838 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1c9f8f69-dc5d-4953-a9a1-997d62213ad0 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:17.326140 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1c9f8f69-dc5d-4953-a9a1-997d62213ad0 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/0e392b33-c106-4158-b4be-8972aa5794f4" status: 200 len: 1315 microversion: 2.1 time: 0.513669 Oct 04 18:49:17.344896 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1ca5bc06-4113-4700-b141-1db5dc01a258 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1517 microversion: 2.1 time: 0.614324 Oct 04 18:49:17.344896 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2382/4703] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:16 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1517 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:17.346236 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2322/4704] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:16 2022] GET /compute/v2.1/servers/0e392b33-c106-4158-b4be-8972aa5794f4 => generated 1315 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:49:17.629672 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-37ce7fb6-064d-494c-b4d1-a3f763fa9ac1 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:17.631886 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-37ce7fb6-064d-494c-b4d1-a3f763fa9ac1 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: 406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:17.649298 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-37ce7fb6-064d-494c-b4d1-a3f763fa9ac1 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:17.649818 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-37ce7fb6-064d-494c-b4d1-a3f763fa9ac1 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:17.650262 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-37ce7fb6-064d-494c-b4d1-a3f763fa9ac1 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:17.654007 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-37ce7fb6-064d-494c-b4d1-a3f763fa9ac1 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:17.655198 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-37ce7fb6-064d-494c-b4d1-a3f763fa9ac1 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:17.655803 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-37ce7fb6-064d-494c-b4d1-a3f763fa9ac1 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:17.955827 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-37ce7fb6-064d-494c-b4d1-a3f763fa9ac1 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:17.964355 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-37ce7fb6-064d-494c-b4d1-a3f763fa9ac1 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a" status: 200 len: 1522 microversion: 2.1 time: 0.339563 Oct 04 18:49:17.965399 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2383/4705] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:17 2022] GET /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a => generated 1522 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:18.131721 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-e913fcd2-79e1-4c16-95c6-f63417f0c8f0 req-42a3d36c-fc21-483c-9f79-31a997c4b060 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e392b33-c106-4158-b4be-8972aa5794f4", "name": "network-vif-plugged", "status": "completed", "tag": "cc7230e3-6e5f-49f8-a0fc-82fea2c1bf39"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:49:18.141749 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-e913fcd2-79e1-4c16-95c6-f63417f0c8f0 req-42a3d36c-fc21-483c-9f79-31a997c4b060 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:18.142250 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-e913fcd2-79e1-4c16-95c6-f63417f0c8f0 req-42a3d36c-fc21-483c-9f79-31a997c4b060 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:18.143425 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-e913fcd2-79e1-4c16-95c6-f63417f0c8f0 req-42a3d36c-fc21-483c-9f79-31a997c4b060 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:18.156572 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-e913fcd2-79e1-4c16-95c6-f63417f0c8f0 req-42a3d36c-fc21-483c-9f79-31a997c4b060 service nova] Creating event network-vif-plugged:cc7230e3-6e5f-49f8-a0fc-82fea2c1bf39 for instance 0e392b33-c106-4158-b4be-8972aa5794f4 on n-h1-850501-14 Oct 04 18:49:18.162698 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-e913fcd2-79e1-4c16-95c6-f63417f0c8f0 req-42a3d36c-fc21-483c-9f79-31a997c4b060 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034476 Oct 04 18:49:18.163502 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2323/4706] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:49:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:49:18.353052 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-700a0bd8-b6c7-4d88-9f9e-6a6abf0116e1 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:18.358638 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-700a0bd8-b6c7-4d88-9f9e-6a6abf0116e1 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: 0e392b33-c106-4158-b4be-8972aa5794f4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:18.366509 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-573a2113-51dc-4c7f-b607-dbc53946f538 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:18.368776 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-573a2113-51dc-4c7f-b607-dbc53946f538 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:18.391940 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-700a0bd8-b6c7-4d88-9f9e-6a6abf0116e1 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:18.396095 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-700a0bd8-b6c7-4d88-9f9e-6a6abf0116e1 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:18.401362 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-700a0bd8-b6c7-4d88-9f9e-6a6abf0116e1 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:18.410638 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-700a0bd8-b6c7-4d88-9f9e-6a6abf0116e1 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:18.411094 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-700a0bd8-b6c7-4d88-9f9e-6a6abf0116e1 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:18.412549 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-573a2113-51dc-4c7f-b607-dbc53946f538 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:18.414092 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-700a0bd8-b6c7-4d88-9f9e-6a6abf0116e1 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:18.415974 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-573a2113-51dc-4c7f-b607-dbc53946f538 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:18.417825 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-573a2113-51dc-4c7f-b607-dbc53946f538 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:18.421276 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-573a2113-51dc-4c7f-b607-dbc53946f538 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:18.423226 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-573a2113-51dc-4c7f-b607-dbc53946f538 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:18.425945 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-573a2113-51dc-4c7f-b607-dbc53946f538 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:19.087984 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-573a2113-51dc-4c7f-b607-dbc53946f538 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:19.104378 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-573a2113-51dc-4c7f-b607-dbc53946f538 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1517 microversion: 2.1 time: 0.741145 Oct 04 18:49:19.105392 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2324/4707] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:18 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1517 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:19.117285 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-24614103-c820-4de9-9449-84cf8d431b17 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:19.117959 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-24614103-c820-4de9-9449-84cf8d431b17 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: 406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:19.131709 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-24614103-c820-4de9-9449-84cf8d431b17 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:19.132251 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-24614103-c820-4de9-9449-84cf8d431b17 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:19.132795 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-24614103-c820-4de9-9449-84cf8d431b17 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:19.133388 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-24614103-c820-4de9-9449-84cf8d431b17 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:19.133851 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-24614103-c820-4de9-9449-84cf8d431b17 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:19.134276 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-24614103-c820-4de9-9449-84cf8d431b17 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:19.310506 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-700a0bd8-b6c7-4d88-9f9e-6a6abf0116e1 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:19.335026 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-700a0bd8-b6c7-4d88-9f9e-6a6abf0116e1 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/0e392b33-c106-4158-b4be-8972aa5794f4" status: 200 len: 1315 microversion: 2.1 time: 0.986280 Oct 04 18:49:19.356820 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2384/4708] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:18 2022] GET /compute/v2.1/servers/0e392b33-c106-4158-b4be-8972aa5794f4 => generated 1315 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:19.702398 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-24614103-c820-4de9-9449-84cf8d431b17 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:19.721592 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-24614103-c820-4de9-9449-84cf8d431b17 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a" status: 200 len: 1507 microversion: 2.1 time: 0.613497 Oct 04 18:49:19.729424 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2325/4709] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:19 2022] GET /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a => generated 1507 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:19.752716 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-27417796-c709-4d24-9517-6d3718334bc7 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:19.753873 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-27417796-c709-4d24-9517-6d3718334bc7 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: 406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:19.772493 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-27417796-c709-4d24-9517-6d3718334bc7 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:19.773677 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-27417796-c709-4d24-9517-6d3718334bc7 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:19.777659 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-27417796-c709-4d24-9517-6d3718334bc7 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:19.778798 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-27417796-c709-4d24-9517-6d3718334bc7 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:19.779513 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-27417796-c709-4d24-9517-6d3718334bc7 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:19.781824 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-27417796-c709-4d24-9517-6d3718334bc7 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:20.128485 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-335b975e-4d98-44f3-a815-6eb88536165f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:20.133463 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-335b975e-4d98-44f3-a815-6eb88536165f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:20.151420 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-335b975e-4d98-44f3-a815-6eb88536165f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:20.153335 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-335b975e-4d98-44f3-a815-6eb88536165f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:20.155549 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-335b975e-4d98-44f3-a815-6eb88536165f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:20.157479 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-335b975e-4d98-44f3-a815-6eb88536165f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:20.158780 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-335b975e-4d98-44f3-a815-6eb88536165f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:20.161000 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-335b975e-4d98-44f3-a815-6eb88536165f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:20.191623 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-27417796-c709-4d24-9517-6d3718334bc7 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:20.205873 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-27417796-c709-4d24-9517-6d3718334bc7 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a" status: 200 len: 1507 microversion: 2.1 time: 0.458012 Oct 04 18:49:20.208516 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2385/4710] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:19 2022] GET /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a => generated 1507 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:20.238228 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f9297802-8dd2-4f2b-9983-40751f0d78bf tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:20.239155 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f9297802-8dd2-4f2b-9983-40751f0d78bf tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: 406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:20.248539 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f9297802-8dd2-4f2b-9983-40751f0d78bf tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:20.252349 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f9297802-8dd2-4f2b-9983-40751f0d78bf tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:20.253005 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f9297802-8dd2-4f2b-9983-40751f0d78bf tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:20.253807 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f9297802-8dd2-4f2b-9983-40751f0d78bf tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:20.254296 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f9297802-8dd2-4f2b-9983-40751f0d78bf tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:20.257538 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f9297802-8dd2-4f2b-9983-40751f0d78bf tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:20.366735 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f9297802-8dd2-4f2b-9983-40751f0d78bf tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: 406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:49:20.488733 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-335b975e-4d98-44f3-a815-6eb88536165f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:20.497904 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-335b975e-4d98-44f3-a815-6eb88536165f tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1517 microversion: 2.1 time: 0.374552 Oct 04 18:49:20.498495 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2326/4711] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:20 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1517 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:49:20.504267 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-269ebf3d-dde1-4606-ab74-a3b65763aa9e tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:20.507083 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-269ebf3d-dde1-4606-ab74-a3b65763aa9e tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: 0e392b33-c106-4158-b4be-8972aa5794f4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:20.513541 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-269ebf3d-dde1-4606-ab74-a3b65763aa9e tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:20.514305 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-269ebf3d-dde1-4606-ab74-a3b65763aa9e tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:20.514761 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-269ebf3d-dde1-4606-ab74-a3b65763aa9e tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:20.515565 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-269ebf3d-dde1-4606-ab74-a3b65763aa9e tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:20.516250 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-269ebf3d-dde1-4606-ab74-a3b65763aa9e tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:20.516854 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-269ebf3d-dde1-4606-ab74-a3b65763aa9e tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:20.842223 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f9297802-8dd2-4f2b-9983-40751f0d78bf tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "DELETE /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a" status: 204 len: 0 microversion: 2.1 time: 0.608730 Oct 04 18:49:20.843117 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2386/4712] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:49:20 2022] DELETE /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a => generated 0 bytes in 610 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:49:20.856079 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-269ebf3d-dde1-4606-ab74-a3b65763aa9e tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:20.872733 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-269ebf3d-dde1-4606-ab74-a3b65763aa9e tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/0e392b33-c106-4158-b4be-8972aa5794f4" status: 200 len: 1502 microversion: 2.1 time: 0.372828 Oct 04 18:49:20.875280 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2327/4713] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:20 2022] GET /compute/v2.1/servers/0e392b33-c106-4158-b4be-8972aa5794f4 => generated 1502 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:20.905759 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0bae43dd-de05-4315-a3f9-aa05b8cc30f5 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:20.906426 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0bae43dd-de05-4315-a3f9-aa05b8cc30f5 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: 0e392b33-c106-4158-b4be-8972aa5794f4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:20.920047 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0bae43dd-de05-4315-a3f9-aa05b8cc30f5 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:20.920047 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0bae43dd-de05-4315-a3f9-aa05b8cc30f5 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:20.920301 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0bae43dd-de05-4315-a3f9-aa05b8cc30f5 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:20.924729 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0bae43dd-de05-4315-a3f9-aa05b8cc30f5 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:20.925229 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0bae43dd-de05-4315-a3f9-aa05b8cc30f5 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:20.925665 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0bae43dd-de05-4315-a3f9-aa05b8cc30f5 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:20.975769 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0bae43dd-de05-4315-a3f9-aa05b8cc30f5 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: 0e392b33-c106-4158-b4be-8972aa5794f4] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:49:21.043898 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-298458c1-ee23-4289-9dcb-aece9d5c6791 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1544708000", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": [{"uuid": "773447f8-5421-4dc5-aacf-857d60ccc335"}]}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:49:21.422863 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0bae43dd-de05-4315-a3f9-aa05b8cc30f5 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0e392b33-c106-4158-b4be-8972aa5794f4" status: 204 len: 0 microversion: 2.1 time: 0.520921 Oct 04 18:49:21.425066 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2387/4714] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:49:20 2022] DELETE /compute/v2.1/servers/0e392b33-c106-4158-b4be-8972aa5794f4 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:49:21.434821 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b6f2d51b-6267-429e-b673-b4d8c1622d05 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:21.435762 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b6f2d51b-6267-429e-b673-b4d8c1622d05 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: 0e392b33-c106-4158-b4be-8972aa5794f4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:21.446423 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b6f2d51b-6267-429e-b673-b4d8c1622d05 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:21.447366 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b6f2d51b-6267-429e-b673-b4d8c1622d05 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:21.448026 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b6f2d51b-6267-429e-b673-b4d8c1622d05 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:21.448779 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b6f2d51b-6267-429e-b673-b4d8c1622d05 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:21.459566 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b6f2d51b-6267-429e-b673-b4d8c1622d05 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:21.459566 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b6f2d51b-6267-429e-b673-b4d8c1622d05 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:21.672151 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b6f2d51b-6267-429e-b673-b4d8c1622d05 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:21.686921 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b6f2d51b-6267-429e-b673-b4d8c1622d05 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/0e392b33-c106-4158-b4be-8972aa5794f4" status: 200 len: 1508 microversion: 2.1 time: 0.257277 Oct 04 18:49:21.702434 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2388/4715] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:21 2022] GET /compute/v2.1/servers/0e392b33-c106-4158-b4be-8972aa5794f4 => generated 1508 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:21.707624 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-358bc8b7-f97d-4c43-b7a5-f6898d2cec1c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:21.713553 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-358bc8b7-f97d-4c43-b7a5-f6898d2cec1c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:21.718863 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-358bc8b7-f97d-4c43-b7a5-f6898d2cec1c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:21.719844 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-358bc8b7-f97d-4c43-b7a5-f6898d2cec1c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:21.721013 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-358bc8b7-f97d-4c43-b7a5-f6898d2cec1c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:21.724124 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-358bc8b7-f97d-4c43-b7a5-f6898d2cec1c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:21.724124 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-358bc8b7-f97d-4c43-b7a5-f6898d2cec1c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:21.724124 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-358bc8b7-f97d-4c43-b7a5-f6898d2cec1c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:21.731596 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-298458c1-ee23-4289-9dcb-aece9d5c6791 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] validate_networks() for [('773447f8-5421-4dc5-aacf-857d60ccc335', None, None, None, None, None)] {{(pid=123002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:49:22.100257 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-358bc8b7-f97d-4c43-b7a5-f6898d2cec1c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:22.130781 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-358bc8b7-f97d-4c43-b7a5-f6898d2cec1c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1517 microversion: 2.1 time: 0.426080 Oct 04 18:49:22.137348 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2389/4716] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:21 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1517 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:22.158580 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-15bc41ce-1d37-476a-8b09-7f7fc631de06 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:22.159217 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-15bc41ce-1d37-476a-8b09-7f7fc631de06 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:22.169364 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-15bc41ce-1d37-476a-8b09-7f7fc631de06 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:22.169870 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-15bc41ce-1d37-476a-8b09-7f7fc631de06 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:22.170304 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-15bc41ce-1d37-476a-8b09-7f7fc631de06 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:22.171626 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-15bc41ce-1d37-476a-8b09-7f7fc631de06 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:22.172116 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-15bc41ce-1d37-476a-8b09-7f7fc631de06 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:22.176782 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-15bc41ce-1d37-476a-8b09-7f7fc631de06 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:22.678113 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-15bc41ce-1d37-476a-8b09-7f7fc631de06 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:22.696106 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-15bc41ce-1d37-476a-8b09-7f7fc631de06 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1685 microversion: 2.1 time: 0.552311 Oct 04 18:49:22.697825 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2390/4717] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:22 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1685 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:22.721504 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8ef79345-d106-4a07-9193-2e6671788c41 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:22.723049 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8ef79345-d106-4a07-9193-2e6671788c41 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: 0e392b33-c106-4158-b4be-8972aa5794f4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:22.736940 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8ef79345-d106-4a07-9193-2e6671788c41 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:22.739294 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8ef79345-d106-4a07-9193-2e6671788c41 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:22.739743 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8ef79345-d106-4a07-9193-2e6671788c41 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:22.740538 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8ef79345-d106-4a07-9193-2e6671788c41 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:22.742185 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8ef79345-d106-4a07-9193-2e6671788c41 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:22.742185 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8ef79345-d106-4a07-9193-2e6671788c41 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:22.757811 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:49:23.125940 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-298458c1-ee23-4289-9dcb-aece9d5c6791 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:49:23.125940 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-298458c1-ee23-4289-9dcb-aece9d5c6791 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:49:23.125940 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-298458c1-ee23-4289-9dcb-aece9d5c6791 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:49:23.125940 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-298458c1-ee23-4289-9dcb-aece9d5c6791 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:49:23.125940 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-298458c1-ee23-4289-9dcb-aece9d5c6791 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:49:23.125940 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-298458c1-ee23-4289-9dcb-aece9d5c6791 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:23.125940 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-298458c1-ee23-4289-9dcb-aece9d5c6791 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:23.125940 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-298458c1-ee23-4289-9dcb-aece9d5c6791 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:23.125940 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-298458c1-ee23-4289-9dcb-aece9d5c6791 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:23.125940 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-298458c1-ee23-4289-9dcb-aece9d5c6791 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:23.125940 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-298458c1-ee23-4289-9dcb-aece9d5c6791 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:23.170434 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-298458c1-ee23-4289-9dcb-aece9d5c6791 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Getting quotas for project e4bae9055ba74017a261df156ecdd347. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:49:23.190268 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-298458c1-ee23-4289-9dcb-aece9d5c6791 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Getting quotas for user 032b060beb9645c4bea314ae44277b35 and project e4bae9055ba74017a261df156ecdd347. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:49:23.227462 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-298458c1-ee23-4289-9dcb-aece9d5c6791 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Going to run 1 instances... {{(pid=123002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:49:23.234478 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-298458c1-ee23-4289-9dcb-aece9d5c6791 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: b1b5f03e-fb43-4b1d-a072-02d7a0d724da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:49:23.258814 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8ef79345-d106-4a07-9193-2e6671788c41 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:23.275218 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8ef79345-d106-4a07-9193-2e6671788c41 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/0e392b33-c106-4158-b4be-8972aa5794f4" status: 200 len: 1508 microversion: 2.1 time: 0.559957 Oct 04 18:49:23.277661 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2391/4718] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:22 2022] GET /compute/v2.1/servers/0e392b33-c106-4158-b4be-8972aa5794f4 => generated 1508 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:23.297609 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-06d63b79-f8c5-4e69-97ff-fc54b0ffc8d0 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:23.300095 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-06d63b79-f8c5-4e69-97ff-fc54b0ffc8d0 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:23.313704 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-06d63b79-f8c5-4e69-97ff-fc54b0ffc8d0 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:23.324078 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-06d63b79-f8c5-4e69-97ff-fc54b0ffc8d0 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:23.326003 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-06d63b79-f8c5-4e69-97ff-fc54b0ffc8d0 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:23.329048 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-06d63b79-f8c5-4e69-97ff-fc54b0ffc8d0 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:23.329874 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-06d63b79-f8c5-4e69-97ff-fc54b0ffc8d0 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:23.330507 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-06d63b79-f8c5-4e69-97ff-fc54b0ffc8d0 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:23.426383 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-298458c1-ee23-4289-9dcb-aece9d5c6791 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.386268 Oct 04 18:49:23.428386 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2328/4719] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:49:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 2389 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 18:49:23.457319 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-487a922d-6b74-4cfa-8b1a-95030c1da2a8 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:23.458039 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-487a922d-6b74-4cfa-8b1a-95030c1da2a8 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: b1b5f03e-fb43-4b1d-a072-02d7a0d724da] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:23.864352 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-487a922d-6b74-4cfa-8b1a-95030c1da2a8 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:23.876068 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-487a922d-6b74-4cfa-8b1a-95030c1da2a8 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/b1b5f03e-fb43-4b1d-a072-02d7a0d724da" status: 200 len: 1218 microversion: 2.1 time: 0.439834 Oct 04 18:49:23.893233 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2329/4720] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:23 2022] GET /compute/v2.1/servers/b1b5f03e-fb43-4b1d-a072-02d7a0d724da => generated 1218 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:23.913490 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-cfbb5e04-a38d-476f-8895-c86df78c1f36 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:23.914202 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-cfbb5e04-a38d-476f-8895-c86df78c1f36 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:23.933932 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cfbb5e04-a38d-476f-8895-c86df78c1f36 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:23.937474 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cfbb5e04-a38d-476f-8895-c86df78c1f36 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:23.938279 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cfbb5e04-a38d-476f-8895-c86df78c1f36 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:23.953089 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cfbb5e04-a38d-476f-8895-c86df78c1f36 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:23.953714 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cfbb5e04-a38d-476f-8895-c86df78c1f36 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:23.955317 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cfbb5e04-a38d-476f-8895-c86df78c1f36 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:24.038436 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-06d63b79-f8c5-4e69-97ff-fc54b0ffc8d0 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:24.051367 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-06d63b79-f8c5-4e69-97ff-fc54b0ffc8d0 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1517 microversion: 2.1 time: 0.772372 Oct 04 18:49:24.072916 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2392/4721] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:23 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1517 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:24.303953 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ee66f78f-1098-4eaa-b53f-db58f12bc13e tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:24.304908 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ee66f78f-1098-4eaa-b53f-db58f12bc13e tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: 0e392b33-c106-4158-b4be-8972aa5794f4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:24.316495 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ee66f78f-1098-4eaa-b53f-db58f12bc13e tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:24.318824 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ee66f78f-1098-4eaa-b53f-db58f12bc13e tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:24.327185 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ee66f78f-1098-4eaa-b53f-db58f12bc13e tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:24.337991 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ee66f78f-1098-4eaa-b53f-db58f12bc13e tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:24.338311 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ee66f78f-1098-4eaa-b53f-db58f12bc13e tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:24.338793 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ee66f78f-1098-4eaa-b53f-db58f12bc13e tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:24.460929 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-cfbb5e04-a38d-476f-8895-c86df78c1f36 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:24.472771 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-cfbb5e04-a38d-476f-8895-c86df78c1f36 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1672 microversion: 2.1 time: 0.573699 Oct 04 18:49:24.486316 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2330/4722] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:23 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1672 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:24.512673 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-208bb500-10b6-4748-bec8-da9806766855 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-435260847"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:49:24.517481 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-208bb500-10b6-4748-bec8-da9806766855 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:24.535020 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-208bb500-10b6-4748-bec8-da9806766855 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:24.538350 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-208bb500-10b6-4748-bec8-da9806766855 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:24.539021 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-208bb500-10b6-4748-bec8-da9806766855 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:24.541838 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-208bb500-10b6-4748-bec8-da9806766855 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:24.544746 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-208bb500-10b6-4748-bec8-da9806766855 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:24.545230 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-208bb500-10b6-4748-bec8-da9806766855 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:24.743199 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ee66f78f-1098-4eaa-b53f-db58f12bc13e tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:24.775621 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ee66f78f-1098-4eaa-b53f-db58f12bc13e tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/0e392b33-c106-4158-b4be-8972aa5794f4" status: 200 len: 1508 microversion: 2.1 time: 0.475301 Oct 04 18:49:24.785643 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2393/4723] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:24 2022] GET /compute/v2.1/servers/0e392b33-c106-4158-b4be-8972aa5794f4 => generated 1508 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:24.905733 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-34439c7d-2168-44c3-a53c-2e9c69394234 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:24.906633 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-34439c7d-2168-44c3-a53c-2e9c69394234 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: b1b5f03e-fb43-4b1d-a072-02d7a0d724da] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:24.920782 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:49:25.193281 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-34439c7d-2168-44c3-a53c-2e9c69394234 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:25.202355 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-34439c7d-2168-44c3-a53c-2e9c69394234 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/b1b5f03e-fb43-4b1d-a072-02d7a0d724da" status: 200 len: 1218 microversion: 2.1 time: 0.300749 Oct 04 18:49:25.227815 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2394/4724] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:24 2022] GET /compute/v2.1/servers/b1b5f03e-fb43-4b1d-a072-02d7a0d724da => generated 1218 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:49:25.242571 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-277cf565-a9c1-486f-9907-0bcae39299db tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:25.243449 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-277cf565-a9c1-486f-9907-0bcae39299db tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:25.253723 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-277cf565-a9c1-486f-9907-0bcae39299db tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:25.254490 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-277cf565-a9c1-486f-9907-0bcae39299db tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:25.255227 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-277cf565-a9c1-486f-9907-0bcae39299db tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:25.256338 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-277cf565-a9c1-486f-9907-0bcae39299db tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:25.257046 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-277cf565-a9c1-486f-9907-0bcae39299db tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:25.257873 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-277cf565-a9c1-486f-9907-0bcae39299db tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:25.381420 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-208bb500-10b6-4748-bec8-da9806766855 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "POST /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238/action" status: 202 len: 0 microversion: 2.1 time: 0.874090 Oct 04 18:49:25.387258 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2331/4725] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:49:24 2022] POST /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238/action => generated 0 bytes in 879 msecs (HTTP/1.1 202) 10 headers in 456 bytes (2 switches on core 0) Oct 04 18:49:25.405206 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-61118bf6-cbac-4c24-a618-9a41d97feef3 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:25.405997 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-61118bf6-cbac-4c24-a618-9a41d97feef3 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:25.420287 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-61118bf6-cbac-4c24-a618-9a41d97feef3 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:25.421998 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-61118bf6-cbac-4c24-a618-9a41d97feef3 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:25.422848 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-61118bf6-cbac-4c24-a618-9a41d97feef3 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:25.424595 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-61118bf6-cbac-4c24-a618-9a41d97feef3 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:25.426406 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-61118bf6-cbac-4c24-a618-9a41d97feef3 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:25.427376 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-61118bf6-cbac-4c24-a618-9a41d97feef3 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:25.982725 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-277cf565-a9c1-486f-9907-0bcae39299db tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:25.997495 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-277cf565-a9c1-486f-9907-0bcae39299db tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1517 microversion: 2.1 time: 0.764798 Oct 04 18:49:26.000128 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2395/4726] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:25 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1517 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:26.018843 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-32478ccf-3f1d-4fab-b87b-6e7ed121c686 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:26.020200 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-32478ccf-3f1d-4fab-b87b-6e7ed121c686 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: 0e392b33-c106-4158-b4be-8972aa5794f4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:26.044993 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-32478ccf-3f1d-4fab-b87b-6e7ed121c686 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:26.045521 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-32478ccf-3f1d-4fab-b87b-6e7ed121c686 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:26.047801 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-32478ccf-3f1d-4fab-b87b-6e7ed121c686 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:26.049290 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-32478ccf-3f1d-4fab-b87b-6e7ed121c686 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:26.049881 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-32478ccf-3f1d-4fab-b87b-6e7ed121c686 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:26.051482 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-32478ccf-3f1d-4fab-b87b-6e7ed121c686 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:26.097567 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-61118bf6-cbac-4c24-a618-9a41d97feef3 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:26.115204 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-61118bf6-cbac-4c24-a618-9a41d97feef3 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1682 microversion: 2.1 time: 0.724384 Oct 04 18:49:26.116426 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2332/4727] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:25 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1682 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:26.131973 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-08f0d6e0-6155-407d-9918-f662171e6829 req-03a2dd5c-338a-49a5-80d6-4ac9ddefa9d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e208f85-0513-43f4-8a2c-38baa2886238", "name": "network-vif-unplugged", "status": "completed", "tag": "caad0bda-801d-4a85-94c7-4bb13cb984c3"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:49:26.163654 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-08f0d6e0-6155-407d-9918-f662171e6829 req-03a2dd5c-338a-49a5-80d6-4ac9ddefa9d8 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:26.177106 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-08f0d6e0-6155-407d-9918-f662171e6829 req-03a2dd5c-338a-49a5-80d6-4ac9ddefa9d8 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:26.185397 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-08f0d6e0-6155-407d-9918-f662171e6829 req-03a2dd5c-338a-49a5-80d6-4ac9ddefa9d8 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:26.209771 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-08f0d6e0-6155-407d-9918-f662171e6829 req-03a2dd5c-338a-49a5-80d6-4ac9ddefa9d8 service nova] Creating event network-vif-unplugged:caad0bda-801d-4a85-94c7-4bb13cb984c3 for instance 2e208f85-0513-43f4-8a2c-38baa2886238 on n-h2-850501-14 Oct 04 18:49:26.230022 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-08f0d6e0-6155-407d-9918-f662171e6829 req-03a2dd5c-338a-49a5-80d6-4ac9ddefa9d8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.111457 Oct 04 18:49:26.234457 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2333/4728] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:49:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:49:26.252927 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ac791e83-edd3-408e-b3d3-9745e7443613 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:26.253677 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ac791e83-edd3-408e-b3d3-9745e7443613 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: b1b5f03e-fb43-4b1d-a072-02d7a0d724da] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:26.299160 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ac791e83-edd3-408e-b3d3-9745e7443613 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:26.299760 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ac791e83-edd3-408e-b3d3-9745e7443613 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:26.304416 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ac791e83-edd3-408e-b3d3-9745e7443613 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:26.305312 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ac791e83-edd3-408e-b3d3-9745e7443613 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:26.305816 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ac791e83-edd3-408e-b3d3-9745e7443613 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:26.306245 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ac791e83-edd3-408e-b3d3-9745e7443613 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:26.480719 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-32478ccf-3f1d-4fab-b87b-6e7ed121c686 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:26.493144 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-32478ccf-3f1d-4fab-b87b-6e7ed121c686 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/0e392b33-c106-4158-b4be-8972aa5794f4" status: 200 len: 1466 microversion: 2.1 time: 0.486527 Oct 04 18:49:26.494972 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2396/4729] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:26 2022] GET /compute/v2.1/servers/0e392b33-c106-4158-b4be-8972aa5794f4 => generated 1466 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:26.574242 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-e3e34ff0-f2cc-4d99-85c9-65354886dce0 req-9f103bde-0668-47f0-828b-2fc592c6c480 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a", "name": "network-vif-deleted", "tag": "25667d58-f07b-4faa-8414-20c890cec66d"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:49:26.602499 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ac791e83-edd3-408e-b3d3-9745e7443613 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:26.608541 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-e3e34ff0-f2cc-4d99-85c9-65354886dce0 req-9f103bde-0668-47f0-828b-2fc592c6c480 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:26.613752 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-e3e34ff0-f2cc-4d99-85c9-65354886dce0 req-9f103bde-0668-47f0-828b-2fc592c6c480 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:26.616712 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-e3e34ff0-f2cc-4d99-85c9-65354886dce0 req-9f103bde-0668-47f0-828b-2fc592c6c480 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:26.616886 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ac791e83-edd3-408e-b3d3-9745e7443613 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/b1b5f03e-fb43-4b1d-a072-02d7a0d724da" status: 200 len: 1214 microversion: 2.1 time: 0.381099 Oct 04 18:49:26.628421 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2334/4730] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:26 2022] GET /compute/v2.1/servers/b1b5f03e-fb43-4b1d-a072-02d7a0d724da => generated 1214 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:26.675539 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-e3e34ff0-f2cc-4d99-85c9-65354886dce0 req-9f103bde-0668-47f0-828b-2fc592c6c480 service nova] Creating event network-vif-deleted:25667d58-f07b-4faa-8414-20c890cec66d for instance 406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a on n-h2-850501-14 Oct 04 18:49:26.681237 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-e3e34ff0-f2cc-4d99-85c9-65354886dce0 req-9f103bde-0668-47f0-828b-2fc592c6c480 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124685 Oct 04 18:49:26.682422 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2397/4731] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:49:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:49:27.024180 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ce95ea1c-96a5-4d0b-8bcb-7e6f5b65c1bf tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:27.025132 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ce95ea1c-96a5-4d0b-8bcb-7e6f5b65c1bf tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:27.042692 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ce95ea1c-96a5-4d0b-8bcb-7e6f5b65c1bf tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:27.044882 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ce95ea1c-96a5-4d0b-8bcb-7e6f5b65c1bf tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:27.048076 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ce95ea1c-96a5-4d0b-8bcb-7e6f5b65c1bf tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:27.049236 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ce95ea1c-96a5-4d0b-8bcb-7e6f5b65c1bf tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:27.056911 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ce95ea1c-96a5-4d0b-8bcb-7e6f5b65c1bf tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:27.056911 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ce95ea1c-96a5-4d0b-8bcb-7e6f5b65c1bf tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:27.141629 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-60d34a40-85b8-4def-9dad-58fcdfea4ec7 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:27.143494 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-60d34a40-85b8-4def-9dad-58fcdfea4ec7 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:27.152780 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-60d34a40-85b8-4def-9dad-58fcdfea4ec7 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:27.153572 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-60d34a40-85b8-4def-9dad-58fcdfea4ec7 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:27.154250 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-60d34a40-85b8-4def-9dad-58fcdfea4ec7 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:27.155264 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-60d34a40-85b8-4def-9dad-58fcdfea4ec7 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:27.156126 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-60d34a40-85b8-4def-9dad-58fcdfea4ec7 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:27.157041 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-60d34a40-85b8-4def-9dad-58fcdfea4ec7 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:27.529599 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ce95ea1c-96a5-4d0b-8bcb-7e6f5b65c1bf tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:27.561097 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ce95ea1c-96a5-4d0b-8bcb-7e6f5b65c1bf tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1517 microversion: 2.1 time: 0.539989 Oct 04 18:49:27.564559 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2335/4732] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:27 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1517 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:27.582585 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b5731dc2-1829-46c1-8758-aacb324633e5 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:27.582585 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b5731dc2-1829-46c1-8758-aacb324633e5 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: 0e392b33-c106-4158-b4be-8972aa5794f4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:27.587739 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b5731dc2-1829-46c1-8758-aacb324633e5 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:27.588401 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b5731dc2-1829-46c1-8758-aacb324633e5 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:27.589046 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b5731dc2-1829-46c1-8758-aacb324633e5 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:27.589971 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b5731dc2-1829-46c1-8758-aacb324633e5 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:27.590886 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b5731dc2-1829-46c1-8758-aacb324633e5 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:27.591715 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b5731dc2-1829-46c1-8758-aacb324633e5 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:27.650106 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b5731dc2-1829-46c1-8758-aacb324633e5 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:27.650926 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b5731dc2-1829-46c1-8758-aacb324633e5 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:27.652625 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b5731dc2-1829-46c1-8758-aacb324633e5 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:27.654670 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-b5731dc2-1829-46c1-8758-aacb324633e5 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lazy-loading 'fault' on Instance uuid 0e392b33-c106-4158-b4be-8972aa5794f4 {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:49:27.774157 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b5731dc2-1829-46c1-8758-aacb324633e5 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:27.790997 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b5731dc2-1829-46c1-8758-aacb324633e5 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/0e392b33-c106-4158-b4be-8972aa5794f4" status: 200 len: 1305 microversion: 2.1 time: 0.224448 Oct 04 18:49:27.801747 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2336/4733] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:27 2022] GET /compute/v2.1/servers/0e392b33-c106-4158-b4be-8972aa5794f4 => generated 1305 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:27.801974 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-60d34a40-85b8-4def-9dad-58fcdfea4ec7 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:27.802451 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-cbdd11f1-c826-4ffa-9477-c0f24610ca43 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:27.802451 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-cbdd11f1-c826-4ffa-9477-c0f24610ca43 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: b1b5f03e-fb43-4b1d-a072-02d7a0d724da] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:27.821513 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-60d34a40-85b8-4def-9dad-58fcdfea4ec7 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1682 microversion: 2.1 time: 0.684819 Oct 04 18:49:27.824718 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2398/4734] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:27 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1682 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:27.835524 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cbdd11f1-c826-4ffa-9477-c0f24610ca43 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:27.835524 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cbdd11f1-c826-4ffa-9477-c0f24610ca43 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:27.835524 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cbdd11f1-c826-4ffa-9477-c0f24610ca43 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:27.835879 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cbdd11f1-c826-4ffa-9477-c0f24610ca43 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:27.836871 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cbdd11f1-c826-4ffa-9477-c0f24610ca43 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:27.838274 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cbdd11f1-c826-4ffa-9477-c0f24610ca43 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:27.847720 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:49:28.288177 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-cbdd11f1-c826-4ffa-9477-c0f24610ca43 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:28.321762 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-cbdd11f1-c826-4ffa-9477-c0f24610ca43 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/b1b5f03e-fb43-4b1d-a072-02d7a0d724da" status: 200 len: 1270 microversion: 2.1 time: 0.528310 Oct 04 18:49:28.322386 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2337/4735] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:27 2022] GET /compute/v2.1/servers/b1b5f03e-fb43-4b1d-a072-02d7a0d724da => generated 1270 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:28.588762 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-622b47b0-da63-4268-8aa8-a457d6f49829 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:28.589929 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-622b47b0-da63-4268-8aa8-a457d6f49829 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:28.611580 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-622b47b0-da63-4268-8aa8-a457d6f49829 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:28.615249 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-622b47b0-da63-4268-8aa8-a457d6f49829 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:28.617000 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-622b47b0-da63-4268-8aa8-a457d6f49829 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:28.622584 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-622b47b0-da63-4268-8aa8-a457d6f49829 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:28.628179 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-622b47b0-da63-4268-8aa8-a457d6f49829 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:28.628179 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-622b47b0-da63-4268-8aa8-a457d6f49829 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:28.748581 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-795e3bd3-3e73-41b3-bc6a-a36f95dd97dc req-43fbf82a-d585-4495-9325-2cebe428a95e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e392b33-c106-4158-b4be-8972aa5794f4", "name": "network-vif-deleted", "tag": "cc7230e3-6e5f-49f8-a0fc-82fea2c1bf39"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:49:28.774587 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-795e3bd3-3e73-41b3-bc6a-a36f95dd97dc req-43fbf82a-d585-4495-9325-2cebe428a95e service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:28.775256 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-795e3bd3-3e73-41b3-bc6a-a36f95dd97dc req-43fbf82a-d585-4495-9325-2cebe428a95e service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:28.775959 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-795e3bd3-3e73-41b3-bc6a-a36f95dd97dc req-43fbf82a-d585-4495-9325-2cebe428a95e service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:28.798825 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-795e3bd3-3e73-41b3-bc6a-a36f95dd97dc req-43fbf82a-d585-4495-9325-2cebe428a95e service nova] Creating event network-vif-deleted:cc7230e3-6e5f-49f8-a0fc-82fea2c1bf39 for instance 0e392b33-c106-4158-b4be-8972aa5794f4 on n-h1-850501-14 Oct 04 18:49:28.825605 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-795e3bd3-3e73-41b3-bc6a-a36f95dd97dc req-43fbf82a-d585-4495-9325-2cebe428a95e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079178 Oct 04 18:49:28.828500 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2338/4736] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:49:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:49:28.843742 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3d4ab03e-3879-463a-aaa3-54bf7cb97835 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:28.845846 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3d4ab03e-3879-463a-aaa3-54bf7cb97835 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: 0e392b33-c106-4158-b4be-8972aa5794f4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:28.853402 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3d4ab03e-3879-463a-aaa3-54bf7cb97835 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:28.853881 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3d4ab03e-3879-463a-aaa3-54bf7cb97835 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:28.854592 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3d4ab03e-3879-463a-aaa3-54bf7cb97835 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:28.855412 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3d4ab03e-3879-463a-aaa3-54bf7cb97835 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:28.855935 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3d4ab03e-3879-463a-aaa3-54bf7cb97835 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:28.856583 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3d4ab03e-3879-463a-aaa3-54bf7cb97835 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:28.873892 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-3d4ab03e-3879-463a-aaa3-54bf7cb97835 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] HTTP exception thrown: Instance 0e392b33-c106-4158-b4be-8972aa5794f4 could not be found. Oct 04 18:49:28.877441 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3d4ab03e-3879-463a-aaa3-54bf7cb97835 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Request method failure captured: Oct 04 18:49:28.877441 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/0e392b33-c106-4158-b4be-8972aa5794f4 HTTP/1.1 Oct 04 18:49:28.877441 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:49:28.877441 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:49:28.877441 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:49:28.877441 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:49:28.877441 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:49:28.877441 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:49:28.877441 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:49:28.877441 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:49:28.877441 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPIAZ5RZP-L2AfGhXbSAirsikFtiKRJw8GbD2F4avTn6csTjPvYW4EgckMMa_odYrXTBqTIarrxxpsgj83P_nCf0n9cSTNLxyj6f4zISS1Nx3NxppTvrxz8bw1hclhfH5hpAMl_7yiEWC9J95Zeea4ou_80fw0GmE8GZRBOxEg7cn1lU Oct 04 18:49:28.877441 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:49:28.877441 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:49:28.877441 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:49:28.877441 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:49:28.877441 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:49:28.877441 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:49:28.877441 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 4154ec20e0354ee6a425ba853b8efe67 Oct 04 18:49:28.877441 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-DeleteServersTestJSON-806460860 Oct 04 18:49:28.877441 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:49:28.877441 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:49:28.877441 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4154ec20e0354ee6a425ba853b8efe67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4154ec20e0354ee6a425ba853b8efe67", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4154ec20e0354ee6a425ba853b8efe67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4154ec20e0354ee6a425ba853b8efe67"}]}] Oct 04 18:49:28.877441 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-DeleteServersTestJSON-806460860 Oct 04 18:49:28.877441 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 4154ec20e0354ee6a425ba853b8efe67 Oct 04 18:49:28.877441 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-DeleteServersTestJSON-806460860 Oct 04 18:49:28.877441 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-DeleteServersTestJSON-806460860-project Oct 04 18:49:28.877441 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:49:28.877441 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:49:28.877441 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: c56b67cede6b46f5a36a723d361b3245 Oct 04 18:49:28.877441 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-DeleteServersTestJSON-806460860-project Oct 04 18:49:28.877441 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:49:28.877441 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 0e392b33-c106-4158-b4be-8972aa5794f4 could not be found. Oct 04 18:49:28.877441 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '0e392b33-c106-4158-b4be-8972aa5794f4'} Oct 04 18:49:28.877441 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:49:28.877441 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:49:28.877441 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:49:28.877441 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:49:28.877441 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:49:28.877441 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:49:28.877441 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:49:28.877441 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:49:28.877441 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:49:28.877441 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:49:28.877441 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e392b33-c106-4158-b4be-8972aa5794f4 could not be found. Oct 04 18:49:28.877441 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:49:28.877441 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:49:28.877441 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:49:28.877441 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:49:28.877441 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:49:28.877441 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:49:28.877441 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:49:28.877441 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:49:28.877441 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:49:28.877441 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:49:28.877441 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:49:28.877441 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:49:28.877441 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:49:28.877441 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:49:28.877441 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:49:28.877441 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:49:28.877441 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e392b33-c106-4158-b4be-8972aa5794f4 could not be found. Oct 04 18:49:28.877441 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:49:28.877441 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:49:28.877441 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:49:28.882773 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:49:28.882773 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:49:28.882773 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:49:28.882773 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:49:28.882773 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:49:28.882773 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e392b33-c106-4158-b4be-8972aa5794f4 could not be found. Oct 04 18:49:28.882773 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:49:28.882773 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3d4ab03e-3879-463a-aaa3-54bf7cb97835 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Returning 404 to user: Instance 0e392b33-c106-4158-b4be-8972aa5794f4 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:49:28.882773 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3d4ab03e-3879-463a-aaa3-54bf7cb97835 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/0e392b33-c106-4158-b4be-8972aa5794f4" status: 404 len: 111 microversion: 2.1 time: 0.049053 Oct 04 18:49:28.902327 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2339/4737] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:28 2022] GET /compute/v2.1/servers/0e392b33-c106-4158-b4be-8972aa5794f4 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:49:28.926598 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-71a8dd43-0451-4572-8289-63d6f1d5cc2d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:28.927499 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-71a8dd43-0451-4572-8289-63d6f1d5cc2d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:28.949306 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-71a8dd43-0451-4572-8289-63d6f1d5cc2d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:28.950629 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-71a8dd43-0451-4572-8289-63d6f1d5cc2d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:28.950629 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-71a8dd43-0451-4572-8289-63d6f1d5cc2d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:28.950933 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-71a8dd43-0451-4572-8289-63d6f1d5cc2d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:28.951398 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-71a8dd43-0451-4572-8289-63d6f1d5cc2d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:28.976239 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-71a8dd43-0451-4572-8289-63d6f1d5cc2d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:29.660139 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-622b47b0-da63-4268-8aa8-a457d6f49829 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:29.670312 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-622b47b0-da63-4268-8aa8-a457d6f49829 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1517 microversion: 2.1 time: 1.085755 Oct 04 18:49:29.674954 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2399/4738] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:28 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1517 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:29.681183 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1d110908-bd81-4157-8d89-1ec48b355930 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1130525725", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": [{"uuid": "8e684a5f-0995-474b-b515-28954add873e"}]}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:49:29.722458 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-71a8dd43-0451-4572-8289-63d6f1d5cc2d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:29.739691 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-71a8dd43-0451-4572-8289-63d6f1d5cc2d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1682 microversion: 2.1 time: 0.829774 Oct 04 18:49:29.739691 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2340/4739] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:28 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1682 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:29.767794 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7a34d049-c029-4aa9-a86d-59df1757edbf tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:29.768650 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7a34d049-c029-4aa9-a86d-59df1757edbf tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: b1b5f03e-fb43-4b1d-a072-02d7a0d724da] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:29.790679 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7a34d049-c029-4aa9-a86d-59df1757edbf tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:29.790679 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7a34d049-c029-4aa9-a86d-59df1757edbf tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:29.790679 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7a34d049-c029-4aa9-a86d-59df1757edbf tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:29.790679 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7a34d049-c029-4aa9-a86d-59df1757edbf tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:29.790972 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7a34d049-c029-4aa9-a86d-59df1757edbf tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:29.793085 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7a34d049-c029-4aa9-a86d-59df1757edbf tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:29.817145 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.neutron [None req-1d110908-bd81-4157-8d89-1ec48b355930 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] validate_networks() for [('8e684a5f-0995-474b-b515-28954add873e', None, None, None, None, None)] {{(pid=123001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:49:29.963377 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7a34d049-c029-4aa9-a86d-59df1757edbf tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:29.975285 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7a34d049-c029-4aa9-a86d-59df1757edbf tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/b1b5f03e-fb43-4b1d-a072-02d7a0d724da" status: 200 len: 1276 microversion: 2.1 time: 0.220747 Oct 04 18:49:29.976148 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2341/4740] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:29 2022] GET /compute/v2.1/servers/b1b5f03e-fb43-4b1d-a072-02d7a0d724da => generated 1276 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:30.711475 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e31f6ad3-3f69-4b6e-8351-600b7e25096a tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:30.712296 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e31f6ad3-3f69-4b6e-8351-600b7e25096a tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:30.728600 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e31f6ad3-3f69-4b6e-8351-600b7e25096a tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:30.729399 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e31f6ad3-3f69-4b6e-8351-600b7e25096a tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:30.729848 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e31f6ad3-3f69-4b6e-8351-600b7e25096a tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:30.730703 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e31f6ad3-3f69-4b6e-8351-600b7e25096a tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:30.731177 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e31f6ad3-3f69-4b6e-8351-600b7e25096a tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:30.731972 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e31f6ad3-3f69-4b6e-8351-600b7e25096a tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:31.252704 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e31f6ad3-3f69-4b6e-8351-600b7e25096a tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:31.265104 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e31f6ad3-3f69-4b6e-8351-600b7e25096a tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1517 microversion: 2.1 time: 0.564031 Oct 04 18:49:31.271853 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2342/4741] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:30 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1517 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:31.277737 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3753b054-93d6-400b-991e-d06587ba6e9d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:31.278676 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3753b054-93d6-400b-991e-d06587ba6e9d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:31.297226 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3753b054-93d6-400b-991e-d06587ba6e9d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:31.300584 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3753b054-93d6-400b-991e-d06587ba6e9d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:31.300584 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3753b054-93d6-400b-991e-d06587ba6e9d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:31.301368 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3753b054-93d6-400b-991e-d06587ba6e9d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:31.303865 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3753b054-93d6-400b-991e-d06587ba6e9d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:31.304689 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3753b054-93d6-400b-991e-d06587ba6e9d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:31.778079 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3753b054-93d6-400b-991e-d06587ba6e9d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:31.792415 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3753b054-93d6-400b-991e-d06587ba6e9d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1690 microversion: 2.1 time: 0.522788 Oct 04 18:49:31.794532 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2343/4742] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:31 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1690 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:31.805572 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f5755053-9d2e-4c28-a300-8af6fdd2b2e7 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:31.806721 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f5755053-9d2e-4c28-a300-8af6fdd2b2e7 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: b1b5f03e-fb43-4b1d-a072-02d7a0d724da] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:31.820734 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f5755053-9d2e-4c28-a300-8af6fdd2b2e7 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:31.822693 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f5755053-9d2e-4c28-a300-8af6fdd2b2e7 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:31.822693 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f5755053-9d2e-4c28-a300-8af6fdd2b2e7 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:31.828548 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f5755053-9d2e-4c28-a300-8af6fdd2b2e7 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:31.829618 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f5755053-9d2e-4c28-a300-8af6fdd2b2e7 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:31.832228 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f5755053-9d2e-4c28-a300-8af6fdd2b2e7 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:31.957195 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-1d110908-bd81-4157-8d89-1ec48b355930 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:49:31.958009 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-1d110908-bd81-4157-8d89-1ec48b355930 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:49:31.958190 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-1d110908-bd81-4157-8d89-1ec48b355930 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:49:31.958535 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-1d110908-bd81-4157-8d89-1ec48b355930 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:49:31.959138 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-1d110908-bd81-4157-8d89-1ec48b355930 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:49:31.990228 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1d110908-bd81-4157-8d89-1ec48b355930 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:31.991838 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1d110908-bd81-4157-8d89-1ec48b355930 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:31.992412 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1d110908-bd81-4157-8d89-1ec48b355930 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:31.997988 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1d110908-bd81-4157-8d89-1ec48b355930 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:31.997988 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1d110908-bd81-4157-8d89-1ec48b355930 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:31.997988 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1d110908-bd81-4157-8d89-1ec48b355930 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:32.017157 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-1d110908-bd81-4157-8d89-1ec48b355930 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Getting quotas for project 4154ec20e0354ee6a425ba853b8efe67. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:49:32.030650 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-1d110908-bd81-4157-8d89-1ec48b355930 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Getting quotas for user c56b67cede6b46f5a36a723d361b3245 and project 4154ec20e0354ee6a425ba853b8efe67. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:49:32.070567 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1d110908-bd81-4157-8d89-1ec48b355930 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Going to run 1 instances... {{(pid=123001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:49:32.080778 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1d110908-bd81-4157-8d89-1ec48b355930 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: 3209d143-9e5f-4529-a0bb-8fea0c22083b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:49:32.241052 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f5755053-9d2e-4c28-a300-8af6fdd2b2e7 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:32.249951 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f5755053-9d2e-4c28-a300-8af6fdd2b2e7 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/b1b5f03e-fb43-4b1d-a072-02d7a0d724da" status: 200 len: 1318 microversion: 2.1 time: 0.454086 Oct 04 18:49:32.250692 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2344/4743] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:31 2022] GET /compute/v2.1/servers/b1b5f03e-fb43-4b1d-a072-02d7a0d724da => generated 1318 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:32.300830 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-bce7a052-da0f-4d04-8399-4c457a6cad2a tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:32.308426 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-bce7a052-da0f-4d04-8399-4c457a6cad2a tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:32.327099 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1d110908-bd81-4157-8d89-1ec48b355930 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.650849 Oct 04 18:49:32.331669 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2400/4744] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:49:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 2656 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:49:32.338904 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bce7a052-da0f-4d04-8399-4c457a6cad2a tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:32.339418 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bce7a052-da0f-4d04-8399-4c457a6cad2a tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:32.345992 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bce7a052-da0f-4d04-8399-4c457a6cad2a tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:32.350000 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-65e27ab6-f378-4bb7-8019-8df4b07104db tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:32.350909 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-65e27ab6-f378-4bb7-8019-8df4b07104db tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: 3209d143-9e5f-4529-a0bb-8fea0c22083b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:32.359484 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bce7a052-da0f-4d04-8399-4c457a6cad2a tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:32.365997 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bce7a052-da0f-4d04-8399-4c457a6cad2a tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:32.366472 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bce7a052-da0f-4d04-8399-4c457a6cad2a tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:32.667788 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-65e27ab6-f378-4bb7-8019-8df4b07104db tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:32.696163 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-65e27ab6-f378-4bb7-8019-8df4b07104db tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/3209d143-9e5f-4529-a0bb-8fea0c22083b" status: 200 len: 1215 microversion: 2.1 time: 0.356223 Oct 04 18:49:32.696687 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2401/4745] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:32 2022] GET /compute/v2.1/servers/3209d143-9e5f-4529-a0bb-8fea0c22083b => generated 1215 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:32.822324 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-346a3d6a-6ac8-40d9-b162-a287ad9f6849 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:32.822962 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-346a3d6a-6ac8-40d9-b162-a287ad9f6849 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:32.834357 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-346a3d6a-6ac8-40d9-b162-a287ad9f6849 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:32.837430 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-346a3d6a-6ac8-40d9-b162-a287ad9f6849 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:32.838808 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-346a3d6a-6ac8-40d9-b162-a287ad9f6849 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:32.841193 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-346a3d6a-6ac8-40d9-b162-a287ad9f6849 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:32.842926 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-346a3d6a-6ac8-40d9-b162-a287ad9f6849 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:32.843430 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-346a3d6a-6ac8-40d9-b162-a287ad9f6849 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:33.133717 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:49:33.230610 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-bce7a052-da0f-4d04-8399-4c457a6cad2a tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:33.242316 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-bce7a052-da0f-4d04-8399-4c457a6cad2a tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1517 microversion: 2.1 time: 0.951368 Oct 04 18:49:33.242910 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2345/4746] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:32 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1517 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:33.307405 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4a018a88-5779-4528-b69f-76b5071e33b7 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:33.307405 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4a018a88-5779-4528-b69f-76b5071e33b7 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: b1b5f03e-fb43-4b1d-a072-02d7a0d724da] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:33.328434 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4a018a88-5779-4528-b69f-76b5071e33b7 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:33.330528 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4a018a88-5779-4528-b69f-76b5071e33b7 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:33.330969 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4a018a88-5779-4528-b69f-76b5071e33b7 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:33.336012 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4a018a88-5779-4528-b69f-76b5071e33b7 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:33.341256 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4a018a88-5779-4528-b69f-76b5071e33b7 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:33.341925 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4a018a88-5779-4528-b69f-76b5071e33b7 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:33.868988 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=8 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:49:33.902546 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-346a3d6a-6ac8-40d9-b162-a287ad9f6849 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:33.934766 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-346a3d6a-6ac8-40d9-b162-a287ad9f6849 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1690 microversion: 2.1 time: 1.116154 Oct 04 18:49:33.935782 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2402/4747] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:32 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1690 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:49:33.951003 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-dcec3fc0-692e-451e-88c1-52daeee54b01 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:33.952037 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-dcec3fc0-692e-451e-88c1-52daeee54b01 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: 3209d143-9e5f-4529-a0bb-8fea0c22083b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:34.151048 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-dcec3fc0-692e-451e-88c1-52daeee54b01 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:34.166283 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-dcec3fc0-692e-451e-88c1-52daeee54b01 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/3209d143-9e5f-4529-a0bb-8fea0c22083b" status: 200 len: 1215 microversion: 2.1 time: 0.223639 Oct 04 18:49:34.167179 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2403/4748] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:33 2022] GET /compute/v2.1/servers/3209d143-9e5f-4529-a0bb-8fea0c22083b => generated 1215 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:34.184794 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-eeab9c2d-8862-4d53-ba70-49580e558c22 req-39e0a9dd-896b-45e2-b1df-1b16938a9c05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1b5f03e-fb43-4b1d-a072-02d7a0d724da", "tag": "b2c6deaf-9672-446c-aab9-e7af60d31eb8"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:49:34.227286 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4a018a88-5779-4528-b69f-76b5071e33b7 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:34.235611 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4a018a88-5779-4528-b69f-76b5071e33b7 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/b1b5f03e-fb43-4b1d-a072-02d7a0d724da" status: 200 len: 1318 microversion: 2.1 time: 0.964485 Oct 04 18:49:34.241705 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2346/4749] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:33 2022] GET /compute/v2.1/servers/b1b5f03e-fb43-4b1d-a072-02d7a0d724da => generated 1318 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:34.258234 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-eeab9c2d-8862-4d53-ba70-49580e558c22 req-39e0a9dd-896b-45e2-b1df-1b16938a9c05 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:34.259058 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-eeab9c2d-8862-4d53-ba70-49580e558c22 req-39e0a9dd-896b-45e2-b1df-1b16938a9c05 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:34.261643 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-eeab9c2d-8862-4d53-ba70-49580e558c22 req-39e0a9dd-896b-45e2-b1df-1b16938a9c05 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:34.276615 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3fa1b3d7-37b3-49b5-a395-7d07b9a76b3e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:34.277363 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3fa1b3d7-37b3-49b5-a395-7d07b9a76b3e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:34.290368 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3fa1b3d7-37b3-49b5-a395-7d07b9a76b3e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:34.294588 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3fa1b3d7-37b3-49b5-a395-7d07b9a76b3e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:34.295156 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3fa1b3d7-37b3-49b5-a395-7d07b9a76b3e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:34.297365 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3fa1b3d7-37b3-49b5-a395-7d07b9a76b3e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:34.302412 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3fa1b3d7-37b3-49b5-a395-7d07b9a76b3e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:34.303507 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3fa1b3d7-37b3-49b5-a395-7d07b9a76b3e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:34.312300 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-eeab9c2d-8862-4d53-ba70-49580e558c22 req-39e0a9dd-896b-45e2-b1df-1b16938a9c05 service nova] Creating event network-changed:b2c6deaf-9672-446c-aab9-e7af60d31eb8 for instance b1b5f03e-fb43-4b1d-a072-02d7a0d724da on n-h2-850501-14 Oct 04 18:49:34.321742 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-eeab9c2d-8862-4d53-ba70-49580e558c22 req-39e0a9dd-896b-45e2-b1df-1b16938a9c05 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152968 Oct 04 18:49:34.323311 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2404/4750] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:49:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:49:34.966642 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-86fc647e-8e19-444d-8eb4-4a3c603190c1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:34.968205 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-86fc647e-8e19-444d-8eb4-4a3c603190c1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:34.982446 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-86fc647e-8e19-444d-8eb4-4a3c603190c1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:34.985807 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-86fc647e-8e19-444d-8eb4-4a3c603190c1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:34.988444 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-86fc647e-8e19-444d-8eb4-4a3c603190c1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:34.990898 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-86fc647e-8e19-444d-8eb4-4a3c603190c1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:34.992846 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-86fc647e-8e19-444d-8eb4-4a3c603190c1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:34.994317 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-86fc647e-8e19-444d-8eb4-4a3c603190c1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:35.206604 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3fa1b3d7-37b3-49b5-a395-7d07b9a76b3e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:35.215539 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3fa1b3d7-37b3-49b5-a395-7d07b9a76b3e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1517 microversion: 2.1 time: 0.943090 Oct 04 18:49:35.216153 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2347/4751] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:34 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1517 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:49:35.244980 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-07386801-bd86-4034-bdc1-7f8593a72b34 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:35.248790 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-07386801-bd86-4034-bdc1-7f8593a72b34 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: 3209d143-9e5f-4529-a0bb-8fea0c22083b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:35.274781 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-07386801-bd86-4034-bdc1-7f8593a72b34 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:35.276984 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-07386801-bd86-4034-bdc1-7f8593a72b34 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:35.277876 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-07386801-bd86-4034-bdc1-7f8593a72b34 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:35.278989 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-07386801-bd86-4034-bdc1-7f8593a72b34 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:35.279747 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-07386801-bd86-4034-bdc1-7f8593a72b34 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:35.280227 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-07386801-bd86-4034-bdc1-7f8593a72b34 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:35.393457 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-07386801-bd86-4034-bdc1-7f8593a72b34 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:35.402770 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-07386801-bd86-4034-bdc1-7f8593a72b34 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/3209d143-9e5f-4529-a0bb-8fea0c22083b" status: 200 len: 1211 microversion: 2.1 time: 0.176929 Oct 04 18:49:35.407580 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2348/4752] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:35 2022] GET /compute/v2.1/servers/3209d143-9e5f-4529-a0bb-8fea0c22083b => generated 1211 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:35.430831 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-41ddaab5-68f3-4127-9a5a-c8ef33f65d65 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:35.447637 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-41ddaab5-68f3-4127-9a5a-c8ef33f65d65 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: b1b5f03e-fb43-4b1d-a072-02d7a0d724da] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:35.456143 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-41ddaab5-68f3-4127-9a5a-c8ef33f65d65 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:35.456649 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-41ddaab5-68f3-4127-9a5a-c8ef33f65d65 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:35.457081 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-41ddaab5-68f3-4127-9a5a-c8ef33f65d65 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:35.468003 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-41ddaab5-68f3-4127-9a5a-c8ef33f65d65 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:35.471954 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-41ddaab5-68f3-4127-9a5a-c8ef33f65d65 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:35.476738 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-41ddaab5-68f3-4127-9a5a-c8ef33f65d65 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:35.605863 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-86fc647e-8e19-444d-8eb4-4a3c603190c1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:35.622768 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-86fc647e-8e19-444d-8eb4-4a3c603190c1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1690 microversion: 2.1 time: 0.660327 Oct 04 18:49:35.636482 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2405/4753] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:34 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1690 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:49:36.244126 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-e974ca7d-f5b4-463f-a5db-c185830feb0f req-3048340e-dbb0-45ff-a0f9-a05ecfe1c89b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e208f85-0513-43f4-8a2c-38baa2886238", "name": "network-vif-plugged", "status": "completed", "tag": "caad0bda-801d-4a85-94c7-4bb13cb984c3"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:49:36.259243 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-e974ca7d-f5b4-463f-a5db-c185830feb0f req-3048340e-dbb0-45ff-a0f9-a05ecfe1c89b service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:36.260476 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-e974ca7d-f5b4-463f-a5db-c185830feb0f req-3048340e-dbb0-45ff-a0f9-a05ecfe1c89b service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:36.262671 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-e974ca7d-f5b4-463f-a5db-c185830feb0f req-3048340e-dbb0-45ff-a0f9-a05ecfe1c89b service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:36.279968 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-e974ca7d-f5b4-463f-a5db-c185830feb0f req-3048340e-dbb0-45ff-a0f9-a05ecfe1c89b service nova] Creating event network-vif-plugged:caad0bda-801d-4a85-94c7-4bb13cb984c3 for instance 2e208f85-0513-43f4-8a2c-38baa2886238 on n-h2-850501-14 Oct 04 18:49:36.285320 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-e974ca7d-f5b4-463f-a5db-c185830feb0f req-3048340e-dbb0-45ff-a0f9-a05ecfe1c89b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051461 Oct 04 18:49:36.290598 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2406/4754] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:49:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:49:36.298395 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-da72f7e7-7dc0-4456-87ee-d97ad8078e9e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:36.299951 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-da72f7e7-7dc0-4456-87ee-d97ad8078e9e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:36.306678 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-da72f7e7-7dc0-4456-87ee-d97ad8078e9e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:36.307348 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-da72f7e7-7dc0-4456-87ee-d97ad8078e9e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:36.307853 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-da72f7e7-7dc0-4456-87ee-d97ad8078e9e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:36.309066 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-da72f7e7-7dc0-4456-87ee-d97ad8078e9e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:36.310008 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-da72f7e7-7dc0-4456-87ee-d97ad8078e9e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:36.310652 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-da72f7e7-7dc0-4456-87ee-d97ad8078e9e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:36.317749 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-41ddaab5-68f3-4127-9a5a-c8ef33f65d65 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:36.332688 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-41ddaab5-68f3-4127-9a5a-c8ef33f65d65 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/b1b5f03e-fb43-4b1d-a072-02d7a0d724da" status: 200 len: 1318 microversion: 2.1 time: 0.906392 Oct 04 18:49:36.334774 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2349/4755] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:35 2022] GET /compute/v2.1/servers/b1b5f03e-fb43-4b1d-a072-02d7a0d724da => generated 1318 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:36.432127 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-cfaec572-4a1c-4723-bfb3-71528955082f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:36.432843 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-cfaec572-4a1c-4723-bfb3-71528955082f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: 3209d143-9e5f-4529-a0bb-8fea0c22083b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:36.443282 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cfaec572-4a1c-4723-bfb3-71528955082f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:36.444704 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cfaec572-4a1c-4723-bfb3-71528955082f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:36.451777 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cfaec572-4a1c-4723-bfb3-71528955082f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:36.451777 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cfaec572-4a1c-4723-bfb3-71528955082f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:36.451777 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cfaec572-4a1c-4723-bfb3-71528955082f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:36.451777 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cfaec572-4a1c-4723-bfb3-71528955082f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:36.564302 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-cfaec572-4a1c-4723-bfb3-71528955082f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:36.573451 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-cfaec572-4a1c-4723-bfb3-71528955082f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/3209d143-9e5f-4529-a0bb-8fea0c22083b" status: 200 len: 1275 microversion: 2.1 time: 0.145966 Oct 04 18:49:36.574296 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2350/4756] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:36 2022] GET /compute/v2.1/servers/3209d143-9e5f-4529-a0bb-8fea0c22083b => generated 1275 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:36.599717 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-da72f7e7-7dc0-4456-87ee-d97ad8078e9e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:36.608157 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-da72f7e7-7dc0-4456-87ee-d97ad8078e9e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1517 microversion: 2.1 time: 0.315905 Oct 04 18:49:36.609310 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2407/4757] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:36 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1517 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:36.651073 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-79669fed-b0ae-4d77-9e4f-06c5d772cb1f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:36.651788 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-79669fed-b0ae-4d77-9e4f-06c5d772cb1f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:36.665076 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-79669fed-b0ae-4d77-9e4f-06c5d772cb1f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:36.665574 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-79669fed-b0ae-4d77-9e4f-06c5d772cb1f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:36.666753 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-79669fed-b0ae-4d77-9e4f-06c5d772cb1f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:36.667517 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-79669fed-b0ae-4d77-9e4f-06c5d772cb1f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:36.668049 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-79669fed-b0ae-4d77-9e4f-06c5d772cb1f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:36.668517 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-79669fed-b0ae-4d77-9e4f-06c5d772cb1f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:37.022566 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-79669fed-b0ae-4d77-9e4f-06c5d772cb1f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:37.031626 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-79669fed-b0ae-4d77-9e4f-06c5d772cb1f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1690 microversion: 2.1 time: 0.384637 Oct 04 18:49:37.048263 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2351/4758] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:36 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1690 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:37.357253 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f6536cdf-5f21-490f-bb87-68eae18ccd8b tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:37.357935 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f6536cdf-5f21-490f-bb87-68eae18ccd8b tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: b1b5f03e-fb43-4b1d-a072-02d7a0d724da] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:37.365557 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f6536cdf-5f21-490f-bb87-68eae18ccd8b tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:37.366047 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f6536cdf-5f21-490f-bb87-68eae18ccd8b tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:37.366494 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f6536cdf-5f21-490f-bb87-68eae18ccd8b tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:37.367277 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f6536cdf-5f21-490f-bb87-68eae18ccd8b tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:37.367804 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f6536cdf-5f21-490f-bb87-68eae18ccd8b tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:37.368680 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f6536cdf-5f21-490f-bb87-68eae18ccd8b tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:37.590236 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f6536cdf-5f21-490f-bb87-68eae18ccd8b tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:37.603559 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ff87b178-d685-406d-9570-18ea580d377f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:37.611422 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ff87b178-d685-406d-9570-18ea580d377f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: 3209d143-9e5f-4529-a0bb-8fea0c22083b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:37.619867 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ff87b178-d685-406d-9570-18ea580d377f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:37.620747 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ff87b178-d685-406d-9570-18ea580d377f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:37.621382 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ff87b178-d685-406d-9570-18ea580d377f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:37.622401 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ff87b178-d685-406d-9570-18ea580d377f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:37.623063 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ff87b178-d685-406d-9570-18ea580d377f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:37.623695 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ff87b178-d685-406d-9570-18ea580d377f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:37.636546 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f6536cdf-5f21-490f-bb87-68eae18ccd8b tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/b1b5f03e-fb43-4b1d-a072-02d7a0d724da" status: 200 len: 1318 microversion: 2.1 time: 0.277095 Oct 04 18:49:37.646740 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2408/4759] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:37 2022] GET /compute/v2.1/servers/b1b5f03e-fb43-4b1d-a072-02d7a0d724da => generated 1318 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:49:37.657973 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8eab9dcf-b693-4e95-9f79-051448fa1627 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:37.657973 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8eab9dcf-b693-4e95-9f79-051448fa1627 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:37.662719 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8eab9dcf-b693-4e95-9f79-051448fa1627 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:37.663442 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8eab9dcf-b693-4e95-9f79-051448fa1627 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:37.664381 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8eab9dcf-b693-4e95-9f79-051448fa1627 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:37.665236 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8eab9dcf-b693-4e95-9f79-051448fa1627 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:37.665847 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8eab9dcf-b693-4e95-9f79-051448fa1627 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:37.666429 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8eab9dcf-b693-4e95-9f79-051448fa1627 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:38.069556 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8eab9dcf-b693-4e95-9f79-051448fa1627 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:38.084756 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8eab9dcf-b693-4e95-9f79-051448fa1627 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1517 microversion: 2.1 time: 0.436640 Oct 04 18:49:38.087605 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2409/4760] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:37 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1517 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:38.099936 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6cdf7acd-ff16-4307-8843-2e21dbc6a7b3 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:38.100914 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6cdf7acd-ff16-4307-8843-2e21dbc6a7b3 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:38.116496 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6cdf7acd-ff16-4307-8843-2e21dbc6a7b3 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:38.117434 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6cdf7acd-ff16-4307-8843-2e21dbc6a7b3 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:38.118093 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6cdf7acd-ff16-4307-8843-2e21dbc6a7b3 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:38.119065 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6cdf7acd-ff16-4307-8843-2e21dbc6a7b3 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:38.122193 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6cdf7acd-ff16-4307-8843-2e21dbc6a7b3 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:38.122872 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6cdf7acd-ff16-4307-8843-2e21dbc6a7b3 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:38.169365 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ff87b178-d685-406d-9570-18ea580d377f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:38.183911 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ff87b178-d685-406d-9570-18ea580d377f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/3209d143-9e5f-4529-a0bb-8fea0c22083b" status: 200 len: 1315 microversion: 2.1 time: 0.584929 Oct 04 18:49:38.202615 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2352/4761] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:37 2022] GET /compute/v2.1/servers/3209d143-9e5f-4529-a0bb-8fea0c22083b => generated 1315 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:38.543670 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6cdf7acd-ff16-4307-8843-2e21dbc6a7b3 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:38.550480 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6cdf7acd-ff16-4307-8843-2e21dbc6a7b3 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1690 microversion: 2.1 time: 0.461119 Oct 04 18:49:38.551274 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2410/4762] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:38 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1690 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:38.660624 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6302b0f0-77d0-491e-a5f9-06c8520964c1 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:38.661432 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-6302b0f0-77d0-491e-a5f9-06c8520964c1 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: b1b5f03e-fb43-4b1d-a072-02d7a0d724da] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:38.669292 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6302b0f0-77d0-491e-a5f9-06c8520964c1 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:38.670703 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6302b0f0-77d0-491e-a5f9-06c8520964c1 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:38.671508 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6302b0f0-77d0-491e-a5f9-06c8520964c1 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:38.672757 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6302b0f0-77d0-491e-a5f9-06c8520964c1 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:38.673283 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6302b0f0-77d0-491e-a5f9-06c8520964c1 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:38.673961 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6302b0f0-77d0-491e-a5f9-06c8520964c1 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:38.836635 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-6302b0f0-77d0-491e-a5f9-06c8520964c1 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:38.837654 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6302b0f0-77d0-491e-a5f9-06c8520964c1 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/b1b5f03e-fb43-4b1d-a072-02d7a0d724da" status: 200 len: 1318 microversion: 2.1 time: 0.182856 Oct 04 18:49:38.838368 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2353/4763] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:38 2022] GET /compute/v2.1/servers/b1b5f03e-fb43-4b1d-a072-02d7a0d724da => generated 1318 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:39.119456 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-777c342d-53a5-453e-b2ff-4602ce7260ef tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:39.120208 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-777c342d-53a5-453e-b2ff-4602ce7260ef tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:39.126959 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-777c342d-53a5-453e-b2ff-4602ce7260ef tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:39.127449 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-777c342d-53a5-453e-b2ff-4602ce7260ef tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:39.127891 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-777c342d-53a5-453e-b2ff-4602ce7260ef tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:39.129064 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-777c342d-53a5-453e-b2ff-4602ce7260ef tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:39.130038 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-777c342d-53a5-453e-b2ff-4602ce7260ef tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:39.130507 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-777c342d-53a5-453e-b2ff-4602ce7260ef tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:39.213308 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6f8bd2d3-fda6-4453-b750-d28eb85917ef tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:39.214139 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-6f8bd2d3-fda6-4453-b750-d28eb85917ef tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: 3209d143-9e5f-4529-a0bb-8fea0c22083b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:39.221479 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6f8bd2d3-fda6-4453-b750-d28eb85917ef tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:39.221972 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6f8bd2d3-fda6-4453-b750-d28eb85917ef tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:39.222412 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6f8bd2d3-fda6-4453-b750-d28eb85917ef tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:39.223122 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6f8bd2d3-fda6-4453-b750-d28eb85917ef tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:39.223577 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6f8bd2d3-fda6-4453-b750-d28eb85917ef tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:39.224006 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6f8bd2d3-fda6-4453-b750-d28eb85917ef tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:39.280833 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-777c342d-53a5-453e-b2ff-4602ce7260ef tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:39.290145 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-777c342d-53a5-453e-b2ff-4602ce7260ef tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1517 microversion: 2.1 time: 0.174972 Oct 04 18:49:39.290724 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2411/4764] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:39 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1517 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:39.372041 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-6f8bd2d3-fda6-4453-b750-d28eb85917ef tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:39.384266 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6f8bd2d3-fda6-4453-b750-d28eb85917ef tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/3209d143-9e5f-4529-a0bb-8fea0c22083b" status: 200 len: 1315 microversion: 2.1 time: 0.171847 Oct 04 18:49:39.384266 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2354/4765] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:39 2022] GET /compute/v2.1/servers/3209d143-9e5f-4529-a0bb-8fea0c22083b => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:49:39.574928 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3777a1bd-2cf5-4a01-9c15-e71bb33dec56 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:39.575535 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3777a1bd-2cf5-4a01-9c15-e71bb33dec56 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:39.589973 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3777a1bd-2cf5-4a01-9c15-e71bb33dec56 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:39.590462 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3777a1bd-2cf5-4a01-9c15-e71bb33dec56 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:39.590897 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3777a1bd-2cf5-4a01-9c15-e71bb33dec56 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:39.591604 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3777a1bd-2cf5-4a01-9c15-e71bb33dec56 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:39.592070 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3777a1bd-2cf5-4a01-9c15-e71bb33dec56 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:39.594148 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3777a1bd-2cf5-4a01-9c15-e71bb33dec56 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:39.861763 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6bea521c-aeea-4af7-8ca4-9092d7057365 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:39.863095 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-6bea521c-aeea-4af7-8ca4-9092d7057365 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: b1b5f03e-fb43-4b1d-a072-02d7a0d724da] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:39.869604 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6bea521c-aeea-4af7-8ca4-9092d7057365 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:39.870415 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6bea521c-aeea-4af7-8ca4-9092d7057365 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:39.871275 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6bea521c-aeea-4af7-8ca4-9092d7057365 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:39.872329 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6bea521c-aeea-4af7-8ca4-9092d7057365 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:39.873015 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6bea521c-aeea-4af7-8ca4-9092d7057365 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:39.873806 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6bea521c-aeea-4af7-8ca4-9092d7057365 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:39.879280 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=100 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:49:39.973098 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3777a1bd-2cf5-4a01-9c15-e71bb33dec56 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:39.983646 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3777a1bd-2cf5-4a01-9c15-e71bb33dec56 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1685 microversion: 2.1 time: 0.411463 Oct 04 18:49:39.998706 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2412/4766] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:39 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1685 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:40.008452 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-a52db07a-6262-4d65-b0ef-8a15003675a6 req-ca5adfb4-ef8c-4c44-a605-e29a0fc7d15a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3209d143-9e5f-4529-a0bb-8fea0c22083b", "tag": "57f2dc22-09b7-47d9-b9e2-df30d366aaf2"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:49:40.022957 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-a52db07a-6262-4d65-b0ef-8a15003675a6 req-ca5adfb4-ef8c-4c44-a605-e29a0fc7d15a service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:40.023637 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-a52db07a-6262-4d65-b0ef-8a15003675a6 req-ca5adfb4-ef8c-4c44-a605-e29a0fc7d15a service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:40.025018 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-a52db07a-6262-4d65-b0ef-8a15003675a6 req-ca5adfb4-ef8c-4c44-a605-e29a0fc7d15a service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:40.043683 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-a52db07a-6262-4d65-b0ef-8a15003675a6 req-ca5adfb4-ef8c-4c44-a605-e29a0fc7d15a service nova] Creating event network-changed:57f2dc22-09b7-47d9-b9e2-df30d366aaf2 for instance 3209d143-9e5f-4529-a0bb-8fea0c22083b on n-h1-850501-14 Oct 04 18:49:40.051452 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-a52db07a-6262-4d65-b0ef-8a15003675a6 req-ca5adfb4-ef8c-4c44-a605-e29a0fc7d15a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046472 Oct 04 18:49:40.052624 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2413/4767] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:49:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:49:40.315367 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9b37d976-7a72-457d-8287-e47f1e19d328 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:40.316655 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-9b37d976-7a72-457d-8287-e47f1e19d328 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:40.324239 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9b37d976-7a72-457d-8287-e47f1e19d328 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:40.325163 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9b37d976-7a72-457d-8287-e47f1e19d328 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:40.325842 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9b37d976-7a72-457d-8287-e47f1e19d328 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:40.326781 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9b37d976-7a72-457d-8287-e47f1e19d328 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:40.327515 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9b37d976-7a72-457d-8287-e47f1e19d328 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:40.328194 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9b37d976-7a72-457d-8287-e47f1e19d328 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:40.333421 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=100 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:49:40.678088 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-6bea521c-aeea-4af7-8ca4-9092d7057365 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:40.688710 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6bea521c-aeea-4af7-8ca4-9092d7057365 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/b1b5f03e-fb43-4b1d-a072-02d7a0d724da" status: 200 len: 1318 microversion: 2.1 time: 0.830885 Oct 04 18:49:40.689663 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2355/4768] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:39 2022] GET /compute/v2.1/servers/b1b5f03e-fb43-4b1d-a072-02d7a0d724da => generated 1318 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:49:40.694869 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7dd93720-12f6-48f5-a0e5-28bde6e9caac tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:40.695691 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7dd93720-12f6-48f5-a0e5-28bde6e9caac tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: 3209d143-9e5f-4529-a0bb-8fea0c22083b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:40.702395 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7dd93720-12f6-48f5-a0e5-28bde6e9caac tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:40.705678 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7dd93720-12f6-48f5-a0e5-28bde6e9caac tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:40.706324 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7dd93720-12f6-48f5-a0e5-28bde6e9caac tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:40.717730 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7dd93720-12f6-48f5-a0e5-28bde6e9caac tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:40.717730 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7dd93720-12f6-48f5-a0e5-28bde6e9caac tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:40.717730 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7dd93720-12f6-48f5-a0e5-28bde6e9caac tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:40.755797 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9b37d976-7a72-457d-8287-e47f1e19d328 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:40.762367 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9b37d976-7a72-457d-8287-e47f1e19d328 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1517 microversion: 2.1 time: 0.451836 Oct 04 18:49:40.763493 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2414/4769] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:40 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1517 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:49:41.013605 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4596fb20-5f24-4034-92ba-87b1ae903cb6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:41.014449 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-4596fb20-5f24-4034-92ba-87b1ae903cb6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:41.022879 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4596fb20-5f24-4034-92ba-87b1ae903cb6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:41.023687 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4596fb20-5f24-4034-92ba-87b1ae903cb6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:41.024323 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4596fb20-5f24-4034-92ba-87b1ae903cb6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:41.025273 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4596fb20-5f24-4034-92ba-87b1ae903cb6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:41.025994 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4596fb20-5f24-4034-92ba-87b1ae903cb6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:41.026584 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4596fb20-5f24-4034-92ba-87b1ae903cb6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:41.260445 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7dd93720-12f6-48f5-a0e5-28bde6e9caac tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:41.275714 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7dd93720-12f6-48f5-a0e5-28bde6e9caac tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/3209d143-9e5f-4529-a0bb-8fea0c22083b" status: 200 len: 1315 microversion: 2.1 time: 0.584782 Oct 04 18:49:41.289796 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2356/4770] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:40 2022] GET /compute/v2.1/servers/3209d143-9e5f-4529-a0bb-8fea0c22083b => generated 1315 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:41.441713 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-4596fb20-5f24-4034-92ba-87b1ae903cb6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:41.451933 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-4596fb20-5f24-4034-92ba-87b1ae903cb6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1685 microversion: 2.1 time: 0.443687 Oct 04 18:49:41.452554 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2415/4771] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:41 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1685 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:49:41.713949 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c85fac6b-cfd0-42a3-8dca-43a8eaa14e63 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:41.714863 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c85fac6b-cfd0-42a3-8dca-43a8eaa14e63 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: b1b5f03e-fb43-4b1d-a072-02d7a0d724da] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:41.733732 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c85fac6b-cfd0-42a3-8dca-43a8eaa14e63 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:41.734230 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c85fac6b-cfd0-42a3-8dca-43a8eaa14e63 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:41.736035 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c85fac6b-cfd0-42a3-8dca-43a8eaa14e63 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:41.737036 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c85fac6b-cfd0-42a3-8dca-43a8eaa14e63 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:41.737507 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c85fac6b-cfd0-42a3-8dca-43a8eaa14e63 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:41.737934 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c85fac6b-cfd0-42a3-8dca-43a8eaa14e63 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:41.791230 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b48e150e-e5f0-4d00-b084-fb791f1d794c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:41.792662 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b48e150e-e5f0-4d00-b084-fb791f1d794c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:41.801368 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b48e150e-e5f0-4d00-b084-fb791f1d794c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:41.801974 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b48e150e-e5f0-4d00-b084-fb791f1d794c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:41.802572 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b48e150e-e5f0-4d00-b084-fb791f1d794c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:41.803492 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b48e150e-e5f0-4d00-b084-fb791f1d794c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:41.803955 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b48e150e-e5f0-4d00-b084-fb791f1d794c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:41.804473 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b48e150e-e5f0-4d00-b084-fb791f1d794c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:42.007142 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:49:42.086625 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c85fac6b-cfd0-42a3-8dca-43a8eaa14e63 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:42.099706 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c85fac6b-cfd0-42a3-8dca-43a8eaa14e63 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/b1b5f03e-fb43-4b1d-a072-02d7a0d724da" status: 200 len: 1318 microversion: 2.1 time: 0.389458 Oct 04 18:49:42.100362 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2357/4772] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:41 2022] GET /compute/v2.1/servers/b1b5f03e-fb43-4b1d-a072-02d7a0d724da => generated 1318 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:42.118641 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b48e150e-e5f0-4d00-b084-fb791f1d794c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:42.127808 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b48e150e-e5f0-4d00-b084-fb791f1d794c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1517 microversion: 2.1 time: 0.340434 Oct 04 18:49:42.128440 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2416/4773] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:41 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1517 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:42.299061 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-978cc16f-cb4b-4d00-bee9-87624e6a2378 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:42.300619 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-978cc16f-cb4b-4d00-bee9-87624e6a2378 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: 3209d143-9e5f-4529-a0bb-8fea0c22083b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:42.308800 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-978cc16f-cb4b-4d00-bee9-87624e6a2378 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:42.309675 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-978cc16f-cb4b-4d00-bee9-87624e6a2378 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:42.310359 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-978cc16f-cb4b-4d00-bee9-87624e6a2378 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:42.311325 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-978cc16f-cb4b-4d00-bee9-87624e6a2378 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:42.312009 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-978cc16f-cb4b-4d00-bee9-87624e6a2378 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:42.312791 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-978cc16f-cb4b-4d00-bee9-87624e6a2378 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:42.479587 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-978cc16f-cb4b-4d00-bee9-87624e6a2378 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:42.481727 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-08287c38-e96b-4b30-aa79-ae6c6dee44ae tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:42.484892 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-08287c38-e96b-4b30-aa79-ae6c6dee44ae tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:42.490180 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-08287c38-e96b-4b30-aa79-ae6c6dee44ae tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:42.490914 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-08287c38-e96b-4b30-aa79-ae6c6dee44ae tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:42.492522 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-08287c38-e96b-4b30-aa79-ae6c6dee44ae tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:42.493768 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-08287c38-e96b-4b30-aa79-ae6c6dee44ae tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:42.494475 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-08287c38-e96b-4b30-aa79-ae6c6dee44ae tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:42.495123 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-08287c38-e96b-4b30-aa79-ae6c6dee44ae tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:42.499066 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-978cc16f-cb4b-4d00-bee9-87624e6a2378 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/3209d143-9e5f-4529-a0bb-8fea0c22083b" status: 200 len: 1315 microversion: 2.1 time: 0.203761 Oct 04 18:49:42.499997 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2358/4774] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:42 2022] GET /compute/v2.1/servers/3209d143-9e5f-4529-a0bb-8fea0c22083b => generated 1315 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:42.673519 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-08287c38-e96b-4b30-aa79-ae6c6dee44ae tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:42.692923 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-08287c38-e96b-4b30-aa79-ae6c6dee44ae tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1685 microversion: 2.1 time: 0.215541 Oct 04 18:49:42.696931 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2417/4775] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:42 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1685 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:49:43.123237 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-368a7f84-85c3-4b29-a53c-b6547112fb86 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:43.123852 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-368a7f84-85c3-4b29-a53c-b6547112fb86 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: b1b5f03e-fb43-4b1d-a072-02d7a0d724da] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:43.137332 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-368a7f84-85c3-4b29-a53c-b6547112fb86 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:43.138142 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-368a7f84-85c3-4b29-a53c-b6547112fb86 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:43.138772 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-368a7f84-85c3-4b29-a53c-b6547112fb86 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:43.139699 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-368a7f84-85c3-4b29-a53c-b6547112fb86 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:43.140377 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-368a7f84-85c3-4b29-a53c-b6547112fb86 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:43.141689 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-368a7f84-85c3-4b29-a53c-b6547112fb86 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:43.152244 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-84163d8f-e93b-4d4f-8497-6423844b8222 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:43.153562 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-84163d8f-e93b-4d4f-8497-6423844b8222 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:43.162675 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-84163d8f-e93b-4d4f-8497-6423844b8222 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:43.163565 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-84163d8f-e93b-4d4f-8497-6423844b8222 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:43.164269 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-84163d8f-e93b-4d4f-8497-6423844b8222 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:43.165299 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-84163d8f-e93b-4d4f-8497-6423844b8222 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:43.166056 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-84163d8f-e93b-4d4f-8497-6423844b8222 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:43.166654 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-84163d8f-e93b-4d4f-8497-6423844b8222 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:43.494995 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-368a7f84-85c3-4b29-a53c-b6547112fb86 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:43.510340 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-368a7f84-85c3-4b29-a53c-b6547112fb86 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/b1b5f03e-fb43-4b1d-a072-02d7a0d724da" status: 200 len: 1318 microversion: 2.1 time: 0.390418 Oct 04 18:49:43.513038 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2359/4776] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:43 2022] GET /compute/v2.1/servers/b1b5f03e-fb43-4b1d-a072-02d7a0d724da => generated 1318 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:43.527169 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f50fd6e1-4fb4-4df6-827c-775ee652624d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:43.531148 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f50fd6e1-4fb4-4df6-827c-775ee652624d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: 3209d143-9e5f-4529-a0bb-8fea0c22083b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:43.550027 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f50fd6e1-4fb4-4df6-827c-775ee652624d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:43.554904 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f50fd6e1-4fb4-4df6-827c-775ee652624d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:43.556902 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f50fd6e1-4fb4-4df6-827c-775ee652624d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:43.560409 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f50fd6e1-4fb4-4df6-827c-775ee652624d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:43.562417 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f50fd6e1-4fb4-4df6-827c-775ee652624d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:43.566853 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f50fd6e1-4fb4-4df6-827c-775ee652624d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:43.582331 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-84163d8f-e93b-4d4f-8497-6423844b8222 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:43.596694 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-84163d8f-e93b-4d4f-8497-6423844b8222 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1517 microversion: 2.1 time: 0.448116 Oct 04 18:49:43.610958 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2418/4777] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:43 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1517 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:43.724775 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e563e585-8fb2-4309-857b-4898272f963e tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:43.725391 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e563e585-8fb2-4309-857b-4898272f963e tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:43.741394 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e563e585-8fb2-4309-857b-4898272f963e tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:43.743483 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e563e585-8fb2-4309-857b-4898272f963e tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:43.743607 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e563e585-8fb2-4309-857b-4898272f963e tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:43.751879 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e563e585-8fb2-4309-857b-4898272f963e tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:43.752426 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e563e585-8fb2-4309-857b-4898272f963e tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:43.752879 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e563e585-8fb2-4309-857b-4898272f963e tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:43.946117 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f50fd6e1-4fb4-4df6-827c-775ee652624d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:43.959856 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f50fd6e1-4fb4-4df6-827c-775ee652624d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/3209d143-9e5f-4529-a0bb-8fea0c22083b" status: 200 len: 1315 microversion: 2.1 time: 0.438565 Oct 04 18:49:43.961168 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2360/4778] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:43 2022] GET /compute/v2.1/servers/3209d143-9e5f-4529-a0bb-8fea0c22083b => generated 1315 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:44.057265 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e563e585-8fb2-4309-857b-4898272f963e tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:44.079405 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e563e585-8fb2-4309-857b-4898272f963e tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1685 microversion: 2.1 time: 0.357363 Oct 04 18:49:44.098114 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2419/4779] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:43 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1685 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:44.279182 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-efde7093-6eb6-4029-9b64-4af6c820285d req-2595833e-6e0e-439b-8df2-719c60ebff73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95fb1a13-7441-4f74-ad81-5a9413496545", "name": "network-vif-plugged", "status": "completed", "tag": "73befc4a-98f7-414e-8302-6ba3a3fd9481"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:49:44.290133 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:49:44.303225 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-efde7093-6eb6-4029-9b64-4af6c820285d req-2595833e-6e0e-439b-8df2-719c60ebff73 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:44.304536 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-efde7093-6eb6-4029-9b64-4af6c820285d req-2595833e-6e0e-439b-8df2-719c60ebff73 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:44.305649 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-efde7093-6eb6-4029-9b64-4af6c820285d req-2595833e-6e0e-439b-8df2-719c60ebff73 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:44.325069 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-efde7093-6eb6-4029-9b64-4af6c820285d req-2595833e-6e0e-439b-8df2-719c60ebff73 service nova] Creating event network-vif-plugged:73befc4a-98f7-414e-8302-6ba3a3fd9481 for instance 95fb1a13-7441-4f74-ad81-5a9413496545 on n-h2-850501-14 Oct 04 18:49:44.330998 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-efde7093-6eb6-4029-9b64-4af6c820285d req-2595833e-6e0e-439b-8df2-719c60ebff73 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057122 Oct 04 18:49:44.332996 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2361/4780] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:49:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:49:44.538658 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ffee1f6d-c42d-44c0-90e3-1be6c3e1a7a2 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:44.540007 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ffee1f6d-c42d-44c0-90e3-1be6c3e1a7a2 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: b1b5f03e-fb43-4b1d-a072-02d7a0d724da] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:44.558852 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=12 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:49:44.580938 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ffee1f6d-c42d-44c0-90e3-1be6c3e1a7a2 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:44.583369 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ffee1f6d-c42d-44c0-90e3-1be6c3e1a7a2 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:44.583832 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ffee1f6d-c42d-44c0-90e3-1be6c3e1a7a2 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:44.584621 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ffee1f6d-c42d-44c0-90e3-1be6c3e1a7a2 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:44.585094 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ffee1f6d-c42d-44c0-90e3-1be6c3e1a7a2 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:44.591154 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ffee1f6d-c42d-44c0-90e3-1be6c3e1a7a2 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:44.628493 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9c88f4d8-d5be-4a9e-a824-5afe027524fa tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:44.629990 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9c88f4d8-d5be-4a9e-a824-5afe027524fa tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:44.644707 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9c88f4d8-d5be-4a9e-a824-5afe027524fa tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:44.651339 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9c88f4d8-d5be-4a9e-a824-5afe027524fa tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:44.655388 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9c88f4d8-d5be-4a9e-a824-5afe027524fa tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:44.655388 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9c88f4d8-d5be-4a9e-a824-5afe027524fa tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:44.655388 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9c88f4d8-d5be-4a9e-a824-5afe027524fa tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:44.655388 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9c88f4d8-d5be-4a9e-a824-5afe027524fa tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:45.152798 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9c88f4d8-d5be-4a9e-a824-5afe027524fa tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:45.163376 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9c88f4d8-d5be-4a9e-a824-5afe027524fa tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1517 microversion: 2.1 time: 0.543030 Oct 04 18:49:45.184094 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2362/4781] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:44 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1517 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:49:45.184094 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c36af899-435d-4f93-8847-eb62c74d9493 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:45.184094 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c36af899-435d-4f93-8847-eb62c74d9493 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: 3209d143-9e5f-4529-a0bb-8fea0c22083b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:45.198904 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ffee1f6d-c42d-44c0-90e3-1be6c3e1a7a2 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:45.208127 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c36af899-435d-4f93-8847-eb62c74d9493 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:45.210706 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ffee1f6d-c42d-44c0-90e3-1be6c3e1a7a2 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/b1b5f03e-fb43-4b1d-a072-02d7a0d724da" status: 200 len: 1318 microversion: 2.1 time: 0.675929 Oct 04 18:49:45.212809 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c36af899-435d-4f93-8847-eb62c74d9493 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:45.224281 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c36af899-435d-4f93-8847-eb62c74d9493 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:45.224521 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2420/4782] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:44 2022] GET /compute/v2.1/servers/b1b5f03e-fb43-4b1d-a072-02d7a0d724da => generated 1318 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:45.224709 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c36af899-435d-4f93-8847-eb62c74d9493 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:45.224709 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c36af899-435d-4f93-8847-eb62c74d9493 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:45.224709 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c36af899-435d-4f93-8847-eb62c74d9493 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:45.226756 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e60ff674-3c08-4a00-aae3-6cbbb8a05c4a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:45.227656 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e60ff674-3c08-4a00-aae3-6cbbb8a05c4a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:45.246714 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e60ff674-3c08-4a00-aae3-6cbbb8a05c4a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:45.247749 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e60ff674-3c08-4a00-aae3-6cbbb8a05c4a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:45.248468 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e60ff674-3c08-4a00-aae3-6cbbb8a05c4a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:45.249586 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e60ff674-3c08-4a00-aae3-6cbbb8a05c4a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:45.250375 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e60ff674-3c08-4a00-aae3-6cbbb8a05c4a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:45.252189 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e60ff674-3c08-4a00-aae3-6cbbb8a05c4a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:45.614022 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c36af899-435d-4f93-8847-eb62c74d9493 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:45.641685 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e60ff674-3c08-4a00-aae3-6cbbb8a05c4a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:45.649532 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c36af899-435d-4f93-8847-eb62c74d9493 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/3209d143-9e5f-4529-a0bb-8fea0c22083b" status: 200 len: 1315 microversion: 2.1 time: 0.475333 Oct 04 18:49:45.650146 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2363/4783] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:45 2022] GET /compute/v2.1/servers/3209d143-9e5f-4529-a0bb-8fea0c22083b => generated 1315 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:45.662350 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e60ff674-3c08-4a00-aae3-6cbbb8a05c4a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1685 microversion: 2.1 time: 0.447716 Oct 04 18:49:45.666149 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2421/4784] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:45 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1685 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:46.196312 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-aa4ae271-2cb6-466e-8158-25c0895c5c2e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:46.197178 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-aa4ae271-2cb6-466e-8158-25c0895c5c2e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:46.207952 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aa4ae271-2cb6-466e-8158-25c0895c5c2e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:46.213256 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aa4ae271-2cb6-466e-8158-25c0895c5c2e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:46.213711 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aa4ae271-2cb6-466e-8158-25c0895c5c2e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:46.214450 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aa4ae271-2cb6-466e-8158-25c0895c5c2e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:46.214912 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aa4ae271-2cb6-466e-8158-25c0895c5c2e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:46.215342 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aa4ae271-2cb6-466e-8158-25c0895c5c2e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:46.243651 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3d4cac03-bbc6-4d84-9dfe-9a3c922f02d6 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:46.244295 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3d4cac03-bbc6-4d84-9dfe-9a3c922f02d6 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: b1b5f03e-fb43-4b1d-a072-02d7a0d724da] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:46.252671 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3d4cac03-bbc6-4d84-9dfe-9a3c922f02d6 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:46.259452 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3d4cac03-bbc6-4d84-9dfe-9a3c922f02d6 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:46.259905 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3d4cac03-bbc6-4d84-9dfe-9a3c922f02d6 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:46.260904 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3d4cac03-bbc6-4d84-9dfe-9a3c922f02d6 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:46.261143 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3d4cac03-bbc6-4d84-9dfe-9a3c922f02d6 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:46.272489 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3d4cac03-bbc6-4d84-9dfe-9a3c922f02d6 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:46.624196 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-aa4ae271-2cb6-466e-8158-25c0895c5c2e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:46.659728 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-aa4ae271-2cb6-466e-8158-25c0895c5c2e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1517 microversion: 2.1 time: 0.462311 Oct 04 18:49:46.664562 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2364/4785] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:46 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1517 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:46.670448 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3d4cac03-bbc6-4d84-9dfe-9a3c922f02d6 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:46.686227 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3d4cac03-bbc6-4d84-9dfe-9a3c922f02d6 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/b1b5f03e-fb43-4b1d-a072-02d7a0d724da" status: 200 len: 1318 microversion: 2.1 time: 0.445861 Oct 04 18:49:46.701415 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2422/4786] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:46 2022] GET /compute/v2.1/servers/b1b5f03e-fb43-4b1d-a072-02d7a0d724da => generated 1318 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:46.701574 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ee338510-3cef-466f-adcd-d7c7357b3a69 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:46.701574 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ee338510-3cef-466f-adcd-d7c7357b3a69 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: 3209d143-9e5f-4529-a0bb-8fea0c22083b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:46.705152 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-aa135951-cfb1-41d7-ad41-e4eb587663aa tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:46.707321 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-aa135951-cfb1-41d7-ad41-e4eb587663aa tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:46.724469 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aa135951-cfb1-41d7-ad41-e4eb587663aa tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:46.724964 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aa135951-cfb1-41d7-ad41-e4eb587663aa tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:46.725400 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aa135951-cfb1-41d7-ad41-e4eb587663aa tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:46.726122 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aa135951-cfb1-41d7-ad41-e4eb587663aa tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:46.726578 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aa135951-cfb1-41d7-ad41-e4eb587663aa tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:46.726995 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aa135951-cfb1-41d7-ad41-e4eb587663aa tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:46.729372 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ee338510-3cef-466f-adcd-d7c7357b3a69 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:46.736791 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ee338510-3cef-466f-adcd-d7c7357b3a69 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:46.737254 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ee338510-3cef-466f-adcd-d7c7357b3a69 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:46.738038 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ee338510-3cef-466f-adcd-d7c7357b3a69 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:46.742549 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ee338510-3cef-466f-adcd-d7c7357b3a69 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:46.743073 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ee338510-3cef-466f-adcd-d7c7357b3a69 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:47.145967 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ee338510-3cef-466f-adcd-d7c7357b3a69 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:47.154733 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ee338510-3cef-466f-adcd-d7c7357b3a69 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/3209d143-9e5f-4529-a0bb-8fea0c22083b" status: 200 len: 1315 microversion: 2.1 time: 0.472431 Oct 04 18:49:47.160700 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2365/4787] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:46 2022] GET /compute/v2.1/servers/3209d143-9e5f-4529-a0bb-8fea0c22083b => generated 1315 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:47.179169 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-8c4285d5-a218-47bc-9284-67f7bca3eef8 req-ee882b45-0f4d-4a3b-8478-6dbff490719b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1b5f03e-fb43-4b1d-a072-02d7a0d724da", "name": "network-vif-plugged", "status": "completed", "tag": "b2c6deaf-9672-446c-aab9-e7af60d31eb8"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:49:47.192196 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-8c4285d5-a218-47bc-9284-67f7bca3eef8 req-ee882b45-0f4d-4a3b-8478-6dbff490719b service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:47.196272 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-8c4285d5-a218-47bc-9284-67f7bca3eef8 req-ee882b45-0f4d-4a3b-8478-6dbff490719b service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:47.200641 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-8c4285d5-a218-47bc-9284-67f7bca3eef8 req-ee882b45-0f4d-4a3b-8478-6dbff490719b service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:47.259419 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-8c4285d5-a218-47bc-9284-67f7bca3eef8 req-ee882b45-0f4d-4a3b-8478-6dbff490719b service nova] Creating event network-vif-plugged:b2c6deaf-9672-446c-aab9-e7af60d31eb8 for instance b1b5f03e-fb43-4b1d-a072-02d7a0d724da on n-h2-850501-14 Oct 04 18:49:47.275209 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-8c4285d5-a218-47bc-9284-67f7bca3eef8 req-ee882b45-0f4d-4a3b-8478-6dbff490719b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110185 Oct 04 18:49:47.277400 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-aa135951-cfb1-41d7-ad41-e4eb587663aa tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:47.294702 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-aa135951-cfb1-41d7-ad41-e4eb587663aa tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1685 microversion: 2.1 time: 0.602478 Oct 04 18:49:47.296351 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2366/4788] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:49:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:49:47.297048 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2423/4789] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:46 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1685 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:47.691171 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1e4c8734-5b1d-40c3-8403-afd1baef09e9 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:47.692835 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1e4c8734-5b1d-40c3-8403-afd1baef09e9 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:47.705594 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1e4c8734-5b1d-40c3-8403-afd1baef09e9 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:47.707580 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1e4c8734-5b1d-40c3-8403-afd1baef09e9 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:47.710414 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1e4c8734-5b1d-40c3-8403-afd1baef09e9 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:47.712974 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1e4c8734-5b1d-40c3-8403-afd1baef09e9 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:47.713719 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1e4c8734-5b1d-40c3-8403-afd1baef09e9 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:47.715780 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1e4c8734-5b1d-40c3-8403-afd1baef09e9 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:47.733563 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f78e38f7-22f1-41ad-a277-005b1d2aefbf tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:47.734272 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f78e38f7-22f1-41ad-a277-005b1d2aefbf tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: b1b5f03e-fb43-4b1d-a072-02d7a0d724da] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:47.746742 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f78e38f7-22f1-41ad-a277-005b1d2aefbf tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:47.749167 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f78e38f7-22f1-41ad-a277-005b1d2aefbf tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:47.750764 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f78e38f7-22f1-41ad-a277-005b1d2aefbf tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:47.752999 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f78e38f7-22f1-41ad-a277-005b1d2aefbf tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:47.755925 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f78e38f7-22f1-41ad-a277-005b1d2aefbf tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:47.758880 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f78e38f7-22f1-41ad-a277-005b1d2aefbf tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:48.071114 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1e4c8734-5b1d-40c3-8403-afd1baef09e9 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:48.085733 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f78e38f7-22f1-41ad-a277-005b1d2aefbf tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:48.116134 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f78e38f7-22f1-41ad-a277-005b1d2aefbf tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/b1b5f03e-fb43-4b1d-a072-02d7a0d724da" status: 200 len: 1318 microversion: 2.1 time: 0.389043 Oct 04 18:49:48.116134 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2424/4790] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:47 2022] GET /compute/v2.1/servers/b1b5f03e-fb43-4b1d-a072-02d7a0d724da => generated 1318 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:48.116422 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1e4c8734-5b1d-40c3-8403-afd1baef09e9 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1517 microversion: 2.1 time: 0.414726 Oct 04 18:49:48.116422 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2367/4791] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:47 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1517 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:48.187021 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-edfd09ab-1037-4919-a135-030dfb49b04c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:48.187888 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-edfd09ab-1037-4919-a135-030dfb49b04c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: 3209d143-9e5f-4529-a0bb-8fea0c22083b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:48.206764 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-edfd09ab-1037-4919-a135-030dfb49b04c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:48.207750 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-edfd09ab-1037-4919-a135-030dfb49b04c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:48.209559 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-edfd09ab-1037-4919-a135-030dfb49b04c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:48.244018 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-edfd09ab-1037-4919-a135-030dfb49b04c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:48.246067 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-edfd09ab-1037-4919-a135-030dfb49b04c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:48.248239 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-edfd09ab-1037-4919-a135-030dfb49b04c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:48.324350 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-20e1a927-dc92-4b67-b051-1c3cf9a83172 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:48.327472 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-20e1a927-dc92-4b67-b051-1c3cf9a83172 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:48.344200 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-20e1a927-dc92-4b67-b051-1c3cf9a83172 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:48.345117 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-20e1a927-dc92-4b67-b051-1c3cf9a83172 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:48.345772 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-20e1a927-dc92-4b67-b051-1c3cf9a83172 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:48.351650 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-20e1a927-dc92-4b67-b051-1c3cf9a83172 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:48.352314 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-20e1a927-dc92-4b67-b051-1c3cf9a83172 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:48.353004 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-20e1a927-dc92-4b67-b051-1c3cf9a83172 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:48.727140 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-edfd09ab-1037-4919-a135-030dfb49b04c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:48.736911 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-edfd09ab-1037-4919-a135-030dfb49b04c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/3209d143-9e5f-4529-a0bb-8fea0c22083b" status: 200 len: 1315 microversion: 2.1 time: 0.554074 Oct 04 18:49:48.746694 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2425/4792] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:48 2022] GET /compute/v2.1/servers/3209d143-9e5f-4529-a0bb-8fea0c22083b => generated 1315 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:48.808717 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-20e1a927-dc92-4b67-b051-1c3cf9a83172 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:48.821259 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-20e1a927-dc92-4b67-b051-1c3cf9a83172 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1685 microversion: 2.1 time: 0.500943 Oct 04 18:49:48.824471 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2368/4793] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:48 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1685 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:49.130093 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c84714b2-6090-4893-a0d2-a33dd9b55efd tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:49.130704 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c84714b2-6090-4893-a0d2-a33dd9b55efd tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: b1b5f03e-fb43-4b1d-a072-02d7a0d724da] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:49.135890 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-998ae7d8-d3cd-48fc-a31c-401b982b89ad tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:49.136789 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-998ae7d8-d3cd-48fc-a31c-401b982b89ad tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:49.146861 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c84714b2-6090-4893-a0d2-a33dd9b55efd tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:49.147348 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c84714b2-6090-4893-a0d2-a33dd9b55efd tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:49.161609 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-998ae7d8-d3cd-48fc-a31c-401b982b89ad tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:49.164610 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-998ae7d8-d3cd-48fc-a31c-401b982b89ad tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:49.165259 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-998ae7d8-d3cd-48fc-a31c-401b982b89ad tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:49.166151 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-998ae7d8-d3cd-48fc-a31c-401b982b89ad tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:49.167084 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c84714b2-6090-4893-a0d2-a33dd9b55efd tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:49.168542 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-998ae7d8-d3cd-48fc-a31c-401b982b89ad tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:49.169484 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c84714b2-6090-4893-a0d2-a33dd9b55efd tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:49.170079 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-998ae7d8-d3cd-48fc-a31c-401b982b89ad tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:49.170726 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c84714b2-6090-4893-a0d2-a33dd9b55efd tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:49.176397 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c84714b2-6090-4893-a0d2-a33dd9b55efd tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:49.778161 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-998ae7d8-d3cd-48fc-a31c-401b982b89ad tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:49.792869 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-998ae7d8-d3cd-48fc-a31c-401b982b89ad tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1517 microversion: 2.1 time: 0.660798 Oct 04 18:49:49.793773 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2369/4794] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:49 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1517 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:49.802433 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-81e8069a-f4f4-4605-8a54-0d8cfb7b4580 req-5fea33bb-41c4-4e70-b7fb-a25531082bc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3209d143-9e5f-4529-a0bb-8fea0c22083b", "name": "network-vif-plugged", "status": "completed", "tag": "57f2dc22-09b7-47d9-b9e2-df30d366aaf2"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:49:49.833117 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-81e8069a-f4f4-4605-8a54-0d8cfb7b4580 req-5fea33bb-41c4-4e70-b7fb-a25531082bc1 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:49.833731 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-81e8069a-f4f4-4605-8a54-0d8cfb7b4580 req-5fea33bb-41c4-4e70-b7fb-a25531082bc1 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:49.834023 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-81e8069a-f4f4-4605-8a54-0d8cfb7b4580 req-5fea33bb-41c4-4e70-b7fb-a25531082bc1 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:49.854305 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-81e8069a-f4f4-4605-8a54-0d8cfb7b4580 req-5fea33bb-41c4-4e70-b7fb-a25531082bc1 service nova] Creating event network-vif-plugged:57f2dc22-09b7-47d9-b9e2-df30d366aaf2 for instance 3209d143-9e5f-4529-a0bb-8fea0c22083b on n-h1-850501-14 Oct 04 18:49:49.869696 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-81e8069a-f4f4-4605-8a54-0d8cfb7b4580 req-5fea33bb-41c4-4e70-b7fb-a25531082bc1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074513 Oct 04 18:49:49.870532 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2370/4795] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:49:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:49:49.879001 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5871b7cc-94ba-4c0b-8e06-bdd140dbcfc9 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:49.889576 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5871b7cc-94ba-4c0b-8e06-bdd140dbcfc9 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: 3209d143-9e5f-4529-a0bb-8fea0c22083b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:49.892787 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c84714b2-6090-4893-a0d2-a33dd9b55efd tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:49.899862 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5871b7cc-94ba-4c0b-8e06-bdd140dbcfc9 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:49.901876 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5871b7cc-94ba-4c0b-8e06-bdd140dbcfc9 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:49.902506 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5871b7cc-94ba-4c0b-8e06-bdd140dbcfc9 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:49.904186 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5871b7cc-94ba-4c0b-8e06-bdd140dbcfc9 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:49.904687 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c84714b2-6090-4893-a0d2-a33dd9b55efd tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/b1b5f03e-fb43-4b1d-a072-02d7a0d724da" status: 200 len: 1318 microversion: 2.1 time: 0.778373 Oct 04 18:49:49.905156 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5871b7cc-94ba-4c0b-8e06-bdd140dbcfc9 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:49.905923 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2426/4796] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:49 2022] GET /compute/v2.1/servers/b1b5f03e-fb43-4b1d-a072-02d7a0d724da => generated 1318 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:49.906326 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5871b7cc-94ba-4c0b-8e06-bdd140dbcfc9 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:49.918173 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e0101070-ff89-4bee-ac1d-66dc18e5ea72 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:49.919308 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e0101070-ff89-4bee-ac1d-66dc18e5ea72 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:49.931015 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e0101070-ff89-4bee-ac1d-66dc18e5ea72 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:49.932175 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e0101070-ff89-4bee-ac1d-66dc18e5ea72 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:49.932832 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e0101070-ff89-4bee-ac1d-66dc18e5ea72 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:49.933994 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e0101070-ff89-4bee-ac1d-66dc18e5ea72 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:49.934872 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e0101070-ff89-4bee-ac1d-66dc18e5ea72 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:49.936572 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e0101070-ff89-4bee-ac1d-66dc18e5ea72 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:50.310174 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e0101070-ff89-4bee-ac1d-66dc18e5ea72 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:50.324699 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e0101070-ff89-4bee-ac1d-66dc18e5ea72 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1685 microversion: 2.1 time: 0.414137 Oct 04 18:49:50.326992 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2427/4797] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:49 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1685 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:50.495698 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5871b7cc-94ba-4c0b-8e06-bdd140dbcfc9 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:50.505100 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5871b7cc-94ba-4c0b-8e06-bdd140dbcfc9 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/3209d143-9e5f-4529-a0bb-8fea0c22083b" status: 200 len: 1315 microversion: 2.1 time: 0.633179 Oct 04 18:49:50.522841 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2371/4798] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:49 2022] GET /compute/v2.1/servers/3209d143-9e5f-4529-a0bb-8fea0c22083b => generated 1315 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:50.818895 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-376a7db7-d16c-4cb9-838d-8954dd070dd2 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:50.820136 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-376a7db7-d16c-4cb9-838d-8954dd070dd2 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:50.828110 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-376a7db7-d16c-4cb9-838d-8954dd070dd2 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:50.829709 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-376a7db7-d16c-4cb9-838d-8954dd070dd2 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:50.830394 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-376a7db7-d16c-4cb9-838d-8954dd070dd2 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:50.831174 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-376a7db7-d16c-4cb9-838d-8954dd070dd2 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:50.831956 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-376a7db7-d16c-4cb9-838d-8954dd070dd2 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:50.832485 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-376a7db7-d16c-4cb9-838d-8954dd070dd2 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:50.936973 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7de52e53-9b4a-439e-ae87-5fb1f6740693 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:50.938513 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7de52e53-9b4a-439e-ae87-5fb1f6740693 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: b1b5f03e-fb43-4b1d-a072-02d7a0d724da] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:50.947257 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7de52e53-9b4a-439e-ae87-5fb1f6740693 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:50.947923 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7de52e53-9b4a-439e-ae87-5fb1f6740693 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:50.948590 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7de52e53-9b4a-439e-ae87-5fb1f6740693 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:50.949478 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7de52e53-9b4a-439e-ae87-5fb1f6740693 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:50.950188 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7de52e53-9b4a-439e-ae87-5fb1f6740693 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:50.950800 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7de52e53-9b4a-439e-ae87-5fb1f6740693 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:51.108920 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-376a7db7-d16c-4cb9-838d-8954dd070dd2 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:51.117738 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-376a7db7-d16c-4cb9-838d-8954dd070dd2 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1504 microversion: 2.1 time: 0.303030 Oct 04 18:49:51.127722 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2428/4799] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:50 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1504 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:51.146963 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e376c48e-2149-4a19-a103-51bbf082b50a tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:51.148121 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e376c48e-2149-4a19-a103-51bbf082b50a tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:51.158773 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e376c48e-2149-4a19-a103-51bbf082b50a tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:51.159593 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e376c48e-2149-4a19-a103-51bbf082b50a tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:51.160299 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e376c48e-2149-4a19-a103-51bbf082b50a tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:51.161324 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e376c48e-2149-4a19-a103-51bbf082b50a tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:51.162603 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e376c48e-2149-4a19-a103-51bbf082b50a tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:51.163731 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e376c48e-2149-4a19-a103-51bbf082b50a tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:51.185248 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7de52e53-9b4a-439e-ae87-5fb1f6740693 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:51.195139 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7de52e53-9b4a-439e-ae87-5fb1f6740693 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/b1b5f03e-fb43-4b1d-a072-02d7a0d724da" status: 200 len: 1507 microversion: 2.1 time: 0.261946 Oct 04 18:49:51.208673 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2372/4800] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:50 2022] GET /compute/v2.1/servers/b1b5f03e-fb43-4b1d-a072-02d7a0d724da => generated 1507 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:51.220515 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8f424e12-b913-44dd-b6a3-a0577f2a8114 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:51.221139 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8f424e12-b913-44dd-b6a3-a0577f2a8114 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: b1b5f03e-fb43-4b1d-a072-02d7a0d724da] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:51.247151 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8f424e12-b913-44dd-b6a3-a0577f2a8114 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:51.247637 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8f424e12-b913-44dd-b6a3-a0577f2a8114 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:51.248162 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8f424e12-b913-44dd-b6a3-a0577f2a8114 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:51.248806 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8f424e12-b913-44dd-b6a3-a0577f2a8114 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:51.249669 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8f424e12-b913-44dd-b6a3-a0577f2a8114 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:51.251990 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8f424e12-b913-44dd-b6a3-a0577f2a8114 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:51.438728 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e376c48e-2149-4a19-a103-51bbf082b50a tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:51.450326 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e376c48e-2149-4a19-a103-51bbf082b50a tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1504 microversion: 2.1 time: 0.308543 Oct 04 18:49:51.450973 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2429/4801] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:51 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1504 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:49:51.467225 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a1f41a77-97e5-4d21-8534-52c4968b1b83 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:51.469519 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a1f41a77-97e5-4d21-8534-52c4968b1b83 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:51.479139 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a1f41a77-97e5-4d21-8534-52c4968b1b83 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:51.479639 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a1f41a77-97e5-4d21-8534-52c4968b1b83 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:51.480178 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a1f41a77-97e5-4d21-8534-52c4968b1b83 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:51.481132 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a1f41a77-97e5-4d21-8534-52c4968b1b83 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:51.481503 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a1f41a77-97e5-4d21-8534-52c4968b1b83 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:51.481940 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a1f41a77-97e5-4d21-8534-52c4968b1b83 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:51.567952 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8f424e12-b913-44dd-b6a3-a0577f2a8114 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:51.572425 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=100 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:49:51.586711 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8f424e12-b913-44dd-b6a3-a0577f2a8114 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/b1b5f03e-fb43-4b1d-a072-02d7a0d724da" status: 200 len: 1507 microversion: 2.1 time: 0.368625 Oct 04 18:49:51.589005 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2373/4802] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:51 2022] GET /compute/v2.1/servers/b1b5f03e-fb43-4b1d-a072-02d7a0d724da => generated 1507 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:49:51.597455 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d207e7d6-4079-4206-9c94-8f00772af0ea tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:51.599874 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d207e7d6-4079-4206-9c94-8f00772af0ea tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:51.608677 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d207e7d6-4079-4206-9c94-8f00772af0ea tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:51.610163 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d207e7d6-4079-4206-9c94-8f00772af0ea tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:51.620717 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d207e7d6-4079-4206-9c94-8f00772af0ea tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:51.620717 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d207e7d6-4079-4206-9c94-8f00772af0ea tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:51.620717 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d207e7d6-4079-4206-9c94-8f00772af0ea tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:51.620717 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d207e7d6-4079-4206-9c94-8f00772af0ea tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:51.855164 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a1f41a77-97e5-4d21-8534-52c4968b1b83 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:51.858613 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=100 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:49:51.871273 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a1f41a77-97e5-4d21-8534-52c4968b1b83 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1685 microversion: 2.1 time: 0.416072 Oct 04 18:49:51.872265 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2430/4803] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:51 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1685 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:51.880973 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f9a9a87b-ae3b-45b8-8ada-6b35a8a4609d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:51.881636 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f9a9a87b-ae3b-45b8-8ada-6b35a8a4609d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: 3209d143-9e5f-4529-a0bb-8fea0c22083b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:51.895061 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f9a9a87b-ae3b-45b8-8ada-6b35a8a4609d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:51.900027 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f9a9a87b-ae3b-45b8-8ada-6b35a8a4609d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:51.900696 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f9a9a87b-ae3b-45b8-8ada-6b35a8a4609d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:51.901553 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f9a9a87b-ae3b-45b8-8ada-6b35a8a4609d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:51.905721 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f9a9a87b-ae3b-45b8-8ada-6b35a8a4609d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:51.906770 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f9a9a87b-ae3b-45b8-8ada-6b35a8a4609d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:51.917691 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d207e7d6-4079-4206-9c94-8f00772af0ea tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:51.930780 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d207e7d6-4079-4206-9c94-8f00772af0ea tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1504 microversion: 2.1 time: 0.338680 Oct 04 18:49:51.931293 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2374/4804] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:51 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1504 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:51.937579 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-372508d0-a479-4c47-b289-2f50bfcd071a tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:49:51.962179 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-372508d0-a479-4c47-b289-2f50bfcd071a tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: b1b5f03e-fb43-4b1d-a072-02d7a0d724da] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:51.977933 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-372508d0-a479-4c47-b289-2f50bfcd071a tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:51.979808 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-372508d0-a479-4c47-b289-2f50bfcd071a tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:51.979808 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-372508d0-a479-4c47-b289-2f50bfcd071a tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:51.985049 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-372508d0-a479-4c47-b289-2f50bfcd071a tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:51.985864 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-372508d0-a479-4c47-b289-2f50bfcd071a tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:51.986466 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-372508d0-a479-4c47-b289-2f50bfcd071a tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:52.259321 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-372508d0-a479-4c47-b289-2f50bfcd071a tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "PUT /compute/v2.1/servers/b1b5f03e-fb43-4b1d-a072-02d7a0d724da" status: 200 len: 1079 microversion: 2.1 time: 0.325660 Oct 04 18:49:52.260785 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2375/4805] 10.222.0.20 () {60 vars in 1256 bytes} [Tue Oct 4 18:49:51 2022] PUT /compute/v2.1/servers/b1b5f03e-fb43-4b1d-a072-02d7a0d724da => generated 1079 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:52.267263 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-296cbdb1-7827-4524-99d2-6d5f052f8e59 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:49:52.273778 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-296cbdb1-7827-4524-99d2-6d5f052f8e59 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] HTTP exception thrown: Instance 8b5c3b44-4662-403a-b018-4c10223b4c7d has no mapping to a cell. Oct 04 18:49:52.280261 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-296cbdb1-7827-4524-99d2-6d5f052f8e59 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Request method failure captured: Oct 04 18:49:52.280261 n-d-850501-14 devstack@n-api.service[123002]: request: POST /compute/v2.1/servers/8b5c3b44-4662-403a-b018-4c10223b4c7d/action HTTP/1.1 Oct 04 18:49:52.280261 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:49:52.280261 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:49:52.280261 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:49:52.280261 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 15 Oct 04 18:49:52.280261 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:49:52.280261 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:49:52.280261 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:49:52.280261 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:49:52.280261 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH9zAVdj2h4kh6QqBpYrS2CJMhbcXf529VUNrZoZOYhS2tkLYBgw6AHy860DK9jQ3xATqZvC9lQuxt-_H5qKsAI41eznf32K6QSGqVcHXegpVHrDueww23ZMVCBM3D_hH0NTzh4447rgHqcrC-OZE48IfZrRJ9KPLPjAHT57T3mcPIc Oct 04 18:49:52.280261 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:49:52.280261 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:49:52.280261 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:49:52.280261 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:49:52.280261 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:49:52.280261 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:49:52.280261 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: b6c6b9deecde44b5953d22b38b5b0ff1 Oct 04 18:49:52.280261 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:49:52.280261 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:49:52.280261 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:49:52.280261 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6c6b9deecde44b5953d22b38b5b0ff1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b6c6b9deecde44b5953d22b38b5b0ff1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b6c6b9deecde44b5953d22b38b5b0ff1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6c6b9deecde44b5953d22b38b5b0ff1"}]}] Oct 04 18:49:52.280261 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:49:52.280261 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: b6c6b9deecde44b5953d22b38b5b0ff1 Oct 04 18:49:52.280261 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:49:52.280261 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServersNegativeTestJSON-626077540-project Oct 04 18:49:52.280261 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:49:52.280261 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:49:52.280261 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 5b4eb70f22ba4872b890a4f160cc1805 Oct 04 18:49:52.280261 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServersNegativeTestJSON-626077540-project Oct 04 18:49:52.280261 n-d-850501-14 devstack@n-api.service[123002]: Oct 04 18:49:52.280261 n-d-850501-14 devstack@n-api.service[123002]: {"os-stop": {}} Oct 04 18:49:52.280261 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:49:52.280261 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 8b5c3b44-4662-403a-b018-4c10223b4c7d has no mapping to a cell. Oct 04 18:49:52.280261 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '8b5c3b44-4662-403a-b018-4c10223b4c7d', 'body': {'os-stop': {}}} Oct 04 18:49:52.280261 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:49:52.280261 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:49:52.280261 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1411, in _get_instance Oct 04 18:49:52.280261 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Oct 04 18:49:52.280261 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:49:52.280261 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:49:52.280261 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Oct 04 18:49:52.280261 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 04 18:49:52.280261 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:49:52.280261 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:49:52.280261 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Oct 04 18:49:52.280261 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Oct 04 18:49:52.280261 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 8b5c3b44-4662-403a-b018-4c10223b4c7d has no mapping to a cell. Oct 04 18:49:52.280261 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:49:52.280261 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:49:52.280261 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:49:52.280261 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:49:52.280261 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:49:52.280261 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:49:52.280261 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:49:52.280261 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:49:52.280261 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:49:52.280261 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:49:52.280261 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1444, in _stop_server Oct 04 18:49:52.280261 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Oct 04 18:49:52.280261 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1418, in _get_instance Oct 04 18:49:52.280261 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:49:52.280261 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b5c3b44-4662-403a-b018-4c10223b4c7d has no mapping to a cell. Oct 04 18:49:52.285886 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:49:52.285886 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:49:52.285886 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:49:52.285886 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:49:52.285886 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:49:52.285886 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:49:52.285886 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:49:52.285886 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:49:52.285886 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b5c3b44-4662-403a-b018-4c10223b4c7d has no mapping to a cell. Oct 04 18:49:52.285886 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:49:52.288321 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-296cbdb1-7827-4524-99d2-6d5f052f8e59 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Returning 404 to user: Instance 8b5c3b44-4662-403a-b018-4c10223b4c7d has no mapping to a cell. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:49:52.290038 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-296cbdb1-7827-4524-99d2-6d5f052f8e59 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "POST /compute/v2.1/servers/8b5c3b44-4662-403a-b018-4c10223b4c7d/action" status: 404 len: 117 microversion: 2.1 time: 0.027351 Oct 04 18:49:52.291368 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2376/4806] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:49:52 2022] POST /compute/v2.1/servers/8b5c3b44-4662-403a-b018-4c10223b4c7d/action => generated 117 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:49:52.298185 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-82695359-3386-4a9d-bf1a-e07436398f3a tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:52.299208 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-82695359-3386-4a9d-bf1a-e07436398f3a tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: b1b5f03e-fb43-4b1d-a072-02d7a0d724da] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:52.303613 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f9a9a87b-ae3b-45b8-8ada-6b35a8a4609d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:52.307900 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-82695359-3386-4a9d-bf1a-e07436398f3a tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:52.308828 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-82695359-3386-4a9d-bf1a-e07436398f3a tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:52.309803 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-82695359-3386-4a9d-bf1a-e07436398f3a tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:52.310739 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-82695359-3386-4a9d-bf1a-e07436398f3a tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:52.311463 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-82695359-3386-4a9d-bf1a-e07436398f3a tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:52.312138 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-82695359-3386-4a9d-bf1a-e07436398f3a tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:52.318903 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f9a9a87b-ae3b-45b8-8ada-6b35a8a4609d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/3209d143-9e5f-4529-a0bb-8fea0c22083b" status: 200 len: 1501 microversion: 2.1 time: 0.444428 Oct 04 18:49:52.318903 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2431/4807] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:51 2022] GET /compute/v2.1/servers/3209d143-9e5f-4529-a0bb-8fea0c22083b => generated 1501 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:52.323783 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f871db41-81e3-4d12-a146-ae007f867ee2 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:52.324424 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f871db41-81e3-4d12-a146-ae007f867ee2 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:52.331947 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f871db41-81e3-4d12-a146-ae007f867ee2 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:52.332487 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f871db41-81e3-4d12-a146-ae007f867ee2 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:52.332930 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f871db41-81e3-4d12-a146-ae007f867ee2 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:52.334121 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f871db41-81e3-4d12-a146-ae007f867ee2 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:52.334121 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f871db41-81e3-4d12-a146-ae007f867ee2 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:52.334478 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f871db41-81e3-4d12-a146-ae007f867ee2 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:52.831002 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-82695359-3386-4a9d-bf1a-e07436398f3a tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:52.862146 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-82695359-3386-4a9d-bf1a-e07436398f3a tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/b1b5f03e-fb43-4b1d-a072-02d7a0d724da" status: 200 len: 1505 microversion: 2.1 time: 0.569168 Oct 04 18:49:52.865530 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2377/4808] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:52 2022] GET /compute/v2.1/servers/b1b5f03e-fb43-4b1d-a072-02d7a0d724da => generated 1505 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:52.873299 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f871db41-81e3-4d12-a146-ae007f867ee2 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:52.883511 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f871db41-81e3-4d12-a146-ae007f867ee2 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1504 microversion: 2.1 time: 0.563547 Oct 04 18:49:52.884382 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2432/4809] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:52 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1504 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:52.913751 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9f19e01f-cf7f-442b-af7d-5f37753da07d tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:52.914837 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9f19e01f-cf7f-442b-af7d-5f37753da07d tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: b1b5f03e-fb43-4b1d-a072-02d7a0d724da] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:52.915703 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-22212081-ac5a-4c14-ad8c-9ea3e3841733 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:52.917298 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-22212081-ac5a-4c14-ad8c-9ea3e3841733 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:52.929609 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-22212081-ac5a-4c14-ad8c-9ea3e3841733 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:52.930256 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-22212081-ac5a-4c14-ad8c-9ea3e3841733 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:52.930858 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-22212081-ac5a-4c14-ad8c-9ea3e3841733 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:52.931573 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-22212081-ac5a-4c14-ad8c-9ea3e3841733 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:52.932092 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-22212081-ac5a-4c14-ad8c-9ea3e3841733 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:52.932595 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-22212081-ac5a-4c14-ad8c-9ea3e3841733 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:52.933309 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9f19e01f-cf7f-442b-af7d-5f37753da07d tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:52.935789 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9f19e01f-cf7f-442b-af7d-5f37753da07d tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:52.937667 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9f19e01f-cf7f-442b-af7d-5f37753da07d tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:52.942817 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9f19e01f-cf7f-442b-af7d-5f37753da07d tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:52.943830 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9f19e01f-cf7f-442b-af7d-5f37753da07d tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:52.954648 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9f19e01f-cf7f-442b-af7d-5f37753da07d tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:53.263487 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9f19e01f-cf7f-442b-af7d-5f37753da07d tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:53.285649 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9f19e01f-cf7f-442b-af7d-5f37753da07d tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/b1b5f03e-fb43-4b1d-a072-02d7a0d724da" status: 200 len: 1505 microversion: 2.1 time: 0.397871 Oct 04 18:49:53.288405 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2378/4810] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:52 2022] GET /compute/v2.1/servers/b1b5f03e-fb43-4b1d-a072-02d7a0d724da => generated 1505 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:53.303314 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8324e880-ac8f-4441-aed6-5dc807e3821e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:53.304346 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8324e880-ac8f-4441-aed6-5dc807e3821e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:53.313344 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8324e880-ac8f-4441-aed6-5dc807e3821e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:53.314948 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8324e880-ac8f-4441-aed6-5dc807e3821e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:53.314948 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8324e880-ac8f-4441-aed6-5dc807e3821e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:53.315911 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8324e880-ac8f-4441-aed6-5dc807e3821e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:53.316617 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8324e880-ac8f-4441-aed6-5dc807e3821e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:53.317241 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8324e880-ac8f-4441-aed6-5dc807e3821e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:53.393560 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-22212081-ac5a-4c14-ad8c-9ea3e3841733 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:53.404556 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-22212081-ac5a-4c14-ad8c-9ea3e3841733 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1685 microversion: 2.1 time: 0.509665 Oct 04 18:49:53.408421 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2433/4811] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:52 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1685 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:53.423811 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b7e1364f-674b-4b5d-8741-a94a9578ac70 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:49:53.434808 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b7e1364f-674b-4b5d-8741-a94a9578ac70 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: b1b5f03e-fb43-4b1d-a072-02d7a0d724da] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:53.448905 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b7e1364f-674b-4b5d-8741-a94a9578ac70 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:53.449576 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b7e1364f-674b-4b5d-8741-a94a9578ac70 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:53.450122 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b7e1364f-674b-4b5d-8741-a94a9578ac70 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:53.450982 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b7e1364f-674b-4b5d-8741-a94a9578ac70 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:53.457152 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b7e1364f-674b-4b5d-8741-a94a9578ac70 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:53.461305 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b7e1364f-674b-4b5d-8741-a94a9578ac70 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:53.682148 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8324e880-ac8f-4441-aed6-5dc807e3821e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:53.709429 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8324e880-ac8f-4441-aed6-5dc807e3821e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1504 microversion: 2.1 time: 0.419331 Oct 04 18:49:53.710830 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2379/4812] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:53 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1504 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:53.763250 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2f767fe7-b065-4520-8718-853ef7581054 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:49:53.764134 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2f767fe7-b065-4520-8718-853ef7581054 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: d0d21a44-6811-416f-82b3-a1b4efd157b2] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:53.783565 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-2f767fe7-b065-4520-8718-853ef7581054 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] HTTP exception thrown: Instance d0d21a44-6811-416f-82b3-a1b4efd157b2 could not be found. Oct 04 18:49:53.786166 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2f767fe7-b065-4520-8718-853ef7581054 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Request method failure captured: Oct 04 18:49:53.786166 n-d-850501-14 devstack@n-api.service[123002]: request: POST /compute/v2.1/servers/d0d21a44-6811-416f-82b3-a1b4efd157b2/action HTTP/1.1 Oct 04 18:49:53.786166 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:49:53.786166 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:49:53.786166 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:49:53.786166 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 15 Oct 04 18:49:53.786166 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:49:53.786166 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:49:53.786166 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:49:53.786166 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:49:53.786166 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH9zAVdj2h4kh6QqBpYrS2CJMhbcXf529VUNrZoZOYhS2tkLYBgw6AHy860DK9jQ3xATqZvC9lQuxt-_H5qKsAI41eznf32K6QSGqVcHXegpVHrDueww23ZMVCBM3D_hH0NTzh4447rgHqcrC-OZE48IfZrRJ9KPLPjAHT57T3mcPIc Oct 04 18:49:53.786166 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:49:53.786166 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:49:53.786166 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:49:53.786166 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:49:53.786166 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:49:53.786166 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:49:53.786166 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: b6c6b9deecde44b5953d22b38b5b0ff1 Oct 04 18:49:53.786166 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:49:53.786166 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:49:53.786166 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:49:53.786166 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6c6b9deecde44b5953d22b38b5b0ff1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b6c6b9deecde44b5953d22b38b5b0ff1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b6c6b9deecde44b5953d22b38b5b0ff1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6c6b9deecde44b5953d22b38b5b0ff1"}]}] Oct 04 18:49:53.786166 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:49:53.786166 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: b6c6b9deecde44b5953d22b38b5b0ff1 Oct 04 18:49:53.786166 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:49:53.786166 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServersNegativeTestJSON-626077540-project Oct 04 18:49:53.786166 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:49:53.786166 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:49:53.786166 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 5b4eb70f22ba4872b890a4f160cc1805 Oct 04 18:49:53.786166 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServersNegativeTestJSON-626077540-project Oct 04 18:49:53.786166 n-d-850501-14 devstack@n-api.service[123002]: Oct 04 18:49:53.786166 n-d-850501-14 devstack@n-api.service[123002]: {"suspend": {}} Oct 04 18:49:53.786166 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:49:53.786166 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance d0d21a44-6811-416f-82b3-a1b4efd157b2 could not be found. Oct 04 18:49:53.786166 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'd0d21a44-6811-416f-82b3-a1b4efd157b2', 'body': {'suspend': {}}} Oct 04 18:49:53.786166 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:49:53.786166 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:49:53.786166 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:49:53.786166 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:49:53.786166 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:49:53.786166 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:49:53.786166 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:49:53.786166 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:49:53.786166 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0d21a44-6811-416f-82b3-a1b4efd157b2 could not be found. Oct 04 18:49:53.786166 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:49:53.786166 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:49:53.786166 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:49:53.786166 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:49:53.786166 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:49:53.786166 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:49:53.786166 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:49:53.786166 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:49:53.786166 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:49:53.786166 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:49:53.786166 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Oct 04 18:49:53.786166 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 04 18:49:53.786166 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:49:53.786166 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:49:53.786166 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0d21a44-6811-416f-82b3-a1b4efd157b2 could not be found. Oct 04 18:49:53.786166 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:49:53.786166 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:49:53.786166 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:49:53.786166 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:49:53.786166 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:49:53.786166 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:49:53.803233 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:49:53.803233 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:49:53.803233 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0d21a44-6811-416f-82b3-a1b4efd157b2 could not be found. Oct 04 18:49:53.803233 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:49:53.803233 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2f767fe7-b065-4520-8718-853ef7581054 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Returning 404 to user: Instance d0d21a44-6811-416f-82b3-a1b4efd157b2 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:49:53.803233 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2f767fe7-b065-4520-8718-853ef7581054 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "POST /compute/v2.1/servers/d0d21a44-6811-416f-82b3-a1b4efd157b2/action" status: 404 len: 111 microversion: 2.1 time: 0.046376 Oct 04 18:49:53.803233 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2380/4813] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:49:53 2022] POST /compute/v2.1/servers/d0d21a44-6811-416f-82b3-a1b4efd157b2/action => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:49:53.808975 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-271fd04e-e702-43c5-ae86-314718352693 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:53.810397 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-271fd04e-e702-43c5-ae86-314718352693 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:53.837447 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-271fd04e-e702-43c5-ae86-314718352693 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:53.840460 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-271fd04e-e702-43c5-ae86-314718352693 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:53.842642 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-271fd04e-e702-43c5-ae86-314718352693 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:53.847552 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-271fd04e-e702-43c5-ae86-314718352693 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:53.850395 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-271fd04e-e702-43c5-ae86-314718352693 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:53.852671 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-271fd04e-e702-43c5-ae86-314718352693 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:53.890384 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b7e1364f-674b-4b5d-8741-a94a9578ac70 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "PUT /compute/v2.1/servers/b1b5f03e-fb43-4b1d-a072-02d7a0d724da" status: 200 len: 1081 microversion: 2.1 time: 0.480807 Oct 04 18:49:53.900182 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2434/4814] 10.222.0.20 () {60 vars in 1256 bytes} [Tue Oct 4 18:49:53 2022] PUT /compute/v2.1/servers/b1b5f03e-fb43-4b1d-a072-02d7a0d724da => generated 1081 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:53.931700 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-dd19b2f4-a1b5-4ea3-b22e-39de0c9f091f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:53.945287 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-dd19b2f4-a1b5-4ea3-b22e-39de0c9f091f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: b1b5f03e-fb43-4b1d-a072-02d7a0d724da] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:53.959301 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:49:53.961381 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dd19b2f4-a1b5-4ea3-b22e-39de0c9f091f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:53.962767 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dd19b2f4-a1b5-4ea3-b22e-39de0c9f091f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:53.963431 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dd19b2f4-a1b5-4ea3-b22e-39de0c9f091f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:53.964447 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dd19b2f4-a1b5-4ea3-b22e-39de0c9f091f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:53.965129 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dd19b2f4-a1b5-4ea3-b22e-39de0c9f091f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:53.965760 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dd19b2f4-a1b5-4ea3-b22e-39de0c9f091f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:55.010168 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-271fd04e-e702-43c5-ae86-314718352693 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:55.027996 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-271fd04e-e702-43c5-ae86-314718352693 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1504 microversion: 2.1 time: 1.233991 Oct 04 18:49:55.033243 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2381/4815] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:53 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1504 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:55.047811 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4dc5c155-c672-481a-bd27-50513543e09b tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:55.061070 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4dc5c155-c672-481a-bd27-50513543e09b tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:55.068990 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4dc5c155-c672-481a-bd27-50513543e09b tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:55.073928 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-dd19b2f4-a1b5-4ea3-b22e-39de0c9f091f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:55.074929 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4dc5c155-c672-481a-bd27-50513543e09b tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:55.075744 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4dc5c155-c672-481a-bd27-50513543e09b tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:55.079165 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4dc5c155-c672-481a-bd27-50513543e09b tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:55.082059 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4dc5c155-c672-481a-bd27-50513543e09b tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:55.086261 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4dc5c155-c672-481a-bd27-50513543e09b tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:55.101274 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-dd19b2f4-a1b5-4ea3-b22e-39de0c9f091f tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/b1b5f03e-fb43-4b1d-a072-02d7a0d724da" status: 200 len: 1507 microversion: 2.1 time: 1.173800 Oct 04 18:49:55.104270 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2435/4816] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:53 2022] GET /compute/v2.1/servers/b1b5f03e-fb43-4b1d-a072-02d7a0d724da => generated 1507 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:55.114233 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e15b0f2d-4b76-41cd-b481-1cbcd7f44eff tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:55.116863 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e15b0f2d-4b76-41cd-b481-1cbcd7f44eff tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:55.136650 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e15b0f2d-4b76-41cd-b481-1cbcd7f44eff tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:55.138694 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e15b0f2d-4b76-41cd-b481-1cbcd7f44eff tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:55.143522 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e15b0f2d-4b76-41cd-b481-1cbcd7f44eff tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:55.143522 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e15b0f2d-4b76-41cd-b481-1cbcd7f44eff tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:55.143522 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e15b0f2d-4b76-41cd-b481-1cbcd7f44eff tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:55.143522 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e15b0f2d-4b76-41cd-b481-1cbcd7f44eff tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:55.624487 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4dc5c155-c672-481a-bd27-50513543e09b tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:55.644782 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4dc5c155-c672-481a-bd27-50513543e09b tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1685 microversion: 2.1 time: 0.608245 Oct 04 18:49:55.645965 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2382/4817] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:55 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1685 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:55.663455 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ed1cff9d-97ad-4aa7-815e-ff8f4789efe1 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:55.667320 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ed1cff9d-97ad-4aa7-815e-ff8f4789efe1 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: b1b5f03e-fb43-4b1d-a072-02d7a0d724da] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:55.691377 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ed1cff9d-97ad-4aa7-815e-ff8f4789efe1 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:55.694739 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ed1cff9d-97ad-4aa7-815e-ff8f4789efe1 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:55.695773 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ed1cff9d-97ad-4aa7-815e-ff8f4789efe1 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:55.697275 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ed1cff9d-97ad-4aa7-815e-ff8f4789efe1 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:55.698170 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ed1cff9d-97ad-4aa7-815e-ff8f4789efe1 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:55.699011 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ed1cff9d-97ad-4aa7-815e-ff8f4789efe1 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:55.724589 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e15b0f2d-4b76-41cd-b481-1cbcd7f44eff tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:55.748246 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e15b0f2d-4b76-41cd-b481-1cbcd7f44eff tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1504 microversion: 2.1 time: 0.641438 Oct 04 18:49:55.752236 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2436/4818] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:55 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1504 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:55.785201 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a5ff0043-0d09-421f-ae34-5e0c368c16de tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:49:55.786120 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a5ff0043-0d09-421f-ae34-5e0c368c16de tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:55.805129 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a5ff0043-0d09-421f-ae34-5e0c368c16de tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:55.808786 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a5ff0043-0d09-421f-ae34-5e0c368c16de tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:55.811015 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a5ff0043-0d09-421f-ae34-5e0c368c16de tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:55.815671 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a5ff0043-0d09-421f-ae34-5e0c368c16de tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:55.818570 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a5ff0043-0d09-421f-ae34-5e0c368c16de tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:55.819210 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a5ff0043-0d09-421f-ae34-5e0c368c16de tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:55.921487 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-a5ff0043-0d09-421f-ae34-5e0c368c16de tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lazy-loading 'flavor' on Instance uuid 95fb1a13-7441-4f74-ad81-5a9413496545 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:49:56.068947 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ed1cff9d-97ad-4aa7-815e-ff8f4789efe1 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:56.088292 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ed1cff9d-97ad-4aa7-815e-ff8f4789efe1 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/b1b5f03e-fb43-4b1d-a072-02d7a0d724da" status: 200 len: 1507 microversion: 2.1 time: 0.429598 Oct 04 18:49:56.100090 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2383/4819] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:55 2022] GET /compute/v2.1/servers/b1b5f03e-fb43-4b1d-a072-02d7a0d724da => generated 1507 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:56.117459 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-02ceba18-4398-48d4-beaa-69b601d53754 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:56.120504 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-02ceba18-4398-48d4-beaa-69b601d53754 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: b1b5f03e-fb43-4b1d-a072-02d7a0d724da] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:56.133345 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-02ceba18-4398-48d4-beaa-69b601d53754 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:56.133916 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-02ceba18-4398-48d4-beaa-69b601d53754 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:56.134462 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-02ceba18-4398-48d4-beaa-69b601d53754 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:56.138036 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-02ceba18-4398-48d4-beaa-69b601d53754 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:56.138685 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-02ceba18-4398-48d4-beaa-69b601d53754 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:56.140633 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-02ceba18-4398-48d4-beaa-69b601d53754 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:56.207474 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-02ceba18-4398-48d4-beaa-69b601d53754 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: b1b5f03e-fb43-4b1d-a072-02d7a0d724da] Going to try to terminate instance {{(pid=123002) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:49:56.472025 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a5ff0043-0d09-421f-ae34-5e0c368c16de tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "POST /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545/action" status: 202 len: 0 microversion: 2.1 time: 0.697200 Oct 04 18:49:56.472716 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2437/4820] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:49:55 2022] POST /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545/action => generated 0 bytes in 700 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:49:56.498677 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0739dc8a-f797-4235-83be-06dbef10d2fd tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:56.507251 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0739dc8a-f797-4235-83be-06dbef10d2fd tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:56.523371 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0739dc8a-f797-4235-83be-06dbef10d2fd tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:56.534560 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0739dc8a-f797-4235-83be-06dbef10d2fd tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:56.535643 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0739dc8a-f797-4235-83be-06dbef10d2fd tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:56.551878 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0739dc8a-f797-4235-83be-06dbef10d2fd tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:56.552445 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0739dc8a-f797-4235-83be-06dbef10d2fd tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:56.556542 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0739dc8a-f797-4235-83be-06dbef10d2fd tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:56.768585 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0739dc8a-f797-4235-83be-06dbef10d2fd tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:56.780416 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0739dc8a-f797-4235-83be-06dbef10d2fd tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1512 microversion: 2.1 time: 0.300560 Oct 04 18:49:56.781073 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2438/4821] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:56 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1512 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:56.791274 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-76e264e8-220e-4221-ac6c-62d8fb7a4947 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:56.797311 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-76e264e8-220e-4221-ac6c-62d8fb7a4947 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:56.814447 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-76e264e8-220e-4221-ac6c-62d8fb7a4947 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:56.816695 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-76e264e8-220e-4221-ac6c-62d8fb7a4947 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:56.817152 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-76e264e8-220e-4221-ac6c-62d8fb7a4947 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:56.818139 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-76e264e8-220e-4221-ac6c-62d8fb7a4947 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:56.828835 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-76e264e8-220e-4221-ac6c-62d8fb7a4947 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:56.832449 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-76e264e8-220e-4221-ac6c-62d8fb7a4947 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:56.846299 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-02ceba18-4398-48d4-beaa-69b601d53754 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b1b5f03e-fb43-4b1d-a072-02d7a0d724da" status: 204 len: 0 microversion: 2.1 time: 0.732765 Oct 04 18:49:56.846299 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2384/4822] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:49:56 2022] DELETE /compute/v2.1/servers/b1b5f03e-fb43-4b1d-a072-02d7a0d724da => generated 0 bytes in 735 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:49:56.856826 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a8c85b9a-c223-4a5a-b82e-4cd83d5e3cd1 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:56.858086 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a8c85b9a-c223-4a5a-b82e-4cd83d5e3cd1 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: b1b5f03e-fb43-4b1d-a072-02d7a0d724da] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:56.880765 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a8c85b9a-c223-4a5a-b82e-4cd83d5e3cd1 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:56.880765 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a8c85b9a-c223-4a5a-b82e-4cd83d5e3cd1 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:56.880765 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a8c85b9a-c223-4a5a-b82e-4cd83d5e3cd1 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:56.880765 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a8c85b9a-c223-4a5a-b82e-4cd83d5e3cd1 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:56.880765 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a8c85b9a-c223-4a5a-b82e-4cd83d5e3cd1 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:56.880765 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a8c85b9a-c223-4a5a-b82e-4cd83d5e3cd1 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:56.967871 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a8c85b9a-c223-4a5a-b82e-4cd83d5e3cd1 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: b1b5f03e-fb43-4b1d-a072-02d7a0d724da] Going to try to terminate instance {{(pid=123002) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:49:57.166555 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-76e264e8-220e-4221-ac6c-62d8fb7a4947 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:57.169189 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.compute.api [None req-a8c85b9a-c223-4a5a-b82e-4cd83d5e3cd1 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: b1b5f03e-fb43-4b1d-a072-02d7a0d724da] Instance is already in deleting state, ignoring this request Oct 04 18:49:57.171957 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a8c85b9a-c223-4a5a-b82e-4cd83d5e3cd1 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b1b5f03e-fb43-4b1d-a072-02d7a0d724da" status: 204 len: 0 microversion: 2.1 time: 0.319753 Oct 04 18:49:57.174267 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2385/4823] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:49:56 2022] DELETE /compute/v2.1/servers/b1b5f03e-fb43-4b1d-a072-02d7a0d724da => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:49:57.179982 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-76e264e8-220e-4221-ac6c-62d8fb7a4947 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1685 microversion: 2.1 time: 0.396135 Oct 04 18:49:57.180491 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-83fd4680-9aa2-4db5-9c42-3cd316704c1f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "15e89bf5-2151-4e9e-a6df-5e70e0ff6dc2"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:49:57.183102 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-83fd4680-9aa2-4db5-9c42-3cd316704c1f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: 3209d143-9e5f-4529-a0bb-8fea0c22083b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:57.184464 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2439/4824] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:56 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1685 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:57.193889 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6504331b-0dca-4975-a9a5-583d6378bd3d tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:57.198630 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6504331b-0dca-4975-a9a5-583d6378bd3d tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: b1b5f03e-fb43-4b1d-a072-02d7a0d724da] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:57.209814 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6504331b-0dca-4975-a9a5-583d6378bd3d tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:57.212651 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-83fd4680-9aa2-4db5-9c42-3cd316704c1f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:57.213330 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-83fd4680-9aa2-4db5-9c42-3cd316704c1f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:57.214016 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-83fd4680-9aa2-4db5-9c42-3cd316704c1f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:57.214877 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-83fd4680-9aa2-4db5-9c42-3cd316704c1f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:57.215484 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-83fd4680-9aa2-4db5-9c42-3cd316704c1f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:57.216077 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-83fd4680-9aa2-4db5-9c42-3cd316704c1f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:57.220469 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6504331b-0dca-4975-a9a5-583d6378bd3d tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:57.220925 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6504331b-0dca-4975-a9a5-583d6378bd3d tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:57.221805 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6504331b-0dca-4975-a9a5-583d6378bd3d tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:57.222339 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6504331b-0dca-4975-a9a5-583d6378bd3d tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:57.222702 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6504331b-0dca-4975-a9a5-583d6378bd3d tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:57.662067 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6504331b-0dca-4975-a9a5-583d6378bd3d tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:57.670766 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6504331b-0dca-4975-a9a5-583d6378bd3d tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/b1b5f03e-fb43-4b1d-a072-02d7a0d724da" status: 200 len: 1513 microversion: 2.1 time: 0.485072 Oct 04 18:49:57.671361 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2440/4825] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:57 2022] GET /compute/v2.1/servers/b1b5f03e-fb43-4b1d-a072-02d7a0d724da => generated 1513 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:57.808210 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-afe7a8d3-b35a-4d27-af30-858e8e62c85c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:57.808861 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-afe7a8d3-b35a-4d27-af30-858e8e62c85c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:57.814907 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-afe7a8d3-b35a-4d27-af30-858e8e62c85c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:57.815398 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-afe7a8d3-b35a-4d27-af30-858e8e62c85c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:57.815832 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-afe7a8d3-b35a-4d27-af30-858e8e62c85c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:57.816550 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-afe7a8d3-b35a-4d27-af30-858e8e62c85c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:57.817001 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-afe7a8d3-b35a-4d27-af30-858e8e62c85c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:57.817425 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-afe7a8d3-b35a-4d27-af30-858e8e62c85c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:58.078982 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-afe7a8d3-b35a-4d27-af30-858e8e62c85c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:58.097460 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-afe7a8d3-b35a-4d27-af30-858e8e62c85c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1512 microversion: 2.1 time: 0.292973 Oct 04 18:49:58.112542 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2441/4826] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:57 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1512 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:49:58.216520 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-86b870d3-f65d-4d3d-934e-f44cc08f57e2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:58.217618 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-86b870d3-f65d-4d3d-934e-f44cc08f57e2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:58.231223 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-86b870d3-f65d-4d3d-934e-f44cc08f57e2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:58.247481 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-86b870d3-f65d-4d3d-934e-f44cc08f57e2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:58.248450 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-86b870d3-f65d-4d3d-934e-f44cc08f57e2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:58.252895 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-86b870d3-f65d-4d3d-934e-f44cc08f57e2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:58.254986 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-86b870d3-f65d-4d3d-934e-f44cc08f57e2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:58.256694 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-86b870d3-f65d-4d3d-934e-f44cc08f57e2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:58.642244 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-83fd4680-9aa2-4db5-9c42-3cd316704c1f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "POST /compute/v2.1/servers/3209d143-9e5f-4529-a0bb-8fea0c22083b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.466160 Oct 04 18:49:58.643701 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2386/4827] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Oct 4 18:49:57 2022] POST /compute/v2.1/servers/3209d143-9e5f-4529-a0bb-8fea0c22083b/os-volume_attachments => generated 194 bytes in 1469 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:49:58.711796 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6a9803e2-1310-488f-bda5-86afdde4aa8e tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:58.718933 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-6a9803e2-1310-488f-bda5-86afdde4aa8e tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: b1b5f03e-fb43-4b1d-a072-02d7a0d724da] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:58.777300 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6a9803e2-1310-488f-bda5-86afdde4aa8e tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:58.779339 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6a9803e2-1310-488f-bda5-86afdde4aa8e tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:58.786396 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6a9803e2-1310-488f-bda5-86afdde4aa8e tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:58.789725 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6a9803e2-1310-488f-bda5-86afdde4aa8e tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:58.790595 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6a9803e2-1310-488f-bda5-86afdde4aa8e tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:58.797098 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6a9803e2-1310-488f-bda5-86afdde4aa8e tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:58.801696 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-86b870d3-f65d-4d3d-934e-f44cc08f57e2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:58.815392 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-86b870d3-f65d-4d3d-934e-f44cc08f57e2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1685 microversion: 2.1 time: 0.604520 Oct 04 18:49:58.816282 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2442/4828] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:58 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1685 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:58.883415 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=5,nova_cell1:INSERT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:49:59.125934 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b975c03a-03eb-4ce3-a586-3bbb32f85220 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:59.126937 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b975c03a-03eb-4ce3-a586-3bbb32f85220 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:59.173200 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b975c03a-03eb-4ce3-a586-3bbb32f85220 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:59.179006 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b975c03a-03eb-4ce3-a586-3bbb32f85220 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:59.183126 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b975c03a-03eb-4ce3-a586-3bbb32f85220 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:59.185313 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b975c03a-03eb-4ce3-a586-3bbb32f85220 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:59.186404 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b975c03a-03eb-4ce3-a586-3bbb32f85220 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:59.187953 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b975c03a-03eb-4ce3-a586-3bbb32f85220 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:59.432830 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-6a9803e2-1310-488f-bda5-86afdde4aa8e tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:59.441496 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6a9803e2-1310-488f-bda5-86afdde4aa8e tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/b1b5f03e-fb43-4b1d-a072-02d7a0d724da" status: 200 len: 1513 microversion: 2.1 time: 0.749640 Oct 04 18:49:59.447814 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2387/4829] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:58 2022] GET /compute/v2.1/servers/b1b5f03e-fb43-4b1d-a072-02d7a0d724da => generated 1513 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:59.623035 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b975c03a-03eb-4ce3-a586-3bbb32f85220 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:59.635283 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b975c03a-03eb-4ce3-a586-3bbb32f85220 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1495 microversion: 2.1 time: 0.513452 Oct 04 18:49:59.655424 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2443/4830] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:59 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1495 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:59.681905 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-831d1b85-762b-40d5-8eb3-2bdf5060c6f9 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:49:59.682996 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-831d1b85-762b-40d5-8eb3-2bdf5060c6f9 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:59.702407 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-831d1b85-762b-40d5-8eb3-2bdf5060c6f9 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:59.703985 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-831d1b85-762b-40d5-8eb3-2bdf5060c6f9 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:59.704467 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-831d1b85-762b-40d5-8eb3-2bdf5060c6f9 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:59.705267 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-831d1b85-762b-40d5-8eb3-2bdf5060c6f9 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:59.708664 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-831d1b85-762b-40d5-8eb3-2bdf5060c6f9 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:59.710661 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-831d1b85-762b-40d5-8eb3-2bdf5060c6f9 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:59.767817 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-831d1b85-762b-40d5-8eb3-2bdf5060c6f9 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lazy-loading 'flavor' on Instance uuid 95fb1a13-7441-4f74-ad81-5a9413496545 {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:49:59.846174 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-831d1b85-762b-40d5-8eb3-2bdf5060c6f9 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] HTTP exception thrown: Cannot 'suspend' instance 95fb1a13-7441-4f74-ad81-5a9413496545 while it is in vm_state suspended Oct 04 18:49:59.851164 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-027f76f2-5bb7-440f-8ad4-a0aa253c83a6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:59.852350 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-027f76f2-5bb7-440f-8ad4-a0aa253c83a6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:59.857510 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-831d1b85-762b-40d5-8eb3-2bdf5060c6f9 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Request method failure captured: Oct 04 18:49:59.857510 n-d-850501-14 devstack@n-api.service[123002]: request: POST /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545/action HTTP/1.1 Oct 04 18:49:59.857510 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:49:59.857510 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:49:59.857510 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:49:59.857510 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 15 Oct 04 18:49:59.857510 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:49:59.857510 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:49:59.857510 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:49:59.857510 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:49:59.857510 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH9zAVdj2h4kh6QqBpYrS2CJMhbcXf529VUNrZoZOYhS2tkLYBgw6AHy860DK9jQ3xATqZvC9lQuxt-_H5qKsAI41eznf32K6QSGqVcHXegpVHrDueww23ZMVCBM3D_hH0NTzh4447rgHqcrC-OZE48IfZrRJ9KPLPjAHT57T3mcPIc Oct 04 18:49:59.857510 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:49:59.857510 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:49:59.857510 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:49:59.857510 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:49:59.857510 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:49:59.857510 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:49:59.857510 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: b6c6b9deecde44b5953d22b38b5b0ff1 Oct 04 18:49:59.857510 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:49:59.857510 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:49:59.857510 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:49:59.857510 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6c6b9deecde44b5953d22b38b5b0ff1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b6c6b9deecde44b5953d22b38b5b0ff1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b6c6b9deecde44b5953d22b38b5b0ff1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6c6b9deecde44b5953d22b38b5b0ff1"}]}] Oct 04 18:49:59.857510 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:49:59.857510 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: b6c6b9deecde44b5953d22b38b5b0ff1 Oct 04 18:49:59.857510 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:49:59.857510 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServersNegativeTestJSON-626077540-project Oct 04 18:49:59.857510 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:49:59.857510 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:49:59.857510 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 5b4eb70f22ba4872b890a4f160cc1805 Oct 04 18:49:59.857510 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServersNegativeTestJSON-626077540-project Oct 04 18:49:59.857510 n-d-850501-14 devstack@n-api.service[123002]: Oct 04 18:49:59.857510 n-d-850501-14 devstack@n-api.service[123002]: {"suspend": {}} Oct 04 18:49:59.857510 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:49:59.857510 n-d-850501-14 devstack@n-api.service[123002]: exception: Cannot 'suspend' instance 95fb1a13-7441-4f74-ad81-5a9413496545 while it is in vm_state suspended Oct 04 18:49:59.857510 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '95fb1a13-7441-4f74-ad81-5a9413496545', 'body': {'suspend': {}}} Oct 04 18:49:59.857510 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:49:59.857510 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:49:59.857510 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Oct 04 18:49:59.857510 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Oct 04 18:49:59.857510 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 04 18:49:59.857510 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 18:49:59.857510 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 04 18:49:59.857510 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 18:49:59.857510 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 18:49:59.857510 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 18:49:59.857510 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 04 18:49:59.857510 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 18:49:59.857510 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:49:59.857510 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:49:59.857510 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 18:49:59.857510 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 18:49:59.857510 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 95fb1a13-7441-4f74-ad81-5a9413496545 in vm_state suspended. Cannot suspend while the instance is in this state. Oct 04 18:49:59.857510 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:49:59.857510 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:49:59.857510 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:49:59.857510 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:49:59.857510 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:49:59.857510 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:49:59.857510 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:49:59.857510 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:49:59.857510 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:49:59.857510 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:49:59.857510 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Oct 04 18:49:59.857510 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 18:49:59.861808 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 18:49:59.861808 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 18:49:59.861808 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 95fb1a13-7441-4f74-ad81-5a9413496545 while it is in vm_state suspended Oct 04 18:49:59.861808 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:49:59.861808 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:49:59.861808 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:49:59.861808 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:49:59.861808 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:49:59.861808 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:49:59.861808 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:49:59.861808 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:49:59.861808 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 95fb1a13-7441-4f74-ad81-5a9413496545 while it is in vm_state suspended Oct 04 18:49:59.861808 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:49:59.863552 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-831d1b85-762b-40d5-8eb3-2bdf5060c6f9 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Returning 409 to user: Cannot 'suspend' instance 95fb1a13-7441-4f74-ad81-5a9413496545 while it is in vm_state suspended {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:49:59.866493 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-831d1b85-762b-40d5-8eb3-2bdf5060c6f9 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "POST /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545/action" status: 409 len: 148 microversion: 2.1 time: 0.193429 Oct 04 18:49:59.868448 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-027f76f2-5bb7-440f-8ad4-a0aa253c83a6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:59.871428 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2388/4831] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:49:59 2022] POST /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545/action => generated 148 bytes in 200 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:49:59.875685 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-027f76f2-5bb7-440f-8ad4-a0aa253c83a6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:59.875685 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-027f76f2-5bb7-440f-8ad4-a0aa253c83a6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:59.875685 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-027f76f2-5bb7-440f-8ad4-a0aa253c83a6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:59.875685 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-027f76f2-5bb7-440f-8ad4-a0aa253c83a6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:59.876543 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-027f76f2-5bb7-440f-8ad4-a0aa253c83a6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:59.914012 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5fd17959-de5d-4424-98c4-7c2a00429e15 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:49:59.915791 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5fd17959-de5d-4424-98c4-7c2a00429e15 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:59.955850 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5fd17959-de5d-4424-98c4-7c2a00429e15 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:59.956955 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5fd17959-de5d-4424-98c4-7c2a00429e15 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:59.960921 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5fd17959-de5d-4424-98c4-7c2a00429e15 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:59.966617 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5fd17959-de5d-4424-98c4-7c2a00429e15 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:59.967315 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5fd17959-de5d-4424-98c4-7c2a00429e15 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:59.968303 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5fd17959-de5d-4424-98c4-7c2a00429e15 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:00.343271 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5fd17959-de5d-4424-98c4-7c2a00429e15 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "POST /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545/action" status: 202 len: 0 microversion: 2.1 time: 0.460961 Oct 04 18:50:00.344781 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2389/4832] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:49:59 2022] POST /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545/action => generated 0 bytes in 464 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:50:00.366266 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-60d3b299-91d5-4106-b65e-07e272b0b6f2 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:00.367302 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-60d3b299-91d5-4106-b65e-07e272b0b6f2 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:00.387043 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-60d3b299-91d5-4106-b65e-07e272b0b6f2 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:00.390890 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-60d3b299-91d5-4106-b65e-07e272b0b6f2 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:00.392897 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-60d3b299-91d5-4106-b65e-07e272b0b6f2 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:00.394366 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-60d3b299-91d5-4106-b65e-07e272b0b6f2 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:00.397124 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-60d3b299-91d5-4106-b65e-07e272b0b6f2 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:00.406246 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-60d3b299-91d5-4106-b65e-07e272b0b6f2 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:00.448105 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-027f76f2-5bb7-440f-8ad4-a0aa253c83a6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:00.460519 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-027f76f2-5bb7-440f-8ad4-a0aa253c83a6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1685 microversion: 2.1 time: 0.613459 Oct 04 18:50:00.470348 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2444/4833] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:59 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1685 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:50:00.483069 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6e1f7c35-efb4-4f6d-81f3-4f08086c7175 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:00.492724 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6e1f7c35-efb4-4f6d-81f3-4f08086c7175 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: b1b5f03e-fb43-4b1d-a072-02d7a0d724da] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:00.509511 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6e1f7c35-efb4-4f6d-81f3-4f08086c7175 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:00.521172 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6e1f7c35-efb4-4f6d-81f3-4f08086c7175 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:00.521970 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6e1f7c35-efb4-4f6d-81f3-4f08086c7175 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:00.527416 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6e1f7c35-efb4-4f6d-81f3-4f08086c7175 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:00.527416 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6e1f7c35-efb4-4f6d-81f3-4f08086c7175 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:00.527416 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6e1f7c35-efb4-4f6d-81f3-4f08086c7175 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:00.595019 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:50:01.336112 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6e1f7c35-efb4-4f6d-81f3-4f08086c7175 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:01.353770 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6e1f7c35-efb4-4f6d-81f3-4f08086c7175 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/b1b5f03e-fb43-4b1d-a072-02d7a0d724da" status: 200 len: 1513 microversion: 2.1 time: 0.874804 Oct 04 18:50:01.369838 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2445/4834] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:00 2022] GET /compute/v2.1/servers/b1b5f03e-fb43-4b1d-a072-02d7a0d724da => generated 1513 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:50:01.418478 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-60d3b299-91d5-4106-b65e-07e272b0b6f2 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:01.447158 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-60d3b299-91d5-4106-b65e-07e272b0b6f2 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1501 microversion: 2.1 time: 1.092944 Oct 04 18:50:01.459058 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2390/4835] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:00 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1501 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:01.505981 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c7b7f037-4e67-4152-8e04-0c9763e78a70 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:01.507098 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c7b7f037-4e67-4152-8e04-0c9763e78a70 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:01.526044 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c7b7f037-4e67-4152-8e04-0c9763e78a70 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:01.528494 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c7b7f037-4e67-4152-8e04-0c9763e78a70 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:01.529407 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c7b7f037-4e67-4152-8e04-0c9763e78a70 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:01.533562 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c7b7f037-4e67-4152-8e04-0c9763e78a70 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:01.534396 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c7b7f037-4e67-4152-8e04-0c9763e78a70 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:01.535910 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c7b7f037-4e67-4152-8e04-0c9763e78a70 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:02.223839 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c7b7f037-4e67-4152-8e04-0c9763e78a70 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:02.242517 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c7b7f037-4e67-4152-8e04-0c9763e78a70 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1685 microversion: 2.1 time: 0.742569 Oct 04 18:50:02.243680 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2446/4836] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:01 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1685 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:02.295273 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-42f0a83a-f939-4e35-89e3-b92157f78625 req-50bb9702-47c6-484a-9133-1f4821e84393 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1b5f03e-fb43-4b1d-a072-02d7a0d724da", "name": "network-vif-deleted", "tag": "b2c6deaf-9672-446c-aab9-e7af60d31eb8"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:02.335786 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-42f0a83a-f939-4e35-89e3-b92157f78625 req-50bb9702-47c6-484a-9133-1f4821e84393 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:02.336811 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-42f0a83a-f939-4e35-89e3-b92157f78625 req-50bb9702-47c6-484a-9133-1f4821e84393 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:02.337463 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-42f0a83a-f939-4e35-89e3-b92157f78625 req-50bb9702-47c6-484a-9133-1f4821e84393 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:02.391080 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-42f0a83a-f939-4e35-89e3-b92157f78625 req-50bb9702-47c6-484a-9133-1f4821e84393 service nova] Creating event network-vif-deleted:b2c6deaf-9672-446c-aab9-e7af60d31eb8 for instance b1b5f03e-fb43-4b1d-a072-02d7a0d724da on n-h2-850501-14 Oct 04 18:50:02.393457 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c99554bb-4a9d-43e4-ba15-a60169a65377 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:02.394087 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c99554bb-4a9d-43e4-ba15-a60169a65377 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: b1b5f03e-fb43-4b1d-a072-02d7a0d724da] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:02.399966 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-42f0a83a-f939-4e35-89e3-b92157f78625 req-50bb9702-47c6-484a-9133-1f4821e84393 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107969 Oct 04 18:50:02.402632 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2391/4837] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:50:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:50:02.404605 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c99554bb-4a9d-43e4-ba15-a60169a65377 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:02.410535 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c99554bb-4a9d-43e4-ba15-a60169a65377 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:02.411304 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c99554bb-4a9d-43e4-ba15-a60169a65377 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:02.412282 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c99554bb-4a9d-43e4-ba15-a60169a65377 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:02.413093 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c99554bb-4a9d-43e4-ba15-a60169a65377 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:02.413702 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c99554bb-4a9d-43e4-ba15-a60169a65377 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:02.480079 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-375b9128-77da-4e42-9552-b3d699cce7de tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:02.481030 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-375b9128-77da-4e42-9552-b3d699cce7de tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:02.495413 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-375b9128-77da-4e42-9552-b3d699cce7de tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:02.496497 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-375b9128-77da-4e42-9552-b3d699cce7de tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:02.498141 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-375b9128-77da-4e42-9552-b3d699cce7de tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:02.499006 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-375b9128-77da-4e42-9552-b3d699cce7de tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:02.501253 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-375b9128-77da-4e42-9552-b3d699cce7de tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:02.503447 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-375b9128-77da-4e42-9552-b3d699cce7de tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:02.742634 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c99554bb-4a9d-43e4-ba15-a60169a65377 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:02.754223 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c99554bb-4a9d-43e4-ba15-a60169a65377 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/b1b5f03e-fb43-4b1d-a072-02d7a0d724da" status: 200 len: 1471 microversion: 2.1 time: 0.364790 Oct 04 18:50:02.767846 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2447/4838] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:02 2022] GET /compute/v2.1/servers/b1b5f03e-fb43-4b1d-a072-02d7a0d724da => generated 1471 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:50:02.895539 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-375b9128-77da-4e42-9552-b3d699cce7de tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:02.905299 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-375b9128-77da-4e42-9552-b3d699cce7de tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1501 microversion: 2.1 time: 0.429934 Oct 04 18:50:02.908525 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2392/4839] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:02 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1501 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:03.271538 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-34d7e93a-8047-4320-8270-e47a9d6e31d9 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:03.272191 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-34d7e93a-8047-4320-8270-e47a9d6e31d9 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:03.284730 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-34d7e93a-8047-4320-8270-e47a9d6e31d9 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:03.285533 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-34d7e93a-8047-4320-8270-e47a9d6e31d9 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:03.286158 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-34d7e93a-8047-4320-8270-e47a9d6e31d9 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:03.287129 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-34d7e93a-8047-4320-8270-e47a9d6e31d9 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:03.289952 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-34d7e93a-8047-4320-8270-e47a9d6e31d9 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:03.290662 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-34d7e93a-8047-4320-8270-e47a9d6e31d9 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:03.785447 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6756908c-e933-4f53-aaf9-7790f51eac33 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:03.786700 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-6756908c-e933-4f53-aaf9-7790f51eac33 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: b1b5f03e-fb43-4b1d-a072-02d7a0d724da] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:03.794756 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6756908c-e933-4f53-aaf9-7790f51eac33 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:03.795510 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6756908c-e933-4f53-aaf9-7790f51eac33 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:03.796145 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6756908c-e933-4f53-aaf9-7790f51eac33 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:03.797144 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6756908c-e933-4f53-aaf9-7790f51eac33 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:03.797788 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6756908c-e933-4f53-aaf9-7790f51eac33 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:03.798411 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6756908c-e933-4f53-aaf9-7790f51eac33 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:03.861096 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-34d7e93a-8047-4320-8270-e47a9d6e31d9 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:03.870378 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6756908c-e933-4f53-aaf9-7790f51eac33 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:03.871434 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6756908c-e933-4f53-aaf9-7790f51eac33 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:03.872308 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6756908c-e933-4f53-aaf9-7790f51eac33 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:03.872818 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-34d7e93a-8047-4320-8270-e47a9d6e31d9 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1685 microversion: 2.1 time: 0.603041 Oct 04 18:50:03.880538 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-6756908c-e933-4f53-aaf9-7790f51eac33 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lazy-loading 'fault' on Instance uuid b1b5f03e-fb43-4b1d-a072-02d7a0d724da {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:50:03.880703 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2448/4840] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:03 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1685 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:03.935492 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7674e444-4658-4b1d-92be-7bb5afd4fc1a tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:03.936228 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7674e444-4658-4b1d-92be-7bb5afd4fc1a tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:03.953856 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7674e444-4658-4b1d-92be-7bb5afd4fc1a tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:03.954623 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7674e444-4658-4b1d-92be-7bb5afd4fc1a tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:03.955330 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7674e444-4658-4b1d-92be-7bb5afd4fc1a tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:03.956248 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7674e444-4658-4b1d-92be-7bb5afd4fc1a tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:03.956960 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7674e444-4658-4b1d-92be-7bb5afd4fc1a tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:03.957614 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7674e444-4658-4b1d-92be-7bb5afd4fc1a tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:04.073535 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-6756908c-e933-4f53-aaf9-7790f51eac33 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032b060beb9645c4bea314ae44277b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bae9055ba74017a261df156ecdd347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:04.111203 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6756908c-e933-4f53-aaf9-7790f51eac33 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/b1b5f03e-fb43-4b1d-a072-02d7a0d724da" status: 200 len: 1308 microversion: 2.1 time: 0.331178 Oct 04 18:50:04.116562 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2393/4841] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:03 2022] GET /compute/v2.1/servers/b1b5f03e-fb43-4b1d-a072-02d7a0d724da => generated 1308 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:04.448662 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7674e444-4658-4b1d-92be-7bb5afd4fc1a tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:04.457315 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7674e444-4658-4b1d-92be-7bb5afd4fc1a tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1504 microversion: 2.1 time: 0.527648 Oct 04 18:50:04.457908 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2449/4842] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:03 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1504 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:04.488186 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-cbe8dfe8-59cc-4950-b1d3-39b733997b31 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:04.489122 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-cbe8dfe8-59cc-4950-b1d3-39b733997b31 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:04.498144 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cbe8dfe8-59cc-4950-b1d3-39b733997b31 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:04.499305 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cbe8dfe8-59cc-4950-b1d3-39b733997b31 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:04.500643 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cbe8dfe8-59cc-4950-b1d3-39b733997b31 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:04.501862 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cbe8dfe8-59cc-4950-b1d3-39b733997b31 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:04.502539 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cbe8dfe8-59cc-4950-b1d3-39b733997b31 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:04.503214 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cbe8dfe8-59cc-4950-b1d3-39b733997b31 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:04.863489 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-cbe8dfe8-59cc-4950-b1d3-39b733997b31 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:04.878959 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-cbe8dfe8-59cc-4950-b1d3-39b733997b31 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1504 microversion: 2.1 time: 0.396614 Oct 04 18:50:04.880174 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2394/4843] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:04 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1504 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:04.907456 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c10a64f0-2fbb-4271-a619-998b51804adf tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:04.908538 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c10a64f0-2fbb-4271-a619-998b51804adf tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:04.919923 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4512b7ba-2c67-4a31-b0c6-57ec26bfe9d5 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:04.925230 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c10a64f0-2fbb-4271-a619-998b51804adf tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:04.925230 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c10a64f0-2fbb-4271-a619-998b51804adf tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:04.925230 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c10a64f0-2fbb-4271-a619-998b51804adf tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:04.925230 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c10a64f0-2fbb-4271-a619-998b51804adf tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:04.925230 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c10a64f0-2fbb-4271-a619-998b51804adf tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:04.925230 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c10a64f0-2fbb-4271-a619-998b51804adf tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:04.926615 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4512b7ba-2c67-4a31-b0c6-57ec26bfe9d5 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 0ff67959-cb33-458c-b46f-9ac82c1da65e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:04.939361 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-4512b7ba-2c67-4a31-b0c6-57ec26bfe9d5 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] HTTP exception thrown: Instance 0ff67959-cb33-458c-b46f-9ac82c1da65e could not be found. Oct 04 18:50:04.942960 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4512b7ba-2c67-4a31-b0c6-57ec26bfe9d5 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Request method failure captured: Oct 04 18:50:04.942960 n-d-850501-14 devstack@n-api.service[123002]: request: POST /compute/v2.1/servers/0ff67959-cb33-458c-b46f-9ac82c1da65e/action HTTP/1.1 Oct 04 18:50:04.942960 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:50:04.942960 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:50:04.942960 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:50:04.942960 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 15 Oct 04 18:50:04.942960 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:50:04.942960 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:50:04.942960 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:50:04.942960 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:50:04.942960 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH9zAVdj2h4kh6QqBpYrS2CJMhbcXf529VUNrZoZOYhS2tkLYBgw6AHy860DK9jQ3xATqZvC9lQuxt-_H5qKsAI41eznf32K6QSGqVcHXegpVHrDueww23ZMVCBM3D_hH0NTzh4447rgHqcrC-OZE48IfZrRJ9KPLPjAHT57T3mcPIc Oct 04 18:50:04.942960 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:50:04.942960 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:50:04.942960 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:50:04.942960 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:50:04.942960 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:50:04.942960 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:50:04.942960 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: b6c6b9deecde44b5953d22b38b5b0ff1 Oct 04 18:50:04.942960 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:50:04.942960 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:50:04.942960 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:50:04.942960 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6c6b9deecde44b5953d22b38b5b0ff1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b6c6b9deecde44b5953d22b38b5b0ff1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b6c6b9deecde44b5953d22b38b5b0ff1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6c6b9deecde44b5953d22b38b5b0ff1"}]}] Oct 04 18:50:04.942960 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:50:04.942960 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: b6c6b9deecde44b5953d22b38b5b0ff1 Oct 04 18:50:04.942960 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:50:04.942960 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServersNegativeTestJSON-626077540-project Oct 04 18:50:04.942960 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:50:04.942960 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:50:04.942960 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 5b4eb70f22ba4872b890a4f160cc1805 Oct 04 18:50:04.942960 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServersNegativeTestJSON-626077540-project Oct 04 18:50:04.942960 n-d-850501-14 devstack@n-api.service[123002]: Oct 04 18:50:04.942960 n-d-850501-14 devstack@n-api.service[123002]: {"unpause": {}} Oct 04 18:50:04.942960 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:50:04.942960 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 0ff67959-cb33-458c-b46f-9ac82c1da65e could not be found. Oct 04 18:50:04.942960 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '0ff67959-cb33-458c-b46f-9ac82c1da65e', 'body': {'unpause': {}}} Oct 04 18:50:04.942960 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:50:04.942960 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:50:04.942960 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:50:04.942960 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:50:04.942960 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:50:04.942960 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:50:04.942960 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:50:04.942960 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:50:04.942960 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ff67959-cb33-458c-b46f-9ac82c1da65e could not be found. Oct 04 18:50:04.942960 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:50:04.942960 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:50:04.942960 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:50:04.942960 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:50:04.942960 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:50:04.942960 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:50:04.942960 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:50:04.942960 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:50:04.942960 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:50:04.942960 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:50:04.942960 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Oct 04 18:50:04.942960 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 04 18:50:04.942960 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:50:04.942960 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:50:04.942960 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ff67959-cb33-458c-b46f-9ac82c1da65e could not be found. Oct 04 18:50:04.942960 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:50:04.942960 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:50:04.942960 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:50:04.942960 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:50:04.942960 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:50:04.942960 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:50:04.953174 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:50:04.953174 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:50:04.953174 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ff67959-cb33-458c-b46f-9ac82c1da65e could not be found. Oct 04 18:50:04.953174 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:50:04.953876 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4512b7ba-2c67-4a31-b0c6-57ec26bfe9d5 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Returning 404 to user: Instance 0ff67959-cb33-458c-b46f-9ac82c1da65e could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:50:04.957709 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4512b7ba-2c67-4a31-b0c6-57ec26bfe9d5 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "POST /compute/v2.1/servers/0ff67959-cb33-458c-b46f-9ac82c1da65e/action" status: 404 len: 111 microversion: 2.1 time: 0.045049 Oct 04 18:50:04.958958 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2395/4844] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:50:04 2022] POST /compute/v2.1/servers/0ff67959-cb33-458c-b46f-9ac82c1da65e/action => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:50:04.977661 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3bf7eb2f-0b34-4ef4-bae0-920f5329e771 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:04.978736 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3bf7eb2f-0b34-4ef4-bae0-920f5329e771 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:04.999032 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3bf7eb2f-0b34-4ef4-bae0-920f5329e771 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:05.004500 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3bf7eb2f-0b34-4ef4-bae0-920f5329e771 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:05.007473 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3bf7eb2f-0b34-4ef4-bae0-920f5329e771 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:05.008587 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3bf7eb2f-0b34-4ef4-bae0-920f5329e771 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:05.010803 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3bf7eb2f-0b34-4ef4-bae0-920f5329e771 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:05.013621 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3bf7eb2f-0b34-4ef4-bae0-920f5329e771 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:05.347527 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c10a64f0-2fbb-4271-a619-998b51804adf tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:05.351668 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3bf7eb2f-0b34-4ef4-bae0-920f5329e771 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:05.362385 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3bf7eb2f-0b34-4ef4-bae0-920f5329e771 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1504 microversion: 2.1 time: 0.387889 Oct 04 18:50:05.362672 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c10a64f0-2fbb-4271-a619-998b51804adf tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1685 microversion: 2.1 time: 0.464670 Oct 04 18:50:05.364111 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2396/4845] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:04 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1504 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:05.369944 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d615e4e0-7bd2-4b99-8f35-6a38b6717b68 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:05.370953 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d615e4e0-7bd2-4b99-8f35-6a38b6717b68 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: b1b5f03e-fb43-4b1d-a072-02d7a0d724da] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:05.378497 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2450/4846] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:04 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1685 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:05.379513 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d615e4e0-7bd2-4b99-8f35-6a38b6717b68 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:05.380399 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d615e4e0-7bd2-4b99-8f35-6a38b6717b68 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:05.381123 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d615e4e0-7bd2-4b99-8f35-6a38b6717b68 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:05.382133 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d615e4e0-7bd2-4b99-8f35-6a38b6717b68 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:05.382845 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d615e4e0-7bd2-4b99-8f35-6a38b6717b68 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:05.383545 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d615e4e0-7bd2-4b99-8f35-6a38b6717b68 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:05.415620 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-d615e4e0-7bd2-4b99-8f35-6a38b6717b68 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] HTTP exception thrown: Instance b1b5f03e-fb43-4b1d-a072-02d7a0d724da could not be found. Oct 04 18:50:05.417167 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3a9dea1c-729f-417a-8584-78d93cd339d8 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:05.418131 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3a9dea1c-729f-417a-8584-78d93cd339d8 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:05.421345 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d615e4e0-7bd2-4b99-8f35-6a38b6717b68 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Request method failure captured: Oct 04 18:50:05.421345 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/b1b5f03e-fb43-4b1d-a072-02d7a0d724da HTTP/1.1 Oct 04 18:50:05.421345 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:50:05.421345 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:50:05.421345 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:50:05.421345 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:50:05.421345 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:50:05.421345 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:50:05.421345 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:50:05.421345 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:50:05.421345 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH-nBekwC5fAwltGL315VvTLHsfUswjHgLgmQTkHvBbFpg1aXh2j0pRLB5L9z3RlCKCwHUtdM8eVy6UuTCEajW3osTXRJTcTfbp7TKlKcVMfqXNDSUsvP2hviKqQuc90qacTjYr-g-52an7qD4eigw2FpzeuCFGisWFHM-nyPisZ3Pc Oct 04 18:50:05.421345 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:50:05.421345 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:50:05.421345 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:50:05.421345 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:50:05.421345 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:50:05.421345 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:50:05.421345 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: e4bae9055ba74017a261df156ecdd347 Oct 04 18:50:05.421345 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1416484868 Oct 04 18:50:05.421345 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:50:05.421345 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:50:05.421345 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e4bae9055ba74017a261df156ecdd347"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e4bae9055ba74017a261df156ecdd347", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e4bae9055ba74017a261df156ecdd347"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e4bae9055ba74017a261df156ecdd347"}]}] Oct 04 18:50:05.421345 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServerDiskConfigTestJSON-1416484868 Oct 04 18:50:05.421345 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: e4bae9055ba74017a261df156ecdd347 Oct 04 18:50:05.421345 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1416484868 Oct 04 18:50:05.421345 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServerDiskConfigTestJSON-1416484868-project Oct 04 18:50:05.421345 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:50:05.421345 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:50:05.421345 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 032b060beb9645c4bea314ae44277b35 Oct 04 18:50:05.421345 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServerDiskConfigTestJSON-1416484868-project Oct 04 18:50:05.421345 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:50:05.421345 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance b1b5f03e-fb43-4b1d-a072-02d7a0d724da could not be found. Oct 04 18:50:05.421345 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'b1b5f03e-fb43-4b1d-a072-02d7a0d724da'} Oct 04 18:50:05.421345 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:50:05.421345 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:50:05.421345 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:50:05.421345 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:50:05.421345 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:50:05.421345 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:50:05.421345 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:50:05.421345 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:50:05.421345 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:50:05.421345 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:50:05.421345 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1b5f03e-fb43-4b1d-a072-02d7a0d724da could not be found. Oct 04 18:50:05.421345 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:50:05.421345 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:50:05.421345 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:50:05.421345 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:50:05.421345 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:50:05.421345 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:50:05.421345 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:50:05.421345 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:50:05.421345 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:50:05.421345 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:50:05.421345 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:50:05.421345 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:50:05.421345 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:50:05.421345 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:50:05.421345 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:50:05.421345 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:50:05.421345 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1b5f03e-fb43-4b1d-a072-02d7a0d724da could not be found. Oct 04 18:50:05.421345 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:50:05.421345 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:50:05.421345 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:50:05.426025 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:50:05.426025 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:50:05.426025 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:50:05.426025 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:50:05.426025 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:50:05.426025 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1b5f03e-fb43-4b1d-a072-02d7a0d724da could not be found. Oct 04 18:50:05.426025 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:50:05.426025 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d615e4e0-7bd2-4b99-8f35-6a38b6717b68 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Returning 404 to user: Instance b1b5f03e-fb43-4b1d-a072-02d7a0d724da could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:50:05.426025 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d615e4e0-7bd2-4b99-8f35-6a38b6717b68 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/b1b5f03e-fb43-4b1d-a072-02d7a0d724da" status: 404 len: 111 microversion: 2.1 time: 0.060224 Oct 04 18:50:05.429124 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2397/4847] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:05 2022] GET /compute/v2.1/servers/b1b5f03e-fb43-4b1d-a072-02d7a0d724da => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:50:05.439036 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3a9dea1c-729f-417a-8584-78d93cd339d8 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:05.439965 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3a9dea1c-729f-417a-8584-78d93cd339d8 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:05.440652 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3a9dea1c-729f-417a-8584-78d93cd339d8 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:05.443410 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3a9dea1c-729f-417a-8584-78d93cd339d8 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:05.445665 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3a9dea1c-729f-417a-8584-78d93cd339d8 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:05.446382 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3a9dea1c-729f-417a-8584-78d93cd339d8 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:05.461384 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c92d89b8-67b6-415b-86cb-87d7cc9227fd tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:05.462013 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c92d89b8-67b6-415b-86cb-87d7cc9227fd tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: 406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:05.497756 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c92d89b8-67b6-415b-86cb-87d7cc9227fd tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:05.502720 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c92d89b8-67b6-415b-86cb-87d7cc9227fd tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:05.503776 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c92d89b8-67b6-415b-86cb-87d7cc9227fd tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:05.508629 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c92d89b8-67b6-415b-86cb-87d7cc9227fd tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:05.510234 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c92d89b8-67b6-415b-86cb-87d7cc9227fd tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:05.514820 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c92d89b8-67b6-415b-86cb-87d7cc9227fd tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:05.551363 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-c92d89b8-67b6-415b-86cb-87d7cc9227fd tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] HTTP exception thrown: Instance 406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a could not be found. Oct 04 18:50:05.554269 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c92d89b8-67b6-415b-86cb-87d7cc9227fd tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Request method failure captured: Oct 04 18:50:05.554269 n-d-850501-14 devstack@n-api.service[123002]: request: DELETE /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a HTTP/1.1 Oct 04 18:50:05.554269 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:50:05.554269 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:50:05.554269 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:50:05.554269 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:50:05.554269 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:50:05.554269 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:50:05.554269 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:50:05.554269 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:50:05.554269 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH-nBekwC5fAwltGL315VvTLHsfUswjHgLgmQTkHvBbFpg1aXh2j0pRLB5L9z3RlCKCwHUtdM8eVy6UuTCEajW3osTXRJTcTfbp7TKlKcVMfqXNDSUsvP2hviKqQuc90qacTjYr-g-52an7qD4eigw2FpzeuCFGisWFHM-nyPisZ3Pc Oct 04 18:50:05.554269 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:50:05.554269 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:50:05.554269 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:50:05.554269 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:50:05.554269 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:50:05.554269 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:50:05.554269 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: e4bae9055ba74017a261df156ecdd347 Oct 04 18:50:05.554269 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1416484868 Oct 04 18:50:05.554269 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:50:05.554269 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:50:05.554269 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e4bae9055ba74017a261df156ecdd347"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e4bae9055ba74017a261df156ecdd347", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e4bae9055ba74017a261df156ecdd347"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e4bae9055ba74017a261df156ecdd347"}]}] Oct 04 18:50:05.554269 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServerDiskConfigTestJSON-1416484868 Oct 04 18:50:05.554269 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: e4bae9055ba74017a261df156ecdd347 Oct 04 18:50:05.554269 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1416484868 Oct 04 18:50:05.554269 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServerDiskConfigTestJSON-1416484868-project Oct 04 18:50:05.554269 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:50:05.554269 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:50:05.554269 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 032b060beb9645c4bea314ae44277b35 Oct 04 18:50:05.554269 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServerDiskConfigTestJSON-1416484868-project Oct 04 18:50:05.554269 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:50:05.554269 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a could not be found. Oct 04 18:50:05.554269 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a'} Oct 04 18:50:05.554269 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:50:05.554269 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:50:05.554269 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:50:05.554269 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:50:05.554269 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:50:05.554269 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:50:05.554269 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:50:05.554269 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:50:05.554269 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:50:05.554269 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:50:05.554269 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a could not be found. Oct 04 18:50:05.554269 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:50:05.554269 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:50:05.554269 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:50:05.554269 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:50:05.554269 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:50:05.554269 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:50:05.554269 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:50:05.554269 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:50:05.554269 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:50:05.554269 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:50:05.554269 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:50:05.554269 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:50:05.554269 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:50:05.554269 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:50:05.554269 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:50:05.554269 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:50:05.554269 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:50:05.554269 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:50:05.590546 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a could not be found. Oct 04 18:50:05.590546 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:50:05.590546 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:50:05.590546 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:50:05.590546 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:50:05.590546 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:50:05.590546 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:50:05.590546 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:50:05.590546 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:50:05.590546 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a could not be found. Oct 04 18:50:05.590546 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:50:05.590546 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c92d89b8-67b6-415b-86cb-87d7cc9227fd tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Returning 404 to user: Instance 406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:50:05.590546 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c92d89b8-67b6-415b-86cb-87d7cc9227fd tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "DELETE /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a" status: 404 len: 111 microversion: 2.1 time: 0.123180 Oct 04 18:50:05.590546 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2398/4848] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:50:05 2022] DELETE /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:50:05.590546 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-dfca5c5b-a8ed-4206-b190-a6ed33f66f62 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:05.590546 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-dfca5c5b-a8ed-4206-b190-a6ed33f66f62 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: 406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:05.597375 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dfca5c5b-a8ed-4206-b190-a6ed33f66f62 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:05.597589 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dfca5c5b-a8ed-4206-b190-a6ed33f66f62 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:05.599781 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dfca5c5b-a8ed-4206-b190-a6ed33f66f62 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:05.600712 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dfca5c5b-a8ed-4206-b190-a6ed33f66f62 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:05.601184 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dfca5c5b-a8ed-4206-b190-a6ed33f66f62 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:05.601625 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dfca5c5b-a8ed-4206-b190-a6ed33f66f62 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:05.647506 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-dfca5c5b-a8ed-4206-b190-a6ed33f66f62 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] HTTP exception thrown: Instance 406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a could not be found. Oct 04 18:50:05.649157 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-dfca5c5b-a8ed-4206-b190-a6ed33f66f62 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Request method failure captured: Oct 04 18:50:05.649157 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a HTTP/1.1 Oct 04 18:50:05.649157 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:50:05.649157 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:50:05.649157 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:50:05.649157 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:50:05.649157 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:50:05.649157 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:50:05.649157 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:50:05.649157 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:50:05.649157 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH-nBekwC5fAwltGL315VvTLHsfUswjHgLgmQTkHvBbFpg1aXh2j0pRLB5L9z3RlCKCwHUtdM8eVy6UuTCEajW3osTXRJTcTfbp7TKlKcVMfqXNDSUsvP2hviKqQuc90qacTjYr-g-52an7qD4eigw2FpzeuCFGisWFHM-nyPisZ3Pc Oct 04 18:50:05.649157 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:50:05.649157 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:50:05.649157 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:50:05.649157 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:50:05.649157 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:50:05.649157 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:50:05.649157 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: e4bae9055ba74017a261df156ecdd347 Oct 04 18:50:05.649157 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1416484868 Oct 04 18:50:05.649157 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:50:05.649157 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:50:05.649157 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e4bae9055ba74017a261df156ecdd347"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e4bae9055ba74017a261df156ecdd347", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e4bae9055ba74017a261df156ecdd347"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e4bae9055ba74017a261df156ecdd347"}]}] Oct 04 18:50:05.649157 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServerDiskConfigTestJSON-1416484868 Oct 04 18:50:05.649157 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: e4bae9055ba74017a261df156ecdd347 Oct 04 18:50:05.649157 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1416484868 Oct 04 18:50:05.649157 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServerDiskConfigTestJSON-1416484868-project Oct 04 18:50:05.649157 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:50:05.649157 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:50:05.649157 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 032b060beb9645c4bea314ae44277b35 Oct 04 18:50:05.649157 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServerDiskConfigTestJSON-1416484868-project Oct 04 18:50:05.649157 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:50:05.649157 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a could not be found. Oct 04 18:50:05.649157 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a'} Oct 04 18:50:05.649157 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:50:05.649157 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:50:05.649157 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:50:05.649157 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:50:05.649157 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:50:05.649157 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:50:05.649157 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:50:05.649157 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:50:05.649157 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:50:05.649157 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:50:05.649157 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a could not be found. Oct 04 18:50:05.649157 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:50:05.649157 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:50:05.649157 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:50:05.649157 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:50:05.649157 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:50:05.649157 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:50:05.649157 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:50:05.649157 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:50:05.649157 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:50:05.649157 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:50:05.649157 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:50:05.649157 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:50:05.649157 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:50:05.649157 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:50:05.649157 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:50:05.649157 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:50:05.649157 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a could not be found. Oct 04 18:50:05.649157 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:50:05.649157 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:50:05.649157 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:50:05.653314 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:50:05.653314 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:50:05.653314 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:50:05.653314 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:50:05.653314 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:50:05.653314 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a could not be found. Oct 04 18:50:05.653314 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:50:05.653314 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-dfca5c5b-a8ed-4206-b190-a6ed33f66f62 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Returning 404 to user: Instance 406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:50:05.653314 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-dfca5c5b-a8ed-4206-b190-a6ed33f66f62 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a" status: 404 len: 111 microversion: 2.1 time: 0.085808 Oct 04 18:50:05.654337 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2399/4849] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:05 2022] GET /compute/v2.1/servers/406d0ec6-a2c3-48c5-a3eb-ee6ee8edd88a => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:50:05.672237 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f8751602-3468-4544-b18a-d6c3a6e8cbf7 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:05.673465 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f8751602-3468-4544-b18a-d6c3a6e8cbf7 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: 60694294-78ff-49f7-9d07-bb5915eae69e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:05.691547 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f8751602-3468-4544-b18a-d6c3a6e8cbf7 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:05.692317 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f8751602-3468-4544-b18a-d6c3a6e8cbf7 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:05.693719 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f8751602-3468-4544-b18a-d6c3a6e8cbf7 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:05.694689 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f8751602-3468-4544-b18a-d6c3a6e8cbf7 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:05.696348 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f8751602-3468-4544-b18a-d6c3a6e8cbf7 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:05.696919 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f8751602-3468-4544-b18a-d6c3a6e8cbf7 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:05.723393 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-f8751602-3468-4544-b18a-d6c3a6e8cbf7 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] HTTP exception thrown: Instance 60694294-78ff-49f7-9d07-bb5915eae69e could not be found. Oct 04 18:50:05.725937 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f8751602-3468-4544-b18a-d6c3a6e8cbf7 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Request method failure captured: Oct 04 18:50:05.725937 n-d-850501-14 devstack@n-api.service[123002]: request: DELETE /compute/v2.1/servers/60694294-78ff-49f7-9d07-bb5915eae69e HTTP/1.1 Oct 04 18:50:05.725937 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:50:05.725937 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:50:05.725937 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:50:05.725937 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:50:05.725937 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:50:05.725937 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:50:05.725937 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:50:05.725937 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:50:05.725937 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH-nBekwC5fAwltGL315VvTLHsfUswjHgLgmQTkHvBbFpg1aXh2j0pRLB5L9z3RlCKCwHUtdM8eVy6UuTCEajW3osTXRJTcTfbp7TKlKcVMfqXNDSUsvP2hviKqQuc90qacTjYr-g-52an7qD4eigw2FpzeuCFGisWFHM-nyPisZ3Pc Oct 04 18:50:05.725937 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:50:05.725937 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:50:05.725937 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:50:05.725937 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:50:05.725937 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:50:05.725937 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:50:05.725937 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: e4bae9055ba74017a261df156ecdd347 Oct 04 18:50:05.725937 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1416484868 Oct 04 18:50:05.725937 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:50:05.725937 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:50:05.725937 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e4bae9055ba74017a261df156ecdd347"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e4bae9055ba74017a261df156ecdd347", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e4bae9055ba74017a261df156ecdd347"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e4bae9055ba74017a261df156ecdd347"}]}] Oct 04 18:50:05.725937 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServerDiskConfigTestJSON-1416484868 Oct 04 18:50:05.725937 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: e4bae9055ba74017a261df156ecdd347 Oct 04 18:50:05.725937 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1416484868 Oct 04 18:50:05.725937 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServerDiskConfigTestJSON-1416484868-project Oct 04 18:50:05.725937 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:50:05.725937 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:50:05.725937 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 032b060beb9645c4bea314ae44277b35 Oct 04 18:50:05.725937 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServerDiskConfigTestJSON-1416484868-project Oct 04 18:50:05.725937 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:50:05.725937 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 60694294-78ff-49f7-9d07-bb5915eae69e could not be found. Oct 04 18:50:05.725937 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '60694294-78ff-49f7-9d07-bb5915eae69e'} Oct 04 18:50:05.725937 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:50:05.725937 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:50:05.725937 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:50:05.725937 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:50:05.725937 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:50:05.725937 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:50:05.725937 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:50:05.725937 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:50:05.725937 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:50:05.725937 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:50:05.725937 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60694294-78ff-49f7-9d07-bb5915eae69e could not be found. Oct 04 18:50:05.725937 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:50:05.725937 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:50:05.725937 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:50:05.725937 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:50:05.725937 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:50:05.725937 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:50:05.725937 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:50:05.725937 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:50:05.725937 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:50:05.725937 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:50:05.725937 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:50:05.725937 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:50:05.725937 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:50:05.725937 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:50:05.725937 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:50:05.725937 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:50:05.725937 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:50:05.725937 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:50:05.731420 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60694294-78ff-49f7-9d07-bb5915eae69e could not be found. Oct 04 18:50:05.731420 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:50:05.731420 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:50:05.731420 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:50:05.731420 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:50:05.731420 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:50:05.731420 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:50:05.731420 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:50:05.731420 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:50:05.731420 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60694294-78ff-49f7-9d07-bb5915eae69e could not be found. Oct 04 18:50:05.731420 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:50:05.735711 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f8751602-3468-4544-b18a-d6c3a6e8cbf7 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Returning 404 to user: Instance 60694294-78ff-49f7-9d07-bb5915eae69e could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:50:05.735711 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f8751602-3468-4544-b18a-d6c3a6e8cbf7 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "DELETE /compute/v2.1/servers/60694294-78ff-49f7-9d07-bb5915eae69e" status: 404 len: 111 microversion: 2.1 time: 0.079650 Oct 04 18:50:05.735711 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2400/4850] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:50:05 2022] DELETE /compute/v2.1/servers/60694294-78ff-49f7-9d07-bb5915eae69e => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:50:05.743837 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a4cf39b3-b5f4-4d28-b0cc-dabe9682f354 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:05.745009 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a4cf39b3-b5f4-4d28-b0cc-dabe9682f354 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] [instance: 60694294-78ff-49f7-9d07-bb5915eae69e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:05.752864 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a4cf39b3-b5f4-4d28-b0cc-dabe9682f354 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:05.753457 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a4cf39b3-b5f4-4d28-b0cc-dabe9682f354 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:05.754650 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a4cf39b3-b5f4-4d28-b0cc-dabe9682f354 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:05.755468 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a4cf39b3-b5f4-4d28-b0cc-dabe9682f354 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:05.756429 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a4cf39b3-b5f4-4d28-b0cc-dabe9682f354 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:05.756935 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a4cf39b3-b5f4-4d28-b0cc-dabe9682f354 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:05.772419 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-a4cf39b3-b5f4-4d28-b0cc-dabe9682f354 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] HTTP exception thrown: Instance 60694294-78ff-49f7-9d07-bb5915eae69e could not be found. Oct 04 18:50:05.774299 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a4cf39b3-b5f4-4d28-b0cc-dabe9682f354 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Request method failure captured: Oct 04 18:50:05.774299 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/60694294-78ff-49f7-9d07-bb5915eae69e HTTP/1.1 Oct 04 18:50:05.774299 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:50:05.774299 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:50:05.774299 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:50:05.774299 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:50:05.774299 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:50:05.774299 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:50:05.774299 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:50:05.774299 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:50:05.774299 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH-nBekwC5fAwltGL315VvTLHsfUswjHgLgmQTkHvBbFpg1aXh2j0pRLB5L9z3RlCKCwHUtdM8eVy6UuTCEajW3osTXRJTcTfbp7TKlKcVMfqXNDSUsvP2hviKqQuc90qacTjYr-g-52an7qD4eigw2FpzeuCFGisWFHM-nyPisZ3Pc Oct 04 18:50:05.774299 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:50:05.774299 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:50:05.774299 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:50:05.774299 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:50:05.774299 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:50:05.774299 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:50:05.774299 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: e4bae9055ba74017a261df156ecdd347 Oct 04 18:50:05.774299 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1416484868 Oct 04 18:50:05.774299 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:50:05.774299 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:50:05.774299 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e4bae9055ba74017a261df156ecdd347"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e4bae9055ba74017a261df156ecdd347", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e4bae9055ba74017a261df156ecdd347"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e4bae9055ba74017a261df156ecdd347"}]}] Oct 04 18:50:05.774299 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServerDiskConfigTestJSON-1416484868 Oct 04 18:50:05.774299 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: e4bae9055ba74017a261df156ecdd347 Oct 04 18:50:05.774299 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1416484868 Oct 04 18:50:05.774299 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServerDiskConfigTestJSON-1416484868-project Oct 04 18:50:05.774299 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:50:05.774299 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:50:05.774299 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 032b060beb9645c4bea314ae44277b35 Oct 04 18:50:05.774299 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServerDiskConfigTestJSON-1416484868-project Oct 04 18:50:05.774299 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:50:05.774299 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 60694294-78ff-49f7-9d07-bb5915eae69e could not be found. Oct 04 18:50:05.774299 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '60694294-78ff-49f7-9d07-bb5915eae69e'} Oct 04 18:50:05.774299 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:50:05.774299 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:50:05.774299 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:50:05.774299 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:50:05.774299 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:50:05.774299 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:50:05.774299 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:50:05.774299 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:50:05.774299 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:50:05.774299 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:50:05.774299 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60694294-78ff-49f7-9d07-bb5915eae69e could not be found. Oct 04 18:50:05.774299 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:50:05.774299 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:50:05.774299 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:50:05.774299 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:50:05.774299 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:50:05.774299 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:50:05.774299 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:50:05.774299 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:50:05.774299 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:50:05.774299 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:50:05.774299 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:50:05.774299 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:50:05.774299 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:50:05.774299 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:50:05.774299 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:50:05.774299 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:50:05.774299 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60694294-78ff-49f7-9d07-bb5915eae69e could not be found. Oct 04 18:50:05.774299 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:50:05.774299 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:50:05.774299 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:50:05.785446 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:50:05.785446 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:50:05.785446 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:50:05.785446 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:50:05.785446 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:50:05.785446 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60694294-78ff-49f7-9d07-bb5915eae69e could not be found. Oct 04 18:50:05.785446 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:50:05.785446 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a4cf39b3-b5f4-4d28-b0cc-dabe9682f354 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] Returning 404 to user: Instance 60694294-78ff-49f7-9d07-bb5915eae69e could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:50:05.785446 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a4cf39b3-b5f4-4d28-b0cc-dabe9682f354 tempest-ServerDiskConfigTestJSON-1416484868 tempest-ServerDiskConfigTestJSON-1416484868-project] 10.222.0.20 "GET /compute/v2.1/servers/60694294-78ff-49f7-9d07-bb5915eae69e" status: 404 len: 111 microversion: 2.1 time: 0.037191 Oct 04 18:50:05.785446 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2401/4851] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:05 2022] GET /compute/v2.1/servers/60694294-78ff-49f7-9d07-bb5915eae69e => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:50:05.845048 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3a9dea1c-729f-417a-8584-78d93cd339d8 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:05.855378 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3a9dea1c-729f-417a-8584-78d93cd339d8 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1504 microversion: 2.1 time: 0.443252 Oct 04 18:50:05.855974 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2451/4852] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:05 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1504 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:50:05.879350 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-66968c07-5013-4875-a17e-943b44f0903d tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:05.879890 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-66968c07-5013-4875-a17e-943b44f0903d tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:05.886518 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-66968c07-5013-4875-a17e-943b44f0903d tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:05.887005 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-66968c07-5013-4875-a17e-943b44f0903d tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:05.887446 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-66968c07-5013-4875-a17e-943b44f0903d tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:05.888179 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-66968c07-5013-4875-a17e-943b44f0903d tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:05.888640 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-66968c07-5013-4875-a17e-943b44f0903d tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:05.889097 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-66968c07-5013-4875-a17e-943b44f0903d tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:05.916467 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-66968c07-5013-4875-a17e-943b44f0903d tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] HTTP exception thrown: Cannot 'unpause' instance 95fb1a13-7441-4f74-ad81-5a9413496545 while it is in vm_state active Oct 04 18:50:05.918494 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-66968c07-5013-4875-a17e-943b44f0903d tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Request method failure captured: Oct 04 18:50:05.918494 n-d-850501-14 devstack@n-api.service[123002]: request: POST /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545/action HTTP/1.1 Oct 04 18:50:05.918494 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:50:05.918494 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:50:05.918494 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:50:05.918494 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 15 Oct 04 18:50:05.918494 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:50:05.918494 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:50:05.918494 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:50:05.918494 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:50:05.918494 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH9zAVdj2h4kh6QqBpYrS2CJMhbcXf529VUNrZoZOYhS2tkLYBgw6AHy860DK9jQ3xATqZvC9lQuxt-_H5qKsAI41eznf32K6QSGqVcHXegpVHrDueww23ZMVCBM3D_hH0NTzh4447rgHqcrC-OZE48IfZrRJ9KPLPjAHT57T3mcPIc Oct 04 18:50:05.918494 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:50:05.918494 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:50:05.918494 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:50:05.918494 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:50:05.918494 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:50:05.918494 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:50:05.918494 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: b6c6b9deecde44b5953d22b38b5b0ff1 Oct 04 18:50:05.918494 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:50:05.918494 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:50:05.918494 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:50:05.918494 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6c6b9deecde44b5953d22b38b5b0ff1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b6c6b9deecde44b5953d22b38b5b0ff1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b6c6b9deecde44b5953d22b38b5b0ff1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6c6b9deecde44b5953d22b38b5b0ff1"}]}] Oct 04 18:50:05.918494 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:50:05.918494 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: b6c6b9deecde44b5953d22b38b5b0ff1 Oct 04 18:50:05.918494 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:50:05.918494 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServersNegativeTestJSON-626077540-project Oct 04 18:50:05.918494 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:50:05.918494 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:50:05.918494 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 5b4eb70f22ba4872b890a4f160cc1805 Oct 04 18:50:05.918494 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServersNegativeTestJSON-626077540-project Oct 04 18:50:05.918494 n-d-850501-14 devstack@n-api.service[123002]: Oct 04 18:50:05.918494 n-d-850501-14 devstack@n-api.service[123002]: {"unpause": {}} Oct 04 18:50:05.918494 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:50:05.918494 n-d-850501-14 devstack@n-api.service[123002]: exception: Cannot 'unpause' instance 95fb1a13-7441-4f74-ad81-5a9413496545 while it is in vm_state active Oct 04 18:50:05.918494 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '95fb1a13-7441-4f74-ad81-5a9413496545', 'body': {'unpause': {}}} Oct 04 18:50:05.918494 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:50:05.918494 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:50:05.918494 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Oct 04 18:50:05.918494 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Oct 04 18:50:05.918494 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:50:05.918494 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:50:05.918494 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 18:50:05.918494 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 18:50:05.918494 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 95fb1a13-7441-4f74-ad81-5a9413496545 in vm_state active. Cannot unpause while the instance is in this state. Oct 04 18:50:05.918494 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:50:05.918494 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:50:05.918494 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:50:05.918494 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:50:05.918494 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:50:05.918494 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:50:05.918494 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:50:05.918494 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:50:05.918494 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:50:05.918494 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:50:05.918494 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Oct 04 18:50:05.918494 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 18:50:05.918494 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 18:50:05.918494 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 18:50:05.918494 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 95fb1a13-7441-4f74-ad81-5a9413496545 while it is in vm_state active Oct 04 18:50:05.918494 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:50:05.918494 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:50:05.918494 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:50:05.918494 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:50:05.918494 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:50:05.927966 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:50:05.927966 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:50:05.927966 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:50:05.927966 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 95fb1a13-7441-4f74-ad81-5a9413496545 while it is in vm_state active Oct 04 18:50:05.927966 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:50:05.927966 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-66968c07-5013-4875-a17e-943b44f0903d tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Returning 409 to user: Cannot 'unpause' instance 95fb1a13-7441-4f74-ad81-5a9413496545 while it is in vm_state active {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:50:05.927966 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-66968c07-5013-4875-a17e-943b44f0903d tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "POST /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545/action" status: 409 len: 145 microversion: 2.1 time: 0.044852 Oct 04 18:50:05.927966 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2402/4853] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:50:05 2022] POST /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545/action => generated 145 bytes in 46 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:50:05.940262 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5260497f-760f-43bb-8d03-6f23d5544f5d tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:05.941155 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5260497f-760f-43bb-8d03-6f23d5544f5d tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:05.947777 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5260497f-760f-43bb-8d03-6f23d5544f5d tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:05.948309 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5260497f-760f-43bb-8d03-6f23d5544f5d tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:05.948757 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5260497f-760f-43bb-8d03-6f23d5544f5d tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:05.949463 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5260497f-760f-43bb-8d03-6f23d5544f5d tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:05.949921 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5260497f-760f-43bb-8d03-6f23d5544f5d tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:05.950795 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5260497f-760f-43bb-8d03-6f23d5544f5d tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:06.451227 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-47a09280-c0b2-46c6-b7e7-22893ba1edd8 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:06.451227 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-47a09280-c0b2-46c6-b7e7-22893ba1edd8 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:06.451227 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-47a09280-c0b2-46c6-b7e7-22893ba1edd8 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:06.451227 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-47a09280-c0b2-46c6-b7e7-22893ba1edd8 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:06.451227 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-47a09280-c0b2-46c6-b7e7-22893ba1edd8 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:06.451227 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-47a09280-c0b2-46c6-b7e7-22893ba1edd8 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:06.451227 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-47a09280-c0b2-46c6-b7e7-22893ba1edd8 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:06.451227 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-47a09280-c0b2-46c6-b7e7-22893ba1edd8 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:06.452114 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5260497f-760f-43bb-8d03-6f23d5544f5d tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:06.458024 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5260497f-760f-43bb-8d03-6f23d5544f5d tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1504 microversion: 2.1 time: 0.528402 Oct 04 18:50:06.460862 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2452/4854] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:05 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1504 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:50:06.499307 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d8926071-fa40-4178-9ab2-ee8ea5bd1ccf tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:06.501299 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d8926071-fa40-4178-9ab2-ee8ea5bd1ccf tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:06.528747 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d8926071-fa40-4178-9ab2-ee8ea5bd1ccf tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:06.532593 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d8926071-fa40-4178-9ab2-ee8ea5bd1ccf tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:06.533503 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d8926071-fa40-4178-9ab2-ee8ea5bd1ccf tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:06.536041 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d8926071-fa40-4178-9ab2-ee8ea5bd1ccf tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:06.538981 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d8926071-fa40-4178-9ab2-ee8ea5bd1ccf tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:06.542867 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d8926071-fa40-4178-9ab2-ee8ea5bd1ccf tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:07.224722 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-47a09280-c0b2-46c6-b7e7-22893ba1edd8 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:07.224722 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-47a09280-c0b2-46c6-b7e7-22893ba1edd8 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1685 microversion: 2.1 time: 0.813764 Oct 04 18:50:07.224722 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2403/4855] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:06 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1685 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:07.410607 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d8926071-fa40-4178-9ab2-ee8ea5bd1ccf tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:07.420196 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d8926071-fa40-4178-9ab2-ee8ea5bd1ccf tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1504 microversion: 2.1 time: 0.936099 Oct 04 18:50:07.426189 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2453/4856] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:06 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1504 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:50:07.453424 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6682e3e1-e65f-442b-91f8-66baf568d987 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:07.454357 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-6682e3e1-e65f-442b-91f8-66baf568d987 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 0f322d0f-43bf-4a61-8c40-ddd4e9fc864f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:07.472283 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-6682e3e1-e65f-442b-91f8-66baf568d987 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] HTTP exception thrown: Instance 0f322d0f-43bf-4a61-8c40-ddd4e9fc864f could not be found. Oct 04 18:50:07.493142 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6682e3e1-e65f-442b-91f8-66baf568d987 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Request method failure captured: Oct 04 18:50:07.493142 n-d-850501-14 devstack@n-api.service[123002]: request: POST /compute/v2.1/servers/0f322d0f-43bf-4a61-8c40-ddd4e9fc864f/action HTTP/1.1 Oct 04 18:50:07.493142 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:50:07.493142 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:50:07.493142 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:50:07.493142 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 18 Oct 04 18:50:07.493142 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:50:07.493142 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:50:07.493142 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:50:07.493142 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:50:07.493142 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH9zAVdj2h4kh6QqBpYrS2CJMhbcXf529VUNrZoZOYhS2tkLYBgw6AHy860DK9jQ3xATqZvC9lQuxt-_H5qKsAI41eznf32K6QSGqVcHXegpVHrDueww23ZMVCBM3D_hH0NTzh4447rgHqcrC-OZE48IfZrRJ9KPLPjAHT57T3mcPIc Oct 04 18:50:07.493142 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:50:07.493142 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:50:07.493142 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:50:07.493142 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:50:07.493142 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:50:07.493142 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:50:07.493142 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: b6c6b9deecde44b5953d22b38b5b0ff1 Oct 04 18:50:07.493142 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:50:07.493142 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:50:07.493142 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:50:07.493142 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6c6b9deecde44b5953d22b38b5b0ff1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b6c6b9deecde44b5953d22b38b5b0ff1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b6c6b9deecde44b5953d22b38b5b0ff1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6c6b9deecde44b5953d22b38b5b0ff1"}]}] Oct 04 18:50:07.493142 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:50:07.493142 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: b6c6b9deecde44b5953d22b38b5b0ff1 Oct 04 18:50:07.493142 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:50:07.493142 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServersNegativeTestJSON-626077540-project Oct 04 18:50:07.493142 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:50:07.493142 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:50:07.493142 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 5b4eb70f22ba4872b890a4f160cc1805 Oct 04 18:50:07.493142 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServersNegativeTestJSON-626077540-project Oct 04 18:50:07.493142 n-d-850501-14 devstack@n-api.service[123002]: Oct 04 18:50:07.493142 n-d-850501-14 devstack@n-api.service[123002]: {"unshelve": null} Oct 04 18:50:07.493142 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:50:07.493142 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 0f322d0f-43bf-4a61-8c40-ddd4e9fc864f could not be found. Oct 04 18:50:07.493142 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '0f322d0f-43bf-4a61-8c40-ddd4e9fc864f', 'body': {'unshelve': None}} Oct 04 18:50:07.493142 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:50:07.493142 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:50:07.493142 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:50:07.493142 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:50:07.493142 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:50:07.493142 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:50:07.493142 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:50:07.493142 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:50:07.493142 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f322d0f-43bf-4a61-8c40-ddd4e9fc864f could not be found. Oct 04 18:50:07.493142 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:50:07.493142 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:50:07.493142 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:50:07.493142 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:50:07.493142 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:50:07.493142 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:50:07.493142 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:50:07.493142 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:50:07.493142 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:50:07.493142 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:50:07.493142 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:50:07.493142 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:50:07.493142 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:50:07.493142 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:50:07.493142 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Oct 04 18:50:07.493142 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 04 18:50:07.493142 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:50:07.493142 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:50:07.493142 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f322d0f-43bf-4a61-8c40-ddd4e9fc864f could not be found. Oct 04 18:50:07.493142 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:50:07.493142 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:50:07.502055 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:50:07.502055 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:50:07.502055 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:50:07.502055 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:50:07.502055 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:50:07.502055 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:50:07.502055 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f322d0f-43bf-4a61-8c40-ddd4e9fc864f could not be found. Oct 04 18:50:07.502055 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:50:07.502055 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6682e3e1-e65f-442b-91f8-66baf568d987 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Returning 404 to user: Instance 0f322d0f-43bf-4a61-8c40-ddd4e9fc864f could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:50:07.502055 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6682e3e1-e65f-442b-91f8-66baf568d987 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "POST /compute/v2.1/servers/0f322d0f-43bf-4a61-8c40-ddd4e9fc864f/action" status: 404 len: 111 microversion: 2.1 time: 0.049458 Oct 04 18:50:07.502055 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2404/4857] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:50:07 2022] POST /compute/v2.1/servers/0f322d0f-43bf-4a61-8c40-ddd4e9fc864f/action => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:50:07.512987 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-149a2193-1d57-4ac2-8ca6-405f9f93278d tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:07.514634 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-149a2193-1d57-4ac2-8ca6-405f9f93278d tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:07.531883 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-149a2193-1d57-4ac2-8ca6-405f9f93278d tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:07.532504 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-149a2193-1d57-4ac2-8ca6-405f9f93278d tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:07.537084 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-149a2193-1d57-4ac2-8ca6-405f9f93278d tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:07.537084 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-149a2193-1d57-4ac2-8ca6-405f9f93278d tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:07.537084 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-149a2193-1d57-4ac2-8ca6-405f9f93278d tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:07.537084 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-149a2193-1d57-4ac2-8ca6-405f9f93278d tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:07.755895 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-149a2193-1d57-4ac2-8ca6-405f9f93278d tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:07.769302 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-149a2193-1d57-4ac2-8ca6-405f9f93278d tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1504 microversion: 2.1 time: 0.257103 Oct 04 18:50:07.771612 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2454/4858] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:07 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1504 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:07.799544 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-95aa4bc7-4d10-4048-8c65-882cd35fe3b4 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:07.800549 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-95aa4bc7-4d10-4048-8c65-882cd35fe3b4 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:07.816447 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-95aa4bc7-4d10-4048-8c65-882cd35fe3b4 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:07.819430 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-95aa4bc7-4d10-4048-8c65-882cd35fe3b4 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:07.821222 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-95aa4bc7-4d10-4048-8c65-882cd35fe3b4 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:07.824242 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-95aa4bc7-4d10-4048-8c65-882cd35fe3b4 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:07.824893 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-95aa4bc7-4d10-4048-8c65-882cd35fe3b4 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:07.827984 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-95aa4bc7-4d10-4048-8c65-882cd35fe3b4 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:08.196002 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-95aa4bc7-4d10-4048-8c65-882cd35fe3b4 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:08.196002 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-95aa4bc7-4d10-4048-8c65-882cd35fe3b4 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1504 microversion: 2.1 time: 0.381661 Oct 04 18:50:08.196002 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2405/4859] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:07 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1504 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:08.209735 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c0f35e0b-cc2f-4620-9502-9cb1d708cd98 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:08.211265 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c0f35e0b-cc2f-4620-9502-9cb1d708cd98 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:08.222439 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c0f35e0b-cc2f-4620-9502-9cb1d708cd98 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:08.222944 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c0f35e0b-cc2f-4620-9502-9cb1d708cd98 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:08.223404 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c0f35e0b-cc2f-4620-9502-9cb1d708cd98 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:08.224206 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c0f35e0b-cc2f-4620-9502-9cb1d708cd98 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:08.224666 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c0f35e0b-cc2f-4620-9502-9cb1d708cd98 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:08.225092 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c0f35e0b-cc2f-4620-9502-9cb1d708cd98 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:08.245712 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-559f1955-5fc2-47cf-b159-96bdd00c6bf6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:08.246923 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-559f1955-5fc2-47cf-b159-96bdd00c6bf6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:08.261675 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-559f1955-5fc2-47cf-b159-96bdd00c6bf6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:08.262163 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-559f1955-5fc2-47cf-b159-96bdd00c6bf6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:08.263267 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-559f1955-5fc2-47cf-b159-96bdd00c6bf6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:08.265579 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-559f1955-5fc2-47cf-b159-96bdd00c6bf6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:08.266255 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-559f1955-5fc2-47cf-b159-96bdd00c6bf6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:08.266919 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-559f1955-5fc2-47cf-b159-96bdd00c6bf6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:08.290465 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-c0f35e0b-cc2f-4620-9502-9cb1d708cd98 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] HTTP exception thrown: Cannot 'unshelve' instance 95fb1a13-7441-4f74-ad81-5a9413496545 while it is in vm_state active Oct 04 18:50:08.293212 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c0f35e0b-cc2f-4620-9502-9cb1d708cd98 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Request method failure captured: Oct 04 18:50:08.293212 n-d-850501-14 devstack@n-api.service[123001]: request: POST /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545/action HTTP/1.1 Oct 04 18:50:08.293212 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:50:08.293212 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:50:08.293212 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:50:08.293212 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 18 Oct 04 18:50:08.293212 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:50:08.293212 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:50:08.293212 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:50:08.293212 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:50:08.293212 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPH9zAVdj2h4kh6QqBpYrS2CJMhbcXf529VUNrZoZOYhS2tkLYBgw6AHy860DK9jQ3xATqZvC9lQuxt-_H5qKsAI41eznf32K6QSGqVcHXegpVHrDueww23ZMVCBM3D_hH0NTzh4447rgHqcrC-OZE48IfZrRJ9KPLPjAHT57T3mcPIc Oct 04 18:50:08.293212 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:50:08.293212 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:50:08.293212 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:50:08.293212 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:50:08.293212 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:50:08.293212 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:50:08.293212 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: b6c6b9deecde44b5953d22b38b5b0ff1 Oct 04 18:50:08.293212 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:50:08.293212 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:50:08.293212 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:50:08.293212 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6c6b9deecde44b5953d22b38b5b0ff1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b6c6b9deecde44b5953d22b38b5b0ff1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b6c6b9deecde44b5953d22b38b5b0ff1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6c6b9deecde44b5953d22b38b5b0ff1"}]}] Oct 04 18:50:08.293212 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:50:08.293212 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: b6c6b9deecde44b5953d22b38b5b0ff1 Oct 04 18:50:08.293212 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:50:08.293212 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ServersNegativeTestJSON-626077540-project Oct 04 18:50:08.293212 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:50:08.293212 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:50:08.293212 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 5b4eb70f22ba4872b890a4f160cc1805 Oct 04 18:50:08.293212 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ServersNegativeTestJSON-626077540-project Oct 04 18:50:08.293212 n-d-850501-14 devstack@n-api.service[123001]: Oct 04 18:50:08.293212 n-d-850501-14 devstack@n-api.service[123001]: {"unshelve": null} Oct 04 18:50:08.293212 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:50:08.293212 n-d-850501-14 devstack@n-api.service[123001]: exception: Cannot 'unshelve' instance 95fb1a13-7441-4f74-ad81-5a9413496545 while it is in vm_state active Oct 04 18:50:08.293212 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '95fb1a13-7441-4f74-ad81-5a9413496545', 'body': {'unshelve': None}} Oct 04 18:50:08.293212 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:50:08.293212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:50:08.293212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Oct 04 18:50:08.293212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Oct 04 18:50:08.293212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 04 18:50:08.293212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:50:08.293212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:50:08.293212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:50:08.293212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 18:50:08.293212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 18:50:08.293212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 95fb1a13-7441-4f74-ad81-5a9413496545 in vm_state active. Cannot unshelve while the instance is in this state. Oct 04 18:50:08.293212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:50:08.293212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:50:08.293212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:50:08.293212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:50:08.293212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:50:08.293212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:50:08.293212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:50:08.293212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:50:08.293212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:50:08.293212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:50:08.293212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:50:08.293212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:50:08.293212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:50:08.293212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:50:08.293212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Oct 04 18:50:08.293212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 04 18:50:08.293212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 18:50:08.293212 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 18:50:08.298774 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 95fb1a13-7441-4f74-ad81-5a9413496545 while it is in vm_state active Oct 04 18:50:08.298774 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:50:08.298774 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:50:08.298774 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:50:08.298774 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:50:08.298774 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:50:08.298774 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:50:08.298774 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:50:08.298774 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:50:08.298774 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 95fb1a13-7441-4f74-ad81-5a9413496545 while it is in vm_state active Oct 04 18:50:08.298774 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:50:08.300342 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c0f35e0b-cc2f-4620-9502-9cb1d708cd98 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Returning 409 to user: Cannot 'unshelve' instance 95fb1a13-7441-4f74-ad81-5a9413496545 while it is in vm_state active {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:50:08.302037 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c0f35e0b-cc2f-4620-9502-9cb1d708cd98 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "POST /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545/action" status: 409 len: 146 microversion: 2.1 time: 0.099206 Oct 04 18:50:08.303196 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2455/4860] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:50:08 2022] POST /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545/action => generated 146 bytes in 103 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:50:08.313754 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-44dddbbf-1ab7-4d20-a167-8702b35de4af tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:08.315501 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-44dddbbf-1ab7-4d20-a167-8702b35de4af tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:08.323475 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-44dddbbf-1ab7-4d20-a167-8702b35de4af tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:08.324049 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-44dddbbf-1ab7-4d20-a167-8702b35de4af tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:08.324620 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-44dddbbf-1ab7-4d20-a167-8702b35de4af tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:08.325430 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-44dddbbf-1ab7-4d20-a167-8702b35de4af tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:08.326000 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-44dddbbf-1ab7-4d20-a167-8702b35de4af tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:08.326526 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-44dddbbf-1ab7-4d20-a167-8702b35de4af tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:08.782008 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-44dddbbf-1ab7-4d20-a167-8702b35de4af tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:08.792854 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-44dddbbf-1ab7-4d20-a167-8702b35de4af tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1504 microversion: 2.1 time: 0.484508 Oct 04 18:50:08.795906 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2456/4861] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:08 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1504 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:08.801299 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-559f1955-5fc2-47cf-b159-96bdd00c6bf6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:08.842628 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-559f1955-5fc2-47cf-b159-96bdd00c6bf6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1685 microversion: 2.1 time: 0.597330 Oct 04 18:50:08.844760 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-acecd386-20d5-4348-89da-0a7318ec7bd0 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:08.845733 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-acecd386-20d5-4348-89da-0a7318ec7bd0 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:08.846477 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2406/4862] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:08 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1685 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:08.855668 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-acecd386-20d5-4348-89da-0a7318ec7bd0 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:08.856492 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-acecd386-20d5-4348-89da-0a7318ec7bd0 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:08.857175 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-acecd386-20d5-4348-89da-0a7318ec7bd0 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:08.858042 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-acecd386-20d5-4348-89da-0a7318ec7bd0 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:08.859221 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-acecd386-20d5-4348-89da-0a7318ec7bd0 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:08.860502 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-acecd386-20d5-4348-89da-0a7318ec7bd0 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:09.105261 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-acecd386-20d5-4348-89da-0a7318ec7bd0 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:09.116748 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-acecd386-20d5-4348-89da-0a7318ec7bd0 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1504 microversion: 2.1 time: 0.288671 Oct 04 18:50:09.117552 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2457/4863] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:08 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1504 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:09.140402 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f0fafbc9-c2f3-46e9-84cc-de10fcb799b8 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2120900835_updated"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:09.143103 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f0fafbc9-c2f3-46e9-84cc-de10fcb799b8 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 9b11bd3e-c604-428f-bbf4-6d86a7e2ebe8] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:09.147847 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:50:09.150938 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-f0fafbc9-c2f3-46e9-84cc-de10fcb799b8 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] HTTP exception thrown: Instance 9b11bd3e-c604-428f-bbf4-6d86a7e2ebe8 could not be found. Oct 04 18:50:09.155038 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f0fafbc9-c2f3-46e9-84cc-de10fcb799b8 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Request method failure captured: Oct 04 18:50:09.155038 n-d-850501-14 devstack@n-api.service[123002]: request: PUT /compute/v2.1/servers/9b11bd3e-c604-428f-bbf4-6d86a7e2ebe8 HTTP/1.1 Oct 04 18:50:09.155038 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:50:09.155038 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:50:09.155038 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:50:09.155038 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 81 Oct 04 18:50:09.155038 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:50:09.155038 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:50:09.155038 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:50:09.155038 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:50:09.155038 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH9zAVdj2h4kh6QqBpYrS2CJMhbcXf529VUNrZoZOYhS2tkLYBgw6AHy860DK9jQ3xATqZvC9lQuxt-_H5qKsAI41eznf32K6QSGqVcHXegpVHrDueww23ZMVCBM3D_hH0NTzh4447rgHqcrC-OZE48IfZrRJ9KPLPjAHT57T3mcPIc Oct 04 18:50:09.155038 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:50:09.155038 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:50:09.155038 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:50:09.155038 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:50:09.155038 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:50:09.155038 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:50:09.155038 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: b6c6b9deecde44b5953d22b38b5b0ff1 Oct 04 18:50:09.155038 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:50:09.155038 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:50:09.155038 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:50:09.155038 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6c6b9deecde44b5953d22b38b5b0ff1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b6c6b9deecde44b5953d22b38b5b0ff1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b6c6b9deecde44b5953d22b38b5b0ff1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6c6b9deecde44b5953d22b38b5b0ff1"}]}] Oct 04 18:50:09.155038 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:50:09.155038 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: b6c6b9deecde44b5953d22b38b5b0ff1 Oct 04 18:50:09.155038 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:50:09.155038 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServersNegativeTestJSON-626077540-project Oct 04 18:50:09.155038 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:50:09.155038 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:50:09.155038 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 5b4eb70f22ba4872b890a4f160cc1805 Oct 04 18:50:09.155038 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServersNegativeTestJSON-626077540-project Oct 04 18:50:09.155038 n-d-850501-14 devstack@n-api.service[123002]: Oct 04 18:50:09.155038 n-d-850501-14 devstack@n-api.service[123002]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2120900835_updated"}} Oct 04 18:50:09.155038 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:50:09.155038 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 9b11bd3e-c604-428f-bbf4-6d86a7e2ebe8 could not be found. Oct 04 18:50:09.155038 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '9b11bd3e-c604-428f-bbf4-6d86a7e2ebe8', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2120900835_updated'}}} Oct 04 18:50:09.155038 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:50:09.155038 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:50:09.155038 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:50:09.155038 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:50:09.155038 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:50:09.155038 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:50:09.155038 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:50:09.155038 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:50:09.155038 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b11bd3e-c604-428f-bbf4-6d86a7e2ebe8 could not be found. Oct 04 18:50:09.155038 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:50:09.155038 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:50:09.155038 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:50:09.155038 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:50:09.155038 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:50:09.155038 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:50:09.155038 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:50:09.155038 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:50:09.155038 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:50:09.155038 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:50:09.155038 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:50:09.155038 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:50:09.155038 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:50:09.155038 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:50:09.155038 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:50:09.155038 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:50:09.155038 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 04 18:50:09.155038 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 04 18:50:09.155038 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 04 18:50:09.155038 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:50:09.160180 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:50:09.160180 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:50:09.160180 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:50:09.160180 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b11bd3e-c604-428f-bbf4-6d86a7e2ebe8 could not be found. Oct 04 18:50:09.160180 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:50:09.160180 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:50:09.160180 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:50:09.160180 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:50:09.160180 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:50:09.160180 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:50:09.160180 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:50:09.160180 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:50:09.160180 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b11bd3e-c604-428f-bbf4-6d86a7e2ebe8 could not be found. Oct 04 18:50:09.160180 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:50:09.160180 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f0fafbc9-c2f3-46e9-84cc-de10fcb799b8 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Returning 404 to user: Instance 9b11bd3e-c604-428f-bbf4-6d86a7e2ebe8 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:50:09.160180 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f0fafbc9-c2f3-46e9-84cc-de10fcb799b8 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "PUT /compute/v2.1/servers/9b11bd3e-c604-428f-bbf4-6d86a7e2ebe8" status: 404 len: 111 microversion: 2.1 time: 0.018625 Oct 04 18:50:09.160180 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2407/4864] 10.222.0.20 () {60 vars in 1256 bytes} [Tue Oct 4 18:50:09 2022] PUT /compute/v2.1/servers/9b11bd3e-c604-428f-bbf4-6d86a7e2ebe8 => generated 111 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:50:09.167904 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7136186a-726d-45d9-aef9-8f5eb0bb3e74 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:09.168857 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7136186a-726d-45d9-aef9-8f5eb0bb3e74 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:09.176909 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7136186a-726d-45d9-aef9-8f5eb0bb3e74 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:09.177735 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7136186a-726d-45d9-aef9-8f5eb0bb3e74 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:09.178739 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7136186a-726d-45d9-aef9-8f5eb0bb3e74 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:09.179751 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7136186a-726d-45d9-aef9-8f5eb0bb3e74 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:09.180446 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7136186a-726d-45d9-aef9-8f5eb0bb3e74 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:09.180940 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7136186a-726d-45d9-aef9-8f5eb0bb3e74 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:09.384031 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7136186a-726d-45d9-aef9-8f5eb0bb3e74 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:09.397377 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7136186a-726d-45d9-aef9-8f5eb0bb3e74 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1504 microversion: 2.1 time: 0.232850 Oct 04 18:50:09.406114 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2458/4865] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:09 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1504 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:09.429991 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7375d702-9758-4713-925b-9f93a8e6aeaf tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:09.436794 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7375d702-9758-4713-925b-9f93a8e6aeaf tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:09.439541 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7375d702-9758-4713-925b-9f93a8e6aeaf tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:09.440265 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7375d702-9758-4713-925b-9f93a8e6aeaf tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:09.440914 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7375d702-9758-4713-925b-9f93a8e6aeaf tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:09.441643 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7375d702-9758-4713-925b-9f93a8e6aeaf tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:09.442113 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7375d702-9758-4713-925b-9f93a8e6aeaf tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:09.442816 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7375d702-9758-4713-925b-9f93a8e6aeaf tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:09.630611 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7375d702-9758-4713-925b-9f93a8e6aeaf tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:09.644902 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7375d702-9758-4713-925b-9f93a8e6aeaf tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1504 microversion: 2.1 time: 0.220818 Oct 04 18:50:09.663688 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2408/4866] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:09 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1504 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:50:09.671776 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-de89f815-7027-4ae2-aa12-f5a7ac495344 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:09.682322 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-de89f815-7027-4ae2-aa12-f5a7ac495344 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Request method failure captured: Oct 04 18:50:09.682322 n-d-850501-14 devstack@n-api.service[123001]: request: PUT /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 HTTP/1.1 Oct 04 18:50:09.682322 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:50:09.682322 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:50:09.682322 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:50:09.682322 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 280 Oct 04 18:50:09.682322 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:50:09.682322 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:50:09.682322 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:50:09.682322 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:50:09.682322 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPH9zAVdj2h4kh6QqBpYrS2CJMhbcXf529VUNrZoZOYhS2tkLYBgw6AHy860DK9jQ3xATqZvC9lQuxt-_H5qKsAI41eznf32K6QSGqVcHXegpVHrDueww23ZMVCBM3D_hH0NTzh4447rgHqcrC-OZE48IfZrRJ9KPLPjAHT57T3mcPIc Oct 04 18:50:09.682322 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:50:09.682322 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:50:09.682322 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:50:09.682322 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:50:09.682322 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:50:09.682322 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:50:09.682322 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: b6c6b9deecde44b5953d22b38b5b0ff1 Oct 04 18:50:09.682322 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:50:09.682322 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:50:09.682322 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:50:09.682322 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6c6b9deecde44b5953d22b38b5b0ff1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b6c6b9deecde44b5953d22b38b5b0ff1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b6c6b9deecde44b5953d22b38b5b0ff1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6c6b9deecde44b5953d22b38b5b0ff1"}]}] Oct 04 18:50:09.682322 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:50:09.682322 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: b6c6b9deecde44b5953d22b38b5b0ff1 Oct 04 18:50:09.682322 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:50:09.682322 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ServersNegativeTestJSON-626077540-project Oct 04 18:50:09.682322 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:50:09.682322 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:50:09.682322 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 5b4eb70f22ba4872b890a4f160cc1805 Oct 04 18:50:09.682322 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ServersNegativeTestJSON-626077540-project Oct 04 18:50:09.682322 n-d-850501-14 devstack@n-api.service[123001]: Oct 04 18:50:09.682322 n-d-850501-14 devstack@n-api.service[123001]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 04 18:50:09.682322 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:50:09.682322 n-d-850501-14 devstack@n-api.service[123001]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 18:50:09.682322 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '95fb1a13-7441-4f74-ad81-5a9413496545', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 04 18:50:09.682322 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:50:09.682322 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:50:09.682322 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:50:09.682322 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:50:09.682322 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:50:09.682322 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:50:09.682322 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 18:50:09.682322 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:50:09.682322 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 04 18:50:09.682322 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 18:50:09.682322 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:50:09.682322 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 18:50:09.682322 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 04 18:50:09.682322 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:50:09.682322 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:50:09.682322 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:50:09.682322 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:50:09.686539 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:50:09.686539 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:50:09.686539 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:50:09.686539 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:50:09.686539 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:50:09.686539 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:50:09.686539 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:50:09.686539 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:50:09.686539 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:50:09.686539 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:50:09.686539 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:50:09.686539 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:50:09.686539 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:50:09.686539 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:50:09.686539 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 18:50:09.686539 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:50:09.686539 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:50:09.686539 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:50:09.686539 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:50:09.686539 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:50:09.686539 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:50:09.686539 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:50:09.686539 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:50:09.686539 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 18:50:09.686539 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:50:09.686539 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-de89f815-7027-4ae2-aa12-f5a7ac495344 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:50:09.689444 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-de89f815-7027-4ae2-aa12-f5a7ac495344 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "PUT /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 400 len: 619 microversion: 2.1 time: 0.015566 Oct 04 18:50:09.696273 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2459/4867] 10.222.0.20 () {60 vars in 1257 bytes} [Tue Oct 4 18:50:09 2022] PUT /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 619 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:50:09.705641 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b48bb116-c4c7-4dcf-9f4f-55f00bb95caa tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:09.707042 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b48bb116-c4c7-4dcf-9f4f-55f00bb95caa tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:09.714708 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b48bb116-c4c7-4dcf-9f4f-55f00bb95caa tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:09.715672 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b48bb116-c4c7-4dcf-9f4f-55f00bb95caa tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:09.716307 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b48bb116-c4c7-4dcf-9f4f-55f00bb95caa tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:09.717797 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b48bb116-c4c7-4dcf-9f4f-55f00bb95caa tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:09.719704 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b48bb116-c4c7-4dcf-9f4f-55f00bb95caa tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:09.720369 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b48bb116-c4c7-4dcf-9f4f-55f00bb95caa tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:09.877691 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3acb404b-1406-4112-86d2-6d3f3b5de7d7 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:09.878798 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3acb404b-1406-4112-86d2-6d3f3b5de7d7 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:09.893085 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3acb404b-1406-4112-86d2-6d3f3b5de7d7 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:09.894483 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3acb404b-1406-4112-86d2-6d3f3b5de7d7 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:09.895467 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3acb404b-1406-4112-86d2-6d3f3b5de7d7 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:09.896606 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3acb404b-1406-4112-86d2-6d3f3b5de7d7 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:09.902957 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3acb404b-1406-4112-86d2-6d3f3b5de7d7 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:09.904246 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3acb404b-1406-4112-86d2-6d3f3b5de7d7 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:09.929927 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b48bb116-c4c7-4dcf-9f4f-55f00bb95caa tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:09.941270 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b48bb116-c4c7-4dcf-9f4f-55f00bb95caa tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1504 microversion: 2.1 time: 0.243215 Oct 04 18:50:09.956927 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2409/4868] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:09 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1504 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:09.968859 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4e67cd99-02d4-4d20-8275-0ff1aeb85344 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:09.969637 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4e67cd99-02d4-4d20-8275-0ff1aeb85344 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:09.977162 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4e67cd99-02d4-4d20-8275-0ff1aeb85344 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:09.977653 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4e67cd99-02d4-4d20-8275-0ff1aeb85344 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:09.982696 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4e67cd99-02d4-4d20-8275-0ff1aeb85344 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:09.982696 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4e67cd99-02d4-4d20-8275-0ff1aeb85344 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:09.982696 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4e67cd99-02d4-4d20-8275-0ff1aeb85344 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:09.982696 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4e67cd99-02d4-4d20-8275-0ff1aeb85344 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:10.027115 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:50:10.262907 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3acb404b-1406-4112-86d2-6d3f3b5de7d7 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:10.280363 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4e67cd99-02d4-4d20-8275-0ff1aeb85344 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:10.299186 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3acb404b-1406-4112-86d2-6d3f3b5de7d7 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1672 microversion: 2.1 time: 0.422220 Oct 04 18:50:10.299351 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4e67cd99-02d4-4d20-8275-0ff1aeb85344 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1504 microversion: 2.1 time: 0.334952 Oct 04 18:50:10.300311 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2460/4869] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:09 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1672 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:50:10.300684 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2410/4870] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:09 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1504 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:50:10.337068 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7a21391a-33d7-401b-b000-622a5f0de5dd tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:10.345230 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7a21391a-33d7-401b-b000-622a5f0de5dd tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Request method failure captured: Oct 04 18:50:10.345230 n-d-850501-14 devstack@n-api.service[123001]: request: PUT /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 HTTP/1.1 Oct 04 18:50:10.345230 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:50:10.345230 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:50:10.345230 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:50:10.345230 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 24 Oct 04 18:50:10.345230 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:50:10.345230 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:50:10.345230 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:50:10.345230 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:50:10.345230 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPH9zAVdj2h4kh6QqBpYrS2CJMhbcXf529VUNrZoZOYhS2tkLYBgw6AHy860DK9jQ3xATqZvC9lQuxt-_H5qKsAI41eznf32K6QSGqVcHXegpVHrDueww23ZMVCBM3D_hH0NTzh4447rgHqcrC-OZE48IfZrRJ9KPLPjAHT57T3mcPIc Oct 04 18:50:10.345230 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:50:10.345230 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:50:10.345230 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:50:10.345230 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:50:10.345230 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:50:10.345230 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:50:10.345230 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: b6c6b9deecde44b5953d22b38b5b0ff1 Oct 04 18:50:10.345230 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:50:10.345230 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:50:10.345230 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:50:10.345230 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6c6b9deecde44b5953d22b38b5b0ff1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b6c6b9deecde44b5953d22b38b5b0ff1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b6c6b9deecde44b5953d22b38b5b0ff1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6c6b9deecde44b5953d22b38b5b0ff1"}]}] Oct 04 18:50:10.345230 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:50:10.345230 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: b6c6b9deecde44b5953d22b38b5b0ff1 Oct 04 18:50:10.345230 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:50:10.345230 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ServersNegativeTestJSON-626077540-project Oct 04 18:50:10.345230 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:50:10.345230 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:50:10.345230 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 5b4eb70f22ba4872b890a4f160cc1805 Oct 04 18:50:10.345230 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ServersNegativeTestJSON-626077540-project Oct 04 18:50:10.345230 n-d-850501-14 devstack@n-api.service[123001]: Oct 04 18:50:10.345230 n-d-850501-14 devstack@n-api.service[123001]: {"server": {"name": ""}} Oct 04 18:50:10.345230 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:50:10.345230 n-d-850501-14 devstack@n-api.service[123001]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 04 18:50:10.345230 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '95fb1a13-7441-4f74-ad81-5a9413496545', 'body': {'server': {'name': ''}}} Oct 04 18:50:10.345230 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:50:10.345230 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:50:10.345230 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:50:10.345230 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:50:10.345230 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:50:10.345230 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:50:10.345230 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 04 18:50:10.345230 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:50:10.345230 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 04 18:50:10.345230 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 18:50:10.345230 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:50:10.345230 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 18:50:10.345230 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi '' Oct 04 18:50:10.345230 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:50:10.345230 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:50:10.345230 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:50:10.345230 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:50:10.345230 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:50:10.345230 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:50:10.345230 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:50:10.345230 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:50:10.345230 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:50:10.345230 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:50:10.345230 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:50:10.345230 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:50:10.345230 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:50:10.345230 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:50:10.345230 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:50:10.345230 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:50:10.345230 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:50:10.345230 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:50:10.345230 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 04 18:50:10.354669 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:50:10.354669 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:50:10.354669 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:50:10.354669 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:50:10.354669 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:50:10.354669 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:50:10.354669 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:50:10.354669 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:50:10.354669 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 04 18:50:10.354669 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:50:10.354669 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7a21391a-33d7-401b-b000-622a5f0de5dd tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:50:10.354669 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7a21391a-33d7-401b-b000-622a5f0de5dd tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "PUT /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 400 len: 108 microversion: 2.1 time: 0.015143 Oct 04 18:50:10.354669 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2461/4871] 10.222.0.20 () {60 vars in 1256 bytes} [Tue Oct 4 18:50:10 2022] PUT /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 108 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:50:10.357206 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4cbedb0b-caee-45fc-b6ad-be075d77fdad tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:10.357839 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4cbedb0b-caee-45fc-b6ad-be075d77fdad tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:10.364212 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4cbedb0b-caee-45fc-b6ad-be075d77fdad tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:10.364712 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4cbedb0b-caee-45fc-b6ad-be075d77fdad tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:10.365155 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4cbedb0b-caee-45fc-b6ad-be075d77fdad tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:10.365866 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4cbedb0b-caee-45fc-b6ad-be075d77fdad tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:10.366331 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4cbedb0b-caee-45fc-b6ad-be075d77fdad tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:10.366766 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4cbedb0b-caee-45fc-b6ad-be075d77fdad tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:10.535711 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4cbedb0b-caee-45fc-b6ad-be075d77fdad tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:10.552163 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4cbedb0b-caee-45fc-b6ad-be075d77fdad tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1504 microversion: 2.1 time: 0.198608 Oct 04 18:50:10.557498 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2411/4872] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:10 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1504 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:12.449650 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-778c0966-5743-4509-9cdb-4e25e6978305 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-2055540196", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": [{"uuid": "59565d3a-ef98-4937-ac26-9db87f0f88b0"}]}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:12.530294 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6c9d3d2f-4320-470e-be31-5a81b303a80c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:12.531716 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-6c9d3d2f-4320-470e-be31-5a81b303a80c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:12.553498 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6c9d3d2f-4320-470e-be31-5a81b303a80c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:12.558342 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6c9d3d2f-4320-470e-be31-5a81b303a80c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:12.558342 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6c9d3d2f-4320-470e-be31-5a81b303a80c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:12.558342 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6c9d3d2f-4320-470e-be31-5a81b303a80c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:12.558342 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6c9d3d2f-4320-470e-be31-5a81b303a80c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:12.559013 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6c9d3d2f-4320-470e-be31-5a81b303a80c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:12.574473 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.neutron [None req-778c0966-5743-4509-9cdb-4e25e6978305 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] validate_networks() for [('59565d3a-ef98-4937-ac26-9db87f0f88b0', None, None, None, None, None)] {{(pid=123001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:50:12.947104 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-6c9d3d2f-4320-470e-be31-5a81b303a80c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:12.957383 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6c9d3d2f-4320-470e-be31-5a81b303a80c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1672 microversion: 2.1 time: 0.432267 Oct 04 18:50:12.960672 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2412/4873] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:12 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1672 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:50:13.348695 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-a0726cdc-f821-4cff-8315-d2b968437c20 req-4b1278b7-d420-4df7-97ad-57935fa03625 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e208f85-0513-43f4-8a2c-38baa2886238", "name": "network-vif-unplugged", "status": "completed", "tag": "caad0bda-801d-4a85-94c7-4bb13cb984c3"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:13.366555 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-a0726cdc-f821-4cff-8315-d2b968437c20 req-4b1278b7-d420-4df7-97ad-57935fa03625 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:13.367059 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-a0726cdc-f821-4cff-8315-d2b968437c20 req-4b1278b7-d420-4df7-97ad-57935fa03625 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:13.367501 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-a0726cdc-f821-4cff-8315-d2b968437c20 req-4b1278b7-d420-4df7-97ad-57935fa03625 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:13.402839 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-a0726cdc-f821-4cff-8315-d2b968437c20 req-4b1278b7-d420-4df7-97ad-57935fa03625 service nova] Creating event network-vif-unplugged:caad0bda-801d-4a85-94c7-4bb13cb984c3 for instance 2e208f85-0513-43f4-8a2c-38baa2886238 on n-h2-850501-14 Oct 04 18:50:13.419846 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-a0726cdc-f821-4cff-8315-d2b968437c20 req-4b1278b7-d420-4df7-97ad-57935fa03625 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075109 Oct 04 18:50:13.425157 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2413/4874] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:50:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:50:13.529147 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-778c0966-5743-4509-9cdb-4e25e6978305 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:50:13.530731 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-778c0966-5743-4509-9cdb-4e25e6978305 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:50:13.531294 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-778c0966-5743-4509-9cdb-4e25e6978305 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:50:13.531800 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-778c0966-5743-4509-9cdb-4e25e6978305 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:50:13.532193 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-778c0966-5743-4509-9cdb-4e25e6978305 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:50:13.546344 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-778c0966-5743-4509-9cdb-4e25e6978305 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:13.548020 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-778c0966-5743-4509-9cdb-4e25e6978305 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:13.548510 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-778c0966-5743-4509-9cdb-4e25e6978305 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:13.549651 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-778c0966-5743-4509-9cdb-4e25e6978305 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:13.550303 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-778c0966-5743-4509-9cdb-4e25e6978305 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:13.550884 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-778c0966-5743-4509-9cdb-4e25e6978305 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:13.578837 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-778c0966-5743-4509-9cdb-4e25e6978305 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Getting quotas for project ac6d0a20c16d4c229b3e7488cf75a35b. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:50:13.582868 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-778c0966-5743-4509-9cdb-4e25e6978305 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Getting quotas for user 4307d3ab621244f29d98d8ef2a40538a and project ac6d0a20c16d4c229b3e7488cf75a35b. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:50:13.611984 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-778c0966-5743-4509-9cdb-4e25e6978305 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Going to run 1 instances... {{(pid=123001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:50:13.614893 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-778c0966-5743-4509-9cdb-4e25e6978305 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] [instance: 795440d0-6c9d-4317-9c59-dcc268cfa354] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:50:13.895576 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-778c0966-5743-4509-9cdb-4e25e6978305 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.661905 Oct 04 18:50:13.900501 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2462/4875] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:50:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1668 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:50:13.910084 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ca2c55ca-df75-4ced-83ae-10ac20cb5f9b tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:13.911026 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ca2c55ca-df75-4ced-83ae-10ac20cb5f9b tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] [instance: 795440d0-6c9d-4317-9c59-dcc268cfa354] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:14.019358 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ca2c55ca-df75-4ced-83ae-10ac20cb5f9b tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4307d3ab621244f29d98d8ef2a40538a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6d0a20c16d4c229b3e7488cf75a35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:14.040253 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ca2c55ca-df75-4ced-83ae-10ac20cb5f9b tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] 10.222.0.20 "GET /compute/v2.1/servers/795440d0-6c9d-4317-9c59-dcc268cfa354" status: 200 len: 1215 microversion: 2.1 time: 0.132886 Oct 04 18:50:14.047716 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2414/4876] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:13 2022] GET /compute/v2.1/servers/795440d0-6c9d-4317-9c59-dcc268cfa354 => generated 1215 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:50:15.074801 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-80bcc1a7-6fc3-4fae-b70a-2f20285baaad tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:15.075581 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-80bcc1a7-6fc3-4fae-b70a-2f20285baaad tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] [instance: 795440d0-6c9d-4317-9c59-dcc268cfa354] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:15.163801 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-80bcc1a7-6fc3-4fae-b70a-2f20285baaad tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4307d3ab621244f29d98d8ef2a40538a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6d0a20c16d4c229b3e7488cf75a35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:15.176655 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-80bcc1a7-6fc3-4fae-b70a-2f20285baaad tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] 10.222.0.20 "GET /compute/v2.1/servers/795440d0-6c9d-4317-9c59-dcc268cfa354" status: 200 len: 1215 microversion: 2.1 time: 0.106893 Oct 04 18:50:15.177947 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2463/4877] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:15 2022] GET /compute/v2.1/servers/795440d0-6c9d-4317-9c59-dcc268cfa354 => generated 1215 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:16.199382 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-30399ac9-ec6a-4a9a-b1ab-fdcb84db9ffa tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:16.199999 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-30399ac9-ec6a-4a9a-b1ab-fdcb84db9ffa tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] [instance: 795440d0-6c9d-4317-9c59-dcc268cfa354] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:16.224831 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-30399ac9-ec6a-4a9a-b1ab-fdcb84db9ffa tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:16.226162 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-30399ac9-ec6a-4a9a-b1ab-fdcb84db9ffa tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:16.226797 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-30399ac9-ec6a-4a9a-b1ab-fdcb84db9ffa tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:16.227716 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-30399ac9-ec6a-4a9a-b1ab-fdcb84db9ffa tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:16.228459 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-30399ac9-ec6a-4a9a-b1ab-fdcb84db9ffa tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:16.229047 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-30399ac9-ec6a-4a9a-b1ab-fdcb84db9ffa tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:16.432498 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-30399ac9-ec6a-4a9a-b1ab-fdcb84db9ffa tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4307d3ab621244f29d98d8ef2a40538a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6d0a20c16d4c229b3e7488cf75a35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:16.441251 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-30399ac9-ec6a-4a9a-b1ab-fdcb84db9ffa tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] 10.222.0.20 "GET /compute/v2.1/servers/795440d0-6c9d-4317-9c59-dcc268cfa354" status: 200 len: 1219 microversion: 2.1 time: 0.246077 Oct 04 18:50:16.441829 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2415/4878] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:16 2022] GET /compute/v2.1/servers/795440d0-6c9d-4317-9c59-dcc268cfa354 => generated 1219 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:16.644089 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3a1d6a87-587e-4093-bff3-fc6d790051c8 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:16.644577 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3a1d6a87-587e-4093-bff3-fc6d790051c8 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:16.653449 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3a1d6a87-587e-4093-bff3-fc6d790051c8 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:16.653936 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3a1d6a87-587e-4093-bff3-fc6d790051c8 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:16.654423 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3a1d6a87-587e-4093-bff3-fc6d790051c8 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:16.655053 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3a1d6a87-587e-4093-bff3-fc6d790051c8 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:16.656047 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3a1d6a87-587e-4093-bff3-fc6d790051c8 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:16.656491 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3a1d6a87-587e-4093-bff3-fc6d790051c8 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:16.904044 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8ec54762-0bcf-45a4-bef6-db93aae4de16 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:16.904982 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8ec54762-0bcf-45a4-bef6-db93aae4de16 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: 3209d143-9e5f-4529-a0bb-8fea0c22083b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:16.911777 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8ec54762-0bcf-45a4-bef6-db93aae4de16 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:16.924347 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8ec54762-0bcf-45a4-bef6-db93aae4de16 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:16.925078 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8ec54762-0bcf-45a4-bef6-db93aae4de16 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:16.925894 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8ec54762-0bcf-45a4-bef6-db93aae4de16 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:16.926447 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8ec54762-0bcf-45a4-bef6-db93aae4de16 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:16.927088 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8ec54762-0bcf-45a4-bef6-db93aae4de16 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:16.978163 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8ec54762-0bcf-45a4-bef6-db93aae4de16 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: 3209d143-9e5f-4529-a0bb-8fea0c22083b] Going to try to terminate instance {{(pid=123002) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:50:16.979216 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3a1d6a87-587e-4093-bff3-fc6d790051c8 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:16.988149 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3a1d6a87-587e-4093-bff3-fc6d790051c8 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1672 microversion: 2.1 time: 0.348449 Oct 04 18:50:16.991307 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2464/4879] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:16 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1672 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:17.026935 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-18e8ec11-76dc-44d7-a30f-bb30062d5ff7 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:17.027920 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-18e8ec11-76dc-44d7-a30f-bb30062d5ff7 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:17.048392 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-18e8ec11-76dc-44d7-a30f-bb30062d5ff7 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:17.056813 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-18e8ec11-76dc-44d7-a30f-bb30062d5ff7 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:17.057272 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-18e8ec11-76dc-44d7-a30f-bb30062d5ff7 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:17.059920 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-18e8ec11-76dc-44d7-a30f-bb30062d5ff7 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:17.059920 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-18e8ec11-76dc-44d7-a30f-bb30062d5ff7 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:17.059920 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-18e8ec11-76dc-44d7-a30f-bb30062d5ff7 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:17.328017 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-18e8ec11-76dc-44d7-a30f-bb30062d5ff7 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:17.336506 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=100 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:50:17.346470 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-18e8ec11-76dc-44d7-a30f-bb30062d5ff7 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1672 microversion: 2.1 time: 0.334439 Oct 04 18:50:17.347763 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2465/4880] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:17 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1672 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:50:17.382388 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7da239d5-2820-4798-80ab-8e813ac639ce tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:17.383243 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7da239d5-2820-4798-80ab-8e813ac639ce tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:17.392737 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7da239d5-2820-4798-80ab-8e813ac639ce tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:17.393427 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7da239d5-2820-4798-80ab-8e813ac639ce tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:17.394009 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7da239d5-2820-4798-80ab-8e813ac639ce tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:17.394830 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7da239d5-2820-4798-80ab-8e813ac639ce tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:17.395573 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7da239d5-2820-4798-80ab-8e813ac639ce tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:17.396033 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7da239d5-2820-4798-80ab-8e813ac639ce tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:17.560304 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8ec54762-0bcf-45a4-bef6-db93aae4de16 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3209d143-9e5f-4529-a0bb-8fea0c22083b" status: 204 len: 0 microversion: 2.1 time: 0.656478 Oct 04 18:50:17.560304 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2416/4881] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:50:16 2022] DELETE /compute/v2.1/servers/3209d143-9e5f-4529-a0bb-8fea0c22083b => generated 0 bytes in 658 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:50:17.566465 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9aa0ad2b-ec71-433e-a572-075c655e827e tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:17.567387 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9aa0ad2b-ec71-433e-a572-075c655e827e tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] [instance: 795440d0-6c9d-4317-9c59-dcc268cfa354] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:17.573466 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7da239d5-2820-4798-80ab-8e813ac639ce tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:17.575090 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9aa0ad2b-ec71-433e-a572-075c655e827e tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:17.576160 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9aa0ad2b-ec71-433e-a572-075c655e827e tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:17.576783 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9aa0ad2b-ec71-433e-a572-075c655e827e tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:17.578447 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9aa0ad2b-ec71-433e-a572-075c655e827e tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:17.579655 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9aa0ad2b-ec71-433e-a572-075c655e827e tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:17.580843 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9aa0ad2b-ec71-433e-a572-075c655e827e tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:17.592804 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7da239d5-2820-4798-80ab-8e813ac639ce tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1672 microversion: 2.1 time: 0.216060 Oct 04 18:50:17.595654 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2466/4882] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:17 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1672 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:17.608678 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-23261da7-e494-4a9d-9946-0db60e6bcef2 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:17.609941 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-23261da7-e494-4a9d-9946-0db60e6bcef2 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: 3209d143-9e5f-4529-a0bb-8fea0c22083b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:17.620648 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-23261da7-e494-4a9d-9946-0db60e6bcef2 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:17.621156 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-23261da7-e494-4a9d-9946-0db60e6bcef2 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:17.621599 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-23261da7-e494-4a9d-9946-0db60e6bcef2 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:17.623056 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-23261da7-e494-4a9d-9946-0db60e6bcef2 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:17.633991 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-23261da7-e494-4a9d-9946-0db60e6bcef2 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:17.639379 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-23261da7-e494-4a9d-9946-0db60e6bcef2 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:17.830782 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9aa0ad2b-ec71-433e-a572-075c655e827e tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4307d3ab621244f29d98d8ef2a40538a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6d0a20c16d4c229b3e7488cf75a35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:17.846924 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9aa0ad2b-ec71-433e-a572-075c655e827e tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] 10.222.0.20 "GET /compute/v2.1/servers/795440d0-6c9d-4317-9c59-dcc268cfa354" status: 200 len: 1267 microversion: 2.1 time: 0.287143 Oct 04 18:50:17.849945 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2417/4883] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:17 2022] GET /compute/v2.1/servers/795440d0-6c9d-4317-9c59-dcc268cfa354 => generated 1267 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:17.862896 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7e2ffa24-334d-43da-95fb-779a8f712f2c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:17.866103 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7e2ffa24-334d-43da-95fb-779a8f712f2c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:17.876430 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7e2ffa24-334d-43da-95fb-779a8f712f2c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:17.877323 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7e2ffa24-334d-43da-95fb-779a8f712f2c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:17.878390 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7e2ffa24-334d-43da-95fb-779a8f712f2c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:17.879692 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7e2ffa24-334d-43da-95fb-779a8f712f2c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:17.885457 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7e2ffa24-334d-43da-95fb-779a8f712f2c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:17.885457 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7e2ffa24-334d-43da-95fb-779a8f712f2c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:18.024187 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-23261da7-e494-4a9d-9946-0db60e6bcef2 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:18.058464 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-23261da7-e494-4a9d-9946-0db60e6bcef2 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/3209d143-9e5f-4529-a0bb-8fea0c22083b" status: 200 len: 1553 microversion: 2.1 time: 0.459889 Oct 04 18:50:18.059467 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2467/4884] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:17 2022] GET /compute/v2.1/servers/3209d143-9e5f-4529-a0bb-8fea0c22083b => generated 1553 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:18.200193 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7e2ffa24-334d-43da-95fb-779a8f712f2c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "POST /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238/action" status: 202 len: 0 microversion: 2.1 time: 0.347793 Oct 04 18:50:18.204897 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2418/4885] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:50:17 2022] POST /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238/action => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:50:18.212419 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-baa7bd00-fb3f-47c9-9e5d-3a7badb519d1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:18.213319 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-baa7bd00-fb3f-47c9-9e5d-3a7badb519d1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:18.220993 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-baa7bd00-fb3f-47c9-9e5d-3a7badb519d1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:18.222710 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-baa7bd00-fb3f-47c9-9e5d-3a7badb519d1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:18.222710 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-baa7bd00-fb3f-47c9-9e5d-3a7badb519d1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:18.222710 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-baa7bd00-fb3f-47c9-9e5d-3a7badb519d1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:18.223296 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-baa7bd00-fb3f-47c9-9e5d-3a7badb519d1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:18.223909 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-baa7bd00-fb3f-47c9-9e5d-3a7badb519d1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:18.683517 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-baa7bd00-fb3f-47c9-9e5d-3a7badb519d1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:18.698002 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-baa7bd00-fb3f-47c9-9e5d-3a7badb519d1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1674 microversion: 2.1 time: 0.491283 Oct 04 18:50:18.701258 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2468/4886] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:18 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1674 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:18.876759 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d4c0a815-ac94-4671-adfb-126348606396 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:18.880713 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d4c0a815-ac94-4671-adfb-126348606396 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] [instance: 795440d0-6c9d-4317-9c59-dcc268cfa354] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:18.910161 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d4c0a815-ac94-4671-adfb-126348606396 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:18.911079 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d4c0a815-ac94-4671-adfb-126348606396 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:18.912952 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d4c0a815-ac94-4671-adfb-126348606396 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:18.913948 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d4c0a815-ac94-4671-adfb-126348606396 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:18.915455 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d4c0a815-ac94-4671-adfb-126348606396 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:18.924703 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d4c0a815-ac94-4671-adfb-126348606396 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:19.096310 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5e6706d8-3f37-4003-982d-06e650293241 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:19.096947 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5e6706d8-3f37-4003-982d-06e650293241 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: 3209d143-9e5f-4529-a0bb-8fea0c22083b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:19.113199 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5e6706d8-3f37-4003-982d-06e650293241 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:19.114444 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5e6706d8-3f37-4003-982d-06e650293241 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:19.115042 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5e6706d8-3f37-4003-982d-06e650293241 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:19.116117 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5e6706d8-3f37-4003-982d-06e650293241 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:19.116883 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5e6706d8-3f37-4003-982d-06e650293241 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:19.117466 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5e6706d8-3f37-4003-982d-06e650293241 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:19.133164 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d4c0a815-ac94-4671-adfb-126348606396 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4307d3ab621244f29d98d8ef2a40538a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6d0a20c16d4c229b3e7488cf75a35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:19.145754 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d4c0a815-ac94-4671-adfb-126348606396 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] 10.222.0.20 "GET /compute/v2.1/servers/795440d0-6c9d-4317-9c59-dcc268cfa354" status: 200 len: 1275 microversion: 2.1 time: 0.279057 Oct 04 18:50:19.154326 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2419/4887] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:18 2022] GET /compute/v2.1/servers/795440d0-6c9d-4317-9c59-dcc268cfa354 => generated 1275 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:19.728915 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6830db16-da0b-4179-84b8-d6c083681518 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:19.729231 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-6830db16-da0b-4179-84b8-d6c083681518 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:19.739143 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6830db16-da0b-4179-84b8-d6c083681518 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:19.739632 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6830db16-da0b-4179-84b8-d6c083681518 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:19.740079 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6830db16-da0b-4179-84b8-d6c083681518 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:19.740799 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6830db16-da0b-4179-84b8-d6c083681518 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:19.745711 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6830db16-da0b-4179-84b8-d6c083681518 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:19.746181 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6830db16-da0b-4179-84b8-d6c083681518 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:20.160253 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-6830db16-da0b-4179-84b8-d6c083681518 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:20.170405 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6830db16-da0b-4179-84b8-d6c083681518 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1674 microversion: 2.1 time: 0.447433 Oct 04 18:50:20.180259 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2420/4888] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:19 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1674 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:20.183996 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-23fa67d4-e6da-4251-a245-d112e83705d8 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:20.196408 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-23fa67d4-e6da-4251-a245-d112e83705d8 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] [instance: 795440d0-6c9d-4317-9c59-dcc268cfa354] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:20.203822 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-23fa67d4-e6da-4251-a245-d112e83705d8 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:20.203944 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-23fa67d4-e6da-4251-a245-d112e83705d8 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:20.204456 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-23fa67d4-e6da-4251-a245-d112e83705d8 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:20.205158 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-23fa67d4-e6da-4251-a245-d112e83705d8 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:20.205624 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-23fa67d4-e6da-4251-a245-d112e83705d8 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:20.210286 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-23fa67d4-e6da-4251-a245-d112e83705d8 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:20.266888 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5e6706d8-3f37-4003-982d-06e650293241 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:20.282019 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5e6706d8-3f37-4003-982d-06e650293241 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/3209d143-9e5f-4529-a0bb-8fea0c22083b" status: 200 len: 1553 microversion: 2.1 time: 1.197773 Oct 04 18:50:20.305917 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2469/4889] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:19 2022] GET /compute/v2.1/servers/3209d143-9e5f-4529-a0bb-8fea0c22083b => generated 1553 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:20.332490 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-19d02c36-68fd-402f-a7d5-6a2dba12c08e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:20.333032 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-19d02c36-68fd-402f-a7d5-6a2dba12c08e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: e6b3ee80-2e17-4135-9f45-bef437385e0c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:20.348316 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-19d02c36-68fd-402f-a7d5-6a2dba12c08e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:20.349267 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-19d02c36-68fd-402f-a7d5-6a2dba12c08e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:20.349778 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-19d02c36-68fd-402f-a7d5-6a2dba12c08e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:20.350554 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-19d02c36-68fd-402f-a7d5-6a2dba12c08e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:20.351015 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-19d02c36-68fd-402f-a7d5-6a2dba12c08e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:20.351445 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-19d02c36-68fd-402f-a7d5-6a2dba12c08e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:20.372910 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-19d02c36-68fd-402f-a7d5-6a2dba12c08e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] HTTP exception thrown: Instance e6b3ee80-2e17-4135-9f45-bef437385e0c could not be found. Oct 04 18:50:20.375891 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-19d02c36-68fd-402f-a7d5-6a2dba12c08e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Request method failure captured: Oct 04 18:50:20.375891 n-d-850501-14 devstack@n-api.service[123001]: request: DELETE /compute/v2.1/servers/e6b3ee80-2e17-4135-9f45-bef437385e0c HTTP/1.1 Oct 04 18:50:20.375891 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:50:20.375891 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:50:20.375891 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:50:20.375891 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:50:20.375891 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:50:20.375891 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:50:20.375891 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:50:20.375891 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:50:20.375891 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPH9zAVdj2h4kh6QqBpYrS2CJMhbcXf529VUNrZoZOYhS2tkLYBgw6AHy860DK9jQ3xATqZvC9lQuxt-_H5qKsAI41eznf32K6QSGqVcHXegpVHrDueww23ZMVCBM3D_hH0NTzh4447rgHqcrC-OZE48IfZrRJ9KPLPjAHT57T3mcPIc Oct 04 18:50:20.375891 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:50:20.375891 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:50:20.375891 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:50:20.375891 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:50:20.375891 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:50:20.375891 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:50:20.375891 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: b6c6b9deecde44b5953d22b38b5b0ff1 Oct 04 18:50:20.375891 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:50:20.375891 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:50:20.375891 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:50:20.375891 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6c6b9deecde44b5953d22b38b5b0ff1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b6c6b9deecde44b5953d22b38b5b0ff1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b6c6b9deecde44b5953d22b38b5b0ff1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6c6b9deecde44b5953d22b38b5b0ff1"}]}] Oct 04 18:50:20.375891 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:50:20.375891 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: b6c6b9deecde44b5953d22b38b5b0ff1 Oct 04 18:50:20.375891 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:50:20.375891 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ServersNegativeTestJSON-626077540-project Oct 04 18:50:20.375891 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:50:20.375891 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:50:20.375891 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 5b4eb70f22ba4872b890a4f160cc1805 Oct 04 18:50:20.375891 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ServersNegativeTestJSON-626077540-project Oct 04 18:50:20.375891 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:50:20.375891 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance e6b3ee80-2e17-4135-9f45-bef437385e0c could not be found. Oct 04 18:50:20.375891 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': 'e6b3ee80-2e17-4135-9f45-bef437385e0c'} Oct 04 18:50:20.375891 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:50:20.375891 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:50:20.375891 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:50:20.375891 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:50:20.375891 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:50:20.375891 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:50:20.375891 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:50:20.375891 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:50:20.375891 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:50:20.375891 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:50:20.375891 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6b3ee80-2e17-4135-9f45-bef437385e0c could not be found. Oct 04 18:50:20.375891 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:50:20.375891 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:50:20.375891 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:50:20.375891 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:50:20.375891 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:50:20.375891 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:50:20.375891 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:50:20.375891 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:50:20.375891 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:50:20.375891 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:50:20.375891 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:50:20.375891 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:50:20.375891 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:50:20.375891 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:50:20.375891 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:50:20.375891 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:50:20.375891 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:50:20.375891 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:50:20.380631 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6b3ee80-2e17-4135-9f45-bef437385e0c could not be found. Oct 04 18:50:20.380631 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:50:20.380631 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:50:20.380631 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:50:20.380631 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:50:20.380631 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:50:20.380631 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:50:20.380631 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:50:20.380631 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:50:20.380631 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6b3ee80-2e17-4135-9f45-bef437385e0c could not be found. Oct 04 18:50:20.380631 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:50:20.380631 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-19d02c36-68fd-402f-a7d5-6a2dba12c08e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Returning 404 to user: Instance e6b3ee80-2e17-4135-9f45-bef437385e0c could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:50:20.380631 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-19d02c36-68fd-402f-a7d5-6a2dba12c08e tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e6b3ee80-2e17-4135-9f45-bef437385e0c" status: 404 len: 111 microversion: 2.1 time: 0.070016 Oct 04 18:50:20.380631 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2470/4890] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:50:20 2022] DELETE /compute/v2.1/servers/e6b3ee80-2e17-4135-9f45-bef437385e0c => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:50:20.391157 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-71f36d3e-91eb-46f8-91e7-67112a7a5a46 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:20.398779 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-71f36d3e-91eb-46f8-91e7-67112a7a5a46 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: e6b3ee80-2e17-4135-9f45-bef437385e0c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:20.399471 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-71f36d3e-91eb-46f8-91e7-67112a7a5a46 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:20.400083 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-71f36d3e-91eb-46f8-91e7-67112a7a5a46 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:20.400566 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-71f36d3e-91eb-46f8-91e7-67112a7a5a46 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:20.401287 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-71f36d3e-91eb-46f8-91e7-67112a7a5a46 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:20.401748 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-71f36d3e-91eb-46f8-91e7-67112a7a5a46 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:20.402173 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-71f36d3e-91eb-46f8-91e7-67112a7a5a46 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:20.411637 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-23fa67d4-e6da-4251-a245-d112e83705d8 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4307d3ab621244f29d98d8ef2a40538a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6d0a20c16d4c229b3e7488cf75a35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:20.419682 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-23fa67d4-e6da-4251-a245-d112e83705d8 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] 10.222.0.20 "GET /compute/v2.1/servers/795440d0-6c9d-4317-9c59-dcc268cfa354" status: 200 len: 1273 microversion: 2.1 time: 0.240594 Oct 04 18:50:20.436215 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2421/4891] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:20 2022] GET /compute/v2.1/servers/795440d0-6c9d-4317-9c59-dcc268cfa354 => generated 1273 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:20.437609 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-71f36d3e-91eb-46f8-91e7-67112a7a5a46 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] HTTP exception thrown: Instance e6b3ee80-2e17-4135-9f45-bef437385e0c could not be found. Oct 04 18:50:20.439600 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-71f36d3e-91eb-46f8-91e7-67112a7a5a46 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Request method failure captured: Oct 04 18:50:20.439600 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/e6b3ee80-2e17-4135-9f45-bef437385e0c HTTP/1.1 Oct 04 18:50:20.439600 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:50:20.439600 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:50:20.439600 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:50:20.439600 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:50:20.439600 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:50:20.439600 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:50:20.439600 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:50:20.439600 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:50:20.439600 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPH9zAVdj2h4kh6QqBpYrS2CJMhbcXf529VUNrZoZOYhS2tkLYBgw6AHy860DK9jQ3xATqZvC9lQuxt-_H5qKsAI41eznf32K6QSGqVcHXegpVHrDueww23ZMVCBM3D_hH0NTzh4447rgHqcrC-OZE48IfZrRJ9KPLPjAHT57T3mcPIc Oct 04 18:50:20.439600 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:50:20.439600 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:50:20.439600 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:50:20.439600 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:50:20.439600 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:50:20.439600 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:50:20.439600 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: b6c6b9deecde44b5953d22b38b5b0ff1 Oct 04 18:50:20.439600 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:50:20.439600 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:50:20.439600 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:50:20.439600 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6c6b9deecde44b5953d22b38b5b0ff1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b6c6b9deecde44b5953d22b38b5b0ff1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b6c6b9deecde44b5953d22b38b5b0ff1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6c6b9deecde44b5953d22b38b5b0ff1"}]}] Oct 04 18:50:20.439600 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:50:20.439600 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: b6c6b9deecde44b5953d22b38b5b0ff1 Oct 04 18:50:20.439600 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:50:20.439600 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ServersNegativeTestJSON-626077540-project Oct 04 18:50:20.439600 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:50:20.439600 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:50:20.439600 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 5b4eb70f22ba4872b890a4f160cc1805 Oct 04 18:50:20.439600 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ServersNegativeTestJSON-626077540-project Oct 04 18:50:20.439600 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:50:20.439600 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance e6b3ee80-2e17-4135-9f45-bef437385e0c could not be found. Oct 04 18:50:20.439600 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': 'e6b3ee80-2e17-4135-9f45-bef437385e0c'} Oct 04 18:50:20.439600 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:50:20.439600 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:50:20.439600 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:50:20.439600 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:50:20.439600 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:50:20.439600 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:50:20.439600 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:50:20.439600 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:50:20.439600 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:50:20.439600 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:50:20.439600 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6b3ee80-2e17-4135-9f45-bef437385e0c could not be found. Oct 04 18:50:20.439600 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:50:20.439600 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:50:20.439600 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:50:20.439600 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:50:20.439600 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:50:20.439600 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:50:20.439600 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:50:20.439600 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:50:20.439600 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:50:20.439600 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:50:20.439600 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:50:20.439600 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:50:20.439600 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:50:20.439600 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:50:20.439600 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:50:20.439600 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:50:20.439600 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6b3ee80-2e17-4135-9f45-bef437385e0c could not be found. Oct 04 18:50:20.439600 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:50:20.439600 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:50:20.439600 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:50:20.445240 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:50:20.445240 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:50:20.445240 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:50:20.445240 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:50:20.445240 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:50:20.445240 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6b3ee80-2e17-4135-9f45-bef437385e0c could not be found. Oct 04 18:50:20.445240 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:50:20.445240 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-71f36d3e-91eb-46f8-91e7-67112a7a5a46 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Returning 404 to user: Instance e6b3ee80-2e17-4135-9f45-bef437385e0c could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:50:20.445240 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-71f36d3e-91eb-46f8-91e7-67112a7a5a46 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/e6b3ee80-2e17-4135-9f45-bef437385e0c" status: 404 len: 111 microversion: 2.1 time: 0.054943 Oct 04 18:50:20.445240 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2471/4892] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:20 2022] GET /compute/v2.1/servers/e6b3ee80-2e17-4135-9f45-bef437385e0c => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:50:20.453944 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2bcc7b76-64ab-48e1-b3c4-721486a1e116 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:20.454704 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2bcc7b76-64ab-48e1-b3c4-721486a1e116 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:20.464460 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2bcc7b76-64ab-48e1-b3c4-721486a1e116 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:20.464460 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2bcc7b76-64ab-48e1-b3c4-721486a1e116 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:20.464460 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2bcc7b76-64ab-48e1-b3c4-721486a1e116 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:20.465269 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2bcc7b76-64ab-48e1-b3c4-721486a1e116 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:20.465947 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2bcc7b76-64ab-48e1-b3c4-721486a1e116 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:20.466670 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2bcc7b76-64ab-48e1-b3c4-721486a1e116 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:20.499764 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2bcc7b76-64ab-48e1-b3c4-721486a1e116 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Going to try to terminate instance {{(pid=123002) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:50:20.848457 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2bcc7b76-64ab-48e1-b3c4-721486a1e116 tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "DELETE /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 204 len: 0 microversion: 2.1 time: 0.399036 Oct 04 18:50:20.849818 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2422/4893] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:50:20 2022] DELETE /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:50:20.868445 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-59f113c9-9283-4a07-95a7-ed076f609f4b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:20.870293 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-59f113c9-9283-4a07-95a7-ed076f609f4b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:20.888765 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-59f113c9-9283-4a07-95a7-ed076f609f4b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:20.890714 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-59f113c9-9283-4a07-95a7-ed076f609f4b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:20.891212 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-59f113c9-9283-4a07-95a7-ed076f609f4b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:20.896005 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-59f113c9-9283-4a07-95a7-ed076f609f4b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:20.896360 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-59f113c9-9283-4a07-95a7-ed076f609f4b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:20.896576 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-59f113c9-9283-4a07-95a7-ed076f609f4b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:21.207070 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-bc0d7142-e0eb-4a84-9642-c68017295c03 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:21.207070 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-bc0d7142-e0eb-4a84-9642-c68017295c03 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:21.224654 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bc0d7142-e0eb-4a84-9642-c68017295c03 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:21.225314 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bc0d7142-e0eb-4a84-9642-c68017295c03 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:21.230090 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bc0d7142-e0eb-4a84-9642-c68017295c03 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:21.230090 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bc0d7142-e0eb-4a84-9642-c68017295c03 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:21.231910 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bc0d7142-e0eb-4a84-9642-c68017295c03 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:21.235290 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bc0d7142-e0eb-4a84-9642-c68017295c03 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:21.455888 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-59f113c9-9283-4a07-95a7-ed076f609f4b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:21.465240 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-59f113c9-9283-4a07-95a7-ed076f609f4b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1510 microversion: 2.1 time: 0.609159 Oct 04 18:50:21.471051 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2472/4894] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:20 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1510 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:21.484430 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-52394aff-6d1c-4186-b279-dfcfac637468 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:21.485347 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-52394aff-6d1c-4186-b279-dfcfac637468 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: 3209d143-9e5f-4529-a0bb-8fea0c22083b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:21.498340 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-52394aff-6d1c-4186-b279-dfcfac637468 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:21.499146 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-52394aff-6d1c-4186-b279-dfcfac637468 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:21.499798 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-52394aff-6d1c-4186-b279-dfcfac637468 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:21.500734 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-52394aff-6d1c-4186-b279-dfcfac637468 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:21.501506 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-52394aff-6d1c-4186-b279-dfcfac637468 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:21.502167 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-52394aff-6d1c-4186-b279-dfcfac637468 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:21.698475 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-52394aff-6d1c-4186-b279-dfcfac637468 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:21.707211 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-52394aff-6d1c-4186-b279-dfcfac637468 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/3209d143-9e5f-4529-a0bb-8fea0c22083b" status: 200 len: 1511 microversion: 2.1 time: 0.234698 Oct 04 18:50:21.713165 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2473/4895] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:21 2022] GET /compute/v2.1/servers/3209d143-9e5f-4529-a0bb-8fea0c22083b => generated 1511 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:21.723535 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8961d94d-6566-4ac0-81a4-ba1404076c53 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:21.724397 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8961d94d-6566-4ac0-81a4-ba1404076c53 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] [instance: 795440d0-6c9d-4317-9c59-dcc268cfa354] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:21.736632 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8961d94d-6566-4ac0-81a4-ba1404076c53 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:21.737121 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8961d94d-6566-4ac0-81a4-ba1404076c53 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:21.737558 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8961d94d-6566-4ac0-81a4-ba1404076c53 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:21.738269 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8961d94d-6566-4ac0-81a4-ba1404076c53 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:21.738718 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8961d94d-6566-4ac0-81a4-ba1404076c53 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:21.741464 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8961d94d-6566-4ac0-81a4-ba1404076c53 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:21.995534 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8961d94d-6566-4ac0-81a4-ba1404076c53 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4307d3ab621244f29d98d8ef2a40538a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6d0a20c16d4c229b3e7488cf75a35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:22.007515 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8961d94d-6566-4ac0-81a4-ba1404076c53 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] 10.222.0.20 "GET /compute/v2.1/servers/795440d0-6c9d-4317-9c59-dcc268cfa354" status: 200 len: 1273 microversion: 2.1 time: 0.287752 Oct 04 18:50:22.020681 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2474/4896] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:21 2022] GET /compute/v2.1/servers/795440d0-6c9d-4317-9c59-dcc268cfa354 => generated 1273 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:22.047181 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-92ecefd2-e869-41fd-887b-7c87e473cf93 req-6e7cb408-6d92-4ebf-8ae2-8c6bfacbeabe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3209d143-9e5f-4529-a0bb-8fea0c22083b", "name": "network-vif-deleted", "tag": "57f2dc22-09b7-47d9-b9e2-df30d366aaf2"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:22.080345 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-92ecefd2-e869-41fd-887b-7c87e473cf93 req-6e7cb408-6d92-4ebf-8ae2-8c6bfacbeabe service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:22.081255 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-92ecefd2-e869-41fd-887b-7c87e473cf93 req-6e7cb408-6d92-4ebf-8ae2-8c6bfacbeabe service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:22.081929 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-92ecefd2-e869-41fd-887b-7c87e473cf93 req-6e7cb408-6d92-4ebf-8ae2-8c6bfacbeabe service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:22.104448 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-92ecefd2-e869-41fd-887b-7c87e473cf93 req-6e7cb408-6d92-4ebf-8ae2-8c6bfacbeabe service nova] Creating event network-vif-deleted:57f2dc22-09b7-47d9-b9e2-df30d366aaf2 for instance 3209d143-9e5f-4529-a0bb-8fea0c22083b on n-h1-850501-14 Oct 04 18:50:22.113787 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-92ecefd2-e869-41fd-887b-7c87e473cf93 req-6e7cb408-6d92-4ebf-8ae2-8c6bfacbeabe service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091442 Oct 04 18:50:22.115028 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2475/4897] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:50:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:50:22.303677 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-bc0d7142-e0eb-4a84-9642-c68017295c03 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:22.339923 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-bc0d7142-e0eb-4a84-9642-c68017295c03 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1674 microversion: 2.1 time: 1.142379 Oct 04 18:50:22.341121 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2423/4898] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:21 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1674 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:50:22.495919 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-00095c9c-7dd8-401e-b636-61d646b7e02d tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:22.497773 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-00095c9c-7dd8-401e-b636-61d646b7e02d tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:22.506010 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-00095c9c-7dd8-401e-b636-61d646b7e02d tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:22.507134 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-00095c9c-7dd8-401e-b636-61d646b7e02d tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:22.508230 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-00095c9c-7dd8-401e-b636-61d646b7e02d tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:22.509171 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-00095c9c-7dd8-401e-b636-61d646b7e02d tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:22.509866 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-00095c9c-7dd8-401e-b636-61d646b7e02d tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:22.510506 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-00095c9c-7dd8-401e-b636-61d646b7e02d tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:22.740010 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-01b3fc77-4b12-47d8-9486-f894b59fc354 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:22.740947 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-01b3fc77-4b12-47d8-9486-f894b59fc354 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: 3209d143-9e5f-4529-a0bb-8fea0c22083b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:22.763293 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-01b3fc77-4b12-47d8-9486-f894b59fc354 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:22.764076 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-01b3fc77-4b12-47d8-9486-f894b59fc354 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:22.766325 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-00095c9c-7dd8-401e-b636-61d646b7e02d tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:22.766950 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-01b3fc77-4b12-47d8-9486-f894b59fc354 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:22.769737 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-01b3fc77-4b12-47d8-9486-f894b59fc354 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:22.772353 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-01b3fc77-4b12-47d8-9486-f894b59fc354 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:22.772804 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-01b3fc77-4b12-47d8-9486-f894b59fc354 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:22.775974 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-00095c9c-7dd8-401e-b636-61d646b7e02d tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1510 microversion: 2.1 time: 0.284603 Oct 04 18:50:22.777953 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2476/4899] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:22 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1510 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:22.785127 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:50:22.884939 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-01b3fc77-4b12-47d8-9486-f894b59fc354 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:22.896971 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-01b3fc77-4b12-47d8-9486-f894b59fc354 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/3209d143-9e5f-4529-a0bb-8fea0c22083b" status: 200 len: 1346 microversion: 2.1 time: 0.161077 Oct 04 18:50:22.911252 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2424/4900] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:22 2022] GET /compute/v2.1/servers/3209d143-9e5f-4529-a0bb-8fea0c22083b => generated 1346 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:50:23.036185 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-54d54e24-4359-4828-b08d-bb7b944f3be5 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:23.041212 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-54d54e24-4359-4828-b08d-bb7b944f3be5 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] [instance: 795440d0-6c9d-4317-9c59-dcc268cfa354] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:23.052513 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-54d54e24-4359-4828-b08d-bb7b944f3be5 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:23.053293 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-54d54e24-4359-4828-b08d-bb7b944f3be5 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:23.054030 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-54d54e24-4359-4828-b08d-bb7b944f3be5 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:23.054924 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-54d54e24-4359-4828-b08d-bb7b944f3be5 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:23.055564 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-54d54e24-4359-4828-b08d-bb7b944f3be5 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:23.056184 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-54d54e24-4359-4828-b08d-bb7b944f3be5 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:23.371498 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b5969c5f-10f2-4de0-ab2e-e1a2e123510c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:23.372327 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b5969c5f-10f2-4de0-ab2e-e1a2e123510c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:23.397296 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b5969c5f-10f2-4de0-ab2e-e1a2e123510c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:23.397810 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b5969c5f-10f2-4de0-ab2e-e1a2e123510c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:23.398253 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b5969c5f-10f2-4de0-ab2e-e1a2e123510c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:23.399354 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b5969c5f-10f2-4de0-ab2e-e1a2e123510c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:23.399824 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b5969c5f-10f2-4de0-ab2e-e1a2e123510c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:23.402457 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b5969c5f-10f2-4de0-ab2e-e1a2e123510c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:23.562222 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:50:23.802024 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-54d54e24-4359-4828-b08d-bb7b944f3be5 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4307d3ab621244f29d98d8ef2a40538a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6d0a20c16d4c229b3e7488cf75a35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:23.819783 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-54d54e24-4359-4828-b08d-bb7b944f3be5 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] 10.222.0.20 "GET /compute/v2.1/servers/795440d0-6c9d-4317-9c59-dcc268cfa354" status: 200 len: 1315 microversion: 2.1 time: 0.787966 Oct 04 18:50:23.849010 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2477/4901] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:23 2022] GET /compute/v2.1/servers/795440d0-6c9d-4317-9c59-dcc268cfa354 => generated 1315 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:23.854448 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-41096092-b1ef-4ce0-909a-4744cb56480c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:23.855974 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-41096092-b1ef-4ce0-909a-4744cb56480c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:23.864213 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-41096092-b1ef-4ce0-909a-4744cb56480c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:23.867245 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-41096092-b1ef-4ce0-909a-4744cb56480c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:23.874865 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-41096092-b1ef-4ce0-909a-4744cb56480c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:23.874865 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-41096092-b1ef-4ce0-909a-4744cb56480c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:23.874865 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-41096092-b1ef-4ce0-909a-4744cb56480c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:23.874865 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-41096092-b1ef-4ce0-909a-4744cb56480c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:23.884135 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b5969c5f-10f2-4de0-ab2e-e1a2e123510c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:23.913259 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b5969c5f-10f2-4de0-ab2e-e1a2e123510c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1679 microversion: 2.1 time: 0.545877 Oct 04 18:50:23.924423 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2425/4902] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:23 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1679 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:23.947801 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-683cc486-2f1b-4568-b2a9-b47b607f9ae1 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:23.948384 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-683cc486-2f1b-4568-b2a9-b47b607f9ae1 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: 3209d143-9e5f-4529-a0bb-8fea0c22083b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:23.964407 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-683cc486-2f1b-4568-b2a9-b47b607f9ae1 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:23.966429 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-683cc486-2f1b-4568-b2a9-b47b607f9ae1 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:23.968688 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-683cc486-2f1b-4568-b2a9-b47b607f9ae1 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:23.969657 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-683cc486-2f1b-4568-b2a9-b47b607f9ae1 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:23.971804 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-683cc486-2f1b-4568-b2a9-b47b607f9ae1 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:23.973685 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-683cc486-2f1b-4568-b2a9-b47b607f9ae1 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:24.043691 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:50:24.122375 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-683cc486-2f1b-4568-b2a9-b47b607f9ae1 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:24.157604 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-683cc486-2f1b-4568-b2a9-b47b607f9ae1 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/3209d143-9e5f-4529-a0bb-8fea0c22083b" status: 200 len: 1346 microversion: 2.1 time: 0.210620 Oct 04 18:50:24.157604 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2426/4903] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:23 2022] GET /compute/v2.1/servers/3209d143-9e5f-4529-a0bb-8fea0c22083b => generated 1346 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:24.291513 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-41096092-b1ef-4ce0-909a-4744cb56480c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:24.305672 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-41096092-b1ef-4ce0-909a-4744cb56480c tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1510 microversion: 2.1 time: 0.455127 Oct 04 18:50:24.320095 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2478/4904] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:23 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1510 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:24.632983 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-308a153b-2d84-4ea1-a361-da86ba1d3f0a req-95b15321-22b4-450a-bc16-fbbf3509efb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95fb1a13-7441-4f74-ad81-5a9413496545", "name": "network-vif-deleted", "tag": "73befc4a-98f7-414e-8302-6ba3a3fd9481"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:24.673472 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-308a153b-2d84-4ea1-a361-da86ba1d3f0a req-95b15321-22b4-450a-bc16-fbbf3509efb8 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:24.674555 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-308a153b-2d84-4ea1-a361-da86ba1d3f0a req-95b15321-22b4-450a-bc16-fbbf3509efb8 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:24.675339 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-308a153b-2d84-4ea1-a361-da86ba1d3f0a req-95b15321-22b4-450a-bc16-fbbf3509efb8 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:24.694589 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-308a153b-2d84-4ea1-a361-da86ba1d3f0a req-95b15321-22b4-450a-bc16-fbbf3509efb8 service nova] Creating event network-vif-deleted:73befc4a-98f7-414e-8302-6ba3a3fd9481 for instance 95fb1a13-7441-4f74-ad81-5a9413496545 on n-h2-850501-14 Oct 04 18:50:24.702427 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-308a153b-2d84-4ea1-a361-da86ba1d3f0a req-95b15321-22b4-450a-bc16-fbbf3509efb8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072558 Oct 04 18:50:24.703928 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2427/4905] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:50:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:50:24.848001 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-656be690-c89c-4052-9f9f-9f44cc5129e7 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:24.849408 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-656be690-c89c-4052-9f9f-9f44cc5129e7 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] [instance: 795440d0-6c9d-4317-9c59-dcc268cfa354] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:24.859560 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:50:24.862328 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-656be690-c89c-4052-9f9f-9f44cc5129e7 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:24.863058 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-656be690-c89c-4052-9f9f-9f44cc5129e7 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:24.863732 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-656be690-c89c-4052-9f9f-9f44cc5129e7 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:24.864707 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-656be690-c89c-4052-9f9f-9f44cc5129e7 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:24.865920 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-656be690-c89c-4052-9f9f-9f44cc5129e7 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:24.866588 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-656be690-c89c-4052-9f9f-9f44cc5129e7 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:24.948669 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2000385a-4cf3-4443-9082-89f64dfbc954 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:24.949383 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2000385a-4cf3-4443-9082-89f64dfbc954 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:24.959695 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2000385a-4cf3-4443-9082-89f64dfbc954 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:24.960586 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2000385a-4cf3-4443-9082-89f64dfbc954 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:24.961203 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2000385a-4cf3-4443-9082-89f64dfbc954 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:24.962180 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2000385a-4cf3-4443-9082-89f64dfbc954 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:24.962852 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2000385a-4cf3-4443-9082-89f64dfbc954 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:24.963944 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2000385a-4cf3-4443-9082-89f64dfbc954 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:25.175528 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=8 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:50:25.277473 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-656be690-c89c-4052-9f9f-9f44cc5129e7 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4307d3ab621244f29d98d8ef2a40538a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6d0a20c16d4c229b3e7488cf75a35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:25.279270 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2000385a-4cf3-4443-9082-89f64dfbc954 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:25.287468 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-656be690-c89c-4052-9f9f-9f44cc5129e7 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] 10.222.0.20 "GET /compute/v2.1/servers/795440d0-6c9d-4317-9c59-dcc268cfa354" status: 200 len: 1315 microversion: 2.1 time: 0.444907 Oct 04 18:50:25.288673 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2479/4906] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:24 2022] GET /compute/v2.1/servers/795440d0-6c9d-4317-9c59-dcc268cfa354 => generated 1315 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:25.293084 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2000385a-4cf3-4443-9082-89f64dfbc954 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1672 microversion: 2.1 time: 0.349518 Oct 04 18:50:25.304109 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2428/4907] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:24 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1672 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:50:25.324573 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6972c386-1dfd-4e41-85c7-bacdfc59e0ec tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:25.324785 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7e764fea-0dee-4f0a-a3b7-88e9233340b3 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:25.326293 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6972c386-1dfd-4e41-85c7-bacdfc59e0ec tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: 3209d143-9e5f-4529-a0bb-8fea0c22083b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:25.328333 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7e764fea-0dee-4f0a-a3b7-88e9233340b3 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:25.334953 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6972c386-1dfd-4e41-85c7-bacdfc59e0ec tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:25.335893 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6972c386-1dfd-4e41-85c7-bacdfc59e0ec tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:25.336778 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6972c386-1dfd-4e41-85c7-bacdfc59e0ec tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:25.337733 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6972c386-1dfd-4e41-85c7-bacdfc59e0ec tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:25.338441 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6972c386-1dfd-4e41-85c7-bacdfc59e0ec tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:25.339031 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6972c386-1dfd-4e41-85c7-bacdfc59e0ec tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:25.342026 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7e764fea-0dee-4f0a-a3b7-88e9233340b3 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:25.353581 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7e764fea-0dee-4f0a-a3b7-88e9233340b3 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:25.353581 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7e764fea-0dee-4f0a-a3b7-88e9233340b3 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:25.353581 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7e764fea-0dee-4f0a-a3b7-88e9233340b3 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:25.353581 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7e764fea-0dee-4f0a-a3b7-88e9233340b3 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:25.353581 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7e764fea-0dee-4f0a-a3b7-88e9233340b3 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:25.451401 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7e764fea-0dee-4f0a-a3b7-88e9233340b3 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "POST /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238/action" status: 200 len: 324 microversion: 2.1 time: 0.130841 Oct 04 18:50:25.459523 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2429/4908] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:50:25 2022] POST /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238/action => generated 324 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:50:25.470142 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-28a964f4-320c-4336-a78a-2a8f68b6fdee tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:25.476283 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-28a964f4-320c-4336-a78a-2a8f68b6fdee tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:25.494657 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-28a964f4-320c-4336-a78a-2a8f68b6fdee tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:25.496903 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-28a964f4-320c-4336-a78a-2a8f68b6fdee tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:25.497663 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-28a964f4-320c-4336-a78a-2a8f68b6fdee tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:25.499316 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-28a964f4-320c-4336-a78a-2a8f68b6fdee tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:25.500072 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-28a964f4-320c-4336-a78a-2a8f68b6fdee tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:25.500681 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-28a964f4-320c-4336-a78a-2a8f68b6fdee tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:25.513685 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6972c386-1dfd-4e41-85c7-bacdfc59e0ec tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:25.532552 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6972c386-1dfd-4e41-85c7-bacdfc59e0ec tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/3209d143-9e5f-4529-a0bb-8fea0c22083b" status: 200 len: 1346 microversion: 2.1 time: 0.238091 Oct 04 18:50:25.533335 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2480/4909] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:25 2022] GET /compute/v2.1/servers/3209d143-9e5f-4529-a0bb-8fea0c22083b => generated 1346 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:25.544659 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-28a964f4-320c-4336-a78a-2a8f68b6fdee tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:25.545435 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-28a964f4-320c-4336-a78a-2a8f68b6fdee tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:25.546079 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-28a964f4-320c-4336-a78a-2a8f68b6fdee tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:25.546376 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-736dbe60-317c-450f-9710-1dfdb94d321f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:25.547096 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-736dbe60-317c-450f-9710-1dfdb94d321f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:25.547417 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-28a964f4-320c-4336-a78a-2a8f68b6fdee tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lazy-loading 'fault' on Instance uuid 95fb1a13-7441-4f74-ad81-5a9413496545 {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:50:25.558530 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-736dbe60-317c-450f-9710-1dfdb94d321f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:25.562243 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-736dbe60-317c-450f-9710-1dfdb94d321f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:25.562936 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-736dbe60-317c-450f-9710-1dfdb94d321f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:25.563768 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-736dbe60-317c-450f-9710-1dfdb94d321f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:25.564441 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-736dbe60-317c-450f-9710-1dfdb94d321f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:25.565024 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-736dbe60-317c-450f-9710-1dfdb94d321f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:25.632639 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-28a964f4-320c-4336-a78a-2a8f68b6fdee tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4eb70f22ba4872b890a4f160cc1805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c6b9deecde44b5953d22b38b5b0ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:25.650166 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-28a964f4-320c-4336-a78a-2a8f68b6fdee tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 200 len: 1307 microversion: 2.1 time: 0.188875 Oct 04 18:50:25.651312 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2430/4910] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:25 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 1307 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:25.926158 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-736dbe60-317c-450f-9710-1dfdb94d321f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:25.934999 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-736dbe60-317c-450f-9710-1dfdb94d321f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1672 microversion: 2.1 time: 0.400444 Oct 04 18:50:25.937019 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2481/4911] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:25 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1672 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:25.962895 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-65721078-c67d-4843-a408-939d05e1f99d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:25.973352 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-65721078-c67d-4843-a408-939d05e1f99d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:25.996514 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-65721078-c67d-4843-a408-939d05e1f99d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:25.997334 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-65721078-c67d-4843-a408-939d05e1f99d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:25.997933 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-65721078-c67d-4843-a408-939d05e1f99d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:25.998935 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-65721078-c67d-4843-a408-939d05e1f99d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:25.999839 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-65721078-c67d-4843-a408-939d05e1f99d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:26.000530 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-65721078-c67d-4843-a408-939d05e1f99d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:26.232083 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-65721078-c67d-4843-a408-939d05e1f99d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:26.252769 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-65721078-c67d-4843-a408-939d05e1f99d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1672 microversion: 2.1 time: 0.286568 Oct 04 18:50:26.266095 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2431/4912] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:25 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1672 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:26.278260 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-fb577fad-2373-43bb-b20b-1965fdad0a6d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:26.279471 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-fb577fad-2373-43bb-b20b-1965fdad0a6d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:26.295644 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fb577fad-2373-43bb-b20b-1965fdad0a6d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:26.300958 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fb577fad-2373-43bb-b20b-1965fdad0a6d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:26.301455 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fb577fad-2373-43bb-b20b-1965fdad0a6d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:26.302213 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fb577fad-2373-43bb-b20b-1965fdad0a6d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:26.303815 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fb577fad-2373-43bb-b20b-1965fdad0a6d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:26.303815 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fb577fad-2373-43bb-b20b-1965fdad0a6d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:26.315725 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c04be145-400b-4ffa-bca8-598b93f80c56 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:26.316386 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c04be145-400b-4ffa-bca8-598b93f80c56 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] [instance: 795440d0-6c9d-4317-9c59-dcc268cfa354] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:26.328607 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c04be145-400b-4ffa-bca8-598b93f80c56 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:26.329111 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c04be145-400b-4ffa-bca8-598b93f80c56 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:26.329622 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c04be145-400b-4ffa-bca8-598b93f80c56 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:26.330281 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c04be145-400b-4ffa-bca8-598b93f80c56 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:26.330763 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c04be145-400b-4ffa-bca8-598b93f80c56 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:26.331200 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c04be145-400b-4ffa-bca8-598b93f80c56 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:26.747873 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-fb577fad-2373-43bb-b20b-1965fdad0a6d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:26.760810 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-fb577fad-2373-43bb-b20b-1965fdad0a6d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1672 microversion: 2.1 time: 0.484920 Oct 04 18:50:26.761428 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2482/4913] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:26 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1672 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:26.789981 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-44159c0e-9d1e-4cce-a35d-ee7dbf7a5ac3 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:26.799833 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-44159c0e-9d1e-4cce-a35d-ee7dbf7a5ac3 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: 3209d143-9e5f-4529-a0bb-8fea0c22083b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:26.809328 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-44159c0e-9d1e-4cce-a35d-ee7dbf7a5ac3 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:26.810413 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-44159c0e-9d1e-4cce-a35d-ee7dbf7a5ac3 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:26.811157 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-44159c0e-9d1e-4cce-a35d-ee7dbf7a5ac3 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:26.812082 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-44159c0e-9d1e-4cce-a35d-ee7dbf7a5ac3 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:26.812732 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-44159c0e-9d1e-4cce-a35d-ee7dbf7a5ac3 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:26.814390 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-44159c0e-9d1e-4cce-a35d-ee7dbf7a5ac3 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:27.122153 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c04be145-400b-4ffa-bca8-598b93f80c56 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4307d3ab621244f29d98d8ef2a40538a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6d0a20c16d4c229b3e7488cf75a35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:27.138656 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c04be145-400b-4ffa-bca8-598b93f80c56 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] 10.222.0.20 "GET /compute/v2.1/servers/795440d0-6c9d-4317-9c59-dcc268cfa354" status: 200 len: 1315 microversion: 2.1 time: 0.827574 Oct 04 18:50:27.141422 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2432/4914] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:26 2022] GET /compute/v2.1/servers/795440d0-6c9d-4317-9c59-dcc268cfa354 => generated 1315 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:27.175650 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0f8de351-c60d-465f-b68d-1d0d1952488b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:27.175650 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0f8de351-c60d-465f-b68d-1d0d1952488b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] [instance: 95fb1a13-7441-4f74-ad81-5a9413496545] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:27.175927 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-44159c0e-9d1e-4cce-a35d-ee7dbf7a5ac3 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:27.178221 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0f8de351-c60d-465f-b68d-1d0d1952488b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:27.178408 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-44159c0e-9d1e-4cce-a35d-ee7dbf7a5ac3 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/3209d143-9e5f-4529-a0bb-8fea0c22083b" status: 200 len: 1346 microversion: 2.1 time: 0.394106 Oct 04 18:50:27.178573 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0f8de351-c60d-465f-b68d-1d0d1952488b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:27.178573 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0f8de351-c60d-465f-b68d-1d0d1952488b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:27.178573 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0f8de351-c60d-465f-b68d-1d0d1952488b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:27.178573 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0f8de351-c60d-465f-b68d-1d0d1952488b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:27.178573 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0f8de351-c60d-465f-b68d-1d0d1952488b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:27.188473 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2483/4915] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:26 2022] GET /compute/v2.1/servers/3209d143-9e5f-4529-a0bb-8fea0c22083b => generated 1346 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:27.197126 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d612e184-71a2-42a0-96a8-9d94d33fc0b2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:27.206421 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-0f8de351-c60d-465f-b68d-1d0d1952488b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] HTTP exception thrown: Instance 95fb1a13-7441-4f74-ad81-5a9413496545 could not be found. Oct 04 18:50:27.206575 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d612e184-71a2-42a0-96a8-9d94d33fc0b2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:27.206677 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0f8de351-c60d-465f-b68d-1d0d1952488b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Request method failure captured: Oct 04 18:50:27.206677 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 HTTP/1.1 Oct 04 18:50:27.206677 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:50:27.206677 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:50:27.206677 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:50:27.206677 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:50:27.206677 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:50:27.206677 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:50:27.206677 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:50:27.206677 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:50:27.206677 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH9zAVdj2h4kh6QqBpYrS2CJMhbcXf529VUNrZoZOYhS2tkLYBgw6AHy860DK9jQ3xATqZvC9lQuxt-_H5qKsAI41eznf32K6QSGqVcHXegpVHrDueww23ZMVCBM3D_hH0NTzh4447rgHqcrC-OZE48IfZrRJ9KPLPjAHT57T3mcPIc Oct 04 18:50:27.206677 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:50:27.206677 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:50:27.206677 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:50:27.206677 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:50:27.206677 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:50:27.206677 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:50:27.206677 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: b6c6b9deecde44b5953d22b38b5b0ff1 Oct 04 18:50:27.206677 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:50:27.206677 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:50:27.206677 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:50:27.206677 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6c6b9deecde44b5953d22b38b5b0ff1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b6c6b9deecde44b5953d22b38b5b0ff1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b6c6b9deecde44b5953d22b38b5b0ff1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6c6b9deecde44b5953d22b38b5b0ff1"}]}] Oct 04 18:50:27.206677 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:50:27.206677 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: b6c6b9deecde44b5953d22b38b5b0ff1 Oct 04 18:50:27.206677 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServersNegativeTestJSON-626077540 Oct 04 18:50:27.206677 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServersNegativeTestJSON-626077540-project Oct 04 18:50:27.206677 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:50:27.206677 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:50:27.206677 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 5b4eb70f22ba4872b890a4f160cc1805 Oct 04 18:50:27.206677 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServersNegativeTestJSON-626077540-project Oct 04 18:50:27.206677 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:50:27.206677 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 95fb1a13-7441-4f74-ad81-5a9413496545 could not be found. Oct 04 18:50:27.206677 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '95fb1a13-7441-4f74-ad81-5a9413496545'} Oct 04 18:50:27.206677 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:50:27.206677 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:50:27.206677 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:50:27.206677 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:50:27.206677 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:50:27.206677 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:50:27.206677 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:50:27.206677 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:50:27.206677 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:50:27.206677 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:50:27.206677 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95fb1a13-7441-4f74-ad81-5a9413496545 could not be found. Oct 04 18:50:27.206677 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:50:27.206677 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:50:27.206677 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:50:27.206677 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:50:27.206677 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:50:27.206677 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:50:27.206677 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:50:27.206677 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:50:27.206677 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:50:27.206677 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:50:27.206677 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:50:27.206677 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:50:27.206677 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:50:27.206677 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:50:27.206677 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:50:27.206677 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:50:27.206677 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95fb1a13-7441-4f74-ad81-5a9413496545 could not be found. Oct 04 18:50:27.206677 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:50:27.206677 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:50:27.206677 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:50:27.211655 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:50:27.211655 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:50:27.211655 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:50:27.211655 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:50:27.211655 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:50:27.211655 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95fb1a13-7441-4f74-ad81-5a9413496545 could not be found. Oct 04 18:50:27.211655 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:50:27.211655 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0f8de351-c60d-465f-b68d-1d0d1952488b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] Returning 404 to user: Instance 95fb1a13-7441-4f74-ad81-5a9413496545 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:50:27.214196 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0f8de351-c60d-465f-b68d-1d0d1952488b tempest-ServersNegativeTestJSON-626077540 tempest-ServersNegativeTestJSON-626077540-project] 10.222.0.20 "GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545" status: 404 len: 111 microversion: 2.1 time: 0.057716 Oct 04 18:50:27.214196 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2433/4916] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:27 2022] GET /compute/v2.1/servers/95fb1a13-7441-4f74-ad81-5a9413496545 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:50:27.217019 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d612e184-71a2-42a0-96a8-9d94d33fc0b2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:27.218163 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d612e184-71a2-42a0-96a8-9d94d33fc0b2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:27.218610 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d612e184-71a2-42a0-96a8-9d94d33fc0b2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:27.219423 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d612e184-71a2-42a0-96a8-9d94d33fc0b2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:27.219890 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d612e184-71a2-42a0-96a8-9d94d33fc0b2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:27.220357 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d612e184-71a2-42a0-96a8-9d94d33fc0b2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:27.220544 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-2f5914a5-6ead-413f-8f3e-9295d42d951c req-73140071-41f0-46d8-bce7-7d98297a6b45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "795440d0-6c9d-4317-9c59-dcc268cfa354", "tag": "8add3ba8-ff09-4d66-8428-6407ddbd2e5b"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:27.234355 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-2f5914a5-6ead-413f-8f3e-9295d42d951c req-73140071-41f0-46d8-bce7-7d98297a6b45 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:27.235065 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-2f5914a5-6ead-413f-8f3e-9295d42d951c req-73140071-41f0-46d8-bce7-7d98297a6b45 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:27.240888 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-2f5914a5-6ead-413f-8f3e-9295d42d951c req-73140071-41f0-46d8-bce7-7d98297a6b45 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:27.259787 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=100 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:50:27.261622 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-2f5914a5-6ead-413f-8f3e-9295d42d951c req-73140071-41f0-46d8-bce7-7d98297a6b45 service nova] Creating event network-changed:8add3ba8-ff09-4d66-8428-6407ddbd2e5b for instance 795440d0-6c9d-4317-9c59-dcc268cfa354 on n-h2-850501-14 Oct 04 18:50:27.269897 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-2f5914a5-6ead-413f-8f3e-9295d42d951c req-73140071-41f0-46d8-bce7-7d98297a6b45 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055585 Oct 04 18:50:27.281378 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2434/4917] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:50:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:50:27.913351 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d612e184-71a2-42a0-96a8-9d94d33fc0b2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:27.923575 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d612e184-71a2-42a0-96a8-9d94d33fc0b2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1672 microversion: 2.1 time: 0.733586 Oct 04 18:50:27.924791 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2484/4918] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:27 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1672 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:28.103037 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8def6c97-79ad-4ca3-b3cb-f8ae5a8b6878 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-984302745", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": [{"uuid": "5739801d-d64f-45ac-b67b-5773a9d23794"}]}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:28.180934 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-cb2bfd9b-31d4-4e2d-ac26-7c2eb8869724 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:28.181601 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-cb2bfd9b-31d4-4e2d-ac26-7c2eb8869724 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] [instance: 795440d0-6c9d-4317-9c59-dcc268cfa354] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:28.195742 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cb2bfd9b-31d4-4e2d-ac26-7c2eb8869724 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:28.197906 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cb2bfd9b-31d4-4e2d-ac26-7c2eb8869724 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:28.198372 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cb2bfd9b-31d4-4e2d-ac26-7c2eb8869724 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:28.199103 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cb2bfd9b-31d4-4e2d-ac26-7c2eb8869724 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:28.203405 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cb2bfd9b-31d4-4e2d-ac26-7c2eb8869724 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:28.204240 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cb2bfd9b-31d4-4e2d-ac26-7c2eb8869724 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:28.241498 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-8def6c97-79ad-4ca3-b3cb-f8ae5a8b6878 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] validate_networks() for [('5739801d-d64f-45ac-b67b-5773a9d23794', None, None, None, None, None)] {{(pid=123002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:50:28.844340 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-cb2bfd9b-31d4-4e2d-ac26-7c2eb8869724 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4307d3ab621244f29d98d8ef2a40538a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6d0a20c16d4c229b3e7488cf75a35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:28.861843 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-cb2bfd9b-31d4-4e2d-ac26-7c2eb8869724 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] 10.222.0.20 "GET /compute/v2.1/servers/795440d0-6c9d-4317-9c59-dcc268cfa354" status: 200 len: 1315 microversion: 2.1 time: 0.691620 Oct 04 18:50:28.862470 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2485/4919] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:28 2022] GET /compute/v2.1/servers/795440d0-6c9d-4317-9c59-dcc268cfa354 => generated 1315 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:28.867598 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a6deac41-6604-476e-8bbe-6e2998f0e4e0 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:28.868567 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a6deac41-6604-476e-8bbe-6e2998f0e4e0 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: 3209d143-9e5f-4529-a0bb-8fea0c22083b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:28.885983 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a6deac41-6604-476e-8bbe-6e2998f0e4e0 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:28.887862 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a6deac41-6604-476e-8bbe-6e2998f0e4e0 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:28.888532 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a6deac41-6604-476e-8bbe-6e2998f0e4e0 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:28.892244 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a6deac41-6604-476e-8bbe-6e2998f0e4e0 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:28.894292 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a6deac41-6604-476e-8bbe-6e2998f0e4e0 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:28.894858 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a6deac41-6604-476e-8bbe-6e2998f0e4e0 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:29.350774 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a6deac41-6604-476e-8bbe-6e2998f0e4e0 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:29.380664 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a6deac41-6604-476e-8bbe-6e2998f0e4e0 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/3209d143-9e5f-4529-a0bb-8fea0c22083b" status: 200 len: 1346 microversion: 2.1 time: 0.516648 Oct 04 18:50:29.397671 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2486/4920] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:28 2022] GET /compute/v2.1/servers/3209d143-9e5f-4529-a0bb-8fea0c22083b => generated 1346 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:29.898035 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b010fc88-d6a9-4b5c-b9b4-3ea79c82e88f tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:29.898651 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b010fc88-d6a9-4b5c-b9b4-3ea79c82e88f tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] [instance: 795440d0-6c9d-4317-9c59-dcc268cfa354] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:29.909014 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b010fc88-d6a9-4b5c-b9b4-3ea79c82e88f tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:29.909857 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b010fc88-d6a9-4b5c-b9b4-3ea79c82e88f tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:29.910954 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b010fc88-d6a9-4b5c-b9b4-3ea79c82e88f tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:29.911886 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b010fc88-d6a9-4b5c-b9b4-3ea79c82e88f tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:29.912597 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b010fc88-d6a9-4b5c-b9b4-3ea79c82e88f tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:29.913212 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b010fc88-d6a9-4b5c-b9b4-3ea79c82e88f tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:30.269316 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b010fc88-d6a9-4b5c-b9b4-3ea79c82e88f tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4307d3ab621244f29d98d8ef2a40538a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6d0a20c16d4c229b3e7488cf75a35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:30.283941 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b010fc88-d6a9-4b5c-b9b4-3ea79c82e88f tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] 10.222.0.20 "GET /compute/v2.1/servers/795440d0-6c9d-4317-9c59-dcc268cfa354" status: 200 len: 1315 microversion: 2.1 time: 0.391388 Oct 04 18:50:30.285193 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2487/4921] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:29 2022] GET /compute/v2.1/servers/795440d0-6c9d-4317-9c59-dcc268cfa354 => generated 1315 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:50:30.411187 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-12c1eaea-a53d-418a-8142-8d09b5534b07 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:30.412665 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-12c1eaea-a53d-418a-8142-8d09b5534b07 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: 3209d143-9e5f-4529-a0bb-8fea0c22083b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:30.423789 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-12c1eaea-a53d-418a-8142-8d09b5534b07 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:30.424580 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-12c1eaea-a53d-418a-8142-8d09b5534b07 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:30.425271 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-12c1eaea-a53d-418a-8142-8d09b5534b07 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:30.426345 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-12c1eaea-a53d-418a-8142-8d09b5534b07 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:30.426966 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-12c1eaea-a53d-418a-8142-8d09b5534b07 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:30.427616 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-12c1eaea-a53d-418a-8142-8d09b5534b07 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:30.447270 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-12c1eaea-a53d-418a-8142-8d09b5534b07 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] HTTP exception thrown: Instance 3209d143-9e5f-4529-a0bb-8fea0c22083b could not be found. Oct 04 18:50:30.449760 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-12c1eaea-a53d-418a-8142-8d09b5534b07 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Request method failure captured: Oct 04 18:50:30.449760 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/3209d143-9e5f-4529-a0bb-8fea0c22083b HTTP/1.1 Oct 04 18:50:30.449760 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:50:30.449760 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:50:30.449760 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:50:30.449760 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:50:30.449760 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:50:30.449760 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:50:30.449760 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:50:30.449760 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:50:30.449760 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPIAZ5RZP-L2AfGhXbSAirsikFtiKRJw8GbD2F4avTn6csTjPvYW4EgckMMa_odYrXTBqTIarrxxpsgj83P_nCf0n9cSTNLxyj6f4zISS1Nx3NxppTvrxz8bw1hclhfH5hpAMl_7yiEWC9J95Zeea4ou_80fw0GmE8GZRBOxEg7cn1lU Oct 04 18:50:30.449760 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:50:30.449760 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:50:30.449760 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:50:30.449760 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:50:30.449760 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:50:30.449760 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:50:30.449760 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 4154ec20e0354ee6a425ba853b8efe67 Oct 04 18:50:30.449760 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-DeleteServersTestJSON-806460860 Oct 04 18:50:30.449760 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:50:30.449760 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:50:30.449760 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4154ec20e0354ee6a425ba853b8efe67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4154ec20e0354ee6a425ba853b8efe67", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4154ec20e0354ee6a425ba853b8efe67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4154ec20e0354ee6a425ba853b8efe67"}]}] Oct 04 18:50:30.449760 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-DeleteServersTestJSON-806460860 Oct 04 18:50:30.449760 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 4154ec20e0354ee6a425ba853b8efe67 Oct 04 18:50:30.449760 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-DeleteServersTestJSON-806460860 Oct 04 18:50:30.449760 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-DeleteServersTestJSON-806460860-project Oct 04 18:50:30.449760 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:50:30.449760 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:50:30.449760 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: c56b67cede6b46f5a36a723d361b3245 Oct 04 18:50:30.449760 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-DeleteServersTestJSON-806460860-project Oct 04 18:50:30.449760 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:50:30.449760 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 3209d143-9e5f-4529-a0bb-8fea0c22083b could not be found. Oct 04 18:50:30.449760 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '3209d143-9e5f-4529-a0bb-8fea0c22083b'} Oct 04 18:50:30.449760 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:50:30.449760 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:50:30.449760 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:50:30.449760 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:50:30.449760 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:50:30.449760 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:50:30.449760 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:50:30.449760 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:50:30.449760 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:50:30.449760 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:50:30.449760 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3209d143-9e5f-4529-a0bb-8fea0c22083b could not be found. Oct 04 18:50:30.449760 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:50:30.449760 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:50:30.449760 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:50:30.449760 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:50:30.449760 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:50:30.449760 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:50:30.449760 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:50:30.449760 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:50:30.449760 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:50:30.449760 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:50:30.449760 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:50:30.449760 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:50:30.449760 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:50:30.449760 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:50:30.449760 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:50:30.449760 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:50:30.449760 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3209d143-9e5f-4529-a0bb-8fea0c22083b could not be found. Oct 04 18:50:30.449760 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:50:30.449760 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:50:30.449760 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:50:30.457077 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:50:30.457077 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:50:30.457077 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:50:30.457077 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:50:30.457077 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:50:30.457077 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3209d143-9e5f-4529-a0bb-8fea0c22083b could not be found. Oct 04 18:50:30.457077 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:50:30.459664 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-12c1eaea-a53d-418a-8142-8d09b5534b07 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Returning 404 to user: Instance 3209d143-9e5f-4529-a0bb-8fea0c22083b could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:50:30.462415 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-12c1eaea-a53d-418a-8142-8d09b5534b07 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/3209d143-9e5f-4529-a0bb-8fea0c22083b" status: 404 len: 111 microversion: 2.1 time: 0.056277 Oct 04 18:50:30.467299 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-8def6c97-79ad-4ca3-b3cb-f8ae5a8b6878 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:50:30.468235 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2488/4922] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:30 2022] GET /compute/v2.1/servers/3209d143-9e5f-4529-a0bb-8fea0c22083b => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:50:30.475759 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-8def6c97-79ad-4ca3-b3cb-f8ae5a8b6878 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:50:30.476415 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-8def6c97-79ad-4ca3-b3cb-f8ae5a8b6878 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:50:30.476841 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-8def6c97-79ad-4ca3-b3cb-f8ae5a8b6878 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:50:30.477266 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-8def6c97-79ad-4ca3-b3cb-f8ae5a8b6878 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:50:30.496865 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8def6c97-79ad-4ca3-b3cb-f8ae5a8b6878 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:30.497365 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8def6c97-79ad-4ca3-b3cb-f8ae5a8b6878 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:30.497802 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8def6c97-79ad-4ca3-b3cb-f8ae5a8b6878 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:30.499348 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8def6c97-79ad-4ca3-b3cb-f8ae5a8b6878 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:30.500284 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8def6c97-79ad-4ca3-b3cb-f8ae5a8b6878 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:30.501641 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8def6c97-79ad-4ca3-b3cb-f8ae5a8b6878 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:30.562975 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-8def6c97-79ad-4ca3-b3cb-f8ae5a8b6878 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Getting quotas for project 57d8fd392d5b4e8798cb51fe0e54ad3b. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:50:30.575795 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-8def6c97-79ad-4ca3-b3cb-f8ae5a8b6878 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Getting quotas for user ee7fee2b098d4eb8bdc8df2a929cdede and project 57d8fd392d5b4e8798cb51fe0e54ad3b. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:50:30.613090 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8def6c97-79ad-4ca3-b3cb-f8ae5a8b6878 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Going to run 1 instances... {{(pid=123002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:50:30.615582 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8def6c97-79ad-4ca3-b3cb-f8ae5a8b6878 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: dcecca6b-779d-4b0f-900a-02287aaac41f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:50:30.656006 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a37b030e-8455-41ed-87f5-effd6a61b004 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:30.663751 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a37b030e-8455-41ed-87f5-effd6a61b004 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: 3209d143-9e5f-4529-a0bb-8fea0c22083b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:30.674885 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a37b030e-8455-41ed-87f5-effd6a61b004 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:30.675660 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a37b030e-8455-41ed-87f5-effd6a61b004 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:30.676289 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a37b030e-8455-41ed-87f5-effd6a61b004 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:30.679714 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a37b030e-8455-41ed-87f5-effd6a61b004 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:30.679714 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a37b030e-8455-41ed-87f5-effd6a61b004 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:30.679714 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a37b030e-8455-41ed-87f5-effd6a61b004 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:30.708736 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-a37b030e-8455-41ed-87f5-effd6a61b004 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] HTTP exception thrown: Instance 3209d143-9e5f-4529-a0bb-8fea0c22083b could not be found. Oct 04 18:50:30.710573 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a37b030e-8455-41ed-87f5-effd6a61b004 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Request method failure captured: Oct 04 18:50:30.710573 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/3209d143-9e5f-4529-a0bb-8fea0c22083b/os-volume_attachments HTTP/1.1 Oct 04 18:50:30.710573 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:50:30.710573 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:50:30.710573 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:50:30.710573 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:50:30.710573 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:50:30.710573 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:50:30.710573 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:50:30.710573 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:50:30.710573 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPIAZ5RZP-L2AfGhXbSAirsikFtiKRJw8GbD2F4avTn6csTjPvYW4EgckMMa_odYrXTBqTIarrxxpsgj83P_nCf0n9cSTNLxyj6f4zISS1Nx3NxppTvrxz8bw1hclhfH5hpAMl_7yiEWC9J95Zeea4ou_80fw0GmE8GZRBOxEg7cn1lU Oct 04 18:50:30.710573 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:50:30.710573 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:50:30.710573 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:50:30.710573 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:50:30.710573 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:50:30.710573 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:50:30.710573 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 4154ec20e0354ee6a425ba853b8efe67 Oct 04 18:50:30.710573 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-DeleteServersTestJSON-806460860 Oct 04 18:50:30.710573 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:50:30.710573 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:50:30.710573 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4154ec20e0354ee6a425ba853b8efe67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4154ec20e0354ee6a425ba853b8efe67", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4154ec20e0354ee6a425ba853b8efe67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4154ec20e0354ee6a425ba853b8efe67"}]}] Oct 04 18:50:30.710573 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-DeleteServersTestJSON-806460860 Oct 04 18:50:30.710573 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 4154ec20e0354ee6a425ba853b8efe67 Oct 04 18:50:30.710573 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-DeleteServersTestJSON-806460860 Oct 04 18:50:30.710573 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-DeleteServersTestJSON-806460860-project Oct 04 18:50:30.710573 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:50:30.710573 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:50:30.710573 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: c56b67cede6b46f5a36a723d361b3245 Oct 04 18:50:30.710573 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-DeleteServersTestJSON-806460860-project Oct 04 18:50:30.710573 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:50:30.710573 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 3209d143-9e5f-4529-a0bb-8fea0c22083b could not be found. Oct 04 18:50:30.710573 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'server_id': '3209d143-9e5f-4529-a0bb-8fea0c22083b'} Oct 04 18:50:30.710573 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:50:30.710573 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:50:30.710573 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:50:30.710573 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:50:30.710573 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:50:30.710573 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:50:30.710573 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:50:30.710573 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:50:30.710573 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:50:30.710573 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:50:30.710573 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3209d143-9e5f-4529-a0bb-8fea0c22083b could not be found. Oct 04 18:50:30.710573 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:50:30.710573 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:50:30.710573 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:50:30.710573 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:50:30.710573 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:50:30.710573 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:50:30.710573 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:50:30.710573 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:50:30.710573 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:50:30.710573 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:50:30.710573 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:50:30.710573 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:50:30.710573 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:50:30.710573 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:50:30.710573 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 04 18:50:30.710573 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 04 18:50:30.710573 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:50:30.710573 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:50:30.715544 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3209d143-9e5f-4529-a0bb-8fea0c22083b could not be found. Oct 04 18:50:30.715544 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:50:30.715544 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:50:30.715544 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:50:30.715544 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:50:30.715544 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:50:30.715544 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:50:30.715544 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:50:30.715544 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:50:30.715544 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3209d143-9e5f-4529-a0bb-8fea0c22083b could not be found. Oct 04 18:50:30.715544 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:50:30.718154 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a37b030e-8455-41ed-87f5-effd6a61b004 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Returning 404 to user: Instance 3209d143-9e5f-4529-a0bb-8fea0c22083b could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:50:30.719295 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a37b030e-8455-41ed-87f5-effd6a61b004 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/3209d143-9e5f-4529-a0bb-8fea0c22083b/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.073464 Oct 04 18:50:30.723841 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2489/4923] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 18:50:30 2022] GET /compute/v2.1/servers/3209d143-9e5f-4529-a0bb-8fea0c22083b/os-volume_attachments => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:50:30.887431 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8def6c97-79ad-4ca3-b3cb-f8ae5a8b6878 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.790738 Oct 04 18:50:30.894503 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2435/4924] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:50:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 2799 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:50:30.899761 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-af0ffb0d-befb-4bc6-9fc0-54d3413961be tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:30.900749 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-af0ffb0d-befb-4bc6-9fc0-54d3413961be tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: dcecca6b-779d-4b0f-900a-02287aaac41f] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:31.007254 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3b346f39-9980-4637-b19b-aa8efcda3b73 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-709438269", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": [{"uuid": "8e684a5f-0995-474b-b515-28954add873e"}]}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:31.043873 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-af0ffb0d-befb-4bc6-9fc0-54d3413961be tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:31.054263 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-af0ffb0d-befb-4bc6-9fc0-54d3413961be tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/dcecca6b-779d-4b0f-900a-02287aaac41f" status: 200 len: 1214 microversion: 2.1 time: 0.156645 Oct 04 18:50:31.054874 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2490/4925] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:30 2022] GET /compute/v2.1/servers/dcecca6b-779d-4b0f-900a-02287aaac41f => generated 1214 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:50:31.124131 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-3b346f39-9980-4637-b19b-aa8efcda3b73 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] validate_networks() for [('8e684a5f-0995-474b-b515-28954add873e', None, None, None, None, None)] {{(pid=123002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:50:31.307501 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5deb34d6-0c9e-4220-a41d-c4d59c8013ad tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:31.308136 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5deb34d6-0c9e-4220-a41d-c4d59c8013ad tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] [instance: 795440d0-6c9d-4317-9c59-dcc268cfa354] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:31.325415 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5deb34d6-0c9e-4220-a41d-c4d59c8013ad tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:31.326327 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5deb34d6-0c9e-4220-a41d-c4d59c8013ad tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:31.326979 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5deb34d6-0c9e-4220-a41d-c4d59c8013ad tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:31.328416 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5deb34d6-0c9e-4220-a41d-c4d59c8013ad tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:31.329274 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5deb34d6-0c9e-4220-a41d-c4d59c8013ad tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:31.330468 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5deb34d6-0c9e-4220-a41d-c4d59c8013ad tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:32.265109 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5deb34d6-0c9e-4220-a41d-c4d59c8013ad tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4307d3ab621244f29d98d8ef2a40538a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6d0a20c16d4c229b3e7488cf75a35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:32.280928 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5deb34d6-0c9e-4220-a41d-c4d59c8013ad tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] 10.222.0.20 "GET /compute/v2.1/servers/795440d0-6c9d-4317-9c59-dcc268cfa354" status: 200 len: 1315 microversion: 2.1 time: 0.976786 Oct 04 18:50:32.282294 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2491/4926] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:31 2022] GET /compute/v2.1/servers/795440d0-6c9d-4317-9c59-dcc268cfa354 => generated 1315 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:32.291387 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d590d08f-95ad-40d4-954d-072925aa6d0c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:32.292254 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d590d08f-95ad-40d4-954d-072925aa6d0c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: dcecca6b-779d-4b0f-900a-02287aaac41f] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:32.301106 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d590d08f-95ad-40d4-954d-072925aa6d0c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:32.303779 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d590d08f-95ad-40d4-954d-072925aa6d0c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:32.303779 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d590d08f-95ad-40d4-954d-072925aa6d0c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:32.303779 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d590d08f-95ad-40d4-954d-072925aa6d0c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:32.304306 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d590d08f-95ad-40d4-954d-072925aa6d0c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:32.304843 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d590d08f-95ad-40d4-954d-072925aa6d0c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:32.480917 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d590d08f-95ad-40d4-954d-072925aa6d0c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:32.494642 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d590d08f-95ad-40d4-954d-072925aa6d0c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/dcecca6b-779d-4b0f-900a-02287aaac41f" status: 200 len: 1218 microversion: 2.1 time: 0.210854 Oct 04 18:50:32.496467 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2492/4927] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:32 2022] GET /compute/v2.1/servers/dcecca6b-779d-4b0f-900a-02287aaac41f => generated 1218 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:32.711045 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-812a53df-812b-468e-99b9-633b63f80243 req-b50a08dd-54ea-4f94-aabc-f772cd1f70b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "795440d0-6c9d-4317-9c59-dcc268cfa354", "name": "network-vif-plugged", "status": "completed", "tag": "8add3ba8-ff09-4d66-8428-6407ddbd2e5b"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:32.734933 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-812a53df-812b-468e-99b9-633b63f80243 req-b50a08dd-54ea-4f94-aabc-f772cd1f70b4 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:32.735409 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-812a53df-812b-468e-99b9-633b63f80243 req-b50a08dd-54ea-4f94-aabc-f772cd1f70b4 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:32.736274 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-812a53df-812b-468e-99b9-633b63f80243 req-b50a08dd-54ea-4f94-aabc-f772cd1f70b4 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:32.749836 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-812a53df-812b-468e-99b9-633b63f80243 req-b50a08dd-54ea-4f94-aabc-f772cd1f70b4 service nova] Creating event network-vif-plugged:8add3ba8-ff09-4d66-8428-6407ddbd2e5b for instance 795440d0-6c9d-4317-9c59-dcc268cfa354 on n-h2-850501-14 Oct 04 18:50:32.755552 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-812a53df-812b-468e-99b9-633b63f80243 req-b50a08dd-54ea-4f94-aabc-f772cd1f70b4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051003 Oct 04 18:50:32.756536 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2493/4928] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:50:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:50:32.859646 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-3b346f39-9980-4637-b19b-aa8efcda3b73 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:50:32.860232 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-3b346f39-9980-4637-b19b-aa8efcda3b73 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:50:32.860603 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-3b346f39-9980-4637-b19b-aa8efcda3b73 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:50:32.861020 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-3b346f39-9980-4637-b19b-aa8efcda3b73 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:50:32.861447 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-3b346f39-9980-4637-b19b-aa8efcda3b73 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:50:32.871607 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3b346f39-9980-4637-b19b-aa8efcda3b73 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:32.872405 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3b346f39-9980-4637-b19b-aa8efcda3b73 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:32.873648 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3b346f39-9980-4637-b19b-aa8efcda3b73 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:32.875100 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3b346f39-9980-4637-b19b-aa8efcda3b73 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:32.875357 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3b346f39-9980-4637-b19b-aa8efcda3b73 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:32.876007 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3b346f39-9980-4637-b19b-aa8efcda3b73 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:32.896372 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-3b346f39-9980-4637-b19b-aa8efcda3b73 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Getting quotas for project 4154ec20e0354ee6a425ba853b8efe67. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:50:32.902127 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-3b346f39-9980-4637-b19b-aa8efcda3b73 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Getting quotas for user c56b67cede6b46f5a36a723d361b3245 and project 4154ec20e0354ee6a425ba853b8efe67. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:50:32.919372 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3b346f39-9980-4637-b19b-aa8efcda3b73 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Going to run 1 instances... {{(pid=123002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:50:32.925443 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3b346f39-9980-4637-b19b-aa8efcda3b73 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: b652bf6c-d91a-4569-88ab-4874851ae618] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:50:32.933779 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:50:33.069344 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3b346f39-9980-4637-b19b-aa8efcda3b73 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.066118 Oct 04 18:50:33.072648 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2436/4929] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:50:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 2070 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:50:33.086387 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-54028525-3c4a-419c-b2e8-28f89663a6d0 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:33.087450 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-54028525-3c4a-419c-b2e8-28f89663a6d0 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: b652bf6c-d91a-4569-88ab-4874851ae618] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:33.255961 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-54028525-3c4a-419c-b2e8-28f89663a6d0 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:33.264522 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-54028525-3c4a-419c-b2e8-28f89663a6d0 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/b652bf6c-d91a-4569-88ab-4874851ae618" status: 200 len: 1214 microversion: 2.1 time: 0.182794 Oct 04 18:50:33.270096 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2494/4930] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:33 2022] GET /compute/v2.1/servers/b652bf6c-d91a-4569-88ab-4874851ae618 => generated 1214 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:50:33.298892 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-29116c89-df2a-4da6-8715-46dd7c51ba98 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:33.298892 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-29116c89-df2a-4da6-8715-46dd7c51ba98 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: b652bf6c-d91a-4569-88ab-4874851ae618] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:33.305376 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-758ee2d5-69bb-4d18-a86f-d9f9e63a4bdb tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:33.306116 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-758ee2d5-69bb-4d18-a86f-d9f9e63a4bdb tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] [instance: 795440d0-6c9d-4317-9c59-dcc268cfa354] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:33.319792 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-758ee2d5-69bb-4d18-a86f-d9f9e63a4bdb tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:33.323116 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-758ee2d5-69bb-4d18-a86f-d9f9e63a4bdb tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:33.327031 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-758ee2d5-69bb-4d18-a86f-d9f9e63a4bdb tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:33.332265 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-758ee2d5-69bb-4d18-a86f-d9f9e63a4bdb tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:33.336777 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-758ee2d5-69bb-4d18-a86f-d9f9e63a4bdb tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:33.338084 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-758ee2d5-69bb-4d18-a86f-d9f9e63a4bdb tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:33.339627 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-29116c89-df2a-4da6-8715-46dd7c51ba98 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: b652bf6c-d91a-4569-88ab-4874851ae618] Going to try to terminate instance {{(pid=123002) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:50:34.169764 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.scheduler.client.report [None req-29116c89-df2a-4da6-8715-46dd7c51ba98 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Deleted allocations for instance b652bf6c-d91a-4569-88ab-4874851ae618 Oct 04 18:50:34.174275 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.compute.api [None req-29116c89-df2a-4da6-8715-46dd7c51ba98 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: b652bf6c-d91a-4569-88ab-4874851ae618] Instance Mapping does not exist while attempting local delete cleanup. Oct 04 18:50:34.175462 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-29116c89-df2a-4da6-8715-46dd7c51ba98 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b652bf6c-d91a-4569-88ab-4874851ae618" status: 204 len: 0 microversion: 2.1 time: 0.886774 Oct 04 18:50:34.176794 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2437/4931] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:50:33 2022] DELETE /compute/v2.1/servers/b652bf6c-d91a-4569-88ab-4874851ae618 => generated 0 bytes in 888 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:50:34.203692 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-af1aa2c3-c2fb-4825-98f7-6c534cee33eb tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:34.203692 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-af1aa2c3-c2fb-4825-98f7-6c534cee33eb tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: dcecca6b-779d-4b0f-900a-02287aaac41f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:34.218091 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-af1aa2c3-c2fb-4825-98f7-6c534cee33eb tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:34.223625 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-af1aa2c3-c2fb-4825-98f7-6c534cee33eb tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:34.224991 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-af1aa2c3-c2fb-4825-98f7-6c534cee33eb tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:34.228985 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-af1aa2c3-c2fb-4825-98f7-6c534cee33eb tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:34.228985 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-af1aa2c3-c2fb-4825-98f7-6c534cee33eb tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:34.228985 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-af1aa2c3-c2fb-4825-98f7-6c534cee33eb tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:34.297682 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-758ee2d5-69bb-4d18-a86f-d9f9e63a4bdb tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4307d3ab621244f29d98d8ef2a40538a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6d0a20c16d4c229b3e7488cf75a35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:34.312650 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-758ee2d5-69bb-4d18-a86f-d9f9e63a4bdb tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] 10.222.0.20 "GET /compute/v2.1/servers/795440d0-6c9d-4317-9c59-dcc268cfa354" status: 200 len: 1315 microversion: 2.1 time: 1.011892 Oct 04 18:50:34.313255 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2495/4932] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:33 2022] GET /compute/v2.1/servers/795440d0-6c9d-4317-9c59-dcc268cfa354 => generated 1315 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:34.342705 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d0b65a38-c30f-41cb-8039-7c6ea4b0ac13 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:34.343714 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d0b65a38-c30f-41cb-8039-7c6ea4b0ac13 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: b652bf6c-d91a-4569-88ab-4874851ae618] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:34.382448 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-d0b65a38-c30f-41cb-8039-7c6ea4b0ac13 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] HTTP exception thrown: Instance b652bf6c-d91a-4569-88ab-4874851ae618 could not be found. Oct 04 18:50:34.384948 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d0b65a38-c30f-41cb-8039-7c6ea4b0ac13 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Request method failure captured: Oct 04 18:50:34.384948 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/b652bf6c-d91a-4569-88ab-4874851ae618 HTTP/1.1 Oct 04 18:50:34.384948 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:50:34.384948 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:50:34.384948 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:50:34.384948 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:50:34.384948 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:50:34.384948 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:50:34.384948 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:50:34.384948 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:50:34.384948 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPIAZ5RZP-L2AfGhXbSAirsikFtiKRJw8GbD2F4avTn6csTjPvYW4EgckMMa_odYrXTBqTIarrxxpsgj83P_nCf0n9cSTNLxyj6f4zISS1Nx3NxppTvrxz8bw1hclhfH5hpAMl_7yiEWC9J95Zeea4ou_80fw0GmE8GZRBOxEg7cn1lU Oct 04 18:50:34.384948 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:50:34.384948 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:50:34.384948 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:50:34.384948 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:50:34.384948 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:50:34.384948 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:50:34.384948 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 4154ec20e0354ee6a425ba853b8efe67 Oct 04 18:50:34.384948 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-DeleteServersTestJSON-806460860 Oct 04 18:50:34.384948 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:50:34.384948 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:50:34.384948 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4154ec20e0354ee6a425ba853b8efe67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4154ec20e0354ee6a425ba853b8efe67", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4154ec20e0354ee6a425ba853b8efe67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4154ec20e0354ee6a425ba853b8efe67"}]}] Oct 04 18:50:34.384948 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-DeleteServersTestJSON-806460860 Oct 04 18:50:34.384948 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 4154ec20e0354ee6a425ba853b8efe67 Oct 04 18:50:34.384948 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-DeleteServersTestJSON-806460860 Oct 04 18:50:34.384948 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-DeleteServersTestJSON-806460860-project Oct 04 18:50:34.384948 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:50:34.384948 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:50:34.384948 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: c56b67cede6b46f5a36a723d361b3245 Oct 04 18:50:34.384948 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-DeleteServersTestJSON-806460860-project Oct 04 18:50:34.384948 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:50:34.384948 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance b652bf6c-d91a-4569-88ab-4874851ae618 could not be found. Oct 04 18:50:34.384948 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': 'b652bf6c-d91a-4569-88ab-4874851ae618'} Oct 04 18:50:34.384948 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:50:34.384948 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:50:34.384948 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:50:34.384948 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:50:34.384948 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:50:34.384948 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:50:34.384948 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:50:34.384948 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:50:34.384948 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b652bf6c-d91a-4569-88ab-4874851ae618 could not be found. Oct 04 18:50:34.384948 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:50:34.384948 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:50:34.384948 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:50:34.384948 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:50:34.384948 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:50:34.384948 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:50:34.384948 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:50:34.384948 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:50:34.384948 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:50:34.384948 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:50:34.384948 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:50:34.384948 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:50:34.384948 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:50:34.384948 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:50:34.384948 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:50:34.384948 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:50:34.384948 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b652bf6c-d91a-4569-88ab-4874851ae618 could not be found. Oct 04 18:50:34.384948 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:50:34.384948 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:50:34.384948 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:50:34.384948 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:50:34.384948 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:50:34.391751 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:50:34.391751 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:50:34.391751 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:50:34.391751 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b652bf6c-d91a-4569-88ab-4874851ae618 could not be found. Oct 04 18:50:34.391751 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:50:34.397127 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d0b65a38-c30f-41cb-8039-7c6ea4b0ac13 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Returning 404 to user: Instance b652bf6c-d91a-4569-88ab-4874851ae618 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:50:34.402684 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d0b65a38-c30f-41cb-8039-7c6ea4b0ac13 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/b652bf6c-d91a-4569-88ab-4874851ae618" status: 404 len: 111 microversion: 2.1 time: 0.077135 Oct 04 18:50:34.406015 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2496/4933] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:34 2022] GET /compute/v2.1/servers/b652bf6c-d91a-4569-88ab-4874851ae618 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:50:34.686186 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-32a2f562-d8a7-47e3-94d6-66c900455851 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1965715525", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": [{"uuid": "8e684a5f-0995-474b-b515-28954add873e"}]}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:34.770490 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.neutron [None req-32a2f562-d8a7-47e3-94d6-66c900455851 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] validate_networks() for [('8e684a5f-0995-474b-b515-28954add873e', None, None, None, None, None)] {{(pid=123001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:50:34.846620 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-af1aa2c3-c2fb-4825-98f7-6c534cee33eb tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:34.856656 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-af1aa2c3-c2fb-4825-98f7-6c534cee33eb tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/dcecca6b-779d-4b0f-900a-02287aaac41f" status: 200 len: 1274 microversion: 2.1 time: 0.677365 Oct 04 18:50:34.871953 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2438/4934] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:34 2022] GET /compute/v2.1/servers/dcecca6b-779d-4b0f-900a-02287aaac41f => generated 1274 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:35.349534 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6d18c64a-d519-4e5f-af90-cc1f1efcf08d tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:35.351160 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-6d18c64a-d519-4e5f-af90-cc1f1efcf08d tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] [instance: 795440d0-6c9d-4317-9c59-dcc268cfa354] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:35.369178 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6d18c64a-d519-4e5f-af90-cc1f1efcf08d tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:35.372248 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6d18c64a-d519-4e5f-af90-cc1f1efcf08d tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:35.373575 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6d18c64a-d519-4e5f-af90-cc1f1efcf08d tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:35.375613 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6d18c64a-d519-4e5f-af90-cc1f1efcf08d tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:35.377341 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6d18c64a-d519-4e5f-af90-cc1f1efcf08d tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:35.378715 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6d18c64a-d519-4e5f-af90-cc1f1efcf08d tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:36.012510 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-6d18c64a-d519-4e5f-af90-cc1f1efcf08d tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4307d3ab621244f29d98d8ef2a40538a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6d0a20c16d4c229b3e7488cf75a35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:36.021395 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6d18c64a-d519-4e5f-af90-cc1f1efcf08d tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] 10.222.0.20 "GET /compute/v2.1/servers/795440d0-6c9d-4317-9c59-dcc268cfa354" status: 200 len: 1503 microversion: 2.1 time: 0.677187 Oct 04 18:50:36.024105 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2439/4935] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:35 2022] GET /compute/v2.1/servers/795440d0-6c9d-4317-9c59-dcc268cfa354 => generated 1503 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:36.035355 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1a0928d4-54ce-4563-ab62-5a49cf09293d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:36.036166 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1a0928d4-54ce-4563-ab62-5a49cf09293d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: dcecca6b-779d-4b0f-900a-02287aaac41f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:36.064016 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1a0928d4-54ce-4563-ab62-5a49cf09293d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:36.064844 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1a0928d4-54ce-4563-ab62-5a49cf09293d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:36.065568 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1a0928d4-54ce-4563-ab62-5a49cf09293d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:36.066545 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1a0928d4-54ce-4563-ab62-5a49cf09293d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:36.067272 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1a0928d4-54ce-4563-ab62-5a49cf09293d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:36.068237 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1a0928d4-54ce-4563-ab62-5a49cf09293d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:36.653579 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-32a2f562-d8a7-47e3-94d6-66c900455851 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:50:36.654752 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-32a2f562-d8a7-47e3-94d6-66c900455851 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:50:36.655798 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-32a2f562-d8a7-47e3-94d6-66c900455851 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:50:36.656998 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-32a2f562-d8a7-47e3-94d6-66c900455851 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:50:36.657752 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-32a2f562-d8a7-47e3-94d6-66c900455851 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:50:36.674047 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-32a2f562-d8a7-47e3-94d6-66c900455851 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:36.682769 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-32a2f562-d8a7-47e3-94d6-66c900455851 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:36.683606 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-32a2f562-d8a7-47e3-94d6-66c900455851 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:36.684715 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-32a2f562-d8a7-47e3-94d6-66c900455851 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:36.685952 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-32a2f562-d8a7-47e3-94d6-66c900455851 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:36.686631 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-32a2f562-d8a7-47e3-94d6-66c900455851 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:36.745077 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-32a2f562-d8a7-47e3-94d6-66c900455851 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Getting quotas for project 4154ec20e0354ee6a425ba853b8efe67. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:50:36.774856 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1a0928d4-54ce-4563-ab62-5a49cf09293d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:36.777099 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-32a2f562-d8a7-47e3-94d6-66c900455851 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Getting quotas for user c56b67cede6b46f5a36a723d361b3245 and project 4154ec20e0354ee6a425ba853b8efe67. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:50:36.790529 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1a0928d4-54ce-4563-ab62-5a49cf09293d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/dcecca6b-779d-4b0f-900a-02287aaac41f" status: 200 len: 1272 microversion: 2.1 time: 0.758898 Oct 04 18:50:36.792373 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2440/4936] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:36 2022] GET /compute/v2.1/servers/dcecca6b-779d-4b0f-900a-02287aaac41f => generated 1272 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:36.804376 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-58026ea8-b2de-4171-a496-cfac47df5800 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:36.805482 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-58026ea8-b2de-4171-a496-cfac47df5800 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] [instance: 795440d0-6c9d-4317-9c59-dcc268cfa354] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:36.822516 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-58026ea8-b2de-4171-a496-cfac47df5800 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:36.823018 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-58026ea8-b2de-4171-a496-cfac47df5800 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:36.823174 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-32a2f562-d8a7-47e3-94d6-66c900455851 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Going to run 1 instances... {{(pid=123001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:50:36.823458 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-58026ea8-b2de-4171-a496-cfac47df5800 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:36.825833 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-32a2f562-d8a7-47e3-94d6-66c900455851 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: c6d7d726-8e3f-44de-8d6f-2d8c6187e8df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:50:36.827376 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-58026ea8-b2de-4171-a496-cfac47df5800 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:36.827959 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-58026ea8-b2de-4171-a496-cfac47df5800 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:36.831479 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-58026ea8-b2de-4171-a496-cfac47df5800 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:37.050638 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-32a2f562-d8a7-47e3-94d6-66c900455851 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.390250 Oct 04 18:50:37.056152 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2497/4937] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:50:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 2393 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:50:37.068179 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0a77509b-9102-4ef9-9e11-4278ebc31baa tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:37.068972 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0a77509b-9102-4ef9-9e11-4278ebc31baa tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: c6d7d726-8e3f-44de-8d6f-2d8c6187e8df] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:37.302665 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0a77509b-9102-4ef9-9e11-4278ebc31baa tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:37.314140 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0a77509b-9102-4ef9-9e11-4278ebc31baa tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/c6d7d726-8e3f-44de-8d6f-2d8c6187e8df" status: 200 len: 1215 microversion: 2.1 time: 0.251918 Oct 04 18:50:37.334164 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2498/4938] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:37 2022] GET /compute/v2.1/servers/c6d7d726-8e3f-44de-8d6f-2d8c6187e8df => generated 1215 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:37.518441 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-58026ea8-b2de-4171-a496-cfac47df5800 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4307d3ab621244f29d98d8ef2a40538a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6d0a20c16d4c229b3e7488cf75a35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:37.540673 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-58026ea8-b2de-4171-a496-cfac47df5800 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] 10.222.0.20 "GET /compute/v2.1/servers/795440d0-6c9d-4317-9c59-dcc268cfa354" status: 200 len: 1503 microversion: 2.1 time: 0.746948 Oct 04 18:50:37.547882 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2441/4939] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:36 2022] GET /compute/v2.1/servers/795440d0-6c9d-4317-9c59-dcc268cfa354 => generated 1503 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:37.567521 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-fa973c53-20c8-4d3f-a8a8-ac0d035f6b07 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:37.568547 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-fa973c53-20c8-4d3f-a8a8-ac0d035f6b07 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] [instance: 795440d0-6c9d-4317-9c59-dcc268cfa354] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:37.579802 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fa973c53-20c8-4d3f-a8a8-ac0d035f6b07 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:37.580526 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fa973c53-20c8-4d3f-a8a8-ac0d035f6b07 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:37.580974 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fa973c53-20c8-4d3f-a8a8-ac0d035f6b07 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:37.581698 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fa973c53-20c8-4d3f-a8a8-ac0d035f6b07 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:37.584337 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fa973c53-20c8-4d3f-a8a8-ac0d035f6b07 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:37.588044 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fa973c53-20c8-4d3f-a8a8-ac0d035f6b07 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:37.659007 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-fa973c53-20c8-4d3f-a8a8-ac0d035f6b07 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lazy-loading 'flavor' on Instance uuid 795440d0-6c9d-4317-9c59-dcc268cfa354 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:50:37.822973 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1beb392e-d4a8-4521-9184-ab39e38804e0 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:37.823595 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1beb392e-d4a8-4521-9184-ab39e38804e0 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: dcecca6b-779d-4b0f-900a-02287aaac41f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:37.847008 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1beb392e-d4a8-4521-9184-ab39e38804e0 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:37.847595 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1beb392e-d4a8-4521-9184-ab39e38804e0 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:37.848067 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1beb392e-d4a8-4521-9184-ab39e38804e0 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:37.850671 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1beb392e-d4a8-4521-9184-ab39e38804e0 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:37.851294 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1beb392e-d4a8-4521-9184-ab39e38804e0 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:37.853881 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1beb392e-d4a8-4521-9184-ab39e38804e0 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:38.180221 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-fa973c53-20c8-4d3f-a8a8-ac0d035f6b07 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] 10.222.0.20 "POST /compute/v2.1/servers/795440d0-6c9d-4317-9c59-dcc268cfa354/action" status: 202 len: 0 microversion: 2.1 time: 0.617048 Oct 04 18:50:38.181641 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2499/4940] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:50:37 2022] POST /compute/v2.1/servers/795440d0-6c9d-4317-9c59-dcc268cfa354/action => generated 0 bytes in 619 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:50:38.194160 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-590b0e95-544a-47dc-8524-82d71e251965 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:38.196136 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-590b0e95-544a-47dc-8524-82d71e251965 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] [instance: 795440d0-6c9d-4317-9c59-dcc268cfa354] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:38.211895 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-590b0e95-544a-47dc-8524-82d71e251965 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:38.212833 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-590b0e95-544a-47dc-8524-82d71e251965 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:38.213514 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-590b0e95-544a-47dc-8524-82d71e251965 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:38.223248 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-590b0e95-544a-47dc-8524-82d71e251965 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:38.224560 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-590b0e95-544a-47dc-8524-82d71e251965 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:38.225273 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-590b0e95-544a-47dc-8524-82d71e251965 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:38.448973 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1beb392e-d4a8-4521-9184-ab39e38804e0 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:38.463035 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1beb392e-d4a8-4521-9184-ab39e38804e0 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/dcecca6b-779d-4b0f-900a-02287aaac41f" status: 200 len: 1314 microversion: 2.1 time: 0.642949 Oct 04 18:50:38.475735 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2442/4941] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:37 2022] GET /compute/v2.1/servers/dcecca6b-779d-4b0f-900a-02287aaac41f => generated 1314 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:38.484454 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ce5d10d9-9678-453c-9d07-7d3f6f84144f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:38.485363 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ce5d10d9-9678-453c-9d07-7d3f6f84144f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: c6d7d726-8e3f-44de-8d6f-2d8c6187e8df] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:38.871855 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ce5d10d9-9678-453c-9d07-7d3f6f84144f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:38.880907 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ce5d10d9-9678-453c-9d07-7d3f6f84144f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/c6d7d726-8e3f-44de-8d6f-2d8c6187e8df" status: 200 len: 1215 microversion: 2.1 time: 0.403930 Oct 04 18:50:38.885427 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2443/4942] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:38 2022] GET /compute/v2.1/servers/c6d7d726-8e3f-44de-8d6f-2d8c6187e8df => generated 1215 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:38.989669 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-444d1419-3d0a-4a9c-af34-c152a961ddfa tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:38.990784 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-444d1419-3d0a-4a9c-af34-c152a961ddfa tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] [instance: 317c7bd8-4f1e-4210-bb33-087557a1f4d6] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:38.997358 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-444d1419-3d0a-4a9c-af34-c152a961ddfa tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:39.001023 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-444d1419-3d0a-4a9c-af34-c152a961ddfa tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:39.001778 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-444d1419-3d0a-4a9c-af34-c152a961ddfa tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:39.006685 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-444d1419-3d0a-4a9c-af34-c152a961ddfa tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:39.007800 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-444d1419-3d0a-4a9c-af34-c152a961ddfa tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:39.009720 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-444d1419-3d0a-4a9c-af34-c152a961ddfa tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:39.784736 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-444d1419-3d0a-4a9c-af34-c152a961ddfa tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:39.806843 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-444d1419-3d0a-4a9c-af34-c152a961ddfa tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:39.831692 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-444d1419-3d0a-4a9c-af34-c152a961ddfa tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:39.835313 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-444d1419-3d0a-4a9c-af34-c152a961ddfa tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] 10.222.0.20 "GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6" status: 200 len: 2951 microversion: 2.32 time: 0.855923 Oct 04 18:50:39.852083 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2444/4943] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:50:38 2022] GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6 => generated 2951 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:50:39.863083 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b8b2b346-af7a-4013-9af4-7c4767326282 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:39.863083 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b8b2b346-af7a-4013-9af4-7c4767326282 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: dcecca6b-779d-4b0f-900a-02287aaac41f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:39.887041 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b8b2b346-af7a-4013-9af4-7c4767326282 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:39.889513 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b8b2b346-af7a-4013-9af4-7c4767326282 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:39.891024 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b8b2b346-af7a-4013-9af4-7c4767326282 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:39.894473 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b8b2b346-af7a-4013-9af4-7c4767326282 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:39.900232 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b8b2b346-af7a-4013-9af4-7c4767326282 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:39.906006 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b8b2b346-af7a-4013-9af4-7c4767326282 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:39.954096 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-590b0e95-544a-47dc-8524-82d71e251965 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4307d3ab621244f29d98d8ef2a40538a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6d0a20c16d4c229b3e7488cf75a35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:39.978817 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-590b0e95-544a-47dc-8524-82d71e251965 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] 10.222.0.20 "GET /compute/v2.1/servers/795440d0-6c9d-4317-9c59-dcc268cfa354" status: 200 len: 1511 microversion: 2.1 time: 1.780300 Oct 04 18:50:39.979481 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2500/4944] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:38 2022] GET /compute/v2.1/servers/795440d0-6c9d-4317-9c59-dcc268cfa354 => generated 1511 bytes in 1794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:39.995530 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-6739a0b0-c0fb-41e6-a99b-f0ff5dbc9706 req-3bfa76d5-079e-43b6-96b6-bd15e4ad5426 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcecca6b-779d-4b0f-900a-02287aaac41f", "tag": "00331aac-20e5-49e6-9a18-7f739184e446"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:40.035925 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-6739a0b0-c0fb-41e6-a99b-f0ff5dbc9706 req-3bfa76d5-079e-43b6-96b6-bd15e4ad5426 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:40.036448 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-6739a0b0-c0fb-41e6-a99b-f0ff5dbc9706 req-3bfa76d5-079e-43b6-96b6-bd15e4ad5426 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:40.036937 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-6739a0b0-c0fb-41e6-a99b-f0ff5dbc9706 req-3bfa76d5-079e-43b6-96b6-bd15e4ad5426 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:40.063050 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-6739a0b0-c0fb-41e6-a99b-f0ff5dbc9706 req-3bfa76d5-079e-43b6-96b6-bd15e4ad5426 service nova] Creating event network-changed:00331aac-20e5-49e6-9a18-7f739184e446 for instance dcecca6b-779d-4b0f-900a-02287aaac41f on n-h1-850501-14 Oct 04 18:50:40.086048 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-6739a0b0-c0fb-41e6-a99b-f0ff5dbc9706 req-3bfa76d5-079e-43b6-96b6-bd15e4ad5426 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094019 Oct 04 18:50:40.090382 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2501/4945] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:50:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:50:40.092352 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-67a00c21-88ab-4a50-a136-a8646685e9fc tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:40.092990 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-67a00c21-88ab-4a50-a136-a8646685e9fc tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] [instance: 317c7bd8-4f1e-4210-bb33-087557a1f4d6] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:40.105242 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-67a00c21-88ab-4a50-a136-a8646685e9fc tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:40.105996 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-67a00c21-88ab-4a50-a136-a8646685e9fc tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:40.106589 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-67a00c21-88ab-4a50-a136-a8646685e9fc tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:40.108376 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-67a00c21-88ab-4a50-a136-a8646685e9fc tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:40.111537 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-67a00c21-88ab-4a50-a136-a8646685e9fc tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:40.112812 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-67a00c21-88ab-4a50-a136-a8646685e9fc tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:40.336234 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-67a00c21-88ab-4a50-a136-a8646685e9fc tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] 10.222.0.20 "GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.247514 Oct 04 18:50:40.337183 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2502/4946] 10.222.0.20 () {60 vars in 1316 bytes} [Tue Oct 4 18:50:40 2022] GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6/os-interface => generated 1831 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:50:40.359436 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-23bf314e-6035-461e-8b19-7ee3ba3fe056 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:40.360222 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-23bf314e-6035-461e-8b19-7ee3ba3fe056 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: c6d7d726-8e3f-44de-8d6f-2d8c6187e8df] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:40.377299 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-23bf314e-6035-461e-8b19-7ee3ba3fe056 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:40.379791 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-23bf314e-6035-461e-8b19-7ee3ba3fe056 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:40.380522 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-23bf314e-6035-461e-8b19-7ee3ba3fe056 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:40.383851 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-23bf314e-6035-461e-8b19-7ee3ba3fe056 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:40.385461 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-23bf314e-6035-461e-8b19-7ee3ba3fe056 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:40.387794 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-23bf314e-6035-461e-8b19-7ee3ba3fe056 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:40.505738 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b8b2b346-af7a-4013-9af4-7c4767326282 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:40.514657 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b8b2b346-af7a-4013-9af4-7c4767326282 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/dcecca6b-779d-4b0f-900a-02287aaac41f" status: 200 len: 1314 microversion: 2.1 time: 0.670583 Oct 04 18:50:40.515544 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2445/4947] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:39 2022] GET /compute/v2.1/servers/dcecca6b-779d-4b0f-900a-02287aaac41f => generated 1314 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:40.755620 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-23bf314e-6035-461e-8b19-7ee3ba3fe056 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:40.766978 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-23bf314e-6035-461e-8b19-7ee3ba3fe056 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/c6d7d726-8e3f-44de-8d6f-2d8c6187e8df" status: 200 len: 1267 microversion: 2.1 time: 0.428339 Oct 04 18:50:40.768169 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2503/4948] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:40 2022] GET /compute/v2.1/servers/c6d7d726-8e3f-44de-8d6f-2d8c6187e8df => generated 1267 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:41.012013 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-257c132c-80d1-4b36-86a8-93c9adb79626 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:41.012666 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-257c132c-80d1-4b36-86a8-93c9adb79626 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] [instance: 795440d0-6c9d-4317-9c59-dcc268cfa354] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:41.021231 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-257c132c-80d1-4b36-86a8-93c9adb79626 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:41.021730 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-257c132c-80d1-4b36-86a8-93c9adb79626 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:41.022171 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-257c132c-80d1-4b36-86a8-93c9adb79626 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:41.023148 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-257c132c-80d1-4b36-86a8-93c9adb79626 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:41.025582 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-257c132c-80d1-4b36-86a8-93c9adb79626 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:41.026041 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-257c132c-80d1-4b36-86a8-93c9adb79626 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:41.032358 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=100 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:50:41.540391 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a7a84700-e24d-4257-b873-d141574f2831 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:41.551468 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a7a84700-e24d-4257-b873-d141574f2831 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: dcecca6b-779d-4b0f-900a-02287aaac41f] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:41.555398 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a7a84700-e24d-4257-b873-d141574f2831 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:41.556084 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a7a84700-e24d-4257-b873-d141574f2831 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:41.556643 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a7a84700-e24d-4257-b873-d141574f2831 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:41.558197 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a7a84700-e24d-4257-b873-d141574f2831 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:41.558986 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a7a84700-e24d-4257-b873-d141574f2831 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:41.559968 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a7a84700-e24d-4257-b873-d141574f2831 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:41.560392 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-257c132c-80d1-4b36-86a8-93c9adb79626 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4307d3ab621244f29d98d8ef2a40538a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6d0a20c16d4c229b3e7488cf75a35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:41.575091 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-257c132c-80d1-4b36-86a8-93c9adb79626 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] 10.222.0.20 "GET /compute/v2.1/servers/795440d0-6c9d-4317-9c59-dcc268cfa354" status: 200 len: 1494 microversion: 2.1 time: 0.567848 Oct 04 18:50:41.578164 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2446/4949] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:41 2022] GET /compute/v2.1/servers/795440d0-6c9d-4317-9c59-dcc268cfa354 => generated 1494 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:41.604148 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-46cb1155-4528-4306-9085-50c06e5b5813 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:41.605681 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-46cb1155-4528-4306-9085-50c06e5b5813 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] [instance: 795440d0-6c9d-4317-9c59-dcc268cfa354] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:41.616659 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-46cb1155-4528-4306-9085-50c06e5b5813 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:41.617663 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-46cb1155-4528-4306-9085-50c06e5b5813 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:41.618973 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-46cb1155-4528-4306-9085-50c06e5b5813 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:41.619998 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-46cb1155-4528-4306-9085-50c06e5b5813 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:41.620737 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-46cb1155-4528-4306-9085-50c06e5b5813 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:41.621396 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-46cb1155-4528-4306-9085-50c06e5b5813 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:41.922168 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-46cb1155-4528-4306-9085-50c06e5b5813 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] 10.222.0.20 "POST /compute/v2.1/servers/795440d0-6c9d-4317-9c59-dcc268cfa354/action" status: 202 len: 0 microversion: 2.1 time: 0.322439 Oct 04 18:50:41.930929 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2447/4950] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:50:41 2022] POST /compute/v2.1/servers/795440d0-6c9d-4317-9c59-dcc268cfa354/action => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:50:41.954706 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6a9f0cce-981d-4469-8725-054ec100ce45 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:41.957738 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-6a9f0cce-981d-4469-8725-054ec100ce45 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: c6d7d726-8e3f-44de-8d6f-2d8c6187e8df] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:41.983005 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6a9f0cce-981d-4469-8725-054ec100ce45 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:41.985672 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6a9f0cce-981d-4469-8725-054ec100ce45 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:41.987805 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6a9f0cce-981d-4469-8725-054ec100ce45 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:41.991931 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6a9f0cce-981d-4469-8725-054ec100ce45 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:41.994600 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6a9f0cce-981d-4469-8725-054ec100ce45 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:41.997993 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6a9f0cce-981d-4469-8725-054ec100ce45 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:42.327008 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a7a84700-e24d-4257-b873-d141574f2831 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:42.352664 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-6a9f0cce-981d-4469-8725-054ec100ce45 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:42.356196 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a7a84700-e24d-4257-b873-d141574f2831 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/dcecca6b-779d-4b0f-900a-02287aaac41f" status: 200 len: 1314 microversion: 2.1 time: 0.818566 Oct 04 18:50:42.358366 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2504/4951] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:41 2022] GET /compute/v2.1/servers/dcecca6b-779d-4b0f-900a-02287aaac41f => generated 1314 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:42.366586 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8f3b5012-2bb8-4613-aa07-c8185c02b67c tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:42.368722 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8f3b5012-2bb8-4613-aa07-c8185c02b67c tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] [instance: 795440d0-6c9d-4317-9c59-dcc268cfa354] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:42.370664 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6a9f0cce-981d-4469-8725-054ec100ce45 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/c6d7d726-8e3f-44de-8d6f-2d8c6187e8df" status: 200 len: 1275 microversion: 2.1 time: 0.435287 Oct 04 18:50:42.371589 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2448/4952] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:41 2022] GET /compute/v2.1/servers/c6d7d726-8e3f-44de-8d6f-2d8c6187e8df => generated 1275 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:42.381835 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8f3b5012-2bb8-4613-aa07-c8185c02b67c tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:42.382597 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8f3b5012-2bb8-4613-aa07-c8185c02b67c tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:42.383708 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8f3b5012-2bb8-4613-aa07-c8185c02b67c tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:42.385386 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8f3b5012-2bb8-4613-aa07-c8185c02b67c tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:42.386024 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8f3b5012-2bb8-4613-aa07-c8185c02b67c tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:42.388874 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8f3b5012-2bb8-4613-aa07-c8185c02b67c tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:43.370151 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8f3b5012-2bb8-4613-aa07-c8185c02b67c tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4307d3ab621244f29d98d8ef2a40538a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6d0a20c16d4c229b3e7488cf75a35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:43.382780 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-01a8f71a-bf6d-46bb-ae44-8d52b081d81a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:43.383320 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8f3b5012-2bb8-4613-aa07-c8185c02b67c tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] 10.222.0.20 "GET /compute/v2.1/servers/795440d0-6c9d-4317-9c59-dcc268cfa354" status: 200 len: 1500 microversion: 2.1 time: 1.021494 Oct 04 18:50:43.383471 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2505/4953] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:42 2022] GET /compute/v2.1/servers/795440d0-6c9d-4317-9c59-dcc268cfa354 => generated 1500 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:43.383637 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-01a8f71a-bf6d-46bb-ae44-8d52b081d81a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: dcecca6b-779d-4b0f-900a-02287aaac41f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:43.386106 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=4 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:50:43.402359 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8c5b6d7b-e734-4054-8e85-a1534fdaca3d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:43.402807 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-01a8f71a-bf6d-46bb-ae44-8d52b081d81a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:43.403186 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8c5b6d7b-e734-4054-8e85-a1534fdaca3d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: c6d7d726-8e3f-44de-8d6f-2d8c6187e8df] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:43.403309 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-01a8f71a-bf6d-46bb-ae44-8d52b081d81a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:43.403743 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-01a8f71a-bf6d-46bb-ae44-8d52b081d81a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:43.405438 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-01a8f71a-bf6d-46bb-ae44-8d52b081d81a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:43.405919 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-01a8f71a-bf6d-46bb-ae44-8d52b081d81a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:43.406356 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-01a8f71a-bf6d-46bb-ae44-8d52b081d81a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:43.422163 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8c5b6d7b-e734-4054-8e85-a1534fdaca3d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:43.422673 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8c5b6d7b-e734-4054-8e85-a1534fdaca3d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:43.423313 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8c5b6d7b-e734-4054-8e85-a1534fdaca3d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:43.424040 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8c5b6d7b-e734-4054-8e85-a1534fdaca3d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:43.425143 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8c5b6d7b-e734-4054-8e85-a1534fdaca3d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:43.425585 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8c5b6d7b-e734-4054-8e85-a1534fdaca3d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:43.634646 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8c5b6d7b-e734-4054-8e85-a1534fdaca3d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:43.652287 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8c5b6d7b-e734-4054-8e85-a1534fdaca3d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/c6d7d726-8e3f-44de-8d6f-2d8c6187e8df" status: 200 len: 1273 microversion: 2.1 time: 0.252608 Oct 04 18:50:43.657564 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2506/4954] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:43 2022] GET /compute/v2.1/servers/c6d7d726-8e3f-44de-8d6f-2d8c6187e8df => generated 1273 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:44.115818 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-01a8f71a-bf6d-46bb-ae44-8d52b081d81a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:44.128949 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-01a8f71a-bf6d-46bb-ae44-8d52b081d81a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/dcecca6b-779d-4b0f-900a-02287aaac41f" status: 200 len: 1314 microversion: 2.1 time: 0.749938 Oct 04 18:50:44.134029 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2449/4955] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:43 2022] GET /compute/v2.1/servers/dcecca6b-779d-4b0f-900a-02287aaac41f => generated 1314 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:50:44.158619 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-aa77d918-7e15-45d4-958d-cd8fca527e5f tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-1835077562", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": [{"uuid": "d873340f-f377-4253-9542-618176c26230"}]}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:44.240098 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.neutron [None req-aa77d918-7e15-45d4-958d-cd8fca527e5f tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] validate_networks() for [('d873340f-f377-4253-9542-618176c26230', None, None, None, None, None)] {{(pid=123001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:50:44.413259 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2b287767-7dec-42d9-be83-325e206c7287 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:44.414057 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2b287767-7dec-42d9-be83-325e206c7287 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] [instance: 795440d0-6c9d-4317-9c59-dcc268cfa354] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:44.470972 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2b287767-7dec-42d9-be83-325e206c7287 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:44.472949 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2b287767-7dec-42d9-be83-325e206c7287 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:44.475714 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2b287767-7dec-42d9-be83-325e206c7287 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:44.485719 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2b287767-7dec-42d9-be83-325e206c7287 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:44.488284 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2b287767-7dec-42d9-be83-325e206c7287 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:44.489432 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2b287767-7dec-42d9-be83-325e206c7287 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:45.462224 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2b287767-7dec-42d9-be83-325e206c7287 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4307d3ab621244f29d98d8ef2a40538a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6d0a20c16d4c229b3e7488cf75a35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:45.477421 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2b287767-7dec-42d9-be83-325e206c7287 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] 10.222.0.20 "GET /compute/v2.1/servers/795440d0-6c9d-4317-9c59-dcc268cfa354" status: 200 len: 1500 microversion: 2.1 time: 1.070650 Oct 04 18:50:45.478052 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2450/4956] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:44 2022] GET /compute/v2.1/servers/795440d0-6c9d-4317-9c59-dcc268cfa354 => generated 1500 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:45.493290 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d6cdb362-07da-4ead-8b04-63884141b747 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:45.493998 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d6cdb362-07da-4ead-8b04-63884141b747 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: c6d7d726-8e3f-44de-8d6f-2d8c6187e8df] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:45.517029 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d6cdb362-07da-4ead-8b04-63884141b747 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:45.518713 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d6cdb362-07da-4ead-8b04-63884141b747 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:45.519059 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d6cdb362-07da-4ead-8b04-63884141b747 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:45.520002 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d6cdb362-07da-4ead-8b04-63884141b747 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:45.520842 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d6cdb362-07da-4ead-8b04-63884141b747 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:45.521434 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d6cdb362-07da-4ead-8b04-63884141b747 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:46.004449 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d6cdb362-07da-4ead-8b04-63884141b747 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:46.018615 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d6cdb362-07da-4ead-8b04-63884141b747 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/c6d7d726-8e3f-44de-8d6f-2d8c6187e8df" status: 200 len: 1315 microversion: 2.1 time: 0.538190 Oct 04 18:50:46.025068 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2451/4957] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:45 2022] GET /compute/v2.1/servers/c6d7d726-8e3f-44de-8d6f-2d8c6187e8df => generated 1315 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:46.039197 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e6010f27-8b2a-4d3b-92ad-fb3ed94e5543 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:46.042169 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e6010f27-8b2a-4d3b-92ad-fb3ed94e5543 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: dcecca6b-779d-4b0f-900a-02287aaac41f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:46.060591 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e6010f27-8b2a-4d3b-92ad-fb3ed94e5543 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:46.060591 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e6010f27-8b2a-4d3b-92ad-fb3ed94e5543 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:46.060591 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e6010f27-8b2a-4d3b-92ad-fb3ed94e5543 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:46.060591 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e6010f27-8b2a-4d3b-92ad-fb3ed94e5543 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:46.062715 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e6010f27-8b2a-4d3b-92ad-fb3ed94e5543 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:46.065160 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e6010f27-8b2a-4d3b-92ad-fb3ed94e5543 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:46.234474 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-aa77d918-7e15-45d4-958d-cd8fca527e5f tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:50:46.235051 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-aa77d918-7e15-45d4-958d-cd8fca527e5f tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:50:46.235474 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-aa77d918-7e15-45d4-958d-cd8fca527e5f tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:50:46.236097 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-aa77d918-7e15-45d4-958d-cd8fca527e5f tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:50:46.236525 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-aa77d918-7e15-45d4-958d-cd8fca527e5f tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:50:46.272812 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aa77d918-7e15-45d4-958d-cd8fca527e5f tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:46.273310 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aa77d918-7e15-45d4-958d-cd8fca527e5f tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:46.273749 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aa77d918-7e15-45d4-958d-cd8fca527e5f tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:46.281168 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aa77d918-7e15-45d4-958d-cd8fca527e5f tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:46.281678 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aa77d918-7e15-45d4-958d-cd8fca527e5f tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:46.283153 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aa77d918-7e15-45d4-958d-cd8fca527e5f tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:46.329668 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:50:46.371387 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-aa77d918-7e15-45d4-958d-cd8fca527e5f tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Getting quotas for project 1c0c83e578904efeb287fa626e7306a6. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:50:46.386971 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-aa77d918-7e15-45d4-958d-cd8fca527e5f tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Getting quotas for user 60055eab0e434fe7a25b50d906c21eb7 and project 1c0c83e578904efeb287fa626e7306a6. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:50:46.424503 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-aa77d918-7e15-45d4-958d-cd8fca527e5f tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Going to run 1 instances... {{(pid=123001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:50:46.433271 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-aa77d918-7e15-45d4-958d-cd8fca527e5f tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] [instance: 7b559895-fb96-44e4-a48b-090a344316c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:50:46.594841 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e6010f27-8b2a-4d3b-92ad-fb3ed94e5543 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:46.606326 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e6010f27-8b2a-4d3b-92ad-fb3ed94e5543 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/dcecca6b-779d-4b0f-900a-02287aaac41f" status: 200 len: 1314 microversion: 2.1 time: 0.579478 Oct 04 18:50:46.628409 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2452/4958] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:46 2022] GET /compute/v2.1/servers/dcecca6b-779d-4b0f-900a-02287aaac41f => generated 1314 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:46.652717 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-03ef42cc-9eab-4390-9441-d1026af9e880 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:46.655092 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-03ef42cc-9eab-4390-9441-d1026af9e880 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] [instance: 795440d0-6c9d-4317-9c59-dcc268cfa354] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:46.666677 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-aa77d918-7e15-45d4-958d-cd8fca527e5f tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.821644 Oct 04 18:50:46.672970 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-03ef42cc-9eab-4390-9441-d1026af9e880 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:46.673598 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2507/4959] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:50:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 2835 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:50:46.689842 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-03ef42cc-9eab-4390-9441-d1026af9e880 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:46.692374 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-03ef42cc-9eab-4390-9441-d1026af9e880 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:46.693308 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-54470a98-10f1-42eb-ba9f-2b31b31f82a9 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:46.698011 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-03ef42cc-9eab-4390-9441-d1026af9e880 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:46.698011 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-03ef42cc-9eab-4390-9441-d1026af9e880 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:46.698011 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-03ef42cc-9eab-4390-9441-d1026af9e880 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:46.705026 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-54470a98-10f1-42eb-ba9f-2b31b31f82a9 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] [instance: 7b559895-fb96-44e4-a48b-090a344316c7] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:47.342535 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-54470a98-10f1-42eb-ba9f-2b31b31f82a9 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60055eab0e434fe7a25b50d906c21eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0c83e578904efeb287fa626e7306a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:47.377860 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-54470a98-10f1-42eb-ba9f-2b31b31f82a9 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] 10.222.0.20 "GET /compute/v2.1/servers/7b559895-fb96-44e4-a48b-090a344316c7" status: 200 len: 1217 microversion: 2.1 time: 0.695570 Oct 04 18:50:47.392888 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2508/4960] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:46 2022] GET /compute/v2.1/servers/7b559895-fb96-44e4-a48b-090a344316c7 => generated 1217 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:50:47.401627 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9b92babe-c9c9-4a34-a4e0-d5b6a62cde18 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:47.402867 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-9b92babe-c9c9-4a34-a4e0-d5b6a62cde18 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: c6d7d726-8e3f-44de-8d6f-2d8c6187e8df] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:47.407630 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-03ef42cc-9eab-4390-9441-d1026af9e880 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4307d3ab621244f29d98d8ef2a40538a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6d0a20c16d4c229b3e7488cf75a35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:47.410973 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9b92babe-c9c9-4a34-a4e0-d5b6a62cde18 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:47.411669 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9b92babe-c9c9-4a34-a4e0-d5b6a62cde18 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:47.412572 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9b92babe-c9c9-4a34-a4e0-d5b6a62cde18 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:47.413843 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9b92babe-c9c9-4a34-a4e0-d5b6a62cde18 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:47.414462 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9b92babe-c9c9-4a34-a4e0-d5b6a62cde18 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:47.415127 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9b92babe-c9c9-4a34-a4e0-d5b6a62cde18 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:47.417369 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-03ef42cc-9eab-4390-9441-d1026af9e880 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] 10.222.0.20 "GET /compute/v2.1/servers/795440d0-6c9d-4317-9c59-dcc268cfa354" status: 200 len: 1500 microversion: 2.1 time: 0.787135 Oct 04 18:50:47.417971 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2453/4961] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:46 2022] GET /compute/v2.1/servers/795440d0-6c9d-4317-9c59-dcc268cfa354 => generated 1500 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:47.637553 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4d0f816c-c3f2-439f-b62d-19fe3c4f4e74 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:47.638890 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4d0f816c-c3f2-439f-b62d-19fe3c4f4e74 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: dcecca6b-779d-4b0f-900a-02287aaac41f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:47.652654 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4d0f816c-c3f2-439f-b62d-19fe3c4f4e74 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:47.653350 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4d0f816c-c3f2-439f-b62d-19fe3c4f4e74 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:47.655202 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4d0f816c-c3f2-439f-b62d-19fe3c4f4e74 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:47.668387 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4d0f816c-c3f2-439f-b62d-19fe3c4f4e74 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:47.668387 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4d0f816c-c3f2-439f-b62d-19fe3c4f4e74 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:47.668387 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4d0f816c-c3f2-439f-b62d-19fe3c4f4e74 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:47.746891 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9b92babe-c9c9-4a34-a4e0-d5b6a62cde18 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:47.759239 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9b92babe-c9c9-4a34-a4e0-d5b6a62cde18 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/c6d7d726-8e3f-44de-8d6f-2d8c6187e8df" status: 200 len: 1315 microversion: 2.1 time: 0.360971 Oct 04 18:50:47.759239 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2509/4962] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:47 2022] GET /compute/v2.1/servers/c6d7d726-8e3f-44de-8d6f-2d8c6187e8df => generated 1315 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:48.008026 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4d0f816c-c3f2-439f-b62d-19fe3c4f4e74 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:48.017017 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4d0f816c-c3f2-439f-b62d-19fe3c4f4e74 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/dcecca6b-779d-4b0f-900a-02287aaac41f" status: 200 len: 1314 microversion: 2.1 time: 0.384600 Oct 04 18:50:48.033154 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2454/4963] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:47 2022] GET /compute/v2.1/servers/dcecca6b-779d-4b0f-900a-02287aaac41f => generated 1314 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:48.349643 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-fe2d2418-1564-4f54-9593-e103b26add74 req-ebe246bf-ec48-4e40-b5c6-b35bff77b188 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcecca6b-779d-4b0f-900a-02287aaac41f", "name": "network-vif-plugged", "status": "completed", "tag": "00331aac-20e5-49e6-9a18-7f739184e446"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:48.375040 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-fe2d2418-1564-4f54-9593-e103b26add74 req-ebe246bf-ec48-4e40-b5c6-b35bff77b188 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:48.382251 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-fe2d2418-1564-4f54-9593-e103b26add74 req-ebe246bf-ec48-4e40-b5c6-b35bff77b188 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:48.382716 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-fe2d2418-1564-4f54-9593-e103b26add74 req-ebe246bf-ec48-4e40-b5c6-b35bff77b188 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:48.404595 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-fe2d2418-1564-4f54-9593-e103b26add74 req-ebe246bf-ec48-4e40-b5c6-b35bff77b188 service nova] Creating event network-vif-plugged:00331aac-20e5-49e6-9a18-7f739184e446 for instance dcecca6b-779d-4b0f-900a-02287aaac41f on n-h1-850501-14 Oct 04 18:50:48.406972 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3e4ce824-f717-4147-a3a4-979120e45b3c tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:48.407734 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3e4ce824-f717-4147-a3a4-979120e45b3c tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] [instance: 7b559895-fb96-44e4-a48b-090a344316c7] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:48.418015 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-fe2d2418-1564-4f54-9593-e103b26add74 req-ebe246bf-ec48-4e40-b5c6-b35bff77b188 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073618 Oct 04 18:50:48.418661 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2510/4964] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:50:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:50:48.445586 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-89b21ce8-8d78-4e5a-b824-384ac0d83efa tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:48.446840 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-89b21ce8-8d78-4e5a-b824-384ac0d83efa tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] [instance: 795440d0-6c9d-4317-9c59-dcc268cfa354] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:48.459037 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:50:48.461033 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-89b21ce8-8d78-4e5a-b824-384ac0d83efa tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:48.469848 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-89b21ce8-8d78-4e5a-b824-384ac0d83efa tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:48.473926 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-89b21ce8-8d78-4e5a-b824-384ac0d83efa tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:48.473926 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-89b21ce8-8d78-4e5a-b824-384ac0d83efa tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:48.473926 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-89b21ce8-8d78-4e5a-b824-384ac0d83efa tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:48.473926 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-89b21ce8-8d78-4e5a-b824-384ac0d83efa tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:48.543603 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3e4ce824-f717-4147-a3a4-979120e45b3c tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60055eab0e434fe7a25b50d906c21eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0c83e578904efeb287fa626e7306a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:48.552195 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3e4ce824-f717-4147-a3a4-979120e45b3c tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] 10.222.0.20 "GET /compute/v2.1/servers/7b559895-fb96-44e4-a48b-090a344316c7" status: 200 len: 1217 microversion: 2.1 time: 0.150366 Oct 04 18:50:48.552647 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2455/4965] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:48 2022] GET /compute/v2.1/servers/7b559895-fb96-44e4-a48b-090a344316c7 => generated 1217 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:50:48.790228 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9ce8f9ff-172f-473f-8715-99df7941ab1f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:48.796827 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9ce8f9ff-172f-473f-8715-99df7941ab1f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: c6d7d726-8e3f-44de-8d6f-2d8c6187e8df] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:48.811676 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9ce8f9ff-172f-473f-8715-99df7941ab1f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:48.812274 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9ce8f9ff-172f-473f-8715-99df7941ab1f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:48.813689 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9ce8f9ff-172f-473f-8715-99df7941ab1f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:48.817130 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9ce8f9ff-172f-473f-8715-99df7941ab1f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:48.817903 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9ce8f9ff-172f-473f-8715-99df7941ab1f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:48.818359 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9ce8f9ff-172f-473f-8715-99df7941ab1f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:48.875249 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-89b21ce8-8d78-4e5a-b824-384ac0d83efa tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4307d3ab621244f29d98d8ef2a40538a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6d0a20c16d4c229b3e7488cf75a35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:48.886152 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-89b21ce8-8d78-4e5a-b824-384ac0d83efa tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] 10.222.0.20 "GET /compute/v2.1/servers/795440d0-6c9d-4317-9c59-dcc268cfa354" status: 200 len: 1503 microversion: 2.1 time: 0.442991 Oct 04 18:50:48.888125 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2511/4966] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:48 2022] GET /compute/v2.1/servers/795440d0-6c9d-4317-9c59-dcc268cfa354 => generated 1503 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:50:48.914768 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d8f78a88-7f08-46cf-b13e-0ec41e5a1959 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:48.915201 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d8f78a88-7f08-46cf-b13e-0ec41e5a1959 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] [instance: 795440d0-6c9d-4317-9c59-dcc268cfa354] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:48.927011 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d8f78a88-7f08-46cf-b13e-0ec41e5a1959 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:48.927521 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d8f78a88-7f08-46cf-b13e-0ec41e5a1959 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:48.927966 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d8f78a88-7f08-46cf-b13e-0ec41e5a1959 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:48.932225 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d8f78a88-7f08-46cf-b13e-0ec41e5a1959 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:48.932720 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d8f78a88-7f08-46cf-b13e-0ec41e5a1959 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:48.933169 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d8f78a88-7f08-46cf-b13e-0ec41e5a1959 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:48.977250 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-d8f78a88-7f08-46cf-b13e-0ec41e5a1959 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lazy-loading 'flavor' on Instance uuid 795440d0-6c9d-4317-9c59-dcc268cfa354 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:50:49.220983 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9ce8f9ff-172f-473f-8715-99df7941ab1f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:49.245280 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9ce8f9ff-172f-473f-8715-99df7941ab1f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/c6d7d726-8e3f-44de-8d6f-2d8c6187e8df" status: 200 len: 1315 microversion: 2.1 time: 0.462614 Oct 04 18:50:49.247172 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2456/4967] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:48 2022] GET /compute/v2.1/servers/c6d7d726-8e3f-44de-8d6f-2d8c6187e8df => generated 1315 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:50:49.253948 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-0e87ad42-1078-440d-9de2-83b2ab6cfd87 req-06b0ce98-7ef3-4282-b41c-1bad32817605 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6d7d726-8e3f-44de-8d6f-2d8c6187e8df", "tag": "06e0de3c-b9d6-40ae-9154-56e02ffc7f2f"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:49.281557 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-0e87ad42-1078-440d-9de2-83b2ab6cfd87 req-06b0ce98-7ef3-4282-b41c-1bad32817605 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:49.282046 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-0e87ad42-1078-440d-9de2-83b2ab6cfd87 req-06b0ce98-7ef3-4282-b41c-1bad32817605 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:49.282481 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-0e87ad42-1078-440d-9de2-83b2ab6cfd87 req-06b0ce98-7ef3-4282-b41c-1bad32817605 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:49.302106 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-0e87ad42-1078-440d-9de2-83b2ab6cfd87 req-06b0ce98-7ef3-4282-b41c-1bad32817605 service nova] Creating event network-changed:06e0de3c-b9d6-40ae-9154-56e02ffc7f2f for instance c6d7d726-8e3f-44de-8d6f-2d8c6187e8df on n-h1-850501-14 Oct 04 18:50:49.302747 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-0e87ad42-1078-440d-9de2-83b2ab6cfd87 req-06b0ce98-7ef3-4282-b41c-1bad32817605 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052101 Oct 04 18:50:49.303520 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2457/4968] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:50:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:50:49.312340 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5d72a4d1-b2e9-43bb-ac6a-6623874bdee1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:49.313247 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5d72a4d1-b2e9-43bb-ac6a-6623874bdee1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: dcecca6b-779d-4b0f-900a-02287aaac41f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:49.330863 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5d72a4d1-b2e9-43bb-ac6a-6623874bdee1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:49.331572 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5d72a4d1-b2e9-43bb-ac6a-6623874bdee1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:49.332611 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5d72a4d1-b2e9-43bb-ac6a-6623874bdee1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:49.335296 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5d72a4d1-b2e9-43bb-ac6a-6623874bdee1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:49.336452 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5d72a4d1-b2e9-43bb-ac6a-6623874bdee1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:49.337538 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5d72a4d1-b2e9-43bb-ac6a-6623874bdee1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:49.425752 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d8f78a88-7f08-46cf-b13e-0ec41e5a1959 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] 10.222.0.20 "POST /compute/v2.1/servers/795440d0-6c9d-4317-9c59-dcc268cfa354/action" status: 202 len: 0 microversion: 2.1 time: 0.512520 Oct 04 18:50:49.441117 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2512/4969] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:50:48 2022] POST /compute/v2.1/servers/795440d0-6c9d-4317-9c59-dcc268cfa354/action => generated 0 bytes in 531 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:50:49.461068 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a622b9bc-ae15-4ae2-88cd-a0cb0a721f17 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:49.469696 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a622b9bc-ae15-4ae2-88cd-a0cb0a721f17 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] [instance: 795440d0-6c9d-4317-9c59-dcc268cfa354] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:49.478933 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a622b9bc-ae15-4ae2-88cd-a0cb0a721f17 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:49.480768 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a622b9bc-ae15-4ae2-88cd-a0cb0a721f17 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:49.481885 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a622b9bc-ae15-4ae2-88cd-a0cb0a721f17 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:49.483100 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a622b9bc-ae15-4ae2-88cd-a0cb0a721f17 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:49.484396 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a622b9bc-ae15-4ae2-88cd-a0cb0a721f17 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:49.485153 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a622b9bc-ae15-4ae2-88cd-a0cb0a721f17 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:49.550113 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5d72a4d1-b2e9-43bb-ac6a-6623874bdee1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:49.564022 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5d72a4d1-b2e9-43bb-ac6a-6623874bdee1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/dcecca6b-779d-4b0f-900a-02287aaac41f" status: 200 len: 1314 microversion: 2.1 time: 0.256908 Oct 04 18:50:49.576307 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2458/4970] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:49 2022] GET /compute/v2.1/servers/dcecca6b-779d-4b0f-900a-02287aaac41f => generated 1314 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:49.583547 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-738aaf78-d0cb-4739-8f76-addb706987fb tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:49.583547 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-738aaf78-d0cb-4739-8f76-addb706987fb tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] [instance: 7b559895-fb96-44e4-a48b-090a344316c7] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:49.594828 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-738aaf78-d0cb-4739-8f76-addb706987fb tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:49.602391 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-738aaf78-d0cb-4739-8f76-addb706987fb tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:49.602391 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-738aaf78-d0cb-4739-8f76-addb706987fb tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:49.602391 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-738aaf78-d0cb-4739-8f76-addb706987fb tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:49.602391 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-738aaf78-d0cb-4739-8f76-addb706987fb tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:49.602391 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-738aaf78-d0cb-4739-8f76-addb706987fb tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:49.757991 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-738aaf78-d0cb-4739-8f76-addb706987fb tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60055eab0e434fe7a25b50d906c21eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0c83e578904efeb287fa626e7306a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:49.770453 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-738aaf78-d0cb-4739-8f76-addb706987fb tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] 10.222.0.20 "GET /compute/v2.1/servers/7b559895-fb96-44e4-a48b-090a344316c7" status: 200 len: 1213 microversion: 2.1 time: 0.197401 Oct 04 18:50:49.771053 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2459/4971] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:49 2022] GET /compute/v2.1/servers/7b559895-fb96-44e4-a48b-090a344316c7 => generated 1213 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:50:49.920706 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a622b9bc-ae15-4ae2-88cd-a0cb0a721f17 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4307d3ab621244f29d98d8ef2a40538a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6d0a20c16d4c229b3e7488cf75a35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:49.930402 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a622b9bc-ae15-4ae2-88cd-a0cb0a721f17 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] 10.222.0.20 "GET /compute/v2.1/servers/795440d0-6c9d-4317-9c59-dcc268cfa354" status: 200 len: 1511 microversion: 2.1 time: 0.481528 Oct 04 18:50:49.944080 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2513/4972] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:49 2022] GET /compute/v2.1/servers/795440d0-6c9d-4317-9c59-dcc268cfa354 => generated 1511 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:50.271522 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-dde7ad53-acbd-48f5-a6eb-bb36c35b153c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:50.272183 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-dde7ad53-acbd-48f5-a6eb-bb36c35b153c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: c6d7d726-8e3f-44de-8d6f-2d8c6187e8df] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:50.288754 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dde7ad53-acbd-48f5-a6eb-bb36c35b153c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:50.289569 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dde7ad53-acbd-48f5-a6eb-bb36c35b153c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:50.295494 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dde7ad53-acbd-48f5-a6eb-bb36c35b153c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:50.295494 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dde7ad53-acbd-48f5-a6eb-bb36c35b153c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:50.295494 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dde7ad53-acbd-48f5-a6eb-bb36c35b153c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:50.295494 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dde7ad53-acbd-48f5-a6eb-bb36c35b153c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:50.476639 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-dde7ad53-acbd-48f5-a6eb-bb36c35b153c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:50.486377 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-dde7ad53-acbd-48f5-a6eb-bb36c35b153c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/c6d7d726-8e3f-44de-8d6f-2d8c6187e8df" status: 200 len: 1315 microversion: 2.1 time: 0.218865 Oct 04 18:50:50.487389 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2460/4973] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:50 2022] GET /compute/v2.1/servers/c6d7d726-8e3f-44de-8d6f-2d8c6187e8df => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:50.591384 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ea9ab367-8780-4b0e-a044-b0b63ae8a59c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:50.592761 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ea9ab367-8780-4b0e-a044-b0b63ae8a59c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: dcecca6b-779d-4b0f-900a-02287aaac41f] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:50.601150 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ea9ab367-8780-4b0e-a044-b0b63ae8a59c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:50.601822 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ea9ab367-8780-4b0e-a044-b0b63ae8a59c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:50.602413 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ea9ab367-8780-4b0e-a044-b0b63ae8a59c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:50.603316 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ea9ab367-8780-4b0e-a044-b0b63ae8a59c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:50.603941 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ea9ab367-8780-4b0e-a044-b0b63ae8a59c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:50.604735 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ea9ab367-8780-4b0e-a044-b0b63ae8a59c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:50.801579 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6a038a02-d330-4217-8e2e-c4f6bb951aec tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:50.802203 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-6a038a02-d330-4217-8e2e-c4f6bb951aec tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] [instance: 7b559895-fb96-44e4-a48b-090a344316c7] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:50.815520 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6a038a02-d330-4217-8e2e-c4f6bb951aec tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:50.816078 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6a038a02-d330-4217-8e2e-c4f6bb951aec tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:50.820177 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6a038a02-d330-4217-8e2e-c4f6bb951aec tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:50.820967 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6a038a02-d330-4217-8e2e-c4f6bb951aec tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:50.824473 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6a038a02-d330-4217-8e2e-c4f6bb951aec tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:50.824977 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6a038a02-d330-4217-8e2e-c4f6bb951aec tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:50.870222 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ea9ab367-8780-4b0e-a044-b0b63ae8a59c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:50.883033 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ea9ab367-8780-4b0e-a044-b0b63ae8a59c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/dcecca6b-779d-4b0f-900a-02287aaac41f" status: 200 len: 1501 microversion: 2.1 time: 0.295646 Oct 04 18:50:50.883599 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2514/4974] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:50 2022] GET /compute/v2.1/servers/dcecca6b-779d-4b0f-900a-02287aaac41f => generated 1501 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:50.914014 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-fad05fb2-d3df-444c-a6fe-f3704e5d7eb2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:50.921493 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fad05fb2-d3df-444c-a6fe-f3704e5d7eb2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:50.922300 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fad05fb2-d3df-444c-a6fe-f3704e5d7eb2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:50.922912 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fad05fb2-d3df-444c-a6fe-f3704e5d7eb2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:50.962934 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-6a038a02-d330-4217-8e2e-c4f6bb951aec tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60055eab0e434fe7a25b50d906c21eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0c83e578904efeb287fa626e7306a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:50.977201 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6a038a02-d330-4217-8e2e-c4f6bb951aec tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] 10.222.0.20 "GET /compute/v2.1/servers/7b559895-fb96-44e4-a48b-090a344316c7" status: 200 len: 1277 microversion: 2.1 time: 0.179435 Oct 04 18:50:50.977988 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2461/4975] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:50 2022] GET /compute/v2.1/servers/7b559895-fb96-44e4-a48b-090a344316c7 => generated 1277 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:50.983858 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d1997dc9-bd8d-4c35-b5f9-977a8ccd02c1 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:50.984499 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d1997dc9-bd8d-4c35-b5f9-977a8ccd02c1 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] [instance: 795440d0-6c9d-4317-9c59-dcc268cfa354] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:50.999213 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d1997dc9-bd8d-4c35-b5f9-977a8ccd02c1 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:50.999729 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d1997dc9-bd8d-4c35-b5f9-977a8ccd02c1 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:51.000238 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d1997dc9-bd8d-4c35-b5f9-977a8ccd02c1 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:51.000951 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d1997dc9-bd8d-4c35-b5f9-977a8ccd02c1 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:51.001404 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d1997dc9-bd8d-4c35-b5f9-977a8ccd02c1 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:51.001828 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d1997dc9-bd8d-4c35-b5f9-977a8ccd02c1 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:51.002879 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-fad05fb2-d3df-444c-a6fe-f3704e5d7eb2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: dcecca6b-779d-4b0f-900a-02287aaac41f] Going to try to stop instance {{(pid=123001) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 18:50:51.273123 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-fad05fb2-d3df-444c-a6fe-f3704e5d7eb2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "POST /compute/v2.1/servers/dcecca6b-779d-4b0f-900a-02287aaac41f/action" status: 202 len: 0 microversion: 2.1 time: 0.364740 Oct 04 18:50:51.277628 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2515/4976] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:50:50 2022] POST /compute/v2.1/servers/dcecca6b-779d-4b0f-900a-02287aaac41f/action => generated 0 bytes in 370 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:50:51.283989 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c0581c58-f9e5-4080-8f7b-476692384c7f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:51.285138 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c0581c58-f9e5-4080-8f7b-476692384c7f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: dcecca6b-779d-4b0f-900a-02287aaac41f] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:51.300844 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c0581c58-f9e5-4080-8f7b-476692384c7f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:51.301743 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c0581c58-f9e5-4080-8f7b-476692384c7f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:51.302469 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c0581c58-f9e5-4080-8f7b-476692384c7f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:51.305063 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c0581c58-f9e5-4080-8f7b-476692384c7f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:51.306369 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c0581c58-f9e5-4080-8f7b-476692384c7f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:51.307024 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c0581c58-f9e5-4080-8f7b-476692384c7f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:51.817975 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d1997dc9-bd8d-4c35-b5f9-977a8ccd02c1 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4307d3ab621244f29d98d8ef2a40538a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6d0a20c16d4c229b3e7488cf75a35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:51.827065 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d1997dc9-bd8d-4c35-b5f9-977a8ccd02c1 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] 10.222.0.20 "GET /compute/v2.1/servers/795440d0-6c9d-4317-9c59-dcc268cfa354" status: 200 len: 1494 microversion: 2.1 time: 0.848182 Oct 04 18:50:51.827770 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2462/4977] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:50 2022] GET /compute/v2.1/servers/795440d0-6c9d-4317-9c59-dcc268cfa354 => generated 1494 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:51.832829 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-77fa0c03-775d-4ae9-82f9-ce363dd5076b tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:51.833811 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-77fa0c03-775d-4ae9-82f9-ce363dd5076b tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: c6d7d726-8e3f-44de-8d6f-2d8c6187e8df] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:51.840643 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-77fa0c03-775d-4ae9-82f9-ce363dd5076b tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:51.842238 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-77fa0c03-775d-4ae9-82f9-ce363dd5076b tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:51.843021 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-77fa0c03-775d-4ae9-82f9-ce363dd5076b tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:51.844260 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-77fa0c03-775d-4ae9-82f9-ce363dd5076b tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:51.844950 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-77fa0c03-775d-4ae9-82f9-ce363dd5076b tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:51.845752 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-77fa0c03-775d-4ae9-82f9-ce363dd5076b tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:51.875224 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:50:52.003316 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c0581c58-f9e5-4080-8f7b-476692384c7f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:52.017769 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c0581c58-f9e5-4080-8f7b-476692384c7f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/dcecca6b-779d-4b0f-900a-02287aaac41f" status: 200 len: 1511 microversion: 2.1 time: 0.737338 Oct 04 18:50:52.032274 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2516/4978] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:51 2022] GET /compute/v2.1/servers/dcecca6b-779d-4b0f-900a-02287aaac41f => generated 1511 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:52.040166 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-34fd8ed2-de9b-4003-9acc-7c4aa3aa18fb tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:52.040605 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-34fd8ed2-de9b-4003-9acc-7c4aa3aa18fb tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] [instance: 795440d0-6c9d-4317-9c59-dcc268cfa354] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:52.096031 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-34fd8ed2-de9b-4003-9acc-7c4aa3aa18fb tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:52.096824 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-34fd8ed2-de9b-4003-9acc-7c4aa3aa18fb tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:52.097336 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-34fd8ed2-de9b-4003-9acc-7c4aa3aa18fb tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:52.102508 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-34fd8ed2-de9b-4003-9acc-7c4aa3aa18fb tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:52.102508 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-34fd8ed2-de9b-4003-9acc-7c4aa3aa18fb tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:52.102508 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-34fd8ed2-de9b-4003-9acc-7c4aa3aa18fb tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:52.269905 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-77fa0c03-775d-4ae9-82f9-ce363dd5076b tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:52.278882 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-77fa0c03-775d-4ae9-82f9-ce363dd5076b tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/c6d7d726-8e3f-44de-8d6f-2d8c6187e8df" status: 200 len: 1315 microversion: 2.1 time: 0.449660 Oct 04 18:50:52.279539 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2463/4979] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:51 2022] GET /compute/v2.1/servers/c6d7d726-8e3f-44de-8d6f-2d8c6187e8df => generated 1315 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:52.284605 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b3268941-8bae-47fa-9ab7-15a5544c864c tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:52.285563 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b3268941-8bae-47fa-9ab7-15a5544c864c tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] [instance: 7b559895-fb96-44e4-a48b-090a344316c7] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:52.293067 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b3268941-8bae-47fa-9ab7-15a5544c864c tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:52.293865 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b3268941-8bae-47fa-9ab7-15a5544c864c tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:52.295344 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b3268941-8bae-47fa-9ab7-15a5544c864c tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:52.296370 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b3268941-8bae-47fa-9ab7-15a5544c864c tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:52.297065 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b3268941-8bae-47fa-9ab7-15a5544c864c tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:52.306923 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b3268941-8bae-47fa-9ab7-15a5544c864c tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:52.425081 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-34fd8ed2-de9b-4003-9acc-7c4aa3aa18fb tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] 10.222.0.20 "POST /compute/v2.1/servers/795440d0-6c9d-4317-9c59-dcc268cfa354/action" status: 202 len: 0 microversion: 2.1 time: 0.391027 Oct 04 18:50:52.426226 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2517/4980] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:50:52 2022] POST /compute/v2.1/servers/795440d0-6c9d-4317-9c59-dcc268cfa354/action => generated 0 bytes in 393 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:50:52.441982 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1f076f09-e07d-4d2c-9e80-18d2b48fb5ff tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:52.446315 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1f076f09-e07d-4d2c-9e80-18d2b48fb5ff tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] [instance: 795440d0-6c9d-4317-9c59-dcc268cfa354] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:52.467035 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1f076f09-e07d-4d2c-9e80-18d2b48fb5ff tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:52.467910 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1f076f09-e07d-4d2c-9e80-18d2b48fb5ff tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:52.469224 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1f076f09-e07d-4d2c-9e80-18d2b48fb5ff tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:52.471860 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1f076f09-e07d-4d2c-9e80-18d2b48fb5ff tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:52.472786 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1f076f09-e07d-4d2c-9e80-18d2b48fb5ff tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:52.473576 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1f076f09-e07d-4d2c-9e80-18d2b48fb5ff tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:52.494308 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b3268941-8bae-47fa-9ab7-15a5544c864c tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60055eab0e434fe7a25b50d906c21eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0c83e578904efeb287fa626e7306a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:52.515066 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b3268941-8bae-47fa-9ab7-15a5544c864c tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] 10.222.0.20 "GET /compute/v2.1/servers/7b559895-fb96-44e4-a48b-090a344316c7" status: 200 len: 1275 microversion: 2.1 time: 0.233792 Oct 04 18:50:52.518367 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2464/4981] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:52 2022] GET /compute/v2.1/servers/7b559895-fb96-44e4-a48b-090a344316c7 => generated 1275 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:53.002749 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1f076f09-e07d-4d2c-9e80-18d2b48fb5ff tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4307d3ab621244f29d98d8ef2a40538a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6d0a20c16d4c229b3e7488cf75a35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:53.015647 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1f076f09-e07d-4d2c-9e80-18d2b48fb5ff tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] 10.222.0.20 "GET /compute/v2.1/servers/795440d0-6c9d-4317-9c59-dcc268cfa354" status: 200 len: 1500 microversion: 2.1 time: 0.581253 Oct 04 18:50:53.034233 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2518/4982] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:52 2022] GET /compute/v2.1/servers/795440d0-6c9d-4317-9c59-dcc268cfa354 => generated 1500 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:53.044947 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-064444dc-c3e4-4bae-88d5-d077e62d096d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:53.046625 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-064444dc-c3e4-4bae-88d5-d077e62d096d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: dcecca6b-779d-4b0f-900a-02287aaac41f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:53.062310 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-064444dc-c3e4-4bae-88d5-d077e62d096d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:53.069949 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-064444dc-c3e4-4bae-88d5-d077e62d096d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:53.070667 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-064444dc-c3e4-4bae-88d5-d077e62d096d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:53.071616 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-064444dc-c3e4-4bae-88d5-d077e62d096d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:53.072286 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-064444dc-c3e4-4bae-88d5-d077e62d096d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:53.072907 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-064444dc-c3e4-4bae-88d5-d077e62d096d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:53.306450 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5a9fbb20-8910-4e27-a0b5-1f62477b3ec1 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:53.308742 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5a9fbb20-8910-4e27-a0b5-1f62477b3ec1 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: c6d7d726-8e3f-44de-8d6f-2d8c6187e8df] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:53.318733 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5a9fbb20-8910-4e27-a0b5-1f62477b3ec1 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:53.321313 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5a9fbb20-8910-4e27-a0b5-1f62477b3ec1 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:53.321313 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5a9fbb20-8910-4e27-a0b5-1f62477b3ec1 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:53.322225 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5a9fbb20-8910-4e27-a0b5-1f62477b3ec1 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:53.322914 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5a9fbb20-8910-4e27-a0b5-1f62477b3ec1 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:53.323571 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5a9fbb20-8910-4e27-a0b5-1f62477b3ec1 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:53.413197 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-064444dc-c3e4-4bae-88d5-d077e62d096d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:53.423716 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-064444dc-c3e4-4bae-88d5-d077e62d096d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/dcecca6b-779d-4b0f-900a-02287aaac41f" status: 200 len: 1511 microversion: 2.1 time: 0.383353 Oct 04 18:50:53.425759 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2465/4983] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:53 2022] GET /compute/v2.1/servers/dcecca6b-779d-4b0f-900a-02287aaac41f => generated 1511 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:53.546078 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3611f8e3-e3a7-42b2-9196-7a24a80f9834 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:53.547580 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3611f8e3-e3a7-42b2-9196-7a24a80f9834 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] [instance: 7b559895-fb96-44e4-a48b-090a344316c7] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:53.563440 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3611f8e3-e3a7-42b2-9196-7a24a80f9834 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:53.567025 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3611f8e3-e3a7-42b2-9196-7a24a80f9834 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:53.570987 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3611f8e3-e3a7-42b2-9196-7a24a80f9834 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:53.571560 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3611f8e3-e3a7-42b2-9196-7a24a80f9834 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:53.573090 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3611f8e3-e3a7-42b2-9196-7a24a80f9834 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:53.573783 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3611f8e3-e3a7-42b2-9196-7a24a80f9834 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:53.878280 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5a9fbb20-8910-4e27-a0b5-1f62477b3ec1 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:53.897548 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5a9fbb20-8910-4e27-a0b5-1f62477b3ec1 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/c6d7d726-8e3f-44de-8d6f-2d8c6187e8df" status: 200 len: 1315 microversion: 2.1 time: 0.594875 Oct 04 18:50:53.900568 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2519/4984] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:53 2022] GET /compute/v2.1/servers/c6d7d726-8e3f-44de-8d6f-2d8c6187e8df => generated 1315 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:50:54.044553 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a81daa38-75b6-4f2f-bfb9-0fcec90589a9 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:54.046264 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a81daa38-75b6-4f2f-bfb9-0fcec90589a9 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] [instance: 795440d0-6c9d-4317-9c59-dcc268cfa354] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:54.090371 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a81daa38-75b6-4f2f-bfb9-0fcec90589a9 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:54.090814 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a81daa38-75b6-4f2f-bfb9-0fcec90589a9 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:54.094554 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a81daa38-75b6-4f2f-bfb9-0fcec90589a9 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:54.095353 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a81daa38-75b6-4f2f-bfb9-0fcec90589a9 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:54.095841 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a81daa38-75b6-4f2f-bfb9-0fcec90589a9 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:54.096353 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a81daa38-75b6-4f2f-bfb9-0fcec90589a9 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:54.281367 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3611f8e3-e3a7-42b2-9196-7a24a80f9834 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60055eab0e434fe7a25b50d906c21eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0c83e578904efeb287fa626e7306a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:54.291970 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3611f8e3-e3a7-42b2-9196-7a24a80f9834 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] 10.222.0.20 "GET /compute/v2.1/servers/7b559895-fb96-44e4-a48b-090a344316c7" status: 200 len: 1317 microversion: 2.1 time: 0.751285 Oct 04 18:50:54.311703 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2466/4985] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:53 2022] GET /compute/v2.1/servers/7b559895-fb96-44e4-a48b-090a344316c7 => generated 1317 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:54.425434 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a81daa38-75b6-4f2f-bfb9-0fcec90589a9 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4307d3ab621244f29d98d8ef2a40538a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6d0a20c16d4c229b3e7488cf75a35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:54.438924 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a81daa38-75b6-4f2f-bfb9-0fcec90589a9 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] 10.222.0.20 "GET /compute/v2.1/servers/795440d0-6c9d-4317-9c59-dcc268cfa354" status: 200 len: 1500 microversion: 2.1 time: 0.400252 Oct 04 18:50:54.443266 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2520/4986] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:54 2022] GET /compute/v2.1/servers/795440d0-6c9d-4317-9c59-dcc268cfa354 => generated 1500 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:54.464407 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a2b66997-c27e-4c7e-9024-f26d8276adcd tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:54.465334 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a2b66997-c27e-4c7e-9024-f26d8276adcd tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: dcecca6b-779d-4b0f-900a-02287aaac41f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:54.474417 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a2b66997-c27e-4c7e-9024-f26d8276adcd tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:54.475175 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a2b66997-c27e-4c7e-9024-f26d8276adcd tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:54.475789 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a2b66997-c27e-4c7e-9024-f26d8276adcd tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:54.476807 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a2b66997-c27e-4c7e-9024-f26d8276adcd tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:54.477447 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a2b66997-c27e-4c7e-9024-f26d8276adcd tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:54.478047 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a2b66997-c27e-4c7e-9024-f26d8276adcd tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:54.927013 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d7233bcc-a42e-446c-ab7f-12fe20a32ab3 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:54.927210 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d7233bcc-a42e-446c-ab7f-12fe20a32ab3 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: c6d7d726-8e3f-44de-8d6f-2d8c6187e8df] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:54.939673 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d7233bcc-a42e-446c-ab7f-12fe20a32ab3 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:54.940609 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d7233bcc-a42e-446c-ab7f-12fe20a32ab3 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:54.941235 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d7233bcc-a42e-446c-ab7f-12fe20a32ab3 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:54.941945 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d7233bcc-a42e-446c-ab7f-12fe20a32ab3 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:54.944935 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d7233bcc-a42e-446c-ab7f-12fe20a32ab3 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:54.945770 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d7233bcc-a42e-446c-ab7f-12fe20a32ab3 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:54.961831 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a2b66997-c27e-4c7e-9024-f26d8276adcd tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:54.975863 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a2b66997-c27e-4c7e-9024-f26d8276adcd tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/dcecca6b-779d-4b0f-900a-02287aaac41f" status: 200 len: 1511 microversion: 2.1 time: 0.517433 Oct 04 18:50:54.978220 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2467/4987] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:54 2022] GET /compute/v2.1/servers/dcecca6b-779d-4b0f-900a-02287aaac41f => generated 1511 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:55.238542 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d7233bcc-a42e-446c-ab7f-12fe20a32ab3 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:55.257906 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d7233bcc-a42e-446c-ab7f-12fe20a32ab3 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/c6d7d726-8e3f-44de-8d6f-2d8c6187e8df" status: 200 len: 1315 microversion: 2.1 time: 0.334942 Oct 04 18:50:55.258522 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2521/4988] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:54 2022] GET /compute/v2.1/servers/c6d7d726-8e3f-44de-8d6f-2d8c6187e8df => generated 1315 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:50:55.325433 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-04da3a7a-e164-4a0f-9c54-beb3d7cd6e11 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:55.326061 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-04da3a7a-e164-4a0f-9c54-beb3d7cd6e11 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] [instance: 7b559895-fb96-44e4-a48b-090a344316c7] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:55.332299 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-04da3a7a-e164-4a0f-9c54-beb3d7cd6e11 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:55.332813 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-04da3a7a-e164-4a0f-9c54-beb3d7cd6e11 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:55.333396 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-04da3a7a-e164-4a0f-9c54-beb3d7cd6e11 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:55.334106 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-04da3a7a-e164-4a0f-9c54-beb3d7cd6e11 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:55.334555 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-04da3a7a-e164-4a0f-9c54-beb3d7cd6e11 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:55.334983 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-04da3a7a-e164-4a0f-9c54-beb3d7cd6e11 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:55.473070 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-363b345b-bbe1-432f-ba5f-262e9227cd8b tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:55.476795 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-363b345b-bbe1-432f-ba5f-262e9227cd8b tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] [instance: 795440d0-6c9d-4317-9c59-dcc268cfa354] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:55.487373 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-363b345b-bbe1-432f-ba5f-262e9227cd8b tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:55.488824 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-363b345b-bbe1-432f-ba5f-262e9227cd8b tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:55.489605 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-363b345b-bbe1-432f-ba5f-262e9227cd8b tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:55.491965 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-363b345b-bbe1-432f-ba5f-262e9227cd8b tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:55.492721 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-363b345b-bbe1-432f-ba5f-262e9227cd8b tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:55.493405 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-363b345b-bbe1-432f-ba5f-262e9227cd8b tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:55.523754 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:50:55.906436 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-363b345b-bbe1-432f-ba5f-262e9227cd8b tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4307d3ab621244f29d98d8ef2a40538a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6d0a20c16d4c229b3e7488cf75a35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:55.914251 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-363b345b-bbe1-432f-ba5f-262e9227cd8b tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] 10.222.0.20 "GET /compute/v2.1/servers/795440d0-6c9d-4317-9c59-dcc268cfa354" status: 200 len: 1500 microversion: 2.1 time: 0.449885 Oct 04 18:50:55.915059 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2522/4989] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:55 2022] GET /compute/v2.1/servers/795440d0-6c9d-4317-9c59-dcc268cfa354 => generated 1500 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:50:56.004845 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-fd22b27c-546f-4321-83c0-6296af4b14e5 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:56.005573 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-fd22b27c-546f-4321-83c0-6296af4b14e5 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: dcecca6b-779d-4b0f-900a-02287aaac41f] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:56.021690 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fd22b27c-546f-4321-83c0-6296af4b14e5 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:56.027806 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fd22b27c-546f-4321-83c0-6296af4b14e5 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:56.027806 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fd22b27c-546f-4321-83c0-6296af4b14e5 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:56.027806 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fd22b27c-546f-4321-83c0-6296af4b14e5 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:56.027806 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fd22b27c-546f-4321-83c0-6296af4b14e5 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:56.027806 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fd22b27c-546f-4321-83c0-6296af4b14e5 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:56.097425 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-04da3a7a-e164-4a0f-9c54-beb3d7cd6e11 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60055eab0e434fe7a25b50d906c21eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0c83e578904efeb287fa626e7306a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:56.109651 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-04da3a7a-e164-4a0f-9c54-beb3d7cd6e11 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] 10.222.0.20 "GET /compute/v2.1/servers/7b559895-fb96-44e4-a48b-090a344316c7" status: 200 len: 1317 microversion: 2.1 time: 0.792058 Oct 04 18:50:56.124104 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2468/4990] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:55 2022] GET /compute/v2.1/servers/7b559895-fb96-44e4-a48b-090a344316c7 => generated 1317 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:56.126601 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-93403660-42f1-4e8a-b8f6-c18d3e12747f req-08f423d3-8183-44ac-b6d1-02d820bdbb4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b559895-fb96-44e4-a48b-090a344316c7", "tag": "f23ab705-7a64-4c5f-bf5a-87d59f6b5acb"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:56.151028 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-93403660-42f1-4e8a-b8f6-c18d3e12747f req-08f423d3-8183-44ac-b6d1-02d820bdbb4d service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:56.151898 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-93403660-42f1-4e8a-b8f6-c18d3e12747f req-08f423d3-8183-44ac-b6d1-02d820bdbb4d service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:56.152563 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-93403660-42f1-4e8a-b8f6-c18d3e12747f req-08f423d3-8183-44ac-b6d1-02d820bdbb4d service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:56.168464 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-93403660-42f1-4e8a-b8f6-c18d3e12747f req-08f423d3-8183-44ac-b6d1-02d820bdbb4d service nova] Creating event network-changed:f23ab705-7a64-4c5f-bf5a-87d59f6b5acb for instance 7b559895-fb96-44e4-a48b-090a344316c7 on n-h2-850501-14 Oct 04 18:50:56.175397 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-93403660-42f1-4e8a-b8f6-c18d3e12747f req-08f423d3-8183-44ac-b6d1-02d820bdbb4d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061778 Oct 04 18:50:56.176480 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2469/4991] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:50:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:50:56.281507 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1c96fb1c-7007-4865-b880-e66f6014aff4 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:56.282371 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1c96fb1c-7007-4865-b880-e66f6014aff4 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: c6d7d726-8e3f-44de-8d6f-2d8c6187e8df] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:56.292266 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1c96fb1c-7007-4865-b880-e66f6014aff4 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:56.292788 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1c96fb1c-7007-4865-b880-e66f6014aff4 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:56.293196 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1c96fb1c-7007-4865-b880-e66f6014aff4 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:56.294570 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1c96fb1c-7007-4865-b880-e66f6014aff4 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:56.295371 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1c96fb1c-7007-4865-b880-e66f6014aff4 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:56.295819 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1c96fb1c-7007-4865-b880-e66f6014aff4 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:56.329975 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=4 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:50:56.541542 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-fd22b27c-546f-4321-83c0-6296af4b14e5 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:56.554955 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-fd22b27c-546f-4321-83c0-6296af4b14e5 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/dcecca6b-779d-4b0f-900a-02287aaac41f" status: 200 len: 1511 microversion: 2.1 time: 0.554511 Oct 04 18:50:56.561239 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2523/4992] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:55 2022] GET /compute/v2.1/servers/dcecca6b-779d-4b0f-900a-02287aaac41f => generated 1511 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:56.574788 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-0a0e5760-4dae-4aee-be9d-b2ee27a30229 req-64b58199-73db-43ba-a6a1-c4883b6acd04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6d7d726-8e3f-44de-8d6f-2d8c6187e8df", "name": "network-vif-plugged", "status": "completed", "tag": "06e0de3c-b9d6-40ae-9154-56e02ffc7f2f"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:56.589066 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-0a0e5760-4dae-4aee-be9d-b2ee27a30229 req-64b58199-73db-43ba-a6a1-c4883b6acd04 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:56.589867 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-0a0e5760-4dae-4aee-be9d-b2ee27a30229 req-64b58199-73db-43ba-a6a1-c4883b6acd04 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:56.590530 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-0a0e5760-4dae-4aee-be9d-b2ee27a30229 req-64b58199-73db-43ba-a6a1-c4883b6acd04 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:56.599707 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1c96fb1c-7007-4865-b880-e66f6014aff4 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:56.605813 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-0a0e5760-4dae-4aee-be9d-b2ee27a30229 req-64b58199-73db-43ba-a6a1-c4883b6acd04 service nova] Creating event network-vif-plugged:06e0de3c-b9d6-40ae-9154-56e02ffc7f2f for instance c6d7d726-8e3f-44de-8d6f-2d8c6187e8df on n-h1-850501-14 Oct 04 18:50:56.612324 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-0a0e5760-4dae-4aee-be9d-b2ee27a30229 req-64b58199-73db-43ba-a6a1-c4883b6acd04 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041730 Oct 04 18:50:56.618307 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2524/4993] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:50:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:50:56.618432 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1c96fb1c-7007-4865-b880-e66f6014aff4 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/c6d7d726-8e3f-44de-8d6f-2d8c6187e8df" status: 200 len: 1315 microversion: 2.1 time: 0.337797 Oct 04 18:50:56.618432 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2470/4994] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:56 2022] GET /compute/v2.1/servers/c6d7d726-8e3f-44de-8d6f-2d8c6187e8df => generated 1315 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:56.939176 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2928b216-6e89-46ab-89b8-08b5842d611e tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:56.939950 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2928b216-6e89-46ab-89b8-08b5842d611e tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] [instance: 795440d0-6c9d-4317-9c59-dcc268cfa354] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:56.957351 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2928b216-6e89-46ab-89b8-08b5842d611e tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:56.958291 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2928b216-6e89-46ab-89b8-08b5842d611e tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:56.958964 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2928b216-6e89-46ab-89b8-08b5842d611e tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:56.959902 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2928b216-6e89-46ab-89b8-08b5842d611e tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:56.960602 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2928b216-6e89-46ab-89b8-08b5842d611e tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:56.961249 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2928b216-6e89-46ab-89b8-08b5842d611e tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:57.133373 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5037a36e-29fb-4aca-b5e6-18b2e33d64b9 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:57.134045 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5037a36e-29fb-4aca-b5e6-18b2e33d64b9 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] [instance: 7b559895-fb96-44e4-a48b-090a344316c7] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:57.141950 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5037a36e-29fb-4aca-b5e6-18b2e33d64b9 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:57.148899 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5037a36e-29fb-4aca-b5e6-18b2e33d64b9 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:57.149530 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5037a36e-29fb-4aca-b5e6-18b2e33d64b9 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:57.151976 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5037a36e-29fb-4aca-b5e6-18b2e33d64b9 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:57.153873 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5037a36e-29fb-4aca-b5e6-18b2e33d64b9 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:57.156639 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5037a36e-29fb-4aca-b5e6-18b2e33d64b9 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:57.376553 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=20 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:50:57.395678 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-2928b216-6e89-46ab-89b8-08b5842d611e tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4307d3ab621244f29d98d8ef2a40538a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6d0a20c16d4c229b3e7488cf75a35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:57.429537 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2928b216-6e89-46ab-89b8-08b5842d611e tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] 10.222.0.20 "GET /compute/v2.1/servers/795440d0-6c9d-4317-9c59-dcc268cfa354" status: 200 len: 1503 microversion: 2.1 time: 0.493812 Oct 04 18:50:57.433602 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2525/4995] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:56 2022] GET /compute/v2.1/servers/795440d0-6c9d-4317-9c59-dcc268cfa354 => generated 1503 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:57.455516 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c714cae4-0d57-41bf-bcd4-5dc72eb3d8ce tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:57.456671 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c714cae4-0d57-41bf-bcd4-5dc72eb3d8ce tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] [instance: 795440d0-6c9d-4317-9c59-dcc268cfa354] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:57.468441 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c714cae4-0d57-41bf-bcd4-5dc72eb3d8ce tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:57.468849 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c714cae4-0d57-41bf-bcd4-5dc72eb3d8ce tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:57.469756 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c714cae4-0d57-41bf-bcd4-5dc72eb3d8ce tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:57.470715 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c714cae4-0d57-41bf-bcd4-5dc72eb3d8ce tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:57.471332 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c714cae4-0d57-41bf-bcd4-5dc72eb3d8ce tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:57.472198 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c714cae4-0d57-41bf-bcd4-5dc72eb3d8ce tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:57.512125 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c714cae4-0d57-41bf-bcd4-5dc72eb3d8ce tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] [instance: 795440d0-6c9d-4317-9c59-dcc268cfa354] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:50:57.571621 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5037a36e-29fb-4aca-b5e6-18b2e33d64b9 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60055eab0e434fe7a25b50d906c21eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0c83e578904efeb287fa626e7306a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:57.581958 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5037a36e-29fb-4aca-b5e6-18b2e33d64b9 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] 10.222.0.20 "GET /compute/v2.1/servers/7b559895-fb96-44e4-a48b-090a344316c7" status: 200 len: 1317 microversion: 2.1 time: 0.452335 Oct 04 18:50:57.589024 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2471/4996] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:57 2022] GET /compute/v2.1/servers/7b559895-fb96-44e4-a48b-090a344316c7 => generated 1317 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:50:57.604709 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-34fe3660-0b86-4959-8211-4efae11cde30 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:57.606577 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-34fe3660-0b86-4959-8211-4efae11cde30 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: dcecca6b-779d-4b0f-900a-02287aaac41f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:57.626290 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-34fe3660-0b86-4959-8211-4efae11cde30 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:57.627324 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-34fe3660-0b86-4959-8211-4efae11cde30 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:57.628112 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-34fe3660-0b86-4959-8211-4efae11cde30 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:57.629705 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-34fe3660-0b86-4959-8211-4efae11cde30 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:57.630869 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-34fe3660-0b86-4959-8211-4efae11cde30 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:57.631717 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-34fe3660-0b86-4959-8211-4efae11cde30 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:57.861792 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c714cae4-0d57-41bf-bcd4-5dc72eb3d8ce tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] 10.222.0.20 "DELETE /compute/v2.1/servers/795440d0-6c9d-4317-9c59-dcc268cfa354" status: 204 len: 0 microversion: 2.1 time: 0.411946 Oct 04 18:50:57.862757 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2526/4997] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:50:57 2022] DELETE /compute/v2.1/servers/795440d0-6c9d-4317-9c59-dcc268cfa354 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:50:57.869658 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f453dc46-b71c-49ca-8ce6-bd52436238e0 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:57.871298 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f453dc46-b71c-49ca-8ce6-bd52436238e0 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: c6d7d726-8e3f-44de-8d6f-2d8c6187e8df] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:57.878552 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f453dc46-b71c-49ca-8ce6-bd52436238e0 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:57.879052 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f453dc46-b71c-49ca-8ce6-bd52436238e0 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:57.879486 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f453dc46-b71c-49ca-8ce6-bd52436238e0 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:57.881227 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f453dc46-b71c-49ca-8ce6-bd52436238e0 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:57.881876 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f453dc46-b71c-49ca-8ce6-bd52436238e0 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:57.882310 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f453dc46-b71c-49ca-8ce6-bd52436238e0 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:58.001647 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-34fe3660-0b86-4959-8211-4efae11cde30 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:58.012484 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-34fe3660-0b86-4959-8211-4efae11cde30 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/dcecca6b-779d-4b0f-900a-02287aaac41f" status: 200 len: 1511 microversion: 2.1 time: 0.422028 Oct 04 18:50:58.036122 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2472/4998] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:57 2022] GET /compute/v2.1/servers/dcecca6b-779d-4b0f-900a-02287aaac41f => generated 1511 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:58.041195 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e70593ec-364f-4930-b478-634974968417 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:58.043339 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e70593ec-364f-4930-b478-634974968417 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] [instance: 795440d0-6c9d-4317-9c59-dcc268cfa354] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:58.054154 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e70593ec-364f-4930-b478-634974968417 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:58.054666 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e70593ec-364f-4930-b478-634974968417 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:58.055112 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e70593ec-364f-4930-b478-634974968417 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:58.055990 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e70593ec-364f-4930-b478-634974968417 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:58.056484 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e70593ec-364f-4930-b478-634974968417 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:58.056927 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e70593ec-364f-4930-b478-634974968417 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:58.283627 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f453dc46-b71c-49ca-8ce6-bd52436238e0 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:58.291517 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f453dc46-b71c-49ca-8ce6-bd52436238e0 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/c6d7d726-8e3f-44de-8d6f-2d8c6187e8df" status: 200 len: 1315 microversion: 2.1 time: 0.427282 Oct 04 18:50:58.304472 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2527/4999] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:57 2022] GET /compute/v2.1/servers/c6d7d726-8e3f-44de-8d6f-2d8c6187e8df => generated 1315 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:58.552252 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=18 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:50:58.617413 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b24327bb-0ac3-456b-806a-726e536432ce tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:58.618128 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b24327bb-0ac3-456b-806a-726e536432ce tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] [instance: 7b559895-fb96-44e4-a48b-090a344316c7] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:58.625881 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b24327bb-0ac3-456b-806a-726e536432ce tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:58.627384 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b24327bb-0ac3-456b-806a-726e536432ce tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:58.628023 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b24327bb-0ac3-456b-806a-726e536432ce tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:58.629518 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b24327bb-0ac3-456b-806a-726e536432ce tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:58.629657 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b24327bb-0ac3-456b-806a-726e536432ce tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:58.630043 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b24327bb-0ac3-456b-806a-726e536432ce tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:58.789382 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e70593ec-364f-4930-b478-634974968417 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4307d3ab621244f29d98d8ef2a40538a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6d0a20c16d4c229b3e7488cf75a35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:58.798739 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e70593ec-364f-4930-b478-634974968417 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] 10.222.0.20 "GET /compute/v2.1/servers/795440d0-6c9d-4317-9c59-dcc268cfa354" status: 200 len: 1509 microversion: 2.1 time: 0.765921 Oct 04 18:50:58.799630 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2473/5000] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:58 2022] GET /compute/v2.1/servers/795440d0-6c9d-4317-9c59-dcc268cfa354 => generated 1509 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:58.911871 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b24327bb-0ac3-456b-806a-726e536432ce tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60055eab0e434fe7a25b50d906c21eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0c83e578904efeb287fa626e7306a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:58.921727 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b24327bb-0ac3-456b-806a-726e536432ce tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] 10.222.0.20 "GET /compute/v2.1/servers/7b559895-fb96-44e4-a48b-090a344316c7" status: 200 len: 1317 microversion: 2.1 time: 0.311362 Oct 04 18:50:58.938420 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2528/5001] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:58 2022] GET /compute/v2.1/servers/7b559895-fb96-44e4-a48b-090a344316c7 => generated 1317 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:50:59.046014 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2fe3ab60-e9a6-4bf5-8bef-28b9f42c6ee9 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:59.046014 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2fe3ab60-e9a6-4bf5-8bef-28b9f42c6ee9 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: dcecca6b-779d-4b0f-900a-02287aaac41f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:59.056514 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2fe3ab60-e9a6-4bf5-8bef-28b9f42c6ee9 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:59.056906 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2fe3ab60-e9a6-4bf5-8bef-28b9f42c6ee9 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:59.058700 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2fe3ab60-e9a6-4bf5-8bef-28b9f42c6ee9 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:59.059771 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2fe3ab60-e9a6-4bf5-8bef-28b9f42c6ee9 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:59.062306 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2fe3ab60-e9a6-4bf5-8bef-28b9f42c6ee9 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:59.066337 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2fe3ab60-e9a6-4bf5-8bef-28b9f42c6ee9 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:59.316486 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ec789d2c-31b5-415a-919b-55f6fb143610 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:59.317420 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ec789d2c-31b5-415a-919b-55f6fb143610 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: c6d7d726-8e3f-44de-8d6f-2d8c6187e8df] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:59.325779 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec789d2c-31b5-415a-919b-55f6fb143610 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:59.326600 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec789d2c-31b5-415a-919b-55f6fb143610 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:59.327097 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec789d2c-31b5-415a-919b-55f6fb143610 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:59.327810 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec789d2c-31b5-415a-919b-55f6fb143610 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:59.328294 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec789d2c-31b5-415a-919b-55f6fb143610 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:59.328716 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec789d2c-31b5-415a-919b-55f6fb143610 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:59.355708 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2fe3ab60-e9a6-4bf5-8bef-28b9f42c6ee9 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:59.373205 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2fe3ab60-e9a6-4bf5-8bef-28b9f42c6ee9 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/dcecca6b-779d-4b0f-900a-02287aaac41f" status: 200 len: 1511 microversion: 2.1 time: 0.334026 Oct 04 18:50:59.374610 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2474/5002] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:59 2022] GET /compute/v2.1/servers/dcecca6b-779d-4b0f-900a-02287aaac41f => generated 1511 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:59.642567 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ec789d2c-31b5-415a-919b-55f6fb143610 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:59.656615 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ec789d2c-31b5-415a-919b-55f6fb143610 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/c6d7d726-8e3f-44de-8d6f-2d8c6187e8df" status: 200 len: 1502 microversion: 2.1 time: 0.342688 Oct 04 18:50:59.678489 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2529/5003] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:59 2022] GET /compute/v2.1/servers/c6d7d726-8e3f-44de-8d6f-2d8c6187e8df => generated 1502 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:50:59.688100 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e65689e7-717d-4048-9109-fd66cba434ab tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:59.689417 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e65689e7-717d-4048-9109-fd66cba434ab tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: c6d7d726-8e3f-44de-8d6f-2d8c6187e8df] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:59.704217 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e65689e7-717d-4048-9109-fd66cba434ab tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:59.711445 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e65689e7-717d-4048-9109-fd66cba434ab tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:59.712866 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e65689e7-717d-4048-9109-fd66cba434ab tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:59.713766 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e65689e7-717d-4048-9109-fd66cba434ab tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:59.714818 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e65689e7-717d-4048-9109-fd66cba434ab tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:59.715418 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e65689e7-717d-4048-9109-fd66cba434ab tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:59.824245 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ac412e39-6358-446e-b5ac-c48c548e57ec tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:59.825207 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ac412e39-6358-446e-b5ac-c48c548e57ec tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] [instance: 795440d0-6c9d-4317-9c59-dcc268cfa354] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:59.839027 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ac412e39-6358-446e-b5ac-c48c548e57ec tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:59.840496 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ac412e39-6358-446e-b5ac-c48c548e57ec tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:59.843009 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ac412e39-6358-446e-b5ac-c48c548e57ec tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:59.845378 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ac412e39-6358-446e-b5ac-c48c548e57ec tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:59.846073 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ac412e39-6358-446e-b5ac-c48c548e57ec tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:59.848186 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ac412e39-6358-446e-b5ac-c48c548e57ec tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:00.067073 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e65689e7-717d-4048-9109-fd66cba434ab tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "POST /compute/v2.1/servers/c6d7d726-8e3f-44de-8d6f-2d8c6187e8df/action" status: 202 len: 0 microversion: 2.1 time: 0.384582 Oct 04 18:51:00.086511 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2475/5004] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:50:59 2022] POST /compute/v2.1/servers/c6d7d726-8e3f-44de-8d6f-2d8c6187e8df/action => generated 0 bytes in 405 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:51:00.097971 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-37a71d80-dae1-47c4-987c-18cd460cf445 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:00.099013 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-37a71d80-dae1-47c4-987c-18cd460cf445 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] [instance: 7b559895-fb96-44e4-a48b-090a344316c7] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:00.108028 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-37a71d80-dae1-47c4-987c-18cd460cf445 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:00.108028 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-37a71d80-dae1-47c4-987c-18cd460cf445 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:00.108400 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-37a71d80-dae1-47c4-987c-18cd460cf445 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:00.113235 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-37a71d80-dae1-47c4-987c-18cd460cf445 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:00.113235 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-37a71d80-dae1-47c4-987c-18cd460cf445 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:00.113235 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-37a71d80-dae1-47c4-987c-18cd460cf445 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:00.382668 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ac412e39-6358-446e-b5ac-c48c548e57ec tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4307d3ab621244f29d98d8ef2a40538a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6d0a20c16d4c229b3e7488cf75a35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:00.392563 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ac412e39-6358-446e-b5ac-c48c548e57ec tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] 10.222.0.20 "GET /compute/v2.1/servers/795440d0-6c9d-4317-9c59-dcc268cfa354" status: 200 len: 1509 microversion: 2.1 time: 0.572631 Oct 04 18:51:00.396976 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2530/5005] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:59 2022] GET /compute/v2.1/servers/795440d0-6c9d-4317-9c59-dcc268cfa354 => generated 1509 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:00.402593 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-62a62379-ef86-4f47-85f8-2666194e1f2f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:00.403321 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-62a62379-ef86-4f47-85f8-2666194e1f2f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: c6d7d726-8e3f-44de-8d6f-2d8c6187e8df] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:00.420097 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-62a62379-ef86-4f47-85f8-2666194e1f2f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:00.422071 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-62a62379-ef86-4f47-85f8-2666194e1f2f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:00.422748 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-62a62379-ef86-4f47-85f8-2666194e1f2f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:00.427491 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-62a62379-ef86-4f47-85f8-2666194e1f2f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:00.430348 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-62a62379-ef86-4f47-85f8-2666194e1f2f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:00.431183 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-62a62379-ef86-4f47-85f8-2666194e1f2f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:00.655676 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-37a71d80-dae1-47c4-987c-18cd460cf445 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60055eab0e434fe7a25b50d906c21eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0c83e578904efeb287fa626e7306a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:00.670221 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-37a71d80-dae1-47c4-987c-18cd460cf445 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] 10.222.0.20 "GET /compute/v2.1/servers/7b559895-fb96-44e4-a48b-090a344316c7" status: 200 len: 1317 microversion: 2.1 time: 0.580031 Oct 04 18:51:00.671673 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2476/5006] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:00 2022] GET /compute/v2.1/servers/7b559895-fb96-44e4-a48b-090a344316c7 => generated 1317 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:00.677405 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-157a459a-71e5-41ba-a6fc-d944af4e53b8 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:00.678461 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-157a459a-71e5-41ba-a6fc-d944af4e53b8 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: dcecca6b-779d-4b0f-900a-02287aaac41f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:00.689755 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-157a459a-71e5-41ba-a6fc-d944af4e53b8 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:00.691471 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-157a459a-71e5-41ba-a6fc-d944af4e53b8 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:00.692480 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-157a459a-71e5-41ba-a6fc-d944af4e53b8 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:00.693838 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-157a459a-71e5-41ba-a6fc-d944af4e53b8 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:00.694743 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-157a459a-71e5-41ba-a6fc-d944af4e53b8 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:00.695480 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-157a459a-71e5-41ba-a6fc-d944af4e53b8 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:00.978911 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-62a62379-ef86-4f47-85f8-2666194e1f2f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:00.996226 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-62a62379-ef86-4f47-85f8-2666194e1f2f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/c6d7d726-8e3f-44de-8d6f-2d8c6187e8df" status: 200 len: 1507 microversion: 2.1 time: 0.597255 Oct 04 18:51:00.996850 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2531/5007] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:00 2022] GET /compute/v2.1/servers/c6d7d726-8e3f-44de-8d6f-2d8c6187e8df => generated 1507 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:01.385910 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-157a459a-71e5-41ba-a6fc-d944af4e53b8 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:01.402574 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-157a459a-71e5-41ba-a6fc-d944af4e53b8 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/dcecca6b-779d-4b0f-900a-02287aaac41f" status: 200 len: 1511 microversion: 2.1 time: 0.729242 Oct 04 18:51:01.404191 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2477/5008] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:00 2022] GET /compute/v2.1/servers/dcecca6b-779d-4b0f-900a-02287aaac41f => generated 1511 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:01.424755 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3ec58f2a-178e-4148-8641-8230a48592ba tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:01.425926 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3ec58f2a-178e-4148-8641-8230a48592ba tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] [instance: 795440d0-6c9d-4317-9c59-dcc268cfa354] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:01.438504 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3ec58f2a-178e-4148-8641-8230a48592ba tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:01.438992 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3ec58f2a-178e-4148-8641-8230a48592ba tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:01.439438 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3ec58f2a-178e-4148-8641-8230a48592ba tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:01.444273 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3ec58f2a-178e-4148-8641-8230a48592ba tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:01.444903 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3ec58f2a-178e-4148-8641-8230a48592ba tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:01.445362 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3ec58f2a-178e-4148-8641-8230a48592ba tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:01.699870 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f011f509-04e2-4ceb-940e-a0ca23099cfd tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:01.699870 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f011f509-04e2-4ceb-940e-a0ca23099cfd tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] [instance: 7b559895-fb96-44e4-a48b-090a344316c7] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:01.704195 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=96,nova_api:DELETE=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:51:01.716673 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f011f509-04e2-4ceb-940e-a0ca23099cfd tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:01.717271 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f011f509-04e2-4ceb-940e-a0ca23099cfd tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:01.720654 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f011f509-04e2-4ceb-940e-a0ca23099cfd tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:01.721602 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f011f509-04e2-4ceb-940e-a0ca23099cfd tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:01.722250 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f011f509-04e2-4ceb-940e-a0ca23099cfd tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:01.723005 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f011f509-04e2-4ceb-940e-a0ca23099cfd tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:02.215255 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3ec58f2a-178e-4148-8641-8230a48592ba tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4307d3ab621244f29d98d8ef2a40538a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6d0a20c16d4c229b3e7488cf75a35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:02.237141 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3ec58f2a-178e-4148-8641-8230a48592ba tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] 10.222.0.20 "GET /compute/v2.1/servers/795440d0-6c9d-4317-9c59-dcc268cfa354" status: 200 len: 1509 microversion: 2.1 time: 0.816687 Oct 04 18:51:02.245256 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2532/5009] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:01 2022] GET /compute/v2.1/servers/795440d0-6c9d-4317-9c59-dcc268cfa354 => generated 1509 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:02.245675 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f011f509-04e2-4ceb-940e-a0ca23099cfd tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60055eab0e434fe7a25b50d906c21eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0c83e578904efeb287fa626e7306a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:02.253515 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4c673c55-ad6c-4901-92a3-724fec5693fb tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:02.255238 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-4c673c55-ad6c-4901-92a3-724fec5693fb tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: c6d7d726-8e3f-44de-8d6f-2d8c6187e8df] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:02.266088 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f011f509-04e2-4ceb-940e-a0ca23099cfd tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] 10.222.0.20 "GET /compute/v2.1/servers/7b559895-fb96-44e4-a48b-090a344316c7" status: 200 len: 1317 microversion: 2.1 time: 0.571971 Oct 04 18:51:02.267276 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2478/5010] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:01 2022] GET /compute/v2.1/servers/7b559895-fb96-44e4-a48b-090a344316c7 => generated 1317 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:51:02.278788 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4c673c55-ad6c-4901-92a3-724fec5693fb tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:02.279298 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4c673c55-ad6c-4901-92a3-724fec5693fb tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:02.279754 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4c673c55-ad6c-4901-92a3-724fec5693fb tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:02.280516 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4c673c55-ad6c-4901-92a3-724fec5693fb tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:02.283964 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4c673c55-ad6c-4901-92a3-724fec5693fb tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:02.283964 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4c673c55-ad6c-4901-92a3-724fec5693fb tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:02.427792 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e3abb6fd-a01f-4c44-b32e-bd6960de8166 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:02.429120 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e3abb6fd-a01f-4c44-b32e-bd6960de8166 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: dcecca6b-779d-4b0f-900a-02287aaac41f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:02.437121 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e3abb6fd-a01f-4c44-b32e-bd6960de8166 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:02.440422 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e3abb6fd-a01f-4c44-b32e-bd6960de8166 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:02.441186 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e3abb6fd-a01f-4c44-b32e-bd6960de8166 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:02.441941 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e3abb6fd-a01f-4c44-b32e-bd6960de8166 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:02.442411 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e3abb6fd-a01f-4c44-b32e-bd6960de8166 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:02.443196 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e3abb6fd-a01f-4c44-b32e-bd6960de8166 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:02.733779 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-4c673c55-ad6c-4901-92a3-724fec5693fb tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:02.745868 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-4c673c55-ad6c-4901-92a3-724fec5693fb tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/c6d7d726-8e3f-44de-8d6f-2d8c6187e8df" status: 200 len: 1487 microversion: 2.1 time: 0.498966 Oct 04 18:51:02.766127 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2533/5011] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:02 2022] GET /compute/v2.1/servers/c6d7d726-8e3f-44de-8d6f-2d8c6187e8df => generated 1487 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:02.787508 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ec19a23d-1b7d-48d0-964c-2a5f85a95521 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:02.788299 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ec19a23d-1b7d-48d0-964c-2a5f85a95521 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: c6d7d726-8e3f-44de-8d6f-2d8c6187e8df] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:02.805834 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec19a23d-1b7d-48d0-964c-2a5f85a95521 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:02.812566 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec19a23d-1b7d-48d0-964c-2a5f85a95521 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:02.813529 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec19a23d-1b7d-48d0-964c-2a5f85a95521 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:02.816938 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec19a23d-1b7d-48d0-964c-2a5f85a95521 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:02.817953 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec19a23d-1b7d-48d0-964c-2a5f85a95521 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:02.826137 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec19a23d-1b7d-48d0-964c-2a5f85a95521 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:02.901622 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ec19a23d-1b7d-48d0-964c-2a5f85a95521 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: c6d7d726-8e3f-44de-8d6f-2d8c6187e8df] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:51:03.311096 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e3abb6fd-a01f-4c44-b32e-bd6960de8166 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:03.342528 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:51:03.345657 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e3abb6fd-a01f-4c44-b32e-bd6960de8166 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/dcecca6b-779d-4b0f-900a-02287aaac41f" status: 200 len: 1511 microversion: 2.1 time: 0.922428 Oct 04 18:51:03.346900 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2479/5012] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:02 2022] GET /compute/v2.1/servers/dcecca6b-779d-4b0f-900a-02287aaac41f => generated 1511 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:51:03.353931 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-fedae8ce-939c-489b-9594-eefceb5a8336 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:03.358667 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-fedae8ce-939c-489b-9594-eefceb5a8336 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] [instance: 795440d0-6c9d-4317-9c59-dcc268cfa354] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:03.367856 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fedae8ce-939c-489b-9594-eefceb5a8336 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:03.372290 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fedae8ce-939c-489b-9594-eefceb5a8336 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:03.372813 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fedae8ce-939c-489b-9594-eefceb5a8336 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:03.373575 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fedae8ce-939c-489b-9594-eefceb5a8336 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:03.374051 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fedae8ce-939c-489b-9594-eefceb5a8336 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:03.374693 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fedae8ce-939c-489b-9594-eefceb5a8336 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:03.406120 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ec19a23d-1b7d-48d0-964c-2a5f85a95521 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c6d7d726-8e3f-44de-8d6f-2d8c6187e8df" status: 204 len: 0 microversion: 2.1 time: 0.627764 Oct 04 18:51:03.409297 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2534/5013] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:51:02 2022] DELETE /compute/v2.1/servers/c6d7d726-8e3f-44de-8d6f-2d8c6187e8df => generated 0 bytes in 633 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:51:03.424873 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f198c7b2-003e-475d-8d5d-a756aa1b6582 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:03.428028 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f198c7b2-003e-475d-8d5d-a756aa1b6582 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] [instance: 7b559895-fb96-44e4-a48b-090a344316c7] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:03.443422 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f198c7b2-003e-475d-8d5d-a756aa1b6582 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:03.443926 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f198c7b2-003e-475d-8d5d-a756aa1b6582 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:03.444401 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f198c7b2-003e-475d-8d5d-a756aa1b6582 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:03.445115 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f198c7b2-003e-475d-8d5d-a756aa1b6582 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:03.445577 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f198c7b2-003e-475d-8d5d-a756aa1b6582 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:03.450466 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f198c7b2-003e-475d-8d5d-a756aa1b6582 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:03.743417 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-fedae8ce-939c-489b-9594-eefceb5a8336 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4307d3ab621244f29d98d8ef2a40538a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6d0a20c16d4c229b3e7488cf75a35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:03.759059 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-fedae8ce-939c-489b-9594-eefceb5a8336 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] 10.222.0.20 "GET /compute/v2.1/servers/795440d0-6c9d-4317-9c59-dcc268cfa354" status: 200 len: 1509 microversion: 2.1 time: 0.410006 Oct 04 18:51:03.759929 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2480/5014] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:03 2022] GET /compute/v2.1/servers/795440d0-6c9d-4317-9c59-dcc268cfa354 => generated 1509 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:03.764773 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e1bec8b0-4188-4e1b-b76d-f6585398223e tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:03.769087 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e1bec8b0-4188-4e1b-b76d-f6585398223e tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: c6d7d726-8e3f-44de-8d6f-2d8c6187e8df] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:03.786208 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e1bec8b0-4188-4e1b-b76d-f6585398223e tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:03.786719 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e1bec8b0-4188-4e1b-b76d-f6585398223e tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:03.788877 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e1bec8b0-4188-4e1b-b76d-f6585398223e tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:03.788877 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e1bec8b0-4188-4e1b-b76d-f6585398223e tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:03.788877 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e1bec8b0-4188-4e1b-b76d-f6585398223e tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:03.788877 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e1bec8b0-4188-4e1b-b76d-f6585398223e tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:03.821424 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f198c7b2-003e-475d-8d5d-a756aa1b6582 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60055eab0e434fe7a25b50d906c21eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0c83e578904efeb287fa626e7306a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:03.843149 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f198c7b2-003e-475d-8d5d-a756aa1b6582 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] 10.222.0.20 "GET /compute/v2.1/servers/7b559895-fb96-44e4-a48b-090a344316c7" status: 200 len: 1317 microversion: 2.1 time: 0.427398 Oct 04 18:51:03.844032 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2535/5015] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:03 2022] GET /compute/v2.1/servers/7b559895-fb96-44e4-a48b-090a344316c7 => generated 1317 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:03.869650 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-b6133bc2-cd69-4f9c-8ce2-9d3d04e35ad5 req-808e7f6f-1f46-45ee-8dc9-5b5a69b3586f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "795440d0-6c9d-4317-9c59-dcc268cfa354", "name": "network-vif-deleted", "tag": "8add3ba8-ff09-4d66-8428-6407ddbd2e5b"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:51:03.885076 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-b6133bc2-cd69-4f9c-8ce2-9d3d04e35ad5 req-808e7f6f-1f46-45ee-8dc9-5b5a69b3586f service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:03.885580 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-b6133bc2-cd69-4f9c-8ce2-9d3d04e35ad5 req-808e7f6f-1f46-45ee-8dc9-5b5a69b3586f service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:03.886737 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-b6133bc2-cd69-4f9c-8ce2-9d3d04e35ad5 req-808e7f6f-1f46-45ee-8dc9-5b5a69b3586f service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:03.906095 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-b6133bc2-cd69-4f9c-8ce2-9d3d04e35ad5 req-808e7f6f-1f46-45ee-8dc9-5b5a69b3586f service nova] Creating event network-vif-deleted:8add3ba8-ff09-4d66-8428-6407ddbd2e5b for instance 795440d0-6c9d-4317-9c59-dcc268cfa354 on n-h2-850501-14 Oct 04 18:51:03.912609 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-b6133bc2-cd69-4f9c-8ce2-9d3d04e35ad5 req-808e7f6f-1f46-45ee-8dc9-5b5a69b3586f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051613 Oct 04 18:51:03.913221 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2536/5016] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:51:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:51:03.998290 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e1bec8b0-4188-4e1b-b76d-f6585398223e tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:04.012094 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e1bec8b0-4188-4e1b-b76d-f6585398223e tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/c6d7d726-8e3f-44de-8d6f-2d8c6187e8df" status: 200 len: 1493 microversion: 2.1 time: 0.249989 Oct 04 18:51:04.015584 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2481/5017] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:03 2022] GET /compute/v2.1/servers/c6d7d726-8e3f-44de-8d6f-2d8c6187e8df => generated 1493 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:04.380018 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-537fcc4f-7377-431e-8728-410a554ac62f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:04.381243 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-537fcc4f-7377-431e-8728-410a554ac62f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: dcecca6b-779d-4b0f-900a-02287aaac41f] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:04.388366 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-537fcc4f-7377-431e-8728-410a554ac62f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:04.389663 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-537fcc4f-7377-431e-8728-410a554ac62f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:04.390356 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-537fcc4f-7377-431e-8728-410a554ac62f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:04.391306 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-537fcc4f-7377-431e-8728-410a554ac62f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:04.392010 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-537fcc4f-7377-431e-8728-410a554ac62f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:04.392771 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-537fcc4f-7377-431e-8728-410a554ac62f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:04.422628 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:51:04.790247 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1ab6ccb7-35bd-47b6-ba09-b3911bcf5357 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:04.791336 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1ab6ccb7-35bd-47b6-ba09-b3911bcf5357 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] [instance: 795440d0-6c9d-4317-9c59-dcc268cfa354] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:04.814359 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1ab6ccb7-35bd-47b6-ba09-b3911bcf5357 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:04.814359 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1ab6ccb7-35bd-47b6-ba09-b3911bcf5357 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:04.814858 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1ab6ccb7-35bd-47b6-ba09-b3911bcf5357 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:04.817316 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1ab6ccb7-35bd-47b6-ba09-b3911bcf5357 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:04.818476 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1ab6ccb7-35bd-47b6-ba09-b3911bcf5357 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:04.820363 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1ab6ccb7-35bd-47b6-ba09-b3911bcf5357 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:04.866637 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1ab6ccb7-35bd-47b6-ba09-b3911bcf5357 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:04.867820 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1ab6ccb7-35bd-47b6-ba09-b3911bcf5357 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:04.868732 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1ab6ccb7-35bd-47b6-ba09-b3911bcf5357 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:04.869499 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-1ab6ccb7-35bd-47b6-ba09-b3911bcf5357 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lazy-loading 'fault' on Instance uuid 795440d0-6c9d-4317-9c59-dcc268cfa354 {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:51:04.954174 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1ab6ccb7-35bd-47b6-ba09-b3911bcf5357 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4307d3ab621244f29d98d8ef2a40538a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6d0a20c16d4c229b3e7488cf75a35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:04.962814 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1ab6ccb7-35bd-47b6-ba09-b3911bcf5357 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] 10.222.0.20 "GET /compute/v2.1/servers/795440d0-6c9d-4317-9c59-dcc268cfa354" status: 200 len: 1305 microversion: 2.1 time: 0.181947 Oct 04 18:51:04.963404 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2482/5018] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:04 2022] GET /compute/v2.1/servers/795440d0-6c9d-4317-9c59-dcc268cfa354 => generated 1305 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:04.979503 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-49b28607-2773-4b64-9c5a-e0e3def8516a tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:04.980148 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-49b28607-2773-4b64-9c5a-e0e3def8516a tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] [instance: 7b559895-fb96-44e4-a48b-090a344316c7] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:04.998902 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-49b28607-2773-4b64-9c5a-e0e3def8516a tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:04.999404 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-49b28607-2773-4b64-9c5a-e0e3def8516a tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:05.001805 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-49b28607-2773-4b64-9c5a-e0e3def8516a tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:05.002611 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-49b28607-2773-4b64-9c5a-e0e3def8516a tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:05.003070 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-49b28607-2773-4b64-9c5a-e0e3def8516a tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:05.003505 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-49b28607-2773-4b64-9c5a-e0e3def8516a tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:05.243517 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-537fcc4f-7377-431e-8728-410a554ac62f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:05.259258 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-537fcc4f-7377-431e-8728-410a554ac62f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/dcecca6b-779d-4b0f-900a-02287aaac41f" status: 200 len: 1511 microversion: 2.1 time: 0.883670 Oct 04 18:51:05.259862 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2537/5019] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:04 2022] GET /compute/v2.1/servers/dcecca6b-779d-4b0f-900a-02287aaac41f => generated 1511 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:05.271362 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8633c007-cb0c-4c00-9c13-e6b81a24788f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:05.271979 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8633c007-cb0c-4c00-9c13-e6b81a24788f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: c6d7d726-8e3f-44de-8d6f-2d8c6187e8df] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:05.312157 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8633c007-cb0c-4c00-9c13-e6b81a24788f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:05.312157 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8633c007-cb0c-4c00-9c13-e6b81a24788f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:05.312157 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8633c007-cb0c-4c00-9c13-e6b81a24788f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:05.312578 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8633c007-cb0c-4c00-9c13-e6b81a24788f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:05.312856 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8633c007-cb0c-4c00-9c13-e6b81a24788f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:05.313267 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8633c007-cb0c-4c00-9c13-e6b81a24788f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:05.385153 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-49b28607-2773-4b64-9c5a-e0e3def8516a tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60055eab0e434fe7a25b50d906c21eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0c83e578904efeb287fa626e7306a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:05.393715 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-49b28607-2773-4b64-9c5a-e0e3def8516a tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] 10.222.0.20 "GET /compute/v2.1/servers/7b559895-fb96-44e4-a48b-090a344316c7" status: 200 len: 1317 microversion: 2.1 time: 0.429261 Oct 04 18:51:05.399809 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2483/5020] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:04 2022] GET /compute/v2.1/servers/7b559895-fb96-44e4-a48b-090a344316c7 => generated 1317 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:05.404985 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-f6dbc8d1-e4e8-465d-89ef-354b472e0754 req-3e68281c-2e13-428e-9de5-78377d65dad4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b559895-fb96-44e4-a48b-090a344316c7", "name": "network-vif-plugged", "status": "completed", "tag": "f23ab705-7a64-4c5f-bf5a-87d59f6b5acb"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:51:05.429469 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-f6dbc8d1-e4e8-465d-89ef-354b472e0754 req-3e68281c-2e13-428e-9de5-78377d65dad4 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:05.445919 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-f6dbc8d1-e4e8-465d-89ef-354b472e0754 req-3e68281c-2e13-428e-9de5-78377d65dad4 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:05.447933 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-f6dbc8d1-e4e8-465d-89ef-354b472e0754 req-3e68281c-2e13-428e-9de5-78377d65dad4 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:05.480765 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-f6dbc8d1-e4e8-465d-89ef-354b472e0754 req-3e68281c-2e13-428e-9de5-78377d65dad4 service nova] Creating event network-vif-plugged:f23ab705-7a64-4c5f-bf5a-87d59f6b5acb for instance 7b559895-fb96-44e4-a48b-090a344316c7 on n-h2-850501-14 Oct 04 18:51:05.505682 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-f6dbc8d1-e4e8-465d-89ef-354b472e0754 req-3e68281c-2e13-428e-9de5-78377d65dad4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103151 Oct 04 18:51:05.507830 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2484/5021] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:51:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:51:05.649606 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8633c007-cb0c-4c00-9c13-e6b81a24788f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:05.660025 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8633c007-cb0c-4c00-9c13-e6b81a24788f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/c6d7d726-8e3f-44de-8d6f-2d8c6187e8df" status: 200 len: 1493 microversion: 2.1 time: 0.396949 Oct 04 18:51:05.660584 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2538/5022] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:05 2022] GET /compute/v2.1/servers/c6d7d726-8e3f-44de-8d6f-2d8c6187e8df => generated 1493 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:05.994273 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-99ded434-9bb3-4a9f-adf1-7538dc5c0148 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:05.995047 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-99ded434-9bb3-4a9f-adf1-7538dc5c0148 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] [instance: 795440d0-6c9d-4317-9c59-dcc268cfa354] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:06.009871 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-99ded434-9bb3-4a9f-adf1-7538dc5c0148 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:06.010301 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-99ded434-9bb3-4a9f-adf1-7538dc5c0148 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:06.010744 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-99ded434-9bb3-4a9f-adf1-7538dc5c0148 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:06.018634 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-99ded434-9bb3-4a9f-adf1-7538dc5c0148 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:06.019605 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-99ded434-9bb3-4a9f-adf1-7538dc5c0148 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:06.020285 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-99ded434-9bb3-4a9f-adf1-7538dc5c0148 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:06.040600 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-99ded434-9bb3-4a9f-adf1-7538dc5c0148 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] HTTP exception thrown: Instance 795440d0-6c9d-4317-9c59-dcc268cfa354 could not be found. Oct 04 18:51:06.042782 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-99ded434-9bb3-4a9f-adf1-7538dc5c0148 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Request method failure captured: Oct 04 18:51:06.042782 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/795440d0-6c9d-4317-9c59-dcc268cfa354 HTTP/1.1 Oct 04 18:51:06.042782 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:51:06.042782 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:51:06.042782 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:51:06.042782 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:51:06.042782 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:51:06.042782 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:51:06.042782 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:51:06.042782 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:51:06.042782 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPIBdLUmXQ8Xsw7XJE1o9pLkOzUupiwSRt-4g0Np8E_2WnI1_2FuXbyADvD02DnSuJFjijveCXktzUYRxiAWEqaNsrSGnNMI4oHkUZQPZgQqmOe4DNKmWv_riX2zYdSvFi59TpUwe42kek_aJc4HLYiZtocrbIqvjB895g4lfvBYxICY Oct 04 18:51:06.042782 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:51:06.042782 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:51:06.042782 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:51:06.042782 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:51:06.042782 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:51:06.042782 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:51:06.042782 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: ac6d0a20c16d4c229b3e7488cf75a35b Oct 04 18:51:06.042782 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-TestServerAdvancedOps-883108158 Oct 04 18:51:06.042782 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:51:06.042782 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:51:06.042782 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ac6d0a20c16d4c229b3e7488cf75a35b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ac6d0a20c16d4c229b3e7488cf75a35b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ac6d0a20c16d4c229b3e7488cf75a35b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ac6d0a20c16d4c229b3e7488cf75a35b"}]}] Oct 04 18:51:06.042782 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-TestServerAdvancedOps-883108158 Oct 04 18:51:06.042782 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: ac6d0a20c16d4c229b3e7488cf75a35b Oct 04 18:51:06.042782 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-TestServerAdvancedOps-883108158 Oct 04 18:51:06.042782 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-TestServerAdvancedOps-883108158-project Oct 04 18:51:06.042782 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:51:06.042782 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:51:06.042782 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 4307d3ab621244f29d98d8ef2a40538a Oct 04 18:51:06.042782 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-TestServerAdvancedOps-883108158-project Oct 04 18:51:06.042782 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:51:06.042782 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 795440d0-6c9d-4317-9c59-dcc268cfa354 could not be found. Oct 04 18:51:06.042782 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '795440d0-6c9d-4317-9c59-dcc268cfa354'} Oct 04 18:51:06.042782 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:51:06.042782 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:51:06.042782 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:51:06.042782 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:51:06.042782 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:51:06.042782 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:51:06.042782 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:51:06.042782 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:51:06.042782 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:51:06.042782 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:51:06.042782 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 795440d0-6c9d-4317-9c59-dcc268cfa354 could not be found. Oct 04 18:51:06.042782 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:51:06.042782 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:51:06.042782 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:51:06.042782 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:51:06.042782 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:51:06.042782 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:51:06.042782 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:51:06.042782 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:51:06.042782 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:51:06.042782 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:51:06.042782 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:51:06.042782 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:51:06.042782 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:51:06.042782 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:51:06.042782 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:51:06.042782 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:51:06.042782 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 795440d0-6c9d-4317-9c59-dcc268cfa354 could not be found. Oct 04 18:51:06.042782 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:51:06.042782 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:51:06.042782 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:51:06.047617 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:51:06.047617 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:51:06.047617 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:51:06.047617 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:51:06.047617 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:51:06.047617 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 795440d0-6c9d-4317-9c59-dcc268cfa354 could not be found. Oct 04 18:51:06.047617 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:51:06.049643 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-99ded434-9bb3-4a9f-adf1-7538dc5c0148 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] Returning 404 to user: Instance 795440d0-6c9d-4317-9c59-dcc268cfa354 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:51:06.050760 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-99ded434-9bb3-4a9f-adf1-7538dc5c0148 tempest-TestServerAdvancedOps-883108158 tempest-TestServerAdvancedOps-883108158-project] 10.222.0.20 "GET /compute/v2.1/servers/795440d0-6c9d-4317-9c59-dcc268cfa354" status: 404 len: 111 microversion: 2.1 time: 0.061427 Oct 04 18:51:06.052107 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2485/5023] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:05 2022] GET /compute/v2.1/servers/795440d0-6c9d-4317-9c59-dcc268cfa354 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:51:06.298336 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6fc2abaf-1f00-46f9-ac93-67c873158179 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:06.299487 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6fc2abaf-1f00-46f9-ac93-67c873158179 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: dcecca6b-779d-4b0f-900a-02287aaac41f] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:06.312397 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6fc2abaf-1f00-46f9-ac93-67c873158179 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:06.313178 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6fc2abaf-1f00-46f9-ac93-67c873158179 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:06.313799 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6fc2abaf-1f00-46f9-ac93-67c873158179 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:06.315476 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6fc2abaf-1f00-46f9-ac93-67c873158179 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:06.315940 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6fc2abaf-1f00-46f9-ac93-67c873158179 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:06.317181 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6fc2abaf-1f00-46f9-ac93-67c873158179 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:06.424244 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-00aa2210-74be-4d21-87a8-d439607ce9e9 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:06.425491 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-00aa2210-74be-4d21-87a8-d439607ce9e9 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] [instance: 7b559895-fb96-44e4-a48b-090a344316c7] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:06.442128 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-00aa2210-74be-4d21-87a8-d439607ce9e9 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:06.443489 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-00aa2210-74be-4d21-87a8-d439607ce9e9 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:06.444242 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-00aa2210-74be-4d21-87a8-d439607ce9e9 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:06.445200 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-00aa2210-74be-4d21-87a8-d439607ce9e9 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:06.446585 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-00aa2210-74be-4d21-87a8-d439607ce9e9 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:06.447261 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-00aa2210-74be-4d21-87a8-d439607ce9e9 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:06.662270 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6fc2abaf-1f00-46f9-ac93-67c873158179 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:06.676871 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6fc2abaf-1f00-46f9-ac93-67c873158179 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/dcecca6b-779d-4b0f-900a-02287aaac41f" status: 200 len: 1511 microversion: 2.1 time: 0.397671 Oct 04 18:51:06.689580 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2539/5024] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:06 2022] GET /compute/v2.1/servers/dcecca6b-779d-4b0f-900a-02287aaac41f => generated 1511 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:06.693842 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-eac2f14b-3290-4801-aece-893ee3144519 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:06.696548 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-eac2f14b-3290-4801-aece-893ee3144519 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: c6d7d726-8e3f-44de-8d6f-2d8c6187e8df] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:06.717443 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eac2f14b-3290-4801-aece-893ee3144519 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:06.719241 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eac2f14b-3290-4801-aece-893ee3144519 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:06.720658 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eac2f14b-3290-4801-aece-893ee3144519 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:06.723246 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eac2f14b-3290-4801-aece-893ee3144519 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:06.725567 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eac2f14b-3290-4801-aece-893ee3144519 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:06.726840 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eac2f14b-3290-4801-aece-893ee3144519 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:06.973557 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-eac2f14b-3290-4801-aece-893ee3144519 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:06.989288 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-eac2f14b-3290-4801-aece-893ee3144519 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/c6d7d726-8e3f-44de-8d6f-2d8c6187e8df" status: 200 len: 1451 microversion: 2.1 time: 0.303659 Oct 04 18:51:06.990088 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2540/5025] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:06 2022] GET /compute/v2.1/servers/c6d7d726-8e3f-44de-8d6f-2d8c6187e8df => generated 1451 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:07.065014 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-00aa2210-74be-4d21-87a8-d439607ce9e9 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60055eab0e434fe7a25b50d906c21eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0c83e578904efeb287fa626e7306a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:07.085076 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-00aa2210-74be-4d21-87a8-d439607ce9e9 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] 10.222.0.20 "GET /compute/v2.1/servers/7b559895-fb96-44e4-a48b-090a344316c7" status: 200 len: 1317 microversion: 2.1 time: 0.666661 Oct 04 18:51:07.085672 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2486/5026] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:06 2022] GET /compute/v2.1/servers/7b559895-fb96-44e4-a48b-090a344316c7 => generated 1317 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:51:07.408368 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-9c19a802-4ec7-48e0-8245-3f8c7a07ac81 req-710f5a49-9013-409c-b5d7-28528185c94a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6d7d726-8e3f-44de-8d6f-2d8c6187e8df", "name": "network-vif-deleted", "tag": "06e0de3c-b9d6-40ae-9154-56e02ffc7f2f"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:51:07.430429 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-9c19a802-4ec7-48e0-8245-3f8c7a07ac81 req-710f5a49-9013-409c-b5d7-28528185c94a service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:07.431202 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-9c19a802-4ec7-48e0-8245-3f8c7a07ac81 req-710f5a49-9013-409c-b5d7-28528185c94a service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:07.431826 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-9c19a802-4ec7-48e0-8245-3f8c7a07ac81 req-710f5a49-9013-409c-b5d7-28528185c94a service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:07.454533 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-9c19a802-4ec7-48e0-8245-3f8c7a07ac81 req-710f5a49-9013-409c-b5d7-28528185c94a service nova] Creating event network-vif-deleted:06e0de3c-b9d6-40ae-9154-56e02ffc7f2f for instance c6d7d726-8e3f-44de-8d6f-2d8c6187e8df on n-h1-850501-14 Oct 04 18:51:07.466194 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-9c19a802-4ec7-48e0-8245-3f8c7a07ac81 req-710f5a49-9013-409c-b5d7-28528185c94a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062505 Oct 04 18:51:07.467492 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2541/5027] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:51:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:51:07.743519 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1d1af622-f931-4133-93da-ece75623e2ad tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:07.747713 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1d1af622-f931-4133-93da-ece75623e2ad tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: dcecca6b-779d-4b0f-900a-02287aaac41f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:07.767874 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1d1af622-f931-4133-93da-ece75623e2ad tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:07.770006 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1d1af622-f931-4133-93da-ece75623e2ad tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:07.771683 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1d1af622-f931-4133-93da-ece75623e2ad tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:07.777689 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1d1af622-f931-4133-93da-ece75623e2ad tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:07.779414 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1d1af622-f931-4133-93da-ece75623e2ad tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:07.784584 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1d1af622-f931-4133-93da-ece75623e2ad tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:08.015816 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d210a257-bc59-4822-8d13-4c7f9a1fde67 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:08.017596 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d210a257-bc59-4822-8d13-4c7f9a1fde67 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: c6d7d726-8e3f-44de-8d6f-2d8c6187e8df] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:08.031973 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d210a257-bc59-4822-8d13-4c7f9a1fde67 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:08.033331 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d210a257-bc59-4822-8d13-4c7f9a1fde67 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:08.033331 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d210a257-bc59-4822-8d13-4c7f9a1fde67 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:08.037205 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d210a257-bc59-4822-8d13-4c7f9a1fde67 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:08.037780 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d210a257-bc59-4822-8d13-4c7f9a1fde67 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:08.039035 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d210a257-bc59-4822-8d13-4c7f9a1fde67 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:08.127308 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d210a257-bc59-4822-8d13-4c7f9a1fde67 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:08.130904 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d210a257-bc59-4822-8d13-4c7f9a1fde67 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:08.134724 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d210a257-bc59-4822-8d13-4c7f9a1fde67 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:08.135475 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-d210a257-bc59-4822-8d13-4c7f9a1fde67 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lazy-loading 'fault' on Instance uuid c6d7d726-8e3f-44de-8d6f-2d8c6187e8df {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:51:08.268281 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d210a257-bc59-4822-8d13-4c7f9a1fde67 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:08.280255 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1d1af622-f931-4133-93da-ece75623e2ad tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:08.285701 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d210a257-bc59-4822-8d13-4c7f9a1fde67 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/c6d7d726-8e3f-44de-8d6f-2d8c6187e8df" status: 200 len: 1305 microversion: 2.1 time: 0.273133 Oct 04 18:51:08.296458 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2542/5028] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:08 2022] GET /compute/v2.1/servers/c6d7d726-8e3f-44de-8d6f-2d8c6187e8df => generated 1305 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:08.299677 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1d1af622-f931-4133-93da-ece75623e2ad tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/dcecca6b-779d-4b0f-900a-02287aaac41f" status: 200 len: 1511 microversion: 2.1 time: 0.591203 Oct 04 18:51:08.301096 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2487/5029] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:07 2022] GET /compute/v2.1/servers/dcecca6b-779d-4b0f-900a-02287aaac41f => generated 1511 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:08.307643 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7c01b611-07b6-4694-a45e-6f156b343fd2 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:08.312532 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7c01b611-07b6-4694-a45e-6f156b343fd2 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] [instance: 7b559895-fb96-44e4-a48b-090a344316c7] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:08.316408 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7c01b611-07b6-4694-a45e-6f156b343fd2 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:08.317406 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7c01b611-07b6-4694-a45e-6f156b343fd2 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:08.317406 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7c01b611-07b6-4694-a45e-6f156b343fd2 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:08.318353 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7c01b611-07b6-4694-a45e-6f156b343fd2 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:08.318857 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7c01b611-07b6-4694-a45e-6f156b343fd2 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:08.319502 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7c01b611-07b6-4694-a45e-6f156b343fd2 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:08.651526 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7c01b611-07b6-4694-a45e-6f156b343fd2 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60055eab0e434fe7a25b50d906c21eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0c83e578904efeb287fa626e7306a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:08.662104 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7c01b611-07b6-4694-a45e-6f156b343fd2 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] 10.222.0.20 "GET /compute/v2.1/servers/7b559895-fb96-44e4-a48b-090a344316c7" status: 200 len: 1507 microversion: 2.1 time: 0.364242 Oct 04 18:51:08.662764 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2543/5030] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:08 2022] GET /compute/v2.1/servers/7b559895-fb96-44e4-a48b-090a344316c7 => generated 1507 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:08.696343 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-02918026-59fd-487e-9969-6db6ad889ee8 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:08.696909 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-02918026-59fd-487e-9969-6db6ad889ee8 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] [instance: 7b559895-fb96-44e4-a48b-090a344316c7] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:08.706788 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-02918026-59fd-487e-9969-6db6ad889ee8 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:08.707301 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-02918026-59fd-487e-9969-6db6ad889ee8 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:08.707915 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-02918026-59fd-487e-9969-6db6ad889ee8 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:08.708501 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-02918026-59fd-487e-9969-6db6ad889ee8 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:08.708962 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-02918026-59fd-487e-9969-6db6ad889ee8 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:08.726522 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-02918026-59fd-487e-9969-6db6ad889ee8 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:08.764073 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-02918026-59fd-487e-9969-6db6ad889ee8 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '60055eab0e434fe7a25b50d906c21eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0c83e578904efeb287fa626e7306a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:08.765126 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-02918026-59fd-487e-9969-6db6ad889ee8 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] 10.222.0.20 "GET /compute/v2.1/servers/7b559895-fb96-44e4-a48b-090a344316c7/os-instance-actions/req-aa77d918-7e15-45d4-958d-cd8fca527e5f" status: 200 len: 313 microversion: 2.1 time: 0.073427 Oct 04 18:51:08.766691 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2488/5031] 10.222.0.20 () {58 vars in 1419 bytes} [Tue Oct 4 18:51:08 2022] GET /compute/v2.1/servers/7b559895-fb96-44e4-a48b-090a344316c7/os-instance-actions/req-aa77d918-7e15-45d4-958d-cd8fca527e5f => generated 313 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:51:08.780769 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f039f134-71ee-48eb-ab8c-19a3e4febc1d tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:51:08.791078 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f039f134-71ee-48eb-ab8c-19a3e4febc1d tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] [instance: 7b559895-fb96-44e4-a48b-090a344316c7] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:08.793209 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f039f134-71ee-48eb-ab8c-19a3e4febc1d tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:08.794435 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f039f134-71ee-48eb-ab8c-19a3e4febc1d tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:08.795058 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f039f134-71ee-48eb-ab8c-19a3e4febc1d tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:08.795935 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f039f134-71ee-48eb-ab8c-19a3e4febc1d tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:08.796570 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f039f134-71ee-48eb-ab8c-19a3e4febc1d tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:08.797196 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f039f134-71ee-48eb-ab8c-19a3e4febc1d tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:09.068249 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f039f134-71ee-48eb-ab8c-19a3e4febc1d tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] 10.222.0.20 "POST /compute/v2.1/servers/7b559895-fb96-44e4-a48b-090a344316c7/action" status: 202 len: 0 microversion: 2.1 time: 0.292193 Oct 04 18:51:09.070082 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2544/5032] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:51:08 2022] POST /compute/v2.1/servers/7b559895-fb96-44e4-a48b-090a344316c7/action => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:51:09.078066 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e21e066c-d0f3-4842-8b78-28b13d76802e tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:09.078963 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e21e066c-d0f3-4842-8b78-28b13d76802e tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] [instance: 7b559895-fb96-44e4-a48b-090a344316c7] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:09.091702 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e21e066c-d0f3-4842-8b78-28b13d76802e tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:09.092335 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e21e066c-d0f3-4842-8b78-28b13d76802e tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:09.092788 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e21e066c-d0f3-4842-8b78-28b13d76802e tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:09.093522 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e21e066c-d0f3-4842-8b78-28b13d76802e tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:09.093988 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e21e066c-d0f3-4842-8b78-28b13d76802e tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:09.103587 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e21e066c-d0f3-4842-8b78-28b13d76802e tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:09.311939 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-42ff1515-8078-465a-96f3-945bfec021a8 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:09.313413 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-42ff1515-8078-465a-96f3-945bfec021a8 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: c6d7d726-8e3f-44de-8d6f-2d8c6187e8df] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:09.338293 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-42ff1515-8078-465a-96f3-945bfec021a8 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:09.339169 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-42ff1515-8078-465a-96f3-945bfec021a8 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:09.339814 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-42ff1515-8078-465a-96f3-945bfec021a8 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:09.341433 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-42ff1515-8078-465a-96f3-945bfec021a8 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:09.342243 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-42ff1515-8078-465a-96f3-945bfec021a8 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:09.344603 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-42ff1515-8078-465a-96f3-945bfec021a8 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:09.365002 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-42ff1515-8078-465a-96f3-945bfec021a8 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] HTTP exception thrown: Instance c6d7d726-8e3f-44de-8d6f-2d8c6187e8df could not be found. Oct 04 18:51:09.367249 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-42ff1515-8078-465a-96f3-945bfec021a8 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Request method failure captured: Oct 04 18:51:09.367249 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/c6d7d726-8e3f-44de-8d6f-2d8c6187e8df HTTP/1.1 Oct 04 18:51:09.367249 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:51:09.367249 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:51:09.367249 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:51:09.367249 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:51:09.367249 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:51:09.367249 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:51:09.367249 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:51:09.367249 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:51:09.367249 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPIAZ5RZP-L2AfGhXbSAirsikFtiKRJw8GbD2F4avTn6csTjPvYW4EgckMMa_odYrXTBqTIarrxxpsgj83P_nCf0n9cSTNLxyj6f4zISS1Nx3NxppTvrxz8bw1hclhfH5hpAMl_7yiEWC9J95Zeea4ou_80fw0GmE8GZRBOxEg7cn1lU Oct 04 18:51:09.367249 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:51:09.367249 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:51:09.367249 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:51:09.367249 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:51:09.367249 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:51:09.367249 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:51:09.367249 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 4154ec20e0354ee6a425ba853b8efe67 Oct 04 18:51:09.367249 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-DeleteServersTestJSON-806460860 Oct 04 18:51:09.367249 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:51:09.367249 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:51:09.367249 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4154ec20e0354ee6a425ba853b8efe67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4154ec20e0354ee6a425ba853b8efe67", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4154ec20e0354ee6a425ba853b8efe67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4154ec20e0354ee6a425ba853b8efe67"}]}] Oct 04 18:51:09.367249 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-DeleteServersTestJSON-806460860 Oct 04 18:51:09.367249 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 4154ec20e0354ee6a425ba853b8efe67 Oct 04 18:51:09.367249 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-DeleteServersTestJSON-806460860 Oct 04 18:51:09.367249 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-DeleteServersTestJSON-806460860-project Oct 04 18:51:09.367249 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:51:09.367249 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:51:09.367249 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: c56b67cede6b46f5a36a723d361b3245 Oct 04 18:51:09.367249 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-DeleteServersTestJSON-806460860-project Oct 04 18:51:09.367249 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:51:09.367249 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance c6d7d726-8e3f-44de-8d6f-2d8c6187e8df could not be found. Oct 04 18:51:09.367249 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': 'c6d7d726-8e3f-44de-8d6f-2d8c6187e8df'} Oct 04 18:51:09.367249 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:51:09.367249 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:51:09.367249 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:51:09.367249 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:51:09.367249 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:51:09.367249 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:51:09.367249 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:51:09.367249 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:51:09.367249 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:51:09.367249 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:51:09.367249 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6d7d726-8e3f-44de-8d6f-2d8c6187e8df could not be found. Oct 04 18:51:09.367249 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:51:09.367249 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:51:09.367249 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:51:09.367249 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:51:09.367249 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:51:09.367249 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:51:09.367249 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:51:09.367249 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:51:09.367249 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:51:09.367249 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:51:09.367249 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:51:09.367249 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:51:09.367249 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:51:09.367249 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:51:09.367249 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:51:09.367249 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:51:09.367249 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6d7d726-8e3f-44de-8d6f-2d8c6187e8df could not be found. Oct 04 18:51:09.367249 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:51:09.367249 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:51:09.367249 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:51:09.372803 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:51:09.372803 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:51:09.372803 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:51:09.372803 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:51:09.372803 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:51:09.372803 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6d7d726-8e3f-44de-8d6f-2d8c6187e8df could not be found. Oct 04 18:51:09.372803 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:51:09.374567 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-42ff1515-8078-465a-96f3-945bfec021a8 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Returning 404 to user: Instance c6d7d726-8e3f-44de-8d6f-2d8c6187e8df could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:51:09.375668 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-42ff1515-8078-465a-96f3-945bfec021a8 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/c6d7d726-8e3f-44de-8d6f-2d8c6187e8df" status: 404 len: 111 microversion: 2.1 time: 0.068351 Oct 04 18:51:09.376891 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2545/5033] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:09 2022] GET /compute/v2.1/servers/c6d7d726-8e3f-44de-8d6f-2d8c6187e8df => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:51:09.381985 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d25bc4b1-244f-4a01-bea8-c59864bb2383 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:09.383026 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d25bc4b1-244f-4a01-bea8-c59864bb2383 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: dcecca6b-779d-4b0f-900a-02287aaac41f] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:09.404303 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d25bc4b1-244f-4a01-bea8-c59864bb2383 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:09.405928 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d25bc4b1-244f-4a01-bea8-c59864bb2383 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:09.406604 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d25bc4b1-244f-4a01-bea8-c59864bb2383 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:09.408890 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d25bc4b1-244f-4a01-bea8-c59864bb2383 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:09.409612 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d25bc4b1-244f-4a01-bea8-c59864bb2383 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:09.412684 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d25bc4b1-244f-4a01-bea8-c59864bb2383 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:09.425396 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e21e066c-d0f3-4842-8b78-28b13d76802e tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60055eab0e434fe7a25b50d906c21eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0c83e578904efeb287fa626e7306a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:09.479475 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e21e066c-d0f3-4842-8b78-28b13d76802e tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] 10.222.0.20 "GET /compute/v2.1/servers/7b559895-fb96-44e4-a48b-090a344316c7" status: 200 len: 1509 microversion: 2.1 time: 0.405258 Oct 04 18:51:09.484544 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2489/5034] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:09 2022] GET /compute/v2.1/servers/7b559895-fb96-44e4-a48b-090a344316c7 => generated 1509 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:09.578473 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1c8bd2dc-196c-4c99-b651-83f2eadf28d2 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-515448087", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": [{"uuid": "8e684a5f-0995-474b-b515-28954add873e"}]}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:51:09.682297 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-1c8bd2dc-196c-4c99-b651-83f2eadf28d2 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] validate_networks() for [('8e684a5f-0995-474b-b515-28954add873e', None, None, None, None, None)] {{(pid=123002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:51:09.742977 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d25bc4b1-244f-4a01-bea8-c59864bb2383 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:09.752314 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d25bc4b1-244f-4a01-bea8-c59864bb2383 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/dcecca6b-779d-4b0f-900a-02287aaac41f" status: 200 len: 1511 microversion: 2.1 time: 0.374019 Oct 04 18:51:09.769072 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2546/5035] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:09 2022] GET /compute/v2.1/servers/dcecca6b-779d-4b0f-900a-02287aaac41f => generated 1511 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:10.504754 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-441f162b-fbf0-45db-8583-bd7a6040cd77 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:10.505428 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-441f162b-fbf0-45db-8583-bd7a6040cd77 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] [instance: 7b559895-fb96-44e4-a48b-090a344316c7] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:10.522026 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-441f162b-fbf0-45db-8583-bd7a6040cd77 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:10.531307 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-441f162b-fbf0-45db-8583-bd7a6040cd77 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:10.532085 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-441f162b-fbf0-45db-8583-bd7a6040cd77 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:10.532872 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-441f162b-fbf0-45db-8583-bd7a6040cd77 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:10.533351 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-441f162b-fbf0-45db-8583-bd7a6040cd77 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:10.533844 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-441f162b-fbf0-45db-8583-bd7a6040cd77 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:10.843416 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-1c8bd2dc-196c-4c99-b651-83f2eadf28d2 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:51:10.843958 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-1c8bd2dc-196c-4c99-b651-83f2eadf28d2 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:51:10.844885 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-1c8bd2dc-196c-4c99-b651-83f2eadf28d2 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:51:10.845699 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-1c8bd2dc-196c-4c99-b651-83f2eadf28d2 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:51:10.846225 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-1c8bd2dc-196c-4c99-b651-83f2eadf28d2 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:51:10.868389 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1c8bd2dc-196c-4c99-b651-83f2eadf28d2 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:10.872440 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1c8bd2dc-196c-4c99-b651-83f2eadf28d2 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:10.880977 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1c8bd2dc-196c-4c99-b651-83f2eadf28d2 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:10.884844 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1c8bd2dc-196c-4c99-b651-83f2eadf28d2 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:10.886029 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1c8bd2dc-196c-4c99-b651-83f2eadf28d2 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:10.890059 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1c8bd2dc-196c-4c99-b651-83f2eadf28d2 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:10.900280 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-441f162b-fbf0-45db-8583-bd7a6040cd77 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60055eab0e434fe7a25b50d906c21eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0c83e578904efeb287fa626e7306a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:10.911965 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-441f162b-fbf0-45db-8583-bd7a6040cd77 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] 10.222.0.20 "GET /compute/v2.1/servers/7b559895-fb96-44e4-a48b-090a344316c7" status: 200 len: 1509 microversion: 2.1 time: 0.411609 Oct 04 18:51:10.916423 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2547/5036] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:10 2022] GET /compute/v2.1/servers/7b559895-fb96-44e4-a48b-090a344316c7 => generated 1509 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:10.927583 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-1c8bd2dc-196c-4c99-b651-83f2eadf28d2 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Getting quotas for project 4154ec20e0354ee6a425ba853b8efe67. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:51:10.933963 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-fe3019d9-cd9a-46a9-a081-6c7de038c034 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:10.935058 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-1c8bd2dc-196c-4c99-b651-83f2eadf28d2 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Getting quotas for user c56b67cede6b46f5a36a723d361b3245 and project 4154ec20e0354ee6a425ba853b8efe67. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:51:10.935696 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-fe3019d9-cd9a-46a9-a081-6c7de038c034 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: dcecca6b-779d-4b0f-900a-02287aaac41f] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:10.944168 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fe3019d9-cd9a-46a9-a081-6c7de038c034 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:10.947002 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fe3019d9-cd9a-46a9-a081-6c7de038c034 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:10.948393 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fe3019d9-cd9a-46a9-a081-6c7de038c034 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:10.949278 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fe3019d9-cd9a-46a9-a081-6c7de038c034 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:10.951808 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1c8bd2dc-196c-4c99-b651-83f2eadf28d2 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Going to run 1 instances... {{(pid=123002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:51:10.953241 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fe3019d9-cd9a-46a9-a081-6c7de038c034 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:10.953761 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fe3019d9-cd9a-46a9-a081-6c7de038c034 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:10.955131 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1c8bd2dc-196c-4c99-b651-83f2eadf28d2 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9eaa25a-0821-47fb-a16e-d07bcde9cc60] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:51:11.149806 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1c8bd2dc-196c-4c99-b651-83f2eadf28d2 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.571522 Oct 04 18:51:11.153699 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2490/5037] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:51:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1580 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:51:11.165384 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-43bdb4e3-eed2-4b1a-8924-9a5130d80dd4 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:11.167657 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-43bdb4e3-eed2-4b1a-8924-9a5130d80dd4 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9eaa25a-0821-47fb-a16e-d07bcde9cc60] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:11.316807 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-43bdb4e3-eed2-4b1a-8924-9a5130d80dd4 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:11.324760 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-43bdb4e3-eed2-4b1a-8924-9a5130d80dd4 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60" status: 200 len: 1214 microversion: 2.1 time: 0.164139 Oct 04 18:51:11.328426 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2491/5038] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:11 2022] GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60 => generated 1214 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:51:11.473140 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-fe3019d9-cd9a-46a9-a081-6c7de038c034 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:11.489927 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-fe3019d9-cd9a-46a9-a081-6c7de038c034 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/dcecca6b-779d-4b0f-900a-02287aaac41f" status: 200 len: 1511 microversion: 2.1 time: 0.571966 Oct 04 18:51:11.493751 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2548/5039] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:10 2022] GET /compute/v2.1/servers/dcecca6b-779d-4b0f-900a-02287aaac41f => generated 1511 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:11.946273 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-185770ae-7ce7-43e3-ae40-39becfd823da tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:11.947016 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-185770ae-7ce7-43e3-ae40-39becfd823da tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] [instance: 7b559895-fb96-44e4-a48b-090a344316c7] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:11.956048 n-d-850501-14 devstack@n-api.service[123002]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 18:51:11.956576 n-d-850501-14 devstack@n-api.service[123002]: Tue Oct 4 18:51:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7b559895-fb96-44e4-a48b-090a344316c7 (ip 10.222.0.20) !!! Oct 04 18:51:11.959810 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-185770ae-7ce7-43e3-ae40-39becfd823da tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:11.960969 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-185770ae-7ce7-43e3-ae40-39becfd823da tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:11.961835 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-185770ae-7ce7-43e3-ae40-39becfd823da tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:11.962817 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-185770ae-7ce7-43e3-ae40-39becfd823da tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:11.963534 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-185770ae-7ce7-43e3-ae40-39becfd823da tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:11.964261 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-185770ae-7ce7-43e3-ae40-39becfd823da tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:12.353679 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-02bc16fd-c75c-434c-b462-12409e3b278d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:12.354912 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-02bc16fd-c75c-434c-b462-12409e3b278d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9eaa25a-0821-47fb-a16e-d07bcde9cc60] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:12.680338 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-02bc16fd-c75c-434c-b462-12409e3b278d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:12.700271 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-02bc16fd-c75c-434c-b462-12409e3b278d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60" status: 200 len: 1214 microversion: 2.1 time: 0.350197 Oct 04 18:51:12.704704 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2549/5040] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:12 2022] GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60 => generated 1214 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:51:12.733771 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-99221c8d-f85e-423b-848a-18db356cda04 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:12.736025 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-99221c8d-f85e-423b-848a-18db356cda04 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: dcecca6b-779d-4b0f-900a-02287aaac41f] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:12.744804 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-185770ae-7ce7-43e3-ae40-39becfd823da tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60055eab0e434fe7a25b50d906c21eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0c83e578904efeb287fa626e7306a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:12.764603 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-99221c8d-f85e-423b-848a-18db356cda04 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:12.768406 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-99221c8d-f85e-423b-848a-18db356cda04 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:12.769278 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-185770ae-7ce7-43e3-ae40-39becfd823da tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] 10.222.0.20 "GET /compute/v2.1/servers/7b559895-fb96-44e4-a48b-090a344316c7" status: 200 len: 1514 microversion: 2.1 time: 0.827778 Oct 04 18:51:12.769473 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-99221c8d-f85e-423b-848a-18db356cda04 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:12.769913 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2492/5041] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:11 2022] GET /compute/v2.1/servers/7b559895-fb96-44e4-a48b-090a344316c7 => generated 1514 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:12.773515 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-99221c8d-f85e-423b-848a-18db356cda04 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:12.774807 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-99221c8d-f85e-423b-848a-18db356cda04 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:12.778788 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-99221c8d-f85e-423b-848a-18db356cda04 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:13.171879 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-99221c8d-f85e-423b-848a-18db356cda04 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:13.188627 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-99221c8d-f85e-423b-848a-18db356cda04 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/dcecca6b-779d-4b0f-900a-02287aaac41f" status: 200 len: 1511 microversion: 2.1 time: 0.481396 Oct 04 18:51:13.200925 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2550/5042] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:12 2022] GET /compute/v2.1/servers/dcecca6b-779d-4b0f-900a-02287aaac41f => generated 1511 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:13.741351 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e5fda73c-41f3-4cfc-bbae-3c7656cb1865 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:13.742141 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e5fda73c-41f3-4cfc-bbae-3c7656cb1865 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9eaa25a-0821-47fb-a16e-d07bcde9cc60] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:13.756241 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e5fda73c-41f3-4cfc-bbae-3c7656cb1865 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:13.757178 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e5fda73c-41f3-4cfc-bbae-3c7656cb1865 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:13.757881 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e5fda73c-41f3-4cfc-bbae-3c7656cb1865 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:13.758829 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e5fda73c-41f3-4cfc-bbae-3c7656cb1865 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:13.759512 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e5fda73c-41f3-4cfc-bbae-3c7656cb1865 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:13.761021 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e5fda73c-41f3-4cfc-bbae-3c7656cb1865 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:13.802866 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c886b3a6-1602-43fe-94a8-66e175e3c52c tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:13.803471 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c886b3a6-1602-43fe-94a8-66e175e3c52c tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] [instance: 7b559895-fb96-44e4-a48b-090a344316c7] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:13.812916 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c886b3a6-1602-43fe-94a8-66e175e3c52c tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:13.814021 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c886b3a6-1602-43fe-94a8-66e175e3c52c tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:13.814631 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c886b3a6-1602-43fe-94a8-66e175e3c52c tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:13.815582 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c886b3a6-1602-43fe-94a8-66e175e3c52c tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:13.816418 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c886b3a6-1602-43fe-94a8-66e175e3c52c tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:13.816968 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c886b3a6-1602-43fe-94a8-66e175e3c52c tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:13.884881 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e5fda73c-41f3-4cfc-bbae-3c7656cb1865 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:13.905889 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e5fda73c-41f3-4cfc-bbae-3c7656cb1865 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60" status: 200 len: 1266 microversion: 2.1 time: 0.168797 Oct 04 18:51:13.907322 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2493/5043] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:13 2022] GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:14.082495 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c886b3a6-1602-43fe-94a8-66e175e3c52c tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60055eab0e434fe7a25b50d906c21eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0c83e578904efeb287fa626e7306a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:14.094416 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c886b3a6-1602-43fe-94a8-66e175e3c52c tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] 10.222.0.20 "GET /compute/v2.1/servers/7b559895-fb96-44e4-a48b-090a344316c7" status: 200 len: 1507 microversion: 2.1 time: 0.295295 Oct 04 18:51:14.111148 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2551/5044] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:13 2022] GET /compute/v2.1/servers/7b559895-fb96-44e4-a48b-090a344316c7 => generated 1507 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:14.119388 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-bfa3514e-17ef-4185-a5b7-74aacc20a0dd tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Calling method '.version_select at 0x7fe259588820>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:14.119968 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-bfa3514e-17ef-4185-a5b7-74aacc20a0dd tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] [instance: 7b559895-fb96-44e4-a48b-090a344316c7] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:14.127814 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bfa3514e-17ef-4185-a5b7-74aacc20a0dd tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:14.130958 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bfa3514e-17ef-4185-a5b7-74aacc20a0dd tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:14.130958 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bfa3514e-17ef-4185-a5b7-74aacc20a0dd tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:14.130958 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bfa3514e-17ef-4185-a5b7-74aacc20a0dd tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:14.130958 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bfa3514e-17ef-4185-a5b7-74aacc20a0dd tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:14.130958 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bfa3514e-17ef-4185-a5b7-74aacc20a0dd tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:14.170050 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-bfa3514e-17ef-4185-a5b7-74aacc20a0dd tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] 10.222.0.20 "GET /compute/v2.1/servers/7b559895-fb96-44e4-a48b-090a344316c7/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.054623 Oct 04 18:51:14.170656 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2494/5045] 10.222.0.20 () {58 vars in 1296 bytes} [Tue Oct 4 18:51:14 2022] GET /compute/v2.1/servers/7b559895-fb96-44e4-a48b-090a344316c7/os-instance-actions => generated 611 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:51:14.186120 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-88c3be7c-66ad-4f5a-8f4f-73ad94827174 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:14.186954 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-88c3be7c-66ad-4f5a-8f4f-73ad94827174 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] [instance: 7b559895-fb96-44e4-a48b-090a344316c7] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:14.194299 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-88c3be7c-66ad-4f5a-8f4f-73ad94827174 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:14.195095 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-88c3be7c-66ad-4f5a-8f4f-73ad94827174 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:14.195774 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-88c3be7c-66ad-4f5a-8f4f-73ad94827174 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:14.196718 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-88c3be7c-66ad-4f5a-8f4f-73ad94827174 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:14.197394 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-88c3be7c-66ad-4f5a-8f4f-73ad94827174 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:14.198048 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-88c3be7c-66ad-4f5a-8f4f-73ad94827174 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:14.221639 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-15decc8c-0c00-4a10-b0b7-124a2a8a1d10 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:14.222461 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-15decc8c-0c00-4a10-b0b7-124a2a8a1d10 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: dcecca6b-779d-4b0f-900a-02287aaac41f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:14.235171 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-15decc8c-0c00-4a10-b0b7-124a2a8a1d10 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:14.235828 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-15decc8c-0c00-4a10-b0b7-124a2a8a1d10 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:14.236888 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-15decc8c-0c00-4a10-b0b7-124a2a8a1d10 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:14.239926 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-15decc8c-0c00-4a10-b0b7-124a2a8a1d10 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:14.240636 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-15decc8c-0c00-4a10-b0b7-124a2a8a1d10 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:14.241150 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-15decc8c-0c00-4a10-b0b7-124a2a8a1d10 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:14.252466 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-88c3be7c-66ad-4f5a-8f4f-73ad94827174 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] [instance: 7b559895-fb96-44e4-a48b-090a344316c7] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:51:14.537105 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:51:14.621968 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-15decc8c-0c00-4a10-b0b7-124a2a8a1d10 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:14.634854 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-15decc8c-0c00-4a10-b0b7-124a2a8a1d10 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/dcecca6b-779d-4b0f-900a-02287aaac41f" status: 200 len: 1511 microversion: 2.1 time: 0.417470 Oct 04 18:51:14.638056 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2495/5046] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:14 2022] GET /compute/v2.1/servers/dcecca6b-779d-4b0f-900a-02287aaac41f => generated 1511 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:51:14.688460 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-88c3be7c-66ad-4f5a-8f4f-73ad94827174 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7b559895-fb96-44e4-a48b-090a344316c7" status: 204 len: 0 microversion: 2.1 time: 0.507988 Oct 04 18:51:14.690021 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2552/5047] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:51:14 2022] DELETE /compute/v2.1/servers/7b559895-fb96-44e4-a48b-090a344316c7 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:51:14.699096 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f2ce210b-75ef-4e7f-ac84-56d9f51e3eca tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:14.700438 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f2ce210b-75ef-4e7f-ac84-56d9f51e3eca tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] [instance: 7b559895-fb96-44e4-a48b-090a344316c7] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:14.716234 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f2ce210b-75ef-4e7f-ac84-56d9f51e3eca tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:14.717005 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f2ce210b-75ef-4e7f-ac84-56d9f51e3eca tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:14.717652 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f2ce210b-75ef-4e7f-ac84-56d9f51e3eca tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:14.718530 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f2ce210b-75ef-4e7f-ac84-56d9f51e3eca tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:14.719146 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f2ce210b-75ef-4e7f-ac84-56d9f51e3eca tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:14.719731 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f2ce210b-75ef-4e7f-ac84-56d9f51e3eca tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:14.931105 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0c4c5a3a-bde0-417b-83bb-a3d9b1b8a808 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:14.931892 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0c4c5a3a-bde0-417b-83bb-a3d9b1b8a808 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9eaa25a-0821-47fb-a16e-d07bcde9cc60] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:14.939059 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0c4c5a3a-bde0-417b-83bb-a3d9b1b8a808 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:14.939602 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0c4c5a3a-bde0-417b-83bb-a3d9b1b8a808 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:14.940041 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0c4c5a3a-bde0-417b-83bb-a3d9b1b8a808 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:14.940815 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0c4c5a3a-bde0-417b-83bb-a3d9b1b8a808 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:14.941233 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0c4c5a3a-bde0-417b-83bb-a3d9b1b8a808 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:14.941657 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0c4c5a3a-bde0-417b-83bb-a3d9b1b8a808 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:14.974772 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:51:15.079207 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0c4c5a3a-bde0-417b-83bb-a3d9b1b8a808 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:15.086812 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0c4c5a3a-bde0-417b-83bb-a3d9b1b8a808 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60" status: 200 len: 1272 microversion: 2.1 time: 0.160573 Oct 04 18:51:15.089387 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2553/5048] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:14 2022] GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60 => generated 1272 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:15.108763 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f2ce210b-75ef-4e7f-ac84-56d9f51e3eca tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60055eab0e434fe7a25b50d906c21eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0c83e578904efeb287fa626e7306a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:15.117704 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f2ce210b-75ef-4e7f-ac84-56d9f51e3eca tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] 10.222.0.20 "GET /compute/v2.1/servers/7b559895-fb96-44e4-a48b-090a344316c7" status: 200 len: 1513 microversion: 2.1 time: 0.423138 Oct 04 18:51:15.118845 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2496/5049] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:14 2022] GET /compute/v2.1/servers/7b559895-fb96-44e4-a48b-090a344316c7 => generated 1513 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:15.664941 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0bb51b98-c090-4572-9bf3-d792933d9e81 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:15.666272 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0bb51b98-c090-4572-9bf3-d792933d9e81 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: dcecca6b-779d-4b0f-900a-02287aaac41f] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:15.686779 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0bb51b98-c090-4572-9bf3-d792933d9e81 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:15.688166 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0bb51b98-c090-4572-9bf3-d792933d9e81 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:15.688834 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0bb51b98-c090-4572-9bf3-d792933d9e81 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:15.689865 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0bb51b98-c090-4572-9bf3-d792933d9e81 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:15.690554 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0bb51b98-c090-4572-9bf3-d792933d9e81 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:15.691259 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0bb51b98-c090-4572-9bf3-d792933d9e81 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:16.100866 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0bb51b98-c090-4572-9bf3-d792933d9e81 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:16.115033 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0bb51b98-c090-4572-9bf3-d792933d9e81 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/dcecca6b-779d-4b0f-900a-02287aaac41f" status: 200 len: 1511 microversion: 2.1 time: 0.453936 Oct 04 18:51:16.118290 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-24ae6740-0dc5-47b8-993a-f0e50ff10fd8 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:16.119656 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-24ae6740-0dc5-47b8-993a-f0e50ff10fd8 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9eaa25a-0821-47fb-a16e-d07bcde9cc60] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:16.133605 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2554/5050] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:15 2022] GET /compute/v2.1/servers/dcecca6b-779d-4b0f-900a-02287aaac41f => generated 1511 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:16.137416 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-24ae6740-0dc5-47b8-993a-f0e50ff10fd8 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:16.138210 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-24ae6740-0dc5-47b8-993a-f0e50ff10fd8 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:16.140934 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-24ae6740-0dc5-47b8-993a-f0e50ff10fd8 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:16.140934 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-24ae6740-0dc5-47b8-993a-f0e50ff10fd8 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:16.141426 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-24ae6740-0dc5-47b8-993a-f0e50ff10fd8 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:16.144905 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-85bcf7fd-8493-4435-a99c-1c2b88e30ede tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:16.146855 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-24ae6740-0dc5-47b8-993a-f0e50ff10fd8 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:16.147176 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-85bcf7fd-8493-4435-a99c-1c2b88e30ede tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] [instance: 7b559895-fb96-44e4-a48b-090a344316c7] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:16.157754 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-85bcf7fd-8493-4435-a99c-1c2b88e30ede tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:16.158617 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-85bcf7fd-8493-4435-a99c-1c2b88e30ede tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:16.159434 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-85bcf7fd-8493-4435-a99c-1c2b88e30ede tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:16.160444 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-85bcf7fd-8493-4435-a99c-1c2b88e30ede tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:16.161104 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-85bcf7fd-8493-4435-a99c-1c2b88e30ede tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:16.161825 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-85bcf7fd-8493-4435-a99c-1c2b88e30ede tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:16.475637 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-85bcf7fd-8493-4435-a99c-1c2b88e30ede tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60055eab0e434fe7a25b50d906c21eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0c83e578904efeb287fa626e7306a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:16.486367 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-85bcf7fd-8493-4435-a99c-1c2b88e30ede tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] 10.222.0.20 "GET /compute/v2.1/servers/7b559895-fb96-44e4-a48b-090a344316c7" status: 200 len: 1513 microversion: 2.1 time: 0.347083 Oct 04 18:51:16.504710 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2555/5051] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:16 2022] GET /compute/v2.1/servers/7b559895-fb96-44e4-a48b-090a344316c7 => generated 1513 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:51:16.554655 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-24ae6740-0dc5-47b8-993a-f0e50ff10fd8 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:16.593616 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-24ae6740-0dc5-47b8-993a-f0e50ff10fd8 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60" status: 200 len: 1314 microversion: 2.1 time: 0.477352 Oct 04 18:51:16.599439 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2497/5052] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:16 2022] GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60 => generated 1314 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:17.144289 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-cf986fca-b80c-4d41-89e4-f80f27ed5db0 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:17.146867 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-cf986fca-b80c-4d41-89e4-f80f27ed5db0 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: dcecca6b-779d-4b0f-900a-02287aaac41f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:17.164929 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cf986fca-b80c-4d41-89e4-f80f27ed5db0 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:17.171432 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cf986fca-b80c-4d41-89e4-f80f27ed5db0 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:17.173631 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cf986fca-b80c-4d41-89e4-f80f27ed5db0 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:17.178075 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cf986fca-b80c-4d41-89e4-f80f27ed5db0 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:17.182013 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cf986fca-b80c-4d41-89e4-f80f27ed5db0 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:17.183326 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cf986fca-b80c-4d41-89e4-f80f27ed5db0 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:17.236761 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2856703d-3c6a-4e98-9e81-914741942e56 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-1364789060", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": [{"uuid": "de3275f0-e598-4846-b3b3-cf3766555c60"}]}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:51:17.342880 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.neutron [None req-2856703d-3c6a-4e98-9e81-914741942e56 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] validate_networks() for [('de3275f0-e598-4846-b3b3-cf3766555c60', None, None, None, None, None)] {{(pid=123001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:51:17.935998 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-cf986fca-b80c-4d41-89e4-f80f27ed5db0 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:17.952424 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-cf986fca-b80c-4d41-89e4-f80f27ed5db0 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/dcecca6b-779d-4b0f-900a-02287aaac41f" status: 200 len: 1511 microversion: 2.1 time: 0.816985 Oct 04 18:51:17.953994 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2498/5053] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:17 2022] GET /compute/v2.1/servers/dcecca6b-779d-4b0f-900a-02287aaac41f => generated 1511 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:17.961186 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-58514d2a-5df7-4358-9158-edd3ec18eb1d tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:17.961998 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-58514d2a-5df7-4358-9158-edd3ec18eb1d tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] [instance: 7b559895-fb96-44e4-a48b-090a344316c7] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:17.969219 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-58514d2a-5df7-4358-9158-edd3ec18eb1d tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:17.969708 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-58514d2a-5df7-4358-9158-edd3ec18eb1d tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:17.970144 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-58514d2a-5df7-4358-9158-edd3ec18eb1d tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:17.970847 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-58514d2a-5df7-4358-9158-edd3ec18eb1d tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:17.971300 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-58514d2a-5df7-4358-9158-edd3ec18eb1d tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:17.972235 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-58514d2a-5df7-4358-9158-edd3ec18eb1d tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:17.977810 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=100 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:51:18.082152 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-58514d2a-5df7-4358-9158-edd3ec18eb1d tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60055eab0e434fe7a25b50d906c21eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0c83e578904efeb287fa626e7306a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:18.092467 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-58514d2a-5df7-4358-9158-edd3ec18eb1d tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] 10.222.0.20 "GET /compute/v2.1/servers/7b559895-fb96-44e4-a48b-090a344316c7" status: 200 len: 1471 microversion: 2.1 time: 0.137351 Oct 04 18:51:18.107341 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2499/5054] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:17 2022] GET /compute/v2.1/servers/7b559895-fb96-44e4-a48b-090a344316c7 => generated 1471 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:18.143148 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e6f45391-a237-4148-b06c-b05be4a4dc86 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:18.146246 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e6f45391-a237-4148-b06c-b05be4a4dc86 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9eaa25a-0821-47fb-a16e-d07bcde9cc60] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:18.166768 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e6f45391-a237-4148-b06c-b05be4a4dc86 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:18.167253 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e6f45391-a237-4148-b06c-b05be4a4dc86 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:18.169201 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e6f45391-a237-4148-b06c-b05be4a4dc86 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:18.169945 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e6f45391-a237-4148-b06c-b05be4a4dc86 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:18.171141 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e6f45391-a237-4148-b06c-b05be4a4dc86 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:18.171575 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e6f45391-a237-4148-b06c-b05be4a4dc86 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:18.536437 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e6f45391-a237-4148-b06c-b05be4a4dc86 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:18.539127 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e6f45391-a237-4148-b06c-b05be4a4dc86 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60" status: 200 len: 1314 microversion: 2.1 time: 0.410759 Oct 04 18:51:18.539726 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2500/5055] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:18 2022] GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60 => generated 1314 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:18.603575 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-a84b1252-4996-46f7-826f-cee9db4751af req-bf3103fc-7f0f-4449-923c-670d0ad05743 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b559895-fb96-44e4-a48b-090a344316c7", "name": "network-vif-deleted", "tag": "f23ab705-7a64-4c5f-bf5a-87d59f6b5acb"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:51:18.630147 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-a84b1252-4996-46f7-826f-cee9db4751af req-bf3103fc-7f0f-4449-923c-670d0ad05743 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:18.633853 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-a84b1252-4996-46f7-826f-cee9db4751af req-bf3103fc-7f0f-4449-923c-670d0ad05743 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:18.634589 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-a84b1252-4996-46f7-826f-cee9db4751af req-bf3103fc-7f0f-4449-923c-670d0ad05743 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:18.667599 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-a84b1252-4996-46f7-826f-cee9db4751af req-bf3103fc-7f0f-4449-923c-670d0ad05743 service nova] Creating event network-vif-deleted:f23ab705-7a64-4c5f-bf5a-87d59f6b5acb for instance 7b559895-fb96-44e4-a48b-090a344316c7 on n-h2-850501-14 Oct 04 18:51:18.686020 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-a84b1252-4996-46f7-826f-cee9db4751af req-bf3103fc-7f0f-4449-923c-670d0ad05743 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112749 Oct 04 18:51:18.691150 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2501/5056] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:51:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:51:18.977511 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b36aa4ba-c881-4045-be41-90bd91c43836 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:18.978192 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b36aa4ba-c881-4045-be41-90bd91c43836 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: dcecca6b-779d-4b0f-900a-02287aaac41f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:18.999329 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b36aa4ba-c881-4045-be41-90bd91c43836 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:18.999329 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b36aa4ba-c881-4045-be41-90bd91c43836 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:18.999329 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b36aa4ba-c881-4045-be41-90bd91c43836 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:18.999329 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b36aa4ba-c881-4045-be41-90bd91c43836 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:19.000233 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b36aa4ba-c881-4045-be41-90bd91c43836 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:19.002389 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b36aa4ba-c881-4045-be41-90bd91c43836 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:19.111429 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-2856703d-3c6a-4e98-9e81-914741942e56 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:51:19.111909 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-2856703d-3c6a-4e98-9e81-914741942e56 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:51:19.112422 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-2856703d-3c6a-4e98-9e81-914741942e56 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:51:19.113104 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-2856703d-3c6a-4e98-9e81-914741942e56 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:51:19.113940 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-2856703d-3c6a-4e98-9e81-914741942e56 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:51:19.146046 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2856703d-3c6a-4e98-9e81-914741942e56 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:19.146737 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2856703d-3c6a-4e98-9e81-914741942e56 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:19.147577 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2856703d-3c6a-4e98-9e81-914741942e56 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:19.149136 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2856703d-3c6a-4e98-9e81-914741942e56 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:19.149802 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2856703d-3c6a-4e98-9e81-914741942e56 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:19.161503 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2856703d-3c6a-4e98-9e81-914741942e56 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:19.199838 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-2856703d-3c6a-4e98-9e81-914741942e56 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Getting quotas for project 92b4487fe1814c8e892d803f909557ed. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:51:19.206369 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-2856703d-3c6a-4e98-9e81-914741942e56 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Getting quotas for user 7faf4e5c164941c2bcf5ba6e8f100b9d and project 92b4487fe1814c8e892d803f909557ed. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:51:19.224287 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2856703d-3c6a-4e98-9e81-914741942e56 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Going to run 1 instances... {{(pid=123001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:51:19.227894 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2856703d-3c6a-4e98-9e81-914741942e56 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] [instance: d209c762-5668-445f-aabf-9952ba110f38] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:51:19.330246 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b36aa4ba-c881-4045-be41-90bd91c43836 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:19.347875 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b36aa4ba-c881-4045-be41-90bd91c43836 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/dcecca6b-779d-4b0f-900a-02287aaac41f" status: 200 len: 1488 microversion: 2.1 time: 0.374168 Oct 04 18:51:19.349304 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2502/5057] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:18 2022] GET /compute/v2.1/servers/dcecca6b-779d-4b0f-900a-02287aaac41f => generated 1488 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:51:19.362440 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c5673e73-f765-4ed5-a5d9-10ea5ca4f38c tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:19.364157 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c5673e73-f765-4ed5-a5d9-10ea5ca4f38c tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] [instance: 7b559895-fb96-44e4-a48b-090a344316c7] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:19.376016 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c5673e73-f765-4ed5-a5d9-10ea5ca4f38c tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:19.377139 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c5673e73-f765-4ed5-a5d9-10ea5ca4f38c tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:19.378042 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c5673e73-f765-4ed5-a5d9-10ea5ca4f38c tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:19.379292 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c5673e73-f765-4ed5-a5d9-10ea5ca4f38c tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:19.379960 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c5673e73-f765-4ed5-a5d9-10ea5ca4f38c tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:19.381495 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c5673e73-f765-4ed5-a5d9-10ea5ca4f38c tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:19.429545 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c5673e73-f765-4ed5-a5d9-10ea5ca4f38c tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:19.430478 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c5673e73-f765-4ed5-a5d9-10ea5ca4f38c tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:19.431294 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c5673e73-f765-4ed5-a5d9-10ea5ca4f38c tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:19.431982 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-c5673e73-f765-4ed5-a5d9-10ea5ca4f38c tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lazy-loading 'fault' on Instance uuid 7b559895-fb96-44e4-a48b-090a344316c7 {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:51:19.516997 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2856703d-3c6a-4e98-9e81-914741942e56 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.762516 Oct 04 18:51:19.519434 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2556/5058] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:51:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 2767 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:51:19.530748 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c5673e73-f765-4ed5-a5d9-10ea5ca4f38c tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60055eab0e434fe7a25b50d906c21eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0c83e578904efeb287fa626e7306a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:19.537774 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-75983ce1-4666-40ca-9d6c-4e3e37457707 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:51:19.540727 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-75983ce1-4666-40ca-9d6c-4e3e37457707 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:19.552474 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-75983ce1-4666-40ca-9d6c-4e3e37457707 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:19.553330 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-75983ce1-4666-40ca-9d6c-4e3e37457707 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:19.553989 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-75983ce1-4666-40ca-9d6c-4e3e37457707 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:19.554929 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-75983ce1-4666-40ca-9d6c-4e3e37457707 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:19.555831 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c5673e73-f765-4ed5-a5d9-10ea5ca4f38c tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] 10.222.0.20 "GET /compute/v2.1/servers/7b559895-fb96-44e4-a48b-090a344316c7" status: 200 len: 1307 microversion: 2.1 time: 0.204463 Oct 04 18:51:19.556242 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-75983ce1-4666-40ca-9d6c-4e3e37457707 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:19.557194 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-75983ce1-4666-40ca-9d6c-4e3e37457707 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:19.573787 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2503/5059] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:19 2022] GET /compute/v2.1/servers/7b559895-fb96-44e4-a48b-090a344316c7 => generated 1307 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:19.588251 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-03aeaa3e-473d-4f89-bbf4-7c07057d0043 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:19.588884 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-03aeaa3e-473d-4f89-bbf4-7c07057d0043 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] [instance: d209c762-5668-445f-aabf-9952ba110f38] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:19.664722 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-75983ce1-4666-40ca-9d6c-4e3e37457707 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "POST /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238/action" status: 200 len: 152 microversion: 2.1 time: 0.141404 Oct 04 18:51:19.665696 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2557/5060] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:51:19 2022] POST /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238/action => generated 152 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:51:19.692620 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-db575767-648d-4552-a4c3-62f0e857ebc8 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:19.702065 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-db575767-648d-4552-a4c3-62f0e857ebc8 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9eaa25a-0821-47fb-a16e-d07bcde9cc60] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:19.729341 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-db575767-648d-4552-a4c3-62f0e857ebc8 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:19.729479 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-03aeaa3e-473d-4f89-bbf4-7c07057d0043 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7faf4e5c164941c2bcf5ba6e8f100b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b4487fe1814c8e892d803f909557ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:19.729587 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-db575767-648d-4552-a4c3-62f0e857ebc8 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:19.729587 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-db575767-648d-4552-a4c3-62f0e857ebc8 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:19.730267 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-db575767-648d-4552-a4c3-62f0e857ebc8 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:19.731278 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-db575767-648d-4552-a4c3-62f0e857ebc8 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:19.731724 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-db575767-648d-4552-a4c3-62f0e857ebc8 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:19.737944 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-03aeaa3e-473d-4f89-bbf4-7c07057d0043 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] 10.222.0.20 "GET /compute/v2.1/servers/d209c762-5668-445f-aabf-9952ba110f38" status: 200 len: 1228 microversion: 2.1 time: 0.162503 Oct 04 18:51:19.745014 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2504/5061] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:19 2022] GET /compute/v2.1/servers/d209c762-5668-445f-aabf-9952ba110f38 => generated 1228 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:19.764089 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-91b1c017-7446-4a00-80ef-79f979386b4b tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:19.776125 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-91b1c017-7446-4a00-80ef-79f979386b4b tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:19.788518 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-91b1c017-7446-4a00-80ef-79f979386b4b tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:19.795080 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-91b1c017-7446-4a00-80ef-79f979386b4b tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:19.796474 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-91b1c017-7446-4a00-80ef-79f979386b4b tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:19.798374 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-91b1c017-7446-4a00-80ef-79f979386b4b tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:19.802757 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-91b1c017-7446-4a00-80ef-79f979386b4b tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:19.804721 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-91b1c017-7446-4a00-80ef-79f979386b4b tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:20.001843 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-db575767-648d-4552-a4c3-62f0e857ebc8 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:20.018962 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-db575767-648d-4552-a4c3-62f0e857ebc8 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60" status: 200 len: 1314 microversion: 2.1 time: 0.351351 Oct 04 18:51:20.050471 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2558/5062] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:19 2022] GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60 => generated 1314 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:20.136642 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-91b1c017-7446-4a00-80ef-79f979386b4b tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:20.158136 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-91b1c017-7446-4a00-80ef-79f979386b4b tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1672 microversion: 2.1 time: 0.398793 Oct 04 18:51:20.158136 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2505/5063] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:19 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1672 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:20.174592 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0457387f-d50f-4212-9001-b07164ee7018 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:20.175881 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0457387f-d50f-4212-9001-b07164ee7018 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:20.188380 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0457387f-d50f-4212-9001-b07164ee7018 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:20.189604 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0457387f-d50f-4212-9001-b07164ee7018 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:20.190050 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0457387f-d50f-4212-9001-b07164ee7018 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:20.191136 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0457387f-d50f-4212-9001-b07164ee7018 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:20.191791 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0457387f-d50f-4212-9001-b07164ee7018 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:20.193711 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0457387f-d50f-4212-9001-b07164ee7018 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:20.492661 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0457387f-d50f-4212-9001-b07164ee7018 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:20.501496 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0457387f-d50f-4212-9001-b07164ee7018 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1672 microversion: 2.1 time: 0.331012 Oct 04 18:51:20.503363 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2559/5064] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:20 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1672 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:20.530377 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-897c76e6-7c20-4051-8a79-1f354e010208 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:20.531793 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-897c76e6-7c20-4051-8a79-1f354e010208 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:20.539234 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-897c76e6-7c20-4051-8a79-1f354e010208 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:20.546467 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-897c76e6-7c20-4051-8a79-1f354e010208 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:20.546467 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-897c76e6-7c20-4051-8a79-1f354e010208 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:20.546467 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-897c76e6-7c20-4051-8a79-1f354e010208 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:20.546467 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-897c76e6-7c20-4051-8a79-1f354e010208 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:20.546467 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-897c76e6-7c20-4051-8a79-1f354e010208 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:20.599406 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7067a4df-bb05-4da4-b560-fe64c9856d94 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:20.602209 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7067a4df-bb05-4da4-b560-fe64c9856d94 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] [instance: 7b559895-fb96-44e4-a48b-090a344316c7] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:20.614561 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7067a4df-bb05-4da4-b560-fe64c9856d94 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:20.615065 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7067a4df-bb05-4da4-b560-fe64c9856d94 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:20.615776 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7067a4df-bb05-4da4-b560-fe64c9856d94 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:20.616708 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7067a4df-bb05-4da4-b560-fe64c9856d94 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:20.617172 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7067a4df-bb05-4da4-b560-fe64c9856d94 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:20.617655 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7067a4df-bb05-4da4-b560-fe64c9856d94 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:20.636135 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-7067a4df-bb05-4da4-b560-fe64c9856d94 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] HTTP exception thrown: Instance 7b559895-fb96-44e4-a48b-090a344316c7 could not be found. Oct 04 18:51:20.638560 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7067a4df-bb05-4da4-b560-fe64c9856d94 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Request method failure captured: Oct 04 18:51:20.638560 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/7b559895-fb96-44e4-a48b-090a344316c7 HTTP/1.1 Oct 04 18:51:20.638560 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:51:20.638560 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:51:20.638560 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:51:20.638560 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:51:20.638560 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:51:20.638560 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:51:20.638560 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:51:20.638560 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:51:20.638560 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPICDjLi9TZ93SULim07zMUc9VWW_YzzHlSuCsjje-Yw08GmqA1O9o-NOtPjP7w2kJe1wfewI7Ke-oAGNfvGPf6tdvlclTzi4ZE4g32rSyJSgIr9dbvLw3-ZkNYbZkvLqRsfFF5IF-hsNyOXvHNpSgv63iFOCTfW7YDnsazYsXkgk4Zs Oct 04 18:51:20.638560 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:51:20.638560 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:51:20.638560 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:51:20.638560 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:51:20.638560 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:51:20.638560 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:51:20.638560 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 1c0c83e578904efeb287fa626e7306a6 Oct 04 18:51:20.638560 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-InstanceActionsTestJSON-146647420 Oct 04 18:51:20.638560 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:51:20.638560 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:51:20.638560 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1c0c83e578904efeb287fa626e7306a6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1c0c83e578904efeb287fa626e7306a6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1c0c83e578904efeb287fa626e7306a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1c0c83e578904efeb287fa626e7306a6"}]}] Oct 04 18:51:20.638560 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-InstanceActionsTestJSON-146647420 Oct 04 18:51:20.638560 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 1c0c83e578904efeb287fa626e7306a6 Oct 04 18:51:20.638560 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-InstanceActionsTestJSON-146647420 Oct 04 18:51:20.638560 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-InstanceActionsTestJSON-146647420-project Oct 04 18:51:20.638560 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:51:20.638560 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:51:20.638560 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 60055eab0e434fe7a25b50d906c21eb7 Oct 04 18:51:20.638560 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-InstanceActionsTestJSON-146647420-project Oct 04 18:51:20.638560 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:51:20.638560 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 7b559895-fb96-44e4-a48b-090a344316c7 could not be found. Oct 04 18:51:20.638560 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '7b559895-fb96-44e4-a48b-090a344316c7'} Oct 04 18:51:20.638560 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:51:20.638560 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:51:20.638560 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:51:20.638560 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:51:20.638560 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:51:20.638560 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:51:20.638560 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:51:20.638560 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:51:20.638560 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:51:20.638560 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:51:20.638560 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b559895-fb96-44e4-a48b-090a344316c7 could not be found. Oct 04 18:51:20.638560 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:51:20.638560 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:51:20.638560 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:51:20.638560 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:51:20.638560 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:51:20.638560 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:51:20.638560 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:51:20.638560 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:51:20.638560 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:51:20.638560 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:51:20.638560 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:51:20.638560 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:51:20.638560 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:51:20.638560 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:51:20.638560 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:51:20.638560 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:51:20.638560 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b559895-fb96-44e4-a48b-090a344316c7 could not be found. Oct 04 18:51:20.638560 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:51:20.638560 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:51:20.638560 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:51:20.643966 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:51:20.643966 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:51:20.643966 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:51:20.643966 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:51:20.643966 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:51:20.643966 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b559895-fb96-44e4-a48b-090a344316c7 could not be found. Oct 04 18:51:20.643966 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:51:20.643966 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7067a4df-bb05-4da4-b560-fe64c9856d94 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] Returning 404 to user: Instance 7b559895-fb96-44e4-a48b-090a344316c7 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:51:20.643966 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7067a4df-bb05-4da4-b560-fe64c9856d94 tempest-InstanceActionsTestJSON-146647420 tempest-InstanceActionsTestJSON-146647420-project] 10.222.0.20 "GET /compute/v2.1/servers/7b559895-fb96-44e4-a48b-090a344316c7" status: 404 len: 111 microversion: 2.1 time: 0.044870 Oct 04 18:51:20.645534 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2560/5065] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:20 2022] GET /compute/v2.1/servers/7b559895-fb96-44e4-a48b-090a344316c7 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:51:20.711241 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-0000586e-4810-41bb-8bd4-482f08b6c3e2 req-b0eb7b68-8303-4585-a9e3-1641c2596d45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9eaa25a-0821-47fb-a16e-d07bcde9cc60", "tag": "b323ea97-81a2-4778-8096-32e05d6f2440"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:51:20.734117 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-0000586e-4810-41bb-8bd4-482f08b6c3e2 req-b0eb7b68-8303-4585-a9e3-1641c2596d45 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:20.734624 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-0000586e-4810-41bb-8bd4-482f08b6c3e2 req-b0eb7b68-8303-4585-a9e3-1641c2596d45 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:20.735065 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-0000586e-4810-41bb-8bd4-482f08b6c3e2 req-b0eb7b68-8303-4585-a9e3-1641c2596d45 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:20.754620 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-0000586e-4810-41bb-8bd4-482f08b6c3e2 req-b0eb7b68-8303-4585-a9e3-1641c2596d45 service nova] Creating event network-changed:b323ea97-81a2-4778-8096-32e05d6f2440 for instance a9eaa25a-0821-47fb-a16e-d07bcde9cc60 on n-h2-850501-14 Oct 04 18:51:20.764366 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-0000586e-4810-41bb-8bd4-482f08b6c3e2 req-b0eb7b68-8303-4585-a9e3-1641c2596d45 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057086 Oct 04 18:51:20.766277 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2561/5066] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:51:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:51:20.774952 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7ed54502-879f-44ac-a902-93642c45fb49 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:20.775784 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7ed54502-879f-44ac-a902-93642c45fb49 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] [instance: d209c762-5668-445f-aabf-9952ba110f38] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:20.915079 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:51:21.048000 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7ed54502-879f-44ac-a902-93642c45fb49 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7faf4e5c164941c2bcf5ba6e8f100b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b4487fe1814c8e892d803f909557ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:21.055325 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7ed54502-879f-44ac-a902-93642c45fb49 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] 10.222.0.20 "GET /compute/v2.1/servers/d209c762-5668-445f-aabf-9952ba110f38" status: 200 len: 1228 microversion: 2.1 time: 0.287244 Oct 04 18:51:21.062873 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2562/5067] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:20 2022] GET /compute/v2.1/servers/d209c762-5668-445f-aabf-9952ba110f38 => generated 1228 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:21.078021 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-64071abc-bf16-4933-b0a6-834283a61cec tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:21.080323 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-64071abc-bf16-4933-b0a6-834283a61cec tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9eaa25a-0821-47fb-a16e-d07bcde9cc60] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:21.102460 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-64071abc-bf16-4933-b0a6-834283a61cec tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:21.103223 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-64071abc-bf16-4933-b0a6-834283a61cec tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:21.104313 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-64071abc-bf16-4933-b0a6-834283a61cec tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:21.106169 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-64071abc-bf16-4933-b0a6-834283a61cec tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:21.109511 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-64071abc-bf16-4933-b0a6-834283a61cec tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:21.111394 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-64071abc-bf16-4933-b0a6-834283a61cec tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:21.411239 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-897c76e6-7c20-4051-8a79-1f354e010208 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:21.422516 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-897c76e6-7c20-4051-8a79-1f354e010208 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1672 microversion: 2.1 time: 0.899544 Oct 04 18:51:21.442521 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2506/5068] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:20 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1672 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:21.458920 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-87fe501f-30a6-4808-91b9-210b4d20c2f5 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:21.459902 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-87fe501f-30a6-4808-91b9-210b4d20c2f5 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:21.473044 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-87fe501f-30a6-4808-91b9-210b4d20c2f5 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:21.473551 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-87fe501f-30a6-4808-91b9-210b4d20c2f5 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:21.475114 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-87fe501f-30a6-4808-91b9-210b4d20c2f5 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:21.477094 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-87fe501f-30a6-4808-91b9-210b4d20c2f5 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:21.478323 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-87fe501f-30a6-4808-91b9-210b4d20c2f5 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:21.482323 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-87fe501f-30a6-4808-91b9-210b4d20c2f5 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:21.531431 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-64071abc-bf16-4933-b0a6-834283a61cec tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:21.544086 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-64071abc-bf16-4933-b0a6-834283a61cec tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60" status: 200 len: 1314 microversion: 2.1 time: 0.479564 Oct 04 18:51:21.560453 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2563/5069] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:21 2022] GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60 => generated 1314 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:21.843001 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-87fe501f-30a6-4808-91b9-210b4d20c2f5 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:21.856411 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-87fe501f-30a6-4808-91b9-210b4d20c2f5 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1672 microversion: 2.1 time: 0.407409 Oct 04 18:51:21.859489 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2507/5070] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:21 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1672 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:22.019258 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7e7bd37e-8d86-4340-95c2-e710cf1c9041 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-457147275", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": [{"uuid": "5739801d-d64f-45ac-b67b-5773a9d23794"}]}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:51:22.081080 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6c6bb4cd-0f4d-4364-bb8b-ab31abb22ab4 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:22.081937 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-6c6bb4cd-0f4d-4364-bb8b-ab31abb22ab4 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] [instance: d209c762-5668-445f-aabf-9952ba110f38] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:22.088121 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6c6bb4cd-0f4d-4364-bb8b-ab31abb22ab4 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:22.088620 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6c6bb4cd-0f4d-4364-bb8b-ab31abb22ab4 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:22.088871 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.neutron [None req-7e7bd37e-8d86-4340-95c2-e710cf1c9041 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] validate_networks() for [('5739801d-d64f-45ac-b67b-5773a9d23794', None, None, None, None, None)] {{(pid=123001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:51:22.089070 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6c6bb4cd-0f4d-4364-bb8b-ab31abb22ab4 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:22.090562 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6c6bb4cd-0f4d-4364-bb8b-ab31abb22ab4 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:22.091407 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6c6bb4cd-0f4d-4364-bb8b-ab31abb22ab4 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:22.092083 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6c6bb4cd-0f4d-4364-bb8b-ab31abb22ab4 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:22.358460 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-6c6bb4cd-0f4d-4364-bb8b-ab31abb22ab4 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7faf4e5c164941c2bcf5ba6e8f100b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b4487fe1814c8e892d803f909557ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:22.380765 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6c6bb4cd-0f4d-4364-bb8b-ab31abb22ab4 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] 10.222.0.20 "GET /compute/v2.1/servers/d209c762-5668-445f-aabf-9952ba110f38" status: 200 len: 1280 microversion: 2.1 time: 0.300553 Oct 04 18:51:22.399985 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2508/5071] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:22 2022] GET /compute/v2.1/servers/d209c762-5668-445f-aabf-9952ba110f38 => generated 1280 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:22.568023 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b81b9c79-9648-485b-b328-361ac86b249d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:22.568605 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b81b9c79-9648-485b-b328-361ac86b249d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9eaa25a-0821-47fb-a16e-d07bcde9cc60] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:22.578458 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b81b9c79-9648-485b-b328-361ac86b249d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:22.579325 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b81b9c79-9648-485b-b328-361ac86b249d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:22.580356 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b81b9c79-9648-485b-b328-361ac86b249d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:22.581303 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b81b9c79-9648-485b-b328-361ac86b249d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:22.581959 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b81b9c79-9648-485b-b328-361ac86b249d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:22.582585 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b81b9c79-9648-485b-b328-361ac86b249d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:22.787848 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-7e7bd37e-8d86-4340-95c2-e710cf1c9041 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:51:22.795505 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-7e7bd37e-8d86-4340-95c2-e710cf1c9041 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:51:22.796399 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-7e7bd37e-8d86-4340-95c2-e710cf1c9041 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:51:22.797043 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-7e7bd37e-8d86-4340-95c2-e710cf1c9041 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:51:22.798120 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-7e7bd37e-8d86-4340-95c2-e710cf1c9041 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:51:22.834180 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b81b9c79-9648-485b-b328-361ac86b249d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:22.837330 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7e7bd37e-8d86-4340-95c2-e710cf1c9041 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:22.837509 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7e7bd37e-8d86-4340-95c2-e710cf1c9041 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:22.839282 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7e7bd37e-8d86-4340-95c2-e710cf1c9041 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:22.841624 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7e7bd37e-8d86-4340-95c2-e710cf1c9041 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:22.844457 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7e7bd37e-8d86-4340-95c2-e710cf1c9041 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:22.848430 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7e7bd37e-8d86-4340-95c2-e710cf1c9041 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:22.860920 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b81b9c79-9648-485b-b328-361ac86b249d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60" status: 200 len: 1314 microversion: 2.1 time: 0.294693 Oct 04 18:51:22.862997 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2509/5072] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:22 2022] GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60 => generated 1314 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:22.890163 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-7e7bd37e-8d86-4340-95c2-e710cf1c9041 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Getting quotas for project 57d8fd392d5b4e8798cb51fe0e54ad3b. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:51:22.896322 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-7e7bd37e-8d86-4340-95c2-e710cf1c9041 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Getting quotas for user ee7fee2b098d4eb8bdc8df2a929cdede and project 57d8fd392d5b4e8798cb51fe0e54ad3b. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:51:22.914528 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7e7bd37e-8d86-4340-95c2-e710cf1c9041 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Going to run 1 instances... {{(pid=123001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:51:22.918424 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7e7bd37e-8d86-4340-95c2-e710cf1c9041 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: fc136da8-3767-4c12-906c-d3a3562ccba4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:51:23.094268 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7e7bd37e-8d86-4340-95c2-e710cf1c9041 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.078817 Oct 04 18:51:23.095527 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2564/5073] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:51:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1081 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:51:23.107845 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5e22d4e5-e400-4a9b-aae5-8ef4559d6f5e tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:23.108561 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5e22d4e5-e400-4a9b-aae5-8ef4559d6f5e tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: fc136da8-3767-4c12-906c-d3a3562ccba4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:23.279085 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5e22d4e5-e400-4a9b-aae5-8ef4559d6f5e tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:23.292156 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5e22d4e5-e400-4a9b-aae5-8ef4559d6f5e tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/fc136da8-3767-4c12-906c-d3a3562ccba4" status: 200 len: 1214 microversion: 2.1 time: 0.189323 Oct 04 18:51:23.293312 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2510/5074] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:23 2022] GET /compute/v2.1/servers/fc136da8-3767-4c12-906c-d3a3562ccba4 => generated 1214 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:23.413822 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-cdbbc0e0-c4ca-4e9d-a6b0-7fbfa1b0e762 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:23.414455 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-cdbbc0e0-c4ca-4e9d-a6b0-7fbfa1b0e762 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] [instance: d209c762-5668-445f-aabf-9952ba110f38] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:23.429526 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cdbbc0e0-c4ca-4e9d-a6b0-7fbfa1b0e762 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:23.430093 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cdbbc0e0-c4ca-4e9d-a6b0-7fbfa1b0e762 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:23.430532 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cdbbc0e0-c4ca-4e9d-a6b0-7fbfa1b0e762 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:23.431244 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cdbbc0e0-c4ca-4e9d-a6b0-7fbfa1b0e762 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:23.431696 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cdbbc0e0-c4ca-4e9d-a6b0-7fbfa1b0e762 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:23.432137 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cdbbc0e0-c4ca-4e9d-a6b0-7fbfa1b0e762 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:23.551948 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-cdbbc0e0-c4ca-4e9d-a6b0-7fbfa1b0e762 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7faf4e5c164941c2bcf5ba6e8f100b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b4487fe1814c8e892d803f909557ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:23.562753 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-cdbbc0e0-c4ca-4e9d-a6b0-7fbfa1b0e762 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] 10.222.0.20 "GET /compute/v2.1/servers/d209c762-5668-445f-aabf-9952ba110f38" status: 200 len: 1286 microversion: 2.1 time: 0.156541 Oct 04 18:51:23.565823 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2565/5075] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:23 2022] GET /compute/v2.1/servers/d209c762-5668-445f-aabf-9952ba110f38 => generated 1286 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:51:23.891832 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-76a9c33a-6cd1-497f-9e68-f79a0a6acb0f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:23.895958 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-76a9c33a-6cd1-497f-9e68-f79a0a6acb0f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9eaa25a-0821-47fb-a16e-d07bcde9cc60] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:23.930469 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-76a9c33a-6cd1-497f-9e68-f79a0a6acb0f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:23.932464 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-76a9c33a-6cd1-497f-9e68-f79a0a6acb0f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:23.933369 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-76a9c33a-6cd1-497f-9e68-f79a0a6acb0f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:23.939507 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-76a9c33a-6cd1-497f-9e68-f79a0a6acb0f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:23.940343 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-76a9c33a-6cd1-497f-9e68-f79a0a6acb0f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:23.941572 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-76a9c33a-6cd1-497f-9e68-f79a0a6acb0f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:24.315937 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-17fd5fba-b5bc-4096-8f75-4271dca5ac91 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:24.316414 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-17fd5fba-b5bc-4096-8f75-4271dca5ac91 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: fc136da8-3767-4c12-906c-d3a3562ccba4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:24.366686 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-76a9c33a-6cd1-497f-9e68-f79a0a6acb0f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:24.412605 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-76a9c33a-6cd1-497f-9e68-f79a0a6acb0f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60" status: 200 len: 1314 microversion: 2.1 time: 0.527609 Oct 04 18:51:24.414900 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2511/5076] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:23 2022] GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60 => generated 1314 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:24.490008 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-17fd5fba-b5bc-4096-8f75-4271dca5ac91 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:24.503143 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-17fd5fba-b5bc-4096-8f75-4271dca5ac91 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/fc136da8-3767-4c12-906c-d3a3562ccba4" status: 200 len: 1214 microversion: 2.1 time: 0.191170 Oct 04 18:51:24.506319 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2566/5077] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:24 2022] GET /compute/v2.1/servers/fc136da8-3767-4c12-906c-d3a3562ccba4 => generated 1214 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:24.590569 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-943d219b-eb5e-4501-9095-45550f10d1ec tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:24.591601 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-943d219b-eb5e-4501-9095-45550f10d1ec tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] [instance: d209c762-5668-445f-aabf-9952ba110f38] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:24.609360 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-943d219b-eb5e-4501-9095-45550f10d1ec tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:24.610660 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-943d219b-eb5e-4501-9095-45550f10d1ec tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:24.611506 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-943d219b-eb5e-4501-9095-45550f10d1ec tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:24.618217 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-943d219b-eb5e-4501-9095-45550f10d1ec tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:24.619009 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-943d219b-eb5e-4501-9095-45550f10d1ec tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:24.620105 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-943d219b-eb5e-4501-9095-45550f10d1ec tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:24.704559 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-943d219b-eb5e-4501-9095-45550f10d1ec tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7faf4e5c164941c2bcf5ba6e8f100b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b4487fe1814c8e892d803f909557ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:24.715540 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-943d219b-eb5e-4501-9095-45550f10d1ec tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] 10.222.0.20 "GET /compute/v2.1/servers/d209c762-5668-445f-aabf-9952ba110f38" status: 200 len: 1286 microversion: 2.1 time: 0.129184 Oct 04 18:51:24.736696 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2512/5078] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:24 2022] GET /compute/v2.1/servers/d209c762-5668-445f-aabf-9952ba110f38 => generated 1286 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:25.444787 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-31ec107e-0cda-4bcc-9506-636cff946518 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:25.446867 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-31ec107e-0cda-4bcc-9506-636cff946518 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9eaa25a-0821-47fb-a16e-d07bcde9cc60] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:25.461973 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-31ec107e-0cda-4bcc-9506-636cff946518 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:25.465735 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-31ec107e-0cda-4bcc-9506-636cff946518 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:25.470686 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-31ec107e-0cda-4bcc-9506-636cff946518 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:25.471956 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-31ec107e-0cda-4bcc-9506-636cff946518 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:25.472710 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-31ec107e-0cda-4bcc-9506-636cff946518 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:25.473399 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-31ec107e-0cda-4bcc-9506-636cff946518 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:25.531389 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2d223b16-fac3-4319-ba9a-60cfda7c55ed tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:25.532868 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2d223b16-fac3-4319-ba9a-60cfda7c55ed tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: fc136da8-3767-4c12-906c-d3a3562ccba4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:25.569652 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2d223b16-fac3-4319-ba9a-60cfda7c55ed tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:25.570358 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2d223b16-fac3-4319-ba9a-60cfda7c55ed tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:25.570909 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2d223b16-fac3-4319-ba9a-60cfda7c55ed tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:25.571666 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2d223b16-fac3-4319-ba9a-60cfda7c55ed tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:25.572728 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2d223b16-fac3-4319-ba9a-60cfda7c55ed tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:25.573382 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2d223b16-fac3-4319-ba9a-60cfda7c55ed tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:25.867220 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2d223b16-fac3-4319-ba9a-60cfda7c55ed tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:25.879241 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2d223b16-fac3-4319-ba9a-60cfda7c55ed tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/fc136da8-3767-4c12-906c-d3a3562ccba4" status: 200 len: 1266 microversion: 2.1 time: 0.353725 Oct 04 18:51:25.884532 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2513/5079] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:25 2022] GET /compute/v2.1/servers/fc136da8-3767-4c12-906c-d3a3562ccba4 => generated 1266 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:25.897716 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a17e9a81-8530-464d-814c-c038b38e2aa8 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:25.898630 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a17e9a81-8530-464d-814c-c038b38e2aa8 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] [instance: d209c762-5668-445f-aabf-9952ba110f38] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:25.938971 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a17e9a81-8530-464d-814c-c038b38e2aa8 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:25.940710 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a17e9a81-8530-464d-814c-c038b38e2aa8 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:25.942408 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a17e9a81-8530-464d-814c-c038b38e2aa8 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:25.944771 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a17e9a81-8530-464d-814c-c038b38e2aa8 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:25.945717 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a17e9a81-8530-464d-814c-c038b38e2aa8 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:25.946092 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a17e9a81-8530-464d-814c-c038b38e2aa8 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:26.639977 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-31ec107e-0cda-4bcc-9506-636cff946518 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:26.671121 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-31ec107e-0cda-4bcc-9506-636cff946518 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60" status: 200 len: 1314 microversion: 2.1 time: 1.229882 Oct 04 18:51:26.673180 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2567/5080] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:25 2022] GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60 => generated 1314 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:26.758317 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a17e9a81-8530-464d-814c-c038b38e2aa8 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7faf4e5c164941c2bcf5ba6e8f100b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b4487fe1814c8e892d803f909557ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:26.771218 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a17e9a81-8530-464d-814c-c038b38e2aa8 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] 10.222.0.20 "GET /compute/v2.1/servers/d209c762-5668-445f-aabf-9952ba110f38" status: 200 len: 1328 microversion: 2.1 time: 0.885356 Oct 04 18:51:26.772142 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2514/5081] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:25 2022] GET /compute/v2.1/servers/d209c762-5668-445f-aabf-9952ba110f38 => generated 1328 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:26.916855 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-76e291e3-d619-48a7-b8f9-f7e4a2b04fee tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:26.925469 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-76e291e3-d619-48a7-b8f9-f7e4a2b04fee tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: fc136da8-3767-4c12-906c-d3a3562ccba4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:26.935715 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-76e291e3-d619-48a7-b8f9-f7e4a2b04fee tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:26.937774 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-76e291e3-d619-48a7-b8f9-f7e4a2b04fee tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:26.938425 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-76e291e3-d619-48a7-b8f9-f7e4a2b04fee tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:26.945818 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-76e291e3-d619-48a7-b8f9-f7e4a2b04fee tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:26.945818 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-76e291e3-d619-48a7-b8f9-f7e4a2b04fee tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:26.945818 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-76e291e3-d619-48a7-b8f9-f7e4a2b04fee tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:27.112511 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-76e291e3-d619-48a7-b8f9-f7e4a2b04fee tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:27.135343 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-76e291e3-d619-48a7-b8f9-f7e4a2b04fee tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/fc136da8-3767-4c12-906c-d3a3562ccba4" status: 200 len: 1272 microversion: 2.1 time: 0.227804 Oct 04 18:51:27.158523 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2568/5082] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:26 2022] GET /compute/v2.1/servers/fc136da8-3767-4c12-906c-d3a3562ccba4 => generated 1272 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:27.361820 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-517b91f6-08d9-4616-8095-5cea6bc7e634 req-fb2265d6-b3b5-4e30-9f29-2981fe76b11e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d209c762-5668-445f-aabf-9952ba110f38", "tag": "b3bd4ecb-ac77-4c6b-9331-2239e7b43036"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:51:27.374429 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-517b91f6-08d9-4616-8095-5cea6bc7e634 req-fb2265d6-b3b5-4e30-9f29-2981fe76b11e service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:27.375316 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-517b91f6-08d9-4616-8095-5cea6bc7e634 req-fb2265d6-b3b5-4e30-9f29-2981fe76b11e service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:27.375985 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-517b91f6-08d9-4616-8095-5cea6bc7e634 req-fb2265d6-b3b5-4e30-9f29-2981fe76b11e service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:27.391507 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-517b91f6-08d9-4616-8095-5cea6bc7e634 req-fb2265d6-b3b5-4e30-9f29-2981fe76b11e service nova] Creating event network-changed:b3bd4ecb-ac77-4c6b-9331-2239e7b43036 for instance d209c762-5668-445f-aabf-9952ba110f38 on n-h1-850501-14 Oct 04 18:51:27.407352 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-517b91f6-08d9-4616-8095-5cea6bc7e634 req-fb2265d6-b3b5-4e30-9f29-2981fe76b11e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045554 Oct 04 18:51:27.409645 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2515/5083] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:51:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:51:27.697351 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6890cff4-3e67-45e2-97ab-dd48dadbc911 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:27.700521 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6890cff4-3e67-45e2-97ab-dd48dadbc911 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9eaa25a-0821-47fb-a16e-d07bcde9cc60] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:27.716400 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6890cff4-3e67-45e2-97ab-dd48dadbc911 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:27.717662 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6890cff4-3e67-45e2-97ab-dd48dadbc911 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:27.718329 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6890cff4-3e67-45e2-97ab-dd48dadbc911 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:27.719645 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6890cff4-3e67-45e2-97ab-dd48dadbc911 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:27.720509 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6890cff4-3e67-45e2-97ab-dd48dadbc911 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:27.721371 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6890cff4-3e67-45e2-97ab-dd48dadbc911 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:27.795015 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-77fbf83e-f461-4d43-9ad9-1f217693f406 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:27.796549 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-77fbf83e-f461-4d43-9ad9-1f217693f406 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] [instance: d209c762-5668-445f-aabf-9952ba110f38] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:27.803217 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:51:27.808886 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-77fbf83e-f461-4d43-9ad9-1f217693f406 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:27.808886 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-77fbf83e-f461-4d43-9ad9-1f217693f406 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:27.808886 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-77fbf83e-f461-4d43-9ad9-1f217693f406 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:27.808886 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-77fbf83e-f461-4d43-9ad9-1f217693f406 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:27.808886 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-77fbf83e-f461-4d43-9ad9-1f217693f406 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:27.808886 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-77fbf83e-f461-4d43-9ad9-1f217693f406 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:28.195850 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6890cff4-3e67-45e2-97ab-dd48dadbc911 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:28.212704 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6890cff4-3e67-45e2-97ab-dd48dadbc911 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60" status: 200 len: 1314 microversion: 2.1 time: 0.521501 Oct 04 18:51:28.214438 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2569/5084] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:27 2022] GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60 => generated 1314 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:28.227762 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-76fdd4f2-5d99-43cf-ad75-1f696ef2ca8b req-222f4acd-3072-4df5-9bd4-f6a9909cdca5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9eaa25a-0821-47fb-a16e-d07bcde9cc60", "name": "network-vif-plugged", "status": "completed", "tag": "b323ea97-81a2-4778-8096-32e05d6f2440"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:51:28.240648 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-76fdd4f2-5d99-43cf-ad75-1f696ef2ca8b req-222f4acd-3072-4df5-9bd4-f6a9909cdca5 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:28.240648 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-76fdd4f2-5d99-43cf-ad75-1f696ef2ca8b req-222f4acd-3072-4df5-9bd4-f6a9909cdca5 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:28.241394 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-76fdd4f2-5d99-43cf-ad75-1f696ef2ca8b req-222f4acd-3072-4df5-9bd4-f6a9909cdca5 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:28.258834 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-76fdd4f2-5d99-43cf-ad75-1f696ef2ca8b req-222f4acd-3072-4df5-9bd4-f6a9909cdca5 service nova] Creating event network-vif-plugged:b323ea97-81a2-4778-8096-32e05d6f2440 for instance a9eaa25a-0821-47fb-a16e-d07bcde9cc60 on n-h2-850501-14 Oct 04 18:51:28.265360 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-76fdd4f2-5d99-43cf-ad75-1f696ef2ca8b req-222f4acd-3072-4df5-9bd4-f6a9909cdca5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048893 Oct 04 18:51:28.267755 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2570/5085] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:51:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:51:28.275062 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5b47884f-c180-4c55-8fd4-62c54377453c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:28.276481 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5b47884f-c180-4c55-8fd4-62c54377453c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: fc136da8-3767-4c12-906c-d3a3562ccba4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:28.283807 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5b47884f-c180-4c55-8fd4-62c54377453c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:28.284575 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5b47884f-c180-4c55-8fd4-62c54377453c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:28.285167 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5b47884f-c180-4c55-8fd4-62c54377453c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:28.286045 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5b47884f-c180-4c55-8fd4-62c54377453c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:28.286805 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5b47884f-c180-4c55-8fd4-62c54377453c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:28.287574 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5b47884f-c180-4c55-8fd4-62c54377453c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:28.420732 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-77fbf83e-f461-4d43-9ad9-1f217693f406 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7faf4e5c164941c2bcf5ba6e8f100b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b4487fe1814c8e892d803f909557ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:28.442326 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-77fbf83e-f461-4d43-9ad9-1f217693f406 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] 10.222.0.20 "GET /compute/v2.1/servers/d209c762-5668-445f-aabf-9952ba110f38" status: 200 len: 1328 microversion: 2.1 time: 0.651375 Oct 04 18:51:28.449210 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2516/5086] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:27 2022] GET /compute/v2.1/servers/d209c762-5668-445f-aabf-9952ba110f38 => generated 1328 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:28.691806 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5b47884f-c180-4c55-8fd4-62c54377453c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:28.729278 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5b47884f-c180-4c55-8fd4-62c54377453c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/fc136da8-3767-4c12-906c-d3a3562ccba4" status: 200 len: 1314 microversion: 2.1 time: 0.459565 Oct 04 18:51:28.731288 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2571/5087] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:28 2022] GET /compute/v2.1/servers/fc136da8-3767-4c12-906c-d3a3562ccba4 => generated 1314 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:29.240657 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-52c55f61-a3a0-4712-9cc8-8961d1b51412 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:29.242069 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-52c55f61-a3a0-4712-9cc8-8961d1b51412 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9eaa25a-0821-47fb-a16e-d07bcde9cc60] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:29.260046 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-52c55f61-a3a0-4712-9cc8-8961d1b51412 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:29.263088 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-52c55f61-a3a0-4712-9cc8-8961d1b51412 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:29.274131 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-52c55f61-a3a0-4712-9cc8-8961d1b51412 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:29.274131 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-52c55f61-a3a0-4712-9cc8-8961d1b51412 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:29.274131 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-52c55f61-a3a0-4712-9cc8-8961d1b51412 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:29.274131 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-52c55f61-a3a0-4712-9cc8-8961d1b51412 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:29.481134 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ba0500f6-400e-4a09-ad4b-76de6913d9f5 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:29.483256 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ba0500f6-400e-4a09-ad4b-76de6913d9f5 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] [instance: d209c762-5668-445f-aabf-9952ba110f38] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:29.492629 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ba0500f6-400e-4a09-ad4b-76de6913d9f5 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:29.493399 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ba0500f6-400e-4a09-ad4b-76de6913d9f5 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:29.496135 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ba0500f6-400e-4a09-ad4b-76de6913d9f5 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:29.496928 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ba0500f6-400e-4a09-ad4b-76de6913d9f5 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:29.497398 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ba0500f6-400e-4a09-ad4b-76de6913d9f5 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:29.498108 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ba0500f6-400e-4a09-ad4b-76de6913d9f5 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:29.780875 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-52c55f61-a3a0-4712-9cc8-8961d1b51412 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:29.789646 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-52c55f61-a3a0-4712-9cc8-8961d1b51412 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60" status: 200 len: 1314 microversion: 2.1 time: 0.555043 Oct 04 18:51:29.801083 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2517/5088] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:29 2022] GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60 => generated 1314 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:29.806738 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2dffdd33-f3ba-486d-9bf8-60e00a4ff907 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:29.807630 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2dffdd33-f3ba-486d-9bf8-60e00a4ff907 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: fc136da8-3767-4c12-906c-d3a3562ccba4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:29.825760 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2dffdd33-f3ba-486d-9bf8-60e00a4ff907 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:29.826537 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2dffdd33-f3ba-486d-9bf8-60e00a4ff907 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:29.827183 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2dffdd33-f3ba-486d-9bf8-60e00a4ff907 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:29.827928 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2dffdd33-f3ba-486d-9bf8-60e00a4ff907 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:29.828409 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2dffdd33-f3ba-486d-9bf8-60e00a4ff907 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:29.834603 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2dffdd33-f3ba-486d-9bf8-60e00a4ff907 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:30.009476 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ba0500f6-400e-4a09-ad4b-76de6913d9f5 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7faf4e5c164941c2bcf5ba6e8f100b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b4487fe1814c8e892d803f909557ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:30.020692 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ba0500f6-400e-4a09-ad4b-76de6913d9f5 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] 10.222.0.20 "GET /compute/v2.1/servers/d209c762-5668-445f-aabf-9952ba110f38" status: 200 len: 1328 microversion: 2.1 time: 0.552206 Oct 04 18:51:30.023842 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2572/5089] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:29 2022] GET /compute/v2.1/servers/d209c762-5668-445f-aabf-9952ba110f38 => generated 1328 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:51:30.500189 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2dffdd33-f3ba-486d-9bf8-60e00a4ff907 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:30.506393 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=100 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:51:30.512314 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2dffdd33-f3ba-486d-9bf8-60e00a4ff907 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/fc136da8-3767-4c12-906c-d3a3562ccba4" status: 200 len: 1314 microversion: 2.1 time: 0.708807 Oct 04 18:51:30.534918 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2518/5090] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:29 2022] GET /compute/v2.1/servers/fc136da8-3767-4c12-906c-d3a3562ccba4 => generated 1314 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:30.826472 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ef46d40c-dce2-4ebb-9a07-7f225cea6ff6 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:30.827119 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ef46d40c-dce2-4ebb-9a07-7f225cea6ff6 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9eaa25a-0821-47fb-a16e-d07bcde9cc60] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:30.854415 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ef46d40c-dce2-4ebb-9a07-7f225cea6ff6 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:30.861489 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ef46d40c-dce2-4ebb-9a07-7f225cea6ff6 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:30.861489 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ef46d40c-dce2-4ebb-9a07-7f225cea6ff6 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:30.862027 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ef46d40c-dce2-4ebb-9a07-7f225cea6ff6 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:30.862270 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ef46d40c-dce2-4ebb-9a07-7f225cea6ff6 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:30.862700 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ef46d40c-dce2-4ebb-9a07-7f225cea6ff6 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:31.053707 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-08da74be-ba29-4ed4-83c5-83931b0f1aeb tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:31.053707 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-08da74be-ba29-4ed4-83c5-83931b0f1aeb tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] [instance: d209c762-5668-445f-aabf-9952ba110f38] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:31.060820 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-08da74be-ba29-4ed4-83c5-83931b0f1aeb tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:31.062640 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-08da74be-ba29-4ed4-83c5-83931b0f1aeb tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:31.064237 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-08da74be-ba29-4ed4-83c5-83931b0f1aeb tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:31.074838 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-08da74be-ba29-4ed4-83c5-83931b0f1aeb tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:31.075506 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-08da74be-ba29-4ed4-83c5-83931b0f1aeb tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:31.083860 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-08da74be-ba29-4ed4-83c5-83931b0f1aeb tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:31.519410 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ef46d40c-dce2-4ebb-9a07-7f225cea6ff6 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:31.531660 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ef46d40c-dce2-4ebb-9a07-7f225cea6ff6 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60" status: 200 len: 1500 microversion: 2.1 time: 0.709726 Oct 04 18:51:31.534307 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2573/5091] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:30 2022] GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60 => generated 1500 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:31.546738 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-0259aafe-9c24-48d0-a74d-4ac522ff696f req-492325f1-88fc-43ef-9445-6f1ed3126cf9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc136da8-3767-4c12-906c-d3a3562ccba4", "tag": "82cf7717-c488-403e-b3ab-a388fa84189b"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:51:31.589840 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-0259aafe-9c24-48d0-a74d-4ac522ff696f req-492325f1-88fc-43ef-9445-6f1ed3126cf9 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:31.594375 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-0259aafe-9c24-48d0-a74d-4ac522ff696f req-492325f1-88fc-43ef-9445-6f1ed3126cf9 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:31.599931 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-0259aafe-9c24-48d0-a74d-4ac522ff696f req-492325f1-88fc-43ef-9445-6f1ed3126cf9 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:31.601776 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-08da74be-ba29-4ed4-83c5-83931b0f1aeb tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7faf4e5c164941c2bcf5ba6e8f100b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b4487fe1814c8e892d803f909557ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:31.611091 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-08da74be-ba29-4ed4-83c5-83931b0f1aeb tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] 10.222.0.20 "GET /compute/v2.1/servers/d209c762-5668-445f-aabf-9952ba110f38" status: 200 len: 1328 microversion: 2.1 time: 0.571296 Oct 04 18:51:31.619147 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2519/5092] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:31 2022] GET /compute/v2.1/servers/d209c762-5668-445f-aabf-9952ba110f38 => generated 1328 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:31.641171 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-06f9fc3d-b6a5-4fcd-ba04-98f26ad73cb1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:31.641171 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-06f9fc3d-b6a5-4fcd-ba04-98f26ad73cb1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: fc136da8-3767-4c12-906c-d3a3562ccba4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:31.649757 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-0259aafe-9c24-48d0-a74d-4ac522ff696f req-492325f1-88fc-43ef-9445-6f1ed3126cf9 service nova] Creating event network-changed:82cf7717-c488-403e-b3ab-a388fa84189b for instance fc136da8-3767-4c12-906c-d3a3562ccba4 on n-h2-850501-14 Oct 04 18:51:31.658948 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-06f9fc3d-b6a5-4fcd-ba04-98f26ad73cb1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:31.668756 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-06f9fc3d-b6a5-4fcd-ba04-98f26ad73cb1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:31.672664 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-06f9fc3d-b6a5-4fcd-ba04-98f26ad73cb1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:31.674494 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-06f9fc3d-b6a5-4fcd-ba04-98f26ad73cb1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:31.677194 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-0259aafe-9c24-48d0-a74d-4ac522ff696f req-492325f1-88fc-43ef-9445-6f1ed3126cf9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140292 Oct 04 18:51:31.678256 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2574/5093] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:51:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:51:31.684149 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d193ef6b-e611-42ec-adf6-4d7ff14d80db tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:51:31.688355 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d193ef6b-e611-42ec-adf6-4d7ff14d80db tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9eaa25a-0821-47fb-a16e-d07bcde9cc60] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:31.691036 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-06f9fc3d-b6a5-4fcd-ba04-98f26ad73cb1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:31.710532 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d193ef6b-e611-42ec-adf6-4d7ff14d80db tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:31.710532 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d193ef6b-e611-42ec-adf6-4d7ff14d80db tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:31.710740 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-06f9fc3d-b6a5-4fcd-ba04-98f26ad73cb1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:31.710861 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d193ef6b-e611-42ec-adf6-4d7ff14d80db tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:31.711150 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d193ef6b-e611-42ec-adf6-4d7ff14d80db tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:31.711629 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d193ef6b-e611-42ec-adf6-4d7ff14d80db tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:31.712148 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d193ef6b-e611-42ec-adf6-4d7ff14d80db tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:31.768597 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-d193ef6b-e611-42ec-adf6-4d7ff14d80db tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lazy-loading 'flavor' on Instance uuid a9eaa25a-0821-47fb-a16e-d07bcde9cc60 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:51:31.800420 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:51:32.058786 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-06f9fc3d-b6a5-4fcd-ba04-98f26ad73cb1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:32.072762 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-06f9fc3d-b6a5-4fcd-ba04-98f26ad73cb1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/fc136da8-3767-4c12-906c-d3a3562ccba4" status: 200 len: 1314 microversion: 2.1 time: 0.452447 Oct 04 18:51:32.076353 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2520/5094] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:31 2022] GET /compute/v2.1/servers/fc136da8-3767-4c12-906c-d3a3562ccba4 => generated 1314 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:32.547751 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d193ef6b-e611-42ec-adf6-4d7ff14d80db tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "POST /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60/action" status: 202 len: 0 microversion: 2.1 time: 0.861895 Oct 04 18:51:32.547751 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2575/5095] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:51:31 2022] POST /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60/action => generated 0 bytes in 866 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:51:32.555628 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4478cc21-6fef-49d1-a519-884fc327e228 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:32.556630 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4478cc21-6fef-49d1-a519-884fc327e228 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9eaa25a-0821-47fb-a16e-d07bcde9cc60] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:32.564250 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4478cc21-6fef-49d1-a519-884fc327e228 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:32.564989 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4478cc21-6fef-49d1-a519-884fc327e228 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:32.566112 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4478cc21-6fef-49d1-a519-884fc327e228 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:32.566686 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4478cc21-6fef-49d1-a519-884fc327e228 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:32.567155 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4478cc21-6fef-49d1-a519-884fc327e228 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:32.567629 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4478cc21-6fef-49d1-a519-884fc327e228 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:32.645361 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f75b9ddc-95c4-457d-b98b-fbbb436d6db8 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:32.649828 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f75b9ddc-95c4-457d-b98b-fbbb436d6db8 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] [instance: d209c762-5668-445f-aabf-9952ba110f38] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:32.661092 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f75b9ddc-95c4-457d-b98b-fbbb436d6db8 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:32.662417 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f75b9ddc-95c4-457d-b98b-fbbb436d6db8 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:32.662881 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f75b9ddc-95c4-457d-b98b-fbbb436d6db8 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:32.664268 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f75b9ddc-95c4-457d-b98b-fbbb436d6db8 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:32.665141 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f75b9ddc-95c4-457d-b98b-fbbb436d6db8 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:32.665586 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f75b9ddc-95c4-457d-b98b-fbbb436d6db8 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:32.863248 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=4 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:51:33.005001 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f75b9ddc-95c4-457d-b98b-fbbb436d6db8 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7faf4e5c164941c2bcf5ba6e8f100b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b4487fe1814c8e892d803f909557ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:33.009378 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4478cc21-6fef-49d1-a519-884fc327e228 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:33.019293 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f75b9ddc-95c4-457d-b98b-fbbb436d6db8 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] 10.222.0.20 "GET /compute/v2.1/servers/d209c762-5668-445f-aabf-9952ba110f38" status: 200 len: 1328 microversion: 2.1 time: 0.378571 Oct 04 18:51:33.020810 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4478cc21-6fef-49d1-a519-884fc327e228 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60" status: 200 len: 1506 microversion: 2.1 time: 0.470943 Oct 04 18:51:33.022360 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2576/5096] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:32 2022] GET /compute/v2.1/servers/d209c762-5668-445f-aabf-9952ba110f38 => generated 1328 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:33.024583 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2521/5097] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:32 2022] GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60 => generated 1506 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:33.110009 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6fc61f0f-7c0e-480f-a9f6-835b87ddea88 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:33.110775 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6fc61f0f-7c0e-480f-a9f6-835b87ddea88 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: fc136da8-3767-4c12-906c-d3a3562ccba4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:33.126348 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6fc61f0f-7c0e-480f-a9f6-835b87ddea88 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:33.127115 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6fc61f0f-7c0e-480f-a9f6-835b87ddea88 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:33.128431 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6fc61f0f-7c0e-480f-a9f6-835b87ddea88 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:33.129386 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6fc61f0f-7c0e-480f-a9f6-835b87ddea88 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:33.131491 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6fc61f0f-7c0e-480f-a9f6-835b87ddea88 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:33.132361 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6fc61f0f-7c0e-480f-a9f6-835b87ddea88 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:33.475608 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6fc61f0f-7c0e-480f-a9f6-835b87ddea88 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:33.485718 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6fc61f0f-7c0e-480f-a9f6-835b87ddea88 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/fc136da8-3767-4c12-906c-d3a3562ccba4" status: 200 len: 1314 microversion: 2.1 time: 0.387833 Oct 04 18:51:33.501939 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2577/5098] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:33 2022] GET /compute/v2.1/servers/fc136da8-3767-4c12-906c-d3a3562ccba4 => generated 1314 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:34.050117 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7418cbf0-dcb6-4c23-9444-73ccc1bf9ce1 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:34.050729 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7418cbf0-dcb6-4c23-9444-73ccc1bf9ce1 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9eaa25a-0821-47fb-a16e-d07bcde9cc60] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:34.052459 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=12 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:51:34.058841 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-57bbc1c1-321b-4870-876b-235895b1e857 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:34.065884 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7418cbf0-dcb6-4c23-9444-73ccc1bf9ce1 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:34.066381 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7418cbf0-dcb6-4c23-9444-73ccc1bf9ce1 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:34.066820 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7418cbf0-dcb6-4c23-9444-73ccc1bf9ce1 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:34.067525 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7418cbf0-dcb6-4c23-9444-73ccc1bf9ce1 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:34.068279 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7418cbf0-dcb6-4c23-9444-73ccc1bf9ce1 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:34.068719 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7418cbf0-dcb6-4c23-9444-73ccc1bf9ce1 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:34.071146 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-57bbc1c1-321b-4870-876b-235895b1e857 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] [instance: d209c762-5668-445f-aabf-9952ba110f38] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:34.077990 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-57bbc1c1-321b-4870-876b-235895b1e857 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:34.078699 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-57bbc1c1-321b-4870-876b-235895b1e857 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:34.081694 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-57bbc1c1-321b-4870-876b-235895b1e857 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:34.081694 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-57bbc1c1-321b-4870-876b-235895b1e857 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:34.081694 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-57bbc1c1-321b-4870-876b-235895b1e857 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:34.081694 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-57bbc1c1-321b-4870-876b-235895b1e857 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:34.494738 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=18 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:51:34.663219 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7418cbf0-dcb6-4c23-9444-73ccc1bf9ce1 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:34.671908 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7418cbf0-dcb6-4c23-9444-73ccc1bf9ce1 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60" status: 200 len: 1506 microversion: 2.1 time: 0.626045 Oct 04 18:51:34.672526 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2578/5099] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:34 2022] GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60 => generated 1506 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:34.688907 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-c5157229-c9d6-4bd1-bb13-82347621d12c req-803842ce-0718-4553-87cb-2a9e4b26311d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d209c762-5668-445f-aabf-9952ba110f38", "name": "network-vif-plugged", "status": "completed", "tag": "b3bd4ecb-ac77-4c6b-9331-2239e7b43036"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:51:34.689466 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-57bbc1c1-321b-4870-876b-235895b1e857 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7faf4e5c164941c2bcf5ba6e8f100b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b4487fe1814c8e892d803f909557ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:34.689570 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-c5157229-c9d6-4bd1-bb13-82347621d12c req-803842ce-0718-4553-87cb-2a9e4b26311d service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:34.702490 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-57bbc1c1-321b-4870-876b-235895b1e857 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] 10.222.0.20 "GET /compute/v2.1/servers/d209c762-5668-445f-aabf-9952ba110f38" status: 200 len: 1328 microversion: 2.1 time: 0.654764 Oct 04 18:51:34.702607 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-c5157229-c9d6-4bd1-bb13-82347621d12c req-803842ce-0718-4553-87cb-2a9e4b26311d service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:34.702695 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2522/5100] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:34 2022] GET /compute/v2.1/servers/d209c762-5668-445f-aabf-9952ba110f38 => generated 1328 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:34.702786 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-c5157229-c9d6-4bd1-bb13-82347621d12c req-803842ce-0718-4553-87cb-2a9e4b26311d service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:34.715708 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-c5157229-c9d6-4bd1-bb13-82347621d12c req-803842ce-0718-4553-87cb-2a9e4b26311d service nova] Creating event network-vif-plugged:b3bd4ecb-ac77-4c6b-9331-2239e7b43036 for instance d209c762-5668-445f-aabf-9952ba110f38 on n-h1-850501-14 Oct 04 18:51:34.723405 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-32a1880c-07a3-4ab9-bd12-a6360a726d52 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:34.726811 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-32a1880c-07a3-4ab9-bd12-a6360a726d52 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: fc136da8-3767-4c12-906c-d3a3562ccba4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:34.729452 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-c5157229-c9d6-4bd1-bb13-82347621d12c req-803842ce-0718-4553-87cb-2a9e4b26311d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055638 Oct 04 18:51:34.732620 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2579/5101] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:51:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:51:34.737584 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-32a1880c-07a3-4ab9-bd12-a6360a726d52 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:34.738090 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-32a1880c-07a3-4ab9-bd12-a6360a726d52 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:34.738918 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-32a1880c-07a3-4ab9-bd12-a6360a726d52 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:34.739785 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-32a1880c-07a3-4ab9-bd12-a6360a726d52 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:34.740290 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-32a1880c-07a3-4ab9-bd12-a6360a726d52 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:34.740730 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-32a1880c-07a3-4ab9-bd12-a6360a726d52 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:35.142559 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-32a1880c-07a3-4ab9-bd12-a6360a726d52 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:35.150546 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-32a1880c-07a3-4ab9-bd12-a6360a726d52 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/fc136da8-3767-4c12-906c-d3a3562ccba4" status: 200 len: 1314 microversion: 2.1 time: 0.437682 Oct 04 18:51:35.166044 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2523/5102] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:34 2022] GET /compute/v2.1/servers/fc136da8-3767-4c12-906c-d3a3562ccba4 => generated 1314 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:35.697081 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6ef53c5e-bf6c-46f0-a6e1-a45376b223b8 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:35.697786 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6ef53c5e-bf6c-46f0-a6e1-a45376b223b8 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9eaa25a-0821-47fb-a16e-d07bcde9cc60] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:35.706792 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6ef53c5e-bf6c-46f0-a6e1-a45376b223b8 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:35.707309 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6ef53c5e-bf6c-46f0-a6e1-a45376b223b8 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:35.707790 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6ef53c5e-bf6c-46f0-a6e1-a45376b223b8 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:35.708465 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6ef53c5e-bf6c-46f0-a6e1-a45376b223b8 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:35.708922 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6ef53c5e-bf6c-46f0-a6e1-a45376b223b8 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:35.709565 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6ef53c5e-bf6c-46f0-a6e1-a45376b223b8 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:35.728185 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b41ffabf-47ec-4256-ba71-c9d8b49ba68b tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:35.731830 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b41ffabf-47ec-4256-ba71-c9d8b49ba68b tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] [instance: d209c762-5668-445f-aabf-9952ba110f38] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:35.738225 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b41ffabf-47ec-4256-ba71-c9d8b49ba68b tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:35.739059 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b41ffabf-47ec-4256-ba71-c9d8b49ba68b tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:35.739733 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b41ffabf-47ec-4256-ba71-c9d8b49ba68b tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:35.740715 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b41ffabf-47ec-4256-ba71-c9d8b49ba68b tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:35.741410 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b41ffabf-47ec-4256-ba71-c9d8b49ba68b tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:35.742053 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b41ffabf-47ec-4256-ba71-c9d8b49ba68b tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:36.017027 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b41ffabf-47ec-4256-ba71-c9d8b49ba68b tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7faf4e5c164941c2bcf5ba6e8f100b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b4487fe1814c8e892d803f909557ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:36.031696 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b41ffabf-47ec-4256-ba71-c9d8b49ba68b tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] 10.222.0.20 "GET /compute/v2.1/servers/d209c762-5668-445f-aabf-9952ba110f38" status: 200 len: 1328 microversion: 2.1 time: 0.307261 Oct 04 18:51:36.036102 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6ef53c5e-bf6c-46f0-a6e1-a45376b223b8 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:36.048733 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2524/5103] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:35 2022] GET /compute/v2.1/servers/d209c762-5668-445f-aabf-9952ba110f38 => generated 1328 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:36.051857 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6ef53c5e-bf6c-46f0-a6e1-a45376b223b8 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60" status: 200 len: 1506 microversion: 2.1 time: 0.359262 Oct 04 18:51:36.052838 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2580/5104] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:35 2022] GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60 => generated 1506 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:36.176600 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f5ec3638-3884-4eab-bae1-a1548bee48e5 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:36.178472 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f5ec3638-3884-4eab-bae1-a1548bee48e5 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: fc136da8-3767-4c12-906c-d3a3562ccba4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:36.188202 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f5ec3638-3884-4eab-bae1-a1548bee48e5 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:36.189121 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f5ec3638-3884-4eab-bae1-a1548bee48e5 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:36.189911 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f5ec3638-3884-4eab-bae1-a1548bee48e5 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:36.191048 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f5ec3638-3884-4eab-bae1-a1548bee48e5 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:36.191733 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f5ec3638-3884-4eab-bae1-a1548bee48e5 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:36.192210 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f5ec3638-3884-4eab-bae1-a1548bee48e5 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:36.497247 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f5ec3638-3884-4eab-bae1-a1548bee48e5 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:36.529151 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f5ec3638-3884-4eab-bae1-a1548bee48e5 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/fc136da8-3767-4c12-906c-d3a3562ccba4" status: 200 len: 1314 microversion: 2.1 time: 0.356635 Oct 04 18:51:36.530305 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2525/5105] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:36 2022] GET /compute/v2.1/servers/fc136da8-3767-4c12-906c-d3a3562ccba4 => generated 1314 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:37.075808 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-88a74643-9dbb-48d0-a4da-395a7b44ba10 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:37.076760 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-88a74643-9dbb-48d0-a4da-395a7b44ba10 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9eaa25a-0821-47fb-a16e-d07bcde9cc60] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:37.077888 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-82de2942-5c8b-40dd-bc60-6b96ef3fd044 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:37.081848 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-82de2942-5c8b-40dd-bc60-6b96ef3fd044 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] [instance: d209c762-5668-445f-aabf-9952ba110f38] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:37.089800 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-88a74643-9dbb-48d0-a4da-395a7b44ba10 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:37.090744 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-88a74643-9dbb-48d0-a4da-395a7b44ba10 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:37.091294 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-88a74643-9dbb-48d0-a4da-395a7b44ba10 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:37.092150 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-88a74643-9dbb-48d0-a4da-395a7b44ba10 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:37.092716 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-88a74643-9dbb-48d0-a4da-395a7b44ba10 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:37.093265 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-88a74643-9dbb-48d0-a4da-395a7b44ba10 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:37.099443 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-82de2942-5c8b-40dd-bc60-6b96ef3fd044 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:37.100208 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-82de2942-5c8b-40dd-bc60-6b96ef3fd044 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:37.101752 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-82de2942-5c8b-40dd-bc60-6b96ef3fd044 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:37.102663 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-82de2942-5c8b-40dd-bc60-6b96ef3fd044 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:37.107266 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-82de2942-5c8b-40dd-bc60-6b96ef3fd044 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:37.107266 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-82de2942-5c8b-40dd-bc60-6b96ef3fd044 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:37.763372 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-82de2942-5c8b-40dd-bc60-6b96ef3fd044 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7faf4e5c164941c2bcf5ba6e8f100b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b4487fe1814c8e892d803f909557ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:37.770814 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-88a74643-9dbb-48d0-a4da-395a7b44ba10 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:37.773449 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-82de2942-5c8b-40dd-bc60-6b96ef3fd044 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] 10.222.0.20 "GET /compute/v2.1/servers/d209c762-5668-445f-aabf-9952ba110f38" status: 200 len: 1529 microversion: 2.1 time: 0.702347 Oct 04 18:51:37.774679 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2581/5106] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:37 2022] GET /compute/v2.1/servers/d209c762-5668-445f-aabf-9952ba110f38 => generated 1529 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:37.780750 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f360da32-bc76-48a0-93b5-c0ad837f8356 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:37.783649 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-88a74643-9dbb-48d0-a4da-395a7b44ba10 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60" status: 200 len: 1506 microversion: 2.1 time: 0.710766 Oct 04 18:51:37.784759 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2526/5107] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:37 2022] GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60 => generated 1506 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:37.801426 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f360da32-bc76-48a0-93b5-c0ad837f8356 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: fc136da8-3767-4c12-906c-d3a3562ccba4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:37.811523 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ef8a30b4-1b32-4848-b978-a0a14ce6abdc tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:37.812192 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ef8a30b4-1b32-4848-b978-a0a14ce6abdc tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] [instance: d209c762-5668-445f-aabf-9952ba110f38] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:37.815775 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f360da32-bc76-48a0-93b5-c0ad837f8356 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:37.816319 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f360da32-bc76-48a0-93b5-c0ad837f8356 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:37.818876 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f360da32-bc76-48a0-93b5-c0ad837f8356 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:37.820738 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f360da32-bc76-48a0-93b5-c0ad837f8356 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:37.820738 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f360da32-bc76-48a0-93b5-c0ad837f8356 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:37.820738 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f360da32-bc76-48a0-93b5-c0ad837f8356 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:37.828163 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ef8a30b4-1b32-4848-b978-a0a14ce6abdc tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:37.829397 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ef8a30b4-1b32-4848-b978-a0a14ce6abdc tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:37.830412 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ef8a30b4-1b32-4848-b978-a0a14ce6abdc tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:37.832851 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ef8a30b4-1b32-4848-b978-a0a14ce6abdc tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:37.834259 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ef8a30b4-1b32-4848-b978-a0a14ce6abdc tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:37.834910 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ef8a30b4-1b32-4848-b978-a0a14ce6abdc tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:38.193943 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ef8a30b4-1b32-4848-b978-a0a14ce6abdc tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7faf4e5c164941c2bcf5ba6e8f100b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b4487fe1814c8e892d803f909557ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:38.216720 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ef8a30b4-1b32-4848-b978-a0a14ce6abdc tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] 10.222.0.20 "GET /compute/v2.1/servers/d209c762-5668-445f-aabf-9952ba110f38" status: 200 len: 1529 microversion: 2.1 time: 0.415296 Oct 04 18:51:38.218194 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2527/5108] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:37 2022] GET /compute/v2.1/servers/d209c762-5668-445f-aabf-9952ba110f38 => generated 1529 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:38.247985 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f360da32-bc76-48a0-93b5-c0ad837f8356 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:38.258480 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f360da32-bc76-48a0-93b5-c0ad837f8356 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/fc136da8-3767-4c12-906c-d3a3562ccba4" status: 200 len: 1314 microversion: 2.1 time: 0.482500 Oct 04 18:51:38.259553 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2582/5109] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:37 2022] GET /compute/v2.1/servers/fc136da8-3767-4c12-906c-d3a3562ccba4 => generated 1314 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:38.515676 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-666a3715-7f8d-4f42-a57b-0997d281b4cf tempest-ServersNegativeTestMultiTenantJSON-1011363614 tempest-ServersNegativeTestMultiTenantJSON-1011363614-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:38.516603 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-666a3715-7f8d-4f42-a57b-0997d281b4cf tempest-ServersNegativeTestMultiTenantJSON-1011363614 tempest-ServersNegativeTestMultiTenantJSON-1011363614-project] [instance: d209c762-5668-445f-aabf-9952ba110f38] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:38.523589 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-666a3715-7f8d-4f42-a57b-0997d281b4cf tempest-ServersNegativeTestMultiTenantJSON-1011363614 tempest-ServersNegativeTestMultiTenantJSON-1011363614-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:38.524617 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-666a3715-7f8d-4f42-a57b-0997d281b4cf tempest-ServersNegativeTestMultiTenantJSON-1011363614 tempest-ServersNegativeTestMultiTenantJSON-1011363614-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:38.525314 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-666a3715-7f8d-4f42-a57b-0997d281b4cf tempest-ServersNegativeTestMultiTenantJSON-1011363614 tempest-ServersNegativeTestMultiTenantJSON-1011363614-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:38.526290 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-666a3715-7f8d-4f42-a57b-0997d281b4cf tempest-ServersNegativeTestMultiTenantJSON-1011363614 tempest-ServersNegativeTestMultiTenantJSON-1011363614-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:38.527431 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-666a3715-7f8d-4f42-a57b-0997d281b4cf tempest-ServersNegativeTestMultiTenantJSON-1011363614 tempest-ServersNegativeTestMultiTenantJSON-1011363614-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:38.528216 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-666a3715-7f8d-4f42-a57b-0997d281b4cf tempest-ServersNegativeTestMultiTenantJSON-1011363614 tempest-ServersNegativeTestMultiTenantJSON-1011363614-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:38.543679 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-666a3715-7f8d-4f42-a57b-0997d281b4cf tempest-ServersNegativeTestMultiTenantJSON-1011363614 tempest-ServersNegativeTestMultiTenantJSON-1011363614-project] HTTP exception thrown: Instance d209c762-5668-445f-aabf-9952ba110f38 could not be found. Oct 04 18:51:38.545947 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-666a3715-7f8d-4f42-a57b-0997d281b4cf tempest-ServersNegativeTestMultiTenantJSON-1011363614 tempest-ServersNegativeTestMultiTenantJSON-1011363614-project] Request method failure captured: Oct 04 18:51:38.545947 n-d-850501-14 devstack@n-api.service[123002]: request: DELETE /compute/v2.1/servers/d209c762-5668-445f-aabf-9952ba110f38 HTTP/1.1 Oct 04 18:51:38.545947 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:51:38.545947 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:51:38.545947 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:51:38.545947 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:51:38.545947 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:51:38.545947 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:51:38.545947 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:51:38.545947 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:51:38.545947 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPICkHg6WC52xHXsop_2ZOmBUneFf8fZZIs4rGKI80PdqLuVVCj9EYCm64U2Ja6vC2Gv4Fr_mD-NTdXXzNFC4CuTH0QkV3qi7uZR5aAzW4AKxP9QPCw0o42UFY8WoKCaf9PznSGbDrStcQkfSzdIQKdOt5IjSNOkMxP_Wc7N8H7CILQ0 Oct 04 18:51:38.545947 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:51:38.545947 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:51:38.545947 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:51:38.545947 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:51:38.545947 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:51:38.545947 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:51:38.545947 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 2eab56d4724547f682a92f1ca785ec7a Oct 04 18:51:38.545947 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1011363614 Oct 04 18:51:38.545947 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:51:38.545947 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:51:38.545947 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2eab56d4724547f682a92f1ca785ec7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2eab56d4724547f682a92f1ca785ec7a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2eab56d4724547f682a92f1ca785ec7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2eab56d4724547f682a92f1ca785ec7a"}]}] Oct 04 18:51:38.545947 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1011363614 Oct 04 18:51:38.545947 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 2eab56d4724547f682a92f1ca785ec7a Oct 04 18:51:38.545947 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1011363614 Oct 04 18:51:38.545947 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1011363614-project Oct 04 18:51:38.545947 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:51:38.545947 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:51:38.545947 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: da1db5883b414df19f8eed88dbbeac0f Oct 04 18:51:38.545947 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1011363614-project Oct 04 18:51:38.545947 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:51:38.545947 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance d209c762-5668-445f-aabf-9952ba110f38 could not be found. Oct 04 18:51:38.545947 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'd209c762-5668-445f-aabf-9952ba110f38'} Oct 04 18:51:38.545947 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:51:38.545947 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:51:38.545947 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:51:38.545947 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:51:38.545947 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:51:38.545947 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:51:38.545947 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:51:38.545947 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:51:38.545947 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:51:38.545947 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:51:38.545947 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d209c762-5668-445f-aabf-9952ba110f38 could not be found. Oct 04 18:51:38.545947 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:51:38.545947 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:51:38.545947 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:51:38.545947 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:51:38.545947 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:51:38.545947 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:51:38.545947 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:51:38.545947 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:51:38.545947 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:51:38.545947 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:51:38.545947 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:51:38.545947 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:51:38.545947 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:51:38.545947 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:51:38.545947 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:51:38.545947 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:51:38.545947 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:51:38.545947 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:51:38.550294 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d209c762-5668-445f-aabf-9952ba110f38 could not be found. Oct 04 18:51:38.550294 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:51:38.550294 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:51:38.550294 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:51:38.550294 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:51:38.550294 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:51:38.550294 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:51:38.550294 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:51:38.550294 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:51:38.550294 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d209c762-5668-445f-aabf-9952ba110f38 could not be found. Oct 04 18:51:38.550294 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:51:38.552644 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-666a3715-7f8d-4f42-a57b-0997d281b4cf tempest-ServersNegativeTestMultiTenantJSON-1011363614 tempest-ServersNegativeTestMultiTenantJSON-1011363614-project] Returning 404 to user: Instance d209c762-5668-445f-aabf-9952ba110f38 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:51:38.553949 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-666a3715-7f8d-4f42-a57b-0997d281b4cf tempest-ServersNegativeTestMultiTenantJSON-1011363614 tempest-ServersNegativeTestMultiTenantJSON-1011363614-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d209c762-5668-445f-aabf-9952ba110f38" status: 404 len: 111 microversion: 2.1 time: 0.312460 Oct 04 18:51:38.559388 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2528/5110] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:51:38 2022] DELETE /compute/v2.1/servers/d209c762-5668-445f-aabf-9952ba110f38 => generated 111 bytes in 319 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:51:38.564778 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-306449f8-7414-4a81-a94d-014330cb1f60 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:38.565448 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-306449f8-7414-4a81-a94d-014330cb1f60 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] [instance: d209c762-5668-445f-aabf-9952ba110f38] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:38.572755 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-306449f8-7414-4a81-a94d-014330cb1f60 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:38.573896 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-306449f8-7414-4a81-a94d-014330cb1f60 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:38.574430 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-306449f8-7414-4a81-a94d-014330cb1f60 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:38.575220 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-306449f8-7414-4a81-a94d-014330cb1f60 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:38.575750 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-306449f8-7414-4a81-a94d-014330cb1f60 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:38.576280 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-306449f8-7414-4a81-a94d-014330cb1f60 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:38.768150 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-306449f8-7414-4a81-a94d-014330cb1f60 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7faf4e5c164941c2bcf5ba6e8f100b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b4487fe1814c8e892d803f909557ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:38.778113 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-306449f8-7414-4a81-a94d-014330cb1f60 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] 10.222.0.20 "GET /compute/v2.1/servers/d209c762-5668-445f-aabf-9952ba110f38" status: 200 len: 1529 microversion: 2.1 time: 0.217059 Oct 04 18:51:38.779191 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2583/5111] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:38 2022] GET /compute/v2.1/servers/d209c762-5668-445f-aabf-9952ba110f38 => generated 1529 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:38.803047 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-118ed2f1-e9a5-40e8-bd43-a11bd8a67467 tempest-ServersNegativeTestMultiTenantJSON-1011363614 tempest-ServersNegativeTestMultiTenantJSON-1011363614-project] Action: 'update', calling method: >, body: {"server": {"name": "d209c762-5668-445f-aabf-9952ba110f38_new"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:51:38.806789 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-118ed2f1-e9a5-40e8-bd43-a11bd8a67467 tempest-ServersNegativeTestMultiTenantJSON-1011363614 tempest-ServersNegativeTestMultiTenantJSON-1011363614-project] [instance: d209c762-5668-445f-aabf-9952ba110f38] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:38.810856 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8a042561-32b3-424b-a842-e5178f546f34 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:38.818217 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8a042561-32b3-424b-a842-e5178f546f34 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9eaa25a-0821-47fb-a16e-d07bcde9cc60] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:38.818369 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-118ed2f1-e9a5-40e8-bd43-a11bd8a67467 tempest-ServersNegativeTestMultiTenantJSON-1011363614 tempest-ServersNegativeTestMultiTenantJSON-1011363614-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:38.818369 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-118ed2f1-e9a5-40e8-bd43-a11bd8a67467 tempest-ServersNegativeTestMultiTenantJSON-1011363614 tempest-ServersNegativeTestMultiTenantJSON-1011363614-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:38.818369 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-118ed2f1-e9a5-40e8-bd43-a11bd8a67467 tempest-ServersNegativeTestMultiTenantJSON-1011363614 tempest-ServersNegativeTestMultiTenantJSON-1011363614-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:38.818369 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-118ed2f1-e9a5-40e8-bd43-a11bd8a67467 tempest-ServersNegativeTestMultiTenantJSON-1011363614 tempest-ServersNegativeTestMultiTenantJSON-1011363614-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:38.818369 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-118ed2f1-e9a5-40e8-bd43-a11bd8a67467 tempest-ServersNegativeTestMultiTenantJSON-1011363614 tempest-ServersNegativeTestMultiTenantJSON-1011363614-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:38.818369 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-118ed2f1-e9a5-40e8-bd43-a11bd8a67467 tempest-ServersNegativeTestMultiTenantJSON-1011363614 tempest-ServersNegativeTestMultiTenantJSON-1011363614-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:38.820578 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:51:38.822374 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8a042561-32b3-424b-a842-e5178f546f34 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:38.825034 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8a042561-32b3-424b-a842-e5178f546f34 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:38.826089 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8a042561-32b3-424b-a842-e5178f546f34 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:38.827191 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8a042561-32b3-424b-a842-e5178f546f34 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:38.828246 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8a042561-32b3-424b-a842-e5178f546f34 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:38.828944 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8a042561-32b3-424b-a842-e5178f546f34 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:38.833424 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-118ed2f1-e9a5-40e8-bd43-a11bd8a67467 tempest-ServersNegativeTestMultiTenantJSON-1011363614 tempest-ServersNegativeTestMultiTenantJSON-1011363614-project] HTTP exception thrown: Instance d209c762-5668-445f-aabf-9952ba110f38 could not be found. Oct 04 18:51:38.836839 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-118ed2f1-e9a5-40e8-bd43-a11bd8a67467 tempest-ServersNegativeTestMultiTenantJSON-1011363614 tempest-ServersNegativeTestMultiTenantJSON-1011363614-project] Request method failure captured: Oct 04 18:51:38.836839 n-d-850501-14 devstack@n-api.service[123002]: request: PUT /compute/v2.1/servers/d209c762-5668-445f-aabf-9952ba110f38 HTTP/1.1 Oct 04 18:51:38.836839 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:51:38.836839 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:51:38.836839 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:51:38.836839 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 64 Oct 04 18:51:38.836839 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:51:38.836839 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:51:38.836839 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:51:38.836839 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:51:38.836839 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPICkHg6WC52xHXsop_2ZOmBUneFf8fZZIs4rGKI80PdqLuVVCj9EYCm64U2Ja6vC2Gv4Fr_mD-NTdXXzNFC4CuTH0QkV3qi7uZR5aAzW4AKxP9QPCw0o42UFY8WoKCaf9PznSGbDrStcQkfSzdIQKdOt5IjSNOkMxP_Wc7N8H7CILQ0 Oct 04 18:51:38.836839 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:51:38.836839 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:51:38.836839 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:51:38.836839 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:51:38.836839 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:51:38.836839 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:51:38.836839 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 2eab56d4724547f682a92f1ca785ec7a Oct 04 18:51:38.836839 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1011363614 Oct 04 18:51:38.836839 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:51:38.836839 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:51:38.836839 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2eab56d4724547f682a92f1ca785ec7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2eab56d4724547f682a92f1ca785ec7a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2eab56d4724547f682a92f1ca785ec7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2eab56d4724547f682a92f1ca785ec7a"}]}] Oct 04 18:51:38.836839 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1011363614 Oct 04 18:51:38.836839 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 2eab56d4724547f682a92f1ca785ec7a Oct 04 18:51:38.836839 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1011363614 Oct 04 18:51:38.836839 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1011363614-project Oct 04 18:51:38.836839 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:51:38.836839 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:51:38.836839 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: da1db5883b414df19f8eed88dbbeac0f Oct 04 18:51:38.836839 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1011363614-project Oct 04 18:51:38.836839 n-d-850501-14 devstack@n-api.service[123002]: Oct 04 18:51:38.836839 n-d-850501-14 devstack@n-api.service[123002]: {"server": {"name": "d209c762-5668-445f-aabf-9952ba110f38_new"}} Oct 04 18:51:38.836839 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:51:38.836839 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance d209c762-5668-445f-aabf-9952ba110f38 could not be found. Oct 04 18:51:38.836839 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'd209c762-5668-445f-aabf-9952ba110f38', 'body': {'server': {'name': 'd209c762-5668-445f-aabf-9952ba110f38_new'}}} Oct 04 18:51:38.836839 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:51:38.836839 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:51:38.836839 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:51:38.836839 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:51:38.836839 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:51:38.836839 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:51:38.836839 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:51:38.836839 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:51:38.836839 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:51:38.836839 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:51:38.836839 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d209c762-5668-445f-aabf-9952ba110f38 could not be found. Oct 04 18:51:38.836839 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:51:38.836839 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:51:38.836839 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:51:38.836839 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:51:38.836839 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:51:38.836839 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:51:38.836839 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:51:38.836839 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:51:38.836839 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:51:38.836839 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:51:38.836839 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:51:38.836839 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:51:38.836839 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:51:38.836839 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:51:38.836839 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:51:38.836839 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:51:38.836839 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 04 18:51:38.847024 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 04 18:51:38.847024 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 04 18:51:38.847024 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:51:38.847024 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:51:38.847024 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:51:38.847024 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:51:38.847024 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d209c762-5668-445f-aabf-9952ba110f38 could not be found. Oct 04 18:51:38.847024 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:51:38.847024 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:51:38.847024 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:51:38.847024 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:51:38.847024 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:51:38.847024 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:51:38.847024 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:51:38.847024 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:51:38.847024 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d209c762-5668-445f-aabf-9952ba110f38 could not be found. Oct 04 18:51:38.847024 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:51:38.847024 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-118ed2f1-e9a5-40e8-bd43-a11bd8a67467 tempest-ServersNegativeTestMultiTenantJSON-1011363614 tempest-ServersNegativeTestMultiTenantJSON-1011363614-project] Returning 404 to user: Instance d209c762-5668-445f-aabf-9952ba110f38 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:51:38.847024 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-118ed2f1-e9a5-40e8-bd43-a11bd8a67467 tempest-ServersNegativeTestMultiTenantJSON-1011363614 tempest-ServersNegativeTestMultiTenantJSON-1011363614-project] 10.222.0.20 "PUT /compute/v2.1/servers/d209c762-5668-445f-aabf-9952ba110f38" status: 404 len: 111 microversion: 2.1 time: 0.039833 Oct 04 18:51:38.860175 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2529/5112] 10.222.0.20 () {60 vars in 1256 bytes} [Tue Oct 4 18:51:38 2022] PUT /compute/v2.1/servers/d209c762-5668-445f-aabf-9952ba110f38 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:51:38.865562 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5d47b410-d942-4695-924a-dd43648ac055 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:38.866085 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5d47b410-d942-4695-924a-dd43648ac055 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] [instance: d209c762-5668-445f-aabf-9952ba110f38] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:38.880609 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5d47b410-d942-4695-924a-dd43648ac055 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:38.891939 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5d47b410-d942-4695-924a-dd43648ac055 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:38.892471 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5d47b410-d942-4695-924a-dd43648ac055 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:38.893246 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5d47b410-d942-4695-924a-dd43648ac055 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:38.893794 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5d47b410-d942-4695-924a-dd43648ac055 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:38.894168 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5d47b410-d942-4695-924a-dd43648ac055 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:38.927069 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5d47b410-d942-4695-924a-dd43648ac055 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] [instance: d209c762-5668-445f-aabf-9952ba110f38] Going to try to terminate instance {{(pid=123002) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:51:39.225716 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8a042561-32b3-424b-a842-e5178f546f34 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:39.237661 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8a042561-32b3-424b-a842-e5178f546f34 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60" status: 200 len: 1506 microversion: 2.1 time: 0.434682 Oct 04 18:51:39.239288 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2584/5113] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:38 2022] GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60 => generated 1506 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:51:39.288006 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c8f51dfa-57c5-4d47-a9fd-3e4c3fa547de tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:39.290233 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c8f51dfa-57c5-4d47-a9fd-3e4c3fa547de tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: fc136da8-3767-4c12-906c-d3a3562ccba4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:39.301913 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c8f51dfa-57c5-4d47-a9fd-3e4c3fa547de tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:39.306547 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c8f51dfa-57c5-4d47-a9fd-3e4c3fa547de tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:39.308466 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c8f51dfa-57c5-4d47-a9fd-3e4c3fa547de tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:39.309830 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c8f51dfa-57c5-4d47-a9fd-3e4c3fa547de tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:39.311880 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c8f51dfa-57c5-4d47-a9fd-3e4c3fa547de tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:39.312447 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c8f51dfa-57c5-4d47-a9fd-3e4c3fa547de tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:39.427960 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5d47b410-d942-4695-924a-dd43648ac055 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d209c762-5668-445f-aabf-9952ba110f38" status: 204 len: 0 microversion: 2.1 time: 0.566232 Oct 04 18:51:39.429052 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2530/5114] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:51:38 2022] DELETE /compute/v2.1/servers/d209c762-5668-445f-aabf-9952ba110f38 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:51:39.452563 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-60b60668-ac1b-455b-88d5-16ba8f4a3257 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:39.454037 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-60b60668-ac1b-455b-88d5-16ba8f4a3257 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] [instance: d209c762-5668-445f-aabf-9952ba110f38] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:39.465959 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-60b60668-ac1b-455b-88d5-16ba8f4a3257 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:39.466683 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-60b60668-ac1b-455b-88d5-16ba8f4a3257 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:39.467423 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-60b60668-ac1b-455b-88d5-16ba8f4a3257 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:39.468301 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-60b60668-ac1b-455b-88d5-16ba8f4a3257 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:39.469153 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-60b60668-ac1b-455b-88d5-16ba8f4a3257 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:39.469843 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-60b60668-ac1b-455b-88d5-16ba8f4a3257 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:39.631682 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c8f51dfa-57c5-4d47-a9fd-3e4c3fa547de tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:39.643985 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c8f51dfa-57c5-4d47-a9fd-3e4c3fa547de tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/fc136da8-3767-4c12-906c-d3a3562ccba4" status: 200 len: 1314 microversion: 2.1 time: 0.360942 Oct 04 18:51:39.644830 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2585/5115] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:39 2022] GET /compute/v2.1/servers/fc136da8-3767-4c12-906c-d3a3562ccba4 => generated 1314 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:39.871190 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-9caf1067-df68-4c71-9810-eaedaffd12c8 req-d2214aa5-e4e8-47b5-b713-74320e09b0b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc136da8-3767-4c12-906c-d3a3562ccba4", "name": "network-vif-plugged", "status": "completed", "tag": "82cf7717-c488-403e-b3ab-a388fa84189b"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:51:39.875184 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-60b60668-ac1b-455b-88d5-16ba8f4a3257 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7faf4e5c164941c2bcf5ba6e8f100b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b4487fe1814c8e892d803f909557ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:39.894758 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-9caf1067-df68-4c71-9810-eaedaffd12c8 req-d2214aa5-e4e8-47b5-b713-74320e09b0b6 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:39.896359 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-60b60668-ac1b-455b-88d5-16ba8f4a3257 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] 10.222.0.20 "GET /compute/v2.1/servers/d209c762-5668-445f-aabf-9952ba110f38" status: 200 len: 1535 microversion: 2.1 time: 0.459136 Oct 04 18:51:39.897536 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2531/5116] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:39 2022] GET /compute/v2.1/servers/d209c762-5668-445f-aabf-9952ba110f38 => generated 1535 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:51:39.900340 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-9caf1067-df68-4c71-9810-eaedaffd12c8 req-d2214aa5-e4e8-47b5-b713-74320e09b0b6 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:39.900911 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-9caf1067-df68-4c71-9810-eaedaffd12c8 req-d2214aa5-e4e8-47b5-b713-74320e09b0b6 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:39.924119 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-9caf1067-df68-4c71-9810-eaedaffd12c8 req-d2214aa5-e4e8-47b5-b713-74320e09b0b6 service nova] Creating event network-vif-plugged:82cf7717-c488-403e-b3ab-a388fa84189b for instance fc136da8-3767-4c12-906c-d3a3562ccba4 on n-h2-850501-14 Oct 04 18:51:39.934056 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-9caf1067-df68-4c71-9810-eaedaffd12c8 req-d2214aa5-e4e8-47b5-b713-74320e09b0b6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067943 Oct 04 18:51:39.934994 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2586/5117] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:51:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:51:40.266290 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-bd742cc1-4807-450a-bee6-33f2800509fc tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:40.267370 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-bd742cc1-4807-450a-bee6-33f2800509fc tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9eaa25a-0821-47fb-a16e-d07bcde9cc60] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:40.276252 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bd742cc1-4807-450a-bee6-33f2800509fc tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:40.278884 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bd742cc1-4807-450a-bee6-33f2800509fc tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:40.279688 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bd742cc1-4807-450a-bee6-33f2800509fc tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:40.281204 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bd742cc1-4807-450a-bee6-33f2800509fc tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:40.282446 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bd742cc1-4807-450a-bee6-33f2800509fc tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:40.284727 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bd742cc1-4807-450a-bee6-33f2800509fc tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:40.529030 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-bd742cc1-4807-450a-bee6-33f2800509fc tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:40.543597 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-bd742cc1-4807-450a-bee6-33f2800509fc tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60" status: 200 len: 1506 microversion: 2.1 time: 0.281495 Oct 04 18:51:40.545170 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2532/5118] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:40 2022] GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60 => generated 1506 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:40.669490 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-dcd611bd-2ec0-4915-8a09-df238251f3ca tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:40.670210 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-dcd611bd-2ec0-4915-8a09-df238251f3ca tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: fc136da8-3767-4c12-906c-d3a3562ccba4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:40.683971 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dcd611bd-2ec0-4915-8a09-df238251f3ca tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:40.684509 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dcd611bd-2ec0-4915-8a09-df238251f3ca tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:40.684953 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dcd611bd-2ec0-4915-8a09-df238251f3ca tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:40.685718 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dcd611bd-2ec0-4915-8a09-df238251f3ca tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:40.688381 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dcd611bd-2ec0-4915-8a09-df238251f3ca tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:40.689070 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dcd611bd-2ec0-4915-8a09-df238251f3ca tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:40.922406 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-08164442-c7c9-4cca-b8fb-9df0b2ac757c tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:40.923990 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-08164442-c7c9-4cca-b8fb-9df0b2ac757c tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] [instance: d209c762-5668-445f-aabf-9952ba110f38] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:40.931231 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-08164442-c7c9-4cca-b8fb-9df0b2ac757c tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:40.932101 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-08164442-c7c9-4cca-b8fb-9df0b2ac757c tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:40.932960 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-08164442-c7c9-4cca-b8fb-9df0b2ac757c tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:40.934094 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-08164442-c7c9-4cca-b8fb-9df0b2ac757c tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:40.934880 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-08164442-c7c9-4cca-b8fb-9df0b2ac757c tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:40.935525 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-08164442-c7c9-4cca-b8fb-9df0b2ac757c tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:41.408171 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-08164442-c7c9-4cca-b8fb-9df0b2ac757c tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7faf4e5c164941c2bcf5ba6e8f100b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b4487fe1814c8e892d803f909557ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:41.420320 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-08164442-c7c9-4cca-b8fb-9df0b2ac757c tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] 10.222.0.20 "GET /compute/v2.1/servers/d209c762-5668-445f-aabf-9952ba110f38" status: 200 len: 1535 microversion: 2.1 time: 0.501812 Oct 04 18:51:41.433208 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2533/5119] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:40 2022] GET /compute/v2.1/servers/d209c762-5668-445f-aabf-9952ba110f38 => generated 1535 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:41.460251 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-dcd611bd-2ec0-4915-8a09-df238251f3ca tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:41.473749 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-dcd611bd-2ec0-4915-8a09-df238251f3ca tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/fc136da8-3767-4c12-906c-d3a3562ccba4" status: 200 len: 1314 microversion: 2.1 time: 0.810028 Oct 04 18:51:41.475942 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2587/5120] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:40 2022] GET /compute/v2.1/servers/fc136da8-3767-4c12-906c-d3a3562ccba4 => generated 1314 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:41.572334 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-dc2e6215-951d-47f4-af72-8c6ed70bc266 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:41.575141 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-dc2e6215-951d-47f4-af72-8c6ed70bc266 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9eaa25a-0821-47fb-a16e-d07bcde9cc60] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:41.595217 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dc2e6215-951d-47f4-af72-8c6ed70bc266 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:41.599520 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dc2e6215-951d-47f4-af72-8c6ed70bc266 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:41.599520 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dc2e6215-951d-47f4-af72-8c6ed70bc266 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:41.603609 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dc2e6215-951d-47f4-af72-8c6ed70bc266 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:41.604185 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dc2e6215-951d-47f4-af72-8c6ed70bc266 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:41.606854 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dc2e6215-951d-47f4-af72-8c6ed70bc266 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:41.712565 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-debe4336-17f9-4f6a-aa6f-d309d9fc7286 req-e3ab6c3d-b5e7-4731-9a1e-074794a72c2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d209c762-5668-445f-aabf-9952ba110f38", "name": "network-vif-deleted", "tag": "b3bd4ecb-ac77-4c6b-9331-2239e7b43036"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:51:41.732086 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-debe4336-17f9-4f6a-aa6f-d309d9fc7286 req-e3ab6c3d-b5e7-4731-9a1e-074794a72c2a service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:41.734443 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-debe4336-17f9-4f6a-aa6f-d309d9fc7286 req-e3ab6c3d-b5e7-4731-9a1e-074794a72c2a service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:41.735128 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-debe4336-17f9-4f6a-aa6f-d309d9fc7286 req-e3ab6c3d-b5e7-4731-9a1e-074794a72c2a service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:41.761323 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-debe4336-17f9-4f6a-aa6f-d309d9fc7286 req-e3ab6c3d-b5e7-4731-9a1e-074794a72c2a service nova] Creating event network-vif-deleted:b3bd4ecb-ac77-4c6b-9331-2239e7b43036 for instance d209c762-5668-445f-aabf-9952ba110f38 on n-h1-850501-14 Oct 04 18:51:41.767692 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-debe4336-17f9-4f6a-aa6f-d309d9fc7286 req-e3ab6c3d-b5e7-4731-9a1e-074794a72c2a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060556 Oct 04 18:51:41.768581 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2588/5121] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:51:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:51:42.172242 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-dc2e6215-951d-47f4-af72-8c6ed70bc266 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:42.190814 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-dc2e6215-951d-47f4-af72-8c6ed70bc266 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60" status: 200 len: 1506 microversion: 2.1 time: 0.624368 Oct 04 18:51:42.193715 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2534/5122] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:41 2022] GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60 => generated 1506 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:42.446321 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-036c5c87-f8e6-4bf7-8c5c-7170225385e1 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:42.447568 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-036c5c87-f8e6-4bf7-8c5c-7170225385e1 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] [instance: d209c762-5668-445f-aabf-9952ba110f38] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:42.459961 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-036c5c87-f8e6-4bf7-8c5c-7170225385e1 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:42.463031 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-036c5c87-f8e6-4bf7-8c5c-7170225385e1 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:42.468315 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-036c5c87-f8e6-4bf7-8c5c-7170225385e1 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:42.473432 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-036c5c87-f8e6-4bf7-8c5c-7170225385e1 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:42.473432 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-036c5c87-f8e6-4bf7-8c5c-7170225385e1 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:42.473432 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-036c5c87-f8e6-4bf7-8c5c-7170225385e1 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:42.505057 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4c96c569-3b15-472e-b001-04050d6feec6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:42.505683 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4c96c569-3b15-472e-b001-04050d6feec6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: fc136da8-3767-4c12-906c-d3a3562ccba4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:42.527234 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4c96c569-3b15-472e-b001-04050d6feec6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:42.534298 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4c96c569-3b15-472e-b001-04050d6feec6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:42.534873 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4c96c569-3b15-472e-b001-04050d6feec6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:42.536126 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4c96c569-3b15-472e-b001-04050d6feec6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:42.539355 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4c96c569-3b15-472e-b001-04050d6feec6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:42.540893 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4c96c569-3b15-472e-b001-04050d6feec6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:42.598518 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-036c5c87-f8e6-4bf7-8c5c-7170225385e1 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:42.599394 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-036c5c87-f8e6-4bf7-8c5c-7170225385e1 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:42.600045 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-036c5c87-f8e6-4bf7-8c5c-7170225385e1 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:42.600704 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-036c5c87-f8e6-4bf7-8c5c-7170225385e1 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Lazy-loading 'fault' on Instance uuid d209c762-5668-445f-aabf-9952ba110f38 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:51:42.639789 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:51:42.699583 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-036c5c87-f8e6-4bf7-8c5c-7170225385e1 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7faf4e5c164941c2bcf5ba6e8f100b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b4487fe1814c8e892d803f909557ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:42.708931 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-036c5c87-f8e6-4bf7-8c5c-7170225385e1 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] 10.222.0.20 "GET /compute/v2.1/servers/d209c762-5668-445f-aabf-9952ba110f38" status: 200 len: 1318 microversion: 2.1 time: 0.267361 Oct 04 18:51:42.731369 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2589/5123] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:42 2022] GET /compute/v2.1/servers/d209c762-5668-445f-aabf-9952ba110f38 => generated 1318 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:51:43.219184 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1eb5bcc7-a3a8-4053-9302-48f8ebf787f1 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:43.220190 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1eb5bcc7-a3a8-4053-9302-48f8ebf787f1 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9eaa25a-0821-47fb-a16e-d07bcde9cc60] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:43.237346 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1eb5bcc7-a3a8-4053-9302-48f8ebf787f1 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:43.237896 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1eb5bcc7-a3a8-4053-9302-48f8ebf787f1 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:43.238574 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1eb5bcc7-a3a8-4053-9302-48f8ebf787f1 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:43.239520 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1eb5bcc7-a3a8-4053-9302-48f8ebf787f1 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:43.240241 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1eb5bcc7-a3a8-4053-9302-48f8ebf787f1 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:43.240915 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1eb5bcc7-a3a8-4053-9302-48f8ebf787f1 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:43.578983 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4c96c569-3b15-472e-b001-04050d6feec6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:43.601091 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4c96c569-3b15-472e-b001-04050d6feec6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/fc136da8-3767-4c12-906c-d3a3562ccba4" status: 200 len: 1502 microversion: 2.1 time: 1.086757 Oct 04 18:51:43.619675 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2535/5124] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:42 2022] GET /compute/v2.1/servers/fc136da8-3767-4c12-906c-d3a3562ccba4 => generated 1502 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:43.635238 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-fbc54754-9a40-414d-a23c-afe1d023cbd6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:51:43.647160 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-fbc54754-9a40-414d-a23c-afe1d023cbd6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: fc136da8-3767-4c12-906c-d3a3562ccba4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:43.669183 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fbc54754-9a40-414d-a23c-afe1d023cbd6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:43.672180 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fbc54754-9a40-414d-a23c-afe1d023cbd6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:43.672895 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fbc54754-9a40-414d-a23c-afe1d023cbd6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:43.679072 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fbc54754-9a40-414d-a23c-afe1d023cbd6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:43.679072 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fbc54754-9a40-414d-a23c-afe1d023cbd6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:43.679072 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fbc54754-9a40-414d-a23c-afe1d023cbd6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:43.786501 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1eb5bcc7-a3a8-4053-9302-48f8ebf787f1 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:43.789321 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-fbc54754-9a40-414d-a23c-afe1d023cbd6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "POST /compute/v2.1/servers/fc136da8-3767-4c12-906c-d3a3562ccba4/action" status: 200 len: 14 microversion: 2.1 time: 0.166947 Oct 04 18:51:43.799678 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2536/5125] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:51:43 2022] POST /compute/v2.1/servers/fc136da8-3767-4c12-906c-d3a3562ccba4/action => generated 14 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:51:43.799820 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1eb5bcc7-a3a8-4053-9302-48f8ebf787f1 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60" status: 200 len: 1506 microversion: 2.1 time: 0.582283 Oct 04 18:51:43.799913 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6649dffb-5ca1-41d6-acbe-3e7860c1e6a5 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:43.800194 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2590/5126] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:43 2022] GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60 => generated 1506 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:43.800490 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-6649dffb-5ca1-41d6-acbe-3e7860c1e6a5 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] [instance: d209c762-5668-445f-aabf-9952ba110f38] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:43.810874 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6649dffb-5ca1-41d6-acbe-3e7860c1e6a5 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:43.811650 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6649dffb-5ca1-41d6-acbe-3e7860c1e6a5 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:43.812365 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6649dffb-5ca1-41d6-acbe-3e7860c1e6a5 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:43.813102 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6649dffb-5ca1-41d6-acbe-3e7860c1e6a5 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:43.813568 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6649dffb-5ca1-41d6-acbe-3e7860c1e6a5 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:43.814042 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6649dffb-5ca1-41d6-acbe-3e7860c1e6a5 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:43.830131 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-6649dffb-5ca1-41d6-acbe-3e7860c1e6a5 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] HTTP exception thrown: Instance d209c762-5668-445f-aabf-9952ba110f38 could not be found. Oct 04 18:51:43.831828 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6649dffb-5ca1-41d6-acbe-3e7860c1e6a5 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Request method failure captured: Oct 04 18:51:43.831828 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/d209c762-5668-445f-aabf-9952ba110f38 HTTP/1.1 Oct 04 18:51:43.831828 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:51:43.831828 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:51:43.831828 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:51:43.831828 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:51:43.831828 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:51:43.831828 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:51:43.831828 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:51:43.831828 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:51:43.831828 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPICWSrUfgJ86emdyOC2x5HsAT_bFwvW7itPHcFBky6zztr2OvwqMqjaIYJCCzbw8Hw2HhrPugEzkbigcCXMT1jSjwFJMevazX52aO2eWIpwfSeq6kFquvFT1gFll5vzoyWfI2OWD3HL9uhtxo7TiryKi_iqXWMz8WRF1yza3lsd8Dd8 Oct 04 18:51:43.831828 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:51:43.831828 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:51:43.831828 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:51:43.831828 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:51:43.831828 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:51:43.831828 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:51:43.831828 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 92b4487fe1814c8e892d803f909557ed Oct 04 18:51:43.831828 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-628184512 Oct 04 18:51:43.831828 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:51:43.831828 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:51:43.831828 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/92b4487fe1814c8e892d803f909557ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_92b4487fe1814c8e892d803f909557ed", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/92b4487fe1814c8e892d803f909557ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/92b4487fe1814c8e892d803f909557ed"}]}] Oct 04 18:51:43.831828 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-628184512 Oct 04 18:51:43.831828 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 92b4487fe1814c8e892d803f909557ed Oct 04 18:51:43.831828 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-628184512 Oct 04 18:51:43.831828 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServersNegativeTestMultiTenantJSON-628184512-project Oct 04 18:51:43.831828 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:51:43.831828 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:51:43.831828 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 7faf4e5c164941c2bcf5ba6e8f100b9d Oct 04 18:51:43.831828 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-628184512-project Oct 04 18:51:43.831828 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:51:43.831828 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance d209c762-5668-445f-aabf-9952ba110f38 could not be found. Oct 04 18:51:43.831828 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'd209c762-5668-445f-aabf-9952ba110f38'} Oct 04 18:51:43.831828 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:51:43.831828 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:51:43.831828 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:51:43.831828 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:51:43.831828 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:51:43.831828 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:51:43.831828 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:51:43.831828 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:51:43.831828 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:51:43.831828 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:51:43.831828 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d209c762-5668-445f-aabf-9952ba110f38 could not be found. Oct 04 18:51:43.831828 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:51:43.831828 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:51:43.831828 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:51:43.831828 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:51:43.831828 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:51:43.831828 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:51:43.831828 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:51:43.831828 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:51:43.831828 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:51:43.831828 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:51:43.831828 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:51:43.831828 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:51:43.831828 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:51:43.831828 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:51:43.831828 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:51:43.831828 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:51:43.831828 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d209c762-5668-445f-aabf-9952ba110f38 could not be found. Oct 04 18:51:43.831828 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:51:43.837874 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:51:43.837874 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:51:43.837874 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:51:43.837874 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:51:43.837874 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:51:43.837874 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:51:43.837874 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:51:43.837874 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d209c762-5668-445f-aabf-9952ba110f38 could not be found. Oct 04 18:51:43.837874 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:51:43.837874 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6649dffb-5ca1-41d6-acbe-3e7860c1e6a5 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] Returning 404 to user: Instance d209c762-5668-445f-aabf-9952ba110f38 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:51:43.837874 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6649dffb-5ca1-41d6-acbe-3e7860c1e6a5 tempest-ServersNegativeTestMultiTenantJSON-628184512 tempest-ServersNegativeTestMultiTenantJSON-628184512-project] 10.222.0.20 "GET /compute/v2.1/servers/d209c762-5668-445f-aabf-9952ba110f38" status: 404 len: 111 microversion: 2.1 time: 0.038105 Oct 04 18:51:43.837874 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2537/5127] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:43 2022] GET /compute/v2.1/servers/d209c762-5668-445f-aabf-9952ba110f38 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:51:44.802316 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2b70d770-b450-4da5-beed-7cad32d93961 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:51:44.808672 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2b70d770-b450-4da5-beed-7cad32d93961 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: fc136da8-3767-4c12-906c-d3a3562ccba4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:44.821455 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2b70d770-b450-4da5-beed-7cad32d93961 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:44.823251 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2b70d770-b450-4da5-beed-7cad32d93961 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:44.823892 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2b70d770-b450-4da5-beed-7cad32d93961 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:44.826313 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2b70d770-b450-4da5-beed-7cad32d93961 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:44.826995 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2b70d770-b450-4da5-beed-7cad32d93961 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:44.827387 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-98d40d28-b784-4368-84c0-3fdd1a9a2a77 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:44.828525 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2b70d770-b450-4da5-beed-7cad32d93961 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:44.828661 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-98d40d28-b784-4368-84c0-3fdd1a9a2a77 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9eaa25a-0821-47fb-a16e-d07bcde9cc60] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:44.842049 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-98d40d28-b784-4368-84c0-3fdd1a9a2a77 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:44.843859 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-98d40d28-b784-4368-84c0-3fdd1a9a2a77 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:44.845581 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-98d40d28-b784-4368-84c0-3fdd1a9a2a77 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:44.853971 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-98d40d28-b784-4368-84c0-3fdd1a9a2a77 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:44.853971 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-98d40d28-b784-4368-84c0-3fdd1a9a2a77 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:44.853971 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-98d40d28-b784-4368-84c0-3fdd1a9a2a77 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:44.913408 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2b70d770-b450-4da5-beed-7cad32d93961 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "POST /compute/v2.1/servers/fc136da8-3767-4c12-906c-d3a3562ccba4/action" status: 200 len: 14 microversion: 2.1 time: 0.115272 Oct 04 18:51:44.915703 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2591/5128] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:51:44 2022] POST /compute/v2.1/servers/fc136da8-3767-4c12-906c-d3a3562ccba4/action => generated 14 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:51:45.504609 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-98d40d28-b784-4368-84c0-3fdd1a9a2a77 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:45.521264 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-98d40d28-b784-4368-84c0-3fdd1a9a2a77 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60" status: 200 len: 1506 microversion: 2.1 time: 0.700454 Oct 04 18:51:45.521872 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2538/5129] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:44 2022] GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60 => generated 1506 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:51:45.926306 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-bb00ecc2-e37e-4285-b808-e7a239190b41 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:51:45.928681 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-bb00ecc2-e37e-4285-b808-e7a239190b41 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: fc136da8-3767-4c12-906c-d3a3562ccba4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:45.942102 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bb00ecc2-e37e-4285-b808-e7a239190b41 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:45.942593 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bb00ecc2-e37e-4285-b808-e7a239190b41 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:45.943294 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bb00ecc2-e37e-4285-b808-e7a239190b41 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:45.944004 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bb00ecc2-e37e-4285-b808-e7a239190b41 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:45.953857 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bb00ecc2-e37e-4285-b808-e7a239190b41 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:45.954283 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bb00ecc2-e37e-4285-b808-e7a239190b41 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:46.040789 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-bb00ecc2-e37e-4285-b808-e7a239190b41 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "POST /compute/v2.1/servers/fc136da8-3767-4c12-906c-d3a3562ccba4/action" status: 200 len: 14 microversion: 2.1 time: 0.118057 Oct 04 18:51:46.041473 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2592/5130] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:51:45 2022] POST /compute/v2.1/servers/fc136da8-3767-4c12-906c-d3a3562ccba4/action => generated 14 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:51:46.234528 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8abb57b6-e08a-42d8-989f-581c713fead8 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1500998961", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": [{"uuid": "05b3fc66-8d50-4841-aedb-d7bd07f42fa2"}]}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:51:46.305472 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-8abb57b6-e08a-42d8-989f-581c713fead8 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] validate_networks() for [('05b3fc66-8d50-4841-aedb-d7bd07f42fa2', None, None, None, None, None)] {{(pid=123002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:51:46.546610 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4f9abf80-d748-4b41-9011-bf15a1832f2c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:46.547552 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-4f9abf80-d748-4b41-9011-bf15a1832f2c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9eaa25a-0821-47fb-a16e-d07bcde9cc60] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:46.554907 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4f9abf80-d748-4b41-9011-bf15a1832f2c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:46.555649 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4f9abf80-d748-4b41-9011-bf15a1832f2c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:46.556301 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4f9abf80-d748-4b41-9011-bf15a1832f2c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:46.557156 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4f9abf80-d748-4b41-9011-bf15a1832f2c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:46.558298 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4f9abf80-d748-4b41-9011-bf15a1832f2c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:46.558882 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4f9abf80-d748-4b41-9011-bf15a1832f2c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:46.564230 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:51:47.029982 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-4f9abf80-d748-4b41-9011-bf15a1832f2c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:47.040029 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-4f9abf80-d748-4b41-9011-bf15a1832f2c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60" status: 200 len: 1506 microversion: 2.1 time: 0.498044 Oct 04 18:51:47.041469 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2593/5131] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:46 2022] GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60 => generated 1506 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:51:47.063275 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c0b224c3-a477-4091-8508-8cba6e82b952 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:51:47.074346 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c0b224c3-a477-4091-8508-8cba6e82b952 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: fc136da8-3767-4c12-906c-d3a3562ccba4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:47.081532 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c0b224c3-a477-4091-8508-8cba6e82b952 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:47.082641 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c0b224c3-a477-4091-8508-8cba6e82b952 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:47.083349 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c0b224c3-a477-4091-8508-8cba6e82b952 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:47.084877 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c0b224c3-a477-4091-8508-8cba6e82b952 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:47.085524 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c0b224c3-a477-4091-8508-8cba6e82b952 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:47.086108 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c0b224c3-a477-4091-8508-8cba6e82b952 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:47.163636 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c0b224c3-a477-4091-8508-8cba6e82b952 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "POST /compute/v2.1/servers/fc136da8-3767-4c12-906c-d3a3562ccba4/action" status: 200 len: 14 microversion: 2.1 time: 0.106643 Oct 04 18:51:47.164459 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2594/5132] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:51:47 2022] POST /compute/v2.1/servers/fc136da8-3767-4c12-906c-d3a3562ccba4/action => generated 14 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:51:47.382825 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-8abb57b6-e08a-42d8-989f-581c713fead8 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:51:47.388200 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-8abb57b6-e08a-42d8-989f-581c713fead8 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:51:47.388952 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-8abb57b6-e08a-42d8-989f-581c713fead8 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:51:47.390803 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-8abb57b6-e08a-42d8-989f-581c713fead8 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:51:47.392679 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-8abb57b6-e08a-42d8-989f-581c713fead8 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:51:47.404384 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8abb57b6-e08a-42d8-989f-581c713fead8 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:47.404877 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8abb57b6-e08a-42d8-989f-581c713fead8 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:47.405525 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8abb57b6-e08a-42d8-989f-581c713fead8 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:47.406498 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8abb57b6-e08a-42d8-989f-581c713fead8 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:47.407270 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8abb57b6-e08a-42d8-989f-581c713fead8 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:47.407854 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8abb57b6-e08a-42d8-989f-581c713fead8 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:47.428199 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-8abb57b6-e08a-42d8-989f-581c713fead8 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Getting quotas for project fc7284369fd548539c5152796566eca4. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:51:47.435901 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-8abb57b6-e08a-42d8-989f-581c713fead8 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Getting quotas for user 6ed1e61032824e30be2244ae45341d6f and project fc7284369fd548539c5152796566eca4. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:51:47.451659 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8abb57b6-e08a-42d8-989f-581c713fead8 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Going to run 1 instances... {{(pid=123002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:51:47.454398 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8abb57b6-e08a-42d8-989f-581c713fead8 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] [instance: f1b17780-52f5-468b-afe8-44ace600334c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:51:47.740376 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8abb57b6-e08a-42d8-989f-581c713fead8 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 1.583315 Oct 04 18:51:47.742036 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2539/5133] 10.222.0.20 () {62 vars in 1188 bytes} [Tue Oct 4 18:51:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1587 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 04 18:51:47.755898 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-bba80d08-ef66-4568-9c5c-652de9c15630 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:47.758932 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-bba80d08-ef66-4568-9c5c-652de9c15630 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] [instance: f1b17780-52f5-468b-afe8-44ace600334c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:47.950757 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-bba80d08-ef66-4568-9c5c-652de9c15630 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed1e61032824e30be2244ae45341d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7284369fd548539c5152796566eca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:47.962142 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-bba80d08-ef66-4568-9c5c-652de9c15630 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ed1e61032824e30be2244ae45341d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7284369fd548539c5152796566eca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:47.978926 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-bba80d08-ef66-4568-9c5c-652de9c15630 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ed1e61032824e30be2244ae45341d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7284369fd548539c5152796566eca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:47.978926 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-bba80d08-ef66-4568-9c5c-652de9c15630 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] 10.222.0.20 "GET /compute/v2.1/servers/f1b17780-52f5-468b-afe8-44ace600334c" status: 200 len: 1259 microversion: 2.21 time: 0.220444 Oct 04 18:51:47.978926 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2595/5134] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:51:47 2022] GET /compute/v2.1/servers/f1b17780-52f5-468b-afe8-44ace600334c => generated 1259 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:51:48.066380 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d7a9afca-d66a-4701-b560-e8d8a8c14b70 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:48.067255 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d7a9afca-d66a-4701-b560-e8d8a8c14b70 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9eaa25a-0821-47fb-a16e-d07bcde9cc60] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:48.081822 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d7a9afca-d66a-4701-b560-e8d8a8c14b70 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:48.082719 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d7a9afca-d66a-4701-b560-e8d8a8c14b70 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:48.083337 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d7a9afca-d66a-4701-b560-e8d8a8c14b70 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:48.086481 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d7a9afca-d66a-4701-b560-e8d8a8c14b70 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:48.087302 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d7a9afca-d66a-4701-b560-e8d8a8c14b70 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:48.087977 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d7a9afca-d66a-4701-b560-e8d8a8c14b70 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:48.174905 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e2e91cbe-6a8c-4dc1-95ba-a4f9d37bea29 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:51:48.177170 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e2e91cbe-6a8c-4dc1-95ba-a4f9d37bea29 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: fc136da8-3767-4c12-906c-d3a3562ccba4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:48.201685 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e2e91cbe-6a8c-4dc1-95ba-a4f9d37bea29 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:48.201685 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e2e91cbe-6a8c-4dc1-95ba-a4f9d37bea29 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:48.201685 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e2e91cbe-6a8c-4dc1-95ba-a4f9d37bea29 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:48.201685 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e2e91cbe-6a8c-4dc1-95ba-a4f9d37bea29 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:48.201685 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e2e91cbe-6a8c-4dc1-95ba-a4f9d37bea29 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:48.201685 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e2e91cbe-6a8c-4dc1-95ba-a4f9d37bea29 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:48.286332 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e2e91cbe-6a8c-4dc1-95ba-a4f9d37bea29 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "POST /compute/v2.1/servers/fc136da8-3767-4c12-906c-d3a3562ccba4/action" status: 200 len: 14 microversion: 2.1 time: 0.114837 Oct 04 18:51:48.287845 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2596/5135] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:51:48 2022] POST /compute/v2.1/servers/fc136da8-3767-4c12-906c-d3a3562ccba4/action => generated 14 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:51:48.423183 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d7a9afca-d66a-4701-b560-e8d8a8c14b70 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:48.437174 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d7a9afca-d66a-4701-b560-e8d8a8c14b70 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60" status: 200 len: 1506 microversion: 2.1 time: 0.376522 Oct 04 18:51:48.438624 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2540/5136] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:48 2022] GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60 => generated 1506 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:49.004815 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9ecc9f05-d469-4a0a-a019-eaa2e12253e5 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:49.005581 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-9ecc9f05-d469-4a0a-a019-eaa2e12253e5 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] [instance: f1b17780-52f5-468b-afe8-44ace600334c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:49.115303 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9ecc9f05-d469-4a0a-a019-eaa2e12253e5 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed1e61032824e30be2244ae45341d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7284369fd548539c5152796566eca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:49.139063 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9ecc9f05-d469-4a0a-a019-eaa2e12253e5 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ed1e61032824e30be2244ae45341d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7284369fd548539c5152796566eca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:49.141756 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9ecc9f05-d469-4a0a-a019-eaa2e12253e5 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ed1e61032824e30be2244ae45341d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7284369fd548539c5152796566eca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:49.145403 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9ecc9f05-d469-4a0a-a019-eaa2e12253e5 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] 10.222.0.20 "GET /compute/v2.1/servers/f1b17780-52f5-468b-afe8-44ace600334c" status: 200 len: 1259 microversion: 2.21 time: 0.145355 Oct 04 18:51:49.146197 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2597/5137] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:51:48 2022] GET /compute/v2.1/servers/f1b17780-52f5-468b-afe8-44ace600334c => generated 1259 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:51:49.299523 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a6808044-b475-4df9-adbe-398f3d34738c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:51:49.307315 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a6808044-b475-4df9-adbe-398f3d34738c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: fc136da8-3767-4c12-906c-d3a3562ccba4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:49.319936 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a6808044-b475-4df9-adbe-398f3d34738c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:49.320781 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a6808044-b475-4df9-adbe-398f3d34738c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:49.323286 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a6808044-b475-4df9-adbe-398f3d34738c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:49.324486 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a6808044-b475-4df9-adbe-398f3d34738c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:49.325134 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a6808044-b475-4df9-adbe-398f3d34738c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:49.326314 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a6808044-b475-4df9-adbe-398f3d34738c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:49.414182 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a6808044-b475-4df9-adbe-398f3d34738c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "POST /compute/v2.1/servers/fc136da8-3767-4c12-906c-d3a3562ccba4/action" status: 200 len: 14 microversion: 2.1 time: 0.118553 Oct 04 18:51:49.415928 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2541/5138] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:51:49 2022] POST /compute/v2.1/servers/fc136da8-3767-4c12-906c-d3a3562ccba4/action => generated 14 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:51:49.466934 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b3abd82e-dd08-4e99-bfd3-83062c70ae9c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:49.468218 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b3abd82e-dd08-4e99-bfd3-83062c70ae9c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9eaa25a-0821-47fb-a16e-d07bcde9cc60] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:49.478110 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b3abd82e-dd08-4e99-bfd3-83062c70ae9c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:49.478721 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b3abd82e-dd08-4e99-bfd3-83062c70ae9c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:49.479467 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b3abd82e-dd08-4e99-bfd3-83062c70ae9c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:49.480460 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b3abd82e-dd08-4e99-bfd3-83062c70ae9c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:49.481085 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b3abd82e-dd08-4e99-bfd3-83062c70ae9c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:49.481705 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b3abd82e-dd08-4e99-bfd3-83062c70ae9c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:49.858224 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b3abd82e-dd08-4e99-bfd3-83062c70ae9c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:49.867698 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b3abd82e-dd08-4e99-bfd3-83062c70ae9c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60" status: 200 len: 1506 microversion: 2.1 time: 0.405683 Oct 04 18:51:49.868462 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2598/5139] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:49 2022] GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60 => generated 1506 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:50.172333 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b98a8f42-a9bb-4f34-abab-2aede41780f4 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:50.173049 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b98a8f42-a9bb-4f34-abab-2aede41780f4 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] [instance: f1b17780-52f5-468b-afe8-44ace600334c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:50.223468 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b98a8f42-a9bb-4f34-abab-2aede41780f4 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:50.223468 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b98a8f42-a9bb-4f34-abab-2aede41780f4 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:50.223468 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b98a8f42-a9bb-4f34-abab-2aede41780f4 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:50.223468 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b98a8f42-a9bb-4f34-abab-2aede41780f4 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:50.223468 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b98a8f42-a9bb-4f34-abab-2aede41780f4 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:50.223468 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b98a8f42-a9bb-4f34-abab-2aede41780f4 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:50.349663 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b98a8f42-a9bb-4f34-abab-2aede41780f4 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed1e61032824e30be2244ae45341d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7284369fd548539c5152796566eca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:50.377794 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b98a8f42-a9bb-4f34-abab-2aede41780f4 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ed1e61032824e30be2244ae45341d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7284369fd548539c5152796566eca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:50.377794 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b98a8f42-a9bb-4f34-abab-2aede41780f4 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ed1e61032824e30be2244ae45341d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7284369fd548539c5152796566eca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:50.377794 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b98a8f42-a9bb-4f34-abab-2aede41780f4 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] 10.222.0.20 "GET /compute/v2.1/servers/f1b17780-52f5-468b-afe8-44ace600334c" status: 200 len: 1255 microversion: 2.21 time: 0.195513 Oct 04 18:51:50.377794 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2542/5140] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:51:50 2022] GET /compute/v2.1/servers/f1b17780-52f5-468b-afe8-44ace600334c => generated 1255 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:51:50.428879 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f8aea022-fb78-4743-a54a-1c8cf4acff1e tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:51:50.431711 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f8aea022-fb78-4743-a54a-1c8cf4acff1e tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: fc136da8-3767-4c12-906c-d3a3562ccba4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:50.448686 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f8aea022-fb78-4743-a54a-1c8cf4acff1e tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:50.449349 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f8aea022-fb78-4743-a54a-1c8cf4acff1e tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:50.449797 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f8aea022-fb78-4743-a54a-1c8cf4acff1e tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:50.450513 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f8aea022-fb78-4743-a54a-1c8cf4acff1e tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:50.450971 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f8aea022-fb78-4743-a54a-1c8cf4acff1e tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:50.451392 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f8aea022-fb78-4743-a54a-1c8cf4acff1e tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:50.542711 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f8aea022-fb78-4743-a54a-1c8cf4acff1e tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "POST /compute/v2.1/servers/fc136da8-3767-4c12-906c-d3a3562ccba4/action" status: 200 len: 14 microversion: 2.1 time: 0.118899 Oct 04 18:51:50.545142 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2599/5141] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:51:50 2022] POST /compute/v2.1/servers/fc136da8-3767-4c12-906c-d3a3562ccba4/action => generated 14 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:51:50.892368 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4f6455e9-bbf5-47fd-a5e5-86fcd8bd7ce8 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:50.893503 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4f6455e9-bbf5-47fd-a5e5-86fcd8bd7ce8 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9eaa25a-0821-47fb-a16e-d07bcde9cc60] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:50.910033 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4f6455e9-bbf5-47fd-a5e5-86fcd8bd7ce8 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:50.913566 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4f6455e9-bbf5-47fd-a5e5-86fcd8bd7ce8 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:50.915485 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4f6455e9-bbf5-47fd-a5e5-86fcd8bd7ce8 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:50.916848 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4f6455e9-bbf5-47fd-a5e5-86fcd8bd7ce8 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:50.922028 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4f6455e9-bbf5-47fd-a5e5-86fcd8bd7ce8 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:50.924166 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4f6455e9-bbf5-47fd-a5e5-86fcd8bd7ce8 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:51.388570 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4f6455e9-bbf5-47fd-a5e5-86fcd8bd7ce8 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:51.399951 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ac3b3b41-90cb-4b5f-8a6f-4abddb2a3788 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:51.400839 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ac3b3b41-90cb-4b5f-8a6f-4abddb2a3788 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] [instance: f1b17780-52f5-468b-afe8-44ace600334c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:51.420863 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4f6455e9-bbf5-47fd-a5e5-86fcd8bd7ce8 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60" status: 200 len: 1506 microversion: 2.1 time: 0.533753 Oct 04 18:51:51.421503 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2543/5142] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:50 2022] GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60 => generated 1506 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:51.441413 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ac3b3b41-90cb-4b5f-8a6f-4abddb2a3788 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:51.441909 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ac3b3b41-90cb-4b5f-8a6f-4abddb2a3788 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:51.454716 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ac3b3b41-90cb-4b5f-8a6f-4abddb2a3788 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:51.454716 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ac3b3b41-90cb-4b5f-8a6f-4abddb2a3788 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:51.454716 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ac3b3b41-90cb-4b5f-8a6f-4abddb2a3788 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:51.454716 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ac3b3b41-90cb-4b5f-8a6f-4abddb2a3788 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:51.555573 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5e420718-976b-40c9-8dd6-da9e58bb9823 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:51:51.558280 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5e420718-976b-40c9-8dd6-da9e58bb9823 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: fc136da8-3767-4c12-906c-d3a3562ccba4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:51.576399 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5e420718-976b-40c9-8dd6-da9e58bb9823 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:51.576904 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5e420718-976b-40c9-8dd6-da9e58bb9823 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:51.577346 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5e420718-976b-40c9-8dd6-da9e58bb9823 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:51.578139 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5e420718-976b-40c9-8dd6-da9e58bb9823 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:51.578598 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5e420718-976b-40c9-8dd6-da9e58bb9823 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:51.579025 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5e420718-976b-40c9-8dd6-da9e58bb9823 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:51.648418 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ac3b3b41-90cb-4b5f-8a6f-4abddb2a3788 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed1e61032824e30be2244ae45341d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7284369fd548539c5152796566eca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:51.666200 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ac3b3b41-90cb-4b5f-8a6f-4abddb2a3788 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ed1e61032824e30be2244ae45341d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7284369fd548539c5152796566eca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:51.670445 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5e420718-976b-40c9-8dd6-da9e58bb9823 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "POST /compute/v2.1/servers/fc136da8-3767-4c12-906c-d3a3562ccba4/action" status: 200 len: 14 microversion: 2.1 time: 0.118531 Oct 04 18:51:51.674847 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2544/5143] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:51:51 2022] POST /compute/v2.1/servers/fc136da8-3767-4c12-906c-d3a3562ccba4/action => generated 14 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 18:51:51.675674 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ac3b3b41-90cb-4b5f-8a6f-4abddb2a3788 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ed1e61032824e30be2244ae45341d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7284369fd548539c5152796566eca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:51.677882 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ac3b3b41-90cb-4b5f-8a6f-4abddb2a3788 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] 10.222.0.20 "GET /compute/v2.1/servers/f1b17780-52f5-468b-afe8-44ace600334c" status: 200 len: 1319 microversion: 2.21 time: 0.287067 Oct 04 18:51:51.680427 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2600/5144] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:51:51 2022] GET /compute/v2.1/servers/f1b17780-52f5-468b-afe8-44ace600334c => generated 1319 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:51:52.452733 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c25502a3-f712-4155-aadf-49482e652899 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:52.454166 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c25502a3-f712-4155-aadf-49482e652899 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9eaa25a-0821-47fb-a16e-d07bcde9cc60] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:52.461645 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c25502a3-f712-4155-aadf-49482e652899 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:52.462139 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c25502a3-f712-4155-aadf-49482e652899 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:52.462790 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c25502a3-f712-4155-aadf-49482e652899 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:52.464274 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c25502a3-f712-4155-aadf-49482e652899 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:52.464741 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c25502a3-f712-4155-aadf-49482e652899 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:52.465342 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c25502a3-f712-4155-aadf-49482e652899 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:52.686380 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7791719b-9b06-4f8f-9f44-55fd71e093f1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:51:52.694999 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7791719b-9b06-4f8f-9f44-55fd71e093f1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: fc136da8-3767-4c12-906c-d3a3562ccba4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:52.707996 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7791719b-9b06-4f8f-9f44-55fd71e093f1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:52.708685 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7791719b-9b06-4f8f-9f44-55fd71e093f1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:52.721541 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7791719b-9b06-4f8f-9f44-55fd71e093f1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:52.736898 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7791719b-9b06-4f8f-9f44-55fd71e093f1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:52.737914 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7791719b-9b06-4f8f-9f44-55fd71e093f1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:52.738584 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7791719b-9b06-4f8f-9f44-55fd71e093f1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:52.805997 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7791719b-9b06-4f8f-9f44-55fd71e093f1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "POST /compute/v2.1/servers/fc136da8-3767-4c12-906c-d3a3562ccba4/action" status: 200 len: 14 microversion: 2.1 time: 0.123369 Oct 04 18:51:52.811344 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2601/5145] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:51:52 2022] POST /compute/v2.1/servers/fc136da8-3767-4c12-906c-d3a3562ccba4/action => generated 14 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:51:52.819613 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7110d574-5251-4f6a-b232-213a7d2fec4e tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:52.820621 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7110d574-5251-4f6a-b232-213a7d2fec4e tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] [instance: f1b17780-52f5-468b-afe8-44ace600334c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:52.830662 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c25502a3-f712-4155-aadf-49482e652899 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:52.839267 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7110d574-5251-4f6a-b232-213a7d2fec4e tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:52.840080 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c25502a3-f712-4155-aadf-49482e652899 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60" status: 200 len: 1506 microversion: 2.1 time: 0.391648 Oct 04 18:51:52.840564 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7110d574-5251-4f6a-b232-213a7d2fec4e tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:52.840730 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2545/5146] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:52 2022] GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60 => generated 1506 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:52.841386 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7110d574-5251-4f6a-b232-213a7d2fec4e tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:52.843985 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7110d574-5251-4f6a-b232-213a7d2fec4e tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:52.844762 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7110d574-5251-4f6a-b232-213a7d2fec4e tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:52.845456 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7110d574-5251-4f6a-b232-213a7d2fec4e tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:52.926347 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7110d574-5251-4f6a-b232-213a7d2fec4e tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed1e61032824e30be2244ae45341d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7284369fd548539c5152796566eca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:52.936132 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7110d574-5251-4f6a-b232-213a7d2fec4e tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ed1e61032824e30be2244ae45341d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7284369fd548539c5152796566eca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:52.941005 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7110d574-5251-4f6a-b232-213a7d2fec4e tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ed1e61032824e30be2244ae45341d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7284369fd548539c5152796566eca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:52.941005 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7110d574-5251-4f6a-b232-213a7d2fec4e tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] 10.222.0.20 "GET /compute/v2.1/servers/f1b17780-52f5-468b-afe8-44ace600334c" status: 200 len: 1317 microversion: 2.21 time: 0.125457 Oct 04 18:51:52.941005 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2602/5147] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:51:52 2022] GET /compute/v2.1/servers/f1b17780-52f5-468b-afe8-44ace600334c => generated 1317 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:51:53.821616 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ae386e5b-b595-4a2e-a1a8-e735466fbff6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:51:53.825047 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ae386e5b-b595-4a2e-a1a8-e735466fbff6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: fc136da8-3767-4c12-906c-d3a3562ccba4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:53.834467 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ae386e5b-b595-4a2e-a1a8-e735466fbff6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:53.834970 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ae386e5b-b595-4a2e-a1a8-e735466fbff6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:53.835418 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ae386e5b-b595-4a2e-a1a8-e735466fbff6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:53.836191 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ae386e5b-b595-4a2e-a1a8-e735466fbff6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:53.836657 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ae386e5b-b595-4a2e-a1a8-e735466fbff6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:53.837117 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ae386e5b-b595-4a2e-a1a8-e735466fbff6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:53.866490 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-47c4a748-0b1f-4f3f-bc9d-ac6a31d5d1f1 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:53.874316 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-47c4a748-0b1f-4f3f-bc9d-ac6a31d5d1f1 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9eaa25a-0821-47fb-a16e-d07bcde9cc60] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:53.881015 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-47c4a748-0b1f-4f3f-bc9d-ac6a31d5d1f1 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:53.881523 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-47c4a748-0b1f-4f3f-bc9d-ac6a31d5d1f1 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:53.881983 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-47c4a748-0b1f-4f3f-bc9d-ac6a31d5d1f1 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:53.882689 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-47c4a748-0b1f-4f3f-bc9d-ac6a31d5d1f1 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:53.883135 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-47c4a748-0b1f-4f3f-bc9d-ac6a31d5d1f1 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:53.883640 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-47c4a748-0b1f-4f3f-bc9d-ac6a31d5d1f1 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:53.905626 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ae386e5b-b595-4a2e-a1a8-e735466fbff6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "POST /compute/v2.1/servers/fc136da8-3767-4c12-906c-d3a3562ccba4/action" status: 200 len: 14 microversion: 2.1 time: 0.090856 Oct 04 18:51:53.906885 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2546/5148] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:51:53 2022] POST /compute/v2.1/servers/fc136da8-3767-4c12-906c-d3a3562ccba4/action => generated 14 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:51:53.970004 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f39b697f-e29b-4280-a5ec-6dc8aed1add8 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:53.970004 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f39b697f-e29b-4280-a5ec-6dc8aed1add8 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] [instance: f1b17780-52f5-468b-afe8-44ace600334c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:53.978887 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f39b697f-e29b-4280-a5ec-6dc8aed1add8 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:53.979361 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f39b697f-e29b-4280-a5ec-6dc8aed1add8 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:53.979998 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f39b697f-e29b-4280-a5ec-6dc8aed1add8 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:53.981342 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f39b697f-e29b-4280-a5ec-6dc8aed1add8 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:53.982122 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f39b697f-e29b-4280-a5ec-6dc8aed1add8 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:53.982560 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f39b697f-e29b-4280-a5ec-6dc8aed1add8 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:54.074900 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f39b697f-e29b-4280-a5ec-6dc8aed1add8 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed1e61032824e30be2244ae45341d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7284369fd548539c5152796566eca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:54.082816 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-47c4a748-0b1f-4f3f-bc9d-ac6a31d5d1f1 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:54.091783 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f39b697f-e29b-4280-a5ec-6dc8aed1add8 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ed1e61032824e30be2244ae45341d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7284369fd548539c5152796566eca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:54.093122 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-47c4a748-0b1f-4f3f-bc9d-ac6a31d5d1f1 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60" status: 200 len: 1506 microversion: 2.1 time: 0.232053 Oct 04 18:51:54.096102 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f39b697f-e29b-4280-a5ec-6dc8aed1add8 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ed1e61032824e30be2244ae45341d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7284369fd548539c5152796566eca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:54.096275 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2603/5149] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:53 2022] GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60 => generated 1506 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:54.096404 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f39b697f-e29b-4280-a5ec-6dc8aed1add8 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] 10.222.0.20 "GET /compute/v2.1/servers/f1b17780-52f5-468b-afe8-44ace600334c" status: 200 len: 1317 microversion: 2.21 time: 0.133257 Oct 04 18:51:54.096404 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2547/5150] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:51:53 2022] GET /compute/v2.1/servers/f1b17780-52f5-468b-afe8-44ace600334c => generated 1317 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:51:54.926872 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ce25b369-de53-4e8a-8076-445ea28dcad1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:51:54.933488 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ce25b369-de53-4e8a-8076-445ea28dcad1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: fc136da8-3767-4c12-906c-d3a3562ccba4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:54.950954 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ce25b369-de53-4e8a-8076-445ea28dcad1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:54.960833 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ce25b369-de53-4e8a-8076-445ea28dcad1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:54.962248 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ce25b369-de53-4e8a-8076-445ea28dcad1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:54.982403 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ce25b369-de53-4e8a-8076-445ea28dcad1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:54.982403 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ce25b369-de53-4e8a-8076-445ea28dcad1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:54.982403 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ce25b369-de53-4e8a-8076-445ea28dcad1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:55.087806 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ce25b369-de53-4e8a-8076-445ea28dcad1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "POST /compute/v2.1/servers/fc136da8-3767-4c12-906c-d3a3562ccba4/action" status: 200 len: 8208 microversion: 2.1 time: 0.172408 Oct 04 18:51:55.090600 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2604/5151] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:51:54 2022] POST /compute/v2.1/servers/fc136da8-3767-4c12-906c-d3a3562ccba4/action => generated 8208 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:55.104617 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-fc0384f3-17b0-417c-a65a-95456ba3c26c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:55.107016 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-fc0384f3-17b0-417c-a65a-95456ba3c26c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:55.123625 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9844b719-417d-42da-a65c-754f4ade1a5a tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:55.124540 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-9844b719-417d-42da-a65c-754f4ade1a5a tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9eaa25a-0821-47fb-a16e-d07bcde9cc60] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:55.128663 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fc0384f3-17b0-417c-a65a-95456ba3c26c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:55.129389 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fc0384f3-17b0-417c-a65a-95456ba3c26c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:55.132353 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fc0384f3-17b0-417c-a65a-95456ba3c26c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:55.135448 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fc0384f3-17b0-417c-a65a-95456ba3c26c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:55.135448 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fc0384f3-17b0-417c-a65a-95456ba3c26c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:55.135448 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fc0384f3-17b0-417c-a65a-95456ba3c26c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:55.135786 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9844b719-417d-42da-a65c-754f4ade1a5a tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:55.136847 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9844b719-417d-42da-a65c-754f4ade1a5a tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:55.137715 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9844b719-417d-42da-a65c-754f4ade1a5a tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:55.139005 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9844b719-417d-42da-a65c-754f4ade1a5a tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:55.140982 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9844b719-417d-42da-a65c-754f4ade1a5a tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:55.141662 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9844b719-417d-42da-a65c-754f4ade1a5a tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:55.583716 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-fc0384f3-17b0-417c-a65a-95456ba3c26c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:55.596949 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-fc0384f3-17b0-417c-a65a-95456ba3c26c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1672 microversion: 2.1 time: 0.499347 Oct 04 18:51:55.597800 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2548/5152] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:55 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1672 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:55.604413 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-02bbba44-55dc-45a9-bb38-06525d66eb92 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:55.605230 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-02bbba44-55dc-45a9-bb38-06525d66eb92 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] [instance: f1b17780-52f5-468b-afe8-44ace600334c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:55.613574 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-02bbba44-55dc-45a9-bb38-06525d66eb92 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:55.614067 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-02bbba44-55dc-45a9-bb38-06525d66eb92 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:55.614512 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-02bbba44-55dc-45a9-bb38-06525d66eb92 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:55.615323 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-02bbba44-55dc-45a9-bb38-06525d66eb92 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:55.615782 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-02bbba44-55dc-45a9-bb38-06525d66eb92 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:55.616258 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-02bbba44-55dc-45a9-bb38-06525d66eb92 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:55.627104 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9844b719-417d-42da-a65c-754f4ade1a5a tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:55.642272 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9844b719-417d-42da-a65c-754f4ade1a5a tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60" status: 200 len: 1506 microversion: 2.1 time: 0.528478 Oct 04 18:51:55.643025 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2605/5153] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:55 2022] GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60 => generated 1506 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:55.649251 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2cdfc6b1-4cc4-4275-8d75-b50de7c22964 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:55.650217 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2cdfc6b1-4cc4-4275-8d75-b50de7c22964 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:55.657200 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2cdfc6b1-4cc4-4275-8d75-b50de7c22964 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:55.659546 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2cdfc6b1-4cc4-4275-8d75-b50de7c22964 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:55.659546 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2cdfc6b1-4cc4-4275-8d75-b50de7c22964 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:55.659546 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2cdfc6b1-4cc4-4275-8d75-b50de7c22964 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:55.660290 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2cdfc6b1-4cc4-4275-8d75-b50de7c22964 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:55.660993 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2cdfc6b1-4cc4-4275-8d75-b50de7c22964 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:56.036855 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-02bbba44-55dc-45a9-bb38-06525d66eb92 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed1e61032824e30be2244ae45341d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7284369fd548539c5152796566eca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:56.052175 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-02bbba44-55dc-45a9-bb38-06525d66eb92 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ed1e61032824e30be2244ae45341d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7284369fd548539c5152796566eca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:56.053736 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-02bbba44-55dc-45a9-bb38-06525d66eb92 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ed1e61032824e30be2244ae45341d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7284369fd548539c5152796566eca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:56.054899 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-02bbba44-55dc-45a9-bb38-06525d66eb92 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] 10.222.0.20 "GET /compute/v2.1/servers/f1b17780-52f5-468b-afe8-44ace600334c" status: 200 len: 1359 microversion: 2.21 time: 0.455504 Oct 04 18:51:56.055463 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2549/5154] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:51:55 2022] GET /compute/v2.1/servers/f1b17780-52f5-468b-afe8-44ace600334c => generated 1359 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:51:56.141507 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-2cdfc6b1-4cc4-4275-8d75-b50de7c22964 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:56.154780 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2cdfc6b1-4cc4-4275-8d75-b50de7c22964 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1672 microversion: 2.1 time: 0.510404 Oct 04 18:51:56.157174 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2606/5155] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:55 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1672 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:56.185921 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1a8abdfc-8c16-4be4-b35a-75221f250ea9 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:56.188045 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1a8abdfc-8c16-4be4-b35a-75221f250ea9 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:56.196867 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1a8abdfc-8c16-4be4-b35a-75221f250ea9 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:56.197673 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1a8abdfc-8c16-4be4-b35a-75221f250ea9 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:56.198272 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1a8abdfc-8c16-4be4-b35a-75221f250ea9 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:56.199156 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1a8abdfc-8c16-4be4-b35a-75221f250ea9 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:56.199770 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1a8abdfc-8c16-4be4-b35a-75221f250ea9 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:56.200410 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1a8abdfc-8c16-4be4-b35a-75221f250ea9 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:56.426316 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1a8abdfc-8c16-4be4-b35a-75221f250ea9 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:56.436036 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1a8abdfc-8c16-4be4-b35a-75221f250ea9 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1672 microversion: 2.1 time: 0.259233 Oct 04 18:51:56.452472 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2550/5156] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:56 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1672 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:56.459849 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-74cddbb6-8437-4e5a-b4e2-803db9cf689f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:56.460748 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-74cddbb6-8437-4e5a-b4e2-803db9cf689f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:56.467811 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-74cddbb6-8437-4e5a-b4e2-803db9cf689f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:56.468396 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-74cddbb6-8437-4e5a-b4e2-803db9cf689f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:56.468832 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-74cddbb6-8437-4e5a-b4e2-803db9cf689f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:56.469528 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-74cddbb6-8437-4e5a-b4e2-803db9cf689f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:56.470167 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-74cddbb6-8437-4e5a-b4e2-803db9cf689f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:56.470588 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-74cddbb6-8437-4e5a-b4e2-803db9cf689f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:56.674242 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5e981bdd-e2d2-4417-a32d-e2e15df3230d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:56.674863 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5e981bdd-e2d2-4417-a32d-e2e15df3230d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9eaa25a-0821-47fb-a16e-d07bcde9cc60] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:56.681465 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5e981bdd-e2d2-4417-a32d-e2e15df3230d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:56.683250 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5e981bdd-e2d2-4417-a32d-e2e15df3230d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:56.683828 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5e981bdd-e2d2-4417-a32d-e2e15df3230d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:56.684726 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5e981bdd-e2d2-4417-a32d-e2e15df3230d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:56.685435 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5e981bdd-e2d2-4417-a32d-e2e15df3230d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:56.686027 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5e981bdd-e2d2-4417-a32d-e2e15df3230d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:56.797268 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-74cddbb6-8437-4e5a-b4e2-803db9cf689f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:56.813619 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-74cddbb6-8437-4e5a-b4e2-803db9cf689f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1672 microversion: 2.1 time: 0.352614 Oct 04 18:51:56.813619 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2607/5157] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:56 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1672 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:56.815878 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-bbf76417-b6aa-4943-91b6-8c64e64a66c2 req-8eb5e686-a4ca-4293-bbed-94fb131fa87f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1b17780-52f5-468b-afe8-44ace600334c", "tag": "8adf6669-0f1d-4bc5-93ff-aaa346197fa5"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:51:56.846108 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-bbf76417-b6aa-4943-91b6-8c64e64a66c2 req-8eb5e686-a4ca-4293-bbed-94fb131fa87f service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:56.848701 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-bbf76417-b6aa-4943-91b6-8c64e64a66c2 req-8eb5e686-a4ca-4293-bbed-94fb131fa87f service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:56.849290 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-bbf76417-b6aa-4943-91b6-8c64e64a66c2 req-8eb5e686-a4ca-4293-bbed-94fb131fa87f service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:56.880636 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-bbf76417-b6aa-4943-91b6-8c64e64a66c2 req-8eb5e686-a4ca-4293-bbed-94fb131fa87f service nova] Creating event network-changed:8adf6669-0f1d-4bc5-93ff-aaa346197fa5 for instance f1b17780-52f5-468b-afe8-44ace600334c on n-h1-850501-14 Oct 04 18:51:56.905272 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-bbf76417-b6aa-4943-91b6-8c64e64a66c2 req-8eb5e686-a4ca-4293-bbed-94fb131fa87f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089978 Oct 04 18:51:56.907544 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2608/5158] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:51:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:51:56.925943 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d2370315-c1b2-4ce6-a1b9-92aba904db01 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:51:56.927099 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d2370315-c1b2-4ce6-a1b9-92aba904db01 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:56.937366 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d2370315-c1b2-4ce6-a1b9-92aba904db01 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:56.937867 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d2370315-c1b2-4ce6-a1b9-92aba904db01 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:56.938308 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d2370315-c1b2-4ce6-a1b9-92aba904db01 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:56.944387 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d2370315-c1b2-4ce6-a1b9-92aba904db01 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:56.944900 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d2370315-c1b2-4ce6-a1b9-92aba904db01 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:56.946974 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d2370315-c1b2-4ce6-a1b9-92aba904db01 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:57.007212 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5e981bdd-e2d2-4417-a32d-e2e15df3230d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:57.017911 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5e981bdd-e2d2-4417-a32d-e2e15df3230d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60" status: 200 len: 1506 microversion: 2.1 time: 0.347508 Oct 04 18:51:57.018503 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2551/5159] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:56 2022] GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60 => generated 1506 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:51:57.086292 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-56364d1d-8255-49fb-9c6f-1fad3dd6f312 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:57.087083 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-56364d1d-8255-49fb-9c6f-1fad3dd6f312 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] [instance: f1b17780-52f5-468b-afe8-44ace600334c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:57.097441 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-56364d1d-8255-49fb-9c6f-1fad3dd6f312 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:57.100250 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-56364d1d-8255-49fb-9c6f-1fad3dd6f312 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:57.101183 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-56364d1d-8255-49fb-9c6f-1fad3dd6f312 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:57.103583 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-56364d1d-8255-49fb-9c6f-1fad3dd6f312 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:57.105079 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-56364d1d-8255-49fb-9c6f-1fad3dd6f312 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:57.106389 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-56364d1d-8255-49fb-9c6f-1fad3dd6f312 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:57.194983 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d2370315-c1b2-4ce6-a1b9-92aba904db01 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Locking {{(pid=123001) lock /opt/stack/nova/nova/compute/api.py:4845}} Oct 04 18:51:57.420640 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:51:57.430025 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-56364d1d-8255-49fb-9c6f-1fad3dd6f312 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed1e61032824e30be2244ae45341d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7284369fd548539c5152796566eca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:57.440160 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-56364d1d-8255-49fb-9c6f-1fad3dd6f312 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ed1e61032824e30be2244ae45341d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7284369fd548539c5152796566eca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:57.441742 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-56364d1d-8255-49fb-9c6f-1fad3dd6f312 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ed1e61032824e30be2244ae45341d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7284369fd548539c5152796566eca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:57.443249 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-56364d1d-8255-49fb-9c6f-1fad3dd6f312 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] 10.222.0.20 "GET /compute/v2.1/servers/f1b17780-52f5-468b-afe8-44ace600334c" status: 200 len: 1359 microversion: 2.21 time: 0.361770 Oct 04 18:51:57.443905 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2552/5160] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:51:57 2022] GET /compute/v2.1/servers/f1b17780-52f5-468b-afe8-44ace600334c => generated 1359 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:51:57.458727 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d2370315-c1b2-4ce6-a1b9-92aba904db01 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "POST /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238/action" status: 202 len: 0 microversion: 2.1 time: 0.548401 Oct 04 18:51:57.466528 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2609/5161] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:51:56 2022] POST /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238/action => generated 0 bytes in 551 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:51:57.473701 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3736a2e6-a5f7-4017-971f-db90fe04398d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:57.474622 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3736a2e6-a5f7-4017-971f-db90fe04398d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:57.476799 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=6 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:51:57.482748 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3736a2e6-a5f7-4017-971f-db90fe04398d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:57.483340 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3736a2e6-a5f7-4017-971f-db90fe04398d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:57.483908 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3736a2e6-a5f7-4017-971f-db90fe04398d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:57.484725 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3736a2e6-a5f7-4017-971f-db90fe04398d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:57.485305 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3736a2e6-a5f7-4017-971f-db90fe04398d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:57.485801 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3736a2e6-a5f7-4017-971f-db90fe04398d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:58.044891 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-54f80299-4ede-436c-b8a7-e39c94da278e tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:58.045887 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-54f80299-4ede-436c-b8a7-e39c94da278e tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9eaa25a-0821-47fb-a16e-d07bcde9cc60] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:58.053504 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-54f80299-4ede-436c-b8a7-e39c94da278e tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:58.054589 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-54f80299-4ede-436c-b8a7-e39c94da278e tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:58.055420 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-54f80299-4ede-436c-b8a7-e39c94da278e tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:58.056272 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-54f80299-4ede-436c-b8a7-e39c94da278e tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:58.057225 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-54f80299-4ede-436c-b8a7-e39c94da278e tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:58.057690 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-54f80299-4ede-436c-b8a7-e39c94da278e tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:58.080884 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3736a2e6-a5f7-4017-971f-db90fe04398d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:58.091043 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3736a2e6-a5f7-4017-971f-db90fe04398d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1672 microversion: 2.1 time: 0.621205 Oct 04 18:51:58.091882 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2553/5162] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:57 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1672 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:58.123507 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5f25ed81-2d6f-45af-b7c0-aa7d39eb3f7e tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:51:58.123507 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5f25ed81-2d6f-45af-b7c0-aa7d39eb3f7e tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:58.123507 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5f25ed81-2d6f-45af-b7c0-aa7d39eb3f7e tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:58.123507 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5f25ed81-2d6f-45af-b7c0-aa7d39eb3f7e tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:58.145480 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=100 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:51:58.159322 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-5f25ed81-2d6f-45af-b7c0-aa7d39eb3f7e tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] HTTP exception thrown: Instance 2e208f85-0513-43f4-8a2c-38baa2886238 is locked Oct 04 18:51:58.163869 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5f25ed81-2d6f-45af-b7c0-aa7d39eb3f7e tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Request method failure captured: Oct 04 18:51:58.163869 n-d-850501-14 devstack@n-api.service[123002]: request: POST /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238/action HTTP/1.1 Oct 04 18:51:58.163869 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:51:58.163869 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:51:58.163869 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:51:58.163869 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 15 Oct 04 18:51:58.163869 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:51:58.163869 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:51:58.163869 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:51:58.163869 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:51:58.163869 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH9sNKcZV12-VrzgkMcjOaIHcQXzo_OQ-K38hc0f55Lf_4RZrXGgMmn5jWeZmAc1TRzC-i_WlxKP0xlRL0UMRNxVvlUX8rNQZjC__ruqdhQgQWDSwxsACYsgZpz7nprjIdkJFbhvMXXkXexF7-ajgS9bmCu4Pvp0T8fklC1E3t24Rz8 Oct 04 18:51:58.163869 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:51:58.163869 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:51:58.163869 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:51:58.163869 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:51:58.163869 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:51:58.163869 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:51:58.163869 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 57d8fd392d5b4e8798cb51fe0e54ad3b Oct 04 18:51:58.163869 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServerActionsTestJSON-1010650728 Oct 04 18:51:58.163869 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:51:58.163869 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:51:58.163869 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/57d8fd392d5b4e8798cb51fe0e54ad3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_57d8fd392d5b4e8798cb51fe0e54ad3b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/57d8fd392d5b4e8798cb51fe0e54ad3b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/57d8fd392d5b4e8798cb51fe0e54ad3b"}]}] Oct 04 18:51:58.163869 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServerActionsTestJSON-1010650728 Oct 04 18:51:58.163869 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 57d8fd392d5b4e8798cb51fe0e54ad3b Oct 04 18:51:58.163869 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServerActionsTestJSON-1010650728 Oct 04 18:51:58.163869 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServerActionsTestJSON-1010650728-project Oct 04 18:51:58.163869 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:51:58.163869 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:51:58.163869 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: ee7fee2b098d4eb8bdc8df2a929cdede Oct 04 18:51:58.163869 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServerActionsTestJSON-1010650728-project Oct 04 18:51:58.163869 n-d-850501-14 devstack@n-api.service[123002]: Oct 04 18:51:58.163869 n-d-850501-14 devstack@n-api.service[123002]: {"os-stop": {}} Oct 04 18:51:58.163869 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:51:58.163869 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 2e208f85-0513-43f4-8a2c-38baa2886238 is locked Oct 04 18:51:58.163869 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '2e208f85-0513-43f4-8a2c-38baa2886238', 'body': {'os-stop': {}}} Oct 04 18:51:58.163869 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:51:58.163869 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:51:58.163869 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1449, in _stop_server Oct 04 18:51:58.163869 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Oct 04 18:51:58.163869 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Oct 04 18:51:58.163869 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Oct 04 18:51:58.163869 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 2e208f85-0513-43f4-8a2c-38baa2886238 is locked Oct 04 18:51:58.163869 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:51:58.163869 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:51:58.163869 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:51:58.163869 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:51:58.163869 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:51:58.163869 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:51:58.163869 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:51:58.163869 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:51:58.163869 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:51:58.163869 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:51:58.163869 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1451, in _stop_server Oct 04 18:51:58.163869 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Oct 04 18:51:58.163869 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 2e208f85-0513-43f4-8a2c-38baa2886238 is locked Oct 04 18:51:58.163869 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:51:58.163869 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:51:58.163869 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:51:58.163869 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:51:58.163869 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:51:58.163869 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:51:58.163869 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:51:58.163869 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:51:58.163869 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e208f85-0513-43f4-8a2c-38baa2886238 is locked Oct 04 18:51:58.163869 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:51:58.174598 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5f25ed81-2d6f-45af-b7c0-aa7d39eb3f7e tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Returning 409 to user: Instance 2e208f85-0513-43f4-8a2c-38baa2886238 is locked {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:51:58.174598 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5f25ed81-2d6f-45af-b7c0-aa7d39eb3f7e tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "POST /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238/action" status: 409 len: 107 microversion: 2.1 time: 0.058608 Oct 04 18:51:58.174598 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2554/5163] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:51:58 2022] POST /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238/action => generated 107 bytes in 64 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 04 18:51:58.183115 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-631ca3a0-b3b1-4ae1-819f-1d4756fa4025 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:51:58.183929 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-631ca3a0-b3b1-4ae1-819f-1d4756fa4025 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:58.194855 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-631ca3a0-b3b1-4ae1-819f-1d4756fa4025 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:58.195895 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-631ca3a0-b3b1-4ae1-819f-1d4756fa4025 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:58.196645 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-631ca3a0-b3b1-4ae1-819f-1d4756fa4025 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:58.199614 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-631ca3a0-b3b1-4ae1-819f-1d4756fa4025 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:58.200335 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-631ca3a0-b3b1-4ae1-819f-1d4756fa4025 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:58.203009 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-631ca3a0-b3b1-4ae1-819f-1d4756fa4025 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:58.253799 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-54f80299-4ede-436c-b8a7-e39c94da278e tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:58.264506 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-54f80299-4ede-436c-b8a7-e39c94da278e tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60" status: 200 len: 1506 microversion: 2.1 time: 0.225443 Oct 04 18:51:58.265391 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2610/5164] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:58 2022] GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60 => generated 1506 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:51:58.470924 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1b79c317-a628-4c77-b613-c48226722a7d tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:58.471733 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1b79c317-a628-4c77-b613-c48226722a7d tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] [instance: f1b17780-52f5-468b-afe8-44ace600334c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:58.478867 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1b79c317-a628-4c77-b613-c48226722a7d tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:58.479421 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1b79c317-a628-4c77-b613-c48226722a7d tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:58.480123 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1b79c317-a628-4c77-b613-c48226722a7d tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:58.480892 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1b79c317-a628-4c77-b613-c48226722a7d tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:58.481424 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1b79c317-a628-4c77-b613-c48226722a7d tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:58.481914 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1b79c317-a628-4c77-b613-c48226722a7d tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:58.498821 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-631ca3a0-b3b1-4ae1-819f-1d4756fa4025 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Unlocking {{(pid=123002) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 04 18:51:58.726798 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1b79c317-a628-4c77-b613-c48226722a7d tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed1e61032824e30be2244ae45341d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7284369fd548539c5152796566eca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:58.742660 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:51:58.761418 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1b79c317-a628-4c77-b613-c48226722a7d tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ed1e61032824e30be2244ae45341d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7284369fd548539c5152796566eca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:58.763154 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1b79c317-a628-4c77-b613-c48226722a7d tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ed1e61032824e30be2244ae45341d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7284369fd548539c5152796566eca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:58.767561 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1b79c317-a628-4c77-b613-c48226722a7d tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] 10.222.0.20 "GET /compute/v2.1/servers/f1b17780-52f5-468b-afe8-44ace600334c" status: 200 len: 1359 microversion: 2.21 time: 0.300778 Oct 04 18:51:58.768345 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2611/5165] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:51:58 2022] GET /compute/v2.1/servers/f1b17780-52f5-468b-afe8-44ace600334c => generated 1359 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:51:58.795494 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-631ca3a0-b3b1-4ae1-819f-1d4756fa4025 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "POST /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238/action" status: 202 len: 0 microversion: 2.1 time: 0.617627 Oct 04 18:51:58.800072 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2555/5166] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:51:58 2022] POST /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238/action => generated 0 bytes in 621 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:51:58.807561 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b280e047-7c26-44f6-b54d-91213e253532 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:51:58.816701 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b280e047-7c26-44f6-b54d-91213e253532 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:58.818019 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b280e047-7c26-44f6-b54d-91213e253532 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:58.818964 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b280e047-7c26-44f6-b54d-91213e253532 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:58.856099 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b280e047-7c26-44f6-b54d-91213e253532 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Going to try to stop instance {{(pid=123001) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 18:51:59.121783 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b280e047-7c26-44f6-b54d-91213e253532 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "POST /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238/action" status: 202 len: 0 microversion: 2.1 time: 0.319672 Oct 04 18:51:59.133652 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b24f223b-e91e-4b42-a80c-a2cbdf5edbed tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:59.134976 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b24f223b-e91e-4b42-a80c-a2cbdf5edbed tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:59.135905 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2612/5167] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:51:58 2022] POST /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238/action => generated 0 bytes in 335 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:51:59.147460 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:51:59.160802 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b24f223b-e91e-4b42-a80c-a2cbdf5edbed tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:59.161489 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b24f223b-e91e-4b42-a80c-a2cbdf5edbed tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:59.162126 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b24f223b-e91e-4b42-a80c-a2cbdf5edbed tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:59.163213 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b24f223b-e91e-4b42-a80c-a2cbdf5edbed tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:59.163894 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b24f223b-e91e-4b42-a80c-a2cbdf5edbed tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:59.164999 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b24f223b-e91e-4b42-a80c-a2cbdf5edbed tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:59.285993 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=4 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:51:59.292524 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2d2db6de-ee75-4379-b9fc-ab55d7bb0065 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:59.296255 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2d2db6de-ee75-4379-b9fc-ab55d7bb0065 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9eaa25a-0821-47fb-a16e-d07bcde9cc60] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:59.317630 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2d2db6de-ee75-4379-b9fc-ab55d7bb0065 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:59.318667 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2d2db6de-ee75-4379-b9fc-ab55d7bb0065 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:59.319982 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2d2db6de-ee75-4379-b9fc-ab55d7bb0065 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:59.321225 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2d2db6de-ee75-4379-b9fc-ab55d7bb0065 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:59.323045 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2d2db6de-ee75-4379-b9fc-ab55d7bb0065 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:59.324254 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2d2db6de-ee75-4379-b9fc-ab55d7bb0065 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:59.671549 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b24f223b-e91e-4b42-a80c-a2cbdf5edbed tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:59.681899 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b24f223b-e91e-4b42-a80c-a2cbdf5edbed tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1682 microversion: 2.1 time: 0.553362 Oct 04 18:51:59.683242 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2556/5168] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:59 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1682 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:59.804691 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-80b05012-5076-43bc-a18d-15a1f282162f tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:59.805409 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-80b05012-5076-43bc-a18d-15a1f282162f tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] [instance: f1b17780-52f5-468b-afe8-44ace600334c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:59.814058 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-80b05012-5076-43bc-a18d-15a1f282162f tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:59.814837 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-80b05012-5076-43bc-a18d-15a1f282162f tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:59.816976 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-80b05012-5076-43bc-a18d-15a1f282162f tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:59.822215 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-2d2db6de-ee75-4379-b9fc-ab55d7bb0065 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:59.826522 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-80b05012-5076-43bc-a18d-15a1f282162f tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:59.827356 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-80b05012-5076-43bc-a18d-15a1f282162f tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:59.832446 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-80b05012-5076-43bc-a18d-15a1f282162f tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:59.833831 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2d2db6de-ee75-4379-b9fc-ab55d7bb0065 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60" status: 200 len: 1506 microversion: 2.1 time: 0.546741 Oct 04 18:51:59.838037 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2613/5169] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:59 2022] GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60 => generated 1506 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:52:00.271904 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-80b05012-5076-43bc-a18d-15a1f282162f tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed1e61032824e30be2244ae45341d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7284369fd548539c5152796566eca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:00.280762 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-80b05012-5076-43bc-a18d-15a1f282162f tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ed1e61032824e30be2244ae45341d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7284369fd548539c5152796566eca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:00.282496 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-80b05012-5076-43bc-a18d-15a1f282162f tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ed1e61032824e30be2244ae45341d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7284369fd548539c5152796566eca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:00.283637 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-80b05012-5076-43bc-a18d-15a1f282162f tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] 10.222.0.20 "GET /compute/v2.1/servers/f1b17780-52f5-468b-afe8-44ace600334c" status: 200 len: 1359 microversion: 2.21 time: 0.484555 Oct 04 18:52:00.284547 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2557/5170] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:51:59 2022] GET /compute/v2.1/servers/f1b17780-52f5-468b-afe8-44ace600334c => generated 1359 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:52:00.706762 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-29c49231-d0e0-4978-b106-b315475481b1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:00.707353 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-29c49231-d0e0-4978-b106-b315475481b1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:00.718833 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-29c49231-d0e0-4978-b106-b315475481b1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:00.720439 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-29c49231-d0e0-4978-b106-b315475481b1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:00.722089 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-29c49231-d0e0-4978-b106-b315475481b1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:00.722829 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-29c49231-d0e0-4978-b106-b315475481b1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:00.725440 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-29c49231-d0e0-4978-b106-b315475481b1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:00.730330 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-29c49231-d0e0-4978-b106-b315475481b1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:00.861137 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f288292c-b98c-4102-bce2-39152b0bccd0 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:00.861773 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f288292c-b98c-4102-bce2-39152b0bccd0 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9eaa25a-0821-47fb-a16e-d07bcde9cc60] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:00.872616 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f288292c-b98c-4102-bce2-39152b0bccd0 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:00.873135 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f288292c-b98c-4102-bce2-39152b0bccd0 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:00.873584 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f288292c-b98c-4102-bce2-39152b0bccd0 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:00.874311 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f288292c-b98c-4102-bce2-39152b0bccd0 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:00.874777 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f288292c-b98c-4102-bce2-39152b0bccd0 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:00.875536 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f288292c-b98c-4102-bce2-39152b0bccd0 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:00.923323 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-29c49231-d0e0-4978-b106-b315475481b1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:00.936580 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-29c49231-d0e0-4978-b106-b315475481b1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1682 microversion: 2.1 time: 0.233265 Oct 04 18:52:00.949600 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2614/5171] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:00 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1682 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:01.048214 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f288292c-b98c-4102-bce2-39152b0bccd0 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:01.058247 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f288292c-b98c-4102-bce2-39152b0bccd0 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60" status: 200 len: 1506 microversion: 2.1 time: 0.200639 Oct 04 18:52:01.074849 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2558/5172] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:00 2022] GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60 => generated 1506 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:52:01.310352 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6eca28c4-deec-4c59-ae8e-6d5765688896 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:01.310971 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6eca28c4-deec-4c59-ae8e-6d5765688896 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] [instance: f1b17780-52f5-468b-afe8-44ace600334c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:01.317104 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6eca28c4-deec-4c59-ae8e-6d5765688896 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:01.317697 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6eca28c4-deec-4c59-ae8e-6d5765688896 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:01.318578 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6eca28c4-deec-4c59-ae8e-6d5765688896 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:01.319274 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6eca28c4-deec-4c59-ae8e-6d5765688896 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:01.319732 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6eca28c4-deec-4c59-ae8e-6d5765688896 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:01.320196 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6eca28c4-deec-4c59-ae8e-6d5765688896 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:01.493299 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6eca28c4-deec-4c59-ae8e-6d5765688896 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed1e61032824e30be2244ae45341d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7284369fd548539c5152796566eca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:01.505308 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6eca28c4-deec-4c59-ae8e-6d5765688896 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ed1e61032824e30be2244ae45341d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7284369fd548539c5152796566eca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:01.507840 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6eca28c4-deec-4c59-ae8e-6d5765688896 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ed1e61032824e30be2244ae45341d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7284369fd548539c5152796566eca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:01.509302 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6eca28c4-deec-4c59-ae8e-6d5765688896 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] 10.222.0.20 "GET /compute/v2.1/servers/f1b17780-52f5-468b-afe8-44ace600334c" status: 200 len: 1359 microversion: 2.21 time: 0.204352 Oct 04 18:52:01.510291 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2615/5173] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:52:01 2022] GET /compute/v2.1/servers/f1b17780-52f5-468b-afe8-44ace600334c => generated 1359 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:52:01.964222 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-99e65d34-a49f-4846-803d-8b70bc91d4bf tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:01.964940 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-99e65d34-a49f-4846-803d-8b70bc91d4bf tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:01.972637 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-99e65d34-a49f-4846-803d-8b70bc91d4bf tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:01.978135 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-99e65d34-a49f-4846-803d-8b70bc91d4bf tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:01.978135 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-99e65d34-a49f-4846-803d-8b70bc91d4bf tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:01.978135 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-99e65d34-a49f-4846-803d-8b70bc91d4bf tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:01.978135 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-99e65d34-a49f-4846-803d-8b70bc91d4bf tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:01.978135 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-99e65d34-a49f-4846-803d-8b70bc91d4bf tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:02.086145 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ddc52bda-b567-4d89-b7aa-3263d37b6f07 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:02.090292 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ddc52bda-b567-4d89-b7aa-3263d37b6f07 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9eaa25a-0821-47fb-a16e-d07bcde9cc60] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:02.109432 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ddc52bda-b567-4d89-b7aa-3263d37b6f07 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:02.110513 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ddc52bda-b567-4d89-b7aa-3263d37b6f07 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:02.112690 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ddc52bda-b567-4d89-b7aa-3263d37b6f07 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:02.113078 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ddc52bda-b567-4d89-b7aa-3263d37b6f07 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:02.113559 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ddc52bda-b567-4d89-b7aa-3263d37b6f07 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:02.114000 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ddc52bda-b567-4d89-b7aa-3263d37b6f07 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:02.177285 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-99e65d34-a49f-4846-803d-8b70bc91d4bf tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:02.188194 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-99e65d34-a49f-4846-803d-8b70bc91d4bf tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1682 microversion: 2.1 time: 0.227900 Oct 04 18:52:02.189970 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2559/5174] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:01 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1682 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:02.339135 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ddc52bda-b567-4d89-b7aa-3263d37b6f07 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:02.347615 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ddc52bda-b567-4d89-b7aa-3263d37b6f07 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60" status: 200 len: 1527 microversion: 2.1 time: 0.268697 Oct 04 18:52:02.349146 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2616/5175] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:02 2022] GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60 => generated 1527 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:02.360164 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-c1a9f74a-594a-4459-a76a-17fe842c983c req-69ddb5ad-e3f9-46f4-b0d2-55262ffa8573 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1b17780-52f5-468b-afe8-44ace600334c", "name": "network-vif-plugged", "status": "completed", "tag": "8adf6669-0f1d-4bc5-93ff-aaa346197fa5"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:52:02.371836 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-c1a9f74a-594a-4459-a76a-17fe842c983c req-69ddb5ad-e3f9-46f4-b0d2-55262ffa8573 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:02.372460 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-c1a9f74a-594a-4459-a76a-17fe842c983c req-69ddb5ad-e3f9-46f4-b0d2-55262ffa8573 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:02.372973 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-c1a9f74a-594a-4459-a76a-17fe842c983c req-69ddb5ad-e3f9-46f4-b0d2-55262ffa8573 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:02.386280 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-c1a9f74a-594a-4459-a76a-17fe842c983c req-69ddb5ad-e3f9-46f4-b0d2-55262ffa8573 service nova] Creating event network-vif-plugged:8adf6669-0f1d-4bc5-93ff-aaa346197fa5 for instance f1b17780-52f5-468b-afe8-44ace600334c on n-h1-850501-14 Oct 04 18:52:02.392173 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-c1a9f74a-594a-4459-a76a-17fe842c983c req-69ddb5ad-e3f9-46f4-b0d2-55262ffa8573 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035788 Oct 04 18:52:02.393773 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2560/5176] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:52:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:52:02.544329 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6a00be0e-c42f-4a3d-8d56-23ecd8cee809 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:02.545536 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6a00be0e-c42f-4a3d-8d56-23ecd8cee809 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] [instance: f1b17780-52f5-468b-afe8-44ace600334c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:02.558237 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6a00be0e-c42f-4a3d-8d56-23ecd8cee809 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:02.559192 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6a00be0e-c42f-4a3d-8d56-23ecd8cee809 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:02.559631 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6a00be0e-c42f-4a3d-8d56-23ecd8cee809 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:02.560796 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6a00be0e-c42f-4a3d-8d56-23ecd8cee809 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:02.561408 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6a00be0e-c42f-4a3d-8d56-23ecd8cee809 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:02.561938 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6a00be0e-c42f-4a3d-8d56-23ecd8cee809 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:02.769541 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6a00be0e-c42f-4a3d-8d56-23ecd8cee809 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed1e61032824e30be2244ae45341d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7284369fd548539c5152796566eca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:02.782681 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6a00be0e-c42f-4a3d-8d56-23ecd8cee809 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ed1e61032824e30be2244ae45341d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7284369fd548539c5152796566eca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:02.784370 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6a00be0e-c42f-4a3d-8d56-23ecd8cee809 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ed1e61032824e30be2244ae45341d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7284369fd548539c5152796566eca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:02.785582 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6a00be0e-c42f-4a3d-8d56-23ecd8cee809 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] 10.222.0.20 "GET /compute/v2.1/servers/f1b17780-52f5-468b-afe8-44ace600334c" status: 200 len: 1359 microversion: 2.21 time: 0.250579 Oct 04 18:52:02.786632 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2617/5177] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:52:02 2022] GET /compute/v2.1/servers/f1b17780-52f5-468b-afe8-44ace600334c => generated 1359 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:52:03.215459 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-45e7bd1e-ea60-4c44-a956-9a00d269325b tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:03.216355 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-45e7bd1e-ea60-4c44-a956-9a00d269325b tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:03.224196 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-45e7bd1e-ea60-4c44-a956-9a00d269325b tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:03.224928 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-45e7bd1e-ea60-4c44-a956-9a00d269325b tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:03.225381 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-45e7bd1e-ea60-4c44-a956-9a00d269325b tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:03.226099 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-45e7bd1e-ea60-4c44-a956-9a00d269325b tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:03.226561 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-45e7bd1e-ea60-4c44-a956-9a00d269325b tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:03.226997 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-45e7bd1e-ea60-4c44-a956-9a00d269325b tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:03.371482 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0643cd89-bdb3-440f-bcf8-9a06c883a005 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:03.372233 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0643cd89-bdb3-440f-bcf8-9a06c883a005 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9eaa25a-0821-47fb-a16e-d07bcde9cc60] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:03.379397 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0643cd89-bdb3-440f-bcf8-9a06c883a005 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:03.380162 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0643cd89-bdb3-440f-bcf8-9a06c883a005 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:03.380601 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0643cd89-bdb3-440f-bcf8-9a06c883a005 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:03.381301 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0643cd89-bdb3-440f-bcf8-9a06c883a005 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:03.381754 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0643cd89-bdb3-440f-bcf8-9a06c883a005 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:03.382178 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0643cd89-bdb3-440f-bcf8-9a06c883a005 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:03.500622 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-45e7bd1e-ea60-4c44-a956-9a00d269325b tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:03.508830 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-45e7bd1e-ea60-4c44-a956-9a00d269325b tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1682 microversion: 2.1 time: 0.299169 Oct 04 18:52:03.509428 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2561/5178] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:03 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1682 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:52:03.668044 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0643cd89-bdb3-440f-bcf8-9a06c883a005 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:03.680585 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0643cd89-bdb3-440f-bcf8-9a06c883a005 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60" status: 200 len: 1527 microversion: 2.1 time: 0.313354 Oct 04 18:52:03.681344 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2618/5179] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:03 2022] GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60 => generated 1527 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:52:03.814532 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e696b130-8a2b-4c3b-8db9-45b709552d92 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:03.815240 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e696b130-8a2b-4c3b-8db9-45b709552d92 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] [instance: f1b17780-52f5-468b-afe8-44ace600334c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:03.826009 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e696b130-8a2b-4c3b-8db9-45b709552d92 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:03.827250 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e696b130-8a2b-4c3b-8db9-45b709552d92 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:03.828027 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e696b130-8a2b-4c3b-8db9-45b709552d92 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:03.829180 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e696b130-8a2b-4c3b-8db9-45b709552d92 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:03.829972 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e696b130-8a2b-4c3b-8db9-45b709552d92 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:03.830599 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e696b130-8a2b-4c3b-8db9-45b709552d92 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:04.026402 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e696b130-8a2b-4c3b-8db9-45b709552d92 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed1e61032824e30be2244ae45341d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7284369fd548539c5152796566eca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:04.036796 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e696b130-8a2b-4c3b-8db9-45b709552d92 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ed1e61032824e30be2244ae45341d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7284369fd548539c5152796566eca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:04.041738 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e696b130-8a2b-4c3b-8db9-45b709552d92 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ed1e61032824e30be2244ae45341d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7284369fd548539c5152796566eca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:04.041738 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e696b130-8a2b-4c3b-8db9-45b709552d92 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] 10.222.0.20 "GET /compute/v2.1/servers/f1b17780-52f5-468b-afe8-44ace600334c" status: 200 len: 1359 microversion: 2.21 time: 0.229465 Oct 04 18:52:04.041738 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2562/5180] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:52:03 2022] GET /compute/v2.1/servers/f1b17780-52f5-468b-afe8-44ace600334c => generated 1359 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:52:04.535059 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0c0ae171-1fc9-43d1-a6e4-e84d1af1e3b7 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:04.536461 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0c0ae171-1fc9-43d1-a6e4-e84d1af1e3b7 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:04.555769 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0c0ae171-1fc9-43d1-a6e4-e84d1af1e3b7 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:04.555924 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0c0ae171-1fc9-43d1-a6e4-e84d1af1e3b7 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:04.557247 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0c0ae171-1fc9-43d1-a6e4-e84d1af1e3b7 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:04.558363 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0c0ae171-1fc9-43d1-a6e4-e84d1af1e3b7 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:04.559148 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0c0ae171-1fc9-43d1-a6e4-e84d1af1e3b7 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:04.559689 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0c0ae171-1fc9-43d1-a6e4-e84d1af1e3b7 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:04.604852 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1d70820c-45ab-48d8-a8c4-f9577d6be7ab tempest-VolumesNegativeTest-1086787532 tempest-VolumesNegativeTest-1086787532-project] Action: 'create', calling method: .version_select at 0x7fe253bc95e0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-315327390", "metadata": {"Type": "work"}}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:52:04.608939 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1d70820c-45ab-48d8-a8c4-f9577d6be7ab tempest-VolumesNegativeTest-1086787532 tempest-VolumesNegativeTest-1086787532-project] Request method failure captured: Oct 04 18:52:04.608939 n-d-850501-14 devstack@n-api.service[123001]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 04 18:52:04.608939 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:52:04.608939 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:52:04.608939 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:52:04.608939 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 121 Oct 04 18:52:04.608939 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:52:04.608939 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:52:04.608939 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:52:04.608939 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:52:04.608939 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPIDUzk6lFmDTLJnK1WgXw2zCTwiok44hKDD2y7xsedrlmO6H-h3byFO3-ls5qkKxtLpA-10pXg7SNmtLP1YGE-PMZCD8idZxOSnzWRQV00YZdd-5cBHNWwaMR_F2z4W25-B4b_oaRnwWZF8CkgUw6I01tzyHjeuYTZViuxkL82ejvew Oct 04 18:52:04.608939 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:52:04.608939 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:52:04.608939 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:52:04.608939 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:52:04.608939 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:52:04.608939 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:52:04.608939 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: ceb834d5d2394bd588c55b20c1c28759 Oct 04 18:52:04.608939 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-VolumesNegativeTest-1086787532 Oct 04 18:52:04.608939 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:52:04.608939 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:52:04.608939 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ceb834d5d2394bd588c55b20c1c28759"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ceb834d5d2394bd588c55b20c1c28759", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ceb834d5d2394bd588c55b20c1c28759"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ceb834d5d2394bd588c55b20c1c28759"}]}] Oct 04 18:52:04.608939 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-VolumesNegativeTest-1086787532 Oct 04 18:52:04.608939 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: ceb834d5d2394bd588c55b20c1c28759 Oct 04 18:52:04.608939 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-VolumesNegativeTest-1086787532 Oct 04 18:52:04.608939 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-VolumesNegativeTest-1086787532-project Oct 04 18:52:04.608939 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:52:04.608939 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:52:04.608939 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 9124cd89187c49709e1b039570c75937 Oct 04 18:52:04.608939 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-VolumesNegativeTest-1086787532-project Oct 04 18:52:04.608939 n-d-850501-14 devstack@n-api.service[123001]: Oct 04 18:52:04.608939 n-d-850501-14 devstack@n-api.service[123001]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-315327390", "metadata": {"Type": "work"}}} Oct 04 18:52:04.608939 n-d-850501-14 devstack@n-api.service[123001]: method: Oct 04 18:52:04.608939 n-d-850501-14 devstack@n-api.service[123001]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 04 18:52:04.608939 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-315327390', 'metadata': {'Type': 'work'}}}} Oct 04 18:52:04.608939 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:52:04.608939 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:04.608939 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:52:04.608939 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:52:04.608939 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:52:04.608939 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:52:04.608939 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 04 18:52:04.608939 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:52:04.608939 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 04 18:52:04.608939 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 04 18:52:04.608939 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:52:04.608939 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 04 18:52:04.608939 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi '#$%' Oct 04 18:52:04.608939 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:52:04.608939 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:52:04.608939 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:52:04.608939 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:04.608939 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:52:04.608939 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:52:04.608939 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:52:04.608939 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:52:04.608939 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:52:04.608939 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:52:04.608939 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:52:04.608939 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:52:04.608939 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:52:04.608939 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:52:04.608939 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:52:04.608939 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:52:04.608939 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:52:04.608939 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:52:04.621610 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 04 18:52:04.621610 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:52:04.621610 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:52:04.621610 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:52:04.621610 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:04.621610 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:52:04.621610 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:52:04.621610 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:52:04.621610 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:52:04.621610 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 04 18:52:04.621610 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:52:04.621610 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1d70820c-45ab-48d8-a8c4-f9577d6be7ab tempest-VolumesNegativeTest-1086787532 tempest-VolumesNegativeTest-1086787532-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:52:04.621610 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1d70820c-45ab-48d8-a8c4-f9577d6be7ab tempest-VolumesNegativeTest-1086787532 tempest-VolumesNegativeTest-1086787532-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.137456 Oct 04 18:52:04.621610 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2619/5181] 10.222.0.20 () {60 vars in 1156 bytes} [Tue Oct 4 18:52:04 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 142 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:52:04.621610 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ec36c655-93ad-4c24-a7cf-1d09e8f6a5b0 tempest-VolumesNegativeTest-1086787532 tempest-VolumesNegativeTest-1086787532-project] Action: 'create', calling method: .version_select at 0x7fe253b8d0d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-288281504", "metadata": {"Type": "work"}}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:52:04.625132 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ec36c655-93ad-4c24-a7cf-1d09e8f6a5b0 tempest-VolumesNegativeTest-1086787532 tempest-VolumesNegativeTest-1086787532-project] Request method failure captured: Oct 04 18:52:04.625132 n-d-850501-14 devstack@n-api.service[123001]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 04 18:52:04.625132 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:52:04.625132 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:52:04.625132 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:52:04.625132 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 119 Oct 04 18:52:04.625132 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:52:04.625132 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:52:04.625132 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:52:04.625132 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:52:04.625132 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPIDUzk6lFmDTLJnK1WgXw2zCTwiok44hKDD2y7xsedrlmO6H-h3byFO3-ls5qkKxtLpA-10pXg7SNmtLP1YGE-PMZCD8idZxOSnzWRQV00YZdd-5cBHNWwaMR_F2z4W25-B4b_oaRnwWZF8CkgUw6I01tzyHjeuYTZViuxkL82ejvew Oct 04 18:52:04.625132 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:52:04.625132 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:52:04.625132 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:52:04.625132 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:52:04.625132 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:52:04.625132 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:52:04.625132 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: ceb834d5d2394bd588c55b20c1c28759 Oct 04 18:52:04.625132 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-VolumesNegativeTest-1086787532 Oct 04 18:52:04.625132 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:52:04.625132 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:52:04.625132 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ceb834d5d2394bd588c55b20c1c28759"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ceb834d5d2394bd588c55b20c1c28759", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ceb834d5d2394bd588c55b20c1c28759"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ceb834d5d2394bd588c55b20c1c28759"}]}] Oct 04 18:52:04.625132 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-VolumesNegativeTest-1086787532 Oct 04 18:52:04.625132 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: ceb834d5d2394bd588c55b20c1c28759 Oct 04 18:52:04.625132 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-VolumesNegativeTest-1086787532 Oct 04 18:52:04.625132 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-VolumesNegativeTest-1086787532-project Oct 04 18:52:04.625132 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:52:04.625132 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:52:04.625132 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 9124cd89187c49709e1b039570c75937 Oct 04 18:52:04.625132 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-VolumesNegativeTest-1086787532-project Oct 04 18:52:04.625132 n-d-850501-14 devstack@n-api.service[123001]: Oct 04 18:52:04.625132 n-d-850501-14 devstack@n-api.service[123001]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-288281504", "metadata": {"Type": "work"}}} Oct 04 18:52:04.625132 n-d-850501-14 devstack@n-api.service[123001]: method: Oct 04 18:52:04.625132 n-d-850501-14 devstack@n-api.service[123001]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 04 18:52:04.625132 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-288281504', 'metadata': {'Type': 'work'}}}} Oct 04 18:52:04.625132 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:52:04.625132 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:04.625132 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:52:04.625132 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:52:04.625132 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:52:04.625132 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:52:04.625132 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 04 18:52:04.625132 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:52:04.625132 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 04 18:52:04.625132 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 04 18:52:04.625132 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:52:04.625132 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 04 18:52:04.625132 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi '0' Oct 04 18:52:04.625132 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:52:04.625132 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:52:04.625132 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:52:04.625132 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:04.625132 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:52:04.625132 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:52:04.625132 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:52:04.625132 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:52:04.625132 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:52:04.625132 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:52:04.625132 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:52:04.625132 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:52:04.625132 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:52:04.625132 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:52:04.625132 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:52:04.625132 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:52:04.625132 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:52:04.625132 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:52:04.630654 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 04 18:52:04.630654 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:52:04.630654 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:52:04.630654 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:52:04.630654 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:04.630654 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:52:04.630654 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:52:04.630654 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:52:04.630654 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:52:04.630654 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 04 18:52:04.630654 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:52:04.630654 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ec36c655-93ad-4c24-a7cf-1d09e8f6a5b0 tempest-VolumesNegativeTest-1086787532 tempest-VolumesNegativeTest-1086787532-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:52:04.630654 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ec36c655-93ad-4c24-a7cf-1d09e8f6a5b0 tempest-VolumesNegativeTest-1086787532 tempest-VolumesNegativeTest-1086787532-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010554 Oct 04 18:52:04.631606 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2620/5182] 10.222.0.20 () {60 vars in 1156 bytes} [Tue Oct 4 18:52:04 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 04 18:52:04.635781 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-db6c2127-1460-4085-882e-498008041095 tempest-VolumesNegativeTest-1086787532 tempest-VolumesNegativeTest-1086787532-project] Action: 'create', calling method: .version_select at 0x7fe253bc93a0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1147425203", "metadata": {"Type": "work"}}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:52:04.639460 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-db6c2127-1460-4085-882e-498008041095 tempest-VolumesNegativeTest-1086787532 tempest-VolumesNegativeTest-1086787532-project] Request method failure captured: Oct 04 18:52:04.639460 n-d-850501-14 devstack@n-api.service[123001]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 04 18:52:04.639460 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:52:04.639460 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:52:04.639460 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:52:04.639460 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 119 Oct 04 18:52:04.639460 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:52:04.639460 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:52:04.639460 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:52:04.639460 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:52:04.639460 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPIDUzk6lFmDTLJnK1WgXw2zCTwiok44hKDD2y7xsedrlmO6H-h3byFO3-ls5qkKxtLpA-10pXg7SNmtLP1YGE-PMZCD8idZxOSnzWRQV00YZdd-5cBHNWwaMR_F2z4W25-B4b_oaRnwWZF8CkgUw6I01tzyHjeuYTZViuxkL82ejvew Oct 04 18:52:04.639460 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:52:04.639460 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:52:04.639460 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:52:04.639460 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:52:04.639460 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:52:04.639460 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:52:04.639460 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: ceb834d5d2394bd588c55b20c1c28759 Oct 04 18:52:04.639460 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-VolumesNegativeTest-1086787532 Oct 04 18:52:04.639460 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:52:04.639460 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:52:04.639460 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ceb834d5d2394bd588c55b20c1c28759"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ceb834d5d2394bd588c55b20c1c28759", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ceb834d5d2394bd588c55b20c1c28759"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ceb834d5d2394bd588c55b20c1c28759"}]}] Oct 04 18:52:04.639460 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-VolumesNegativeTest-1086787532 Oct 04 18:52:04.639460 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: ceb834d5d2394bd588c55b20c1c28759 Oct 04 18:52:04.639460 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-VolumesNegativeTest-1086787532 Oct 04 18:52:04.639460 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-VolumesNegativeTest-1086787532-project Oct 04 18:52:04.639460 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:52:04.639460 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:52:04.639460 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 9124cd89187c49709e1b039570c75937 Oct 04 18:52:04.639460 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-VolumesNegativeTest-1086787532-project Oct 04 18:52:04.639460 n-d-850501-14 devstack@n-api.service[123001]: Oct 04 18:52:04.639460 n-d-850501-14 devstack@n-api.service[123001]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1147425203", "metadata": {"Type": "work"}}} Oct 04 18:52:04.639460 n-d-850501-14 devstack@n-api.service[123001]: method: Oct 04 18:52:04.639460 n-d-850501-14 devstack@n-api.service[123001]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 04 18:52:04.639460 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1147425203', 'metadata': {'Type': 'work'}}}} Oct 04 18:52:04.639460 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:52:04.639460 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:04.639460 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:52:04.639460 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:52:04.639460 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:52:04.639460 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:52:04.639460 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 04 18:52:04.639460 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:52:04.639460 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 04 18:52:04.639460 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 04 18:52:04.639460 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:52:04.639460 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 04 18:52:04.639460 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi '' Oct 04 18:52:04.639460 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:52:04.639460 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:52:04.639460 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:52:04.639460 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:04.639460 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:52:04.639460 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:52:04.639460 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:52:04.639460 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:52:04.639460 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:52:04.639460 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:52:04.639460 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:52:04.639460 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:52:04.639460 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:52:04.639460 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:52:04.639460 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:52:04.639460 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:52:04.639460 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:52:04.639460 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:52:04.653744 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 04 18:52:04.653744 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:52:04.653744 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:52:04.653744 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:52:04.653744 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:04.653744 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:52:04.653744 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:52:04.653744 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:52:04.653744 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:52:04.653744 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 04 18:52:04.653744 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:52:04.653744 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-db6c2127-1460-4085-882e-498008041095 tempest-VolumesNegativeTest-1086787532 tempest-VolumesNegativeTest-1086787532-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:52:04.653744 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-db6c2127-1460-4085-882e-498008041095 tempest-VolumesNegativeTest-1086787532 tempest-VolumesNegativeTest-1086787532-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008828 Oct 04 18:52:04.653744 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2621/5183] 10.222.0.20 () {60 vars in 1156 bytes} [Tue Oct 4 18:52:04 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:52:04.657574 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-97925e19-1948-43ec-bf45-0e1e22598e41 tempest-VolumesNegativeTest-1086787532 tempest-VolumesNegativeTest-1086787532-project] Calling method '.version_select at 0x7fe253b8de50>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:04.689355 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-97925e19-1948-43ec-bf45-0e1e22598e41 tempest-VolumesNegativeTest-1086787532 tempest-VolumesNegativeTest-1086787532-project] HTTP exception thrown: Volume tempest-invalid-1804226345 could not be found. Oct 04 18:52:04.691471 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-97925e19-1948-43ec-bf45-0e1e22598e41 tempest-VolumesNegativeTest-1086787532 tempest-VolumesNegativeTest-1086787532-project] Request method failure captured: Oct 04 18:52:04.691471 n-d-850501-14 devstack@n-api.service[123001]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1804226345 HTTP/1.1 Oct 04 18:52:04.691471 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:52:04.691471 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:52:04.691471 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:52:04.691471 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:52:04.691471 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:52:04.691471 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:52:04.691471 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:52:04.691471 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:52:04.691471 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPIDUzk6lFmDTLJnK1WgXw2zCTwiok44hKDD2y7xsedrlmO6H-h3byFO3-ls5qkKxtLpA-10pXg7SNmtLP1YGE-PMZCD8idZxOSnzWRQV00YZdd-5cBHNWwaMR_F2z4W25-B4b_oaRnwWZF8CkgUw6I01tzyHjeuYTZViuxkL82ejvew Oct 04 18:52:04.691471 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:52:04.691471 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:52:04.691471 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:52:04.691471 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:52:04.691471 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:52:04.691471 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:52:04.691471 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: ceb834d5d2394bd588c55b20c1c28759 Oct 04 18:52:04.691471 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-VolumesNegativeTest-1086787532 Oct 04 18:52:04.691471 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:52:04.691471 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:52:04.691471 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ceb834d5d2394bd588c55b20c1c28759"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ceb834d5d2394bd588c55b20c1c28759", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ceb834d5d2394bd588c55b20c1c28759"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ceb834d5d2394bd588c55b20c1c28759"}]}] Oct 04 18:52:04.691471 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-VolumesNegativeTest-1086787532 Oct 04 18:52:04.691471 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: ceb834d5d2394bd588c55b20c1c28759 Oct 04 18:52:04.691471 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-VolumesNegativeTest-1086787532 Oct 04 18:52:04.691471 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-VolumesNegativeTest-1086787532-project Oct 04 18:52:04.691471 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:52:04.691471 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:52:04.691471 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 9124cd89187c49709e1b039570c75937 Oct 04 18:52:04.691471 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-VolumesNegativeTest-1086787532-project Oct 04 18:52:04.691471 n-d-850501-14 devstack@n-api.service[123001]: method: Oct 04 18:52:04.691471 n-d-850501-14 devstack@n-api.service[123001]: exception: Volume tempest-invalid-1804226345 could not be found. Oct 04 18:52:04.691471 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': 'tempest-invalid-1804226345'} Oct 04 18:52:04.691471 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:52:04.691471 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:04.691471 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 18:52:04.691471 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 18:52:04.691471 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 18:52:04.691471 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 18:52:04.691471 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 18:52:04.691471 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 18:52:04.691471 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 18:52:04.691471 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 18:52:04.691471 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 18:52:04.691471 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 18:52:04.691471 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:52:04.691471 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:52:04.691471 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:52:04.691471 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:52:04.691471 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1804226345 could not be found. (HTTP 404) (Request-ID: req-ebdfcd41-4f0c-4ddc-b946-a141f63d13e8) Oct 04 18:52:04.691471 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:52:04.691471 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:52:04.691471 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:52:04.691471 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:04.691471 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 04 18:52:04.691471 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 04 18:52:04.691471 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 18:52:04.691471 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 18:52:04.691471 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 18:52:04.691471 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 18:52:04.691471 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 18:52:04.691471 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 18:52:04.691471 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 18:52:04.696791 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 18:52:04.696791 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 18:52:04.696791 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 18:52:04.696791 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 18:52:04.696791 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 18:52:04.696791 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 18:52:04.696791 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 18:52:04.696791 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 18:52:04.696791 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 18:52:04.696791 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:52:04.696791 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:52:04.696791 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:52:04.696791 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:52:04.696791 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1804226345 could not be found. Oct 04 18:52:04.696791 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:52:04.696791 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:52:04.696791 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:52:04.696791 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:04.696791 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:52:04.696791 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:52:04.696791 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:52:04.696791 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:52:04.696791 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:52:04.696791 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:52:04.696791 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:52:04.696791 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:52:04.696791 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 04 18:52:04.696791 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:52:04.696791 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1804226345 could not be found. Oct 04 18:52:04.696791 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:52:04.696791 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:52:04.696791 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:52:04.696791 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:04.696791 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:52:04.696791 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:52:04.696791 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:52:04.696791 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:52:04.696791 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1804226345 could not be found. Oct 04 18:52:04.696791 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:52:04.696791 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-97925e19-1948-43ec-bf45-0e1e22598e41 tempest-VolumesNegativeTest-1086787532 tempest-VolumesNegativeTest-1086787532-project] Returning 404 to user: Volume tempest-invalid-1804226345 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:52:04.696791 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-97925e19-1948-43ec-bf45-0e1e22598e41 tempest-VolumesNegativeTest-1086787532 tempest-VolumesNegativeTest-1086787532-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1804226345" status: 404 len: 99 microversion: 2.1 time: 0.039425 Oct 04 18:52:04.696791 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2622/5184] 10.222.0.20 () {58 vars in 1218 bytes} [Tue Oct 4 18:52:04 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1804226345 => generated 99 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 04 18:52:04.707985 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-54e83e4a-4be1-4f09-b702-2065a9082a7f tempest-VolumesNegativeTest-1086787532 tempest-VolumesNegativeTest-1086787532-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004946 Oct 04 18:52:04.709044 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2623/5185] 10.222.0.20 () {58 vars in 1140 bytes} [Tue Oct 4 18:52:04 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 04 18:52:04.721815 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-14f9f5c4-05cf-4436-93c1-a56338636934 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:04.723021 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-14f9f5c4-05cf-4436-93c1-a56338636934 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9eaa25a-0821-47fb-a16e-d07bcde9cc60] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:04.729686 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0c0ae171-1fc9-43d1-a6e4-e84d1af1e3b7 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:04.731408 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-14f9f5c4-05cf-4436-93c1-a56338636934 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:04.731911 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-14f9f5c4-05cf-4436-93c1-a56338636934 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:04.732392 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-14f9f5c4-05cf-4436-93c1-a56338636934 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:04.733102 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-14f9f5c4-05cf-4436-93c1-a56338636934 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:04.733775 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-14f9f5c4-05cf-4436-93c1-a56338636934 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:04.734381 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-14f9f5c4-05cf-4436-93c1-a56338636934 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:04.739259 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0c0ae171-1fc9-43d1-a6e4-e84d1af1e3b7 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1682 microversion: 2.1 time: 0.209945 Oct 04 18:52:04.739850 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2563/5186] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:04 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1682 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:04.746445 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-cc5337c3-a396-4d51-a3ed-6a4f86c56810 tempest-VolumesNegativeTest-1086787532 tempest-VolumesNegativeTest-1086787532-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005216 Oct 04 18:52:04.751489 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2564/5187] 10.222.0.20 () {58 vars in 1137 bytes} [Tue Oct 4 18:52:04 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 04 18:52:04.756479 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a65d56d4-b5ea-4d47-8315-f924b2f42fee tempest-VolumesNegativeTest-1086787532 tempest-VolumesNegativeTest-1086787532-project] Calling method '.version_select at 0x7fe253fa2dc0>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:04.790271 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-a65d56d4-b5ea-4d47-8315-f924b2f42fee tempest-VolumesNegativeTest-1086787532 tempest-VolumesNegativeTest-1086787532-project] HTTP exception thrown: Volume 8226607e-bb47-4dda-ab25-ac98eaa53445 could not be found. Oct 04 18:52:04.792786 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a65d56d4-b5ea-4d47-8315-f924b2f42fee tempest-VolumesNegativeTest-1086787532 tempest-VolumesNegativeTest-1086787532-project] Request method failure captured: Oct 04 18:52:04.792786 n-d-850501-14 devstack@n-api.service[123002]: request: DELETE /compute/v2.1/os-volumes/8226607e-bb47-4dda-ab25-ac98eaa53445 HTTP/1.1 Oct 04 18:52:04.792786 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:52:04.792786 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:52:04.792786 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:52:04.792786 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:52:04.792786 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:52:04.792786 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:52:04.792786 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:52:04.792786 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:52:04.792786 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPIDUzk6lFmDTLJnK1WgXw2zCTwiok44hKDD2y7xsedrlmO6H-h3byFO3-ls5qkKxtLpA-10pXg7SNmtLP1YGE-PMZCD8idZxOSnzWRQV00YZdd-5cBHNWwaMR_F2z4W25-B4b_oaRnwWZF8CkgUw6I01tzyHjeuYTZViuxkL82ejvew Oct 04 18:52:04.792786 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:52:04.792786 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:52:04.792786 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:52:04.792786 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:52:04.792786 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:52:04.792786 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:52:04.792786 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: ceb834d5d2394bd588c55b20c1c28759 Oct 04 18:52:04.792786 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-VolumesNegativeTest-1086787532 Oct 04 18:52:04.792786 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:52:04.792786 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:52:04.792786 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ceb834d5d2394bd588c55b20c1c28759"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ceb834d5d2394bd588c55b20c1c28759", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ceb834d5d2394bd588c55b20c1c28759"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ceb834d5d2394bd588c55b20c1c28759"}]}] Oct 04 18:52:04.792786 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-VolumesNegativeTest-1086787532 Oct 04 18:52:04.792786 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: ceb834d5d2394bd588c55b20c1c28759 Oct 04 18:52:04.792786 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-VolumesNegativeTest-1086787532 Oct 04 18:52:04.792786 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-VolumesNegativeTest-1086787532-project Oct 04 18:52:04.792786 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:52:04.792786 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:52:04.792786 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 9124cd89187c49709e1b039570c75937 Oct 04 18:52:04.792786 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-VolumesNegativeTest-1086787532-project Oct 04 18:52:04.792786 n-d-850501-14 devstack@n-api.service[123002]: method: Oct 04 18:52:04.792786 n-d-850501-14 devstack@n-api.service[123002]: exception: Volume 8226607e-bb47-4dda-ab25-ac98eaa53445 could not be found. Oct 04 18:52:04.792786 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '8226607e-bb47-4dda-ab25-ac98eaa53445'} Oct 04 18:52:04.792786 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:52:04.792786 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:04.792786 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 18:52:04.792786 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 18:52:04.792786 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 18:52:04.792786 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 18:52:04.792786 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 18:52:04.792786 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 18:52:04.792786 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 18:52:04.792786 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 18:52:04.792786 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 18:52:04.792786 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 18:52:04.792786 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:52:04.792786 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:52:04.792786 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:52:04.792786 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:52:04.792786 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8226607e-bb47-4dda-ab25-ac98eaa53445 could not be found. (HTTP 404) (Request-ID: req-2f43fd79-1d97-4697-91eb-2f6082ef4cfd) Oct 04 18:52:04.792786 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:52:04.792786 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:52:04.792786 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:52:04.792786 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:04.792786 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 04 18:52:04.792786 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 04 18:52:04.792786 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 18:52:04.792786 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 18:52:04.792786 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 18:52:04.792786 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 18:52:04.792786 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 18:52:04.792786 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 18:52:04.792786 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 18:52:04.807107 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 18:52:04.807107 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 18:52:04.807107 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 18:52:04.807107 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 18:52:04.807107 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 18:52:04.807107 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 18:52:04.807107 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 18:52:04.807107 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 18:52:04.807107 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 18:52:04.807107 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:52:04.807107 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:52:04.807107 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:52:04.807107 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:52:04.807107 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8226607e-bb47-4dda-ab25-ac98eaa53445 could not be found. Oct 04 18:52:04.807107 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:52:04.807107 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:52:04.807107 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:52:04.807107 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:04.807107 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:52:04.807107 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:52:04.807107 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:52:04.807107 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:52:04.807107 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:52:04.807107 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:52:04.807107 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:52:04.807107 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:52:04.807107 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 04 18:52:04.807107 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:52:04.807107 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8226607e-bb47-4dda-ab25-ac98eaa53445 could not be found. Oct 04 18:52:04.807107 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:52:04.807107 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:52:04.807107 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:52:04.807107 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:04.807107 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:52:04.807107 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:52:04.807107 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:52:04.807107 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:52:04.807107 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8226607e-bb47-4dda-ab25-ac98eaa53445 could not be found. Oct 04 18:52:04.807107 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:52:04.807107 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a65d56d4-b5ea-4d47-8315-f924b2f42fee tempest-VolumesNegativeTest-1086787532 tempest-VolumesNegativeTest-1086787532-project] Returning 404 to user: Volume 8226607e-bb47-4dda-ab25-ac98eaa53445 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:52:04.807107 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a65d56d4-b5ea-4d47-8315-f924b2f42fee tempest-VolumesNegativeTest-1086787532 tempest-VolumesNegativeTest-1086787532-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/8226607e-bb47-4dda-ab25-ac98eaa53445" status: 404 len: 109 microversion: 2.1 time: 0.043091 Oct 04 18:52:04.807107 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2565/5188] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Oct 4 18:52:04 2022] DELETE /compute/v2.1/os-volumes/8226607e-bb47-4dda-ab25-ac98eaa53445 => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:52:04.810649 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c04213b0-fb08-4f39-87f3-e7f42a396353 tempest-VolumesNegativeTest-1086787532 tempest-VolumesNegativeTest-1086787532-project] Calling method '.version_select at 0x7fe2595450d0>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:04.851353 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-c04213b0-fb08-4f39-87f3-e7f42a396353 tempest-VolumesNegativeTest-1086787532 tempest-VolumesNegativeTest-1086787532-project] HTTP exception thrown: Volume be4e15b9-8c91-4eb3-b7d6-22ae0fb427a6 could not be found. Oct 04 18:52:04.854234 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c04213b0-fb08-4f39-87f3-e7f42a396353 tempest-VolumesNegativeTest-1086787532 tempest-VolumesNegativeTest-1086787532-project] Request method failure captured: Oct 04 18:52:04.854234 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/os-volumes/be4e15b9-8c91-4eb3-b7d6-22ae0fb427a6 HTTP/1.1 Oct 04 18:52:04.854234 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:52:04.854234 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:52:04.854234 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:52:04.854234 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:52:04.854234 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:52:04.854234 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:52:04.854234 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:52:04.854234 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:52:04.854234 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPIDUzk6lFmDTLJnK1WgXw2zCTwiok44hKDD2y7xsedrlmO6H-h3byFO3-ls5qkKxtLpA-10pXg7SNmtLP1YGE-PMZCD8idZxOSnzWRQV00YZdd-5cBHNWwaMR_F2z4W25-B4b_oaRnwWZF8CkgUw6I01tzyHjeuYTZViuxkL82ejvew Oct 04 18:52:04.854234 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:52:04.854234 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:52:04.854234 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:52:04.854234 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:52:04.854234 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:52:04.854234 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:52:04.854234 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: ceb834d5d2394bd588c55b20c1c28759 Oct 04 18:52:04.854234 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-VolumesNegativeTest-1086787532 Oct 04 18:52:04.854234 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:52:04.854234 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:52:04.854234 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ceb834d5d2394bd588c55b20c1c28759"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ceb834d5d2394bd588c55b20c1c28759", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ceb834d5d2394bd588c55b20c1c28759"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ceb834d5d2394bd588c55b20c1c28759"}]}] Oct 04 18:52:04.854234 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-VolumesNegativeTest-1086787532 Oct 04 18:52:04.854234 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: ceb834d5d2394bd588c55b20c1c28759 Oct 04 18:52:04.854234 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-VolumesNegativeTest-1086787532 Oct 04 18:52:04.854234 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-VolumesNegativeTest-1086787532-project Oct 04 18:52:04.854234 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:52:04.854234 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:52:04.854234 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 9124cd89187c49709e1b039570c75937 Oct 04 18:52:04.854234 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-VolumesNegativeTest-1086787532-project Oct 04 18:52:04.854234 n-d-850501-14 devstack@n-api.service[123002]: method: Oct 04 18:52:04.854234 n-d-850501-14 devstack@n-api.service[123002]: exception: Volume be4e15b9-8c91-4eb3-b7d6-22ae0fb427a6 could not be found. Oct 04 18:52:04.854234 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'be4e15b9-8c91-4eb3-b7d6-22ae0fb427a6'} Oct 04 18:52:04.854234 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:52:04.854234 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:04.854234 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 18:52:04.854234 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 18:52:04.854234 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 18:52:04.854234 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 18:52:04.854234 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 18:52:04.854234 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 18:52:04.854234 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 18:52:04.854234 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 18:52:04.854234 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 18:52:04.854234 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 18:52:04.854234 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:52:04.854234 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:52:04.854234 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:52:04.854234 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:52:04.854234 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume be4e15b9-8c91-4eb3-b7d6-22ae0fb427a6 could not be found. (HTTP 404) (Request-ID: req-92c2fea0-98e4-44cb-9213-cd5bebe96841) Oct 04 18:52:04.854234 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:52:04.854234 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:52:04.854234 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:52:04.854234 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:04.854234 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 04 18:52:04.854234 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 04 18:52:04.854234 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 18:52:04.854234 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 18:52:04.854234 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 18:52:04.854234 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 18:52:04.854234 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 18:52:04.854234 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 18:52:04.854234 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 18:52:04.858931 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 18:52:04.858931 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 18:52:04.858931 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 18:52:04.858931 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 18:52:04.858931 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 18:52:04.858931 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 18:52:04.858931 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 18:52:04.858931 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 18:52:04.858931 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 18:52:04.858931 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:52:04.858931 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:52:04.858931 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:52:04.858931 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:52:04.858931 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume be4e15b9-8c91-4eb3-b7d6-22ae0fb427a6 could not be found. Oct 04 18:52:04.858931 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:52:04.858931 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:52:04.858931 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:52:04.858931 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:04.858931 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:52:04.858931 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:52:04.858931 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:52:04.858931 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:52:04.858931 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:52:04.858931 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:52:04.858931 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:52:04.858931 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:52:04.858931 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 04 18:52:04.858931 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:52:04.858931 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume be4e15b9-8c91-4eb3-b7d6-22ae0fb427a6 could not be found. Oct 04 18:52:04.858931 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:52:04.858931 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:52:04.858931 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:52:04.858931 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:04.858931 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:52:04.858931 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:52:04.858931 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:52:04.858931 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:52:04.858931 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume be4e15b9-8c91-4eb3-b7d6-22ae0fb427a6 could not be found. Oct 04 18:52:04.858931 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:52:04.858931 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c04213b0-fb08-4f39-87f3-e7f42a396353 tempest-VolumesNegativeTest-1086787532 tempest-VolumesNegativeTest-1086787532-project] Returning 404 to user: Volume be4e15b9-8c91-4eb3-b7d6-22ae0fb427a6 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:52:04.858931 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c04213b0-fb08-4f39-87f3-e7f42a396353 tempest-VolumesNegativeTest-1086787532 tempest-VolumesNegativeTest-1086787532-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/be4e15b9-8c91-4eb3-b7d6-22ae0fb427a6" status: 404 len: 109 microversion: 2.1 time: 0.053312 Oct 04 18:52:04.858931 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2566/5189] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Oct 4 18:52:04 2022] GET /compute/v2.1/os-volumes/be4e15b9-8c91-4eb3-b7d6-22ae0fb427a6 => generated 109 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:52:04.910613 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-14f9f5c4-05cf-4436-93c1-a56338636934 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:04.920281 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-14f9f5c4-05cf-4436-93c1-a56338636934 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60" status: 200 len: 1527 microversion: 2.1 time: 0.205261 Oct 04 18:52:04.922112 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2624/5190] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:04 2022] GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60 => generated 1527 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:52:05.064843 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d594d51d-c5c9-4d55-be33-4da5574e2bcc tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:05.065710 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d594d51d-c5c9-4d55-be33-4da5574e2bcc tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] [instance: f1b17780-52f5-468b-afe8-44ace600334c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:05.072382 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d594d51d-c5c9-4d55-be33-4da5574e2bcc tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:05.073455 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d594d51d-c5c9-4d55-be33-4da5574e2bcc tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:05.074112 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d594d51d-c5c9-4d55-be33-4da5574e2bcc tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:05.075038 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d594d51d-c5c9-4d55-be33-4da5574e2bcc tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:05.075718 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d594d51d-c5c9-4d55-be33-4da5574e2bcc tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:05.076246 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d594d51d-c5c9-4d55-be33-4da5574e2bcc tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:05.230859 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d594d51d-c5c9-4d55-be33-4da5574e2bcc tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed1e61032824e30be2244ae45341d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7284369fd548539c5152796566eca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:05.251345 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d594d51d-c5c9-4d55-be33-4da5574e2bcc tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ed1e61032824e30be2244ae45341d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7284369fd548539c5152796566eca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:05.253235 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d594d51d-c5c9-4d55-be33-4da5574e2bcc tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ed1e61032824e30be2244ae45341d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7284369fd548539c5152796566eca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:05.254516 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d594d51d-c5c9-4d55-be33-4da5574e2bcc tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] 10.222.0.20 "GET /compute/v2.1/servers/f1b17780-52f5-468b-afe8-44ace600334c" status: 200 len: 1552 microversion: 2.21 time: 0.193508 Oct 04 18:52:05.255128 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2567/5191] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:52:05 2022] GET /compute/v2.1/servers/f1b17780-52f5-468b-afe8-44ace600334c => generated 1552 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:52:05.280711 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a11b26b8-7c8c-4387-ad4d-ba6912a099cd tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:05.281174 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a11b26b8-7c8c-4387-ad4d-ba6912a099cd tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] [instance: f1b17780-52f5-468b-afe8-44ace600334c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:05.290295 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a11b26b8-7c8c-4387-ad4d-ba6912a099cd tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:05.291398 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a11b26b8-7c8c-4387-ad4d-ba6912a099cd tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:05.291962 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a11b26b8-7c8c-4387-ad4d-ba6912a099cd tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:05.292797 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a11b26b8-7c8c-4387-ad4d-ba6912a099cd tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:05.293258 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a11b26b8-7c8c-4387-ad4d-ba6912a099cd tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:05.294007 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a11b26b8-7c8c-4387-ad4d-ba6912a099cd tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:05.323302 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a11b26b8-7c8c-4387-ad4d-ba6912a099cd tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] [instance: f1b17780-52f5-468b-afe8-44ace600334c] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:52:05.415373 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-e63c44a0-78e2-4f68-bbe0-d93981d989b2 req-086760d5-2a8a-4f6e-baee-e4ad1d24087c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9eaa25a-0821-47fb-a16e-d07bcde9cc60", "name": "network-vif-plugged", "status": "completed", "tag": "b323ea97-81a2-4778-8096-32e05d6f2440"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:52:05.427014 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-e63c44a0-78e2-4f68-bbe0-d93981d989b2 req-086760d5-2a8a-4f6e-baee-e4ad1d24087c service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:05.427995 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-e63c44a0-78e2-4f68-bbe0-d93981d989b2 req-086760d5-2a8a-4f6e-baee-e4ad1d24087c service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:05.428758 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-e63c44a0-78e2-4f68-bbe0-d93981d989b2 req-086760d5-2a8a-4f6e-baee-e4ad1d24087c service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:05.442517 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-e63c44a0-78e2-4f68-bbe0-d93981d989b2 req-086760d5-2a8a-4f6e-baee-e4ad1d24087c service nova] Creating event network-vif-plugged:b323ea97-81a2-4778-8096-32e05d6f2440 for instance a9eaa25a-0821-47fb-a16e-d07bcde9cc60 on n-h2-850501-14 Oct 04 18:52:05.448933 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-e63c44a0-78e2-4f68-bbe0-d93981d989b2 req-086760d5-2a8a-4f6e-baee-e4ad1d24087c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037211 Oct 04 18:52:05.450353 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2568/5192] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:52:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:52:05.630611 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a11b26b8-7c8c-4387-ad4d-ba6912a099cd tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f1b17780-52f5-468b-afe8-44ace600334c" status: 204 len: 0 microversion: 2.21 time: 0.353424 Oct 04 18:52:05.631233 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2625/5193] 10.222.0.20 () {60 vars in 1280 bytes} [Tue Oct 4 18:52:05 2022] DELETE /compute/v2.1/servers/f1b17780-52f5-468b-afe8-44ace600334c => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:52:05.642304 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-73eca182-0140-4087-b91c-48f119a668e0 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:05.643741 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-73eca182-0140-4087-b91c-48f119a668e0 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] [instance: f1b17780-52f5-468b-afe8-44ace600334c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:05.655186 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-73eca182-0140-4087-b91c-48f119a668e0 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:05.656450 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-73eca182-0140-4087-b91c-48f119a668e0 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:05.657137 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-73eca182-0140-4087-b91c-48f119a668e0 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:05.658777 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-73eca182-0140-4087-b91c-48f119a668e0 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:05.659570 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-73eca182-0140-4087-b91c-48f119a668e0 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:05.660199 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-73eca182-0140-4087-b91c-48f119a668e0 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:05.770950 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9379be04-2dfa-40f1-b969-4f23acaca98c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:05.772008 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-9379be04-2dfa-40f1-b969-4f23acaca98c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:05.779723 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9379be04-2dfa-40f1-b969-4f23acaca98c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:05.780262 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9379be04-2dfa-40f1-b969-4f23acaca98c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:05.780706 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9379be04-2dfa-40f1-b969-4f23acaca98c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:05.781707 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9379be04-2dfa-40f1-b969-4f23acaca98c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:05.782253 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9379be04-2dfa-40f1-b969-4f23acaca98c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:05.782638 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9379be04-2dfa-40f1-b969-4f23acaca98c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:05.934901 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-73eca182-0140-4087-b91c-48f119a668e0 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed1e61032824e30be2244ae45341d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7284369fd548539c5152796566eca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:05.949225 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-73eca182-0140-4087-b91c-48f119a668e0 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ed1e61032824e30be2244ae45341d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7284369fd548539c5152796566eca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:05.951191 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-73eca182-0140-4087-b91c-48f119a668e0 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ed1e61032824e30be2244ae45341d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7284369fd548539c5152796566eca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:05.953323 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-73eca182-0140-4087-b91c-48f119a668e0 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] 10.222.0.20 "GET /compute/v2.1/servers/f1b17780-52f5-468b-afe8-44ace600334c" status: 200 len: 1558 microversion: 2.21 time: 0.316103 Oct 04 18:52:05.954612 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2569/5194] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:52:05 2022] GET /compute/v2.1/servers/f1b17780-52f5-468b-afe8-44ace600334c => generated 1558 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:52:05.976864 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-257aaded-37d6-4721-a47e-fc0a06bb072c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:05.977915 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-257aaded-37d6-4721-a47e-fc0a06bb072c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9eaa25a-0821-47fb-a16e-d07bcde9cc60] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:05.986037 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-257aaded-37d6-4721-a47e-fc0a06bb072c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:05.987053 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-257aaded-37d6-4721-a47e-fc0a06bb072c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:05.988077 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-257aaded-37d6-4721-a47e-fc0a06bb072c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:05.989043 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-257aaded-37d6-4721-a47e-fc0a06bb072c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:05.990370 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-257aaded-37d6-4721-a47e-fc0a06bb072c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:05.990894 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-257aaded-37d6-4721-a47e-fc0a06bb072c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:06.036725 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9379be04-2dfa-40f1-b969-4f23acaca98c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:06.047594 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9379be04-2dfa-40f1-b969-4f23acaca98c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1682 microversion: 2.1 time: 0.280839 Oct 04 18:52:06.048953 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2626/5195] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:05 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1682 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:52:06.216181 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-257aaded-37d6-4721-a47e-fc0a06bb072c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:06.226687 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-257aaded-37d6-4721-a47e-fc0a06bb072c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60" status: 200 len: 1527 microversion: 2.1 time: 0.270788 Oct 04 18:52:06.227394 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2570/5196] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:05 2022] GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60 => generated 1527 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:06.981684 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1ed42ec1-dbd0-403f-8f92-6b033319323d tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:06.988038 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1ed42ec1-dbd0-403f-8f92-6b033319323d tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] [instance: f1b17780-52f5-468b-afe8-44ace600334c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:07.002683 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1ed42ec1-dbd0-403f-8f92-6b033319323d tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:07.003188 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1ed42ec1-dbd0-403f-8f92-6b033319323d tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:07.003682 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1ed42ec1-dbd0-403f-8f92-6b033319323d tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:07.004426 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1ed42ec1-dbd0-403f-8f92-6b033319323d tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:07.004891 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1ed42ec1-dbd0-403f-8f92-6b033319323d tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:07.005323 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1ed42ec1-dbd0-403f-8f92-6b033319323d tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:07.090483 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-974c16cc-a655-433f-995c-efe7b9de62ff tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:07.091104 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-974c16cc-a655-433f-995c-efe7b9de62ff tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:07.102452 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-974c16cc-a655-433f-995c-efe7b9de62ff tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:07.102920 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-974c16cc-a655-433f-995c-efe7b9de62ff tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:07.103963 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-974c16cc-a655-433f-995c-efe7b9de62ff tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:07.104719 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-974c16cc-a655-433f-995c-efe7b9de62ff tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:07.105175 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-974c16cc-a655-433f-995c-efe7b9de62ff tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:07.107354 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-974c16cc-a655-433f-995c-efe7b9de62ff tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:07.508403 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-974c16cc-a655-433f-995c-efe7b9de62ff tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:07.531841 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-974c16cc-a655-433f-995c-efe7b9de62ff tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1682 microversion: 2.1 time: 0.447896 Oct 04 18:52:07.546336 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2571/5197] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:07 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1682 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:07.556619 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1ed42ec1-dbd0-403f-8f92-6b033319323d tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed1e61032824e30be2244ae45341d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7284369fd548539c5152796566eca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:07.559671 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ee738ab8-8b56-4e55-aac6-22d469bb00e9 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:07.567180 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1ed42ec1-dbd0-403f-8f92-6b033319323d tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ed1e61032824e30be2244ae45341d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7284369fd548539c5152796566eca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:07.567440 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ee738ab8-8b56-4e55-aac6-22d469bb00e9 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9eaa25a-0821-47fb-a16e-d07bcde9cc60] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:07.570428 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1ed42ec1-dbd0-403f-8f92-6b033319323d tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ed1e61032824e30be2244ae45341d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7284369fd548539c5152796566eca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:07.571830 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1ed42ec1-dbd0-403f-8f92-6b033319323d tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] 10.222.0.20 "GET /compute/v2.1/servers/f1b17780-52f5-468b-afe8-44ace600334c" status: 200 len: 1558 microversion: 2.21 time: 0.595108 Oct 04 18:52:07.573008 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2627/5198] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:52:06 2022] GET /compute/v2.1/servers/f1b17780-52f5-468b-afe8-44ace600334c => generated 1558 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:52:07.595021 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ee738ab8-8b56-4e55-aac6-22d469bb00e9 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:07.595810 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ee738ab8-8b56-4e55-aac6-22d469bb00e9 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:07.596436 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ee738ab8-8b56-4e55-aac6-22d469bb00e9 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:07.597308 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ee738ab8-8b56-4e55-aac6-22d469bb00e9 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:07.597921 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ee738ab8-8b56-4e55-aac6-22d469bb00e9 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:07.598514 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ee738ab8-8b56-4e55-aac6-22d469bb00e9 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:07.892590 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ee738ab8-8b56-4e55-aac6-22d469bb00e9 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:07.910591 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ee738ab8-8b56-4e55-aac6-22d469bb00e9 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60" status: 200 len: 1527 microversion: 2.1 time: 0.362908 Oct 04 18:52:07.912005 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2572/5199] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:07 2022] GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60 => generated 1527 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:07.988867 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-5e9873dc-2df4-4f67-9c73-187ca4943026 req-9ed3213e-8610-406a-9dbb-96c7d4ae26b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1b17780-52f5-468b-afe8-44ace600334c", "name": "network-vif-deleted", "tag": "8adf6669-0f1d-4bc5-93ff-aaa346197fa5"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:52:08.000877 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-5e9873dc-2df4-4f67-9c73-187ca4943026 req-9ed3213e-8610-406a-9dbb-96c7d4ae26b5 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:08.001572 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-5e9873dc-2df4-4f67-9c73-187ca4943026 req-9ed3213e-8610-406a-9dbb-96c7d4ae26b5 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:08.002178 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-5e9873dc-2df4-4f67-9c73-187ca4943026 req-9ed3213e-8610-406a-9dbb-96c7d4ae26b5 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:08.015659 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-5e9873dc-2df4-4f67-9c73-187ca4943026 req-9ed3213e-8610-406a-9dbb-96c7d4ae26b5 service nova] Creating event network-vif-deleted:8adf6669-0f1d-4bc5-93ff-aaa346197fa5 for instance f1b17780-52f5-468b-afe8-44ace600334c on n-h1-850501-14 Oct 04 18:52:08.021221 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-5e9873dc-2df4-4f67-9c73-187ca4943026 req-9ed3213e-8610-406a-9dbb-96c7d4ae26b5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035859 Oct 04 18:52:08.022159 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2628/5200] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:52:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:52:08.572338 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e7cb8b4e-3fae-4484-b3f4-66b11ab02710 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:08.575508 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e7cb8b4e-3fae-4484-b3f4-66b11ab02710 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:08.590180 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e7cb8b4e-3fae-4484-b3f4-66b11ab02710 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:08.593519 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e7cb8b4e-3fae-4484-b3f4-66b11ab02710 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:08.594227 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e7cb8b4e-3fae-4484-b3f4-66b11ab02710 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:08.600920 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3a769bd0-293b-4000-b1e9-502aec8d1bf9 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:08.601890 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3a769bd0-293b-4000-b1e9-502aec8d1bf9 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] [instance: f1b17780-52f5-468b-afe8-44ace600334c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:08.608331 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e7cb8b4e-3fae-4484-b3f4-66b11ab02710 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:08.611153 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e7cb8b4e-3fae-4484-b3f4-66b11ab02710 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:08.612408 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e7cb8b4e-3fae-4484-b3f4-66b11ab02710 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:08.618620 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3a769bd0-293b-4000-b1e9-502aec8d1bf9 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:08.620237 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3a769bd0-293b-4000-b1e9-502aec8d1bf9 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:08.624174 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3a769bd0-293b-4000-b1e9-502aec8d1bf9 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:08.624174 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3a769bd0-293b-4000-b1e9-502aec8d1bf9 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:08.624174 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3a769bd0-293b-4000-b1e9-502aec8d1bf9 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:08.624777 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3a769bd0-293b-4000-b1e9-502aec8d1bf9 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:08.658777 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:52:08.703281 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3a769bd0-293b-4000-b1e9-502aec8d1bf9 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:08.705269 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3a769bd0-293b-4000-b1e9-502aec8d1bf9 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:08.705893 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3a769bd0-293b-4000-b1e9-502aec8d1bf9 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:08.706544 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-3a769bd0-293b-4000-b1e9-502aec8d1bf9 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Lazy-loading 'fault' on Instance uuid f1b17780-52f5-468b-afe8-44ace600334c {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:52:08.862444 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3a769bd0-293b-4000-b1e9-502aec8d1bf9 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed1e61032824e30be2244ae45341d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7284369fd548539c5152796566eca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:08.886690 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3a769bd0-293b-4000-b1e9-502aec8d1bf9 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ed1e61032824e30be2244ae45341d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7284369fd548539c5152796566eca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:08.889966 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3a769bd0-293b-4000-b1e9-502aec8d1bf9 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ed1e61032824e30be2244ae45341d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7284369fd548539c5152796566eca4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:08.898548 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3a769bd0-293b-4000-b1e9-502aec8d1bf9 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] 10.222.0.20 "GET /compute/v2.1/servers/f1b17780-52f5-468b-afe8-44ace600334c" status: 200 len: 1349 microversion: 2.21 time: 0.299760 Oct 04 18:52:08.898548 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2629/5201] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:52:08 2022] GET /compute/v2.1/servers/f1b17780-52f5-468b-afe8-44ace600334c => generated 1349 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:52:08.936540 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8efe2dc1-f2bf-4c3e-b6a6-272f2a4f7735 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:08.938593 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8efe2dc1-f2bf-4c3e-b6a6-272f2a4f7735 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9eaa25a-0821-47fb-a16e-d07bcde9cc60] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:08.959652 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8efe2dc1-f2bf-4c3e-b6a6-272f2a4f7735 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:08.965442 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8efe2dc1-f2bf-4c3e-b6a6-272f2a4f7735 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:08.966008 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8efe2dc1-f2bf-4c3e-b6a6-272f2a4f7735 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:08.966772 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8efe2dc1-f2bf-4c3e-b6a6-272f2a4f7735 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:08.970876 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8efe2dc1-f2bf-4c3e-b6a6-272f2a4f7735 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:08.971622 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8efe2dc1-f2bf-4c3e-b6a6-272f2a4f7735 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:09.173268 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e7cb8b4e-3fae-4484-b3f4-66b11ab02710 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:09.185325 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e7cb8b4e-3fae-4484-b3f4-66b11ab02710 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1682 microversion: 2.1 time: 0.629195 Oct 04 18:52:09.185924 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2573/5202] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:08 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1682 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:09.375721 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8efe2dc1-f2bf-4c3e-b6a6-272f2a4f7735 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:09.393918 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8efe2dc1-f2bf-4c3e-b6a6-272f2a4f7735 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60" status: 200 len: 1522 microversion: 2.1 time: 0.462187 Oct 04 18:52:09.394833 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2630/5203] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:08 2022] GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60 => generated 1522 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:09.927619 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a956c8d3-59ba-4192-bc1d-a2a821da1128 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:09.929274 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a956c8d3-59ba-4192-bc1d-a2a821da1128 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] [instance: f1b17780-52f5-468b-afe8-44ace600334c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:09.954003 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a956c8d3-59ba-4192-bc1d-a2a821da1128 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:09.955710 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a956c8d3-59ba-4192-bc1d-a2a821da1128 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:09.959062 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a956c8d3-59ba-4192-bc1d-a2a821da1128 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:09.960092 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a956c8d3-59ba-4192-bc1d-a2a821da1128 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:09.961238 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a956c8d3-59ba-4192-bc1d-a2a821da1128 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:09.963102 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a956c8d3-59ba-4192-bc1d-a2a821da1128 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:09.991541 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-a956c8d3-59ba-4192-bc1d-a2a821da1128 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] HTTP exception thrown: Instance f1b17780-52f5-468b-afe8-44ace600334c could not be found. Oct 04 18:52:09.999730 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a956c8d3-59ba-4192-bc1d-a2a821da1128 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Request method failure captured: Oct 04 18:52:09.999730 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/f1b17780-52f5-468b-afe8-44ace600334c HTTP/1.1 Oct 04 18:52:09.999730 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:52:09.999730 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:52:09.999730 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:52:09.999730 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:52:09.999730 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:52:09.999730 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:52:09.999730 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:52:09.999730 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:52:09.999730 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPIDB6ThOzrD9vZG7IwiIkEASOObOc-Qz7T73ePVg_EjaMMeOJOwKWHIex7pwAg7Fz-AC_RE-UcI_ZzmqfSXS_WMKBl1XnoxXngsD5kMYfxGvUW_GA3rCi-FVaCB4uCAwNMv5aAuAJEAOPAFET8TqMhWq95CMMPFCtBw-K_d0kaRszWc Oct 04 18:52:09.999730 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:52:09.999730 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:52:09.999730 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:52:09.999730 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:52:09.999730 n-d-850501-14 devstack@n-api.service[123002]: X-Openstack-Nova-Api-Version: 2.21 Oct 04 18:52:09.999730 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:52:09.999730 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:52:09.999730 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: fc7284369fd548539c5152796566eca4 Oct 04 18:52:09.999730 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-InstanceActionsV221TestJSON-891951375 Oct 04 18:52:09.999730 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:52:09.999730 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:52:09.999730 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fc7284369fd548539c5152796566eca4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fc7284369fd548539c5152796566eca4", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fc7284369fd548539c5152796566eca4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fc7284369fd548539c5152796566eca4"}]}] Oct 04 18:52:09.999730 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-InstanceActionsV221TestJSON-891951375 Oct 04 18:52:09.999730 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: fc7284369fd548539c5152796566eca4 Oct 04 18:52:09.999730 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-891951375 Oct 04 18:52:09.999730 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-InstanceActionsV221TestJSON-891951375-project Oct 04 18:52:09.999730 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:52:09.999730 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:52:09.999730 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 6ed1e61032824e30be2244ae45341d6f Oct 04 18:52:09.999730 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-InstanceActionsV221TestJSON-891951375-project Oct 04 18:52:09.999730 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:52:09.999730 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance f1b17780-52f5-468b-afe8-44ace600334c could not be found. Oct 04 18:52:09.999730 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'f1b17780-52f5-468b-afe8-44ace600334c'} Oct 04 18:52:09.999730 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:52:09.999730 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:09.999730 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:52:09.999730 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:52:09.999730 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:52:09.999730 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:52:09.999730 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:52:09.999730 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:52:09.999730 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:52:09.999730 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:52:09.999730 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1b17780-52f5-468b-afe8-44ace600334c could not be found. Oct 04 18:52:09.999730 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:52:09.999730 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:52:09.999730 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:52:09.999730 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:09.999730 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:52:09.999730 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:52:09.999730 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:52:09.999730 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:52:09.999730 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:52:09.999730 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:52:09.999730 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:52:09.999730 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:52:09.999730 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:52:09.999730 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:52:09.999730 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:52:09.999730 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:52:09.999730 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1b17780-52f5-468b-afe8-44ace600334c could not be found. Oct 04 18:52:09.999730 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:52:09.999730 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:52:10.007814 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:52:10.007814 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:10.007814 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:52:10.007814 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:52:10.007814 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:52:10.007814 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:52:10.007814 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1b17780-52f5-468b-afe8-44ace600334c could not be found. Oct 04 18:52:10.007814 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:52:10.014155 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a956c8d3-59ba-4192-bc1d-a2a821da1128 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Returning 404 to user: Instance f1b17780-52f5-468b-afe8-44ace600334c could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:52:10.015290 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a956c8d3-59ba-4192-bc1d-a2a821da1128 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] 10.222.0.20 "GET /compute/v2.1/servers/f1b17780-52f5-468b-afe8-44ace600334c" status: 404 len: 111 microversion: 2.21 time: 0.092016 Oct 04 18:52:10.027176 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6cbe1a1c-8a20-4ae9-81e5-608de3d1ceff tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Calling method '.version_select at 0x7fe253b8d4c0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:10.028849 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6cbe1a1c-8a20-4ae9-81e5-608de3d1ceff tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] [instance: f1b17780-52f5-468b-afe8-44ace600334c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:10.033772 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2574/5204] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:52:09 2022] GET /compute/v2.1/servers/f1b17780-52f5-468b-afe8-44ace600334c => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:52:10.035997 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:52:10.037709 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6cbe1a1c-8a20-4ae9-81e5-608de3d1ceff tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:10.038596 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6cbe1a1c-8a20-4ae9-81e5-608de3d1ceff tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:10.039229 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6cbe1a1c-8a20-4ae9-81e5-608de3d1ceff tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:10.040410 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6cbe1a1c-8a20-4ae9-81e5-608de3d1ceff tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:10.041816 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6cbe1a1c-8a20-4ae9-81e5-608de3d1ceff tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:10.042444 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6cbe1a1c-8a20-4ae9-81e5-608de3d1ceff tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:10.213109 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-85172280-2cf5-48cb-bf49-cda17fb8bbe4 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:10.213728 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-85172280-2cf5-48cb-bf49-cda17fb8bbe4 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:10.229935 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-85172280-2cf5-48cb-bf49-cda17fb8bbe4 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:10.230690 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-85172280-2cf5-48cb-bf49-cda17fb8bbe4 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:10.231579 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-85172280-2cf5-48cb-bf49-cda17fb8bbe4 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:10.232532 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-85172280-2cf5-48cb-bf49-cda17fb8bbe4 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:10.233181 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-85172280-2cf5-48cb-bf49-cda17fb8bbe4 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:10.233768 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-85172280-2cf5-48cb-bf49-cda17fb8bbe4 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:10.514836 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:52:10.555995 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6cbe1a1c-8a20-4ae9-81e5-608de3d1ceff tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] 10.222.0.20 "GET /compute/v2.1/servers/f1b17780-52f5-468b-afe8-44ace600334c/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.534295 Oct 04 18:52:10.568395 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2631/5205] 10.222.0.20 () {60 vars in 1337 bytes} [Tue Oct 4 18:52:10 2022] GET /compute/v2.1/servers/f1b17780-52f5-468b-afe8-44ace600334c/os-instance-actions => generated 611 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:52:10.570983 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d00bc978-4abf-4c55-8978-d1c08890ec59 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:10.572364 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d00bc978-4abf-4c55-8978-d1c08890ec59 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9eaa25a-0821-47fb-a16e-d07bcde9cc60] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:10.583608 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d00bc978-4abf-4c55-8978-d1c08890ec59 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:10.584651 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d00bc978-4abf-4c55-8978-d1c08890ec59 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:10.585322 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d00bc978-4abf-4c55-8978-d1c08890ec59 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:10.586325 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d00bc978-4abf-4c55-8978-d1c08890ec59 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:10.586998 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d00bc978-4abf-4c55-8978-d1c08890ec59 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:10.588415 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d00bc978-4abf-4c55-8978-d1c08890ec59 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:10.930286 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-85172280-2cf5-48cb-bf49-cda17fb8bbe4 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:10.940411 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-85172280-2cf5-48cb-bf49-cda17fb8bbe4 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1659 microversion: 2.1 time: 0.731157 Oct 04 18:52:10.951151 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2575/5206] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:10 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1659 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:52:10.970052 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d00bc978-4abf-4c55-8978-d1c08890ec59 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:10.977377 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e4a3d233-88f7-4d1c-8ead-cee32106cbb2 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:10.977377 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e4a3d233-88f7-4d1c-8ead-cee32106cbb2 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] [instance: f1b17780-52f5-468b-afe8-44ace600334c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:10.981024 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d00bc978-4abf-4c55-8978-d1c08890ec59 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60" status: 200 len: 1522 microversion: 2.1 time: 0.421947 Oct 04 18:52:10.981653 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2632/5207] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:10 2022] GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60 => generated 1522 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:10.988802 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e4a3d233-88f7-4d1c-8ead-cee32106cbb2 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:10.989418 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e4a3d233-88f7-4d1c-8ead-cee32106cbb2 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:10.993370 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e4a3d233-88f7-4d1c-8ead-cee32106cbb2 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:10.994264 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e4a3d233-88f7-4d1c-8ead-cee32106cbb2 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:10.994777 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e4a3d233-88f7-4d1c-8ead-cee32106cbb2 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:10.995216 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e4a3d233-88f7-4d1c-8ead-cee32106cbb2 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:10.996717 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2e31dbcb-bf72-4486-94ae-8be8b54b4fba tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:52:11.003712 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2e31dbcb-bf72-4486-94ae-8be8b54b4fba tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:11.007132 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2e31dbcb-bf72-4486-94ae-8be8b54b4fba tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:11.007132 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2e31dbcb-bf72-4486-94ae-8be8b54b4fba tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:11.036829 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-e4a3d233-88f7-4d1c-8ead-cee32106cbb2 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] HTTP exception thrown: Instance f1b17780-52f5-468b-afe8-44ace600334c could not be found. Oct 04 18:52:11.038441 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e4a3d233-88f7-4d1c-8ead-cee32106cbb2 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Request method failure captured: Oct 04 18:52:11.038441 n-d-850501-14 devstack@n-api.service[123002]: request: DELETE /compute/v2.1/servers/f1b17780-52f5-468b-afe8-44ace600334c HTTP/1.1 Oct 04 18:52:11.038441 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:52:11.038441 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:52:11.038441 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:52:11.038441 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:52:11.038441 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:52:11.038441 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:52:11.038441 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:52:11.038441 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:52:11.038441 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPIDB6ThOzrD9vZG7IwiIkEASOObOc-Qz7T73ePVg_EjaMMeOJOwKWHIex7pwAg7Fz-AC_RE-UcI_ZzmqfSXS_WMKBl1XnoxXngsD5kMYfxGvUW_GA3rCi-FVaCB4uCAwNMv5aAuAJEAOPAFET8TqMhWq95CMMPFCtBw-K_d0kaRszWc Oct 04 18:52:11.038441 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:52:11.038441 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:52:11.038441 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:52:11.038441 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:52:11.038441 n-d-850501-14 devstack@n-api.service[123002]: X-Openstack-Nova-Api-Version: 2.21 Oct 04 18:52:11.038441 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:52:11.038441 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:52:11.038441 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: fc7284369fd548539c5152796566eca4 Oct 04 18:52:11.038441 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-InstanceActionsV221TestJSON-891951375 Oct 04 18:52:11.038441 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:52:11.038441 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:52:11.038441 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fc7284369fd548539c5152796566eca4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fc7284369fd548539c5152796566eca4", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fc7284369fd548539c5152796566eca4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fc7284369fd548539c5152796566eca4"}]}] Oct 04 18:52:11.038441 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-InstanceActionsV221TestJSON-891951375 Oct 04 18:52:11.038441 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: fc7284369fd548539c5152796566eca4 Oct 04 18:52:11.038441 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-891951375 Oct 04 18:52:11.038441 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-InstanceActionsV221TestJSON-891951375-project Oct 04 18:52:11.038441 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:52:11.038441 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:52:11.038441 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 6ed1e61032824e30be2244ae45341d6f Oct 04 18:52:11.038441 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-InstanceActionsV221TestJSON-891951375-project Oct 04 18:52:11.038441 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:52:11.038441 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance f1b17780-52f5-468b-afe8-44ace600334c could not be found. Oct 04 18:52:11.038441 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'f1b17780-52f5-468b-afe8-44ace600334c'} Oct 04 18:52:11.038441 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:52:11.038441 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:11.038441 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:52:11.038441 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:52:11.038441 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:52:11.038441 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:52:11.038441 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:52:11.038441 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:52:11.038441 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:52:11.038441 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:52:11.038441 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1b17780-52f5-468b-afe8-44ace600334c could not be found. Oct 04 18:52:11.038441 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:52:11.038441 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:52:11.038441 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:52:11.038441 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:11.038441 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:52:11.038441 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:52:11.038441 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:52:11.038441 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:52:11.038441 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:52:11.038441 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:52:11.038441 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:52:11.038441 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:52:11.038441 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:52:11.038441 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:52:11.038441 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:52:11.038441 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:52:11.038441 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:52:11.038441 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:52:11.045684 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1b17780-52f5-468b-afe8-44ace600334c could not be found. Oct 04 18:52:11.045684 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:52:11.045684 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:52:11.045684 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:52:11.045684 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:11.045684 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:52:11.045684 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:52:11.045684 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:52:11.045684 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:52:11.045684 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1b17780-52f5-468b-afe8-44ace600334c could not be found. Oct 04 18:52:11.045684 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:52:11.045684 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e4a3d233-88f7-4d1c-8ead-cee32106cbb2 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Returning 404 to user: Instance f1b17780-52f5-468b-afe8-44ace600334c could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:52:11.045684 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e4a3d233-88f7-4d1c-8ead-cee32106cbb2 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f1b17780-52f5-468b-afe8-44ace600334c" status: 404 len: 111 microversion: 2.21 time: 0.087452 Oct 04 18:52:11.045684 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2576/5208] 10.222.0.20 () {60 vars in 1280 bytes} [Tue Oct 4 18:52:10 2022] DELETE /compute/v2.1/servers/f1b17780-52f5-468b-afe8-44ace600334c => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:52:11.064469 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-fd6b34aa-9733-4efb-a572-36e0e7716051 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:11.073082 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-fd6b34aa-9733-4efb-a572-36e0e7716051 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] [instance: f1b17780-52f5-468b-afe8-44ace600334c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:11.089610 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fd6b34aa-9733-4efb-a572-36e0e7716051 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:11.089610 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fd6b34aa-9733-4efb-a572-36e0e7716051 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:11.089610 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fd6b34aa-9733-4efb-a572-36e0e7716051 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:11.089610 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fd6b34aa-9733-4efb-a572-36e0e7716051 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:11.113265 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fd6b34aa-9733-4efb-a572-36e0e7716051 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:11.113265 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fd6b34aa-9733-4efb-a572-36e0e7716051 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:11.115882 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2e31dbcb-bf72-4486-94ae-8be8b54b4fba tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Going to try to start instance {{(pid=123001) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 04 18:52:11.141963 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-fd6b34aa-9733-4efb-a572-36e0e7716051 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] HTTP exception thrown: Instance f1b17780-52f5-468b-afe8-44ace600334c could not be found. Oct 04 18:52:11.143534 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-fd6b34aa-9733-4efb-a572-36e0e7716051 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Request method failure captured: Oct 04 18:52:11.143534 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/f1b17780-52f5-468b-afe8-44ace600334c HTTP/1.1 Oct 04 18:52:11.143534 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:52:11.143534 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:52:11.143534 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:52:11.143534 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:52:11.143534 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:52:11.143534 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:52:11.143534 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:52:11.143534 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:52:11.143534 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPIDB6ThOzrD9vZG7IwiIkEASOObOc-Qz7T73ePVg_EjaMMeOJOwKWHIex7pwAg7Fz-AC_RE-UcI_ZzmqfSXS_WMKBl1XnoxXngsD5kMYfxGvUW_GA3rCi-FVaCB4uCAwNMv5aAuAJEAOPAFET8TqMhWq95CMMPFCtBw-K_d0kaRszWc Oct 04 18:52:11.143534 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:52:11.143534 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:52:11.143534 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:52:11.143534 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:52:11.143534 n-d-850501-14 devstack@n-api.service[123002]: X-Openstack-Nova-Api-Version: 2.21 Oct 04 18:52:11.143534 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:52:11.143534 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:52:11.143534 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: fc7284369fd548539c5152796566eca4 Oct 04 18:52:11.143534 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-InstanceActionsV221TestJSON-891951375 Oct 04 18:52:11.143534 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:52:11.143534 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:52:11.143534 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fc7284369fd548539c5152796566eca4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fc7284369fd548539c5152796566eca4", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fc7284369fd548539c5152796566eca4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fc7284369fd548539c5152796566eca4"}]}] Oct 04 18:52:11.143534 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-InstanceActionsV221TestJSON-891951375 Oct 04 18:52:11.143534 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: fc7284369fd548539c5152796566eca4 Oct 04 18:52:11.143534 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-891951375 Oct 04 18:52:11.143534 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-InstanceActionsV221TestJSON-891951375-project Oct 04 18:52:11.143534 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:52:11.143534 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:52:11.143534 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 6ed1e61032824e30be2244ae45341d6f Oct 04 18:52:11.143534 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-InstanceActionsV221TestJSON-891951375-project Oct 04 18:52:11.143534 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:52:11.143534 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance f1b17780-52f5-468b-afe8-44ace600334c could not be found. Oct 04 18:52:11.143534 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'f1b17780-52f5-468b-afe8-44ace600334c'} Oct 04 18:52:11.143534 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:52:11.143534 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:11.143534 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:52:11.143534 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:52:11.143534 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:52:11.143534 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:52:11.143534 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:52:11.143534 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:52:11.143534 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:52:11.143534 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:52:11.143534 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1b17780-52f5-468b-afe8-44ace600334c could not be found. Oct 04 18:52:11.143534 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:52:11.143534 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:52:11.143534 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:52:11.143534 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:11.143534 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:52:11.143534 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:52:11.143534 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:52:11.143534 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:52:11.143534 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:52:11.143534 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:52:11.143534 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:52:11.143534 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:52:11.143534 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:52:11.143534 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:52:11.143534 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:52:11.143534 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:52:11.143534 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1b17780-52f5-468b-afe8-44ace600334c could not be found. Oct 04 18:52:11.143534 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:52:11.143534 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:52:11.147896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:52:11.147896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:11.147896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:52:11.147896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:52:11.147896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:52:11.147896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:52:11.147896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1b17780-52f5-468b-afe8-44ace600334c could not be found. Oct 04 18:52:11.147896 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:52:11.147896 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-fd6b34aa-9733-4efb-a572-36e0e7716051 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] Returning 404 to user: Instance f1b17780-52f5-468b-afe8-44ace600334c could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:52:11.147896 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-fd6b34aa-9733-4efb-a572-36e0e7716051 tempest-InstanceActionsV221TestJSON-891951375 tempest-InstanceActionsV221TestJSON-891951375-project] 10.222.0.20 "GET /compute/v2.1/servers/f1b17780-52f5-468b-afe8-44ace600334c" status: 404 len: 111 microversion: 2.21 time: 0.095775 Oct 04 18:52:11.150794 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2577/5209] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:52:11 2022] GET /compute/v2.1/servers/f1b17780-52f5-468b-afe8-44ace600334c => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:52:11.451198 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2e31dbcb-bf72-4486-94ae-8be8b54b4fba tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "POST /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238/action" status: 202 len: 0 microversion: 2.1 time: 0.465534 Oct 04 18:52:11.452565 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2633/5210] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:52:10 2022] POST /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238/action => generated 0 bytes in 468 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:52:11.460716 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2a75dab0-5fc3-4400-aa9c-d551f1eb0640 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:11.461348 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2a75dab0-5fc3-4400-aa9c-d551f1eb0640 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:11.481746 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2a75dab0-5fc3-4400-aa9c-d551f1eb0640 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:11.483975 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2a75dab0-5fc3-4400-aa9c-d551f1eb0640 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:11.486388 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2a75dab0-5fc3-4400-aa9c-d551f1eb0640 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:11.487320 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2a75dab0-5fc3-4400-aa9c-d551f1eb0640 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:11.489004 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2a75dab0-5fc3-4400-aa9c-d551f1eb0640 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:11.490768 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2a75dab0-5fc3-4400-aa9c-d551f1eb0640 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:12.010817 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c1bed92f-d948-4514-89e2-de9bb3ace548 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:12.012216 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c1bed92f-d948-4514-89e2-de9bb3ace548 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9eaa25a-0821-47fb-a16e-d07bcde9cc60] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:12.021557 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c1bed92f-d948-4514-89e2-de9bb3ace548 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:12.022346 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c1bed92f-d948-4514-89e2-de9bb3ace548 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:12.022970 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c1bed92f-d948-4514-89e2-de9bb3ace548 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:12.024250 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c1bed92f-d948-4514-89e2-de9bb3ace548 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:12.025448 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c1bed92f-d948-4514-89e2-de9bb3ace548 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:12.026060 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c1bed92f-d948-4514-89e2-de9bb3ace548 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:12.539000 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2a75dab0-5fc3-4400-aa9c-d551f1eb0640 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:12.553244 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2a75dab0-5fc3-4400-aa9c-d551f1eb0640 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1668 microversion: 2.1 time: 1.096183 Oct 04 18:52:12.555588 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2578/5211] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:11 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1668 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:12.637255 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c1bed92f-d948-4514-89e2-de9bb3ace548 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:12.651903 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c1bed92f-d948-4514-89e2-de9bb3ace548 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60" status: 200 len: 1522 microversion: 2.1 time: 0.643888 Oct 04 18:52:12.652560 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2634/5212] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:12 2022] GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60 => generated 1522 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:13.586747 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2b69aae8-51c0-4c08-b7c7-dbab0def5d63 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:13.588591 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2b69aae8-51c0-4c08-b7c7-dbab0def5d63 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:13.604078 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2b69aae8-51c0-4c08-b7c7-dbab0def5d63 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:13.604889 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2b69aae8-51c0-4c08-b7c7-dbab0def5d63 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:13.605555 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2b69aae8-51c0-4c08-b7c7-dbab0def5d63 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:13.606544 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2b69aae8-51c0-4c08-b7c7-dbab0def5d63 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:13.616146 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2b69aae8-51c0-4c08-b7c7-dbab0def5d63 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:13.616831 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2b69aae8-51c0-4c08-b7c7-dbab0def5d63 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:13.678658 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7e43f2e8-e4d4-452d-9ff3-b336743cd2ca tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:13.679388 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7e43f2e8-e4d4-452d-9ff3-b336743cd2ca tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9eaa25a-0821-47fb-a16e-d07bcde9cc60] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:13.691444 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7e43f2e8-e4d4-452d-9ff3-b336743cd2ca tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:13.692022 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7e43f2e8-e4d4-452d-9ff3-b336743cd2ca tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:13.692521 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7e43f2e8-e4d4-452d-9ff3-b336743cd2ca tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:13.693530 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7e43f2e8-e4d4-452d-9ff3-b336743cd2ca tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:13.693993 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7e43f2e8-e4d4-452d-9ff3-b336743cd2ca tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:13.694429 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7e43f2e8-e4d4-452d-9ff3-b336743cd2ca tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:14.304735 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7e43f2e8-e4d4-452d-9ff3-b336743cd2ca tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:14.319065 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7e43f2e8-e4d4-452d-9ff3-b336743cd2ca tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60" status: 200 len: 1522 microversion: 2.1 time: 0.644245 Oct 04 18:52:14.326125 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2635/5213] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:13 2022] GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60 => generated 1522 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:52:14.355232 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2b69aae8-51c0-4c08-b7c7-dbab0def5d63 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:14.375172 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2b69aae8-51c0-4c08-b7c7-dbab0def5d63 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1668 microversion: 2.1 time: 0.786438 Oct 04 18:52:14.378462 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2579/5214] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:13 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1668 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:15.354772 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b78eeba9-17b5-4035-8644-2b9f8f7daa21 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:15.357103 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b78eeba9-17b5-4035-8644-2b9f8f7daa21 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9eaa25a-0821-47fb-a16e-d07bcde9cc60] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:15.365039 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b78eeba9-17b5-4035-8644-2b9f8f7daa21 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:15.366866 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b78eeba9-17b5-4035-8644-2b9f8f7daa21 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:15.367491 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b78eeba9-17b5-4035-8644-2b9f8f7daa21 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:15.368540 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b78eeba9-17b5-4035-8644-2b9f8f7daa21 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:15.370100 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b78eeba9-17b5-4035-8644-2b9f8f7daa21 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:15.371320 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b78eeba9-17b5-4035-8644-2b9f8f7daa21 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:15.418098 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-20d607c2-af2a-418e-8c4b-41350e5eaa93 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:15.421004 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-20d607c2-af2a-418e-8c4b-41350e5eaa93 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:15.429419 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-20d607c2-af2a-418e-8c4b-41350e5eaa93 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:15.430374 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-20d607c2-af2a-418e-8c4b-41350e5eaa93 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:15.431752 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-20d607c2-af2a-418e-8c4b-41350e5eaa93 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:15.432894 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-20d607c2-af2a-418e-8c4b-41350e5eaa93 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:15.435331 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-20d607c2-af2a-418e-8c4b-41350e5eaa93 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:15.436483 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-20d607c2-af2a-418e-8c4b-41350e5eaa93 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:15.782119 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b78eeba9-17b5-4035-8644-2b9f8f7daa21 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:15.796124 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b78eeba9-17b5-4035-8644-2b9f8f7daa21 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60" status: 200 len: 1522 microversion: 2.1 time: 0.446860 Oct 04 18:52:15.797946 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2636/5215] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:15 2022] GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60 => generated 1522 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:15.890432 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-20d607c2-af2a-418e-8c4b-41350e5eaa93 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:15.948537 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-20d607c2-af2a-418e-8c4b-41350e5eaa93 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1672 microversion: 2.1 time: 0.533209 Oct 04 18:52:15.950977 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2580/5216] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:15 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1672 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:52:15.976785 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1317dcf4-e7c8-4129-a1f4-aeec5c576a71 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:15.977892 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1317dcf4-e7c8-4129-a1f4-aeec5c576a71 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:16.010480 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1317dcf4-e7c8-4129-a1f4-aeec5c576a71 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:16.010837 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1317dcf4-e7c8-4129-a1f4-aeec5c576a71 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:16.011287 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1317dcf4-e7c8-4129-a1f4-aeec5c576a71 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:16.018685 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1317dcf4-e7c8-4129-a1f4-aeec5c576a71 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:16.019359 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1317dcf4-e7c8-4129-a1f4-aeec5c576a71 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:16.022605 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1317dcf4-e7c8-4129-a1f4-aeec5c576a71 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:16.498188 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1317dcf4-e7c8-4129-a1f4-aeec5c576a71 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:16.514671 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1317dcf4-e7c8-4129-a1f4-aeec5c576a71 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1672 microversion: 2.1 time: 0.543827 Oct 04 18:52:16.518119 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2637/5217] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:15 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1672 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:16.541980 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c3832569-dd06-40e0-8f2b-4711ae916501 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:52:16.542523 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c3832569-dd06-40e0-8f2b-4711ae916501 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:16.559244 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c3832569-dd06-40e0-8f2b-4711ae916501 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:16.565016 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c3832569-dd06-40e0-8f2b-4711ae916501 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:16.569682 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c3832569-dd06-40e0-8f2b-4711ae916501 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:16.571204 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c3832569-dd06-40e0-8f2b-4711ae916501 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:16.573105 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c3832569-dd06-40e0-8f2b-4711ae916501 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:16.577574 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c3832569-dd06-40e0-8f2b-4711ae916501 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:16.820759 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3d50b7f1-e8e8-47d0-8f1e-5805c31e0269 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:16.822303 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3d50b7f1-e8e8-47d0-8f1e-5805c31e0269 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9eaa25a-0821-47fb-a16e-d07bcde9cc60] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:16.835783 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3d50b7f1-e8e8-47d0-8f1e-5805c31e0269 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:16.839886 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3d50b7f1-e8e8-47d0-8f1e-5805c31e0269 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:16.840374 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3d50b7f1-e8e8-47d0-8f1e-5805c31e0269 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:16.841112 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3d50b7f1-e8e8-47d0-8f1e-5805c31e0269 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:16.841572 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3d50b7f1-e8e8-47d0-8f1e-5805c31e0269 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:16.842001 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3d50b7f1-e8e8-47d0-8f1e-5805c31e0269 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:16.894454 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c3832569-dd06-40e0-8f2b-4711ae916501 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Unlocking {{(pid=123002) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 04 18:52:17.125787 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c3832569-dd06-40e0-8f2b-4711ae916501 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "POST /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238/action" status: 202 len: 0 microversion: 2.1 time: 0.588890 Oct 04 18:52:17.126470 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2581/5218] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:52:16 2022] POST /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238/action => generated 0 bytes in 590 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:52:17.137474 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c529c2ea-4c78-443e-9042-328f03bf2615 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:17.139402 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c529c2ea-4c78-443e-9042-328f03bf2615 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:17.147606 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c529c2ea-4c78-443e-9042-328f03bf2615 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:17.155273 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c529c2ea-4c78-443e-9042-328f03bf2615 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:17.156942 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c529c2ea-4c78-443e-9042-328f03bf2615 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:17.162190 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c529c2ea-4c78-443e-9042-328f03bf2615 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:17.163727 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c529c2ea-4c78-443e-9042-328f03bf2615 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:17.168519 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c529c2ea-4c78-443e-9042-328f03bf2615 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:17.516260 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3d50b7f1-e8e8-47d0-8f1e-5805c31e0269 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:17.524592 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3d50b7f1-e8e8-47d0-8f1e-5805c31e0269 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60" status: 200 len: 1522 microversion: 2.1 time: 0.707750 Oct 04 18:52:17.534307 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2638/5219] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:16 2022] GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60 => generated 1522 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:52:17.778210 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c529c2ea-4c78-443e-9042-328f03bf2615 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:17.786427 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c529c2ea-4c78-443e-9042-328f03bf2615 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1672 microversion: 2.1 time: 0.650750 Oct 04 18:52:17.802087 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2582/5220] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:17 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1672 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:52:17.825861 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1bd4de97-c14f-4d37-8847-af4e1a36f10d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:17.827967 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1bd4de97-c14f-4d37-8847-af4e1a36f10d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:17.845881 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1bd4de97-c14f-4d37-8847-af4e1a36f10d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:17.846756 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1bd4de97-c14f-4d37-8847-af4e1a36f10d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:17.848113 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1bd4de97-c14f-4d37-8847-af4e1a36f10d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:17.849155 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1bd4de97-c14f-4d37-8847-af4e1a36f10d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:17.849907 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1bd4de97-c14f-4d37-8847-af4e1a36f10d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:17.850594 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1bd4de97-c14f-4d37-8847-af4e1a36f10d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:18.210996 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1bd4de97-c14f-4d37-8847-af4e1a36f10d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:18.229698 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1bd4de97-c14f-4d37-8847-af4e1a36f10d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1672 microversion: 2.1 time: 0.418393 Oct 04 18:52:18.230290 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2639/5221] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:17 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1672 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:18.261636 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3aa51eb5-0393-49d3-9a91-0c3e388bded6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:18.261636 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3aa51eb5-0393-49d3-9a91-0c3e388bded6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:18.270090 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3aa51eb5-0393-49d3-9a91-0c3e388bded6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:18.270592 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3aa51eb5-0393-49d3-9a91-0c3e388bded6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:18.271029 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3aa51eb5-0393-49d3-9a91-0c3e388bded6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:18.271749 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3aa51eb5-0393-49d3-9a91-0c3e388bded6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:18.272253 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3aa51eb5-0393-49d3-9a91-0c3e388bded6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:18.272684 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3aa51eb5-0393-49d3-9a91-0c3e388bded6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:18.553520 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e2521d7f-52fc-4755-8ca5-e82bebb1836e tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:18.554069 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e2521d7f-52fc-4755-8ca5-e82bebb1836e tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9eaa25a-0821-47fb-a16e-d07bcde9cc60] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:18.570177 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e2521d7f-52fc-4755-8ca5-e82bebb1836e tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:18.573052 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e2521d7f-52fc-4755-8ca5-e82bebb1836e tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:18.573052 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e2521d7f-52fc-4755-8ca5-e82bebb1836e tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:18.573052 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e2521d7f-52fc-4755-8ca5-e82bebb1836e tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:18.583316 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e2521d7f-52fc-4755-8ca5-e82bebb1836e tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:18.584047 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e2521d7f-52fc-4755-8ca5-e82bebb1836e tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:19.446595 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3aa51eb5-0393-49d3-9a91-0c3e388bded6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:19.459349 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3aa51eb5-0393-49d3-9a91-0c3e388bded6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1672 microversion: 2.1 time: 1.201730 Oct 04 18:52:19.463744 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2583/5222] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:18 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1672 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:19.507485 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-52a90a9e-c6c5-4039-8d58-5b4608277188 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:52:19.508781 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-52a90a9e-c6c5-4039-8d58-5b4608277188 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:19.526078 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-52a90a9e-c6c5-4039-8d58-5b4608277188 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:19.527704 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-52a90a9e-c6c5-4039-8d58-5b4608277188 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:19.531467 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-52a90a9e-c6c5-4039-8d58-5b4608277188 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:19.533932 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-52a90a9e-c6c5-4039-8d58-5b4608277188 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:19.535174 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-52a90a9e-c6c5-4039-8d58-5b4608277188 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:19.536456 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-52a90a9e-c6c5-4039-8d58-5b4608277188 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:19.729376 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e2521d7f-52fc-4755-8ca5-e82bebb1836e tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:19.750438 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e2521d7f-52fc-4755-8ca5-e82bebb1836e tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60" status: 200 len: 1522 microversion: 2.1 time: 1.200481 Oct 04 18:52:19.751325 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2640/5223] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:18 2022] GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60 => generated 1522 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:52:19.947992 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-52a90a9e-c6c5-4039-8d58-5b4608277188 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "POST /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238/action" status: 202 len: 0 microversion: 2.1 time: 0.462482 Oct 04 18:52:19.951990 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2584/5224] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:52:19 2022] POST /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238/action => generated 0 bytes in 466 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:52:19.958358 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-206d61b2-fdfb-4aa4-a61e-96bcfb2241b8 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:19.958975 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-206d61b2-fdfb-4aa4-a61e-96bcfb2241b8 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:19.980854 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-206d61b2-fdfb-4aa4-a61e-96bcfb2241b8 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:19.981601 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-206d61b2-fdfb-4aa4-a61e-96bcfb2241b8 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:19.982295 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-206d61b2-fdfb-4aa4-a61e-96bcfb2241b8 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:19.983500 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-206d61b2-fdfb-4aa4-a61e-96bcfb2241b8 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:19.984346 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-206d61b2-fdfb-4aa4-a61e-96bcfb2241b8 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:19.985089 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-206d61b2-fdfb-4aa4-a61e-96bcfb2241b8 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:20.387986 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-206d61b2-fdfb-4aa4-a61e-96bcfb2241b8 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:20.427334 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-206d61b2-fdfb-4aa4-a61e-96bcfb2241b8 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1677 microversion: 2.1 time: 0.472013 Oct 04 18:52:20.440865 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2641/5225] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:19 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1677 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:52:20.781654 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0d2ede68-01c2-43bc-a8b3-55c0fe177147 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:20.783075 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0d2ede68-01c2-43bc-a8b3-55c0fe177147 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9eaa25a-0821-47fb-a16e-d07bcde9cc60] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:20.814088 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0d2ede68-01c2-43bc-a8b3-55c0fe177147 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:20.814596 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0d2ede68-01c2-43bc-a8b3-55c0fe177147 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:20.815042 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0d2ede68-01c2-43bc-a8b3-55c0fe177147 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:20.815766 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0d2ede68-01c2-43bc-a8b3-55c0fe177147 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:20.816261 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0d2ede68-01c2-43bc-a8b3-55c0fe177147 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:20.816695 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0d2ede68-01c2-43bc-a8b3-55c0fe177147 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:21.244195 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0d2ede68-01c2-43bc-a8b3-55c0fe177147 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:21.252458 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0d2ede68-01c2-43bc-a8b3-55c0fe177147 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60" status: 200 len: 1522 microversion: 2.1 time: 0.476529 Oct 04 18:52:21.270692 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2585/5226] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:20 2022] GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60 => generated 1522 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:21.454390 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-aa21a3f0-e3f8-4f7d-8cfa-38ed25074a1f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:21.455772 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-aa21a3f0-e3f8-4f7d-8cfa-38ed25074a1f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:21.467510 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aa21a3f0-e3f8-4f7d-8cfa-38ed25074a1f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:21.468878 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aa21a3f0-e3f8-4f7d-8cfa-38ed25074a1f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:21.469880 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aa21a3f0-e3f8-4f7d-8cfa-38ed25074a1f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:21.471145 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aa21a3f0-e3f8-4f7d-8cfa-38ed25074a1f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:21.471860 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aa21a3f0-e3f8-4f7d-8cfa-38ed25074a1f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:21.485988 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aa21a3f0-e3f8-4f7d-8cfa-38ed25074a1f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:21.850231 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-aa21a3f0-e3f8-4f7d-8cfa-38ed25074a1f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:21.878263 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-aa21a3f0-e3f8-4f7d-8cfa-38ed25074a1f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1657 microversion: 2.1 time: 0.428312 Oct 04 18:52:21.892926 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2642/5227] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:21 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1657 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:21.904347 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c4f888ab-83f8-4d84-ba88-62ba026c4158 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:52:21.905886 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c4f888ab-83f8-4d84-ba88-62ba026c4158 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:21.920920 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c4f888ab-83f8-4d84-ba88-62ba026c4158 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:21.928604 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c4f888ab-83f8-4d84-ba88-62ba026c4158 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:21.929875 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c4f888ab-83f8-4d84-ba88-62ba026c4158 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:21.932472 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c4f888ab-83f8-4d84-ba88-62ba026c4158 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:21.934009 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c4f888ab-83f8-4d84-ba88-62ba026c4158 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:21.934683 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c4f888ab-83f8-4d84-ba88-62ba026c4158 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:22.258048 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c4f888ab-83f8-4d84-ba88-62ba026c4158 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "POST /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238/action" status: 202 len: 0 microversion: 2.1 time: 0.357472 Oct 04 18:52:22.260390 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2586/5228] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:52:21 2022] POST /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238/action => generated 0 bytes in 361 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:52:22.272344 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-dacfeb49-def0-4586-81a7-f37e0e31b692 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:22.275134 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-dacfeb49-def0-4586-81a7-f37e0e31b692 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:22.296230 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3351e3fe-2fa0-4039-a7cb-2a254fc973ff tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:22.296952 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3351e3fe-2fa0-4039-a7cb-2a254fc973ff tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9eaa25a-0821-47fb-a16e-d07bcde9cc60] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:22.298971 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dacfeb49-def0-4586-81a7-f37e0e31b692 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:22.299764 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dacfeb49-def0-4586-81a7-f37e0e31b692 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:22.304010 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dacfeb49-def0-4586-81a7-f37e0e31b692 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:22.314718 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dacfeb49-def0-4586-81a7-f37e0e31b692 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:22.317234 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dacfeb49-def0-4586-81a7-f37e0e31b692 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:22.317690 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dacfeb49-def0-4586-81a7-f37e0e31b692 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:22.329428 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3351e3fe-2fa0-4039-a7cb-2a254fc973ff tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:22.329853 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3351e3fe-2fa0-4039-a7cb-2a254fc973ff tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:22.330285 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3351e3fe-2fa0-4039-a7cb-2a254fc973ff tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:22.331000 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3351e3fe-2fa0-4039-a7cb-2a254fc973ff tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:22.336620 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3351e3fe-2fa0-4039-a7cb-2a254fc973ff tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:22.337947 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3351e3fe-2fa0-4039-a7cb-2a254fc973ff tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:22.478750 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=4,nova_cell1:UPDATE=6 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:52:22.893826 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3351e3fe-2fa0-4039-a7cb-2a254fc973ff tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:22.908118 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3351e3fe-2fa0-4039-a7cb-2a254fc973ff tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60" status: 200 len: 1522 microversion: 2.1 time: 0.628263 Oct 04 18:52:22.924319 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2587/5229] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:22 2022] GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60 => generated 1522 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:22.940181 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-dacfeb49-def0-4586-81a7-f37e0e31b692 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:22.950882 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-dacfeb49-def0-4586-81a7-f37e0e31b692 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1664 microversion: 2.1 time: 0.685970 Oct 04 18:52:22.951552 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2643/5230] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:22 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1664 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:23.936319 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-15f3cb87-07a7-460f-9a3a-1ac922d8987d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:23.937282 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-15f3cb87-07a7-460f-9a3a-1ac922d8987d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9eaa25a-0821-47fb-a16e-d07bcde9cc60] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:23.963336 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-15f3cb87-07a7-460f-9a3a-1ac922d8987d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:23.966166 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-15f3cb87-07a7-460f-9a3a-1ac922d8987d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:23.978514 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f33a1774-5873-49a0-b061-817dbbc94703 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:23.979731 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f33a1774-5873-49a0-b061-817dbbc94703 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:23.984013 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-15f3cb87-07a7-460f-9a3a-1ac922d8987d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:23.990678 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-15f3cb87-07a7-460f-9a3a-1ac922d8987d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:23.993554 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-15f3cb87-07a7-460f-9a3a-1ac922d8987d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:23.997290 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-15f3cb87-07a7-460f-9a3a-1ac922d8987d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:24.009245 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f33a1774-5873-49a0-b061-817dbbc94703 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:24.009726 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f33a1774-5873-49a0-b061-817dbbc94703 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:24.010185 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f33a1774-5873-49a0-b061-817dbbc94703 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:24.019818 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f33a1774-5873-49a0-b061-817dbbc94703 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:24.021054 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f33a1774-5873-49a0-b061-817dbbc94703 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:24.031122 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f33a1774-5873-49a0-b061-817dbbc94703 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:24.510693 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-15f3cb87-07a7-460f-9a3a-1ac922d8987d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:24.530089 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f33a1774-5873-49a0-b061-817dbbc94703 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:24.538712 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f33a1774-5873-49a0-b061-817dbbc94703 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1672 microversion: 2.1 time: 0.566221 Oct 04 18:52:24.539713 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-15f3cb87-07a7-460f-9a3a-1ac922d8987d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60" status: 200 len: 1522 microversion: 2.1 time: 0.605494 Oct 04 18:52:24.541171 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2588/5231] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:23 2022] GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60 => generated 1522 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:24.541888 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2644/5232] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:23 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1672 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:24.576912 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7a5ca47d-692f-4e35-8076-586b43050780 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:24.578105 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7a5ca47d-692f-4e35-8076-586b43050780 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:24.593740 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7a5ca47d-692f-4e35-8076-586b43050780 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:24.594422 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7a5ca47d-692f-4e35-8076-586b43050780 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:24.600589 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7a5ca47d-692f-4e35-8076-586b43050780 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:24.600589 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7a5ca47d-692f-4e35-8076-586b43050780 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:24.600589 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7a5ca47d-692f-4e35-8076-586b43050780 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:24.608532 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7a5ca47d-692f-4e35-8076-586b43050780 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:24.842048 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7a5ca47d-692f-4e35-8076-586b43050780 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:24.861027 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7a5ca47d-692f-4e35-8076-586b43050780 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1672 microversion: 2.1 time: 0.288749 Oct 04 18:52:24.867026 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2589/5233] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:24 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1672 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:24.893598 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5db2919b-de57-45a9-b214-465c8629a825 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:24.893598 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5db2919b-de57-45a9-b214-465c8629a825 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:24.901019 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5db2919b-de57-45a9-b214-465c8629a825 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:24.901837 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5db2919b-de57-45a9-b214-465c8629a825 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:24.902682 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5db2919b-de57-45a9-b214-465c8629a825 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:24.903949 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5db2919b-de57-45a9-b214-465c8629a825 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:24.904625 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5db2919b-de57-45a9-b214-465c8629a825 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:24.905375 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5db2919b-de57-45a9-b214-465c8629a825 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:25.182621 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5db2919b-de57-45a9-b214-465c8629a825 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:25.195068 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5db2919b-de57-45a9-b214-465c8629a825 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1672 microversion: 2.1 time: 0.311832 Oct 04 18:52:25.196024 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2645/5234] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:24 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1672 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:25.220380 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f1065f7c-a35e-4425-b796-d94aedd8170a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:25.221006 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f1065f7c-a35e-4425-b796-d94aedd8170a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:25.234335 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f1065f7c-a35e-4425-b796-d94aedd8170a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:25.235158 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f1065f7c-a35e-4425-b796-d94aedd8170a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:25.235839 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f1065f7c-a35e-4425-b796-d94aedd8170a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:25.236816 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f1065f7c-a35e-4425-b796-d94aedd8170a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:25.237659 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f1065f7c-a35e-4425-b796-d94aedd8170a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:25.238395 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f1065f7c-a35e-4425-b796-d94aedd8170a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:25.569574 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b8b67cd3-f8a7-4133-a8d6-0fd4a87b6f38 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:25.570415 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b8b67cd3-f8a7-4133-a8d6-0fd4a87b6f38 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9eaa25a-0821-47fb-a16e-d07bcde9cc60] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:25.585860 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b8b67cd3-f8a7-4133-a8d6-0fd4a87b6f38 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:25.590928 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b8b67cd3-f8a7-4133-a8d6-0fd4a87b6f38 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:25.591710 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b8b67cd3-f8a7-4133-a8d6-0fd4a87b6f38 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:25.592607 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b8b67cd3-f8a7-4133-a8d6-0fd4a87b6f38 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:25.593197 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b8b67cd3-f8a7-4133-a8d6-0fd4a87b6f38 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:25.593760 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b8b67cd3-f8a7-4133-a8d6-0fd4a87b6f38 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:25.855055 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f1065f7c-a35e-4425-b796-d94aedd8170a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:25.872397 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f1065f7c-a35e-4425-b796-d94aedd8170a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1672 microversion: 2.1 time: 0.654017 Oct 04 18:52:25.876557 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2590/5235] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:25 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1672 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:25.900109 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-fa50f28d-b660-43cd-9030-04e33405cbdc tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:25.900109 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-fa50f28d-b660-43cd-9030-04e33405cbdc tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:25.907886 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fa50f28d-b660-43cd-9030-04e33405cbdc tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:25.908802 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fa50f28d-b660-43cd-9030-04e33405cbdc tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:25.909501 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fa50f28d-b660-43cd-9030-04e33405cbdc tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:25.910468 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fa50f28d-b660-43cd-9030-04e33405cbdc tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:25.911146 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fa50f28d-b660-43cd-9030-04e33405cbdc tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:25.911843 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fa50f28d-b660-43cd-9030-04e33405cbdc tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:26.142192 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b8b67cd3-f8a7-4133-a8d6-0fd4a87b6f38 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:26.160532 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:52:26.177376 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b8b67cd3-f8a7-4133-a8d6-0fd4a87b6f38 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60" status: 200 len: 1522 microversion: 2.1 time: 0.612983 Oct 04 18:52:26.178159 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2646/5236] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:25 2022] GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60 => generated 1522 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:26.301429 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-fa50f28d-b660-43cd-9030-04e33405cbdc tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:26.311234 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-fa50f28d-b660-43cd-9030-04e33405cbdc tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1672 microversion: 2.1 time: 0.417881 Oct 04 18:52:26.316424 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2591/5237] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:25 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1672 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:52:26.345879 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-703a79b1-f320-4e56-9de8-c138ddacb9b1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:26.347318 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-703a79b1-f320-4e56-9de8-c138ddacb9b1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:26.364400 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-703a79b1-f320-4e56-9de8-c138ddacb9b1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:26.364400 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-703a79b1-f320-4e56-9de8-c138ddacb9b1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:26.364400 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-703a79b1-f320-4e56-9de8-c138ddacb9b1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:26.364400 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-703a79b1-f320-4e56-9de8-c138ddacb9b1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:26.364400 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-703a79b1-f320-4e56-9de8-c138ddacb9b1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:26.366030 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-703a79b1-f320-4e56-9de8-c138ddacb9b1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:26.637550 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-703a79b1-f320-4e56-9de8-c138ddacb9b1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:26.646533 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-703a79b1-f320-4e56-9de8-c138ddacb9b1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1672 microversion: 2.1 time: 0.306857 Oct 04 18:52:26.659743 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2647/5238] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:26 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1672 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:27.205112 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-44342b93-ce87-47dd-811d-6c0081c89ae5 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:27.205112 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-44342b93-ce87-47dd-811d-6c0081c89ae5 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9eaa25a-0821-47fb-a16e-d07bcde9cc60] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:27.217646 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-44342b93-ce87-47dd-811d-6c0081c89ae5 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:27.220352 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-44342b93-ce87-47dd-811d-6c0081c89ae5 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:27.224469 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-44342b93-ce87-47dd-811d-6c0081c89ae5 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:27.226812 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-44342b93-ce87-47dd-811d-6c0081c89ae5 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:27.230038 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-44342b93-ce87-47dd-811d-6c0081c89ae5 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:27.233669 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-44342b93-ce87-47dd-811d-6c0081c89ae5 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:27.578235 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-44342b93-ce87-47dd-811d-6c0081c89ae5 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:27.592399 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-44342b93-ce87-47dd-811d-6c0081c89ae5 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60" status: 200 len: 1522 microversion: 2.1 time: 0.393574 Oct 04 18:52:27.593412 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2592/5239] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:27 2022] GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60 => generated 1522 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:28.619321 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-501aadb3-919e-4492-8b9c-4878e0552399 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:28.620681 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-501aadb3-919e-4492-8b9c-4878e0552399 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9eaa25a-0821-47fb-a16e-d07bcde9cc60] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:28.640006 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-501aadb3-919e-4492-8b9c-4878e0552399 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:28.640689 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-501aadb3-919e-4492-8b9c-4878e0552399 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:28.641404 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-501aadb3-919e-4492-8b9c-4878e0552399 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:28.644952 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-501aadb3-919e-4492-8b9c-4878e0552399 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:28.645690 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-501aadb3-919e-4492-8b9c-4878e0552399 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:28.647181 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-501aadb3-919e-4492-8b9c-4878e0552399 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:28.909715 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-501aadb3-919e-4492-8b9c-4878e0552399 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:28.925482 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-501aadb3-919e-4492-8b9c-4878e0552399 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60" status: 200 len: 1522 microversion: 2.1 time: 0.310726 Oct 04 18:52:28.929946 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2648/5240] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:28 2022] GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60 => generated 1522 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:29.953468 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a66c28c4-50e5-49c4-9260-5cb711d9911c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:29.954199 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a66c28c4-50e5-49c4-9260-5cb711d9911c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9eaa25a-0821-47fb-a16e-d07bcde9cc60] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:29.966917 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a66c28c4-50e5-49c4-9260-5cb711d9911c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:29.967431 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a66c28c4-50e5-49c4-9260-5cb711d9911c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:29.967872 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a66c28c4-50e5-49c4-9260-5cb711d9911c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:29.968628 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a66c28c4-50e5-49c4-9260-5cb711d9911c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:29.969090 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a66c28c4-50e5-49c4-9260-5cb711d9911c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:29.969523 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a66c28c4-50e5-49c4-9260-5cb711d9911c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:30.396153 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a66c28c4-50e5-49c4-9260-5cb711d9911c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:30.419114 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a66c28c4-50e5-49c4-9260-5cb711d9911c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60" status: 200 len: 1522 microversion: 2.1 time: 0.469348 Oct 04 18:52:30.420769 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2593/5241] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:29 2022] GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60 => generated 1522 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:31.447607 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9a93141b-0a52-46bf-9e6b-223e90cbdff3 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:31.448976 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-9a93141b-0a52-46bf-9e6b-223e90cbdff3 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9eaa25a-0821-47fb-a16e-d07bcde9cc60] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:31.458232 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9a93141b-0a52-46bf-9e6b-223e90cbdff3 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:31.459166 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9a93141b-0a52-46bf-9e6b-223e90cbdff3 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:31.460880 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9a93141b-0a52-46bf-9e6b-223e90cbdff3 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:31.460880 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9a93141b-0a52-46bf-9e6b-223e90cbdff3 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:31.462133 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9a93141b-0a52-46bf-9e6b-223e90cbdff3 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:31.462937 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9a93141b-0a52-46bf-9e6b-223e90cbdff3 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:31.760452 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9a93141b-0a52-46bf-9e6b-223e90cbdff3 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:31.773490 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9a93141b-0a52-46bf-9e6b-223e90cbdff3 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60" status: 200 len: 1522 microversion: 2.1 time: 0.332768 Oct 04 18:52:31.776722 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2649/5242] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:31 2022] GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60 => generated 1522 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:32.809640 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-220142d3-5e63-431a-9ba0-040a81959484 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:32.811282 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-220142d3-5e63-431a-9ba0-040a81959484 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9eaa25a-0821-47fb-a16e-d07bcde9cc60] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:32.822502 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=70 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:52:32.824808 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-220142d3-5e63-431a-9ba0-040a81959484 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:32.825467 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-220142d3-5e63-431a-9ba0-040a81959484 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:32.826102 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-220142d3-5e63-431a-9ba0-040a81959484 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:32.827481 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-220142d3-5e63-431a-9ba0-040a81959484 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:32.829243 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-220142d3-5e63-431a-9ba0-040a81959484 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:32.830206 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-220142d3-5e63-431a-9ba0-040a81959484 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:33.264280 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-220142d3-5e63-431a-9ba0-040a81959484 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:33.274921 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-220142d3-5e63-431a-9ba0-040a81959484 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60" status: 200 len: 1504 microversion: 2.1 time: 0.474906 Oct 04 18:52:33.278053 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2594/5243] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:32 2022] GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60 => generated 1504 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:52:34.311656 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6d207a08-4cc7-4dea-9c13-c8cce38092e1 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:34.313353 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6d207a08-4cc7-4dea-9c13-c8cce38092e1 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9eaa25a-0821-47fb-a16e-d07bcde9cc60] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:34.323571 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6d207a08-4cc7-4dea-9c13-c8cce38092e1 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:34.335415 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6d207a08-4cc7-4dea-9c13-c8cce38092e1 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:34.349815 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6d207a08-4cc7-4dea-9c13-c8cce38092e1 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:34.357291 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6d207a08-4cc7-4dea-9c13-c8cce38092e1 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:34.358135 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6d207a08-4cc7-4dea-9c13-c8cce38092e1 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:34.360533 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6d207a08-4cc7-4dea-9c13-c8cce38092e1 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:34.669712 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6d207a08-4cc7-4dea-9c13-c8cce38092e1 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:34.679382 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6d207a08-4cc7-4dea-9c13-c8cce38092e1 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60" status: 200 len: 1504 microversion: 2.1 time: 0.373768 Oct 04 18:52:34.696743 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2650/5244] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:34 2022] GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60 => generated 1504 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:35.707793 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-09b9a3f4-5e96-4ad5-a5e6-60450170dbe7 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:35.709461 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-09b9a3f4-5e96-4ad5-a5e6-60450170dbe7 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9eaa25a-0821-47fb-a16e-d07bcde9cc60] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:35.729357 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-09b9a3f4-5e96-4ad5-a5e6-60450170dbe7 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:35.734038 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-09b9a3f4-5e96-4ad5-a5e6-60450170dbe7 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:35.734038 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-09b9a3f4-5e96-4ad5-a5e6-60450170dbe7 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:35.734318 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-09b9a3f4-5e96-4ad5-a5e6-60450170dbe7 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:35.735902 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-09b9a3f4-5e96-4ad5-a5e6-60450170dbe7 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:35.737984 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-09b9a3f4-5e96-4ad5-a5e6-60450170dbe7 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:35.815947 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-97292473-9051-468c-ab1a-04d55fe41342 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1655344081", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "208dc67a-0b06-478b-aa19-f7d0ebfb448f"}]}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:52:35.921368 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-97292473-9051-468c-ab1a-04d55fe41342 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] validate_networks() for [('208dc67a-0b06-478b-aa19-f7d0ebfb448f', None, None, None, None, None)] {{(pid=123002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:52:36.264606 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-09b9a3f4-5e96-4ad5-a5e6-60450170dbe7 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:36.273014 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-09b9a3f4-5e96-4ad5-a5e6-60450170dbe7 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60" status: 200 len: 1507 microversion: 2.1 time: 0.569512 Oct 04 18:52:36.273621 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2651/5245] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:35 2022] GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60 => generated 1507 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:36.278482 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-12764ba2-495a-476e-910c-3f322b658c55 req-63532500-6c87-4490-ad2c-74b223ea5754 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9eaa25a-0821-47fb-a16e-d07bcde9cc60", "name": "network-vif-unplugged", "status": "completed", "tag": "b323ea97-81a2-4778-8096-32e05d6f2440"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:52:36.326987 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-12764ba2-495a-476e-910c-3f322b658c55 req-63532500-6c87-4490-ad2c-74b223ea5754 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:36.335266 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-12764ba2-495a-476e-910c-3f322b658c55 req-63532500-6c87-4490-ad2c-74b223ea5754 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:36.335688 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-12764ba2-495a-476e-910c-3f322b658c55 req-63532500-6c87-4490-ad2c-74b223ea5754 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:36.391115 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-12764ba2-495a-476e-910c-3f322b658c55 req-63532500-6c87-4490-ad2c-74b223ea5754 service nova] Creating event network-vif-unplugged:b323ea97-81a2-4778-8096-32e05d6f2440 for instance a9eaa25a-0821-47fb-a16e-d07bcde9cc60 on n-h2-850501-14 Oct 04 18:52:36.404862 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-12764ba2-495a-476e-910c-3f322b658c55 req-63532500-6c87-4490-ad2c-74b223ea5754 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.128284 Oct 04 18:52:36.407401 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2652/5246] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:52:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:52:36.430255 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b6a10cc7-2182-422f-a344-e9ceff386021 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:36.430882 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b6a10cc7-2182-422f-a344-e9ceff386021 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9eaa25a-0821-47fb-a16e-d07bcde9cc60] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:36.449299 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b6a10cc7-2182-422f-a344-e9ceff386021 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:36.453562 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b6a10cc7-2182-422f-a344-e9ceff386021 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:36.453562 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b6a10cc7-2182-422f-a344-e9ceff386021 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:36.453562 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b6a10cc7-2182-422f-a344-e9ceff386021 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:36.457587 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b6a10cc7-2182-422f-a344-e9ceff386021 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:36.458378 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b6a10cc7-2182-422f-a344-e9ceff386021 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:36.531929 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b6a10cc7-2182-422f-a344-e9ceff386021 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9eaa25a-0821-47fb-a16e-d07bcde9cc60] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:52:36.550420 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.compute.api [None req-b6a10cc7-2182-422f-a344-e9ceff386021 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9eaa25a-0821-47fb-a16e-d07bcde9cc60] Working on deleting snapshot e6184d4e-79fd-4a3f-a98f-fe1c8b0d255e from shelved instance... Oct 04 18:52:37.010609 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-97292473-9051-468c-ab1a-04d55fe41342 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:52:37.011153 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-97292473-9051-468c-ab1a-04d55fe41342 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:52:37.011725 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-97292473-9051-468c-ab1a-04d55fe41342 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:52:37.012288 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-97292473-9051-468c-ab1a-04d55fe41342 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:52:37.013669 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-97292473-9051-468c-ab1a-04d55fe41342 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:52:37.035333 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-97292473-9051-468c-ab1a-04d55fe41342 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:37.038089 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-97292473-9051-468c-ab1a-04d55fe41342 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:37.038721 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-97292473-9051-468c-ab1a-04d55fe41342 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:37.040375 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-97292473-9051-468c-ab1a-04d55fe41342 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:37.041057 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-97292473-9051-468c-ab1a-04d55fe41342 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:37.047214 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-97292473-9051-468c-ab1a-04d55fe41342 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:37.070842 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-97292473-9051-468c-ab1a-04d55fe41342 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Getting quotas for project 9d3bae1b8ffa4fdb8a3be402743fbca6. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:52:37.077298 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-97292473-9051-468c-ab1a-04d55fe41342 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Getting quotas for user ec940f2051b647afb6436356e773a769 and project 9d3bae1b8ffa4fdb8a3be402743fbca6. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:52:37.111429 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-97292473-9051-468c-ab1a-04d55fe41342 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Going to run 3 instances... {{(pid=123002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:52:37.113864 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-97292473-9051-468c-ab1a-04d55fe41342 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] [instance: 4267e7a6-74c2-4509-9d96-6a8075236937] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:52:37.337831 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-97292473-9051-468c-ab1a-04d55fe41342 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] [instance: 1236cea0-3e65-4b7d-861d-eb75d62a5af2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=4267e7a6-74c2-4509-9d96-6a8075236937,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:52:37.551527 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-97292473-9051-468c-ab1a-04d55fe41342 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] [instance: e1f035f0-277f-403b-973c-fe337e16ccae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=1236cea0-3e65-4b7d-861d-eb75d62a5af2,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:52:37.774732 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-97292473-9051-468c-ab1a-04d55fe41342 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.174348 Oct 04 18:52:37.775334 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2595/5247] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:52:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 2176 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:52:37.786715 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-65dc79a8-3f2c-48c8-88bb-d49bb4a895a4 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:37.793538 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-65dc79a8-3f2c-48c8-88bb-d49bb4a895a4 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ec940f2051b647afb6436356e773a769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3bae1b8ffa4fdb8a3be402743fbca6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:37.794508 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-65dc79a8-3f2c-48c8-88bb-d49bb4a895a4 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Searching by: {'deleted': False, 'project_id': '9d3bae1b8ffa4fdb8a3be402743fbca6'} {{(pid=123002) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:52:37.828139 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-65dc79a8-3f2c-48c8-88bb-d49bb4a895a4 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:37.830022 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-65dc79a8-3f2c-48c8-88bb-d49bb4a895a4 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:37.830761 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-65dc79a8-3f2c-48c8-88bb-d49bb4a895a4 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:37.831807 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-65dc79a8-3f2c-48c8-88bb-d49bb4a895a4 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:37.832445 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-65dc79a8-3f2c-48c8-88bb-d49bb4a895a4 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:37.833024 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-65dc79a8-3f2c-48c8-88bb-d49bb4a895a4 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:37.856770 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-65dc79a8-3f2c-48c8-88bb-d49bb4a895a4 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.074020 Oct 04 18:52:37.857969 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2596/5248] 10.222.0.20 () {58 vars in 1125 bytes} [Tue Oct 4 18:52:37 2022] GET /compute/v2.1/servers => generated 1018 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:52:37.878955 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d52d295d-aaf1-458a-a3e6-72da32165211 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:37.884438 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d52d295d-aaf1-458a-a3e6-72da32165211 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] [instance: e1f035f0-277f-403b-973c-fe337e16ccae] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:37.999276 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d52d295d-aaf1-458a-a3e6-72da32165211 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec940f2051b647afb6436356e773a769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3bae1b8ffa4fdb8a3be402743fbca6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:38.016048 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d52d295d-aaf1-458a-a3e6-72da32165211 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] 10.222.0.20 "GET /compute/v2.1/servers/e1f035f0-277f-403b-973c-fe337e16ccae" status: 200 len: 1223 microversion: 2.1 time: 0.150053 Oct 04 18:52:38.017604 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2597/5249] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:37 2022] GET /compute/v2.1/servers/e1f035f0-277f-403b-973c-fe337e16ccae => generated 1223 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:39.038496 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b6a10cc7-2182-422f-a344-e9ceff386021 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9eaa25a-0821-47fb-a16e-d07bcde9cc60] Doing local delete in cell a6039a6d-a98c-44a9-819b-4eff388d8aa7(cell1) {{(pid=123001) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 04 18:52:39.041738 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b6a10cc7-2182-422f-a344-e9ceff386021 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:39.044027 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b6a10cc7-2182-422f-a344-e9ceff386021 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:39.044512 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b6a10cc7-2182-422f-a344-e9ceff386021 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:39.044640 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1b2804fc-5e97-4075-b51f-5d07c2047ef2 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:39.049570 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1b2804fc-5e97-4075-b51f-5d07c2047ef2 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] [instance: e1f035f0-277f-403b-973c-fe337e16ccae] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:39.050196 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.compute.api [None req-b6a10cc7-2182-422f-a344-e9ceff386021 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9eaa25a-0821-47fb-a16e-d07bcde9cc60] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 04 18:52:39.056763 n-d-850501-14 devstack@n-api.service[123001]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b6a10cc7-2182-422f-a344-e9ceff386021 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [6c8ce3ae-b440-4b28-996b-33b11441f461] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 18:52:39.229286 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1b2804fc-5e97-4075-b51f-5d07c2047ef2 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec940f2051b647afb6436356e773a769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3bae1b8ffa4fdb8a3be402743fbca6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:39.238911 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1b2804fc-5e97-4075-b51f-5d07c2047ef2 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] 10.222.0.20 "GET /compute/v2.1/servers/e1f035f0-277f-403b-973c-fe337e16ccae" status: 200 len: 1223 microversion: 2.1 time: 0.199800 Oct 04 18:52:39.241560 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2598/5250] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:39 2022] GET /compute/v2.1/servers/e1f035f0-277f-403b-973c-fe337e16ccae => generated 1223 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:40.069114 n-d-850501-14 devstack@n-api.service[123001]: INFO oslo.messaging._drivers.impl_rabbit [None req-b6a10cc7-2182-422f-a344-e9ceff386021 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [6c8ce3ae-b440-4b28-996b-33b11441f461] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 43592. Oct 04 18:52:40.079079 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.neutron [None req-b6a10cc7-2182-422f-a344-e9ceff386021 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9eaa25a-0821-47fb-a16e-d07bcde9cc60] deallocate_for_instance() {{(pid=123001) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 04 18:52:40.272741 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0e82f385-95c0-4616-91fd-aa43f8b6c126 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:40.275042 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0e82f385-95c0-4616-91fd-aa43f8b6c126 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] [instance: e1f035f0-277f-403b-973c-fe337e16ccae] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:40.378757 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0e82f385-95c0-4616-91fd-aa43f8b6c126 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec940f2051b647afb6436356e773a769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3bae1b8ffa4fdb8a3be402743fbca6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:40.387636 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0e82f385-95c0-4616-91fd-aa43f8b6c126 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] 10.222.0.20 "GET /compute/v2.1/servers/e1f035f0-277f-403b-973c-fe337e16ccae" status: 200 len: 1223 microversion: 2.1 time: 0.126877 Oct 04 18:52:40.391428 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2599/5251] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:40 2022] GET /compute/v2.1/servers/e1f035f0-277f-403b-973c-fe337e16ccae => generated 1223 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:41.439309 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.neutron [None req-b6a10cc7-2182-422f-a344-e9ceff386021 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9eaa25a-0821-47fb-a16e-d07bcde9cc60] Updating instance_info_cache with network_info: [] {{(pid=123001) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 18:52:41.672127 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-ec2d956b-029a-4ba0-881b-2375e813c6ed req-8547c837-452f-47a9-ae66-cfb851de1670 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9eaa25a-0821-47fb-a16e-d07bcde9cc60", "name": "network-vif-deleted", "tag": "b323ea97-81a2-4778-8096-32e05d6f2440"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:52:41.693276 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-ec2d956b-029a-4ba0-881b-2375e813c6ed req-8547c837-452f-47a9-ae66-cfb851de1670 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:41.693768 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-ec2d956b-029a-4ba0-881b-2375e813c6ed req-8547c837-452f-47a9-ae66-cfb851de1670 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:41.698140 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-ec2d956b-029a-4ba0-881b-2375e813c6ed req-8547c837-452f-47a9-ae66-cfb851de1670 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:41.716280 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.compute.server_external_events [req-ec2d956b-029a-4ba0-881b-2375e813c6ed req-8547c837-452f-47a9-ae66-cfb851de1670 service nova] Unable to find a host for instance a9eaa25a-0821-47fb-a16e-d07bcde9cc60. Dropping event network-vif-deleted {{(pid=123002) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 04 18:52:41.717603 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-ec2d956b-029a-4ba0-881b-2375e813c6ed req-8547c837-452f-47a9-ae66-cfb851de1670 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.403882 Oct 04 18:52:41.718375 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2600/5252] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:52:41 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 406 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 04 18:52:41.738594 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7928d390-fe45-40d5-9334-e9df37c366ab tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:41.739559 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7928d390-fe45-40d5-9334-e9df37c366ab tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] [instance: e1f035f0-277f-403b-973c-fe337e16ccae] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:41.748434 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7928d390-fe45-40d5-9334-e9df37c366ab tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:41.752584 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7928d390-fe45-40d5-9334-e9df37c366ab tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:41.752584 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7928d390-fe45-40d5-9334-e9df37c366ab tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:41.752584 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7928d390-fe45-40d5-9334-e9df37c366ab tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:41.752584 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7928d390-fe45-40d5-9334-e9df37c366ab tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:41.752584 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7928d390-fe45-40d5-9334-e9df37c366ab tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:41.919454 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7928d390-fe45-40d5-9334-e9df37c366ab tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec940f2051b647afb6436356e773a769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3bae1b8ffa4fdb8a3be402743fbca6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:41.936979 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7928d390-fe45-40d5-9334-e9df37c366ab tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] 10.222.0.20 "GET /compute/v2.1/servers/e1f035f0-277f-403b-973c-fe337e16ccae" status: 200 len: 1227 microversion: 2.1 time: 0.202352 Oct 04 18:52:41.937596 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2601/5253] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:41 2022] GET /compute/v2.1/servers/e1f035f0-277f-403b-973c-fe337e16ccae => generated 1227 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:42.152973 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=48 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:52:42.440796 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b6a10cc7-2182-422f-a344-e9ceff386021 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60" status: 204 len: 0 microversion: 2.1 time: 6.033336 Oct 04 18:52:42.443845 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2653/5254] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:52:36 2022] DELETE /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60 => generated 0 bytes in 6035 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:52:42.455307 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c7ecabb5-9af9-4ab2-9d7f-606d8efd6e81 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:42.456505 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c7ecabb5-9af9-4ab2-9d7f-606d8efd6e81 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9eaa25a-0821-47fb-a16e-d07bcde9cc60] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:42.468134 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c7ecabb5-9af9-4ab2-9d7f-606d8efd6e81 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:42.472519 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c7ecabb5-9af9-4ab2-9d7f-606d8efd6e81 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:42.472519 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c7ecabb5-9af9-4ab2-9d7f-606d8efd6e81 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:42.472519 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c7ecabb5-9af9-4ab2-9d7f-606d8efd6e81 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:42.472519 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c7ecabb5-9af9-4ab2-9d7f-606d8efd6e81 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:42.472519 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c7ecabb5-9af9-4ab2-9d7f-606d8efd6e81 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:42.501428 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-c7ecabb5-9af9-4ab2-9d7f-606d8efd6e81 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] HTTP exception thrown: Instance a9eaa25a-0821-47fb-a16e-d07bcde9cc60 could not be found. Oct 04 18:52:42.501428 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c7ecabb5-9af9-4ab2-9d7f-606d8efd6e81 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Request method failure captured: Oct 04 18:52:42.501428 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60 HTTP/1.1 Oct 04 18:52:42.501428 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:52:42.501428 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:52:42.501428 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:52:42.501428 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:52:42.501428 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:52:42.501428 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:52:42.501428 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:52:42.501428 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:52:42.501428 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPIAZ5RZP-L2AfGhXbSAirsikFtiKRJw8GbD2F4avTn6csTjPvYW4EgckMMa_odYrXTBqTIarrxxpsgj83P_nCf0n9cSTNLxyj6f4zISS1Nx3NxppTvrxz8bw1hclhfH5hpAMl_7yiEWC9J95Zeea4ou_80fw0GmE8GZRBOxEg7cn1lU Oct 04 18:52:42.501428 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:52:42.501428 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:52:42.501428 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:52:42.501428 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:52:42.501428 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:52:42.501428 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:52:42.501428 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 4154ec20e0354ee6a425ba853b8efe67 Oct 04 18:52:42.501428 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-DeleteServersTestJSON-806460860 Oct 04 18:52:42.501428 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:52:42.501428 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:52:42.501428 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4154ec20e0354ee6a425ba853b8efe67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4154ec20e0354ee6a425ba853b8efe67", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4154ec20e0354ee6a425ba853b8efe67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4154ec20e0354ee6a425ba853b8efe67"}]}] Oct 04 18:52:42.501428 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-DeleteServersTestJSON-806460860 Oct 04 18:52:42.501428 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 4154ec20e0354ee6a425ba853b8efe67 Oct 04 18:52:42.501428 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-DeleteServersTestJSON-806460860 Oct 04 18:52:42.501428 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-DeleteServersTestJSON-806460860-project Oct 04 18:52:42.501428 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:52:42.501428 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:52:42.501428 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: c56b67cede6b46f5a36a723d361b3245 Oct 04 18:52:42.501428 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-DeleteServersTestJSON-806460860-project Oct 04 18:52:42.501428 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:52:42.501428 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance a9eaa25a-0821-47fb-a16e-d07bcde9cc60 could not be found. Oct 04 18:52:42.501428 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'a9eaa25a-0821-47fb-a16e-d07bcde9cc60'} Oct 04 18:52:42.501428 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:52:42.501428 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:42.501428 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:52:42.501428 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:52:42.501428 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:52:42.501428 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:52:42.501428 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:52:42.501428 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:52:42.501428 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:52:42.501428 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:52:42.501428 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9eaa25a-0821-47fb-a16e-d07bcde9cc60 could not be found. Oct 04 18:52:42.501428 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:52:42.501428 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:52:42.501428 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:52:42.501428 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:42.501428 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:52:42.501428 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:52:42.501428 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:52:42.501428 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:52:42.501428 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:52:42.501428 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:52:42.501428 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:52:42.501428 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:52:42.501428 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:52:42.501428 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:52:42.501428 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:52:42.501428 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:52:42.507415 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9eaa25a-0821-47fb-a16e-d07bcde9cc60 could not be found. Oct 04 18:52:42.507415 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:52:42.507415 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:52:42.507415 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:52:42.507415 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:42.507415 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:52:42.507415 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:52:42.507415 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:52:42.507415 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:52:42.507415 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9eaa25a-0821-47fb-a16e-d07bcde9cc60 could not be found. Oct 04 18:52:42.507415 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:52:42.511241 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c7ecabb5-9af9-4ab2-9d7f-606d8efd6e81 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Returning 404 to user: Instance a9eaa25a-0821-47fb-a16e-d07bcde9cc60 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:52:42.526388 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c7ecabb5-9af9-4ab2-9d7f-606d8efd6e81 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60" status: 404 len: 111 microversion: 2.1 time: 0.064420 Oct 04 18:52:42.544393 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2602/5255] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:42 2022] GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:52:42.730560 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c7c7e5fd-f47f-444d-96e0-c8f92a65ebb8 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-392522440", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": [{"uuid": "8e684a5f-0995-474b-b515-28954add873e"}]}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:52:42.794153 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.neutron [None req-c7c7e5fd-f47f-444d-96e0-c8f92a65ebb8 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] validate_networks() for [('8e684a5f-0995-474b-b515-28954add873e', None, None, None, None, None)] {{(pid=123001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:52:42.965855 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0343ac0a-1620-42ea-b37e-049c1ebcabc6 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:42.968579 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0343ac0a-1620-42ea-b37e-049c1ebcabc6 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] [instance: e1f035f0-277f-403b-973c-fe337e16ccae] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:42.996927 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0343ac0a-1620-42ea-b37e-049c1ebcabc6 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:42.997077 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0343ac0a-1620-42ea-b37e-049c1ebcabc6 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:42.997469 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0343ac0a-1620-42ea-b37e-049c1ebcabc6 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:42.998185 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0343ac0a-1620-42ea-b37e-049c1ebcabc6 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:42.998643 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0343ac0a-1620-42ea-b37e-049c1ebcabc6 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:42.999071 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0343ac0a-1620-42ea-b37e-049c1ebcabc6 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:43.118945 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0343ac0a-1620-42ea-b37e-049c1ebcabc6 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec940f2051b647afb6436356e773a769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3bae1b8ffa4fdb8a3be402743fbca6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:43.129345 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0343ac0a-1620-42ea-b37e-049c1ebcabc6 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] 10.222.0.20 "GET /compute/v2.1/servers/e1f035f0-277f-403b-973c-fe337e16ccae" status: 200 len: 1275 microversion: 2.1 time: 0.170100 Oct 04 18:52:43.148667 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2603/5256] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:42 2022] GET /compute/v2.1/servers/e1f035f0-277f-403b-973c-fe337e16ccae => generated 1275 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:52:43.518939 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-c7c7e5fd-f47f-444d-96e0-c8f92a65ebb8 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:52:43.519462 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-c7c7e5fd-f47f-444d-96e0-c8f92a65ebb8 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:52:43.520016 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-c7c7e5fd-f47f-444d-96e0-c8f92a65ebb8 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:52:43.520585 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-c7c7e5fd-f47f-444d-96e0-c8f92a65ebb8 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:52:43.521100 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-c7c7e5fd-f47f-444d-96e0-c8f92a65ebb8 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:52:43.534069 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c7c7e5fd-f47f-444d-96e0-c8f92a65ebb8 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:43.534974 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c7c7e5fd-f47f-444d-96e0-c8f92a65ebb8 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:43.535681 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c7c7e5fd-f47f-444d-96e0-c8f92a65ebb8 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:43.536697 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c7c7e5fd-f47f-444d-96e0-c8f92a65ebb8 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:43.537404 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c7c7e5fd-f47f-444d-96e0-c8f92a65ebb8 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:43.538101 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c7c7e5fd-f47f-444d-96e0-c8f92a65ebb8 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:43.563703 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-c7c7e5fd-f47f-444d-96e0-c8f92a65ebb8 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Getting quotas for project 4154ec20e0354ee6a425ba853b8efe67. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:52:43.575613 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-c7c7e5fd-f47f-444d-96e0-c8f92a65ebb8 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Getting quotas for user c56b67cede6b46f5a36a723d361b3245 and project 4154ec20e0354ee6a425ba853b8efe67. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:52:43.621065 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c7c7e5fd-f47f-444d-96e0-c8f92a65ebb8 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Going to run 1 instances... {{(pid=123001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:52:43.627704 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c7c7e5fd-f47f-444d-96e0-c8f92a65ebb8 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9afd6ad-3b96-4a57-8301-5da830e674c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:52:43.853057 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c7c7e5fd-f47f-444d-96e0-c8f92a65ebb8 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.127144 Oct 04 18:52:43.890741 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-38b35883-d370-4677-811c-c56faa178afe tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:43.896671 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-38b35883-d370-4677-811c-c56faa178afe tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9afd6ad-3b96-4a57-8301-5da830e674c7] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:43.905079 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2654/5257] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:52:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1179 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 18:52:43.978944 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-38b35883-d370-4677-811c-c56faa178afe tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:43.989331 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-38b35883-d370-4677-811c-c56faa178afe tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7" status: 200 len: 1214 microversion: 2.1 time: 0.127256 Oct 04 18:52:44.001506 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2604/5258] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:43 2022] GET /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7 => generated 1214 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:44.160453 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b6a3c11b-5b51-48e1-8c6d-fab55d5cf9c8 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:44.160921 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b6a3c11b-5b51-48e1-8c6d-fab55d5cf9c8 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] [instance: e1f035f0-277f-403b-973c-fe337e16ccae] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:44.186588 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b6a3c11b-5b51-48e1-8c6d-fab55d5cf9c8 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:44.187027 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b6a3c11b-5b51-48e1-8c6d-fab55d5cf9c8 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:44.190748 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b6a3c11b-5b51-48e1-8c6d-fab55d5cf9c8 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:44.191378 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b6a3c11b-5b51-48e1-8c6d-fab55d5cf9c8 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:44.194118 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b6a3c11b-5b51-48e1-8c6d-fab55d5cf9c8 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:44.194603 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b6a3c11b-5b51-48e1-8c6d-fab55d5cf9c8 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:44.453706 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b6a3c11b-5b51-48e1-8c6d-fab55d5cf9c8 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec940f2051b647afb6436356e773a769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3bae1b8ffa4fdb8a3be402743fbca6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:44.484743 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b6a3c11b-5b51-48e1-8c6d-fab55d5cf9c8 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] 10.222.0.20 "GET /compute/v2.1/servers/e1f035f0-277f-403b-973c-fe337e16ccae" status: 200 len: 1293 microversion: 2.1 time: 0.324223 Oct 04 18:52:44.495399 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2655/5259] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:44 2022] GET /compute/v2.1/servers/e1f035f0-277f-403b-973c-fe337e16ccae => generated 1293 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:45.019020 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5aac66a6-fa57-44d3-9a3c-413f21969db2 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:45.020639 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5aac66a6-fa57-44d3-9a3c-413f21969db2 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9afd6ad-3b96-4a57-8301-5da830e674c7] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:45.146936 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5aac66a6-fa57-44d3-9a3c-413f21969db2 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:45.155953 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5aac66a6-fa57-44d3-9a3c-413f21969db2 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7" status: 200 len: 1214 microversion: 2.1 time: 0.140880 Oct 04 18:52:45.170491 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2605/5260] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:45 2022] GET /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7 => generated 1214 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:45.508153 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7891c978-0656-435f-97e3-771a2184a3e9 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:45.508861 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7891c978-0656-435f-97e3-771a2184a3e9 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] [instance: e1f035f0-277f-403b-973c-fe337e16ccae] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:45.521448 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7891c978-0656-435f-97e3-771a2184a3e9 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:45.521943 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7891c978-0656-435f-97e3-771a2184a3e9 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:45.522385 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7891c978-0656-435f-97e3-771a2184a3e9 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:45.523096 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7891c978-0656-435f-97e3-771a2184a3e9 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:45.523579 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7891c978-0656-435f-97e3-771a2184a3e9 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:45.536470 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7891c978-0656-435f-97e3-771a2184a3e9 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:45.666392 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7891c978-0656-435f-97e3-771a2184a3e9 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec940f2051b647afb6436356e773a769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3bae1b8ffa4fdb8a3be402743fbca6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:45.689492 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7891c978-0656-435f-97e3-771a2184a3e9 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] 10.222.0.20 "GET /compute/v2.1/servers/e1f035f0-277f-403b-973c-fe337e16ccae" status: 200 len: 1281 microversion: 2.1 time: 0.184779 Oct 04 18:52:45.691106 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2656/5261] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:45 2022] GET /compute/v2.1/servers/e1f035f0-277f-403b-973c-fe337e16ccae => generated 1281 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:46.190690 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0b46d407-8c36-4abf-a7e5-70068875f644 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:46.192303 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0b46d407-8c36-4abf-a7e5-70068875f644 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9afd6ad-3b96-4a57-8301-5da830e674c7] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:46.210014 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0b46d407-8c36-4abf-a7e5-70068875f644 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:46.210897 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0b46d407-8c36-4abf-a7e5-70068875f644 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:46.211550 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0b46d407-8c36-4abf-a7e5-70068875f644 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:46.212885 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0b46d407-8c36-4abf-a7e5-70068875f644 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:46.215432 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0b46d407-8c36-4abf-a7e5-70068875f644 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:46.216202 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0b46d407-8c36-4abf-a7e5-70068875f644 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:46.733156 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-524f8616-3f8e-4ad8-8ac4-a710bf1c1f50 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:46.734481 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-524f8616-3f8e-4ad8-8ac4-a710bf1c1f50 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] [instance: e1f035f0-277f-403b-973c-fe337e16ccae] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:46.759945 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-524f8616-3f8e-4ad8-8ac4-a710bf1c1f50 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:46.760536 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-524f8616-3f8e-4ad8-8ac4-a710bf1c1f50 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:46.760991 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-524f8616-3f8e-4ad8-8ac4-a710bf1c1f50 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:46.764976 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-524f8616-3f8e-4ad8-8ac4-a710bf1c1f50 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:46.765787 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-524f8616-3f8e-4ad8-8ac4-a710bf1c1f50 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:46.767436 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-524f8616-3f8e-4ad8-8ac4-a710bf1c1f50 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:46.960804 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0b46d407-8c36-4abf-a7e5-70068875f644 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:46.972860 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0b46d407-8c36-4abf-a7e5-70068875f644 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7" status: 200 len: 1210 microversion: 2.1 time: 0.789830 Oct 04 18:52:46.981904 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2606/5262] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:46 2022] GET /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7 => generated 1210 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:47.565174 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9616abe4-c2ba-47f2-a03d-bb424cdf3d85 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:47.566338 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9616abe4-c2ba-47f2-a03d-bb424cdf3d85 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] [instance: 317c7bd8-4f1e-4210-bb33-087557a1f4d6] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:47.567260 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-524f8616-3f8e-4ad8-8ac4-a710bf1c1f50 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec940f2051b647afb6436356e773a769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3bae1b8ffa4fdb8a3be402743fbca6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:47.576909 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9616abe4-c2ba-47f2-a03d-bb424cdf3d85 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:47.577975 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9616abe4-c2ba-47f2-a03d-bb424cdf3d85 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:47.578869 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9616abe4-c2ba-47f2-a03d-bb424cdf3d85 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:47.579837 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9616abe4-c2ba-47f2-a03d-bb424cdf3d85 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:47.580552 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9616abe4-c2ba-47f2-a03d-bb424cdf3d85 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:47.592367 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9616abe4-c2ba-47f2-a03d-bb424cdf3d85 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:47.608994 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-524f8616-3f8e-4ad8-8ac4-a710bf1c1f50 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] 10.222.0.20 "GET /compute/v2.1/servers/e1f035f0-277f-403b-973c-fe337e16ccae" status: 200 len: 1323 microversion: 2.1 time: 0.885770 Oct 04 18:52:47.611025 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2657/5263] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:46 2022] GET /compute/v2.1/servers/e1f035f0-277f-403b-973c-fe337e16ccae => generated 1323 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:47.621073 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9616abe4-c2ba-47f2-a03d-bb424cdf3d85 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] [instance: 317c7bd8-4f1e-4210-bb33-087557a1f4d6] Going to try to terminate instance {{(pid=123002) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:52:47.845223 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=4 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:52:47.964687 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9616abe4-c2ba-47f2-a03d-bb424cdf3d85 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] 10.222.0.20 "DELETE /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6" status: 204 len: 0 microversion: 2.32 time: 0.981274 Oct 04 18:52:47.965530 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2607/5264] 10.222.0.20 () {60 vars in 1280 bytes} [Tue Oct 4 18:52:46 2022] DELETE /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6 => generated 0 bytes in 983 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:52:47.975642 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7e796928-6813-47f3-9b02-a1062110dcab tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:47.977162 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7e796928-6813-47f3-9b02-a1062110dcab tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] [instance: 317c7bd8-4f1e-4210-bb33-087557a1f4d6] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:47.996086 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7e796928-6813-47f3-9b02-a1062110dcab tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:47.999789 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7e796928-6813-47f3-9b02-a1062110dcab tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:47.999789 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7e796928-6813-47f3-9b02-a1062110dcab tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:47.999789 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7e796928-6813-47f3-9b02-a1062110dcab tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:48.000147 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1c8584df-ed28-4705-b75e-54bb36f97a58 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:48.000312 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1c8584df-ed28-4705-b75e-54bb36f97a58 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9afd6ad-3b96-4a57-8301-5da830e674c7] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:48.000975 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7e796928-6813-47f3-9b02-a1062110dcab tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:48.002206 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7e796928-6813-47f3-9b02-a1062110dcab tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:48.010093 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1c8584df-ed28-4705-b75e-54bb36f97a58 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:48.010604 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1c8584df-ed28-4705-b75e-54bb36f97a58 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:48.012575 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1c8584df-ed28-4705-b75e-54bb36f97a58 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:48.013585 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1c8584df-ed28-4705-b75e-54bb36f97a58 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:48.014236 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1c8584df-ed28-4705-b75e-54bb36f97a58 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:48.014844 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1c8584df-ed28-4705-b75e-54bb36f97a58 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:48.052085 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:52:48.135454 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1c8584df-ed28-4705-b75e-54bb36f97a58 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:48.142926 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1c8584df-ed28-4705-b75e-54bb36f97a58 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7" status: 200 len: 1272 microversion: 2.1 time: 0.148758 Oct 04 18:52:48.144116 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2608/5265] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:47 2022] GET /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7 => generated 1272 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:52:48.486501 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7e796928-6813-47f3-9b02-a1062110dcab tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:48.498018 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7e796928-6813-47f3-9b02-a1062110dcab tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:48.499707 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7e796928-6813-47f3-9b02-a1062110dcab tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:48.500990 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7e796928-6813-47f3-9b02-a1062110dcab tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] 10.222.0.20 "GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6" status: 200 len: 2957 microversion: 2.32 time: 0.531033 Oct 04 18:52:48.502390 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2658/5266] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:52:47 2022] GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6 => generated 2957 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:52:48.641022 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-229a40a8-6a2a-40b0-a841-19a9f758856d tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:48.642190 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-229a40a8-6a2a-40b0-a841-19a9f758856d tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] [instance: e1f035f0-277f-403b-973c-fe337e16ccae] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:48.654428 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-229a40a8-6a2a-40b0-a841-19a9f758856d tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:48.654969 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-229a40a8-6a2a-40b0-a841-19a9f758856d tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:48.663064 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-229a40a8-6a2a-40b0-a841-19a9f758856d tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:48.663064 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-229a40a8-6a2a-40b0-a841-19a9f758856d tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:48.663064 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-229a40a8-6a2a-40b0-a841-19a9f758856d tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:48.663064 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-229a40a8-6a2a-40b0-a841-19a9f758856d tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:48.954932 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-229a40a8-6a2a-40b0-a841-19a9f758856d tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec940f2051b647afb6436356e773a769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3bae1b8ffa4fdb8a3be402743fbca6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:49.003685 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-229a40a8-6a2a-40b0-a841-19a9f758856d tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] 10.222.0.20 "GET /compute/v2.1/servers/e1f035f0-277f-403b-973c-fe337e16ccae" status: 200 len: 1323 microversion: 2.1 time: 0.345163 Oct 04 18:52:49.003685 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2609/5267] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:48 2022] GET /compute/v2.1/servers/e1f035f0-277f-403b-973c-fe337e16ccae => generated 1323 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:49.173589 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a9268e2f-9bb2-4b8e-b83f-75884da5ac59 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:49.174239 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a9268e2f-9bb2-4b8e-b83f-75884da5ac59 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9afd6ad-3b96-4a57-8301-5da830e674c7] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:49.182520 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a9268e2f-9bb2-4b8e-b83f-75884da5ac59 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:49.183636 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a9268e2f-9bb2-4b8e-b83f-75884da5ac59 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:49.183940 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a9268e2f-9bb2-4b8e-b83f-75884da5ac59 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:49.184709 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a9268e2f-9bb2-4b8e-b83f-75884da5ac59 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:49.185162 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a9268e2f-9bb2-4b8e-b83f-75884da5ac59 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:49.185761 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a9268e2f-9bb2-4b8e-b83f-75884da5ac59 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:49.327209 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a9268e2f-9bb2-4b8e-b83f-75884da5ac59 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:49.355898 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a9268e2f-9bb2-4b8e-b83f-75884da5ac59 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7" status: 200 len: 1272 microversion: 2.1 time: 0.186630 Oct 04 18:52:49.361142 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2659/5268] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:49 2022] GET /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7 => generated 1272 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:49.426925 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-2dedc2fa-6247-41cc-8691-b9acd06c7ce6 req-6f1b8705-950c-4b2c-a062-2b55d48bcf4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4267e7a6-74c2-4509-9d96-6a8075236937", "tag": "d47175d7-4bbf-41cd-a2d2-908a9318cf8e"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:52:49.457201 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-2dedc2fa-6247-41cc-8691-b9acd06c7ce6 req-6f1b8705-950c-4b2c-a062-2b55d48bcf4a service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:49.457778 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-2dedc2fa-6247-41cc-8691-b9acd06c7ce6 req-6f1b8705-950c-4b2c-a062-2b55d48bcf4a service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:49.458283 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-2dedc2fa-6247-41cc-8691-b9acd06c7ce6 req-6f1b8705-950c-4b2c-a062-2b55d48bcf4a service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:49.467750 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:52:49.483035 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-2dedc2fa-6247-41cc-8691-b9acd06c7ce6 req-6f1b8705-950c-4b2c-a062-2b55d48bcf4a service nova] Creating event network-changed:d47175d7-4bbf-41cd-a2d2-908a9318cf8e for instance 4267e7a6-74c2-4509-9d96-6a8075236937 on n-h1-850501-14 Oct 04 18:52:49.497434 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-2dedc2fa-6247-41cc-8691-b9acd06c7ce6 req-6f1b8705-950c-4b2c-a062-2b55d48bcf4a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077273 Oct 04 18:52:49.499081 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2610/5269] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:52:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:52:49.535824 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9fd3c3c4-6285-4474-91e3-e3b3dd3ee143 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:49.536874 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-9fd3c3c4-6285-4474-91e3-e3b3dd3ee143 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] [instance: 317c7bd8-4f1e-4210-bb33-087557a1f4d6] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:49.549527 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9fd3c3c4-6285-4474-91e3-e3b3dd3ee143 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:49.550039 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9fd3c3c4-6285-4474-91e3-e3b3dd3ee143 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:49.550490 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9fd3c3c4-6285-4474-91e3-e3b3dd3ee143 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:49.551225 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9fd3c3c4-6285-4474-91e3-e3b3dd3ee143 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:49.551691 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9fd3c3c4-6285-4474-91e3-e3b3dd3ee143 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:49.552149 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9fd3c3c4-6285-4474-91e3-e3b3dd3ee143 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:49.913255 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9fd3c3c4-6285-4474-91e3-e3b3dd3ee143 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:49.927223 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9fd3c3c4-6285-4474-91e3-e3b3dd3ee143 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:49.931011 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9fd3c3c4-6285-4474-91e3-e3b3dd3ee143 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:49.937511 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9fd3c3c4-6285-4474-91e3-e3b3dd3ee143 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] 10.222.0.20 "GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6" status: 200 len: 2957 microversion: 2.32 time: 0.405205 Oct 04 18:52:49.940389 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2660/5270] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:52:49 2022] GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6 => generated 2957 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:52:50.013116 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-47a437e8-4f8f-4377-9395-b8c15eda834d tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:50.013817 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-47a437e8-4f8f-4377-9395-b8c15eda834d tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] [instance: e1f035f0-277f-403b-973c-fe337e16ccae] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:50.024396 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-47a437e8-4f8f-4377-9395-b8c15eda834d tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:50.024888 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-47a437e8-4f8f-4377-9395-b8c15eda834d tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:50.025326 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-47a437e8-4f8f-4377-9395-b8c15eda834d tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:50.026036 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-47a437e8-4f8f-4377-9395-b8c15eda834d tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:50.026491 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-47a437e8-4f8f-4377-9395-b8c15eda834d tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:50.026916 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-47a437e8-4f8f-4377-9395-b8c15eda834d tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:50.386383 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-905a1637-f715-4f8a-b338-ba7ed86caec6 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:50.387098 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-905a1637-f715-4f8a-b338-ba7ed86caec6 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9afd6ad-3b96-4a57-8301-5da830e674c7] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:50.394141 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-905a1637-f715-4f8a-b338-ba7ed86caec6 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:50.394912 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-905a1637-f715-4f8a-b338-ba7ed86caec6 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:50.395516 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-905a1637-f715-4f8a-b338-ba7ed86caec6 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:50.396435 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-905a1637-f715-4f8a-b338-ba7ed86caec6 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:50.397053 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-905a1637-f715-4f8a-b338-ba7ed86caec6 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:50.397641 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-905a1637-f715-4f8a-b338-ba7ed86caec6 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:50.689514 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-47a437e8-4f8f-4377-9395-b8c15eda834d tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec940f2051b647afb6436356e773a769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3bae1b8ffa4fdb8a3be402743fbca6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:50.710566 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-47a437e8-4f8f-4377-9395-b8c15eda834d tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] 10.222.0.20 "GET /compute/v2.1/servers/e1f035f0-277f-403b-973c-fe337e16ccae" status: 200 len: 1323 microversion: 2.1 time: 0.703304 Oct 04 18:52:50.712334 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2611/5271] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:50 2022] GET /compute/v2.1/servers/e1f035f0-277f-403b-973c-fe337e16ccae => generated 1323 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:50.901380 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-905a1637-f715-4f8a-b338-ba7ed86caec6 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:50.919448 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-905a1637-f715-4f8a-b338-ba7ed86caec6 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7" status: 200 len: 1314 microversion: 2.1 time: 0.537301 Oct 04 18:52:50.920185 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2661/5272] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:50 2022] GET /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7 => generated 1314 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:50.973204 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0b5e5629-4ab1-430f-86f1-0e85c4e5b8bb tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:50.973872 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0b5e5629-4ab1-430f-86f1-0e85c4e5b8bb tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] [instance: 317c7bd8-4f1e-4210-bb33-087557a1f4d6] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:50.982119 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0b5e5629-4ab1-430f-86f1-0e85c4e5b8bb tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:50.982619 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0b5e5629-4ab1-430f-86f1-0e85c4e5b8bb tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:50.983240 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0b5e5629-4ab1-430f-86f1-0e85c4e5b8bb tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:50.983959 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0b5e5629-4ab1-430f-86f1-0e85c4e5b8bb tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:50.985393 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0b5e5629-4ab1-430f-86f1-0e85c4e5b8bb tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:50.985838 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0b5e5629-4ab1-430f-86f1-0e85c4e5b8bb tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:51.544862 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-7d5a67c1-16ff-4293-a1cd-c161e60bf370 req-d41c958a-6af6-4f4c-bc7e-f82b6bc2eaa5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1236cea0-3e65-4b7d-861d-eb75d62a5af2", "tag": "97558e74-1510-4e28-a8ec-4451850143f9"}, {"name": "network-changed", "server_uuid": "e1f035f0-277f-403b-973c-fe337e16ccae", "tag": "12e39199-7995-45e6-baa3-778b4af0ca82"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:52:51.566836 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-7d5a67c1-16ff-4293-a1cd-c161e60bf370 req-d41c958a-6af6-4f4c-bc7e-f82b6bc2eaa5 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:51.575628 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-7d5a67c1-16ff-4293-a1cd-c161e60bf370 req-d41c958a-6af6-4f4c-bc7e-f82b6bc2eaa5 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:51.576108 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-7d5a67c1-16ff-4293-a1cd-c161e60bf370 req-d41c958a-6af6-4f4c-bc7e-f82b6bc2eaa5 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:51.595313 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-7d5a67c1-16ff-4293-a1cd-c161e60bf370 req-d41c958a-6af6-4f4c-bc7e-f82b6bc2eaa5 service nova] Creating event network-changed:97558e74-1510-4e28-a8ec-4451850143f9 for instance 1236cea0-3e65-4b7d-861d-eb75d62a5af2 on n-h2-850501-14 Oct 04 18:52:51.596249 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-7d5a67c1-16ff-4293-a1cd-c161e60bf370 req-d41c958a-6af6-4f4c-bc7e-f82b6bc2eaa5 service nova] Creating event network-changed:12e39199-7995-45e6-baa3-778b4af0ca82 for instance e1f035f0-277f-403b-973c-fe337e16ccae on n-h1-850501-14 Oct 04 18:52:51.611490 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-7d5a67c1-16ff-4293-a1cd-c161e60bf370 req-d41c958a-6af6-4f4c-bc7e-f82b6bc2eaa5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.072641 Oct 04 18:52:51.612593 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2662/5273] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:52:51 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:52:51.741526 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3b1d9abf-fa35-4d30-946a-08d32f41447b tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:51.743834 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3b1d9abf-fa35-4d30-946a-08d32f41447b tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] [instance: e1f035f0-277f-403b-973c-fe337e16ccae] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:51.751218 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3b1d9abf-fa35-4d30-946a-08d32f41447b tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:51.752011 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3b1d9abf-fa35-4d30-946a-08d32f41447b tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:51.760094 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3b1d9abf-fa35-4d30-946a-08d32f41447b tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:51.760094 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3b1d9abf-fa35-4d30-946a-08d32f41447b tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:51.760094 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3b1d9abf-fa35-4d30-946a-08d32f41447b tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:51.760094 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3b1d9abf-fa35-4d30-946a-08d32f41447b tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:52.149597 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0b5e5629-4ab1-430f-86f1-0e85c4e5b8bb tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:52.165175 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0b5e5629-4ab1-430f-86f1-0e85c4e5b8bb tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:52.165907 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0b5e5629-4ab1-430f-86f1-0e85c4e5b8bb tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:52.173597 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0b5e5629-4ab1-430f-86f1-0e85c4e5b8bb tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] 10.222.0.20 "GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6" status: 200 len: 2957 microversion: 2.32 time: 1.202158 Oct 04 18:52:52.174568 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2612/5274] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:52:50 2022] GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6 => generated 2957 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:52:52.207653 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ec5ee3bb-f5ab-422e-90e6-5f2a42509357 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:52.208390 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ec5ee3bb-f5ab-422e-90e6-5f2a42509357 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9afd6ad-3b96-4a57-8301-5da830e674c7] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:52.216970 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ec5ee3bb-f5ab-422e-90e6-5f2a42509357 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:52.217638 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ec5ee3bb-f5ab-422e-90e6-5f2a42509357 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:52.218420 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ec5ee3bb-f5ab-422e-90e6-5f2a42509357 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:52.219150 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ec5ee3bb-f5ab-422e-90e6-5f2a42509357 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:52.219623 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ec5ee3bb-f5ab-422e-90e6-5f2a42509357 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:52.220088 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ec5ee3bb-f5ab-422e-90e6-5f2a42509357 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:52.260616 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3b1d9abf-fa35-4d30-946a-08d32f41447b tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec940f2051b647afb6436356e773a769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3bae1b8ffa4fdb8a3be402743fbca6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:52.276142 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3b1d9abf-fa35-4d30-946a-08d32f41447b tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] 10.222.0.20 "GET /compute/v2.1/servers/e1f035f0-277f-403b-973c-fe337e16ccae" status: 200 len: 1323 microversion: 2.1 time: 0.541394 Oct 04 18:52:52.278406 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2663/5275] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:51 2022] GET /compute/v2.1/servers/e1f035f0-277f-403b-973c-fe337e16ccae => generated 1323 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:52:52.606827 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ec5ee3bb-f5ab-422e-90e6-5f2a42509357 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:52.620577 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ec5ee3bb-f5ab-422e-90e6-5f2a42509357 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7" status: 200 len: 1314 microversion: 2.1 time: 0.417817 Oct 04 18:52:52.621593 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2613/5276] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:52 2022] GET /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7 => generated 1314 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:53.212713 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c6173fa7-50db-46a0-bd22-6847a655d771 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:53.212713 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c6173fa7-50db-46a0-bd22-6847a655d771 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] [instance: 317c7bd8-4f1e-4210-bb33-087557a1f4d6] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:53.216593 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c6173fa7-50db-46a0-bd22-6847a655d771 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:53.227749 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c6173fa7-50db-46a0-bd22-6847a655d771 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:53.228413 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c6173fa7-50db-46a0-bd22-6847a655d771 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:53.230297 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c6173fa7-50db-46a0-bd22-6847a655d771 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:53.231756 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c6173fa7-50db-46a0-bd22-6847a655d771 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:53.236725 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c6173fa7-50db-46a0-bd22-6847a655d771 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:53.307309 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6fb7b0f7-d88f-44fe-8f56-961c18415793 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:53.308122 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-6fb7b0f7-d88f-44fe-8f56-961c18415793 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] [instance: e1f035f0-277f-403b-973c-fe337e16ccae] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:53.327590 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6fb7b0f7-d88f-44fe-8f56-961c18415793 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:53.329158 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6fb7b0f7-d88f-44fe-8f56-961c18415793 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:53.329847 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6fb7b0f7-d88f-44fe-8f56-961c18415793 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:53.333533 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6fb7b0f7-d88f-44fe-8f56-961c18415793 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:53.333533 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6fb7b0f7-d88f-44fe-8f56-961c18415793 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:53.333533 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6fb7b0f7-d88f-44fe-8f56-961c18415793 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:53.551125 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:52:53.606613 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=6 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:52:53.820771 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c6173fa7-50db-46a0-bd22-6847a655d771 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:53.830186 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c6173fa7-50db-46a0-bd22-6847a655d771 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:53.844574 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c6173fa7-50db-46a0-bd22-6847a655d771 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:53.844574 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c6173fa7-50db-46a0-bd22-6847a655d771 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] 10.222.0.20 "GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6" status: 200 len: 2936 microversion: 2.32 time: 0.630047 Oct 04 18:52:53.844574 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2664/5277] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:52:53 2022] GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6 => generated 2936 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:52:53.844574 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-5cbc61b4-fd8a-4e88-ae88-07bd15ec46e9 req-967f14e9-3559-4847-8939-c786d72b653d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9afd6ad-3b96-4a57-8301-5da830e674c7", "tag": "7cd90652-9ead-45c9-ac3b-182b9c2da3bb"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:52:53.852084 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-5cbc61b4-fd8a-4e88-ae88-07bd15ec46e9 req-967f14e9-3559-4847-8939-c786d72b653d service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:53.853890 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-5cbc61b4-fd8a-4e88-ae88-07bd15ec46e9 req-967f14e9-3559-4847-8939-c786d72b653d service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:53.854541 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-5cbc61b4-fd8a-4e88-ae88-07bd15ec46e9 req-967f14e9-3559-4847-8939-c786d72b653d service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:53.869963 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-5cbc61b4-fd8a-4e88-ae88-07bd15ec46e9 req-967f14e9-3559-4847-8939-c786d72b653d service nova] Creating event network-changed:7cd90652-9ead-45c9-ac3b-182b9c2da3bb for instance a9afd6ad-3b96-4a57-8301-5da830e674c7 on n-h2-850501-14 Oct 04 18:52:53.875375 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-5cbc61b4-fd8a-4e88-ae88-07bd15ec46e9 req-967f14e9-3559-4847-8939-c786d72b653d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039710 Oct 04 18:52:53.875754 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-6fb7b0f7-d88f-44fe-8f56-961c18415793 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec940f2051b647afb6436356e773a769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3bae1b8ffa4fdb8a3be402743fbca6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:53.876406 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2665/5278] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:52:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:52:53.881522 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2bbbfddd-95d6-4958-9a32-e1bf81ab9448 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:53.882270 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2bbbfddd-95d6-4958-9a32-e1bf81ab9448 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9afd6ad-3b96-4a57-8301-5da830e674c7] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:53.890275 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6fb7b0f7-d88f-44fe-8f56-961c18415793 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] 10.222.0.20 "GET /compute/v2.1/servers/e1f035f0-277f-403b-973c-fe337e16ccae" status: 200 len: 1323 microversion: 2.1 time: 0.587123 Oct 04 18:52:53.892915 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2614/5279] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:53 2022] GET /compute/v2.1/servers/e1f035f0-277f-403b-973c-fe337e16ccae => generated 1323 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:52:53.893687 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2bbbfddd-95d6-4958-9a32-e1bf81ab9448 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:53.894458 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2bbbfddd-95d6-4958-9a32-e1bf81ab9448 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:53.895291 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2bbbfddd-95d6-4958-9a32-e1bf81ab9448 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:53.896038 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2bbbfddd-95d6-4958-9a32-e1bf81ab9448 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:53.896561 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2bbbfddd-95d6-4958-9a32-e1bf81ab9448 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:53.896998 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2bbbfddd-95d6-4958-9a32-e1bf81ab9448 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:54.128934 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-2bbbfddd-95d6-4958-9a32-e1bf81ab9448 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:54.153269 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2bbbfddd-95d6-4958-9a32-e1bf81ab9448 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7" status: 200 len: 1314 microversion: 2.1 time: 0.275600 Oct 04 18:52:54.155031 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2666/5280] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:53 2022] GET /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7 => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:54.512386 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-cf448b68-63bd-453b-9a74-424fdb641898 req-7a0375e1-6e55-438c-9a7e-87addd9cc5a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "317c7bd8-4f1e-4210-bb33-087557a1f4d6", "name": "network-vif-unplugged", "status": "completed", "tag": "88a546f7-13bd-4f6e-b36e-3c743eeface0"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:52:54.532693 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-cf448b68-63bd-453b-9a74-424fdb641898 req-7a0375e1-6e55-438c-9a7e-87addd9cc5a0 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:54.533471 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-cf448b68-63bd-453b-9a74-424fdb641898 req-7a0375e1-6e55-438c-9a7e-87addd9cc5a0 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:54.534088 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-cf448b68-63bd-453b-9a74-424fdb641898 req-7a0375e1-6e55-438c-9a7e-87addd9cc5a0 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:54.547600 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-cf448b68-63bd-453b-9a74-424fdb641898 req-7a0375e1-6e55-438c-9a7e-87addd9cc5a0 service nova] Creating event network-vif-unplugged:88a546f7-13bd-4f6e-b36e-3c743eeface0 for instance 317c7bd8-4f1e-4210-bb33-087557a1f4d6 on n-h1-850501-14 Oct 04 18:52:54.554711 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-cf448b68-63bd-453b-9a74-424fdb641898 req-7a0375e1-6e55-438c-9a7e-87addd9cc5a0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047066 Oct 04 18:52:54.560947 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2615/5281] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:52:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:52:54.872579 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-73f1f7f8-6d01-416b-8b51-f24c354546e1 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:54.873690 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-73f1f7f8-6d01-416b-8b51-f24c354546e1 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] [instance: 317c7bd8-4f1e-4210-bb33-087557a1f4d6] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:54.882097 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-73f1f7f8-6d01-416b-8b51-f24c354546e1 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:54.892980 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-73f1f7f8-6d01-416b-8b51-f24c354546e1 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:54.893620 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-73f1f7f8-6d01-416b-8b51-f24c354546e1 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:54.895070 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-73f1f7f8-6d01-416b-8b51-f24c354546e1 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:54.895546 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-73f1f7f8-6d01-416b-8b51-f24c354546e1 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:54.906444 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-73f1f7f8-6d01-416b-8b51-f24c354546e1 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:54.917271 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-fb59b9b2-937a-4356-b534-e8ba39101b15 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:54.918410 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-fb59b9b2-937a-4356-b534-e8ba39101b15 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] [instance: e1f035f0-277f-403b-973c-fe337e16ccae] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:54.948326 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fb59b9b2-937a-4356-b534-e8ba39101b15 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:54.951156 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fb59b9b2-937a-4356-b534-e8ba39101b15 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:54.952575 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fb59b9b2-937a-4356-b534-e8ba39101b15 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:54.953885 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fb59b9b2-937a-4356-b534-e8ba39101b15 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:54.954644 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fb59b9b2-937a-4356-b534-e8ba39101b15 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:54.955384 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fb59b9b2-937a-4356-b534-e8ba39101b15 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:55.152428 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=16 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:52:55.546564 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-fb59b9b2-937a-4356-b534-e8ba39101b15 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec940f2051b647afb6436356e773a769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3bae1b8ffa4fdb8a3be402743fbca6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:55.547974 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-73f1f7f8-6d01-416b-8b51-f24c354546e1 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:55.562568 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-fb59b9b2-937a-4356-b534-e8ba39101b15 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] 10.222.0.20 "GET /compute/v2.1/servers/e1f035f0-277f-403b-973c-fe337e16ccae" status: 200 len: 1323 microversion: 2.1 time: 0.651239 Oct 04 18:52:55.563056 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2616/5282] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:54 2022] GET /compute/v2.1/servers/e1f035f0-277f-403b-973c-fe337e16ccae => generated 1323 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:52:55.573370 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ea0b1b12-da2e-4fe6-9ef6-1479bebed3b1 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:55.577697 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ea0b1b12-da2e-4fe6-9ef6-1479bebed3b1 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9afd6ad-3b96-4a57-8301-5da830e674c7] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:55.579876 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-73f1f7f8-6d01-416b-8b51-f24c354546e1 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:55.590662 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-73f1f7f8-6d01-416b-8b51-f24c354546e1 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:55.592646 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-73f1f7f8-6d01-416b-8b51-f24c354546e1 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] 10.222.0.20 "GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6" status: 200 len: 2915 microversion: 2.32 time: 0.724575 Oct 04 18:52:55.593430 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2667/5283] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:52:54 2022] GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6 => generated 2915 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:52:55.594767 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ea0b1b12-da2e-4fe6-9ef6-1479bebed3b1 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:55.595454 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ea0b1b12-da2e-4fe6-9ef6-1479bebed3b1 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:55.596093 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ea0b1b12-da2e-4fe6-9ef6-1479bebed3b1 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:55.598348 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ea0b1b12-da2e-4fe6-9ef6-1479bebed3b1 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:55.599084 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ea0b1b12-da2e-4fe6-9ef6-1479bebed3b1 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:55.599696 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ea0b1b12-da2e-4fe6-9ef6-1479bebed3b1 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:55.910684 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ea0b1b12-da2e-4fe6-9ef6-1479bebed3b1 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:55.942315 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ea0b1b12-da2e-4fe6-9ef6-1479bebed3b1 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7" status: 200 len: 1314 microversion: 2.1 time: 0.375176 Oct 04 18:52:55.961499 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2617/5284] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:55 2022] GET /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7 => generated 1314 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:55.990660 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-312d9297-f0a0-4963-9ec7-3009cf746cba req-5c98236b-906a-4ef1-b1e6-132e8596a25c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "317c7bd8-4f1e-4210-bb33-087557a1f4d6", "name": "network-vif-deleted", "tag": "2db3b2e9-5704-4a97-af2f-ad3b3aff8b6c"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:52:56.005510 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-312d9297-f0a0-4963-9ec7-3009cf746cba req-5c98236b-906a-4ef1-b1e6-132e8596a25c service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:56.006328 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-312d9297-f0a0-4963-9ec7-3009cf746cba req-5c98236b-906a-4ef1-b1e6-132e8596a25c service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:56.028412 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-312d9297-f0a0-4963-9ec7-3009cf746cba req-5c98236b-906a-4ef1-b1e6-132e8596a25c service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:56.057937 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-312d9297-f0a0-4963-9ec7-3009cf746cba req-5c98236b-906a-4ef1-b1e6-132e8596a25c service nova] Creating event network-vif-deleted:2db3b2e9-5704-4a97-af2f-ad3b3aff8b6c for instance 317c7bd8-4f1e-4210-bb33-087557a1f4d6 on n-h1-850501-14 Oct 04 18:52:56.064918 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-312d9297-f0a0-4963-9ec7-3009cf746cba req-5c98236b-906a-4ef1-b1e6-132e8596a25c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078066 Oct 04 18:52:56.066165 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2668/5285] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:52:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:52:56.590834 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-628c725f-e915-4ad4-999a-abc2a2c9e932 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:56.592725 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-7153b2a6-5720-437f-8cb6-26ee09072cae req-e12ffdbe-168c-457b-b105-6481df244df9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "317c7bd8-4f1e-4210-bb33-087557a1f4d6", "name": "network-vif-unplugged", "status": "completed", "tag": "53730d23-3a07-4884-9751-67c1b4d3e3f1"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:52:56.594043 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-628c725f-e915-4ad4-999a-abc2a2c9e932 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] [instance: e1f035f0-277f-403b-973c-fe337e16ccae] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:56.610434 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-628c725f-e915-4ad4-999a-abc2a2c9e932 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:56.610961 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-628c725f-e915-4ad4-999a-abc2a2c9e932 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:56.611387 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-7153b2a6-5720-437f-8cb6-26ee09072cae req-e12ffdbe-168c-457b-b105-6481df244df9 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:56.611553 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-628c725f-e915-4ad4-999a-abc2a2c9e932 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:56.612523 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-7153b2a6-5720-437f-8cb6-26ee09072cae req-e12ffdbe-168c-457b-b105-6481df244df9 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:56.613419 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-7153b2a6-5720-437f-8cb6-26ee09072cae req-e12ffdbe-168c-457b-b105-6481df244df9 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:56.613969 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-628c725f-e915-4ad4-999a-abc2a2c9e932 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:56.615078 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-628c725f-e915-4ad4-999a-abc2a2c9e932 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:56.616173 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-628c725f-e915-4ad4-999a-abc2a2c9e932 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:56.634330 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-7153b2a6-5720-437f-8cb6-26ee09072cae req-e12ffdbe-168c-457b-b105-6481df244df9 service nova] Creating event network-vif-unplugged:53730d23-3a07-4884-9751-67c1b4d3e3f1 for instance 317c7bd8-4f1e-4210-bb33-087557a1f4d6 on n-h1-850501-14 Oct 04 18:52:56.641067 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-7153b2a6-5720-437f-8cb6-26ee09072cae req-e12ffdbe-168c-457b-b105-6481df244df9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053645 Oct 04 18:52:56.645395 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2669/5286] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:52:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:52:56.652228 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-db6f6634-5831-4fba-a293-62af742f920b tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:56.653587 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-db6f6634-5831-4fba-a293-62af742f920b tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] [instance: 317c7bd8-4f1e-4210-bb33-087557a1f4d6] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:56.662966 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-db6f6634-5831-4fba-a293-62af742f920b tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:56.664035 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-db6f6634-5831-4fba-a293-62af742f920b tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:56.664873 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-db6f6634-5831-4fba-a293-62af742f920b tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:56.665881 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-db6f6634-5831-4fba-a293-62af742f920b tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:56.666730 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-db6f6634-5831-4fba-a293-62af742f920b tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:56.667847 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-db6f6634-5831-4fba-a293-62af742f920b tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:57.249919 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-db6f6634-5831-4fba-a293-62af742f920b tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:57.293566 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-db6f6634-5831-4fba-a293-62af742f920b tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:57.295718 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-db6f6634-5831-4fba-a293-62af742f920b tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:57.308329 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-db6f6634-5831-4fba-a293-62af742f920b tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] 10.222.0.20 "GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6" status: 200 len: 2707 microversion: 2.32 time: 0.656712 Oct 04 18:52:57.311821 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2670/5287] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:52:56 2022] GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6 => generated 2707 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:52:57.332731 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-99f97114-08b2-4374-ac54-5a4a1464314f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:57.333594 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-99f97114-08b2-4374-ac54-5a4a1464314f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9afd6ad-3b96-4a57-8301-5da830e674c7] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:57.360874 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-99f97114-08b2-4374-ac54-5a4a1464314f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:57.361689 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-99f97114-08b2-4374-ac54-5a4a1464314f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:57.363387 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-99f97114-08b2-4374-ac54-5a4a1464314f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:57.366354 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-99f97114-08b2-4374-ac54-5a4a1464314f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:57.367363 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-99f97114-08b2-4374-ac54-5a4a1464314f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:57.368079 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-99f97114-08b2-4374-ac54-5a4a1464314f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:57.373105 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-628c725f-e915-4ad4-999a-abc2a2c9e932 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec940f2051b647afb6436356e773a769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3bae1b8ffa4fdb8a3be402743fbca6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:57.390457 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-628c725f-e915-4ad4-999a-abc2a2c9e932 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] 10.222.0.20 "GET /compute/v2.1/servers/e1f035f0-277f-403b-973c-fe337e16ccae" status: 200 len: 1323 microversion: 2.1 time: 0.798906 Oct 04 18:52:57.412350 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2618/5288] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:56 2022] GET /compute/v2.1/servers/e1f035f0-277f-403b-973c-fe337e16ccae => generated 1323 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:57.830607 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-99f97114-08b2-4374-ac54-5a4a1464314f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:57.840604 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-99f97114-08b2-4374-ac54-5a4a1464314f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7" status: 200 len: 1314 microversion: 2.1 time: 0.527341 Oct 04 18:52:57.845682 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2671/5289] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:57 2022] GET /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7 => generated 1314 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:58.107290 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-e9a2ba3e-4441-4a6d-a559-ca1615f3e8bf req-70353614-9d35-4423-b3b0-ec1ae615f135 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "317c7bd8-4f1e-4210-bb33-087557a1f4d6", "name": "network-vif-deleted", "tag": "53730d23-3a07-4884-9751-67c1b4d3e3f1"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:52:58.124177 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-e9a2ba3e-4441-4a6d-a559-ca1615f3e8bf req-70353614-9d35-4423-b3b0-ec1ae615f135 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:58.125795 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-e9a2ba3e-4441-4a6d-a559-ca1615f3e8bf req-70353614-9d35-4423-b3b0-ec1ae615f135 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:58.126546 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-e9a2ba3e-4441-4a6d-a559-ca1615f3e8bf req-70353614-9d35-4423-b3b0-ec1ae615f135 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:58.159619 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-e9a2ba3e-4441-4a6d-a559-ca1615f3e8bf req-70353614-9d35-4423-b3b0-ec1ae615f135 service nova] Creating event network-vif-deleted:53730d23-3a07-4884-9751-67c1b4d3e3f1 for instance 317c7bd8-4f1e-4210-bb33-087557a1f4d6 on n-h1-850501-14 Oct 04 18:52:58.173948 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-e9a2ba3e-4441-4a6d-a559-ca1615f3e8bf req-70353614-9d35-4423-b3b0-ec1ae615f135 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072990 Oct 04 18:52:58.176324 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2619/5290] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:52:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:52:58.345683 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-11ce36d1-0b47-40f2-ae19-113044dab736 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:58.347128 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-11ce36d1-0b47-40f2-ae19-113044dab736 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] [instance: 317c7bd8-4f1e-4210-bb33-087557a1f4d6] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:58.353549 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-11ce36d1-0b47-40f2-ae19-113044dab736 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:58.354037 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-11ce36d1-0b47-40f2-ae19-113044dab736 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:58.354467 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-11ce36d1-0b47-40f2-ae19-113044dab736 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:58.355241 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-11ce36d1-0b47-40f2-ae19-113044dab736 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:58.355691 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-11ce36d1-0b47-40f2-ae19-113044dab736 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:58.356132 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-11ce36d1-0b47-40f2-ae19-113044dab736 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:58.424657 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2f1e1c4d-cf57-47f1-897c-06faae597d6f tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:58.425320 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2f1e1c4d-cf57-47f1-897c-06faae597d6f tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] [instance: e1f035f0-277f-403b-973c-fe337e16ccae] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:58.437598 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2f1e1c4d-cf57-47f1-897c-06faae597d6f tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:58.439389 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2f1e1c4d-cf57-47f1-897c-06faae597d6f tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:58.440010 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2f1e1c4d-cf57-47f1-897c-06faae597d6f tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:58.440804 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2f1e1c4d-cf57-47f1-897c-06faae597d6f tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:58.441254 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2f1e1c4d-cf57-47f1-897c-06faae597d6f tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:58.441681 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2f1e1c4d-cf57-47f1-897c-06faae597d6f tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:58.928154 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-11ce36d1-0b47-40f2-ae19-113044dab736 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:58.943981 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-11ce36d1-0b47-40f2-ae19-113044dab736 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:58.956347 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-11ce36d1-0b47-40f2-ae19-113044dab736 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:58.956347 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-11ce36d1-0b47-40f2-ae19-113044dab736 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] 10.222.0.20 "GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6" status: 200 len: 2660 microversion: 2.32 time: 0.606711 Oct 04 18:52:58.956347 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2672/5291] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:52:58 2022] GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6 => generated 2660 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:52:58.961783 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-cc3f40a9-eddf-484a-89e5-0269c10a66f8 req-6ff0a03a-8e94-461b-9c2f-e383cf5eb69b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "317c7bd8-4f1e-4210-bb33-087557a1f4d6", "name": "network-vif-unplugged", "status": "completed", "tag": "722c07ac-b873-4605-a9eb-4abf62e975df"}, {"server_uuid": "317c7bd8-4f1e-4210-bb33-087557a1f4d6", "name": "network-vif-unplugged", "status": "completed", "tag": "f77c8e43-6a46-4f2a-aef7-77f61d8b7f1a"}, {"server_uuid": "4267e7a6-74c2-4509-9d96-6a8075236937", "name": "network-vif-plugged", "status": "completed", "tag": "d47175d7-4bbf-41cd-a2d2-908a9318cf8e"}, {"server_uuid": "e1f035f0-277f-403b-973c-fe337e16ccae", "name": "network-vif-plugged", "status": "completed", "tag": "12e39199-7995-45e6-baa3-778b4af0ca82"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:52:58.975999 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2f1e1c4d-cf57-47f1-897c-06faae597d6f tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec940f2051b647afb6436356e773a769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3bae1b8ffa4fdb8a3be402743fbca6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:58.979603 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-cc3f40a9-eddf-484a-89e5-0269c10a66f8 req-6ff0a03a-8e94-461b-9c2f-e383cf5eb69b service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:58.981961 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-cc3f40a9-eddf-484a-89e5-0269c10a66f8 req-6ff0a03a-8e94-461b-9c2f-e383cf5eb69b service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:58.985176 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-cc3f40a9-eddf-484a-89e5-0269c10a66f8 req-6ff0a03a-8e94-461b-9c2f-e383cf5eb69b service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:58.997009 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2f1e1c4d-cf57-47f1-897c-06faae597d6f tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] 10.222.0.20 "GET /compute/v2.1/servers/e1f035f0-277f-403b-973c-fe337e16ccae" status: 200 len: 1323 microversion: 2.1 time: 0.577358 Oct 04 18:52:59.001649 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2620/5292] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:58 2022] GET /compute/v2.1/servers/e1f035f0-277f-403b-973c-fe337e16ccae => generated 1323 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:52:59.004829 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-cc3f40a9-eddf-484a-89e5-0269c10a66f8 req-6ff0a03a-8e94-461b-9c2f-e383cf5eb69b service nova] Creating event network-vif-unplugged:722c07ac-b873-4605-a9eb-4abf62e975df for instance 317c7bd8-4f1e-4210-bb33-087557a1f4d6 on n-h1-850501-14 Oct 04 18:52:59.005350 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-cc3f40a9-eddf-484a-89e5-0269c10a66f8 req-6ff0a03a-8e94-461b-9c2f-e383cf5eb69b service nova] Creating event network-vif-unplugged:f77c8e43-6a46-4f2a-aef7-77f61d8b7f1a for instance 317c7bd8-4f1e-4210-bb33-087557a1f4d6 on n-h1-850501-14 Oct 04 18:52:59.005853 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-cc3f40a9-eddf-484a-89e5-0269c10a66f8 req-6ff0a03a-8e94-461b-9c2f-e383cf5eb69b service nova] Creating event network-vif-plugged:d47175d7-4bbf-41cd-a2d2-908a9318cf8e for instance 4267e7a6-74c2-4509-9d96-6a8075236937 on n-h1-850501-14 Oct 04 18:52:59.008517 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-cc3f40a9-eddf-484a-89e5-0269c10a66f8 req-6ff0a03a-8e94-461b-9c2f-e383cf5eb69b service nova] Creating event network-vif-plugged:12e39199-7995-45e6-baa3-778b4af0ca82 for instance e1f035f0-277f-403b-973c-fe337e16ccae on n-h1-850501-14 Oct 04 18:52:59.009388 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c3443475-258c-4934-b54a-fee4df4fb65b tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:59.010091 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c3443475-258c-4934-b54a-fee4df4fb65b tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9afd6ad-3b96-4a57-8301-5da830e674c7] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:59.016955 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c3443475-258c-4934-b54a-fee4df4fb65b tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:59.021514 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c3443475-258c-4934-b54a-fee4df4fb65b tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:59.021878 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c3443475-258c-4934-b54a-fee4df4fb65b tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:59.022888 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c3443475-258c-4934-b54a-fee4df4fb65b tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:59.024509 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c3443475-258c-4934-b54a-fee4df4fb65b tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:59.026162 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c3443475-258c-4934-b54a-fee4df4fb65b tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:59.031360 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-cc3f40a9-eddf-484a-89e5-0269c10a66f8 req-6ff0a03a-8e94-461b-9c2f-e383cf5eb69b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 700 microversion: 2.1 time: 0.081509 Oct 04 18:52:59.040221 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2673/5293] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:52:58 2022] POST /compute/v2.1/os-server-external-events => generated 700 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:52:59.313540 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c3443475-258c-4934-b54a-fee4df4fb65b tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:59.342008 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c3443475-258c-4934-b54a-fee4df4fb65b tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7" status: 200 len: 1314 microversion: 2.1 time: 0.330868 Oct 04 18:52:59.347882 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2621/5294] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:59 2022] GET /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7 => generated 1314 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:59.981918 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-cc552811-adcb-4f28-b7c4-b511442c39d2 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:59.983360 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-cc552811-adcb-4f28-b7c4-b511442c39d2 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] [instance: 317c7bd8-4f1e-4210-bb33-087557a1f4d6] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:59.989983 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cc552811-adcb-4f28-b7c4-b511442c39d2 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:59.990833 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cc552811-adcb-4f28-b7c4-b511442c39d2 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:59.992180 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cc552811-adcb-4f28-b7c4-b511442c39d2 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:59.993257 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cc552811-adcb-4f28-b7c4-b511442c39d2 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:59.994345 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cc552811-adcb-4f28-b7c4-b511442c39d2 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:59.994843 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cc552811-adcb-4f28-b7c4-b511442c39d2 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:00.043234 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-76cec817-c111-4b51-8877-193572ccf4ce tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:00.044275 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-76cec817-c111-4b51-8877-193572ccf4ce tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] [instance: e1f035f0-277f-403b-973c-fe337e16ccae] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:00.065448 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-76cec817-c111-4b51-8877-193572ccf4ce tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:00.065727 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-76cec817-c111-4b51-8877-193572ccf4ce tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:00.066441 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-76cec817-c111-4b51-8877-193572ccf4ce tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:00.067520 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-76cec817-c111-4b51-8877-193572ccf4ce tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:00.068516 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-76cec817-c111-4b51-8877-193572ccf4ce tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:00.069204 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-76cec817-c111-4b51-8877-193572ccf4ce tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:00.319114 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-cc552811-adcb-4f28-b7c4-b511442c39d2 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:00.338167 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-cc552811-adcb-4f28-b7c4-b511442c39d2 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:00.340397 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-cc552811-adcb-4f28-b7c4-b511442c39d2 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:00.344092 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-cc552811-adcb-4f28-b7c4-b511442c39d2 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] 10.222.0.20 "GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6" status: 200 len: 2499 microversion: 2.32 time: 0.367375 Oct 04 18:53:00.345534 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2674/5295] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:52:59 2022] GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6 => generated 2499 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:53:00.356677 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-c7415df4-7d27-4bbe-a2e0-bd6cd4e85f64 req-1caa2011-39db-4e43-81fa-32cbdc3adbf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "317c7bd8-4f1e-4210-bb33-087557a1f4d6", "name": "network-vif-deleted", "tag": "88a546f7-13bd-4f6e-b36e-3c743eeface0"}, {"server_uuid": "317c7bd8-4f1e-4210-bb33-087557a1f4d6", "name": "network-vif-deleted", "tag": "f77c8e43-6a46-4f2a-aef7-77f61d8b7f1a"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:53:00.357903 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-76cec817-c111-4b51-8877-193572ccf4ce tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec940f2051b647afb6436356e773a769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3bae1b8ffa4fdb8a3be402743fbca6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:00.367925 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-76cec817-c111-4b51-8877-193572ccf4ce tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] 10.222.0.20 "GET /compute/v2.1/servers/e1f035f0-277f-403b-973c-fe337e16ccae" status: 200 len: 1323 microversion: 2.1 time: 0.329669 Oct 04 18:53:00.394119 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2622/5296] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:00 2022] GET /compute/v2.1/servers/e1f035f0-277f-403b-973c-fe337e16ccae => generated 1323 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:00.404842 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a44a6d7f-6915-4e0a-a284-3e123feed3be tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:00.405452 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a44a6d7f-6915-4e0a-a284-3e123feed3be tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9afd6ad-3b96-4a57-8301-5da830e674c7] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:00.425936 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-c7415df4-7d27-4bbe-a2e0-bd6cd4e85f64 req-1caa2011-39db-4e43-81fa-32cbdc3adbf8 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:00.426708 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-c7415df4-7d27-4bbe-a2e0-bd6cd4e85f64 req-1caa2011-39db-4e43-81fa-32cbdc3adbf8 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:00.428313 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-c7415df4-7d27-4bbe-a2e0-bd6cd4e85f64 req-1caa2011-39db-4e43-81fa-32cbdc3adbf8 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:00.446792 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a44a6d7f-6915-4e0a-a284-3e123feed3be tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:00.456397 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a44a6d7f-6915-4e0a-a284-3e123feed3be tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:00.457959 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a44a6d7f-6915-4e0a-a284-3e123feed3be tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:00.459818 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a44a6d7f-6915-4e0a-a284-3e123feed3be tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:00.461163 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a44a6d7f-6915-4e0a-a284-3e123feed3be tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:00.468678 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a44a6d7f-6915-4e0a-a284-3e123feed3be tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:00.474210 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-c7415df4-7d27-4bbe-a2e0-bd6cd4e85f64 req-1caa2011-39db-4e43-81fa-32cbdc3adbf8 service nova] Creating event network-vif-deleted:88a546f7-13bd-4f6e-b36e-3c743eeface0 for instance 317c7bd8-4f1e-4210-bb33-087557a1f4d6 on n-h1-850501-14 Oct 04 18:53:00.475303 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-c7415df4-7d27-4bbe-a2e0-bd6cd4e85f64 req-1caa2011-39db-4e43-81fa-32cbdc3adbf8 service nova] Creating event network-vif-deleted:f77c8e43-6a46-4f2a-aef7-77f61d8b7f1a for instance 317c7bd8-4f1e-4210-bb33-087557a1f4d6 on n-h1-850501-14 Oct 04 18:53:00.493210 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-c7415df4-7d27-4bbe-a2e0-bd6cd4e85f64 req-1caa2011-39db-4e43-81fa-32cbdc3adbf8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.144157 Oct 04 18:53:00.505990 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2675/5297] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:53:00 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:53:00.835655 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a44a6d7f-6915-4e0a-a284-3e123feed3be tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:00.859393 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a44a6d7f-6915-4e0a-a284-3e123feed3be tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7" status: 200 len: 1314 microversion: 2.1 time: 0.458312 Oct 04 18:53:00.859393 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2623/5298] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:00 2022] GET /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7 => generated 1314 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:01.110997 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-3303fe24-135d-41ab-97f0-62505f5cf5f4 req-83222e0c-80bf-4647-a70c-1da3eb7ad734 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1236cea0-3e65-4b7d-861d-eb75d62a5af2", "name": "network-vif-plugged", "status": "completed", "tag": "97558e74-1510-4e28-a8ec-4451850143f9"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:53:01.123505 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-3303fe24-135d-41ab-97f0-62505f5cf5f4 req-83222e0c-80bf-4647-a70c-1da3eb7ad734 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:01.124426 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-3303fe24-135d-41ab-97f0-62505f5cf5f4 req-83222e0c-80bf-4647-a70c-1da3eb7ad734 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:01.125052 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-3303fe24-135d-41ab-97f0-62505f5cf5f4 req-83222e0c-80bf-4647-a70c-1da3eb7ad734 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:01.146625 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-3303fe24-135d-41ab-97f0-62505f5cf5f4 req-83222e0c-80bf-4647-a70c-1da3eb7ad734 service nova] Creating event network-vif-plugged:97558e74-1510-4e28-a8ec-4451850143f9 for instance 1236cea0-3e65-4b7d-861d-eb75d62a5af2 on n-h2-850501-14 Oct 04 18:53:01.166835 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-3303fe24-135d-41ab-97f0-62505f5cf5f4 req-83222e0c-80bf-4647-a70c-1da3eb7ad734 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080111 Oct 04 18:53:01.168138 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2676/5299] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:53:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:53:01.374409 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6288d35a-1dc0-47e4-a7c1-c65b87380160 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:01.375030 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-6288d35a-1dc0-47e4-a7c1-c65b87380160 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] [instance: 317c7bd8-4f1e-4210-bb33-087557a1f4d6] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:01.385576 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6288d35a-1dc0-47e4-a7c1-c65b87380160 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:01.386062 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6288d35a-1dc0-47e4-a7c1-c65b87380160 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:01.389699 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6288d35a-1dc0-47e4-a7c1-c65b87380160 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:01.389699 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6288d35a-1dc0-47e4-a7c1-c65b87380160 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:01.389699 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6288d35a-1dc0-47e4-a7c1-c65b87380160 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:01.389699 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6288d35a-1dc0-47e4-a7c1-c65b87380160 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:01.395741 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0fb165ea-f2d2-48a2-9357-ba4079214236 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:01.396486 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0fb165ea-f2d2-48a2-9357-ba4079214236 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] [instance: e1f035f0-277f-403b-973c-fe337e16ccae] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:01.410359 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0fb165ea-f2d2-48a2-9357-ba4079214236 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:01.418192 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0fb165ea-f2d2-48a2-9357-ba4079214236 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:01.418192 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0fb165ea-f2d2-48a2-9357-ba4079214236 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:01.418192 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0fb165ea-f2d2-48a2-9357-ba4079214236 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:01.418192 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0fb165ea-f2d2-48a2-9357-ba4079214236 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:01.418192 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0fb165ea-f2d2-48a2-9357-ba4079214236 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:01.865564 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0fb165ea-f2d2-48a2-9357-ba4079214236 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec940f2051b647afb6436356e773a769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3bae1b8ffa4fdb8a3be402743fbca6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:01.879859 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0fb165ea-f2d2-48a2-9357-ba4079214236 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] 10.222.0.20 "GET /compute/v2.1/servers/e1f035f0-277f-403b-973c-fe337e16ccae" status: 200 len: 1517 microversion: 2.1 time: 0.488354 Oct 04 18:53:01.880494 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2677/5300] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:01 2022] GET /compute/v2.1/servers/e1f035f0-277f-403b-973c-fe337e16ccae => generated 1517 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:53:01.898865 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-74745254-68a2-4537-b7e9-8fa7c581513d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:01.899650 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-74745254-68a2-4537-b7e9-8fa7c581513d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9afd6ad-3b96-4a57-8301-5da830e674c7] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:01.925929 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-74745254-68a2-4537-b7e9-8fa7c581513d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:01.926439 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-74745254-68a2-4537-b7e9-8fa7c581513d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:01.926889 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-74745254-68a2-4537-b7e9-8fa7c581513d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:01.927609 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-74745254-68a2-4537-b7e9-8fa7c581513d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:01.928101 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-74745254-68a2-4537-b7e9-8fa7c581513d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:01.935761 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-74745254-68a2-4537-b7e9-8fa7c581513d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:02.046976 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-6288d35a-1dc0-47e4-a7c1-c65b87380160 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:02.061423 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-6288d35a-1dc0-47e4-a7c1-c65b87380160 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:02.100021 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-6288d35a-1dc0-47e4-a7c1-c65b87380160 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:02.101421 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6288d35a-1dc0-47e4-a7c1-c65b87380160 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] 10.222.0.20 "GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6" status: 200 len: 2100 microversion: 2.32 time: 0.731075 Oct 04 18:53:02.102009 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2624/5301] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:53:01 2022] GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6 => generated 2100 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:53:02.111845 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-66550e14-7e5a-4dd5-bc1f-6552e5cce2f3 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:02.120189 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-66550e14-7e5a-4dd5-bc1f-6552e5cce2f3 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] [instance: 1236cea0-3e65-4b7d-861d-eb75d62a5af2] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:02.142084 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:53:02.143823 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-66550e14-7e5a-4dd5-bc1f-6552e5cce2f3 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:02.144557 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-66550e14-7e5a-4dd5-bc1f-6552e5cce2f3 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:02.145180 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-66550e14-7e5a-4dd5-bc1f-6552e5cce2f3 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:02.146059 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-66550e14-7e5a-4dd5-bc1f-6552e5cce2f3 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:02.146996 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-66550e14-7e5a-4dd5-bc1f-6552e5cce2f3 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:02.150609 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-66550e14-7e5a-4dd5-bc1f-6552e5cce2f3 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:02.200894 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-74745254-68a2-4537-b7e9-8fa7c581513d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:02.218137 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-74745254-68a2-4537-b7e9-8fa7c581513d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7" status: 200 len: 1314 microversion: 2.1 time: 0.336566 Oct 04 18:53:02.219018 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2678/5302] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:01 2022] GET /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7 => generated 1314 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:02.408835 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-66550e14-7e5a-4dd5-bc1f-6552e5cce2f3 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec940f2051b647afb6436356e773a769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3bae1b8ffa4fdb8a3be402743fbca6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:02.423688 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-66550e14-7e5a-4dd5-bc1f-6552e5cce2f3 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] 10.222.0.20 "GET /compute/v2.1/servers/1236cea0-3e65-4b7d-861d-eb75d62a5af2" status: 200 len: 1323 microversion: 2.1 time: 0.319975 Oct 04 18:53:02.449358 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2625/5303] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:02 2022] GET /compute/v2.1/servers/1236cea0-3e65-4b7d-861d-eb75d62a5af2 => generated 1323 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:02.548674 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-9bb87127-da75-4f16-960d-576efcdeecbc req-2ed1ea45-da29-4a23-98fe-18f8954c6f9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "317c7bd8-4f1e-4210-bb33-087557a1f4d6", "name": "network-vif-deleted", "tag": "722c07ac-b873-4605-a9eb-4abf62e975df"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:53:02.565417 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-9bb87127-da75-4f16-960d-576efcdeecbc req-2ed1ea45-da29-4a23-98fe-18f8954c6f9d service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:02.568214 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-9bb87127-da75-4f16-960d-576efcdeecbc req-2ed1ea45-da29-4a23-98fe-18f8954c6f9d service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:02.570781 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-9bb87127-da75-4f16-960d-576efcdeecbc req-2ed1ea45-da29-4a23-98fe-18f8954c6f9d service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:02.615443 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-9bb87127-da75-4f16-960d-576efcdeecbc req-2ed1ea45-da29-4a23-98fe-18f8954c6f9d service nova] Creating event network-vif-deleted:722c07ac-b873-4605-a9eb-4abf62e975df for instance 317c7bd8-4f1e-4210-bb33-087557a1f4d6 on n-h1-850501-14 Oct 04 18:53:02.625667 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-9bb87127-da75-4f16-960d-576efcdeecbc req-2ed1ea45-da29-4a23-98fe-18f8954c6f9d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084224 Oct 04 18:53:02.627234 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2679/5304] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:53:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:53:03.134864 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-abf33ab9-13f9-4eaa-b854-d5f0ae185195 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:03.135486 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-abf33ab9-13f9-4eaa-b854-d5f0ae185195 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] [instance: 317c7bd8-4f1e-4210-bb33-087557a1f4d6] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:03.146615 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-abf33ab9-13f9-4eaa-b854-d5f0ae185195 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:03.147028 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-abf33ab9-13f9-4eaa-b854-d5f0ae185195 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:03.147494 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-abf33ab9-13f9-4eaa-b854-d5f0ae185195 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:03.150008 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-abf33ab9-13f9-4eaa-b854-d5f0ae185195 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:03.150676 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-abf33ab9-13f9-4eaa-b854-d5f0ae185195 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:03.151280 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-abf33ab9-13f9-4eaa-b854-d5f0ae185195 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:03.253765 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d5744616-58c8-4254-a23b-6cfa6e23a192 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:03.254853 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d5744616-58c8-4254-a23b-6cfa6e23a192 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9afd6ad-3b96-4a57-8301-5da830e674c7] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:03.302073 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d5744616-58c8-4254-a23b-6cfa6e23a192 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:03.302776 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d5744616-58c8-4254-a23b-6cfa6e23a192 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:03.303766 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d5744616-58c8-4254-a23b-6cfa6e23a192 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:03.304563 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d5744616-58c8-4254-a23b-6cfa6e23a192 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:03.305025 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d5744616-58c8-4254-a23b-6cfa6e23a192 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:03.312829 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d5744616-58c8-4254-a23b-6cfa6e23a192 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:03.332454 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-abf33ab9-13f9-4eaa-b854-d5f0ae185195 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:03.348665 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-abf33ab9-13f9-4eaa-b854-d5f0ae185195 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:03.355932 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-abf33ab9-13f9-4eaa-b854-d5f0ae185195 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:03.357223 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-abf33ab9-13f9-4eaa-b854-d5f0ae185195 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] 10.222.0.20 "GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6" status: 200 len: 1605 microversion: 2.32 time: 0.227025 Oct 04 18:53:03.358204 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2626/5305] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:53:03 2022] GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6 => generated 1605 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:53:03.360341 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=100 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:53:03.459018 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4653ff5c-42ef-438f-9f4d-7f1908f677fe tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:03.461513 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4653ff5c-42ef-438f-9f4d-7f1908f677fe tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] [instance: 1236cea0-3e65-4b7d-861d-eb75d62a5af2] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:03.474182 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4653ff5c-42ef-438f-9f4d-7f1908f677fe tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:03.475064 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4653ff5c-42ef-438f-9f4d-7f1908f677fe tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:03.476392 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4653ff5c-42ef-438f-9f4d-7f1908f677fe tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:03.478520 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4653ff5c-42ef-438f-9f4d-7f1908f677fe tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:03.479224 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4653ff5c-42ef-438f-9f4d-7f1908f677fe tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:03.479936 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4653ff5c-42ef-438f-9f4d-7f1908f677fe tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:03.700775 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d5744616-58c8-4254-a23b-6cfa6e23a192 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:03.715633 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d5744616-58c8-4254-a23b-6cfa6e23a192 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7" status: 200 len: 1314 microversion: 2.1 time: 0.472052 Oct 04 18:53:03.733824 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2680/5306] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:03 2022] GET /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7 => generated 1314 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:03.735967 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4653ff5c-42ef-438f-9f4d-7f1908f677fe tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec940f2051b647afb6436356e773a769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3bae1b8ffa4fdb8a3be402743fbca6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:03.760934 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4653ff5c-42ef-438f-9f4d-7f1908f677fe tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] 10.222.0.20 "GET /compute/v2.1/servers/1236cea0-3e65-4b7d-861d-eb75d62a5af2" status: 200 len: 1516 microversion: 2.1 time: 0.307437 Oct 04 18:53:03.761781 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2627/5307] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:03 2022] GET /compute/v2.1/servers/1236cea0-3e65-4b7d-861d-eb75d62a5af2 => generated 1516 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:53:03.789029 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-238fcae9-38fc-4c06-9b64-c812351602c6 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:03.790084 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-238fcae9-38fc-4c06-9b64-c812351602c6 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] [instance: 4267e7a6-74c2-4509-9d96-6a8075236937] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:03.796779 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-238fcae9-38fc-4c06-9b64-c812351602c6 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:03.802292 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-238fcae9-38fc-4c06-9b64-c812351602c6 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:03.802292 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-238fcae9-38fc-4c06-9b64-c812351602c6 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:03.802292 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-238fcae9-38fc-4c06-9b64-c812351602c6 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:03.802292 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-238fcae9-38fc-4c06-9b64-c812351602c6 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:03.802292 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-238fcae9-38fc-4c06-9b64-c812351602c6 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:03.993561 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-238fcae9-38fc-4c06-9b64-c812351602c6 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec940f2051b647afb6436356e773a769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3bae1b8ffa4fdb8a3be402743fbca6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:04.013642 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-238fcae9-38fc-4c06-9b64-c812351602c6 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] 10.222.0.20 "GET /compute/v2.1/servers/4267e7a6-74c2-4509-9d96-6a8075236937" status: 200 len: 1516 microversion: 2.1 time: 0.226083 Oct 04 18:53:04.018994 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2681/5308] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:03 2022] GET /compute/v2.1/servers/4267e7a6-74c2-4509-9d96-6a8075236937 => generated 1516 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:04.036003 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-bdb631e6-50cf-47a5-a166-8831c2870457 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:04.036890 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-bdb631e6-50cf-47a5-a166-8831c2870457 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] [instance: 4267e7a6-74c2-4509-9d96-6a8075236937] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:04.047538 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bdb631e6-50cf-47a5-a166-8831c2870457 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:04.048027 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bdb631e6-50cf-47a5-a166-8831c2870457 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:04.050470 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bdb631e6-50cf-47a5-a166-8831c2870457 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:04.053605 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bdb631e6-50cf-47a5-a166-8831c2870457 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:04.054599 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bdb631e6-50cf-47a5-a166-8831c2870457 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:04.055355 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bdb631e6-50cf-47a5-a166-8831c2870457 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:04.097361 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-bdb631e6-50cf-47a5-a166-8831c2870457 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] [instance: 4267e7a6-74c2-4509-9d96-6a8075236937] Going to try to terminate instance {{(pid=123002) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:53:04.100434 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=100 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:53:04.389486 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0df8c73f-8a2f-4dd5-93d6-fbad3fad191f tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:04.389486 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0df8c73f-8a2f-4dd5-93d6-fbad3fad191f tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] [instance: 317c7bd8-4f1e-4210-bb33-087557a1f4d6] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:04.395367 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0df8c73f-8a2f-4dd5-93d6-fbad3fad191f tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:04.396195 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0df8c73f-8a2f-4dd5-93d6-fbad3fad191f tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:04.396544 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0df8c73f-8a2f-4dd5-93d6-fbad3fad191f tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:04.397256 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0df8c73f-8a2f-4dd5-93d6-fbad3fad191f tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:04.398272 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0df8c73f-8a2f-4dd5-93d6-fbad3fad191f tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:04.398769 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0df8c73f-8a2f-4dd5-93d6-fbad3fad191f tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:04.467028 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-bdb631e6-50cf-47a5-a166-8831c2870457 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4267e7a6-74c2-4509-9d96-6a8075236937" status: 204 len: 0 microversion: 2.1 time: 0.434584 Oct 04 18:53:04.474051 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0df8c73f-8a2f-4dd5-93d6-fbad3fad191f tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:04.476503 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2628/5309] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:53:04 2022] DELETE /compute/v2.1/servers/4267e7a6-74c2-4509-9d96-6a8075236937 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:53:04.483943 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e7865cc3-2509-4b16-be42-58de340723ad tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:04.508289 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e7865cc3-2509-4b16-be42-58de340723ad tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] [instance: 4267e7a6-74c2-4509-9d96-6a8075236937] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:04.508601 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0df8c73f-8a2f-4dd5-93d6-fbad3fad191f tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:04.508601 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0df8c73f-8a2f-4dd5-93d6-fbad3fad191f tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:04.508601 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0df8c73f-8a2f-4dd5-93d6-fbad3fad191f tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] 10.222.0.20 "GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6" status: 200 len: 1605 microversion: 2.32 time: 0.106977 Oct 04 18:53:04.508601 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2682/5310] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:53:04 2022] GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6 => generated 1605 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:53:04.508967 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e7865cc3-2509-4b16-be42-58de340723ad tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:04.508967 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e7865cc3-2509-4b16-be42-58de340723ad tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:04.508967 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e7865cc3-2509-4b16-be42-58de340723ad tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:04.508967 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e7865cc3-2509-4b16-be42-58de340723ad tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:04.508967 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e7865cc3-2509-4b16-be42-58de340723ad tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:04.508967 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e7865cc3-2509-4b16-be42-58de340723ad tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:04.740962 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-68a72447-3177-48a6-86c6-e2af89107281 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:04.742683 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-68a72447-3177-48a6-86c6-e2af89107281 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9afd6ad-3b96-4a57-8301-5da830e674c7] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:04.748358 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e7865cc3-2509-4b16-be42-58de340723ad tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec940f2051b647afb6436356e773a769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3bae1b8ffa4fdb8a3be402743fbca6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:04.750565 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-68a72447-3177-48a6-86c6-e2af89107281 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:04.751463 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-68a72447-3177-48a6-86c6-e2af89107281 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:04.752750 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-68a72447-3177-48a6-86c6-e2af89107281 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:04.753687 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-68a72447-3177-48a6-86c6-e2af89107281 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:04.765303 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-68a72447-3177-48a6-86c6-e2af89107281 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:04.765303 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-68a72447-3177-48a6-86c6-e2af89107281 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:04.765697 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e7865cc3-2509-4b16-be42-58de340723ad tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] 10.222.0.20 "GET /compute/v2.1/servers/4267e7a6-74c2-4509-9d96-6a8075236937" status: 200 len: 1522 microversion: 2.1 time: 0.286405 Oct 04 18:53:04.780247 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2629/5311] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:04 2022] GET /compute/v2.1/servers/4267e7a6-74c2-4509-9d96-6a8075236937 => generated 1522 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:04.998368 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-68a72447-3177-48a6-86c6-e2af89107281 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:05.014242 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-68a72447-3177-48a6-86c6-e2af89107281 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7" status: 200 len: 1314 microversion: 2.1 time: 0.272707 Oct 04 18:53:05.014242 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2683/5312] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:04 2022] GET /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7 => generated 1314 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:05.328012 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-cddecbb0-05b7-4acb-bf01-63ffd6e3097e req-8343f49b-16fe-44ca-abc5-84661dbe0b4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9afd6ad-3b96-4a57-8301-5da830e674c7", "name": "network-vif-plugged", "status": "completed", "tag": "7cd90652-9ead-45c9-ac3b-182b9c2da3bb"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:53:05.359044 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-cddecbb0-05b7-4acb-bf01-63ffd6e3097e req-8343f49b-16fe-44ca-abc5-84661dbe0b4e service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:05.359899 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-cddecbb0-05b7-4acb-bf01-63ffd6e3097e req-8343f49b-16fe-44ca-abc5-84661dbe0b4e service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:05.360615 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-cddecbb0-05b7-4acb-bf01-63ffd6e3097e req-8343f49b-16fe-44ca-abc5-84661dbe0b4e service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:05.389454 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-cddecbb0-05b7-4acb-bf01-63ffd6e3097e req-8343f49b-16fe-44ca-abc5-84661dbe0b4e service nova] Creating event network-vif-plugged:7cd90652-9ead-45c9-ac3b-182b9c2da3bb for instance a9afd6ad-3b96-4a57-8301-5da830e674c7 on n-h2-850501-14 Oct 04 18:53:05.395486 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-cddecbb0-05b7-4acb-bf01-63ffd6e3097e req-8343f49b-16fe-44ca-abc5-84661dbe0b4e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076992 Oct 04 18:53:05.398753 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2630/5313] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:53:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:53:05.520726 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-273fb6ca-bd92-45a7-9fc0-28bbd44fd713 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:05.521530 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-273fb6ca-bd92-45a7-9fc0-28bbd44fd713 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] [instance: 317c7bd8-4f1e-4210-bb33-087557a1f4d6] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:05.530372 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-273fb6ca-bd92-45a7-9fc0-28bbd44fd713 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:05.538926 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-273fb6ca-bd92-45a7-9fc0-28bbd44fd713 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:05.538926 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-273fb6ca-bd92-45a7-9fc0-28bbd44fd713 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:05.538926 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-273fb6ca-bd92-45a7-9fc0-28bbd44fd713 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:05.538926 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-273fb6ca-bd92-45a7-9fc0-28bbd44fd713 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:05.538926 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-273fb6ca-bd92-45a7-9fc0-28bbd44fd713 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:05.674879 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-273fb6ca-bd92-45a7-9fc0-28bbd44fd713 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:05.691514 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-273fb6ca-bd92-45a7-9fc0-28bbd44fd713 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:05.693356 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-273fb6ca-bd92-45a7-9fc0-28bbd44fd713 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:05.695221 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-273fb6ca-bd92-45a7-9fc0-28bbd44fd713 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] 10.222.0.20 "GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6" status: 200 len: 1605 microversion: 2.32 time: 0.177984 Oct 04 18:53:05.717339 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2684/5314] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:53:05 2022] GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6 => generated 1605 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:53:05.788383 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-fd03a946-4da6-49fb-9013-bf0db3820e95 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:05.789076 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-fd03a946-4da6-49fb-9013-bf0db3820e95 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] [instance: 4267e7a6-74c2-4509-9d96-6a8075236937] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:05.796502 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fd03a946-4da6-49fb-9013-bf0db3820e95 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:05.797002 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fd03a946-4da6-49fb-9013-bf0db3820e95 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:05.798182 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fd03a946-4da6-49fb-9013-bf0db3820e95 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:05.799127 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fd03a946-4da6-49fb-9013-bf0db3820e95 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:05.799823 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fd03a946-4da6-49fb-9013-bf0db3820e95 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:05.800510 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fd03a946-4da6-49fb-9013-bf0db3820e95 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:06.033767 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-79c773e7-67cc-4509-8c25-0ddc13ed930b tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:06.034620 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-79c773e7-67cc-4509-8c25-0ddc13ed930b tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9afd6ad-3b96-4a57-8301-5da830e674c7] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:06.044262 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-79c773e7-67cc-4509-8c25-0ddc13ed930b tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:06.044974 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-79c773e7-67cc-4509-8c25-0ddc13ed930b tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:06.049653 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-79c773e7-67cc-4509-8c25-0ddc13ed930b tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:06.050942 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-79c773e7-67cc-4509-8c25-0ddc13ed930b tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:06.051564 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-79c773e7-67cc-4509-8c25-0ddc13ed930b tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:06.052914 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-79c773e7-67cc-4509-8c25-0ddc13ed930b tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:06.248289 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-fd03a946-4da6-49fb-9013-bf0db3820e95 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec940f2051b647afb6436356e773a769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3bae1b8ffa4fdb8a3be402743fbca6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:06.257259 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-fd03a946-4da6-49fb-9013-bf0db3820e95 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] 10.222.0.20 "GET /compute/v2.1/servers/4267e7a6-74c2-4509-9d96-6a8075236937" status: 200 len: 1522 microversion: 2.1 time: 0.473890 Oct 04 18:53:06.263179 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2631/5315] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:05 2022] GET /compute/v2.1/servers/4267e7a6-74c2-4509-9d96-6a8075236937 => generated 1522 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:06.332664 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-79c773e7-67cc-4509-8c25-0ddc13ed930b tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:06.343239 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-79c773e7-67cc-4509-8c25-0ddc13ed930b tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7" status: 200 len: 1314 microversion: 2.1 time: 0.313475 Oct 04 18:53:06.355272 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2685/5316] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:06 2022] GET /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7 => generated 1314 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:06.727924 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a148003c-2afc-49a6-ad72-b0a5fca554fd tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:06.727924 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a148003c-2afc-49a6-ad72-b0a5fca554fd tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] [instance: 317c7bd8-4f1e-4210-bb33-087557a1f4d6] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:06.754723 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a148003c-2afc-49a6-ad72-b0a5fca554fd tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:06.761797 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a148003c-2afc-49a6-ad72-b0a5fca554fd tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:06.761797 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a148003c-2afc-49a6-ad72-b0a5fca554fd tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:06.761797 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a148003c-2afc-49a6-ad72-b0a5fca554fd tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:06.761797 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a148003c-2afc-49a6-ad72-b0a5fca554fd tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:06.761797 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a148003c-2afc-49a6-ad72-b0a5fca554fd tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:06.865969 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a148003c-2afc-49a6-ad72-b0a5fca554fd tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:06.877280 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a148003c-2afc-49a6-ad72-b0a5fca554fd tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:06.879098 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a148003c-2afc-49a6-ad72-b0a5fca554fd tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:06.899696 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a148003c-2afc-49a6-ad72-b0a5fca554fd tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] 10.222.0.20 "GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6" status: 200 len: 1605 microversion: 2.32 time: 0.177479 Oct 04 18:53:06.900347 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2632/5317] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:53:06 2022] GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6 => generated 1605 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:53:06.977745 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-078e3262-4a37-41ec-bb3e-f82232a7fcf1 req-cc0eb855-e967-4ae9-b29c-ad7aaaa3c3da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4267e7a6-74c2-4509-9d96-6a8075236937", "name": "network-vif-deleted", "tag": "d47175d7-4bbf-41cd-a2d2-908a9318cf8e"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:53:06.995112 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-078e3262-4a37-41ec-bb3e-f82232a7fcf1 req-cc0eb855-e967-4ae9-b29c-ad7aaaa3c3da service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:06.997023 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-078e3262-4a37-41ec-bb3e-f82232a7fcf1 req-cc0eb855-e967-4ae9-b29c-ad7aaaa3c3da service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:06.997777 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-078e3262-4a37-41ec-bb3e-f82232a7fcf1 req-cc0eb855-e967-4ae9-b29c-ad7aaaa3c3da service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:07.021600 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-078e3262-4a37-41ec-bb3e-f82232a7fcf1 req-cc0eb855-e967-4ae9-b29c-ad7aaaa3c3da service nova] Creating event network-vif-deleted:d47175d7-4bbf-41cd-a2d2-908a9318cf8e for instance 4267e7a6-74c2-4509-9d96-6a8075236937 on n-h1-850501-14 Oct 04 18:53:07.029154 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-078e3262-4a37-41ec-bb3e-f82232a7fcf1 req-cc0eb855-e967-4ae9-b29c-ad7aaaa3c3da service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065410 Oct 04 18:53:07.030530 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2686/5318] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:53:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:53:07.288677 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6302b20d-a2c7-456a-b4e4-84bdcd92c90a tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:07.289995 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-6302b20d-a2c7-456a-b4e4-84bdcd92c90a tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] [instance: 4267e7a6-74c2-4509-9d96-6a8075236937] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:07.297150 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6302b20d-a2c7-456a-b4e4-84bdcd92c90a tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:07.297871 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6302b20d-a2c7-456a-b4e4-84bdcd92c90a tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:07.298649 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6302b20d-a2c7-456a-b4e4-84bdcd92c90a tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:07.300875 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6302b20d-a2c7-456a-b4e4-84bdcd92c90a tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:07.301542 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6302b20d-a2c7-456a-b4e4-84bdcd92c90a tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:07.302299 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6302b20d-a2c7-456a-b4e4-84bdcd92c90a tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:07.372669 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-84216e0d-b019-4fdf-88bd-de0e3dab4227 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:07.373747 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-84216e0d-b019-4fdf-88bd-de0e3dab4227 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9afd6ad-3b96-4a57-8301-5da830e674c7] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:07.381052 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-84216e0d-b019-4fdf-88bd-de0e3dab4227 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:07.388369 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-84216e0d-b019-4fdf-88bd-de0e3dab4227 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:07.389167 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-84216e0d-b019-4fdf-88bd-de0e3dab4227 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:07.390165 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-84216e0d-b019-4fdf-88bd-de0e3dab4227 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:07.390854 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-84216e0d-b019-4fdf-88bd-de0e3dab4227 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:07.391518 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-84216e0d-b019-4fdf-88bd-de0e3dab4227 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:07.448123 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-6302b20d-a2c7-456a-b4e4-84bdcd92c90a tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec940f2051b647afb6436356e773a769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3bae1b8ffa4fdb8a3be402743fbca6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:07.457731 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6302b20d-a2c7-456a-b4e4-84bdcd92c90a tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] 10.222.0.20 "GET /compute/v2.1/servers/4267e7a6-74c2-4509-9d96-6a8075236937" status: 200 len: 1308 microversion: 2.1 time: 0.174199 Oct 04 18:53:07.472684 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2633/5319] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:07 2022] GET /compute/v2.1/servers/4267e7a6-74c2-4509-9d96-6a8075236937 => generated 1308 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:07.594057 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-84216e0d-b019-4fdf-88bd-de0e3dab4227 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:07.605951 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-84216e0d-b019-4fdf-88bd-de0e3dab4227 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7" status: 200 len: 1314 microversion: 2.1 time: 0.235891 Oct 04 18:53:07.606658 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2687/5320] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:07 2022] GET /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7 => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:07.931048 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-45ab3725-7ffc-40e5-935f-025da2eeead3 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:07.932020 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-45ab3725-7ffc-40e5-935f-025da2eeead3 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] [instance: 317c7bd8-4f1e-4210-bb33-087557a1f4d6] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:07.944849 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-45ab3725-7ffc-40e5-935f-025da2eeead3 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:07.947461 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-45ab3725-7ffc-40e5-935f-025da2eeead3 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:07.947461 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-45ab3725-7ffc-40e5-935f-025da2eeead3 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:07.947461 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-45ab3725-7ffc-40e5-935f-025da2eeead3 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:07.947828 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-45ab3725-7ffc-40e5-935f-025da2eeead3 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:07.948335 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-45ab3725-7ffc-40e5-935f-025da2eeead3 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:08.047090 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-45ab3725-7ffc-40e5-935f-025da2eeead3 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:08.057970 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-45ab3725-7ffc-40e5-935f-025da2eeead3 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:08.059609 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-45ab3725-7ffc-40e5-935f-025da2eeead3 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:08.060861 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-45ab3725-7ffc-40e5-935f-025da2eeead3 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] 10.222.0.20 "GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6" status: 200 len: 1605 microversion: 2.32 time: 0.133777 Oct 04 18:53:08.061546 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2634/5321] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:53:07 2022] GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6 => generated 1605 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:53:08.482180 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f24198e1-6be9-4429-b5a2-70c8d93fd818 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:08.483776 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f24198e1-6be9-4429-b5a2-70c8d93fd818 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] [instance: 4267e7a6-74c2-4509-9d96-6a8075236937] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:08.505450 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f24198e1-6be9-4429-b5a2-70c8d93fd818 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:08.505450 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f24198e1-6be9-4429-b5a2-70c8d93fd818 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:08.505450 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f24198e1-6be9-4429-b5a2-70c8d93fd818 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:08.505450 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f24198e1-6be9-4429-b5a2-70c8d93fd818 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:08.505450 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f24198e1-6be9-4429-b5a2-70c8d93fd818 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:08.506147 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f24198e1-6be9-4429-b5a2-70c8d93fd818 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:08.536532 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-f24198e1-6be9-4429-b5a2-70c8d93fd818 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] HTTP exception thrown: Instance 4267e7a6-74c2-4509-9d96-6a8075236937 could not be found. Oct 04 18:53:08.541324 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f24198e1-6be9-4429-b5a2-70c8d93fd818 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Request method failure captured: Oct 04 18:53:08.541324 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/4267e7a6-74c2-4509-9d96-6a8075236937 HTTP/1.1 Oct 04 18:53:08.541324 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:53:08.541324 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:53:08.541324 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:53:08.541324 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:53:08.541324 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:53:08.541324 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:53:08.541324 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:53:08.541324 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:53:08.541324 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPIDz-AINW-m2COs41Yxxm3xwCWNxUS9OTeoK0Fh1LsrYTv0jdeaQIKQiPuSRczxs2KgYMllwaZ7bEn-Mec4GNYFkt_T6tecuJMAGqK81k1j5xsz6NLYA5OlMlYH95ZFFRGCCpC3cvXFYkdTFTcRZ-v77_4AB8Ul-7yCDUGOXhU8ttSI Oct 04 18:53:08.541324 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:53:08.541324 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:53:08.541324 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:53:08.541324 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:53:08.541324 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:53:08.541324 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:53:08.541324 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 9d3bae1b8ffa4fdb8a3be402743fbca6 Oct 04 18:53:08.541324 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ListServersNegativeTestJSON-741628576 Oct 04 18:53:08.541324 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:53:08.541324 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:53:08.541324 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9d3bae1b8ffa4fdb8a3be402743fbca6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9d3bae1b8ffa4fdb8a3be402743fbca6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9d3bae1b8ffa4fdb8a3be402743fbca6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9d3bae1b8ffa4fdb8a3be402743fbca6"}]}] Oct 04 18:53:08.541324 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ListServersNegativeTestJSON-741628576 Oct 04 18:53:08.541324 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 9d3bae1b8ffa4fdb8a3be402743fbca6 Oct 04 18:53:08.541324 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-741628576 Oct 04 18:53:08.541324 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ListServersNegativeTestJSON-741628576-project Oct 04 18:53:08.541324 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:53:08.541324 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:53:08.541324 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: ec940f2051b647afb6436356e773a769 Oct 04 18:53:08.541324 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ListServersNegativeTestJSON-741628576-project Oct 04 18:53:08.541324 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:53:08.541324 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 4267e7a6-74c2-4509-9d96-6a8075236937 could not be found. Oct 04 18:53:08.541324 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '4267e7a6-74c2-4509-9d96-6a8075236937'} Oct 04 18:53:08.541324 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:53:08.541324 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:08.541324 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:53:08.541324 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:53:08.541324 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:53:08.541324 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:53:08.541324 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:53:08.541324 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:53:08.541324 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:53:08.541324 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:53:08.541324 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4267e7a6-74c2-4509-9d96-6a8075236937 could not be found. Oct 04 18:53:08.541324 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:53:08.541324 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:53:08.541324 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:53:08.541324 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:08.541324 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:53:08.541324 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:53:08.541324 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:53:08.541324 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:53:08.541324 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:53:08.541324 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:53:08.541324 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:53:08.541324 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:53:08.541324 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:53:08.541324 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:53:08.541324 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:53:08.541324 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:53:08.541324 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4267e7a6-74c2-4509-9d96-6a8075236937 could not be found. Oct 04 18:53:08.541324 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:53:08.541324 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:53:08.546950 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:53:08.546950 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:08.546950 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:53:08.546950 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:53:08.546950 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:53:08.546950 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:53:08.546950 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4267e7a6-74c2-4509-9d96-6a8075236937 could not be found. Oct 04 18:53:08.546950 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:53:08.549942 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f24198e1-6be9-4429-b5a2-70c8d93fd818 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Returning 404 to user: Instance 4267e7a6-74c2-4509-9d96-6a8075236937 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:53:08.551050 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f24198e1-6be9-4429-b5a2-70c8d93fd818 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] 10.222.0.20 "GET /compute/v2.1/servers/4267e7a6-74c2-4509-9d96-6a8075236937" status: 404 len: 111 microversion: 2.1 time: 0.073075 Oct 04 18:53:08.552233 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2688/5322] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:08 2022] GET /compute/v2.1/servers/4267e7a6-74c2-4509-9d96-6a8075236937 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:53:08.562334 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d845be2b-c898-46ee-b211-bc3d6fd4eba7 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:08.569633 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d845be2b-c898-46ee-b211-bc3d6fd4eba7 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ec940f2051b647afb6436356e773a769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3bae1b8ffa4fdb8a3be402743fbca6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:08.575336 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d845be2b-c898-46ee-b211-bc3d6fd4eba7 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '9d3bae1b8ffa4fdb8a3be402743fbca6'} {{(pid=123002) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:53:08.581813 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d845be2b-c898-46ee-b211-bc3d6fd4eba7 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:08.582301 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d845be2b-c898-46ee-b211-bc3d6fd4eba7 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:08.582736 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d845be2b-c898-46ee-b211-bc3d6fd4eba7 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:08.583464 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d845be2b-c898-46ee-b211-bc3d6fd4eba7 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:08.583915 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d845be2b-c898-46ee-b211-bc3d6fd4eba7 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:08.584457 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d845be2b-c898-46ee-b211-bc3d6fd4eba7 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:08.632992 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-664cd382-d533-4f64-a47c-b7b318348708 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:08.633940 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-664cd382-d533-4f64-a47c-b7b318348708 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9afd6ad-3b96-4a57-8301-5da830e674c7] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:08.640540 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-664cd382-d533-4f64-a47c-b7b318348708 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:08.641287 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-664cd382-d533-4f64-a47c-b7b318348708 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:08.641907 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-664cd382-d533-4f64-a47c-b7b318348708 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:08.642816 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-664cd382-d533-4f64-a47c-b7b318348708 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:08.643609 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-664cd382-d533-4f64-a47c-b7b318348708 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:08.644250 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-664cd382-d533-4f64-a47c-b7b318348708 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:08.751136 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d845be2b-c898-46ee-b211-bc3d6fd4eba7 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] 10.222.0.20 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.192968 Oct 04 18:53:08.757606 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2635/5323] 10.222.0.20 () {58 vars in 1230 bytes} [Tue Oct 4 18:53:08 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:53:08.777885 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d36116e7-3cd1-4fa6-86ff-dfd74d2eebb8 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:08.782337 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d36116e7-3cd1-4fa6-86ff-dfd74d2eebb8 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Request method failure captured: Oct 04 18:53:08.782337 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Oct 04 18:53:08.782337 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:53:08.782337 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:53:08.782337 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:53:08.782337 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:53:08.782337 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:53:08.782337 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:53:08.782337 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:53:08.782337 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:53:08.782337 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPIDz-AINW-m2COs41Yxxm3xwCWNxUS9OTeoK0Fh1LsrYTv0jdeaQIKQiPuSRczxs2KgYMllwaZ7bEn-Mec4GNYFkt_T6tecuJMAGqK81k1j5xsz6NLYA5OlMlYH95ZFFRGCCpC3cvXFYkdTFTcRZ-v77_4AB8Ul-7yCDUGOXhU8ttSI Oct 04 18:53:08.782337 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:53:08.782337 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:53:08.782337 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:53:08.782337 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:53:08.782337 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:53:08.782337 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:53:08.782337 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 9d3bae1b8ffa4fdb8a3be402743fbca6 Oct 04 18:53:08.782337 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ListServersNegativeTestJSON-741628576 Oct 04 18:53:08.782337 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:53:08.782337 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:53:08.782337 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9d3bae1b8ffa4fdb8a3be402743fbca6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9d3bae1b8ffa4fdb8a3be402743fbca6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9d3bae1b8ffa4fdb8a3be402743fbca6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9d3bae1b8ffa4fdb8a3be402743fbca6"}]}] Oct 04 18:53:08.782337 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ListServersNegativeTestJSON-741628576 Oct 04 18:53:08.782337 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 9d3bae1b8ffa4fdb8a3be402743fbca6 Oct 04 18:53:08.782337 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-741628576 Oct 04 18:53:08.782337 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ListServersNegativeTestJSON-741628576-project Oct 04 18:53:08.782337 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:53:08.782337 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:53:08.782337 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: ec940f2051b647afb6436356e773a769 Oct 04 18:53:08.782337 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ListServersNegativeTestJSON-741628576-project Oct 04 18:53:08.782337 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:53:08.782337 n-d-850501-14 devstack@n-api.service[123002]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 04 18:53:08.782337 n-d-850501-14 devstack@n-api.service[123002]: action_args: {} Oct 04 18:53:08.782337 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:53:08.782337 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:08.782337 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:53:08.782337 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:53:08.782337 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:53:08.782337 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:53:08.782337 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Oct 04 18:53:08.782337 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:53:08.782337 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Oct 04 18:53:08.782337 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Oct 04 18:53:08.782337 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:53:08.782337 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 04 18:53:08.782337 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi '2011/01/01' Oct 04 18:53:08.782337 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:53:08.782337 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:53:08.782337 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:53:08.782337 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:08.782337 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:53:08.782337 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:53:08.782337 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:53:08.782337 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:53:08.782337 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:53:08.782337 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:53:08.782337 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:53:08.782337 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:53:08.782337 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:53:08.782337 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:53:08.782337 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:53:08.782337 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:53:08.782337 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 04 18:53:08.782337 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 04 18:53:08.782337 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 04 18:53:08.782337 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:53:08.792544 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:53:08.792544 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:53:08.792544 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:53:08.792544 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 04 18:53:08.792544 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:53:08.792544 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:53:08.792544 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:53:08.792544 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:08.792544 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:53:08.792544 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:53:08.792544 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:53:08.792544 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:53:08.792544 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 04 18:53:08.792544 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:53:08.792544 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d36116e7-3cd1-4fa6-86ff-dfd74d2eebb8 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:53:08.792544 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d36116e7-3cd1-4fa6-86ff-dfd74d2eebb8 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] 10.222.0.20 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.017335 Oct 04 18:53:08.792544 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2636/5324] 10.222.0.20 () {58 vars in 1182 bytes} [Tue Oct 4 18:53:08 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 04 18:53:08.796363 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-cae1b713-b0a2-4444-abe1-21b5b2011bd6 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:08.801410 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-cae1b713-b0a2-4444-abe1-21b5b2011bd6 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ec940f2051b647afb6436356e773a769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3bae1b8ffa4fdb8a3be402743fbca6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:08.802313 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-cae1b713-b0a2-4444-abe1-21b5b2011bd6 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Searching by: {'deleted': False, 'project_id': '9d3bae1b8ffa4fdb8a3be402743fbca6'} {{(pid=123002) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:53:08.809540 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cae1b713-b0a2-4444-abe1-21b5b2011bd6 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:08.810293 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cae1b713-b0a2-4444-abe1-21b5b2011bd6 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:08.810981 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cae1b713-b0a2-4444-abe1-21b5b2011bd6 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:08.812175 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cae1b713-b0a2-4444-abe1-21b5b2011bd6 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:08.814846 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cae1b713-b0a2-4444-abe1-21b5b2011bd6 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:08.814846 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cae1b713-b0a2-4444-abe1-21b5b2011bd6 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:08.843272 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.multi_cell_list [None req-cae1b713-b0a2-4444-abe1-21b5b2011bd6 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=123002) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:53:08.892104 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-cae1b713-b0a2-4444-abe1-21b5b2011bd6 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.099337 Oct 04 18:53:08.894014 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2637/5325] 10.222.0.20 () {58 vars in 1125 bytes} [Tue Oct 4 18:53:08 2022] GET /compute/v2.1/servers => generated 683 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:53:08.909048 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-90edcd3c-8d25-468b-8058-1c309a712ae9 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:08.914835 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-90edcd3c-8d25-468b-8058-1c309a712ae9 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ec940f2051b647afb6436356e773a769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3bae1b8ffa4fdb8a3be402743fbca6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:08.916964 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.compute.servers [None req-90edcd3c-8d25-468b-8058-1c309a712ae9 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Removing options 'limit' from query {{(pid=123002) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 04 18:53:08.917964 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-90edcd3c-8d25-468b-8058-1c309a712ae9 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Searching by: {'deleted': False, 'project_id': '9d3bae1b8ffa4fdb8a3be402743fbca6'} {{(pid=123002) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:53:08.927580 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-664cd382-d533-4f64-a47c-b7b318348708 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:08.944654 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-664cd382-d533-4f64-a47c-b7b318348708 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7" status: 200 len: 1500 microversion: 2.1 time: 0.317430 Oct 04 18:53:08.947768 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2689/5326] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:08 2022] GET /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7 => generated 1500 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:08.950214 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-90edcd3c-8d25-468b-8058-1c309a712ae9 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:08.951540 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-90edcd3c-8d25-468b-8058-1c309a712ae9 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:08.952248 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-90edcd3c-8d25-468b-8058-1c309a712ae9 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:08.953200 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-90edcd3c-8d25-468b-8058-1c309a712ae9 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:08.954099 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-90edcd3c-8d25-468b-8058-1c309a712ae9 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:08.955180 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-90edcd3c-8d25-468b-8058-1c309a712ae9 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:08.972616 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b76f5a3c-af88-4544-9cca-acef5fb1b2c1 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:53:08.982758 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b76f5a3c-af88-4544-9cca-acef5fb1b2c1 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:08.987486 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b76f5a3c-af88-4544-9cca-acef5fb1b2c1 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:08.988238 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b76f5a3c-af88-4544-9cca-acef5fb1b2c1 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:09.023296 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.multi_cell_list [None req-90edcd3c-8d25-468b-8058-1c309a712ae9 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=123002) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:53:09.031312 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b76f5a3c-af88-4544-9cca-acef5fb1b2c1 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9afd6ad-3b96-4a57-8301-5da830e674c7] Going to try to stop instance {{(pid=123001) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 18:53:09.075441 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-90edcd3c-8d25-468b-8058-1c309a712ae9 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] 10.222.0.20 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.169571 Oct 04 18:53:09.076965 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2638/5327] 10.222.0.20 () {58 vars in 1144 bytes} [Tue Oct 4 18:53:08 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:53:09.091978 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-fdfe6761-abfd-44b5-a6e0-ae6ed77ec2d3 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:09.093952 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-fdfe6761-abfd-44b5-a6e0-ae6ed77ec2d3 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] [instance: 317c7bd8-4f1e-4210-bb33-087557a1f4d6] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:09.114434 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fdfe6761-abfd-44b5-a6e0-ae6ed77ec2d3 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:09.117726 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fdfe6761-abfd-44b5-a6e0-ae6ed77ec2d3 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:09.119268 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fdfe6761-abfd-44b5-a6e0-ae6ed77ec2d3 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:09.120994 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fdfe6761-abfd-44b5-a6e0-ae6ed77ec2d3 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:09.123151 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fdfe6761-abfd-44b5-a6e0-ae6ed77ec2d3 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:09.125044 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fdfe6761-abfd-44b5-a6e0-ae6ed77ec2d3 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:09.237221 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-fdfe6761-abfd-44b5-a6e0-ae6ed77ec2d3 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:09.256775 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-fdfe6761-abfd-44b5-a6e0-ae6ed77ec2d3 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:09.258241 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-fdfe6761-abfd-44b5-a6e0-ae6ed77ec2d3 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:09.259444 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-fdfe6761-abfd-44b5-a6e0-ae6ed77ec2d3 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] 10.222.0.20 "GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6" status: 200 len: 1605 microversion: 2.32 time: 0.176468 Oct 04 18:53:09.260014 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2639/5328] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:53:09 2022] GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6 => generated 1605 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:53:09.279809 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8f4b7817-b237-43db-86a8-d78e19af1bff tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:09.283922 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8f4b7817-b237-43db-86a8-d78e19af1bff tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Request method failure captured: Oct 04 18:53:09.283922 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Oct 04 18:53:09.283922 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:53:09.283922 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:53:09.283922 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:53:09.283922 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:53:09.283922 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:53:09.283922 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:53:09.283922 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:53:09.283922 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:53:09.283922 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPIDz-AINW-m2COs41Yxxm3xwCWNxUS9OTeoK0Fh1LsrYTv0jdeaQIKQiPuSRczxs2KgYMllwaZ7bEn-Mec4GNYFkt_T6tecuJMAGqK81k1j5xsz6NLYA5OlMlYH95ZFFRGCCpC3cvXFYkdTFTcRZ-v77_4AB8Ul-7yCDUGOXhU8ttSI Oct 04 18:53:09.283922 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:53:09.283922 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:53:09.283922 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:53:09.283922 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:53:09.283922 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:53:09.283922 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:53:09.283922 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 9d3bae1b8ffa4fdb8a3be402743fbca6 Oct 04 18:53:09.283922 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ListServersNegativeTestJSON-741628576 Oct 04 18:53:09.283922 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:53:09.283922 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:53:09.283922 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9d3bae1b8ffa4fdb8a3be402743fbca6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9d3bae1b8ffa4fdb8a3be402743fbca6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9d3bae1b8ffa4fdb8a3be402743fbca6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9d3bae1b8ffa4fdb8a3be402743fbca6"}]}] Oct 04 18:53:09.283922 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ListServersNegativeTestJSON-741628576 Oct 04 18:53:09.283922 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 9d3bae1b8ffa4fdb8a3be402743fbca6 Oct 04 18:53:09.283922 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-741628576 Oct 04 18:53:09.283922 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ListServersNegativeTestJSON-741628576-project Oct 04 18:53:09.283922 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:53:09.283922 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:53:09.283922 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: ec940f2051b647afb6436356e773a769 Oct 04 18:53:09.283922 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ListServersNegativeTestJSON-741628576-project Oct 04 18:53:09.283922 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:53:09.283922 n-d-850501-14 devstack@n-api.service[123002]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 04 18:53:09.283922 n-d-850501-14 devstack@n-api.service[123002]: action_args: {} Oct 04 18:53:09.283922 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:53:09.283922 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:09.283922 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:53:09.283922 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:53:09.283922 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:53:09.283922 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:53:09.283922 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Oct 04 18:53:09.283922 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:53:09.283922 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 04 18:53:09.283922 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 04 18:53:09.283922 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 04 18:53:09.283922 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 04 18:53:09.283922 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 04 18:53:09.283922 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:53:09.283922 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 04 18:53:09.283922 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi '-1' Oct 04 18:53:09.283922 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:53:09.283922 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:53:09.283922 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:53:09.283922 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:09.283922 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:53:09.283922 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:53:09.283922 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:53:09.283922 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:53:09.283922 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:53:09.283922 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:53:09.283922 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:53:09.283922 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:53:09.283922 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:53:09.283922 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:53:09.283922 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:53:09.283922 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:53:09.283922 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 04 18:53:09.283922 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 04 18:53:09.283922 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 04 18:53:09.296023 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:53:09.296023 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:53:09.296023 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:53:09.296023 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:53:09.296023 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 04 18:53:09.296023 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:53:09.296023 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:53:09.296023 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:53:09.296023 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:09.296023 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:53:09.296023 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:53:09.296023 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:53:09.296023 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:53:09.296023 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 04 18:53:09.296023 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:53:09.296023 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8f4b7817-b237-43db-86a8-d78e19af1bff tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:53:09.296023 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8f4b7817-b237-43db-86a8-d78e19af1bff tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] 10.222.0.20 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.024377 Oct 04 18:53:09.296023 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2640/5329] 10.222.0.20 () {58 vars in 1142 bytes} [Tue Oct 4 18:53:09 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:53:09.303469 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9da56398-0550-40bf-9bdc-2ea8399aa97d tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:09.311352 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9da56398-0550-40bf-9bdc-2ea8399aa97d tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Request method failure captured: Oct 04 18:53:09.311352 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Oct 04 18:53:09.311352 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:53:09.311352 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:53:09.311352 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:53:09.311352 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:53:09.311352 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:53:09.311352 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:53:09.311352 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:53:09.311352 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:53:09.311352 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPIDz-AINW-m2COs41Yxxm3xwCWNxUS9OTeoK0Fh1LsrYTv0jdeaQIKQiPuSRczxs2KgYMllwaZ7bEn-Mec4GNYFkt_T6tecuJMAGqK81k1j5xsz6NLYA5OlMlYH95ZFFRGCCpC3cvXFYkdTFTcRZ-v77_4AB8Ul-7yCDUGOXhU8ttSI Oct 04 18:53:09.311352 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:53:09.311352 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:53:09.311352 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:53:09.311352 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:53:09.311352 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:53:09.311352 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:53:09.311352 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 9d3bae1b8ffa4fdb8a3be402743fbca6 Oct 04 18:53:09.311352 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ListServersNegativeTestJSON-741628576 Oct 04 18:53:09.311352 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:53:09.311352 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:53:09.311352 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9d3bae1b8ffa4fdb8a3be402743fbca6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9d3bae1b8ffa4fdb8a3be402743fbca6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9d3bae1b8ffa4fdb8a3be402743fbca6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9d3bae1b8ffa4fdb8a3be402743fbca6"}]}] Oct 04 18:53:09.311352 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ListServersNegativeTestJSON-741628576 Oct 04 18:53:09.311352 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 9d3bae1b8ffa4fdb8a3be402743fbca6 Oct 04 18:53:09.311352 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-741628576 Oct 04 18:53:09.311352 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ListServersNegativeTestJSON-741628576-project Oct 04 18:53:09.311352 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:53:09.311352 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:53:09.311352 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: ec940f2051b647afb6436356e773a769 Oct 04 18:53:09.311352 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ListServersNegativeTestJSON-741628576-project Oct 04 18:53:09.311352 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:53:09.311352 n-d-850501-14 devstack@n-api.service[123002]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 04 18:53:09.311352 n-d-850501-14 devstack@n-api.service[123002]: action_args: {} Oct 04 18:53:09.311352 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:53:09.311352 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:09.311352 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:53:09.311352 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:53:09.311352 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:53:09.311352 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:53:09.311352 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Oct 04 18:53:09.311352 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:53:09.311352 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 04 18:53:09.311352 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 04 18:53:09.311352 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 04 18:53:09.311352 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 04 18:53:09.311352 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 04 18:53:09.311352 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:53:09.311352 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 04 18:53:09.311352 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi 'testing' Oct 04 18:53:09.311352 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:53:09.311352 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:53:09.311352 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:53:09.311352 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:09.311352 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:53:09.311352 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:53:09.311352 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:53:09.311352 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:53:09.311352 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:53:09.311352 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:53:09.311352 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:53:09.311352 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:53:09.311352 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:53:09.311352 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:53:09.311352 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:53:09.311352 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:53:09.311352 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 04 18:53:09.311352 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 04 18:53:09.311352 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 04 18:53:09.317114 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:53:09.317114 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:53:09.317114 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:53:09.317114 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:53:09.317114 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 04 18:53:09.317114 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:53:09.317114 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:53:09.317114 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:53:09.317114 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:09.317114 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:53:09.317114 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:53:09.317114 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:53:09.317114 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:53:09.317114 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 04 18:53:09.317114 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:53:09.317114 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9da56398-0550-40bf-9bdc-2ea8399aa97d tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:53:09.317114 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9da56398-0550-40bf-9bdc-2ea8399aa97d tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] 10.222.0.20 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.014328 Oct 04 18:53:09.327538 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2641/5330] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Oct 4 18:53:09 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 04 18:53:09.327538 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-35c302b5-eb59-4d0e-b078-3f8b65187dab tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:09.337419 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-35c302b5-eb59-4d0e-b078-3f8b65187dab tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ec940f2051b647afb6436356e773a769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3bae1b8ffa4fdb8a3be402743fbca6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:09.350617 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b76f5a3c-af88-4544-9cca-acef5fb1b2c1 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "POST /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7/action" status: 202 len: 0 microversion: 2.1 time: 0.381682 Oct 04 18:53:09.351185 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2690/5331] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:53:08 2022] POST /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7/action => generated 0 bytes in 383 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:53:09.353969 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-35c302b5-eb59-4d0e-b078-3f8b65187dab tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '9d3bae1b8ffa4fdb8a3be402743fbca6'} {{(pid=123002) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:53:09.375476 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-85931a3f-b719-4f3a-9a3d-7ff59e3330e6 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:09.380596 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-85931a3f-b719-4f3a-9a3d-7ff59e3330e6 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9afd6ad-3b96-4a57-8301-5da830e674c7] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:09.389615 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.compute.servers [None req-35c302b5-eb59-4d0e-b078-3f8b65187dab tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Flavor 'non_existing_flavor' could not be found {{(pid=123002) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Oct 04 18:53:09.393444 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-35c302b5-eb59-4d0e-b078-3f8b65187dab tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] 10.222.0.20 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.068746 Oct 04 18:53:09.393712 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-85931a3f-b719-4f3a-9a3d-7ff59e3330e6 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:09.395885 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2642/5332] 10.222.0.20 () {58 vars in 1178 bytes} [Tue Oct 4 18:53:09 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:53:09.407869 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-85931a3f-b719-4f3a-9a3d-7ff59e3330e6 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:09.408630 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-85931a3f-b719-4f3a-9a3d-7ff59e3330e6 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:09.409113 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-eefa0963-d41b-43d3-8a6b-5b6b263a2c6a tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:09.409456 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-85931a3f-b719-4f3a-9a3d-7ff59e3330e6 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:09.409886 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-85931a3f-b719-4f3a-9a3d-7ff59e3330e6 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:09.410375 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-85931a3f-b719-4f3a-9a3d-7ff59e3330e6 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:09.425308 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-eefa0963-d41b-43d3-8a6b-5b6b263a2c6a tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ec940f2051b647afb6436356e773a769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3bae1b8ffa4fdb8a3be402743fbca6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:09.427298 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-eefa0963-d41b-43d3-8a6b-5b6b263a2c6a tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '9d3bae1b8ffa4fdb8a3be402743fbca6'} {{(pid=123002) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:53:09.438606 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eefa0963-d41b-43d3-8a6b-5b6b263a2c6a tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:09.439095 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eefa0963-d41b-43d3-8a6b-5b6b263a2c6a tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:09.439532 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eefa0963-d41b-43d3-8a6b-5b6b263a2c6a tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:09.444671 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eefa0963-d41b-43d3-8a6b-5b6b263a2c6a tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:09.448481 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eefa0963-d41b-43d3-8a6b-5b6b263a2c6a tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:09.449215 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eefa0963-d41b-43d3-8a6b-5b6b263a2c6a tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:09.567588 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-eefa0963-d41b-43d3-8a6b-5b6b263a2c6a tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] 10.222.0.20 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.163098 Oct 04 18:53:09.576879 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2643/5333] 10.222.0.20 () {58 vars in 1174 bytes} [Tue Oct 4 18:53:09 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:53:09.581811 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-06aed71b-dd19-4f1b-8af3-835056ad71bf tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:09.587544 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-06aed71b-dd19-4f1b-8af3-835056ad71bf tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ec940f2051b647afb6436356e773a769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3bae1b8ffa4fdb8a3be402743fbca6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:09.588516 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-06aed71b-dd19-4f1b-8af3-835056ad71bf tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '9d3bae1b8ffa4fdb8a3be402743fbca6'} {{(pid=123002) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:53:09.594007 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-06aed71b-dd19-4f1b-8af3-835056ad71bf tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:09.595160 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-06aed71b-dd19-4f1b-8af3-835056ad71bf tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:09.596079 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-06aed71b-dd19-4f1b-8af3-835056ad71bf tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:09.597006 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-06aed71b-dd19-4f1b-8af3-835056ad71bf tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:09.597622 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-06aed71b-dd19-4f1b-8af3-835056ad71bf tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:09.598316 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-06aed71b-dd19-4f1b-8af3-835056ad71bf tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:09.699417 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-06aed71b-dd19-4f1b-8af3-835056ad71bf tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] 10.222.0.20 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.121239 Oct 04 18:53:09.700438 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2644/5334] 10.222.0.20 () {58 vars in 1184 bytes} [Tue Oct 4 18:53:09 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:53:09.704476 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-85931a3f-b719-4f3a-9a3d-7ff59e3330e6 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:09.718234 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d2b5f822-a522-40df-aa06-dffb73881fe4 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:09.719476 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-85931a3f-b719-4f3a-9a3d-7ff59e3330e6 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7" status: 200 len: 1510 microversion: 2.1 time: 0.363783 Oct 04 18:53:09.720582 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2691/5335] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:09 2022] GET /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7 => generated 1510 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:53:09.726112 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d2b5f822-a522-40df-aa06-dffb73881fe4 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ec940f2051b647afb6436356e773a769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3bae1b8ffa4fdb8a3be402743fbca6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:09.727129 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d2b5f822-a522-40df-aa06-dffb73881fe4 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Searching by: {'deleted': False, 'project_id': '9d3bae1b8ffa4fdb8a3be402743fbca6'} {{(pid=123002) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:53:09.754752 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d2b5f822-a522-40df-aa06-dffb73881fe4 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:09.755555 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d2b5f822-a522-40df-aa06-dffb73881fe4 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:09.756215 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d2b5f822-a522-40df-aa06-dffb73881fe4 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:09.757478 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d2b5f822-a522-40df-aa06-dffb73881fe4 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:09.760910 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d2b5f822-a522-40df-aa06-dffb73881fe4 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:09.761553 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d2b5f822-a522-40df-aa06-dffb73881fe4 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:09.820849 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.multi_cell_list [None req-d2b5f822-a522-40df-aa06-dffb73881fe4 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=123002) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:53:09.910253 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d2b5f822-a522-40df-aa06-dffb73881fe4 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec940f2051b647afb6436356e773a769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3bae1b8ffa4fdb8a3be402743fbca6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:09.922735 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d2b5f822-a522-40df-aa06-dffb73881fe4 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:09.923231 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d2b5f822-a522-40df-aa06-dffb73881fe4 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:09.925179 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d2b5f822-a522-40df-aa06-dffb73881fe4 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:10.175164 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d2b5f822-a522-40df-aa06-dffb73881fe4 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] 10.222.0.20 "GET /compute/v2.1/servers/detail" status: 200 len: 3026 microversion: 2.1 time: 0.460614 Oct 04 18:53:10.176124 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2645/5336] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Oct 4 18:53:09 2022] GET /compute/v2.1/servers/detail => generated 3026 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:10.207722 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-386056e4-2512-4bb2-90ff-f9ae4f6e7586 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:10.228554 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-386056e4-2512-4bb2-90ff-f9ae4f6e7586 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ec940f2051b647afb6436356e773a769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3bae1b8ffa4fdb8a3be402743fbca6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:10.229968 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-386056e4-2512-4bb2-90ff-f9ae4f6e7586 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] 10.222.0.20 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.032027 Oct 04 18:53:10.230541 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2692/5337] 10.222.0.20 () {58 vars in 1178 bytes} [Tue Oct 4 18:53:10 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:53:10.248404 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-78db537f-fe0a-44d5-9d84-8b29126d9ad0 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:10.258277 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-78db537f-fe0a-44d5-9d84-8b29126d9ad0 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ec940f2051b647afb6436356e773a769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3bae1b8ffa4fdb8a3be402743fbca6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:10.258277 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-78db537f-fe0a-44d5-9d84-8b29126d9ad0 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Searching by: {'deleted': False, 'project_id': '9d3bae1b8ffa4fdb8a3be402743fbca6'} {{(pid=123002) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:53:10.268935 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-78db537f-fe0a-44d5-9d84-8b29126d9ad0 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:10.269432 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-78db537f-fe0a-44d5-9d84-8b29126d9ad0 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:10.269877 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-78db537f-fe0a-44d5-9d84-8b29126d9ad0 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:10.270646 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-78db537f-fe0a-44d5-9d84-8b29126d9ad0 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:10.271113 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-78db537f-fe0a-44d5-9d84-8b29126d9ad0 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:10.271536 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-78db537f-fe0a-44d5-9d84-8b29126d9ad0 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:10.290598 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5967bfae-a700-4ed4-8f40-3a260b8a008a tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:10.293930 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5967bfae-a700-4ed4-8f40-3a260b8a008a tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] [instance: 317c7bd8-4f1e-4210-bb33-087557a1f4d6] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:10.304938 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5967bfae-a700-4ed4-8f40-3a260b8a008a tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:10.305724 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5967bfae-a700-4ed4-8f40-3a260b8a008a tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:10.306345 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5967bfae-a700-4ed4-8f40-3a260b8a008a tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:10.307268 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5967bfae-a700-4ed4-8f40-3a260b8a008a tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:10.308089 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5967bfae-a700-4ed4-8f40-3a260b8a008a tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:10.308701 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5967bfae-a700-4ed4-8f40-3a260b8a008a tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:10.315711 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.multi_cell_list [None req-78db537f-fe0a-44d5-9d84-8b29126d9ad0 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=123002) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:53:10.372538 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-78db537f-fe0a-44d5-9d84-8b29126d9ad0 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.129666 Oct 04 18:53:10.373868 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2646/5338] 10.222.0.20 () {58 vars in 1125 bytes} [Tue Oct 4 18:53:10 2022] GET /compute/v2.1/servers => generated 683 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:53:10.386721 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-437ca157-6687-4d62-909f-91c8f5987416 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:10.387604 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-437ca157-6687-4d62-909f-91c8f5987416 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] [instance: 4267e7a6-74c2-4509-9d96-6a8075236937] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:10.395528 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-437ca157-6687-4d62-909f-91c8f5987416 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:10.396559 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-437ca157-6687-4d62-909f-91c8f5987416 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:10.397740 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-437ca157-6687-4d62-909f-91c8f5987416 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:10.398748 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-437ca157-6687-4d62-909f-91c8f5987416 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:10.399411 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-437ca157-6687-4d62-909f-91c8f5987416 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:10.400041 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-437ca157-6687-4d62-909f-91c8f5987416 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:10.412416 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5967bfae-a700-4ed4-8f40-3a260b8a008a tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:10.417556 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-437ca157-6687-4d62-909f-91c8f5987416 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] HTTP exception thrown: Instance 4267e7a6-74c2-4509-9d96-6a8075236937 could not be found. Oct 04 18:53:10.419355 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-437ca157-6687-4d62-909f-91c8f5987416 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Request method failure captured: Oct 04 18:53:10.419355 n-d-850501-14 devstack@n-api.service[123002]: request: DELETE /compute/v2.1/servers/4267e7a6-74c2-4509-9d96-6a8075236937 HTTP/1.1 Oct 04 18:53:10.419355 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:53:10.419355 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:53:10.419355 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:53:10.419355 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:53:10.419355 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:53:10.419355 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:53:10.419355 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:53:10.419355 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:53:10.419355 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPIDz-AINW-m2COs41Yxxm3xwCWNxUS9OTeoK0Fh1LsrYTv0jdeaQIKQiPuSRczxs2KgYMllwaZ7bEn-Mec4GNYFkt_T6tecuJMAGqK81k1j5xsz6NLYA5OlMlYH95ZFFRGCCpC3cvXFYkdTFTcRZ-v77_4AB8Ul-7yCDUGOXhU8ttSI Oct 04 18:53:10.419355 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:53:10.419355 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:53:10.419355 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:53:10.419355 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:53:10.419355 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:53:10.419355 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:53:10.419355 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 9d3bae1b8ffa4fdb8a3be402743fbca6 Oct 04 18:53:10.419355 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ListServersNegativeTestJSON-741628576 Oct 04 18:53:10.419355 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:53:10.419355 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:53:10.419355 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9d3bae1b8ffa4fdb8a3be402743fbca6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9d3bae1b8ffa4fdb8a3be402743fbca6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9d3bae1b8ffa4fdb8a3be402743fbca6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9d3bae1b8ffa4fdb8a3be402743fbca6"}]}] Oct 04 18:53:10.419355 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ListServersNegativeTestJSON-741628576 Oct 04 18:53:10.419355 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 9d3bae1b8ffa4fdb8a3be402743fbca6 Oct 04 18:53:10.419355 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-741628576 Oct 04 18:53:10.419355 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ListServersNegativeTestJSON-741628576-project Oct 04 18:53:10.419355 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:53:10.419355 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:53:10.419355 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: ec940f2051b647afb6436356e773a769 Oct 04 18:53:10.419355 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ListServersNegativeTestJSON-741628576-project Oct 04 18:53:10.419355 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:53:10.419355 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 4267e7a6-74c2-4509-9d96-6a8075236937 could not be found. Oct 04 18:53:10.419355 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '4267e7a6-74c2-4509-9d96-6a8075236937'} Oct 04 18:53:10.419355 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:53:10.419355 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:10.419355 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:53:10.419355 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:53:10.419355 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:53:10.419355 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:53:10.419355 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:53:10.419355 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:53:10.419355 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:53:10.419355 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:53:10.419355 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4267e7a6-74c2-4509-9d96-6a8075236937 could not be found. Oct 04 18:53:10.419355 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:53:10.419355 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:53:10.419355 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:53:10.419355 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:10.419355 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:53:10.419355 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:53:10.419355 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:53:10.419355 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:53:10.419355 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:53:10.419355 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:53:10.419355 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:53:10.419355 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:53:10.419355 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:53:10.419355 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:53:10.419355 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:53:10.419355 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:53:10.419355 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:53:10.419355 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:53:10.426634 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4267e7a6-74c2-4509-9d96-6a8075236937 could not be found. Oct 04 18:53:10.426634 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:53:10.426634 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:53:10.426634 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:53:10.426634 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:10.426634 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:53:10.426634 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:53:10.426634 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:53:10.426634 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:53:10.426634 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4267e7a6-74c2-4509-9d96-6a8075236937 could not be found. Oct 04 18:53:10.426634 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:53:10.426634 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-437ca157-6687-4d62-909f-91c8f5987416 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Returning 404 to user: Instance 4267e7a6-74c2-4509-9d96-6a8075236937 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:53:10.426634 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-437ca157-6687-4d62-909f-91c8f5987416 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4267e7a6-74c2-4509-9d96-6a8075236937" status: 404 len: 111 microversion: 2.1 time: 0.038165 Oct 04 18:53:10.426634 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2647/5339] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:53:10 2022] DELETE /compute/v2.1/servers/4267e7a6-74c2-4509-9d96-6a8075236937 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:53:10.432429 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5967bfae-a700-4ed4-8f40-3a260b8a008a tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:10.434290 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5967bfae-a700-4ed4-8f40-3a260b8a008a tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:10.434775 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1a573899-34a4-44af-b392-5234e24dfcac tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:10.435684 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1a573899-34a4-44af-b392-5234e24dfcac tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] [instance: 1236cea0-3e65-4b7d-861d-eb75d62a5af2] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:10.435818 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5967bfae-a700-4ed4-8f40-3a260b8a008a tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] 10.222.0.20 "GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6" status: 200 len: 1605 microversion: 2.32 time: 0.149580 Oct 04 18:53:10.442170 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2693/5340] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:53:10 2022] GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6 => generated 1605 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:53:10.442761 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1a573899-34a4-44af-b392-5234e24dfcac tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:10.443764 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1a573899-34a4-44af-b392-5234e24dfcac tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:10.445765 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1a573899-34a4-44af-b392-5234e24dfcac tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:10.447444 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1a573899-34a4-44af-b392-5234e24dfcac tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:10.448651 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1a573899-34a4-44af-b392-5234e24dfcac tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:10.450316 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1a573899-34a4-44af-b392-5234e24dfcac tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:10.486264 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1a573899-34a4-44af-b392-5234e24dfcac tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] [instance: 1236cea0-3e65-4b7d-861d-eb75d62a5af2] Going to try to terminate instance {{(pid=123002) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:53:10.530764 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:53:10.750646 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-64d523ae-2c13-46f0-9e20-64103666a1f2 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:10.751452 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-64d523ae-2c13-46f0-9e20-64103666a1f2 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9afd6ad-3b96-4a57-8301-5da830e674c7] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:10.762265 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-64d523ae-2c13-46f0-9e20-64103666a1f2 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:10.774934 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-64d523ae-2c13-46f0-9e20-64103666a1f2 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:10.775500 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-64d523ae-2c13-46f0-9e20-64103666a1f2 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:10.776351 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-64d523ae-2c13-46f0-9e20-64103666a1f2 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:10.777337 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-64d523ae-2c13-46f0-9e20-64103666a1f2 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:10.777783 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-64d523ae-2c13-46f0-9e20-64103666a1f2 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:10.880339 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1a573899-34a4-44af-b392-5234e24dfcac tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1236cea0-3e65-4b7d-861d-eb75d62a5af2" status: 204 len: 0 microversion: 2.1 time: 0.449356 Oct 04 18:53:10.882258 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2648/5341] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:53:10 2022] DELETE /compute/v2.1/servers/1236cea0-3e65-4b7d-861d-eb75d62a5af2 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:53:10.898564 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5630a050-cc55-4c6b-b553-8b15b6717a58 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:10.904509 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5630a050-cc55-4c6b-b553-8b15b6717a58 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] [instance: e1f035f0-277f-403b-973c-fe337e16ccae] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:10.917500 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5630a050-cc55-4c6b-b553-8b15b6717a58 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:10.918008 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5630a050-cc55-4c6b-b553-8b15b6717a58 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:10.918582 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5630a050-cc55-4c6b-b553-8b15b6717a58 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:10.919301 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5630a050-cc55-4c6b-b553-8b15b6717a58 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:10.919754 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5630a050-cc55-4c6b-b553-8b15b6717a58 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:10.920363 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5630a050-cc55-4c6b-b553-8b15b6717a58 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:10.956184 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5630a050-cc55-4c6b-b553-8b15b6717a58 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] [instance: e1f035f0-277f-403b-973c-fe337e16ccae] Going to try to terminate instance {{(pid=123002) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:53:11.003455 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-64d523ae-2c13-46f0-9e20-64103666a1f2 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:11.018623 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-64d523ae-2c13-46f0-9e20-64103666a1f2 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7" status: 200 len: 1510 microversion: 2.1 time: 0.274171 Oct 04 18:53:11.020091 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2694/5342] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:10 2022] GET /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7 => generated 1510 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:53:11.469528 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6729cc32-72bd-4349-b579-064ccb8d7ee9 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:11.470655 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6729cc32-72bd-4349-b579-064ccb8d7ee9 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] [instance: 317c7bd8-4f1e-4210-bb33-087557a1f4d6] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:11.479053 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:53:11.480973 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6729cc32-72bd-4349-b579-064ccb8d7ee9 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:11.481717 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6729cc32-72bd-4349-b579-064ccb8d7ee9 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:11.483285 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6729cc32-72bd-4349-b579-064ccb8d7ee9 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:11.484287 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6729cc32-72bd-4349-b579-064ccb8d7ee9 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:11.485465 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6729cc32-72bd-4349-b579-064ccb8d7ee9 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:11.486131 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6729cc32-72bd-4349-b579-064ccb8d7ee9 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:11.491479 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5630a050-cc55-4c6b-b553-8b15b6717a58 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e1f035f0-277f-403b-973c-fe337e16ccae" status: 204 len: 0 microversion: 2.1 time: 0.604662 Oct 04 18:53:11.494343 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2649/5343] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:53:10 2022] DELETE /compute/v2.1/servers/e1f035f0-277f-403b-973c-fe337e16ccae => generated 0 bytes in 607 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:53:11.503100 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5f72acaa-f174-4b9b-80dc-625109814d06 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:11.503896 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5f72acaa-f174-4b9b-80dc-625109814d06 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] [instance: 4267e7a6-74c2-4509-9d96-6a8075236937] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:11.517427 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5f72acaa-f174-4b9b-80dc-625109814d06 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:11.517962 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5f72acaa-f174-4b9b-80dc-625109814d06 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:11.521459 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5f72acaa-f174-4b9b-80dc-625109814d06 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:11.521459 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5f72acaa-f174-4b9b-80dc-625109814d06 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:11.521459 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5f72acaa-f174-4b9b-80dc-625109814d06 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:11.521459 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5f72acaa-f174-4b9b-80dc-625109814d06 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:11.552963 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-5f72acaa-f174-4b9b-80dc-625109814d06 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] HTTP exception thrown: Instance 4267e7a6-74c2-4509-9d96-6a8075236937 could not be found. Oct 04 18:53:11.555715 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5f72acaa-f174-4b9b-80dc-625109814d06 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Request method failure captured: Oct 04 18:53:11.555715 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/4267e7a6-74c2-4509-9d96-6a8075236937 HTTP/1.1 Oct 04 18:53:11.555715 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:53:11.555715 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:53:11.555715 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:53:11.555715 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:53:11.555715 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:53:11.555715 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:53:11.555715 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:53:11.555715 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:53:11.555715 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPIDz-AINW-m2COs41Yxxm3xwCWNxUS9OTeoK0Fh1LsrYTv0jdeaQIKQiPuSRczxs2KgYMllwaZ7bEn-Mec4GNYFkt_T6tecuJMAGqK81k1j5xsz6NLYA5OlMlYH95ZFFRGCCpC3cvXFYkdTFTcRZ-v77_4AB8Ul-7yCDUGOXhU8ttSI Oct 04 18:53:11.555715 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:53:11.555715 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:53:11.555715 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:53:11.555715 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:53:11.555715 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:53:11.555715 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:53:11.555715 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 9d3bae1b8ffa4fdb8a3be402743fbca6 Oct 04 18:53:11.555715 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ListServersNegativeTestJSON-741628576 Oct 04 18:53:11.555715 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:53:11.555715 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:53:11.555715 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9d3bae1b8ffa4fdb8a3be402743fbca6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9d3bae1b8ffa4fdb8a3be402743fbca6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9d3bae1b8ffa4fdb8a3be402743fbca6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9d3bae1b8ffa4fdb8a3be402743fbca6"}]}] Oct 04 18:53:11.555715 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ListServersNegativeTestJSON-741628576 Oct 04 18:53:11.555715 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 9d3bae1b8ffa4fdb8a3be402743fbca6 Oct 04 18:53:11.555715 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-741628576 Oct 04 18:53:11.555715 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ListServersNegativeTestJSON-741628576-project Oct 04 18:53:11.555715 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:53:11.555715 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:53:11.555715 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: ec940f2051b647afb6436356e773a769 Oct 04 18:53:11.555715 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ListServersNegativeTestJSON-741628576-project Oct 04 18:53:11.555715 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:53:11.555715 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 4267e7a6-74c2-4509-9d96-6a8075236937 could not be found. Oct 04 18:53:11.555715 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '4267e7a6-74c2-4509-9d96-6a8075236937'} Oct 04 18:53:11.555715 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:53:11.555715 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:11.555715 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:53:11.555715 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:53:11.555715 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:53:11.555715 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:53:11.555715 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:53:11.555715 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:53:11.555715 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:53:11.555715 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:53:11.555715 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4267e7a6-74c2-4509-9d96-6a8075236937 could not be found. Oct 04 18:53:11.555715 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:53:11.555715 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:53:11.555715 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:53:11.555715 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:11.555715 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:53:11.555715 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:53:11.555715 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:53:11.555715 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:53:11.555715 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:53:11.555715 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:53:11.555715 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:53:11.555715 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:53:11.555715 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:53:11.555715 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:53:11.555715 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:53:11.555715 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:53:11.555715 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4267e7a6-74c2-4509-9d96-6a8075236937 could not be found. Oct 04 18:53:11.555715 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:53:11.555715 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:53:11.561266 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:53:11.561266 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:11.561266 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:53:11.561266 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:53:11.561266 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:53:11.561266 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:53:11.561266 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4267e7a6-74c2-4509-9d96-6a8075236937 could not be found. Oct 04 18:53:11.561266 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:53:11.562927 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5f72acaa-f174-4b9b-80dc-625109814d06 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Returning 404 to user: Instance 4267e7a6-74c2-4509-9d96-6a8075236937 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:53:11.563952 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5f72acaa-f174-4b9b-80dc-625109814d06 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] 10.222.0.20 "GET /compute/v2.1/servers/4267e7a6-74c2-4509-9d96-6a8075236937" status: 404 len: 111 microversion: 2.1 time: 0.067077 Oct 04 18:53:11.565007 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2650/5344] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:11 2022] GET /compute/v2.1/servers/4267e7a6-74c2-4509-9d96-6a8075236937 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:53:11.573513 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b26d4d9b-a00a-48ff-a84b-9b48738255ae tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:11.574401 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b26d4d9b-a00a-48ff-a84b-9b48738255ae tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] [instance: 1236cea0-3e65-4b7d-861d-eb75d62a5af2] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:11.580890 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b26d4d9b-a00a-48ff-a84b-9b48738255ae tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:11.581617 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b26d4d9b-a00a-48ff-a84b-9b48738255ae tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:11.582226 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b26d4d9b-a00a-48ff-a84b-9b48738255ae tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:11.583125 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b26d4d9b-a00a-48ff-a84b-9b48738255ae tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:11.583753 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b26d4d9b-a00a-48ff-a84b-9b48738255ae tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:11.584381 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b26d4d9b-a00a-48ff-a84b-9b48738255ae tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:11.589214 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6729cc32-72bd-4349-b579-064ccb8d7ee9 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:11.605579 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6729cc32-72bd-4349-b579-064ccb8d7ee9 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:11.613425 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6729cc32-72bd-4349-b579-064ccb8d7ee9 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:11.613425 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6729cc32-72bd-4349-b579-064ccb8d7ee9 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] 10.222.0.20 "GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6" status: 200 len: 1605 microversion: 2.32 time: 0.143334 Oct 04 18:53:11.613425 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2695/5345] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:53:11 2022] GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6 => generated 1605 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:53:11.777284 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b26d4d9b-a00a-48ff-a84b-9b48738255ae tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec940f2051b647afb6436356e773a769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3bae1b8ffa4fdb8a3be402743fbca6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:11.785794 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b26d4d9b-a00a-48ff-a84b-9b48738255ae tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] 10.222.0.20 "GET /compute/v2.1/servers/1236cea0-3e65-4b7d-861d-eb75d62a5af2" status: 200 len: 1522 microversion: 2.1 time: 0.215971 Oct 04 18:53:11.788356 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2651/5346] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:11 2022] GET /compute/v2.1/servers/1236cea0-3e65-4b7d-861d-eb75d62a5af2 => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:12.046496 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-13506bba-9d65-48db-a4d5-77b488c7d729 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:12.047113 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-13506bba-9d65-48db-a4d5-77b488c7d729 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9afd6ad-3b96-4a57-8301-5da830e674c7] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:12.055903 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-13506bba-9d65-48db-a4d5-77b488c7d729 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:12.056343 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-13506bba-9d65-48db-a4d5-77b488c7d729 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:12.056786 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-13506bba-9d65-48db-a4d5-77b488c7d729 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:12.057491 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-13506bba-9d65-48db-a4d5-77b488c7d729 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:12.058138 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-13506bba-9d65-48db-a4d5-77b488c7d729 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:12.058962 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-13506bba-9d65-48db-a4d5-77b488c7d729 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:12.323715 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-13506bba-9d65-48db-a4d5-77b488c7d729 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:12.340787 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-13506bba-9d65-48db-a4d5-77b488c7d729 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7" status: 200 len: 1510 microversion: 2.1 time: 0.298019 Oct 04 18:53:12.341666 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2696/5347] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:12 2022] GET /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7 => generated 1510 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:12.638486 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d7079e6f-7db9-44ff-af79-a09dd9c8f7bd tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:12.639680 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d7079e6f-7db9-44ff-af79-a09dd9c8f7bd tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] [instance: 317c7bd8-4f1e-4210-bb33-087557a1f4d6] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:12.650984 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d7079e6f-7db9-44ff-af79-a09dd9c8f7bd tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:12.659619 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d7079e6f-7db9-44ff-af79-a09dd9c8f7bd tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:12.660341 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d7079e6f-7db9-44ff-af79-a09dd9c8f7bd tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:12.661285 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d7079e6f-7db9-44ff-af79-a09dd9c8f7bd tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:12.661918 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d7079e6f-7db9-44ff-af79-a09dd9c8f7bd tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:12.663248 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d7079e6f-7db9-44ff-af79-a09dd9c8f7bd tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:12.799530 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d7079e6f-7db9-44ff-af79-a09dd9c8f7bd tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:12.814035 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0ac393e6-8ba9-475e-b13b-0e6fab08532e tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:12.814505 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0ac393e6-8ba9-475e-b13b-0e6fab08532e tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] [instance: 1236cea0-3e65-4b7d-861d-eb75d62a5af2] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:12.825834 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0ac393e6-8ba9-475e-b13b-0e6fab08532e tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:12.826966 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d7079e6f-7db9-44ff-af79-a09dd9c8f7bd tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:12.827382 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0ac393e6-8ba9-475e-b13b-0e6fab08532e tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:12.828788 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0ac393e6-8ba9-475e-b13b-0e6fab08532e tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:12.832314 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d7079e6f-7db9-44ff-af79-a09dd9c8f7bd tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:12.832314 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d7079e6f-7db9-44ff-af79-a09dd9c8f7bd tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] 10.222.0.20 "GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6" status: 200 len: 1605 microversion: 2.32 time: 0.196279 Oct 04 18:53:12.832571 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0ac393e6-8ba9-475e-b13b-0e6fab08532e tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:12.832666 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2652/5348] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:53:12 2022] GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6 => generated 1605 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:53:12.832764 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0ac393e6-8ba9-475e-b13b-0e6fab08532e tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:12.832867 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0ac393e6-8ba9-475e-b13b-0e6fab08532e tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:13.268976 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0ac393e6-8ba9-475e-b13b-0e6fab08532e tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec940f2051b647afb6436356e773a769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3bae1b8ffa4fdb8a3be402743fbca6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:13.281411 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0ac393e6-8ba9-475e-b13b-0e6fab08532e tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] 10.222.0.20 "GET /compute/v2.1/servers/1236cea0-3e65-4b7d-861d-eb75d62a5af2" status: 200 len: 1522 microversion: 2.1 time: 0.472541 Oct 04 18:53:13.282280 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2697/5349] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:12 2022] GET /compute/v2.1/servers/1236cea0-3e65-4b7d-861d-eb75d62a5af2 => generated 1522 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:13.367928 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f8c80a32-16a3-49dc-a101-5d1e2aad7a1e tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:13.368829 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f8c80a32-16a3-49dc-a101-5d1e2aad7a1e tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9afd6ad-3b96-4a57-8301-5da830e674c7] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:13.377827 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f8c80a32-16a3-49dc-a101-5d1e2aad7a1e tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:13.378673 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f8c80a32-16a3-49dc-a101-5d1e2aad7a1e tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:13.379451 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f8c80a32-16a3-49dc-a101-5d1e2aad7a1e tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:13.381457 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f8c80a32-16a3-49dc-a101-5d1e2aad7a1e tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:13.382657 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f8c80a32-16a3-49dc-a101-5d1e2aad7a1e tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:13.383260 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f8c80a32-16a3-49dc-a101-5d1e2aad7a1e tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:13.622277 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f8c80a32-16a3-49dc-a101-5d1e2aad7a1e tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:13.630705 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f8c80a32-16a3-49dc-a101-5d1e2aad7a1e tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7" status: 200 len: 1510 microversion: 2.1 time: 0.269432 Oct 04 18:53:13.636288 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2653/5350] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:13 2022] GET /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7 => generated 1510 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:13.859434 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-92659599-820c-4b5c-a83d-545e5416dd48 req-3c3bdf48-a71f-4815-ab98-e6c568d9fcf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1f035f0-277f-403b-973c-fe337e16ccae", "name": "network-vif-deleted", "tag": "12e39199-7995-45e6-baa3-778b4af0ca82"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:53:13.866137 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5af1ca58-09fe-4ed6-87d1-faad254adf64 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:13.871729 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5af1ca58-09fe-4ed6-87d1-faad254adf64 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] [instance: 317c7bd8-4f1e-4210-bb33-087557a1f4d6] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:13.893631 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5af1ca58-09fe-4ed6-87d1-faad254adf64 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:13.894135 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5af1ca58-09fe-4ed6-87d1-faad254adf64 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:13.900503 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-92659599-820c-4b5c-a83d-545e5416dd48 req-3c3bdf48-a71f-4815-ab98-e6c568d9fcf5 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:13.900503 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-92659599-820c-4b5c-a83d-545e5416dd48 req-3c3bdf48-a71f-4815-ab98-e6c568d9fcf5 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:13.900503 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-92659599-820c-4b5c-a83d-545e5416dd48 req-3c3bdf48-a71f-4815-ab98-e6c568d9fcf5 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:13.900835 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5af1ca58-09fe-4ed6-87d1-faad254adf64 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:13.901438 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5af1ca58-09fe-4ed6-87d1-faad254adf64 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:13.902050 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5af1ca58-09fe-4ed6-87d1-faad254adf64 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:13.902336 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5af1ca58-09fe-4ed6-87d1-faad254adf64 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:13.931900 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-92659599-820c-4b5c-a83d-545e5416dd48 req-3c3bdf48-a71f-4815-ab98-e6c568d9fcf5 service nova] Creating event network-vif-deleted:12e39199-7995-45e6-baa3-778b4af0ca82 for instance e1f035f0-277f-403b-973c-fe337e16ccae on n-h1-850501-14 Oct 04 18:53:13.983915 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-92659599-820c-4b5c-a83d-545e5416dd48 req-3c3bdf48-a71f-4815-ab98-e6c568d9fcf5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123847 Oct 04 18:53:13.984673 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2698/5351] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:53:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:53:14.007184 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-d617f66c-9404-4c02-a236-2a399422cb3e req-e85d2311-1e36-4054-8087-3d84a872d54e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1236cea0-3e65-4b7d-861d-eb75d62a5af2", "name": "network-vif-deleted", "tag": "97558e74-1510-4e28-a8ec-4451850143f9"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:53:14.044520 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-d617f66c-9404-4c02-a236-2a399422cb3e req-e85d2311-1e36-4054-8087-3d84a872d54e service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:14.056881 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-d617f66c-9404-4c02-a236-2a399422cb3e req-e85d2311-1e36-4054-8087-3d84a872d54e service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:14.057723 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-d617f66c-9404-4c02-a236-2a399422cb3e req-e85d2311-1e36-4054-8087-3d84a872d54e service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:14.088529 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:53:14.092066 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-d617f66c-9404-4c02-a236-2a399422cb3e req-e85d2311-1e36-4054-8087-3d84a872d54e service nova] Creating event network-vif-deleted:97558e74-1510-4e28-a8ec-4451850143f9 for instance 1236cea0-3e65-4b7d-861d-eb75d62a5af2 on n-h2-850501-14 Oct 04 18:53:14.099667 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-d617f66c-9404-4c02-a236-2a399422cb3e req-e85d2311-1e36-4054-8087-3d84a872d54e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110931 Oct 04 18:53:14.107623 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2699/5352] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:53:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:53:14.108286 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5af1ca58-09fe-4ed6-87d1-faad254adf64 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:14.124237 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5af1ca58-09fe-4ed6-87d1-faad254adf64 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:14.126550 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5af1ca58-09fe-4ed6-87d1-faad254adf64 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:14.127878 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5af1ca58-09fe-4ed6-87d1-faad254adf64 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] 10.222.0.20 "GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6" status: 200 len: 1605 microversion: 2.32 time: 0.266622 Oct 04 18:53:14.129574 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2654/5353] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:53:13 2022] GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6 => generated 1605 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:53:14.306910 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5ea98126-f65e-49a3-b2f3-be7f8bf47d34 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:14.308257 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5ea98126-f65e-49a3-b2f3-be7f8bf47d34 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] [instance: 1236cea0-3e65-4b7d-861d-eb75d62a5af2] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:14.328794 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5ea98126-f65e-49a3-b2f3-be7f8bf47d34 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:14.329601 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5ea98126-f65e-49a3-b2f3-be7f8bf47d34 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:14.331833 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5ea98126-f65e-49a3-b2f3-be7f8bf47d34 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:14.332794 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5ea98126-f65e-49a3-b2f3-be7f8bf47d34 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:14.333424 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5ea98126-f65e-49a3-b2f3-be7f8bf47d34 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:14.333857 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5ea98126-f65e-49a3-b2f3-be7f8bf47d34 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:14.441197 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5ea98126-f65e-49a3-b2f3-be7f8bf47d34 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec940f2051b647afb6436356e773a769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3bae1b8ffa4fdb8a3be402743fbca6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:14.451090 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5ea98126-f65e-49a3-b2f3-be7f8bf47d34 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] 10.222.0.20 "GET /compute/v2.1/servers/1236cea0-3e65-4b7d-861d-eb75d62a5af2" status: 200 len: 1308 microversion: 2.1 time: 0.149194 Oct 04 18:53:14.452112 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2700/5354] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:14 2022] GET /compute/v2.1/servers/1236cea0-3e65-4b7d-861d-eb75d62a5af2 => generated 1308 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:14.659555 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-56c8e437-3c09-4b5c-9bd1-a707dac7d03b tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:14.661731 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-56c8e437-3c09-4b5c-9bd1-a707dac7d03b tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9afd6ad-3b96-4a57-8301-5da830e674c7] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:14.672464 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-56c8e437-3c09-4b5c-9bd1-a707dac7d03b tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:14.673896 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-56c8e437-3c09-4b5c-9bd1-a707dac7d03b tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:14.674986 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-56c8e437-3c09-4b5c-9bd1-a707dac7d03b tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:14.681277 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-56c8e437-3c09-4b5c-9bd1-a707dac7d03b tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:14.681277 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-56c8e437-3c09-4b5c-9bd1-a707dac7d03b tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:14.681277 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-56c8e437-3c09-4b5c-9bd1-a707dac7d03b tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:14.947219 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-56c8e437-3c09-4b5c-9bd1-a707dac7d03b tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:14.956699 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-56c8e437-3c09-4b5c-9bd1-a707dac7d03b tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7" status: 200 len: 1510 microversion: 2.1 time: 0.304981 Oct 04 18:53:14.957317 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2655/5355] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:14 2022] GET /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7 => generated 1510 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:15.160163 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-427110e1-0fca-4d54-8cad-6eeb647c8677 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:15.161074 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-427110e1-0fca-4d54-8cad-6eeb647c8677 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] [instance: 317c7bd8-4f1e-4210-bb33-087557a1f4d6] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:15.176767 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-427110e1-0fca-4d54-8cad-6eeb647c8677 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:15.177486 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-427110e1-0fca-4d54-8cad-6eeb647c8677 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:15.178224 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-427110e1-0fca-4d54-8cad-6eeb647c8677 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:15.179716 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-427110e1-0fca-4d54-8cad-6eeb647c8677 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:15.180714 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-427110e1-0fca-4d54-8cad-6eeb647c8677 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:15.181945 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-427110e1-0fca-4d54-8cad-6eeb647c8677 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:15.295087 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-427110e1-0fca-4d54-8cad-6eeb647c8677 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:15.305380 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-427110e1-0fca-4d54-8cad-6eeb647c8677 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:15.307166 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-427110e1-0fca-4d54-8cad-6eeb647c8677 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:15.309042 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-427110e1-0fca-4d54-8cad-6eeb647c8677 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] 10.222.0.20 "GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6" status: 200 len: 1605 microversion: 2.32 time: 0.155095 Oct 04 18:53:15.309928 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2701/5356] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:53:15 2022] GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6 => generated 1605 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:53:15.483539 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ac8dbb0e-bfcc-4104-8c63-c2fa732bab00 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:15.485142 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ac8dbb0e-bfcc-4104-8c63-c2fa732bab00 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] [instance: 1236cea0-3e65-4b7d-861d-eb75d62a5af2] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:15.496602 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ac8dbb0e-bfcc-4104-8c63-c2fa732bab00 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:15.497370 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ac8dbb0e-bfcc-4104-8c63-c2fa732bab00 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:15.498030 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ac8dbb0e-bfcc-4104-8c63-c2fa732bab00 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:15.500366 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ac8dbb0e-bfcc-4104-8c63-c2fa732bab00 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:15.503190 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ac8dbb0e-bfcc-4104-8c63-c2fa732bab00 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:15.504306 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ac8dbb0e-bfcc-4104-8c63-c2fa732bab00 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:15.573410 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ac8dbb0e-bfcc-4104-8c63-c2fa732bab00 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:15.574749 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ac8dbb0e-bfcc-4104-8c63-c2fa732bab00 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:15.575288 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ac8dbb0e-bfcc-4104-8c63-c2fa732bab00 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:15.575855 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-ac8dbb0e-bfcc-4104-8c63-c2fa732bab00 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lazy-loading 'fault' on Instance uuid 1236cea0-3e65-4b7d-861d-eb75d62a5af2 {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:53:15.673667 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ac8dbb0e-bfcc-4104-8c63-c2fa732bab00 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec940f2051b647afb6436356e773a769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3bae1b8ffa4fdb8a3be402743fbca6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:15.686169 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ac8dbb0e-bfcc-4104-8c63-c2fa732bab00 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] 10.222.0.20 "GET /compute/v2.1/servers/1236cea0-3e65-4b7d-861d-eb75d62a5af2" status: 200 len: 1313 microversion: 2.1 time: 0.212062 Oct 04 18:53:15.692650 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2656/5357] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:15 2022] GET /compute/v2.1/servers/1236cea0-3e65-4b7d-861d-eb75d62a5af2 => generated 1313 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:15.983260 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e1e67379-8350-49fc-85bc-e61a647e9508 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:15.984033 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e1e67379-8350-49fc-85bc-e61a647e9508 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9afd6ad-3b96-4a57-8301-5da830e674c7] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:15.994796 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e1e67379-8350-49fc-85bc-e61a647e9508 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:15.998908 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e1e67379-8350-49fc-85bc-e61a647e9508 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:15.999412 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e1e67379-8350-49fc-85bc-e61a647e9508 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:16.002735 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e1e67379-8350-49fc-85bc-e61a647e9508 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:16.003237 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e1e67379-8350-49fc-85bc-e61a647e9508 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:16.003684 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e1e67379-8350-49fc-85bc-e61a647e9508 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:16.200296 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e1e67379-8350-49fc-85bc-e61a647e9508 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:16.209529 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e1e67379-8350-49fc-85bc-e61a647e9508 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7" status: 200 len: 1510 microversion: 2.1 time: 0.230748 Oct 04 18:53:16.225274 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2702/5358] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:15 2022] GET /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7 => generated 1510 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:16.340420 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-32fd2a53-405a-41e5-8f66-4f98bd5d2b9b tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:16.341122 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-32fd2a53-405a-41e5-8f66-4f98bd5d2b9b tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] [instance: 317c7bd8-4f1e-4210-bb33-087557a1f4d6] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:16.351973 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-32fd2a53-405a-41e5-8f66-4f98bd5d2b9b tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:16.352796 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-32fd2a53-405a-41e5-8f66-4f98bd5d2b9b tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:16.353647 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-32fd2a53-405a-41e5-8f66-4f98bd5d2b9b tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:16.356440 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-32fd2a53-405a-41e5-8f66-4f98bd5d2b9b tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:16.357289 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-32fd2a53-405a-41e5-8f66-4f98bd5d2b9b tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:16.360570 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-32fd2a53-405a-41e5-8f66-4f98bd5d2b9b tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:16.454895 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-32fd2a53-405a-41e5-8f66-4f98bd5d2b9b tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:16.477367 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-32fd2a53-405a-41e5-8f66-4f98bd5d2b9b tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:16.480005 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-32fd2a53-405a-41e5-8f66-4f98bd5d2b9b tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:16.482897 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-32fd2a53-405a-41e5-8f66-4f98bd5d2b9b tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] 10.222.0.20 "GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6" status: 200 len: 1605 microversion: 2.32 time: 0.151654 Oct 04 18:53:16.484241 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2657/5359] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:53:16 2022] GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6 => generated 1605 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:53:16.713145 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c54cf1c6-e81d-4522-93d7-0f886abe0053 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:16.714374 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c54cf1c6-e81d-4522-93d7-0f886abe0053 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] [instance: 1236cea0-3e65-4b7d-861d-eb75d62a5af2] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:16.723301 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c54cf1c6-e81d-4522-93d7-0f886abe0053 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:16.726709 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c54cf1c6-e81d-4522-93d7-0f886abe0053 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:16.727364 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c54cf1c6-e81d-4522-93d7-0f886abe0053 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:16.728306 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c54cf1c6-e81d-4522-93d7-0f886abe0053 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:16.731611 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c54cf1c6-e81d-4522-93d7-0f886abe0053 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:16.732433 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c54cf1c6-e81d-4522-93d7-0f886abe0053 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:16.759829 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-c54cf1c6-e81d-4522-93d7-0f886abe0053 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] HTTP exception thrown: Instance 1236cea0-3e65-4b7d-861d-eb75d62a5af2 could not be found. Oct 04 18:53:16.761864 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c54cf1c6-e81d-4522-93d7-0f886abe0053 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Request method failure captured: Oct 04 18:53:16.761864 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/1236cea0-3e65-4b7d-861d-eb75d62a5af2 HTTP/1.1 Oct 04 18:53:16.761864 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:53:16.761864 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:53:16.761864 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:53:16.761864 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:53:16.761864 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:53:16.761864 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:53:16.761864 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:53:16.761864 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:53:16.761864 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPIDz-AINW-m2COs41Yxxm3xwCWNxUS9OTeoK0Fh1LsrYTv0jdeaQIKQiPuSRczxs2KgYMllwaZ7bEn-Mec4GNYFkt_T6tecuJMAGqK81k1j5xsz6NLYA5OlMlYH95ZFFRGCCpC3cvXFYkdTFTcRZ-v77_4AB8Ul-7yCDUGOXhU8ttSI Oct 04 18:53:16.761864 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:53:16.761864 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:53:16.761864 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:53:16.761864 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:53:16.761864 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:53:16.761864 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:53:16.761864 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 9d3bae1b8ffa4fdb8a3be402743fbca6 Oct 04 18:53:16.761864 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ListServersNegativeTestJSON-741628576 Oct 04 18:53:16.761864 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:53:16.761864 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:53:16.761864 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9d3bae1b8ffa4fdb8a3be402743fbca6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9d3bae1b8ffa4fdb8a3be402743fbca6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9d3bae1b8ffa4fdb8a3be402743fbca6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9d3bae1b8ffa4fdb8a3be402743fbca6"}]}] Oct 04 18:53:16.761864 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ListServersNegativeTestJSON-741628576 Oct 04 18:53:16.761864 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 9d3bae1b8ffa4fdb8a3be402743fbca6 Oct 04 18:53:16.761864 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-741628576 Oct 04 18:53:16.761864 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ListServersNegativeTestJSON-741628576-project Oct 04 18:53:16.761864 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:53:16.761864 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:53:16.761864 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: ec940f2051b647afb6436356e773a769 Oct 04 18:53:16.761864 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ListServersNegativeTestJSON-741628576-project Oct 04 18:53:16.761864 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:53:16.761864 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 1236cea0-3e65-4b7d-861d-eb75d62a5af2 could not be found. Oct 04 18:53:16.761864 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '1236cea0-3e65-4b7d-861d-eb75d62a5af2'} Oct 04 18:53:16.761864 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:53:16.761864 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:16.761864 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:53:16.761864 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:53:16.761864 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:53:16.761864 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:53:16.761864 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:53:16.761864 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:53:16.761864 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:53:16.761864 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:53:16.761864 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1236cea0-3e65-4b7d-861d-eb75d62a5af2 could not be found. Oct 04 18:53:16.761864 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:53:16.761864 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:53:16.761864 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:53:16.761864 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:16.761864 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:53:16.761864 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:53:16.761864 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:53:16.761864 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:53:16.761864 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:53:16.761864 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:53:16.761864 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:53:16.761864 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:53:16.761864 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:53:16.761864 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:53:16.761864 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:53:16.761864 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:53:16.761864 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1236cea0-3e65-4b7d-861d-eb75d62a5af2 could not be found. Oct 04 18:53:16.761864 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:53:16.761864 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:53:16.770030 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:53:16.770030 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:16.770030 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:53:16.770030 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:53:16.770030 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:53:16.770030 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:53:16.770030 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1236cea0-3e65-4b7d-861d-eb75d62a5af2 could not be found. Oct 04 18:53:16.770030 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:53:16.770030 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c54cf1c6-e81d-4522-93d7-0f886abe0053 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Returning 404 to user: Instance 1236cea0-3e65-4b7d-861d-eb75d62a5af2 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:53:16.775531 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c54cf1c6-e81d-4522-93d7-0f886abe0053 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] 10.222.0.20 "GET /compute/v2.1/servers/1236cea0-3e65-4b7d-861d-eb75d62a5af2" status: 404 len: 111 microversion: 2.1 time: 0.056740 Oct 04 18:53:16.776291 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2703/5360] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:16 2022] GET /compute/v2.1/servers/1236cea0-3e65-4b7d-861d-eb75d62a5af2 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:53:16.786909 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4536102d-283f-4cb0-a296-916b7c516863 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:16.787600 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4536102d-283f-4cb0-a296-916b7c516863 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] [instance: e1f035f0-277f-403b-973c-fe337e16ccae] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:16.800207 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4536102d-283f-4cb0-a296-916b7c516863 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:16.800207 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4536102d-283f-4cb0-a296-916b7c516863 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:16.800207 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4536102d-283f-4cb0-a296-916b7c516863 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:16.800207 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4536102d-283f-4cb0-a296-916b7c516863 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:16.800207 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4536102d-283f-4cb0-a296-916b7c516863 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:16.800207 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4536102d-283f-4cb0-a296-916b7c516863 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:16.834323 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-4536102d-283f-4cb0-a296-916b7c516863 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] HTTP exception thrown: Instance e1f035f0-277f-403b-973c-fe337e16ccae could not be found. Oct 04 18:53:16.837345 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4536102d-283f-4cb0-a296-916b7c516863 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Request method failure captured: Oct 04 18:53:16.837345 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/e1f035f0-277f-403b-973c-fe337e16ccae HTTP/1.1 Oct 04 18:53:16.837345 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:53:16.837345 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:53:16.837345 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:53:16.837345 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:53:16.837345 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:53:16.837345 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:53:16.837345 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:53:16.837345 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:53:16.837345 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPIDz-AINW-m2COs41Yxxm3xwCWNxUS9OTeoK0Fh1LsrYTv0jdeaQIKQiPuSRczxs2KgYMllwaZ7bEn-Mec4GNYFkt_T6tecuJMAGqK81k1j5xsz6NLYA5OlMlYH95ZFFRGCCpC3cvXFYkdTFTcRZ-v77_4AB8Ul-7yCDUGOXhU8ttSI Oct 04 18:53:16.837345 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:53:16.837345 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:53:16.837345 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:53:16.837345 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:53:16.837345 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:53:16.837345 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:53:16.837345 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 9d3bae1b8ffa4fdb8a3be402743fbca6 Oct 04 18:53:16.837345 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ListServersNegativeTestJSON-741628576 Oct 04 18:53:16.837345 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:53:16.837345 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:53:16.837345 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9d3bae1b8ffa4fdb8a3be402743fbca6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9d3bae1b8ffa4fdb8a3be402743fbca6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9d3bae1b8ffa4fdb8a3be402743fbca6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9d3bae1b8ffa4fdb8a3be402743fbca6"}]}] Oct 04 18:53:16.837345 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ListServersNegativeTestJSON-741628576 Oct 04 18:53:16.837345 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 9d3bae1b8ffa4fdb8a3be402743fbca6 Oct 04 18:53:16.837345 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-741628576 Oct 04 18:53:16.837345 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ListServersNegativeTestJSON-741628576-project Oct 04 18:53:16.837345 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:53:16.837345 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:53:16.837345 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: ec940f2051b647afb6436356e773a769 Oct 04 18:53:16.837345 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ListServersNegativeTestJSON-741628576-project Oct 04 18:53:16.837345 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:53:16.837345 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance e1f035f0-277f-403b-973c-fe337e16ccae could not be found. Oct 04 18:53:16.837345 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'e1f035f0-277f-403b-973c-fe337e16ccae'} Oct 04 18:53:16.837345 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:53:16.837345 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:16.837345 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:53:16.837345 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:53:16.837345 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:53:16.837345 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:53:16.837345 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:53:16.837345 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:53:16.837345 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:53:16.837345 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:53:16.837345 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1f035f0-277f-403b-973c-fe337e16ccae could not be found. Oct 04 18:53:16.837345 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:53:16.837345 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:53:16.837345 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:53:16.837345 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:16.837345 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:53:16.837345 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:53:16.837345 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:53:16.837345 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:53:16.837345 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:53:16.837345 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:53:16.837345 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:53:16.837345 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:53:16.837345 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:53:16.837345 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:53:16.837345 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:53:16.837345 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:53:16.837345 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1f035f0-277f-403b-973c-fe337e16ccae could not be found. Oct 04 18:53:16.837345 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:53:16.837345 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:53:16.842081 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:53:16.842081 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:16.842081 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:53:16.842081 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:53:16.842081 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:53:16.842081 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:53:16.842081 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1f035f0-277f-403b-973c-fe337e16ccae could not be found. Oct 04 18:53:16.842081 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:53:16.843056 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4536102d-283f-4cb0-a296-916b7c516863 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] Returning 404 to user: Instance e1f035f0-277f-403b-973c-fe337e16ccae could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:53:16.844001 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4536102d-283f-4cb0-a296-916b7c516863 tempest-ListServersNegativeTestJSON-741628576 tempest-ListServersNegativeTestJSON-741628576-project] 10.222.0.20 "GET /compute/v2.1/servers/e1f035f0-277f-403b-973c-fe337e16ccae" status: 404 len: 111 microversion: 2.1 time: 0.061209 Oct 04 18:53:16.844940 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2658/5361] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:16 2022] GET /compute/v2.1/servers/e1f035f0-277f-403b-973c-fe337e16ccae => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:53:17.236030 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6288da3e-5562-4a80-bcf5-bfb958f3db63 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:17.237090 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6288da3e-5562-4a80-bcf5-bfb958f3db63 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9afd6ad-3b96-4a57-8301-5da830e674c7] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:17.246452 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6288da3e-5562-4a80-bcf5-bfb958f3db63 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:17.248238 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6288da3e-5562-4a80-bcf5-bfb958f3db63 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:17.249028 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6288da3e-5562-4a80-bcf5-bfb958f3db63 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:17.250574 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6288da3e-5562-4a80-bcf5-bfb958f3db63 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:17.251613 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6288da3e-5562-4a80-bcf5-bfb958f3db63 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:17.252252 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6288da3e-5562-4a80-bcf5-bfb958f3db63 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:17.483801 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6288da3e-5562-4a80-bcf5-bfb958f3db63 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:17.493576 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6288da3e-5562-4a80-bcf5-bfb958f3db63 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7" status: 200 len: 1510 microversion: 2.1 time: 0.262234 Oct 04 18:53:17.509817 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2704/5362] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:17 2022] GET /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7 => generated 1510 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:17.528081 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-53fb1693-5630-4a45-aad1-088d39c7a57e tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:17.528862 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-53fb1693-5630-4a45-aad1-088d39c7a57e tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] [instance: 317c7bd8-4f1e-4210-bb33-087557a1f4d6] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:17.544561 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-53fb1693-5630-4a45-aad1-088d39c7a57e tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:17.547554 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-53fb1693-5630-4a45-aad1-088d39c7a57e tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:17.548118 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-53fb1693-5630-4a45-aad1-088d39c7a57e tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:17.549731 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-53fb1693-5630-4a45-aad1-088d39c7a57e tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:17.554441 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-53fb1693-5630-4a45-aad1-088d39c7a57e tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:17.555034 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-53fb1693-5630-4a45-aad1-088d39c7a57e tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:17.689046 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-53fb1693-5630-4a45-aad1-088d39c7a57e tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:17.701962 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-53fb1693-5630-4a45-aad1-088d39c7a57e tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:17.703728 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-53fb1693-5630-4a45-aad1-088d39c7a57e tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:17.705278 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-53fb1693-5630-4a45-aad1-088d39c7a57e tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] 10.222.0.20 "GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6" status: 200 len: 1605 microversion: 2.32 time: 0.183248 Oct 04 18:53:17.721040 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2659/5363] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:53:17 2022] GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6 => generated 1605 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:53:18.526853 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6117bc5c-ba50-4668-ace7-c99ed2bb3980 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:18.531474 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6117bc5c-ba50-4668-ace7-c99ed2bb3980 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9afd6ad-3b96-4a57-8301-5da830e674c7] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:18.554118 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6117bc5c-ba50-4668-ace7-c99ed2bb3980 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:18.558138 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6117bc5c-ba50-4668-ace7-c99ed2bb3980 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:18.559120 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6117bc5c-ba50-4668-ace7-c99ed2bb3980 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:18.560848 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6117bc5c-ba50-4668-ace7-c99ed2bb3980 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:18.563155 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6117bc5c-ba50-4668-ace7-c99ed2bb3980 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:18.565547 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6117bc5c-ba50-4668-ace7-c99ed2bb3980 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:18.733595 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e199ed89-755a-4153-a0ba-8e6c3f916186 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:18.734346 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e199ed89-755a-4153-a0ba-8e6c3f916186 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] [instance: 317c7bd8-4f1e-4210-bb33-087557a1f4d6] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:18.746748 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e199ed89-755a-4153-a0ba-8e6c3f916186 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:18.749445 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e199ed89-755a-4153-a0ba-8e6c3f916186 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:18.751830 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e199ed89-755a-4153-a0ba-8e6c3f916186 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:18.753114 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e199ed89-755a-4153-a0ba-8e6c3f916186 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:18.753607 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e199ed89-755a-4153-a0ba-8e6c3f916186 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:18.755069 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e199ed89-755a-4153-a0ba-8e6c3f916186 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:19.439356 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e199ed89-755a-4153-a0ba-8e6c3f916186 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:19.460786 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e199ed89-755a-4153-a0ba-8e6c3f916186 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:19.463213 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e199ed89-755a-4153-a0ba-8e6c3f916186 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:19.466161 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e199ed89-755a-4153-a0ba-8e6c3f916186 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] 10.222.0.20 "GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6" status: 200 len: 1605 microversion: 2.32 time: 0.736746 Oct 04 18:53:19.469264 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2660/5364] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:53:18 2022] GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6 => generated 1605 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:53:19.483958 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-730f9e55-b5a3-48fa-ae9a-f5c00ec8b148 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:53:19.492606 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-730f9e55-b5a3-48fa-ae9a-f5c00ec8b148 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:19.515441 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-730f9e55-b5a3-48fa-ae9a-f5c00ec8b148 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:19.515943 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-730f9e55-b5a3-48fa-ae9a-f5c00ec8b148 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:19.516414 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-730f9e55-b5a3-48fa-ae9a-f5c00ec8b148 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:19.517138 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-730f9e55-b5a3-48fa-ae9a-f5c00ec8b148 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:19.517596 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-730f9e55-b5a3-48fa-ae9a-f5c00ec8b148 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:19.518025 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-730f9e55-b5a3-48fa-ae9a-f5c00ec8b148 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:19.745586 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6117bc5c-ba50-4668-ace7-c99ed2bb3980 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:19.748560 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-730f9e55-b5a3-48fa-ae9a-f5c00ec8b148 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "POST /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238/action" status: 202 len: 0 microversion: 2.1 time: 0.270819 Oct 04 18:53:19.750863 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2661/5365] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:53:19 2022] POST /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238/action => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:53:19.775680 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6117bc5c-ba50-4668-ace7-c99ed2bb3980 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7" status: 200 len: 1510 microversion: 2.1 time: 1.260264 Oct 04 18:53:19.776784 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2705/5366] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:18 2022] GET /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7 => generated 1510 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:19.796486 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b01f226d-6108-429f-97a6-28a087981e1b tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:19.797712 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b01f226d-6108-429f-97a6-28a087981e1b tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:19.816094 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b01f226d-6108-429f-97a6-28a087981e1b tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:19.820704 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b01f226d-6108-429f-97a6-28a087981e1b tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:19.822356 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b01f226d-6108-429f-97a6-28a087981e1b tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:19.825736 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b01f226d-6108-429f-97a6-28a087981e1b tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:19.826458 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b01f226d-6108-429f-97a6-28a087981e1b tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:19.827112 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b01f226d-6108-429f-97a6-28a087981e1b tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:19.907922 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:53:20.278692 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b01f226d-6108-429f-97a6-28a087981e1b tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:20.289611 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=94,nova_cell1:INSERT=3 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:53:20.290775 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=14 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:53:20.300095 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b01f226d-6108-429f-97a6-28a087981e1b tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1674 microversion: 2.1 time: 0.530145 Oct 04 18:53:20.304754 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2662/5367] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:19 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1674 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:20.511575 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4f8e8603-7efa-4cf8-8510-20395afedf5f tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:20.512656 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-4f8e8603-7efa-4cf8-8510-20395afedf5f tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] [instance: 317c7bd8-4f1e-4210-bb33-087557a1f4d6] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:20.530443 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4f8e8603-7efa-4cf8-8510-20395afedf5f tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:20.531235 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4f8e8603-7efa-4cf8-8510-20395afedf5f tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:20.531925 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4f8e8603-7efa-4cf8-8510-20395afedf5f tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:20.532918 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4f8e8603-7efa-4cf8-8510-20395afedf5f tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:20.547253 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4f8e8603-7efa-4cf8-8510-20395afedf5f tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:20.547253 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4f8e8603-7efa-4cf8-8510-20395afedf5f tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:20.765364 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-4f8e8603-7efa-4cf8-8510-20395afedf5f tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:20.786848 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-4f8e8603-7efa-4cf8-8510-20395afedf5f tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:20.792273 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-4f8e8603-7efa-4cf8-8510-20395afedf5f tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:20.798286 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-4f8e8603-7efa-4cf8-8510-20395afedf5f tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] 10.222.0.20 "GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6" status: 200 len: 1605 microversion: 2.32 time: 0.298649 Oct 04 18:53:20.800305 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2706/5368] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:53:20 2022] GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6 => generated 1605 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:53:20.812522 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-093c70ca-2616-4b5e-ad95-c79ca8b2f1d7 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:20.814014 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-093c70ca-2616-4b5e-ad95-c79ca8b2f1d7 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9afd6ad-3b96-4a57-8301-5da830e674c7] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:20.836676 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-093c70ca-2616-4b5e-ad95-c79ca8b2f1d7 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:20.837451 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-093c70ca-2616-4b5e-ad95-c79ca8b2f1d7 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:20.840302 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-093c70ca-2616-4b5e-ad95-c79ca8b2f1d7 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:20.841243 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-093c70ca-2616-4b5e-ad95-c79ca8b2f1d7 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:20.843086 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-093c70ca-2616-4b5e-ad95-c79ca8b2f1d7 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:20.844407 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-093c70ca-2616-4b5e-ad95-c79ca8b2f1d7 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:21.205447 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-093c70ca-2616-4b5e-ad95-c79ca8b2f1d7 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:21.239393 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-093c70ca-2616-4b5e-ad95-c79ca8b2f1d7 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7" status: 200 len: 1510 microversion: 2.1 time: 0.443456 Oct 04 18:53:21.260369 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2663/5369] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:20 2022] GET /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7 => generated 1510 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:21.328764 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-fe5a9057-2507-4604-b575-6c7ea84677bb tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:21.329482 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-fe5a9057-2507-4604-b575-6c7ea84677bb tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:21.342020 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fe5a9057-2507-4604-b575-6c7ea84677bb tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:21.342537 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fe5a9057-2507-4604-b575-6c7ea84677bb tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:21.342990 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fe5a9057-2507-4604-b575-6c7ea84677bb tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:21.343717 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fe5a9057-2507-4604-b575-6c7ea84677bb tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:21.347978 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fe5a9057-2507-4604-b575-6c7ea84677bb tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:21.351872 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fe5a9057-2507-4604-b575-6c7ea84677bb tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:21.838869 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-bc16e4e0-1d5e-4dd2-b51d-8117c0432941 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:21.839523 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-bc16e4e0-1d5e-4dd2-b51d-8117c0432941 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] [instance: 317c7bd8-4f1e-4210-bb33-087557a1f4d6] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:21.841553 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-fe5a9057-2507-4604-b575-6c7ea84677bb tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:21.851758 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-fe5a9057-2507-4604-b575-6c7ea84677bb tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1674 microversion: 2.1 time: 0.527843 Oct 04 18:53:21.863879 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bc16e4e0-1d5e-4dd2-b51d-8117c0432941 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:21.864689 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bc16e4e0-1d5e-4dd2-b51d-8117c0432941 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:21.864846 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2707/5370] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:21 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1674 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:21.865999 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bc16e4e0-1d5e-4dd2-b51d-8117c0432941 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:21.868590 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bc16e4e0-1d5e-4dd2-b51d-8117c0432941 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:21.870347 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bc16e4e0-1d5e-4dd2-b51d-8117c0432941 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:21.871889 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bc16e4e0-1d5e-4dd2-b51d-8117c0432941 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:21.983947 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bc16e4e0-1d5e-4dd2-b51d-8117c0432941 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:21.984826 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bc16e4e0-1d5e-4dd2-b51d-8117c0432941 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:21.985156 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bc16e4e0-1d5e-4dd2-b51d-8117c0432941 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:21.985624 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-bc16e4e0-1d5e-4dd2-b51d-8117c0432941 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lazy-loading 'fault' on Instance uuid 317c7bd8-4f1e-4210-bb33-087557a1f4d6 {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:53:22.103042 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-bc16e4e0-1d5e-4dd2-b51d-8117c0432941 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:22.114339 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-bc16e4e0-1d5e-4dd2-b51d-8117c0432941 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:22.117121 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-bc16e4e0-1d5e-4dd2-b51d-8117c0432941 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a18012de566645afb138207e20fb4cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc171af3b14473983188dbd7fb01227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:22.118571 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-bc16e4e0-1d5e-4dd2-b51d-8117c0432941 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] 10.222.0.20 "GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6" status: 200 len: 1372 microversion: 2.32 time: 0.291799 Oct 04 18:53:22.134252 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2664/5371] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:53:21 2022] GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6 => generated 1372 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:53:22.264954 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-26029d11-25a4-4ced-a182-c81c39bcdf5d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:22.265683 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-26029d11-25a4-4ced-a182-c81c39bcdf5d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9afd6ad-3b96-4a57-8301-5da830e674c7] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:22.279485 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-26029d11-25a4-4ced-a182-c81c39bcdf5d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:22.279992 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-26029d11-25a4-4ced-a182-c81c39bcdf5d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:22.280502 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-26029d11-25a4-4ced-a182-c81c39bcdf5d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:22.281219 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-26029d11-25a4-4ced-a182-c81c39bcdf5d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:22.281683 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-26029d11-25a4-4ced-a182-c81c39bcdf5d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:22.282215 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-26029d11-25a4-4ced-a182-c81c39bcdf5d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:22.641078 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-26029d11-25a4-4ced-a182-c81c39bcdf5d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:22.652816 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-26029d11-25a4-4ced-a182-c81c39bcdf5d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7" status: 200 len: 1510 microversion: 2.1 time: 0.391614 Oct 04 18:53:22.659006 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2708/5372] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:22 2022] GET /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7 => generated 1510 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:22.878505 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-365a5e71-9d0b-49fd-b901-6ae52a3fe3c5 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:22.879145 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-365a5e71-9d0b-49fd-b901-6ae52a3fe3c5 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:22.888617 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-365a5e71-9d0b-49fd-b901-6ae52a3fe3c5 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:22.888617 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-365a5e71-9d0b-49fd-b901-6ae52a3fe3c5 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:22.888617 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-365a5e71-9d0b-49fd-b901-6ae52a3fe3c5 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:22.889200 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-365a5e71-9d0b-49fd-b901-6ae52a3fe3c5 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:22.889859 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-365a5e71-9d0b-49fd-b901-6ae52a3fe3c5 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:22.890463 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-365a5e71-9d0b-49fd-b901-6ae52a3fe3c5 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:23.157857 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-63d7ad33-798d-4138-9594-16d964afbfa5 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:23.158791 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-63d7ad33-798d-4138-9594-16d964afbfa5 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] [instance: 317c7bd8-4f1e-4210-bb33-087557a1f4d6] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:23.169901 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-63d7ad33-798d-4138-9594-16d964afbfa5 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:23.170471 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-63d7ad33-798d-4138-9594-16d964afbfa5 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:23.170922 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-63d7ad33-798d-4138-9594-16d964afbfa5 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:23.171650 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-63d7ad33-798d-4138-9594-16d964afbfa5 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:23.172191 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-63d7ad33-798d-4138-9594-16d964afbfa5 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:23.179862 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-63d7ad33-798d-4138-9594-16d964afbfa5 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:23.202576 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-63d7ad33-798d-4138-9594-16d964afbfa5 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] HTTP exception thrown: Instance 317c7bd8-4f1e-4210-bb33-087557a1f4d6 could not be found. Oct 04 18:53:23.203360 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-63d7ad33-798d-4138-9594-16d964afbfa5 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Request method failure captured: Oct 04 18:53:23.203360 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6 HTTP/1.1 Oct 04 18:53:23.203360 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:53:23.203360 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:53:23.203360 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:53:23.203360 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:53:23.203360 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:53:23.203360 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:53:23.203360 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:53:23.203360 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:53:23.203360 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPH9VwXnqNWbdaCcaKJs-wGqmnDs8a4HXWMJyTYeuMAVbk-68UQXg4MWua4firumCqg9zK88uDwwsxLnSHaArTTqDUQF3fzkNlwGl2NfgWxshd3m4B9TbzwjyWDXkbzqxh-tuldG3qOtDZ4LrEmxRDMePbCT-Xf3LlJmTsJb3VrnpICk Oct 04 18:53:23.203360 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:53:23.203360 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:53:23.203360 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:53:23.203360 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:53:23.203360 n-d-850501-14 devstack@n-api.service[123001]: X-Openstack-Nova-Api-Version: 2.32 Oct 04 18:53:23.203360 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:53:23.203360 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:53:23.203360 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 7bc171af3b14473983188dbd7fb01227 Oct 04 18:53:23.203360 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-TaggedBootDevicesTest-1911251369 Oct 04 18:53:23.203360 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:53:23.203360 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:53:23.203360 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7bc171af3b14473983188dbd7fb01227"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7bc171af3b14473983188dbd7fb01227", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7bc171af3b14473983188dbd7fb01227"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7bc171af3b14473983188dbd7fb01227"}]}] Oct 04 18:53:23.203360 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-TaggedBootDevicesTest-1911251369 Oct 04 18:53:23.203360 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 7bc171af3b14473983188dbd7fb01227 Oct 04 18:53:23.203360 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1911251369 Oct 04 18:53:23.203360 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-TaggedBootDevicesTest-1911251369-project Oct 04 18:53:23.203360 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:53:23.203360 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:53:23.203360 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: a18012de566645afb138207e20fb4cf0 Oct 04 18:53:23.203360 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-TaggedBootDevicesTest-1911251369-project Oct 04 18:53:23.203360 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:53:23.203360 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 317c7bd8-4f1e-4210-bb33-087557a1f4d6 could not be found. Oct 04 18:53:23.203360 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '317c7bd8-4f1e-4210-bb33-087557a1f4d6'} Oct 04 18:53:23.203360 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:53:23.203360 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:23.203360 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:53:23.203360 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:53:23.203360 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:53:23.203360 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:53:23.203360 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:53:23.203360 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:53:23.203360 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:53:23.203360 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:53:23.203360 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 317c7bd8-4f1e-4210-bb33-087557a1f4d6 could not be found. Oct 04 18:53:23.203360 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:53:23.203360 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:53:23.203360 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:53:23.203360 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:23.203360 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:53:23.203360 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:53:23.203360 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:53:23.203360 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:53:23.203360 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:53:23.203360 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:53:23.203360 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:53:23.203360 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:53:23.203360 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:53:23.203360 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:53:23.203360 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:53:23.203360 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:53:23.203360 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 317c7bd8-4f1e-4210-bb33-087557a1f4d6 could not be found. Oct 04 18:53:23.203360 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:53:23.203360 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:53:23.210103 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:53:23.210103 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:23.210103 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:53:23.210103 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:53:23.210103 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:53:23.210103 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:53:23.210103 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 317c7bd8-4f1e-4210-bb33-087557a1f4d6 could not be found. Oct 04 18:53:23.210103 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:53:23.210103 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-63d7ad33-798d-4138-9594-16d964afbfa5 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Returning 404 to user: Instance 317c7bd8-4f1e-4210-bb33-087557a1f4d6 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:53:23.210103 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-63d7ad33-798d-4138-9594-16d964afbfa5 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] 10.222.0.20 "GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6" status: 404 len: 111 microversion: 2.32 time: 0.051601 Oct 04 18:53:23.210103 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2709/5373] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:53:23 2022] GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:53:23.220596 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3394fa85-b05d-4556-9f6a-0fea40eacd37 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Calling method '.version_select at 0x7fe258d92940>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:23.304438 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-365a5e71-9d0b-49fd-b901-6ae52a3fe3c5 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:23.317169 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-365a5e71-9d0b-49fd-b901-6ae52a3fe3c5 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1679 microversion: 2.1 time: 0.438850 Oct 04 18:53:23.317818 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2665/5374] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:22 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1679 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:23.433153 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3394fa85-b05d-4556-9f6a-0fea40eacd37 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1491919207" status: 204 len: 0 microversion: 2.32 time: 0.215120 Oct 04 18:53:23.433153 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2710/5375] 10.222.0.20 () {60 vars in 1262 bytes} [Tue Oct 4 18:53:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1491919207 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:53:23.682809 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b82a7845-8590-447f-8af7-5a66e7494a7f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:23.685160 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b82a7845-8590-447f-8af7-5a66e7494a7f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9afd6ad-3b96-4a57-8301-5da830e674c7] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:23.690601 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:53:23.701610 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b82a7845-8590-447f-8af7-5a66e7494a7f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:23.702403 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b82a7845-8590-447f-8af7-5a66e7494a7f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:23.704143 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b82a7845-8590-447f-8af7-5a66e7494a7f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:23.705535 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b82a7845-8590-447f-8af7-5a66e7494a7f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:23.706184 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b82a7845-8590-447f-8af7-5a66e7494a7f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:23.710461 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b82a7845-8590-447f-8af7-5a66e7494a7f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:24.129737 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b82a7845-8590-447f-8af7-5a66e7494a7f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:24.139541 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b82a7845-8590-447f-8af7-5a66e7494a7f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7" status: 200 len: 1510 microversion: 2.1 time: 0.461174 Oct 04 18:53:24.141409 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2666/5376] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:23 2022] GET /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7 => generated 1510 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:24.344248 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2740ac5f-2ff9-4bbd-9d24-062a94babbf2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:24.345145 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2740ac5f-2ff9-4bbd-9d24-062a94babbf2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:24.353638 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2740ac5f-2ff9-4bbd-9d24-062a94babbf2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:24.354310 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2740ac5f-2ff9-4bbd-9d24-062a94babbf2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:24.355452 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2740ac5f-2ff9-4bbd-9d24-062a94babbf2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:24.356416 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2740ac5f-2ff9-4bbd-9d24-062a94babbf2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:24.356880 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2740ac5f-2ff9-4bbd-9d24-062a94babbf2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:24.358779 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2740ac5f-2ff9-4bbd-9d24-062a94babbf2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:24.653429 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-2740ac5f-2ff9-4bbd-9d24-062a94babbf2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:24.667038 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2740ac5f-2ff9-4bbd-9d24-062a94babbf2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1679 microversion: 2.1 time: 0.327468 Oct 04 18:53:24.692089 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2711/5377] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:24 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1679 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:25.164399 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-17c25c21-49d2-46d3-9240-f9dea227baec tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:25.165075 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-17c25c21-49d2-46d3-9240-f9dea227baec tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9afd6ad-3b96-4a57-8301-5da830e674c7] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:25.172832 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-17c25c21-49d2-46d3-9240-f9dea227baec tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:25.173649 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-17c25c21-49d2-46d3-9240-f9dea227baec tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:25.174262 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-17c25c21-49d2-46d3-9240-f9dea227baec tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:25.175145 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-17c25c21-49d2-46d3-9240-f9dea227baec tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:25.175589 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-17c25c21-49d2-46d3-9240-f9dea227baec tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:25.176228 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-17c25c21-49d2-46d3-9240-f9dea227baec tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:25.474227 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-17c25c21-49d2-46d3-9240-f9dea227baec tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:25.485623 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-17c25c21-49d2-46d3-9240-f9dea227baec tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7" status: 200 len: 1510 microversion: 2.1 time: 0.325332 Oct 04 18:53:25.486939 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2667/5378] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:25 2022] GET /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7 => generated 1510 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:25.703470 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-cb3b7661-5b37-4061-82eb-132654c9461b tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:25.704679 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-cb3b7661-5b37-4061-82eb-132654c9461b tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:25.717111 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cb3b7661-5b37-4061-82eb-132654c9461b tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:25.725644 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cb3b7661-5b37-4061-82eb-132654c9461b tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:25.726447 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cb3b7661-5b37-4061-82eb-132654c9461b tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:25.731834 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cb3b7661-5b37-4061-82eb-132654c9461b tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:25.731834 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cb3b7661-5b37-4061-82eb-132654c9461b tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:25.731834 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cb3b7661-5b37-4061-82eb-132654c9461b tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:25.924756 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-cb3b7661-5b37-4061-82eb-132654c9461b tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:25.934867 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-cb3b7661-5b37-4061-82eb-132654c9461b tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1679 microversion: 2.1 time: 0.236121 Oct 04 18:53:25.960847 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2712/5379] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:25 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1679 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:26.512651 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-06a06bec-ea1c-4de2-b897-409d87e7335c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:26.514424 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-06a06bec-ea1c-4de2-b897-409d87e7335c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9afd6ad-3b96-4a57-8301-5da830e674c7] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:26.525734 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-06a06bec-ea1c-4de2-b897-409d87e7335c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:26.532244 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-06a06bec-ea1c-4de2-b897-409d87e7335c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:26.532244 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-06a06bec-ea1c-4de2-b897-409d87e7335c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:26.534179 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-06a06bec-ea1c-4de2-b897-409d87e7335c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:26.534789 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-06a06bec-ea1c-4de2-b897-409d87e7335c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:26.535949 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-06a06bec-ea1c-4de2-b897-409d87e7335c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:26.931405 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-06a06bec-ea1c-4de2-b897-409d87e7335c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:26.942428 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-06a06bec-ea1c-4de2-b897-409d87e7335c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7" status: 200 len: 1510 microversion: 2.1 time: 0.431741 Oct 04 18:53:26.944984 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2668/5380] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:26 2022] GET /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7 => generated 1510 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:26.971412 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1f701dc3-e00a-4a27-b8e8-8cb3e822cd29 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:26.972714 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1f701dc3-e00a-4a27-b8e8-8cb3e822cd29 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:26.984758 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1f701dc3-e00a-4a27-b8e8-8cb3e822cd29 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:26.985473 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1f701dc3-e00a-4a27-b8e8-8cb3e822cd29 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:26.986065 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1f701dc3-e00a-4a27-b8e8-8cb3e822cd29 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:26.987095 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1f701dc3-e00a-4a27-b8e8-8cb3e822cd29 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:26.987556 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1f701dc3-e00a-4a27-b8e8-8cb3e822cd29 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:26.987980 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1f701dc3-e00a-4a27-b8e8-8cb3e822cd29 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:27.165067 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1f701dc3-e00a-4a27-b8e8-8cb3e822cd29 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:27.190410 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1f701dc3-e00a-4a27-b8e8-8cb3e822cd29 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1679 microversion: 2.1 time: 0.223764 Oct 04 18:53:27.192541 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2713/5381] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:26 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1679 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:27.971122 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-975bfc2f-955f-4543-af08-8a94b476b56e tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:27.971743 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-975bfc2f-955f-4543-af08-8a94b476b56e tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9afd6ad-3b96-4a57-8301-5da830e674c7] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:27.979241 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-975bfc2f-955f-4543-af08-8a94b476b56e tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:27.979995 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-975bfc2f-955f-4543-af08-8a94b476b56e tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:27.980885 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-975bfc2f-955f-4543-af08-8a94b476b56e tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:27.982384 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-975bfc2f-955f-4543-af08-8a94b476b56e tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:27.983203 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-975bfc2f-955f-4543-af08-8a94b476b56e tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:27.983806 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-975bfc2f-955f-4543-af08-8a94b476b56e tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:28.348228 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0fddc5f8-fae3-4ef6-b0e1-804ebf16d914 tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-851447481", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": "none"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:53:28.348774 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-975bfc2f-955f-4543-af08-8a94b476b56e tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:28.360959 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-975bfc2f-955f-4543-af08-8a94b476b56e tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7" status: 200 len: 1510 microversion: 2.1 time: 0.394780 Oct 04 18:53:28.373347 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2669/5382] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:27 2022] GET /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7 => generated 1510 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:28.383909 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-eeb49ab3-2589-45d4-a8a7-f09710440c4d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:28.383909 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-eeb49ab3-2589-45d4-a8a7-f09710440c4d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:28.395274 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eeb49ab3-2589-45d4-a8a7-f09710440c4d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:28.395773 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eeb49ab3-2589-45d4-a8a7-f09710440c4d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:28.396392 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eeb49ab3-2589-45d4-a8a7-f09710440c4d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:28.397259 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eeb49ab3-2589-45d4-a8a7-f09710440c4d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:28.401583 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eeb49ab3-2589-45d4-a8a7-f09710440c4d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:28.402076 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eeb49ab3-2589-45d4-a8a7-f09710440c4d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:28.454074 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-0fddc5f8-fae3-4ef6-b0e1-804ebf16d914 tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:53:28.455656 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-0fddc5f8-fae3-4ef6-b0e1-804ebf16d914 tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:53:28.456219 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-0fddc5f8-fae3-4ef6-b0e1-804ebf16d914 tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:53:28.459511 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-0fddc5f8-fae3-4ef6-b0e1-804ebf16d914 tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:53:28.460833 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-0fddc5f8-fae3-4ef6-b0e1-804ebf16d914 tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:53:28.481176 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0fddc5f8-fae3-4ef6-b0e1-804ebf16d914 tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:28.481880 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0fddc5f8-fae3-4ef6-b0e1-804ebf16d914 tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:28.482340 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0fddc5f8-fae3-4ef6-b0e1-804ebf16d914 tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:28.483565 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0fddc5f8-fae3-4ef6-b0e1-804ebf16d914 tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:28.484151 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0fddc5f8-fae3-4ef6-b0e1-804ebf16d914 tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:28.484773 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0fddc5f8-fae3-4ef6-b0e1-804ebf16d914 tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:28.513375 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-0fddc5f8-fae3-4ef6-b0e1-804ebf16d914 tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Getting quotas for project a917b814c2ee46aba6dafc77bf82c390. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:53:28.520164 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-0fddc5f8-fae3-4ef6-b0e1-804ebf16d914 tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Getting quotas for user 322b415e8fc34c5dacfdcb6efba30f69 and project a917b814c2ee46aba6dafc77bf82c390. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:53:28.553561 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0fddc5f8-fae3-4ef6-b0e1-804ebf16d914 tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Going to run 1 instances... {{(pid=123001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:53:28.556242 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0fddc5f8-fae3-4ef6-b0e1-804ebf16d914 tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] [instance: f910d164-591e-41d7-9af8-8b690b08e4b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:53:28.691318 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-eeb49ab3-2589-45d4-a8a7-f09710440c4d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:28.702048 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-eeb49ab3-2589-45d4-a8a7-f09710440c4d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1672 microversion: 2.1 time: 0.337823 Oct 04 18:53:28.702931 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2670/5383] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:28 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1672 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:28.745366 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0fddc5f8-fae3-4ef6-b0e1-804ebf16d914 tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.758447 Oct 04 18:53:28.752818 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2714/5384] 10.222.0.20 () {62 vars in 1188 bytes} [Tue Oct 4 18:53:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 766 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 04 18:53:28.761489 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-bec4b8ec-83e0-4b2a-a262-453fb797d4c1 tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:28.762431 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-bec4b8ec-83e0-4b2a-a262-453fb797d4c1 tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] [instance: f910d164-591e-41d7-9af8-8b690b08e4b5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:28.796975 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-20a070fa-6210-47a7-8cba-73d41a79a671 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:28.797951 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-20a070fa-6210-47a7-8cba-73d41a79a671 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] [instance: 317c7bd8-4f1e-4210-bb33-087557a1f4d6] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:28.815080 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-20a070fa-6210-47a7-8cba-73d41a79a671 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:28.815080 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-20a070fa-6210-47a7-8cba-73d41a79a671 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:28.815080 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-20a070fa-6210-47a7-8cba-73d41a79a671 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:28.815080 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-20a070fa-6210-47a7-8cba-73d41a79a671 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:28.815080 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-20a070fa-6210-47a7-8cba-73d41a79a671 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:28.815080 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-20a070fa-6210-47a7-8cba-73d41a79a671 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:28.831391 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-20a070fa-6210-47a7-8cba-73d41a79a671 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] HTTP exception thrown: Instance 317c7bd8-4f1e-4210-bb33-087557a1f4d6 could not be found. Oct 04 18:53:28.833495 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-20a070fa-6210-47a7-8cba-73d41a79a671 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Request method failure captured: Oct 04 18:53:28.833495 n-d-850501-14 devstack@n-api.service[123001]: request: DELETE /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6 HTTP/1.1 Oct 04 18:53:28.833495 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:53:28.833495 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:53:28.833495 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:53:28.833495 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:53:28.833495 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:53:28.833495 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:53:28.833495 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:53:28.833495 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:53:28.833495 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPH9VwXnqNWbdaCcaKJs-wGqmnDs8a4HXWMJyTYeuMAVbk-68UQXg4MWua4firumCqg9zK88uDwwsxLnSHaArTTqDUQF3fzkNlwGl2NfgWxshd3m4B9TbzwjyWDXkbzqxh-tuldG3qOtDZ4LrEmxRDMePbCT-Xf3LlJmTsJb3VrnpICk Oct 04 18:53:28.833495 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:53:28.833495 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:53:28.833495 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:53:28.833495 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:53:28.833495 n-d-850501-14 devstack@n-api.service[123001]: X-Openstack-Nova-Api-Version: 2.32 Oct 04 18:53:28.833495 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:53:28.833495 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:53:28.833495 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 7bc171af3b14473983188dbd7fb01227 Oct 04 18:53:28.833495 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-TaggedBootDevicesTest-1911251369 Oct 04 18:53:28.833495 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:53:28.833495 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:53:28.833495 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7bc171af3b14473983188dbd7fb01227"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7bc171af3b14473983188dbd7fb01227", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7bc171af3b14473983188dbd7fb01227"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7bc171af3b14473983188dbd7fb01227"}]}] Oct 04 18:53:28.833495 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-TaggedBootDevicesTest-1911251369 Oct 04 18:53:28.833495 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 7bc171af3b14473983188dbd7fb01227 Oct 04 18:53:28.833495 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1911251369 Oct 04 18:53:28.833495 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-TaggedBootDevicesTest-1911251369-project Oct 04 18:53:28.833495 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:53:28.833495 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:53:28.833495 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: a18012de566645afb138207e20fb4cf0 Oct 04 18:53:28.833495 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-TaggedBootDevicesTest-1911251369-project Oct 04 18:53:28.833495 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:53:28.833495 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 317c7bd8-4f1e-4210-bb33-087557a1f4d6 could not be found. Oct 04 18:53:28.833495 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '317c7bd8-4f1e-4210-bb33-087557a1f4d6'} Oct 04 18:53:28.833495 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:53:28.833495 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:28.833495 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:53:28.833495 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:53:28.833495 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:53:28.833495 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:53:28.833495 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:53:28.833495 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:53:28.833495 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:53:28.833495 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:53:28.833495 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 317c7bd8-4f1e-4210-bb33-087557a1f4d6 could not be found. Oct 04 18:53:28.833495 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:53:28.833495 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:53:28.833495 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:53:28.833495 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:28.833495 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:53:28.833495 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:53:28.833495 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:53:28.833495 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:53:28.833495 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:53:28.833495 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:53:28.833495 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:53:28.833495 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:53:28.833495 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:53:28.833495 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:53:28.833495 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:53:28.833495 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:53:28.833495 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:53:28.833495 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:53:28.843056 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 317c7bd8-4f1e-4210-bb33-087557a1f4d6 could not be found. Oct 04 18:53:28.843056 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:53:28.843056 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:53:28.843056 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:53:28.843056 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:28.843056 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:53:28.843056 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:53:28.843056 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:53:28.843056 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:53:28.843056 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 317c7bd8-4f1e-4210-bb33-087557a1f4d6 could not be found. Oct 04 18:53:28.843056 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:53:28.843056 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-20a070fa-6210-47a7-8cba-73d41a79a671 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Returning 404 to user: Instance 317c7bd8-4f1e-4210-bb33-087557a1f4d6 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:53:28.843056 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-20a070fa-6210-47a7-8cba-73d41a79a671 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] 10.222.0.20 "DELETE /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6" status: 404 len: 111 microversion: 2.32 time: 0.047722 Oct 04 18:53:28.843056 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2715/5385] 10.222.0.20 () {60 vars in 1280 bytes} [Tue Oct 4 18:53:28 2022] DELETE /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 04 18:53:28.849379 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-42bd1f91-c03e-4e14-a533-4e93949137a4 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:28.850231 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-42bd1f91-c03e-4e14-a533-4e93949137a4 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] [instance: 317c7bd8-4f1e-4210-bb33-087557a1f4d6] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:28.857385 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-42bd1f91-c03e-4e14-a533-4e93949137a4 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:28.858148 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-42bd1f91-c03e-4e14-a533-4e93949137a4 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:28.858411 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-bec4b8ec-83e0-4b2a-a262-453fb797d4c1 tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322b415e8fc34c5dacfdcb6efba30f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917b814c2ee46aba6dafc77bf82c390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:28.858967 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-42bd1f91-c03e-4e14-a533-4e93949137a4 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:28.859844 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-42bd1f91-c03e-4e14-a533-4e93949137a4 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:28.860502 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-42bd1f91-c03e-4e14-a533-4e93949137a4 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:28.861089 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-42bd1f91-c03e-4e14-a533-4e93949137a4 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:28.867327 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-bec4b8ec-83e0-4b2a-a262-453fb797d4c1 tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '322b415e8fc34c5dacfdcb6efba30f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917b814c2ee46aba6dafc77bf82c390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:28.869851 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-bec4b8ec-83e0-4b2a-a262-453fb797d4c1 tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '322b415e8fc34c5dacfdcb6efba30f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917b814c2ee46aba6dafc77bf82c390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:28.871012 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-bec4b8ec-83e0-4b2a-a262-453fb797d4c1 tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] 10.222.0.20 "GET /compute/v2.1/servers/f910d164-591e-41d7-9af8-8b690b08e4b5" status: 200 len: 1280 microversion: 2.47 time: 0.117051 Oct 04 18:53:28.872196 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2671/5386] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:53:28 2022] GET /compute/v2.1/servers/f910d164-591e-41d7-9af8-8b690b08e4b5 => generated 1280 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:53:28.882792 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-42bd1f91-c03e-4e14-a533-4e93949137a4 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] HTTP exception thrown: Instance 317c7bd8-4f1e-4210-bb33-087557a1f4d6 could not be found. Oct 04 18:53:28.884665 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-42bd1f91-c03e-4e14-a533-4e93949137a4 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Request method failure captured: Oct 04 18:53:28.884665 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6 HTTP/1.1 Oct 04 18:53:28.884665 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:53:28.884665 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:53:28.884665 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:53:28.884665 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:53:28.884665 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:53:28.884665 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:53:28.884665 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:53:28.884665 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:53:28.884665 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPH9VwXnqNWbdaCcaKJs-wGqmnDs8a4HXWMJyTYeuMAVbk-68UQXg4MWua4firumCqg9zK88uDwwsxLnSHaArTTqDUQF3fzkNlwGl2NfgWxshd3m4B9TbzwjyWDXkbzqxh-tuldG3qOtDZ4LrEmxRDMePbCT-Xf3LlJmTsJb3VrnpICk Oct 04 18:53:28.884665 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:53:28.884665 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:53:28.884665 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:53:28.884665 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:53:28.884665 n-d-850501-14 devstack@n-api.service[123001]: X-Openstack-Nova-Api-Version: 2.32 Oct 04 18:53:28.884665 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:53:28.884665 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:53:28.884665 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 7bc171af3b14473983188dbd7fb01227 Oct 04 18:53:28.884665 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-TaggedBootDevicesTest-1911251369 Oct 04 18:53:28.884665 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:53:28.884665 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:53:28.884665 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7bc171af3b14473983188dbd7fb01227"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7bc171af3b14473983188dbd7fb01227", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7bc171af3b14473983188dbd7fb01227"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7bc171af3b14473983188dbd7fb01227"}]}] Oct 04 18:53:28.884665 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-TaggedBootDevicesTest-1911251369 Oct 04 18:53:28.884665 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 7bc171af3b14473983188dbd7fb01227 Oct 04 18:53:28.884665 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1911251369 Oct 04 18:53:28.884665 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-TaggedBootDevicesTest-1911251369-project Oct 04 18:53:28.884665 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:53:28.884665 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:53:28.884665 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: a18012de566645afb138207e20fb4cf0 Oct 04 18:53:28.884665 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-TaggedBootDevicesTest-1911251369-project Oct 04 18:53:28.884665 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:53:28.884665 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 317c7bd8-4f1e-4210-bb33-087557a1f4d6 could not be found. Oct 04 18:53:28.884665 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '317c7bd8-4f1e-4210-bb33-087557a1f4d6'} Oct 04 18:53:28.884665 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:53:28.884665 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:28.884665 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:53:28.884665 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:53:28.884665 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:53:28.884665 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:53:28.884665 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:53:28.884665 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:53:28.884665 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:53:28.884665 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:53:28.884665 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 317c7bd8-4f1e-4210-bb33-087557a1f4d6 could not be found. Oct 04 18:53:28.884665 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:53:28.884665 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:53:28.884665 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:53:28.884665 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:28.884665 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:53:28.884665 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:53:28.884665 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:53:28.884665 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:53:28.884665 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:53:28.884665 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:53:28.884665 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:53:28.884665 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:53:28.884665 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:53:28.884665 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:53:28.884665 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:53:28.884665 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:53:28.884665 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 317c7bd8-4f1e-4210-bb33-087557a1f4d6 could not be found. Oct 04 18:53:28.884665 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:53:28.884665 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:53:28.889393 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:53:28.889393 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:28.889393 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:53:28.889393 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:53:28.889393 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:53:28.889393 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:53:28.889393 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 317c7bd8-4f1e-4210-bb33-087557a1f4d6 could not be found. Oct 04 18:53:28.889393 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:53:28.889393 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-42bd1f91-c03e-4e14-a533-4e93949137a4 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] Returning 404 to user: Instance 317c7bd8-4f1e-4210-bb33-087557a1f4d6 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:53:28.889393 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-42bd1f91-c03e-4e14-a533-4e93949137a4 tempest-TaggedBootDevicesTest-1911251369 tempest-TaggedBootDevicesTest-1911251369-project] 10.222.0.20 "GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6" status: 404 len: 111 microversion: 2.32 time: 0.040647 Oct 04 18:53:28.889393 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2716/5387] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:53:28 2022] GET /compute/v2.1/servers/317c7bd8-4f1e-4210-bb33-087557a1f4d6 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:53:29.387853 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e1f7bc08-f9b2-4d2a-9c0d-07ed1acfc998 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:29.388428 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e1f7bc08-f9b2-4d2a-9c0d-07ed1acfc998 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9afd6ad-3b96-4a57-8301-5da830e674c7] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:29.396475 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e1f7bc08-f9b2-4d2a-9c0d-07ed1acfc998 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:29.400019 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e1f7bc08-f9b2-4d2a-9c0d-07ed1acfc998 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:29.400019 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e1f7bc08-f9b2-4d2a-9c0d-07ed1acfc998 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:29.400019 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e1f7bc08-f9b2-4d2a-9c0d-07ed1acfc998 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:29.400019 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e1f7bc08-f9b2-4d2a-9c0d-07ed1acfc998 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:29.400019 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e1f7bc08-f9b2-4d2a-9c0d-07ed1acfc998 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:29.601760 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e1f7bc08-f9b2-4d2a-9c0d-07ed1acfc998 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:29.611312 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e1f7bc08-f9b2-4d2a-9c0d-07ed1acfc998 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7" status: 200 len: 1510 microversion: 2.1 time: 0.227407 Oct 04 18:53:29.620362 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2672/5388] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:29 2022] GET /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7 => generated 1510 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:29.901024 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0bf8b2a9-a6fe-4824-ac3f-498580de7742 tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:29.903426 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0bf8b2a9-a6fe-4824-ac3f-498580de7742 tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] [instance: f910d164-591e-41d7-9af8-8b690b08e4b5] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:30.019298 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0bf8b2a9-a6fe-4824-ac3f-498580de7742 tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322b415e8fc34c5dacfdcb6efba30f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917b814c2ee46aba6dafc77bf82c390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:30.032387 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0bf8b2a9-a6fe-4824-ac3f-498580de7742 tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '322b415e8fc34c5dacfdcb6efba30f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917b814c2ee46aba6dafc77bf82c390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:30.035917 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0bf8b2a9-a6fe-4824-ac3f-498580de7742 tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '322b415e8fc34c5dacfdcb6efba30f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917b814c2ee46aba6dafc77bf82c390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:30.038003 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0bf8b2a9-a6fe-4824-ac3f-498580de7742 tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] 10.222.0.20 "GET /compute/v2.1/servers/f910d164-591e-41d7-9af8-8b690b08e4b5" status: 200 len: 1280 microversion: 2.47 time: 0.142318 Oct 04 18:53:30.049085 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2717/5389] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:53:29 2022] GET /compute/v2.1/servers/f910d164-591e-41d7-9af8-8b690b08e4b5 => generated 1280 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:53:30.638811 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5d59325f-fa87-42c9-870e-36ff5b835644 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:30.641918 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5d59325f-fa87-42c9-870e-36ff5b835644 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9afd6ad-3b96-4a57-8301-5da830e674c7] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:30.655880 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5d59325f-fa87-42c9-870e-36ff5b835644 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:30.656834 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5d59325f-fa87-42c9-870e-36ff5b835644 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:30.657339 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5d59325f-fa87-42c9-870e-36ff5b835644 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:30.658462 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5d59325f-fa87-42c9-870e-36ff5b835644 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:30.659573 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5d59325f-fa87-42c9-870e-36ff5b835644 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:30.660687 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5d59325f-fa87-42c9-870e-36ff5b835644 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:30.891284 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5d59325f-fa87-42c9-870e-36ff5b835644 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:30.920655 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5d59325f-fa87-42c9-870e-36ff5b835644 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7" status: 200 len: 1510 microversion: 2.1 time: 0.287817 Oct 04 18:53:30.922613 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2673/5390] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:30 2022] GET /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7 => generated 1510 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:31.066086 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-42e442f7-61fd-4ba5-904c-c8e9e5c544bd tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:31.066633 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-42e442f7-61fd-4ba5-904c-c8e9e5c544bd tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] [instance: f910d164-591e-41d7-9af8-8b690b08e4b5] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:31.077263 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-42e442f7-61fd-4ba5-904c-c8e9e5c544bd tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:31.077263 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-42e442f7-61fd-4ba5-904c-c8e9e5c544bd tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:31.077263 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-42e442f7-61fd-4ba5-904c-c8e9e5c544bd tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:31.077263 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-42e442f7-61fd-4ba5-904c-c8e9e5c544bd tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:31.077263 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-42e442f7-61fd-4ba5-904c-c8e9e5c544bd tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:31.077810 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-42e442f7-61fd-4ba5-904c-c8e9e5c544bd tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:31.151093 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-42e442f7-61fd-4ba5-904c-c8e9e5c544bd tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322b415e8fc34c5dacfdcb6efba30f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917b814c2ee46aba6dafc77bf82c390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:31.166645 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-42e442f7-61fd-4ba5-904c-c8e9e5c544bd tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '322b415e8fc34c5dacfdcb6efba30f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917b814c2ee46aba6dafc77bf82c390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:31.168642 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-42e442f7-61fd-4ba5-904c-c8e9e5c544bd tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '322b415e8fc34c5dacfdcb6efba30f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917b814c2ee46aba6dafc77bf82c390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:31.170099 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-42e442f7-61fd-4ba5-904c-c8e9e5c544bd tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] 10.222.0.20 "GET /compute/v2.1/servers/f910d164-591e-41d7-9af8-8b690b08e4b5" status: 200 len: 1276 microversion: 2.47 time: 0.108648 Oct 04 18:53:31.171343 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2718/5391] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:53:31 2022] GET /compute/v2.1/servers/f910d164-591e-41d7-9af8-8b690b08e4b5 => generated 1276 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:53:31.947672 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f671fbce-4ff2-4b97-be70-f50690bc9867 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:31.948528 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f671fbce-4ff2-4b97-be70-f50690bc9867 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9afd6ad-3b96-4a57-8301-5da830e674c7] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:31.958815 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f671fbce-4ff2-4b97-be70-f50690bc9867 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:31.959560 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f671fbce-4ff2-4b97-be70-f50690bc9867 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:31.961994 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f671fbce-4ff2-4b97-be70-f50690bc9867 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:31.962979 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f671fbce-4ff2-4b97-be70-f50690bc9867 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:31.963766 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f671fbce-4ff2-4b97-be70-f50690bc9867 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:31.964397 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f671fbce-4ff2-4b97-be70-f50690bc9867 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:32.164262 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f671fbce-4ff2-4b97-be70-f50690bc9867 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:32.197912 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f671fbce-4ff2-4b97-be70-f50690bc9867 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7" status: 200 len: 1510 microversion: 2.1 time: 0.248817 Oct 04 18:53:32.211143 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2674/5392] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:31 2022] GET /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7 => generated 1510 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:32.213420 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-cc60097d-91de-40b4-b5c5-a66cdfe89cec tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:32.215111 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-cc60097d-91de-40b4-b5c5-a66cdfe89cec tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] [instance: f910d164-591e-41d7-9af8-8b690b08e4b5] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:32.224001 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cc60097d-91de-40b4-b5c5-a66cdfe89cec tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:32.224807 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cc60097d-91de-40b4-b5c5-a66cdfe89cec tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:32.226097 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cc60097d-91de-40b4-b5c5-a66cdfe89cec tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:32.227117 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cc60097d-91de-40b4-b5c5-a66cdfe89cec tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:32.228299 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cc60097d-91de-40b4-b5c5-a66cdfe89cec tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:32.229403 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cc60097d-91de-40b4-b5c5-a66cdfe89cec tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:32.309303 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-cc60097d-91de-40b4-b5c5-a66cdfe89cec tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322b415e8fc34c5dacfdcb6efba30f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917b814c2ee46aba6dafc77bf82c390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:32.320793 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-cc60097d-91de-40b4-b5c5-a66cdfe89cec tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '322b415e8fc34c5dacfdcb6efba30f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917b814c2ee46aba6dafc77bf82c390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:32.322306 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-cc60097d-91de-40b4-b5c5-a66cdfe89cec tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '322b415e8fc34c5dacfdcb6efba30f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917b814c2ee46aba6dafc77bf82c390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:32.323460 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-cc60097d-91de-40b4-b5c5-a66cdfe89cec tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] 10.222.0.20 "GET /compute/v2.1/servers/f910d164-591e-41d7-9af8-8b690b08e4b5" status: 200 len: 1350 microversion: 2.47 time: 0.115242 Oct 04 18:53:32.324012 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2719/5393] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:53:32 2022] GET /compute/v2.1/servers/f910d164-591e-41d7-9af8-8b690b08e4b5 => generated 1350 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:53:33.220610 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-87b95e0f-bebd-4642-abb2-265cb1147b28 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:33.222712 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-87b95e0f-bebd-4642-abb2-265cb1147b28 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9afd6ad-3b96-4a57-8301-5da830e674c7] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:33.239979 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-87b95e0f-bebd-4642-abb2-265cb1147b28 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:33.240940 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-87b95e0f-bebd-4642-abb2-265cb1147b28 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:33.241942 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-87b95e0f-bebd-4642-abb2-265cb1147b28 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:33.244865 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-87b95e0f-bebd-4642-abb2-265cb1147b28 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:33.245540 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-87b95e0f-bebd-4642-abb2-265cb1147b28 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:33.248201 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-87b95e0f-bebd-4642-abb2-265cb1147b28 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:33.350892 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4db2c597-8e4f-4fdb-858d-1250ce50c3b0 tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:33.351512 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-4db2c597-8e4f-4fdb-858d-1250ce50c3b0 tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] [instance: f910d164-591e-41d7-9af8-8b690b08e4b5] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:33.371582 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4db2c597-8e4f-4fdb-858d-1250ce50c3b0 tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:33.372451 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4db2c597-8e4f-4fdb-858d-1250ce50c3b0 tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:33.372579 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4db2c597-8e4f-4fdb-858d-1250ce50c3b0 tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:33.373246 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4db2c597-8e4f-4fdb-858d-1250ce50c3b0 tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:33.373902 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4db2c597-8e4f-4fdb-858d-1250ce50c3b0 tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:33.374648 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4db2c597-8e4f-4fdb-858d-1250ce50c3b0 tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:33.538235 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-4db2c597-8e4f-4fdb-858d-1250ce50c3b0 tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322b415e8fc34c5dacfdcb6efba30f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917b814c2ee46aba6dafc77bf82c390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:33.556291 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-4db2c597-8e4f-4fdb-858d-1250ce50c3b0 tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '322b415e8fc34c5dacfdcb6efba30f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917b814c2ee46aba6dafc77bf82c390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:33.560567 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-4db2c597-8e4f-4fdb-858d-1250ce50c3b0 tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '322b415e8fc34c5dacfdcb6efba30f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917b814c2ee46aba6dafc77bf82c390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:33.561756 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-4db2c597-8e4f-4fdb-858d-1250ce50c3b0 tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] 10.222.0.20 "GET /compute/v2.1/servers/f910d164-591e-41d7-9af8-8b690b08e4b5" status: 200 len: 1338 microversion: 2.47 time: 0.215672 Oct 04 18:53:33.562360 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2720/5394] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:53:33 2022] GET /compute/v2.1/servers/f910d164-591e-41d7-9af8-8b690b08e4b5 => generated 1338 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:53:33.643803 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-87b95e0f-bebd-4642-abb2-265cb1147b28 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:33.654003 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-87b95e0f-bebd-4642-abb2-265cb1147b28 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7" status: 200 len: 1510 microversion: 2.1 time: 0.438906 Oct 04 18:53:33.659913 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2675/5395] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:33 2022] GET /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7 => generated 1510 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:34.593540 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e06e5516-cb7b-43e1-b457-fe747e24f88c tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:34.594876 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e06e5516-cb7b-43e1-b457-fe747e24f88c tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] [instance: f910d164-591e-41d7-9af8-8b690b08e4b5] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:34.605547 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e06e5516-cb7b-43e1-b457-fe747e24f88c tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:34.608788 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e06e5516-cb7b-43e1-b457-fe747e24f88c tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:34.609472 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e06e5516-cb7b-43e1-b457-fe747e24f88c tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:34.610518 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e06e5516-cb7b-43e1-b457-fe747e24f88c tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:34.616715 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e06e5516-cb7b-43e1-b457-fe747e24f88c tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:34.617523 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e06e5516-cb7b-43e1-b457-fe747e24f88c tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:34.705164 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-87f289cc-1f0a-46be-9752-4d77bd7fc20f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:34.705947 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-87f289cc-1f0a-46be-9752-4d77bd7fc20f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9afd6ad-3b96-4a57-8301-5da830e674c7] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:34.720983 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-87f289cc-1f0a-46be-9752-4d77bd7fc20f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:34.721826 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-87f289cc-1f0a-46be-9752-4d77bd7fc20f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:34.722522 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-87f289cc-1f0a-46be-9752-4d77bd7fc20f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:34.723949 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-87f289cc-1f0a-46be-9752-4d77bd7fc20f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:34.724679 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-87f289cc-1f0a-46be-9752-4d77bd7fc20f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:34.725894 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-87f289cc-1f0a-46be-9752-4d77bd7fc20f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:34.777049 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e06e5516-cb7b-43e1-b457-fe747e24f88c tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322b415e8fc34c5dacfdcb6efba30f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917b814c2ee46aba6dafc77bf82c390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:34.783585 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=100 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:53:34.787967 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e06e5516-cb7b-43e1-b457-fe747e24f88c tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '322b415e8fc34c5dacfdcb6efba30f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917b814c2ee46aba6dafc77bf82c390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:34.789465 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e06e5516-cb7b-43e1-b457-fe747e24f88c tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '322b415e8fc34c5dacfdcb6efba30f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917b814c2ee46aba6dafc77bf82c390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:34.792643 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e06e5516-cb7b-43e1-b457-fe747e24f88c tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] 10.222.0.20 "GET /compute/v2.1/servers/f910d164-591e-41d7-9af8-8b690b08e4b5" status: 200 len: 1359 microversion: 2.47 time: 0.203998 Oct 04 18:53:34.797726 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2721/5396] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:53:34 2022] GET /compute/v2.1/servers/f910d164-591e-41d7-9af8-8b690b08e4b5 => generated 1359 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:53:34.835485 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b4007731-2fa9-4945-b263-a18ed92c128c tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1370535695"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:53:34.838657 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b4007731-2fa9-4945-b263-a18ed92c128c tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] [instance: f910d164-591e-41d7-9af8-8b690b08e4b5] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:34.847411 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b4007731-2fa9-4945-b263-a18ed92c128c tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:34.850411 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b4007731-2fa9-4945-b263-a18ed92c128c tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:34.851280 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b4007731-2fa9-4945-b263-a18ed92c128c tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:34.857183 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b4007731-2fa9-4945-b263-a18ed92c128c tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:34.862490 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b4007731-2fa9-4945-b263-a18ed92c128c tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:34.863464 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b4007731-2fa9-4945-b263-a18ed92c128c tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:35.201924 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-87f289cc-1f0a-46be-9752-4d77bd7fc20f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:35.219092 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-87f289cc-1f0a-46be-9752-4d77bd7fc20f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7" status: 200 len: 1510 microversion: 2.1 time: 0.522884 Oct 04 18:53:35.220436 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2676/5397] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:34 2022] GET /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7 => generated 1510 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:35.661188 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b4007731-2fa9-4945-b263-a18ed92c128c tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] 10.222.0.20 "POST /compute/v2.1/servers/f910d164-591e-41d7-9af8-8b690b08e4b5/action" status: 202 len: 52 microversion: 2.47 time: 0.833775 Oct 04 18:53:35.662739 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2722/5398] 10.222.0.20 () {62 vars in 1319 bytes} [Tue Oct 4 18:53:34 2022] POST /compute/v2.1/servers/f910d164-591e-41d7-9af8-8b690b08e4b5/action => generated 52 bytes in 837 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Oct 04 18:53:35.674476 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7a13fad8-c441-44c3-825e-fe9109809650 tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:35.675011 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7a13fad8-c441-44c3-825e-fe9109809650 tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] [instance: f910d164-591e-41d7-9af8-8b690b08e4b5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:35.681475 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7a13fad8-c441-44c3-825e-fe9109809650 tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:35.681978 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7a13fad8-c441-44c3-825e-fe9109809650 tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:35.682426 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7a13fad8-c441-44c3-825e-fe9109809650 tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:35.683157 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7a13fad8-c441-44c3-825e-fe9109809650 tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:35.683826 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7a13fad8-c441-44c3-825e-fe9109809650 tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:35.684304 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7a13fad8-c441-44c3-825e-fe9109809650 tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:35.765249 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7a13fad8-c441-44c3-825e-fe9109809650 tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] [instance: f910d164-591e-41d7-9af8-8b690b08e4b5] Going to try to terminate instance {{(pid=123002) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:53:36.228097 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7a13fad8-c441-44c3-825e-fe9109809650 tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f910d164-591e-41d7-9af8-8b690b08e4b5" status: 204 len: 0 microversion: 2.47 time: 0.557287 Oct 04 18:53:36.242387 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f8ad85a2-8ebc-4301-b2bd-c07370f8ea2f tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:36.245368 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2677/5399] 10.222.0.20 () {60 vars in 1280 bytes} [Tue Oct 4 18:53:35 2022] DELETE /compute/v2.1/servers/f910d164-591e-41d7-9af8-8b690b08e4b5 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:53:36.257845 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2cae605d-7ab4-4ad6-8fe3-07ea3c1f4bfc tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:36.258809 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f8ad85a2-8ebc-4301-b2bd-c07370f8ea2f tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] [instance: f910d164-591e-41d7-9af8-8b690b08e4b5] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:36.272482 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2cae605d-7ab4-4ad6-8fe3-07ea3c1f4bfc tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9afd6ad-3b96-4a57-8301-5da830e674c7] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:36.295497 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f8ad85a2-8ebc-4301-b2bd-c07370f8ea2f tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:36.304876 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f8ad85a2-8ebc-4301-b2bd-c07370f8ea2f tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:36.305631 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f8ad85a2-8ebc-4301-b2bd-c07370f8ea2f tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:36.306121 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2cae605d-7ab4-4ad6-8fe3-07ea3c1f4bfc tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:36.307156 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f8ad85a2-8ebc-4301-b2bd-c07370f8ea2f tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:36.307972 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2cae605d-7ab4-4ad6-8fe3-07ea3c1f4bfc tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:36.310618 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f8ad85a2-8ebc-4301-b2bd-c07370f8ea2f tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:36.311161 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2cae605d-7ab4-4ad6-8fe3-07ea3c1f4bfc tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:36.312221 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2cae605d-7ab4-4ad6-8fe3-07ea3c1f4bfc tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:36.312937 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f8ad85a2-8ebc-4301-b2bd-c07370f8ea2f tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:36.315548 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2cae605d-7ab4-4ad6-8fe3-07ea3c1f4bfc tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:36.321865 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2cae605d-7ab4-4ad6-8fe3-07ea3c1f4bfc tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:36.403058 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:53:36.830508 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f8ad85a2-8ebc-4301-b2bd-c07370f8ea2f tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322b415e8fc34c5dacfdcb6efba30f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917b814c2ee46aba6dafc77bf82c390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:36.843947 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f8ad85a2-8ebc-4301-b2bd-c07370f8ea2f tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '322b415e8fc34c5dacfdcb6efba30f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917b814c2ee46aba6dafc77bf82c390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:36.845771 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f8ad85a2-8ebc-4301-b2bd-c07370f8ea2f tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '322b415e8fc34c5dacfdcb6efba30f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917b814c2ee46aba6dafc77bf82c390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:36.849691 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f8ad85a2-8ebc-4301-b2bd-c07370f8ea2f tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] 10.222.0.20 "GET /compute/v2.1/servers/f910d164-591e-41d7-9af8-8b690b08e4b5" status: 200 len: 1365 microversion: 2.47 time: 0.612892 Oct 04 18:53:36.873237 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2723/5400] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:53:36 2022] GET /compute/v2.1/servers/f910d164-591e-41d7-9af8-8b690b08e4b5 => generated 1365 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:53:37.660677 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2cae605d-7ab4-4ad6-8fe3-07ea3c1f4bfc tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:37.699895 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2cae605d-7ab4-4ad6-8fe3-07ea3c1f4bfc tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7" status: 200 len: 1487 microversion: 2.1 time: 1.445300 Oct 04 18:53:37.701838 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2678/5401] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:36 2022] GET /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7 => generated 1487 bytes in 1456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:37.730361 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0e2f8ad2-ec89-4219-99eb-a8cd56ce2ab6 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:37.734546 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0e2f8ad2-ec89-4219-99eb-a8cd56ce2ab6 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9afd6ad-3b96-4a57-8301-5da830e674c7] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:37.762571 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0e2f8ad2-ec89-4219-99eb-a8cd56ce2ab6 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:37.763075 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0e2f8ad2-ec89-4219-99eb-a8cd56ce2ab6 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:37.763513 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0e2f8ad2-ec89-4219-99eb-a8cd56ce2ab6 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:37.772970 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0e2f8ad2-ec89-4219-99eb-a8cd56ce2ab6 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:37.773581 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0e2f8ad2-ec89-4219-99eb-a8cd56ce2ab6 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:37.774038 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0e2f8ad2-ec89-4219-99eb-a8cd56ce2ab6 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:37.839449 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0e2f8ad2-ec89-4219-99eb-a8cd56ce2ab6 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9afd6ad-3b96-4a57-8301-5da830e674c7] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:53:37.882164 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6aad6540-6b46-4aeb-b436-dcd02319fea4 tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:37.883189 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-6aad6540-6b46-4aeb-b436-dcd02319fea4 tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] [instance: f910d164-591e-41d7-9af8-8b690b08e4b5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:37.898834 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6aad6540-6b46-4aeb-b436-dcd02319fea4 tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:37.905209 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6aad6540-6b46-4aeb-b436-dcd02319fea4 tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:37.905917 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6aad6540-6b46-4aeb-b436-dcd02319fea4 tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:37.908814 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6aad6540-6b46-4aeb-b436-dcd02319fea4 tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:37.913645 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6aad6540-6b46-4aeb-b436-dcd02319fea4 tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:37.914324 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6aad6540-6b46-4aeb-b436-dcd02319fea4 tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:38.304889 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0e2f8ad2-ec89-4219-99eb-a8cd56ce2ab6 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7" status: 204 len: 0 microversion: 2.1 time: 0.578635 Oct 04 18:53:38.309095 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2724/5402] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:53:37 2022] DELETE /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:53:38.342181 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-47e53971-0126-49ba-921f-fd0e90fafe36 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:38.347535 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-47e53971-0126-49ba-921f-fd0e90fafe36 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9afd6ad-3b96-4a57-8301-5da830e674c7] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:38.386221 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-47e53971-0126-49ba-921f-fd0e90fafe36 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:38.390135 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-47e53971-0126-49ba-921f-fd0e90fafe36 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:38.392207 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-6aad6540-6b46-4aeb-b436-dcd02319fea4 tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322b415e8fc34c5dacfdcb6efba30f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917b814c2ee46aba6dafc77bf82c390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:38.394775 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-47e53971-0126-49ba-921f-fd0e90fafe36 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:38.395898 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-47e53971-0126-49ba-921f-fd0e90fafe36 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:38.405358 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-6aad6540-6b46-4aeb-b436-dcd02319fea4 tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '322b415e8fc34c5dacfdcb6efba30f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917b814c2ee46aba6dafc77bf82c390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:38.409575 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-6aad6540-6b46-4aeb-b436-dcd02319fea4 tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '322b415e8fc34c5dacfdcb6efba30f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917b814c2ee46aba6dafc77bf82c390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:38.413030 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-47e53971-0126-49ba-921f-fd0e90fafe36 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:38.413579 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-47e53971-0126-49ba-921f-fd0e90fafe36 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:38.417641 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6aad6540-6b46-4aeb-b436-dcd02319fea4 tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] 10.222.0.20 "GET /compute/v2.1/servers/f910d164-591e-41d7-9af8-8b690b08e4b5" status: 200 len: 1365 microversion: 2.47 time: 0.537458 Oct 04 18:53:38.420186 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2679/5403] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:53:37 2022] GET /compute/v2.1/servers/f910d164-591e-41d7-9af8-8b690b08e4b5 => generated 1365 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:53:38.509973 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:53:38.655037 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-47e53971-0126-49ba-921f-fd0e90fafe36 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:38.672599 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-47e53971-0126-49ba-921f-fd0e90fafe36 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7" status: 200 len: 1493 microversion: 2.1 time: 0.336874 Oct 04 18:53:38.672599 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2725/5404] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:38 2022] GET /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7 => generated 1493 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:39.448935 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b3f36449-f4ae-47c0-a1c3-ef5b1178bae8 tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:39.449712 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b3f36449-f4ae-47c0-a1c3-ef5b1178bae8 tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] [instance: f910d164-591e-41d7-9af8-8b690b08e4b5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:39.451700 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:53:39.462356 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b3f36449-f4ae-47c0-a1c3-ef5b1178bae8 tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:39.462356 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b3f36449-f4ae-47c0-a1c3-ef5b1178bae8 tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:39.463405 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b3f36449-f4ae-47c0-a1c3-ef5b1178bae8 tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:39.464392 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b3f36449-f4ae-47c0-a1c3-ef5b1178bae8 tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:39.465202 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b3f36449-f4ae-47c0-a1c3-ef5b1178bae8 tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:39.466865 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b3f36449-f4ae-47c0-a1c3-ef5b1178bae8 tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:39.680522 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b3f36449-f4ae-47c0-a1c3-ef5b1178bae8 tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322b415e8fc34c5dacfdcb6efba30f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917b814c2ee46aba6dafc77bf82c390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:39.694722 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b3f36449-f4ae-47c0-a1c3-ef5b1178bae8 tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '322b415e8fc34c5dacfdcb6efba30f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917b814c2ee46aba6dafc77bf82c390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:39.696218 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b3f36449-f4ae-47c0-a1c3-ef5b1178bae8 tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '322b415e8fc34c5dacfdcb6efba30f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917b814c2ee46aba6dafc77bf82c390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:39.697218 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1b2c26ef-bc7a-440e-9d04-b21f47321baa tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:39.697847 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1b2c26ef-bc7a-440e-9d04-b21f47321baa tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9afd6ad-3b96-4a57-8301-5da830e674c7] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:39.698403 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b3f36449-f4ae-47c0-a1c3-ef5b1178bae8 tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] 10.222.0.20 "GET /compute/v2.1/servers/f910d164-591e-41d7-9af8-8b690b08e4b5" status: 200 len: 1365 microversion: 2.47 time: 0.253640 Oct 04 18:53:39.699293 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2680/5405] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:53:39 2022] GET /compute/v2.1/servers/f910d164-591e-41d7-9af8-8b690b08e4b5 => generated 1365 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:53:39.715436 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1b2c26ef-bc7a-440e-9d04-b21f47321baa tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:39.716340 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1b2c26ef-bc7a-440e-9d04-b21f47321baa tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:39.716997 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1b2c26ef-bc7a-440e-9d04-b21f47321baa tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:39.718203 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1b2c26ef-bc7a-440e-9d04-b21f47321baa tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:39.718855 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1b2c26ef-bc7a-440e-9d04-b21f47321baa tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:39.719475 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1b2c26ef-bc7a-440e-9d04-b21f47321baa tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:40.024617 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=8 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:53:40.223008 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1b2c26ef-bc7a-440e-9d04-b21f47321baa tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:40.249803 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1b2c26ef-bc7a-440e-9d04-b21f47321baa tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7" status: 200 len: 1493 microversion: 2.1 time: 0.556551 Oct 04 18:53:40.260241 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2726/5406] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:39 2022] GET /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7 => generated 1493 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:40.732013 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-342dfb74-137e-4c65-ac8f-6eb2513519cc tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:40.737731 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-342dfb74-137e-4c65-ac8f-6eb2513519cc tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] [instance: f910d164-591e-41d7-9af8-8b690b08e4b5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:40.755153 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-342dfb74-137e-4c65-ac8f-6eb2513519cc tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:40.756296 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-342dfb74-137e-4c65-ac8f-6eb2513519cc tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:40.756753 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-342dfb74-137e-4c65-ac8f-6eb2513519cc tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:40.757477 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-342dfb74-137e-4c65-ac8f-6eb2513519cc tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:40.757942 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-342dfb74-137e-4c65-ac8f-6eb2513519cc tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:40.758369 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-342dfb74-137e-4c65-ac8f-6eb2513519cc tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:40.853203 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-342dfb74-137e-4c65-ac8f-6eb2513519cc tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:40.853696 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-342dfb74-137e-4c65-ac8f-6eb2513519cc tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:40.854328 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-342dfb74-137e-4c65-ac8f-6eb2513519cc tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:40.854955 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-342dfb74-137e-4c65-ac8f-6eb2513519cc tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Lazy-loading 'fault' on Instance uuid f910d164-591e-41d7-9af8-8b690b08e4b5 {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:53:40.983385 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-342dfb74-137e-4c65-ac8f-6eb2513519cc tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322b415e8fc34c5dacfdcb6efba30f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917b814c2ee46aba6dafc77bf82c390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:40.994179 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-342dfb74-137e-4c65-ac8f-6eb2513519cc tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '322b415e8fc34c5dacfdcb6efba30f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917b814c2ee46aba6dafc77bf82c390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:40.995648 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-342dfb74-137e-4c65-ac8f-6eb2513519cc tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '322b415e8fc34c5dacfdcb6efba30f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917b814c2ee46aba6dafc77bf82c390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:40.997050 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-342dfb74-137e-4c65-ac8f-6eb2513519cc tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] 10.222.0.20 "GET /compute/v2.1/servers/f910d164-591e-41d7-9af8-8b690b08e4b5" status: 200 len: 1370 microversion: 2.47 time: 0.269739 Oct 04 18:53:40.998188 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2681/5407] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:53:40 2022] GET /compute/v2.1/servers/f910d164-591e-41d7-9af8-8b690b08e4b5 => generated 1370 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:53:41.289294 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8ca7d73f-905d-4978-bebb-58e2405466d6 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:41.291540 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8ca7d73f-905d-4978-bebb-58e2405466d6 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9afd6ad-3b96-4a57-8301-5da830e674c7] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:41.315759 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8ca7d73f-905d-4978-bebb-58e2405466d6 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:41.327408 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8ca7d73f-905d-4978-bebb-58e2405466d6 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:41.327408 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8ca7d73f-905d-4978-bebb-58e2405466d6 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:41.327408 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8ca7d73f-905d-4978-bebb-58e2405466d6 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:41.327408 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8ca7d73f-905d-4978-bebb-58e2405466d6 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:41.328223 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8ca7d73f-905d-4978-bebb-58e2405466d6 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:41.528866 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-0e07bb85-d37a-4176-9282-d388663fc320 req-b87ab932-d26b-4dea-9bc1-9ee7b71ad5f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9afd6ad-3b96-4a57-8301-5da830e674c7", "name": "network-vif-deleted", "tag": "7cd90652-9ead-45c9-ac3b-182b9c2da3bb"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:53:41.555234 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-0e07bb85-d37a-4176-9282-d388663fc320 req-b87ab932-d26b-4dea-9bc1-9ee7b71ad5f4 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:41.556286 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-0e07bb85-d37a-4176-9282-d388663fc320 req-b87ab932-d26b-4dea-9bc1-9ee7b71ad5f4 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:41.556924 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-0e07bb85-d37a-4176-9282-d388663fc320 req-b87ab932-d26b-4dea-9bc1-9ee7b71ad5f4 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:41.592289 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-0e07bb85-d37a-4176-9282-d388663fc320 req-b87ab932-d26b-4dea-9bc1-9ee7b71ad5f4 service nova] Creating event network-vif-deleted:7cd90652-9ead-45c9-ac3b-182b9c2da3bb for instance a9afd6ad-3b96-4a57-8301-5da830e674c7 on n-h2-850501-14 Oct 04 18:53:41.604947 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-0e07bb85-d37a-4176-9282-d388663fc320 req-b87ab932-d26b-4dea-9bc1-9ee7b71ad5f4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.321554 Oct 04 18:53:41.608791 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2682/5408] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:53:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:53:41.633388 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8ca7d73f-905d-4978-bebb-58e2405466d6 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:41.696958 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8ca7d73f-905d-4978-bebb-58e2405466d6 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7" status: 200 len: 1451 microversion: 2.1 time: 0.413370 Oct 04 18:53:41.724207 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2727/5409] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:41 2022] GET /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7 => generated 1451 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:42.026392 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-61121468-4176-46d9-86aa-d567e6d05fd4 tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:42.027367 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-61121468-4176-46d9-86aa-d567e6d05fd4 tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] [instance: f910d164-591e-41d7-9af8-8b690b08e4b5] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:42.040040 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-61121468-4176-46d9-86aa-d567e6d05fd4 tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:42.043703 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-61121468-4176-46d9-86aa-d567e6d05fd4 tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:42.044514 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-61121468-4176-46d9-86aa-d567e6d05fd4 tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:42.045438 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-61121468-4176-46d9-86aa-d567e6d05fd4 tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:42.046390 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-61121468-4176-46d9-86aa-d567e6d05fd4 tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:42.053059 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-61121468-4176-46d9-86aa-d567e6d05fd4 tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:42.085026 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-61121468-4176-46d9-86aa-d567e6d05fd4 tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] HTTP exception thrown: Instance f910d164-591e-41d7-9af8-8b690b08e4b5 could not be found. Oct 04 18:53:42.098891 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-61121468-4176-46d9-86aa-d567e6d05fd4 tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Request method failure captured: Oct 04 18:53:42.098891 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/f910d164-591e-41d7-9af8-8b690b08e4b5 HTTP/1.1 Oct 04 18:53:42.098891 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:53:42.098891 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:53:42.098891 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:53:42.098891 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:53:42.098891 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:53:42.098891 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:53:42.098891 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:53:42.098891 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:53:42.098891 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPIEnjNylhxzJdKfmWcijpGb9BdMdRLTEWHYe8xvb1HGdWeTetjRxA2vzjKsVnx9HLaPrjG1BCoOnRhZaYUjsAVJXQ_QekkIOeB5p9IaJ7wPPNxpf0ao0qbOTE9dJ07_4Kg2IcrfD5R6_DOpakmvp0d554vZOkTPJTMiIbrRT-pBLzRI Oct 04 18:53:42.098891 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:53:42.098891 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:53:42.098891 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:53:42.098891 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:53:42.098891 n-d-850501-14 devstack@n-api.service[123002]: X-Openstack-Nova-Api-Version: 2.47 Oct 04 18:53:42.098891 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:53:42.098891 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:53:42.098891 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: a917b814c2ee46aba6dafc77bf82c390 Oct 04 18:53:42.098891 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServersAaction247Test-113354398 Oct 04 18:53:42.098891 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:53:42.098891 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:53:42.098891 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a917b814c2ee46aba6dafc77bf82c390"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a917b814c2ee46aba6dafc77bf82c390", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a917b814c2ee46aba6dafc77bf82c390"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a917b814c2ee46aba6dafc77bf82c390"}]}] Oct 04 18:53:42.098891 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServersAaction247Test-113354398 Oct 04 18:53:42.098891 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: a917b814c2ee46aba6dafc77bf82c390 Oct 04 18:53:42.098891 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServersAaction247Test-113354398 Oct 04 18:53:42.098891 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServersAaction247Test-113354398-project Oct 04 18:53:42.098891 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:53:42.098891 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:53:42.098891 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 322b415e8fc34c5dacfdcb6efba30f69 Oct 04 18:53:42.098891 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServersAaction247Test-113354398-project Oct 04 18:53:42.098891 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:53:42.098891 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance f910d164-591e-41d7-9af8-8b690b08e4b5 could not be found. Oct 04 18:53:42.098891 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'f910d164-591e-41d7-9af8-8b690b08e4b5'} Oct 04 18:53:42.098891 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:53:42.098891 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:42.098891 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:53:42.098891 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:53:42.098891 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:53:42.098891 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:53:42.098891 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:53:42.098891 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:53:42.098891 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:53:42.098891 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:53:42.098891 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f910d164-591e-41d7-9af8-8b690b08e4b5 could not be found. Oct 04 18:53:42.098891 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:53:42.098891 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:53:42.098891 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:53:42.098891 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:42.098891 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:53:42.098891 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:53:42.098891 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:53:42.098891 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:53:42.098891 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:53:42.098891 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:53:42.098891 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:53:42.098891 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:53:42.098891 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:53:42.098891 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:53:42.098891 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:53:42.098891 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:53:42.098891 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f910d164-591e-41d7-9af8-8b690b08e4b5 could not be found. Oct 04 18:53:42.098891 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:53:42.098891 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:53:42.098891 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:53:42.109814 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:42.109814 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:53:42.109814 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:53:42.109814 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:53:42.109814 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:53:42.109814 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f910d164-591e-41d7-9af8-8b690b08e4b5 could not be found. Oct 04 18:53:42.109814 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:53:42.109814 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-61121468-4176-46d9-86aa-d567e6d05fd4 tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] Returning 404 to user: Instance f910d164-591e-41d7-9af8-8b690b08e4b5 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:53:42.109814 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-61121468-4176-46d9-86aa-d567e6d05fd4 tempest-ServersAaction247Test-113354398 tempest-ServersAaction247Test-113354398-project] 10.222.0.20 "GET /compute/v2.1/servers/f910d164-591e-41d7-9af8-8b690b08e4b5" status: 404 len: 111 microversion: 2.47 time: 0.081953 Oct 04 18:53:42.109814 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2683/5410] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:53:42 2022] GET /compute/v2.1/servers/f910d164-591e-41d7-9af8-8b690b08e4b5 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:53:42.736415 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1f431f2e-9833-4d8a-b37e-566a2e9f0d3c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:42.738444 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1f431f2e-9833-4d8a-b37e-566a2e9f0d3c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9afd6ad-3b96-4a57-8301-5da830e674c7] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:42.743153 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:53:42.751244 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1f431f2e-9833-4d8a-b37e-566a2e9f0d3c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:42.752630 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1f431f2e-9833-4d8a-b37e-566a2e9f0d3c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:42.753798 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1f431f2e-9833-4d8a-b37e-566a2e9f0d3c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:42.755809 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1f431f2e-9833-4d8a-b37e-566a2e9f0d3c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:42.757013 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1f431f2e-9833-4d8a-b37e-566a2e9f0d3c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:42.758198 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1f431f2e-9833-4d8a-b37e-566a2e9f0d3c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:42.832882 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1f431f2e-9833-4d8a-b37e-566a2e9f0d3c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:42.833910 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1f431f2e-9833-4d8a-b37e-566a2e9f0d3c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:42.835839 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1f431f2e-9833-4d8a-b37e-566a2e9f0d3c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:42.836624 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-1f431f2e-9833-4d8a-b37e-566a2e9f0d3c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lazy-loading 'fault' on Instance uuid a9afd6ad-3b96-4a57-8301-5da830e674c7 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:53:42.931563 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1f431f2e-9833-4d8a-b37e-566a2e9f0d3c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:42.955626 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1f431f2e-9833-4d8a-b37e-566a2e9f0d3c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7" status: 200 len: 1304 microversion: 2.1 time: 0.221868 Oct 04 18:53:42.965089 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2728/5411] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:42 2022] GET /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7 => generated 1304 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:43.981748 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d5fd654d-9f26-4711-b41d-509227788191 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:43.982629 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d5fd654d-9f26-4711-b41d-509227788191 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9afd6ad-3b96-4a57-8301-5da830e674c7] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:43.990843 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d5fd654d-9f26-4711-b41d-509227788191 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:43.991327 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d5fd654d-9f26-4711-b41d-509227788191 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:43.992015 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d5fd654d-9f26-4711-b41d-509227788191 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:43.994287 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d5fd654d-9f26-4711-b41d-509227788191 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:43.994287 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d5fd654d-9f26-4711-b41d-509227788191 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:43.994287 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d5fd654d-9f26-4711-b41d-509227788191 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:44.017897 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-d5fd654d-9f26-4711-b41d-509227788191 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] HTTP exception thrown: Instance a9afd6ad-3b96-4a57-8301-5da830e674c7 could not be found. Oct 04 18:53:44.021212 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d5fd654d-9f26-4711-b41d-509227788191 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Request method failure captured: Oct 04 18:53:44.021212 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7 HTTP/1.1 Oct 04 18:53:44.021212 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:53:44.021212 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:53:44.021212 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:53:44.021212 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:53:44.021212 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:53:44.021212 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:53:44.021212 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:53:44.021212 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:53:44.021212 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPIAZ5RZP-L2AfGhXbSAirsikFtiKRJw8GbD2F4avTn6csTjPvYW4EgckMMa_odYrXTBqTIarrxxpsgj83P_nCf0n9cSTNLxyj6f4zISS1Nx3NxppTvrxz8bw1hclhfH5hpAMl_7yiEWC9J95Zeea4ou_80fw0GmE8GZRBOxEg7cn1lU Oct 04 18:53:44.021212 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:53:44.021212 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:53:44.021212 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:53:44.021212 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:53:44.021212 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:53:44.021212 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:53:44.021212 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 4154ec20e0354ee6a425ba853b8efe67 Oct 04 18:53:44.021212 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-DeleteServersTestJSON-806460860 Oct 04 18:53:44.021212 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:53:44.021212 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:53:44.021212 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4154ec20e0354ee6a425ba853b8efe67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4154ec20e0354ee6a425ba853b8efe67", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4154ec20e0354ee6a425ba853b8efe67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4154ec20e0354ee6a425ba853b8efe67"}]}] Oct 04 18:53:44.021212 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-DeleteServersTestJSON-806460860 Oct 04 18:53:44.021212 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 4154ec20e0354ee6a425ba853b8efe67 Oct 04 18:53:44.021212 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-DeleteServersTestJSON-806460860 Oct 04 18:53:44.021212 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-DeleteServersTestJSON-806460860-project Oct 04 18:53:44.021212 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:53:44.021212 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:53:44.021212 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: c56b67cede6b46f5a36a723d361b3245 Oct 04 18:53:44.021212 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-DeleteServersTestJSON-806460860-project Oct 04 18:53:44.021212 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:53:44.021212 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance a9afd6ad-3b96-4a57-8301-5da830e674c7 could not be found. Oct 04 18:53:44.021212 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'a9afd6ad-3b96-4a57-8301-5da830e674c7'} Oct 04 18:53:44.021212 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:53:44.021212 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:44.021212 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:53:44.021212 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:53:44.021212 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:53:44.021212 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:53:44.021212 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:53:44.021212 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:53:44.021212 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:53:44.021212 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:53:44.021212 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9afd6ad-3b96-4a57-8301-5da830e674c7 could not be found. Oct 04 18:53:44.021212 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:53:44.021212 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:53:44.021212 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:53:44.021212 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:44.021212 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:53:44.021212 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:53:44.021212 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:53:44.021212 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:53:44.021212 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:53:44.021212 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:53:44.021212 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:53:44.021212 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:53:44.021212 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:53:44.021212 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:53:44.021212 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:53:44.021212 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:53:44.021212 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9afd6ad-3b96-4a57-8301-5da830e674c7 could not be found. Oct 04 18:53:44.021212 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:53:44.021212 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:53:44.021212 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:53:44.030558 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:44.030558 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:53:44.030558 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:53:44.030558 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:53:44.030558 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:53:44.030558 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9afd6ad-3b96-4a57-8301-5da830e674c7 could not be found. Oct 04 18:53:44.030558 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:53:44.030558 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d5fd654d-9f26-4711-b41d-509227788191 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Returning 404 to user: Instance a9afd6ad-3b96-4a57-8301-5da830e674c7 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:53:44.030558 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d5fd654d-9f26-4711-b41d-509227788191 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7" status: 404 len: 111 microversion: 2.1 time: 0.046977 Oct 04 18:53:44.030558 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2684/5412] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:43 2022] GET /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:53:44.205160 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c7f9be9a-7e20-4969-86e0-4d1f50f78381 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1149986258", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": [{"uuid": "8e684a5f-0995-474b-b515-28954add873e"}]}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:53:44.296352 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.neutron [None req-c7f9be9a-7e20-4969-86e0-4d1f50f78381 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] validate_networks() for [('8e684a5f-0995-474b-b515-28954add873e', None, None, None, None, None)] {{(pid=123001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:53:45.437182 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-c7f9be9a-7e20-4969-86e0-4d1f50f78381 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:53:45.454115 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-c7f9be9a-7e20-4969-86e0-4d1f50f78381 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:53:45.454714 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-c7f9be9a-7e20-4969-86e0-4d1f50f78381 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:53:45.455147 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-c7f9be9a-7e20-4969-86e0-4d1f50f78381 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:53:45.455585 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-c7f9be9a-7e20-4969-86e0-4d1f50f78381 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:53:45.477440 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c7f9be9a-7e20-4969-86e0-4d1f50f78381 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:45.480798 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c7f9be9a-7e20-4969-86e0-4d1f50f78381 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:45.480798 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c7f9be9a-7e20-4969-86e0-4d1f50f78381 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:45.480798 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c7f9be9a-7e20-4969-86e0-4d1f50f78381 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:45.480798 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c7f9be9a-7e20-4969-86e0-4d1f50f78381 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:45.480798 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c7f9be9a-7e20-4969-86e0-4d1f50f78381 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:45.534156 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-c7f9be9a-7e20-4969-86e0-4d1f50f78381 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Getting quotas for project 4154ec20e0354ee6a425ba853b8efe67. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:53:45.553428 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-c7f9be9a-7e20-4969-86e0-4d1f50f78381 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Getting quotas for user c56b67cede6b46f5a36a723d361b3245 and project 4154ec20e0354ee6a425ba853b8efe67. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:53:45.571509 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c7f9be9a-7e20-4969-86e0-4d1f50f78381 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Going to run 1 instances... {{(pid=123001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:53:45.574378 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c7f9be9a-7e20-4969-86e0-4d1f50f78381 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: 41e6c46e-2175-4d24-94da-cb48da165631] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:53:45.754699 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c7f9be9a-7e20-4969-86e0-4d1f50f78381 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.554530 Oct 04 18:53:45.760260 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2729/5413] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:53:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1561 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:53:45.773649 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-dcf84867-03c3-47ce-b270-143f1c73dff0 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:45.774299 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-dcf84867-03c3-47ce-b270-143f1c73dff0 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: 41e6c46e-2175-4d24-94da-cb48da165631] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:45.978507 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-dcf84867-03c3-47ce-b270-143f1c73dff0 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:45.994413 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-dcf84867-03c3-47ce-b270-143f1c73dff0 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/41e6c46e-2175-4d24-94da-cb48da165631" status: 200 len: 1215 microversion: 2.1 time: 0.226295 Oct 04 18:53:45.997084 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2685/5414] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:45 2022] GET /compute/v2.1/servers/41e6c46e-2175-4d24-94da-cb48da165631 => generated 1215 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:47.034962 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-fdde0e75-cfd9-472b-8e4a-2350c49320d7 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:47.061551 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-fdde0e75-cfd9-472b-8e4a-2350c49320d7 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: 41e6c46e-2175-4d24-94da-cb48da165631] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:47.195889 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-fdde0e75-cfd9-472b-8e4a-2350c49320d7 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:47.203216 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-fdde0e75-cfd9-472b-8e4a-2350c49320d7 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/41e6c46e-2175-4d24-94da-cb48da165631" status: 200 len: 1215 microversion: 2.1 time: 0.184716 Oct 04 18:53:47.214078 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2730/5415] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:47 2022] GET /compute/v2.1/servers/41e6c46e-2175-4d24-94da-cb48da165631 => generated 1215 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:48.238456 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5f035495-b787-407f-85d2-5158dc46e2e4 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:48.239114 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5f035495-b787-407f-85d2-5158dc46e2e4 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: 41e6c46e-2175-4d24-94da-cb48da165631] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:48.247910 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5f035495-b787-407f-85d2-5158dc46e2e4 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:48.248445 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5f035495-b787-407f-85d2-5158dc46e2e4 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:48.248880 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5f035495-b787-407f-85d2-5158dc46e2e4 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:48.249582 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5f035495-b787-407f-85d2-5158dc46e2e4 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:48.250065 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5f035495-b787-407f-85d2-5158dc46e2e4 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:48.250684 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5f035495-b787-407f-85d2-5158dc46e2e4 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:48.380540 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5f035495-b787-407f-85d2-5158dc46e2e4 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:48.390261 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5f035495-b787-407f-85d2-5158dc46e2e4 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/41e6c46e-2175-4d24-94da-cb48da165631" status: 200 len: 1267 microversion: 2.1 time: 0.157026 Oct 04 18:53:48.392013 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2686/5416] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:48 2022] GET /compute/v2.1/servers/41e6c46e-2175-4d24-94da-cb48da165631 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:49.416417 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-23a7068a-4666-4f40-a652-6047fde8fe79 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:49.417914 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-23a7068a-4666-4f40-a652-6047fde8fe79 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: 41e6c46e-2175-4d24-94da-cb48da165631] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:49.430147 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-23a7068a-4666-4f40-a652-6047fde8fe79 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:49.431475 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-23a7068a-4666-4f40-a652-6047fde8fe79 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:49.433875 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-23a7068a-4666-4f40-a652-6047fde8fe79 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:49.435232 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-23a7068a-4666-4f40-a652-6047fde8fe79 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:49.437519 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-23a7068a-4666-4f40-a652-6047fde8fe79 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:49.444460 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-23a7068a-4666-4f40-a652-6047fde8fe79 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:49.659221 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-23a7068a-4666-4f40-a652-6047fde8fe79 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:49.670887 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-23a7068a-4666-4f40-a652-6047fde8fe79 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/41e6c46e-2175-4d24-94da-cb48da165631" status: 200 len: 1273 microversion: 2.1 time: 0.258922 Oct 04 18:53:49.684607 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2731/5417] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:49 2022] GET /compute/v2.1/servers/41e6c46e-2175-4d24-94da-cb48da165631 => generated 1273 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:50.700606 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f98cc362-26db-467f-a218-30fb3e7a532b tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:50.701229 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f98cc362-26db-467f-a218-30fb3e7a532b tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: 41e6c46e-2175-4d24-94da-cb48da165631] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:50.710185 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f98cc362-26db-467f-a218-30fb3e7a532b tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:50.721230 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f98cc362-26db-467f-a218-30fb3e7a532b tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:50.721693 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f98cc362-26db-467f-a218-30fb3e7a532b tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:50.722444 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f98cc362-26db-467f-a218-30fb3e7a532b tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:50.722904 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f98cc362-26db-467f-a218-30fb3e7a532b tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:50.724392 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f98cc362-26db-467f-a218-30fb3e7a532b tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:51.307544 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f98cc362-26db-467f-a218-30fb3e7a532b tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:51.315882 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f98cc362-26db-467f-a218-30fb3e7a532b tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/41e6c46e-2175-4d24-94da-cb48da165631" status: 200 len: 1273 microversion: 2.1 time: 0.620261 Oct 04 18:53:51.362643 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2687/5418] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:50 2022] GET /compute/v2.1/servers/41e6c46e-2175-4d24-94da-cb48da165631 => generated 1273 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:52.386646 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f163bb18-847f-4c42-a52f-45e49c2fac9f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:52.387643 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f163bb18-847f-4c42-a52f-45e49c2fac9f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: 41e6c46e-2175-4d24-94da-cb48da165631] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:52.408181 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f163bb18-847f-4c42-a52f-45e49c2fac9f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:52.410121 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f163bb18-847f-4c42-a52f-45e49c2fac9f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:52.413314 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f163bb18-847f-4c42-a52f-45e49c2fac9f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:52.416622 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f163bb18-847f-4c42-a52f-45e49c2fac9f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:52.420426 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f163bb18-847f-4c42-a52f-45e49c2fac9f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:52.421923 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f163bb18-847f-4c42-a52f-45e49c2fac9f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:52.950315 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f163bb18-847f-4c42-a52f-45e49c2fac9f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:52.965061 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f163bb18-847f-4c42-a52f-45e49c2fac9f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/41e6c46e-2175-4d24-94da-cb48da165631" status: 200 len: 1315 microversion: 2.1 time: 0.583465 Oct 04 18:53:52.966415 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2732/5419] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:52 2022] GET /compute/v2.1/servers/41e6c46e-2175-4d24-94da-cb48da165631 => generated 1315 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:53.991724 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e1670dc9-704a-4690-ba21-07ec2ba3bcac tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:53.992393 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e1670dc9-704a-4690-ba21-07ec2ba3bcac tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: 41e6c46e-2175-4d24-94da-cb48da165631] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:54.008748 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e1670dc9-704a-4690-ba21-07ec2ba3bcac tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:54.009435 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e1670dc9-704a-4690-ba21-07ec2ba3bcac tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:54.009964 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e1670dc9-704a-4690-ba21-07ec2ba3bcac tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:54.010899 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e1670dc9-704a-4690-ba21-07ec2ba3bcac tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:54.011448 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e1670dc9-704a-4690-ba21-07ec2ba3bcac tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:54.013955 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e1670dc9-704a-4690-ba21-07ec2ba3bcac tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:54.355638 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e1670dc9-704a-4690-ba21-07ec2ba3bcac tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:54.368814 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e1670dc9-704a-4690-ba21-07ec2ba3bcac tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/41e6c46e-2175-4d24-94da-cb48da165631" status: 200 len: 1315 microversion: 2.1 time: 0.380790 Oct 04 18:53:54.369853 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2688/5420] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:53 2022] GET /compute/v2.1/servers/41e6c46e-2175-4d24-94da-cb48da165631 => generated 1315 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:54.662731 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-41b4cf19-89ed-438f-ac5a-1623b932ec5c req-adb9af63-fbe1-4e14-8bc9-aa33eccc4e76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41e6c46e-2175-4d24-94da-cb48da165631", "tag": "fdd68b2f-c0f0-4708-aba9-f4085dfac44d"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:53:54.699041 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-41b4cf19-89ed-438f-ac5a-1623b932ec5c req-adb9af63-fbe1-4e14-8bc9-aa33eccc4e76 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:54.699041 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-41b4cf19-89ed-438f-ac5a-1623b932ec5c req-adb9af63-fbe1-4e14-8bc9-aa33eccc4e76 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:54.699041 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-41b4cf19-89ed-438f-ac5a-1623b932ec5c req-adb9af63-fbe1-4e14-8bc9-aa33eccc4e76 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:54.715887 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-41b4cf19-89ed-438f-ac5a-1623b932ec5c req-adb9af63-fbe1-4e14-8bc9-aa33eccc4e76 service nova] Creating event network-changed:fdd68b2f-c0f0-4708-aba9-f4085dfac44d for instance 41e6c46e-2175-4d24-94da-cb48da165631 on n-h1-850501-14 Oct 04 18:53:54.725415 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-41b4cf19-89ed-438f-ac5a-1623b932ec5c req-adb9af63-fbe1-4e14-8bc9-aa33eccc4e76 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068289 Oct 04 18:53:54.727463 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2733/5421] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:53:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:53:55.401362 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0faef327-d73f-4f30-be23-a28e6fd68fa2 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:55.402009 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0faef327-d73f-4f30-be23-a28e6fd68fa2 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: 41e6c46e-2175-4d24-94da-cb48da165631] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:55.410609 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:53:55.425301 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0faef327-d73f-4f30-be23-a28e6fd68fa2 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:55.425832 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0faef327-d73f-4f30-be23-a28e6fd68fa2 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:55.426280 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0faef327-d73f-4f30-be23-a28e6fd68fa2 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:55.427165 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0faef327-d73f-4f30-be23-a28e6fd68fa2 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:55.427848 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0faef327-d73f-4f30-be23-a28e6fd68fa2 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:55.428477 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0faef327-d73f-4f30-be23-a28e6fd68fa2 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:55.993002 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:53:56.072254 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0faef327-d73f-4f30-be23-a28e6fd68fa2 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:56.080937 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0faef327-d73f-4f30-be23-a28e6fd68fa2 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/41e6c46e-2175-4d24-94da-cb48da165631" status: 200 len: 1315 microversion: 2.1 time: 0.687371 Oct 04 18:53:56.081523 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2689/5422] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:55 2022] GET /compute/v2.1/servers/41e6c46e-2175-4d24-94da-cb48da165631 => generated 1315 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:57.108789 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b3f83232-a345-42d3-a465-a8318ef5dbfd tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:57.109505 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b3f83232-a345-42d3-a465-a8318ef5dbfd tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: 41e6c46e-2175-4d24-94da-cb48da165631] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:57.111656 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:53:57.122178 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b3f83232-a345-42d3-a465-a8318ef5dbfd tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:57.122697 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b3f83232-a345-42d3-a465-a8318ef5dbfd tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:57.125479 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b3f83232-a345-42d3-a465-a8318ef5dbfd tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:57.126245 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b3f83232-a345-42d3-a465-a8318ef5dbfd tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:57.126906 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b3f83232-a345-42d3-a465-a8318ef5dbfd tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:57.127348 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b3f83232-a345-42d3-a465-a8318ef5dbfd tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:57.199899 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=8 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:53:57.731187 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b3f83232-a345-42d3-a465-a8318ef5dbfd tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:57.743592 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b3f83232-a345-42d3-a465-a8318ef5dbfd tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/41e6c46e-2175-4d24-94da-cb48da165631" status: 200 len: 1315 microversion: 2.1 time: 0.642340 Oct 04 18:53:57.744996 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2734/5423] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:57 2022] GET /compute/v2.1/servers/41e6c46e-2175-4d24-94da-cb48da165631 => generated 1315 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:59.084210 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-eb4c5ffb-b003-43e8-8d89-b087b593cba4 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:59.084843 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-eb4c5ffb-b003-43e8-8d89-b087b593cba4 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: 41e6c46e-2175-4d24-94da-cb48da165631] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:59.090906 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eb4c5ffb-b003-43e8-8d89-b087b593cba4 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:59.096636 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eb4c5ffb-b003-43e8-8d89-b087b593cba4 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:59.096636 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eb4c5ffb-b003-43e8-8d89-b087b593cba4 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:59.096636 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eb4c5ffb-b003-43e8-8d89-b087b593cba4 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:59.096636 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eb4c5ffb-b003-43e8-8d89-b087b593cba4 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:59.096636 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eb4c5ffb-b003-43e8-8d89-b087b593cba4 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:00.323872 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-eb4c5ffb-b003-43e8-8d89-b087b593cba4 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:00.332124 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-eb4c5ffb-b003-43e8-8d89-b087b593cba4 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/41e6c46e-2175-4d24-94da-cb48da165631" status: 200 len: 1315 microversion: 2.1 time: 1.569032 Oct 04 18:54:00.333224 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2690/5424] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:58 2022] GET /compute/v2.1/servers/41e6c46e-2175-4d24-94da-cb48da165631 => generated 1315 bytes in 1571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:01.357479 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6b7f5bf9-c765-4fb7-b489-0b6f91296839 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:01.358763 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6b7f5bf9-c765-4fb7-b489-0b6f91296839 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: 41e6c46e-2175-4d24-94da-cb48da165631] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:01.374973 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6b7f5bf9-c765-4fb7-b489-0b6f91296839 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:01.391427 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6b7f5bf9-c765-4fb7-b489-0b6f91296839 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:01.392923 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6b7f5bf9-c765-4fb7-b489-0b6f91296839 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:01.393928 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6b7f5bf9-c765-4fb7-b489-0b6f91296839 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:01.408551 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6b7f5bf9-c765-4fb7-b489-0b6f91296839 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:01.409475 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6b7f5bf9-c765-4fb7-b489-0b6f91296839 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:01.632747 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-60a649c1-1a0f-4d9c-a2d3-a40d7c8b2b1f tempest-ServerGroup264TestJSON-801106680 tempest-ServerGroup264TestJSON-801106680-project] Action: 'create', calling method: .version_select at 0x7fe253a4af70>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:54:01.689245 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-60a649c1-1a0f-4d9c-a2d3-a40d7c8b2b1f tempest-ServerGroup264TestJSON-801106680 tempest-ServerGroup264TestJSON-801106680-project] Getting quotas for project 63371a6922da46ae8c4825d83ebc11a1. Resources: {'server_groups'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:54:01.710647 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-60a649c1-1a0f-4d9c-a2d3-a40d7c8b2b1f tempest-ServerGroup264TestJSON-801106680 tempest-ServerGroup264TestJSON-801106680-project] Getting quotas for user 911bc7cb359b4e8db92491a226db0b36 and project 63371a6922da46ae8c4825d83ebc11a1. Resources: {'server_groups'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:54:01.876854 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6b7f5bf9-c765-4fb7-b489-0b6f91296839 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:01.883656 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-60a649c1-1a0f-4d9c-a2d3-a40d7c8b2b1f tempest-ServerGroup264TestJSON-801106680 tempest-ServerGroup264TestJSON-801106680-project] Getting quotas for project 63371a6922da46ae8c4825d83ebc11a1. Resources: {'server_groups'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:54:01.890598 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-60a649c1-1a0f-4d9c-a2d3-a40d7c8b2b1f tempest-ServerGroup264TestJSON-801106680 tempest-ServerGroup264TestJSON-801106680-project] Getting quotas for user 911bc7cb359b4e8db92491a226db0b36 and project 63371a6922da46ae8c4825d83ebc11a1. Resources: {'server_groups'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:54:01.892930 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6b7f5bf9-c765-4fb7-b489-0b6f91296839 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/41e6c46e-2175-4d24-94da-cb48da165631" status: 200 len: 1315 microversion: 2.1 time: 0.537445 Oct 04 18:54:01.894560 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2735/5425] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:01 2022] GET /compute/v2.1/servers/41e6c46e-2175-4d24-94da-cb48da165631 => generated 1315 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:01.972122 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-60a649c1-1a0f-4d9c-a2d3-a40d7c8b2b1f tempest-ServerGroup264TestJSON-801106680 tempest-ServerGroup264TestJSON-801106680-project] 10.222.0.20 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.451869 Oct 04 18:54:01.974239 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2691/5426] 10.222.0.20 () {62 vars in 1214 bytes} [Tue Oct 4 18:54:01 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:54:01.993623 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-77655e35-f742-4bb4-8756-96d8afee3454 tempest-ServerGroup264TestJSON-801106680 tempest-ServerGroup264TestJSON-801106680-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:02.028802 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-77655e35-f742-4bb4-8756-96d8afee3454 tempest-ServerGroup264TestJSON-801106680 tempest-ServerGroup264TestJSON-801106680-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.046444 Oct 04 18:54:02.032586 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2736/5427] 10.222.0.20 () {60 vars in 1193 bytes} [Tue Oct 4 18:54:01 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:54:02.052644 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4e86f722-6314-4886-8b24-7237b5689881 tempest-ServerGroup264TestJSON-801106680 tempest-ServerGroup264TestJSON-801106680-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:02.063060 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4e86f722-6314-4886-8b24-7237b5689881 tempest-ServerGroup264TestJSON-801106680 tempest-ServerGroup264TestJSON-801106680-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups/6fb7ccd5-b58c-45a3-90d7-d9399a23d858" status: 200 len: 235 microversion: 2.64 time: 0.017551 Oct 04 18:54:02.085258 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9f2f7899-9bd5-43ae-b6d6-b9fc9dff6825 tempest-ServerGroup264TestJSON-801106680 tempest-ServerGroup264TestJSON-801106680-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:02.087839 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2692/5428] 10.222.0.20 () {60 vars in 1304 bytes} [Tue Oct 4 18:54:02 2022] GET /compute/v2.1/os-server-groups/6fb7ccd5-b58c-45a3-90d7-d9399a23d858 => generated 235 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:54:02.245433 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9f2f7899-9bd5-43ae-b6d6-b9fc9dff6825 tempest-ServerGroup264TestJSON-801106680 tempest-ServerGroup264TestJSON-801106680-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/6fb7ccd5-b58c-45a3-90d7-d9399a23d858" status: 204 len: 0 microversion: 2.64 time: 0.166430 Oct 04 18:54:02.248041 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2737/5429] 10.222.0.20 () {60 vars in 1307 bytes} [Tue Oct 4 18:54:02 2022] DELETE /compute/v2.1/os-server-groups/6fb7ccd5-b58c-45a3-90d7-d9399a23d858 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:54:02.260334 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-26252b05-fc35-41e6-9803-ebbe1fb998ca tempest-ServerGroup264TestJSON-801106680 tempest-ServerGroup264TestJSON-801106680-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:02.266688 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-26252b05-fc35-41e6-9803-ebbe1fb998ca tempest-ServerGroup264TestJSON-801106680 tempest-ServerGroup264TestJSON-801106680-project] HTTP exception thrown: Instance group 6fb7ccd5-b58c-45a3-90d7-d9399a23d858 could not be found. Oct 04 18:54:02.268560 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-26252b05-fc35-41e6-9803-ebbe1fb998ca tempest-ServerGroup264TestJSON-801106680 tempest-ServerGroup264TestJSON-801106680-project] Request method failure captured: Oct 04 18:54:02.268560 n-d-850501-14 devstack@n-api.service[123002]: request: DELETE /compute/v2.1/os-server-groups/6fb7ccd5-b58c-45a3-90d7-d9399a23d858 HTTP/1.1 Oct 04 18:54:02.268560 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:54:02.268560 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:54:02.268560 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:54:02.268560 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:54:02.268560 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:54:02.268560 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:54:02.268560 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:54:02.268560 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:54:02.268560 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPIFJ-gzwoNEW5o_dfUnSSIErUwCY_hGY-4IeaVighbHFDJrRe6egau33na8gFNYhUk4YhU-f7DRhXL9hJGKZ5-B_7S2-4vl7OeEQByWNcjp8VLTH93yCsJqe8eWlktCGzZ0E8j-XWoS6WrgQ44IOqCOFmNRJPbeAn8UJPCCL9oRooeg Oct 04 18:54:02.268560 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:54:02.268560 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:54:02.268560 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:54:02.268560 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:54:02.268560 n-d-850501-14 devstack@n-api.service[123002]: X-Openstack-Nova-Api-Version: 2.64 Oct 04 18:54:02.268560 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:54:02.268560 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:54:02.268560 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 63371a6922da46ae8c4825d83ebc11a1 Oct 04 18:54:02.268560 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServerGroup264TestJSON-801106680 Oct 04 18:54:02.268560 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:54:02.268560 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:54:02.268560 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/63371a6922da46ae8c4825d83ebc11a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_63371a6922da46ae8c4825d83ebc11a1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/63371a6922da46ae8c4825d83ebc11a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/63371a6922da46ae8c4825d83ebc11a1"}]}] Oct 04 18:54:02.268560 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServerGroup264TestJSON-801106680 Oct 04 18:54:02.268560 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 63371a6922da46ae8c4825d83ebc11a1 Oct 04 18:54:02.268560 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServerGroup264TestJSON-801106680 Oct 04 18:54:02.268560 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServerGroup264TestJSON-801106680-project Oct 04 18:54:02.268560 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:54:02.268560 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:54:02.268560 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 911bc7cb359b4e8db92491a226db0b36 Oct 04 18:54:02.268560 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServerGroup264TestJSON-801106680-project Oct 04 18:54:02.268560 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:54:02.268560 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance group 6fb7ccd5-b58c-45a3-90d7-d9399a23d858 could not be found. Oct 04 18:54:02.268560 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '6fb7ccd5-b58c-45a3-90d7-d9399a23d858'} Oct 04 18:54:02.268560 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:54:02.268560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:02.268560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 04 18:54:02.268560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 04 18:54:02.268560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:54:02.268560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:54:02.268560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 04 18:54:02.268560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 04 18:54:02.268560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:54:02.268560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:54:02.268560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 04 18:54:02.268560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 04 18:54:02.268560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 6fb7ccd5-b58c-45a3-90d7-d9399a23d858 could not be found. Oct 04 18:54:02.268560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:54:02.268560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:02.268560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:54:02.268560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:02.268560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:02.268560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:02.268560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:54:02.268560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:54:02.268560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:54:02.268560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:54:02.268560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 04 18:54:02.268560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:54:02.268560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 6fb7ccd5-b58c-45a3-90d7-d9399a23d858 could not be found. Oct 04 18:54:02.268560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:54:02.268560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:02.268560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:54:02.268560 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:02.275087 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:02.275087 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:02.275087 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:54:02.275087 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:54:02.275087 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 6fb7ccd5-b58c-45a3-90d7-d9399a23d858 could not be found. Oct 04 18:54:02.275087 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:54:02.280203 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-26252b05-fc35-41e6-9803-ebbe1fb998ca tempest-ServerGroup264TestJSON-801106680 tempest-ServerGroup264TestJSON-801106680-project] Returning 404 to user: Instance group 6fb7ccd5-b58c-45a3-90d7-d9399a23d858 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:54:02.280203 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-26252b05-fc35-41e6-9803-ebbe1fb998ca tempest-ServerGroup264TestJSON-801106680 tempest-ServerGroup264TestJSON-801106680-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/6fb7ccd5-b58c-45a3-90d7-d9399a23d858" status: 404 len: 117 microversion: 2.64 time: 0.021607 Oct 04 18:54:02.280203 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2693/5430] 10.222.0.20 () {60 vars in 1307 bytes} [Tue Oct 4 18:54:02 2022] DELETE /compute/v2.1/os-server-groups/6fb7ccd5-b58c-45a3-90d7-d9399a23d858 => generated 117 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:54:02.918805 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-68748bc9-c91e-431e-ae19-5f632bf90fde tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:02.919583 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-68748bc9-c91e-431e-ae19-5f632bf90fde tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: 41e6c46e-2175-4d24-94da-cb48da165631] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:02.933221 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-68748bc9-c91e-431e-ae19-5f632bf90fde tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:02.935655 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-68748bc9-c91e-431e-ae19-5f632bf90fde tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:02.936404 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-68748bc9-c91e-431e-ae19-5f632bf90fde tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:02.937551 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-68748bc9-c91e-431e-ae19-5f632bf90fde tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:02.940249 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-68748bc9-c91e-431e-ae19-5f632bf90fde tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:02.943950 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-68748bc9-c91e-431e-ae19-5f632bf90fde tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:03.309113 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-68748bc9-c91e-431e-ae19-5f632bf90fde tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:03.329318 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-68748bc9-c91e-431e-ae19-5f632bf90fde tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/41e6c46e-2175-4d24-94da-cb48da165631" status: 200 len: 1315 microversion: 2.1 time: 0.414309 Oct 04 18:54:03.329954 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2738/5431] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:02 2022] GET /compute/v2.1/servers/41e6c46e-2175-4d24-94da-cb48da165631 => generated 1315 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:04.373121 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8bfc6a2a-6b0b-4150-b0d6-9cf3dd27e5a7 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:04.392516 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8bfc6a2a-6b0b-4150-b0d6-9cf3dd27e5a7 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: 41e6c46e-2175-4d24-94da-cb48da165631] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:04.405378 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8bfc6a2a-6b0b-4150-b0d6-9cf3dd27e5a7 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:04.408902 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8bfc6a2a-6b0b-4150-b0d6-9cf3dd27e5a7 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:04.409468 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8bfc6a2a-6b0b-4150-b0d6-9cf3dd27e5a7 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:04.411194 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8bfc6a2a-6b0b-4150-b0d6-9cf3dd27e5a7 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:04.411858 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8bfc6a2a-6b0b-4150-b0d6-9cf3dd27e5a7 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:04.412713 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8bfc6a2a-6b0b-4150-b0d6-9cf3dd27e5a7 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:04.462418 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:54:04.813490 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-393faf9f-d772-4ad8-976e-a2b8686801a8 req-a27b95cb-1c6f-41b4-a4d7-1059fc2c040f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41e6c46e-2175-4d24-94da-cb48da165631", "name": "network-vif-plugged", "status": "completed", "tag": "fdd68b2f-c0f0-4708-aba9-f4085dfac44d"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:54:04.829094 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-393faf9f-d772-4ad8-976e-a2b8686801a8 req-a27b95cb-1c6f-41b4-a4d7-1059fc2c040f service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:04.830038 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-393faf9f-d772-4ad8-976e-a2b8686801a8 req-a27b95cb-1c6f-41b4-a4d7-1059fc2c040f service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:04.830692 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-393faf9f-d772-4ad8-976e-a2b8686801a8 req-a27b95cb-1c6f-41b4-a4d7-1059fc2c040f service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:04.864460 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-393faf9f-d772-4ad8-976e-a2b8686801a8 req-a27b95cb-1c6f-41b4-a4d7-1059fc2c040f service nova] Creating event network-vif-plugged:fdd68b2f-c0f0-4708-aba9-f4085dfac44d for instance 41e6c46e-2175-4d24-94da-cb48da165631 on n-h1-850501-14 Oct 04 18:54:04.888246 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-393faf9f-d772-4ad8-976e-a2b8686801a8 req-a27b95cb-1c6f-41b4-a4d7-1059fc2c040f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.534974 Oct 04 18:54:04.889125 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2694/5432] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:54:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:54:04.980183 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8bfc6a2a-6b0b-4150-b0d6-9cf3dd27e5a7 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:04.992885 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8bfc6a2a-6b0b-4150-b0d6-9cf3dd27e5a7 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/41e6c46e-2175-4d24-94da-cb48da165631" status: 200 len: 1315 microversion: 2.1 time: 0.637285 Oct 04 18:54:05.010036 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2739/5433] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:04 2022] GET /compute/v2.1/servers/41e6c46e-2175-4d24-94da-cb48da165631 => generated 1315 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:06.025622 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b65629db-bcc9-4cd0-bd50-57763140db6d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:06.026333 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b65629db-bcc9-4cd0-bd50-57763140db6d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: 41e6c46e-2175-4d24-94da-cb48da165631] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:06.041956 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b65629db-bcc9-4cd0-bd50-57763140db6d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:06.044133 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b65629db-bcc9-4cd0-bd50-57763140db6d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:06.050738 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b65629db-bcc9-4cd0-bd50-57763140db6d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:06.050738 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b65629db-bcc9-4cd0-bd50-57763140db6d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:06.050738 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b65629db-bcc9-4cd0-bd50-57763140db6d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:06.050738 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b65629db-bcc9-4cd0-bd50-57763140db6d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:06.739818 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b65629db-bcc9-4cd0-bd50-57763140db6d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:06.759333 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b65629db-bcc9-4cd0-bd50-57763140db6d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/41e6c46e-2175-4d24-94da-cb48da165631" status: 200 len: 1315 microversion: 2.1 time: 0.738522 Oct 04 18:54:06.759915 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2695/5434] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:06 2022] GET /compute/v2.1/servers/41e6c46e-2175-4d24-94da-cb48da165631 => generated 1315 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:54:07.790951 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-55a090fd-e2ef-4ea2-9360-da1c1f6b37ab tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:07.792658 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-55a090fd-e2ef-4ea2-9360-da1c1f6b37ab tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: 41e6c46e-2175-4d24-94da-cb48da165631] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:07.810271 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-55a090fd-e2ef-4ea2-9360-da1c1f6b37ab tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:07.811352 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-55a090fd-e2ef-4ea2-9360-da1c1f6b37ab tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:07.812984 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-55a090fd-e2ef-4ea2-9360-da1c1f6b37ab tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:07.812984 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-55a090fd-e2ef-4ea2-9360-da1c1f6b37ab tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:07.813768 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-55a090fd-e2ef-4ea2-9360-da1c1f6b37ab tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:07.814818 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-55a090fd-e2ef-4ea2-9360-da1c1f6b37ab tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:08.342561 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-55a090fd-e2ef-4ea2-9360-da1c1f6b37ab tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:08.374826 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-55a090fd-e2ef-4ea2-9360-da1c1f6b37ab tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/41e6c46e-2175-4d24-94da-cb48da165631" status: 200 len: 1501 microversion: 2.1 time: 0.590193 Oct 04 18:54:08.377446 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2740/5435] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:07 2022] GET /compute/v2.1/servers/41e6c46e-2175-4d24-94da-cb48da165631 => generated 1501 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:08.402666 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-325a5bc9-cd96-4af5-ad52-46b0dedc416d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:54:08.402666 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-325a5bc9-cd96-4af5-ad52-46b0dedc416d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: 41e6c46e-2175-4d24-94da-cb48da165631] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:08.406872 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-325a5bc9-cd96-4af5-ad52-46b0dedc416d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:08.407370 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-325a5bc9-cd96-4af5-ad52-46b0dedc416d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:08.407812 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-325a5bc9-cd96-4af5-ad52-46b0dedc416d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:08.408842 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-325a5bc9-cd96-4af5-ad52-46b0dedc416d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:08.409312 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-325a5bc9-cd96-4af5-ad52-46b0dedc416d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:08.409743 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-325a5bc9-cd96-4af5-ad52-46b0dedc416d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:08.438015 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=67 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:54:08.442831 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-325a5bc9-cd96-4af5-ad52-46b0dedc416d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lazy-loading 'flavor' on Instance uuid 41e6c46e-2175-4d24-94da-cb48da165631 {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:54:08.887804 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-325a5bc9-cd96-4af5-ad52-46b0dedc416d tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "POST /compute/v2.1/servers/41e6c46e-2175-4d24-94da-cb48da165631/action" status: 202 len: 0 microversion: 2.1 time: 0.493601 Oct 04 18:54:08.894179 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2696/5436] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:54:08 2022] POST /compute/v2.1/servers/41e6c46e-2175-4d24-94da-cb48da165631/action => generated 0 bytes in 502 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:54:08.898412 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-01014b28-c439-447b-a7a4-a7b795383224 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:08.899662 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-01014b28-c439-447b-a7a4-a7b795383224 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: 41e6c46e-2175-4d24-94da-cb48da165631] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:08.915860 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-01014b28-c439-447b-a7a4-a7b795383224 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:08.916619 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-01014b28-c439-447b-a7a4-a7b795383224 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:08.917256 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-01014b28-c439-447b-a7a4-a7b795383224 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:08.918159 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-01014b28-c439-447b-a7a4-a7b795383224 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:08.918781 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-01014b28-c439-447b-a7a4-a7b795383224 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:08.919368 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-01014b28-c439-447b-a7a4-a7b795383224 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:09.301022 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-01014b28-c439-447b-a7a4-a7b795383224 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:09.319847 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-01014b28-c439-447b-a7a4-a7b795383224 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/41e6c46e-2175-4d24-94da-cb48da165631" status: 200 len: 1509 microversion: 2.1 time: 0.427284 Oct 04 18:54:09.320539 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2741/5437] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:08 2022] GET /compute/v2.1/servers/41e6c46e-2175-4d24-94da-cb48da165631 => generated 1509 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:54:10.351749 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-07648fd3-05f2-4d35-a3ca-a3c6c557ed2f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:10.352511 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-07648fd3-05f2-4d35-a3ca-a3c6c557ed2f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: 41e6c46e-2175-4d24-94da-cb48da165631] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:10.372234 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-07648fd3-05f2-4d35-a3ca-a3c6c557ed2f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:10.372948 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-07648fd3-05f2-4d35-a3ca-a3c6c557ed2f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:10.373464 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-07648fd3-05f2-4d35-a3ca-a3c6c557ed2f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:10.374397 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-07648fd3-05f2-4d35-a3ca-a3c6c557ed2f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:10.374928 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-07648fd3-05f2-4d35-a3ca-a3c6c557ed2f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:10.375429 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-07648fd3-05f2-4d35-a3ca-a3c6c557ed2f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:10.545817 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-07648fd3-05f2-4d35-a3ca-a3c6c557ed2f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:10.555670 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-07648fd3-05f2-4d35-a3ca-a3c6c557ed2f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/41e6c46e-2175-4d24-94da-cb48da165631" status: 200 len: 1492 microversion: 2.1 time: 0.211144 Oct 04 18:54:10.557052 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2697/5438] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:10 2022] GET /compute/v2.1/servers/41e6c46e-2175-4d24-94da-cb48da165631 => generated 1492 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:10.581728 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1a6b4065-0f88-40e6-bb5e-8c1cce39a364 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:10.583063 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1a6b4065-0f88-40e6-bb5e-8c1cce39a364 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: 41e6c46e-2175-4d24-94da-cb48da165631] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:10.593681 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1a6b4065-0f88-40e6-bb5e-8c1cce39a364 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:10.594627 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1a6b4065-0f88-40e6-bb5e-8c1cce39a364 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:10.595249 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1a6b4065-0f88-40e6-bb5e-8c1cce39a364 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:10.596218 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1a6b4065-0f88-40e6-bb5e-8c1cce39a364 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:10.596869 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1a6b4065-0f88-40e6-bb5e-8c1cce39a364 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:10.597502 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1a6b4065-0f88-40e6-bb5e-8c1cce39a364 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:10.628928 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1a6b4065-0f88-40e6-bb5e-8c1cce39a364 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: 41e6c46e-2175-4d24-94da-cb48da165631] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:54:10.997785 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1a6b4065-0f88-40e6-bb5e-8c1cce39a364 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "DELETE /compute/v2.1/servers/41e6c46e-2175-4d24-94da-cb48da165631" status: 204 len: 0 microversion: 2.1 time: 0.418880 Oct 04 18:54:10.999730 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2742/5439] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:54:10 2022] DELETE /compute/v2.1/servers/41e6c46e-2175-4d24-94da-cb48da165631 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:54:11.009956 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4cce79db-c694-415f-bd24-382d51592377 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:11.010850 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4cce79db-c694-415f-bd24-382d51592377 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: 41e6c46e-2175-4d24-94da-cb48da165631] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:11.017407 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4cce79db-c694-415f-bd24-382d51592377 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:11.018111 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4cce79db-c694-415f-bd24-382d51592377 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:11.018555 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4cce79db-c694-415f-bd24-382d51592377 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:11.019383 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4cce79db-c694-415f-bd24-382d51592377 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:11.020602 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4cce79db-c694-415f-bd24-382d51592377 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:11.021159 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4cce79db-c694-415f-bd24-382d51592377 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:11.213088 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4cce79db-c694-415f-bd24-382d51592377 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:11.226934 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4cce79db-c694-415f-bd24-382d51592377 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/41e6c46e-2175-4d24-94da-cb48da165631" status: 200 len: 1498 microversion: 2.1 time: 0.222885 Oct 04 18:54:11.241581 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2698/5440] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:11 2022] GET /compute/v2.1/servers/41e6c46e-2175-4d24-94da-cb48da165631 => generated 1498 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:12.258446 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5db9d18e-c976-439c-aae2-a7b120643df4 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:12.259350 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5db9d18e-c976-439c-aae2-a7b120643df4 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: 41e6c46e-2175-4d24-94da-cb48da165631] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:12.267374 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5db9d18e-c976-439c-aae2-a7b120643df4 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:12.268261 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5db9d18e-c976-439c-aae2-a7b120643df4 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:12.268771 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5db9d18e-c976-439c-aae2-a7b120643df4 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:12.269691 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5db9d18e-c976-439c-aae2-a7b120643df4 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:12.270214 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5db9d18e-c976-439c-aae2-a7b120643df4 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:12.270710 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5db9d18e-c976-439c-aae2-a7b120643df4 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:12.496985 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5db9d18e-c976-439c-aae2-a7b120643df4 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:12.505515 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5db9d18e-c976-439c-aae2-a7b120643df4 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/41e6c46e-2175-4d24-94da-cb48da165631" status: 200 len: 1498 microversion: 2.1 time: 0.252586 Oct 04 18:54:12.519543 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2743/5441] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:12 2022] GET /compute/v2.1/servers/41e6c46e-2175-4d24-94da-cb48da165631 => generated 1498 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:13.482329 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-c888ed08-f72b-4aa4-b72b-acc41b013da5 req-642b23e1-d4a8-46d6-9530-a8533c685be4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41e6c46e-2175-4d24-94da-cb48da165631", "name": "network-vif-deleted", "tag": "fdd68b2f-c0f0-4708-aba9-f4085dfac44d"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:54:13.493783 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=8 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:54:13.509289 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-c888ed08-f72b-4aa4-b72b-acc41b013da5 req-642b23e1-d4a8-46d6-9530-a8533c685be4 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:13.509969 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-c888ed08-f72b-4aa4-b72b-acc41b013da5 req-642b23e1-d4a8-46d6-9530-a8533c685be4 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:13.510592 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-c888ed08-f72b-4aa4-b72b-acc41b013da5 req-642b23e1-d4a8-46d6-9530-a8533c685be4 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:13.541884 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f5a92c86-c7dc-4b6b-987e-6e13a614385c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:13.542588 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f5a92c86-c7dc-4b6b-987e-6e13a614385c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: 41e6c46e-2175-4d24-94da-cb48da165631] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:13.553874 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-c888ed08-f72b-4aa4-b72b-acc41b013da5 req-642b23e1-d4a8-46d6-9530-a8533c685be4 service nova] Creating event network-vif-deleted:fdd68b2f-c0f0-4708-aba9-f4085dfac44d for instance 41e6c46e-2175-4d24-94da-cb48da165631 on n-h1-850501-14 Oct 04 18:54:13.556915 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f5a92c86-c7dc-4b6b-987e-6e13a614385c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:13.557418 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f5a92c86-c7dc-4b6b-987e-6e13a614385c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:13.564155 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f5a92c86-c7dc-4b6b-987e-6e13a614385c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:13.564939 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f5a92c86-c7dc-4b6b-987e-6e13a614385c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:13.565419 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f5a92c86-c7dc-4b6b-987e-6e13a614385c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:13.565847 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f5a92c86-c7dc-4b6b-987e-6e13a614385c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:13.578459 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-c888ed08-f72b-4aa4-b72b-acc41b013da5 req-642b23e1-d4a8-46d6-9530-a8533c685be4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101286 Oct 04 18:54:13.579086 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2699/5442] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:54:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:54:13.745543 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f5a92c86-c7dc-4b6b-987e-6e13a614385c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56b67cede6b46f5a36a723d361b3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4154ec20e0354ee6a425ba853b8efe67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:13.760289 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f5a92c86-c7dc-4b6b-987e-6e13a614385c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/41e6c46e-2175-4d24-94da-cb48da165631" status: 200 len: 1456 microversion: 2.1 time: 0.221512 Oct 04 18:54:13.766009 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2744/5443] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:13 2022] GET /compute/v2.1/servers/41e6c46e-2175-4d24-94da-cb48da165631 => generated 1456 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:54:14.787539 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-bd1fa62a-4155-4565-8751-5cf078ca5aba tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:14.792916 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-bd1fa62a-4155-4565-8751-5cf078ca5aba tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: 41e6c46e-2175-4d24-94da-cb48da165631] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:14.814835 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bd1fa62a-4155-4565-8751-5cf078ca5aba tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:14.815582 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bd1fa62a-4155-4565-8751-5cf078ca5aba tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:14.816332 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bd1fa62a-4155-4565-8751-5cf078ca5aba tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:14.820081 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bd1fa62a-4155-4565-8751-5cf078ca5aba tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:14.821880 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bd1fa62a-4155-4565-8751-5cf078ca5aba tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:14.822554 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bd1fa62a-4155-4565-8751-5cf078ca5aba tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:14.846182 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-bd1fa62a-4155-4565-8751-5cf078ca5aba tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] HTTP exception thrown: Instance 41e6c46e-2175-4d24-94da-cb48da165631 could not be found. Oct 04 18:54:14.847997 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-bd1fa62a-4155-4565-8751-5cf078ca5aba tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Request method failure captured: Oct 04 18:54:14.847997 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/41e6c46e-2175-4d24-94da-cb48da165631 HTTP/1.1 Oct 04 18:54:14.847997 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:54:14.847997 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:54:14.847997 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:54:14.847997 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:54:14.847997 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:54:14.847997 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:54:14.847997 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:54:14.847997 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:54:14.847997 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPIAZ5RZP-L2AfGhXbSAirsikFtiKRJw8GbD2F4avTn6csTjPvYW4EgckMMa_odYrXTBqTIarrxxpsgj83P_nCf0n9cSTNLxyj6f4zISS1Nx3NxppTvrxz8bw1hclhfH5hpAMl_7yiEWC9J95Zeea4ou_80fw0GmE8GZRBOxEg7cn1lU Oct 04 18:54:14.847997 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:54:14.847997 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:54:14.847997 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:54:14.847997 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:54:14.847997 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:54:14.847997 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:54:14.847997 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 4154ec20e0354ee6a425ba853b8efe67 Oct 04 18:54:14.847997 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-DeleteServersTestJSON-806460860 Oct 04 18:54:14.847997 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:54:14.847997 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:54:14.847997 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4154ec20e0354ee6a425ba853b8efe67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4154ec20e0354ee6a425ba853b8efe67", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4154ec20e0354ee6a425ba853b8efe67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4154ec20e0354ee6a425ba853b8efe67"}]}] Oct 04 18:54:14.847997 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-DeleteServersTestJSON-806460860 Oct 04 18:54:14.847997 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 4154ec20e0354ee6a425ba853b8efe67 Oct 04 18:54:14.847997 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-DeleteServersTestJSON-806460860 Oct 04 18:54:14.847997 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-DeleteServersTestJSON-806460860-project Oct 04 18:54:14.847997 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:54:14.847997 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:54:14.847997 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: c56b67cede6b46f5a36a723d361b3245 Oct 04 18:54:14.847997 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-DeleteServersTestJSON-806460860-project Oct 04 18:54:14.847997 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:54:14.847997 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 41e6c46e-2175-4d24-94da-cb48da165631 could not be found. Oct 04 18:54:14.847997 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '41e6c46e-2175-4d24-94da-cb48da165631'} Oct 04 18:54:14.847997 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:54:14.847997 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:14.847997 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:54:14.847997 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:54:14.847997 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:54:14.847997 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:54:14.847997 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:54:14.847997 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:54:14.847997 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:54:14.847997 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:54:14.847997 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41e6c46e-2175-4d24-94da-cb48da165631 could not be found. Oct 04 18:54:14.847997 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:54:14.847997 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:14.847997 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:54:14.847997 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:14.847997 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:14.847997 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:14.847997 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:54:14.847997 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:54:14.847997 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:54:14.847997 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:54:14.847997 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:54:14.847997 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:54:14.847997 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:54:14.847997 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:54:14.847997 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:54:14.847997 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:54:14.847997 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41e6c46e-2175-4d24-94da-cb48da165631 could not be found. Oct 04 18:54:14.847997 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:54:14.847997 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:14.847997 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:54:14.853544 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:14.853544 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:14.853544 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:14.853544 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:54:14.853544 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:54:14.853544 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41e6c46e-2175-4d24-94da-cb48da165631 could not be found. Oct 04 18:54:14.853544 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:54:14.853544 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-bd1fa62a-4155-4565-8751-5cf078ca5aba tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Returning 404 to user: Instance 41e6c46e-2175-4d24-94da-cb48da165631 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:54:14.856623 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-bd1fa62a-4155-4565-8751-5cf078ca5aba tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/41e6c46e-2175-4d24-94da-cb48da165631" status: 404 len: 111 microversion: 2.1 time: 0.076080 Oct 04 18:54:14.857211 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2700/5444] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:14 2022] GET /compute/v2.1/servers/41e6c46e-2175-4d24-94da-cb48da165631 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:54:14.872765 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3eeadab0-716a-4743-b702-786208e8b935 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:14.874184 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3eeadab0-716a-4743-b702-786208e8b935 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: 41e6c46e-2175-4d24-94da-cb48da165631] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:14.877484 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:54:14.889639 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3eeadab0-716a-4743-b702-786208e8b935 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:14.890141 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3eeadab0-716a-4743-b702-786208e8b935 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:14.890582 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3eeadab0-716a-4743-b702-786208e8b935 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:14.891288 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3eeadab0-716a-4743-b702-786208e8b935 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:14.893083 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3eeadab0-716a-4743-b702-786208e8b935 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:14.893083 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3eeadab0-716a-4743-b702-786208e8b935 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:14.922096 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-3eeadab0-716a-4743-b702-786208e8b935 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] HTTP exception thrown: Instance 41e6c46e-2175-4d24-94da-cb48da165631 could not be found. Oct 04 18:54:14.923836 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3eeadab0-716a-4743-b702-786208e8b935 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Request method failure captured: Oct 04 18:54:14.923836 n-d-850501-14 devstack@n-api.service[123001]: request: DELETE /compute/v2.1/servers/41e6c46e-2175-4d24-94da-cb48da165631 HTTP/1.1 Oct 04 18:54:14.923836 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:54:14.923836 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:54:14.923836 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:54:14.923836 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:54:14.923836 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:54:14.923836 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:54:14.923836 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:54:14.923836 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:54:14.923836 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPIAZ5RZP-L2AfGhXbSAirsikFtiKRJw8GbD2F4avTn6csTjPvYW4EgckMMa_odYrXTBqTIarrxxpsgj83P_nCf0n9cSTNLxyj6f4zISS1Nx3NxppTvrxz8bw1hclhfH5hpAMl_7yiEWC9J95Zeea4ou_80fw0GmE8GZRBOxEg7cn1lU Oct 04 18:54:14.923836 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:54:14.923836 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:54:14.923836 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:54:14.923836 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:54:14.923836 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:54:14.923836 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:54:14.923836 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 4154ec20e0354ee6a425ba853b8efe67 Oct 04 18:54:14.923836 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-DeleteServersTestJSON-806460860 Oct 04 18:54:14.923836 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:54:14.923836 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:54:14.923836 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4154ec20e0354ee6a425ba853b8efe67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4154ec20e0354ee6a425ba853b8efe67", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4154ec20e0354ee6a425ba853b8efe67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4154ec20e0354ee6a425ba853b8efe67"}]}] Oct 04 18:54:14.923836 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-DeleteServersTestJSON-806460860 Oct 04 18:54:14.923836 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 4154ec20e0354ee6a425ba853b8efe67 Oct 04 18:54:14.923836 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-DeleteServersTestJSON-806460860 Oct 04 18:54:14.923836 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-DeleteServersTestJSON-806460860-project Oct 04 18:54:14.923836 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:54:14.923836 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:54:14.923836 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: c56b67cede6b46f5a36a723d361b3245 Oct 04 18:54:14.923836 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-DeleteServersTestJSON-806460860-project Oct 04 18:54:14.923836 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:54:14.923836 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 41e6c46e-2175-4d24-94da-cb48da165631 could not be found. Oct 04 18:54:14.923836 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '41e6c46e-2175-4d24-94da-cb48da165631'} Oct 04 18:54:14.923836 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:54:14.923836 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:14.923836 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:54:14.923836 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:54:14.923836 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:54:14.923836 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:54:14.923836 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:54:14.923836 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:54:14.923836 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:54:14.923836 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:54:14.923836 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41e6c46e-2175-4d24-94da-cb48da165631 could not be found. Oct 04 18:54:14.923836 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:54:14.923836 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:14.923836 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:54:14.923836 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:14.923836 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:14.923836 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:14.923836 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:54:14.923836 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:54:14.923836 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:54:14.923836 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:54:14.923836 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:54:14.923836 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:54:14.923836 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:54:14.923836 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:54:14.923836 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:54:14.923836 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:54:14.923836 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:54:14.923836 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:54:14.937636 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41e6c46e-2175-4d24-94da-cb48da165631 could not be found. Oct 04 18:54:14.937636 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:54:14.937636 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:14.937636 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:54:14.937636 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:14.937636 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:14.937636 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:14.937636 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:54:14.937636 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:54:14.937636 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41e6c46e-2175-4d24-94da-cb48da165631 could not be found. Oct 04 18:54:14.937636 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:54:14.937636 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3eeadab0-716a-4743-b702-786208e8b935 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Returning 404 to user: Instance 41e6c46e-2175-4d24-94da-cb48da165631 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:54:14.937636 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3eeadab0-716a-4743-b702-786208e8b935 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "DELETE /compute/v2.1/servers/41e6c46e-2175-4d24-94da-cb48da165631" status: 404 len: 111 microversion: 2.1 time: 0.061936 Oct 04 18:54:14.937636 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2745/5445] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:54:14 2022] DELETE /compute/v2.1/servers/41e6c46e-2175-4d24-94da-cb48da165631 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:54:14.942622 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-15d0071f-7ca9-4d57-963b-a211a9e5f1ed tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:14.947258 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-15d0071f-7ca9-4d57-963b-a211a9e5f1ed tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: 41e6c46e-2175-4d24-94da-cb48da165631] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:14.966074 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-15d0071f-7ca9-4d57-963b-a211a9e5f1ed tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:14.966074 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-15d0071f-7ca9-4d57-963b-a211a9e5f1ed tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:14.966074 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-15d0071f-7ca9-4d57-963b-a211a9e5f1ed tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:14.967068 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-15d0071f-7ca9-4d57-963b-a211a9e5f1ed tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:14.967611 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-15d0071f-7ca9-4d57-963b-a211a9e5f1ed tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:14.971460 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-15d0071f-7ca9-4d57-963b-a211a9e5f1ed tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:14.990108 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-15d0071f-7ca9-4d57-963b-a211a9e5f1ed tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] HTTP exception thrown: Instance 41e6c46e-2175-4d24-94da-cb48da165631 could not be found. Oct 04 18:54:14.992335 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-15d0071f-7ca9-4d57-963b-a211a9e5f1ed tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Request method failure captured: Oct 04 18:54:14.992335 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/41e6c46e-2175-4d24-94da-cb48da165631 HTTP/1.1 Oct 04 18:54:14.992335 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:54:14.992335 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:54:14.992335 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:54:14.992335 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:54:14.992335 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:54:14.992335 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:54:14.992335 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:54:14.992335 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:54:14.992335 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPIAZ5RZP-L2AfGhXbSAirsikFtiKRJw8GbD2F4avTn6csTjPvYW4EgckMMa_odYrXTBqTIarrxxpsgj83P_nCf0n9cSTNLxyj6f4zISS1Nx3NxppTvrxz8bw1hclhfH5hpAMl_7yiEWC9J95Zeea4ou_80fw0GmE8GZRBOxEg7cn1lU Oct 04 18:54:14.992335 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:54:14.992335 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:54:14.992335 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:54:14.992335 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:54:14.992335 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:54:14.992335 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:54:14.992335 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 4154ec20e0354ee6a425ba853b8efe67 Oct 04 18:54:14.992335 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-DeleteServersTestJSON-806460860 Oct 04 18:54:14.992335 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:54:14.992335 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:54:14.992335 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4154ec20e0354ee6a425ba853b8efe67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4154ec20e0354ee6a425ba853b8efe67", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4154ec20e0354ee6a425ba853b8efe67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4154ec20e0354ee6a425ba853b8efe67"}]}] Oct 04 18:54:14.992335 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-DeleteServersTestJSON-806460860 Oct 04 18:54:14.992335 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 4154ec20e0354ee6a425ba853b8efe67 Oct 04 18:54:14.992335 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-DeleteServersTestJSON-806460860 Oct 04 18:54:14.992335 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-DeleteServersTestJSON-806460860-project Oct 04 18:54:14.992335 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:54:14.992335 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:54:14.992335 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: c56b67cede6b46f5a36a723d361b3245 Oct 04 18:54:14.992335 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-DeleteServersTestJSON-806460860-project Oct 04 18:54:14.992335 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:54:14.992335 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 41e6c46e-2175-4d24-94da-cb48da165631 could not be found. Oct 04 18:54:14.992335 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '41e6c46e-2175-4d24-94da-cb48da165631'} Oct 04 18:54:14.992335 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:54:14.992335 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:14.992335 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:54:14.992335 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:54:14.992335 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:54:14.992335 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:54:14.992335 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:54:14.992335 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:54:14.992335 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:54:14.992335 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:54:14.992335 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41e6c46e-2175-4d24-94da-cb48da165631 could not be found. Oct 04 18:54:14.992335 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:54:14.992335 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:14.992335 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:54:14.992335 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:14.992335 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:14.992335 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:14.992335 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:54:14.992335 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:54:14.992335 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:54:14.992335 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:54:14.992335 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:54:14.992335 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:54:14.992335 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:54:14.992335 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:54:14.992335 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:54:14.992335 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:54:14.992335 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41e6c46e-2175-4d24-94da-cb48da165631 could not be found. Oct 04 18:54:14.992335 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:54:14.992335 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:14.992335 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:54:14.997093 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:14.997093 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:14.997093 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:14.997093 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:54:14.997093 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:54:14.997093 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41e6c46e-2175-4d24-94da-cb48da165631 could not be found. Oct 04 18:54:14.997093 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:54:15.004534 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-15d0071f-7ca9-4d57-963b-a211a9e5f1ed tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Returning 404 to user: Instance 41e6c46e-2175-4d24-94da-cb48da165631 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:54:15.006154 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-15d0071f-7ca9-4d57-963b-a211a9e5f1ed tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/41e6c46e-2175-4d24-94da-cb48da165631" status: 404 len: 111 microversion: 2.1 time: 0.071303 Oct 04 18:54:15.007350 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2701/5446] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:14 2022] GET /compute/v2.1/servers/41e6c46e-2175-4d24-94da-cb48da165631 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:54:15.021326 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a84353f2-c1f8-468e-8b62-4730a1de8708 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:15.022106 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a84353f2-c1f8-468e-8b62-4730a1de8708 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9afd6ad-3b96-4a57-8301-5da830e674c7] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:15.039803 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a84353f2-c1f8-468e-8b62-4730a1de8708 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:15.040598 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a84353f2-c1f8-468e-8b62-4730a1de8708 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:15.042152 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a84353f2-c1f8-468e-8b62-4730a1de8708 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:15.042152 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a84353f2-c1f8-468e-8b62-4730a1de8708 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:15.042942 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a84353f2-c1f8-468e-8b62-4730a1de8708 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:15.043548 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a84353f2-c1f8-468e-8b62-4730a1de8708 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:15.069504 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-a84353f2-c1f8-468e-8b62-4730a1de8708 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] HTTP exception thrown: Instance a9afd6ad-3b96-4a57-8301-5da830e674c7 could not be found. Oct 04 18:54:15.071310 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a84353f2-c1f8-468e-8b62-4730a1de8708 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Request method failure captured: Oct 04 18:54:15.071310 n-d-850501-14 devstack@n-api.service[123001]: request: DELETE /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7 HTTP/1.1 Oct 04 18:54:15.071310 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:54:15.071310 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:54:15.071310 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:54:15.071310 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:54:15.071310 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:54:15.071310 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:54:15.071310 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:54:15.071310 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:54:15.071310 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPIAZ5RZP-L2AfGhXbSAirsikFtiKRJw8GbD2F4avTn6csTjPvYW4EgckMMa_odYrXTBqTIarrxxpsgj83P_nCf0n9cSTNLxyj6f4zISS1Nx3NxppTvrxz8bw1hclhfH5hpAMl_7yiEWC9J95Zeea4ou_80fw0GmE8GZRBOxEg7cn1lU Oct 04 18:54:15.071310 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:54:15.071310 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:54:15.071310 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:54:15.071310 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:54:15.071310 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:54:15.071310 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:54:15.071310 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 4154ec20e0354ee6a425ba853b8efe67 Oct 04 18:54:15.071310 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-DeleteServersTestJSON-806460860 Oct 04 18:54:15.071310 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:54:15.071310 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:54:15.071310 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4154ec20e0354ee6a425ba853b8efe67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4154ec20e0354ee6a425ba853b8efe67", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4154ec20e0354ee6a425ba853b8efe67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4154ec20e0354ee6a425ba853b8efe67"}]}] Oct 04 18:54:15.071310 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-DeleteServersTestJSON-806460860 Oct 04 18:54:15.071310 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 4154ec20e0354ee6a425ba853b8efe67 Oct 04 18:54:15.071310 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-DeleteServersTestJSON-806460860 Oct 04 18:54:15.071310 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-DeleteServersTestJSON-806460860-project Oct 04 18:54:15.071310 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:54:15.071310 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:54:15.071310 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: c56b67cede6b46f5a36a723d361b3245 Oct 04 18:54:15.071310 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-DeleteServersTestJSON-806460860-project Oct 04 18:54:15.071310 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:54:15.071310 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance a9afd6ad-3b96-4a57-8301-5da830e674c7 could not be found. Oct 04 18:54:15.071310 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': 'a9afd6ad-3b96-4a57-8301-5da830e674c7'} Oct 04 18:54:15.071310 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:54:15.071310 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:15.071310 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:54:15.071310 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:54:15.071310 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:54:15.071310 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:54:15.071310 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:54:15.071310 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:54:15.071310 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:54:15.071310 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:54:15.071310 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9afd6ad-3b96-4a57-8301-5da830e674c7 could not be found. Oct 04 18:54:15.071310 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:54:15.071310 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:15.071310 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:54:15.071310 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:15.071310 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:15.071310 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:15.071310 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:54:15.071310 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:54:15.071310 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:54:15.071310 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:54:15.071310 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:54:15.071310 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:54:15.071310 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:54:15.071310 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:54:15.071310 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:54:15.071310 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:54:15.071310 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:54:15.071310 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:54:15.076587 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9afd6ad-3b96-4a57-8301-5da830e674c7 could not be found. Oct 04 18:54:15.076587 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:54:15.076587 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:15.076587 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:54:15.076587 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:15.076587 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:15.076587 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:15.076587 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:54:15.076587 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:54:15.076587 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9afd6ad-3b96-4a57-8301-5da830e674c7 could not be found. Oct 04 18:54:15.076587 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:54:15.088919 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a84353f2-c1f8-468e-8b62-4730a1de8708 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Returning 404 to user: Instance a9afd6ad-3b96-4a57-8301-5da830e674c7 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:54:15.090185 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a84353f2-c1f8-468e-8b62-4730a1de8708 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7" status: 404 len: 111 microversion: 2.1 time: 0.074965 Oct 04 18:54:15.091332 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2746/5447] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:54:15 2022] DELETE /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:54:15.106351 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d149ef04-fd3c-4eeb-99a4-e35ef2432c0c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:15.106975 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d149ef04-fd3c-4eeb-99a4-e35ef2432c0c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9afd6ad-3b96-4a57-8301-5da830e674c7] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:15.118907 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d149ef04-fd3c-4eeb-99a4-e35ef2432c0c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:15.119413 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d149ef04-fd3c-4eeb-99a4-e35ef2432c0c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:15.119873 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d149ef04-fd3c-4eeb-99a4-e35ef2432c0c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:15.120630 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d149ef04-fd3c-4eeb-99a4-e35ef2432c0c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:15.121096 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d149ef04-fd3c-4eeb-99a4-e35ef2432c0c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:15.121530 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d149ef04-fd3c-4eeb-99a4-e35ef2432c0c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:15.148792 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-d149ef04-fd3c-4eeb-99a4-e35ef2432c0c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] HTTP exception thrown: Instance a9afd6ad-3b96-4a57-8301-5da830e674c7 could not be found. Oct 04 18:54:15.150365 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d149ef04-fd3c-4eeb-99a4-e35ef2432c0c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Request method failure captured: Oct 04 18:54:15.150365 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7 HTTP/1.1 Oct 04 18:54:15.150365 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:54:15.150365 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:54:15.150365 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:54:15.150365 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:54:15.150365 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:54:15.150365 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:54:15.150365 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:54:15.150365 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:54:15.150365 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPIAZ5RZP-L2AfGhXbSAirsikFtiKRJw8GbD2F4avTn6csTjPvYW4EgckMMa_odYrXTBqTIarrxxpsgj83P_nCf0n9cSTNLxyj6f4zISS1Nx3NxppTvrxz8bw1hclhfH5hpAMl_7yiEWC9J95Zeea4ou_80fw0GmE8GZRBOxEg7cn1lU Oct 04 18:54:15.150365 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:54:15.150365 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:54:15.150365 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:54:15.150365 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:54:15.150365 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:54:15.150365 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:54:15.150365 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 4154ec20e0354ee6a425ba853b8efe67 Oct 04 18:54:15.150365 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-DeleteServersTestJSON-806460860 Oct 04 18:54:15.150365 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:54:15.150365 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:54:15.150365 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4154ec20e0354ee6a425ba853b8efe67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4154ec20e0354ee6a425ba853b8efe67", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4154ec20e0354ee6a425ba853b8efe67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4154ec20e0354ee6a425ba853b8efe67"}]}] Oct 04 18:54:15.150365 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-DeleteServersTestJSON-806460860 Oct 04 18:54:15.150365 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 4154ec20e0354ee6a425ba853b8efe67 Oct 04 18:54:15.150365 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-DeleteServersTestJSON-806460860 Oct 04 18:54:15.150365 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-DeleteServersTestJSON-806460860-project Oct 04 18:54:15.150365 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:54:15.150365 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:54:15.150365 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: c56b67cede6b46f5a36a723d361b3245 Oct 04 18:54:15.150365 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-DeleteServersTestJSON-806460860-project Oct 04 18:54:15.150365 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:54:15.150365 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance a9afd6ad-3b96-4a57-8301-5da830e674c7 could not be found. Oct 04 18:54:15.150365 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'a9afd6ad-3b96-4a57-8301-5da830e674c7'} Oct 04 18:54:15.150365 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:54:15.150365 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:15.150365 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:54:15.150365 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:54:15.150365 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:54:15.150365 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:54:15.150365 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:54:15.150365 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:54:15.150365 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:54:15.150365 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:54:15.150365 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9afd6ad-3b96-4a57-8301-5da830e674c7 could not be found. Oct 04 18:54:15.150365 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:54:15.150365 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:15.150365 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:54:15.150365 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:15.150365 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:15.150365 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:15.150365 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:54:15.150365 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:54:15.150365 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:54:15.150365 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:54:15.150365 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:54:15.150365 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:54:15.150365 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:54:15.150365 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:54:15.150365 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:54:15.150365 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:54:15.150365 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9afd6ad-3b96-4a57-8301-5da830e674c7 could not be found. Oct 04 18:54:15.150365 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:54:15.150365 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:15.150365 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:54:15.155706 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:15.155706 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:15.155706 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:15.155706 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:54:15.155706 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:54:15.155706 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9afd6ad-3b96-4a57-8301-5da830e674c7 could not be found. Oct 04 18:54:15.155706 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:54:15.155706 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d149ef04-fd3c-4eeb-99a4-e35ef2432c0c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Returning 404 to user: Instance a9afd6ad-3b96-4a57-8301-5da830e674c7 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:54:15.155706 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d149ef04-fd3c-4eeb-99a4-e35ef2432c0c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7" status: 404 len: 111 microversion: 2.1 time: 0.049346 Oct 04 18:54:15.161727 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2702/5448] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:15 2022] GET /compute/v2.1/servers/a9afd6ad-3b96-4a57-8301-5da830e674c7 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:54:15.170150 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4b77548d-531b-4ba9-87d2-d151d5cc31af tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:15.170664 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-4b77548d-531b-4ba9-87d2-d151d5cc31af tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9eaa25a-0821-47fb-a16e-d07bcde9cc60] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:15.180274 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4b77548d-531b-4ba9-87d2-d151d5cc31af tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:15.180274 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4b77548d-531b-4ba9-87d2-d151d5cc31af tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:15.180274 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4b77548d-531b-4ba9-87d2-d151d5cc31af tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:15.180274 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4b77548d-531b-4ba9-87d2-d151d5cc31af tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:15.180274 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4b77548d-531b-4ba9-87d2-d151d5cc31af tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:15.180274 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4b77548d-531b-4ba9-87d2-d151d5cc31af tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:15.197038 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-4b77548d-531b-4ba9-87d2-d151d5cc31af tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] HTTP exception thrown: Instance a9eaa25a-0821-47fb-a16e-d07bcde9cc60 could not be found. Oct 04 18:54:15.198890 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4b77548d-531b-4ba9-87d2-d151d5cc31af tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Request method failure captured: Oct 04 18:54:15.198890 n-d-850501-14 devstack@n-api.service[123001]: request: DELETE /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60 HTTP/1.1 Oct 04 18:54:15.198890 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:54:15.198890 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:54:15.198890 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:54:15.198890 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:54:15.198890 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:54:15.198890 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:54:15.198890 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:54:15.198890 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:54:15.198890 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPIAZ5RZP-L2AfGhXbSAirsikFtiKRJw8GbD2F4avTn6csTjPvYW4EgckMMa_odYrXTBqTIarrxxpsgj83P_nCf0n9cSTNLxyj6f4zISS1Nx3NxppTvrxz8bw1hclhfH5hpAMl_7yiEWC9J95Zeea4ou_80fw0GmE8GZRBOxEg7cn1lU Oct 04 18:54:15.198890 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:54:15.198890 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:54:15.198890 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:54:15.198890 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:54:15.198890 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:54:15.198890 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:54:15.198890 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 4154ec20e0354ee6a425ba853b8efe67 Oct 04 18:54:15.198890 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-DeleteServersTestJSON-806460860 Oct 04 18:54:15.198890 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:54:15.198890 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:54:15.198890 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4154ec20e0354ee6a425ba853b8efe67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4154ec20e0354ee6a425ba853b8efe67", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4154ec20e0354ee6a425ba853b8efe67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4154ec20e0354ee6a425ba853b8efe67"}]}] Oct 04 18:54:15.198890 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-DeleteServersTestJSON-806460860 Oct 04 18:54:15.198890 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 4154ec20e0354ee6a425ba853b8efe67 Oct 04 18:54:15.198890 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-DeleteServersTestJSON-806460860 Oct 04 18:54:15.198890 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-DeleteServersTestJSON-806460860-project Oct 04 18:54:15.198890 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:54:15.198890 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:54:15.198890 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: c56b67cede6b46f5a36a723d361b3245 Oct 04 18:54:15.198890 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-DeleteServersTestJSON-806460860-project Oct 04 18:54:15.198890 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:54:15.198890 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance a9eaa25a-0821-47fb-a16e-d07bcde9cc60 could not be found. Oct 04 18:54:15.198890 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': 'a9eaa25a-0821-47fb-a16e-d07bcde9cc60'} Oct 04 18:54:15.198890 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:54:15.198890 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:15.198890 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:54:15.198890 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:54:15.198890 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:54:15.198890 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:54:15.198890 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:54:15.198890 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:54:15.198890 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:54:15.198890 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:54:15.198890 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9eaa25a-0821-47fb-a16e-d07bcde9cc60 could not be found. Oct 04 18:54:15.198890 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:54:15.198890 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:15.198890 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:54:15.198890 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:15.198890 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:15.198890 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:15.198890 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:54:15.198890 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:54:15.198890 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:54:15.198890 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:54:15.198890 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:54:15.198890 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:54:15.198890 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:54:15.198890 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:54:15.198890 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:54:15.198890 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:54:15.198890 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:54:15.198890 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:54:15.209502 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9eaa25a-0821-47fb-a16e-d07bcde9cc60 could not be found. Oct 04 18:54:15.209502 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:54:15.209502 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:15.209502 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:54:15.209502 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:15.209502 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:15.209502 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:15.209502 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:54:15.209502 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:54:15.209502 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9eaa25a-0821-47fb-a16e-d07bcde9cc60 could not be found. Oct 04 18:54:15.209502 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:54:15.209502 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4b77548d-531b-4ba9-87d2-d151d5cc31af tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Returning 404 to user: Instance a9eaa25a-0821-47fb-a16e-d07bcde9cc60 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:54:15.209502 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-4b77548d-531b-4ba9-87d2-d151d5cc31af tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60" status: 404 len: 111 microversion: 2.1 time: 0.036951 Oct 04 18:54:15.209502 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2747/5449] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:54:15 2022] DELETE /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:54:15.213112 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8f722f6e-f1ec-4a88-a051-f17c036b1f0c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:15.213734 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8f722f6e-f1ec-4a88-a051-f17c036b1f0c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: a9eaa25a-0821-47fb-a16e-d07bcde9cc60] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:15.219744 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8f722f6e-f1ec-4a88-a051-f17c036b1f0c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:15.220287 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8f722f6e-f1ec-4a88-a051-f17c036b1f0c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:15.220784 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8f722f6e-f1ec-4a88-a051-f17c036b1f0c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:15.221499 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8f722f6e-f1ec-4a88-a051-f17c036b1f0c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:15.221959 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8f722f6e-f1ec-4a88-a051-f17c036b1f0c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:15.223225 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8f722f6e-f1ec-4a88-a051-f17c036b1f0c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:15.239572 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-8f722f6e-f1ec-4a88-a051-f17c036b1f0c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] HTTP exception thrown: Instance a9eaa25a-0821-47fb-a16e-d07bcde9cc60 could not be found. Oct 04 18:54:15.241279 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8f722f6e-f1ec-4a88-a051-f17c036b1f0c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Request method failure captured: Oct 04 18:54:15.241279 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60 HTTP/1.1 Oct 04 18:54:15.241279 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:54:15.241279 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:54:15.241279 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:54:15.241279 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:54:15.241279 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:54:15.241279 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:54:15.241279 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:54:15.241279 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:54:15.241279 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPIAZ5RZP-L2AfGhXbSAirsikFtiKRJw8GbD2F4avTn6csTjPvYW4EgckMMa_odYrXTBqTIarrxxpsgj83P_nCf0n9cSTNLxyj6f4zISS1Nx3NxppTvrxz8bw1hclhfH5hpAMl_7yiEWC9J95Zeea4ou_80fw0GmE8GZRBOxEg7cn1lU Oct 04 18:54:15.241279 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:54:15.241279 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:54:15.241279 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:54:15.241279 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:54:15.241279 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:54:15.241279 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:54:15.241279 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 4154ec20e0354ee6a425ba853b8efe67 Oct 04 18:54:15.241279 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-DeleteServersTestJSON-806460860 Oct 04 18:54:15.241279 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:54:15.241279 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:54:15.241279 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4154ec20e0354ee6a425ba853b8efe67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4154ec20e0354ee6a425ba853b8efe67", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4154ec20e0354ee6a425ba853b8efe67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4154ec20e0354ee6a425ba853b8efe67"}]}] Oct 04 18:54:15.241279 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-DeleteServersTestJSON-806460860 Oct 04 18:54:15.241279 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 4154ec20e0354ee6a425ba853b8efe67 Oct 04 18:54:15.241279 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-DeleteServersTestJSON-806460860 Oct 04 18:54:15.241279 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-DeleteServersTestJSON-806460860-project Oct 04 18:54:15.241279 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:54:15.241279 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:54:15.241279 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: c56b67cede6b46f5a36a723d361b3245 Oct 04 18:54:15.241279 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-DeleteServersTestJSON-806460860-project Oct 04 18:54:15.241279 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:54:15.241279 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance a9eaa25a-0821-47fb-a16e-d07bcde9cc60 could not be found. Oct 04 18:54:15.241279 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'a9eaa25a-0821-47fb-a16e-d07bcde9cc60'} Oct 04 18:54:15.241279 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:54:15.241279 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:15.241279 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:54:15.241279 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:54:15.241279 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:54:15.241279 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:54:15.241279 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:54:15.241279 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:54:15.241279 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:54:15.241279 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:54:15.241279 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9eaa25a-0821-47fb-a16e-d07bcde9cc60 could not be found. Oct 04 18:54:15.241279 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:54:15.241279 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:15.241279 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:54:15.241279 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:15.241279 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:15.241279 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:15.241279 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:54:15.241279 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:54:15.241279 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:54:15.241279 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:54:15.241279 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:54:15.241279 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:54:15.241279 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:54:15.241279 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:54:15.241279 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:54:15.241279 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:54:15.241279 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9eaa25a-0821-47fb-a16e-d07bcde9cc60 could not be found. Oct 04 18:54:15.241279 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:54:15.241279 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:15.241279 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:54:15.248750 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:15.248750 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:15.248750 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:15.248750 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:54:15.248750 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:54:15.248750 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9eaa25a-0821-47fb-a16e-d07bcde9cc60 could not be found. Oct 04 18:54:15.248750 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:54:15.252211 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8f722f6e-f1ec-4a88-a051-f17c036b1f0c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Returning 404 to user: Instance a9eaa25a-0821-47fb-a16e-d07bcde9cc60 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:54:15.252500 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8f722f6e-f1ec-4a88-a051-f17c036b1f0c tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60" status: 404 len: 111 microversion: 2.1 time: 0.043061 Oct 04 18:54:15.253294 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2703/5450] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:15 2022] GET /compute/v2.1/servers/a9eaa25a-0821-47fb-a16e-d07bcde9cc60 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:54:15.262287 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1ce19ba1-a4d8-4f92-9d30-b853bcfa8eb9 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:15.262805 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1ce19ba1-a4d8-4f92-9d30-b853bcfa8eb9 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: c6d7d726-8e3f-44de-8d6f-2d8c6187e8df] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:15.269824 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1ce19ba1-a4d8-4f92-9d30-b853bcfa8eb9 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:15.272117 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1ce19ba1-a4d8-4f92-9d30-b853bcfa8eb9 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:15.272117 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1ce19ba1-a4d8-4f92-9d30-b853bcfa8eb9 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:15.272117 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1ce19ba1-a4d8-4f92-9d30-b853bcfa8eb9 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:15.272117 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1ce19ba1-a4d8-4f92-9d30-b853bcfa8eb9 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:15.272591 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1ce19ba1-a4d8-4f92-9d30-b853bcfa8eb9 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:15.302459 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-1ce19ba1-a4d8-4f92-9d30-b853bcfa8eb9 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] HTTP exception thrown: Instance c6d7d726-8e3f-44de-8d6f-2d8c6187e8df could not be found. Oct 04 18:54:15.304293 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1ce19ba1-a4d8-4f92-9d30-b853bcfa8eb9 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Request method failure captured: Oct 04 18:54:15.304293 n-d-850501-14 devstack@n-api.service[123001]: request: DELETE /compute/v2.1/servers/c6d7d726-8e3f-44de-8d6f-2d8c6187e8df HTTP/1.1 Oct 04 18:54:15.304293 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:54:15.304293 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:54:15.304293 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:54:15.304293 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:54:15.304293 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:54:15.304293 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:54:15.304293 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:54:15.304293 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:54:15.304293 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPIAZ5RZP-L2AfGhXbSAirsikFtiKRJw8GbD2F4avTn6csTjPvYW4EgckMMa_odYrXTBqTIarrxxpsgj83P_nCf0n9cSTNLxyj6f4zISS1Nx3NxppTvrxz8bw1hclhfH5hpAMl_7yiEWC9J95Zeea4ou_80fw0GmE8GZRBOxEg7cn1lU Oct 04 18:54:15.304293 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:54:15.304293 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:54:15.304293 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:54:15.304293 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:54:15.304293 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:54:15.304293 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:54:15.304293 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 4154ec20e0354ee6a425ba853b8efe67 Oct 04 18:54:15.304293 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-DeleteServersTestJSON-806460860 Oct 04 18:54:15.304293 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:54:15.304293 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:54:15.304293 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4154ec20e0354ee6a425ba853b8efe67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4154ec20e0354ee6a425ba853b8efe67", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4154ec20e0354ee6a425ba853b8efe67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4154ec20e0354ee6a425ba853b8efe67"}]}] Oct 04 18:54:15.304293 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-DeleteServersTestJSON-806460860 Oct 04 18:54:15.304293 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 4154ec20e0354ee6a425ba853b8efe67 Oct 04 18:54:15.304293 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-DeleteServersTestJSON-806460860 Oct 04 18:54:15.304293 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-DeleteServersTestJSON-806460860-project Oct 04 18:54:15.304293 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:54:15.304293 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:54:15.304293 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: c56b67cede6b46f5a36a723d361b3245 Oct 04 18:54:15.304293 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-DeleteServersTestJSON-806460860-project Oct 04 18:54:15.304293 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:54:15.304293 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance c6d7d726-8e3f-44de-8d6f-2d8c6187e8df could not be found. Oct 04 18:54:15.304293 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': 'c6d7d726-8e3f-44de-8d6f-2d8c6187e8df'} Oct 04 18:54:15.304293 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:54:15.304293 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:15.304293 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:54:15.304293 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:54:15.304293 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:54:15.304293 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:54:15.304293 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:54:15.304293 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:54:15.304293 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:54:15.304293 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:54:15.304293 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6d7d726-8e3f-44de-8d6f-2d8c6187e8df could not be found. Oct 04 18:54:15.304293 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:54:15.304293 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:15.304293 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:54:15.304293 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:15.304293 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:15.304293 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:15.304293 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:54:15.304293 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:54:15.304293 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:54:15.304293 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:54:15.304293 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:54:15.304293 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:54:15.304293 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:54:15.304293 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:54:15.304293 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:54:15.304293 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:54:15.304293 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:54:15.304293 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:54:15.309719 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6d7d726-8e3f-44de-8d6f-2d8c6187e8df could not be found. Oct 04 18:54:15.309719 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:54:15.309719 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:15.309719 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:54:15.309719 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:15.309719 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:15.309719 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:15.309719 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:54:15.309719 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:54:15.309719 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6d7d726-8e3f-44de-8d6f-2d8c6187e8df could not be found. Oct 04 18:54:15.309719 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:54:15.309719 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1ce19ba1-a4d8-4f92-9d30-b853bcfa8eb9 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Returning 404 to user: Instance c6d7d726-8e3f-44de-8d6f-2d8c6187e8df could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:54:15.310915 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1ce19ba1-a4d8-4f92-9d30-b853bcfa8eb9 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c6d7d726-8e3f-44de-8d6f-2d8c6187e8df" status: 404 len: 111 microversion: 2.1 time: 0.052943 Oct 04 18:54:15.311740 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2748/5451] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:54:15 2022] DELETE /compute/v2.1/servers/c6d7d726-8e3f-44de-8d6f-2d8c6187e8df => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:54:15.321090 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b6796913-81ae-4b06-85b2-2bb5c5b59157 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:15.321728 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b6796913-81ae-4b06-85b2-2bb5c5b59157 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: c6d7d726-8e3f-44de-8d6f-2d8c6187e8df] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:15.336915 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b6796913-81ae-4b06-85b2-2bb5c5b59157 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:15.337387 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b6796913-81ae-4b06-85b2-2bb5c5b59157 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:15.337934 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b6796913-81ae-4b06-85b2-2bb5c5b59157 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:15.340725 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b6796913-81ae-4b06-85b2-2bb5c5b59157 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:15.341203 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b6796913-81ae-4b06-85b2-2bb5c5b59157 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:15.341646 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b6796913-81ae-4b06-85b2-2bb5c5b59157 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:15.357896 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-b6796913-81ae-4b06-85b2-2bb5c5b59157 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] HTTP exception thrown: Instance c6d7d726-8e3f-44de-8d6f-2d8c6187e8df could not be found. Oct 04 18:54:15.359942 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b6796913-81ae-4b06-85b2-2bb5c5b59157 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Request method failure captured: Oct 04 18:54:15.359942 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/c6d7d726-8e3f-44de-8d6f-2d8c6187e8df HTTP/1.1 Oct 04 18:54:15.359942 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:54:15.359942 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:54:15.359942 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:54:15.359942 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:54:15.359942 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:54:15.359942 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:54:15.359942 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:54:15.359942 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:54:15.359942 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPIAZ5RZP-L2AfGhXbSAirsikFtiKRJw8GbD2F4avTn6csTjPvYW4EgckMMa_odYrXTBqTIarrxxpsgj83P_nCf0n9cSTNLxyj6f4zISS1Nx3NxppTvrxz8bw1hclhfH5hpAMl_7yiEWC9J95Zeea4ou_80fw0GmE8GZRBOxEg7cn1lU Oct 04 18:54:15.359942 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:54:15.359942 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:54:15.359942 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:54:15.359942 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:54:15.359942 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:54:15.359942 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:54:15.359942 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 4154ec20e0354ee6a425ba853b8efe67 Oct 04 18:54:15.359942 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-DeleteServersTestJSON-806460860 Oct 04 18:54:15.359942 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:54:15.359942 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:54:15.359942 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4154ec20e0354ee6a425ba853b8efe67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4154ec20e0354ee6a425ba853b8efe67", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4154ec20e0354ee6a425ba853b8efe67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4154ec20e0354ee6a425ba853b8efe67"}]}] Oct 04 18:54:15.359942 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-DeleteServersTestJSON-806460860 Oct 04 18:54:15.359942 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 4154ec20e0354ee6a425ba853b8efe67 Oct 04 18:54:15.359942 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-DeleteServersTestJSON-806460860 Oct 04 18:54:15.359942 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-DeleteServersTestJSON-806460860-project Oct 04 18:54:15.359942 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:54:15.359942 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:54:15.359942 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: c56b67cede6b46f5a36a723d361b3245 Oct 04 18:54:15.359942 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-DeleteServersTestJSON-806460860-project Oct 04 18:54:15.359942 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:54:15.359942 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance c6d7d726-8e3f-44de-8d6f-2d8c6187e8df could not be found. Oct 04 18:54:15.359942 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'c6d7d726-8e3f-44de-8d6f-2d8c6187e8df'} Oct 04 18:54:15.359942 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:54:15.359942 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:15.359942 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:54:15.359942 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:54:15.359942 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:54:15.359942 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:54:15.359942 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:54:15.359942 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:54:15.359942 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:54:15.359942 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:54:15.359942 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6d7d726-8e3f-44de-8d6f-2d8c6187e8df could not be found. Oct 04 18:54:15.359942 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:54:15.359942 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:15.359942 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:54:15.359942 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:15.359942 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:15.359942 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:15.359942 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:54:15.359942 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:54:15.359942 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:54:15.359942 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:54:15.359942 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:54:15.359942 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:54:15.359942 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:54:15.359942 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:54:15.359942 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:54:15.359942 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:54:15.359942 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6d7d726-8e3f-44de-8d6f-2d8c6187e8df could not be found. Oct 04 18:54:15.359942 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:54:15.359942 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:15.359942 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:54:15.367323 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:15.367323 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:15.367323 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:15.367323 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:54:15.367323 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:54:15.367323 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6d7d726-8e3f-44de-8d6f-2d8c6187e8df could not be found. Oct 04 18:54:15.367323 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:54:15.367323 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b6796913-81ae-4b06-85b2-2bb5c5b59157 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Returning 404 to user: Instance c6d7d726-8e3f-44de-8d6f-2d8c6187e8df could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:54:15.367323 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b6796913-81ae-4b06-85b2-2bb5c5b59157 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/c6d7d726-8e3f-44de-8d6f-2d8c6187e8df" status: 404 len: 111 microversion: 2.1 time: 0.044703 Oct 04 18:54:15.367323 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2704/5452] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:15 2022] GET /compute/v2.1/servers/c6d7d726-8e3f-44de-8d6f-2d8c6187e8df => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:54:15.373080 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7d782a03-7d03-43a0-b419-0d9bebaf3a62 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:15.373595 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7d782a03-7d03-43a0-b419-0d9bebaf3a62 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: b652bf6c-d91a-4569-88ab-4874851ae618] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:15.383028 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-7d782a03-7d03-43a0-b419-0d9bebaf3a62 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] HTTP exception thrown: Instance b652bf6c-d91a-4569-88ab-4874851ae618 could not be found. Oct 04 18:54:15.384737 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7d782a03-7d03-43a0-b419-0d9bebaf3a62 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Request method failure captured: Oct 04 18:54:15.384737 n-d-850501-14 devstack@n-api.service[123001]: request: DELETE /compute/v2.1/servers/b652bf6c-d91a-4569-88ab-4874851ae618 HTTP/1.1 Oct 04 18:54:15.384737 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:54:15.384737 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:54:15.384737 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:54:15.384737 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:54:15.384737 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:54:15.384737 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:54:15.384737 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:54:15.384737 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:54:15.384737 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPIAZ5RZP-L2AfGhXbSAirsikFtiKRJw8GbD2F4avTn6csTjPvYW4EgckMMa_odYrXTBqTIarrxxpsgj83P_nCf0n9cSTNLxyj6f4zISS1Nx3NxppTvrxz8bw1hclhfH5hpAMl_7yiEWC9J95Zeea4ou_80fw0GmE8GZRBOxEg7cn1lU Oct 04 18:54:15.384737 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:54:15.384737 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:54:15.384737 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:54:15.384737 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:54:15.384737 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:54:15.384737 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:54:15.384737 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 4154ec20e0354ee6a425ba853b8efe67 Oct 04 18:54:15.384737 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-DeleteServersTestJSON-806460860 Oct 04 18:54:15.384737 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:54:15.384737 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:54:15.384737 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4154ec20e0354ee6a425ba853b8efe67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4154ec20e0354ee6a425ba853b8efe67", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4154ec20e0354ee6a425ba853b8efe67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4154ec20e0354ee6a425ba853b8efe67"}]}] Oct 04 18:54:15.384737 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-DeleteServersTestJSON-806460860 Oct 04 18:54:15.384737 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 4154ec20e0354ee6a425ba853b8efe67 Oct 04 18:54:15.384737 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-DeleteServersTestJSON-806460860 Oct 04 18:54:15.384737 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-DeleteServersTestJSON-806460860-project Oct 04 18:54:15.384737 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:54:15.384737 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:54:15.384737 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: c56b67cede6b46f5a36a723d361b3245 Oct 04 18:54:15.384737 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-DeleteServersTestJSON-806460860-project Oct 04 18:54:15.384737 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:54:15.384737 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance b652bf6c-d91a-4569-88ab-4874851ae618 could not be found. Oct 04 18:54:15.384737 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': 'b652bf6c-d91a-4569-88ab-4874851ae618'} Oct 04 18:54:15.384737 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:54:15.384737 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:15.384737 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:54:15.384737 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:54:15.384737 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:54:15.384737 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:54:15.384737 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:54:15.384737 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:54:15.384737 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b652bf6c-d91a-4569-88ab-4874851ae618 could not be found. Oct 04 18:54:15.384737 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:54:15.384737 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:15.384737 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:54:15.384737 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:15.384737 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:15.384737 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:15.384737 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:54:15.384737 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:54:15.384737 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:54:15.384737 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:54:15.384737 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:54:15.384737 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:54:15.384737 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:54:15.384737 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:54:15.384737 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:54:15.384737 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:54:15.384737 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:54:15.384737 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:54:15.384737 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b652bf6c-d91a-4569-88ab-4874851ae618 could not be found. Oct 04 18:54:15.384737 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:54:15.384737 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:15.384737 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:54:15.394165 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:15.394165 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:15.394165 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:15.394165 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:54:15.394165 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:54:15.394165 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b652bf6c-d91a-4569-88ab-4874851ae618 could not be found. Oct 04 18:54:15.394165 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:54:15.394165 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7d782a03-7d03-43a0-b419-0d9bebaf3a62 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Returning 404 to user: Instance b652bf6c-d91a-4569-88ab-4874851ae618 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:54:15.394165 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7d782a03-7d03-43a0-b419-0d9bebaf3a62 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b652bf6c-d91a-4569-88ab-4874851ae618" status: 404 len: 111 microversion: 2.1 time: 0.022906 Oct 04 18:54:15.394165 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2749/5453] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:54:15 2022] DELETE /compute/v2.1/servers/b652bf6c-d91a-4569-88ab-4874851ae618 => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:54:15.403060 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1fa44efe-3e72-414e-a836-103468e47dbf tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:15.403826 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1fa44efe-3e72-414e-a836-103468e47dbf tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: b652bf6c-d91a-4569-88ab-4874851ae618] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:15.420428 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-1fa44efe-3e72-414e-a836-103468e47dbf tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] HTTP exception thrown: Instance b652bf6c-d91a-4569-88ab-4874851ae618 could not be found. Oct 04 18:54:15.422937 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1fa44efe-3e72-414e-a836-103468e47dbf tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Request method failure captured: Oct 04 18:54:15.422937 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/b652bf6c-d91a-4569-88ab-4874851ae618 HTTP/1.1 Oct 04 18:54:15.422937 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:54:15.422937 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:54:15.422937 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:54:15.422937 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:54:15.422937 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:54:15.422937 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:54:15.422937 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:54:15.422937 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:54:15.422937 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPIAZ5RZP-L2AfGhXbSAirsikFtiKRJw8GbD2F4avTn6csTjPvYW4EgckMMa_odYrXTBqTIarrxxpsgj83P_nCf0n9cSTNLxyj6f4zISS1Nx3NxppTvrxz8bw1hclhfH5hpAMl_7yiEWC9J95Zeea4ou_80fw0GmE8GZRBOxEg7cn1lU Oct 04 18:54:15.422937 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:54:15.422937 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:54:15.422937 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:54:15.422937 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:54:15.422937 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:54:15.422937 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:54:15.422937 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 4154ec20e0354ee6a425ba853b8efe67 Oct 04 18:54:15.422937 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-DeleteServersTestJSON-806460860 Oct 04 18:54:15.422937 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:54:15.422937 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:54:15.422937 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4154ec20e0354ee6a425ba853b8efe67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4154ec20e0354ee6a425ba853b8efe67", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4154ec20e0354ee6a425ba853b8efe67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4154ec20e0354ee6a425ba853b8efe67"}]}] Oct 04 18:54:15.422937 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-DeleteServersTestJSON-806460860 Oct 04 18:54:15.422937 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 4154ec20e0354ee6a425ba853b8efe67 Oct 04 18:54:15.422937 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-DeleteServersTestJSON-806460860 Oct 04 18:54:15.422937 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-DeleteServersTestJSON-806460860-project Oct 04 18:54:15.422937 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:54:15.422937 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:54:15.422937 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: c56b67cede6b46f5a36a723d361b3245 Oct 04 18:54:15.422937 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-DeleteServersTestJSON-806460860-project Oct 04 18:54:15.422937 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:54:15.422937 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance b652bf6c-d91a-4569-88ab-4874851ae618 could not be found. Oct 04 18:54:15.422937 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'b652bf6c-d91a-4569-88ab-4874851ae618'} Oct 04 18:54:15.422937 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:54:15.422937 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:15.422937 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:54:15.422937 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:54:15.422937 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:54:15.422937 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:54:15.422937 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:54:15.422937 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:54:15.422937 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b652bf6c-d91a-4569-88ab-4874851ae618 could not be found. Oct 04 18:54:15.422937 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:54:15.422937 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:15.422937 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:54:15.422937 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:15.422937 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:15.422937 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:15.422937 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:54:15.422937 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:54:15.422937 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:54:15.422937 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:54:15.422937 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:54:15.422937 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:54:15.422937 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:54:15.422937 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:54:15.422937 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:54:15.422937 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:54:15.422937 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b652bf6c-d91a-4569-88ab-4874851ae618 could not be found. Oct 04 18:54:15.422937 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:54:15.422937 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:15.422937 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:54:15.422937 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:15.422937 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:15.429318 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:15.429318 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:54:15.429318 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:54:15.429318 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b652bf6c-d91a-4569-88ab-4874851ae618 could not be found. Oct 04 18:54:15.429318 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:54:15.429318 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1fa44efe-3e72-414e-a836-103468e47dbf tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Returning 404 to user: Instance b652bf6c-d91a-4569-88ab-4874851ae618 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:54:15.429318 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1fa44efe-3e72-414e-a836-103468e47dbf tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/b652bf6c-d91a-4569-88ab-4874851ae618" status: 404 len: 111 microversion: 2.1 time: 0.027287 Oct 04 18:54:15.429318 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2705/5454] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:15 2022] GET /compute/v2.1/servers/b652bf6c-d91a-4569-88ab-4874851ae618 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:54:17.008477 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c1f8cd6c-4cda-49a8-85c1-39b001f580d7 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:17.009845 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c1f8cd6c-4cda-49a8-85c1-39b001f580d7 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:17.036343 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c1f8cd6c-4cda-49a8-85c1-39b001f580d7 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:17.040722 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c1f8cd6c-4cda-49a8-85c1-39b001f580d7 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:17.043496 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c1f8cd6c-4cda-49a8-85c1-39b001f580d7 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:17.044572 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c1f8cd6c-4cda-49a8-85c1-39b001f580d7 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:17.047036 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c1f8cd6c-4cda-49a8-85c1-39b001f580d7 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:17.049716 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c1f8cd6c-4cda-49a8-85c1-39b001f580d7 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:17.362273 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c1f8cd6c-4cda-49a8-85c1-39b001f580d7 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:17.371665 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c1f8cd6c-4cda-49a8-85c1-39b001f580d7 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1672 microversion: 2.1 time: 0.368575 Oct 04 18:54:17.377941 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2750/5455] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:17 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1672 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:17.416651 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-dcf34503-486f-466e-8627-bd1c5152a110 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:17.417543 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-dcf34503-486f-466e-8627-bd1c5152a110 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:17.426477 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dcf34503-486f-466e-8627-bd1c5152a110 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:17.427042 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dcf34503-486f-466e-8627-bd1c5152a110 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:17.427545 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dcf34503-486f-466e-8627-bd1c5152a110 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:17.438630 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dcf34503-486f-466e-8627-bd1c5152a110 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:17.438630 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dcf34503-486f-466e-8627-bd1c5152a110 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:17.438630 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dcf34503-486f-466e-8627-bd1c5152a110 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:17.877588 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-07044f3b-eb5e-44f0-938e-a8a5543db331 tempest-VolumesTestJSON-44002128 tempest-VolumesTestJSON-44002128-project] Calling method '.version_select at 0x7fe2590dac10>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:17.887489 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-dcf34503-486f-466e-8627-bd1c5152a110 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:17.901241 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-dcf34503-486f-466e-8627-bd1c5152a110 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1672 microversion: 2.1 time: 0.494434 Oct 04 18:54:17.917712 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2706/5456] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:17 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1672 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:17.930928 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6f4b3acf-5553-40c9-92ac-42403a6b8ba6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:17.931767 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-6f4b3acf-5553-40c9-92ac-42403a6b8ba6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:17.949269 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6f4b3acf-5553-40c9-92ac-42403a6b8ba6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:17.950295 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6f4b3acf-5553-40c9-92ac-42403a6b8ba6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:17.950904 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6f4b3acf-5553-40c9-92ac-42403a6b8ba6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:17.951809 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6f4b3acf-5553-40c9-92ac-42403a6b8ba6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:17.952580 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6f4b3acf-5553-40c9-92ac-42403a6b8ba6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:17.953192 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6f4b3acf-5553-40c9-92ac-42403a6b8ba6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:18.010169 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-07044f3b-eb5e-44f0-938e-a8a5543db331 tempest-VolumesTestJSON-44002128 tempest-VolumesTestJSON-44002128-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/e837b738-f5bb-47cd-88ff-3741ecc9ba88" status: 200 len: 351 microversion: 2.1 time: 0.136502 Oct 04 18:54:18.012121 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2751/5457] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Oct 4 18:54:17 2022] GET /compute/v2.1/os-volumes/e837b738-f5bb-47cd-88ff-3741ecc9ba88 => generated 351 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:54:18.450413 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-6f4b3acf-5553-40c9-92ac-42403a6b8ba6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:18.467668 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6f4b3acf-5553-40c9-92ac-42403a6b8ba6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1672 microversion: 2.1 time: 0.540488 Oct 04 18:54:18.476389 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2707/5458] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:17 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1672 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:54:18.495013 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3fb9b7e7-b3f0-4b5d-95de-6f2a90a104c5 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:18.495800 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3fb9b7e7-b3f0-4b5d-95de-6f2a90a104c5 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:18.520934 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3fb9b7e7-b3f0-4b5d-95de-6f2a90a104c5 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:18.529313 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3fb9b7e7-b3f0-4b5d-95de-6f2a90a104c5 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:18.529938 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3fb9b7e7-b3f0-4b5d-95de-6f2a90a104c5 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:18.530787 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3fb9b7e7-b3f0-4b5d-95de-6f2a90a104c5 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:18.532566 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3fb9b7e7-b3f0-4b5d-95de-6f2a90a104c5 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:18.533728 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3fb9b7e7-b3f0-4b5d-95de-6f2a90a104c5 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:19.154530 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3fb9b7e7-b3f0-4b5d-95de-6f2a90a104c5 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:19.163549 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3fb9b7e7-b3f0-4b5d-95de-6f2a90a104c5 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1672 microversion: 2.1 time: 0.673934 Oct 04 18:54:19.164505 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2752/5459] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:18 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1672 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:19.483602 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2d16f2f4-09b9-4206-8759-8f8aafd07bae tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-566743836", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": [{"uuid": "5739801d-d64f-45ac-b67b-5773a9d23794"}]}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:54:19.610448 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-2d16f2f4-09b9-4206-8759-8f8aafd07bae tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] validate_networks() for [('5739801d-d64f-45ac-b67b-5773a9d23794', None, None, None, None, None)] {{(pid=123002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:54:20.756431 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-2d16f2f4-09b9-4206-8759-8f8aafd07bae tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:54:20.771811 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-2d16f2f4-09b9-4206-8759-8f8aafd07bae tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:54:20.772865 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-2d16f2f4-09b9-4206-8759-8f8aafd07bae tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:54:20.773558 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-2d16f2f4-09b9-4206-8759-8f8aafd07bae tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:54:20.774445 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-2d16f2f4-09b9-4206-8759-8f8aafd07bae tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:54:20.792188 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2d16f2f4-09b9-4206-8759-8f8aafd07bae tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:20.819572 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2d16f2f4-09b9-4206-8759-8f8aafd07bae tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:20.819572 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2d16f2f4-09b9-4206-8759-8f8aafd07bae tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:20.819572 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2d16f2f4-09b9-4206-8759-8f8aafd07bae tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:20.819572 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2d16f2f4-09b9-4206-8759-8f8aafd07bae tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:20.819572 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2d16f2f4-09b9-4206-8759-8f8aafd07bae tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:20.866780 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-2d16f2f4-09b9-4206-8759-8f8aafd07bae tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Getting quotas for project 57d8fd392d5b4e8798cb51fe0e54ad3b. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:54:20.874038 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-2d16f2f4-09b9-4206-8759-8f8aafd07bae tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Getting quotas for user ee7fee2b098d4eb8bdc8df2a929cdede and project 57d8fd392d5b4e8798cb51fe0e54ad3b. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:54:20.890680 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2d16f2f4-09b9-4206-8759-8f8aafd07bae tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Going to run 1 instances... {{(pid=123002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:54:20.895468 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2d16f2f4-09b9-4206-8759-8f8aafd07bae tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 06eb8777-d059-4716-b47c-df3e6a027722] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:54:21.097990 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2d16f2f4-09b9-4206-8759-8f8aafd07bae tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.619115 Oct 04 18:54:21.099378 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2708/5460] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:54:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1622 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:54:21.111184 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-cd8eabd8-d216-4c31-9184-e9caf36b81f7 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:21.112477 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-cd8eabd8-d216-4c31-9184-e9caf36b81f7 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 06eb8777-d059-4716-b47c-df3e6a027722] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:21.313296 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-cd8eabd8-d216-4c31-9184-e9caf36b81f7 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:21.328871 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-cd8eabd8-d216-4c31-9184-e9caf36b81f7 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/06eb8777-d059-4716-b47c-df3e6a027722" status: 200 len: 1214 microversion: 2.1 time: 0.220671 Oct 04 18:54:21.346651 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2753/5461] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:21 2022] GET /compute/v2.1/servers/06eb8777-d059-4716-b47c-df3e6a027722 => generated 1214 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:22.359040 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-68ceacfb-c541-493c-b8ef-28d39004570f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:22.361428 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-68ceacfb-c541-493c-b8ef-28d39004570f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 06eb8777-d059-4716-b47c-df3e6a027722] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:22.421739 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8f1c9617-25be-44b3-8e91-be0ed32b4079 tempest-VolumesTestJSON-44002128 tempest-VolumesTestJSON-44002128-project] Calling method '.version_select at 0x7fe2580b48b0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:22.551159 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-68ceacfb-c541-493c-b8ef-28d39004570f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:22.563322 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-68ceacfb-c541-493c-b8ef-28d39004570f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/06eb8777-d059-4716-b47c-df3e6a027722" status: 200 len: 1214 microversion: 2.1 time: 0.209774 Oct 04 18:54:22.563912 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2709/5462] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:22 2022] GET /compute/v2.1/servers/06eb8777-d059-4716-b47c-df3e6a027722 => generated 1214 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:22.564154 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8f1c9617-25be-44b3-8e91-be0ed32b4079 tempest-VolumesTestJSON-44002128 tempest-VolumesTestJSON-44002128-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/b5926234-f083-4e14-9718-d9b7e00c58aa" status: 200 len: 351 microversion: 2.1 time: 0.147833 Oct 04 18:54:22.565496 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2754/5463] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Oct 4 18:54:22 2022] GET /compute/v2.1/os-volumes/b5926234-f083-4e14-9718-d9b7e00c58aa => generated 351 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:54:22.590578 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-08b41f84-d948-4f36-bb59-b7cc58673323 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:22.590578 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-08b41f84-d948-4f36-bb59-b7cc58673323 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: 3209d143-9e5f-4529-a0bb-8fea0c22083b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:22.611994 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-08b41f84-d948-4f36-bb59-b7cc58673323 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:22.614257 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-08b41f84-d948-4f36-bb59-b7cc58673323 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:22.618927 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-08b41f84-d948-4f36-bb59-b7cc58673323 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:22.619713 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-08b41f84-d948-4f36-bb59-b7cc58673323 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:22.622862 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-08b41f84-d948-4f36-bb59-b7cc58673323 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:22.623335 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-08b41f84-d948-4f36-bb59-b7cc58673323 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:22.656696 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-08b41f84-d948-4f36-bb59-b7cc58673323 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] HTTP exception thrown: Instance 3209d143-9e5f-4529-a0bb-8fea0c22083b could not be found. Oct 04 18:54:22.663973 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-08b41f84-d948-4f36-bb59-b7cc58673323 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Request method failure captured: Oct 04 18:54:22.663973 n-d-850501-14 devstack@n-api.service[123002]: request: DELETE /compute/v2.1/servers/3209d143-9e5f-4529-a0bb-8fea0c22083b HTTP/1.1 Oct 04 18:54:22.663973 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:54:22.663973 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:54:22.663973 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:54:22.663973 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:54:22.663973 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:54:22.663973 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:54:22.663973 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:54:22.663973 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:54:22.663973 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPIAZ5RZP-L2AfGhXbSAirsikFtiKRJw8GbD2F4avTn6csTjPvYW4EgckMMa_odYrXTBqTIarrxxpsgj83P_nCf0n9cSTNLxyj6f4zISS1Nx3NxppTvrxz8bw1hclhfH5hpAMl_7yiEWC9J95Zeea4ou_80fw0GmE8GZRBOxEg7cn1lU Oct 04 18:54:22.663973 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:54:22.663973 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:54:22.663973 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:54:22.663973 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:54:22.663973 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:54:22.663973 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:54:22.663973 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 4154ec20e0354ee6a425ba853b8efe67 Oct 04 18:54:22.663973 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-DeleteServersTestJSON-806460860 Oct 04 18:54:22.663973 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:54:22.663973 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:54:22.663973 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4154ec20e0354ee6a425ba853b8efe67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4154ec20e0354ee6a425ba853b8efe67", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4154ec20e0354ee6a425ba853b8efe67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4154ec20e0354ee6a425ba853b8efe67"}]}] Oct 04 18:54:22.663973 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-DeleteServersTestJSON-806460860 Oct 04 18:54:22.663973 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 4154ec20e0354ee6a425ba853b8efe67 Oct 04 18:54:22.663973 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-DeleteServersTestJSON-806460860 Oct 04 18:54:22.663973 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-DeleteServersTestJSON-806460860-project Oct 04 18:54:22.663973 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:54:22.663973 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:54:22.663973 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: c56b67cede6b46f5a36a723d361b3245 Oct 04 18:54:22.663973 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-DeleteServersTestJSON-806460860-project Oct 04 18:54:22.663973 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:54:22.663973 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 3209d143-9e5f-4529-a0bb-8fea0c22083b could not be found. Oct 04 18:54:22.663973 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '3209d143-9e5f-4529-a0bb-8fea0c22083b'} Oct 04 18:54:22.663973 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:54:22.663973 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:22.663973 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:54:22.663973 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:54:22.663973 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:54:22.663973 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:54:22.663973 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:54:22.663973 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:54:22.663973 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:54:22.663973 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:54:22.663973 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3209d143-9e5f-4529-a0bb-8fea0c22083b could not be found. Oct 04 18:54:22.663973 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:54:22.663973 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:22.663973 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:54:22.663973 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:22.663973 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:22.663973 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:22.663973 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:54:22.663973 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:54:22.663973 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:54:22.663973 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:54:22.663973 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:54:22.663973 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:54:22.663973 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:54:22.663973 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:54:22.663973 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:54:22.663973 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:54:22.663973 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:54:22.663973 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:54:22.671096 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3209d143-9e5f-4529-a0bb-8fea0c22083b could not be found. Oct 04 18:54:22.671096 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:54:22.671096 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:22.671096 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:54:22.671096 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:22.671096 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:22.671096 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:22.671096 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:54:22.671096 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:54:22.671096 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3209d143-9e5f-4529-a0bb-8fea0c22083b could not be found. Oct 04 18:54:22.671096 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:54:22.671096 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-08b41f84-d948-4f36-bb59-b7cc58673323 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Returning 404 to user: Instance 3209d143-9e5f-4529-a0bb-8fea0c22083b could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:54:22.671096 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-08b41f84-d948-4f36-bb59-b7cc58673323 tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3209d143-9e5f-4529-a0bb-8fea0c22083b" status: 404 len: 111 microversion: 2.1 time: 0.100645 Oct 04 18:54:22.671096 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2710/5464] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:54:22 2022] DELETE /compute/v2.1/servers/3209d143-9e5f-4529-a0bb-8fea0c22083b => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:54:22.681038 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c2bcae75-d79a-4645-b758-3d1147acfe3f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:22.682002 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c2bcae75-d79a-4645-b758-3d1147acfe3f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: 3209d143-9e5f-4529-a0bb-8fea0c22083b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:22.689426 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c2bcae75-d79a-4645-b758-3d1147acfe3f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:22.690158 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c2bcae75-d79a-4645-b758-3d1147acfe3f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:22.691407 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c2bcae75-d79a-4645-b758-3d1147acfe3f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:22.693517 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c2bcae75-d79a-4645-b758-3d1147acfe3f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:22.694230 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c2bcae75-d79a-4645-b758-3d1147acfe3f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:22.694942 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c2bcae75-d79a-4645-b758-3d1147acfe3f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:22.718554 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-c2bcae75-d79a-4645-b758-3d1147acfe3f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] HTTP exception thrown: Instance 3209d143-9e5f-4529-a0bb-8fea0c22083b could not be found. Oct 04 18:54:22.721100 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c2bcae75-d79a-4645-b758-3d1147acfe3f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Request method failure captured: Oct 04 18:54:22.721100 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/3209d143-9e5f-4529-a0bb-8fea0c22083b HTTP/1.1 Oct 04 18:54:22.721100 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:54:22.721100 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:54:22.721100 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:54:22.721100 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:54:22.721100 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:54:22.721100 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:54:22.721100 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:54:22.721100 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:54:22.721100 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPIAZ5RZP-L2AfGhXbSAirsikFtiKRJw8GbD2F4avTn6csTjPvYW4EgckMMa_odYrXTBqTIarrxxpsgj83P_nCf0n9cSTNLxyj6f4zISS1Nx3NxppTvrxz8bw1hclhfH5hpAMl_7yiEWC9J95Zeea4ou_80fw0GmE8GZRBOxEg7cn1lU Oct 04 18:54:22.721100 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:54:22.721100 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:54:22.721100 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:54:22.721100 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:54:22.721100 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:54:22.721100 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:54:22.721100 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 4154ec20e0354ee6a425ba853b8efe67 Oct 04 18:54:22.721100 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-DeleteServersTestJSON-806460860 Oct 04 18:54:22.721100 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:54:22.721100 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:54:22.721100 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4154ec20e0354ee6a425ba853b8efe67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4154ec20e0354ee6a425ba853b8efe67", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4154ec20e0354ee6a425ba853b8efe67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4154ec20e0354ee6a425ba853b8efe67"}]}] Oct 04 18:54:22.721100 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-DeleteServersTestJSON-806460860 Oct 04 18:54:22.721100 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 4154ec20e0354ee6a425ba853b8efe67 Oct 04 18:54:22.721100 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-DeleteServersTestJSON-806460860 Oct 04 18:54:22.721100 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-DeleteServersTestJSON-806460860-project Oct 04 18:54:22.721100 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:54:22.721100 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:54:22.721100 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: c56b67cede6b46f5a36a723d361b3245 Oct 04 18:54:22.721100 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-DeleteServersTestJSON-806460860-project Oct 04 18:54:22.721100 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:54:22.721100 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 3209d143-9e5f-4529-a0bb-8fea0c22083b could not be found. Oct 04 18:54:22.721100 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '3209d143-9e5f-4529-a0bb-8fea0c22083b'} Oct 04 18:54:22.721100 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:54:22.721100 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:22.721100 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:54:22.721100 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:54:22.721100 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:54:22.721100 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:54:22.721100 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:54:22.721100 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:54:22.721100 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:54:22.721100 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:54:22.721100 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3209d143-9e5f-4529-a0bb-8fea0c22083b could not be found. Oct 04 18:54:22.721100 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:54:22.721100 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:22.721100 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:54:22.721100 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:22.721100 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:22.721100 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:22.721100 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:54:22.721100 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:54:22.721100 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:54:22.721100 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:54:22.721100 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:54:22.721100 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:54:22.721100 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:54:22.721100 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:54:22.721100 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:54:22.721100 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:54:22.721100 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3209d143-9e5f-4529-a0bb-8fea0c22083b could not be found. Oct 04 18:54:22.721100 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:54:22.721100 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:22.721100 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:54:22.730471 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:22.730471 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:22.730471 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:22.730471 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:54:22.730471 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:54:22.730471 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3209d143-9e5f-4529-a0bb-8fea0c22083b could not be found. Oct 04 18:54:22.730471 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:54:22.734965 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c2bcae75-d79a-4645-b758-3d1147acfe3f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Returning 404 to user: Instance 3209d143-9e5f-4529-a0bb-8fea0c22083b could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:54:22.736747 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c2bcae75-d79a-4645-b758-3d1147acfe3f tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/3209d143-9e5f-4529-a0bb-8fea0c22083b" status: 404 len: 111 microversion: 2.1 time: 0.061233 Oct 04 18:54:22.739223 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2755/5465] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:22 2022] GET /compute/v2.1/servers/3209d143-9e5f-4529-a0bb-8fea0c22083b => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:54:22.747441 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-31fcde0b-f335-402f-930d-4e280ecda0ec tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:22.748380 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-31fcde0b-f335-402f-930d-4e280ecda0ec tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: 0e392b33-c106-4158-b4be-8972aa5794f4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:22.762255 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-31fcde0b-f335-402f-930d-4e280ecda0ec tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:22.762833 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-31fcde0b-f335-402f-930d-4e280ecda0ec tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:22.769494 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-31fcde0b-f335-402f-930d-4e280ecda0ec tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:22.769494 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-31fcde0b-f335-402f-930d-4e280ecda0ec tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:22.769494 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-31fcde0b-f335-402f-930d-4e280ecda0ec tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:22.769494 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-31fcde0b-f335-402f-930d-4e280ecda0ec tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:22.790029 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-31fcde0b-f335-402f-930d-4e280ecda0ec tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] HTTP exception thrown: Instance 0e392b33-c106-4158-b4be-8972aa5794f4 could not be found. Oct 04 18:54:22.791612 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-31fcde0b-f335-402f-930d-4e280ecda0ec tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Request method failure captured: Oct 04 18:54:22.791612 n-d-850501-14 devstack@n-api.service[123002]: request: DELETE /compute/v2.1/servers/0e392b33-c106-4158-b4be-8972aa5794f4 HTTP/1.1 Oct 04 18:54:22.791612 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:54:22.791612 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:54:22.791612 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:54:22.791612 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:54:22.791612 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:54:22.791612 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:54:22.791612 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:54:22.791612 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:54:22.791612 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPIAZ5RZP-L2AfGhXbSAirsikFtiKRJw8GbD2F4avTn6csTjPvYW4EgckMMa_odYrXTBqTIarrxxpsgj83P_nCf0n9cSTNLxyj6f4zISS1Nx3NxppTvrxz8bw1hclhfH5hpAMl_7yiEWC9J95Zeea4ou_80fw0GmE8GZRBOxEg7cn1lU Oct 04 18:54:22.791612 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:54:22.791612 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:54:22.791612 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:54:22.791612 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:54:22.791612 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:54:22.791612 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:54:22.791612 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 4154ec20e0354ee6a425ba853b8efe67 Oct 04 18:54:22.791612 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-DeleteServersTestJSON-806460860 Oct 04 18:54:22.791612 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:54:22.791612 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:54:22.791612 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4154ec20e0354ee6a425ba853b8efe67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4154ec20e0354ee6a425ba853b8efe67", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4154ec20e0354ee6a425ba853b8efe67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4154ec20e0354ee6a425ba853b8efe67"}]}] Oct 04 18:54:22.791612 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-DeleteServersTestJSON-806460860 Oct 04 18:54:22.791612 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 4154ec20e0354ee6a425ba853b8efe67 Oct 04 18:54:22.791612 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-DeleteServersTestJSON-806460860 Oct 04 18:54:22.791612 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-DeleteServersTestJSON-806460860-project Oct 04 18:54:22.791612 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:54:22.791612 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:54:22.791612 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: c56b67cede6b46f5a36a723d361b3245 Oct 04 18:54:22.791612 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-DeleteServersTestJSON-806460860-project Oct 04 18:54:22.791612 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:54:22.791612 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 0e392b33-c106-4158-b4be-8972aa5794f4 could not be found. Oct 04 18:54:22.791612 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '0e392b33-c106-4158-b4be-8972aa5794f4'} Oct 04 18:54:22.791612 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:54:22.791612 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:22.791612 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:54:22.791612 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:54:22.791612 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:54:22.791612 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:54:22.791612 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:54:22.791612 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:54:22.791612 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:54:22.791612 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:54:22.791612 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e392b33-c106-4158-b4be-8972aa5794f4 could not be found. Oct 04 18:54:22.791612 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:54:22.791612 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:22.791612 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:54:22.791612 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:22.791612 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:22.791612 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:22.791612 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:54:22.791612 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:54:22.791612 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:54:22.791612 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:54:22.791612 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:54:22.791612 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:54:22.791612 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:54:22.791612 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:54:22.791612 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:54:22.791612 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:54:22.791612 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:54:22.791612 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:54:22.800045 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e392b33-c106-4158-b4be-8972aa5794f4 could not be found. Oct 04 18:54:22.800045 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:54:22.800045 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:22.800045 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:54:22.800045 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:22.800045 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:22.800045 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:22.800045 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:54:22.800045 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:54:22.800045 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e392b33-c106-4158-b4be-8972aa5794f4 could not be found. Oct 04 18:54:22.800045 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:54:22.800045 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-31fcde0b-f335-402f-930d-4e280ecda0ec tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Returning 404 to user: Instance 0e392b33-c106-4158-b4be-8972aa5794f4 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:54:22.800045 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-31fcde0b-f335-402f-930d-4e280ecda0ec tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0e392b33-c106-4158-b4be-8972aa5794f4" status: 404 len: 111 microversion: 2.1 time: 0.050355 Oct 04 18:54:22.800045 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2711/5466] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:54:22 2022] DELETE /compute/v2.1/servers/0e392b33-c106-4158-b4be-8972aa5794f4 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:54:22.806987 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-66691fd5-987a-4a2b-82c4-46bd2262a52b tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:22.808184 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-66691fd5-987a-4a2b-82c4-46bd2262a52b tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] [instance: 0e392b33-c106-4158-b4be-8972aa5794f4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:22.820753 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-66691fd5-987a-4a2b-82c4-46bd2262a52b tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:22.821253 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-66691fd5-987a-4a2b-82c4-46bd2262a52b tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:22.822063 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-66691fd5-987a-4a2b-82c4-46bd2262a52b tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:22.822413 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-66691fd5-987a-4a2b-82c4-46bd2262a52b tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:22.829027 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-66691fd5-987a-4a2b-82c4-46bd2262a52b tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:22.829027 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-66691fd5-987a-4a2b-82c4-46bd2262a52b tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:22.873123 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-66691fd5-987a-4a2b-82c4-46bd2262a52b tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] HTTP exception thrown: Instance 0e392b33-c106-4158-b4be-8972aa5794f4 could not be found. Oct 04 18:54:22.879316 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-66691fd5-987a-4a2b-82c4-46bd2262a52b tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Request method failure captured: Oct 04 18:54:22.879316 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/0e392b33-c106-4158-b4be-8972aa5794f4 HTTP/1.1 Oct 04 18:54:22.879316 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:54:22.879316 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:54:22.879316 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:54:22.879316 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:54:22.879316 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:54:22.879316 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:54:22.879316 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:54:22.879316 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:54:22.879316 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPIAZ5RZP-L2AfGhXbSAirsikFtiKRJw8GbD2F4avTn6csTjPvYW4EgckMMa_odYrXTBqTIarrxxpsgj83P_nCf0n9cSTNLxyj6f4zISS1Nx3NxppTvrxz8bw1hclhfH5hpAMl_7yiEWC9J95Zeea4ou_80fw0GmE8GZRBOxEg7cn1lU Oct 04 18:54:22.879316 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:54:22.879316 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:54:22.879316 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:54:22.879316 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:54:22.879316 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:54:22.879316 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:54:22.879316 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 4154ec20e0354ee6a425ba853b8efe67 Oct 04 18:54:22.879316 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-DeleteServersTestJSON-806460860 Oct 04 18:54:22.879316 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:54:22.879316 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:54:22.879316 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4154ec20e0354ee6a425ba853b8efe67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4154ec20e0354ee6a425ba853b8efe67", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4154ec20e0354ee6a425ba853b8efe67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4154ec20e0354ee6a425ba853b8efe67"}]}] Oct 04 18:54:22.879316 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-DeleteServersTestJSON-806460860 Oct 04 18:54:22.879316 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 4154ec20e0354ee6a425ba853b8efe67 Oct 04 18:54:22.879316 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-DeleteServersTestJSON-806460860 Oct 04 18:54:22.879316 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-DeleteServersTestJSON-806460860-project Oct 04 18:54:22.879316 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:54:22.879316 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:54:22.879316 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: c56b67cede6b46f5a36a723d361b3245 Oct 04 18:54:22.879316 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-DeleteServersTestJSON-806460860-project Oct 04 18:54:22.879316 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:54:22.879316 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 0e392b33-c106-4158-b4be-8972aa5794f4 could not be found. Oct 04 18:54:22.879316 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '0e392b33-c106-4158-b4be-8972aa5794f4'} Oct 04 18:54:22.879316 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:54:22.879316 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:22.879316 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:54:22.879316 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:54:22.879316 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:54:22.879316 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:54:22.879316 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:54:22.879316 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:54:22.879316 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:54:22.879316 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:54:22.879316 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e392b33-c106-4158-b4be-8972aa5794f4 could not be found. Oct 04 18:54:22.879316 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:54:22.879316 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:22.879316 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:54:22.879316 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:22.879316 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:22.879316 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:22.879316 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:54:22.879316 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:54:22.879316 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:54:22.879316 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:54:22.879316 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:54:22.879316 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:54:22.879316 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:54:22.879316 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:54:22.879316 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:54:22.879316 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:54:22.879316 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e392b33-c106-4158-b4be-8972aa5794f4 could not be found. Oct 04 18:54:22.879316 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:54:22.879316 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:22.879316 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:54:22.886727 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:22.886727 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:22.886727 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:22.886727 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:54:22.886727 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:54:22.886727 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e392b33-c106-4158-b4be-8972aa5794f4 could not be found. Oct 04 18:54:22.886727 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:54:22.888257 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-66691fd5-987a-4a2b-82c4-46bd2262a52b tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] Returning 404 to user: Instance 0e392b33-c106-4158-b4be-8972aa5794f4 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:54:22.891242 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-66691fd5-987a-4a2b-82c4-46bd2262a52b tempest-DeleteServersTestJSON-806460860 tempest-DeleteServersTestJSON-806460860-project] 10.222.0.20 "GET /compute/v2.1/servers/0e392b33-c106-4158-b4be-8972aa5794f4" status: 404 len: 111 microversion: 2.1 time: 0.088571 Oct 04 18:54:22.894922 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2756/5467] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:22 2022] GET /compute/v2.1/servers/0e392b33-c106-4158-b4be-8972aa5794f4 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:54:23.592147 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1afb6677-9196-4ad5-bc51-3cd4d4e1cc3a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:23.592782 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1afb6677-9196-4ad5-bc51-3cd4d4e1cc3a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 06eb8777-d059-4716-b47c-df3e6a027722] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:23.622897 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1afb6677-9196-4ad5-bc51-3cd4d4e1cc3a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:23.623396 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1afb6677-9196-4ad5-bc51-3cd4d4e1cc3a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:23.632227 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1afb6677-9196-4ad5-bc51-3cd4d4e1cc3a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:23.635035 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1afb6677-9196-4ad5-bc51-3cd4d4e1cc3a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:23.637301 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1afb6677-9196-4ad5-bc51-3cd4d4e1cc3a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:23.653083 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1afb6677-9196-4ad5-bc51-3cd4d4e1cc3a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:23.837979 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1afb6677-9196-4ad5-bc51-3cd4d4e1cc3a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:23.859153 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1afb6677-9196-4ad5-bc51-3cd4d4e1cc3a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/06eb8777-d059-4716-b47c-df3e6a027722" status: 200 len: 1266 microversion: 2.1 time: 0.270710 Oct 04 18:54:23.887018 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2712/5468] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:23 2022] GET /compute/v2.1/servers/06eb8777-d059-4716-b47c-df3e6a027722 => generated 1266 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:24.891768 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1b3fb24c-73e8-4f2b-a0aa-649c54a8565c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:24.892953 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1b3fb24c-73e8-4f2b-a0aa-649c54a8565c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 06eb8777-d059-4716-b47c-df3e6a027722] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:24.904654 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1b3fb24c-73e8-4f2b-a0aa-649c54a8565c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:24.909203 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1b3fb24c-73e8-4f2b-a0aa-649c54a8565c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:24.910069 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1b3fb24c-73e8-4f2b-a0aa-649c54a8565c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:24.911018 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1b3fb24c-73e8-4f2b-a0aa-649c54a8565c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:24.912549 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1b3fb24c-73e8-4f2b-a0aa-649c54a8565c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:24.915472 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1b3fb24c-73e8-4f2b-a0aa-649c54a8565c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:25.139085 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1b3fb24c-73e8-4f2b-a0aa-649c54a8565c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:25.164232 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1b3fb24c-73e8-4f2b-a0aa-649c54a8565c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/06eb8777-d059-4716-b47c-df3e6a027722" status: 200 len: 1272 microversion: 2.1 time: 0.277385 Oct 04 18:54:25.166111 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2757/5469] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:24 2022] GET /compute/v2.1/servers/06eb8777-d059-4716-b47c-df3e6a027722 => generated 1272 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:26.197996 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4b4dab0a-9042-417d-9c59-1ccaec915cce tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:26.198899 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4b4dab0a-9042-417d-9c59-1ccaec915cce tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 06eb8777-d059-4716-b47c-df3e6a027722] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:26.214943 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4b4dab0a-9042-417d-9c59-1ccaec915cce tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:26.220738 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4b4dab0a-9042-417d-9c59-1ccaec915cce tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:26.223735 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4b4dab0a-9042-417d-9c59-1ccaec915cce tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:26.225433 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4b4dab0a-9042-417d-9c59-1ccaec915cce tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:26.227424 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4b4dab0a-9042-417d-9c59-1ccaec915cce tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:26.228161 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4b4dab0a-9042-417d-9c59-1ccaec915cce tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:26.468958 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4b4dab0a-9042-417d-9c59-1ccaec915cce tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:26.487524 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4b4dab0a-9042-417d-9c59-1ccaec915cce tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/06eb8777-d059-4716-b47c-df3e6a027722" status: 200 len: 1272 microversion: 2.1 time: 0.294276 Oct 04 18:54:26.499609 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2713/5470] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:26 2022] GET /compute/v2.1/servers/06eb8777-d059-4716-b47c-df3e6a027722 => generated 1272 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:26.898387 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-dbbaa632-54f1-41c7-b101-db8e826c01f5 tempest-VolumesTestJSON-44002128 tempest-VolumesTestJSON-44002128-project] Calling method '.version_select at 0x7fe258215820>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:27.016631 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-dbbaa632-54f1-41c7-b101-db8e826c01f5 tempest-VolumesTestJSON-44002128 tempest-VolumesTestJSON-44002128-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/78d5adeb-fa67-4b09-bec6-8db407b0f78e" status: 200 len: 351 microversion: 2.1 time: 0.122834 Oct 04 18:54:27.021026 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2758/5471] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Oct 4 18:54:26 2022] GET /compute/v2.1/os-volumes/78d5adeb-fa67-4b09-bec6-8db407b0f78e => generated 351 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:54:27.034490 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c548139d-7a5e-4f3e-843a-5b39ee5643ae tempest-VolumesTestJSON-44002128 tempest-VolumesTestJSON-44002128-project] Calling method '.version_select at 0x7fe253fa2c10>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:27.365007 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c548139d-7a5e-4f3e-843a-5b39ee5643ae tempest-VolumesTestJSON-44002128 tempest-VolumesTestJSON-44002128-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.335468 Oct 04 18:54:27.372951 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2714/5472] 10.222.0.20 () {58 vars in 1134 bytes} [Tue Oct 4 18:54:27 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:27.385281 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-795f76fe-844d-45eb-8df8-726005958fcf tempest-VolumesTestJSON-44002128 tempest-VolumesTestJSON-44002128-project] Calling method '.version_select at 0x7fe2581caa60>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:27.513002 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a0301f0c-1d43-4356-87dc-e0b29b0ccf4e tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:27.513983 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a0301f0c-1d43-4356-87dc-e0b29b0ccf4e tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 06eb8777-d059-4716-b47c-df3e6a027722] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:27.537063 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a0301f0c-1d43-4356-87dc-e0b29b0ccf4e tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:27.549322 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a0301f0c-1d43-4356-87dc-e0b29b0ccf4e tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:27.552252 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a0301f0c-1d43-4356-87dc-e0b29b0ccf4e tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:27.553048 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a0301f0c-1d43-4356-87dc-e0b29b0ccf4e tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:27.558353 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a0301f0c-1d43-4356-87dc-e0b29b0ccf4e tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:27.558902 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a0301f0c-1d43-4356-87dc-e0b29b0ccf4e tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:27.597322 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-795f76fe-844d-45eb-8df8-726005958fcf tempest-VolumesTestJSON-44002128 tempest-VolumesTestJSON-44002128-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.216748 Oct 04 18:54:27.598824 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2759/5473] 10.222.0.20 () {58 vars in 1149 bytes} [Tue Oct 4 18:54:27 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:54:27.621817 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4cb60cd8-5eb4-4c31-b1c7-4f3c5b82cc70 tempest-VolumesTestJSON-44002128 tempest-VolumesTestJSON-44002128-project] Calling method '.version_select at 0x7fe2593da670>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:27.820441 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-4cb60cd8-5eb4-4c31-b1c7-4f3c5b82cc70 tempest-VolumesTestJSON-44002128 tempest-VolumesTestJSON-44002128-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.205895 Oct 04 18:54:27.821036 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2760/5474] 10.222.0.20 () {58 vars in 1134 bytes} [Tue Oct 4 18:54:27 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:54:27.835215 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-89ee55b9-0eaa-4006-a923-df3a34c0d8e9 tempest-VolumesTestJSON-44002128 tempest-VolumesTestJSON-44002128-project] Calling method '.version_select at 0x7fe2580b49d0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:27.981995 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-89ee55b9-0eaa-4006-a923-df3a34c0d8e9 tempest-VolumesTestJSON-44002128 tempest-VolumesTestJSON-44002128-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.151201 Oct 04 18:54:27.982747 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2761/5475] 10.222.0.20 () {58 vars in 1167 bytes} [Tue Oct 4 18:54:27 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:54:28.008530 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-988e9fcd-bbb5-4f77-9f6d-e8f69c658113 tempest-VolumesTestJSON-44002128 tempest-VolumesTestJSON-44002128-project] Calling method '.version_select at 0x7fe258fda940>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:28.136233 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a0301f0c-1d43-4356-87dc-e0b29b0ccf4e tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:28.155752 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a0301f0c-1d43-4356-87dc-e0b29b0ccf4e tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/06eb8777-d059-4716-b47c-df3e6a027722" status: 200 len: 1314 microversion: 2.1 time: 0.648727 Oct 04 18:54:28.161039 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2715/5476] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:27 2022] GET /compute/v2.1/servers/06eb8777-d059-4716-b47c-df3e6a027722 => generated 1314 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:54:28.173831 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-988e9fcd-bbb5-4f77-9f6d-e8f69c658113 tempest-VolumesTestJSON-44002128 tempest-VolumesTestJSON-44002128-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.169256 Oct 04 18:54:28.173831 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2762/5477] 10.222.0.20 () {58 vars in 1170 bytes} [Tue Oct 4 18:54:27 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:54:28.187807 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e5157629-234a-4035-bbf2-d3a60b76ac86 tempest-VolumesTestJSON-44002128 tempest-VolumesTestJSON-44002128-project] Calling method '.version_select at 0x7fe2582155e0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:28.366123 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e5157629-234a-4035-bbf2-d3a60b76ac86 tempest-VolumesTestJSON-44002128 tempest-VolumesTestJSON-44002128-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.183160 Oct 04 18:54:28.367321 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2763/5478] 10.222.0.20 () {58 vars in 1155 bytes} [Tue Oct 4 18:54:28 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:28.381114 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-34bdcf1e-4ff2-42f3-938c-8bcba5db3661 tempest-VolumesTestJSON-44002128 tempest-VolumesTestJSON-44002128-project] Calling method '.version_select at 0x7fe253dded30>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:28.516348 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-34bdcf1e-4ff2-42f3-938c-8bcba5db3661 tempest-VolumesTestJSON-44002128 tempest-VolumesTestJSON-44002128-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.139335 Oct 04 18:54:28.520124 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2716/5479] 10.222.0.20 () {58 vars in 1188 bytes} [Tue Oct 4 18:54:28 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:54:28.533080 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5a8b393d-d8da-46e1-82f4-18aad352bac2 tempest-VolumesTestJSON-44002128 tempest-VolumesTestJSON-44002128-project] Calling method '.version_select at 0x7fe25914d790>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:28.635169 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5a8b393d-d8da-46e1-82f4-18aad352bac2 tempest-VolumesTestJSON-44002128 tempest-VolumesTestJSON-44002128-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.106033 Oct 04 18:54:28.636077 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2764/5480] 10.222.0.20 () {58 vars in 1155 bytes} [Tue Oct 4 18:54:28 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:29.193626 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b5cf2df7-7192-4de9-8e5f-c4c6dc13db1a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:29.203445 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b5cf2df7-7192-4de9-8e5f-c4c6dc13db1a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 06eb8777-d059-4716-b47c-df3e6a027722] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:29.211014 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=5 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:54:29.216423 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b5cf2df7-7192-4de9-8e5f-c4c6dc13db1a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:29.217795 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b5cf2df7-7192-4de9-8e5f-c4c6dc13db1a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:29.219350 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b5cf2df7-7192-4de9-8e5f-c4c6dc13db1a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:29.224369 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b5cf2df7-7192-4de9-8e5f-c4c6dc13db1a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:29.225158 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b5cf2df7-7192-4de9-8e5f-c4c6dc13db1a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:29.225957 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b5cf2df7-7192-4de9-8e5f-c4c6dc13db1a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:30.231852 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b5cf2df7-7192-4de9-8e5f-c4c6dc13db1a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:30.252025 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b5cf2df7-7192-4de9-8e5f-c4c6dc13db1a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/06eb8777-d059-4716-b47c-df3e6a027722" status: 200 len: 1314 microversion: 2.1 time: 1.053135 Oct 04 18:54:30.259752 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2717/5481] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:29 2022] GET /compute/v2.1/servers/06eb8777-d059-4716-b47c-df3e6a027722 => generated 1314 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:30.495389 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7b4c4970-fea3-4f4a-b178-16e0c94d309a tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-989528416", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "d2b4b2bb-5916-444d-9710-bee1c3406654"}]}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:54:30.627422 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.neutron [None req-7b4c4970-fea3-4f4a-b178-16e0c94d309a tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] validate_networks() for [('d2b4b2bb-5916-444d-9710-bee1c3406654', None, None, None, None, None)] {{(pid=123001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:54:30.922622 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-08876056-9576-4c83-ab42-7300ad0f6a6f req-38a402ac-d301-479f-9463-3c8ecc7c2c4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06eb8777-d059-4716-b47c-df3e6a027722", "tag": "216b899c-9fe6-4911-a379-731b6d5dce0e"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:54:30.939757 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:54:30.946359 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-08876056-9576-4c83-ab42-7300ad0f6a6f req-38a402ac-d301-479f-9463-3c8ecc7c2c4c service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:30.946841 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-08876056-9576-4c83-ab42-7300ad0f6a6f req-38a402ac-d301-479f-9463-3c8ecc7c2c4c service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:30.950403 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-08876056-9576-4c83-ab42-7300ad0f6a6f req-38a402ac-d301-479f-9463-3c8ecc7c2c4c service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:30.978660 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-08876056-9576-4c83-ab42-7300ad0f6a6f req-38a402ac-d301-479f-9463-3c8ecc7c2c4c service nova] Creating event network-changed:216b899c-9fe6-4911-a379-731b6d5dce0e for instance 06eb8777-d059-4716-b47c-df3e6a027722 on n-h1-850501-14 Oct 04 18:54:30.990000 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-08876056-9576-4c83-ab42-7300ad0f6a6f req-38a402ac-d301-479f-9463-3c8ecc7c2c4c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070989 Oct 04 18:54:30.995693 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2718/5482] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:54:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:54:31.286523 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a27c562e-82b7-438c-a358-2e659c094e04 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:31.287709 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a27c562e-82b7-438c-a358-2e659c094e04 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 06eb8777-d059-4716-b47c-df3e6a027722] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:31.302326 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a27c562e-82b7-438c-a358-2e659c094e04 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:31.303166 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a27c562e-82b7-438c-a358-2e659c094e04 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:31.303688 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a27c562e-82b7-438c-a358-2e659c094e04 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:31.306877 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a27c562e-82b7-438c-a358-2e659c094e04 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:31.308836 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a27c562e-82b7-438c-a358-2e659c094e04 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:31.309359 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a27c562e-82b7-438c-a358-2e659c094e04 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:31.325284 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:54:32.557058 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=8 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:54:32.810014 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-7b4c4970-fea3-4f4a-b178-16e0c94d309a tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:54:32.810744 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-7b4c4970-fea3-4f4a-b178-16e0c94d309a tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:54:32.811205 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-7b4c4970-fea3-4f4a-b178-16e0c94d309a tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:54:32.811375 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-7b4c4970-fea3-4f4a-b178-16e0c94d309a tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:54:32.811906 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-7b4c4970-fea3-4f4a-b178-16e0c94d309a tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:54:32.830256 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7b4c4970-fea3-4f4a-b178-16e0c94d309a tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:32.831875 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7b4c4970-fea3-4f4a-b178-16e0c94d309a tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:32.832393 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a27c562e-82b7-438c-a358-2e659c094e04 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:32.832762 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7b4c4970-fea3-4f4a-b178-16e0c94d309a tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:32.839446 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7b4c4970-fea3-4f4a-b178-16e0c94d309a tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:32.839446 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7b4c4970-fea3-4f4a-b178-16e0c94d309a tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:32.839446 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7b4c4970-fea3-4f4a-b178-16e0c94d309a tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:32.842932 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a27c562e-82b7-438c-a358-2e659c094e04 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/06eb8777-d059-4716-b47c-df3e6a027722" status: 200 len: 1314 microversion: 2.1 time: 1.563874 Oct 04 18:54:32.846692 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2719/5483] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:31 2022] GET /compute/v2.1/servers/06eb8777-d059-4716-b47c-df3e6a027722 => generated 1314 bytes in 1568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:54:32.864018 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-7b4c4970-fea3-4f4a-b178-16e0c94d309a tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Getting quotas for project 399d0b659c18493493b399e9617f8500. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:54:32.870940 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-7b4c4970-fea3-4f4a-b178-16e0c94d309a tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Getting quotas for user 8d749453f0b848738205a98fdd13ab64 and project 399d0b659c18493493b399e9617f8500. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:54:32.886099 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7b4c4970-fea3-4f4a-b178-16e0c94d309a tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Going to run 1 instances... {{(pid=123001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:54:32.890325 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7b4c4970-fea3-4f4a-b178-16e0c94d309a tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] [instance: fbe7c90b-7779-44b8-b43b-f01b223bcc0f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:54:33.122839 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7b4c4970-fea3-4f4a-b178-16e0c94d309a tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.047252 Oct 04 18:54:33.125403 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2765/5484] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:54:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 3051 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 18:54:33.142200 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f538337e-eebc-4ba1-91d9-5dbeea638a62 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:33.145600 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f538337e-eebc-4ba1-91d9-5dbeea638a62 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] [instance: fbe7c90b-7779-44b8-b43b-f01b223bcc0f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:33.375022 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f538337e-eebc-4ba1-91d9-5dbeea638a62 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d749453f0b848738205a98fdd13ab64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399d0b659c18493493b399e9617f8500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:33.392484 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f538337e-eebc-4ba1-91d9-5dbeea638a62 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] 10.222.0.20 "GET /compute/v2.1/servers/fbe7c90b-7779-44b8-b43b-f01b223bcc0f" status: 200 len: 1223 microversion: 2.1 time: 0.251505 Oct 04 18:54:33.392484 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2720/5485] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:33 2022] GET /compute/v2.1/servers/fbe7c90b-7779-44b8-b43b-f01b223bcc0f => generated 1223 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:33.871483 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-bc86ecbb-d680-4dff-91f9-0ef154de93e1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:33.875087 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-bc86ecbb-d680-4dff-91f9-0ef154de93e1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 06eb8777-d059-4716-b47c-df3e6a027722] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:33.887884 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bc86ecbb-d680-4dff-91f9-0ef154de93e1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:33.889822 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bc86ecbb-d680-4dff-91f9-0ef154de93e1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:33.892123 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bc86ecbb-d680-4dff-91f9-0ef154de93e1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:33.896617 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bc86ecbb-d680-4dff-91f9-0ef154de93e1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:33.896617 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bc86ecbb-d680-4dff-91f9-0ef154de93e1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:33.897857 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bc86ecbb-d680-4dff-91f9-0ef154de93e1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:34.414788 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ed2f2470-2c90-4b25-afca-ddb48cf38680 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:34.416034 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ed2f2470-2c90-4b25-afca-ddb48cf38680 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] [instance: fbe7c90b-7779-44b8-b43b-f01b223bcc0f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:34.583165 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-bc86ecbb-d680-4dff-91f9-0ef154de93e1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:34.602487 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-bc86ecbb-d680-4dff-91f9-0ef154de93e1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/06eb8777-d059-4716-b47c-df3e6a027722" status: 200 len: 1314 microversion: 2.1 time: 0.731899 Oct 04 18:54:34.604165 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2766/5486] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:33 2022] GET /compute/v2.1/servers/06eb8777-d059-4716-b47c-df3e6a027722 => generated 1314 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:34.707896 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ed2f2470-2c90-4b25-afca-ddb48cf38680 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d749453f0b848738205a98fdd13ab64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399d0b659c18493493b399e9617f8500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:34.736380 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ed2f2470-2c90-4b25-afca-ddb48cf38680 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] 10.222.0.20 "GET /compute/v2.1/servers/fbe7c90b-7779-44b8-b43b-f01b223bcc0f" status: 200 len: 1223 microversion: 2.1 time: 0.326096 Oct 04 18:54:34.738515 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2721/5487] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:34 2022] GET /compute/v2.1/servers/fbe7c90b-7779-44b8-b43b-f01b223bcc0f => generated 1223 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:35.635492 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ecf69704-df3c-4e4b-a381-454c02bedab2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:35.636312 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ecf69704-df3c-4e4b-a381-454c02bedab2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 06eb8777-d059-4716-b47c-df3e6a027722] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:35.652017 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ecf69704-df3c-4e4b-a381-454c02bedab2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:35.652593 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ecf69704-df3c-4e4b-a381-454c02bedab2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:35.653045 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ecf69704-df3c-4e4b-a381-454c02bedab2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:35.653783 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ecf69704-df3c-4e4b-a381-454c02bedab2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:35.655826 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ecf69704-df3c-4e4b-a381-454c02bedab2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:35.656291 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ecf69704-df3c-4e4b-a381-454c02bedab2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:35.764697 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-947797fc-b2f3-4a01-8588-4016237f7df6 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:35.766060 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-947797fc-b2f3-4a01-8588-4016237f7df6 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] [instance: fbe7c90b-7779-44b8-b43b-f01b223bcc0f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:35.781824 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-947797fc-b2f3-4a01-8588-4016237f7df6 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:35.785105 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-947797fc-b2f3-4a01-8588-4016237f7df6 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:35.785558 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-947797fc-b2f3-4a01-8588-4016237f7df6 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:35.789524 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-947797fc-b2f3-4a01-8588-4016237f7df6 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:35.790238 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-947797fc-b2f3-4a01-8588-4016237f7df6 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:35.791075 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-947797fc-b2f3-4a01-8588-4016237f7df6 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:36.082635 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-947797fc-b2f3-4a01-8588-4016237f7df6 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d749453f0b848738205a98fdd13ab64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399d0b659c18493493b399e9617f8500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:36.113753 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-947797fc-b2f3-4a01-8588-4016237f7df6 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] 10.222.0.20 "GET /compute/v2.1/servers/fbe7c90b-7779-44b8-b43b-f01b223bcc0f" status: 200 len: 1275 microversion: 2.1 time: 0.351322 Oct 04 18:54:36.116225 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2722/5488] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:35 2022] GET /compute/v2.1/servers/fbe7c90b-7779-44b8-b43b-f01b223bcc0f => generated 1275 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:54:36.310463 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ecf69704-df3c-4e4b-a381-454c02bedab2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:36.337289 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ecf69704-df3c-4e4b-a381-454c02bedab2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/06eb8777-d059-4716-b47c-df3e6a027722" status: 200 len: 1314 microversion: 2.1 time: 0.705822 Oct 04 18:54:36.342248 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2767/5489] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:35 2022] GET /compute/v2.1/servers/06eb8777-d059-4716-b47c-df3e6a027722 => generated 1314 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:37.148561 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e87ee964-aab2-4465-ae9b-039ed3e406bf tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:37.149972 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e87ee964-aab2-4465-ae9b-039ed3e406bf tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] [instance: fbe7c90b-7779-44b8-b43b-f01b223bcc0f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:37.172688 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e87ee964-aab2-4465-ae9b-039ed3e406bf tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:37.173199 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e87ee964-aab2-4465-ae9b-039ed3e406bf tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:37.173664 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e87ee964-aab2-4465-ae9b-039ed3e406bf tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:37.174383 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e87ee964-aab2-4465-ae9b-039ed3e406bf tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:37.175557 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e87ee964-aab2-4465-ae9b-039ed3e406bf tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:37.188883 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e87ee964-aab2-4465-ae9b-039ed3e406bf tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:37.357059 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e87ee964-aab2-4465-ae9b-039ed3e406bf tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d749453f0b848738205a98fdd13ab64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399d0b659c18493493b399e9617f8500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:37.367590 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b7d7be2d-01cf-45cf-a154-570b65f796f5 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:37.368251 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b7d7be2d-01cf-45cf-a154-570b65f796f5 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 06eb8777-d059-4716-b47c-df3e6a027722] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:37.368794 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:54:37.374764 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e87ee964-aab2-4465-ae9b-039ed3e406bf tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] 10.222.0.20 "GET /compute/v2.1/servers/fbe7c90b-7779-44b8-b43b-f01b223bcc0f" status: 200 len: 1281 microversion: 2.1 time: 0.227893 Oct 04 18:54:37.385793 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b7d7be2d-01cf-45cf-a154-570b65f796f5 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:37.386826 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b7d7be2d-01cf-45cf-a154-570b65f796f5 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:37.387447 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b7d7be2d-01cf-45cf-a154-570b65f796f5 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:37.388366 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b7d7be2d-01cf-45cf-a154-570b65f796f5 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:37.396971 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2723/5490] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:37 2022] GET /compute/v2.1/servers/fbe7c90b-7779-44b8-b43b-f01b223bcc0f => generated 1281 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:37.397876 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b7d7be2d-01cf-45cf-a154-570b65f796f5 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:37.400154 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b7d7be2d-01cf-45cf-a154-570b65f796f5 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:37.694455 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b7d7be2d-01cf-45cf-a154-570b65f796f5 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:37.708711 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b7d7be2d-01cf-45cf-a154-570b65f796f5 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/06eb8777-d059-4716-b47c-df3e6a027722" status: 200 len: 1314 microversion: 2.1 time: 0.344234 Oct 04 18:54:37.725373 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2768/5491] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:37 2022] GET /compute/v2.1/servers/06eb8777-d059-4716-b47c-df3e6a027722 => generated 1314 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:38.404487 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-881d0862-3df3-4d76-9ffd-9c37e6808590 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:38.405311 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-881d0862-3df3-4d76-9ffd-9c37e6808590 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] [instance: fbe7c90b-7779-44b8-b43b-f01b223bcc0f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:38.420846 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-881d0862-3df3-4d76-9ffd-9c37e6808590 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:38.426740 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-881d0862-3df3-4d76-9ffd-9c37e6808590 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:38.426740 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-881d0862-3df3-4d76-9ffd-9c37e6808590 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:38.426740 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-881d0862-3df3-4d76-9ffd-9c37e6808590 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:38.426740 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-881d0862-3df3-4d76-9ffd-9c37e6808590 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:38.427187 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-881d0862-3df3-4d76-9ffd-9c37e6808590 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:38.748666 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-881d0862-3df3-4d76-9ffd-9c37e6808590 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d749453f0b848738205a98fdd13ab64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399d0b659c18493493b399e9617f8500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:38.750366 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-22049252-81bf-45b7-9169-7111ef1cf787 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:38.751147 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-22049252-81bf-45b7-9169-7111ef1cf787 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 06eb8777-d059-4716-b47c-df3e6a027722] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:38.761908 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-881d0862-3df3-4d76-9ffd-9c37e6808590 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] 10.222.0.20 "GET /compute/v2.1/servers/fbe7c90b-7779-44b8-b43b-f01b223bcc0f" status: 200 len: 1281 microversion: 2.1 time: 0.359043 Oct 04 18:54:38.764178 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2724/5492] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:38 2022] GET /compute/v2.1/servers/fbe7c90b-7779-44b8-b43b-f01b223bcc0f => generated 1281 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:38.782405 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-22049252-81bf-45b7-9169-7111ef1cf787 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:38.782915 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-22049252-81bf-45b7-9169-7111ef1cf787 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:38.787934 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-22049252-81bf-45b7-9169-7111ef1cf787 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:38.789269 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-22049252-81bf-45b7-9169-7111ef1cf787 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:38.789765 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-22049252-81bf-45b7-9169-7111ef1cf787 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:38.793566 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-22049252-81bf-45b7-9169-7111ef1cf787 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:38.803725 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:54:39.256000 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-22049252-81bf-45b7-9169-7111ef1cf787 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:39.265743 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-22049252-81bf-45b7-9169-7111ef1cf787 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/06eb8777-d059-4716-b47c-df3e6a027722" status: 200 len: 1314 microversion: 2.1 time: 0.520254 Oct 04 18:54:39.270133 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2769/5493] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:38 2022] GET /compute/v2.1/servers/06eb8777-d059-4716-b47c-df3e6a027722 => generated 1314 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:54:39.788641 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1645fead-869a-41ba-bf7a-e6f1ec3a6544 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:39.789694 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1645fead-869a-41ba-bf7a-e6f1ec3a6544 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] [instance: fbe7c90b-7779-44b8-b43b-f01b223bcc0f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:39.823100 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1645fead-869a-41ba-bf7a-e6f1ec3a6544 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:39.824885 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1645fead-869a-41ba-bf7a-e6f1ec3a6544 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:39.828761 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1645fead-869a-41ba-bf7a-e6f1ec3a6544 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:39.831970 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1645fead-869a-41ba-bf7a-e6f1ec3a6544 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:39.843879 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1645fead-869a-41ba-bf7a-e6f1ec3a6544 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:39.844695 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1645fead-869a-41ba-bf7a-e6f1ec3a6544 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:40.293894 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2f098d3e-2493-44cf-be13-fe58169aaba7 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:40.295146 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2f098d3e-2493-44cf-be13-fe58169aaba7 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 06eb8777-d059-4716-b47c-df3e6a027722] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:40.316592 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2f098d3e-2493-44cf-be13-fe58169aaba7 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:40.317367 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2f098d3e-2493-44cf-be13-fe58169aaba7 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:40.318008 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2f098d3e-2493-44cf-be13-fe58169aaba7 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:40.319262 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2f098d3e-2493-44cf-be13-fe58169aaba7 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:40.325336 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2f098d3e-2493-44cf-be13-fe58169aaba7 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:40.325336 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2f098d3e-2493-44cf-be13-fe58169aaba7 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:40.366599 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1645fead-869a-41ba-bf7a-e6f1ec3a6544 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d749453f0b848738205a98fdd13ab64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399d0b659c18493493b399e9617f8500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:40.374605 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1645fead-869a-41ba-bf7a-e6f1ec3a6544 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] 10.222.0.20 "GET /compute/v2.1/servers/fbe7c90b-7779-44b8-b43b-f01b223bcc0f" status: 200 len: 1323 microversion: 2.1 time: 0.591654 Oct 04 18:54:40.393605 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2725/5494] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:39 2022] GET /compute/v2.1/servers/fbe7c90b-7779-44b8-b43b-f01b223bcc0f => generated 1323 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:40.650360 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-2f098d3e-2493-44cf-be13-fe58169aaba7 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:40.663294 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2f098d3e-2493-44cf-be13-fe58169aaba7 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/06eb8777-d059-4716-b47c-df3e6a027722" status: 200 len: 1314 microversion: 2.1 time: 0.373978 Oct 04 18:54:40.666887 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2770/5495] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:40 2022] GET /compute/v2.1/servers/06eb8777-d059-4716-b47c-df3e6a027722 => generated 1314 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:54:41.400979 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c8360d42-e832-4dee-8c1f-c998504eed39 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:41.401595 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c8360d42-e832-4dee-8c1f-c998504eed39 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] [instance: fbe7c90b-7779-44b8-b43b-f01b223bcc0f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:41.412723 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c8360d42-e832-4dee-8c1f-c998504eed39 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:41.413221 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c8360d42-e832-4dee-8c1f-c998504eed39 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:41.422262 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c8360d42-e832-4dee-8c1f-c998504eed39 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:41.423259 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c8360d42-e832-4dee-8c1f-c998504eed39 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:41.423917 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c8360d42-e832-4dee-8c1f-c998504eed39 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:41.425223 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c8360d42-e832-4dee-8c1f-c998504eed39 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:41.687992 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f1229a4f-388b-44c9-8361-e976d78fffbd tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:41.688741 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f1229a4f-388b-44c9-8361-e976d78fffbd tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 06eb8777-d059-4716-b47c-df3e6a027722] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:41.710006 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f1229a4f-388b-44c9-8361-e976d78fffbd tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:41.712592 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f1229a4f-388b-44c9-8361-e976d78fffbd tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:41.714709 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f1229a4f-388b-44c9-8361-e976d78fffbd tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:41.717448 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f1229a4f-388b-44c9-8361-e976d78fffbd tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:41.719336 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f1229a4f-388b-44c9-8361-e976d78fffbd tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:41.723164 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f1229a4f-388b-44c9-8361-e976d78fffbd tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:42.159283 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c8360d42-e832-4dee-8c1f-c998504eed39 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d749453f0b848738205a98fdd13ab64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399d0b659c18493493b399e9617f8500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:42.169607 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c8360d42-e832-4dee-8c1f-c998504eed39 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] 10.222.0.20 "GET /compute/v2.1/servers/fbe7c90b-7779-44b8-b43b-f01b223bcc0f" status: 200 len: 1323 microversion: 2.1 time: 0.772562 Oct 04 18:54:42.176217 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2726/5496] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:41 2022] GET /compute/v2.1/servers/fbe7c90b-7779-44b8-b43b-f01b223bcc0f => generated 1323 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:42.186411 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-8e16a7c6-fdfb-4a6d-b427-665c4a697996 req-704dee5f-74f3-4ef9-be4b-825d57b84db7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06eb8777-d059-4716-b47c-df3e6a027722", "name": "network-vif-plugged", "status": "completed", "tag": "216b899c-9fe6-4911-a379-731b6d5dce0e"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:54:42.210440 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-8e16a7c6-fdfb-4a6d-b427-665c4a697996 req-704dee5f-74f3-4ef9-be4b-825d57b84db7 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:42.211431 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-8e16a7c6-fdfb-4a6d-b427-665c4a697996 req-704dee5f-74f3-4ef9-be4b-825d57b84db7 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:42.212101 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-8e16a7c6-fdfb-4a6d-b427-665c4a697996 req-704dee5f-74f3-4ef9-be4b-825d57b84db7 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:42.235856 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-8e16a7c6-fdfb-4a6d-b427-665c4a697996 req-704dee5f-74f3-4ef9-be4b-825d57b84db7 service nova] Creating event network-vif-plugged:216b899c-9fe6-4911-a379-731b6d5dce0e for instance 06eb8777-d059-4716-b47c-df3e6a027722 on n-h1-850501-14 Oct 04 18:54:42.243965 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-8e16a7c6-fdfb-4a6d-b427-665c4a697996 req-704dee5f-74f3-4ef9-be4b-825d57b84db7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065658 Oct 04 18:54:42.251732 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2727/5497] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:54:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:54:42.308794 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f1229a4f-388b-44c9-8361-e976d78fffbd tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:42.325027 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f1229a4f-388b-44c9-8361-e976d78fffbd tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/06eb8777-d059-4716-b47c-df3e6a027722" status: 200 len: 1314 microversion: 2.1 time: 0.639065 Oct 04 18:54:42.326191 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2771/5498] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:41 2022] GET /compute/v2.1/servers/06eb8777-d059-4716-b47c-df3e6a027722 => generated 1314 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:43.195128 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-a72d343f-52d8-4e3a-adb6-609d581b165a req-804a4f61-f53c-4b24-8a82-80d0ebb6428c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbe7c90b-7779-44b8-b43b-f01b223bcc0f", "tag": "6af48d98-45dd-4bc2-b618-e67783c0e02b"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:54:43.197953 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:54:43.198775 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=6 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:54:43.202896 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b24bdc95-0dfd-41ff-b7e7-a814721b2ce2 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:43.203522 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b24bdc95-0dfd-41ff-b7e7-a814721b2ce2 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] [instance: fbe7c90b-7779-44b8-b43b-f01b223bcc0f] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:43.233532 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b24bdc95-0dfd-41ff-b7e7-a814721b2ce2 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:43.234038 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b24bdc95-0dfd-41ff-b7e7-a814721b2ce2 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:43.234488 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b24bdc95-0dfd-41ff-b7e7-a814721b2ce2 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:43.235207 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b24bdc95-0dfd-41ff-b7e7-a814721b2ce2 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:43.235824 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b24bdc95-0dfd-41ff-b7e7-a814721b2ce2 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:43.236122 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b24bdc95-0dfd-41ff-b7e7-a814721b2ce2 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:43.243952 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-a72d343f-52d8-4e3a-adb6-609d581b165a req-804a4f61-f53c-4b24-8a82-80d0ebb6428c service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:43.251540 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-a72d343f-52d8-4e3a-adb6-609d581b165a req-804a4f61-f53c-4b24-8a82-80d0ebb6428c service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:43.255028 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-a72d343f-52d8-4e3a-adb6-609d581b165a req-804a4f61-f53c-4b24-8a82-80d0ebb6428c service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:43.285512 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-a72d343f-52d8-4e3a-adb6-609d581b165a req-804a4f61-f53c-4b24-8a82-80d0ebb6428c service nova] Creating event network-changed:6af48d98-45dd-4bc2-b618-e67783c0e02b for instance fbe7c90b-7779-44b8-b43b-f01b223bcc0f on n-h2-850501-14 Oct 04 18:54:43.305558 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-a72d343f-52d8-4e3a-adb6-609d581b165a req-804a4f61-f53c-4b24-8a82-80d0ebb6428c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117835 Oct 04 18:54:43.306180 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2728/5499] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:54:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:54:43.355850 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-873f31d4-959c-4db7-b42c-9e59852fe25b tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:43.357110 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-873f31d4-959c-4db7-b42c-9e59852fe25b tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 06eb8777-d059-4716-b47c-df3e6a027722] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:43.369124 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-873f31d4-959c-4db7-b42c-9e59852fe25b tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:43.370072 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-873f31d4-959c-4db7-b42c-9e59852fe25b tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:43.370912 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-873f31d4-959c-4db7-b42c-9e59852fe25b tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:43.372150 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-873f31d4-959c-4db7-b42c-9e59852fe25b tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:43.375591 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-873f31d4-959c-4db7-b42c-9e59852fe25b tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:43.375591 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-873f31d4-959c-4db7-b42c-9e59852fe25b tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:43.847594 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-873f31d4-959c-4db7-b42c-9e59852fe25b tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:43.866868 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-873f31d4-959c-4db7-b42c-9e59852fe25b tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/06eb8777-d059-4716-b47c-df3e6a027722" status: 200 len: 1314 microversion: 2.1 time: 0.515113 Oct 04 18:54:43.879591 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2729/5500] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:43 2022] GET /compute/v2.1/servers/06eb8777-d059-4716-b47c-df3e6a027722 => generated 1314 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:43.930161 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b24bdc95-0dfd-41ff-b7e7-a814721b2ce2 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d749453f0b848738205a98fdd13ab64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399d0b659c18493493b399e9617f8500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:43.961438 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b24bdc95-0dfd-41ff-b7e7-a814721b2ce2 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] 10.222.0.20 "GET /compute/v2.1/servers/fbe7c90b-7779-44b8-b43b-f01b223bcc0f" status: 200 len: 1323 microversion: 2.1 time: 0.764873 Oct 04 18:54:43.978692 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2772/5501] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:43 2022] GET /compute/v2.1/servers/fbe7c90b-7779-44b8-b43b-f01b223bcc0f => generated 1323 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:44.897799 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-84823d2e-526d-47e0-8078-bc4d40d55f24 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:44.898503 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-84823d2e-526d-47e0-8078-bc4d40d55f24 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 06eb8777-d059-4716-b47c-df3e6a027722] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:44.920927 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=4 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:54:44.930522 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-84823d2e-526d-47e0-8078-bc4d40d55f24 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:44.931486 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-84823d2e-526d-47e0-8078-bc4d40d55f24 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:44.932316 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-84823d2e-526d-47e0-8078-bc4d40d55f24 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:44.933989 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-84823d2e-526d-47e0-8078-bc4d40d55f24 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:44.934913 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-84823d2e-526d-47e0-8078-bc4d40d55f24 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:44.935670 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-84823d2e-526d-47e0-8078-bc4d40d55f24 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:44.989866 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-26b88dd9-462e-49ef-a328-f0838df9142e tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:44.991507 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-26b88dd9-462e-49ef-a328-f0838df9142e tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] [instance: fbe7c90b-7779-44b8-b43b-f01b223bcc0f] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:45.002974 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-26b88dd9-462e-49ef-a328-f0838df9142e tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:45.012139 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-26b88dd9-462e-49ef-a328-f0838df9142e tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:45.016267 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-26b88dd9-462e-49ef-a328-f0838df9142e tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:45.017584 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-26b88dd9-462e-49ef-a328-f0838df9142e tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:45.018837 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-26b88dd9-462e-49ef-a328-f0838df9142e tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:45.021399 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-26b88dd9-462e-49ef-a328-f0838df9142e tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:45.387296 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-84823d2e-526d-47e0-8078-bc4d40d55f24 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:45.411901 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-84823d2e-526d-47e0-8078-bc4d40d55f24 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/06eb8777-d059-4716-b47c-df3e6a027722" status: 200 len: 1501 microversion: 2.1 time: 0.512118 Oct 04 18:54:45.414662 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2730/5502] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:44 2022] GET /compute/v2.1/servers/06eb8777-d059-4716-b47c-df3e6a027722 => generated 1501 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:45.442172 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9eed7866-c818-4d53-b0fe-2eea7c4382c5 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:54:45.443590 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9eed7866-c818-4d53-b0fe-2eea7c4382c5 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 06eb8777-d059-4716-b47c-df3e6a027722] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:45.457709 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9eed7866-c818-4d53-b0fe-2eea7c4382c5 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:45.459748 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9eed7866-c818-4d53-b0fe-2eea7c4382c5 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:45.464266 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9eed7866-c818-4d53-b0fe-2eea7c4382c5 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:45.465309 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9eed7866-c818-4d53-b0fe-2eea7c4382c5 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:45.468780 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9eed7866-c818-4d53-b0fe-2eea7c4382c5 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:45.469559 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9eed7866-c818-4d53-b0fe-2eea7c4382c5 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:45.589566 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-26b88dd9-462e-49ef-a328-f0838df9142e tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d749453f0b848738205a98fdd13ab64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399d0b659c18493493b399e9617f8500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:45.606329 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-26b88dd9-462e-49ef-a328-f0838df9142e tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] 10.222.0.20 "GET /compute/v2.1/servers/fbe7c90b-7779-44b8-b43b-f01b223bcc0f" status: 200 len: 1323 microversion: 2.1 time: 0.620857 Oct 04 18:54:45.606935 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2773/5503] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:44 2022] GET /compute/v2.1/servers/fbe7c90b-7779-44b8-b43b-f01b223bcc0f => generated 1323 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:54:45.994295 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.network.security_group_api [None req-9eed7866-c818-4d53-b0fe-2eea7c4382c5 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Removing security group 803c2149-d44c-4053-a1be-67f2bdff092c from port 216b899c-9fe6-4911-a379-731b6d5dce0e Oct 04 18:54:46.636604 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-bf2e96c0-a446-4a14-914b-32ce16f8c4ae tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:46.637243 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-bf2e96c0-a446-4a14-914b-32ce16f8c4ae tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] [instance: fbe7c90b-7779-44b8-b43b-f01b223bcc0f] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:46.645410 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bf2e96c0-a446-4a14-914b-32ce16f8c4ae tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:46.645920 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bf2e96c0-a446-4a14-914b-32ce16f8c4ae tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:46.646372 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bf2e96c0-a446-4a14-914b-32ce16f8c4ae tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:46.647125 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bf2e96c0-a446-4a14-914b-32ce16f8c4ae tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:46.647610 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bf2e96c0-a446-4a14-914b-32ce16f8c4ae tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:46.648138 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bf2e96c0-a446-4a14-914b-32ce16f8c4ae tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:46.749573 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9eed7866-c818-4d53-b0fe-2eea7c4382c5 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "POST /compute/v2.1/servers/06eb8777-d059-4716-b47c-df3e6a027722/action" status: 202 len: 0 microversion: 2.1 time: 1.312684 Oct 04 18:54:46.754332 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2731/5504] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:54:45 2022] POST /compute/v2.1/servers/06eb8777-d059-4716-b47c-df3e6a027722/action => generated 0 bytes in 1314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:54:46.759942 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7c3f2e4b-9780-45dc-b153-4c9ab919b3ed tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:46.760602 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7c3f2e4b-9780-45dc-b153-4c9ab919b3ed tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 06eb8777-d059-4716-b47c-df3e6a027722] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:46.769770 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c3f2e4b-9780-45dc-b153-4c9ab919b3ed tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:46.770280 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c3f2e4b-9780-45dc-b153-4c9ab919b3ed tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:46.770729 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c3f2e4b-9780-45dc-b153-4c9ab919b3ed tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:46.771449 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c3f2e4b-9780-45dc-b153-4c9ab919b3ed tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:46.784297 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c3f2e4b-9780-45dc-b153-4c9ab919b3ed tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:46.785210 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c3f2e4b-9780-45dc-b153-4c9ab919b3ed tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:46.956894 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7c3f2e4b-9780-45dc-b153-4c9ab919b3ed tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:46.972809 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7c3f2e4b-9780-45dc-b153-4c9ab919b3ed tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/06eb8777-d059-4716-b47c-df3e6a027722" status: 200 len: 1459 microversion: 2.1 time: 0.216624 Oct 04 18:54:46.973754 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2732/5505] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:46 2022] GET /compute/v2.1/servers/06eb8777-d059-4716-b47c-df3e6a027722 => generated 1459 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:54:46.979976 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-a0c36433-fd20-4ab8-b581-c186b60dd4b9 req-8e59a627-c276-4b42-bb9d-6c5c3ce8b4f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06eb8777-d059-4716-b47c-df3e6a027722", "tag": "216b899c-9fe6-4911-a379-731b6d5dce0e"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:54:47.021979 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-a0c36433-fd20-4ab8-b581-c186b60dd4b9 req-8e59a627-c276-4b42-bb9d-6c5c3ce8b4f0 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:47.022609 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-a0c36433-fd20-4ab8-b581-c186b60dd4b9 req-8e59a627-c276-4b42-bb9d-6c5c3ce8b4f0 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:47.027176 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-a0c36433-fd20-4ab8-b581-c186b60dd4b9 req-8e59a627-c276-4b42-bb9d-6c5c3ce8b4f0 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:47.043286 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-a0c36433-fd20-4ab8-b581-c186b60dd4b9 req-8e59a627-c276-4b42-bb9d-6c5c3ce8b4f0 service nova] Creating event network-changed:216b899c-9fe6-4911-a379-731b6d5dce0e for instance 06eb8777-d059-4716-b47c-df3e6a027722 on n-h1-850501-14 Oct 04 18:54:47.049746 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-a0c36433-fd20-4ab8-b581-c186b60dd4b9 req-8e59a627-c276-4b42-bb9d-6c5c3ce8b4f0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073910 Oct 04 18:54:47.056924 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2733/5506] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:54:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:54:47.057667 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4d71d36a-93a2-4298-92ea-8ca5bd78a8d2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:47.058322 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4d71d36a-93a2-4298-92ea-8ca5bd78a8d2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:47.066086 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4d71d36a-93a2-4298-92ea-8ca5bd78a8d2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:47.066905 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4d71d36a-93a2-4298-92ea-8ca5bd78a8d2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:47.067544 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4d71d36a-93a2-4298-92ea-8ca5bd78a8d2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:47.068732 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4d71d36a-93a2-4298-92ea-8ca5bd78a8d2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:47.069530 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4d71d36a-93a2-4298-92ea-8ca5bd78a8d2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:47.069962 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4d71d36a-93a2-4298-92ea-8ca5bd78a8d2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:47.072763 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-bf2e96c0-a446-4a14-914b-32ce16f8c4ae tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d749453f0b848738205a98fdd13ab64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399d0b659c18493493b399e9617f8500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:47.083092 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-bf2e96c0-a446-4a14-914b-32ce16f8c4ae tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] 10.222.0.20 "GET /compute/v2.1/servers/fbe7c90b-7779-44b8-b43b-f01b223bcc0f" status: 200 len: 1323 microversion: 2.1 time: 0.451305 Oct 04 18:54:47.087947 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2774/5507] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:46 2022] GET /compute/v2.1/servers/fbe7c90b-7779-44b8-b43b-f01b223bcc0f => generated 1323 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:54:47.480243 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4d71d36a-93a2-4298-92ea-8ca5bd78a8d2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:47.488398 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4d71d36a-93a2-4298-92ea-8ca5bd78a8d2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1672 microversion: 2.1 time: 0.435783 Oct 04 18:54:47.489304 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2734/5508] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:47 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1672 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:47.517032 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e1750890-90b4-47ba-a786-25c92a15d55f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:47.517686 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e1750890-90b4-47ba-a786-25c92a15d55f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:47.532808 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e1750890-90b4-47ba-a786-25c92a15d55f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:47.534797 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e1750890-90b4-47ba-a786-25c92a15d55f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:47.536304 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e1750890-90b4-47ba-a786-25c92a15d55f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:47.541358 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e1750890-90b4-47ba-a786-25c92a15d55f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:47.542665 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e1750890-90b4-47ba-a786-25c92a15d55f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:47.543473 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e1750890-90b4-47ba-a786-25c92a15d55f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:47.865416 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e1750890-90b4-47ba-a786-25c92a15d55f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:47.887375 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e1750890-90b4-47ba-a786-25c92a15d55f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1672 microversion: 2.1 time: 0.374416 Oct 04 18:54:47.907218 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2775/5509] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:47 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1672 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:47.924827 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-13896452-1caf-4e92-916e-d20949b598cb tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:47.925471 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-13896452-1caf-4e92-916e-d20949b598cb tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:47.945296 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-13896452-1caf-4e92-916e-d20949b598cb tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:47.946190 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-13896452-1caf-4e92-916e-d20949b598cb tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:47.946833 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-13896452-1caf-4e92-916e-d20949b598cb tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:47.947734 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-13896452-1caf-4e92-916e-d20949b598cb tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:47.949019 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-13896452-1caf-4e92-916e-d20949b598cb tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:47.949665 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-13896452-1caf-4e92-916e-d20949b598cb tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:48.117565 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-07c820fa-915b-4f55-85da-b67ec9035300 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:48.120800 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-07c820fa-915b-4f55-85da-b67ec9035300 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] [instance: fbe7c90b-7779-44b8-b43b-f01b223bcc0f] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:48.133824 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-07c820fa-915b-4f55-85da-b67ec9035300 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:48.134815 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-07c820fa-915b-4f55-85da-b67ec9035300 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:48.135511 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-07c820fa-915b-4f55-85da-b67ec9035300 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:48.136801 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-07c820fa-915b-4f55-85da-b67ec9035300 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:48.137501 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-07c820fa-915b-4f55-85da-b67ec9035300 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:48.138160 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-07c820fa-915b-4f55-85da-b67ec9035300 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:48.475218 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-13896452-1caf-4e92-916e-d20949b598cb tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:48.480884 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-07c820fa-915b-4f55-85da-b67ec9035300 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d749453f0b848738205a98fdd13ab64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399d0b659c18493493b399e9617f8500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:48.488995 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-13896452-1caf-4e92-916e-d20949b598cb tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1672 microversion: 2.1 time: 0.571321 Oct 04 18:54:48.489209 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-07c820fa-915b-4f55-85da-b67ec9035300 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] 10.222.0.20 "GET /compute/v2.1/servers/fbe7c90b-7779-44b8-b43b-f01b223bcc0f" status: 200 len: 1323 microversion: 2.1 time: 0.377775 Oct 04 18:54:48.493513 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2735/5510] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:47 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1672 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:48.501231 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2776/5511] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:48 2022] GET /compute/v2.1/servers/fbe7c90b-7779-44b8-b43b-f01b223bcc0f => generated 1323 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:54:48.516670 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f0b55c9b-4716-452f-9294-7755897f38dd tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:48.518566 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f0b55c9b-4716-452f-9294-7755897f38dd tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:48.526923 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f0b55c9b-4716-452f-9294-7755897f38dd tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:48.527417 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f0b55c9b-4716-452f-9294-7755897f38dd tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:48.527851 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f0b55c9b-4716-452f-9294-7755897f38dd tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:48.528658 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f0b55c9b-4716-452f-9294-7755897f38dd tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:48.529285 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f0b55c9b-4716-452f-9294-7755897f38dd tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:48.529708 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f0b55c9b-4716-452f-9294-7755897f38dd tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:48.681516 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f0b55c9b-4716-452f-9294-7755897f38dd tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:48.694268 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f0b55c9b-4716-452f-9294-7755897f38dd tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1672 microversion: 2.1 time: 0.184033 Oct 04 18:54:48.694866 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2736/5512] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:48 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1672 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:48.835928 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7445bb7d-d944-402d-9dff-abcc41671289 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2015516868", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": [{"uuid": "5739801d-d64f-45ac-b67b-5773a9d23794"}]}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:54:48.849774 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:54:48.897461 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.neutron [None req-7445bb7d-d944-402d-9dff-abcc41671289 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] validate_networks() for [('5739801d-d64f-45ac-b67b-5773a9d23794', None, None, None, None, None)] {{(pid=123001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:54:49.504261 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-7445bb7d-d944-402d-9dff-abcc41671289 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:54:49.504897 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-7445bb7d-d944-402d-9dff-abcc41671289 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:54:49.505560 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-7445bb7d-d944-402d-9dff-abcc41671289 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:54:49.505982 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-7445bb7d-d944-402d-9dff-abcc41671289 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:54:49.506399 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-7445bb7d-d944-402d-9dff-abcc41671289 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:54:49.513773 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5655fbc8-57a8-4838-9bf0-ce66a8aa4c6a tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:49.514492 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5655fbc8-57a8-4838-9bf0-ce66a8aa4c6a tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] [instance: fbe7c90b-7779-44b8-b43b-f01b223bcc0f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:49.523052 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5655fbc8-57a8-4838-9bf0-ce66a8aa4c6a tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:49.524264 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5655fbc8-57a8-4838-9bf0-ce66a8aa4c6a tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:49.525618 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7445bb7d-d944-402d-9dff-abcc41671289 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:49.526303 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7445bb7d-d944-402d-9dff-abcc41671289 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:49.526530 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7445bb7d-d944-402d-9dff-abcc41671289 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:49.527652 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7445bb7d-d944-402d-9dff-abcc41671289 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:49.528033 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5655fbc8-57a8-4838-9bf0-ce66a8aa4c6a tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:49.530287 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7445bb7d-d944-402d-9dff-abcc41671289 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:49.530287 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7445bb7d-d944-402d-9dff-abcc41671289 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:49.530513 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5655fbc8-57a8-4838-9bf0-ce66a8aa4c6a tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:49.530513 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5655fbc8-57a8-4838-9bf0-ce66a8aa4c6a tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:49.531413 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5655fbc8-57a8-4838-9bf0-ce66a8aa4c6a tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:49.593255 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-7445bb7d-d944-402d-9dff-abcc41671289 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Getting quotas for project 57d8fd392d5b4e8798cb51fe0e54ad3b. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:54:49.605904 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-7445bb7d-d944-402d-9dff-abcc41671289 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Getting quotas for user ee7fee2b098d4eb8bdc8df2a929cdede and project 57d8fd392d5b4e8798cb51fe0e54ad3b. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:54:49.637887 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7445bb7d-d944-402d-9dff-abcc41671289 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Going to run 1 instances... {{(pid=123001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:54:49.640403 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7445bb7d-d944-402d-9dff-abcc41671289 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 202dbed8-c7d0-46a7-aca4-1ff1d9122d8f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:54:49.762825 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5655fbc8-57a8-4838-9bf0-ce66a8aa4c6a tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d749453f0b848738205a98fdd13ab64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399d0b659c18493493b399e9617f8500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:49.772228 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5655fbc8-57a8-4838-9bf0-ce66a8aa4c6a tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] 10.222.0.20 "GET /compute/v2.1/servers/fbe7c90b-7779-44b8-b43b-f01b223bcc0f" status: 200 len: 1323 microversion: 2.1 time: 0.262304 Oct 04 18:54:49.773161 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2737/5513] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:49 2022] GET /compute/v2.1/servers/fbe7c90b-7779-44b8-b43b-f01b223bcc0f => generated 1323 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:54:49.832749 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7445bb7d-d944-402d-9dff-abcc41671289 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.993988 Oct 04 18:54:49.833482 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2777/5514] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:54:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1004 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:54:49.847439 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-534865b8-3595-4e8b-9ed9-f851fe5b3b11 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:49.848374 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-534865b8-3595-4e8b-9ed9-f851fe5b3b11 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 202dbed8-c7d0-46a7-aca4-1ff1d9122d8f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:49.979345 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-534865b8-3595-4e8b-9ed9-f851fe5b3b11 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:50.000034 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-534865b8-3595-4e8b-9ed9-f851fe5b3b11 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/202dbed8-c7d0-46a7-aca4-1ff1d9122d8f" status: 200 len: 1215 microversion: 2.1 time: 0.153308 Oct 04 18:54:50.001818 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2738/5515] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:49 2022] GET /compute/v2.1/servers/202dbed8-c7d0-46a7-aca4-1ff1d9122d8f => generated 1215 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:50.798110 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-17884817-89a0-4de1-9fa5-38d09406d840 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:50.799395 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-17884817-89a0-4de1-9fa5-38d09406d840 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] [instance: fbe7c90b-7779-44b8-b43b-f01b223bcc0f] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:50.815548 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-17884817-89a0-4de1-9fa5-38d09406d840 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:50.816645 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-17884817-89a0-4de1-9fa5-38d09406d840 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:50.829853 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-17884817-89a0-4de1-9fa5-38d09406d840 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:50.833147 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-17884817-89a0-4de1-9fa5-38d09406d840 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:50.836457 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-17884817-89a0-4de1-9fa5-38d09406d840 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:50.837169 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-17884817-89a0-4de1-9fa5-38d09406d840 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:51.028952 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f6c4ca4d-5f1d-4906-b0e0-12aa403fa4fd tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:51.029583 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f6c4ca4d-5f1d-4906-b0e0-12aa403fa4fd tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 202dbed8-c7d0-46a7-aca4-1ff1d9122d8f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:51.834061 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f6c4ca4d-5f1d-4906-b0e0-12aa403fa4fd tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:51.846395 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f6c4ca4d-5f1d-4906-b0e0-12aa403fa4fd tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/202dbed8-c7d0-46a7-aca4-1ff1d9122d8f" status: 200 len: 1215 microversion: 2.1 time: 0.821192 Oct 04 18:54:51.850722 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2739/5516] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:51 2022] GET /compute/v2.1/servers/202dbed8-c7d0-46a7-aca4-1ff1d9122d8f => generated 1215 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:52.069768 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-17884817-89a0-4de1-9fa5-38d09406d840 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d749453f0b848738205a98fdd13ab64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399d0b659c18493493b399e9617f8500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:52.083789 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-17884817-89a0-4de1-9fa5-38d09406d840 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] 10.222.0.20 "GET /compute/v2.1/servers/fbe7c90b-7779-44b8-b43b-f01b223bcc0f" status: 200 len: 1323 microversion: 2.1 time: 1.290349 Oct 04 18:54:52.092711 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2778/5517] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:50 2022] GET /compute/v2.1/servers/fbe7c90b-7779-44b8-b43b-f01b223bcc0f => generated 1323 bytes in 1300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:52.876116 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-794fa43e-203e-48a7-8ed3-eeaa660e02e0 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:52.880324 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-794fa43e-203e-48a7-8ed3-eeaa660e02e0 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 202dbed8-c7d0-46a7-aca4-1ff1d9122d8f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:52.906317 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-794fa43e-203e-48a7-8ed3-eeaa660e02e0 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:52.907126 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-794fa43e-203e-48a7-8ed3-eeaa660e02e0 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:52.909944 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-794fa43e-203e-48a7-8ed3-eeaa660e02e0 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:52.913975 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-794fa43e-203e-48a7-8ed3-eeaa660e02e0 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:52.913975 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-794fa43e-203e-48a7-8ed3-eeaa660e02e0 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:52.916953 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-794fa43e-203e-48a7-8ed3-eeaa660e02e0 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:53.112645 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-75f57501-4377-4c88-a12f-2b93ddbd4fd2 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:53.115705 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-75f57501-4377-4c88-a12f-2b93ddbd4fd2 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] [instance: fbe7c90b-7779-44b8-b43b-f01b223bcc0f] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:53.135080 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-75f57501-4377-4c88-a12f-2b93ddbd4fd2 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:53.141228 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-75f57501-4377-4c88-a12f-2b93ddbd4fd2 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:53.143124 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-75f57501-4377-4c88-a12f-2b93ddbd4fd2 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:53.148209 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-75f57501-4377-4c88-a12f-2b93ddbd4fd2 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:53.148967 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-75f57501-4377-4c88-a12f-2b93ddbd4fd2 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:53.150528 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-75f57501-4377-4c88-a12f-2b93ddbd4fd2 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:53.204366 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-794fa43e-203e-48a7-8ed3-eeaa660e02e0 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:53.222314 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-794fa43e-203e-48a7-8ed3-eeaa660e02e0 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/202dbed8-c7d0-46a7-aca4-1ff1d9122d8f" status: 200 len: 1267 microversion: 2.1 time: 0.351167 Oct 04 18:54:53.224762 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2740/5518] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:52 2022] GET /compute/v2.1/servers/202dbed8-c7d0-46a7-aca4-1ff1d9122d8f => generated 1267 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:54.175064 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-75f57501-4377-4c88-a12f-2b93ddbd4fd2 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d749453f0b848738205a98fdd13ab64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399d0b659c18493493b399e9617f8500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:54.183854 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-75f57501-4377-4c88-a12f-2b93ddbd4fd2 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] 10.222.0.20 "GET /compute/v2.1/servers/fbe7c90b-7779-44b8-b43b-f01b223bcc0f" status: 200 len: 1323 microversion: 2.1 time: 1.078462 Oct 04 18:54:54.187707 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2779/5519] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:53 2022] GET /compute/v2.1/servers/fbe7c90b-7779-44b8-b43b-f01b223bcc0f => generated 1323 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:54.250443 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3a07ec5d-2254-4312-8555-eb5da151f06a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:54.251237 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3a07ec5d-2254-4312-8555-eb5da151f06a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 202dbed8-c7d0-46a7-aca4-1ff1d9122d8f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:54.271096 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3a07ec5d-2254-4312-8555-eb5da151f06a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:54.275888 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3a07ec5d-2254-4312-8555-eb5da151f06a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:54.275888 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3a07ec5d-2254-4312-8555-eb5da151f06a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:54.279132 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3a07ec5d-2254-4312-8555-eb5da151f06a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:54.291308 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3a07ec5d-2254-4312-8555-eb5da151f06a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:54.291924 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3a07ec5d-2254-4312-8555-eb5da151f06a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:54.477914 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3a07ec5d-2254-4312-8555-eb5da151f06a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:54.489460 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3a07ec5d-2254-4312-8555-eb5da151f06a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/202dbed8-c7d0-46a7-aca4-1ff1d9122d8f" status: 200 len: 1273 microversion: 2.1 time: 0.244344 Oct 04 18:54:54.491498 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2741/5520] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:54 2022] GET /compute/v2.1/servers/202dbed8-c7d0-46a7-aca4-1ff1d9122d8f => generated 1273 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:54.778995 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-d6660f56-da01-4ffb-b60d-0f1efc5e5d7a req-b09b8b6d-5cbb-42c9-8ed1-4c3f607c2e1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbe7c90b-7779-44b8-b43b-f01b223bcc0f", "name": "network-vif-plugged", "status": "completed", "tag": "6af48d98-45dd-4bc2-b618-e67783c0e02b"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:54:54.792376 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-d6660f56-da01-4ffb-b60d-0f1efc5e5d7a req-b09b8b6d-5cbb-42c9-8ed1-4c3f607c2e1c service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:54.808412 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-d6660f56-da01-4ffb-b60d-0f1efc5e5d7a req-b09b8b6d-5cbb-42c9-8ed1-4c3f607c2e1c service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:54.809213 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-d6660f56-da01-4ffb-b60d-0f1efc5e5d7a req-b09b8b6d-5cbb-42c9-8ed1-4c3f607c2e1c service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:54.827418 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-d6660f56-da01-4ffb-b60d-0f1efc5e5d7a req-b09b8b6d-5cbb-42c9-8ed1-4c3f607c2e1c service nova] Creating event network-vif-plugged:6af48d98-45dd-4bc2-b618-e67783c0e02b for instance fbe7c90b-7779-44b8-b43b-f01b223bcc0f on n-h2-850501-14 Oct 04 18:54:54.846613 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-d6660f56-da01-4ffb-b60d-0f1efc5e5d7a req-b09b8b6d-5cbb-42c9-8ed1-4c3f607c2e1c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070619 Oct 04 18:54:54.847346 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2780/5521] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:54:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:54:55.171311 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-494e6124-e514-482d-be99-a290ad797cc1 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-493979916", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": [{"uuid": "4dfcc586-ebb4-4495-b804-effea4f66054"}]}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:54:55.210916 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-66c74e5c-f027-4456-87f9-e2ddb861db73 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:55.212192 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-66c74e5c-f027-4456-87f9-e2ddb861db73 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] [instance: fbe7c90b-7779-44b8-b43b-f01b223bcc0f] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:55.224153 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-66c74e5c-f027-4456-87f9-e2ddb861db73 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:55.228356 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-66c74e5c-f027-4456-87f9-e2ddb861db73 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:55.231865 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-66c74e5c-f027-4456-87f9-e2ddb861db73 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:55.233040 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-66c74e5c-f027-4456-87f9-e2ddb861db73 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:55.233674 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-66c74e5c-f027-4456-87f9-e2ddb861db73 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:55.244619 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-66c74e5c-f027-4456-87f9-e2ddb861db73 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:55.262220 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-494e6124-e514-482d-be99-a290ad797cc1 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] validate_networks() for [('4dfcc586-ebb4-4495-b804-effea4f66054', None, None, None, None, None)] {{(pid=123002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:54:55.819447 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-66c74e5c-f027-4456-87f9-e2ddb861db73 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d749453f0b848738205a98fdd13ab64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399d0b659c18493493b399e9617f8500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:55.827667 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-66c74e5c-f027-4456-87f9-e2ddb861db73 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] 10.222.0.20 "GET /compute/v2.1/servers/fbe7c90b-7779-44b8-b43b-f01b223bcc0f" status: 200 len: 1323 microversion: 2.1 time: 0.621630 Oct 04 18:54:55.828705 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2781/5522] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:55 2022] GET /compute/v2.1/servers/fbe7c90b-7779-44b8-b43b-f01b223bcc0f => generated 1323 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:55.856383 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c61fcf73-a217-483c-85eb-52efb6cc53d5 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:55.857727 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c61fcf73-a217-483c-85eb-52efb6cc53d5 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 202dbed8-c7d0-46a7-aca4-1ff1d9122d8f] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:55.871329 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c61fcf73-a217-483c-85eb-52efb6cc53d5 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:55.872532 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c61fcf73-a217-483c-85eb-52efb6cc53d5 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:55.872982 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c61fcf73-a217-483c-85eb-52efb6cc53d5 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:55.874267 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c61fcf73-a217-483c-85eb-52efb6cc53d5 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:55.875198 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c61fcf73-a217-483c-85eb-52efb6cc53d5 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:55.876568 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c61fcf73-a217-483c-85eb-52efb6cc53d5 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:56.049711 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c61fcf73-a217-483c-85eb-52efb6cc53d5 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:56.122428 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c61fcf73-a217-483c-85eb-52efb6cc53d5 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/202dbed8-c7d0-46a7-aca4-1ff1d9122d8f" status: 200 len: 1273 microversion: 2.1 time: 0.229415 Oct 04 18:54:56.122428 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2782/5523] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:55 2022] GET /compute/v2.1/servers/202dbed8-c7d0-46a7-aca4-1ff1d9122d8f => generated 1273 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:56.866387 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5496b3fc-bd22-4b35-a94e-41300f063641 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:56.870366 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5496b3fc-bd22-4b35-a94e-41300f063641 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] [instance: fbe7c90b-7779-44b8-b43b-f01b223bcc0f] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:56.898534 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5496b3fc-bd22-4b35-a94e-41300f063641 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:56.907354 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5496b3fc-bd22-4b35-a94e-41300f063641 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:56.907354 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5496b3fc-bd22-4b35-a94e-41300f063641 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:56.907354 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5496b3fc-bd22-4b35-a94e-41300f063641 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:56.907354 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5496b3fc-bd22-4b35-a94e-41300f063641 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:56.909739 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5496b3fc-bd22-4b35-a94e-41300f063641 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:57.002333 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-494e6124-e514-482d-be99-a290ad797cc1 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:54:57.003547 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-494e6124-e514-482d-be99-a290ad797cc1 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:54:57.004339 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-494e6124-e514-482d-be99-a290ad797cc1 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:54:57.005323 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-494e6124-e514-482d-be99-a290ad797cc1 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:54:57.006333 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-494e6124-e514-482d-be99-a290ad797cc1 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:54:57.035045 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-494e6124-e514-482d-be99-a290ad797cc1 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:57.040640 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-494e6124-e514-482d-be99-a290ad797cc1 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:57.041862 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-494e6124-e514-482d-be99-a290ad797cc1 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:57.043005 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-494e6124-e514-482d-be99-a290ad797cc1 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:57.044242 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-494e6124-e514-482d-be99-a290ad797cc1 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:57.045055 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-494e6124-e514-482d-be99-a290ad797cc1 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:57.092317 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-494e6124-e514-482d-be99-a290ad797cc1 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Getting quotas for project 2f2264ab7b874626a0e161fe1a8eee1f. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:54:57.102985 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-494e6124-e514-482d-be99-a290ad797cc1 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Getting quotas for user d422967752f94b3abd31a1c24976655c and project 2f2264ab7b874626a0e161fe1a8eee1f. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:54:57.145748 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-494e6124-e514-482d-be99-a290ad797cc1 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Going to run 1 instances... {{(pid=123002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:54:57.155386 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-494e6124-e514-482d-be99-a290ad797cc1 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] [instance: a889cd84-d30c-4a3e-95d0-fffe787ba0fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:54:57.351215 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-494e6124-e514-482d-be99-a290ad797cc1 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.443841 Oct 04 18:54:57.352980 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2742/5524] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:54:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 2446 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:54:57.358990 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-021a2563-1529-4c00-bf2b-b2bc5e13e12e tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:57.360514 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-021a2563-1529-4c00-bf2b-b2bc5e13e12e tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 202dbed8-c7d0-46a7-aca4-1ff1d9122d8f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:57.370939 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-021a2563-1529-4c00-bf2b-b2bc5e13e12e tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:57.372789 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-021a2563-1529-4c00-bf2b-b2bc5e13e12e tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:57.373713 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-021a2563-1529-4c00-bf2b-b2bc5e13e12e tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:57.375211 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-021a2563-1529-4c00-bf2b-b2bc5e13e12e tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:57.375944 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-021a2563-1529-4c00-bf2b-b2bc5e13e12e tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:57.377787 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-021a2563-1529-4c00-bf2b-b2bc5e13e12e tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:57.727860 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5496b3fc-bd22-4b35-a94e-41300f063641 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d749453f0b848738205a98fdd13ab64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399d0b659c18493493b399e9617f8500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:57.737963 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5496b3fc-bd22-4b35-a94e-41300f063641 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] 10.222.0.20 "GET /compute/v2.1/servers/fbe7c90b-7779-44b8-b43b-f01b223bcc0f" status: 200 len: 1518 microversion: 2.1 time: 0.879062 Oct 04 18:54:57.739033 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2783/5525] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:56 2022] GET /compute/v2.1/servers/fbe7c90b-7779-44b8-b43b-f01b223bcc0f => generated 1518 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:57.763500 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a39687a2-8e61-4de5-a739-7be0143d445b tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:57.772780 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a39687a2-8e61-4de5-a739-7be0143d445b tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] [instance: a889cd84-d30c-4a3e-95d0-fffe787ba0fc] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:57.951673 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a39687a2-8e61-4de5-a739-7be0143d445b tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd422967752f94b3abd31a1c24976655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2264ab7b874626a0e161fe1a8eee1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:57.968194 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a39687a2-8e61-4de5-a739-7be0143d445b tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] 10.222.0.20 "GET /compute/v2.1/servers/a889cd84-d30c-4a3e-95d0-fffe787ba0fc" status: 200 len: 1224 microversion: 2.1 time: 0.206480 Oct 04 18:54:57.968194 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2784/5526] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:57 2022] GET /compute/v2.1/servers/a889cd84-d30c-4a3e-95d0-fffe787ba0fc => generated 1224 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:58.117105 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-021a2563-1529-4c00-bf2b-b2bc5e13e12e tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:58.134143 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-021a2563-1529-4c00-bf2b-b2bc5e13e12e tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/202dbed8-c7d0-46a7-aca4-1ff1d9122d8f" status: 200 len: 1315 microversion: 2.1 time: 0.777667 Oct 04 18:54:58.134786 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2743/5527] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:57 2022] GET /compute/v2.1/servers/202dbed8-c7d0-46a7-aca4-1ff1d9122d8f => generated 1315 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:58.175670 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a4ac6c39-7f68-4c2c-95ce-ddc0d2a0ee81 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1002733049", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "d2b4b2bb-5916-444d-9710-bee1c3406654"}]}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:54:58.181667 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a4ac6c39-7f68-4c2c-95ce-ddc0d2a0ee81 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Request method failure captured: Oct 04 18:54:58.181667 n-d-850501-14 devstack@n-api.service[123001]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:54:58.181667 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:54:58.181667 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:54:58.181667 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:54:58.181667 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 243 Oct 04 18:54:58.181667 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:54:58.181667 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:54:58.181667 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:54:58.181667 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:54:58.181667 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPIFllRv8RaZ3t7hW2szLBIerMsXt6bvsi5yAZAld9zB6iDu6QazY85yfqcMy52lk3UwEsuIM2EOavxfe-KR7c8ANkiq6kKiYtFhfXk7yyhsRMjABSeIz7uxJBSc73RAizU3KdiuztO4V88ptPht8-uREqqgYv4KBGNari7UtWh1baJ4 Oct 04 18:54:58.181667 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:54:58.181667 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:54:58.181667 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:54:58.181667 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:54:58.181667 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:54:58.181667 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:54:58.181667 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 399d0b659c18493493b399e9617f8500 Oct 04 18:54:58.181667 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-89775462 Oct 04 18:54:58.181667 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:54:58.181667 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:54:58.181667 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/399d0b659c18493493b399e9617f8500"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_399d0b659c18493493b399e9617f8500", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/399d0b659c18493493b399e9617f8500"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/399d0b659c18493493b399e9617f8500"}]}] Oct 04 18:54:58.181667 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-89775462 Oct 04 18:54:58.181667 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 399d0b659c18493493b399e9617f8500 Oct 04 18:54:58.181667 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-89775462 Oct 04 18:54:58.181667 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ServerMetadataNegativeTestJSON-89775462-project Oct 04 18:54:58.181667 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:54:58.181667 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:54:58.181667 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 8d749453f0b848738205a98fdd13ab64 Oct 04 18:54:58.181667 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-89775462-project Oct 04 18:54:58.181667 n-d-850501-14 devstack@n-api.service[123001]: Oct 04 18:54:58.181667 n-d-850501-14 devstack@n-api.service[123001]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1002733049", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "d2b4b2bb-5916-444d-9710-bee1c3406654"}]}} Oct 04 18:54:58.181667 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:54:58.181667 n-d-850501-14 devstack@n-api.service[123001]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:54:58.181667 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1002733049', 'imageRef': 'f545e662-10b3-46b1-88bb-6e66dd294559', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': 'd2b4b2bb-5916-444d-9710-bee1c3406654'}]}}} Oct 04 18:54:58.181667 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:54:58.181667 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:58.181667 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:54:58.181667 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:54:58.181667 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:54:58.181667 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:54:58.181667 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:54:58.181667 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:54:58.181667 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 04 18:54:58.181667 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 04 18:54:58.181667 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 04 18:54:58.181667 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 04 18:54:58.181667 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 04 18:54:58.181667 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:54:58.181667 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 18:54:58.181667 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi {'': 'data1'} Oct 04 18:54:58.181667 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:54:58.181667 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:58.181667 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:54:58.181667 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:58.181667 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:58.181667 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:58.181667 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:54:58.181667 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:54:58.181667 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:54:58.181667 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:54:58.181667 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:54:58.181667 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:54:58.194771 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:54:58.194771 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:54:58.194771 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:54:58.194771 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:54:58.194771 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:54:58.194771 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:54:58.194771 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:54:58.194771 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:54:58.194771 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:58.194771 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:54:58.194771 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:58.194771 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:58.194771 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:58.194771 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:54:58.194771 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:54:58.194771 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:54:58.194771 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:54:58.194771 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a4ac6c39-7f68-4c2c-95ce-ddc0d2a0ee81 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:54:58.194771 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a4ac6c39-7f68-4c2c-95ce-ddc0d2a0ee81 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.014112 Oct 04 18:54:58.194771 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2785/5528] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:54:58 2022] POST /compute/v2.1/servers => generated 175 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:54:58.203826 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-343dd1a7-3864-4cdd-aae2-43cf66895e01 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:58.204394 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-343dd1a7-3864-4cdd-aae2-43cf66895e01 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] [instance: 2959c884-3c3f-477c-89bb-f6c0265d275f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:58.211034 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-343dd1a7-3864-4cdd-aae2-43cf66895e01 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] HTTP exception thrown: Instance 2959c884-3c3f-477c-89bb-f6c0265d275f could not be found. Oct 04 18:54:58.225928 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-343dd1a7-3864-4cdd-aae2-43cf66895e01 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Request method failure captured: Oct 04 18:54:58.225928 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/2959c884-3c3f-477c-89bb-f6c0265d275f/metadata HTTP/1.1 Oct 04 18:54:58.225928 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:54:58.225928 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:54:58.225928 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:54:58.225928 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:54:58.225928 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:54:58.225928 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:54:58.225928 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:54:58.225928 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:54:58.225928 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPIFllRv8RaZ3t7hW2szLBIerMsXt6bvsi5yAZAld9zB6iDu6QazY85yfqcMy52lk3UwEsuIM2EOavxfe-KR7c8ANkiq6kKiYtFhfXk7yyhsRMjABSeIz7uxJBSc73RAizU3KdiuztO4V88ptPht8-uREqqgYv4KBGNari7UtWh1baJ4 Oct 04 18:54:58.225928 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:54:58.225928 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:54:58.225928 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:54:58.225928 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:54:58.225928 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:54:58.225928 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:54:58.225928 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 399d0b659c18493493b399e9617f8500 Oct 04 18:54:58.225928 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-89775462 Oct 04 18:54:58.225928 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:54:58.225928 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:54:58.225928 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/399d0b659c18493493b399e9617f8500"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_399d0b659c18493493b399e9617f8500", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/399d0b659c18493493b399e9617f8500"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/399d0b659c18493493b399e9617f8500"}]}] Oct 04 18:54:58.225928 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-89775462 Oct 04 18:54:58.225928 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 399d0b659c18493493b399e9617f8500 Oct 04 18:54:58.225928 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-89775462 Oct 04 18:54:58.225928 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServerMetadataNegativeTestJSON-89775462-project Oct 04 18:54:58.225928 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:54:58.225928 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:54:58.225928 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 8d749453f0b848738205a98fdd13ab64 Oct 04 18:54:58.225928 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-89775462-project Oct 04 18:54:58.225928 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:54:58.225928 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 2959c884-3c3f-477c-89bb-f6c0265d275f could not be found. Oct 04 18:54:58.225928 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'server_id': '2959c884-3c3f-477c-89bb-f6c0265d275f'} Oct 04 18:54:58.225928 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:54:58.225928 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:58.225928 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:54:58.225928 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:54:58.225928 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:54:58.225928 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:54:58.225928 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:54:58.225928 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:54:58.225928 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2959c884-3c3f-477c-89bb-f6c0265d275f could not be found. Oct 04 18:54:58.225928 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:54:58.225928 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:58.225928 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:54:58.225928 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:58.225928 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:58.225928 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:58.225928 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:54:58.225928 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:54:58.225928 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:54:58.225928 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:54:58.225928 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Oct 04 18:54:58.225928 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 04 18:54:58.225928 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:54:58.225928 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:54:58.225928 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2959c884-3c3f-477c-89bb-f6c0265d275f could not be found. Oct 04 18:54:58.225928 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:54:58.225928 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:58.225928 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:54:58.225928 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:58.225928 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:58.225928 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:58.231765 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:54:58.231765 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:54:58.231765 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2959c884-3c3f-477c-89bb-f6c0265d275f could not be found. Oct 04 18:54:58.231765 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:54:58.236924 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-343dd1a7-3864-4cdd-aae2-43cf66895e01 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Returning 404 to user: Instance 2959c884-3c3f-477c-89bb-f6c0265d275f could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:54:58.238903 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-343dd1a7-3864-4cdd-aae2-43cf66895e01 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] 10.222.0.20 "GET /compute/v2.1/servers/2959c884-3c3f-477c-89bb-f6c0265d275f/metadata" status: 404 len: 111 microversion: 2.1 time: 0.040470 Oct 04 18:54:58.270906 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2744/5529] 10.222.0.20 () {58 vars in 1263 bytes} [Tue Oct 4 18:54:58 2022] GET /compute/v2.1/servers/2959c884-3c3f-477c-89bb-f6c0265d275f/metadata => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:54:58.395835 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3fdb7d92-5d27-4f0f-bc3d-01376acd2be9 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1669500783", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "d2b4b2bb-5916-444d-9710-bee1c3406654"}]}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:54:58.410331 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3fdb7d92-5d27-4f0f-bc3d-01376acd2be9 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Request method failure captured: Oct 04 18:54:58.410331 n-d-850501-14 devstack@n-api.service[123001]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:54:58.410331 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:54:58.410331 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:54:58.410331 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:54:58.410331 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 499 Oct 04 18:54:58.410331 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:54:58.410331 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:54:58.410331 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:54:58.410331 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:54:58.410331 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPIFllRv8RaZ3t7hW2szLBIerMsXt6bvsi5yAZAld9zB6iDu6QazY85yfqcMy52lk3UwEsuIM2EOavxfe-KR7c8ANkiq6kKiYtFhfXk7yyhsRMjABSeIz7uxJBSc73RAizU3KdiuztO4V88ptPht8-uREqqgYv4KBGNari7UtWh1baJ4 Oct 04 18:54:58.410331 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:54:58.410331 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:54:58.410331 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:54:58.410331 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:54:58.410331 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:54:58.410331 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:54:58.410331 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 399d0b659c18493493b399e9617f8500 Oct 04 18:54:58.410331 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-89775462 Oct 04 18:54:58.410331 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:54:58.410331 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:54:58.410331 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/399d0b659c18493493b399e9617f8500"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_399d0b659c18493493b399e9617f8500", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/399d0b659c18493493b399e9617f8500"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/399d0b659c18493493b399e9617f8500"}]}] Oct 04 18:54:58.410331 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-89775462 Oct 04 18:54:58.410331 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 399d0b659c18493493b399e9617f8500 Oct 04 18:54:58.410331 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-89775462 Oct 04 18:54:58.410331 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ServerMetadataNegativeTestJSON-89775462-project Oct 04 18:54:58.410331 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:54:58.410331 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:54:58.410331 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 8d749453f0b848738205a98fdd13ab64 Oct 04 18:54:58.410331 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-89775462-project Oct 04 18:54:58.410331 n-d-850501-14 devstack@n-api.service[123001]: Oct 04 18:54:58.410331 n-d-850501-14 devstack@n-api.service[123001]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1669500783", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "d2b4b2bb-5916-444d-9710-bee1c3406654"}]}} Oct 04 18:54:58.410331 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:54:58.410331 n-d-850501-14 devstack@n-api.service[123001]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:54:58.410331 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1669500783', 'imageRef': 'f545e662-10b3-46b1-88bb-6e66dd294559', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'd2b4b2bb-5916-444d-9710-bee1c3406654'}]}}} Oct 04 18:54:58.410331 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:54:58.410331 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:58.410331 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:54:58.410331 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:54:58.410331 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:54:58.410331 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:54:58.410331 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:54:58.410331 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:54:58.410331 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 04 18:54:58.410331 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 04 18:54:58.410331 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 04 18:54:58.410331 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 04 18:54:58.420367 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 04 18:54:58.420367 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:54:58.420367 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 18:54:58.420367 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 04 18:54:58.420367 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:54:58.420367 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:58.420367 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:54:58.420367 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:58.420367 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:58.420367 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:58.420367 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:54:58.420367 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:54:58.420367 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:54:58.420367 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:54:58.420367 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:54:58.420367 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:54:58.420367 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:54:58.420367 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:54:58.420367 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:54:58.420367 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:54:58.420367 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:54:58.420367 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:54:58.420367 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:54:58.420367 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:54:58.420367 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:58.420367 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:54:58.420367 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:58.420367 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:58.420367 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:58.420367 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:54:58.420367 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:54:58.420367 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:54:58.420367 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:54:58.420367 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3fdb7d92-5d27-4f0f-bc3d-01376acd2be9 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:54:58.434202 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3fdb7d92-5d27-4f0f-bc3d-01376acd2be9 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.044110 Oct 04 18:54:58.436982 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2786/5530] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:54:58 2022] POST /compute/v2.1/servers => generated 687 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:54:58.489960 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e9d348be-e825-4a12-b060-a1f141280cef tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-477421055", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "d2b4b2bb-5916-444d-9710-bee1c3406654"}]}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:54:58.494833 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e9d348be-e825-4a12-b060-a1f141280cef tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Request method failure captured: Oct 04 18:54:58.494833 n-d-850501-14 devstack@n-api.service[123002]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:54:58.494833 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:54:58.494833 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:54:58.494833 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:54:58.494833 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 499 Oct 04 18:54:58.494833 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:54:58.494833 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:54:58.494833 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:54:58.494833 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:54:58.494833 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPIFllRv8RaZ3t7hW2szLBIerMsXt6bvsi5yAZAld9zB6iDu6QazY85yfqcMy52lk3UwEsuIM2EOavxfe-KR7c8ANkiq6kKiYtFhfXk7yyhsRMjABSeIz7uxJBSc73RAizU3KdiuztO4V88ptPht8-uREqqgYv4KBGNari7UtWh1baJ4 Oct 04 18:54:58.494833 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:54:58.494833 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:54:58.494833 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:54:58.494833 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:54:58.494833 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:54:58.494833 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:54:58.494833 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 399d0b659c18493493b399e9617f8500 Oct 04 18:54:58.494833 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-89775462 Oct 04 18:54:58.494833 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:54:58.494833 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:54:58.494833 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/399d0b659c18493493b399e9617f8500"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_399d0b659c18493493b399e9617f8500", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/399d0b659c18493493b399e9617f8500"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/399d0b659c18493493b399e9617f8500"}]}] Oct 04 18:54:58.494833 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-89775462 Oct 04 18:54:58.494833 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 399d0b659c18493493b399e9617f8500 Oct 04 18:54:58.494833 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-89775462 Oct 04 18:54:58.494833 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServerMetadataNegativeTestJSON-89775462-project Oct 04 18:54:58.494833 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:54:58.494833 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:54:58.494833 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 8d749453f0b848738205a98fdd13ab64 Oct 04 18:54:58.494833 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-89775462-project Oct 04 18:54:58.494833 n-d-850501-14 devstack@n-api.service[123002]: Oct 04 18:54:58.494833 n-d-850501-14 devstack@n-api.service[123002]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-477421055", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "d2b4b2bb-5916-444d-9710-bee1c3406654"}]}} Oct 04 18:54:58.494833 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:54:58.494833 n-d-850501-14 devstack@n-api.service[123002]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:54:58.494833 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-477421055', 'imageRef': 'f545e662-10b3-46b1-88bb-6e66dd294559', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'd2b4b2bb-5916-444d-9710-bee1c3406654'}]}}} Oct 04 18:54:58.494833 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:54:58.494833 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:58.494833 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:54:58.494833 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:54:58.494833 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:54:58.494833 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:54:58.494833 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:54:58.494833 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:54:58.494833 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 04 18:54:58.494833 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 04 18:54:58.494833 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 04 18:54:58.494833 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 04 18:54:58.502270 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 04 18:54:58.502270 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:54:58.502270 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 18:54:58.502270 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 04 18:54:58.502270 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:54:58.502270 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:58.502270 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:54:58.502270 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:58.502270 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:58.502270 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:58.502270 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:54:58.502270 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:54:58.502270 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:54:58.502270 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:54:58.502270 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:54:58.502270 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:54:58.502270 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:54:58.502270 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:54:58.502270 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:54:58.502270 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:54:58.502270 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:54:58.502270 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:54:58.502270 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:54:58.502270 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:54:58.502270 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:58.502270 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:54:58.502270 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:58.502270 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:58.502270 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:58.502270 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:54:58.502270 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:54:58.502270 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:54:58.502270 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:54:58.502270 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e9d348be-e825-4a12-b060-a1f141280cef tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:54:58.502270 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e9d348be-e825-4a12-b060-a1f141280cef tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.013807 Oct 04 18:54:58.514359 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2745/5531] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:54:58 2022] POST /compute/v2.1/servers => generated 689 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:54:58.565193 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-de363e98-4b57-4373-bb2f-012cf911328d tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2011722697", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "d2b4b2bb-5916-444d-9710-bee1c3406654"}]}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:54:58.571655 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-de363e98-4b57-4373-bb2f-012cf911328d tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Request method failure captured: Oct 04 18:54:58.571655 n-d-850501-14 devstack@n-api.service[123001]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:54:58.571655 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:54:58.571655 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:54:58.571655 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:54:58.571655 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 754 Oct 04 18:54:58.571655 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:54:58.571655 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:54:58.571655 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:54:58.571655 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:54:58.571655 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPIFllRv8RaZ3t7hW2szLBIerMsXt6bvsi5yAZAld9zB6iDu6QazY85yfqcMy52lk3UwEsuIM2EOavxfe-KR7c8ANkiq6kKiYtFhfXk7yyhsRMjABSeIz7uxJBSc73RAizU3KdiuztO4V88ptPht8-uREqqgYv4KBGNari7UtWh1baJ4 Oct 04 18:54:58.571655 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:54:58.571655 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:54:58.571655 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:54:58.571655 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:54:58.571655 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:54:58.571655 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:54:58.571655 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 399d0b659c18493493b399e9617f8500 Oct 04 18:54:58.571655 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-89775462 Oct 04 18:54:58.571655 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:54:58.571655 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:54:58.571655 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/399d0b659c18493493b399e9617f8500"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_399d0b659c18493493b399e9617f8500", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/399d0b659c18493493b399e9617f8500"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/399d0b659c18493493b399e9617f8500"}]}] Oct 04 18:54:58.571655 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-89775462 Oct 04 18:54:58.571655 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 399d0b659c18493493b399e9617f8500 Oct 04 18:54:58.571655 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-89775462 Oct 04 18:54:58.571655 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ServerMetadataNegativeTestJSON-89775462-project Oct 04 18:54:58.571655 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:54:58.571655 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:54:58.571655 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 8d749453f0b848738205a98fdd13ab64 Oct 04 18:54:58.571655 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-89775462-project Oct 04 18:54:58.571655 n-d-850501-14 devstack@n-api.service[123001]: Oct 04 18:54:58.571655 n-d-850501-14 devstack@n-api.service[123001]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2011722697", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "d2b4b2bb-5916-444d-9710-bee1c3406654"}]}} Oct 04 18:54:58.571655 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:54:58.571655 n-d-850501-14 devstack@n-api.service[123001]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:54:58.571655 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-2011722697', 'imageRef': 'f545e662-10b3-46b1-88bb-6e66dd294559', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'd2b4b2bb-5916-444d-9710-bee1c3406654'}]}}} Oct 04 18:54:58.571655 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:54:58.571655 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:58.571655 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:54:58.571655 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:54:58.571655 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:54:58.580555 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:54:58.580555 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:54:58.580555 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:54:58.580555 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 04 18:54:58.580555 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 04 18:54:58.580555 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 04 18:54:58.580555 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 04 18:54:58.580555 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 04 18:54:58.580555 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:54:58.580555 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 18:54:58.580555 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 04 18:54:58.580555 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:54:58.580555 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:58.580555 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:54:58.580555 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:58.580555 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:58.580555 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:58.580555 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:54:58.580555 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:54:58.580555 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:54:58.580555 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:54:58.580555 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:54:58.580555 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:54:58.580555 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:54:58.580555 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:54:58.580555 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:54:58.580555 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:54:58.580555 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:54:58.580555 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:54:58.580555 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:54:58.580555 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:54:58.580555 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:58.580555 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:54:58.580555 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:58.580555 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:58.580555 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:58.580555 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:54:58.580555 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:54:58.587095 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:54:58.587095 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:54:58.587095 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-de363e98-4b57-4373-bb2f-012cf911328d tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:54:58.587095 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-de363e98-4b57-4373-bb2f-012cf911328d tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.016225 Oct 04 18:54:58.587095 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2787/5532] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:54:58 2022] POST /compute/v2.1/servers => generated 1197 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 04 18:54:58.824836 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-97e4c1e9-0c0d-4283-a2d0-49caa01e4c71 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-459206324", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "d2b4b2bb-5916-444d-9710-bee1c3406654"}]}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:54:58.830802 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-97e4c1e9-0c0d-4283-a2d0-49caa01e4c71 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Request method failure captured: Oct 04 18:54:58.830802 n-d-850501-14 devstack@n-api.service[123002]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:54:58.830802 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:54:58.830802 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:54:58.830802 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:54:58.830802 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 1265 Oct 04 18:54:58.830802 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:54:58.830802 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:54:58.830802 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:54:58.830802 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:54:58.830802 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPIFllRv8RaZ3t7hW2szLBIerMsXt6bvsi5yAZAld9zB6iDu6QazY85yfqcMy52lk3UwEsuIM2EOavxfe-KR7c8ANkiq6kKiYtFhfXk7yyhsRMjABSeIz7uxJBSc73RAizU3KdiuztO4V88ptPht8-uREqqgYv4KBGNari7UtWh1baJ4 Oct 04 18:54:58.830802 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:54:58.830802 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:54:58.830802 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:54:58.830802 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:54:58.830802 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:54:58.830802 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:54:58.830802 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 399d0b659c18493493b399e9617f8500 Oct 04 18:54:58.830802 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-89775462 Oct 04 18:54:58.830802 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:54:58.830802 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:54:58.830802 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/399d0b659c18493493b399e9617f8500"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_399d0b659c18493493b399e9617f8500", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/399d0b659c18493493b399e9617f8500"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/399d0b659c18493493b399e9617f8500"}]}] Oct 04 18:54:58.830802 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-89775462 Oct 04 18:54:58.830802 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 399d0b659c18493493b399e9617f8500 Oct 04 18:54:58.830802 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-89775462 Oct 04 18:54:58.830802 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServerMetadataNegativeTestJSON-89775462-project Oct 04 18:54:58.830802 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:54:58.830802 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:54:58.830802 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 8d749453f0b848738205a98fdd13ab64 Oct 04 18:54:58.830802 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-89775462-project Oct 04 18:54:58.830802 n-d-850501-14 devstack@n-api.service[123002]: Oct 04 18:54:58.830802 n-d-850501-14 devstack@n-api.service[123002]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-459206324", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "d2b4b2bb-5916-444d-9710-bee1c3406654"}]}} Oct 04 18:54:58.830802 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:54:58.833332 n-d-850501-14 devstack@n-api.service[123002]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:54:58.833332 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-459206324', 'imageRef': 'f545e662-10b3-46b1-88bb-6e66dd294559', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'd2b4b2bb-5916-444d-9710-bee1c3406654'}]}}} Oct 04 18:54:58.833332 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:54:58.833332 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:58.833332 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:54:58.833332 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:54:58.833332 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:54:58.833332 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:54:58.833332 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:54:58.833332 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:54:58.833332 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 04 18:54:58.833332 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 04 18:54:58.833332 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 04 18:54:58.833332 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 04 18:54:58.833332 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 04 18:54:58.833332 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:54:58.833332 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 18:54:58.834755 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 04 18:54:58.834755 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:54:58.834755 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:58.834755 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:54:58.834755 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:58.834755 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:58.834755 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:58.834755 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:54:58.834755 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:54:58.834755 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:54:58.834755 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:54:58.834755 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:54:58.834755 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:54:58.834755 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:54:58.834755 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:54:58.834755 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:54:58.834755 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:54:58.834755 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:54:58.834755 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:54:58.834755 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:54:58.834755 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:54:58.834755 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:58.834755 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:54:58.834755 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:58.834755 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:58.834755 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:58.834755 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:54:58.834755 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:54:58.836869 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:54:58.836869 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:54:58.838774 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-97e4c1e9-0c0d-4283-a2d0-49caa01e4c71 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:54:58.840074 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-97e4c1e9-0c0d-4283-a2d0-49caa01e4c71 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.021590 Oct 04 18:54:58.851807 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6c115976-894c-4706-8bf0-c7ad62c5c86a tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:58.858176 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6c115976-894c-4706-8bf0-c7ad62c5c86a tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] [instance: 1fb772f8-160e-4469-a946-366fe356bd22] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:58.858280 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2746/5533] 10.222.0.20 () {60 vars in 1148 bytes} [Tue Oct 4 18:54:58 2022] POST /compute/v2.1/servers => generated 2221 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 04 18:54:58.860678 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-6c115976-894c-4706-8bf0-c7ad62c5c86a tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] HTTP exception thrown: Instance 1fb772f8-160e-4469-a946-366fe356bd22 could not be found. Oct 04 18:54:58.863442 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6c115976-894c-4706-8bf0-c7ad62c5c86a tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Request method failure captured: Oct 04 18:54:58.863442 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/1fb772f8-160e-4469-a946-366fe356bd22/metadata/test2 HTTP/1.1 Oct 04 18:54:58.863442 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:54:58.863442 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:54:58.863442 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:54:58.863442 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:54:58.863442 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:54:58.863442 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:54:58.863442 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:54:58.863442 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:54:58.863442 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPIFllRv8RaZ3t7hW2szLBIerMsXt6bvsi5yAZAld9zB6iDu6QazY85yfqcMy52lk3UwEsuIM2EOavxfe-KR7c8ANkiq6kKiYtFhfXk7yyhsRMjABSeIz7uxJBSc73RAizU3KdiuztO4V88ptPht8-uREqqgYv4KBGNari7UtWh1baJ4 Oct 04 18:54:58.863442 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:54:58.863442 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:54:58.863442 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:54:58.863442 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:54:58.863442 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:54:58.863442 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:54:58.863442 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 399d0b659c18493493b399e9617f8500 Oct 04 18:54:58.863442 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-89775462 Oct 04 18:54:58.863442 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:54:58.863442 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:54:58.863442 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/399d0b659c18493493b399e9617f8500"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_399d0b659c18493493b399e9617f8500", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/399d0b659c18493493b399e9617f8500"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/399d0b659c18493493b399e9617f8500"}]}] Oct 04 18:54:58.863442 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-89775462 Oct 04 18:54:58.863442 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 399d0b659c18493493b399e9617f8500 Oct 04 18:54:58.863442 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-89775462 Oct 04 18:54:58.863442 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ServerMetadataNegativeTestJSON-89775462-project Oct 04 18:54:58.863442 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:54:58.863442 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:54:58.863442 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 8d749453f0b848738205a98fdd13ab64 Oct 04 18:54:58.863442 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-89775462-project Oct 04 18:54:58.863442 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:54:58.863442 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 1fb772f8-160e-4469-a946-366fe356bd22 could not be found. Oct 04 18:54:58.863442 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'server_id': '1fb772f8-160e-4469-a946-366fe356bd22', 'id': 'test2'} Oct 04 18:54:58.863442 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:54:58.863442 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:58.863442 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:54:58.863442 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:54:58.863442 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:54:58.863442 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:54:58.863442 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:54:58.863442 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:54:58.863442 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fb772f8-160e-4469-a946-366fe356bd22 could not be found. Oct 04 18:54:58.863442 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:54:58.863442 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:58.863442 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:54:58.863442 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:58.863442 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:58.863442 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:58.863442 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:54:58.863442 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:54:58.863442 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:54:58.863442 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:54:58.863442 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Oct 04 18:54:58.863442 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 04 18:54:58.863442 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:54:58.863442 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:54:58.863442 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fb772f8-160e-4469-a946-366fe356bd22 could not be found. Oct 04 18:54:58.863442 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:54:58.863442 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:58.863442 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:54:58.863442 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:58.863442 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:58.863442 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:58.878078 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:54:58.878078 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:54:58.878078 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fb772f8-160e-4469-a946-366fe356bd22 could not be found. Oct 04 18:54:58.878078 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:54:58.878078 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6c115976-894c-4706-8bf0-c7ad62c5c86a tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Returning 404 to user: Instance 1fb772f8-160e-4469-a946-366fe356bd22 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:54:58.878078 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6c115976-894c-4706-8bf0-c7ad62c5c86a tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] 10.222.0.20 "GET /compute/v2.1/servers/1fb772f8-160e-4469-a946-366fe356bd22/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.016892 Oct 04 18:54:58.878078 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2788/5534] 10.222.0.20 () {58 vars in 1281 bytes} [Tue Oct 4 18:54:58 2022] GET /compute/v2.1/servers/1fb772f8-160e-4469-a946-366fe356bd22/metadata/test2 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:54:58.888824 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d67d7a62-05df-41b7-a7f6-bb50a3d2b819 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:58.891617 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d67d7a62-05df-41b7-a7f6-bb50a3d2b819 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] [instance: fbe7c90b-7779-44b8-b43b-f01b223bcc0f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:58.904366 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d67d7a62-05df-41b7-a7f6-bb50a3d2b819 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:58.904366 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d67d7a62-05df-41b7-a7f6-bb50a3d2b819 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:58.904366 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d67d7a62-05df-41b7-a7f6-bb50a3d2b819 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:58.904366 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d67d7a62-05df-41b7-a7f6-bb50a3d2b819 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:58.904366 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d67d7a62-05df-41b7-a7f6-bb50a3d2b819 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:58.904366 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d67d7a62-05df-41b7-a7f6-bb50a3d2b819 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:58.949208 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d67d7a62-05df-41b7-a7f6-bb50a3d2b819 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] [instance: fbe7c90b-7779-44b8-b43b-f01b223bcc0f] Going to try to terminate instance {{(pid=123002) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:54:58.988577 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-53a76231-1ee0-4649-bc5a-55aff08ef8ab tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:58.989685 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-53a76231-1ee0-4649-bc5a-55aff08ef8ab tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] [instance: a889cd84-d30c-4a3e-95d0-fffe787ba0fc] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:59.013271 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=100 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:54:59.153769 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-53a76231-1ee0-4649-bc5a-55aff08ef8ab tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd422967752f94b3abd31a1c24976655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2264ab7b874626a0e161fe1a8eee1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:59.168929 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-53a76231-1ee0-4649-bc5a-55aff08ef8ab tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] 10.222.0.20 "GET /compute/v2.1/servers/a889cd84-d30c-4a3e-95d0-fffe787ba0fc" status: 200 len: 1224 microversion: 2.1 time: 0.185226 Oct 04 18:54:59.169570 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2789/5535] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:58 2022] GET /compute/v2.1/servers/a889cd84-d30c-4a3e-95d0-fffe787ba0fc => generated 1224 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:54:59.179814 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c357bc08-64e1-40b0-9514-242a010e6455 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:59.181338 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c357bc08-64e1-40b0-9514-242a010e6455 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 202dbed8-c7d0-46a7-aca4-1ff1d9122d8f] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:59.197919 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c357bc08-64e1-40b0-9514-242a010e6455 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:59.198792 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c357bc08-64e1-40b0-9514-242a010e6455 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:59.199469 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c357bc08-64e1-40b0-9514-242a010e6455 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:59.200917 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c357bc08-64e1-40b0-9514-242a010e6455 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:59.206536 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c357bc08-64e1-40b0-9514-242a010e6455 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:59.207430 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c357bc08-64e1-40b0-9514-242a010e6455 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:59.335188 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d67d7a62-05df-41b7-a7f6-bb50a3d2b819 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] 10.222.0.20 "DELETE /compute/v2.1/servers/fbe7c90b-7779-44b8-b43b-f01b223bcc0f" status: 204 len: 0 microversion: 2.1 time: 0.459768 Oct 04 18:54:59.336868 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2747/5536] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:54:58 2022] DELETE /compute/v2.1/servers/fbe7c90b-7779-44b8-b43b-f01b223bcc0f => generated 0 bytes in 462 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:54:59.349332 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e9debe5f-0e59-4afd-9265-7b36c1db2590 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:59.349909 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e9debe5f-0e59-4afd-9265-7b36c1db2590 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] [instance: fbe7c90b-7779-44b8-b43b-f01b223bcc0f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:59.358410 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e9debe5f-0e59-4afd-9265-7b36c1db2590 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:59.358916 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e9debe5f-0e59-4afd-9265-7b36c1db2590 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:59.359366 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e9debe5f-0e59-4afd-9265-7b36c1db2590 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:59.360104 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e9debe5f-0e59-4afd-9265-7b36c1db2590 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:59.360580 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e9debe5f-0e59-4afd-9265-7b36c1db2590 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:59.361587 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e9debe5f-0e59-4afd-9265-7b36c1db2590 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:59.556467 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:55:00.029452 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c357bc08-64e1-40b0-9514-242a010e6455 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:00.035513 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e9debe5f-0e59-4afd-9265-7b36c1db2590 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d749453f0b848738205a98fdd13ab64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399d0b659c18493493b399e9617f8500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:00.056778 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e9debe5f-0e59-4afd-9265-7b36c1db2590 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] 10.222.0.20 "GET /compute/v2.1/servers/fbe7c90b-7779-44b8-b43b-f01b223bcc0f" status: 200 len: 1524 microversion: 2.1 time: 0.715455 Oct 04 18:55:00.071653 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c357bc08-64e1-40b0-9514-242a010e6455 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/202dbed8-c7d0-46a7-aca4-1ff1d9122d8f" status: 200 len: 1315 microversion: 2.1 time: 0.882839 Oct 04 18:55:00.072182 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2748/5537] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:59 2022] GET /compute/v2.1/servers/fbe7c90b-7779-44b8-b43b-f01b223bcc0f => generated 1524 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:00.075953 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2790/5538] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:59 2022] GET /compute/v2.1/servers/202dbed8-c7d0-46a7-aca4-1ff1d9122d8f => generated 1315 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:00.196367 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ada57ac8-f82b-4aa7-a6f5-c782a6303039 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:00.200621 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ada57ac8-f82b-4aa7-a6f5-c782a6303039 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] [instance: a889cd84-d30c-4a3e-95d0-fffe787ba0fc] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:00.209044 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:55:00.212296 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ada57ac8-f82b-4aa7-a6f5-c782a6303039 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:00.212809 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ada57ac8-f82b-4aa7-a6f5-c782a6303039 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:00.213258 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ada57ac8-f82b-4aa7-a6f5-c782a6303039 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:00.218385 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ada57ac8-f82b-4aa7-a6f5-c782a6303039 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:00.218917 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ada57ac8-f82b-4aa7-a6f5-c782a6303039 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:00.219374 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ada57ac8-f82b-4aa7-a6f5-c782a6303039 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:01.092961 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-cab2a307-118a-4161-8232-dd4e2fe0bcbc tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:01.094272 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-cab2a307-118a-4161-8232-dd4e2fe0bcbc tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 202dbed8-c7d0-46a7-aca4-1ff1d9122d8f] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:01.107083 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cab2a307-118a-4161-8232-dd4e2fe0bcbc tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:01.107947 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cab2a307-118a-4161-8232-dd4e2fe0bcbc tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:01.108620 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cab2a307-118a-4161-8232-dd4e2fe0bcbc tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:01.110343 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cab2a307-118a-4161-8232-dd4e2fe0bcbc tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:01.110343 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cab2a307-118a-4161-8232-dd4e2fe0bcbc tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:01.111725 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cab2a307-118a-4161-8232-dd4e2fe0bcbc tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:01.320180 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ada57ac8-f82b-4aa7-a6f5-c782a6303039 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd422967752f94b3abd31a1c24976655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2264ab7b874626a0e161fe1a8eee1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:01.353956 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ada57ac8-f82b-4aa7-a6f5-c782a6303039 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] 10.222.0.20 "GET /compute/v2.1/servers/a889cd84-d30c-4a3e-95d0-fffe787ba0fc" status: 200 len: 1276 microversion: 2.1 time: 1.159969 Oct 04 18:55:01.357090 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2749/5539] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:00 2022] GET /compute/v2.1/servers/a889cd84-d30c-4a3e-95d0-fffe787ba0fc => generated 1276 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:01.392321 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f1e4a490-d623-4ba3-b50b-b8c916ec14d0 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:01.403767 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f1e4a490-d623-4ba3-b50b-b8c916ec14d0 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] [instance: fbe7c90b-7779-44b8-b43b-f01b223bcc0f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:01.412782 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f1e4a490-d623-4ba3-b50b-b8c916ec14d0 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:01.413636 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f1e4a490-d623-4ba3-b50b-b8c916ec14d0 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:01.414325 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f1e4a490-d623-4ba3-b50b-b8c916ec14d0 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:01.416402 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f1e4a490-d623-4ba3-b50b-b8c916ec14d0 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:01.417564 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f1e4a490-d623-4ba3-b50b-b8c916ec14d0 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:01.418251 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f1e4a490-d623-4ba3-b50b-b8c916ec14d0 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:01.857230 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-cab2a307-118a-4161-8232-dd4e2fe0bcbc tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:01.865903 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-cab2a307-118a-4161-8232-dd4e2fe0bcbc tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/202dbed8-c7d0-46a7-aca4-1ff1d9122d8f" status: 200 len: 1315 microversion: 2.1 time: 0.786127 Oct 04 18:55:01.866490 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2791/5540] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:01 2022] GET /compute/v2.1/servers/202dbed8-c7d0-46a7-aca4-1ff1d9122d8f => generated 1315 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:02.042519 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f1e4a490-d623-4ba3-b50b-b8c916ec14d0 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d749453f0b848738205a98fdd13ab64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399d0b659c18493493b399e9617f8500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:02.062406 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f1e4a490-d623-4ba3-b50b-b8c916ec14d0 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] 10.222.0.20 "GET /compute/v2.1/servers/fbe7c90b-7779-44b8-b43b-f01b223bcc0f" status: 200 len: 1524 microversion: 2.1 time: 0.697176 Oct 04 18:55:02.068949 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2750/5541] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:01 2022] GET /compute/v2.1/servers/fbe7c90b-7779-44b8-b43b-f01b223bcc0f => generated 1524 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:02.266130 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-a8d65237-bb50-41ae-a046-17babfcdd606 req-e5eeb4f2-d009-415e-b33c-5b953df33b46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "202dbed8-c7d0-46a7-aca4-1ff1d9122d8f", "tag": "e17b95ea-0e43-4795-956b-ede441ab9cb4"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:55:02.289337 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-a8d65237-bb50-41ae-a046-17babfcdd606 req-e5eeb4f2-d009-415e-b33c-5b953df33b46 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:02.290124 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-a8d65237-bb50-41ae-a046-17babfcdd606 req-e5eeb4f2-d009-415e-b33c-5b953df33b46 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:02.290711 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-a8d65237-bb50-41ae-a046-17babfcdd606 req-e5eeb4f2-d009-415e-b33c-5b953df33b46 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:02.325189 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-a8d65237-bb50-41ae-a046-17babfcdd606 req-e5eeb4f2-d009-415e-b33c-5b953df33b46 service nova] Creating event network-changed:e17b95ea-0e43-4795-956b-ede441ab9cb4 for instance 202dbed8-c7d0-46a7-aca4-1ff1d9122d8f on n-h1-850501-14 Oct 04 18:55:02.331987 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-a8d65237-bb50-41ae-a046-17babfcdd606 req-e5eeb4f2-d009-415e-b33c-5b953df33b46 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069395 Oct 04 18:55:02.333209 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2792/5542] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:55:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:55:02.399136 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1305a49c-11f4-4d4d-a2bb-6d9bd8a88151 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:02.400968 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1305a49c-11f4-4d4d-a2bb-6d9bd8a88151 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] [instance: a889cd84-d30c-4a3e-95d0-fffe787ba0fc] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:02.415484 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1305a49c-11f4-4d4d-a2bb-6d9bd8a88151 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:02.422453 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1305a49c-11f4-4d4d-a2bb-6d9bd8a88151 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:02.422916 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1305a49c-11f4-4d4d-a2bb-6d9bd8a88151 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:02.423924 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1305a49c-11f4-4d4d-a2bb-6d9bd8a88151 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:02.424421 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1305a49c-11f4-4d4d-a2bb-6d9bd8a88151 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:02.425034 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1305a49c-11f4-4d4d-a2bb-6d9bd8a88151 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:02.605209 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1305a49c-11f4-4d4d-a2bb-6d9bd8a88151 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd422967752f94b3abd31a1c24976655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2264ab7b874626a0e161fe1a8eee1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:02.645470 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1305a49c-11f4-4d4d-a2bb-6d9bd8a88151 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] 10.222.0.20 "GET /compute/v2.1/servers/a889cd84-d30c-4a3e-95d0-fffe787ba0fc" status: 200 len: 1282 microversion: 2.1 time: 0.255685 Oct 04 18:55:02.662798 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2751/5543] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:02 2022] GET /compute/v2.1/servers/a889cd84-d30c-4a3e-95d0-fffe787ba0fc => generated 1282 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:02.896756 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7652e666-9581-4662-8492-f90b841779f1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:02.897945 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7652e666-9581-4662-8492-f90b841779f1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 202dbed8-c7d0-46a7-aca4-1ff1d9122d8f] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:02.919453 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7652e666-9581-4662-8492-f90b841779f1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:02.919453 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7652e666-9581-4662-8492-f90b841779f1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:02.919453 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7652e666-9581-4662-8492-f90b841779f1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:02.921561 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7652e666-9581-4662-8492-f90b841779f1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:02.923092 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7652e666-9581-4662-8492-f90b841779f1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:02.924965 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7652e666-9581-4662-8492-f90b841779f1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:03.107244 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-18db13f3-b17d-4fc7-ac64-74305e0bbc8f tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:03.109611 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-18db13f3-b17d-4fc7-ac64-74305e0bbc8f tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] [instance: fbe7c90b-7779-44b8-b43b-f01b223bcc0f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:03.129520 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-18db13f3-b17d-4fc7-ac64-74305e0bbc8f tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:03.131722 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-18db13f3-b17d-4fc7-ac64-74305e0bbc8f tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:03.132982 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-18db13f3-b17d-4fc7-ac64-74305e0bbc8f tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:03.135841 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-18db13f3-b17d-4fc7-ac64-74305e0bbc8f tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:03.139964 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-18db13f3-b17d-4fc7-ac64-74305e0bbc8f tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:03.142543 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-18db13f3-b17d-4fc7-ac64-74305e0bbc8f tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:03.339600 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-18db13f3-b17d-4fc7-ac64-74305e0bbc8f tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d749453f0b848738205a98fdd13ab64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399d0b659c18493493b399e9617f8500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:03.392145 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-18db13f3-b17d-4fc7-ac64-74305e0bbc8f tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] 10.222.0.20 "GET /compute/v2.1/servers/fbe7c90b-7779-44b8-b43b-f01b223bcc0f" status: 200 len: 1482 microversion: 2.1 time: 0.303602 Oct 04 18:55:03.417225 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2752/5544] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:03 2022] GET /compute/v2.1/servers/fbe7c90b-7779-44b8-b43b-f01b223bcc0f => generated 1482 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:03.509634 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-2f4d8497-5103-4a5f-b8e5-1088ec149470 req-753d47bd-7f0a-484a-b45b-071e98e8c92f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbe7c90b-7779-44b8-b43b-f01b223bcc0f", "name": "network-vif-deleted", "tag": "6af48d98-45dd-4bc2-b618-e67783c0e02b"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:55:03.557192 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-2f4d8497-5103-4a5f-b8e5-1088ec149470 req-753d47bd-7f0a-484a-b45b-071e98e8c92f service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:03.558392 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-2f4d8497-5103-4a5f-b8e5-1088ec149470 req-753d47bd-7f0a-484a-b45b-071e98e8c92f service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:03.561212 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-2f4d8497-5103-4a5f-b8e5-1088ec149470 req-753d47bd-7f0a-484a-b45b-071e98e8c92f service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:03.585422 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-2f4d8497-5103-4a5f-b8e5-1088ec149470 req-753d47bd-7f0a-484a-b45b-071e98e8c92f service nova] Creating event network-vif-deleted:6af48d98-45dd-4bc2-b618-e67783c0e02b for instance fbe7c90b-7779-44b8-b43b-f01b223bcc0f on n-h2-850501-14 Oct 04 18:55:03.593287 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-2f4d8497-5103-4a5f-b8e5-1088ec149470 req-753d47bd-7f0a-484a-b45b-071e98e8c92f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092710 Oct 04 18:55:03.594257 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2753/5545] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:55:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:55:03.674845 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e244f20f-228c-4e80-9ce8-c0a0dad45a22 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:03.675758 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e244f20f-228c-4e80-9ce8-c0a0dad45a22 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] [instance: a889cd84-d30c-4a3e-95d0-fffe787ba0fc] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:03.691299 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e244f20f-228c-4e80-9ce8-c0a0dad45a22 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:03.692194 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e244f20f-228c-4e80-9ce8-c0a0dad45a22 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:03.693809 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e244f20f-228c-4e80-9ce8-c0a0dad45a22 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:03.695007 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e244f20f-228c-4e80-9ce8-c0a0dad45a22 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:03.695734 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e244f20f-228c-4e80-9ce8-c0a0dad45a22 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:03.702038 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e244f20f-228c-4e80-9ce8-c0a0dad45a22 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:03.810739 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7652e666-9581-4662-8492-f90b841779f1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:03.813089 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=100 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:55:03.827125 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7652e666-9581-4662-8492-f90b841779f1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/202dbed8-c7d0-46a7-aca4-1ff1d9122d8f" status: 200 len: 1315 microversion: 2.1 time: 0.941154 Oct 04 18:55:03.832720 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2793/5546] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:02 2022] GET /compute/v2.1/servers/202dbed8-c7d0-46a7-aca4-1ff1d9122d8f => generated 1315 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:04.293120 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e244f20f-228c-4e80-9ce8-c0a0dad45a22 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd422967752f94b3abd31a1c24976655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2264ab7b874626a0e161fe1a8eee1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:04.307572 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e244f20f-228c-4e80-9ce8-c0a0dad45a22 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] 10.222.0.20 "GET /compute/v2.1/servers/a889cd84-d30c-4a3e-95d0-fffe787ba0fc" status: 200 len: 1324 microversion: 2.1 time: 0.640419 Oct 04 18:55:04.322128 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2754/5547] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:03 2022] GET /compute/v2.1/servers/a889cd84-d30c-4a3e-95d0-fffe787ba0fc => generated 1324 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:04.438198 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4fe4fbd1-91f9-44f5-8769-398f56a29e14 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:04.438542 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-4fe4fbd1-91f9-44f5-8769-398f56a29e14 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] [instance: fbe7c90b-7779-44b8-b43b-f01b223bcc0f] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:04.450347 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4fe4fbd1-91f9-44f5-8769-398f56a29e14 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:04.451138 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4fe4fbd1-91f9-44f5-8769-398f56a29e14 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:04.451955 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4fe4fbd1-91f9-44f5-8769-398f56a29e14 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:04.452878 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4fe4fbd1-91f9-44f5-8769-398f56a29e14 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:04.454081 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4fe4fbd1-91f9-44f5-8769-398f56a29e14 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:04.454775 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4fe4fbd1-91f9-44f5-8769-398f56a29e14 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:04.504710 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4fe4fbd1-91f9-44f5-8769-398f56a29e14 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:04.506551 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4fe4fbd1-91f9-44f5-8769-398f56a29e14 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:04.507231 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4fe4fbd1-91f9-44f5-8769-398f56a29e14 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:04.508402 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-4fe4fbd1-91f9-44f5-8769-398f56a29e14 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Lazy-loading 'fault' on Instance uuid fbe7c90b-7779-44b8-b43b-f01b223bcc0f {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:55:04.667744 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-4fe4fbd1-91f9-44f5-8769-398f56a29e14 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d749453f0b848738205a98fdd13ab64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399d0b659c18493493b399e9617f8500', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:04.676533 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-4fe4fbd1-91f9-44f5-8769-398f56a29e14 tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] 10.222.0.20 "GET /compute/v2.1/servers/fbe7c90b-7779-44b8-b43b-f01b223bcc0f" status: 200 len: 1313 microversion: 2.1 time: 0.244223 Oct 04 18:55:04.677224 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2794/5548] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:04 2022] GET /compute/v2.1/servers/fbe7c90b-7779-44b8-b43b-f01b223bcc0f => generated 1313 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:04.856939 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9c9f0d45-d1fa-4196-b62f-5b64606f31eb tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:04.857709 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9c9f0d45-d1fa-4196-b62f-5b64606f31eb tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 202dbed8-c7d0-46a7-aca4-1ff1d9122d8f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:04.865851 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9c9f0d45-d1fa-4196-b62f-5b64606f31eb tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:04.866347 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9c9f0d45-d1fa-4196-b62f-5b64606f31eb tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:04.866818 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9c9f0d45-d1fa-4196-b62f-5b64606f31eb tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:04.867599 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9c9f0d45-d1fa-4196-b62f-5b64606f31eb tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:04.868264 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9c9f0d45-d1fa-4196-b62f-5b64606f31eb tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:04.868699 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9c9f0d45-d1fa-4196-b62f-5b64606f31eb tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:05.344820 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-31bbbafa-9945-4566-a233-fad1c3b905e8 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:05.346980 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-31bbbafa-9945-4566-a233-fad1c3b905e8 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] [instance: a889cd84-d30c-4a3e-95d0-fffe787ba0fc] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:05.353023 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-31bbbafa-9945-4566-a233-fad1c3b905e8 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:05.353549 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-31bbbafa-9945-4566-a233-fad1c3b905e8 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:05.353987 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-31bbbafa-9945-4566-a233-fad1c3b905e8 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:05.354695 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-31bbbafa-9945-4566-a233-fad1c3b905e8 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:05.355152 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-31bbbafa-9945-4566-a233-fad1c3b905e8 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:05.355576 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-31bbbafa-9945-4566-a233-fad1c3b905e8 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:05.752200 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9c9f0d45-d1fa-4196-b62f-5b64606f31eb tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:05.766190 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9c9f0d45-d1fa-4196-b62f-5b64606f31eb tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/202dbed8-c7d0-46a7-aca4-1ff1d9122d8f" status: 200 len: 1315 microversion: 2.1 time: 0.913076 Oct 04 18:55:05.770349 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2755/5549] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:04 2022] GET /compute/v2.1/servers/202dbed8-c7d0-46a7-aca4-1ff1d9122d8f => generated 1315 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:05.775653 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e9389ec5-f571-4c0e-a715-e35ed6a5a26e tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:05.776586 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e9389ec5-f571-4c0e-a715-e35ed6a5a26e tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] [instance: fbe7c90b-7779-44b8-b43b-f01b223bcc0f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:05.786743 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e9389ec5-f571-4c0e-a715-e35ed6a5a26e tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:05.787394 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e9389ec5-f571-4c0e-a715-e35ed6a5a26e tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:05.787968 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e9389ec5-f571-4c0e-a715-e35ed6a5a26e tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:05.788958 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e9389ec5-f571-4c0e-a715-e35ed6a5a26e tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:05.789649 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e9389ec5-f571-4c0e-a715-e35ed6a5a26e tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:05.790305 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e9389ec5-f571-4c0e-a715-e35ed6a5a26e tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:05.816145 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-e9389ec5-f571-4c0e-a715-e35ed6a5a26e tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] HTTP exception thrown: Instance fbe7c90b-7779-44b8-b43b-f01b223bcc0f could not be found. Oct 04 18:55:05.819009 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e9389ec5-f571-4c0e-a715-e35ed6a5a26e tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Request method failure captured: Oct 04 18:55:05.819009 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/fbe7c90b-7779-44b8-b43b-f01b223bcc0f HTTP/1.1 Oct 04 18:55:05.819009 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:55:05.819009 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:55:05.819009 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:55:05.819009 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:55:05.819009 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:55:05.819009 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:55:05.819009 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:55:05.819009 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:55:05.819009 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPIFllRv8RaZ3t7hW2szLBIerMsXt6bvsi5yAZAld9zB6iDu6QazY85yfqcMy52lk3UwEsuIM2EOavxfe-KR7c8ANkiq6kKiYtFhfXk7yyhsRMjABSeIz7uxJBSc73RAizU3KdiuztO4V88ptPht8-uREqqgYv4KBGNari7UtWh1baJ4 Oct 04 18:55:05.819009 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:55:05.819009 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:55:05.819009 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:55:05.819009 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:55:05.819009 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:55:05.819009 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:55:05.819009 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 399d0b659c18493493b399e9617f8500 Oct 04 18:55:05.819009 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-89775462 Oct 04 18:55:05.819009 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:55:05.819009 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:55:05.819009 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/399d0b659c18493493b399e9617f8500"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_399d0b659c18493493b399e9617f8500", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/399d0b659c18493493b399e9617f8500"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/399d0b659c18493493b399e9617f8500"}]}] Oct 04 18:55:05.819009 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-89775462 Oct 04 18:55:05.819009 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 399d0b659c18493493b399e9617f8500 Oct 04 18:55:05.819009 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-89775462 Oct 04 18:55:05.819009 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServerMetadataNegativeTestJSON-89775462-project Oct 04 18:55:05.819009 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:55:05.819009 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:55:05.819009 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 8d749453f0b848738205a98fdd13ab64 Oct 04 18:55:05.819009 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-89775462-project Oct 04 18:55:05.819009 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:55:05.819009 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance fbe7c90b-7779-44b8-b43b-f01b223bcc0f could not be found. Oct 04 18:55:05.819009 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'fbe7c90b-7779-44b8-b43b-f01b223bcc0f'} Oct 04 18:55:05.819009 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:55:05.819009 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:05.819009 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:55:05.819009 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:55:05.819009 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:55:05.819009 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:55:05.819009 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:55:05.819009 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:55:05.819009 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:55:05.819009 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:55:05.819009 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbe7c90b-7779-44b8-b43b-f01b223bcc0f could not be found. Oct 04 18:55:05.819009 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:55:05.819009 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:55:05.819009 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:55:05.819009 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:05.819009 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:55:05.819009 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:55:05.819009 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:55:05.819009 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:55:05.819009 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:55:05.819009 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:55:05.819009 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:55:05.819009 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:55:05.819009 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:55:05.819009 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:55:05.819009 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:55:05.819009 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:55:05.819009 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbe7c90b-7779-44b8-b43b-f01b223bcc0f could not be found. Oct 04 18:55:05.819009 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:55:05.819009 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:55:05.822853 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:55:05.822853 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:05.822853 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:55:05.822853 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:55:05.822853 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:55:05.822853 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:55:05.822853 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbe7c90b-7779-44b8-b43b-f01b223bcc0f could not be found. Oct 04 18:55:05.822853 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:55:05.822853 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e9389ec5-f571-4c0e-a715-e35ed6a5a26e tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] Returning 404 to user: Instance fbe7c90b-7779-44b8-b43b-f01b223bcc0f could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:55:05.822853 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e9389ec5-f571-4c0e-a715-e35ed6a5a26e tempest-ServerMetadataNegativeTestJSON-89775462 tempest-ServerMetadataNegativeTestJSON-89775462-project] 10.222.0.20 "GET /compute/v2.1/servers/fbe7c90b-7779-44b8-b43b-f01b223bcc0f" status: 404 len: 111 microversion: 2.1 time: 0.051439 Oct 04 18:55:05.822853 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2756/5550] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:05 2022] GET /compute/v2.1/servers/fbe7c90b-7779-44b8-b43b-f01b223bcc0f => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:55:05.836034 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-1aa02740-1d28-46a7-8e89-3565f4232411 req-efb17d2e-cdde-4977-af92-84d0c5530689 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a889cd84-d30c-4a3e-95d0-fffe787ba0fc", "tag": "eb8e836f-fe41-461e-afdb-3ad6e2e9041b"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:55:05.847213 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-1aa02740-1d28-46a7-8e89-3565f4232411 req-efb17d2e-cdde-4977-af92-84d0c5530689 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:05.847703 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-1aa02740-1d28-46a7-8e89-3565f4232411 req-efb17d2e-cdde-4977-af92-84d0c5530689 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:05.848160 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-1aa02740-1d28-46a7-8e89-3565f4232411 req-efb17d2e-cdde-4977-af92-84d0c5530689 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:05.875186 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-1aa02740-1d28-46a7-8e89-3565f4232411 req-efb17d2e-cdde-4977-af92-84d0c5530689 service nova] Creating event network-changed:eb8e836f-fe41-461e-afdb-3ad6e2e9041b for instance a889cd84-d30c-4a3e-95d0-fffe787ba0fc on n-h1-850501-14 Oct 04 18:55:05.875784 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-31bbbafa-9945-4566-a233-fad1c3b905e8 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd422967752f94b3abd31a1c24976655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2264ab7b874626a0e161fe1a8eee1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:05.884213 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-31bbbafa-9945-4566-a233-fad1c3b905e8 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] 10.222.0.20 "GET /compute/v2.1/servers/a889cd84-d30c-4a3e-95d0-fffe787ba0fc" status: 200 len: 1324 microversion: 2.1 time: 0.543286 Oct 04 18:55:05.885347 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2795/5551] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:05 2022] GET /compute/v2.1/servers/a889cd84-d30c-4a3e-95d0-fffe787ba0fc => generated 1324 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:55:05.905010 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-1aa02740-1d28-46a7-8e89-3565f4232411 req-efb17d2e-cdde-4977-af92-84d0c5530689 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079017 Oct 04 18:55:05.905981 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2757/5552] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:55:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:55:06.792196 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-689ada69-195b-420e-8a2d-437fcadcd0e5 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:06.792842 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-689ada69-195b-420e-8a2d-437fcadcd0e5 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 202dbed8-c7d0-46a7-aca4-1ff1d9122d8f] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:06.808829 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-689ada69-195b-420e-8a2d-437fcadcd0e5 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:06.809831 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-689ada69-195b-420e-8a2d-437fcadcd0e5 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:06.812758 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-689ada69-195b-420e-8a2d-437fcadcd0e5 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:06.813967 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-689ada69-195b-420e-8a2d-437fcadcd0e5 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:06.814755 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-689ada69-195b-420e-8a2d-437fcadcd0e5 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:06.815374 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-689ada69-195b-420e-8a2d-437fcadcd0e5 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:06.912944 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-40b8e69f-e129-40af-a015-4d53ff96aba7 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:06.917182 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-40b8e69f-e129-40af-a015-4d53ff96aba7 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] [instance: a889cd84-d30c-4a3e-95d0-fffe787ba0fc] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:06.932039 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-40b8e69f-e129-40af-a015-4d53ff96aba7 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:06.933389 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-40b8e69f-e129-40af-a015-4d53ff96aba7 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:06.935190 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-40b8e69f-e129-40af-a015-4d53ff96aba7 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:06.937146 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-40b8e69f-e129-40af-a015-4d53ff96aba7 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:06.938271 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-40b8e69f-e129-40af-a015-4d53ff96aba7 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:06.939721 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-40b8e69f-e129-40af-a015-4d53ff96aba7 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:07.072004 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:55:07.149724 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=10 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:55:07.365851 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-689ada69-195b-420e-8a2d-437fcadcd0e5 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:07.375167 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-689ada69-195b-420e-8a2d-437fcadcd0e5 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/202dbed8-c7d0-46a7-aca4-1ff1d9122d8f" status: 200 len: 1315 microversion: 2.1 time: 0.587615 Oct 04 18:55:07.375756 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2796/5553] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:06 2022] GET /compute/v2.1/servers/202dbed8-c7d0-46a7-aca4-1ff1d9122d8f => generated 1315 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:07.388476 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-40b8e69f-e129-40af-a015-4d53ff96aba7 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd422967752f94b3abd31a1c24976655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2264ab7b874626a0e161fe1a8eee1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:07.405319 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-40b8e69f-e129-40af-a015-4d53ff96aba7 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] 10.222.0.20 "GET /compute/v2.1/servers/a889cd84-d30c-4a3e-95d0-fffe787ba0fc" status: 200 len: 1324 microversion: 2.1 time: 0.501840 Oct 04 18:55:07.405920 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2758/5554] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:06 2022] GET /compute/v2.1/servers/a889cd84-d30c-4a3e-95d0-fffe787ba0fc => generated 1324 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:55:08.405562 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-218a41ca-97a8-4418-8527-303ff5aea196 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:08.406764 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-218a41ca-97a8-4418-8527-303ff5aea196 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 202dbed8-c7d0-46a7-aca4-1ff1d9122d8f] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:08.427772 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-218a41ca-97a8-4418-8527-303ff5aea196 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:08.427772 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-218a41ca-97a8-4418-8527-303ff5aea196 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:08.430147 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f450b5bb-1d71-4c33-9868-826d3f384750 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:08.430981 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f450b5bb-1d71-4c33-9868-826d3f384750 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] [instance: a889cd84-d30c-4a3e-95d0-fffe787ba0fc] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:08.431859 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-218a41ca-97a8-4418-8527-303ff5aea196 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:08.434032 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-218a41ca-97a8-4418-8527-303ff5aea196 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:08.434736 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-218a41ca-97a8-4418-8527-303ff5aea196 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:08.436581 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-218a41ca-97a8-4418-8527-303ff5aea196 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:08.449083 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f450b5bb-1d71-4c33-9868-826d3f384750 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:08.451177 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f450b5bb-1d71-4c33-9868-826d3f384750 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:08.451880 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f450b5bb-1d71-4c33-9868-826d3f384750 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:08.453933 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f450b5bb-1d71-4c33-9868-826d3f384750 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:08.456377 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f450b5bb-1d71-4c33-9868-826d3f384750 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:08.457028 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f450b5bb-1d71-4c33-9868-826d3f384750 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:08.784501 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-218a41ca-97a8-4418-8527-303ff5aea196 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:08.794240 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-218a41ca-97a8-4418-8527-303ff5aea196 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/202dbed8-c7d0-46a7-aca4-1ff1d9122d8f" status: 200 len: 1315 microversion: 2.1 time: 0.395188 Oct 04 18:55:08.821162 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2797/5555] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:08 2022] GET /compute/v2.1/servers/202dbed8-c7d0-46a7-aca4-1ff1d9122d8f => generated 1315 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:08.854184 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f450b5bb-1d71-4c33-9868-826d3f384750 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd422967752f94b3abd31a1c24976655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2264ab7b874626a0e161fe1a8eee1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:08.868656 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f450b5bb-1d71-4c33-9868-826d3f384750 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] 10.222.0.20 "GET /compute/v2.1/servers/a889cd84-d30c-4a3e-95d0-fffe787ba0fc" status: 200 len: 1324 microversion: 2.1 time: 0.442511 Oct 04 18:55:08.870365 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2759/5556] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:08 2022] GET /compute/v2.1/servers/a889cd84-d30c-4a3e-95d0-fffe787ba0fc => generated 1324 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:55:09.823789 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d92cbac2-9f26-422d-91f7-5912c2a0e5b6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:09.828184 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d92cbac2-9f26-422d-91f7-5912c2a0e5b6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 202dbed8-c7d0-46a7-aca4-1ff1d9122d8f] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:09.832408 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=10 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:55:09.851058 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d92cbac2-9f26-422d-91f7-5912c2a0e5b6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:09.851662 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d92cbac2-9f26-422d-91f7-5912c2a0e5b6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:09.854220 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d92cbac2-9f26-422d-91f7-5912c2a0e5b6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:09.856760 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d92cbac2-9f26-422d-91f7-5912c2a0e5b6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:09.858433 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d92cbac2-9f26-422d-91f7-5912c2a0e5b6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:09.871503 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d92cbac2-9f26-422d-91f7-5912c2a0e5b6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:09.893918 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d26cbf76-fc7f-47e8-9acf-8eebcb8708e4 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:09.894721 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d26cbf76-fc7f-47e8-9acf-8eebcb8708e4 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] [instance: a889cd84-d30c-4a3e-95d0-fffe787ba0fc] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:09.924186 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d26cbf76-fc7f-47e8-9acf-8eebcb8708e4 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:09.934735 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d26cbf76-fc7f-47e8-9acf-8eebcb8708e4 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:09.940401 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d26cbf76-fc7f-47e8-9acf-8eebcb8708e4 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:09.949835 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d26cbf76-fc7f-47e8-9acf-8eebcb8708e4 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:09.956311 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d26cbf76-fc7f-47e8-9acf-8eebcb8708e4 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:09.964163 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d26cbf76-fc7f-47e8-9acf-8eebcb8708e4 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:10.899998 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d26cbf76-fc7f-47e8-9acf-8eebcb8708e4 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd422967752f94b3abd31a1c24976655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2264ab7b874626a0e161fe1a8eee1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:10.924614 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d26cbf76-fc7f-47e8-9acf-8eebcb8708e4 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] 10.222.0.20 "GET /compute/v2.1/servers/a889cd84-d30c-4a3e-95d0-fffe787ba0fc" status: 200 len: 1324 microversion: 2.1 time: 1.024684 Oct 04 18:55:10.924614 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2760/5557] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:09 2022] GET /compute/v2.1/servers/a889cd84-d30c-4a3e-95d0-fffe787ba0fc => generated 1324 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:10.938418 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-e28a69ee-409c-479d-b14f-84311d23c4bc req-57abd8f0-2632-424a-8f51-ff3f5778f384 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a889cd84-d30c-4a3e-95d0-fffe787ba0fc", "name": "network-vif-plugged", "status": "completed", "tag": "eb8e836f-fe41-461e-afdb-3ad6e2e9041b"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:55:10.942986 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d92cbac2-9f26-422d-91f7-5912c2a0e5b6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:10.965959 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d92cbac2-9f26-422d-91f7-5912c2a0e5b6 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/202dbed8-c7d0-46a7-aca4-1ff1d9122d8f" status: 200 len: 1315 microversion: 2.1 time: 1.150181 Oct 04 18:55:10.971680 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2798/5558] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:09 2022] GET /compute/v2.1/servers/202dbed8-c7d0-46a7-aca4-1ff1d9122d8f => generated 1315 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:10.980245 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-e28a69ee-409c-479d-b14f-84311d23c4bc req-57abd8f0-2632-424a-8f51-ff3f5778f384 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:10.980952 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-e28a69ee-409c-479d-b14f-84311d23c4bc req-57abd8f0-2632-424a-8f51-ff3f5778f384 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:10.981742 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-e28a69ee-409c-479d-b14f-84311d23c4bc req-57abd8f0-2632-424a-8f51-ff3f5778f384 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:10.996605 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-e28a69ee-409c-479d-b14f-84311d23c4bc req-57abd8f0-2632-424a-8f51-ff3f5778f384 service nova] Creating event network-vif-plugged:eb8e836f-fe41-461e-afdb-3ad6e2e9041b for instance a889cd84-d30c-4a3e-95d0-fffe787ba0fc on n-h1-850501-14 Oct 04 18:55:11.003212 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-e28a69ee-409c-479d-b14f-84311d23c4bc req-57abd8f0-2632-424a-8f51-ff3f5778f384 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088894 Oct 04 18:55:11.004188 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2761/5559] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:55:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:55:11.941074 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7cfc5e9f-0136-4d3b-9203-0684f0172d8b tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:11.941933 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7cfc5e9f-0136-4d3b-9203-0684f0172d8b tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] [instance: a889cd84-d30c-4a3e-95d0-fffe787ba0fc] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:11.956971 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7cfc5e9f-0136-4d3b-9203-0684f0172d8b tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:11.957589 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7cfc5e9f-0136-4d3b-9203-0684f0172d8b tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:11.957908 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7cfc5e9f-0136-4d3b-9203-0684f0172d8b tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:11.958635 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7cfc5e9f-0136-4d3b-9203-0684f0172d8b tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:11.959102 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7cfc5e9f-0136-4d3b-9203-0684f0172d8b tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:11.965330 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7cfc5e9f-0136-4d3b-9203-0684f0172d8b tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:11.994756 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5912c597-3f32-438d-a325-a4798f7f30d4 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:11.995477 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5912c597-3f32-438d-a325-a4798f7f30d4 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 202dbed8-c7d0-46a7-aca4-1ff1d9122d8f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:12.028166 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5912c597-3f32-438d-a325-a4798f7f30d4 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:12.032199 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5912c597-3f32-438d-a325-a4798f7f30d4 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:12.033349 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5912c597-3f32-438d-a325-a4798f7f30d4 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:12.034277 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5912c597-3f32-438d-a325-a4798f7f30d4 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:12.035200 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5912c597-3f32-438d-a325-a4798f7f30d4 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:12.038057 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5912c597-3f32-438d-a325-a4798f7f30d4 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:12.556248 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5912c597-3f32-438d-a325-a4798f7f30d4 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:12.573687 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5912c597-3f32-438d-a325-a4798f7f30d4 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/202dbed8-c7d0-46a7-aca4-1ff1d9122d8f" status: 200 len: 1315 microversion: 2.1 time: 0.583868 Oct 04 18:55:12.576426 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2762/5560] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:11 2022] GET /compute/v2.1/servers/202dbed8-c7d0-46a7-aca4-1ff1d9122d8f => generated 1315 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:55:12.642996 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7cfc5e9f-0136-4d3b-9203-0684f0172d8b tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd422967752f94b3abd31a1c24976655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2264ab7b874626a0e161fe1a8eee1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:12.656689 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7cfc5e9f-0136-4d3b-9203-0684f0172d8b tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] 10.222.0.20 "GET /compute/v2.1/servers/a889cd84-d30c-4a3e-95d0-fffe787ba0fc" status: 200 len: 1324 microversion: 2.1 time: 0.717653 Oct 04 18:55:12.661008 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2799/5561] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:11 2022] GET /compute/v2.1/servers/a889cd84-d30c-4a3e-95d0-fffe787ba0fc => generated 1324 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:13.104935 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-f97ded9b-e534-4485-b829-735bfcfc3b31 req-46301cb9-1186-4635-83e4-c40a10786737 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "202dbed8-c7d0-46a7-aca4-1ff1d9122d8f", "name": "network-vif-plugged", "status": "completed", "tag": "e17b95ea-0e43-4795-956b-ede441ab9cb4"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:55:13.104935 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-f97ded9b-e534-4485-b829-735bfcfc3b31 req-46301cb9-1186-4635-83e4-c40a10786737 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:13.104935 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-f97ded9b-e534-4485-b829-735bfcfc3b31 req-46301cb9-1186-4635-83e4-c40a10786737 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:13.105945 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-f97ded9b-e534-4485-b829-735bfcfc3b31 req-46301cb9-1186-4635-83e4-c40a10786737 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:13.119105 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-f97ded9b-e534-4485-b829-735bfcfc3b31 req-46301cb9-1186-4635-83e4-c40a10786737 service nova] Creating event network-vif-plugged:e17b95ea-0e43-4795-956b-ede441ab9cb4 for instance 202dbed8-c7d0-46a7-aca4-1ff1d9122d8f on n-h1-850501-14 Oct 04 18:55:13.146512 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-f97ded9b-e534-4485-b829-735bfcfc3b31 req-46301cb9-1186-4635-83e4-c40a10786737 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037736 Oct 04 18:55:13.146512 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2763/5562] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:55:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:55:13.603573 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-25bf8c3f-69af-422b-a448-930882b86bff tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:13.604430 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-25bf8c3f-69af-422b-a448-930882b86bff tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 202dbed8-c7d0-46a7-aca4-1ff1d9122d8f] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:13.621950 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-25bf8c3f-69af-422b-a448-930882b86bff tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:13.626893 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-25bf8c3f-69af-422b-a448-930882b86bff tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:13.626893 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-25bf8c3f-69af-422b-a448-930882b86bff tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:13.626893 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-25bf8c3f-69af-422b-a448-930882b86bff tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:13.626893 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-25bf8c3f-69af-422b-a448-930882b86bff tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:13.626893 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-25bf8c3f-69af-422b-a448-930882b86bff tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:13.689552 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1a3d0975-7a06-4ac9-9fe3-094ea2cc665a tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:13.690788 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1a3d0975-7a06-4ac9-9fe3-094ea2cc665a tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] [instance: a889cd84-d30c-4a3e-95d0-fffe787ba0fc] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:13.703140 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1a3d0975-7a06-4ac9-9fe3-094ea2cc665a tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:13.706941 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1a3d0975-7a06-4ac9-9fe3-094ea2cc665a tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:13.709211 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1a3d0975-7a06-4ac9-9fe3-094ea2cc665a tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:13.710571 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1a3d0975-7a06-4ac9-9fe3-094ea2cc665a tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:13.712617 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1a3d0975-7a06-4ac9-9fe3-094ea2cc665a tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:13.714063 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1a3d0975-7a06-4ac9-9fe3-094ea2cc665a tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:13.968323 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-25bf8c3f-69af-422b-a448-930882b86bff tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:13.993899 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-25bf8c3f-69af-422b-a448-930882b86bff tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/202dbed8-c7d0-46a7-aca4-1ff1d9122d8f" status: 200 len: 1315 microversion: 2.1 time: 0.396997 Oct 04 18:55:13.994957 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2800/5563] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:13 2022] GET /compute/v2.1/servers/202dbed8-c7d0-46a7-aca4-1ff1d9122d8f => generated 1315 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:14.146271 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1a3d0975-7a06-4ac9-9fe3-094ea2cc665a tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd422967752f94b3abd31a1c24976655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2264ab7b874626a0e161fe1a8eee1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:14.157674 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1a3d0975-7a06-4ac9-9fe3-094ea2cc665a tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] 10.222.0.20 "GET /compute/v2.1/servers/a889cd84-d30c-4a3e-95d0-fffe787ba0fc" status: 200 len: 1521 microversion: 2.1 time: 0.478522 Oct 04 18:55:14.166874 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2764/5564] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:13 2022] GET /compute/v2.1/servers/a889cd84-d30c-4a3e-95d0-fffe787ba0fc => generated 1521 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:55:14.196347 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-35b47511-4d3c-48c6-bc75-09f2b370b871 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:14.202491 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-35b47511-4d3c-48c6-bc75-09f2b370b871 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] [instance: a889cd84-d30c-4a3e-95d0-fffe787ba0fc] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:14.214250 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-35b47511-4d3c-48c6-bc75-09f2b370b871 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:14.216926 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-35b47511-4d3c-48c6-bc75-09f2b370b871 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:14.219181 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-35b47511-4d3c-48c6-bc75-09f2b370b871 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:14.219181 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-35b47511-4d3c-48c6-bc75-09f2b370b871 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:14.224698 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-35b47511-4d3c-48c6-bc75-09f2b370b871 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:14.225390 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-35b47511-4d3c-48c6-bc75-09f2b370b871 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:14.286238 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-35b47511-4d3c-48c6-bc75-09f2b370b871 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] HTTP exception thrown: Action 999 not found Oct 04 18:55:14.291652 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-35b47511-4d3c-48c6-bc75-09f2b370b871 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Request method failure captured: Oct 04 18:55:14.291652 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/a889cd84-d30c-4a3e-95d0-fffe787ba0fc/os-instance-actions/999 HTTP/1.1 Oct 04 18:55:14.291652 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:55:14.291652 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:55:14.291652 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:55:14.291652 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:55:14.291652 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:55:14.291652 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:55:14.291652 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:55:14.291652 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:55:14.291652 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPIF-Hba-oEAYIDospexoQhDvP04gRLQLgf4P1DN5S5ZhXQYvD0veZvo3djkmi2SqXElk-JTVCCCt_inbFaGcU_u-zRt4-V6LbdTltry2NNvwEARI8prwCVLOLFjRsy0rDmIS0L5qyrf92WUUYu_IdBzJ3Jvq9feNb4llpxWlnvCFtC0 Oct 04 18:55:14.291652 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:55:14.291652 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:55:14.291652 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:55:14.291652 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:55:14.291652 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:55:14.291652 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:55:14.291652 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 2f2264ab7b874626a0e161fe1a8eee1f Oct 04 18:55:14.291652 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1665813674 Oct 04 18:55:14.291652 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:55:14.291652 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:55:14.291652 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2f2264ab7b874626a0e161fe1a8eee1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2f2264ab7b874626a0e161fe1a8eee1f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2f2264ab7b874626a0e161fe1a8eee1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2f2264ab7b874626a0e161fe1a8eee1f"}]}] Oct 04 18:55:14.291652 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1665813674 Oct 04 18:55:14.291652 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 2f2264ab7b874626a0e161fe1a8eee1f Oct 04 18:55:14.291652 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1665813674 Oct 04 18:55:14.291652 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-InstanceActionsNegativeTestJSON-1665813674-project Oct 04 18:55:14.291652 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:55:14.291652 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:55:14.291652 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: d422967752f94b3abd31a1c24976655c Oct 04 18:55:14.291652 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1665813674-project Oct 04 18:55:14.291652 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:55:14.291652 n-d-850501-14 devstack@n-api.service[123001]: exception: Action 999 not found Oct 04 18:55:14.291652 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'server_id': 'a889cd84-d30c-4a3e-95d0-fffe787ba0fc', 'id': '999'} Oct 04 18:55:14.291652 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:55:14.291652 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:14.291652 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:55:14.291652 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:55:14.291652 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:55:14.291652 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:55:14.291652 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:55:14.291652 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:55:14.291652 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Oct 04 18:55:14.291652 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 18:55:14.291652 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Oct 04 18:55:14.291652 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:55:14.291652 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:55:14.291652 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:55:14.291652 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:14.291652 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:55:14.291652 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:55:14.291652 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:55:14.291652 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:55:14.291652 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Oct 04 18:55:14.291652 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:55:14.296078 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-35b47511-4d3c-48c6-bc75-09f2b370b871 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Returning 404 to user: Action 999 not found {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:55:14.297316 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-35b47511-4d3c-48c6-bc75-09f2b370b871 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] 10.222.0.20 "GET /compute/v2.1/servers/a889cd84-d30c-4a3e-95d0-fffe787ba0fc/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.108787 Oct 04 18:55:14.300563 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2801/5565] 10.222.0.20 () {58 vars in 1308 bytes} [Tue Oct 4 18:55:14 2022] GET /compute/v2.1/servers/a889cd84-d30c-4a3e-95d0-fffe787ba0fc/os-instance-actions/999 => generated 66 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:55:14.308632 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-30cd1be1-43d9-4ad0-b0f9-cbcdf79984ec tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Calling method '.version_select at 0x7fe253f994c0>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:14.312027 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-30cd1be1-43d9-4ad0-b0f9-cbcdf79984ec tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] [instance: 663f9d87-fdc3-4826-8540-1f593e21678e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:14.319952 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-30cd1be1-43d9-4ad0-b0f9-cbcdf79984ec tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] HTTP exception thrown: Instance 663f9d87-fdc3-4826-8540-1f593e21678e could not be found. Oct 04 18:55:14.322167 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-30cd1be1-43d9-4ad0-b0f9-cbcdf79984ec tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Request method failure captured: Oct 04 18:55:14.322167 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/663f9d87-fdc3-4826-8540-1f593e21678e/os-instance-actions HTTP/1.1 Oct 04 18:55:14.322167 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:55:14.322167 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:55:14.322167 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:55:14.322167 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:55:14.322167 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:55:14.322167 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:55:14.322167 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:55:14.322167 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:55:14.322167 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPIF-Hba-oEAYIDospexoQhDvP04gRLQLgf4P1DN5S5ZhXQYvD0veZvo3djkmi2SqXElk-JTVCCCt_inbFaGcU_u-zRt4-V6LbdTltry2NNvwEARI8prwCVLOLFjRsy0rDmIS0L5qyrf92WUUYu_IdBzJ3Jvq9feNb4llpxWlnvCFtC0 Oct 04 18:55:14.322167 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:55:14.322167 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:55:14.322167 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:55:14.322167 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:55:14.322167 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:55:14.322167 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:55:14.322167 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 2f2264ab7b874626a0e161fe1a8eee1f Oct 04 18:55:14.322167 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1665813674 Oct 04 18:55:14.322167 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:55:14.322167 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:55:14.322167 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2f2264ab7b874626a0e161fe1a8eee1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2f2264ab7b874626a0e161fe1a8eee1f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2f2264ab7b874626a0e161fe1a8eee1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2f2264ab7b874626a0e161fe1a8eee1f"}]}] Oct 04 18:55:14.322167 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1665813674 Oct 04 18:55:14.322167 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 2f2264ab7b874626a0e161fe1a8eee1f Oct 04 18:55:14.322167 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1665813674 Oct 04 18:55:14.322167 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-InstanceActionsNegativeTestJSON-1665813674-project Oct 04 18:55:14.322167 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:55:14.322167 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:55:14.322167 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: d422967752f94b3abd31a1c24976655c Oct 04 18:55:14.322167 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1665813674-project Oct 04 18:55:14.322167 n-d-850501-14 devstack@n-api.service[123002]: method: Oct 04 18:55:14.322167 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 663f9d87-fdc3-4826-8540-1f593e21678e could not be found. Oct 04 18:55:14.322167 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'server_id': '663f9d87-fdc3-4826-8540-1f593e21678e'} Oct 04 18:55:14.322167 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:55:14.322167 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:14.322167 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:55:14.322167 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:55:14.322167 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:55:14.322167 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:55:14.322167 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:55:14.322167 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:55:14.322167 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 663f9d87-fdc3-4826-8540-1f593e21678e could not be found. Oct 04 18:55:14.322167 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:55:14.322167 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:55:14.322167 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:55:14.322167 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:14.322167 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:55:14.322167 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:55:14.322167 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:55:14.322167 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:55:14.322167 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:55:14.322167 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:55:14.322167 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:55:14.322167 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:55:14.322167 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Oct 04 18:55:14.322167 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Oct 04 18:55:14.322167 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:55:14.322167 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:55:14.322167 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Oct 04 18:55:14.322167 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Oct 04 18:55:14.322167 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:55:14.322167 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:55:14.325997 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 663f9d87-fdc3-4826-8540-1f593e21678e could not be found. Oct 04 18:55:14.325997 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:55:14.325997 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:55:14.325997 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:55:14.325997 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:14.325997 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:55:14.325997 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:55:14.325997 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:55:14.325997 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:55:14.325997 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 663f9d87-fdc3-4826-8540-1f593e21678e could not be found. Oct 04 18:55:14.325997 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:55:14.336136 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-30cd1be1-43d9-4ad0-b0f9-cbcdf79984ec tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Returning 404 to user: Instance 663f9d87-fdc3-4826-8540-1f593e21678e could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:55:14.337202 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-30cd1be1-43d9-4ad0-b0f9-cbcdf79984ec tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] 10.222.0.20 "GET /compute/v2.1/servers/663f9d87-fdc3-4826-8540-1f593e21678e/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.032567 Oct 04 18:55:14.337942 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2765/5566] 10.222.0.20 () {58 vars in 1296 bytes} [Tue Oct 4 18:55:14 2022] GET /compute/v2.1/servers/663f9d87-fdc3-4826-8540-1f593e21678e/os-instance-actions => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:55:14.347277 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0705f304-579d-4b78-ad7a-bf74876c9ecf tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:14.348120 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0705f304-579d-4b78-ad7a-bf74876c9ecf tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] [instance: a889cd84-d30c-4a3e-95d0-fffe787ba0fc] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:14.359260 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0705f304-579d-4b78-ad7a-bf74876c9ecf tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:14.361734 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0705f304-579d-4b78-ad7a-bf74876c9ecf tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:14.362285 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0705f304-579d-4b78-ad7a-bf74876c9ecf tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:14.363217 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0705f304-579d-4b78-ad7a-bf74876c9ecf tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:14.367479 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0705f304-579d-4b78-ad7a-bf74876c9ecf tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:14.368396 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0705f304-579d-4b78-ad7a-bf74876c9ecf tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:14.430873 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0705f304-579d-4b78-ad7a-bf74876c9ecf tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] [instance: a889cd84-d30c-4a3e-95d0-fffe787ba0fc] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:55:14.864882 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0705f304-579d-4b78-ad7a-bf74876c9ecf tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a889cd84-d30c-4a3e-95d0-fffe787ba0fc" status: 204 len: 0 microversion: 2.1 time: 0.521518 Oct 04 18:55:14.866212 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2802/5567] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:55:14 2022] DELETE /compute/v2.1/servers/a889cd84-d30c-4a3e-95d0-fffe787ba0fc => generated 0 bytes in 524 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:55:14.874431 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-93e871bd-fd4d-4bd3-9fd6-7477a2c708f7 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:14.875053 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-93e871bd-fd4d-4bd3-9fd6-7477a2c708f7 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] [instance: a889cd84-d30c-4a3e-95d0-fffe787ba0fc] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:14.894670 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-93e871bd-fd4d-4bd3-9fd6-7477a2c708f7 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:14.894670 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-93e871bd-fd4d-4bd3-9fd6-7477a2c708f7 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:14.894670 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-93e871bd-fd4d-4bd3-9fd6-7477a2c708f7 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:14.894670 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-93e871bd-fd4d-4bd3-9fd6-7477a2c708f7 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:14.895763 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-93e871bd-fd4d-4bd3-9fd6-7477a2c708f7 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:14.896481 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-93e871bd-fd4d-4bd3-9fd6-7477a2c708f7 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:15.022355 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-dbb511c0-ce25-47d6-885f-4e9d95525fd7 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:15.022355 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-dbb511c0-ce25-47d6-885f-4e9d95525fd7 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 202dbed8-c7d0-46a7-aca4-1ff1d9122d8f] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:15.031427 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dbb511c0-ce25-47d6-885f-4e9d95525fd7 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:15.031924 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dbb511c0-ce25-47d6-885f-4e9d95525fd7 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:15.038022 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dbb511c0-ce25-47d6-885f-4e9d95525fd7 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:15.038813 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dbb511c0-ce25-47d6-885f-4e9d95525fd7 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:15.039291 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dbb511c0-ce25-47d6-885f-4e9d95525fd7 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:15.039721 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dbb511c0-ce25-47d6-885f-4e9d95525fd7 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:15.108971 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-93e871bd-fd4d-4bd3-9fd6-7477a2c708f7 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd422967752f94b3abd31a1c24976655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2264ab7b874626a0e161fe1a8eee1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:15.121045 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-93e871bd-fd4d-4bd3-9fd6-7477a2c708f7 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] 10.222.0.20 "GET /compute/v2.1/servers/a889cd84-d30c-4a3e-95d0-fffe787ba0fc" status: 200 len: 1527 microversion: 2.1 time: 0.250599 Oct 04 18:55:15.123475 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2766/5568] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:14 2022] GET /compute/v2.1/servers/a889cd84-d30c-4a3e-95d0-fffe787ba0fc => generated 1527 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:15.460584 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-dbb511c0-ce25-47d6-885f-4e9d95525fd7 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:15.479149 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-dbb511c0-ce25-47d6-885f-4e9d95525fd7 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/202dbed8-c7d0-46a7-aca4-1ff1d9122d8f" status: 200 len: 1502 microversion: 2.1 time: 0.463929 Oct 04 18:55:15.479855 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2803/5569] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:15 2022] GET /compute/v2.1/servers/202dbed8-c7d0-46a7-aca4-1ff1d9122d8f => generated 1502 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:15.507227 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6c2ce7ab-34fc-42d8-86ea-ed0d77508633 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:55:15.509630 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-6c2ce7ab-34fc-42d8-86ea-ed0d77508633 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 202dbed8-c7d0-46a7-aca4-1ff1d9122d8f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:15.520021 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6c2ce7ab-34fc-42d8-86ea-ed0d77508633 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:15.521245 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6c2ce7ab-34fc-42d8-86ea-ed0d77508633 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:15.522281 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6c2ce7ab-34fc-42d8-86ea-ed0d77508633 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:15.523170 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6c2ce7ab-34fc-42d8-86ea-ed0d77508633 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:15.528985 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6c2ce7ab-34fc-42d8-86ea-ed0d77508633 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:15.529914 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6c2ce7ab-34fc-42d8-86ea-ed0d77508633 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:15.588607 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:55:15.890721 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6c2ce7ab-34fc-42d8-86ea-ed0d77508633 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "POST /compute/v2.1/servers/202dbed8-c7d0-46a7-aca4-1ff1d9122d8f/action" status: 202 len: 0 microversion: 2.1 time: 0.386809 Oct 04 18:55:15.892200 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2767/5570] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:55:15 2022] POST /compute/v2.1/servers/202dbed8-c7d0-46a7-aca4-1ff1d9122d8f/action => generated 0 bytes in 393 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:55:15.900298 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-fc0d3a92-ba3d-4f09-98c0-b2cc012fb2b0 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:15.900917 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-fc0d3a92-ba3d-4f09-98c0-b2cc012fb2b0 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 202dbed8-c7d0-46a7-aca4-1ff1d9122d8f] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:15.933534 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fc0d3a92-ba3d-4f09-98c0-b2cc012fb2b0 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:15.934089 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fc0d3a92-ba3d-4f09-98c0-b2cc012fb2b0 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:15.936404 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fc0d3a92-ba3d-4f09-98c0-b2cc012fb2b0 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:15.944480 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fc0d3a92-ba3d-4f09-98c0-b2cc012fb2b0 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:15.945006 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fc0d3a92-ba3d-4f09-98c0-b2cc012fb2b0 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:15.945461 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fc0d3a92-ba3d-4f09-98c0-b2cc012fb2b0 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:16.149263 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2e0d921b-b1ad-43e7-a0c9-c6fe4c1edf08 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:16.149983 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2e0d921b-b1ad-43e7-a0c9-c6fe4c1edf08 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] [instance: a889cd84-d30c-4a3e-95d0-fffe787ba0fc] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:16.187458 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e0d921b-b1ad-43e7-a0c9-c6fe4c1edf08 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:16.187973 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e0d921b-b1ad-43e7-a0c9-c6fe4c1edf08 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:16.189038 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e0d921b-b1ad-43e7-a0c9-c6fe4c1edf08 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:16.189769 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e0d921b-b1ad-43e7-a0c9-c6fe4c1edf08 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:16.190235 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e0d921b-b1ad-43e7-a0c9-c6fe4c1edf08 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:16.190666 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e0d921b-b1ad-43e7-a0c9-c6fe4c1edf08 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:16.768299 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2e0d921b-b1ad-43e7-a0c9-c6fe4c1edf08 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd422967752f94b3abd31a1c24976655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2264ab7b874626a0e161fe1a8eee1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:16.785179 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2e0d921b-b1ad-43e7-a0c9-c6fe4c1edf08 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] 10.222.0.20 "GET /compute/v2.1/servers/a889cd84-d30c-4a3e-95d0-fffe787ba0fc" status: 200 len: 1527 microversion: 2.1 time: 0.640958 Oct 04 18:55:16.786175 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2768/5571] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:16 2022] GET /compute/v2.1/servers/a889cd84-d30c-4a3e-95d0-fffe787ba0fc => generated 1527 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:16.802942 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-fc0d3a92-ba3d-4f09-98c0-b2cc012fb2b0 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:16.816963 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-fc0d3a92-ba3d-4f09-98c0-b2cc012fb2b0 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/202dbed8-c7d0-46a7-aca4-1ff1d9122d8f" status: 200 len: 1507 microversion: 2.1 time: 0.920676 Oct 04 18:55:16.853708 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2804/5572] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:15 2022] GET /compute/v2.1/servers/202dbed8-c7d0-46a7-aca4-1ff1d9122d8f => generated 1507 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:17.811833 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4ce22d9d-330a-40d7-926f-075ce4e67d33 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:17.812677 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4ce22d9d-330a-40d7-926f-075ce4e67d33 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] [instance: a889cd84-d30c-4a3e-95d0-fffe787ba0fc] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:17.838405 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4ce22d9d-330a-40d7-926f-075ce4e67d33 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:17.839699 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4ce22d9d-330a-40d7-926f-075ce4e67d33 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:17.840511 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4ce22d9d-330a-40d7-926f-075ce4e67d33 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:17.849296 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4ce22d9d-330a-40d7-926f-075ce4e67d33 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:17.850013 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4ce22d9d-330a-40d7-926f-075ce4e67d33 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:17.851348 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4ce22d9d-330a-40d7-926f-075ce4e67d33 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:17.885357 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-17eaab37-19d7-4e80-a317-899cb6c5f8f8 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:17.886122 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-17eaab37-19d7-4e80-a317-899cb6c5f8f8 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 202dbed8-c7d0-46a7-aca4-1ff1d9122d8f] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:17.902950 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-17eaab37-19d7-4e80-a317-899cb6c5f8f8 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:17.903504 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-17eaab37-19d7-4e80-a317-899cb6c5f8f8 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:17.903897 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-17eaab37-19d7-4e80-a317-899cb6c5f8f8 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:17.904643 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-17eaab37-19d7-4e80-a317-899cb6c5f8f8 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:17.905138 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-17eaab37-19d7-4e80-a317-899cb6c5f8f8 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:17.905522 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-17eaab37-19d7-4e80-a317-899cb6c5f8f8 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:18.033052 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4ce22d9d-330a-40d7-926f-075ce4e67d33 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd422967752f94b3abd31a1c24976655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2264ab7b874626a0e161fe1a8eee1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:18.051766 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4ce22d9d-330a-40d7-926f-075ce4e67d33 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] 10.222.0.20 "GET /compute/v2.1/servers/a889cd84-d30c-4a3e-95d0-fffe787ba0fc" status: 200 len: 1485 microversion: 2.1 time: 0.244222 Oct 04 18:55:18.052610 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2769/5573] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:17 2022] GET /compute/v2.1/servers/a889cd84-d30c-4a3e-95d0-fffe787ba0fc => generated 1485 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:18.062796 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-5f443962-1737-4580-82c0-d881879f9776 req-9d75d485-541f-45bc-ad88-1f0fa6a20e16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a889cd84-d30c-4a3e-95d0-fffe787ba0fc", "name": "network-vif-deleted", "tag": "eb8e836f-fe41-461e-afdb-3ad6e2e9041b"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:55:18.091188 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-5f443962-1737-4580-82c0-d881879f9776 req-9d75d485-541f-45bc-ad88-1f0fa6a20e16 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:18.091798 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-5f443962-1737-4580-82c0-d881879f9776 req-9d75d485-541f-45bc-ad88-1f0fa6a20e16 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:18.096039 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-5f443962-1737-4580-82c0-d881879f9776 req-9d75d485-541f-45bc-ad88-1f0fa6a20e16 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:18.114143 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-5f443962-1737-4580-82c0-d881879f9776 req-9d75d485-541f-45bc-ad88-1f0fa6a20e16 service nova] Creating event network-vif-deleted:eb8e836f-fe41-461e-afdb-3ad6e2e9041b for instance a889cd84-d30c-4a3e-95d0-fffe787ba0fc on n-h1-850501-14 Oct 04 18:55:18.119766 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-5f443962-1737-4580-82c0-d881879f9776 req-9d75d485-541f-45bc-ad88-1f0fa6a20e16 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065695 Oct 04 18:55:18.124857 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2770/5574] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:55:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:55:18.673836 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-17eaab37-19d7-4e80-a317-899cb6c5f8f8 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:18.697189 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-17eaab37-19d7-4e80-a317-899cb6c5f8f8 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/202dbed8-c7d0-46a7-aca4-1ff1d9122d8f" status: 200 len: 1487 microversion: 2.1 time: 0.824024 Oct 04 18:55:18.697878 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2805/5575] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:17 2022] GET /compute/v2.1/servers/202dbed8-c7d0-46a7-aca4-1ff1d9122d8f => generated 1487 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:18.735620 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-36f1cb48-7245-437e-a52a-4d4cf73d7810 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:55:18.738778 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-36f1cb48-7245-437e-a52a-4d4cf73d7810 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 202dbed8-c7d0-46a7-aca4-1ff1d9122d8f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:18.758628 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-36f1cb48-7245-437e-a52a-4d4cf73d7810 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:18.765791 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-36f1cb48-7245-437e-a52a-4d4cf73d7810 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:18.765791 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-36f1cb48-7245-437e-a52a-4d4cf73d7810 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:18.765791 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-36f1cb48-7245-437e-a52a-4d4cf73d7810 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:18.765791 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-36f1cb48-7245-437e-a52a-4d4cf73d7810 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:18.765791 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-36f1cb48-7245-437e-a52a-4d4cf73d7810 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:18.849399 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-36f1cb48-7245-437e-a52a-4d4cf73d7810 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lazy-loading 'flavor' on Instance uuid 202dbed8-c7d0-46a7-aca4-1ff1d9122d8f {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:55:19.089877 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-020fdae3-cee5-4083-baa8-8398b251a47b tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:19.091207 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-020fdae3-cee5-4083-baa8-8398b251a47b tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] [instance: a889cd84-d30c-4a3e-95d0-fffe787ba0fc] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:19.107704 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-020fdae3-cee5-4083-baa8-8398b251a47b tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:19.111887 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-020fdae3-cee5-4083-baa8-8398b251a47b tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:19.114337 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-020fdae3-cee5-4083-baa8-8398b251a47b tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:19.119930 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-020fdae3-cee5-4083-baa8-8398b251a47b tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:19.121528 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-020fdae3-cee5-4083-baa8-8398b251a47b tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:19.122237 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-020fdae3-cee5-4083-baa8-8398b251a47b tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:19.218476 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-020fdae3-cee5-4083-baa8-8398b251a47b tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:19.219104 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-020fdae3-cee5-4083-baa8-8398b251a47b tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:19.220941 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-020fdae3-cee5-4083-baa8-8398b251a47b tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:19.223811 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-020fdae3-cee5-4083-baa8-8398b251a47b tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Lazy-loading 'fault' on Instance uuid a889cd84-d30c-4a3e-95d0-fffe787ba0fc {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:55:19.534235 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-020fdae3-cee5-4083-baa8-8398b251a47b tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd422967752f94b3abd31a1c24976655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2264ab7b874626a0e161fe1a8eee1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:19.546562 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-020fdae3-cee5-4083-baa8-8398b251a47b tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] 10.222.0.20 "GET /compute/v2.1/servers/a889cd84-d30c-4a3e-95d0-fffe787ba0fc" status: 200 len: 1314 microversion: 2.1 time: 0.465582 Oct 04 18:55:19.549094 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2806/5576] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:19 2022] GET /compute/v2.1/servers/a889cd84-d30c-4a3e-95d0-fffe787ba0fc => generated 1314 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:55:19.762934 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-36f1cb48-7245-437e-a52a-4d4cf73d7810 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "POST /compute/v2.1/servers/202dbed8-c7d0-46a7-aca4-1ff1d9122d8f/action" status: 202 len: 0 microversion: 2.1 time: 1.038721 Oct 04 18:55:19.765077 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2771/5577] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:55:18 2022] POST /compute/v2.1/servers/202dbed8-c7d0-46a7-aca4-1ff1d9122d8f/action => generated 0 bytes in 1043 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:55:19.774562 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-28ceb76f-aa29-4a87-b289-a2ab31f95c3a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:19.775838 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-28ceb76f-aa29-4a87-b289-a2ab31f95c3a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 202dbed8-c7d0-46a7-aca4-1ff1d9122d8f] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:19.796214 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-28ceb76f-aa29-4a87-b289-a2ab31f95c3a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:19.799266 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-28ceb76f-aa29-4a87-b289-a2ab31f95c3a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:19.803739 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-28ceb76f-aa29-4a87-b289-a2ab31f95c3a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:19.805231 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-28ceb76f-aa29-4a87-b289-a2ab31f95c3a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:19.807997 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-28ceb76f-aa29-4a87-b289-a2ab31f95c3a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:19.808678 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-28ceb76f-aa29-4a87-b289-a2ab31f95c3a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:20.385289 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-28ceb76f-aa29-4a87-b289-a2ab31f95c3a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:20.415298 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-28ceb76f-aa29-4a87-b289-a2ab31f95c3a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/202dbed8-c7d0-46a7-aca4-1ff1d9122d8f" status: 200 len: 1493 microversion: 2.1 time: 0.645391 Oct 04 18:55:20.419212 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2807/5578] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:19 2022] GET /compute/v2.1/servers/202dbed8-c7d0-46a7-aca4-1ff1d9122d8f => generated 1493 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:20.583731 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ce7677da-4da1-4a32-9daf-60633c911665 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:20.585099 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ce7677da-4da1-4a32-9daf-60633c911665 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] [instance: a889cd84-d30c-4a3e-95d0-fffe787ba0fc] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:20.630030 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ce7677da-4da1-4a32-9daf-60633c911665 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:20.631499 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ce7677da-4da1-4a32-9daf-60633c911665 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:20.631499 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ce7677da-4da1-4a32-9daf-60633c911665 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:20.633872 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ce7677da-4da1-4a32-9daf-60633c911665 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:20.636134 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ce7677da-4da1-4a32-9daf-60633c911665 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:20.641800 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ce7677da-4da1-4a32-9daf-60633c911665 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:20.696862 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-ce7677da-4da1-4a32-9daf-60633c911665 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] HTTP exception thrown: Instance a889cd84-d30c-4a3e-95d0-fffe787ba0fc could not be found. Oct 04 18:55:20.703434 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ce7677da-4da1-4a32-9daf-60633c911665 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Request method failure captured: Oct 04 18:55:20.703434 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/a889cd84-d30c-4a3e-95d0-fffe787ba0fc HTTP/1.1 Oct 04 18:55:20.703434 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:55:20.703434 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:55:20.703434 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:55:20.703434 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:55:20.703434 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:55:20.703434 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:55:20.703434 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:55:20.703434 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:55:20.703434 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPIF-Hba-oEAYIDospexoQhDvP04gRLQLgf4P1DN5S5ZhXQYvD0veZvo3djkmi2SqXElk-JTVCCCt_inbFaGcU_u-zRt4-V6LbdTltry2NNvwEARI8prwCVLOLFjRsy0rDmIS0L5qyrf92WUUYu_IdBzJ3Jvq9feNb4llpxWlnvCFtC0 Oct 04 18:55:20.703434 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:55:20.703434 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:55:20.703434 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:55:20.703434 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:55:20.703434 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:55:20.703434 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:55:20.703434 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 2f2264ab7b874626a0e161fe1a8eee1f Oct 04 18:55:20.703434 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1665813674 Oct 04 18:55:20.703434 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:55:20.703434 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:55:20.703434 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2f2264ab7b874626a0e161fe1a8eee1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2f2264ab7b874626a0e161fe1a8eee1f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2f2264ab7b874626a0e161fe1a8eee1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2f2264ab7b874626a0e161fe1a8eee1f"}]}] Oct 04 18:55:20.703434 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1665813674 Oct 04 18:55:20.703434 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 2f2264ab7b874626a0e161fe1a8eee1f Oct 04 18:55:20.703434 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1665813674 Oct 04 18:55:20.703434 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-InstanceActionsNegativeTestJSON-1665813674-project Oct 04 18:55:20.703434 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:55:20.703434 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:55:20.703434 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: d422967752f94b3abd31a1c24976655c Oct 04 18:55:20.703434 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1665813674-project Oct 04 18:55:20.703434 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:55:20.703434 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance a889cd84-d30c-4a3e-95d0-fffe787ba0fc could not be found. Oct 04 18:55:20.703434 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'a889cd84-d30c-4a3e-95d0-fffe787ba0fc'} Oct 04 18:55:20.703434 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:55:20.703434 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:20.703434 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:55:20.703434 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:55:20.703434 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:55:20.703434 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:55:20.703434 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:55:20.703434 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:55:20.703434 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:55:20.703434 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:55:20.703434 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a889cd84-d30c-4a3e-95d0-fffe787ba0fc could not be found. Oct 04 18:55:20.703434 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:55:20.703434 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:55:20.703434 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:55:20.703434 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:20.703434 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:55:20.703434 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:55:20.703434 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:55:20.703434 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:55:20.703434 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:55:20.703434 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:55:20.703434 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:55:20.703434 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:55:20.703434 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:55:20.703434 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:55:20.703434 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:55:20.703434 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:55:20.703434 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a889cd84-d30c-4a3e-95d0-fffe787ba0fc could not be found. Oct 04 18:55:20.703434 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:55:20.703434 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:55:20.709990 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:55:20.709990 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:20.709990 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:55:20.709990 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:55:20.709990 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:55:20.709990 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:55:20.709990 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a889cd84-d30c-4a3e-95d0-fffe787ba0fc could not be found. Oct 04 18:55:20.709990 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:55:20.709990 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ce7677da-4da1-4a32-9daf-60633c911665 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] Returning 404 to user: Instance a889cd84-d30c-4a3e-95d0-fffe787ba0fc could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:55:20.709990 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ce7677da-4da1-4a32-9daf-60633c911665 tempest-InstanceActionsNegativeTestJSON-1665813674 tempest-InstanceActionsNegativeTestJSON-1665813674-project] 10.222.0.20 "GET /compute/v2.1/servers/a889cd84-d30c-4a3e-95d0-fffe787ba0fc" status: 404 len: 111 microversion: 2.1 time: 0.130411 Oct 04 18:55:20.730444 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2772/5579] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:20 2022] GET /compute/v2.1/servers/a889cd84-d30c-4a3e-95d0-fffe787ba0fc => generated 111 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:55:20.860903 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c1036e3a-8728-4b49-8398-7de3c922c860 tempest-ExtensionsTest-600692708 tempest-ExtensionsTest-600692708-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:20.862849 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c1036e3a-8728-4b49-8398-7de3c922c860 tempest-ExtensionsTest-600692708 tempest-ExtensionsTest-600692708-project] 10.222.0.20 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.242465 Oct 04 18:55:20.863820 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2808/5580] 10.222.0.20 () {58 vars in 1170 bytes} [Tue Oct 4 18:55:20 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:55:20.873266 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d03f9229-4e11-4d42-84ea-15021c962a16 tempest-ExtensionsTest-600692708 tempest-ExtensionsTest-600692708-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:20.879703 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d03f9229-4e11-4d42-84ea-15021c962a16 tempest-ExtensionsTest-600692708 tempest-ExtensionsTest-600692708-project] 10.222.0.20 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.010457 Oct 04 18:55:20.880580 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2773/5581] 10.222.0.20 () {58 vars in 1134 bytes} [Tue Oct 4 18:55:20 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:55:21.444888 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-72ecd9d8-d367-4f60-8ea1-7e1527f34ac9 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:21.445515 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-72ecd9d8-d367-4f60-8ea1-7e1527f34ac9 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 202dbed8-c7d0-46a7-aca4-1ff1d9122d8f] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:21.458924 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:55:21.460452 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-72ecd9d8-d367-4f60-8ea1-7e1527f34ac9 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:21.460953 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-72ecd9d8-d367-4f60-8ea1-7e1527f34ac9 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:21.461398 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-72ecd9d8-d367-4f60-8ea1-7e1527f34ac9 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:21.462118 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-72ecd9d8-d367-4f60-8ea1-7e1527f34ac9 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:21.462583 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-72ecd9d8-d367-4f60-8ea1-7e1527f34ac9 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:21.463017 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-72ecd9d8-d367-4f60-8ea1-7e1527f34ac9 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:21.465884 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:55:21.875582 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-72ecd9d8-d367-4f60-8ea1-7e1527f34ac9 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:21.897950 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-72ecd9d8-d367-4f60-8ea1-7e1527f34ac9 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/202dbed8-c7d0-46a7-aca4-1ff1d9122d8f" status: 200 len: 1514 microversion: 2.1 time: 0.458519 Oct 04 18:55:21.898583 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2809/5582] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:21 2022] GET /compute/v2.1/servers/202dbed8-c7d0-46a7-aca4-1ff1d9122d8f => generated 1514 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:22.928777 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f21263e7-23ad-43bb-8f13-10adb6fa254d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:22.930267 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f21263e7-23ad-43bb-8f13-10adb6fa254d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 202dbed8-c7d0-46a7-aca4-1ff1d9122d8f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:22.943382 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f21263e7-23ad-43bb-8f13-10adb6fa254d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:22.944159 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f21263e7-23ad-43bb-8f13-10adb6fa254d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:22.944822 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f21263e7-23ad-43bb-8f13-10adb6fa254d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:22.945723 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f21263e7-23ad-43bb-8f13-10adb6fa254d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:22.946348 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f21263e7-23ad-43bb-8f13-10adb6fa254d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:22.947454 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f21263e7-23ad-43bb-8f13-10adb6fa254d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:23.656512 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f21263e7-23ad-43bb-8f13-10adb6fa254d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:23.676381 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f21263e7-23ad-43bb-8f13-10adb6fa254d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/202dbed8-c7d0-46a7-aca4-1ff1d9122d8f" status: 200 len: 1509 microversion: 2.1 time: 0.750686 Oct 04 18:55:23.679348 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2774/5583] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:22 2022] GET /compute/v2.1/servers/202dbed8-c7d0-46a7-aca4-1ff1d9122d8f => generated 1509 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:24.710418 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9c47eaea-00e3-4edb-996c-1117842434aa tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:24.711674 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-9c47eaea-00e3-4edb-996c-1117842434aa tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 202dbed8-c7d0-46a7-aca4-1ff1d9122d8f] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:24.730369 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9c47eaea-00e3-4edb-996c-1117842434aa tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:24.734229 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9c47eaea-00e3-4edb-996c-1117842434aa tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:24.737653 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9c47eaea-00e3-4edb-996c-1117842434aa tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:24.738598 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9c47eaea-00e3-4edb-996c-1117842434aa tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:24.739753 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9c47eaea-00e3-4edb-996c-1117842434aa tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:24.740313 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9c47eaea-00e3-4edb-996c-1117842434aa tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:25.406913 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9c47eaea-00e3-4edb-996c-1117842434aa tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:25.426170 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9c47eaea-00e3-4edb-996c-1117842434aa tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/202dbed8-c7d0-46a7-aca4-1ff1d9122d8f" status: 200 len: 1509 microversion: 2.1 time: 0.720094 Oct 04 18:55:25.444886 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2810/5584] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:24 2022] GET /compute/v2.1/servers/202dbed8-c7d0-46a7-aca4-1ff1d9122d8f => generated 1509 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:25.995778 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-7e34187e-bb01-43a8-8bcf-ac0cc7418a85 req-7fdd0397-9bcc-48d2-9330-ea0c7c001642 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "202dbed8-c7d0-46a7-aca4-1ff1d9122d8f", "name": "network-vif-plugged", "status": "completed", "tag": "e17b95ea-0e43-4795-956b-ede441ab9cb4"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:55:26.029363 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-7e34187e-bb01-43a8-8bcf-ac0cc7418a85 req-7fdd0397-9bcc-48d2-9330-ea0c7c001642 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:26.040854 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-7e34187e-bb01-43a8-8bcf-ac0cc7418a85 req-7fdd0397-9bcc-48d2-9330-ea0c7c001642 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:26.041311 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-7e34187e-bb01-43a8-8bcf-ac0cc7418a85 req-7fdd0397-9bcc-48d2-9330-ea0c7c001642 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:26.109555 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-7e34187e-bb01-43a8-8bcf-ac0cc7418a85 req-7fdd0397-9bcc-48d2-9330-ea0c7c001642 service nova] Creating event network-vif-plugged:e17b95ea-0e43-4795-956b-ede441ab9cb4 for instance 202dbed8-c7d0-46a7-aca4-1ff1d9122d8f on n-h1-850501-14 Oct 04 18:55:26.127788 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-7e34187e-bb01-43a8-8bcf-ac0cc7418a85 req-7fdd0397-9bcc-48d2-9330-ea0c7c001642 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136291 Oct 04 18:55:26.140718 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2775/5585] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:55:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:55:26.464958 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-eaf89be8-7cd7-4ef3-99da-6d97b6012874 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:26.466817 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-eaf89be8-7cd7-4ef3-99da-6d97b6012874 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 202dbed8-c7d0-46a7-aca4-1ff1d9122d8f] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:26.514596 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eaf89be8-7cd7-4ef3-99da-6d97b6012874 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:26.514596 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eaf89be8-7cd7-4ef3-99da-6d97b6012874 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:26.514596 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eaf89be8-7cd7-4ef3-99da-6d97b6012874 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:26.518845 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eaf89be8-7cd7-4ef3-99da-6d97b6012874 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:26.519430 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eaf89be8-7cd7-4ef3-99da-6d97b6012874 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:26.519899 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eaf89be8-7cd7-4ef3-99da-6d97b6012874 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:27.473016 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-eaf89be8-7cd7-4ef3-99da-6d97b6012874 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:27.492965 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-eaf89be8-7cd7-4ef3-99da-6d97b6012874 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/202dbed8-c7d0-46a7-aca4-1ff1d9122d8f" status: 200 len: 1509 microversion: 2.1 time: 1.033269 Oct 04 18:55:27.494955 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2811/5586] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:26 2022] GET /compute/v2.1/servers/202dbed8-c7d0-46a7-aca4-1ff1d9122d8f => generated 1509 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:28.527808 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4718fa94-0352-4eca-a5c4-f9fa9bdd1ef1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:28.528668 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4718fa94-0352-4eca-a5c4-f9fa9bdd1ef1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 202dbed8-c7d0-46a7-aca4-1ff1d9122d8f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:28.542682 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4718fa94-0352-4eca-a5c4-f9fa9bdd1ef1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:28.543459 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4718fa94-0352-4eca-a5c4-f9fa9bdd1ef1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:28.543929 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4718fa94-0352-4eca-a5c4-f9fa9bdd1ef1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:28.561433 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4718fa94-0352-4eca-a5c4-f9fa9bdd1ef1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:28.562040 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4718fa94-0352-4eca-a5c4-f9fa9bdd1ef1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:28.562491 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4718fa94-0352-4eca-a5c4-f9fa9bdd1ef1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:29.362279 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4718fa94-0352-4eca-a5c4-f9fa9bdd1ef1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:29.397652 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4718fa94-0352-4eca-a5c4-f9fa9bdd1ef1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/202dbed8-c7d0-46a7-aca4-1ff1d9122d8f" status: 200 len: 1509 microversion: 2.1 time: 0.874868 Oct 04 18:55:29.398263 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2776/5587] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:28 2022] GET /compute/v2.1/servers/202dbed8-c7d0-46a7-aca4-1ff1d9122d8f => generated 1509 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:30.425639 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-49faa46b-f083-4035-b265-d88d53eb9610 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:30.427584 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-49faa46b-f083-4035-b265-d88d53eb9610 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 202dbed8-c7d0-46a7-aca4-1ff1d9122d8f] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:30.442737 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-49faa46b-f083-4035-b265-d88d53eb9610 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:30.444502 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-49faa46b-f083-4035-b265-d88d53eb9610 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:30.448486 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-49faa46b-f083-4035-b265-d88d53eb9610 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:30.450811 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-49faa46b-f083-4035-b265-d88d53eb9610 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:30.453144 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-49faa46b-f083-4035-b265-d88d53eb9610 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:30.454518 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-49faa46b-f083-4035-b265-d88d53eb9610 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:31.441277 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-49faa46b-f083-4035-b265-d88d53eb9610 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:31.456459 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-49faa46b-f083-4035-b265-d88d53eb9610 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/202dbed8-c7d0-46a7-aca4-1ff1d9122d8f" status: 200 len: 1509 microversion: 2.1 time: 1.033720 Oct 04 18:55:31.486341 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2812/5588] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:30 2022] GET /compute/v2.1/servers/202dbed8-c7d0-46a7-aca4-1ff1d9122d8f => generated 1509 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:32.497631 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-cdd644d8-3973-4457-a5cc-5e9b5ecc0c2d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:32.499369 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-cdd644d8-3973-4457-a5cc-5e9b5ecc0c2d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 202dbed8-c7d0-46a7-aca4-1ff1d9122d8f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:32.520934 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cdd644d8-3973-4457-a5cc-5e9b5ecc0c2d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:32.527178 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cdd644d8-3973-4457-a5cc-5e9b5ecc0c2d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:32.528075 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cdd644d8-3973-4457-a5cc-5e9b5ecc0c2d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:32.528856 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cdd644d8-3973-4457-a5cc-5e9b5ecc0c2d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:32.532984 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cdd644d8-3973-4457-a5cc-5e9b5ecc0c2d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:32.533485 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cdd644d8-3973-4457-a5cc-5e9b5ecc0c2d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:32.877750 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-cdd644d8-3973-4457-a5cc-5e9b5ecc0c2d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:32.889221 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-cdd644d8-3973-4457-a5cc-5e9b5ecc0c2d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/202dbed8-c7d0-46a7-aca4-1ff1d9122d8f" status: 200 len: 1509 microversion: 2.1 time: 0.403697 Oct 04 18:55:32.908090 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2777/5589] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:32 2022] GET /compute/v2.1/servers/202dbed8-c7d0-46a7-aca4-1ff1d9122d8f => generated 1509 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:33.924673 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1b0db68f-f806-4064-9544-c2b838b42083 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:33.927472 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1b0db68f-f806-4064-9544-c2b838b42083 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 202dbed8-c7d0-46a7-aca4-1ff1d9122d8f] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:33.943996 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1b0db68f-f806-4064-9544-c2b838b42083 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:33.944905 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1b0db68f-f806-4064-9544-c2b838b42083 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:33.945562 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1b0db68f-f806-4064-9544-c2b838b42083 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:33.946554 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1b0db68f-f806-4064-9544-c2b838b42083 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:33.948581 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1b0db68f-f806-4064-9544-c2b838b42083 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:33.950010 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1b0db68f-f806-4064-9544-c2b838b42083 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:34.382711 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1b0db68f-f806-4064-9544-c2b838b42083 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:34.399948 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1b0db68f-f806-4064-9544-c2b838b42083 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/202dbed8-c7d0-46a7-aca4-1ff1d9122d8f" status: 200 len: 1509 microversion: 2.1 time: 0.483002 Oct 04 18:55:34.416156 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2813/5590] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:33 2022] GET /compute/v2.1/servers/202dbed8-c7d0-46a7-aca4-1ff1d9122d8f => generated 1509 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:35.432323 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6323a566-5eca-4649-9870-4b30f384e9a1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:35.432947 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-6323a566-5eca-4649-9870-4b30f384e9a1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 202dbed8-c7d0-46a7-aca4-1ff1d9122d8f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:35.444565 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=56 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:55:35.445888 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6323a566-5eca-4649-9870-4b30f384e9a1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:35.446384 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6323a566-5eca-4649-9870-4b30f384e9a1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:35.446829 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6323a566-5eca-4649-9870-4b30f384e9a1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:35.447543 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6323a566-5eca-4649-9870-4b30f384e9a1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:35.448009 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6323a566-5eca-4649-9870-4b30f384e9a1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:35.448468 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6323a566-5eca-4649-9870-4b30f384e9a1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:36.129031 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-6323a566-5eca-4649-9870-4b30f384e9a1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:36.185716 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6323a566-5eca-4649-9870-4b30f384e9a1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/202dbed8-c7d0-46a7-aca4-1ff1d9122d8f" status: 200 len: 1509 microversion: 2.1 time: 0.756879 Oct 04 18:55:36.188474 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2778/5591] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:35 2022] GET /compute/v2.1/servers/202dbed8-c7d0-46a7-aca4-1ff1d9122d8f => generated 1509 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:37.216582 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-79864db1-c519-44bd-a895-fe893e36fbb9 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:37.217218 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-79864db1-c519-44bd-a895-fe893e36fbb9 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 202dbed8-c7d0-46a7-aca4-1ff1d9122d8f] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:37.236290 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-79864db1-c519-44bd-a895-fe893e36fbb9 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:37.244730 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-79864db1-c519-44bd-a895-fe893e36fbb9 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:37.245204 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-79864db1-c519-44bd-a895-fe893e36fbb9 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:37.249592 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-79864db1-c519-44bd-a895-fe893e36fbb9 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:37.249977 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-79864db1-c519-44bd-a895-fe893e36fbb9 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:37.253175 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-79864db1-c519-44bd-a895-fe893e36fbb9 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:37.962492 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-79864db1-c519-44bd-a895-fe893e36fbb9 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:37.979654 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-79864db1-c519-44bd-a895-fe893e36fbb9 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/202dbed8-c7d0-46a7-aca4-1ff1d9122d8f" status: 200 len: 1509 microversion: 2.1 time: 0.768392 Oct 04 18:55:37.980286 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2814/5592] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:37 2022] GET /compute/v2.1/servers/202dbed8-c7d0-46a7-aca4-1ff1d9122d8f => generated 1509 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:39.012619 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0fda932e-8aee-44f5-92a0-b70bab1148ad tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:39.013848 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0fda932e-8aee-44f5-92a0-b70bab1148ad tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 202dbed8-c7d0-46a7-aca4-1ff1d9122d8f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:39.025474 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0fda932e-8aee-44f5-92a0-b70bab1148ad tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:39.033193 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0fda932e-8aee-44f5-92a0-b70bab1148ad tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:39.034063 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0fda932e-8aee-44f5-92a0-b70bab1148ad tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:39.037819 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0fda932e-8aee-44f5-92a0-b70bab1148ad tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:39.038928 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0fda932e-8aee-44f5-92a0-b70bab1148ad tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:39.039533 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0fda932e-8aee-44f5-92a0-b70bab1148ad tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:39.953903 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0fda932e-8aee-44f5-92a0-b70bab1148ad tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:39.962693 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0fda932e-8aee-44f5-92a0-b70bab1148ad tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/202dbed8-c7d0-46a7-aca4-1ff1d9122d8f" status: 200 len: 1509 microversion: 2.1 time: 0.954829 Oct 04 18:55:39.969542 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2779/5593] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:39 2022] GET /compute/v2.1/servers/202dbed8-c7d0-46a7-aca4-1ff1d9122d8f => generated 1509 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:40.172227 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-34d80f4f-263e-4893-ba48-c2e0175c2a25 tempest-MultipleCreateNegativeTestJSON-1435378238 tempest-MultipleCreateNegativeTestJSON-1435378238-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1025588081", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:55:40.180765 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-34d80f4f-263e-4893-ba48-c2e0175c2a25 tempest-MultipleCreateNegativeTestJSON-1435378238 tempest-MultipleCreateNegativeTestJSON-1435378238-project] HTTP exception thrown: min_count must be <= max_count Oct 04 18:55:40.188182 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-34d80f4f-263e-4893-ba48-c2e0175c2a25 tempest-MultipleCreateNegativeTestJSON-1435378238 tempest-MultipleCreateNegativeTestJSON-1435378238-project] Request method failure captured: Oct 04 18:55:40.188182 n-d-850501-14 devstack@n-api.service[123001]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:55:40.188182 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:55:40.188182 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:55:40.188182 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:55:40.188182 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 184 Oct 04 18:55:40.188182 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:55:40.188182 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:55:40.188182 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:55:40.188182 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:55:40.188182 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPIGrkkmlPN2ihlrUVyF9vrLdHw_uEU_jSF32mAkZW-k8H1k91QVMUtax-fgI8gXrRwy9OWHpfOykC89JeQkT289mxCU0eClCngiDZUk9POX2e29cEdCXAlhsrIprAK5yRdRgNzss9YP7nHe8MHsfjpqEGOkiT5LGLI8XB_QYmh1hSSI Oct 04 18:55:40.188182 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:55:40.188182 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:55:40.188182 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:55:40.188182 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:55:40.188182 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:55:40.188182 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:55:40.188182 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 8b3169dd6a934e499705a721f1324174 Oct 04 18:55:40.188182 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1435378238 Oct 04 18:55:40.188182 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:55:40.188182 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:55:40.188182 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8b3169dd6a934e499705a721f1324174"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8b3169dd6a934e499705a721f1324174", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8b3169dd6a934e499705a721f1324174"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8b3169dd6a934e499705a721f1324174"}]}] Oct 04 18:55:40.188182 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1435378238 Oct 04 18:55:40.188182 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 8b3169dd6a934e499705a721f1324174 Oct 04 18:55:40.188182 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1435378238 Oct 04 18:55:40.188182 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-MultipleCreateNegativeTestJSON-1435378238-project Oct 04 18:55:40.188182 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:55:40.188182 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:55:40.188182 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: f25fd0309cb04fadbc5a8555be99f2b0 Oct 04 18:55:40.188182 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1435378238-project Oct 04 18:55:40.188182 n-d-850501-14 devstack@n-api.service[123001]: Oct 04 18:55:40.188182 n-d-850501-14 devstack@n-api.service[123001]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1025588081", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "min_count": 3, "max_count": 2}} Oct 04 18:55:40.188182 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:55:40.188182 n-d-850501-14 devstack@n-api.service[123001]: exception: min_count must be <= max_count Oct 04 18:55:40.188182 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1025588081', 'imageRef': 'f545e662-10b3-46b1-88bb-6e66dd294559', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Oct 04 18:55:40.188182 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:55:40.188182 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:40.188182 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:55:40.188182 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:55:40.188182 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:55:40.188182 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:55:40.188182 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:55:40.188182 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:55:40.188182 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:55:40.188182 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:55:40.188182 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:55:40.188182 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:55:40.188182 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:55:40.188182 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:55:40.188182 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 18:55:40.188182 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Oct 04 18:55:40.188182 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 04 18:55:40.188182 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Oct 04 18:55:40.188182 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:55:40.188182 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:55:40.188182 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:55:40.188182 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:40.188182 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:55:40.188182 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:55:40.188182 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:55:40.188182 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:55:40.188182 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Oct 04 18:55:40.188182 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:55:40.195709 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-34d80f4f-263e-4893-ba48-c2e0175c2a25 tempest-MultipleCreateNegativeTestJSON-1435378238 tempest-MultipleCreateNegativeTestJSON-1435378238-project] Returning 400 to user: min_count must be <= max_count {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:55:40.196951 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-34d80f4f-263e-4893-ba48-c2e0175c2a25 tempest-MultipleCreateNegativeTestJSON-1435378238 tempest-MultipleCreateNegativeTestJSON-1435378238-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.650327 Oct 04 18:55:40.198222 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2815/5594] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:55:39 2022] POST /compute/v2.1/servers => generated 74 bytes in 652 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 18:55:40.604954 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-809308ed-dc13-47c9-9c6a-4656b05f2ae7 tempest-MultipleCreateNegativeTestJSON-1435378238 tempest-MultipleCreateNegativeTestJSON-1435378238-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1030330452", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "max_count": 0}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:55:40.610584 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-809308ed-dc13-47c9-9c6a-4656b05f2ae7 tempest-MultipleCreateNegativeTestJSON-1435378238 tempest-MultipleCreateNegativeTestJSON-1435378238-project] Request method failure captured: Oct 04 18:55:40.610584 n-d-850501-14 devstack@n-api.service[123002]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:55:40.610584 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:55:40.610584 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:55:40.610584 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:55:40.610584 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 168 Oct 04 18:55:40.610584 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:55:40.610584 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:55:40.610584 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:55:40.610584 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:55:40.610584 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPIGrkkmlPN2ihlrUVyF9vrLdHw_uEU_jSF32mAkZW-k8H1k91QVMUtax-fgI8gXrRwy9OWHpfOykC89JeQkT289mxCU0eClCngiDZUk9POX2e29cEdCXAlhsrIprAK5yRdRgNzss9YP7nHe8MHsfjpqEGOkiT5LGLI8XB_QYmh1hSSI Oct 04 18:55:40.610584 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:55:40.610584 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:55:40.610584 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:55:40.610584 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:55:40.610584 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:55:40.610584 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:55:40.610584 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 8b3169dd6a934e499705a721f1324174 Oct 04 18:55:40.610584 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1435378238 Oct 04 18:55:40.610584 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:55:40.610584 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:55:40.610584 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8b3169dd6a934e499705a721f1324174"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8b3169dd6a934e499705a721f1324174", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8b3169dd6a934e499705a721f1324174"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8b3169dd6a934e499705a721f1324174"}]}] Oct 04 18:55:40.610584 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1435378238 Oct 04 18:55:40.610584 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 8b3169dd6a934e499705a721f1324174 Oct 04 18:55:40.610584 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1435378238 Oct 04 18:55:40.610584 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-MultipleCreateNegativeTestJSON-1435378238-project Oct 04 18:55:40.610584 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:55:40.610584 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:55:40.610584 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: f25fd0309cb04fadbc5a8555be99f2b0 Oct 04 18:55:40.610584 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1435378238-project Oct 04 18:55:40.610584 n-d-850501-14 devstack@n-api.service[123002]: Oct 04 18:55:40.610584 n-d-850501-14 devstack@n-api.service[123002]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1030330452", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "max_count": 0}} Oct 04 18:55:40.610584 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:55:40.610584 n-d-850501-14 devstack@n-api.service[123002]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 04 18:55:40.610584 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1030330452', 'imageRef': 'f545e662-10b3-46b1-88bb-6e66dd294559', 'flavorRef': '452', 'max_count': 0}}} Oct 04 18:55:40.610584 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:55:40.610584 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:40.610584 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:55:40.610584 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:55:40.610584 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:55:40.610584 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:55:40.610584 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 04 18:55:40.610584 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:55:40.610584 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Oct 04 18:55:40.610584 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 04 18:55:40.610584 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 04 18:55:40.610584 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 04 18:55:40.610584 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 04 18:55:40.610584 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:55:40.610584 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 18:55:40.610584 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi 0 Oct 04 18:55:40.610584 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:55:40.610584 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:55:40.610584 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:55:40.610584 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:40.610584 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:55:40.610584 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:55:40.610584 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:55:40.610584 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:55:40.610584 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:55:40.610584 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:55:40.610584 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:55:40.610584 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:55:40.610584 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:55:40.610584 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:55:40.615436 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:55:40.615436 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:55:40.615436 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:55:40.615436 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:55:40.615436 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 04 18:55:40.615436 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:55:40.615436 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:55:40.615436 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:55:40.615436 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:40.615436 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:55:40.615436 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:55:40.615436 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:55:40.615436 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:55:40.615436 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 04 18:55:40.615436 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:55:40.625226 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-809308ed-dc13-47c9-9c6a-4656b05f2ae7 tempest-MultipleCreateNegativeTestJSON-1435378238 tempest-MultipleCreateNegativeTestJSON-1435378238-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:55:40.626541 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-809308ed-dc13-47c9-9c6a-4656b05f2ae7 tempest-MultipleCreateNegativeTestJSON-1435378238 tempest-MultipleCreateNegativeTestJSON-1435378238-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.027214 Oct 04 18:55:40.627639 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2780/5595] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:55:40 2022] POST /compute/v2.1/servers => generated 130 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:55:40.995226 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-96f1dcd5-e871-4fc7-9c2d-9fa020a7b97e tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:40.995840 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-96f1dcd5-e871-4fc7-9c2d-9fa020a7b97e tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 202dbed8-c7d0-46a7-aca4-1ff1d9122d8f] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:41.012874 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-96f1dcd5-e871-4fc7-9c2d-9fa020a7b97e tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:41.013669 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-96f1dcd5-e871-4fc7-9c2d-9fa020a7b97e tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:41.015948 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-96f1dcd5-e871-4fc7-9c2d-9fa020a7b97e tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:41.016964 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-96f1dcd5-e871-4fc7-9c2d-9fa020a7b97e tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:41.019070 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-96f1dcd5-e871-4fc7-9c2d-9fa020a7b97e tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:41.020116 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-96f1dcd5-e871-4fc7-9c2d-9fa020a7b97e tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:41.285454 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f5ce8c4d-3004-4fb4-a042-ce70538e8eaa tempest-MultipleCreateNegativeTestJSON-1435378238 tempest-MultipleCreateNegativeTestJSON-1435378238-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1137597385", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "max_count": 2.5}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:55:41.289484 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f5ce8c4d-3004-4fb4-a042-ce70538e8eaa tempest-MultipleCreateNegativeTestJSON-1435378238 tempest-MultipleCreateNegativeTestJSON-1435378238-project] Request method failure captured: Oct 04 18:55:41.289484 n-d-850501-14 devstack@n-api.service[123002]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:55:41.289484 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:55:41.289484 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:55:41.289484 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:55:41.289484 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 170 Oct 04 18:55:41.289484 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:55:41.289484 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:55:41.289484 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:55:41.289484 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:55:41.289484 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPIGrkkmlPN2ihlrUVyF9vrLdHw_uEU_jSF32mAkZW-k8H1k91QVMUtax-fgI8gXrRwy9OWHpfOykC89JeQkT289mxCU0eClCngiDZUk9POX2e29cEdCXAlhsrIprAK5yRdRgNzss9YP7nHe8MHsfjpqEGOkiT5LGLI8XB_QYmh1hSSI Oct 04 18:55:41.289484 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:55:41.289484 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:55:41.289484 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:55:41.289484 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:55:41.289484 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:55:41.289484 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:55:41.289484 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 8b3169dd6a934e499705a721f1324174 Oct 04 18:55:41.289484 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1435378238 Oct 04 18:55:41.289484 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:55:41.289484 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:55:41.289484 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8b3169dd6a934e499705a721f1324174"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8b3169dd6a934e499705a721f1324174", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8b3169dd6a934e499705a721f1324174"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8b3169dd6a934e499705a721f1324174"}]}] Oct 04 18:55:41.289484 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1435378238 Oct 04 18:55:41.289484 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 8b3169dd6a934e499705a721f1324174 Oct 04 18:55:41.289484 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1435378238 Oct 04 18:55:41.289484 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-MultipleCreateNegativeTestJSON-1435378238-project Oct 04 18:55:41.289484 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:55:41.289484 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:55:41.289484 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: f25fd0309cb04fadbc5a8555be99f2b0 Oct 04 18:55:41.289484 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1435378238-project Oct 04 18:55:41.289484 n-d-850501-14 devstack@n-api.service[123002]: Oct 04 18:55:41.289484 n-d-850501-14 devstack@n-api.service[123002]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1137597385", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "max_count": 2.5}} Oct 04 18:55:41.289484 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:55:41.289484 n-d-850501-14 devstack@n-api.service[123002]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 04 18:55:41.289484 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1137597385', 'imageRef': 'f545e662-10b3-46b1-88bb-6e66dd294559', 'flavorRef': '452', 'max_count': 2.5}}} Oct 04 18:55:41.289484 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:55:41.289484 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:41.289484 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:55:41.289484 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:55:41.289484 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:55:41.289484 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:55:41.289484 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 04 18:55:41.289484 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:55:41.289484 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Oct 04 18:55:41.289484 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 04 18:55:41.289484 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 04 18:55:41.289484 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 04 18:55:41.289484 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 04 18:55:41.289484 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:55:41.289484 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 18:55:41.289484 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi 2.5 Oct 04 18:55:41.289484 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:55:41.289484 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:55:41.289484 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:55:41.289484 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:41.289484 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:55:41.289484 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:55:41.289484 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:55:41.289484 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:55:41.289484 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:55:41.289484 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:55:41.289484 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:55:41.289484 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:55:41.289484 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:55:41.289484 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:55:41.293090 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:55:41.293090 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:55:41.293090 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:55:41.293090 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:55:41.293090 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 04 18:55:41.293090 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:55:41.293090 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:55:41.293090 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:55:41.293090 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:41.293090 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:55:41.293090 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:55:41.293090 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:55:41.293090 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:55:41.293090 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 04 18:55:41.293090 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:55:41.293090 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f5ce8c4d-3004-4fb4-a042-ce70538e8eaa tempest-MultipleCreateNegativeTestJSON-1435378238 tempest-MultipleCreateNegativeTestJSON-1435378238-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:55:41.293090 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f5ce8c4d-3004-4fb4-a042-ce70538e8eaa tempest-MultipleCreateNegativeTestJSON-1435378238 tempest-MultipleCreateNegativeTestJSON-1435378238-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.010443 Oct 04 18:55:41.299711 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2781/5596] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:55:41 2022] POST /compute/v2.1/servers => generated 139 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:55:41.747265 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ad1a6867-5bde-4c1d-a6ed-f1809736c6c4 tempest-MultipleCreateNegativeTestJSON-1435378238 tempest-MultipleCreateNegativeTestJSON-1435378238-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-386816801", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "min_count": 0}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:55:41.764487 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ad1a6867-5bde-4c1d-a6ed-f1809736c6c4 tempest-MultipleCreateNegativeTestJSON-1435378238 tempest-MultipleCreateNegativeTestJSON-1435378238-project] Request method failure captured: Oct 04 18:55:41.764487 n-d-850501-14 devstack@n-api.service[123002]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:55:41.764487 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:55:41.764487 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:55:41.764487 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:55:41.764487 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 167 Oct 04 18:55:41.764487 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:55:41.764487 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:55:41.764487 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:55:41.764487 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:55:41.764487 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPIGrkkmlPN2ihlrUVyF9vrLdHw_uEU_jSF32mAkZW-k8H1k91QVMUtax-fgI8gXrRwy9OWHpfOykC89JeQkT289mxCU0eClCngiDZUk9POX2e29cEdCXAlhsrIprAK5yRdRgNzss9YP7nHe8MHsfjpqEGOkiT5LGLI8XB_QYmh1hSSI Oct 04 18:55:41.764487 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:55:41.764487 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:55:41.764487 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:55:41.764487 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:55:41.764487 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:55:41.764487 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:55:41.764487 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 8b3169dd6a934e499705a721f1324174 Oct 04 18:55:41.764487 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1435378238 Oct 04 18:55:41.764487 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:55:41.764487 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:55:41.764487 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8b3169dd6a934e499705a721f1324174"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8b3169dd6a934e499705a721f1324174", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8b3169dd6a934e499705a721f1324174"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8b3169dd6a934e499705a721f1324174"}]}] Oct 04 18:55:41.764487 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1435378238 Oct 04 18:55:41.764487 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 8b3169dd6a934e499705a721f1324174 Oct 04 18:55:41.764487 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1435378238 Oct 04 18:55:41.764487 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-MultipleCreateNegativeTestJSON-1435378238-project Oct 04 18:55:41.764487 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:55:41.764487 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:55:41.764487 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: f25fd0309cb04fadbc5a8555be99f2b0 Oct 04 18:55:41.764487 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1435378238-project Oct 04 18:55:41.764487 n-d-850501-14 devstack@n-api.service[123002]: Oct 04 18:55:41.764487 n-d-850501-14 devstack@n-api.service[123002]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-386816801", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "min_count": 0}} Oct 04 18:55:41.764487 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:55:41.764487 n-d-850501-14 devstack@n-api.service[123002]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 04 18:55:41.764487 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-386816801', 'imageRef': 'f545e662-10b3-46b1-88bb-6e66dd294559', 'flavorRef': '452', 'min_count': 0}}} Oct 04 18:55:41.764487 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:55:41.764487 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:41.764487 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:55:41.764487 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:55:41.764487 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:55:41.764487 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:55:41.764487 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 04 18:55:41.764487 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:55:41.764487 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Oct 04 18:55:41.764487 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 04 18:55:41.764487 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 04 18:55:41.764487 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 04 18:55:41.764487 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 04 18:55:41.764487 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:55:41.764487 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 18:55:41.764487 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi 0 Oct 04 18:55:41.764487 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:55:41.764487 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:55:41.764487 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:55:41.764487 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:41.764487 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:55:41.764487 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:55:41.764487 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:55:41.764487 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:55:41.764487 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:55:41.764487 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:55:41.764487 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:55:41.764487 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:55:41.764487 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:55:41.764487 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:55:41.769529 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:55:41.769529 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:55:41.769529 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:55:41.769529 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:55:41.769529 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 04 18:55:41.769529 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:55:41.769529 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:55:41.769529 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:55:41.769529 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:41.769529 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:55:41.769529 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:55:41.769529 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:55:41.769529 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:55:41.769529 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 04 18:55:41.769529 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:55:41.769529 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ad1a6867-5bde-4c1d-a6ed-f1809736c6c4 tempest-MultipleCreateNegativeTestJSON-1435378238 tempest-MultipleCreateNegativeTestJSON-1435378238-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:55:41.769529 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ad1a6867-5bde-4c1d-a6ed-f1809736c6c4 tempest-MultipleCreateNegativeTestJSON-1435378238 tempest-MultipleCreateNegativeTestJSON-1435378238-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.025163 Oct 04 18:55:41.780290 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2782/5597] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:55:41 2022] POST /compute/v2.1/servers => generated 130 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:55:41.921255 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b809c0bf-fa02-4745-8fb6-7fcb9184bd82 tempest-MultipleCreateNegativeTestJSON-1435378238 tempest-MultipleCreateNegativeTestJSON-1435378238-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-470609007", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "min_count": 2.5}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:55:41.927830 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b809c0bf-fa02-4745-8fb6-7fcb9184bd82 tempest-MultipleCreateNegativeTestJSON-1435378238 tempest-MultipleCreateNegativeTestJSON-1435378238-project] Request method failure captured: Oct 04 18:55:41.927830 n-d-850501-14 devstack@n-api.service[123002]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:55:41.927830 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:55:41.927830 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:55:41.927830 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:55:41.927830 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 169 Oct 04 18:55:41.927830 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:55:41.927830 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:55:41.927830 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:55:41.927830 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:55:41.927830 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPIGrkkmlPN2ihlrUVyF9vrLdHw_uEU_jSF32mAkZW-k8H1k91QVMUtax-fgI8gXrRwy9OWHpfOykC89JeQkT289mxCU0eClCngiDZUk9POX2e29cEdCXAlhsrIprAK5yRdRgNzss9YP7nHe8MHsfjpqEGOkiT5LGLI8XB_QYmh1hSSI Oct 04 18:55:41.927830 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:55:41.927830 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:55:41.927830 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:55:41.927830 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:55:41.927830 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:55:41.927830 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:55:41.927830 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 8b3169dd6a934e499705a721f1324174 Oct 04 18:55:41.927830 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1435378238 Oct 04 18:55:41.927830 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:55:41.927830 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:55:41.927830 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8b3169dd6a934e499705a721f1324174"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8b3169dd6a934e499705a721f1324174", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8b3169dd6a934e499705a721f1324174"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8b3169dd6a934e499705a721f1324174"}]}] Oct 04 18:55:41.927830 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1435378238 Oct 04 18:55:41.927830 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 8b3169dd6a934e499705a721f1324174 Oct 04 18:55:41.927830 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1435378238 Oct 04 18:55:41.927830 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-MultipleCreateNegativeTestJSON-1435378238-project Oct 04 18:55:41.927830 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:55:41.927830 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:55:41.927830 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: f25fd0309cb04fadbc5a8555be99f2b0 Oct 04 18:55:41.927830 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1435378238-project Oct 04 18:55:41.927830 n-d-850501-14 devstack@n-api.service[123002]: Oct 04 18:55:41.927830 n-d-850501-14 devstack@n-api.service[123002]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-470609007", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "min_count": 2.5}} Oct 04 18:55:41.927830 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:55:41.927830 n-d-850501-14 devstack@n-api.service[123002]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 04 18:55:41.927830 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-470609007', 'imageRef': 'f545e662-10b3-46b1-88bb-6e66dd294559', 'flavorRef': '452', 'min_count': 2.5}}} Oct 04 18:55:41.927830 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:55:41.927830 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:41.927830 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:55:41.927830 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:55:41.927830 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:55:41.927830 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:55:41.927830 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 04 18:55:41.927830 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:55:41.927830 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Oct 04 18:55:41.927830 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 04 18:55:41.927830 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 04 18:55:41.927830 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 04 18:55:41.927830 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 04 18:55:41.927830 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:55:41.927830 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 18:55:41.927830 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi 2.5 Oct 04 18:55:41.927830 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:55:41.927830 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:55:41.927830 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:55:41.927830 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:41.927830 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:55:41.927830 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:55:41.927830 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:55:41.927830 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:55:41.927830 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:55:41.927830 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:55:41.927830 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:55:41.927830 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:55:41.927830 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:55:41.927830 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:55:41.936979 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:55:41.936979 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:55:41.936979 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:55:41.936979 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:55:41.936979 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 04 18:55:41.936979 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:55:41.936979 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:55:41.936979 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:55:41.936979 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:41.936979 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:55:41.936979 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:55:41.936979 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:55:41.936979 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:55:41.936979 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 04 18:55:41.936979 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:55:41.942492 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b809c0bf-fa02-4745-8fb6-7fcb9184bd82 tempest-MultipleCreateNegativeTestJSON-1435378238 tempest-MultipleCreateNegativeTestJSON-1435378238-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:55:41.946324 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b809c0bf-fa02-4745-8fb6-7fcb9184bd82 tempest-MultipleCreateNegativeTestJSON-1435378238 tempest-MultipleCreateNegativeTestJSON-1435378238-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.030931 Oct 04 18:55:41.964139 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2783/5598] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:55:41 2022] POST /compute/v2.1/servers => generated 139 bytes in 49 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:55:42.561008 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-96f1dcd5-e871-4fc7-9c2d-9fa020a7b97e tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:42.606120 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-96f1dcd5-e871-4fc7-9c2d-9fa020a7b97e tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/202dbed8-c7d0-46a7-aca4-1ff1d9122d8f" status: 200 len: 1509 microversion: 2.1 time: 1.616155 Oct 04 18:55:42.611084 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2816/5599] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:40 2022] GET /compute/v2.1/servers/202dbed8-c7d0-46a7-aca4-1ff1d9122d8f => generated 1509 bytes in 1622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:43.648176 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-efdaed7b-63f4-4ffa-bdf5-1bcdcdb53e25 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:43.648176 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-efdaed7b-63f4-4ffa-bdf5-1bcdcdb53e25 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 202dbed8-c7d0-46a7-aca4-1ff1d9122d8f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:43.673861 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-efdaed7b-63f4-4ffa-bdf5-1bcdcdb53e25 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:43.674371 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-efdaed7b-63f4-4ffa-bdf5-1bcdcdb53e25 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:43.679950 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-efdaed7b-63f4-4ffa-bdf5-1bcdcdb53e25 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:43.681460 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-efdaed7b-63f4-4ffa-bdf5-1bcdcdb53e25 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:43.682584 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-efdaed7b-63f4-4ffa-bdf5-1bcdcdb53e25 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:43.683018 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-efdaed7b-63f4-4ffa-bdf5-1bcdcdb53e25 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:44.493333 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-efdaed7b-63f4-4ffa-bdf5-1bcdcdb53e25 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:44.548273 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-efdaed7b-63f4-4ffa-bdf5-1bcdcdb53e25 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/202dbed8-c7d0-46a7-aca4-1ff1d9122d8f" status: 200 len: 1509 microversion: 2.1 time: 0.910388 Oct 04 18:55:44.548994 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2784/5600] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:43 2022] GET /compute/v2.1/servers/202dbed8-c7d0-46a7-aca4-1ff1d9122d8f => generated 1509 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:45.580893 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3cebd624-8b21-4993-9fa2-25778e92e772 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:45.582824 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3cebd624-8b21-4993-9fa2-25778e92e772 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 202dbed8-c7d0-46a7-aca4-1ff1d9122d8f] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:45.600875 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3cebd624-8b21-4993-9fa2-25778e92e772 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:45.602005 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3cebd624-8b21-4993-9fa2-25778e92e772 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:45.603664 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3cebd624-8b21-4993-9fa2-25778e92e772 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:45.606462 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3cebd624-8b21-4993-9fa2-25778e92e772 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:45.607593 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3cebd624-8b21-4993-9fa2-25778e92e772 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:45.610040 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3cebd624-8b21-4993-9fa2-25778e92e772 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:46.150824 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3cebd624-8b21-4993-9fa2-25778e92e772 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:46.167107 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3cebd624-8b21-4993-9fa2-25778e92e772 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/202dbed8-c7d0-46a7-aca4-1ff1d9122d8f" status: 200 len: 1509 microversion: 2.1 time: 0.590828 Oct 04 18:55:46.168342 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2817/5601] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:45 2022] GET /compute/v2.1/servers/202dbed8-c7d0-46a7-aca4-1ff1d9122d8f => generated 1509 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:47.196463 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a63cbab2-e90c-4f49-8345-92605b7a7f28 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:47.197795 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a63cbab2-e90c-4f49-8345-92605b7a7f28 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 202dbed8-c7d0-46a7-aca4-1ff1d9122d8f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:47.223135 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a63cbab2-e90c-4f49-8345-92605b7a7f28 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:47.232635 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a63cbab2-e90c-4f49-8345-92605b7a7f28 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:47.259943 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a63cbab2-e90c-4f49-8345-92605b7a7f28 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:47.259943 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a63cbab2-e90c-4f49-8345-92605b7a7f28 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:47.259943 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a63cbab2-e90c-4f49-8345-92605b7a7f28 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:47.259943 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a63cbab2-e90c-4f49-8345-92605b7a7f28 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:47.620501 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a63cbab2-e90c-4f49-8345-92605b7a7f28 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:47.630437 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a63cbab2-e90c-4f49-8345-92605b7a7f28 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/202dbed8-c7d0-46a7-aca4-1ff1d9122d8f" status: 200 len: 1509 microversion: 2.1 time: 0.439772 Oct 04 18:55:47.651852 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2785/5602] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:47 2022] GET /compute/v2.1/servers/202dbed8-c7d0-46a7-aca4-1ff1d9122d8f => generated 1509 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:55:48.660349 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5ecd965b-3d96-4a7f-9a1a-b72342beef00 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:48.660349 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5ecd965b-3d96-4a7f-9a1a-b72342beef00 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 202dbed8-c7d0-46a7-aca4-1ff1d9122d8f] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:48.690121 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5ecd965b-3d96-4a7f-9a1a-b72342beef00 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:48.691558 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5ecd965b-3d96-4a7f-9a1a-b72342beef00 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:48.692075 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5ecd965b-3d96-4a7f-9a1a-b72342beef00 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:48.699006 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5ecd965b-3d96-4a7f-9a1a-b72342beef00 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:48.699301 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5ecd965b-3d96-4a7f-9a1a-b72342beef00 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:48.703002 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5ecd965b-3d96-4a7f-9a1a-b72342beef00 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:49.120215 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5ecd965b-3d96-4a7f-9a1a-b72342beef00 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:49.131828 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5ecd965b-3d96-4a7f-9a1a-b72342beef00 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/202dbed8-c7d0-46a7-aca4-1ff1d9122d8f" status: 200 len: 1509 microversion: 2.1 time: 0.479651 Oct 04 18:55:49.134058 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2818/5603] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:48 2022] GET /compute/v2.1/servers/202dbed8-c7d0-46a7-aca4-1ff1d9122d8f => generated 1509 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:50.160916 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-21923666-f583-4299-ad0e-f851d1d1f551 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:50.161722 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-21923666-f583-4299-ad0e-f851d1d1f551 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 202dbed8-c7d0-46a7-aca4-1ff1d9122d8f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:50.194554 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-21923666-f583-4299-ad0e-f851d1d1f551 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:50.203581 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-21923666-f583-4299-ad0e-f851d1d1f551 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:50.206380 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-21923666-f583-4299-ad0e-f851d1d1f551 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:50.209165 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-21923666-f583-4299-ad0e-f851d1d1f551 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:50.209914 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-21923666-f583-4299-ad0e-f851d1d1f551 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:50.211946 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-21923666-f583-4299-ad0e-f851d1d1f551 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:50.230318 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:55:50.684336 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-21923666-f583-4299-ad0e-f851d1d1f551 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:50.705421 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-21923666-f583-4299-ad0e-f851d1d1f551 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/202dbed8-c7d0-46a7-aca4-1ff1d9122d8f" status: 200 len: 1509 microversion: 2.1 time: 0.550762 Oct 04 18:55:50.721253 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2786/5604] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:50 2022] GET /compute/v2.1/servers/202dbed8-c7d0-46a7-aca4-1ff1d9122d8f => generated 1509 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:51.735688 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-de6dc7a5-3cd5-4cad-9b62-61bfe4aa177d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:51.736518 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-de6dc7a5-3cd5-4cad-9b62-61bfe4aa177d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 202dbed8-c7d0-46a7-aca4-1ff1d9122d8f] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:51.759487 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-de6dc7a5-3cd5-4cad-9b62-61bfe4aa177d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:51.761669 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-de6dc7a5-3cd5-4cad-9b62-61bfe4aa177d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:51.764205 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-de6dc7a5-3cd5-4cad-9b62-61bfe4aa177d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:51.769768 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-de6dc7a5-3cd5-4cad-9b62-61bfe4aa177d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:51.772010 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-de6dc7a5-3cd5-4cad-9b62-61bfe4aa177d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:51.774671 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-de6dc7a5-3cd5-4cad-9b62-61bfe4aa177d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:52.455486 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-de6dc7a5-3cd5-4cad-9b62-61bfe4aa177d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:52.474634 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-de6dc7a5-3cd5-4cad-9b62-61bfe4aa177d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/202dbed8-c7d0-46a7-aca4-1ff1d9122d8f" status: 200 len: 1509 microversion: 2.1 time: 0.738754 Oct 04 18:55:52.475464 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2819/5605] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:51 2022] GET /compute/v2.1/servers/202dbed8-c7d0-46a7-aca4-1ff1d9122d8f => generated 1509 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:53.509631 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a3a78d18-da48-4fe0-8723-8935f5bbb4c1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:53.512508 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a3a78d18-da48-4fe0-8723-8935f5bbb4c1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 202dbed8-c7d0-46a7-aca4-1ff1d9122d8f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:53.537814 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a3a78d18-da48-4fe0-8723-8935f5bbb4c1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:53.537814 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a3a78d18-da48-4fe0-8723-8935f5bbb4c1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:53.544440 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a3a78d18-da48-4fe0-8723-8935f5bbb4c1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:53.545927 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a3a78d18-da48-4fe0-8723-8935f5bbb4c1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:53.547440 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a3a78d18-da48-4fe0-8723-8935f5bbb4c1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:53.553500 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a3a78d18-da48-4fe0-8723-8935f5bbb4c1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:54.325756 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a3a78d18-da48-4fe0-8723-8935f5bbb4c1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:54.337505 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a3a78d18-da48-4fe0-8723-8935f5bbb4c1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/202dbed8-c7d0-46a7-aca4-1ff1d9122d8f" status: 200 len: 1509 microversion: 2.1 time: 0.837248 Oct 04 18:55:54.347846 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2787/5606] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:53 2022] GET /compute/v2.1/servers/202dbed8-c7d0-46a7-aca4-1ff1d9122d8f => generated 1509 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:55.364269 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-80dc9e5b-5974-4dcf-9ee5-becad28b2e9e tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:55.364881 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-80dc9e5b-5974-4dcf-9ee5-becad28b2e9e tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 202dbed8-c7d0-46a7-aca4-1ff1d9122d8f] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:55.367684 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=20 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:55:55.381059 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-80dc9e5b-5974-4dcf-9ee5-becad28b2e9e tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:55.381856 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-80dc9e5b-5974-4dcf-9ee5-becad28b2e9e tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:55.384251 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-80dc9e5b-5974-4dcf-9ee5-becad28b2e9e tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:55.385193 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-80dc9e5b-5974-4dcf-9ee5-becad28b2e9e tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:55.385820 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-80dc9e5b-5974-4dcf-9ee5-becad28b2e9e tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:55.388918 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-80dc9e5b-5974-4dcf-9ee5-becad28b2e9e tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:56.521248 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-80dc9e5b-5974-4dcf-9ee5-becad28b2e9e tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:56.523489 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=64 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:55:56.533431 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-80dc9e5b-5974-4dcf-9ee5-becad28b2e9e tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/202dbed8-c7d0-46a7-aca4-1ff1d9122d8f" status: 200 len: 1506 microversion: 2.1 time: 1.173731 Oct 04 18:55:56.542704 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2820/5607] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:55 2022] GET /compute/v2.1/servers/202dbed8-c7d0-46a7-aca4-1ff1d9122d8f => generated 1506 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:57.569313 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c6a77194-e31d-4902-8ecd-1dd1a5222e8f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:57.570075 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c6a77194-e31d-4902-8ecd-1dd1a5222e8f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 202dbed8-c7d0-46a7-aca4-1ff1d9122d8f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:57.618326 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c6a77194-e31d-4902-8ecd-1dd1a5222e8f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:57.620309 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c6a77194-e31d-4902-8ecd-1dd1a5222e8f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:57.624983 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c6a77194-e31d-4902-8ecd-1dd1a5222e8f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:57.628971 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c6a77194-e31d-4902-8ecd-1dd1a5222e8f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:57.633578 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c6a77194-e31d-4902-8ecd-1dd1a5222e8f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:57.634888 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c6a77194-e31d-4902-8ecd-1dd1a5222e8f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:58.039846 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-49c9f0d2-8531-46ea-a3e2-46948d713a04 req-11245b2c-d634-4884-80cb-22391a060926 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "202dbed8-c7d0-46a7-aca4-1ff1d9122d8f", "name": "network-vif-unplugged", "status": "completed", "tag": "e17b95ea-0e43-4795-956b-ede441ab9cb4"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:55:58.065416 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-49c9f0d2-8531-46ea-a3e2-46948d713a04 req-11245b2c-d634-4884-80cb-22391a060926 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:58.065913 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-49c9f0d2-8531-46ea-a3e2-46948d713a04 req-11245b2c-d634-4884-80cb-22391a060926 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:58.066342 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-49c9f0d2-8531-46ea-a3e2-46948d713a04 req-11245b2c-d634-4884-80cb-22391a060926 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:58.108110 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-49c9f0d2-8531-46ea-a3e2-46948d713a04 req-11245b2c-d634-4884-80cb-22391a060926 service nova] Creating event network-vif-unplugged:e17b95ea-0e43-4795-956b-ede441ab9cb4 for instance 202dbed8-c7d0-46a7-aca4-1ff1d9122d8f on n-h1-850501-14 Oct 04 18:55:58.130906 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-49c9f0d2-8531-46ea-a3e2-46948d713a04 req-11245b2c-d634-4884-80cb-22391a060926 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092303 Oct 04 18:55:58.133857 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2821/5608] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:55:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:55:58.170594 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c6a77194-e31d-4902-8ecd-1dd1a5222e8f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:58.181672 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c6a77194-e31d-4902-8ecd-1dd1a5222e8f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/202dbed8-c7d0-46a7-aca4-1ff1d9122d8f" status: 200 len: 1506 microversion: 2.1 time: 0.617165 Oct 04 18:55:58.184005 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2788/5609] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:57 2022] GET /compute/v2.1/servers/202dbed8-c7d0-46a7-aca4-1ff1d9122d8f => generated 1506 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:59.213527 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d512d115-15a3-4cb0-9f6c-adaa71ab52f2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:59.214161 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d512d115-15a3-4cb0-9f6c-adaa71ab52f2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 202dbed8-c7d0-46a7-aca4-1ff1d9122d8f] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:59.230806 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d512d115-15a3-4cb0-9f6c-adaa71ab52f2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:59.231401 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d512d115-15a3-4cb0-9f6c-adaa71ab52f2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:59.231980 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d512d115-15a3-4cb0-9f6c-adaa71ab52f2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:59.232752 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d512d115-15a3-4cb0-9f6c-adaa71ab52f2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:59.234570 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d512d115-15a3-4cb0-9f6c-adaa71ab52f2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:59.235026 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d512d115-15a3-4cb0-9f6c-adaa71ab52f2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:59.768514 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d512d115-15a3-4cb0-9f6c-adaa71ab52f2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:59.778245 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d512d115-15a3-4cb0-9f6c-adaa71ab52f2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/202dbed8-c7d0-46a7-aca4-1ff1d9122d8f" status: 200 len: 1509 microversion: 2.1 time: 0.569029 Oct 04 18:55:59.781012 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2822/5610] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:59 2022] GET /compute/v2.1/servers/202dbed8-c7d0-46a7-aca4-1ff1d9122d8f => generated 1509 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:59.803937 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7f495b97-8963-4ba9-a263-b5d4ded60a59 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:59.816357 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7f495b97-8963-4ba9-a263-b5d4ded60a59 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:59.816357 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7f495b97-8963-4ba9-a263-b5d4ded60a59 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:59.818480 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7f495b97-8963-4ba9-a263-b5d4ded60a59 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:59.819092 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7f495b97-8963-4ba9-a263-b5d4ded60a59 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:59.820502 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7f495b97-8963-4ba9-a263-b5d4ded60a59 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:59.821140 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7f495b97-8963-4ba9-a263-b5d4ded60a59 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:59.821751 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7f495b97-8963-4ba9-a263-b5d4ded60a59 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:00.313241 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7f495b97-8963-4ba9-a263-b5d4ded60a59 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:00.323650 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7f495b97-8963-4ba9-a263-b5d4ded60a59 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1672 microversion: 2.1 time: 0.523700 Oct 04 18:56:00.342192 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2789/5611] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:59 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1672 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:00.365362 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4bbda3f4-4a25-4132-8477-75140ef9b6b2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:00.366217 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-4bbda3f4-4a25-4132-8477-75140ef9b6b2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:00.379022 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4bbda3f4-4a25-4132-8477-75140ef9b6b2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:00.379617 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4bbda3f4-4a25-4132-8477-75140ef9b6b2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:00.380196 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4bbda3f4-4a25-4132-8477-75140ef9b6b2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:00.380994 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4bbda3f4-4a25-4132-8477-75140ef9b6b2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:00.386905 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4bbda3f4-4a25-4132-8477-75140ef9b6b2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:00.387493 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4bbda3f4-4a25-4132-8477-75140ef9b6b2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:00.704537 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-4bbda3f4-4a25-4132-8477-75140ef9b6b2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:00.730971 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-4bbda3f4-4a25-4132-8477-75140ef9b6b2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1672 microversion: 2.1 time: 0.369229 Oct 04 18:56:00.731784 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2823/5612] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:00 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1672 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:00.755492 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5bfd1be1-4225-492c-aaad-063be868071a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:00.756565 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5bfd1be1-4225-492c-aaad-063be868071a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:00.770734 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5bfd1be1-4225-492c-aaad-063be868071a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:00.771671 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5bfd1be1-4225-492c-aaad-063be868071a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:00.772951 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5bfd1be1-4225-492c-aaad-063be868071a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:00.775099 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5bfd1be1-4225-492c-aaad-063be868071a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:00.777386 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5bfd1be1-4225-492c-aaad-063be868071a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:00.778105 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5bfd1be1-4225-492c-aaad-063be868071a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:01.141801 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5bfd1be1-4225-492c-aaad-063be868071a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:01.161037 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5bfd1be1-4225-492c-aaad-063be868071a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1672 microversion: 2.1 time: 0.409436 Oct 04 18:56:01.165482 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2790/5613] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:00 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1672 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:01.192725 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-33ca8f4e-e07c-4f5c-b065-e6d76c015e76 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:01.193908 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-33ca8f4e-e07c-4f5c-b065-e6d76c015e76 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:01.205165 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-33ca8f4e-e07c-4f5c-b065-e6d76c015e76 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:01.205960 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-33ca8f4e-e07c-4f5c-b065-e6d76c015e76 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:01.206570 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-33ca8f4e-e07c-4f5c-b065-e6d76c015e76 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:01.207490 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-33ca8f4e-e07c-4f5c-b065-e6d76c015e76 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:01.209430 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-33ca8f4e-e07c-4f5c-b065-e6d76c015e76 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:01.210153 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-33ca8f4e-e07c-4f5c-b065-e6d76c015e76 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:01.631273 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-33ca8f4e-e07c-4f5c-b065-e6d76c015e76 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:01.646263 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-33ca8f4e-e07c-4f5c-b065-e6d76c015e76 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1672 microversion: 2.1 time: 0.461054 Oct 04 18:56:01.647478 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2824/5614] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:01 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1672 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:01.675819 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e36a2ed3-a333-49cb-94fe-f840831f37f3 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:56:01.694933 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e36a2ed3-a333-49cb-94fe-f840831f37f3 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:01.695457 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e36a2ed3-a333-49cb-94fe-f840831f37f3 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:01.705102 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e36a2ed3-a333-49cb-94fe-f840831f37f3 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:01.817606 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e36a2ed3-a333-49cb-94fe-f840831f37f3 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Going to try to stop instance {{(pid=123002) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 18:56:02.063457 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e36a2ed3-a333-49cb-94fe-f840831f37f3 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "POST /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238/action" status: 202 len: 0 microversion: 2.1 time: 0.391001 Oct 04 18:56:02.079515 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2791/5615] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:56:01 2022] POST /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238/action => generated 0 bytes in 409 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:56:02.083386 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-626ce4f7-4c6b-4ce3-b7d5-b6353d534963 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:02.084352 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-626ce4f7-4c6b-4ce3-b7d5-b6353d534963 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:02.095499 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-626ce4f7-4c6b-4ce3-b7d5-b6353d534963 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:02.096671 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-626ce4f7-4c6b-4ce3-b7d5-b6353d534963 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:02.098005 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-626ce4f7-4c6b-4ce3-b7d5-b6353d534963 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:02.099721 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-626ce4f7-4c6b-4ce3-b7d5-b6353d534963 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:02.104411 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-626ce4f7-4c6b-4ce3-b7d5-b6353d534963 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:02.104949 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-626ce4f7-4c6b-4ce3-b7d5-b6353d534963 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:02.307684 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-626ce4f7-4c6b-4ce3-b7d5-b6353d534963 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:02.321817 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-626ce4f7-4c6b-4ce3-b7d5-b6353d534963 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1682 microversion: 2.1 time: 0.241947 Oct 04 18:56:02.322777 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2825/5616] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:02 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1682 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:56:03.349093 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-670e7641-a77c-4299-82a5-99463de6e5cf tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:03.350131 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-670e7641-a77c-4299-82a5-99463de6e5cf tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:03.370954 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-670e7641-a77c-4299-82a5-99463de6e5cf tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:03.371465 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-670e7641-a77c-4299-82a5-99463de6e5cf tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:03.379238 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-670e7641-a77c-4299-82a5-99463de6e5cf tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:03.391626 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-670e7641-a77c-4299-82a5-99463de6e5cf tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:03.393213 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-670e7641-a77c-4299-82a5-99463de6e5cf tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:03.403289 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-670e7641-a77c-4299-82a5-99463de6e5cf tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:04.083508 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-670e7641-a77c-4299-82a5-99463de6e5cf tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:04.096576 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-670e7641-a77c-4299-82a5-99463de6e5cf tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1682 microversion: 2.1 time: 0.752594 Oct 04 18:56:04.099829 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2792/5617] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:03 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1682 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:05.794075 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-38d9e97d-98da-47df-98e8-c96221622094 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:05.794075 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-38d9e97d-98da-47df-98e8-c96221622094 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:05.819585 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-38d9e97d-98da-47df-98e8-c96221622094 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:05.821559 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-38d9e97d-98da-47df-98e8-c96221622094 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:05.822951 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-38d9e97d-98da-47df-98e8-c96221622094 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:05.824590 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-38d9e97d-98da-47df-98e8-c96221622094 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:05.831778 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-38d9e97d-98da-47df-98e8-c96221622094 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:05.833867 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-38d9e97d-98da-47df-98e8-c96221622094 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:06.534003 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-38d9e97d-98da-47df-98e8-c96221622094 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:06.550675 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-38d9e97d-98da-47df-98e8-c96221622094 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1682 microversion: 2.1 time: 1.426986 Oct 04 18:56:06.556424 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2826/5618] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:05 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1682 bytes in 1429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:07.584038 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f3d97d73-9a86-4c82-a65c-47e351add782 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:07.585523 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f3d97d73-9a86-4c82-a65c-47e351add782 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:07.606377 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=22 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:56:07.632423 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f3d97d73-9a86-4c82-a65c-47e351add782 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:07.634726 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f3d97d73-9a86-4c82-a65c-47e351add782 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:07.636690 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f3d97d73-9a86-4c82-a65c-47e351add782 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:07.638049 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f3d97d73-9a86-4c82-a65c-47e351add782 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:07.638794 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f3d97d73-9a86-4c82-a65c-47e351add782 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:07.641440 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f3d97d73-9a86-4c82-a65c-47e351add782 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:08.460872 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f3d97d73-9a86-4c82-a65c-47e351add782 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:08.475543 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f3d97d73-9a86-4c82-a65c-47e351add782 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1682 microversion: 2.1 time: 0.901862 Oct 04 18:56:08.477568 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2793/5619] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:07 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1682 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:09.090453 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3b03913d-bccb-4104-a333-e15bbabcc4ab tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-1688263372", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": [{"uuid": "ad4eef9a-40ae-4ea4-9c5c-ffea59afe72e"}]}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:56:09.190116 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.neutron [None req-3b03913d-bccb-4104-a333-e15bbabcc4ab tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] validate_networks() for [('ad4eef9a-40ae-4ea4-9c5c-ffea59afe72e', None, None, None, None, None)] {{(pid=123001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:56:09.503889 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a6f332ff-64e3-4ac3-900f-e727d6849764 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:09.504730 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a6f332ff-64e3-4ac3-900f-e727d6849764 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:09.521858 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a6f332ff-64e3-4ac3-900f-e727d6849764 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:09.527046 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a6f332ff-64e3-4ac3-900f-e727d6849764 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:09.528644 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a6f332ff-64e3-4ac3-900f-e727d6849764 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:09.528644 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a6f332ff-64e3-4ac3-900f-e727d6849764 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:09.533661 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a6f332ff-64e3-4ac3-900f-e727d6849764 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:09.534262 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a6f332ff-64e3-4ac3-900f-e727d6849764 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:09.947644 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a6f332ff-64e3-4ac3-900f-e727d6849764 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:09.962500 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a6f332ff-64e3-4ac3-900f-e727d6849764 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1682 microversion: 2.1 time: 0.460624 Oct 04 18:56:09.985211 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2794/5620] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:09 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1682 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:10.118358 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-3b03913d-bccb-4104-a333-e15bbabcc4ab tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:56:10.118928 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-3b03913d-bccb-4104-a333-e15bbabcc4ab tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:56:10.119268 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-3b03913d-bccb-4104-a333-e15bbabcc4ab tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:56:10.119693 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-3b03913d-bccb-4104-a333-e15bbabcc4ab tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:56:10.120134 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-3b03913d-bccb-4104-a333-e15bbabcc4ab tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:56:10.140093 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3b03913d-bccb-4104-a333-e15bbabcc4ab tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:10.140955 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3b03913d-bccb-4104-a333-e15bbabcc4ab tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:10.141660 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3b03913d-bccb-4104-a333-e15bbabcc4ab tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:10.142655 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3b03913d-bccb-4104-a333-e15bbabcc4ab tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:10.143553 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3b03913d-bccb-4104-a333-e15bbabcc4ab tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:10.144238 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3b03913d-bccb-4104-a333-e15bbabcc4ab tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:10.226611 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-3b03913d-bccb-4104-a333-e15bbabcc4ab tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Getting quotas for project 7bbfab5a1ffb409e957df2961e769bab. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:56:10.243358 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-3b03913d-bccb-4104-a333-e15bbabcc4ab tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Getting quotas for user cb455a61889548b8be6c14780ddcd77e and project 7bbfab5a1ffb409e957df2961e769bab. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:56:10.276583 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3b03913d-bccb-4104-a333-e15bbabcc4ab tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Going to run 1 instances... {{(pid=123001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:56:10.281353 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3b03913d-bccb-4104-a333-e15bbabcc4ab tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] [instance: 35ace695-3c50-4035-b161-66417ca56154] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:56:10.464286 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3b03913d-bccb-4104-a333-e15bbabcc4ab tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.735263 Oct 04 18:56:10.474133 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2827/5621] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:56:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1746 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:56:10.478581 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-04bc08c9-6197-44ee-8705-5db5a9d144c8 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:10.479918 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-04bc08c9-6197-44ee-8705-5db5a9d144c8 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] [instance: 35ace695-3c50-4035-b161-66417ca56154] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:10.616969 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-04bc08c9-6197-44ee-8705-5db5a9d144c8 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb455a61889548b8be6c14780ddcd77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bbfab5a1ffb409e957df2961e769bab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:10.627110 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-04bc08c9-6197-44ee-8705-5db5a9d144c8 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] 10.222.0.20 "GET /compute/v2.1/servers/35ace695-3c50-4035-b161-66417ca56154" status: 200 len: 1216 microversion: 2.1 time: 0.152610 Oct 04 18:56:10.631208 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2795/5622] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:10 2022] GET /compute/v2.1/servers/35ace695-3c50-4035-b161-66417ca56154 => generated 1216 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:10.989926 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d93e495d-f8bd-48b3-ba84-73116634a1e8 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:10.990678 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d93e495d-f8bd-48b3-ba84-73116634a1e8 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:11.019123 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d93e495d-f8bd-48b3-ba84-73116634a1e8 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:11.019797 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d93e495d-f8bd-48b3-ba84-73116634a1e8 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:11.021906 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d93e495d-f8bd-48b3-ba84-73116634a1e8 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:11.025463 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d93e495d-f8bd-48b3-ba84-73116634a1e8 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:11.028655 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d93e495d-f8bd-48b3-ba84-73116634a1e8 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:11.029366 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d93e495d-f8bd-48b3-ba84-73116634a1e8 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:11.366201 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d93e495d-f8bd-48b3-ba84-73116634a1e8 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:11.376683 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d93e495d-f8bd-48b3-ba84-73116634a1e8 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1682 microversion: 2.1 time: 0.390766 Oct 04 18:56:11.380252 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2828/5623] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:10 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1682 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:11.659585 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1f11ffb8-24d3-4770-9c49-246959ffb782 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:11.660544 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1f11ffb8-24d3-4770-9c49-246959ffb782 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] [instance: 35ace695-3c50-4035-b161-66417ca56154] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:11.822488 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1f11ffb8-24d3-4770-9c49-246959ffb782 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb455a61889548b8be6c14780ddcd77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bbfab5a1ffb409e957df2961e769bab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:11.833612 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1f11ffb8-24d3-4770-9c49-246959ffb782 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] 10.222.0.20 "GET /compute/v2.1/servers/35ace695-3c50-4035-b161-66417ca56154" status: 200 len: 1216 microversion: 2.1 time: 0.180044 Oct 04 18:56:11.840914 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2796/5624] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:11 2022] GET /compute/v2.1/servers/35ace695-3c50-4035-b161-66417ca56154 => generated 1216 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:12.407539 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-bf9a1e6c-1334-4338-af5e-805a8e46b41b tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:12.409568 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-bf9a1e6c-1334-4338-af5e-805a8e46b41b tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:12.448961 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bf9a1e6c-1334-4338-af5e-805a8e46b41b tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:12.450547 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bf9a1e6c-1334-4338-af5e-805a8e46b41b tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:12.454527 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bf9a1e6c-1334-4338-af5e-805a8e46b41b tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:12.455298 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bf9a1e6c-1334-4338-af5e-805a8e46b41b tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:12.455783 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bf9a1e6c-1334-4338-af5e-805a8e46b41b tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:12.456257 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bf9a1e6c-1334-4338-af5e-805a8e46b41b tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:12.755858 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-bf9a1e6c-1334-4338-af5e-805a8e46b41b tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:12.766665 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-bf9a1e6c-1334-4338-af5e-805a8e46b41b tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1682 microversion: 2.1 time: 0.364180 Oct 04 18:56:12.772102 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2829/5625] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:12 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1682 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:12.861882 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9e2b2000-603d-4723-9397-8975a7eb2dfd tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:12.862529 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9e2b2000-603d-4723-9397-8975a7eb2dfd tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] [instance: 35ace695-3c50-4035-b161-66417ca56154] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:12.880907 n-d-850501-14 devstack@n-api.service[123002]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 18:56:12.881314 n-d-850501-14 devstack@n-api.service[123002]: Tue Oct 4 18:56:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/35ace695-3c50-4035-b161-66417ca56154 (ip 10.222.0.20) !!! Oct 04 18:56:12.884704 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9e2b2000-603d-4723-9397-8975a7eb2dfd tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:12.886441 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9e2b2000-603d-4723-9397-8975a7eb2dfd tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:12.887156 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9e2b2000-603d-4723-9397-8975a7eb2dfd tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:12.888226 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9e2b2000-603d-4723-9397-8975a7eb2dfd tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:12.890951 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9e2b2000-603d-4723-9397-8975a7eb2dfd tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:12.891697 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9e2b2000-603d-4723-9397-8975a7eb2dfd tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:13.075714 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9e2b2000-603d-4723-9397-8975a7eb2dfd tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb455a61889548b8be6c14780ddcd77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bbfab5a1ffb409e957df2961e769bab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:13.093367 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9e2b2000-603d-4723-9397-8975a7eb2dfd tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] 10.222.0.20 "GET /compute/v2.1/servers/35ace695-3c50-4035-b161-66417ca56154" status: 200 len: 1212 microversion: 2.1 time: 0.234934 Oct 04 18:56:13.093563 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2797/5626] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:12 2022] GET /compute/v2.1/servers/35ace695-3c50-4035-b161-66417ca56154 => generated 1212 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:56:13.795670 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-95f4b891-2fc8-4d0b-8498-30033757bc3c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:13.797856 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-95f4b891-2fc8-4d0b-8498-30033757bc3c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:13.817179 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-95f4b891-2fc8-4d0b-8498-30033757bc3c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:13.822428 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-95f4b891-2fc8-4d0b-8498-30033757bc3c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:13.823149 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-95f4b891-2fc8-4d0b-8498-30033757bc3c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:13.829521 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-95f4b891-2fc8-4d0b-8498-30033757bc3c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:13.831993 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-95f4b891-2fc8-4d0b-8498-30033757bc3c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:13.832999 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-95f4b891-2fc8-4d0b-8498-30033757bc3c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:14.122578 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d6564855-a698-4a34-ba10-cc025c5ff1b2 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:14.126157 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d6564855-a698-4a34-ba10-cc025c5ff1b2 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] [instance: 35ace695-3c50-4035-b161-66417ca56154] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:14.136305 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d6564855-a698-4a34-ba10-cc025c5ff1b2 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:14.138611 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d6564855-a698-4a34-ba10-cc025c5ff1b2 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:14.140495 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d6564855-a698-4a34-ba10-cc025c5ff1b2 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:14.143167 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d6564855-a698-4a34-ba10-cc025c5ff1b2 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:14.144047 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d6564855-a698-4a34-ba10-cc025c5ff1b2 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:14.144711 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d6564855-a698-4a34-ba10-cc025c5ff1b2 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:14.148697 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-95f4b891-2fc8-4d0b-8498-30033757bc3c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:14.163613 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-95f4b891-2fc8-4d0b-8498-30033757bc3c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1659 microversion: 2.1 time: 0.368046 Oct 04 18:56:14.164520 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2830/5627] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:13 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1659 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:14.189068 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-791aa383-acd3-4880-8041-198b22d1d198 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:56:14.199538 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-791aa383-acd3-4880-8041-198b22d1d198 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:14.200509 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-791aa383-acd3-4880-8041-198b22d1d198 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:14.204807 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-791aa383-acd3-4880-8041-198b22d1d198 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:14.252083 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-791aa383-acd3-4880-8041-198b22d1d198 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Going to try to start instance {{(pid=123001) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 04 18:56:14.424554 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d6564855-a698-4a34-ba10-cc025c5ff1b2 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb455a61889548b8be6c14780ddcd77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bbfab5a1ffb409e957df2961e769bab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:14.440574 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d6564855-a698-4a34-ba10-cc025c5ff1b2 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] 10.222.0.20 "GET /compute/v2.1/servers/35ace695-3c50-4035-b161-66417ca56154" status: 200 len: 1276 microversion: 2.1 time: 0.324089 Oct 04 18:56:14.453858 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2798/5628] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:14 2022] GET /compute/v2.1/servers/35ace695-3c50-4035-b161-66417ca56154 => generated 1276 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:14.549495 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-791aa383-acd3-4880-8041-198b22d1d198 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "POST /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238/action" status: 202 len: 0 microversion: 2.1 time: 0.364048 Oct 04 18:56:14.550623 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2831/5629] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:56:14 2022] POST /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238/action => generated 0 bytes in 367 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:56:14.563430 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-413c7f75-6f00-4ff2-b6be-dd4f2651adc9 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:14.564274 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-413c7f75-6f00-4ff2-b6be-dd4f2651adc9 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:14.575952 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-413c7f75-6f00-4ff2-b6be-dd4f2651adc9 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:14.578541 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-413c7f75-6f00-4ff2-b6be-dd4f2651adc9 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:14.581045 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-413c7f75-6f00-4ff2-b6be-dd4f2651adc9 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:14.583764 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-413c7f75-6f00-4ff2-b6be-dd4f2651adc9 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:14.584499 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-413c7f75-6f00-4ff2-b6be-dd4f2651adc9 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:14.585091 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-413c7f75-6f00-4ff2-b6be-dd4f2651adc9 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:14.870811 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-413c7f75-6f00-4ff2-b6be-dd4f2651adc9 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:14.881945 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-413c7f75-6f00-4ff2-b6be-dd4f2651adc9 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1668 microversion: 2.1 time: 0.326510 Oct 04 18:56:14.896649 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2799/5630] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:14 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1668 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:15.470136 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-cb447c97-77aa-4415-87db-9ba568fedb80 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:15.470913 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-cb447c97-77aa-4415-87db-9ba568fedb80 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] [instance: 35ace695-3c50-4035-b161-66417ca56154] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:15.482791 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cb447c97-77aa-4415-87db-9ba568fedb80 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:15.487098 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cb447c97-77aa-4415-87db-9ba568fedb80 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:15.488707 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cb447c97-77aa-4415-87db-9ba568fedb80 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:15.497122 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cb447c97-77aa-4415-87db-9ba568fedb80 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:15.501648 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cb447c97-77aa-4415-87db-9ba568fedb80 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:15.502486 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cb447c97-77aa-4415-87db-9ba568fedb80 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:15.741435 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-cb447c97-77aa-4415-87db-9ba568fedb80 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb455a61889548b8be6c14780ddcd77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bbfab5a1ffb409e957df2961e769bab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:15.784371 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-cb447c97-77aa-4415-87db-9ba568fedb80 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] 10.222.0.20 "GET /compute/v2.1/servers/35ace695-3c50-4035-b161-66417ca56154" status: 200 len: 1274 microversion: 2.1 time: 0.313905 Oct 04 18:56:15.786871 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2832/5631] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:15 2022] GET /compute/v2.1/servers/35ace695-3c50-4035-b161-66417ca56154 => generated 1274 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:15.910348 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9890d64d-ce51-466a-98fe-29e04e76646c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:15.911480 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9890d64d-ce51-466a-98fe-29e04e76646c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:15.921191 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9890d64d-ce51-466a-98fe-29e04e76646c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:15.921923 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9890d64d-ce51-466a-98fe-29e04e76646c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:15.922549 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9890d64d-ce51-466a-98fe-29e04e76646c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:15.923483 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9890d64d-ce51-466a-98fe-29e04e76646c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:15.924139 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9890d64d-ce51-466a-98fe-29e04e76646c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:15.924720 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9890d64d-ce51-466a-98fe-29e04e76646c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:16.704685 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9890d64d-ce51-466a-98fe-29e04e76646c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:16.716332 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9890d64d-ce51-466a-98fe-29e04e76646c tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1668 microversion: 2.1 time: 0.810333 Oct 04 18:56:16.732566 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2800/5632] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:15 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1668 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:56:16.820351 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ab57f884-cacd-45b1-abdb-412559ec9347 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:16.821597 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ab57f884-cacd-45b1-abdb-412559ec9347 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] [instance: 35ace695-3c50-4035-b161-66417ca56154] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:16.844076 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ab57f884-cacd-45b1-abdb-412559ec9347 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:16.860512 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ab57f884-cacd-45b1-abdb-412559ec9347 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:16.864409 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ab57f884-cacd-45b1-abdb-412559ec9347 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:16.865276 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ab57f884-cacd-45b1-abdb-412559ec9347 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:16.865777 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ab57f884-cacd-45b1-abdb-412559ec9347 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:16.866239 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ab57f884-cacd-45b1-abdb-412559ec9347 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:17.267990 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ab57f884-cacd-45b1-abdb-412559ec9347 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb455a61889548b8be6c14780ddcd77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bbfab5a1ffb409e957df2961e769bab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:17.286917 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ab57f884-cacd-45b1-abdb-412559ec9347 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] 10.222.0.20 "GET /compute/v2.1/servers/35ace695-3c50-4035-b161-66417ca56154" status: 200 len: 1316 microversion: 2.1 time: 0.474643 Oct 04 18:56:17.292723 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2833/5633] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:16 2022] GET /compute/v2.1/servers/35ace695-3c50-4035-b161-66417ca56154 => generated 1316 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:56:17.756536 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d3ffb97a-a1f5-4faf-9af1-7c026e1b0f2d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:17.757843 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d3ffb97a-a1f5-4faf-9af1-7c026e1b0f2d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:17.769895 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d3ffb97a-a1f5-4faf-9af1-7c026e1b0f2d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:17.770913 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d3ffb97a-a1f5-4faf-9af1-7c026e1b0f2d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:17.771505 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d3ffb97a-a1f5-4faf-9af1-7c026e1b0f2d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:17.772647 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d3ffb97a-a1f5-4faf-9af1-7c026e1b0f2d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:17.773257 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d3ffb97a-a1f5-4faf-9af1-7c026e1b0f2d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:17.774029 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d3ffb97a-a1f5-4faf-9af1-7c026e1b0f2d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:18.108369 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d3ffb97a-a1f5-4faf-9af1-7c026e1b0f2d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:18.123789 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d3ffb97a-a1f5-4faf-9af1-7c026e1b0f2d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1668 microversion: 2.1 time: 0.369761 Oct 04 18:56:18.130389 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2801/5634] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:17 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1668 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:18.319188 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-288ef3ae-83ab-4658-a7d3-454968fff8ae tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:18.320795 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-288ef3ae-83ab-4658-a7d3-454968fff8ae tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] [instance: 35ace695-3c50-4035-b161-66417ca56154] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:18.336278 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-288ef3ae-83ab-4658-a7d3-454968fff8ae tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:18.337484 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-288ef3ae-83ab-4658-a7d3-454968fff8ae tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:18.338224 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-288ef3ae-83ab-4658-a7d3-454968fff8ae tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:18.339188 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-288ef3ae-83ab-4658-a7d3-454968fff8ae tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:18.340851 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-288ef3ae-83ab-4658-a7d3-454968fff8ae tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:18.344083 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-288ef3ae-83ab-4658-a7d3-454968fff8ae tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:19.152984 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-089e1da2-8f09-4d88-b399-43cb7e3aa459 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:19.154662 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-089e1da2-8f09-4d88-b399-43cb7e3aa459 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:19.167648 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-089e1da2-8f09-4d88-b399-43cb7e3aa459 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:19.169196 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-089e1da2-8f09-4d88-b399-43cb7e3aa459 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:19.172419 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-089e1da2-8f09-4d88-b399-43cb7e3aa459 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:19.173330 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-089e1da2-8f09-4d88-b399-43cb7e3aa459 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:19.174009 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-089e1da2-8f09-4d88-b399-43cb7e3aa459 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:19.174603 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-089e1da2-8f09-4d88-b399-43cb7e3aa459 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:19.372635 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-288ef3ae-83ab-4658-a7d3-454968fff8ae tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb455a61889548b8be6c14780ddcd77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bbfab5a1ffb409e957df2961e769bab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:19.421242 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-288ef3ae-83ab-4658-a7d3-454968fff8ae tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] 10.222.0.20 "GET /compute/v2.1/servers/35ace695-3c50-4035-b161-66417ca56154" status: 200 len: 1316 microversion: 2.1 time: 1.106232 Oct 04 18:56:19.434929 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2834/5635] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:18 2022] GET /compute/v2.1/servers/35ace695-3c50-4035-b161-66417ca56154 => generated 1316 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:19.464758 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-9d1af9c4-cf6a-4cbd-a348-0de170201349 req-97a11fa6-b34a-4487-ab35-4307ea4e3906 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35ace695-3c50-4035-b161-66417ca56154", "tag": "2ac73446-6c2f-419a-a8a7-0732dca7f5b0"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:56:19.499049 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-9d1af9c4-cf6a-4cbd-a348-0de170201349 req-97a11fa6-b34a-4487-ab35-4307ea4e3906 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:19.499549 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-9d1af9c4-cf6a-4cbd-a348-0de170201349 req-97a11fa6-b34a-4487-ab35-4307ea4e3906 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:19.501852 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-9d1af9c4-cf6a-4cbd-a348-0de170201349 req-97a11fa6-b34a-4487-ab35-4307ea4e3906 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:19.542519 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-9d1af9c4-cf6a-4cbd-a348-0de170201349 req-97a11fa6-b34a-4487-ab35-4307ea4e3906 service nova] Creating event network-changed:2ac73446-6c2f-419a-a8a7-0732dca7f5b0 for instance 35ace695-3c50-4035-b161-66417ca56154 on n-h1-850501-14 Oct 04 18:56:19.568493 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-9d1af9c4-cf6a-4cbd-a348-0de170201349 req-97a11fa6-b34a-4487-ab35-4307ea4e3906 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120028 Oct 04 18:56:19.569983 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2835/5636] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:56:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:56:19.605608 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-089e1da2-8f09-4d88-b399-43cb7e3aa459 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:19.616976 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-089e1da2-8f09-4d88-b399-43cb7e3aa459 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1672 microversion: 2.1 time: 0.469925 Oct 04 18:56:19.634119 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2802/5637] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:19 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1672 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:19.646896 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3e6e2f93-8004-48f7-8740-164961ba5285 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:19.647934 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3e6e2f93-8004-48f7-8740-164961ba5285 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:19.656236 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3e6e2f93-8004-48f7-8740-164961ba5285 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:19.657006 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3e6e2f93-8004-48f7-8740-164961ba5285 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:19.657655 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3e6e2f93-8004-48f7-8740-164961ba5285 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:19.658629 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3e6e2f93-8004-48f7-8740-164961ba5285 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:19.659309 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3e6e2f93-8004-48f7-8740-164961ba5285 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:19.660019 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3e6e2f93-8004-48f7-8740-164961ba5285 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:20.173287 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:56:20.259162 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=6 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:56:20.266687 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3e6e2f93-8004-48f7-8740-164961ba5285 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:20.293957 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3e6e2f93-8004-48f7-8740-164961ba5285 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1672 microversion: 2.1 time: 0.647709 Oct 04 18:56:20.295902 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2836/5638] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:19 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1672 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:20.331285 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2eede44a-aca2-4aef-8ba0-d490b33bbdf2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:20.332946 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2eede44a-aca2-4aef-8ba0-d490b33bbdf2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:20.347828 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2eede44a-aca2-4aef-8ba0-d490b33bbdf2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:20.348394 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2eede44a-aca2-4aef-8ba0-d490b33bbdf2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:20.352483 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2eede44a-aca2-4aef-8ba0-d490b33bbdf2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:20.354615 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2eede44a-aca2-4aef-8ba0-d490b33bbdf2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:20.356278 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2eede44a-aca2-4aef-8ba0-d490b33bbdf2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:20.359925 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2eede44a-aca2-4aef-8ba0-d490b33bbdf2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:20.458304 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-bf083e7e-730b-4a94-8eaa-331592e3bb1a tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:20.461547 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-bf083e7e-730b-4a94-8eaa-331592e3bb1a tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] [instance: 35ace695-3c50-4035-b161-66417ca56154] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:20.477491 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bf083e7e-730b-4a94-8eaa-331592e3bb1a tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:20.477914 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bf083e7e-730b-4a94-8eaa-331592e3bb1a tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:20.478771 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bf083e7e-730b-4a94-8eaa-331592e3bb1a tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:20.479824 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bf083e7e-730b-4a94-8eaa-331592e3bb1a tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:20.480386 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bf083e7e-730b-4a94-8eaa-331592e3bb1a tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:20.481057 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bf083e7e-730b-4a94-8eaa-331592e3bb1a tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:20.690514 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2eede44a-aca2-4aef-8ba0-d490b33bbdf2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:20.697423 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:56:20.699737 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2eede44a-aca2-4aef-8ba0-d490b33bbdf2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1672 microversion: 2.1 time: 0.375885 Oct 04 18:56:20.712488 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2803/5639] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:20 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1672 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:20.726380 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1d6b8310-cacd-4463-bc2a-aa190bcf01b4 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:20.727181 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1d6b8310-cacd-4463-bc2a-aa190bcf01b4 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:20.737322 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1d6b8310-cacd-4463-bc2a-aa190bcf01b4 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:20.743124 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1d6b8310-cacd-4463-bc2a-aa190bcf01b4 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:20.743124 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1d6b8310-cacd-4463-bc2a-aa190bcf01b4 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:20.743124 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1d6b8310-cacd-4463-bc2a-aa190bcf01b4 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:20.743124 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1d6b8310-cacd-4463-bc2a-aa190bcf01b4 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:20.743124 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1d6b8310-cacd-4463-bc2a-aa190bcf01b4 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:20.825348 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-bf083e7e-730b-4a94-8eaa-331592e3bb1a tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb455a61889548b8be6c14780ddcd77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bbfab5a1ffb409e957df2961e769bab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:20.853448 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-bf083e7e-730b-4a94-8eaa-331592e3bb1a tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] 10.222.0.20 "GET /compute/v2.1/servers/35ace695-3c50-4035-b161-66417ca56154" status: 200 len: 1316 microversion: 2.1 time: 0.394497 Oct 04 18:56:20.859987 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2837/5640] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:20 2022] GET /compute/v2.1/servers/35ace695-3c50-4035-b161-66417ca56154 => generated 1316 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:21.165647 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1d6b8310-cacd-4463-bc2a-aa190bcf01b4 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:21.174859 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1d6b8310-cacd-4463-bc2a-aa190bcf01b4 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1672 microversion: 2.1 time: 0.452760 Oct 04 18:56:21.180463 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2804/5641] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:20 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1672 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:56:21.206429 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3633fda2-5709-4c2e-afe1-739d3bfbfadb tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:21.207057 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3633fda2-5709-4c2e-afe1-739d3bfbfadb tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:21.213806 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3633fda2-5709-4c2e-afe1-739d3bfbfadb tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:21.214308 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3633fda2-5709-4c2e-afe1-739d3bfbfadb tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:21.215323 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3633fda2-5709-4c2e-afe1-739d3bfbfadb tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:21.216136 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3633fda2-5709-4c2e-afe1-739d3bfbfadb tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:21.216726 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3633fda2-5709-4c2e-afe1-739d3bfbfadb tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:21.217209 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3633fda2-5709-4c2e-afe1-739d3bfbfadb tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:21.273046 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:56:21.550797 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3633fda2-5709-4c2e-afe1-739d3bfbfadb tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:21.581774 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3633fda2-5709-4c2e-afe1-739d3bfbfadb tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1672 microversion: 2.1 time: 0.370349 Oct 04 18:56:21.583873 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2838/5642] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:21 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1672 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:21.610894 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-83359204-ff20-46bb-ba80-9b1426859258 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:56:21.611547 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-83359204-ff20-46bb-ba80-9b1426859258 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:21.621209 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-83359204-ff20-46bb-ba80-9b1426859258 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:21.622418 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-83359204-ff20-46bb-ba80-9b1426859258 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:21.623047 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-83359204-ff20-46bb-ba80-9b1426859258 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:21.624222 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-83359204-ff20-46bb-ba80-9b1426859258 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:21.624843 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-83359204-ff20-46bb-ba80-9b1426859258 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:21.625362 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-83359204-ff20-46bb-ba80-9b1426859258 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:21.665364 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-83359204-ff20-46bb-ba80-9b1426859258 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lazy-loading 'flavor' on Instance uuid 2e208f85-0513-43f4-8a2c-38baa2886238 {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:56:21.837503 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=4 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:56:21.888161 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4f964fbc-2ff3-4064-8638-99423d8f33c9 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:21.889702 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-4f964fbc-2ff3-4064-8638-99423d8f33c9 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] [instance: 35ace695-3c50-4035-b161-66417ca56154] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:21.918842 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4f964fbc-2ff3-4064-8638-99423d8f33c9 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:21.919865 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4f964fbc-2ff3-4064-8638-99423d8f33c9 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:21.926656 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4f964fbc-2ff3-4064-8638-99423d8f33c9 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:21.926656 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4f964fbc-2ff3-4064-8638-99423d8f33c9 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:21.926656 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4f964fbc-2ff3-4064-8638-99423d8f33c9 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:21.926656 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4f964fbc-2ff3-4064-8638-99423d8f33c9 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:22.092789 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-83359204-ff20-46bb-ba80-9b1426859258 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "POST /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238/action" status: 202 len: 0 microversion: 2.1 time: 0.484068 Oct 04 18:56:22.092789 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2805/5643] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:56:21 2022] POST /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238/action => generated 0 bytes in 486 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:56:22.100374 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-90e1f010-4b9a-4054-a3ad-92442c46a162 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:22.101159 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-90e1f010-4b9a-4054-a3ad-92442c46a162 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:22.116825 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-90e1f010-4b9a-4054-a3ad-92442c46a162 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:22.117346 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-90e1f010-4b9a-4054-a3ad-92442c46a162 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:22.121163 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-90e1f010-4b9a-4054-a3ad-92442c46a162 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:22.121163 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-90e1f010-4b9a-4054-a3ad-92442c46a162 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:22.121163 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-90e1f010-4b9a-4054-a3ad-92442c46a162 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:22.121163 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-90e1f010-4b9a-4054-a3ad-92442c46a162 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:22.323774 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-4f964fbc-2ff3-4064-8638-99423d8f33c9 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb455a61889548b8be6c14780ddcd77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bbfab5a1ffb409e957df2961e769bab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:22.332706 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-4f964fbc-2ff3-4064-8638-99423d8f33c9 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] 10.222.0.20 "GET /compute/v2.1/servers/35ace695-3c50-4035-b161-66417ca56154" status: 200 len: 1316 microversion: 2.1 time: 0.451396 Oct 04 18:56:22.336762 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2839/5644] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:21 2022] GET /compute/v2.1/servers/35ace695-3c50-4035-b161-66417ca56154 => generated 1316 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:22.443941 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-90e1f010-4b9a-4054-a3ad-92442c46a162 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:22.514984 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-90e1f010-4b9a-4054-a3ad-92442c46a162 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1680 microversion: 2.1 time: 0.412194 Oct 04 18:56:22.516045 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2806/5645] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:22 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1680 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:56:23.363807 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-10afbff2-93f5-41c0-8a6a-d4be253b1da5 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:23.364826 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-10afbff2-93f5-41c0-8a6a-d4be253b1da5 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] [instance: 35ace695-3c50-4035-b161-66417ca56154] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:23.384664 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-10afbff2-93f5-41c0-8a6a-d4be253b1da5 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:23.385169 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-10afbff2-93f5-41c0-8a6a-d4be253b1da5 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:23.385713 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-10afbff2-93f5-41c0-8a6a-d4be253b1da5 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:23.386447 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-10afbff2-93f5-41c0-8a6a-d4be253b1da5 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:23.389086 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-10afbff2-93f5-41c0-8a6a-d4be253b1da5 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:23.392461 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-10afbff2-93f5-41c0-8a6a-d4be253b1da5 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:23.543450 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d0a8a870-3af4-4cb5-bc4c-b349cbfbc133 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:23.544070 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d0a8a870-3af4-4cb5-bc4c-b349cbfbc133 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:23.552026 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d0a8a870-3af4-4cb5-bc4c-b349cbfbc133 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:23.552549 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d0a8a870-3af4-4cb5-bc4c-b349cbfbc133 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:23.552988 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d0a8a870-3af4-4cb5-bc4c-b349cbfbc133 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:23.553685 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d0a8a870-3af4-4cb5-bc4c-b349cbfbc133 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:23.554151 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d0a8a870-3af4-4cb5-bc4c-b349cbfbc133 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:23.554571 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d0a8a870-3af4-4cb5-bc4c-b349cbfbc133 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:23.849041 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-10afbff2-93f5-41c0-8a6a-d4be253b1da5 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb455a61889548b8be6c14780ddcd77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bbfab5a1ffb409e957df2961e769bab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:23.856808 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-10afbff2-93f5-41c0-8a6a-d4be253b1da5 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] 10.222.0.20 "GET /compute/v2.1/servers/35ace695-3c50-4035-b161-66417ca56154" status: 200 len: 1316 microversion: 2.1 time: 0.496910 Oct 04 18:56:23.865926 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2840/5646] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:23 2022] GET /compute/v2.1/servers/35ace695-3c50-4035-b161-66417ca56154 => generated 1316 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:23.973261 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d0a8a870-3af4-4cb5-bc4c-b349cbfbc133 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:23.985054 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d0a8a870-3af4-4cb5-bc4c-b349cbfbc133 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1663 microversion: 2.1 time: 0.445924 Oct 04 18:56:23.985923 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2807/5647] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:23 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1663 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:56:24.009231 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0211c919-6162-483e-8e53-a39e5118bc9a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:56:24.009765 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0211c919-6162-483e-8e53-a39e5118bc9a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:24.016762 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0211c919-6162-483e-8e53-a39e5118bc9a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:24.018718 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0211c919-6162-483e-8e53-a39e5118bc9a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:24.021181 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0211c919-6162-483e-8e53-a39e5118bc9a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:24.022878 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0211c919-6162-483e-8e53-a39e5118bc9a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:24.023706 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0211c919-6162-483e-8e53-a39e5118bc9a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:24.024156 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0211c919-6162-483e-8e53-a39e5118bc9a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:24.390602 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0211c919-6162-483e-8e53-a39e5118bc9a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "POST /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238/action" status: 202 len: 0 microversion: 2.1 time: 0.381289 Oct 04 18:56:24.390602 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2841/5648] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 18:56:24 2022] POST /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238/action => generated 0 bytes in 383 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:56:24.401535 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d161331f-e50c-4a7f-88e6-84bb7318a7cd tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:24.402547 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d161331f-e50c-4a7f-88e6-84bb7318a7cd tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:24.415981 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d161331f-e50c-4a7f-88e6-84bb7318a7cd tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:24.419524 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d161331f-e50c-4a7f-88e6-84bb7318a7cd tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:24.419524 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d161331f-e50c-4a7f-88e6-84bb7318a7cd tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:24.420814 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d161331f-e50c-4a7f-88e6-84bb7318a7cd tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:24.422517 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d161331f-e50c-4a7f-88e6-84bb7318a7cd tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:24.424751 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d161331f-e50c-4a7f-88e6-84bb7318a7cd tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:24.738306 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d161331f-e50c-4a7f-88e6-84bb7318a7cd tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:24.768508 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d161331f-e50c-4a7f-88e6-84bb7318a7cd tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1669 microversion: 2.1 time: 0.364858 Oct 04 18:56:24.768508 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2808/5649] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:24 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1669 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:24.881240 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-54c15464-87aa-45b3-a5b7-50f208867234 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:24.882469 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-54c15464-87aa-45b3-a5b7-50f208867234 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] [instance: 35ace695-3c50-4035-b161-66417ca56154] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:24.893915 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-54c15464-87aa-45b3-a5b7-50f208867234 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:24.895682 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-54c15464-87aa-45b3-a5b7-50f208867234 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:24.896286 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-54c15464-87aa-45b3-a5b7-50f208867234 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:24.897980 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-54c15464-87aa-45b3-a5b7-50f208867234 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:24.902687 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-54c15464-87aa-45b3-a5b7-50f208867234 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:24.903116 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-54c15464-87aa-45b3-a5b7-50f208867234 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:25.121694 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-54c15464-87aa-45b3-a5b7-50f208867234 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb455a61889548b8be6c14780ddcd77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bbfab5a1ffb409e957df2961e769bab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:25.135388 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-54c15464-87aa-45b3-a5b7-50f208867234 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] 10.222.0.20 "GET /compute/v2.1/servers/35ace695-3c50-4035-b161-66417ca56154" status: 200 len: 1316 microversion: 2.1 time: 0.258023 Oct 04 18:56:25.136810 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2842/5650] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:24 2022] GET /compute/v2.1/servers/35ace695-3c50-4035-b161-66417ca56154 => generated 1316 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:25.786978 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5ce0da4d-ea52-4b7b-b7f7-0732e8425863 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:25.787534 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5ce0da4d-ea52-4b7b-b7f7-0732e8425863 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:25.800320 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5ce0da4d-ea52-4b7b-b7f7-0732e8425863 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:25.802694 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5ce0da4d-ea52-4b7b-b7f7-0732e8425863 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:25.806627 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5ce0da4d-ea52-4b7b-b7f7-0732e8425863 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:25.806627 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5ce0da4d-ea52-4b7b-b7f7-0732e8425863 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:25.806627 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5ce0da4d-ea52-4b7b-b7f7-0732e8425863 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:25.806627 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5ce0da4d-ea52-4b7b-b7f7-0732e8425863 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:26.084967 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-61d74955-782d-41bf-aa3e-35fd63aa429d req-372fa324-53da-43ea-804b-a0a5e146228b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35ace695-3c50-4035-b161-66417ca56154", "name": "network-vif-plugged", "status": "completed", "tag": "2ac73446-6c2f-419a-a8a7-0732dca7f5b0"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:56:26.100615 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:56:26.104082 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-61d74955-782d-41bf-aa3e-35fd63aa429d req-372fa324-53da-43ea-804b-a0a5e146228b service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:26.104606 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-61d74955-782d-41bf-aa3e-35fd63aa429d req-372fa324-53da-43ea-804b-a0a5e146228b service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:26.105117 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-61d74955-782d-41bf-aa3e-35fd63aa429d req-372fa324-53da-43ea-804b-a0a5e146228b service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:26.122074 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-61d74955-782d-41bf-aa3e-35fd63aa429d req-372fa324-53da-43ea-804b-a0a5e146228b service nova] Creating event network-vif-plugged:2ac73446-6c2f-419a-a8a7-0732dca7f5b0 for instance 35ace695-3c50-4035-b161-66417ca56154 on n-h1-850501-14 Oct 04 18:56:26.130029 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-61d74955-782d-41bf-aa3e-35fd63aa429d req-372fa324-53da-43ea-804b-a0a5e146228b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050616 Oct 04 18:56:26.131859 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2843/5651] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:56:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:56:26.149245 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5ce0da4d-ea52-4b7b-b7f7-0732e8425863 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:26.162621 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6284f3d3-ea1a-47b5-8a5d-77c33dbc9e51 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:26.163161 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6284f3d3-ea1a-47b5-8a5d-77c33dbc9e51 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] [instance: 35ace695-3c50-4035-b161-66417ca56154] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:26.177372 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5ce0da4d-ea52-4b7b-b7f7-0732e8425863 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1669 microversion: 2.1 time: 0.394970 Oct 04 18:56:26.177967 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2809/5652] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:25 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1669 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:26.205501 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6284f3d3-ea1a-47b5-8a5d-77c33dbc9e51 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:26.206269 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6284f3d3-ea1a-47b5-8a5d-77c33dbc9e51 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:26.207504 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6284f3d3-ea1a-47b5-8a5d-77c33dbc9e51 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:26.208266 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6284f3d3-ea1a-47b5-8a5d-77c33dbc9e51 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:26.208969 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6284f3d3-ea1a-47b5-8a5d-77c33dbc9e51 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:26.209529 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6284f3d3-ea1a-47b5-8a5d-77c33dbc9e51 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:26.507181 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6284f3d3-ea1a-47b5-8a5d-77c33dbc9e51 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb455a61889548b8be6c14780ddcd77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bbfab5a1ffb409e957df2961e769bab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:26.517040 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6284f3d3-ea1a-47b5-8a5d-77c33dbc9e51 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] 10.222.0.20 "GET /compute/v2.1/servers/35ace695-3c50-4035-b161-66417ca56154" status: 200 len: 1316 microversion: 2.1 time: 0.360700 Oct 04 18:56:26.531105 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2844/5653] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:26 2022] GET /compute/v2.1/servers/35ace695-3c50-4035-b161-66417ca56154 => generated 1316 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:27.203765 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-180ab82c-0314-4301-bd83-fc190e221009 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:27.204577 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-180ab82c-0314-4301-bd83-fc190e221009 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:27.220563 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-180ab82c-0314-4301-bd83-fc190e221009 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:27.221226 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-180ab82c-0314-4301-bd83-fc190e221009 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:27.221677 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-180ab82c-0314-4301-bd83-fc190e221009 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:27.224882 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-180ab82c-0314-4301-bd83-fc190e221009 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:27.225572 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-180ab82c-0314-4301-bd83-fc190e221009 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:27.225898 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-180ab82c-0314-4301-bd83-fc190e221009 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:27.543219 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-09a686b6-2c42-4503-8874-69ce7e68b72f tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:27.543846 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-09a686b6-2c42-4503-8874-69ce7e68b72f tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] [instance: 35ace695-3c50-4035-b161-66417ca56154] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:27.558154 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-180ab82c-0314-4301-bd83-fc190e221009 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:27.558431 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-09a686b6-2c42-4503-8874-69ce7e68b72f tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:27.559155 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-09a686b6-2c42-4503-8874-69ce7e68b72f tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:27.559763 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-09a686b6-2c42-4503-8874-69ce7e68b72f tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:27.561415 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-09a686b6-2c42-4503-8874-69ce7e68b72f tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:27.562110 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-09a686b6-2c42-4503-8874-69ce7e68b72f tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:27.562779 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-09a686b6-2c42-4503-8874-69ce7e68b72f tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:27.570460 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-180ab82c-0314-4301-bd83-fc190e221009 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1672 microversion: 2.1 time: 0.371733 Oct 04 18:56:27.579698 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2810/5654] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:27 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1672 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:27.614226 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b81f9e2d-2ed5-4d48-a215-17a13832f049 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:27.614850 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b81f9e2d-2ed5-4d48-a215-17a13832f049 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:27.629909 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b81f9e2d-2ed5-4d48-a215-17a13832f049 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:27.630601 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b81f9e2d-2ed5-4d48-a215-17a13832f049 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:27.631617 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b81f9e2d-2ed5-4d48-a215-17a13832f049 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:27.633191 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b81f9e2d-2ed5-4d48-a215-17a13832f049 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:27.633951 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b81f9e2d-2ed5-4d48-a215-17a13832f049 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:27.634586 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b81f9e2d-2ed5-4d48-a215-17a13832f049 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:28.081879 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-09a686b6-2c42-4503-8874-69ce7e68b72f tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb455a61889548b8be6c14780ddcd77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bbfab5a1ffb409e957df2961e769bab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:28.090587 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b81f9e2d-2ed5-4d48-a215-17a13832f049 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:28.093471 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-09a686b6-2c42-4503-8874-69ce7e68b72f tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] 10.222.0.20 "GET /compute/v2.1/servers/35ace695-3c50-4035-b161-66417ca56154" status: 200 len: 1316 microversion: 2.1 time: 0.555449 Oct 04 18:56:28.094831 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2845/5655] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:27 2022] GET /compute/v2.1/servers/35ace695-3c50-4035-b161-66417ca56154 => generated 1316 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:56:28.112852 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b81f9e2d-2ed5-4d48-a215-17a13832f049 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1672 microversion: 2.1 time: 0.509928 Oct 04 18:56:28.113624 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2811/5656] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:27 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1672 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:28.141764 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9a73beaf-714b-4a17-a730-23caca2a4a6d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:28.142273 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-9a73beaf-714b-4a17-a730-23caca2a4a6d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 202dbed8-c7d0-46a7-aca4-1ff1d9122d8f] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:28.148726 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9a73beaf-714b-4a17-a730-23caca2a4a6d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:28.149220 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9a73beaf-714b-4a17-a730-23caca2a4a6d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:28.149662 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9a73beaf-714b-4a17-a730-23caca2a4a6d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:28.150369 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9a73beaf-714b-4a17-a730-23caca2a4a6d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:28.151001 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9a73beaf-714b-4a17-a730-23caca2a4a6d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:28.151608 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9a73beaf-714b-4a17-a730-23caca2a4a6d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:28.180092 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-9a73beaf-714b-4a17-a730-23caca2a4a6d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 202dbed8-c7d0-46a7-aca4-1ff1d9122d8f] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:56:28.187799 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.compute.api [None req-9a73beaf-714b-4a17-a730-23caca2a4a6d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 202dbed8-c7d0-46a7-aca4-1ff1d9122d8f] Working on deleting snapshot 12644341-a2b8-4e5c-b2cc-b5c709d0fdb0 from shelved instance... Oct 04 18:56:29.117562 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-fbffe991-5727-4afa-99eb-2591fccfdb22 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:29.118284 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-fbffe991-5727-4afa-99eb-2591fccfdb22 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] [instance: 35ace695-3c50-4035-b161-66417ca56154] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:29.125429 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fbffe991-5727-4afa-99eb-2591fccfdb22 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:29.125922 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fbffe991-5727-4afa-99eb-2591fccfdb22 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:29.126639 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fbffe991-5727-4afa-99eb-2591fccfdb22 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:29.127615 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fbffe991-5727-4afa-99eb-2591fccfdb22 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:29.128097 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fbffe991-5727-4afa-99eb-2591fccfdb22 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:29.129053 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fbffe991-5727-4afa-99eb-2591fccfdb22 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:29.354005 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-fbffe991-5727-4afa-99eb-2591fccfdb22 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb455a61889548b8be6c14780ddcd77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bbfab5a1ffb409e957df2961e769bab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:29.379213 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-fbffe991-5727-4afa-99eb-2591fccfdb22 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] 10.222.0.20 "GET /compute/v2.1/servers/35ace695-3c50-4035-b161-66417ca56154" status: 200 len: 1504 microversion: 2.1 time: 0.266198 Oct 04 18:56:29.393375 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2812/5657] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:29 2022] GET /compute/v2.1/servers/35ace695-3c50-4035-b161-66417ca56154 => generated 1504 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:56:29.405691 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-271543db-6c30-4c6c-9d8a-d5f50facc876 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:29.406208 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-271543db-6c30-4c6c-9d8a-d5f50facc876 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] [instance: 35ace695-3c50-4035-b161-66417ca56154] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:29.412198 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-271543db-6c30-4c6c-9d8a-d5f50facc876 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:29.412685 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-271543db-6c30-4c6c-9d8a-d5f50facc876 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:29.413124 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-271543db-6c30-4c6c-9d8a-d5f50facc876 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:29.413999 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-271543db-6c30-4c6c-9d8a-d5f50facc876 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:29.414475 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-271543db-6c30-4c6c-9d8a-d5f50facc876 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:29.415163 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-271543db-6c30-4c6c-9d8a-d5f50facc876 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:29.569019 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-271543db-6c30-4c6c-9d8a-d5f50facc876 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] 10.222.0.20 "DELETE /compute/v2.1/servers/35ace695-3c50-4035-b161-66417ca56154/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.167183 Oct 04 18:56:29.573765 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2813/5658] 10.222.0.20 () {58 vars in 1296 bytes} [Tue Oct 4 18:56:29 2022] DELETE /compute/v2.1/servers/35ace695-3c50-4035-b161-66417ca56154/os-server-password => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:56:29.579974 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0a3a9002-7b43-4b74-a1dc-314860d04bd0 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:29.581054 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0a3a9002-7b43-4b74-a1dc-314860d04bd0 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] [instance: 35ace695-3c50-4035-b161-66417ca56154] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:29.588619 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0a3a9002-7b43-4b74-a1dc-314860d04bd0 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:29.589325 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0a3a9002-7b43-4b74-a1dc-314860d04bd0 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:29.590152 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0a3a9002-7b43-4b74-a1dc-314860d04bd0 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:29.590956 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0a3a9002-7b43-4b74-a1dc-314860d04bd0 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:29.591819 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0a3a9002-7b43-4b74-a1dc-314860d04bd0 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:29.592303 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0a3a9002-7b43-4b74-a1dc-314860d04bd0 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:29.619284 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0a3a9002-7b43-4b74-a1dc-314860d04bd0 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] 10.222.0.20 "GET /compute/v2.1/servers/35ace695-3c50-4035-b161-66417ca56154/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.044142 Oct 04 18:56:29.619887 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2814/5659] 10.222.0.20 () {58 vars in 1293 bytes} [Tue Oct 4 18:56:29 2022] GET /compute/v2.1/servers/35ace695-3c50-4035-b161-66417ca56154/os-server-password => generated 16 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:56:29.631270 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-95720ba8-8ac0-4552-aca6-3fe77d8e4001 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:29.631772 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-95720ba8-8ac0-4552-aca6-3fe77d8e4001 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] [instance: 35ace695-3c50-4035-b161-66417ca56154] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:29.638610 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-95720ba8-8ac0-4552-aca6-3fe77d8e4001 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:29.639055 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-95720ba8-8ac0-4552-aca6-3fe77d8e4001 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:29.639490 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-95720ba8-8ac0-4552-aca6-3fe77d8e4001 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:29.640216 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-95720ba8-8ac0-4552-aca6-3fe77d8e4001 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:29.640669 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-95720ba8-8ac0-4552-aca6-3fe77d8e4001 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:29.641098 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-95720ba8-8ac0-4552-aca6-3fe77d8e4001 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:29.667572 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-95720ba8-8ac0-4552-aca6-3fe77d8e4001 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] [instance: 35ace695-3c50-4035-b161-66417ca56154] Going to try to terminate instance {{(pid=123002) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:56:29.967884 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-9a73beaf-714b-4a17-a730-23caca2a4a6d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 202dbed8-c7d0-46a7-aca4-1ff1d9122d8f] Doing local delete in cell a6039a6d-a98c-44a9-819b-4eff388d8aa7(cell1) {{(pid=123001) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 04 18:56:29.969302 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9a73beaf-714b-4a17-a730-23caca2a4a6d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:29.970032 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9a73beaf-714b-4a17-a730-23caca2a4a6d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:29.970615 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9a73beaf-714b-4a17-a730-23caca2a4a6d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:29.971185 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.compute.api [None req-9a73beaf-714b-4a17-a730-23caca2a4a6d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 202dbed8-c7d0-46a7-aca4-1ff1d9122d8f] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 04 18:56:29.975530 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.neutron [None req-9a73beaf-714b-4a17-a730-23caca2a4a6d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 202dbed8-c7d0-46a7-aca4-1ff1d9122d8f] deallocate_for_instance() {{(pid=123001) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 04 18:56:30.056489 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-95720ba8-8ac0-4552-aca6-3fe77d8e4001 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] 10.222.0.20 "DELETE /compute/v2.1/servers/35ace695-3c50-4035-b161-66417ca56154" status: 204 len: 0 microversion: 2.1 time: 0.428918 Oct 04 18:56:30.059280 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2815/5660] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:56:29 2022] DELETE /compute/v2.1/servers/35ace695-3c50-4035-b161-66417ca56154 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:56:30.079874 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2a0329c5-b546-449e-89b3-9d2128e25624 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:30.080660 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2a0329c5-b546-449e-89b3-9d2128e25624 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] [instance: 35ace695-3c50-4035-b161-66417ca56154] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:30.087689 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2a0329c5-b546-449e-89b3-9d2128e25624 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:30.088407 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2a0329c5-b546-449e-89b3-9d2128e25624 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:30.089110 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2a0329c5-b546-449e-89b3-9d2128e25624 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:30.089860 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2a0329c5-b546-449e-89b3-9d2128e25624 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:30.090325 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2a0329c5-b546-449e-89b3-9d2128e25624 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:30.090761 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2a0329c5-b546-449e-89b3-9d2128e25624 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:30.117474 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=4,nova_cell1:INSERT=6 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:56:30.486706 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2a0329c5-b546-449e-89b3-9d2128e25624 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb455a61889548b8be6c14780ddcd77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bbfab5a1ffb409e957df2961e769bab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:30.499946 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2a0329c5-b546-449e-89b3-9d2128e25624 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] 10.222.0.20 "GET /compute/v2.1/servers/35ace695-3c50-4035-b161-66417ca56154" status: 200 len: 1510 microversion: 2.1 time: 0.424119 Oct 04 18:56:30.500939 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2816/5661] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:30 2022] GET /compute/v2.1/servers/35ace695-3c50-4035-b161-66417ca56154 => generated 1510 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:56:31.112927 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-29b275d7-c01b-4706-bdd1-bcc77bd08034 req-730a49f8-9302-46bd-8cef-81b146c50e89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "202dbed8-c7d0-46a7-aca4-1ff1d9122d8f", "name": "network-vif-deleted", "tag": "e17b95ea-0e43-4795-956b-ede441ab9cb4"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:56:31.143354 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-29b275d7-c01b-4706-bdd1-bcc77bd08034 req-730a49f8-9302-46bd-8cef-81b146c50e89 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:31.143839 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-29b275d7-c01b-4706-bdd1-bcc77bd08034 req-730a49f8-9302-46bd-8cef-81b146c50e89 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:31.144308 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-29b275d7-c01b-4706-bdd1-bcc77bd08034 req-730a49f8-9302-46bd-8cef-81b146c50e89 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:31.173053 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.compute.server_external_events [req-29b275d7-c01b-4706-bdd1-bcc77bd08034 req-730a49f8-9302-46bd-8cef-81b146c50e89 service nova] Unable to find a host for instance 202dbed8-c7d0-46a7-aca4-1ff1d9122d8f. Dropping event network-vif-deleted {{(pid=123002) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 04 18:56:31.173981 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-29b275d7-c01b-4706-bdd1-bcc77bd08034 req-730a49f8-9302-46bd-8cef-81b146c50e89 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.065681 Oct 04 18:56:31.181167 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2817/5662] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:56:31 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 72 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 04 18:56:31.185530 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.neutron [None req-9a73beaf-714b-4a17-a730-23caca2a4a6d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 202dbed8-c7d0-46a7-aca4-1ff1d9122d8f] Updating instance_info_cache with network_info: [] {{(pid=123001) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 18:56:31.523565 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-807ad08b-da08-4bb2-923f-68f3edc4be4b tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:31.524238 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-807ad08b-da08-4bb2-923f-68f3edc4be4b tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] [instance: 35ace695-3c50-4035-b161-66417ca56154] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:31.535199 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-807ad08b-da08-4bb2-923f-68f3edc4be4b tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:31.536374 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-807ad08b-da08-4bb2-923f-68f3edc4be4b tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:31.537025 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-807ad08b-da08-4bb2-923f-68f3edc4be4b tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:31.538216 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-807ad08b-da08-4bb2-923f-68f3edc4be4b tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:31.540301 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-807ad08b-da08-4bb2-923f-68f3edc4be4b tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:31.541881 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-807ad08b-da08-4bb2-923f-68f3edc4be4b tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:31.871885 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9a73beaf-714b-4a17-a730-23caca2a4a6d tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "DELETE /compute/v2.1/servers/202dbed8-c7d0-46a7-aca4-1ff1d9122d8f" status: 204 len: 0 microversion: 2.1 time: 3.734055 Oct 04 18:56:31.874052 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2846/5663] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:56:28 2022] DELETE /compute/v2.1/servers/202dbed8-c7d0-46a7-aca4-1ff1d9122d8f => generated 0 bytes in 3741 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:56:31.890736 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b11ca36e-e9b3-42dc-a381-59662954d1f8 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:31.896546 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b11ca36e-e9b3-42dc-a381-59662954d1f8 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 202dbed8-c7d0-46a7-aca4-1ff1d9122d8f] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:31.911614 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b11ca36e-e9b3-42dc-a381-59662954d1f8 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:31.915604 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b11ca36e-e9b3-42dc-a381-59662954d1f8 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:31.915604 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b11ca36e-e9b3-42dc-a381-59662954d1f8 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:31.915604 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b11ca36e-e9b3-42dc-a381-59662954d1f8 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:31.915604 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b11ca36e-e9b3-42dc-a381-59662954d1f8 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:31.915604 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b11ca36e-e9b3-42dc-a381-59662954d1f8 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:31.944907 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-b11ca36e-e9b3-42dc-a381-59662954d1f8 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] HTTP exception thrown: Instance 202dbed8-c7d0-46a7-aca4-1ff1d9122d8f could not be found. Oct 04 18:56:31.946943 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b11ca36e-e9b3-42dc-a381-59662954d1f8 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Request method failure captured: Oct 04 18:56:31.946943 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/202dbed8-c7d0-46a7-aca4-1ff1d9122d8f HTTP/1.1 Oct 04 18:56:31.946943 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:56:31.946943 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:56:31.946943 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:56:31.946943 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:56:31.946943 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:56:31.946943 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:56:31.946943 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:56:31.946943 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:56:31.946943 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPH9sNKcZV12-VrzgkMcjOaIHcQXzo_OQ-K38hc0f55Lf_4RZrXGgMmn5jWeZmAc1TRzC-i_WlxKP0xlRL0UMRNxVvlUX8rNQZjC__ruqdhQgQWDSwxsACYsgZpz7nprjIdkJFbhvMXXkXexF7-ajgS9bmCu4Pvp0T8fklC1E3t24Rz8 Oct 04 18:56:31.946943 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:56:31.946943 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:56:31.946943 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:56:31.946943 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:56:31.946943 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:56:31.946943 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:56:31.946943 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 57d8fd392d5b4e8798cb51fe0e54ad3b Oct 04 18:56:31.946943 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ServerActionsTestJSON-1010650728 Oct 04 18:56:31.946943 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:56:31.946943 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:56:31.946943 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/57d8fd392d5b4e8798cb51fe0e54ad3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_57d8fd392d5b4e8798cb51fe0e54ad3b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/57d8fd392d5b4e8798cb51fe0e54ad3b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/57d8fd392d5b4e8798cb51fe0e54ad3b"}]}] Oct 04 18:56:31.946943 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ServerActionsTestJSON-1010650728 Oct 04 18:56:31.946943 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 57d8fd392d5b4e8798cb51fe0e54ad3b Oct 04 18:56:31.946943 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ServerActionsTestJSON-1010650728 Oct 04 18:56:31.946943 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ServerActionsTestJSON-1010650728-project Oct 04 18:56:31.946943 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:56:31.946943 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:56:31.946943 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: ee7fee2b098d4eb8bdc8df2a929cdede Oct 04 18:56:31.946943 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ServerActionsTestJSON-1010650728-project Oct 04 18:56:31.946943 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:56:31.946943 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 202dbed8-c7d0-46a7-aca4-1ff1d9122d8f could not be found. Oct 04 18:56:31.946943 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '202dbed8-c7d0-46a7-aca4-1ff1d9122d8f'} Oct 04 18:56:31.946943 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:56:31.946943 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:56:31.946943 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:56:31.946943 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:56:31.946943 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:56:31.946943 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:56:31.946943 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:56:31.946943 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:56:31.946943 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:56:31.946943 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:56:31.946943 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 202dbed8-c7d0-46a7-aca4-1ff1d9122d8f could not be found. Oct 04 18:56:31.946943 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:56:31.946943 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:56:31.946943 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:56:31.946943 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:56:31.946943 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:56:31.946943 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:56:31.946943 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:56:31.946943 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:56:31.946943 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:56:31.946943 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:56:31.946943 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:56:31.946943 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:56:31.946943 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:56:31.946943 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:56:31.946943 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:56:31.946943 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:56:31.946943 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 202dbed8-c7d0-46a7-aca4-1ff1d9122d8f could not be found. Oct 04 18:56:31.946943 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:56:31.946943 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:56:31.946943 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:56:31.952215 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:56:31.952215 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:56:31.952215 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:56:31.952215 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:56:31.952215 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:56:31.952215 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 202dbed8-c7d0-46a7-aca4-1ff1d9122d8f could not be found. Oct 04 18:56:31.952215 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:56:31.953678 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b11ca36e-e9b3-42dc-a381-59662954d1f8 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Returning 404 to user: Instance 202dbed8-c7d0-46a7-aca4-1ff1d9122d8f could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:56:31.954698 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b11ca36e-e9b3-42dc-a381-59662954d1f8 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/202dbed8-c7d0-46a7-aca4-1ff1d9122d8f" status: 404 len: 111 microversion: 2.1 time: 0.076310 Oct 04 18:56:31.955743 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2847/5664] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:31 2022] GET /compute/v2.1/servers/202dbed8-c7d0-46a7-aca4-1ff1d9122d8f => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:56:31.967127 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2780956f-b67c-44e3-a899-ad63ba06fd07 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:31.967646 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2780956f-b67c-44e3-a899-ad63ba06fd07 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 06eb8777-d059-4716-b47c-df3e6a027722] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:31.987163 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2780956f-b67c-44e3-a899-ad63ba06fd07 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:31.987665 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2780956f-b67c-44e3-a899-ad63ba06fd07 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:31.988127 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2780956f-b67c-44e3-a899-ad63ba06fd07 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:31.988897 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2780956f-b67c-44e3-a899-ad63ba06fd07 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:31.989362 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2780956f-b67c-44e3-a899-ad63ba06fd07 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:31.989778 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2780956f-b67c-44e3-a899-ad63ba06fd07 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:32.065695 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2780956f-b67c-44e3-a899-ad63ba06fd07 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 06eb8777-d059-4716-b47c-df3e6a027722] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:56:32.105271 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-807ad08b-da08-4bb2-923f-68f3edc4be4b tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb455a61889548b8be6c14780ddcd77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bbfab5a1ffb409e957df2961e769bab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:32.116111 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=17,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:56:32.120969 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-807ad08b-da08-4bb2-923f-68f3edc4be4b tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] 10.222.0.20 "GET /compute/v2.1/servers/35ace695-3c50-4035-b161-66417ca56154" status: 200 len: 1510 microversion: 2.1 time: 0.601882 Oct 04 18:56:32.121569 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2818/5665] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:31 2022] GET /compute/v2.1/servers/35ace695-3c50-4035-b161-66417ca56154 => generated 1510 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:56:32.465280 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2780956f-b67c-44e3-a899-ad63ba06fd07 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "DELETE /compute/v2.1/servers/06eb8777-d059-4716-b47c-df3e6a027722" status: 204 len: 0 microversion: 2.1 time: 0.504510 Oct 04 18:56:32.469789 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2848/5666] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:56:31 2022] DELETE /compute/v2.1/servers/06eb8777-d059-4716-b47c-df3e6a027722 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:56:32.490385 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c2db78b6-1580-4542-b403-f1e641ccfb85 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:32.492915 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c2db78b6-1580-4542-b403-f1e641ccfb85 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 06eb8777-d059-4716-b47c-df3e6a027722] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:32.501288 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c2db78b6-1580-4542-b403-f1e641ccfb85 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:32.502633 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c2db78b6-1580-4542-b403-f1e641ccfb85 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:32.503279 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c2db78b6-1580-4542-b403-f1e641ccfb85 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:32.504639 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c2db78b6-1580-4542-b403-f1e641ccfb85 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:32.507484 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c2db78b6-1580-4542-b403-f1e641ccfb85 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:32.508220 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c2db78b6-1580-4542-b403-f1e641ccfb85 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:32.647172 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c2db78b6-1580-4542-b403-f1e641ccfb85 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:32.660417 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c2db78b6-1580-4542-b403-f1e641ccfb85 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/06eb8777-d059-4716-b47c-df3e6a027722" status: 200 len: 1465 microversion: 2.1 time: 0.186392 Oct 04 18:56:32.661029 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2819/5667] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:32 2022] GET /compute/v2.1/servers/06eb8777-d059-4716-b47c-df3e6a027722 => generated 1465 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:56:33.157636 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4d6cf310-ce50-433a-8154-8aaf496ba124 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:33.159755 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-4d6cf310-ce50-433a-8154-8aaf496ba124 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] [instance: 35ace695-3c50-4035-b161-66417ca56154] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:33.185871 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4d6cf310-ce50-433a-8154-8aaf496ba124 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:33.187027 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4d6cf310-ce50-433a-8154-8aaf496ba124 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:33.187658 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4d6cf310-ce50-433a-8154-8aaf496ba124 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:33.188690 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4d6cf310-ce50-433a-8154-8aaf496ba124 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:33.189376 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4d6cf310-ce50-433a-8154-8aaf496ba124 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:33.189963 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4d6cf310-ce50-433a-8154-8aaf496ba124 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:33.194512 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-198efe6b-c90b-4f01-8c45-99498958d6ad req-9aa79198-193e-4e5a-a1a7-ad663d183b03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35ace695-3c50-4035-b161-66417ca56154", "name": "network-vif-deleted", "tag": "2ac73446-6c2f-419a-a8a7-0732dca7f5b0"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:56:33.221012 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-198efe6b-c90b-4f01-8c45-99498958d6ad req-9aa79198-193e-4e5a-a1a7-ad663d183b03 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:33.227867 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-198efe6b-c90b-4f01-8c45-99498958d6ad req-9aa79198-193e-4e5a-a1a7-ad663d183b03 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:33.228662 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-198efe6b-c90b-4f01-8c45-99498958d6ad req-9aa79198-193e-4e5a-a1a7-ad663d183b03 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:33.309218 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-198efe6b-c90b-4f01-8c45-99498958d6ad req-9aa79198-193e-4e5a-a1a7-ad663d183b03 service nova] Creating event network-vif-deleted:2ac73446-6c2f-419a-a8a7-0732dca7f5b0 for instance 35ace695-3c50-4035-b161-66417ca56154 on n-h1-850501-14 Oct 04 18:56:33.324136 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-198efe6b-c90b-4f01-8c45-99498958d6ad req-9aa79198-193e-4e5a-a1a7-ad663d183b03 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135865 Oct 04 18:56:33.324769 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2820/5668] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:56:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:56:33.334553 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-4d6cf310-ce50-433a-8154-8aaf496ba124 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb455a61889548b8be6c14780ddcd77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bbfab5a1ffb409e957df2961e769bab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:33.346464 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-4d6cf310-ce50-433a-8154-8aaf496ba124 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] 10.222.0.20 "GET /compute/v2.1/servers/35ace695-3c50-4035-b161-66417ca56154" status: 200 len: 1468 microversion: 2.1 time: 0.202276 Oct 04 18:56:33.349659 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2849/5669] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:33 2022] GET /compute/v2.1/servers/35ace695-3c50-4035-b161-66417ca56154 => generated 1468 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:33.686317 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7bf70f68-aefb-453c-a783-266ee69a6333 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:33.687691 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7bf70f68-aefb-453c-a783-266ee69a6333 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 06eb8777-d059-4716-b47c-df3e6a027722] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:33.739042 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7bf70f68-aefb-453c-a783-266ee69a6333 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:33.741938 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7bf70f68-aefb-453c-a783-266ee69a6333 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:33.741938 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7bf70f68-aefb-453c-a783-266ee69a6333 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:33.741938 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7bf70f68-aefb-453c-a783-266ee69a6333 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:33.741938 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7bf70f68-aefb-453c-a783-266ee69a6333 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:33.742987 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7bf70f68-aefb-453c-a783-266ee69a6333 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:33.945450 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7bf70f68-aefb-453c-a783-266ee69a6333 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:33.956574 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7bf70f68-aefb-453c-a783-266ee69a6333 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/06eb8777-d059-4716-b47c-df3e6a027722" status: 200 len: 1465 microversion: 2.1 time: 0.275380 Oct 04 18:56:33.957526 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2821/5670] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:33 2022] GET /compute/v2.1/servers/06eb8777-d059-4716-b47c-df3e6a027722 => generated 1465 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:34.382640 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ec01236d-1ce8-4799-b23f-08384c6877fb tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:34.384129 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ec01236d-1ce8-4799-b23f-08384c6877fb tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] [instance: 35ace695-3c50-4035-b161-66417ca56154] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:34.397959 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec01236d-1ce8-4799-b23f-08384c6877fb tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:34.405075 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec01236d-1ce8-4799-b23f-08384c6877fb tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:34.405765 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec01236d-1ce8-4799-b23f-08384c6877fb tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:34.406716 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec01236d-1ce8-4799-b23f-08384c6877fb tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:34.408405 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec01236d-1ce8-4799-b23f-08384c6877fb tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:34.409348 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec01236d-1ce8-4799-b23f-08384c6877fb tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:34.475198 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec01236d-1ce8-4799-b23f-08384c6877fb tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:34.482429 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec01236d-1ce8-4799-b23f-08384c6877fb tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:34.482429 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec01236d-1ce8-4799-b23f-08384c6877fb tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:34.482429 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-ec01236d-1ce8-4799-b23f-08384c6877fb tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Lazy-loading 'fault' on Instance uuid 35ace695-3c50-4035-b161-66417ca56154 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:56:34.641904 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ec01236d-1ce8-4799-b23f-08384c6877fb tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb455a61889548b8be6c14780ddcd77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bbfab5a1ffb409e957df2961e769bab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:34.661963 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ec01236d-1ce8-4799-b23f-08384c6877fb tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] 10.222.0.20 "GET /compute/v2.1/servers/35ace695-3c50-4035-b161-66417ca56154" status: 200 len: 1306 microversion: 2.1 time: 0.283828 Oct 04 18:56:34.663038 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2850/5671] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:34 2022] GET /compute/v2.1/servers/35ace695-3c50-4035-b161-66417ca56154 => generated 1306 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:34.988420 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3c7dec93-ddcd-4e0c-94e6-7715d26aac6a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:34.989201 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3c7dec93-ddcd-4e0c-94e6-7715d26aac6a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 06eb8777-d059-4716-b47c-df3e6a027722] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:34.998255 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3c7dec93-ddcd-4e0c-94e6-7715d26aac6a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:34.998905 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3c7dec93-ddcd-4e0c-94e6-7715d26aac6a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:34.999413 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3c7dec93-ddcd-4e0c-94e6-7715d26aac6a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:35.000204 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3c7dec93-ddcd-4e0c-94e6-7715d26aac6a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:35.000663 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3c7dec93-ddcd-4e0c-94e6-7715d26aac6a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:35.001108 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3c7dec93-ddcd-4e0c-94e6-7715d26aac6a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:35.092091 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3c7dec93-ddcd-4e0c-94e6-7715d26aac6a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:35.101914 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3c7dec93-ddcd-4e0c-94e6-7715d26aac6a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/06eb8777-d059-4716-b47c-df3e6a027722" status: 200 len: 1299 microversion: 2.1 time: 0.119116 Oct 04 18:56:35.104815 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2822/5672] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:34 2022] GET /compute/v2.1/servers/06eb8777-d059-4716-b47c-df3e6a027722 => generated 1299 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:56:35.365335 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-d4045766-5092-4a8a-aaef-fafb432d80be req-c58f532c-649c-46ee-ae5d-37b7e6d5223f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06eb8777-d059-4716-b47c-df3e6a027722", "name": "network-vif-deleted", "tag": "216b899c-9fe6-4911-a379-731b6d5dce0e"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:56:35.390035 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-d4045766-5092-4a8a-aaef-fafb432d80be req-c58f532c-649c-46ee-ae5d-37b7e6d5223f service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:35.393667 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-d4045766-5092-4a8a-aaef-fafb432d80be req-c58f532c-649c-46ee-ae5d-37b7e6d5223f service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:35.394515 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-d4045766-5092-4a8a-aaef-fafb432d80be req-c58f532c-649c-46ee-ae5d-37b7e6d5223f service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:35.428857 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-d4045766-5092-4a8a-aaef-fafb432d80be req-c58f532c-649c-46ee-ae5d-37b7e6d5223f service nova] Creating event network-vif-deleted:216b899c-9fe6-4911-a379-731b6d5dce0e for instance 06eb8777-d059-4716-b47c-df3e6a027722 on n-h1-850501-14 Oct 04 18:56:35.443148 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-d4045766-5092-4a8a-aaef-fafb432d80be req-c58f532c-649c-46ee-ae5d-37b7e6d5223f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083324 Oct 04 18:56:35.447015 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2851/5673] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:56:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:56:35.688534 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d6a8fde8-9408-40ca-8d21-ac5ef77f2771 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:35.689169 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d6a8fde8-9408-40ca-8d21-ac5ef77f2771 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] [instance: 35ace695-3c50-4035-b161-66417ca56154] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:35.701138 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d6a8fde8-9408-40ca-8d21-ac5ef77f2771 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:35.704446 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d6a8fde8-9408-40ca-8d21-ac5ef77f2771 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:35.704967 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d6a8fde8-9408-40ca-8d21-ac5ef77f2771 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:35.705807 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d6a8fde8-9408-40ca-8d21-ac5ef77f2771 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:35.706599 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d6a8fde8-9408-40ca-8d21-ac5ef77f2771 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:35.707056 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d6a8fde8-9408-40ca-8d21-ac5ef77f2771 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:35.755439 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-d6a8fde8-9408-40ca-8d21-ac5ef77f2771 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] HTTP exception thrown: Instance 35ace695-3c50-4035-b161-66417ca56154 could not be found. Oct 04 18:56:35.758143 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d6a8fde8-9408-40ca-8d21-ac5ef77f2771 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Request method failure captured: Oct 04 18:56:35.758143 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/35ace695-3c50-4035-b161-66417ca56154 HTTP/1.1 Oct 04 18:56:35.758143 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:56:35.758143 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:56:35.758143 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:56:35.758143 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:56:35.758143 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:56:35.758143 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:56:35.758143 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:56:35.758143 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:56:35.758143 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPIHIOv2BYyuuoIRj39mhTJV5rPOfGyHSlG8iigIjzr21iLIHN-pVNCqepWf0r8pTVDl5qwPROC1izTAxj8C_qUTiPcVYF7ZHZiNqx-kGml_2-HQtluhEzJJ_z1y4e9fKabFZcrHxmrBFaYu_yXbISmeEk3475HJpYfQCgz2YY8o-rsw Oct 04 18:56:35.758143 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:56:35.758143 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:56:35.758143 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:56:35.758143 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:56:35.758143 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:56:35.758143 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:56:35.758143 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 7bbfab5a1ffb409e957df2961e769bab Oct 04 18:56:35.758143 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServerPasswordTestJSON-368490088 Oct 04 18:56:35.758143 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:56:35.758143 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:56:35.758143 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7bbfab5a1ffb409e957df2961e769bab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7bbfab5a1ffb409e957df2961e769bab", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7bbfab5a1ffb409e957df2961e769bab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7bbfab5a1ffb409e957df2961e769bab"}]}] Oct 04 18:56:35.758143 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServerPasswordTestJSON-368490088 Oct 04 18:56:35.758143 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 7bbfab5a1ffb409e957df2961e769bab Oct 04 18:56:35.758143 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServerPasswordTestJSON-368490088 Oct 04 18:56:35.758143 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServerPasswordTestJSON-368490088-project Oct 04 18:56:35.758143 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:56:35.758143 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:56:35.758143 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: cb455a61889548b8be6c14780ddcd77e Oct 04 18:56:35.758143 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServerPasswordTestJSON-368490088-project Oct 04 18:56:35.758143 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:56:35.758143 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 35ace695-3c50-4035-b161-66417ca56154 could not be found. Oct 04 18:56:35.758143 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '35ace695-3c50-4035-b161-66417ca56154'} Oct 04 18:56:35.758143 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:56:35.758143 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:56:35.758143 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:56:35.758143 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:56:35.758143 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:56:35.758143 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:56:35.758143 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:56:35.758143 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:56:35.758143 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:56:35.758143 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:56:35.758143 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35ace695-3c50-4035-b161-66417ca56154 could not be found. Oct 04 18:56:35.758143 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:56:35.758143 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:56:35.758143 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:56:35.758143 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:56:35.758143 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:56:35.758143 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:56:35.758143 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:56:35.758143 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:56:35.758143 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:56:35.758143 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:56:35.758143 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:56:35.758143 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:56:35.758143 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:56:35.758143 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:56:35.758143 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:56:35.758143 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:56:35.758143 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35ace695-3c50-4035-b161-66417ca56154 could not be found. Oct 04 18:56:35.758143 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:56:35.758143 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:56:35.758143 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:56:35.762008 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:56:35.762008 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:56:35.762008 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:56:35.762008 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:56:35.762008 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:56:35.762008 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35ace695-3c50-4035-b161-66417ca56154 could not be found. Oct 04 18:56:35.762008 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:56:35.762008 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d6a8fde8-9408-40ca-8d21-ac5ef77f2771 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] Returning 404 to user: Instance 35ace695-3c50-4035-b161-66417ca56154 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:56:35.762008 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d6a8fde8-9408-40ca-8d21-ac5ef77f2771 tempest-ServerPasswordTestJSON-368490088 tempest-ServerPasswordTestJSON-368490088-project] 10.222.0.20 "GET /compute/v2.1/servers/35ace695-3c50-4035-b161-66417ca56154" status: 404 len: 111 microversion: 2.1 time: 0.076265 Oct 04 18:56:35.762008 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2823/5674] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:35 2022] GET /compute/v2.1/servers/35ace695-3c50-4035-b161-66417ca56154 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:56:36.143460 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a1ad312b-cea6-4bfd-879f-9dd58aaef36e tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:36.144548 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a1ad312b-cea6-4bfd-879f-9dd58aaef36e tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 06eb8777-d059-4716-b47c-df3e6a027722] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:36.163540 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a1ad312b-cea6-4bfd-879f-9dd58aaef36e tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:36.165531 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a1ad312b-cea6-4bfd-879f-9dd58aaef36e tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:36.166247 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a1ad312b-cea6-4bfd-879f-9dd58aaef36e tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:36.168766 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a1ad312b-cea6-4bfd-879f-9dd58aaef36e tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:36.174482 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a1ad312b-cea6-4bfd-879f-9dd58aaef36e tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:36.175180 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a1ad312b-cea6-4bfd-879f-9dd58aaef36e tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:36.195638 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-a1ad312b-cea6-4bfd-879f-9dd58aaef36e tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] HTTP exception thrown: Instance 06eb8777-d059-4716-b47c-df3e6a027722 could not be found. Oct 04 18:56:36.198081 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a1ad312b-cea6-4bfd-879f-9dd58aaef36e tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Request method failure captured: Oct 04 18:56:36.198081 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/06eb8777-d059-4716-b47c-df3e6a027722 HTTP/1.1 Oct 04 18:56:36.198081 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:56:36.198081 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:56:36.198081 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:56:36.198081 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:56:36.198081 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:56:36.198081 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:56:36.198081 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:56:36.198081 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:56:36.198081 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPH9sNKcZV12-VrzgkMcjOaIHcQXzo_OQ-K38hc0f55Lf_4RZrXGgMmn5jWeZmAc1TRzC-i_WlxKP0xlRL0UMRNxVvlUX8rNQZjC__ruqdhQgQWDSwxsACYsgZpz7nprjIdkJFbhvMXXkXexF7-ajgS9bmCu4Pvp0T8fklC1E3t24Rz8 Oct 04 18:56:36.198081 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:56:36.198081 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:56:36.198081 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:56:36.198081 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:56:36.198081 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:56:36.198081 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:56:36.198081 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 57d8fd392d5b4e8798cb51fe0e54ad3b Oct 04 18:56:36.198081 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ServerActionsTestJSON-1010650728 Oct 04 18:56:36.198081 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:56:36.198081 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:56:36.198081 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/57d8fd392d5b4e8798cb51fe0e54ad3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_57d8fd392d5b4e8798cb51fe0e54ad3b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/57d8fd392d5b4e8798cb51fe0e54ad3b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/57d8fd392d5b4e8798cb51fe0e54ad3b"}]}] Oct 04 18:56:36.198081 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ServerActionsTestJSON-1010650728 Oct 04 18:56:36.198081 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 57d8fd392d5b4e8798cb51fe0e54ad3b Oct 04 18:56:36.198081 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ServerActionsTestJSON-1010650728 Oct 04 18:56:36.198081 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ServerActionsTestJSON-1010650728-project Oct 04 18:56:36.198081 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:56:36.198081 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:56:36.198081 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: ee7fee2b098d4eb8bdc8df2a929cdede Oct 04 18:56:36.198081 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ServerActionsTestJSON-1010650728-project Oct 04 18:56:36.198081 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:56:36.198081 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 06eb8777-d059-4716-b47c-df3e6a027722 could not be found. Oct 04 18:56:36.198081 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '06eb8777-d059-4716-b47c-df3e6a027722'} Oct 04 18:56:36.198081 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:56:36.198081 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:56:36.198081 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:56:36.198081 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:56:36.198081 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:56:36.198081 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:56:36.198081 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:56:36.198081 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:56:36.198081 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:56:36.198081 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:56:36.198081 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06eb8777-d059-4716-b47c-df3e6a027722 could not be found. Oct 04 18:56:36.198081 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:56:36.198081 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:56:36.198081 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:56:36.198081 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:56:36.198081 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:56:36.198081 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:56:36.198081 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:56:36.198081 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:56:36.198081 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:56:36.198081 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:56:36.198081 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:56:36.198081 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:56:36.198081 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:56:36.198081 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:56:36.198081 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:56:36.198081 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:56:36.198081 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06eb8777-d059-4716-b47c-df3e6a027722 could not be found. Oct 04 18:56:36.198081 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:56:36.198081 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:56:36.198081 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:56:36.212666 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:56:36.212666 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:56:36.212666 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:56:36.212666 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:56:36.212666 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:56:36.212666 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06eb8777-d059-4716-b47c-df3e6a027722 could not be found. Oct 04 18:56:36.212666 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:56:36.212666 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a1ad312b-cea6-4bfd-879f-9dd58aaef36e tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Returning 404 to user: Instance 06eb8777-d059-4716-b47c-df3e6a027722 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:56:36.212666 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a1ad312b-cea6-4bfd-879f-9dd58aaef36e tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/06eb8777-d059-4716-b47c-df3e6a027722" status: 404 len: 111 microversion: 2.1 time: 0.064808 Oct 04 18:56:36.212666 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2852/5675] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:36 2022] GET /compute/v2.1/servers/06eb8777-d059-4716-b47c-df3e6a027722 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:56:36.213352 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d630c948-433b-4a29-bc17-1e69d2d35190 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:36.213352 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d630c948-433b-4a29-bc17-1e69d2d35190 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: fc136da8-3767-4c12-906c-d3a3562ccba4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:36.229106 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d630c948-433b-4a29-bc17-1e69d2d35190 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:36.229793 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d630c948-433b-4a29-bc17-1e69d2d35190 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:36.230610 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d630c948-433b-4a29-bc17-1e69d2d35190 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:36.237076 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d630c948-433b-4a29-bc17-1e69d2d35190 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:36.237674 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d630c948-433b-4a29-bc17-1e69d2d35190 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:36.240324 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d630c948-433b-4a29-bc17-1e69d2d35190 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:36.298155 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d630c948-433b-4a29-bc17-1e69d2d35190 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: fc136da8-3767-4c12-906c-d3a3562ccba4] Going to try to terminate instance {{(pid=123002) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:56:36.715217 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d630c948-433b-4a29-bc17-1e69d2d35190 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "DELETE /compute/v2.1/servers/fc136da8-3767-4c12-906c-d3a3562ccba4" status: 204 len: 0 microversion: 2.1 time: 0.508927 Oct 04 18:56:36.717175 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2824/5676] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:56:36 2022] DELETE /compute/v2.1/servers/fc136da8-3767-4c12-906c-d3a3562ccba4 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:56:36.727996 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8b039966-4764-4d17-b71f-d6485d30a51a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:36.729028 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8b039966-4764-4d17-b71f-d6485d30a51a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: fc136da8-3767-4c12-906c-d3a3562ccba4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:36.752213 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8b039966-4764-4d17-b71f-d6485d30a51a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:36.753405 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8b039966-4764-4d17-b71f-d6485d30a51a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:36.756457 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8b039966-4764-4d17-b71f-d6485d30a51a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:36.757885 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8b039966-4764-4d17-b71f-d6485d30a51a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:36.760652 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8b039966-4764-4d17-b71f-d6485d30a51a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:36.762273 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8b039966-4764-4d17-b71f-d6485d30a51a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:37.046119 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8b039966-4764-4d17-b71f-d6485d30a51a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:37.054087 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8b039966-4764-4d17-b71f-d6485d30a51a tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/fc136da8-3767-4c12-906c-d3a3562ccba4" status: 200 len: 1508 microversion: 2.1 time: 0.332410 Oct 04 18:56:37.054647 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2853/5677] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:36 2022] GET /compute/v2.1/servers/fc136da8-3767-4c12-906c-d3a3562ccba4 => generated 1508 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:38.080677 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-44fae56c-eb9a-4dcc-a816-501afda2773f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:38.081466 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-44fae56c-eb9a-4dcc-a816-501afda2773f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: fc136da8-3767-4c12-906c-d3a3562ccba4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:38.094143 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:56:38.100610 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-44fae56c-eb9a-4dcc-a816-501afda2773f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:38.100610 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-44fae56c-eb9a-4dcc-a816-501afda2773f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:38.100610 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-44fae56c-eb9a-4dcc-a816-501afda2773f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:38.100610 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-44fae56c-eb9a-4dcc-a816-501afda2773f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:38.102805 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-44fae56c-eb9a-4dcc-a816-501afda2773f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:38.103241 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-44fae56c-eb9a-4dcc-a816-501afda2773f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:38.627415 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-44fae56c-eb9a-4dcc-a816-501afda2773f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:38.637983 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-44fae56c-eb9a-4dcc-a816-501afda2773f tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/fc136da8-3767-4c12-906c-d3a3562ccba4" status: 200 len: 1508 microversion: 2.1 time: 0.561511 Oct 04 18:56:38.654237 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2825/5678] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:38 2022] GET /compute/v2.1/servers/fc136da8-3767-4c12-906c-d3a3562ccba4 => generated 1508 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:39.201806 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-99604993-1292-456c-82a8-448dcacda9b2 req-4ac77e26-fb6f-44d2-8e48-3ebc15896ca5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc136da8-3767-4c12-906c-d3a3562ccba4", "name": "network-vif-deleted", "tag": "82cf7717-c488-403e-b3ab-a388fa84189b"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:56:39.223046 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-99604993-1292-456c-82a8-448dcacda9b2 req-4ac77e26-fb6f-44d2-8e48-3ebc15896ca5 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:39.225705 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-99604993-1292-456c-82a8-448dcacda9b2 req-4ac77e26-fb6f-44d2-8e48-3ebc15896ca5 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:39.226335 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-99604993-1292-456c-82a8-448dcacda9b2 req-4ac77e26-fb6f-44d2-8e48-3ebc15896ca5 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:39.256810 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-99604993-1292-456c-82a8-448dcacda9b2 req-4ac77e26-fb6f-44d2-8e48-3ebc15896ca5 service nova] Creating event network-vif-deleted:82cf7717-c488-403e-b3ab-a388fa84189b for instance fc136da8-3767-4c12-906c-d3a3562ccba4 on n-h2-850501-14 Oct 04 18:56:39.269052 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-99604993-1292-456c-82a8-448dcacda9b2 req-4ac77e26-fb6f-44d2-8e48-3ebc15896ca5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070900 Oct 04 18:56:39.271882 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2854/5679] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:56:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:56:39.670145 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8cf86ff3-866c-4d60-9bcf-2000ed20cfad tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:39.671846 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8cf86ff3-866c-4d60-9bcf-2000ed20cfad tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: fc136da8-3767-4c12-906c-d3a3562ccba4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:39.691494 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8cf86ff3-866c-4d60-9bcf-2000ed20cfad tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:39.698093 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8cf86ff3-866c-4d60-9bcf-2000ed20cfad tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:39.698906 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8cf86ff3-866c-4d60-9bcf-2000ed20cfad tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:39.699808 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8cf86ff3-866c-4d60-9bcf-2000ed20cfad tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:39.700571 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8cf86ff3-866c-4d60-9bcf-2000ed20cfad tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:39.701184 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8cf86ff3-866c-4d60-9bcf-2000ed20cfad tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:39.885019 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8cf86ff3-866c-4d60-9bcf-2000ed20cfad tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:39.895800 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8cf86ff3-866c-4d60-9bcf-2000ed20cfad tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/fc136da8-3767-4c12-906c-d3a3562ccba4" status: 200 len: 1299 microversion: 2.1 time: 0.233417 Oct 04 18:56:39.899962 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2826/5680] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:39 2022] GET /compute/v2.1/servers/fc136da8-3767-4c12-906c-d3a3562ccba4 => generated 1299 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:40.920990 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-127585a7-82ce-490e-a520-86bc0cd1b273 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:40.921708 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-127585a7-82ce-490e-a520-86bc0cd1b273 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: fc136da8-3767-4c12-906c-d3a3562ccba4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:40.939818 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-127585a7-82ce-490e-a520-86bc0cd1b273 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:40.940355 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-127585a7-82ce-490e-a520-86bc0cd1b273 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:40.940799 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-127585a7-82ce-490e-a520-86bc0cd1b273 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:40.941510 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-127585a7-82ce-490e-a520-86bc0cd1b273 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:40.941970 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-127585a7-82ce-490e-a520-86bc0cd1b273 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:40.946895 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-127585a7-82ce-490e-a520-86bc0cd1b273 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:40.998534 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-127585a7-82ce-490e-a520-86bc0cd1b273 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:40.999458 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-127585a7-82ce-490e-a520-86bc0cd1b273 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:40.999575 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-127585a7-82ce-490e-a520-86bc0cd1b273 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:41.000153 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-127585a7-82ce-490e-a520-86bc0cd1b273 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lazy-loading 'fault' on Instance uuid fc136da8-3767-4c12-906c-d3a3562ccba4 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:56:41.096943 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-127585a7-82ce-490e-a520-86bc0cd1b273 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:41.111104 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-127585a7-82ce-490e-a520-86bc0cd1b273 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/fc136da8-3767-4c12-906c-d3a3562ccba4" status: 200 len: 1304 microversion: 2.1 time: 0.191830 Oct 04 18:56:41.129118 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2855/5681] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:40 2022] GET /compute/v2.1/servers/fc136da8-3767-4c12-906c-d3a3562ccba4 => generated 1304 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:42.142101 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-94ad3308-b6be-4969-b4c9-df515a55f8e4 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:42.142947 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-94ad3308-b6be-4969-b4c9-df515a55f8e4 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: fc136da8-3767-4c12-906c-d3a3562ccba4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:42.157426 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-94ad3308-b6be-4969-b4c9-df515a55f8e4 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:42.160350 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-94ad3308-b6be-4969-b4c9-df515a55f8e4 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:42.160926 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-94ad3308-b6be-4969-b4c9-df515a55f8e4 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:42.163071 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-94ad3308-b6be-4969-b4c9-df515a55f8e4 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:42.164195 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-94ad3308-b6be-4969-b4c9-df515a55f8e4 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:42.166085 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-94ad3308-b6be-4969-b4c9-df515a55f8e4 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:42.197032 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-94ad3308-b6be-4969-b4c9-df515a55f8e4 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] HTTP exception thrown: Instance fc136da8-3767-4c12-906c-d3a3562ccba4 could not be found. Oct 04 18:56:42.200336 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-94ad3308-b6be-4969-b4c9-df515a55f8e4 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Request method failure captured: Oct 04 18:56:42.200336 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/fc136da8-3767-4c12-906c-d3a3562ccba4 HTTP/1.1 Oct 04 18:56:42.200336 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:56:42.200336 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:56:42.200336 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:56:42.200336 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:56:42.200336 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:56:42.200336 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:56:42.200336 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:56:42.200336 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:56:42.200336 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH9sNKcZV12-VrzgkMcjOaIHcQXzo_OQ-K38hc0f55Lf_4RZrXGgMmn5jWeZmAc1TRzC-i_WlxKP0xlRL0UMRNxVvlUX8rNQZjC__ruqdhQgQWDSwxsACYsgZpz7nprjIdkJFbhvMXXkXexF7-ajgS9bmCu4Pvp0T8fklC1E3t24Rz8 Oct 04 18:56:42.200336 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:56:42.200336 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:56:42.200336 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:56:42.200336 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:56:42.200336 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:56:42.200336 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:56:42.200336 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 57d8fd392d5b4e8798cb51fe0e54ad3b Oct 04 18:56:42.200336 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServerActionsTestJSON-1010650728 Oct 04 18:56:42.200336 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:56:42.200336 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:56:42.200336 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/57d8fd392d5b4e8798cb51fe0e54ad3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_57d8fd392d5b4e8798cb51fe0e54ad3b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/57d8fd392d5b4e8798cb51fe0e54ad3b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/57d8fd392d5b4e8798cb51fe0e54ad3b"}]}] Oct 04 18:56:42.200336 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServerActionsTestJSON-1010650728 Oct 04 18:56:42.200336 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 57d8fd392d5b4e8798cb51fe0e54ad3b Oct 04 18:56:42.200336 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServerActionsTestJSON-1010650728 Oct 04 18:56:42.200336 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServerActionsTestJSON-1010650728-project Oct 04 18:56:42.200336 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:56:42.200336 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:56:42.200336 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: ee7fee2b098d4eb8bdc8df2a929cdede Oct 04 18:56:42.200336 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServerActionsTestJSON-1010650728-project Oct 04 18:56:42.200336 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:56:42.200336 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance fc136da8-3767-4c12-906c-d3a3562ccba4 could not be found. Oct 04 18:56:42.200336 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'fc136da8-3767-4c12-906c-d3a3562ccba4'} Oct 04 18:56:42.200336 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:56:42.200336 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:56:42.200336 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:56:42.200336 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:56:42.200336 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:56:42.200336 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:56:42.200336 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:56:42.200336 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:56:42.200336 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:56:42.200336 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:56:42.200336 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc136da8-3767-4c12-906c-d3a3562ccba4 could not be found. Oct 04 18:56:42.200336 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:56:42.200336 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:56:42.200336 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:56:42.200336 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:56:42.200336 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:56:42.200336 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:56:42.200336 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:56:42.200336 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:56:42.200336 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:56:42.200336 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:56:42.200336 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:56:42.200336 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:56:42.200336 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:56:42.200336 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:56:42.200336 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:56:42.200336 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:56:42.200336 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc136da8-3767-4c12-906c-d3a3562ccba4 could not be found. Oct 04 18:56:42.200336 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:56:42.200336 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:56:42.200336 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:56:42.204480 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:56:42.204480 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:56:42.204480 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:56:42.204480 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:56:42.204480 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:56:42.204480 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc136da8-3767-4c12-906c-d3a3562ccba4 could not be found. Oct 04 18:56:42.204480 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:56:42.206298 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-94ad3308-b6be-4969-b4c9-df515a55f8e4 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Returning 404 to user: Instance fc136da8-3767-4c12-906c-d3a3562ccba4 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:56:42.207389 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-94ad3308-b6be-4969-b4c9-df515a55f8e4 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/fc136da8-3767-4c12-906c-d3a3562ccba4" status: 404 len: 111 microversion: 2.1 time: 0.075820 Oct 04 18:56:42.208661 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2827/5682] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:42 2022] GET /compute/v2.1/servers/fc136da8-3767-4c12-906c-d3a3562ccba4 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:56:42.217527 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b60e5242-b156-4cd8-b824-4f903c474dc2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:42.219057 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b60e5242-b156-4cd8-b824-4f903c474dc2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: dcecca6b-779d-4b0f-900a-02287aaac41f] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:42.228092 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b60e5242-b156-4cd8-b824-4f903c474dc2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:42.228757 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b60e5242-b156-4cd8-b824-4f903c474dc2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:42.229317 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b60e5242-b156-4cd8-b824-4f903c474dc2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:42.230105 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b60e5242-b156-4cd8-b824-4f903c474dc2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:42.230644 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b60e5242-b156-4cd8-b824-4f903c474dc2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:42.231860 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b60e5242-b156-4cd8-b824-4f903c474dc2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:42.265080 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b60e5242-b156-4cd8-b824-4f903c474dc2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: dcecca6b-779d-4b0f-900a-02287aaac41f] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:56:42.691158 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b60e5242-b156-4cd8-b824-4f903c474dc2 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "DELETE /compute/v2.1/servers/dcecca6b-779d-4b0f-900a-02287aaac41f" status: 204 len: 0 microversion: 2.1 time: 0.478017 Oct 04 18:56:42.692395 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2856/5683] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:56:42 2022] DELETE /compute/v2.1/servers/dcecca6b-779d-4b0f-900a-02287aaac41f => generated 0 bytes in 480 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:56:42.705557 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-56c2f91c-c26f-4e2b-b221-8311b8415321 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:42.707010 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-56c2f91c-c26f-4e2b-b221-8311b8415321 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: dcecca6b-779d-4b0f-900a-02287aaac41f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:42.718551 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-56c2f91c-c26f-4e2b-b221-8311b8415321 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:42.719150 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-56c2f91c-c26f-4e2b-b221-8311b8415321 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:42.719663 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-56c2f91c-c26f-4e2b-b221-8311b8415321 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:42.721220 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-56c2f91c-c26f-4e2b-b221-8311b8415321 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:42.722082 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-56c2f91c-c26f-4e2b-b221-8311b8415321 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:42.722766 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-56c2f91c-c26f-4e2b-b221-8311b8415321 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:43.119401 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-56c2f91c-c26f-4e2b-b221-8311b8415321 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:43.136971 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-56c2f91c-c26f-4e2b-b221-8311b8415321 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/dcecca6b-779d-4b0f-900a-02287aaac41f" status: 200 len: 1494 microversion: 2.1 time: 0.439460 Oct 04 18:56:43.152865 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2828/5684] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:42 2022] GET /compute/v2.1/servers/dcecca6b-779d-4b0f-900a-02287aaac41f => generated 1494 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:43.874726 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-f182da1f-98e8-460f-a63d-be7eb1843ca6 req-66633eba-7a44-4719-a068-7cec59e9a0e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcecca6b-779d-4b0f-900a-02287aaac41f", "name": "network-vif-deleted", "tag": "00331aac-20e5-49e6-9a18-7f739184e446"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:56:43.898068 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-f182da1f-98e8-460f-a63d-be7eb1843ca6 req-66633eba-7a44-4719-a068-7cec59e9a0e9 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:43.900720 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-f182da1f-98e8-460f-a63d-be7eb1843ca6 req-66633eba-7a44-4719-a068-7cec59e9a0e9 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:43.905377 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-f182da1f-98e8-460f-a63d-be7eb1843ca6 req-66633eba-7a44-4719-a068-7cec59e9a0e9 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:43.936010 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-f182da1f-98e8-460f-a63d-be7eb1843ca6 req-66633eba-7a44-4719-a068-7cec59e9a0e9 service nova] Creating event network-vif-deleted:00331aac-20e5-49e6-9a18-7f739184e446 for instance dcecca6b-779d-4b0f-900a-02287aaac41f on n-h1-850501-14 Oct 04 18:56:43.949444 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-f182da1f-98e8-460f-a63d-be7eb1843ca6 req-66633eba-7a44-4719-a068-7cec59e9a0e9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079611 Oct 04 18:56:43.952566 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2857/5685] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:56:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:56:44.168744 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6704e21d-698c-4ccb-8664-8a9a7b6b0dc1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:44.169317 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-6704e21d-698c-4ccb-8664-8a9a7b6b0dc1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: dcecca6b-779d-4b0f-900a-02287aaac41f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:44.186379 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6704e21d-698c-4ccb-8664-8a9a7b6b0dc1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:44.200997 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6704e21d-698c-4ccb-8664-8a9a7b6b0dc1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:44.201719 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6704e21d-698c-4ccb-8664-8a9a7b6b0dc1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:44.202495 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6704e21d-698c-4ccb-8664-8a9a7b6b0dc1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:44.204988 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6704e21d-698c-4ccb-8664-8a9a7b6b0dc1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:44.205610 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6704e21d-698c-4ccb-8664-8a9a7b6b0dc1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:44.378326 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-6704e21d-698c-4ccb-8664-8a9a7b6b0dc1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:44.393281 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6704e21d-698c-4ccb-8664-8a9a7b6b0dc1 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/dcecca6b-779d-4b0f-900a-02287aaac41f" status: 200 len: 1286 microversion: 2.1 time: 0.231320 Oct 04 18:56:44.418686 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2829/5686] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:44 2022] GET /compute/v2.1/servers/dcecca6b-779d-4b0f-900a-02287aaac41f => generated 1286 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:45.429916 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5b8260a0-6482-45b0-9805-9b418e691594 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:45.431403 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5b8260a0-6482-45b0-9805-9b418e691594 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: dcecca6b-779d-4b0f-900a-02287aaac41f] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:45.438924 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5b8260a0-6482-45b0-9805-9b418e691594 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:45.439821 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5b8260a0-6482-45b0-9805-9b418e691594 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:45.440588 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5b8260a0-6482-45b0-9805-9b418e691594 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:45.441514 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5b8260a0-6482-45b0-9805-9b418e691594 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:45.442339 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5b8260a0-6482-45b0-9805-9b418e691594 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:45.443000 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5b8260a0-6482-45b0-9805-9b418e691594 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:45.458550 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-5b8260a0-6482-45b0-9805-9b418e691594 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] HTTP exception thrown: Instance dcecca6b-779d-4b0f-900a-02287aaac41f could not be found. Oct 04 18:56:45.460700 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5b8260a0-6482-45b0-9805-9b418e691594 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Request method failure captured: Oct 04 18:56:45.460700 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/dcecca6b-779d-4b0f-900a-02287aaac41f HTTP/1.1 Oct 04 18:56:45.460700 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:56:45.460700 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:56:45.460700 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:56:45.460700 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:56:45.460700 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:56:45.460700 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:56:45.460700 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:56:45.460700 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:56:45.460700 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPH9sNKcZV12-VrzgkMcjOaIHcQXzo_OQ-K38hc0f55Lf_4RZrXGgMmn5jWeZmAc1TRzC-i_WlxKP0xlRL0UMRNxVvlUX8rNQZjC__ruqdhQgQWDSwxsACYsgZpz7nprjIdkJFbhvMXXkXexF7-ajgS9bmCu4Pvp0T8fklC1E3t24Rz8 Oct 04 18:56:45.460700 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:56:45.460700 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:56:45.460700 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:56:45.460700 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:56:45.460700 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:56:45.460700 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:56:45.460700 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 57d8fd392d5b4e8798cb51fe0e54ad3b Oct 04 18:56:45.460700 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ServerActionsTestJSON-1010650728 Oct 04 18:56:45.460700 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:56:45.460700 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:56:45.460700 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/57d8fd392d5b4e8798cb51fe0e54ad3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_57d8fd392d5b4e8798cb51fe0e54ad3b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/57d8fd392d5b4e8798cb51fe0e54ad3b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/57d8fd392d5b4e8798cb51fe0e54ad3b"}]}] Oct 04 18:56:45.460700 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ServerActionsTestJSON-1010650728 Oct 04 18:56:45.460700 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 57d8fd392d5b4e8798cb51fe0e54ad3b Oct 04 18:56:45.460700 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ServerActionsTestJSON-1010650728 Oct 04 18:56:45.460700 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ServerActionsTestJSON-1010650728-project Oct 04 18:56:45.460700 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:56:45.460700 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:56:45.460700 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: ee7fee2b098d4eb8bdc8df2a929cdede Oct 04 18:56:45.460700 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ServerActionsTestJSON-1010650728-project Oct 04 18:56:45.460700 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:56:45.460700 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance dcecca6b-779d-4b0f-900a-02287aaac41f could not be found. Oct 04 18:56:45.460700 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': 'dcecca6b-779d-4b0f-900a-02287aaac41f'} Oct 04 18:56:45.460700 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:56:45.460700 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:56:45.460700 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:56:45.460700 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:56:45.460700 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:56:45.460700 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:56:45.460700 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:56:45.460700 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:56:45.460700 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:56:45.460700 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:56:45.460700 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcecca6b-779d-4b0f-900a-02287aaac41f could not be found. Oct 04 18:56:45.460700 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:56:45.460700 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:56:45.460700 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:56:45.460700 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:56:45.460700 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:56:45.460700 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:56:45.460700 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:56:45.460700 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:56:45.460700 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:56:45.460700 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:56:45.460700 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:56:45.460700 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:56:45.460700 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:56:45.460700 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:56:45.460700 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:56:45.460700 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:56:45.460700 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcecca6b-779d-4b0f-900a-02287aaac41f could not be found. Oct 04 18:56:45.460700 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:56:45.460700 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:56:45.460700 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:56:45.464295 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:56:45.464295 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:56:45.464295 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:56:45.464295 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:56:45.464295 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:56:45.464295 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcecca6b-779d-4b0f-900a-02287aaac41f could not be found. Oct 04 18:56:45.464295 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:56:45.466996 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5b8260a0-6482-45b0-9805-9b418e691594 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Returning 404 to user: Instance dcecca6b-779d-4b0f-900a-02287aaac41f could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:56:45.468179 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5b8260a0-6482-45b0-9805-9b418e691594 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/dcecca6b-779d-4b0f-900a-02287aaac41f" status: 404 len: 111 microversion: 2.1 time: 0.042599 Oct 04 18:56:45.469310 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2858/5687] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:45 2022] GET /compute/v2.1/servers/dcecca6b-779d-4b0f-900a-02287aaac41f => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:56:45.477575 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e2436211-7de3-4110-813d-80f08d931bcd tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:45.478289 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e2436211-7de3-4110-813d-80f08d931bcd tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:45.489943 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e2436211-7de3-4110-813d-80f08d931bcd tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:45.490828 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e2436211-7de3-4110-813d-80f08d931bcd tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:45.491574 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e2436211-7de3-4110-813d-80f08d931bcd tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:45.492634 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e2436211-7de3-4110-813d-80f08d931bcd tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:45.493446 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e2436211-7de3-4110-813d-80f08d931bcd tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:45.494489 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e2436211-7de3-4110-813d-80f08d931bcd tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:45.531085 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e2436211-7de3-4110-813d-80f08d931bcd tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Going to try to terminate instance {{(pid=123002) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:56:45.961096 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e2436211-7de3-4110-813d-80f08d931bcd tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 204 len: 0 microversion: 2.1 time: 0.487052 Oct 04 18:56:45.966811 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2830/5688] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:56:45 2022] DELETE /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:56:45.971108 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8be527e7-8dba-4186-aab8-85773ac49cc7 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:45.971622 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8be527e7-8dba-4186-aab8-85773ac49cc7 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:45.984606 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8be527e7-8dba-4186-aab8-85773ac49cc7 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:45.984606 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8be527e7-8dba-4186-aab8-85773ac49cc7 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:45.985612 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8be527e7-8dba-4186-aab8-85773ac49cc7 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:45.986615 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8be527e7-8dba-4186-aab8-85773ac49cc7 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:45.987331 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8be527e7-8dba-4186-aab8-85773ac49cc7 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:45.987969 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8be527e7-8dba-4186-aab8-85773ac49cc7 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:46.219704 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8be527e7-8dba-4186-aab8-85773ac49cc7 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:46.231757 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8be527e7-8dba-4186-aab8-85773ac49cc7 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1678 microversion: 2.1 time: 0.264528 Oct 04 18:56:46.234614 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2859/5689] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:45 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1678 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:47.258590 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-033b331c-faf1-4805-b335-64fe1dd29af0 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:47.259946 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-033b331c-faf1-4805-b335-64fe1dd29af0 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:47.269926 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-033b331c-faf1-4805-b335-64fe1dd29af0 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:47.270314 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-033b331c-faf1-4805-b335-64fe1dd29af0 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:47.270950 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-033b331c-faf1-4805-b335-64fe1dd29af0 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:47.273316 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-033b331c-faf1-4805-b335-64fe1dd29af0 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:47.274818 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-033b331c-faf1-4805-b335-64fe1dd29af0 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:47.275265 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-033b331c-faf1-4805-b335-64fe1dd29af0 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:47.500338 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-033b331c-faf1-4805-b335-64fe1dd29af0 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:47.516315 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-033b331c-faf1-4805-b335-64fe1dd29af0 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1678 microversion: 2.1 time: 0.261799 Oct 04 18:56:47.517441 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2831/5690] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:47 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1678 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:48.547092 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-30b13ad5-68b0-46a2-8dfe-4533fbf15d84 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:48.547092 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-30b13ad5-68b0-46a2-8dfe-4533fbf15d84 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:48.552441 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-30b13ad5-68b0-46a2-8dfe-4533fbf15d84 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:48.553180 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-30b13ad5-68b0-46a2-8dfe-4533fbf15d84 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:48.557728 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-30b13ad5-68b0-46a2-8dfe-4533fbf15d84 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:48.559291 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-30b13ad5-68b0-46a2-8dfe-4533fbf15d84 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:48.559991 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-30b13ad5-68b0-46a2-8dfe-4533fbf15d84 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:48.560670 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-30b13ad5-68b0-46a2-8dfe-4533fbf15d84 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:48.842716 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-30b13ad5-68b0-46a2-8dfe-4533fbf15d84 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:48.852595 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-30b13ad5-68b0-46a2-8dfe-4533fbf15d84 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1678 microversion: 2.1 time: 0.316811 Oct 04 18:56:48.865889 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2860/5691] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:48 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1678 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:49.376775 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-33e44ed5-8107-417d-9c82-350d9aa88fdc req-e9498a6c-5abf-4812-9065-e52b0acf0dbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e208f85-0513-43f4-8a2c-38baa2886238", "name": "network-vif-deleted", "tag": "caad0bda-801d-4a85-94c7-4bb13cb984c3"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:56:49.376775 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-33e44ed5-8107-417d-9c82-350d9aa88fdc req-e9498a6c-5abf-4812-9065-e52b0acf0dbb service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:49.376775 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-33e44ed5-8107-417d-9c82-350d9aa88fdc req-e9498a6c-5abf-4812-9065-e52b0acf0dbb service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:49.376775 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-33e44ed5-8107-417d-9c82-350d9aa88fdc req-e9498a6c-5abf-4812-9065-e52b0acf0dbb service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:49.376775 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:56:49.376775 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-33e44ed5-8107-417d-9c82-350d9aa88fdc req-e9498a6c-5abf-4812-9065-e52b0acf0dbb service nova] Creating event network-vif-deleted:caad0bda-801d-4a85-94c7-4bb13cb984c3 for instance 2e208f85-0513-43f4-8a2c-38baa2886238 on n-h2-850501-14 Oct 04 18:56:49.376775 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-33e44ed5-8107-417d-9c82-350d9aa88fdc req-e9498a6c-5abf-4812-9065-e52b0acf0dbb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036173 Oct 04 18:56:49.376775 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2832/5692] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:56:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:56:49.884005 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-29cb9191-0c1d-4676-8133-1cd9c546ddaa tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:49.884760 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-29cb9191-0c1d-4676-8133-1cd9c546ddaa tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:49.899934 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-29cb9191-0c1d-4676-8133-1cd9c546ddaa tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:49.903150 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-29cb9191-0c1d-4676-8133-1cd9c546ddaa tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:49.904208 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-29cb9191-0c1d-4676-8133-1cd9c546ddaa tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:49.904594 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-29cb9191-0c1d-4676-8133-1cd9c546ddaa tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:49.905114 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-29cb9191-0c1d-4676-8133-1cd9c546ddaa tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:49.907957 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-29cb9191-0c1d-4676-8133-1cd9c546ddaa tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:50.008235 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-29cb9191-0c1d-4676-8133-1cd9c546ddaa tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:50.011344 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-29cb9191-0c1d-4676-8133-1cd9c546ddaa tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:50.011872 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-29cb9191-0c1d-4676-8133-1cd9c546ddaa tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:50.013598 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-29cb9191-0c1d-4676-8133-1cd9c546ddaa tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lazy-loading 'fault' on Instance uuid 2e208f85-0513-43f4-8a2c-38baa2886238 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:56:50.070646 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-29cb9191-0c1d-4676-8133-1cd9c546ddaa tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee7fee2b098d4eb8bdc8df2a929cdede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d8fd392d5b4e8798cb51fe0e54ad3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:50.084975 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-29cb9191-0c1d-4676-8133-1cd9c546ddaa tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 200 len: 1329 microversion: 2.1 time: 0.205879 Oct 04 18:56:50.086244 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2861/5693] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:49 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 1329 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:51.115010 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3e14038e-2fcb-4796-a85e-eba3f4f11d17 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:51.115938 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3e14038e-2fcb-4796-a85e-eba3f4f11d17 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] [instance: 2e208f85-0513-43f4-8a2c-38baa2886238] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:51.123754 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3e14038e-2fcb-4796-a85e-eba3f4f11d17 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:51.124336 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3e14038e-2fcb-4796-a85e-eba3f4f11d17 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:51.124773 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3e14038e-2fcb-4796-a85e-eba3f4f11d17 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:51.125475 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3e14038e-2fcb-4796-a85e-eba3f4f11d17 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:51.126101 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3e14038e-2fcb-4796-a85e-eba3f4f11d17 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:51.126865 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3e14038e-2fcb-4796-a85e-eba3f4f11d17 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:51.174140 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-3e14038e-2fcb-4796-a85e-eba3f4f11d17 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] HTTP exception thrown: Instance 2e208f85-0513-43f4-8a2c-38baa2886238 could not be found. Oct 04 18:56:51.181613 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3e14038e-2fcb-4796-a85e-eba3f4f11d17 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Request method failure captured: Oct 04 18:56:51.181613 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 HTTP/1.1 Oct 04 18:56:51.181613 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 18:56:51.181613 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 18:56:51.181613 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 18:56:51.181613 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 18:56:51.181613 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 18:56:51.181613 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 18:56:51.181613 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 18:56:51.181613 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 18:56:51.181613 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPH9sNKcZV12-VrzgkMcjOaIHcQXzo_OQ-K38hc0f55Lf_4RZrXGgMmn5jWeZmAc1TRzC-i_WlxKP0xlRL0UMRNxVvlUX8rNQZjC__ruqdhQgQWDSwxsACYsgZpz7nprjIdkJFbhvMXXkXexF7-ajgS9bmCu4Pvp0T8fklC1E3t24Rz8 Oct 04 18:56:51.181613 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 18:56:51.181613 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 18:56:51.181613 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 18:56:51.181613 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 18:56:51.181613 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 18:56:51.181613 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 18:56:51.181613 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 57d8fd392d5b4e8798cb51fe0e54ad3b Oct 04 18:56:51.181613 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServerActionsTestJSON-1010650728 Oct 04 18:56:51.181613 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 18:56:51.181613 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 18:56:51.181613 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/57d8fd392d5b4e8798cb51fe0e54ad3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_57d8fd392d5b4e8798cb51fe0e54ad3b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/57d8fd392d5b4e8798cb51fe0e54ad3b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/57d8fd392d5b4e8798cb51fe0e54ad3b"}]}] Oct 04 18:56:51.181613 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServerActionsTestJSON-1010650728 Oct 04 18:56:51.181613 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 57d8fd392d5b4e8798cb51fe0e54ad3b Oct 04 18:56:51.181613 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServerActionsTestJSON-1010650728 Oct 04 18:56:51.181613 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServerActionsTestJSON-1010650728-project Oct 04 18:56:51.181613 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 18:56:51.181613 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 18:56:51.181613 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: ee7fee2b098d4eb8bdc8df2a929cdede Oct 04 18:56:51.181613 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServerActionsTestJSON-1010650728-project Oct 04 18:56:51.181613 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 18:56:51.181613 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 2e208f85-0513-43f4-8a2c-38baa2886238 could not be found. Oct 04 18:56:51.181613 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '2e208f85-0513-43f4-8a2c-38baa2886238'} Oct 04 18:56:51.181613 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:56:51.181613 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:56:51.181613 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:56:51.181613 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:56:51.181613 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:56:51.181613 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:56:51.181613 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:56:51.181613 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:56:51.181613 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:56:51.181613 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:56:51.181613 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e208f85-0513-43f4-8a2c-38baa2886238 could not be found. Oct 04 18:56:51.181613 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:56:51.181613 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:56:51.181613 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:56:51.181613 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:56:51.181613 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:56:51.181613 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:56:51.181613 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:56:51.181613 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:56:51.181613 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:56:51.181613 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:56:51.181613 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:56:51.181613 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:56:51.181613 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:56:51.181613 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:56:51.181613 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:56:51.181613 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:56:51.181613 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e208f85-0513-43f4-8a2c-38baa2886238 could not be found. Oct 04 18:56:51.181613 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:56:51.181613 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:56:51.181613 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:56:51.186559 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:56:51.186559 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:56:51.186559 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:56:51.186559 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:56:51.186559 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:56:51.186559 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e208f85-0513-43f4-8a2c-38baa2886238 could not be found. Oct 04 18:56:51.186559 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 18:56:51.193664 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3e14038e-2fcb-4796-a85e-eba3f4f11d17 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Returning 404 to user: Instance 2e208f85-0513-43f4-8a2c-38baa2886238 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:56:51.196340 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3e14038e-2fcb-4796-a85e-eba3f4f11d17 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238" status: 404 len: 111 microversion: 2.1 time: 0.091232 Oct 04 18:56:51.199149 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2833/5694] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:51 2022] GET /compute/v2.1/servers/2e208f85-0513-43f4-8a2c-38baa2886238 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:56:51.211315 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-78a6fbe8-910e-4e6b-bb40-289e1a8bc701 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '.version_select at 0x7fe253b88040>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:51.377488 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-78a6fbe8-910e-4e6b-bb40-289e1a8bc701 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1474378313" status: 202 len: 0 microversion: 2.1 time: 0.172528 Oct 04 18:56:51.382178 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2862/5695] 10.222.0.20 () {58 vars in 1221 bytes} [Tue Oct 4 18:56:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1474378313 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:57:01.291464 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3e14038e-2fcb-4796-a85e-eba3f4f11d17 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:01.298305 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3e14038e-2fcb-4796-a85e-eba3f4f11d17 tempest-ServerActionsTestJSON-1010650728 tempest-ServerActionsTestJSON-1010650728-project] 10.222.0.20 "GET /compute//" status: 200 len: 377 microversion: - time: 0.007073 Oct 04 18:57:01.309188 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2834/5696] 10.222.0.20 () {56 vars in 886 bytes} [Tue Oct 4 18:57:01 2022] GET /compute/ => generated 377 bytes in 20 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 04 18:57:18.892226 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:57:18.893395 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:57:19.277930 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-49ff2b31-4a0f-4196-a026-9b9fac2d7465 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1175337137", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": [{"uuid": "8711f3f6-49a6-4ec9-a2c9-79bd0936dcce"}]}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:57:19.350512 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.neutron [None req-49ff2b31-4a0f-4196-a026-9b9fac2d7465 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] validate_networks() for [('8711f3f6-49a6-4ec9-a2c9-79bd0936dcce', None, None, None, None, None)] {{(pid=123001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:57:20.682213 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-49ff2b31-4a0f-4196-a026-9b9fac2d7465 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:57:20.683157 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-49ff2b31-4a0f-4196-a026-9b9fac2d7465 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:57:20.683674 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-49ff2b31-4a0f-4196-a026-9b9fac2d7465 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:57:20.684171 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-49ff2b31-4a0f-4196-a026-9b9fac2d7465 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:57:20.687786 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-49ff2b31-4a0f-4196-a026-9b9fac2d7465 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:57:20.737020 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-49ff2b31-4a0f-4196-a026-9b9fac2d7465 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:20.742432 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-49ff2b31-4a0f-4196-a026-9b9fac2d7465 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:20.742432 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-49ff2b31-4a0f-4196-a026-9b9fac2d7465 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:20.744826 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-49ff2b31-4a0f-4196-a026-9b9fac2d7465 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:20.745443 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-49ff2b31-4a0f-4196-a026-9b9fac2d7465 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:20.749700 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-49ff2b31-4a0f-4196-a026-9b9fac2d7465 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:20.785184 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-49ff2b31-4a0f-4196-a026-9b9fac2d7465 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Getting quotas for project 800b737c81e34fb4a074a4c9a7543dfd. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:57:20.807714 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-49ff2b31-4a0f-4196-a026-9b9fac2d7465 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Getting quotas for user b424868a1dc546e0ab5f46dc9031e836 and project 800b737c81e34fb4a074a4c9a7543dfd. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:57:20.864260 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-49ff2b31-4a0f-4196-a026-9b9fac2d7465 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Going to run 1 instances... {{(pid=123001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:57:20.872898 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-49ff2b31-4a0f-4196-a026-9b9fac2d7465 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] [instance: c1f39d90-2cb8-40dc-9a4f-9c1d57e25492] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:57:21.154335 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-49ff2b31-4a0f-4196-a026-9b9fac2d7465 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.271206 Oct 04 18:57:21.155282 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2863/5697] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:57:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 2273 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:57:21.170559 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-af0e0329-130f-4370-8ca6-b868a907d941 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:21.171375 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-af0e0329-130f-4370-8ca6-b868a907d941 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] [instance: c1f39d90-2cb8-40dc-9a4f-9c1d57e25492] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:21.187438 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:57:21.387414 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-af0e0329-130f-4370-8ca6-b868a907d941 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424868a1dc546e0ab5f46dc9031e836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800b737c81e34fb4a074a4c9a7543dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:21.396028 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-af0e0329-130f-4370-8ca6-b868a907d941 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] 10.222.0.20 "GET /compute/v2.1/servers/c1f39d90-2cb8-40dc-9a4f-9c1d57e25492" status: 200 len: 1217 microversion: 2.1 time: 0.233060 Oct 04 18:57:21.401768 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2835/5698] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:21 2022] GET /compute/v2.1/servers/c1f39d90-2cb8-40dc-9a4f-9c1d57e25492 => generated 1217 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:22.431364 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-dc8eb7d8-512e-4ba5-845e-2e6daefdc251 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:22.432990 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-dc8eb7d8-512e-4ba5-845e-2e6daefdc251 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] [instance: c1f39d90-2cb8-40dc-9a4f-9c1d57e25492] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:22.694567 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-dc8eb7d8-512e-4ba5-845e-2e6daefdc251 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424868a1dc546e0ab5f46dc9031e836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800b737c81e34fb4a074a4c9a7543dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:22.749487 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-dc8eb7d8-512e-4ba5-845e-2e6daefdc251 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] 10.222.0.20 "GET /compute/v2.1/servers/c1f39d90-2cb8-40dc-9a4f-9c1d57e25492" status: 200 len: 1217 microversion: 2.1 time: 0.311602 Oct 04 18:57:22.751243 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2864/5699] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:22 2022] GET /compute/v2.1/servers/c1f39d90-2cb8-40dc-9a4f-9c1d57e25492 => generated 1217 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:23.777948 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4c45195c-6681-4054-881b-3c43109f0297 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:23.779143 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4c45195c-6681-4054-881b-3c43109f0297 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] [instance: c1f39d90-2cb8-40dc-9a4f-9c1d57e25492] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:23.805820 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4c45195c-6681-4054-881b-3c43109f0297 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:23.806924 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4c45195c-6681-4054-881b-3c43109f0297 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:23.807884 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4c45195c-6681-4054-881b-3c43109f0297 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:23.809122 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4c45195c-6681-4054-881b-3c43109f0297 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:23.809740 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4c45195c-6681-4054-881b-3c43109f0297 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:23.810388 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4c45195c-6681-4054-881b-3c43109f0297 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:24.116329 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4c45195c-6681-4054-881b-3c43109f0297 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424868a1dc546e0ab5f46dc9031e836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800b737c81e34fb4a074a4c9a7543dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:24.139135 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4c45195c-6681-4054-881b-3c43109f0297 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] 10.222.0.20 "GET /compute/v2.1/servers/c1f39d90-2cb8-40dc-9a4f-9c1d57e25492" status: 200 len: 1221 microversion: 2.1 time: 0.368447 Oct 04 18:57:24.139780 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2836/5700] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:23 2022] GET /compute/v2.1/servers/c1f39d90-2cb8-40dc-9a4f-9c1d57e25492 => generated 1221 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:25.179088 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7295c277-6925-4c0d-bc35-5a8169c2f0bf tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:25.182659 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7295c277-6925-4c0d-bc35-5a8169c2f0bf tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] [instance: c1f39d90-2cb8-40dc-9a4f-9c1d57e25492] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:25.206163 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7295c277-6925-4c0d-bc35-5a8169c2f0bf tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:25.214079 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7295c277-6925-4c0d-bc35-5a8169c2f0bf tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:25.214079 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7295c277-6925-4c0d-bc35-5a8169c2f0bf tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:25.214079 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7295c277-6925-4c0d-bc35-5a8169c2f0bf tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:25.214079 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7295c277-6925-4c0d-bc35-5a8169c2f0bf tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:25.214079 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7295c277-6925-4c0d-bc35-5a8169c2f0bf tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:25.737961 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7295c277-6925-4c0d-bc35-5a8169c2f0bf tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424868a1dc546e0ab5f46dc9031e836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800b737c81e34fb4a074a4c9a7543dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:25.755511 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7295c277-6925-4c0d-bc35-5a8169c2f0bf tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] 10.222.0.20 "GET /compute/v2.1/servers/c1f39d90-2cb8-40dc-9a4f-9c1d57e25492" status: 200 len: 1277 microversion: 2.1 time: 0.581365 Oct 04 18:57:25.757692 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2865/5701] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:25 2022] GET /compute/v2.1/servers/c1f39d90-2cb8-40dc-9a4f-9c1d57e25492 => generated 1277 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:26.785692 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1fd7b999-7e04-45d1-ab51-5f158b56e7c4 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:26.786945 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1fd7b999-7e04-45d1-ab51-5f158b56e7c4 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] [instance: c1f39d90-2cb8-40dc-9a4f-9c1d57e25492] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:26.806670 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1fd7b999-7e04-45d1-ab51-5f158b56e7c4 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:26.807257 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1fd7b999-7e04-45d1-ab51-5f158b56e7c4 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:26.807994 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1fd7b999-7e04-45d1-ab51-5f158b56e7c4 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:26.820540 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1fd7b999-7e04-45d1-ab51-5f158b56e7c4 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:26.822576 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1fd7b999-7e04-45d1-ab51-5f158b56e7c4 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:26.823634 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1fd7b999-7e04-45d1-ab51-5f158b56e7c4 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:27.182789 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1fd7b999-7e04-45d1-ab51-5f158b56e7c4 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424868a1dc546e0ab5f46dc9031e836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800b737c81e34fb4a074a4c9a7543dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:27.202587 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1fd7b999-7e04-45d1-ab51-5f158b56e7c4 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] 10.222.0.20 "GET /compute/v2.1/servers/c1f39d90-2cb8-40dc-9a4f-9c1d57e25492" status: 200 len: 1275 microversion: 2.1 time: 0.423088 Oct 04 18:57:27.206675 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2837/5702] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:26 2022] GET /compute/v2.1/servers/c1f39d90-2cb8-40dc-9a4f-9c1d57e25492 => generated 1275 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:28.229834 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3ae75e04-1c68-4723-a7f2-d1502dcb4b62 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:28.231311 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3ae75e04-1c68-4723-a7f2-d1502dcb4b62 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] [instance: c1f39d90-2cb8-40dc-9a4f-9c1d57e25492] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:28.249272 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3ae75e04-1c68-4723-a7f2-d1502dcb4b62 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:28.251096 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3ae75e04-1c68-4723-a7f2-d1502dcb4b62 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:28.251096 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3ae75e04-1c68-4723-a7f2-d1502dcb4b62 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:28.251984 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3ae75e04-1c68-4723-a7f2-d1502dcb4b62 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:28.252666 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3ae75e04-1c68-4723-a7f2-d1502dcb4b62 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:28.253626 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3ae75e04-1c68-4723-a7f2-d1502dcb4b62 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:28.297311 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-132ca0a2-7367-4fd6-b6ac-de64b9dfaaad tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Action: 'create', calling method: .version_select at 0x7fe253b45d30>, body: {"keypair": {"name": "tempest-keypair-1414317048", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDgaPeCL15JFagSm96i7WfLnb/ayMeUhVZVmSoFoHIF3FcdPz6TcbZInUbNGw/IoTGa2Cy7JVUSm/lklwAGnk79RQIY6S+TaUTkS5n4q0GTjZd3Wl5J5/f12wDo6o5UQfg=="}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:57:28.344024 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-132ca0a2-7367-4fd6-b6ac-de64b9dfaaad tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Getting quotas for project 5dc67d8de57543c48bdf45669b684227. Resources: {'key_pairs'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:57:28.351840 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-132ca0a2-7367-4fd6-b6ac-de64b9dfaaad tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Getting quotas for user ce441ded6f554ec28560c75de97af173 and project 5dc67d8de57543c48bdf45669b684227. Resources: {'key_pairs'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:57:28.524636 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-132ca0a2-7367-4fd6-b6ac-de64b9dfaaad tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.068240 Oct 04 18:57:28.528347 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2866/5703] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Oct 4 18:57:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:57:28.985930 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3ae75e04-1c68-4723-a7f2-d1502dcb4b62 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424868a1dc546e0ab5f46dc9031e836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800b737c81e34fb4a074a4c9a7543dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:29.016472 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3ae75e04-1c68-4723-a7f2-d1502dcb4b62 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] 10.222.0.20 "GET /compute/v2.1/servers/c1f39d90-2cb8-40dc-9a4f-9c1d57e25492" status: 200 len: 1317 microversion: 2.1 time: 0.792860 Oct 04 18:57:29.018723 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2838/5704] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:28 2022] GET /compute/v2.1/servers/c1f39d90-2cb8-40dc-9a4f-9c1d57e25492 => generated 1317 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:30.041614 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-01c2d49a-3f89-4e62-8118-b3b5e588fe40 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:30.042806 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-01c2d49a-3f89-4e62-8118-b3b5e588fe40 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] [instance: c1f39d90-2cb8-40dc-9a4f-9c1d57e25492] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:30.059575 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-01c2d49a-3f89-4e62-8118-b3b5e588fe40 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:30.059714 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-01c2d49a-3f89-4e62-8118-b3b5e588fe40 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:30.060109 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-01c2d49a-3f89-4e62-8118-b3b5e588fe40 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:30.064515 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-01c2d49a-3f89-4e62-8118-b3b5e588fe40 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:30.065127 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-01c2d49a-3f89-4e62-8118-b3b5e588fe40 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:30.065661 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-01c2d49a-3f89-4e62-8118-b3b5e588fe40 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:30.762719 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:57:30.804617 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-01c2d49a-3f89-4e62-8118-b3b5e588fe40 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424868a1dc546e0ab5f46dc9031e836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800b737c81e34fb4a074a4c9a7543dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:30.825141 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-01c2d49a-3f89-4e62-8118-b3b5e588fe40 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] 10.222.0.20 "GET /compute/v2.1/servers/c1f39d90-2cb8-40dc-9a4f-9c1d57e25492" status: 200 len: 1317 microversion: 2.1 time: 0.788141 Oct 04 18:57:30.835817 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2867/5705] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:30 2022] GET /compute/v2.1/servers/c1f39d90-2cb8-40dc-9a4f-9c1d57e25492 => generated 1317 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:31.853361 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3d0934a1-4d4b-4398-ba55-d0f6b025f62e tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:31.854236 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3d0934a1-4d4b-4398-ba55-d0f6b025f62e tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] [instance: c1f39d90-2cb8-40dc-9a4f-9c1d57e25492] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:31.858838 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:57:31.904944 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3d0934a1-4d4b-4398-ba55-d0f6b025f62e tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:31.912962 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3d0934a1-4d4b-4398-ba55-d0f6b025f62e tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:31.913552 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3d0934a1-4d4b-4398-ba55-d0f6b025f62e tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:31.918119 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3d0934a1-4d4b-4398-ba55-d0f6b025f62e tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:31.922735 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3d0934a1-4d4b-4398-ba55-d0f6b025f62e tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:31.923867 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3d0934a1-4d4b-4398-ba55-d0f6b025f62e tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:32.613896 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3d0934a1-4d4b-4398-ba55-d0f6b025f62e tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424868a1dc546e0ab5f46dc9031e836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800b737c81e34fb4a074a4c9a7543dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:32.625323 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3d0934a1-4d4b-4398-ba55-d0f6b025f62e tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] 10.222.0.20 "GET /compute/v2.1/servers/c1f39d90-2cb8-40dc-9a4f-9c1d57e25492" status: 200 len: 1317 microversion: 2.1 time: 0.778264 Oct 04 18:57:32.625928 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2839/5706] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:31 2022] GET /compute/v2.1/servers/c1f39d90-2cb8-40dc-9a4f-9c1d57e25492 => generated 1317 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:33.205289 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-c375a171-4aad-4050-930d-4a6ecf894dcc req-b3a6c675-e870-4db0-9f4f-a51eb406a4f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1f39d90-2cb8-40dc-9a4f-9c1d57e25492", "tag": "ec80ff71-2e86-42cb-b4dd-09c80a54d329"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:57:33.249044 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-c375a171-4aad-4050-930d-4a6ecf894dcc req-b3a6c675-e870-4db0-9f4f-a51eb406a4f0 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:33.249346 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-c375a171-4aad-4050-930d-4a6ecf894dcc req-b3a6c675-e870-4db0-9f4f-a51eb406a4f0 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:33.249995 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-c375a171-4aad-4050-930d-4a6ecf894dcc req-b3a6c675-e870-4db0-9f4f-a51eb406a4f0 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:33.282072 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-c375a171-4aad-4050-930d-4a6ecf894dcc req-b3a6c675-e870-4db0-9f4f-a51eb406a4f0 service nova] Creating event network-changed:ec80ff71-2e86-42cb-b4dd-09c80a54d329 for instance c1f39d90-2cb8-40dc-9a4f-9c1d57e25492 on n-h1-850501-14 Oct 04 18:57:33.294037 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-c375a171-4aad-4050-930d-4a6ecf894dcc req-b3a6c675-e870-4db0-9f4f-a51eb406a4f0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102469 Oct 04 18:57:33.297531 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2868/5707] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:57:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:57:33.650151 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d39cee1c-f2cb-4cb3-99b3-6ee007916d85 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:33.650990 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d39cee1c-f2cb-4cb3-99b3-6ee007916d85 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] [instance: c1f39d90-2cb8-40dc-9a4f-9c1d57e25492] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:33.661859 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d39cee1c-f2cb-4cb3-99b3-6ee007916d85 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:33.668860 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d39cee1c-f2cb-4cb3-99b3-6ee007916d85 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:33.687330 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d39cee1c-f2cb-4cb3-99b3-6ee007916d85 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:33.691725 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d39cee1c-f2cb-4cb3-99b3-6ee007916d85 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:33.691725 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d39cee1c-f2cb-4cb3-99b3-6ee007916d85 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:33.691725 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d39cee1c-f2cb-4cb3-99b3-6ee007916d85 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:34.122812 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d39cee1c-f2cb-4cb3-99b3-6ee007916d85 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424868a1dc546e0ab5f46dc9031e836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800b737c81e34fb4a074a4c9a7543dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:34.145623 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d39cee1c-f2cb-4cb3-99b3-6ee007916d85 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] 10.222.0.20 "GET /compute/v2.1/servers/c1f39d90-2cb8-40dc-9a4f-9c1d57e25492" status: 200 len: 1317 microversion: 2.1 time: 0.500129 Oct 04 18:57:34.163436 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2840/5708] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:33 2022] GET /compute/v2.1/servers/c1f39d90-2cb8-40dc-9a4f-9c1d57e25492 => generated 1317 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:35.177682 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e9712db5-b326-469a-899d-39b814feee28 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:35.178417 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e9712db5-b326-469a-899d-39b814feee28 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] [instance: c1f39d90-2cb8-40dc-9a4f-9c1d57e25492] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:35.199330 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e9712db5-b326-469a-899d-39b814feee28 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:35.207478 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e9712db5-b326-469a-899d-39b814feee28 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:35.208191 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e9712db5-b326-469a-899d-39b814feee28 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:35.209158 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e9712db5-b326-469a-899d-39b814feee28 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:35.209631 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e9712db5-b326-469a-899d-39b814feee28 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:35.216409 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e9712db5-b326-469a-899d-39b814feee28 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:35.738424 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e9712db5-b326-469a-899d-39b814feee28 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424868a1dc546e0ab5f46dc9031e836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800b737c81e34fb4a074a4c9a7543dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:35.757902 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e9712db5-b326-469a-899d-39b814feee28 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] 10.222.0.20 "GET /compute/v2.1/servers/c1f39d90-2cb8-40dc-9a4f-9c1d57e25492" status: 200 len: 1317 microversion: 2.1 time: 0.590091 Oct 04 18:57:35.782756 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2869/5709] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:35 2022] GET /compute/v2.1/servers/c1f39d90-2cb8-40dc-9a4f-9c1d57e25492 => generated 1317 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:36.786963 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c24814af-1223-4aab-a8a3-c313e95a5ec6 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:36.788193 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c24814af-1223-4aab-a8a3-c313e95a5ec6 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] [instance: c1f39d90-2cb8-40dc-9a4f-9c1d57e25492] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:36.804514 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c24814af-1223-4aab-a8a3-c313e95a5ec6 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:36.805043 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c24814af-1223-4aab-a8a3-c313e95a5ec6 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:36.812738 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c24814af-1223-4aab-a8a3-c313e95a5ec6 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:36.812738 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c24814af-1223-4aab-a8a3-c313e95a5ec6 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:36.812738 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c24814af-1223-4aab-a8a3-c313e95a5ec6 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:36.812738 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c24814af-1223-4aab-a8a3-c313e95a5ec6 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:37.383222 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c24814af-1223-4aab-a8a3-c313e95a5ec6 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424868a1dc546e0ab5f46dc9031e836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800b737c81e34fb4a074a4c9a7543dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:37.394425 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c24814af-1223-4aab-a8a3-c313e95a5ec6 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] 10.222.0.20 "GET /compute/v2.1/servers/c1f39d90-2cb8-40dc-9a4f-9c1d57e25492" status: 200 len: 1317 microversion: 2.1 time: 0.612129 Oct 04 18:57:37.400619 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2841/5710] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:36 2022] GET /compute/v2.1/servers/c1f39d90-2cb8-40dc-9a4f-9c1d57e25492 => generated 1317 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:37.927423 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-fadc4325-c31e-4ac2-ae4b-3d0f7c8b1554 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1534916488", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "32f1ab07-b252-4176-b7b8-3cc5be1795d8"}], "security_groups": [{"name": "tempest-securitygroup--2102736801"}], "key_name": "tempest-keypair-1414317048", "user_data": "}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:57:38.209835 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.neutron [None req-fadc4325-c31e-4ac2-ae4b-3d0f7c8b1554 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] validate_networks() for [('32f1ab07-b252-4176-b7b8-3cc5be1795d8', None, None, None, None, None)] {{(pid=123001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:57:38.363680 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=12 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:57:38.422413 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-55ff32bd-105e-4ad5-9323-63d79ed625a8 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:38.423028 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-55ff32bd-105e-4ad5-9323-63d79ed625a8 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] [instance: c1f39d90-2cb8-40dc-9a4f-9c1d57e25492] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:38.437693 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-55ff32bd-105e-4ad5-9323-63d79ed625a8 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:38.438296 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-55ff32bd-105e-4ad5-9323-63d79ed625a8 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:38.438819 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-55ff32bd-105e-4ad5-9323-63d79ed625a8 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:38.439615 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-55ff32bd-105e-4ad5-9323-63d79ed625a8 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:38.443579 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-55ff32bd-105e-4ad5-9323-63d79ed625a8 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:38.444248 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-55ff32bd-105e-4ad5-9323-63d79ed625a8 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:38.878594 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-55ff32bd-105e-4ad5-9323-63d79ed625a8 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424868a1dc546e0ab5f46dc9031e836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800b737c81e34fb4a074a4c9a7543dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:38.890285 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-55ff32bd-105e-4ad5-9323-63d79ed625a8 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] 10.222.0.20 "GET /compute/v2.1/servers/c1f39d90-2cb8-40dc-9a4f-9c1d57e25492" status: 200 len: 1317 microversion: 2.1 time: 0.471538 Oct 04 18:57:38.893537 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2842/5711] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:38 2022] GET /compute/v2.1/servers/c1f39d90-2cb8-40dc-9a4f-9c1d57e25492 => generated 1317 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:57:39.201408 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-fadc4325-c31e-4ac2-ae4b-3d0f7c8b1554 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:57:39.202420 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-fadc4325-c31e-4ac2-ae4b-3d0f7c8b1554 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:57:39.203092 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-fadc4325-c31e-4ac2-ae4b-3d0f7c8b1554 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:57:39.203666 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-fadc4325-c31e-4ac2-ae4b-3d0f7c8b1554 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:57:39.204530 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-fadc4325-c31e-4ac2-ae4b-3d0f7c8b1554 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:57:39.230479 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fadc4325-c31e-4ac2-ae4b-3d0f7c8b1554 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:39.233023 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fadc4325-c31e-4ac2-ae4b-3d0f7c8b1554 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:39.233710 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fadc4325-c31e-4ac2-ae4b-3d0f7c8b1554 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:39.235838 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fadc4325-c31e-4ac2-ae4b-3d0f7c8b1554 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:39.238013 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fadc4325-c31e-4ac2-ae4b-3d0f7c8b1554 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:39.243634 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fadc4325-c31e-4ac2-ae4b-3d0f7c8b1554 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:39.289961 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-fadc4325-c31e-4ac2-ae4b-3d0f7c8b1554 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Getting quotas for project 5dc67d8de57543c48bdf45669b684227. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:57:39.298843 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-fadc4325-c31e-4ac2-ae4b-3d0f7c8b1554 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Getting quotas for user ce441ded6f554ec28560c75de97af173 and project 5dc67d8de57543c48bdf45669b684227. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:57:39.316543 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-fadc4325-c31e-4ac2-ae4b-3d0f7c8b1554 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Going to run 1 instances... {{(pid=123001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:57:39.320225 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-fadc4325-c31e-4ac2-ae4b-3d0f7c8b1554 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: ba710906-86d6-4c04-a708-1f3b9a466e3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:57:39.484632 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-fadc4325-c31e-4ac2-ae4b-3d0f7c8b1554 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.565287 Oct 04 18:57:39.487637 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2870/5712] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:57:37 2022] POST /compute/v2.1/servers => generated 402 bytes in 1568 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:57:39.498284 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-274bcde1-d8fd-436e-a55b-347ce4d22d67 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:39.499318 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-274bcde1-d8fd-436e-a55b-347ce4d22d67 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: ba710906-86d6-4c04-a708-1f3b9a466e3c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:39.609327 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-274bcde1-d8fd-436e-a55b-347ce4d22d67 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce441ded6f554ec28560c75de97af173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc67d8de57543c48bdf45669b684227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:39.618183 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-274bcde1-d8fd-436e-a55b-347ce4d22d67 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/ba710906-86d6-4c04-a708-1f3b9a466e3c" status: 200 len: 1242 microversion: 2.1 time: 0.125058 Oct 04 18:57:39.652938 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2843/5713] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:39 2022] GET /compute/v2.1/servers/ba710906-86d6-4c04-a708-1f3b9a466e3c => generated 1242 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:39.914929 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b63639a6-2b54-47a8-a680-c5db27403199 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:39.915816 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b63639a6-2b54-47a8-a680-c5db27403199 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] [instance: c1f39d90-2cb8-40dc-9a4f-9c1d57e25492] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:39.948806 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b63639a6-2b54-47a8-a680-c5db27403199 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:39.948806 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b63639a6-2b54-47a8-a680-c5db27403199 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:39.948806 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b63639a6-2b54-47a8-a680-c5db27403199 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:39.948806 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b63639a6-2b54-47a8-a680-c5db27403199 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:39.949252 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b63639a6-2b54-47a8-a680-c5db27403199 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:39.949343 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b63639a6-2b54-47a8-a680-c5db27403199 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:40.320534 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b63639a6-2b54-47a8-a680-c5db27403199 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424868a1dc546e0ab5f46dc9031e836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800b737c81e34fb4a074a4c9a7543dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:40.333653 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b63639a6-2b54-47a8-a680-c5db27403199 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] 10.222.0.20 "GET /compute/v2.1/servers/c1f39d90-2cb8-40dc-9a4f-9c1d57e25492" status: 200 len: 1317 microversion: 2.1 time: 0.421807 Oct 04 18:57:40.335034 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2871/5714] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:39 2022] GET /compute/v2.1/servers/c1f39d90-2cb8-40dc-9a4f-9c1d57e25492 => generated 1317 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:40.662478 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-e98218bf-ee55-4401-b2e8-077d152441d3 req-17b09017-3bab-4b17-ba21-c415660af3da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1f39d90-2cb8-40dc-9a4f-9c1d57e25492", "name": "network-vif-plugged", "status": "completed", "tag": "ec80ff71-2e86-42cb-b4dd-09c80a54d329"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:57:40.676021 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-392e63e9-d4b6-476a-ac52-a7df3f6c32a7 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:40.676933 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-392e63e9-d4b6-476a-ac52-a7df3f6c32a7 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: ba710906-86d6-4c04-a708-1f3b9a466e3c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:40.706072 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-e98218bf-ee55-4401-b2e8-077d152441d3 req-17b09017-3bab-4b17-ba21-c415660af3da service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:40.706749 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-e98218bf-ee55-4401-b2e8-077d152441d3 req-17b09017-3bab-4b17-ba21-c415660af3da service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:40.707363 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-e98218bf-ee55-4401-b2e8-077d152441d3 req-17b09017-3bab-4b17-ba21-c415660af3da service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:40.738720 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-e98218bf-ee55-4401-b2e8-077d152441d3 req-17b09017-3bab-4b17-ba21-c415660af3da service nova] Creating event network-vif-plugged:ec80ff71-2e86-42cb-b4dd-09c80a54d329 for instance c1f39d90-2cb8-40dc-9a4f-9c1d57e25492 on n-h1-850501-14 Oct 04 18:57:40.746580 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-e98218bf-ee55-4401-b2e8-077d152441d3 req-17b09017-3bab-4b17-ba21-c415660af3da service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087795 Oct 04 18:57:40.747282 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2844/5715] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:57:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:57:40.824616 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-392e63e9-d4b6-476a-ac52-a7df3f6c32a7 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce441ded6f554ec28560c75de97af173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc67d8de57543c48bdf45669b684227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:40.854312 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-392e63e9-d4b6-476a-ac52-a7df3f6c32a7 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/ba710906-86d6-4c04-a708-1f3b9a466e3c" status: 200 len: 1242 microversion: 2.1 time: 0.170088 Oct 04 18:57:40.859168 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2872/5716] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:40 2022] GET /compute/v2.1/servers/ba710906-86d6-4c04-a708-1f3b9a466e3c => generated 1242 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:41.367724 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-dc5aa907-f6e0-4a0f-8aa9-26149a878e37 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:41.369622 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-dc5aa907-f6e0-4a0f-8aa9-26149a878e37 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] [instance: c1f39d90-2cb8-40dc-9a4f-9c1d57e25492] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:41.376724 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dc5aa907-f6e0-4a0f-8aa9-26149a878e37 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:41.377215 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dc5aa907-f6e0-4a0f-8aa9-26149a878e37 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:41.377680 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dc5aa907-f6e0-4a0f-8aa9-26149a878e37 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:41.378438 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dc5aa907-f6e0-4a0f-8aa9-26149a878e37 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:41.378892 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dc5aa907-f6e0-4a0f-8aa9-26149a878e37 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:41.379313 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dc5aa907-f6e0-4a0f-8aa9-26149a878e37 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:41.678078 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-dc5aa907-f6e0-4a0f-8aa9-26149a878e37 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424868a1dc546e0ab5f46dc9031e836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800b737c81e34fb4a074a4c9a7543dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:41.742034 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-dc5aa907-f6e0-4a0f-8aa9-26149a878e37 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] 10.222.0.20 "GET /compute/v2.1/servers/c1f39d90-2cb8-40dc-9a4f-9c1d57e25492" status: 200 len: 1317 microversion: 2.1 time: 0.351546 Oct 04 18:57:41.742927 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2845/5717] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:41 2022] GET /compute/v2.1/servers/c1f39d90-2cb8-40dc-9a4f-9c1d57e25492 => generated 1317 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:41.883322 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a5a443d1-8bfd-4f77-be41-19829683c9ad tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:41.884289 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a5a443d1-8bfd-4f77-be41-19829683c9ad tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: ba710906-86d6-4c04-a708-1f3b9a466e3c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:41.893311 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a5a443d1-8bfd-4f77-be41-19829683c9ad tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:41.894206 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a5a443d1-8bfd-4f77-be41-19829683c9ad tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:41.894832 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a5a443d1-8bfd-4f77-be41-19829683c9ad tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:41.895858 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a5a443d1-8bfd-4f77-be41-19829683c9ad tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:41.896521 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a5a443d1-8bfd-4f77-be41-19829683c9ad tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:41.897137 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a5a443d1-8bfd-4f77-be41-19829683c9ad tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:42.010433 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a5a443d1-8bfd-4f77-be41-19829683c9ad tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce441ded6f554ec28560c75de97af173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc67d8de57543c48bdf45669b684227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:42.019851 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a5a443d1-8bfd-4f77-be41-19829683c9ad tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/ba710906-86d6-4c04-a708-1f3b9a466e3c" status: 200 len: 1238 microversion: 2.1 time: 0.140762 Oct 04 18:57:42.025069 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2873/5718] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:41 2022] GET /compute/v2.1/servers/ba710906-86d6-4c04-a708-1f3b9a466e3c => generated 1238 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:42.771392 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c50aab95-607e-4d4b-bec9-3d624f78206b tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:42.779495 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c50aab95-607e-4d4b-bec9-3d624f78206b tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] [instance: c1f39d90-2cb8-40dc-9a4f-9c1d57e25492] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:42.806177 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c50aab95-607e-4d4b-bec9-3d624f78206b tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:42.812819 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c50aab95-607e-4d4b-bec9-3d624f78206b tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:42.814801 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c50aab95-607e-4d4b-bec9-3d624f78206b tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:42.815806 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c50aab95-607e-4d4b-bec9-3d624f78206b tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:42.819192 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c50aab95-607e-4d4b-bec9-3d624f78206b tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:42.819848 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c50aab95-607e-4d4b-bec9-3d624f78206b tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:43.052917 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-315d199e-e9f1-4b93-82c6-d0c955ad90b2 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:43.053746 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-315d199e-e9f1-4b93-82c6-d0c955ad90b2 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: ba710906-86d6-4c04-a708-1f3b9a466e3c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:43.077905 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-315d199e-e9f1-4b93-82c6-d0c955ad90b2 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:43.079838 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-315d199e-e9f1-4b93-82c6-d0c955ad90b2 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:43.080598 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-315d199e-e9f1-4b93-82c6-d0c955ad90b2 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:43.085229 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-315d199e-e9f1-4b93-82c6-d0c955ad90b2 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:43.085977 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-315d199e-e9f1-4b93-82c6-d0c955ad90b2 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:43.086721 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-315d199e-e9f1-4b93-82c6-d0c955ad90b2 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:43.302739 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-315d199e-e9f1-4b93-82c6-d0c955ad90b2 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce441ded6f554ec28560c75de97af173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc67d8de57543c48bdf45669b684227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:43.311455 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-315d199e-e9f1-4b93-82c6-d0c955ad90b2 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/ba710906-86d6-4c04-a708-1f3b9a466e3c" status: 200 len: 1302 microversion: 2.1 time: 0.264078 Oct 04 18:57:43.312072 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2874/5719] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:43 2022] GET /compute/v2.1/servers/ba710906-86d6-4c04-a708-1f3b9a466e3c => generated 1302 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:57:43.690997 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c50aab95-607e-4d4b-bec9-3d624f78206b tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424868a1dc546e0ab5f46dc9031e836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800b737c81e34fb4a074a4c9a7543dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:43.704716 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c50aab95-607e-4d4b-bec9-3d624f78206b tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] 10.222.0.20 "GET /compute/v2.1/servers/c1f39d90-2cb8-40dc-9a4f-9c1d57e25492" status: 200 len: 1506 microversion: 2.1 time: 0.935798 Oct 04 18:57:43.707583 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2846/5720] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:42 2022] GET /compute/v2.1/servers/c1f39d90-2cb8-40dc-9a4f-9c1d57e25492 => generated 1506 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:43.734144 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d50801dd-abc5-4ce9-940c-ef57a0cdb5c6 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:43.735738 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d50801dd-abc5-4ce9-940c-ef57a0cdb5c6 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] [instance: c1f39d90-2cb8-40dc-9a4f-9c1d57e25492] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:43.746314 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d50801dd-abc5-4ce9-940c-ef57a0cdb5c6 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:43.746740 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d50801dd-abc5-4ce9-940c-ef57a0cdb5c6 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:43.762449 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d50801dd-abc5-4ce9-940c-ef57a0cdb5c6 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:43.762449 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d50801dd-abc5-4ce9-940c-ef57a0cdb5c6 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:43.762449 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d50801dd-abc5-4ce9-940c-ef57a0cdb5c6 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:43.762449 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d50801dd-abc5-4ce9-940c-ef57a0cdb5c6 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:43.821229 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d50801dd-abc5-4ce9-940c-ef57a0cdb5c6 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] 10.222.0.20 "GET /compute/v2.1/servers/c1f39d90-2cb8-40dc-9a4f-9c1d57e25492/ips" status: 200 len: 109 microversion: 2.1 time: 0.091629 Oct 04 18:57:43.825889 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2875/5721] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Oct 4 18:57:43 2022] GET /compute/v2.1/servers/c1f39d90-2cb8-40dc-9a4f-9c1d57e25492/ips => generated 109 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:57:43.836661 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7d9ea3ab-7bcd-4e67-a27e-4dcba0510e7a tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:43.838814 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7d9ea3ab-7bcd-4e67-a27e-4dcba0510e7a tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] [instance: c1f39d90-2cb8-40dc-9a4f-9c1d57e25492] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:43.859689 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7d9ea3ab-7bcd-4e67-a27e-4dcba0510e7a tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:43.864581 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7d9ea3ab-7bcd-4e67-a27e-4dcba0510e7a tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:43.866981 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7d9ea3ab-7bcd-4e67-a27e-4dcba0510e7a tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:43.868016 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7d9ea3ab-7bcd-4e67-a27e-4dcba0510e7a tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:43.874810 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7d9ea3ab-7bcd-4e67-a27e-4dcba0510e7a tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:43.875625 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7d9ea3ab-7bcd-4e67-a27e-4dcba0510e7a tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:43.936462 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7d9ea3ab-7bcd-4e67-a27e-4dcba0510e7a tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] 10.222.0.20 "GET /compute/v2.1/servers/c1f39d90-2cb8-40dc-9a4f-9c1d57e25492/ips" status: 200 len: 109 microversion: 2.1 time: 0.105275 Oct 04 18:57:43.940317 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2847/5722] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Oct 4 18:57:43 2022] GET /compute/v2.1/servers/c1f39d90-2cb8-40dc-9a4f-9c1d57e25492/ips => generated 109 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:57:43.953779 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9b6aa4a2-f36c-4633-acae-666c38fad218 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:43.954695 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-9b6aa4a2-f36c-4633-acae-666c38fad218 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] [instance: c1f39d90-2cb8-40dc-9a4f-9c1d57e25492] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:43.968744 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9b6aa4a2-f36c-4633-acae-666c38fad218 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:43.969906 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9b6aa4a2-f36c-4633-acae-666c38fad218 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:43.971702 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9b6aa4a2-f36c-4633-acae-666c38fad218 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:43.974295 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9b6aa4a2-f36c-4633-acae-666c38fad218 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:43.974957 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9b6aa4a2-f36c-4633-acae-666c38fad218 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:43.977262 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9b6aa4a2-f36c-4633-acae-666c38fad218 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:44.050544 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9b6aa4a2-f36c-4633-acae-666c38fad218 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] 10.222.0.20 "GET /compute/v2.1/servers/c1f39d90-2cb8-40dc-9a4f-9c1d57e25492/ips/tempest-ServerAddressesTestJSON-554713807-network" status: 200 len: 94 microversion: 2.1 time: 0.101465 Oct 04 18:57:44.056862 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2876/5723] 10.222.0.20 () {58 vars in 1398 bytes} [Tue Oct 4 18:57:43 2022] GET /compute/v2.1/servers/c1f39d90-2cb8-40dc-9a4f-9c1d57e25492/ips/tempest-ServerAddressesTestJSON-554713807-network => generated 94 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:57:44.072625 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7aa69951-64a6-4323-b472-efcc08a2dcd9 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:44.074922 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7aa69951-64a6-4323-b472-efcc08a2dcd9 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] [instance: c1f39d90-2cb8-40dc-9a4f-9c1d57e25492] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:44.085272 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7aa69951-64a6-4323-b472-efcc08a2dcd9 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:44.089399 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7aa69951-64a6-4323-b472-efcc08a2dcd9 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:44.090111 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7aa69951-64a6-4323-b472-efcc08a2dcd9 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:44.091252 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7aa69951-64a6-4323-b472-efcc08a2dcd9 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:44.093268 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7aa69951-64a6-4323-b472-efcc08a2dcd9 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:44.094107 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7aa69951-64a6-4323-b472-efcc08a2dcd9 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:44.158702 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7aa69951-64a6-4323-b472-efcc08a2dcd9 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] [instance: c1f39d90-2cb8-40dc-9a4f-9c1d57e25492] Going to try to terminate instance {{(pid=123002) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:57:44.336896 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-34cb8372-b88f-40ae-9747-c8e5af9063dd tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:44.338695 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-34cb8372-b88f-40ae-9747-c8e5af9063dd tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: ba710906-86d6-4c04-a708-1f3b9a466e3c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:44.359426 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-34cb8372-b88f-40ae-9747-c8e5af9063dd tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:44.360410 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-34cb8372-b88f-40ae-9747-c8e5af9063dd tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:44.361097 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-34cb8372-b88f-40ae-9747-c8e5af9063dd tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:44.362819 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-34cb8372-b88f-40ae-9747-c8e5af9063dd tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:44.365841 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-34cb8372-b88f-40ae-9747-c8e5af9063dd tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:44.366582 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-34cb8372-b88f-40ae-9747-c8e5af9063dd tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:44.605109 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-34cb8372-b88f-40ae-9747-c8e5af9063dd tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce441ded6f554ec28560c75de97af173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc67d8de57543c48bdf45669b684227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:44.617432 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-34cb8372-b88f-40ae-9747-c8e5af9063dd tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/ba710906-86d6-4c04-a708-1f3b9a466e3c" status: 200 len: 1300 microversion: 2.1 time: 0.284663 Oct 04 18:57:44.629599 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2877/5724] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:44 2022] GET /compute/v2.1/servers/ba710906-86d6-4c04-a708-1f3b9a466e3c => generated 1300 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:57:44.729628 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7aa69951-64a6-4323-b472-efcc08a2dcd9 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c1f39d90-2cb8-40dc-9a4f-9c1d57e25492" status: 204 len: 0 microversion: 2.1 time: 0.663718 Oct 04 18:57:44.732875 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2848/5725] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 18:57:44 2022] DELETE /compute/v2.1/servers/c1f39d90-2cb8-40dc-9a4f-9c1d57e25492 => generated 0 bytes in 669 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:57:44.743440 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-dbdcebff-104e-467d-8331-92d6665a5e62 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:44.744651 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-dbdcebff-104e-467d-8331-92d6665a5e62 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] [instance: c1f39d90-2cb8-40dc-9a4f-9c1d57e25492] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:44.760915 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dbdcebff-104e-467d-8331-92d6665a5e62 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:44.761714 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dbdcebff-104e-467d-8331-92d6665a5e62 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:44.762678 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dbdcebff-104e-467d-8331-92d6665a5e62 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:44.763420 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dbdcebff-104e-467d-8331-92d6665a5e62 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:44.763885 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dbdcebff-104e-467d-8331-92d6665a5e62 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:44.785052 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dbdcebff-104e-467d-8331-92d6665a5e62 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:45.098280 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-dbdcebff-104e-467d-8331-92d6665a5e62 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424868a1dc546e0ab5f46dc9031e836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800b737c81e34fb4a074a4c9a7543dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:45.108565 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-dbdcebff-104e-467d-8331-92d6665a5e62 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] 10.222.0.20 "GET /compute/v2.1/servers/c1f39d90-2cb8-40dc-9a4f-9c1d57e25492" status: 200 len: 1512 microversion: 2.1 time: 0.368813 Oct 04 18:57:45.125232 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2878/5726] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:44 2022] GET /compute/v2.1/servers/c1f39d90-2cb8-40dc-9a4f-9c1d57e25492 => generated 1512 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:45.661218 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b6e3afae-5d86-4277-8d88-f162c2e62b30 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:45.661949 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b6e3afae-5d86-4277-8d88-f162c2e62b30 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: ba710906-86d6-4c04-a708-1f3b9a466e3c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:45.682902 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b6e3afae-5d86-4277-8d88-f162c2e62b30 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:45.683405 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b6e3afae-5d86-4277-8d88-f162c2e62b30 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:45.693807 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b6e3afae-5d86-4277-8d88-f162c2e62b30 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:45.695184 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b6e3afae-5d86-4277-8d88-f162c2e62b30 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:45.697796 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b6e3afae-5d86-4277-8d88-f162c2e62b30 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:45.698500 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b6e3afae-5d86-4277-8d88-f162c2e62b30 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:46.133997 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9882d342-b393-4bb4-bc4f-0c081d9462c1 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:46.136222 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-9882d342-b393-4bb4-bc4f-0c081d9462c1 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] [instance: c1f39d90-2cb8-40dc-9a4f-9c1d57e25492] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:46.152784 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b6e3afae-5d86-4277-8d88-f162c2e62b30 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce441ded6f554ec28560c75de97af173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc67d8de57543c48bdf45669b684227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:46.157508 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9882d342-b393-4bb4-bc4f-0c081d9462c1 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:46.159696 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9882d342-b393-4bb4-bc4f-0c081d9462c1 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:46.160932 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9882d342-b393-4bb4-bc4f-0c081d9462c1 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:46.165488 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9882d342-b393-4bb4-bc4f-0c081d9462c1 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:46.170447 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b6e3afae-5d86-4277-8d88-f162c2e62b30 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/ba710906-86d6-4c04-a708-1f3b9a466e3c" status: 200 len: 1368 microversion: 2.1 time: 0.513768 Oct 04 18:57:46.184107 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2849/5727] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:45 2022] GET /compute/v2.1/servers/ba710906-86d6-4c04-a708-1f3b9a466e3c => generated 1368 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:46.184471 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9882d342-b393-4bb4-bc4f-0c081d9462c1 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:46.184471 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9882d342-b393-4bb4-bc4f-0c081d9462c1 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:47.120451 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9882d342-b393-4bb4-bc4f-0c081d9462c1 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424868a1dc546e0ab5f46dc9031e836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800b737c81e34fb4a074a4c9a7543dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:47.150736 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9882d342-b393-4bb4-bc4f-0c081d9462c1 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] 10.222.0.20 "GET /compute/v2.1/servers/c1f39d90-2cb8-40dc-9a4f-9c1d57e25492" status: 200 len: 1512 microversion: 2.1 time: 1.019854 Oct 04 18:57:47.150736 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2879/5728] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:46 2022] GET /compute/v2.1/servers/c1f39d90-2cb8-40dc-9a4f-9c1d57e25492 => generated 1512 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:47.205310 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-59621635-a5c1-4234-bbe2-4a4f97d17ede tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:47.206681 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-59621635-a5c1-4234-bbe2-4a4f97d17ede tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: ba710906-86d6-4c04-a708-1f3b9a466e3c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:47.218602 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-59621635-a5c1-4234-bbe2-4a4f97d17ede tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:47.222981 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-59621635-a5c1-4234-bbe2-4a4f97d17ede tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:47.223770 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-59621635-a5c1-4234-bbe2-4a4f97d17ede tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:47.224891 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-59621635-a5c1-4234-bbe2-4a4f97d17ede tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:47.243430 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-59621635-a5c1-4234-bbe2-4a4f97d17ede tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:47.252252 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-59621635-a5c1-4234-bbe2-4a4f97d17ede tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:47.477548 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-eae7a6ff-9b24-4332-8890-18a38fc5b494 req-46ca003f-52f2-4642-a215-399d52e0249d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba710906-86d6-4c04-a708-1f3b9a466e3c", "tag": "57e29293-74e1-4d5e-a79e-46e5c51346d1"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:57:47.500656 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-eae7a6ff-9b24-4332-8890-18a38fc5b494 req-46ca003f-52f2-4642-a215-399d52e0249d service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:47.501992 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-eae7a6ff-9b24-4332-8890-18a38fc5b494 req-46ca003f-52f2-4642-a215-399d52e0249d service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:47.502524 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-eae7a6ff-9b24-4332-8890-18a38fc5b494 req-46ca003f-52f2-4642-a215-399d52e0249d service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:47.535485 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-eae7a6ff-9b24-4332-8890-18a38fc5b494 req-46ca003f-52f2-4642-a215-399d52e0249d service nova] Creating event network-changed:57e29293-74e1-4d5e-a79e-46e5c51346d1 for instance ba710906-86d6-4c04-a708-1f3b9a466e3c on n-h2-850501-14 Oct 04 18:57:47.553729 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-eae7a6ff-9b24-4332-8890-18a38fc5b494 req-46ca003f-52f2-4642-a215-399d52e0249d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079810 Oct 04 18:57:47.554978 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2880/5729] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:57:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:57:47.695253 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-59621635-a5c1-4234-bbe2-4a4f97d17ede tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce441ded6f554ec28560c75de97af173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc67d8de57543c48bdf45669b684227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:47.707366 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-59621635-a5c1-4234-bbe2-4a4f97d17ede tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/ba710906-86d6-4c04-a708-1f3b9a466e3c" status: 200 len: 1368 microversion: 2.1 time: 0.506123 Oct 04 18:57:47.718463 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2850/5730] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:47 2022] GET /compute/v2.1/servers/ba710906-86d6-4c04-a708-1f3b9a466e3c => generated 1368 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:48.184086 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4b214b00-f8ce-4db7-a6b3-1490a26cee74 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:48.185104 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4b214b00-f8ce-4db7-a6b3-1490a26cee74 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] [instance: c1f39d90-2cb8-40dc-9a4f-9c1d57e25492] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:48.205422 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4b214b00-f8ce-4db7-a6b3-1490a26cee74 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:48.206632 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4b214b00-f8ce-4db7-a6b3-1490a26cee74 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:48.207635 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4b214b00-f8ce-4db7-a6b3-1490a26cee74 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:48.208960 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4b214b00-f8ce-4db7-a6b3-1490a26cee74 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:48.218719 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4b214b00-f8ce-4db7-a6b3-1490a26cee74 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:48.221010 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4b214b00-f8ce-4db7-a6b3-1490a26cee74 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:48.338339 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-0bc5af4f-868b-4b9a-8ff9-911f3a058171 req-b4f66a53-cc1a-4bb7-9638-209036b4c2e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1f39d90-2cb8-40dc-9a4f-9c1d57e25492", "name": "network-vif-deleted", "tag": "ec80ff71-2e86-42cb-b4dd-09c80a54d329"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:57:48.363286 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-0bc5af4f-868b-4b9a-8ff9-911f3a058171 req-b4f66a53-cc1a-4bb7-9638-209036b4c2e8 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:48.364086 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-0bc5af4f-868b-4b9a-8ff9-911f3a058171 req-b4f66a53-cc1a-4bb7-9638-209036b4c2e8 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:48.365412 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-0bc5af4f-868b-4b9a-8ff9-911f3a058171 req-b4f66a53-cc1a-4bb7-9638-209036b4c2e8 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:48.387465 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-0bc5af4f-868b-4b9a-8ff9-911f3a058171 req-b4f66a53-cc1a-4bb7-9638-209036b4c2e8 service nova] Creating event network-vif-deleted:ec80ff71-2e86-42cb-b4dd-09c80a54d329 for instance c1f39d90-2cb8-40dc-9a4f-9c1d57e25492 on n-h1-850501-14 Oct 04 18:57:48.394167 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-0bc5af4f-868b-4b9a-8ff9-911f3a058171 req-b4f66a53-cc1a-4bb7-9638-209036b4c2e8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.371320 Oct 04 18:57:48.400919 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4b214b00-f8ce-4db7-a6b3-1490a26cee74 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424868a1dc546e0ab5f46dc9031e836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800b737c81e34fb4a074a4c9a7543dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:48.411519 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2881/5731] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:57:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:57:48.428263 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4b214b00-f8ce-4db7-a6b3-1490a26cee74 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] 10.222.0.20 "GET /compute/v2.1/servers/c1f39d90-2cb8-40dc-9a4f-9c1d57e25492" status: 200 len: 1302 microversion: 2.1 time: 0.252053 Oct 04 18:57:48.434678 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2851/5732] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:48 2022] GET /compute/v2.1/servers/c1f39d90-2cb8-40dc-9a4f-9c1d57e25492 => generated 1302 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:57:48.750572 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4441175f-f67c-450a-8bd1-ac1b022674ac tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:48.752417 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-4441175f-f67c-450a-8bd1-ac1b022674ac tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: ba710906-86d6-4c04-a708-1f3b9a466e3c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:48.770462 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4441175f-f67c-450a-8bd1-ac1b022674ac tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:48.772038 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4441175f-f67c-450a-8bd1-ac1b022674ac tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:48.782634 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4441175f-f67c-450a-8bd1-ac1b022674ac tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:48.782634 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4441175f-f67c-450a-8bd1-ac1b022674ac tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:48.782634 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4441175f-f67c-450a-8bd1-ac1b022674ac tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:48.782634 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4441175f-f67c-450a-8bd1-ac1b022674ac tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:49.279992 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:57:49.459826 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-652871f2-c9fe-4e87-bd09-9686f7271fa5 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:49.460474 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-652871f2-c9fe-4e87-bd09-9686f7271fa5 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] [instance: c1f39d90-2cb8-40dc-9a4f-9c1d57e25492] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:49.493947 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-652871f2-c9fe-4e87-bd09-9686f7271fa5 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:49.495078 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-652871f2-c9fe-4e87-bd09-9686f7271fa5 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:49.495725 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-652871f2-c9fe-4e87-bd09-9686f7271fa5 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:49.496673 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-652871f2-c9fe-4e87-bd09-9686f7271fa5 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:49.497300 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-652871f2-c9fe-4e87-bd09-9686f7271fa5 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:49.498033 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-652871f2-c9fe-4e87-bd09-9686f7271fa5 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:49.529322 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:57:49.544172 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-652871f2-c9fe-4e87-bd09-9686f7271fa5 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:49.544765 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-652871f2-c9fe-4e87-bd09-9686f7271fa5 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:49.545432 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-652871f2-c9fe-4e87-bd09-9686f7271fa5 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:49.546089 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-652871f2-c9fe-4e87-bd09-9686f7271fa5 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Lazy-loading 'fault' on Instance uuid c1f39d90-2cb8-40dc-9a4f-9c1d57e25492 {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:57:49.618196 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:57:49.740219 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-652871f2-c9fe-4e87-bd09-9686f7271fa5 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424868a1dc546e0ab5f46dc9031e836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800b737c81e34fb4a074a4c9a7543dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:49.745819 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-4441175f-f67c-450a-8bd1-ac1b022674ac tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce441ded6f554ec28560c75de97af173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc67d8de57543c48bdf45669b684227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:49.761352 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-652871f2-c9fe-4e87-bd09-9686f7271fa5 tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] 10.222.0.20 "GET /compute/v2.1/servers/c1f39d90-2cb8-40dc-9a4f-9c1d57e25492" status: 200 len: 1307 microversion: 2.1 time: 0.305463 Oct 04 18:57:49.763771 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-4441175f-f67c-450a-8bd1-ac1b022674ac tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/ba710906-86d6-4c04-a708-1f3b9a466e3c" status: 200 len: 1368 microversion: 2.1 time: 1.030619 Oct 04 18:57:49.764853 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2852/5733] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:49 2022] GET /compute/v2.1/servers/c1f39d90-2cb8-40dc-9a4f-9c1d57e25492 => generated 1307 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:49.766734 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2882/5734] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:48 2022] GET /compute/v2.1/servers/ba710906-86d6-4c04-a708-1f3b9a466e3c => generated 1368 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:50.796011 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c88bdbc0-8bc2-4e81-bebb-9e2c9611755d tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:50.797482 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e2d61206-b77d-4d07-978f-b61846e3f9c0 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:50.800877 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c88bdbc0-8bc2-4e81-bebb-9e2c9611755d tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] [instance: c1f39d90-2cb8-40dc-9a4f-9c1d57e25492] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:50.803319 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e2d61206-b77d-4d07-978f-b61846e3f9c0 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: ba710906-86d6-4c04-a708-1f3b9a466e3c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:50.827246 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c88bdbc0-8bc2-4e81-bebb-9e2c9611755d tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:50.829079 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c88bdbc0-8bc2-4e81-bebb-9e2c9611755d tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:50.833646 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c88bdbc0-8bc2-4e81-bebb-9e2c9611755d tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:50.835332 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c88bdbc0-8bc2-4e81-bebb-9e2c9611755d tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:50.835974 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e2d61206-b77d-4d07-978f-b61846e3f9c0 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:50.837439 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e2d61206-b77d-4d07-978f-b61846e3f9c0 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:50.838829 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c88bdbc0-8bc2-4e81-bebb-9e2c9611755d tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:50.842136 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e2d61206-b77d-4d07-978f-b61846e3f9c0 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:50.842718 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c88bdbc0-8bc2-4e81-bebb-9e2c9611755d tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:50.844253 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=8 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:57:50.846706 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e2d61206-b77d-4d07-978f-b61846e3f9c0 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:50.847672 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e2d61206-b77d-4d07-978f-b61846e3f9c0 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:50.850062 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e2d61206-b77d-4d07-978f-b61846e3f9c0 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:50.902796 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=79 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:57:50.911287 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-c88bdbc0-8bc2-4e81-bebb-9e2c9611755d tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] HTTP exception thrown: Instance c1f39d90-2cb8-40dc-9a4f-9c1d57e25492 could not be found. Oct 04 18:57:50.915648 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c88bdbc0-8bc2-4e81-bebb-9e2c9611755d tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Request method failure captured: Oct 04 18:57:50.915648 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/c1f39d90-2cb8-40dc-9a4f-9c1d57e25492 HTTP/1.1 Oct 04 18:57:50.915648 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 18:57:50.915648 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 18:57:50.915648 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 18:57:50.915648 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 18:57:50.915648 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 18:57:50.915648 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 18:57:50.915648 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 18:57:50.915648 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 18:57:50.915648 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPIIORok_ev4vmL34ryQntHJfiWmBEJIZ7wa5HtbKAfpjucpUuIiZhmV3AX_CYPKhJSPmEMixc6LZjecDOHUvTibaLxyyRvsUoBl33_RQ7VYDv0wLwGlFD51Magn2Nt67gkx6iNnbPZAQkO11xtdJJ1tUQdO5N1F55CG-553_IspsFcI Oct 04 18:57:50.915648 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 18:57:50.915648 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 18:57:50.915648 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 18:57:50.915648 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 18:57:50.915648 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 18:57:50.915648 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 18:57:50.915648 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 800b737c81e34fb4a074a4c9a7543dfd Oct 04 18:57:50.915648 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ServerAddressesTestJSON-1293725324 Oct 04 18:57:50.915648 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 18:57:50.915648 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 18:57:50.915648 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/800b737c81e34fb4a074a4c9a7543dfd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_800b737c81e34fb4a074a4c9a7543dfd", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/800b737c81e34fb4a074a4c9a7543dfd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/800b737c81e34fb4a074a4c9a7543dfd"}]}] Oct 04 18:57:50.915648 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ServerAddressesTestJSON-1293725324 Oct 04 18:57:50.915648 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 800b737c81e34fb4a074a4c9a7543dfd Oct 04 18:57:50.915648 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ServerAddressesTestJSON-1293725324 Oct 04 18:57:50.915648 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ServerAddressesTestJSON-1293725324-project Oct 04 18:57:50.915648 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 18:57:50.915648 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 18:57:50.915648 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: b424868a1dc546e0ab5f46dc9031e836 Oct 04 18:57:50.915648 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ServerAddressesTestJSON-1293725324-project Oct 04 18:57:50.915648 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 18:57:50.915648 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance c1f39d90-2cb8-40dc-9a4f-9c1d57e25492 could not be found. Oct 04 18:57:50.915648 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': 'c1f39d90-2cb8-40dc-9a4f-9c1d57e25492'} Oct 04 18:57:50.915648 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:57:50.915648 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:57:50.915648 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:57:50.915648 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:57:50.915648 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:57:50.915648 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:57:50.915648 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:57:50.915648 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:57:50.915648 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:57:50.915648 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:57:50.915648 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1f39d90-2cb8-40dc-9a4f-9c1d57e25492 could not be found. Oct 04 18:57:50.915648 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:57:50.915648 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:57:50.915648 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:57:50.915648 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:57:50.915648 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:57:50.915648 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:57:50.915648 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:57:50.915648 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:57:50.915648 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:57:50.915648 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:57:50.915648 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:57:50.915648 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:57:50.915648 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:57:50.915648 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:57:50.915648 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:57:50.915648 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:57:50.915648 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1f39d90-2cb8-40dc-9a4f-9c1d57e25492 could not be found. Oct 04 18:57:50.915648 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:57:50.915648 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:57:50.915648 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:57:50.932742 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:57:50.932742 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:57:50.932742 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:57:50.932742 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:57:50.932742 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:57:50.932742 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1f39d90-2cb8-40dc-9a4f-9c1d57e25492 could not be found. Oct 04 18:57:50.932742 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 18:57:50.937301 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c88bdbc0-8bc2-4e81-bebb-9e2c9611755d tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] Returning 404 to user: Instance c1f39d90-2cb8-40dc-9a4f-9c1d57e25492 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:57:50.939759 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c88bdbc0-8bc2-4e81-bebb-9e2c9611755d tempest-ServerAddressesTestJSON-1293725324 tempest-ServerAddressesTestJSON-1293725324-project] 10.222.0.20 "GET /compute/v2.1/servers/c1f39d90-2cb8-40dc-9a4f-9c1d57e25492" status: 404 len: 111 microversion: 2.1 time: 0.146556 Oct 04 18:57:50.941164 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2883/5735] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:50 2022] GET /compute/v2.1/servers/c1f39d90-2cb8-40dc-9a4f-9c1d57e25492 => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:57:51.668386 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e2d61206-b77d-4d07-978f-b61846e3f9c0 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce441ded6f554ec28560c75de97af173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc67d8de57543c48bdf45669b684227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:51.681790 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e2d61206-b77d-4d07-978f-b61846e3f9c0 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/ba710906-86d6-4c04-a708-1f3b9a466e3c" status: 200 len: 1368 microversion: 2.1 time: 0.898151 Oct 04 18:57:51.683309 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2853/5736] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:50 2022] GET /compute/v2.1/servers/ba710906-86d6-4c04-a708-1f3b9a466e3c => generated 1368 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:52.708731 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d7e6fc6d-dee8-4ce4-a113-e4b3927bb394 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:52.721837 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d7e6fc6d-dee8-4ce4-a113-e4b3927bb394 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: ba710906-86d6-4c04-a708-1f3b9a466e3c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:52.750176 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=7 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:57:52.752819 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d7e6fc6d-dee8-4ce4-a113-e4b3927bb394 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:52.753853 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d7e6fc6d-dee8-4ce4-a113-e4b3927bb394 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:52.754836 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d7e6fc6d-dee8-4ce4-a113-e4b3927bb394 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:52.755800 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d7e6fc6d-dee8-4ce4-a113-e4b3927bb394 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:52.756511 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d7e6fc6d-dee8-4ce4-a113-e4b3927bb394 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:52.757193 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d7e6fc6d-dee8-4ce4-a113-e4b3927bb394 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:53.545066 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d7e6fc6d-dee8-4ce4-a113-e4b3927bb394 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce441ded6f554ec28560c75de97af173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc67d8de57543c48bdf45669b684227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:53.554547 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d7e6fc6d-dee8-4ce4-a113-e4b3927bb394 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/ba710906-86d6-4c04-a708-1f3b9a466e3c" status: 200 len: 1368 microversion: 2.1 time: 0.849991 Oct 04 18:57:53.555131 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2884/5737] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:52 2022] GET /compute/v2.1/servers/ba710906-86d6-4c04-a708-1f3b9a466e3c => generated 1368 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:54.580042 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-31c995e4-810f-4dbd-9be2-bb9c395a0191 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:54.580678 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-31c995e4-810f-4dbd-9be2-bb9c395a0191 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: ba710906-86d6-4c04-a708-1f3b9a466e3c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:54.586419 n-d-850501-14 devstack@n-api.service[123002]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 18:57:54.586617 n-d-850501-14 devstack@n-api.service[123002]: Tue Oct 4 18:57:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ba710906-86d6-4c04-a708-1f3b9a466e3c (ip 10.222.0.20) !!! Oct 04 18:57:54.594004 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-31c995e4-810f-4dbd-9be2-bb9c395a0191 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:54.594903 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-31c995e4-810f-4dbd-9be2-bb9c395a0191 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:54.595533 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-31c995e4-810f-4dbd-9be2-bb9c395a0191 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:54.596441 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-31c995e4-810f-4dbd-9be2-bb9c395a0191 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:54.597096 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-31c995e4-810f-4dbd-9be2-bb9c395a0191 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:54.597690 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-31c995e4-810f-4dbd-9be2-bb9c395a0191 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:55.155268 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-31c995e4-810f-4dbd-9be2-bb9c395a0191 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce441ded6f554ec28560c75de97af173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc67d8de57543c48bdf45669b684227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:55.163946 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-31c995e4-810f-4dbd-9be2-bb9c395a0191 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/ba710906-86d6-4c04-a708-1f3b9a466e3c" status: 200 len: 1368 microversion: 2.1 time: 0.588045 Oct 04 18:57:55.185747 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2854/5738] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:54 2022] GET /compute/v2.1/servers/ba710906-86d6-4c04-a708-1f3b9a466e3c => generated 1368 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:55.261960 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-d86ca77d-7e0d-4c57-8165-32fadb205fc8 req-655f778c-6b4d-4019-b0cf-912cef47bc7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba710906-86d6-4c04-a708-1f3b9a466e3c", "name": "network-vif-plugged", "status": "completed", "tag": "57e29293-74e1-4d5e-a79e-46e5c51346d1"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:57:55.291279 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-d86ca77d-7e0d-4c57-8165-32fadb205fc8 req-655f778c-6b4d-4019-b0cf-912cef47bc7d service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:55.292087 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-d86ca77d-7e0d-4c57-8165-32fadb205fc8 req-655f778c-6b4d-4019-b0cf-912cef47bc7d service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:55.296327 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-d86ca77d-7e0d-4c57-8165-32fadb205fc8 req-655f778c-6b4d-4019-b0cf-912cef47bc7d service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:55.321224 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-d86ca77d-7e0d-4c57-8165-32fadb205fc8 req-655f778c-6b4d-4019-b0cf-912cef47bc7d service nova] Creating event network-vif-plugged:57e29293-74e1-4d5e-a79e-46e5c51346d1 for instance ba710906-86d6-4c04-a708-1f3b9a466e3c on n-h2-850501-14 Oct 04 18:57:55.337080 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-d86ca77d-7e0d-4c57-8165-32fadb205fc8 req-655f778c-6b4d-4019-b0cf-912cef47bc7d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079048 Oct 04 18:57:55.346553 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2885/5739] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:57:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:57:56.191007 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-eb859f87-0e5d-4cb3-a731-88e682158f00 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:56.192310 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-eb859f87-0e5d-4cb3-a731-88e682158f00 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: ba710906-86d6-4c04-a708-1f3b9a466e3c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:56.237295 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eb859f87-0e5d-4cb3-a731-88e682158f00 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:56.243422 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eb859f87-0e5d-4cb3-a731-88e682158f00 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:56.243422 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eb859f87-0e5d-4cb3-a731-88e682158f00 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:56.243422 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eb859f87-0e5d-4cb3-a731-88e682158f00 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:56.243422 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eb859f87-0e5d-4cb3-a731-88e682158f00 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:56.247116 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eb859f87-0e5d-4cb3-a731-88e682158f00 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:57.165597 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-eb859f87-0e5d-4cb3-a731-88e682158f00 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce441ded6f554ec28560c75de97af173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc67d8de57543c48bdf45669b684227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:57.183207 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-eb859f87-0e5d-4cb3-a731-88e682158f00 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/ba710906-86d6-4c04-a708-1f3b9a466e3c" status: 200 len: 1368 microversion: 2.1 time: 0.997020 Oct 04 18:57:57.202410 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2855/5740] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:56 2022] GET /compute/v2.1/servers/ba710906-86d6-4c04-a708-1f3b9a466e3c => generated 1368 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:58.208623 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6b7704f5-d652-4ab5-89e4-b5f0c3fca89c tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:58.209527 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6b7704f5-d652-4ab5-89e4-b5f0c3fca89c tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: ba710906-86d6-4c04-a708-1f3b9a466e3c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:58.232213 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6b7704f5-d652-4ab5-89e4-b5f0c3fca89c tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:58.232996 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6b7704f5-d652-4ab5-89e4-b5f0c3fca89c tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:58.233600 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6b7704f5-d652-4ab5-89e4-b5f0c3fca89c tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:58.234487 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6b7704f5-d652-4ab5-89e4-b5f0c3fca89c tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:58.235110 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6b7704f5-d652-4ab5-89e4-b5f0c3fca89c tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:58.235717 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6b7704f5-d652-4ab5-89e4-b5f0c3fca89c tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:58.589574 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6b7704f5-d652-4ab5-89e4-b5f0c3fca89c tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce441ded6f554ec28560c75de97af173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc67d8de57543c48bdf45669b684227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:58.631115 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6b7704f5-d652-4ab5-89e4-b5f0c3fca89c tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/ba710906-86d6-4c04-a708-1f3b9a466e3c" status: 200 len: 1558 microversion: 2.1 time: 0.427858 Oct 04 18:57:58.635085 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2886/5741] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:58 2022] GET /compute/v2.1/servers/ba710906-86d6-4c04-a708-1f3b9a466e3c => generated 1558 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:58.659777 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-044c1598-cc34-4695-9589-5670a1272601 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:58.660740 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-044c1598-cc34-4695-9589-5670a1272601 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: ba710906-86d6-4c04-a708-1f3b9a466e3c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:58.665093 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:57:58.672118 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-044c1598-cc34-4695-9589-5670a1272601 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:58.679848 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-044c1598-cc34-4695-9589-5670a1272601 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:58.679848 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-044c1598-cc34-4695-9589-5670a1272601 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:58.679848 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-044c1598-cc34-4695-9589-5670a1272601 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:58.679848 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-044c1598-cc34-4695-9589-5670a1272601 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:58.679848 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-044c1598-cc34-4695-9589-5670a1272601 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:58.862827 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-044c1598-cc34-4695-9589-5670a1272601 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/ba710906-86d6-4c04-a708-1f3b9a466e3c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.207249 Oct 04 18:57:58.872384 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2856/5742] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Oct 4 18:57:58 2022] GET /compute/v2.1/servers/ba710906-86d6-4c04-a708-1f3b9a466e3c/os-interface => generated 284 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:58:01.707323 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-45ee76cf-4d5c-48e8-8cc1-fe001ca2a29b req-734a8628-b924-4b88-9ddf-e0aeb7e6393f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba710906-86d6-4c04-a708-1f3b9a466e3c", "tag": "57e29293-74e1-4d5e-a79e-46e5c51346d1"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:58:01.736188 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-45ee76cf-4d5c-48e8-8cc1-fe001ca2a29b req-734a8628-b924-4b88-9ddf-e0aeb7e6393f service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:01.737399 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-45ee76cf-4d5c-48e8-8cc1-fe001ca2a29b req-734a8628-b924-4b88-9ddf-e0aeb7e6393f service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:01.738064 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-45ee76cf-4d5c-48e8-8cc1-fe001ca2a29b req-734a8628-b924-4b88-9ddf-e0aeb7e6393f service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:01.755533 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-45ee76cf-4d5c-48e8-8cc1-fe001ca2a29b req-734a8628-b924-4b88-9ddf-e0aeb7e6393f service nova] Creating event network-changed:57e29293-74e1-4d5e-a79e-46e5c51346d1 for instance ba710906-86d6-4c04-a708-1f3b9a466e3c on n-h2-850501-14 Oct 04 18:58:01.762646 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-45ee76cf-4d5c-48e8-8cc1-fe001ca2a29b req-734a8628-b924-4b88-9ddf-e0aeb7e6393f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059217 Oct 04 18:58:01.763653 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2887/5743] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:58:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:58:04.215288 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-91e7532f-ddd9-4550-bba2-beb86116271f tempest-QuotasTestJSON-224036951 tempest-QuotasTestJSON-224036951-project] Calling method '.version_select at 0x7fe258c70820>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:04.574627 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-91e7532f-ddd9-4550-bba2-beb86116271f tempest-QuotasTestJSON-224036951 tempest-QuotasTestJSON-224036951-project] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/098ff140e8fc480aa3180733eedb8daf/defaults" status: 200 len: 371 microversion: 2.1 time: 0.595741 Oct 04 18:58:04.583183 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2857/5744] 10.222.0.20 () {58 vars in 1269 bytes} [Tue Oct 4 18:58:03 2022] GET /compute/v2.1/os-quota-sets/098ff140e8fc480aa3180733eedb8daf/defaults => generated 371 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:58:04.591381 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-872a6ec6-10b9-4fd3-bf0e-7ee3f31151dd tempest-QuotasTestJSON-224036951 tempest-QuotasTestJSON-224036951-project] Calling method '.version_select at 0x7fe253b5f790>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:05.177371 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-872a6ec6-10b9-4fd3-bf0e-7ee3f31151dd tempest-QuotasTestJSON-224036951 tempest-QuotasTestJSON-224036951-project] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/098ff140e8fc480aa3180733eedb8daf" status: 200 len: 371 microversion: 2.1 time: 0.590730 Oct 04 18:58:05.178754 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2888/5745] 10.222.0.20 () {58 vars in 1242 bytes} [Tue Oct 4 18:58:04 2022] GET /compute/v2.1/os-quota-sets/098ff140e8fc480aa3180733eedb8daf => generated 371 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:58:05.195645 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1d1f8b7b-80cb-4608-aada-a02c903c8c91 tempest-QuotasTestJSON-224036951 tempest-QuotasTestJSON-224036951-project] Calling method '.version_select at 0x7fe258c70ca0>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:05.635908 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1d1f8b7b-80cb-4608-aada-a02c903c8c91 tempest-QuotasTestJSON-224036951 tempest-QuotasTestJSON-224036951-project] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/098ff140e8fc480aa3180733eedb8daf/defaults" status: 200 len: 371 microversion: 2.1 time: 0.445759 Oct 04 18:58:05.636846 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2858/5746] 10.222.0.20 () {58 vars in 1269 bytes} [Tue Oct 4 18:58:05 2022] GET /compute/v2.1/os-quota-sets/098ff140e8fc480aa3180733eedb8daf/defaults => generated 371 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:58:05.652043 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5f9df979-6fa6-4c31-9495-7f2282b8baf5 tempest-QuotasTestJSON-224036951 tempest-QuotasTestJSON-224036951-project] Calling method '.version_select at 0x7fe258d208b0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:06.257522 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5f9df979-6fa6-4c31-9495-7f2282b8baf5 tempest-QuotasTestJSON-224036951 tempest-QuotasTestJSON-224036951-project] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/098ff140e8fc480aa3180733eedb8daf" status: 200 len: 371 microversion: 2.1 time: 0.610485 Oct 04 18:58:06.265834 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2889/5747] 10.222.0.20 () {58 vars in 1242 bytes} [Tue Oct 4 18:58:05 2022] GET /compute/v2.1/os-quota-sets/098ff140e8fc480aa3180733eedb8daf => generated 371 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:58:06.278168 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-09cd8c4d-a1ba-4668-af9f-6653d744506b tempest-QuotasTestJSON-224036951 tempest-QuotasTestJSON-224036951-project] Calling method '.version_select at 0x7fe258c708b0>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:06.435358 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-09cd8c4d-a1ba-4668-af9f-6653d744506b tempest-QuotasTestJSON-224036951 tempest-QuotasTestJSON-224036951-project] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/098ff140e8fc480aa3180733eedb8daf?user_id=0c516f5c43e042d5b53294e0da84012b" status: 200 len: 371 microversion: 2.1 time: 0.168581 Oct 04 18:58:06.437969 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2859/5748] 10.222.0.20 () {58 vars in 1323 bytes} [Tue Oct 4 18:58:06 2022] GET /compute/v2.1/os-quota-sets/098ff140e8fc480aa3180733eedb8daf?user_id=0c516f5c43e042d5b53294e0da84012b => generated 371 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:58:12.867064 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=17 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:58:13.120758 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-fad4c0d6-0c35-4bd8-86c1-c1c1f90e4aa0 tempest-ComputeTenantNetworksTest-1447352668 tempest-ComputeTenantNetworksTest-1447352668-project] Calling method '.version_select at 0x7fe253ba9430>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:13.576845 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-fad4c0d6-0c35-4bd8-86c1-c1c1f90e4aa0 tempest-ComputeTenantNetworksTest-1447352668 tempest-ComputeTenantNetworksTest-1447352668-project] 10.222.0.20 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 424 microversion: 2.1 time: 0.715936 Oct 04 18:58:13.578089 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2890/5749] 10.222.0.20 () {58 vars in 1158 bytes} [Tue Oct 4 18:58:12 2022] GET /compute/v2.1/os-tenant-networks => generated 424 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:58:13.589483 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2e13312f-8ad0-4264-935f-bcdc0d05e730 tempest-ComputeTenantNetworksTest-1447352668 tempest-ComputeTenantNetworksTest-1447352668-project] Calling method '.version_select at 0x7fe2597f7f70>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:13.600396 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=27 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:58:14.171338 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2e13312f-8ad0-4264-935f-bcdc0d05e730 tempest-ComputeTenantNetworksTest-1447352668 tempest-ComputeTenantNetworksTest-1447352668-project] 10.222.0.20 "GET /compute/v2.1/os-tenant-networks/bcc1368e-9bb7-43b0-8bad-5fcbc7d7d87f" status: 200 len: 140 microversion: 2.1 time: 0.586010 Oct 04 18:58:14.178047 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2860/5750] 10.222.0.20 () {58 vars in 1269 bytes} [Tue Oct 4 18:58:13 2022] GET /compute/v2.1/os-tenant-networks/bcc1368e-9bb7-43b0-8bad-5fcbc7d7d87f => generated 140 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:58:30.823185 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=4 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:58:30.824039 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=15 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:58:31.067695 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2f429eb6-9e9d-4954-86a3-dd8c778fd56c tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Action: 'create', calling method: .version_select at 0x7fe253f52160>, body: {"keypair": {"name": "tempest-keypair-574112895", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPNYYbFs/QlwPeZIJRZrceGwzd5NzT4p1anLhcfkmz3npENfMZWIaJvbCWMg9aYJJ2dVqpFvGeq9pc8MZXmcPYvMELXxT8eSzXou0bvfpRLCOayvjDNsibb08TDV8al6UA=="}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:58:31.119640 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-2f429eb6-9e9d-4954-86a3-dd8c778fd56c tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Getting quotas for project b56fe9a8df63477b883f958825dbeafa. Resources: {'key_pairs'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:58:31.147918 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-2f429eb6-9e9d-4954-86a3-dd8c778fd56c tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Getting quotas for user 46676c950dc043bda9b06a2bf8af3085 and project b56fe9a8df63477b883f958825dbeafa. Resources: {'key_pairs'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:58:31.320302 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2f429eb6-9e9d-4954-86a3-dd8c778fd56c tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.500874 Oct 04 18:58:31.323428 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2891/5751] 10.222.0.20 () {62 vars in 1200 bytes} [Tue Oct 4 18:58:30 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 503 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 18:58:40.204801 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=4 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:58:40.205576 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=11 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:58:40.215264 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6814c02d-532f-4d52-86f1-611053d73c86 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-992660396", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7a4ee582-93c3-413b-9115-b740d642f425"}], "security_groups": [{"name": "tempest-securitygroup--62182616"}], "key_name": "tempest-keypair-574112895", "user_data": "}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:58:40.671554 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-6814c02d-532f-4d52-86f1-611053d73c86 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] validate_networks() for [('7a4ee582-93c3-413b-9115-b740d642f425', None, None, None, None, None)] {{(pid=123002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:58:42.330940 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-6814c02d-532f-4d52-86f1-611053d73c86 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:58:42.338483 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-6814c02d-532f-4d52-86f1-611053d73c86 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:58:42.338483 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-6814c02d-532f-4d52-86f1-611053d73c86 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:58:42.338483 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-6814c02d-532f-4d52-86f1-611053d73c86 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:58:42.338483 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-6814c02d-532f-4d52-86f1-611053d73c86 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:58:42.371022 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6814c02d-532f-4d52-86f1-611053d73c86 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:42.371729 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6814c02d-532f-4d52-86f1-611053d73c86 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:42.372223 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6814c02d-532f-4d52-86f1-611053d73c86 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:42.373913 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6814c02d-532f-4d52-86f1-611053d73c86 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:42.374412 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6814c02d-532f-4d52-86f1-611053d73c86 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:42.375129 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6814c02d-532f-4d52-86f1-611053d73c86 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:42.405416 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-6814c02d-532f-4d52-86f1-611053d73c86 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Getting quotas for project b56fe9a8df63477b883f958825dbeafa. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:58:42.414809 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-6814c02d-532f-4d52-86f1-611053d73c86 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Getting quotas for user 46676c950dc043bda9b06a2bf8af3085 and project b56fe9a8df63477b883f958825dbeafa. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:58:42.432377 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-6814c02d-532f-4d52-86f1-611053d73c86 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Going to run 1 instances... {{(pid=123002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:58:42.435593 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-6814c02d-532f-4d52-86f1-611053d73c86 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:58:42.709210 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6814c02d-532f-4d52-86f1-611053d73c86 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 2.506159 Oct 04 18:58:42.736168 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2861/5752] 10.222.0.20 () {62 vars in 1188 bytes} [Tue Oct 4 18:58:40 2022] POST /compute/v2.1/servers => generated 400 bytes in 2534 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 18:58:42.747406 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-088d5a2f-aafb-40b9-95fc-be2a9d924990 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:42.748201 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-088d5a2f-aafb-40b9-95fc-be2a9d924990 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:42.764933 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=4 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:58:42.765590 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:58:42.916532 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-088d5a2f-aafb-40b9-95fc-be2a9d924990 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:42.936741 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-088d5a2f-aafb-40b9-95fc-be2a9d924990 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:42.943050 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-088d5a2f-aafb-40b9-95fc-be2a9d924990 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:42.954106 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-088d5a2f-aafb-40b9-95fc-be2a9d924990 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18" status: 200 len: 1280 microversion: 2.20 time: 0.202114 Oct 04 18:58:42.955360 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2892/5753] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:58:42 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 => generated 1280 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:58:43.981195 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2dad7170-e136-4aaf-88cd-30ab5a977153 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:43.981965 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2dad7170-e136-4aaf-88cd-30ab5a977153 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:44.292130 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2dad7170-e136-4aaf-88cd-30ab5a977153 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:44.304264 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2dad7170-e136-4aaf-88cd-30ab5a977153 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:44.310814 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2dad7170-e136-4aaf-88cd-30ab5a977153 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:44.313714 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2dad7170-e136-4aaf-88cd-30ab5a977153 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18" status: 200 len: 1280 microversion: 2.20 time: 0.336867 Oct 04 18:58:44.340793 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2862/5754] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:58:43 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 => generated 1280 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:58:45.343228 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-03b483fb-f3dc-45e3-a9a5-2a0af6aab0b9 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:45.343838 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-03b483fb-f3dc-45e3-a9a5-2a0af6aab0b9 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:45.352277 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-03b483fb-f3dc-45e3-a9a5-2a0af6aab0b9 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:45.352784 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-03b483fb-f3dc-45e3-a9a5-2a0af6aab0b9 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:45.355652 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-03b483fb-f3dc-45e3-a9a5-2a0af6aab0b9 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:45.355652 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-03b483fb-f3dc-45e3-a9a5-2a0af6aab0b9 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:45.355652 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-03b483fb-f3dc-45e3-a9a5-2a0af6aab0b9 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:45.355652 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-03b483fb-f3dc-45e3-a9a5-2a0af6aab0b9 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:45.543598 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-03b483fb-f3dc-45e3-a9a5-2a0af6aab0b9 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:45.559180 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-03b483fb-f3dc-45e3-a9a5-2a0af6aab0b9 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:45.563147 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-03b483fb-f3dc-45e3-a9a5-2a0af6aab0b9 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:45.569698 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-03b483fb-f3dc-45e3-a9a5-2a0af6aab0b9 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18" status: 200 len: 1284 microversion: 2.20 time: 0.228141 Oct 04 18:58:45.572030 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2893/5755] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:58:45 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 => generated 1284 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:58:45.637840 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0ff769cb-d37d-4cef-9d2a-0eeb2c26913a tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-485829204", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": [{"uuid": "b1de81af-4066-4f05-a180-554d7db3864c"}]}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:58:45.764757 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-0ff769cb-d37d-4cef-9d2a-0eeb2c26913a tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] validate_networks() for [('b1de81af-4066-4f05-a180-554d7db3864c', None, None, None, None, None)] {{(pid=123002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:58:46.602800 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5f0362eb-1ff6-4087-986c-37fa8b1bbe8d tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:46.603415 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5f0362eb-1ff6-4087-986c-37fa8b1bbe8d tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:46.621927 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5f0362eb-1ff6-4087-986c-37fa8b1bbe8d tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:46.628994 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5f0362eb-1ff6-4087-986c-37fa8b1bbe8d tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:46.629450 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5f0362eb-1ff6-4087-986c-37fa8b1bbe8d tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:46.630179 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5f0362eb-1ff6-4087-986c-37fa8b1bbe8d tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:46.630638 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5f0362eb-1ff6-4087-986c-37fa8b1bbe8d tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:46.633689 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5f0362eb-1ff6-4087-986c-37fa8b1bbe8d tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:46.782505 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-0ff769cb-d37d-4cef-9d2a-0eeb2c26913a tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:58:46.784579 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-0ff769cb-d37d-4cef-9d2a-0eeb2c26913a tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:58:46.786280 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-0ff769cb-d37d-4cef-9d2a-0eeb2c26913a tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:58:46.794102 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-0ff769cb-d37d-4cef-9d2a-0eeb2c26913a tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:58:46.794102 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-0ff769cb-d37d-4cef-9d2a-0eeb2c26913a tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:58:46.805344 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0ff769cb-d37d-4cef-9d2a-0eeb2c26913a tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:46.806170 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0ff769cb-d37d-4cef-9d2a-0eeb2c26913a tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:46.806807 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0ff769cb-d37d-4cef-9d2a-0eeb2c26913a tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:46.808491 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0ff769cb-d37d-4cef-9d2a-0eeb2c26913a tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:46.809170 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0ff769cb-d37d-4cef-9d2a-0eeb2c26913a tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:46.809991 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0ff769cb-d37d-4cef-9d2a-0eeb2c26913a tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:46.852825 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-0ff769cb-d37d-4cef-9d2a-0eeb2c26913a tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Getting quotas for project 7a6844b3a51e4c2da1294e89517989c4. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:58:46.858900 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-0ff769cb-d37d-4cef-9d2a-0eeb2c26913a tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Getting quotas for user 49a7fac7323441708be3f27945a92fb5 and project 7a6844b3a51e4c2da1294e89517989c4. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:58:46.862741 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5f0362eb-1ff6-4087-986c-37fa8b1bbe8d tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:46.875923 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0ff769cb-d37d-4cef-9d2a-0eeb2c26913a tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Going to run 1 instances... {{(pid=123002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:58:46.878466 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0ff769cb-d37d-4cef-9d2a-0eeb2c26913a tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] [instance: 3edcc394-83d7-4358-8f99-af546b861685] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:58:46.887044 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5f0362eb-1ff6-4087-986c-37fa8b1bbe8d tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:46.889318 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5f0362eb-1ff6-4087-986c-37fa8b1bbe8d tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:46.894373 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5f0362eb-1ff6-4087-986c-37fa8b1bbe8d tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18" status: 200 len: 1340 microversion: 2.20 time: 0.302000 Oct 04 18:58:46.915434 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2894/5756] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:58:46 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 => generated 1340 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:58:47.102976 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0ff769cb-d37d-4cef-9d2a-0eeb2c26913a tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.471616 Oct 04 18:58:47.103655 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2863/5757] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:58:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1473 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:58:47.116577 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d413dd28-591e-4ddd-8c65-8b5ca388c4a8 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:47.118060 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d413dd28-591e-4ddd-8c65-8b5ca388c4a8 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] [instance: 3edcc394-83d7-4358-8f99-af546b861685] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:47.346877 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d413dd28-591e-4ddd-8c65-8b5ca388c4a8 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7fac7323441708be3f27945a92fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6844b3a51e4c2da1294e89517989c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:47.367638 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d413dd28-591e-4ddd-8c65-8b5ca388c4a8 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] 10.222.0.20 "GET /compute/v2.1/servers/3edcc394-83d7-4358-8f99-af546b861685" status: 200 len: 1218 microversion: 2.1 time: 0.254970 Oct 04 18:58:47.368945 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2895/5758] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:47 2022] GET /compute/v2.1/servers/3edcc394-83d7-4358-8f99-af546b861685 => generated 1218 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:47.937241 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-227c7680-20ac-4019-aeb0-3373ef5a4775 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:47.939746 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-227c7680-20ac-4019-aeb0-3373ef5a4775 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:47.960667 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-227c7680-20ac-4019-aeb0-3373ef5a4775 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:47.962228 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-227c7680-20ac-4019-aeb0-3373ef5a4775 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:47.965065 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-227c7680-20ac-4019-aeb0-3373ef5a4775 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:47.966220 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-227c7680-20ac-4019-aeb0-3373ef5a4775 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:47.966914 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-227c7680-20ac-4019-aeb0-3373ef5a4775 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:47.967851 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-227c7680-20ac-4019-aeb0-3373ef5a4775 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:48.391227 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d331d3b7-91a2-45e7-8b8e-94cfbfef6bcf tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:48.392019 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d331d3b7-91a2-45e7-8b8e-94cfbfef6bcf tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] [instance: 3edcc394-83d7-4358-8f99-af546b861685] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:48.539354 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-227c7680-20ac-4019-aeb0-3373ef5a4775 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:48.547750 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-227c7680-20ac-4019-aeb0-3373ef5a4775 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:48.549475 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-227c7680-20ac-4019-aeb0-3373ef5a4775 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:48.550790 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-227c7680-20ac-4019-aeb0-3373ef5a4775 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18" status: 200 len: 1338 microversion: 2.20 time: 0.628016 Oct 04 18:58:48.564464 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2864/5759] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:58:47 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 => generated 1338 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:58:48.614376 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d331d3b7-91a2-45e7-8b8e-94cfbfef6bcf tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7fac7323441708be3f27945a92fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6844b3a51e4c2da1294e89517989c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:48.628240 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d331d3b7-91a2-45e7-8b8e-94cfbfef6bcf tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] 10.222.0.20 "GET /compute/v2.1/servers/3edcc394-83d7-4358-8f99-af546b861685" status: 200 len: 1218 microversion: 2.1 time: 0.239601 Oct 04 18:58:48.631061 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2896/5760] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:48 2022] GET /compute/v2.1/servers/3edcc394-83d7-4358-8f99-af546b861685 => generated 1218 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:58:49.578835 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-aed5d05d-3f56-4ae5-a3f7-1f703f3a70e8 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:49.580273 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-aed5d05d-3f56-4ae5-a3f7-1f703f3a70e8 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:49.594704 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aed5d05d-3f56-4ae5-a3f7-1f703f3a70e8 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:49.595554 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aed5d05d-3f56-4ae5-a3f7-1f703f3a70e8 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:49.596303 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aed5d05d-3f56-4ae5-a3f7-1f703f3a70e8 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:49.597254 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aed5d05d-3f56-4ae5-a3f7-1f703f3a70e8 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:49.597939 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aed5d05d-3f56-4ae5-a3f7-1f703f3a70e8 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:49.601267 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aed5d05d-3f56-4ae5-a3f7-1f703f3a70e8 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:49.657652 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-040a3368-3edf-453b-9329-fe2181bc70b5 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:49.658284 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-040a3368-3edf-453b-9329-fe2181bc70b5 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] [instance: 3edcc394-83d7-4358-8f99-af546b861685] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:49.665924 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-040a3368-3edf-453b-9329-fe2181bc70b5 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:49.666690 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-040a3368-3edf-453b-9329-fe2181bc70b5 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:49.667285 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-040a3368-3edf-453b-9329-fe2181bc70b5 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:49.668193 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-040a3368-3edf-453b-9329-fe2181bc70b5 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:49.668820 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-040a3368-3edf-453b-9329-fe2181bc70b5 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:49.669890 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-040a3368-3edf-453b-9329-fe2181bc70b5 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:49.815646 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-040a3368-3edf-453b-9329-fe2181bc70b5 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7fac7323441708be3f27945a92fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6844b3a51e4c2da1294e89517989c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:49.825429 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-040a3368-3edf-453b-9329-fe2181bc70b5 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] 10.222.0.20 "GET /compute/v2.1/servers/3edcc394-83d7-4358-8f99-af546b861685" status: 200 len: 1270 microversion: 2.1 time: 0.171490 Oct 04 18:58:49.826342 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2897/5761] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:49 2022] GET /compute/v2.1/servers/3edcc394-83d7-4358-8f99-af546b861685 => generated 1270 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:50.202260 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-aed5d05d-3f56-4ae5-a3f7-1f703f3a70e8 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:50.213915 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-aed5d05d-3f56-4ae5-a3f7-1f703f3a70e8 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:50.215370 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-aed5d05d-3f56-4ae5-a3f7-1f703f3a70e8 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:50.216540 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-aed5d05d-3f56-4ae5-a3f7-1f703f3a70e8 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18" status: 200 len: 1404 microversion: 2.20 time: 0.641696 Oct 04 18:58:50.228879 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2865/5762] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:58:49 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 => generated 1404 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:58:50.850790 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7c233134-7ed4-48c2-b841-096ea9e5d75d tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:50.853273 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7c233134-7ed4-48c2-b841-096ea9e5d75d tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] [instance: 3edcc394-83d7-4358-8f99-af546b861685] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:50.872939 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7c233134-7ed4-48c2-b841-096ea9e5d75d tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:50.873824 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7c233134-7ed4-48c2-b841-096ea9e5d75d tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:50.879205 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7c233134-7ed4-48c2-b841-096ea9e5d75d tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:50.879205 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7c233134-7ed4-48c2-b841-096ea9e5d75d tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:50.879205 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7c233134-7ed4-48c2-b841-096ea9e5d75d tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:50.879205 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7c233134-7ed4-48c2-b841-096ea9e5d75d tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:51.092780 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7c233134-7ed4-48c2-b841-096ea9e5d75d tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7fac7323441708be3f27945a92fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6844b3a51e4c2da1294e89517989c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:51.104497 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7c233134-7ed4-48c2-b841-096ea9e5d75d tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] 10.222.0.20 "GET /compute/v2.1/servers/3edcc394-83d7-4358-8f99-af546b861685" status: 200 len: 1276 microversion: 2.1 time: 0.258097 Oct 04 18:58:51.106018 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2898/5763] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:50 2022] GET /compute/v2.1/servers/3edcc394-83d7-4358-8f99-af546b861685 => generated 1276 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:51.247659 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-efb8e992-43a3-4763-8f0b-54907defa34a tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:51.259773 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-efb8e992-43a3-4763-8f0b-54907defa34a tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:51.273800 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-efb8e992-43a3-4763-8f0b-54907defa34a tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:51.274311 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-efb8e992-43a3-4763-8f0b-54907defa34a tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:51.274753 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-efb8e992-43a3-4763-8f0b-54907defa34a tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:51.275473 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-efb8e992-43a3-4763-8f0b-54907defa34a tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:51.275923 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-efb8e992-43a3-4763-8f0b-54907defa34a tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:51.278619 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-efb8e992-43a3-4763-8f0b-54907defa34a tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:51.811476 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-efb8e992-43a3-4763-8f0b-54907defa34a tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:51.825398 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-efb8e992-43a3-4763-8f0b-54907defa34a tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:51.827783 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-efb8e992-43a3-4763-8f0b-54907defa34a tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:51.833800 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-efb8e992-43a3-4763-8f0b-54907defa34a tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18" status: 200 len: 1404 microversion: 2.20 time: 0.585686 Oct 04 18:58:51.833800 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2866/5764] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:58:51 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 => generated 1404 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:58:52.135385 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0e9826a3-9211-458f-a93d-5e22be3fca53 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:52.136007 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0e9826a3-9211-458f-a93d-5e22be3fca53 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] [instance: 3edcc394-83d7-4358-8f99-af546b861685] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:52.151407 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0e9826a3-9211-458f-a93d-5e22be3fca53 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:52.151912 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0e9826a3-9211-458f-a93d-5e22be3fca53 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:52.152392 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0e9826a3-9211-458f-a93d-5e22be3fca53 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:52.153106 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0e9826a3-9211-458f-a93d-5e22be3fca53 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:52.157522 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0e9826a3-9211-458f-a93d-5e22be3fca53 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:52.158711 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0e9826a3-9211-458f-a93d-5e22be3fca53 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:52.733005 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0e9826a3-9211-458f-a93d-5e22be3fca53 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7fac7323441708be3f27945a92fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6844b3a51e4c2da1294e89517989c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:52.742530 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0e9826a3-9211-458f-a93d-5e22be3fca53 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] 10.222.0.20 "GET /compute/v2.1/servers/3edcc394-83d7-4358-8f99-af546b861685" status: 200 len: 1318 microversion: 2.1 time: 0.614545 Oct 04 18:58:52.755088 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2899/5765] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:52 2022] GET /compute/v2.1/servers/3edcc394-83d7-4358-8f99-af546b861685 => generated 1318 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:52.859445 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-21ae8ac6-b8ff-4e1b-a276-cef96d8fdac0 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:52.860793 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-21ae8ac6-b8ff-4e1b-a276-cef96d8fdac0 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:52.869735 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-21ae8ac6-b8ff-4e1b-a276-cef96d8fdac0 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:52.870475 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-21ae8ac6-b8ff-4e1b-a276-cef96d8fdac0 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:52.871224 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-21ae8ac6-b8ff-4e1b-a276-cef96d8fdac0 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:52.872256 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-21ae8ac6-b8ff-4e1b-a276-cef96d8fdac0 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:52.872885 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-21ae8ac6-b8ff-4e1b-a276-cef96d8fdac0 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:52.873489 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-21ae8ac6-b8ff-4e1b-a276-cef96d8fdac0 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:52.911709 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-c9e92633-da57-490d-ab42-ebfa7d6afbc8 req-78ac4ee8-7001-4942-a699-efdc970f3df2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b882133-2fca-4df4-b228-46a12f538c18", "tag": "1f37fede-c1b1-491b-bab1-5ad8cb57086e"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:58:52.945093 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-c9e92633-da57-490d-ab42-ebfa7d6afbc8 req-78ac4ee8-7001-4942-a699-efdc970f3df2 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:52.951506 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-c9e92633-da57-490d-ab42-ebfa7d6afbc8 req-78ac4ee8-7001-4942-a699-efdc970f3df2 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:52.952504 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-c9e92633-da57-490d-ab42-ebfa7d6afbc8 req-78ac4ee8-7001-4942-a699-efdc970f3df2 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:52.988291 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-c9e92633-da57-490d-ab42-ebfa7d6afbc8 req-78ac4ee8-7001-4942-a699-efdc970f3df2 service nova] Creating event network-changed:1f37fede-c1b1-491b-bab1-5ad8cb57086e for instance 7b882133-2fca-4df4-b228-46a12f538c18 on n-h1-850501-14 Oct 04 18:58:52.988291 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-c9e92633-da57-490d-ab42-ebfa7d6afbc8 req-78ac4ee8-7001-4942-a699-efdc970f3df2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081078 Oct 04 18:58:52.988291 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2900/5766] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:58:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:58:53.296143 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-65d3e859-dbef-4bc5-b65f-5a437391076c req-9b139d2c-69e3-45d0-bc1e-389dda18781a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3edcc394-83d7-4358-8f99-af546b861685", "tag": "236e4f54-124f-4ab5-a66c-bfe8436a720b"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:58:53.308552 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-65d3e859-dbef-4bc5-b65f-5a437391076c req-9b139d2c-69e3-45d0-bc1e-389dda18781a service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:53.309088 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-65d3e859-dbef-4bc5-b65f-5a437391076c req-9b139d2c-69e3-45d0-bc1e-389dda18781a service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:53.309568 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-65d3e859-dbef-4bc5-b65f-5a437391076c req-9b139d2c-69e3-45d0-bc1e-389dda18781a service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:53.327794 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-65d3e859-dbef-4bc5-b65f-5a437391076c req-9b139d2c-69e3-45d0-bc1e-389dda18781a service nova] Creating event network-changed:236e4f54-124f-4ab5-a66c-bfe8436a720b for instance 3edcc394-83d7-4358-8f99-af546b861685 on n-h2-850501-14 Oct 04 18:58:53.333751 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-65d3e859-dbef-4bc5-b65f-5a437391076c req-9b139d2c-69e3-45d0-bc1e-389dda18781a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.346557 Oct 04 18:58:53.337329 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2901/5767] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:58:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:58:53.785190 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-47b28d99-ad0d-4d6e-a511-18d80ac48bea tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:53.785966 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-47b28d99-ad0d-4d6e-a511-18d80ac48bea tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] [instance: 3edcc394-83d7-4358-8f99-af546b861685] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:53.802364 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-47b28d99-ad0d-4d6e-a511-18d80ac48bea tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:53.803730 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-47b28d99-ad0d-4d6e-a511-18d80ac48bea tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:53.804760 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-47b28d99-ad0d-4d6e-a511-18d80ac48bea tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:53.806753 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-47b28d99-ad0d-4d6e-a511-18d80ac48bea tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:53.809303 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-47b28d99-ad0d-4d6e-a511-18d80ac48bea tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:53.810328 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-47b28d99-ad0d-4d6e-a511-18d80ac48bea tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:53.954704 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-21ae8ac6-b8ff-4e1b-a276-cef96d8fdac0 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:53.968784 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-21ae8ac6-b8ff-4e1b-a276-cef96d8fdac0 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:53.970937 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-21ae8ac6-b8ff-4e1b-a276-cef96d8fdac0 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:53.972136 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-21ae8ac6-b8ff-4e1b-a276-cef96d8fdac0 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18" status: 200 len: 1404 microversion: 2.20 time: 1.116661 Oct 04 18:58:53.972718 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2867/5768] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:58:52 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 => generated 1404 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:58:54.534321 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-47b28d99-ad0d-4d6e-a511-18d80ac48bea tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7fac7323441708be3f27945a92fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6844b3a51e4c2da1294e89517989c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:54.541036 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-47b28d99-ad0d-4d6e-a511-18d80ac48bea tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] 10.222.0.20 "GET /compute/v2.1/servers/3edcc394-83d7-4358-8f99-af546b861685" status: 200 len: 1318 microversion: 2.1 time: 0.762909 Oct 04 18:58:54.562781 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2902/5769] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:53 2022] GET /compute/v2.1/servers/3edcc394-83d7-4358-8f99-af546b861685 => generated 1318 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:55.001713 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-16acf263-1e33-461e-8227-1f5954614fe0 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:55.003806 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-16acf263-1e33-461e-8227-1f5954614fe0 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:55.015061 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-16acf263-1e33-461e-8227-1f5954614fe0 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:55.015569 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-16acf263-1e33-461e-8227-1f5954614fe0 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:55.016228 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-16acf263-1e33-461e-8227-1f5954614fe0 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:55.016971 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-16acf263-1e33-461e-8227-1f5954614fe0 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:55.017535 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-16acf263-1e33-461e-8227-1f5954614fe0 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:55.020655 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-16acf263-1e33-461e-8227-1f5954614fe0 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:55.569488 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0d4fd61e-006b-4346-b75f-8d11e2187a3c tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:55.570359 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0d4fd61e-006b-4346-b75f-8d11e2187a3c tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] [instance: 3edcc394-83d7-4358-8f99-af546b861685] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:55.583902 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0d4fd61e-006b-4346-b75f-8d11e2187a3c tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:55.589337 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0d4fd61e-006b-4346-b75f-8d11e2187a3c tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:55.590203 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0d4fd61e-006b-4346-b75f-8d11e2187a3c tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:55.591294 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0d4fd61e-006b-4346-b75f-8d11e2187a3c tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:55.591962 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0d4fd61e-006b-4346-b75f-8d11e2187a3c tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:55.593741 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0d4fd61e-006b-4346-b75f-8d11e2187a3c tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:55.737254 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-16acf263-1e33-461e-8227-1f5954614fe0 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:55.739144 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-16acf263-1e33-461e-8227-1f5954614fe0 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:55.744159 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-16acf263-1e33-461e-8227-1f5954614fe0 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:55.745593 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-16acf263-1e33-461e-8227-1f5954614fe0 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18" status: 200 len: 1404 microversion: 2.20 time: 0.750672 Oct 04 18:58:55.746716 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2868/5770] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:58:54 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 => generated 1404 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:58:56.054836 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0d4fd61e-006b-4346-b75f-8d11e2187a3c tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7fac7323441708be3f27945a92fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6844b3a51e4c2da1294e89517989c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:56.071875 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0d4fd61e-006b-4346-b75f-8d11e2187a3c tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] 10.222.0.20 "GET /compute/v2.1/servers/3edcc394-83d7-4358-8f99-af546b861685" status: 200 len: 1318 microversion: 2.1 time: 0.507339 Oct 04 18:58:56.074515 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2903/5771] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:55 2022] GET /compute/v2.1/servers/3edcc394-83d7-4358-8f99-af546b861685 => generated 1318 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:56.777588 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-903dfe87-633a-4d18-baf8-b113e5514860 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:56.778905 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-903dfe87-633a-4d18-baf8-b113e5514860 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:56.786939 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-903dfe87-633a-4d18-baf8-b113e5514860 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:56.794711 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-903dfe87-633a-4d18-baf8-b113e5514860 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:56.795464 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-903dfe87-633a-4d18-baf8-b113e5514860 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:56.796479 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-903dfe87-633a-4d18-baf8-b113e5514860 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:56.797177 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-903dfe87-633a-4d18-baf8-b113e5514860 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:56.799018 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-903dfe87-633a-4d18-baf8-b113e5514860 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:56.841400 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=4 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:58:56.871037 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=14 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:58:57.098926 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6291ae2c-1ab4-474d-8e58-ff4fd9684ebd tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:57.099618 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6291ae2c-1ab4-474d-8e58-ff4fd9684ebd tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] [instance: 3edcc394-83d7-4358-8f99-af546b861685] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:57.111565 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6291ae2c-1ab4-474d-8e58-ff4fd9684ebd tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:57.113663 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6291ae2c-1ab4-474d-8e58-ff4fd9684ebd tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:57.114195 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6291ae2c-1ab4-474d-8e58-ff4fd9684ebd tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:57.118896 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6291ae2c-1ab4-474d-8e58-ff4fd9684ebd tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:57.118896 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6291ae2c-1ab4-474d-8e58-ff4fd9684ebd tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:57.118896 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6291ae2c-1ab4-474d-8e58-ff4fd9684ebd tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:57.124986 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-903dfe87-633a-4d18-baf8-b113e5514860 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:57.137715 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-903dfe87-633a-4d18-baf8-b113e5514860 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:57.139495 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-903dfe87-633a-4d18-baf8-b113e5514860 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:57.145459 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-903dfe87-633a-4d18-baf8-b113e5514860 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18" status: 200 len: 1404 microversion: 2.20 time: 0.374290 Oct 04 18:58:57.147573 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2869/5772] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:58:56 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 => generated 1404 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:58:57.415324 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6291ae2c-1ab4-474d-8e58-ff4fd9684ebd tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7fac7323441708be3f27945a92fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6844b3a51e4c2da1294e89517989c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:57.426881 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6291ae2c-1ab4-474d-8e58-ff4fd9684ebd tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] 10.222.0.20 "GET /compute/v2.1/servers/3edcc394-83d7-4358-8f99-af546b861685" status: 200 len: 1318 microversion: 2.1 time: 0.332047 Oct 04 18:58:57.427477 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2904/5773] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:57 2022] GET /compute/v2.1/servers/3edcc394-83d7-4358-8f99-af546b861685 => generated 1318 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:58:58.174465 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-25496187-0a25-4a43-9b0c-c26b029c25f0 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:58.176073 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-25496187-0a25-4a43-9b0c-c26b029c25f0 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:58.196968 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-25496187-0a25-4a43-9b0c-c26b029c25f0 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:58.197875 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-25496187-0a25-4a43-9b0c-c26b029c25f0 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:58.198529 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-25496187-0a25-4a43-9b0c-c26b029c25f0 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:58.199508 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-25496187-0a25-4a43-9b0c-c26b029c25f0 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:58.200220 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-25496187-0a25-4a43-9b0c-c26b029c25f0 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:58.200891 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-25496187-0a25-4a43-9b0c-c26b029c25f0 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:58.455056 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8897cd1d-2289-4491-b9bd-ce9ccbcbc38a tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:58.455858 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8897cd1d-2289-4491-b9bd-ce9ccbcbc38a tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] [instance: 3edcc394-83d7-4358-8f99-af546b861685] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:58.478904 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8897cd1d-2289-4491-b9bd-ce9ccbcbc38a tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:58.480539 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8897cd1d-2289-4491-b9bd-ce9ccbcbc38a tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:58.483658 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8897cd1d-2289-4491-b9bd-ce9ccbcbc38a tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:58.494963 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8897cd1d-2289-4491-b9bd-ce9ccbcbc38a tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:58.498420 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8897cd1d-2289-4491-b9bd-ce9ccbcbc38a tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:58.499573 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8897cd1d-2289-4491-b9bd-ce9ccbcbc38a tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:58.623323 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=6 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:58:59.244195 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8897cd1d-2289-4491-b9bd-ce9ccbcbc38a tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7fac7323441708be3f27945a92fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6844b3a51e4c2da1294e89517989c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:59.245327 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-25496187-0a25-4a43-9b0c-c26b029c25f0 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:59.271415 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8897cd1d-2289-4491-b9bd-ce9ccbcbc38a tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] 10.222.0.20 "GET /compute/v2.1/servers/3edcc394-83d7-4358-8f99-af546b861685" status: 200 len: 1318 microversion: 2.1 time: 0.818038 Oct 04 18:58:59.272926 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-25496187-0a25-4a43-9b0c-c26b029c25f0 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:59.273705 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2905/5774] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:58:58 2022] GET /compute/v2.1/servers/3edcc394-83d7-4358-8f99-af546b861685 => generated 1318 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:58:59.275368 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-25496187-0a25-4a43-9b0c-c26b029c25f0 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:58:59.276599 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-25496187-0a25-4a43-9b0c-c26b029c25f0 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18" status: 200 len: 1404 microversion: 2.20 time: 1.106669 Oct 04 18:58:59.277276 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2870/5775] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:58:58 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 => generated 1404 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:59:00.299250 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a8b5c09c-fd63-4397-b8d8-1ffcc8c83983 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:00.300525 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a8b5c09c-fd63-4397-b8d8-1ffcc8c83983 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] [instance: 3edcc394-83d7-4358-8f99-af546b861685] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:00.319985 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e40b6465-40fc-4944-bccf-1dc12a719244 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:00.319985 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e40b6465-40fc-4944-bccf-1dc12a719244 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:00.346627 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a8b5c09c-fd63-4397-b8d8-1ffcc8c83983 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:00.350197 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e40b6465-40fc-4944-bccf-1dc12a719244 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:00.351107 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e40b6465-40fc-4944-bccf-1dc12a719244 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:00.351795 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e40b6465-40fc-4944-bccf-1dc12a719244 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:00.352559 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a8b5c09c-fd63-4397-b8d8-1ffcc8c83983 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:00.353053 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e40b6465-40fc-4944-bccf-1dc12a719244 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:00.353192 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a8b5c09c-fd63-4397-b8d8-1ffcc8c83983 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:00.353879 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a8b5c09c-fd63-4397-b8d8-1ffcc8c83983 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:00.354120 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e40b6465-40fc-4944-bccf-1dc12a719244 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:00.354360 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a8b5c09c-fd63-4397-b8d8-1ffcc8c83983 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:00.354838 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a8b5c09c-fd63-4397-b8d8-1ffcc8c83983 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:00.355254 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e40b6465-40fc-4944-bccf-1dc12a719244 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:01.058768 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a8b5c09c-fd63-4397-b8d8-1ffcc8c83983 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7fac7323441708be3f27945a92fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6844b3a51e4c2da1294e89517989c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:01.073173 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a8b5c09c-fd63-4397-b8d8-1ffcc8c83983 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] 10.222.0.20 "GET /compute/v2.1/servers/3edcc394-83d7-4358-8f99-af546b861685" status: 200 len: 1318 microversion: 2.1 time: 0.777896 Oct 04 18:59:01.074076 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2906/5776] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:00 2022] GET /compute/v2.1/servers/3edcc394-83d7-4358-8f99-af546b861685 => generated 1318 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:01.123120 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e40b6465-40fc-4944-bccf-1dc12a719244 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:01.147653 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e40b6465-40fc-4944-bccf-1dc12a719244 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:01.151631 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e40b6465-40fc-4944-bccf-1dc12a719244 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:01.169272 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e40b6465-40fc-4944-bccf-1dc12a719244 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18" status: 200 len: 1404 microversion: 2.20 time: 0.857071 Oct 04 18:59:01.184257 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2871/5777] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:59:00 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 => generated 1404 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:59:02.104221 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-fda8eb21-2091-410c-a0b3-038d3fc6e714 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:02.105129 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-fda8eb21-2091-410c-a0b3-038d3fc6e714 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] [instance: 3edcc394-83d7-4358-8f99-af546b861685] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:02.119448 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fda8eb21-2091-410c-a0b3-038d3fc6e714 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:02.120446 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fda8eb21-2091-410c-a0b3-038d3fc6e714 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:02.121114 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fda8eb21-2091-410c-a0b3-038d3fc6e714 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:02.122812 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fda8eb21-2091-410c-a0b3-038d3fc6e714 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:02.126040 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fda8eb21-2091-410c-a0b3-038d3fc6e714 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:02.126808 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fda8eb21-2091-410c-a0b3-038d3fc6e714 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:02.216673 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-db1bf10b-1d24-42c8-92fd-ace705a45005 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:02.218830 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-db1bf10b-1d24-42c8-92fd-ace705a45005 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:02.230520 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-db1bf10b-1d24-42c8-92fd-ace705a45005 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:02.233537 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-db1bf10b-1d24-42c8-92fd-ace705a45005 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:02.236292 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-db1bf10b-1d24-42c8-92fd-ace705a45005 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:02.237302 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-db1bf10b-1d24-42c8-92fd-ace705a45005 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:02.238664 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-db1bf10b-1d24-42c8-92fd-ace705a45005 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:02.241595 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-db1bf10b-1d24-42c8-92fd-ace705a45005 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:02.764316 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-db1bf10b-1d24-42c8-92fd-ace705a45005 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:02.782000 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-db1bf10b-1d24-42c8-92fd-ace705a45005 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:02.789394 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-db1bf10b-1d24-42c8-92fd-ace705a45005 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:02.792831 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-db1bf10b-1d24-42c8-92fd-ace705a45005 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18" status: 200 len: 1404 microversion: 2.20 time: 0.578337 Oct 04 18:59:02.795022 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2872/5778] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:59:02 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 => generated 1404 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:59:02.808134 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-e956ad64-92fe-4b83-9bdd-de6429fd1fd0 req-8b62e5b2-a8a4-4fa5-8821-36f70041b01c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b882133-2fca-4df4-b228-46a12f538c18", "name": "network-vif-plugged", "status": "completed", "tag": "1f37fede-c1b1-491b-bab1-5ad8cb57086e"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:59:02.835616 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-e956ad64-92fe-4b83-9bdd-de6429fd1fd0 req-8b62e5b2-a8a4-4fa5-8821-36f70041b01c service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:02.839786 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-e956ad64-92fe-4b83-9bdd-de6429fd1fd0 req-8b62e5b2-a8a4-4fa5-8821-36f70041b01c service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:02.840502 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-e956ad64-92fe-4b83-9bdd-de6429fd1fd0 req-8b62e5b2-a8a4-4fa5-8821-36f70041b01c service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:02.878283 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-e956ad64-92fe-4b83-9bdd-de6429fd1fd0 req-8b62e5b2-a8a4-4fa5-8821-36f70041b01c service nova] Creating event network-vif-plugged:1f37fede-c1b1-491b-bab1-5ad8cb57086e for instance 7b882133-2fca-4df4-b228-46a12f538c18 on n-h1-850501-14 Oct 04 18:59:02.891805 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-e956ad64-92fe-4b83-9bdd-de6429fd1fd0 req-8b62e5b2-a8a4-4fa5-8821-36f70041b01c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094702 Oct 04 18:59:02.892856 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2873/5779] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:59:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:59:02.963190 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-fda8eb21-2091-410c-a0b3-038d3fc6e714 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7fac7323441708be3f27945a92fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6844b3a51e4c2da1294e89517989c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:02.971717 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-fda8eb21-2091-410c-a0b3-038d3fc6e714 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] 10.222.0.20 "GET /compute/v2.1/servers/3edcc394-83d7-4358-8f99-af546b861685" status: 200 len: 1318 microversion: 2.1 time: 0.872759 Oct 04 18:59:02.977147 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2907/5780] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:02 2022] GET /compute/v2.1/servers/3edcc394-83d7-4358-8f99-af546b861685 => generated 1318 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:03.824987 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a8835f49-aabf-4ba6-9dce-cbb55cff8b43 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:03.828220 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a8835f49-aabf-4ba6-9dce-cbb55cff8b43 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:03.854312 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a8835f49-aabf-4ba6-9dce-cbb55cff8b43 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:03.859382 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a8835f49-aabf-4ba6-9dce-cbb55cff8b43 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:03.861532 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a8835f49-aabf-4ba6-9dce-cbb55cff8b43 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:03.862460 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a8835f49-aabf-4ba6-9dce-cbb55cff8b43 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:03.864328 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a8835f49-aabf-4ba6-9dce-cbb55cff8b43 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:03.870167 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a8835f49-aabf-4ba6-9dce-cbb55cff8b43 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:04.005036 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-31d933d3-2c39-4e51-81b4-23971cbb2a10 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:04.007708 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-31d933d3-2c39-4e51-81b4-23971cbb2a10 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] [instance: 3edcc394-83d7-4358-8f99-af546b861685] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:04.030066 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-31d933d3-2c39-4e51-81b4-23971cbb2a10 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:04.032818 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-31d933d3-2c39-4e51-81b4-23971cbb2a10 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:04.035448 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-31d933d3-2c39-4e51-81b4-23971cbb2a10 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:04.037767 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-31d933d3-2c39-4e51-81b4-23971cbb2a10 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:04.041335 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-31d933d3-2c39-4e51-81b4-23971cbb2a10 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:04.044196 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-31d933d3-2c39-4e51-81b4-23971cbb2a10 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:04.699243 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a8835f49-aabf-4ba6-9dce-cbb55cff8b43 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:04.712744 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a8835f49-aabf-4ba6-9dce-cbb55cff8b43 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:04.733618 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a8835f49-aabf-4ba6-9dce-cbb55cff8b43 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:04.735075 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a8835f49-aabf-4ba6-9dce-cbb55cff8b43 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18" status: 200 len: 1404 microversion: 2.20 time: 0.915389 Oct 04 18:59:04.736228 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2874/5781] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:59:03 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 => generated 1404 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:59:04.758880 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-31d933d3-2c39-4e51-81b4-23971cbb2a10 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7fac7323441708be3f27945a92fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6844b3a51e4c2da1294e89517989c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:04.766613 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-31d933d3-2c39-4e51-81b4-23971cbb2a10 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] 10.222.0.20 "GET /compute/v2.1/servers/3edcc394-83d7-4358-8f99-af546b861685" status: 200 len: 1318 microversion: 2.1 time: 0.771158 Oct 04 18:59:04.767212 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2908/5782] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:03 2022] GET /compute/v2.1/servers/3edcc394-83d7-4358-8f99-af546b861685 => generated 1318 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:05.201605 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-52a386b5-3f26-46c4-9030-8848c22576d4 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:05.202159 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-52a386b5-3f26-46c4-9030-8848c22576d4 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: ba710906-86d6-4c04-a708-1f3b9a466e3c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:05.220806 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-52a386b5-3f26-46c4-9030-8848c22576d4 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:05.221388 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-52a386b5-3f26-46c4-9030-8848c22576d4 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:05.221931 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-52a386b5-3f26-46c4-9030-8848c22576d4 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:05.222790 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-52a386b5-3f26-46c4-9030-8848c22576d4 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:05.223373 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-52a386b5-3f26-46c4-9030-8848c22576d4 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:05.223877 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-52a386b5-3f26-46c4-9030-8848c22576d4 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:05.252303 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-52a386b5-3f26-46c4-9030-8848c22576d4 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/ba710906-86d6-4c04-a708-1f3b9a466e3c/ips" status: 200 len: 149 microversion: 2.1 time: 0.054587 Oct 04 18:59:05.253711 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2909/5783] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Oct 4 18:59:05 2022] GET /compute/v2.1/servers/ba710906-86d6-4c04-a708-1f3b9a466e3c/ips => generated 149 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:59:05.291430 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-375606da-2445-4bec-bdb2-075635b3f8b5 req-fd6855d6-465d-4171-bbe6-afe6c664b33a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3edcc394-83d7-4358-8f99-af546b861685", "name": "network-vif-plugged", "status": "completed", "tag": "236e4f54-124f-4ab5-a66c-bfe8436a720b"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:59:05.326886 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-375606da-2445-4bec-bdb2-075635b3f8b5 req-fd6855d6-465d-4171-bbe6-afe6c664b33a service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:05.327326 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-375606da-2445-4bec-bdb2-075635b3f8b5 req-fd6855d6-465d-4171-bbe6-afe6c664b33a service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:05.331696 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-375606da-2445-4bec-bdb2-075635b3f8b5 req-fd6855d6-465d-4171-bbe6-afe6c664b33a service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:05.382381 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-375606da-2445-4bec-bdb2-075635b3f8b5 req-fd6855d6-465d-4171-bbe6-afe6c664b33a service nova] Creating event network-vif-plugged:236e4f54-124f-4ab5-a66c-bfe8436a720b for instance 3edcc394-83d7-4358-8f99-af546b861685 on n-h2-850501-14 Oct 04 18:59:05.399428 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-375606da-2445-4bec-bdb2-075635b3f8b5 req-fd6855d6-465d-4171-bbe6-afe6c664b33a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.446203 Oct 04 18:59:05.405283 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2875/5784] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:59:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:59:05.760630 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-557f56cb-9e15-4293-85ff-df2d964ff0a0 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:05.761511 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-557f56cb-9e15-4293-85ff-df2d964ff0a0 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:05.775480 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-557f56cb-9e15-4293-85ff-df2d964ff0a0 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:05.778940 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-557f56cb-9e15-4293-85ff-df2d964ff0a0 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:05.781539 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-557f56cb-9e15-4293-85ff-df2d964ff0a0 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:05.782989 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-557f56cb-9e15-4293-85ff-df2d964ff0a0 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:05.784923 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-557f56cb-9e15-4293-85ff-df2d964ff0a0 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:05.790170 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-557f56cb-9e15-4293-85ff-df2d964ff0a0 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:05.792234 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-fe4c0054-5bb6-4318-929e-bdb730b1b9db tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:05.793007 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-fe4c0054-5bb6-4318-929e-bdb730b1b9db tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] [instance: 3edcc394-83d7-4358-8f99-af546b861685] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:05.799897 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fe4c0054-5bb6-4318-929e-bdb730b1b9db tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:05.801700 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fe4c0054-5bb6-4318-929e-bdb730b1b9db tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:05.802380 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fe4c0054-5bb6-4318-929e-bdb730b1b9db tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:05.803991 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fe4c0054-5bb6-4318-929e-bdb730b1b9db tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:05.805206 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fe4c0054-5bb6-4318-929e-bdb730b1b9db tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:05.806289 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fe4c0054-5bb6-4318-929e-bdb730b1b9db tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:06.278987 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-557f56cb-9e15-4293-85ff-df2d964ff0a0 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:06.294121 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-557f56cb-9e15-4293-85ff-df2d964ff0a0 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:06.300574 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-557f56cb-9e15-4293-85ff-df2d964ff0a0 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:06.301916 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-557f56cb-9e15-4293-85ff-df2d964ff0a0 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18" status: 200 len: 1597 microversion: 2.20 time: 0.545359 Oct 04 18:59:06.305118 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2910/5785] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:59:05 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 => generated 1597 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:59:06.332032 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-aac31cf8-fd0d-43a1-b077-1b08d45d28e7 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:06.332670 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-aac31cf8-fd0d-43a1-b077-1b08d45d28e7 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:06.339323 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aac31cf8-fd0d-43a1-b077-1b08d45d28e7 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:06.339825 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aac31cf8-fd0d-43a1-b077-1b08d45d28e7 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:06.340297 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aac31cf8-fd0d-43a1-b077-1b08d45d28e7 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:06.340996 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aac31cf8-fd0d-43a1-b077-1b08d45d28e7 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:06.341642 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aac31cf8-fd0d-43a1-b077-1b08d45d28e7 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:06.344598 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aac31cf8-fd0d-43a1-b077-1b08d45d28e7 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:06.347010 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-fe4c0054-5bb6-4318-929e-bdb730b1b9db tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7fac7323441708be3f27945a92fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6844b3a51e4c2da1294e89517989c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:06.357196 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-fe4c0054-5bb6-4318-929e-bdb730b1b9db tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] 10.222.0.20 "GET /compute/v2.1/servers/3edcc394-83d7-4358-8f99-af546b861685" status: 200 len: 1318 microversion: 2.1 time: 0.570802 Oct 04 18:59:06.358081 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2876/5786] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:05 2022] GET /compute/v2.1/servers/3edcc394-83d7-4358-8f99-af546b861685 => generated 1318 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:59:06.636962 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-aac31cf8-fd0d-43a1-b077-1b08d45d28e7 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.312672 Oct 04 18:59:06.637937 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2911/5787] 10.222.0.20 () {60 vars in 1316 bytes} [Tue Oct 4 18:59:06 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18/os-interface => generated 285 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 18:59:07.393425 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-aefa6132-bc4d-45fb-90ae-ed669e9d8b4e tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:07.395130 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-aefa6132-bc4d-45fb-90ae-ed669e9d8b4e tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] [instance: 3edcc394-83d7-4358-8f99-af546b861685] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:07.406561 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aefa6132-bc4d-45fb-90ae-ed669e9d8b4e tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:07.407573 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aefa6132-bc4d-45fb-90ae-ed669e9d8b4e tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:07.408561 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aefa6132-bc4d-45fb-90ae-ed669e9d8b4e tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:07.411141 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aefa6132-bc4d-45fb-90ae-ed669e9d8b4e tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:07.412760 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aefa6132-bc4d-45fb-90ae-ed669e9d8b4e tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:07.413498 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aefa6132-bc4d-45fb-90ae-ed669e9d8b4e tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:07.858902 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-aefa6132-bc4d-45fb-90ae-ed669e9d8b4e tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7fac7323441708be3f27945a92fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6844b3a51e4c2da1294e89517989c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:07.883485 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-aefa6132-bc4d-45fb-90ae-ed669e9d8b4e tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] 10.222.0.20 "GET /compute/v2.1/servers/3edcc394-83d7-4358-8f99-af546b861685" status: 200 len: 1318 microversion: 2.1 time: 0.501969 Oct 04 18:59:07.885628 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2877/5788] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:07 2022] GET /compute/v2.1/servers/3edcc394-83d7-4358-8f99-af546b861685 => generated 1318 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:59:08.437069 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b37b44f2-4e1a-4d19-8af5-13d862f1af26 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a8e039fe-2de9-4a43-8029-a353c57b3fdd"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:59:08.444318 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b37b44f2-4e1a-4d19-8af5-13d862f1af26 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: ba710906-86d6-4c04-a708-1f3b9a466e3c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:08.456705 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b37b44f2-4e1a-4d19-8af5-13d862f1af26 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:08.457839 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b37b44f2-4e1a-4d19-8af5-13d862f1af26 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:08.458911 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b37b44f2-4e1a-4d19-8af5-13d862f1af26 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:08.462243 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b37b44f2-4e1a-4d19-8af5-13d862f1af26 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:08.463208 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b37b44f2-4e1a-4d19-8af5-13d862f1af26 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:08.464531 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b37b44f2-4e1a-4d19-8af5-13d862f1af26 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:08.915923 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e2ec916d-98df-4393-892a-839ea891f830 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:08.918758 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e2ec916d-98df-4393-892a-839ea891f830 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] [instance: 3edcc394-83d7-4358-8f99-af546b861685] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:08.926370 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e2ec916d-98df-4393-892a-839ea891f830 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:08.926370 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e2ec916d-98df-4393-892a-839ea891f830 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:08.926687 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e2ec916d-98df-4393-892a-839ea891f830 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:08.927851 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e2ec916d-98df-4393-892a-839ea891f830 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:08.928595 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e2ec916d-98df-4393-892a-839ea891f830 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:08.929404 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e2ec916d-98df-4393-892a-839ea891f830 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:09.382691 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:59:09.386483 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e2ec916d-98df-4393-892a-839ea891f830 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7fac7323441708be3f27945a92fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6844b3a51e4c2da1294e89517989c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:09.408615 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e2ec916d-98df-4393-892a-839ea891f830 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] 10.222.0.20 "GET /compute/v2.1/servers/3edcc394-83d7-4358-8f99-af546b861685" status: 200 len: 1507 microversion: 2.1 time: 0.487261 Oct 04 18:59:09.409560 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2878/5789] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:08 2022] GET /compute/v2.1/servers/3edcc394-83d7-4358-8f99-af546b861685 => generated 1507 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:09.578588 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b37b44f2-4e1a-4d19-8af5-13d862f1af26 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "POST /compute/v2.1/servers/ba710906-86d6-4c04-a708-1f3b9a466e3c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.147313 Oct 04 18:59:09.580845 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2912/5790] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Oct 4 18:59:08 2022] POST /compute/v2.1/servers/ba710906-86d6-4c04-a708-1f3b9a466e3c/os-volume_attachments => generated 194 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:59:09.978585 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-2dad0eb5-7a49-4d44-8a2f-79a8f588c35e req-5422dc61-025a-4e96-a924-706d36276cfe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b882133-2fca-4df4-b228-46a12f538c18", "tag": "1f37fede-c1b1-491b-bab1-5ad8cb57086e"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:59:10.001741 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-2dad0eb5-7a49-4d44-8a2f-79a8f588c35e req-5422dc61-025a-4e96-a924-706d36276cfe service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:10.006563 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-2dad0eb5-7a49-4d44-8a2f-79a8f588c35e req-5422dc61-025a-4e96-a924-706d36276cfe service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:10.006928 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-2dad0eb5-7a49-4d44-8a2f-79a8f588c35e req-5422dc61-025a-4e96-a924-706d36276cfe service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:10.060747 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-2dad0eb5-7a49-4d44-8a2f-79a8f588c35e req-5422dc61-025a-4e96-a924-706d36276cfe service nova] Creating event network-changed:1f37fede-c1b1-491b-bab1-5ad8cb57086e for instance 7b882133-2fca-4df4-b228-46a12f538c18 on n-h1-850501-14 Oct 04 18:59:10.065011 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-2dad0eb5-7a49-4d44-8a2f-79a8f588c35e req-5422dc61-025a-4e96-a924-706d36276cfe service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089707 Oct 04 18:59:10.066135 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2879/5791] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:59:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:59:27.943272 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=48 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:59:27.948614 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3dd890f2-f82c-4c49-9b40-a5729829eab6 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Action: 'create', calling method: .version_select at 0x7fe253ba9790>, body: {"keypair": {"name": "tempest-keypair-512410222", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGO1yl6teB3I5q8JqGMBMJeSZ3jtUviy6Oymzs91TKdFxP74QJ8yK6bUgS7H9rj4E2Qt9aT+3FGa/b9+wEMCIhr289AU+ULQr0BqFaq/Uh6rZtco5VS3N+0LW1IO3LtA7w=="}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:59:28.007396 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-3dd890f2-f82c-4c49-9b40-a5729829eab6 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Getting quotas for project 5dc67d8de57543c48bdf45669b684227. Resources: {'key_pairs'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:59:28.025302 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-3dd890f2-f82c-4c49-9b40-a5729829eab6 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Getting quotas for user ce441ded6f554ec28560c75de97af173 and project 5dc67d8de57543c48bdf45669b684227. Resources: {'key_pairs'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:59:28.380755 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3dd890f2-f82c-4c49-9b40-a5729829eab6 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.439717 Oct 04 18:59:28.386685 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2913/5792] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Oct 4 18:59:27 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:59:29.112953 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=6 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:59:29.113716 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=88 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:59:29.124719 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-96eac54c-b9ae-4db0-bddc-b9d4f4d3acc0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1691939156", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "47be66b8-ff74-4710-95f9-95ea57e3ce7a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "dbc89e1f-759d-4fcb-8e1c-542119e29e34"}]}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:59:29.332420 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-96eac54c-b9ae-4db0-bddc-b9d4f4d3acc0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] validate_networks() for [('dbc89e1f-759d-4fcb-8e1c-542119e29e34', None, None, None, None, None)] {{(pid=123002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:59:30.719776 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-96eac54c-b9ae-4db0-bddc-b9d4f4d3acc0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:59:30.721084 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-96eac54c-b9ae-4db0-bddc-b9d4f4d3acc0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:59:30.721727 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-96eac54c-b9ae-4db0-bddc-b9d4f4d3acc0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:59:30.722290 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-96eac54c-b9ae-4db0-bddc-b9d4f4d3acc0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:59:30.723057 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-96eac54c-b9ae-4db0-bddc-b9d4f4d3acc0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:59:30.743919 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-96eac54c-b9ae-4db0-bddc-b9d4f4d3acc0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:30.747530 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-96eac54c-b9ae-4db0-bddc-b9d4f4d3acc0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:30.748339 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-96eac54c-b9ae-4db0-bddc-b9d4f4d3acc0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:30.749319 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-96eac54c-b9ae-4db0-bddc-b9d4f4d3acc0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:30.751144 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-96eac54c-b9ae-4db0-bddc-b9d4f4d3acc0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:30.756360 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-96eac54c-b9ae-4db0-bddc-b9d4f4d3acc0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:30.827465 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-96eac54c-b9ae-4db0-bddc-b9d4f4d3acc0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Getting quotas for project 82d0cd3db371459db429cb770abde738. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:59:30.841345 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-96eac54c-b9ae-4db0-bddc-b9d4f4d3acc0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Getting quotas for user a65ae9c3fb3c46a2a393fe21ce21b9d4 and project 82d0cd3db371459db429cb770abde738. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:59:31.029151 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-96eac54c-b9ae-4db0-bddc-b9d4f4d3acc0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Going to run 1 instances... {{(pid=123002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:59:31.032826 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-96eac54c-b9ae-4db0-bddc-b9d4f4d3acc0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: cd8357d8-7845-4c92-ab64-22dbea5c6dbc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='47be66b8-ff74-4710-95f9-95ea57e3ce7a',volume_size=None,volume_type=None)] {{(pid=123002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:59:31.581645 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-96eac54c-b9ae-4db0-bddc-b9d4f4d3acc0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.470678 Oct 04 18:59:31.589509 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2880/5793] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:59:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 2475 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:59:31.594044 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a4a47053-3fab-447b-9e29-7863408109f8 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:31.594804 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a4a47053-3fab-447b-9e29-7863408109f8 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: cd8357d8-7845-4c92-ab64-22dbea5c6dbc] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:31.918804 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a4a47053-3fab-447b-9e29-7863408109f8 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:31.927547 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a4a47053-3fab-447b-9e29-7863408109f8 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/cd8357d8-7845-4c92-ab64-22dbea5c6dbc" status: 200 len: 1057 microversion: 2.1 time: 0.337663 Oct 04 18:59:31.936880 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2914/5794] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:31 2022] GET /compute/v2.1/servers/cd8357d8-7845-4c92-ab64-22dbea5c6dbc => generated 1057 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:32.961818 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-49918e9e-5fd9-487d-875d-c244e5a0b26c tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:32.962444 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-49918e9e-5fd9-487d-875d-c244e5a0b26c tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: cd8357d8-7845-4c92-ab64-22dbea5c6dbc] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:33.132441 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-49918e9e-5fd9-487d-875d-c244e5a0b26c tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:33.148955 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-49918e9e-5fd9-487d-875d-c244e5a0b26c tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/cd8357d8-7845-4c92-ab64-22dbea5c6dbc" status: 200 len: 1057 microversion: 2.1 time: 0.187628 Oct 04 18:59:33.151177 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2881/5795] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:32 2022] GET /compute/v2.1/servers/cd8357d8-7845-4c92-ab64-22dbea5c6dbc => generated 1057 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:34.184691 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a5eb2fb6-a24e-497c-9085-25eb83aeace0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:34.184691 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a5eb2fb6-a24e-497c-9085-25eb83aeace0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: cd8357d8-7845-4c92-ab64-22dbea5c6dbc] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:34.207977 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a5eb2fb6-a24e-497c-9085-25eb83aeace0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:34.208894 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a5eb2fb6-a24e-497c-9085-25eb83aeace0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:34.209643 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a5eb2fb6-a24e-497c-9085-25eb83aeace0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:34.210884 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a5eb2fb6-a24e-497c-9085-25eb83aeace0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:34.211915 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a5eb2fb6-a24e-497c-9085-25eb83aeace0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:34.212450 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a5eb2fb6-a24e-497c-9085-25eb83aeace0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:34.431999 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a5eb2fb6-a24e-497c-9085-25eb83aeace0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:34.444455 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a5eb2fb6-a24e-497c-9085-25eb83aeace0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/cd8357d8-7845-4c92-ab64-22dbea5c6dbc" status: 200 len: 1107 microversion: 2.1 time: 0.267486 Oct 04 18:59:34.445319 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2915/5796] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:34 2022] GET /compute/v2.1/servers/cd8357d8-7845-4c92-ab64-22dbea5c6dbc => generated 1107 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:35.473885 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3832cc0f-1799-45fe-b24c-371b2460c5f3 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:35.475467 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3832cc0f-1799-45fe-b24c-371b2460c5f3 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: cd8357d8-7845-4c92-ab64-22dbea5c6dbc] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:35.491871 n-d-850501-14 devstack@n-api.service[123002]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 18:59:35.495606 n-d-850501-14 devstack@n-api.service[123002]: Tue Oct 4 18:59:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cd8357d8-7845-4c92-ab64-22dbea5c6dbc (ip 10.222.0.20) !!! Oct 04 18:59:35.505393 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3832cc0f-1799-45fe-b24c-371b2460c5f3 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:35.506773 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3832cc0f-1799-45fe-b24c-371b2460c5f3 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:35.510493 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3832cc0f-1799-45fe-b24c-371b2460c5f3 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:35.514067 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3832cc0f-1799-45fe-b24c-371b2460c5f3 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:35.516723 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3832cc0f-1799-45fe-b24c-371b2460c5f3 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:35.517546 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3832cc0f-1799-45fe-b24c-371b2460c5f3 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:35.676915 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3832cc0f-1799-45fe-b24c-371b2460c5f3 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:35.694757 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3832cc0f-1799-45fe-b24c-371b2460c5f3 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/cd8357d8-7845-4c92-ab64-22dbea5c6dbc" status: 200 len: 1155 microversion: 2.1 time: 0.223752 Oct 04 18:59:35.702908 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2882/5797] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:35 2022] GET /compute/v2.1/servers/cd8357d8-7845-4c92-ab64-22dbea5c6dbc => generated 1155 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:36.249854 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-761271f4-23c4-4e48-a8b7-30dfe5c8cfad tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-579682171", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "32f1ab07-b252-4176-b7b8-3cc5be1795d8"}], "security_groups": [{"name": "tempest-securitygroup--1903252937"}], "key_name": "tempest-keypair-512410222", "user_data": "}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:59:36.541180 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.neutron [None req-761271f4-23c4-4e48-a8b7-30dfe5c8cfad tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] validate_networks() for [('32f1ab07-b252-4176-b7b8-3cc5be1795d8', None, None, None, None, None)] {{(pid=123001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:59:36.721107 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e64712d5-1249-41f6-bf97-49e05d2aff6b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:36.721726 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e64712d5-1249-41f6-bf97-49e05d2aff6b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: cd8357d8-7845-4c92-ab64-22dbea5c6dbc] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:36.755168 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e64712d5-1249-41f6-bf97-49e05d2aff6b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:36.755848 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e64712d5-1249-41f6-bf97-49e05d2aff6b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:36.756331 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e64712d5-1249-41f6-bf97-49e05d2aff6b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:36.757079 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e64712d5-1249-41f6-bf97-49e05d2aff6b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:36.757599 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e64712d5-1249-41f6-bf97-49e05d2aff6b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:36.758067 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e64712d5-1249-41f6-bf97-49e05d2aff6b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:36.984674 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e64712d5-1249-41f6-bf97-49e05d2aff6b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:36.998978 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e64712d5-1249-41f6-bf97-49e05d2aff6b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/cd8357d8-7845-4c92-ab64-22dbea5c6dbc" status: 200 len: 1173 microversion: 2.1 time: 0.279021 Oct 04 18:59:37.000279 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2883/5798] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:36 2022] GET /compute/v2.1/servers/cd8357d8-7845-4c92-ab64-22dbea5c6dbc => generated 1173 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:37.492770 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-761271f4-23c4-4e48-a8b7-30dfe5c8cfad tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:59:37.495220 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-761271f4-23c4-4e48-a8b7-30dfe5c8cfad tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:59:37.495220 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-761271f4-23c4-4e48-a8b7-30dfe5c8cfad tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:59:37.495220 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-761271f4-23c4-4e48-a8b7-30dfe5c8cfad tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:59:37.507816 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-761271f4-23c4-4e48-a8b7-30dfe5c8cfad tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:59:37.555886 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-761271f4-23c4-4e48-a8b7-30dfe5c8cfad tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:37.558019 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-761271f4-23c4-4e48-a8b7-30dfe5c8cfad tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:37.558843 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-761271f4-23c4-4e48-a8b7-30dfe5c8cfad tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:37.560497 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-761271f4-23c4-4e48-a8b7-30dfe5c8cfad tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:37.562129 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-761271f4-23c4-4e48-a8b7-30dfe5c8cfad tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:37.563885 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-761271f4-23c4-4e48-a8b7-30dfe5c8cfad tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:37.610147 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-761271f4-23c4-4e48-a8b7-30dfe5c8cfad tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Getting quotas for project 5dc67d8de57543c48bdf45669b684227. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:59:37.617568 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-761271f4-23c4-4e48-a8b7-30dfe5c8cfad tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Getting quotas for user ce441ded6f554ec28560c75de97af173 and project 5dc67d8de57543c48bdf45669b684227. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:59:37.643750 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-761271f4-23c4-4e48-a8b7-30dfe5c8cfad tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Going to run 1 instances... {{(pid=123001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:59:37.649829 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-761271f4-23c4-4e48-a8b7-30dfe5c8cfad tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: efab3398-8820-4a11-8dd2-0f7f51a73763] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:59:37.859668 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-761271f4-23c4-4e48-a8b7-30dfe5c8cfad tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.609894 Oct 04 18:59:37.866138 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2916/5799] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:59:36 2022] POST /compute/v2.1/servers => generated 402 bytes in 1618 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:59:37.874174 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b039dd83-abc8-4d7e-9cc5-3cdb798e2324 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:37.875511 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b039dd83-abc8-4d7e-9cc5-3cdb798e2324 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: efab3398-8820-4a11-8dd2-0f7f51a73763] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:37.979950 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b039dd83-abc8-4d7e-9cc5-3cdb798e2324 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce441ded6f554ec28560c75de97af173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc67d8de57543c48bdf45669b684227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:37.992359 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b039dd83-abc8-4d7e-9cc5-3cdb798e2324 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/efab3398-8820-4a11-8dd2-0f7f51a73763" status: 200 len: 1240 microversion: 2.1 time: 0.117341 Oct 04 18:59:37.995588 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2884/5800] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:37 2022] GET /compute/v2.1/servers/efab3398-8820-4a11-8dd2-0f7f51a73763 => generated 1240 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:38.042673 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-cfed2671-efdb-483e-bd0c-68ea3caaef76 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:38.045845 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-cfed2671-efdb-483e-bd0c-68ea3caaef76 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: cd8357d8-7845-4c92-ab64-22dbea5c6dbc] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:38.067439 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cfed2671-efdb-483e-bd0c-68ea3caaef76 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:38.067926 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cfed2671-efdb-483e-bd0c-68ea3caaef76 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:38.069265 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cfed2671-efdb-483e-bd0c-68ea3caaef76 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:38.074319 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cfed2671-efdb-483e-bd0c-68ea3caaef76 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:38.074799 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cfed2671-efdb-483e-bd0c-68ea3caaef76 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:38.075249 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cfed2671-efdb-483e-bd0c-68ea3caaef76 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:38.213068 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-cfed2671-efdb-483e-bd0c-68ea3caaef76 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:38.224317 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-cfed2671-efdb-483e-bd0c-68ea3caaef76 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/cd8357d8-7845-4c92-ab64-22dbea5c6dbc" status: 200 len: 1173 microversion: 2.1 time: 0.195150 Oct 04 18:59:38.225477 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2917/5801] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:38 2022] GET /compute/v2.1/servers/cd8357d8-7845-4c92-ab64-22dbea5c6dbc => generated 1173 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:39.014102 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-87e3a969-7544-47b0-8b89-2283869e3290 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:39.014802 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-87e3a969-7544-47b0-8b89-2283869e3290 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: efab3398-8820-4a11-8dd2-0f7f51a73763] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:39.250797 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-15534cbb-43ff-496e-aa65-b7b01ede614d tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:39.251392 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-15534cbb-43ff-496e-aa65-b7b01ede614d tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: cd8357d8-7845-4c92-ab64-22dbea5c6dbc] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:39.259039 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-15534cbb-43ff-496e-aa65-b7b01ede614d tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:39.259613 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-15534cbb-43ff-496e-aa65-b7b01ede614d tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:39.260278 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-15534cbb-43ff-496e-aa65-b7b01ede614d tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:39.261020 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-15534cbb-43ff-496e-aa65-b7b01ede614d tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:39.261491 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-15534cbb-43ff-496e-aa65-b7b01ede614d tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:39.261926 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-15534cbb-43ff-496e-aa65-b7b01ede614d tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:39.283024 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-87e3a969-7544-47b0-8b89-2283869e3290 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce441ded6f554ec28560c75de97af173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc67d8de57543c48bdf45669b684227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:39.302787 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-87e3a969-7544-47b0-8b89-2283869e3290 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/efab3398-8820-4a11-8dd2-0f7f51a73763" status: 200 len: 1240 microversion: 2.1 time: 0.292642 Oct 04 18:59:39.317599 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2885/5802] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:39 2022] GET /compute/v2.1/servers/efab3398-8820-4a11-8dd2-0f7f51a73763 => generated 1240 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:39.691091 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-15534cbb-43ff-496e-aa65-b7b01ede614d tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:39.705206 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-15534cbb-43ff-496e-aa65-b7b01ede614d tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/cd8357d8-7845-4c92-ab64-22dbea5c6dbc" status: 200 len: 1215 microversion: 2.1 time: 0.458160 Oct 04 18:59:39.723897 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2918/5803] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:39 2022] GET /compute/v2.1/servers/cd8357d8-7845-4c92-ab64-22dbea5c6dbc => generated 1215 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:59:40.361061 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3459bf58-2133-4ea2-a651-d43fbe4f4459 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:40.365584 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3459bf58-2133-4ea2-a651-d43fbe4f4459 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: efab3398-8820-4a11-8dd2-0f7f51a73763] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:40.376391 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3459bf58-2133-4ea2-a651-d43fbe4f4459 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:40.385175 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3459bf58-2133-4ea2-a651-d43fbe4f4459 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:40.386134 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3459bf58-2133-4ea2-a651-d43fbe4f4459 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:40.386366 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3459bf58-2133-4ea2-a651-d43fbe4f4459 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:40.395391 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3459bf58-2133-4ea2-a651-d43fbe4f4459 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:40.397819 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3459bf58-2133-4ea2-a651-d43fbe4f4459 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:40.728649 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5c3e67d9-2b67-48db-b70a-b7d5cd21cc0e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:40.730214 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5c3e67d9-2b67-48db-b70a-b7d5cd21cc0e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: cd8357d8-7845-4c92-ab64-22dbea5c6dbc] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:40.733009 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3459bf58-2133-4ea2-a651-d43fbe4f4459 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce441ded6f554ec28560c75de97af173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc67d8de57543c48bdf45669b684227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:40.743307 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5c3e67d9-2b67-48db-b70a-b7d5cd21cc0e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:40.743811 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5c3e67d9-2b67-48db-b70a-b7d5cd21cc0e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:40.747044 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3459bf58-2133-4ea2-a651-d43fbe4f4459 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/efab3398-8820-4a11-8dd2-0f7f51a73763" status: 200 len: 1292 microversion: 2.1 time: 0.392647 Oct 04 18:59:40.752522 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5c3e67d9-2b67-48db-b70a-b7d5cd21cc0e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:40.753407 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5c3e67d9-2b67-48db-b70a-b7d5cd21cc0e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:40.753928 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5c3e67d9-2b67-48db-b70a-b7d5cd21cc0e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:40.754686 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5c3e67d9-2b67-48db-b70a-b7d5cd21cc0e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:40.761604 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2886/5804] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:40 2022] GET /compute/v2.1/servers/efab3398-8820-4a11-8dd2-0f7f51a73763 => generated 1292 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:41.743094 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5c3e67d9-2b67-48db-b70a-b7d5cd21cc0e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:41.759082 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5c3e67d9-2b67-48db-b70a-b7d5cd21cc0e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/cd8357d8-7845-4c92-ab64-22dbea5c6dbc" status: 200 len: 1215 microversion: 2.1 time: 1.034710 Oct 04 18:59:41.765192 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2919/5805] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:40 2022] GET /compute/v2.1/servers/cd8357d8-7845-4c92-ab64-22dbea5c6dbc => generated 1215 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:59:41.773595 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-22e67e66-a027-4338-ae49-90cb864b6e8e tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:41.774786 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-22e67e66-a027-4338-ae49-90cb864b6e8e tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: efab3398-8820-4a11-8dd2-0f7f51a73763] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:41.782857 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:59:41.788466 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-22e67e66-a027-4338-ae49-90cb864b6e8e tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:41.794745 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-22e67e66-a027-4338-ae49-90cb864b6e8e tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:41.798777 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-22e67e66-a027-4338-ae49-90cb864b6e8e tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:41.798777 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-22e67e66-a027-4338-ae49-90cb864b6e8e tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:41.798777 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-22e67e66-a027-4338-ae49-90cb864b6e8e tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:41.798777 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-22e67e66-a027-4338-ae49-90cb864b6e8e tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:42.042165 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-22e67e66-a027-4338-ae49-90cb864b6e8e tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce441ded6f554ec28560c75de97af173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc67d8de57543c48bdf45669b684227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:42.058875 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-22e67e66-a027-4338-ae49-90cb864b6e8e tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/efab3398-8820-4a11-8dd2-0f7f51a73763" status: 200 len: 1298 microversion: 2.1 time: 0.288926 Oct 04 18:59:42.062647 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2887/5806] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:41 2022] GET /compute/v2.1/servers/efab3398-8820-4a11-8dd2-0f7f51a73763 => generated 1298 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:42.715161 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-779c1702-5a65-46f6-8dc8-6cce44930e22 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:42.715881 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-779c1702-5a65-46f6-8dc8-6cce44930e22 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:42.742790 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-779c1702-5a65-46f6-8dc8-6cce44930e22 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:42.745003 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-779c1702-5a65-46f6-8dc8-6cce44930e22 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:42.746650 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-779c1702-5a65-46f6-8dc8-6cce44930e22 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:42.751284 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-779c1702-5a65-46f6-8dc8-6cce44930e22 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:42.751851 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-779c1702-5a65-46f6-8dc8-6cce44930e22 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:42.752348 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-779c1702-5a65-46f6-8dc8-6cce44930e22 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:42.798527 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-302123cb-a0e7-44d3-b39e-401e0069c2dd tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:42.799905 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-302123cb-a0e7-44d3-b39e-401e0069c2dd tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: cd8357d8-7845-4c92-ab64-22dbea5c6dbc] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:42.814066 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-302123cb-a0e7-44d3-b39e-401e0069c2dd tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:42.814916 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-302123cb-a0e7-44d3-b39e-401e0069c2dd tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:42.819222 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-302123cb-a0e7-44d3-b39e-401e0069c2dd tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:42.820386 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-302123cb-a0e7-44d3-b39e-401e0069c2dd tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:42.821156 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-302123cb-a0e7-44d3-b39e-401e0069c2dd tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:42.822442 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-302123cb-a0e7-44d3-b39e-401e0069c2dd tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:42.834174 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-779c1702-5a65-46f6-8dc8-6cce44930e22 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18/ips" status: 200 len: 153 microversion: 2.20 time: 0.128124 Oct 04 18:59:42.851948 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2920/5807] 10.222.0.20 () {60 vars in 1289 bytes} [Tue Oct 4 18:59:42 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18/ips => generated 153 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:59:43.099261 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-70090775-7ba5-4204-a057-b96659653af4 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:43.101780 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-70090775-7ba5-4204-a057-b96659653af4 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: efab3398-8820-4a11-8dd2-0f7f51a73763] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:43.115354 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-70090775-7ba5-4204-a057-b96659653af4 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:43.116171 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-70090775-7ba5-4204-a057-b96659653af4 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:43.116934 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-70090775-7ba5-4204-a057-b96659653af4 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:43.117829 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-70090775-7ba5-4204-a057-b96659653af4 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:43.126945 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-70090775-7ba5-4204-a057-b96659653af4 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:43.127596 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-70090775-7ba5-4204-a057-b96659653af4 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:43.392887 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-302123cb-a0e7-44d3-b39e-401e0069c2dd tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:43.402443 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-302123cb-a0e7-44d3-b39e-401e0069c2dd tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/cd8357d8-7845-4c92-ab64-22dbea5c6dbc" status: 200 len: 1215 microversion: 2.1 time: 0.609018 Oct 04 18:59:43.404879 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2888/5808] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:42 2022] GET /compute/v2.1/servers/cd8357d8-7845-4c92-ab64-22dbea5c6dbc => generated 1215 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:43.435167 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-70090775-7ba5-4204-a057-b96659653af4 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce441ded6f554ec28560c75de97af173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc67d8de57543c48bdf45669b684227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:43.451568 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-70090775-7ba5-4204-a057-b96659653af4 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/efab3398-8820-4a11-8dd2-0f7f51a73763" status: 200 len: 1298 microversion: 2.1 time: 0.372018 Oct 04 18:59:43.452231 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2921/5809] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:43 2022] GET /compute/v2.1/servers/efab3398-8820-4a11-8dd2-0f7f51a73763 => generated 1298 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:59:44.356197 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-fc577c34-2e32-4cde-a764-68f5e68f83ee req-30f47412-ce06-4775-9895-2a7656833563 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd8357d8-7845-4c92-ab64-22dbea5c6dbc", "tag": "4dfcc6bf-552f-4e81-a0ee-414651aba0e0"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:59:44.382804 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-fc577c34-2e32-4cde-a764-68f5e68f83ee req-30f47412-ce06-4775-9895-2a7656833563 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:44.383341 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-fc577c34-2e32-4cde-a764-68f5e68f83ee req-30f47412-ce06-4775-9895-2a7656833563 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:44.384002 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-fc577c34-2e32-4cde-a764-68f5e68f83ee req-30f47412-ce06-4775-9895-2a7656833563 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:44.430215 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-17c8bf78-d439-42d1-a821-8578673703d7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:44.430901 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-17c8bf78-d439-42d1-a821-8578673703d7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: cd8357d8-7845-4c92-ab64-22dbea5c6dbc] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:44.441958 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-17c8bf78-d439-42d1-a821-8578673703d7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:44.442643 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-17c8bf78-d439-42d1-a821-8578673703d7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:44.443329 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-17c8bf78-d439-42d1-a821-8578673703d7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:44.450498 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-17c8bf78-d439-42d1-a821-8578673703d7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:44.451183 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-17c8bf78-d439-42d1-a821-8578673703d7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:44.451819 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-17c8bf78-d439-42d1-a821-8578673703d7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:44.453120 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-fc577c34-2e32-4cde-a764-68f5e68f83ee req-30f47412-ce06-4775-9895-2a7656833563 service nova] Creating event network-changed:4dfcc6bf-552f-4e81-a0ee-414651aba0e0 for instance cd8357d8-7845-4c92-ab64-22dbea5c6dbc on n-h2-850501-14 Oct 04 18:59:44.478158 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-fc577c34-2e32-4cde-a764-68f5e68f83ee req-30f47412-ce06-4775-9895-2a7656833563 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121102 Oct 04 18:59:44.479098 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2889/5810] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:59:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:59:44.492352 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-038387cb-a03a-4f2b-b11f-20178d4571b5 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:44.493333 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-038387cb-a03a-4f2b-b11f-20178d4571b5 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: efab3398-8820-4a11-8dd2-0f7f51a73763] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:44.515617 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-038387cb-a03a-4f2b-b11f-20178d4571b5 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:44.521163 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-038387cb-a03a-4f2b-b11f-20178d4571b5 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:44.521632 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-038387cb-a03a-4f2b-b11f-20178d4571b5 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:44.522395 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-038387cb-a03a-4f2b-b11f-20178d4571b5 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:44.525795 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-038387cb-a03a-4f2b-b11f-20178d4571b5 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:44.526876 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-038387cb-a03a-4f2b-b11f-20178d4571b5 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:44.749920 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-038387cb-a03a-4f2b-b11f-20178d4571b5 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce441ded6f554ec28560c75de97af173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc67d8de57543c48bdf45669b684227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:44.762742 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-038387cb-a03a-4f2b-b11f-20178d4571b5 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/efab3398-8820-4a11-8dd2-0f7f51a73763" status: 200 len: 1298 microversion: 2.1 time: 0.281820 Oct 04 18:59:44.765067 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2890/5811] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:44 2022] GET /compute/v2.1/servers/efab3398-8820-4a11-8dd2-0f7f51a73763 => generated 1298 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:45.109575 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-17c8bf78-d439-42d1-a821-8578673703d7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:45.125077 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-17c8bf78-d439-42d1-a821-8578673703d7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/cd8357d8-7845-4c92-ab64-22dbea5c6dbc" status: 200 len: 1215 microversion: 2.1 time: 0.698842 Oct 04 18:59:45.140145 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2922/5812] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:44 2022] GET /compute/v2.1/servers/cd8357d8-7845-4c92-ab64-22dbea5c6dbc => generated 1215 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:45.795521 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-feb23fc3-5825-41f7-b3c6-7350d4f1b7ef tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:45.796444 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-feb23fc3-5825-41f7-b3c6-7350d4f1b7ef tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: efab3398-8820-4a11-8dd2-0f7f51a73763] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:45.808631 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-feb23fc3-5825-41f7-b3c6-7350d4f1b7ef tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:45.814235 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-feb23fc3-5825-41f7-b3c6-7350d4f1b7ef tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:45.814806 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-feb23fc3-5825-41f7-b3c6-7350d4f1b7ef tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:45.815630 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-feb23fc3-5825-41f7-b3c6-7350d4f1b7ef tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:45.817023 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-feb23fc3-5825-41f7-b3c6-7350d4f1b7ef tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:45.817701 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-feb23fc3-5825-41f7-b3c6-7350d4f1b7ef tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:46.158584 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-94f49a8d-b527-49ca-9acf-776eebc41f4b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:46.159217 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-94f49a8d-b527-49ca-9acf-776eebc41f4b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: cd8357d8-7845-4c92-ab64-22dbea5c6dbc] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:46.167245 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-94f49a8d-b527-49ca-9acf-776eebc41f4b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:46.176290 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-94f49a8d-b527-49ca-9acf-776eebc41f4b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:46.176290 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-94f49a8d-b527-49ca-9acf-776eebc41f4b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:46.176290 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-94f49a8d-b527-49ca-9acf-776eebc41f4b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:46.176290 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-94f49a8d-b527-49ca-9acf-776eebc41f4b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:46.176290 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-94f49a8d-b527-49ca-9acf-776eebc41f4b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:46.894183 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-feb23fc3-5825-41f7-b3c6-7350d4f1b7ef tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce441ded6f554ec28560c75de97af173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc67d8de57543c48bdf45669b684227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:46.902100 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-feb23fc3-5825-41f7-b3c6-7350d4f1b7ef tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/efab3398-8820-4a11-8dd2-0f7f51a73763" status: 200 len: 1366 microversion: 2.1 time: 1.110365 Oct 04 18:59:46.907014 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2891/5813] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:45 2022] GET /compute/v2.1/servers/efab3398-8820-4a11-8dd2-0f7f51a73763 => generated 1366 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:46.919171 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f4c94cdd-be39-4624-a140-28583bd2e5f8 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:59:46.919974 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f4c94cdd-be39-4624-a140-28583bd2e5f8 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:46.941837 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f4c94cdd-be39-4624-a140-28583bd2e5f8 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:46.944229 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f4c94cdd-be39-4624-a140-28583bd2e5f8 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:46.944860 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f4c94cdd-be39-4624-a140-28583bd2e5f8 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:46.945789 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f4c94cdd-be39-4624-a140-28583bd2e5f8 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:46.946258 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f4c94cdd-be39-4624-a140-28583bd2e5f8 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:46.946692 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f4c94cdd-be39-4624-a140-28583bd2e5f8 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:46.967067 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-94f49a8d-b527-49ca-9acf-776eebc41f4b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:47.003502 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-94f49a8d-b527-49ca-9acf-776eebc41f4b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/cd8357d8-7845-4c92-ab64-22dbea5c6dbc" status: 200 len: 1215 microversion: 2.1 time: 0.831456 Oct 04 18:59:47.003502 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2923/5814] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:46 2022] GET /compute/v2.1/servers/cd8357d8-7845-4c92-ab64-22dbea5c6dbc => generated 1215 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:59:47.003743 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-f4c94cdd-be39-4624-a140-28583bd2e5f8 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lazy-loading 'flavor' on Instance uuid 7b882133-2fca-4df4-b228-46a12f538c18 {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:59:47.936457 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6fb142ad-2129-438f-b5cd-3027b058b9ef tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:47.937709 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6fb142ad-2129-438f-b5cd-3027b058b9ef tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: efab3398-8820-4a11-8dd2-0f7f51a73763] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:47.942597 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:59:47.947179 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=12 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:59:47.960531 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6fb142ad-2129-438f-b5cd-3027b058b9ef tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:47.961240 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6fb142ad-2129-438f-b5cd-3027b058b9ef tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:47.963189 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6fb142ad-2129-438f-b5cd-3027b058b9ef tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:47.969239 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6fb142ad-2129-438f-b5cd-3027b058b9ef tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:47.972636 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6fb142ad-2129-438f-b5cd-3027b058b9ef tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:47.973274 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6fb142ad-2129-438f-b5cd-3027b058b9ef tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:48.008258 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f4c94cdd-be39-4624-a140-28583bd2e5f8 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "POST /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18/action" status: 202 len: 0 microversion: 2.20 time: 1.095079 Oct 04 18:59:48.014337 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2892/5815] 10.222.0.20 () {62 vars in 1319 bytes} [Tue Oct 4 18:59:46 2022] POST /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18/action => generated 0 bytes in 1106 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:59:48.032354 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8cc7a7eb-5815-4d98-bca8-6b46b1b0b1bc tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:48.035192 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8cc7a7eb-5815-4d98-bca8-6b46b1b0b1bc tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: cd8357d8-7845-4c92-ab64-22dbea5c6dbc] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:48.052921 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8cc7a7eb-5815-4d98-bca8-6b46b1b0b1bc tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:48.056639 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8cc7a7eb-5815-4d98-bca8-6b46b1b0b1bc tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:48.057442 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8cc7a7eb-5815-4d98-bca8-6b46b1b0b1bc tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:48.058904 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8cc7a7eb-5815-4d98-bca8-6b46b1b0b1bc tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:48.061389 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8cc7a7eb-5815-4d98-bca8-6b46b1b0b1bc tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:48.062415 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8cc7a7eb-5815-4d98-bca8-6b46b1b0b1bc tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:48.745957 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8cc7a7eb-5815-4d98-bca8-6b46b1b0b1bc tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:48.754979 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8cc7a7eb-5815-4d98-bca8-6b46b1b0b1bc tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/cd8357d8-7845-4c92-ab64-22dbea5c6dbc" status: 200 len: 1203 microversion: 2.1 time: 0.737228 Oct 04 18:59:48.756235 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2893/5816] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:48 2022] GET /compute/v2.1/servers/cd8357d8-7845-4c92-ab64-22dbea5c6dbc => generated 1203 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:48.756737 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6fb142ad-2129-438f-b5cd-3027b058b9ef tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce441ded6f554ec28560c75de97af173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc67d8de57543c48bdf45669b684227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:48.763083 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-471f818f-1987-4708-9d52-ba8aa92aed82 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:48.763944 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-471f818f-1987-4708-9d52-ba8aa92aed82 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:48.771134 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-471f818f-1987-4708-9d52-ba8aa92aed82 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:48.771669 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6fb142ad-2129-438f-b5cd-3027b058b9ef tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/efab3398-8820-4a11-8dd2-0f7f51a73763" status: 200 len: 1366 microversion: 2.1 time: 0.842169 Oct 04 18:59:48.772302 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2924/5817] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:47 2022] GET /compute/v2.1/servers/efab3398-8820-4a11-8dd2-0f7f51a73763 => generated 1366 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:59:48.772713 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-471f818f-1987-4708-9d52-ba8aa92aed82 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:48.773487 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-471f818f-1987-4708-9d52-ba8aa92aed82 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:48.774454 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-471f818f-1987-4708-9d52-ba8aa92aed82 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:48.775158 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-471f818f-1987-4708-9d52-ba8aa92aed82 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:48.775928 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-471f818f-1987-4708-9d52-ba8aa92aed82 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:49.300967 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=12 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:59:49.554526 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-471f818f-1987-4708-9d52-ba8aa92aed82 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:49.576516 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-471f818f-1987-4708-9d52-ba8aa92aed82 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:49.579868 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-471f818f-1987-4708-9d52-ba8aa92aed82 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:49.581547 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-471f818f-1987-4708-9d52-ba8aa92aed82 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18" status: 200 len: 1722 microversion: 2.20 time: 0.823600 Oct 04 18:59:49.583666 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2894/5818] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:59:48 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 => generated 1722 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:59:49.779027 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e39ff4c8-91c8-43b0-9e44-49ee72ca177a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:49.779683 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e39ff4c8-91c8-43b0-9e44-49ee72ca177a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: cd8357d8-7845-4c92-ab64-22dbea5c6dbc] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:49.791764 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e39ff4c8-91c8-43b0-9e44-49ee72ca177a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:49.792314 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e39ff4c8-91c8-43b0-9e44-49ee72ca177a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:49.792766 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e39ff4c8-91c8-43b0-9e44-49ee72ca177a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:49.796316 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e39ff4c8-91c8-43b0-9e44-49ee72ca177a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:49.797178 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e39ff4c8-91c8-43b0-9e44-49ee72ca177a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:49.797800 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e39ff4c8-91c8-43b0-9e44-49ee72ca177a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:49.799419 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6c2fd5a0-c801-479d-9547-7e1ac2adc0a6 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:49.800986 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-6c2fd5a0-c801-479d-9547-7e1ac2adc0a6 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: efab3398-8820-4a11-8dd2-0f7f51a73763] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:49.810769 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6c2fd5a0-c801-479d-9547-7e1ac2adc0a6 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:49.811587 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6c2fd5a0-c801-479d-9547-7e1ac2adc0a6 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:49.812236 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6c2fd5a0-c801-479d-9547-7e1ac2adc0a6 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:49.813138 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6c2fd5a0-c801-479d-9547-7e1ac2adc0a6 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:49.814072 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6c2fd5a0-c801-479d-9547-7e1ac2adc0a6 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:49.814767 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6c2fd5a0-c801-479d-9547-7e1ac2adc0a6 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:50.504639 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e39ff4c8-91c8-43b0-9e44-49ee72ca177a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:50.509524 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-6c2fd5a0-c801-479d-9547-7e1ac2adc0a6 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce441ded6f554ec28560c75de97af173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc67d8de57543c48bdf45669b684227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:50.514402 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e39ff4c8-91c8-43b0-9e44-49ee72ca177a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/cd8357d8-7845-4c92-ab64-22dbea5c6dbc" status: 200 len: 1203 microversion: 2.1 time: 0.738859 Oct 04 18:59:50.531305 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2925/5819] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:49 2022] GET /compute/v2.1/servers/cd8357d8-7845-4c92-ab64-22dbea5c6dbc => generated 1203 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:50.537171 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-7c680539-8612-443e-99b1-39b121fbefdd req-8c131022-c286-495d-929f-239667db21ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efab3398-8820-4a11-8dd2-0f7f51a73763", "tag": "740a18b8-34ca-450d-a2e5-f7f6a97fe931"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:59:50.538003 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6c2fd5a0-c801-479d-9547-7e1ac2adc0a6 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/efab3398-8820-4a11-8dd2-0f7f51a73763" status: 200 len: 1366 microversion: 2.1 time: 0.742912 Oct 04 18:59:50.541552 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2895/5820] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:49 2022] GET /compute/v2.1/servers/efab3398-8820-4a11-8dd2-0f7f51a73763 => generated 1366 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:59:50.548974 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-7c680539-8612-443e-99b1-39b121fbefdd req-8c131022-c286-495d-929f-239667db21ab service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:50.549821 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-7c680539-8612-443e-99b1-39b121fbefdd req-8c131022-c286-495d-929f-239667db21ab service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:50.550617 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-7c680539-8612-443e-99b1-39b121fbefdd req-8c131022-c286-495d-929f-239667db21ab service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:50.565158 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-7c680539-8612-443e-99b1-39b121fbefdd req-8c131022-c286-495d-929f-239667db21ab service nova] Creating event network-changed:740a18b8-34ca-450d-a2e5-f7f6a97fe931 for instance efab3398-8820-4a11-8dd2-0f7f51a73763 on n-h1-850501-14 Oct 04 18:59:50.571090 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-7c680539-8612-443e-99b1-39b121fbefdd req-8c131022-c286-495d-929f-239667db21ab service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038176 Oct 04 18:59:50.572625 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2926/5821] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:59:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:59:50.615318 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ce4f4d01-4bc4-4668-bc81-257ed29a5f97 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:50.617005 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ce4f4d01-4bc4-4668-bc81-257ed29a5f97 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:50.629651 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ce4f4d01-4bc4-4668-bc81-257ed29a5f97 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:50.633101 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ce4f4d01-4bc4-4668-bc81-257ed29a5f97 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:50.633590 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ce4f4d01-4bc4-4668-bc81-257ed29a5f97 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:50.634340 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ce4f4d01-4bc4-4668-bc81-257ed29a5f97 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:50.637674 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ce4f4d01-4bc4-4668-bc81-257ed29a5f97 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:50.638554 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ce4f4d01-4bc4-4668-bc81-257ed29a5f97 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:51.180495 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ce4f4d01-4bc4-4668-bc81-257ed29a5f97 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:51.194757 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ce4f4d01-4bc4-4668-bc81-257ed29a5f97 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:51.197230 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ce4f4d01-4bc4-4668-bc81-257ed29a5f97 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:51.203231 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ce4f4d01-4bc4-4668-bc81-257ed29a5f97 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18" status: 200 len: 1722 microversion: 2.20 time: 0.592739 Oct 04 18:59:51.203871 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2896/5822] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:59:50 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 => generated 1722 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:59:51.538913 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2b53676c-13f2-4430-94e9-3058bd147da1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:51.540221 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2b53676c-13f2-4430-94e9-3058bd147da1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: cd8357d8-7845-4c92-ab64-22dbea5c6dbc] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:51.555291 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2b53676c-13f2-4430-94e9-3058bd147da1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:51.569877 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5f16415f-71c8-4c58-b07a-8d54adc13032 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:51.571147 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5f16415f-71c8-4c58-b07a-8d54adc13032 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: efab3398-8820-4a11-8dd2-0f7f51a73763] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:51.573080 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2b53676c-13f2-4430-94e9-3058bd147da1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:51.573586 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2b53676c-13f2-4430-94e9-3058bd147da1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:51.574346 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2b53676c-13f2-4430-94e9-3058bd147da1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:51.576686 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2b53676c-13f2-4430-94e9-3058bd147da1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:51.580138 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2b53676c-13f2-4430-94e9-3058bd147da1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:51.600671 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5f16415f-71c8-4c58-b07a-8d54adc13032 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:51.603678 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5f16415f-71c8-4c58-b07a-8d54adc13032 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:51.608375 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5f16415f-71c8-4c58-b07a-8d54adc13032 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:51.608375 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5f16415f-71c8-4c58-b07a-8d54adc13032 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:51.608375 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5f16415f-71c8-4c58-b07a-8d54adc13032 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:51.608375 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5f16415f-71c8-4c58-b07a-8d54adc13032 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:52.010776 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-2b53676c-13f2-4430-94e9-3058bd147da1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:52.021232 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5f16415f-71c8-4c58-b07a-8d54adc13032 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce441ded6f554ec28560c75de97af173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc67d8de57543c48bdf45669b684227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:52.029566 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2b53676c-13f2-4430-94e9-3058bd147da1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/cd8357d8-7845-4c92-ab64-22dbea5c6dbc" status: 200 len: 1203 microversion: 2.1 time: 0.494241 Oct 04 18:59:52.031909 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5f16415f-71c8-4c58-b07a-8d54adc13032 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/efab3398-8820-4a11-8dd2-0f7f51a73763" status: 200 len: 1366 microversion: 2.1 time: 0.467234 Oct 04 18:59:52.032172 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2927/5823] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:51 2022] GET /compute/v2.1/servers/cd8357d8-7845-4c92-ab64-22dbea5c6dbc => generated 1203 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:52.033201 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2897/5824] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:51 2022] GET /compute/v2.1/servers/efab3398-8820-4a11-8dd2-0f7f51a73763 => generated 1366 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:59:52.247417 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-15b0792a-c914-4053-a90c-949cc0b05e92 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:52.247417 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-15b0792a-c914-4053-a90c-949cc0b05e92 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:52.259341 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-15b0792a-c914-4053-a90c-949cc0b05e92 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:52.260437 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-15b0792a-c914-4053-a90c-949cc0b05e92 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:52.261087 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-15b0792a-c914-4053-a90c-949cc0b05e92 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:52.262219 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-15b0792a-c914-4053-a90c-949cc0b05e92 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:52.263179 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-15b0792a-c914-4053-a90c-949cc0b05e92 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:52.263903 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-15b0792a-c914-4053-a90c-949cc0b05e92 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:52.756126 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9a986a5b-cfed-4688-815c-6c635239c061 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Action: 'create', calling method: .version_select at 0x7fe25d131820>, body: {"keypair": {"name": "tempest-TestServerBasicOps-1216014711", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEoowopOahN0QsYXSzF8BqJpYsP8Vyx/UARoxSxZb1Sf2OlTbMTgPMmW2ExLtxw6/k3HVNIBhJ6OujdHcoWofJ4gM4FxkI740rdjQ1RS8z+rW9GQKmx7yjq77Eup/u669A=="}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:59:52.777504 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-9a986a5b-cfed-4688-815c-6c635239c061 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Getting quotas for project d039c1953c26418d9a0b70444bc76a64. Resources: {'key_pairs'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:59:52.785905 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-9a986a5b-cfed-4688-815c-6c635239c061 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Getting quotas for user c07d8700f1d64a47b5f1b105178b60be and project d039c1953c26418d9a0b70444bc76a64. Resources: {'key_pairs'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:59:52.933088 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9a986a5b-cfed-4688-815c-6c635239c061 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.679156 Oct 04 18:59:52.933850 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2898/5825] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Oct 4 18:59:52 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:59:52.949732 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5f4b7c34-af28-46bc-89c6-81d4a95c4888 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "99fd733b-05a0-4e44-80d9-94ddcb07339b", "device": "/dev/sdb"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:59:52.952756 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5f4b7c34-af28-46bc-89c6-81d4a95c4888 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] [instance: 3edcc394-83d7-4358-8f99-af546b861685] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:52.961338 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5f4b7c34-af28-46bc-89c6-81d4a95c4888 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:52.962233 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5f4b7c34-af28-46bc-89c6-81d4a95c4888 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:52.962839 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5f4b7c34-af28-46bc-89c6-81d4a95c4888 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:52.963833 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5f4b7c34-af28-46bc-89c6-81d4a95c4888 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:52.964566 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5f4b7c34-af28-46bc-89c6-81d4a95c4888 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:52.965149 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5f4b7c34-af28-46bc-89c6-81d4a95c4888 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:53.046227 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-15b0792a-c914-4053-a90c-949cc0b05e92 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:53.067236 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-15b0792a-c914-4053-a90c-949cc0b05e92 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:53.079320 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:59:53.087953 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-15b0792a-c914-4053-a90c-949cc0b05e92 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:53.094921 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-15b0792a-c914-4053-a90c-949cc0b05e92 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18" status: 200 len: 1722 microversion: 2.20 time: 0.863294 Oct 04 18:59:53.096906 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2928/5826] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:59:52 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 => generated 1722 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:59:53.104617 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c6a632ed-bd27-4713-aac0-d82b0e9d0089 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:53.105621 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c6a632ed-bd27-4713-aac0-d82b0e9d0089 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: cd8357d8-7845-4c92-ab64-22dbea5c6dbc] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:53.113836 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c6a632ed-bd27-4713-aac0-d82b0e9d0089 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:53.115123 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c6a632ed-bd27-4713-aac0-d82b0e9d0089 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:53.115819 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c6a632ed-bd27-4713-aac0-d82b0e9d0089 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:53.116820 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c6a632ed-bd27-4713-aac0-d82b0e9d0089 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:53.117509 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c6a632ed-bd27-4713-aac0-d82b0e9d0089 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:53.118156 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c6a632ed-bd27-4713-aac0-d82b0e9d0089 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:53.515090 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c6a632ed-bd27-4713-aac0-d82b0e9d0089 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:53.528516 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c6a632ed-bd27-4713-aac0-d82b0e9d0089 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/cd8357d8-7845-4c92-ab64-22dbea5c6dbc" status: 200 len: 1203 microversion: 2.1 time: 0.428291 Oct 04 18:59:53.530075 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2929/5827] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:53 2022] GET /compute/v2.1/servers/cd8357d8-7845-4c92-ab64-22dbea5c6dbc => generated 1203 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:53.536898 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c6ab468f-1271-4e17-ab5e-f5f61b5e6d73 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:53.537833 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c6ab468f-1271-4e17-ab5e-f5f61b5e6d73 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: efab3398-8820-4a11-8dd2-0f7f51a73763] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:53.547587 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c6ab468f-1271-4e17-ab5e-f5f61b5e6d73 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:53.555703 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c6ab468f-1271-4e17-ab5e-f5f61b5e6d73 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:53.555703 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c6ab468f-1271-4e17-ab5e-f5f61b5e6d73 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:53.555703 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c6ab468f-1271-4e17-ab5e-f5f61b5e6d73 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:53.555703 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c6ab468f-1271-4e17-ab5e-f5f61b5e6d73 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:53.555703 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c6ab468f-1271-4e17-ab5e-f5f61b5e6d73 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:53.908952 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5f4b7c34-af28-46bc-89c6-81d4a95c4888 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] 10.222.0.20 "POST /compute/v2.1/servers/3edcc394-83d7-4358-8f99-af546b861685/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.973553 Oct 04 18:59:53.910865 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2899/5828] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Oct 4 18:59:52 2022] POST /compute/v2.1/servers/3edcc394-83d7-4358-8f99-af546b861685/os-volume_attachments => generated 194 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:59:53.930141 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c6ab468f-1271-4e17-ab5e-f5f61b5e6d73 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce441ded6f554ec28560c75de97af173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc67d8de57543c48bdf45669b684227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:53.936408 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c6ab468f-1271-4e17-ab5e-f5f61b5e6d73 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/efab3398-8820-4a11-8dd2-0f7f51a73763" status: 200 len: 1366 microversion: 2.1 time: 0.405118 Oct 04 18:59:53.937005 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2930/5829] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:53 2022] GET /compute/v2.1/servers/efab3398-8820-4a11-8dd2-0f7f51a73763 => generated 1366 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:54.130616 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6561befb-8ce5-49dc-84a7-0e0c145dc544 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:54.131592 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-6561befb-8ce5-49dc-84a7-0e0c145dc544 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:54.138810 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6561befb-8ce5-49dc-84a7-0e0c145dc544 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:54.140958 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6561befb-8ce5-49dc-84a7-0e0c145dc544 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:54.140958 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6561befb-8ce5-49dc-84a7-0e0c145dc544 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:54.140958 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6561befb-8ce5-49dc-84a7-0e0c145dc544 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:54.141253 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6561befb-8ce5-49dc-84a7-0e0c145dc544 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:54.141909 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6561befb-8ce5-49dc-84a7-0e0c145dc544 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:54.455528 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-6561befb-8ce5-49dc-84a7-0e0c145dc544 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:54.468769 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-6561befb-8ce5-49dc-84a7-0e0c145dc544 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:54.471134 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-6561befb-8ce5-49dc-84a7-0e0c145dc544 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:54.481320 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6561befb-8ce5-49dc-84a7-0e0c145dc544 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18" status: 200 len: 1722 microversion: 2.20 time: 0.355887 Oct 04 18:59:54.499498 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2900/5830] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:59:54 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 => generated 1722 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:59:54.560391 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a388c4c2-4bc5-4320-bd2d-0245f409c0a6 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:54.565981 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a388c4c2-4bc5-4320-bd2d-0245f409c0a6 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: cd8357d8-7845-4c92-ab64-22dbea5c6dbc] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:54.575583 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a388c4c2-4bc5-4320-bd2d-0245f409c0a6 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:54.576402 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a388c4c2-4bc5-4320-bd2d-0245f409c0a6 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:54.577026 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a388c4c2-4bc5-4320-bd2d-0245f409c0a6 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:54.578074 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a388c4c2-4bc5-4320-bd2d-0245f409c0a6 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:54.578791 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a388c4c2-4bc5-4320-bd2d-0245f409c0a6 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:54.579417 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a388c4c2-4bc5-4320-bd2d-0245f409c0a6 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:54.815272 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a388c4c2-4bc5-4320-bd2d-0245f409c0a6 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:54.825126 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a388c4c2-4bc5-4320-bd2d-0245f409c0a6 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/cd8357d8-7845-4c92-ab64-22dbea5c6dbc" status: 200 len: 1203 microversion: 2.1 time: 0.272833 Oct 04 18:59:54.825716 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2931/5831] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:54 2022] GET /compute/v2.1/servers/cd8357d8-7845-4c92-ab64-22dbea5c6dbc => generated 1203 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:54.965829 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-72f9b739-e5a8-4684-be94-32b2d8bdfe8d tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:54.966474 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-72f9b739-e5a8-4684-be94-32b2d8bdfe8d tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: efab3398-8820-4a11-8dd2-0f7f51a73763] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:54.982425 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-72f9b739-e5a8-4684-be94-32b2d8bdfe8d tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:54.982944 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-72f9b739-e5a8-4684-be94-32b2d8bdfe8d tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:54.983391 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-72f9b739-e5a8-4684-be94-32b2d8bdfe8d tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:54.986656 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-72f9b739-e5a8-4684-be94-32b2d8bdfe8d tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:54.987159 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-72f9b739-e5a8-4684-be94-32b2d8bdfe8d tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:54.987610 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-72f9b739-e5a8-4684-be94-32b2d8bdfe8d tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:55.474765 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-72f9b739-e5a8-4684-be94-32b2d8bdfe8d tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce441ded6f554ec28560c75de97af173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc67d8de57543c48bdf45669b684227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:55.482151 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-72f9b739-e5a8-4684-be94-32b2d8bdfe8d tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/efab3398-8820-4a11-8dd2-0f7f51a73763" status: 200 len: 1366 microversion: 2.1 time: 0.520870 Oct 04 18:59:55.482666 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2901/5832] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:54 2022] GET /compute/v2.1/servers/efab3398-8820-4a11-8dd2-0f7f51a73763 => generated 1366 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:55.511342 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c0eb5ed8-c26c-4f0e-aed2-c8c051cdd51a tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:55.512090 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c0eb5ed8-c26c-4f0e-aed2-c8c051cdd51a tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:55.534578 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c0eb5ed8-c26c-4f0e-aed2-c8c051cdd51a tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:55.534578 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c0eb5ed8-c26c-4f0e-aed2-c8c051cdd51a tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:55.534578 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c0eb5ed8-c26c-4f0e-aed2-c8c051cdd51a tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:55.535661 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c0eb5ed8-c26c-4f0e-aed2-c8c051cdd51a tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:55.536476 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c0eb5ed8-c26c-4f0e-aed2-c8c051cdd51a tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:55.540750 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c0eb5ed8-c26c-4f0e-aed2-c8c051cdd51a tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:55.599460 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:59:55.808588 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c0eb5ed8-c26c-4f0e-aed2-c8c051cdd51a tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:55.819228 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c0eb5ed8-c26c-4f0e-aed2-c8c051cdd51a tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:55.824390 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c0eb5ed8-c26c-4f0e-aed2-c8c051cdd51a tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:55.825696 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c0eb5ed8-c26c-4f0e-aed2-c8c051cdd51a tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18" status: 200 len: 1722 microversion: 2.20 time: 0.319273 Oct 04 18:59:55.828533 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2932/5833] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:59:55 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 => generated 1722 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:59:55.855946 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a9ad1f58-e7c7-46ec-bc78-1679ca3cdf68 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:55.859730 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a9ad1f58-e7c7-46ec-bc78-1679ca3cdf68 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: cd8357d8-7845-4c92-ab64-22dbea5c6dbc] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:55.868945 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a9ad1f58-e7c7-46ec-bc78-1679ca3cdf68 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:55.869480 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a9ad1f58-e7c7-46ec-bc78-1679ca3cdf68 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:55.869917 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a9ad1f58-e7c7-46ec-bc78-1679ca3cdf68 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:55.870636 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a9ad1f58-e7c7-46ec-bc78-1679ca3cdf68 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:55.871085 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a9ad1f58-e7c7-46ec-bc78-1679ca3cdf68 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:55.875626 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a9ad1f58-e7c7-46ec-bc78-1679ca3cdf68 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:56.520719 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-97c65ff2-4233-475d-a265-71b93cf8e867 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:56.521544 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-97c65ff2-4233-475d-a265-71b93cf8e867 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: efab3398-8820-4a11-8dd2-0f7f51a73763] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:56.529699 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-97c65ff2-4233-475d-a265-71b93cf8e867 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:56.530431 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-97c65ff2-4233-475d-a265-71b93cf8e867 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:56.531034 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-97c65ff2-4233-475d-a265-71b93cf8e867 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:56.532736 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-97c65ff2-4233-475d-a265-71b93cf8e867 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:56.533389 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-97c65ff2-4233-475d-a265-71b93cf8e867 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:56.534347 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-97c65ff2-4233-475d-a265-71b93cf8e867 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:56.905552 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a9ad1f58-e7c7-46ec-bc78-1679ca3cdf68 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:56.916403 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a9ad1f58-e7c7-46ec-bc78-1679ca3cdf68 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/cd8357d8-7845-4c92-ab64-22dbea5c6dbc" status: 200 len: 1203 microversion: 2.1 time: 1.064239 Oct 04 18:59:56.918652 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2902/5834] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:55 2022] GET /compute/v2.1/servers/cd8357d8-7845-4c92-ab64-22dbea5c6dbc => generated 1203 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:56.939556 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-555917b2-7d06-43f8-a713-bd85ae41f9c7 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:56.944179 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-555917b2-7d06-43f8-a713-bd85ae41f9c7 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:56.955195 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-555917b2-7d06-43f8-a713-bd85ae41f9c7 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:56.956457 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-555917b2-7d06-43f8-a713-bd85ae41f9c7 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:56.959036 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-555917b2-7d06-43f8-a713-bd85ae41f9c7 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:56.960114 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-555917b2-7d06-43f8-a713-bd85ae41f9c7 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:56.960801 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-555917b2-7d06-43f8-a713-bd85ae41f9c7 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:56.963127 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-555917b2-7d06-43f8-a713-bd85ae41f9c7 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:56.988135 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-97c65ff2-4233-475d-a265-71b93cf8e867 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce441ded6f554ec28560c75de97af173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc67d8de57543c48bdf45669b684227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:57.012474 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-97c65ff2-4233-475d-a265-71b93cf8e867 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/efab3398-8820-4a11-8dd2-0f7f51a73763" status: 200 len: 1366 microversion: 2.1 time: 0.510868 Oct 04 18:59:57.013081 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2933/5835] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:56 2022] GET /compute/v2.1/servers/efab3398-8820-4a11-8dd2-0f7f51a73763 => generated 1366 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:57.257071 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-555917b2-7d06-43f8-a713-bd85ae41f9c7 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:57.277625 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-555917b2-7d06-43f8-a713-bd85ae41f9c7 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:57.279150 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-555917b2-7d06-43f8-a713-bd85ae41f9c7 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:57.282159 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-555917b2-7d06-43f8-a713-bd85ae41f9c7 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18" status: 200 len: 1722 microversion: 2.20 time: 0.361712 Oct 04 18:59:57.292195 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2903/5836] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:59:56 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 => generated 1722 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:59:57.421749 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6c0fa02f-abdb-41ab-a256-835fd74d6a16 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-266537658", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-1216014711", "security_groups": [{"name": "tempest-secgroup-smoke-590815972"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "b85ad93c-ffb4-42ce-8e0f-b36fc5ae771f"}]}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:59:57.556025 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.neutron [None req-6c0fa02f-abdb-41ab-a256-835fd74d6a16 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] validate_networks() for [('b85ad93c-ffb4-42ce-8e0f-b36fc5ae771f', None, None, None, None, None)] {{(pid=123001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:59:57.944720 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-52d77906-42f7-4d4a-8fb9-ef88c2f4a51e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:57.946008 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-52d77906-42f7-4d4a-8fb9-ef88c2f4a51e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: cd8357d8-7845-4c92-ab64-22dbea5c6dbc] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:57.976830 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-52d77906-42f7-4d4a-8fb9-ef88c2f4a51e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:57.977200 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-52d77906-42f7-4d4a-8fb9-ef88c2f4a51e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:57.977843 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-52d77906-42f7-4d4a-8fb9-ef88c2f4a51e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:57.978596 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-52d77906-42f7-4d4a-8fb9-ef88c2f4a51e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:57.979731 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-52d77906-42f7-4d4a-8fb9-ef88c2f4a51e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:57.980185 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-52d77906-42f7-4d4a-8fb9-ef88c2f4a51e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:58.195474 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=4 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:59:58.205816 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-6c0fa02f-abdb-41ab-a256-835fd74d6a16 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Getting quotas for project d039c1953c26418d9a0b70444bc76a64. Resources: dict_keys(['metadata_items']) {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:59:58.217025 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-52d77906-42f7-4d4a-8fb9-ef88c2f4a51e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:58.217178 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-6c0fa02f-abdb-41ab-a256-835fd74d6a16 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Getting quotas for user c07d8700f1d64a47b5f1b105178b60be and project d039c1953c26418d9a0b70444bc76a64. Resources: dict_keys(['metadata_items']) {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:59:58.228904 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-52d77906-42f7-4d4a-8fb9-ef88c2f4a51e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/cd8357d8-7845-4c92-ab64-22dbea5c6dbc" status: 200 len: 1203 microversion: 2.1 time: 0.288276 Oct 04 18:59:58.239029 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-6c0fa02f-abdb-41ab-a256-835fd74d6a16 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:59:58.239700 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-6c0fa02f-abdb-41ab-a256-835fd74d6a16 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:59:58.240439 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-6c0fa02f-abdb-41ab-a256-835fd74d6a16 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:59:58.241068 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-6c0fa02f-abdb-41ab-a256-835fd74d6a16 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:59:58.241676 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2904/5837] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:57 2022] GET /compute/v2.1/servers/cd8357d8-7845-4c92-ab64-22dbea5c6dbc => generated 1203 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:58.241962 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-6c0fa02f-abdb-41ab-a256-835fd74d6a16 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:59:58.253717 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a645ee2f-aee3-49c3-962c-82e7960305f0 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:58.254786 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a645ee2f-aee3-49c3-962c-82e7960305f0 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: efab3398-8820-4a11-8dd2-0f7f51a73763] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:58.255458 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6c0fa02f-abdb-41ab-a256-835fd74d6a16 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:58.256400 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6c0fa02f-abdb-41ab-a256-835fd74d6a16 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:58.257075 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6c0fa02f-abdb-41ab-a256-835fd74d6a16 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:58.258060 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6c0fa02f-abdb-41ab-a256-835fd74d6a16 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:58.258725 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6c0fa02f-abdb-41ab-a256-835fd74d6a16 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:58.259506 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6c0fa02f-abdb-41ab-a256-835fd74d6a16 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:58.261964 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a645ee2f-aee3-49c3-962c-82e7960305f0 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:58.273075 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a645ee2f-aee3-49c3-962c-82e7960305f0 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:58.273075 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a645ee2f-aee3-49c3-962c-82e7960305f0 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:58.273075 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a645ee2f-aee3-49c3-962c-82e7960305f0 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:58.273075 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a645ee2f-aee3-49c3-962c-82e7960305f0 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:58.273075 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a645ee2f-aee3-49c3-962c-82e7960305f0 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:58.284966 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-6c0fa02f-abdb-41ab-a256-835fd74d6a16 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Getting quotas for project d039c1953c26418d9a0b70444bc76a64. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:59:58.292270 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-6c0fa02f-abdb-41ab-a256-835fd74d6a16 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Getting quotas for user c07d8700f1d64a47b5f1b105178b60be and project d039c1953c26418d9a0b70444bc76a64. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:59:58.308855 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6c0fa02f-abdb-41ab-a256-835fd74d6a16 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Going to run 1 instances... {{(pid=123001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:59:58.314098 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6c0fa02f-abdb-41ab-a256-835fd74d6a16 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] [instance: 505e8d54-138e-404a-a403-1bd5c9b0c4ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:59:58.439078 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6c0fa02f-abdb-41ab-a256-835fd74d6a16 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.022297 Oct 04 18:59:58.443702 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2934/5838] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 18:59:57 2022] POST /compute/v2.1/servers => generated 405 bytes in 1028 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:59:58.455793 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b2579241-3a87-4f1a-a31f-d4b397d6fe5f tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:58.460229 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b2579241-3a87-4f1a-a31f-d4b397d6fe5f tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:58.480899 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b2579241-3a87-4f1a-a31f-d4b397d6fe5f tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:58.481394 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b2579241-3a87-4f1a-a31f-d4b397d6fe5f tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:58.481835 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b2579241-3a87-4f1a-a31f-d4b397d6fe5f tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:58.482541 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b2579241-3a87-4f1a-a31f-d4b397d6fe5f tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:58.482996 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b2579241-3a87-4f1a-a31f-d4b397d6fe5f tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:58.489295 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b2579241-3a87-4f1a-a31f-d4b397d6fe5f tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:58.526655 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a645ee2f-aee3-49c3-962c-82e7960305f0 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce441ded6f554ec28560c75de97af173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc67d8de57543c48bdf45669b684227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:58.539820 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a645ee2f-aee3-49c3-962c-82e7960305f0 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/efab3398-8820-4a11-8dd2-0f7f51a73763" status: 200 len: 1366 microversion: 2.1 time: 0.290860 Oct 04 18:59:58.560435 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2905/5839] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:58 2022] GET /compute/v2.1/servers/efab3398-8820-4a11-8dd2-0f7f51a73763 => generated 1366 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:58.589846 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b57d6b5a-34a1-4848-a7d1-d2633fa53111 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:58.589846 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b57d6b5a-34a1-4848-a7d1-d2633fa53111 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] [instance: 505e8d54-138e-404a-a403-1bd5c9b0c4ab] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:58.704902 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b57d6b5a-34a1-4848-a7d1-d2633fa53111 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07d8700f1d64a47b5f1b105178b60be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039c1953c26418d9a0b70444bc76a64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:58.714813 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b57d6b5a-34a1-4848-a7d1-d2633fa53111 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] 10.222.0.20 "GET /compute/v2.1/servers/505e8d54-138e-404a-a403-1bd5c9b0c4ab" status: 200 len: 1302 microversion: 2.1 time: 0.152853 Oct 04 18:59:58.729860 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2906/5840] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:58 2022] GET /compute/v2.1/servers/505e8d54-138e-404a-a403-1bd5c9b0c4ab => generated 1302 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:58.793148 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b2579241-3a87-4f1a-a31f-d4b397d6fe5f tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:58.810842 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b2579241-3a87-4f1a-a31f-d4b397d6fe5f tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:58.812864 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b2579241-3a87-4f1a-a31f-d4b397d6fe5f tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:58.814530 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b2579241-3a87-4f1a-a31f-d4b397d6fe5f tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18" status: 200 len: 1722 microversion: 2.20 time: 0.368516 Oct 04 18:59:58.815247 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2935/5841] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:59:58 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 => generated 1722 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:59:59.113382 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-bd2447c6-49d7-4f70-a217-bd002e463420 req-9e8c24d8-69e8-4eb1-b466-1d4aa649c8d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efab3398-8820-4a11-8dd2-0f7f51a73763", "name": "network-vif-plugged", "status": "completed", "tag": "740a18b8-34ca-450d-a2e5-f7f6a97fe931"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:59:59.126159 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-bd2447c6-49d7-4f70-a217-bd002e463420 req-9e8c24d8-69e8-4eb1-b466-1d4aa649c8d7 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:59.126823 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-bd2447c6-49d7-4f70-a217-bd002e463420 req-9e8c24d8-69e8-4eb1-b466-1d4aa649c8d7 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:59.128730 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-bd2447c6-49d7-4f70-a217-bd002e463420 req-9e8c24d8-69e8-4eb1-b466-1d4aa649c8d7 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:59.139537 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-bd2447c6-49d7-4f70-a217-bd002e463420 req-9e8c24d8-69e8-4eb1-b466-1d4aa649c8d7 service nova] Creating event network-vif-plugged:740a18b8-34ca-450d-a2e5-f7f6a97fe931 for instance efab3398-8820-4a11-8dd2-0f7f51a73763 on n-h1-850501-14 Oct 04 18:59:59.145619 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-bd2447c6-49d7-4f70-a217-bd002e463420 req-9e8c24d8-69e8-4eb1-b466-1d4aa649c8d7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035925 Oct 04 18:59:59.146740 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2907/5842] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 18:59:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:59:59.255706 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c850df04-3972-4ce9-b181-08b28a78c421 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:59.256360 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c850df04-3972-4ce9-b181-08b28a78c421 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: cd8357d8-7845-4c92-ab64-22dbea5c6dbc] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:59.277970 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c850df04-3972-4ce9-b181-08b28a78c421 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:59.277970 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c850df04-3972-4ce9-b181-08b28a78c421 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:59.277970 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c850df04-3972-4ce9-b181-08b28a78c421 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:59.277970 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c850df04-3972-4ce9-b181-08b28a78c421 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:59.278408 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c850df04-3972-4ce9-b181-08b28a78c421 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:59.278525 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c850df04-3972-4ce9-b181-08b28a78c421 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:59.495620 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c850df04-3972-4ce9-b181-08b28a78c421 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:59.508042 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c850df04-3972-4ce9-b181-08b28a78c421 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/cd8357d8-7845-4c92-ab64-22dbea5c6dbc" status: 200 len: 1203 microversion: 2.1 time: 0.256540 Oct 04 18:59:59.508666 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2936/5843] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:59 2022] GET /compute/v2.1/servers/cd8357d8-7845-4c92-ab64-22dbea5c6dbc => generated 1203 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:59.569384 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ea3b0d01-97d9-48d5-8a63-968c34cc963f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:59.570094 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ea3b0d01-97d9-48d5-8a63-968c34cc963f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: efab3398-8820-4a11-8dd2-0f7f51a73763] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:59.580900 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=4 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:59:59.588088 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ea3b0d01-97d9-48d5-8a63-968c34cc963f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:59.588642 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ea3b0d01-97d9-48d5-8a63-968c34cc963f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:59.589088 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ea3b0d01-97d9-48d5-8a63-968c34cc963f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:59.591087 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ea3b0d01-97d9-48d5-8a63-968c34cc963f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:59.592211 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ea3b0d01-97d9-48d5-8a63-968c34cc963f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:59.595373 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ea3b0d01-97d9-48d5-8a63-968c34cc963f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:59.745470 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-fc596823-59ad-4d75-b7fc-1dbbfa1e4c2e tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:59.746312 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-fc596823-59ad-4d75-b7fc-1dbbfa1e4c2e tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] [instance: 505e8d54-138e-404a-a403-1bd5c9b0c4ab] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:59.823098 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-fc596823-59ad-4d75-b7fc-1dbbfa1e4c2e tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07d8700f1d64a47b5f1b105178b60be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039c1953c26418d9a0b70444bc76a64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:59.833807 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-fc596823-59ad-4d75-b7fc-1dbbfa1e4c2e tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] 10.222.0.20 "GET /compute/v2.1/servers/505e8d54-138e-404a-a403-1bd5c9b0c4ab" status: 200 len: 1302 microversion: 2.1 time: 0.091853 Oct 04 18:59:59.834994 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2937/5844] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:59 2022] GET /compute/v2.1/servers/505e8d54-138e-404a-a403-1bd5c9b0c4ab => generated 1302 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:59.866799 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a3bc8e0a-8b86-44c2-9539-b5aa4ef916ef tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:59.867811 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a3bc8e0a-8b86-44c2-9539-b5aa4ef916ef tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:59.876441 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a3bc8e0a-8b86-44c2-9539-b5aa4ef916ef tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:59.877281 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a3bc8e0a-8b86-44c2-9539-b5aa4ef916ef tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:59.896048 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a3bc8e0a-8b86-44c2-9539-b5aa4ef916ef tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:59.898134 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a3bc8e0a-8b86-44c2-9539-b5aa4ef916ef tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:59.900494 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a3bc8e0a-8b86-44c2-9539-b5aa4ef916ef tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:59.901683 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a3bc8e0a-8b86-44c2-9539-b5aa4ef916ef tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:00.150450 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ea3b0d01-97d9-48d5-8a63-968c34cc963f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce441ded6f554ec28560c75de97af173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc67d8de57543c48bdf45669b684227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:00.165629 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ea3b0d01-97d9-48d5-8a63-968c34cc963f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/efab3398-8820-4a11-8dd2-0f7f51a73763" status: 200 len: 1366 microversion: 2.1 time: 0.600257 Oct 04 19:00:00.168530 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2908/5845] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:59 2022] GET /compute/v2.1/servers/efab3398-8820-4a11-8dd2-0f7f51a73763 => generated 1366 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:00.177580 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a3bc8e0a-8b86-44c2-9539-b5aa4ef916ef tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:00.193785 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a3bc8e0a-8b86-44c2-9539-b5aa4ef916ef tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:00.195637 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a3bc8e0a-8b86-44c2-9539-b5aa4ef916ef tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:00.200792 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a3bc8e0a-8b86-44c2-9539-b5aa4ef916ef tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18" status: 200 len: 1743 microversion: 2.20 time: 0.360365 Oct 04 19:00:00.202025 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2938/5846] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 18:59:59 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 => generated 1743 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:00:00.532646 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5e8801a4-c944-46c3-bb69-08fc66f13e76 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:00.533368 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5e8801a4-c944-46c3-bb69-08fc66f13e76 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: cd8357d8-7845-4c92-ab64-22dbea5c6dbc] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:00.552097 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5e8801a4-c944-46c3-bb69-08fc66f13e76 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:00.552097 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5e8801a4-c944-46c3-bb69-08fc66f13e76 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:00.552097 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5e8801a4-c944-46c3-bb69-08fc66f13e76 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:00.552798 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5e8801a4-c944-46c3-bb69-08fc66f13e76 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:00.560695 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5e8801a4-c944-46c3-bb69-08fc66f13e76 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:00.560695 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5e8801a4-c944-46c3-bb69-08fc66f13e76 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:00.863696 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b8d72a7e-6133-4015-9e4e-f5aa3c573575 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:00.864425 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b8d72a7e-6133-4015-9e4e-f5aa3c573575 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] [instance: 505e8d54-138e-404a-a403-1bd5c9b0c4ab] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:00.887879 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b8d72a7e-6133-4015-9e4e-f5aa3c573575 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:00.888438 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b8d72a7e-6133-4015-9e4e-f5aa3c573575 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:00.888884 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b8d72a7e-6133-4015-9e4e-f5aa3c573575 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:00.889613 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b8d72a7e-6133-4015-9e4e-f5aa3c573575 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:00.890075 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b8d72a7e-6133-4015-9e4e-f5aa3c573575 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:00.890500 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b8d72a7e-6133-4015-9e4e-f5aa3c573575 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:01.056232 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b8d72a7e-6133-4015-9e4e-f5aa3c573575 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07d8700f1d64a47b5f1b105178b60be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039c1953c26418d9a0b70444bc76a64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:01.075481 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b8d72a7e-6133-4015-9e4e-f5aa3c573575 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] 10.222.0.20 "GET /compute/v2.1/servers/505e8d54-138e-404a-a403-1bd5c9b0c4ab" status: 200 len: 1354 microversion: 2.1 time: 0.217103 Oct 04 19:00:01.077410 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2939/5847] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:00 2022] GET /compute/v2.1/servers/505e8d54-138e-404a-a403-1bd5c9b0c4ab => generated 1354 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:01.082606 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5e8801a4-c944-46c3-bb69-08fc66f13e76 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:01.101452 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5e8801a4-c944-46c3-bb69-08fc66f13e76 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/cd8357d8-7845-4c92-ab64-22dbea5c6dbc" status: 200 len: 1203 microversion: 2.1 time: 0.572522 Oct 04 19:00:01.113459 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2909/5848] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:00 2022] GET /compute/v2.1/servers/cd8357d8-7845-4c92-ab64-22dbea5c6dbc => generated 1203 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:01.166973 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-91d3c364-6d67-4c35-97f5-3a644c1b08e5 req-e7794938-0838-4ebf-903c-2199ce09df2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd8357d8-7845-4c92-ab64-22dbea5c6dbc", "name": "network-vif-plugged", "status": "completed", "tag": "4dfcc6bf-552f-4e81-a0ee-414651aba0e0"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:00:01.187995 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-91d3c364-6d67-4c35-97f5-3a644c1b08e5 req-e7794938-0838-4ebf-903c-2199ce09df2b service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:01.189857 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-91d3c364-6d67-4c35-97f5-3a644c1b08e5 req-e7794938-0838-4ebf-903c-2199ce09df2b service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:01.191428 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-91d3c364-6d67-4c35-97f5-3a644c1b08e5 req-e7794938-0838-4ebf-903c-2199ce09df2b service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:01.201548 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-94d95797-5c5f-438b-95c9-33792c09455c tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:01.202511 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-94d95797-5c5f-438b-95c9-33792c09455c tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: efab3398-8820-4a11-8dd2-0f7f51a73763] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:01.209191 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-91d3c364-6d67-4c35-97f5-3a644c1b08e5 req-e7794938-0838-4ebf-903c-2199ce09df2b service nova] Creating event network-vif-plugged:4dfcc6bf-552f-4e81-a0ee-414651aba0e0 for instance cd8357d8-7845-4c92-ab64-22dbea5c6dbc on n-h2-850501-14 Oct 04 19:00:01.215389 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-91d3c364-6d67-4c35-97f5-3a644c1b08e5 req-e7794938-0838-4ebf-903c-2199ce09df2b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054222 Oct 04 19:00:01.218531 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2940/5849] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:00:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:00:01.224442 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-94d95797-5c5f-438b-95c9-33792c09455c tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:01.225182 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-94d95797-5c5f-438b-95c9-33792c09455c tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:01.227690 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-94d95797-5c5f-438b-95c9-33792c09455c tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:01.228783 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-94d95797-5c5f-438b-95c9-33792c09455c tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:01.229550 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-94d95797-5c5f-438b-95c9-33792c09455c tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:01.230223 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-94d95797-5c5f-438b-95c9-33792c09455c tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:01.276702 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6fbbaf92-2406-4a25-9c52-db13a0566f3f tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:01.277524 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6fbbaf92-2406-4a25-9c52-db13a0566f3f tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:01.308698 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6fbbaf92-2406-4a25-9c52-db13a0566f3f tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:01.309405 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6fbbaf92-2406-4a25-9c52-db13a0566f3f tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:01.311491 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6fbbaf92-2406-4a25-9c52-db13a0566f3f tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:01.313715 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6fbbaf92-2406-4a25-9c52-db13a0566f3f tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:01.318376 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6fbbaf92-2406-4a25-9c52-db13a0566f3f tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:01.320668 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6fbbaf92-2406-4a25-9c52-db13a0566f3f tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:01.828358 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-94d95797-5c5f-438b-95c9-33792c09455c tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce441ded6f554ec28560c75de97af173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc67d8de57543c48bdf45669b684227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:01.837841 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-94d95797-5c5f-438b-95c9-33792c09455c tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/efab3398-8820-4a11-8dd2-0f7f51a73763" status: 200 len: 1366 microversion: 2.1 time: 0.650204 Oct 04 19:00:01.840738 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2910/5850] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:01 2022] GET /compute/v2.1/servers/efab3398-8820-4a11-8dd2-0f7f51a73763 => generated 1366 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:00:01.852351 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6fbbaf92-2406-4a25-9c52-db13a0566f3f tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:01.862857 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6fbbaf92-2406-4a25-9c52-db13a0566f3f tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:01.864679 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6fbbaf92-2406-4a25-9c52-db13a0566f3f tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:01.866791 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6fbbaf92-2406-4a25-9c52-db13a0566f3f tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18" status: 200 len: 1738 microversion: 2.20 time: 0.637549 Oct 04 19:00:01.868635 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2941/5851] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:00:01 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 => generated 1738 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:00:02.110072 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e5ce6da6-6cda-43e7-af0e-229df2cddad9 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:02.111114 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e5ce6da6-6cda-43e7-af0e-229df2cddad9 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] [instance: 505e8d54-138e-404a-a403-1bd5c9b0c4ab] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:02.123077 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e5ce6da6-6cda-43e7-af0e-229df2cddad9 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:02.124074 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e5ce6da6-6cda-43e7-af0e-229df2cddad9 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:02.125755 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e5ce6da6-6cda-43e7-af0e-229df2cddad9 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:02.126519 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e5ce6da6-6cda-43e7-af0e-229df2cddad9 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:02.127275 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e5ce6da6-6cda-43e7-af0e-229df2cddad9 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:02.129734 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e5ce6da6-6cda-43e7-af0e-229df2cddad9 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:02.144978 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1de92e2c-a2cc-4cdb-b0be-d873719685cc tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:02.145989 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1de92e2c-a2cc-4cdb-b0be-d873719685cc tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: cd8357d8-7845-4c92-ab64-22dbea5c6dbc] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:02.162040 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1de92e2c-a2cc-4cdb-b0be-d873719685cc tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:02.165385 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1de92e2c-a2cc-4cdb-b0be-d873719685cc tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:02.167226 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1de92e2c-a2cc-4cdb-b0be-d873719685cc tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:02.170637 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1de92e2c-a2cc-4cdb-b0be-d873719685cc tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:02.171442 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1de92e2c-a2cc-4cdb-b0be-d873719685cc tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:02.172188 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1de92e2c-a2cc-4cdb-b0be-d873719685cc tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:02.850216 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e5ce6da6-6cda-43e7-af0e-229df2cddad9 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07d8700f1d64a47b5f1b105178b60be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039c1953c26418d9a0b70444bc76a64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:02.861547 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e5ce6da6-6cda-43e7-af0e-229df2cddad9 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] 10.222.0.20 "GET /compute/v2.1/servers/505e8d54-138e-404a-a403-1bd5c9b0c4ab" status: 200 len: 1362 microversion: 2.1 time: 0.756914 Oct 04 19:00:02.862155 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2911/5852] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:02 2022] GET /compute/v2.1/servers/505e8d54-138e-404a-a403-1bd5c9b0c4ab => generated 1362 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:02.881091 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-65899f1d-42e8-4c57-8d5a-30814b724b7f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:02.881715 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-65899f1d-42e8-4c57-8d5a-30814b724b7f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: efab3398-8820-4a11-8dd2-0f7f51a73763] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:02.893536 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-65899f1d-42e8-4c57-8d5a-30814b724b7f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:02.894348 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-65899f1d-42e8-4c57-8d5a-30814b724b7f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:02.895003 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-65899f1d-42e8-4c57-8d5a-30814b724b7f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:02.895750 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-65899f1d-42e8-4c57-8d5a-30814b724b7f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:02.896249 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-65899f1d-42e8-4c57-8d5a-30814b724b7f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:02.896683 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-65899f1d-42e8-4c57-8d5a-30814b724b7f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:03.305562 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1de92e2c-a2cc-4cdb-b0be-d873719685cc tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:03.319229 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1de92e2c-a2cc-4cdb-b0be-d873719685cc tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/cd8357d8-7845-4c92-ab64-22dbea5c6dbc" status: 200 len: 1203 microversion: 2.1 time: 1.183346 Oct 04 19:00:03.355461 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2942/5853] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:02 2022] GET /compute/v2.1/servers/cd8357d8-7845-4c92-ab64-22dbea5c6dbc => generated 1203 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:03.399399 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-86a9a99a-431b-4465-bf55-99e4ea6fb0da tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:03.404557 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-86a9a99a-431b-4465-bf55-99e4ea6fb0da tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:03.438528 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-86a9a99a-431b-4465-bf55-99e4ea6fb0da tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:03.439164 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-86a9a99a-431b-4465-bf55-99e4ea6fb0da tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:03.439633 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-86a9a99a-431b-4465-bf55-99e4ea6fb0da tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:03.446079 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-86a9a99a-431b-4465-bf55-99e4ea6fb0da tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:03.446079 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-86a9a99a-431b-4465-bf55-99e4ea6fb0da tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:03.447882 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-86a9a99a-431b-4465-bf55-99e4ea6fb0da tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:03.526540 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-65899f1d-42e8-4c57-8d5a-30814b724b7f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce441ded6f554ec28560c75de97af173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc67d8de57543c48bdf45669b684227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:03.539313 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-65899f1d-42e8-4c57-8d5a-30814b724b7f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/efab3398-8820-4a11-8dd2-0f7f51a73763" status: 200 len: 1557 microversion: 2.1 time: 0.675931 Oct 04 19:00:03.539989 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2912/5854] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:02 2022] GET /compute/v2.1/servers/efab3398-8820-4a11-8dd2-0f7f51a73763 => generated 1557 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:03.560473 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-fff81c07-5a40-4964-bbab-9fa50ff4b298 req-325885aa-61b8-4519-90cf-c4d6dab3c23e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b882133-2fca-4df4-b228-46a12f538c18", "name": "network-vif-plugged", "status": "completed", "tag": "1f37fede-c1b1-491b-bab1-5ad8cb57086e"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:00:03.592097 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-fff81c07-5a40-4964-bbab-9fa50ff4b298 req-325885aa-61b8-4519-90cf-c4d6dab3c23e service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:03.594891 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-fff81c07-5a40-4964-bbab-9fa50ff4b298 req-325885aa-61b8-4519-90cf-c4d6dab3c23e service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:03.598369 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-fff81c07-5a40-4964-bbab-9fa50ff4b298 req-325885aa-61b8-4519-90cf-c4d6dab3c23e service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:03.648354 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-fff81c07-5a40-4964-bbab-9fa50ff4b298 req-325885aa-61b8-4519-90cf-c4d6dab3c23e service nova] Creating event network-vif-plugged:1f37fede-c1b1-491b-bab1-5ad8cb57086e for instance 7b882133-2fca-4df4-b228-46a12f538c18 on n-h1-850501-14 Oct 04 19:00:03.654851 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-fff81c07-5a40-4964-bbab-9fa50ff4b298 req-325885aa-61b8-4519-90cf-c4d6dab3c23e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112436 Oct 04 19:00:03.665012 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2913/5855] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:00:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:00:03.673411 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-809a8b84-5c67-4a0a-8062-2ed3cba99e72 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:03.674476 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-809a8b84-5c67-4a0a-8062-2ed3cba99e72 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: efab3398-8820-4a11-8dd2-0f7f51a73763] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:03.684906 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-809a8b84-5c67-4a0a-8062-2ed3cba99e72 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:03.687248 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-809a8b84-5c67-4a0a-8062-2ed3cba99e72 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:03.687954 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-809a8b84-5c67-4a0a-8062-2ed3cba99e72 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:03.693199 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-809a8b84-5c67-4a0a-8062-2ed3cba99e72 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:03.696531 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-809a8b84-5c67-4a0a-8062-2ed3cba99e72 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:03.697357 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-809a8b84-5c67-4a0a-8062-2ed3cba99e72 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:03.901146 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-809a8b84-5c67-4a0a-8062-2ed3cba99e72 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/efab3398-8820-4a11-8dd2-0f7f51a73763/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.234393 Oct 04 19:00:03.901861 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2914/5856] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Oct 4 19:00:03 2022] GET /compute/v2.1/servers/efab3398-8820-4a11-8dd2-0f7f51a73763/os-interface => generated 285 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:00:03.910859 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-78188815-e79e-438b-9356-6b5ca79d9cc7 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:03.911528 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-78188815-e79e-438b-9356-6b5ca79d9cc7 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] [instance: 505e8d54-138e-404a-a403-1bd5c9b0c4ab] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:03.930922 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-78188815-e79e-438b-9356-6b5ca79d9cc7 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:03.940273 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-78188815-e79e-438b-9356-6b5ca79d9cc7 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:03.940273 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-78188815-e79e-438b-9356-6b5ca79d9cc7 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:03.940273 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-78188815-e79e-438b-9356-6b5ca79d9cc7 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:03.940273 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-78188815-e79e-438b-9356-6b5ca79d9cc7 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:03.940273 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-78188815-e79e-438b-9356-6b5ca79d9cc7 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:03.969897 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-86a9a99a-431b-4465-bf55-99e4ea6fb0da tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:03.984276 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-86a9a99a-431b-4465-bf55-99e4ea6fb0da tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:03.985718 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-86a9a99a-431b-4465-bf55-99e4ea6fb0da tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:03.990739 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-86a9a99a-431b-4465-bf55-99e4ea6fb0da tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18" status: 200 len: 1738 microversion: 2.20 time: 0.633850 Oct 04 19:00:03.991930 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2943/5857] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:00:03 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 => generated 1738 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:00:04.193968 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-78188815-e79e-438b-9356-6b5ca79d9cc7 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07d8700f1d64a47b5f1b105178b60be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039c1953c26418d9a0b70444bc76a64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:04.203738 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-78188815-e79e-438b-9356-6b5ca79d9cc7 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] 10.222.0.20 "GET /compute/v2.1/servers/505e8d54-138e-404a-a403-1bd5c9b0c4ab" status: 200 len: 1360 microversion: 2.1 time: 0.300666 Oct 04 19:00:04.205533 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2915/5858] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:03 2022] GET /compute/v2.1/servers/505e8d54-138e-404a-a403-1bd5c9b0c4ab => generated 1360 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:04.354821 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1c66d356-4948-4301-bc94-052aaf481e26 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:04.355529 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1c66d356-4948-4301-bc94-052aaf481e26 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: cd8357d8-7845-4c92-ab64-22dbea5c6dbc] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:04.372319 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1c66d356-4948-4301-bc94-052aaf481e26 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:04.373437 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1c66d356-4948-4301-bc94-052aaf481e26 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:04.374077 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1c66d356-4948-4301-bc94-052aaf481e26 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:04.374986 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1c66d356-4948-4301-bc94-052aaf481e26 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:04.375658 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1c66d356-4948-4301-bc94-052aaf481e26 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:04.376330 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1c66d356-4948-4301-bc94-052aaf481e26 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:05.022543 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-42e538c1-7a15-4d4c-9eab-24b22a75f897 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:05.025408 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-42e538c1-7a15-4d4c-9eab-24b22a75f897 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:05.036530 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-42e538c1-7a15-4d4c-9eab-24b22a75f897 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:05.037321 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-42e538c1-7a15-4d4c-9eab-24b22a75f897 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:05.038097 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-42e538c1-7a15-4d4c-9eab-24b22a75f897 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:05.038999 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-42e538c1-7a15-4d4c-9eab-24b22a75f897 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:05.039620 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-42e538c1-7a15-4d4c-9eab-24b22a75f897 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:05.049146 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-42e538c1-7a15-4d4c-9eab-24b22a75f897 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:05.276165 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1c66d356-4948-4301-bc94-052aaf481e26 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:05.287957 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1c66d356-4948-4301-bc94-052aaf481e26 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/cd8357d8-7845-4c92-ab64-22dbea5c6dbc" status: 200 len: 1390 microversion: 2.1 time: 0.936913 Oct 04 19:00:05.288503 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2944/5859] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:04 2022] GET /compute/v2.1/servers/cd8357d8-7845-4c92-ab64-22dbea5c6dbc => generated 1390 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:05.304433 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-37538356-7460-4e11-ad4d-6793a0243b41 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:05.305080 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-37538356-7460-4e11-ad4d-6793a0243b41 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] [instance: 505e8d54-138e-404a-a403-1bd5c9b0c4ab] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:05.322011 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-37538356-7460-4e11-ad4d-6793a0243b41 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:05.322234 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-37538356-7460-4e11-ad4d-6793a0243b41 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:05.323022 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-37538356-7460-4e11-ad4d-6793a0243b41 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:05.324004 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-37538356-7460-4e11-ad4d-6793a0243b41 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:05.324651 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-37538356-7460-4e11-ad4d-6793a0243b41 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:05.325242 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-37538356-7460-4e11-ad4d-6793a0243b41 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:05.519527 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-37538356-7460-4e11-ad4d-6793a0243b41 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07d8700f1d64a47b5f1b105178b60be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039c1953c26418d9a0b70444bc76a64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:05.532838 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-37538356-7460-4e11-ad4d-6793a0243b41 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] 10.222.0.20 "GET /compute/v2.1/servers/505e8d54-138e-404a-a403-1bd5c9b0c4ab" status: 200 len: 1360 microversion: 2.1 time: 0.243249 Oct 04 19:00:05.545959 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2945/5860] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:05 2022] GET /compute/v2.1/servers/505e8d54-138e-404a-a403-1bd5c9b0c4ab => generated 1360 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:05.575869 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4cc607a8-7a4e-453d-9d8b-e58812d56813 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:05.578555 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-4cc607a8-7a4e-453d-9d8b-e58812d56813 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: cd8357d8-7845-4c92-ab64-22dbea5c6dbc] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:05.616726 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4cc607a8-7a4e-453d-9d8b-e58812d56813 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:05.620039 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4cc607a8-7a4e-453d-9d8b-e58812d56813 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:05.620602 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4cc607a8-7a4e-453d-9d8b-e58812d56813 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:05.621367 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4cc607a8-7a4e-453d-9d8b-e58812d56813 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:05.621836 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4cc607a8-7a4e-453d-9d8b-e58812d56813 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:05.622274 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4cc607a8-7a4e-453d-9d8b-e58812d56813 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:05.958680 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-42e538c1-7a15-4d4c-9eab-24b22a75f897 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:05.975440 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-42e538c1-7a15-4d4c-9eab-24b22a75f897 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:05.977628 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-42e538c1-7a15-4d4c-9eab-24b22a75f897 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:05.979167 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-42e538c1-7a15-4d4c-9eab-24b22a75f897 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18" status: 200 len: 1738 microversion: 2.20 time: 0.961269 Oct 04 19:00:05.980565 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2916/5861] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:00:05 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 => generated 1738 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 19:00:06.016801 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-4cc607a8-7a4e-453d-9d8b-e58812d56813 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:06.028941 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-4cc607a8-7a4e-453d-9d8b-e58812d56813 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/cd8357d8-7845-4c92-ab64-22dbea5c6dbc" status: 200 len: 1390 microversion: 2.1 time: 0.481543 Oct 04 19:00:06.030759 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2946/5862] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:05 2022] GET /compute/v2.1/servers/cd8357d8-7845-4c92-ab64-22dbea5c6dbc => generated 1390 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:06.053889 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9f869627-df17-4ae7-93f2-4bb4e7a9628b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:06.054579 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9f869627-df17-4ae7-93f2-4bb4e7a9628b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: cd8357d8-7845-4c92-ab64-22dbea5c6dbc] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:06.069112 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9f869627-df17-4ae7-93f2-4bb4e7a9628b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:06.069112 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9f869627-df17-4ae7-93f2-4bb4e7a9628b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:06.069510 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9f869627-df17-4ae7-93f2-4bb4e7a9628b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:06.070184 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9f869627-df17-4ae7-93f2-4bb4e7a9628b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:06.070652 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9f869627-df17-4ae7-93f2-4bb4e7a9628b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:06.071159 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9f869627-df17-4ae7-93f2-4bb4e7a9628b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:06.569601 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f8bf9eb0-70df-4e4a-83b9-0cd10a77ab8a tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:06.570884 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f8bf9eb0-70df-4e4a-83b9-0cd10a77ab8a tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] [instance: 505e8d54-138e-404a-a403-1bd5c9b0c4ab] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:06.580561 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f8bf9eb0-70df-4e4a-83b9-0cd10a77ab8a tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:06.586807 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f8bf9eb0-70df-4e4a-83b9-0cd10a77ab8a tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:06.587498 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f8bf9eb0-70df-4e4a-83b9-0cd10a77ab8a tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:06.588470 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f8bf9eb0-70df-4e4a-83b9-0cd10a77ab8a tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:06.589096 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f8bf9eb0-70df-4e4a-83b9-0cd10a77ab8a tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:06.589705 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f8bf9eb0-70df-4e4a-83b9-0cd10a77ab8a tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:07.304909 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9f869627-df17-4ae7-93f2-4bb4e7a9628b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:07.312717 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:00:07.315863 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9f869627-df17-4ae7-93f2-4bb4e7a9628b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/cd8357d8-7845-4c92-ab64-22dbea5c6dbc" status: 200 len: 1390 microversion: 2.1 time: 1.265613 Oct 04 19:00:07.325482 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2917/5863] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:06 2022] GET /compute/v2.1/servers/cd8357d8-7845-4c92-ab64-22dbea5c6dbc => generated 1390 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:07.360423 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-b3569dda-5ae2-463b-80cb-72d2266e9031 req-163a0a38-619b-4da0-a148-400ccb37ead6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efab3398-8820-4a11-8dd2-0f7f51a73763", "tag": "740a18b8-34ca-450d-a2e5-f7f6a97fe931"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:00:07.404009 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-b3569dda-5ae2-463b-80cb-72d2266e9031 req-163a0a38-619b-4da0-a148-400ccb37ead6 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:07.405848 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-b3569dda-5ae2-463b-80cb-72d2266e9031 req-163a0a38-619b-4da0-a148-400ccb37ead6 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:07.406529 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-b3569dda-5ae2-463b-80cb-72d2266e9031 req-163a0a38-619b-4da0-a148-400ccb37ead6 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:07.461936 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-b3569dda-5ae2-463b-80cb-72d2266e9031 req-163a0a38-619b-4da0-a148-400ccb37ead6 service nova] Creating event network-changed:740a18b8-34ca-450d-a2e5-f7f6a97fe931 for instance efab3398-8820-4a11-8dd2-0f7f51a73763 on n-h1-850501-14 Oct 04 19:00:07.486310 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f8bf9eb0-70df-4e4a-83b9-0cd10a77ab8a tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07d8700f1d64a47b5f1b105178b60be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039c1953c26418d9a0b70444bc76a64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:07.494320 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-b3569dda-5ae2-463b-80cb-72d2266e9031 req-163a0a38-619b-4da0-a148-400ccb37ead6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.156588 Oct 04 19:00:07.497472 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2918/5864] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:00:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:00:07.499696 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f8bf9eb0-70df-4e4a-83b9-0cd10a77ab8a tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] 10.222.0.20 "GET /compute/v2.1/servers/505e8d54-138e-404a-a403-1bd5c9b0c4ab" status: 200 len: 1427 microversion: 2.1 time: 0.934645 Oct 04 19:00:07.523200 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2947/5865] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:06 2022] GET /compute/v2.1/servers/505e8d54-138e-404a-a403-1bd5c9b0c4ab => generated 1427 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:07.533821 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-058c77a8-f9d3-4b35-9b88-5b385a2cd645 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:07.535086 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2b44e9d7-8dab-447e-a913-2d9f64e579e8 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:07.536346 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2b44e9d7-8dab-447e-a913-2d9f64e579e8 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:07.538225 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-058c77a8-f9d3-4b35-9b88-5b385a2cd645 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: cd8357d8-7845-4c92-ab64-22dbea5c6dbc] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:07.550433 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2b44e9d7-8dab-447e-a913-2d9f64e579e8 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:07.553186 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-058c77a8-f9d3-4b35-9b88-5b385a2cd645 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:07.554025 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2b44e9d7-8dab-447e-a913-2d9f64e579e8 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:07.555082 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-058c77a8-f9d3-4b35-9b88-5b385a2cd645 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:07.556169 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-058c77a8-f9d3-4b35-9b88-5b385a2cd645 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:07.556499 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2b44e9d7-8dab-447e-a913-2d9f64e579e8 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:07.557493 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2b44e9d7-8dab-447e-a913-2d9f64e579e8 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:07.558407 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-058c77a8-f9d3-4b35-9b88-5b385a2cd645 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:07.559135 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-058c77a8-f9d3-4b35-9b88-5b385a2cd645 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:07.559571 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-058c77a8-f9d3-4b35-9b88-5b385a2cd645 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:07.560474 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2b44e9d7-8dab-447e-a913-2d9f64e579e8 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:07.561299 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2b44e9d7-8dab-447e-a913-2d9f64e579e8 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:07.647347 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-058c77a8-f9d3-4b35-9b88-5b385a2cd645 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: cd8357d8-7845-4c92-ab64-22dbea5c6dbc] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:00:07.969602 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2b44e9d7-8dab-447e-a913-2d9f64e579e8 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:07.979126 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2b44e9d7-8dab-447e-a913-2d9f64e579e8 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:07.980683 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2b44e9d7-8dab-447e-a913-2d9f64e579e8 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:07.981910 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2b44e9d7-8dab-447e-a913-2d9f64e579e8 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18" status: 200 len: 1738 microversion: 2.20 time: 0.483284 Oct 04 19:00:08.000451 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2919/5866] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:00:07 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 => generated 1738 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:00:08.011150 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-058c77a8-f9d3-4b35-9b88-5b385a2cd645 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "DELETE /compute/v2.1/servers/cd8357d8-7845-4c92-ab64-22dbea5c6dbc" status: 204 len: 0 microversion: 2.1 time: 0.483160 Oct 04 19:00:08.012075 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2948/5867] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 19:00:07 2022] DELETE /compute/v2.1/servers/cd8357d8-7845-4c92-ab64-22dbea5c6dbc => generated 0 bytes in 487 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:00:08.025769 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-697696fe-4a4b-43f9-b2d0-3e1dd9416f7b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:08.026484 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-697696fe-4a4b-43f9-b2d0-3e1dd9416f7b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: cd8357d8-7845-4c92-ab64-22dbea5c6dbc] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:08.044081 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-697696fe-4a4b-43f9-b2d0-3e1dd9416f7b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:08.047895 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-697696fe-4a4b-43f9-b2d0-3e1dd9416f7b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:08.048621 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-697696fe-4a4b-43f9-b2d0-3e1dd9416f7b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:08.052547 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-697696fe-4a4b-43f9-b2d0-3e1dd9416f7b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:08.053269 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-697696fe-4a4b-43f9-b2d0-3e1dd9416f7b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:08.055128 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-697696fe-4a4b-43f9-b2d0-3e1dd9416f7b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:08.560621 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a0033ef9-6b71-4ed4-afe9-e0469300c3c3 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:08.561640 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a0033ef9-6b71-4ed4-afe9-e0469300c3c3 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] [instance: 505e8d54-138e-404a-a403-1bd5c9b0c4ab] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:08.581541 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:00:08.588984 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a0033ef9-6b71-4ed4-afe9-e0469300c3c3 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:08.589510 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a0033ef9-6b71-4ed4-afe9-e0469300c3c3 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:08.591085 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a0033ef9-6b71-4ed4-afe9-e0469300c3c3 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:08.591833 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a0033ef9-6b71-4ed4-afe9-e0469300c3c3 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:08.593261 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a0033ef9-6b71-4ed4-afe9-e0469300c3c3 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:08.599185 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a0033ef9-6b71-4ed4-afe9-e0469300c3c3 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:08.714248 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=6 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:00:09.407088 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a0033ef9-6b71-4ed4-afe9-e0469300c3c3 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07d8700f1d64a47b5f1b105178b60be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039c1953c26418d9a0b70444bc76a64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:09.416790 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:00:09.431755 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a0033ef9-6b71-4ed4-afe9-e0469300c3c3 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] 10.222.0.20 "GET /compute/v2.1/servers/505e8d54-138e-404a-a403-1bd5c9b0c4ab" status: 200 len: 1427 microversion: 2.1 time: 0.875314 Oct 04 19:00:09.442722 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2949/5868] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:08 2022] GET /compute/v2.1/servers/505e8d54-138e-404a-a403-1bd5c9b0c4ab => generated 1427 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:09.442722 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d4dd1702-6bc2-4649-84af-482a648384be tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:09.442722 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d4dd1702-6bc2-4649-84af-482a648384be tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:09.450249 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d4dd1702-6bc2-4649-84af-482a648384be tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:09.457515 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d4dd1702-6bc2-4649-84af-482a648384be tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:09.457515 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d4dd1702-6bc2-4649-84af-482a648384be tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:09.457515 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d4dd1702-6bc2-4649-84af-482a648384be tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:09.457515 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d4dd1702-6bc2-4649-84af-482a648384be tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:09.457515 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d4dd1702-6bc2-4649-84af-482a648384be tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:09.474531 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-697696fe-4a4b-43f9-b2d0-3e1dd9416f7b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:09.486496 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-697696fe-4a4b-43f9-b2d0-3e1dd9416f7b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/cd8357d8-7845-4c92-ab64-22dbea5c6dbc" status: 200 len: 1396 microversion: 2.1 time: 1.470144 Oct 04 19:00:09.489707 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2920/5869] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:08 2022] GET /compute/v2.1/servers/cd8357d8-7845-4c92-ab64-22dbea5c6dbc => generated 1396 bytes in 1474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:09.751749 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d4dd1702-6bc2-4649-84af-482a648384be tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:09.765033 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d4dd1702-6bc2-4649-84af-482a648384be tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:09.767864 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d4dd1702-6bc2-4649-84af-482a648384be tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:09.770858 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d4dd1702-6bc2-4649-84af-482a648384be tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18" status: 200 len: 1738 microversion: 2.20 time: 0.336730 Oct 04 19:00:09.773453 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2950/5870] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:00:09 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 => generated 1738 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:00:10.461015 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-252c459d-ec2d-4e6a-92b0-673714e8a833 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:10.461015 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-252c459d-ec2d-4e6a-92b0-673714e8a833 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] [instance: 505e8d54-138e-404a-a403-1bd5c9b0c4ab] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:10.480682 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-252c459d-ec2d-4e6a-92b0-673714e8a833 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:10.483720 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-252c459d-ec2d-4e6a-92b0-673714e8a833 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:10.487228 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-252c459d-ec2d-4e6a-92b0-673714e8a833 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:10.489753 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-252c459d-ec2d-4e6a-92b0-673714e8a833 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:10.490518 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-252c459d-ec2d-4e6a-92b0-673714e8a833 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:10.491249 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-252c459d-ec2d-4e6a-92b0-673714e8a833 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:10.523156 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9452efc3-9253-433c-8e5d-d5d472401af9 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:10.525613 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-9452efc3-9253-433c-8e5d-d5d472401af9 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: cd8357d8-7845-4c92-ab64-22dbea5c6dbc] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:10.570656 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=12 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:00:10.597852 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9452efc3-9253-433c-8e5d-d5d472401af9 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:10.599459 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9452efc3-9253-433c-8e5d-d5d472401af9 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:10.600278 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9452efc3-9253-433c-8e5d-d5d472401af9 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:10.601134 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9452efc3-9253-433c-8e5d-d5d472401af9 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:10.610096 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9452efc3-9253-433c-8e5d-d5d472401af9 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:10.616268 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9452efc3-9253-433c-8e5d-d5d472401af9 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:11.627179 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9452efc3-9253-433c-8e5d-d5d472401af9 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:11.644804 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-252c459d-ec2d-4e6a-92b0-673714e8a833 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07d8700f1d64a47b5f1b105178b60be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039c1953c26418d9a0b70444bc76a64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:11.646592 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9452efc3-9253-433c-8e5d-d5d472401af9 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/cd8357d8-7845-4c92-ab64-22dbea5c6dbc" status: 200 len: 1396 microversion: 2.1 time: 1.132916 Oct 04 19:00:11.647737 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2951/5871] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:10 2022] GET /compute/v2.1/servers/cd8357d8-7845-4c92-ab64-22dbea5c6dbc => generated 1396 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:11.664862 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-e007a312-8b5e-4300-a46d-73084b52e36d req-f1e3da21-929b-4e66-b441-29fe16e99a03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "505e8d54-138e-404a-a403-1bd5c9b0c4ab", "tag": "165d92c2-bb6d-44be-b249-79846e929a8b"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:00:11.679225 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-252c459d-ec2d-4e6a-92b0-673714e8a833 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] 10.222.0.20 "GET /compute/v2.1/servers/505e8d54-138e-404a-a403-1bd5c9b0c4ab" status: 200 len: 1427 microversion: 2.1 time: 1.226281 Oct 04 19:00:11.692147 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2921/5872] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:10 2022] GET /compute/v2.1/servers/505e8d54-138e-404a-a403-1bd5c9b0c4ab => generated 1427 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:11.703376 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-e007a312-8b5e-4300-a46d-73084b52e36d req-f1e3da21-929b-4e66-b441-29fe16e99a03 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:11.703376 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-e007a312-8b5e-4300-a46d-73084b52e36d req-f1e3da21-929b-4e66-b441-29fe16e99a03 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:11.703376 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-e007a312-8b5e-4300-a46d-73084b52e36d req-f1e3da21-929b-4e66-b441-29fe16e99a03 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:11.710810 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0fcf9866-308f-42c8-9530-f41d7e99b108 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:11.711749 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0fcf9866-308f-42c8-9530-f41d7e99b108 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:11.743898 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0fcf9866-308f-42c8-9530-f41d7e99b108 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:11.744889 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0fcf9866-308f-42c8-9530-f41d7e99b108 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:11.745532 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0fcf9866-308f-42c8-9530-f41d7e99b108 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:11.746612 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0fcf9866-308f-42c8-9530-f41d7e99b108 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:11.747271 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0fcf9866-308f-42c8-9530-f41d7e99b108 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:11.748432 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0fcf9866-308f-42c8-9530-f41d7e99b108 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:11.753705 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-e007a312-8b5e-4300-a46d-73084b52e36d req-f1e3da21-929b-4e66-b441-29fe16e99a03 service nova] Creating event network-changed:165d92c2-bb6d-44be-b249-79846e929a8b for instance 505e8d54-138e-404a-a403-1bd5c9b0c4ab on n-h1-850501-14 Oct 04 19:00:11.775897 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-e007a312-8b5e-4300-a46d-73084b52e36d req-f1e3da21-929b-4e66-b441-29fe16e99a03 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125028 Oct 04 19:00:11.780325 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2952/5873] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:00:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:00:11.821749 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-3d311aaa-f7c8-4e36-a275-9dab517868ed req-b690b53a-8c68-4a7a-b3f3-fdb4f7c7a96a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd8357d8-7845-4c92-ab64-22dbea5c6dbc", "name": "network-vif-deleted", "tag": "4dfcc6bf-552f-4e81-a0ee-414651aba0e0"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:00:11.836470 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-3d311aaa-f7c8-4e36-a275-9dab517868ed req-b690b53a-8c68-4a7a-b3f3-fdb4f7c7a96a service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:11.836957 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-3d311aaa-f7c8-4e36-a275-9dab517868ed req-b690b53a-8c68-4a7a-b3f3-fdb4f7c7a96a service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:11.837408 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-3d311aaa-f7c8-4e36-a275-9dab517868ed req-b690b53a-8c68-4a7a-b3f3-fdb4f7c7a96a service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:11.855437 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-3d311aaa-f7c8-4e36-a275-9dab517868ed req-b690b53a-8c68-4a7a-b3f3-fdb4f7c7a96a service nova] Creating event network-vif-deleted:4dfcc6bf-552f-4e81-a0ee-414651aba0e0 for instance cd8357d8-7845-4c92-ab64-22dbea5c6dbc on n-h2-850501-14 Oct 04 19:00:11.861973 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-3d311aaa-f7c8-4e36-a275-9dab517868ed req-b690b53a-8c68-4a7a-b3f3-fdb4f7c7a96a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046535 Oct 04 19:00:11.863789 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2953/5874] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:00:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:00:12.204706 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0fcf9866-308f-42c8-9530-f41d7e99b108 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:12.214939 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0fcf9866-308f-42c8-9530-f41d7e99b108 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:12.221488 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0fcf9866-308f-42c8-9530-f41d7e99b108 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:12.228932 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0fcf9866-308f-42c8-9530-f41d7e99b108 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18" status: 200 len: 1738 microversion: 2.20 time: 0.532167 Oct 04 19:00:12.230139 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2922/5875] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:00:11 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 => generated 1738 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:00:12.675718 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d2f28a4d-6b96-4049-b272-0b7a06a0a6bf tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:12.676453 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d2f28a4d-6b96-4049-b272-0b7a06a0a6bf tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: cd8357d8-7845-4c92-ab64-22dbea5c6dbc] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:12.701503 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d2f28a4d-6b96-4049-b272-0b7a06a0a6bf tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:12.702296 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d2f28a4d-6b96-4049-b272-0b7a06a0a6bf tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:12.703032 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d2f28a4d-6b96-4049-b272-0b7a06a0a6bf tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:12.703937 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d2f28a4d-6b96-4049-b272-0b7a06a0a6bf tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:12.704584 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d2f28a4d-6b96-4049-b272-0b7a06a0a6bf tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:12.705161 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d2f28a4d-6b96-4049-b272-0b7a06a0a6bf tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:12.706575 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b3b7b40d-8c9f-43ed-9afa-3519c584bce0 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:12.707195 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b3b7b40d-8c9f-43ed-9afa-3519c584bce0 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] [instance: 505e8d54-138e-404a-a403-1bd5c9b0c4ab] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:12.724690 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b3b7b40d-8c9f-43ed-9afa-3519c584bce0 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:12.725518 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b3b7b40d-8c9f-43ed-9afa-3519c584bce0 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:12.726741 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b3b7b40d-8c9f-43ed-9afa-3519c584bce0 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:12.727671 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b3b7b40d-8c9f-43ed-9afa-3519c584bce0 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:12.728331 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b3b7b40d-8c9f-43ed-9afa-3519c584bce0 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:12.728946 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b3b7b40d-8c9f-43ed-9afa-3519c584bce0 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:12.944648 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d2f28a4d-6b96-4049-b272-0b7a06a0a6bf tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:12.961123 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d2f28a4d-6b96-4049-b272-0b7a06a0a6bf tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/cd8357d8-7845-4c92-ab64-22dbea5c6dbc" status: 200 len: 1188 microversion: 2.1 time: 0.289836 Oct 04 19:00:12.963457 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2954/5876] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:12 2022] GET /compute/v2.1/servers/cd8357d8-7845-4c92-ab64-22dbea5c6dbc => generated 1188 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:13.117072 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b3b7b40d-8c9f-43ed-9afa-3519c584bce0 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07d8700f1d64a47b5f1b105178b60be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039c1953c26418d9a0b70444bc76a64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:13.149756 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b3b7b40d-8c9f-43ed-9afa-3519c584bce0 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] 10.222.0.20 "GET /compute/v2.1/servers/505e8d54-138e-404a-a403-1bd5c9b0c4ab" status: 200 len: 1427 microversion: 2.1 time: 0.440542 Oct 04 19:00:13.154714 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2923/5877] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:12 2022] GET /compute/v2.1/servers/505e8d54-138e-404a-a403-1bd5c9b0c4ab => generated 1427 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:13.269630 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6f5f9c19-86f4-4bfe-8bc6-3cc485c00fdf tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:13.270276 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6f5f9c19-86f4-4bfe-8bc6-3cc485c00fdf tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:13.287226 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6f5f9c19-86f4-4bfe-8bc6-3cc485c00fdf tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:13.288138 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6f5f9c19-86f4-4bfe-8bc6-3cc485c00fdf tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:13.289360 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6f5f9c19-86f4-4bfe-8bc6-3cc485c00fdf tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:13.297144 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6f5f9c19-86f4-4bfe-8bc6-3cc485c00fdf tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:13.297144 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6f5f9c19-86f4-4bfe-8bc6-3cc485c00fdf tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:13.297144 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6f5f9c19-86f4-4bfe-8bc6-3cc485c00fdf tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:13.598649 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6f5f9c19-86f4-4bfe-8bc6-3cc485c00fdf tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:13.612851 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6f5f9c19-86f4-4bfe-8bc6-3cc485c00fdf tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:13.614426 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6f5f9c19-86f4-4bfe-8bc6-3cc485c00fdf tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:13.623245 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6f5f9c19-86f4-4bfe-8bc6-3cc485c00fdf tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18" status: 200 len: 1738 microversion: 2.20 time: 0.367166 Oct 04 19:00:13.624247 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2955/5878] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:00:13 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 => generated 1738 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:00:13.991115 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0ca6df5c-2bbe-4a6b-9c95-c67fd87cfeb0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:13.991861 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0ca6df5c-2bbe-4a6b-9c95-c67fd87cfeb0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: cd8357d8-7845-4c92-ab64-22dbea5c6dbc] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:14.024979 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0ca6df5c-2bbe-4a6b-9c95-c67fd87cfeb0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:14.030971 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0ca6df5c-2bbe-4a6b-9c95-c67fd87cfeb0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:14.031605 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0ca6df5c-2bbe-4a6b-9c95-c67fd87cfeb0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:14.036784 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0ca6df5c-2bbe-4a6b-9c95-c67fd87cfeb0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:14.040545 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0ca6df5c-2bbe-4a6b-9c95-c67fd87cfeb0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:14.043366 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0ca6df5c-2bbe-4a6b-9c95-c67fd87cfeb0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:14.181144 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b7a0373f-c923-42e5-a533-5b371f60fd6a tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:14.182343 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b7a0373f-c923-42e5-a533-5b371f60fd6a tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] [instance: 505e8d54-138e-404a-a403-1bd5c9b0c4ab] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:14.195849 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b7a0373f-c923-42e5-a533-5b371f60fd6a tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:14.197487 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b7a0373f-c923-42e5-a533-5b371f60fd6a tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:14.205819 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b7a0373f-c923-42e5-a533-5b371f60fd6a tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:14.205819 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b7a0373f-c923-42e5-a533-5b371f60fd6a tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:14.205819 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b7a0373f-c923-42e5-a533-5b371f60fd6a tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:14.205819 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b7a0373f-c923-42e5-a533-5b371f60fd6a tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:14.398407 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0ca6df5c-2bbe-4a6b-9c95-c67fd87cfeb0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:14.409880 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0ca6df5c-2bbe-4a6b-9c95-c67fd87cfeb0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/cd8357d8-7845-4c92-ab64-22dbea5c6dbc" status: 200 len: 1188 microversion: 2.1 time: 0.424576 Oct 04 19:00:14.429368 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2924/5879] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:13 2022] GET /compute/v2.1/servers/cd8357d8-7845-4c92-ab64-22dbea5c6dbc => generated 1188 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:14.657552 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-108db185-5552-4829-a2c5-d72913aa7b55 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:14.666180 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-108db185-5552-4829-a2c5-d72913aa7b55 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:14.697721 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-108db185-5552-4829-a2c5-d72913aa7b55 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:14.700615 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-108db185-5552-4829-a2c5-d72913aa7b55 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:14.701293 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-108db185-5552-4829-a2c5-d72913aa7b55 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:14.703040 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-108db185-5552-4829-a2c5-d72913aa7b55 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:14.704222 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-108db185-5552-4829-a2c5-d72913aa7b55 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:14.704902 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-108db185-5552-4829-a2c5-d72913aa7b55 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:15.197357 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b7a0373f-c923-42e5-a533-5b371f60fd6a tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07d8700f1d64a47b5f1b105178b60be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039c1953c26418d9a0b70444bc76a64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:15.207650 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b7a0373f-c923-42e5-a533-5b371f60fd6a tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] 10.222.0.20 "GET /compute/v2.1/servers/505e8d54-138e-404a-a403-1bd5c9b0c4ab" status: 200 len: 1427 microversion: 2.1 time: 1.033009 Oct 04 19:00:15.215966 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2956/5880] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:14 2022] GET /compute/v2.1/servers/505e8d54-138e-404a-a403-1bd5c9b0c4ab => generated 1427 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:15.435391 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-74d40784-b106-4a1e-90d2-bab5f6c4e392 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:15.437606 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-74d40784-b106-4a1e-90d2-bab5f6c4e392 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: cd8357d8-7845-4c92-ab64-22dbea5c6dbc] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:15.449268 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-74d40784-b106-4a1e-90d2-bab5f6c4e392 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:15.450998 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-74d40784-b106-4a1e-90d2-bab5f6c4e392 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:15.452019 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-74d40784-b106-4a1e-90d2-bab5f6c4e392 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:15.458464 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-74d40784-b106-4a1e-90d2-bab5f6c4e392 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:15.460324 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-74d40784-b106-4a1e-90d2-bab5f6c4e392 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:15.461601 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-74d40784-b106-4a1e-90d2-bab5f6c4e392 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:15.602703 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-108db185-5552-4829-a2c5-d72913aa7b55 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:15.618810 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-108db185-5552-4829-a2c5-d72913aa7b55 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:15.626620 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-108db185-5552-4829-a2c5-d72913aa7b55 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:15.629069 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-108db185-5552-4829-a2c5-d72913aa7b55 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18" status: 200 len: 1738 microversion: 2.20 time: 0.979661 Oct 04 19:00:15.641570 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2925/5881] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:00:14 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 => generated 1738 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:00:15.667177 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-74d40784-b106-4a1e-90d2-bab5f6c4e392 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:15.682497 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-74d40784-b106-4a1e-90d2-bab5f6c4e392 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/cd8357d8-7845-4c92-ab64-22dbea5c6dbc" status: 200 len: 1188 microversion: 2.1 time: 0.251884 Oct 04 19:00:15.700082 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2957/5882] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:15 2022] GET /compute/v2.1/servers/cd8357d8-7845-4c92-ab64-22dbea5c6dbc => generated 1188 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:00:16.243553 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4f34a5f7-4103-4998-8452-4986b83a1531 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:16.244351 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4f34a5f7-4103-4998-8452-4986b83a1531 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] [instance: 505e8d54-138e-404a-a403-1bd5c9b0c4ab] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:16.275094 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4f34a5f7-4103-4998-8452-4986b83a1531 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:16.280358 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4f34a5f7-4103-4998-8452-4986b83a1531 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:16.282259 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4f34a5f7-4103-4998-8452-4986b83a1531 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:16.283174 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4f34a5f7-4103-4998-8452-4986b83a1531 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:16.288689 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4f34a5f7-4103-4998-8452-4986b83a1531 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:16.289388 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4f34a5f7-4103-4998-8452-4986b83a1531 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:16.564455 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4f34a5f7-4103-4998-8452-4986b83a1531 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07d8700f1d64a47b5f1b105178b60be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039c1953c26418d9a0b70444bc76a64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:16.578529 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4f34a5f7-4103-4998-8452-4986b83a1531 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] 10.222.0.20 "GET /compute/v2.1/servers/505e8d54-138e-404a-a403-1bd5c9b0c4ab" status: 200 len: 1427 microversion: 2.1 time: 0.336205 Oct 04 19:00:16.583713 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2926/5883] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:16 2022] GET /compute/v2.1/servers/505e8d54-138e-404a-a403-1bd5c9b0c4ab => generated 1427 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:16.664034 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-19557f98-24d2-4aca-8381-c30226cbf779 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:16.665396 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-19557f98-24d2-4aca-8381-c30226cbf779 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:16.690829 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-19557f98-24d2-4aca-8381-c30226cbf779 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:16.691641 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-19557f98-24d2-4aca-8381-c30226cbf779 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:16.692171 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-19557f98-24d2-4aca-8381-c30226cbf779 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:16.710575 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-19557f98-24d2-4aca-8381-c30226cbf779 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:16.712122 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-19557f98-24d2-4aca-8381-c30226cbf779 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:16.715372 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-19557f98-24d2-4aca-8381-c30226cbf779 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:16.724738 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1c6db805-f735-40f8-8ac8-66b1c1ac529b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:16.726497 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1c6db805-f735-40f8-8ac8-66b1c1ac529b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: cd8357d8-7845-4c92-ab64-22dbea5c6dbc] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:16.733057 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1c6db805-f735-40f8-8ac8-66b1c1ac529b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:16.733857 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1c6db805-f735-40f8-8ac8-66b1c1ac529b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:16.734471 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1c6db805-f735-40f8-8ac8-66b1c1ac529b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:16.735452 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1c6db805-f735-40f8-8ac8-66b1c1ac529b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:16.736112 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1c6db805-f735-40f8-8ac8-66b1c1ac529b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:16.737278 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1c6db805-f735-40f8-8ac8-66b1c1ac529b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:16.831778 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1c6db805-f735-40f8-8ac8-66b1c1ac529b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:16.853920 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1c6db805-f735-40f8-8ac8-66b1c1ac529b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/cd8357d8-7845-4c92-ab64-22dbea5c6dbc" status: 200 len: 1188 microversion: 2.1 time: 0.143163 Oct 04 19:00:16.855275 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2927/5884] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:16 2022] GET /compute/v2.1/servers/cd8357d8-7845-4c92-ab64-22dbea5c6dbc => generated 1188 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:17.021643 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-19557f98-24d2-4aca-8381-c30226cbf779 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:17.032538 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-19557f98-24d2-4aca-8381-c30226cbf779 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:17.034969 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-19557f98-24d2-4aca-8381-c30226cbf779 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:17.036728 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-19557f98-24d2-4aca-8381-c30226cbf779 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18" status: 200 len: 1738 microversion: 2.20 time: 0.379231 Oct 04 19:00:17.037812 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2958/5885] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:00:16 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 => generated 1738 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:00:17.610757 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-836e2afe-f9a2-4743-803d-48331669439e tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:17.612625 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-836e2afe-f9a2-4743-803d-48331669439e tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] [instance: 505e8d54-138e-404a-a403-1bd5c9b0c4ab] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:17.622350 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-836e2afe-f9a2-4743-803d-48331669439e tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:17.623198 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-836e2afe-f9a2-4743-803d-48331669439e tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:17.638361 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-836e2afe-f9a2-4743-803d-48331669439e tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:17.639525 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-836e2afe-f9a2-4743-803d-48331669439e tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:17.640306 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-836e2afe-f9a2-4743-803d-48331669439e tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:17.641001 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-836e2afe-f9a2-4743-803d-48331669439e tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:17.879814 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8480ec12-da5c-40dc-9331-d5a5d739f939 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:17.880772 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8480ec12-da5c-40dc-9331-d5a5d739f939 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: cd8357d8-7845-4c92-ab64-22dbea5c6dbc] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:17.894039 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8480ec12-da5c-40dc-9331-d5a5d739f939 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:17.902821 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8480ec12-da5c-40dc-9331-d5a5d739f939 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:17.903427 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8480ec12-da5c-40dc-9331-d5a5d739f939 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:17.904489 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8480ec12-da5c-40dc-9331-d5a5d739f939 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:17.905197 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8480ec12-da5c-40dc-9331-d5a5d739f939 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:17.905876 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8480ec12-da5c-40dc-9331-d5a5d739f939 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:18.121349 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8480ec12-da5c-40dc-9331-d5a5d739f939 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:18.131356 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8480ec12-da5c-40dc-9331-d5a5d739f939 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/cd8357d8-7845-4c92-ab64-22dbea5c6dbc" status: 200 len: 1188 microversion: 2.1 time: 0.256250 Oct 04 19:00:18.137225 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2959/5886] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:17 2022] GET /compute/v2.1/servers/cd8357d8-7845-4c92-ab64-22dbea5c6dbc => generated 1188 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:18.152536 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1fc2ab28-8f6e-4d22-aa72-5fa4c6a501b2 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:18.153496 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1fc2ab28-8f6e-4d22-aa72-5fa4c6a501b2 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:18.178595 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1fc2ab28-8f6e-4d22-aa72-5fa4c6a501b2 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:18.185837 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1fc2ab28-8f6e-4d22-aa72-5fa4c6a501b2 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:18.187079 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1fc2ab28-8f6e-4d22-aa72-5fa4c6a501b2 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:18.188121 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1fc2ab28-8f6e-4d22-aa72-5fa4c6a501b2 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:18.189352 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1fc2ab28-8f6e-4d22-aa72-5fa4c6a501b2 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:18.190227 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1fc2ab28-8f6e-4d22-aa72-5fa4c6a501b2 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:19.108686 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-836e2afe-f9a2-4743-803d-48331669439e tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07d8700f1d64a47b5f1b105178b60be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039c1953c26418d9a0b70444bc76a64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:19.124184 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-836e2afe-f9a2-4743-803d-48331669439e tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] 10.222.0.20 "GET /compute/v2.1/servers/505e8d54-138e-404a-a403-1bd5c9b0c4ab" status: 200 len: 1427 microversion: 2.1 time: 1.521290 Oct 04 19:00:19.137247 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2928/5887] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:17 2022] GET /compute/v2.1/servers/505e8d54-138e-404a-a403-1bd5c9b0c4ab => generated 1427 bytes in 1535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:19.179560 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9c848a6f-332a-4537-9d04-aa3ae26751ea tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:19.179560 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9c848a6f-332a-4537-9d04-aa3ae26751ea tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: cd8357d8-7845-4c92-ab64-22dbea5c6dbc] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:19.196477 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9c848a6f-332a-4537-9d04-aa3ae26751ea tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:19.201397 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9c848a6f-332a-4537-9d04-aa3ae26751ea tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:19.203678 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9c848a6f-332a-4537-9d04-aa3ae26751ea tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:19.206725 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9c848a6f-332a-4537-9d04-aa3ae26751ea tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:19.208542 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9c848a6f-332a-4537-9d04-aa3ae26751ea tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:19.210692 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9c848a6f-332a-4537-9d04-aa3ae26751ea tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:19.503342 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9c848a6f-332a-4537-9d04-aa3ae26751ea tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:19.519032 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9c848a6f-332a-4537-9d04-aa3ae26751ea tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/cd8357d8-7845-4c92-ab64-22dbea5c6dbc" status: 200 len: 1188 microversion: 2.1 time: 0.351955 Oct 04 19:00:19.519892 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2929/5888] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:19 2022] GET /compute/v2.1/servers/cd8357d8-7845-4c92-ab64-22dbea5c6dbc => generated 1188 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:00:19.660932 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1fc2ab28-8f6e-4d22-aa72-5fa4c6a501b2 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:19.673477 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1fc2ab28-8f6e-4d22-aa72-5fa4c6a501b2 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:19.682224 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1fc2ab28-8f6e-4d22-aa72-5fa4c6a501b2 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:19.683948 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1fc2ab28-8f6e-4d22-aa72-5fa4c6a501b2 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18" status: 200 len: 1738 microversion: 2.20 time: 1.545615 Oct 04 19:00:19.685558 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2960/5889] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:00:18 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 => generated 1738 bytes in 1548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:00:20.081934 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-389ad772-dfdc-40ea-84ce-b5207c641710 req-a5796748-995c-49e6-8323-38a01325b1b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "505e8d54-138e-404a-a403-1bd5c9b0c4ab", "name": "network-vif-plugged", "status": "completed", "tag": "165d92c2-bb6d-44be-b249-79846e929a8b"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:00:20.130622 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-389ad772-dfdc-40ea-84ce-b5207c641710 req-a5796748-995c-49e6-8323-38a01325b1b6 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:20.135575 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-389ad772-dfdc-40ea-84ce-b5207c641710 req-a5796748-995c-49e6-8323-38a01325b1b6 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:20.136396 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-389ad772-dfdc-40ea-84ce-b5207c641710 req-a5796748-995c-49e6-8323-38a01325b1b6 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:20.150639 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4a7a5cd4-69f0-4404-8b07-f01918734fb3 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:20.152765 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-4a7a5cd4-69f0-4404-8b07-f01918734fb3 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] [instance: 505e8d54-138e-404a-a403-1bd5c9b0c4ab] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:20.161933 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4a7a5cd4-69f0-4404-8b07-f01918734fb3 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:20.176901 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4a7a5cd4-69f0-4404-8b07-f01918734fb3 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:20.180869 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4a7a5cd4-69f0-4404-8b07-f01918734fb3 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:20.185252 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4a7a5cd4-69f0-4404-8b07-f01918734fb3 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:20.185252 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4a7a5cd4-69f0-4404-8b07-f01918734fb3 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:20.185252 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4a7a5cd4-69f0-4404-8b07-f01918734fb3 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:20.208938 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-389ad772-dfdc-40ea-84ce-b5207c641710 req-a5796748-995c-49e6-8323-38a01325b1b6 service nova] Creating event network-vif-plugged:165d92c2-bb6d-44be-b249-79846e929a8b for instance 505e8d54-138e-404a-a403-1bd5c9b0c4ab on n-h1-850501-14 Oct 04 19:00:20.237921 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-389ad772-dfdc-40ea-84ce-b5207c641710 req-a5796748-995c-49e6-8323-38a01325b1b6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160283 Oct 04 19:00:20.239715 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2930/5890] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:00:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:00:20.547643 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5af651db-eeec-4d78-afeb-72313b69cbed tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:20.548697 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5af651db-eeec-4d78-afeb-72313b69cbed tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: cd8357d8-7845-4c92-ab64-22dbea5c6dbc] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:20.577977 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5af651db-eeec-4d78-afeb-72313b69cbed tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:20.578796 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5af651db-eeec-4d78-afeb-72313b69cbed tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:20.584625 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5af651db-eeec-4d78-afeb-72313b69cbed tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:20.586099 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5af651db-eeec-4d78-afeb-72313b69cbed tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:20.587078 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5af651db-eeec-4d78-afeb-72313b69cbed tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:20.592345 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5af651db-eeec-4d78-afeb-72313b69cbed tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:21.080777 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5af651db-eeec-4d78-afeb-72313b69cbed tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:21.098748 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5af651db-eeec-4d78-afeb-72313b69cbed tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/cd8357d8-7845-4c92-ab64-22dbea5c6dbc" status: 200 len: 1188 microversion: 2.1 time: 0.555845 Oct 04 19:00:21.117630 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2931/5891] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:20 2022] GET /compute/v2.1/servers/cd8357d8-7845-4c92-ab64-22dbea5c6dbc => generated 1188 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:21.131096 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2576cdbf-1f23-4be2-87b3-65f18750ffe2 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:21.131757 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2576cdbf-1f23-4be2-87b3-65f18750ffe2 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:21.161927 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2576cdbf-1f23-4be2-87b3-65f18750ffe2 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:21.164745 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2576cdbf-1f23-4be2-87b3-65f18750ffe2 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:21.167325 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2576cdbf-1f23-4be2-87b3-65f18750ffe2 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:21.168579 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2576cdbf-1f23-4be2-87b3-65f18750ffe2 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:21.169225 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2576cdbf-1f23-4be2-87b3-65f18750ffe2 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:21.171583 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2576cdbf-1f23-4be2-87b3-65f18750ffe2 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:21.230382 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-4a7a5cd4-69f0-4404-8b07-f01918734fb3 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07d8700f1d64a47b5f1b105178b60be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039c1953c26418d9a0b70444bc76a64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:21.239564 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-4a7a5cd4-69f0-4404-8b07-f01918734fb3 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] 10.222.0.20 "GET /compute/v2.1/servers/505e8d54-138e-404a-a403-1bd5c9b0c4ab" status: 200 len: 1427 microversion: 2.1 time: 1.092823 Oct 04 19:00:21.248902 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2961/5892] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:20 2022] GET /compute/v2.1/servers/505e8d54-138e-404a-a403-1bd5c9b0c4ab => generated 1427 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:00:21.631231 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2576cdbf-1f23-4be2-87b3-65f18750ffe2 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:21.651296 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2576cdbf-1f23-4be2-87b3-65f18750ffe2 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:21.656646 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2576cdbf-1f23-4be2-87b3-65f18750ffe2 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:21.658985 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2576cdbf-1f23-4be2-87b3-65f18750ffe2 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18" status: 200 len: 1738 microversion: 2.20 time: 0.539318 Oct 04 19:00:21.662403 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2932/5893] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:00:21 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 => generated 1738 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:00:22.124883 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d1037f1d-0712-46d5-9d55-cc11f8dc6421 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:22.125417 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d1037f1d-0712-46d5-9d55-cc11f8dc6421 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: cd8357d8-7845-4c92-ab64-22dbea5c6dbc] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:22.158570 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d1037f1d-0712-46d5-9d55-cc11f8dc6421 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:22.159382 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d1037f1d-0712-46d5-9d55-cc11f8dc6421 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:22.160003 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d1037f1d-0712-46d5-9d55-cc11f8dc6421 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:22.160945 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d1037f1d-0712-46d5-9d55-cc11f8dc6421 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:22.161585 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d1037f1d-0712-46d5-9d55-cc11f8dc6421 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:22.162180 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d1037f1d-0712-46d5-9d55-cc11f8dc6421 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:22.277407 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5ba81e45-2ad3-41e8-8113-0e69f91cfb62 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:22.278564 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5ba81e45-2ad3-41e8-8113-0e69f91cfb62 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] [instance: 505e8d54-138e-404a-a403-1bd5c9b0c4ab] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:22.311545 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5ba81e45-2ad3-41e8-8113-0e69f91cfb62 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:22.317083 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5ba81e45-2ad3-41e8-8113-0e69f91cfb62 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:22.322181 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5ba81e45-2ad3-41e8-8113-0e69f91cfb62 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:22.323442 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5ba81e45-2ad3-41e8-8113-0e69f91cfb62 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:22.325368 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5ba81e45-2ad3-41e8-8113-0e69f91cfb62 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:22.327277 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5ba81e45-2ad3-41e8-8113-0e69f91cfb62 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:22.599789 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d1037f1d-0712-46d5-9d55-cc11f8dc6421 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:22.612236 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d1037f1d-0712-46d5-9d55-cc11f8dc6421 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/cd8357d8-7845-4c92-ab64-22dbea5c6dbc" status: 200 len: 1188 microversion: 2.1 time: 0.491196 Oct 04 19:00:22.623846 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2962/5894] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:22 2022] GET /compute/v2.1/servers/cd8357d8-7845-4c92-ab64-22dbea5c6dbc => generated 1188 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:22.688556 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d4072382-383d-47a9-8fed-3e661f7d2c6f tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:22.689793 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d4072382-383d-47a9-8fed-3e661f7d2c6f tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:22.706452 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d4072382-383d-47a9-8fed-3e661f7d2c6f tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:22.711970 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d4072382-383d-47a9-8fed-3e661f7d2c6f tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:22.717360 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d4072382-383d-47a9-8fed-3e661f7d2c6f tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:22.718402 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d4072382-383d-47a9-8fed-3e661f7d2c6f tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:22.719036 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d4072382-383d-47a9-8fed-3e661f7d2c6f tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:22.719641 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d4072382-383d-47a9-8fed-3e661f7d2c6f tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:22.890460 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5ba81e45-2ad3-41e8-8113-0e69f91cfb62 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07d8700f1d64a47b5f1b105178b60be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039c1953c26418d9a0b70444bc76a64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:22.905440 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5ba81e45-2ad3-41e8-8113-0e69f91cfb62 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] 10.222.0.20 "GET /compute/v2.1/servers/505e8d54-138e-404a-a403-1bd5c9b0c4ab" status: 200 len: 1427 microversion: 2.1 time: 0.633255 Oct 04 19:00:22.923159 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2933/5895] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:22 2022] GET /compute/v2.1/servers/505e8d54-138e-404a-a403-1bd5c9b0c4ab => generated 1427 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:23.025917 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d4072382-383d-47a9-8fed-3e661f7d2c6f tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:23.036756 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d4072382-383d-47a9-8fed-3e661f7d2c6f tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:23.040038 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d4072382-383d-47a9-8fed-3e661f7d2c6f tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:23.043042 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d4072382-383d-47a9-8fed-3e661f7d2c6f tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18" status: 200 len: 1738 microversion: 2.20 time: 0.359365 Oct 04 19:00:23.055318 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2963/5896] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:00:22 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 => generated 1738 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:00:23.639615 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9dc6269b-2c4c-42ae-b304-1ff2d7db2538 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:23.640843 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9dc6269b-2c4c-42ae-b304-1ff2d7db2538 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: cd8357d8-7845-4c92-ab64-22dbea5c6dbc] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:23.656583 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9dc6269b-2c4c-42ae-b304-1ff2d7db2538 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:23.657403 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9dc6269b-2c4c-42ae-b304-1ff2d7db2538 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:23.658024 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9dc6269b-2c4c-42ae-b304-1ff2d7db2538 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:23.660810 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9dc6269b-2c4c-42ae-b304-1ff2d7db2538 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:23.661485 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9dc6269b-2c4c-42ae-b304-1ff2d7db2538 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:23.663214 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9dc6269b-2c4c-42ae-b304-1ff2d7db2538 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:23.802241 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9dc6269b-2c4c-42ae-b304-1ff2d7db2538 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:23.803362 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9dc6269b-2c4c-42ae-b304-1ff2d7db2538 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:23.803892 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9dc6269b-2c4c-42ae-b304-1ff2d7db2538 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:23.804404 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-9dc6269b-2c4c-42ae-b304-1ff2d7db2538 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lazy-loading 'fault' on Instance uuid cd8357d8-7845-4c92-ab64-22dbea5c6dbc {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:00:23.865858 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9dc6269b-2c4c-42ae-b304-1ff2d7db2538 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:23.873662 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9dc6269b-2c4c-42ae-b304-1ff2d7db2538 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/cd8357d8-7845-4c92-ab64-22dbea5c6dbc" status: 200 len: 1147 microversion: 2.1 time: 0.238434 Oct 04 19:00:23.874594 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2934/5897] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:23 2022] GET /compute/v2.1/servers/cd8357d8-7845-4c92-ab64-22dbea5c6dbc => generated 1147 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:23.936362 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-51ffdc8c-f8b4-41cd-89a4-f8c7fecfc260 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:23.937948 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-51ffdc8c-f8b4-41cd-89a4-f8c7fecfc260 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] [instance: 505e8d54-138e-404a-a403-1bd5c9b0c4ab] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:23.963879 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-51ffdc8c-f8b4-41cd-89a4-f8c7fecfc260 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:23.968635 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-51ffdc8c-f8b4-41cd-89a4-f8c7fecfc260 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:23.969292 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-51ffdc8c-f8b4-41cd-89a4-f8c7fecfc260 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:23.970205 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-51ffdc8c-f8b4-41cd-89a4-f8c7fecfc260 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:23.976725 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-51ffdc8c-f8b4-41cd-89a4-f8c7fecfc260 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:23.977411 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-51ffdc8c-f8b4-41cd-89a4-f8c7fecfc260 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:24.077657 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0fcb5b71-ef7a-45bf-abf1-3a90e90744a9 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:24.078315 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0fcb5b71-ef7a-45bf-abf1-3a90e90744a9 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:24.094001 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0fcb5b71-ef7a-45bf-abf1-3a90e90744a9 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:24.094509 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0fcb5b71-ef7a-45bf-abf1-3a90e90744a9 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:24.104534 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0fcb5b71-ef7a-45bf-abf1-3a90e90744a9 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:24.108438 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0fcb5b71-ef7a-45bf-abf1-3a90e90744a9 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:24.109229 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0fcb5b71-ef7a-45bf-abf1-3a90e90744a9 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:24.114273 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0fcb5b71-ef7a-45bf-abf1-3a90e90744a9 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:24.172155 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=100 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:00:24.798637 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-51ffdc8c-f8b4-41cd-89a4-f8c7fecfc260 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07d8700f1d64a47b5f1b105178b60be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039c1953c26418d9a0b70444bc76a64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:24.822582 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-51ffdc8c-f8b4-41cd-89a4-f8c7fecfc260 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] 10.222.0.20 "GET /compute/v2.1/servers/505e8d54-138e-404a-a403-1bd5c9b0c4ab" status: 200 len: 1607 microversion: 2.1 time: 0.894805 Oct 04 19:00:24.828851 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2964/5898] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:23 2022] GET /compute/v2.1/servers/505e8d54-138e-404a-a403-1bd5c9b0c4ab => generated 1607 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:24.862832 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-598627f8-7595-4f06-b523-bf2e8c97062e tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:24.864596 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-598627f8-7595-4f06-b523-bf2e8c97062e tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] [instance: 505e8d54-138e-404a-a403-1bd5c9b0c4ab] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:24.867409 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0fcb5b71-ef7a-45bf-abf1-3a90e90744a9 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:24.895332 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-598627f8-7595-4f06-b523-bf2e8c97062e tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:24.908654 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0fcb5b71-ef7a-45bf-abf1-3a90e90744a9 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:24.911006 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0fcb5b71-ef7a-45bf-abf1-3a90e90744a9 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:24.921066 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-598627f8-7595-4f06-b523-bf2e8c97062e tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:24.925184 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-598627f8-7595-4f06-b523-bf2e8c97062e tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:24.926106 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-598627f8-7595-4f06-b523-bf2e8c97062e tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:24.926574 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-598627f8-7595-4f06-b523-bf2e8c97062e tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:24.927003 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-598627f8-7595-4f06-b523-bf2e8c97062e tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:24.941475 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0fcb5b71-ef7a-45bf-abf1-3a90e90744a9 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18" status: 200 len: 1738 microversion: 2.20 time: 0.865052 Oct 04 19:00:24.959406 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2935/5899] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:00:24 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 => generated 1738 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:00:24.972929 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-62423d12-3634-4dc7-b61b-618ee095f525 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:24.976436 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-62423d12-3634-4dc7-b61b-618ee095f525 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: cd8357d8-7845-4c92-ab64-22dbea5c6dbc] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:24.984201 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-62423d12-3634-4dc7-b61b-618ee095f525 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:24.985067 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-62423d12-3634-4dc7-b61b-618ee095f525 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:24.986936 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-62423d12-3634-4dc7-b61b-618ee095f525 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:24.989935 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-62423d12-3634-4dc7-b61b-618ee095f525 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:24.991243 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-62423d12-3634-4dc7-b61b-618ee095f525 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:24.991969 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-62423d12-3634-4dc7-b61b-618ee095f525 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:25.014347 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-62423d12-3634-4dc7-b61b-618ee095f525 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] HTTP exception thrown: Instance cd8357d8-7845-4c92-ab64-22dbea5c6dbc could not be found. Oct 04 19:00:25.016641 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-62423d12-3634-4dc7-b61b-618ee095f525 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Request method failure captured: Oct 04 19:00:25.016641 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/cd8357d8-7845-4c92-ab64-22dbea5c6dbc HTTP/1.1 Oct 04 19:00:25.016641 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 19:00:25.016641 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 19:00:25.016641 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 19:00:25.016641 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 19:00:25.016641 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 19:00:25.016641 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 19:00:25.016641 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 19:00:25.016641 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 19:00:25.016641 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPIJ4KptPiy5XyaUYG9pLSP7TnMEf-PY7yFvjaPGmW4DAHqC1kasy1bm5to10RwAF_dSHQb87b5amqQ9ZUna6URZpq6M0BGpvwENg84W1HvOZfHgDXT7E6YYTtPhmcCZbmf-MEJzIKVI741HwGnmdHx846U9v3mpOw6zsk7UNEsUijp4 Oct 04 19:00:25.016641 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 19:00:25.016641 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 19:00:25.016641 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 19:00:25.016641 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 19:00:25.016641 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 19:00:25.016641 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 19:00:25.016641 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 82d0cd3db371459db429cb770abde738 Oct 04 19:00:25.016641 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-TestVolumeBootPattern-1621879949 Oct 04 19:00:25.016641 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 19:00:25.016641 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 19:00:25.016641 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/82d0cd3db371459db429cb770abde738"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_82d0cd3db371459db429cb770abde738", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/82d0cd3db371459db429cb770abde738"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/82d0cd3db371459db429cb770abde738"}]}] Oct 04 19:00:25.016641 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-TestVolumeBootPattern-1621879949 Oct 04 19:00:25.016641 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 82d0cd3db371459db429cb770abde738 Oct 04 19:00:25.016641 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-TestVolumeBootPattern-1621879949 Oct 04 19:00:25.016641 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-TestVolumeBootPattern-1621879949-project Oct 04 19:00:25.016641 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 19:00:25.016641 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 19:00:25.016641 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: a65ae9c3fb3c46a2a393fe21ce21b9d4 Oct 04 19:00:25.016641 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-TestVolumeBootPattern-1621879949-project Oct 04 19:00:25.016641 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 19:00:25.016641 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance cd8357d8-7845-4c92-ab64-22dbea5c6dbc could not be found. Oct 04 19:00:25.016641 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'cd8357d8-7845-4c92-ab64-22dbea5c6dbc'} Oct 04 19:00:25.016641 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:00:25.016641 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:00:25.016641 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:00:25.016641 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:00:25.016641 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:00:25.016641 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:00:25.016641 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:00:25.016641 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:00:25.016641 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:00:25.016641 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:00:25.016641 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd8357d8-7845-4c92-ab64-22dbea5c6dbc could not be found. Oct 04 19:00:25.016641 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:00:25.016641 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:00:25.016641 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:00:25.016641 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:00:25.016641 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:00:25.016641 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:00:25.016641 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:00:25.016641 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:00:25.016641 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:00:25.016641 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:00:25.016641 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:00:25.016641 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:00:25.016641 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:00:25.016641 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:00:25.016641 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:00:25.016641 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:00:25.016641 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd8357d8-7845-4c92-ab64-22dbea5c6dbc could not be found. Oct 04 19:00:25.016641 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:00:25.016641 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:00:25.016641 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:00:25.022579 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:00:25.022579 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:00:25.022579 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:00:25.022579 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:00:25.022579 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:00:25.022579 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd8357d8-7845-4c92-ab64-22dbea5c6dbc could not be found. Oct 04 19:00:25.022579 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:00:25.028112 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-62423d12-3634-4dc7-b61b-618ee095f525 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Returning 404 to user: Instance cd8357d8-7845-4c92-ab64-22dbea5c6dbc could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:00:25.029468 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-62423d12-3634-4dc7-b61b-618ee095f525 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/cd8357d8-7845-4c92-ab64-22dbea5c6dbc" status: 404 len: 111 microversion: 2.1 time: 0.063272 Oct 04 19:00:25.032786 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2936/5900] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:24 2022] GET /compute/v2.1/servers/cd8357d8-7845-4c92-ab64-22dbea5c6dbc => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:00:25.670053 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-598627f8-7595-4f06-b523-bf2e8c97062e tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07d8700f1d64a47b5f1b105178b60be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039c1953c26418d9a0b70444bc76a64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:25.676331 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-598627f8-7595-4f06-b523-bf2e8c97062e tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] 10.222.0.20 "GET /compute/v2.1/servers/505e8d54-138e-404a-a403-1bd5c9b0c4ab" status: 200 len: 1607 microversion: 2.1 time: 0.828030 Oct 04 19:00:25.677697 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2965/5901] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:24 2022] GET /compute/v2.1/servers/505e8d54-138e-404a-a403-1bd5c9b0c4ab => generated 1607 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:25.709216 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-474a8200-d56b-4340-87fd-c744dc0502c6 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:25.710586 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-474a8200-d56b-4340-87fd-c744dc0502c6 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] [instance: 505e8d54-138e-404a-a403-1bd5c9b0c4ab] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:25.729622 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-474a8200-d56b-4340-87fd-c744dc0502c6 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:25.730433 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-474a8200-d56b-4340-87fd-c744dc0502c6 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:25.732967 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-474a8200-d56b-4340-87fd-c744dc0502c6 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:25.734133 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-474a8200-d56b-4340-87fd-c744dc0502c6 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:25.739223 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-474a8200-d56b-4340-87fd-c744dc0502c6 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:25.743802 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-474a8200-d56b-4340-87fd-c744dc0502c6 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:25.976841 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-03d7b830-4ed7-4142-ace3-9da2efcfa25a tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:25.977633 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-03d7b830-4ed7-4142-ace3-9da2efcfa25a tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:25.991579 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-03d7b830-4ed7-4142-ace3-9da2efcfa25a tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:25.995777 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-03d7b830-4ed7-4142-ace3-9da2efcfa25a tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:26.006345 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-03d7b830-4ed7-4142-ace3-9da2efcfa25a tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:26.010814 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-03d7b830-4ed7-4142-ace3-9da2efcfa25a tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:26.012496 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-03d7b830-4ed7-4142-ace3-9da2efcfa25a tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:26.016205 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-03d7b830-4ed7-4142-ace3-9da2efcfa25a tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:26.723163 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-474a8200-d56b-4340-87fd-c744dc0502c6 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07d8700f1d64a47b5f1b105178b60be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039c1953c26418d9a0b70444bc76a64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:26.744402 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-474a8200-d56b-4340-87fd-c744dc0502c6 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] 10.222.0.20 "GET /compute/v2.1/servers/505e8d54-138e-404a-a403-1bd5c9b0c4ab" status: 200 len: 1607 microversion: 2.1 time: 1.046473 Oct 04 19:00:26.748726 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2937/5902] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:25 2022] GET /compute/v2.1/servers/505e8d54-138e-404a-a403-1bd5c9b0c4ab => generated 1607 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:26.852347 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-03d7b830-4ed7-4142-ace3-9da2efcfa25a tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:26.861793 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-03d7b830-4ed7-4142-ace3-9da2efcfa25a tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:26.873563 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-03d7b830-4ed7-4142-ace3-9da2efcfa25a tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:26.880630 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-03d7b830-4ed7-4142-ace3-9da2efcfa25a tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18" status: 200 len: 1738 microversion: 2.20 time: 0.909333 Oct 04 19:00:26.881455 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2966/5903] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:00:25 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 => generated 1738 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:00:27.907418 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e1cab6d4-594c-4763-aa3f-107ca6d48e69 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:27.908277 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e1cab6d4-594c-4763-aa3f-107ca6d48e69 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:27.920414 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e1cab6d4-594c-4763-aa3f-107ca6d48e69 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:27.921010 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e1cab6d4-594c-4763-aa3f-107ca6d48e69 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:27.930787 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e1cab6d4-594c-4763-aa3f-107ca6d48e69 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:27.931728 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e1cab6d4-594c-4763-aa3f-107ca6d48e69 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:27.932497 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e1cab6d4-594c-4763-aa3f-107ca6d48e69 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:27.933172 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e1cab6d4-594c-4763-aa3f-107ca6d48e69 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:28.769016 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e1cab6d4-594c-4763-aa3f-107ca6d48e69 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:28.788880 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e1cab6d4-594c-4763-aa3f-107ca6d48e69 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:28.794279 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e1cab6d4-594c-4763-aa3f-107ca6d48e69 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:28.795748 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e1cab6d4-594c-4763-aa3f-107ca6d48e69 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18" status: 200 len: 1738 microversion: 2.20 time: 0.892676 Oct 04 19:00:28.800008 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2938/5904] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:00:27 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 => generated 1738 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 19:00:29.833666 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a2ac0a6b-783e-4d5c-bff9-0b6d1afa3a36 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:29.834839 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a2ac0a6b-783e-4d5c-bff9-0b6d1afa3a36 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:29.862253 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:00:29.872311 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a2ac0a6b-783e-4d5c-bff9-0b6d1afa3a36 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:29.872822 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a2ac0a6b-783e-4d5c-bff9-0b6d1afa3a36 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:29.873270 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a2ac0a6b-783e-4d5c-bff9-0b6d1afa3a36 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:29.873995 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a2ac0a6b-783e-4d5c-bff9-0b6d1afa3a36 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:29.874456 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a2ac0a6b-783e-4d5c-bff9-0b6d1afa3a36 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:29.874888 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a2ac0a6b-783e-4d5c-bff9-0b6d1afa3a36 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:30.349755 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a2ac0a6b-783e-4d5c-bff9-0b6d1afa3a36 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:30.353286 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=100 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:00:30.360116 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a2ac0a6b-783e-4d5c-bff9-0b6d1afa3a36 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:30.362174 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a2ac0a6b-783e-4d5c-bff9-0b6d1afa3a36 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:30.363408 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a2ac0a6b-783e-4d5c-bff9-0b6d1afa3a36 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18" status: 200 len: 1738 microversion: 2.20 time: 0.534693 Oct 04 19:00:30.376023 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2967/5905] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:00:29 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 => generated 1738 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:00:31.393585 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f57f39cd-f954-4859-a044-77dff96e016e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:31.395137 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f57f39cd-f954-4859-a044-77dff96e016e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:31.416620 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=64 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:00:31.430526 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f57f39cd-f954-4859-a044-77dff96e016e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:31.433554 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f57f39cd-f954-4859-a044-77dff96e016e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:31.434269 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f57f39cd-f954-4859-a044-77dff96e016e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:31.442639 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f57f39cd-f954-4859-a044-77dff96e016e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:31.442639 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f57f39cd-f954-4859-a044-77dff96e016e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:31.442639 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f57f39cd-f954-4859-a044-77dff96e016e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:32.370022 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f57f39cd-f954-4859-a044-77dff96e016e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:32.388166 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f57f39cd-f954-4859-a044-77dff96e016e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:32.390640 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f57f39cd-f954-4859-a044-77dff96e016e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:32.393501 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f57f39cd-f954-4859-a044-77dff96e016e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18" status: 200 len: 1720 microversion: 2.20 time: 1.005400 Oct 04 19:00:32.415900 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2939/5906] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:00:31 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 => generated 1720 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:00:33.429929 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-23156d45-7971-4f31-8fde-84aa105bd49e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:33.430743 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-23156d45-7971-4f31-8fde-84aa105bd49e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:33.446816 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-23156d45-7971-4f31-8fde-84aa105bd49e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:33.447323 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-23156d45-7971-4f31-8fde-84aa105bd49e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:33.448905 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-23156d45-7971-4f31-8fde-84aa105bd49e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:33.449661 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-23156d45-7971-4f31-8fde-84aa105bd49e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:33.450780 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-23156d45-7971-4f31-8fde-84aa105bd49e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:33.451544 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-23156d45-7971-4f31-8fde-84aa105bd49e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:34.283794 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-23156d45-7971-4f31-8fde-84aa105bd49e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:34.293239 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-23156d45-7971-4f31-8fde-84aa105bd49e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:34.317395 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-23156d45-7971-4f31-8fde-84aa105bd49e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:34.326689 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-23156d45-7971-4f31-8fde-84aa105bd49e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18" status: 200 len: 1720 microversion: 2.20 time: 0.900598 Oct 04 19:00:34.346018 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2968/5907] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:00:33 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 => generated 1720 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:00:35.359383 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0eb353c3-8c69-49d6-9c6d-41ce027e368b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:35.360551 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0eb353c3-8c69-49d6-9c6d-41ce027e368b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:35.373431 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0eb353c3-8c69-49d6-9c6d-41ce027e368b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:35.377963 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0eb353c3-8c69-49d6-9c6d-41ce027e368b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:35.379593 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0eb353c3-8c69-49d6-9c6d-41ce027e368b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:35.382969 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0eb353c3-8c69-49d6-9c6d-41ce027e368b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:35.383673 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0eb353c3-8c69-49d6-9c6d-41ce027e368b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:35.384367 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0eb353c3-8c69-49d6-9c6d-41ce027e368b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:35.684653 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-ae975945-05ef-4153-b647-aa2acdfa9ed7 req-c74263c7-6f46-46f5-bb3f-c664d42210a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b882133-2fca-4df4-b228-46a12f538c18", "name": "network-vif-unplugged", "status": "completed", "tag": "1f37fede-c1b1-491b-bab1-5ad8cb57086e"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:00:35.704263 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-ae975945-05ef-4153-b647-aa2acdfa9ed7 req-c74263c7-6f46-46f5-bb3f-c664d42210a8 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:35.708370 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-ae975945-05ef-4153-b647-aa2acdfa9ed7 req-c74263c7-6f46-46f5-bb3f-c664d42210a8 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:35.709046 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-ae975945-05ef-4153-b647-aa2acdfa9ed7 req-c74263c7-6f46-46f5-bb3f-c664d42210a8 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:35.752994 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-ae975945-05ef-4153-b647-aa2acdfa9ed7 req-c74263c7-6f46-46f5-bb3f-c664d42210a8 service nova] Creating event network-vif-unplugged:1f37fede-c1b1-491b-bab1-5ad8cb57086e for instance 7b882133-2fca-4df4-b228-46a12f538c18 on n-h1-850501-14 Oct 04 19:00:35.769989 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-ae975945-05ef-4153-b647-aa2acdfa9ed7 req-c74263c7-6f46-46f5-bb3f-c664d42210a8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.088959 Oct 04 19:00:35.776964 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2969/5908] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:00:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:00:35.795074 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0eb353c3-8c69-49d6-9c6d-41ce027e368b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:35.805647 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0eb353c3-8c69-49d6-9c6d-41ce027e368b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:35.812466 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0eb353c3-8c69-49d6-9c6d-41ce027e368b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:35.816215 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0eb353c3-8c69-49d6-9c6d-41ce027e368b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18" status: 200 len: 1720 microversion: 2.20 time: 0.462485 Oct 04 19:00:35.821122 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2940/5909] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:00:35 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 => generated 1720 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:00:36.399111 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-b7a66c52-ef98-49bc-b7e9-12c96a09cd69 req-dba914a2-f367-42ab-b775-8ea5afdaa0e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "505e8d54-138e-404a-a403-1bd5c9b0c4ab", "tag": "165d92c2-bb6d-44be-b249-79846e929a8b"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:00:36.429555 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-b7a66c52-ef98-49bc-b7e9-12c96a09cd69 req-dba914a2-f367-42ab-b775-8ea5afdaa0e7 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:36.430315 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-b7a66c52-ef98-49bc-b7e9-12c96a09cd69 req-dba914a2-f367-42ab-b775-8ea5afdaa0e7 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:36.431164 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-b7a66c52-ef98-49bc-b7e9-12c96a09cd69 req-dba914a2-f367-42ab-b775-8ea5afdaa0e7 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:36.467474 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-b7a66c52-ef98-49bc-b7e9-12c96a09cd69 req-dba914a2-f367-42ab-b775-8ea5afdaa0e7 service nova] Creating event network-changed:165d92c2-bb6d-44be-b249-79846e929a8b for instance 505e8d54-138e-404a-a403-1bd5c9b0c4ab on n-h1-850501-14 Oct 04 19:00:36.481708 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-b7a66c52-ef98-49bc-b7e9-12c96a09cd69 req-dba914a2-f367-42ab-b775-8ea5afdaa0e7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099495 Oct 04 19:00:36.488180 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2970/5910] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:00:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:00:36.850842 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-26e3d83a-6a34-4f72-bd43-4065762e90ff tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:36.851486 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-26e3d83a-6a34-4f72-bd43-4065762e90ff tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:36.864872 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-26e3d83a-6a34-4f72-bd43-4065762e90ff tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:36.877851 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-26e3d83a-6a34-4f72-bd43-4065762e90ff tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:36.878407 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-26e3d83a-6a34-4f72-bd43-4065762e90ff tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:36.882867 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-26e3d83a-6a34-4f72-bd43-4065762e90ff tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:36.885543 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-26e3d83a-6a34-4f72-bd43-4065762e90ff tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:36.886489 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-26e3d83a-6a34-4f72-bd43-4065762e90ff tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:37.052975 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0b7c82f9-d5e4-45a7-adda-02cf1e9cf752 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-363482929", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "210aa66c-6799-4948-8355-ba52c26c42ab", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "dbc89e1f-759d-4fcb-8e1c-542119e29e34"}]}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:00:37.179407 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.neutron [None req-0b7c82f9-d5e4-45a7-adda-02cf1e9cf752 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] validate_networks() for [('dbc89e1f-759d-4fcb-8e1c-542119e29e34', None, None, None, None, None)] {{(pid=123001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:00:37.472822 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-26e3d83a-6a34-4f72-bd43-4065762e90ff tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:37.488888 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-26e3d83a-6a34-4f72-bd43-4065762e90ff tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:37.495195 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-26e3d83a-6a34-4f72-bd43-4065762e90ff tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:37.497236 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-26e3d83a-6a34-4f72-bd43-4065762e90ff tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18" status: 200 len: 1723 microversion: 2.20 time: 0.652079 Oct 04 19:00:37.503114 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2941/5911] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:00:36 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 => generated 1723 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:00:37.529029 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a0260f79-60d9-44cb-b7ec-ec3afd9b3dfb tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "93f47f36-8b52-4fc9-84f2-6668d5cab544"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:00:37.531916 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a0260f79-60d9-44cb-b7ec-ec3afd9b3dfb tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:37.542860 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a0260f79-60d9-44cb-b7ec-ec3afd9b3dfb tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:37.543724 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a0260f79-60d9-44cb-b7ec-ec3afd9b3dfb tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:37.544700 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a0260f79-60d9-44cb-b7ec-ec3afd9b3dfb tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:37.545741 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a0260f79-60d9-44cb-b7ec-ec3afd9b3dfb tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:37.546419 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a0260f79-60d9-44cb-b7ec-ec3afd9b3dfb tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:37.553416 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a0260f79-60d9-44cb-b7ec-ec3afd9b3dfb tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:38.743640 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-0b7c82f9-d5e4-45a7-adda-02cf1e9cf752 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:00:38.744158 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-0b7c82f9-d5e4-45a7-adda-02cf1e9cf752 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:00:38.744702 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-0b7c82f9-d5e4-45a7-adda-02cf1e9cf752 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:00:38.745413 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-0b7c82f9-d5e4-45a7-adda-02cf1e9cf752 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:00:38.745918 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-0b7c82f9-d5e4-45a7-adda-02cf1e9cf752 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:00:38.759021 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a0260f79-60d9-44cb-b7ec-ec3afd9b3dfb tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "POST /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.234473 Oct 04 19:00:38.770526 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2942/5912] 10.222.0.20 () {62 vars in 1364 bytes} [Tue Oct 4 19:00:37 2022] POST /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18/os-volume_attachments => generated 188 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 19:00:38.779978 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f5d44709-6ccf-4cd7-afe4-0045936d06f1 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:38.788387 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0b7c82f9-d5e4-45a7-adda-02cf1e9cf752 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:38.788631 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f5d44709-6ccf-4cd7-afe4-0045936d06f1 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] [instance: 3edcc394-83d7-4358-8f99-af546b861685] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:38.790855 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0b7c82f9-d5e4-45a7-adda-02cf1e9cf752 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.033s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:38.790855 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0b7c82f9-d5e4-45a7-adda-02cf1e9cf752 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:38.793315 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0b7c82f9-d5e4-45a7-adda-02cf1e9cf752 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:38.794060 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0b7c82f9-d5e4-45a7-adda-02cf1e9cf752 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:38.794999 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0b7c82f9-d5e4-45a7-adda-02cf1e9cf752 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:38.797866 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f5d44709-6ccf-4cd7-afe4-0045936d06f1 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:38.798597 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f5d44709-6ccf-4cd7-afe4-0045936d06f1 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:38.799241 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f5d44709-6ccf-4cd7-afe4-0045936d06f1 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:38.800239 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f5d44709-6ccf-4cd7-afe4-0045936d06f1 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:38.801585 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f5d44709-6ccf-4cd7-afe4-0045936d06f1 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:38.802223 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f5d44709-6ccf-4cd7-afe4-0045936d06f1 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:38.834062 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-0b7c82f9-d5e4-45a7-adda-02cf1e9cf752 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Getting quotas for project 82d0cd3db371459db429cb770abde738. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:00:38.855169 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-0b7c82f9-d5e4-45a7-adda-02cf1e9cf752 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Getting quotas for user a65ae9c3fb3c46a2a393fe21ce21b9d4 and project 82d0cd3db371459db429cb770abde738. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:00:38.957630 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-f5d44709-6ccf-4cd7-afe4-0045936d06f1 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lazy-loading 'services' on Instance uuid 3edcc394-83d7-4358-8f99-af546b861685 {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:00:39.031378 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0b7c82f9-d5e4-45a7-adda-02cf1e9cf752 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Going to run 1 instances... {{(pid=123001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:00:39.034553 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0b7c82f9-d5e4-45a7-adda-02cf1e9cf752 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 12c4f942-479c-47b3-b824-def0b12f527b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='210aa66c-6799-4948-8355-ba52c26c42ab',volume_size=None,volume_type=None)] {{(pid=123001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:00:39.244159 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f5d44709-6ccf-4cd7-afe4-0045936d06f1 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3edcc394-83d7-4358-8f99-af546b861685/os-volume_attachments/99fd733b-05a0-4e44-80d9-94ddcb07339b" status: 202 len: 0 microversion: 2.1 time: 0.472213 Oct 04 19:00:39.244950 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2943/5913] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Oct 4 19:00:38 2022] DELETE /compute/v2.1/servers/3edcc394-83d7-4358-8f99-af546b861685/os-volume_attachments/99fd733b-05a0-4e44-80d9-94ddcb07339b => generated 0 bytes in 474 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:00:39.252635 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-fe8f5b7d-2ac3-4fa6-8ac1-01ec11ee30ee tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:00:39.255935 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-fe8f5b7d-2ac3-4fa6-8ac1-01ec11ee30ee tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:39.274536 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fe8f5b7d-2ac3-4fa6-8ac1-01ec11ee30ee tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:39.275245 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fe8f5b7d-2ac3-4fa6-8ac1-01ec11ee30ee tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:39.275817 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fe8f5b7d-2ac3-4fa6-8ac1-01ec11ee30ee tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:39.276705 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fe8f5b7d-2ac3-4fa6-8ac1-01ec11ee30ee tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:39.279502 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fe8f5b7d-2ac3-4fa6-8ac1-01ec11ee30ee tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:39.280143 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fe8f5b7d-2ac3-4fa6-8ac1-01ec11ee30ee tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:39.349307 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-fe8f5b7d-2ac3-4fa6-8ac1-01ec11ee30ee tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=123002) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 19:00:39.555175 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0b7c82f9-d5e4-45a7-adda-02cf1e9cf752 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.507339 Oct 04 19:00:39.555835 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2971/5914] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 19:00:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 2509 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 19:00:39.560690 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f182870c-317c-4981-bcef-8b30c9f8f74b tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:39.561443 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f182870c-317c-4981-bcef-8b30c9f8f74b tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: efab3398-8820-4a11-8dd2-0f7f51a73763] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:39.576969 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f182870c-317c-4981-bcef-8b30c9f8f74b tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:39.577481 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f182870c-317c-4981-bcef-8b30c9f8f74b tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:39.577928 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f182870c-317c-4981-bcef-8b30c9f8f74b tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:39.580904 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f182870c-317c-4981-bcef-8b30c9f8f74b tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:39.582087 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f182870c-317c-4981-bcef-8b30c9f8f74b tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:39.582671 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f182870c-317c-4981-bcef-8b30c9f8f74b tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:39.618240 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f182870c-317c-4981-bcef-8b30c9f8f74b tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/efab3398-8820-4a11-8dd2-0f7f51a73763/ips" status: 200 len: 151 microversion: 2.1 time: 0.061041 Oct 04 19:00:39.619516 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2972/5915] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Oct 4 19:00:39 2022] GET /compute/v2.1/servers/efab3398-8820-4a11-8dd2-0f7f51a73763/ips => generated 151 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:00:39.625163 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0f287e66-222d-49ca-95e6-25fb170b5ed5 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:39.629475 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0f287e66-222d-49ca-95e6-25fb170b5ed5 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 12c4f942-479c-47b3-b824-def0b12f527b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:39.701746 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-fe8f5b7d-2ac3-4fa6-8ac1-01ec11ee30ee tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "POST /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18/action" status: 202 len: 0 microversion: 2.20 time: 0.455523 Oct 04 19:00:39.702724 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2944/5916] 10.222.0.20 () {62 vars in 1319 bytes} [Tue Oct 4 19:00:39 2022] POST /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18/action => generated 0 bytes in 457 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:00:39.714525 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f4d5997b-5c9e-4e6e-b044-fd0ff96a9e1f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a8e039fe-2de9-4a43-8029-a353c57b3fdd"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:00:39.721334 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f4d5997b-5c9e-4e6e-b044-fd0ff96a9e1f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: efab3398-8820-4a11-8dd2-0f7f51a73763] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:39.741972 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f4d5997b-5c9e-4e6e-b044-fd0ff96a9e1f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:39.742998 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f4d5997b-5c9e-4e6e-b044-fd0ff96a9e1f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:39.743603 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f4d5997b-5c9e-4e6e-b044-fd0ff96a9e1f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:39.745050 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f4d5997b-5c9e-4e6e-b044-fd0ff96a9e1f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:39.747852 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f4d5997b-5c9e-4e6e-b044-fd0ff96a9e1f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:39.748517 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f4d5997b-5c9e-4e6e-b044-fd0ff96a9e1f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:39.752886 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0f287e66-222d-49ca-95e6-25fb170b5ed5 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:39.762980 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0f287e66-222d-49ca-95e6-25fb170b5ed5 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/12c4f942-479c-47b3-b824-def0b12f527b" status: 200 len: 1056 microversion: 2.1 time: 0.142127 Oct 04 19:00:39.763578 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2973/5917] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:39 2022] GET /compute/v2.1/servers/12c4f942-479c-47b3-b824-def0b12f527b => generated 1056 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:39.771407 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a7feec8a-0b7c-46c8-9937-ded7e8deba52 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:39.772268 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a7feec8a-0b7c-46c8-9937-ded7e8deba52 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:39.802783 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a7feec8a-0b7c-46c8-9937-ded7e8deba52 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:39.803790 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a7feec8a-0b7c-46c8-9937-ded7e8deba52 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:39.804319 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a7feec8a-0b7c-46c8-9937-ded7e8deba52 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:39.806090 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a7feec8a-0b7c-46c8-9937-ded7e8deba52 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:39.806355 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a7feec8a-0b7c-46c8-9937-ded7e8deba52 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:39.808156 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a7feec8a-0b7c-46c8-9937-ded7e8deba52 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:39.953128 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-f4d5997b-5c9e-4e6e-b044-fd0ff96a9e1f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] HTTP exception thrown: Invalid volume: volume a8e039fe-2de9-4a43-8029-a353c57b3fdd is already attached to instances: ba710906-86d6-4c04-a708-1f3b9a466e3c Oct 04 19:00:39.955472 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f4d5997b-5c9e-4e6e-b044-fd0ff96a9e1f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Request method failure captured: Oct 04 19:00:39.955472 n-d-850501-14 devstack@n-api.service[123002]: request: POST /compute/v2.1/servers/efab3398-8820-4a11-8dd2-0f7f51a73763/os-volume_attachments HTTP/1.1 Oct 04 19:00:39.955472 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 19:00:39.955472 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 19:00:39.955472 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 19:00:39.955472 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 74 Oct 04 19:00:39.955472 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 19:00:39.955472 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 19:00:39.955472 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 19:00:39.955472 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 19:00:39.955472 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPIIX_3DOcExv0tyjf74SMRRF0KoXtiJVCF7h65af0U3qLWvNf58dKqXrLellPdPVePIBHO4xx7DLTXsLA5NqBHQCEuDWqWqMr6VInyDk7lvTZQyuDvBxRCTYPpwhj6qdAHOfmE7y3qjml2L3OlgdXc8W6zK59OH-OYNHGwvWAJmEgQ4 Oct 04 19:00:39.955472 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 19:00:39.955472 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 19:00:39.955472 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 19:00:39.955472 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 19:00:39.955472 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 19:00:39.955472 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 19:00:39.955472 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 5dc67d8de57543c48bdf45669b684227 Oct 04 19:00:39.955472 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-AttachVolumeNegativeTest-715412502 Oct 04 19:00:39.955472 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 19:00:39.955472 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 19:00:39.955472 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5dc67d8de57543c48bdf45669b684227"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5dc67d8de57543c48bdf45669b684227", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5dc67d8de57543c48bdf45669b684227"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5dc67d8de57543c48bdf45669b684227"}]}] Oct 04 19:00:39.955472 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-AttachVolumeNegativeTest-715412502 Oct 04 19:00:39.955472 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 5dc67d8de57543c48bdf45669b684227 Oct 04 19:00:39.955472 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-715412502 Oct 04 19:00:39.955472 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-AttachVolumeNegativeTest-715412502-project Oct 04 19:00:39.955472 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 19:00:39.955472 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 19:00:39.955472 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: ce441ded6f554ec28560c75de97af173 Oct 04 19:00:39.955472 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-AttachVolumeNegativeTest-715412502-project Oct 04 19:00:39.955472 n-d-850501-14 devstack@n-api.service[123002]: Oct 04 19:00:39.955472 n-d-850501-14 devstack@n-api.service[123002]: {"volumeAttachment": {"volumeId": "a8e039fe-2de9-4a43-8029-a353c57b3fdd"}} Oct 04 19:00:39.955472 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 19:00:39.955472 n-d-850501-14 devstack@n-api.service[123002]: exception: Invalid volume: volume a8e039fe-2de9-4a43-8029-a353c57b3fdd is already attached to instances: ba710906-86d6-4c04-a708-1f3b9a466e3c Oct 04 19:00:39.955472 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'server_id': 'efab3398-8820-4a11-8dd2-0f7f51a73763', 'body': {'volumeAttachment': {'volumeId': 'a8e039fe-2de9-4a43-8029-a353c57b3fdd'}}} Oct 04 19:00:39.955472 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:00:39.955472 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:00:39.955472 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 04 19:00:39.955472 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 04 19:00:39.955472 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 19:00:39.955472 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 19:00:39.955472 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 04 19:00:39.955472 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 19:00:39.955472 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 04 19:00:39.955472 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 04 19:00:39.955472 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 04 19:00:39.955472 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 04 19:00:39.955472 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume a8e039fe-2de9-4a43-8029-a353c57b3fdd is already attached to instances: ba710906-86d6-4c04-a708-1f3b9a466e3c Oct 04 19:00:39.955472 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:00:39.955472 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:00:39.955472 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:00:39.955472 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:00:39.955472 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:00:39.955472 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:00:39.955472 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:00:39.955472 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:00:39.955472 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:00:39.955472 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:00:39.955472 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 19:00:39.955472 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 19:00:39.955472 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 19:00:39.955472 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 19:00:39.960406 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 19:00:39.960406 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 19:00:39.960406 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 04 19:00:39.960406 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 04 19:00:39.960406 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume a8e039fe-2de9-4a43-8029-a353c57b3fdd is already attached to instances: ba710906-86d6-4c04-a708-1f3b9a466e3c Oct 04 19:00:39.960406 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:00:39.960406 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:00:39.960406 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:00:39.960406 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:00:39.960406 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:00:39.960406 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:00:39.960406 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:00:39.960406 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:00:39.960406 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume a8e039fe-2de9-4a43-8029-a353c57b3fdd is already attached to instances: ba710906-86d6-4c04-a708-1f3b9a466e3c Oct 04 19:00:39.960406 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:00:39.960406 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f4d5997b-5c9e-4e6e-b044-fd0ff96a9e1f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Returning 400 to user: Invalid volume: volume a8e039fe-2de9-4a43-8029-a353c57b3fdd is already attached to instances: ba710906-86d6-4c04-a708-1f3b9a466e3c {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:00:39.961476 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f4d5997b-5c9e-4e6e-b044-fd0ff96a9e1f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "POST /compute/v2.1/servers/efab3398-8820-4a11-8dd2-0f7f51a73763/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.256723 Oct 04 19:00:39.969418 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2945/5918] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Oct 4 19:00:39 2022] POST /compute/v2.1/servers/efab3398-8820-4a11-8dd2-0f7f51a73763/os-volume_attachments => generated 174 bytes in 266 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 19:00:39.986095 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-05ba99f0-fdb0-40e2-9810-018f20570a62 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:39.986630 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-05ba99f0-fdb0-40e2-9810-018f20570a62 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: efab3398-8820-4a11-8dd2-0f7f51a73763] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:40.015722 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-05ba99f0-fdb0-40e2-9810-018f20570a62 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:40.016257 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-05ba99f0-fdb0-40e2-9810-018f20570a62 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:40.017130 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-05ba99f0-fdb0-40e2-9810-018f20570a62 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:40.040336 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-05ba99f0-fdb0-40e2-9810-018f20570a62 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:40.044044 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-05ba99f0-fdb0-40e2-9810-018f20570a62 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:40.047692 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-05ba99f0-fdb0-40e2-9810-018f20570a62 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:40.157078 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-05ba99f0-fdb0-40e2-9810-018f20570a62 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: efab3398-8820-4a11-8dd2-0f7f51a73763] Going to try to terminate instance {{(pid=123002) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:00:40.247984 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a7feec8a-0b7c-46c8-9937-ded7e8deba52 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:40.263134 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a7feec8a-0b7c-46c8-9937-ded7e8deba52 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:40.268035 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a7feec8a-0b7c-46c8-9937-ded7e8deba52 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:40.272037 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a7feec8a-0b7c-46c8-9937-ded7e8deba52 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18" status: 200 len: 1749 microversion: 2.20 time: 0.506183 Oct 04 19:00:40.276550 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2974/5919] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:00:39 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 => generated 1749 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:00:40.463085 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=6,nova_cell1:UPDATE=6 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:00:40.633359 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-05ba99f0-fdb0-40e2-9810-018f20570a62 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "DELETE /compute/v2.1/servers/efab3398-8820-4a11-8dd2-0f7f51a73763" status: 204 len: 0 microversion: 2.1 time: 0.659015 Oct 04 19:00:40.634372 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2946/5920] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 19:00:39 2022] DELETE /compute/v2.1/servers/efab3398-8820-4a11-8dd2-0f7f51a73763 => generated 0 bytes in 661 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 19:00:40.654274 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-88b85d30-8344-4021-aa67-995715d01996 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:40.660433 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-88b85d30-8344-4021-aa67-995715d01996 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: efab3398-8820-4a11-8dd2-0f7f51a73763] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:40.682070 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-88b85d30-8344-4021-aa67-995715d01996 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:40.683967 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-88b85d30-8344-4021-aa67-995715d01996 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:40.686208 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-88b85d30-8344-4021-aa67-995715d01996 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:40.687048 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-88b85d30-8344-4021-aa67-995715d01996 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:40.689867 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-88b85d30-8344-4021-aa67-995715d01996 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:40.690836 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-88b85d30-8344-4021-aa67-995715d01996 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:40.791993 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-16ed8386-d2f9-4b5a-a8d8-063f64632259 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:40.793038 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-16ed8386-d2f9-4b5a-a8d8-063f64632259 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 12c4f942-479c-47b3-b824-def0b12f527b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:41.018128 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-16ed8386-d2f9-4b5a-a8d8-063f64632259 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:41.035285 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-88b85d30-8344-4021-aa67-995715d01996 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce441ded6f554ec28560c75de97af173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc67d8de57543c48bdf45669b684227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:41.040256 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-16ed8386-d2f9-4b5a-a8d8-063f64632259 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/12c4f942-479c-47b3-b824-def0b12f527b" status: 200 len: 1056 microversion: 2.1 time: 0.253836 Oct 04 19:00:41.044153 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2947/5921] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:40 2022] GET /compute/v2.1/servers/12c4f942-479c-47b3-b824-def0b12f527b => generated 1056 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:41.050580 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-88b85d30-8344-4021-aa67-995715d01996 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/efab3398-8820-4a11-8dd2-0f7f51a73763" status: 200 len: 1682 microversion: 2.1 time: 0.412015 Oct 04 19:00:41.051807 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2975/5922] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:40 2022] GET /compute/v2.1/servers/efab3398-8820-4a11-8dd2-0f7f51a73763 => generated 1682 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:41.306329 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-bdddc9b9-66df-405d-8ed2-ee943e5a9094 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:41.307190 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-bdddc9b9-66df-405d-8ed2-ee943e5a9094 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:41.316411 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bdddc9b9-66df-405d-8ed2-ee943e5a9094 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:41.317190 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bdddc9b9-66df-405d-8ed2-ee943e5a9094 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:41.318171 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bdddc9b9-66df-405d-8ed2-ee943e5a9094 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:41.319343 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bdddc9b9-66df-405d-8ed2-ee943e5a9094 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:41.319986 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bdddc9b9-66df-405d-8ed2-ee943e5a9094 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:41.320476 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bdddc9b9-66df-405d-8ed2-ee943e5a9094 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:41.950881 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-bdddc9b9-66df-405d-8ed2-ee943e5a9094 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:41.975113 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-bdddc9b9-66df-405d-8ed2-ee943e5a9094 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:41.976936 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-bdddc9b9-66df-405d-8ed2-ee943e5a9094 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:41.978352 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-bdddc9b9-66df-405d-8ed2-ee943e5a9094 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18" status: 200 len: 1749 microversion: 2.20 time: 0.676416 Oct 04 19:00:41.982907 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2948/5923] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:00:41 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 => generated 1749 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:00:42.090124 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-57429749-8339-4a10-84fa-517bf0627a4d tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:42.091383 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-57429749-8339-4a10-84fa-517bf0627a4d tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 12c4f942-479c-47b3-b824-def0b12f527b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:42.098746 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5bd2b8fa-bcbe-4538-b6ea-053ea6d0a971 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:42.105711 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5bd2b8fa-bcbe-4538-b6ea-053ea6d0a971 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: efab3398-8820-4a11-8dd2-0f7f51a73763] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:42.114015 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-57429749-8339-4a10-84fa-517bf0627a4d tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:42.116719 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-57429749-8339-4a10-84fa-517bf0627a4d tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:42.120746 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-57429749-8339-4a10-84fa-517bf0627a4d tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:42.120746 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-57429749-8339-4a10-84fa-517bf0627a4d tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:42.120746 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-57429749-8339-4a10-84fa-517bf0627a4d tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:42.120746 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-57429749-8339-4a10-84fa-517bf0627a4d tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:42.121509 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5bd2b8fa-bcbe-4538-b6ea-053ea6d0a971 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:42.122002 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5bd2b8fa-bcbe-4538-b6ea-053ea6d0a971 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:42.122432 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5bd2b8fa-bcbe-4538-b6ea-053ea6d0a971 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:42.123137 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5bd2b8fa-bcbe-4538-b6ea-053ea6d0a971 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:42.123598 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5bd2b8fa-bcbe-4538-b6ea-053ea6d0a971 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:42.124019 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5bd2b8fa-bcbe-4538-b6ea-053ea6d0a971 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:42.600988 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-57429749-8339-4a10-84fa-517bf0627a4d tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:42.613520 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-57429749-8339-4a10-84fa-517bf0627a4d tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/12c4f942-479c-47b3-b824-def0b12f527b" status: 200 len: 1154 microversion: 2.1 time: 0.528044 Oct 04 19:00:42.621105 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2976/5924] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:42 2022] GET /compute/v2.1/servers/12c4f942-479c-47b3-b824-def0b12f527b => generated 1154 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:43.010712 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7749d251-3c40-4531-a19e-61aaed9daeaa tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:43.012551 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7749d251-3c40-4531-a19e-61aaed9daeaa tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:43.026763 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7749d251-3c40-4531-a19e-61aaed9daeaa tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:43.027302 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7749d251-3c40-4531-a19e-61aaed9daeaa tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:43.027747 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7749d251-3c40-4531-a19e-61aaed9daeaa tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:43.033975 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7749d251-3c40-4531-a19e-61aaed9daeaa tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:43.035920 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7749d251-3c40-4531-a19e-61aaed9daeaa tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:43.035920 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7749d251-3c40-4531-a19e-61aaed9daeaa tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:43.198191 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5bd2b8fa-bcbe-4538-b6ea-053ea6d0a971 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce441ded6f554ec28560c75de97af173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc67d8de57543c48bdf45669b684227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:43.222739 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5bd2b8fa-bcbe-4538-b6ea-053ea6d0a971 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/efab3398-8820-4a11-8dd2-0f7f51a73763" status: 200 len: 1682 microversion: 2.1 time: 1.130790 Oct 04 19:00:43.223615 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2949/5925] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:42 2022] GET /compute/v2.1/servers/efab3398-8820-4a11-8dd2-0f7f51a73763 => generated 1682 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:00:43.637198 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-cef0bc26-cad6-4771-ab87-25d01bb22c77 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:43.637829 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-cef0bc26-cad6-4771-ab87-25d01bb22c77 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 12c4f942-479c-47b3-b824-def0b12f527b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:43.648108 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cef0bc26-cad6-4771-ab87-25d01bb22c77 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:43.650989 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cef0bc26-cad6-4771-ab87-25d01bb22c77 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:43.651453 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cef0bc26-cad6-4771-ab87-25d01bb22c77 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:43.652230 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cef0bc26-cad6-4771-ab87-25d01bb22c77 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:43.652696 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cef0bc26-cad6-4771-ab87-25d01bb22c77 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:43.653133 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cef0bc26-cad6-4771-ab87-25d01bb22c77 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:44.653445 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-cef0bc26-cad6-4771-ab87-25d01bb22c77 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:44.662500 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-cef0bc26-cad6-4771-ab87-25d01bb22c77 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/12c4f942-479c-47b3-b824-def0b12f527b" status: 200 len: 1214 microversion: 2.1 time: 1.029218 Oct 04 19:00:44.663028 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2950/5926] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:43 2022] GET /compute/v2.1/servers/12c4f942-479c-47b3-b824-def0b12f527b => generated 1214 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:44.695460 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-975ceeb9-2c76-4f71-8a2a-045436946f5c tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:44.696024 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-975ceeb9-2c76-4f71-8a2a-045436946f5c tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: efab3398-8820-4a11-8dd2-0f7f51a73763] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:44.717497 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-975ceeb9-2c76-4f71-8a2a-045436946f5c tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:44.718838 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-975ceeb9-2c76-4f71-8a2a-045436946f5c tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:44.718838 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-975ceeb9-2c76-4f71-8a2a-045436946f5c tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:44.720249 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-975ceeb9-2c76-4f71-8a2a-045436946f5c tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:44.721116 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-975ceeb9-2c76-4f71-8a2a-045436946f5c tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:44.721752 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-975ceeb9-2c76-4f71-8a2a-045436946f5c tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:44.860322 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7749d251-3c40-4531-a19e-61aaed9daeaa tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:44.877952 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7749d251-3c40-4531-a19e-61aaed9daeaa tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:44.880181 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7749d251-3c40-4531-a19e-61aaed9daeaa tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:44.881813 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7749d251-3c40-4531-a19e-61aaed9daeaa tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18" status: 200 len: 1749 microversion: 2.20 time: 1.877844 Oct 04 19:00:44.882620 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2977/5927] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:00:43 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 => generated 1749 bytes in 1879 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:00:45.021941 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-975ceeb9-2c76-4f71-8a2a-045436946f5c tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce441ded6f554ec28560c75de97af173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc67d8de57543c48bdf45669b684227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:45.067086 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-975ceeb9-2c76-4f71-8a2a-045436946f5c tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/efab3398-8820-4a11-8dd2-0f7f51a73763" status: 200 len: 1682 microversion: 2.1 time: 0.378049 Oct 04 19:00:45.069384 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2951/5928] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:44 2022] GET /compute/v2.1/servers/efab3398-8820-4a11-8dd2-0f7f51a73763 => generated 1682 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:45.687196 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d7a38ddc-19b9-41a5-86d4-053300156531 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:45.687883 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d7a38ddc-19b9-41a5-86d4-053300156531 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 12c4f942-479c-47b3-b824-def0b12f527b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:45.704856 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d7a38ddc-19b9-41a5-86d4-053300156531 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:45.705276 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d7a38ddc-19b9-41a5-86d4-053300156531 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:45.705736 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d7a38ddc-19b9-41a5-86d4-053300156531 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:45.706477 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d7a38ddc-19b9-41a5-86d4-053300156531 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:45.707017 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d7a38ddc-19b9-41a5-86d4-053300156531 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:45.707427 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d7a38ddc-19b9-41a5-86d4-053300156531 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:45.923562 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-58490971-4676-421d-94c9-30ba16b793cb tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:45.924712 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-58490971-4676-421d-94c9-30ba16b793cb tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:45.945023 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-58490971-4676-421d-94c9-30ba16b793cb tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:45.950337 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-58490971-4676-421d-94c9-30ba16b793cb tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:45.951170 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-58490971-4676-421d-94c9-30ba16b793cb tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:45.953327 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-58490971-4676-421d-94c9-30ba16b793cb tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:45.954709 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-58490971-4676-421d-94c9-30ba16b793cb tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:45.955578 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-58490971-4676-421d-94c9-30ba16b793cb tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:46.406832 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d7a38ddc-19b9-41a5-86d4-053300156531 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:46.422509 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d7a38ddc-19b9-41a5-86d4-053300156531 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/12c4f942-479c-47b3-b824-def0b12f527b" status: 200 len: 1214 microversion: 2.1 time: 0.739522 Oct 04 19:00:46.424911 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2978/5929] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:45 2022] GET /compute/v2.1/servers/12c4f942-479c-47b3-b824-def0b12f527b => generated 1214 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:46.446514 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ae115715-a84b-4fe6-bb44-608a12b9a0ae tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:46.447509 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ae115715-a84b-4fe6-bb44-608a12b9a0ae tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: efab3398-8820-4a11-8dd2-0f7f51a73763] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:46.479304 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ae115715-a84b-4fe6-bb44-608a12b9a0ae tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:46.480184 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ae115715-a84b-4fe6-bb44-608a12b9a0ae tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:46.483142 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ae115715-a84b-4fe6-bb44-608a12b9a0ae tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:46.486025 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ae115715-a84b-4fe6-bb44-608a12b9a0ae tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:46.493552 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ae115715-a84b-4fe6-bb44-608a12b9a0ae tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:46.499074 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ae115715-a84b-4fe6-bb44-608a12b9a0ae tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:46.730026 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ae115715-a84b-4fe6-bb44-608a12b9a0ae tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce441ded6f554ec28560c75de97af173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc67d8de57543c48bdf45669b684227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:46.744226 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-58490971-4676-421d-94c9-30ba16b793cb tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:46.759647 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-58490971-4676-421d-94c9-30ba16b793cb tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:46.761947 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ae115715-a84b-4fe6-bb44-608a12b9a0ae tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/efab3398-8820-4a11-8dd2-0f7f51a73763" status: 200 len: 1614 microversion: 2.1 time: 0.331223 Oct 04 19:00:46.762666 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2979/5930] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:46 2022] GET /compute/v2.1/servers/efab3398-8820-4a11-8dd2-0f7f51a73763 => generated 1614 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:46.779914 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-58490971-4676-421d-94c9-30ba16b793cb tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:46.781229 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-58490971-4676-421d-94c9-30ba16b793cb tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18" status: 200 len: 1751 microversion: 2.20 time: 0.872941 Oct 04 19:00:46.783506 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-30f14938-794f-433f-9f8f-efa5979d391a req-cd09f679-c8a8-4920-85f9-3eecd5eed84f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efab3398-8820-4a11-8dd2-0f7f51a73763", "name": "network-vif-deleted", "tag": "740a18b8-34ca-450d-a2e5-f7f6a97fe931"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:00:46.790639 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2952/5931] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:00:45 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 => generated 1751 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:00:46.833233 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-57447dc1-c46a-445d-a613-d9f353285046 req-0d0dc317-e37f-4c91-b2ff-d1f59465f993 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12c4f942-479c-47b3-b824-def0b12f527b", "tag": "e4977aed-cb1f-4e42-b534-b46ca871039f"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:00:46.863869 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-30f14938-794f-433f-9f8f-efa5979d391a req-cd09f679-c8a8-4920-85f9-3eecd5eed84f service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:46.869405 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-30f14938-794f-433f-9f8f-efa5979d391a req-cd09f679-c8a8-4920-85f9-3eecd5eed84f service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:46.869900 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-30f14938-794f-433f-9f8f-efa5979d391a req-cd09f679-c8a8-4920-85f9-3eecd5eed84f service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:46.902551 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-57447dc1-c46a-445d-a613-d9f353285046 req-0d0dc317-e37f-4c91-b2ff-d1f59465f993 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:46.904457 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-57447dc1-c46a-445d-a613-d9f353285046 req-0d0dc317-e37f-4c91-b2ff-d1f59465f993 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:46.905513 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-57447dc1-c46a-445d-a613-d9f353285046 req-0d0dc317-e37f-4c91-b2ff-d1f59465f993 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:46.932681 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-30f14938-794f-433f-9f8f-efa5979d391a req-cd09f679-c8a8-4920-85f9-3eecd5eed84f service nova] Creating event network-vif-deleted:740a18b8-34ca-450d-a2e5-f7f6a97fe931 for instance efab3398-8820-4a11-8dd2-0f7f51a73763 on n-h1-850501-14 Oct 04 19:00:46.939507 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-57447dc1-c46a-445d-a613-d9f353285046 req-0d0dc317-e37f-4c91-b2ff-d1f59465f993 service nova] Creating event network-changed:e4977aed-cb1f-4e42-b534-b46ca871039f for instance 12c4f942-479c-47b3-b824-def0b12f527b on n-h2-850501-14 Oct 04 19:00:46.947296 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-30f14938-794f-433f-9f8f-efa5979d391a req-cd09f679-c8a8-4920-85f9-3eecd5eed84f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.183339 Oct 04 19:00:46.950672 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2980/5932] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:00:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:00:46.963486 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-57447dc1-c46a-445d-a613-d9f353285046 req-0d0dc317-e37f-4c91-b2ff-d1f59465f993 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.171329 Oct 04 19:00:46.966272 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2953/5933] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:00:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:00:47.448775 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-47c23636-a829-4aa0-9d36-229cfdb43bf6 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:47.449601 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-47c23636-a829-4aa0-9d36-229cfdb43bf6 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 12c4f942-479c-47b3-b824-def0b12f527b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:47.468781 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-47c23636-a829-4aa0-9d36-229cfdb43bf6 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:47.471248 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-47c23636-a829-4aa0-9d36-229cfdb43bf6 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:47.471967 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-47c23636-a829-4aa0-9d36-229cfdb43bf6 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:47.473131 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-47c23636-a829-4aa0-9d36-229cfdb43bf6 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:47.473861 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-47c23636-a829-4aa0-9d36-229cfdb43bf6 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:47.474585 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-47c23636-a829-4aa0-9d36-229cfdb43bf6 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:47.734777 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-47c23636-a829-4aa0-9d36-229cfdb43bf6 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:47.746145 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-47c23636-a829-4aa0-9d36-229cfdb43bf6 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/12c4f942-479c-47b3-b824-def0b12f527b" status: 200 len: 1214 microversion: 2.1 time: 0.302853 Oct 04 19:00:47.749101 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2981/5934] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:47 2022] GET /compute/v2.1/servers/12c4f942-479c-47b3-b824-def0b12f527b => generated 1214 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:47.791854 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-267b88d6-9f74-4f6e-ac86-63d78b4e444b tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:47.792679 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-267b88d6-9f74-4f6e-ac86-63d78b4e444b tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: efab3398-8820-4a11-8dd2-0f7f51a73763] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:47.803794 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-267b88d6-9f74-4f6e-ac86-63d78b4e444b tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:47.804328 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-267b88d6-9f74-4f6e-ac86-63d78b4e444b tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:47.804771 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-267b88d6-9f74-4f6e-ac86-63d78b4e444b tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:47.810552 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-267b88d6-9f74-4f6e-ac86-63d78b4e444b tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:47.811329 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-267b88d6-9f74-4f6e-ac86-63d78b4e444b tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:47.811958 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-267b88d6-9f74-4f6e-ac86-63d78b4e444b tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:47.824008 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7750ff0d-1d72-4996-8545-30b34f08df7d tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:47.824902 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7750ff0d-1d72-4996-8545-30b34f08df7d tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:47.845676 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7750ff0d-1d72-4996-8545-30b34f08df7d tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:47.846460 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7750ff0d-1d72-4996-8545-30b34f08df7d tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:47.847150 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7750ff0d-1d72-4996-8545-30b34f08df7d tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:47.848149 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7750ff0d-1d72-4996-8545-30b34f08df7d tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:47.855454 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7750ff0d-1d72-4996-8545-30b34f08df7d tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:47.855454 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7750ff0d-1d72-4996-8545-30b34f08df7d tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:47.858252 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-267b88d6-9f74-4f6e-ac86-63d78b4e444b tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] HTTP exception thrown: Instance efab3398-8820-4a11-8dd2-0f7f51a73763 could not be found. Oct 04 19:00:47.864861 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-267b88d6-9f74-4f6e-ac86-63d78b4e444b tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Request method failure captured: Oct 04 19:00:47.864861 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/efab3398-8820-4a11-8dd2-0f7f51a73763 HTTP/1.1 Oct 04 19:00:47.864861 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 19:00:47.864861 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 19:00:47.864861 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 19:00:47.864861 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 19:00:47.864861 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 19:00:47.864861 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 19:00:47.864861 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 19:00:47.864861 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 19:00:47.864861 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPIIX_3DOcExv0tyjf74SMRRF0KoXtiJVCF7h65af0U3qLWvNf58dKqXrLellPdPVePIBHO4xx7DLTXsLA5NqBHQCEuDWqWqMr6VInyDk7lvTZQyuDvBxRCTYPpwhj6qdAHOfmE7y3qjml2L3OlgdXc8W6zK59OH-OYNHGwvWAJmEgQ4 Oct 04 19:00:47.864861 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 19:00:47.864861 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 19:00:47.864861 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 19:00:47.864861 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 19:00:47.864861 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 19:00:47.864861 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 19:00:47.864861 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 5dc67d8de57543c48bdf45669b684227 Oct 04 19:00:47.864861 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-AttachVolumeNegativeTest-715412502 Oct 04 19:00:47.864861 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 19:00:47.864861 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 19:00:47.864861 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5dc67d8de57543c48bdf45669b684227"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5dc67d8de57543c48bdf45669b684227", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5dc67d8de57543c48bdf45669b684227"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5dc67d8de57543c48bdf45669b684227"}]}] Oct 04 19:00:47.864861 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-AttachVolumeNegativeTest-715412502 Oct 04 19:00:47.864861 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 5dc67d8de57543c48bdf45669b684227 Oct 04 19:00:47.864861 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-715412502 Oct 04 19:00:47.864861 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-AttachVolumeNegativeTest-715412502-project Oct 04 19:00:47.864861 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 19:00:47.864861 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 19:00:47.864861 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: ce441ded6f554ec28560c75de97af173 Oct 04 19:00:47.864861 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-AttachVolumeNegativeTest-715412502-project Oct 04 19:00:47.864861 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 19:00:47.864861 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance efab3398-8820-4a11-8dd2-0f7f51a73763 could not be found. Oct 04 19:00:47.864861 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'efab3398-8820-4a11-8dd2-0f7f51a73763'} Oct 04 19:00:47.864861 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:00:47.864861 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:00:47.864861 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:00:47.864861 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:00:47.864861 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:00:47.864861 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:00:47.864861 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:00:47.864861 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:00:47.864861 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:00:47.864861 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:00:47.864861 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efab3398-8820-4a11-8dd2-0f7f51a73763 could not be found. Oct 04 19:00:47.864861 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:00:47.864861 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:00:47.864861 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:00:47.864861 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:00:47.864861 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:00:47.864861 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:00:47.864861 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:00:47.864861 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:00:47.864861 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:00:47.864861 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:00:47.864861 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:00:47.864861 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:00:47.864861 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:00:47.864861 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:00:47.864861 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:00:47.864861 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:00:47.864861 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efab3398-8820-4a11-8dd2-0f7f51a73763 could not be found. Oct 04 19:00:47.864861 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:00:47.864861 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:00:47.864861 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:00:47.869990 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:00:47.869990 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:00:47.869990 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:00:47.869990 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:00:47.869990 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:00:47.869990 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efab3398-8820-4a11-8dd2-0f7f51a73763 could not be found. Oct 04 19:00:47.869990 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:00:47.871632 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-267b88d6-9f74-4f6e-ac86-63d78b4e444b tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Returning 404 to user: Instance efab3398-8820-4a11-8dd2-0f7f51a73763 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:00:47.893232 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-267b88d6-9f74-4f6e-ac86-63d78b4e444b tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/efab3398-8820-4a11-8dd2-0f7f51a73763" status: 404 len: 111 microversion: 2.1 time: 0.106391 Oct 04 19:00:47.899762 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2954/5935] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:47 2022] GET /compute/v2.1/servers/efab3398-8820-4a11-8dd2-0f7f51a73763 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:00:47.915085 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-983ef095-06fc-4f4d-ab73-4d459447217c tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '.version_select at 0x7fe253d91d30>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:48.043474 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-983ef095-06fc-4f4d-ab73-4d459447217c tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-512410222" status: 202 len: 0 microversion: 2.1 time: 0.142147 Oct 04 19:00:48.046935 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2955/5936] 10.222.0.20 () {58 vars in 1218 bytes} [Tue Oct 4 19:00:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-512410222 => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:00:48.291218 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7750ff0d-1d72-4996-8545-30b34f08df7d tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:48.307909 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7750ff0d-1d72-4996-8545-30b34f08df7d tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:48.312611 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7750ff0d-1d72-4996-8545-30b34f08df7d tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:48.321797 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7750ff0d-1d72-4996-8545-30b34f08df7d tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18" status: 200 len: 1751 microversion: 2.20 time: 0.501830 Oct 04 19:00:48.341779 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2982/5937] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:00:47 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 => generated 1751 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:00:48.774348 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-34de6809-e877-4d9e-9b3e-43fe6d224f91 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:48.775287 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-34de6809-e877-4d9e-9b3e-43fe6d224f91 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 12c4f942-479c-47b3-b824-def0b12f527b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:48.794378 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-34de6809-e877-4d9e-9b3e-43fe6d224f91 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:48.797594 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-34de6809-e877-4d9e-9b3e-43fe6d224f91 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:48.798262 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-34de6809-e877-4d9e-9b3e-43fe6d224f91 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:48.805864 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-34de6809-e877-4d9e-9b3e-43fe6d224f91 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:48.822495 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-34de6809-e877-4d9e-9b3e-43fe6d224f91 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:48.828253 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-34de6809-e877-4d9e-9b3e-43fe6d224f91 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:49.190075 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-34de6809-e877-4d9e-9b3e-43fe6d224f91 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:49.202759 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-34de6809-e877-4d9e-9b3e-43fe6d224f91 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/12c4f942-479c-47b3-b824-def0b12f527b" status: 200 len: 1214 microversion: 2.1 time: 0.433661 Oct 04 19:00:49.206919 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2956/5938] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:48 2022] GET /compute/v2.1/servers/12c4f942-479c-47b3-b824-def0b12f527b => generated 1214 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:49.353029 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-33128cdb-1540-4684-bc12-4f839ec3621b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:49.353621 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-33128cdb-1540-4684-bc12-4f839ec3621b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:49.357490 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:00:49.366008 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-33128cdb-1540-4684-bc12-4f839ec3621b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:49.369647 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-33128cdb-1540-4684-bc12-4f839ec3621b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:49.369647 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-33128cdb-1540-4684-bc12-4f839ec3621b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:49.369647 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-33128cdb-1540-4684-bc12-4f839ec3621b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:49.369647 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-33128cdb-1540-4684-bc12-4f839ec3621b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:49.369647 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-33128cdb-1540-4684-bc12-4f839ec3621b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:49.621346 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-33128cdb-1540-4684-bc12-4f839ec3621b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:49.641796 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-33128cdb-1540-4684-bc12-4f839ec3621b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:49.643542 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-33128cdb-1540-4684-bc12-4f839ec3621b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:49.644941 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-33128cdb-1540-4684-bc12-4f839ec3621b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18" status: 200 len: 1751 microversion: 2.20 time: 0.295874 Oct 04 19:00:49.660578 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2983/5939] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:00:49 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 => generated 1751 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:00:50.227888 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c07fe62b-8bd6-4506-b4b2-ceeb90b5cd26 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:50.228600 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c07fe62b-8bd6-4506-b4b2-ceeb90b5cd26 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 12c4f942-479c-47b3-b824-def0b12f527b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:50.236622 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c07fe62b-8bd6-4506-b4b2-ceeb90b5cd26 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:50.237194 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c07fe62b-8bd6-4506-b4b2-ceeb90b5cd26 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:50.237861 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c07fe62b-8bd6-4506-b4b2-ceeb90b5cd26 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:50.238666 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c07fe62b-8bd6-4506-b4b2-ceeb90b5cd26 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:50.239503 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c07fe62b-8bd6-4506-b4b2-ceeb90b5cd26 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:50.239999 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c07fe62b-8bd6-4506-b4b2-ceeb90b5cd26 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:50.620001 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c07fe62b-8bd6-4506-b4b2-ceeb90b5cd26 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:50.634887 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c07fe62b-8bd6-4506-b4b2-ceeb90b5cd26 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/12c4f942-479c-47b3-b824-def0b12f527b" status: 200 len: 1214 microversion: 2.1 time: 0.411608 Oct 04 19:00:50.637090 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2957/5940] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:50 2022] GET /compute/v2.1/servers/12c4f942-479c-47b3-b824-def0b12f527b => generated 1214 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:50.672026 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e369567f-5347-43eb-81d9-6b23ae8e1bc7 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:50.673547 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e369567f-5347-43eb-81d9-6b23ae8e1bc7 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:50.675578 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=8 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:00:50.681987 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e369567f-5347-43eb-81d9-6b23ae8e1bc7 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:50.682538 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e369567f-5347-43eb-81d9-6b23ae8e1bc7 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:50.683135 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e369567f-5347-43eb-81d9-6b23ae8e1bc7 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:50.687684 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e369567f-5347-43eb-81d9-6b23ae8e1bc7 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:50.687684 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e369567f-5347-43eb-81d9-6b23ae8e1bc7 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:50.687684 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e369567f-5347-43eb-81d9-6b23ae8e1bc7 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:50.945794 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e369567f-5347-43eb-81d9-6b23ae8e1bc7 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:50.958171 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e369567f-5347-43eb-81d9-6b23ae8e1bc7 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:50.965010 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e369567f-5347-43eb-81d9-6b23ae8e1bc7 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:50.965010 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e369567f-5347-43eb-81d9-6b23ae8e1bc7 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18" status: 200 len: 1751 microversion: 2.20 time: 0.294073 Oct 04 19:00:50.965010 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2984/5941] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:00:50 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 => generated 1751 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:00:51.661103 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-81056ae0-b8be-47bb-b1a2-233c3281c629 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:51.661906 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-81056ae0-b8be-47bb-b1a2-233c3281c629 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 12c4f942-479c-47b3-b824-def0b12f527b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:51.664513 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:00:51.671073 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-81056ae0-b8be-47bb-b1a2-233c3281c629 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:51.671739 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-81056ae0-b8be-47bb-b1a2-233c3281c629 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:51.672307 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-81056ae0-b8be-47bb-b1a2-233c3281c629 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:51.673405 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-81056ae0-b8be-47bb-b1a2-233c3281c629 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:51.674133 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-81056ae0-b8be-47bb-b1a2-233c3281c629 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:51.674678 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-81056ae0-b8be-47bb-b1a2-233c3281c629 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:51.993833 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6863e57c-a7ca-4593-adc2-289783f71cdd tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:51.995186 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6863e57c-a7ca-4593-adc2-289783f71cdd tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:51.997168 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-81056ae0-b8be-47bb-b1a2-233c3281c629 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:52.003984 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6863e57c-a7ca-4593-adc2-289783f71cdd tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:52.004940 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6863e57c-a7ca-4593-adc2-289783f71cdd tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:52.005719 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6863e57c-a7ca-4593-adc2-289783f71cdd tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:52.006642 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6863e57c-a7ca-4593-adc2-289783f71cdd tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:52.007456 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6863e57c-a7ca-4593-adc2-289783f71cdd tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:52.008122 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6863e57c-a7ca-4593-adc2-289783f71cdd tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:52.018817 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-81056ae0-b8be-47bb-b1a2-233c3281c629 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/12c4f942-479c-47b3-b824-def0b12f527b" status: 200 len: 1214 microversion: 2.1 time: 0.353812 Oct 04 19:00:52.018817 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2958/5942] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:51 2022] GET /compute/v2.1/servers/12c4f942-479c-47b3-b824-def0b12f527b => generated 1214 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:52.367462 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6863e57c-a7ca-4593-adc2-289783f71cdd tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:52.378572 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6863e57c-a7ca-4593-adc2-289783f71cdd tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:52.396313 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6863e57c-a7ca-4593-adc2-289783f71cdd tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:52.396313 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6863e57c-a7ca-4593-adc2-289783f71cdd tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18" status: 200 len: 1751 microversion: 2.20 time: 0.393028 Oct 04 19:00:52.396313 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2985/5943] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:00:51 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 => generated 1751 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 19:00:53.039254 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0a812aee-1da3-4c02-ba70-d273afc5ca14 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:53.040672 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0a812aee-1da3-4c02-ba70-d273afc5ca14 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 12c4f942-479c-47b3-b824-def0b12f527b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:53.048860 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0a812aee-1da3-4c02-ba70-d273afc5ca14 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:53.049656 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0a812aee-1da3-4c02-ba70-d273afc5ca14 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:53.050302 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0a812aee-1da3-4c02-ba70-d273afc5ca14 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:53.051245 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0a812aee-1da3-4c02-ba70-d273afc5ca14 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:53.051900 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0a812aee-1da3-4c02-ba70-d273afc5ca14 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:53.052904 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0a812aee-1da3-4c02-ba70-d273afc5ca14 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:53.376998 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0a812aee-1da3-4c02-ba70-d273afc5ca14 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:53.391825 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0a812aee-1da3-4c02-ba70-d273afc5ca14 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/12c4f942-479c-47b3-b824-def0b12f527b" status: 200 len: 1214 microversion: 2.1 time: 0.359710 Oct 04 19:00:53.403362 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2959/5944] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:53 2022] GET /compute/v2.1/servers/12c4f942-479c-47b3-b824-def0b12f527b => generated 1214 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:53.412015 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-76addfb3-58f5-42de-b7d1-d26e838f5d4b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:53.412800 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-76addfb3-58f5-42de-b7d1-d26e838f5d4b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:53.426724 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-76addfb3-58f5-42de-b7d1-d26e838f5d4b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:53.427624 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-76addfb3-58f5-42de-b7d1-d26e838f5d4b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:53.428471 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-76addfb3-58f5-42de-b7d1-d26e838f5d4b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:53.431116 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-76addfb3-58f5-42de-b7d1-d26e838f5d4b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:53.432431 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-76addfb3-58f5-42de-b7d1-d26e838f5d4b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:53.433078 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-76addfb3-58f5-42de-b7d1-d26e838f5d4b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:53.665961 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-76addfb3-58f5-42de-b7d1-d26e838f5d4b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:53.685175 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-76addfb3-58f5-42de-b7d1-d26e838f5d4b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:53.690107 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-76addfb3-58f5-42de-b7d1-d26e838f5d4b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:53.691678 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-76addfb3-58f5-42de-b7d1-d26e838f5d4b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18" status: 200 len: 1751 microversion: 2.20 time: 0.286830 Oct 04 19:00:53.692905 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2986/5945] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:00:53 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 => generated 1751 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:00:54.416855 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-fac1ca9c-ca07-48d0-afa0-ebe5f2606b47 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:54.417548 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-fac1ca9c-ca07-48d0-afa0-ebe5f2606b47 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 12c4f942-479c-47b3-b824-def0b12f527b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:54.427246 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fac1ca9c-ca07-48d0-afa0-ebe5f2606b47 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:54.427995 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fac1ca9c-ca07-48d0-afa0-ebe5f2606b47 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:54.428622 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fac1ca9c-ca07-48d0-afa0-ebe5f2606b47 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:54.429734 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fac1ca9c-ca07-48d0-afa0-ebe5f2606b47 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:54.430478 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fac1ca9c-ca07-48d0-afa0-ebe5f2606b47 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:54.431142 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fac1ca9c-ca07-48d0-afa0-ebe5f2606b47 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:54.656357 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-fac1ca9c-ca07-48d0-afa0-ebe5f2606b47 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:54.685484 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-fac1ca9c-ca07-48d0-afa0-ebe5f2606b47 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/12c4f942-479c-47b3-b824-def0b12f527b" status: 200 len: 1214 microversion: 2.1 time: 0.272388 Oct 04 19:00:54.696833 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2960/5946] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:54 2022] GET /compute/v2.1/servers/12c4f942-479c-47b3-b824-def0b12f527b => generated 1214 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:54.746226 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-242aef4e-ed4a-4438-a032-cccb78daa4ca tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:54.746907 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-242aef4e-ed4a-4438-a032-cccb78daa4ca tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:54.759904 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-242aef4e-ed4a-4438-a032-cccb78daa4ca tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:54.760504 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-242aef4e-ed4a-4438-a032-cccb78daa4ca tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:54.761081 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-242aef4e-ed4a-4438-a032-cccb78daa4ca tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:54.762070 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-242aef4e-ed4a-4438-a032-cccb78daa4ca tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:54.762613 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-242aef4e-ed4a-4438-a032-cccb78daa4ca tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:54.763625 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-242aef4e-ed4a-4438-a032-cccb78daa4ca tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:55.243022 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-242aef4e-ed4a-4438-a032-cccb78daa4ca tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:55.261481 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-242aef4e-ed4a-4438-a032-cccb78daa4ca tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:55.262938 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-242aef4e-ed4a-4438-a032-cccb78daa4ca tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:55.264286 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-242aef4e-ed4a-4438-a032-cccb78daa4ca tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18" status: 200 len: 1751 microversion: 2.20 time: 0.544782 Oct 04 19:00:55.265641 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2987/5947] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:00:54 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 => generated 1751 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:00:55.731292 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0f6a600b-75ce-4d8b-a680-03c8daef2dca tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:55.735844 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0f6a600b-75ce-4d8b-a680-03c8daef2dca tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 12c4f942-479c-47b3-b824-def0b12f527b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:55.743150 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0f6a600b-75ce-4d8b-a680-03c8daef2dca tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:55.743776 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0f6a600b-75ce-4d8b-a680-03c8daef2dca tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:55.744342 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0f6a600b-75ce-4d8b-a680-03c8daef2dca tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:55.745278 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0f6a600b-75ce-4d8b-a680-03c8daef2dca tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:55.745798 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0f6a600b-75ce-4d8b-a680-03c8daef2dca tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:55.746283 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0f6a600b-75ce-4d8b-a680-03c8daef2dca tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:55.949198 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0f6a600b-75ce-4d8b-a680-03c8daef2dca tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:55.961424 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0f6a600b-75ce-4d8b-a680-03c8daef2dca tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/12c4f942-479c-47b3-b824-def0b12f527b" status: 200 len: 1214 microversion: 2.1 time: 0.233722 Oct 04 19:00:55.975919 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2961/5948] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:55 2022] GET /compute/v2.1/servers/12c4f942-479c-47b3-b824-def0b12f527b => generated 1214 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:56.296117 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-07ae6be3-1d72-4ef1-9b51-075725a6dad2 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:56.296742 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-07ae6be3-1d72-4ef1-9b51-075725a6dad2 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:56.309410 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-07ae6be3-1d72-4ef1-9b51-075725a6dad2 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:56.318158 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-07ae6be3-1d72-4ef1-9b51-075725a6dad2 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:56.319225 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-07ae6be3-1d72-4ef1-9b51-075725a6dad2 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:56.322281 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-07ae6be3-1d72-4ef1-9b51-075725a6dad2 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:56.322888 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-07ae6be3-1d72-4ef1-9b51-075725a6dad2 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:56.323201 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-07ae6be3-1d72-4ef1-9b51-075725a6dad2 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:56.389032 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=100 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:00:56.663894 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4baa95b5-d9ab-4500-8298-06dd83502051 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:56.664574 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4baa95b5-d9ab-4500-8298-06dd83502051 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] [instance: 3edcc394-83d7-4358-8f99-af546b861685] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:56.674260 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4baa95b5-d9ab-4500-8298-06dd83502051 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:56.674758 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4baa95b5-d9ab-4500-8298-06dd83502051 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:56.675198 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4baa95b5-d9ab-4500-8298-06dd83502051 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:56.675914 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4baa95b5-d9ab-4500-8298-06dd83502051 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:56.681488 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4baa95b5-d9ab-4500-8298-06dd83502051 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:56.682109 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4baa95b5-d9ab-4500-8298-06dd83502051 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:56.757891 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4baa95b5-d9ab-4500-8298-06dd83502051 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] [instance: 3edcc394-83d7-4358-8f99-af546b861685] Going to try to terminate instance {{(pid=123002) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:00:56.894671 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-07ae6be3-1d72-4ef1-9b51-075725a6dad2 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:56.906516 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-07ae6be3-1d72-4ef1-9b51-075725a6dad2 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:56.908541 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-07ae6be3-1d72-4ef1-9b51-075725a6dad2 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:56.910449 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-07ae6be3-1d72-4ef1-9b51-075725a6dad2 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18" status: 200 len: 1751 microversion: 2.20 time: 0.619105 Oct 04 19:00:56.918413 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2988/5949] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:00:56 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 => generated 1751 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:00:56.924144 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0849e4eb-f33e-4465-9226-f74d54173d0d tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:56.924839 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0849e4eb-f33e-4465-9226-f74d54173d0d tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: ba710906-86d6-4c04-a708-1f3b9a466e3c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:56.932691 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0849e4eb-f33e-4465-9226-f74d54173d0d tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:56.933434 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0849e4eb-f33e-4465-9226-f74d54173d0d tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:56.934107 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0849e4eb-f33e-4465-9226-f74d54173d0d tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:56.935007 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0849e4eb-f33e-4465-9226-f74d54173d0d tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:56.935470 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0849e4eb-f33e-4465-9226-f74d54173d0d tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:56.935896 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0849e4eb-f33e-4465-9226-f74d54173d0d tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:57.168862 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-0849e4eb-f33e-4465-9226-f74d54173d0d tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lazy-loading 'services' on Instance uuid ba710906-86d6-4c04-a708-1f3b9a466e3c {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:00:57.210823 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4baa95b5-d9ab-4500-8298-06dd83502051 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3edcc394-83d7-4358-8f99-af546b861685" status: 204 len: 0 microversion: 2.1 time: 0.550217 Oct 04 19:00:57.211663 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2962/5950] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 19:00:56 2022] DELETE /compute/v2.1/servers/3edcc394-83d7-4358-8f99-af546b861685 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 19:00:57.224109 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-81ff02ac-da48-4a19-8aa2-dc58a2f3e6bc tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:57.224109 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-81ff02ac-da48-4a19-8aa2-dc58a2f3e6bc tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 12c4f942-479c-47b3-b824-def0b12f527b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:57.249682 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-81ff02ac-da48-4a19-8aa2-dc58a2f3e6bc tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:57.252707 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-81ff02ac-da48-4a19-8aa2-dc58a2f3e6bc tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:57.253666 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-81ff02ac-da48-4a19-8aa2-dc58a2f3e6bc tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:57.256036 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-81ff02ac-da48-4a19-8aa2-dc58a2f3e6bc tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:57.257883 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-81ff02ac-da48-4a19-8aa2-dc58a2f3e6bc tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:57.260421 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-81ff02ac-da48-4a19-8aa2-dc58a2f3e6bc tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:57.536959 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0849e4eb-f33e-4465-9226-f74d54173d0d tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ba710906-86d6-4c04-a708-1f3b9a466e3c/os-volume_attachments/a8e039fe-2de9-4a43-8029-a353c57b3fdd" status: 202 len: 0 microversion: 2.1 time: 0.617085 Oct 04 19:00:57.538008 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2989/5951] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Oct 4 19:00:56 2022] DELETE /compute/v2.1/servers/ba710906-86d6-4c04-a708-1f3b9a466e3c/os-volume_attachments/a8e039fe-2de9-4a43-8029-a353c57b3fdd => generated 0 bytes in 619 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:00:57.549758 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c51d8ffc-3bc0-4235-8907-32d1a36be9c7 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:57.550845 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c51d8ffc-3bc0-4235-8907-32d1a36be9c7 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] [instance: 3edcc394-83d7-4358-8f99-af546b861685] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:57.570677 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c51d8ffc-3bc0-4235-8907-32d1a36be9c7 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:57.575901 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c51d8ffc-3bc0-4235-8907-32d1a36be9c7 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:57.576501 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c51d8ffc-3bc0-4235-8907-32d1a36be9c7 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:57.577375 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c51d8ffc-3bc0-4235-8907-32d1a36be9c7 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:57.580578 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c51d8ffc-3bc0-4235-8907-32d1a36be9c7 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:57.581147 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c51d8ffc-3bc0-4235-8907-32d1a36be9c7 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:57.752960 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-81ff02ac-da48-4a19-8aa2-dc58a2f3e6bc tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:57.766900 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-81ff02ac-da48-4a19-8aa2-dc58a2f3e6bc tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/12c4f942-479c-47b3-b824-def0b12f527b" status: 200 len: 1214 microversion: 2.1 time: 0.553647 Oct 04 19:00:57.769323 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2963/5952] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:57 2022] GET /compute/v2.1/servers/12c4f942-479c-47b3-b824-def0b12f527b => generated 1214 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:57.776732 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c78eb9f1-81da-4cfa-b9f6-e13f6a53bdd2 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:57.788582 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c78eb9f1-81da-4cfa-b9f6-e13f6a53bdd2 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: ba710906-86d6-4c04-a708-1f3b9a466e3c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:57.805752 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c78eb9f1-81da-4cfa-b9f6-e13f6a53bdd2 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:57.806367 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c78eb9f1-81da-4cfa-b9f6-e13f6a53bdd2 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:57.806703 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c78eb9f1-81da-4cfa-b9f6-e13f6a53bdd2 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:57.807470 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c78eb9f1-81da-4cfa-b9f6-e13f6a53bdd2 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:57.808543 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c78eb9f1-81da-4cfa-b9f6-e13f6a53bdd2 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:57.808543 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c78eb9f1-81da-4cfa-b9f6-e13f6a53bdd2 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:57.857725 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c78eb9f1-81da-4cfa-b9f6-e13f6a53bdd2 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/ba710906-86d6-4c04-a708-1f3b9a466e3c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084739 Oct 04 19:00:57.864227 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2964/5953] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 19:00:57 2022] GET /compute/v2.1/servers/ba710906-86d6-4c04-a708-1f3b9a466e3c/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:00:57.887264 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c51d8ffc-3bc0-4235-8907-32d1a36be9c7 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7fac7323441708be3f27945a92fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6844b3a51e4c2da1294e89517989c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:57.903167 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c51d8ffc-3bc0-4235-8907-32d1a36be9c7 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] 10.222.0.20 "GET /compute/v2.1/servers/3edcc394-83d7-4358-8f99-af546b861685" status: 200 len: 1513 microversion: 2.1 time: 0.363467 Oct 04 19:00:57.905052 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2990/5954] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:57 2022] GET /compute/v2.1/servers/3edcc394-83d7-4358-8f99-af546b861685 => generated 1513 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:57.941184 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8e91df87-0aac-4b28-bca5-626d824b8fea tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:57.942102 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8e91df87-0aac-4b28-bca5-626d824b8fea tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:57.953247 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8e91df87-0aac-4b28-bca5-626d824b8fea tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:57.954825 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8e91df87-0aac-4b28-bca5-626d824b8fea tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:57.955431 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8e91df87-0aac-4b28-bca5-626d824b8fea tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:57.956982 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8e91df87-0aac-4b28-bca5-626d824b8fea tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:57.957619 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8e91df87-0aac-4b28-bca5-626d824b8fea tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:57.958293 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8e91df87-0aac-4b28-bca5-626d824b8fea tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:57.965285 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:00:58.200267 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8e91df87-0aac-4b28-bca5-626d824b8fea tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:58.209687 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8e91df87-0aac-4b28-bca5-626d824b8fea tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:58.211498 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8e91df87-0aac-4b28-bca5-626d824b8fea tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:58.212751 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8e91df87-0aac-4b28-bca5-626d824b8fea tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18" status: 200 len: 1751 microversion: 2.20 time: 0.278998 Oct 04 19:00:58.221064 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2965/5955] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:00:57 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 => generated 1751 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:00:58.795183 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-87fa61cd-2d8a-4fbf-a0b7-83617036b9d7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:58.795835 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-87fa61cd-2d8a-4fbf-a0b7-83617036b9d7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 12c4f942-479c-47b3-b824-def0b12f527b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:58.803298 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-87fa61cd-2d8a-4fbf-a0b7-83617036b9d7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:58.803533 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-87fa61cd-2d8a-4fbf-a0b7-83617036b9d7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:58.804999 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-87fa61cd-2d8a-4fbf-a0b7-83617036b9d7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:58.804999 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-87fa61cd-2d8a-4fbf-a0b7-83617036b9d7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:58.805282 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-87fa61cd-2d8a-4fbf-a0b7-83617036b9d7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:58.805752 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-87fa61cd-2d8a-4fbf-a0b7-83617036b9d7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:58.877350 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c8db4c99-0908-4c2b-bc94-93d40c04ef7c tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:58.880218 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c8db4c99-0908-4c2b-bc94-93d40c04ef7c tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: ba710906-86d6-4c04-a708-1f3b9a466e3c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:58.887721 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c8db4c99-0908-4c2b-bc94-93d40c04ef7c tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:58.888257 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c8db4c99-0908-4c2b-bc94-93d40c04ef7c tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:58.888694 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c8db4c99-0908-4c2b-bc94-93d40c04ef7c tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:58.889394 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c8db4c99-0908-4c2b-bc94-93d40c04ef7c tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:58.889834 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c8db4c99-0908-4c2b-bc94-93d40c04ef7c tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:58.890260 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c8db4c99-0908-4c2b-bc94-93d40c04ef7c tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:58.927779 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c8db4c99-0908-4c2b-bc94-93d40c04ef7c tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/ba710906-86d6-4c04-a708-1f3b9a466e3c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058512 Oct 04 19:00:58.932391 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2966/5956] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 19:00:58 2022] GET /compute/v2.1/servers/ba710906-86d6-4c04-a708-1f3b9a466e3c/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:00:58.933651 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1757fefd-9a26-44a0-9629-debc6013b650 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:58.934432 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1757fefd-9a26-44a0-9629-debc6013b650 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] [instance: 3edcc394-83d7-4358-8f99-af546b861685] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:58.942446 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1757fefd-9a26-44a0-9629-debc6013b650 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:58.942940 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1757fefd-9a26-44a0-9629-debc6013b650 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:58.943377 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1757fefd-9a26-44a0-9629-debc6013b650 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:58.944631 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1757fefd-9a26-44a0-9629-debc6013b650 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:58.944866 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1757fefd-9a26-44a0-9629-debc6013b650 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:58.945297 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1757fefd-9a26-44a0-9629-debc6013b650 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:59.079675 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-87fa61cd-2d8a-4fbf-a0b7-83617036b9d7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:59.088621 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-87fa61cd-2d8a-4fbf-a0b7-83617036b9d7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/12c4f942-479c-47b3-b824-def0b12f527b" status: 200 len: 1202 microversion: 2.1 time: 0.299794 Oct 04 19:00:59.089508 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2991/5957] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:58 2022] GET /compute/v2.1/servers/12c4f942-479c-47b3-b824-def0b12f527b => generated 1202 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:59.197108 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1757fefd-9a26-44a0-9629-debc6013b650 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7fac7323441708be3f27945a92fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6844b3a51e4c2da1294e89517989c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:59.240547 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1457b892-4153-4cc7-b677-1e8bf2d47ed4 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:59.241172 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1457b892-4153-4cc7-b677-1e8bf2d47ed4 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:59.247117 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1457b892-4153-4cc7-b677-1e8bf2d47ed4 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:59.247610 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1457b892-4153-4cc7-b677-1e8bf2d47ed4 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:59.248389 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1457b892-4153-4cc7-b677-1e8bf2d47ed4 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:59.249077 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1457b892-4153-4cc7-b677-1e8bf2d47ed4 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:59.249639 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1457b892-4153-4cc7-b677-1e8bf2d47ed4 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:59.249947 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1457b892-4153-4cc7-b677-1e8bf2d47ed4 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:59.286730 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1757fefd-9a26-44a0-9629-debc6013b650 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] 10.222.0.20 "GET /compute/v2.1/servers/3edcc394-83d7-4358-8f99-af546b861685" status: 200 len: 1513 microversion: 2.1 time: 0.356965 Oct 04 19:00:59.287717 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2967/5958] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:00:58 2022] GET /compute/v2.1/servers/3edcc394-83d7-4358-8f99-af546b861685 => generated 1513 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:59.527583 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1457b892-4153-4cc7-b677-1e8bf2d47ed4 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:59.543818 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1457b892-4153-4cc7-b677-1e8bf2d47ed4 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:59.550018 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1457b892-4153-4cc7-b677-1e8bf2d47ed4 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:00:59.550018 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1457b892-4153-4cc7-b677-1e8bf2d47ed4 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18" status: 200 len: 1751 microversion: 2.20 time: 0.309794 Oct 04 19:00:59.550018 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2992/5959] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:00:59 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 => generated 1751 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 19:00:59.951541 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0272e729-d673-4660-952a-fa3521c5f53c tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:00:59.959189 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0272e729-d673-4660-952a-fa3521c5f53c tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: ba710906-86d6-4c04-a708-1f3b9a466e3c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:59.980847 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0272e729-d673-4660-952a-fa3521c5f53c tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:59.981341 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0272e729-d673-4660-952a-fa3521c5f53c tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:59.981781 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0272e729-d673-4660-952a-fa3521c5f53c tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:59.982493 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0272e729-d673-4660-952a-fa3521c5f53c tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:59.982943 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0272e729-d673-4660-952a-fa3521c5f53c tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:59.983368 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0272e729-d673-4660-952a-fa3521c5f53c tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:00.068375 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0272e729-d673-4660-952a-fa3521c5f53c tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/ba710906-86d6-4c04-a708-1f3b9a466e3c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.129698 Oct 04 19:01:00.069859 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2968/5960] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 19:00:59 2022] GET /compute/v2.1/servers/ba710906-86d6-4c04-a708-1f3b9a466e3c/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:01:00.119582 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e77f050b-993b-4c28-bea7-2abd748390e5 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:00.121657 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e77f050b-993b-4c28-bea7-2abd748390e5 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 12c4f942-479c-47b3-b824-def0b12f527b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:00.157106 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e77f050b-993b-4c28-bea7-2abd748390e5 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:00.157626 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e77f050b-993b-4c28-bea7-2abd748390e5 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:00.158103 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e77f050b-993b-4c28-bea7-2abd748390e5 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:00.158821 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e77f050b-993b-4c28-bea7-2abd748390e5 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:00.159989 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e77f050b-993b-4c28-bea7-2abd748390e5 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:00.160470 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e77f050b-993b-4c28-bea7-2abd748390e5 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:00.311424 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4918b585-12d9-414e-89b0-719e18b42d0a tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:00.312322 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4918b585-12d9-414e-89b0-719e18b42d0a tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] [instance: 3edcc394-83d7-4358-8f99-af546b861685] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:00.322235 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4918b585-12d9-414e-89b0-719e18b42d0a tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:00.324496 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4918b585-12d9-414e-89b0-719e18b42d0a tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:00.328829 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4918b585-12d9-414e-89b0-719e18b42d0a tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:00.332116 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4918b585-12d9-414e-89b0-719e18b42d0a tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:00.332857 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4918b585-12d9-414e-89b0-719e18b42d0a tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:00.334600 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4918b585-12d9-414e-89b0-719e18b42d0a tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:00.532510 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4918b585-12d9-414e-89b0-719e18b42d0a tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7fac7323441708be3f27945a92fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6844b3a51e4c2da1294e89517989c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:00.545508 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4918b585-12d9-414e-89b0-719e18b42d0a tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] 10.222.0.20 "GET /compute/v2.1/servers/3edcc394-83d7-4358-8f99-af546b861685" status: 200 len: 1471 microversion: 2.1 time: 0.237334 Oct 04 19:01:00.550571 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2969/5961] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:00 2022] GET /compute/v2.1/servers/3edcc394-83d7-4358-8f99-af546b861685 => generated 1471 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:01:00.558540 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e77f050b-993b-4c28-bea7-2abd748390e5 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:00.575406 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b529a4c6-6933-4e27-83e8-c643cd063612 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:00.576022 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b529a4c6-6933-4e27-83e8-c643cd063612 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:00.586981 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b529a4c6-6933-4e27-83e8-c643cd063612 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:00.587485 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b529a4c6-6933-4e27-83e8-c643cd063612 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:00.588270 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b529a4c6-6933-4e27-83e8-c643cd063612 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:00.589786 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e77f050b-993b-4c28-bea7-2abd748390e5 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/12c4f942-479c-47b3-b824-def0b12f527b" status: 200 len: 1202 microversion: 2.1 time: 0.476094 Oct 04 19:01:00.604737 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2993/5962] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:00 2022] GET /compute/v2.1/servers/12c4f942-479c-47b3-b824-def0b12f527b => generated 1202 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:01:00.613430 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b529a4c6-6933-4e27-83e8-c643cd063612 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:00.614106 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b529a4c6-6933-4e27-83e8-c643cd063612 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:00.614805 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b529a4c6-6933-4e27-83e8-c643cd063612 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:00.711018 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-373863e3-15c8-4c9c-91a4-d380b2d48a27 req-9f3de25a-b8e7-4d77-9a36-2e9c4aee83ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3edcc394-83d7-4358-8f99-af546b861685", "name": "network-vif-deleted", "tag": "236e4f54-124f-4ab5-a66c-bfe8436a720b"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:01:00.717268 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:01:00.731943 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-373863e3-15c8-4c9c-91a4-d380b2d48a27 req-9f3de25a-b8e7-4d77-9a36-2e9c4aee83ef service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:00.733035 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-373863e3-15c8-4c9c-91a4-d380b2d48a27 req-9f3de25a-b8e7-4d77-9a36-2e9c4aee83ef service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:00.733682 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-373863e3-15c8-4c9c-91a4-d380b2d48a27 req-9f3de25a-b8e7-4d77-9a36-2e9c4aee83ef service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:00.749562 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-373863e3-15c8-4c9c-91a4-d380b2d48a27 req-9f3de25a-b8e7-4d77-9a36-2e9c4aee83ef service nova] Creating event network-vif-deleted:236e4f54-124f-4ab5-a66c-bfe8436a720b for instance 3edcc394-83d7-4358-8f99-af546b861685 on n-h2-850501-14 Oct 04 19:01:00.759849 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-373863e3-15c8-4c9c-91a4-d380b2d48a27 req-9f3de25a-b8e7-4d77-9a36-2e9c4aee83ef service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052885 Oct 04 19:01:00.760863 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2994/5963] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:01:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:01:01.035695 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b529a4c6-6933-4e27-83e8-c643cd063612 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:01.045901 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b529a4c6-6933-4e27-83e8-c643cd063612 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:01.047991 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b529a4c6-6933-4e27-83e8-c643cd063612 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:01.049213 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b529a4c6-6933-4e27-83e8-c643cd063612 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18" status: 200 len: 1807 microversion: 2.20 time: 0.478790 Oct 04 19:01:01.049781 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2970/5964] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:01:00 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 => generated 1807 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 19:01:01.082893 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c478ab09-2e1f-4f13-a65b-c2d8dccce2fc tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:01.085088 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c478ab09-2e1f-4f13-a65b-c2d8dccce2fc tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: ba710906-86d6-4c04-a708-1f3b9a466e3c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:01.097139 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c478ab09-2e1f-4f13-a65b-c2d8dccce2fc tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:01.098104 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c478ab09-2e1f-4f13-a65b-c2d8dccce2fc tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:01.117433 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c478ab09-2e1f-4f13-a65b-c2d8dccce2fc tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:01.118739 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c478ab09-2e1f-4f13-a65b-c2d8dccce2fc tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:01.119948 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c478ab09-2e1f-4f13-a65b-c2d8dccce2fc tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:01.121581 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c478ab09-2e1f-4f13-a65b-c2d8dccce2fc tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:01.199107 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c478ab09-2e1f-4f13-a65b-c2d8dccce2fc tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/ba710906-86d6-4c04-a708-1f3b9a466e3c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.120125 Oct 04 19:01:01.206880 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2995/5965] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 19:01:01 2022] GET /compute/v2.1/servers/ba710906-86d6-4c04-a708-1f3b9a466e3c/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:01:01.574954 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b7075006-11d9-4d34-9851-d962d8c38ef7 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:01.576231 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b7075006-11d9-4d34-9851-d962d8c38ef7 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] [instance: 3edcc394-83d7-4358-8f99-af546b861685] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:01.601169 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:01:01.603183 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b7075006-11d9-4d34-9851-d962d8c38ef7 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:01.603859 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b7075006-11d9-4d34-9851-d962d8c38ef7 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:01.622345 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b7075006-11d9-4d34-9851-d962d8c38ef7 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:01.622663 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c859edee-4dbf-4e2e-ba84-cfb0391f22e7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:01.623332 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b7075006-11d9-4d34-9851-d962d8c38ef7 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:01.623704 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c859edee-4dbf-4e2e-ba84-cfb0391f22e7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 12c4f942-479c-47b3-b824-def0b12f527b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:01.623832 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b7075006-11d9-4d34-9851-d962d8c38ef7 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:01.624268 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b7075006-11d9-4d34-9851-d962d8c38ef7 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:01.642400 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c859edee-4dbf-4e2e-ba84-cfb0391f22e7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:01.648143 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c859edee-4dbf-4e2e-ba84-cfb0391f22e7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:01.649559 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c859edee-4dbf-4e2e-ba84-cfb0391f22e7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:01.655571 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c859edee-4dbf-4e2e-ba84-cfb0391f22e7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:01.658405 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c859edee-4dbf-4e2e-ba84-cfb0391f22e7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:01.660439 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c859edee-4dbf-4e2e-ba84-cfb0391f22e7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:01.756803 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b7075006-11d9-4d34-9851-d962d8c38ef7 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:01.757293 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b7075006-11d9-4d34-9851-d962d8c38ef7 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:01.768846 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b7075006-11d9-4d34-9851-d962d8c38ef7 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:01.769592 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-b7075006-11d9-4d34-9851-d962d8c38ef7 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lazy-loading 'fault' on Instance uuid 3edcc394-83d7-4358-8f99-af546b861685 {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:01:01.982876 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b7075006-11d9-4d34-9851-d962d8c38ef7 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7fac7323441708be3f27945a92fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6844b3a51e4c2da1294e89517989c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:01.999269 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b7075006-11d9-4d34-9851-d962d8c38ef7 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] 10.222.0.20 "GET /compute/v2.1/servers/3edcc394-83d7-4358-8f99-af546b861685" status: 200 len: 1308 microversion: 2.1 time: 0.429325 Oct 04 19:01:02.031125 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2971/5966] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:01 2022] GET /compute/v2.1/servers/3edcc394-83d7-4358-8f99-af546b861685 => generated 1308 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:02.039960 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3447b089-1812-4370-a03a-5d8f5662f910 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:02.042397 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3447b089-1812-4370-a03a-5d8f5662f910 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] [instance: 505e8d54-138e-404a-a403-1bd5c9b0c4ab] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:02.055130 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3447b089-1812-4370-a03a-5d8f5662f910 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:02.056394 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3447b089-1812-4370-a03a-5d8f5662f910 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:02.057223 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3447b089-1812-4370-a03a-5d8f5662f910 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:02.063240 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3447b089-1812-4370-a03a-5d8f5662f910 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:02.063240 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3447b089-1812-4370-a03a-5d8f5662f910 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:02.063240 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3447b089-1812-4370-a03a-5d8f5662f910 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:02.138061 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3447b089-1812-4370-a03a-5d8f5662f910 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] 10.222.0.20 "GET /compute/v2.1/servers/505e8d54-138e-404a-a403-1bd5c9b0c4ab/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.095534 Oct 04 19:01:02.139105 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2972/5967] 10.222.0.20 () {58 vars in 1293 bytes} [Tue Oct 4 19:01:02 2022] GET /compute/v2.1/servers/505e8d54-138e-404a-a403-1bd5c9b0c4ab/os-server-password => generated 116 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:01:02.146250 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6e8c6d55-c769-4bc4-aac5-ac9623086782 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:02.155648 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-6e8c6d55-c769-4bc4-aac5-ac9623086782 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:02.165777 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6e8c6d55-c769-4bc4-aac5-ac9623086782 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:02.172579 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6e8c6d55-c769-4bc4-aac5-ac9623086782 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:02.172579 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6e8c6d55-c769-4bc4-aac5-ac9623086782 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:02.172579 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6e8c6d55-c769-4bc4-aac5-ac9623086782 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:02.172579 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6e8c6d55-c769-4bc4-aac5-ac9623086782 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:02.172579 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6e8c6d55-c769-4bc4-aac5-ac9623086782 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:02.199620 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c859edee-4dbf-4e2e-ba84-cfb0391f22e7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:02.220500 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c859edee-4dbf-4e2e-ba84-cfb0391f22e7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/12c4f942-479c-47b3-b824-def0b12f527b" status: 200 len: 1202 microversion: 2.1 time: 0.603083 Oct 04 19:01:02.221900 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2996/5968] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:01 2022] GET /compute/v2.1/servers/12c4f942-479c-47b3-b824-def0b12f527b => generated 1202 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:01:02.242865 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b7f7d739-bcfb-4c79-b688-23894237f7b5 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:02.246242 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b7f7d739-bcfb-4c79-b688-23894237f7b5 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: ba710906-86d6-4c04-a708-1f3b9a466e3c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:02.275838 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b7f7d739-bcfb-4c79-b688-23894237f7b5 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:02.276566 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b7f7d739-bcfb-4c79-b688-23894237f7b5 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:02.277630 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b7f7d739-bcfb-4c79-b688-23894237f7b5 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:02.281048 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b7f7d739-bcfb-4c79-b688-23894237f7b5 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:02.288094 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b7f7d739-bcfb-4c79-b688-23894237f7b5 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:02.288830 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b7f7d739-bcfb-4c79-b688-23894237f7b5 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:02.388350 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b7f7d739-bcfb-4c79-b688-23894237f7b5 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/ba710906-86d6-4c04-a708-1f3b9a466e3c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.164428 Oct 04 19:01:02.391462 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2997/5969] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 19:01:02 2022] GET /compute/v2.1/servers/ba710906-86d6-4c04-a708-1f3b9a466e3c/os-volume_attachments => generated 197 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:01:02.666578 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-6e8c6d55-c769-4bc4-aac5-ac9623086782 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:02.681820 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-6e8c6d55-c769-4bc4-aac5-ac9623086782 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:02.690509 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-6e8c6d55-c769-4bc4-aac5-ac9623086782 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:02.698878 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6e8c6d55-c769-4bc4-aac5-ac9623086782 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18" status: 200 len: 1807 microversion: 2.20 time: 0.557875 Oct 04 19:01:02.713023 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2973/5970] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:01:02 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 => generated 1807 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:01:03.025660 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c1c7a5ff-eddc-47aa-85ca-72db218354c4 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:03.026548 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c1c7a5ff-eddc-47aa-85ca-72db218354c4 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] [instance: 3edcc394-83d7-4358-8f99-af546b861685] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:03.036856 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c1c7a5ff-eddc-47aa-85ca-72db218354c4 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:03.041279 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c1c7a5ff-eddc-47aa-85ca-72db218354c4 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:03.041798 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c1c7a5ff-eddc-47aa-85ca-72db218354c4 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:03.042770 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c1c7a5ff-eddc-47aa-85ca-72db218354c4 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:03.043258 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c1c7a5ff-eddc-47aa-85ca-72db218354c4 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:03.043685 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c1c7a5ff-eddc-47aa-85ca-72db218354c4 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:03.071923 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-c1c7a5ff-eddc-47aa-85ca-72db218354c4 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] HTTP exception thrown: Instance 3edcc394-83d7-4358-8f99-af546b861685 could not be found. Oct 04 19:01:03.073922 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c1c7a5ff-eddc-47aa-85ca-72db218354c4 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Request method failure captured: Oct 04 19:01:03.073922 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/3edcc394-83d7-4358-8f99-af546b861685 HTTP/1.1 Oct 04 19:01:03.073922 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 19:01:03.073922 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 19:01:03.073922 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 19:01:03.073922 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 19:01:03.073922 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 19:01:03.073922 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 19:01:03.073922 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 19:01:03.073922 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 19:01:03.073922 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPIHhh9F9tBlMDot08nnALqp1MPE1mGoUXRLUWVjleGTcRnFNMTeSzTCx7lg63VuTDVF-ItPv1j2qluLL-gUxwZu8R9YRAXusKSHz_nubC0EiDGRmhVfZrXu-pulgAXptA4BBAfnw3EI06_nivrZ9hP0xR50t44SgL8yYE2ybOpEvxUM Oct 04 19:01:03.073922 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 19:01:03.073922 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 19:01:03.073922 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 19:01:03.073922 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 19:01:03.073922 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 19:01:03.073922 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 19:01:03.073922 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 7a6844b3a51e4c2da1294e89517989c4 Oct 04 19:01:03.073922 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-VolumesSnapshotTestJSON-520514649 Oct 04 19:01:03.073922 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 19:01:03.073922 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 19:01:03.073922 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7a6844b3a51e4c2da1294e89517989c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7a6844b3a51e4c2da1294e89517989c4", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7a6844b3a51e4c2da1294e89517989c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7a6844b3a51e4c2da1294e89517989c4"}]}] Oct 04 19:01:03.073922 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-VolumesSnapshotTestJSON-520514649 Oct 04 19:01:03.073922 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 7a6844b3a51e4c2da1294e89517989c4 Oct 04 19:01:03.073922 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-520514649 Oct 04 19:01:03.073922 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-VolumesSnapshotTestJSON-520514649-project Oct 04 19:01:03.073922 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 19:01:03.073922 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 19:01:03.073922 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 49a7fac7323441708be3f27945a92fb5 Oct 04 19:01:03.073922 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-VolumesSnapshotTestJSON-520514649-project Oct 04 19:01:03.073922 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 19:01:03.073922 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 3edcc394-83d7-4358-8f99-af546b861685 could not be found. Oct 04 19:01:03.073922 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '3edcc394-83d7-4358-8f99-af546b861685'} Oct 04 19:01:03.073922 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:01:03.073922 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:01:03.073922 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:01:03.073922 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:01:03.073922 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:01:03.073922 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:01:03.073922 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:01:03.073922 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:01:03.073922 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:01:03.073922 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:01:03.073922 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3edcc394-83d7-4358-8f99-af546b861685 could not be found. Oct 04 19:01:03.073922 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:01:03.073922 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:01:03.073922 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:01:03.073922 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:01:03.073922 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:01:03.073922 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:01:03.073922 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:01:03.073922 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:01:03.073922 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:01:03.073922 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:01:03.073922 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:01:03.073922 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:01:03.073922 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:01:03.073922 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:01:03.073922 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:01:03.073922 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:01:03.073922 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3edcc394-83d7-4358-8f99-af546b861685 could not be found. Oct 04 19:01:03.073922 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:01:03.073922 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:01:03.073922 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:01:03.079305 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:01:03.079305 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:01:03.079305 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:01:03.079305 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:01:03.079305 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:01:03.079305 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3edcc394-83d7-4358-8f99-af546b861685 could not be found. Oct 04 19:01:03.079305 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:01:03.082707 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c1c7a5ff-eddc-47aa-85ca-72db218354c4 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Returning 404 to user: Instance 3edcc394-83d7-4358-8f99-af546b861685 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:01:03.085899 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c1c7a5ff-eddc-47aa-85ca-72db218354c4 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] 10.222.0.20 "GET /compute/v2.1/servers/3edcc394-83d7-4358-8f99-af546b861685" status: 404 len: 111 microversion: 2.1 time: 0.062427 Oct 04 19:01:03.090192 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2998/5971] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:03 2022] GET /compute/v2.1/servers/3edcc394-83d7-4358-8f99-af546b861685 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:01:03.248582 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-52021e55-46a4-495a-a51d-e47915d0933e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:03.249321 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-52021e55-46a4-495a-a51d-e47915d0933e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 12c4f942-479c-47b3-b824-def0b12f527b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:03.259072 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-52021e55-46a4-495a-a51d-e47915d0933e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:03.261761 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-52021e55-46a4-495a-a51d-e47915d0933e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:03.264492 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-52021e55-46a4-495a-a51d-e47915d0933e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:03.265585 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-52021e55-46a4-495a-a51d-e47915d0933e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:03.267782 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-52021e55-46a4-495a-a51d-e47915d0933e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:03.269165 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-52021e55-46a4-495a-a51d-e47915d0933e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:03.394740 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-403d58c9-6b2f-4bc3-9aa0-8174c8d126cd req-0730cbea-3f5b-45cb-b492-98242c56cd1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b882133-2fca-4df4-b228-46a12f538c18", "tag": "1f37fede-c1b1-491b-bab1-5ad8cb57086e"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:01:03.410812 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-403d58c9-6b2f-4bc3-9aa0-8174c8d126cd req-0730cbea-3f5b-45cb-b492-98242c56cd1a service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:03.411641 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-403d58c9-6b2f-4bc3-9aa0-8174c8d126cd req-0730cbea-3f5b-45cb-b492-98242c56cd1a service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:03.412320 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-403d58c9-6b2f-4bc3-9aa0-8174c8d126cd req-0730cbea-3f5b-45cb-b492-98242c56cd1a service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:03.439531 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-403d58c9-6b2f-4bc3-9aa0-8174c8d126cd req-0730cbea-3f5b-45cb-b492-98242c56cd1a service nova] Creating event network-changed:1f37fede-c1b1-491b-bab1-5ad8cb57086e for instance 7b882133-2fca-4df4-b228-46a12f538c18 on n-h2-850501-14 Oct 04 19:01:03.447407 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-403d58c9-6b2f-4bc3-9aa0-8174c8d126cd req-0730cbea-3f5b-45cb-b492-98242c56cd1a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055846 Oct 04 19:01:03.449273 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 2999/5972] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:01:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:01:03.457033 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-93c8f596-3da6-4aa1-b2f8-ba4b84e29b75 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:03.461525 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-93c8f596-3da6-4aa1-b2f8-ba4b84e29b75 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: ba710906-86d6-4c04-a708-1f3b9a466e3c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:03.471000 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-93c8f596-3da6-4aa1-b2f8-ba4b84e29b75 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:03.471908 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-93c8f596-3da6-4aa1-b2f8-ba4b84e29b75 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:03.472643 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-93c8f596-3da6-4aa1-b2f8-ba4b84e29b75 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:03.473611 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-93c8f596-3da6-4aa1-b2f8-ba4b84e29b75 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:03.474228 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-93c8f596-3da6-4aa1-b2f8-ba4b84e29b75 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:03.475000 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-93c8f596-3da6-4aa1-b2f8-ba4b84e29b75 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:03.542195 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-93c8f596-3da6-4aa1-b2f8-ba4b84e29b75 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/ba710906-86d6-4c04-a708-1f3b9a466e3c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091313 Oct 04 19:01:03.543159 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3000/5973] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 19:01:03 2022] GET /compute/v2.1/servers/ba710906-86d6-4c04-a708-1f3b9a466e3c/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:01:03.660887 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-52021e55-46a4-495a-a51d-e47915d0933e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:03.669799 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-52021e55-46a4-495a-a51d-e47915d0933e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/12c4f942-479c-47b3-b824-def0b12f527b" status: 200 len: 1202 microversion: 2.1 time: 0.426108 Oct 04 19:01:03.680128 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2974/5974] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:03 2022] GET /compute/v2.1/servers/12c4f942-479c-47b3-b824-def0b12f527b => generated 1202 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:03.733011 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a8f9f6fb-80e1-4aad-81a1-f812acb622cf tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:03.733763 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a8f9f6fb-80e1-4aad-81a1-f812acb622cf tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:03.753594 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a8f9f6fb-80e1-4aad-81a1-f812acb622cf tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:03.754122 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a8f9f6fb-80e1-4aad-81a1-f812acb622cf tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:03.754573 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a8f9f6fb-80e1-4aad-81a1-f812acb622cf tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:03.756981 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a8f9f6fb-80e1-4aad-81a1-f812acb622cf tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:03.757810 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a8f9f6fb-80e1-4aad-81a1-f812acb622cf tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:03.758896 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a8f9f6fb-80e1-4aad-81a1-f812acb622cf tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:04.027728 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a8f9f6fb-80e1-4aad-81a1-f812acb622cf tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:04.038694 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a8f9f6fb-80e1-4aad-81a1-f812acb622cf tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:04.040719 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a8f9f6fb-80e1-4aad-81a1-f812acb622cf tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:04.042469 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a8f9f6fb-80e1-4aad-81a1-f812acb622cf tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18" status: 200 len: 1807 microversion: 2.20 time: 0.315155 Oct 04 19:01:04.043117 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3001/5975] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:01:03 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 => generated 1807 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:01:04.554831 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-390e1145-c147-4863-ab78-77c7e2ca864d tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:04.557218 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-390e1145-c147-4863-ab78-77c7e2ca864d tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: ba710906-86d6-4c04-a708-1f3b9a466e3c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:04.578945 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-390e1145-c147-4863-ab78-77c7e2ca864d tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:04.578945 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-390e1145-c147-4863-ab78-77c7e2ca864d tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:04.578945 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-390e1145-c147-4863-ab78-77c7e2ca864d tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:04.578945 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-390e1145-c147-4863-ab78-77c7e2ca864d tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:04.578945 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-390e1145-c147-4863-ab78-77c7e2ca864d tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:04.579785 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-390e1145-c147-4863-ab78-77c7e2ca864d tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:04.658322 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-390e1145-c147-4863-ab78-77c7e2ca864d tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/ba710906-86d6-4c04-a708-1f3b9a466e3c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107429 Oct 04 19:01:04.659417 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2975/5976] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 19:01:04 2022] GET /compute/v2.1/servers/ba710906-86d6-4c04-a708-1f3b9a466e3c/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:01:04.697777 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6936ece8-e32d-42a7-9f75-ee528d2681c7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:04.698986 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6936ece8-e32d-42a7-9f75-ee528d2681c7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 12c4f942-479c-47b3-b824-def0b12f527b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:04.717989 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6936ece8-e32d-42a7-9f75-ee528d2681c7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:04.718865 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6936ece8-e32d-42a7-9f75-ee528d2681c7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:04.719495 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6936ece8-e32d-42a7-9f75-ee528d2681c7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:04.720415 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6936ece8-e32d-42a7-9f75-ee528d2681c7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:04.721041 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6936ece8-e32d-42a7-9f75-ee528d2681c7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:04.721621 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6936ece8-e32d-42a7-9f75-ee528d2681c7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:05.027809 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6936ece8-e32d-42a7-9f75-ee528d2681c7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:05.054504 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6936ece8-e32d-42a7-9f75-ee528d2681c7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/12c4f942-479c-47b3-b824-def0b12f527b" status: 200 len: 1202 microversion: 2.1 time: 0.346902 Oct 04 19:01:05.054504 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3002/5977] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:04 2022] GET /compute/v2.1/servers/12c4f942-479c-47b3-b824-def0b12f527b => generated 1202 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:05.072103 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c3e678e0-8307-494b-bf0f-28a3f794ad06 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:05.072103 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c3e678e0-8307-494b-bf0f-28a3f794ad06 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:05.079399 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c3e678e0-8307-494b-bf0f-28a3f794ad06 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:05.079904 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c3e678e0-8307-494b-bf0f-28a3f794ad06 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:05.080380 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c3e678e0-8307-494b-bf0f-28a3f794ad06 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:05.088142 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c3e678e0-8307-494b-bf0f-28a3f794ad06 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:05.088703 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c3e678e0-8307-494b-bf0f-28a3f794ad06 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:05.092111 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c3e678e0-8307-494b-bf0f-28a3f794ad06 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:05.341389 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c3e678e0-8307-494b-bf0f-28a3f794ad06 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:05.352994 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c3e678e0-8307-494b-bf0f-28a3f794ad06 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:05.354920 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c3e678e0-8307-494b-bf0f-28a3f794ad06 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:05.357227 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c3e678e0-8307-494b-bf0f-28a3f794ad06 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18" status: 200 len: 1807 microversion: 2.20 time: 0.289828 Oct 04 19:01:05.358251 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2976/5978] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:01:05 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 => generated 1807 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 19:01:05.673032 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e5a09e39-0c93-4ee7-8432-38a8269cec32 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:05.675371 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e5a09e39-0c93-4ee7-8432-38a8269cec32 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: ba710906-86d6-4c04-a708-1f3b9a466e3c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:05.704896 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e5a09e39-0c93-4ee7-8432-38a8269cec32 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:05.705565 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e5a09e39-0c93-4ee7-8432-38a8269cec32 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:05.705904 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e5a09e39-0c93-4ee7-8432-38a8269cec32 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:05.706657 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e5a09e39-0c93-4ee7-8432-38a8269cec32 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:05.707121 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e5a09e39-0c93-4ee7-8432-38a8269cec32 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:05.707548 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e5a09e39-0c93-4ee7-8432-38a8269cec32 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:05.809454 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e5a09e39-0c93-4ee7-8432-38a8269cec32 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/ba710906-86d6-4c04-a708-1f3b9a466e3c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.141672 Oct 04 19:01:05.815489 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3003/5979] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 19:01:05 2022] GET /compute/v2.1/servers/ba710906-86d6-4c04-a708-1f3b9a466e3c/os-volume_attachments => generated 197 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:01:06.062031 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3e7851cb-f954-4c1c-b167-1901bffe618c tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:06.062735 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3e7851cb-f954-4c1c-b167-1901bffe618c tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 12c4f942-479c-47b3-b824-def0b12f527b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:06.075053 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3e7851cb-f954-4c1c-b167-1901bffe618c tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:06.080348 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3e7851cb-f954-4c1c-b167-1901bffe618c tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:06.080870 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3e7851cb-f954-4c1c-b167-1901bffe618c tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:06.085943 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3e7851cb-f954-4c1c-b167-1901bffe618c tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:06.086429 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3e7851cb-f954-4c1c-b167-1901bffe618c tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:06.086869 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3e7851cb-f954-4c1c-b167-1901bffe618c tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:06.386070 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-fc13f6d6-d1dd-4566-a8fe-0a88431652aa tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:06.386755 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-fc13f6d6-d1dd-4566-a8fe-0a88431652aa tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:06.398263 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fc13f6d6-d1dd-4566-a8fe-0a88431652aa tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:06.400868 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fc13f6d6-d1dd-4566-a8fe-0a88431652aa tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:06.401747 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fc13f6d6-d1dd-4566-a8fe-0a88431652aa tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:06.402792 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fc13f6d6-d1dd-4566-a8fe-0a88431652aa tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:06.404680 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fc13f6d6-d1dd-4566-a8fe-0a88431652aa tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:06.406834 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fc13f6d6-d1dd-4566-a8fe-0a88431652aa tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:06.594849 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3e7851cb-f954-4c1c-b167-1901bffe618c tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:06.595085 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3e7851cb-f954-4c1c-b167-1901bffe618c tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/12c4f942-479c-47b3-b824-def0b12f527b" status: 200 len: 1202 microversion: 2.1 time: 0.537106 Oct 04 19:01:06.604226 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2977/5980] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:06 2022] GET /compute/v2.1/servers/12c4f942-479c-47b3-b824-def0b12f527b => generated 1202 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:06.823653 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-fd427e4b-3279-4bbf-a9a2-e72b8805584d tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:06.826275 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-fd427e4b-3279-4bbf-a9a2-e72b8805584d tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: ba710906-86d6-4c04-a708-1f3b9a466e3c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:06.835455 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fd427e4b-3279-4bbf-a9a2-e72b8805584d tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:06.844415 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fd427e4b-3279-4bbf-a9a2-e72b8805584d tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:06.845133 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fd427e4b-3279-4bbf-a9a2-e72b8805584d tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:06.846069 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fd427e4b-3279-4bbf-a9a2-e72b8805584d tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:06.846703 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fd427e4b-3279-4bbf-a9a2-e72b8805584d tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:06.847317 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fd427e4b-3279-4bbf-a9a2-e72b8805584d tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:06.882340 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-fc13f6d6-d1dd-4566-a8fe-0a88431652aa tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:06.897636 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-fc13f6d6-d1dd-4566-a8fe-0a88431652aa tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:06.908115 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-fc13f6d6-d1dd-4566-a8fe-0a88431652aa tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:06.909887 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-fc13f6d6-d1dd-4566-a8fe-0a88431652aa tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18" status: 200 len: 1807 microversion: 2.20 time: 0.528955 Oct 04 19:01:06.910651 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3004/5981] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:01:06 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 => generated 1807 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:01:06.916016 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-fd427e4b-3279-4bbf-a9a2-e72b8805584d tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/ba710906-86d6-4c04-a708-1f3b9a466e3c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096579 Oct 04 19:01:06.916956 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2978/5982] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 19:01:06 2022] GET /compute/v2.1/servers/ba710906-86d6-4c04-a708-1f3b9a466e3c/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:01:07.623991 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-13b62d9f-b3ad-4259-a9db-c977fd089ecd tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:07.625552 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-13b62d9f-b3ad-4259-a9db-c977fd089ecd tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 12c4f942-479c-47b3-b824-def0b12f527b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:07.634990 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-13b62d9f-b3ad-4259-a9db-c977fd089ecd tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:07.637490 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-13b62d9f-b3ad-4259-a9db-c977fd089ecd tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:07.638269 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-13b62d9f-b3ad-4259-a9db-c977fd089ecd tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:07.639191 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-13b62d9f-b3ad-4259-a9db-c977fd089ecd tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:07.640643 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-13b62d9f-b3ad-4259-a9db-c977fd089ecd tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:07.641430 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-13b62d9f-b3ad-4259-a9db-c977fd089ecd tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:07.929375 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e99999b9-127f-4826-aa8c-71887614188b tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:07.931685 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e99999b9-127f-4826-aa8c-71887614188b tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: ba710906-86d6-4c04-a708-1f3b9a466e3c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:07.946434 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e99999b9-127f-4826-aa8c-71887614188b tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:07.947228 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e99999b9-127f-4826-aa8c-71887614188b tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:07.948579 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e99999b9-127f-4826-aa8c-71887614188b tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:07.951922 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e99999b9-127f-4826-aa8c-71887614188b tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:07.952626 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e99999b9-127f-4826-aa8c-71887614188b tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:07.956712 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e99999b9-127f-4826-aa8c-71887614188b tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:08.024983 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e99999b9-127f-4826-aa8c-71887614188b tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/ba710906-86d6-4c04-a708-1f3b9a466e3c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096407 Oct 04 19:01:08.032483 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2979/5983] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 19:01:07 2022] GET /compute/v2.1/servers/ba710906-86d6-4c04-a708-1f3b9a466e3c/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:01:08.042176 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4a0f3f2d-d7e5-4674-a676-6e88bdb7c842 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:08.042800 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4a0f3f2d-d7e5-4674-a676-6e88bdb7c842 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:08.058513 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4a0f3f2d-d7e5-4674-a676-6e88bdb7c842 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:08.058513 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4a0f3f2d-d7e5-4674-a676-6e88bdb7c842 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:08.058513 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4a0f3f2d-d7e5-4674-a676-6e88bdb7c842 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:08.061041 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4a0f3f2d-d7e5-4674-a676-6e88bdb7c842 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:08.061533 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4a0f3f2d-d7e5-4674-a676-6e88bdb7c842 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:08.061974 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4a0f3f2d-d7e5-4674-a676-6e88bdb7c842 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:08.299470 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-13b62d9f-b3ad-4259-a9db-c977fd089ecd tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:08.327938 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-13b62d9f-b3ad-4259-a9db-c977fd089ecd tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/12c4f942-479c-47b3-b824-def0b12f527b" status: 200 len: 1202 microversion: 2.1 time: 0.703269 Oct 04 19:01:08.327938 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3005/5984] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:07 2022] GET /compute/v2.1/servers/12c4f942-479c-47b3-b824-def0b12f527b => generated 1202 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:08.446714 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4a0f3f2d-d7e5-4674-a676-6e88bdb7c842 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:08.477505 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4a0f3f2d-d7e5-4674-a676-6e88bdb7c842 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:08.478989 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4a0f3f2d-d7e5-4674-a676-6e88bdb7c842 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:08.492451 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4a0f3f2d-d7e5-4674-a676-6e88bdb7c842 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18" status: 200 len: 1807 microversion: 2.20 time: 0.442838 Oct 04 19:01:08.495228 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2980/5985] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:01:08 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 => generated 1807 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:01:09.043819 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-09fcd1e8-be9c-40ce-b622-7adf7dd370d7 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:09.047824 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-09fcd1e8-be9c-40ce-b622-7adf7dd370d7 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: ba710906-86d6-4c04-a708-1f3b9a466e3c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:09.078383 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-09fcd1e8-be9c-40ce-b622-7adf7dd370d7 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:09.086152 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-09fcd1e8-be9c-40ce-b622-7adf7dd370d7 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:09.086152 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-09fcd1e8-be9c-40ce-b622-7adf7dd370d7 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:09.086152 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-09fcd1e8-be9c-40ce-b622-7adf7dd370d7 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:09.103512 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-09fcd1e8-be9c-40ce-b622-7adf7dd370d7 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:09.104745 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-09fcd1e8-be9c-40ce-b622-7adf7dd370d7 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:09.185149 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:01:09.221095 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-09fcd1e8-be9c-40ce-b622-7adf7dd370d7 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/ba710906-86d6-4c04-a708-1f3b9a466e3c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.184520 Oct 04 19:01:09.223359 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3006/5986] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 19:01:09 2022] GET /compute/v2.1/servers/ba710906-86d6-4c04-a708-1f3b9a466e3c/os-volume_attachments => generated 25 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 19:01:09.353832 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-607dd65c-1b7e-4e61-a85d-a6ce6fc9bda7 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:09.354352 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-42fce2f4-cdd4-4764-899d-c74344f10c22 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:09.354352 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-42fce2f4-cdd4-4764-899d-c74344f10c22 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 12c4f942-479c-47b3-b824-def0b12f527b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:09.354974 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-607dd65c-1b7e-4e61-a85d-a6ce6fc9bda7 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: ba710906-86d6-4c04-a708-1f3b9a466e3c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:09.366086 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-42fce2f4-cdd4-4764-899d-c74344f10c22 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:09.368715 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-42fce2f4-cdd4-4764-899d-c74344f10c22 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:09.369244 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-42fce2f4-cdd4-4764-899d-c74344f10c22 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:09.370091 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-42fce2f4-cdd4-4764-899d-c74344f10c22 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:09.370622 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-42fce2f4-cdd4-4764-899d-c74344f10c22 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:09.373558 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-42fce2f4-cdd4-4764-899d-c74344f10c22 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:09.374532 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-607dd65c-1b7e-4e61-a85d-a6ce6fc9bda7 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:09.377570 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-607dd65c-1b7e-4e61-a85d-a6ce6fc9bda7 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:09.380789 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-607dd65c-1b7e-4e61-a85d-a6ce6fc9bda7 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:09.381595 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-607dd65c-1b7e-4e61-a85d-a6ce6fc9bda7 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:09.386167 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-607dd65c-1b7e-4e61-a85d-a6ce6fc9bda7 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:09.386703 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-607dd65c-1b7e-4e61-a85d-a6ce6fc9bda7 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:09.497908 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-607dd65c-1b7e-4e61-a85d-a6ce6fc9bda7 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: ba710906-86d6-4c04-a708-1f3b9a466e3c] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:01:09.848785 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-607dd65c-1b7e-4e61-a85d-a6ce6fc9bda7 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ba710906-86d6-4c04-a708-1f3b9a466e3c" status: 204 len: 0 microversion: 2.1 time: 0.497150 Oct 04 19:01:09.850181 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3007/5987] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 19:01:09 2022] DELETE /compute/v2.1/servers/ba710906-86d6-4c04-a708-1f3b9a466e3c => generated 0 bytes in 501 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:01:09.861254 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b6b54c4e-c0ef-4ae8-bc4a-c2cc3aa6bc77 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:09.873848 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b6b54c4e-c0ef-4ae8-bc4a-c2cc3aa6bc77 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:09.883495 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-42fce2f4-cdd4-4764-899d-c74344f10c22 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:09.889086 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=100 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:01:09.893352 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b6b54c4e-c0ef-4ae8-bc4a-c2cc3aa6bc77 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:09.893352 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b6b54c4e-c0ef-4ae8-bc4a-c2cc3aa6bc77 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:09.893352 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b6b54c4e-c0ef-4ae8-bc4a-c2cc3aa6bc77 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:09.893352 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b6b54c4e-c0ef-4ae8-bc4a-c2cc3aa6bc77 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:09.893755 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b6b54c4e-c0ef-4ae8-bc4a-c2cc3aa6bc77 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:09.895873 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b6b54c4e-c0ef-4ae8-bc4a-c2cc3aa6bc77 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:09.900516 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-42fce2f4-cdd4-4764-899d-c74344f10c22 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/12c4f942-479c-47b3-b824-def0b12f527b" status: 200 len: 1202 microversion: 2.1 time: 0.552867 Oct 04 19:01:09.903089 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2981/5988] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:09 2022] GET /compute/v2.1/servers/12c4f942-479c-47b3-b824-def0b12f527b => generated 1202 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:09.918436 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5c2505d9-2917-4eb6-9564-5f2de2194a35 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:09.922270 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5c2505d9-2917-4eb6-9564-5f2de2194a35 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: ba710906-86d6-4c04-a708-1f3b9a466e3c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:09.930995 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5c2505d9-2917-4eb6-9564-5f2de2194a35 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:09.932357 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5c2505d9-2917-4eb6-9564-5f2de2194a35 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:09.933067 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5c2505d9-2917-4eb6-9564-5f2de2194a35 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:09.934144 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5c2505d9-2917-4eb6-9564-5f2de2194a35 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:09.934848 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5c2505d9-2917-4eb6-9564-5f2de2194a35 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:09.935560 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5c2505d9-2917-4eb6-9564-5f2de2194a35 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:10.493003 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5c2505d9-2917-4eb6-9564-5f2de2194a35 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce441ded6f554ec28560c75de97af173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc67d8de57543c48bdf45669b684227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:10.503584 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b6b54c4e-c0ef-4ae8-bc4a-c2cc3aa6bc77 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:10.521355 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5c2505d9-2917-4eb6-9564-5f2de2194a35 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/ba710906-86d6-4c04-a708-1f3b9a466e3c" status: 200 len: 1682 microversion: 2.1 time: 0.614011 Oct 04 19:01:10.533875 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2982/5989] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:09 2022] GET /compute/v2.1/servers/ba710906-86d6-4c04-a708-1f3b9a466e3c => generated 1682 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:10.539870 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b6b54c4e-c0ef-4ae8-bc4a-c2cc3aa6bc77 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:10.541362 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b6b54c4e-c0ef-4ae8-bc4a-c2cc3aa6bc77 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:10.542561 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b6b54c4e-c0ef-4ae8-bc4a-c2cc3aa6bc77 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18" status: 200 len: 1807 microversion: 2.20 time: 0.690260 Oct 04 19:01:10.543122 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3008/5990] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:01:09 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 => generated 1807 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:01:10.547546 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-25a1c02c-150a-4023-a6a8-dbd4f46bc2f6 req-6e7c9804-8121-4971-8c51-7af119ec66fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12c4f942-479c-47b3-b824-def0b12f527b", "name": "network-vif-plugged", "status": "completed", "tag": "e4977aed-cb1f-4e42-b534-b46ca871039f"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:01:10.568152 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-25a1c02c-150a-4023-a6a8-dbd4f46bc2f6 req-6e7c9804-8121-4971-8c51-7af119ec66fe service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:10.573248 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-25a1c02c-150a-4023-a6a8-dbd4f46bc2f6 req-6e7c9804-8121-4971-8c51-7af119ec66fe service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:10.574175 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-25a1c02c-150a-4023-a6a8-dbd4f46bc2f6 req-6e7c9804-8121-4971-8c51-7af119ec66fe service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:10.598860 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-25a1c02c-150a-4023-a6a8-dbd4f46bc2f6 req-6e7c9804-8121-4971-8c51-7af119ec66fe service nova] Creating event network-vif-plugged:e4977aed-cb1f-4e42-b534-b46ca871039f for instance 12c4f942-479c-47b3-b824-def0b12f527b on n-h2-850501-14 Oct 04 19:01:10.619543 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-25a1c02c-150a-4023-a6a8-dbd4f46bc2f6 req-6e7c9804-8121-4971-8c51-7af119ec66fe service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084355 Oct 04 19:01:10.620483 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2983/5991] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:01:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:01:10.931600 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c15fd2bc-c4a1-404b-8a2b-f588a2db5ebf tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:10.944196 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c15fd2bc-c4a1-404b-8a2b-f588a2db5ebf tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 12c4f942-479c-47b3-b824-def0b12f527b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:10.982899 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c15fd2bc-c4a1-404b-8a2b-f588a2db5ebf tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:10.982899 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c15fd2bc-c4a1-404b-8a2b-f588a2db5ebf tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:10.982899 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c15fd2bc-c4a1-404b-8a2b-f588a2db5ebf tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:10.982899 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c15fd2bc-c4a1-404b-8a2b-f588a2db5ebf tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:10.983343 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c15fd2bc-c4a1-404b-8a2b-f588a2db5ebf tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:10.983675 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c15fd2bc-c4a1-404b-8a2b-f588a2db5ebf tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:11.316435 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c15fd2bc-c4a1-404b-8a2b-f588a2db5ebf tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:11.326190 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c15fd2bc-c4a1-404b-8a2b-f588a2db5ebf tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/12c4f942-479c-47b3-b824-def0b12f527b" status: 200 len: 1202 microversion: 2.1 time: 0.398099 Oct 04 19:01:11.327494 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3009/5992] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:10 2022] GET /compute/v2.1/servers/12c4f942-479c-47b3-b824-def0b12f527b => generated 1202 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:11.548573 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e1f5d7fb-84db-43ea-8300-04ac21482c45 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:11.558009 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e1f5d7fb-84db-43ea-8300-04ac21482c45 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: ba710906-86d6-4c04-a708-1f3b9a466e3c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:11.559752 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e1f5d7fb-84db-43ea-8300-04ac21482c45 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:11.560483 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e1f5d7fb-84db-43ea-8300-04ac21482c45 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:11.560963 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e1f5d7fb-84db-43ea-8300-04ac21482c45 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:11.561944 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e1f5d7fb-84db-43ea-8300-04ac21482c45 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:11.562511 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e1f5d7fb-84db-43ea-8300-04ac21482c45 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:11.573478 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2e9630f5-b6b8-40c1-9166-26dc68bb9448 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:11.574594 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2e9630f5-b6b8-40c1-9166-26dc68bb9448 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:11.579224 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e1f5d7fb-84db-43ea-8300-04ac21482c45 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:11.598127 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2e9630f5-b6b8-40c1-9166-26dc68bb9448 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:11.599054 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2e9630f5-b6b8-40c1-9166-26dc68bb9448 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:11.601101 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2e9630f5-b6b8-40c1-9166-26dc68bb9448 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:11.602078 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2e9630f5-b6b8-40c1-9166-26dc68bb9448 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:11.604694 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2e9630f5-b6b8-40c1-9166-26dc68bb9448 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:11.605371 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2e9630f5-b6b8-40c1-9166-26dc68bb9448 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:12.105765 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e1f5d7fb-84db-43ea-8300-04ac21482c45 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce441ded6f554ec28560c75de97af173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc67d8de57543c48bdf45669b684227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:12.114040 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e1f5d7fb-84db-43ea-8300-04ac21482c45 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/ba710906-86d6-4c04-a708-1f3b9a466e3c" status: 200 len: 1682 microversion: 2.1 time: 0.569855 Oct 04 19:01:12.119503 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2984/5993] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:11 2022] GET /compute/v2.1/servers/ba710906-86d6-4c04-a708-1f3b9a466e3c => generated 1682 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:12.131047 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-2e9630f5-b6b8-40c1-9166-26dc68bb9448 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:12.145706 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-2e9630f5-b6b8-40c1-9166-26dc68bb9448 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:12.147658 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-2e9630f5-b6b8-40c1-9166-26dc68bb9448 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:12.154156 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2e9630f5-b6b8-40c1-9166-26dc68bb9448 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18" status: 200 len: 1807 microversion: 2.20 time: 0.584387 Oct 04 19:01:12.155234 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3010/5994] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:01:11 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 => generated 1807 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:01:12.361200 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7e55dacb-d87f-495a-9561-818e3496390d tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:12.371284 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7e55dacb-d87f-495a-9561-818e3496390d tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 12c4f942-479c-47b3-b824-def0b12f527b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:12.371284 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7e55dacb-d87f-495a-9561-818e3496390d tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:12.371284 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7e55dacb-d87f-495a-9561-818e3496390d tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:12.371284 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7e55dacb-d87f-495a-9561-818e3496390d tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:12.376902 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7e55dacb-d87f-495a-9561-818e3496390d tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:12.377848 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7e55dacb-d87f-495a-9561-818e3496390d tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:12.386638 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7e55dacb-d87f-495a-9561-818e3496390d tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:12.813767 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7e55dacb-d87f-495a-9561-818e3496390d tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:12.825317 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7e55dacb-d87f-495a-9561-818e3496390d tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/12c4f942-479c-47b3-b824-def0b12f527b" status: 200 len: 1202 microversion: 2.1 time: 0.473990 Oct 04 19:01:12.826500 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2985/5995] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:12 2022] GET /compute/v2.1/servers/12c4f942-479c-47b3-b824-def0b12f527b => generated 1202 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:13.146014 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-293a28ff-8f9b-4dfa-b46a-73bba2aae1d9 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:13.146750 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-293a28ff-8f9b-4dfa-b46a-73bba2aae1d9 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: ba710906-86d6-4c04-a708-1f3b9a466e3c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:13.159358 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-293a28ff-8f9b-4dfa-b46a-73bba2aae1d9 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:13.160159 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-293a28ff-8f9b-4dfa-b46a-73bba2aae1d9 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:13.160749 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-293a28ff-8f9b-4dfa-b46a-73bba2aae1d9 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:13.161691 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-293a28ff-8f9b-4dfa-b46a-73bba2aae1d9 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:13.162312 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-293a28ff-8f9b-4dfa-b46a-73bba2aae1d9 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:13.162732 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-293a28ff-8f9b-4dfa-b46a-73bba2aae1d9 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:13.181884 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-951934dd-1091-4acf-a316-b8980c9e8ff5 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:13.182519 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-951934dd-1091-4acf-a316-b8980c9e8ff5 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:13.189415 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-951934dd-1091-4acf-a316-b8980c9e8ff5 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:13.189839 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-951934dd-1091-4acf-a316-b8980c9e8ff5 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:13.190290 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-951934dd-1091-4acf-a316-b8980c9e8ff5 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:13.191017 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-951934dd-1091-4acf-a316-b8980c9e8ff5 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:13.191476 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-951934dd-1091-4acf-a316-b8980c9e8ff5 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:13.191908 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-951934dd-1091-4acf-a316-b8980c9e8ff5 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:13.501009 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-293a28ff-8f9b-4dfa-b46a-73bba2aae1d9 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce441ded6f554ec28560c75de97af173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc67d8de57543c48bdf45669b684227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:13.519111 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-293a28ff-8f9b-4dfa-b46a-73bba2aae1d9 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/ba710906-86d6-4c04-a708-1f3b9a466e3c" status: 200 len: 1682 microversion: 2.1 time: 0.373901 Oct 04 19:01:13.538013 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3011/5996] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:13 2022] GET /compute/v2.1/servers/ba710906-86d6-4c04-a708-1f3b9a466e3c => generated 1682 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:13.563647 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-951934dd-1091-4acf-a316-b8980c9e8ff5 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:13.586238 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-951934dd-1091-4acf-a316-b8980c9e8ff5 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:13.593002 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-951934dd-1091-4acf-a316-b8980c9e8ff5 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:13.595281 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-951934dd-1091-4acf-a316-b8980c9e8ff5 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18" status: 200 len: 1807 microversion: 2.20 time: 0.417546 Oct 04 19:01:13.596466 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2986/5997] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:01:13 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 => generated 1807 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:01:13.852515 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-84adeec7-8b83-4954-ab77-8d4ea261cc75 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:13.853409 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-84adeec7-8b83-4954-ab77-8d4ea261cc75 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 12c4f942-479c-47b3-b824-def0b12f527b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:13.876000 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-84adeec7-8b83-4954-ab77-8d4ea261cc75 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:13.881425 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-84adeec7-8b83-4954-ab77-8d4ea261cc75 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:13.881898 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-84adeec7-8b83-4954-ab77-8d4ea261cc75 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:13.882655 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-84adeec7-8b83-4954-ab77-8d4ea261cc75 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:13.883126 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-84adeec7-8b83-4954-ab77-8d4ea261cc75 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:13.883626 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-84adeec7-8b83-4954-ab77-8d4ea261cc75 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:14.159125 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-84adeec7-8b83-4954-ab77-8d4ea261cc75 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:14.168801 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-84adeec7-8b83-4954-ab77-8d4ea261cc75 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/12c4f942-479c-47b3-b824-def0b12f527b" status: 200 len: 1202 microversion: 2.1 time: 0.320685 Oct 04 19:01:14.174390 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3012/5998] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:13 2022] GET /compute/v2.1/servers/12c4f942-479c-47b3-b824-def0b12f527b => generated 1202 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:14.554035 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f85a8eb9-c565-430e-880c-f832f2dc026a tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:14.554656 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f85a8eb9-c565-430e-880c-f832f2dc026a tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: ba710906-86d6-4c04-a708-1f3b9a466e3c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:14.574845 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f85a8eb9-c565-430e-880c-f832f2dc026a tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:14.575804 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f85a8eb9-c565-430e-880c-f832f2dc026a tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:14.576486 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f85a8eb9-c565-430e-880c-f832f2dc026a tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:14.577397 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f85a8eb9-c565-430e-880c-f832f2dc026a tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:14.578769 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f85a8eb9-c565-430e-880c-f832f2dc026a tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:14.592008 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f85a8eb9-c565-430e-880c-f832f2dc026a tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:14.624871 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9b97ef3c-2b03-4bc6-934e-b94139bda501 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:14.625870 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-9b97ef3c-2b03-4bc6-934e-b94139bda501 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:14.636180 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9b97ef3c-2b03-4bc6-934e-b94139bda501 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:14.652568 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9b97ef3c-2b03-4bc6-934e-b94139bda501 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:14.653103 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9b97ef3c-2b03-4bc6-934e-b94139bda501 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:14.654129 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9b97ef3c-2b03-4bc6-934e-b94139bda501 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:14.654810 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9b97ef3c-2b03-4bc6-934e-b94139bda501 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:14.655440 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9b97ef3c-2b03-4bc6-934e-b94139bda501 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:15.168656 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f85a8eb9-c565-430e-880c-f832f2dc026a tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce441ded6f554ec28560c75de97af173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc67d8de57543c48bdf45669b684227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:15.170294 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9b97ef3c-2b03-4bc6-934e-b94139bda501 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:15.187912 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9b97ef3c-2b03-4bc6-934e-b94139bda501 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:15.189511 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f85a8eb9-c565-430e-880c-f832f2dc026a tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/ba710906-86d6-4c04-a708-1f3b9a466e3c" status: 200 len: 1682 microversion: 2.1 time: 0.639317 Oct 04 19:01:15.204502 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2987/5999] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:14 2022] GET /compute/v2.1/servers/ba710906-86d6-4c04-a708-1f3b9a466e3c => generated 1682 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:15.210758 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9b97ef3c-2b03-4bc6-934e-b94139bda501 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:15.214440 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9b97ef3c-2b03-4bc6-934e-b94139bda501 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18" status: 200 len: 1807 microversion: 2.20 time: 0.593577 Oct 04 19:01:15.217145 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-70b062ae-47c0-4e5a-a9c8-bbbcfc8931e4 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:15.232707 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3013/6000] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:01:14 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 => generated 1807 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:01:15.233799 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-70b062ae-47c0-4e5a-a9c8-bbbcfc8931e4 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 12c4f942-479c-47b3-b824-def0b12f527b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:15.257619 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-70b062ae-47c0-4e5a-a9c8-bbbcfc8931e4 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:15.258053 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-70b062ae-47c0-4e5a-a9c8-bbbcfc8931e4 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:15.258498 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-70b062ae-47c0-4e5a-a9c8-bbbcfc8931e4 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:15.259285 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-70b062ae-47c0-4e5a-a9c8-bbbcfc8931e4 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:15.259755 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-70b062ae-47c0-4e5a-a9c8-bbbcfc8931e4 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:15.279100 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-70b062ae-47c0-4e5a-a9c8-bbbcfc8931e4 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:16.195126 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-70b062ae-47c0-4e5a-a9c8-bbbcfc8931e4 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:16.209022 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-70b062ae-47c0-4e5a-a9c8-bbbcfc8931e4 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/12c4f942-479c-47b3-b824-def0b12f527b" status: 200 len: 1202 microversion: 2.1 time: 1.001784 Oct 04 19:01:16.223405 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-80ad9567-51ce-4aea-aa64-048f74f938fb req-5a76f6be-a415-4cba-baf9-3526ef3e518b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba710906-86d6-4c04-a708-1f3b9a466e3c", "name": "network-vif-deleted", "tag": "57e29293-74e1-4d5e-a79e-46e5c51346d1"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:01:16.225061 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2988/6001] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:15 2022] GET /compute/v2.1/servers/12c4f942-479c-47b3-b824-def0b12f527b => generated 1202 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:16.245593 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-25ba991f-dd07-48ef-a53c-16252fbd24d5 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:16.249637 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-25ba991f-dd07-48ef-a53c-16252fbd24d5 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: ba710906-86d6-4c04-a708-1f3b9a466e3c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:16.254448 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-80ad9567-51ce-4aea-aa64-048f74f938fb req-5a76f6be-a415-4cba-baf9-3526ef3e518b service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:16.259828 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-80ad9567-51ce-4aea-aa64-048f74f938fb req-5a76f6be-a415-4cba-baf9-3526ef3e518b service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:16.260550 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-80ad9567-51ce-4aea-aa64-048f74f938fb req-5a76f6be-a415-4cba-baf9-3526ef3e518b service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:16.273395 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-25ba991f-dd07-48ef-a53c-16252fbd24d5 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:16.282208 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-25ba991f-dd07-48ef-a53c-16252fbd24d5 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:16.283140 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-25ba991f-dd07-48ef-a53c-16252fbd24d5 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:16.285076 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-25ba991f-dd07-48ef-a53c-16252fbd24d5 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:16.288883 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-25ba991f-dd07-48ef-a53c-16252fbd24d5 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:16.291684 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-25ba991f-dd07-48ef-a53c-16252fbd24d5 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:16.330177 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-80ad9567-51ce-4aea-aa64-048f74f938fb req-5a76f6be-a415-4cba-baf9-3526ef3e518b service nova] Creating event network-vif-deleted:57e29293-74e1-4d5e-a79e-46e5c51346d1 for instance ba710906-86d6-4c04-a708-1f3b9a466e3c on n-h2-850501-14 Oct 04 19:01:16.349691 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-80ad9567-51ce-4aea-aa64-048f74f938fb req-5a76f6be-a415-4cba-baf9-3526ef3e518b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138410 Oct 04 19:01:16.352273 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3014/6002] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:01:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:01:16.361089 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4ea3ebcd-7582-4031-a12e-19a815e243a7 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:16.382999 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-4ea3ebcd-7582-4031-a12e-19a815e243a7 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:16.399783 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4ea3ebcd-7582-4031-a12e-19a815e243a7 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:16.400637 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4ea3ebcd-7582-4031-a12e-19a815e243a7 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:16.401279 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4ea3ebcd-7582-4031-a12e-19a815e243a7 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:16.402170 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4ea3ebcd-7582-4031-a12e-19a815e243a7 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:16.402796 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4ea3ebcd-7582-4031-a12e-19a815e243a7 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:16.404951 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4ea3ebcd-7582-4031-a12e-19a815e243a7 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:16.567834 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-25ba991f-dd07-48ef-a53c-16252fbd24d5 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce441ded6f554ec28560c75de97af173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc67d8de57543c48bdf45669b684227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:16.586833 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-25ba991f-dd07-48ef-a53c-16252fbd24d5 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/ba710906-86d6-4c04-a708-1f3b9a466e3c" status: 200 len: 1614 microversion: 2.1 time: 0.360295 Oct 04 19:01:16.588247 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2989/6003] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:16 2022] GET /compute/v2.1/servers/ba710906-86d6-4c04-a708-1f3b9a466e3c => generated 1614 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:17.073931 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-4ea3ebcd-7582-4031-a12e-19a815e243a7 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:17.094705 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-4ea3ebcd-7582-4031-a12e-19a815e243a7 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:17.097261 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-4ea3ebcd-7582-4031-a12e-19a815e243a7 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:17.097840 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-4ea3ebcd-7582-4031-a12e-19a815e243a7 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18" status: 200 len: 1807 microversion: 2.20 time: 0.741586 Oct 04 19:01:17.120458 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3015/6004] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:01:16 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 => generated 1807 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:01:17.247457 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e0ec6014-e80a-4e6a-8c4c-ef6a2cb42a32 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:17.248748 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e0ec6014-e80a-4e6a-8c4c-ef6a2cb42a32 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 12c4f942-479c-47b3-b824-def0b12f527b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:17.269686 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e0ec6014-e80a-4e6a-8c4c-ef6a2cb42a32 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:17.271254 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e0ec6014-e80a-4e6a-8c4c-ef6a2cb42a32 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:17.273552 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e0ec6014-e80a-4e6a-8c4c-ef6a2cb42a32 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:17.275112 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e0ec6014-e80a-4e6a-8c4c-ef6a2cb42a32 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:17.278847 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e0ec6014-e80a-4e6a-8c4c-ef6a2cb42a32 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:17.279717 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e0ec6014-e80a-4e6a-8c4c-ef6a2cb42a32 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:17.619084 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c8132adf-596e-4f06-ba13-083edce9c7d6 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:17.619833 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c8132adf-596e-4f06-ba13-083edce9c7d6 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: ba710906-86d6-4c04-a708-1f3b9a466e3c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:17.643241 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c8132adf-596e-4f06-ba13-083edce9c7d6 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:17.645957 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c8132adf-596e-4f06-ba13-083edce9c7d6 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:17.648182 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c8132adf-596e-4f06-ba13-083edce9c7d6 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:17.649349 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c8132adf-596e-4f06-ba13-083edce9c7d6 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:17.652196 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c8132adf-596e-4f06-ba13-083edce9c7d6 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:17.655705 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c8132adf-596e-4f06-ba13-083edce9c7d6 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:17.707949 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e0ec6014-e80a-4e6a-8c4c-ef6a2cb42a32 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:17.758910 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e0ec6014-e80a-4e6a-8c4c-ef6a2cb42a32 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/12c4f942-479c-47b3-b824-def0b12f527b" status: 200 len: 1388 microversion: 2.1 time: 0.519034 Oct 04 19:01:17.759855 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2990/6005] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:17 2022] GET /compute/v2.1/servers/12c4f942-479c-47b3-b824-def0b12f527b => generated 1388 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:01:17.786183 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c8132adf-596e-4f06-ba13-083edce9c7d6 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:17.786753 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c8132adf-596e-4f06-ba13-083edce9c7d6 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:17.787261 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c8132adf-596e-4f06-ba13-083edce9c7d6 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:17.787593 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2c991974-40f2-4b35-9213-1f6f991bd00a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:17.788352 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2c991974-40f2-4b35-9213-1f6f991bd00a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 12c4f942-479c-47b3-b824-def0b12f527b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:17.788653 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-c8132adf-596e-4f06-ba13-083edce9c7d6 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lazy-loading 'fault' on Instance uuid ba710906-86d6-4c04-a708-1f3b9a466e3c {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:01:17.795112 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2c991974-40f2-4b35-9213-1f6f991bd00a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:17.796173 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2c991974-40f2-4b35-9213-1f6f991bd00a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:17.797006 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2c991974-40f2-4b35-9213-1f6f991bd00a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:17.798058 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2c991974-40f2-4b35-9213-1f6f991bd00a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:17.798706 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2c991974-40f2-4b35-9213-1f6f991bd00a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:17.799469 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2c991974-40f2-4b35-9213-1f6f991bd00a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:17.918709 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c8132adf-596e-4f06-ba13-083edce9c7d6 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce441ded6f554ec28560c75de97af173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc67d8de57543c48bdf45669b684227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:17.928869 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c8132adf-596e-4f06-ba13-083edce9c7d6 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/ba710906-86d6-4c04-a708-1f3b9a466e3c" status: 200 len: 1332 microversion: 2.1 time: 0.314031 Oct 04 19:01:17.939715 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3016/6006] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:17 2022] GET /compute/v2.1/servers/ba710906-86d6-4c04-a708-1f3b9a466e3c => generated 1332 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:01:18.034413 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-52e94ada-8950-44e9-af3b-81add06a45fc tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1651073894", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": [{"uuid": "b1de81af-4066-4f05-a180-554d7db3864c"}]}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:01:18.146244 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.neutron [None req-52e94ada-8950-44e9-af3b-81add06a45fc tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] validate_networks() for [('b1de81af-4066-4f05-a180-554d7db3864c', None, None, None, None, None)] {{(pid=123001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:01:18.153648 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2c991974-40f2-4b35-9213-1f6f991bd00a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:18.175089 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2c991974-40f2-4b35-9213-1f6f991bd00a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/12c4f942-479c-47b3-b824-def0b12f527b" status: 200 len: 1388 microversion: 2.1 time: 0.385166 Oct 04 19:01:18.192558 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2991/6007] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:17 2022] GET /compute/v2.1/servers/12c4f942-479c-47b3-b824-def0b12f527b => generated 1388 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:18.234644 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-11e306e3-824b-4bbb-9e63-1c353e642426 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:18.237691 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-11e306e3-824b-4bbb-9e63-1c353e642426 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:18.263781 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-11e306e3-824b-4bbb-9e63-1c353e642426 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:18.268283 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-11e306e3-824b-4bbb-9e63-1c353e642426 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:18.269933 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-11e306e3-824b-4bbb-9e63-1c353e642426 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:18.273205 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-11e306e3-824b-4bbb-9e63-1c353e642426 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:18.273835 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-11e306e3-824b-4bbb-9e63-1c353e642426 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:18.275415 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-11e306e3-824b-4bbb-9e63-1c353e642426 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:18.748789 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-11e306e3-824b-4bbb-9e63-1c353e642426 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:18.774805 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-11e306e3-824b-4bbb-9e63-1c353e642426 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:18.779768 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-11e306e3-824b-4bbb-9e63-1c353e642426 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:18.815334 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-11e306e3-824b-4bbb-9e63-1c353e642426 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18" status: 200 len: 1807 microversion: 2.20 time: 0.590764 Oct 04 19:01:18.816699 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2992/6008] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:01:18 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 => generated 1807 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:01:18.833325 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ecd6dc4f-147a-4344-befd-5ebfc0b5fe5a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:18.834322 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ecd6dc4f-147a-4344-befd-5ebfc0b5fe5a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 12c4f942-479c-47b3-b824-def0b12f527b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:18.847860 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ecd6dc4f-147a-4344-befd-5ebfc0b5fe5a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:18.852916 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ecd6dc4f-147a-4344-befd-5ebfc0b5fe5a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:18.856924 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ecd6dc4f-147a-4344-befd-5ebfc0b5fe5a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:18.859213 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ecd6dc4f-147a-4344-befd-5ebfc0b5fe5a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:18.860385 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ecd6dc4f-147a-4344-befd-5ebfc0b5fe5a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:18.861018 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ecd6dc4f-147a-4344-befd-5ebfc0b5fe5a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:19.116706 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ecd6dc4f-147a-4344-befd-5ebfc0b5fe5a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:19.130187 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ecd6dc4f-147a-4344-befd-5ebfc0b5fe5a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/12c4f942-479c-47b3-b824-def0b12f527b" status: 200 len: 1388 microversion: 2.1 time: 0.308331 Oct 04 19:01:19.132279 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2993/6009] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:18 2022] GET /compute/v2.1/servers/12c4f942-479c-47b3-b824-def0b12f527b => generated 1388 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:19.142847 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-81ab25b3-1819-49df-8b94-519d3043e2a4 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:19.144920 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-81ab25b3-1819-49df-8b94-519d3043e2a4 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: ba710906-86d6-4c04-a708-1f3b9a466e3c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:19.159112 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-81ab25b3-1819-49df-8b94-519d3043e2a4 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:19.163191 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-81ab25b3-1819-49df-8b94-519d3043e2a4 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:19.163843 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-81ab25b3-1819-49df-8b94-519d3043e2a4 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:19.164700 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-81ab25b3-1819-49df-8b94-519d3043e2a4 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:19.166537 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-81ab25b3-1819-49df-8b94-519d3043e2a4 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:19.167803 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-81ab25b3-1819-49df-8b94-519d3043e2a4 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:19.234606 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-81ab25b3-1819-49df-8b94-519d3043e2a4 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] HTTP exception thrown: Instance ba710906-86d6-4c04-a708-1f3b9a466e3c could not be found. Oct 04 19:01:19.242658 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-81ab25b3-1819-49df-8b94-519d3043e2a4 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Request method failure captured: Oct 04 19:01:19.242658 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/ba710906-86d6-4c04-a708-1f3b9a466e3c HTTP/1.1 Oct 04 19:01:19.242658 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 19:01:19.242658 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 19:01:19.242658 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 19:01:19.242658 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 19:01:19.242658 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 19:01:19.242658 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 19:01:19.242658 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 19:01:19.242658 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 19:01:19.242658 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPIIX_3DOcExv0tyjf74SMRRF0KoXtiJVCF7h65af0U3qLWvNf58dKqXrLellPdPVePIBHO4xx7DLTXsLA5NqBHQCEuDWqWqMr6VInyDk7lvTZQyuDvBxRCTYPpwhj6qdAHOfmE7y3qjml2L3OlgdXc8W6zK59OH-OYNHGwvWAJmEgQ4 Oct 04 19:01:19.242658 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 19:01:19.242658 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 19:01:19.242658 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 19:01:19.242658 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 19:01:19.242658 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 19:01:19.242658 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 19:01:19.242658 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 5dc67d8de57543c48bdf45669b684227 Oct 04 19:01:19.242658 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-AttachVolumeNegativeTest-715412502 Oct 04 19:01:19.242658 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 19:01:19.242658 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 19:01:19.242658 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5dc67d8de57543c48bdf45669b684227"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5dc67d8de57543c48bdf45669b684227", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5dc67d8de57543c48bdf45669b684227"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5dc67d8de57543c48bdf45669b684227"}]}] Oct 04 19:01:19.242658 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-AttachVolumeNegativeTest-715412502 Oct 04 19:01:19.242658 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 5dc67d8de57543c48bdf45669b684227 Oct 04 19:01:19.242658 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-715412502 Oct 04 19:01:19.242658 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-AttachVolumeNegativeTest-715412502-project Oct 04 19:01:19.242658 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 19:01:19.242658 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 19:01:19.242658 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: ce441ded6f554ec28560c75de97af173 Oct 04 19:01:19.242658 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-AttachVolumeNegativeTest-715412502-project Oct 04 19:01:19.242658 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 19:01:19.242658 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance ba710906-86d6-4c04-a708-1f3b9a466e3c could not be found. Oct 04 19:01:19.242658 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'ba710906-86d6-4c04-a708-1f3b9a466e3c'} Oct 04 19:01:19.242658 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:01:19.242658 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:01:19.242658 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:01:19.242658 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:01:19.242658 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:01:19.242658 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:01:19.242658 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:01:19.242658 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:01:19.242658 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:01:19.242658 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:01:19.242658 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba710906-86d6-4c04-a708-1f3b9a466e3c could not be found. Oct 04 19:01:19.242658 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:01:19.242658 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:01:19.242658 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:01:19.242658 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:01:19.242658 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:01:19.242658 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:01:19.242658 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:01:19.242658 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:01:19.242658 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:01:19.242658 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:01:19.242658 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:01:19.242658 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:01:19.242658 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:01:19.242658 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:01:19.242658 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:01:19.242658 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:01:19.242658 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba710906-86d6-4c04-a708-1f3b9a466e3c could not be found. Oct 04 19:01:19.242658 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:01:19.242658 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:01:19.242658 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:01:19.247484 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:01:19.247484 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:01:19.247484 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:01:19.247484 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:01:19.247484 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:01:19.247484 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba710906-86d6-4c04-a708-1f3b9a466e3c could not be found. Oct 04 19:01:19.247484 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:01:19.247944 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-81ab25b3-1819-49df-8b94-519d3043e2a4 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Returning 404 to user: Instance ba710906-86d6-4c04-a708-1f3b9a466e3c could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:01:19.249033 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-81ab25b3-1819-49df-8b94-519d3043e2a4 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/ba710906-86d6-4c04-a708-1f3b9a466e3c" status: 404 len: 111 microversion: 2.1 time: 0.115622 Oct 04 19:01:19.254650 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2994/6010] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:19 2022] GET /compute/v2.1/servers/ba710906-86d6-4c04-a708-1f3b9a466e3c => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:01:19.274246 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6019e878-fc96-40a0-bcb4-a3652904c4be tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:19.274769 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-6019e878-fc96-40a0-bcb4-a3652904c4be tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 12c4f942-479c-47b3-b824-def0b12f527b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:19.293127 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6019e878-fc96-40a0-bcb4-a3652904c4be tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:19.294427 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6019e878-fc96-40a0-bcb4-a3652904c4be tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:19.294888 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6019e878-fc96-40a0-bcb4-a3652904c4be tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:19.295627 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6019e878-fc96-40a0-bcb4-a3652904c4be tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:19.303161 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6019e878-fc96-40a0-bcb4-a3652904c4be tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:19.304125 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6019e878-fc96-40a0-bcb4-a3652904c4be tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:19.420987 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-6019e878-fc96-40a0-bcb4-a3652904c4be tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 12c4f942-479c-47b3-b824-def0b12f527b] Going to try to terminate instance {{(pid=123002) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:01:19.510079 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-52e94ada-8950-44e9-af3b-81add06a45fc tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:01:19.510636 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-52e94ada-8950-44e9-af3b-81add06a45fc tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:01:19.511070 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-52e94ada-8950-44e9-af3b-81add06a45fc tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:01:19.511750 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-52e94ada-8950-44e9-af3b-81add06a45fc tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:01:19.512589 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-52e94ada-8950-44e9-af3b-81add06a45fc tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:01:19.540403 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-52e94ada-8950-44e9-af3b-81add06a45fc tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:19.545777 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-52e94ada-8950-44e9-af3b-81add06a45fc tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:19.548979 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-52e94ada-8950-44e9-af3b-81add06a45fc tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:19.551186 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-52e94ada-8950-44e9-af3b-81add06a45fc tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:19.552460 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-52e94ada-8950-44e9-af3b-81add06a45fc tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:19.554276 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-52e94ada-8950-44e9-af3b-81add06a45fc tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:19.619405 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-52e94ada-8950-44e9-af3b-81add06a45fc tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Getting quotas for project 7a6844b3a51e4c2da1294e89517989c4. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:01:19.636490 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-52e94ada-8950-44e9-af3b-81add06a45fc tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Getting quotas for user 49a7fac7323441708be3f27945a92fb5 and project 7a6844b3a51e4c2da1294e89517989c4. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:01:19.660824 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-52e94ada-8950-44e9-af3b-81add06a45fc tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Going to run 1 instances... {{(pid=123001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:01:19.663771 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-52e94ada-8950-44e9-af3b-81add06a45fc tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] [instance: a3c2e8e3-d8c6-4185-93b7-df9dd21cf432] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:01:19.850420 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6019e878-fc96-40a0-bcb4-a3652904c4be tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "DELETE /compute/v2.1/servers/12c4f942-479c-47b3-b824-def0b12f527b" status: 204 len: 0 microversion: 2.1 time: 0.597123 Oct 04 19:01:19.851091 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2995/6011] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 19:01:19 2022] DELETE /compute/v2.1/servers/12c4f942-479c-47b3-b824-def0b12f527b => generated 0 bytes in 599 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:01:19.869379 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-700ac4a5-1c7b-4cbb-a293-b193bd47ba3f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '.version_select at 0x7fe253d5aaf0>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:19.886834 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-52e94ada-8950-44e9-af3b-81add06a45fc tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.862058 Oct 04 19:01:19.892144 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3017/6012] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 19:01:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1868 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:01:19.905230 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-72c02ab8-86b5-43c2-b447-325337e061b7 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:19.910494 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-72c02ab8-86b5-43c2-b447-325337e061b7 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:19.939049 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-72c02ab8-86b5-43c2-b447-325337e061b7 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:19.939049 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-72c02ab8-86b5-43c2-b447-325337e061b7 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:19.939049 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-72c02ab8-86b5-43c2-b447-325337e061b7 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:19.941601 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-72c02ab8-86b5-43c2-b447-325337e061b7 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:19.942280 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-72c02ab8-86b5-43c2-b447-325337e061b7 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:19.942941 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-72c02ab8-86b5-43c2-b447-325337e061b7 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:20.023053 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-700ac4a5-1c7b-4cbb-a293-b193bd47ba3f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1414317048" status: 202 len: 0 microversion: 2.1 time: 0.170527 Oct 04 19:01:20.028128 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2996/6013] 10.222.0.20 () {58 vars in 1221 bytes} [Tue Oct 4 19:01:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1414317048 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:01:20.042188 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9c7ad5d8-c2fd-4402-a023-ea4f9104d394 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:20.044979 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9c7ad5d8-c2fd-4402-a023-ea4f9104d394 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 12c4f942-479c-47b3-b824-def0b12f527b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:20.079066 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9c7ad5d8-c2fd-4402-a023-ea4f9104d394 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:20.079578 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9c7ad5d8-c2fd-4402-a023-ea4f9104d394 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:20.080028 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9c7ad5d8-c2fd-4402-a023-ea4f9104d394 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:20.080878 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9c7ad5d8-c2fd-4402-a023-ea4f9104d394 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:20.081350 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9c7ad5d8-c2fd-4402-a023-ea4f9104d394 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:20.081790 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9c7ad5d8-c2fd-4402-a023-ea4f9104d394 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:20.481967 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-72c02ab8-86b5-43c2-b447-325337e061b7 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:20.501537 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-72c02ab8-86b5-43c2-b447-325337e061b7 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:20.511282 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-72c02ab8-86b5-43c2-b447-325337e061b7 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:20.514059 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-72c02ab8-86b5-43c2-b447-325337e061b7 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18" status: 200 len: 1807 microversion: 2.20 time: 0.620400 Oct 04 19:01:20.534409 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3018/6014] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:01:19 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 => generated 1807 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:01:20.561448 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c5d5df72-2111-4e59-bf77-f7e6f1cde774 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:20.562416 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c5d5df72-2111-4e59-bf77-f7e6f1cde774 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] [instance: a3c2e8e3-d8c6-4185-93b7-df9dd21cf432] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:20.724019 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c5d5df72-2111-4e59-bf77-f7e6f1cde774 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7fac7323441708be3f27945a92fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6844b3a51e4c2da1294e89517989c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:20.741240 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c5d5df72-2111-4e59-bf77-f7e6f1cde774 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] 10.222.0.20 "GET /compute/v2.1/servers/a3c2e8e3-d8c6-4185-93b7-df9dd21cf432" status: 200 len: 1219 microversion: 2.1 time: 0.201814 Oct 04 19:01:20.742692 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3019/6015] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:20 2022] GET /compute/v2.1/servers/a3c2e8e3-d8c6-4185-93b7-df9dd21cf432 => generated 1219 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:20.785756 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9c7ad5d8-c2fd-4402-a023-ea4f9104d394 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:20.796518 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9c7ad5d8-c2fd-4402-a023-ea4f9104d394 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/12c4f942-479c-47b3-b824-def0b12f527b" status: 200 len: 1394 microversion: 2.1 time: 0.766929 Oct 04 19:01:20.797544 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2997/6016] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:20 2022] GET /compute/v2.1/servers/12c4f942-479c-47b3-b824-def0b12f527b => generated 1394 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:21.551373 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0f66caa4-8a4f-42eb-bbbd-70c64487d4ec tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:21.552774 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0f66caa4-8a4f-42eb-bbbd-70c64487d4ec tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:21.573478 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0f66caa4-8a4f-42eb-bbbd-70c64487d4ec tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:21.574615 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0f66caa4-8a4f-42eb-bbbd-70c64487d4ec tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:21.575777 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0f66caa4-8a4f-42eb-bbbd-70c64487d4ec tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:21.580885 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0f66caa4-8a4f-42eb-bbbd-70c64487d4ec tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:21.581635 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0f66caa4-8a4f-42eb-bbbd-70c64487d4ec tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:21.583052 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0f66caa4-8a4f-42eb-bbbd-70c64487d4ec tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:21.778163 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-29b66f0b-8b30-4957-8a94-c2a9e88500d5 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:21.779342 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-29b66f0b-8b30-4957-8a94-c2a9e88500d5 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] [instance: a3c2e8e3-d8c6-4185-93b7-df9dd21cf432] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:22.004913 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-29b66f0b-8b30-4957-8a94-c2a9e88500d5 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7fac7323441708be3f27945a92fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6844b3a51e4c2da1294e89517989c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:22.004913 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-29b66f0b-8b30-4957-8a94-c2a9e88500d5 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] 10.222.0.20 "GET /compute/v2.1/servers/a3c2e8e3-d8c6-4185-93b7-df9dd21cf432" status: 200 len: 1219 microversion: 2.1 time: 0.137515 Oct 04 19:01:22.004913 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2998/6017] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:21 2022] GET /compute/v2.1/servers/a3c2e8e3-d8c6-4185-93b7-df9dd21cf432 => generated 1219 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:22.004913 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7c5244ce-a18b-499b-9d5e-657057012fee tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:22.004913 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7c5244ce-a18b-499b-9d5e-657057012fee tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 12c4f942-479c-47b3-b824-def0b12f527b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:22.004913 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c5244ce-a18b-499b-9d5e-657057012fee tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:22.004913 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c5244ce-a18b-499b-9d5e-657057012fee tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:22.004913 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c5244ce-a18b-499b-9d5e-657057012fee tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:22.004913 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c5244ce-a18b-499b-9d5e-657057012fee tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:22.004913 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c5244ce-a18b-499b-9d5e-657057012fee tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:22.004913 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c5244ce-a18b-499b-9d5e-657057012fee tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:22.006776 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0f66caa4-8a4f-42eb-bbbd-70c64487d4ec tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:22.006776 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0f66caa4-8a4f-42eb-bbbd-70c64487d4ec tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:22.006776 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0f66caa4-8a4f-42eb-bbbd-70c64487d4ec tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:22.009545 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0f66caa4-8a4f-42eb-bbbd-70c64487d4ec tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18" status: 200 len: 1807 microversion: 2.20 time: 0.463975 Oct 04 19:01:22.025526 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3020/6018] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:01:21 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 => generated 1807 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 19:01:22.223587 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7c5244ce-a18b-499b-9d5e-657057012fee tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:22.237278 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7c5244ce-a18b-499b-9d5e-657057012fee tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/12c4f942-479c-47b3-b824-def0b12f527b" status: 200 len: 1394 microversion: 2.1 time: 0.323092 Oct 04 19:01:22.256411 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 2999/6019] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:21 2022] GET /compute/v2.1/servers/12c4f942-479c-47b3-b824-def0b12f527b => generated 1394 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:22.494830 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1a14184b-f954-473b-bbef-daf9975009d2 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Action: 'create', calling method: .version_select at 0x7fe253b5fc10>, body: {"keypair": {"name": "tempest-keypair-1922494035", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIV6E8HfTkstDg+ni7aVV8JZoYlBWqL15sRco5KANxD5/1zjs5lJGQ4QRcdFmhoN2gZcSdKhwYRhLGWmf1OwskHhlW15OPU9CdQ/9dgQ/irRJMSD7rpNwqiNCfvM5fmEhA=="}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:01:22.512477 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-1a14184b-f954-473b-bbef-daf9975009d2 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Getting quotas for project 5dc67d8de57543c48bdf45669b684227. Resources: {'key_pairs'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:01:22.518322 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-1a14184b-f954-473b-bbef-daf9975009d2 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Getting quotas for user ce441ded6f554ec28560c75de97af173 and project 5dc67d8de57543c48bdf45669b684227. Resources: {'key_pairs'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:01:22.618114 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1a14184b-f954-473b-bbef-daf9975009d2 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.127259 Oct 04 19:01:22.630134 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3021/6020] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Oct 4 19:01:22 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:01:23.032404 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d1bac4a2-e174-4ee8-b241-1106e306e4a3 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:23.033728 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d1bac4a2-e174-4ee8-b241-1106e306e4a3 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] [instance: a3c2e8e3-d8c6-4185-93b7-df9dd21cf432] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:23.040458 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d1bac4a2-e174-4ee8-b241-1106e306e4a3 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:23.041084 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d1bac4a2-e174-4ee8-b241-1106e306e4a3 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:23.046596 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d1bac4a2-e174-4ee8-b241-1106e306e4a3 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:23.047732 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d1bac4a2-e174-4ee8-b241-1106e306e4a3 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:23.048370 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f896ba04-3a25-44ba-9595-589fb134df79 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:23.048600 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d1bac4a2-e174-4ee8-b241-1106e306e4a3 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:23.049195 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d1bac4a2-e174-4ee8-b241-1106e306e4a3 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:23.049633 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f896ba04-3a25-44ba-9595-589fb134df79 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:23.054223 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:01:23.061160 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f896ba04-3a25-44ba-9595-589fb134df79 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:23.061801 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f896ba04-3a25-44ba-9595-589fb134df79 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:23.062899 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f896ba04-3a25-44ba-9595-589fb134df79 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:23.065155 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f896ba04-3a25-44ba-9595-589fb134df79 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:23.065747 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f896ba04-3a25-44ba-9595-589fb134df79 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:23.069762 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f896ba04-3a25-44ba-9595-589fb134df79 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:23.157164 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d1bac4a2-e174-4ee8-b241-1106e306e4a3 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7fac7323441708be3f27945a92fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6844b3a51e4c2da1294e89517989c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:23.165281 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d1bac4a2-e174-4ee8-b241-1106e306e4a3 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] 10.222.0.20 "GET /compute/v2.1/servers/a3c2e8e3-d8c6-4185-93b7-df9dd21cf432" status: 200 len: 1271 microversion: 2.1 time: 0.142193 Oct 04 19:01:23.165857 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3000/6021] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:23 2022] GET /compute/v2.1/servers/a3c2e8e3-d8c6-4185-93b7-df9dd21cf432 => generated 1271 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:23.263308 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2735634b-5b3d-432e-a310-8fbb7f0e2a53 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:23.263934 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2735634b-5b3d-432e-a310-8fbb7f0e2a53 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 12c4f942-479c-47b3-b824-def0b12f527b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:23.274696 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2735634b-5b3d-432e-a310-8fbb7f0e2a53 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:23.275131 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2735634b-5b3d-432e-a310-8fbb7f0e2a53 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:23.275730 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2735634b-5b3d-432e-a310-8fbb7f0e2a53 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:23.276480 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2735634b-5b3d-432e-a310-8fbb7f0e2a53 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:23.276944 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2735634b-5b3d-432e-a310-8fbb7f0e2a53 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:23.277377 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2735634b-5b3d-432e-a310-8fbb7f0e2a53 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:23.436837 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f896ba04-3a25-44ba-9595-589fb134df79 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:23.445005 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f896ba04-3a25-44ba-9595-589fb134df79 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:23.447946 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f896ba04-3a25-44ba-9595-589fb134df79 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:23.465730 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f896ba04-3a25-44ba-9595-589fb134df79 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18" status: 200 len: 1807 microversion: 2.20 time: 0.412599 Oct 04 19:01:23.465730 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3022/6022] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:01:23 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 => generated 1807 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 19:01:23.600810 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2735634b-5b3d-432e-a310-8fbb7f0e2a53 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:23.616110 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2735634b-5b3d-432e-a310-8fbb7f0e2a53 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/12c4f942-479c-47b3-b824-def0b12f527b" status: 200 len: 1394 microversion: 2.1 time: 0.356818 Oct 04 19:01:23.632316 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3001/6023] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:23 2022] GET /compute/v2.1/servers/12c4f942-479c-47b3-b824-def0b12f527b => generated 1394 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:01:24.190588 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3ac428e1-b18c-465b-88d3-5f75f82398f6 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:24.190588 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3ac428e1-b18c-465b-88d3-5f75f82398f6 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] [instance: a3c2e8e3-d8c6-4185-93b7-df9dd21cf432] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:24.208996 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3ac428e1-b18c-465b-88d3-5f75f82398f6 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:24.209514 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3ac428e1-b18c-465b-88d3-5f75f82398f6 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:24.209968 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3ac428e1-b18c-465b-88d3-5f75f82398f6 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:24.210700 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3ac428e1-b18c-465b-88d3-5f75f82398f6 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:24.211171 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3ac428e1-b18c-465b-88d3-5f75f82398f6 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:24.211595 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3ac428e1-b18c-465b-88d3-5f75f82398f6 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:24.378348 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3ac428e1-b18c-465b-88d3-5f75f82398f6 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7fac7323441708be3f27945a92fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6844b3a51e4c2da1294e89517989c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:24.413621 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3ac428e1-b18c-465b-88d3-5f75f82398f6 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] 10.222.0.20 "GET /compute/v2.1/servers/a3c2e8e3-d8c6-4185-93b7-df9dd21cf432" status: 200 len: 1277 microversion: 2.1 time: 0.226030 Oct 04 19:01:24.418154 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3023/6024] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:24 2022] GET /compute/v2.1/servers/a3c2e8e3-d8c6-4185-93b7-df9dd21cf432 => generated 1277 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:24.491146 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-29e8df64-cbd3-4af3-994f-bc9f06e3044b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:24.492630 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-29e8df64-cbd3-4af3-994f-bc9f06e3044b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:24.503241 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-29e8df64-cbd3-4af3-994f-bc9f06e3044b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:24.505582 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-29e8df64-cbd3-4af3-994f-bc9f06e3044b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:24.505582 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-29e8df64-cbd3-4af3-994f-bc9f06e3044b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:24.505582 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-29e8df64-cbd3-4af3-994f-bc9f06e3044b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:24.506083 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-29e8df64-cbd3-4af3-994f-bc9f06e3044b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:24.506683 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-29e8df64-cbd3-4af3-994f-bc9f06e3044b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:24.640796 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-96dc434c-244f-485e-83fc-5aee0703edb3 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:24.641527 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-96dc434c-244f-485e-83fc-5aee0703edb3 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 12c4f942-479c-47b3-b824-def0b12f527b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:24.652345 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-96dc434c-244f-485e-83fc-5aee0703edb3 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:24.656944 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-96dc434c-244f-485e-83fc-5aee0703edb3 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:24.656944 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-96dc434c-244f-485e-83fc-5aee0703edb3 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:24.656944 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-96dc434c-244f-485e-83fc-5aee0703edb3 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:24.658388 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-96dc434c-244f-485e-83fc-5aee0703edb3 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:24.659067 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-96dc434c-244f-485e-83fc-5aee0703edb3 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:24.704203 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:01:24.744325 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-29e8df64-cbd3-4af3-994f-bc9f06e3044b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:24.762328 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-29e8df64-cbd3-4af3-994f-bc9f06e3044b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:24.768281 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-29e8df64-cbd3-4af3-994f-bc9f06e3044b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:24.771520 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-29e8df64-cbd3-4af3-994f-bc9f06e3044b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18" status: 200 len: 1807 microversion: 2.20 time: 0.282826 Oct 04 19:01:24.773964 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3002/6025] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:01:24 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 => generated 1807 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:01:24.875411 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-96dc434c-244f-485e-83fc-5aee0703edb3 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:24.889700 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-96dc434c-244f-485e-83fc-5aee0703edb3 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/12c4f942-479c-47b3-b824-def0b12f527b" status: 200 len: 1394 microversion: 2.1 time: 0.252978 Oct 04 19:01:24.892095 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3024/6026] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:24 2022] GET /compute/v2.1/servers/12c4f942-479c-47b3-b824-def0b12f527b => generated 1394 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:25.454732 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d376ff4c-98ed-4ab7-89d4-96198ad72bd4 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:25.460397 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d376ff4c-98ed-4ab7-89d4-96198ad72bd4 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] [instance: a3c2e8e3-d8c6-4185-93b7-df9dd21cf432] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:25.497187 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d376ff4c-98ed-4ab7-89d4-96198ad72bd4 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:25.502279 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d376ff4c-98ed-4ab7-89d4-96198ad72bd4 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:25.503190 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d376ff4c-98ed-4ab7-89d4-96198ad72bd4 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:25.504750 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d376ff4c-98ed-4ab7-89d4-96198ad72bd4 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:25.505441 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d376ff4c-98ed-4ab7-89d4-96198ad72bd4 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:25.506079 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d376ff4c-98ed-4ab7-89d4-96198ad72bd4 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:25.809521 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-48602a3f-bfa7-4ad6-acd8-688239935d2f tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:25.813642 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-48602a3f-bfa7-4ad6-acd8-688239935d2f tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:25.814853 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d376ff4c-98ed-4ab7-89d4-96198ad72bd4 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7fac7323441708be3f27945a92fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6844b3a51e4c2da1294e89517989c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:25.823671 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d376ff4c-98ed-4ab7-89d4-96198ad72bd4 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] 10.222.0.20 "GET /compute/v2.1/servers/a3c2e8e3-d8c6-4185-93b7-df9dd21cf432" status: 200 len: 1319 microversion: 2.1 time: 0.383990 Oct 04 19:01:25.824476 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3003/6027] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:25 2022] GET /compute/v2.1/servers/a3c2e8e3-d8c6-4185-93b7-df9dd21cf432 => generated 1319 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:25.832621 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-48602a3f-bfa7-4ad6-acd8-688239935d2f tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:25.833351 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-48602a3f-bfa7-4ad6-acd8-688239935d2f tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:25.833986 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-48602a3f-bfa7-4ad6-acd8-688239935d2f tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:25.834844 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-48602a3f-bfa7-4ad6-acd8-688239935d2f tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:25.835454 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-48602a3f-bfa7-4ad6-acd8-688239935d2f tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:25.836410 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-48602a3f-bfa7-4ad6-acd8-688239935d2f tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:25.924419 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c4bffc4c-5ec9-4df1-a8c9-4e80c274b8e2 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:25.925049 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c4bffc4c-5ec9-4df1-a8c9-4e80c274b8e2 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 12c4f942-479c-47b3-b824-def0b12f527b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:25.937373 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c4bffc4c-5ec9-4df1-a8c9-4e80c274b8e2 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:25.938059 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c4bffc4c-5ec9-4df1-a8c9-4e80c274b8e2 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:25.938590 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c4bffc4c-5ec9-4df1-a8c9-4e80c274b8e2 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:25.939331 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c4bffc4c-5ec9-4df1-a8c9-4e80c274b8e2 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:25.939790 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c4bffc4c-5ec9-4df1-a8c9-4e80c274b8e2 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:25.940259 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c4bffc4c-5ec9-4df1-a8c9-4e80c274b8e2 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:26.018818 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c4bffc4c-5ec9-4df1-a8c9-4e80c274b8e2 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:26.034624 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c4bffc4c-5ec9-4df1-a8c9-4e80c274b8e2 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/12c4f942-479c-47b3-b824-def0b12f527b" status: 200 len: 1352 microversion: 2.1 time: 0.119575 Oct 04 19:01:26.035777 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3004/6028] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:25 2022] GET /compute/v2.1/servers/12c4f942-479c-47b3-b824-def0b12f527b => generated 1352 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:26.065401 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-48602a3f-bfa7-4ad6-acd8-688239935d2f tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:26.075373 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-48602a3f-bfa7-4ad6-acd8-688239935d2f tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:26.083422 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-48602a3f-bfa7-4ad6-acd8-688239935d2f tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:26.084689 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-48602a3f-bfa7-4ad6-acd8-688239935d2f tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18" status: 200 len: 1807 microversion: 2.20 time: 0.283609 Oct 04 19:01:26.098117 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3025/6029] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:01:25 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 => generated 1807 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:01:26.192894 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-f315ea8a-270b-463b-8d6c-7d30dde950a5 req-c05c4ff1-c8b3-45a9-8993-50239bf45609 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12c4f942-479c-47b3-b824-def0b12f527b", "name": "network-vif-deleted", "tag": "e4977aed-cb1f-4e42-b534-b46ca871039f"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:01:26.228971 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-f315ea8a-270b-463b-8d6c-7d30dde950a5 req-c05c4ff1-c8b3-45a9-8993-50239bf45609 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:26.229946 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-f315ea8a-270b-463b-8d6c-7d30dde950a5 req-c05c4ff1-c8b3-45a9-8993-50239bf45609 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:26.230571 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-f315ea8a-270b-463b-8d6c-7d30dde950a5 req-c05c4ff1-c8b3-45a9-8993-50239bf45609 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:26.265500 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-f315ea8a-270b-463b-8d6c-7d30dde950a5 req-c05c4ff1-c8b3-45a9-8993-50239bf45609 service nova] Creating event network-vif-deleted:e4977aed-cb1f-4e42-b534-b46ca871039f for instance 12c4f942-479c-47b3-b824-def0b12f527b on n-h2-850501-14 Oct 04 19:01:26.282821 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-f315ea8a-270b-463b-8d6c-7d30dde950a5 req-c05c4ff1-c8b3-45a9-8993-50239bf45609 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085192 Oct 04 19:01:26.286220 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3005/6030] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:01:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:01:26.716333 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-3f5da41f-fade-4d94-8f73-5055ee4a9197 req-a8d6d695-b3b8-4eaf-bbcb-118e26d53ff0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3c2e8e3-d8c6-4185-93b7-df9dd21cf432", "tag": "364c2e17-3302-4355-9c8f-97a2d2ecce31"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:01:26.737743 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-3f5da41f-fade-4d94-8f73-5055ee4a9197 req-a8d6d695-b3b8-4eaf-bbcb-118e26d53ff0 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:26.740383 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-3f5da41f-fade-4d94-8f73-5055ee4a9197 req-a8d6d695-b3b8-4eaf-bbcb-118e26d53ff0 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:26.740958 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-3f5da41f-fade-4d94-8f73-5055ee4a9197 req-a8d6d695-b3b8-4eaf-bbcb-118e26d53ff0 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:26.760942 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-3f5da41f-fade-4d94-8f73-5055ee4a9197 req-a8d6d695-b3b8-4eaf-bbcb-118e26d53ff0 service nova] Creating event network-changed:364c2e17-3302-4355-9c8f-97a2d2ecce31 for instance a3c2e8e3-d8c6-4185-93b7-df9dd21cf432 on n-h1-850501-14 Oct 04 19:01:26.767339 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-3f5da41f-fade-4d94-8f73-5055ee4a9197 req-a8d6d695-b3b8-4eaf-bbcb-118e26d53ff0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057564 Oct 04 19:01:26.768780 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3026/6031] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:01:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:01:26.853636 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4d04a005-e2da-41a2-a7c7-dd73544fd507 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:26.854328 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4d04a005-e2da-41a2-a7c7-dd73544fd507 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] [instance: a3c2e8e3-d8c6-4185-93b7-df9dd21cf432] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:26.863178 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4d04a005-e2da-41a2-a7c7-dd73544fd507 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:26.877629 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4d04a005-e2da-41a2-a7c7-dd73544fd507 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:26.878663 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4d04a005-e2da-41a2-a7c7-dd73544fd507 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:26.880601 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4d04a005-e2da-41a2-a7c7-dd73544fd507 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:26.881340 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4d04a005-e2da-41a2-a7c7-dd73544fd507 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:26.882523 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4d04a005-e2da-41a2-a7c7-dd73544fd507 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:27.067640 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0b87f77e-96ca-4023-9244-43d9a5b165b1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:27.069396 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0b87f77e-96ca-4023-9244-43d9a5b165b1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 12c4f942-479c-47b3-b824-def0b12f527b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:27.073298 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:01:27.092472 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0b87f77e-96ca-4023-9244-43d9a5b165b1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:27.095403 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0b87f77e-96ca-4023-9244-43d9a5b165b1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:27.096775 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0b87f77e-96ca-4023-9244-43d9a5b165b1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:27.102311 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0b87f77e-96ca-4023-9244-43d9a5b165b1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:27.104027 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0b87f77e-96ca-4023-9244-43d9a5b165b1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:27.104737 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0b87f77e-96ca-4023-9244-43d9a5b165b1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:27.457894 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0b87f77e-96ca-4023-9244-43d9a5b165b1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:27.473532 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0b87f77e-96ca-4023-9244-43d9a5b165b1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/12c4f942-479c-47b3-b824-def0b12f527b" status: 200 len: 1187 microversion: 2.1 time: 0.416168 Oct 04 19:01:27.476006 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3027/6032] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:27 2022] GET /compute/v2.1/servers/12c4f942-479c-47b3-b824-def0b12f527b => generated 1187 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:27.496290 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8142f98a-fdbc-4531-b6a2-0e578b266af1 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:27.502186 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8142f98a-fdbc-4531-b6a2-0e578b266af1 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:27.517323 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8142f98a-fdbc-4531-b6a2-0e578b266af1 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:27.518219 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8142f98a-fdbc-4531-b6a2-0e578b266af1 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:27.518880 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8142f98a-fdbc-4531-b6a2-0e578b266af1 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:27.520862 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8142f98a-fdbc-4531-b6a2-0e578b266af1 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:27.521540 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8142f98a-fdbc-4531-b6a2-0e578b266af1 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:27.524186 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8142f98a-fdbc-4531-b6a2-0e578b266af1 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:27.791041 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4d04a005-e2da-41a2-a7c7-dd73544fd507 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7fac7323441708be3f27945a92fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6844b3a51e4c2da1294e89517989c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:27.807555 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4d04a005-e2da-41a2-a7c7-dd73544fd507 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] 10.222.0.20 "GET /compute/v2.1/servers/a3c2e8e3-d8c6-4185-93b7-df9dd21cf432" status: 200 len: 1319 microversion: 2.1 time: 0.956507 Oct 04 19:01:27.810921 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3006/6033] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:26 2022] GET /compute/v2.1/servers/a3c2e8e3-d8c6-4185-93b7-df9dd21cf432 => generated 1319 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:27.822306 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7cd20ab8-4cdc-44a5-aa04-9a7cc6b54087 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1669080869", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "32f1ab07-b252-4176-b7b8-3cc5be1795d8"}], "security_groups": [{"name": "tempest-securitygroup--2020145753"}], "key_name": "tempest-keypair-1922494035", "user_data": "}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:01:28.045578 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8142f98a-fdbc-4531-b6a2-0e578b266af1 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:28.070991 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8142f98a-fdbc-4531-b6a2-0e578b266af1 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:28.078417 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8142f98a-fdbc-4531-b6a2-0e578b266af1 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:28.082626 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8142f98a-fdbc-4531-b6a2-0e578b266af1 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18" status: 200 len: 1807 microversion: 2.20 time: 0.602440 Oct 04 19:01:28.084847 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3028/6034] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:01:27 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 => generated 1807 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:01:28.112787 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-7cd20ab8-4cdc-44a5-aa04-9a7cc6b54087 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] validate_networks() for [('32f1ab07-b252-4176-b7b8-3cc5be1795d8', None, None, None, None, None)] {{(pid=123002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:01:28.500035 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-feec80c6-6fd4-4253-b0a4-e97a81772427 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:28.500988 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-feec80c6-6fd4-4253-b0a4-e97a81772427 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 12c4f942-479c-47b3-b824-def0b12f527b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:28.513351 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-feec80c6-6fd4-4253-b0a4-e97a81772427 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:28.516606 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-feec80c6-6fd4-4253-b0a4-e97a81772427 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:28.519417 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-feec80c6-6fd4-4253-b0a4-e97a81772427 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:28.521967 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-feec80c6-6fd4-4253-b0a4-e97a81772427 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:28.522607 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-feec80c6-6fd4-4253-b0a4-e97a81772427 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:28.523196 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-feec80c6-6fd4-4253-b0a4-e97a81772427 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:28.737700 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-feec80c6-6fd4-4253-b0a4-e97a81772427 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:28.747712 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-feec80c6-6fd4-4253-b0a4-e97a81772427 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/12c4f942-479c-47b3-b824-def0b12f527b" status: 200 len: 1187 microversion: 2.1 time: 0.252490 Oct 04 19:01:28.748326 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3029/6035] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:28 2022] GET /compute/v2.1/servers/12c4f942-479c-47b3-b824-def0b12f527b => generated 1187 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:01:28.841795 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-363bd1f3-37e3-4c64-bc42-b1f77038d01c tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:28.845395 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-363bd1f3-37e3-4c64-bc42-b1f77038d01c tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] [instance: a3c2e8e3-d8c6-4185-93b7-df9dd21cf432] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:28.864005 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-363bd1f3-37e3-4c64-bc42-b1f77038d01c tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:28.865709 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-363bd1f3-37e3-4c64-bc42-b1f77038d01c tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:28.866259 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-363bd1f3-37e3-4c64-bc42-b1f77038d01c tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:28.867337 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-363bd1f3-37e3-4c64-bc42-b1f77038d01c tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:28.867920 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-363bd1f3-37e3-4c64-bc42-b1f77038d01c tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:28.868861 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-363bd1f3-37e3-4c64-bc42-b1f77038d01c tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:29.293139 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-363bd1f3-37e3-4c64-bc42-b1f77038d01c tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7fac7323441708be3f27945a92fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6844b3a51e4c2da1294e89517989c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:29.300750 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-363bd1f3-37e3-4c64-bc42-b1f77038d01c tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] 10.222.0.20 "GET /compute/v2.1/servers/a3c2e8e3-d8c6-4185-93b7-df9dd21cf432" status: 200 len: 1319 microversion: 2.1 time: 0.462807 Oct 04 19:01:29.301799 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3030/6036] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:28 2022] GET /compute/v2.1/servers/a3c2e8e3-d8c6-4185-93b7-df9dd21cf432 => generated 1319 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:29.306629 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-66ed33f4-1af4-4594-b07d-9579fc357e79 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:29.307385 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-66ed33f4-1af4-4594-b07d-9579fc357e79 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:29.317366 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-66ed33f4-1af4-4594-b07d-9579fc357e79 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:29.318075 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-66ed33f4-1af4-4594-b07d-9579fc357e79 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:29.318728 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-66ed33f4-1af4-4594-b07d-9579fc357e79 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:29.319917 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-66ed33f4-1af4-4594-b07d-9579fc357e79 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:29.320792 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-66ed33f4-1af4-4594-b07d-9579fc357e79 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:29.321532 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-66ed33f4-1af4-4594-b07d-9579fc357e79 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:29.355504 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-7cd20ab8-4cdc-44a5-aa04-9a7cc6b54087 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:01:29.357535 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-7cd20ab8-4cdc-44a5-aa04-9a7cc6b54087 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:01:29.358233 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-7cd20ab8-4cdc-44a5-aa04-9a7cc6b54087 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:01:29.358743 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-7cd20ab8-4cdc-44a5-aa04-9a7cc6b54087 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:01:29.359410 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-7cd20ab8-4cdc-44a5-aa04-9a7cc6b54087 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:01:29.370640 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7cd20ab8-4cdc-44a5-aa04-9a7cc6b54087 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:29.371285 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7cd20ab8-4cdc-44a5-aa04-9a7cc6b54087 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:29.371848 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7cd20ab8-4cdc-44a5-aa04-9a7cc6b54087 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:29.372850 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7cd20ab8-4cdc-44a5-aa04-9a7cc6b54087 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:29.373404 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7cd20ab8-4cdc-44a5-aa04-9a7cc6b54087 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:29.373931 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7cd20ab8-4cdc-44a5-aa04-9a7cc6b54087 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:29.394431 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-7cd20ab8-4cdc-44a5-aa04-9a7cc6b54087 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Getting quotas for project 5dc67d8de57543c48bdf45669b684227. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:01:29.403638 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-7cd20ab8-4cdc-44a5-aa04-9a7cc6b54087 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Getting quotas for user ce441ded6f554ec28560c75de97af173 and project 5dc67d8de57543c48bdf45669b684227. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:01:29.419622 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7cd20ab8-4cdc-44a5-aa04-9a7cc6b54087 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Going to run 1 instances... {{(pid=123002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:01:29.426241 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7cd20ab8-4cdc-44a5-aa04-9a7cc6b54087 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: 6860257c-9998-4117-8aa4-b08bd2f8dc28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:01:29.551425 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-66ed33f4-1af4-4594-b07d-9579fc357e79 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:29.560814 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:01:29.565587 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-66ed33f4-1af4-4594-b07d-9579fc357e79 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:29.573724 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-66ed33f4-1af4-4594-b07d-9579fc357e79 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:29.575047 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-66ed33f4-1af4-4594-b07d-9579fc357e79 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18" status: 200 len: 1807 microversion: 2.20 time: 0.272060 Oct 04 19:01:29.575695 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3031/6037] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:01:29 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 => generated 1807 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:01:29.674474 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7cd20ab8-4cdc-44a5-aa04-9a7cc6b54087 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.862128 Oct 04 19:01:29.678223 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3007/6038] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 19:01:27 2022] POST /compute/v2.1/servers => generated 402 bytes in 1867 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:01:29.690078 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e7eeef63-4efe-4cd9-a42a-89f53d058c5b tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:29.690947 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e7eeef63-4efe-4cd9-a42a-89f53d058c5b tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: 6860257c-9998-4117-8aa4-b08bd2f8dc28] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:29.693689 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:01:29.777487 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c7c06584-600d-4167-a8ea-7522497d9735 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:29.778165 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c7c06584-600d-4167-a8ea-7522497d9735 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 12c4f942-479c-47b3-b824-def0b12f527b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:29.791363 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e7eeef63-4efe-4cd9-a42a-89f53d058c5b tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce441ded6f554ec28560c75de97af173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc67d8de57543c48bdf45669b684227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:29.797375 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e7eeef63-4efe-4cd9-a42a-89f53d058c5b tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/6860257c-9998-4117-8aa4-b08bd2f8dc28" status: 200 len: 1242 microversion: 2.1 time: 0.111488 Oct 04 19:01:29.798939 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3032/6039] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:29 2022] GET /compute/v2.1/servers/6860257c-9998-4117-8aa4-b08bd2f8dc28 => generated 1242 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:29.805077 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c7c06584-600d-4167-a8ea-7522497d9735 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:29.805585 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c7c06584-600d-4167-a8ea-7522497d9735 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:29.806025 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c7c06584-600d-4167-a8ea-7522497d9735 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:29.806738 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c7c06584-600d-4167-a8ea-7522497d9735 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:29.807574 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c7c06584-600d-4167-a8ea-7522497d9735 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:29.809894 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c7c06584-600d-4167-a8ea-7522497d9735 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:29.910570 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c7c06584-600d-4167-a8ea-7522497d9735 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:29.936872 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c7c06584-600d-4167-a8ea-7522497d9735 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/12c4f942-479c-47b3-b824-def0b12f527b" status: 200 len: 1187 microversion: 2.1 time: 0.168171 Oct 04 19:01:29.938855 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3008/6040] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:29 2022] GET /compute/v2.1/servers/12c4f942-479c-47b3-b824-def0b12f527b => generated 1187 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:30.326334 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-83889166-f66c-422a-ac96-cde4e3fa5f51 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:30.326967 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-83889166-f66c-422a-ac96-cde4e3fa5f51 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] [instance: a3c2e8e3-d8c6-4185-93b7-df9dd21cf432] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:30.336151 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-83889166-f66c-422a-ac96-cde4e3fa5f51 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:30.336893 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-83889166-f66c-422a-ac96-cde4e3fa5f51 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:30.337598 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-83889166-f66c-422a-ac96-cde4e3fa5f51 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:30.338749 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-83889166-f66c-422a-ac96-cde4e3fa5f51 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:30.339377 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-83889166-f66c-422a-ac96-cde4e3fa5f51 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:30.339958 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-83889166-f66c-422a-ac96-cde4e3fa5f51 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:30.564457 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-83889166-f66c-422a-ac96-cde4e3fa5f51 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7fac7323441708be3f27945a92fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6844b3a51e4c2da1294e89517989c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:30.572545 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-83889166-f66c-422a-ac96-cde4e3fa5f51 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] 10.222.0.20 "GET /compute/v2.1/servers/a3c2e8e3-d8c6-4185-93b7-df9dd21cf432" status: 200 len: 1319 microversion: 2.1 time: 0.250688 Oct 04 19:01:30.575402 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3033/6041] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:30 2022] GET /compute/v2.1/servers/a3c2e8e3-d8c6-4185-93b7-df9dd21cf432 => generated 1319 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:30.606791 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8fc1e5b8-76ca-48f0-ae17-e608e7d6fe89 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:30.607784 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8fc1e5b8-76ca-48f0-ae17-e608e7d6fe89 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:30.623323 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8fc1e5b8-76ca-48f0-ae17-e608e7d6fe89 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:30.624047 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8fc1e5b8-76ca-48f0-ae17-e608e7d6fe89 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:30.626914 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8fc1e5b8-76ca-48f0-ae17-e608e7d6fe89 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:30.627883 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8fc1e5b8-76ca-48f0-ae17-e608e7d6fe89 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:30.628388 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8fc1e5b8-76ca-48f0-ae17-e608e7d6fe89 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:30.631442 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8fc1e5b8-76ca-48f0-ae17-e608e7d6fe89 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:30.825802 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8c5a7d2f-9f61-4060-8016-ececd162c319 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:30.826263 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8c5a7d2f-9f61-4060-8016-ececd162c319 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: 6860257c-9998-4117-8aa4-b08bd2f8dc28] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:30.934597 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8fc1e5b8-76ca-48f0-ae17-e608e7d6fe89 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:30.934834 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8c5a7d2f-9f61-4060-8016-ececd162c319 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce441ded6f554ec28560c75de97af173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc67d8de57543c48bdf45669b684227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:30.944892 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8c5a7d2f-9f61-4060-8016-ececd162c319 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/6860257c-9998-4117-8aa4-b08bd2f8dc28" status: 200 len: 1242 microversion: 2.1 time: 0.125342 Oct 04 19:01:30.946599 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3034/6042] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:30 2022] GET /compute/v2.1/servers/6860257c-9998-4117-8aa4-b08bd2f8dc28 => generated 1242 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:01:30.950473 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8fc1e5b8-76ca-48f0-ae17-e608e7d6fe89 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:30.952205 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8fc1e5b8-76ca-48f0-ae17-e608e7d6fe89 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:30.954232 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8fc1e5b8-76ca-48f0-ae17-e608e7d6fe89 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18" status: 200 len: 1807 microversion: 2.20 time: 0.351618 Oct 04 19:01:30.961570 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3285d43c-8df7-43b5-a1ee-9378c76d804f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:30.962199 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3285d43c-8df7-43b5-a1ee-9378c76d804f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 12c4f942-479c-47b3-b824-def0b12f527b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:30.965846 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3009/6043] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:01:30 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 => generated 1807 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:01:30.969838 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3285d43c-8df7-43b5-a1ee-9378c76d804f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:30.970794 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3285d43c-8df7-43b5-a1ee-9378c76d804f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:30.971459 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3285d43c-8df7-43b5-a1ee-9378c76d804f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:30.972423 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3285d43c-8df7-43b5-a1ee-9378c76d804f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:30.973240 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3285d43c-8df7-43b5-a1ee-9378c76d804f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:30.973947 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3285d43c-8df7-43b5-a1ee-9378c76d804f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:31.091282 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3285d43c-8df7-43b5-a1ee-9378c76d804f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:31.105484 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3285d43c-8df7-43b5-a1ee-9378c76d804f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/12c4f942-479c-47b3-b824-def0b12f527b" status: 200 len: 1187 microversion: 2.1 time: 0.147965 Oct 04 19:01:31.121198 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3035/6044] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:30 2022] GET /compute/v2.1/servers/12c4f942-479c-47b3-b824-def0b12f527b => generated 1187 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:01:31.595702 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ebcc738c-8a47-469a-b852-cd85cdf991a0 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:31.596643 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ebcc738c-8a47-469a-b852-cd85cdf991a0 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] [instance: a3c2e8e3-d8c6-4185-93b7-df9dd21cf432] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:31.604854 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ebcc738c-8a47-469a-b852-cd85cdf991a0 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:31.604854 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ebcc738c-8a47-469a-b852-cd85cdf991a0 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:31.604854 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ebcc738c-8a47-469a-b852-cd85cdf991a0 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:31.605636 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ebcc738c-8a47-469a-b852-cd85cdf991a0 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:31.606103 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ebcc738c-8a47-469a-b852-cd85cdf991a0 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:31.606539 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ebcc738c-8a47-469a-b852-cd85cdf991a0 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:31.975169 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3d8d77ea-5e89-4626-82ca-cebf4ba0215d tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:31.979692 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3d8d77ea-5e89-4626-82ca-cebf4ba0215d tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: 6860257c-9998-4117-8aa4-b08bd2f8dc28] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:31.990154 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3d8d77ea-5e89-4626-82ca-cebf4ba0215d tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:31.990649 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3d8d77ea-5e89-4626-82ca-cebf4ba0215d tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:31.991097 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3d8d77ea-5e89-4626-82ca-cebf4ba0215d tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:31.991832 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3d8d77ea-5e89-4626-82ca-cebf4ba0215d tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:31.992573 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3d8d77ea-5e89-4626-82ca-cebf4ba0215d tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:31.993017 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3d8d77ea-5e89-4626-82ca-cebf4ba0215d tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:32.185587 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ebcc738c-8a47-469a-b852-cd85cdf991a0 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7fac7323441708be3f27945a92fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6844b3a51e4c2da1294e89517989c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:32.194351 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ebcc738c-8a47-469a-b852-cd85cdf991a0 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] 10.222.0.20 "GET /compute/v2.1/servers/a3c2e8e3-d8c6-4185-93b7-df9dd21cf432" status: 200 len: 1319 microversion: 2.1 time: 0.603109 Oct 04 19:01:32.194956 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3010/6045] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:31 2022] GET /compute/v2.1/servers/a3c2e8e3-d8c6-4185-93b7-df9dd21cf432 => generated 1319 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:01:32.207432 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3d8d77ea-5e89-4626-82ca-cebf4ba0215d tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce441ded6f554ec28560c75de97af173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc67d8de57543c48bdf45669b684227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:32.213811 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4b8d5895-f518-4b82-9d11-2cb6bf651e45 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:32.214469 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4b8d5895-f518-4b82-9d11-2cb6bf651e45 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:32.222767 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4b8d5895-f518-4b82-9d11-2cb6bf651e45 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:32.223265 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4b8d5895-f518-4b82-9d11-2cb6bf651e45 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:32.223700 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4b8d5895-f518-4b82-9d11-2cb6bf651e45 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:32.226820 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4b8d5895-f518-4b82-9d11-2cb6bf651e45 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:32.226949 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3d8d77ea-5e89-4626-82ca-cebf4ba0215d tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/6860257c-9998-4117-8aa4-b08bd2f8dc28" status: 200 len: 1294 microversion: 2.1 time: 0.253913 Oct 04 19:01:32.227059 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4b8d5895-f518-4b82-9d11-2cb6bf651e45 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:32.227059 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4b8d5895-f518-4b82-9d11-2cb6bf651e45 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:32.227236 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3036/6046] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:31 2022] GET /compute/v2.1/servers/6860257c-9998-4117-8aa4-b08bd2f8dc28 => generated 1294 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:32.235442 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-26c6e7e4-cead-4503-b976-ddeaf03f181e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:32.236532 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-26c6e7e4-cead-4503-b976-ddeaf03f181e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 12c4f942-479c-47b3-b824-def0b12f527b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:32.244376 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-26c6e7e4-cead-4503-b976-ddeaf03f181e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:32.245157 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-26c6e7e4-cead-4503-b976-ddeaf03f181e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:32.250258 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-26c6e7e4-cead-4503-b976-ddeaf03f181e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:32.250258 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-26c6e7e4-cead-4503-b976-ddeaf03f181e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:32.250258 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-26c6e7e4-cead-4503-b976-ddeaf03f181e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:32.250258 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-26c6e7e4-cead-4503-b976-ddeaf03f181e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:32.387100 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-26c6e7e4-cead-4503-b976-ddeaf03f181e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:32.399651 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-26c6e7e4-cead-4503-b976-ddeaf03f181e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/12c4f942-479c-47b3-b824-def0b12f527b" status: 200 len: 1187 microversion: 2.1 time: 0.172615 Oct 04 19:01:32.400522 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3037/6047] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:32 2022] GET /compute/v2.1/servers/12c4f942-479c-47b3-b824-def0b12f527b => generated 1187 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:32.503338 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4b8d5895-f518-4b82-9d11-2cb6bf651e45 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:32.513497 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4b8d5895-f518-4b82-9d11-2cb6bf651e45 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:32.515940 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4b8d5895-f518-4b82-9d11-2cb6bf651e45 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:32.517708 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4b8d5895-f518-4b82-9d11-2cb6bf651e45 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18" status: 200 len: 1807 microversion: 2.20 time: 0.308401 Oct 04 19:01:32.518531 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3011/6048] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:01:32 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 => generated 1807 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:01:33.248829 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c82d43db-a424-492e-b9ef-cae69db5c1b3 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:33.249590 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c82d43db-a424-492e-b9ef-cae69db5c1b3 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: 6860257c-9998-4117-8aa4-b08bd2f8dc28] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:33.264526 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c82d43db-a424-492e-b9ef-cae69db5c1b3 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:33.269149 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c82d43db-a424-492e-b9ef-cae69db5c1b3 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:33.269837 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c82d43db-a424-492e-b9ef-cae69db5c1b3 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:33.270782 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c82d43db-a424-492e-b9ef-cae69db5c1b3 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:33.271401 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c82d43db-a424-492e-b9ef-cae69db5c1b3 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:33.272014 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c82d43db-a424-492e-b9ef-cae69db5c1b3 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:33.458437 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c82d43db-a424-492e-b9ef-cae69db5c1b3 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce441ded6f554ec28560c75de97af173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc67d8de57543c48bdf45669b684227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:33.467647 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c82d43db-a424-492e-b9ef-cae69db5c1b3 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/6860257c-9998-4117-8aa4-b08bd2f8dc28" status: 200 len: 1294 microversion: 2.1 time: 0.222867 Oct 04 19:01:33.478445 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3012/6049] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:33 2022] GET /compute/v2.1/servers/6860257c-9998-4117-8aa4-b08bd2f8dc28 => generated 1294 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:01:33.496231 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4bf39621-d2e7-4fd3-9fa4-507722a39a05 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:33.497146 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4bf39621-d2e7-4fd3-9fa4-507722a39a05 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 12c4f942-479c-47b3-b824-def0b12f527b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:33.506268 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4bf39621-d2e7-4fd3-9fa4-507722a39a05 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:33.507081 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4bf39621-d2e7-4fd3-9fa4-507722a39a05 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:33.507732 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4bf39621-d2e7-4fd3-9fa4-507722a39a05 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:33.508649 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4bf39621-d2e7-4fd3-9fa4-507722a39a05 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:33.509270 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4bf39621-d2e7-4fd3-9fa4-507722a39a05 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:33.509860 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4bf39621-d2e7-4fd3-9fa4-507722a39a05 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:33.555783 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4bf39621-d2e7-4fd3-9fa4-507722a39a05 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:33.556598 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4bf39621-d2e7-4fd3-9fa4-507722a39a05 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:33.557451 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4bf39621-d2e7-4fd3-9fa4-507722a39a05 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:33.558082 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-4bf39621-d2e7-4fd3-9fa4-507722a39a05 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lazy-loading 'fault' on Instance uuid 12c4f942-479c-47b3-b824-def0b12f527b {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:01:33.568895 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-534c9561-450c-4841-9a08-3b8e1cdbff14 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:33.571004 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-534c9561-450c-4841-9a08-3b8e1cdbff14 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] [instance: a3c2e8e3-d8c6-4185-93b7-df9dd21cf432] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:33.585573 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-534c9561-450c-4841-9a08-3b8e1cdbff14 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:33.587038 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-534c9561-450c-4841-9a08-3b8e1cdbff14 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:33.587826 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-534c9561-450c-4841-9a08-3b8e1cdbff14 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:33.588944 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-534c9561-450c-4841-9a08-3b8e1cdbff14 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:33.589757 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-534c9561-450c-4841-9a08-3b8e1cdbff14 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:33.593790 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-534c9561-450c-4841-9a08-3b8e1cdbff14 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:33.714856 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4bf39621-d2e7-4fd3-9fa4-507722a39a05 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:33.727625 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4bf39621-d2e7-4fd3-9fa4-507722a39a05 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/12c4f942-479c-47b3-b824-def0b12f527b" status: 200 len: 1192 microversion: 2.1 time: 0.246194 Oct 04 19:01:33.728709 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3013/6050] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:33 2022] GET /compute/v2.1/servers/12c4f942-479c-47b3-b824-def0b12f527b => generated 1192 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:33.757042 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5a452f30-c41b-4e6e-b5f8-9f64ee378f9e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:33.760897 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5a452f30-c41b-4e6e-b5f8-9f64ee378f9e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:33.772532 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5a452f30-c41b-4e6e-b5f8-9f64ee378f9e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:33.775691 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5a452f30-c41b-4e6e-b5f8-9f64ee378f9e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:33.776365 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5a452f30-c41b-4e6e-b5f8-9f64ee378f9e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:33.779577 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5a452f30-c41b-4e6e-b5f8-9f64ee378f9e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:33.780280 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5a452f30-c41b-4e6e-b5f8-9f64ee378f9e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:33.782042 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5a452f30-c41b-4e6e-b5f8-9f64ee378f9e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:34.113468 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-534c9561-450c-4841-9a08-3b8e1cdbff14 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7fac7323441708be3f27945a92fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6844b3a51e4c2da1294e89517989c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:34.123570 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-534c9561-450c-4841-9a08-3b8e1cdbff14 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] 10.222.0.20 "GET /compute/v2.1/servers/a3c2e8e3-d8c6-4185-93b7-df9dd21cf432" status: 200 len: 1319 microversion: 2.1 time: 0.903963 Oct 04 19:01:34.126445 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3038/6051] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:33 2022] GET /compute/v2.1/servers/a3c2e8e3-d8c6-4185-93b7-df9dd21cf432 => generated 1319 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:34.138832 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-e8737553-49f5-4d7d-9a89-a83b18f303c1 req-c16f067a-e323-4a35-a676-15b2c9ae55fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3c2e8e3-d8c6-4185-93b7-df9dd21cf432", "name": "network-vif-plugged", "status": "completed", "tag": "364c2e17-3302-4355-9c8f-97a2d2ecce31"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:01:34.162008 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-e8737553-49f5-4d7d-9a89-a83b18f303c1 req-c16f067a-e323-4a35-a676-15b2c9ae55fd service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:34.162480 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-e8737553-49f5-4d7d-9a89-a83b18f303c1 req-c16f067a-e323-4a35-a676-15b2c9ae55fd service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:34.162914 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-e8737553-49f5-4d7d-9a89-a83b18f303c1 req-c16f067a-e323-4a35-a676-15b2c9ae55fd service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:34.185868 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-e8737553-49f5-4d7d-9a89-a83b18f303c1 req-c16f067a-e323-4a35-a676-15b2c9ae55fd service nova] Creating event network-vif-plugged:364c2e17-3302-4355-9c8f-97a2d2ecce31 for instance a3c2e8e3-d8c6-4185-93b7-df9dd21cf432 on n-h1-850501-14 Oct 04 19:01:34.193874 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-e8737553-49f5-4d7d-9a89-a83b18f303c1 req-c16f067a-e323-4a35-a676-15b2c9ae55fd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064076 Oct 04 19:01:34.195070 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3039/6052] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:01:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:01:34.507134 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5e3a377b-a792-4cff-8b95-515fa22e25bc tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:34.512179 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5e3a377b-a792-4cff-8b95-515fa22e25bc tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: 6860257c-9998-4117-8aa4-b08bd2f8dc28] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:34.529908 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5e3a377b-a792-4cff-8b95-515fa22e25bc tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:34.533465 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5e3a377b-a792-4cff-8b95-515fa22e25bc tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:34.534815 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5e3a377b-a792-4cff-8b95-515fa22e25bc tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:34.536166 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5e3a377b-a792-4cff-8b95-515fa22e25bc tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:34.539833 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5e3a377b-a792-4cff-8b95-515fa22e25bc tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:34.539833 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5e3a377b-a792-4cff-8b95-515fa22e25bc tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:34.701103 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5a452f30-c41b-4e6e-b5f8-9f64ee378f9e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:34.711944 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5a452f30-c41b-4e6e-b5f8-9f64ee378f9e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:34.717936 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5a452f30-c41b-4e6e-b5f8-9f64ee378f9e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:34.723067 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5a452f30-c41b-4e6e-b5f8-9f64ee378f9e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18" status: 200 len: 1807 microversion: 2.20 time: 0.973349 Oct 04 19:01:34.724746 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3014/6053] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:01:33 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 => generated 1807 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:01:34.757574 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7083fdd0-4417-456f-b78c-cc7fdb163f57 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:34.759091 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7083fdd0-4417-456f-b78c-cc7fdb163f57 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 12c4f942-479c-47b3-b824-def0b12f527b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:34.779152 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7083fdd0-4417-456f-b78c-cc7fdb163f57 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:34.779787 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7083fdd0-4417-456f-b78c-cc7fdb163f57 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:34.780366 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7083fdd0-4417-456f-b78c-cc7fdb163f57 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:34.782490 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7083fdd0-4417-456f-b78c-cc7fdb163f57 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:34.783082 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7083fdd0-4417-456f-b78c-cc7fdb163f57 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:34.784746 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7083fdd0-4417-456f-b78c-cc7fdb163f57 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:34.816917 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-7083fdd0-4417-456f-b78c-cc7fdb163f57 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] HTTP exception thrown: Instance 12c4f942-479c-47b3-b824-def0b12f527b could not be found. Oct 04 19:01:34.818569 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5e3a377b-a792-4cff-8b95-515fa22e25bc tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce441ded6f554ec28560c75de97af173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc67d8de57543c48bdf45669b684227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:34.822649 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7083fdd0-4417-456f-b78c-cc7fdb163f57 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Request method failure captured: Oct 04 19:01:34.822649 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/12c4f942-479c-47b3-b824-def0b12f527b HTTP/1.1 Oct 04 19:01:34.822649 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 19:01:34.822649 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 19:01:34.822649 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 19:01:34.822649 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 19:01:34.822649 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 19:01:34.822649 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 19:01:34.822649 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 19:01:34.822649 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 19:01:34.822649 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPIJ4KptPiy5XyaUYG9pLSP7TnMEf-PY7yFvjaPGmW4DAHqC1kasy1bm5to10RwAF_dSHQb87b5amqQ9ZUna6URZpq6M0BGpvwENg84W1HvOZfHgDXT7E6YYTtPhmcCZbmf-MEJzIKVI741HwGnmdHx846U9v3mpOw6zsk7UNEsUijp4 Oct 04 19:01:34.822649 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 19:01:34.822649 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 19:01:34.822649 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 19:01:34.822649 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 19:01:34.822649 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 19:01:34.822649 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 19:01:34.822649 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 82d0cd3db371459db429cb770abde738 Oct 04 19:01:34.822649 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-TestVolumeBootPattern-1621879949 Oct 04 19:01:34.822649 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 19:01:34.822649 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 19:01:34.822649 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/82d0cd3db371459db429cb770abde738"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_82d0cd3db371459db429cb770abde738", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/82d0cd3db371459db429cb770abde738"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/82d0cd3db371459db429cb770abde738"}]}] Oct 04 19:01:34.822649 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-TestVolumeBootPattern-1621879949 Oct 04 19:01:34.822649 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 82d0cd3db371459db429cb770abde738 Oct 04 19:01:34.822649 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-TestVolumeBootPattern-1621879949 Oct 04 19:01:34.822649 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-TestVolumeBootPattern-1621879949-project Oct 04 19:01:34.822649 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 19:01:34.822649 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 19:01:34.822649 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: a65ae9c3fb3c46a2a393fe21ce21b9d4 Oct 04 19:01:34.822649 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-TestVolumeBootPattern-1621879949-project Oct 04 19:01:34.822649 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 19:01:34.822649 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 12c4f942-479c-47b3-b824-def0b12f527b could not be found. Oct 04 19:01:34.822649 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '12c4f942-479c-47b3-b824-def0b12f527b'} Oct 04 19:01:34.822649 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:01:34.822649 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:01:34.822649 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:01:34.822649 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:01:34.822649 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:01:34.822649 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:01:34.822649 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:01:34.822649 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:01:34.822649 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:01:34.822649 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:01:34.822649 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12c4f942-479c-47b3-b824-def0b12f527b could not be found. Oct 04 19:01:34.822649 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:01:34.822649 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:01:34.822649 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:01:34.822649 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:01:34.822649 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:01:34.822649 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:01:34.822649 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:01:34.822649 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:01:34.822649 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:01:34.822649 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:01:34.822649 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:01:34.822649 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:01:34.822649 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:01:34.822649 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:01:34.822649 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:01:34.822649 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:01:34.822649 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12c4f942-479c-47b3-b824-def0b12f527b could not be found. Oct 04 19:01:34.822649 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:01:34.822649 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:01:34.822649 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:01:34.827243 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:01:34.827243 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:01:34.827243 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:01:34.827243 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:01:34.827243 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:01:34.827243 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12c4f942-479c-47b3-b824-def0b12f527b could not be found. Oct 04 19:01:34.827243 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:01:34.827243 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7083fdd0-4417-456f-b78c-cc7fdb163f57 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Returning 404 to user: Instance 12c4f942-479c-47b3-b824-def0b12f527b could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:01:34.827243 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7083fdd0-4417-456f-b78c-cc7fdb163f57 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/12c4f942-479c-47b3-b824-def0b12f527b" status: 404 len: 111 microversion: 2.1 time: 0.073784 Oct 04 19:01:34.828592 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3015/6054] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:34 2022] GET /compute/v2.1/servers/12c4f942-479c-47b3-b824-def0b12f527b => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:01:34.854537 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5e3a377b-a792-4cff-8b95-515fa22e25bc tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/6860257c-9998-4117-8aa4-b08bd2f8dc28" status: 200 len: 1300 microversion: 2.1 time: 0.352037 Oct 04 19:01:34.864460 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3040/6055] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:34 2022] GET /compute/v2.1/servers/6860257c-9998-4117-8aa4-b08bd2f8dc28 => generated 1300 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:35.162868 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6cabe275-0678-419b-8cd2-0a484caf1af8 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:35.164855 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-6cabe275-0678-419b-8cd2-0a484caf1af8 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] [instance: a3c2e8e3-d8c6-4185-93b7-df9dd21cf432] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:35.189095 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6cabe275-0678-419b-8cd2-0a484caf1af8 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:35.189872 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6cabe275-0678-419b-8cd2-0a484caf1af8 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:35.190583 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6cabe275-0678-419b-8cd2-0a484caf1af8 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:35.191584 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6cabe275-0678-419b-8cd2-0a484caf1af8 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:35.202034 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6cabe275-0678-419b-8cd2-0a484caf1af8 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:35.202612 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6cabe275-0678-419b-8cd2-0a484caf1af8 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:35.549709 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-6cabe275-0678-419b-8cd2-0a484caf1af8 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7fac7323441708be3f27945a92fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6844b3a51e4c2da1294e89517989c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:35.558717 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6cabe275-0678-419b-8cd2-0a484caf1af8 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] 10.222.0.20 "GET /compute/v2.1/servers/a3c2e8e3-d8c6-4185-93b7-df9dd21cf432" status: 200 len: 1319 microversion: 2.1 time: 0.410662 Oct 04 19:01:35.561619 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3016/6056] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:35 2022] GET /compute/v2.1/servers/a3c2e8e3-d8c6-4185-93b7-df9dd21cf432 => generated 1319 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:35.754171 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6cbf7229-9257-4524-a73a-4d2b12ac7a36 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:35.754957 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6cbf7229-9257-4524-a73a-4d2b12ac7a36 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:35.776884 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6cbf7229-9257-4524-a73a-4d2b12ac7a36 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:35.777774 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6cbf7229-9257-4524-a73a-4d2b12ac7a36 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:35.778417 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6cbf7229-9257-4524-a73a-4d2b12ac7a36 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:35.779345 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6cbf7229-9257-4524-a73a-4d2b12ac7a36 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:35.780003 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6cbf7229-9257-4524-a73a-4d2b12ac7a36 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:35.780727 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6cbf7229-9257-4524-a73a-4d2b12ac7a36 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:35.881874 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-cb82b72d-39da-4dc8-8c26-cbf75ae41e7d tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:35.887846 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-cb82b72d-39da-4dc8-8c26-cbf75ae41e7d tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: 6860257c-9998-4117-8aa4-b08bd2f8dc28] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:35.902259 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cb82b72d-39da-4dc8-8c26-cbf75ae41e7d tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:35.912999 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cb82b72d-39da-4dc8-8c26-cbf75ae41e7d tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:35.912999 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cb82b72d-39da-4dc8-8c26-cbf75ae41e7d tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:35.912999 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cb82b72d-39da-4dc8-8c26-cbf75ae41e7d tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:35.912999 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cb82b72d-39da-4dc8-8c26-cbf75ae41e7d tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:35.912999 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cb82b72d-39da-4dc8-8c26-cbf75ae41e7d tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:36.088478 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6cbf7229-9257-4524-a73a-4d2b12ac7a36 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:36.109269 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6cbf7229-9257-4524-a73a-4d2b12ac7a36 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:36.112909 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6cbf7229-9257-4524-a73a-4d2b12ac7a36 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:36.114292 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6cbf7229-9257-4524-a73a-4d2b12ac7a36 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18" status: 200 len: 1807 microversion: 2.20 time: 0.364073 Oct 04 19:01:36.118198 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3041/6057] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:01:35 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 => generated 1807 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:01:36.211699 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-cb82b72d-39da-4dc8-8c26-cbf75ae41e7d tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce441ded6f554ec28560c75de97af173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc67d8de57543c48bdf45669b684227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:36.225119 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-cb82b72d-39da-4dc8-8c26-cbf75ae41e7d tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/6860257c-9998-4117-8aa4-b08bd2f8dc28" status: 200 len: 1368 microversion: 2.1 time: 0.345694 Oct 04 19:01:36.226104 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3017/6058] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:35 2022] GET /compute/v2.1/servers/6860257c-9998-4117-8aa4-b08bd2f8dc28 => generated 1368 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:36.590258 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-28d6bb92-f77b-4cc8-81ba-d2d657c4aaee tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:36.590895 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-28d6bb92-f77b-4cc8-81ba-d2d657c4aaee tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] [instance: a3c2e8e3-d8c6-4185-93b7-df9dd21cf432] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:36.597964 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-28d6bb92-f77b-4cc8-81ba-d2d657c4aaee tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:36.598464 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-28d6bb92-f77b-4cc8-81ba-d2d657c4aaee tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:36.599098 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-28d6bb92-f77b-4cc8-81ba-d2d657c4aaee tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:36.600233 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-28d6bb92-f77b-4cc8-81ba-d2d657c4aaee tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:36.600886 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-28d6bb92-f77b-4cc8-81ba-d2d657c4aaee tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:36.604665 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-28d6bb92-f77b-4cc8-81ba-d2d657c4aaee tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:36.827642 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-28d6bb92-f77b-4cc8-81ba-d2d657c4aaee tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7fac7323441708be3f27945a92fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6844b3a51e4c2da1294e89517989c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:36.836206 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-28d6bb92-f77b-4cc8-81ba-d2d657c4aaee tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] 10.222.0.20 "GET /compute/v2.1/servers/a3c2e8e3-d8c6-4185-93b7-df9dd21cf432" status: 200 len: 1508 microversion: 2.1 time: 0.250265 Oct 04 19:01:36.840919 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3042/6059] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:36 2022] GET /compute/v2.1/servers/a3c2e8e3-d8c6-4185-93b7-df9dd21cf432 => generated 1508 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:36.845000 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-0b736302-c83b-4c04-9e06-6af67bec7210 req-278a5348-00f2-4414-96ae-43c9ad3cbab0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b882133-2fca-4df4-b228-46a12f538c18", "name": "network-vif-plugged", "status": "completed", "tag": "1f37fede-c1b1-491b-bab1-5ad8cb57086e"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:01:36.868360 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-0b736302-c83b-4c04-9e06-6af67bec7210 req-278a5348-00f2-4414-96ae-43c9ad3cbab0 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:36.869363 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-11381e96-ee28-4f82-a392-929179722e50 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2121aae9-f053-4463-9a4e-6845b3b07a1b", "device": "/dev/sdb"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:01:36.870149 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-0b736302-c83b-4c04-9e06-6af67bec7210 req-278a5348-00f2-4414-96ae-43c9ad3cbab0 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:36.871489 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-0b736302-c83b-4c04-9e06-6af67bec7210 req-278a5348-00f2-4414-96ae-43c9ad3cbab0 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:36.872907 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-11381e96-ee28-4f82-a392-929179722e50 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] [instance: a3c2e8e3-d8c6-4185-93b7-df9dd21cf432] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:36.885899 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-11381e96-ee28-4f82-a392-929179722e50 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:36.886554 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-11381e96-ee28-4f82-a392-929179722e50 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:36.887246 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-11381e96-ee28-4f82-a392-929179722e50 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:36.894109 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-11381e96-ee28-4f82-a392-929179722e50 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:36.894751 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-0b736302-c83b-4c04-9e06-6af67bec7210 req-278a5348-00f2-4414-96ae-43c9ad3cbab0 service nova] Creating event network-vif-plugged:1f37fede-c1b1-491b-bab1-5ad8cb57086e for instance 7b882133-2fca-4df4-b228-46a12f538c18 on n-h2-850501-14 Oct 04 19:01:36.895270 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-11381e96-ee28-4f82-a392-929179722e50 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:36.895568 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-11381e96-ee28-4f82-a392-929179722e50 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:36.906818 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-0b736302-c83b-4c04-9e06-6af67bec7210 req-278a5348-00f2-4414-96ae-43c9ad3cbab0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064247 Oct 04 19:01:36.906818 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3018/6060] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:01:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:01:37.146226 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8c029fa5-34cd-4c52-88b1-5fccb05dee67 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:37.147896 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8c029fa5-34cd-4c52-88b1-5fccb05dee67 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:37.162129 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8c029fa5-34cd-4c52-88b1-5fccb05dee67 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:37.162129 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8c029fa5-34cd-4c52-88b1-5fccb05dee67 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:37.162129 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8c029fa5-34cd-4c52-88b1-5fccb05dee67 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:37.162129 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8c029fa5-34cd-4c52-88b1-5fccb05dee67 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:37.162129 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8c029fa5-34cd-4c52-88b1-5fccb05dee67 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:37.163725 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8c029fa5-34cd-4c52-88b1-5fccb05dee67 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:37.170099 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=100 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:01:37.448986 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8c029fa5-34cd-4c52-88b1-5fccb05dee67 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:37.459950 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8c029fa5-34cd-4c52-88b1-5fccb05dee67 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:37.461881 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8c029fa5-34cd-4c52-88b1-5fccb05dee67 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:37.463470 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8c029fa5-34cd-4c52-88b1-5fccb05dee67 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18" status: 200 len: 1807 microversion: 2.20 time: 0.321810 Oct 04 19:01:37.464818 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3019/6061] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:01:37 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 => generated 1807 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 19:01:37.470236 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8f8b8446-e288-46ef-ab67-0a96edabdb48 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:37.471047 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8f8b8446-e288-46ef-ab67-0a96edabdb48 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: 6860257c-9998-4117-8aa4-b08bd2f8dc28] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:37.478029 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8f8b8446-e288-46ef-ab67-0a96edabdb48 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:37.478795 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8f8b8446-e288-46ef-ab67-0a96edabdb48 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:37.479437 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8f8b8446-e288-46ef-ab67-0a96edabdb48 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:37.480450 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8f8b8446-e288-46ef-ab67-0a96edabdb48 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:37.481168 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8f8b8446-e288-46ef-ab67-0a96edabdb48 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:37.481850 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8f8b8446-e288-46ef-ab67-0a96edabdb48 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:37.547999 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:01:37.764320 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-11381e96-ee28-4f82-a392-929179722e50 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] 10.222.0.20 "POST /compute/v2.1/servers/a3c2e8e3-d8c6-4185-93b7-df9dd21cf432/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.898506 Oct 04 19:01:37.766828 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3043/6062] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Oct 4 19:01:36 2022] POST /compute/v2.1/servers/a3c2e8e3-d8c6-4185-93b7-df9dd21cf432/os-volume_attachments => generated 194 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:01:37.789952 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8f8b8446-e288-46ef-ab67-0a96edabdb48 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce441ded6f554ec28560c75de97af173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc67d8de57543c48bdf45669b684227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:37.808425 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8f8b8446-e288-46ef-ab67-0a96edabdb48 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/6860257c-9998-4117-8aa4-b08bd2f8dc28" status: 200 len: 1368 microversion: 2.1 time: 0.341906 Oct 04 19:01:37.813376 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3020/6063] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:37 2022] GET /compute/v2.1/servers/6860257c-9998-4117-8aa4-b08bd2f8dc28 => generated 1368 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:38.028280 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-2ba11713-fcfb-4b76-96ff-40add3103504 req-95a3a0d6-7be9-4aa1-a9b3-4571715dd15c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6860257c-9998-4117-8aa4-b08bd2f8dc28", "tag": "43c00037-bb5f-437e-ad69-490e42209bb4"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:01:38.067394 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-2ba11713-fcfb-4b76-96ff-40add3103504 req-95a3a0d6-7be9-4aa1-a9b3-4571715dd15c service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:38.069167 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-2ba11713-fcfb-4b76-96ff-40add3103504 req-95a3a0d6-7be9-4aa1-a9b3-4571715dd15c service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:38.070209 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-2ba11713-fcfb-4b76-96ff-40add3103504 req-95a3a0d6-7be9-4aa1-a9b3-4571715dd15c service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:38.114012 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-2ba11713-fcfb-4b76-96ff-40add3103504 req-95a3a0d6-7be9-4aa1-a9b3-4571715dd15c service nova] Creating event network-changed:43c00037-bb5f-437e-ad69-490e42209bb4 for instance 6860257c-9998-4117-8aa4-b08bd2f8dc28 on n-h2-850501-14 Oct 04 19:01:38.122858 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-2ba11713-fcfb-4b76-96ff-40add3103504 req-95a3a0d6-7be9-4aa1-a9b3-4571715dd15c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098614 Oct 04 19:01:38.123469 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3044/6064] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:01:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:01:38.501408 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b3a58dad-1816-401b-bb08-dc3aae8a4be6 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:38.502632 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b3a58dad-1816-401b-bb08-dc3aae8a4be6 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:38.523996 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b3a58dad-1816-401b-bb08-dc3aae8a4be6 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:38.524696 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b3a58dad-1816-401b-bb08-dc3aae8a4be6 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:38.525319 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b3a58dad-1816-401b-bb08-dc3aae8a4be6 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:38.526218 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b3a58dad-1816-401b-bb08-dc3aae8a4be6 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:38.527770 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b3a58dad-1816-401b-bb08-dc3aae8a4be6 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:38.530162 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b3a58dad-1816-401b-bb08-dc3aae8a4be6 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:38.849419 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b1a309b5-9323-4fab-a10e-a9837337d5e9 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:38.856828 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b3a58dad-1816-401b-bb08-dc3aae8a4be6 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:38.858023 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b1a309b5-9323-4fab-a10e-a9837337d5e9 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: 6860257c-9998-4117-8aa4-b08bd2f8dc28] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:38.869436 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b3a58dad-1816-401b-bb08-dc3aae8a4be6 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:38.873302 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b3a58dad-1816-401b-bb08-dc3aae8a4be6 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:38.877947 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b1a309b5-9323-4fab-a10e-a9837337d5e9 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:38.879221 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b3a58dad-1816-401b-bb08-dc3aae8a4be6 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18" status: 200 len: 1807 microversion: 2.20 time: 0.383228 Oct 04 19:01:38.879801 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b1a309b5-9323-4fab-a10e-a9837337d5e9 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:38.880298 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3021/6065] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:01:38 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 => generated 1807 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:01:38.881690 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b1a309b5-9323-4fab-a10e-a9837337d5e9 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:38.882573 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b1a309b5-9323-4fab-a10e-a9837337d5e9 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:38.883159 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b1a309b5-9323-4fab-a10e-a9837337d5e9 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:38.887573 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b1a309b5-9323-4fab-a10e-a9837337d5e9 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:39.338205 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b1a309b5-9323-4fab-a10e-a9837337d5e9 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce441ded6f554ec28560c75de97af173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc67d8de57543c48bdf45669b684227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:39.349119 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b1a309b5-9323-4fab-a10e-a9837337d5e9 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/6860257c-9998-4117-8aa4-b08bd2f8dc28" status: 200 len: 1368 microversion: 2.1 time: 0.507014 Oct 04 19:01:39.350468 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3045/6066] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:38 2022] GET /compute/v2.1/servers/6860257c-9998-4117-8aa4-b08bd2f8dc28 => generated 1368 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:01:39.908023 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1ad3ce97-b9c1-4af8-9164-d3e8b80bd38e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:39.908689 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1ad3ce97-b9c1-4af8-9164-d3e8b80bd38e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:39.910595 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:01:39.911502 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=8 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:01:39.917850 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1ad3ce97-b9c1-4af8-9164-d3e8b80bd38e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:39.918651 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1ad3ce97-b9c1-4af8-9164-d3e8b80bd38e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:39.919254 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1ad3ce97-b9c1-4af8-9164-d3e8b80bd38e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:39.920261 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1ad3ce97-b9c1-4af8-9164-d3e8b80bd38e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:39.920890 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1ad3ce97-b9c1-4af8-9164-d3e8b80bd38e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:39.922155 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1ad3ce97-b9c1-4af8-9164-d3e8b80bd38e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:40.224885 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1ad3ce97-b9c1-4af8-9164-d3e8b80bd38e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:40.235723 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1ad3ce97-b9c1-4af8-9164-d3e8b80bd38e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:40.237549 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1ad3ce97-b9c1-4af8-9164-d3e8b80bd38e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:40.239065 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1ad3ce97-b9c1-4af8-9164-d3e8b80bd38e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18" status: 200 len: 1807 microversion: 2.20 time: 0.335056 Oct 04 19:01:40.241146 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3022/6067] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:01:39 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 => generated 1807 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:01:40.383947 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-954a8762-1cec-43ee-be70-af844cbdb39c tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:40.385427 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-954a8762-1cec-43ee-be70-af844cbdb39c tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: 6860257c-9998-4117-8aa4-b08bd2f8dc28] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:40.401928 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-954a8762-1cec-43ee-be70-af844cbdb39c tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:40.402648 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-954a8762-1cec-43ee-be70-af844cbdb39c tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:40.403323 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-954a8762-1cec-43ee-be70-af844cbdb39c tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:40.404306 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-954a8762-1cec-43ee-be70-af844cbdb39c tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:40.405418 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-954a8762-1cec-43ee-be70-af844cbdb39c tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:40.406923 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-954a8762-1cec-43ee-be70-af844cbdb39c tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:40.685900 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-954a8762-1cec-43ee-be70-af844cbdb39c tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce441ded6f554ec28560c75de97af173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc67d8de57543c48bdf45669b684227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:40.696526 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-954a8762-1cec-43ee-be70-af844cbdb39c tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/6860257c-9998-4117-8aa4-b08bd2f8dc28" status: 200 len: 1368 microversion: 2.1 time: 0.314707 Oct 04 19:01:40.699235 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3046/6068] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:40 2022] GET /compute/v2.1/servers/6860257c-9998-4117-8aa4-b08bd2f8dc28 => generated 1368 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:41.272428 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d2bb328a-27b9-4f46-b38b-0b8921ba2d84 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:41.273107 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d2bb328a-27b9-4f46-b38b-0b8921ba2d84 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:41.311051 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d2bb328a-27b9-4f46-b38b-0b8921ba2d84 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:41.312630 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d2bb328a-27b9-4f46-b38b-0b8921ba2d84 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:41.313129 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d2bb328a-27b9-4f46-b38b-0b8921ba2d84 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:41.315702 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d2bb328a-27b9-4f46-b38b-0b8921ba2d84 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:41.321104 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d2bb328a-27b9-4f46-b38b-0b8921ba2d84 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:41.321672 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d2bb328a-27b9-4f46-b38b-0b8921ba2d84 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:41.694365 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d2bb328a-27b9-4f46-b38b-0b8921ba2d84 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:41.707960 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d2bb328a-27b9-4f46-b38b-0b8921ba2d84 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:41.716872 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d2bb328a-27b9-4f46-b38b-0b8921ba2d84 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:41.718457 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d2bb328a-27b9-4f46-b38b-0b8921ba2d84 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18" status: 200 len: 1807 microversion: 2.20 time: 0.451963 Oct 04 19:01:41.719567 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3023/6069] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:01:41 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 => generated 1807 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:01:41.734902 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-066ea411-60e4-446a-8f57-9030531b4cb0 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:41.736780 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-066ea411-60e4-446a-8f57-9030531b4cb0 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: 6860257c-9998-4117-8aa4-b08bd2f8dc28] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:41.739783 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=16 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:01:41.758873 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-066ea411-60e4-446a-8f57-9030531b4cb0 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:41.759380 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-066ea411-60e4-446a-8f57-9030531b4cb0 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:41.759868 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-066ea411-60e4-446a-8f57-9030531b4cb0 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:41.760580 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-066ea411-60e4-446a-8f57-9030531b4cb0 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:41.761045 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-066ea411-60e4-446a-8f57-9030531b4cb0 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:41.765548 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-066ea411-60e4-446a-8f57-9030531b4cb0 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:42.182329 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-066ea411-60e4-446a-8f57-9030531b4cb0 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce441ded6f554ec28560c75de97af173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc67d8de57543c48bdf45669b684227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:42.203836 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-066ea411-60e4-446a-8f57-9030531b4cb0 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/6860257c-9998-4117-8aa4-b08bd2f8dc28" status: 200 len: 1368 microversion: 2.1 time: 0.476806 Oct 04 19:01:42.213449 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3047/6070] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:41 2022] GET /compute/v2.1/servers/6860257c-9998-4117-8aa4-b08bd2f8dc28 => generated 1368 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:42.748734 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9beb9597-39a4-46f0-8e9f-e074a4e8626b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:42.751395 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9beb9597-39a4-46f0-8e9f-e074a4e8626b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:42.767366 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9beb9597-39a4-46f0-8e9f-e074a4e8626b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:42.768472 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9beb9597-39a4-46f0-8e9f-e074a4e8626b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:42.771074 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9beb9597-39a4-46f0-8e9f-e074a4e8626b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:42.773203 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9beb9597-39a4-46f0-8e9f-e074a4e8626b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:42.773965 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9beb9597-39a4-46f0-8e9f-e074a4e8626b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:42.774622 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9beb9597-39a4-46f0-8e9f-e074a4e8626b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:43.205787 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9beb9597-39a4-46f0-8e9f-e074a4e8626b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:43.222683 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9beb9597-39a4-46f0-8e9f-e074a4e8626b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:43.230222 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9beb9597-39a4-46f0-8e9f-e074a4e8626b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:43.231869 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9beb9597-39a4-46f0-8e9f-e074a4e8626b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18" status: 200 len: 1794 microversion: 2.20 time: 0.487409 Oct 04 19:01:43.239116 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3024/6071] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:01:42 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 => generated 1794 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:01:43.248706 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-abf831bf-20ce-4584-9974-535221d68af4 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:43.249523 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-abf831bf-20ce-4584-9974-535221d68af4 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: 6860257c-9998-4117-8aa4-b08bd2f8dc28] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:43.263490 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-abf831bf-20ce-4584-9974-535221d68af4 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:43.265454 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-abf831bf-20ce-4584-9974-535221d68af4 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:43.266124 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-abf831bf-20ce-4584-9974-535221d68af4 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:43.269690 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-abf831bf-20ce-4584-9974-535221d68af4 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:43.270517 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-abf831bf-20ce-4584-9974-535221d68af4 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:43.271149 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-abf831bf-20ce-4584-9974-535221d68af4 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:43.649460 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-abf831bf-20ce-4584-9974-535221d68af4 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce441ded6f554ec28560c75de97af173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc67d8de57543c48bdf45669b684227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:43.658082 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-abf831bf-20ce-4584-9974-535221d68af4 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/6860257c-9998-4117-8aa4-b08bd2f8dc28" status: 200 len: 1368 microversion: 2.1 time: 0.422536 Oct 04 19:01:43.659187 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3048/6072] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:43 2022] GET /compute/v2.1/servers/6860257c-9998-4117-8aa4-b08bd2f8dc28 => generated 1368 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:44.683004 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0436d0d7-dc46-49ce-88a1-643a5c375c89 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:44.683612 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0436d0d7-dc46-49ce-88a1-643a5c375c89 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: 6860257c-9998-4117-8aa4-b08bd2f8dc28] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:44.691217 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0436d0d7-dc46-49ce-88a1-643a5c375c89 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:44.692147 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0436d0d7-dc46-49ce-88a1-643a5c375c89 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:44.692795 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0436d0d7-dc46-49ce-88a1-643a5c375c89 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:44.693716 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0436d0d7-dc46-49ce-88a1-643a5c375c89 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:44.694388 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0436d0d7-dc46-49ce-88a1-643a5c375c89 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:44.695461 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0436d0d7-dc46-49ce-88a1-643a5c375c89 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:44.932857 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0436d0d7-dc46-49ce-88a1-643a5c375c89 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce441ded6f554ec28560c75de97af173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc67d8de57543c48bdf45669b684227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:44.944374 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0436d0d7-dc46-49ce-88a1-643a5c375c89 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/6860257c-9998-4117-8aa4-b08bd2f8dc28" status: 200 len: 1368 microversion: 2.1 time: 0.265350 Oct 04 19:01:44.946105 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3025/6073] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:44 2022] GET /compute/v2.1/servers/6860257c-9998-4117-8aa4-b08bd2f8dc28 => generated 1368 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:45.971284 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-bb9b09c7-ea46-47e4-93c8-ef10d6ee0b99 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:45.972688 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-bb9b09c7-ea46-47e4-93c8-ef10d6ee0b99 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: 6860257c-9998-4117-8aa4-b08bd2f8dc28] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:45.991752 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bb9b09c7-ea46-47e4-93c8-ef10d6ee0b99 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:45.992615 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bb9b09c7-ea46-47e4-93c8-ef10d6ee0b99 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:45.993256 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bb9b09c7-ea46-47e4-93c8-ef10d6ee0b99 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:45.997934 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bb9b09c7-ea46-47e4-93c8-ef10d6ee0b99 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:46.001554 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bb9b09c7-ea46-47e4-93c8-ef10d6ee0b99 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:46.002591 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bb9b09c7-ea46-47e4-93c8-ef10d6ee0b99 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:46.395832 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-bb9b09c7-ea46-47e4-93c8-ef10d6ee0b99 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce441ded6f554ec28560c75de97af173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc67d8de57543c48bdf45669b684227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:46.406279 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-bb9b09c7-ea46-47e4-93c8-ef10d6ee0b99 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/6860257c-9998-4117-8aa4-b08bd2f8dc28" status: 200 len: 1368 microversion: 2.1 time: 0.440138 Oct 04 19:01:46.414869 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3049/6074] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:45 2022] GET /compute/v2.1/servers/6860257c-9998-4117-8aa4-b08bd2f8dc28 => generated 1368 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:46.840269 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-77ba27d3-e16a-4bef-9a7a-dad42247abe1 req-bcbc0eba-f997-434d-b5b4-addf84c755e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6860257c-9998-4117-8aa4-b08bd2f8dc28", "name": "network-vif-plugged", "status": "completed", "tag": "43c00037-bb5f-437e-ad69-490e42209bb4"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:01:46.863816 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-77ba27d3-e16a-4bef-9a7a-dad42247abe1 req-bcbc0eba-f997-434d-b5b4-addf84c755e5 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:46.865092 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-77ba27d3-e16a-4bef-9a7a-dad42247abe1 req-bcbc0eba-f997-434d-b5b4-addf84c755e5 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:46.865613 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-77ba27d3-e16a-4bef-9a7a-dad42247abe1 req-bcbc0eba-f997-434d-b5b4-addf84c755e5 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:46.879777 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-77ba27d3-e16a-4bef-9a7a-dad42247abe1 req-bcbc0eba-f997-434d-b5b4-addf84c755e5 service nova] Creating event network-vif-plugged:43c00037-bb5f-437e-ad69-490e42209bb4 for instance 6860257c-9998-4117-8aa4-b08bd2f8dc28 on n-h2-850501-14 Oct 04 19:01:46.885972 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-77ba27d3-e16a-4bef-9a7a-dad42247abe1 req-bcbc0eba-f997-434d-b5b4-addf84c755e5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051143 Oct 04 19:01:46.886600 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3026/6075] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:01:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:01:47.442973 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-72e3a630-5cba-433c-afc7-3b6808fbf8bf tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:47.443616 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-72e3a630-5cba-433c-afc7-3b6808fbf8bf tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: 6860257c-9998-4117-8aa4-b08bd2f8dc28] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:47.454774 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-72e3a630-5cba-433c-afc7-3b6808fbf8bf tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:47.457110 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-72e3a630-5cba-433c-afc7-3b6808fbf8bf tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:47.457569 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-72e3a630-5cba-433c-afc7-3b6808fbf8bf tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:47.458303 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-72e3a630-5cba-433c-afc7-3b6808fbf8bf tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:47.458787 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-72e3a630-5cba-433c-afc7-3b6808fbf8bf tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:47.459227 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-72e3a630-5cba-433c-afc7-3b6808fbf8bf tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:47.736295 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-72e3a630-5cba-433c-afc7-3b6808fbf8bf tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce441ded6f554ec28560c75de97af173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc67d8de57543c48bdf45669b684227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:47.750271 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-72e3a630-5cba-433c-afc7-3b6808fbf8bf tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/6860257c-9998-4117-8aa4-b08bd2f8dc28" status: 200 len: 1368 microversion: 2.1 time: 0.314873 Oct 04 19:01:47.753056 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3050/6076] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:47 2022] GET /compute/v2.1/servers/6860257c-9998-4117-8aa4-b08bd2f8dc28 => generated 1368 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:48.779874 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4384858b-752b-484d-9fa3-88e442947b20 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:48.780642 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4384858b-752b-484d-9fa3-88e442947b20 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: 6860257c-9998-4117-8aa4-b08bd2f8dc28] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:48.787591 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4384858b-752b-484d-9fa3-88e442947b20 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:48.788468 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4384858b-752b-484d-9fa3-88e442947b20 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:48.789106 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4384858b-752b-484d-9fa3-88e442947b20 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:48.789832 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4384858b-752b-484d-9fa3-88e442947b20 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:48.790293 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4384858b-752b-484d-9fa3-88e442947b20 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:48.790722 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4384858b-752b-484d-9fa3-88e442947b20 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:49.076908 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4384858b-752b-484d-9fa3-88e442947b20 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce441ded6f554ec28560c75de97af173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc67d8de57543c48bdf45669b684227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:49.090353 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4384858b-752b-484d-9fa3-88e442947b20 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/6860257c-9998-4117-8aa4-b08bd2f8dc28" status: 200 len: 1368 microversion: 2.1 time: 0.315993 Oct 04 19:01:49.104986 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3027/6077] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:48 2022] GET /compute/v2.1/servers/6860257c-9998-4117-8aa4-b08bd2f8dc28 => generated 1368 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:50.119374 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-12fd9cdc-bc1b-4ae2-8b6b-cb8659fbd7db tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:50.120018 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-12fd9cdc-bc1b-4ae2-8b6b-cb8659fbd7db tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: 6860257c-9998-4117-8aa4-b08bd2f8dc28] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:50.132235 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-12fd9cdc-bc1b-4ae2-8b6b-cb8659fbd7db tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:50.133328 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-12fd9cdc-bc1b-4ae2-8b6b-cb8659fbd7db tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:50.133981 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-12fd9cdc-bc1b-4ae2-8b6b-cb8659fbd7db tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:50.134898 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-12fd9cdc-bc1b-4ae2-8b6b-cb8659fbd7db tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:50.135616 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-12fd9cdc-bc1b-4ae2-8b6b-cb8659fbd7db tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:50.136554 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-12fd9cdc-bc1b-4ae2-8b6b-cb8659fbd7db tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:50.314006 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-12fd9cdc-bc1b-4ae2-8b6b-cb8659fbd7db tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce441ded6f554ec28560c75de97af173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc67d8de57543c48bdf45669b684227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:50.326440 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-12fd9cdc-bc1b-4ae2-8b6b-cb8659fbd7db tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/6860257c-9998-4117-8aa4-b08bd2f8dc28" status: 200 len: 1559 microversion: 2.1 time: 0.215148 Oct 04 19:01:50.340619 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3051/6078] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:50 2022] GET /compute/v2.1/servers/6860257c-9998-4117-8aa4-b08bd2f8dc28 => generated 1559 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:50.359073 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4ed24a13-b01e-40f3-aa7d-aad5cd11c7e2 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:50.359073 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4ed24a13-b01e-40f3-aa7d-aad5cd11c7e2 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: 6860257c-9998-4117-8aa4-b08bd2f8dc28] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:50.376548 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4ed24a13-b01e-40f3-aa7d-aad5cd11c7e2 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:50.377116 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4ed24a13-b01e-40f3-aa7d-aad5cd11c7e2 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:50.381377 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4ed24a13-b01e-40f3-aa7d-aad5cd11c7e2 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:50.382294 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4ed24a13-b01e-40f3-aa7d-aad5cd11c7e2 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:50.382773 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4ed24a13-b01e-40f3-aa7d-aad5cd11c7e2 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:50.383964 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4ed24a13-b01e-40f3-aa7d-aad5cd11c7e2 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:50.520035 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4ed24a13-b01e-40f3-aa7d-aad5cd11c7e2 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/6860257c-9998-4117-8aa4-b08bd2f8dc28/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.166961 Oct 04 19:01:50.520599 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3028/6079] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Oct 4 19:01:50 2022] GET /compute/v2.1/servers/6860257c-9998-4117-8aa4-b08bd2f8dc28/os-interface => generated 285 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:01:52.466548 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-76ee2d36-cc55-4dea-ac88-77b57b1c5aff req-f0619c44-6896-471f-92f6-538ad1023694 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6860257c-9998-4117-8aa4-b08bd2f8dc28", "tag": "43c00037-bb5f-437e-ad69-490e42209bb4"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:01:52.484196 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-76ee2d36-cc55-4dea-ac88-77b57b1c5aff req-f0619c44-6896-471f-92f6-538ad1023694 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:52.486711 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-76ee2d36-cc55-4dea-ac88-77b57b1c5aff req-f0619c44-6896-471f-92f6-538ad1023694 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:52.486711 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-76ee2d36-cc55-4dea-ac88-77b57b1c5aff req-f0619c44-6896-471f-92f6-538ad1023694 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:52.501370 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-76ee2d36-cc55-4dea-ac88-77b57b1c5aff req-f0619c44-6896-471f-92f6-538ad1023694 service nova] Creating event network-changed:43c00037-bb5f-437e-ad69-490e42209bb4 for instance 6860257c-9998-4117-8aa4-b08bd2f8dc28 on n-h2-850501-14 Oct 04 19:01:52.512818 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-76ee2d36-cc55-4dea-ac88-77b57b1c5aff req-f0619c44-6896-471f-92f6-538ad1023694 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050461 Oct 04 19:01:52.515143 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3052/6080] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:01:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:02:10.701732 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=44 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:02:10.704013 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=52 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:02:10.708309 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-862c37ca-b31e-4958-b6d6-83b8cc81b973 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:10.708808 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-862c37ca-b31e-4958-b6d6-83b8cc81b973 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] [instance: a3c2e8e3-d8c6-4185-93b7-df9dd21cf432] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:10.715278 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-862c37ca-b31e-4958-b6d6-83b8cc81b973 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:10.716020 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-862c37ca-b31e-4958-b6d6-83b8cc81b973 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:10.716708 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-862c37ca-b31e-4958-b6d6-83b8cc81b973 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:10.717710 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-862c37ca-b31e-4958-b6d6-83b8cc81b973 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:10.719313 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-862c37ca-b31e-4958-b6d6-83b8cc81b973 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:10.720095 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-862c37ca-b31e-4958-b6d6-83b8cc81b973 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:10.823105 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-862c37ca-b31e-4958-b6d6-83b8cc81b973 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lazy-loading 'services' on Instance uuid a3c2e8e3-d8c6-4185-93b7-df9dd21cf432 {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:02:11.229071 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-862c37ca-b31e-4958-b6d6-83b8cc81b973 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a3c2e8e3-d8c6-4185-93b7-df9dd21cf432/os-volume_attachments/2121aae9-f053-4463-9a4e-6845b3b07a1b" status: 202 len: 0 microversion: 2.1 time: 0.529786 Oct 04 19:02:11.229693 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3029/6081] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Oct 4 19:02:10 2022] DELETE /compute/v2.1/servers/a3c2e8e3-d8c6-4185-93b7-df9dd21cf432/os-volume_attachments/2121aae9-f053-4463-9a4e-6845b3b07a1b => generated 0 bytes in 531 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:02:18.912554 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=55 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:02:18.914049 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=48,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:02:18.920185 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9cfd8885-904c-4b01-8fb8-05bc00344872 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:18.922992 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-9cfd8885-904c-4b01-8fb8-05bc00344872 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] [instance: a3c2e8e3-d8c6-4185-93b7-df9dd21cf432] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:18.942780 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9cfd8885-904c-4b01-8fb8-05bc00344872 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:18.943586 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9cfd8885-904c-4b01-8fb8-05bc00344872 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:18.944250 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9cfd8885-904c-4b01-8fb8-05bc00344872 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:18.945154 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9cfd8885-904c-4b01-8fb8-05bc00344872 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:18.945779 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9cfd8885-904c-4b01-8fb8-05bc00344872 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:18.946700 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9cfd8885-904c-4b01-8fb8-05bc00344872 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:19.016817 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-9cfd8885-904c-4b01-8fb8-05bc00344872 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] [instance: a3c2e8e3-d8c6-4185-93b7-df9dd21cf432] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:02:19.616885 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9cfd8885-904c-4b01-8fb8-05bc00344872 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a3c2e8e3-d8c6-4185-93b7-df9dd21cf432" status: 204 len: 0 microversion: 2.1 time: 0.706137 Oct 04 19:02:19.618827 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3053/6082] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 19:02:18 2022] DELETE /compute/v2.1/servers/a3c2e8e3-d8c6-4185-93b7-df9dd21cf432 => generated 0 bytes in 709 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:02:19.641442 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-adc16461-49d4-43ad-a01f-4e2be6eaa410 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:19.642151 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-adc16461-49d4-43ad-a01f-4e2be6eaa410 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] [instance: a3c2e8e3-d8c6-4185-93b7-df9dd21cf432] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:19.664352 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-adc16461-49d4-43ad-a01f-4e2be6eaa410 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:19.664352 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-adc16461-49d4-43ad-a01f-4e2be6eaa410 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:19.664352 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-adc16461-49d4-43ad-a01f-4e2be6eaa410 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:19.664352 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-adc16461-49d4-43ad-a01f-4e2be6eaa410 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:19.664352 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-adc16461-49d4-43ad-a01f-4e2be6eaa410 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:19.664352 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-adc16461-49d4-43ad-a01f-4e2be6eaa410 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:20.014829 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-adc16461-49d4-43ad-a01f-4e2be6eaa410 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7fac7323441708be3f27945a92fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6844b3a51e4c2da1294e89517989c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:20.024440 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-adc16461-49d4-43ad-a01f-4e2be6eaa410 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] 10.222.0.20 "GET /compute/v2.1/servers/a3c2e8e3-d8c6-4185-93b7-df9dd21cf432" status: 200 len: 1514 microversion: 2.1 time: 0.388384 Oct 04 19:02:20.025291 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3030/6083] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:19 2022] GET /compute/v2.1/servers/a3c2e8e3-d8c6-4185-93b7-df9dd21cf432 => generated 1514 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:21.050783 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2b731efa-0880-4cc8-9e37-d33d3fe47c12 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:21.051535 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2b731efa-0880-4cc8-9e37-d33d3fe47c12 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] [instance: a3c2e8e3-d8c6-4185-93b7-df9dd21cf432] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:21.065320 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2b731efa-0880-4cc8-9e37-d33d3fe47c12 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:21.086381 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2b731efa-0880-4cc8-9e37-d33d3fe47c12 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:21.086381 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2b731efa-0880-4cc8-9e37-d33d3fe47c12 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:21.086381 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2b731efa-0880-4cc8-9e37-d33d3fe47c12 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:21.086381 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2b731efa-0880-4cc8-9e37-d33d3fe47c12 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:21.086381 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2b731efa-0880-4cc8-9e37-d33d3fe47c12 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:21.475671 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-2b731efa-0880-4cc8-9e37-d33d3fe47c12 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7fac7323441708be3f27945a92fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6844b3a51e4c2da1294e89517989c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:21.489359 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2b731efa-0880-4cc8-9e37-d33d3fe47c12 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] 10.222.0.20 "GET /compute/v2.1/servers/a3c2e8e3-d8c6-4185-93b7-df9dd21cf432" status: 200 len: 1514 microversion: 2.1 time: 0.442536 Oct 04 19:02:21.492074 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3054/6084] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:21 2022] GET /compute/v2.1/servers/a3c2e8e3-d8c6-4185-93b7-df9dd21cf432 => generated 1514 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:21.953878 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-7d944aaa-aa2b-43b0-a152-fbb6f0d509a9 req-5280ef48-19e2-4701-98c6-3146afc54f6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3c2e8e3-d8c6-4185-93b7-df9dd21cf432", "name": "network-vif-deleted", "tag": "364c2e17-3302-4355-9c8f-97a2d2ecce31"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:02:21.966227 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-7d944aaa-aa2b-43b0-a152-fbb6f0d509a9 req-5280ef48-19e2-4701-98c6-3146afc54f6a service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:21.968687 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-7d944aaa-aa2b-43b0-a152-fbb6f0d509a9 req-5280ef48-19e2-4701-98c6-3146afc54f6a service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:21.968687 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-7d944aaa-aa2b-43b0-a152-fbb6f0d509a9 req-5280ef48-19e2-4701-98c6-3146afc54f6a service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:21.981628 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-7d944aaa-aa2b-43b0-a152-fbb6f0d509a9 req-5280ef48-19e2-4701-98c6-3146afc54f6a service nova] Creating event network-vif-deleted:364c2e17-3302-4355-9c8f-97a2d2ecce31 for instance a3c2e8e3-d8c6-4185-93b7-df9dd21cf432 on n-h1-850501-14 Oct 04 19:02:21.988727 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-7d944aaa-aa2b-43b0-a152-fbb6f0d509a9 req-5280ef48-19e2-4701-98c6-3146afc54f6a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039145 Oct 04 19:02:21.992471 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3031/6085] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:02:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:02:22.512945 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-cea2be96-5ac1-439f-b109-c5f678576e37 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:22.513565 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-cea2be96-5ac1-439f-b109-c5f678576e37 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] [instance: a3c2e8e3-d8c6-4185-93b7-df9dd21cf432] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:22.527627 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cea2be96-5ac1-439f-b109-c5f678576e37 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:22.528427 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cea2be96-5ac1-439f-b109-c5f678576e37 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:22.529632 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cea2be96-5ac1-439f-b109-c5f678576e37 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:22.533198 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cea2be96-5ac1-439f-b109-c5f678576e37 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:22.533870 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cea2be96-5ac1-439f-b109-c5f678576e37 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:22.534520 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cea2be96-5ac1-439f-b109-c5f678576e37 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:22.577648 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cea2be96-5ac1-439f-b109-c5f678576e37 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:22.578932 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cea2be96-5ac1-439f-b109-c5f678576e37 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:22.579572 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cea2be96-5ac1-439f-b109-c5f678576e37 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:22.580374 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-cea2be96-5ac1-439f-b109-c5f678576e37 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lazy-loading 'fault' on Instance uuid a3c2e8e3-d8c6-4185-93b7-df9dd21cf432 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:02:22.638052 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-cea2be96-5ac1-439f-b109-c5f678576e37 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7fac7323441708be3f27945a92fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6844b3a51e4c2da1294e89517989c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:22.647130 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-cea2be96-5ac1-439f-b109-c5f678576e37 tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] 10.222.0.20 "GET /compute/v2.1/servers/a3c2e8e3-d8c6-4185-93b7-df9dd21cf432" status: 200 len: 1309 microversion: 2.1 time: 0.138077 Oct 04 19:02:22.649994 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3055/6086] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:22 2022] GET /compute/v2.1/servers/a3c2e8e3-d8c6-4185-93b7-df9dd21cf432 => generated 1309 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:23.689174 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f9a7c3b8-1dee-4c36-9439-0f8701400ceb tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:23.691046 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f9a7c3b8-1dee-4c36-9439-0f8701400ceb tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] [instance: a3c2e8e3-d8c6-4185-93b7-df9dd21cf432] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:23.704387 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f9a7c3b8-1dee-4c36-9439-0f8701400ceb tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:23.704998 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f9a7c3b8-1dee-4c36-9439-0f8701400ceb tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:23.705927 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f9a7c3b8-1dee-4c36-9439-0f8701400ceb tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:23.706888 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f9a7c3b8-1dee-4c36-9439-0f8701400ceb tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:23.707559 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f9a7c3b8-1dee-4c36-9439-0f8701400ceb tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:23.708099 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f9a7c3b8-1dee-4c36-9439-0f8701400ceb tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:23.735366 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-f9a7c3b8-1dee-4c36-9439-0f8701400ceb tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] HTTP exception thrown: Instance a3c2e8e3-d8c6-4185-93b7-df9dd21cf432 could not be found. Oct 04 19:02:23.737586 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f9a7c3b8-1dee-4c36-9439-0f8701400ceb tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Request method failure captured: Oct 04 19:02:23.737586 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/a3c2e8e3-d8c6-4185-93b7-df9dd21cf432 HTTP/1.1 Oct 04 19:02:23.737586 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 19:02:23.737586 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 19:02:23.737586 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 19:02:23.737586 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 19:02:23.737586 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 19:02:23.737586 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 19:02:23.737586 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 19:02:23.737586 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 19:02:23.737586 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPIHhh9F9tBlMDot08nnALqp1MPE1mGoUXRLUWVjleGTcRnFNMTeSzTCx7lg63VuTDVF-ItPv1j2qluLL-gUxwZu8R9YRAXusKSHz_nubC0EiDGRmhVfZrXu-pulgAXptA4BBAfnw3EI06_nivrZ9hP0xR50t44SgL8yYE2ybOpEvxUM Oct 04 19:02:23.737586 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 19:02:23.737586 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 19:02:23.737586 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 19:02:23.737586 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 19:02:23.737586 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 19:02:23.737586 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 19:02:23.737586 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 7a6844b3a51e4c2da1294e89517989c4 Oct 04 19:02:23.737586 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-VolumesSnapshotTestJSON-520514649 Oct 04 19:02:23.737586 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 19:02:23.737586 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 19:02:23.737586 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7a6844b3a51e4c2da1294e89517989c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7a6844b3a51e4c2da1294e89517989c4", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7a6844b3a51e4c2da1294e89517989c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7a6844b3a51e4c2da1294e89517989c4"}]}] Oct 04 19:02:23.737586 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-VolumesSnapshotTestJSON-520514649 Oct 04 19:02:23.737586 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 7a6844b3a51e4c2da1294e89517989c4 Oct 04 19:02:23.737586 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-520514649 Oct 04 19:02:23.737586 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-VolumesSnapshotTestJSON-520514649-project Oct 04 19:02:23.737586 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 19:02:23.737586 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 19:02:23.737586 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 49a7fac7323441708be3f27945a92fb5 Oct 04 19:02:23.737586 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-VolumesSnapshotTestJSON-520514649-project Oct 04 19:02:23.737586 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 19:02:23.737586 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance a3c2e8e3-d8c6-4185-93b7-df9dd21cf432 could not be found. Oct 04 19:02:23.737586 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'a3c2e8e3-d8c6-4185-93b7-df9dd21cf432'} Oct 04 19:02:23.737586 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:02:23.737586 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:02:23.737586 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:02:23.737586 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:02:23.737586 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:02:23.737586 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:02:23.737586 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:02:23.737586 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:02:23.737586 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:02:23.737586 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:02:23.737586 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3c2e8e3-d8c6-4185-93b7-df9dd21cf432 could not be found. Oct 04 19:02:23.737586 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:02:23.737586 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:02:23.737586 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:02:23.737586 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:02:23.737586 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:02:23.737586 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:02:23.737586 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:02:23.737586 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:02:23.737586 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:02:23.737586 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:02:23.737586 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:02:23.737586 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:02:23.737586 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:02:23.737586 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:02:23.737586 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:02:23.737586 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:02:23.737586 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3c2e8e3-d8c6-4185-93b7-df9dd21cf432 could not be found. Oct 04 19:02:23.737586 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:02:23.737586 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:02:23.737586 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:02:23.747401 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:02:23.747401 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:02:23.747401 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:02:23.747401 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:02:23.747401 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:02:23.747401 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3c2e8e3-d8c6-4185-93b7-df9dd21cf432 could not be found. Oct 04 19:02:23.747401 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:02:23.747401 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f9a7c3b8-1dee-4c36-9439-0f8701400ceb tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] Returning 404 to user: Instance a3c2e8e3-d8c6-4185-93b7-df9dd21cf432 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:02:23.747401 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f9a7c3b8-1dee-4c36-9439-0f8701400ceb tempest-VolumesSnapshotTestJSON-520514649 tempest-VolumesSnapshotTestJSON-520514649-project] 10.222.0.20 "GET /compute/v2.1/servers/a3c2e8e3-d8c6-4185-93b7-df9dd21cf432" status: 404 len: 111 microversion: 2.1 time: 0.072255 Oct 04 19:02:23.747401 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3032/6087] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:23 2022] GET /compute/v2.1/servers/a3c2e8e3-d8c6-4185-93b7-df9dd21cf432 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:02:26.028740 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-38c695a1-600f-4438-a835-81f084b4899c tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-158719480", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "b965b030-5bb4-4324-9881-73285b62db3b", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "dbc89e1f-759d-4fcb-8e1c-542119e29e34"}]}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:02:26.132483 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.neutron [None req-38c695a1-600f-4438-a835-81f084b4899c tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] validate_networks() for [('dbc89e1f-759d-4fcb-8e1c-542119e29e34', None, None, None, None, None)] {{(pid=123001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:02:27.399813 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-38c695a1-600f-4438-a835-81f084b4899c tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:02:27.400454 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-38c695a1-600f-4438-a835-81f084b4899c tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:02:27.400938 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-38c695a1-600f-4438-a835-81f084b4899c tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:02:27.401537 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-38c695a1-600f-4438-a835-81f084b4899c tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:02:27.402039 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-38c695a1-600f-4438-a835-81f084b4899c tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:02:27.413083 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-38c695a1-600f-4438-a835-81f084b4899c tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:27.413917 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-38c695a1-600f-4438-a835-81f084b4899c tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:27.414911 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-38c695a1-600f-4438-a835-81f084b4899c tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:27.415864 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-38c695a1-600f-4438-a835-81f084b4899c tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:27.417160 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-38c695a1-600f-4438-a835-81f084b4899c tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:27.418054 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-38c695a1-600f-4438-a835-81f084b4899c tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:27.447861 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-38c695a1-600f-4438-a835-81f084b4899c tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Getting quotas for project 82d0cd3db371459db429cb770abde738. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:02:27.455741 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-38c695a1-600f-4438-a835-81f084b4899c tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Getting quotas for user a65ae9c3fb3c46a2a393fe21ce21b9d4 and project 82d0cd3db371459db429cb770abde738. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:02:27.472430 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-38c695a1-600f-4438-a835-81f084b4899c tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Going to run 1 instances... {{(pid=123001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:02:27.474949 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-38c695a1-600f-4438-a835-81f084b4899c tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 697578c4-b2ae-4229-b5d3-b03775a91594] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='b965b030-5bb4-4324-9881-73285b62db3b',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:02:27.677814 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-38c695a1-600f-4438-a835-81f084b4899c tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.655090 Oct 04 19:02:27.678761 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3056/6088] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 19:02:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1657 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 19:02:27.691388 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a646f54e-c903-4da8-a3b3-dbbcae365780 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:27.695772 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a646f54e-c903-4da8-a3b3-dbbcae365780 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 697578c4-b2ae-4229-b5d3-b03775a91594] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:27.814944 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a646f54e-c903-4da8-a3b3-dbbcae365780 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:27.836210 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a646f54e-c903-4da8-a3b3-dbbcae365780 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594" status: 200 len: 1056 microversion: 2.1 time: 0.149306 Oct 04 19:02:27.840928 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3033/6089] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:27 2022] GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594 => generated 1056 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:28.871567 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ed346fc2-70a4-4a94-8589-f16aa5786293 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:28.872222 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ed346fc2-70a4-4a94-8589-f16aa5786293 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 697578c4-b2ae-4229-b5d3-b03775a91594] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:28.879379 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ed346fc2-70a4-4a94-8589-f16aa5786293 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:28.879873 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ed346fc2-70a4-4a94-8589-f16aa5786293 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:28.880334 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ed346fc2-70a4-4a94-8589-f16aa5786293 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:28.881033 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ed346fc2-70a4-4a94-8589-f16aa5786293 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:28.881487 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ed346fc2-70a4-4a94-8589-f16aa5786293 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:28.881908 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ed346fc2-70a4-4a94-8589-f16aa5786293 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:28.956579 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ed346fc2-70a4-4a94-8589-f16aa5786293 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:28.966437 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ed346fc2-70a4-4a94-8589-f16aa5786293 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594" status: 200 len: 1060 microversion: 2.1 time: 0.105041 Oct 04 19:02:28.978683 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3057/6090] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:28 2022] GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594 => generated 1060 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:29.990461 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-69d4b8c4-85f7-44ec-a94f-0905da810ad5 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:29.991040 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-69d4b8c4-85f7-44ec-a94f-0905da810ad5 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 697578c4-b2ae-4229-b5d3-b03775a91594] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:30.000708 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-69d4b8c4-85f7-44ec-a94f-0905da810ad5 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:30.001590 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-69d4b8c4-85f7-44ec-a94f-0905da810ad5 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:30.002528 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-69d4b8c4-85f7-44ec-a94f-0905da810ad5 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:30.003506 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-69d4b8c4-85f7-44ec-a94f-0905da810ad5 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:30.003972 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-69d4b8c4-85f7-44ec-a94f-0905da810ad5 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:30.004638 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-69d4b8c4-85f7-44ec-a94f-0905da810ad5 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:30.085001 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-69d4b8c4-85f7-44ec-a94f-0905da810ad5 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:30.099470 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-69d4b8c4-85f7-44ec-a94f-0905da810ad5 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594" status: 200 len: 1108 microversion: 2.1 time: 0.112949 Oct 04 19:02:30.100094 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3034/6091] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:29 2022] GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594 => generated 1108 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:31.138803 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c4c77a92-e4fa-46b4-ac9e-8633a0d181ac tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:31.141058 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c4c77a92-e4fa-46b4-ac9e-8633a0d181ac tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 697578c4-b2ae-4229-b5d3-b03775a91594] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:31.149425 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c4c77a92-e4fa-46b4-ac9e-8633a0d181ac tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:31.150157 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c4c77a92-e4fa-46b4-ac9e-8633a0d181ac tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:31.151036 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c4c77a92-e4fa-46b4-ac9e-8633a0d181ac tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:31.151941 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c4c77a92-e4fa-46b4-ac9e-8633a0d181ac tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:31.152706 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c4c77a92-e4fa-46b4-ac9e-8633a0d181ac tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:31.153305 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c4c77a92-e4fa-46b4-ac9e-8633a0d181ac tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:31.284064 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c4c77a92-e4fa-46b4-ac9e-8633a0d181ac tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:31.293429 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c4c77a92-e4fa-46b4-ac9e-8633a0d181ac tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594" status: 200 len: 1126 microversion: 2.1 time: 0.157929 Oct 04 19:02:31.300100 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3058/6092] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:31 2022] GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594 => generated 1126 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:32.335288 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-28275ac5-b226-4dd2-b3e9-d51c915aed89 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:32.335288 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-28275ac5-b226-4dd2-b3e9-d51c915aed89 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 697578c4-b2ae-4229-b5d3-b03775a91594] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:32.352270 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-28275ac5-b226-4dd2-b3e9-d51c915aed89 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:32.357100 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-28275ac5-b226-4dd2-b3e9-d51c915aed89 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:32.357415 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-28275ac5-b226-4dd2-b3e9-d51c915aed89 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:32.358701 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-28275ac5-b226-4dd2-b3e9-d51c915aed89 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:32.361648 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-28275ac5-b226-4dd2-b3e9-d51c915aed89 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:32.362485 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-28275ac5-b226-4dd2-b3e9-d51c915aed89 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:33.072024 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-28275ac5-b226-4dd2-b3e9-d51c915aed89 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:33.072024 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-28275ac5-b226-4dd2-b3e9-d51c915aed89 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594" status: 200 len: 1168 microversion: 2.1 time: 0.723979 Oct 04 19:02:33.072024 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3035/6093] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:32 2022] GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594 => generated 1168 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:34.075515 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-41cdfa0c-2200-4aab-86a3-4df989558711 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:34.076265 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-41cdfa0c-2200-4aab-86a3-4df989558711 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 697578c4-b2ae-4229-b5d3-b03775a91594] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:34.089637 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-41cdfa0c-2200-4aab-86a3-4df989558711 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:34.090981 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-41cdfa0c-2200-4aab-86a3-4df989558711 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:34.091531 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-41cdfa0c-2200-4aab-86a3-4df989558711 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:34.092786 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-41cdfa0c-2200-4aab-86a3-4df989558711 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:34.093590 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-41cdfa0c-2200-4aab-86a3-4df989558711 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:34.094351 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-41cdfa0c-2200-4aab-86a3-4df989558711 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:34.528563 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-03823080-7348-4ee7-a426-8afeaa48c2dc req-dcf3294f-f62e-4f32-b76b-46d0348b835b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "697578c4-b2ae-4229-b5d3-b03775a91594", "tag": "d1b8318d-581b-46bc-a909-4c3a42f5756a"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:02:34.550750 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-03823080-7348-4ee7-a426-8afeaa48c2dc req-dcf3294f-f62e-4f32-b76b-46d0348b835b service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:34.551259 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-03823080-7348-4ee7-a426-8afeaa48c2dc req-dcf3294f-f62e-4f32-b76b-46d0348b835b service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:34.551705 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-03823080-7348-4ee7-a426-8afeaa48c2dc req-dcf3294f-f62e-4f32-b76b-46d0348b835b service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:34.580773 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-03823080-7348-4ee7-a426-8afeaa48c2dc req-dcf3294f-f62e-4f32-b76b-46d0348b835b service nova] Creating event network-changed:d1b8318d-581b-46bc-a909-4c3a42f5756a for instance 697578c4-b2ae-4229-b5d3-b03775a91594 on n-h1-850501-14 Oct 04 19:02:34.591259 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-03823080-7348-4ee7-a426-8afeaa48c2dc req-dcf3294f-f62e-4f32-b76b-46d0348b835b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065860 Oct 04 19:02:34.592319 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3036/6094] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:02:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 04 19:02:34.613783 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-41cdfa0c-2200-4aab-86a3-4df989558711 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:34.628383 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-41cdfa0c-2200-4aab-86a3-4df989558711 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594" status: 200 len: 1168 microversion: 2.1 time: 0.553785 Oct 04 19:02:34.629312 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3059/6095] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:34 2022] GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594 => generated 1168 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:35.653858 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-34e60de3-026b-4b0c-a84b-a5aec662377a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:35.659810 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-34e60de3-026b-4b0c-a84b-a5aec662377a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 697578c4-b2ae-4229-b5d3-b03775a91594] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:35.664983 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-34e60de3-026b-4b0c-a84b-a5aec662377a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:35.668804 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-34e60de3-026b-4b0c-a84b-a5aec662377a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:35.669478 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-34e60de3-026b-4b0c-a84b-a5aec662377a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:35.673219 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-34e60de3-026b-4b0c-a84b-a5aec662377a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:35.674013 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-34e60de3-026b-4b0c-a84b-a5aec662377a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:35.674630 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-34e60de3-026b-4b0c-a84b-a5aec662377a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:36.019288 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-34e60de3-026b-4b0c-a84b-a5aec662377a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:36.031838 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-34e60de3-026b-4b0c-a84b-a5aec662377a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594" status: 200 len: 1168 microversion: 2.1 time: 0.380633 Oct 04 19:02:36.031838 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3037/6096] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:35 2022] GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594 => generated 1168 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:37.060419 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f043aaa8-5a2c-4f23-9c75-14406cbd3e2d tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:37.062126 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f043aaa8-5a2c-4f23-9c75-14406cbd3e2d tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 697578c4-b2ae-4229-b5d3-b03775a91594] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:37.071832 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f043aaa8-5a2c-4f23-9c75-14406cbd3e2d tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:37.072611 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f043aaa8-5a2c-4f23-9c75-14406cbd3e2d tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:37.073307 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f043aaa8-5a2c-4f23-9c75-14406cbd3e2d tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:37.074356 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f043aaa8-5a2c-4f23-9c75-14406cbd3e2d tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:37.075093 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f043aaa8-5a2c-4f23-9c75-14406cbd3e2d tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:37.075793 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f043aaa8-5a2c-4f23-9c75-14406cbd3e2d tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:37.434281 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:02:37.466509 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=6 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:02:37.515113 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f043aaa8-5a2c-4f23-9c75-14406cbd3e2d tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:37.542555 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f043aaa8-5a2c-4f23-9c75-14406cbd3e2d tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594" status: 200 len: 1168 microversion: 2.1 time: 0.491611 Oct 04 19:02:37.548234 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3060/6097] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:37 2022] GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594 => generated 1168 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:38.568040 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-877e7b8d-474f-46e5-862c-a183bf800305 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:38.568688 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-877e7b8d-474f-46e5-862c-a183bf800305 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 697578c4-b2ae-4229-b5d3-b03775a91594] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:38.572763 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:02:38.583067 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-877e7b8d-474f-46e5-862c-a183bf800305 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:38.583870 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-877e7b8d-474f-46e5-862c-a183bf800305 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:38.584613 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-877e7b8d-474f-46e5-862c-a183bf800305 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:38.586193 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-877e7b8d-474f-46e5-862c-a183bf800305 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:38.587212 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-877e7b8d-474f-46e5-862c-a183bf800305 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:38.587854 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-877e7b8d-474f-46e5-862c-a183bf800305 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:38.921398 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-877e7b8d-474f-46e5-862c-a183bf800305 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:38.938265 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-877e7b8d-474f-46e5-862c-a183bf800305 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594" status: 200 len: 1168 microversion: 2.1 time: 0.373423 Oct 04 19:02:38.941482 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3038/6098] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:38 2022] GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594 => generated 1168 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:40.095729 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-dd4e7a52-d2e9-4aa7-831b-0488538098d0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:40.096491 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-dd4e7a52-d2e9-4aa7-831b-0488538098d0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 697578c4-b2ae-4229-b5d3-b03775a91594] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:40.109714 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dd4e7a52-d2e9-4aa7-831b-0488538098d0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:40.110220 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dd4e7a52-d2e9-4aa7-831b-0488538098d0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:40.110663 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dd4e7a52-d2e9-4aa7-831b-0488538098d0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:40.111364 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dd4e7a52-d2e9-4aa7-831b-0488538098d0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:40.111823 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dd4e7a52-d2e9-4aa7-831b-0488538098d0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:40.112473 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dd4e7a52-d2e9-4aa7-831b-0488538098d0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:40.363317 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-dd4e7a52-d2e9-4aa7-831b-0488538098d0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:40.374626 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-dd4e7a52-d2e9-4aa7-831b-0488538098d0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594" status: 200 len: 1168 microversion: 2.1 time: 0.287891 Oct 04 19:02:40.375506 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3061/6099] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:40 2022] GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594 => generated 1168 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:41.407931 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a03bb766-b7cb-46f8-8d72-cb129f0bbe00 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:41.412536 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a03bb766-b7cb-46f8-8d72-cb129f0bbe00 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 697578c4-b2ae-4229-b5d3-b03775a91594] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:41.428735 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=23 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:02:41.438721 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a03bb766-b7cb-46f8-8d72-cb129f0bbe00 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:41.439223 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a03bb766-b7cb-46f8-8d72-cb129f0bbe00 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:41.439664 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a03bb766-b7cb-46f8-8d72-cb129f0bbe00 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:41.440738 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a03bb766-b7cb-46f8-8d72-cb129f0bbe00 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:41.441182 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a03bb766-b7cb-46f8-8d72-cb129f0bbe00 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:41.441784 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a03bb766-b7cb-46f8-8d72-cb129f0bbe00 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:41.446900 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=46,nova_cell1:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:02:41.630781 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a03bb766-b7cb-46f8-8d72-cb129f0bbe00 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:41.639834 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a03bb766-b7cb-46f8-8d72-cb129f0bbe00 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594" status: 200 len: 1168 microversion: 2.1 time: 0.245066 Oct 04 19:02:41.642336 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3039/6100] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:41 2022] GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594 => generated 1168 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:42.674088 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a5d97bd0-9d4a-4152-b4ca-c11581f74a1f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:42.678609 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a5d97bd0-9d4a-4152-b4ca-c11581f74a1f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 697578c4-b2ae-4229-b5d3-b03775a91594] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:42.686605 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a5d97bd0-9d4a-4152-b4ca-c11581f74a1f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:42.687356 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a5d97bd0-9d4a-4152-b4ca-c11581f74a1f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:42.687953 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a5d97bd0-9d4a-4152-b4ca-c11581f74a1f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:42.688959 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a5d97bd0-9d4a-4152-b4ca-c11581f74a1f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:42.689702 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a5d97bd0-9d4a-4152-b4ca-c11581f74a1f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:42.690342 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a5d97bd0-9d4a-4152-b4ca-c11581f74a1f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:42.960855 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a5d97bd0-9d4a-4152-b4ca-c11581f74a1f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:42.973464 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a5d97bd0-9d4a-4152-b4ca-c11581f74a1f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594" status: 200 len: 1168 microversion: 2.1 time: 0.309935 Oct 04 19:02:42.974405 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3062/6101] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:42 2022] GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594 => generated 1168 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:44.004746 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-bc069854-8482-43cd-8a77-ebd64aca3ef0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:44.005339 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-bc069854-8482-43cd-8a77-ebd64aca3ef0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 697578c4-b2ae-4229-b5d3-b03775a91594] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:44.013384 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bc069854-8482-43cd-8a77-ebd64aca3ef0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:44.013882 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bc069854-8482-43cd-8a77-ebd64aca3ef0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:44.014870 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bc069854-8482-43cd-8a77-ebd64aca3ef0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:44.015582 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bc069854-8482-43cd-8a77-ebd64aca3ef0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:44.019254 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bc069854-8482-43cd-8a77-ebd64aca3ef0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:44.019404 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bc069854-8482-43cd-8a77-ebd64aca3ef0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:44.267063 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-bc069854-8482-43cd-8a77-ebd64aca3ef0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:44.283899 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-bc069854-8482-43cd-8a77-ebd64aca3ef0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594" status: 200 len: 1168 microversion: 2.1 time: 0.290363 Oct 04 19:02:44.285104 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3040/6102] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:43 2022] GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594 => generated 1168 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:45.310451 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6748a11a-4450-4e8b-a853-18c4726d3f2a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:45.311364 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6748a11a-4450-4e8b-a853-18c4726d3f2a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 697578c4-b2ae-4229-b5d3-b03775a91594] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:45.329043 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6748a11a-4450-4e8b-a853-18c4726d3f2a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:45.329043 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6748a11a-4450-4e8b-a853-18c4726d3f2a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:45.329043 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6748a11a-4450-4e8b-a853-18c4726d3f2a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:45.329043 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6748a11a-4450-4e8b-a853-18c4726d3f2a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:45.329043 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6748a11a-4450-4e8b-a853-18c4726d3f2a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:45.329043 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6748a11a-4450-4e8b-a853-18c4726d3f2a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:45.619736 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6748a11a-4450-4e8b-a853-18c4726d3f2a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:45.632089 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6748a11a-4450-4e8b-a853-18c4726d3f2a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594" status: 200 len: 1168 microversion: 2.1 time: 0.326357 Oct 04 19:02:45.634147 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3063/6103] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:45 2022] GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594 => generated 1168 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:46.659519 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-75aabe6c-9d70-4bc3-8734-ee77b8496496 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:46.660215 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-75aabe6c-9d70-4bc3-8734-ee77b8496496 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 697578c4-b2ae-4229-b5d3-b03775a91594] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:46.668628 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-75aabe6c-9d70-4bc3-8734-ee77b8496496 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:46.669115 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-75aabe6c-9d70-4bc3-8734-ee77b8496496 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:46.669594 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-75aabe6c-9d70-4bc3-8734-ee77b8496496 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:46.670926 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-75aabe6c-9d70-4bc3-8734-ee77b8496496 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:46.671658 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-75aabe6c-9d70-4bc3-8734-ee77b8496496 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:46.672477 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-75aabe6c-9d70-4bc3-8734-ee77b8496496 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:46.934871 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-75aabe6c-9d70-4bc3-8734-ee77b8496496 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:46.946080 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-75aabe6c-9d70-4bc3-8734-ee77b8496496 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594" status: 200 len: 1168 microversion: 2.1 time: 0.291038 Oct 04 19:02:46.950402 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3041/6104] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:46 2022] GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594 => generated 1168 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:47.495404 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3f0542b9-69ed-4237-af8b-84913aea2ce0 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:47.496387 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3f0542b9-69ed-4237-af8b-84913aea2ce0 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:47.505342 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3f0542b9-69ed-4237-af8b-84913aea2ce0 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:47.506985 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3f0542b9-69ed-4237-af8b-84913aea2ce0 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:47.508403 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3f0542b9-69ed-4237-af8b-84913aea2ce0 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:47.509465 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3f0542b9-69ed-4237-af8b-84913aea2ce0 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:47.510119 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3f0542b9-69ed-4237-af8b-84913aea2ce0 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:47.510562 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3f0542b9-69ed-4237-af8b-84913aea2ce0 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:47.555959 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3f0542b9-69ed-4237-af8b-84913aea2ce0 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18/os-volume_attachments/93f47f36-8b52-4fc9-84f2-6668d5cab544" status: 200 len: 194 microversion: 2.20 time: 0.065272 Oct 04 19:02:47.557193 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3064/6105] 10.222.0.20 () {60 vars in 1454 bytes} [Tue Oct 4 19:02:47 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18/os-volume_attachments/93f47f36-8b52-4fc9-84f2-6668d5cab544 => generated 194 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 19:02:47.697512 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3a74f3ef-4bf1-4858-9cda-dbea3107c1e8 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:47.698558 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3a74f3ef-4bf1-4858-9cda-dbea3107c1e8 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:47.735083 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3a74f3ef-4bf1-4858-9cda-dbea3107c1e8 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:47.742572 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3a74f3ef-4bf1-4858-9cda-dbea3107c1e8 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:47.742572 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3a74f3ef-4bf1-4858-9cda-dbea3107c1e8 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:47.742572 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3a74f3ef-4bf1-4858-9cda-dbea3107c1e8 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:47.742572 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3a74f3ef-4bf1-4858-9cda-dbea3107c1e8 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:47.742572 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3a74f3ef-4bf1-4858-9cda-dbea3107c1e8 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:47.928082 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-3a74f3ef-4bf1-4858-9cda-dbea3107c1e8 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lazy-loading 'services' on Instance uuid 7b882133-2fca-4df4-b228-46a12f538c18 {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:02:47.974318 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-56a8a6dc-2927-4620-812c-ed91513a3538 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:47.974965 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-56a8a6dc-2927-4620-812c-ed91513a3538 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 697578c4-b2ae-4229-b5d3-b03775a91594] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:47.988026 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-56a8a6dc-2927-4620-812c-ed91513a3538 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:47.988358 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-56a8a6dc-2927-4620-812c-ed91513a3538 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:47.988792 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-56a8a6dc-2927-4620-812c-ed91513a3538 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:47.989499 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-56a8a6dc-2927-4620-812c-ed91513a3538 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:47.989952 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-56a8a6dc-2927-4620-812c-ed91513a3538 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:47.990378 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-56a8a6dc-2927-4620-812c-ed91513a3538 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:48.227709 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-56a8a6dc-2927-4620-812c-ed91513a3538 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:48.240567 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-56a8a6dc-2927-4620-812c-ed91513a3538 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594" status: 200 len: 1168 microversion: 2.1 time: 0.270200 Oct 04 19:02:48.253672 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3065/6106] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:47 2022] GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594 => generated 1168 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:02:48.332274 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3a74f3ef-4bf1-4858-9cda-dbea3107c1e8 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18/os-volume_attachments/93f47f36-8b52-4fc9-84f2-6668d5cab544" status: 202 len: 0 microversion: 2.20 time: 0.638647 Oct 04 19:02:48.333531 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3042/6107] 10.222.0.20 () {60 vars in 1457 bytes} [Tue Oct 4 19:02:47 2022] DELETE /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18/os-volume_attachments/93f47f36-8b52-4fc9-84f2-6668d5cab544 => generated 0 bytes in 641 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:02:48.343497 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-68be12cf-a6f9-43bf-a7f5-59f64df86e90 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:48.346734 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-68be12cf-a6f9-43bf-a7f5-59f64df86e90 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:48.356336 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-68be12cf-a6f9-43bf-a7f5-59f64df86e90 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:48.357051 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-68be12cf-a6f9-43bf-a7f5-59f64df86e90 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:48.357735 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-68be12cf-a6f9-43bf-a7f5-59f64df86e90 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:48.359575 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-68be12cf-a6f9-43bf-a7f5-59f64df86e90 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:48.360260 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-68be12cf-a6f9-43bf-a7f5-59f64df86e90 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:48.361231 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-68be12cf-a6f9-43bf-a7f5-59f64df86e90 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:48.411746 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-68be12cf-a6f9-43bf-a7f5-59f64df86e90 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.074037 Oct 04 19:02:48.412386 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3066/6108] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Oct 4 19:02:48 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 19:02:49.277809 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9fc097c1-c673-4309-bc3f-718636bc4663 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:49.278515 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9fc097c1-c673-4309-bc3f-718636bc4663 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 697578c4-b2ae-4229-b5d3-b03775a91594] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:49.292281 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9fc097c1-c673-4309-bc3f-718636bc4663 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:49.292997 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9fc097c1-c673-4309-bc3f-718636bc4663 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:49.297967 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9fc097c1-c673-4309-bc3f-718636bc4663 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:49.297967 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9fc097c1-c673-4309-bc3f-718636bc4663 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:49.297967 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9fc097c1-c673-4309-bc3f-718636bc4663 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:49.297967 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9fc097c1-c673-4309-bc3f-718636bc4663 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:49.426614 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-eec5416c-0951-4fe8-ad64-6dbcc19e19b6 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:49.427904 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-eec5416c-0951-4fe8-ad64-6dbcc19e19b6 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:49.442933 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:02:49.456803 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eec5416c-0951-4fe8-ad64-6dbcc19e19b6 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:49.457505 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eec5416c-0951-4fe8-ad64-6dbcc19e19b6 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:49.458144 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eec5416c-0951-4fe8-ad64-6dbcc19e19b6 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:49.459102 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eec5416c-0951-4fe8-ad64-6dbcc19e19b6 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:49.460135 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eec5416c-0951-4fe8-ad64-6dbcc19e19b6 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:49.460759 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eec5416c-0951-4fe8-ad64-6dbcc19e19b6 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:49.504647 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9fc097c1-c673-4309-bc3f-718636bc4663 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:49.522867 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9fc097c1-c673-4309-bc3f-718636bc4663 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594" status: 200 len: 1168 microversion: 2.1 time: 0.260012 Oct 04 19:02:49.523777 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3043/6109] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:49 2022] GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594 => generated 1168 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:49.526738 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-eec5416c-0951-4fe8-ad64-6dbcc19e19b6 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.106378 Oct 04 19:02:49.527320 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3067/6110] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Oct 4 19:02:49 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 19:02:50.541332 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f8c43767-1101-4f16-ba13-0f555beb8d3e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:50.544621 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f8c43767-1101-4f16-ba13-0f555beb8d3e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:50.546562 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e69e5221-0d9b-4194-ada7-44444597d779 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:50.547181 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e69e5221-0d9b-4194-ada7-44444597d779 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 697578c4-b2ae-4229-b5d3-b03775a91594] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:50.563780 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f8c43767-1101-4f16-ba13-0f555beb8d3e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:50.573908 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f8c43767-1101-4f16-ba13-0f555beb8d3e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:50.573908 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f8c43767-1101-4f16-ba13-0f555beb8d3e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:50.574093 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e69e5221-0d9b-4194-ada7-44444597d779 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:50.574093 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e69e5221-0d9b-4194-ada7-44444597d779 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:50.574285 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f8c43767-1101-4f16-ba13-0f555beb8d3e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:50.574383 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e69e5221-0d9b-4194-ada7-44444597d779 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:50.574383 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e69e5221-0d9b-4194-ada7-44444597d779 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:50.574383 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e69e5221-0d9b-4194-ada7-44444597d779 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:50.574383 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e69e5221-0d9b-4194-ada7-44444597d779 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:50.574680 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f8c43767-1101-4f16-ba13-0f555beb8d3e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:50.574680 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f8c43767-1101-4f16-ba13-0f555beb8d3e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:50.574854 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:02:50.641807 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f8c43767-1101-4f16-ba13-0f555beb8d3e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.104750 Oct 04 19:02:50.645114 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3044/6111] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Oct 4 19:02:50 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:02:51.082702 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e69e5221-0d9b-4194-ada7-44444597d779 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:51.086187 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e69e5221-0d9b-4194-ada7-44444597d779 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594" status: 200 len: 1168 microversion: 2.1 time: 0.543548 Oct 04 19:02:51.088613 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3068/6112] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:50 2022] GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594 => generated 1168 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:02:51.661211 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4a153b84-cda7-444e-b871-a5f90583ab16 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:51.668982 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4a153b84-cda7-444e-b871-a5f90583ab16 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:51.682245 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4a153b84-cda7-444e-b871-a5f90583ab16 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:51.682739 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4a153b84-cda7-444e-b871-a5f90583ab16 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:51.683178 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4a153b84-cda7-444e-b871-a5f90583ab16 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:51.695079 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4a153b84-cda7-444e-b871-a5f90583ab16 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:51.696723 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4a153b84-cda7-444e-b871-a5f90583ab16 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:51.697693 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4a153b84-cda7-444e-b871-a5f90583ab16 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:51.777124 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4a153b84-cda7-444e-b871-a5f90583ab16 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.119808 Oct 04 19:02:51.777982 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3045/6113] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Oct 4 19:02:51 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:02:52.112555 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d983d1a9-837d-45d2-a686-55869987f643 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:52.113894 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d983d1a9-837d-45d2-a686-55869987f643 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 697578c4-b2ae-4229-b5d3-b03775a91594] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:52.121055 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d983d1a9-837d-45d2-a686-55869987f643 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:52.121814 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d983d1a9-837d-45d2-a686-55869987f643 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:52.122413 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d983d1a9-837d-45d2-a686-55869987f643 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:52.124042 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d983d1a9-837d-45d2-a686-55869987f643 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:52.125050 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d983d1a9-837d-45d2-a686-55869987f643 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:52.125704 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d983d1a9-837d-45d2-a686-55869987f643 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:52.402096 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d983d1a9-837d-45d2-a686-55869987f643 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:52.413594 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d983d1a9-837d-45d2-a686-55869987f643 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594" status: 200 len: 1168 microversion: 2.1 time: 0.305812 Oct 04 19:02:52.414818 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3069/6114] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:52 2022] GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594 => generated 1168 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:52.793416 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7d4b925c-83d9-462c-bb85-7fdcf3c4b10e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:52.797446 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7d4b925c-83d9-462c-bb85-7fdcf3c4b10e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:52.815223 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7d4b925c-83d9-462c-bb85-7fdcf3c4b10e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:52.819915 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7d4b925c-83d9-462c-bb85-7fdcf3c4b10e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:52.819915 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7d4b925c-83d9-462c-bb85-7fdcf3c4b10e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:52.819915 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7d4b925c-83d9-462c-bb85-7fdcf3c4b10e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:52.819915 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7d4b925c-83d9-462c-bb85-7fdcf3c4b10e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:52.819915 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7d4b925c-83d9-462c-bb85-7fdcf3c4b10e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:52.862202 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7d4b925c-83d9-462c-bb85-7fdcf3c4b10e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.075377 Oct 04 19:02:52.863086 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3046/6115] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Oct 4 19:02:52 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:02:53.446432 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-92f778a7-bf47-47f3-ae58-6033d958c382 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:53.448155 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-92f778a7-bf47-47f3-ae58-6033d958c382 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 697578c4-b2ae-4229-b5d3-b03775a91594] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:53.457093 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-92f778a7-bf47-47f3-ae58-6033d958c382 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:53.457580 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-92f778a7-bf47-47f3-ae58-6033d958c382 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:53.458016 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-92f778a7-bf47-47f3-ae58-6033d958c382 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:53.458748 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-92f778a7-bf47-47f3-ae58-6033d958c382 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:53.459197 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-92f778a7-bf47-47f3-ae58-6033d958c382 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:53.459868 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-92f778a7-bf47-47f3-ae58-6033d958c382 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:53.689694 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-92f778a7-bf47-47f3-ae58-6033d958c382 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:53.699031 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-92f778a7-bf47-47f3-ae58-6033d958c382 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594" status: 200 len: 1168 microversion: 2.1 time: 0.259195 Oct 04 19:02:53.700095 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3070/6116] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:53 2022] GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594 => generated 1168 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:53.875433 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c1fdb232-bf69-4940-9311-3350fa4cf230 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:53.877727 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c1fdb232-bf69-4940-9311-3350fa4cf230 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:53.885062 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c1fdb232-bf69-4940-9311-3350fa4cf230 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:53.885564 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c1fdb232-bf69-4940-9311-3350fa4cf230 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:53.886005 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c1fdb232-bf69-4940-9311-3350fa4cf230 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:53.886718 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c1fdb232-bf69-4940-9311-3350fa4cf230 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:53.887175 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c1fdb232-bf69-4940-9311-3350fa4cf230 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:53.887607 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c1fdb232-bf69-4940-9311-3350fa4cf230 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:53.920409 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c1fdb232-bf69-4940-9311-3350fa4cf230 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049055 Oct 04 19:02:53.925953 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3047/6117] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Oct 4 19:02:53 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:02:54.722707 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-30571f2d-52a9-436e-a091-903bbb2ce9d4 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:54.723943 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-30571f2d-52a9-436e-a091-903bbb2ce9d4 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 697578c4-b2ae-4229-b5d3-b03775a91594] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:54.748768 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-30571f2d-52a9-436e-a091-903bbb2ce9d4 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:54.749543 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-30571f2d-52a9-436e-a091-903bbb2ce9d4 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:54.750435 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-30571f2d-52a9-436e-a091-903bbb2ce9d4 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:54.751620 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-30571f2d-52a9-436e-a091-903bbb2ce9d4 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:54.752364 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-30571f2d-52a9-436e-a091-903bbb2ce9d4 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:54.753042 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-30571f2d-52a9-436e-a091-903bbb2ce9d4 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:54.934356 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-30571f2d-52a9-436e-a091-903bbb2ce9d4 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:54.935253 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0a96f43c-033f-4b02-b4b1-640a96020e58 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:54.936512 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-30571f2d-52a9-436e-a091-903bbb2ce9d4 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594" status: 200 len: 1168 microversion: 2.1 time: 0.217237 Oct 04 19:02:54.937329 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3071/6118] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:54 2022] GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594 => generated 1168 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:54.939179 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0a96f43c-033f-4b02-b4b1-640a96020e58 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:54.946558 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0a96f43c-033f-4b02-b4b1-640a96020e58 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:54.947606 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0a96f43c-033f-4b02-b4b1-640a96020e58 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:54.948283 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0a96f43c-033f-4b02-b4b1-640a96020e58 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:54.949160 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0a96f43c-033f-4b02-b4b1-640a96020e58 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:54.949788 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0a96f43c-033f-4b02-b4b1-640a96020e58 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:54.950391 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0a96f43c-033f-4b02-b4b1-640a96020e58 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:54.985590 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0a96f43c-033f-4b02-b4b1-640a96020e58 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.055460 Oct 04 19:02:54.986895 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3048/6119] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Oct 4 19:02:54 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:55.087497 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2df83c26-8c55-4bdb-afef-4c7fac1b111d tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:55.088009 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2df83c26-8c55-4bdb-afef-4c7fac1b111d tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:55.094898 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2df83c26-8c55-4bdb-afef-4c7fac1b111d tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:55.095394 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2df83c26-8c55-4bdb-afef-4c7fac1b111d tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:55.096047 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2df83c26-8c55-4bdb-afef-4c7fac1b111d tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:55.096792 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2df83c26-8c55-4bdb-afef-4c7fac1b111d tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:55.097261 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2df83c26-8c55-4bdb-afef-4c7fac1b111d tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:55.097694 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2df83c26-8c55-4bdb-afef-4c7fac1b111d tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:55.140750 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2df83c26-8c55-4bdb-afef-4c7fac1b111d tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:02:55.703618 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2df83c26-8c55-4bdb-afef-4c7fac1b111d tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18" status: 204 len: 0 microversion: 2.20 time: 0.619589 Oct 04 19:02:55.706886 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3072/6120] 10.222.0.20 () {60 vars in 1280 bytes} [Tue Oct 4 19:02:55 2022] DELETE /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 => generated 0 bytes in 622 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 19:02:55.720234 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ab04b606-b71f-4d2c-a3ba-64cb8381d095 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:55.721036 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ab04b606-b71f-4d2c-a3ba-64cb8381d095 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:55.736341 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ab04b606-b71f-4d2c-a3ba-64cb8381d095 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:55.737094 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ab04b606-b71f-4d2c-a3ba-64cb8381d095 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:55.737786 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ab04b606-b71f-4d2c-a3ba-64cb8381d095 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:55.738716 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ab04b606-b71f-4d2c-a3ba-64cb8381d095 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:55.739273 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ab04b606-b71f-4d2c-a3ba-64cb8381d095 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:55.740621 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ab04b606-b71f-4d2c-a3ba-64cb8381d095 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:55.961851 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-02fa7de2-e8dd-4c19-9e2b-0b2b56452aa3 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:55.962751 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-02fa7de2-e8dd-4c19-9e2b-0b2b56452aa3 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 697578c4-b2ae-4229-b5d3-b03775a91594] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:55.975452 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-02fa7de2-e8dd-4c19-9e2b-0b2b56452aa3 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:55.976029 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-02fa7de2-e8dd-4c19-9e2b-0b2b56452aa3 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:55.976439 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-02fa7de2-e8dd-4c19-9e2b-0b2b56452aa3 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:55.986755 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-02fa7de2-e8dd-4c19-9e2b-0b2b56452aa3 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:55.987506 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-02fa7de2-e8dd-4c19-9e2b-0b2b56452aa3 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:55.993952 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-02fa7de2-e8dd-4c19-9e2b-0b2b56452aa3 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:56.291589 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-02fa7de2-e8dd-4c19-9e2b-0b2b56452aa3 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:56.303364 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-02fa7de2-e8dd-4c19-9e2b-0b2b56452aa3 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594" status: 200 len: 1168 microversion: 2.1 time: 0.346560 Oct 04 19:02:56.303921 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3073/6121] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:55 2022] GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594 => generated 1168 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:56.391615 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ab04b606-b71f-4d2c-a3ba-64cb8381d095 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:56.404483 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ab04b606-b71f-4d2c-a3ba-64cb8381d095 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:56.406481 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ab04b606-b71f-4d2c-a3ba-64cb8381d095 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:56.407896 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ab04b606-b71f-4d2c-a3ba-64cb8381d095 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18" status: 200 len: 1722 microversion: 2.20 time: 0.692619 Oct 04 19:02:56.408984 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3049/6122] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:02:55 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 => generated 1722 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 19:02:57.333635 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8efadea7-80a0-4594-abf3-daed6a721817 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:57.335148 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8efadea7-80a0-4594-abf3-daed6a721817 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 697578c4-b2ae-4229-b5d3-b03775a91594] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:57.343542 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8efadea7-80a0-4594-abf3-daed6a721817 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:57.348642 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8efadea7-80a0-4594-abf3-daed6a721817 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:57.349264 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8efadea7-80a0-4594-abf3-daed6a721817 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:57.350189 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8efadea7-80a0-4594-abf3-daed6a721817 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:57.351246 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8efadea7-80a0-4594-abf3-daed6a721817 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:57.351246 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8efadea7-80a0-4594-abf3-daed6a721817 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:57.436883 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e264300d-cfaf-4830-b73d-d6b4801ab835 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:57.437527 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e264300d-cfaf-4830-b73d-d6b4801ab835 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:57.448070 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e264300d-cfaf-4830-b73d-d6b4801ab835 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:57.448781 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e264300d-cfaf-4830-b73d-d6b4801ab835 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:57.449415 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e264300d-cfaf-4830-b73d-d6b4801ab835 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:57.450293 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e264300d-cfaf-4830-b73d-d6b4801ab835 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:57.450912 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e264300d-cfaf-4830-b73d-d6b4801ab835 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:57.452041 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e264300d-cfaf-4830-b73d-d6b4801ab835 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:57.753411 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8efadea7-80a0-4594-abf3-daed6a721817 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:57.765369 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e264300d-cfaf-4830-b73d-d6b4801ab835 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:57.765639 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8efadea7-80a0-4594-abf3-daed6a721817 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594" status: 200 len: 1168 microversion: 2.1 time: 0.433022 Oct 04 19:02:57.769225 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3074/6123] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:57 2022] GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594 => generated 1168 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:57.797649 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e264300d-cfaf-4830-b73d-d6b4801ab835 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:57.799247 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e264300d-cfaf-4830-b73d-d6b4801ab835 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:57.800532 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e264300d-cfaf-4830-b73d-d6b4801ab835 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18" status: 200 len: 1722 microversion: 2.20 time: 0.368437 Oct 04 19:02:57.804333 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3050/6124] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:02:57 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 => generated 1722 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:02:58.790158 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f49e45cd-4a63-49cb-8acb-a11ae5ff390c tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:58.791418 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f49e45cd-4a63-49cb-8acb-a11ae5ff390c tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 697578c4-b2ae-4229-b5d3-b03775a91594] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:58.812486 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f49e45cd-4a63-49cb-8acb-a11ae5ff390c tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:58.813199 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f49e45cd-4a63-49cb-8acb-a11ae5ff390c tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:58.813911 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f49e45cd-4a63-49cb-8acb-a11ae5ff390c tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:58.814568 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f49e45cd-4a63-49cb-8acb-a11ae5ff390c tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:58.815047 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f49e45cd-4a63-49cb-8acb-a11ae5ff390c tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:58.815471 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f49e45cd-4a63-49cb-8acb-a11ae5ff390c tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:58.836902 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-bbff6c47-e1c5-4e27-a854-4ca8e5579604 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:58.838659 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-bbff6c47-e1c5-4e27-a854-4ca8e5579604 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:58.849834 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bbff6c47-e1c5-4e27-a854-4ca8e5579604 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:58.850615 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bbff6c47-e1c5-4e27-a854-4ca8e5579604 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:58.851255 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bbff6c47-e1c5-4e27-a854-4ca8e5579604 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:58.852220 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bbff6c47-e1c5-4e27-a854-4ca8e5579604 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:58.853185 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bbff6c47-e1c5-4e27-a854-4ca8e5579604 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:58.854802 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bbff6c47-e1c5-4e27-a854-4ca8e5579604 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:59.041310 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-bbff6c47-e1c5-4e27-a854-4ca8e5579604 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:59.057035 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-bbff6c47-e1c5-4e27-a854-4ca8e5579604 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:59.065139 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-bbff6c47-e1c5-4e27-a854-4ca8e5579604 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:59.074219 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-bbff6c47-e1c5-4e27-a854-4ca8e5579604 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18" status: 200 len: 1656 microversion: 2.20 time: 0.242149 Oct 04 19:02:59.075310 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3051/6125] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:02:58 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 => generated 1656 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 19:02:59.160631 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f49e45cd-4a63-49cb-8acb-a11ae5ff390c tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:59.173860 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f49e45cd-4a63-49cb-8acb-a11ae5ff390c tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594" status: 200 len: 1168 microversion: 2.1 time: 0.387491 Oct 04 19:02:59.174454 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3075/6126] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:58 2022] GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594 => generated 1168 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:59.586590 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-4321a719-d3f0-4d22-9e8e-5a449a12aeef req-4fa7d489-7f31-49cd-9fcd-3d763201c9ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b882133-2fca-4df4-b228-46a12f538c18", "name": "network-vif-deleted", "tag": "1f37fede-c1b1-491b-bab1-5ad8cb57086e"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:02:59.637981 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-4321a719-d3f0-4d22-9e8e-5a449a12aeef req-4fa7d489-7f31-49cd-9fcd-3d763201c9ac service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:59.640700 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-4321a719-d3f0-4d22-9e8e-5a449a12aeef req-4fa7d489-7f31-49cd-9fcd-3d763201c9ac service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:59.641993 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-4321a719-d3f0-4d22-9e8e-5a449a12aeef req-4fa7d489-7f31-49cd-9fcd-3d763201c9ac service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:59.683154 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-4321a719-d3f0-4d22-9e8e-5a449a12aeef req-4fa7d489-7f31-49cd-9fcd-3d763201c9ac service nova] Creating event network-vif-deleted:1f37fede-c1b1-491b-bab1-5ad8cb57086e for instance 7b882133-2fca-4df4-b228-46a12f538c18 on n-h2-850501-14 Oct 04 19:02:59.692600 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-4321a719-d3f0-4d22-9e8e-5a449a12aeef req-4fa7d489-7f31-49cd-9fcd-3d763201c9ac service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110384 Oct 04 19:02:59.695198 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3052/6127] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:02:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:03:00.105112 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1682dc01-c636-4bcc-af4e-b77d6ea10861 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:00.106623 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1682dc01-c636-4bcc-af4e-b77d6ea10861 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:00.117900 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1682dc01-c636-4bcc-af4e-b77d6ea10861 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:00.119224 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1682dc01-c636-4bcc-af4e-b77d6ea10861 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:00.119900 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1682dc01-c636-4bcc-af4e-b77d6ea10861 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:00.120888 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1682dc01-c636-4bcc-af4e-b77d6ea10861 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:00.122019 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1682dc01-c636-4bcc-af4e-b77d6ea10861 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:00.122866 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1682dc01-c636-4bcc-af4e-b77d6ea10861 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:00.185481 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1682dc01-c636-4bcc-af4e-b77d6ea10861 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:00.186412 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1682dc01-c636-4bcc-af4e-b77d6ea10861 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:00.187075 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1682dc01-c636-4bcc-af4e-b77d6ea10861 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:00.191661 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-1682dc01-c636-4bcc-af4e-b77d6ea10861 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lazy-loading 'fault' on Instance uuid 7b882133-2fca-4df4-b228-46a12f538c18 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:03:00.212363 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-477b625f-4068-4721-a037-b38112878768 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:00.213720 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-477b625f-4068-4721-a037-b38112878768 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 697578c4-b2ae-4229-b5d3-b03775a91594] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:00.227228 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-477b625f-4068-4721-a037-b38112878768 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:00.230890 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-477b625f-4068-4721-a037-b38112878768 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:00.233494 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-477b625f-4068-4721-a037-b38112878768 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:00.233494 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-477b625f-4068-4721-a037-b38112878768 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:00.233494 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-477b625f-4068-4721-a037-b38112878768 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:00.233494 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-477b625f-4068-4721-a037-b38112878768 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:00.240716 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1682dc01-c636-4bcc-af4e-b77d6ea10861 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:00.251190 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1682dc01-c636-4bcc-af4e-b77d6ea10861 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:00.253378 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1682dc01-c636-4bcc-af4e-b77d6ea10861 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:00.254812 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1682dc01-c636-4bcc-af4e-b77d6ea10861 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18" status: 200 len: 1370 microversion: 2.20 time: 0.154046 Oct 04 19:03:00.255560 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3076/6128] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:03:00 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 => generated 1370 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:03:00.600332 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-477b625f-4068-4721-a037-b38112878768 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:00.616143 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-477b625f-4068-4721-a037-b38112878768 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594" status: 200 len: 1168 microversion: 2.1 time: 0.419893 Oct 04 19:03:00.616978 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3053/6129] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:00 2022] GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594 => generated 1168 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:01.286247 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2d00c11e-c9a5-46f5-896b-f19e870b6dba tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:01.287653 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2d00c11e-c9a5-46f5-896b-f19e870b6dba tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:01.304764 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2d00c11e-c9a5-46f5-896b-f19e870b6dba tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:01.305626 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2d00c11e-c9a5-46f5-896b-f19e870b6dba tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:01.306626 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2d00c11e-c9a5-46f5-896b-f19e870b6dba tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:01.307231 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2d00c11e-c9a5-46f5-896b-f19e870b6dba tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:01.307933 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2d00c11e-c9a5-46f5-896b-f19e870b6dba tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:01.308785 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2d00c11e-c9a5-46f5-896b-f19e870b6dba tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:01.364089 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2d00c11e-c9a5-46f5-896b-f19e870b6dba tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:01.364602 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2d00c11e-c9a5-46f5-896b-f19e870b6dba tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:01.365044 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2d00c11e-c9a5-46f5-896b-f19e870b6dba tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:01.365614 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-2d00c11e-c9a5-46f5-896b-f19e870b6dba tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lazy-loading 'fault' on Instance uuid 7b882133-2fca-4df4-b228-46a12f538c18 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:03:01.455556 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-2d00c11e-c9a5-46f5-896b-f19e870b6dba tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:01.468640 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-2d00c11e-c9a5-46f5-896b-f19e870b6dba tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:01.470094 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-2d00c11e-c9a5-46f5-896b-f19e870b6dba tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:01.471271 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2d00c11e-c9a5-46f5-896b-f19e870b6dba tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18" status: 200 len: 1370 microversion: 2.20 time: 0.190153 Oct 04 19:03:01.484862 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3077/6130] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:03:01 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 => generated 1370 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 19:03:01.640523 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4b75123c-06cb-403c-83d9-0f2192d55425 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:01.641880 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4b75123c-06cb-403c-83d9-0f2192d55425 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 697578c4-b2ae-4229-b5d3-b03775a91594] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:01.649401 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4b75123c-06cb-403c-83d9-0f2192d55425 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:01.650314 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4b75123c-06cb-403c-83d9-0f2192d55425 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:01.651005 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4b75123c-06cb-403c-83d9-0f2192d55425 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:01.651924 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4b75123c-06cb-403c-83d9-0f2192d55425 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:01.652465 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4b75123c-06cb-403c-83d9-0f2192d55425 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:01.653115 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4b75123c-06cb-403c-83d9-0f2192d55425 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:02.244082 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4b75123c-06cb-403c-83d9-0f2192d55425 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:02.245331 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4b75123c-06cb-403c-83d9-0f2192d55425 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594" status: 200 len: 1168 microversion: 2.1 time: 0.609940 Oct 04 19:03:02.272140 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3054/6131] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:01 2022] GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594 => generated 1168 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:03:02.505145 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d22f9d11-a2d5-41be-9740-5db7f7a88ab1 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:02.507291 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d22f9d11-a2d5-41be-9740-5db7f7a88ab1 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:02.525368 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d22f9d11-a2d5-41be-9740-5db7f7a88ab1 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:02.531847 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d22f9d11-a2d5-41be-9740-5db7f7a88ab1 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:02.536457 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d22f9d11-a2d5-41be-9740-5db7f7a88ab1 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:02.542726 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d22f9d11-a2d5-41be-9740-5db7f7a88ab1 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:02.543584 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d22f9d11-a2d5-41be-9740-5db7f7a88ab1 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:02.544344 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d22f9d11-a2d5-41be-9740-5db7f7a88ab1 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:02.570686 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-d22f9d11-a2d5-41be-9740-5db7f7a88ab1 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] HTTP exception thrown: Instance 7b882133-2fca-4df4-b228-46a12f538c18 could not be found. Oct 04 19:03:02.572777 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d22f9d11-a2d5-41be-9740-5db7f7a88ab1 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Request method failure captured: Oct 04 19:03:02.572777 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 HTTP/1.1 Oct 04 19:03:02.572777 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 19:03:02.572777 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 19:03:02.572777 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 19:03:02.572777 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 19:03:02.572777 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 19:03:02.572777 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 19:03:02.572777 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 19:03:02.572777 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 19:03:02.572777 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPIJWtqn1BwGSboHCu8dMzewnZ8z0DuMrXk7CBmt7J2yD6zV8noY5_3PNlOVNmZkdXJrIq5VXEFV2GVrqKuqlbTwmixwjxfydIbQmhN8Cj0z84NkNQ9kY0gslO7HP3WsSqTClXHCgfZWZX4qvaJKz6i5lve1xdtmOtzQ8xk6cnOBI-ow Oct 04 19:03:02.572777 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 19:03:02.572777 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 19:03:02.572777 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 19:03:02.572777 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 19:03:02.572777 n-d-850501-14 devstack@n-api.service[123001]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 19:03:02.572777 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 19:03:02.572777 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 19:03:02.572777 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: b56fe9a8df63477b883f958825dbeafa Oct 04 19:03:02.572777 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1807071435 Oct 04 19:03:02.572777 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 19:03:02.572777 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 19:03:02.572777 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b56fe9a8df63477b883f958825dbeafa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b56fe9a8df63477b883f958825dbeafa", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b56fe9a8df63477b883f958825dbeafa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b56fe9a8df63477b883f958825dbeafa"}]}] Oct 04 19:03:02.572777 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1807071435 Oct 04 19:03:02.572777 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: b56fe9a8df63477b883f958825dbeafa Oct 04 19:03:02.572777 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1807071435 Oct 04 19:03:02.572777 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-AttachVolumeShelveTestJSON-1807071435-project Oct 04 19:03:02.572777 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 19:03:02.572777 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 19:03:02.572777 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 46676c950dc043bda9b06a2bf8af3085 Oct 04 19:03:02.572777 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1807071435-project Oct 04 19:03:02.572777 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 19:03:02.572777 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 7b882133-2fca-4df4-b228-46a12f538c18 could not be found. Oct 04 19:03:02.572777 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '7b882133-2fca-4df4-b228-46a12f538c18'} Oct 04 19:03:02.572777 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:03:02.572777 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:03:02.572777 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:03:02.572777 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:03:02.572777 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:03:02.572777 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:03:02.572777 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:03:02.572777 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:03:02.572777 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:03:02.572777 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:03:02.572777 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b882133-2fca-4df4-b228-46a12f538c18 could not be found. Oct 04 19:03:02.572777 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:03:02.572777 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:03:02.572777 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:03:02.572777 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:03:02.572777 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:03:02.572777 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:03:02.572777 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:03:02.572777 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:03:02.572777 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:03:02.572777 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:03:02.572777 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:03:02.572777 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:03:02.572777 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:03:02.572777 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:03:02.572777 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:03:02.572777 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:03:02.572777 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b882133-2fca-4df4-b228-46a12f538c18 could not be found. Oct 04 19:03:02.572777 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:03:02.572777 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:03:02.579001 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:03:02.579001 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:03:02.579001 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:03:02.579001 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:03:02.579001 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:03:02.579001 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:03:02.579001 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b882133-2fca-4df4-b228-46a12f538c18 could not be found. Oct 04 19:03:02.579001 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:03:02.579001 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d22f9d11-a2d5-41be-9740-5db7f7a88ab1 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Returning 404 to user: Instance 7b882133-2fca-4df4-b228-46a12f538c18 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:03:02.579001 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d22f9d11-a2d5-41be-9740-5db7f7a88ab1 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18" status: 404 len: 111 microversion: 2.20 time: 0.078999 Oct 04 19:03:02.579001 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3078/6132] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:03:02 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 19:03:02.584865 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7305d023-6089-4a92-8b17-696843145e46 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '.version_select at 0x7fe253cf5790>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:02.722503 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7305d023-6089-4a92-8b17-696843145e46 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-574112895" status: 204 len: 0 microversion: 2.20 time: 0.141469 Oct 04 19:03:02.723566 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3055/6133] 10.222.0.20 () {60 vars in 1259 bytes} [Tue Oct 4 19:03:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-574112895 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 19:03:03.293470 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ed7827db-0d58-4af3-800c-888e58e95a67 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:03.294364 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ed7827db-0d58-4af3-800c-888e58e95a67 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 697578c4-b2ae-4229-b5d3-b03775a91594] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:03.336841 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ed7827db-0d58-4af3-800c-888e58e95a67 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:03.343260 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ed7827db-0d58-4af3-800c-888e58e95a67 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:03.344005 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ed7827db-0d58-4af3-800c-888e58e95a67 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:03.349889 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ed7827db-0d58-4af3-800c-888e58e95a67 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:03.350915 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ed7827db-0d58-4af3-800c-888e58e95a67 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:03.351964 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ed7827db-0d58-4af3-800c-888e58e95a67 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:03.707577 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ed7827db-0d58-4af3-800c-888e58e95a67 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:03.736194 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ed7827db-0d58-4af3-800c-888e58e95a67 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594" status: 200 len: 1168 microversion: 2.1 time: 0.448771 Oct 04 19:03:03.736786 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3079/6134] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:03 2022] GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594 => generated 1168 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:04.381930 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-dc73fef8-2280-4378-9edd-4bdb4c685626 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Action: 'create', calling method: .version_select at 0x7fe253f55940>, body: {"keypair": {"name": "tempest-keypair-1827792346", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIKQPw045LX6b++EtITOORHzy4uj6n0uWwJFw3TyJXywornPyBjAVBdZPXbvdjogK+0DUHb5kxgc/XG0D+H99SB2KlSFjTtbJnJSkD6dGRwD8e6VJDwSNIWMy37ZS2jlIw=="}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:03:04.403232 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-dc73fef8-2280-4378-9edd-4bdb4c685626 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Getting quotas for project b56fe9a8df63477b883f958825dbeafa. Resources: {'key_pairs'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:03:04.409605 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-dc73fef8-2280-4378-9edd-4bdb4c685626 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Getting quotas for user 46676c950dc043bda9b06a2bf8af3085 and project b56fe9a8df63477b883f958825dbeafa. Resources: {'key_pairs'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:03:04.557150 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-dc73fef8-2280-4378-9edd-4bdb4c685626 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.179908 Oct 04 19:03:04.558053 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3056/6135] 10.222.0.20 () {62 vars in 1200 bytes} [Tue Oct 4 19:03:04 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 182 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 04 19:03:04.767951 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8aecc9e5-1b10-467d-94ed-8cf5f7397f4a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:04.769230 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8aecc9e5-1b10-467d-94ed-8cf5f7397f4a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 697578c4-b2ae-4229-b5d3-b03775a91594] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:04.777024 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8aecc9e5-1b10-467d-94ed-8cf5f7397f4a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:04.777847 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8aecc9e5-1b10-467d-94ed-8cf5f7397f4a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:04.778599 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8aecc9e5-1b10-467d-94ed-8cf5f7397f4a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:04.779587 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8aecc9e5-1b10-467d-94ed-8cf5f7397f4a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:04.780357 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8aecc9e5-1b10-467d-94ed-8cf5f7397f4a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:04.781652 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8aecc9e5-1b10-467d-94ed-8cf5f7397f4a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:04.959052 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8aecc9e5-1b10-467d-94ed-8cf5f7397f4a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:04.970858 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8aecc9e5-1b10-467d-94ed-8cf5f7397f4a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594" status: 200 len: 1168 microversion: 2.1 time: 0.214124 Oct 04 19:03:04.971753 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3080/6136] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:04 2022] GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594 => generated 1168 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:03:05.994913 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c3cff235-e41f-4f59-9512-bff4dd04be9e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:05.996269 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c3cff235-e41f-4f59-9512-bff4dd04be9e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 697578c4-b2ae-4229-b5d3-b03775a91594] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:06.005456 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c3cff235-e41f-4f59-9512-bff4dd04be9e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:06.006205 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c3cff235-e41f-4f59-9512-bff4dd04be9e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:06.006833 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c3cff235-e41f-4f59-9512-bff4dd04be9e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:06.007589 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c3cff235-e41f-4f59-9512-bff4dd04be9e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:06.008274 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c3cff235-e41f-4f59-9512-bff4dd04be9e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:06.008866 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c3cff235-e41f-4f59-9512-bff4dd04be9e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:06.237876 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c3cff235-e41f-4f59-9512-bff4dd04be9e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:06.242779 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:03:06.251572 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c3cff235-e41f-4f59-9512-bff4dd04be9e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594" status: 200 len: 1168 microversion: 2.1 time: 0.261474 Oct 04 19:03:06.252191 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3057/6137] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:05 2022] GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594 => generated 1168 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:07.277452 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-bba382c8-0ec8-49b1-aa31-5edfd366d7f0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:07.279337 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-bba382c8-0ec8-49b1-aa31-5edfd366d7f0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 697578c4-b2ae-4229-b5d3-b03775a91594] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:07.289285 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bba382c8-0ec8-49b1-aa31-5edfd366d7f0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:07.290090 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bba382c8-0ec8-49b1-aa31-5edfd366d7f0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:07.290703 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bba382c8-0ec8-49b1-aa31-5edfd366d7f0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:07.292292 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bba382c8-0ec8-49b1-aa31-5edfd366d7f0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:07.302822 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bba382c8-0ec8-49b1-aa31-5edfd366d7f0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:07.303206 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bba382c8-0ec8-49b1-aa31-5edfd366d7f0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:07.582111 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-bba382c8-0ec8-49b1-aa31-5edfd366d7f0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:07.596672 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-bba382c8-0ec8-49b1-aa31-5edfd366d7f0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594" status: 200 len: 1168 microversion: 2.1 time: 0.323092 Oct 04 19:03:07.597892 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3081/6138] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:07 2022] GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594 => generated 1168 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:08.150922 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b3db1cb2-9f8e-481a-b11f-876aa30aea4f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:08.152248 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b3db1cb2-9f8e-481a-b11f-876aa30aea4f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: 6860257c-9998-4117-8aa4-b08bd2f8dc28] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:08.160046 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b3db1cb2-9f8e-481a-b11f-876aa30aea4f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:08.160814 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b3db1cb2-9f8e-481a-b11f-876aa30aea4f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:08.162592 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b3db1cb2-9f8e-481a-b11f-876aa30aea4f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:08.163586 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b3db1cb2-9f8e-481a-b11f-876aa30aea4f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:08.164479 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b3db1cb2-9f8e-481a-b11f-876aa30aea4f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:08.165119 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b3db1cb2-9f8e-481a-b11f-876aa30aea4f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:08.194193 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b3db1cb2-9f8e-481a-b11f-876aa30aea4f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/6860257c-9998-4117-8aa4-b08bd2f8dc28/ips" status: 200 len: 150 microversion: 2.1 time: 0.300741 Oct 04 19:03:08.195537 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3058/6139] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Oct 4 19:03:07 2022] GET /compute/v2.1/servers/6860257c-9998-4117-8aa4-b08bd2f8dc28/ips => generated 150 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:03:08.624138 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7e347390-6119-4430-aa28-b5796d34b867 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:08.625612 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7e347390-6119-4430-aa28-b5796d34b867 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 697578c4-b2ae-4229-b5d3-b03775a91594] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:08.639744 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7e347390-6119-4430-aa28-b5796d34b867 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:08.642700 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7e347390-6119-4430-aa28-b5796d34b867 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:08.643998 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7e347390-6119-4430-aa28-b5796d34b867 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:08.646336 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7e347390-6119-4430-aa28-b5796d34b867 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:08.649258 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7e347390-6119-4430-aa28-b5796d34b867 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:08.650440 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7e347390-6119-4430-aa28-b5796d34b867 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:08.704923 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-93729af0-7337-4f0f-a838-3e691f6dd8cf tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-672054401", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7a4ee582-93c3-413b-9115-b740d642f425"}], "security_groups": [{"name": "tempest-securitygroup--1575260125"}], "key_name": "tempest-keypair-1827792346", "user_data": "}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:03:09.145063 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-93729af0-7337-4f0f-a838-3e691f6dd8cf tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] validate_networks() for [('7a4ee582-93c3-413b-9115-b740d642f425', None, None, None, None, None)] {{(pid=123002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:03:09.214587 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7e347390-6119-4430-aa28-b5796d34b867 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:09.225575 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7e347390-6119-4430-aa28-b5796d34b867 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594" status: 200 len: 1202 microversion: 2.1 time: 0.606803 Oct 04 19:03:09.230972 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3082/6140] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:08 2022] GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594 => generated 1202 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:10.093151 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-93729af0-7337-4f0f-a838-3e691f6dd8cf tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:03:10.093748 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-93729af0-7337-4f0f-a838-3e691f6dd8cf tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:03:10.094166 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-93729af0-7337-4f0f-a838-3e691f6dd8cf tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:03:10.095100 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-93729af0-7337-4f0f-a838-3e691f6dd8cf tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:03:10.095213 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-93729af0-7337-4f0f-a838-3e691f6dd8cf tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:03:10.127777 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-93729af0-7337-4f0f-a838-3e691f6dd8cf tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:10.132782 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-93729af0-7337-4f0f-a838-3e691f6dd8cf tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:10.133593 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-93729af0-7337-4f0f-a838-3e691f6dd8cf tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:10.135187 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-93729af0-7337-4f0f-a838-3e691f6dd8cf tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:10.135856 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-93729af0-7337-4f0f-a838-3e691f6dd8cf tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:10.137057 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-93729af0-7337-4f0f-a838-3e691f6dd8cf tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:10.191253 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-93729af0-7337-4f0f-a838-3e691f6dd8cf tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Getting quotas for project b56fe9a8df63477b883f958825dbeafa. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:03:10.218784 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-93729af0-7337-4f0f-a838-3e691f6dd8cf tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Getting quotas for user 46676c950dc043bda9b06a2bf8af3085 and project b56fe9a8df63477b883f958825dbeafa. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:03:10.237172 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-93729af0-7337-4f0f-a838-3e691f6dd8cf tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Going to run 1 instances... {{(pid=123002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:03:10.240851 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-93729af0-7337-4f0f-a838-3e691f6dd8cf tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 0e957abd-68e7-48c3-af4b-74d570d41c15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:03:10.249906 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6fe7337e-8aa7-4d5d-aa48-fd4a5df64bd0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:10.250512 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6fe7337e-8aa7-4d5d-aa48-fd4a5df64bd0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 697578c4-b2ae-4229-b5d3-b03775a91594] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:10.260579 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6fe7337e-8aa7-4d5d-aa48-fd4a5df64bd0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:10.272903 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6fe7337e-8aa7-4d5d-aa48-fd4a5df64bd0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:10.273623 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6fe7337e-8aa7-4d5d-aa48-fd4a5df64bd0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:10.274535 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6fe7337e-8aa7-4d5d-aa48-fd4a5df64bd0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:10.275153 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6fe7337e-8aa7-4d5d-aa48-fd4a5df64bd0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:10.275752 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6fe7337e-8aa7-4d5d-aa48-fd4a5df64bd0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:10.282306 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:03:10.365356 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-93729af0-7337-4f0f-a838-3e691f6dd8cf tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.666617 Oct 04 19:03:10.372836 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3059/6141] 10.222.0.20 () {62 vars in 1188 bytes} [Tue Oct 4 19:03:08 2022] POST /compute/v2.1/servers => generated 402 bytes in 1675 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 04 19:03:10.378560 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-77616ddf-b4b9-47e6-8f03-28459cbbf600 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:10.379180 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-77616ddf-b4b9-47e6-8f03-28459cbbf600 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 0e957abd-68e7-48c3-af4b-74d570d41c15] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:10.552409 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-77616ddf-b4b9-47e6-8f03-28459cbbf600 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:10.564576 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-77616ddf-b4b9-47e6-8f03-28459cbbf600 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:10.580657 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-77616ddf-b4b9-47e6-8f03-28459cbbf600 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:10.581939 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-77616ddf-b4b9-47e6-8f03-28459cbbf600 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15" status: 200 len: 1281 microversion: 2.20 time: 0.207396 Oct 04 19:03:10.596337 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3060/6142] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:03:10 2022] GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15 => generated 1281 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:03:10.742321 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6fe7337e-8aa7-4d5d-aa48-fd4a5df64bd0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:10.774150 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6fe7337e-8aa7-4d5d-aa48-fd4a5df64bd0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594" status: 200 len: 1202 microversion: 2.1 time: 0.528576 Oct 04 19:03:10.775100 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3083/6143] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:10 2022] GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594 => generated 1202 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:11.245517 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-68e108ed-c674-4f42-b8b0-5e4a27156007 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "12ab43aa-6dc4-4ca7-9b4d-63f1ef524f8d"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:03:11.251398 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-68e108ed-c674-4f42-b8b0-5e4a27156007 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: 6860257c-9998-4117-8aa4-b08bd2f8dc28] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:11.266907 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-68e108ed-c674-4f42-b8b0-5e4a27156007 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:11.273137 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-68e108ed-c674-4f42-b8b0-5e4a27156007 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:11.273769 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-68e108ed-c674-4f42-b8b0-5e4a27156007 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:11.275913 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-68e108ed-c674-4f42-b8b0-5e4a27156007 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:11.276566 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-68e108ed-c674-4f42-b8b0-5e4a27156007 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:11.278766 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-68e108ed-c674-4f42-b8b0-5e4a27156007 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:11.606864 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d67669cb-7d1d-4a4b-b604-31ea61eac0c3 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:11.608248 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d67669cb-7d1d-4a4b-b604-31ea61eac0c3 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 0e957abd-68e7-48c3-af4b-74d570d41c15] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:11.615433 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d67669cb-7d1d-4a4b-b604-31ea61eac0c3 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:11.615989 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d67669cb-7d1d-4a4b-b604-31ea61eac0c3 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:11.616517 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d67669cb-7d1d-4a4b-b604-31ea61eac0c3 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:11.617317 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d67669cb-7d1d-4a4b-b604-31ea61eac0c3 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:11.617851 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d67669cb-7d1d-4a4b-b604-31ea61eac0c3 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:11.618345 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d67669cb-7d1d-4a4b-b604-31ea61eac0c3 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:11.757907 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d67669cb-7d1d-4a4b-b604-31ea61eac0c3 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:11.776590 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d67669cb-7d1d-4a4b-b604-31ea61eac0c3 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:11.778659 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d67669cb-7d1d-4a4b-b604-31ea61eac0c3 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:11.780446 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d67669cb-7d1d-4a4b-b604-31ea61eac0c3 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15" status: 200 len: 1285 microversion: 2.20 time: 0.177437 Oct 04 19:03:11.792021 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3084/6144] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:03:11 2022] GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15 => generated 1285 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 19:03:11.800635 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ad0fdcb7-3587-4a38-b73c-07bd2f5fb3a1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:11.800635 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ad0fdcb7-3587-4a38-b73c-07bd2f5fb3a1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 697578c4-b2ae-4229-b5d3-b03775a91594] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:11.808513 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ad0fdcb7-3587-4a38-b73c-07bd2f5fb3a1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:11.809328 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ad0fdcb7-3587-4a38-b73c-07bd2f5fb3a1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:11.819876 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ad0fdcb7-3587-4a38-b73c-07bd2f5fb3a1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:11.819876 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ad0fdcb7-3587-4a38-b73c-07bd2f5fb3a1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:11.819876 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ad0fdcb7-3587-4a38-b73c-07bd2f5fb3a1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:11.819876 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ad0fdcb7-3587-4a38-b73c-07bd2f5fb3a1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:12.008099 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ad0fdcb7-3587-4a38-b73c-07bd2f5fb3a1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:12.018875 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ad0fdcb7-3587-4a38-b73c-07bd2f5fb3a1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594" status: 200 len: 1202 microversion: 2.1 time: 0.224958 Oct 04 19:03:12.019670 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3085/6145] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:11 2022] GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594 => generated 1202 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:03:12.222914 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-68e108ed-c674-4f42-b8b0-5e4a27156007 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "POST /compute/v2.1/servers/6860257c-9998-4117-8aa4-b08bd2f8dc28/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.985273 Oct 04 19:03:12.223544 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3061/6146] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Oct 4 19:03:11 2022] POST /compute/v2.1/servers/6860257c-9998-4117-8aa4-b08bd2f8dc28/os-volume_attachments => generated 194 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:03:12.816245 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-96317078-7a0e-4adc-9c36-774e2dae0473 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:12.816887 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-96317078-7a0e-4adc-9c36-774e2dae0473 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 0e957abd-68e7-48c3-af4b-74d570d41c15] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:12.829126 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-96317078-7a0e-4adc-9c36-774e2dae0473 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:12.829628 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-96317078-7a0e-4adc-9c36-774e2dae0473 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:12.830066 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-96317078-7a0e-4adc-9c36-774e2dae0473 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:12.834819 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-96317078-7a0e-4adc-9c36-774e2dae0473 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:12.835393 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-96317078-7a0e-4adc-9c36-774e2dae0473 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:12.837441 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-96317078-7a0e-4adc-9c36-774e2dae0473 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:12.984662 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-96317078-7a0e-4adc-9c36-774e2dae0473 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:13.004343 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-96317078-7a0e-4adc-9c36-774e2dae0473 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:13.006470 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-96317078-7a0e-4adc-9c36-774e2dae0473 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:13.007866 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-96317078-7a0e-4adc-9c36-774e2dae0473 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15" status: 200 len: 1333 microversion: 2.20 time: 0.195961 Oct 04 19:03:13.009929 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3086/6147] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:03:12 2022] GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15 => generated 1333 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:03:13.044600 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-fb46a70f-479b-4e56-89d7-9f3436fe4c74 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:13.046764 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-fb46a70f-479b-4e56-89d7-9f3436fe4c74 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 697578c4-b2ae-4229-b5d3-b03775a91594] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:13.059811 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fb46a70f-479b-4e56-89d7-9f3436fe4c74 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:13.064159 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fb46a70f-479b-4e56-89d7-9f3436fe4c74 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:13.064839 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fb46a70f-479b-4e56-89d7-9f3436fe4c74 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:13.066320 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fb46a70f-479b-4e56-89d7-9f3436fe4c74 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:13.068162 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fb46a70f-479b-4e56-89d7-9f3436fe4c74 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:13.070183 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fb46a70f-479b-4e56-89d7-9f3436fe4c74 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:13.370223 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-fb46a70f-479b-4e56-89d7-9f3436fe4c74 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:13.383283 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-fb46a70f-479b-4e56-89d7-9f3436fe4c74 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594" status: 200 len: 1202 microversion: 2.1 time: 0.344132 Oct 04 19:03:13.385679 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3062/6148] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:13 2022] GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594 => generated 1202 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:14.036810 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-15119303-aab4-45ba-86e5-792e0cc8d9d7 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:14.038136 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-15119303-aab4-45ba-86e5-792e0cc8d9d7 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 0e957abd-68e7-48c3-af4b-74d570d41c15] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:14.053496 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-15119303-aab4-45ba-86e5-792e0cc8d9d7 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:14.055390 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-15119303-aab4-45ba-86e5-792e0cc8d9d7 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:14.059523 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-15119303-aab4-45ba-86e5-792e0cc8d9d7 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:14.060632 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-15119303-aab4-45ba-86e5-792e0cc8d9d7 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:14.061931 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-15119303-aab4-45ba-86e5-792e0cc8d9d7 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:14.062555 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-15119303-aab4-45ba-86e5-792e0cc8d9d7 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:14.196453 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-15119303-aab4-45ba-86e5-792e0cc8d9d7 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:14.213954 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-15119303-aab4-45ba-86e5-792e0cc8d9d7 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:14.216303 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-15119303-aab4-45ba-86e5-792e0cc8d9d7 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:14.218431 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-15119303-aab4-45ba-86e5-792e0cc8d9d7 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15" status: 200 len: 1339 microversion: 2.20 time: 0.185621 Oct 04 19:03:14.219558 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3087/6149] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:03:14 2022] GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15 => generated 1339 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:03:14.414704 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ea1b9717-371e-409d-ad50-70c0412c148d tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:14.414704 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ea1b9717-371e-409d-ad50-70c0412c148d tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 697578c4-b2ae-4229-b5d3-b03775a91594] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:14.422603 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=73,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:03:14.424186 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ea1b9717-371e-409d-ad50-70c0412c148d tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:14.424682 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ea1b9717-371e-409d-ad50-70c0412c148d tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:14.425123 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ea1b9717-371e-409d-ad50-70c0412c148d tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:14.426017 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ea1b9717-371e-409d-ad50-70c0412c148d tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:14.426477 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ea1b9717-371e-409d-ad50-70c0412c148d tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:14.426905 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ea1b9717-371e-409d-ad50-70c0412c148d tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:14.938476 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ea1b9717-371e-409d-ad50-70c0412c148d tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:14.957104 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ea1b9717-371e-409d-ad50-70c0412c148d tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594" status: 200 len: 1202 microversion: 2.1 time: 0.552617 Oct 04 19:03:14.973131 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3063/6150] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:14 2022] GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594 => generated 1202 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:15.247702 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-cacf6a66-662e-4baa-94fe-6ef5c41fb42e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:15.249439 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-cacf6a66-662e-4baa-94fe-6ef5c41fb42e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 0e957abd-68e7-48c3-af4b-74d570d41c15] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:15.265826 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cacf6a66-662e-4baa-94fe-6ef5c41fb42e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:15.265826 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cacf6a66-662e-4baa-94fe-6ef5c41fb42e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:15.265826 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cacf6a66-662e-4baa-94fe-6ef5c41fb42e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:15.265826 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cacf6a66-662e-4baa-94fe-6ef5c41fb42e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:15.265826 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cacf6a66-662e-4baa-94fe-6ef5c41fb42e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:15.265826 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cacf6a66-662e-4baa-94fe-6ef5c41fb42e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:15.615028 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-cacf6a66-662e-4baa-94fe-6ef5c41fb42e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:15.630705 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-cacf6a66-662e-4baa-94fe-6ef5c41fb42e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:15.637012 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-cacf6a66-662e-4baa-94fe-6ef5c41fb42e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:15.639316 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-cacf6a66-662e-4baa-94fe-6ef5c41fb42e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15" status: 200 len: 1407 microversion: 2.20 time: 0.395452 Oct 04 19:03:15.641871 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3088/6151] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:03:15 2022] GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15 => generated 1407 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:03:15.982317 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-961b541b-4d24-4f97-9980-308e54412934 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:15.983838 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-961b541b-4d24-4f97-9980-308e54412934 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 697578c4-b2ae-4229-b5d3-b03775a91594] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:15.998811 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-961b541b-4d24-4f97-9980-308e54412934 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:15.999453 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-961b541b-4d24-4f97-9980-308e54412934 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:16.000168 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-961b541b-4d24-4f97-9980-308e54412934 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:16.002410 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-961b541b-4d24-4f97-9980-308e54412934 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:16.002890 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-961b541b-4d24-4f97-9980-308e54412934 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:16.003322 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-961b541b-4d24-4f97-9980-308e54412934 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:16.495266 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-961b541b-4d24-4f97-9980-308e54412934 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:16.504608 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-961b541b-4d24-4f97-9980-308e54412934 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594" status: 200 len: 1202 microversion: 2.1 time: 0.526690 Oct 04 19:03:16.510940 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3064/6152] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:15 2022] GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594 => generated 1202 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:16.674148 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-756514a9-441a-40ce-9070-b75491565cff tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:16.675962 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-756514a9-441a-40ce-9070-b75491565cff tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 0e957abd-68e7-48c3-af4b-74d570d41c15] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:16.700373 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-756514a9-441a-40ce-9070-b75491565cff tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:16.702884 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-756514a9-441a-40ce-9070-b75491565cff tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:16.705318 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-756514a9-441a-40ce-9070-b75491565cff tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:16.708150 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-756514a9-441a-40ce-9070-b75491565cff tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:16.712654 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-756514a9-441a-40ce-9070-b75491565cff tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:16.715397 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-756514a9-441a-40ce-9070-b75491565cff tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:17.052433 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-ba972ab0-3f46-48f4-a283-5738901579bc req-3d934ab6-da60-41d5-9677-67e1d81630fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e957abd-68e7-48c3-af4b-74d570d41c15", "tag": "a324d908-a426-4333-ae46-4fc6e0230e67"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:03:17.109476 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-ba972ab0-3f46-48f4-a283-5738901579bc req-3d934ab6-da60-41d5-9677-67e1d81630fb service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:17.111899 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-ba972ab0-3f46-48f4-a283-5738901579bc req-3d934ab6-da60-41d5-9677-67e1d81630fb service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:17.111899 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-ba972ab0-3f46-48f4-a283-5738901579bc req-3d934ab6-da60-41d5-9677-67e1d81630fb service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:17.174752 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-ba972ab0-3f46-48f4-a283-5738901579bc req-3d934ab6-da60-41d5-9677-67e1d81630fb service nova] Creating event network-changed:a324d908-a426-4333-ae46-4fc6e0230e67 for instance 0e957abd-68e7-48c3-af4b-74d570d41c15 on n-h2-850501-14 Oct 04 19:03:17.187114 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-ba972ab0-3f46-48f4-a283-5738901579bc req-3d934ab6-da60-41d5-9677-67e1d81630fb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.147713 Oct 04 19:03:17.190776 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3065/6153] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:03:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:03:17.314311 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-756514a9-441a-40ce-9070-b75491565cff tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:17.326588 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-756514a9-441a-40ce-9070-b75491565cff tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:17.333706 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-756514a9-441a-40ce-9070-b75491565cff tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:17.335705 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-756514a9-441a-40ce-9070-b75491565cff tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15" status: 200 len: 1407 microversion: 2.20 time: 0.670433 Oct 04 19:03:17.337756 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3089/6154] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:03:16 2022] GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15 => generated 1407 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:03:17.534037 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0c85c872-684c-464f-9f95-d2c66fa5f6b2 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:17.534917 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0c85c872-684c-464f-9f95-d2c66fa5f6b2 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 697578c4-b2ae-4229-b5d3-b03775a91594] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:17.548772 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0c85c872-684c-464f-9f95-d2c66fa5f6b2 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:17.552466 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0c85c872-684c-464f-9f95-d2c66fa5f6b2 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:17.552466 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0c85c872-684c-464f-9f95-d2c66fa5f6b2 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:17.552466 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0c85c872-684c-464f-9f95-d2c66fa5f6b2 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:17.552466 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0c85c872-684c-464f-9f95-d2c66fa5f6b2 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:17.552466 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0c85c872-684c-464f-9f95-d2c66fa5f6b2 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:17.961418 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0c85c872-684c-464f-9f95-d2c66fa5f6b2 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:17.963917 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-61623992-dc6e-4215-a9b8-77e7d9ee682a req-c194d7a4-7a8d-431f-9b0b-fab3ff92f0e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "697578c4-b2ae-4229-b5d3-b03775a91594", "name": "network-vif-plugged", "status": "completed", "tag": "d1b8318d-581b-46bc-a909-4c3a42f5756a"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:03:17.975101 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0c85c872-684c-464f-9f95-d2c66fa5f6b2 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594" status: 200 len: 1202 microversion: 2.1 time: 0.447751 Oct 04 19:03:17.977336 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-61623992-dc6e-4215-a9b8-77e7d9ee682a req-c194d7a4-7a8d-431f-9b0b-fab3ff92f0e0 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:17.978044 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-61623992-dc6e-4215-a9b8-77e7d9ee682a req-c194d7a4-7a8d-431f-9b0b-fab3ff92f0e0 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:17.978659 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-61623992-dc6e-4215-a9b8-77e7d9ee682a req-c194d7a4-7a8d-431f-9b0b-fab3ff92f0e0 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:17.984214 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3066/6155] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:17 2022] GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594 => generated 1202 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:03:18.000157 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-61623992-dc6e-4215-a9b8-77e7d9ee682a req-c194d7a4-7a8d-431f-9b0b-fab3ff92f0e0 service nova] Creating event network-vif-plugged:d1b8318d-581b-46bc-a909-4c3a42f5756a for instance 697578c4-b2ae-4229-b5d3-b03775a91594 on n-h1-850501-14 Oct 04 19:03:18.005901 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-61623992-dc6e-4215-a9b8-77e7d9ee682a req-c194d7a4-7a8d-431f-9b0b-fab3ff92f0e0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045785 Oct 04 19:03:18.013924 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3090/6156] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:03:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:03:18.365657 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1eb08f99-738b-4e5a-acc3-95ef9d8fd293 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:18.366123 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1eb08f99-738b-4e5a-acc3-95ef9d8fd293 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 0e957abd-68e7-48c3-af4b-74d570d41c15] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:18.380222 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1eb08f99-738b-4e5a-acc3-95ef9d8fd293 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:18.380222 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1eb08f99-738b-4e5a-acc3-95ef9d8fd293 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:18.380222 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1eb08f99-738b-4e5a-acc3-95ef9d8fd293 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:18.380222 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1eb08f99-738b-4e5a-acc3-95ef9d8fd293 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:18.380222 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1eb08f99-738b-4e5a-acc3-95ef9d8fd293 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:18.392535 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1eb08f99-738b-4e5a-acc3-95ef9d8fd293 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:18.675798 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1eb08f99-738b-4e5a-acc3-95ef9d8fd293 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:18.691978 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1eb08f99-738b-4e5a-acc3-95ef9d8fd293 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:18.693465 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1eb08f99-738b-4e5a-acc3-95ef9d8fd293 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:18.694819 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1eb08f99-738b-4e5a-acc3-95ef9d8fd293 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15" status: 200 len: 1407 microversion: 2.20 time: 0.333673 Oct 04 19:03:18.695731 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3067/6157] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:03:18 2022] GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15 => generated 1407 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 19:03:19.005400 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-250bb04f-0810-45cc-8e35-0f0555aa0392 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:19.006319 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-250bb04f-0810-45cc-8e35-0f0555aa0392 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 697578c4-b2ae-4229-b5d3-b03775a91594] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:19.014718 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-250bb04f-0810-45cc-8e35-0f0555aa0392 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:19.015363 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-250bb04f-0810-45cc-8e35-0f0555aa0392 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:19.016559 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-250bb04f-0810-45cc-8e35-0f0555aa0392 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:19.017404 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-250bb04f-0810-45cc-8e35-0f0555aa0392 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:19.017978 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-250bb04f-0810-45cc-8e35-0f0555aa0392 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:19.018564 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-250bb04f-0810-45cc-8e35-0f0555aa0392 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:19.728842 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4a53240d-5b40-47f0-b99a-af8a9b924cc6 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:19.729567 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4a53240d-5b40-47f0-b99a-af8a9b924cc6 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 0e957abd-68e7-48c3-af4b-74d570d41c15] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:19.738126 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4a53240d-5b40-47f0-b99a-af8a9b924cc6 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:19.739729 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4a53240d-5b40-47f0-b99a-af8a9b924cc6 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:19.740529 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4a53240d-5b40-47f0-b99a-af8a9b924cc6 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:19.742069 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4a53240d-5b40-47f0-b99a-af8a9b924cc6 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:19.742803 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4a53240d-5b40-47f0-b99a-af8a9b924cc6 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:19.743548 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4a53240d-5b40-47f0-b99a-af8a9b924cc6 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:19.771163 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-250bb04f-0810-45cc-8e35-0f0555aa0392 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:19.781014 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-250bb04f-0810-45cc-8e35-0f0555aa0392 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594" status: 200 len: 1202 microversion: 2.1 time: 0.784413 Oct 04 19:03:19.795526 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3091/6158] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:18 2022] GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594 => generated 1202 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:19.981608 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4a53240d-5b40-47f0-b99a-af8a9b924cc6 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:19.991019 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4a53240d-5b40-47f0-b99a-af8a9b924cc6 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:19.992515 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4a53240d-5b40-47f0-b99a-af8a9b924cc6 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:19.993660 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4a53240d-5b40-47f0-b99a-af8a9b924cc6 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15" status: 200 len: 1407 microversion: 2.20 time: 0.269348 Oct 04 19:03:19.996652 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3068/6159] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:03:19 2022] GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15 => generated 1407 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 19:03:20.807305 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b6956efd-99d8-4c97-a252-2c095a8b2a1a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:20.807775 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b6956efd-99d8-4c97-a252-2c095a8b2a1a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 697578c4-b2ae-4229-b5d3-b03775a91594] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:20.824201 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b6956efd-99d8-4c97-a252-2c095a8b2a1a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:20.824792 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b6956efd-99d8-4c97-a252-2c095a8b2a1a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:20.826476 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b6956efd-99d8-4c97-a252-2c095a8b2a1a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:20.827597 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b6956efd-99d8-4c97-a252-2c095a8b2a1a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:20.829522 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b6956efd-99d8-4c97-a252-2c095a8b2a1a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:20.831736 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b6956efd-99d8-4c97-a252-2c095a8b2a1a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:21.019795 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5da9e3e0-134f-4ca4-8488-2d0f80b9867d tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:21.021255 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5da9e3e0-134f-4ca4-8488-2d0f80b9867d tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 0e957abd-68e7-48c3-af4b-74d570d41c15] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:21.032607 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:03:21.039924 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=12 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:03:21.048258 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5da9e3e0-134f-4ca4-8488-2d0f80b9867d tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:21.050031 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5da9e3e0-134f-4ca4-8488-2d0f80b9867d tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:21.050512 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5da9e3e0-134f-4ca4-8488-2d0f80b9867d tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:21.054823 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5da9e3e0-134f-4ca4-8488-2d0f80b9867d tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:21.056883 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5da9e3e0-134f-4ca4-8488-2d0f80b9867d tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:21.057349 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5da9e3e0-134f-4ca4-8488-2d0f80b9867d tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:21.096976 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b6956efd-99d8-4c97-a252-2c095a8b2a1a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:21.119774 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b6956efd-99d8-4c97-a252-2c095a8b2a1a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594" status: 200 len: 1389 microversion: 2.1 time: 0.318413 Oct 04 19:03:21.120710 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3092/6160] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:20 2022] GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594 => generated 1389 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:21.151980 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7105b595-1631-4af8-b75c-3b17332b9b42 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:21.153312 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7105b595-1631-4af8-b75c-3b17332b9b42 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 697578c4-b2ae-4229-b5d3-b03775a91594] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:21.166110 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7105b595-1631-4af8-b75c-3b17332b9b42 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:21.173169 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7105b595-1631-4af8-b75c-3b17332b9b42 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:21.174145 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7105b595-1631-4af8-b75c-3b17332b9b42 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:21.175250 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7105b595-1631-4af8-b75c-3b17332b9b42 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:21.182316 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7105b595-1631-4af8-b75c-3b17332b9b42 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:21.183709 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7105b595-1631-4af8-b75c-3b17332b9b42 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:21.545679 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5da9e3e0-134f-4ca4-8488-2d0f80b9867d tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:21.556666 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7105b595-1631-4af8-b75c-3b17332b9b42 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:21.557537 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5da9e3e0-134f-4ca4-8488-2d0f80b9867d tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:21.564734 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5da9e3e0-134f-4ca4-8488-2d0f80b9867d tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:21.565858 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5da9e3e0-134f-4ca4-8488-2d0f80b9867d tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15" status: 200 len: 1407 microversion: 2.20 time: 0.550707 Oct 04 19:03:21.566161 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7105b595-1631-4af8-b75c-3b17332b9b42 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594" status: 200 len: 1389 microversion: 2.1 time: 0.418146 Oct 04 19:03:21.569134 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3069/6161] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:03:21 2022] GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15 => generated 1407 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:03:21.573566 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3093/6162] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:21 2022] GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594 => generated 1389 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:21.593614 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ba7abb1e-c9ba-4ccc-9e69-26aca828835f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:21.594481 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ba7abb1e-c9ba-4ccc-9e69-26aca828835f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 697578c4-b2ae-4229-b5d3-b03775a91594] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:21.601332 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ba7abb1e-c9ba-4ccc-9e69-26aca828835f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:21.602242 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ba7abb1e-c9ba-4ccc-9e69-26aca828835f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:21.602902 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ba7abb1e-c9ba-4ccc-9e69-26aca828835f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:21.604194 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ba7abb1e-c9ba-4ccc-9e69-26aca828835f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:21.604839 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ba7abb1e-c9ba-4ccc-9e69-26aca828835f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:21.605443 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ba7abb1e-c9ba-4ccc-9e69-26aca828835f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:21.849498 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ba7abb1e-c9ba-4ccc-9e69-26aca828835f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:21.861265 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ba7abb1e-c9ba-4ccc-9e69-26aca828835f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594" status: 200 len: 1389 microversion: 2.1 time: 0.271570 Oct 04 19:03:21.862342 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3070/6163] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:21 2022] GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594 => generated 1389 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:21.970324 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b8cc4d3d-b8fc-436a-a04e-0768075b9839 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:21.971465 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b8cc4d3d-b8fc-436a-a04e-0768075b9839 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 697578c4-b2ae-4229-b5d3-b03775a91594] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:21.978790 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b8cc4d3d-b8fc-436a-a04e-0768075b9839 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:21.979284 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b8cc4d3d-b8fc-436a-a04e-0768075b9839 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:21.979731 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b8cc4d3d-b8fc-436a-a04e-0768075b9839 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:21.980462 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b8cc4d3d-b8fc-436a-a04e-0768075b9839 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:21.980927 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b8cc4d3d-b8fc-436a-a04e-0768075b9839 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:21.981357 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b8cc4d3d-b8fc-436a-a04e-0768075b9839 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:22.012742 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b8cc4d3d-b8fc-436a-a04e-0768075b9839 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 697578c4-b2ae-4229-b5d3-b03775a91594] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:03:22.241716 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:03:22.346855 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b8cc4d3d-b8fc-436a-a04e-0768075b9839 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "DELETE /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594" status: 204 len: 0 microversion: 2.1 time: 0.378122 Oct 04 19:03:22.346855 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3094/6164] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 19:03:21 2022] DELETE /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:03:22.353100 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-44285d2a-8554-4830-83ee-8fa4d597051c tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:22.354659 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-44285d2a-8554-4830-83ee-8fa4d597051c tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 697578c4-b2ae-4229-b5d3-b03775a91594] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:22.363482 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-44285d2a-8554-4830-83ee-8fa4d597051c tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:22.364332 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-44285d2a-8554-4830-83ee-8fa4d597051c tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:22.364967 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-44285d2a-8554-4830-83ee-8fa4d597051c tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:22.369896 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-44285d2a-8554-4830-83ee-8fa4d597051c tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:22.369896 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-44285d2a-8554-4830-83ee-8fa4d597051c tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:22.369896 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-44285d2a-8554-4830-83ee-8fa4d597051c tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:22.551210 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-44285d2a-8554-4830-83ee-8fa4d597051c tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:22.563221 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-44285d2a-8554-4830-83ee-8fa4d597051c tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594" status: 200 len: 1395 microversion: 2.1 time: 0.213819 Oct 04 19:03:22.565312 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3071/6165] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:22 2022] GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594 => generated 1395 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:22.611224 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-42720f95-8f0a-48f5-a85c-866e935b6a53 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:22.614496 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-42720f95-8f0a-48f5-a85c-866e935b6a53 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 0e957abd-68e7-48c3-af4b-74d570d41c15] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:22.622119 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-42720f95-8f0a-48f5-a85c-866e935b6a53 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:22.623866 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-42720f95-8f0a-48f5-a85c-866e935b6a53 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:22.625956 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-42720f95-8f0a-48f5-a85c-866e935b6a53 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:22.626874 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-42720f95-8f0a-48f5-a85c-866e935b6a53 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:22.627520 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-42720f95-8f0a-48f5-a85c-866e935b6a53 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:22.628284 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-42720f95-8f0a-48f5-a85c-866e935b6a53 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:22.875129 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-42720f95-8f0a-48f5-a85c-866e935b6a53 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:22.886156 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-42720f95-8f0a-48f5-a85c-866e935b6a53 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:22.889216 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-42720f95-8f0a-48f5-a85c-866e935b6a53 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:22.890128 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-42720f95-8f0a-48f5-a85c-866e935b6a53 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15" status: 200 len: 1407 microversion: 2.20 time: 0.295442 Oct 04 19:03:22.891317 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3095/6166] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:03:22 2022] GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15 => generated 1407 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:03:23.586728 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1eaf1b63-eefd-4624-8777-c6bfff903c9e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:23.587854 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1eaf1b63-eefd-4624-8777-c6bfff903c9e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 697578c4-b2ae-4229-b5d3-b03775a91594] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:23.595577 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1eaf1b63-eefd-4624-8777-c6bfff903c9e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:23.596297 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1eaf1b63-eefd-4624-8777-c6bfff903c9e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:23.596902 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1eaf1b63-eefd-4624-8777-c6bfff903c9e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:23.606629 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1eaf1b63-eefd-4624-8777-c6bfff903c9e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:23.606629 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1eaf1b63-eefd-4624-8777-c6bfff903c9e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:23.606629 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1eaf1b63-eefd-4624-8777-c6bfff903c9e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:23.780908 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1eaf1b63-eefd-4624-8777-c6bfff903c9e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:23.793631 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1eaf1b63-eefd-4624-8777-c6bfff903c9e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594" status: 200 len: 1395 microversion: 2.1 time: 0.210082 Oct 04 19:03:23.794869 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3072/6167] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:23 2022] GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594 => generated 1395 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:23.923806 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-04145047-3f86-4e18-af4e-f0176d0c5ab6 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:23.927195 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-04145047-3f86-4e18-af4e-f0176d0c5ab6 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 0e957abd-68e7-48c3-af4b-74d570d41c15] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:23.932972 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-04145047-3f86-4e18-af4e-f0176d0c5ab6 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:23.933464 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-04145047-3f86-4e18-af4e-f0176d0c5ab6 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:23.934178 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-04145047-3f86-4e18-af4e-f0176d0c5ab6 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:23.934917 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-04145047-3f86-4e18-af4e-f0176d0c5ab6 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:23.935953 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-04145047-3f86-4e18-af4e-f0176d0c5ab6 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:23.936946 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-04145047-3f86-4e18-af4e-f0176d0c5ab6 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:24.155770 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-04145047-3f86-4e18-af4e-f0176d0c5ab6 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:24.169437 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-04145047-3f86-4e18-af4e-f0176d0c5ab6 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:24.172312 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-04145047-3f86-4e18-af4e-f0176d0c5ab6 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:24.174103 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-04145047-3f86-4e18-af4e-f0176d0c5ab6 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15" status: 200 len: 1407 microversion: 2.20 time: 0.261294 Oct 04 19:03:24.174901 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3096/6168] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:03:23 2022] GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15 => generated 1407 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:03:24.763053 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-e8087235-8dfa-4022-bb11-c1034e2e6fd6 req-b3259649-60db-41d1-a431-19d261ca9223 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "697578c4-b2ae-4229-b5d3-b03775a91594", "name": "network-vif-deleted", "tag": "d1b8318d-581b-46bc-a909-4c3a42f5756a"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:03:24.775808 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-e8087235-8dfa-4022-bb11-c1034e2e6fd6 req-b3259649-60db-41d1-a431-19d261ca9223 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:24.776351 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-e8087235-8dfa-4022-bb11-c1034e2e6fd6 req-b3259649-60db-41d1-a431-19d261ca9223 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:24.776802 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-e8087235-8dfa-4022-bb11-c1034e2e6fd6 req-b3259649-60db-41d1-a431-19d261ca9223 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:24.792362 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-e8087235-8dfa-4022-bb11-c1034e2e6fd6 req-b3259649-60db-41d1-a431-19d261ca9223 service nova] Creating event network-vif-deleted:d1b8318d-581b-46bc-a909-4c3a42f5756a for instance 697578c4-b2ae-4229-b5d3-b03775a91594 on n-h1-850501-14 Oct 04 19:03:24.800682 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-e8087235-8dfa-4022-bb11-c1034e2e6fd6 req-b3259649-60db-41d1-a431-19d261ca9223 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.190332 Oct 04 19:03:24.801865 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3073/6169] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:03:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:03:24.819200 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-31f32f47-a5cb-4472-ae30-06c66ff658d6 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:24.819926 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-31f32f47-a5cb-4472-ae30-06c66ff658d6 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 697578c4-b2ae-4229-b5d3-b03775a91594] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:24.839920 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-31f32f47-a5cb-4472-ae30-06c66ff658d6 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:24.844828 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-31f32f47-a5cb-4472-ae30-06c66ff658d6 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:24.845499 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-31f32f47-a5cb-4472-ae30-06c66ff658d6 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:24.849227 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-31f32f47-a5cb-4472-ae30-06c66ff658d6 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:24.849931 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-31f32f47-a5cb-4472-ae30-06c66ff658d6 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:24.851357 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-31f32f47-a5cb-4472-ae30-06c66ff658d6 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:24.937460 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-31f32f47-a5cb-4472-ae30-06c66ff658d6 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:24.948800 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-31f32f47-a5cb-4472-ae30-06c66ff658d6 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594" status: 200 len: 1187 microversion: 2.1 time: 0.134465 Oct 04 19:03:24.949966 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3097/6170] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:24 2022] GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594 => generated 1187 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:25.065242 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-6d6c658f-7e9d-47ac-a232-7ce866a3962b req-e0da534d-0707-4447-bd89-cab0c20d76c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e957abd-68e7-48c3-af4b-74d570d41c15", "name": "network-vif-plugged", "status": "completed", "tag": "a324d908-a426-4333-ae46-4fc6e0230e67"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:03:25.078082 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-6d6c658f-7e9d-47ac-a232-7ce866a3962b req-e0da534d-0707-4447-bd89-cab0c20d76c4 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:25.078571 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-6d6c658f-7e9d-47ac-a232-7ce866a3962b req-e0da534d-0707-4447-bd89-cab0c20d76c4 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:25.079003 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-6d6c658f-7e9d-47ac-a232-7ce866a3962b req-e0da534d-0707-4447-bd89-cab0c20d76c4 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:25.091422 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-6d6c658f-7e9d-47ac-a232-7ce866a3962b req-e0da534d-0707-4447-bd89-cab0c20d76c4 service nova] Creating event network-vif-plugged:a324d908-a426-4333-ae46-4fc6e0230e67 for instance 0e957abd-68e7-48c3-af4b-74d570d41c15 on n-h2-850501-14 Oct 04 19:03:25.097578 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-6d6c658f-7e9d-47ac-a232-7ce866a3962b req-e0da534d-0707-4447-bd89-cab0c20d76c4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038098 Oct 04 19:03:25.098522 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3074/6171] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:03:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:03:25.206839 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-83f5328b-ec77-4296-925f-e1a60834b39f tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:25.207449 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-83f5328b-ec77-4296-925f-e1a60834b39f tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 0e957abd-68e7-48c3-af4b-74d570d41c15] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:25.239216 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-83f5328b-ec77-4296-925f-e1a60834b39f tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:25.239975 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-83f5328b-ec77-4296-925f-e1a60834b39f tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:25.240737 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-83f5328b-ec77-4296-925f-e1a60834b39f tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:25.241651 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-83f5328b-ec77-4296-925f-e1a60834b39f tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:25.242280 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-83f5328b-ec77-4296-925f-e1a60834b39f tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:25.243426 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-83f5328b-ec77-4296-925f-e1a60834b39f tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:25.460631 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-83f5328b-ec77-4296-925f-e1a60834b39f tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:25.468733 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:03:25.476403 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-83f5328b-ec77-4296-925f-e1a60834b39f tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:25.478623 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-83f5328b-ec77-4296-925f-e1a60834b39f tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:25.481510 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-83f5328b-ec77-4296-925f-e1a60834b39f tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15" status: 200 len: 1407 microversion: 2.20 time: 0.278206 Oct 04 19:03:25.483216 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3098/6172] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:03:25 2022] GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15 => generated 1407 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:03:25.976821 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e962301a-ce02-4ea9-9039-efb1d5c2543b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:25.978242 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e962301a-ce02-4ea9-9039-efb1d5c2543b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 697578c4-b2ae-4229-b5d3-b03775a91594] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:25.997210 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e962301a-ce02-4ea9-9039-efb1d5c2543b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:25.997733 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e962301a-ce02-4ea9-9039-efb1d5c2543b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:25.999460 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e962301a-ce02-4ea9-9039-efb1d5c2543b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:26.000997 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e962301a-ce02-4ea9-9039-efb1d5c2543b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:26.002658 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e962301a-ce02-4ea9-9039-efb1d5c2543b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:26.003446 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e962301a-ce02-4ea9-9039-efb1d5c2543b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:26.096503 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e962301a-ce02-4ea9-9039-efb1d5c2543b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:26.106424 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e962301a-ce02-4ea9-9039-efb1d5c2543b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594" status: 200 len: 1187 microversion: 2.1 time: 0.135662 Oct 04 19:03:26.121718 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3075/6173] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:25 2022] GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594 => generated 1187 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:26.508185 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b6cc932e-f9ae-4379-9ba9-6268cb8d4982 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:26.509434 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b6cc932e-f9ae-4379-9ba9-6268cb8d4982 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 0e957abd-68e7-48c3-af4b-74d570d41c15] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:26.518924 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b6cc932e-f9ae-4379-9ba9-6268cb8d4982 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:26.519364 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b6cc932e-f9ae-4379-9ba9-6268cb8d4982 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:26.519866 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b6cc932e-f9ae-4379-9ba9-6268cb8d4982 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:26.520821 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b6cc932e-f9ae-4379-9ba9-6268cb8d4982 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:26.521268 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b6cc932e-f9ae-4379-9ba9-6268cb8d4982 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:26.521754 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b6cc932e-f9ae-4379-9ba9-6268cb8d4982 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:26.720790 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b6cc932e-f9ae-4379-9ba9-6268cb8d4982 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:26.733828 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b6cc932e-f9ae-4379-9ba9-6268cb8d4982 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:26.736538 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b6cc932e-f9ae-4379-9ba9-6268cb8d4982 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:26.738406 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b6cc932e-f9ae-4379-9ba9-6268cb8d4982 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15" status: 200 len: 1407 microversion: 2.20 time: 0.234224 Oct 04 19:03:26.759791 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3099/6174] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:03:26 2022] GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15 => generated 1407 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:03:27.134580 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8279edf6-44e0-41d2-b700-b7e617c5e2b8 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:27.134580 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8279edf6-44e0-41d2-b700-b7e617c5e2b8 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 697578c4-b2ae-4229-b5d3-b03775a91594] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:27.145720 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8279edf6-44e0-41d2-b700-b7e617c5e2b8 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:27.146228 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8279edf6-44e0-41d2-b700-b7e617c5e2b8 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:27.154096 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8279edf6-44e0-41d2-b700-b7e617c5e2b8 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:27.156217 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8279edf6-44e0-41d2-b700-b7e617c5e2b8 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:27.156908 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8279edf6-44e0-41d2-b700-b7e617c5e2b8 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:27.157448 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8279edf6-44e0-41d2-b700-b7e617c5e2b8 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:27.275994 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8279edf6-44e0-41d2-b700-b7e617c5e2b8 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:27.287425 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8279edf6-44e0-41d2-b700-b7e617c5e2b8 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594" status: 200 len: 1187 microversion: 2.1 time: 0.160475 Oct 04 19:03:27.316156 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3076/6175] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:27 2022] GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594 => generated 1187 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:27.766751 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-eebf4451-6027-4001-962c-af0449ff77bc tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:27.767359 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-eebf4451-6027-4001-962c-af0449ff77bc tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 0e957abd-68e7-48c3-af4b-74d570d41c15] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:27.785515 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eebf4451-6027-4001-962c-af0449ff77bc tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:27.785982 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eebf4451-6027-4001-962c-af0449ff77bc tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:27.786420 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eebf4451-6027-4001-962c-af0449ff77bc tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:27.787125 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eebf4451-6027-4001-962c-af0449ff77bc tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:27.788077 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eebf4451-6027-4001-962c-af0449ff77bc tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:27.788673 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eebf4451-6027-4001-962c-af0449ff77bc tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:28.044600 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-eebf4451-6027-4001-962c-af0449ff77bc tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:28.055877 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-eebf4451-6027-4001-962c-af0449ff77bc tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:28.057835 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-eebf4451-6027-4001-962c-af0449ff77bc tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:28.059061 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-eebf4451-6027-4001-962c-af0449ff77bc tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15" status: 200 len: 1600 microversion: 2.20 time: 0.296417 Oct 04 19:03:28.059636 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3100/6176] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:03:27 2022] GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15 => generated 1600 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:03:28.090776 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5feb54f7-48ba-4168-849d-642a493e64af tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:28.091263 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5feb54f7-48ba-4168-849d-642a493e64af tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 0e957abd-68e7-48c3-af4b-74d570d41c15] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:28.101879 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5feb54f7-48ba-4168-849d-642a493e64af tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:28.102920 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5feb54f7-48ba-4168-849d-642a493e64af tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:28.103662 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5feb54f7-48ba-4168-849d-642a493e64af tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:28.104711 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5feb54f7-48ba-4168-849d-642a493e64af tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:28.105600 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5feb54f7-48ba-4168-849d-642a493e64af tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:28.106344 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5feb54f7-48ba-4168-849d-642a493e64af tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:28.162422 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:03:28.287123 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5feb54f7-48ba-4168-849d-642a493e64af tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.200465 Oct 04 19:03:28.288129 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3077/6177] 10.222.0.20 () {60 vars in 1316 bytes} [Tue Oct 4 19:03:28 2022] GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15/os-interface => generated 285 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:03:28.320277 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6b22b6fd-2bb5-48a9-8ba9-84034804a510 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:28.320277 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6b22b6fd-2bb5-48a9-8ba9-84034804a510 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 697578c4-b2ae-4229-b5d3-b03775a91594] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:28.329202 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6b22b6fd-2bb5-48a9-8ba9-84034804a510 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:28.332556 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6b22b6fd-2bb5-48a9-8ba9-84034804a510 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:28.332722 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6b22b6fd-2bb5-48a9-8ba9-84034804a510 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:28.333470 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6b22b6fd-2bb5-48a9-8ba9-84034804a510 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:28.338611 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6b22b6fd-2bb5-48a9-8ba9-84034804a510 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:28.339154 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6b22b6fd-2bb5-48a9-8ba9-84034804a510 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:28.634724 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-eae061b2-f83c-48d9-9c1b-6201ca6bad62 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "12ab43aa-6dc4-4ca7-9b4d-63f1ef524f8d"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:03:28.640074 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-eae061b2-f83c-48d9-9c1b-6201ca6bad62 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: 6860257c-9998-4117-8aa4-b08bd2f8dc28] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:28.677934 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eae061b2-f83c-48d9-9c1b-6201ca6bad62 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:28.678507 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eae061b2-f83c-48d9-9c1b-6201ca6bad62 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:28.678950 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eae061b2-f83c-48d9-9c1b-6201ca6bad62 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:28.692170 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eae061b2-f83c-48d9-9c1b-6201ca6bad62 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:28.692786 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eae061b2-f83c-48d9-9c1b-6201ca6bad62 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:28.693243 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eae061b2-f83c-48d9-9c1b-6201ca6bad62 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:28.961985 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-eae061b2-f83c-48d9-9c1b-6201ca6bad62 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] HTTP exception thrown: Invalid volume: volume 12ab43aa-6dc4-4ca7-9b4d-63f1ef524f8d is already attached to instances: 6860257c-9998-4117-8aa4-b08bd2f8dc28 Oct 04 19:03:28.971641 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-eae061b2-f83c-48d9-9c1b-6201ca6bad62 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Request method failure captured: Oct 04 19:03:28.971641 n-d-850501-14 devstack@n-api.service[123002]: request: POST /compute/v2.1/servers/6860257c-9998-4117-8aa4-b08bd2f8dc28/os-volume_attachments HTTP/1.1 Oct 04 19:03:28.971641 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 19:03:28.971641 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 19:03:28.971641 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 19:03:28.971641 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 74 Oct 04 19:03:28.971641 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 19:03:28.971641 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 19:03:28.971641 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 19:03:28.971641 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 19:03:28.971641 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPIIX_3DOcExv0tyjf74SMRRF0KoXtiJVCF7h65af0U3qLWvNf58dKqXrLellPdPVePIBHO4xx7DLTXsLA5NqBHQCEuDWqWqMr6VInyDk7lvTZQyuDvBxRCTYPpwhj6qdAHOfmE7y3qjml2L3OlgdXc8W6zK59OH-OYNHGwvWAJmEgQ4 Oct 04 19:03:28.971641 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 19:03:28.971641 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 19:03:28.971641 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 19:03:28.971641 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 19:03:28.971641 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 19:03:28.971641 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 19:03:28.971641 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 5dc67d8de57543c48bdf45669b684227 Oct 04 19:03:28.971641 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-AttachVolumeNegativeTest-715412502 Oct 04 19:03:28.971641 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 19:03:28.971641 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 19:03:28.971641 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5dc67d8de57543c48bdf45669b684227"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5dc67d8de57543c48bdf45669b684227", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5dc67d8de57543c48bdf45669b684227"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5dc67d8de57543c48bdf45669b684227"}]}] Oct 04 19:03:28.971641 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-AttachVolumeNegativeTest-715412502 Oct 04 19:03:28.971641 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 5dc67d8de57543c48bdf45669b684227 Oct 04 19:03:28.971641 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-715412502 Oct 04 19:03:28.971641 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-AttachVolumeNegativeTest-715412502-project Oct 04 19:03:28.971641 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 19:03:28.971641 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 19:03:28.971641 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: ce441ded6f554ec28560c75de97af173 Oct 04 19:03:28.971641 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-AttachVolumeNegativeTest-715412502-project Oct 04 19:03:28.971641 n-d-850501-14 devstack@n-api.service[123002]: Oct 04 19:03:28.971641 n-d-850501-14 devstack@n-api.service[123002]: {"volumeAttachment": {"volumeId": "12ab43aa-6dc4-4ca7-9b4d-63f1ef524f8d"}} Oct 04 19:03:28.971641 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 19:03:28.971641 n-d-850501-14 devstack@n-api.service[123002]: exception: Invalid volume: volume 12ab43aa-6dc4-4ca7-9b4d-63f1ef524f8d is already attached to instances: 6860257c-9998-4117-8aa4-b08bd2f8dc28 Oct 04 19:03:28.971641 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'server_id': '6860257c-9998-4117-8aa4-b08bd2f8dc28', 'body': {'volumeAttachment': {'volumeId': '12ab43aa-6dc4-4ca7-9b4d-63f1ef524f8d'}}} Oct 04 19:03:28.971641 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:03:28.971641 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:03:28.971641 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 04 19:03:28.971641 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 04 19:03:28.971641 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 19:03:28.971641 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 19:03:28.971641 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 04 19:03:28.971641 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 19:03:28.971641 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 04 19:03:28.971641 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 04 19:03:28.971641 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 04 19:03:28.971641 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 04 19:03:28.971641 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 12ab43aa-6dc4-4ca7-9b4d-63f1ef524f8d is already attached to instances: 6860257c-9998-4117-8aa4-b08bd2f8dc28 Oct 04 19:03:28.971641 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:03:28.971641 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:03:28.971641 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:03:28.971641 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:03:28.971641 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:03:28.971641 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:03:28.971641 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:03:28.971641 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:03:28.971641 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:03:28.971641 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:03:28.971641 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 19:03:28.971641 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 19:03:28.971641 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 19:03:28.971641 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 19:03:28.981665 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 19:03:28.981665 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 19:03:28.981665 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 04 19:03:28.981665 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 04 19:03:28.981665 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 12ab43aa-6dc4-4ca7-9b4d-63f1ef524f8d is already attached to instances: 6860257c-9998-4117-8aa4-b08bd2f8dc28 Oct 04 19:03:28.981665 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:03:28.981665 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:03:28.981665 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:03:28.981665 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:03:28.981665 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:03:28.981665 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:03:28.981665 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:03:28.981665 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:03:28.981665 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 12ab43aa-6dc4-4ca7-9b4d-63f1ef524f8d is already attached to instances: 6860257c-9998-4117-8aa4-b08bd2f8dc28 Oct 04 19:03:28.981665 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:03:28.981665 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-eae061b2-f83c-48d9-9c1b-6201ca6bad62 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Returning 400 to user: Invalid volume: volume 12ab43aa-6dc4-4ca7-9b4d-63f1ef524f8d is already attached to instances: 6860257c-9998-4117-8aa4-b08bd2f8dc28 {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:03:28.981665 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-eae061b2-f83c-48d9-9c1b-6201ca6bad62 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "POST /compute/v2.1/servers/6860257c-9998-4117-8aa4-b08bd2f8dc28/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.344637 Oct 04 19:03:28.987536 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3078/6178] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Oct 4 19:03:28 2022] POST /compute/v2.1/servers/6860257c-9998-4117-8aa4-b08bd2f8dc28/os-volume_attachments => generated 174 bytes in 354 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 04 19:03:29.152944 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-246a63b6-5721-4305-8ca6-5ab813b3643f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:29.153221 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-246a63b6-5721-4305-8ca6-5ab813b3643f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: 6860257c-9998-4117-8aa4-b08bd2f8dc28] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:29.164792 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-246a63b6-5721-4305-8ca6-5ab813b3643f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:29.168846 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-246a63b6-5721-4305-8ca6-5ab813b3643f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:29.169756 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-246a63b6-5721-4305-8ca6-5ab813b3643f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:29.173142 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-246a63b6-5721-4305-8ca6-5ab813b3643f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:29.173862 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-246a63b6-5721-4305-8ca6-5ab813b3643f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:29.174501 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-246a63b6-5721-4305-8ca6-5ab813b3643f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:29.344720 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-246a63b6-5721-4305-8ca6-5ab813b3643f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lazy-loading 'services' on Instance uuid 6860257c-9998-4117-8aa4-b08bd2f8dc28 {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:03:29.362470 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6b22b6fd-2bb5-48a9-8ba9-84034804a510 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:29.375636 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6b22b6fd-2bb5-48a9-8ba9-84034804a510 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594" status: 200 len: 1187 microversion: 2.1 time: 1.062289 Oct 04 19:03:29.380357 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3101/6179] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:28 2022] GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594 => generated 1187 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:29.801380 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-246a63b6-5721-4305-8ca6-5ab813b3643f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6860257c-9998-4117-8aa4-b08bd2f8dc28/os-volume_attachments/12ab43aa-6dc4-4ca7-9b4d-63f1ef524f8d" status: 202 len: 0 microversion: 2.1 time: 0.652843 Oct 04 19:03:29.802377 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3079/6180] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Oct 4 19:03:29 2022] DELETE /compute/v2.1/servers/6860257c-9998-4117-8aa4-b08bd2f8dc28/os-volume_attachments/12ab43aa-6dc4-4ca7-9b4d-63f1ef524f8d => generated 0 bytes in 656 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:03:29.813948 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-53d9cfb8-c85b-4132-a86e-60e553894f9f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:29.821084 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-53d9cfb8-c85b-4132-a86e-60e553894f9f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: 6860257c-9998-4117-8aa4-b08bd2f8dc28] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:29.845216 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-53d9cfb8-c85b-4132-a86e-60e553894f9f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:29.846498 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-53d9cfb8-c85b-4132-a86e-60e553894f9f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:29.847464 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-53d9cfb8-c85b-4132-a86e-60e553894f9f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:29.849464 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-53d9cfb8-c85b-4132-a86e-60e553894f9f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:29.850212 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-53d9cfb8-c85b-4132-a86e-60e553894f9f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:29.851436 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-53d9cfb8-c85b-4132-a86e-60e553894f9f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:29.898202 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-53d9cfb8-c85b-4132-a86e-60e553894f9f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/6860257c-9998-4117-8aa4-b08bd2f8dc28/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090047 Oct 04 19:03:29.906206 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3102/6181] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 19:03:29 2022] GET /compute/v2.1/servers/6860257c-9998-4117-8aa4-b08bd2f8dc28/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:03:30.162171 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-b2761f1c-db57-4c7d-8930-2bc6ba49c0ba req-991be345-0bc5-46eb-9c88-57233c9b3e43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e957abd-68e7-48c3-af4b-74d570d41c15", "tag": "a324d908-a426-4333-ae46-4fc6e0230e67"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:03:30.187634 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-b2761f1c-db57-4c7d-8930-2bc6ba49c0ba req-991be345-0bc5-46eb-9c88-57233c9b3e43 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:30.189070 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-b2761f1c-db57-4c7d-8930-2bc6ba49c0ba req-991be345-0bc5-46eb-9c88-57233c9b3e43 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:30.189735 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-b2761f1c-db57-4c7d-8930-2bc6ba49c0ba req-991be345-0bc5-46eb-9c88-57233c9b3e43 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:30.220373 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-b2761f1c-db57-4c7d-8930-2bc6ba49c0ba req-991be345-0bc5-46eb-9c88-57233c9b3e43 service nova] Creating event network-changed:a324d908-a426-4333-ae46-4fc6e0230e67 for instance 0e957abd-68e7-48c3-af4b-74d570d41c15 on n-h2-850501-14 Oct 04 19:03:30.226136 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-b2761f1c-db57-4c7d-8930-2bc6ba49c0ba req-991be345-0bc5-46eb-9c88-57233c9b3e43 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067921 Oct 04 19:03:30.227026 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3080/6182] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:03:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:03:30.406056 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5cf5cbd6-ab0c-428f-bfdf-d8cb85f56692 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:30.407297 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5cf5cbd6-ab0c-428f-bfdf-d8cb85f56692 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 697578c4-b2ae-4229-b5d3-b03775a91594] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:30.421082 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5cf5cbd6-ab0c-428f-bfdf-d8cb85f56692 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:30.425323 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5cf5cbd6-ab0c-428f-bfdf-d8cb85f56692 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:30.426059 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5cf5cbd6-ab0c-428f-bfdf-d8cb85f56692 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:30.428944 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5cf5cbd6-ab0c-428f-bfdf-d8cb85f56692 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:30.431609 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5cf5cbd6-ab0c-428f-bfdf-d8cb85f56692 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:30.433281 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5cf5cbd6-ab0c-428f-bfdf-d8cb85f56692 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:30.530406 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5cf5cbd6-ab0c-428f-bfdf-d8cb85f56692 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:30.544378 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5cf5cbd6-ab0c-428f-bfdf-d8cb85f56692 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594" status: 200 len: 1187 microversion: 2.1 time: 0.140889 Oct 04 19:03:30.545972 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3103/6183] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:30 2022] GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594 => generated 1187 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:30.914419 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-33332e6c-7004-40ba-b891-ee05d21c26c3 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:30.917600 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-33332e6c-7004-40ba-b891-ee05d21c26c3 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: 6860257c-9998-4117-8aa4-b08bd2f8dc28] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:30.934447 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-33332e6c-7004-40ba-b891-ee05d21c26c3 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:30.935758 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-33332e6c-7004-40ba-b891-ee05d21c26c3 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:30.939118 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-33332e6c-7004-40ba-b891-ee05d21c26c3 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:30.940111 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-33332e6c-7004-40ba-b891-ee05d21c26c3 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:30.940785 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-33332e6c-7004-40ba-b891-ee05d21c26c3 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:30.941218 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-33332e6c-7004-40ba-b891-ee05d21c26c3 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:30.998439 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-33332e6c-7004-40ba-b891-ee05d21c26c3 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/6860257c-9998-4117-8aa4-b08bd2f8dc28/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088522 Oct 04 19:03:31.005006 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3081/6184] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 19:03:30 2022] GET /compute/v2.1/servers/6860257c-9998-4117-8aa4-b08bd2f8dc28/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:03:31.567802 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c8533c13-dcc8-4fdf-9ad6-9f1fc927785b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:31.568627 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c8533c13-dcc8-4fdf-9ad6-9f1fc927785b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 697578c4-b2ae-4229-b5d3-b03775a91594] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:31.584581 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c8533c13-dcc8-4fdf-9ad6-9f1fc927785b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:31.585255 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c8533c13-dcc8-4fdf-9ad6-9f1fc927785b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:31.586502 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c8533c13-dcc8-4fdf-9ad6-9f1fc927785b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:31.587347 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c8533c13-dcc8-4fdf-9ad6-9f1fc927785b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:31.587921 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c8533c13-dcc8-4fdf-9ad6-9f1fc927785b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:31.588481 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c8533c13-dcc8-4fdf-9ad6-9f1fc927785b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:31.891489 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c8533c13-dcc8-4fdf-9ad6-9f1fc927785b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:31.899870 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c8533c13-dcc8-4fdf-9ad6-9f1fc927785b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594" status: 200 len: 1187 microversion: 2.1 time: 0.335977 Oct 04 19:03:31.904180 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3104/6185] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:31 2022] GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594 => generated 1187 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:32.012956 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-17052a98-e95e-4d0f-a4dd-8f4f08d184c0 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:32.017921 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-17052a98-e95e-4d0f-a4dd-8f4f08d184c0 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: 6860257c-9998-4117-8aa4-b08bd2f8dc28] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:32.049084 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-17052a98-e95e-4d0f-a4dd-8f4f08d184c0 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:32.050211 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-17052a98-e95e-4d0f-a4dd-8f4f08d184c0 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:32.051095 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-17052a98-e95e-4d0f-a4dd-8f4f08d184c0 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:32.052005 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-17052a98-e95e-4d0f-a4dd-8f4f08d184c0 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:32.052662 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-17052a98-e95e-4d0f-a4dd-8f4f08d184c0 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:32.061199 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-17052a98-e95e-4d0f-a4dd-8f4f08d184c0 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:32.099283 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-17052a98-e95e-4d0f-a4dd-8f4f08d184c0 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/6860257c-9998-4117-8aa4-b08bd2f8dc28/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091434 Oct 04 19:03:32.099998 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3082/6186] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 19:03:32 2022] GET /compute/v2.1/servers/6860257c-9998-4117-8aa4-b08bd2f8dc28/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:03:32.930817 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6586c186-306c-494c-81d1-20811484c753 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:32.932021 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6586c186-306c-494c-81d1-20811484c753 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 697578c4-b2ae-4229-b5d3-b03775a91594] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:32.954713 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6586c186-306c-494c-81d1-20811484c753 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:32.956367 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6586c186-306c-494c-81d1-20811484c753 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:32.958309 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6586c186-306c-494c-81d1-20811484c753 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:32.959231 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6586c186-306c-494c-81d1-20811484c753 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:32.962171 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6586c186-306c-494c-81d1-20811484c753 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:32.962825 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6586c186-306c-494c-81d1-20811484c753 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:33.093913 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6586c186-306c-494c-81d1-20811484c753 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:33.103684 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6586c186-306c-494c-81d1-20811484c753 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594" status: 200 len: 1187 microversion: 2.1 time: 0.179649 Oct 04 19:03:33.108787 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3105/6187] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:32 2022] GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594 => generated 1187 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:33.114586 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ef7393b1-e621-4d39-8b37-3fdb704cbcb3 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:33.118171 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ef7393b1-e621-4d39-8b37-3fdb704cbcb3 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: 6860257c-9998-4117-8aa4-b08bd2f8dc28] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:33.128628 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ef7393b1-e621-4d39-8b37-3fdb704cbcb3 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:33.137570 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ef7393b1-e621-4d39-8b37-3fdb704cbcb3 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:33.137570 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ef7393b1-e621-4d39-8b37-3fdb704cbcb3 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:33.137570 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ef7393b1-e621-4d39-8b37-3fdb704cbcb3 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:33.137570 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ef7393b1-e621-4d39-8b37-3fdb704cbcb3 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:33.137570 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ef7393b1-e621-4d39-8b37-3fdb704cbcb3 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:33.182080 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ef7393b1-e621-4d39-8b37-3fdb704cbcb3 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/6860257c-9998-4117-8aa4-b08bd2f8dc28/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073393 Oct 04 19:03:33.189747 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3083/6188] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 19:03:33 2022] GET /compute/v2.1/servers/6860257c-9998-4117-8aa4-b08bd2f8dc28/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:03:34.133254 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-fe8b5c15-3560-48cd-9989-f2527993b045 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:34.139279 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-fe8b5c15-3560-48cd-9989-f2527993b045 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 697578c4-b2ae-4229-b5d3-b03775a91594] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:34.152381 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fe8b5c15-3560-48cd-9989-f2527993b045 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:34.153263 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fe8b5c15-3560-48cd-9989-f2527993b045 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:34.153615 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fe8b5c15-3560-48cd-9989-f2527993b045 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:34.155194 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fe8b5c15-3560-48cd-9989-f2527993b045 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:34.155842 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fe8b5c15-3560-48cd-9989-f2527993b045 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:34.156476 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fe8b5c15-3560-48cd-9989-f2527993b045 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:34.196582 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-be9f0123-a55c-4bff-8be5-784b2d72ad48 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:34.199764 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-be9f0123-a55c-4bff-8be5-784b2d72ad48 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: 6860257c-9998-4117-8aa4-b08bd2f8dc28] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:34.225385 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-be9f0123-a55c-4bff-8be5-784b2d72ad48 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:34.230326 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-be9f0123-a55c-4bff-8be5-784b2d72ad48 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:34.230326 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-be9f0123-a55c-4bff-8be5-784b2d72ad48 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:34.230326 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-be9f0123-a55c-4bff-8be5-784b2d72ad48 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:34.230326 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-be9f0123-a55c-4bff-8be5-784b2d72ad48 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:34.230326 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-be9f0123-a55c-4bff-8be5-784b2d72ad48 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:34.231091 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fe8b5c15-3560-48cd-9989-f2527993b045 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:34.231091 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fe8b5c15-3560-48cd-9989-f2527993b045 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:34.231091 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fe8b5c15-3560-48cd-9989-f2527993b045 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:34.231091 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-fe8b5c15-3560-48cd-9989-f2527993b045 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lazy-loading 'fault' on Instance uuid 697578c4-b2ae-4229-b5d3-b03775a91594 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:03:34.314549 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-be9f0123-a55c-4bff-8be5-784b2d72ad48 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/6860257c-9998-4117-8aa4-b08bd2f8dc28/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.122319 Oct 04 19:03:34.324758 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3084/6189] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 19:03:34 2022] GET /compute/v2.1/servers/6860257c-9998-4117-8aa4-b08bd2f8dc28/os-volume_attachments => generated 197 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:03:34.333833 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-fe8b5c15-3560-48cd-9989-f2527993b045 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:34.346428 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-fe8b5c15-3560-48cd-9989-f2527993b045 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594" status: 200 len: 1192 microversion: 2.1 time: 0.217202 Oct 04 19:03:34.347721 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3106/6190] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:34 2022] GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594 => generated 1192 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:35.336625 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5dfaa090-c14c-4ac9-800a-901e6115fce7 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:35.339565 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5dfaa090-c14c-4ac9-800a-901e6115fce7 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: 6860257c-9998-4117-8aa4-b08bd2f8dc28] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:35.347041 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5dfaa090-c14c-4ac9-800a-901e6115fce7 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:35.347792 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5dfaa090-c14c-4ac9-800a-901e6115fce7 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:35.348478 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5dfaa090-c14c-4ac9-800a-901e6115fce7 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:35.349376 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5dfaa090-c14c-4ac9-800a-901e6115fce7 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:35.350006 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5dfaa090-c14c-4ac9-800a-901e6115fce7 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:35.350621 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5dfaa090-c14c-4ac9-800a-901e6115fce7 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:35.370968 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f8df6fd5-3d26-4aff-b0f7-6c5a0f048e7b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:35.373510 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f8df6fd5-3d26-4aff-b0f7-6c5a0f048e7b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 697578c4-b2ae-4229-b5d3-b03775a91594] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:35.383269 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f8df6fd5-3d26-4aff-b0f7-6c5a0f048e7b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:35.385605 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f8df6fd5-3d26-4aff-b0f7-6c5a0f048e7b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:35.387437 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f8df6fd5-3d26-4aff-b0f7-6c5a0f048e7b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:35.391119 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f8df6fd5-3d26-4aff-b0f7-6c5a0f048e7b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:35.392043 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f8df6fd5-3d26-4aff-b0f7-6c5a0f048e7b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:35.393694 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f8df6fd5-3d26-4aff-b0f7-6c5a0f048e7b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:35.438745 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5dfaa090-c14c-4ac9-800a-901e6115fce7 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/6860257c-9998-4117-8aa4-b08bd2f8dc28/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106022 Oct 04 19:03:35.439352 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3085/6191] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 19:03:35 2022] GET /compute/v2.1/servers/6860257c-9998-4117-8aa4-b08bd2f8dc28/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:03:35.450150 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-f8df6fd5-3d26-4aff-b0f7-6c5a0f048e7b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] HTTP exception thrown: Instance 697578c4-b2ae-4229-b5d3-b03775a91594 could not be found. Oct 04 19:03:35.456955 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f8df6fd5-3d26-4aff-b0f7-6c5a0f048e7b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Request method failure captured: Oct 04 19:03:35.456955 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594 HTTP/1.1 Oct 04 19:03:35.456955 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 19:03:35.456955 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 19:03:35.456955 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 19:03:35.456955 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 19:03:35.456955 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 19:03:35.456955 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 19:03:35.456955 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 19:03:35.456955 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 19:03:35.456955 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPIJ4KptPiy5XyaUYG9pLSP7TnMEf-PY7yFvjaPGmW4DAHqC1kasy1bm5to10RwAF_dSHQb87b5amqQ9ZUna6URZpq6M0BGpvwENg84W1HvOZfHgDXT7E6YYTtPhmcCZbmf-MEJzIKVI741HwGnmdHx846U9v3mpOw6zsk7UNEsUijp4 Oct 04 19:03:35.456955 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 19:03:35.456955 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 19:03:35.456955 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 19:03:35.456955 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 19:03:35.456955 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 19:03:35.456955 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 19:03:35.456955 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 82d0cd3db371459db429cb770abde738 Oct 04 19:03:35.456955 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-TestVolumeBootPattern-1621879949 Oct 04 19:03:35.456955 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 19:03:35.456955 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 19:03:35.456955 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/82d0cd3db371459db429cb770abde738"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_82d0cd3db371459db429cb770abde738", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/82d0cd3db371459db429cb770abde738"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/82d0cd3db371459db429cb770abde738"}]}] Oct 04 19:03:35.456955 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-TestVolumeBootPattern-1621879949 Oct 04 19:03:35.456955 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 82d0cd3db371459db429cb770abde738 Oct 04 19:03:35.456955 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-TestVolumeBootPattern-1621879949 Oct 04 19:03:35.456955 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-TestVolumeBootPattern-1621879949-project Oct 04 19:03:35.456955 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 19:03:35.456955 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 19:03:35.456955 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: a65ae9c3fb3c46a2a393fe21ce21b9d4 Oct 04 19:03:35.456955 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-TestVolumeBootPattern-1621879949-project Oct 04 19:03:35.456955 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 19:03:35.456955 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 697578c4-b2ae-4229-b5d3-b03775a91594 could not be found. Oct 04 19:03:35.456955 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '697578c4-b2ae-4229-b5d3-b03775a91594'} Oct 04 19:03:35.456955 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:03:35.456955 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:03:35.456955 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:03:35.456955 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:03:35.456955 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:03:35.456955 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:03:35.456955 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:03:35.456955 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:03:35.456955 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:03:35.456955 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:03:35.456955 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 697578c4-b2ae-4229-b5d3-b03775a91594 could not be found. Oct 04 19:03:35.456955 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:03:35.456955 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:03:35.456955 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:03:35.456955 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:03:35.456955 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:03:35.456955 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:03:35.456955 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:03:35.456955 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:03:35.456955 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:03:35.456955 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:03:35.456955 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:03:35.456955 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:03:35.456955 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:03:35.456955 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:03:35.456955 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:03:35.456955 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:03:35.456955 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 697578c4-b2ae-4229-b5d3-b03775a91594 could not be found. Oct 04 19:03:35.456955 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:03:35.456955 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:03:35.456955 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:03:35.465954 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:03:35.465954 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:03:35.465954 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:03:35.465954 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:03:35.465954 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:03:35.465954 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 697578c4-b2ae-4229-b5d3-b03775a91594 could not be found. Oct 04 19:03:35.465954 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:03:35.465954 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f8df6fd5-3d26-4aff-b0f7-6c5a0f048e7b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Returning 404 to user: Instance 697578c4-b2ae-4229-b5d3-b03775a91594 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:03:35.465954 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f8df6fd5-3d26-4aff-b0f7-6c5a0f048e7b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594" status: 404 len: 111 microversion: 2.1 time: 0.091557 Oct 04 19:03:35.465954 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3107/6192] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:35 2022] GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 19:03:36.452168 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6bc8f5b3-f80b-4e3a-8a7c-d51e41bd0fdf tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:36.455507 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-6bc8f5b3-f80b-4e3a-8a7c-d51e41bd0fdf tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: 6860257c-9998-4117-8aa4-b08bd2f8dc28] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:36.471778 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6bc8f5b3-f80b-4e3a-8a7c-d51e41bd0fdf tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:36.474186 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6bc8f5b3-f80b-4e3a-8a7c-d51e41bd0fdf tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:36.475334 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6bc8f5b3-f80b-4e3a-8a7c-d51e41bd0fdf tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:36.478345 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6bc8f5b3-f80b-4e3a-8a7c-d51e41bd0fdf tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:36.479417 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6bc8f5b3-f80b-4e3a-8a7c-d51e41bd0fdf tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:36.480782 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6bc8f5b3-f80b-4e3a-8a7c-d51e41bd0fdf tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:36.545363 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6bc8f5b3-f80b-4e3a-8a7c-d51e41bd0fdf tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/6860257c-9998-4117-8aa4-b08bd2f8dc28/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097816 Oct 04 19:03:36.550858 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3086/6193] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 19:03:36 2022] GET /compute/v2.1/servers/6860257c-9998-4117-8aa4-b08bd2f8dc28/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:03:37.558543 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8d942111-f6ea-466f-96f1-8207e1b03662 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:37.560982 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8d942111-f6ea-466f-96f1-8207e1b03662 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: 6860257c-9998-4117-8aa4-b08bd2f8dc28] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:37.571889 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8d942111-f6ea-466f-96f1-8207e1b03662 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:37.577379 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8d942111-f6ea-466f-96f1-8207e1b03662 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:37.577873 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8d942111-f6ea-466f-96f1-8207e1b03662 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:37.578621 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8d942111-f6ea-466f-96f1-8207e1b03662 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:37.579085 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8d942111-f6ea-466f-96f1-8207e1b03662 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:37.579511 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8d942111-f6ea-466f-96f1-8207e1b03662 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:37.718213 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8d942111-f6ea-466f-96f1-8207e1b03662 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/6860257c-9998-4117-8aa4-b08bd2f8dc28/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.163916 Oct 04 19:03:37.725890 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3108/6194] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 19:03:37 2022] GET /compute/v2.1/servers/6860257c-9998-4117-8aa4-b08bd2f8dc28/os-volume_attachments => generated 197 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:03:37.727885 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-56a5a9b4-d0a6-46dd-9ee8-8dfb42c6f6fb tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:37.729040 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-56a5a9b4-d0a6-46dd-9ee8-8dfb42c6f6fb tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 697578c4-b2ae-4229-b5d3-b03775a91594] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:37.742409 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-56a5a9b4-d0a6-46dd-9ee8-8dfb42c6f6fb tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:37.742919 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-56a5a9b4-d0a6-46dd-9ee8-8dfb42c6f6fb tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:37.751388 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-56a5a9b4-d0a6-46dd-9ee8-8dfb42c6f6fb tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:37.752203 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-56a5a9b4-d0a6-46dd-9ee8-8dfb42c6f6fb tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:37.752675 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-56a5a9b4-d0a6-46dd-9ee8-8dfb42c6f6fb tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:37.753120 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-56a5a9b4-d0a6-46dd-9ee8-8dfb42c6f6fb tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:37.806223 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-56a5a9b4-d0a6-46dd-9ee8-8dfb42c6f6fb tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] HTTP exception thrown: Instance 697578c4-b2ae-4229-b5d3-b03775a91594 could not be found. Oct 04 19:03:37.807903 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-56a5a9b4-d0a6-46dd-9ee8-8dfb42c6f6fb tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Request method failure captured: Oct 04 19:03:37.807903 n-d-850501-14 devstack@n-api.service[123002]: request: DELETE /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594 HTTP/1.1 Oct 04 19:03:37.807903 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 19:03:37.807903 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 19:03:37.807903 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 19:03:37.807903 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 19:03:37.807903 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 19:03:37.807903 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 19:03:37.807903 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 19:03:37.807903 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 19:03:37.807903 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPIJ4KptPiy5XyaUYG9pLSP7TnMEf-PY7yFvjaPGmW4DAHqC1kasy1bm5to10RwAF_dSHQb87b5amqQ9ZUna6URZpq6M0BGpvwENg84W1HvOZfHgDXT7E6YYTtPhmcCZbmf-MEJzIKVI741HwGnmdHx846U9v3mpOw6zsk7UNEsUijp4 Oct 04 19:03:37.807903 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 19:03:37.807903 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 19:03:37.807903 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 19:03:37.807903 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 19:03:37.807903 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 19:03:37.807903 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 19:03:37.807903 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 82d0cd3db371459db429cb770abde738 Oct 04 19:03:37.807903 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-TestVolumeBootPattern-1621879949 Oct 04 19:03:37.807903 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 19:03:37.807903 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 19:03:37.807903 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/82d0cd3db371459db429cb770abde738"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_82d0cd3db371459db429cb770abde738", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/82d0cd3db371459db429cb770abde738"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/82d0cd3db371459db429cb770abde738"}]}] Oct 04 19:03:37.807903 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-TestVolumeBootPattern-1621879949 Oct 04 19:03:37.807903 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 82d0cd3db371459db429cb770abde738 Oct 04 19:03:37.807903 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-TestVolumeBootPattern-1621879949 Oct 04 19:03:37.807903 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-TestVolumeBootPattern-1621879949-project Oct 04 19:03:37.807903 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 19:03:37.807903 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 19:03:37.807903 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: a65ae9c3fb3c46a2a393fe21ce21b9d4 Oct 04 19:03:37.807903 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-TestVolumeBootPattern-1621879949-project Oct 04 19:03:37.807903 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 19:03:37.807903 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 697578c4-b2ae-4229-b5d3-b03775a91594 could not be found. Oct 04 19:03:37.807903 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '697578c4-b2ae-4229-b5d3-b03775a91594'} Oct 04 19:03:37.807903 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:03:37.807903 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:03:37.807903 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:03:37.807903 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:03:37.807903 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:03:37.807903 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:03:37.807903 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:03:37.807903 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:03:37.807903 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:03:37.807903 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:03:37.807903 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 697578c4-b2ae-4229-b5d3-b03775a91594 could not be found. Oct 04 19:03:37.807903 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:03:37.807903 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:03:37.807903 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:03:37.807903 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:03:37.807903 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:03:37.807903 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:03:37.807903 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:03:37.807903 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:03:37.807903 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:03:37.807903 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:03:37.807903 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 19:03:37.807903 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 19:03:37.807903 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 19:03:37.807903 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 19:03:37.807903 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:03:37.807903 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:03:37.807903 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:03:37.807903 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:03:37.813738 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 697578c4-b2ae-4229-b5d3-b03775a91594 could not be found. Oct 04 19:03:37.813738 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:03:37.813738 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:03:37.813738 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:03:37.813738 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:03:37.813738 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:03:37.813738 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:03:37.813738 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:03:37.813738 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:03:37.813738 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 697578c4-b2ae-4229-b5d3-b03775a91594 could not be found. Oct 04 19:03:37.813738 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:03:37.813738 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-56a5a9b4-d0a6-46dd-9ee8-8dfb42c6f6fb tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Returning 404 to user: Instance 697578c4-b2ae-4229-b5d3-b03775a91594 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:03:37.813738 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-56a5a9b4-d0a6-46dd-9ee8-8dfb42c6f6fb tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "DELETE /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594" status: 404 len: 111 microversion: 2.1 time: 0.085497 Oct 04 19:03:37.820129 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3087/6195] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 19:03:37 2022] DELETE /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:03:37.820530 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-899ec9a9-17d1-4dc6-ad9f-301cfaf7172e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:37.821228 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-899ec9a9-17d1-4dc6-ad9f-301cfaf7172e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 697578c4-b2ae-4229-b5d3-b03775a91594] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:37.882201 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-899ec9a9-17d1-4dc6-ad9f-301cfaf7172e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:37.882815 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-899ec9a9-17d1-4dc6-ad9f-301cfaf7172e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:37.883360 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-899ec9a9-17d1-4dc6-ad9f-301cfaf7172e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:37.884237 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-899ec9a9-17d1-4dc6-ad9f-301cfaf7172e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:37.884803 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-899ec9a9-17d1-4dc6-ad9f-301cfaf7172e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:37.885333 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-899ec9a9-17d1-4dc6-ad9f-301cfaf7172e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:37.909075 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-899ec9a9-17d1-4dc6-ad9f-301cfaf7172e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] HTTP exception thrown: Instance 697578c4-b2ae-4229-b5d3-b03775a91594 could not be found. Oct 04 19:03:37.911842 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-899ec9a9-17d1-4dc6-ad9f-301cfaf7172e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Request method failure captured: Oct 04 19:03:37.911842 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594 HTTP/1.1 Oct 04 19:03:37.911842 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 19:03:37.911842 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 19:03:37.911842 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 19:03:37.911842 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 19:03:37.911842 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 19:03:37.911842 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 19:03:37.911842 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 19:03:37.911842 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 19:03:37.911842 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPIJ4KptPiy5XyaUYG9pLSP7TnMEf-PY7yFvjaPGmW4DAHqC1kasy1bm5to10RwAF_dSHQb87b5amqQ9ZUna6URZpq6M0BGpvwENg84W1HvOZfHgDXT7E6YYTtPhmcCZbmf-MEJzIKVI741HwGnmdHx846U9v3mpOw6zsk7UNEsUijp4 Oct 04 19:03:37.911842 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 19:03:37.911842 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 19:03:37.911842 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 19:03:37.911842 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 19:03:37.911842 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 19:03:37.911842 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 19:03:37.911842 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 82d0cd3db371459db429cb770abde738 Oct 04 19:03:37.911842 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-TestVolumeBootPattern-1621879949 Oct 04 19:03:37.911842 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 19:03:37.911842 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 19:03:37.911842 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/82d0cd3db371459db429cb770abde738"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_82d0cd3db371459db429cb770abde738", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/82d0cd3db371459db429cb770abde738"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/82d0cd3db371459db429cb770abde738"}]}] Oct 04 19:03:37.911842 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-TestVolumeBootPattern-1621879949 Oct 04 19:03:37.911842 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 82d0cd3db371459db429cb770abde738 Oct 04 19:03:37.911842 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-TestVolumeBootPattern-1621879949 Oct 04 19:03:37.911842 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-TestVolumeBootPattern-1621879949-project Oct 04 19:03:37.911842 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 19:03:37.911842 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 19:03:37.911842 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: a65ae9c3fb3c46a2a393fe21ce21b9d4 Oct 04 19:03:37.911842 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-TestVolumeBootPattern-1621879949-project Oct 04 19:03:37.911842 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 19:03:37.911842 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 697578c4-b2ae-4229-b5d3-b03775a91594 could not be found. Oct 04 19:03:37.911842 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '697578c4-b2ae-4229-b5d3-b03775a91594'} Oct 04 19:03:37.911842 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:03:37.911842 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:03:37.911842 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:03:37.911842 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:03:37.911842 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:03:37.911842 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:03:37.911842 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:03:37.911842 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:03:37.911842 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:03:37.911842 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:03:37.911842 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 697578c4-b2ae-4229-b5d3-b03775a91594 could not be found. Oct 04 19:03:37.911842 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:03:37.911842 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:03:37.911842 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:03:37.911842 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:03:37.911842 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:03:37.911842 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:03:37.911842 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:03:37.911842 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:03:37.911842 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:03:37.911842 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:03:37.911842 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:03:37.911842 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:03:37.911842 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:03:37.911842 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:03:37.911842 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:03:37.911842 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:03:37.911842 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 697578c4-b2ae-4229-b5d3-b03775a91594 could not be found. Oct 04 19:03:37.911842 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:03:37.911842 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:03:37.911842 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:03:37.917113 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:03:37.917113 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:03:37.917113 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:03:37.917113 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:03:37.917113 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:03:37.917113 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 697578c4-b2ae-4229-b5d3-b03775a91594 could not be found. Oct 04 19:03:37.917113 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:03:37.917113 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-899ec9a9-17d1-4dc6-ad9f-301cfaf7172e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Returning 404 to user: Instance 697578c4-b2ae-4229-b5d3-b03775a91594 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:03:37.930966 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-899ec9a9-17d1-4dc6-ad9f-301cfaf7172e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594" status: 404 len: 111 microversion: 2.1 time: 0.114225 Oct 04 19:03:37.933680 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3109/6196] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:37 2022] GET /compute/v2.1/servers/697578c4-b2ae-4229-b5d3-b03775a91594 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:03:38.731921 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7922da27-db1e-41b1-b7fc-f253f3b12439 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:38.734887 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7922da27-db1e-41b1-b7fc-f253f3b12439 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: 6860257c-9998-4117-8aa4-b08bd2f8dc28] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:38.757065 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7922da27-db1e-41b1-b7fc-f253f3b12439 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:38.759999 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7922da27-db1e-41b1-b7fc-f253f3b12439 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:38.760508 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7922da27-db1e-41b1-b7fc-f253f3b12439 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:38.761253 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7922da27-db1e-41b1-b7fc-f253f3b12439 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:38.761713 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7922da27-db1e-41b1-b7fc-f253f3b12439 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:38.762135 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7922da27-db1e-41b1-b7fc-f253f3b12439 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:38.866281 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7922da27-db1e-41b1-b7fc-f253f3b12439 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/6860257c-9998-4117-8aa4-b08bd2f8dc28/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.134254 Oct 04 19:03:38.866281 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3088/6197] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 19:03:38 2022] GET /compute/v2.1/servers/6860257c-9998-4117-8aa4-b08bd2f8dc28/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:03:39.876455 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-92d69235-8d5a-4f63-8978-bed9ea67158c tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:39.879688 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-92d69235-8d5a-4f63-8978-bed9ea67158c tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: 6860257c-9998-4117-8aa4-b08bd2f8dc28] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:39.893304 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-92d69235-8d5a-4f63-8978-bed9ea67158c tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:39.900594 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-92d69235-8d5a-4f63-8978-bed9ea67158c tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:39.901422 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-92d69235-8d5a-4f63-8978-bed9ea67158c tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:39.902424 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-92d69235-8d5a-4f63-8978-bed9ea67158c tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:39.903120 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-92d69235-8d5a-4f63-8978-bed9ea67158c tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:39.903790 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-92d69235-8d5a-4f63-8978-bed9ea67158c tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:39.969769 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-92d69235-8d5a-4f63-8978-bed9ea67158c tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/6860257c-9998-4117-8aa4-b08bd2f8dc28/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098459 Oct 04 19:03:39.975428 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3110/6198] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 19:03:39 2022] GET /compute/v2.1/servers/6860257c-9998-4117-8aa4-b08bd2f8dc28/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:03:40.983709 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-bd4cd262-2d1a-4dbb-8a84-9cf9b16929e7 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:40.988498 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-bd4cd262-2d1a-4dbb-8a84-9cf9b16929e7 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: 6860257c-9998-4117-8aa4-b08bd2f8dc28] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:41.009332 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bd4cd262-2d1a-4dbb-8a84-9cf9b16929e7 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:41.013247 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bd4cd262-2d1a-4dbb-8a84-9cf9b16929e7 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:41.015588 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bd4cd262-2d1a-4dbb-8a84-9cf9b16929e7 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:41.023911 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bd4cd262-2d1a-4dbb-8a84-9cf9b16929e7 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:41.024646 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bd4cd262-2d1a-4dbb-8a84-9cf9b16929e7 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:41.025961 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bd4cd262-2d1a-4dbb-8a84-9cf9b16929e7 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:41.107232 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-bd4cd262-2d1a-4dbb-8a84-9cf9b16929e7 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/6860257c-9998-4117-8aa4-b08bd2f8dc28/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.128600 Oct 04 19:03:41.113215 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3089/6199] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 19:03:40 2022] GET /compute/v2.1/servers/6860257c-9998-4117-8aa4-b08bd2f8dc28/os-volume_attachments => generated 25 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 19:03:41.202805 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-af6377d4-80d4-4d6a-8824-fd3e6e4411cb tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:41.203733 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-af6377d4-80d4-4d6a-8824-fd3e6e4411cb tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: 6860257c-9998-4117-8aa4-b08bd2f8dc28] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:41.217792 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-af6377d4-80d4-4d6a-8824-fd3e6e4411cb tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:41.218309 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-af6377d4-80d4-4d6a-8824-fd3e6e4411cb tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:41.218752 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-af6377d4-80d4-4d6a-8824-fd3e6e4411cb tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:41.219469 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-af6377d4-80d4-4d6a-8824-fd3e6e4411cb tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:41.220773 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-af6377d4-80d4-4d6a-8824-fd3e6e4411cb tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:41.221217 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-af6377d4-80d4-4d6a-8824-fd3e6e4411cb tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:41.255553 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-af6377d4-80d4-4d6a-8824-fd3e6e4411cb tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: 6860257c-9998-4117-8aa4-b08bd2f8dc28] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:03:41.595513 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-af6377d4-80d4-4d6a-8824-fd3e6e4411cb tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6860257c-9998-4117-8aa4-b08bd2f8dc28" status: 204 len: 0 microversion: 2.1 time: 0.397398 Oct 04 19:03:41.596339 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3111/6200] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 19:03:41 2022] DELETE /compute/v2.1/servers/6860257c-9998-4117-8aa4-b08bd2f8dc28 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:03:41.605096 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8b2c2abf-2f1c-434e-a5eb-0b4af2368faf tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:41.605777 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8b2c2abf-2f1c-434e-a5eb-0b4af2368faf tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: 6860257c-9998-4117-8aa4-b08bd2f8dc28] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:41.614120 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8b2c2abf-2f1c-434e-a5eb-0b4af2368faf tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:41.614827 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8b2c2abf-2f1c-434e-a5eb-0b4af2368faf tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:41.615625 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8b2c2abf-2f1c-434e-a5eb-0b4af2368faf tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:41.616588 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8b2c2abf-2f1c-434e-a5eb-0b4af2368faf tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:41.617207 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8b2c2abf-2f1c-434e-a5eb-0b4af2368faf tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:41.617795 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8b2c2abf-2f1c-434e-a5eb-0b4af2368faf tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:41.840783 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8b2c2abf-2f1c-434e-a5eb-0b4af2368faf tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce441ded6f554ec28560c75de97af173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc67d8de57543c48bdf45669b684227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:41.848711 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8b2c2abf-2f1c-434e-a5eb-0b4af2368faf tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/6860257c-9998-4117-8aa4-b08bd2f8dc28" status: 200 len: 1683 microversion: 2.1 time: 0.248147 Oct 04 19:03:41.849292 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3090/6201] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:41 2022] GET /compute/v2.1/servers/6860257c-9998-4117-8aa4-b08bd2f8dc28 => generated 1683 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:42.873530 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-400ef569-07f9-47de-9571-12c9740f361b tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:42.874856 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-400ef569-07f9-47de-9571-12c9740f361b tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: 6860257c-9998-4117-8aa4-b08bd2f8dc28] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:42.882223 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-400ef569-07f9-47de-9571-12c9740f361b tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:42.882940 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-400ef569-07f9-47de-9571-12c9740f361b tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:42.883564 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-400ef569-07f9-47de-9571-12c9740f361b tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:42.884466 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-400ef569-07f9-47de-9571-12c9740f361b tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:42.885081 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-400ef569-07f9-47de-9571-12c9740f361b tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:42.885668 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-400ef569-07f9-47de-9571-12c9740f361b tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:43.101619 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-400ef569-07f9-47de-9571-12c9740f361b tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce441ded6f554ec28560c75de97af173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc67d8de57543c48bdf45669b684227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:43.112685 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-400ef569-07f9-47de-9571-12c9740f361b tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/6860257c-9998-4117-8aa4-b08bd2f8dc28" status: 200 len: 1683 microversion: 2.1 time: 0.243791 Oct 04 19:03:43.114456 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3112/6202] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:42 2022] GET /compute/v2.1/servers/6860257c-9998-4117-8aa4-b08bd2f8dc28 => generated 1683 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:44.138288 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9cd03031-1189-4861-bae9-e1978fa03527 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:44.140159 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9cd03031-1189-4861-bae9-e1978fa03527 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: 6860257c-9998-4117-8aa4-b08bd2f8dc28] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:44.149288 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9cd03031-1189-4861-bae9-e1978fa03527 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:44.150091 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9cd03031-1189-4861-bae9-e1978fa03527 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:44.150960 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9cd03031-1189-4861-bae9-e1978fa03527 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:44.151942 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9cd03031-1189-4861-bae9-e1978fa03527 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:44.152597 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9cd03031-1189-4861-bae9-e1978fa03527 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:44.153207 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9cd03031-1189-4861-bae9-e1978fa03527 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:44.347853 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9cd03031-1189-4861-bae9-e1978fa03527 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce441ded6f554ec28560c75de97af173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc67d8de57543c48bdf45669b684227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:44.358820 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9cd03031-1189-4861-bae9-e1978fa03527 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/6860257c-9998-4117-8aa4-b08bd2f8dc28" status: 200 len: 1683 microversion: 2.1 time: 0.225762 Oct 04 19:03:44.359424 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3091/6203] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:44 2022] GET /compute/v2.1/servers/6860257c-9998-4117-8aa4-b08bd2f8dc28 => generated 1683 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:45.074254 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-312aff24-f6e7-45f0-8528-23a0e589e2d1 req-9f004685-753c-4120-88ec-a9c83f6c1d79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6860257c-9998-4117-8aa4-b08bd2f8dc28", "name": "network-vif-deleted", "tag": "43c00037-bb5f-437e-ad69-490e42209bb4"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:03:45.118792 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-312aff24-f6e7-45f0-8528-23a0e589e2d1 req-9f004685-753c-4120-88ec-a9c83f6c1d79 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:45.119776 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-312aff24-f6e7-45f0-8528-23a0e589e2d1 req-9f004685-753c-4120-88ec-a9c83f6c1d79 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:45.120812 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-312aff24-f6e7-45f0-8528-23a0e589e2d1 req-9f004685-753c-4120-88ec-a9c83f6c1d79 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:45.136270 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-312aff24-f6e7-45f0-8528-23a0e589e2d1 req-9f004685-753c-4120-88ec-a9c83f6c1d79 service nova] Creating event network-vif-deleted:43c00037-bb5f-437e-ad69-490e42209bb4 for instance 6860257c-9998-4117-8aa4-b08bd2f8dc28 on n-h2-850501-14 Oct 04 19:03:45.146491 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-312aff24-f6e7-45f0-8528-23a0e589e2d1 req-9f004685-753c-4120-88ec-a9c83f6c1d79 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076789 Oct 04 19:03:45.147545 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3113/6204] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:03:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:03:45.383509 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0884e145-ac62-45c7-96df-e213d5bd9c74 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:45.385026 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0884e145-ac62-45c7-96df-e213d5bd9c74 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: 6860257c-9998-4117-8aa4-b08bd2f8dc28] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:45.400480 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0884e145-ac62-45c7-96df-e213d5bd9c74 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:45.401566 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0884e145-ac62-45c7-96df-e213d5bd9c74 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:45.402332 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0884e145-ac62-45c7-96df-e213d5bd9c74 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:45.405672 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0884e145-ac62-45c7-96df-e213d5bd9c74 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:45.407682 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0884e145-ac62-45c7-96df-e213d5bd9c74 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:45.409597 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0884e145-ac62-45c7-96df-e213d5bd9c74 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:45.572723 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0884e145-ac62-45c7-96df-e213d5bd9c74 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce441ded6f554ec28560c75de97af173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc67d8de57543c48bdf45669b684227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:45.598773 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0884e145-ac62-45c7-96df-e213d5bd9c74 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/6860257c-9998-4117-8aa4-b08bd2f8dc28" status: 200 len: 1327 microversion: 2.1 time: 0.219790 Oct 04 19:03:45.599621 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3092/6205] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:45 2022] GET /compute/v2.1/servers/6860257c-9998-4117-8aa4-b08bd2f8dc28 => generated 1327 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:46.629725 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2c14e686-1412-4a26-8585-b2812f90254c tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:46.631101 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2c14e686-1412-4a26-8585-b2812f90254c tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: 6860257c-9998-4117-8aa4-b08bd2f8dc28] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:46.646992 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2c14e686-1412-4a26-8585-b2812f90254c tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:46.647643 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2c14e686-1412-4a26-8585-b2812f90254c tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:46.652703 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2c14e686-1412-4a26-8585-b2812f90254c tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:46.653619 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2c14e686-1412-4a26-8585-b2812f90254c tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:46.654756 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2c14e686-1412-4a26-8585-b2812f90254c tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:46.655291 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2c14e686-1412-4a26-8585-b2812f90254c tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:46.712576 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-2c14e686-1412-4a26-8585-b2812f90254c tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] HTTP exception thrown: Instance 6860257c-9998-4117-8aa4-b08bd2f8dc28 could not be found. Oct 04 19:03:46.714618 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2c14e686-1412-4a26-8585-b2812f90254c tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Request method failure captured: Oct 04 19:03:46.714618 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/6860257c-9998-4117-8aa4-b08bd2f8dc28 HTTP/1.1 Oct 04 19:03:46.714618 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 19:03:46.714618 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 19:03:46.714618 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 19:03:46.714618 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 19:03:46.714618 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 19:03:46.714618 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 19:03:46.714618 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 19:03:46.714618 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 19:03:46.714618 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPIIX_3DOcExv0tyjf74SMRRF0KoXtiJVCF7h65af0U3qLWvNf58dKqXrLellPdPVePIBHO4xx7DLTXsLA5NqBHQCEuDWqWqMr6VInyDk7lvTZQyuDvBxRCTYPpwhj6qdAHOfmE7y3qjml2L3OlgdXc8W6zK59OH-OYNHGwvWAJmEgQ4 Oct 04 19:03:46.714618 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 19:03:46.714618 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 19:03:46.714618 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 19:03:46.714618 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 19:03:46.714618 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 19:03:46.714618 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 19:03:46.714618 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 5dc67d8de57543c48bdf45669b684227 Oct 04 19:03:46.714618 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-AttachVolumeNegativeTest-715412502 Oct 04 19:03:46.714618 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 19:03:46.714618 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 19:03:46.714618 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5dc67d8de57543c48bdf45669b684227"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5dc67d8de57543c48bdf45669b684227", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5dc67d8de57543c48bdf45669b684227"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5dc67d8de57543c48bdf45669b684227"}]}] Oct 04 19:03:46.714618 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-AttachVolumeNegativeTest-715412502 Oct 04 19:03:46.714618 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 5dc67d8de57543c48bdf45669b684227 Oct 04 19:03:46.714618 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-715412502 Oct 04 19:03:46.714618 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-AttachVolumeNegativeTest-715412502-project Oct 04 19:03:46.714618 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 19:03:46.714618 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 19:03:46.714618 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: ce441ded6f554ec28560c75de97af173 Oct 04 19:03:46.714618 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-AttachVolumeNegativeTest-715412502-project Oct 04 19:03:46.714618 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 19:03:46.714618 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 6860257c-9998-4117-8aa4-b08bd2f8dc28 could not be found. Oct 04 19:03:46.714618 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '6860257c-9998-4117-8aa4-b08bd2f8dc28'} Oct 04 19:03:46.714618 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:03:46.714618 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:03:46.714618 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:03:46.714618 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:03:46.714618 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:03:46.714618 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:03:46.714618 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:03:46.714618 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:03:46.714618 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:03:46.714618 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:03:46.714618 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6860257c-9998-4117-8aa4-b08bd2f8dc28 could not be found. Oct 04 19:03:46.714618 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:03:46.714618 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:03:46.714618 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:03:46.714618 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:03:46.714618 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:03:46.714618 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:03:46.714618 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:03:46.714618 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:03:46.714618 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:03:46.714618 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:03:46.714618 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:03:46.714618 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:03:46.714618 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:03:46.714618 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:03:46.714618 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:03:46.714618 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:03:46.714618 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6860257c-9998-4117-8aa4-b08bd2f8dc28 could not be found. Oct 04 19:03:46.714618 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:03:46.714618 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:03:46.714618 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:03:46.719996 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:03:46.719996 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:03:46.719996 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:03:46.719996 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:03:46.719996 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:03:46.719996 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6860257c-9998-4117-8aa4-b08bd2f8dc28 could not be found. Oct 04 19:03:46.719996 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:03:46.726432 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2c14e686-1412-4a26-8585-b2812f90254c tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Returning 404 to user: Instance 6860257c-9998-4117-8aa4-b08bd2f8dc28 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:03:46.735623 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2c14e686-1412-4a26-8585-b2812f90254c tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/6860257c-9998-4117-8aa4-b08bd2f8dc28" status: 404 len: 111 microversion: 2.1 time: 0.109558 Oct 04 19:03:46.737772 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3114/6206] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:46 2022] GET /compute/v2.1/servers/6860257c-9998-4117-8aa4-b08bd2f8dc28 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:03:46.745003 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-757bb50d-1d41-486b-8212-8f35192d4b9e tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '.version_select at 0x7fe253aad040>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:46.770900 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=60 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:03:46.894644 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-757bb50d-1d41-486b-8212-8f35192d4b9e tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1922494035" status: 202 len: 0 microversion: 2.1 time: 0.153611 Oct 04 19:03:46.898717 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3093/6207] 10.222.0.20 () {58 vars in 1221 bytes} [Tue Oct 4 19:03:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1922494035 => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:03:48.561937 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2b86f649-93d3-41c6-8baf-4d280376d174 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Action: 'create', calling method: .version_select at 0x7fe253ab7c10>, body: {"keypair": {"name": "tempest-keypair-1744721298", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEbRqpj2J6JglzUdQ8RZH9Kv3MWAWiwYK9M9VO6Sy9eW3X8nXv3ncl/iXiHWZmHGDh23gFaCl9jSn7MAJ0mWMlRGAF6RLANvaQZ1rIBGQET4+d1KTWicq3isiaKhOmWGsg=="}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:03:48.581279 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-2b86f649-93d3-41c6-8baf-4d280376d174 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Getting quotas for project 5dc67d8de57543c48bdf45669b684227. Resources: {'key_pairs'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:03:48.587994 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-2b86f649-93d3-41c6-8baf-4d280376d174 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Getting quotas for user ce441ded6f554ec28560c75de97af173 and project 5dc67d8de57543c48bdf45669b684227. Resources: {'key_pairs'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:03:48.606914 n-d-850501-14 devstack@n-api.service[123001]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2b86f649-93d3-41c6-8baf-4d280376d174 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [6c8ce3ae-b440-4b28-996b-33b11441f461] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 19:03:49.615032 n-d-850501-14 devstack@n-api.service[123001]: INFO oslo.messaging._drivers.impl_rabbit [None req-2b86f649-93d3-41c6-8baf-4d280376d174 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [6c8ce3ae-b440-4b28-996b-33b11441f461] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 58152. Oct 04 19:03:49.679740 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2b86f649-93d3-41c6-8baf-4d280376d174 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.124041 Oct 04 19:03:49.680478 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3115/6208] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Oct 4 19:03:48 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:03:54.206258 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-562e52b7-d3c7-444c-8da2-ba84bfb7a05d tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1448270251", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "32f1ab07-b252-4176-b7b8-3cc5be1795d8"}], "security_groups": [{"name": "tempest-securitygroup--33880055"}], "key_name": "tempest-keypair-1744721298", "user_data": "}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:03:54.400758 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-562e52b7-d3c7-444c-8da2-ba84bfb7a05d tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] validate_networks() for [('32f1ab07-b252-4176-b7b8-3cc5be1795d8', None, None, None, None, None)] {{(pid=123002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:03:55.581503 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:03:55.893783 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-562e52b7-d3c7-444c-8da2-ba84bfb7a05d tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:03:55.894205 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-562e52b7-d3c7-444c-8da2-ba84bfb7a05d tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:03:55.894681 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-562e52b7-d3c7-444c-8da2-ba84bfb7a05d tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:03:55.895089 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-562e52b7-d3c7-444c-8da2-ba84bfb7a05d tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:03:55.895945 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-562e52b7-d3c7-444c-8da2-ba84bfb7a05d tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:03:55.911361 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-562e52b7-d3c7-444c-8da2-ba84bfb7a05d tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:55.911692 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-562e52b7-d3c7-444c-8da2-ba84bfb7a05d tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:55.913165 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-562e52b7-d3c7-444c-8da2-ba84bfb7a05d tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:55.914912 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-562e52b7-d3c7-444c-8da2-ba84bfb7a05d tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:55.915757 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-562e52b7-d3c7-444c-8da2-ba84bfb7a05d tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:55.937261 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-562e52b7-d3c7-444c-8da2-ba84bfb7a05d tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:55.980875 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-562e52b7-d3c7-444c-8da2-ba84bfb7a05d tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Getting quotas for project 5dc67d8de57543c48bdf45669b684227. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:03:55.985021 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-562e52b7-d3c7-444c-8da2-ba84bfb7a05d tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Getting quotas for user ce441ded6f554ec28560c75de97af173 and project 5dc67d8de57543c48bdf45669b684227. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:03:56.018237 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-562e52b7-d3c7-444c-8da2-ba84bfb7a05d tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Going to run 1 instances... {{(pid=123002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:03:56.020914 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-562e52b7-d3c7-444c-8da2-ba84bfb7a05d tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: f8f9ee3a-1a3d-43b9-bdf1-8725457b6611] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:03:56.136150 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-562e52b7-d3c7-444c-8da2-ba84bfb7a05d tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.939919 Oct 04 19:03:56.137058 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3094/6209] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 19:03:54 2022] POST /compute/v2.1/servers => generated 400 bytes in 1943 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:03:56.150262 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ef8b1da1-e0c3-4dc4-ae5b-1f788e701454 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:56.151578 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ef8b1da1-e0c3-4dc4-ae5b-1f788e701454 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: f8f9ee3a-1a3d-43b9-bdf1-8725457b6611] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:56.160786 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:03:56.361224 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ef8b1da1-e0c3-4dc4-ae5b-1f788e701454 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce441ded6f554ec28560c75de97af173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc67d8de57543c48bdf45669b684227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:56.374760 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ef8b1da1-e0c3-4dc4-ae5b-1f788e701454 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/f8f9ee3a-1a3d-43b9-bdf1-8725457b6611" status: 200 len: 1242 microversion: 2.1 time: 0.229636 Oct 04 19:03:56.381607 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3116/6210] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:56 2022] GET /compute/v2.1/servers/f8f9ee3a-1a3d-43b9-bdf1-8725457b6611 => generated 1242 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:57.404780 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c8083049-47f0-4cdb-8934-1aab49e6d150 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:57.405747 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c8083049-47f0-4cdb-8934-1aab49e6d150 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: f8f9ee3a-1a3d-43b9-bdf1-8725457b6611] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:57.428571 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:03:57.478341 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-39e1be01-4c4b-4406-b979-db94b7d2e672 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Action: 'create', calling method: .version_select at 0x7fe253bd0430>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-1461020954", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHRW3JRLYTZmfbdjtvfIF3oAymQyqy+FHojrVH6VkeVJICKn/oz+k1f7YUHIXpMRI8cJ2LXjTfhZVeyIl8tM7C2IB8vg1a+eCrJ2Wtm0d6crwMMOm4tqxJRsWDD61eeRDA=="}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:03:57.509664 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-39e1be01-4c4b-4406-b979-db94b7d2e672 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Getting quotas for project 7c177dc51b8e4a969670684997f3cb2a. Resources: {'key_pairs'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:03:57.510432 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-39e1be01-4c4b-4406-b979-db94b7d2e672 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Getting quotas for user c1e772e66d8c42dfa995bbecb6b9ccf9 and project 7c177dc51b8e4a969670684997f3cb2a. Resources: {'key_pairs'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:03:57.636586 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-39e1be01-4c4b-4406-b979-db94b7d2e672 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.463659 Oct 04 19:03:57.637973 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3095/6211] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Oct 4 19:03:57 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:03:57.644382 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c8083049-47f0-4cdb-8934-1aab49e6d150 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce441ded6f554ec28560c75de97af173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc67d8de57543c48bdf45669b684227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:57.667086 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c8083049-47f0-4cdb-8934-1aab49e6d150 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/f8f9ee3a-1a3d-43b9-bdf1-8725457b6611" status: 200 len: 1242 microversion: 2.1 time: 0.266636 Oct 04 19:03:57.670037 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3117/6212] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:57 2022] GET /compute/v2.1/servers/f8f9ee3a-1a3d-43b9-bdf1-8725457b6611 => generated 1242 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:58.717612 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9fc9d9a5-9724-44e9-9ede-1f92cabe3e8f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:58.720317 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9fc9d9a5-9724-44e9-9ede-1f92cabe3e8f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: f8f9ee3a-1a3d-43b9-bdf1-8725457b6611] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:58.760911 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9fc9d9a5-9724-44e9-9ede-1f92cabe3e8f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:58.763925 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9fc9d9a5-9724-44e9-9ede-1f92cabe3e8f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:58.765427 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9fc9d9a5-9724-44e9-9ede-1f92cabe3e8f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:58.769125 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9fc9d9a5-9724-44e9-9ede-1f92cabe3e8f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:58.771104 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9fc9d9a5-9724-44e9-9ede-1f92cabe3e8f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:58.771802 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9fc9d9a5-9724-44e9-9ede-1f92cabe3e8f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:58.951486 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9fc9d9a5-9724-44e9-9ede-1f92cabe3e8f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce441ded6f554ec28560c75de97af173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc67d8de57543c48bdf45669b684227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:58.951486 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9fc9d9a5-9724-44e9-9ede-1f92cabe3e8f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/f8f9ee3a-1a3d-43b9-bdf1-8725457b6611" status: 200 len: 1294 microversion: 2.1 time: 0.228790 Oct 04 19:03:58.951486 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3096/6213] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:58 2022] GET /compute/v2.1/servers/f8f9ee3a-1a3d-43b9-bdf1-8725457b6611 => generated 1294 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:59.954907 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-bf1e36c2-003e-41f3-89d9-6b05e6b422d1 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:59.956360 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-bf1e36c2-003e-41f3-89d9-6b05e6b422d1 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: f8f9ee3a-1a3d-43b9-bdf1-8725457b6611] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:59.966144 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bf1e36c2-003e-41f3-89d9-6b05e6b422d1 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:59.967111 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bf1e36c2-003e-41f3-89d9-6b05e6b422d1 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:59.967741 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bf1e36c2-003e-41f3-89d9-6b05e6b422d1 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:59.968877 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bf1e36c2-003e-41f3-89d9-6b05e6b422d1 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:59.969530 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bf1e36c2-003e-41f3-89d9-6b05e6b422d1 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:59.969970 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bf1e36c2-003e-41f3-89d9-6b05e6b422d1 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:00.097516 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-bf1e36c2-003e-41f3-89d9-6b05e6b422d1 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce441ded6f554ec28560c75de97af173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc67d8de57543c48bdf45669b684227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:00.106413 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-bf1e36c2-003e-41f3-89d9-6b05e6b422d1 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/f8f9ee3a-1a3d-43b9-bdf1-8725457b6611" status: 200 len: 1312 microversion: 2.1 time: 0.157820 Oct 04 19:04:00.120877 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3118/6214] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:59 2022] GET /compute/v2.1/servers/f8f9ee3a-1a3d-43b9-bdf1-8725457b6611 => generated 1312 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:01.131032 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f8c1fef4-cfea-4547-829e-8a28b3451353 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:01.132447 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f8c1fef4-cfea-4547-829e-8a28b3451353 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: f8f9ee3a-1a3d-43b9-bdf1-8725457b6611] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:01.141608 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f8c1fef4-cfea-4547-829e-8a28b3451353 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:01.144507 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f8c1fef4-cfea-4547-829e-8a28b3451353 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:01.146589 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f8c1fef4-cfea-4547-829e-8a28b3451353 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:01.147565 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f8c1fef4-cfea-4547-829e-8a28b3451353 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:01.148033 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f8c1fef4-cfea-4547-829e-8a28b3451353 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:01.150438 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f8c1fef4-cfea-4547-829e-8a28b3451353 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:01.291543 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f8c1fef4-cfea-4547-829e-8a28b3451353 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce441ded6f554ec28560c75de97af173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc67d8de57543c48bdf45669b684227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:01.302408 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f8c1fef4-cfea-4547-829e-8a28b3451353 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/f8f9ee3a-1a3d-43b9-bdf1-8725457b6611" status: 200 len: 1300 microversion: 2.1 time: 0.175267 Oct 04 19:04:01.305173 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3097/6215] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:01 2022] GET /compute/v2.1/servers/f8f9ee3a-1a3d-43b9-bdf1-8725457b6611 => generated 1300 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:02.346355 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b7fc2825-1f6c-444d-9844-4e0ec71776f9 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:02.347026 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b7fc2825-1f6c-444d-9844-4e0ec71776f9 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: f8f9ee3a-1a3d-43b9-bdf1-8725457b6611] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:02.385552 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b7fc2825-1f6c-444d-9844-4e0ec71776f9 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:02.388701 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b7fc2825-1f6c-444d-9844-4e0ec71776f9 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:02.394077 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b7fc2825-1f6c-444d-9844-4e0ec71776f9 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:02.394077 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b7fc2825-1f6c-444d-9844-4e0ec71776f9 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:02.394077 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b7fc2825-1f6c-444d-9844-4e0ec71776f9 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:02.394077 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b7fc2825-1f6c-444d-9844-4e0ec71776f9 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:03.115577 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b7fc2825-1f6c-444d-9844-4e0ec71776f9 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce441ded6f554ec28560c75de97af173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc67d8de57543c48bdf45669b684227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:03.129972 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b7fc2825-1f6c-444d-9844-4e0ec71776f9 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/f8f9ee3a-1a3d-43b9-bdf1-8725457b6611" status: 200 len: 1366 microversion: 2.1 time: 0.806700 Oct 04 19:04:03.131145 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3119/6216] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:02 2022] GET /compute/v2.1/servers/f8f9ee3a-1a3d-43b9-bdf1-8725457b6611 => generated 1366 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:04.158217 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1081c938-f6d7-4800-9614-35a695f06d34 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:04.158217 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1081c938-f6d7-4800-9614-35a695f06d34 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: f8f9ee3a-1a3d-43b9-bdf1-8725457b6611] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:04.189493 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1081c938-f6d7-4800-9614-35a695f06d34 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:04.189493 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1081c938-f6d7-4800-9614-35a695f06d34 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:04.189493 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1081c938-f6d7-4800-9614-35a695f06d34 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:04.189493 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1081c938-f6d7-4800-9614-35a695f06d34 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:04.189493 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1081c938-f6d7-4800-9614-35a695f06d34 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:04.189493 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1081c938-f6d7-4800-9614-35a695f06d34 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:04.388982 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1081c938-f6d7-4800-9614-35a695f06d34 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce441ded6f554ec28560c75de97af173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc67d8de57543c48bdf45669b684227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:04.388982 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1081c938-f6d7-4800-9614-35a695f06d34 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/f8f9ee3a-1a3d-43b9-bdf1-8725457b6611" status: 200 len: 1366 microversion: 2.1 time: 0.220481 Oct 04 19:04:04.388982 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3098/6217] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:04 2022] GET /compute/v2.1/servers/f8f9ee3a-1a3d-43b9-bdf1-8725457b6611 => generated 1366 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:04.742390 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-2307e11c-b672-42f9-b0ef-92ca2fc5c839 req-50c80102-ab2e-435d-8660-c988d3265600 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8f9ee3a-1a3d-43b9-bdf1-8725457b6611", "tag": "17457df1-6526-44cc-ab11-3633a315e869"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:04:04.780006 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-2307e11c-b672-42f9-b0ef-92ca2fc5c839 req-50c80102-ab2e-435d-8660-c988d3265600 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:04.785005 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-2307e11c-b672-42f9-b0ef-92ca2fc5c839 req-50c80102-ab2e-435d-8660-c988d3265600 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:04.785005 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-2307e11c-b672-42f9-b0ef-92ca2fc5c839 req-50c80102-ab2e-435d-8660-c988d3265600 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:04.814683 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-2307e11c-b672-42f9-b0ef-92ca2fc5c839 req-50c80102-ab2e-435d-8660-c988d3265600 service nova] Creating event network-changed:17457df1-6526-44cc-ab11-3633a315e869 for instance f8f9ee3a-1a3d-43b9-bdf1-8725457b6611 on n-h1-850501-14 Oct 04 19:04:04.836595 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-2307e11c-b672-42f9-b0ef-92ca2fc5c839 req-50c80102-ab2e-435d-8660-c988d3265600 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109135 Oct 04 19:04:04.837996 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3120/6218] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:04:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:04:05.400312 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2f3be36b-653f-4e76-b107-80b2ed3b4274 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:05.406237 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2f3be36b-653f-4e76-b107-80b2ed3b4274 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: f8f9ee3a-1a3d-43b9-bdf1-8725457b6611] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:05.409950 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2f3be36b-653f-4e76-b107-80b2ed3b4274 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:05.410690 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2f3be36b-653f-4e76-b107-80b2ed3b4274 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:05.411328 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2f3be36b-653f-4e76-b107-80b2ed3b4274 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:05.412427 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2f3be36b-653f-4e76-b107-80b2ed3b4274 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:05.413241 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2f3be36b-653f-4e76-b107-80b2ed3b4274 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:05.413855 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2f3be36b-653f-4e76-b107-80b2ed3b4274 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:05.964383 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:04:06.296935 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2f3be36b-653f-4e76-b107-80b2ed3b4274 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce441ded6f554ec28560c75de97af173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc67d8de57543c48bdf45669b684227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:06.325184 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2f3be36b-653f-4e76-b107-80b2ed3b4274 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/f8f9ee3a-1a3d-43b9-bdf1-8725457b6611" status: 200 len: 1366 microversion: 2.1 time: 0.923031 Oct 04 19:04:06.326952 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3099/6219] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:05 2022] GET /compute/v2.1/servers/f8f9ee3a-1a3d-43b9-bdf1-8725457b6611 => generated 1366 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:07.349999 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c604e99c-8870-45c2-b69e-c53da3dfd485 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:07.359151 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c604e99c-8870-45c2-b69e-c53da3dfd485 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: f8f9ee3a-1a3d-43b9-bdf1-8725457b6611] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:07.377183 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c604e99c-8870-45c2-b69e-c53da3dfd485 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:07.384795 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c604e99c-8870-45c2-b69e-c53da3dfd485 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:07.385600 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c604e99c-8870-45c2-b69e-c53da3dfd485 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:07.388376 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c604e99c-8870-45c2-b69e-c53da3dfd485 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:07.390093 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c604e99c-8870-45c2-b69e-c53da3dfd485 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:07.392659 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c604e99c-8870-45c2-b69e-c53da3dfd485 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:07.661808 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=8 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:04:07.821829 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c604e99c-8870-45c2-b69e-c53da3dfd485 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce441ded6f554ec28560c75de97af173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc67d8de57543c48bdf45669b684227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:07.837844 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c604e99c-8870-45c2-b69e-c53da3dfd485 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/f8f9ee3a-1a3d-43b9-bdf1-8725457b6611" status: 200 len: 1366 microversion: 2.1 time: 0.493354 Oct 04 19:04:07.839161 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3121/6220] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:07 2022] GET /compute/v2.1/servers/f8f9ee3a-1a3d-43b9-bdf1-8725457b6611 => generated 1366 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:08.861675 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7b7abf31-b543-434b-915e-2be2486ff7c8 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:08.863081 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7b7abf31-b543-434b-915e-2be2486ff7c8 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: f8f9ee3a-1a3d-43b9-bdf1-8725457b6611] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:08.865999 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=10 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:04:08.876717 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7b7abf31-b543-434b-915e-2be2486ff7c8 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:08.880626 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7b7abf31-b543-434b-915e-2be2486ff7c8 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:08.884678 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7b7abf31-b543-434b-915e-2be2486ff7c8 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:08.884678 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7b7abf31-b543-434b-915e-2be2486ff7c8 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:08.884678 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7b7abf31-b543-434b-915e-2be2486ff7c8 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:08.884678 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7b7abf31-b543-434b-915e-2be2486ff7c8 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:09.202121 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7b7abf31-b543-434b-915e-2be2486ff7c8 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce441ded6f554ec28560c75de97af173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc67d8de57543c48bdf45669b684227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:09.218448 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7b7abf31-b543-434b-915e-2be2486ff7c8 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/f8f9ee3a-1a3d-43b9-bdf1-8725457b6611" status: 200 len: 1366 microversion: 2.1 time: 0.360510 Oct 04 19:04:09.224042 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3100/6221] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:08 2022] GET /compute/v2.1/servers/f8f9ee3a-1a3d-43b9-bdf1-8725457b6611 => generated 1366 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:10.261349 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e2fcb546-e8ad-4dd6-a224-01072fc3450f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:10.263329 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e2fcb546-e8ad-4dd6-a224-01072fc3450f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: f8f9ee3a-1a3d-43b9-bdf1-8725457b6611] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:10.277161 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e2fcb546-e8ad-4dd6-a224-01072fc3450f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:10.279394 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e2fcb546-e8ad-4dd6-a224-01072fc3450f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:10.280386 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e2fcb546-e8ad-4dd6-a224-01072fc3450f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:10.282063 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e2fcb546-e8ad-4dd6-a224-01072fc3450f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:10.282817 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e2fcb546-e8ad-4dd6-a224-01072fc3450f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:10.283461 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e2fcb546-e8ad-4dd6-a224-01072fc3450f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:10.793136 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e2fcb546-e8ad-4dd6-a224-01072fc3450f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce441ded6f554ec28560c75de97af173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc67d8de57543c48bdf45669b684227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:10.809162 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e2fcb546-e8ad-4dd6-a224-01072fc3450f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/f8f9ee3a-1a3d-43b9-bdf1-8725457b6611" status: 200 len: 1366 microversion: 2.1 time: 0.566288 Oct 04 19:04:10.812299 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3122/6222] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:10 2022] GET /compute/v2.1/servers/f8f9ee3a-1a3d-43b9-bdf1-8725457b6611 => generated 1366 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:11.836358 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2a0127e0-d3d9-4517-8c31-7631e13dfd0c tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:11.836981 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2a0127e0-d3d9-4517-8c31-7631e13dfd0c tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: f8f9ee3a-1a3d-43b9-bdf1-8725457b6611] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:11.845302 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2a0127e0-d3d9-4517-8c31-7631e13dfd0c tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:11.846093 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2a0127e0-d3d9-4517-8c31-7631e13dfd0c tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:11.846584 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2a0127e0-d3d9-4517-8c31-7631e13dfd0c tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:11.847324 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2a0127e0-d3d9-4517-8c31-7631e13dfd0c tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:11.847936 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2a0127e0-d3d9-4517-8c31-7631e13dfd0c tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:11.848418 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2a0127e0-d3d9-4517-8c31-7631e13dfd0c tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:12.164361 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2a0127e0-d3d9-4517-8c31-7631e13dfd0c tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce441ded6f554ec28560c75de97af173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc67d8de57543c48bdf45669b684227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:12.176618 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2a0127e0-d3d9-4517-8c31-7631e13dfd0c tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/f8f9ee3a-1a3d-43b9-bdf1-8725457b6611" status: 200 len: 1366 microversion: 2.1 time: 0.345151 Oct 04 19:04:12.184092 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3101/6223] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:11 2022] GET /compute/v2.1/servers/f8f9ee3a-1a3d-43b9-bdf1-8725457b6611 => generated 1366 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:04:12.642637 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0fc7e97d-c42c-42f2-b614-e512aa25300f tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1367116116-access_point-942640324", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": [{"uuid": "5a294b85-c254-41e0-a255-cbf44694a56c"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1461020954", "security_groups": [{"name": "tempest-secgroup_access--1481739482"}, {"name": "tempest-secgroup_general--1319041105"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:04:12.920756 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-352c05ab-7655-492c-8eab-af5770faa44f req-dd8f5f94-fa3f-4eeb-9d75-de56df183d8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8f9ee3a-1a3d-43b9-bdf1-8725457b6611", "name": "network-vif-plugged", "status": "completed", "tag": "17457df1-6526-44cc-ab11-3633a315e869"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:04:12.931178 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-352c05ab-7655-492c-8eab-af5770faa44f req-dd8f5f94-fa3f-4eeb-9d75-de56df183d8f service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:12.932211 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-352c05ab-7655-492c-8eab-af5770faa44f req-dd8f5f94-fa3f-4eeb-9d75-de56df183d8f service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:12.932924 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-352c05ab-7655-492c-8eab-af5770faa44f req-dd8f5f94-fa3f-4eeb-9d75-de56df183d8f service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:12.946899 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-352c05ab-7655-492c-8eab-af5770faa44f req-dd8f5f94-fa3f-4eeb-9d75-de56df183d8f service nova] Creating event network-vif-plugged:17457df1-6526-44cc-ab11-3633a315e869 for instance f8f9ee3a-1a3d-43b9-bdf1-8725457b6611 on n-h1-850501-14 Oct 04 19:04:12.962996 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-352c05ab-7655-492c-8eab-af5770faa44f req-dd8f5f94-fa3f-4eeb-9d75-de56df183d8f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152021 Oct 04 19:04:12.962996 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3102/6224] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:04:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:04:13.133535 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.neutron [None req-0fc7e97d-c42c-42f2-b614-e512aa25300f tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] validate_networks() for [('5a294b85-c254-41e0-a255-cbf44694a56c', None, None, None, None, None)] {{(pid=123001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:04:13.206046 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-926f8fa2-3b3b-40a2-8220-59e4f57adebc tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:13.206779 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-926f8fa2-3b3b-40a2-8220-59e4f57adebc tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: f8f9ee3a-1a3d-43b9-bdf1-8725457b6611] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:13.219845 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-926f8fa2-3b3b-40a2-8220-59e4f57adebc tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:13.224176 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-926f8fa2-3b3b-40a2-8220-59e4f57adebc tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:13.224828 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-926f8fa2-3b3b-40a2-8220-59e4f57adebc tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:13.225918 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-926f8fa2-3b3b-40a2-8220-59e4f57adebc tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:13.226570 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-926f8fa2-3b3b-40a2-8220-59e4f57adebc tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:13.246383 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-926f8fa2-3b3b-40a2-8220-59e4f57adebc tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:13.561140 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-926f8fa2-3b3b-40a2-8220-59e4f57adebc tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce441ded6f554ec28560c75de97af173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc67d8de57543c48bdf45669b684227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:13.573741 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-926f8fa2-3b3b-40a2-8220-59e4f57adebc tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/f8f9ee3a-1a3d-43b9-bdf1-8725457b6611" status: 200 len: 1366 microversion: 2.1 time: 0.371987 Oct 04 19:04:13.576873 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3103/6225] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:13 2022] GET /compute/v2.1/servers/f8f9ee3a-1a3d-43b9-bdf1-8725457b6611 => generated 1366 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:04:13.942920 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-0fc7e97d-c42c-42f2-b614-e512aa25300f tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:04:13.942920 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-0fc7e97d-c42c-42f2-b614-e512aa25300f tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:04:13.942920 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-0fc7e97d-c42c-42f2-b614-e512aa25300f tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:04:13.942920 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-0fc7e97d-c42c-42f2-b614-e512aa25300f tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:04:13.942920 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-0fc7e97d-c42c-42f2-b614-e512aa25300f tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:04:13.956102 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0fc7e97d-c42c-42f2-b614-e512aa25300f tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:13.956595 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0fc7e97d-c42c-42f2-b614-e512aa25300f tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:13.957051 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0fc7e97d-c42c-42f2-b614-e512aa25300f tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:13.957766 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0fc7e97d-c42c-42f2-b614-e512aa25300f tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:13.959429 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0fc7e97d-c42c-42f2-b614-e512aa25300f tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:13.959864 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0fc7e97d-c42c-42f2-b614-e512aa25300f tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:13.993351 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-0fc7e97d-c42c-42f2-b614-e512aa25300f tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Getting quotas for project 7c177dc51b8e4a969670684997f3cb2a. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:04:13.999524 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-0fc7e97d-c42c-42f2-b614-e512aa25300f tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Getting quotas for user c1e772e66d8c42dfa995bbecb6b9ccf9 and project 7c177dc51b8e4a969670684997f3cb2a. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:04:14.014648 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0fc7e97d-c42c-42f2-b614-e512aa25300f tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Going to run 1 instances... {{(pid=123001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:04:14.017275 n-d-850501-14 devstack@n-api.service[123001]: WARNING nova.utils [None req-0fc7e97d-c42c-42f2-b614-e512aa25300f tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1367116116-access_point-942640324 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1367116116-ac Oct 04 19:04:14.018235 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0fc7e97d-c42c-42f2-b614-e512aa25300f tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] [instance: a939ed32-d553-4214-9f35-d59e18a5d86b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:04:14.599265 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4619500e-8309-4841-8e2a-f0e5ec17e108 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:14.600560 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4619500e-8309-4841-8e2a-f0e5ec17e108 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: f8f9ee3a-1a3d-43b9-bdf1-8725457b6611] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:14.603247 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0fc7e97d-c42c-42f2-b614-e512aa25300f tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 458 microversion: 2.1 time: 1.962827 Oct 04 19:04:14.605614 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3123/6226] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 19:04:12 2022] POST /compute/v2.1/servers => generated 458 bytes in 1968 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:04:14.624037 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4619500e-8309-4841-8e2a-f0e5ec17e108 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:14.627581 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4619500e-8309-4841-8e2a-f0e5ec17e108 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:14.628966 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f694ca81-0b74-4733-ab57-749872be9c00 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:14.629176 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4619500e-8309-4841-8e2a-f0e5ec17e108 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:14.630099 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4619500e-8309-4841-8e2a-f0e5ec17e108 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:14.630600 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f694ca81-0b74-4733-ab57-749872be9c00 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] [instance: a939ed32-d553-4214-9f35-d59e18a5d86b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:14.630763 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4619500e-8309-4841-8e2a-f0e5ec17e108 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:14.633171 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4619500e-8309-4841-8e2a-f0e5ec17e108 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:14.772253 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f694ca81-0b74-4733-ab57-749872be9c00 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e772e66d8c42dfa995bbecb6b9ccf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c177dc51b8e4a969670684997f3cb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:14.835224 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f694ca81-0b74-4733-ab57-749872be9c00 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] 10.222.0.20 "GET /compute/v2.1/servers/a939ed32-d553-4214-9f35-d59e18a5d86b" status: 200 len: 1294 microversion: 2.1 time: 0.215493 Oct 04 19:04:14.855026 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3124/6227] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:14 2022] GET /compute/v2.1/servers/a939ed32-d553-4214-9f35-d59e18a5d86b => generated 1294 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:15.125943 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4619500e-8309-4841-8e2a-f0e5ec17e108 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce441ded6f554ec28560c75de97af173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc67d8de57543c48bdf45669b684227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:15.134048 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4619500e-8309-4841-8e2a-f0e5ec17e108 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/f8f9ee3a-1a3d-43b9-bdf1-8725457b6611" status: 200 len: 1366 microversion: 2.1 time: 0.538757 Oct 04 19:04:15.137178 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3104/6228] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:14 2022] GET /compute/v2.1/servers/f8f9ee3a-1a3d-43b9-bdf1-8725457b6611 => generated 1366 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:15.869381 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8e99556a-9638-47a7-b0c8-e37c9d8f8aac tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:15.871922 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8e99556a-9638-47a7-b0c8-e37c9d8f8aac tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] [instance: a939ed32-d553-4214-9f35-d59e18a5d86b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:16.025346 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8e99556a-9638-47a7-b0c8-e37c9d8f8aac tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e772e66d8c42dfa995bbecb6b9ccf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c177dc51b8e4a969670684997f3cb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:16.049741 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8e99556a-9638-47a7-b0c8-e37c9d8f8aac tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] 10.222.0.20 "GET /compute/v2.1/servers/a939ed32-d553-4214-9f35-d59e18a5d86b" status: 200 len: 1294 microversion: 2.1 time: 0.185333 Oct 04 19:04:16.051365 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3125/6229] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:15 2022] GET /compute/v2.1/servers/a939ed32-d553-4214-9f35-d59e18a5d86b => generated 1294 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:16.159921 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1bde6c04-c11a-4b5a-b130-0dfe5c3b3908 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:16.160974 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1bde6c04-c11a-4b5a-b130-0dfe5c3b3908 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: f8f9ee3a-1a3d-43b9-bdf1-8725457b6611] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:16.173343 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1bde6c04-c11a-4b5a-b130-0dfe5c3b3908 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:16.174178 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1bde6c04-c11a-4b5a-b130-0dfe5c3b3908 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:16.174828 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1bde6c04-c11a-4b5a-b130-0dfe5c3b3908 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:16.181339 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1bde6c04-c11a-4b5a-b130-0dfe5c3b3908 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:16.182090 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1bde6c04-c11a-4b5a-b130-0dfe5c3b3908 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:16.184098 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1bde6c04-c11a-4b5a-b130-0dfe5c3b3908 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:16.547488 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1bde6c04-c11a-4b5a-b130-0dfe5c3b3908 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce441ded6f554ec28560c75de97af173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc67d8de57543c48bdf45669b684227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:16.559300 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1bde6c04-c11a-4b5a-b130-0dfe5c3b3908 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/f8f9ee3a-1a3d-43b9-bdf1-8725457b6611" status: 200 len: 1556 microversion: 2.1 time: 0.403344 Oct 04 19:04:16.565520 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3105/6230] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:16 2022] GET /compute/v2.1/servers/f8f9ee3a-1a3d-43b9-bdf1-8725457b6611 => generated 1556 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:16.587505 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9358b213-de6a-46bb-9df8-29ba01171bdb tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:16.588019 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-9358b213-de6a-46bb-9df8-29ba01171bdb tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: f8f9ee3a-1a3d-43b9-bdf1-8725457b6611] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:16.595192 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9358b213-de6a-46bb-9df8-29ba01171bdb tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:16.595703 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9358b213-de6a-46bb-9df8-29ba01171bdb tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:16.596254 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9358b213-de6a-46bb-9df8-29ba01171bdb tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:16.597712 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9358b213-de6a-46bb-9df8-29ba01171bdb tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:16.598384 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9358b213-de6a-46bb-9df8-29ba01171bdb tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:16.598989 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9358b213-de6a-46bb-9df8-29ba01171bdb tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:16.726294 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9358b213-de6a-46bb-9df8-29ba01171bdb tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/f8f9ee3a-1a3d-43b9-bdf1-8725457b6611/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.143116 Oct 04 19:04:16.726902 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3126/6231] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Oct 4 19:04:16 2022] GET /compute/v2.1/servers/f8f9ee3a-1a3d-43b9-bdf1-8725457b6611/os-interface => generated 284 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:04:17.077952 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b2b3213e-b5d9-4b8c-adac-5fef35ed9810 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:17.078841 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b2b3213e-b5d9-4b8c-adac-5fef35ed9810 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] [instance: a939ed32-d553-4214-9f35-d59e18a5d86b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:17.082252 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=49,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:04:17.093412 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b2b3213e-b5d9-4b8c-adac-5fef35ed9810 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:17.094188 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b2b3213e-b5d9-4b8c-adac-5fef35ed9810 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:17.094802 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b2b3213e-b5d9-4b8c-adac-5fef35ed9810 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:17.097572 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b2b3213e-b5d9-4b8c-adac-5fef35ed9810 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:17.100801 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b2b3213e-b5d9-4b8c-adac-5fef35ed9810 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:17.101534 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b2b3213e-b5d9-4b8c-adac-5fef35ed9810 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:17.296550 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b2b3213e-b5d9-4b8c-adac-5fef35ed9810 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e772e66d8c42dfa995bbecb6b9ccf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c177dc51b8e4a969670684997f3cb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:17.319384 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b2b3213e-b5d9-4b8c-adac-5fef35ed9810 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] 10.222.0.20 "GET /compute/v2.1/servers/a939ed32-d553-4214-9f35-d59e18a5d86b" status: 200 len: 1290 microversion: 2.1 time: 0.246454 Oct 04 19:04:17.323020 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3106/6232] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:17 2022] GET /compute/v2.1/servers/a939ed32-d553-4214-9f35-d59e18a5d86b => generated 1290 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:18.351206 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-12664e1d-1d5e-47fb-8a67-d5f4dedde0ed tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:18.354214 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-12664e1d-1d5e-47fb-8a67-d5f4dedde0ed tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] [instance: a939ed32-d553-4214-9f35-d59e18a5d86b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:18.364006 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-12664e1d-1d5e-47fb-8a67-d5f4dedde0ed tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:18.364750 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-12664e1d-1d5e-47fb-8a67-d5f4dedde0ed tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:18.365544 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-12664e1d-1d5e-47fb-8a67-d5f4dedde0ed tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:18.366496 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-12664e1d-1d5e-47fb-8a67-d5f4dedde0ed tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:18.367322 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-12664e1d-1d5e-47fb-8a67-d5f4dedde0ed tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:18.368344 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-12664e1d-1d5e-47fb-8a67-d5f4dedde0ed tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:18.493803 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-12664e1d-1d5e-47fb-8a67-d5f4dedde0ed tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e772e66d8c42dfa995bbecb6b9ccf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c177dc51b8e4a969670684997f3cb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:18.505942 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-12664e1d-1d5e-47fb-8a67-d5f4dedde0ed tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] 10.222.0.20 "GET /compute/v2.1/servers/a939ed32-d553-4214-9f35-d59e18a5d86b" status: 200 len: 1346 microversion: 2.1 time: 0.159163 Oct 04 19:04:18.521451 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3127/6233] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:18 2022] GET /compute/v2.1/servers/a939ed32-d553-4214-9f35-d59e18a5d86b => generated 1346 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:19.191861 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-33546c6b-a406-4c08-aeaa-e62bdc15a1ed req-28f4d7f6-b752-4837-a6c7-19ea17ec34f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8f9ee3a-1a3d-43b9-bdf1-8725457b6611", "tag": "17457df1-6526-44cc-ab11-3633a315e869"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:04:19.218737 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-33546c6b-a406-4c08-aeaa-e62bdc15a1ed req-28f4d7f6-b752-4837-a6c7-19ea17ec34f5 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:19.219238 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-33546c6b-a406-4c08-aeaa-e62bdc15a1ed req-28f4d7f6-b752-4837-a6c7-19ea17ec34f5 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:19.219672 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-33546c6b-a406-4c08-aeaa-e62bdc15a1ed req-28f4d7f6-b752-4837-a6c7-19ea17ec34f5 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:19.268339 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-33546c6b-a406-4c08-aeaa-e62bdc15a1ed req-28f4d7f6-b752-4837-a6c7-19ea17ec34f5 service nova] Creating event network-changed:17457df1-6526-44cc-ab11-3633a315e869 for instance f8f9ee3a-1a3d-43b9-bdf1-8725457b6611 on n-h1-850501-14 Oct 04 19:04:19.281111 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-33546c6b-a406-4c08-aeaa-e62bdc15a1ed req-28f4d7f6-b752-4837-a6c7-19ea17ec34f5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.249515 Oct 04 19:04:19.293724 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3107/6234] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:04:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:04:19.532494 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9ae72051-d45a-4ef0-8334-210825815c58 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:19.534312 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-9ae72051-d45a-4ef0-8334-210825815c58 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] [instance: a939ed32-d553-4214-9f35-d59e18a5d86b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:19.542530 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9ae72051-d45a-4ef0-8334-210825815c58 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:19.543033 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9ae72051-d45a-4ef0-8334-210825815c58 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:19.543491 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9ae72051-d45a-4ef0-8334-210825815c58 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:19.553591 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9ae72051-d45a-4ef0-8334-210825815c58 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:19.554807 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9ae72051-d45a-4ef0-8334-210825815c58 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:19.566280 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9ae72051-d45a-4ef0-8334-210825815c58 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:19.760733 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9ae72051-d45a-4ef0-8334-210825815c58 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e772e66d8c42dfa995bbecb6b9ccf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c177dc51b8e4a969670684997f3cb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:19.779247 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9ae72051-d45a-4ef0-8334-210825815c58 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] 10.222.0.20 "GET /compute/v2.1/servers/a939ed32-d553-4214-9f35-d59e18a5d86b" status: 200 len: 1364 microversion: 2.1 time: 0.251064 Oct 04 19:04:19.780155 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3128/6235] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:19 2022] GET /compute/v2.1/servers/a939ed32-d553-4214-9f35-d59e18a5d86b => generated 1364 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:20.811938 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2d41a220-b1c2-4522-ba62-b6d3e15b7094 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:20.812708 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2d41a220-b1c2-4522-ba62-b6d3e15b7094 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] [instance: a939ed32-d553-4214-9f35-d59e18a5d86b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:20.819641 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2d41a220-b1c2-4522-ba62-b6d3e15b7094 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:20.820438 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2d41a220-b1c2-4522-ba62-b6d3e15b7094 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:20.820878 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2d41a220-b1c2-4522-ba62-b6d3e15b7094 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:20.821612 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2d41a220-b1c2-4522-ba62-b6d3e15b7094 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:20.822045 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2d41a220-b1c2-4522-ba62-b6d3e15b7094 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:20.822469 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2d41a220-b1c2-4522-ba62-b6d3e15b7094 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:21.023723 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2d41a220-b1c2-4522-ba62-b6d3e15b7094 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e772e66d8c42dfa995bbecb6b9ccf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c177dc51b8e4a969670684997f3cb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:21.036440 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2d41a220-b1c2-4522-ba62-b6d3e15b7094 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] 10.222.0.20 "GET /compute/v2.1/servers/a939ed32-d553-4214-9f35-d59e18a5d86b" status: 200 len: 1472 microversion: 2.1 time: 0.230313 Oct 04 19:04:21.045757 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3108/6236] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:20 2022] GET /compute/v2.1/servers/a939ed32-d553-4214-9f35-d59e18a5d86b => generated 1472 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:22.059755 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7f2cc625-b3e9-4d9b-a198-722f52ff5c12 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:22.060500 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7f2cc625-b3e9-4d9b-a198-722f52ff5c12 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] [instance: a939ed32-d553-4214-9f35-d59e18a5d86b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:22.067733 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7f2cc625-b3e9-4d9b-a198-722f52ff5c12 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:22.068255 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7f2cc625-b3e9-4d9b-a198-722f52ff5c12 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:22.068697 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7f2cc625-b3e9-4d9b-a198-722f52ff5c12 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:22.069402 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7f2cc625-b3e9-4d9b-a198-722f52ff5c12 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:22.069854 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7f2cc625-b3e9-4d9b-a198-722f52ff5c12 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:22.070340 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7f2cc625-b3e9-4d9b-a198-722f52ff5c12 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:22.241635 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7f2cc625-b3e9-4d9b-a198-722f52ff5c12 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e772e66d8c42dfa995bbecb6b9ccf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c177dc51b8e4a969670684997f3cb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:22.249769 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7f2cc625-b3e9-4d9b-a198-722f52ff5c12 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] 10.222.0.20 "GET /compute/v2.1/servers/a939ed32-d553-4214-9f35-d59e18a5d86b" status: 200 len: 1472 microversion: 2.1 time: 0.194656 Oct 04 19:04:22.265060 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3129/6237] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:22 2022] GET /compute/v2.1/servers/a939ed32-d553-4214-9f35-d59e18a5d86b => generated 1472 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:23.275219 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-46066f3f-17fe-4ff9-9b75-1cb69d5fe419 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:23.277244 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-46066f3f-17fe-4ff9-9b75-1cb69d5fe419 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] [instance: a939ed32-d553-4214-9f35-d59e18a5d86b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:23.286564 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-46066f3f-17fe-4ff9-9b75-1cb69d5fe419 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:23.287184 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-46066f3f-17fe-4ff9-9b75-1cb69d5fe419 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:23.287684 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-46066f3f-17fe-4ff9-9b75-1cb69d5fe419 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:23.291427 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-46066f3f-17fe-4ff9-9b75-1cb69d5fe419 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:23.291427 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-46066f3f-17fe-4ff9-9b75-1cb69d5fe419 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:23.291427 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-46066f3f-17fe-4ff9-9b75-1cb69d5fe419 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:23.442638 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-46066f3f-17fe-4ff9-9b75-1cb69d5fe419 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e772e66d8c42dfa995bbecb6b9ccf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c177dc51b8e4a969670684997f3cb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:23.451346 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-46066f3f-17fe-4ff9-9b75-1cb69d5fe419 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] 10.222.0.20 "GET /compute/v2.1/servers/a939ed32-d553-4214-9f35-d59e18a5d86b" status: 200 len: 1472 microversion: 2.1 time: 0.180389 Oct 04 19:04:23.464352 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3109/6238] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:23 2022] GET /compute/v2.1/servers/a939ed32-d553-4214-9f35-d59e18a5d86b => generated 1472 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:23.817753 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-103fee33-7d8b-4472-a2cc-5597ad04e250 req-833f1bc5-fc43-4030-943f-d87fa8704dc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a939ed32-d553-4214-9f35-d59e18a5d86b", "tag": "3f36fac6-4f01-474d-8381-b3c1c0311c69"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:04:23.854325 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-103fee33-7d8b-4472-a2cc-5597ad04e250 req-833f1bc5-fc43-4030-943f-d87fa8704dc8 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:23.855097 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-103fee33-7d8b-4472-a2cc-5597ad04e250 req-833f1bc5-fc43-4030-943f-d87fa8704dc8 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:23.855799 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-103fee33-7d8b-4472-a2cc-5597ad04e250 req-833f1bc5-fc43-4030-943f-d87fa8704dc8 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:23.873349 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-103fee33-7d8b-4472-a2cc-5597ad04e250 req-833f1bc5-fc43-4030-943f-d87fa8704dc8 service nova] Creating event network-changed:3f36fac6-4f01-474d-8381-b3c1c0311c69 for instance a939ed32-d553-4214-9f35-d59e18a5d86b on n-h2-850501-14 Oct 04 19:04:23.877257 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-103fee33-7d8b-4472-a2cc-5597ad04e250 req-833f1bc5-fc43-4030-943f-d87fa8704dc8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063980 Oct 04 19:04:23.878541 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3130/6239] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:04:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:04:24.474819 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d8fec55e-47ec-4ff6-8eab-9d84df6d7d4f tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:24.475435 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d8fec55e-47ec-4ff6-8eab-9d84df6d7d4f tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] [instance: a939ed32-d553-4214-9f35-d59e18a5d86b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:24.483971 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d8fec55e-47ec-4ff6-8eab-9d84df6d7d4f tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:24.484516 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d8fec55e-47ec-4ff6-8eab-9d84df6d7d4f tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:24.484963 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d8fec55e-47ec-4ff6-8eab-9d84df6d7d4f tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:24.485683 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d8fec55e-47ec-4ff6-8eab-9d84df6d7d4f tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:24.486146 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d8fec55e-47ec-4ff6-8eab-9d84df6d7d4f tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:24.486584 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d8fec55e-47ec-4ff6-8eab-9d84df6d7d4f tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:24.761596 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d8fec55e-47ec-4ff6-8eab-9d84df6d7d4f tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e772e66d8c42dfa995bbecb6b9ccf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c177dc51b8e4a969670684997f3cb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:24.768003 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d8fec55e-47ec-4ff6-8eab-9d84df6d7d4f tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] 10.222.0.20 "GET /compute/v2.1/servers/a939ed32-d553-4214-9f35-d59e18a5d86b" status: 200 len: 1472 microversion: 2.1 time: 0.296911 Oct 04 19:04:24.785463 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3110/6240] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:24 2022] GET /compute/v2.1/servers/a939ed32-d553-4214-9f35-d59e18a5d86b => generated 1472 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:25.799453 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:04:25.812236 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0c00375e-7dc3-4ee0-828e-cd3249766c4a tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:25.812236 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0c00375e-7dc3-4ee0-828e-cd3249766c4a tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] [instance: a939ed32-d553-4214-9f35-d59e18a5d86b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:25.818329 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0c00375e-7dc3-4ee0-828e-cd3249766c4a tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:25.818976 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0c00375e-7dc3-4ee0-828e-cd3249766c4a tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:25.819640 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0c00375e-7dc3-4ee0-828e-cd3249766c4a tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:25.820691 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0c00375e-7dc3-4ee0-828e-cd3249766c4a tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:25.821287 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0c00375e-7dc3-4ee0-828e-cd3249766c4a tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:25.821903 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0c00375e-7dc3-4ee0-828e-cd3249766c4a tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:26.051195 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=10 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:04:26.057982 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0c00375e-7dc3-4ee0-828e-cd3249766c4a tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e772e66d8c42dfa995bbecb6b9ccf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c177dc51b8e4a969670684997f3cb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:26.068397 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0c00375e-7dc3-4ee0-828e-cd3249766c4a tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] 10.222.0.20 "GET /compute/v2.1/servers/a939ed32-d553-4214-9f35-d59e18a5d86b" status: 200 len: 1472 microversion: 2.1 time: 0.269733 Oct 04 19:04:26.069243 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3131/6241] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:25 2022] GET /compute/v2.1/servers/a939ed32-d553-4214-9f35-d59e18a5d86b => generated 1472 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:27.095162 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d3ac5a2c-d25e-4238-872d-08acc23e6833 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:27.095776 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d3ac5a2c-d25e-4238-872d-08acc23e6833 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] [instance: a939ed32-d553-4214-9f35-d59e18a5d86b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:27.103354 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d3ac5a2c-d25e-4238-872d-08acc23e6833 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:27.103842 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d3ac5a2c-d25e-4238-872d-08acc23e6833 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:27.104358 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d3ac5a2c-d25e-4238-872d-08acc23e6833 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:27.105056 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d3ac5a2c-d25e-4238-872d-08acc23e6833 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:27.105509 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d3ac5a2c-d25e-4238-872d-08acc23e6833 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:27.105930 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d3ac5a2c-d25e-4238-872d-08acc23e6833 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:27.109609 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=85 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:04:27.262527 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d3ac5a2c-d25e-4238-872d-08acc23e6833 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e772e66d8c42dfa995bbecb6b9ccf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c177dc51b8e4a969670684997f3cb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:27.270993 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d3ac5a2c-d25e-4238-872d-08acc23e6833 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] 10.222.0.20 "GET /compute/v2.1/servers/a939ed32-d553-4214-9f35-d59e18a5d86b" status: 200 len: 1472 microversion: 2.1 time: 0.180379 Oct 04 19:04:27.271579 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3111/6242] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:27 2022] GET /compute/v2.1/servers/a939ed32-d553-4214-9f35-d59e18a5d86b => generated 1472 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:28.294688 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-34336bee-ed3d-4bc5-b77b-645772760220 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:28.296082 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-34336bee-ed3d-4bc5-b77b-645772760220 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] [instance: a939ed32-d553-4214-9f35-d59e18a5d86b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:28.300394 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:04:28.304769 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-34336bee-ed3d-4bc5-b77b-645772760220 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:28.305281 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-34336bee-ed3d-4bc5-b77b-645772760220 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:28.305905 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-34336bee-ed3d-4bc5-b77b-645772760220 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:28.306772 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-34336bee-ed3d-4bc5-b77b-645772760220 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:28.307231 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-34336bee-ed3d-4bc5-b77b-645772760220 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:28.307652 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-34336bee-ed3d-4bc5-b77b-645772760220 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:28.478155 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-34336bee-ed3d-4bc5-b77b-645772760220 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e772e66d8c42dfa995bbecb6b9ccf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c177dc51b8e4a969670684997f3cb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:28.488636 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-34336bee-ed3d-4bc5-b77b-645772760220 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] 10.222.0.20 "GET /compute/v2.1/servers/a939ed32-d553-4214-9f35-d59e18a5d86b" status: 200 len: 1472 microversion: 2.1 time: 0.197549 Oct 04 19:04:28.490134 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3132/6243] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:28 2022] GET /compute/v2.1/servers/a939ed32-d553-4214-9f35-d59e18a5d86b => generated 1472 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:29.514987 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e932f688-377c-439c-ac2a-69a146573f09 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:29.516339 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e932f688-377c-439c-ac2a-69a146573f09 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] [instance: a939ed32-d553-4214-9f35-d59e18a5d86b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:29.524037 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e932f688-377c-439c-ac2a-69a146573f09 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:29.528939 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e932f688-377c-439c-ac2a-69a146573f09 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:29.529785 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e932f688-377c-439c-ac2a-69a146573f09 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:29.530715 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e932f688-377c-439c-ac2a-69a146573f09 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:29.531232 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e932f688-377c-439c-ac2a-69a146573f09 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:29.532631 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e932f688-377c-439c-ac2a-69a146573f09 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:29.755592 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e932f688-377c-439c-ac2a-69a146573f09 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e772e66d8c42dfa995bbecb6b9ccf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c177dc51b8e4a969670684997f3cb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:29.764406 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e932f688-377c-439c-ac2a-69a146573f09 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] 10.222.0.20 "GET /compute/v2.1/servers/a939ed32-d553-4214-9f35-d59e18a5d86b" status: 200 len: 1472 microversion: 2.1 time: 0.254007 Oct 04 19:04:29.765011 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3112/6244] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:29 2022] GET /compute/v2.1/servers/a939ed32-d553-4214-9f35-d59e18a5d86b => generated 1472 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:30.378023 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a0ed3e58-7464-4b84-abf9-1a84354a79db tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-712863137", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "8e42da7f-4be1-4434-82db-3887d3b51f81", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "dbc89e1f-759d-4fcb-8e1c-542119e29e34"}]}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:04:30.450523 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.neutron [None req-a0ed3e58-7464-4b84-abf9-1a84354a79db tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] validate_networks() for [('dbc89e1f-759d-4fcb-8e1c-542119e29e34', None, None, None, None, None)] {{(pid=123001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:04:30.787999 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-498b2d57-6b6d-4a87-8de9-bf406ebdd855 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:30.789238 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-498b2d57-6b6d-4a87-8de9-bf406ebdd855 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] [instance: a939ed32-d553-4214-9f35-d59e18a5d86b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:30.798824 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-498b2d57-6b6d-4a87-8de9-bf406ebdd855 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:30.799318 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-498b2d57-6b6d-4a87-8de9-bf406ebdd855 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:30.799761 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-498b2d57-6b6d-4a87-8de9-bf406ebdd855 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:30.803313 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-498b2d57-6b6d-4a87-8de9-bf406ebdd855 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:30.803802 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-498b2d57-6b6d-4a87-8de9-bf406ebdd855 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:30.804274 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-498b2d57-6b6d-4a87-8de9-bf406ebdd855 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:31.432191 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-498b2d57-6b6d-4a87-8de9-bf406ebdd855 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e772e66d8c42dfa995bbecb6b9ccf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c177dc51b8e4a969670684997f3cb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:31.441335 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-498b2d57-6b6d-4a87-8de9-bf406ebdd855 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] 10.222.0.20 "GET /compute/v2.1/servers/a939ed32-d553-4214-9f35-d59e18a5d86b" status: 200 len: 1472 microversion: 2.1 time: 0.657751 Oct 04 19:04:31.463207 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3113/6245] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:30 2022] GET /compute/v2.1/servers/a939ed32-d553-4214-9f35-d59e18a5d86b => generated 1472 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:04:31.470357 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-1390f8d8-fa82-49ce-8372-69e2795a6b87 req-e788640a-9878-4c1a-bd3d-0b39653cc27d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a939ed32-d553-4214-9f35-d59e18a5d86b", "name": "network-vif-plugged", "status": "completed", "tag": "3f36fac6-4f01-474d-8381-b3c1c0311c69"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:04:31.481410 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-1390f8d8-fa82-49ce-8372-69e2795a6b87 req-e788640a-9878-4c1a-bd3d-0b39653cc27d service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:31.481966 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-1390f8d8-fa82-49ce-8372-69e2795a6b87 req-e788640a-9878-4c1a-bd3d-0b39653cc27d service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:31.482689 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-1390f8d8-fa82-49ce-8372-69e2795a6b87 req-e788640a-9878-4c1a-bd3d-0b39653cc27d service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:31.494225 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-a0ed3e58-7464-4b84-abf9-1a84354a79db tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:04:31.495242 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-a0ed3e58-7464-4b84-abf9-1a84354a79db tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:04:31.495894 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-a0ed3e58-7464-4b84-abf9-1a84354a79db tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:04:31.496503 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-a0ed3e58-7464-4b84-abf9-1a84354a79db tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:04:31.497333 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-a0ed3e58-7464-4b84-abf9-1a84354a79db tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:04:31.497690 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-1390f8d8-fa82-49ce-8372-69e2795a6b87 req-e788640a-9878-4c1a-bd3d-0b39653cc27d service nova] Creating event network-vif-plugged:3f36fac6-4f01-474d-8381-b3c1c0311c69 for instance a939ed32-d553-4214-9f35-d59e18a5d86b on n-h2-850501-14 Oct 04 19:04:31.507949 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-1390f8d8-fa82-49ce-8372-69e2795a6b87 req-e788640a-9878-4c1a-bd3d-0b39653cc27d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039912 Oct 04 19:04:31.507949 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3114/6246] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:04:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:04:31.514511 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a0ed3e58-7464-4b84-abf9-1a84354a79db tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:31.515291 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a0ed3e58-7464-4b84-abf9-1a84354a79db tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:31.515735 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a0ed3e58-7464-4b84-abf9-1a84354a79db tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:31.516489 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a0ed3e58-7464-4b84-abf9-1a84354a79db tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:31.516939 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a0ed3e58-7464-4b84-abf9-1a84354a79db tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:31.517363 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a0ed3e58-7464-4b84-abf9-1a84354a79db tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:31.536785 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-a0ed3e58-7464-4b84-abf9-1a84354a79db tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Getting quotas for project 82d0cd3db371459db429cb770abde738. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:04:31.542750 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-a0ed3e58-7464-4b84-abf9-1a84354a79db tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Getting quotas for user a65ae9c3fb3c46a2a393fe21ce21b9d4 and project 82d0cd3db371459db429cb770abde738. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:04:31.622073 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a0ed3e58-7464-4b84-abf9-1a84354a79db tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Going to run 1 instances... {{(pid=123001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:04:31.625083 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a0ed3e58-7464-4b84-abf9-1a84354a79db tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 4a92d48e-091e-4ede-a4db-476209e74bf2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8e42da7f-4be1-4434-82db-3887d3b51f81',volume_size=None,volume_type=None)] {{(pid=123001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:04:32.149480 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a0ed3e58-7464-4b84-abf9-1a84354a79db tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.773879 Oct 04 19:04:32.152977 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3133/6247] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 19:04:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1779 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:04:32.162347 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f973492d-1f7c-4b3f-a3ca-0f79026f51d1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:32.162912 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f973492d-1f7c-4b3f-a3ca-0f79026f51d1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 4a92d48e-091e-4ede-a4db-476209e74bf2] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:32.259521 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f973492d-1f7c-4b3f-a3ca-0f79026f51d1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:32.280548 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f973492d-1f7c-4b3f-a3ca-0f79026f51d1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/4a92d48e-091e-4ede-a4db-476209e74bf2" status: 200 len: 1070 microversion: 2.1 time: 0.121971 Oct 04 19:04:32.283901 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3115/6248] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:32 2022] GET /compute/v2.1/servers/4a92d48e-091e-4ede-a4db-476209e74bf2 => generated 1070 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:32.467182 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c300fac8-0dd2-4f48-abac-e014bd127c39 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:32.467726 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c300fac8-0dd2-4f48-abac-e014bd127c39 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] [instance: a939ed32-d553-4214-9f35-d59e18a5d86b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:32.475812 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c300fac8-0dd2-4f48-abac-e014bd127c39 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:32.476330 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c300fac8-0dd2-4f48-abac-e014bd127c39 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:32.476937 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c300fac8-0dd2-4f48-abac-e014bd127c39 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:32.478234 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c300fac8-0dd2-4f48-abac-e014bd127c39 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:32.478980 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c300fac8-0dd2-4f48-abac-e014bd127c39 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:32.479562 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c300fac8-0dd2-4f48-abac-e014bd127c39 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:32.486582 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=67 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:04:32.668655 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c300fac8-0dd2-4f48-abac-e014bd127c39 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e772e66d8c42dfa995bbecb6b9ccf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c177dc51b8e4a969670684997f3cb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:32.677695 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c300fac8-0dd2-4f48-abac-e014bd127c39 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] 10.222.0.20 "GET /compute/v2.1/servers/a939ed32-d553-4214-9f35-d59e18a5d86b" status: 200 len: 1472 microversion: 2.1 time: 0.214812 Oct 04 19:04:32.678587 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3134/6249] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:32 2022] GET /compute/v2.1/servers/a939ed32-d553-4214-9f35-d59e18a5d86b => generated 1472 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:33.305187 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4825c2de-961d-41c3-96ea-8a67e6644892 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:33.305812 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4825c2de-961d-41c3-96ea-8a67e6644892 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 4a92d48e-091e-4ede-a4db-476209e74bf2] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:33.314273 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4825c2de-961d-41c3-96ea-8a67e6644892 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:33.314771 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4825c2de-961d-41c3-96ea-8a67e6644892 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:33.315209 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4825c2de-961d-41c3-96ea-8a67e6644892 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:33.316001 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4825c2de-961d-41c3-96ea-8a67e6644892 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:33.316683 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4825c2de-961d-41c3-96ea-8a67e6644892 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:33.317122 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4825c2de-961d-41c3-96ea-8a67e6644892 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:33.393327 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4825c2de-961d-41c3-96ea-8a67e6644892 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:33.403090 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4825c2de-961d-41c3-96ea-8a67e6644892 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/4a92d48e-091e-4ede-a4db-476209e74bf2" status: 200 len: 1120 microversion: 2.1 time: 0.102236 Oct 04 19:04:33.403686 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3116/6250] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:33 2022] GET /compute/v2.1/servers/4a92d48e-091e-4ede-a4db-476209e74bf2 => generated 1120 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:33.703696 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8286d79e-a91e-4ff8-aca4-8c7eb3a573c1 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:33.704870 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8286d79e-a91e-4ff8-aca4-8c7eb3a573c1 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] [instance: a939ed32-d553-4214-9f35-d59e18a5d86b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:33.711977 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8286d79e-a91e-4ff8-aca4-8c7eb3a573c1 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:33.712629 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8286d79e-a91e-4ff8-aca4-8c7eb3a573c1 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:33.713223 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8286d79e-a91e-4ff8-aca4-8c7eb3a573c1 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:33.714531 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8286d79e-a91e-4ff8-aca4-8c7eb3a573c1 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:33.715354 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8286d79e-a91e-4ff8-aca4-8c7eb3a573c1 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:33.715797 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8286d79e-a91e-4ff8-aca4-8c7eb3a573c1 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:33.897259 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8286d79e-a91e-4ff8-aca4-8c7eb3a573c1 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e772e66d8c42dfa995bbecb6b9ccf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c177dc51b8e4a969670684997f3cb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:33.907223 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8286d79e-a91e-4ff8-aca4-8c7eb3a573c1 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] 10.222.0.20 "GET /compute/v2.1/servers/a939ed32-d553-4214-9f35-d59e18a5d86b" status: 200 len: 1644 microversion: 2.1 time: 0.208944 Oct 04 19:04:33.917561 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3135/6251] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:33 2022] GET /compute/v2.1/servers/a939ed32-d553-4214-9f35-d59e18a5d86b => generated 1644 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:33.930463 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7f93563a-f6ff-4add-a7ec-73004439671c tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:33.936859 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7f93563a-f6ff-4add-a7ec-73004439671c tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] [instance: a939ed32-d553-4214-9f35-d59e18a5d86b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:33.940219 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7f93563a-f6ff-4add-a7ec-73004439671c tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:33.940839 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7f93563a-f6ff-4add-a7ec-73004439671c tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:33.941296 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7f93563a-f6ff-4add-a7ec-73004439671c tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:33.942191 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7f93563a-f6ff-4add-a7ec-73004439671c tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:33.942666 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7f93563a-f6ff-4add-a7ec-73004439671c tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:33.943098 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7f93563a-f6ff-4add-a7ec-73004439671c tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:34.123843 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7f93563a-f6ff-4add-a7ec-73004439671c tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e772e66d8c42dfa995bbecb6b9ccf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c177dc51b8e4a969670684997f3cb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:34.131721 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7f93563a-f6ff-4add-a7ec-73004439671c tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] 10.222.0.20 "GET /compute/v2.1/servers/a939ed32-d553-4214-9f35-d59e18a5d86b" status: 200 len: 1644 microversion: 2.1 time: 0.205299 Oct 04 19:04:34.132330 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3117/6252] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:33 2022] GET /compute/v2.1/servers/a939ed32-d553-4214-9f35-d59e18a5d86b => generated 1644 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:34.155193 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e5a05ad8-10dd-4b1a-a1db-80af9b1eb326 tempest-TestSecurityGroupsBasicOps-1209095330 tempest-TestSecurityGroupsBasicOps-1209095330-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:34.156112 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e5a05ad8-10dd-4b1a-a1db-80af9b1eb326 tempest-TestSecurityGroupsBasicOps-1209095330 tempest-TestSecurityGroupsBasicOps-1209095330-project-admin] [instance: a939ed32-d553-4214-9f35-d59e18a5d86b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:34.164839 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e5a05ad8-10dd-4b1a-a1db-80af9b1eb326 tempest-TestSecurityGroupsBasicOps-1209095330 tempest-TestSecurityGroupsBasicOps-1209095330-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:34.164839 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e5a05ad8-10dd-4b1a-a1db-80af9b1eb326 tempest-TestSecurityGroupsBasicOps-1209095330 tempest-TestSecurityGroupsBasicOps-1209095330-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:34.164839 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e5a05ad8-10dd-4b1a-a1db-80af9b1eb326 tempest-TestSecurityGroupsBasicOps-1209095330 tempest-TestSecurityGroupsBasicOps-1209095330-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:34.164839 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e5a05ad8-10dd-4b1a-a1db-80af9b1eb326 tempest-TestSecurityGroupsBasicOps-1209095330 tempest-TestSecurityGroupsBasicOps-1209095330-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:34.164839 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e5a05ad8-10dd-4b1a-a1db-80af9b1eb326 tempest-TestSecurityGroupsBasicOps-1209095330 tempest-TestSecurityGroupsBasicOps-1209095330-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:34.165213 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e5a05ad8-10dd-4b1a-a1db-80af9b1eb326 tempest-TestSecurityGroupsBasicOps-1209095330 tempest-TestSecurityGroupsBasicOps-1209095330-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:34.427263 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a8633557-bfdb-41f3-abec-5870136793d1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:34.427905 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a8633557-bfdb-41f3-abec-5870136793d1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 4a92d48e-091e-4ede-a4db-476209e74bf2] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:34.435840 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a8633557-bfdb-41f3-abec-5870136793d1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:34.436329 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a8633557-bfdb-41f3-abec-5870136793d1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:34.436780 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a8633557-bfdb-41f3-abec-5870136793d1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:34.437492 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a8633557-bfdb-41f3-abec-5870136793d1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:34.437955 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a8633557-bfdb-41f3-abec-5870136793d1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:34.438388 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a8633557-bfdb-41f3-abec-5870136793d1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:34.531001 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a8633557-bfdb-41f3-abec-5870136793d1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:34.539942 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a8633557-bfdb-41f3-abec-5870136793d1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/4a92d48e-091e-4ede-a4db-476209e74bf2" status: 200 len: 1168 microversion: 2.1 time: 0.117127 Oct 04 19:04:34.540974 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3118/6253] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:34 2022] GET /compute/v2.1/servers/4a92d48e-091e-4ede-a4db-476209e74bf2 => generated 1168 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:04:34.560085 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e5a05ad8-10dd-4b1a-a1db-80af9b1eb326 tempest-TestSecurityGroupsBasicOps-1209095330 tempest-TestSecurityGroupsBasicOps-1209095330-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/a939ed32-d553-4214-9f35-d59e18a5d86b" status: 200 len: 1797 microversion: 2.1 time: 0.409359 Oct 04 19:04:34.561213 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3136/6254] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:34 2022] GET /compute/v2.1/servers/a939ed32-d553-4214-9f35-d59e18a5d86b => generated 1797 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:35.567165 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-115e5270-8538-4b9f-a4a3-0bae393af6f7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:35.568476 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-115e5270-8538-4b9f-a4a3-0bae393af6f7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 4a92d48e-091e-4ede-a4db-476209e74bf2] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:35.583002 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-115e5270-8538-4b9f-a4a3-0bae393af6f7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:35.587520 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-115e5270-8538-4b9f-a4a3-0bae393af6f7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:35.588155 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-115e5270-8538-4b9f-a4a3-0bae393af6f7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:35.592159 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-115e5270-8538-4b9f-a4a3-0bae393af6f7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:35.592912 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-115e5270-8538-4b9f-a4a3-0bae393af6f7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:35.597853 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-115e5270-8538-4b9f-a4a3-0bae393af6f7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:35.962362 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1eecfec5-6cb0-43bf-b31c-6c5e2d6e84cd tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:35.963664 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1eecfec5-6cb0-43bf-b31c-6c5e2d6e84cd tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 0e957abd-68e7-48c3-af4b-74d570d41c15] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:35.976886 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1eecfec5-6cb0-43bf-b31c-6c5e2d6e84cd tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:35.977779 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-115e5270-8538-4b9f-a4a3-0bae393af6f7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:35.979030 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1eecfec5-6cb0-43bf-b31c-6c5e2d6e84cd tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:35.980488 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1eecfec5-6cb0-43bf-b31c-6c5e2d6e84cd tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:35.982855 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1eecfec5-6cb0-43bf-b31c-6c5e2d6e84cd tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:35.983772 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1eecfec5-6cb0-43bf-b31c-6c5e2d6e84cd tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:35.985814 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1eecfec5-6cb0-43bf-b31c-6c5e2d6e84cd tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:35.989300 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-115e5270-8538-4b9f-a4a3-0bae393af6f7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/4a92d48e-091e-4ede-a4db-476209e74bf2" status: 200 len: 1228 microversion: 2.1 time: 0.426941 Oct 04 19:04:35.989985 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3137/6255] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:35 2022] GET /compute/v2.1/servers/4a92d48e-091e-4ede-a4db-476209e74bf2 => generated 1228 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:36.040620 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1eecfec5-6cb0-43bf-b31c-6c5e2d6e84cd tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15/ips" status: 200 len: 153 microversion: 2.20 time: 0.551986 Oct 04 19:04:36.042038 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3119/6256] 10.222.0.20 () {60 vars in 1289 bytes} [Tue Oct 4 19:04:35 2022] GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15/ips => generated 153 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 19:04:37.026711 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5bccccad-de16-4f01-87a9-f84fbc496387 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:37.027695 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5bccccad-de16-4f01-87a9-f84fbc496387 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 4a92d48e-091e-4ede-a4db-476209e74bf2] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:37.049279 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5bccccad-de16-4f01-87a9-f84fbc496387 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:37.053350 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5bccccad-de16-4f01-87a9-f84fbc496387 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:37.053350 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5bccccad-de16-4f01-87a9-f84fbc496387 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:37.053350 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5bccccad-de16-4f01-87a9-f84fbc496387 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:37.054197 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5bccccad-de16-4f01-87a9-f84fbc496387 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:37.054796 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5bccccad-de16-4f01-87a9-f84fbc496387 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:37.363457 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5bccccad-de16-4f01-87a9-f84fbc496387 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:37.380133 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5bccccad-de16-4f01-87a9-f84fbc496387 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/4a92d48e-091e-4ede-a4db-476209e74bf2" status: 200 len: 1228 microversion: 2.1 time: 0.366428 Oct 04 19:04:37.398493 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3138/6257] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:37 2022] GET /compute/v2.1/servers/4a92d48e-091e-4ede-a4db-476209e74bf2 => generated 1228 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:37.523708 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-5fb75541-cf01-421e-ac8c-e96635b20569 req-6a59ae0c-1c22-412b-88cc-542d7d5f2fa2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a92d48e-091e-4ede-a4db-476209e74bf2", "tag": "34ca71bf-fe42-4928-b71c-84a6708d753a"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:04:37.548492 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-5fb75541-cf01-421e-ac8c-e96635b20569 req-6a59ae0c-1c22-412b-88cc-542d7d5f2fa2 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:37.548990 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-5fb75541-cf01-421e-ac8c-e96635b20569 req-6a59ae0c-1c22-412b-88cc-542d7d5f2fa2 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:37.549426 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-5fb75541-cf01-421e-ac8c-e96635b20569 req-6a59ae0c-1c22-412b-88cc-542d7d5f2fa2 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:37.579332 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-5fb75541-cf01-421e-ac8c-e96635b20569 req-6a59ae0c-1c22-412b-88cc-542d7d5f2fa2 service nova] Creating event network-changed:34ca71bf-fe42-4928-b71c-84a6708d753a for instance 4a92d48e-091e-4ede-a4db-476209e74bf2 on n-h1-850501-14 Oct 04 19:04:37.589730 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-5fb75541-cf01-421e-ac8c-e96635b20569 req-6a59ae0c-1c22-412b-88cc-542d7d5f2fa2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074933 Oct 04 19:04:37.593536 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3120/6258] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:04:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:04:37.761001 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-33f9ac90-24f0-4c20-b5de-9e98e05e5062 req-695e6c74-6627-4b45-9457-871eeb90b7d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a939ed32-d553-4214-9f35-d59e18a5d86b", "tag": "3f36fac6-4f01-474d-8381-b3c1c0311c69"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:04:37.777564 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-33f9ac90-24f0-4c20-b5de-9e98e05e5062 req-695e6c74-6627-4b45-9457-871eeb90b7d4 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:37.778463 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-33f9ac90-24f0-4c20-b5de-9e98e05e5062 req-695e6c74-6627-4b45-9457-871eeb90b7d4 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:37.779166 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-33f9ac90-24f0-4c20-b5de-9e98e05e5062 req-695e6c74-6627-4b45-9457-871eeb90b7d4 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:38.339493 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-33f9ac90-24f0-4c20-b5de-9e98e05e5062 req-695e6c74-6627-4b45-9457-871eeb90b7d4 service nova] Creating event network-changed:3f36fac6-4f01-474d-8381-b3c1c0311c69 for instance a939ed32-d553-4214-9f35-d59e18a5d86b on n-h2-850501-14 Oct 04 19:04:38.347741 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-33f9ac90-24f0-4c20-b5de-9e98e05e5062 req-695e6c74-6627-4b45-9457-871eeb90b7d4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.598818 Oct 04 19:04:38.349010 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3139/6259] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:04:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:04:38.408492 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2ab3ddfc-8b5c-4c8d-b19c-b311dee8adfb tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:38.410057 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2ab3ddfc-8b5c-4c8d-b19c-b311dee8adfb tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 4a92d48e-091e-4ede-a4db-476209e74bf2] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:38.424901 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2ab3ddfc-8b5c-4c8d-b19c-b311dee8adfb tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:38.425738 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2ab3ddfc-8b5c-4c8d-b19c-b311dee8adfb tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:38.430362 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2ab3ddfc-8b5c-4c8d-b19c-b311dee8adfb tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:38.430362 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2ab3ddfc-8b5c-4c8d-b19c-b311dee8adfb tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:38.430362 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2ab3ddfc-8b5c-4c8d-b19c-b311dee8adfb tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:38.432035 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2ab3ddfc-8b5c-4c8d-b19c-b311dee8adfb tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:38.985595 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2ab3ddfc-8b5c-4c8d-b19c-b311dee8adfb tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:39.006758 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2ab3ddfc-8b5c-4c8d-b19c-b311dee8adfb tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/4a92d48e-091e-4ede-a4db-476209e74bf2" status: 200 len: 1228 microversion: 2.1 time: 0.596439 Oct 04 19:04:39.007410 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3121/6260] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:38 2022] GET /compute/v2.1/servers/4a92d48e-091e-4ede-a4db-476209e74bf2 => generated 1228 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:39.571908 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f8e2c612-a206-46cb-99c4-bce65b2b77d4 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:04:39.578743 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f8e2c612-a206-46cb-99c4-bce65b2b77d4 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 0e957abd-68e7-48c3-af4b-74d570d41c15] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:39.589633 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f8e2c612-a206-46cb-99c4-bce65b2b77d4 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:39.590717 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f8e2c612-a206-46cb-99c4-bce65b2b77d4 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:39.591172 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f8e2c612-a206-46cb-99c4-bce65b2b77d4 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:39.592483 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f8e2c612-a206-46cb-99c4-bce65b2b77d4 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:39.592950 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f8e2c612-a206-46cb-99c4-bce65b2b77d4 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:39.601729 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f8e2c612-a206-46cb-99c4-bce65b2b77d4 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:39.638612 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-f8e2c612-a206-46cb-99c4-bce65b2b77d4 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lazy-loading 'flavor' on Instance uuid 0e957abd-68e7-48c3-af4b-74d570d41c15 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:04:40.034538 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c2c89175-ed66-4a60-9e99-0a08dc4129dd tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:40.035081 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c2c89175-ed66-4a60-9e99-0a08dc4129dd tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 4a92d48e-091e-4ede-a4db-476209e74bf2] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:40.048740 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c2c89175-ed66-4a60-9e99-0a08dc4129dd tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:40.049259 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c2c89175-ed66-4a60-9e99-0a08dc4129dd tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:40.049689 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c2c89175-ed66-4a60-9e99-0a08dc4129dd tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:40.050409 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c2c89175-ed66-4a60-9e99-0a08dc4129dd tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:40.050874 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c2c89175-ed66-4a60-9e99-0a08dc4129dd tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:40.051309 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c2c89175-ed66-4a60-9e99-0a08dc4129dd tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:40.233804 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f8e2c612-a206-46cb-99c4-bce65b2b77d4 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "POST /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15/action" status: 202 len: 0 microversion: 2.20 time: 0.673445 Oct 04 19:04:40.241161 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3140/6261] 10.222.0.20 () {62 vars in 1319 bytes} [Tue Oct 4 19:04:39 2022] POST /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15/action => generated 0 bytes in 682 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:04:40.248312 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c2c89175-ed66-4a60-9e99-0a08dc4129dd tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:40.258762 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8c62890a-9ce8-4145-ad08-25a18b9e160c tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:40.268306 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8c62890a-9ce8-4145-ad08-25a18b9e160c tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 0e957abd-68e7-48c3-af4b-74d570d41c15] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:40.268529 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c2c89175-ed66-4a60-9e99-0a08dc4129dd tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/4a92d48e-091e-4ede-a4db-476209e74bf2" status: 200 len: 1228 microversion: 2.1 time: 0.231039 Oct 04 19:04:40.270007 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3122/6262] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:40 2022] GET /compute/v2.1/servers/4a92d48e-091e-4ede-a4db-476209e74bf2 => generated 1228 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:40.275291 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8c62890a-9ce8-4145-ad08-25a18b9e160c tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:40.276080 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8c62890a-9ce8-4145-ad08-25a18b9e160c tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:40.276623 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8c62890a-9ce8-4145-ad08-25a18b9e160c tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:40.277562 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8c62890a-9ce8-4145-ad08-25a18b9e160c tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:40.278217 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8c62890a-9ce8-4145-ad08-25a18b9e160c tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:40.278649 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8c62890a-9ce8-4145-ad08-25a18b9e160c tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:40.442607 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8c62890a-9ce8-4145-ad08-25a18b9e160c tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:40.453852 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8c62890a-9ce8-4145-ad08-25a18b9e160c tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:40.455865 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8c62890a-9ce8-4145-ad08-25a18b9e160c tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:40.457663 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8c62890a-9ce8-4145-ad08-25a18b9e160c tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15" status: 200 len: 1725 microversion: 2.20 time: 0.205258 Oct 04 19:04:40.473859 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3141/6263] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:04:40 2022] GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15 => generated 1725 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:04:41.286341 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3f01a28a-26cf-4f31-828b-916f7b4fa553 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:41.287795 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3f01a28a-26cf-4f31-828b-916f7b4fa553 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 4a92d48e-091e-4ede-a4db-476209e74bf2] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:41.295226 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f01a28a-26cf-4f31-828b-916f7b4fa553 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:41.295933 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f01a28a-26cf-4f31-828b-916f7b4fa553 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:41.296392 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f01a28a-26cf-4f31-828b-916f7b4fa553 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:41.297101 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f01a28a-26cf-4f31-828b-916f7b4fa553 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:41.297678 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f01a28a-26cf-4f31-828b-916f7b4fa553 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:41.298105 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f01a28a-26cf-4f31-828b-916f7b4fa553 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:41.461485 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3f01a28a-26cf-4f31-828b-916f7b4fa553 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:41.469846 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3f01a28a-26cf-4f31-828b-916f7b4fa553 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/4a92d48e-091e-4ede-a4db-476209e74bf2" status: 200 len: 1228 microversion: 2.1 time: 0.187372 Oct 04 19:04:41.470445 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3123/6264] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:41 2022] GET /compute/v2.1/servers/4a92d48e-091e-4ede-a4db-476209e74bf2 => generated 1228 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:41.492672 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-973f8678-e4b6-4f9f-9bf1-39c7463e2f75 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:41.493228 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-973f8678-e4b6-4f9f-9bf1-39c7463e2f75 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 0e957abd-68e7-48c3-af4b-74d570d41c15] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:41.500592 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-973f8678-e4b6-4f9f-9bf1-39c7463e2f75 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:41.501096 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-973f8678-e4b6-4f9f-9bf1-39c7463e2f75 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:41.501577 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-973f8678-e4b6-4f9f-9bf1-39c7463e2f75 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:41.502476 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-973f8678-e4b6-4f9f-9bf1-39c7463e2f75 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:41.502942 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-973f8678-e4b6-4f9f-9bf1-39c7463e2f75 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:41.503365 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-973f8678-e4b6-4f9f-9bf1-39c7463e2f75 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:41.527079 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:04:41.552506 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=6 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:04:41.650517 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-973f8678-e4b6-4f9f-9bf1-39c7463e2f75 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:41.660773 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-973f8678-e4b6-4f9f-9bf1-39c7463e2f75 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:41.662273 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-973f8678-e4b6-4f9f-9bf1-39c7463e2f75 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:41.663576 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-973f8678-e4b6-4f9f-9bf1-39c7463e2f75 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15" status: 200 len: 1725 microversion: 2.20 time: 0.174821 Oct 04 19:04:41.664182 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3142/6265] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:04:41 2022] GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15 => generated 1725 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 19:04:42.496095 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d9ada14f-297b-4055-9595-21b17378276f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:42.496896 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d9ada14f-297b-4055-9595-21b17378276f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 4a92d48e-091e-4ede-a4db-476209e74bf2] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:42.503733 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:04:42.507547 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d9ada14f-297b-4055-9595-21b17378276f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:42.508070 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d9ada14f-297b-4055-9595-21b17378276f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:42.508584 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d9ada14f-297b-4055-9595-21b17378276f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:42.509477 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d9ada14f-297b-4055-9595-21b17378276f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:42.510257 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d9ada14f-297b-4055-9595-21b17378276f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:42.510938 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d9ada14f-297b-4055-9595-21b17378276f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:42.665030 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d9ada14f-297b-4055-9595-21b17378276f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:42.673900 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d9ada14f-297b-4055-9595-21b17378276f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/4a92d48e-091e-4ede-a4db-476209e74bf2" status: 200 len: 1216 microversion: 2.1 time: 0.182399 Oct 04 19:04:42.674490 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3124/6266] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:42 2022] GET /compute/v2.1/servers/4a92d48e-091e-4ede-a4db-476209e74bf2 => generated 1216 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:42.690386 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3696a772-079a-48ba-86e3-41f350ac7496 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:42.691745 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3696a772-079a-48ba-86e3-41f350ac7496 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 0e957abd-68e7-48c3-af4b-74d570d41c15] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:42.699761 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3696a772-079a-48ba-86e3-41f350ac7496 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:42.700879 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3696a772-079a-48ba-86e3-41f350ac7496 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:42.701794 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3696a772-079a-48ba-86e3-41f350ac7496 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:42.702252 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3696a772-079a-48ba-86e3-41f350ac7496 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:42.702924 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3696a772-079a-48ba-86e3-41f350ac7496 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:42.703541 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3696a772-079a-48ba-86e3-41f350ac7496 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:42.907256 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3696a772-079a-48ba-86e3-41f350ac7496 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:42.915694 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3696a772-079a-48ba-86e3-41f350ac7496 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:42.917478 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3696a772-079a-48ba-86e3-41f350ac7496 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:42.918659 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3696a772-079a-48ba-86e3-41f350ac7496 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15" status: 200 len: 1725 microversion: 2.20 time: 0.232320 Oct 04 19:04:42.919246 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3143/6267] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:04:42 2022] GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15 => generated 1725 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:04:43.699169 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-cae7ca38-2052-41c5-84b6-e561ebd6ed64 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:43.699919 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-cae7ca38-2052-41c5-84b6-e561ebd6ed64 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 4a92d48e-091e-4ede-a4db-476209e74bf2] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:43.707957 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cae7ca38-2052-41c5-84b6-e561ebd6ed64 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:43.708476 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cae7ca38-2052-41c5-84b6-e561ebd6ed64 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:43.708915 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cae7ca38-2052-41c5-84b6-e561ebd6ed64 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:43.709614 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cae7ca38-2052-41c5-84b6-e561ebd6ed64 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:43.710233 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cae7ca38-2052-41c5-84b6-e561ebd6ed64 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:43.710662 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cae7ca38-2052-41c5-84b6-e561ebd6ed64 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:43.910924 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-cae7ca38-2052-41c5-84b6-e561ebd6ed64 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:43.922365 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-cae7ca38-2052-41c5-84b6-e561ebd6ed64 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/4a92d48e-091e-4ede-a4db-476209e74bf2" status: 200 len: 1216 microversion: 2.1 time: 0.227066 Oct 04 19:04:43.924744 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3125/6268] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:43 2022] GET /compute/v2.1/servers/4a92d48e-091e-4ede-a4db-476209e74bf2 => generated 1216 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:43.944364 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ed044e4b-499d-4302-ad42-67c786973c17 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:43.945159 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ed044e4b-499d-4302-ad42-67c786973c17 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 0e957abd-68e7-48c3-af4b-74d570d41c15] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:43.954586 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ed044e4b-499d-4302-ad42-67c786973c17 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:43.955163 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ed044e4b-499d-4302-ad42-67c786973c17 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:43.955606 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ed044e4b-499d-4302-ad42-67c786973c17 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:43.956406 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ed044e4b-499d-4302-ad42-67c786973c17 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:43.956861 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ed044e4b-499d-4302-ad42-67c786973c17 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:43.957284 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ed044e4b-499d-4302-ad42-67c786973c17 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:44.140749 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ed044e4b-499d-4302-ad42-67c786973c17 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:44.150184 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ed044e4b-499d-4302-ad42-67c786973c17 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:44.151804 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ed044e4b-499d-4302-ad42-67c786973c17 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:44.153172 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ed044e4b-499d-4302-ad42-67c786973c17 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15" status: 200 len: 1725 microversion: 2.20 time: 0.212985 Oct 04 19:04:44.154565 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3144/6269] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:04:43 2022] GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15 => generated 1725 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:04:44.945524 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c6fc58b1-652e-4fba-943a-e4dc3cb36147 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:44.946165 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c6fc58b1-652e-4fba-943a-e4dc3cb36147 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 4a92d48e-091e-4ede-a4db-476209e74bf2] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:44.954081 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c6fc58b1-652e-4fba-943a-e4dc3cb36147 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:44.954776 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c6fc58b1-652e-4fba-943a-e4dc3cb36147 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:44.955366 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c6fc58b1-652e-4fba-943a-e4dc3cb36147 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:44.956089 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c6fc58b1-652e-4fba-943a-e4dc3cb36147 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:44.956724 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c6fc58b1-652e-4fba-943a-e4dc3cb36147 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:44.957321 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c6fc58b1-652e-4fba-943a-e4dc3cb36147 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:45.099457 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c6fc58b1-652e-4fba-943a-e4dc3cb36147 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:45.108035 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c6fc58b1-652e-4fba-943a-e4dc3cb36147 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/4a92d48e-091e-4ede-a4db-476209e74bf2" status: 200 len: 1216 microversion: 2.1 time: 0.166441 Oct 04 19:04:45.108513 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3126/6270] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:44 2022] GET /compute/v2.1/servers/4a92d48e-091e-4ede-a4db-476209e74bf2 => generated 1216 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:04:45.181145 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7e8f7b90-1054-47db-9bb3-b1048a2bff83 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:45.181699 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7e8f7b90-1054-47db-9bb3-b1048a2bff83 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 0e957abd-68e7-48c3-af4b-74d570d41c15] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:45.190191 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7e8f7b90-1054-47db-9bb3-b1048a2bff83 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:45.190679 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7e8f7b90-1054-47db-9bb3-b1048a2bff83 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:45.191114 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7e8f7b90-1054-47db-9bb3-b1048a2bff83 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:45.191813 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7e8f7b90-1054-47db-9bb3-b1048a2bff83 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:45.192303 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7e8f7b90-1054-47db-9bb3-b1048a2bff83 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:45.192764 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7e8f7b90-1054-47db-9bb3-b1048a2bff83 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:45.332074 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7e8f7b90-1054-47db-9bb3-b1048a2bff83 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:45.348539 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7e8f7b90-1054-47db-9bb3-b1048a2bff83 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:45.350024 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7e8f7b90-1054-47db-9bb3-b1048a2bff83 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:45.351184 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7e8f7b90-1054-47db-9bb3-b1048a2bff83 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15" status: 200 len: 1725 microversion: 2.20 time: 0.174095 Oct 04 19:04:45.351762 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3145/6271] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:04:45 2022] GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15 => generated 1725 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:04:46.131241 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b4ff4b99-1512-4285-81c4-bfec277ece25 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:46.132086 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b4ff4b99-1512-4285-81c4-bfec277ece25 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 4a92d48e-091e-4ede-a4db-476209e74bf2] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:46.139756 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b4ff4b99-1512-4285-81c4-bfec277ece25 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:46.140444 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b4ff4b99-1512-4285-81c4-bfec277ece25 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:46.141122 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b4ff4b99-1512-4285-81c4-bfec277ece25 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:46.141941 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b4ff4b99-1512-4285-81c4-bfec277ece25 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:46.142531 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b4ff4b99-1512-4285-81c4-bfec277ece25 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:46.143242 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b4ff4b99-1512-4285-81c4-bfec277ece25 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:46.285179 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b4ff4b99-1512-4285-81c4-bfec277ece25 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:46.293000 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b4ff4b99-1512-4285-81c4-bfec277ece25 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/4a92d48e-091e-4ede-a4db-476209e74bf2" status: 200 len: 1216 microversion: 2.1 time: 0.166052 Oct 04 19:04:46.293587 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3127/6272] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:46 2022] GET /compute/v2.1/servers/4a92d48e-091e-4ede-a4db-476209e74bf2 => generated 1216 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:46.380083 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1a3e7834-4454-4b64-b209-c2c18a30797c tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:46.380684 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1a3e7834-4454-4b64-b209-c2c18a30797c tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 0e957abd-68e7-48c3-af4b-74d570d41c15] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:46.390332 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1a3e7834-4454-4b64-b209-c2c18a30797c tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:46.390843 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1a3e7834-4454-4b64-b209-c2c18a30797c tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:46.391292 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1a3e7834-4454-4b64-b209-c2c18a30797c tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:46.392024 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1a3e7834-4454-4b64-b209-c2c18a30797c tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:46.392576 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1a3e7834-4454-4b64-b209-c2c18a30797c tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:46.393014 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1a3e7834-4454-4b64-b209-c2c18a30797c tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:46.804240 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1a3e7834-4454-4b64-b209-c2c18a30797c tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:46.814127 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1a3e7834-4454-4b64-b209-c2c18a30797c tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:46.815992 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1a3e7834-4454-4b64-b209-c2c18a30797c tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:46.817284 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1a3e7834-4454-4b64-b209-c2c18a30797c tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15" status: 200 len: 1725 microversion: 2.20 time: 0.442036 Oct 04 19:04:46.818374 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3146/6273] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:04:46 2022] GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15 => generated 1725 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:04:47.317474 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b3d10823-9814-408b-8e62-b5b1b3d7d108 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:47.318124 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b3d10823-9814-408b-8e62-b5b1b3d7d108 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 4a92d48e-091e-4ede-a4db-476209e74bf2] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:47.324864 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b3d10823-9814-408b-8e62-b5b1b3d7d108 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:47.325362 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b3d10823-9814-408b-8e62-b5b1b3d7d108 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:47.326902 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b3d10823-9814-408b-8e62-b5b1b3d7d108 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:47.327794 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b3d10823-9814-408b-8e62-b5b1b3d7d108 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:47.328299 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b3d10823-9814-408b-8e62-b5b1b3d7d108 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:47.328738 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b3d10823-9814-408b-8e62-b5b1b3d7d108 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:47.463991 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b3d10823-9814-408b-8e62-b5b1b3d7d108 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:47.472614 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b3d10823-9814-408b-8e62-b5b1b3d7d108 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/4a92d48e-091e-4ede-a4db-476209e74bf2" status: 200 len: 1216 microversion: 2.1 time: 0.159249 Oct 04 19:04:47.473198 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3128/6274] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:47 2022] GET /compute/v2.1/servers/4a92d48e-091e-4ede-a4db-476209e74bf2 => generated 1216 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:47.849284 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-44fafd64-0d76-48d2-81d4-2664d788fff2 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:47.849942 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-44fafd64-0d76-48d2-81d4-2664d788fff2 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 0e957abd-68e7-48c3-af4b-74d570d41c15] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:47.857808 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-44fafd64-0d76-48d2-81d4-2664d788fff2 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:47.858308 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-44fafd64-0d76-48d2-81d4-2664d788fff2 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:47.858753 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-44fafd64-0d76-48d2-81d4-2664d788fff2 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:47.859489 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-44fafd64-0d76-48d2-81d4-2664d788fff2 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:47.859950 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-44fafd64-0d76-48d2-81d4-2664d788fff2 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:47.860501 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-44fafd64-0d76-48d2-81d4-2664d788fff2 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:47.993992 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-44fafd64-0d76-48d2-81d4-2664d788fff2 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:48.002500 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-44fafd64-0d76-48d2-81d4-2664d788fff2 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:48.003928 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-44fafd64-0d76-48d2-81d4-2664d788fff2 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:48.005249 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-44fafd64-0d76-48d2-81d4-2664d788fff2 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15" status: 200 len: 1725 microversion: 2.20 time: 0.160791 Oct 04 19:04:48.005803 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3147/6275] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:04:47 2022] GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:04:48.495295 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-89130683-5888-46db-9000-f78de343c920 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:48.496707 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-89130683-5888-46db-9000-f78de343c920 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 4a92d48e-091e-4ede-a4db-476209e74bf2] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:48.507645 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-89130683-5888-46db-9000-f78de343c920 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:48.508178 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-89130683-5888-46db-9000-f78de343c920 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:48.508646 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-89130683-5888-46db-9000-f78de343c920 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:48.509360 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-89130683-5888-46db-9000-f78de343c920 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:48.509822 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-89130683-5888-46db-9000-f78de343c920 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:48.510257 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-89130683-5888-46db-9000-f78de343c920 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:48.663627 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-89130683-5888-46db-9000-f78de343c920 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:48.672559 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-89130683-5888-46db-9000-f78de343c920 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/4a92d48e-091e-4ede-a4db-476209e74bf2" status: 200 len: 1216 microversion: 2.1 time: 0.181509 Oct 04 19:04:48.673130 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3129/6276] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:48 2022] GET /compute/v2.1/servers/4a92d48e-091e-4ede-a4db-476209e74bf2 => generated 1216 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:49.031644 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-09dad101-84cc-4245-8d39-eda5f5321789 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:49.032585 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-09dad101-84cc-4245-8d39-eda5f5321789 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 0e957abd-68e7-48c3-af4b-74d570d41c15] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:49.042085 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-09dad101-84cc-4245-8d39-eda5f5321789 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:49.042514 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-09dad101-84cc-4245-8d39-eda5f5321789 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:49.042959 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-09dad101-84cc-4245-8d39-eda5f5321789 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:49.043700 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-09dad101-84cc-4245-8d39-eda5f5321789 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:49.044209 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-09dad101-84cc-4245-8d39-eda5f5321789 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:49.044678 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-09dad101-84cc-4245-8d39-eda5f5321789 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:49.191183 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-09dad101-84cc-4245-8d39-eda5f5321789 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:49.199493 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-09dad101-84cc-4245-8d39-eda5f5321789 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:49.201685 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-09dad101-84cc-4245-8d39-eda5f5321789 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:49.203023 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-09dad101-84cc-4245-8d39-eda5f5321789 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15" status: 200 len: 1725 microversion: 2.20 time: 0.176102 Oct 04 19:04:49.203587 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3148/6277] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:04:49 2022] GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15 => generated 1725 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:04:49.702167 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-feda3dbb-4819-4858-93ba-9dc6815d8d72 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:49.702167 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-feda3dbb-4819-4858-93ba-9dc6815d8d72 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 4a92d48e-091e-4ede-a4db-476209e74bf2] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:49.703999 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-feda3dbb-4819-4858-93ba-9dc6815d8d72 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:49.704685 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-feda3dbb-4819-4858-93ba-9dc6815d8d72 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:49.705132 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-feda3dbb-4819-4858-93ba-9dc6815d8d72 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:49.705844 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-feda3dbb-4819-4858-93ba-9dc6815d8d72 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:49.706303 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-feda3dbb-4819-4858-93ba-9dc6815d8d72 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:49.706733 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-feda3dbb-4819-4858-93ba-9dc6815d8d72 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:49.723851 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=100 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:04:49.856047 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-feda3dbb-4819-4858-93ba-9dc6815d8d72 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:49.866474 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-feda3dbb-4819-4858-93ba-9dc6815d8d72 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/4a92d48e-091e-4ede-a4db-476209e74bf2" status: 200 len: 1216 microversion: 2.1 time: 0.172954 Oct 04 19:04:49.866474 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3130/6278] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:49 2022] GET /compute/v2.1/servers/4a92d48e-091e-4ede-a4db-476209e74bf2 => generated 1216 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:50.245047 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-264c9b21-6394-4c44-acb2-f358c5549514 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:50.245722 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-264c9b21-6394-4c44-acb2-f358c5549514 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 0e957abd-68e7-48c3-af4b-74d570d41c15] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:50.253134 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-264c9b21-6394-4c44-acb2-f358c5549514 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:50.254043 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-264c9b21-6394-4c44-acb2-f358c5549514 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:50.254889 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-264c9b21-6394-4c44-acb2-f358c5549514 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:50.255715 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-264c9b21-6394-4c44-acb2-f358c5549514 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:50.256337 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-264c9b21-6394-4c44-acb2-f358c5549514 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:50.257007 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-264c9b21-6394-4c44-acb2-f358c5549514 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:50.274628 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:04:50.418368 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-264c9b21-6394-4c44-acb2-f358c5549514 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:50.427283 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-264c9b21-6394-4c44-acb2-f358c5549514 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:50.435589 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-264c9b21-6394-4c44-acb2-f358c5549514 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:50.435589 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-264c9b21-6394-4c44-acb2-f358c5549514 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15" status: 200 len: 1725 microversion: 2.20 time: 0.195221 Oct 04 19:04:50.435589 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3149/6279] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:04:50 2022] GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15 => generated 1725 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:04:50.887758 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-44c414e6-cab9-429c-9ec1-f40bdbfa8fb7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:50.889056 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-44c414e6-cab9-429c-9ec1-f40bdbfa8fb7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 4a92d48e-091e-4ede-a4db-476209e74bf2] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:50.895758 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=52 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:04:50.897506 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-44c414e6-cab9-429c-9ec1-f40bdbfa8fb7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:50.898197 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-44c414e6-cab9-429c-9ec1-f40bdbfa8fb7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:50.898803 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-44c414e6-cab9-429c-9ec1-f40bdbfa8fb7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:50.903240 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-44c414e6-cab9-429c-9ec1-f40bdbfa8fb7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:50.903240 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-44c414e6-cab9-429c-9ec1-f40bdbfa8fb7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:50.903240 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-44c414e6-cab9-429c-9ec1-f40bdbfa8fb7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:51.098691 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-44c414e6-cab9-429c-9ec1-f40bdbfa8fb7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:51.107565 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-44c414e6-cab9-429c-9ec1-f40bdbfa8fb7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/4a92d48e-091e-4ede-a4db-476209e74bf2" status: 200 len: 1216 microversion: 2.1 time: 0.223133 Oct 04 19:04:51.108351 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3131/6280] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:50 2022] GET /compute/v2.1/servers/4a92d48e-091e-4ede-a4db-476209e74bf2 => generated 1216 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:51.457708 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f4ee259d-a4fb-4b3d-b3c9-e00eb280112c tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:51.458408 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f4ee259d-a4fb-4b3d-b3c9-e00eb280112c tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 0e957abd-68e7-48c3-af4b-74d570d41c15] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:51.465625 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f4ee259d-a4fb-4b3d-b3c9-e00eb280112c tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:51.466045 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f4ee259d-a4fb-4b3d-b3c9-e00eb280112c tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:51.467730 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f4ee259d-a4fb-4b3d-b3c9-e00eb280112c tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:51.468480 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f4ee259d-a4fb-4b3d-b3c9-e00eb280112c tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:51.468946 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f4ee259d-a4fb-4b3d-b3c9-e00eb280112c tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:51.469381 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f4ee259d-a4fb-4b3d-b3c9-e00eb280112c tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:51.638427 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f4ee259d-a4fb-4b3d-b3c9-e00eb280112c tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:51.649629 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f4ee259d-a4fb-4b3d-b3c9-e00eb280112c tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:51.651498 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f4ee259d-a4fb-4b3d-b3c9-e00eb280112c tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:51.653540 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f4ee259d-a4fb-4b3d-b3c9-e00eb280112c tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15" status: 200 len: 1725 microversion: 2.20 time: 0.199571 Oct 04 19:04:51.654580 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3150/6281] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:04:51 2022] GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15 => generated 1725 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:04:52.136199 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-24eadabe-1a61-4974-af3d-5d09e050f7da tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:52.137491 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-24eadabe-1a61-4974-af3d-5d09e050f7da tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 4a92d48e-091e-4ede-a4db-476209e74bf2] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:52.155478 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-24eadabe-1a61-4974-af3d-5d09e050f7da tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:52.156620 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-24eadabe-1a61-4974-af3d-5d09e050f7da tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:52.156620 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-24eadabe-1a61-4974-af3d-5d09e050f7da tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:52.157378 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-24eadabe-1a61-4974-af3d-5d09e050f7da tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:52.157708 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-24eadabe-1a61-4974-af3d-5d09e050f7da tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:52.158141 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-24eadabe-1a61-4974-af3d-5d09e050f7da tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:52.323769 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-24eadabe-1a61-4974-af3d-5d09e050f7da tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:52.345125 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-24eadabe-1a61-4974-af3d-5d09e050f7da tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/4a92d48e-091e-4ede-a4db-476209e74bf2" status: 200 len: 1216 microversion: 2.1 time: 0.217312 Oct 04 19:04:52.346371 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3132/6282] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:52 2022] GET /compute/v2.1/servers/4a92d48e-091e-4ede-a4db-476209e74bf2 => generated 1216 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:52.378148 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-4ab697bf-fad7-41a3-8245-832d1c829321 req-f1b18e18-3e69-4abe-a01f-81bcac1010ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a92d48e-091e-4ede-a4db-476209e74bf2", "name": "network-vif-plugged", "status": "completed", "tag": "34ca71bf-fe42-4928-b71c-84a6708d753a"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:04:52.404467 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-4ab697bf-fad7-41a3-8245-832d1c829321 req-f1b18e18-3e69-4abe-a01f-81bcac1010ef service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:52.404467 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-4ab697bf-fad7-41a3-8245-832d1c829321 req-f1b18e18-3e69-4abe-a01f-81bcac1010ef service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:52.404467 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-4ab697bf-fad7-41a3-8245-832d1c829321 req-f1b18e18-3e69-4abe-a01f-81bcac1010ef service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:52.422377 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-4ab697bf-fad7-41a3-8245-832d1c829321 req-f1b18e18-3e69-4abe-a01f-81bcac1010ef service nova] Creating event network-vif-plugged:34ca71bf-fe42-4928-b71c-84a6708d753a for instance 4a92d48e-091e-4ede-a4db-476209e74bf2 on n-h1-850501-14 Oct 04 19:04:52.427614 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-4ab697bf-fad7-41a3-8245-832d1c829321 req-f1b18e18-3e69-4abe-a01f-81bcac1010ef service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053709 Oct 04 19:04:52.428255 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3151/6283] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:04:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:04:52.680548 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-fa799871-6c74-4ed8-bdbf-7a087d9983c7 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:52.681291 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-fa799871-6c74-4ed8-bdbf-7a087d9983c7 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 0e957abd-68e7-48c3-af4b-74d570d41c15] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:52.688102 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fa799871-6c74-4ed8-bdbf-7a087d9983c7 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:52.688602 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fa799871-6c74-4ed8-bdbf-7a087d9983c7 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:52.689058 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fa799871-6c74-4ed8-bdbf-7a087d9983c7 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:52.691687 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fa799871-6c74-4ed8-bdbf-7a087d9983c7 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:52.692206 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fa799871-6c74-4ed8-bdbf-7a087d9983c7 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:52.692653 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fa799871-6c74-4ed8-bdbf-7a087d9983c7 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:52.893147 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-fa799871-6c74-4ed8-bdbf-7a087d9983c7 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:52.906330 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-fa799871-6c74-4ed8-bdbf-7a087d9983c7 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:52.908072 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-fa799871-6c74-4ed8-bdbf-7a087d9983c7 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:52.909305 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-fa799871-6c74-4ed8-bdbf-7a087d9983c7 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15" status: 200 len: 1746 microversion: 2.20 time: 0.232857 Oct 04 19:04:52.909879 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3133/6284] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:04:52 2022] GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15 => generated 1746 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:04:53.010727 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ae6cd827-0e13-49b0-aac9-4b6e58b251a2 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:53.011956 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ae6cd827-0e13-49b0-aac9-4b6e58b251a2 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: f8f9ee3a-1a3d-43b9-bdf1-8725457b6611] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:53.018785 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ae6cd827-0e13-49b0-aac9-4b6e58b251a2 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:53.019353 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ae6cd827-0e13-49b0-aac9-4b6e58b251a2 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:53.020027 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ae6cd827-0e13-49b0-aac9-4b6e58b251a2 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:53.021042 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ae6cd827-0e13-49b0-aac9-4b6e58b251a2 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:53.021552 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ae6cd827-0e13-49b0-aac9-4b6e58b251a2 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:53.022173 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ae6cd827-0e13-49b0-aac9-4b6e58b251a2 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:53.048379 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ae6cd827-0e13-49b0-aac9-4b6e58b251a2 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/f8f9ee3a-1a3d-43b9-bdf1-8725457b6611/ips" status: 200 len: 150 microversion: 2.1 time: 0.042999 Oct 04 19:04:53.049683 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3152/6285] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Oct 4 19:04:53 2022] GET /compute/v2.1/servers/f8f9ee3a-1a3d-43b9-bdf1-8725457b6611/ips => generated 150 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:04:53.371435 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-02996664-7140-449a-8dd3-f679559f2c3e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:53.372227 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-02996664-7140-449a-8dd3-f679559f2c3e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 4a92d48e-091e-4ede-a4db-476209e74bf2] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:53.380498 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-02996664-7140-449a-8dd3-f679559f2c3e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:53.380991 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-02996664-7140-449a-8dd3-f679559f2c3e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:53.389912 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-02996664-7140-449a-8dd3-f679559f2c3e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:53.389912 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-02996664-7140-449a-8dd3-f679559f2c3e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:53.389912 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-02996664-7140-449a-8dd3-f679559f2c3e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:53.389912 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-02996664-7140-449a-8dd3-f679559f2c3e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:53.544203 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-02996664-7140-449a-8dd3-f679559f2c3e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:53.555114 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-02996664-7140-449a-8dd3-f679559f2c3e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/4a92d48e-091e-4ede-a4db-476209e74bf2" status: 200 len: 1216 microversion: 2.1 time: 0.188023 Oct 04 19:04:53.557027 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3134/6286] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:53 2022] GET /compute/v2.1/servers/4a92d48e-091e-4ede-a4db-476209e74bf2 => generated 1216 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:53.935885 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e9b2d275-dc75-4fa0-b3cd-9e08fe64ac40 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:53.936618 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e9b2d275-dc75-4fa0-b3cd-9e08fe64ac40 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 0e957abd-68e7-48c3-af4b-74d570d41c15] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:53.943338 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e9b2d275-dc75-4fa0-b3cd-9e08fe64ac40 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:53.943891 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e9b2d275-dc75-4fa0-b3cd-9e08fe64ac40 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:53.944388 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e9b2d275-dc75-4fa0-b3cd-9e08fe64ac40 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:53.945234 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e9b2d275-dc75-4fa0-b3cd-9e08fe64ac40 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:53.946786 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e9b2d275-dc75-4fa0-b3cd-9e08fe64ac40 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:53.947238 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e9b2d275-dc75-4fa0-b3cd-9e08fe64ac40 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:54.106956 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e9b2d275-dc75-4fa0-b3cd-9e08fe64ac40 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:54.120990 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e9b2d275-dc75-4fa0-b3cd-9e08fe64ac40 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:54.122435 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e9b2d275-dc75-4fa0-b3cd-9e08fe64ac40 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:54.123700 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e9b2d275-dc75-4fa0-b3cd-9e08fe64ac40 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15" status: 200 len: 1746 microversion: 2.20 time: 0.191789 Oct 04 19:04:54.125339 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3153/6287] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:04:53 2022] GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15 => generated 1746 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:04:54.583298 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-fea2c091-bb7b-49a7-985d-7dc7d289e7c9 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:54.583968 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-fea2c091-bb7b-49a7-985d-7dc7d289e7c9 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 4a92d48e-091e-4ede-a4db-476209e74bf2] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:54.592235 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fea2c091-bb7b-49a7-985d-7dc7d289e7c9 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:54.593584 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fea2c091-bb7b-49a7-985d-7dc7d289e7c9 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:54.594036 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fea2c091-bb7b-49a7-985d-7dc7d289e7c9 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:54.594865 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fea2c091-bb7b-49a7-985d-7dc7d289e7c9 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:54.595469 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fea2c091-bb7b-49a7-985d-7dc7d289e7c9 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:54.595906 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fea2c091-bb7b-49a7-985d-7dc7d289e7c9 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:54.746588 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-fea2c091-bb7b-49a7-985d-7dc7d289e7c9 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:54.756479 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-fea2c091-bb7b-49a7-985d-7dc7d289e7c9 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/4a92d48e-091e-4ede-a4db-476209e74bf2" status: 200 len: 1403 microversion: 2.1 time: 0.180284 Oct 04 19:04:54.757061 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3135/6288] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:54 2022] GET /compute/v2.1/servers/4a92d48e-091e-4ede-a4db-476209e74bf2 => generated 1403 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:54.779544 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ef5d79b4-422b-4e8f-b11e-003a246a6c0a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:54.780254 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ef5d79b4-422b-4e8f-b11e-003a246a6c0a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 4a92d48e-091e-4ede-a4db-476209e74bf2] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:54.786595 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ef5d79b4-422b-4e8f-b11e-003a246a6c0a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:54.787099 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ef5d79b4-422b-4e8f-b11e-003a246a6c0a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:54.787820 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ef5d79b4-422b-4e8f-b11e-003a246a6c0a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:54.788634 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ef5d79b4-422b-4e8f-b11e-003a246a6c0a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:54.789313 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ef5d79b4-422b-4e8f-b11e-003a246a6c0a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:54.789760 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ef5d79b4-422b-4e8f-b11e-003a246a6c0a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:55.033249 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ef5d79b4-422b-4e8f-b11e-003a246a6c0a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:55.042785 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ef5d79b4-422b-4e8f-b11e-003a246a6c0a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/4a92d48e-091e-4ede-a4db-476209e74bf2" status: 200 len: 1403 microversion: 2.1 time: 0.266990 Oct 04 19:04:55.046086 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3154/6289] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:54 2022] GET /compute/v2.1/servers/4a92d48e-091e-4ede-a4db-476209e74bf2 => generated 1403 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:55.069161 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9581f44f-77fd-45d1-aa8e-0da3178a83cf tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-124235698"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:04:55.072393 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9581f44f-77fd-45d1-aa8e-0da3178a83cf tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 4a92d48e-091e-4ede-a4db-476209e74bf2] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:55.081455 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9581f44f-77fd-45d1-aa8e-0da3178a83cf tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:55.082486 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9581f44f-77fd-45d1-aa8e-0da3178a83cf tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:55.083818 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9581f44f-77fd-45d1-aa8e-0da3178a83cf tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:55.084372 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9581f44f-77fd-45d1-aa8e-0da3178a83cf tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:55.084971 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9581f44f-77fd-45d1-aa8e-0da3178a83cf tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:55.085481 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9581f44f-77fd-45d1-aa8e-0da3178a83cf tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:55.150225 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-da3b0ba6-4e2f-44dd-8bcc-ad07dc4ba641 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:55.150888 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-da3b0ba6-4e2f-44dd-8bcc-ad07dc4ba641 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 0e957abd-68e7-48c3-af4b-74d570d41c15] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:55.161890 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-da3b0ba6-4e2f-44dd-8bcc-ad07dc4ba641 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:55.162400 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-da3b0ba6-4e2f-44dd-8bcc-ad07dc4ba641 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:55.162952 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-da3b0ba6-4e2f-44dd-8bcc-ad07dc4ba641 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:55.164491 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-da3b0ba6-4e2f-44dd-8bcc-ad07dc4ba641 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:55.165369 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-da3b0ba6-4e2f-44dd-8bcc-ad07dc4ba641 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:55.166009 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-da3b0ba6-4e2f-44dd-8bcc-ad07dc4ba641 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:55.242701 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.compute.api [None req-9581f44f-77fd-45d1-aa8e-0da3178a83cf tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 4a92d48e-091e-4ede-a4db-476209e74bf2] Attempting to quiesce instance before volume snapshot. Oct 04 19:04:55.289137 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.compute.api [None req-9581f44f-77fd-45d1-aa8e-0da3178a83cf tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 4a92d48e-091e-4ede-a4db-476209e74bf2] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Oct 04 19:04:55.404505 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-da3b0ba6-4e2f-44dd-8bcc-ad07dc4ba641 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:55.414939 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-da3b0ba6-4e2f-44dd-8bcc-ad07dc4ba641 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:55.416764 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-da3b0ba6-4e2f-44dd-8bcc-ad07dc4ba641 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:55.418175 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-da3b0ba6-4e2f-44dd-8bcc-ad07dc4ba641 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15" status: 200 len: 1746 microversion: 2.20 time: 0.272254 Oct 04 19:04:55.419129 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3155/6290] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:04:55 2022] GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15 => generated 1746 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 19:04:55.424021 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-12849702-41e5-410f-ae39-36456d9c61f3 req-bdb096e0-468d-4b33-a544-0afb0a8eaf1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e957abd-68e7-48c3-af4b-74d570d41c15", "name": "network-vif-plugged", "status": "completed", "tag": "a324d908-a426-4333-ae46-4fc6e0230e67"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:04:55.433525 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-12849702-41e5-410f-ae39-36456d9c61f3 req-bdb096e0-468d-4b33-a544-0afb0a8eaf1e service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:55.434256 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-12849702-41e5-410f-ae39-36456d9c61f3 req-bdb096e0-468d-4b33-a544-0afb0a8eaf1e service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:55.437504 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-12849702-41e5-410f-ae39-36456d9c61f3 req-bdb096e0-468d-4b33-a544-0afb0a8eaf1e service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:55.448405 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-12849702-41e5-410f-ae39-36456d9c61f3 req-bdb096e0-468d-4b33-a544-0afb0a8eaf1e service nova] Creating event network-vif-plugged:a324d908-a426-4333-ae46-4fc6e0230e67 for instance 0e957abd-68e7-48c3-af4b-74d570d41c15 on n-h2-850501-14 Oct 04 19:04:55.454713 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-12849702-41e5-410f-ae39-36456d9c61f3 req-bdb096e0-468d-4b33-a544-0afb0a8eaf1e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034006 Oct 04 19:04:55.455322 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3156/6291] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:04:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:04:55.535827 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9581f44f-77fd-45d1-aa8e-0da3178a83cf tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 4a92d48e-091e-4ede-a4db-476209e74bf2] Creating snapshot from volume 8e42da7f-4be1-4434-82db-3887d3b51f81. {{(pid=123002) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Oct 04 19:04:55.969415 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-cd24d944-fe94-4077-88d6-c84a275740e8 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "014b5cb6-7bd5-4322-8ccb-a711c870aeb5"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:04:55.972242 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-cd24d944-fe94-4077-88d6-c84a275740e8 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: f8f9ee3a-1a3d-43b9-bdf1-8725457b6611] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:55.984976 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cd24d944-fe94-4077-88d6-c84a275740e8 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:55.985902 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cd24d944-fe94-4077-88d6-c84a275740e8 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:55.986554 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cd24d944-fe94-4077-88d6-c84a275740e8 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:55.987507 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cd24d944-fe94-4077-88d6-c84a275740e8 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:55.987977 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cd24d944-fe94-4077-88d6-c84a275740e8 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:55.988646 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cd24d944-fe94-4077-88d6-c84a275740e8 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:56.995880 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-cd24d944-fe94-4077-88d6-c84a275740e8 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "POST /compute/v2.1/servers/f8f9ee3a-1a3d-43b9-bdf1-8725457b6611/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.035719 Oct 04 19:04:56.998191 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3157/6292] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Oct 4 19:04:55 2022] POST /compute/v2.1/servers/f8f9ee3a-1a3d-43b9-bdf1-8725457b6611/os-volume_attachments => generated 194 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:04:57.034959 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e5c416f5-4ccb-4a43-9786-d09862981f0d tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:57.035695 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e5c416f5-4ccb-4a43-9786-d09862981f0d tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 0e957abd-68e7-48c3-af4b-74d570d41c15] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:57.060511 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e5c416f5-4ccb-4a43-9786-d09862981f0d tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:57.065953 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e5c416f5-4ccb-4a43-9786-d09862981f0d tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:57.066508 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e5c416f5-4ccb-4a43-9786-d09862981f0d tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:57.067266 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e5c416f5-4ccb-4a43-9786-d09862981f0d tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:57.067747 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e5c416f5-4ccb-4a43-9786-d09862981f0d tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:57.068218 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e5c416f5-4ccb-4a43-9786-d09862981f0d tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:57.358273 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e5c416f5-4ccb-4a43-9786-d09862981f0d tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:57.374899 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e5c416f5-4ccb-4a43-9786-d09862981f0d tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:57.377534 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e5c416f5-4ccb-4a43-9786-d09862981f0d tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:57.379466 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e5c416f5-4ccb-4a43-9786-d09862981f0d tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15" status: 200 len: 1746 microversion: 2.20 time: 0.378479 Oct 04 19:04:57.382386 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3158/6293] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:04:56 2022] GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15 => generated 1746 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:04:57.863736 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9581f44f-77fd-45d1-aa8e-0da3178a83cf tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "POST /compute/v2.1/servers/4a92d48e-091e-4ede-a4db-476209e74bf2/action" status: 202 len: 0 microversion: 2.1 time: 2.798685 Oct 04 19:04:57.865161 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3136/6294] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 19:04:55 2022] POST /compute/v2.1/servers/4a92d48e-091e-4ede-a4db-476209e74bf2/action => generated 0 bytes in 2801 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 19:04:58.410616 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6f9a707e-424e-4287-8307-9a13e856b09a tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:58.411332 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6f9a707e-424e-4287-8307-9a13e856b09a tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 0e957abd-68e7-48c3-af4b-74d570d41c15] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:58.443036 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6f9a707e-424e-4287-8307-9a13e856b09a tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:58.443552 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6f9a707e-424e-4287-8307-9a13e856b09a tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:58.451617 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6f9a707e-424e-4287-8307-9a13e856b09a tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:58.456800 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6f9a707e-424e-4287-8307-9a13e856b09a tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:58.457492 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6f9a707e-424e-4287-8307-9a13e856b09a tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:58.457945 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6f9a707e-424e-4287-8307-9a13e856b09a tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:58.659851 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6f9a707e-424e-4287-8307-9a13e856b09a tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:58.675094 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6f9a707e-424e-4287-8307-9a13e856b09a tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:58.677131 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6f9a707e-424e-4287-8307-9a13e856b09a tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:58.680367 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6f9a707e-424e-4287-8307-9a13e856b09a tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15" status: 200 len: 1741 microversion: 2.20 time: 0.272167 Oct 04 19:04:58.680367 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3159/6295] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:04:58 2022] GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15 => generated 1741 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:04:59.259897 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7f37c29c-2cf6-4182-a3b1-7278c4434f14 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1914880162", "imageRef": "619b06a1-bd39-4588-81c7-65219bb99158", "flavorRef": "452", "networks": [{"uuid": "dbc89e1f-759d-4fcb-8e1c-542119e29e34"}]}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:04:59.380478 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-7f37c29c-2cf6-4182-a3b1-7278c4434f14 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] validate_networks() for [('dbc89e1f-759d-4fcb-8e1c-542119e29e34', None, None, None, None, None)] {{(pid=123002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:04:59.723377 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d8450708-9968-4eaf-b334-7674eb38da1a tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:59.724646 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d8450708-9968-4eaf-b334-7674eb38da1a tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 0e957abd-68e7-48c3-af4b-74d570d41c15] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:59.738824 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d8450708-9968-4eaf-b334-7674eb38da1a tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:59.739510 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d8450708-9968-4eaf-b334-7674eb38da1a tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:59.740140 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d8450708-9968-4eaf-b334-7674eb38da1a tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:59.741350 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d8450708-9968-4eaf-b334-7674eb38da1a tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:59.741981 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d8450708-9968-4eaf-b334-7674eb38da1a tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:59.742579 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d8450708-9968-4eaf-b334-7674eb38da1a tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:00.072997 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d8450708-9968-4eaf-b334-7674eb38da1a tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:00.088511 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d8450708-9968-4eaf-b334-7674eb38da1a tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:00.090297 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d8450708-9968-4eaf-b334-7674eb38da1a tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:00.091521 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d8450708-9968-4eaf-b334-7674eb38da1a tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15" status: 200 len: 1741 microversion: 2.20 time: 0.379649 Oct 04 19:05:00.092096 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3160/6296] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:04:59 2022] GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15 => generated 1741 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 19:05:00.206857 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-7f37c29c-2cf6-4182-a3b1-7278c4434f14 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:05:00.207912 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-7f37c29c-2cf6-4182-a3b1-7278c4434f14 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:05:00.209700 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-7f37c29c-2cf6-4182-a3b1-7278c4434f14 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:05:00.210314 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-7f37c29c-2cf6-4182-a3b1-7278c4434f14 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:05:00.211789 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-7f37c29c-2cf6-4182-a3b1-7278c4434f14 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:05:00.250800 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7f37c29c-2cf6-4182-a3b1-7278c4434f14 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:00.251309 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7f37c29c-2cf6-4182-a3b1-7278c4434f14 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:00.251765 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7f37c29c-2cf6-4182-a3b1-7278c4434f14 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:00.252565 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7f37c29c-2cf6-4182-a3b1-7278c4434f14 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:00.253044 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7f37c29c-2cf6-4182-a3b1-7278c4434f14 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:00.253492 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7f37c29c-2cf6-4182-a3b1-7278c4434f14 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:00.401514 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-7f37c29c-2cf6-4182-a3b1-7278c4434f14 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Getting quotas for project 82d0cd3db371459db429cb770abde738. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:05:00.412561 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-7f37c29c-2cf6-4182-a3b1-7278c4434f14 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Getting quotas for user a65ae9c3fb3c46a2a393fe21ce21b9d4 and project 82d0cd3db371459db429cb770abde738. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:05:00.444812 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7f37c29c-2cf6-4182-a3b1-7278c4434f14 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Going to run 1 instances... {{(pid=123002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:05:00.452435 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7f37c29c-2cf6-4182-a3b1-7278c4434f14 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='04758be2-3678-42fd-8a86-ecfa0cada294',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=123002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:05:00.735140 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7f37c29c-2cf6-4182-a3b1-7278c4434f14 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.480327 Oct 04 19:05:00.735738 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3137/6297] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 19:04:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1482 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:05:00.747568 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f11f6d8b-9fc0-4b26-9968-4e20d037375a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:00.748223 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f11f6d8b-9fc0-4b26-9968-4e20d037375a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:00.752018 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:05:00.856381 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f11f6d8b-9fc0-4b26-9968-4e20d037375a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:00.866370 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f11f6d8b-9fc0-4b26-9968-4e20d037375a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed" status: 200 len: 1230 microversion: 2.1 time: 0.122992 Oct 04 19:05:00.881289 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3161/6298] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:00 2022] GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed => generated 1230 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:01.121509 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-cbd43f05-e176-46a9-a658-fa6479ac823c tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:01.122226 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-cbd43f05-e176-46a9-a658-fa6479ac823c tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 0e957abd-68e7-48c3-af4b-74d570d41c15] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:01.135803 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cbd43f05-e176-46a9-a658-fa6479ac823c tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:01.144822 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cbd43f05-e176-46a9-a658-fa6479ac823c tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:01.145756 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cbd43f05-e176-46a9-a658-fa6479ac823c tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:01.147504 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cbd43f05-e176-46a9-a658-fa6479ac823c tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:01.148194 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cbd43f05-e176-46a9-a658-fa6479ac823c tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:01.151116 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cbd43f05-e176-46a9-a658-fa6479ac823c tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:01.452332 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-cbd43f05-e176-46a9-a658-fa6479ac823c tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:01.464674 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-cbd43f05-e176-46a9-a658-fa6479ac823c tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:01.466499 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-cbd43f05-e176-46a9-a658-fa6479ac823c tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:01.477060 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-cbd43f05-e176-46a9-a658-fa6479ac823c tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15" status: 200 len: 1741 microversion: 2.20 time: 0.357350 Oct 04 19:05:01.477060 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3138/6299] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:05:01 2022] GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15 => generated 1741 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:05:01.895968 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-aedadb60-a461-42e9-9f1d-87cc0a8d76ba tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:01.897197 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-aedadb60-a461-42e9-9f1d-87cc0a8d76ba tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:01.992954 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-aedadb60-a461-42e9-9f1d-87cc0a8d76ba tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:02.010667 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-aedadb60-a461-42e9-9f1d-87cc0a8d76ba tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed" status: 200 len: 1230 microversion: 2.1 time: 0.118772 Oct 04 19:05:02.014739 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3162/6300] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:01 2022] GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed => generated 1230 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:02.511189 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d1bc878b-8333-49c1-89a2-954b8bc09b72 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:02.511907 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d1bc878b-8333-49c1-89a2-954b8bc09b72 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 0e957abd-68e7-48c3-af4b-74d570d41c15] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:02.521588 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d1bc878b-8333-49c1-89a2-954b8bc09b72 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:02.522250 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d1bc878b-8333-49c1-89a2-954b8bc09b72 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:02.522959 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d1bc878b-8333-49c1-89a2-954b8bc09b72 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:02.523926 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d1bc878b-8333-49c1-89a2-954b8bc09b72 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:02.524632 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d1bc878b-8333-49c1-89a2-954b8bc09b72 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:02.525284 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d1bc878b-8333-49c1-89a2-954b8bc09b72 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:02.845258 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d1bc878b-8333-49c1-89a2-954b8bc09b72 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:02.868988 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d1bc878b-8333-49c1-89a2-954b8bc09b72 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:02.871647 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d1bc878b-8333-49c1-89a2-954b8bc09b72 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:02.882492 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d1bc878b-8333-49c1-89a2-954b8bc09b72 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15" status: 200 len: 1741 microversion: 2.20 time: 0.378553 Oct 04 19:05:02.883340 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3139/6301] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:05:02 2022] GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15 => generated 1741 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:05:03.043856 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b8e01700-fce5-43be-bf2d-4055a3166c7e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:03.045191 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b8e01700-fce5-43be-bf2d-4055a3166c7e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:03.063978 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b8e01700-fce5-43be-bf2d-4055a3166c7e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:03.064833 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b8e01700-fce5-43be-bf2d-4055a3166c7e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:03.065638 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b8e01700-fce5-43be-bf2d-4055a3166c7e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:03.066881 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b8e01700-fce5-43be-bf2d-4055a3166c7e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:03.067559 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b8e01700-fce5-43be-bf2d-4055a3166c7e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:03.068180 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b8e01700-fce5-43be-bf2d-4055a3166c7e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:03.230090 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b8e01700-fce5-43be-bf2d-4055a3166c7e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:03.246503 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b8e01700-fce5-43be-bf2d-4055a3166c7e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed" status: 200 len: 1282 microversion: 2.1 time: 0.207812 Oct 04 19:05:03.250352 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3163/6302] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:03 2022] GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed => generated 1282 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:03.919346 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-86881ec2-445a-4777-9b5e-a5a5b1d76caf tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:03.921320 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-86881ec2-445a-4777-9b5e-a5a5b1d76caf tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 0e957abd-68e7-48c3-af4b-74d570d41c15] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:03.932127 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-86881ec2-445a-4777-9b5e-a5a5b1d76caf tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:03.932647 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-86881ec2-445a-4777-9b5e-a5a5b1d76caf tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:03.933106 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-86881ec2-445a-4777-9b5e-a5a5b1d76caf tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:03.938879 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-86881ec2-445a-4777-9b5e-a5a5b1d76caf tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:03.939539 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-86881ec2-445a-4777-9b5e-a5a5b1d76caf tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:03.940008 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-86881ec2-445a-4777-9b5e-a5a5b1d76caf tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:04.279335 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f5f4d2d8-ea5f-4444-9d62-3406f31338ae tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:04.280331 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f5f4d2d8-ea5f-4444-9d62-3406f31338ae tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:04.302556 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f5f4d2d8-ea5f-4444-9d62-3406f31338ae tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:04.303214 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f5f4d2d8-ea5f-4444-9d62-3406f31338ae tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:04.304027 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f5f4d2d8-ea5f-4444-9d62-3406f31338ae tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:04.304822 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f5f4d2d8-ea5f-4444-9d62-3406f31338ae tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:04.305293 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f5f4d2d8-ea5f-4444-9d62-3406f31338ae tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:04.305725 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f5f4d2d8-ea5f-4444-9d62-3406f31338ae tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:04.477975 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f5f4d2d8-ea5f-4444-9d62-3406f31338ae tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:04.491117 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f5f4d2d8-ea5f-4444-9d62-3406f31338ae tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed" status: 200 len: 1290 microversion: 2.1 time: 0.217133 Oct 04 19:05:04.497402 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3164/6303] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:04 2022] GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed => generated 1290 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:04.589698 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-86881ec2-445a-4777-9b5e-a5a5b1d76caf tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:04.607353 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-86881ec2-445a-4777-9b5e-a5a5b1d76caf tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:04.610097 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-86881ec2-445a-4777-9b5e-a5a5b1d76caf tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:04.611659 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-86881ec2-445a-4777-9b5e-a5a5b1d76caf tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15" status: 200 len: 1741 microversion: 2.20 time: 0.696676 Oct 04 19:05:04.617930 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3140/6304] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:05:03 2022] GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15 => generated 1741 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:05:05.525348 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-be089297-0697-4f13-8b53-1e9fd23dcc51 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:05.526676 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-be089297-0697-4f13-8b53-1e9fd23dcc51 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:05.541653 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-be089297-0697-4f13-8b53-1e9fd23dcc51 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:05.541653 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-be089297-0697-4f13-8b53-1e9fd23dcc51 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:05.541653 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-be089297-0697-4f13-8b53-1e9fd23dcc51 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:05.542743 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-be089297-0697-4f13-8b53-1e9fd23dcc51 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:05.544278 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-be089297-0697-4f13-8b53-1e9fd23dcc51 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:05.544729 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-be089297-0697-4f13-8b53-1e9fd23dcc51 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:05.643400 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-64904970-3615-4e0e-b9a0-cd49d3d8e5d7 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:05.644115 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-64904970-3615-4e0e-b9a0-cd49d3d8e5d7 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 0e957abd-68e7-48c3-af4b-74d570d41c15] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:05.651292 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-64904970-3615-4e0e-b9a0-cd49d3d8e5d7 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:05.660949 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-64904970-3615-4e0e-b9a0-cd49d3d8e5d7 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:05.663328 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-64904970-3615-4e0e-b9a0-cd49d3d8e5d7 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:05.665720 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-64904970-3615-4e0e-b9a0-cd49d3d8e5d7 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:05.667286 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-64904970-3615-4e0e-b9a0-cd49d3d8e5d7 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:05.673077 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-64904970-3615-4e0e-b9a0-cd49d3d8e5d7 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:05.704102 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-be089297-0697-4f13-8b53-1e9fd23dcc51 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:05.718656 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-be089297-0697-4f13-8b53-1e9fd23dcc51 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed" status: 200 len: 1300 microversion: 2.1 time: 0.197449 Oct 04 19:05:05.722490 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3165/6305] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:05 2022] GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed => generated 1300 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:06.271680 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-70ee9b72-3694-46d0-afea-0c1fb4a56eb8 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:06.272414 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-70ee9b72-3694-46d0-afea-0c1fb4a56eb8 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] [instance: 505e8d54-138e-404a-a403-1bd5c9b0c4ab] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:06.284353 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-70ee9b72-3694-46d0-afea-0c1fb4a56eb8 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:06.288813 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-70ee9b72-3694-46d0-afea-0c1fb4a56eb8 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:06.289281 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-70ee9b72-3694-46d0-afea-0c1fb4a56eb8 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:06.290020 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-70ee9b72-3694-46d0-afea-0c1fb4a56eb8 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:06.294165 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-70ee9b72-3694-46d0-afea-0c1fb4a56eb8 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:06.294645 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-70ee9b72-3694-46d0-afea-0c1fb4a56eb8 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:06.461708 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-70ee9b72-3694-46d0-afea-0c1fb4a56eb8 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] [instance: 505e8d54-138e-404a-a403-1bd5c9b0c4ab] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:05:06.484674 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-64904970-3615-4e0e-b9a0-cd49d3d8e5d7 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:06.484674 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-64904970-3615-4e0e-b9a0-cd49d3d8e5d7 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:06.484674 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-64904970-3615-4e0e-b9a0-cd49d3d8e5d7 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:06.484674 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-64904970-3615-4e0e-b9a0-cd49d3d8e5d7 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15" status: 200 len: 1741 microversion: 2.20 time: 0.764557 Oct 04 19:05:06.484674 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3141/6306] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:05:05 2022] GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15 => generated 1741 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:05:06.616594 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:05:06.749673 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-88f3bd27-5d9c-4ce3-abe9-dcbdcd7d80e4 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:06.750671 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-88f3bd27-5d9c-4ce3-abe9-dcbdcd7d80e4 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:06.784721 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-88f3bd27-5d9c-4ce3-abe9-dcbdcd7d80e4 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:06.786437 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-88f3bd27-5d9c-4ce3-abe9-dcbdcd7d80e4 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:06.790038 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-88f3bd27-5d9c-4ce3-abe9-dcbdcd7d80e4 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:06.791077 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-88f3bd27-5d9c-4ce3-abe9-dcbdcd7d80e4 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:06.791960 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-88f3bd27-5d9c-4ce3-abe9-dcbdcd7d80e4 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:06.792665 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-88f3bd27-5d9c-4ce3-abe9-dcbdcd7d80e4 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:06.841208 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-70ee9b72-3694-46d0-afea-0c1fb4a56eb8 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] 10.222.0.20 "DELETE /compute/v2.1/servers/505e8d54-138e-404a-a403-1bd5c9b0c4ab" status: 204 len: 0 microversion: 2.1 time: 1.087282 Oct 04 19:05:06.841833 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3166/6307] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 19:05:05 2022] DELETE /compute/v2.1/servers/505e8d54-138e-404a-a403-1bd5c9b0c4ab => generated 0 bytes in 1089 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 19:05:06.858054 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f896c765-63b1-423e-bbd0-30ca7ef5c1fe tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:06.859060 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f896c765-63b1-423e-bbd0-30ca7ef5c1fe tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] [instance: 505e8d54-138e-404a-a403-1bd5c9b0c4ab] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:06.890165 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f896c765-63b1-423e-bbd0-30ca7ef5c1fe tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:06.891052 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f896c765-63b1-423e-bbd0-30ca7ef5c1fe tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:06.891926 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f896c765-63b1-423e-bbd0-30ca7ef5c1fe tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:06.893221 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f896c765-63b1-423e-bbd0-30ca7ef5c1fe tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:06.893805 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f896c765-63b1-423e-bbd0-30ca7ef5c1fe tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:06.894281 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f896c765-63b1-423e-bbd0-30ca7ef5c1fe tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:07.441922 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f896c765-63b1-423e-bbd0-30ca7ef5c1fe tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07d8700f1d64a47b5f1b105178b60be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039c1953c26418d9a0b70444bc76a64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:07.459361 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f896c765-63b1-423e-bbd0-30ca7ef5c1fe tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] 10.222.0.20 "GET /compute/v2.1/servers/505e8d54-138e-404a-a403-1bd5c9b0c4ab" status: 200 len: 1732 microversion: 2.1 time: 0.611286 Oct 04 19:05:07.463078 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3167/6308] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:06 2022] GET /compute/v2.1/servers/505e8d54-138e-404a-a403-1bd5c9b0c4ab => generated 1732 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:07.470566 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-29923f69-7818-4c8c-a05b-16ff58209d1d tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:07.478316 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-29923f69-7818-4c8c-a05b-16ff58209d1d tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 0e957abd-68e7-48c3-af4b-74d570d41c15] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:07.490929 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-29923f69-7818-4c8c-a05b-16ff58209d1d tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:07.491735 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-29923f69-7818-4c8c-a05b-16ff58209d1d tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:07.492691 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-29923f69-7818-4c8c-a05b-16ff58209d1d tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:07.494189 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-29923f69-7818-4c8c-a05b-16ff58209d1d tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:07.497049 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-29923f69-7818-4c8c-a05b-16ff58209d1d tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:07.502112 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-29923f69-7818-4c8c-a05b-16ff58209d1d tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:08.032935 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-88f3bd27-5d9c-4ce3-abe9-dcbdcd7d80e4 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:08.042599 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-88f3bd27-5d9c-4ce3-abe9-dcbdcd7d80e4 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed" status: 200 len: 1342 microversion: 2.1 time: 1.297370 Oct 04 19:05:08.050153 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3142/6309] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:06 2022] GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed => generated 1342 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:08.219874 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-29923f69-7818-4c8c-a05b-16ff58209d1d tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:08.231541 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-29923f69-7818-4c8c-a05b-16ff58209d1d tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:08.233422 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-29923f69-7818-4c8c-a05b-16ff58209d1d tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:08.238680 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-29923f69-7818-4c8c-a05b-16ff58209d1d tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15" status: 200 len: 1741 microversion: 2.20 time: 0.774105 Oct 04 19:05:08.240737 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3168/6310] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:05:07 2022] GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15 => generated 1741 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:05:08.490628 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a57397fc-3f9e-4a56-a5e4-0ce1187719ac tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:08.491674 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a57397fc-3f9e-4a56-a5e4-0ce1187719ac tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] [instance: 505e8d54-138e-404a-a403-1bd5c9b0c4ab] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:08.518140 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a57397fc-3f9e-4a56-a5e4-0ce1187719ac tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:08.523896 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a57397fc-3f9e-4a56-a5e4-0ce1187719ac tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:08.527189 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a57397fc-3f9e-4a56-a5e4-0ce1187719ac tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:08.529543 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a57397fc-3f9e-4a56-a5e4-0ce1187719ac tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:08.538253 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a57397fc-3f9e-4a56-a5e4-0ce1187719ac tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:08.542079 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a57397fc-3f9e-4a56-a5e4-0ce1187719ac tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:08.997584 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a57397fc-3f9e-4a56-a5e4-0ce1187719ac tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07d8700f1d64a47b5f1b105178b60be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039c1953c26418d9a0b70444bc76a64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:09.018967 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a57397fc-3f9e-4a56-a5e4-0ce1187719ac tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] 10.222.0.20 "GET /compute/v2.1/servers/505e8d54-138e-404a-a403-1bd5c9b0c4ab" status: 200 len: 1732 microversion: 2.1 time: 0.533672 Oct 04 19:05:09.025043 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3143/6311] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:08 2022] GET /compute/v2.1/servers/505e8d54-138e-404a-a403-1bd5c9b0c4ab => generated 1732 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:09.078313 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9dbce02a-8088-4dca-b725-60062f02ff69 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:09.078855 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-9dbce02a-8088-4dca-b725-60062f02ff69 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:09.117927 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9dbce02a-8088-4dca-b725-60062f02ff69 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:09.124650 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9dbce02a-8088-4dca-b725-60062f02ff69 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:09.125132 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9dbce02a-8088-4dca-b725-60062f02ff69 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:09.125901 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9dbce02a-8088-4dca-b725-60062f02ff69 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:09.126385 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9dbce02a-8088-4dca-b725-60062f02ff69 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:09.130125 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9dbce02a-8088-4dca-b725-60062f02ff69 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:09.132707 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-c38ad520-425d-401b-85ea-5172f1ff40c8 req-d109b6a4-1144-4ccb-9adc-645200d5b2db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed", "tag": "ba4a5f1b-b13b-4b2b-80a2-ed60e990a0bb"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:05:09.150239 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-c38ad520-425d-401b-85ea-5172f1ff40c8 req-d109b6a4-1144-4ccb-9adc-645200d5b2db service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:09.152647 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-c38ad520-425d-401b-85ea-5172f1ff40c8 req-d109b6a4-1144-4ccb-9adc-645200d5b2db service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:09.156073 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-c38ad520-425d-401b-85ea-5172f1ff40c8 req-d109b6a4-1144-4ccb-9adc-645200d5b2db service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:09.195733 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-c38ad520-425d-401b-85ea-5172f1ff40c8 req-d109b6a4-1144-4ccb-9adc-645200d5b2db service nova] Creating event network-changed:ba4a5f1b-b13b-4b2b-80a2-ed60e990a0bb for instance eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed on n-h1-850501-14 Oct 04 19:05:09.211472 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-c38ad520-425d-401b-85ea-5172f1ff40c8 req-d109b6a4-1144-4ccb-9adc-645200d5b2db service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082643 Oct 04 19:05:09.216315 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3144/6312] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:05:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:05:09.271135 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7468058d-6ab7-4694-84c5-6b9aa5a7e68e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:09.272223 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7468058d-6ab7-4694-84c5-6b9aa5a7e68e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 0e957abd-68e7-48c3-af4b-74d570d41c15] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:09.290406 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7468058d-6ab7-4694-84c5-6b9aa5a7e68e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:09.291284 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7468058d-6ab7-4694-84c5-6b9aa5a7e68e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:09.291934 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7468058d-6ab7-4694-84c5-6b9aa5a7e68e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:09.292894 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7468058d-6ab7-4694-84c5-6b9aa5a7e68e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:09.293545 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7468058d-6ab7-4694-84c5-6b9aa5a7e68e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:09.299071 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7468058d-6ab7-4694-84c5-6b9aa5a7e68e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:09.721308 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9dbce02a-8088-4dca-b725-60062f02ff69 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:09.736031 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9dbce02a-8088-4dca-b725-60062f02ff69 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed" status: 200 len: 1342 microversion: 2.1 time: 0.662676 Oct 04 19:05:09.738766 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3169/6313] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:09 2022] GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed => generated 1342 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:09.829541 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7468058d-6ab7-4694-84c5-6b9aa5a7e68e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:09.847946 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7468058d-6ab7-4694-84c5-6b9aa5a7e68e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:09.849800 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7468058d-6ab7-4694-84c5-6b9aa5a7e68e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:09.855598 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7468058d-6ab7-4694-84c5-6b9aa5a7e68e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15" status: 200 len: 1741 microversion: 2.20 time: 0.589066 Oct 04 19:05:09.879302 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3145/6314] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:05:09 2022] GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15 => generated 1741 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:05:10.056899 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-efd19657-49d2-41c5-877e-2d68a9f66471 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:10.057754 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-efd19657-49d2-41c5-877e-2d68a9f66471 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] [instance: 505e8d54-138e-404a-a403-1bd5c9b0c4ab] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:10.074557 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-efd19657-49d2-41c5-877e-2d68a9f66471 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:10.078394 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-efd19657-49d2-41c5-877e-2d68a9f66471 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:10.079847 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-efd19657-49d2-41c5-877e-2d68a9f66471 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:10.081574 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-efd19657-49d2-41c5-877e-2d68a9f66471 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:10.084016 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-efd19657-49d2-41c5-877e-2d68a9f66471 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:10.084726 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-efd19657-49d2-41c5-877e-2d68a9f66471 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:10.279564 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-efd19657-49d2-41c5-877e-2d68a9f66471 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07d8700f1d64a47b5f1b105178b60be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039c1953c26418d9a0b70444bc76a64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:10.291259 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-efd19657-49d2-41c5-877e-2d68a9f66471 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] 10.222.0.20 "GET /compute/v2.1/servers/505e8d54-138e-404a-a403-1bd5c9b0c4ab" status: 200 len: 1665 microversion: 2.1 time: 0.237073 Oct 04 19:05:10.293921 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3170/6315] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:10 2022] GET /compute/v2.1/servers/505e8d54-138e-404a-a403-1bd5c9b0c4ab => generated 1665 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:10.764915 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-05c4fe7d-23ee-41f3-aaa9-f5611c073ce5 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:10.767722 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-05c4fe7d-23ee-41f3-aaa9-f5611c073ce5 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:10.770283 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:05:10.771274 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=6 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:05:10.785018 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-05c4fe7d-23ee-41f3-aaa9-f5611c073ce5 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:10.786773 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-05c4fe7d-23ee-41f3-aaa9-f5611c073ce5 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:10.787457 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-05c4fe7d-23ee-41f3-aaa9-f5611c073ce5 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:10.790723 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-05c4fe7d-23ee-41f3-aaa9-f5611c073ce5 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:10.791405 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-05c4fe7d-23ee-41f3-aaa9-f5611c073ce5 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:10.792303 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-05c4fe7d-23ee-41f3-aaa9-f5611c073ce5 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:10.802511 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:05:10.887879 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-dd8c002f-f2c3-4c13-b4b5-064289268e13 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:10.888518 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-dd8c002f-f2c3-4c13-b4b5-064289268e13 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 0e957abd-68e7-48c3-af4b-74d570d41c15] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:10.916347 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dd8c002f-f2c3-4c13-b4b5-064289268e13 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:10.916640 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dd8c002f-f2c3-4c13-b4b5-064289268e13 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:10.917105 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dd8c002f-f2c3-4c13-b4b5-064289268e13 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:10.917856 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dd8c002f-f2c3-4c13-b4b5-064289268e13 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:10.932372 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dd8c002f-f2c3-4c13-b4b5-064289268e13 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:10.935342 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dd8c002f-f2c3-4c13-b4b5-064289268e13 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:11.762262 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-dd8c002f-f2c3-4c13-b4b5-064289268e13 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:11.780122 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-dd8c002f-f2c3-4c13-b4b5-064289268e13 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:11.782707 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-dd8c002f-f2c3-4c13-b4b5-064289268e13 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:11.784174 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-dd8c002f-f2c3-4c13-b4b5-064289268e13 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15" status: 200 len: 1741 microversion: 2.20 time: 0.901232 Oct 04 19:05:11.785220 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3171/6316] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:05:10 2022] GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15 => generated 1741 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 19:05:11.790410 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-05c4fe7d-23ee-41f3-aaa9-f5611c073ce5 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:11.799453 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-05c4fe7d-23ee-41f3-aaa9-f5611c073ce5 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed" status: 200 len: 1342 microversion: 2.1 time: 1.040407 Oct 04 19:05:11.808892 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-66ce5211-83ad-46d4-8125-7fc037056af9 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:11.809395 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3146/6317] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:10 2022] GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed => generated 1342 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:11.819031 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-306ac519-2137-4704-b81d-771f157162fc req-e3fd63a5-f9aa-49b1-9c1b-fda4f7b6af57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "505e8d54-138e-404a-a403-1bd5c9b0c4ab", "name": "network-vif-deleted", "tag": "165d92c2-bb6d-44be-b249-79846e929a8b"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:05:11.819963 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-66ce5211-83ad-46d4-8125-7fc037056af9 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] [instance: 505e8d54-138e-404a-a403-1bd5c9b0c4ab] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:11.835363 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-66ce5211-83ad-46d4-8125-7fc037056af9 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:11.835363 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-66ce5211-83ad-46d4-8125-7fc037056af9 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:11.835363 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-66ce5211-83ad-46d4-8125-7fc037056af9 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:11.839110 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-66ce5211-83ad-46d4-8125-7fc037056af9 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:11.843406 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-66ce5211-83ad-46d4-8125-7fc037056af9 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:11.844877 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-66ce5211-83ad-46d4-8125-7fc037056af9 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:11.858194 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-306ac519-2137-4704-b81d-771f157162fc req-e3fd63a5-f9aa-49b1-9c1b-fda4f7b6af57 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:11.863873 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-306ac519-2137-4704-b81d-771f157162fc req-e3fd63a5-f9aa-49b1-9c1b-fda4f7b6af57 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:11.864718 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-306ac519-2137-4704-b81d-771f157162fc req-e3fd63a5-f9aa-49b1-9c1b-fda4f7b6af57 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:11.894294 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-306ac519-2137-4704-b81d-771f157162fc req-e3fd63a5-f9aa-49b1-9c1b-fda4f7b6af57 service nova] Creating event network-vif-deleted:165d92c2-bb6d-44be-b249-79846e929a8b for instance 505e8d54-138e-404a-a403-1bd5c9b0c4ab on n-h1-850501-14 Oct 04 19:05:11.906513 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-306ac519-2137-4704-b81d-771f157162fc req-e3fd63a5-f9aa-49b1-9c1b-fda4f7b6af57 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095687 Oct 04 19:05:11.908423 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3147/6318] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:05:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:05:11.955132 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-66ce5211-83ad-46d4-8125-7fc037056af9 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:11.955132 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-66ce5211-83ad-46d4-8125-7fc037056af9 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:11.955132 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-66ce5211-83ad-46d4-8125-7fc037056af9 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:11.955132 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-66ce5211-83ad-46d4-8125-7fc037056af9 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lazy-loading 'fault' on Instance uuid 505e8d54-138e-404a-a403-1bd5c9b0c4ab {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:05:12.009706 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=4 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:05:12.460689 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-66ce5211-83ad-46d4-8125-7fc037056af9 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07d8700f1d64a47b5f1b105178b60be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039c1953c26418d9a0b70444bc76a64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:12.472815 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-66ce5211-83ad-46d4-8125-7fc037056af9 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] 10.222.0.20 "GET /compute/v2.1/servers/505e8d54-138e-404a-a403-1bd5c9b0c4ab" status: 200 len: 1388 microversion: 2.1 time: 0.684473 Oct 04 19:05:12.496571 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3172/6319] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:11 2022] GET /compute/v2.1/servers/505e8d54-138e-404a-a403-1bd5c9b0c4ab => generated 1388 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:12.816476 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-28b4c088-5e54-408e-8657-6a8b86ac38f8 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:12.817887 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-28b4c088-5e54-408e-8657-6a8b86ac38f8 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 0e957abd-68e7-48c3-af4b-74d570d41c15] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:12.828887 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-02d67107-6b1b-46f2-a69c-e92d06844eed tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:12.829741 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-02d67107-6b1b-46f2-a69c-e92d06844eed tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:12.844485 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-02d67107-6b1b-46f2-a69c-e92d06844eed tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:12.845300 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-02d67107-6b1b-46f2-a69c-e92d06844eed tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:12.847450 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-02d67107-6b1b-46f2-a69c-e92d06844eed tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:12.849023 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-28b4c088-5e54-408e-8657-6a8b86ac38f8 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:12.849343 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-02d67107-6b1b-46f2-a69c-e92d06844eed tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:12.849804 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-02d67107-6b1b-46f2-a69c-e92d06844eed tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:12.850235 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-02d67107-6b1b-46f2-a69c-e92d06844eed tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:12.853459 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-28b4c088-5e54-408e-8657-6a8b86ac38f8 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:12.854690 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-28b4c088-5e54-408e-8657-6a8b86ac38f8 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:12.855640 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-28b4c088-5e54-408e-8657-6a8b86ac38f8 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:12.856160 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-28b4c088-5e54-408e-8657-6a8b86ac38f8 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:12.856608 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-28b4c088-5e54-408e-8657-6a8b86ac38f8 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:13.308564 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-02d67107-6b1b-46f2-a69c-e92d06844eed tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:13.309082 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-28b4c088-5e54-408e-8657-6a8b86ac38f8 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:13.322301 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-02d67107-6b1b-46f2-a69c-e92d06844eed tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed" status: 200 len: 1342 microversion: 2.1 time: 0.499099 Oct 04 19:05:13.324137 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3173/6320] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:12 2022] GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed => generated 1342 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:13.325799 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-28b4c088-5e54-408e-8657-6a8b86ac38f8 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:13.329550 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-28b4c088-5e54-408e-8657-6a8b86ac38f8 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:13.331164 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-82ca6955-5c86-4d49-bd61-f1aeae16f4b1 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:13.331781 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-82ca6955-5c86-4d49-bd61-f1aeae16f4b1 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: f8f9ee3a-1a3d-43b9-bdf1-8725457b6611] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:13.332138 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-28b4c088-5e54-408e-8657-6a8b86ac38f8 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15" status: 200 len: 1741 microversion: 2.20 time: 0.522186 Oct 04 19:05:13.338704 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3148/6321] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:05:12 2022] GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15 => generated 1741 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:05:13.339070 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-82ca6955-5c86-4d49-bd61-f1aeae16f4b1 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:13.339604 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-82ca6955-5c86-4d49-bd61-f1aeae16f4b1 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:13.341004 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-82ca6955-5c86-4d49-bd61-f1aeae16f4b1 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:13.341428 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-82ca6955-5c86-4d49-bd61-f1aeae16f4b1 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:13.341668 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-82ca6955-5c86-4d49-bd61-f1aeae16f4b1 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:13.342984 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-82ca6955-5c86-4d49-bd61-f1aeae16f4b1 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:13.455680 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-82ca6955-5c86-4d49-bd61-f1aeae16f4b1 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lazy-loading 'services' on Instance uuid f8f9ee3a-1a3d-43b9-bdf1-8725457b6611 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:05:13.506974 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e45251e3-51a8-4bf6-bd1c-45a19fa328e9 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:13.509557 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e45251e3-51a8-4bf6-bd1c-45a19fa328e9 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] [instance: 505e8d54-138e-404a-a403-1bd5c9b0c4ab] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:13.544831 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e45251e3-51a8-4bf6-bd1c-45a19fa328e9 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:13.548016 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e45251e3-51a8-4bf6-bd1c-45a19fa328e9 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:13.548742 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e45251e3-51a8-4bf6-bd1c-45a19fa328e9 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:13.550467 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e45251e3-51a8-4bf6-bd1c-45a19fa328e9 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:13.551928 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e45251e3-51a8-4bf6-bd1c-45a19fa328e9 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:13.558005 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e45251e3-51a8-4bf6-bd1c-45a19fa328e9 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:13.712973 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e45251e3-51a8-4bf6-bd1c-45a19fa328e9 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:13.713827 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e45251e3-51a8-4bf6-bd1c-45a19fa328e9 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:13.714291 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e45251e3-51a8-4bf6-bd1c-45a19fa328e9 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:13.716174 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-e45251e3-51a8-4bf6-bd1c-45a19fa328e9 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lazy-loading 'fault' on Instance uuid 505e8d54-138e-404a-a403-1bd5c9b0c4ab {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:05:13.806223 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e45251e3-51a8-4bf6-bd1c-45a19fa328e9 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c07d8700f1d64a47b5f1b105178b60be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd039c1953c26418d9a0b70444bc76a64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:13.821563 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e45251e3-51a8-4bf6-bd1c-45a19fa328e9 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] 10.222.0.20 "GET /compute/v2.1/servers/505e8d54-138e-404a-a403-1bd5c9b0c4ab" status: 200 len: 1388 microversion: 2.1 time: 0.324848 Oct 04 19:05:13.824304 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3149/6322] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:13 2022] GET /compute/v2.1/servers/505e8d54-138e-404a-a403-1bd5c9b0c4ab => generated 1388 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:13.956891 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-82ca6955-5c86-4d49-bd61-f1aeae16f4b1 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f8f9ee3a-1a3d-43b9-bdf1-8725457b6611/os-volume_attachments/014b5cb6-7bd5-4322-8ccb-a711c870aeb5" status: 202 len: 0 microversion: 2.1 time: 0.631012 Oct 04 19:05:13.957406 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3174/6323] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Oct 4 19:05:13 2022] DELETE /compute/v2.1/servers/f8f9ee3a-1a3d-43b9-bdf1-8725457b6611/os-volume_attachments/014b5cb6-7bd5-4322-8ccb-a711c870aeb5 => generated 0 bytes in 633 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:05:13.968279 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ad4da93f-dfa1-4ae7-9bf7-cd8afe71591d tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:13.974531 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ad4da93f-dfa1-4ae7-9bf7-cd8afe71591d tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: f8f9ee3a-1a3d-43b9-bdf1-8725457b6611] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:13.997713 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ad4da93f-dfa1-4ae7-9bf7-cd8afe71591d tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:14.000228 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ad4da93f-dfa1-4ae7-9bf7-cd8afe71591d tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:14.000751 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ad4da93f-dfa1-4ae7-9bf7-cd8afe71591d tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:14.001879 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ad4da93f-dfa1-4ae7-9bf7-cd8afe71591d tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:14.002608 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ad4da93f-dfa1-4ae7-9bf7-cd8afe71591d tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:14.003233 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ad4da93f-dfa1-4ae7-9bf7-cd8afe71591d tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:14.131613 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ad4da93f-dfa1-4ae7-9bf7-cd8afe71591d tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/f8f9ee3a-1a3d-43b9-bdf1-8725457b6611/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.169027 Oct 04 19:05:14.146245 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3150/6324] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 19:05:13 2022] GET /compute/v2.1/servers/f8f9ee3a-1a3d-43b9-bdf1-8725457b6611/os-volume_attachments => generated 197 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:05:14.363392 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2fb0e041-c729-4200-a21c-2669fc6efe96 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:14.363392 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2fb0e041-c729-4200-a21c-2669fc6efe96 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:14.371203 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-81a5fac1-11b7-4d8d-9112-f58458911cd8 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:14.371927 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-81a5fac1-11b7-4d8d-9112-f58458911cd8 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 0e957abd-68e7-48c3-af4b-74d570d41c15] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:14.384299 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-81a5fac1-11b7-4d8d-9112-f58458911cd8 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:14.384809 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-81a5fac1-11b7-4d8d-9112-f58458911cd8 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:14.385394 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-81a5fac1-11b7-4d8d-9112-f58458911cd8 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:14.386494 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-81a5fac1-11b7-4d8d-9112-f58458911cd8 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:14.387125 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-81a5fac1-11b7-4d8d-9112-f58458911cd8 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:14.387676 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-81a5fac1-11b7-4d8d-9112-f58458911cd8 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:14.388689 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2fb0e041-c729-4200-a21c-2669fc6efe96 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:14.390535 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2fb0e041-c729-4200-a21c-2669fc6efe96 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:14.391328 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2fb0e041-c729-4200-a21c-2669fc6efe96 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:14.412796 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2fb0e041-c729-4200-a21c-2669fc6efe96 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:14.413868 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2fb0e041-c729-4200-a21c-2669fc6efe96 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:14.417944 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2fb0e041-c729-4200-a21c-2669fc6efe96 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:14.877522 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-81a5fac1-11b7-4d8d-9112-f58458911cd8 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:14.901563 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-81a5fac1-11b7-4d8d-9112-f58458911cd8 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:14.906061 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-2fb0e041-c729-4200-a21c-2669fc6efe96 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:14.912697 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-81a5fac1-11b7-4d8d-9112-f58458911cd8 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:14.912697 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-81a5fac1-11b7-4d8d-9112-f58458911cd8 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15" status: 200 len: 1741 microversion: 2.20 time: 0.541643 Oct 04 19:05:14.917098 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2fb0e041-c729-4200-a21c-2669fc6efe96 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed" status: 200 len: 1342 microversion: 2.1 time: 0.563044 Oct 04 19:05:14.934107 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3175/6325] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:14 2022] GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed => generated 1342 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:14.936087 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3151/6326] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:05:14 2022] GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15 => generated 1741 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:05:14.949684 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-41277a75-8eaf-4db3-9d8f-66759d02f974 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:14.950705 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-41277a75-8eaf-4db3-9d8f-66759d02f974 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] [instance: 505e8d54-138e-404a-a403-1bd5c9b0c4ab] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:14.958356 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-41277a75-8eaf-4db3-9d8f-66759d02f974 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:14.959135 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-41277a75-8eaf-4db3-9d8f-66759d02f974 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:14.959784 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-41277a75-8eaf-4db3-9d8f-66759d02f974 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:14.960807 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-41277a75-8eaf-4db3-9d8f-66759d02f974 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:14.961464 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-41277a75-8eaf-4db3-9d8f-66759d02f974 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:14.962088 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-41277a75-8eaf-4db3-9d8f-66759d02f974 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:14.992451 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-41277a75-8eaf-4db3-9d8f-66759d02f974 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] HTTP exception thrown: Instance 505e8d54-138e-404a-a403-1bd5c9b0c4ab could not be found. Oct 04 19:05:14.995242 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-41277a75-8eaf-4db3-9d8f-66759d02f974 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Request method failure captured: Oct 04 19:05:14.995242 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/505e8d54-138e-404a-a403-1bd5c9b0c4ab HTTP/1.1 Oct 04 19:05:14.995242 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 19:05:14.995242 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 19:05:14.995242 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 19:05:14.995242 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 19:05:14.995242 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 19:05:14.995242 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 19:05:14.995242 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 19:05:14.995242 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 19:05:14.995242 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPIKTu0CYodd3JNr0T_dqLqmM5ED44a2sXzLXn4Tuato5CJHy5CRxi3ts6IGLDJpM4QqBSnA228GKc5hBSnWBTkVxy6EW8_Vl8KjJOBGsg6WWuzVbcFk_iupBhylqy5x2iFraK0j5T8eGgoGngw9oxrK4u0Of_BW2b4XWZayVQjSR8Fg Oct 04 19:05:14.995242 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 19:05:14.995242 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 19:05:14.995242 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 19:05:14.995242 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 19:05:14.995242 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 19:05:14.995242 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 19:05:14.995242 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: d039c1953c26418d9a0b70444bc76a64 Oct 04 19:05:14.995242 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-TestServerBasicOps-1031939344 Oct 04 19:05:14.995242 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 19:05:14.995242 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 19:05:14.995242 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d039c1953c26418d9a0b70444bc76a64"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d039c1953c26418d9a0b70444bc76a64", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d039c1953c26418d9a0b70444bc76a64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d039c1953c26418d9a0b70444bc76a64"}]}] Oct 04 19:05:14.995242 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-TestServerBasicOps-1031939344 Oct 04 19:05:14.995242 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: d039c1953c26418d9a0b70444bc76a64 Oct 04 19:05:14.995242 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-TestServerBasicOps-1031939344 Oct 04 19:05:14.995242 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-TestServerBasicOps-1031939344-project Oct 04 19:05:14.995242 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 19:05:14.995242 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 19:05:14.995242 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: c07d8700f1d64a47b5f1b105178b60be Oct 04 19:05:14.995242 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-TestServerBasicOps-1031939344-project Oct 04 19:05:14.995242 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 19:05:14.995242 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 505e8d54-138e-404a-a403-1bd5c9b0c4ab could not be found. Oct 04 19:05:14.995242 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '505e8d54-138e-404a-a403-1bd5c9b0c4ab'} Oct 04 19:05:14.995242 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:05:14.995242 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:05:14.995242 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:05:14.995242 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:05:14.995242 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:05:14.995242 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:05:14.995242 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:05:14.995242 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:05:14.995242 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:05:14.995242 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:05:14.995242 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 505e8d54-138e-404a-a403-1bd5c9b0c4ab could not be found. Oct 04 19:05:14.995242 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:05:14.995242 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:05:14.995242 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:05:14.995242 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:05:14.995242 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:05:14.995242 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:05:14.995242 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:05:14.995242 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:05:14.995242 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:05:14.995242 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:05:14.995242 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:05:14.995242 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:05:14.995242 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:05:14.995242 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:05:14.995242 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:05:14.995242 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:05:14.995242 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 505e8d54-138e-404a-a403-1bd5c9b0c4ab could not be found. Oct 04 19:05:14.995242 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:05:14.995242 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:05:14.995242 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:05:14.999222 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:05:14.999222 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:05:14.999222 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:05:14.999222 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:05:14.999222 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:05:14.999222 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 505e8d54-138e-404a-a403-1bd5c9b0c4ab could not be found. Oct 04 19:05:14.999222 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:05:15.005550 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-41277a75-8eaf-4db3-9d8f-66759d02f974 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Returning 404 to user: Instance 505e8d54-138e-404a-a403-1bd5c9b0c4ab could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:05:15.009173 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-41277a75-8eaf-4db3-9d8f-66759d02f974 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] 10.222.0.20 "GET /compute/v2.1/servers/505e8d54-138e-404a-a403-1bd5c9b0c4ab" status: 404 len: 111 microversion: 2.1 time: 0.071205 Oct 04 19:05:15.014730 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3176/6327] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:14 2022] GET /compute/v2.1/servers/505e8d54-138e-404a-a403-1bd5c9b0c4ab => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:05:15.159948 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-46a8c9b9-ae3b-4dc0-a4a5-619065d9ba6a tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:15.169043 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-46a8c9b9-ae3b-4dc0-a4a5-619065d9ba6a tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: f8f9ee3a-1a3d-43b9-bdf1-8725457b6611] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:15.183118 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-46a8c9b9-ae3b-4dc0-a4a5-619065d9ba6a tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:15.194959 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-46a8c9b9-ae3b-4dc0-a4a5-619065d9ba6a tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:15.195734 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-46a8c9b9-ae3b-4dc0-a4a5-619065d9ba6a tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:15.198132 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-46a8c9b9-ae3b-4dc0-a4a5-619065d9ba6a tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:15.198961 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-46a8c9b9-ae3b-4dc0-a4a5-619065d9ba6a tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:15.200135 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-46a8c9b9-ae3b-4dc0-a4a5-619065d9ba6a tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:15.254530 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-46a8c9b9-ae3b-4dc0-a4a5-619065d9ba6a tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/f8f9ee3a-1a3d-43b9-bdf1-8725457b6611/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098070 Oct 04 19:05:15.256888 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3152/6328] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 19:05:15 2022] GET /compute/v2.1/servers/f8f9ee3a-1a3d-43b9-bdf1-8725457b6611/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:05:15.950319 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9090b2ea-d857-4b85-a2d3-03a6c4a652da tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:15.953337 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-9090b2ea-d857-4b85-a2d3-03a6c4a652da tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 0e957abd-68e7-48c3-af4b-74d570d41c15] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:15.954217 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3f1ea9af-2b97-43e3-901f-c369d6eba821 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:15.954972 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3f1ea9af-2b97-43e3-901f-c369d6eba821 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:15.964547 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9090b2ea-d857-4b85-a2d3-03a6c4a652da tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:15.965921 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9090b2ea-d857-4b85-a2d3-03a6c4a652da tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:15.966042 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f1ea9af-2b97-43e3-901f-c369d6eba821 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:15.966588 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f1ea9af-2b97-43e3-901f-c369d6eba821 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:15.966815 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9090b2ea-d857-4b85-a2d3-03a6c4a652da tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:15.968242 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f1ea9af-2b97-43e3-901f-c369d6eba821 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:15.968988 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f1ea9af-2b97-43e3-901f-c369d6eba821 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:15.971181 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9090b2ea-d857-4b85-a2d3-03a6c4a652da tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:15.972491 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9090b2ea-d857-4b85-a2d3-03a6c4a652da tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:15.973139 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9090b2ea-d857-4b85-a2d3-03a6c4a652da tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:15.974162 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f1ea9af-2b97-43e3-901f-c369d6eba821 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:15.974694 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f1ea9af-2b97-43e3-901f-c369d6eba821 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:16.229446 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9090b2ea-d857-4b85-a2d3-03a6c4a652da tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:16.251660 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9090b2ea-d857-4b85-a2d3-03a6c4a652da tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:16.257163 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9090b2ea-d857-4b85-a2d3-03a6c4a652da tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:16.258418 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9090b2ea-d857-4b85-a2d3-03a6c4a652da tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15" status: 200 len: 1741 microversion: 2.20 time: 0.315541 Oct 04 19:05:16.281662 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3177/6329] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:05:15 2022] GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15 => generated 1741 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:05:16.281662 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b2639ca6-2261-4aaf-9fbd-69fd6614cc5f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:16.292903 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b2639ca6-2261-4aaf-9fbd-69fd6614cc5f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: f8f9ee3a-1a3d-43b9-bdf1-8725457b6611] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:16.309368 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b2639ca6-2261-4aaf-9fbd-69fd6614cc5f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:16.310480 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b2639ca6-2261-4aaf-9fbd-69fd6614cc5f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:16.311670 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b2639ca6-2261-4aaf-9fbd-69fd6614cc5f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:16.315238 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b2639ca6-2261-4aaf-9fbd-69fd6614cc5f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:16.316033 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b2639ca6-2261-4aaf-9fbd-69fd6614cc5f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:16.318167 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b2639ca6-2261-4aaf-9fbd-69fd6614cc5f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:16.393101 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3f1ea9af-2b97-43e3-901f-c369d6eba821 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:16.401848 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3f1ea9af-2b97-43e3-901f-c369d6eba821 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed" status: 200 len: 1342 microversion: 2.1 time: 0.452339 Oct 04 19:05:16.410625 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b2639ca6-2261-4aaf-9fbd-69fd6614cc5f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/f8f9ee3a-1a3d-43b9-bdf1-8725457b6611/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.137975 Oct 04 19:05:16.411611 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3178/6330] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 19:05:16 2022] GET /compute/v2.1/servers/f8f9ee3a-1a3d-43b9-bdf1-8725457b6611/os-volume_attachments => generated 197 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:05:16.417165 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3153/6331] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:15 2022] GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed => generated 1342 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:16.423409 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-685f4ffe-90f1-4f94-9060-0d264cc8236b tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:16.423409 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-685f4ffe-90f1-4f94-9060-0d264cc8236b tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] [instance: 505e8d54-138e-404a-a403-1bd5c9b0c4ab] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:16.430777 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-685f4ffe-90f1-4f94-9060-0d264cc8236b tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:16.432951 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-685f4ffe-90f1-4f94-9060-0d264cc8236b tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:16.432951 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-685f4ffe-90f1-4f94-9060-0d264cc8236b tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:16.433254 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-685f4ffe-90f1-4f94-9060-0d264cc8236b tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:16.433790 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-685f4ffe-90f1-4f94-9060-0d264cc8236b tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:16.434220 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-685f4ffe-90f1-4f94-9060-0d264cc8236b tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:16.453867 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-685f4ffe-90f1-4f94-9060-0d264cc8236b tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] HTTP exception thrown: Instance 505e8d54-138e-404a-a403-1bd5c9b0c4ab could not be found. Oct 04 19:05:16.456789 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-685f4ffe-90f1-4f94-9060-0d264cc8236b tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Request method failure captured: Oct 04 19:05:16.456789 n-d-850501-14 devstack@n-api.service[123001]: request: DELETE /compute/v2.1/servers/505e8d54-138e-404a-a403-1bd5c9b0c4ab HTTP/1.1 Oct 04 19:05:16.456789 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 19:05:16.456789 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 19:05:16.456789 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 19:05:16.456789 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 19:05:16.456789 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 19:05:16.456789 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 19:05:16.456789 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 19:05:16.456789 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 19:05:16.456789 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPIKTu0CYodd3JNr0T_dqLqmM5ED44a2sXzLXn4Tuato5CJHy5CRxi3ts6IGLDJpM4QqBSnA228GKc5hBSnWBTkVxy6EW8_Vl8KjJOBGsg6WWuzVbcFk_iupBhylqy5x2iFraK0j5T8eGgoGngw9oxrK4u0Of_BW2b4XWZayVQjSR8Fg Oct 04 19:05:16.456789 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 19:05:16.456789 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 19:05:16.456789 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 19:05:16.456789 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 19:05:16.456789 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 19:05:16.456789 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 19:05:16.456789 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: d039c1953c26418d9a0b70444bc76a64 Oct 04 19:05:16.456789 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-TestServerBasicOps-1031939344 Oct 04 19:05:16.456789 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 19:05:16.456789 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 19:05:16.456789 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d039c1953c26418d9a0b70444bc76a64"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d039c1953c26418d9a0b70444bc76a64", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d039c1953c26418d9a0b70444bc76a64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d039c1953c26418d9a0b70444bc76a64"}]}] Oct 04 19:05:16.456789 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-TestServerBasicOps-1031939344 Oct 04 19:05:16.456789 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: d039c1953c26418d9a0b70444bc76a64 Oct 04 19:05:16.456789 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-TestServerBasicOps-1031939344 Oct 04 19:05:16.456789 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-TestServerBasicOps-1031939344-project Oct 04 19:05:16.456789 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 19:05:16.456789 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 19:05:16.456789 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: c07d8700f1d64a47b5f1b105178b60be Oct 04 19:05:16.456789 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-TestServerBasicOps-1031939344-project Oct 04 19:05:16.456789 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 19:05:16.456789 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 505e8d54-138e-404a-a403-1bd5c9b0c4ab could not be found. Oct 04 19:05:16.456789 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '505e8d54-138e-404a-a403-1bd5c9b0c4ab'} Oct 04 19:05:16.456789 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:05:16.456789 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:05:16.456789 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:05:16.456789 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:05:16.456789 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:05:16.456789 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:05:16.456789 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:05:16.456789 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:05:16.456789 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:05:16.456789 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:05:16.456789 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 505e8d54-138e-404a-a403-1bd5c9b0c4ab could not be found. Oct 04 19:05:16.456789 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:05:16.456789 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:05:16.456789 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:05:16.456789 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:05:16.456789 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:05:16.456789 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:05:16.456789 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:05:16.456789 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:05:16.456789 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:05:16.456789 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:05:16.456789 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 19:05:16.456789 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 19:05:16.456789 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 19:05:16.456789 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 19:05:16.456789 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:05:16.456789 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:05:16.456789 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:05:16.456789 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:05:16.460093 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 505e8d54-138e-404a-a403-1bd5c9b0c4ab could not be found. Oct 04 19:05:16.460093 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:05:16.460093 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:05:16.460093 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:05:16.460093 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:05:16.460093 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:05:16.460093 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:05:16.460093 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:05:16.460093 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:05:16.460093 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 505e8d54-138e-404a-a403-1bd5c9b0c4ab could not be found. Oct 04 19:05:16.460093 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:05:16.460093 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-685f4ffe-90f1-4f94-9060-0d264cc8236b tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Returning 404 to user: Instance 505e8d54-138e-404a-a403-1bd5c9b0c4ab could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:05:16.460093 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-685f4ffe-90f1-4f94-9060-0d264cc8236b tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] 10.222.0.20 "DELETE /compute/v2.1/servers/505e8d54-138e-404a-a403-1bd5c9b0c4ab" status: 404 len: 111 microversion: 2.1 time: 0.042427 Oct 04 19:05:16.461715 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3179/6332] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 19:05:16 2022] DELETE /compute/v2.1/servers/505e8d54-138e-404a-a403-1bd5c9b0c4ab => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:05:16.467329 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7fafa997-3cdf-4df9-9198-bbdfc3f29801 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:16.469383 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7fafa997-3cdf-4df9-9198-bbdfc3f29801 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] [instance: 505e8d54-138e-404a-a403-1bd5c9b0c4ab] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:16.483657 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7fafa997-3cdf-4df9-9198-bbdfc3f29801 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:16.484504 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7fafa997-3cdf-4df9-9198-bbdfc3f29801 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:16.485301 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7fafa997-3cdf-4df9-9198-bbdfc3f29801 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:16.486395 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7fafa997-3cdf-4df9-9198-bbdfc3f29801 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:16.487055 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7fafa997-3cdf-4df9-9198-bbdfc3f29801 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:16.487682 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7fafa997-3cdf-4df9-9198-bbdfc3f29801 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:16.534807 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-7fafa997-3cdf-4df9-9198-bbdfc3f29801 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] HTTP exception thrown: Instance 505e8d54-138e-404a-a403-1bd5c9b0c4ab could not be found. Oct 04 19:05:16.549140 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7fafa997-3cdf-4df9-9198-bbdfc3f29801 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Request method failure captured: Oct 04 19:05:16.549140 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/505e8d54-138e-404a-a403-1bd5c9b0c4ab HTTP/1.1 Oct 04 19:05:16.549140 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 19:05:16.549140 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 19:05:16.549140 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 19:05:16.549140 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 19:05:16.549140 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 19:05:16.549140 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 19:05:16.549140 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 19:05:16.549140 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 19:05:16.549140 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPIKTu0CYodd3JNr0T_dqLqmM5ED44a2sXzLXn4Tuato5CJHy5CRxi3ts6IGLDJpM4QqBSnA228GKc5hBSnWBTkVxy6EW8_Vl8KjJOBGsg6WWuzVbcFk_iupBhylqy5x2iFraK0j5T8eGgoGngw9oxrK4u0Of_BW2b4XWZayVQjSR8Fg Oct 04 19:05:16.549140 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 19:05:16.549140 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 19:05:16.549140 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 19:05:16.549140 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 19:05:16.549140 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 19:05:16.549140 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 19:05:16.549140 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: d039c1953c26418d9a0b70444bc76a64 Oct 04 19:05:16.549140 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-TestServerBasicOps-1031939344 Oct 04 19:05:16.549140 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 19:05:16.549140 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 19:05:16.549140 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d039c1953c26418d9a0b70444bc76a64"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d039c1953c26418d9a0b70444bc76a64", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d039c1953c26418d9a0b70444bc76a64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d039c1953c26418d9a0b70444bc76a64"}]}] Oct 04 19:05:16.549140 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-TestServerBasicOps-1031939344 Oct 04 19:05:16.549140 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: d039c1953c26418d9a0b70444bc76a64 Oct 04 19:05:16.549140 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-TestServerBasicOps-1031939344 Oct 04 19:05:16.549140 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-TestServerBasicOps-1031939344-project Oct 04 19:05:16.549140 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 19:05:16.549140 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 19:05:16.549140 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: c07d8700f1d64a47b5f1b105178b60be Oct 04 19:05:16.549140 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-TestServerBasicOps-1031939344-project Oct 04 19:05:16.549140 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 19:05:16.549140 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 505e8d54-138e-404a-a403-1bd5c9b0c4ab could not be found. Oct 04 19:05:16.549140 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '505e8d54-138e-404a-a403-1bd5c9b0c4ab'} Oct 04 19:05:16.549140 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:05:16.549140 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:05:16.549140 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:05:16.549140 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:05:16.549140 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:05:16.549140 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:05:16.549140 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:05:16.549140 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:05:16.549140 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:05:16.549140 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:05:16.549140 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 505e8d54-138e-404a-a403-1bd5c9b0c4ab could not be found. Oct 04 19:05:16.549140 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:05:16.549140 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:05:16.549140 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:05:16.549140 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:05:16.549140 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:05:16.549140 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:05:16.549140 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:05:16.549140 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:05:16.549140 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:05:16.549140 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:05:16.549140 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:05:16.549140 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:05:16.549140 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:05:16.549140 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:05:16.549140 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:05:16.549140 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:05:16.549140 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 505e8d54-138e-404a-a403-1bd5c9b0c4ab could not be found. Oct 04 19:05:16.549140 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:05:16.549140 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:05:16.549140 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:05:16.552479 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:05:16.552479 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:05:16.552479 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:05:16.552479 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:05:16.552479 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:05:16.552479 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 505e8d54-138e-404a-a403-1bd5c9b0c4ab could not be found. Oct 04 19:05:16.552479 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:05:16.552479 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7fafa997-3cdf-4df9-9198-bbdfc3f29801 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Returning 404 to user: Instance 505e8d54-138e-404a-a403-1bd5c9b0c4ab could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:05:16.552479 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7fafa997-3cdf-4df9-9198-bbdfc3f29801 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] 10.222.0.20 "GET /compute/v2.1/servers/505e8d54-138e-404a-a403-1bd5c9b0c4ab" status: 404 len: 111 microversion: 2.1 time: 0.087892 Oct 04 19:05:16.555080 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3154/6333] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:16 2022] GET /compute/v2.1/servers/505e8d54-138e-404a-a403-1bd5c9b0c4ab => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 19:05:16.923965 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-82649fe9-db3b-460a-85c2-9ce2282841a0 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] Calling method '.version_select at 0x7fe259636a60>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:17.158083 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-82649fe9-db3b-460a-85c2-9ce2282841a0 tempest-TestServerBasicOps-1031939344 tempest-TestServerBasicOps-1031939344-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1216014711" status: 202 len: 0 microversion: 2.1 time: 0.240880 Oct 04 19:05:17.165960 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3180/6334] 10.222.0.20 () {58 vars in 1254 bytes} [Tue Oct 4 19:05:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1216014711 => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:05:17.288992 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-030d5b71-518d-464b-9a1a-0ed962f32e0b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:17.290244 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-030d5b71-518d-464b-9a1a-0ed962f32e0b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 0e957abd-68e7-48c3-af4b-74d570d41c15] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:17.304561 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-030d5b71-518d-464b-9a1a-0ed962f32e0b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:17.309930 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-030d5b71-518d-464b-9a1a-0ed962f32e0b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:17.313100 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-030d5b71-518d-464b-9a1a-0ed962f32e0b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:17.314264 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-030d5b71-518d-464b-9a1a-0ed962f32e0b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:17.315421 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-030d5b71-518d-464b-9a1a-0ed962f32e0b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:17.317080 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-030d5b71-518d-464b-9a1a-0ed962f32e0b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:17.429713 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f7090aa9-7aba-47a6-92f4-da55b442c13b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:17.430595 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f7090aa9-7aba-47a6-92f4-da55b442c13b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:17.456426 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f7090aa9-7aba-47a6-92f4-da55b442c13b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:17.475654 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f7090aa9-7aba-47a6-92f4-da55b442c13b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:17.486184 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f7090aa9-7aba-47a6-92f4-da55b442c13b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:17.511525 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f7090aa9-7aba-47a6-92f4-da55b442c13b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:17.512429 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f7090aa9-7aba-47a6-92f4-da55b442c13b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:17.516145 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f7090aa9-7aba-47a6-92f4-da55b442c13b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:17.734873 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-030d5b71-518d-464b-9a1a-0ed962f32e0b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:17.745055 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-030d5b71-518d-464b-9a1a-0ed962f32e0b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:17.746888 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-030d5b71-518d-464b-9a1a-0ed962f32e0b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:17.749211 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-030d5b71-518d-464b-9a1a-0ed962f32e0b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15" status: 200 len: 1741 microversion: 2.20 time: 0.464334 Oct 04 19:05:17.750064 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3155/6335] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:05:17 2022] GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15 => generated 1741 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 19:05:17.755610 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-dae15387-2b5e-4d24-b2a4-d72b28c561a1 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:17.758231 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-dae15387-2b5e-4d24-b2a4-d72b28c561a1 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: f8f9ee3a-1a3d-43b9-bdf1-8725457b6611] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:17.769255 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dae15387-2b5e-4d24-b2a4-d72b28c561a1 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:17.769255 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dae15387-2b5e-4d24-b2a4-d72b28c561a1 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:17.769255 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dae15387-2b5e-4d24-b2a4-d72b28c561a1 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:17.769255 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dae15387-2b5e-4d24-b2a4-d72b28c561a1 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:17.769255 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dae15387-2b5e-4d24-b2a4-d72b28c561a1 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:17.769255 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dae15387-2b5e-4d24-b2a4-d72b28c561a1 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:17.815881 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-dae15387-2b5e-4d24-b2a4-d72b28c561a1 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/f8f9ee3a-1a3d-43b9-bdf1-8725457b6611/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064173 Oct 04 19:05:17.817812 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3156/6336] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 19:05:17 2022] GET /compute/v2.1/servers/f8f9ee3a-1a3d-43b9-bdf1-8725457b6611/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:05:17.948032 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f7090aa9-7aba-47a6-92f4-da55b442c13b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:17.965825 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f7090aa9-7aba-47a6-92f4-da55b442c13b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed" status: 200 len: 1342 microversion: 2.1 time: 0.541501 Oct 04 19:05:17.970188 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3181/6337] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:17 2022] GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed => generated 1342 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:05:18.781565 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-49da8506-ff24-4615-8c7f-663ac5429b70 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:18.782213 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-49da8506-ff24-4615-8c7f-663ac5429b70 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 0e957abd-68e7-48c3-af4b-74d570d41c15] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:18.822965 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-49da8506-ff24-4615-8c7f-663ac5429b70 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:18.827750 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-49da8506-ff24-4615-8c7f-663ac5429b70 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:18.832379 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d0b4751b-0e40-4363-bca3-22f0ce524dfa tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:18.833793 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-49da8506-ff24-4615-8c7f-663ac5429b70 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:18.835678 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d0b4751b-0e40-4363-bca3-22f0ce524dfa tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: f8f9ee3a-1a3d-43b9-bdf1-8725457b6611] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:18.840817 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-49da8506-ff24-4615-8c7f-663ac5429b70 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:18.841384 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-49da8506-ff24-4615-8c7f-663ac5429b70 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:18.841866 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-49da8506-ff24-4615-8c7f-663ac5429b70 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:18.867207 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d0b4751b-0e40-4363-bca3-22f0ce524dfa tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:18.867979 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d0b4751b-0e40-4363-bca3-22f0ce524dfa tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:18.868580 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d0b4751b-0e40-4363-bca3-22f0ce524dfa tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:18.869606 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d0b4751b-0e40-4363-bca3-22f0ce524dfa tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:18.870216 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d0b4751b-0e40-4363-bca3-22f0ce524dfa tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:18.870750 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d0b4751b-0e40-4363-bca3-22f0ce524dfa tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:18.909518 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d0b4751b-0e40-4363-bca3-22f0ce524dfa tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/f8f9ee3a-1a3d-43b9-bdf1-8725457b6611/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082716 Oct 04 19:05:18.910461 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3182/6338] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 19:05:18 2022] GET /compute/v2.1/servers/f8f9ee3a-1a3d-43b9-bdf1-8725457b6611/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:05:18.996266 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ba092989-3528-455a-a8dd-cb80468d4b8b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:18.997184 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ba092989-3528-455a-a8dd-cb80468d4b8b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:19.010273 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ba092989-3528-455a-a8dd-cb80468d4b8b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:19.011291 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ba092989-3528-455a-a8dd-cb80468d4b8b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:19.012780 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ba092989-3528-455a-a8dd-cb80468d4b8b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:19.017043 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ba092989-3528-455a-a8dd-cb80468d4b8b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:19.017734 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ba092989-3528-455a-a8dd-cb80468d4b8b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:19.018418 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ba092989-3528-455a-a8dd-cb80468d4b8b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:19.340583 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-49da8506-ff24-4615-8c7f-663ac5429b70 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:19.352110 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-49da8506-ff24-4615-8c7f-663ac5429b70 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:19.354201 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-49da8506-ff24-4615-8c7f-663ac5429b70 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:19.355642 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-49da8506-ff24-4615-8c7f-663ac5429b70 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15" status: 200 len: 1741 microversion: 2.20 time: 0.579262 Oct 04 19:05:19.372548 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3157/6339] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:05:18 2022] GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15 => generated 1741 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:05:19.597640 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ba092989-3528-455a-a8dd-cb80468d4b8b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:19.616639 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ba092989-3528-455a-a8dd-cb80468d4b8b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed" status: 200 len: 1342 microversion: 2.1 time: 0.625629 Oct 04 19:05:19.621051 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3183/6340] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:18 2022] GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed => generated 1342 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:05:19.926999 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-df4eebd9-a800-46bb-ade2-cdc63c1bd872 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:19.931572 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-df4eebd9-a800-46bb-ade2-cdc63c1bd872 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: f8f9ee3a-1a3d-43b9-bdf1-8725457b6611] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:19.960092 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-df4eebd9-a800-46bb-ade2-cdc63c1bd872 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:19.966464 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-df4eebd9-a800-46bb-ade2-cdc63c1bd872 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:19.972450 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-df4eebd9-a800-46bb-ade2-cdc63c1bd872 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:19.974368 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-df4eebd9-a800-46bb-ade2-cdc63c1bd872 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:19.977513 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-df4eebd9-a800-46bb-ade2-cdc63c1bd872 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:19.979085 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-df4eebd9-a800-46bb-ade2-cdc63c1bd872 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:20.067765 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-df4eebd9-a800-46bb-ade2-cdc63c1bd872 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/f8f9ee3a-1a3d-43b9-bdf1-8725457b6611/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.148894 Oct 04 19:05:20.068865 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3158/6341] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 19:05:19 2022] GET /compute/v2.1/servers/f8f9ee3a-1a3d-43b9-bdf1-8725457b6611/os-volume_attachments => generated 197 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:05:20.403886 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c7a6dc24-4aae-4240-b253-e15e95e6ae3d tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:20.406023 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c7a6dc24-4aae-4240-b253-e15e95e6ae3d tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 0e957abd-68e7-48c3-af4b-74d570d41c15] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:20.432604 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c7a6dc24-4aae-4240-b253-e15e95e6ae3d tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:20.433345 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c7a6dc24-4aae-4240-b253-e15e95e6ae3d tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:20.434172 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c7a6dc24-4aae-4240-b253-e15e95e6ae3d tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:20.441191 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c7a6dc24-4aae-4240-b253-e15e95e6ae3d tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:20.442283 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c7a6dc24-4aae-4240-b253-e15e95e6ae3d tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:20.446100 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c7a6dc24-4aae-4240-b253-e15e95e6ae3d tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:20.646034 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5fe8eec2-d2fb-4aac-bdab-643d56fec2c8 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:20.647130 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5fe8eec2-d2fb-4aac-bdab-643d56fec2c8 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:20.655773 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5fe8eec2-d2fb-4aac-bdab-643d56fec2c8 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:20.657013 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5fe8eec2-d2fb-4aac-bdab-643d56fec2c8 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:20.657646 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5fe8eec2-d2fb-4aac-bdab-643d56fec2c8 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:20.658388 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5fe8eec2-d2fb-4aac-bdab-643d56fec2c8 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:20.659050 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5fe8eec2-d2fb-4aac-bdab-643d56fec2c8 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:20.659659 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5fe8eec2-d2fb-4aac-bdab-643d56fec2c8 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:20.818161 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c7a6dc24-4aae-4240-b253-e15e95e6ae3d tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:20.823968 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=98 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:05:20.842751 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c7a6dc24-4aae-4240-b253-e15e95e6ae3d tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:20.845723 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c7a6dc24-4aae-4240-b253-e15e95e6ae3d tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:20.847486 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c7a6dc24-4aae-4240-b253-e15e95e6ae3d tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15" status: 200 len: 1741 microversion: 2.20 time: 0.461846 Oct 04 19:05:20.864402 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3184/6342] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:05:20 2022] GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15 => generated 1741 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 19:05:20.913359 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5fe8eec2-d2fb-4aac-bdab-643d56fec2c8 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:20.925787 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5fe8eec2-d2fb-4aac-bdab-643d56fec2c8 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed" status: 200 len: 1342 microversion: 2.1 time: 0.283859 Oct 04 19:05:20.926457 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3159/6343] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:20 2022] GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed => generated 1342 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:05:21.083262 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-dad77c77-3ae1-4468-b884-5429aefeec03 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:21.086558 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-dad77c77-3ae1-4468-b884-5429aefeec03 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: f8f9ee3a-1a3d-43b9-bdf1-8725457b6611] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:21.099625 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dad77c77-3ae1-4468-b884-5429aefeec03 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:21.101684 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dad77c77-3ae1-4468-b884-5429aefeec03 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:21.102769 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dad77c77-3ae1-4468-b884-5429aefeec03 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:21.137211 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dad77c77-3ae1-4468-b884-5429aefeec03 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:21.137211 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dad77c77-3ae1-4468-b884-5429aefeec03 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:21.137211 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dad77c77-3ae1-4468-b884-5429aefeec03 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:21.210071 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-dad77c77-3ae1-4468-b884-5429aefeec03 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/f8f9ee3a-1a3d-43b9-bdf1-8725457b6611/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.131757 Oct 04 19:05:21.214278 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3185/6344] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 19:05:21 2022] GET /compute/v2.1/servers/f8f9ee3a-1a3d-43b9-bdf1-8725457b6611/os-volume_attachments => generated 197 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:05:21.880249 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-675cbdff-2e65-426e-88c7-8b7384ddc2b0 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:21.880883 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-675cbdff-2e65-426e-88c7-8b7384ddc2b0 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 0e957abd-68e7-48c3-af4b-74d570d41c15] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:21.884755 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:05:21.908199 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-675cbdff-2e65-426e-88c7-8b7384ddc2b0 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:21.909864 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-675cbdff-2e65-426e-88c7-8b7384ddc2b0 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:21.910595 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-675cbdff-2e65-426e-88c7-8b7384ddc2b0 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:21.914864 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-675cbdff-2e65-426e-88c7-8b7384ddc2b0 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:21.915617 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-675cbdff-2e65-426e-88c7-8b7384ddc2b0 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:21.916271 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-675cbdff-2e65-426e-88c7-8b7384ddc2b0 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:21.955847 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-786fada8-80d3-44c1-af28-7c3e60b79777 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:21.957077 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-786fada8-80d3-44c1-af28-7c3e60b79777 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:21.966815 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-786fada8-80d3-44c1-af28-7c3e60b79777 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:21.968783 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-786fada8-80d3-44c1-af28-7c3e60b79777 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:21.970338 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-786fada8-80d3-44c1-af28-7c3e60b79777 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:21.971095 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-786fada8-80d3-44c1-af28-7c3e60b79777 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:21.971565 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-786fada8-80d3-44c1-af28-7c3e60b79777 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:21.971995 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-786fada8-80d3-44c1-af28-7c3e60b79777 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:22.344415 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-675cbdff-2e65-426e-88c7-8b7384ddc2b0 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:22.354918 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-675cbdff-2e65-426e-88c7-8b7384ddc2b0 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:22.356438 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-675cbdff-2e65-426e-88c7-8b7384ddc2b0 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:22.357968 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-675cbdff-2e65-426e-88c7-8b7384ddc2b0 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15" status: 200 len: 1741 microversion: 2.20 time: 0.484574 Oct 04 19:05:22.367567 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3160/6345] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:05:21 2022] GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15 => generated 1741 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:05:22.385666 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ca838903-9afe-4aec-aa9d-c5a9622d9444 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:22.388554 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ca838903-9afe-4aec-aa9d-c5a9622d9444 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: f8f9ee3a-1a3d-43b9-bdf1-8725457b6611] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:22.407724 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ca838903-9afe-4aec-aa9d-c5a9622d9444 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:22.407724 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ca838903-9afe-4aec-aa9d-c5a9622d9444 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:22.413611 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ca838903-9afe-4aec-aa9d-c5a9622d9444 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:22.414590 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ca838903-9afe-4aec-aa9d-c5a9622d9444 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:22.415986 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ca838903-9afe-4aec-aa9d-c5a9622d9444 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:22.419842 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-786fada8-80d3-44c1-af28-7c3e60b79777 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:22.424445 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ca838903-9afe-4aec-aa9d-c5a9622d9444 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:22.434225 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-786fada8-80d3-44c1-af28-7c3e60b79777 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed" status: 200 len: 1342 microversion: 2.1 time: 0.483291 Oct 04 19:05:22.435325 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3186/6346] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:21 2022] GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed => generated 1342 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:05:22.466113 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ca838903-9afe-4aec-aa9d-c5a9622d9444 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/f8f9ee3a-1a3d-43b9-bdf1-8725457b6611/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.096620 Oct 04 19:05:22.467500 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3161/6347] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 19:05:22 2022] GET /compute/v2.1/servers/f8f9ee3a-1a3d-43b9-bdf1-8725457b6611/os-volume_attachments => generated 25 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 19:05:22.555084 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-73938559-7419-4970-a015-75f97c799b45 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:22.555705 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-73938559-7419-4970-a015-75f97c799b45 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: f8f9ee3a-1a3d-43b9-bdf1-8725457b6611] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:22.566525 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-73938559-7419-4970-a015-75f97c799b45 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:22.567460 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-73938559-7419-4970-a015-75f97c799b45 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:22.571391 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-73938559-7419-4970-a015-75f97c799b45 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:22.572601 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-73938559-7419-4970-a015-75f97c799b45 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:22.573506 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-73938559-7419-4970-a015-75f97c799b45 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:22.574189 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-73938559-7419-4970-a015-75f97c799b45 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:22.616835 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-73938559-7419-4970-a015-75f97c799b45 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: f8f9ee3a-1a3d-43b9-bdf1-8725457b6611] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:05:23.285569 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-73938559-7419-4970-a015-75f97c799b45 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f8f9ee3a-1a3d-43b9-bdf1-8725457b6611" status: 204 len: 0 microversion: 2.1 time: 0.731216 Oct 04 19:05:23.288689 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3187/6348] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 19:05:22 2022] DELETE /compute/v2.1/servers/f8f9ee3a-1a3d-43b9-bdf1-8725457b6611 => generated 0 bytes in 739 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:05:23.299088 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b4e3ec2e-9abc-4168-beeb-5c0c9499f385 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:23.300666 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b4e3ec2e-9abc-4168-beeb-5c0c9499f385 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: f8f9ee3a-1a3d-43b9-bdf1-8725457b6611] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:23.309704 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b4e3ec2e-9abc-4168-beeb-5c0c9499f385 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:23.311476 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b4e3ec2e-9abc-4168-beeb-5c0c9499f385 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:23.312988 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b4e3ec2e-9abc-4168-beeb-5c0c9499f385 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:23.313776 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b4e3ec2e-9abc-4168-beeb-5c0c9499f385 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:23.314468 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b4e3ec2e-9abc-4168-beeb-5c0c9499f385 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:23.315174 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b4e3ec2e-9abc-4168-beeb-5c0c9499f385 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:23.389961 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e0477445-21e5-4543-a9d8-8981f7996d79 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:23.390710 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e0477445-21e5-4543-a9d8-8981f7996d79 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 0e957abd-68e7-48c3-af4b-74d570d41c15] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:23.397513 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e0477445-21e5-4543-a9d8-8981f7996d79 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:23.398027 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e0477445-21e5-4543-a9d8-8981f7996d79 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:23.398740 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e0477445-21e5-4543-a9d8-8981f7996d79 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:23.399760 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e0477445-21e5-4543-a9d8-8981f7996d79 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:23.403430 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e0477445-21e5-4543-a9d8-8981f7996d79 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:23.404130 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e0477445-21e5-4543-a9d8-8981f7996d79 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:23.694350 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b4e3ec2e-9abc-4168-beeb-5c0c9499f385 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce441ded6f554ec28560c75de97af173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc67d8de57543c48bdf45669b684227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:23.713517 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e0477445-21e5-4543-a9d8-8981f7996d79 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:23.727786 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b4e3ec2e-9abc-4168-beeb-5c0c9499f385 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/f8f9ee3a-1a3d-43b9-bdf1-8725457b6611" status: 200 len: 1681 microversion: 2.1 time: 0.434164 Oct 04 19:05:23.731601 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e0477445-21e5-4543-a9d8-8981f7996d79 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:23.741921 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e0477445-21e5-4543-a9d8-8981f7996d79 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:23.743367 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e0477445-21e5-4543-a9d8-8981f7996d79 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15" status: 200 len: 1741 microversion: 2.20 time: 0.358372 Oct 04 19:05:23.748688 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3162/6349] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:23 2022] GET /compute/v2.1/servers/f8f9ee3a-1a3d-43b9-bdf1-8725457b6611 => generated 1681 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:23.755982 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3188/6350] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:05:23 2022] GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15 => generated 1741 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:05:23.757077 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d890f2c0-dc05-4bc1-9784-5a6021c6ba05 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:23.757077 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d890f2c0-dc05-4bc1-9784-5a6021c6ba05 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:23.771917 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d890f2c0-dc05-4bc1-9784-5a6021c6ba05 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:23.772492 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d890f2c0-dc05-4bc1-9784-5a6021c6ba05 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:23.772966 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d890f2c0-dc05-4bc1-9784-5a6021c6ba05 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:23.774030 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d890f2c0-dc05-4bc1-9784-5a6021c6ba05 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:23.774617 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d890f2c0-dc05-4bc1-9784-5a6021c6ba05 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:23.775272 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d890f2c0-dc05-4bc1-9784-5a6021c6ba05 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:24.085602 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d890f2c0-dc05-4bc1-9784-5a6021c6ba05 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:24.090123 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=100 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:05:24.101033 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d890f2c0-dc05-4bc1-9784-5a6021c6ba05 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed" status: 200 len: 1342 microversion: 2.1 time: 0.351848 Oct 04 19:05:24.102038 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3163/6351] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:23 2022] GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed => generated 1342 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:24.751085 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-04986bb1-1076-41fb-8698-5250aa4b4840 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:24.758727 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-04986bb1-1076-41fb-8698-5250aa4b4840 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: f8f9ee3a-1a3d-43b9-bdf1-8725457b6611] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:24.761472 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-04986bb1-1076-41fb-8698-5250aa4b4840 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:24.765016 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-04986bb1-1076-41fb-8698-5250aa4b4840 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:24.765575 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-04986bb1-1076-41fb-8698-5250aa4b4840 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:24.766498 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-04986bb1-1076-41fb-8698-5250aa4b4840 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:24.767039 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-04986bb1-1076-41fb-8698-5250aa4b4840 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:24.767568 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-04986bb1-1076-41fb-8698-5250aa4b4840 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:24.782773 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5ec63b5f-079f-41c1-8d30-e2a8967d3d10 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:24.783503 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5ec63b5f-079f-41c1-8d30-e2a8967d3d10 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 0e957abd-68e7-48c3-af4b-74d570d41c15] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:24.797358 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5ec63b5f-079f-41c1-8d30-e2a8967d3d10 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:24.801496 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5ec63b5f-079f-41c1-8d30-e2a8967d3d10 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:24.802080 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5ec63b5f-079f-41c1-8d30-e2a8967d3d10 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:24.803074 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5ec63b5f-079f-41c1-8d30-e2a8967d3d10 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:24.803777 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5ec63b5f-079f-41c1-8d30-e2a8967d3d10 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:24.804499 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5ec63b5f-079f-41c1-8d30-e2a8967d3d10 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:25.636923 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-04986bb1-1076-41fb-8698-5250aa4b4840 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce441ded6f554ec28560c75de97af173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc67d8de57543c48bdf45669b684227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:25.648851 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-04986bb1-1076-41fb-8698-5250aa4b4840 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/f8f9ee3a-1a3d-43b9-bdf1-8725457b6611" status: 200 len: 1681 microversion: 2.1 time: 0.899487 Oct 04 19:05:25.648851 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3189/6352] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:24 2022] GET /compute/v2.1/servers/f8f9ee3a-1a3d-43b9-bdf1-8725457b6611 => generated 1681 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:25.655697 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5ec63b5f-079f-41c1-8d30-e2a8967d3d10 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:25.677638 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5ec63b5f-079f-41c1-8d30-e2a8967d3d10 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:25.679670 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5ec63b5f-079f-41c1-8d30-e2a8967d3d10 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:25.681153 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5ec63b5f-079f-41c1-8d30-e2a8967d3d10 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15" status: 200 len: 1723 microversion: 2.20 time: 0.903590 Oct 04 19:05:25.682810 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3164/6353] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:05:24 2022] GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15 => generated 1723 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 19:05:25.697349 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6e8bf416-c994-4447-9b12-0a71efbd5f9e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:25.697997 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6e8bf416-c994-4447-9b12-0a71efbd5f9e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:25.705197 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6e8bf416-c994-4447-9b12-0a71efbd5f9e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:25.705700 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6e8bf416-c994-4447-9b12-0a71efbd5f9e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:25.709009 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6e8bf416-c994-4447-9b12-0a71efbd5f9e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:25.712808 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6e8bf416-c994-4447-9b12-0a71efbd5f9e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:25.712808 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6e8bf416-c994-4447-9b12-0a71efbd5f9e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:25.712808 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6e8bf416-c994-4447-9b12-0a71efbd5f9e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:26.092730 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6e8bf416-c994-4447-9b12-0a71efbd5f9e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:26.100643 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6e8bf416-c994-4447-9b12-0a71efbd5f9e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed" status: 200 len: 1342 microversion: 2.1 time: 0.434206 Oct 04 19:05:26.101316 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3190/6354] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:25 2022] GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed => generated 1342 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:26.784107 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8e8051ef-0726-4fa7-a9c8-8fefe351bf5a tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:26.784107 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8e8051ef-0726-4fa7-a9c8-8fefe351bf5a tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: f8f9ee3a-1a3d-43b9-bdf1-8725457b6611] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:26.784107 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8e8051ef-0726-4fa7-a9c8-8fefe351bf5a tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:26.784107 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8e8051ef-0726-4fa7-a9c8-8fefe351bf5a tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:26.784107 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8e8051ef-0726-4fa7-a9c8-8fefe351bf5a tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:26.784107 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8e8051ef-0726-4fa7-a9c8-8fefe351bf5a tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:26.784107 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8e8051ef-0726-4fa7-a9c8-8fefe351bf5a tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:26.784107 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8e8051ef-0726-4fa7-a9c8-8fefe351bf5a tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:26.791141 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-38d26f9f-fe5c-491f-8c78-54b2e913ffd4 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:26.791141 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-38d26f9f-fe5c-491f-8c78-54b2e913ffd4 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 0e957abd-68e7-48c3-af4b-74d570d41c15] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:26.791141 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-38d26f9f-fe5c-491f-8c78-54b2e913ffd4 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:26.791141 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-38d26f9f-fe5c-491f-8c78-54b2e913ffd4 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:26.791141 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-38d26f9f-fe5c-491f-8c78-54b2e913ffd4 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:26.791141 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-38d26f9f-fe5c-491f-8c78-54b2e913ffd4 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:26.791141 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-38d26f9f-fe5c-491f-8c78-54b2e913ffd4 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:26.791141 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-38d26f9f-fe5c-491f-8c78-54b2e913ffd4 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:26.863060 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8e8051ef-0726-4fa7-a9c8-8fefe351bf5a tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce441ded6f554ec28560c75de97af173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc67d8de57543c48bdf45669b684227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:26.873769 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8e8051ef-0726-4fa7-a9c8-8fefe351bf5a tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/f8f9ee3a-1a3d-43b9-bdf1-8725457b6611" status: 200 len: 1615 microversion: 2.1 time: 0.201152 Oct 04 19:05:26.875208 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3165/6355] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:26 2022] GET /compute/v2.1/servers/f8f9ee3a-1a3d-43b9-bdf1-8725457b6611 => generated 1615 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:27.096882 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-38d26f9f-fe5c-491f-8c78-54b2e913ffd4 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:27.106566 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-38d26f9f-fe5c-491f-8c78-54b2e913ffd4 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:27.109260 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-38d26f9f-fe5c-491f-8c78-54b2e913ffd4 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:27.110886 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-38d26f9f-fe5c-491f-8c78-54b2e913ffd4 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15" status: 200 len: 1723 microversion: 2.20 time: 0.404019 Oct 04 19:05:27.112159 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3191/6356] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:05:26 2022] GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15 => generated 1723 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 19:05:27.134921 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8f3e8aea-3753-4b4b-a8ef-96afecd95bd3 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:27.138156 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8f3e8aea-3753-4b4b-a8ef-96afecd95bd3 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:27.147794 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8f3e8aea-3753-4b4b-a8ef-96afecd95bd3 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:27.148359 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8f3e8aea-3753-4b4b-a8ef-96afecd95bd3 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:27.149177 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8f3e8aea-3753-4b4b-a8ef-96afecd95bd3 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:27.150338 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8f3e8aea-3753-4b4b-a8ef-96afecd95bd3 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:27.150976 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8f3e8aea-3753-4b4b-a8ef-96afecd95bd3 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:27.151577 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8f3e8aea-3753-4b4b-a8ef-96afecd95bd3 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:27.398855 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-c36a0c43-0440-44c5-8638-0dcf8650237c req-78133311-569c-4a54-ae96-8dc4cd1cf331 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8f9ee3a-1a3d-43b9-bdf1-8725457b6611", "name": "network-vif-deleted", "tag": "17457df1-6526-44cc-ab11-3633a315e869"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:05:27.416302 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-c36a0c43-0440-44c5-8638-0dcf8650237c req-78133311-569c-4a54-ae96-8dc4cd1cf331 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:27.422757 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-c36a0c43-0440-44c5-8638-0dcf8650237c req-78133311-569c-4a54-ae96-8dc4cd1cf331 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:27.428453 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-c36a0c43-0440-44c5-8638-0dcf8650237c req-78133311-569c-4a54-ae96-8dc4cd1cf331 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:27.454034 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-c36a0c43-0440-44c5-8638-0dcf8650237c req-78133311-569c-4a54-ae96-8dc4cd1cf331 service nova] Creating event network-vif-deleted:17457df1-6526-44cc-ab11-3633a315e869 for instance f8f9ee3a-1a3d-43b9-bdf1-8725457b6611 on n-h1-850501-14 Oct 04 19:05:27.471883 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-c36a0c43-0440-44c5-8638-0dcf8650237c req-78133311-569c-4a54-ae96-8dc4cd1cf331 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077067 Oct 04 19:05:27.473456 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3192/6357] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:05:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:05:27.636807 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8f3e8aea-3753-4b4b-a8ef-96afecd95bd3 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:27.644868 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8f3e8aea-3753-4b4b-a8ef-96afecd95bd3 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed" status: 200 len: 1342 microversion: 2.1 time: 0.524385 Oct 04 19:05:27.664853 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3166/6358] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:27 2022] GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed => generated 1342 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:27.716117 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-09e350b4-1b2e-4f16-a2ab-b1b3e9aef61c req-ba0b2ef5-ff98-4eb8-9f5e-52b186bc4ddf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e957abd-68e7-48c3-af4b-74d570d41c15", "name": "network-vif-unplugged", "status": "completed", "tag": "a324d908-a426-4333-ae46-4fc6e0230e67"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:05:27.751857 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-09e350b4-1b2e-4f16-a2ab-b1b3e9aef61c req-ba0b2ef5-ff98-4eb8-9f5e-52b186bc4ddf service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:27.752597 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-09e350b4-1b2e-4f16-a2ab-b1b3e9aef61c req-ba0b2ef5-ff98-4eb8-9f5e-52b186bc4ddf service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:27.753045 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-09e350b4-1b2e-4f16-a2ab-b1b3e9aef61c req-ba0b2ef5-ff98-4eb8-9f5e-52b186bc4ddf service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:27.796774 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-09e350b4-1b2e-4f16-a2ab-b1b3e9aef61c req-ba0b2ef5-ff98-4eb8-9f5e-52b186bc4ddf service nova] Creating event network-vif-unplugged:a324d908-a426-4333-ae46-4fc6e0230e67 for instance 0e957abd-68e7-48c3-af4b-74d570d41c15 on n-h2-850501-14 Oct 04 19:05:27.812014 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-09e350b4-1b2e-4f16-a2ab-b1b3e9aef61c req-ba0b2ef5-ff98-4eb8-9f5e-52b186bc4ddf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.097900 Oct 04 19:05:27.813398 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3193/6359] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:05:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:05:27.899359 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1d5f5d36-6fba-4286-af94-5823dedb67d5 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:27.900598 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1d5f5d36-6fba-4286-af94-5823dedb67d5 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: f8f9ee3a-1a3d-43b9-bdf1-8725457b6611] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:27.909276 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1d5f5d36-6fba-4286-af94-5823dedb67d5 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:27.910019 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1d5f5d36-6fba-4286-af94-5823dedb67d5 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:27.910625 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1d5f5d36-6fba-4286-af94-5823dedb67d5 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:27.911536 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1d5f5d36-6fba-4286-af94-5823dedb67d5 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:27.912414 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1d5f5d36-6fba-4286-af94-5823dedb67d5 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:27.913008 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1d5f5d36-6fba-4286-af94-5823dedb67d5 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:28.016982 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1d5f5d36-6fba-4286-af94-5823dedb67d5 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce441ded6f554ec28560c75de97af173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc67d8de57543c48bdf45669b684227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:28.027718 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1d5f5d36-6fba-4286-af94-5823dedb67d5 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/f8f9ee3a-1a3d-43b9-bdf1-8725457b6611" status: 200 len: 1327 microversion: 2.1 time: 0.132298 Oct 04 19:05:28.028342 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3167/6360] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:27 2022] GET /compute/v2.1/servers/f8f9ee3a-1a3d-43b9-bdf1-8725457b6611 => generated 1327 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:28.140181 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9419f7e4-5db9-4151-96c8-c1d4a51a5367 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:28.147015 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-9419f7e4-5db9-4151-96c8-c1d4a51a5367 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 0e957abd-68e7-48c3-af4b-74d570d41c15] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:28.161159 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9419f7e4-5db9-4151-96c8-c1d4a51a5367 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:28.167425 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9419f7e4-5db9-4151-96c8-c1d4a51a5367 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:28.171048 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9419f7e4-5db9-4151-96c8-c1d4a51a5367 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:28.172186 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9419f7e4-5db9-4151-96c8-c1d4a51a5367 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:28.172816 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9419f7e4-5db9-4151-96c8-c1d4a51a5367 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:28.175688 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9419f7e4-5db9-4151-96c8-c1d4a51a5367 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:28.472088 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9419f7e4-5db9-4151-96c8-c1d4a51a5367 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:28.524413 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9419f7e4-5db9-4151-96c8-c1d4a51a5367 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:28.526006 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9419f7e4-5db9-4151-96c8-c1d4a51a5367 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:28.533922 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9419f7e4-5db9-4151-96c8-c1d4a51a5367 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15" status: 200 len: 1726 microversion: 2.20 time: 0.392794 Oct 04 19:05:28.534555 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3194/6361] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:05:28 2022] GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15 => generated 1726 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:05:28.570829 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f71937dc-49c0-4013-8cb2-7fa9f5ccf5dd tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f7bfdd78-25a1-4e92-aaa1-2e508ee93482"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:05:28.577046 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f71937dc-49c0-4013-8cb2-7fa9f5ccf5dd tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 0e957abd-68e7-48c3-af4b-74d570d41c15] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:28.604545 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f71937dc-49c0-4013-8cb2-7fa9f5ccf5dd tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:28.604545 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f71937dc-49c0-4013-8cb2-7fa9f5ccf5dd tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:28.604545 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f71937dc-49c0-4013-8cb2-7fa9f5ccf5dd tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:28.604545 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f71937dc-49c0-4013-8cb2-7fa9f5ccf5dd tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:28.605160 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f71937dc-49c0-4013-8cb2-7fa9f5ccf5dd tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:28.606422 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f71937dc-49c0-4013-8cb2-7fa9f5ccf5dd tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:28.670923 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-315aa92e-d460-409a-a7d6-6114179e120c tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:28.671827 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-315aa92e-d460-409a-a7d6-6114179e120c tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:28.683929 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-315aa92e-d460-409a-a7d6-6114179e120c tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:28.684471 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-315aa92e-d460-409a-a7d6-6114179e120c tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:28.684910 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-315aa92e-d460-409a-a7d6-6114179e120c tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:28.686329 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-315aa92e-d460-409a-a7d6-6114179e120c tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:28.686984 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-315aa92e-d460-409a-a7d6-6114179e120c tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:28.687293 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-315aa92e-d460-409a-a7d6-6114179e120c tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:29.493483 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-315aa92e-d460-409a-a7d6-6114179e120c tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:29.502366 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-315aa92e-d460-409a-a7d6-6114179e120c tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed" status: 200 len: 1342 microversion: 2.1 time: 0.836155 Oct 04 19:05:29.502949 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3195/6362] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:28 2022] GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed => generated 1342 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:05:29.507821 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-91f8f868-6618-478d-8a2f-6f7d9ef0e323 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:29.513739 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-91f8f868-6618-478d-8a2f-6f7d9ef0e323 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: f8f9ee3a-1a3d-43b9-bdf1-8725457b6611] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:29.514667 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-91f8f868-6618-478d-8a2f-6f7d9ef0e323 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:29.515395 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-91f8f868-6618-478d-8a2f-6f7d9ef0e323 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:29.516101 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-91f8f868-6618-478d-8a2f-6f7d9ef0e323 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:29.517035 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-91f8f868-6618-478d-8a2f-6f7d9ef0e323 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:29.517738 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-91f8f868-6618-478d-8a2f-6f7d9ef0e323 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:29.518403 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-91f8f868-6618-478d-8a2f-6f7d9ef0e323 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:29.547050 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-91f8f868-6618-478d-8a2f-6f7d9ef0e323 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] HTTP exception thrown: Instance f8f9ee3a-1a3d-43b9-bdf1-8725457b6611 could not be found. Oct 04 19:05:29.549303 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-91f8f868-6618-478d-8a2f-6f7d9ef0e323 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Request method failure captured: Oct 04 19:05:29.549303 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/f8f9ee3a-1a3d-43b9-bdf1-8725457b6611 HTTP/1.1 Oct 04 19:05:29.549303 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 19:05:29.549303 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 19:05:29.549303 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 19:05:29.549303 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 19:05:29.549303 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 19:05:29.549303 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 19:05:29.549303 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 19:05:29.549303 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 19:05:29.549303 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPIIX_3DOcExv0tyjf74SMRRF0KoXtiJVCF7h65af0U3qLWvNf58dKqXrLellPdPVePIBHO4xx7DLTXsLA5NqBHQCEuDWqWqMr6VInyDk7lvTZQyuDvBxRCTYPpwhj6qdAHOfmE7y3qjml2L3OlgdXc8W6zK59OH-OYNHGwvWAJmEgQ4 Oct 04 19:05:29.549303 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 19:05:29.549303 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 19:05:29.549303 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 19:05:29.549303 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 19:05:29.549303 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 19:05:29.549303 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 19:05:29.549303 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 5dc67d8de57543c48bdf45669b684227 Oct 04 19:05:29.549303 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-AttachVolumeNegativeTest-715412502 Oct 04 19:05:29.549303 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 19:05:29.549303 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 19:05:29.549303 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5dc67d8de57543c48bdf45669b684227"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5dc67d8de57543c48bdf45669b684227", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5dc67d8de57543c48bdf45669b684227"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5dc67d8de57543c48bdf45669b684227"}]}] Oct 04 19:05:29.549303 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-AttachVolumeNegativeTest-715412502 Oct 04 19:05:29.549303 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 5dc67d8de57543c48bdf45669b684227 Oct 04 19:05:29.549303 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-715412502 Oct 04 19:05:29.549303 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-AttachVolumeNegativeTest-715412502-project Oct 04 19:05:29.549303 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 19:05:29.549303 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 19:05:29.549303 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: ce441ded6f554ec28560c75de97af173 Oct 04 19:05:29.549303 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-AttachVolumeNegativeTest-715412502-project Oct 04 19:05:29.549303 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 19:05:29.549303 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance f8f9ee3a-1a3d-43b9-bdf1-8725457b6611 could not be found. Oct 04 19:05:29.549303 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': 'f8f9ee3a-1a3d-43b9-bdf1-8725457b6611'} Oct 04 19:05:29.549303 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:05:29.549303 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:05:29.549303 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:05:29.549303 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:05:29.549303 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:05:29.549303 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:05:29.549303 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:05:29.549303 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:05:29.549303 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:05:29.549303 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:05:29.549303 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8f9ee3a-1a3d-43b9-bdf1-8725457b6611 could not be found. Oct 04 19:05:29.549303 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:05:29.549303 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:05:29.549303 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:05:29.549303 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:05:29.549303 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:05:29.549303 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:05:29.549303 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:05:29.549303 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:05:29.549303 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:05:29.549303 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:05:29.549303 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:05:29.549303 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:05:29.549303 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:05:29.549303 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:05:29.549303 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:05:29.549303 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:05:29.549303 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8f9ee3a-1a3d-43b9-bdf1-8725457b6611 could not be found. Oct 04 19:05:29.549303 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:05:29.549303 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:05:29.549303 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:05:29.557575 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:05:29.557575 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:05:29.557575 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:05:29.557575 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:05:29.557575 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:05:29.557575 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8f9ee3a-1a3d-43b9-bdf1-8725457b6611 could not be found. Oct 04 19:05:29.557575 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:05:29.557575 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-91f8f868-6618-478d-8a2f-6f7d9ef0e323 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Returning 404 to user: Instance f8f9ee3a-1a3d-43b9-bdf1-8725457b6611 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:05:29.557575 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-91f8f868-6618-478d-8a2f-6f7d9ef0e323 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/f8f9ee3a-1a3d-43b9-bdf1-8725457b6611" status: 404 len: 111 microversion: 2.1 time: 0.049973 Oct 04 19:05:29.568156 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3196/6363] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:29 2022] GET /compute/v2.1/servers/f8f9ee3a-1a3d-43b9-bdf1-8725457b6611 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:05:29.575128 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-96783617-8f54-479c-bb69-4808398cad5e tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '.version_select at 0x7fe2581a9d30>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:29.779250 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-96783617-8f54-479c-bb69-4808398cad5e tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1744721298" status: 202 len: 0 microversion: 2.1 time: 0.209526 Oct 04 19:05:29.785785 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3197/6364] 10.222.0.20 () {58 vars in 1221 bytes} [Tue Oct 4 19:05:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1744721298 => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:05:30.536508 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-586a5e87-ae70-46e5-a555-363b61034b0f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:30.536508 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-586a5e87-ae70-46e5-a555-363b61034b0f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:30.541792 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-586a5e87-ae70-46e5-a555-363b61034b0f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:30.542636 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-586a5e87-ae70-46e5-a555-363b61034b0f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:30.543092 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-586a5e87-ae70-46e5-a555-363b61034b0f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:30.543888 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-586a5e87-ae70-46e5-a555-363b61034b0f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:30.544496 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-586a5e87-ae70-46e5-a555-363b61034b0f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:30.546458 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-586a5e87-ae70-46e5-a555-363b61034b0f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:30.674488 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f71937dc-49c0-4013-8cb2-7fa9f5ccf5dd tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "POST /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 2.108002 Oct 04 19:05:30.682286 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3168/6365] 10.222.0.20 () {62 vars in 1364 bytes} [Tue Oct 4 19:05:28 2022] POST /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15/os-volume_attachments => generated 188 bytes in 2110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 19:05:30.880496 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6ce1db8a-52af-47f1-8564-32084104d167 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:30.882765 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-6ce1db8a-52af-47f1-8564-32084104d167 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 0e957abd-68e7-48c3-af4b-74d570d41c15] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:30.887472 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6ce1db8a-52af-47f1-8564-32084104d167 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:30.887984 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6ce1db8a-52af-47f1-8564-32084104d167 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:30.893590 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6ce1db8a-52af-47f1-8564-32084104d167 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:30.894351 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6ce1db8a-52af-47f1-8564-32084104d167 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:30.894886 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6ce1db8a-52af-47f1-8564-32084104d167 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:30.895338 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6ce1db8a-52af-47f1-8564-32084104d167 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:30.910848 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-586a5e87-ae70-46e5-a555-363b61034b0f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:30.925077 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-586a5e87-ae70-46e5-a555-363b61034b0f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed" status: 200 len: 1342 microversion: 2.1 time: 0.401668 Oct 04 19:05:30.926214 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3198/6366] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:30 2022] GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed => generated 1342 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:05:31.863452 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6ce1db8a-52af-47f1-8564-32084104d167 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15/os-volume_attachments/f7bfdd78-25a1-4e92-aaa1-2e508ee93482" status: 202 len: 0 microversion: 2.20 time: 0.986861 Oct 04 19:05:31.864107 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3169/6367] 10.222.0.20 () {60 vars in 1457 bytes} [Tue Oct 4 19:05:30 2022] DELETE /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15/os-volume_attachments/f7bfdd78-25a1-4e92-aaa1-2e508ee93482 => generated 0 bytes in 989 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 04 19:05:31.956495 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0ff90e91-4e30-4fef-b41f-311982b36b2e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:31.957948 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0ff90e91-4e30-4fef-b41f-311982b36b2e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:31.976150 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:05:31.976150 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0ff90e91-4e30-4fef-b41f-311982b36b2e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:31.976150 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0ff90e91-4e30-4fef-b41f-311982b36b2e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:31.976150 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0ff90e91-4e30-4fef-b41f-311982b36b2e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:31.976150 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0ff90e91-4e30-4fef-b41f-311982b36b2e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:31.976150 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0ff90e91-4e30-4fef-b41f-311982b36b2e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:31.976150 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0ff90e91-4e30-4fef-b41f-311982b36b2e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:31.985595 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a537bd61-d44b-4d4f-85db-7d1e74c17efe tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:05:31.986314 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a537bd61-d44b-4d4f-85db-7d1e74c17efe tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 0e957abd-68e7-48c3-af4b-74d570d41c15] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:31.993471 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a537bd61-d44b-4d4f-85db-7d1e74c17efe tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:31.993982 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a537bd61-d44b-4d4f-85db-7d1e74c17efe tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:31.994443 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a537bd61-d44b-4d4f-85db-7d1e74c17efe tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:31.995174 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a537bd61-d44b-4d4f-85db-7d1e74c17efe tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:31.995650 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a537bd61-d44b-4d4f-85db-7d1e74c17efe tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:31.996154 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a537bd61-d44b-4d4f-85db-7d1e74c17efe tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:32.085219 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a537bd61-d44b-4d4f-85db-7d1e74c17efe tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 0e957abd-68e7-48c3-af4b-74d570d41c15] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=123002) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 19:05:32.191101 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0ff90e91-4e30-4fef-b41f-311982b36b2e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:32.199964 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0ff90e91-4e30-4fef-b41f-311982b36b2e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed" status: 200 len: 1342 microversion: 2.1 time: 0.249224 Oct 04 19:05:32.203798 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3199/6368] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:31 2022] GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed => generated 1342 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:32.556329 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a537bd61-d44b-4d4f-85db-7d1e74c17efe tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "POST /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15/action" status: 202 len: 0 microversion: 2.20 time: 0.576695 Oct 04 19:05:32.557822 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3170/6369] 10.222.0.20 () {62 vars in 1319 bytes} [Tue Oct 4 19:05:31 2022] POST /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15/action => generated 0 bytes in 579 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:05:32.566929 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c8b8c053-a00e-4382-8c4c-c2d8464561f2 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:32.567923 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c8b8c053-a00e-4382-8c4c-c2d8464561f2 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 0e957abd-68e7-48c3-af4b-74d570d41c15] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:32.577666 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c8b8c053-a00e-4382-8c4c-c2d8464561f2 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:32.578175 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c8b8c053-a00e-4382-8c4c-c2d8464561f2 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:32.578672 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c8b8c053-a00e-4382-8c4c-c2d8464561f2 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:32.579509 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c8b8c053-a00e-4382-8c4c-c2d8464561f2 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:32.579908 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c8b8c053-a00e-4382-8c4c-c2d8464561f2 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:32.580521 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c8b8c053-a00e-4382-8c4c-c2d8464561f2 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:32.821050 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c8b8c053-a00e-4382-8c4c-c2d8464561f2 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:32.832962 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c8b8c053-a00e-4382-8c4c-c2d8464561f2 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:32.836095 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c8b8c053-a00e-4382-8c4c-c2d8464561f2 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:32.837427 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c8b8c053-a00e-4382-8c4c-c2d8464561f2 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15" status: 200 len: 1674 microversion: 2.20 time: 0.275342 Oct 04 19:05:32.838592 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3200/6370] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:05:32 2022] GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15 => generated 1674 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:05:33.228676 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ffd88eb2-81d2-4b27-b0c9-87e56f78ff8f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:33.232859 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ffd88eb2-81d2-4b27-b0c9-87e56f78ff8f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:33.242285 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ffd88eb2-81d2-4b27-b0c9-87e56f78ff8f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:33.242937 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ffd88eb2-81d2-4b27-b0c9-87e56f78ff8f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:33.243403 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ffd88eb2-81d2-4b27-b0c9-87e56f78ff8f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:33.244192 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ffd88eb2-81d2-4b27-b0c9-87e56f78ff8f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:33.244679 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ffd88eb2-81d2-4b27-b0c9-87e56f78ff8f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:33.245127 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ffd88eb2-81d2-4b27-b0c9-87e56f78ff8f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:33.401870 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ffd88eb2-81d2-4b27-b0c9-87e56f78ff8f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:33.410831 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ffd88eb2-81d2-4b27-b0c9-87e56f78ff8f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed" status: 200 len: 1342 microversion: 2.1 time: 0.186678 Oct 04 19:05:33.415307 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3171/6371] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:33 2022] GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed => generated 1342 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:05:33.868262 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0daadd39-0050-4d1c-b1fe-d97c89375bf3 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:33.869333 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0daadd39-0050-4d1c-b1fe-d97c89375bf3 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 0e957abd-68e7-48c3-af4b-74d570d41c15] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:33.883449 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0daadd39-0050-4d1c-b1fe-d97c89375bf3 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:33.884707 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0daadd39-0050-4d1c-b1fe-d97c89375bf3 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:33.885890 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0daadd39-0050-4d1c-b1fe-d97c89375bf3 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:33.886885 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0daadd39-0050-4d1c-b1fe-d97c89375bf3 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:33.887493 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0daadd39-0050-4d1c-b1fe-d97c89375bf3 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:33.887944 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0daadd39-0050-4d1c-b1fe-d97c89375bf3 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:34.079719 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0daadd39-0050-4d1c-b1fe-d97c89375bf3 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:34.109372 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0daadd39-0050-4d1c-b1fe-d97c89375bf3 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:34.115503 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0daadd39-0050-4d1c-b1fe-d97c89375bf3 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:34.118258 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0daadd39-0050-4d1c-b1fe-d97c89375bf3 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15" status: 200 len: 1674 microversion: 2.20 time: 0.254149 Oct 04 19:05:34.126970 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3201/6372] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:05:33 2022] GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15 => generated 1674 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:05:34.437741 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-fa90c654-c477-4f5f-8c27-3e7dfc32d410 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:34.441366 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-fa90c654-c477-4f5f-8c27-3e7dfc32d410 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:34.454882 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fa90c654-c477-4f5f-8c27-3e7dfc32d410 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:34.456366 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fa90c654-c477-4f5f-8c27-3e7dfc32d410 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:34.457631 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fa90c654-c477-4f5f-8c27-3e7dfc32d410 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:34.459883 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fa90c654-c477-4f5f-8c27-3e7dfc32d410 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:34.460757 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fa90c654-c477-4f5f-8c27-3e7dfc32d410 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:34.462312 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fa90c654-c477-4f5f-8c27-3e7dfc32d410 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:34.723102 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-fa90c654-c477-4f5f-8c27-3e7dfc32d410 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:34.742586 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-fa90c654-c477-4f5f-8c27-3e7dfc32d410 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed" status: 200 len: 1342 microversion: 2.1 time: 0.312052 Oct 04 19:05:34.746796 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3172/6373] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:34 2022] GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed => generated 1342 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:05:35.148184 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a193cee0-50bb-49e0-af78-e625f7daab9f tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:35.156929 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a193cee0-50bb-49e0-af78-e625f7daab9f tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 0e957abd-68e7-48c3-af4b-74d570d41c15] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:35.177757 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a193cee0-50bb-49e0-af78-e625f7daab9f tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:35.178393 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a193cee0-50bb-49e0-af78-e625f7daab9f tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:35.179087 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a193cee0-50bb-49e0-af78-e625f7daab9f tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:35.180213 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a193cee0-50bb-49e0-af78-e625f7daab9f tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:35.181318 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a193cee0-50bb-49e0-af78-e625f7daab9f tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:35.181954 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a193cee0-50bb-49e0-af78-e625f7daab9f tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:35.366824 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a193cee0-50bb-49e0-af78-e625f7daab9f tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:35.369597 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:05:35.380318 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a193cee0-50bb-49e0-af78-e625f7daab9f tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:35.393108 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a193cee0-50bb-49e0-af78-e625f7daab9f tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:35.398006 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a193cee0-50bb-49e0-af78-e625f7daab9f tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15" status: 200 len: 1674 microversion: 2.20 time: 0.254918 Oct 04 19:05:35.399358 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3202/6374] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:05:35 2022] GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15 => generated 1674 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:05:35.772919 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-79874198-6818-4be3-8fcf-3e9bdff630e5 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:35.773744 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-79874198-6818-4be3-8fcf-3e9bdff630e5 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:35.783771 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-79874198-6818-4be3-8fcf-3e9bdff630e5 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:35.784359 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-79874198-6818-4be3-8fcf-3e9bdff630e5 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:35.784850 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-79874198-6818-4be3-8fcf-3e9bdff630e5 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:35.785823 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-79874198-6818-4be3-8fcf-3e9bdff630e5 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:35.786498 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-79874198-6818-4be3-8fcf-3e9bdff630e5 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:35.787290 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-79874198-6818-4be3-8fcf-3e9bdff630e5 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:36.017150 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-79874198-6818-4be3-8fcf-3e9bdff630e5 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:36.029479 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-79874198-6818-4be3-8fcf-3e9bdff630e5 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed" status: 200 len: 1342 microversion: 2.1 time: 0.261633 Oct 04 19:05:36.038661 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3173/6375] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:35 2022] GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed => generated 1342 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:36.236596 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b06464f3-e0e0-4800-b341-5db7b5aa9f65 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:36.238398 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b06464f3-e0e0-4800-b341-5db7b5aa9f65 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: f8f9ee3a-1a3d-43b9-bdf1-8725457b6611] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:36.251650 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b06464f3-e0e0-4800-b341-5db7b5aa9f65 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:36.252182 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b06464f3-e0e0-4800-b341-5db7b5aa9f65 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:36.252638 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b06464f3-e0e0-4800-b341-5db7b5aa9f65 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:36.254126 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b06464f3-e0e0-4800-b341-5db7b5aa9f65 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:36.254781 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b06464f3-e0e0-4800-b341-5db7b5aa9f65 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:36.255217 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b06464f3-e0e0-4800-b341-5db7b5aa9f65 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:36.274152 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-b06464f3-e0e0-4800-b341-5db7b5aa9f65 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] HTTP exception thrown: Instance f8f9ee3a-1a3d-43b9-bdf1-8725457b6611 could not be found. Oct 04 19:05:36.275988 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b06464f3-e0e0-4800-b341-5db7b5aa9f65 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Request method failure captured: Oct 04 19:05:36.275988 n-d-850501-14 devstack@n-api.service[123001]: request: DELETE /compute/v2.1/servers/f8f9ee3a-1a3d-43b9-bdf1-8725457b6611 HTTP/1.1 Oct 04 19:05:36.275988 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 19:05:36.275988 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 19:05:36.275988 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 19:05:36.275988 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 19:05:36.275988 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 19:05:36.275988 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 19:05:36.275988 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 19:05:36.275988 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 19:05:36.275988 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPIIX_3DOcExv0tyjf74SMRRF0KoXtiJVCF7h65af0U3qLWvNf58dKqXrLellPdPVePIBHO4xx7DLTXsLA5NqBHQCEuDWqWqMr6VInyDk7lvTZQyuDvBxRCTYPpwhj6qdAHOfmE7y3qjml2L3OlgdXc8W6zK59OH-OYNHGwvWAJmEgQ4 Oct 04 19:05:36.275988 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 19:05:36.275988 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 19:05:36.275988 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 19:05:36.275988 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 19:05:36.275988 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 19:05:36.275988 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 19:05:36.275988 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 5dc67d8de57543c48bdf45669b684227 Oct 04 19:05:36.275988 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-AttachVolumeNegativeTest-715412502 Oct 04 19:05:36.275988 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 19:05:36.275988 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 19:05:36.275988 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5dc67d8de57543c48bdf45669b684227"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5dc67d8de57543c48bdf45669b684227", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5dc67d8de57543c48bdf45669b684227"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5dc67d8de57543c48bdf45669b684227"}]}] Oct 04 19:05:36.275988 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-AttachVolumeNegativeTest-715412502 Oct 04 19:05:36.275988 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 5dc67d8de57543c48bdf45669b684227 Oct 04 19:05:36.275988 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-715412502 Oct 04 19:05:36.275988 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-AttachVolumeNegativeTest-715412502-project Oct 04 19:05:36.275988 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 19:05:36.275988 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 19:05:36.275988 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: ce441ded6f554ec28560c75de97af173 Oct 04 19:05:36.275988 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-AttachVolumeNegativeTest-715412502-project Oct 04 19:05:36.275988 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 19:05:36.275988 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance f8f9ee3a-1a3d-43b9-bdf1-8725457b6611 could not be found. Oct 04 19:05:36.275988 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': 'f8f9ee3a-1a3d-43b9-bdf1-8725457b6611'} Oct 04 19:05:36.275988 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:05:36.275988 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:05:36.275988 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:05:36.275988 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:05:36.275988 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:05:36.275988 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:05:36.275988 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:05:36.275988 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:05:36.275988 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:05:36.275988 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:05:36.275988 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8f9ee3a-1a3d-43b9-bdf1-8725457b6611 could not be found. Oct 04 19:05:36.275988 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:05:36.275988 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:05:36.275988 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:05:36.275988 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:05:36.275988 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:05:36.275988 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:05:36.275988 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:05:36.275988 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:05:36.275988 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:05:36.275988 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:05:36.275988 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 19:05:36.275988 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 19:05:36.275988 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 19:05:36.275988 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 19:05:36.275988 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:05:36.275988 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:05:36.275988 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:05:36.275988 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:05:36.279554 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8f9ee3a-1a3d-43b9-bdf1-8725457b6611 could not be found. Oct 04 19:05:36.279554 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:05:36.279554 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:05:36.279554 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:05:36.279554 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:05:36.279554 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:05:36.279554 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:05:36.279554 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:05:36.279554 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:05:36.279554 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8f9ee3a-1a3d-43b9-bdf1-8725457b6611 could not be found. Oct 04 19:05:36.279554 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:05:36.279554 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b06464f3-e0e0-4800-b341-5db7b5aa9f65 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Returning 404 to user: Instance f8f9ee3a-1a3d-43b9-bdf1-8725457b6611 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:05:36.279554 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b06464f3-e0e0-4800-b341-5db7b5aa9f65 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f8f9ee3a-1a3d-43b9-bdf1-8725457b6611" status: 404 len: 111 microversion: 2.1 time: 0.049934 Oct 04 19:05:36.279554 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3203/6376] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 19:05:36 2022] DELETE /compute/v2.1/servers/f8f9ee3a-1a3d-43b9-bdf1-8725457b6611 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:05:36.287065 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b3166ebc-84d6-4c6a-b734-042d1a3b2bb6 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:36.287683 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b3166ebc-84d6-4c6a-b734-042d1a3b2bb6 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: f8f9ee3a-1a3d-43b9-bdf1-8725457b6611] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:36.294376 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b3166ebc-84d6-4c6a-b734-042d1a3b2bb6 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:36.295423 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b3166ebc-84d6-4c6a-b734-042d1a3b2bb6 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:36.296100 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b3166ebc-84d6-4c6a-b734-042d1a3b2bb6 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:36.296968 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b3166ebc-84d6-4c6a-b734-042d1a3b2bb6 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:36.297580 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b3166ebc-84d6-4c6a-b734-042d1a3b2bb6 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:36.298164 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b3166ebc-84d6-4c6a-b734-042d1a3b2bb6 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:36.314976 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-b3166ebc-84d6-4c6a-b734-042d1a3b2bb6 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] HTTP exception thrown: Instance f8f9ee3a-1a3d-43b9-bdf1-8725457b6611 could not be found. Oct 04 19:05:36.316604 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b3166ebc-84d6-4c6a-b734-042d1a3b2bb6 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Request method failure captured: Oct 04 19:05:36.316604 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/f8f9ee3a-1a3d-43b9-bdf1-8725457b6611 HTTP/1.1 Oct 04 19:05:36.316604 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 19:05:36.316604 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 19:05:36.316604 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 19:05:36.316604 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 19:05:36.316604 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 19:05:36.316604 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 19:05:36.316604 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 19:05:36.316604 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 19:05:36.316604 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPIIX_3DOcExv0tyjf74SMRRF0KoXtiJVCF7h65af0U3qLWvNf58dKqXrLellPdPVePIBHO4xx7DLTXsLA5NqBHQCEuDWqWqMr6VInyDk7lvTZQyuDvBxRCTYPpwhj6qdAHOfmE7y3qjml2L3OlgdXc8W6zK59OH-OYNHGwvWAJmEgQ4 Oct 04 19:05:36.316604 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 19:05:36.316604 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 19:05:36.316604 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 19:05:36.316604 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 19:05:36.316604 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 19:05:36.316604 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 19:05:36.316604 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 5dc67d8de57543c48bdf45669b684227 Oct 04 19:05:36.316604 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-AttachVolumeNegativeTest-715412502 Oct 04 19:05:36.316604 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 19:05:36.316604 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 19:05:36.316604 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5dc67d8de57543c48bdf45669b684227"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5dc67d8de57543c48bdf45669b684227", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5dc67d8de57543c48bdf45669b684227"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5dc67d8de57543c48bdf45669b684227"}]}] Oct 04 19:05:36.316604 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-AttachVolumeNegativeTest-715412502 Oct 04 19:05:36.316604 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 5dc67d8de57543c48bdf45669b684227 Oct 04 19:05:36.316604 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-715412502 Oct 04 19:05:36.316604 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-AttachVolumeNegativeTest-715412502-project Oct 04 19:05:36.316604 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 19:05:36.316604 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 19:05:36.316604 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: ce441ded6f554ec28560c75de97af173 Oct 04 19:05:36.316604 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-AttachVolumeNegativeTest-715412502-project Oct 04 19:05:36.316604 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 19:05:36.316604 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance f8f9ee3a-1a3d-43b9-bdf1-8725457b6611 could not be found. Oct 04 19:05:36.316604 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'f8f9ee3a-1a3d-43b9-bdf1-8725457b6611'} Oct 04 19:05:36.316604 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:05:36.316604 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:05:36.316604 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:05:36.316604 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:05:36.316604 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:05:36.316604 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:05:36.316604 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:05:36.316604 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:05:36.316604 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:05:36.316604 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:05:36.316604 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8f9ee3a-1a3d-43b9-bdf1-8725457b6611 could not be found. Oct 04 19:05:36.316604 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:05:36.316604 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:05:36.316604 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:05:36.316604 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:05:36.316604 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:05:36.316604 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:05:36.316604 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:05:36.316604 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:05:36.316604 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:05:36.316604 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:05:36.316604 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:05:36.316604 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:05:36.316604 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:05:36.316604 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:05:36.316604 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:05:36.316604 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:05:36.316604 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8f9ee3a-1a3d-43b9-bdf1-8725457b6611 could not be found. Oct 04 19:05:36.316604 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:05:36.316604 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:05:36.316604 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:05:36.320258 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:05:36.320258 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:05:36.320258 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:05:36.320258 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:05:36.320258 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:05:36.320258 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8f9ee3a-1a3d-43b9-bdf1-8725457b6611 could not be found. Oct 04 19:05:36.320258 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:05:36.320258 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b3166ebc-84d6-4c6a-b734-042d1a3b2bb6 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Returning 404 to user: Instance f8f9ee3a-1a3d-43b9-bdf1-8725457b6611 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:05:36.320258 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b3166ebc-84d6-4c6a-b734-042d1a3b2bb6 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/f8f9ee3a-1a3d-43b9-bdf1-8725457b6611" status: 404 len: 111 microversion: 2.1 time: 0.035070 Oct 04 19:05:36.320258 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3174/6377] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:36 2022] GET /compute/v2.1/servers/f8f9ee3a-1a3d-43b9-bdf1-8725457b6611 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 19:05:36.426737 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d0a6fb28-caf3-46d7-a2c7-87f56f77c7d8 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:36.427919 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d0a6fb28-caf3-46d7-a2c7-87f56f77c7d8 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 0e957abd-68e7-48c3-af4b-74d570d41c15] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:36.435992 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d0a6fb28-caf3-46d7-a2c7-87f56f77c7d8 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:36.437099 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d0a6fb28-caf3-46d7-a2c7-87f56f77c7d8 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:36.437774 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d0a6fb28-caf3-46d7-a2c7-87f56f77c7d8 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:36.438917 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d0a6fb28-caf3-46d7-a2c7-87f56f77c7d8 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:36.439927 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d0a6fb28-caf3-46d7-a2c7-87f56f77c7d8 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:36.440618 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d0a6fb28-caf3-46d7-a2c7-87f56f77c7d8 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:36.700715 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d0a6fb28-caf3-46d7-a2c7-87f56f77c7d8 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:36.713344 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d0a6fb28-caf3-46d7-a2c7-87f56f77c7d8 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:36.714932 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d0a6fb28-caf3-46d7-a2c7-87f56f77c7d8 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:36.716318 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d0a6fb28-caf3-46d7-a2c7-87f56f77c7d8 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15" status: 200 len: 1732 microversion: 2.20 time: 0.293599 Oct 04 19:05:36.717774 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3204/6378] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:05:36 2022] GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15 => generated 1732 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:05:37.059474 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-883fd2e9-955b-467e-92e7-008901a817c5 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:37.109556 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-883fd2e9-955b-467e-92e7-008901a817c5 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:37.109556 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-883fd2e9-955b-467e-92e7-008901a817c5 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:37.109556 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-883fd2e9-955b-467e-92e7-008901a817c5 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:37.109556 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-883fd2e9-955b-467e-92e7-008901a817c5 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:37.109556 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-883fd2e9-955b-467e-92e7-008901a817c5 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:37.109556 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-883fd2e9-955b-467e-92e7-008901a817c5 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:37.109556 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-883fd2e9-955b-467e-92e7-008901a817c5 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:37.109556 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=85,nova_cell1:INSERT=6,nova_cell1:UPDATE=9 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:05:37.356939 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-883fd2e9-955b-467e-92e7-008901a817c5 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:37.369444 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-883fd2e9-955b-467e-92e7-008901a817c5 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed" status: 200 len: 1342 microversion: 2.1 time: 0.312873 Oct 04 19:05:37.386632 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3175/6379] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:37 2022] GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed => generated 1342 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:37.743908 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0e4eca16-fa7c-422f-aeca-4d5ff78f9311 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:37.744787 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0e4eca16-fa7c-422f-aeca-4d5ff78f9311 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 0e957abd-68e7-48c3-af4b-74d570d41c15] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:37.756804 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0e4eca16-fa7c-422f-aeca-4d5ff78f9311 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:37.757762 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0e4eca16-fa7c-422f-aeca-4d5ff78f9311 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:37.758953 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0e4eca16-fa7c-422f-aeca-4d5ff78f9311 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:37.760210 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0e4eca16-fa7c-422f-aeca-4d5ff78f9311 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:37.760896 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0e4eca16-fa7c-422f-aeca-4d5ff78f9311 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:37.761602 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0e4eca16-fa7c-422f-aeca-4d5ff78f9311 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:37.939652 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0e4eca16-fa7c-422f-aeca-4d5ff78f9311 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:37.943516 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0e4eca16-fa7c-422f-aeca-4d5ff78f9311 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:37.945005 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0e4eca16-fa7c-422f-aeca-4d5ff78f9311 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:37.946355 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0e4eca16-fa7c-422f-aeca-4d5ff78f9311 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15" status: 200 len: 1732 microversion: 2.20 time: 0.206812 Oct 04 19:05:37.946972 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3205/6380] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:05:37 2022] GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15 => generated 1732 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:05:38.397817 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4fe0082a-5f81-4b60-af54-fceb96eecaab tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:38.398586 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4fe0082a-5f81-4b60-af54-fceb96eecaab tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:38.407909 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4fe0082a-5f81-4b60-af54-fceb96eecaab tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:38.408857 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4fe0082a-5f81-4b60-af54-fceb96eecaab tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:38.409387 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4fe0082a-5f81-4b60-af54-fceb96eecaab tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:38.410230 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4fe0082a-5f81-4b60-af54-fceb96eecaab tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:38.410791 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4fe0082a-5f81-4b60-af54-fceb96eecaab tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:38.411239 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4fe0082a-5f81-4b60-af54-fceb96eecaab tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:38.563744 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4fe0082a-5f81-4b60-af54-fceb96eecaab tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:38.573842 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4fe0082a-5f81-4b60-af54-fceb96eecaab tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed" status: 200 len: 1342 microversion: 2.1 time: 0.179926 Oct 04 19:05:38.574530 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3176/6381] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:38 2022] GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed => generated 1342 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:38.975943 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-88a14764-480a-4bc0-a1e0-6a609eec2102 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:38.977454 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-88a14764-480a-4bc0-a1e0-6a609eec2102 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 0e957abd-68e7-48c3-af4b-74d570d41c15] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:38.998673 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-88a14764-480a-4bc0-a1e0-6a609eec2102 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:38.998673 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-88a14764-480a-4bc0-a1e0-6a609eec2102 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:38.998673 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-88a14764-480a-4bc0-a1e0-6a609eec2102 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:38.998673 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-88a14764-480a-4bc0-a1e0-6a609eec2102 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:38.998673 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-88a14764-480a-4bc0-a1e0-6a609eec2102 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:38.998673 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-88a14764-480a-4bc0-a1e0-6a609eec2102 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:39.281284 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-88a14764-480a-4bc0-a1e0-6a609eec2102 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:39.296695 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-88a14764-480a-4bc0-a1e0-6a609eec2102 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:39.298957 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-88a14764-480a-4bc0-a1e0-6a609eec2102 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:39.300208 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-88a14764-480a-4bc0-a1e0-6a609eec2102 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15" status: 200 len: 1732 microversion: 2.20 time: 0.329067 Oct 04 19:05:39.300766 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3206/6382] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:05:38 2022] GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15 => generated 1732 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:05:39.600169 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4852501f-d977-49fb-99c9-55d00766ab06 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:39.601643 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4852501f-d977-49fb-99c9-55d00766ab06 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:39.650925 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4852501f-d977-49fb-99c9-55d00766ab06 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:39.652917 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4852501f-d977-49fb-99c9-55d00766ab06 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:39.653813 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4852501f-d977-49fb-99c9-55d00766ab06 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:39.655696 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4852501f-d977-49fb-99c9-55d00766ab06 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:39.656534 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4852501f-d977-49fb-99c9-55d00766ab06 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:39.657235 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4852501f-d977-49fb-99c9-55d00766ab06 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:39.944789 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4852501f-d977-49fb-99c9-55d00766ab06 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:39.976142 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4852501f-d977-49fb-99c9-55d00766ab06 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed" status: 200 len: 1342 microversion: 2.1 time: 0.380420 Oct 04 19:05:39.978104 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3177/6383] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:39 2022] GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed => generated 1342 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:05:40.331864 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6cf72012-2d30-4eb2-a7cb-556619dd8152 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:40.332682 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6cf72012-2d30-4eb2-a7cb-556619dd8152 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 0e957abd-68e7-48c3-af4b-74d570d41c15] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:40.342949 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6cf72012-2d30-4eb2-a7cb-556619dd8152 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:40.343442 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6cf72012-2d30-4eb2-a7cb-556619dd8152 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:40.343883 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6cf72012-2d30-4eb2-a7cb-556619dd8152 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:40.344630 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6cf72012-2d30-4eb2-a7cb-556619dd8152 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:40.345082 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6cf72012-2d30-4eb2-a7cb-556619dd8152 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:40.345510 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6cf72012-2d30-4eb2-a7cb-556619dd8152 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:40.574342 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6cf72012-2d30-4eb2-a7cb-556619dd8152 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:40.589067 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6cf72012-2d30-4eb2-a7cb-556619dd8152 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:40.593559 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6cf72012-2d30-4eb2-a7cb-556619dd8152 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:40.594984 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6cf72012-2d30-4eb2-a7cb-556619dd8152 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15" status: 200 len: 1732 microversion: 2.20 time: 0.267953 Oct 04 19:05:40.598830 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3207/6384] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:05:40 2022] GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15 => generated 1732 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:05:41.003761 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-dd070429-ef8d-4a01-8ec4-c5b59ff00831 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:41.005231 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-dd070429-ef8d-4a01-8ec4-c5b59ff00831 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:41.013182 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dd070429-ef8d-4a01-8ec4-c5b59ff00831 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:41.014660 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dd070429-ef8d-4a01-8ec4-c5b59ff00831 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:41.015352 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dd070429-ef8d-4a01-8ec4-c5b59ff00831 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:41.016366 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dd070429-ef8d-4a01-8ec4-c5b59ff00831 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:41.017057 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dd070429-ef8d-4a01-8ec4-c5b59ff00831 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:41.017501 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dd070429-ef8d-4a01-8ec4-c5b59ff00831 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:41.206566 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-dd070429-ef8d-4a01-8ec4-c5b59ff00831 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:41.214640 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-dd070429-ef8d-4a01-8ec4-c5b59ff00831 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed" status: 200 len: 1342 microversion: 2.1 time: 0.214989 Oct 04 19:05:41.215684 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3178/6385] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:40 2022] GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed => generated 1342 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:41.622110 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8e5d54b0-2a19-4a08-a38d-188cc8f4fc4b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:41.623799 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8e5d54b0-2a19-4a08-a38d-188cc8f4fc4b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 0e957abd-68e7-48c3-af4b-74d570d41c15] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:41.640932 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8e5d54b0-2a19-4a08-a38d-188cc8f4fc4b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:41.645028 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8e5d54b0-2a19-4a08-a38d-188cc8f4fc4b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:41.645028 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8e5d54b0-2a19-4a08-a38d-188cc8f4fc4b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:41.645028 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8e5d54b0-2a19-4a08-a38d-188cc8f4fc4b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:41.645028 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8e5d54b0-2a19-4a08-a38d-188cc8f4fc4b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:41.646242 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8e5d54b0-2a19-4a08-a38d-188cc8f4fc4b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:41.842446 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8e5d54b0-2a19-4a08-a38d-188cc8f4fc4b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:41.860313 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8e5d54b0-2a19-4a08-a38d-188cc8f4fc4b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:41.868593 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8e5d54b0-2a19-4a08-a38d-188cc8f4fc4b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:41.868593 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8e5d54b0-2a19-4a08-a38d-188cc8f4fc4b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15" status: 200 len: 1732 microversion: 2.20 time: 0.245588 Oct 04 19:05:41.881031 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3208/6386] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:05:41 2022] GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15 => generated 1732 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:05:42.162737 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9e54b124-8963-4cad-aba2-4d50fca4e310 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:42.164606 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9e54b124-8963-4cad-aba2-4d50fca4e310 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: 6860257c-9998-4117-8aa4-b08bd2f8dc28] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:42.207307 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9e54b124-8963-4cad-aba2-4d50fca4e310 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:42.209225 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9e54b124-8963-4cad-aba2-4d50fca4e310 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:42.209826 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9e54b124-8963-4cad-aba2-4d50fca4e310 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:42.210479 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9e54b124-8963-4cad-aba2-4d50fca4e310 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:42.215171 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9e54b124-8963-4cad-aba2-4d50fca4e310 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:42.215171 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9e54b124-8963-4cad-aba2-4d50fca4e310 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:42.246320 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1db843c6-1bdc-40c3-91ec-2505e64bf279 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:42.247324 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1db843c6-1bdc-40c3-91ec-2505e64bf279 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:42.260470 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1db843c6-1bdc-40c3-91ec-2505e64bf279 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:42.261161 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1db843c6-1bdc-40c3-91ec-2505e64bf279 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:42.271596 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1db843c6-1bdc-40c3-91ec-2505e64bf279 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:42.273557 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1db843c6-1bdc-40c3-91ec-2505e64bf279 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:42.274117 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1db843c6-1bdc-40c3-91ec-2505e64bf279 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:42.274563 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1db843c6-1bdc-40c3-91ec-2505e64bf279 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:42.275281 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-9e54b124-8963-4cad-aba2-4d50fca4e310 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] HTTP exception thrown: Instance 6860257c-9998-4117-8aa4-b08bd2f8dc28 could not be found. Oct 04 19:05:42.282133 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9e54b124-8963-4cad-aba2-4d50fca4e310 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Request method failure captured: Oct 04 19:05:42.282133 n-d-850501-14 devstack@n-api.service[123002]: request: DELETE /compute/v2.1/servers/6860257c-9998-4117-8aa4-b08bd2f8dc28 HTTP/1.1 Oct 04 19:05:42.282133 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 19:05:42.282133 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 19:05:42.282133 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 19:05:42.282133 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 19:05:42.282133 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 19:05:42.282133 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 19:05:42.282133 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 19:05:42.282133 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 19:05:42.282133 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPIIX_3DOcExv0tyjf74SMRRF0KoXtiJVCF7h65af0U3qLWvNf58dKqXrLellPdPVePIBHO4xx7DLTXsLA5NqBHQCEuDWqWqMr6VInyDk7lvTZQyuDvBxRCTYPpwhj6qdAHOfmE7y3qjml2L3OlgdXc8W6zK59OH-OYNHGwvWAJmEgQ4 Oct 04 19:05:42.282133 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 19:05:42.282133 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 19:05:42.282133 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 19:05:42.282133 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 19:05:42.282133 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 19:05:42.282133 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 19:05:42.282133 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 5dc67d8de57543c48bdf45669b684227 Oct 04 19:05:42.282133 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-AttachVolumeNegativeTest-715412502 Oct 04 19:05:42.282133 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 19:05:42.282133 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 19:05:42.282133 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5dc67d8de57543c48bdf45669b684227"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5dc67d8de57543c48bdf45669b684227", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5dc67d8de57543c48bdf45669b684227"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5dc67d8de57543c48bdf45669b684227"}]}] Oct 04 19:05:42.282133 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-AttachVolumeNegativeTest-715412502 Oct 04 19:05:42.282133 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 5dc67d8de57543c48bdf45669b684227 Oct 04 19:05:42.282133 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-715412502 Oct 04 19:05:42.282133 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-AttachVolumeNegativeTest-715412502-project Oct 04 19:05:42.282133 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 19:05:42.282133 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 19:05:42.282133 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: ce441ded6f554ec28560c75de97af173 Oct 04 19:05:42.282133 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-AttachVolumeNegativeTest-715412502-project Oct 04 19:05:42.282133 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 19:05:42.282133 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 6860257c-9998-4117-8aa4-b08bd2f8dc28 could not be found. Oct 04 19:05:42.282133 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '6860257c-9998-4117-8aa4-b08bd2f8dc28'} Oct 04 19:05:42.282133 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:05:42.282133 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:05:42.282133 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:05:42.282133 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:05:42.282133 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:05:42.282133 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:05:42.282133 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:05:42.282133 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:05:42.282133 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:05:42.282133 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:05:42.282133 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6860257c-9998-4117-8aa4-b08bd2f8dc28 could not be found. Oct 04 19:05:42.282133 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:05:42.282133 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:05:42.282133 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:05:42.282133 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:05:42.282133 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:05:42.282133 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:05:42.282133 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:05:42.282133 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:05:42.282133 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:05:42.282133 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:05:42.282133 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 19:05:42.282133 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 19:05:42.282133 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 19:05:42.282133 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 19:05:42.282133 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:05:42.282133 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:05:42.282133 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:05:42.282133 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:05:42.286132 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6860257c-9998-4117-8aa4-b08bd2f8dc28 could not be found. Oct 04 19:05:42.286132 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:05:42.286132 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:05:42.286132 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:05:42.286132 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:05:42.286132 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:05:42.286132 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:05:42.286132 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:05:42.286132 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:05:42.286132 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6860257c-9998-4117-8aa4-b08bd2f8dc28 could not be found. Oct 04 19:05:42.286132 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:05:42.287727 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9e54b124-8963-4cad-aba2-4d50fca4e310 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Returning 404 to user: Instance 6860257c-9998-4117-8aa4-b08bd2f8dc28 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:05:42.288931 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9e54b124-8963-4cad-aba2-4d50fca4e310 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6860257c-9998-4117-8aa4-b08bd2f8dc28" status: 404 len: 111 microversion: 2.1 time: 0.131037 Oct 04 19:05:42.303935 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3179/6387] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 19:05:42 2022] DELETE /compute/v2.1/servers/6860257c-9998-4117-8aa4-b08bd2f8dc28 => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:05:42.311972 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e24a7cdb-2548-4259-9414-2bc84e794241 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:42.312888 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e24a7cdb-2548-4259-9414-2bc84e794241 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: 6860257c-9998-4117-8aa4-b08bd2f8dc28] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:42.352917 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e24a7cdb-2548-4259-9414-2bc84e794241 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:42.353505 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e24a7cdb-2548-4259-9414-2bc84e794241 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:42.354055 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e24a7cdb-2548-4259-9414-2bc84e794241 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:42.366733 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e24a7cdb-2548-4259-9414-2bc84e794241 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:42.367215 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e24a7cdb-2548-4259-9414-2bc84e794241 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:42.367608 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e24a7cdb-2548-4259-9414-2bc84e794241 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:42.445527 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-e24a7cdb-2548-4259-9414-2bc84e794241 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] HTTP exception thrown: Instance 6860257c-9998-4117-8aa4-b08bd2f8dc28 could not be found. Oct 04 19:05:42.449181 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e24a7cdb-2548-4259-9414-2bc84e794241 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Request method failure captured: Oct 04 19:05:42.449181 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/6860257c-9998-4117-8aa4-b08bd2f8dc28 HTTP/1.1 Oct 04 19:05:42.449181 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 19:05:42.449181 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 19:05:42.449181 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 19:05:42.449181 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 19:05:42.449181 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 19:05:42.449181 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 19:05:42.449181 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 19:05:42.449181 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 19:05:42.449181 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPIIX_3DOcExv0tyjf74SMRRF0KoXtiJVCF7h65af0U3qLWvNf58dKqXrLellPdPVePIBHO4xx7DLTXsLA5NqBHQCEuDWqWqMr6VInyDk7lvTZQyuDvBxRCTYPpwhj6qdAHOfmE7y3qjml2L3OlgdXc8W6zK59OH-OYNHGwvWAJmEgQ4 Oct 04 19:05:42.449181 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 19:05:42.449181 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 19:05:42.449181 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 19:05:42.449181 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 19:05:42.449181 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 19:05:42.449181 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 19:05:42.449181 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 5dc67d8de57543c48bdf45669b684227 Oct 04 19:05:42.449181 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-AttachVolumeNegativeTest-715412502 Oct 04 19:05:42.449181 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 19:05:42.449181 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 19:05:42.449181 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5dc67d8de57543c48bdf45669b684227"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5dc67d8de57543c48bdf45669b684227", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5dc67d8de57543c48bdf45669b684227"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5dc67d8de57543c48bdf45669b684227"}]}] Oct 04 19:05:42.449181 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-AttachVolumeNegativeTest-715412502 Oct 04 19:05:42.449181 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 5dc67d8de57543c48bdf45669b684227 Oct 04 19:05:42.449181 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-715412502 Oct 04 19:05:42.449181 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-AttachVolumeNegativeTest-715412502-project Oct 04 19:05:42.449181 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 19:05:42.449181 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 19:05:42.449181 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: ce441ded6f554ec28560c75de97af173 Oct 04 19:05:42.449181 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-AttachVolumeNegativeTest-715412502-project Oct 04 19:05:42.449181 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 19:05:42.449181 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 6860257c-9998-4117-8aa4-b08bd2f8dc28 could not be found. Oct 04 19:05:42.449181 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '6860257c-9998-4117-8aa4-b08bd2f8dc28'} Oct 04 19:05:42.449181 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:05:42.449181 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:05:42.449181 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:05:42.449181 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:05:42.449181 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:05:42.449181 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:05:42.449181 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:05:42.449181 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:05:42.449181 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:05:42.449181 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:05:42.449181 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6860257c-9998-4117-8aa4-b08bd2f8dc28 could not be found. Oct 04 19:05:42.449181 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:05:42.449181 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:05:42.449181 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:05:42.449181 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:05:42.449181 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:05:42.449181 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:05:42.449181 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:05:42.449181 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:05:42.449181 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:05:42.449181 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:05:42.449181 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:05:42.449181 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:05:42.449181 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:05:42.449181 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:05:42.449181 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:05:42.449181 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:05:42.449181 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6860257c-9998-4117-8aa4-b08bd2f8dc28 could not be found. Oct 04 19:05:42.449181 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:05:42.449181 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:05:42.449181 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:05:42.454357 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:05:42.454357 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:05:42.454357 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:05:42.454357 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:05:42.454357 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:05:42.454357 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6860257c-9998-4117-8aa4-b08bd2f8dc28 could not be found. Oct 04 19:05:42.454357 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:05:42.454357 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e24a7cdb-2548-4259-9414-2bc84e794241 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Returning 404 to user: Instance 6860257c-9998-4117-8aa4-b08bd2f8dc28 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:05:42.454895 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e24a7cdb-2548-4259-9414-2bc84e794241 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/6860257c-9998-4117-8aa4-b08bd2f8dc28" status: 404 len: 111 microversion: 2.1 time: 0.148116 Oct 04 19:05:42.459239 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3180/6388] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:42 2022] GET /compute/v2.1/servers/6860257c-9998-4117-8aa4-b08bd2f8dc28 => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:05:42.475095 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-87136e2e-4006-4cfb-a2c9-eefe8f0cdd0f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:42.479020 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-87136e2e-4006-4cfb-a2c9-eefe8f0cdd0f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: efab3398-8820-4a11-8dd2-0f7f51a73763] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:42.495778 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-87136e2e-4006-4cfb-a2c9-eefe8f0cdd0f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:42.496328 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-87136e2e-4006-4cfb-a2c9-eefe8f0cdd0f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:42.499588 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-87136e2e-4006-4cfb-a2c9-eefe8f0cdd0f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:42.501395 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-87136e2e-4006-4cfb-a2c9-eefe8f0cdd0f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:42.505173 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-87136e2e-4006-4cfb-a2c9-eefe8f0cdd0f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:42.505975 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-87136e2e-4006-4cfb-a2c9-eefe8f0cdd0f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:42.569352 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-87136e2e-4006-4cfb-a2c9-eefe8f0cdd0f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] HTTP exception thrown: Instance efab3398-8820-4a11-8dd2-0f7f51a73763 could not be found. Oct 04 19:05:42.573455 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-87136e2e-4006-4cfb-a2c9-eefe8f0cdd0f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Request method failure captured: Oct 04 19:05:42.573455 n-d-850501-14 devstack@n-api.service[123002]: request: DELETE /compute/v2.1/servers/efab3398-8820-4a11-8dd2-0f7f51a73763 HTTP/1.1 Oct 04 19:05:42.573455 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 19:05:42.573455 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 19:05:42.573455 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 19:05:42.573455 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 19:05:42.573455 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 19:05:42.573455 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 19:05:42.573455 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 19:05:42.573455 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 19:05:42.573455 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPIIX_3DOcExv0tyjf74SMRRF0KoXtiJVCF7h65af0U3qLWvNf58dKqXrLellPdPVePIBHO4xx7DLTXsLA5NqBHQCEuDWqWqMr6VInyDk7lvTZQyuDvBxRCTYPpwhj6qdAHOfmE7y3qjml2L3OlgdXc8W6zK59OH-OYNHGwvWAJmEgQ4 Oct 04 19:05:42.573455 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 19:05:42.573455 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 19:05:42.573455 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 19:05:42.573455 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 19:05:42.573455 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 19:05:42.573455 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 19:05:42.573455 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 5dc67d8de57543c48bdf45669b684227 Oct 04 19:05:42.573455 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-AttachVolumeNegativeTest-715412502 Oct 04 19:05:42.573455 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 19:05:42.573455 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 19:05:42.573455 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5dc67d8de57543c48bdf45669b684227"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5dc67d8de57543c48bdf45669b684227", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5dc67d8de57543c48bdf45669b684227"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5dc67d8de57543c48bdf45669b684227"}]}] Oct 04 19:05:42.573455 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-AttachVolumeNegativeTest-715412502 Oct 04 19:05:42.573455 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 5dc67d8de57543c48bdf45669b684227 Oct 04 19:05:42.573455 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-715412502 Oct 04 19:05:42.573455 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-AttachVolumeNegativeTest-715412502-project Oct 04 19:05:42.573455 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 19:05:42.573455 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 19:05:42.573455 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: ce441ded6f554ec28560c75de97af173 Oct 04 19:05:42.573455 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-AttachVolumeNegativeTest-715412502-project Oct 04 19:05:42.573455 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 19:05:42.573455 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance efab3398-8820-4a11-8dd2-0f7f51a73763 could not be found. Oct 04 19:05:42.573455 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'efab3398-8820-4a11-8dd2-0f7f51a73763'} Oct 04 19:05:42.573455 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:05:42.573455 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:05:42.573455 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:05:42.573455 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:05:42.573455 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:05:42.573455 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:05:42.573455 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:05:42.573455 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:05:42.573455 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:05:42.573455 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:05:42.573455 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efab3398-8820-4a11-8dd2-0f7f51a73763 could not be found. Oct 04 19:05:42.573455 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:05:42.573455 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:05:42.573455 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:05:42.573455 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:05:42.573455 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:05:42.573455 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:05:42.573455 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:05:42.573455 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:05:42.573455 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:05:42.573455 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:05:42.573455 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 19:05:42.573455 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 19:05:42.573455 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 19:05:42.573455 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 19:05:42.573455 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:05:42.573455 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:05:42.573455 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:05:42.573455 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:05:42.578289 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efab3398-8820-4a11-8dd2-0f7f51a73763 could not be found. Oct 04 19:05:42.578289 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:05:42.578289 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:05:42.578289 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:05:42.578289 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:05:42.578289 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:05:42.578289 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:05:42.578289 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:05:42.578289 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:05:42.578289 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efab3398-8820-4a11-8dd2-0f7f51a73763 could not be found. Oct 04 19:05:42.578289 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:05:42.578935 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-87136e2e-4006-4cfb-a2c9-eefe8f0cdd0f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Returning 404 to user: Instance efab3398-8820-4a11-8dd2-0f7f51a73763 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:05:42.579688 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-87136e2e-4006-4cfb-a2c9-eefe8f0cdd0f tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "DELETE /compute/v2.1/servers/efab3398-8820-4a11-8dd2-0f7f51a73763" status: 404 len: 111 microversion: 2.1 time: 0.118186 Oct 04 19:05:42.580374 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3181/6389] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 19:05:42 2022] DELETE /compute/v2.1/servers/efab3398-8820-4a11-8dd2-0f7f51a73763 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:05:42.604130 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-50dc7ad5-e7c7-4011-bb21-6cf7e075210a tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:42.604824 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-50dc7ad5-e7c7-4011-bb21-6cf7e075210a tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: efab3398-8820-4a11-8dd2-0f7f51a73763] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:42.628791 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-50dc7ad5-e7c7-4011-bb21-6cf7e075210a tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:42.628791 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-50dc7ad5-e7c7-4011-bb21-6cf7e075210a tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:42.628791 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-50dc7ad5-e7c7-4011-bb21-6cf7e075210a tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:42.630814 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-50dc7ad5-e7c7-4011-bb21-6cf7e075210a tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:42.633507 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-50dc7ad5-e7c7-4011-bb21-6cf7e075210a tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:42.635069 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-50dc7ad5-e7c7-4011-bb21-6cf7e075210a tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:42.673411 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-50dc7ad5-e7c7-4011-bb21-6cf7e075210a tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] HTTP exception thrown: Instance efab3398-8820-4a11-8dd2-0f7f51a73763 could not be found. Oct 04 19:05:42.676517 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-50dc7ad5-e7c7-4011-bb21-6cf7e075210a tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Request method failure captured: Oct 04 19:05:42.676517 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/efab3398-8820-4a11-8dd2-0f7f51a73763 HTTP/1.1 Oct 04 19:05:42.676517 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 19:05:42.676517 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 19:05:42.676517 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 19:05:42.676517 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 19:05:42.676517 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 19:05:42.676517 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 19:05:42.676517 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 19:05:42.676517 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 19:05:42.676517 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPIIX_3DOcExv0tyjf74SMRRF0KoXtiJVCF7h65af0U3qLWvNf58dKqXrLellPdPVePIBHO4xx7DLTXsLA5NqBHQCEuDWqWqMr6VInyDk7lvTZQyuDvBxRCTYPpwhj6qdAHOfmE7y3qjml2L3OlgdXc8W6zK59OH-OYNHGwvWAJmEgQ4 Oct 04 19:05:42.676517 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 19:05:42.676517 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 19:05:42.676517 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 19:05:42.676517 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 19:05:42.676517 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 19:05:42.676517 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 19:05:42.676517 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 5dc67d8de57543c48bdf45669b684227 Oct 04 19:05:42.676517 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-AttachVolumeNegativeTest-715412502 Oct 04 19:05:42.676517 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 19:05:42.676517 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 19:05:42.676517 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5dc67d8de57543c48bdf45669b684227"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5dc67d8de57543c48bdf45669b684227", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5dc67d8de57543c48bdf45669b684227"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5dc67d8de57543c48bdf45669b684227"}]}] Oct 04 19:05:42.676517 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-AttachVolumeNegativeTest-715412502 Oct 04 19:05:42.676517 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 5dc67d8de57543c48bdf45669b684227 Oct 04 19:05:42.676517 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-715412502 Oct 04 19:05:42.676517 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-AttachVolumeNegativeTest-715412502-project Oct 04 19:05:42.676517 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 19:05:42.676517 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 19:05:42.676517 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: ce441ded6f554ec28560c75de97af173 Oct 04 19:05:42.676517 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-AttachVolumeNegativeTest-715412502-project Oct 04 19:05:42.676517 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 19:05:42.676517 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance efab3398-8820-4a11-8dd2-0f7f51a73763 could not be found. Oct 04 19:05:42.676517 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'efab3398-8820-4a11-8dd2-0f7f51a73763'} Oct 04 19:05:42.676517 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:05:42.676517 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:05:42.676517 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:05:42.676517 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:05:42.676517 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:05:42.676517 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:05:42.676517 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:05:42.676517 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:05:42.676517 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:05:42.676517 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:05:42.676517 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efab3398-8820-4a11-8dd2-0f7f51a73763 could not be found. Oct 04 19:05:42.676517 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:05:42.676517 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:05:42.676517 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:05:42.676517 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:05:42.676517 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:05:42.676517 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:05:42.676517 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:05:42.676517 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:05:42.676517 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:05:42.676517 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:05:42.676517 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:05:42.676517 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:05:42.676517 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:05:42.676517 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:05:42.676517 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:05:42.676517 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:05:42.676517 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efab3398-8820-4a11-8dd2-0f7f51a73763 could not be found. Oct 04 19:05:42.676517 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:05:42.676517 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:05:42.676517 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:05:42.681425 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:05:42.681425 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:05:42.681425 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:05:42.681425 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:05:42.681425 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:05:42.681425 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efab3398-8820-4a11-8dd2-0f7f51a73763 could not be found. Oct 04 19:05:42.681425 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:05:42.683029 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-50dc7ad5-e7c7-4011-bb21-6cf7e075210a tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Returning 404 to user: Instance efab3398-8820-4a11-8dd2-0f7f51a73763 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:05:42.684203 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-50dc7ad5-e7c7-4011-bb21-6cf7e075210a tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/efab3398-8820-4a11-8dd2-0f7f51a73763" status: 404 len: 111 microversion: 2.1 time: 0.095262 Oct 04 19:05:42.685435 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3182/6390] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:42 2022] GET /compute/v2.1/servers/efab3398-8820-4a11-8dd2-0f7f51a73763 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:05:42.725552 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1db843c6-1bdc-40c3-91ec-2505e64bf279 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:42.736393 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1db843c6-1bdc-40c3-91ec-2505e64bf279 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed" status: 200 len: 1342 microversion: 2.1 time: 0.498083 Oct 04 19:05:42.747081 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3209/6391] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:42 2022] GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed => generated 1342 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:05:42.891762 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ed210d9d-0276-41cf-90f1-8cced0f7dbfc tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:42.892377 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ed210d9d-0276-41cf-90f1-8cced0f7dbfc tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 0e957abd-68e7-48c3-af4b-74d570d41c15] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:42.899176 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ed210d9d-0276-41cf-90f1-8cced0f7dbfc tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:42.899832 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ed210d9d-0276-41cf-90f1-8cced0f7dbfc tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:42.900769 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ed210d9d-0276-41cf-90f1-8cced0f7dbfc tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:42.901609 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ed210d9d-0276-41cf-90f1-8cced0f7dbfc tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:42.902285 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ed210d9d-0276-41cf-90f1-8cced0f7dbfc tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:42.902909 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ed210d9d-0276-41cf-90f1-8cced0f7dbfc tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:43.191291 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ed210d9d-0276-41cf-90f1-8cced0f7dbfc tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:43.204638 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ed210d9d-0276-41cf-90f1-8cced0f7dbfc tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:43.208047 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ed210d9d-0276-41cf-90f1-8cced0f7dbfc tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:43.210278 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ed210d9d-0276-41cf-90f1-8cced0f7dbfc tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15" status: 200 len: 1732 microversion: 2.20 time: 0.322998 Oct 04 19:05:43.211511 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3183/6392] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:05:42 2022] GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15 => generated 1732 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:05:43.775043 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0e291bff-d5b3-4626-89f2-9d0fb6e19ca8 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:43.777425 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0e291bff-d5b3-4626-89f2-9d0fb6e19ca8 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:43.790604 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0e291bff-d5b3-4626-89f2-9d0fb6e19ca8 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:43.791095 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0e291bff-d5b3-4626-89f2-9d0fb6e19ca8 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:43.793592 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0e291bff-d5b3-4626-89f2-9d0fb6e19ca8 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:43.797288 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0e291bff-d5b3-4626-89f2-9d0fb6e19ca8 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:43.797922 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0e291bff-d5b3-4626-89f2-9d0fb6e19ca8 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:43.800991 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0e291bff-d5b3-4626-89f2-9d0fb6e19ca8 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:44.206451 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0e291bff-d5b3-4626-89f2-9d0fb6e19ca8 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:44.234769 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0e291bff-d5b3-4626-89f2-9d0fb6e19ca8 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed" status: 200 len: 1342 microversion: 2.1 time: 0.463451 Oct 04 19:05:44.252023 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-54227bee-4c25-405d-98f3-e7623a3db2a2 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:44.254863 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-54227bee-4c25-405d-98f3-e7623a3db2a2 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 0e957abd-68e7-48c3-af4b-74d570d41c15] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:44.262428 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-54227bee-4c25-405d-98f3-e7623a3db2a2 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:44.262874 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3210/6393] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:43 2022] GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed => generated 1342 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:44.263008 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-54227bee-4c25-405d-98f3-e7623a3db2a2 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:44.264003 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-54227bee-4c25-405d-98f3-e7623a3db2a2 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:44.265215 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-54227bee-4c25-405d-98f3-e7623a3db2a2 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:44.268798 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-54227bee-4c25-405d-98f3-e7623a3db2a2 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:44.269604 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-54227bee-4c25-405d-98f3-e7623a3db2a2 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:44.675200 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-54227bee-4c25-405d-98f3-e7623a3db2a2 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:44.684854 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-54227bee-4c25-405d-98f3-e7623a3db2a2 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:44.688017 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-54227bee-4c25-405d-98f3-e7623a3db2a2 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:44.689744 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-54227bee-4c25-405d-98f3-e7623a3db2a2 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15" status: 200 len: 1732 microversion: 2.20 time: 0.447528 Oct 04 19:05:44.690493 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3184/6394] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:05:44 2022] GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15 => generated 1732 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:05:45.278401 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e21faf22-e3b3-4eb4-b58c-17d971a5e6e8 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:45.279558 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e21faf22-e3b3-4eb4-b58c-17d971a5e6e8 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:45.291730 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e21faf22-e3b3-4eb4-b58c-17d971a5e6e8 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:45.295754 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e21faf22-e3b3-4eb4-b58c-17d971a5e6e8 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:45.296533 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e21faf22-e3b3-4eb4-b58c-17d971a5e6e8 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:45.298340 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e21faf22-e3b3-4eb4-b58c-17d971a5e6e8 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:45.299969 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e21faf22-e3b3-4eb4-b58c-17d971a5e6e8 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:45.303093 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e21faf22-e3b3-4eb4-b58c-17d971a5e6e8 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:45.475253 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e21faf22-e3b3-4eb4-b58c-17d971a5e6e8 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:45.485491 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e21faf22-e3b3-4eb4-b58c-17d971a5e6e8 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed" status: 200 len: 1342 microversion: 2.1 time: 0.212043 Oct 04 19:05:45.487107 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3211/6395] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:45 2022] GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed => generated 1342 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:45.721824 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-db73b312-3041-431d-aa13-ea9200ef4adb tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:45.723100 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-db73b312-3041-431d-aa13-ea9200ef4adb tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 0e957abd-68e7-48c3-af4b-74d570d41c15] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:45.734597 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-db73b312-3041-431d-aa13-ea9200ef4adb tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:45.738743 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-db73b312-3041-431d-aa13-ea9200ef4adb tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:45.740102 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-db73b312-3041-431d-aa13-ea9200ef4adb tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:45.742560 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-db73b312-3041-431d-aa13-ea9200ef4adb tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:45.744710 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-db73b312-3041-431d-aa13-ea9200ef4adb tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:45.745182 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-db73b312-3041-431d-aa13-ea9200ef4adb tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:46.049613 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-db73b312-3041-431d-aa13-ea9200ef4adb tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:46.064319 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-db73b312-3041-431d-aa13-ea9200ef4adb tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:46.065865 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-db73b312-3041-431d-aa13-ea9200ef4adb tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:46.067413 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-db73b312-3041-431d-aa13-ea9200ef4adb tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15" status: 200 len: 1732 microversion: 2.20 time: 0.350012 Oct 04 19:05:46.068570 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3185/6396] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:05:45 2022] GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15 => generated 1732 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:05:46.511316 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-efe446ec-5761-448c-bdbb-2f1f617f8be2 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:46.511947 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-efe446ec-5761-448c-bdbb-2f1f617f8be2 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:46.538792 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-efe446ec-5761-448c-bdbb-2f1f617f8be2 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:46.538792 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-efe446ec-5761-448c-bdbb-2f1f617f8be2 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:46.538792 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-efe446ec-5761-448c-bdbb-2f1f617f8be2 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:46.538792 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-efe446ec-5761-448c-bdbb-2f1f617f8be2 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:46.538792 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-efe446ec-5761-448c-bdbb-2f1f617f8be2 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:46.538792 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-efe446ec-5761-448c-bdbb-2f1f617f8be2 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:46.691895 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-efe446ec-5761-448c-bdbb-2f1f617f8be2 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:46.714890 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-efe446ec-5761-448c-bdbb-2f1f617f8be2 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed" status: 200 len: 1342 microversion: 2.1 time: 0.205337 Oct 04 19:05:46.720950 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3212/6397] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:46 2022] GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed => generated 1342 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:47.102277 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-91f6ebdc-f796-4191-b792-4c15bc4fd5a9 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:47.102844 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-91f6ebdc-f796-4191-b792-4c15bc4fd5a9 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 0e957abd-68e7-48c3-af4b-74d570d41c15] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:47.111124 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-91f6ebdc-f796-4191-b792-4c15bc4fd5a9 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:47.111632 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-91f6ebdc-f796-4191-b792-4c15bc4fd5a9 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:47.112108 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-91f6ebdc-f796-4191-b792-4c15bc4fd5a9 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:47.112826 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-91f6ebdc-f796-4191-b792-4c15bc4fd5a9 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:47.113297 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-91f6ebdc-f796-4191-b792-4c15bc4fd5a9 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:47.113739 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-91f6ebdc-f796-4191-b792-4c15bc4fd5a9 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:47.261153 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-91f6ebdc-f796-4191-b792-4c15bc4fd5a9 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:47.271492 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-91f6ebdc-f796-4191-b792-4c15bc4fd5a9 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:47.273244 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-91f6ebdc-f796-4191-b792-4c15bc4fd5a9 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:47.274591 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-91f6ebdc-f796-4191-b792-4c15bc4fd5a9 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15" status: 200 len: 1732 microversion: 2.20 time: 0.176421 Oct 04 19:05:47.275294 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3186/6398] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:05:47 2022] GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15 => generated 1732 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:05:47.740970 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-fed44ca3-89f5-4ebe-8344-f2a1ef8b02ee tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:47.745770 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-fed44ca3-89f5-4ebe-8344-f2a1ef8b02ee tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:47.751864 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fed44ca3-89f5-4ebe-8344-f2a1ef8b02ee tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:47.752568 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fed44ca3-89f5-4ebe-8344-f2a1ef8b02ee tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:47.753207 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fed44ca3-89f5-4ebe-8344-f2a1ef8b02ee tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:47.754066 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fed44ca3-89f5-4ebe-8344-f2a1ef8b02ee tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:47.754677 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fed44ca3-89f5-4ebe-8344-f2a1ef8b02ee tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:47.755256 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fed44ca3-89f5-4ebe-8344-f2a1ef8b02ee tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:47.982995 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-fed44ca3-89f5-4ebe-8344-f2a1ef8b02ee tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:47.992130 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-fed44ca3-89f5-4ebe-8344-f2a1ef8b02ee tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed" status: 200 len: 1342 microversion: 2.1 time: 0.255843 Oct 04 19:05:47.997995 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3213/6399] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:47 2022] GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed => generated 1342 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:48.310175 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3fb6891b-cd6f-463c-a3cb-951622495985 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:48.316143 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3fb6891b-cd6f-463c-a3cb-951622495985 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 0e957abd-68e7-48c3-af4b-74d570d41c15] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:48.332634 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3fb6891b-cd6f-463c-a3cb-951622495985 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:48.335943 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3fb6891b-cd6f-463c-a3cb-951622495985 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:48.335943 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3fb6891b-cd6f-463c-a3cb-951622495985 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:48.335943 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3fb6891b-cd6f-463c-a3cb-951622495985 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:48.335943 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3fb6891b-cd6f-463c-a3cb-951622495985 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:48.350501 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3fb6891b-cd6f-463c-a3cb-951622495985 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:48.756953 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3fb6891b-cd6f-463c-a3cb-951622495985 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:48.766486 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3fb6891b-cd6f-463c-a3cb-951622495985 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:48.772257 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e0c902c8-c7c8-4ea5-9292-af5348c18864 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:48.772257 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e0c902c8-c7c8-4ea5-9292-af5348c18864 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: ba710906-86d6-4c04-a708-1f3b9a466e3c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:48.773382 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3fb6891b-cd6f-463c-a3cb-951622495985 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:48.773382 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3fb6891b-cd6f-463c-a3cb-951622495985 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15" status: 200 len: 1732 microversion: 2.20 time: 0.468326 Oct 04 19:05:48.783376 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e0c902c8-c7c8-4ea5-9292-af5348c18864 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:48.783884 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e0c902c8-c7c8-4ea5-9292-af5348c18864 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:48.784374 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e0c902c8-c7c8-4ea5-9292-af5348c18864 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:48.785076 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e0c902c8-c7c8-4ea5-9292-af5348c18864 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:48.788101 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e0c902c8-c7c8-4ea5-9292-af5348c18864 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:48.788897 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e0c902c8-c7c8-4ea5-9292-af5348c18864 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:48.796839 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3187/6400] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:05:48 2022] GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15 => generated 1732 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:05:48.808800 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-e0c902c8-c7c8-4ea5-9292-af5348c18864 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] HTTP exception thrown: Instance ba710906-86d6-4c04-a708-1f3b9a466e3c could not be found. Oct 04 19:05:48.813310 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e0c902c8-c7c8-4ea5-9292-af5348c18864 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Request method failure captured: Oct 04 19:05:48.813310 n-d-850501-14 devstack@n-api.service[123001]: request: DELETE /compute/v2.1/servers/ba710906-86d6-4c04-a708-1f3b9a466e3c HTTP/1.1 Oct 04 19:05:48.813310 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 19:05:48.813310 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 19:05:48.813310 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 19:05:48.813310 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 19:05:48.813310 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 19:05:48.813310 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 19:05:48.813310 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 19:05:48.813310 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 19:05:48.813310 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPIIX_3DOcExv0tyjf74SMRRF0KoXtiJVCF7h65af0U3qLWvNf58dKqXrLellPdPVePIBHO4xx7DLTXsLA5NqBHQCEuDWqWqMr6VInyDk7lvTZQyuDvBxRCTYPpwhj6qdAHOfmE7y3qjml2L3OlgdXc8W6zK59OH-OYNHGwvWAJmEgQ4 Oct 04 19:05:48.813310 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 19:05:48.813310 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 19:05:48.813310 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 19:05:48.813310 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 19:05:48.813310 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 19:05:48.813310 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 19:05:48.813310 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 5dc67d8de57543c48bdf45669b684227 Oct 04 19:05:48.813310 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-AttachVolumeNegativeTest-715412502 Oct 04 19:05:48.813310 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 19:05:48.813310 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 19:05:48.813310 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5dc67d8de57543c48bdf45669b684227"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5dc67d8de57543c48bdf45669b684227", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5dc67d8de57543c48bdf45669b684227"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5dc67d8de57543c48bdf45669b684227"}]}] Oct 04 19:05:48.813310 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-AttachVolumeNegativeTest-715412502 Oct 04 19:05:48.813310 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 5dc67d8de57543c48bdf45669b684227 Oct 04 19:05:48.813310 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-715412502 Oct 04 19:05:48.813310 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-AttachVolumeNegativeTest-715412502-project Oct 04 19:05:48.813310 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 19:05:48.813310 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 19:05:48.813310 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: ce441ded6f554ec28560c75de97af173 Oct 04 19:05:48.813310 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-AttachVolumeNegativeTest-715412502-project Oct 04 19:05:48.813310 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 19:05:48.813310 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance ba710906-86d6-4c04-a708-1f3b9a466e3c could not be found. Oct 04 19:05:48.813310 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': 'ba710906-86d6-4c04-a708-1f3b9a466e3c'} Oct 04 19:05:48.813310 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:05:48.813310 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:05:48.813310 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:05:48.813310 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:05:48.813310 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:05:48.813310 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:05:48.813310 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:05:48.813310 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:05:48.813310 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:05:48.813310 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:05:48.813310 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba710906-86d6-4c04-a708-1f3b9a466e3c could not be found. Oct 04 19:05:48.813310 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:05:48.813310 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:05:48.813310 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:05:48.813310 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:05:48.813310 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:05:48.813310 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:05:48.813310 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:05:48.813310 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:05:48.813310 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:05:48.813310 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:05:48.813310 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 19:05:48.813310 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 19:05:48.813310 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 19:05:48.813310 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 19:05:48.813310 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:05:48.813310 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:05:48.813310 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:05:48.813310 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:05:48.817036 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba710906-86d6-4c04-a708-1f3b9a466e3c could not be found. Oct 04 19:05:48.817036 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:05:48.817036 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:05:48.817036 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:05:48.817036 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:05:48.817036 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:05:48.817036 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:05:48.817036 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:05:48.817036 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:05:48.817036 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba710906-86d6-4c04-a708-1f3b9a466e3c could not be found. Oct 04 19:05:48.817036 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:05:48.819851 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e0c902c8-c7c8-4ea5-9292-af5348c18864 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Returning 404 to user: Instance ba710906-86d6-4c04-a708-1f3b9a466e3c could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:05:48.821149 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e0c902c8-c7c8-4ea5-9292-af5348c18864 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ba710906-86d6-4c04-a708-1f3b9a466e3c" status: 404 len: 111 microversion: 2.1 time: 0.057514 Oct 04 19:05:48.822148 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3214/6401] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 19:05:48 2022] DELETE /compute/v2.1/servers/ba710906-86d6-4c04-a708-1f3b9a466e3c => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 19:05:48.831429 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-53672ef9-e7a2-4260-8dfc-1a230fe618e1 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:48.832327 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-53672ef9-e7a2-4260-8dfc-1a230fe618e1 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] [instance: ba710906-86d6-4c04-a708-1f3b9a466e3c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:48.840691 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-53672ef9-e7a2-4260-8dfc-1a230fe618e1 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:48.841203 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-53672ef9-e7a2-4260-8dfc-1a230fe618e1 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:48.841653 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-53672ef9-e7a2-4260-8dfc-1a230fe618e1 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:48.842478 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-53672ef9-e7a2-4260-8dfc-1a230fe618e1 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:48.843042 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-53672ef9-e7a2-4260-8dfc-1a230fe618e1 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:48.843941 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-53672ef9-e7a2-4260-8dfc-1a230fe618e1 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:48.866628 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-53672ef9-e7a2-4260-8dfc-1a230fe618e1 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] HTTP exception thrown: Instance ba710906-86d6-4c04-a708-1f3b9a466e3c could not be found. Oct 04 19:05:48.868392 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-53672ef9-e7a2-4260-8dfc-1a230fe618e1 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Request method failure captured: Oct 04 19:05:48.868392 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/ba710906-86d6-4c04-a708-1f3b9a466e3c HTTP/1.1 Oct 04 19:05:48.868392 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 19:05:48.868392 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 19:05:48.868392 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 19:05:48.868392 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 19:05:48.868392 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 19:05:48.868392 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 19:05:48.868392 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 19:05:48.868392 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 19:05:48.868392 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPIIX_3DOcExv0tyjf74SMRRF0KoXtiJVCF7h65af0U3qLWvNf58dKqXrLellPdPVePIBHO4xx7DLTXsLA5NqBHQCEuDWqWqMr6VInyDk7lvTZQyuDvBxRCTYPpwhj6qdAHOfmE7y3qjml2L3OlgdXc8W6zK59OH-OYNHGwvWAJmEgQ4 Oct 04 19:05:48.868392 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 19:05:48.868392 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 19:05:48.868392 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 19:05:48.868392 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 19:05:48.868392 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 19:05:48.868392 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 19:05:48.868392 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 5dc67d8de57543c48bdf45669b684227 Oct 04 19:05:48.868392 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-AttachVolumeNegativeTest-715412502 Oct 04 19:05:48.868392 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 19:05:48.868392 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 19:05:48.868392 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5dc67d8de57543c48bdf45669b684227"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5dc67d8de57543c48bdf45669b684227", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5dc67d8de57543c48bdf45669b684227"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5dc67d8de57543c48bdf45669b684227"}]}] Oct 04 19:05:48.868392 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-AttachVolumeNegativeTest-715412502 Oct 04 19:05:48.868392 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 5dc67d8de57543c48bdf45669b684227 Oct 04 19:05:48.868392 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-715412502 Oct 04 19:05:48.868392 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-AttachVolumeNegativeTest-715412502-project Oct 04 19:05:48.868392 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 19:05:48.868392 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 19:05:48.868392 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: ce441ded6f554ec28560c75de97af173 Oct 04 19:05:48.868392 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-AttachVolumeNegativeTest-715412502-project Oct 04 19:05:48.868392 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 19:05:48.868392 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance ba710906-86d6-4c04-a708-1f3b9a466e3c could not be found. Oct 04 19:05:48.868392 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'ba710906-86d6-4c04-a708-1f3b9a466e3c'} Oct 04 19:05:48.868392 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:05:48.868392 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:05:48.868392 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:05:48.868392 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:05:48.868392 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:05:48.868392 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:05:48.868392 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:05:48.868392 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:05:48.868392 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:05:48.868392 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:05:48.868392 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba710906-86d6-4c04-a708-1f3b9a466e3c could not be found. Oct 04 19:05:48.868392 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:05:48.868392 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:05:48.868392 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:05:48.868392 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:05:48.868392 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:05:48.868392 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:05:48.868392 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:05:48.868392 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:05:48.868392 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:05:48.868392 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:05:48.868392 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:05:48.868392 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:05:48.868392 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:05:48.868392 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:05:48.868392 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:05:48.868392 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:05:48.868392 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba710906-86d6-4c04-a708-1f3b9a466e3c could not be found. Oct 04 19:05:48.868392 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:05:48.868392 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:05:48.868392 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:05:48.878645 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:05:48.878645 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:05:48.878645 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:05:48.878645 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:05:48.878645 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:05:48.878645 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba710906-86d6-4c04-a708-1f3b9a466e3c could not be found. Oct 04 19:05:48.878645 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:05:48.878645 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-53672ef9-e7a2-4260-8dfc-1a230fe618e1 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] Returning 404 to user: Instance ba710906-86d6-4c04-a708-1f3b9a466e3c could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:05:48.878645 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-53672ef9-e7a2-4260-8dfc-1a230fe618e1 tempest-AttachVolumeNegativeTest-715412502 tempest-AttachVolumeNegativeTest-715412502-project] 10.222.0.20 "GET /compute/v2.1/servers/ba710906-86d6-4c04-a708-1f3b9a466e3c" status: 404 len: 111 microversion: 2.1 time: 0.043654 Oct 04 19:05:48.878645 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3188/6402] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:48 2022] GET /compute/v2.1/servers/ba710906-86d6-4c04-a708-1f3b9a466e3c => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:05:49.023997 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-375db6f6-86bb-4f2d-b9ee-3608dde02c0a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:49.024797 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-375db6f6-86bb-4f2d-b9ee-3608dde02c0a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:49.040254 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-375db6f6-86bb-4f2d-b9ee-3608dde02c0a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:49.042329 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-375db6f6-86bb-4f2d-b9ee-3608dde02c0a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:49.043653 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-375db6f6-86bb-4f2d-b9ee-3608dde02c0a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:49.044940 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-375db6f6-86bb-4f2d-b9ee-3608dde02c0a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:49.046178 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-375db6f6-86bb-4f2d-b9ee-3608dde02c0a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:49.067598 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-375db6f6-86bb-4f2d-b9ee-3608dde02c0a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:49.353817 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-375db6f6-86bb-4f2d-b9ee-3608dde02c0a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:49.368977 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-375db6f6-86bb-4f2d-b9ee-3608dde02c0a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed" status: 200 len: 1342 microversion: 2.1 time: 0.350903 Oct 04 19:05:49.385447 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3215/6403] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:49 2022] GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed => generated 1342 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:49.803664 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e71671c1-0856-4d57-9c8b-c8465263b454 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:49.805289 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e71671c1-0856-4d57-9c8b-c8465263b454 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 0e957abd-68e7-48c3-af4b-74d570d41c15] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:49.826333 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e71671c1-0856-4d57-9c8b-c8465263b454 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:49.830572 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e71671c1-0856-4d57-9c8b-c8465263b454 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:49.831463 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e71671c1-0856-4d57-9c8b-c8465263b454 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:49.832632 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e71671c1-0856-4d57-9c8b-c8465263b454 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:49.833963 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e71671c1-0856-4d57-9c8b-c8465263b454 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:49.835727 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e71671c1-0856-4d57-9c8b-c8465263b454 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:50.187381 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e71671c1-0856-4d57-9c8b-c8465263b454 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:50.203232 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e71671c1-0856-4d57-9c8b-c8465263b454 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:50.208484 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e71671c1-0856-4d57-9c8b-c8465263b454 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:50.210321 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e71671c1-0856-4d57-9c8b-c8465263b454 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15" status: 200 len: 1732 microversion: 2.20 time: 0.410939 Oct 04 19:05:50.233300 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3189/6404] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:05:49 2022] GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15 => generated 1732 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:05:50.400541 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-bbeb0a2f-2539-4632-9203-c2944470a8d0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:50.401798 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-bbeb0a2f-2539-4632-9203-c2944470a8d0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:50.413059 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bbeb0a2f-2539-4632-9203-c2944470a8d0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:50.416683 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bbeb0a2f-2539-4632-9203-c2944470a8d0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:50.418312 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bbeb0a2f-2539-4632-9203-c2944470a8d0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:50.419949 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bbeb0a2f-2539-4632-9203-c2944470a8d0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:50.422079 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bbeb0a2f-2539-4632-9203-c2944470a8d0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:50.423408 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bbeb0a2f-2539-4632-9203-c2944470a8d0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:50.748327 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-bbeb0a2f-2539-4632-9203-c2944470a8d0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:50.757413 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-bbeb0a2f-2539-4632-9203-c2944470a8d0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed" status: 200 len: 1342 microversion: 2.1 time: 0.360708 Oct 04 19:05:50.758076 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3216/6405] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:50 2022] GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed => generated 1342 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:51.241157 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-54767067-db35-422a-a717-98934de283b6 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:51.243012 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-54767067-db35-422a-a717-98934de283b6 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 0e957abd-68e7-48c3-af4b-74d570d41c15] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:51.257176 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-54767067-db35-422a-a717-98934de283b6 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:51.257723 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-54767067-db35-422a-a717-98934de283b6 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:51.258197 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-54767067-db35-422a-a717-98934de283b6 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:51.258951 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-54767067-db35-422a-a717-98934de283b6 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:51.259428 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-54767067-db35-422a-a717-98934de283b6 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:51.259872 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-54767067-db35-422a-a717-98934de283b6 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:51.782104 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-49c1d047-6afb-471d-88f9-dbe030ce8497 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:51.783436 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-49c1d047-6afb-471d-88f9-dbe030ce8497 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:51.791214 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-49c1d047-6afb-471d-88f9-dbe030ce8497 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:51.791801 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-49c1d047-6afb-471d-88f9-dbe030ce8497 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:51.793394 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-49c1d047-6afb-471d-88f9-dbe030ce8497 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:51.797890 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-49c1d047-6afb-471d-88f9-dbe030ce8497 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:51.800157 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-49c1d047-6afb-471d-88f9-dbe030ce8497 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:51.801767 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-49c1d047-6afb-471d-88f9-dbe030ce8497 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:51.890901 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-54767067-db35-422a-a717-98934de283b6 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:51.898865 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-54767067-db35-422a-a717-98934de283b6 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:51.900731 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-54767067-db35-422a-a717-98934de283b6 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:51.902143 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-54767067-db35-422a-a717-98934de283b6 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15" status: 200 len: 1732 microversion: 2.20 time: 0.665239 Oct 04 19:05:51.912725 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3190/6406] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:05:51 2022] GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15 => generated 1732 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:05:52.034312 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-49c1d047-6afb-471d-88f9-dbe030ce8497 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:52.042720 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-49c1d047-6afb-471d-88f9-dbe030ce8497 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed" status: 200 len: 1342 microversion: 2.1 time: 0.264786 Oct 04 19:05:52.043298 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3217/6407] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:51 2022] GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed => generated 1342 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:05:52.931751 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-87d7645b-3cfb-456a-9846-1128250a7d37 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:52.933629 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-87d7645b-3cfb-456a-9846-1128250a7d37 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 0e957abd-68e7-48c3-af4b-74d570d41c15] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:52.946980 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:05:52.951389 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-87d7645b-3cfb-456a-9846-1128250a7d37 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:52.953869 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-87d7645b-3cfb-456a-9846-1128250a7d37 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:52.955508 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-87d7645b-3cfb-456a-9846-1128250a7d37 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:52.958355 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-87d7645b-3cfb-456a-9846-1128250a7d37 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:52.959842 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-87d7645b-3cfb-456a-9846-1128250a7d37 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:52.960488 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-87d7645b-3cfb-456a-9846-1128250a7d37 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:53.066799 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-69a1c85b-69de-4811-8c14-bb918900d364 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:53.067603 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-69a1c85b-69de-4811-8c14-bb918900d364 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:53.075079 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-69a1c85b-69de-4811-8c14-bb918900d364 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:53.075587 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-69a1c85b-69de-4811-8c14-bb918900d364 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:53.076035 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-69a1c85b-69de-4811-8c14-bb918900d364 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:53.076831 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-69a1c85b-69de-4811-8c14-bb918900d364 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:53.077755 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-69a1c85b-69de-4811-8c14-bb918900d364 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:53.078104 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-69a1c85b-69de-4811-8c14-bb918900d364 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:53.165819 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-87d7645b-3cfb-456a-9846-1128250a7d37 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:53.174482 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-87d7645b-3cfb-456a-9846-1128250a7d37 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:53.176107 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-87d7645b-3cfb-456a-9846-1128250a7d37 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:53.177299 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-87d7645b-3cfb-456a-9846-1128250a7d37 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15" status: 200 len: 1732 microversion: 2.20 time: 0.250570 Oct 04 19:05:53.177888 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3191/6408] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:05:52 2022] GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15 => generated 1732 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:05:53.242258 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-69a1c85b-69de-4811-8c14-bb918900d364 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:53.251441 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-69a1c85b-69de-4811-8c14-bb918900d364 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed" status: 200 len: 1342 microversion: 2.1 time: 0.188466 Oct 04 19:05:53.252025 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3218/6409] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:53 2022] GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed => generated 1342 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:05:54.209754 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-38cd36b7-9221-4679-8393-67ce22880a3d tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:54.211157 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-38cd36b7-9221-4679-8393-67ce22880a3d tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 0e957abd-68e7-48c3-af4b-74d570d41c15] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:54.222118 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-38cd36b7-9221-4679-8393-67ce22880a3d tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:54.223672 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-38cd36b7-9221-4679-8393-67ce22880a3d tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:54.226366 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-38cd36b7-9221-4679-8393-67ce22880a3d tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:54.227650 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-38cd36b7-9221-4679-8393-67ce22880a3d tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:54.228780 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-38cd36b7-9221-4679-8393-67ce22880a3d tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:54.229417 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-38cd36b7-9221-4679-8393-67ce22880a3d tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:54.275630 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-259dd37d-d30d-4f5e-b559-d2dbbd76efe9 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:54.276287 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-259dd37d-d30d-4f5e-b559-d2dbbd76efe9 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:54.287513 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-259dd37d-d30d-4f5e-b559-d2dbbd76efe9 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:54.291208 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-259dd37d-d30d-4f5e-b559-d2dbbd76efe9 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:54.292482 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-259dd37d-d30d-4f5e-b559-d2dbbd76efe9 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:54.296410 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-259dd37d-d30d-4f5e-b559-d2dbbd76efe9 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:54.301037 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-259dd37d-d30d-4f5e-b559-d2dbbd76efe9 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:54.301037 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-259dd37d-d30d-4f5e-b559-d2dbbd76efe9 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:54.603419 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-38cd36b7-9221-4679-8393-67ce22880a3d tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:54.614596 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-38cd36b7-9221-4679-8393-67ce22880a3d tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:54.616654 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-38cd36b7-9221-4679-8393-67ce22880a3d tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:54.618423 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-38cd36b7-9221-4679-8393-67ce22880a3d tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15" status: 200 len: 1732 microversion: 2.20 time: 0.414046 Oct 04 19:05:54.619542 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3192/6410] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:05:54 2022] GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15 => generated 1732 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:05:54.685142 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-259dd37d-d30d-4f5e-b559-d2dbbd76efe9 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:54.693428 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-259dd37d-d30d-4f5e-b559-d2dbbd76efe9 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed" status: 200 len: 1342 microversion: 2.1 time: 0.422366 Oct 04 19:05:54.694146 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3219/6411] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:54 2022] GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed => generated 1342 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:05:55.651586 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7613ba4e-858a-4886-9393-652097e50622 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:55.653447 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7613ba4e-858a-4886-9393-652097e50622 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 0e957abd-68e7-48c3-af4b-74d570d41c15] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:55.673573 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7613ba4e-858a-4886-9393-652097e50622 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:55.674099 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7613ba4e-858a-4886-9393-652097e50622 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:55.674564 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7613ba4e-858a-4886-9393-652097e50622 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:55.675312 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7613ba4e-858a-4886-9393-652097e50622 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:55.675795 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7613ba4e-858a-4886-9393-652097e50622 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:55.676308 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7613ba4e-858a-4886-9393-652097e50622 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:55.734757 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b827a0e8-7adc-4a96-b490-d195c614d39a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:55.736421 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b827a0e8-7adc-4a96-b490-d195c614d39a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:55.745232 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b827a0e8-7adc-4a96-b490-d195c614d39a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:55.745968 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b827a0e8-7adc-4a96-b490-d195c614d39a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:55.746657 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b827a0e8-7adc-4a96-b490-d195c614d39a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:55.747557 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b827a0e8-7adc-4a96-b490-d195c614d39a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:55.748298 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b827a0e8-7adc-4a96-b490-d195c614d39a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:55.750476 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b827a0e8-7adc-4a96-b490-d195c614d39a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:55.967472 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7613ba4e-858a-4886-9393-652097e50622 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:55.983562 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7613ba4e-858a-4886-9393-652097e50622 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:55.995605 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7613ba4e-858a-4886-9393-652097e50622 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:55.995605 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7613ba4e-858a-4886-9393-652097e50622 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15" status: 200 len: 1732 microversion: 2.20 time: 0.346152 Oct 04 19:05:55.995605 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3193/6412] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:05:55 2022] GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15 => generated 1732 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:05:56.058014 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b827a0e8-7adc-4a96-b490-d195c614d39a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:56.061919 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=100 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:05:56.072642 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b827a0e8-7adc-4a96-b490-d195c614d39a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed" status: 200 len: 1342 microversion: 2.1 time: 0.343321 Oct 04 19:05:56.085077 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3220/6413] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:55 2022] GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed => generated 1342 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:57.013093 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-eb3532b4-488e-42ba-b715-9fabe8732c78 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:57.013934 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-eb3532b4-488e-42ba-b715-9fabe8732c78 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 0e957abd-68e7-48c3-af4b-74d570d41c15] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:57.026327 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eb3532b4-488e-42ba-b715-9fabe8732c78 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:57.032365 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eb3532b4-488e-42ba-b715-9fabe8732c78 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:57.032854 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eb3532b4-488e-42ba-b715-9fabe8732c78 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:57.033624 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eb3532b4-488e-42ba-b715-9fabe8732c78 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:57.034118 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eb3532b4-488e-42ba-b715-9fabe8732c78 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:57.034570 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eb3532b4-488e-42ba-b715-9fabe8732c78 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:57.104936 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-55da594c-02c8-4b2d-8994-380155ef5f7c tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:57.106664 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-55da594c-02c8-4b2d-8994-380155ef5f7c tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:57.142318 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-55da594c-02c8-4b2d-8994-380155ef5f7c tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:57.147671 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-55da594c-02c8-4b2d-8994-380155ef5f7c tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:57.148362 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-55da594c-02c8-4b2d-8994-380155ef5f7c tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:57.153501 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-55da594c-02c8-4b2d-8994-380155ef5f7c tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:57.153501 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-55da594c-02c8-4b2d-8994-380155ef5f7c tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:57.153501 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-55da594c-02c8-4b2d-8994-380155ef5f7c tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:57.349445 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-eb3532b4-488e-42ba-b715-9fabe8732c78 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:57.369998 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-eb3532b4-488e-42ba-b715-9fabe8732c78 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:57.375676 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-eb3532b4-488e-42ba-b715-9fabe8732c78 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:57.386659 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-eb3532b4-488e-42ba-b715-9fabe8732c78 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15" status: 200 len: 1732 microversion: 2.20 time: 0.367871 Oct 04 19:05:57.387793 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3194/6414] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:05:57 2022] GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15 => generated 1732 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:05:57.454635 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-55da594c-02c8-4b2d-8994-380155ef5f7c tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:57.479111 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-55da594c-02c8-4b2d-8994-380155ef5f7c tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed" status: 200 len: 1342 microversion: 2.1 time: 0.380682 Oct 04 19:05:57.503844 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3221/6415] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:57 2022] GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed => generated 1342 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:58.414768 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1c0f6696-759f-4cf9-9fd1-4c98678164d2 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:58.415395 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1c0f6696-759f-4cf9-9fd1-4c98678164d2 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 0e957abd-68e7-48c3-af4b-74d570d41c15] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:58.433637 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1c0f6696-759f-4cf9-9fd1-4c98678164d2 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:58.435627 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1c0f6696-759f-4cf9-9fd1-4c98678164d2 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:58.437026 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1c0f6696-759f-4cf9-9fd1-4c98678164d2 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:58.438860 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1c0f6696-759f-4cf9-9fd1-4c98678164d2 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:58.439771 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1c0f6696-759f-4cf9-9fd1-4c98678164d2 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:58.440659 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1c0f6696-759f-4cf9-9fd1-4c98678164d2 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:58.455702 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=100 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:05:58.704251 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-14f906b8-0d29-43c7-94d3-604be2c8f262 tempest-VolumesGetTestJSON-701386150 tempest-VolumesGetTestJSON-701386150-project] Action: 'create', calling method: .version_select at 0x7fe253cde700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-804514592", "metadata": {"Type": "work"}}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:05:58.713681 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1c0f6696-759f-4cf9-9fd1-4c98678164d2 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:58.724193 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1c0f6696-759f-4cf9-9fd1-4c98678164d2 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:58.725814 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1c0f6696-759f-4cf9-9fd1-4c98678164d2 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:58.727020 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1c0f6696-759f-4cf9-9fd1-4c98678164d2 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15" status: 200 len: 1732 microversion: 2.20 time: 0.316149 Oct 04 19:05:58.733169 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3195/6416] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:05:58 2022] GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15 => generated 1732 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:05:58.740898 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b739afb2-b105-47e5-a91f-ef26997a19e0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:58.741667 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b739afb2-b105-47e5-a91f-ef26997a19e0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:58.760671 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b739afb2-b105-47e5-a91f-ef26997a19e0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:58.761118 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b739afb2-b105-47e5-a91f-ef26997a19e0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:58.761582 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b739afb2-b105-47e5-a91f-ef26997a19e0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:58.762299 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b739afb2-b105-47e5-a91f-ef26997a19e0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:58.762853 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b739afb2-b105-47e5-a91f-ef26997a19e0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:58.763303 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b739afb2-b105-47e5-a91f-ef26997a19e0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:58.956754 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b739afb2-b105-47e5-a91f-ef26997a19e0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:58.966753 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b739afb2-b105-47e5-a91f-ef26997a19e0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed" status: 200 len: 1342 microversion: 2.1 time: 0.231343 Oct 04 19:05:58.968397 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3196/6417] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:58 2022] GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed => generated 1342 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:59.698792 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-1a60eb43-5458-4b5c-af2a-5f330364302c req-cef0b21b-fed6-446b-8b0e-495fcbd72deb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e957abd-68e7-48c3-af4b-74d570d41c15", "name": "network-vif-plugged", "status": "completed", "tag": "a324d908-a426-4333-ae46-4fc6e0230e67"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:05:59.720640 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-1a60eb43-5458-4b5c-af2a-5f330364302c req-cef0b21b-fed6-446b-8b0e-495fcbd72deb service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:59.721152 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-1a60eb43-5458-4b5c-af2a-5f330364302c req-cef0b21b-fed6-446b-8b0e-495fcbd72deb service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:59.721595 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-1a60eb43-5458-4b5c-af2a-5f330364302c req-cef0b21b-fed6-446b-8b0e-495fcbd72deb service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:59.751381 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-1a60eb43-5458-4b5c-af2a-5f330364302c req-cef0b21b-fed6-446b-8b0e-495fcbd72deb service nova] Creating event network-vif-plugged:a324d908-a426-4333-ae46-4fc6e0230e67 for instance 0e957abd-68e7-48c3-af4b-74d570d41c15 on n-h2-850501-14 Oct 04 19:05:59.758270 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-1a60eb43-5458-4b5c-af2a-5f330364302c req-cef0b21b-fed6-446b-8b0e-495fcbd72deb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063471 Oct 04 19:05:59.758923 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3197/6418] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:05:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:05:59.768560 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-cb86b5eb-f1ac-4b15-9ac2-18019b1bfd74 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:59.769598 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-cb86b5eb-f1ac-4b15-9ac2-18019b1bfd74 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 0e957abd-68e7-48c3-af4b-74d570d41c15] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:59.776515 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cb86b5eb-f1ac-4b15-9ac2-18019b1bfd74 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:59.777238 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cb86b5eb-f1ac-4b15-9ac2-18019b1bfd74 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:59.777842 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cb86b5eb-f1ac-4b15-9ac2-18019b1bfd74 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:59.778738 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cb86b5eb-f1ac-4b15-9ac2-18019b1bfd74 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:59.779360 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cb86b5eb-f1ac-4b15-9ac2-18019b1bfd74 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:59.780070 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cb86b5eb-f1ac-4b15-9ac2-18019b1bfd74 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:59.882538 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-14f906b8-0d29-43c7-94d3-604be2c8f262 tempest-VolumesGetTestJSON-701386150 tempest-VolumesGetTestJSON-701386150-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 1.394994 Oct 04 19:05:59.889300 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3222/6419] 10.222.0.20 () {60 vars in 1156 bytes} [Tue Oct 4 19:05:58 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 1402 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 04 19:05:59.898014 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-73336a32-9d9e-4240-90f0-b9ccdc55502e tempest-VolumesGetTestJSON-701386150 tempest-VolumesGetTestJSON-701386150-project] Calling method '.version_select at 0x7fe253e1c310>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:59.963405 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-73336a32-9d9e-4240-90f0-b9ccdc55502e tempest-VolumesGetTestJSON-701386150 tempest-VolumesGetTestJSON-701386150-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/5162b314-aa47-4014-9df1-97834b1887e5" status: 200 len: 352 microversion: 2.1 time: 0.069860 Oct 04 19:05:59.964556 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3223/6420] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Oct 4 19:05:59 2022] GET /compute/v2.1/os-volumes/5162b314-aa47-4014-9df1-97834b1887e5 => generated 352 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:06:00.001642 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-05b43f69-e7fb-460a-80f7-0679442d47bc tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:00.002545 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-05b43f69-e7fb-460a-80f7-0679442d47bc tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:00.038575 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-05b43f69-e7fb-460a-80f7-0679442d47bc tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:00.041561 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-05b43f69-e7fb-460a-80f7-0679442d47bc tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:00.047244 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-05b43f69-e7fb-460a-80f7-0679442d47bc tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:00.051025 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-05b43f69-e7fb-460a-80f7-0679442d47bc tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:00.051634 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-05b43f69-e7fb-460a-80f7-0679442d47bc tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:00.052769 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-05b43f69-e7fb-460a-80f7-0679442d47bc tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:00.294719 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-cb86b5eb-f1ac-4b15-9ac2-18019b1bfd74 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:00.312601 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-cb86b5eb-f1ac-4b15-9ac2-18019b1bfd74 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:00.314555 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-cb86b5eb-f1ac-4b15-9ac2-18019b1bfd74 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:00.315880 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-cb86b5eb-f1ac-4b15-9ac2-18019b1bfd74 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15" status: 200 len: 1732 microversion: 2.20 time: 0.555913 Oct 04 19:06:00.317051 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3198/6421] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:05:59 2022] GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15 => generated 1732 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:06:00.549342 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-05b43f69-e7fb-460a-80f7-0679442d47bc tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:00.561192 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-05b43f69-e7fb-460a-80f7-0679442d47bc tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed" status: 200 len: 1342 microversion: 2.1 time: 0.571241 Oct 04 19:06:00.574253 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3224/6422] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:59 2022] GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed => generated 1342 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:00.979703 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ed879b25-adbe-4ca8-948d-d66f99698449 tempest-VolumesGetTestJSON-701386150 tempest-VolumesGetTestJSON-701386150-project] Calling method '.version_select at 0x7fe2501668b0>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:01.347985 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8e520e3c-c09f-4f6e-a259-68001afae5ac tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:01.349256 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8e520e3c-c09f-4f6e-a259-68001afae5ac tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 0e957abd-68e7-48c3-af4b-74d570d41c15] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:01.358372 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8e520e3c-c09f-4f6e-a259-68001afae5ac tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:01.359724 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8e520e3c-c09f-4f6e-a259-68001afae5ac tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:01.360431 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8e520e3c-c09f-4f6e-a259-68001afae5ac tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:01.361340 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8e520e3c-c09f-4f6e-a259-68001afae5ac tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:01.361960 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8e520e3c-c09f-4f6e-a259-68001afae5ac tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:01.362548 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8e520e3c-c09f-4f6e-a259-68001afae5ac tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:01.733632 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ed879b25-adbe-4ca8-948d-d66f99698449 tempest-VolumesGetTestJSON-701386150 tempest-VolumesGetTestJSON-701386150-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/5162b314-aa47-4014-9df1-97834b1887e5" status: 200 len: 352 microversion: 2.1 time: 0.756746 Oct 04 19:06:01.734440 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3199/6423] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Oct 4 19:06:00 2022] GET /compute/v2.1/os-volumes/5162b314-aa47-4014-9df1-97834b1887e5 => generated 352 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:06:01.739556 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2708f522-65da-431b-9a48-5821b3ee278e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:01.740526 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2708f522-65da-431b-9a48-5821b3ee278e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:01.768383 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2708f522-65da-431b-9a48-5821b3ee278e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:01.770329 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2708f522-65da-431b-9a48-5821b3ee278e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:01.771881 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2708f522-65da-431b-9a48-5821b3ee278e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:01.772841 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2708f522-65da-431b-9a48-5821b3ee278e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:01.784759 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2708f522-65da-431b-9a48-5821b3ee278e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:01.785479 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2708f522-65da-431b-9a48-5821b3ee278e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:01.822167 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8e520e3c-c09f-4f6e-a259-68001afae5ac tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:01.827269 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8e520e3c-c09f-4f6e-a259-68001afae5ac tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:01.835942 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8e520e3c-c09f-4f6e-a259-68001afae5ac tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:01.845288 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8e520e3c-c09f-4f6e-a259-68001afae5ac tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15" status: 200 len: 1732 microversion: 2.20 time: 0.493708 Oct 04 19:06:01.848757 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3225/6424] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:06:01 2022] GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15 => generated 1732 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:06:02.155454 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2708f522-65da-431b-9a48-5821b3ee278e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:02.163827 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2708f522-65da-431b-9a48-5821b3ee278e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed" status: 200 len: 1342 microversion: 2.1 time: 0.428164 Oct 04 19:06:02.169783 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3200/6425] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:01 2022] GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed => generated 1342 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:02.749150 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9de13089-7aaf-4ea0-b25c-1ddc36a8e182 tempest-VolumesGetTestJSON-701386150 tempest-VolumesGetTestJSON-701386150-project] Calling method '.version_select at 0x7fe253cab5e0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:02.850789 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9de13089-7aaf-4ea0-b25c-1ddc36a8e182 tempest-VolumesGetTestJSON-701386150 tempest-VolumesGetTestJSON-701386150-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/5162b314-aa47-4014-9df1-97834b1887e5" status: 200 len: 353 microversion: 2.1 time: 0.106084 Oct 04 19:06:02.851373 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3226/6426] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Oct 4 19:06:02 2022] GET /compute/v2.1/os-volumes/5162b314-aa47-4014-9df1-97834b1887e5 => generated 353 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:06:02.878355 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2884eccd-073e-434d-bffb-1fe75d9e4dc9 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:02.878856 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1c6ef73e-233b-4a6c-abf4-854db46446f8 tempest-VolumesGetTestJSON-701386150 tempest-VolumesGetTestJSON-701386150-project] Calling method '.version_select at 0x7fe2539ecee0>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:02.883236 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2884eccd-073e-434d-bffb-1fe75d9e4dc9 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 0e957abd-68e7-48c3-af4b-74d570d41c15] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:02.903634 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2884eccd-073e-434d-bffb-1fe75d9e4dc9 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:02.909703 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2884eccd-073e-434d-bffb-1fe75d9e4dc9 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:02.911836 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2884eccd-073e-434d-bffb-1fe75d9e4dc9 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:02.917315 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2884eccd-073e-434d-bffb-1fe75d9e4dc9 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:02.917585 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2884eccd-073e-434d-bffb-1fe75d9e4dc9 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:02.918037 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2884eccd-073e-434d-bffb-1fe75d9e4dc9 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:02.989203 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1c6ef73e-233b-4a6c-abf4-854db46446f8 tempest-VolumesGetTestJSON-701386150 tempest-VolumesGetTestJSON-701386150-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/5162b314-aa47-4014-9df1-97834b1887e5" status: 200 len: 353 microversion: 2.1 time: 0.127434 Oct 04 19:06:02.989796 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3201/6427] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Oct 4 19:06:02 2022] GET /compute/v2.1/os-volumes/5162b314-aa47-4014-9df1-97834b1887e5 => generated 353 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:06:03.018588 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9d6d6ce8-170a-484d-b0d6-409ab5136690 tempest-VolumesGetTestJSON-701386150 tempest-VolumesGetTestJSON-701386150-project] Calling method '.version_select at 0x7fe250153790>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:03.217996 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-2884eccd-073e-434d-bffb-1fe75d9e4dc9 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:03.231086 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-2884eccd-073e-434d-bffb-1fe75d9e4dc9 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:03.234226 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-2884eccd-073e-434d-bffb-1fe75d9e4dc9 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:03.235805 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2884eccd-073e-434d-bffb-1fe75d9e4dc9 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15" status: 200 len: 1732 microversion: 2.20 time: 0.363116 Oct 04 19:06:03.237065 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3227/6428] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:06:02 2022] GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15 => generated 1732 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 19:06:03.252647 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-86829921-bcbc-4694-aeeb-e72b240cd1e1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:03.254108 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-86829921-bcbc-4694-aeeb-e72b240cd1e1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:03.262457 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-86829921-bcbc-4694-aeeb-e72b240cd1e1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:03.263299 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-86829921-bcbc-4694-aeeb-e72b240cd1e1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:03.264352 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-86829921-bcbc-4694-aeeb-e72b240cd1e1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:03.267134 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-86829921-bcbc-4694-aeeb-e72b240cd1e1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:03.267134 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-86829921-bcbc-4694-aeeb-e72b240cd1e1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:03.267134 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-86829921-bcbc-4694-aeeb-e72b240cd1e1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:03.372147 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9d6d6ce8-170a-484d-b0d6-409ab5136690 tempest-VolumesGetTestJSON-701386150 tempest-VolumesGetTestJSON-701386150-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/5162b314-aa47-4014-9df1-97834b1887e5" status: 202 len: 0 microversion: 2.1 time: 0.368379 Oct 04 19:06:03.378288 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3202/6429] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Oct 4 19:06:03 2022] DELETE /compute/v2.1/os-volumes/5162b314-aa47-4014-9df1-97834b1887e5 => generated 0 bytes in 376 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:06:03.389471 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-26db1ee3-b8ee-4279-8f05-910bfb760d0c tempest-VolumesGetTestJSON-701386150 tempest-VolumesGetTestJSON-701386150-project] Calling method '.version_select at 0x7fe250188940>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:03.484572 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-26db1ee3-b8ee-4279-8f05-910bfb760d0c tempest-VolumesGetTestJSON-701386150 tempest-VolumesGetTestJSON-701386150-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/5162b314-aa47-4014-9df1-97834b1887e5" status: 200 len: 352 microversion: 2.1 time: 0.104218 Oct 04 19:06:03.485511 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3203/6430] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Oct 4 19:06:03 2022] GET /compute/v2.1/os-volumes/5162b314-aa47-4014-9df1-97834b1887e5 => generated 352 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:06:03.634004 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-86829921-bcbc-4694-aeeb-e72b240cd1e1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:03.648474 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-86829921-bcbc-4694-aeeb-e72b240cd1e1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed" status: 200 len: 1342 microversion: 2.1 time: 0.409936 Oct 04 19:06:03.650040 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3228/6431] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:03 2022] GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed => generated 1342 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:04.282384 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-09fce9e8-2e8f-487f-9519-dc6383832b81 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:04.283763 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-09fce9e8-2e8f-487f-9519-dc6383832b81 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 0e957abd-68e7-48c3-af4b-74d570d41c15] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:04.290893 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-09fce9e8-2e8f-487f-9519-dc6383832b81 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:04.291643 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-09fce9e8-2e8f-487f-9519-dc6383832b81 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:04.292312 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-09fce9e8-2e8f-487f-9519-dc6383832b81 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:04.293481 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-09fce9e8-2e8f-487f-9519-dc6383832b81 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:04.294194 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-09fce9e8-2e8f-487f-9519-dc6383832b81 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:04.294936 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-09fce9e8-2e8f-487f-9519-dc6383832b81 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:04.499612 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a527c21d-8adc-49e4-af54-d895ac41ca61 tempest-VolumesGetTestJSON-701386150 tempest-VolumesGetTestJSON-701386150-project] Calling method '.version_select at 0x7fe25911e700>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:04.561245 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-09fce9e8-2e8f-487f-9519-dc6383832b81 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:04.572385 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-09fce9e8-2e8f-487f-9519-dc6383832b81 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:04.574687 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-09fce9e8-2e8f-487f-9519-dc6383832b81 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:04.577118 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-09fce9e8-2e8f-487f-9519-dc6383832b81 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15" status: 200 len: 1732 microversion: 2.20 time: 0.317786 Oct 04 19:06:04.578808 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3204/6432] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:06:04 2022] GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15 => generated 1732 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:06:04.623716 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a527c21d-8adc-49e4-af54-d895ac41ca61 tempest-VolumesGetTestJSON-701386150 tempest-VolumesGetTestJSON-701386150-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/5162b314-aa47-4014-9df1-97834b1887e5" status: 200 len: 352 microversion: 2.1 time: 0.122947 Oct 04 19:06:04.623716 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3229/6433] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Oct 4 19:06:04 2022] GET /compute/v2.1/os-volumes/5162b314-aa47-4014-9df1-97834b1887e5 => generated 352 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:06:04.704358 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a915ed0c-128b-4865-ac68-1ba19065e195 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:04.709348 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a915ed0c-128b-4865-ac68-1ba19065e195 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:04.726659 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a915ed0c-128b-4865-ac68-1ba19065e195 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:04.735788 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a915ed0c-128b-4865-ac68-1ba19065e195 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:04.736473 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a915ed0c-128b-4865-ac68-1ba19065e195 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:04.745158 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a915ed0c-128b-4865-ac68-1ba19065e195 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:04.750502 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a915ed0c-128b-4865-ac68-1ba19065e195 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:04.751415 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a915ed0c-128b-4865-ac68-1ba19065e195 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:05.144436 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a915ed0c-128b-4865-ac68-1ba19065e195 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:05.163912 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a915ed0c-128b-4865-ac68-1ba19065e195 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed" status: 200 len: 1342 microversion: 2.1 time: 0.486397 Oct 04 19:06:05.165801 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3205/6434] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:04 2022] GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed => generated 1342 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:05.611476 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d95b0ce8-db49-4bf7-9091-caa87e13d3cf tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:05.612215 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d95b0ce8-db49-4bf7-9091-caa87e13d3cf tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 0e957abd-68e7-48c3-af4b-74d570d41c15] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:05.628623 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=54 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:06:05.635339 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d95b0ce8-db49-4bf7-9091-caa87e13d3cf tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:05.635987 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d95b0ce8-db49-4bf7-9091-caa87e13d3cf tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:05.636589 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d95b0ce8-db49-4bf7-9091-caa87e13d3cf tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:05.637394 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d95b0ce8-db49-4bf7-9091-caa87e13d3cf tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:05.638552 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d95b0ce8-db49-4bf7-9091-caa87e13d3cf tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:05.640347 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d95b0ce8-db49-4bf7-9091-caa87e13d3cf tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:05.640953 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e530bf51-8413-4687-8c03-4821b5b71728 tempest-VolumesGetTestJSON-701386150 tempest-VolumesGetTestJSON-701386150-project] Calling method '.version_select at 0x7fe250188d30>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:05.830316 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e530bf51-8413-4687-8c03-4821b5b71728 tempest-VolumesGetTestJSON-701386150 tempest-VolumesGetTestJSON-701386150-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/5162b314-aa47-4014-9df1-97834b1887e5" status: 200 len: 352 microversion: 2.1 time: 0.198538 Oct 04 19:06:05.843037 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3206/6435] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Oct 4 19:06:05 2022] GET /compute/v2.1/os-volumes/5162b314-aa47-4014-9df1-97834b1887e5 => generated 352 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:06:05.970681 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d95b0ce8-db49-4bf7-9091-caa87e13d3cf tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:05.990241 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d95b0ce8-db49-4bf7-9091-caa87e13d3cf tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:05.996219 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d95b0ce8-db49-4bf7-9091-caa87e13d3cf tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:06.012366 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d95b0ce8-db49-4bf7-9091-caa87e13d3cf tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15" status: 200 len: 1719 microversion: 2.20 time: 0.396523 Oct 04 19:06:06.012366 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3230/6436] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:06:05 2022] GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15 => generated 1719 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:06:06.190662 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e9a13196-ce1e-42b0-a0ba-6e55dc060bd8 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:06.191553 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e9a13196-ce1e-42b0-a0ba-6e55dc060bd8 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:06.203947 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e9a13196-ce1e-42b0-a0ba-6e55dc060bd8 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:06.203947 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e9a13196-ce1e-42b0-a0ba-6e55dc060bd8 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:06.203947 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e9a13196-ce1e-42b0-a0ba-6e55dc060bd8 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:06.204629 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e9a13196-ce1e-42b0-a0ba-6e55dc060bd8 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:06.208253 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e9a13196-ce1e-42b0-a0ba-6e55dc060bd8 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:06.218357 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e9a13196-ce1e-42b0-a0ba-6e55dc060bd8 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:06.598284 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e9a13196-ce1e-42b0-a0ba-6e55dc060bd8 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:06.607065 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e9a13196-ce1e-42b0-a0ba-6e55dc060bd8 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed" status: 200 len: 1342 microversion: 2.1 time: 0.420389 Oct 04 19:06:06.626794 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3207/6437] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:06 2022] GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed => generated 1342 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:06.753782 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b1e232eb-006c-4aa2-9d14-8818c713eea8 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-70935776", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": [{"uuid": "e32e6478-987e-4ce8-b59a-932e8f382a00"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1461020954", "security_groups": []}, "os:scheduler_hints": {"different_host": ["a939ed32-d553-4214-9f35-d59e18a5d86b"]}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:06:06.832280 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.neutron [None req-b1e232eb-006c-4aa2-9d14-8818c713eea8 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] validate_networks() for [('e32e6478-987e-4ce8-b59a-932e8f382a00', None, None, None, None, None)] {{(pid=123001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:06:06.845123 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5bbea3d5-33b9-446b-b8ec-361160cbab80 tempest-VolumesGetTestJSON-701386150 tempest-VolumesGetTestJSON-701386150-project] Calling method '.version_select at 0x7fe250188b80>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:06.964076 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5bbea3d5-33b9-446b-b8ec-361160cbab80 tempest-VolumesGetTestJSON-701386150 tempest-VolumesGetTestJSON-701386150-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/5162b314-aa47-4014-9df1-97834b1887e5" status: 200 len: 352 microversion: 2.1 time: 0.115766 Oct 04 19:06:06.964076 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3208/6438] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Oct 4 19:06:06 2022] GET /compute/v2.1/os-volumes/5162b314-aa47-4014-9df1-97834b1887e5 => generated 352 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:06:07.634067 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-b1e232eb-006c-4aa2-9d14-8818c713eea8 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:06:07.635492 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-b1e232eb-006c-4aa2-9d14-8818c713eea8 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:06:07.636026 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-b1e232eb-006c-4aa2-9d14-8818c713eea8 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:06:07.636629 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-b1e232eb-006c-4aa2-9d14-8818c713eea8 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:06:07.637200 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-b1e232eb-006c-4aa2-9d14-8818c713eea8 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:06:07.641800 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-058a28b4-ab69-44b0-a5c0-bd13298b15a6 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:07.642450 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-058a28b4-ab69-44b0-a5c0-bd13298b15a6 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:07.647447 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b1e232eb-006c-4aa2-9d14-8818c713eea8 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:07.648242 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b1e232eb-006c-4aa2-9d14-8818c713eea8 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:07.649097 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b1e232eb-006c-4aa2-9d14-8818c713eea8 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:07.656746 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-058a28b4-ab69-44b0-a5c0-bd13298b15a6 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:07.657519 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-058a28b4-ab69-44b0-a5c0-bd13298b15a6 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:07.658133 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-058a28b4-ab69-44b0-a5c0-bd13298b15a6 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:07.659050 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-058a28b4-ab69-44b0-a5c0-bd13298b15a6 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:07.659687 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-058a28b4-ab69-44b0-a5c0-bd13298b15a6 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:07.660313 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-058a28b4-ab69-44b0-a5c0-bd13298b15a6 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:07.664654 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b1e232eb-006c-4aa2-9d14-8818c713eea8 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:07.665378 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b1e232eb-006c-4aa2-9d14-8818c713eea8 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:07.665841 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b1e232eb-006c-4aa2-9d14-8818c713eea8 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:07.704454 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-b1e232eb-006c-4aa2-9d14-8818c713eea8 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Getting quotas for project 7c177dc51b8e4a969670684997f3cb2a. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:06:07.710696 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-b1e232eb-006c-4aa2-9d14-8818c713eea8 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Getting quotas for user c1e772e66d8c42dfa995bbecb6b9ccf9 and project 7c177dc51b8e4a969670684997f3cb2a. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:06:07.740815 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b1e232eb-006c-4aa2-9d14-8818c713eea8 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Going to run 1 instances... {{(pid=123001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:06:07.751452 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b1e232eb-006c-4aa2-9d14-8818c713eea8 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] [instance: 561b8955-712b-4559-a81a-95bb656e4bbe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:06:07.901555 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-058a28b4-ab69-44b0-a5c0-bd13298b15a6 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:07.910025 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-058a28b4-ab69-44b0-a5c0-bd13298b15a6 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed" status: 200 len: 1342 microversion: 2.1 time: 0.272692 Oct 04 19:06:07.910603 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3209/6439] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:07 2022] GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed => generated 1342 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:06:07.940456 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b1e232eb-006c-4aa2-9d14-8818c713eea8 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 1.190660 Oct 04 19:06:07.942010 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3231/6440] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 19:06:06 2022] POST /compute/v2.1/servers => generated 361 bytes in 1194 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:06:07.954323 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a22a18ba-f881-457d-8a07-71de186ec5c9 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:07.955112 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a22a18ba-f881-457d-8a07-71de186ec5c9 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] [instance: 561b8955-712b-4559-a81a-95bb656e4bbe] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:07.980587 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f176d046-acfa-41a7-8f9a-af2e3b87cc5b tempest-VolumesGetTestJSON-701386150 tempest-VolumesGetTestJSON-701386150-project] Calling method '.version_select at 0x7fe25921c280>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:08.019952 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-f176d046-acfa-41a7-8f9a-af2e3b87cc5b tempest-VolumesGetTestJSON-701386150 tempest-VolumesGetTestJSON-701386150-project] HTTP exception thrown: Volume 5162b314-aa47-4014-9df1-97834b1887e5 could not be found. Oct 04 19:06:08.038816 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f176d046-acfa-41a7-8f9a-af2e3b87cc5b tempest-VolumesGetTestJSON-701386150 tempest-VolumesGetTestJSON-701386150-project] Request method failure captured: Oct 04 19:06:08.038816 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/os-volumes/5162b314-aa47-4014-9df1-97834b1887e5 HTTP/1.1 Oct 04 19:06:08.038816 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 19:06:08.038816 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 19:06:08.038816 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 19:06:08.038816 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 19:06:08.038816 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 19:06:08.038816 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 19:06:08.038816 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 19:06:08.038816 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 19:06:08.038816 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPIQW_VWcuLC1TyTJDhcsY5LYSRfhsB7zwElOjLK9-Ts0zKKZFdJw6NG_BPJmVfmkVesxQifPSiYWqPmPW-txm71jwhn9ob1tfnHclAIgqzDKahmsE5J5Uu9tiJQYjWarPupfBepEB96c5c4VRGvLWFJENEFS2OuYIkoTu_ASGE5bJgI Oct 04 19:06:08.038816 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 19:06:08.038816 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 19:06:08.038816 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 19:06:08.038816 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 19:06:08.038816 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 19:06:08.038816 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 19:06:08.038816 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: c670304aeae846f3a619691e20137667 Oct 04 19:06:08.038816 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-VolumesGetTestJSON-701386150 Oct 04 19:06:08.038816 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 19:06:08.038816 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 19:06:08.038816 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c670304aeae846f3a619691e20137667"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c670304aeae846f3a619691e20137667", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c670304aeae846f3a619691e20137667"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c670304aeae846f3a619691e20137667"}]}] Oct 04 19:06:08.038816 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-VolumesGetTestJSON-701386150 Oct 04 19:06:08.038816 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: c670304aeae846f3a619691e20137667 Oct 04 19:06:08.038816 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-VolumesGetTestJSON-701386150 Oct 04 19:06:08.038816 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-VolumesGetTestJSON-701386150-project Oct 04 19:06:08.038816 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 19:06:08.038816 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 19:06:08.038816 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: ab63176586f0481694e0e1f24800ee6d Oct 04 19:06:08.038816 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-VolumesGetTestJSON-701386150-project Oct 04 19:06:08.038816 n-d-850501-14 devstack@n-api.service[123001]: method: Oct 04 19:06:08.038816 n-d-850501-14 devstack@n-api.service[123001]: exception: Volume 5162b314-aa47-4014-9df1-97834b1887e5 could not be found. Oct 04 19:06:08.038816 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '5162b314-aa47-4014-9df1-97834b1887e5'} Oct 04 19:06:08.038816 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:06:08.038816 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:06:08.038816 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 19:06:08.038816 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 19:06:08.038816 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 19:06:08.038816 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 19:06:08.038816 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 19:06:08.038816 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 19:06:08.038816 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 19:06:08.038816 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 19:06:08.038816 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 19:06:08.038816 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 19:06:08.038816 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 19:06:08.038816 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 19:06:08.038816 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 19:06:08.038816 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 19:06:08.038816 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5162b314-aa47-4014-9df1-97834b1887e5 could not be found. (HTTP 404) (Request-ID: req-e4eecc6e-242e-4704-a36b-bdeed0d3dbd4) Oct 04 19:06:08.038816 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:06:08.038816 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:06:08.038816 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:06:08.038816 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:06:08.038816 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 04 19:06:08.038816 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 04 19:06:08.038816 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 19:06:08.038816 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 19:06:08.038816 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 19:06:08.038816 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 19:06:08.038816 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 19:06:08.038816 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 19:06:08.038816 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 19:06:08.043756 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 19:06:08.043756 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 19:06:08.043756 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 19:06:08.043756 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 19:06:08.043756 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 19:06:08.043756 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 19:06:08.043756 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 19:06:08.043756 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 19:06:08.043756 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 19:06:08.043756 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 19:06:08.043756 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 19:06:08.043756 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 19:06:08.043756 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 19:06:08.043756 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5162b314-aa47-4014-9df1-97834b1887e5 could not be found. Oct 04 19:06:08.043756 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:06:08.043756 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:06:08.043756 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:06:08.043756 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:06:08.043756 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:06:08.043756 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:06:08.043756 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:06:08.043756 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:06:08.043756 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 19:06:08.043756 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 19:06:08.043756 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:06:08.043756 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:06:08.043756 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 04 19:06:08.043756 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:06:08.043756 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5162b314-aa47-4014-9df1-97834b1887e5 could not be found. Oct 04 19:06:08.043756 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:06:08.043756 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:06:08.043756 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:06:08.043756 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:06:08.043756 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:06:08.043756 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:06:08.043756 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:06:08.043756 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:06:08.043756 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5162b314-aa47-4014-9df1-97834b1887e5 could not be found. Oct 04 19:06:08.043756 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:06:08.053701 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f176d046-acfa-41a7-8f9a-af2e3b87cc5b tempest-VolumesGetTestJSON-701386150 tempest-VolumesGetTestJSON-701386150-project] Returning 404 to user: Volume 5162b314-aa47-4014-9df1-97834b1887e5 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:06:08.057539 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f176d046-acfa-41a7-8f9a-af2e3b87cc5b tempest-VolumesGetTestJSON-701386150 tempest-VolumesGetTestJSON-701386150-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/5162b314-aa47-4014-9df1-97834b1887e5" status: 404 len: 109 microversion: 2.1 time: 0.088210 Oct 04 19:06:08.059627 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3232/6441] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Oct 4 19:06:07 2022] GET /compute/v2.1/os-volumes/5162b314-aa47-4014-9df1-97834b1887e5 => generated 109 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 19:06:08.141055 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a22a18ba-f881-457d-8a07-71de186ec5c9 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e772e66d8c42dfa995bbecb6b9ccf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c177dc51b8e4a969670684997f3cb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:08.149668 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a22a18ba-f881-457d-8a07-71de186ec5c9 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] 10.222.0.20 "GET /compute/v2.1/servers/561b8955-712b-4559-a81a-95bb656e4bbe" status: 200 len: 1240 microversion: 2.1 time: 0.200150 Oct 04 19:06:08.150269 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3210/6442] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:07 2022] GET /compute/v2.1/servers/561b8955-712b-4559-a81a-95bb656e4bbe => generated 1240 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:08.934749 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-30ee2313-e841-4581-bf9d-f5c815ddf3ab tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:08.935381 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-30ee2313-e841-4581-bf9d-f5c815ddf3ab tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:08.948495 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-30ee2313-e841-4581-bf9d-f5c815ddf3ab tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:08.950936 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-30ee2313-e841-4581-bf9d-f5c815ddf3ab tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:08.951458 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-30ee2313-e841-4581-bf9d-f5c815ddf3ab tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:08.952232 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-30ee2313-e841-4581-bf9d-f5c815ddf3ab tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:08.958315 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-30ee2313-e841-4581-bf9d-f5c815ddf3ab tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:08.958846 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-30ee2313-e841-4581-bf9d-f5c815ddf3ab tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:09.176044 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-89061b55-35dc-43a4-a7d9-403d2a84fda9 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:09.177262 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-89061b55-35dc-43a4-a7d9-403d2a84fda9 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] [instance: 561b8955-712b-4559-a81a-95bb656e4bbe] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:09.293981 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-89061b55-35dc-43a4-a7d9-403d2a84fda9 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e772e66d8c42dfa995bbecb6b9ccf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c177dc51b8e4a969670684997f3cb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:09.320380 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-89061b55-35dc-43a4-a7d9-403d2a84fda9 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] 10.222.0.20 "GET /compute/v2.1/servers/561b8955-712b-4559-a81a-95bb656e4bbe" status: 200 len: 1240 microversion: 2.1 time: 0.135819 Oct 04 19:06:09.320380 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3211/6443] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:09 2022] GET /compute/v2.1/servers/561b8955-712b-4559-a81a-95bb656e4bbe => generated 1240 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:06:09.416799 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-30ee2313-e841-4581-bf9d-f5c815ddf3ab tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:09.426174 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-30ee2313-e841-4581-bf9d-f5c815ddf3ab tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed" status: 200 len: 1342 microversion: 2.1 time: 0.495893 Oct 04 19:06:09.446439 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3233/6444] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:08 2022] GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed => generated 1342 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:10.336232 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-94513755-8283-411e-8683-dbe8ad27e30d tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:10.337256 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-94513755-8283-411e-8683-dbe8ad27e30d tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] [instance: 561b8955-712b-4559-a81a-95bb656e4bbe] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:10.345428 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-94513755-8283-411e-8683-dbe8ad27e30d tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:10.346194 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-94513755-8283-411e-8683-dbe8ad27e30d tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:10.347029 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-94513755-8283-411e-8683-dbe8ad27e30d tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:10.347866 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-94513755-8283-411e-8683-dbe8ad27e30d tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:10.348422 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-94513755-8283-411e-8683-dbe8ad27e30d tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:10.348862 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-94513755-8283-411e-8683-dbe8ad27e30d tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:10.420531 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-94513755-8283-411e-8683-dbe8ad27e30d tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e772e66d8c42dfa995bbecb6b9ccf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c177dc51b8e4a969670684997f3cb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:10.432842 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-94513755-8283-411e-8683-dbe8ad27e30d tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] 10.222.0.20 "GET /compute/v2.1/servers/561b8955-712b-4559-a81a-95bb656e4bbe" status: 200 len: 1236 microversion: 2.1 time: 0.100765 Oct 04 19:06:10.433456 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3212/6445] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:10 2022] GET /compute/v2.1/servers/561b8955-712b-4559-a81a-95bb656e4bbe => generated 1236 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:10.458122 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-bf9b83db-1f97-4ca0-a3a0-327bd19f214d tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:10.459333 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-bf9b83db-1f97-4ca0-a3a0-327bd19f214d tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:10.467402 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bf9b83db-1f97-4ca0-a3a0-327bd19f214d tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:10.468193 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bf9b83db-1f97-4ca0-a3a0-327bd19f214d tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:10.468637 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bf9b83db-1f97-4ca0-a3a0-327bd19f214d tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:10.469386 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bf9b83db-1f97-4ca0-a3a0-327bd19f214d tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:10.469847 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bf9b83db-1f97-4ca0-a3a0-327bd19f214d tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:10.470284 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bf9b83db-1f97-4ca0-a3a0-327bd19f214d tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:10.658378 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-bf9b83db-1f97-4ca0-a3a0-327bd19f214d tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:10.667427 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-bf9b83db-1f97-4ca0-a3a0-327bd19f214d tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed" status: 200 len: 1388 microversion: 2.1 time: 0.213652 Oct 04 19:06:10.668417 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3234/6446] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:10 2022] GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed => generated 1388 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:11.459311 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-340397af-c25a-47ad-9f5f-57a899607433 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:11.459878 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-340397af-c25a-47ad-9f5f-57a899607433 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] [instance: 561b8955-712b-4559-a81a-95bb656e4bbe] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:11.467868 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-340397af-c25a-47ad-9f5f-57a899607433 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:11.468650 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-340397af-c25a-47ad-9f5f-57a899607433 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:11.469488 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-340397af-c25a-47ad-9f5f-57a899607433 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:11.471069 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-340397af-c25a-47ad-9f5f-57a899607433 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:11.472013 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-340397af-c25a-47ad-9f5f-57a899607433 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:11.476621 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-340397af-c25a-47ad-9f5f-57a899607433 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:11.540706 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-340397af-c25a-47ad-9f5f-57a899607433 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e772e66d8c42dfa995bbecb6b9ccf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c177dc51b8e4a969670684997f3cb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:11.550803 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-340397af-c25a-47ad-9f5f-57a899607433 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] 10.222.0.20 "GET /compute/v2.1/servers/561b8955-712b-4559-a81a-95bb656e4bbe" status: 200 len: 1292 microversion: 2.1 time: 0.095960 Oct 04 19:06:11.551376 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3213/6447] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:11 2022] GET /compute/v2.1/servers/561b8955-712b-4559-a81a-95bb656e4bbe => generated 1292 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:11.693096 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6fb058a7-00ab-4f3a-9dfd-061262de6206 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:11.700215 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6fb058a7-00ab-4f3a-9dfd-061262de6206 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:11.713389 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6fb058a7-00ab-4f3a-9dfd-061262de6206 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:11.714242 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6fb058a7-00ab-4f3a-9dfd-061262de6206 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:11.714857 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6fb058a7-00ab-4f3a-9dfd-061262de6206 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:11.715741 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6fb058a7-00ab-4f3a-9dfd-061262de6206 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:11.717360 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6fb058a7-00ab-4f3a-9dfd-061262de6206 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:11.718412 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6fb058a7-00ab-4f3a-9dfd-061262de6206 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:11.987647 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6fb058a7-00ab-4f3a-9dfd-061262de6206 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:12.003805 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6fb058a7-00ab-4f3a-9dfd-061262de6206 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed" status: 200 len: 1376 microversion: 2.1 time: 0.311507 Oct 04 19:06:12.007319 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3235/6448] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:11 2022] GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed => generated 1376 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:12.576913 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-bb850eb7-8b39-4a70-ac31-5ff90d49f78f tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:12.576913 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-bb850eb7-8b39-4a70-ac31-5ff90d49f78f tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] [instance: 561b8955-712b-4559-a81a-95bb656e4bbe] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:12.582477 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bb850eb7-8b39-4a70-ac31-5ff90d49f78f tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:12.583828 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bb850eb7-8b39-4a70-ac31-5ff90d49f78f tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:12.584505 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bb850eb7-8b39-4a70-ac31-5ff90d49f78f tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:12.585264 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bb850eb7-8b39-4a70-ac31-5ff90d49f78f tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:12.585734 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bb850eb7-8b39-4a70-ac31-5ff90d49f78f tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:12.586508 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bb850eb7-8b39-4a70-ac31-5ff90d49f78f tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:12.669433 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-bb850eb7-8b39-4a70-ac31-5ff90d49f78f tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e772e66d8c42dfa995bbecb6b9ccf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c177dc51b8e4a969670684997f3cb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:12.678735 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-bb850eb7-8b39-4a70-ac31-5ff90d49f78f tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] 10.222.0.20 "GET /compute/v2.1/servers/561b8955-712b-4559-a81a-95bb656e4bbe" status: 200 len: 1298 microversion: 2.1 time: 0.109275 Oct 04 19:06:12.680275 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3214/6449] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:12 2022] GET /compute/v2.1/servers/561b8955-712b-4559-a81a-95bb656e4bbe => generated 1298 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:13.052035 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1f32df83-e4f9-4b97-9290-c43bd6c4a905 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:13.052696 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1f32df83-e4f9-4b97-9290-c43bd6c4a905 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:13.069753 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1f32df83-e4f9-4b97-9290-c43bd6c4a905 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:13.070267 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1f32df83-e4f9-4b97-9290-c43bd6c4a905 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:13.070714 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1f32df83-e4f9-4b97-9290-c43bd6c4a905 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:13.071455 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1f32df83-e4f9-4b97-9290-c43bd6c4a905 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:13.071905 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1f32df83-e4f9-4b97-9290-c43bd6c4a905 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:13.076756 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1f32df83-e4f9-4b97-9290-c43bd6c4a905 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:13.421041 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1f32df83-e4f9-4b97-9290-c43bd6c4a905 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:13.439482 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1f32df83-e4f9-4b97-9290-c43bd6c4a905 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed" status: 200 len: 1376 microversion: 2.1 time: 0.386269 Oct 04 19:06:13.439482 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3236/6450] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:13 2022] GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed => generated 1376 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:13.702079 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1439d48c-ca04-44cc-a10e-c14b96bc2e4d tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:13.702959 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1439d48c-ca04-44cc-a10e-c14b96bc2e4d tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] [instance: 561b8955-712b-4559-a81a-95bb656e4bbe] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:13.712433 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1439d48c-ca04-44cc-a10e-c14b96bc2e4d tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:13.712433 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1439d48c-ca04-44cc-a10e-c14b96bc2e4d tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:13.712433 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1439d48c-ca04-44cc-a10e-c14b96bc2e4d tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:13.712433 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1439d48c-ca04-44cc-a10e-c14b96bc2e4d tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:13.712433 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1439d48c-ca04-44cc-a10e-c14b96bc2e4d tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:13.718420 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1439d48c-ca04-44cc-a10e-c14b96bc2e4d tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:14.231493 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1439d48c-ca04-44cc-a10e-c14b96bc2e4d tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e772e66d8c42dfa995bbecb6b9ccf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c177dc51b8e4a969670684997f3cb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:14.249039 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1439d48c-ca04-44cc-a10e-c14b96bc2e4d tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] 10.222.0.20 "GET /compute/v2.1/servers/561b8955-712b-4559-a81a-95bb656e4bbe" status: 200 len: 1298 microversion: 2.1 time: 0.550716 Oct 04 19:06:14.250244 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3215/6451] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:13 2022] GET /compute/v2.1/servers/561b8955-712b-4559-a81a-95bb656e4bbe => generated 1298 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:14.475214 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c6a06067-4d61-4fe8-99b1-bcac910a0a96 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:14.475214 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c6a06067-4d61-4fe8-99b1-bcac910a0a96 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:14.475214 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c6a06067-4d61-4fe8-99b1-bcac910a0a96 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:14.475214 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c6a06067-4d61-4fe8-99b1-bcac910a0a96 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:14.475214 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c6a06067-4d61-4fe8-99b1-bcac910a0a96 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:14.475214 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c6a06067-4d61-4fe8-99b1-bcac910a0a96 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:14.476272 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c6a06067-4d61-4fe8-99b1-bcac910a0a96 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:14.476272 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c6a06067-4d61-4fe8-99b1-bcac910a0a96 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:14.626730 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c6a06067-4d61-4fe8-99b1-bcac910a0a96 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:14.636146 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c6a06067-4d61-4fe8-99b1-bcac910a0a96 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed" status: 200 len: 1376 microversion: 2.1 time: 0.177187 Oct 04 19:06:14.637376 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3237/6452] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:14 2022] GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed => generated 1376 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:14.670172 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-23a72876-214b-4b39-8143-8f6479a561d2 req-c9216cf4-1387-4a73-8a52-69e2ef932a1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "561b8955-712b-4559-a81a-95bb656e4bbe", "tag": "4bb38b7c-052b-47af-bb83-a4a4d178dad8"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:06:14.687869 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-23a72876-214b-4b39-8143-8f6479a561d2 req-c9216cf4-1387-4a73-8a52-69e2ef932a1b service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:14.691532 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-23a72876-214b-4b39-8143-8f6479a561d2 req-c9216cf4-1387-4a73-8a52-69e2ef932a1b service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:14.691532 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-23a72876-214b-4b39-8143-8f6479a561d2 req-c9216cf4-1387-4a73-8a52-69e2ef932a1b service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:14.708522 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-23a72876-214b-4b39-8143-8f6479a561d2 req-c9216cf4-1387-4a73-8a52-69e2ef932a1b service nova] Creating event network-changed:4bb38b7c-052b-47af-bb83-a4a4d178dad8 for instance 561b8955-712b-4559-a81a-95bb656e4bbe on n-h1-850501-14 Oct 04 19:06:14.718755 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-23a72876-214b-4b39-8143-8f6479a561d2 req-c9216cf4-1387-4a73-8a52-69e2ef932a1b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052605 Oct 04 19:06:14.719630 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3216/6453] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:06:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:06:15.272832 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-89fc7b9b-1ee6-4caf-bcea-bfe00246b7ca tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:15.273674 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-89fc7b9b-1ee6-4caf-bcea-bfe00246b7ca tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] [instance: 561b8955-712b-4559-a81a-95bb656e4bbe] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:15.283240 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-89fc7b9b-1ee6-4caf-bcea-bfe00246b7ca tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:15.283240 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-89fc7b9b-1ee6-4caf-bcea-bfe00246b7ca tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:15.283240 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-89fc7b9b-1ee6-4caf-bcea-bfe00246b7ca tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:15.283240 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-89fc7b9b-1ee6-4caf-bcea-bfe00246b7ca tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:15.283712 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-89fc7b9b-1ee6-4caf-bcea-bfe00246b7ca tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:15.284375 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-89fc7b9b-1ee6-4caf-bcea-bfe00246b7ca tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:15.418565 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-89fc7b9b-1ee6-4caf-bcea-bfe00246b7ca tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e772e66d8c42dfa995bbecb6b9ccf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c177dc51b8e4a969670684997f3cb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:15.427511 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-89fc7b9b-1ee6-4caf-bcea-bfe00246b7ca tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] 10.222.0.20 "GET /compute/v2.1/servers/561b8955-712b-4559-a81a-95bb656e4bbe" status: 200 len: 1298 microversion: 2.1 time: 0.159056 Oct 04 19:06:15.428280 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3238/6454] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:15 2022] GET /compute/v2.1/servers/561b8955-712b-4559-a81a-95bb656e4bbe => generated 1298 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:15.660281 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-22da614d-58e4-45f1-9000-6201a6af8a94 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:15.661241 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-22da614d-58e4-45f1-9000-6201a6af8a94 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:15.668604 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-22da614d-58e4-45f1-9000-6201a6af8a94 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:15.669385 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-22da614d-58e4-45f1-9000-6201a6af8a94 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:15.670317 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-22da614d-58e4-45f1-9000-6201a6af8a94 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:15.671456 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-22da614d-58e4-45f1-9000-6201a6af8a94 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:15.671967 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-22da614d-58e4-45f1-9000-6201a6af8a94 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:15.672734 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-22da614d-58e4-45f1-9000-6201a6af8a94 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:15.853472 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-22da614d-58e4-45f1-9000-6201a6af8a94 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:15.862736 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-22da614d-58e4-45f1-9000-6201a6af8a94 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed" status: 200 len: 1376 microversion: 2.1 time: 0.206759 Oct 04 19:06:15.863388 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3217/6455] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:15 2022] GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed => generated 1376 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:16.450594 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-47872657-0963-4265-aabd-2a574ac7b8c2 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:16.451356 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-47872657-0963-4265-aabd-2a574ac7b8c2 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] [instance: 561b8955-712b-4559-a81a-95bb656e4bbe] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:16.459837 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-47872657-0963-4265-aabd-2a574ac7b8c2 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:16.460437 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-47872657-0963-4265-aabd-2a574ac7b8c2 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:16.460881 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-47872657-0963-4265-aabd-2a574ac7b8c2 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:16.461583 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-47872657-0963-4265-aabd-2a574ac7b8c2 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:16.462041 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-47872657-0963-4265-aabd-2a574ac7b8c2 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:16.462654 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-47872657-0963-4265-aabd-2a574ac7b8c2 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:16.553188 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-47872657-0963-4265-aabd-2a574ac7b8c2 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e772e66d8c42dfa995bbecb6b9ccf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c177dc51b8e4a969670684997f3cb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:16.561933 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-47872657-0963-4265-aabd-2a574ac7b8c2 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] 10.222.0.20 "GET /compute/v2.1/servers/561b8955-712b-4559-a81a-95bb656e4bbe" status: 200 len: 1298 microversion: 2.1 time: 0.115242 Oct 04 19:06:16.568591 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3239/6456] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:16 2022] GET /compute/v2.1/servers/561b8955-712b-4559-a81a-95bb656e4bbe => generated 1298 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:06:16.890193 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e9660209-d215-4188-930a-8f975774e81f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:16.891149 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e9660209-d215-4188-930a-8f975774e81f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:16.899663 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e9660209-d215-4188-930a-8f975774e81f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:16.900213 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e9660209-d215-4188-930a-8f975774e81f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:16.900863 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e9660209-d215-4188-930a-8f975774e81f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:16.901807 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e9660209-d215-4188-930a-8f975774e81f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:16.902281 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e9660209-d215-4188-930a-8f975774e81f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:16.902729 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e9660209-d215-4188-930a-8f975774e81f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:17.077285 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e9660209-d215-4188-930a-8f975774e81f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:17.087826 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e9660209-d215-4188-930a-8f975774e81f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed" status: 200 len: 1376 microversion: 2.1 time: 0.201602 Oct 04 19:06:17.088616 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3218/6457] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:16 2022] GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed => generated 1376 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:06:17.585185 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-76073380-8fe5-4670-a307-6410fba907bd tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:17.585798 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-76073380-8fe5-4670-a307-6410fba907bd tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] [instance: 561b8955-712b-4559-a81a-95bb656e4bbe] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:17.593443 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-76073380-8fe5-4670-a307-6410fba907bd tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:17.593944 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-76073380-8fe5-4670-a307-6410fba907bd tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:17.594389 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-76073380-8fe5-4670-a307-6410fba907bd tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:17.595543 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-76073380-8fe5-4670-a307-6410fba907bd tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:17.596078 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-76073380-8fe5-4670-a307-6410fba907bd tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:17.596605 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-76073380-8fe5-4670-a307-6410fba907bd tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:17.694896 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:06:17.698394 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-76073380-8fe5-4670-a307-6410fba907bd tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e772e66d8c42dfa995bbecb6b9ccf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c177dc51b8e4a969670684997f3cb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:17.706775 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-76073380-8fe5-4670-a307-6410fba907bd tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] 10.222.0.20 "GET /compute/v2.1/servers/561b8955-712b-4559-a81a-95bb656e4bbe" status: 200 len: 1298 microversion: 2.1 time: 0.125595 Oct 04 19:06:17.707386 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3240/6458] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:17 2022] GET /compute/v2.1/servers/561b8955-712b-4559-a81a-95bb656e4bbe => generated 1298 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:18.113037 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-dfdeaf58-dfd5-41e4-98ff-cac7358f9687 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:18.113671 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-dfdeaf58-dfd5-41e4-98ff-cac7358f9687 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:18.120932 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dfdeaf58-dfd5-41e4-98ff-cac7358f9687 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:18.121880 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dfdeaf58-dfd5-41e4-98ff-cac7358f9687 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:18.122637 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dfdeaf58-dfd5-41e4-98ff-cac7358f9687 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:18.124302 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dfdeaf58-dfd5-41e4-98ff-cac7358f9687 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:18.125016 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dfdeaf58-dfd5-41e4-98ff-cac7358f9687 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:18.125657 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dfdeaf58-dfd5-41e4-98ff-cac7358f9687 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:18.287365 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-dfdeaf58-dfd5-41e4-98ff-cac7358f9687 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:18.296389 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-dfdeaf58-dfd5-41e4-98ff-cac7358f9687 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed" status: 200 len: 1376 microversion: 2.1 time: 0.187284 Oct 04 19:06:18.309570 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3219/6459] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:18 2022] GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed => generated 1376 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:18.733046 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0e0e7bdd-07e3-4692-ac45-5e8e19cd7d2f tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:18.733674 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0e0e7bdd-07e3-4692-ac45-5e8e19cd7d2f tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] [instance: 561b8955-712b-4559-a81a-95bb656e4bbe] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:18.737632 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=6 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:06:18.752229 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0e0e7bdd-07e3-4692-ac45-5e8e19cd7d2f tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:18.753143 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0e0e7bdd-07e3-4692-ac45-5e8e19cd7d2f tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:18.753972 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0e0e7bdd-07e3-4692-ac45-5e8e19cd7d2f tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:18.757403 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0e0e7bdd-07e3-4692-ac45-5e8e19cd7d2f tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:18.759818 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0e0e7bdd-07e3-4692-ac45-5e8e19cd7d2f tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:18.760601 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0e0e7bdd-07e3-4692-ac45-5e8e19cd7d2f tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:18.945824 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0e0e7bdd-07e3-4692-ac45-5e8e19cd7d2f tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e772e66d8c42dfa995bbecb6b9ccf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c177dc51b8e4a969670684997f3cb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:18.955278 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0e0e7bdd-07e3-4692-ac45-5e8e19cd7d2f tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] 10.222.0.20 "GET /compute/v2.1/servers/561b8955-712b-4559-a81a-95bb656e4bbe" status: 200 len: 1298 microversion: 2.1 time: 0.226977 Oct 04 19:06:18.957618 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3241/6460] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:18 2022] GET /compute/v2.1/servers/561b8955-712b-4559-a81a-95bb656e4bbe => generated 1298 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:19.267933 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-0c9a6b10-6725-4e5b-b245-20d5ba464ea1 req-b46157be-4cad-47c5-814e-6a4da93f32a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "561b8955-712b-4559-a81a-95bb656e4bbe", "name": "network-vif-plugged", "status": "completed", "tag": "4bb38b7c-052b-47af-bb83-a4a4d178dad8"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:06:19.297088 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-0c9a6b10-6725-4e5b-b245-20d5ba464ea1 req-b46157be-4cad-47c5-814e-6a4da93f32a6 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:19.297626 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-0c9a6b10-6725-4e5b-b245-20d5ba464ea1 req-b46157be-4cad-47c5-814e-6a4da93f32a6 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:19.303146 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-0c9a6b10-6725-4e5b-b245-20d5ba464ea1 req-b46157be-4cad-47c5-814e-6a4da93f32a6 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:19.324407 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-02687839-571a-46e3-9d30-4bfae2076eef tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:19.325388 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-02687839-571a-46e3-9d30-4bfae2076eef tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:19.332362 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=4 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:06:19.339387 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-02687839-571a-46e3-9d30-4bfae2076eef tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:19.344219 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-02687839-571a-46e3-9d30-4bfae2076eef tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:19.344219 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-02687839-571a-46e3-9d30-4bfae2076eef tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:19.344219 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-02687839-571a-46e3-9d30-4bfae2076eef tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:19.345971 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-02687839-571a-46e3-9d30-4bfae2076eef tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:19.350649 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-0c9a6b10-6725-4e5b-b245-20d5ba464ea1 req-b46157be-4cad-47c5-814e-6a4da93f32a6 service nova] Creating event network-vif-plugged:4bb38b7c-052b-47af-bb83-a4a4d178dad8 for instance 561b8955-712b-4559-a81a-95bb656e4bbe on n-h1-850501-14 Oct 04 19:06:19.352583 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-02687839-571a-46e3-9d30-4bfae2076eef tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:19.367396 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-0c9a6b10-6725-4e5b-b245-20d5ba464ea1 req-b46157be-4cad-47c5-814e-6a4da93f32a6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093950 Oct 04 19:06:19.371888 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3220/6461] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:06:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:06:19.696528 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-02687839-571a-46e3-9d30-4bfae2076eef tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:19.710434 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-02687839-571a-46e3-9d30-4bfae2076eef tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed" status: 200 len: 1376 microversion: 2.1 time: 0.393437 Oct 04 19:06:19.711705 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3242/6462] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:19 2022] GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed => generated 1376 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:19.984219 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7be77bdd-d4b4-4b39-97ea-819271a9989f tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:19.985802 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7be77bdd-d4b4-4b39-97ea-819271a9989f tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] [instance: 561b8955-712b-4559-a81a-95bb656e4bbe] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:20.001855 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7be77bdd-d4b4-4b39-97ea-819271a9989f tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:20.001855 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7be77bdd-d4b4-4b39-97ea-819271a9989f tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:20.006041 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7be77bdd-d4b4-4b39-97ea-819271a9989f tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:20.007513 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7be77bdd-d4b4-4b39-97ea-819271a9989f tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:20.008219 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7be77bdd-d4b4-4b39-97ea-819271a9989f tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:20.008680 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7be77bdd-d4b4-4b39-97ea-819271a9989f tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:20.141969 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7be77bdd-d4b4-4b39-97ea-819271a9989f tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e772e66d8c42dfa995bbecb6b9ccf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c177dc51b8e4a969670684997f3cb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:20.145901 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=100 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:06:20.150872 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7be77bdd-d4b4-4b39-97ea-819271a9989f tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] 10.222.0.20 "GET /compute/v2.1/servers/561b8955-712b-4559-a81a-95bb656e4bbe" status: 200 len: 1298 microversion: 2.1 time: 0.173970 Oct 04 19:06:20.153117 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3221/6463] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:19 2022] GET /compute/v2.1/servers/561b8955-712b-4559-a81a-95bb656e4bbe => generated 1298 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:20.739958 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f5851749-b172-4bab-bca2-499c5a857c6f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:20.740707 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f5851749-b172-4bab-bca2-499c5a857c6f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:20.750446 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f5851749-b172-4bab-bca2-499c5a857c6f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:20.751078 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f5851749-b172-4bab-bca2-499c5a857c6f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:20.751522 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f5851749-b172-4bab-bca2-499c5a857c6f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:20.752352 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f5851749-b172-4bab-bca2-499c5a857c6f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:20.752789 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f5851749-b172-4bab-bca2-499c5a857c6f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:20.753221 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f5851749-b172-4bab-bca2-499c5a857c6f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:20.757971 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=100 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:06:20.959283 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f5851749-b172-4bab-bca2-499c5a857c6f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:20.972775 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f5851749-b172-4bab-bca2-499c5a857c6f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed" status: 200 len: 1376 microversion: 2.1 time: 0.238923 Oct 04 19:06:20.974008 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3243/6464] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:20 2022] GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed => generated 1376 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:21.178208 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-643dc27f-0f92-4d9e-96d7-dcd00cf6d0eb tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:21.179205 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-643dc27f-0f92-4d9e-96d7-dcd00cf6d0eb tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] [instance: 561b8955-712b-4559-a81a-95bb656e4bbe] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:21.191339 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-643dc27f-0f92-4d9e-96d7-dcd00cf6d0eb tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:21.192318 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-643dc27f-0f92-4d9e-96d7-dcd00cf6d0eb tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:21.193279 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-643dc27f-0f92-4d9e-96d7-dcd00cf6d0eb tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:21.196197 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-643dc27f-0f92-4d9e-96d7-dcd00cf6d0eb tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:21.196966 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-643dc27f-0f92-4d9e-96d7-dcd00cf6d0eb tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:21.197988 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-643dc27f-0f92-4d9e-96d7-dcd00cf6d0eb tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:21.328485 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-643dc27f-0f92-4d9e-96d7-dcd00cf6d0eb tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e772e66d8c42dfa995bbecb6b9ccf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c177dc51b8e4a969670684997f3cb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:21.340384 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-643dc27f-0f92-4d9e-96d7-dcd00cf6d0eb tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] 10.222.0.20 "GET /compute/v2.1/servers/561b8955-712b-4559-a81a-95bb656e4bbe" status: 200 len: 1471 microversion: 2.1 time: 0.166886 Oct 04 19:06:21.351522 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3222/6465] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:21 2022] GET /compute/v2.1/servers/561b8955-712b-4559-a81a-95bb656e4bbe => generated 1471 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:21.363407 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7d34ba6c-b7f7-474a-9a7e-d65d771e625d tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:21.364014 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7d34ba6c-b7f7-474a-9a7e-d65d771e625d tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] [instance: 561b8955-712b-4559-a81a-95bb656e4bbe] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:21.388777 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7d34ba6c-b7f7-474a-9a7e-d65d771e625d tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:21.391060 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7d34ba6c-b7f7-474a-9a7e-d65d771e625d tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:21.392709 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7d34ba6c-b7f7-474a-9a7e-d65d771e625d tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:21.398291 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-85f5ac56-87a5-43d2-b5cf-3afc472ff7eb req-2ff2040d-38df-4a4c-96ff-3fee474c90c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed", "name": "network-vif-plugged", "status": "completed", "tag": "ba4a5f1b-b13b-4b2b-80a2-ed60e990a0bb"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:06:21.398536 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7d34ba6c-b7f7-474a-9a7e-d65d771e625d tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:21.398536 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7d34ba6c-b7f7-474a-9a7e-d65d771e625d tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:21.398536 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7d34ba6c-b7f7-474a-9a7e-d65d771e625d tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:21.413033 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-85f5ac56-87a5-43d2-b5cf-3afc472ff7eb req-2ff2040d-38df-4a4c-96ff-3fee474c90c5 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:21.415487 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-85f5ac56-87a5-43d2-b5cf-3afc472ff7eb req-2ff2040d-38df-4a4c-96ff-3fee474c90c5 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:21.417086 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-85f5ac56-87a5-43d2-b5cf-3afc472ff7eb req-2ff2040d-38df-4a4c-96ff-3fee474c90c5 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:21.437342 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-85f5ac56-87a5-43d2-b5cf-3afc472ff7eb req-2ff2040d-38df-4a4c-96ff-3fee474c90c5 service nova] Creating event network-vif-plugged:ba4a5f1b-b13b-4b2b-80a2-ed60e990a0bb for instance eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed on n-h1-850501-14 Oct 04 19:06:21.443163 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-85f5ac56-87a5-43d2-b5cf-3afc472ff7eb req-2ff2040d-38df-4a4c-96ff-3fee474c90c5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055635 Oct 04 19:06:21.444924 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3223/6466] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:06:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:06:21.527529 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7d34ba6c-b7f7-474a-9a7e-d65d771e625d tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e772e66d8c42dfa995bbecb6b9ccf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c177dc51b8e4a969670684997f3cb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:21.540445 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7d34ba6c-b7f7-474a-9a7e-d65d771e625d tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] 10.222.0.20 "GET /compute/v2.1/servers/561b8955-712b-4559-a81a-95bb656e4bbe" status: 200 len: 1471 microversion: 2.1 time: 0.180255 Oct 04 19:06:21.558336 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3244/6467] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:21 2022] GET /compute/v2.1/servers/561b8955-712b-4559-a81a-95bb656e4bbe => generated 1471 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:21.575336 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6edcfb6c-bdbc-4045-82f5-c5cc254e7767 tempest-TestSecurityGroupsBasicOps-1209095330 tempest-TestSecurityGroupsBasicOps-1209095330-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:21.577701 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-6edcfb6c-bdbc-4045-82f5-c5cc254e7767 tempest-TestSecurityGroupsBasicOps-1209095330 tempest-TestSecurityGroupsBasicOps-1209095330-project-admin] [instance: 561b8955-712b-4559-a81a-95bb656e4bbe] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:21.590802 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6edcfb6c-bdbc-4045-82f5-c5cc254e7767 tempest-TestSecurityGroupsBasicOps-1209095330 tempest-TestSecurityGroupsBasicOps-1209095330-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:21.591592 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6edcfb6c-bdbc-4045-82f5-c5cc254e7767 tempest-TestSecurityGroupsBasicOps-1209095330 tempest-TestSecurityGroupsBasicOps-1209095330-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:21.592252 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6edcfb6c-bdbc-4045-82f5-c5cc254e7767 tempest-TestSecurityGroupsBasicOps-1209095330 tempest-TestSecurityGroupsBasicOps-1209095330-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:21.593011 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6edcfb6c-bdbc-4045-82f5-c5cc254e7767 tempest-TestSecurityGroupsBasicOps-1209095330 tempest-TestSecurityGroupsBasicOps-1209095330-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:21.593486 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6edcfb6c-bdbc-4045-82f5-c5cc254e7767 tempest-TestSecurityGroupsBasicOps-1209095330 tempest-TestSecurityGroupsBasicOps-1209095330-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:21.593956 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6edcfb6c-bdbc-4045-82f5-c5cc254e7767 tempest-TestSecurityGroupsBasicOps-1209095330 tempest-TestSecurityGroupsBasicOps-1209095330-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:21.714726 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6edcfb6c-bdbc-4045-82f5-c5cc254e7767 tempest-TestSecurityGroupsBasicOps-1209095330 tempest-TestSecurityGroupsBasicOps-1209095330-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/561b8955-712b-4559-a81a-95bb656e4bbe" status: 200 len: 1624 microversion: 2.1 time: 0.145378 Oct 04 19:06:21.720435 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3224/6468] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:21 2022] GET /compute/v2.1/servers/561b8955-712b-4559-a81a-95bb656e4bbe => generated 1624 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:21.736477 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3f847a2b-a3c5-4043-8a09-4f6d6d87d05b tempest-TestSecurityGroupsBasicOps-1209095330 tempest-TestSecurityGroupsBasicOps-1209095330-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:21.737113 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3f847a2b-a3c5-4043-8a09-4f6d6d87d05b tempest-TestSecurityGroupsBasicOps-1209095330 tempest-TestSecurityGroupsBasicOps-1209095330-project-admin] [instance: a939ed32-d553-4214-9f35-d59e18a5d86b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:21.743402 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3f847a2b-a3c5-4043-8a09-4f6d6d87d05b tempest-TestSecurityGroupsBasicOps-1209095330 tempest-TestSecurityGroupsBasicOps-1209095330-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:21.744291 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3f847a2b-a3c5-4043-8a09-4f6d6d87d05b tempest-TestSecurityGroupsBasicOps-1209095330 tempest-TestSecurityGroupsBasicOps-1209095330-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:21.744389 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3f847a2b-a3c5-4043-8a09-4f6d6d87d05b tempest-TestSecurityGroupsBasicOps-1209095330 tempest-TestSecurityGroupsBasicOps-1209095330-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:21.745062 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3f847a2b-a3c5-4043-8a09-4f6d6d87d05b tempest-TestSecurityGroupsBasicOps-1209095330 tempest-TestSecurityGroupsBasicOps-1209095330-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:21.745527 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3f847a2b-a3c5-4043-8a09-4f6d6d87d05b tempest-TestSecurityGroupsBasicOps-1209095330 tempest-TestSecurityGroupsBasicOps-1209095330-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:21.745975 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3f847a2b-a3c5-4043-8a09-4f6d6d87d05b tempest-TestSecurityGroupsBasicOps-1209095330 tempest-TestSecurityGroupsBasicOps-1209095330-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:21.948299 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3f847a2b-a3c5-4043-8a09-4f6d6d87d05b tempest-TestSecurityGroupsBasicOps-1209095330 tempest-TestSecurityGroupsBasicOps-1209095330-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/a939ed32-d553-4214-9f35-d59e18a5d86b" status: 200 len: 1916 microversion: 2.1 time: 0.155348 Oct 04 19:06:21.948299 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3245/6469] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:21 2022] GET /compute/v2.1/servers/a939ed32-d553-4214-9f35-d59e18a5d86b => generated 1916 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:22.000124 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e2d624be-7ab7-4ba2-828c-189c8cd2eb38 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:22.000124 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e2d624be-7ab7-4ba2-828c-189c8cd2eb38 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:22.004452 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e2d624be-7ab7-4ba2-828c-189c8cd2eb38 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:22.004951 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e2d624be-7ab7-4ba2-828c-189c8cd2eb38 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:22.005397 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e2d624be-7ab7-4ba2-828c-189c8cd2eb38 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:22.006104 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e2d624be-7ab7-4ba2-828c-189c8cd2eb38 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:22.006566 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e2d624be-7ab7-4ba2-828c-189c8cd2eb38 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:22.006999 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e2d624be-7ab7-4ba2-828c-189c8cd2eb38 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:22.007094 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7b4d3f59-9598-459c-9cf7-07b21cc13e5b tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:22.007572 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7b4d3f59-9598-459c-9cf7-07b21cc13e5b tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] [instance: 561b8955-712b-4559-a81a-95bb656e4bbe] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:22.014218 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7b4d3f59-9598-459c-9cf7-07b21cc13e5b tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:22.014616 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7b4d3f59-9598-459c-9cf7-07b21cc13e5b tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:22.015061 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7b4d3f59-9598-459c-9cf7-07b21cc13e5b tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:22.015782 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7b4d3f59-9598-459c-9cf7-07b21cc13e5b tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:22.016259 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7b4d3f59-9598-459c-9cf7-07b21cc13e5b tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:22.016704 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7b4d3f59-9598-459c-9cf7-07b21cc13e5b tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:22.047276 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7b4d3f59-9598-459c-9cf7-07b21cc13e5b tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] [instance: 561b8955-712b-4559-a81a-95bb656e4bbe] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:06:22.489739 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e2d624be-7ab7-4ba2-828c-189c8cd2eb38 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:22.501619 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e2d624be-7ab7-4ba2-828c-189c8cd2eb38 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed" status: 200 len: 1376 microversion: 2.1 time: 0.509417 Oct 04 19:06:22.502216 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3225/6470] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:21 2022] GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed => generated 1376 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:22.938962 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7b4d3f59-9598-459c-9cf7-07b21cc13e5b tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] 10.222.0.20 "DELETE /compute/v2.1/servers/561b8955-712b-4559-a81a-95bb656e4bbe" status: 204 len: 0 microversion: 2.1 time: 0.935350 Oct 04 19:06:22.939947 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3246/6471] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 19:06:22 2022] DELETE /compute/v2.1/servers/561b8955-712b-4559-a81a-95bb656e4bbe => generated 0 bytes in 937 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 19:06:22.947762 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6b01acee-76dd-47f2-8f8a-bca08abfe091 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:22.948529 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-6b01acee-76dd-47f2-8f8a-bca08abfe091 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] [instance: 561b8955-712b-4559-a81a-95bb656e4bbe] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:22.957159 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6b01acee-76dd-47f2-8f8a-bca08abfe091 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:22.958089 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6b01acee-76dd-47f2-8f8a-bca08abfe091 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:22.958873 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6b01acee-76dd-47f2-8f8a-bca08abfe091 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:22.960468 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6b01acee-76dd-47f2-8f8a-bca08abfe091 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:22.961271 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6b01acee-76dd-47f2-8f8a-bca08abfe091 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:22.961865 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6b01acee-76dd-47f2-8f8a-bca08abfe091 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:23.085241 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-6b01acee-76dd-47f2-8f8a-bca08abfe091 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e772e66d8c42dfa995bbecb6b9ccf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c177dc51b8e4a969670684997f3cb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:23.095934 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6b01acee-76dd-47f2-8f8a-bca08abfe091 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] 10.222.0.20 "GET /compute/v2.1/servers/561b8955-712b-4559-a81a-95bb656e4bbe" status: 200 len: 1477 microversion: 2.1 time: 0.151956 Oct 04 19:06:23.096680 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3226/6472] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:22 2022] GET /compute/v2.1/servers/561b8955-712b-4559-a81a-95bb656e4bbe => generated 1477 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:23.529420 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5130e3da-501b-4696-9746-e92518ad0b1b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:23.530337 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5130e3da-501b-4696-9746-e92518ad0b1b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:23.536946 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5130e3da-501b-4696-9746-e92518ad0b1b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:23.537438 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5130e3da-501b-4696-9746-e92518ad0b1b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:23.537882 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5130e3da-501b-4696-9746-e92518ad0b1b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:23.538791 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5130e3da-501b-4696-9746-e92518ad0b1b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:23.539265 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5130e3da-501b-4696-9746-e92518ad0b1b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:23.539699 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5130e3da-501b-4696-9746-e92518ad0b1b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:23.732504 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5130e3da-501b-4696-9746-e92518ad0b1b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:23.741867 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5130e3da-501b-4696-9746-e92518ad0b1b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed" status: 200 len: 1563 microversion: 2.1 time: 0.217088 Oct 04 19:06:23.742458 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3247/6473] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:23 2022] GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed => generated 1563 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:23.769517 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-019aab36-5c4f-462f-8e93-82ae2efdc413 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:23.770143 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-019aab36-5c4f-462f-8e93-82ae2efdc413 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:23.773000 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=64 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:06:23.790034 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-019aab36-5c4f-462f-8e93-82ae2efdc413 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:23.790551 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-019aab36-5c4f-462f-8e93-82ae2efdc413 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:23.790998 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-019aab36-5c4f-462f-8e93-82ae2efdc413 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:23.795646 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-019aab36-5c4f-462f-8e93-82ae2efdc413 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:23.796198 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-019aab36-5c4f-462f-8e93-82ae2efdc413 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:23.796654 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-019aab36-5c4f-462f-8e93-82ae2efdc413 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:24.055143 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-019aab36-5c4f-462f-8e93-82ae2efdc413 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:24.063944 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-019aab36-5c4f-462f-8e93-82ae2efdc413 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed" status: 200 len: 1563 microversion: 2.1 time: 0.298176 Oct 04 19:06:24.064560 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3227/6474] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:23 2022] GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed => generated 1563 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:24.119507 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ef247928-ea52-47b2-ba96-98455d621bd8 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:24.120336 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ef247928-ea52-47b2-ba96-98455d621bd8 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] [instance: 561b8955-712b-4559-a81a-95bb656e4bbe] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:24.133634 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ef247928-ea52-47b2-ba96-98455d621bd8 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:24.135218 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ef247928-ea52-47b2-ba96-98455d621bd8 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:24.135798 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ef247928-ea52-47b2-ba96-98455d621bd8 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:24.137084 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ef247928-ea52-47b2-ba96-98455d621bd8 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:24.140390 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ef247928-ea52-47b2-ba96-98455d621bd8 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:24.142048 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ef247928-ea52-47b2-ba96-98455d621bd8 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:24.202253 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-bff875af-9aed-41b0-977e-6562a59a2ccb tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:24.202842 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-bff875af-9aed-41b0-977e-6562a59a2ccb tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:24.213855 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bff875af-9aed-41b0-977e-6562a59a2ccb tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:24.214374 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bff875af-9aed-41b0-977e-6562a59a2ccb tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:24.223892 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bff875af-9aed-41b0-977e-6562a59a2ccb tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:24.223892 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bff875af-9aed-41b0-977e-6562a59a2ccb tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:24.223892 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bff875af-9aed-41b0-977e-6562a59a2ccb tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:24.223892 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bff875af-9aed-41b0-977e-6562a59a2ccb tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:24.286913 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-bff875af-9aed-41b0-977e-6562a59a2ccb tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed] Going to try to terminate instance {{(pid=123002) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:06:24.397200 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ef247928-ea52-47b2-ba96-98455d621bd8 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e772e66d8c42dfa995bbecb6b9ccf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c177dc51b8e4a969670684997f3cb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:24.409716 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ef247928-ea52-47b2-ba96-98455d621bd8 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] 10.222.0.20 "GET /compute/v2.1/servers/561b8955-712b-4559-a81a-95bb656e4bbe" status: 200 len: 1477 microversion: 2.1 time: 0.294506 Oct 04 19:06:24.410647 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3248/6475] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:24 2022] GET /compute/v2.1/servers/561b8955-712b-4559-a81a-95bb656e4bbe => generated 1477 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:06:24.772441 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-bff875af-9aed-41b0-977e-6562a59a2ccb tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "DELETE /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed" status: 204 len: 0 microversion: 2.1 time: 0.574928 Oct 04 19:06:24.774272 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3228/6476] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 19:06:24 2022] DELETE /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed => generated 0 bytes in 578 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:06:24.783419 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2c4b6f29-bcbc-4f44-8a03-8a3140182fc1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:24.783965 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2c4b6f29-bcbc-4f44-8a03-8a3140182fc1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:24.791595 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2c4b6f29-bcbc-4f44-8a03-8a3140182fc1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:24.798401 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2c4b6f29-bcbc-4f44-8a03-8a3140182fc1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:24.798899 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2c4b6f29-bcbc-4f44-8a03-8a3140182fc1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:24.799643 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2c4b6f29-bcbc-4f44-8a03-8a3140182fc1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:24.802298 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2c4b6f29-bcbc-4f44-8a03-8a3140182fc1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:24.802859 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2c4b6f29-bcbc-4f44-8a03-8a3140182fc1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:25.077428 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-2c4b6f29-bcbc-4f44-8a03-8a3140182fc1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:25.091860 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2c4b6f29-bcbc-4f44-8a03-8a3140182fc1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed" status: 200 len: 1569 microversion: 2.1 time: 0.312417 Oct 04 19:06:25.109796 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3249/6477] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:24 2022] GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed => generated 1569 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:25.384138 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-0e9110d0-6e13-4f1e-8d17-665b8728f661 req-45fb3960-873c-4b32-9318-0be6d29747dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "561b8955-712b-4559-a81a-95bb656e4bbe", "name": "network-vif-deleted", "tag": "4bb38b7c-052b-47af-bb83-a4a4d178dad8"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:06:25.418525 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-0e9110d0-6e13-4f1e-8d17-665b8728f661 req-45fb3960-873c-4b32-9318-0be6d29747dd service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:25.426784 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-0e9110d0-6e13-4f1e-8d17-665b8728f661 req-45fb3960-873c-4b32-9318-0be6d29747dd service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:25.427405 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-0e9110d0-6e13-4f1e-8d17-665b8728f661 req-45fb3960-873c-4b32-9318-0be6d29747dd service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:25.434072 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0bda584b-5546-4a05-8d4a-6ad965f83702 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:25.437196 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0bda584b-5546-4a05-8d4a-6ad965f83702 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] [instance: 561b8955-712b-4559-a81a-95bb656e4bbe] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:25.452528 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0bda584b-5546-4a05-8d4a-6ad965f83702 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:25.453317 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0bda584b-5546-4a05-8d4a-6ad965f83702 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:25.460589 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0bda584b-5546-4a05-8d4a-6ad965f83702 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:25.460747 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-0e9110d0-6e13-4f1e-8d17-665b8728f661 req-45fb3960-873c-4b32-9318-0be6d29747dd service nova] Creating event network-vif-deleted:4bb38b7c-052b-47af-bb83-a4a4d178dad8 for instance 561b8955-712b-4559-a81a-95bb656e4bbe on n-h1-850501-14 Oct 04 19:06:25.461703 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0bda584b-5546-4a05-8d4a-6ad965f83702 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:25.462295 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0bda584b-5546-4a05-8d4a-6ad965f83702 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:25.462837 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0bda584b-5546-4a05-8d4a-6ad965f83702 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:25.467318 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-0e9110d0-6e13-4f1e-8d17-665b8728f661 req-45fb3960-873c-4b32-9318-0be6d29747dd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094495 Oct 04 19:06:25.468203 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3229/6478] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:06:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:06:25.560668 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0bda584b-5546-4a05-8d4a-6ad965f83702 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e772e66d8c42dfa995bbecb6b9ccf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c177dc51b8e4a969670684997f3cb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:25.569990 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0bda584b-5546-4a05-8d4a-6ad965f83702 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] 10.222.0.20 "GET /compute/v2.1/servers/561b8955-712b-4559-a81a-95bb656e4bbe" status: 200 len: 1477 microversion: 2.1 time: 0.139930 Oct 04 19:06:25.570632 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3250/6479] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:25 2022] GET /compute/v2.1/servers/561b8955-712b-4559-a81a-95bb656e4bbe => generated 1477 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:26.119825 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0bd03b9c-8741-4f00-b30e-a9b2d0df51be tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:26.120485 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0bd03b9c-8741-4f00-b30e-a9b2d0df51be tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:26.127715 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0bd03b9c-8741-4f00-b30e-a9b2d0df51be tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:26.128860 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0bd03b9c-8741-4f00-b30e-a9b2d0df51be tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:26.129465 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0bd03b9c-8741-4f00-b30e-a9b2d0df51be tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:26.130315 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0bd03b9c-8741-4f00-b30e-a9b2d0df51be tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:26.130920 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0bd03b9c-8741-4f00-b30e-a9b2d0df51be tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:26.131494 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0bd03b9c-8741-4f00-b30e-a9b2d0df51be tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:26.383629 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0bd03b9c-8741-4f00-b30e-a9b2d0df51be tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:26.395789 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0bd03b9c-8741-4f00-b30e-a9b2d0df51be tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed" status: 200 len: 1569 microversion: 2.1 time: 0.282438 Oct 04 19:06:26.396672 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3230/6480] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:26 2022] GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed => generated 1569 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:26.596564 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-71038b5f-18be-41a4-987e-5a2bbe680995 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:26.597228 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-71038b5f-18be-41a4-987e-5a2bbe680995 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] [instance: 561b8955-712b-4559-a81a-95bb656e4bbe] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:26.609324 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-71038b5f-18be-41a4-987e-5a2bbe680995 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:26.614382 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-71038b5f-18be-41a4-987e-5a2bbe680995 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:26.614382 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-71038b5f-18be-41a4-987e-5a2bbe680995 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:26.614382 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-71038b5f-18be-41a4-987e-5a2bbe680995 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:26.614382 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-71038b5f-18be-41a4-987e-5a2bbe680995 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:26.614382 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-71038b5f-18be-41a4-987e-5a2bbe680995 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:26.681637 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-71038b5f-18be-41a4-987e-5a2bbe680995 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:26.682380 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-71038b5f-18be-41a4-987e-5a2bbe680995 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:26.682978 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-71038b5f-18be-41a4-987e-5a2bbe680995 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:26.683633 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-71038b5f-18be-41a4-987e-5a2bbe680995 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lazy-loading 'fault' on Instance uuid 561b8955-712b-4559-a81a-95bb656e4bbe {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:06:26.756341 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-71038b5f-18be-41a4-987e-5a2bbe680995 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e772e66d8c42dfa995bbecb6b9ccf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c177dc51b8e4a969670684997f3cb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:26.773981 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-71038b5f-18be-41a4-987e-5a2bbe680995 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] 10.222.0.20 "GET /compute/v2.1/servers/561b8955-712b-4559-a81a-95bb656e4bbe" status: 200 len: 1330 microversion: 2.1 time: 0.181406 Oct 04 19:06:26.776867 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3251/6481] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:26 2022] GET /compute/v2.1/servers/561b8955-712b-4559-a81a-95bb656e4bbe => generated 1330 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:27.423086 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2edcaa3e-cbea-462c-b41b-44564256fd19 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:27.423719 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2edcaa3e-cbea-462c-b41b-44564256fd19 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:27.437527 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2edcaa3e-cbea-462c-b41b-44564256fd19 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:27.438250 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2edcaa3e-cbea-462c-b41b-44564256fd19 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:27.438710 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2edcaa3e-cbea-462c-b41b-44564256fd19 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:27.439442 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2edcaa3e-cbea-462c-b41b-44564256fd19 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:27.439920 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2edcaa3e-cbea-462c-b41b-44564256fd19 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:27.448415 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2edcaa3e-cbea-462c-b41b-44564256fd19 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:27.484166 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-e0a87361-baff-4267-81c0-7c7dc3997b2f req-2946b69f-7856-4471-81a4-30d0d4d67191 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed", "name": "network-vif-deleted", "tag": "ba4a5f1b-b13b-4b2b-80a2-ed60e990a0bb"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:06:27.505447 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-e0a87361-baff-4267-81c0-7c7dc3997b2f req-2946b69f-7856-4471-81a4-30d0d4d67191 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:27.505926 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-e0a87361-baff-4267-81c0-7c7dc3997b2f req-2946b69f-7856-4471-81a4-30d0d4d67191 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:27.506362 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-e0a87361-baff-4267-81c0-7c7dc3997b2f req-2946b69f-7856-4471-81a4-30d0d4d67191 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:27.522031 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-e0a87361-baff-4267-81c0-7c7dc3997b2f req-2946b69f-7856-4471-81a4-30d0d4d67191 service nova] Creating event network-vif-deleted:ba4a5f1b-b13b-4b2b-80a2-ed60e990a0bb for instance eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed on n-h1-850501-14 Oct 04 19:06:27.537696 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2edcaa3e-cbea-462c-b41b-44564256fd19 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:27.541821 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-e0a87361-baff-4267-81c0-7c7dc3997b2f req-2946b69f-7856-4471-81a4-30d0d4d67191 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061976 Oct 04 19:06:27.542666 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3252/6482] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:06:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:06:27.549678 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2edcaa3e-cbea-462c-b41b-44564256fd19 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed" status: 200 len: 1361 microversion: 2.1 time: 0.131193 Oct 04 19:06:27.550835 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3231/6483] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:27 2022] GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed => generated 1361 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:06:27.802451 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-26f6c6cb-b28d-430b-8765-d96362b31946 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:27.802451 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-26f6c6cb-b28d-430b-8765-d96362b31946 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] [instance: 561b8955-712b-4559-a81a-95bb656e4bbe] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:27.812613 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-26f6c6cb-b28d-430b-8765-d96362b31946 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:27.813288 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-26f6c6cb-b28d-430b-8765-d96362b31946 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:27.813563 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-26f6c6cb-b28d-430b-8765-d96362b31946 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:27.814280 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-26f6c6cb-b28d-430b-8765-d96362b31946 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:27.814783 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-26f6c6cb-b28d-430b-8765-d96362b31946 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:27.815224 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-26f6c6cb-b28d-430b-8765-d96362b31946 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:27.852667 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-26f6c6cb-b28d-430b-8765-d96362b31946 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] HTTP exception thrown: Instance 561b8955-712b-4559-a81a-95bb656e4bbe could not be found. Oct 04 19:06:27.854357 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-26f6c6cb-b28d-430b-8765-d96362b31946 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Request method failure captured: Oct 04 19:06:27.854357 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/561b8955-712b-4559-a81a-95bb656e4bbe HTTP/1.1 Oct 04 19:06:27.854357 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 19:06:27.854357 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 19:06:27.854357 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 19:06:27.854357 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 19:06:27.854357 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 19:06:27.854357 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 19:06:27.854357 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 19:06:27.854357 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 19:06:27.854357 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPIOa1iMDUikaYXaxtNSpZjY7tVA7n6lVhLLGPOqD-_ii-V4WcERZbpF8Uwpl5UIv0q09bwr88qEAau3cDCYZO15gtpAc11JNt9YAHYMn230pmrzUxBB0YBJIMKT4rKYSGTw9IK5ORHTYzK4JXqzVURazTl7LkKFW6gw2DxK3PEE06_Y Oct 04 19:06:27.854357 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 19:06:27.854357 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 19:06:27.854357 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 19:06:27.854357 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 19:06:27.854357 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 19:06:27.854357 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 19:06:27.854357 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 7c177dc51b8e4a969670684997f3cb2a Oct 04 19:06:27.854357 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1367116116 Oct 04 19:06:27.854357 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 19:06:27.854357 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 19:06:27.854357 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7c177dc51b8e4a969670684997f3cb2a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7c177dc51b8e4a969670684997f3cb2a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7c177dc51b8e4a969670684997f3cb2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7c177dc51b8e4a969670684997f3cb2a"}]}] Oct 04 19:06:27.854357 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1367116116 Oct 04 19:06:27.854357 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 7c177dc51b8e4a969670684997f3cb2a Oct 04 19:06:27.854357 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1367116116 Oct 04 19:06:27.854357 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-TestSecurityGroupsBasicOps-1367116116-project Oct 04 19:06:27.854357 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 19:06:27.854357 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 19:06:27.854357 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: c1e772e66d8c42dfa995bbecb6b9ccf9 Oct 04 19:06:27.854357 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1367116116-project Oct 04 19:06:27.854357 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 19:06:27.854357 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 561b8955-712b-4559-a81a-95bb656e4bbe could not be found. Oct 04 19:06:27.854357 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '561b8955-712b-4559-a81a-95bb656e4bbe'} Oct 04 19:06:27.854357 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:06:27.854357 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:06:27.854357 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:06:27.854357 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:06:27.854357 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:06:27.854357 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:06:27.854357 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:06:27.854357 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:06:27.854357 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:06:27.854357 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:06:27.854357 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 561b8955-712b-4559-a81a-95bb656e4bbe could not be found. Oct 04 19:06:27.854357 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:06:27.854357 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:06:27.854357 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:06:27.854357 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:06:27.854357 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:06:27.854357 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:06:27.854357 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:06:27.854357 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:06:27.854357 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:06:27.854357 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:06:27.854357 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:06:27.854357 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:06:27.854357 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:06:27.854357 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:06:27.854357 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:06:27.854357 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:06:27.854357 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 561b8955-712b-4559-a81a-95bb656e4bbe could not be found. Oct 04 19:06:27.854357 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:06:27.854357 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:06:27.860167 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:06:27.860167 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:06:27.860167 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:06:27.860167 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:06:27.860167 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:06:27.860167 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:06:27.860167 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 561b8955-712b-4559-a81a-95bb656e4bbe could not be found. Oct 04 19:06:27.860167 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:06:27.860167 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-26f6c6cb-b28d-430b-8765-d96362b31946 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Returning 404 to user: Instance 561b8955-712b-4559-a81a-95bb656e4bbe could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:06:27.860167 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-26f6c6cb-b28d-430b-8765-d96362b31946 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] 10.222.0.20 "GET /compute/v2.1/servers/561b8955-712b-4559-a81a-95bb656e4bbe" status: 404 len: 111 microversion: 2.1 time: 0.061364 Oct 04 19:06:27.860167 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3253/6484] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:27 2022] GET /compute/v2.1/servers/561b8955-712b-4559-a81a-95bb656e4bbe => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:06:28.575165 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1e1c4e23-abd7-4663-973b-1e3d5b435f31 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:28.577306 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1e1c4e23-abd7-4663-973b-1e3d5b435f31 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:28.585339 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1e1c4e23-abd7-4663-973b-1e3d5b435f31 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:28.586404 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1e1c4e23-abd7-4663-973b-1e3d5b435f31 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:28.587040 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1e1c4e23-abd7-4663-973b-1e3d5b435f31 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:28.587767 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1e1c4e23-abd7-4663-973b-1e3d5b435f31 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:28.588263 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1e1c4e23-abd7-4663-973b-1e3d5b435f31 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:28.588704 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1e1c4e23-abd7-4663-973b-1e3d5b435f31 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:28.673518 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1e1c4e23-abd7-4663-973b-1e3d5b435f31 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:28.684924 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1e1c4e23-abd7-4663-973b-1e3d5b435f31 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed" status: 200 len: 1361 microversion: 2.1 time: 0.113662 Oct 04 19:06:28.686763 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3232/6485] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:28 2022] GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed => generated 1361 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:29.718409 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b1c71ebf-34e6-4a5b-9aec-e3cf9299c812 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:29.719369 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b1c71ebf-34e6-4a5b-9aec-e3cf9299c812 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:29.734239 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b1c71ebf-34e6-4a5b-9aec-e3cf9299c812 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:29.735063 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b1c71ebf-34e6-4a5b-9aec-e3cf9299c812 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:29.735619 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b1c71ebf-34e6-4a5b-9aec-e3cf9299c812 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:29.738088 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b1c71ebf-34e6-4a5b-9aec-e3cf9299c812 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:29.740664 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b1c71ebf-34e6-4a5b-9aec-e3cf9299c812 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:29.741410 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b1c71ebf-34e6-4a5b-9aec-e3cf9299c812 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:29.879637 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b1c71ebf-34e6-4a5b-9aec-e3cf9299c812 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:29.895784 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b1c71ebf-34e6-4a5b-9aec-e3cf9299c812 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed" status: 200 len: 1361 microversion: 2.1 time: 0.181854 Oct 04 19:06:29.896832 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3254/6486] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:29 2022] GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed => generated 1361 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:30.920949 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-15ed5382-bf7f-4715-8f26-ba6f725c2406 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:30.922309 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-15ed5382-bf7f-4715-8f26-ba6f725c2406 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:30.935577 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-15ed5382-bf7f-4715-8f26-ba6f725c2406 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:30.936404 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-15ed5382-bf7f-4715-8f26-ba6f725c2406 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:30.937805 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-15ed5382-bf7f-4715-8f26-ba6f725c2406 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:30.942384 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-15ed5382-bf7f-4715-8f26-ba6f725c2406 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:30.943157 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-15ed5382-bf7f-4715-8f26-ba6f725c2406 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:30.947934 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-15ed5382-bf7f-4715-8f26-ba6f725c2406 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:31.281723 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-15ed5382-bf7f-4715-8f26-ba6f725c2406 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:31.293342 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-15ed5382-bf7f-4715-8f26-ba6f725c2406 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed" status: 200 len: 1361 microversion: 2.1 time: 0.376958 Oct 04 19:06:31.330847 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3233/6487] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:30 2022] GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed => generated 1361 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:32.320131 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f5fb320c-461f-4f2d-953d-c09de579271b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:32.321055 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f5fb320c-461f-4f2d-953d-c09de579271b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:32.331910 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f5fb320c-461f-4f2d-953d-c09de579271b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:32.332590 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f5fb320c-461f-4f2d-953d-c09de579271b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:32.333202 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f5fb320c-461f-4f2d-953d-c09de579271b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:32.337747 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f5fb320c-461f-4f2d-953d-c09de579271b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:32.337747 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f5fb320c-461f-4f2d-953d-c09de579271b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:32.337747 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f5fb320c-461f-4f2d-953d-c09de579271b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:32.422701 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f5fb320c-461f-4f2d-953d-c09de579271b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:32.437660 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f5fb320c-461f-4f2d-953d-c09de579271b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed" status: 200 len: 1361 microversion: 2.1 time: 0.122349 Oct 04 19:06:32.438277 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3255/6488] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:32 2022] GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed => generated 1361 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:33.462360 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0572e6e2-25e3-4cfb-8803-2dd75bd594db tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:33.462977 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0572e6e2-25e3-4cfb-8803-2dd75bd594db tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:33.470251 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0572e6e2-25e3-4cfb-8803-2dd75bd594db tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:33.470811 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0572e6e2-25e3-4cfb-8803-2dd75bd594db tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:33.471262 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0572e6e2-25e3-4cfb-8803-2dd75bd594db tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:33.471972 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0572e6e2-25e3-4cfb-8803-2dd75bd594db tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:33.472573 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0572e6e2-25e3-4cfb-8803-2dd75bd594db tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:33.473045 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0572e6e2-25e3-4cfb-8803-2dd75bd594db tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:33.603269 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0572e6e2-25e3-4cfb-8803-2dd75bd594db tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:33.615191 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0572e6e2-25e3-4cfb-8803-2dd75bd594db tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed" status: 200 len: 1361 microversion: 2.1 time: 0.156531 Oct 04 19:06:33.615997 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3234/6489] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:33 2022] GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:34.401236 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1d7bd716-3a12-48fc-8f4c-bfeae99127ba tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:34.401771 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1d7bd716-3a12-48fc-8f4c-bfeae99127ba tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] [instance: a939ed32-d553-4214-9f35-d59e18a5d86b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:34.413920 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-851986e7-d354-4c59-8089-fdfddd2d6cfd req-ca1d13e6-2a82-4635-85cf-d845af151885 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a939ed32-d553-4214-9f35-d59e18a5d86b", "tag": "3f36fac6-4f01-474d-8381-b3c1c0311c69"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:06:34.419838 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1d7bd716-3a12-48fc-8f4c-bfeae99127ba tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:34.420847 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1d7bd716-3a12-48fc-8f4c-bfeae99127ba tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:34.421461 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1d7bd716-3a12-48fc-8f4c-bfeae99127ba tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:34.422351 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1d7bd716-3a12-48fc-8f4c-bfeae99127ba tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:34.423131 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1d7bd716-3a12-48fc-8f4c-bfeae99127ba tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:34.423706 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1d7bd716-3a12-48fc-8f4c-bfeae99127ba tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:34.429005 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-851986e7-d354-4c59-8089-fdfddd2d6cfd req-ca1d13e6-2a82-4635-85cf-d845af151885 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:34.430003 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-851986e7-d354-4c59-8089-fdfddd2d6cfd req-ca1d13e6-2a82-4635-85cf-d845af151885 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:34.430966 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-851986e7-d354-4c59-8089-fdfddd2d6cfd req-ca1d13e6-2a82-4635-85cf-d845af151885 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:34.446595 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-851986e7-d354-4c59-8089-fdfddd2d6cfd req-ca1d13e6-2a82-4635-85cf-d845af151885 service nova] Creating event network-changed:3f36fac6-4f01-474d-8381-b3c1c0311c69 for instance a939ed32-d553-4214-9f35-d59e18a5d86b on n-h2-850501-14 Oct 04 19:06:34.455185 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-851986e7-d354-4c59-8089-fdfddd2d6cfd req-ca1d13e6-2a82-4635-85cf-d845af151885 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048241 Oct 04 19:06:34.465697 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3235/6490] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:06:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:06:34.472258 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1d7bd716-3a12-48fc-8f4c-bfeae99127ba tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] [instance: a939ed32-d553-4214-9f35-d59e18a5d86b] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:06:34.640018 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5214722c-a6f4-47be-9850-4e94f56cf5a7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:34.641242 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5214722c-a6f4-47be-9850-4e94f56cf5a7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:34.660944 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5214722c-a6f4-47be-9850-4e94f56cf5a7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:34.668085 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5214722c-a6f4-47be-9850-4e94f56cf5a7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:34.668085 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5214722c-a6f4-47be-9850-4e94f56cf5a7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:34.668085 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5214722c-a6f4-47be-9850-4e94f56cf5a7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:34.668085 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5214722c-a6f4-47be-9850-4e94f56cf5a7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:34.668085 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5214722c-a6f4-47be-9850-4e94f56cf5a7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:34.729481 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5214722c-a6f4-47be-9850-4e94f56cf5a7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:34.730154 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5214722c-a6f4-47be-9850-4e94f56cf5a7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:34.730479 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5214722c-a6f4-47be-9850-4e94f56cf5a7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:34.731102 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-5214722c-a6f4-47be-9850-4e94f56cf5a7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lazy-loading 'fault' on Instance uuid eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:06:34.807575 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5214722c-a6f4-47be-9850-4e94f56cf5a7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:34.819334 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5214722c-a6f4-47be-9850-4e94f56cf5a7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed" status: 200 len: 1366 microversion: 2.1 time: 0.184096 Oct 04 19:06:34.823508 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3236/6491] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:34 2022] GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed => generated 1366 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:35.157302 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1d7bd716-3a12-48fc-8f4c-bfeae99127ba tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a939ed32-d553-4214-9f35-d59e18a5d86b" status: 204 len: 0 microversion: 2.1 time: 0.759716 Oct 04 19:06:35.158583 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3256/6492] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 19:06:34 2022] DELETE /compute/v2.1/servers/a939ed32-d553-4214-9f35-d59e18a5d86b => generated 0 bytes in 762 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:06:35.167398 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3a057707-6d4d-4af0-b0fd-b6337788e618 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:35.168036 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3a057707-6d4d-4af0-b0fd-b6337788e618 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] [instance: a939ed32-d553-4214-9f35-d59e18a5d86b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:35.183597 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3a057707-6d4d-4af0-b0fd-b6337788e618 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:35.184136 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3a057707-6d4d-4af0-b0fd-b6337788e618 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:35.184596 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3a057707-6d4d-4af0-b0fd-b6337788e618 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:35.186165 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3a057707-6d4d-4af0-b0fd-b6337788e618 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:35.186715 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3a057707-6d4d-4af0-b0fd-b6337788e618 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:35.187073 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3a057707-6d4d-4af0-b0fd-b6337788e618 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:35.444559 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3a057707-6d4d-4af0-b0fd-b6337788e618 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e772e66d8c42dfa995bbecb6b9ccf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c177dc51b8e4a969670684997f3cb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:35.456327 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3a057707-6d4d-4af0-b0fd-b6337788e618 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] 10.222.0.20 "GET /compute/v2.1/servers/a939ed32-d553-4214-9f35-d59e18a5d86b" status: 200 len: 1769 microversion: 2.1 time: 0.292496 Oct 04 19:06:35.462324 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3237/6493] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:35 2022] GET /compute/v2.1/servers/a939ed32-d553-4214-9f35-d59e18a5d86b => generated 1769 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:35.850095 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-24ba329d-d238-416a-b7e7-29497601c462 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:35.850095 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-24ba329d-d238-416a-b7e7-29497601c462 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:35.855522 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:06:35.860608 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-24ba329d-d238-416a-b7e7-29497601c462 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:35.861124 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-24ba329d-d238-416a-b7e7-29497601c462 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:35.861577 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-24ba329d-d238-416a-b7e7-29497601c462 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:35.862336 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-24ba329d-d238-416a-b7e7-29497601c462 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:35.862760 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-24ba329d-d238-416a-b7e7-29497601c462 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:35.863198 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-24ba329d-d238-416a-b7e7-29497601c462 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:35.891315 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-24ba329d-d238-416a-b7e7-29497601c462 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] HTTP exception thrown: Instance eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed could not be found. Oct 04 19:06:35.893147 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-24ba329d-d238-416a-b7e7-29497601c462 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Request method failure captured: Oct 04 19:06:35.893147 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed HTTP/1.1 Oct 04 19:06:35.893147 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 19:06:35.893147 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 19:06:35.893147 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 19:06:35.893147 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 19:06:35.893147 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 19:06:35.893147 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 19:06:35.893147 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 19:06:35.893147 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 19:06:35.893147 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPIJ4KptPiy5XyaUYG9pLSP7TnMEf-PY7yFvjaPGmW4DAHqC1kasy1bm5to10RwAF_dSHQb87b5amqQ9ZUna6URZpq6M0BGpvwENg84W1HvOZfHgDXT7E6YYTtPhmcCZbmf-MEJzIKVI741HwGnmdHx846U9v3mpOw6zsk7UNEsUijp4 Oct 04 19:06:35.893147 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 19:06:35.893147 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 19:06:35.893147 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 19:06:35.893147 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 19:06:35.893147 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 19:06:35.893147 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 19:06:35.893147 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 82d0cd3db371459db429cb770abde738 Oct 04 19:06:35.893147 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-TestVolumeBootPattern-1621879949 Oct 04 19:06:35.893147 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 19:06:35.893147 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 19:06:35.893147 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/82d0cd3db371459db429cb770abde738"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_82d0cd3db371459db429cb770abde738", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/82d0cd3db371459db429cb770abde738"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/82d0cd3db371459db429cb770abde738"}]}] Oct 04 19:06:35.893147 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-TestVolumeBootPattern-1621879949 Oct 04 19:06:35.893147 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 82d0cd3db371459db429cb770abde738 Oct 04 19:06:35.893147 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-TestVolumeBootPattern-1621879949 Oct 04 19:06:35.893147 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-TestVolumeBootPattern-1621879949-project Oct 04 19:06:35.893147 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 19:06:35.893147 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 19:06:35.893147 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: a65ae9c3fb3c46a2a393fe21ce21b9d4 Oct 04 19:06:35.893147 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-TestVolumeBootPattern-1621879949-project Oct 04 19:06:35.893147 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 19:06:35.893147 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed could not be found. Oct 04 19:06:35.893147 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': 'eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed'} Oct 04 19:06:35.893147 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:06:35.893147 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:06:35.893147 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:06:35.893147 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:06:35.893147 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:06:35.893147 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:06:35.893147 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:06:35.893147 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:06:35.893147 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:06:35.893147 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:06:35.893147 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed could not be found. Oct 04 19:06:35.893147 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:06:35.893147 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:06:35.893147 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:06:35.893147 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:06:35.893147 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:06:35.893147 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:06:35.893147 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:06:35.893147 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:06:35.893147 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:06:35.893147 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:06:35.893147 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:06:35.893147 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:06:35.893147 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:06:35.893147 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:06:35.893147 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:06:35.893147 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:06:35.893147 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed could not be found. Oct 04 19:06:35.893147 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:06:35.893147 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:06:35.893147 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:06:35.896929 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:06:35.896929 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:06:35.896929 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:06:35.896929 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:06:35.896929 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:06:35.896929 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed could not be found. Oct 04 19:06:35.896929 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:06:35.896929 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-24ba329d-d238-416a-b7e7-29497601c462 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Returning 404 to user: Instance eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:06:35.896929 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-24ba329d-d238-416a-b7e7-29497601c462 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed" status: 404 len: 111 microversion: 2.1 time: 0.055353 Oct 04 19:06:35.898958 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3257/6494] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:35 2022] GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:06:36.481390 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-30cb3784-f023-43d6-9d05-66d78a47b1cb tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:36.482824 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-30cb3784-f023-43d6-9d05-66d78a47b1cb tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] [instance: a939ed32-d553-4214-9f35-d59e18a5d86b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:36.490094 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-30cb3784-f023-43d6-9d05-66d78a47b1cb tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:36.490691 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-30cb3784-f023-43d6-9d05-66d78a47b1cb tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:36.491958 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-30cb3784-f023-43d6-9d05-66d78a47b1cb tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:36.491958 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-30cb3784-f023-43d6-9d05-66d78a47b1cb tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:36.492547 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-30cb3784-f023-43d6-9d05-66d78a47b1cb tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:36.493037 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-30cb3784-f023-43d6-9d05-66d78a47b1cb tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:36.527817 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:06:36.680130 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-30cb3784-f023-43d6-9d05-66d78a47b1cb tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e772e66d8c42dfa995bbecb6b9ccf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c177dc51b8e4a969670684997f3cb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:36.688619 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-30cb3784-f023-43d6-9d05-66d78a47b1cb tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] 10.222.0.20 "GET /compute/v2.1/servers/a939ed32-d553-4214-9f35-d59e18a5d86b" status: 200 len: 1650 microversion: 2.1 time: 0.212208 Oct 04 19:06:36.689350 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3238/6495] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:36 2022] GET /compute/v2.1/servers/a939ed32-d553-4214-9f35-d59e18a5d86b => generated 1650 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:37.574786 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-b98e0ead-d7ae-43d7-b187-8e1daac66b8d req-b7d79738-fb33-41d3-8803-1a74988d06d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a939ed32-d553-4214-9f35-d59e18a5d86b", "name": "network-vif-deleted", "tag": "3f36fac6-4f01-474d-8381-b3c1c0311c69"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:06:37.586453 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-b98e0ead-d7ae-43d7-b187-8e1daac66b8d req-b7d79738-fb33-41d3-8803-1a74988d06d1 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:37.586943 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-b98e0ead-d7ae-43d7-b187-8e1daac66b8d req-b7d79738-fb33-41d3-8803-1a74988d06d1 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:37.587381 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-b98e0ead-d7ae-43d7-b187-8e1daac66b8d req-b7d79738-fb33-41d3-8803-1a74988d06d1 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:37.591593 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:06:37.599313 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-b98e0ead-d7ae-43d7-b187-8e1daac66b8d req-b7d79738-fb33-41d3-8803-1a74988d06d1 service nova] Creating event network-vif-deleted:3f36fac6-4f01-474d-8381-b3c1c0311c69 for instance a939ed32-d553-4214-9f35-d59e18a5d86b on n-h2-850501-14 Oct 04 19:06:37.604911 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-b98e0ead-d7ae-43d7-b187-8e1daac66b8d req-b7d79738-fb33-41d3-8803-1a74988d06d1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034145 Oct 04 19:06:37.605526 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3258/6496] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:06:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:06:37.713136 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1bea2220-5265-4dfe-82c8-a880b4509de7 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:37.714979 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1bea2220-5265-4dfe-82c8-a880b4509de7 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] [instance: a939ed32-d553-4214-9f35-d59e18a5d86b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:37.733284 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1bea2220-5265-4dfe-82c8-a880b4509de7 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:37.734010 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1bea2220-5265-4dfe-82c8-a880b4509de7 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:37.734468 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1bea2220-5265-4dfe-82c8-a880b4509de7 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:37.735206 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1bea2220-5265-4dfe-82c8-a880b4509de7 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:37.735681 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1bea2220-5265-4dfe-82c8-a880b4509de7 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:37.736159 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1bea2220-5265-4dfe-82c8-a880b4509de7 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:37.807146 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1bea2220-5265-4dfe-82c8-a880b4509de7 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e772e66d8c42dfa995bbecb6b9ccf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c177dc51b8e4a969670684997f3cb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:37.818672 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1bea2220-5265-4dfe-82c8-a880b4509de7 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] 10.222.0.20 "GET /compute/v2.1/servers/a939ed32-d553-4214-9f35-d59e18a5d86b" status: 200 len: 1530 microversion: 2.1 time: 0.110617 Oct 04 19:06:37.819268 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3239/6497] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:37 2022] GET /compute/v2.1/servers/a939ed32-d553-4214-9f35-d59e18a5d86b => generated 1530 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:38.848745 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-153f2fa4-b0a6-488a-a182-905d2e8dae91 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:38.849467 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-153f2fa4-b0a6-488a-a182-905d2e8dae91 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] [instance: a939ed32-d553-4214-9f35-d59e18a5d86b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:38.859467 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-153f2fa4-b0a6-488a-a182-905d2e8dae91 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:38.859955 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-153f2fa4-b0a6-488a-a182-905d2e8dae91 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:38.860417 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-153f2fa4-b0a6-488a-a182-905d2e8dae91 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:38.861328 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-153f2fa4-b0a6-488a-a182-905d2e8dae91 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:38.861787 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-153f2fa4-b0a6-488a-a182-905d2e8dae91 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:38.862216 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-153f2fa4-b0a6-488a-a182-905d2e8dae91 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:38.899078 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-153f2fa4-b0a6-488a-a182-905d2e8dae91 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:38.899564 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-153f2fa4-b0a6-488a-a182-905d2e8dae91 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:38.900005 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-153f2fa4-b0a6-488a-a182-905d2e8dae91 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:38.900481 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-153f2fa4-b0a6-488a-a182-905d2e8dae91 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lazy-loading 'fault' on Instance uuid a939ed32-d553-4214-9f35-d59e18a5d86b {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:06:38.953021 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-153f2fa4-b0a6-488a-a182-905d2e8dae91 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e772e66d8c42dfa995bbecb6b9ccf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c177dc51b8e4a969670684997f3cb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:38.963044 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-153f2fa4-b0a6-488a-a182-905d2e8dae91 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] 10.222.0.20 "GET /compute/v2.1/servers/a939ed32-d553-4214-9f35-d59e18a5d86b" status: 200 len: 1384 microversion: 2.1 time: 0.118426 Oct 04 19:06:38.963624 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3259/6498] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:38 2022] GET /compute/v2.1/servers/a939ed32-d553-4214-9f35-d59e18a5d86b => generated 1384 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:39.991021 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-88bc7bdd-f3ca-48d1-8d51-6c6fe0f47c93 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:39.991610 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-88bc7bdd-f3ca-48d1-8d51-6c6fe0f47c93 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] [instance: a939ed32-d553-4214-9f35-d59e18a5d86b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:39.999754 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-88bc7bdd-f3ca-48d1-8d51-6c6fe0f47c93 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:40.000321 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-88bc7bdd-f3ca-48d1-8d51-6c6fe0f47c93 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:40.000764 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-88bc7bdd-f3ca-48d1-8d51-6c6fe0f47c93 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:40.002965 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-88bc7bdd-f3ca-48d1-8d51-6c6fe0f47c93 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:40.003449 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-88bc7bdd-f3ca-48d1-8d51-6c6fe0f47c93 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:40.004002 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-88bc7bdd-f3ca-48d1-8d51-6c6fe0f47c93 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:40.019242 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-88bc7bdd-f3ca-48d1-8d51-6c6fe0f47c93 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] HTTP exception thrown: Instance a939ed32-d553-4214-9f35-d59e18a5d86b could not be found. Oct 04 19:06:40.021067 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-88bc7bdd-f3ca-48d1-8d51-6c6fe0f47c93 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Request method failure captured: Oct 04 19:06:40.021067 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/a939ed32-d553-4214-9f35-d59e18a5d86b HTTP/1.1 Oct 04 19:06:40.021067 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 19:06:40.021067 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 19:06:40.021067 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 19:06:40.021067 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 19:06:40.021067 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 19:06:40.021067 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 19:06:40.021067 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 19:06:40.021067 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 19:06:40.021067 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPIOa1iMDUikaYXaxtNSpZjY7tVA7n6lVhLLGPOqD-_ii-V4WcERZbpF8Uwpl5UIv0q09bwr88qEAau3cDCYZO15gtpAc11JNt9YAHYMn230pmrzUxBB0YBJIMKT4rKYSGTw9IK5ORHTYzK4JXqzVURazTl7LkKFW6gw2DxK3PEE06_Y Oct 04 19:06:40.021067 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 19:06:40.021067 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 19:06:40.021067 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 19:06:40.021067 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 19:06:40.021067 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 19:06:40.021067 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 19:06:40.021067 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 7c177dc51b8e4a969670684997f3cb2a Oct 04 19:06:40.021067 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1367116116 Oct 04 19:06:40.021067 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 19:06:40.021067 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 19:06:40.021067 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7c177dc51b8e4a969670684997f3cb2a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7c177dc51b8e4a969670684997f3cb2a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7c177dc51b8e4a969670684997f3cb2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7c177dc51b8e4a969670684997f3cb2a"}]}] Oct 04 19:06:40.021067 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1367116116 Oct 04 19:06:40.021067 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 7c177dc51b8e4a969670684997f3cb2a Oct 04 19:06:40.021067 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1367116116 Oct 04 19:06:40.021067 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-TestSecurityGroupsBasicOps-1367116116-project Oct 04 19:06:40.021067 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 19:06:40.021067 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 19:06:40.021067 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: c1e772e66d8c42dfa995bbecb6b9ccf9 Oct 04 19:06:40.021067 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1367116116-project Oct 04 19:06:40.021067 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 19:06:40.021067 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance a939ed32-d553-4214-9f35-d59e18a5d86b could not be found. Oct 04 19:06:40.021067 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'a939ed32-d553-4214-9f35-d59e18a5d86b'} Oct 04 19:06:40.021067 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:06:40.021067 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:06:40.021067 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:06:40.021067 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:06:40.021067 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:06:40.021067 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:06:40.021067 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:06:40.021067 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:06:40.021067 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:06:40.021067 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:06:40.021067 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a939ed32-d553-4214-9f35-d59e18a5d86b could not be found. Oct 04 19:06:40.021067 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:06:40.021067 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:06:40.021067 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:06:40.021067 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:06:40.021067 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:06:40.021067 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:06:40.021067 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:06:40.021067 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:06:40.021067 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:06:40.021067 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:06:40.021067 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:06:40.021067 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:06:40.021067 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:06:40.021067 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:06:40.021067 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:06:40.021067 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:06:40.021067 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a939ed32-d553-4214-9f35-d59e18a5d86b could not be found. Oct 04 19:06:40.021067 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:06:40.021067 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:06:40.025183 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:06:40.025183 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:06:40.025183 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:06:40.025183 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:06:40.025183 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:06:40.025183 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:06:40.025183 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a939ed32-d553-4214-9f35-d59e18a5d86b could not be found. Oct 04 19:06:40.025183 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:06:40.025183 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-88bc7bdd-f3ca-48d1-8d51-6c6fe0f47c93 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Returning 404 to user: Instance a939ed32-d553-4214-9f35-d59e18a5d86b could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:06:40.025183 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-88bc7bdd-f3ca-48d1-8d51-6c6fe0f47c93 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] 10.222.0.20 "GET /compute/v2.1/servers/a939ed32-d553-4214-9f35-d59e18a5d86b" status: 404 len: 111 microversion: 2.1 time: 0.038085 Oct 04 19:06:40.025183 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3240/6499] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:39 2022] GET /compute/v2.1/servers/a939ed32-d553-4214-9f35-d59e18a5d86b => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:06:41.411676 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b1bf04e2-9c3d-4b05-a9ff-b13b6df3772d tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:41.412309 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b1bf04e2-9c3d-4b05-a9ff-b13b6df3772d tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 4a92d48e-091e-4ede-a4db-476209e74bf2] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:41.422843 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b1bf04e2-9c3d-4b05-a9ff-b13b6df3772d tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:41.423342 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b1bf04e2-9c3d-4b05-a9ff-b13b6df3772d tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:41.423782 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b1bf04e2-9c3d-4b05-a9ff-b13b6df3772d tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:41.424556 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b1bf04e2-9c3d-4b05-a9ff-b13b6df3772d tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:41.425276 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b1bf04e2-9c3d-4b05-a9ff-b13b6df3772d tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:41.425773 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b1bf04e2-9c3d-4b05-a9ff-b13b6df3772d tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:41.454502 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b1bf04e2-9c3d-4b05-a9ff-b13b6df3772d tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 4a92d48e-091e-4ede-a4db-476209e74bf2] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:06:41.839159 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b1bf04e2-9c3d-4b05-a9ff-b13b6df3772d tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4a92d48e-091e-4ede-a4db-476209e74bf2" status: 204 len: 0 microversion: 2.1 time: 0.428309 Oct 04 19:06:41.840234 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3260/6500] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 19:06:41 2022] DELETE /compute/v2.1/servers/4a92d48e-091e-4ede-a4db-476209e74bf2 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:06:41.849385 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-281ef519-80cf-4d7d-bdbe-a6e30ca22a3f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:41.850307 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-281ef519-80cf-4d7d-bdbe-a6e30ca22a3f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 4a92d48e-091e-4ede-a4db-476209e74bf2] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:41.866420 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-281ef519-80cf-4d7d-bdbe-a6e30ca22a3f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:41.871937 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-281ef519-80cf-4d7d-bdbe-a6e30ca22a3f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:41.871937 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-281ef519-80cf-4d7d-bdbe-a6e30ca22a3f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:41.871937 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-281ef519-80cf-4d7d-bdbe-a6e30ca22a3f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:41.871937 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-281ef519-80cf-4d7d-bdbe-a6e30ca22a3f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:41.871937 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-281ef519-80cf-4d7d-bdbe-a6e30ca22a3f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:42.080388 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-281ef519-80cf-4d7d-bdbe-a6e30ca22a3f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:42.080388 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-281ef519-80cf-4d7d-bdbe-a6e30ca22a3f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/4a92d48e-091e-4ede-a4db-476209e74bf2" status: 200 len: 1409 microversion: 2.1 time: 0.233299 Oct 04 19:06:42.080388 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3241/6501] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:41 2022] GET /compute/v2.1/servers/4a92d48e-091e-4ede-a4db-476209e74bf2 => generated 1409 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:43.103343 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-20ff3633-496a-484f-97ab-97379fca6575 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:43.104096 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-20ff3633-496a-484f-97ab-97379fca6575 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 4a92d48e-091e-4ede-a4db-476209e74bf2] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:43.121730 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-20ff3633-496a-484f-97ab-97379fca6575 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:43.122542 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-20ff3633-496a-484f-97ab-97379fca6575 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:43.123795 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-20ff3633-496a-484f-97ab-97379fca6575 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:43.124837 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-20ff3633-496a-484f-97ab-97379fca6575 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:43.125485 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-20ff3633-496a-484f-97ab-97379fca6575 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:43.128297 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-20ff3633-496a-484f-97ab-97379fca6575 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:43.469450 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-20ff3633-496a-484f-97ab-97379fca6575 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:43.478455 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-20ff3633-496a-484f-97ab-97379fca6575 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/4a92d48e-091e-4ede-a4db-476209e74bf2" status: 200 len: 1409 microversion: 2.1 time: 0.379920 Oct 04 19:06:43.479587 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3261/6502] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:43 2022] GET /compute/v2.1/servers/4a92d48e-091e-4ede-a4db-476209e74bf2 => generated 1409 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:44.069207 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-1d38b253-72bb-43d6-9a92-215d8aebc292 req-5b25f291-d87d-4e0f-8cab-6e8dbb5384d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a92d48e-091e-4ede-a4db-476209e74bf2", "name": "network-vif-deleted", "tag": "34ca71bf-fe42-4928-b71c-84a6708d753a"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:06:44.082722 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-1d38b253-72bb-43d6-9a92-215d8aebc292 req-5b25f291-d87d-4e0f-8cab-6e8dbb5384d3 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:44.083527 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-1d38b253-72bb-43d6-9a92-215d8aebc292 req-5b25f291-d87d-4e0f-8cab-6e8dbb5384d3 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:44.083979 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-1d38b253-72bb-43d6-9a92-215d8aebc292 req-5b25f291-d87d-4e0f-8cab-6e8dbb5384d3 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:44.096110 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-1d38b253-72bb-43d6-9a92-215d8aebc292 req-5b25f291-d87d-4e0f-8cab-6e8dbb5384d3 service nova] Creating event network-vif-deleted:34ca71bf-fe42-4928-b71c-84a6708d753a for instance 4a92d48e-091e-4ede-a4db-476209e74bf2 on n-h1-850501-14 Oct 04 19:06:44.101477 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-1d38b253-72bb-43d6-9a92-215d8aebc292 req-5b25f291-d87d-4e0f-8cab-6e8dbb5384d3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035993 Oct 04 19:06:44.102340 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3242/6503] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:06:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:06:44.504894 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-347579aa-032c-4ba1-baba-9a7cd44975c2 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:44.505569 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-347579aa-032c-4ba1-baba-9a7cd44975c2 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 4a92d48e-091e-4ede-a4db-476209e74bf2] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:44.514091 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-347579aa-032c-4ba1-baba-9a7cd44975c2 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:44.514657 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-347579aa-032c-4ba1-baba-9a7cd44975c2 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:44.516641 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-347579aa-032c-4ba1-baba-9a7cd44975c2 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:44.518787 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-347579aa-032c-4ba1-baba-9a7cd44975c2 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:44.521715 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-347579aa-032c-4ba1-baba-9a7cd44975c2 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:44.522408 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-347579aa-032c-4ba1-baba-9a7cd44975c2 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:44.742311 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-347579aa-032c-4ba1-baba-9a7cd44975c2 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:44.755879 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-347579aa-032c-4ba1-baba-9a7cd44975c2 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/4a92d48e-091e-4ede-a4db-476209e74bf2" status: 200 len: 1201 microversion: 2.1 time: 0.254469 Oct 04 19:06:44.757095 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3262/6504] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:44 2022] GET /compute/v2.1/servers/4a92d48e-091e-4ede-a4db-476209e74bf2 => generated 1201 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:45.249673 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-01e31717-466a-4be4-9aaa-6ad61d4d4db2 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] Calling method '.version_select at 0x7fe250188f70>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:45.434078 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-01e31717-466a-4be4-9aaa-6ad61d4d4db2 tempest-TestSecurityGroupsBasicOps-1367116116 tempest-TestSecurityGroupsBasicOps-1367116116-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1461020954" status: 202 len: 0 microversion: 2.1 time: 0.188888 Oct 04 19:06:45.434721 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3243/6505] 10.222.0.20 () {58 vars in 1278 bytes} [Tue Oct 4 19:06:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1461020954 => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:06:45.784677 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-929f3281-9454-41a5-82e6-0ff73da2f9d7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:45.785447 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-929f3281-9454-41a5-82e6-0ff73da2f9d7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 4a92d48e-091e-4ede-a4db-476209e74bf2] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:45.793301 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-929f3281-9454-41a5-82e6-0ff73da2f9d7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:45.793930 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-929f3281-9454-41a5-82e6-0ff73da2f9d7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:45.794480 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-929f3281-9454-41a5-82e6-0ff73da2f9d7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:45.796140 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-929f3281-9454-41a5-82e6-0ff73da2f9d7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:45.796941 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-929f3281-9454-41a5-82e6-0ff73da2f9d7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:45.797581 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-929f3281-9454-41a5-82e6-0ff73da2f9d7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:45.910538 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-929f3281-9454-41a5-82e6-0ff73da2f9d7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:45.920495 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-929f3281-9454-41a5-82e6-0ff73da2f9d7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/4a92d48e-091e-4ede-a4db-476209e74bf2" status: 200 len: 1201 microversion: 2.1 time: 0.139267 Oct 04 19:06:45.925102 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3263/6506] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:45 2022] GET /compute/v2.1/servers/4a92d48e-091e-4ede-a4db-476209e74bf2 => generated 1201 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:46.949043 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-cf3056fd-dbac-465b-bd22-0ff7f0e86a7e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:46.954629 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-cf3056fd-dbac-465b-bd22-0ff7f0e86a7e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 4a92d48e-091e-4ede-a4db-476209e74bf2] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:46.975410 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cf3056fd-dbac-465b-bd22-0ff7f0e86a7e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:46.981763 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cf3056fd-dbac-465b-bd22-0ff7f0e86a7e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:46.984273 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cf3056fd-dbac-465b-bd22-0ff7f0e86a7e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:46.985066 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cf3056fd-dbac-465b-bd22-0ff7f0e86a7e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:46.989201 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cf3056fd-dbac-465b-bd22-0ff7f0e86a7e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:46.990170 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cf3056fd-dbac-465b-bd22-0ff7f0e86a7e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:47.105164 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-cf3056fd-dbac-465b-bd22-0ff7f0e86a7e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:47.115012 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-cf3056fd-dbac-465b-bd22-0ff7f0e86a7e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/4a92d48e-091e-4ede-a4db-476209e74bf2" status: 200 len: 1201 microversion: 2.1 time: 0.173916 Oct 04 19:06:47.117412 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3244/6507] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:46 2022] GET /compute/v2.1/servers/4a92d48e-091e-4ede-a4db-476209e74bf2 => generated 1201 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:48.140824 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-63daeca4-f013-4165-ae36-7484b8c4cfb2 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:48.141692 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-63daeca4-f013-4165-ae36-7484b8c4cfb2 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 4a92d48e-091e-4ede-a4db-476209e74bf2] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:48.149049 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-63daeca4-f013-4165-ae36-7484b8c4cfb2 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:48.149765 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-63daeca4-f013-4165-ae36-7484b8c4cfb2 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:48.150209 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-63daeca4-f013-4165-ae36-7484b8c4cfb2 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:48.150918 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-63daeca4-f013-4165-ae36-7484b8c4cfb2 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:48.151539 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-63daeca4-f013-4165-ae36-7484b8c4cfb2 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:48.151977 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-63daeca4-f013-4165-ae36-7484b8c4cfb2 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:48.228219 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-63daeca4-f013-4165-ae36-7484b8c4cfb2 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:48.242104 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-63daeca4-f013-4165-ae36-7484b8c4cfb2 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/4a92d48e-091e-4ede-a4db-476209e74bf2" status: 200 len: 1201 microversion: 2.1 time: 0.105941 Oct 04 19:06:48.243355 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3264/6508] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:48 2022] GET /compute/v2.1/servers/4a92d48e-091e-4ede-a4db-476209e74bf2 => generated 1201 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:49.269329 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7a1ddf42-ba15-4cb3-9609-b1d9e589f18e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:49.269913 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7a1ddf42-ba15-4cb3-9609-b1d9e589f18e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 4a92d48e-091e-4ede-a4db-476209e74bf2] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:49.309792 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7a1ddf42-ba15-4cb3-9609-b1d9e589f18e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:49.310165 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7a1ddf42-ba15-4cb3-9609-b1d9e589f18e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:49.310712 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7a1ddf42-ba15-4cb3-9609-b1d9e589f18e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:49.311454 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7a1ddf42-ba15-4cb3-9609-b1d9e589f18e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:49.311930 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7a1ddf42-ba15-4cb3-9609-b1d9e589f18e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:49.318603 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7a1ddf42-ba15-4cb3-9609-b1d9e589f18e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:49.393144 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7a1ddf42-ba15-4cb3-9609-b1d9e589f18e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:49.402497 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7a1ddf42-ba15-4cb3-9609-b1d9e589f18e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/4a92d48e-091e-4ede-a4db-476209e74bf2" status: 200 len: 1201 microversion: 2.1 time: 0.136592 Oct 04 19:06:49.422586 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3245/6509] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:49 2022] GET /compute/v2.1/servers/4a92d48e-091e-4ede-a4db-476209e74bf2 => generated 1201 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:50.433812 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a12339a0-96d2-4f05-9c48-7aefd3b8ef65 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:50.434589 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a12339a0-96d2-4f05-9c48-7aefd3b8ef65 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 4a92d48e-091e-4ede-a4db-476209e74bf2] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:50.468679 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a12339a0-96d2-4f05-9c48-7aefd3b8ef65 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:50.469422 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a12339a0-96d2-4f05-9c48-7aefd3b8ef65 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:50.470399 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a12339a0-96d2-4f05-9c48-7aefd3b8ef65 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:50.471387 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a12339a0-96d2-4f05-9c48-7aefd3b8ef65 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:50.472107 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a12339a0-96d2-4f05-9c48-7aefd3b8ef65 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:50.473103 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a12339a0-96d2-4f05-9c48-7aefd3b8ef65 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:50.525149 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a12339a0-96d2-4f05-9c48-7aefd3b8ef65 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:50.526373 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a12339a0-96d2-4f05-9c48-7aefd3b8ef65 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:50.527021 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a12339a0-96d2-4f05-9c48-7aefd3b8ef65 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:50.527819 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-a12339a0-96d2-4f05-9c48-7aefd3b8ef65 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lazy-loading 'fault' on Instance uuid 4a92d48e-091e-4ede-a4db-476209e74bf2 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:06:50.653332 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a12339a0-96d2-4f05-9c48-7aefd3b8ef65 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:50.677398 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a12339a0-96d2-4f05-9c48-7aefd3b8ef65 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/4a92d48e-091e-4ede-a4db-476209e74bf2" status: 200 len: 1206 microversion: 2.1 time: 0.249472 Oct 04 19:06:50.678238 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3265/6510] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:50 2022] GET /compute/v2.1/servers/4a92d48e-091e-4ede-a4db-476209e74bf2 => generated 1206 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:51.711295 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-426f46ec-4d10-4180-9dc7-aa81caa01ab9 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:51.713269 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-426f46ec-4d10-4180-9dc7-aa81caa01ab9 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 4a92d48e-091e-4ede-a4db-476209e74bf2] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:51.724968 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-426f46ec-4d10-4180-9dc7-aa81caa01ab9 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:51.725708 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-426f46ec-4d10-4180-9dc7-aa81caa01ab9 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:51.726345 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-426f46ec-4d10-4180-9dc7-aa81caa01ab9 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:51.727589 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-426f46ec-4d10-4180-9dc7-aa81caa01ab9 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:51.728268 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-426f46ec-4d10-4180-9dc7-aa81caa01ab9 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:51.728774 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-426f46ec-4d10-4180-9dc7-aa81caa01ab9 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:51.786314 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-426f46ec-4d10-4180-9dc7-aa81caa01ab9 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] HTTP exception thrown: Instance 4a92d48e-091e-4ede-a4db-476209e74bf2 could not be found. Oct 04 19:06:51.794114 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-426f46ec-4d10-4180-9dc7-aa81caa01ab9 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Request method failure captured: Oct 04 19:06:51.794114 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/4a92d48e-091e-4ede-a4db-476209e74bf2 HTTP/1.1 Oct 04 19:06:51.794114 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 19:06:51.794114 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 19:06:51.794114 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 19:06:51.794114 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 19:06:51.794114 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 19:06:51.794114 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 19:06:51.794114 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 19:06:51.794114 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 19:06:51.794114 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPIJ4KptPiy5XyaUYG9pLSP7TnMEf-PY7yFvjaPGmW4DAHqC1kasy1bm5to10RwAF_dSHQb87b5amqQ9ZUna6URZpq6M0BGpvwENg84W1HvOZfHgDXT7E6YYTtPhmcCZbmf-MEJzIKVI741HwGnmdHx846U9v3mpOw6zsk7UNEsUijp4 Oct 04 19:06:51.794114 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 19:06:51.794114 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 19:06:51.794114 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 19:06:51.794114 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 19:06:51.794114 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 19:06:51.794114 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 19:06:51.794114 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 82d0cd3db371459db429cb770abde738 Oct 04 19:06:51.794114 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-TestVolumeBootPattern-1621879949 Oct 04 19:06:51.794114 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 19:06:51.794114 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 19:06:51.794114 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/82d0cd3db371459db429cb770abde738"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_82d0cd3db371459db429cb770abde738", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/82d0cd3db371459db429cb770abde738"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/82d0cd3db371459db429cb770abde738"}]}] Oct 04 19:06:51.794114 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-TestVolumeBootPattern-1621879949 Oct 04 19:06:51.794114 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 82d0cd3db371459db429cb770abde738 Oct 04 19:06:51.794114 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-TestVolumeBootPattern-1621879949 Oct 04 19:06:51.794114 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-TestVolumeBootPattern-1621879949-project Oct 04 19:06:51.794114 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 19:06:51.794114 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 19:06:51.794114 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: a65ae9c3fb3c46a2a393fe21ce21b9d4 Oct 04 19:06:51.794114 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-TestVolumeBootPattern-1621879949-project Oct 04 19:06:51.794114 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 19:06:51.794114 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 4a92d48e-091e-4ede-a4db-476209e74bf2 could not be found. Oct 04 19:06:51.794114 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '4a92d48e-091e-4ede-a4db-476209e74bf2'} Oct 04 19:06:51.794114 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:06:51.794114 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:06:51.794114 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:06:51.794114 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:06:51.794114 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:06:51.794114 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:06:51.794114 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:06:51.794114 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:06:51.794114 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:06:51.794114 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:06:51.794114 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a92d48e-091e-4ede-a4db-476209e74bf2 could not be found. Oct 04 19:06:51.794114 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:06:51.794114 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:06:51.794114 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:06:51.794114 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:06:51.794114 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:06:51.794114 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:06:51.794114 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:06:51.794114 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:06:51.794114 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:06:51.794114 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:06:51.794114 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:06:51.794114 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:06:51.794114 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:06:51.794114 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:06:51.794114 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:06:51.794114 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:06:51.794114 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a92d48e-091e-4ede-a4db-476209e74bf2 could not be found. Oct 04 19:06:51.794114 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:06:51.794114 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:06:51.794114 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:06:51.803383 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:06:51.803383 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:06:51.803383 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:06:51.803383 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:06:51.803383 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:06:51.803383 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a92d48e-091e-4ede-a4db-476209e74bf2 could not be found. Oct 04 19:06:51.803383 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:06:51.803383 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-426f46ec-4d10-4180-9dc7-aa81caa01ab9 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Returning 404 to user: Instance 4a92d48e-091e-4ede-a4db-476209e74bf2 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:06:51.806524 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-426f46ec-4d10-4180-9dc7-aa81caa01ab9 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/4a92d48e-091e-4ede-a4db-476209e74bf2" status: 404 len: 111 microversion: 2.1 time: 0.105265 Oct 04 19:06:51.808870 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3246/6511] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:51 2022] GET /compute/v2.1/servers/4a92d48e-091e-4ede-a4db-476209e74bf2 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:06:54.005190 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3af88e88-a377-4328-be72-1e4d07f24783 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:54.005795 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3af88e88-a377-4328-be72-1e4d07f24783 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:54.013992 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3af88e88-a377-4328-be72-1e4d07f24783 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:54.014633 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3af88e88-a377-4328-be72-1e4d07f24783 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:54.015464 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3af88e88-a377-4328-be72-1e4d07f24783 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:54.016444 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3af88e88-a377-4328-be72-1e4d07f24783 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:54.017225 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3af88e88-a377-4328-be72-1e4d07f24783 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:54.017875 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3af88e88-a377-4328-be72-1e4d07f24783 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:54.041667 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-3af88e88-a377-4328-be72-1e4d07f24783 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] HTTP exception thrown: Instance eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed could not be found. Oct 04 19:06:54.043869 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3af88e88-a377-4328-be72-1e4d07f24783 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Request method failure captured: Oct 04 19:06:54.043869 n-d-850501-14 devstack@n-api.service[123001]: request: DELETE /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed HTTP/1.1 Oct 04 19:06:54.043869 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 19:06:54.043869 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 19:06:54.043869 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 19:06:54.043869 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 19:06:54.043869 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 19:06:54.043869 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 19:06:54.043869 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 19:06:54.043869 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 19:06:54.043869 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPIJ4KptPiy5XyaUYG9pLSP7TnMEf-PY7yFvjaPGmW4DAHqC1kasy1bm5to10RwAF_dSHQb87b5amqQ9ZUna6URZpq6M0BGpvwENg84W1HvOZfHgDXT7E6YYTtPhmcCZbmf-MEJzIKVI741HwGnmdHx846U9v3mpOw6zsk7UNEsUijp4 Oct 04 19:06:54.043869 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 19:06:54.043869 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 19:06:54.043869 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 19:06:54.043869 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 19:06:54.043869 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 19:06:54.043869 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 19:06:54.043869 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 82d0cd3db371459db429cb770abde738 Oct 04 19:06:54.043869 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-TestVolumeBootPattern-1621879949 Oct 04 19:06:54.043869 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 19:06:54.043869 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 19:06:54.043869 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/82d0cd3db371459db429cb770abde738"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_82d0cd3db371459db429cb770abde738", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/82d0cd3db371459db429cb770abde738"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/82d0cd3db371459db429cb770abde738"}]}] Oct 04 19:06:54.043869 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-TestVolumeBootPattern-1621879949 Oct 04 19:06:54.043869 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 82d0cd3db371459db429cb770abde738 Oct 04 19:06:54.043869 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-TestVolumeBootPattern-1621879949 Oct 04 19:06:54.043869 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-TestVolumeBootPattern-1621879949-project Oct 04 19:06:54.043869 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 19:06:54.043869 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 19:06:54.043869 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: a65ae9c3fb3c46a2a393fe21ce21b9d4 Oct 04 19:06:54.043869 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-TestVolumeBootPattern-1621879949-project Oct 04 19:06:54.043869 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 19:06:54.043869 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed could not be found. Oct 04 19:06:54.043869 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': 'eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed'} Oct 04 19:06:54.043869 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:06:54.043869 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:06:54.043869 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:06:54.043869 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:06:54.043869 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:06:54.043869 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:06:54.043869 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:06:54.043869 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:06:54.043869 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:06:54.043869 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:06:54.043869 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed could not be found. Oct 04 19:06:54.043869 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:06:54.043869 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:06:54.043869 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:06:54.043869 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:06:54.043869 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:06:54.043869 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:06:54.043869 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:06:54.043869 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:06:54.043869 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:06:54.043869 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:06:54.043869 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 19:06:54.043869 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 19:06:54.043869 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 19:06:54.043869 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 19:06:54.043869 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:06:54.043869 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:06:54.043869 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:06:54.043869 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:06:54.057805 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed could not be found. Oct 04 19:06:54.057805 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:06:54.057805 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:06:54.057805 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:06:54.057805 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:06:54.057805 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:06:54.057805 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:06:54.057805 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:06:54.057805 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:06:54.057805 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed could not be found. Oct 04 19:06:54.057805 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:06:54.057805 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3af88e88-a377-4328-be72-1e4d07f24783 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Returning 404 to user: Instance eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:06:54.057805 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3af88e88-a377-4328-be72-1e4d07f24783 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "DELETE /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed" status: 404 len: 111 microversion: 2.1 time: 0.054489 Oct 04 19:06:54.057805 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3266/6512] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 19:06:53 2022] DELETE /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 19:06:54.063103 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-469633d3-839b-4094-99a1-6f0350638674 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:54.065263 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-469633d3-839b-4094-99a1-6f0350638674 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:54.073934 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:06:54.080145 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-469633d3-839b-4094-99a1-6f0350638674 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:54.084407 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-469633d3-839b-4094-99a1-6f0350638674 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:54.084407 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-469633d3-839b-4094-99a1-6f0350638674 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:54.084407 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-469633d3-839b-4094-99a1-6f0350638674 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:54.084407 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-469633d3-839b-4094-99a1-6f0350638674 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:54.084407 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-469633d3-839b-4094-99a1-6f0350638674 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:54.105563 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-469633d3-839b-4094-99a1-6f0350638674 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] HTTP exception thrown: Instance eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed could not be found. Oct 04 19:06:54.107657 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-469633d3-839b-4094-99a1-6f0350638674 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Request method failure captured: Oct 04 19:06:54.107657 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed HTTP/1.1 Oct 04 19:06:54.107657 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 19:06:54.107657 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 19:06:54.107657 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 19:06:54.107657 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 19:06:54.107657 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 19:06:54.107657 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 19:06:54.107657 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 19:06:54.107657 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 19:06:54.107657 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPIJ4KptPiy5XyaUYG9pLSP7TnMEf-PY7yFvjaPGmW4DAHqC1kasy1bm5to10RwAF_dSHQb87b5amqQ9ZUna6URZpq6M0BGpvwENg84W1HvOZfHgDXT7E6YYTtPhmcCZbmf-MEJzIKVI741HwGnmdHx846U9v3mpOw6zsk7UNEsUijp4 Oct 04 19:06:54.107657 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 19:06:54.107657 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 19:06:54.107657 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 19:06:54.107657 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 19:06:54.107657 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 19:06:54.107657 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 19:06:54.107657 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 82d0cd3db371459db429cb770abde738 Oct 04 19:06:54.107657 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-TestVolumeBootPattern-1621879949 Oct 04 19:06:54.107657 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 19:06:54.107657 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 19:06:54.107657 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/82d0cd3db371459db429cb770abde738"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_82d0cd3db371459db429cb770abde738", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/82d0cd3db371459db429cb770abde738"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/82d0cd3db371459db429cb770abde738"}]}] Oct 04 19:06:54.107657 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-TestVolumeBootPattern-1621879949 Oct 04 19:06:54.107657 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 82d0cd3db371459db429cb770abde738 Oct 04 19:06:54.107657 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-TestVolumeBootPattern-1621879949 Oct 04 19:06:54.107657 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-TestVolumeBootPattern-1621879949-project Oct 04 19:06:54.107657 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 19:06:54.107657 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 19:06:54.107657 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: a65ae9c3fb3c46a2a393fe21ce21b9d4 Oct 04 19:06:54.107657 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-TestVolumeBootPattern-1621879949-project Oct 04 19:06:54.107657 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 19:06:54.107657 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed could not be found. Oct 04 19:06:54.107657 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed'} Oct 04 19:06:54.107657 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:06:54.107657 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:06:54.107657 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:06:54.107657 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:06:54.107657 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:06:54.107657 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:06:54.107657 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:06:54.107657 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:06:54.107657 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:06:54.107657 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:06:54.107657 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed could not be found. Oct 04 19:06:54.107657 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:06:54.107657 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:06:54.107657 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:06:54.107657 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:06:54.107657 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:06:54.107657 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:06:54.107657 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:06:54.107657 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:06:54.107657 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:06:54.107657 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:06:54.107657 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:06:54.107657 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:06:54.107657 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:06:54.107657 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:06:54.107657 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:06:54.107657 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:06:54.107657 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed could not be found. Oct 04 19:06:54.107657 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:06:54.107657 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:06:54.107657 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:06:54.112406 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:06:54.112406 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:06:54.112406 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:06:54.112406 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:06:54.112406 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:06:54.112406 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed could not be found. Oct 04 19:06:54.112406 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:06:54.112406 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-469633d3-839b-4094-99a1-6f0350638674 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Returning 404 to user: Instance eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:06:54.113036 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-469633d3-839b-4094-99a1-6f0350638674 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed" status: 404 len: 111 microversion: 2.1 time: 0.052233 Oct 04 19:06:54.115590 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3247/6513] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:54 2022] GET /compute/v2.1/servers/eef8a8e7-8e7c-4a98-9ad7-0eff73d289ed => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:06:55.319665 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8a68ab4a-0522-4b23-b201-4f546147227d tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:55.321044 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8a68ab4a-0522-4b23-b201-4f546147227d tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 4a92d48e-091e-4ede-a4db-476209e74bf2] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:55.335176 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8a68ab4a-0522-4b23-b201-4f546147227d tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:55.337476 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8a68ab4a-0522-4b23-b201-4f546147227d tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:55.339534 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8a68ab4a-0522-4b23-b201-4f546147227d tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:55.340572 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8a68ab4a-0522-4b23-b201-4f546147227d tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:55.343798 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8a68ab4a-0522-4b23-b201-4f546147227d tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:55.344620 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8a68ab4a-0522-4b23-b201-4f546147227d tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:55.394032 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-8a68ab4a-0522-4b23-b201-4f546147227d tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] HTTP exception thrown: Instance 4a92d48e-091e-4ede-a4db-476209e74bf2 could not be found. Oct 04 19:06:55.396498 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8a68ab4a-0522-4b23-b201-4f546147227d tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Request method failure captured: Oct 04 19:06:55.396498 n-d-850501-14 devstack@n-api.service[123001]: request: DELETE /compute/v2.1/servers/4a92d48e-091e-4ede-a4db-476209e74bf2 HTTP/1.1 Oct 04 19:06:55.396498 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 19:06:55.396498 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 19:06:55.396498 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 19:06:55.396498 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 19:06:55.396498 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 19:06:55.396498 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 19:06:55.396498 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 19:06:55.396498 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 19:06:55.396498 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPIJ4KptPiy5XyaUYG9pLSP7TnMEf-PY7yFvjaPGmW4DAHqC1kasy1bm5to10RwAF_dSHQb87b5amqQ9ZUna6URZpq6M0BGpvwENg84W1HvOZfHgDXT7E6YYTtPhmcCZbmf-MEJzIKVI741HwGnmdHx846U9v3mpOw6zsk7UNEsUijp4 Oct 04 19:06:55.396498 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 19:06:55.396498 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 19:06:55.396498 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 19:06:55.396498 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 19:06:55.396498 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 19:06:55.396498 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 19:06:55.396498 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 82d0cd3db371459db429cb770abde738 Oct 04 19:06:55.396498 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-TestVolumeBootPattern-1621879949 Oct 04 19:06:55.396498 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 19:06:55.396498 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 19:06:55.396498 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/82d0cd3db371459db429cb770abde738"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_82d0cd3db371459db429cb770abde738", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/82d0cd3db371459db429cb770abde738"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/82d0cd3db371459db429cb770abde738"}]}] Oct 04 19:06:55.396498 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-TestVolumeBootPattern-1621879949 Oct 04 19:06:55.396498 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 82d0cd3db371459db429cb770abde738 Oct 04 19:06:55.396498 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-TestVolumeBootPattern-1621879949 Oct 04 19:06:55.396498 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-TestVolumeBootPattern-1621879949-project Oct 04 19:06:55.396498 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 19:06:55.396498 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 19:06:55.396498 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: a65ae9c3fb3c46a2a393fe21ce21b9d4 Oct 04 19:06:55.396498 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-TestVolumeBootPattern-1621879949-project Oct 04 19:06:55.396498 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 19:06:55.396498 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 4a92d48e-091e-4ede-a4db-476209e74bf2 could not be found. Oct 04 19:06:55.396498 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '4a92d48e-091e-4ede-a4db-476209e74bf2'} Oct 04 19:06:55.396498 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:06:55.396498 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:06:55.396498 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:06:55.396498 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:06:55.396498 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:06:55.396498 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:06:55.396498 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:06:55.396498 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:06:55.396498 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:06:55.396498 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:06:55.396498 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a92d48e-091e-4ede-a4db-476209e74bf2 could not be found. Oct 04 19:06:55.396498 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:06:55.396498 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:06:55.396498 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:06:55.396498 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:06:55.396498 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:06:55.396498 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:06:55.396498 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:06:55.396498 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:06:55.396498 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:06:55.396498 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:06:55.396498 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 19:06:55.396498 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 19:06:55.396498 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 19:06:55.396498 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 19:06:55.396498 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:06:55.396498 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:06:55.396498 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:06:55.396498 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:06:55.403744 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a92d48e-091e-4ede-a4db-476209e74bf2 could not be found. Oct 04 19:06:55.403744 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:06:55.403744 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:06:55.403744 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:06:55.403744 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:06:55.403744 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:06:55.403744 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:06:55.403744 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:06:55.403744 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:06:55.403744 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a92d48e-091e-4ede-a4db-476209e74bf2 could not be found. Oct 04 19:06:55.403744 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:06:55.408889 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8a68ab4a-0522-4b23-b201-4f546147227d tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Returning 404 to user: Instance 4a92d48e-091e-4ede-a4db-476209e74bf2 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:06:55.410001 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8a68ab4a-0522-4b23-b201-4f546147227d tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4a92d48e-091e-4ede-a4db-476209e74bf2" status: 404 len: 111 microversion: 2.1 time: 0.094578 Oct 04 19:06:55.410943 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3267/6514] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 19:06:55 2022] DELETE /compute/v2.1/servers/4a92d48e-091e-4ede-a4db-476209e74bf2 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:06:55.420591 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-18fccdd2-4886-4e07-abec-787835a35433 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:55.421305 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-18fccdd2-4886-4e07-abec-787835a35433 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 4a92d48e-091e-4ede-a4db-476209e74bf2] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:55.429752 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-18fccdd2-4886-4e07-abec-787835a35433 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:55.430267 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-18fccdd2-4886-4e07-abec-787835a35433 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:55.430727 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-18fccdd2-4886-4e07-abec-787835a35433 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:55.431660 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-18fccdd2-4886-4e07-abec-787835a35433 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:55.432163 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-18fccdd2-4886-4e07-abec-787835a35433 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:55.432624 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-18fccdd2-4886-4e07-abec-787835a35433 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:55.450638 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-18fccdd2-4886-4e07-abec-787835a35433 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] HTTP exception thrown: Instance 4a92d48e-091e-4ede-a4db-476209e74bf2 could not be found. Oct 04 19:06:55.457678 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-18fccdd2-4886-4e07-abec-787835a35433 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Request method failure captured: Oct 04 19:06:55.457678 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/4a92d48e-091e-4ede-a4db-476209e74bf2 HTTP/1.1 Oct 04 19:06:55.457678 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 19:06:55.457678 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 19:06:55.457678 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 19:06:55.457678 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 19:06:55.457678 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 19:06:55.457678 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 19:06:55.457678 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 19:06:55.457678 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 19:06:55.457678 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPIJ4KptPiy5XyaUYG9pLSP7TnMEf-PY7yFvjaPGmW4DAHqC1kasy1bm5to10RwAF_dSHQb87b5amqQ9ZUna6URZpq6M0BGpvwENg84W1HvOZfHgDXT7E6YYTtPhmcCZbmf-MEJzIKVI741HwGnmdHx846U9v3mpOw6zsk7UNEsUijp4 Oct 04 19:06:55.457678 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 19:06:55.457678 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 19:06:55.457678 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 19:06:55.457678 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 19:06:55.457678 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 19:06:55.457678 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 19:06:55.457678 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 82d0cd3db371459db429cb770abde738 Oct 04 19:06:55.457678 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-TestVolumeBootPattern-1621879949 Oct 04 19:06:55.457678 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 19:06:55.457678 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 19:06:55.457678 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/82d0cd3db371459db429cb770abde738"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_82d0cd3db371459db429cb770abde738", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/82d0cd3db371459db429cb770abde738"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/82d0cd3db371459db429cb770abde738"}]}] Oct 04 19:06:55.457678 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-TestVolumeBootPattern-1621879949 Oct 04 19:06:55.457678 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 82d0cd3db371459db429cb770abde738 Oct 04 19:06:55.457678 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-TestVolumeBootPattern-1621879949 Oct 04 19:06:55.457678 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-TestVolumeBootPattern-1621879949-project Oct 04 19:06:55.457678 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 19:06:55.457678 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 19:06:55.457678 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: a65ae9c3fb3c46a2a393fe21ce21b9d4 Oct 04 19:06:55.457678 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-TestVolumeBootPattern-1621879949-project Oct 04 19:06:55.457678 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 19:06:55.457678 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 4a92d48e-091e-4ede-a4db-476209e74bf2 could not be found. Oct 04 19:06:55.457678 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '4a92d48e-091e-4ede-a4db-476209e74bf2'} Oct 04 19:06:55.457678 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:06:55.457678 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:06:55.457678 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:06:55.457678 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:06:55.457678 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:06:55.457678 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:06:55.457678 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:06:55.457678 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:06:55.457678 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:06:55.457678 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:06:55.457678 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a92d48e-091e-4ede-a4db-476209e74bf2 could not be found. Oct 04 19:06:55.457678 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:06:55.457678 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:06:55.457678 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:06:55.457678 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:06:55.457678 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:06:55.457678 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:06:55.457678 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:06:55.457678 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:06:55.457678 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:06:55.457678 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:06:55.457678 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:06:55.457678 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:06:55.457678 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:06:55.457678 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:06:55.457678 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:06:55.457678 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:06:55.457678 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a92d48e-091e-4ede-a4db-476209e74bf2 could not be found. Oct 04 19:06:55.457678 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:06:55.457678 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:06:55.457678 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:06:55.462418 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:06:55.462418 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:06:55.462418 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:06:55.462418 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:06:55.462418 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:06:55.462418 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a92d48e-091e-4ede-a4db-476209e74bf2 could not be found. Oct 04 19:06:55.462418 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:06:55.462418 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-18fccdd2-4886-4e07-abec-787835a35433 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Returning 404 to user: Instance 4a92d48e-091e-4ede-a4db-476209e74bf2 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:06:55.462418 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-18fccdd2-4886-4e07-abec-787835a35433 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/4a92d48e-091e-4ede-a4db-476209e74bf2" status: 404 len: 111 microversion: 2.1 time: 0.037985 Oct 04 19:06:55.462418 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3248/6515] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:55 2022] GET /compute/v2.1/servers/4a92d48e-091e-4ede-a4db-476209e74bf2 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:06:55.569388 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ad737805-efe4-4d60-b4c7-88c448e649f9 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Action: 'create', calling method: .version_select at 0x7fe258270af0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1229993015", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB8Qz2pNr+cqdwfM5pslPs7gS8JLOnNEjBaSdpxXr7Gbg9/izUFDkCY3eI+Kixp06Xa1B3eUDZqrSTecWO5IK/1NaAnSgg+ZtYGHw9QoD2kycGWPs7TlrWC1SZJYdnnD0g=="}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:06:55.609150 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-ad737805-efe4-4d60-b4c7-88c448e649f9 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Getting quotas for project 82d0cd3db371459db429cb770abde738. Resources: {'key_pairs'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:06:55.619805 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-ad737805-efe4-4d60-b4c7-88c448e649f9 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Getting quotas for user a65ae9c3fb3c46a2a393fe21ce21b9d4 and project 82d0cd3db371459db429cb770abde738. Resources: {'key_pairs'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:06:55.761194 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ad737805-efe4-4d60-b4c7-88c448e649f9 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.196225 Oct 04 19:06:55.762375 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3268/6516] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Oct 4 19:06:55 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:07:01.449488 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ccb8ae4b-223f-4b4a-a82c-31f50d66a173 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:01.452304 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ccb8ae4b-223f-4b4a-a82c-31f50d66a173 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 0e957abd-68e7-48c3-af4b-74d570d41c15] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:01.461083 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ccb8ae4b-223f-4b4a-a82c-31f50d66a173 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:01.468333 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ccb8ae4b-223f-4b4a-a82c-31f50d66a173 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:01.468333 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ccb8ae4b-223f-4b4a-a82c-31f50d66a173 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:01.468333 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ccb8ae4b-223f-4b4a-a82c-31f50d66a173 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:01.468333 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ccb8ae4b-223f-4b4a-a82c-31f50d66a173 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:01.468333 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ccb8ae4b-223f-4b4a-a82c-31f50d66a173 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:01.512873 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ccb8ae4b-223f-4b4a-a82c-31f50d66a173 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.067599 Oct 04 19:07:01.514423 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3249/6517] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Oct 4 19:07:01 2022] GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15/os-volume_attachments => generated 25 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:01.590584 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c2960449-e9eb-4852-987a-6a52ce200751 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:01.591092 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c2960449-e9eb-4852-987a-6a52ce200751 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 0e957abd-68e7-48c3-af4b-74d570d41c15] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:01.600876 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c2960449-e9eb-4852-987a-6a52ce200751 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:01.600876 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c2960449-e9eb-4852-987a-6a52ce200751 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:01.601321 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c2960449-e9eb-4852-987a-6a52ce200751 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:01.602165 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c2960449-e9eb-4852-987a-6a52ce200751 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:01.609504 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c2960449-e9eb-4852-987a-6a52ce200751 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:01.610533 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c2960449-e9eb-4852-987a-6a52ce200751 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:01.648403 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c2960449-e9eb-4852-987a-6a52ce200751 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 0e957abd-68e7-48c3-af4b-74d570d41c15] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:07:02.075751 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c2960449-e9eb-4852-987a-6a52ce200751 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15" status: 204 len: 0 microversion: 2.20 time: 0.489404 Oct 04 19:07:02.076402 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3269/6518] 10.222.0.20 () {60 vars in 1280 bytes} [Tue Oct 4 19:07:01 2022] DELETE /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 19:07:02.087010 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d14c2f5a-f84b-4140-9fe0-359a94aad05c tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:02.090641 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d14c2f5a-f84b-4140-9fe0-359a94aad05c tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 0e957abd-68e7-48c3-af4b-74d570d41c15] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:02.097131 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d14c2f5a-f84b-4140-9fe0-359a94aad05c tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:02.097736 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d14c2f5a-f84b-4140-9fe0-359a94aad05c tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:02.098196 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d14c2f5a-f84b-4140-9fe0-359a94aad05c tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:02.098952 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d14c2f5a-f84b-4140-9fe0-359a94aad05c tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:02.099428 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d14c2f5a-f84b-4140-9fe0-359a94aad05c tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:02.099874 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d14c2f5a-f84b-4140-9fe0-359a94aad05c tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:02.259101 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d14c2f5a-f84b-4140-9fe0-359a94aad05c tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:02.268268 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d14c2f5a-f84b-4140-9fe0-359a94aad05c tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:02.270067 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d14c2f5a-f84b-4140-9fe0-359a94aad05c tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:02.271278 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d14c2f5a-f84b-4140-9fe0-359a94aad05c tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15" status: 200 len: 1725 microversion: 2.20 time: 0.190095 Oct 04 19:07:02.271886 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3250/6519] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:07:02 2022] GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15 => generated 1725 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:07:03.302118 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-370e03fa-7ab2-45d3-9878-f3d3a0598ced tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:03.303012 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-370e03fa-7ab2-45d3-9878-f3d3a0598ced tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 0e957abd-68e7-48c3-af4b-74d570d41c15] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:03.326992 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-370e03fa-7ab2-45d3-9878-f3d3a0598ced tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:03.327929 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-370e03fa-7ab2-45d3-9878-f3d3a0598ced tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:03.328476 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-370e03fa-7ab2-45d3-9878-f3d3a0598ced tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:03.330307 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-370e03fa-7ab2-45d3-9878-f3d3a0598ced tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:03.330307 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-370e03fa-7ab2-45d3-9878-f3d3a0598ced tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:03.330766 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-370e03fa-7ab2-45d3-9878-f3d3a0598ced tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:03.506781 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-370e03fa-7ab2-45d3-9878-f3d3a0598ced tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:03.519273 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-370e03fa-7ab2-45d3-9878-f3d3a0598ced tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:03.519273 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-370e03fa-7ab2-45d3-9878-f3d3a0598ced tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:03.519273 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-370e03fa-7ab2-45d3-9878-f3d3a0598ced tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15" status: 200 len: 1725 microversion: 2.20 time: 0.221005 Oct 04 19:07:03.519273 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3270/6520] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:07:03 2022] GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15 => generated 1725 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 19:07:04.545849 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3bb0285d-0752-4143-9265-712a02e5e41b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:04.546490 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3bb0285d-0752-4143-9265-712a02e5e41b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 0e957abd-68e7-48c3-af4b-74d570d41c15] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:04.553551 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3bb0285d-0752-4143-9265-712a02e5e41b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:04.554272 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3bb0285d-0752-4143-9265-712a02e5e41b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:04.554714 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3bb0285d-0752-4143-9265-712a02e5e41b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:04.555693 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3bb0285d-0752-4143-9265-712a02e5e41b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:04.556183 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3bb0285d-0752-4143-9265-712a02e5e41b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:04.556777 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3bb0285d-0752-4143-9265-712a02e5e41b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:04.721719 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3bb0285d-0752-4143-9265-712a02e5e41b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:04.731173 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3bb0285d-0752-4143-9265-712a02e5e41b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:04.735419 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3bb0285d-0752-4143-9265-712a02e5e41b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:04.737045 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3bb0285d-0752-4143-9265-712a02e5e41b tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15" status: 200 len: 1725 microversion: 2.20 time: 0.195846 Oct 04 19:07:04.741509 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3251/6521] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:07:04 2022] GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15 => generated 1725 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 19:07:05.573110 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-28b0683e-173e-4687-839d-4cd3bd722d61 req-2a27aa86-4f2f-4061-96a9-1983911de009 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e957abd-68e7-48c3-af4b-74d570d41c15", "name": "network-vif-deleted", "tag": "a324d908-a426-4333-ae46-4fc6e0230e67"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:07:05.617497 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-28b0683e-173e-4687-839d-4cd3bd722d61 req-2a27aa86-4f2f-4061-96a9-1983911de009 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:05.617497 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-28b0683e-173e-4687-839d-4cd3bd722d61 req-2a27aa86-4f2f-4061-96a9-1983911de009 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:05.617497 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-28b0683e-173e-4687-839d-4cd3bd722d61 req-2a27aa86-4f2f-4061-96a9-1983911de009 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:05.635081 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=4 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:07:05.673958 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-28b0683e-173e-4687-839d-4cd3bd722d61 req-2a27aa86-4f2f-4061-96a9-1983911de009 service nova] Creating event network-vif-deleted:a324d908-a426-4333-ae46-4fc6e0230e67 for instance 0e957abd-68e7-48c3-af4b-74d570d41c15 on n-h2-850501-14 Oct 04 19:07:05.689500 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-28b0683e-173e-4687-839d-4cd3bd722d61 req-2a27aa86-4f2f-4061-96a9-1983911de009 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130538 Oct 04 19:07:05.690374 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3271/6522] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:07:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:07:05.786915 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f671d236-34db-4f23-aec3-dfa476a5dcb1 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:05.787562 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f671d236-34db-4f23-aec3-dfa476a5dcb1 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 0e957abd-68e7-48c3-af4b-74d570d41c15] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:05.801697 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f671d236-34db-4f23-aec3-dfa476a5dcb1 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:05.802475 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f671d236-34db-4f23-aec3-dfa476a5dcb1 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:05.804466 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f671d236-34db-4f23-aec3-dfa476a5dcb1 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:05.805655 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f671d236-34db-4f23-aec3-dfa476a5dcb1 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:05.809625 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f671d236-34db-4f23-aec3-dfa476a5dcb1 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:05.810782 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f671d236-34db-4f23-aec3-dfa476a5dcb1 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:05.917968 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f671d236-34db-4f23-aec3-dfa476a5dcb1 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:05.941903 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f671d236-34db-4f23-aec3-dfa476a5dcb1 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:05.945698 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f671d236-34db-4f23-aec3-dfa476a5dcb1 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:05.950426 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f671d236-34db-4f23-aec3-dfa476a5dcb1 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15" status: 200 len: 1366 microversion: 2.20 time: 0.177771 Oct 04 19:07:05.953404 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3252/6523] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:07:05 2022] GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15 => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:07:06.983482 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-85bf7b68-f6d9-4805-b10e-a77165c5d8ce tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:06.984251 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-85bf7b68-f6d9-4805-b10e-a77165c5d8ce tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 0e957abd-68e7-48c3-af4b-74d570d41c15] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:06.991549 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-85bf7b68-f6d9-4805-b10e-a77165c5d8ce tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:06.992089 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-85bf7b68-f6d9-4805-b10e-a77165c5d8ce tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:06.992544 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-85bf7b68-f6d9-4805-b10e-a77165c5d8ce tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:06.993605 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-85bf7b68-f6d9-4805-b10e-a77165c5d8ce tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:06.994073 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-85bf7b68-f6d9-4805-b10e-a77165c5d8ce tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:06.994506 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-85bf7b68-f6d9-4805-b10e-a77165c5d8ce tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:07.043220 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-85bf7b68-f6d9-4805-b10e-a77165c5d8ce tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:07.048410 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-85bf7b68-f6d9-4805-b10e-a77165c5d8ce tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:07.048976 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-85bf7b68-f6d9-4805-b10e-a77165c5d8ce tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:07.049445 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-85bf7b68-f6d9-4805-b10e-a77165c5d8ce tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lazy-loading 'fault' on Instance uuid 0e957abd-68e7-48c3-af4b-74d570d41c15 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:07:07.108386 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-85bf7b68-f6d9-4805-b10e-a77165c5d8ce tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:07.118826 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-85bf7b68-f6d9-4805-b10e-a77165c5d8ce tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:07.125303 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-85bf7b68-f6d9-4805-b10e-a77165c5d8ce tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46676c950dc043bda9b06a2bf8af3085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56fe9a8df63477b883f958825dbeafa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:07.125303 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-85bf7b68-f6d9-4805-b10e-a77165c5d8ce tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15" status: 200 len: 1371 microversion: 2.20 time: 0.147576 Oct 04 19:07:07.125303 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3272/6524] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:07:06 2022] GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15 => generated 1371 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 19:07:08.160616 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-94e279dd-8ed2-4cfb-81aa-e97f482e0486 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:08.161983 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-94e279dd-8ed2-4cfb-81aa-e97f482e0486 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 0e957abd-68e7-48c3-af4b-74d570d41c15] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:08.173187 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-94e279dd-8ed2-4cfb-81aa-e97f482e0486 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:08.174089 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-94e279dd-8ed2-4cfb-81aa-e97f482e0486 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:08.174789 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-94e279dd-8ed2-4cfb-81aa-e97f482e0486 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:08.176129 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-94e279dd-8ed2-4cfb-81aa-e97f482e0486 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:08.177106 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-94e279dd-8ed2-4cfb-81aa-e97f482e0486 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:08.177971 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-94e279dd-8ed2-4cfb-81aa-e97f482e0486 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:08.194739 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-94e279dd-8ed2-4cfb-81aa-e97f482e0486 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] HTTP exception thrown: Instance 0e957abd-68e7-48c3-af4b-74d570d41c15 could not be found. Oct 04 19:07:08.196432 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-94e279dd-8ed2-4cfb-81aa-e97f482e0486 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Request method failure captured: Oct 04 19:07:08.196432 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15 HTTP/1.1 Oct 04 19:07:08.196432 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 19:07:08.196432 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 19:07:08.196432 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 19:07:08.196432 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 19:07:08.196432 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 19:07:08.196432 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 19:07:08.196432 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 19:07:08.196432 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 19:07:08.196432 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPIJWtqn1BwGSboHCu8dMzewnZ8z0DuMrXk7CBmt7J2yD6zV8noY5_3PNlOVNmZkdXJrIq5VXEFV2GVrqKuqlbTwmixwjxfydIbQmhN8Cj0z84NkNQ9kY0gslO7HP3WsSqTClXHCgfZWZX4qvaJKz6i5lve1xdtmOtzQ8xk6cnOBI-ow Oct 04 19:07:08.196432 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 19:07:08.196432 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 19:07:08.196432 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 19:07:08.196432 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 19:07:08.196432 n-d-850501-14 devstack@n-api.service[123002]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 19:07:08.196432 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 19:07:08.196432 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 19:07:08.196432 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: b56fe9a8df63477b883f958825dbeafa Oct 04 19:07:08.196432 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1807071435 Oct 04 19:07:08.196432 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 19:07:08.196432 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 19:07:08.196432 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b56fe9a8df63477b883f958825dbeafa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b56fe9a8df63477b883f958825dbeafa", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b56fe9a8df63477b883f958825dbeafa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b56fe9a8df63477b883f958825dbeafa"}]}] Oct 04 19:07:08.196432 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1807071435 Oct 04 19:07:08.196432 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: b56fe9a8df63477b883f958825dbeafa Oct 04 19:07:08.196432 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1807071435 Oct 04 19:07:08.196432 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-AttachVolumeShelveTestJSON-1807071435-project Oct 04 19:07:08.196432 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 19:07:08.196432 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 19:07:08.196432 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 46676c950dc043bda9b06a2bf8af3085 Oct 04 19:07:08.196432 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1807071435-project Oct 04 19:07:08.196432 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 19:07:08.196432 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 0e957abd-68e7-48c3-af4b-74d570d41c15 could not be found. Oct 04 19:07:08.196432 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '0e957abd-68e7-48c3-af4b-74d570d41c15'} Oct 04 19:07:08.196432 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:07:08.196432 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:07:08.196432 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:07:08.196432 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:07:08.196432 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:07:08.196432 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:07:08.196432 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:07:08.196432 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:07:08.196432 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:07:08.196432 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:07:08.196432 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e957abd-68e7-48c3-af4b-74d570d41c15 could not be found. Oct 04 19:07:08.196432 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:07:08.196432 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:07:08.196432 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:07:08.196432 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:07:08.196432 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:07:08.196432 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:07:08.196432 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:07:08.196432 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:07:08.196432 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:07:08.196432 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:07:08.196432 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:07:08.196432 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:07:08.196432 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:07:08.196432 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:07:08.196432 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:07:08.196432 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:07:08.196432 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e957abd-68e7-48c3-af4b-74d570d41c15 could not be found. Oct 04 19:07:08.196432 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:07:08.196432 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:07:08.201738 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:07:08.201738 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:07:08.201738 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:07:08.201738 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:07:08.201738 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:07:08.201738 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:07:08.201738 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e957abd-68e7-48c3-af4b-74d570d41c15 could not be found. Oct 04 19:07:08.201738 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:07:08.203033 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-94e279dd-8ed2-4cfb-81aa-e97f482e0486 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Returning 404 to user: Instance 0e957abd-68e7-48c3-af4b-74d570d41c15 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:07:08.204471 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-94e279dd-8ed2-4cfb-81aa-e97f482e0486 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15" status: 404 len: 111 microversion: 2.20 time: 0.048331 Oct 04 19:07:08.205053 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3253/6525] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:07:08 2022] GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 04 19:07:08.213945 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-cb3c267d-a496-4bc9-bb92-caaec1dc1c0c tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '.version_select at 0x7fe2590dbc10>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:08.322941 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-cb3c267d-a496-4bc9-bb92-caaec1dc1c0c tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1827792346" status: 204 len: 0 microversion: 2.20 time: 0.113086 Oct 04 19:07:08.328177 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3273/6526] 10.222.0.20 () {60 vars in 1262 bytes} [Tue Oct 4 19:07:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1827792346 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 19:07:09.067371 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-35ff8649-a412-420f-bf2b-49ece4e3f95b tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1609482276", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": [{"uuid": "51978103-f099-44b1-8c5b-f81c20fc4355"}]}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:07:09.135386 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-35ff8649-a412-420f-bf2b-49ece4e3f95b tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] validate_networks() for [('51978103-f099-44b1-8c5b-f81c20fc4355', None, None, None, None, None)] {{(pid=123002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:07:09.659069 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-35ff8649-a412-420f-bf2b-49ece4e3f95b tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:07:09.659652 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-35ff8649-a412-420f-bf2b-49ece4e3f95b tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:07:09.659975 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-35ff8649-a412-420f-bf2b-49ece4e3f95b tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:07:09.660438 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-35ff8649-a412-420f-bf2b-49ece4e3f95b tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:07:09.660939 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-35ff8649-a412-420f-bf2b-49ece4e3f95b tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:07:09.686611 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-35ff8649-a412-420f-bf2b-49ece4e3f95b tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:09.687126 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-35ff8649-a412-420f-bf2b-49ece4e3f95b tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:09.687579 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-35ff8649-a412-420f-bf2b-49ece4e3f95b tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:09.690297 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-35ff8649-a412-420f-bf2b-49ece4e3f95b tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:09.690805 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-35ff8649-a412-420f-bf2b-49ece4e3f95b tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:09.691253 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-35ff8649-a412-420f-bf2b-49ece4e3f95b tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:09.730143 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-35ff8649-a412-420f-bf2b-49ece4e3f95b tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Getting quotas for project 90bae5f44b43437193fec925de3f0bf2. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:07:09.737711 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-35ff8649-a412-420f-bf2b-49ece4e3f95b tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Getting quotas for user 7235fe80b9ae4d2cb3ef83ea30fb8961 and project 90bae5f44b43437193fec925de3f0bf2. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:07:09.753047 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-35ff8649-a412-420f-bf2b-49ece4e3f95b tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Going to run 1 instances... {{(pid=123002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:07:09.755507 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-35ff8649-a412-420f-bf2b-49ece4e3f95b tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] [instance: e9a52cdd-6239-4cc7-a02c-2a532aaa9278] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:07:09.985111 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-35ff8649-a412-420f-bf2b-49ece4e3f95b tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.921891 Oct 04 19:07:09.989644 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3254/6527] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 19:07:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 927 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:07:10.011307 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5818e214-89be-4544-ac78-5ed636bf66ac tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:10.012502 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5818e214-89be-4544-ac78-5ed636bf66ac tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] [instance: e9a52cdd-6239-4cc7-a02c-2a532aaa9278] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:10.138901 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5818e214-89be-4544-ac78-5ed636bf66ac tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7235fe80b9ae4d2cb3ef83ea30fb8961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90bae5f44b43437193fec925de3f0bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:10.177271 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5818e214-89be-4544-ac78-5ed636bf66ac tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] 10.222.0.20 "GET /compute/v2.1/servers/e9a52cdd-6239-4cc7-a02c-2a532aaa9278" status: 200 len: 1214 microversion: 2.1 time: 0.166435 Oct 04 19:07:10.177271 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3274/6528] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:09 2022] GET /compute/v2.1/servers/e9a52cdd-6239-4cc7-a02c-2a532aaa9278 => generated 1214 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:11.191847 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-046014fb-f6ea-402e-89b3-d58c531965a1 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:11.193251 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-046014fb-f6ea-402e-89b3-d58c531965a1 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] [instance: e9a52cdd-6239-4cc7-a02c-2a532aaa9278] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:11.262755 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-046014fb-f6ea-402e-89b3-d58c531965a1 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7235fe80b9ae4d2cb3ef83ea30fb8961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90bae5f44b43437193fec925de3f0bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:11.274065 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-046014fb-f6ea-402e-89b3-d58c531965a1 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] 10.222.0.20 "GET /compute/v2.1/servers/e9a52cdd-6239-4cc7-a02c-2a532aaa9278" status: 200 len: 1214 microversion: 2.1 time: 0.086493 Oct 04 19:07:11.274777 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3255/6529] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:11 2022] GET /compute/v2.1/servers/e9a52cdd-6239-4cc7-a02c-2a532aaa9278 => generated 1214 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:07:12.298778 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2f31b851-d07b-47ab-a103-773eff63e709 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:12.299406 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2f31b851-d07b-47ab-a103-773eff63e709 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] [instance: e9a52cdd-6239-4cc7-a02c-2a532aaa9278] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:12.302526 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=2,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:07:12.307656 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2f31b851-d07b-47ab-a103-773eff63e709 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:12.308464 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2f31b851-d07b-47ab-a103-773eff63e709 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:12.308912 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2f31b851-d07b-47ab-a103-773eff63e709 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:12.309654 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2f31b851-d07b-47ab-a103-773eff63e709 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:12.310230 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2f31b851-d07b-47ab-a103-773eff63e709 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:12.310717 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2f31b851-d07b-47ab-a103-773eff63e709 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:12.386344 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-2f31b851-d07b-47ab-a103-773eff63e709 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7235fe80b9ae4d2cb3ef83ea30fb8961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90bae5f44b43437193fec925de3f0bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:12.394769 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2f31b851-d07b-47ab-a103-773eff63e709 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] 10.222.0.20 "GET /compute/v2.1/servers/e9a52cdd-6239-4cc7-a02c-2a532aaa9278" status: 200 len: 1210 microversion: 2.1 time: 0.101193 Oct 04 19:07:12.395335 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3275/6530] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:12 2022] GET /compute/v2.1/servers/e9a52cdd-6239-4cc7-a02c-2a532aaa9278 => generated 1210 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:12.949521 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c971aa65-4df4-469d-8871-6c2051814d4e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:12.950102 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c971aa65-4df4-469d-8871-6c2051814d4e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 0e957abd-68e7-48c3-af4b-74d570d41c15] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:12.959711 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c971aa65-4df4-469d-8871-6c2051814d4e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:12.960528 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c971aa65-4df4-469d-8871-6c2051814d4e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:12.961424 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c971aa65-4df4-469d-8871-6c2051814d4e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:12.963503 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c971aa65-4df4-469d-8871-6c2051814d4e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:12.964226 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c971aa65-4df4-469d-8871-6c2051814d4e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:12.964883 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c971aa65-4df4-469d-8871-6c2051814d4e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:12.970186 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=66 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:07:12.983639 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-c971aa65-4df4-469d-8871-6c2051814d4e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] HTTP exception thrown: Instance 0e957abd-68e7-48c3-af4b-74d570d41c15 could not be found. Oct 04 19:07:12.985681 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c971aa65-4df4-469d-8871-6c2051814d4e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Request method failure captured: Oct 04 19:07:12.985681 n-d-850501-14 devstack@n-api.service[123002]: request: DELETE /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15 HTTP/1.1 Oct 04 19:07:12.985681 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 19:07:12.985681 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 19:07:12.985681 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 19:07:12.985681 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 19:07:12.985681 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 19:07:12.985681 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 19:07:12.985681 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 19:07:12.985681 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 19:07:12.985681 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPIJWtqn1BwGSboHCu8dMzewnZ8z0DuMrXk7CBmt7J2yD6zV8noY5_3PNlOVNmZkdXJrIq5VXEFV2GVrqKuqlbTwmixwjxfydIbQmhN8Cj0z84NkNQ9kY0gslO7HP3WsSqTClXHCgfZWZX4qvaJKz6i5lve1xdtmOtzQ8xk6cnOBI-ow Oct 04 19:07:12.985681 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 19:07:12.985681 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 19:07:12.985681 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 19:07:12.985681 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 19:07:12.985681 n-d-850501-14 devstack@n-api.service[123002]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 19:07:12.985681 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 19:07:12.985681 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 19:07:12.985681 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: b56fe9a8df63477b883f958825dbeafa Oct 04 19:07:12.985681 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1807071435 Oct 04 19:07:12.985681 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 19:07:12.985681 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 19:07:12.985681 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b56fe9a8df63477b883f958825dbeafa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b56fe9a8df63477b883f958825dbeafa", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b56fe9a8df63477b883f958825dbeafa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b56fe9a8df63477b883f958825dbeafa"}]}] Oct 04 19:07:12.985681 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1807071435 Oct 04 19:07:12.985681 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: b56fe9a8df63477b883f958825dbeafa Oct 04 19:07:12.985681 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1807071435 Oct 04 19:07:12.985681 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-AttachVolumeShelveTestJSON-1807071435-project Oct 04 19:07:12.985681 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 19:07:12.985681 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 19:07:12.985681 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 46676c950dc043bda9b06a2bf8af3085 Oct 04 19:07:12.985681 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1807071435-project Oct 04 19:07:12.985681 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 19:07:12.985681 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 0e957abd-68e7-48c3-af4b-74d570d41c15 could not be found. Oct 04 19:07:12.985681 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '0e957abd-68e7-48c3-af4b-74d570d41c15'} Oct 04 19:07:12.985681 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:07:12.985681 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:07:12.985681 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:07:12.985681 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:07:12.985681 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:07:12.985681 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:07:12.985681 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:07:12.985681 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:07:12.985681 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:07:12.985681 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:07:12.985681 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e957abd-68e7-48c3-af4b-74d570d41c15 could not be found. Oct 04 19:07:12.985681 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:07:12.985681 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:07:12.985681 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:07:12.985681 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:07:12.985681 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:07:12.985681 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:07:12.985681 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:07:12.985681 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:07:12.985681 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:07:12.985681 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:07:12.985681 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 19:07:12.985681 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 19:07:12.985681 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 19:07:12.985681 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 19:07:12.985681 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:07:12.985681 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:07:12.985681 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:07:12.985681 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:07:13.001055 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e957abd-68e7-48c3-af4b-74d570d41c15 could not be found. Oct 04 19:07:13.001055 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:07:13.001055 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:07:13.001055 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:07:13.001055 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:07:13.001055 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:07:13.001055 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:07:13.001055 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:07:13.001055 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:07:13.001055 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e957abd-68e7-48c3-af4b-74d570d41c15 could not be found. Oct 04 19:07:13.001055 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:07:13.001055 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c971aa65-4df4-469d-8871-6c2051814d4e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Returning 404 to user: Instance 0e957abd-68e7-48c3-af4b-74d570d41c15 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:07:13.001055 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c971aa65-4df4-469d-8871-6c2051814d4e tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15" status: 404 len: 111 microversion: 2.20 time: 0.045929 Oct 04 19:07:13.001055 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3256/6531] 10.222.0.20 () {60 vars in 1280 bytes} [Tue Oct 4 19:07:12 2022] DELETE /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 19:07:13.006955 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4f56a82c-4455-4ddf-bca5-972bfc5d18f0 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:13.008365 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-4f56a82c-4455-4ddf-bca5-972bfc5d18f0 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 0e957abd-68e7-48c3-af4b-74d570d41c15] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:13.015669 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4f56a82c-4455-4ddf-bca5-972bfc5d18f0 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:13.016220 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4f56a82c-4455-4ddf-bca5-972bfc5d18f0 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:13.016774 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4f56a82c-4455-4ddf-bca5-972bfc5d18f0 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:13.017943 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4f56a82c-4455-4ddf-bca5-972bfc5d18f0 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:13.018849 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4f56a82c-4455-4ddf-bca5-972bfc5d18f0 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:13.020421 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4f56a82c-4455-4ddf-bca5-972bfc5d18f0 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:13.029773 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:07:13.039607 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-4f56a82c-4455-4ddf-bca5-972bfc5d18f0 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] HTTP exception thrown: Instance 0e957abd-68e7-48c3-af4b-74d570d41c15 could not be found. Oct 04 19:07:13.041448 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4f56a82c-4455-4ddf-bca5-972bfc5d18f0 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Request method failure captured: Oct 04 19:07:13.041448 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15 HTTP/1.1 Oct 04 19:07:13.041448 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 19:07:13.041448 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 19:07:13.041448 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 19:07:13.041448 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 19:07:13.041448 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 19:07:13.041448 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 19:07:13.041448 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 19:07:13.041448 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 19:07:13.041448 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPIJWtqn1BwGSboHCu8dMzewnZ8z0DuMrXk7CBmt7J2yD6zV8noY5_3PNlOVNmZkdXJrIq5VXEFV2GVrqKuqlbTwmixwjxfydIbQmhN8Cj0z84NkNQ9kY0gslO7HP3WsSqTClXHCgfZWZX4qvaJKz6i5lve1xdtmOtzQ8xk6cnOBI-ow Oct 04 19:07:13.041448 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 19:07:13.041448 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 19:07:13.041448 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 19:07:13.041448 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 19:07:13.041448 n-d-850501-14 devstack@n-api.service[123001]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 19:07:13.041448 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 19:07:13.041448 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 19:07:13.041448 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: b56fe9a8df63477b883f958825dbeafa Oct 04 19:07:13.041448 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1807071435 Oct 04 19:07:13.041448 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 19:07:13.041448 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 19:07:13.041448 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b56fe9a8df63477b883f958825dbeafa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b56fe9a8df63477b883f958825dbeafa", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b56fe9a8df63477b883f958825dbeafa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b56fe9a8df63477b883f958825dbeafa"}]}] Oct 04 19:07:13.041448 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1807071435 Oct 04 19:07:13.041448 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: b56fe9a8df63477b883f958825dbeafa Oct 04 19:07:13.041448 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1807071435 Oct 04 19:07:13.041448 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-AttachVolumeShelveTestJSON-1807071435-project Oct 04 19:07:13.041448 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 19:07:13.041448 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 19:07:13.041448 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 46676c950dc043bda9b06a2bf8af3085 Oct 04 19:07:13.041448 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1807071435-project Oct 04 19:07:13.041448 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 19:07:13.041448 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 0e957abd-68e7-48c3-af4b-74d570d41c15 could not be found. Oct 04 19:07:13.041448 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '0e957abd-68e7-48c3-af4b-74d570d41c15'} Oct 04 19:07:13.041448 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:07:13.041448 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:07:13.041448 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:07:13.041448 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:07:13.041448 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:07:13.041448 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:07:13.041448 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:07:13.041448 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:07:13.041448 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:07:13.041448 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:07:13.041448 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e957abd-68e7-48c3-af4b-74d570d41c15 could not be found. Oct 04 19:07:13.041448 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:07:13.041448 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:07:13.041448 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:07:13.041448 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:07:13.041448 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:07:13.041448 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:07:13.041448 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:07:13.041448 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:07:13.041448 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:07:13.041448 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:07:13.041448 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:07:13.041448 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:07:13.041448 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:07:13.041448 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:07:13.041448 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:07:13.041448 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:07:13.041448 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e957abd-68e7-48c3-af4b-74d570d41c15 could not be found. Oct 04 19:07:13.041448 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:07:13.041448 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:07:13.047225 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:07:13.047225 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:07:13.047225 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:07:13.047225 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:07:13.047225 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:07:13.047225 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:07:13.047225 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e957abd-68e7-48c3-af4b-74d570d41c15 could not be found. Oct 04 19:07:13.047225 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:07:13.047225 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4f56a82c-4455-4ddf-bca5-972bfc5d18f0 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Returning 404 to user: Instance 0e957abd-68e7-48c3-af4b-74d570d41c15 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:07:13.047225 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-4f56a82c-4455-4ddf-bca5-972bfc5d18f0 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15" status: 404 len: 111 microversion: 2.20 time: 0.039907 Oct 04 19:07:13.047225 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3276/6532] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:07:13 2022] GET /compute/v2.1/servers/0e957abd-68e7-48c3-af4b-74d570d41c15 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 19:07:13.422571 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d06f5f0f-b8d2-43e9-89e7-df48dc3003ff tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:13.423532 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d06f5f0f-b8d2-43e9-89e7-df48dc3003ff tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] [instance: e9a52cdd-6239-4cc7-a02c-2a532aaa9278] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:13.433955 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d06f5f0f-b8d2-43e9-89e7-df48dc3003ff tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:13.435690 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d06f5f0f-b8d2-43e9-89e7-df48dc3003ff tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:13.436222 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d06f5f0f-b8d2-43e9-89e7-df48dc3003ff tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:13.436978 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d06f5f0f-b8d2-43e9-89e7-df48dc3003ff tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:13.437849 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d06f5f0f-b8d2-43e9-89e7-df48dc3003ff tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:13.440550 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d06f5f0f-b8d2-43e9-89e7-df48dc3003ff tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:13.549627 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d06f5f0f-b8d2-43e9-89e7-df48dc3003ff tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7235fe80b9ae4d2cb3ef83ea30fb8961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90bae5f44b43437193fec925de3f0bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:13.559348 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d06f5f0f-b8d2-43e9-89e7-df48dc3003ff tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] 10.222.0.20 "GET /compute/v2.1/servers/e9a52cdd-6239-4cc7-a02c-2a532aaa9278" status: 200 len: 1266 microversion: 2.1 time: 0.141762 Oct 04 19:07:13.574045 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3257/6533] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:13 2022] GET /compute/v2.1/servers/e9a52cdd-6239-4cc7-a02c-2a532aaa9278 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:14.594410 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a42253c6-4a70-4ff3-a4fa-2e58782cdf72 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:14.598270 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a42253c6-4a70-4ff3-a4fa-2e58782cdf72 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] [instance: e9a52cdd-6239-4cc7-a02c-2a532aaa9278] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:14.616773 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a42253c6-4a70-4ff3-a4fa-2e58782cdf72 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:14.618371 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a42253c6-4a70-4ff3-a4fa-2e58782cdf72 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:14.618371 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a42253c6-4a70-4ff3-a4fa-2e58782cdf72 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:14.618895 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a42253c6-4a70-4ff3-a4fa-2e58782cdf72 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:14.625311 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a42253c6-4a70-4ff3-a4fa-2e58782cdf72 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:14.625832 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a42253c6-4a70-4ff3-a4fa-2e58782cdf72 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:14.751562 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a42253c6-4a70-4ff3-a4fa-2e58782cdf72 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7235fe80b9ae4d2cb3ef83ea30fb8961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90bae5f44b43437193fec925de3f0bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:14.759508 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a42253c6-4a70-4ff3-a4fa-2e58782cdf72 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] 10.222.0.20 "GET /compute/v2.1/servers/e9a52cdd-6239-4cc7-a02c-2a532aaa9278" status: 200 len: 1272 microversion: 2.1 time: 0.178230 Oct 04 19:07:14.776868 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3277/6534] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:14 2022] GET /compute/v2.1/servers/e9a52cdd-6239-4cc7-a02c-2a532aaa9278 => generated 1272 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:15.786966 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1c029a01-c238-41a7-bb25-23b61ba138bd tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:15.788427 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1c029a01-c238-41a7-bb25-23b61ba138bd tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] [instance: e9a52cdd-6239-4cc7-a02c-2a532aaa9278] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:15.798345 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1c029a01-c238-41a7-bb25-23b61ba138bd tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:15.799059 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1c029a01-c238-41a7-bb25-23b61ba138bd tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:15.799690 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1c029a01-c238-41a7-bb25-23b61ba138bd tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:15.800659 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1c029a01-c238-41a7-bb25-23b61ba138bd tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:15.801299 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1c029a01-c238-41a7-bb25-23b61ba138bd tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:15.802031 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1c029a01-c238-41a7-bb25-23b61ba138bd tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:16.010171 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1c029a01-c238-41a7-bb25-23b61ba138bd tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7235fe80b9ae4d2cb3ef83ea30fb8961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90bae5f44b43437193fec925de3f0bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:16.021346 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1c029a01-c238-41a7-bb25-23b61ba138bd tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] 10.222.0.20 "GET /compute/v2.1/servers/e9a52cdd-6239-4cc7-a02c-2a532aaa9278" status: 200 len: 1314 microversion: 2.1 time: 0.240186 Oct 04 19:07:16.030590 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3258/6535] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:15 2022] GET /compute/v2.1/servers/e9a52cdd-6239-4cc7-a02c-2a532aaa9278 => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:16.705208 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-1f562157-7585-4ee5-8aa0-2ae5813dc2ef req-eaf69c60-5ba3-4b3c-9074-3379f3e086ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9a52cdd-6239-4cc7-a02c-2a532aaa9278", "tag": "8a9fb50c-70bd-4227-b6cb-0db3778eb953"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:07:16.729102 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-1f562157-7585-4ee5-8aa0-2ae5813dc2ef req-eaf69c60-5ba3-4b3c-9074-3379f3e086ca service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:16.729585 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-1f562157-7585-4ee5-8aa0-2ae5813dc2ef req-eaf69c60-5ba3-4b3c-9074-3379f3e086ca service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:16.730322 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-1f562157-7585-4ee5-8aa0-2ae5813dc2ef req-eaf69c60-5ba3-4b3c-9074-3379f3e086ca service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:16.752190 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-1f562157-7585-4ee5-8aa0-2ae5813dc2ef req-eaf69c60-5ba3-4b3c-9074-3379f3e086ca service nova] Creating event network-changed:8a9fb50c-70bd-4227-b6cb-0db3778eb953 for instance e9a52cdd-6239-4cc7-a02c-2a532aaa9278 on n-h1-850501-14 Oct 04 19:07:16.759557 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-1f562157-7585-4ee5-8aa0-2ae5813dc2ef req-eaf69c60-5ba3-4b3c-9074-3379f3e086ca service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059353 Oct 04 19:07:16.760205 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3278/6536] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:07:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:07:17.046203 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0fb94153-815a-498d-8642-8152d665b445 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:17.047740 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0fb94153-815a-498d-8642-8152d665b445 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] [instance: e9a52cdd-6239-4cc7-a02c-2a532aaa9278] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:17.086269 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0fb94153-815a-498d-8642-8152d665b445 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:17.089175 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0fb94153-815a-498d-8642-8152d665b445 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:17.092719 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0fb94153-815a-498d-8642-8152d665b445 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:17.094106 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0fb94153-815a-498d-8642-8152d665b445 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:17.094770 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0fb94153-815a-498d-8642-8152d665b445 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:17.095382 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0fb94153-815a-498d-8642-8152d665b445 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:17.613785 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0fb94153-815a-498d-8642-8152d665b445 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7235fe80b9ae4d2cb3ef83ea30fb8961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90bae5f44b43437193fec925de3f0bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:17.622351 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0fb94153-815a-498d-8642-8152d665b445 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] 10.222.0.20 "GET /compute/v2.1/servers/e9a52cdd-6239-4cc7-a02c-2a532aaa9278" status: 200 len: 1314 microversion: 2.1 time: 0.580795 Oct 04 19:07:17.630025 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3259/6537] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:17 2022] GET /compute/v2.1/servers/e9a52cdd-6239-4cc7-a02c-2a532aaa9278 => generated 1314 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:17.830613 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b14f7676-968e-42c1-aa4a-9de205ec76c6 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:17.835579 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b14f7676-968e-42c1-aa4a-9de205ec76c6 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:17.846312 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b14f7676-968e-42c1-aa4a-9de205ec76c6 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:17.847153 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b14f7676-968e-42c1-aa4a-9de205ec76c6 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:17.847822 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b14f7676-968e-42c1-aa4a-9de205ec76c6 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:17.848868 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b14f7676-968e-42c1-aa4a-9de205ec76c6 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:17.850488 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b14f7676-968e-42c1-aa4a-9de205ec76c6 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:17.851133 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b14f7676-968e-42c1-aa4a-9de205ec76c6 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:17.870740 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-b14f7676-968e-42c1-aa4a-9de205ec76c6 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] HTTP exception thrown: Instance 7b882133-2fca-4df4-b228-46a12f538c18 could not be found. Oct 04 19:07:17.873231 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b14f7676-968e-42c1-aa4a-9de205ec76c6 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Request method failure captured: Oct 04 19:07:17.873231 n-d-850501-14 devstack@n-api.service[123001]: request: DELETE /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 HTTP/1.1 Oct 04 19:07:17.873231 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 19:07:17.873231 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 19:07:17.873231 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 19:07:17.873231 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 19:07:17.873231 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 19:07:17.873231 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 19:07:17.873231 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 19:07:17.873231 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 19:07:17.873231 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPIJWtqn1BwGSboHCu8dMzewnZ8z0DuMrXk7CBmt7J2yD6zV8noY5_3PNlOVNmZkdXJrIq5VXEFV2GVrqKuqlbTwmixwjxfydIbQmhN8Cj0z84NkNQ9kY0gslO7HP3WsSqTClXHCgfZWZX4qvaJKz6i5lve1xdtmOtzQ8xk6cnOBI-ow Oct 04 19:07:17.873231 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 19:07:17.873231 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 19:07:17.873231 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 19:07:17.873231 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 19:07:17.873231 n-d-850501-14 devstack@n-api.service[123001]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 19:07:17.873231 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 19:07:17.873231 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 19:07:17.873231 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: b56fe9a8df63477b883f958825dbeafa Oct 04 19:07:17.873231 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1807071435 Oct 04 19:07:17.873231 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 19:07:17.873231 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 19:07:17.873231 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b56fe9a8df63477b883f958825dbeafa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b56fe9a8df63477b883f958825dbeafa", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b56fe9a8df63477b883f958825dbeafa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b56fe9a8df63477b883f958825dbeafa"}]}] Oct 04 19:07:17.873231 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1807071435 Oct 04 19:07:17.873231 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: b56fe9a8df63477b883f958825dbeafa Oct 04 19:07:17.873231 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1807071435 Oct 04 19:07:17.873231 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-AttachVolumeShelveTestJSON-1807071435-project Oct 04 19:07:17.873231 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 19:07:17.873231 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 19:07:17.873231 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 46676c950dc043bda9b06a2bf8af3085 Oct 04 19:07:17.873231 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1807071435-project Oct 04 19:07:17.873231 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 19:07:17.873231 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 7b882133-2fca-4df4-b228-46a12f538c18 could not be found. Oct 04 19:07:17.873231 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '7b882133-2fca-4df4-b228-46a12f538c18'} Oct 04 19:07:17.873231 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:07:17.873231 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:07:17.873231 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:07:17.873231 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:07:17.873231 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:07:17.873231 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:07:17.873231 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:07:17.873231 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:07:17.873231 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:07:17.873231 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:07:17.873231 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b882133-2fca-4df4-b228-46a12f538c18 could not be found. Oct 04 19:07:17.873231 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:07:17.873231 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:07:17.873231 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:07:17.873231 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:07:17.873231 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:07:17.873231 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:07:17.873231 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:07:17.873231 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:07:17.873231 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:07:17.873231 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:07:17.873231 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 19:07:17.873231 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 19:07:17.873231 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 19:07:17.873231 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 19:07:17.873231 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:07:17.873231 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:07:17.873231 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:07:17.873231 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:07:17.880566 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b882133-2fca-4df4-b228-46a12f538c18 could not be found. Oct 04 19:07:17.880566 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:07:17.880566 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:07:17.880566 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:07:17.880566 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:07:17.880566 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:07:17.880566 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:07:17.880566 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:07:17.880566 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:07:17.880566 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b882133-2fca-4df4-b228-46a12f538c18 could not be found. Oct 04 19:07:17.880566 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:07:17.880566 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b14f7676-968e-42c1-aa4a-9de205ec76c6 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Returning 404 to user: Instance 7b882133-2fca-4df4-b228-46a12f538c18 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:07:17.880566 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b14f7676-968e-42c1-aa4a-9de205ec76c6 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18" status: 404 len: 111 microversion: 2.20 time: 0.050676 Oct 04 19:07:17.880566 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3279/6538] 10.222.0.20 () {60 vars in 1280 bytes} [Tue Oct 4 19:07:17 2022] DELETE /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 19:07:17.884593 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8c75fa19-2460-4989-b59b-2e085e0fbfd3 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:17.885223 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8c75fa19-2460-4989-b59b-2e085e0fbfd3 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] [instance: 7b882133-2fca-4df4-b228-46a12f538c18] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:17.893193 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8c75fa19-2460-4989-b59b-2e085e0fbfd3 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:17.895322 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8c75fa19-2460-4989-b59b-2e085e0fbfd3 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:17.895322 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8c75fa19-2460-4989-b59b-2e085e0fbfd3 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:17.895322 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8c75fa19-2460-4989-b59b-2e085e0fbfd3 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:17.895983 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8c75fa19-2460-4989-b59b-2e085e0fbfd3 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:17.896628 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8c75fa19-2460-4989-b59b-2e085e0fbfd3 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:17.912978 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-8c75fa19-2460-4989-b59b-2e085e0fbfd3 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] HTTP exception thrown: Instance 7b882133-2fca-4df4-b228-46a12f538c18 could not be found. Oct 04 19:07:17.915092 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8c75fa19-2460-4989-b59b-2e085e0fbfd3 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Request method failure captured: Oct 04 19:07:17.915092 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 HTTP/1.1 Oct 04 19:07:17.915092 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 19:07:17.915092 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 19:07:17.915092 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 19:07:17.915092 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 19:07:17.915092 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 19:07:17.915092 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 19:07:17.915092 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 19:07:17.915092 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 19:07:17.915092 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPIJWtqn1BwGSboHCu8dMzewnZ8z0DuMrXk7CBmt7J2yD6zV8noY5_3PNlOVNmZkdXJrIq5VXEFV2GVrqKuqlbTwmixwjxfydIbQmhN8Cj0z84NkNQ9kY0gslO7HP3WsSqTClXHCgfZWZX4qvaJKz6i5lve1xdtmOtzQ8xk6cnOBI-ow Oct 04 19:07:17.915092 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 19:07:17.915092 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 19:07:17.915092 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 19:07:17.915092 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 19:07:17.915092 n-d-850501-14 devstack@n-api.service[123002]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 19:07:17.915092 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 19:07:17.915092 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 19:07:17.915092 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: b56fe9a8df63477b883f958825dbeafa Oct 04 19:07:17.915092 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1807071435 Oct 04 19:07:17.915092 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 19:07:17.915092 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 19:07:17.915092 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b56fe9a8df63477b883f958825dbeafa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b56fe9a8df63477b883f958825dbeafa", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b56fe9a8df63477b883f958825dbeafa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b56fe9a8df63477b883f958825dbeafa"}]}] Oct 04 19:07:17.915092 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1807071435 Oct 04 19:07:17.915092 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: b56fe9a8df63477b883f958825dbeafa Oct 04 19:07:17.915092 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1807071435 Oct 04 19:07:17.915092 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-AttachVolumeShelveTestJSON-1807071435-project Oct 04 19:07:17.915092 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 19:07:17.915092 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 19:07:17.915092 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 46676c950dc043bda9b06a2bf8af3085 Oct 04 19:07:17.915092 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1807071435-project Oct 04 19:07:17.915092 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 19:07:17.915092 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 7b882133-2fca-4df4-b228-46a12f538c18 could not be found. Oct 04 19:07:17.915092 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '7b882133-2fca-4df4-b228-46a12f538c18'} Oct 04 19:07:17.915092 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:07:17.915092 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:07:17.915092 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:07:17.915092 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:07:17.915092 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:07:17.915092 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:07:17.915092 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:07:17.915092 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:07:17.915092 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:07:17.915092 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:07:17.915092 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b882133-2fca-4df4-b228-46a12f538c18 could not be found. Oct 04 19:07:17.915092 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:07:17.915092 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:07:17.915092 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:07:17.915092 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:07:17.915092 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:07:17.915092 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:07:17.915092 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:07:17.915092 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:07:17.915092 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:07:17.915092 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:07:17.915092 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:07:17.915092 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:07:17.915092 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:07:17.915092 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:07:17.915092 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:07:17.915092 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:07:17.915092 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b882133-2fca-4df4-b228-46a12f538c18 could not be found. Oct 04 19:07:17.915092 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:07:17.915092 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:07:17.926776 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:07:17.926776 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:07:17.926776 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:07:17.926776 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:07:17.926776 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:07:17.926776 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:07:17.926776 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b882133-2fca-4df4-b228-46a12f538c18 could not be found. Oct 04 19:07:17.926776 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:07:17.926776 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8c75fa19-2460-4989-b59b-2e085e0fbfd3 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] Returning 404 to user: Instance 7b882133-2fca-4df4-b228-46a12f538c18 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:07:17.926776 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8c75fa19-2460-4989-b59b-2e085e0fbfd3 tempest-AttachVolumeShelveTestJSON-1807071435 tempest-AttachVolumeShelveTestJSON-1807071435-project] 10.222.0.20 "GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18" status: 404 len: 111 microversion: 2.20 time: 0.041353 Oct 04 19:07:17.926776 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3260/6539] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Oct 4 19:07:17 2022] GET /compute/v2.1/servers/7b882133-2fca-4df4-b228-46a12f538c18 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 19:07:18.647929 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-cb507d9c-afc3-4032-8537-92436dc38cd9 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:18.648761 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-cb507d9c-afc3-4032-8537-92436dc38cd9 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] [instance: e9a52cdd-6239-4cc7-a02c-2a532aaa9278] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:18.675431 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cb507d9c-afc3-4032-8537-92436dc38cd9 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:18.676277 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cb507d9c-afc3-4032-8537-92436dc38cd9 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:18.677516 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cb507d9c-afc3-4032-8537-92436dc38cd9 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:18.678620 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cb507d9c-afc3-4032-8537-92436dc38cd9 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:18.679239 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cb507d9c-afc3-4032-8537-92436dc38cd9 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:18.679824 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cb507d9c-afc3-4032-8537-92436dc38cd9 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:19.154873 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-cb507d9c-afc3-4032-8537-92436dc38cd9 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7235fe80b9ae4d2cb3ef83ea30fb8961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90bae5f44b43437193fec925de3f0bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:19.167960 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-cb507d9c-afc3-4032-8537-92436dc38cd9 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] 10.222.0.20 "GET /compute/v2.1/servers/e9a52cdd-6239-4cc7-a02c-2a532aaa9278" status: 200 len: 1314 microversion: 2.1 time: 0.524295 Oct 04 19:07:19.168756 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3280/6540] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:18 2022] GET /compute/v2.1/servers/e9a52cdd-6239-4cc7-a02c-2a532aaa9278 => generated 1314 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:20.194735 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-70a1c23d-e7b0-4c85-94f5-7fa604dc16b5 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:20.196755 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-70a1c23d-e7b0-4c85-94f5-7fa604dc16b5 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] [instance: e9a52cdd-6239-4cc7-a02c-2a532aaa9278] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:20.207433 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:07:20.210438 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-70a1c23d-e7b0-4c85-94f5-7fa604dc16b5 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:20.211355 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-70a1c23d-e7b0-4c85-94f5-7fa604dc16b5 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:20.212112 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-70a1c23d-e7b0-4c85-94f5-7fa604dc16b5 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:20.213439 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-70a1c23d-e7b0-4c85-94f5-7fa604dc16b5 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:20.214191 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-70a1c23d-e7b0-4c85-94f5-7fa604dc16b5 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:20.215823 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-70a1c23d-e7b0-4c85-94f5-7fa604dc16b5 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:20.390434 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-70a1c23d-e7b0-4c85-94f5-7fa604dc16b5 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7235fe80b9ae4d2cb3ef83ea30fb8961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90bae5f44b43437193fec925de3f0bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:20.400075 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-70a1c23d-e7b0-4c85-94f5-7fa604dc16b5 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] 10.222.0.20 "GET /compute/v2.1/servers/e9a52cdd-6239-4cc7-a02c-2a532aaa9278" status: 200 len: 1314 microversion: 2.1 time: 0.212286 Oct 04 19:07:20.400998 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3261/6541] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:20 2022] GET /compute/v2.1/servers/e9a52cdd-6239-4cc7-a02c-2a532aaa9278 => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:21.427083 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b5a80652-4c17-4304-950f-4f8a7dc7d985 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:21.427684 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b5a80652-4c17-4304-950f-4f8a7dc7d985 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] [instance: e9a52cdd-6239-4cc7-a02c-2a532aaa9278] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:21.439219 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:07:21.439219 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b5a80652-4c17-4304-950f-4f8a7dc7d985 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:21.439219 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b5a80652-4c17-4304-950f-4f8a7dc7d985 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:21.439219 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b5a80652-4c17-4304-950f-4f8a7dc7d985 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:21.439219 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b5a80652-4c17-4304-950f-4f8a7dc7d985 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:21.439219 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b5a80652-4c17-4304-950f-4f8a7dc7d985 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:21.440144 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b5a80652-4c17-4304-950f-4f8a7dc7d985 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:21.613987 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-894de1df-b720-4a27-b033-b271f0cb369c req-5ba1a1a2-411d-482b-bc51-b9bd2f4bd56b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9a52cdd-6239-4cc7-a02c-2a532aaa9278", "name": "network-vif-plugged", "status": "completed", "tag": "8a9fb50c-70bd-4227-b6cb-0db3778eb953"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:07:21.635784 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=8 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:07:21.653738 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-894de1df-b720-4a27-b033-b271f0cb369c req-5ba1a1a2-411d-482b-bc51-b9bd2f4bd56b service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:21.654929 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-894de1df-b720-4a27-b033-b271f0cb369c req-5ba1a1a2-411d-482b-bc51-b9bd2f4bd56b service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:21.656511 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-894de1df-b720-4a27-b033-b271f0cb369c req-5ba1a1a2-411d-482b-bc51-b9bd2f4bd56b service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:21.673355 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-894de1df-b720-4a27-b033-b271f0cb369c req-5ba1a1a2-411d-482b-bc51-b9bd2f4bd56b service nova] Creating event network-vif-plugged:8a9fb50c-70bd-4227-b6cb-0db3778eb953 for instance e9a52cdd-6239-4cc7-a02c-2a532aaa9278 on n-h1-850501-14 Oct 04 19:07:21.679045 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-894de1df-b720-4a27-b033-b271f0cb369c req-5ba1a1a2-411d-482b-bc51-b9bd2f4bd56b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074929 Oct 04 19:07:21.679970 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3262/6542] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:07:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:07:21.731809 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b5a80652-4c17-4304-950f-4f8a7dc7d985 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7235fe80b9ae4d2cb3ef83ea30fb8961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90bae5f44b43437193fec925de3f0bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:21.775964 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b5a80652-4c17-4304-950f-4f8a7dc7d985 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] 10.222.0.20 "GET /compute/v2.1/servers/e9a52cdd-6239-4cc7-a02c-2a532aaa9278" status: 200 len: 1314 microversion: 2.1 time: 0.353216 Oct 04 19:07:21.776884 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3281/6543] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:21 2022] GET /compute/v2.1/servers/e9a52cdd-6239-4cc7-a02c-2a532aaa9278 => generated 1314 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:22.806016 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-cdfcde08-8553-47fa-a939-4fdbab512d5a tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:22.806765 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-cdfcde08-8553-47fa-a939-4fdbab512d5a tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] [instance: e9a52cdd-6239-4cc7-a02c-2a532aaa9278] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:22.815653 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cdfcde08-8553-47fa-a939-4fdbab512d5a tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:22.817818 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cdfcde08-8553-47fa-a939-4fdbab512d5a tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:22.818456 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cdfcde08-8553-47fa-a939-4fdbab512d5a tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:22.819208 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cdfcde08-8553-47fa-a939-4fdbab512d5a tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:22.819694 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cdfcde08-8553-47fa-a939-4fdbab512d5a tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:22.820231 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cdfcde08-8553-47fa-a939-4fdbab512d5a tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:23.575619 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-cdfcde08-8553-47fa-a939-4fdbab512d5a tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7235fe80b9ae4d2cb3ef83ea30fb8961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90bae5f44b43437193fec925de3f0bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:23.585780 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-cdfcde08-8553-47fa-a939-4fdbab512d5a tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] 10.222.0.20 "GET /compute/v2.1/servers/e9a52cdd-6239-4cc7-a02c-2a532aaa9278" status: 200 len: 1314 microversion: 2.1 time: 0.788625 Oct 04 19:07:23.586626 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3263/6544] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:22 2022] GET /compute/v2.1/servers/e9a52cdd-6239-4cc7-a02c-2a532aaa9278 => generated 1314 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:24.610106 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0f1b55f7-5b4f-49a5-910e-7ea62dec1777 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:24.611366 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0f1b55f7-5b4f-49a5-910e-7ea62dec1777 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] [instance: e9a52cdd-6239-4cc7-a02c-2a532aaa9278] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:24.619243 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0f1b55f7-5b4f-49a5-910e-7ea62dec1777 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:24.619842 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0f1b55f7-5b4f-49a5-910e-7ea62dec1777 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:24.620609 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0f1b55f7-5b4f-49a5-910e-7ea62dec1777 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:24.621573 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0f1b55f7-5b4f-49a5-910e-7ea62dec1777 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:24.622783 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0f1b55f7-5b4f-49a5-910e-7ea62dec1777 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:24.623605 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0f1b55f7-5b4f-49a5-910e-7ea62dec1777 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:24.808526 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0f1b55f7-5b4f-49a5-910e-7ea62dec1777 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7235fe80b9ae4d2cb3ef83ea30fb8961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90bae5f44b43437193fec925de3f0bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:24.826765 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0f1b55f7-5b4f-49a5-910e-7ea62dec1777 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] 10.222.0.20 "GET /compute/v2.1/servers/e9a52cdd-6239-4cc7-a02c-2a532aaa9278" status: 200 len: 1499 microversion: 2.1 time: 0.221443 Oct 04 19:07:24.827638 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3282/6545] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:24 2022] GET /compute/v2.1/servers/e9a52cdd-6239-4cc7-a02c-2a532aaa9278 => generated 1499 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:26.062434 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c617deb6-3b17-4d04-bcd8-082c2ca9136e tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:26.071545 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c617deb6-3b17-4d04-bcd8-082c2ca9136e tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] [instance: e9a52cdd-6239-4cc7-a02c-2a532aaa9278] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:26.071545 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c617deb6-3b17-4d04-bcd8-082c2ca9136e tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:26.071545 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c617deb6-3b17-4d04-bcd8-082c2ca9136e tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:26.071545 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c617deb6-3b17-4d04-bcd8-082c2ca9136e tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:26.071923 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c617deb6-3b17-4d04-bcd8-082c2ca9136e tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:26.072362 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c617deb6-3b17-4d04-bcd8-082c2ca9136e tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:26.072814 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c617deb6-3b17-4d04-bcd8-082c2ca9136e tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:26.102078 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c617deb6-3b17-4d04-bcd8-082c2ca9136e tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] [instance: e9a52cdd-6239-4cc7-a02c-2a532aaa9278] Going to try to terminate instance {{(pid=123002) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:07:26.643062 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c617deb6-3b17-4d04-bcd8-082c2ca9136e tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e9a52cdd-6239-4cc7-a02c-2a532aaa9278" status: 204 len: 0 microversion: 2.1 time: 0.584983 Oct 04 19:07:26.644505 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3264/6546] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 19:07:26 2022] DELETE /compute/v2.1/servers/e9a52cdd-6239-4cc7-a02c-2a532aaa9278 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:07:26.654375 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7ebd428b-11ae-4368-bf4f-c80677bc2521 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:26.655619 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7ebd428b-11ae-4368-bf4f-c80677bc2521 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] [instance: e9a52cdd-6239-4cc7-a02c-2a532aaa9278] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:26.670574 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7ebd428b-11ae-4368-bf4f-c80677bc2521 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:26.673435 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7ebd428b-11ae-4368-bf4f-c80677bc2521 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:26.674813 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7ebd428b-11ae-4368-bf4f-c80677bc2521 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:26.677160 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7ebd428b-11ae-4368-bf4f-c80677bc2521 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:26.677868 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7ebd428b-11ae-4368-bf4f-c80677bc2521 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:26.678682 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7ebd428b-11ae-4368-bf4f-c80677bc2521 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:26.845355 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7ebd428b-11ae-4368-bf4f-c80677bc2521 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7235fe80b9ae4d2cb3ef83ea30fb8961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90bae5f44b43437193fec925de3f0bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:26.856254 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7ebd428b-11ae-4368-bf4f-c80677bc2521 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] 10.222.0.20 "GET /compute/v2.1/servers/e9a52cdd-6239-4cc7-a02c-2a532aaa9278" status: 200 len: 1505 microversion: 2.1 time: 0.207064 Oct 04 19:07:26.857218 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3283/6547] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:26 2022] GET /compute/v2.1/servers/e9a52cdd-6239-4cc7-a02c-2a532aaa9278 => generated 1505 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:27.892261 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5796e810-4ce3-4e3c-af4e-8a0e943adb35 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:27.892261 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5796e810-4ce3-4e3c-af4e-8a0e943adb35 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] [instance: e9a52cdd-6239-4cc7-a02c-2a532aaa9278] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:27.892261 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5796e810-4ce3-4e3c-af4e-8a0e943adb35 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:27.892261 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5796e810-4ce3-4e3c-af4e-8a0e943adb35 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:27.892261 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5796e810-4ce3-4e3c-af4e-8a0e943adb35 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:27.892261 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5796e810-4ce3-4e3c-af4e-8a0e943adb35 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:27.892261 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5796e810-4ce3-4e3c-af4e-8a0e943adb35 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:27.893889 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5796e810-4ce3-4e3c-af4e-8a0e943adb35 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:28.127580 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5796e810-4ce3-4e3c-af4e-8a0e943adb35 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7235fe80b9ae4d2cb3ef83ea30fb8961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90bae5f44b43437193fec925de3f0bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:28.154032 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5796e810-4ce3-4e3c-af4e-8a0e943adb35 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] 10.222.0.20 "GET /compute/v2.1/servers/e9a52cdd-6239-4cc7-a02c-2a532aaa9278" status: 200 len: 1505 microversion: 2.1 time: 0.271764 Oct 04 19:07:28.154032 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3265/6548] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:27 2022] GET /compute/v2.1/servers/e9a52cdd-6239-4cc7-a02c-2a532aaa9278 => generated 1505 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:28.728430 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-3c8442b8-929b-4b73-b659-ff64a2d6ef3c req-8f0700b0-1414-4dfd-ac59-75b3a7293326 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9a52cdd-6239-4cc7-a02c-2a532aaa9278", "name": "network-vif-deleted", "tag": "8a9fb50c-70bd-4227-b6cb-0db3778eb953"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:07:28.748732 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-3c8442b8-929b-4b73-b659-ff64a2d6ef3c req-8f0700b0-1414-4dfd-ac59-75b3a7293326 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:28.749685 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-3c8442b8-929b-4b73-b659-ff64a2d6ef3c req-8f0700b0-1414-4dfd-ac59-75b3a7293326 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:28.750364 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-3c8442b8-929b-4b73-b659-ff64a2d6ef3c req-8f0700b0-1414-4dfd-ac59-75b3a7293326 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:28.763825 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-3c8442b8-929b-4b73-b659-ff64a2d6ef3c req-8f0700b0-1414-4dfd-ac59-75b3a7293326 service nova] Creating event network-vif-deleted:8a9fb50c-70bd-4227-b6cb-0db3778eb953 for instance e9a52cdd-6239-4cc7-a02c-2a532aaa9278 on n-h1-850501-14 Oct 04 19:07:28.769975 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-3c8442b8-929b-4b73-b659-ff64a2d6ef3c req-8f0700b0-1414-4dfd-ac59-75b3a7293326 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045266 Oct 04 19:07:28.771314 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3284/6549] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:07:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:07:29.174042 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-231bba21-0315-4748-9f1a-ac164696d564 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:29.175601 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-231bba21-0315-4748-9f1a-ac164696d564 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] [instance: e9a52cdd-6239-4cc7-a02c-2a532aaa9278] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:29.188269 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-231bba21-0315-4748-9f1a-ac164696d564 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:29.188818 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-231bba21-0315-4748-9f1a-ac164696d564 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:29.189274 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-231bba21-0315-4748-9f1a-ac164696d564 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:29.190065 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-231bba21-0315-4748-9f1a-ac164696d564 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:29.190549 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-231bba21-0315-4748-9f1a-ac164696d564 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:29.191073 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-231bba21-0315-4748-9f1a-ac164696d564 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:29.228440 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-231bba21-0315-4748-9f1a-ac164696d564 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:29.229197 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-231bba21-0315-4748-9f1a-ac164696d564 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:29.229754 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-231bba21-0315-4748-9f1a-ac164696d564 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:29.230320 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-231bba21-0315-4748-9f1a-ac164696d564 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lazy-loading 'fault' on Instance uuid e9a52cdd-6239-4cc7-a02c-2a532aaa9278 {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:07:29.276040 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-231bba21-0315-4748-9f1a-ac164696d564 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7235fe80b9ae4d2cb3ef83ea30fb8961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90bae5f44b43437193fec925de3f0bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:29.296594 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-231bba21-0315-4748-9f1a-ac164696d564 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] 10.222.0.20 "GET /compute/v2.1/servers/e9a52cdd-6239-4cc7-a02c-2a532aaa9278" status: 200 len: 1304 microversion: 2.1 time: 0.117156 Oct 04 19:07:29.296594 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3266/6550] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:29 2022] GET /compute/v2.1/servers/e9a52cdd-6239-4cc7-a02c-2a532aaa9278 => generated 1304 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:30.315344 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8e3670c8-23c7-4e8c-985d-0cefe7f0fdeb tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:30.316862 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8e3670c8-23c7-4e8c-985d-0cefe7f0fdeb tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] [instance: e9a52cdd-6239-4cc7-a02c-2a532aaa9278] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:30.325842 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8e3670c8-23c7-4e8c-985d-0cefe7f0fdeb tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:30.326636 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8e3670c8-23c7-4e8c-985d-0cefe7f0fdeb tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:30.327453 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8e3670c8-23c7-4e8c-985d-0cefe7f0fdeb tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:30.328635 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8e3670c8-23c7-4e8c-985d-0cefe7f0fdeb tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:30.329307 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8e3670c8-23c7-4e8c-985d-0cefe7f0fdeb tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:30.330201 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8e3670c8-23c7-4e8c-985d-0cefe7f0fdeb tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:30.352726 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-8e3670c8-23c7-4e8c-985d-0cefe7f0fdeb tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] HTTP exception thrown: Instance e9a52cdd-6239-4cc7-a02c-2a532aaa9278 could not be found. Oct 04 19:07:30.354975 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8e3670c8-23c7-4e8c-985d-0cefe7f0fdeb tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Request method failure captured: Oct 04 19:07:30.354975 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/e9a52cdd-6239-4cc7-a02c-2a532aaa9278 HTTP/1.1 Oct 04 19:07:30.354975 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 19:07:30.354975 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 19:07:30.354975 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 19:07:30.354975 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 19:07:30.354975 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 19:07:30.354975 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 19:07:30.354975 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 19:07:30.354975 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 19:07:30.354975 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPIRZKn16av3uRbh7qyJoViM7H2-HpuJI1Vu8pwEKlnz9frgCmqn5mecWhzRlARR9fUxlYQH-hd_osZ6Fa26SeoQQIriHi_p3VI1fkoNXCzeiROoUZgs-8s8lXBY_MUyt7OxIjloQtKVYzjDbpLDtJIKWuaLDvrmx8f-N7Rd5xsZF-OE Oct 04 19:07:30.354975 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 19:07:30.354975 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 19:07:30.354975 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 19:07:30.354975 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 19:07:30.354975 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 19:07:30.354975 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 19:07:30.354975 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 90bae5f44b43437193fec925de3f0bf2 Oct 04 19:07:30.354975 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-VolumesActionsTest-1581876719 Oct 04 19:07:30.354975 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 19:07:30.354975 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 19:07:30.354975 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/90bae5f44b43437193fec925de3f0bf2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_90bae5f44b43437193fec925de3f0bf2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/90bae5f44b43437193fec925de3f0bf2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/90bae5f44b43437193fec925de3f0bf2"}]}] Oct 04 19:07:30.354975 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-VolumesActionsTest-1581876719 Oct 04 19:07:30.354975 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 90bae5f44b43437193fec925de3f0bf2 Oct 04 19:07:30.354975 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-VolumesActionsTest-1581876719 Oct 04 19:07:30.354975 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-VolumesActionsTest-1581876719-project Oct 04 19:07:30.354975 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 19:07:30.354975 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 19:07:30.354975 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 7235fe80b9ae4d2cb3ef83ea30fb8961 Oct 04 19:07:30.354975 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-VolumesActionsTest-1581876719-project Oct 04 19:07:30.354975 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 19:07:30.354975 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance e9a52cdd-6239-4cc7-a02c-2a532aaa9278 could not be found. Oct 04 19:07:30.354975 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': 'e9a52cdd-6239-4cc7-a02c-2a532aaa9278'} Oct 04 19:07:30.354975 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:07:30.354975 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:07:30.354975 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:07:30.354975 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:07:30.354975 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:07:30.354975 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:07:30.354975 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:07:30.354975 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:07:30.354975 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:07:30.354975 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:07:30.354975 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9a52cdd-6239-4cc7-a02c-2a532aaa9278 could not be found. Oct 04 19:07:30.354975 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:07:30.354975 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:07:30.354975 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:07:30.354975 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:07:30.354975 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:07:30.354975 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:07:30.354975 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:07:30.354975 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:07:30.354975 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:07:30.354975 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:07:30.354975 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:07:30.354975 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:07:30.354975 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:07:30.354975 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:07:30.354975 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:07:30.354975 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:07:30.354975 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9a52cdd-6239-4cc7-a02c-2a532aaa9278 could not be found. Oct 04 19:07:30.354975 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:07:30.354975 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:07:30.354975 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:07:30.371430 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:07:30.371430 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:07:30.371430 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:07:30.371430 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:07:30.371430 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:07:30.371430 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9a52cdd-6239-4cc7-a02c-2a532aaa9278 could not be found. Oct 04 19:07:30.371430 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:07:30.371430 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8e3670c8-23c7-4e8c-985d-0cefe7f0fdeb tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Returning 404 to user: Instance e9a52cdd-6239-4cc7-a02c-2a532aaa9278 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:07:30.371430 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8e3670c8-23c7-4e8c-985d-0cefe7f0fdeb tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] 10.222.0.20 "GET /compute/v2.1/servers/e9a52cdd-6239-4cc7-a02c-2a532aaa9278" status: 404 len: 111 microversion: 2.1 time: 0.046754 Oct 04 19:07:30.371430 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3285/6551] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:30 2022] GET /compute/v2.1/servers/e9a52cdd-6239-4cc7-a02c-2a532aaa9278 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:07:30.498940 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d0c2076e-1ffb-42da-9ead-01ae5b76a044 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-515974716", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": [{"uuid": "51978103-f099-44b1-8c5b-f81c20fc4355"}]}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:07:30.563137 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-d0c2076e-1ffb-42da-9ead-01ae5b76a044 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] validate_networks() for [('51978103-f099-44b1-8c5b-f81c20fc4355', None, None, None, None, None)] {{(pid=123002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:07:31.322268 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-d0c2076e-1ffb-42da-9ead-01ae5b76a044 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:07:31.322717 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-d0c2076e-1ffb-42da-9ead-01ae5b76a044 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:07:31.323210 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-d0c2076e-1ffb-42da-9ead-01ae5b76a044 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:07:31.323747 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-d0c2076e-1ffb-42da-9ead-01ae5b76a044 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:07:31.324305 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-d0c2076e-1ffb-42da-9ead-01ae5b76a044 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:07:31.336544 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d0c2076e-1ffb-42da-9ead-01ae5b76a044 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:31.340603 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d0c2076e-1ffb-42da-9ead-01ae5b76a044 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:31.340603 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d0c2076e-1ffb-42da-9ead-01ae5b76a044 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:31.340603 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d0c2076e-1ffb-42da-9ead-01ae5b76a044 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:31.340603 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d0c2076e-1ffb-42da-9ead-01ae5b76a044 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:31.340603 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d0c2076e-1ffb-42da-9ead-01ae5b76a044 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:31.374999 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-d0c2076e-1ffb-42da-9ead-01ae5b76a044 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Getting quotas for project 90bae5f44b43437193fec925de3f0bf2. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:07:31.381157 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-d0c2076e-1ffb-42da-9ead-01ae5b76a044 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Getting quotas for user 7235fe80b9ae4d2cb3ef83ea30fb8961 and project 90bae5f44b43437193fec925de3f0bf2. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:07:31.396223 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d0c2076e-1ffb-42da-9ead-01ae5b76a044 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Going to run 1 instances... {{(pid=123002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:07:31.399085 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d0c2076e-1ffb-42da-9ead-01ae5b76a044 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] [instance: 5bac58cc-a8a8-4061-8e5d-20133c0fd84a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:07:31.607226 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d0c2076e-1ffb-42da-9ead-01ae5b76a044 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.113048 Oct 04 19:07:31.620792 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3267/6552] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 19:07:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1127 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:07:31.630206 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-26dc7c10-6bd6-4555-bcb0-513c41735bfe tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:31.631782 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-26dc7c10-6bd6-4555-bcb0-513c41735bfe tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] [instance: 5bac58cc-a8a8-4061-8e5d-20133c0fd84a] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:31.778768 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-26dc7c10-6bd6-4555-bcb0-513c41735bfe tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7235fe80b9ae4d2cb3ef83ea30fb8961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90bae5f44b43437193fec925de3f0bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:31.811913 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-26dc7c10-6bd6-4555-bcb0-513c41735bfe tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] 10.222.0.20 "GET /compute/v2.1/servers/5bac58cc-a8a8-4061-8e5d-20133c0fd84a" status: 200 len: 1213 microversion: 2.1 time: 0.187406 Oct 04 19:07:31.812540 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3286/6553] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:31 2022] GET /compute/v2.1/servers/5bac58cc-a8a8-4061-8e5d-20133c0fd84a => generated 1213 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:32.835915 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-717982a5-d83c-42ac-8d6f-f0d8b8adc742 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:32.837203 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-717982a5-d83c-42ac-8d6f-f0d8b8adc742 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] [instance: 5bac58cc-a8a8-4061-8e5d-20133c0fd84a] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:32.841665 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:07:32.922920 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-717982a5-d83c-42ac-8d6f-f0d8b8adc742 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7235fe80b9ae4d2cb3ef83ea30fb8961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90bae5f44b43437193fec925de3f0bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:32.933751 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-717982a5-d83c-42ac-8d6f-f0d8b8adc742 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] 10.222.0.20 "GET /compute/v2.1/servers/5bac58cc-a8a8-4061-8e5d-20133c0fd84a" status: 200 len: 1213 microversion: 2.1 time: 0.101756 Oct 04 19:07:32.935044 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3268/6554] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:32 2022] GET /compute/v2.1/servers/5bac58cc-a8a8-4061-8e5d-20133c0fd84a => generated 1213 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:33.982911 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7c337aca-b7a4-412d-a497-9e1f3cd09a06 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:33.983535 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7c337aca-b7a4-412d-a497-9e1f3cd09a06 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] [instance: 5bac58cc-a8a8-4061-8e5d-20133c0fd84a] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:34.000158 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7c337aca-b7a4-412d-a497-9e1f3cd09a06 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:34.001295 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7c337aca-b7a4-412d-a497-9e1f3cd09a06 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:34.004651 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7c337aca-b7a4-412d-a497-9e1f3cd09a06 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:34.005403 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7c337aca-b7a4-412d-a497-9e1f3cd09a06 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:34.005879 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7c337aca-b7a4-412d-a497-9e1f3cd09a06 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:34.008586 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7c337aca-b7a4-412d-a497-9e1f3cd09a06 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:34.095978 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7c337aca-b7a4-412d-a497-9e1f3cd09a06 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7235fe80b9ae4d2cb3ef83ea30fb8961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90bae5f44b43437193fec925de3f0bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:34.110202 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7c337aca-b7a4-412d-a497-9e1f3cd09a06 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] 10.222.0.20 "GET /compute/v2.1/servers/5bac58cc-a8a8-4061-8e5d-20133c0fd84a" status: 200 len: 1217 microversion: 2.1 time: 0.135263 Oct 04 19:07:34.124203 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3287/6555] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:33 2022] GET /compute/v2.1/servers/5bac58cc-a8a8-4061-8e5d-20133c0fd84a => generated 1217 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:35.139745 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-67e7277b-2a8e-4ef0-afaa-d7850924f6b4 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:35.140479 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-67e7277b-2a8e-4ef0-afaa-d7850924f6b4 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] [instance: 5bac58cc-a8a8-4061-8e5d-20133c0fd84a] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:35.160538 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-67e7277b-2a8e-4ef0-afaa-d7850924f6b4 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:35.161378 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-67e7277b-2a8e-4ef0-afaa-d7850924f6b4 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:35.162066 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-67e7277b-2a8e-4ef0-afaa-d7850924f6b4 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:35.163005 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-67e7277b-2a8e-4ef0-afaa-d7850924f6b4 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:35.163689 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-67e7277b-2a8e-4ef0-afaa-d7850924f6b4 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:35.164587 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-67e7277b-2a8e-4ef0-afaa-d7850924f6b4 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:35.413898 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-67e7277b-2a8e-4ef0-afaa-d7850924f6b4 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7235fe80b9ae4d2cb3ef83ea30fb8961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90bae5f44b43437193fec925de3f0bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:35.453415 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-67e7277b-2a8e-4ef0-afaa-d7850924f6b4 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] 10.222.0.20 "GET /compute/v2.1/servers/5bac58cc-a8a8-4061-8e5d-20133c0fd84a" status: 200 len: 1273 microversion: 2.1 time: 0.319398 Oct 04 19:07:35.457240 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3269/6556] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:35 2022] GET /compute/v2.1/servers/5bac58cc-a8a8-4061-8e5d-20133c0fd84a => generated 1273 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:36.484499 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9233181d-f17f-4590-ad9b-87453bed6c67 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:36.485132 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9233181d-f17f-4590-ad9b-87453bed6c67 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] [instance: 5bac58cc-a8a8-4061-8e5d-20133c0fd84a] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:36.507604 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9233181d-f17f-4590-ad9b-87453bed6c67 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:36.511554 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9233181d-f17f-4590-ad9b-87453bed6c67 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:36.512042 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9233181d-f17f-4590-ad9b-87453bed6c67 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:36.515203 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9233181d-f17f-4590-ad9b-87453bed6c67 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:36.519249 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9233181d-f17f-4590-ad9b-87453bed6c67 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:36.519780 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9233181d-f17f-4590-ad9b-87453bed6c67 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:36.545021 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6a687a88-5185-4106-85d5-238c7483a259 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Action: 'create', calling method: .version_select at 0x7fe258156ee0>, body: {"keypair": {"name": "tempest-keypair-199550104", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKxEmZyVTzZRPxqIyk0r4g/ryXqCFdGYFXhXPOJEFkileRJWvU4REgq+8icwpV1iEhVEGYV085GGhDBIDbr70NXtB6d3dKXDGkwVngsC9nUOUMiwgt0IB18zcXS35zS7/Q=="}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:07:36.574720 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-6a687a88-5185-4106-85d5-238c7483a259 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Getting quotas for project 4e0a841124bf4392b54c3d6b0ea37e11. Resources: {'key_pairs'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:07:36.590043 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-6a687a88-5185-4106-85d5-238c7483a259 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Getting quotas for user 3060cdc6eeba47288205e107717a6980 and project 4e0a841124bf4392b54c3d6b0ea37e11. Resources: {'key_pairs'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:07:36.767338 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6a687a88-5185-4106-85d5-238c7483a259 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.475862 Oct 04 19:07:36.774608 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3288/6557] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Oct 4 19:07:36 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:07:36.873762 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9233181d-f17f-4590-ad9b-87453bed6c67 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7235fe80b9ae4d2cb3ef83ea30fb8961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90bae5f44b43437193fec925de3f0bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:36.892791 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9233181d-f17f-4590-ad9b-87453bed6c67 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] 10.222.0.20 "GET /compute/v2.1/servers/5bac58cc-a8a8-4061-8e5d-20133c0fd84a" status: 200 len: 1313 microversion: 2.1 time: 0.413936 Oct 04 19:07:36.896696 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3270/6558] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:36 2022] GET /compute/v2.1/servers/5bac58cc-a8a8-4061-8e5d-20133c0fd84a => generated 1313 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:07:37.930473 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-918b3ba5-c6ea-4e75-995c-e29d3e6d9bc7 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:37.931939 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-918b3ba5-c6ea-4e75-995c-e29d3e6d9bc7 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] [instance: 5bac58cc-a8a8-4061-8e5d-20133c0fd84a] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:37.946315 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-918b3ba5-c6ea-4e75-995c-e29d3e6d9bc7 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:37.948945 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-918b3ba5-c6ea-4e75-995c-e29d3e6d9bc7 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:37.951941 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-918b3ba5-c6ea-4e75-995c-e29d3e6d9bc7 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:37.956046 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-918b3ba5-c6ea-4e75-995c-e29d3e6d9bc7 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:37.956695 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-918b3ba5-c6ea-4e75-995c-e29d3e6d9bc7 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:37.957893 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-918b3ba5-c6ea-4e75-995c-e29d3e6d9bc7 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:38.271887 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-918b3ba5-c6ea-4e75-995c-e29d3e6d9bc7 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7235fe80b9ae4d2cb3ef83ea30fb8961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90bae5f44b43437193fec925de3f0bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:38.282889 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-918b3ba5-c6ea-4e75-995c-e29d3e6d9bc7 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] 10.222.0.20 "GET /compute/v2.1/servers/5bac58cc-a8a8-4061-8e5d-20133c0fd84a" status: 200 len: 1313 microversion: 2.1 time: 0.357229 Oct 04 19:07:38.283484 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3289/6559] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:37 2022] GET /compute/v2.1/servers/5bac58cc-a8a8-4061-8e5d-20133c0fd84a => generated 1313 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:38.396443 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-664a391f-25cc-4dbc-ad8f-d5994e4a28e4 req-e4a3aa42-ed51-49d2-93cd-64b69a109ce5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bac58cc-a8a8-4061-8e5d-20133c0fd84a", "tag": "cb74bcd3-c7d0-4ef7-9652-fc6cc8a515bb"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:07:38.410848 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-664a391f-25cc-4dbc-ad8f-d5994e4a28e4 req-e4a3aa42-ed51-49d2-93cd-64b69a109ce5 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:38.426635 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-664a391f-25cc-4dbc-ad8f-d5994e4a28e4 req-e4a3aa42-ed51-49d2-93cd-64b69a109ce5 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:38.428647 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-664a391f-25cc-4dbc-ad8f-d5994e4a28e4 req-e4a3aa42-ed51-49d2-93cd-64b69a109ce5 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:38.460215 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-664a391f-25cc-4dbc-ad8f-d5994e4a28e4 req-e4a3aa42-ed51-49d2-93cd-64b69a109ce5 service nova] Creating event network-changed:cb74bcd3-c7d0-4ef7-9652-fc6cc8a515bb for instance 5bac58cc-a8a8-4061-8e5d-20133c0fd84a on n-h1-850501-14 Oct 04 19:07:38.499657 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-664a391f-25cc-4dbc-ad8f-d5994e4a28e4 req-e4a3aa42-ed51-49d2-93cd-64b69a109ce5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106808 Oct 04 19:07:38.505552 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3271/6560] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:07:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:07:39.315834 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-78a5ce10-a0c4-47a9-8c93-ef134db4f1c9 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:39.317341 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-78a5ce10-a0c4-47a9-8c93-ef134db4f1c9 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] [instance: 5bac58cc-a8a8-4061-8e5d-20133c0fd84a] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:39.335597 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-78a5ce10-a0c4-47a9-8c93-ef134db4f1c9 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:39.336370 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-78a5ce10-a0c4-47a9-8c93-ef134db4f1c9 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:39.341651 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-78a5ce10-a0c4-47a9-8c93-ef134db4f1c9 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:39.341651 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-78a5ce10-a0c4-47a9-8c93-ef134db4f1c9 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:39.341651 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-78a5ce10-a0c4-47a9-8c93-ef134db4f1c9 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:39.341651 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-78a5ce10-a0c4-47a9-8c93-ef134db4f1c9 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:39.682029 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-78a5ce10-a0c4-47a9-8c93-ef134db4f1c9 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7235fe80b9ae4d2cb3ef83ea30fb8961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90bae5f44b43437193fec925de3f0bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:39.697534 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-78a5ce10-a0c4-47a9-8c93-ef134db4f1c9 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] 10.222.0.20 "GET /compute/v2.1/servers/5bac58cc-a8a8-4061-8e5d-20133c0fd84a" status: 200 len: 1313 microversion: 2.1 time: 0.392143 Oct 04 19:07:39.722334 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3290/6561] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:39 2022] GET /compute/v2.1/servers/5bac58cc-a8a8-4061-8e5d-20133c0fd84a => generated 1313 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:39.924619 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8aeaf14c-051d-41f2-9f37-b6c853520407 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-345722924", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1229993015", "security_groups": [{"name": "tempest-secgroup-smoke-722389711"}], "block_device_mapping_v2": [{"uuid": "7fa35fd9-dbda-4b69-a259-952999ba393b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "dbc89e1f-759d-4fcb-8e1c-542119e29e34"}]}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:07:40.181377 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-8aeaf14c-051d-41f2-9f37-b6c853520407 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] validate_networks() for [('dbc89e1f-759d-4fcb-8e1c-542119e29e34', None, None, None, None, None)] {{(pid=123002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:07:40.732118 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b20e1862-cdd3-4451-a41d-395e7c3daee4 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:40.732761 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b20e1862-cdd3-4451-a41d-395e7c3daee4 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] [instance: 5bac58cc-a8a8-4061-8e5d-20133c0fd84a] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:40.739207 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b20e1862-cdd3-4451-a41d-395e7c3daee4 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:40.739699 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b20e1862-cdd3-4451-a41d-395e7c3daee4 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:40.743021 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b20e1862-cdd3-4451-a41d-395e7c3daee4 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:40.744137 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b20e1862-cdd3-4451-a41d-395e7c3daee4 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:40.744777 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b20e1862-cdd3-4451-a41d-395e7c3daee4 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:40.745221 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b20e1862-cdd3-4451-a41d-395e7c3daee4 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:41.348215 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:07:41.518663 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b20e1862-cdd3-4451-a41d-395e7c3daee4 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7235fe80b9ae4d2cb3ef83ea30fb8961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90bae5f44b43437193fec925de3f0bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:41.531520 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b20e1862-cdd3-4451-a41d-395e7c3daee4 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] 10.222.0.20 "GET /compute/v2.1/servers/5bac58cc-a8a8-4061-8e5d-20133c0fd84a" status: 200 len: 1313 microversion: 2.1 time: 0.804720 Oct 04 19:07:41.532477 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3291/6562] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:40 2022] GET /compute/v2.1/servers/5bac58cc-a8a8-4061-8e5d-20133c0fd84a => generated 1313 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:07:41.623097 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d8e0a73a-00ca-4da8-9f02-2c192b4ad5a9 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-177548813", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "29403f06-dbc8-4a61-bdee-e5376c8a931e"}], "security_groups": [{"name": "tempest-securitygroup--454329129"}], "key_name": "tempest-keypair-199550104", "user_data": "}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:07:41.634086 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-8aeaf14c-051d-41f2-9f37-b6c853520407 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:07:41.634545 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-8aeaf14c-051d-41f2-9f37-b6c853520407 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:07:41.635042 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-8aeaf14c-051d-41f2-9f37-b6c853520407 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:07:41.635531 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-8aeaf14c-051d-41f2-9f37-b6c853520407 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:07:41.635967 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-8aeaf14c-051d-41f2-9f37-b6c853520407 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:07:41.652830 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8aeaf14c-051d-41f2-9f37-b6c853520407 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:41.654858 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8aeaf14c-051d-41f2-9f37-b6c853520407 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:41.655984 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8aeaf14c-051d-41f2-9f37-b6c853520407 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:41.657032 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8aeaf14c-051d-41f2-9f37-b6c853520407 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:41.657710 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8aeaf14c-051d-41f2-9f37-b6c853520407 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:41.658335 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8aeaf14c-051d-41f2-9f37-b6c853520407 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:41.680656 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-8aeaf14c-051d-41f2-9f37-b6c853520407 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Getting quotas for project 82d0cd3db371459db429cb770abde738. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:07:41.687448 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-8aeaf14c-051d-41f2-9f37-b6c853520407 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Getting quotas for user a65ae9c3fb3c46a2a393fe21ce21b9d4 and project 82d0cd3db371459db429cb770abde738. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:07:41.772089 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8aeaf14c-051d-41f2-9f37-b6c853520407 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Going to run 1 instances... {{(pid=123002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:07:41.774767 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8aeaf14c-051d-41f2-9f37-b6c853520407 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 21361c85-1287-4754-8308-ef0f172d0e6f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7fa35fd9-dbda-4b69-a259-952999ba393b',volume_size=None,volume_type=None)] {{(pid=123002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:07:41.786745 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.neutron [None req-d8e0a73a-00ca-4da8-9f02-2c192b4ad5a9 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] validate_networks() for [('29403f06-dbc8-4a61-bdee-e5376c8a931e', None, None, None, None, None)] {{(pid=123001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:07:42.287225 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8aeaf14c-051d-41f2-9f37-b6c853520407 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.369221 Oct 04 19:07:42.288789 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3272/6563] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 19:07:39 2022] POST /compute/v2.1/servers => generated 405 bytes in 2373 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:07:42.313038 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d21a384f-fffa-461e-9f84-890369f244c1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:42.313038 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d21a384f-fffa-461e-9f84-890369f244c1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 21361c85-1287-4754-8308-ef0f172d0e6f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:42.379943 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-d8e0a73a-00ca-4da8-9f02-2c192b4ad5a9 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:07:42.388376 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-d8e0a73a-00ca-4da8-9f02-2c192b4ad5a9 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:07:42.389070 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-d8e0a73a-00ca-4da8-9f02-2c192b4ad5a9 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:07:42.394150 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-d8e0a73a-00ca-4da8-9f02-2c192b4ad5a9 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:07:42.394775 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-d8e0a73a-00ca-4da8-9f02-2c192b4ad5a9 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:07:42.407581 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d21a384f-fffa-461e-9f84-890369f244c1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:42.413247 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d21a384f-fffa-461e-9f84-890369f244c1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/21361c85-1287-4754-8308-ef0f172d0e6f" status: 200 len: 1094 microversion: 2.1 time: 0.113168 Oct 04 19:07:42.423964 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3273/6564] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:42 2022] GET /compute/v2.1/servers/21361c85-1287-4754-8308-ef0f172d0e6f => generated 1094 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:07:42.424285 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d8e0a73a-00ca-4da8-9f02-2c192b4ad5a9 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:42.424285 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d8e0a73a-00ca-4da8-9f02-2c192b4ad5a9 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:42.424285 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d8e0a73a-00ca-4da8-9f02-2c192b4ad5a9 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:42.424285 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d8e0a73a-00ca-4da8-9f02-2c192b4ad5a9 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:42.424285 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d8e0a73a-00ca-4da8-9f02-2c192b4ad5a9 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:42.424285 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d8e0a73a-00ca-4da8-9f02-2c192b4ad5a9 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:42.445699 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-d8e0a73a-00ca-4da8-9f02-2c192b4ad5a9 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Getting quotas for project 4e0a841124bf4392b54c3d6b0ea37e11. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:07:42.452816 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-d8e0a73a-00ca-4da8-9f02-2c192b4ad5a9 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Getting quotas for user 3060cdc6eeba47288205e107717a6980 and project 4e0a841124bf4392b54c3d6b0ea37e11. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:07:42.472433 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d8e0a73a-00ca-4da8-9f02-2c192b4ad5a9 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Going to run 1 instances... {{(pid=123001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:07:42.474697 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d8e0a73a-00ca-4da8-9f02-2c192b4ad5a9 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 2646dfcb-7213-4870-99eb-68311662d66b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:07:42.556878 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3b319892-d265-4d9f-8118-7347d57a9ac3 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:42.557827 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3b319892-d265-4d9f-8118-7347d57a9ac3 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] [instance: 5bac58cc-a8a8-4061-8e5d-20133c0fd84a] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:42.566136 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3b319892-d265-4d9f-8118-7347d57a9ac3 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:42.567073 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3b319892-d265-4d9f-8118-7347d57a9ac3 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:42.567856 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3b319892-d265-4d9f-8118-7347d57a9ac3 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:42.568807 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3b319892-d265-4d9f-8118-7347d57a9ac3 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:42.569645 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3b319892-d265-4d9f-8118-7347d57a9ac3 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:42.570316 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3b319892-d265-4d9f-8118-7347d57a9ac3 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:42.648745 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d8e0a73a-00ca-4da8-9f02-2c192b4ad5a9 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.030720 Oct 04 19:07:42.649767 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3292/6565] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 19:07:41 2022] POST /compute/v2.1/servers => generated 401 bytes in 1033 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:07:42.661391 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-dbad4a37-22c6-40ad-a756-1f5e9d0fbe23 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:42.665427 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-dbad4a37-22c6-40ad-a756-1f5e9d0fbe23 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 2646dfcb-7213-4870-99eb-68311662d66b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:42.764117 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-dbad4a37-22c6-40ad-a756-1f5e9d0fbe23 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3060cdc6eeba47288205e107717a6980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a841124bf4392b54c3d6b0ea37e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:42.773467 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-dbad4a37-22c6-40ad-a756-1f5e9d0fbe23 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b" status: 200 len: 1236 microversion: 2.1 time: 0.116102 Oct 04 19:07:42.774340 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3293/6566] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:42 2022] GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b => generated 1236 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:07:42.838018 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3b319892-d265-4d9f-8118-7347d57a9ac3 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7235fe80b9ae4d2cb3ef83ea30fb8961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90bae5f44b43437193fec925de3f0bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:42.845823 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3b319892-d265-4d9f-8118-7347d57a9ac3 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] 10.222.0.20 "GET /compute/v2.1/servers/5bac58cc-a8a8-4061-8e5d-20133c0fd84a" status: 200 len: 1313 microversion: 2.1 time: 0.293203 Oct 04 19:07:42.846512 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3274/6567] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:42 2022] GET /compute/v2.1/servers/5bac58cc-a8a8-4061-8e5d-20133c0fd84a => generated 1313 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:43.415150 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-d53bd376-cd62-45f8-a3a1-48c70c082286 req-92d478df-5dbe-463f-8c57-fa2f7d5563e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bac58cc-a8a8-4061-8e5d-20133c0fd84a", "name": "network-vif-plugged", "status": "completed", "tag": "cb74bcd3-c7d0-4ef7-9652-fc6cc8a515bb"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:07:43.427001 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-d53bd376-cd62-45f8-a3a1-48c70c082286 req-92d478df-5dbe-463f-8c57-fa2f7d5563e7 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:43.427482 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-d53bd376-cd62-45f8-a3a1-48c70c082286 req-92d478df-5dbe-463f-8c57-fa2f7d5563e7 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:43.427911 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-d53bd376-cd62-45f8-a3a1-48c70c082286 req-92d478df-5dbe-463f-8c57-fa2f7d5563e7 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:43.440742 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-d53bd376-cd62-45f8-a3a1-48c70c082286 req-92d478df-5dbe-463f-8c57-fa2f7d5563e7 service nova] Creating event network-vif-plugged:cb74bcd3-c7d0-4ef7-9652-fc6cc8a515bb for instance 5bac58cc-a8a8-4061-8e5d-20133c0fd84a on n-h1-850501-14 Oct 04 19:07:43.441246 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8ab5f03e-e2f5-4185-a520-8f4080aa8cb9 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:43.442387 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8ab5f03e-e2f5-4185-a520-8f4080aa8cb9 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 21361c85-1287-4754-8308-ef0f172d0e6f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:43.446216 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-d53bd376-cd62-45f8-a3a1-48c70c082286 req-92d478df-5dbe-463f-8c57-fa2f7d5563e7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036624 Oct 04 19:07:43.447357 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3294/6568] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:07:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:07:43.452112 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8ab5f03e-e2f5-4185-a520-8f4080aa8cb9 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:43.452657 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8ab5f03e-e2f5-4185-a520-8f4080aa8cb9 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:43.453106 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8ab5f03e-e2f5-4185-a520-8f4080aa8cb9 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:43.453819 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8ab5f03e-e2f5-4185-a520-8f4080aa8cb9 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:43.454283 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8ab5f03e-e2f5-4185-a520-8f4080aa8cb9 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:43.455602 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8ab5f03e-e2f5-4185-a520-8f4080aa8cb9 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:43.458632 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:07:43.623523 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8ab5f03e-e2f5-4185-a520-8f4080aa8cb9 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:43.639634 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8ab5f03e-e2f5-4185-a520-8f4080aa8cb9 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/21361c85-1287-4754-8308-ef0f172d0e6f" status: 200 len: 1144 microversion: 2.1 time: 0.201793 Oct 04 19:07:43.643406 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3275/6569] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:43 2022] GET /compute/v2.1/servers/21361c85-1287-4754-8308-ef0f172d0e6f => generated 1144 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:07:43.802016 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-925ed1a2-c8a7-40f8-946c-538ce5bf9d44 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:43.802685 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-925ed1a2-c8a7-40f8-946c-538ce5bf9d44 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 2646dfcb-7213-4870-99eb-68311662d66b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:43.873938 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2ca26177-c3a9-4fa7-a574-f1354c06fc7d tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:43.874642 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2ca26177-c3a9-4fa7-a574-f1354c06fc7d tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] [instance: 5bac58cc-a8a8-4061-8e5d-20133c0fd84a] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:43.881305 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2ca26177-c3a9-4fa7-a574-f1354c06fc7d tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:43.882022 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2ca26177-c3a9-4fa7-a574-f1354c06fc7d tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:43.882486 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2ca26177-c3a9-4fa7-a574-f1354c06fc7d tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:43.883207 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2ca26177-c3a9-4fa7-a574-f1354c06fc7d tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:43.883913 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2ca26177-c3a9-4fa7-a574-f1354c06fc7d tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:43.885147 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2ca26177-c3a9-4fa7-a574-f1354c06fc7d tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:43.887228 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-925ed1a2-c8a7-40f8-946c-538ce5bf9d44 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3060cdc6eeba47288205e107717a6980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a841124bf4392b54c3d6b0ea37e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:43.897054 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-925ed1a2-c8a7-40f8-946c-538ce5bf9d44 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b" status: 200 len: 1236 microversion: 2.1 time: 0.100078 Oct 04 19:07:43.898077 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3295/6570] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:43 2022] GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b => generated 1236 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:44.058288 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2ca26177-c3a9-4fa7-a574-f1354c06fc7d tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7235fe80b9ae4d2cb3ef83ea30fb8961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90bae5f44b43437193fec925de3f0bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:44.058288 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2ca26177-c3a9-4fa7-a574-f1354c06fc7d tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] 10.222.0.20 "GET /compute/v2.1/servers/5bac58cc-a8a8-4061-8e5d-20133c0fd84a" status: 200 len: 1313 microversion: 2.1 time: 0.187963 Oct 04 19:07:44.058288 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3276/6571] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:43 2022] GET /compute/v2.1/servers/5bac58cc-a8a8-4061-8e5d-20133c0fd84a => generated 1313 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:07:44.667581 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-abd1488f-f0fa-4385-b4dd-8fec60d3e062 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:44.672976 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-abd1488f-f0fa-4385-b4dd-8fec60d3e062 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 21361c85-1287-4754-8308-ef0f172d0e6f] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:44.679875 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-abd1488f-f0fa-4385-b4dd-8fec60d3e062 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:44.680415 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-abd1488f-f0fa-4385-b4dd-8fec60d3e062 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:44.682310 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-abd1488f-f0fa-4385-b4dd-8fec60d3e062 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:44.686272 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-abd1488f-f0fa-4385-b4dd-8fec60d3e062 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:44.686761 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-abd1488f-f0fa-4385-b4dd-8fec60d3e062 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:44.687292 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-abd1488f-f0fa-4385-b4dd-8fec60d3e062 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:44.909257 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-abd1488f-f0fa-4385-b4dd-8fec60d3e062 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:44.930169 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a134c21a-4e05-49c7-9012-6face77f6d3f tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:44.930169 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a134c21a-4e05-49c7-9012-6face77f6d3f tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 2646dfcb-7213-4870-99eb-68311662d66b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:44.930758 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-abd1488f-f0fa-4385-b4dd-8fec60d3e062 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/21361c85-1287-4754-8308-ef0f172d0e6f" status: 200 len: 1192 microversion: 2.1 time: 0.258837 Oct 04 19:07:44.930758 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3296/6572] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:44 2022] GET /compute/v2.1/servers/21361c85-1287-4754-8308-ef0f172d0e6f => generated 1192 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:44.939249 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a134c21a-4e05-49c7-9012-6face77f6d3f tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:44.939752 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a134c21a-4e05-49c7-9012-6face77f6d3f tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:44.942388 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a134c21a-4e05-49c7-9012-6face77f6d3f tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:44.943344 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a134c21a-4e05-49c7-9012-6face77f6d3f tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:44.944979 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a134c21a-4e05-49c7-9012-6face77f6d3f tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:44.945643 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a134c21a-4e05-49c7-9012-6face77f6d3f tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:45.038592 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a134c21a-4e05-49c7-9012-6face77f6d3f tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3060cdc6eeba47288205e107717a6980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a841124bf4392b54c3d6b0ea37e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:45.047647 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a134c21a-4e05-49c7-9012-6face77f6d3f tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b" status: 200 len: 1232 microversion: 2.1 time: 0.130008 Oct 04 19:07:45.049063 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3277/6573] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:44 2022] GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b => generated 1232 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:45.085049 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-dbf25972-32af-4720-a660-47d229ff7a56 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:45.085825 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-dbf25972-32af-4720-a660-47d229ff7a56 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] [instance: 5bac58cc-a8a8-4061-8e5d-20133c0fd84a] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:45.096264 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dbf25972-32af-4720-a660-47d229ff7a56 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:45.097211 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dbf25972-32af-4720-a660-47d229ff7a56 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:45.097846 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dbf25972-32af-4720-a660-47d229ff7a56 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:45.098796 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dbf25972-32af-4720-a660-47d229ff7a56 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:45.099464 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dbf25972-32af-4720-a660-47d229ff7a56 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:45.100116 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dbf25972-32af-4720-a660-47d229ff7a56 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:45.400980 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-dbf25972-32af-4720-a660-47d229ff7a56 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7235fe80b9ae4d2cb3ef83ea30fb8961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90bae5f44b43437193fec925de3f0bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:45.414019 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-dbf25972-32af-4720-a660-47d229ff7a56 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] 10.222.0.20 "GET /compute/v2.1/servers/5bac58cc-a8a8-4061-8e5d-20133c0fd84a" status: 200 len: 1313 microversion: 2.1 time: 0.330067 Oct 04 19:07:45.416279 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3297/6574] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:45 2022] GET /compute/v2.1/servers/5bac58cc-a8a8-4061-8e5d-20133c0fd84a => generated 1313 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:45.955944 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-214d5ceb-b69c-499a-8a8a-72294f1ea79f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:45.957251 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-214d5ceb-b69c-499a-8a8a-72294f1ea79f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 21361c85-1287-4754-8308-ef0f172d0e6f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:45.965943 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-214d5ceb-b69c-499a-8a8a-72294f1ea79f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:45.966720 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-214d5ceb-b69c-499a-8a8a-72294f1ea79f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:45.975047 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-214d5ceb-b69c-499a-8a8a-72294f1ea79f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:45.975047 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-214d5ceb-b69c-499a-8a8a-72294f1ea79f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:45.975047 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-214d5ceb-b69c-499a-8a8a-72294f1ea79f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:45.975047 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-214d5ceb-b69c-499a-8a8a-72294f1ea79f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:46.052492 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-214d5ceb-b69c-499a-8a8a-72294f1ea79f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:46.064953 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-214d5ceb-b69c-499a-8a8a-72294f1ea79f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/21361c85-1287-4754-8308-ef0f172d0e6f" status: 200 len: 1210 microversion: 2.1 time: 0.112359 Oct 04 19:07:46.075412 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0d27cdf3-97b7-4ab9-b1b8-0ab5ae10bae4 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:46.077213 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0d27cdf3-97b7-4ab9-b1b8-0ab5ae10bae4 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 2646dfcb-7213-4870-99eb-68311662d66b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:46.081451 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3278/6575] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:45 2022] GET /compute/v2.1/servers/21361c85-1287-4754-8308-ef0f172d0e6f => generated 1210 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:07:46.089547 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0d27cdf3-97b7-4ab9-b1b8-0ab5ae10bae4 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:46.090628 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0d27cdf3-97b7-4ab9-b1b8-0ab5ae10bae4 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:46.091331 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0d27cdf3-97b7-4ab9-b1b8-0ab5ae10bae4 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:46.092392 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0d27cdf3-97b7-4ab9-b1b8-0ab5ae10bae4 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:46.093040 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0d27cdf3-97b7-4ab9-b1b8-0ab5ae10bae4 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:46.093658 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0d27cdf3-97b7-4ab9-b1b8-0ab5ae10bae4 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:46.195218 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0d27cdf3-97b7-4ab9-b1b8-0ab5ae10bae4 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3060cdc6eeba47288205e107717a6980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a841124bf4392b54c3d6b0ea37e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:46.212913 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0d27cdf3-97b7-4ab9-b1b8-0ab5ae10bae4 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b" status: 200 len: 1296 microversion: 2.1 time: 0.137053 Oct 04 19:07:46.214482 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3298/6576] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:46 2022] GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b => generated 1296 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:46.439910 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ab13d651-0a7e-4e96-b94f-25504180248f tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:46.440903 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ab13d651-0a7e-4e96-b94f-25504180248f tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] [instance: 5bac58cc-a8a8-4061-8e5d-20133c0fd84a] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:46.451412 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ab13d651-0a7e-4e96-b94f-25504180248f tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:46.451412 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ab13d651-0a7e-4e96-b94f-25504180248f tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:46.451412 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ab13d651-0a7e-4e96-b94f-25504180248f tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:46.451412 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ab13d651-0a7e-4e96-b94f-25504180248f tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:46.451412 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ab13d651-0a7e-4e96-b94f-25504180248f tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:46.451412 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ab13d651-0a7e-4e96-b94f-25504180248f tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:46.798327 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ab13d651-0a7e-4e96-b94f-25504180248f tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7235fe80b9ae4d2cb3ef83ea30fb8961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90bae5f44b43437193fec925de3f0bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:46.808487 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ab13d651-0a7e-4e96-b94f-25504180248f tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] 10.222.0.20 "GET /compute/v2.1/servers/5bac58cc-a8a8-4061-8e5d-20133c0fd84a" status: 200 len: 1497 microversion: 2.1 time: 0.371642 Oct 04 19:07:46.813621 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3279/6577] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:46 2022] GET /compute/v2.1/servers/5bac58cc-a8a8-4061-8e5d-20133c0fd84a => generated 1497 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:47.094817 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-82411754-16f8-4e61-b938-15065a1b201e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:47.096090 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-82411754-16f8-4e61-b938-15065a1b201e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 21361c85-1287-4754-8308-ef0f172d0e6f] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:47.103857 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-82411754-16f8-4e61-b938-15065a1b201e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:47.104408 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-82411754-16f8-4e61-b938-15065a1b201e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:47.104914 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-82411754-16f8-4e61-b938-15065a1b201e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:47.106322 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-82411754-16f8-4e61-b938-15065a1b201e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:47.107882 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-82411754-16f8-4e61-b938-15065a1b201e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:47.108590 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-82411754-16f8-4e61-b938-15065a1b201e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:47.237963 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6ebc4c7d-4236-4aca-97fd-024b5d849b53 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:47.238603 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-6ebc4c7d-4236-4aca-97fd-024b5d849b53 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 2646dfcb-7213-4870-99eb-68311662d66b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:47.247373 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6ebc4c7d-4236-4aca-97fd-024b5d849b53 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:47.248854 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6ebc4c7d-4236-4aca-97fd-024b5d849b53 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:47.249910 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6ebc4c7d-4236-4aca-97fd-024b5d849b53 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:47.251068 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6ebc4c7d-4236-4aca-97fd-024b5d849b53 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:47.251814 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6ebc4c7d-4236-4aca-97fd-024b5d849b53 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:47.253547 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6ebc4c7d-4236-4aca-97fd-024b5d849b53 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:47.401647 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-6ebc4c7d-4236-4aca-97fd-024b5d849b53 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3060cdc6eeba47288205e107717a6980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a841124bf4392b54c3d6b0ea37e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:47.405519 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-82411754-16f8-4e61-b938-15065a1b201e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:47.417538 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-82411754-16f8-4e61-b938-15065a1b201e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/21361c85-1287-4754-8308-ef0f172d0e6f" status: 200 len: 1277 microversion: 2.1 time: 0.326251 Oct 04 19:07:47.419162 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3299/6578] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:47 2022] GET /compute/v2.1/servers/21361c85-1287-4754-8308-ef0f172d0e6f => generated 1277 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:47.421508 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6ebc4c7d-4236-4aca-97fd-024b5d849b53 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b" status: 200 len: 1294 microversion: 2.1 time: 0.187427 Oct 04 19:07:47.424356 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3280/6579] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:47 2022] GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b => generated 1294 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:48.298316 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-49a2b001-aeec-44b9-84e6-abdfbed76020 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:48.299352 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-49a2b001-aeec-44b9-84e6-abdfbed76020 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] [instance: 5bac58cc-a8a8-4061-8e5d-20133c0fd84a] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:48.316856 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-49a2b001-aeec-44b9-84e6-abdfbed76020 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:48.317362 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-49a2b001-aeec-44b9-84e6-abdfbed76020 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:48.320723 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-49a2b001-aeec-44b9-84e6-abdfbed76020 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:48.321586 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-49a2b001-aeec-44b9-84e6-abdfbed76020 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:48.331562 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-49a2b001-aeec-44b9-84e6-abdfbed76020 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:48.332767 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-49a2b001-aeec-44b9-84e6-abdfbed76020 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:48.341710 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=92 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:07:48.386585 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-49a2b001-aeec-44b9-84e6-abdfbed76020 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] [instance: 5bac58cc-a8a8-4061-8e5d-20133c0fd84a] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:07:48.448715 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e426336c-bb39-4a1c-ad9c-951a967e6acb tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:48.448715 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e426336c-bb39-4a1c-ad9c-951a967e6acb tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 21361c85-1287-4754-8308-ef0f172d0e6f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:48.462609 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e426336c-bb39-4a1c-ad9c-951a967e6acb tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:48.463121 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e426336c-bb39-4a1c-ad9c-951a967e6acb tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:48.470657 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e426336c-bb39-4a1c-ad9c-951a967e6acb tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:48.471893 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e426336c-bb39-4a1c-ad9c-951a967e6acb tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:48.472802 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e426336c-bb39-4a1c-ad9c-951a967e6acb tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:48.473414 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e426336c-bb39-4a1c-ad9c-951a967e6acb tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:48.754763 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=4 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:07:48.810240 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e426336c-bb39-4a1c-ad9c-951a967e6acb tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:48.811371 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e426336c-bb39-4a1c-ad9c-951a967e6acb tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/21361c85-1287-4754-8308-ef0f172d0e6f" status: 200 len: 1277 microversion: 2.1 time: 0.369545 Oct 04 19:07:48.813296 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3281/6580] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:48 2022] GET /compute/v2.1/servers/21361c85-1287-4754-8308-ef0f172d0e6f => generated 1277 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:48.820947 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-fc8a8157-818d-4f82-84c8-78dba91982e7 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:48.821816 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-fc8a8157-818d-4f82-84c8-78dba91982e7 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 2646dfcb-7213-4870-99eb-68311662d66b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:48.840922 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-49a2b001-aeec-44b9-84e6-abdfbed76020 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5bac58cc-a8a8-4061-8e5d-20133c0fd84a" status: 204 len: 0 microversion: 2.1 time: 0.544519 Oct 04 19:07:48.844662 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3300/6581] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 19:07:48 2022] DELETE /compute/v2.1/servers/5bac58cc-a8a8-4061-8e5d-20133c0fd84a => generated 0 bytes in 550 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:07:48.848597 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fc8a8157-818d-4f82-84c8-78dba91982e7 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:48.850621 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fc8a8157-818d-4f82-84c8-78dba91982e7 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:48.851256 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fc8a8157-818d-4f82-84c8-78dba91982e7 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:48.852201 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fc8a8157-818d-4f82-84c8-78dba91982e7 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:48.852839 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fc8a8157-818d-4f82-84c8-78dba91982e7 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:48.853463 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fc8a8157-818d-4f82-84c8-78dba91982e7 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:48.861538 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-84f58cac-9708-438c-a983-87c4e370ad41 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:48.865265 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-84f58cac-9708-438c-a983-87c4e370ad41 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] [instance: 5bac58cc-a8a8-4061-8e5d-20133c0fd84a] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:48.892096 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-84f58cac-9708-438c-a983-87c4e370ad41 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:48.896331 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-84f58cac-9708-438c-a983-87c4e370ad41 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:48.897535 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-84f58cac-9708-438c-a983-87c4e370ad41 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:48.901165 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-84f58cac-9708-438c-a983-87c4e370ad41 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:48.906274 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-84f58cac-9708-438c-a983-87c4e370ad41 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:48.906919 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-84f58cac-9708-438c-a983-87c4e370ad41 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:49.037447 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-fc8a8157-818d-4f82-84c8-78dba91982e7 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3060cdc6eeba47288205e107717a6980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a841124bf4392b54c3d6b0ea37e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:49.050742 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-fc8a8157-818d-4f82-84c8-78dba91982e7 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b" status: 200 len: 1361 microversion: 2.1 time: 0.232332 Oct 04 19:07:49.051880 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3282/6582] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:48 2022] GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b => generated 1361 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:49.167011 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-84f58cac-9708-438c-a983-87c4e370ad41 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7235fe80b9ae4d2cb3ef83ea30fb8961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90bae5f44b43437193fec925de3f0bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:49.177780 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-84f58cac-9708-438c-a983-87c4e370ad41 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] 10.222.0.20 "GET /compute/v2.1/servers/5bac58cc-a8a8-4061-8e5d-20133c0fd84a" status: 200 len: 1503 microversion: 2.1 time: 0.331761 Oct 04 19:07:49.178956 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3301/6583] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:48 2022] GET /compute/v2.1/servers/5bac58cc-a8a8-4061-8e5d-20133c0fd84a => generated 1503 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:49.835500 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e353976d-c48c-4645-bfd3-29fdf6978e82 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:49.836317 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e353976d-c48c-4645-bfd3-29fdf6978e82 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 21361c85-1287-4754-8308-ef0f172d0e6f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:49.846111 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e353976d-c48c-4645-bfd3-29fdf6978e82 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:49.847723 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e353976d-c48c-4645-bfd3-29fdf6978e82 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:49.847723 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e353976d-c48c-4645-bfd3-29fdf6978e82 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:49.849377 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e353976d-c48c-4645-bfd3-29fdf6978e82 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:49.850227 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e353976d-c48c-4645-bfd3-29fdf6978e82 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:49.850848 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e353976d-c48c-4645-bfd3-29fdf6978e82 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:50.076621 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3c76fc22-f7a1-42f2-b9ec-dde7e7ba9fb3 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:50.077242 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3c76fc22-f7a1-42f2-b9ec-dde7e7ba9fb3 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 2646dfcb-7213-4870-99eb-68311662d66b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:50.096976 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3c76fc22-f7a1-42f2-b9ec-dde7e7ba9fb3 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:50.097486 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3c76fc22-f7a1-42f2-b9ec-dde7e7ba9fb3 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:50.097931 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3c76fc22-f7a1-42f2-b9ec-dde7e7ba9fb3 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:50.099177 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3c76fc22-f7a1-42f2-b9ec-dde7e7ba9fb3 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:50.099663 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3c76fc22-f7a1-42f2-b9ec-dde7e7ba9fb3 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:50.100120 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3c76fc22-f7a1-42f2-b9ec-dde7e7ba9fb3 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:50.157033 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e353976d-c48c-4645-bfd3-29fdf6978e82 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:50.170958 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e353976d-c48c-4645-bfd3-29fdf6978e82 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/21361c85-1287-4754-8308-ef0f172d0e6f" status: 200 len: 1277 microversion: 2.1 time: 0.336066 Oct 04 19:07:50.172992 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3283/6584] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:49 2022] GET /compute/v2.1/servers/21361c85-1287-4754-8308-ef0f172d0e6f => generated 1277 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:50.204803 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-27acec26-39d5-4426-a088-7da709678b2a req-e53c8c13-28d5-4e67-90a7-63168f74a0a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21361c85-1287-4754-8308-ef0f172d0e6f", "tag": "55c2030e-c6da-4343-934f-0ec880fa90dc"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:07:50.234256 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-27acec26-39d5-4426-a088-7da709678b2a req-e53c8c13-28d5-4e67-90a7-63168f74a0a7 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:50.234256 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-27acec26-39d5-4426-a088-7da709678b2a req-e53c8c13-28d5-4e67-90a7-63168f74a0a7 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:50.234256 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-27acec26-39d5-4426-a088-7da709678b2a req-e53c8c13-28d5-4e67-90a7-63168f74a0a7 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:50.248310 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-27acec26-39d5-4426-a088-7da709678b2a req-e53c8c13-28d5-4e67-90a7-63168f74a0a7 service nova] Creating event network-changed:55c2030e-c6da-4343-934f-0ec880fa90dc for instance 21361c85-1287-4754-8308-ef0f172d0e6f on n-h2-850501-14 Oct 04 19:07:50.255134 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-27acec26-39d5-4426-a088-7da709678b2a req-e53c8c13-28d5-4e67-90a7-63168f74a0a7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068363 Oct 04 19:07:50.260366 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3284/6585] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:07:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:07:50.267621 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d43706e8-2a45-49fb-8fbd-0f338b4ee932 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:50.274530 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d43706e8-2a45-49fb-8fbd-0f338b4ee932 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] [instance: 5bac58cc-a8a8-4061-8e5d-20133c0fd84a] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:50.279361 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d43706e8-2a45-49fb-8fbd-0f338b4ee932 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:50.279361 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d43706e8-2a45-49fb-8fbd-0f338b4ee932 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:50.279361 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d43706e8-2a45-49fb-8fbd-0f338b4ee932 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:50.279361 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d43706e8-2a45-49fb-8fbd-0f338b4ee932 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:50.279361 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d43706e8-2a45-49fb-8fbd-0f338b4ee932 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:50.280120 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d43706e8-2a45-49fb-8fbd-0f338b4ee932 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:50.972252 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d43706e8-2a45-49fb-8fbd-0f338b4ee932 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7235fe80b9ae4d2cb3ef83ea30fb8961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90bae5f44b43437193fec925de3f0bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:50.984970 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d43706e8-2a45-49fb-8fbd-0f338b4ee932 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] 10.222.0.20 "GET /compute/v2.1/servers/5bac58cc-a8a8-4061-8e5d-20133c0fd84a" status: 200 len: 1503 microversion: 2.1 time: 0.720070 Oct 04 19:07:50.986338 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3285/6586] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:50 2022] GET /compute/v2.1/servers/5bac58cc-a8a8-4061-8e5d-20133c0fd84a => generated 1503 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:51.108692 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3c76fc22-f7a1-42f2-b9ec-dde7e7ba9fb3 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3060cdc6eeba47288205e107717a6980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a841124bf4392b54c3d6b0ea37e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:51.120731 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3c76fc22-f7a1-42f2-b9ec-dde7e7ba9fb3 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b" status: 200 len: 1361 microversion: 2.1 time: 1.049201 Oct 04 19:07:51.123593 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3302/6587] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:50 2022] GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b => generated 1361 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:07:51.207711 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-789f44a0-5c91-4771-a93e-73f9fefa6684 req-73cf4e0e-3333-42d0-b035-7b35b605bb5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bac58cc-a8a8-4061-8e5d-20133c0fd84a", "name": "network-vif-deleted", "tag": "cb74bcd3-c7d0-4ef7-9652-fc6cc8a515bb"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:07:51.208201 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-cbf42136-4549-4ab9-838a-b90c3797e666 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:51.214010 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-cbf42136-4549-4ab9-838a-b90c3797e666 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 21361c85-1287-4754-8308-ef0f172d0e6f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:51.245970 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cbf42136-4549-4ab9-838a-b90c3797e666 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:51.246835 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cbf42136-4549-4ab9-838a-b90c3797e666 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:51.249249 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-789f44a0-5c91-4771-a93e-73f9fefa6684 req-73cf4e0e-3333-42d0-b035-7b35b605bb5e service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:51.251930 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cbf42136-4549-4ab9-838a-b90c3797e666 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:51.255654 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cbf42136-4549-4ab9-838a-b90c3797e666 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:51.257428 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cbf42136-4549-4ab9-838a-b90c3797e666 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:51.258159 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-789f44a0-5c91-4771-a93e-73f9fefa6684 req-73cf4e0e-3333-42d0-b035-7b35b605bb5e service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:51.259549 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cbf42136-4549-4ab9-838a-b90c3797e666 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:51.260096 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-789f44a0-5c91-4771-a93e-73f9fefa6684 req-73cf4e0e-3333-42d0-b035-7b35b605bb5e service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:51.285637 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-789f44a0-5c91-4771-a93e-73f9fefa6684 req-73cf4e0e-3333-42d0-b035-7b35b605bb5e service nova] Creating event network-vif-deleted:cb74bcd3-c7d0-4ef7-9652-fc6cc8a515bb for instance 5bac58cc-a8a8-4061-8e5d-20133c0fd84a on n-h1-850501-14 Oct 04 19:07:51.303257 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-789f44a0-5c91-4771-a93e-73f9fefa6684 req-73cf4e0e-3333-42d0-b035-7b35b605bb5e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100878 Oct 04 19:07:51.316097 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3303/6588] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:07:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:07:51.510599 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-cbf42136-4549-4ab9-838a-b90c3797e666 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:51.521198 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-cbf42136-4549-4ab9-838a-b90c3797e666 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/21361c85-1287-4754-8308-ef0f172d0e6f" status: 200 len: 1277 microversion: 2.1 time: 0.325736 Oct 04 19:07:51.536586 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3286/6589] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:51 2022] GET /compute/v2.1/servers/21361c85-1287-4754-8308-ef0f172d0e6f => generated 1277 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:52.020545 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3a8ea0e6-7a37-41e1-a76f-39c33f1ecc6e tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:52.022202 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3a8ea0e6-7a37-41e1-a76f-39c33f1ecc6e tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] [instance: 5bac58cc-a8a8-4061-8e5d-20133c0fd84a] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:52.031455 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3a8ea0e6-7a37-41e1-a76f-39c33f1ecc6e tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:52.032250 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3a8ea0e6-7a37-41e1-a76f-39c33f1ecc6e tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:52.032798 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3a8ea0e6-7a37-41e1-a76f-39c33f1ecc6e tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:52.033503 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3a8ea0e6-7a37-41e1-a76f-39c33f1ecc6e tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:52.034036 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3a8ea0e6-7a37-41e1-a76f-39c33f1ecc6e tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:52.034376 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3a8ea0e6-7a37-41e1-a76f-39c33f1ecc6e tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:52.068534 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3a8ea0e6-7a37-41e1-a76f-39c33f1ecc6e tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:52.069160 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3a8ea0e6-7a37-41e1-a76f-39c33f1ecc6e tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:52.069692 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3a8ea0e6-7a37-41e1-a76f-39c33f1ecc6e tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:52.070256 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-3a8ea0e6-7a37-41e1-a76f-39c33f1ecc6e tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lazy-loading 'fault' on Instance uuid 5bac58cc-a8a8-4061-8e5d-20133c0fd84a {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:07:52.115427 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3a8ea0e6-7a37-41e1-a76f-39c33f1ecc6e tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7235fe80b9ae4d2cb3ef83ea30fb8961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90bae5f44b43437193fec925de3f0bf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:52.125269 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3a8ea0e6-7a37-41e1-a76f-39c33f1ecc6e tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] 10.222.0.20 "GET /compute/v2.1/servers/5bac58cc-a8a8-4061-8e5d-20133c0fd84a" status: 200 len: 1303 microversion: 2.1 time: 0.110218 Oct 04 19:07:52.125855 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3304/6590] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:52 2022] GET /compute/v2.1/servers/5bac58cc-a8a8-4061-8e5d-20133c0fd84a => generated 1303 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:52.153205 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f3fcc051-175f-4dc9-aeb8-b1725dc3ea07 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:52.154136 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f3fcc051-175f-4dc9-aeb8-b1725dc3ea07 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 2646dfcb-7213-4870-99eb-68311662d66b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:52.160941 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:07:52.164222 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f3fcc051-175f-4dc9-aeb8-b1725dc3ea07 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:52.166957 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f3fcc051-175f-4dc9-aeb8-b1725dc3ea07 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:52.166957 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f3fcc051-175f-4dc9-aeb8-b1725dc3ea07 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:52.166957 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f3fcc051-175f-4dc9-aeb8-b1725dc3ea07 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:52.166957 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f3fcc051-175f-4dc9-aeb8-b1725dc3ea07 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:52.167502 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f3fcc051-175f-4dc9-aeb8-b1725dc3ea07 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:52.272154 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-e11b4a85-3c97-469b-bd2d-9c4b13775896 req-66b2ba6c-81be-43b1-ad92-846ab0710a47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2646dfcb-7213-4870-99eb-68311662d66b", "tag": "4060b5e6-c83b-436b-a8e4-fe4d200875b7"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:07:52.284924 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-e11b4a85-3c97-469b-bd2d-9c4b13775896 req-66b2ba6c-81be-43b1-ad92-846ab0710a47 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:52.285512 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-e11b4a85-3c97-469b-bd2d-9c4b13775896 req-66b2ba6c-81be-43b1-ad92-846ab0710a47 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:52.285951 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-e11b4a85-3c97-469b-bd2d-9c4b13775896 req-66b2ba6c-81be-43b1-ad92-846ab0710a47 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:52.299617 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-e11b4a85-3c97-469b-bd2d-9c4b13775896 req-66b2ba6c-81be-43b1-ad92-846ab0710a47 service nova] Creating event network-changed:4060b5e6-c83b-436b-a8e4-fe4d200875b7 for instance 2646dfcb-7213-4870-99eb-68311662d66b on n-h2-850501-14 Oct 04 19:07:52.305511 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-e11b4a85-3c97-469b-bd2d-9c4b13775896 req-66b2ba6c-81be-43b1-ad92-846ab0710a47 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037553 Oct 04 19:07:52.310264 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3305/6591] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:07:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:07:52.320567 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f3fcc051-175f-4dc9-aeb8-b1725dc3ea07 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3060cdc6eeba47288205e107717a6980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a841124bf4392b54c3d6b0ea37e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:52.331607 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f3fcc051-175f-4dc9-aeb8-b1725dc3ea07 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b" status: 200 len: 1361 microversion: 2.1 time: 0.184454 Oct 04 19:07:52.333130 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3287/6592] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:52 2022] GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b => generated 1361 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:52.549923 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:07:52.549923 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-06cb46ba-8015-475f-9c03-eaf33232c110 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:52.554598 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-06cb46ba-8015-475f-9c03-eaf33232c110 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 21361c85-1287-4754-8308-ef0f172d0e6f] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:52.565494 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-06cb46ba-8015-475f-9c03-eaf33232c110 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:52.566271 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-06cb46ba-8015-475f-9c03-eaf33232c110 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:52.566973 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-06cb46ba-8015-475f-9c03-eaf33232c110 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:52.567861 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-06cb46ba-8015-475f-9c03-eaf33232c110 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:52.568350 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-06cb46ba-8015-475f-9c03-eaf33232c110 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:52.569373 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-06cb46ba-8015-475f-9c03-eaf33232c110 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:52.729999 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-06cb46ba-8015-475f-9c03-eaf33232c110 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:52.739061 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-06cb46ba-8015-475f-9c03-eaf33232c110 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/21361c85-1287-4754-8308-ef0f172d0e6f" status: 200 len: 1277 microversion: 2.1 time: 0.195924 Oct 04 19:07:52.752508 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3306/6593] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:52 2022] GET /compute/v2.1/servers/21361c85-1287-4754-8308-ef0f172d0e6f => generated 1277 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:53.150721 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-72854a21-b154-48f3-9e76-bd44a3adb6d4 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:53.151360 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-72854a21-b154-48f3-9e76-bd44a3adb6d4 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] [instance: 5bac58cc-a8a8-4061-8e5d-20133c0fd84a] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:53.157102 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=16 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:07:53.159391 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-72854a21-b154-48f3-9e76-bd44a3adb6d4 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:53.160096 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-72854a21-b154-48f3-9e76-bd44a3adb6d4 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:53.160746 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-72854a21-b154-48f3-9e76-bd44a3adb6d4 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:53.161475 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-72854a21-b154-48f3-9e76-bd44a3adb6d4 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:53.162121 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-72854a21-b154-48f3-9e76-bd44a3adb6d4 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:53.162568 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-72854a21-b154-48f3-9e76-bd44a3adb6d4 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:53.197715 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-72854a21-b154-48f3-9e76-bd44a3adb6d4 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] HTTP exception thrown: Instance 5bac58cc-a8a8-4061-8e5d-20133c0fd84a could not be found. Oct 04 19:07:53.199989 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-72854a21-b154-48f3-9e76-bd44a3adb6d4 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Request method failure captured: Oct 04 19:07:53.199989 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/5bac58cc-a8a8-4061-8e5d-20133c0fd84a HTTP/1.1 Oct 04 19:07:53.199989 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 19:07:53.199989 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 19:07:53.199989 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 19:07:53.199989 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 19:07:53.199989 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 19:07:53.199989 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 19:07:53.199989 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 19:07:53.199989 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 19:07:53.199989 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPIRZKn16av3uRbh7qyJoViM7H2-HpuJI1Vu8pwEKlnz9frgCmqn5mecWhzRlARR9fUxlYQH-hd_osZ6Fa26SeoQQIriHi_p3VI1fkoNXCzeiROoUZgs-8s8lXBY_MUyt7OxIjloQtKVYzjDbpLDtJIKWuaLDvrmx8f-N7Rd5xsZF-OE Oct 04 19:07:53.199989 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 19:07:53.199989 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 19:07:53.199989 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 19:07:53.199989 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 19:07:53.199989 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 19:07:53.199989 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 19:07:53.199989 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 90bae5f44b43437193fec925de3f0bf2 Oct 04 19:07:53.199989 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-VolumesActionsTest-1581876719 Oct 04 19:07:53.199989 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 19:07:53.199989 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 19:07:53.199989 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/90bae5f44b43437193fec925de3f0bf2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_90bae5f44b43437193fec925de3f0bf2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/90bae5f44b43437193fec925de3f0bf2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/90bae5f44b43437193fec925de3f0bf2"}]}] Oct 04 19:07:53.199989 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-VolumesActionsTest-1581876719 Oct 04 19:07:53.199989 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 90bae5f44b43437193fec925de3f0bf2 Oct 04 19:07:53.199989 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-VolumesActionsTest-1581876719 Oct 04 19:07:53.199989 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-VolumesActionsTest-1581876719-project Oct 04 19:07:53.199989 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 19:07:53.199989 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 19:07:53.199989 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 7235fe80b9ae4d2cb3ef83ea30fb8961 Oct 04 19:07:53.199989 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-VolumesActionsTest-1581876719-project Oct 04 19:07:53.199989 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 19:07:53.199989 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 5bac58cc-a8a8-4061-8e5d-20133c0fd84a could not be found. Oct 04 19:07:53.199989 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '5bac58cc-a8a8-4061-8e5d-20133c0fd84a'} Oct 04 19:07:53.199989 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:07:53.199989 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:07:53.199989 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:07:53.199989 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:07:53.199989 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:07:53.199989 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:07:53.199989 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:07:53.199989 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:07:53.199989 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:07:53.199989 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:07:53.199989 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bac58cc-a8a8-4061-8e5d-20133c0fd84a could not be found. Oct 04 19:07:53.199989 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:07:53.199989 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:07:53.199989 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:07:53.199989 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:07:53.199989 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:07:53.199989 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:07:53.199989 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:07:53.199989 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:07:53.199989 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:07:53.199989 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:07:53.199989 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:07:53.199989 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:07:53.199989 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:07:53.199989 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:07:53.199989 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:07:53.199989 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:07:53.199989 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bac58cc-a8a8-4061-8e5d-20133c0fd84a could not be found. Oct 04 19:07:53.199989 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:07:53.199989 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:07:53.199989 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:07:53.206722 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:07:53.206722 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:07:53.206722 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:07:53.206722 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:07:53.206722 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:07:53.206722 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bac58cc-a8a8-4061-8e5d-20133c0fd84a could not be found. Oct 04 19:07:53.206722 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:07:53.206722 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-72854a21-b154-48f3-9e76-bd44a3adb6d4 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] Returning 404 to user: Instance 5bac58cc-a8a8-4061-8e5d-20133c0fd84a could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:07:53.206722 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-72854a21-b154-48f3-9e76-bd44a3adb6d4 tempest-VolumesActionsTest-1581876719 tempest-VolumesActionsTest-1581876719-project] 10.222.0.20 "GET /compute/v2.1/servers/5bac58cc-a8a8-4061-8e5d-20133c0fd84a" status: 404 len: 111 microversion: 2.1 time: 0.054792 Oct 04 19:07:53.220437 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3288/6594] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:53 2022] GET /compute/v2.1/servers/5bac58cc-a8a8-4061-8e5d-20133c0fd84a => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:07:53.356895 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-138a9d68-8c5b-47f5-a3ca-7bb91e7af961 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:53.357344 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-138a9d68-8c5b-47f5-a3ca-7bb91e7af961 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 2646dfcb-7213-4870-99eb-68311662d66b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:53.363344 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-138a9d68-8c5b-47f5-a3ca-7bb91e7af961 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:53.363830 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-138a9d68-8c5b-47f5-a3ca-7bb91e7af961 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:53.364291 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-138a9d68-8c5b-47f5-a3ca-7bb91e7af961 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:53.364981 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-138a9d68-8c5b-47f5-a3ca-7bb91e7af961 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:53.365433 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-138a9d68-8c5b-47f5-a3ca-7bb91e7af961 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:53.365857 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-138a9d68-8c5b-47f5-a3ca-7bb91e7af961 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:53.568834 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-138a9d68-8c5b-47f5-a3ca-7bb91e7af961 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3060cdc6eeba47288205e107717a6980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a841124bf4392b54c3d6b0ea37e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:53.583016 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-138a9d68-8c5b-47f5-a3ca-7bb91e7af961 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b" status: 200 len: 1361 microversion: 2.1 time: 0.231978 Oct 04 19:07:53.585697 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3307/6595] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:53 2022] GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b => generated 1361 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:53.762724 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9d1d9426-7d93-476a-baad-5c3a66060145 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:53.763363 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9d1d9426-7d93-476a-baad-5c3a66060145 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 21361c85-1287-4754-8308-ef0f172d0e6f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:53.770816 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9d1d9426-7d93-476a-baad-5c3a66060145 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:53.774961 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9d1d9426-7d93-476a-baad-5c3a66060145 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:53.774961 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9d1d9426-7d93-476a-baad-5c3a66060145 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:53.774961 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9d1d9426-7d93-476a-baad-5c3a66060145 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:53.774961 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9d1d9426-7d93-476a-baad-5c3a66060145 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:53.774961 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9d1d9426-7d93-476a-baad-5c3a66060145 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:53.939348 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9d1d9426-7d93-476a-baad-5c3a66060145 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:53.947571 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9d1d9426-7d93-476a-baad-5c3a66060145 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/21361c85-1287-4754-8308-ef0f172d0e6f" status: 200 len: 1277 microversion: 2.1 time: 0.189220 Oct 04 19:07:53.948354 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3289/6596] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:53 2022] GET /compute/v2.1/servers/21361c85-1287-4754-8308-ef0f172d0e6f => generated 1277 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:54.471886 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=16 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:07:54.610381 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5594b4a9-09b2-4691-8758-e344f51aa01f tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:54.611029 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5594b4a9-09b2-4691-8758-e344f51aa01f tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 2646dfcb-7213-4870-99eb-68311662d66b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:54.622513 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5594b4a9-09b2-4691-8758-e344f51aa01f tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:54.624145 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5594b4a9-09b2-4691-8758-e344f51aa01f tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:54.632126 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5594b4a9-09b2-4691-8758-e344f51aa01f tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:54.633324 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5594b4a9-09b2-4691-8758-e344f51aa01f tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:54.633579 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5594b4a9-09b2-4691-8758-e344f51aa01f tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:54.639775 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-76c323eb-4db3-46cb-b435-6d15fdc7744d tempest-PortsAdminExtendedAttrsIpV6TestJSON-1577638841 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1577638841-project-admin] Calling method '.version_select at 0x7fe258fd0310>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:54.641480 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-76c323eb-4db3-46cb-b435-6d15fdc7744d tempest-PortsAdminExtendedAttrsIpV6TestJSON-1577638841 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1577638841-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:54.641991 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-76c323eb-4db3-46cb-b435-6d15fdc7744d tempest-PortsAdminExtendedAttrsIpV6TestJSON-1577638841 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1577638841-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:54.642402 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-76c323eb-4db3-46cb-b435-6d15fdc7744d tempest-PortsAdminExtendedAttrsIpV6TestJSON-1577638841 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1577638841-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:54.647527 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5594b4a9-09b2-4691-8758-e344f51aa01f tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:54.680214 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-76c323eb-4db3-46cb-b435-6d15fdc7744d tempest-PortsAdminExtendedAttrsIpV6TestJSON-1577638841 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1577638841-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:54.680974 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-76c323eb-4db3-46cb-b435-6d15fdc7744d tempest-PortsAdminExtendedAttrsIpV6TestJSON-1577638841 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1577638841-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:54.681421 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-76c323eb-4db3-46cb-b435-6d15fdc7744d tempest-PortsAdminExtendedAttrsIpV6TestJSON-1577638841 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1577638841-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:54.699745 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-76c323eb-4db3-46cb-b435-6d15fdc7744d tempest-PortsAdminExtendedAttrsIpV6TestJSON-1577638841 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1577638841-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:54.700532 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-76c323eb-4db3-46cb-b435-6d15fdc7744d tempest-PortsAdminExtendedAttrsIpV6TestJSON-1577638841 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1577638841-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:54.701185 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-76c323eb-4db3-46cb-b435-6d15fdc7744d tempest-PortsAdminExtendedAttrsIpV6TestJSON-1577638841 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1577638841-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:54.708171 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-76c323eb-4db3-46cb-b435-6d15fdc7744d tempest-PortsAdminExtendedAttrsIpV6TestJSON-1577638841 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1577638841-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.240775 Oct 04 19:07:54.709109 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3308/6597] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Oct 4 19:07:54 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:07:54.831456 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5594b4a9-09b2-4691-8758-e344f51aa01f tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3060cdc6eeba47288205e107717a6980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a841124bf4392b54c3d6b0ea37e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:54.839656 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5594b4a9-09b2-4691-8758-e344f51aa01f tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b" status: 200 len: 1361 microversion: 2.1 time: 0.234610 Oct 04 19:07:54.840372 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3290/6598] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:54 2022] GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b => generated 1361 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:54.971221 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6811287a-bd2f-478c-9160-a07f507e3f0e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:54.972029 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6811287a-bd2f-478c-9160-a07f507e3f0e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 21361c85-1287-4754-8308-ef0f172d0e6f] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:54.978122 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6811287a-bd2f-478c-9160-a07f507e3f0e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:54.978876 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6811287a-bd2f-478c-9160-a07f507e3f0e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:54.979032 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6811287a-bd2f-478c-9160-a07f507e3f0e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:54.979725 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6811287a-bd2f-478c-9160-a07f507e3f0e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:54.980209 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6811287a-bd2f-478c-9160-a07f507e3f0e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:54.981144 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6811287a-bd2f-478c-9160-a07f507e3f0e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:55.212603 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6811287a-bd2f-478c-9160-a07f507e3f0e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:55.221567 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6811287a-bd2f-478c-9160-a07f507e3f0e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/21361c85-1287-4754-8308-ef0f172d0e6f" status: 200 len: 1265 microversion: 2.1 time: 0.254556 Oct 04 19:07:55.222830 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3309/6599] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:54 2022] GET /compute/v2.1/servers/21361c85-1287-4754-8308-ef0f172d0e6f => generated 1265 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:55.864714 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-150932d0-055a-48f6-9adc-aecc1c3831aa tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:55.865489 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-150932d0-055a-48f6-9adc-aecc1c3831aa tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 2646dfcb-7213-4870-99eb-68311662d66b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:55.879220 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-150932d0-055a-48f6-9adc-aecc1c3831aa tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:55.879728 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-150932d0-055a-48f6-9adc-aecc1c3831aa tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:55.880208 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-150932d0-055a-48f6-9adc-aecc1c3831aa tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:55.880932 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-150932d0-055a-48f6-9adc-aecc1c3831aa tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:55.881395 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-150932d0-055a-48f6-9adc-aecc1c3831aa tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:55.882032 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-150932d0-055a-48f6-9adc-aecc1c3831aa tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:56.151220 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-150932d0-055a-48f6-9adc-aecc1c3831aa tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3060cdc6eeba47288205e107717a6980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a841124bf4392b54c3d6b0ea37e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:56.162496 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-150932d0-055a-48f6-9adc-aecc1c3831aa tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b" status: 200 len: 1361 microversion: 2.1 time: 0.302275 Oct 04 19:07:56.170851 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3291/6600] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:55 2022] GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b => generated 1361 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:56.246450 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5b0741bc-f985-45ae-80c9-5b3181a05cf9 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:56.247142 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5b0741bc-f985-45ae-80c9-5b3181a05cf9 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 21361c85-1287-4754-8308-ef0f172d0e6f] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:56.261121 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5b0741bc-f985-45ae-80c9-5b3181a05cf9 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:56.262426 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5b0741bc-f985-45ae-80c9-5b3181a05cf9 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:56.262940 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5b0741bc-f985-45ae-80c9-5b3181a05cf9 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:56.263667 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5b0741bc-f985-45ae-80c9-5b3181a05cf9 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:56.265127 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5b0741bc-f985-45ae-80c9-5b3181a05cf9 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:56.265718 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5b0741bc-f985-45ae-80c9-5b3181a05cf9 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:56.492682 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5b0741bc-f985-45ae-80c9-5b3181a05cf9 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:56.506857 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5b0741bc-f985-45ae-80c9-5b3181a05cf9 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/21361c85-1287-4754-8308-ef0f172d0e6f" status: 200 len: 1265 microversion: 2.1 time: 0.259956 Oct 04 19:07:56.508779 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3310/6601] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:56 2022] GET /compute/v2.1/servers/21361c85-1287-4754-8308-ef0f172d0e6f => generated 1265 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:57.188517 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8700b53b-32b2-44c0-9868-3b15b23c4630 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:57.189193 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8700b53b-32b2-44c0-9868-3b15b23c4630 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 2646dfcb-7213-4870-99eb-68311662d66b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:57.199735 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8700b53b-32b2-44c0-9868-3b15b23c4630 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:57.205543 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8700b53b-32b2-44c0-9868-3b15b23c4630 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:57.208132 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8700b53b-32b2-44c0-9868-3b15b23c4630 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:57.209115 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8700b53b-32b2-44c0-9868-3b15b23c4630 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:57.211261 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8700b53b-32b2-44c0-9868-3b15b23c4630 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:57.211894 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8700b53b-32b2-44c0-9868-3b15b23c4630 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:57.515805 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8700b53b-32b2-44c0-9868-3b15b23c4630 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3060cdc6eeba47288205e107717a6980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a841124bf4392b54c3d6b0ea37e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:57.525139 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8700b53b-32b2-44c0-9868-3b15b23c4630 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b" status: 200 len: 1361 microversion: 2.1 time: 0.340779 Oct 04 19:07:57.535054 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-87df9230-ab82-42f1-8f57-47cf9e7b36b7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:57.536685 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-87df9230-ab82-42f1-8f57-47cf9e7b36b7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 21361c85-1287-4754-8308-ef0f172d0e6f] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:57.537271 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3292/6602] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:57 2022] GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b => generated 1361 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:57.552918 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-87df9230-ab82-42f1-8f57-47cf9e7b36b7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:57.553369 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-87df9230-ab82-42f1-8f57-47cf9e7b36b7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:57.554006 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-87df9230-ab82-42f1-8f57-47cf9e7b36b7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:57.554969 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-87df9230-ab82-42f1-8f57-47cf9e7b36b7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:57.555651 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-87df9230-ab82-42f1-8f57-47cf9e7b36b7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:57.556300 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-87df9230-ab82-42f1-8f57-47cf9e7b36b7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:57.812799 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-87df9230-ab82-42f1-8f57-47cf9e7b36b7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:57.826975 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-87df9230-ab82-42f1-8f57-47cf9e7b36b7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/21361c85-1287-4754-8308-ef0f172d0e6f" status: 200 len: 1265 microversion: 2.1 time: 0.297713 Oct 04 19:07:57.829040 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3311/6603] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:57 2022] GET /compute/v2.1/servers/21361c85-1287-4754-8308-ef0f172d0e6f => generated 1265 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:58.191854 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-af4f5bec-0e91-4903-9e6b-62f0d24cf118 req-f382ad7c-9945-436f-b9ff-4698b17e6818 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2646dfcb-7213-4870-99eb-68311662d66b", "name": "network-vif-plugged", "status": "completed", "tag": "4060b5e6-c83b-436b-a8e4-fe4d200875b7"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:07:58.212408 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-af4f5bec-0e91-4903-9e6b-62f0d24cf118 req-f382ad7c-9945-436f-b9ff-4698b17e6818 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:58.212914 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-af4f5bec-0e91-4903-9e6b-62f0d24cf118 req-f382ad7c-9945-436f-b9ff-4698b17e6818 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:58.214034 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-af4f5bec-0e91-4903-9e6b-62f0d24cf118 req-f382ad7c-9945-436f-b9ff-4698b17e6818 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:58.226126 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=100 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:07:58.242416 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-af4f5bec-0e91-4903-9e6b-62f0d24cf118 req-f382ad7c-9945-436f-b9ff-4698b17e6818 service nova] Creating event network-vif-plugged:4060b5e6-c83b-436b-a8e4-fe4d200875b7 for instance 2646dfcb-7213-4870-99eb-68311662d66b on n-h2-850501-14 Oct 04 19:07:58.252591 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-af4f5bec-0e91-4903-9e6b-62f0d24cf118 req-f382ad7c-9945-436f-b9ff-4698b17e6818 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063817 Oct 04 19:07:58.253228 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3293/6604] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:07:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:07:58.550264 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6938b044-b1af-4d6f-81ca-dcf3dbc14c9e tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:58.550885 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6938b044-b1af-4d6f-81ca-dcf3dbc14c9e tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 2646dfcb-7213-4870-99eb-68311662d66b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:58.559411 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6938b044-b1af-4d6f-81ca-dcf3dbc14c9e tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:58.559959 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6938b044-b1af-4d6f-81ca-dcf3dbc14c9e tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:58.560373 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6938b044-b1af-4d6f-81ca-dcf3dbc14c9e tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:58.561076 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6938b044-b1af-4d6f-81ca-dcf3dbc14c9e tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:58.564415 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6938b044-b1af-4d6f-81ca-dcf3dbc14c9e tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:58.569989 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6938b044-b1af-4d6f-81ca-dcf3dbc14c9e tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:58.786590 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6938b044-b1af-4d6f-81ca-dcf3dbc14c9e tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3060cdc6eeba47288205e107717a6980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a841124bf4392b54c3d6b0ea37e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:58.801801 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6938b044-b1af-4d6f-81ca-dcf3dbc14c9e tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b" status: 200 len: 1361 microversion: 2.1 time: 0.255385 Oct 04 19:07:58.818995 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3312/6605] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:58 2022] GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b => generated 1361 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:58.862558 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ffb719ed-9a70-4cc5-a6e6-5f29ce900717 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:58.862558 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ffb719ed-9a70-4cc5-a6e6-5f29ce900717 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 21361c85-1287-4754-8308-ef0f172d0e6f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:58.873442 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ffb719ed-9a70-4cc5-a6e6-5f29ce900717 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:58.875540 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ffb719ed-9a70-4cc5-a6e6-5f29ce900717 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:58.878971 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ffb719ed-9a70-4cc5-a6e6-5f29ce900717 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:58.880925 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ffb719ed-9a70-4cc5-a6e6-5f29ce900717 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:58.881580 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ffb719ed-9a70-4cc5-a6e6-5f29ce900717 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:58.882568 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ffb719ed-9a70-4cc5-a6e6-5f29ce900717 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:59.079994 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ffb719ed-9a70-4cc5-a6e6-5f29ce900717 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:59.092099 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ffb719ed-9a70-4cc5-a6e6-5f29ce900717 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/21361c85-1287-4754-8308-ef0f172d0e6f" status: 200 len: 1265 microversion: 2.1 time: 0.244458 Oct 04 19:07:59.093411 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3294/6606] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:58 2022] GET /compute/v2.1/servers/21361c85-1287-4754-8308-ef0f172d0e6f => generated 1265 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:59.831879 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0a631f3c-b88b-4607-8543-3d0509125553 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:59.833840 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0a631f3c-b88b-4607-8543-3d0509125553 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 2646dfcb-7213-4870-99eb-68311662d66b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:59.851385 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0a631f3c-b88b-4607-8543-3d0509125553 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:59.852546 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0a631f3c-b88b-4607-8543-3d0509125553 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:59.857085 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0a631f3c-b88b-4607-8543-3d0509125553 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:59.859454 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0a631f3c-b88b-4607-8543-3d0509125553 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:59.861804 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0a631f3c-b88b-4607-8543-3d0509125553 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:59.863421 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0a631f3c-b88b-4607-8543-3d0509125553 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:00.115400 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9359c693-bbd1-47d4-8e39-4bd15b0f0591 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:00.116470 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9359c693-bbd1-47d4-8e39-4bd15b0f0591 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 21361c85-1287-4754-8308-ef0f172d0e6f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:00.133245 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9359c693-bbd1-47d4-8e39-4bd15b0f0591 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:00.133772 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9359c693-bbd1-47d4-8e39-4bd15b0f0591 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:00.134545 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9359c693-bbd1-47d4-8e39-4bd15b0f0591 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:00.136273 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9359c693-bbd1-47d4-8e39-4bd15b0f0591 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:00.137355 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9359c693-bbd1-47d4-8e39-4bd15b0f0591 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:00.140421 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9359c693-bbd1-47d4-8e39-4bd15b0f0591 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:00.160560 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0a631f3c-b88b-4607-8543-3d0509125553 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3060cdc6eeba47288205e107717a6980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a841124bf4392b54c3d6b0ea37e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:00.198221 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0a631f3c-b88b-4607-8543-3d0509125553 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b" status: 200 len: 1361 microversion: 2.1 time: 0.372931 Oct 04 19:08:00.198833 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3313/6607] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:59 2022] GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b => generated 1361 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:00.414752 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9359c693-bbd1-47d4-8e39-4bd15b0f0591 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:00.441484 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9359c693-bbd1-47d4-8e39-4bd15b0f0591 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/21361c85-1287-4754-8308-ef0f172d0e6f" status: 200 len: 1265 microversion: 2.1 time: 0.330474 Oct 04 19:08:00.447994 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3295/6608] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:00 2022] GET /compute/v2.1/servers/21361c85-1287-4754-8308-ef0f172d0e6f => generated 1265 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:08:01.222068 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ce83e0f7-5d72-4712-bde6-d674af85d622 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:01.222634 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ce83e0f7-5d72-4712-bde6-d674af85d622 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 2646dfcb-7213-4870-99eb-68311662d66b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:01.229744 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ce83e0f7-5d72-4712-bde6-d674af85d622 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:01.230297 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ce83e0f7-5d72-4712-bde6-d674af85d622 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:01.231319 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ce83e0f7-5d72-4712-bde6-d674af85d622 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:01.232026 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ce83e0f7-5d72-4712-bde6-d674af85d622 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:01.232514 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ce83e0f7-5d72-4712-bde6-d674af85d622 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:01.232945 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ce83e0f7-5d72-4712-bde6-d674af85d622 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:01.376146 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ce83e0f7-5d72-4712-bde6-d674af85d622 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3060cdc6eeba47288205e107717a6980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a841124bf4392b54c3d6b0ea37e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:01.392473 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ce83e0f7-5d72-4712-bde6-d674af85d622 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b" status: 200 len: 1548 microversion: 2.1 time: 0.174436 Oct 04 19:08:01.405090 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3314/6609] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:01 2022] GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b => generated 1548 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:01.429303 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b6189598-018b-49a3-8594-15df63a38d50 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:01.435626 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b6189598-018b-49a3-8594-15df63a38d50 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 2646dfcb-7213-4870-99eb-68311662d66b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:01.451843 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b6189598-018b-49a3-8594-15df63a38d50 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:01.452407 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b6189598-018b-49a3-8594-15df63a38d50 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:01.452871 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b6189598-018b-49a3-8594-15df63a38d50 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:01.453624 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b6189598-018b-49a3-8594-15df63a38d50 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:01.454104 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b6189598-018b-49a3-8594-15df63a38d50 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:01.454558 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b6189598-018b-49a3-8594-15df63a38d50 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:01.470163 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3bd988d9-51d4-4df6-8ac3-7a1648d381c1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:01.470790 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3bd988d9-51d4-4df6-8ac3-7a1648d381c1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 21361c85-1287-4754-8308-ef0f172d0e6f] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:01.483460 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3bd988d9-51d4-4df6-8ac3-7a1648d381c1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:01.484363 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3bd988d9-51d4-4df6-8ac3-7a1648d381c1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:01.485056 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3bd988d9-51d4-4df6-8ac3-7a1648d381c1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:01.486137 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3bd988d9-51d4-4df6-8ac3-7a1648d381c1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:01.487572 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3bd988d9-51d4-4df6-8ac3-7a1648d381c1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:01.489182 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3bd988d9-51d4-4df6-8ac3-7a1648d381c1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:01.620313 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b6189598-018b-49a3-8594-15df63a38d50 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.206101 Oct 04 19:08:01.622804 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3296/6610] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Oct 4 19:08:01 2022] GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b/os-interface => generated 285 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:08:01.978639 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3bd988d9-51d4-4df6-8ac3-7a1648d381c1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:01.997597 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3bd988d9-51d4-4df6-8ac3-7a1648d381c1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/21361c85-1287-4754-8308-ef0f172d0e6f" status: 200 len: 1265 microversion: 2.1 time: 0.531132 Oct 04 19:08:01.998853 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3315/6611] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:01 2022] GET /compute/v2.1/servers/21361c85-1287-4754-8308-ef0f172d0e6f => generated 1265 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:03.028919 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-86335cc8-c50d-4eba-a2d3-906b458d3bdc tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:03.035457 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-86335cc8-c50d-4eba-a2d3-906b458d3bdc tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 21361c85-1287-4754-8308-ef0f172d0e6f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:03.043740 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-86335cc8-c50d-4eba-a2d3-906b458d3bdc tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:03.045109 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-86335cc8-c50d-4eba-a2d3-906b458d3bdc tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:03.045774 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-86335cc8-c50d-4eba-a2d3-906b458d3bdc tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:03.047265 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-86335cc8-c50d-4eba-a2d3-906b458d3bdc tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:03.048214 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-86335cc8-c50d-4eba-a2d3-906b458d3bdc tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:03.049718 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-86335cc8-c50d-4eba-a2d3-906b458d3bdc tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:03.436441 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-86335cc8-c50d-4eba-a2d3-906b458d3bdc tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:03.450932 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-86335cc8-c50d-4eba-a2d3-906b458d3bdc tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/21361c85-1287-4754-8308-ef0f172d0e6f" status: 200 len: 1265 microversion: 2.1 time: 0.426283 Oct 04 19:08:03.470131 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3297/6612] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:03 2022] GET /compute/v2.1/servers/21361c85-1287-4754-8308-ef0f172d0e6f => generated 1265 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:03.729812 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-193bb819-281e-4d76-a60a-eef647a9100f req-590ae029-9a4c-45a4-a610-c5b180719dd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2646dfcb-7213-4870-99eb-68311662d66b", "tag": "4060b5e6-c83b-436b-a8e4-fe4d200875b7"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:08:03.745273 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-193bb819-281e-4d76-a60a-eef647a9100f req-590ae029-9a4c-45a4-a610-c5b180719dd2 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:03.746493 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-193bb819-281e-4d76-a60a-eef647a9100f req-590ae029-9a4c-45a4-a610-c5b180719dd2 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:03.747197 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-193bb819-281e-4d76-a60a-eef647a9100f req-590ae029-9a4c-45a4-a610-c5b180719dd2 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:03.782712 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:08:03.791257 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-193bb819-281e-4d76-a60a-eef647a9100f req-590ae029-9a4c-45a4-a610-c5b180719dd2 service nova] Creating event network-changed:4060b5e6-c83b-436b-a8e4-fe4d200875b7 for instance 2646dfcb-7213-4870-99eb-68311662d66b on n-h2-850501-14 Oct 04 19:08:03.802540 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-193bb819-281e-4d76-a60a-eef647a9100f req-590ae029-9a4c-45a4-a610-c5b180719dd2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076811 Oct 04 19:08:03.805956 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3316/6613] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:08:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:08:04.482073 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-017a29ab-6d72-421b-ab57-7efc587fbd78 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:04.484409 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-017a29ab-6d72-421b-ab57-7efc587fbd78 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 21361c85-1287-4754-8308-ef0f172d0e6f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:04.497425 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-017a29ab-6d72-421b-ab57-7efc587fbd78 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:04.498289 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-017a29ab-6d72-421b-ab57-7efc587fbd78 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:04.500799 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-017a29ab-6d72-421b-ab57-7efc587fbd78 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:04.501865 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-017a29ab-6d72-421b-ab57-7efc587fbd78 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:04.502639 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-017a29ab-6d72-421b-ab57-7efc587fbd78 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:04.504121 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-017a29ab-6d72-421b-ab57-7efc587fbd78 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:05.087033 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-017a29ab-6d72-421b-ab57-7efc587fbd78 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:05.099844 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-017a29ab-6d72-421b-ab57-7efc587fbd78 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/21361c85-1287-4754-8308-ef0f172d0e6f" status: 200 len: 1265 microversion: 2.1 time: 0.622435 Oct 04 19:08:05.103017 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3298/6614] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:04 2022] GET /compute/v2.1/servers/21361c85-1287-4754-8308-ef0f172d0e6f => generated 1265 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:06.137375 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-796e1148-6782-4878-9541-bc0e07956da7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:06.139399 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-796e1148-6782-4878-9541-bc0e07956da7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 21361c85-1287-4754-8308-ef0f172d0e6f] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:06.150101 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-796e1148-6782-4878-9541-bc0e07956da7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:06.151514 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-796e1148-6782-4878-9541-bc0e07956da7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:06.152976 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-796e1148-6782-4878-9541-bc0e07956da7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:06.165934 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-796e1148-6782-4878-9541-bc0e07956da7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:06.167083 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-796e1148-6782-4878-9541-bc0e07956da7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:06.167750 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-796e1148-6782-4878-9541-bc0e07956da7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:06.638790 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-796e1148-6782-4878-9541-bc0e07956da7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:06.648752 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-796e1148-6782-4878-9541-bc0e07956da7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/21361c85-1287-4754-8308-ef0f172d0e6f" status: 200 len: 1265 microversion: 2.1 time: 0.518852 Oct 04 19:08:06.649275 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3317/6615] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:06 2022] GET /compute/v2.1/servers/21361c85-1287-4754-8308-ef0f172d0e6f => generated 1265 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:06.771482 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-d6fc3656-924b-4c81-9a92-112f626e8b06 req-73cc39e4-d7a1-4bf2-bc9c-eb60709745ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21361c85-1287-4754-8308-ef0f172d0e6f", "name": "network-vif-plugged", "status": "completed", "tag": "55c2030e-c6da-4343-934f-0ec880fa90dc"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:08:06.797533 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-d6fc3656-924b-4c81-9a92-112f626e8b06 req-73cc39e4-d7a1-4bf2-bc9c-eb60709745ec service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:06.798349 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-d6fc3656-924b-4c81-9a92-112f626e8b06 req-73cc39e4-d7a1-4bf2-bc9c-eb60709745ec service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:06.798985 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-d6fc3656-924b-4c81-9a92-112f626e8b06 req-73cc39e4-d7a1-4bf2-bc9c-eb60709745ec service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:06.817580 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-d6fc3656-924b-4c81-9a92-112f626e8b06 req-73cc39e4-d7a1-4bf2-bc9c-eb60709745ec service nova] Creating event network-vif-plugged:55c2030e-c6da-4343-934f-0ec880fa90dc for instance 21361c85-1287-4754-8308-ef0f172d0e6f on n-h2-850501-14 Oct 04 19:08:06.830165 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-d6fc3656-924b-4c81-9a92-112f626e8b06 req-73cc39e4-d7a1-4bf2-bc9c-eb60709745ec service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062175 Oct 04 19:08:06.831047 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3299/6616] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:08:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:08:07.676038 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ae67eeee-82af-437b-99a9-8b229684f0cc tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:07.677368 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ae67eeee-82af-437b-99a9-8b229684f0cc tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 21361c85-1287-4754-8308-ef0f172d0e6f] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:07.686496 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ae67eeee-82af-437b-99a9-8b229684f0cc tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:07.687092 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ae67eeee-82af-437b-99a9-8b229684f0cc tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:07.688028 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ae67eeee-82af-437b-99a9-8b229684f0cc tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:07.688998 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ae67eeee-82af-437b-99a9-8b229684f0cc tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:07.689422 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ae67eeee-82af-437b-99a9-8b229684f0cc tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:07.689814 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ae67eeee-82af-437b-99a9-8b229684f0cc tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:07.880685 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ae67eeee-82af-437b-99a9-8b229684f0cc tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:07.909348 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ae67eeee-82af-437b-99a9-8b229684f0cc tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/21361c85-1287-4754-8308-ef0f172d0e6f" status: 200 len: 1265 microversion: 2.1 time: 0.220442 Oct 04 19:08:07.910555 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3318/6617] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:07 2022] GET /compute/v2.1/servers/21361c85-1287-4754-8308-ef0f172d0e6f => generated 1265 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:08.918908 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5390c980-578c-4f85-aa9f-b4f48d218e2c tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:08.919526 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5390c980-578c-4f85-aa9f-b4f48d218e2c tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 21361c85-1287-4754-8308-ef0f172d0e6f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:08.931729 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:08:08.934131 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5390c980-578c-4f85-aa9f-b4f48d218e2c tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:08.939374 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5390c980-578c-4f85-aa9f-b4f48d218e2c tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:08.939919 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5390c980-578c-4f85-aa9f-b4f48d218e2c tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:08.940704 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5390c980-578c-4f85-aa9f-b4f48d218e2c tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:08.941359 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5390c980-578c-4f85-aa9f-b4f48d218e2c tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:08.944500 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5390c980-578c-4f85-aa9f-b4f48d218e2c tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:09.200597 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5390c980-578c-4f85-aa9f-b4f48d218e2c tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:09.217056 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5390c980-578c-4f85-aa9f-b4f48d218e2c tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/21361c85-1287-4754-8308-ef0f172d0e6f" status: 200 len: 1452 microversion: 2.1 time: 0.303498 Oct 04 19:08:09.236497 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3300/6618] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:08 2022] GET /compute/v2.1/servers/21361c85-1287-4754-8308-ef0f172d0e6f => generated 1452 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:09.241147 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2d7f6080-8271-45e2-8d93-b7b98518601b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:09.241767 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2d7f6080-8271-45e2-8d93-b7b98518601b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 21361c85-1287-4754-8308-ef0f172d0e6f] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:09.254867 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2d7f6080-8271-45e2-8d93-b7b98518601b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:09.255383 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2d7f6080-8271-45e2-8d93-b7b98518601b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:09.259339 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2d7f6080-8271-45e2-8d93-b7b98518601b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:09.259339 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2d7f6080-8271-45e2-8d93-b7b98518601b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:09.259339 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2d7f6080-8271-45e2-8d93-b7b98518601b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:09.259339 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2d7f6080-8271-45e2-8d93-b7b98518601b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:09.500219 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-2d7f6080-8271-45e2-8d93-b7b98518601b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:09.512655 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2d7f6080-8271-45e2-8d93-b7b98518601b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/21361c85-1287-4754-8308-ef0f172d0e6f" status: 200 len: 1452 microversion: 2.1 time: 0.274880 Oct 04 19:08:09.522057 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3319/6619] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:09 2022] GET /compute/v2.1/servers/21361c85-1287-4754-8308-ef0f172d0e6f => generated 1452 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:13.611859 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-5517ebb8-14c1-4d59-8235-1d084cb9b2f8 req-c25b2440-b3d0-45bb-84b1-dfa5d8fb8f7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21361c85-1287-4754-8308-ef0f172d0e6f", "tag": "55c2030e-c6da-4343-934f-0ec880fa90dc"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:08:13.631716 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-5517ebb8-14c1-4d59-8235-1d084cb9b2f8 req-c25b2440-b3d0-45bb-84b1-dfa5d8fb8f7c service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:13.634296 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-5517ebb8-14c1-4d59-8235-1d084cb9b2f8 req-c25b2440-b3d0-45bb-84b1-dfa5d8fb8f7c service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:13.635059 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-5517ebb8-14c1-4d59-8235-1d084cb9b2f8 req-c25b2440-b3d0-45bb-84b1-dfa5d8fb8f7c service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:13.658836 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-5517ebb8-14c1-4d59-8235-1d084cb9b2f8 req-c25b2440-b3d0-45bb-84b1-dfa5d8fb8f7c service nova] Creating event network-changed:55c2030e-c6da-4343-934f-0ec880fa90dc for instance 21361c85-1287-4754-8308-ef0f172d0e6f on n-h2-850501-14 Oct 04 19:08:13.664657 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-5517ebb8-14c1-4d59-8235-1d084cb9b2f8 req-c25b2440-b3d0-45bb-84b1-dfa5d8fb8f7c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056698 Oct 04 19:08:13.666123 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3301/6620] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:08:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:08:30.502134 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:08:30.503310 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=19 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:08:30.507739 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2818f7d1-0ffe-4d31-bc51-bf4e3d275e46 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Action: 'create', calling method: .version_select at 0x7fe258d92ee0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-835733101", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNTllbBJlBIElAE77tNUd+8my36XNwbSjRTkT4/1luzutiSOLrO9nHW6wq7hSoVCJT4zXOTW14Tl8GDnAQlB2YIjGeAAHTjqBQsgR+QCTJ9CRqJF+EXymJGjsncFaA8ndA=="}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:08:30.524312 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-2818f7d1-0ffe-4d31-bc51-bf4e3d275e46 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Getting quotas for project 42758fc2a182488489d9989e17beb026. Resources: {'key_pairs'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:08:30.530786 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-2818f7d1-0ffe-4d31-bc51-bf4e3d275e46 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Getting quotas for user f7f2888940414c0d9a690ad8c68b4da3 and project 42758fc2a182488489d9989e17beb026. Resources: {'key_pairs'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:08:30.645174 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2818f7d1-0ffe-4d31-bc51-bf4e3d275e46 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.144365 Oct 04 19:08:30.646325 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3320/6621] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Oct 4 19:08:30 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:08:33.931584 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a31f8197-981e-4739-b63d-f77f38b9a33e tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-2132936830", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": [{"uuid": "b1ab96ea-ef14-47ea-b5f8-6cceede20cb3"}], "key_name": "tempest-TestNetworkBasicOps-835733101", "security_groups": [{"name": "tempest-secgroup-smoke-628011278"}]}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:08:33.942496 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=3 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:08:33.943178 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=39 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:08:34.076296 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-a31f8197-981e-4739-b63d-f77f38b9a33e tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] validate_networks() for [('b1ab96ea-ef14-47ea-b5f8-6cceede20cb3', None, None, None, None, None)] {{(pid=123002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:08:34.477923 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-a31f8197-981e-4739-b63d-f77f38b9a33e tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:08:34.478373 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-a31f8197-981e-4739-b63d-f77f38b9a33e tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:08:34.478879 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-a31f8197-981e-4739-b63d-f77f38b9a33e tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:08:34.480082 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-a31f8197-981e-4739-b63d-f77f38b9a33e tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:08:34.480627 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-a31f8197-981e-4739-b63d-f77f38b9a33e tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:08:34.489836 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a31f8197-981e-4739-b63d-f77f38b9a33e tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:34.490372 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a31f8197-981e-4739-b63d-f77f38b9a33e tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:34.490866 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a31f8197-981e-4739-b63d-f77f38b9a33e tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:34.491629 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a31f8197-981e-4739-b63d-f77f38b9a33e tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:34.492127 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a31f8197-981e-4739-b63d-f77f38b9a33e tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:34.492573 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a31f8197-981e-4739-b63d-f77f38b9a33e tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:34.510147 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-a31f8197-981e-4739-b63d-f77f38b9a33e tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Getting quotas for project 42758fc2a182488489d9989e17beb026. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:08:34.515881 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-a31f8197-981e-4739-b63d-f77f38b9a33e tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Getting quotas for user f7f2888940414c0d9a690ad8c68b4da3 and project 42758fc2a182488489d9989e17beb026. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:08:34.531186 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a31f8197-981e-4739-b63d-f77f38b9a33e tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Going to run 1 instances... {{(pid=123002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:08:34.533825 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a31f8197-981e-4739-b63d-f77f38b9a33e tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] [instance: fa0d9a6f-0dbf-4a4c-9769-4b87e7a7fee2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:08:34.661116 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a31f8197-981e-4739-b63d-f77f38b9a33e tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.734383 Oct 04 19:08:34.661862 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3302/6622] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 19:08:33 2022] POST /compute/v2.1/servers => generated 405 bytes in 736 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:08:34.679636 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5b3c458b-8172-4a4f-8cd6-83e9a85c72c5 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:34.680350 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5b3c458b-8172-4a4f-8cd6-83e9a85c72c5 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] [instance: fa0d9a6f-0dbf-4a4c-9769-4b87e7a7fee2] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:34.747567 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5b3c458b-8172-4a4f-8cd6-83e9a85c72c5 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f2888940414c0d9a690ad8c68b4da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42758fc2a182488489d9989e17beb026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:34.756387 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5b3c458b-8172-4a4f-8cd6-83e9a85c72c5 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] 10.222.0.20 "GET /compute/v2.1/servers/fa0d9a6f-0dbf-4a4c-9769-4b87e7a7fee2" status: 200 len: 1248 microversion: 2.1 time: 0.086747 Oct 04 19:08:34.756959 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3321/6623] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:34 2022] GET /compute/v2.1/servers/fa0d9a6f-0dbf-4a4c-9769-4b87e7a7fee2 => generated 1248 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:35.784166 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-baad3269-ca4a-41c2-b4f6-f2e9305497a6 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:35.784678 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-baad3269-ca4a-41c2-b4f6-f2e9305497a6 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] [instance: fa0d9a6f-0dbf-4a4c-9769-4b87e7a7fee2] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:35.847696 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-baad3269-ca4a-41c2-b4f6-f2e9305497a6 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f2888940414c0d9a690ad8c68b4da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42758fc2a182488489d9989e17beb026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:35.854987 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-baad3269-ca4a-41c2-b4f6-f2e9305497a6 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] 10.222.0.20 "GET /compute/v2.1/servers/fa0d9a6f-0dbf-4a4c-9769-4b87e7a7fee2" status: 200 len: 1248 microversion: 2.1 time: 0.075020 Oct 04 19:08:35.859674 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3303/6624] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:35 2022] GET /compute/v2.1/servers/fa0d9a6f-0dbf-4a4c-9769-4b87e7a7fee2 => generated 1248 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:36.878497 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-88b7367e-bfe9-43a7-bd9e-9ffd54b311a0 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:36.879116 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-88b7367e-bfe9-43a7-bd9e-9ffd54b311a0 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] [instance: fa0d9a6f-0dbf-4a4c-9769-4b87e7a7fee2] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:36.885887 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-88b7367e-bfe9-43a7-bd9e-9ffd54b311a0 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:36.887009 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-88b7367e-bfe9-43a7-bd9e-9ffd54b311a0 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:36.887455 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-88b7367e-bfe9-43a7-bd9e-9ffd54b311a0 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:36.888189 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-88b7367e-bfe9-43a7-bd9e-9ffd54b311a0 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:36.888646 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-88b7367e-bfe9-43a7-bd9e-9ffd54b311a0 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:36.889073 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-88b7367e-bfe9-43a7-bd9e-9ffd54b311a0 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:36.955543 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-88b7367e-bfe9-43a7-bd9e-9ffd54b311a0 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f2888940414c0d9a690ad8c68b4da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42758fc2a182488489d9989e17beb026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:36.964906 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-88b7367e-bfe9-43a7-bd9e-9ffd54b311a0 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] 10.222.0.20 "GET /compute/v2.1/servers/fa0d9a6f-0dbf-4a4c-9769-4b87e7a7fee2" status: 200 len: 1300 microversion: 2.1 time: 0.089641 Oct 04 19:08:36.965506 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3322/6625] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:36 2022] GET /compute/v2.1/servers/fa0d9a6f-0dbf-4a4c-9769-4b87e7a7fee2 => generated 1300 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:37.113151 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6e3d60dd-6aaa-4a2b-842a-00614bcf5389 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1357552867", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:08:37.190400 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-6e3d60dd-6aaa-4a2b-842a-00614bcf5389 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] validate_networks() for None {{(pid=123002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:08:37.642043 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-6e3d60dd-6aaa-4a2b-842a-00614bcf5389 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:08:37.642560 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-6e3d60dd-6aaa-4a2b-842a-00614bcf5389 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:08:37.643131 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-6e3d60dd-6aaa-4a2b-842a-00614bcf5389 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:08:37.643661 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-6e3d60dd-6aaa-4a2b-842a-00614bcf5389 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:08:37.644216 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-6e3d60dd-6aaa-4a2b-842a-00614bcf5389 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:08:37.654540 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6e3d60dd-6aaa-4a2b-842a-00614bcf5389 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:37.655037 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6e3d60dd-6aaa-4a2b-842a-00614bcf5389 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:37.655846 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6e3d60dd-6aaa-4a2b-842a-00614bcf5389 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:37.656967 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6e3d60dd-6aaa-4a2b-842a-00614bcf5389 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:37.657465 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6e3d60dd-6aaa-4a2b-842a-00614bcf5389 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:37.657903 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6e3d60dd-6aaa-4a2b-842a-00614bcf5389 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:37.676704 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-6e3d60dd-6aaa-4a2b-842a-00614bcf5389 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Getting quotas for project 690445b26ca34431a4cff2f36c27761a. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:08:37.681789 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-6e3d60dd-6aaa-4a2b-842a-00614bcf5389 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Getting quotas for user 98f0388fd33143e6a6cc877ca44eeaa1 and project 690445b26ca34431a4cff2f36c27761a. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:08:37.694460 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-6e3d60dd-6aaa-4a2b-842a-00614bcf5389 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Going to run 1 instances... {{(pid=123002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:08:37.696692 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-6e3d60dd-6aaa-4a2b-842a-00614bcf5389 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] [instance: 42ffef31-9221-4d0a-9bf9-e89d24ce8229] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:08:37.843765 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6e3d60dd-6aaa-4a2b-842a-00614bcf5389 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.733994 Oct 04 19:08:37.852601 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3304/6626] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 19:08:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 744 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:08:37.859896 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b6c507f0-9ccb-49b3-8087-ec7fa33b1b92 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:37.861001 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b6c507f0-9ccb-49b3-8087-ec7fa33b1b92 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] [instance: 42ffef31-9221-4d0a-9bf9-e89d24ce8229] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:37.959730 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b6c507f0-9ccb-49b3-8087-ec7fa33b1b92 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f0388fd33143e6a6cc877ca44eeaa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690445b26ca34431a4cff2f36c27761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:37.975166 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b6c507f0-9ccb-49b3-8087-ec7fa33b1b92 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] 10.222.0.20 "GET /compute/v2.1/servers/42ffef31-9221-4d0a-9bf9-e89d24ce8229" status: 200 len: 1215 microversion: 2.1 time: 0.120036 Oct 04 19:08:37.982342 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3323/6627] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:37 2022] GET /compute/v2.1/servers/42ffef31-9221-4d0a-9bf9-e89d24ce8229 => generated 1215 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:37.995109 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-33b25e11-34ad-48de-bcd9-5ec9a69a6253 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:37.997592 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-33b25e11-34ad-48de-bcd9-5ec9a69a6253 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] [instance: fa0d9a6f-0dbf-4a4c-9769-4b87e7a7fee2] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:38.013112 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-33b25e11-34ad-48de-bcd9-5ec9a69a6253 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:38.013637 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-33b25e11-34ad-48de-bcd9-5ec9a69a6253 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:38.014296 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-33b25e11-34ad-48de-bcd9-5ec9a69a6253 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:38.015606 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-33b25e11-34ad-48de-bcd9-5ec9a69a6253 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:38.016703 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-33b25e11-34ad-48de-bcd9-5ec9a69a6253 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:38.017840 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-33b25e11-34ad-48de-bcd9-5ec9a69a6253 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:38.359916 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-33b25e11-34ad-48de-bcd9-5ec9a69a6253 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f2888940414c0d9a690ad8c68b4da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42758fc2a182488489d9989e17beb026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:38.368891 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-33b25e11-34ad-48de-bcd9-5ec9a69a6253 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] 10.222.0.20 "GET /compute/v2.1/servers/fa0d9a6f-0dbf-4a4c-9769-4b87e7a7fee2" status: 200 len: 1306 microversion: 2.1 time: 0.378136 Oct 04 19:08:38.369753 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3305/6628] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:37 2022] GET /compute/v2.1/servers/fa0d9a6f-0dbf-4a4c-9769-4b87e7a7fee2 => generated 1306 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:38.999570 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-63e6019d-51f0-425d-ad9a-e828fb8a5ddd tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:39.000252 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-63e6019d-51f0-425d-ad9a-e828fb8a5ddd tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] [instance: 42ffef31-9221-4d0a-9bf9-e89d24ce8229] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:39.078013 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-63e6019d-51f0-425d-ad9a-e828fb8a5ddd tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f0388fd33143e6a6cc877ca44eeaa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690445b26ca34431a4cff2f36c27761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:39.085590 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-63e6019d-51f0-425d-ad9a-e828fb8a5ddd tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] 10.222.0.20 "GET /compute/v2.1/servers/42ffef31-9221-4d0a-9bf9-e89d24ce8229" status: 200 len: 1215 microversion: 2.1 time: 0.090438 Oct 04 19:08:39.086171 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3324/6629] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:38 2022] GET /compute/v2.1/servers/42ffef31-9221-4d0a-9bf9-e89d24ce8229 => generated 1215 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:39.392916 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-72ec9b03-d3fa-4bf3-bd17-8b4422871980 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:39.393561 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-72ec9b03-d3fa-4bf3-bd17-8b4422871980 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] [instance: fa0d9a6f-0dbf-4a4c-9769-4b87e7a7fee2] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:39.400584 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-72ec9b03-d3fa-4bf3-bd17-8b4422871980 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:39.401091 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-72ec9b03-d3fa-4bf3-bd17-8b4422871980 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:39.402298 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-72ec9b03-d3fa-4bf3-bd17-8b4422871980 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:39.403018 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-72ec9b03-d3fa-4bf3-bd17-8b4422871980 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:39.403533 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-72ec9b03-d3fa-4bf3-bd17-8b4422871980 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:39.409557 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-72ec9b03-d3fa-4bf3-bd17-8b4422871980 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:39.647594 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-72ec9b03-d3fa-4bf3-bd17-8b4422871980 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f2888940414c0d9a690ad8c68b4da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42758fc2a182488489d9989e17beb026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:39.656378 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-72ec9b03-d3fa-4bf3-bd17-8b4422871980 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] 10.222.0.20 "GET /compute/v2.1/servers/fa0d9a6f-0dbf-4a4c-9769-4b87e7a7fee2" status: 200 len: 1373 microversion: 2.1 time: 0.267300 Oct 04 19:08:39.657221 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3306/6630] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:39 2022] GET /compute/v2.1/servers/fa0d9a6f-0dbf-4a4c-9769-4b87e7a7fee2 => generated 1373 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:40.084100 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-58375a0a-1cbe-4e5c-814c-d5516dc4e79e req-ee78b36c-ffcc-440a-bcc4-76cebc603399 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa0d9a6f-0dbf-4a4c-9769-4b87e7a7fee2", "tag": "ea09e1e6-c143-479c-a9c1-7631b3033288"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:08:40.098904 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-58375a0a-1cbe-4e5c-814c-d5516dc4e79e req-ee78b36c-ffcc-440a-bcc4-76cebc603399 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:40.099817 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-58375a0a-1cbe-4e5c-814c-d5516dc4e79e req-ee78b36c-ffcc-440a-bcc4-76cebc603399 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:40.099933 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-58375a0a-1cbe-4e5c-814c-d5516dc4e79e req-ee78b36c-ffcc-440a-bcc4-76cebc603399 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:40.109760 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0d74238f-ed86-4dd7-852a-ce365b60baf2 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:40.110680 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0d74238f-ed86-4dd7-852a-ce365b60baf2 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] [instance: 42ffef31-9221-4d0a-9bf9-e89d24ce8229] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:40.114110 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-58375a0a-1cbe-4e5c-814c-d5516dc4e79e req-ee78b36c-ffcc-440a-bcc4-76cebc603399 service nova] Creating event network-changed:ea09e1e6-c143-479c-a9c1-7631b3033288 for instance fa0d9a6f-0dbf-4a4c-9769-4b87e7a7fee2 on n-h1-850501-14 Oct 04 19:08:40.118925 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0d74238f-ed86-4dd7-852a-ce365b60baf2 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:40.119677 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-58375a0a-1cbe-4e5c-814c-d5516dc4e79e req-ee78b36c-ffcc-440a-bcc4-76cebc603399 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.193866 Oct 04 19:08:40.120084 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0d74238f-ed86-4dd7-852a-ce365b60baf2 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:40.121183 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3325/6631] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:08:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:08:40.121386 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0d74238f-ed86-4dd7-852a-ce365b60baf2 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:40.122466 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0d74238f-ed86-4dd7-852a-ce365b60baf2 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:40.123469 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0d74238f-ed86-4dd7-852a-ce365b60baf2 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:40.123933 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0d74238f-ed86-4dd7-852a-ce365b60baf2 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:40.195129 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0d74238f-ed86-4dd7-852a-ce365b60baf2 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f0388fd33143e6a6cc877ca44eeaa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690445b26ca34431a4cff2f36c27761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:40.203263 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0d74238f-ed86-4dd7-852a-ce365b60baf2 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] 10.222.0.20 "GET /compute/v2.1/servers/42ffef31-9221-4d0a-9bf9-e89d24ce8229" status: 200 len: 1267 microversion: 2.1 time: 0.099531 Oct 04 19:08:40.204019 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3307/6632] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:40 2022] GET /compute/v2.1/servers/42ffef31-9221-4d0a-9bf9-e89d24ce8229 => generated 1267 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:08:40.682898 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6e3d9128-f012-492a-b044-00f6f61f947f tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:40.683945 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6e3d9128-f012-492a-b044-00f6f61f947f tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] [instance: fa0d9a6f-0dbf-4a4c-9769-4b87e7a7fee2] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:40.690638 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6e3d9128-f012-492a-b044-00f6f61f947f tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:40.691132 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6e3d9128-f012-492a-b044-00f6f61f947f tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:40.691575 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6e3d9128-f012-492a-b044-00f6f61f947f tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:40.692314 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6e3d9128-f012-492a-b044-00f6f61f947f tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:40.692777 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6e3d9128-f012-492a-b044-00f6f61f947f tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:40.693206 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6e3d9128-f012-492a-b044-00f6f61f947f tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:40.875607 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6e3d9128-f012-492a-b044-00f6f61f947f tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f2888940414c0d9a690ad8c68b4da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42758fc2a182488489d9989e17beb026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:40.887132 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6e3d9128-f012-492a-b044-00f6f61f947f tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] 10.222.0.20 "GET /compute/v2.1/servers/fa0d9a6f-0dbf-4a4c-9769-4b87e7a7fee2" status: 200 len: 1373 microversion: 2.1 time: 0.208417 Oct 04 19:08:40.888874 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3326/6633] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:40 2022] GET /compute/v2.1/servers/fa0d9a6f-0dbf-4a4c-9769-4b87e7a7fee2 => generated 1373 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:41.231302 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-658b0cd9-6f3a-4bf9-be11-b1292d9f22e0 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:41.232359 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-658b0cd9-6f3a-4bf9-be11-b1292d9f22e0 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] [instance: 42ffef31-9221-4d0a-9bf9-e89d24ce8229] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:41.240633 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-658b0cd9-6f3a-4bf9-be11-b1292d9f22e0 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:41.241209 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-658b0cd9-6f3a-4bf9-be11-b1292d9f22e0 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:41.241733 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-658b0cd9-6f3a-4bf9-be11-b1292d9f22e0 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:41.243012 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-658b0cd9-6f3a-4bf9-be11-b1292d9f22e0 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:41.243906 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-658b0cd9-6f3a-4bf9-be11-b1292d9f22e0 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:41.244402 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-658b0cd9-6f3a-4bf9-be11-b1292d9f22e0 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:41.315431 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-658b0cd9-6f3a-4bf9-be11-b1292d9f22e0 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f0388fd33143e6a6cc877ca44eeaa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690445b26ca34431a4cff2f36c27761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:41.324324 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-658b0cd9-6f3a-4bf9-be11-b1292d9f22e0 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] 10.222.0.20 "GET /compute/v2.1/servers/42ffef31-9221-4d0a-9bf9-e89d24ce8229" status: 200 len: 1273 microversion: 2.1 time: 0.100425 Oct 04 19:08:41.324920 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3308/6634] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:41 2022] GET /compute/v2.1/servers/42ffef31-9221-4d0a-9bf9-e89d24ce8229 => generated 1273 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:41.911423 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c75293f1-c0e1-45d1-b617-3a96100a1a90 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:41.912383 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c75293f1-c0e1-45d1-b617-3a96100a1a90 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] [instance: fa0d9a6f-0dbf-4a4c-9769-4b87e7a7fee2] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:41.923924 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c75293f1-c0e1-45d1-b617-3a96100a1a90 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:41.925246 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c75293f1-c0e1-45d1-b617-3a96100a1a90 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:41.925710 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c75293f1-c0e1-45d1-b617-3a96100a1a90 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:41.926535 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c75293f1-c0e1-45d1-b617-3a96100a1a90 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:41.927217 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c75293f1-c0e1-45d1-b617-3a96100a1a90 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:41.927864 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c75293f1-c0e1-45d1-b617-3a96100a1a90 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:42.085492 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c75293f1-c0e1-45d1-b617-3a96100a1a90 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f2888940414c0d9a690ad8c68b4da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42758fc2a182488489d9989e17beb026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:42.094762 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c75293f1-c0e1-45d1-b617-3a96100a1a90 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] 10.222.0.20 "GET /compute/v2.1/servers/fa0d9a6f-0dbf-4a4c-9769-4b87e7a7fee2" status: 200 len: 1373 microversion: 2.1 time: 0.187735 Oct 04 19:08:42.095517 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3327/6635] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:41 2022] GET /compute/v2.1/servers/fa0d9a6f-0dbf-4a4c-9769-4b87e7a7fee2 => generated 1373 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:42.355716 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-676b288a-3111-4692-bd8d-49d51aad79cb tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:42.357214 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-676b288a-3111-4692-bd8d-49d51aad79cb tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] [instance: 42ffef31-9221-4d0a-9bf9-e89d24ce8229] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:42.364374 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-676b288a-3111-4692-bd8d-49d51aad79cb tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:42.365115 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-676b288a-3111-4692-bd8d-49d51aad79cb tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:42.365904 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-676b288a-3111-4692-bd8d-49d51aad79cb tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:42.366630 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-676b288a-3111-4692-bd8d-49d51aad79cb tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:42.367246 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-676b288a-3111-4692-bd8d-49d51aad79cb tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:42.367699 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-676b288a-3111-4692-bd8d-49d51aad79cb tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:42.518389 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-676b288a-3111-4692-bd8d-49d51aad79cb tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f0388fd33143e6a6cc877ca44eeaa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690445b26ca34431a4cff2f36c27761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:42.527531 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-676b288a-3111-4692-bd8d-49d51aad79cb tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] 10.222.0.20 "GET /compute/v2.1/servers/42ffef31-9221-4d0a-9bf9-e89d24ce8229" status: 200 len: 1315 microversion: 2.1 time: 0.177754 Oct 04 19:08:42.536151 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3309/6636] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:42 2022] GET /compute/v2.1/servers/42ffef31-9221-4d0a-9bf9-e89d24ce8229 => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:42.868406 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-dd5e0b7d-30d1-46a1-86b7-ed3ebe774eeb req-e6c27eb7-2ea9-4b77-9b18-ef4b84fbdf5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42ffef31-9221-4d0a-9bf9-e89d24ce8229", "tag": "494ff9d7-d818-4edd-90d8-ef313dcd3d37"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:08:42.880818 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-dd5e0b7d-30d1-46a1-86b7-ed3ebe774eeb req-e6c27eb7-2ea9-4b77-9b18-ef4b84fbdf5f service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:42.881404 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-dd5e0b7d-30d1-46a1-86b7-ed3ebe774eeb req-e6c27eb7-2ea9-4b77-9b18-ef4b84fbdf5f service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:42.881912 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-dd5e0b7d-30d1-46a1-86b7-ed3ebe774eeb req-e6c27eb7-2ea9-4b77-9b18-ef4b84fbdf5f service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:42.895325 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-dd5e0b7d-30d1-46a1-86b7-ed3ebe774eeb req-e6c27eb7-2ea9-4b77-9b18-ef4b84fbdf5f service nova] Creating event network-changed:494ff9d7-d818-4edd-90d8-ef313dcd3d37 for instance 42ffef31-9221-4d0a-9bf9-e89d24ce8229 on n-h2-850501-14 Oct 04 19:08:42.901066 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-dd5e0b7d-30d1-46a1-86b7-ed3ebe774eeb req-e6c27eb7-2ea9-4b77-9b18-ef4b84fbdf5f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038940 Oct 04 19:08:42.901795 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3328/6637] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:08:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:08:43.119173 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f97675ea-9a07-4e9d-acc3-5d7c43294c34 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:43.119988 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f97675ea-9a07-4e9d-acc3-5d7c43294c34 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] [instance: fa0d9a6f-0dbf-4a4c-9769-4b87e7a7fee2] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:43.127535 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f97675ea-9a07-4e9d-acc3-5d7c43294c34 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:43.128278 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f97675ea-9a07-4e9d-acc3-5d7c43294c34 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:43.128742 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f97675ea-9a07-4e9d-acc3-5d7c43294c34 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:43.129477 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f97675ea-9a07-4e9d-acc3-5d7c43294c34 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:43.129949 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f97675ea-9a07-4e9d-acc3-5d7c43294c34 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:43.130664 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f97675ea-9a07-4e9d-acc3-5d7c43294c34 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:43.287249 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f97675ea-9a07-4e9d-acc3-5d7c43294c34 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f2888940414c0d9a690ad8c68b4da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42758fc2a182488489d9989e17beb026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:43.297038 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f97675ea-9a07-4e9d-acc3-5d7c43294c34 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] 10.222.0.20 "GET /compute/v2.1/servers/fa0d9a6f-0dbf-4a4c-9769-4b87e7a7fee2" status: 200 len: 1373 microversion: 2.1 time: 0.181875 Oct 04 19:08:43.297644 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3310/6638] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:43 2022] GET /compute/v2.1/servers/fa0d9a6f-0dbf-4a4c-9769-4b87e7a7fee2 => generated 1373 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:43.553477 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6bc8e88a-0656-440d-9246-1e42a96934fc tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:43.554422 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6bc8e88a-0656-440d-9246-1e42a96934fc tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] [instance: 42ffef31-9221-4d0a-9bf9-e89d24ce8229] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:43.561642 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6bc8e88a-0656-440d-9246-1e42a96934fc tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:43.562268 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6bc8e88a-0656-440d-9246-1e42a96934fc tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:43.562967 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6bc8e88a-0656-440d-9246-1e42a96934fc tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:43.563802 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6bc8e88a-0656-440d-9246-1e42a96934fc tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:43.564532 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6bc8e88a-0656-440d-9246-1e42a96934fc tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:43.567256 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6bc8e88a-0656-440d-9246-1e42a96934fc tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:43.742583 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6bc8e88a-0656-440d-9246-1e42a96934fc tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f0388fd33143e6a6cc877ca44eeaa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690445b26ca34431a4cff2f36c27761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:43.751193 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6bc8e88a-0656-440d-9246-1e42a96934fc tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] 10.222.0.20 "GET /compute/v2.1/servers/42ffef31-9221-4d0a-9bf9-e89d24ce8229" status: 200 len: 1315 microversion: 2.1 time: 0.203779 Oct 04 19:08:43.751983 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3329/6639] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:43 2022] GET /compute/v2.1/servers/42ffef31-9221-4d0a-9bf9-e89d24ce8229 => generated 1315 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:44.322725 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8530e05c-12ef-414d-a65e-01303690a7a4 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:44.323476 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8530e05c-12ef-414d-a65e-01303690a7a4 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] [instance: fa0d9a6f-0dbf-4a4c-9769-4b87e7a7fee2] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:44.331817 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8530e05c-12ef-414d-a65e-01303690a7a4 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:44.332301 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8530e05c-12ef-414d-a65e-01303690a7a4 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:44.332757 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8530e05c-12ef-414d-a65e-01303690a7a4 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:44.337859 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8530e05c-12ef-414d-a65e-01303690a7a4 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:44.337859 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8530e05c-12ef-414d-a65e-01303690a7a4 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:44.337859 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8530e05c-12ef-414d-a65e-01303690a7a4 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:44.482958 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8530e05c-12ef-414d-a65e-01303690a7a4 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f2888940414c0d9a690ad8c68b4da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42758fc2a182488489d9989e17beb026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:44.491076 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8530e05c-12ef-414d-a65e-01303690a7a4 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] 10.222.0.20 "GET /compute/v2.1/servers/fa0d9a6f-0dbf-4a4c-9769-4b87e7a7fee2" status: 200 len: 1373 microversion: 2.1 time: 0.172224 Oct 04 19:08:44.491655 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3311/6640] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:44 2022] GET /compute/v2.1/servers/fa0d9a6f-0dbf-4a4c-9769-4b87e7a7fee2 => generated 1373 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:44.775060 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b0ab0b52-de9c-4a54-add7-bbb994187bf2 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:44.782956 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b0ab0b52-de9c-4a54-add7-bbb994187bf2 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] [instance: 42ffef31-9221-4d0a-9bf9-e89d24ce8229] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:44.782956 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b0ab0b52-de9c-4a54-add7-bbb994187bf2 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:44.783155 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b0ab0b52-de9c-4a54-add7-bbb994187bf2 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:44.783521 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b0ab0b52-de9c-4a54-add7-bbb994187bf2 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:44.784276 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b0ab0b52-de9c-4a54-add7-bbb994187bf2 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:44.784726 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b0ab0b52-de9c-4a54-add7-bbb994187bf2 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:44.785148 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b0ab0b52-de9c-4a54-add7-bbb994187bf2 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:44.950570 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b0ab0b52-de9c-4a54-add7-bbb994187bf2 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f0388fd33143e6a6cc877ca44eeaa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690445b26ca34431a4cff2f36c27761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:44.958558 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b0ab0b52-de9c-4a54-add7-bbb994187bf2 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] 10.222.0.20 "GET /compute/v2.1/servers/42ffef31-9221-4d0a-9bf9-e89d24ce8229" status: 200 len: 1315 microversion: 2.1 time: 0.187493 Oct 04 19:08:44.959132 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3330/6641] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:44 2022] GET /compute/v2.1/servers/42ffef31-9221-4d0a-9bf9-e89d24ce8229 => generated 1315 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:45.512419 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-1acc17e7-ac8b-4dc3-98f8-5e5e7c2bfa44 req-dd85948d-3184-4f26-8ef8-0b447ab502dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa0d9a6f-0dbf-4a4c-9769-4b87e7a7fee2", "name": "network-vif-plugged", "status": "completed", "tag": "ea09e1e6-c143-479c-a9c1-7631b3033288"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:08:45.514452 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-bdd14166-d6a3-404a-b03b-4da744216e28 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:45.515201 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-bdd14166-d6a3-404a-b03b-4da744216e28 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] [instance: fa0d9a6f-0dbf-4a4c-9769-4b87e7a7fee2] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:45.521592 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bdd14166-d6a3-404a-b03b-4da744216e28 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:45.522239 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bdd14166-d6a3-404a-b03b-4da744216e28 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:45.522694 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bdd14166-d6a3-404a-b03b-4da744216e28 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:45.523483 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bdd14166-d6a3-404a-b03b-4da744216e28 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:45.523944 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bdd14166-d6a3-404a-b03b-4da744216e28 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:45.524412 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bdd14166-d6a3-404a-b03b-4da744216e28 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:45.524646 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-1acc17e7-ac8b-4dc3-98f8-5e5e7c2bfa44 req-dd85948d-3184-4f26-8ef8-0b447ab502dd service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:45.525153 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-1acc17e7-ac8b-4dc3-98f8-5e5e7c2bfa44 req-dd85948d-3184-4f26-8ef8-0b447ab502dd service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:45.525605 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-1acc17e7-ac8b-4dc3-98f8-5e5e7c2bfa44 req-dd85948d-3184-4f26-8ef8-0b447ab502dd service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:45.540620 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-1acc17e7-ac8b-4dc3-98f8-5e5e7c2bfa44 req-dd85948d-3184-4f26-8ef8-0b447ab502dd service nova] Creating event network-vif-plugged:ea09e1e6-c143-479c-a9c1-7631b3033288 for instance fa0d9a6f-0dbf-4a4c-9769-4b87e7a7fee2 on n-h1-850501-14 Oct 04 19:08:45.545833 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-1acc17e7-ac8b-4dc3-98f8-5e5e7c2bfa44 req-dd85948d-3184-4f26-8ef8-0b447ab502dd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038970 Oct 04 19:08:45.546613 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3312/6642] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:08:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:08:45.742724 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-bdd14166-d6a3-404a-b03b-4da744216e28 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f2888940414c0d9a690ad8c68b4da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42758fc2a182488489d9989e17beb026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:45.757386 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-bdd14166-d6a3-404a-b03b-4da744216e28 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] 10.222.0.20 "GET /compute/v2.1/servers/fa0d9a6f-0dbf-4a4c-9769-4b87e7a7fee2" status: 200 len: 1373 microversion: 2.1 time: 0.247309 Oct 04 19:08:45.758076 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3331/6643] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:45 2022] GET /compute/v2.1/servers/fa0d9a6f-0dbf-4a4c-9769-4b87e7a7fee2 => generated 1373 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:08:45.989854 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-59d618d8-6af0-4087-a72e-2ee52ab7861c tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:45.990578 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-59d618d8-6af0-4087-a72e-2ee52ab7861c tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] [instance: 42ffef31-9221-4d0a-9bf9-e89d24ce8229] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:46.002774 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-59d618d8-6af0-4087-a72e-2ee52ab7861c tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:46.004579 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-59d618d8-6af0-4087-a72e-2ee52ab7861c tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:46.004579 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-59d618d8-6af0-4087-a72e-2ee52ab7861c tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:46.004579 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-59d618d8-6af0-4087-a72e-2ee52ab7861c tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:46.004980 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-59d618d8-6af0-4087-a72e-2ee52ab7861c tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:46.005416 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-59d618d8-6af0-4087-a72e-2ee52ab7861c tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:46.170143 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-59d618d8-6af0-4087-a72e-2ee52ab7861c tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f0388fd33143e6a6cc877ca44eeaa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690445b26ca34431a4cff2f36c27761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:46.177933 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-59d618d8-6af0-4087-a72e-2ee52ab7861c tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] 10.222.0.20 "GET /compute/v2.1/servers/42ffef31-9221-4d0a-9bf9-e89d24ce8229" status: 200 len: 1315 microversion: 2.1 time: 0.199892 Oct 04 19:08:46.178518 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3313/6644] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:45 2022] GET /compute/v2.1/servers/42ffef31-9221-4d0a-9bf9-e89d24ce8229 => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:08:46.781844 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-40ad7eeb-821b-4bd6-b36d-eaad1c596420 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:46.786472 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-40ad7eeb-821b-4bd6-b36d-eaad1c596420 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] [instance: fa0d9a6f-0dbf-4a4c-9769-4b87e7a7fee2] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:46.799019 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-40ad7eeb-821b-4bd6-b36d-eaad1c596420 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:46.799532 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-40ad7eeb-821b-4bd6-b36d-eaad1c596420 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:46.799979 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-40ad7eeb-821b-4bd6-b36d-eaad1c596420 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:46.800728 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-40ad7eeb-821b-4bd6-b36d-eaad1c596420 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:46.801195 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-40ad7eeb-821b-4bd6-b36d-eaad1c596420 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:46.801632 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-40ad7eeb-821b-4bd6-b36d-eaad1c596420 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:46.952995 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-40ad7eeb-821b-4bd6-b36d-eaad1c596420 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f2888940414c0d9a690ad8c68b4da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42758fc2a182488489d9989e17beb026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:46.961948 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-40ad7eeb-821b-4bd6-b36d-eaad1c596420 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] 10.222.0.20 "GET /compute/v2.1/servers/fa0d9a6f-0dbf-4a4c-9769-4b87e7a7fee2" status: 200 len: 1373 microversion: 2.1 time: 0.184144 Oct 04 19:08:46.962530 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3332/6645] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:46 2022] GET /compute/v2.1/servers/fa0d9a6f-0dbf-4a4c-9769-4b87e7a7fee2 => generated 1373 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:47.201107 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5d5b6ae6-2b1f-4c96-89aa-b89e390a00b9 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:47.201843 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5d5b6ae6-2b1f-4c96-89aa-b89e390a00b9 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] [instance: 42ffef31-9221-4d0a-9bf9-e89d24ce8229] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:47.209478 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5d5b6ae6-2b1f-4c96-89aa-b89e390a00b9 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:47.209984 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5d5b6ae6-2b1f-4c96-89aa-b89e390a00b9 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:47.210438 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5d5b6ae6-2b1f-4c96-89aa-b89e390a00b9 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:47.211158 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5d5b6ae6-2b1f-4c96-89aa-b89e390a00b9 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:47.211630 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5d5b6ae6-2b1f-4c96-89aa-b89e390a00b9 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:47.212097 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5d5b6ae6-2b1f-4c96-89aa-b89e390a00b9 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:47.356336 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5d5b6ae6-2b1f-4c96-89aa-b89e390a00b9 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f0388fd33143e6a6cc877ca44eeaa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690445b26ca34431a4cff2f36c27761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:47.364874 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5d5b6ae6-2b1f-4c96-89aa-b89e390a00b9 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] 10.222.0.20 "GET /compute/v2.1/servers/42ffef31-9221-4d0a-9bf9-e89d24ce8229" status: 200 len: 1315 microversion: 2.1 time: 0.168571 Oct 04 19:08:47.365463 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3314/6646] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:47 2022] GET /compute/v2.1/servers/42ffef31-9221-4d0a-9bf9-e89d24ce8229 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:47.984107 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f040a89e-81c0-491e-a7ce-150e3acd4e20 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:47.985075 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f040a89e-81c0-491e-a7ce-150e3acd4e20 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] [instance: fa0d9a6f-0dbf-4a4c-9769-4b87e7a7fee2] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:47.994042 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f040a89e-81c0-491e-a7ce-150e3acd4e20 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:47.994042 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f040a89e-81c0-491e-a7ce-150e3acd4e20 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:47.994042 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f040a89e-81c0-491e-a7ce-150e3acd4e20 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:47.994042 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f040a89e-81c0-491e-a7ce-150e3acd4e20 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:47.994434 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f040a89e-81c0-491e-a7ce-150e3acd4e20 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:47.994882 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f040a89e-81c0-491e-a7ce-150e3acd4e20 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:48.148043 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f040a89e-81c0-491e-a7ce-150e3acd4e20 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f2888940414c0d9a690ad8c68b4da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42758fc2a182488489d9989e17beb026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:48.159558 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f040a89e-81c0-491e-a7ce-150e3acd4e20 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] 10.222.0.20 "GET /compute/v2.1/servers/fa0d9a6f-0dbf-4a4c-9769-4b87e7a7fee2" status: 200 len: 1546 microversion: 2.1 time: 0.179383 Oct 04 19:08:48.160303 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3333/6647] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:47 2022] GET /compute/v2.1/servers/fa0d9a6f-0dbf-4a4c-9769-4b87e7a7fee2 => generated 1546 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:48.190250 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-91da68b9-979d-4bdb-b9c4-473e5491f736 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:48.191204 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-91da68b9-979d-4bdb-b9c4-473e5491f736 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] [instance: fa0d9a6f-0dbf-4a4c-9769-4b87e7a7fee2] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:48.193244 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=4 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:08:48.193965 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=14 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:08:48.199287 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-91da68b9-979d-4bdb-b9c4-473e5491f736 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:48.199800 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-91da68b9-979d-4bdb-b9c4-473e5491f736 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:48.200301 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-91da68b9-979d-4bdb-b9c4-473e5491f736 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:48.201032 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-91da68b9-979d-4bdb-b9c4-473e5491f736 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:48.201521 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-91da68b9-979d-4bdb-b9c4-473e5491f736 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:48.202068 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-91da68b9-979d-4bdb-b9c4-473e5491f736 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:48.346585 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-91da68b9-979d-4bdb-b9c4-473e5491f736 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f2888940414c0d9a690ad8c68b4da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42758fc2a182488489d9989e17beb026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:48.354588 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-91da68b9-979d-4bdb-b9c4-473e5491f736 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] 10.222.0.20 "GET /compute/v2.1/servers/fa0d9a6f-0dbf-4a4c-9769-4b87e7a7fee2" status: 200 len: 1546 microversion: 2.1 time: 0.175873 Oct 04 19:08:48.355968 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3315/6648] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:48 2022] GET /compute/v2.1/servers/fa0d9a6f-0dbf-4a4c-9769-4b87e7a7fee2 => generated 1546 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:48.390119 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-abe60e9d-ed63-4e17-b92d-0ae6e389f715 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:48.391425 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-abe60e9d-ed63-4e17-b92d-0ae6e389f715 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] [instance: 42ffef31-9221-4d0a-9bf9-e89d24ce8229] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:48.398044 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-abe60e9d-ed63-4e17-b92d-0ae6e389f715 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:48.404860 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-abe60e9d-ed63-4e17-b92d-0ae6e389f715 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:48.404860 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-abe60e9d-ed63-4e17-b92d-0ae6e389f715 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:48.404860 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-abe60e9d-ed63-4e17-b92d-0ae6e389f715 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:48.404860 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-abe60e9d-ed63-4e17-b92d-0ae6e389f715 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:48.404860 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-abe60e9d-ed63-4e17-b92d-0ae6e389f715 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:48.415984 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-a18a5d7c-3087-4e29-bc2d-cca6c6719196 req-83d0f8f2-0fea-4b18-81a1-fbb4f39d8ff8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42ffef31-9221-4d0a-9bf9-e89d24ce8229", "name": "network-vif-plugged", "status": "completed", "tag": "494ff9d7-d818-4edd-90d8-ef313dcd3d37"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:08:48.436486 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-a18a5d7c-3087-4e29-bc2d-cca6c6719196 req-83d0f8f2-0fea-4b18-81a1-fbb4f39d8ff8 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:48.437280 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-a18a5d7c-3087-4e29-bc2d-cca6c6719196 req-83d0f8f2-0fea-4b18-81a1-fbb4f39d8ff8 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:48.438141 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-a18a5d7c-3087-4e29-bc2d-cca6c6719196 req-83d0f8f2-0fea-4b18-81a1-fbb4f39d8ff8 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:48.451157 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-a18a5d7c-3087-4e29-bc2d-cca6c6719196 req-83d0f8f2-0fea-4b18-81a1-fbb4f39d8ff8 service nova] Creating event network-vif-plugged:494ff9d7-d818-4edd-90d8-ef313dcd3d37 for instance 42ffef31-9221-4d0a-9bf9-e89d24ce8229 on n-h2-850501-14 Oct 04 19:08:48.458110 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-a18a5d7c-3087-4e29-bc2d-cca6c6719196 req-83d0f8f2-0fea-4b18-81a1-fbb4f39d8ff8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044691 Oct 04 19:08:48.462580 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3316/6649] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:08:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:08:48.570736 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-abe60e9d-ed63-4e17-b92d-0ae6e389f715 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f0388fd33143e6a6cc877ca44eeaa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690445b26ca34431a4cff2f36c27761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:48.578868 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-abe60e9d-ed63-4e17-b92d-0ae6e389f715 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] 10.222.0.20 "GET /compute/v2.1/servers/42ffef31-9221-4d0a-9bf9-e89d24ce8229" status: 200 len: 1315 microversion: 2.1 time: 0.193915 Oct 04 19:08:48.579807 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3334/6650] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:48 2022] GET /compute/v2.1/servers/42ffef31-9221-4d0a-9bf9-e89d24ce8229 => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:49.606634 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b8439e6d-1650-4528-a4d3-0b6e17cac092 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:49.607546 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b8439e6d-1650-4528-a4d3-0b6e17cac092 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] [instance: 42ffef31-9221-4d0a-9bf9-e89d24ce8229] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:49.614964 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b8439e6d-1650-4528-a4d3-0b6e17cac092 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:49.615659 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b8439e6d-1650-4528-a4d3-0b6e17cac092 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:49.616206 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b8439e6d-1650-4528-a4d3-0b6e17cac092 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:49.617004 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b8439e6d-1650-4528-a4d3-0b6e17cac092 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:49.617532 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b8439e6d-1650-4528-a4d3-0b6e17cac092 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:49.618035 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b8439e6d-1650-4528-a4d3-0b6e17cac092 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:49.835388 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b8439e6d-1650-4528-a4d3-0b6e17cac092 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f0388fd33143e6a6cc877ca44eeaa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690445b26ca34431a4cff2f36c27761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:49.845222 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b8439e6d-1650-4528-a4d3-0b6e17cac092 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] 10.222.0.20 "GET /compute/v2.1/servers/42ffef31-9221-4d0a-9bf9-e89d24ce8229" status: 200 len: 1315 microversion: 2.1 time: 0.245574 Oct 04 19:08:49.847198 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3317/6651] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:49 2022] GET /compute/v2.1/servers/42ffef31-9221-4d0a-9bf9-e89d24ce8229 => generated 1315 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:50.841857 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-61af7895-c26d-43c1-8189-3331448346db req-1979595f-dd4f-4a7f-b19d-052590a8778c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa0d9a6f-0dbf-4a4c-9769-4b87e7a7fee2", "tag": "ea09e1e6-c143-479c-a9c1-7631b3033288"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:08:50.848810 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=10 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:08:50.855081 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-61af7895-c26d-43c1-8189-3331448346db req-1979595f-dd4f-4a7f-b19d-052590a8778c service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:50.863847 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-61af7895-c26d-43c1-8189-3331448346db req-1979595f-dd4f-4a7f-b19d-052590a8778c service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:50.863847 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-61af7895-c26d-43c1-8189-3331448346db req-1979595f-dd4f-4a7f-b19d-052590a8778c service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:50.868714 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-61af7895-c26d-43c1-8189-3331448346db req-1979595f-dd4f-4a7f-b19d-052590a8778c service nova] Creating event network-changed:ea09e1e6-c143-479c-a9c1-7631b3033288 for instance fa0d9a6f-0dbf-4a4c-9769-4b87e7a7fee2 on n-h1-850501-14 Oct 04 19:08:50.871606 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-058c94e3-58ed-43c6-9f03-58080c557ff9 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:50.872856 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-058c94e3-58ed-43c6-9f03-58080c557ff9 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] [instance: 42ffef31-9221-4d0a-9bf9-e89d24ce8229] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:50.875150 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-61af7895-c26d-43c1-8189-3331448346db req-1979595f-dd4f-4a7f-b19d-052590a8778c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037641 Oct 04 19:08:50.876496 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3335/6652] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:08:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:08:50.880930 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-058c94e3-58ed-43c6-9f03-58080c557ff9 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:50.881569 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-058c94e3-58ed-43c6-9f03-58080c557ff9 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:50.881899 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-058c94e3-58ed-43c6-9f03-58080c557ff9 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:50.882630 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-058c94e3-58ed-43c6-9f03-58080c557ff9 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:50.883102 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-058c94e3-58ed-43c6-9f03-58080c557ff9 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:50.883721 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-058c94e3-58ed-43c6-9f03-58080c557ff9 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:51.122005 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-058c94e3-58ed-43c6-9f03-58080c557ff9 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f0388fd33143e6a6cc877ca44eeaa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690445b26ca34431a4cff2f36c27761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:51.126485 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-058c94e3-58ed-43c6-9f03-58080c557ff9 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] 10.222.0.20 "GET /compute/v2.1/servers/42ffef31-9221-4d0a-9bf9-e89d24ce8229" status: 200 len: 1464 microversion: 2.1 time: 0.259523 Oct 04 19:08:51.140613 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3318/6653] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:50 2022] GET /compute/v2.1/servers/42ffef31-9221-4d0a-9bf9-e89d24ce8229 => generated 1464 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:51.184721 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3d20b330-f825-4211-802d-bc83e26d10e0 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:51.185317 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3d20b330-f825-4211-802d-bc83e26d10e0 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] [instance: 42ffef31-9221-4d0a-9bf9-e89d24ce8229] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:51.192126 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3d20b330-f825-4211-802d-bc83e26d10e0 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:51.192615 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3d20b330-f825-4211-802d-bc83e26d10e0 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:51.193054 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3d20b330-f825-4211-802d-bc83e26d10e0 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:51.193747 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3d20b330-f825-4211-802d-bc83e26d10e0 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:51.194193 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3d20b330-f825-4211-802d-bc83e26d10e0 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:51.194673 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3d20b330-f825-4211-802d-bc83e26d10e0 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:51.222076 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3d20b330-f825-4211-802d-bc83e26d10e0 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] [instance: 42ffef31-9221-4d0a-9bf9-e89d24ce8229] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:08:51.635230 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3d20b330-f825-4211-802d-bc83e26d10e0 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] 10.222.0.20 "DELETE /compute/v2.1/servers/42ffef31-9221-4d0a-9bf9-e89d24ce8229" status: 204 len: 0 microversion: 2.1 time: 0.454643 Oct 04 19:08:51.635875 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3336/6654] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 19:08:51 2022] DELETE /compute/v2.1/servers/42ffef31-9221-4d0a-9bf9-e89d24ce8229 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:08:51.644898 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9c90d310-4d31-4cc5-bec4-afcb17744017 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:51.645559 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9c90d310-4d31-4cc5-bec4-afcb17744017 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] [instance: 42ffef31-9221-4d0a-9bf9-e89d24ce8229] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:51.652550 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9c90d310-4d31-4cc5-bec4-afcb17744017 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:51.653063 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9c90d310-4d31-4cc5-bec4-afcb17744017 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:51.653520 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9c90d310-4d31-4cc5-bec4-afcb17744017 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:51.654248 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9c90d310-4d31-4cc5-bec4-afcb17744017 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:51.654724 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9c90d310-4d31-4cc5-bec4-afcb17744017 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:51.655303 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9c90d310-4d31-4cc5-bec4-afcb17744017 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:51.800803 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9c90d310-4d31-4cc5-bec4-afcb17744017 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f0388fd33143e6a6cc877ca44eeaa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690445b26ca34431a4cff2f36c27761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:51.814086 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9c90d310-4d31-4cc5-bec4-afcb17744017 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] 10.222.0.20 "GET /compute/v2.1/servers/42ffef31-9221-4d0a-9bf9-e89d24ce8229" status: 200 len: 1470 microversion: 2.1 time: 0.173361 Oct 04 19:08:51.816220 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3319/6655] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:51 2022] GET /compute/v2.1/servers/42ffef31-9221-4d0a-9bf9-e89d24ce8229 => generated 1470 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:52.844539 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d9de0680-32ce-42f4-b021-f11353f5bd16 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:52.845276 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d9de0680-32ce-42f4-b021-f11353f5bd16 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] [instance: 42ffef31-9221-4d0a-9bf9-e89d24ce8229] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:52.852447 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d9de0680-32ce-42f4-b021-f11353f5bd16 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:52.852944 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d9de0680-32ce-42f4-b021-f11353f5bd16 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:52.853425 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d9de0680-32ce-42f4-b021-f11353f5bd16 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:52.854137 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d9de0680-32ce-42f4-b021-f11353f5bd16 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:52.855467 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d9de0680-32ce-42f4-b021-f11353f5bd16 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:52.858638 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d9de0680-32ce-42f4-b021-f11353f5bd16 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:53.018302 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d9de0680-32ce-42f4-b021-f11353f5bd16 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f0388fd33143e6a6cc877ca44eeaa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690445b26ca34431a4cff2f36c27761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:53.031833 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d9de0680-32ce-42f4-b021-f11353f5bd16 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] 10.222.0.20 "GET /compute/v2.1/servers/42ffef31-9221-4d0a-9bf9-e89d24ce8229" status: 200 len: 1470 microversion: 2.1 time: 0.191591 Oct 04 19:08:53.032745 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3337/6656] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:52 2022] GET /compute/v2.1/servers/42ffef31-9221-4d0a-9bf9-e89d24ce8229 => generated 1470 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:53.874702 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-19dc683f-963a-46b4-af24-d262e7f991c8 req-6b5041a2-229b-4a38-9efd-d46ecdea09a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42ffef31-9221-4d0a-9bf9-e89d24ce8229", "name": "network-vif-deleted", "tag": "494ff9d7-d818-4edd-90d8-ef313dcd3d37"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:08:53.891232 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-19dc683f-963a-46b4-af24-d262e7f991c8 req-6b5041a2-229b-4a38-9efd-d46ecdea09a8 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:53.891736 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-19dc683f-963a-46b4-af24-d262e7f991c8 req-6b5041a2-229b-4a38-9efd-d46ecdea09a8 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:53.892288 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-19dc683f-963a-46b4-af24-d262e7f991c8 req-6b5041a2-229b-4a38-9efd-d46ecdea09a8 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:53.910637 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-19dc683f-963a-46b4-af24-d262e7f991c8 req-6b5041a2-229b-4a38-9efd-d46ecdea09a8 service nova] Creating event network-vif-deleted:494ff9d7-d818-4edd-90d8-ef313dcd3d37 for instance 42ffef31-9221-4d0a-9bf9-e89d24ce8229 on n-h2-850501-14 Oct 04 19:08:53.916432 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-19dc683f-963a-46b4-af24-d262e7f991c8 req-6b5041a2-229b-4a38-9efd-d46ecdea09a8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045986 Oct 04 19:08:53.922254 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3320/6657] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:08:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:08:54.055868 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3bff5db6-ed8f-4e5c-9ce8-a68cf3b7afa2 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:54.056552 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3bff5db6-ed8f-4e5c-9ce8-a68cf3b7afa2 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] [instance: 42ffef31-9221-4d0a-9bf9-e89d24ce8229] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:54.063723 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3bff5db6-ed8f-4e5c-9ce8-a68cf3b7afa2 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:54.068261 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3bff5db6-ed8f-4e5c-9ce8-a68cf3b7afa2 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:54.068261 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3bff5db6-ed8f-4e5c-9ce8-a68cf3b7afa2 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:54.068261 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3bff5db6-ed8f-4e5c-9ce8-a68cf3b7afa2 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:54.068261 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3bff5db6-ed8f-4e5c-9ce8-a68cf3b7afa2 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:54.068261 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3bff5db6-ed8f-4e5c-9ce8-a68cf3b7afa2 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:54.134684 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3bff5db6-ed8f-4e5c-9ce8-a68cf3b7afa2 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f0388fd33143e6a6cc877ca44eeaa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690445b26ca34431a4cff2f36c27761a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:54.143888 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3bff5db6-ed8f-4e5c-9ce8-a68cf3b7afa2 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] 10.222.0.20 "GET /compute/v2.1/servers/42ffef31-9221-4d0a-9bf9-e89d24ce8229" status: 200 len: 1300 microversion: 2.1 time: 0.091860 Oct 04 19:08:54.147673 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3338/6658] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:54 2022] GET /compute/v2.1/servers/42ffef31-9221-4d0a-9bf9-e89d24ce8229 => generated 1300 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:55.168370 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a0a78903-b45b-4ca1-b903-8014a8c896f2 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:55.169699 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a0a78903-b45b-4ca1-b903-8014a8c896f2 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] [instance: 42ffef31-9221-4d0a-9bf9-e89d24ce8229] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:55.176248 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a0a78903-b45b-4ca1-b903-8014a8c896f2 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:55.176753 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a0a78903-b45b-4ca1-b903-8014a8c896f2 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:55.177235 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a0a78903-b45b-4ca1-b903-8014a8c896f2 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:55.177953 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a0a78903-b45b-4ca1-b903-8014a8c896f2 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:55.178428 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a0a78903-b45b-4ca1-b903-8014a8c896f2 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:55.178870 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a0a78903-b45b-4ca1-b903-8014a8c896f2 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:55.194939 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-a0a78903-b45b-4ca1-b903-8014a8c896f2 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] HTTP exception thrown: Instance 42ffef31-9221-4d0a-9bf9-e89d24ce8229 could not be found. Oct 04 19:08:55.196678 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a0a78903-b45b-4ca1-b903-8014a8c896f2 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Request method failure captured: Oct 04 19:08:55.196678 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/42ffef31-9221-4d0a-9bf9-e89d24ce8229 HTTP/1.1 Oct 04 19:08:55.196678 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 19:08:55.196678 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 19:08:55.196678 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 19:08:55.196678 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 19:08:55.196678 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 19:08:55.196678 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 19:08:55.196678 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 19:08:55.196678 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 19:08:55.196678 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPISxJWdfP7oJ2x_PcIqkKspZvuxYhJOsYWYWJig7PCKg46h99TbcFkE3Bm9FKxbIIcSPy_m5cFnLgKPJ-BLe5abeBq9LqEkPZt8ja_2jFDzr4INiPQZhwz_b_ijIZgLXMQBsGTTQj5x0vpupDAHsqOckfIHtQjojLcTpu0uFfXZV03M Oct 04 19:08:55.196678 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 19:08:55.196678 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 19:08:55.196678 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 19:08:55.196678 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 19:08:55.196678 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 19:08:55.196678 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 19:08:55.196678 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 690445b26ca34431a4cff2f36c27761a Oct 04 19:08:55.196678 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-VolumesNegativeTest-658616884 Oct 04 19:08:55.196678 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 19:08:55.196678 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 19:08:55.196678 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/690445b26ca34431a4cff2f36c27761a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_690445b26ca34431a4cff2f36c27761a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/690445b26ca34431a4cff2f36c27761a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/690445b26ca34431a4cff2f36c27761a"}]}] Oct 04 19:08:55.196678 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-VolumesNegativeTest-658616884 Oct 04 19:08:55.196678 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 690445b26ca34431a4cff2f36c27761a Oct 04 19:08:55.196678 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-VolumesNegativeTest-658616884 Oct 04 19:08:55.196678 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-VolumesNegativeTest-658616884-project Oct 04 19:08:55.196678 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 19:08:55.196678 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 19:08:55.196678 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 98f0388fd33143e6a6cc877ca44eeaa1 Oct 04 19:08:55.196678 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-VolumesNegativeTest-658616884-project Oct 04 19:08:55.196678 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 19:08:55.196678 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 42ffef31-9221-4d0a-9bf9-e89d24ce8229 could not be found. Oct 04 19:08:55.196678 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '42ffef31-9221-4d0a-9bf9-e89d24ce8229'} Oct 04 19:08:55.196678 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:08:55.196678 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:08:55.196678 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:08:55.196678 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:08:55.196678 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:08:55.196678 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:08:55.196678 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:08:55.196678 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:08:55.196678 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:08:55.196678 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:08:55.196678 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42ffef31-9221-4d0a-9bf9-e89d24ce8229 could not be found. Oct 04 19:08:55.196678 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:08:55.196678 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:08:55.196678 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:08:55.196678 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:08:55.196678 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:08:55.196678 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:08:55.196678 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:08:55.196678 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:08:55.196678 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:08:55.196678 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:08:55.196678 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:08:55.196678 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:08:55.196678 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:08:55.196678 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:08:55.196678 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:08:55.196678 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:08:55.196678 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42ffef31-9221-4d0a-9bf9-e89d24ce8229 could not be found. Oct 04 19:08:55.196678 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:08:55.196678 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:08:55.196678 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:08:55.201073 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:08:55.201073 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:08:55.201073 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:08:55.201073 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:08:55.201073 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:08:55.201073 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42ffef31-9221-4d0a-9bf9-e89d24ce8229 could not be found. Oct 04 19:08:55.201073 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:08:55.201073 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a0a78903-b45b-4ca1-b903-8014a8c896f2 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] Returning 404 to user: Instance 42ffef31-9221-4d0a-9bf9-e89d24ce8229 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:08:55.201073 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a0a78903-b45b-4ca1-b903-8014a8c896f2 tempest-VolumesNegativeTest-658616884 tempest-VolumesNegativeTest-658616884-project] 10.222.0.20 "GET /compute/v2.1/servers/42ffef31-9221-4d0a-9bf9-e89d24ce8229" status: 404 len: 111 microversion: 2.1 time: 0.035231 Oct 04 19:08:55.201073 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3321/6659] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:55 2022] GET /compute/v2.1/servers/42ffef31-9221-4d0a-9bf9-e89d24ce8229 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:09:08.051059 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8e692e6e-c892-4c87-86c7-8b2e417d30d0 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:08.052431 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8e692e6e-c892-4c87-86c7-8b2e417d30d0 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 2646dfcb-7213-4870-99eb-68311662d66b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:08.059557 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:09:08.060268 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:09:08.061636 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8e692e6e-c892-4c87-86c7-8b2e417d30d0 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:08.063434 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8e692e6e-c892-4c87-86c7-8b2e417d30d0 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:08.063434 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8e692e6e-c892-4c87-86c7-8b2e417d30d0 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:08.063644 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8e692e6e-c892-4c87-86c7-8b2e417d30d0 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:08.066362 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8e692e6e-c892-4c87-86c7-8b2e417d30d0 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:08.067142 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8e692e6e-c892-4c87-86c7-8b2e417d30d0 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:08.099297 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8e692e6e-c892-4c87-86c7-8b2e417d30d0 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b/ips" status: 200 len: 147 microversion: 2.1 time: 0.053297 Oct 04 19:09:08.099903 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3339/6660] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Oct 4 19:09:08 2022] GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b/ips => generated 147 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:09:11.230135 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2c8fbd82-fcbf-41ab-a814-b3da1d51051c tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:09:11.233279 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2c8fbd82-fcbf-41ab-a814-b3da1d51051c tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] [instance: fa0d9a6f-0dbf-4a4c-9769-4b87e7a7fee2] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:11.238025 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=6 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:09:11.243188 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=90 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:09:11.244263 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2c8fbd82-fcbf-41ab-a814-b3da1d51051c tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:11.245170 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2c8fbd82-fcbf-41ab-a814-b3da1d51051c tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:11.245886 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2c8fbd82-fcbf-41ab-a814-b3da1d51051c tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:11.250633 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2c8fbd82-fcbf-41ab-a814-b3da1d51051c tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:11.251401 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2c8fbd82-fcbf-41ab-a814-b3da1d51051c tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:11.252756 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2c8fbd82-fcbf-41ab-a814-b3da1d51051c tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:11.315969 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2c8fbd82-fcbf-41ab-a814-b3da1d51051c tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] 10.222.0.20 "POST /compute/v2.1/servers/fa0d9a6f-0dbf-4a4c-9769-4b87e7a7fee2/action" status: 200 len: 24574 microversion: 2.1 time: 0.091120 Oct 04 19:09:11.317293 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3322/6661] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 19:09:11 2022] POST /compute/v2.1/servers/fa0d9a6f-0dbf-4a4c-9769-4b87e7a7fee2/action => generated 24574 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:09:13.382326 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b3e23261-0bd6-4713-bd13-b1496c4b1fd6 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "68dad1a7-0be7-4dc6-a2cd-036f897d260b"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:09:13.385103 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b3e23261-0bd6-4713-bd13-b1496c4b1fd6 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 2646dfcb-7213-4870-99eb-68311662d66b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:13.394006 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b3e23261-0bd6-4713-bd13-b1496c4b1fd6 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:13.394537 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b3e23261-0bd6-4713-bd13-b1496c4b1fd6 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:13.394987 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b3e23261-0bd6-4713-bd13-b1496c4b1fd6 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:13.395703 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b3e23261-0bd6-4713-bd13-b1496c4b1fd6 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:13.396330 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b3e23261-0bd6-4713-bd13-b1496c4b1fd6 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:13.396619 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b3e23261-0bd6-4713-bd13-b1496c4b1fd6 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:14.442185 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b3e23261-0bd6-4713-bd13-b1496c4b1fd6 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "POST /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.070832 Oct 04 19:09:14.442859 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3340/6662] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Oct 4 19:09:13 2022] POST /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b/os-volume_attachments => generated 194 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:09:21.171493 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f4d7c1f4-1ab5-4325-8725-7b6350103c32 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:21.174109 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f4d7c1f4-1ab5-4325-8725-7b6350103c32 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:21.174727 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f4d7c1f4-1ab5-4325-8725-7b6350103c32 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:21.175214 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f4d7c1f4-1ab5-4325-8725-7b6350103c32 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:21.176423 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f4d7c1f4-1ab5-4325-8725-7b6350103c32 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:21.177134 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f4d7c1f4-1ab5-4325-8725-7b6350103c32 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:21.177788 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f4d7c1f4-1ab5-4325-8725-7b6350103c32 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:21.215906 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f4d7c1f4-1ab5-4325-8725-7b6350103c32 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] 10.222.0.20 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.320646 Oct 04 19:09:21.217319 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3323/6663] 10.222.0.20 () {58 vars in 1185 bytes} [Tue Oct 4 19:09:20 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:09:21.362959 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2d192d71-bb87-447c-90ab-aca4d18f5b9c tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1640224024", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "availability_zone": "nova:n-h1-850501-14", "networks": [{"uuid": "17277643-4ecb-4a0d-a8d2-a55ad252cf66"}]}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:09:21.450368 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.neutron [None req-2d192d71-bb87-447c-90ab-aca4d18f5b9c tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] validate_networks() for [('17277643-4ecb-4a0d-a8d2-a55ad252cf66', None, None, None, None, None)] {{(pid=123001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:09:21.938372 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-2d192d71-bb87-447c-90ab-aca4d18f5b9c tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:09:21.939142 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-2d192d71-bb87-447c-90ab-aca4d18f5b9c tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:09:21.939891 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-2d192d71-bb87-447c-90ab-aca4d18f5b9c tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:09:21.945939 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-2d192d71-bb87-447c-90ab-aca4d18f5b9c tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:09:21.945939 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-2d192d71-bb87-447c-90ab-aca4d18f5b9c tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:09:21.950846 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2d192d71-bb87-447c-90ab-aca4d18f5b9c tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:21.951312 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2d192d71-bb87-447c-90ab-aca4d18f5b9c tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:21.951859 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2d192d71-bb87-447c-90ab-aca4d18f5b9c tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:21.952750 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2d192d71-bb87-447c-90ab-aca4d18f5b9c tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:21.953053 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2d192d71-bb87-447c-90ab-aca4d18f5b9c tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:21.953476 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2d192d71-bb87-447c-90ab-aca4d18f5b9c tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:21.974448 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-2d192d71-bb87-447c-90ab-aca4d18f5b9c tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Getting quotas for project 66f955c3f7e64151a36b6ac1d7325406. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:09:21.980654 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-2d192d71-bb87-447c-90ab-aca4d18f5b9c tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Getting quotas for user 7d24a34dd81741f384f1b2a748b9d528 and project 66f955c3f7e64151a36b6ac1d7325406. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:09:21.993831 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2d192d71-bb87-447c-90ab-aca4d18f5b9c tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Going to run 1 instances... {{(pid=123001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:09:21.996341 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2d192d71-bb87-447c-90ab-aca4d18f5b9c tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] [instance: 4dbf84c3-f185-4565-9e8e-99beba05087d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:09:22.143396 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2d192d71-bb87-447c-90ab-aca4d18f5b9c tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.785855 Oct 04 19:09:22.144042 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3341/6664] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 19:09:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 787 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:09:22.154729 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9641d9eb-d409-49b1-b911-5f281ab480ee tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:22.160838 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9641d9eb-d409-49b1-b911-5f281ab480ee tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] [instance: 4dbf84c3-f185-4565-9e8e-99beba05087d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:22.234604 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9641d9eb-d409-49b1-b911-5f281ab480ee tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/4dbf84c3-f185-4565-9e8e-99beba05087d" status: 200 len: 1329 microversion: 2.1 time: 0.083525 Oct 04 19:09:22.236918 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3324/6665] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:22 2022] GET /compute/v2.1/servers/4dbf84c3-f185-4565-9e8e-99beba05087d => generated 1329 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:23.260024 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b9ced529-2c05-483b-a032-3e860a5cee94 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:23.260816 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b9ced529-2c05-483b-a032-3e860a5cee94 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] [instance: 4dbf84c3-f185-4565-9e8e-99beba05087d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:23.322265 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b9ced529-2c05-483b-a032-3e860a5cee94 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/4dbf84c3-f185-4565-9e8e-99beba05087d" status: 200 len: 1329 microversion: 2.1 time: 0.067163 Oct 04 19:09:23.322827 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3342/6666] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:23 2022] GET /compute/v2.1/servers/4dbf84c3-f185-4565-9e8e-99beba05087d => generated 1329 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:24.352539 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7644be83-829d-468a-991c-40863da23af5 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:24.354154 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7644be83-829d-468a-991c-40863da23af5 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] [instance: 4dbf84c3-f185-4565-9e8e-99beba05087d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:24.371288 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7644be83-829d-468a-991c-40863da23af5 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:24.375140 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7644be83-829d-468a-991c-40863da23af5 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:24.376877 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7644be83-829d-468a-991c-40863da23af5 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:24.379413 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7644be83-829d-468a-991c-40863da23af5 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:24.380319 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7644be83-829d-468a-991c-40863da23af5 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:24.381029 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7644be83-829d-468a-991c-40863da23af5 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:24.504448 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7644be83-829d-468a-991c-40863da23af5 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/4dbf84c3-f185-4565-9e8e-99beba05087d" status: 200 len: 1418 microversion: 2.1 time: 0.162261 Oct 04 19:09:24.517921 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3325/6667] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:24 2022] GET /compute/v2.1/servers/4dbf84c3-f185-4565-9e8e-99beba05087d => generated 1418 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:25.529630 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-703464eb-0ed4-4bba-afb4-921c71208255 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:25.530161 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-703464eb-0ed4-4bba-afb4-921c71208255 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] [instance: 4dbf84c3-f185-4565-9e8e-99beba05087d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:25.537040 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-703464eb-0ed4-4bba-afb4-921c71208255 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:25.537817 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-703464eb-0ed4-4bba-afb4-921c71208255 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:25.538621 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-703464eb-0ed4-4bba-afb4-921c71208255 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:25.539516 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-703464eb-0ed4-4bba-afb4-921c71208255 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:25.540230 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-703464eb-0ed4-4bba-afb4-921c71208255 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:25.540814 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-703464eb-0ed4-4bba-afb4-921c71208255 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:25.653280 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-703464eb-0ed4-4bba-afb4-921c71208255 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/4dbf84c3-f185-4565-9e8e-99beba05087d" status: 200 len: 1424 microversion: 2.1 time: 0.127850 Oct 04 19:09:25.664926 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3343/6668] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:25 2022] GET /compute/v2.1/servers/4dbf84c3-f185-4565-9e8e-99beba05087d => generated 1424 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:26.680361 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2d678253-ec30-44a7-a0d7-bcb105eb12f6 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:26.681160 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2d678253-ec30-44a7-a0d7-bcb105eb12f6 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] [instance: 4dbf84c3-f185-4565-9e8e-99beba05087d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:26.690117 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2d678253-ec30-44a7-a0d7-bcb105eb12f6 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:26.690805 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2d678253-ec30-44a7-a0d7-bcb105eb12f6 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:26.691389 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2d678253-ec30-44a7-a0d7-bcb105eb12f6 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:26.692724 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2d678253-ec30-44a7-a0d7-bcb105eb12f6 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:26.693327 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2d678253-ec30-44a7-a0d7-bcb105eb12f6 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:26.693832 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2d678253-ec30-44a7-a0d7-bcb105eb12f6 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:27.027812 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2d678253-ec30-44a7-a0d7-bcb105eb12f6 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/4dbf84c3-f185-4565-9e8e-99beba05087d" status: 200 len: 1466 microversion: 2.1 time: 0.351487 Oct 04 19:09:27.054881 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3326/6669] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:26 2022] GET /compute/v2.1/servers/4dbf84c3-f185-4565-9e8e-99beba05087d => generated 1466 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:27.786666 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-cfe5d1ad-a866-44c7-84a6-f8e1fe7f98ef req-ac45476f-a786-4a51-a45f-fa4179cb1454 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4dbf84c3-f185-4565-9e8e-99beba05087d", "tag": "57105637-fd5c-401f-a764-b6dd2242d686"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:09:27.801579 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-cfe5d1ad-a866-44c7-84a6-f8e1fe7f98ef req-ac45476f-a786-4a51-a45f-fa4179cb1454 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:27.802525 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-cfe5d1ad-a866-44c7-84a6-f8e1fe7f98ef req-ac45476f-a786-4a51-a45f-fa4179cb1454 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:27.803209 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-cfe5d1ad-a866-44c7-84a6-f8e1fe7f98ef req-ac45476f-a786-4a51-a45f-fa4179cb1454 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:27.819822 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-cfe5d1ad-a866-44c7-84a6-f8e1fe7f98ef req-ac45476f-a786-4a51-a45f-fa4179cb1454 service nova] Creating event network-changed:57105637-fd5c-401f-a764-b6dd2242d686 for instance 4dbf84c3-f185-4565-9e8e-99beba05087d on n-h1-850501-14 Oct 04 19:09:27.822435 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7367e144-6cc6-4efb-b39e-59cdf3b49979 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Action: 'create', calling method: .version_select at 0x7fe258bdd790>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-41267450", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEd2EgvvWF/YIYZAwR0WFJbmdpjPwfYQRGHq1pgXoySq+vixQVk8J3dVjKEbieJ2ckJbixpL9fUXzBnfPnSZ+fXN/DOVANX9UIhIj+uO7Y5xwWKDUD314qUsc5tsS+Rhjw=="}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:09:27.827687 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-cfe5d1ad-a866-44c7-84a6-f8e1fe7f98ef req-ac45476f-a786-4a51-a45f-fa4179cb1454 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044173 Oct 04 19:09:27.828788 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3344/6670] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:09:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:09:27.870474 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-7367e144-6cc6-4efb-b39e-59cdf3b49979 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Getting quotas for project 42758fc2a182488489d9989e17beb026. Resources: {'key_pairs'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:09:27.881414 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-7367e144-6cc6-4efb-b39e-59cdf3b49979 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Getting quotas for user f7f2888940414c0d9a690ad8c68b4da3 and project 42758fc2a182488489d9989e17beb026. Resources: {'key_pairs'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:09:27.979418 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7367e144-6cc6-4efb-b39e-59cdf3b49979 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.160931 Oct 04 19:09:27.980801 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3327/6671] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Oct 4 19:09:27 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:09:28.055080 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8b631382-c572-4244-b2bb-3f416e2fb261 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:28.056045 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8b631382-c572-4244-b2bb-3f416e2fb261 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] [instance: 4dbf84c3-f185-4565-9e8e-99beba05087d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:28.063048 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8b631382-c572-4244-b2bb-3f416e2fb261 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:28.063719 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8b631382-c572-4244-b2bb-3f416e2fb261 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:28.065188 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8b631382-c572-4244-b2bb-3f416e2fb261 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:28.066521 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8b631382-c572-4244-b2bb-3f416e2fb261 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:28.067573 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8b631382-c572-4244-b2bb-3f416e2fb261 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:28.068505 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8b631382-c572-4244-b2bb-3f416e2fb261 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:28.671218 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8b631382-c572-4244-b2bb-3f416e2fb261 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/4dbf84c3-f185-4565-9e8e-99beba05087d" status: 200 len: 1466 microversion: 2.1 time: 0.620777 Oct 04 19:09:28.686448 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3345/6672] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:28 2022] GET /compute/v2.1/servers/4dbf84c3-f185-4565-9e8e-99beba05087d => generated 1466 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:28.941958 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7ba33258-e119-4ec5-8f18-f8e75ffbba68 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:09:28.948461 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7ba33258-e119-4ec5-8f18-f8e75ffbba68 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:28.949316 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7ba33258-e119-4ec5-8f18-f8e75ffbba68 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:28.949773 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7ba33258-e119-4ec5-8f18-f8e75ffbba68 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:28.993001 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7ba33258-e119-4ec5-8f18-f8e75ffbba68 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 2646dfcb-7213-4870-99eb-68311662d66b] Going to try to stop instance {{(pid=123002) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 19:09:29.260301 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7ba33258-e119-4ec5-8f18-f8e75ffbba68 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "POST /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b/action" status: 202 len: 0 microversion: 2.1 time: 0.323624 Oct 04 19:09:29.271471 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c3699d92-a0f0-487c-a26c-2e6df9da9367 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:29.272756 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c3699d92-a0f0-487c-a26c-2e6df9da9367 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 2646dfcb-7213-4870-99eb-68311662d66b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:29.279094 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3328/6673] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 19:09:28 2022] POST /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b/action => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:09:29.287092 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c3699d92-a0f0-487c-a26c-2e6df9da9367 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:29.287604 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c3699d92-a0f0-487c-a26c-2e6df9da9367 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:29.288029 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c3699d92-a0f0-487c-a26c-2e6df9da9367 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:29.288778 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c3699d92-a0f0-487c-a26c-2e6df9da9367 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:29.289282 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c3699d92-a0f0-487c-a26c-2e6df9da9367 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:29.289914 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c3699d92-a0f0-487c-a26c-2e6df9da9367 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:29.478967 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c3699d92-a0f0-487c-a26c-2e6df9da9367 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3060cdc6eeba47288205e107717a6980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a841124bf4392b54c3d6b0ea37e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:29.494152 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c3699d92-a0f0-487c-a26c-2e6df9da9367 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b" status: 200 len: 1723 microversion: 2.1 time: 0.227072 Oct 04 19:09:29.519303 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3346/6674] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:29 2022] GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b => generated 1723 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:29.699341 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-19168772-8e9d-4f3e-b52d-366ddc9d2868 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:29.700240 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-19168772-8e9d-4f3e-b52d-366ddc9d2868 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] [instance: 4dbf84c3-f185-4565-9e8e-99beba05087d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:29.729013 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-19168772-8e9d-4f3e-b52d-366ddc9d2868 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:29.733745 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-19168772-8e9d-4f3e-b52d-366ddc9d2868 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:29.734304 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-19168772-8e9d-4f3e-b52d-366ddc9d2868 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:29.735086 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-19168772-8e9d-4f3e-b52d-366ddc9d2868 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:29.735709 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-19168772-8e9d-4f3e-b52d-366ddc9d2868 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:29.736536 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-19168772-8e9d-4f3e-b52d-366ddc9d2868 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:30.013049 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-19168772-8e9d-4f3e-b52d-366ddc9d2868 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/4dbf84c3-f185-4565-9e8e-99beba05087d" status: 200 len: 1466 microversion: 2.1 time: 0.318238 Oct 04 19:09:30.016225 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3329/6675] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:29 2022] GET /compute/v2.1/servers/4dbf84c3-f185-4565-9e8e-99beba05087d => generated 1466 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:30.533486 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-92970eef-d774-42da-96c2-76740ef911be tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:30.534775 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-92970eef-d774-42da-96c2-76740ef911be tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 2646dfcb-7213-4870-99eb-68311662d66b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:30.542914 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-92970eef-d774-42da-96c2-76740ef911be tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:30.543427 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-92970eef-d774-42da-96c2-76740ef911be tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:30.543862 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-92970eef-d774-42da-96c2-76740ef911be tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:30.545372 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-92970eef-d774-42da-96c2-76740ef911be tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:30.545871 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-92970eef-d774-42da-96c2-76740ef911be tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:30.546934 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-92970eef-d774-42da-96c2-76740ef911be tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:30.699347 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-92970eef-d774-42da-96c2-76740ef911be tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3060cdc6eeba47288205e107717a6980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a841124bf4392b54c3d6b0ea37e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:30.710438 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-92970eef-d774-42da-96c2-76740ef911be tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b" status: 200 len: 1723 microversion: 2.1 time: 0.182385 Oct 04 19:09:30.725259 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3347/6676] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:30 2022] GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b => generated 1723 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:31.042847 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1ce9e880-db79-4efe-927c-cde13001f5d2 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:31.043474 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1ce9e880-db79-4efe-927c-cde13001f5d2 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] [instance: 4dbf84c3-f185-4565-9e8e-99beba05087d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:31.050988 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1ce9e880-db79-4efe-927c-cde13001f5d2 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:31.051497 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1ce9e880-db79-4efe-927c-cde13001f5d2 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:31.052044 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1ce9e880-db79-4efe-927c-cde13001f5d2 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:31.052685 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1ce9e880-db79-4efe-927c-cde13001f5d2 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:31.053152 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1ce9e880-db79-4efe-927c-cde13001f5d2 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:31.053591 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1ce9e880-db79-4efe-927c-cde13001f5d2 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:31.204196 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1ce9e880-db79-4efe-927c-cde13001f5d2 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/4dbf84c3-f185-4565-9e8e-99beba05087d" status: 200 len: 1466 microversion: 2.1 time: 0.155072 Oct 04 19:09:31.204196 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3330/6677] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:31 2022] GET /compute/v2.1/servers/4dbf84c3-f185-4565-9e8e-99beba05087d => generated 1466 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:31.682455 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0ce455e3-e54a-47d5-8925-2fdcb7096a05 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-969939114", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": [{"uuid": "ec45082d-3925-456f-94d9-1ba99d887dd0"}], "key_name": "tempest-TestNetworkBasicOps-41267450", "security_groups": [{"name": "tempest-secgroup-smoke-1857224675"}]}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:09:31.743012 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0a3293d6-30e2-45a6-8db5-9593b0e70cf9 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:31.743012 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0a3293d6-30e2-45a6-8db5-9593b0e70cf9 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 2646dfcb-7213-4870-99eb-68311662d66b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:31.743012 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:09:31.746071 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0a3293d6-30e2-45a6-8db5-9593b0e70cf9 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:31.746578 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0a3293d6-30e2-45a6-8db5-9593b0e70cf9 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:31.747030 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0a3293d6-30e2-45a6-8db5-9593b0e70cf9 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:31.747745 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0a3293d6-30e2-45a6-8db5-9593b0e70cf9 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:31.748246 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0a3293d6-30e2-45a6-8db5-9593b0e70cf9 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:31.748728 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0a3293d6-30e2-45a6-8db5-9593b0e70cf9 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:31.822694 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.neutron [None req-0ce455e3-e54a-47d5-8925-2fdcb7096a05 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] validate_networks() for [('ec45082d-3925-456f-94d9-1ba99d887dd0', None, None, None, None, None)] {{(pid=123001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:09:31.965099 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:09:32.011356 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0a3293d6-30e2-45a6-8db5-9593b0e70cf9 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3060cdc6eeba47288205e107717a6980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a841124bf4392b54c3d6b0ea37e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:32.020146 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0a3293d6-30e2-45a6-8db5-9593b0e70cf9 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b" status: 200 len: 1723 microversion: 2.1 time: 0.286741 Oct 04 19:09:32.020874 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3331/6678] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:31 2022] GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b => generated 1723 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:09:32.223561 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1e566fd4-35f6-45a8-8592-429fdc59926c tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:32.224318 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1e566fd4-35f6-45a8-8592-429fdc59926c tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] [instance: 4dbf84c3-f185-4565-9e8e-99beba05087d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:32.232589 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1e566fd4-35f6-45a8-8592-429fdc59926c tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:32.233239 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1e566fd4-35f6-45a8-8592-429fdc59926c tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:32.233890 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1e566fd4-35f6-45a8-8592-429fdc59926c tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:32.234984 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1e566fd4-35f6-45a8-8592-429fdc59926c tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:32.235645 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1e566fd4-35f6-45a8-8592-429fdc59926c tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:32.236603 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1e566fd4-35f6-45a8-8592-429fdc59926c tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:32.331274 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-0ce455e3-e54a-47d5-8925-2fdcb7096a05 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:09:32.331703 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-0ce455e3-e54a-47d5-8925-2fdcb7096a05 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:09:32.332809 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-0ce455e3-e54a-47d5-8925-2fdcb7096a05 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:09:32.333221 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-0ce455e3-e54a-47d5-8925-2fdcb7096a05 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:09:32.333633 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-0ce455e3-e54a-47d5-8925-2fdcb7096a05 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:09:32.342750 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0ce455e3-e54a-47d5-8925-2fdcb7096a05 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:32.343237 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0ce455e3-e54a-47d5-8925-2fdcb7096a05 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:32.343791 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0ce455e3-e54a-47d5-8925-2fdcb7096a05 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:32.344501 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0ce455e3-e54a-47d5-8925-2fdcb7096a05 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:32.344955 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0ce455e3-e54a-47d5-8925-2fdcb7096a05 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:32.345756 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0ce455e3-e54a-47d5-8925-2fdcb7096a05 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:32.364027 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-0ce455e3-e54a-47d5-8925-2fdcb7096a05 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Getting quotas for project 42758fc2a182488489d9989e17beb026. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:09:32.370197 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-0ce455e3-e54a-47d5-8925-2fdcb7096a05 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Getting quotas for user f7f2888940414c0d9a690ad8c68b4da3 and project 42758fc2a182488489d9989e17beb026. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:09:32.383608 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0ce455e3-e54a-47d5-8925-2fdcb7096a05 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Going to run 1 instances... {{(pid=123001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:09:32.385962 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0ce455e3-e54a-47d5-8925-2fdcb7096a05 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] [instance: 641029fb-67ea-4632-96bd-4e11ed5bb256] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:09:32.401538 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1e566fd4-35f6-45a8-8592-429fdc59926c tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/4dbf84c3-f185-4565-9e8e-99beba05087d" status: 200 len: 1466 microversion: 2.1 time: 0.183589 Oct 04 19:09:32.402122 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3332/6679] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:32 2022] GET /compute/v2.1/servers/4dbf84c3-f185-4565-9e8e-99beba05087d => generated 1466 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:09:32.574471 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0ce455e3-e54a-47d5-8925-2fdcb7096a05 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.895979 Oct 04 19:09:32.575029 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3348/6680] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 19:09:31 2022] POST /compute/v2.1/servers => generated 406 bytes in 897 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:09:32.587114 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9267b65c-5739-49aa-8190-f9d139e16ad0 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:32.587742 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9267b65c-5739-49aa-8190-f9d139e16ad0 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] [instance: 641029fb-67ea-4632-96bd-4e11ed5bb256] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:32.646475 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9267b65c-5739-49aa-8190-f9d139e16ad0 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f2888940414c0d9a690ad8c68b4da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42758fc2a182488489d9989e17beb026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:32.655946 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9267b65c-5739-49aa-8190-f9d139e16ad0 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] 10.222.0.20 "GET /compute/v2.1/servers/641029fb-67ea-4632-96bd-4e11ed5bb256" status: 200 len: 1246 microversion: 2.1 time: 0.072046 Oct 04 19:09:32.655946 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3333/6681] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:32 2022] GET /compute/v2.1/servers/641029fb-67ea-4632-96bd-4e11ed5bb256 => generated 1246 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:33.044986 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-dfc61f7a-a19d-44ba-9b5d-3cb5b9bbc642 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:33.045607 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-dfc61f7a-a19d-44ba-9b5d-3cb5b9bbc642 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 2646dfcb-7213-4870-99eb-68311662d66b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:33.052481 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dfc61f7a-a19d-44ba-9b5d-3cb5b9bbc642 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:33.052976 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dfc61f7a-a19d-44ba-9b5d-3cb5b9bbc642 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:33.053423 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dfc61f7a-a19d-44ba-9b5d-3cb5b9bbc642 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:33.054128 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dfc61f7a-a19d-44ba-9b5d-3cb5b9bbc642 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:33.054599 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dfc61f7a-a19d-44ba-9b5d-3cb5b9bbc642 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:33.055327 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dfc61f7a-a19d-44ba-9b5d-3cb5b9bbc642 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:33.194822 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-dfc61f7a-a19d-44ba-9b5d-3cb5b9bbc642 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3060cdc6eeba47288205e107717a6980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a841124bf4392b54c3d6b0ea37e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:33.203918 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-dfc61f7a-a19d-44ba-9b5d-3cb5b9bbc642 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b" status: 200 len: 1723 microversion: 2.1 time: 0.163495 Oct 04 19:09:33.205100 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3349/6682] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:33 2022] GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:33.423413 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-98214c90-34b5-4761-b99c-18ac2d49b06e tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:33.424213 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-98214c90-34b5-4761-b99c-18ac2d49b06e tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] [instance: 4dbf84c3-f185-4565-9e8e-99beba05087d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:33.431634 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-98214c90-34b5-4761-b99c-18ac2d49b06e tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:33.434156 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-98214c90-34b5-4761-b99c-18ac2d49b06e tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:33.434156 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-98214c90-34b5-4761-b99c-18ac2d49b06e tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:33.434156 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-98214c90-34b5-4761-b99c-18ac2d49b06e tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:33.434156 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-98214c90-34b5-4761-b99c-18ac2d49b06e tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:33.434494 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-98214c90-34b5-4761-b99c-18ac2d49b06e tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:33.580476 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-98214c90-34b5-4761-b99c-18ac2d49b06e tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/4dbf84c3-f185-4565-9e8e-99beba05087d" status: 200 len: 1466 microversion: 2.1 time: 0.151791 Oct 04 19:09:33.582203 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3334/6683] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:33 2022] GET /compute/v2.1/servers/4dbf84c3-f185-4565-9e8e-99beba05087d => generated 1466 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:33.680497 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f19e3b42-cfdf-4ac4-80fa-67b557a67e19 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:33.681437 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f19e3b42-cfdf-4ac4-80fa-67b557a67e19 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] [instance: 641029fb-67ea-4632-96bd-4e11ed5bb256] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:33.687681 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f19e3b42-cfdf-4ac4-80fa-67b557a67e19 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:33.688370 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f19e3b42-cfdf-4ac4-80fa-67b557a67e19 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:33.689039 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f19e3b42-cfdf-4ac4-80fa-67b557a67e19 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:33.690504 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f19e3b42-cfdf-4ac4-80fa-67b557a67e19 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:33.691083 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f19e3b42-cfdf-4ac4-80fa-67b557a67e19 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:33.691652 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f19e3b42-cfdf-4ac4-80fa-67b557a67e19 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:33.780455 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f19e3b42-cfdf-4ac4-80fa-67b557a67e19 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f2888940414c0d9a690ad8c68b4da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42758fc2a182488489d9989e17beb026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:33.790709 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f19e3b42-cfdf-4ac4-80fa-67b557a67e19 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] 10.222.0.20 "GET /compute/v2.1/servers/641029fb-67ea-4632-96bd-4e11ed5bb256" status: 200 len: 1250 microversion: 2.1 time: 0.114490 Oct 04 19:09:33.791310 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3350/6684] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:33 2022] GET /compute/v2.1/servers/641029fb-67ea-4632-96bd-4e11ed5bb256 => generated 1250 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:34.237880 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-621a2182-edb5-44ef-a060-0057684c90d6 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:34.239220 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-621a2182-edb5-44ef-a060-0057684c90d6 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 2646dfcb-7213-4870-99eb-68311662d66b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:34.246273 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-621a2182-edb5-44ef-a060-0057684c90d6 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:34.246777 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-621a2182-edb5-44ef-a060-0057684c90d6 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:34.247228 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-621a2182-edb5-44ef-a060-0057684c90d6 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:34.248542 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-621a2182-edb5-44ef-a060-0057684c90d6 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:34.249226 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-621a2182-edb5-44ef-a060-0057684c90d6 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:34.249669 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-621a2182-edb5-44ef-a060-0057684c90d6 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:34.392396 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-621a2182-edb5-44ef-a060-0057684c90d6 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3060cdc6eeba47288205e107717a6980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a841124bf4392b54c3d6b0ea37e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:34.400739 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-621a2182-edb5-44ef-a060-0057684c90d6 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b" status: 200 len: 1723 microversion: 2.1 time: 0.175177 Oct 04 19:09:34.401335 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3335/6685] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:34 2022] GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:34.608172 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d23ca611-55da-4969-ba4b-16e7aa5e9fb2 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:34.608795 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d23ca611-55da-4969-ba4b-16e7aa5e9fb2 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] [instance: 4dbf84c3-f185-4565-9e8e-99beba05087d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:34.616343 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d23ca611-55da-4969-ba4b-16e7aa5e9fb2 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:34.616838 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d23ca611-55da-4969-ba4b-16e7aa5e9fb2 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:34.617279 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d23ca611-55da-4969-ba4b-16e7aa5e9fb2 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:34.617983 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d23ca611-55da-4969-ba4b-16e7aa5e9fb2 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:34.618444 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d23ca611-55da-4969-ba4b-16e7aa5e9fb2 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:34.618876 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d23ca611-55da-4969-ba4b-16e7aa5e9fb2 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:34.762316 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d23ca611-55da-4969-ba4b-16e7aa5e9fb2 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/4dbf84c3-f185-4565-9e8e-99beba05087d" status: 200 len: 1466 microversion: 2.1 time: 0.157909 Oct 04 19:09:34.763014 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3351/6686] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:34 2022] GET /compute/v2.1/servers/4dbf84c3-f185-4565-9e8e-99beba05087d => generated 1466 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:34.814454 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-91285841-968c-4ebd-a1af-5b7c6ec72730 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:34.815731 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-91285841-968c-4ebd-a1af-5b7c6ec72730 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] [instance: 641029fb-67ea-4632-96bd-4e11ed5bb256] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:34.822687 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-91285841-968c-4ebd-a1af-5b7c6ec72730 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:34.823204 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-91285841-968c-4ebd-a1af-5b7c6ec72730 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:34.823655 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-91285841-968c-4ebd-a1af-5b7c6ec72730 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:34.824442 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-91285841-968c-4ebd-a1af-5b7c6ec72730 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:34.824922 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-91285841-968c-4ebd-a1af-5b7c6ec72730 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:34.825504 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-91285841-968c-4ebd-a1af-5b7c6ec72730 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:34.896119 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-91285841-968c-4ebd-a1af-5b7c6ec72730 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f2888940414c0d9a690ad8c68b4da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42758fc2a182488489d9989e17beb026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:34.903712 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-91285841-968c-4ebd-a1af-5b7c6ec72730 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] 10.222.0.20 "GET /compute/v2.1/servers/641029fb-67ea-4632-96bd-4e11ed5bb256" status: 200 len: 1298 microversion: 2.1 time: 0.094066 Oct 04 19:09:34.904306 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3336/6687] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:34 2022] GET /compute/v2.1/servers/641029fb-67ea-4632-96bd-4e11ed5bb256 => generated 1298 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:35.426248 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3028ffa0-9f1a-4fef-92ae-8982bccec1dc tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:35.426948 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3028ffa0-9f1a-4fef-92ae-8982bccec1dc tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 2646dfcb-7213-4870-99eb-68311662d66b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:35.435416 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3028ffa0-9f1a-4fef-92ae-8982bccec1dc tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:35.436314 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3028ffa0-9f1a-4fef-92ae-8982bccec1dc tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:35.436980 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3028ffa0-9f1a-4fef-92ae-8982bccec1dc tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:35.438830 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3028ffa0-9f1a-4fef-92ae-8982bccec1dc tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:35.440488 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3028ffa0-9f1a-4fef-92ae-8982bccec1dc tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:35.441193 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3028ffa0-9f1a-4fef-92ae-8982bccec1dc tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:35.601975 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3028ffa0-9f1a-4fef-92ae-8982bccec1dc tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3060cdc6eeba47288205e107717a6980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a841124bf4392b54c3d6b0ea37e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:35.612329 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3028ffa0-9f1a-4fef-92ae-8982bccec1dc tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b" status: 200 len: 1723 microversion: 2.1 time: 0.191435 Oct 04 19:09:35.613284 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3352/6688] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:35 2022] GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b => generated 1723 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:35.786876 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3d7a1cb2-2ed1-4474-950c-5a8fefcee9a1 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:35.788684 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3d7a1cb2-2ed1-4474-950c-5a8fefcee9a1 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] [instance: 4dbf84c3-f185-4565-9e8e-99beba05087d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:35.799258 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3d7a1cb2-2ed1-4474-950c-5a8fefcee9a1 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:35.800673 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3d7a1cb2-2ed1-4474-950c-5a8fefcee9a1 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:35.801742 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3d7a1cb2-2ed1-4474-950c-5a8fefcee9a1 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:35.802947 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3d7a1cb2-2ed1-4474-950c-5a8fefcee9a1 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:35.803630 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3d7a1cb2-2ed1-4474-950c-5a8fefcee9a1 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:35.804889 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3d7a1cb2-2ed1-4474-950c-5a8fefcee9a1 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:36.037672 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-71e71cee-df3f-4958-87b4-fd10a3e99cb9 req-dca55ec4-792a-4d2c-93e9-b7716332e4cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dbf84c3-f185-4565-9e8e-99beba05087d", "name": "network-vif-plugged", "status": "completed", "tag": "57105637-fd5c-401f-a764-b6dd2242d686"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:09:36.047464 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-71e71cee-df3f-4958-87b4-fd10a3e99cb9 req-dca55ec4-792a-4d2c-93e9-b7716332e4cb service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:36.047950 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-71e71cee-df3f-4958-87b4-fd10a3e99cb9 req-dca55ec4-792a-4d2c-93e9-b7716332e4cb service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:36.049016 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-71e71cee-df3f-4958-87b4-fd10a3e99cb9 req-dca55ec4-792a-4d2c-93e9-b7716332e4cb service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:36.052046 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3d7a1cb2-2ed1-4474-950c-5a8fefcee9a1 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/4dbf84c3-f185-4565-9e8e-99beba05087d" status: 200 len: 1466 microversion: 2.1 time: 0.270608 Oct 04 19:09:36.053979 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3337/6689] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:35 2022] GET /compute/v2.1/servers/4dbf84c3-f185-4565-9e8e-99beba05087d => generated 1466 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:36.058752 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7d4f4aba-1e02-4e84-8640-f37286011d39 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:36.059417 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7d4f4aba-1e02-4e84-8640-f37286011d39 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] [instance: 641029fb-67ea-4632-96bd-4e11ed5bb256] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:36.066081 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7d4f4aba-1e02-4e84-8640-f37286011d39 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:36.066598 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7d4f4aba-1e02-4e84-8640-f37286011d39 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:36.067057 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7d4f4aba-1e02-4e84-8640-f37286011d39 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:36.067787 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7d4f4aba-1e02-4e84-8640-f37286011d39 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:36.068308 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7d4f4aba-1e02-4e84-8640-f37286011d39 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:36.068894 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7d4f4aba-1e02-4e84-8640-f37286011d39 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:36.075902 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-71e71cee-df3f-4958-87b4-fd10a3e99cb9 req-dca55ec4-792a-4d2c-93e9-b7716332e4cb service nova] Creating event network-vif-plugged:57105637-fd5c-401f-a764-b6dd2242d686 for instance 4dbf84c3-f185-4565-9e8e-99beba05087d on n-h1-850501-14 Oct 04 19:09:36.082361 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-71e71cee-df3f-4958-87b4-fd10a3e99cb9 req-dca55ec4-792a-4d2c-93e9-b7716332e4cb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.249827 Oct 04 19:09:36.083406 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3353/6690] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:09:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:09:36.295880 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7d4f4aba-1e02-4e84-8640-f37286011d39 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f2888940414c0d9a690ad8c68b4da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42758fc2a182488489d9989e17beb026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:36.310707 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7d4f4aba-1e02-4e84-8640-f37286011d39 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] 10.222.0.20 "GET /compute/v2.1/servers/641029fb-67ea-4632-96bd-4e11ed5bb256" status: 200 len: 1372 microversion: 2.1 time: 0.255584 Oct 04 19:09:36.311485 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3338/6691] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:36 2022] GET /compute/v2.1/servers/641029fb-67ea-4632-96bd-4e11ed5bb256 => generated 1372 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:36.638228 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5bf25fe9-5218-4b2d-a6cb-aba4b6bd9e12 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:36.638825 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5bf25fe9-5218-4b2d-a6cb-aba4b6bd9e12 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 2646dfcb-7213-4870-99eb-68311662d66b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:36.645500 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5bf25fe9-5218-4b2d-a6cb-aba4b6bd9e12 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:36.645986 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5bf25fe9-5218-4b2d-a6cb-aba4b6bd9e12 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:36.646421 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5bf25fe9-5218-4b2d-a6cb-aba4b6bd9e12 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:36.647110 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5bf25fe9-5218-4b2d-a6cb-aba4b6bd9e12 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:36.647563 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5bf25fe9-5218-4b2d-a6cb-aba4b6bd9e12 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:36.647986 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5bf25fe9-5218-4b2d-a6cb-aba4b6bd9e12 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:36.789260 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5bf25fe9-5218-4b2d-a6cb-aba4b6bd9e12 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3060cdc6eeba47288205e107717a6980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a841124bf4392b54c3d6b0ea37e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:36.798669 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5bf25fe9-5218-4b2d-a6cb-aba4b6bd9e12 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b" status: 200 len: 1723 microversion: 2.1 time: 0.165250 Oct 04 19:09:36.799468 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3354/6692] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:36 2022] GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:37.075008 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1ab9091c-8a24-45a2-9156-cb62bf0e6ce2 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:37.075637 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1ab9091c-8a24-45a2-9156-cb62bf0e6ce2 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] [instance: 4dbf84c3-f185-4565-9e8e-99beba05087d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:37.082787 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1ab9091c-8a24-45a2-9156-cb62bf0e6ce2 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:37.083499 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1ab9091c-8a24-45a2-9156-cb62bf0e6ce2 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:37.083947 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1ab9091c-8a24-45a2-9156-cb62bf0e6ce2 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:37.084688 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1ab9091c-8a24-45a2-9156-cb62bf0e6ce2 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:37.085151 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1ab9091c-8a24-45a2-9156-cb62bf0e6ce2 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:37.085586 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1ab9091c-8a24-45a2-9156-cb62bf0e6ce2 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:37.246017 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-1f4ad967-c32a-44ca-bacf-9a7ee7637dee req-7ebb160b-fc8e-4196-b5dc-4ef9c58619fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "641029fb-67ea-4632-96bd-4e11ed5bb256", "tag": "2b9c4d28-bbce-4ab4-a73e-8504622bd2ec"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:09:37.249923 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1ab9091c-8a24-45a2-9156-cb62bf0e6ce2 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/4dbf84c3-f185-4565-9e8e-99beba05087d" status: 200 len: 1466 microversion: 2.1 time: 0.178776 Oct 04 19:09:37.250655 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3339/6693] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:37 2022] GET /compute/v2.1/servers/4dbf84c3-f185-4565-9e8e-99beba05087d => generated 1466 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:37.270299 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-1f4ad967-c32a-44ca-bacf-9a7ee7637dee req-7ebb160b-fc8e-4196-b5dc-4ef9c58619fb service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:37.270931 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-1f4ad967-c32a-44ca-bacf-9a7ee7637dee req-7ebb160b-fc8e-4196-b5dc-4ef9c58619fb service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:37.271438 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-1f4ad967-c32a-44ca-bacf-9a7ee7637dee req-7ebb160b-fc8e-4196-b5dc-4ef9c58619fb service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:37.285455 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-1f4ad967-c32a-44ca-bacf-9a7ee7637dee req-7ebb160b-fc8e-4196-b5dc-4ef9c58619fb service nova] Creating event network-changed:2b9c4d28-bbce-4ab4-a73e-8504622bd2ec for instance 641029fb-67ea-4632-96bd-4e11ed5bb256 on n-h2-850501-14 Oct 04 19:09:37.290531 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-1f4ad967-c32a-44ca-bacf-9a7ee7637dee req-7ebb160b-fc8e-4196-b5dc-4ef9c58619fb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134423 Oct 04 19:09:37.291351 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3355/6694] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:09:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:09:37.335739 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d315d4ce-88bb-4b66-b3b9-f72ee72a6775 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:37.336520 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d315d4ce-88bb-4b66-b3b9-f72ee72a6775 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] [instance: 641029fb-67ea-4632-96bd-4e11ed5bb256] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:37.344328 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d315d4ce-88bb-4b66-b3b9-f72ee72a6775 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:37.344933 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d315d4ce-88bb-4b66-b3b9-f72ee72a6775 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:37.345598 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d315d4ce-88bb-4b66-b3b9-f72ee72a6775 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:37.346638 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d315d4ce-88bb-4b66-b3b9-f72ee72a6775 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:37.347187 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d315d4ce-88bb-4b66-b3b9-f72ee72a6775 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:37.347713 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d315d4ce-88bb-4b66-b3b9-f72ee72a6775 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:37.509595 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d315d4ce-88bb-4b66-b3b9-f72ee72a6775 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f2888940414c0d9a690ad8c68b4da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42758fc2a182488489d9989e17beb026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:37.518959 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d315d4ce-88bb-4b66-b3b9-f72ee72a6775 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] 10.222.0.20 "GET /compute/v2.1/servers/641029fb-67ea-4632-96bd-4e11ed5bb256" status: 200 len: 1372 microversion: 2.1 time: 0.186234 Oct 04 19:09:37.523205 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3340/6695] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:37 2022] GET /compute/v2.1/servers/641029fb-67ea-4632-96bd-4e11ed5bb256 => generated 1372 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:37.823301 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ff494d87-acf1-4934-9519-a7675e254081 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:37.824020 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ff494d87-acf1-4934-9519-a7675e254081 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 2646dfcb-7213-4870-99eb-68311662d66b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:37.831115 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ff494d87-acf1-4934-9519-a7675e254081 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:37.831597 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ff494d87-acf1-4934-9519-a7675e254081 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:37.832354 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ff494d87-acf1-4934-9519-a7675e254081 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:37.833025 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ff494d87-acf1-4934-9519-a7675e254081 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:37.833456 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ff494d87-acf1-4934-9519-a7675e254081 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:37.838603 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ff494d87-acf1-4934-9519-a7675e254081 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:37.971432 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ff494d87-acf1-4934-9519-a7675e254081 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3060cdc6eeba47288205e107717a6980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a841124bf4392b54c3d6b0ea37e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:37.980085 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ff494d87-acf1-4934-9519-a7675e254081 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b" status: 200 len: 1723 microversion: 2.1 time: 0.161020 Oct 04 19:09:37.985098 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3356/6696] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:37 2022] GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:38.274096 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ba1d3c92-77ca-4c5c-9ce6-f8eacd40cd7e tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:38.274652 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ba1d3c92-77ca-4c5c-9ce6-f8eacd40cd7e tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] [instance: 4dbf84c3-f185-4565-9e8e-99beba05087d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:38.281494 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ba1d3c92-77ca-4c5c-9ce6-f8eacd40cd7e tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:38.281991 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ba1d3c92-77ca-4c5c-9ce6-f8eacd40cd7e tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:38.282440 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ba1d3c92-77ca-4c5c-9ce6-f8eacd40cd7e tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:38.283349 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ba1d3c92-77ca-4c5c-9ce6-f8eacd40cd7e tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:38.283826 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ba1d3c92-77ca-4c5c-9ce6-f8eacd40cd7e tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:38.284297 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ba1d3c92-77ca-4c5c-9ce6-f8eacd40cd7e tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:38.302836 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:09:38.420993 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ba1d3c92-77ca-4c5c-9ce6-f8eacd40cd7e tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/4dbf84c3-f185-4565-9e8e-99beba05087d" status: 200 len: 1651 microversion: 2.1 time: 0.151038 Oct 04 19:09:38.421576 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3341/6697] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:38 2022] GET /compute/v2.1/servers/4dbf84c3-f185-4565-9e8e-99beba05087d => generated 1651 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:38.444507 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-162a3b54-aad7-4b19-ba0b-d531834a0e90 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:38.445110 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-162a3b54-aad7-4b19-ba0b-d531834a0e90 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] [instance: 4dbf84c3-f185-4565-9e8e-99beba05087d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:38.451963 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-162a3b54-aad7-4b19-ba0b-d531834a0e90 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:38.452479 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-162a3b54-aad7-4b19-ba0b-d531834a0e90 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:38.452910 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-162a3b54-aad7-4b19-ba0b-d531834a0e90 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:38.453613 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-162a3b54-aad7-4b19-ba0b-d531834a0e90 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:38.454048 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-162a3b54-aad7-4b19-ba0b-d531834a0e90 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:38.454469 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-162a3b54-aad7-4b19-ba0b-d531834a0e90 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:38.543073 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b1559d8e-ec57-400e-8f9d-7062ade1ad16 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:38.543942 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b1559d8e-ec57-400e-8f9d-7062ade1ad16 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] [instance: 641029fb-67ea-4632-96bd-4e11ed5bb256] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:38.551057 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b1559d8e-ec57-400e-8f9d-7062ade1ad16 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:38.551782 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b1559d8e-ec57-400e-8f9d-7062ade1ad16 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:38.552360 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b1559d8e-ec57-400e-8f9d-7062ade1ad16 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:38.553284 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b1559d8e-ec57-400e-8f9d-7062ade1ad16 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:38.553792 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b1559d8e-ec57-400e-8f9d-7062ade1ad16 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:38.554262 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b1559d8e-ec57-400e-8f9d-7062ade1ad16 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:38.592482 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-162a3b54-aad7-4b19-ba0b-d531834a0e90 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/4dbf84c3-f185-4565-9e8e-99beba05087d" status: 200 len: 1651 microversion: 2.1 time: 0.151552 Oct 04 19:09:38.593245 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3357/6698] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:38 2022] GET /compute/v2.1/servers/4dbf84c3-f185-4565-9e8e-99beba05087d => generated 1651 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:09:38.618421 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a01e3f71-1bd1-4682-84cb-3637f22bf60c tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:38.618973 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a01e3f71-1bd1-4682-84cb-3637f22bf60c tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] [instance: 4dbf84c3-f185-4565-9e8e-99beba05087d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:38.632158 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a01e3f71-1bd1-4682-84cb-3637f22bf60c tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:38.632664 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a01e3f71-1bd1-4682-84cb-3637f22bf60c tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:38.633115 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a01e3f71-1bd1-4682-84cb-3637f22bf60c tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:38.633842 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a01e3f71-1bd1-4682-84cb-3637f22bf60c tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:38.634315 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a01e3f71-1bd1-4682-84cb-3637f22bf60c tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:38.634726 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a01e3f71-1bd1-4682-84cb-3637f22bf60c tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:38.760377 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b1559d8e-ec57-400e-8f9d-7062ade1ad16 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f2888940414c0d9a690ad8c68b4da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42758fc2a182488489d9989e17beb026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:38.769695 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b1559d8e-ec57-400e-8f9d-7062ade1ad16 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] 10.222.0.20 "GET /compute/v2.1/servers/641029fb-67ea-4632-96bd-4e11ed5bb256" status: 200 len: 1372 microversion: 2.1 time: 0.230792 Oct 04 19:09:38.784592 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3342/6699] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:38 2022] GET /compute/v2.1/servers/641029fb-67ea-4632-96bd-4e11ed5bb256 => generated 1372 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:09:38.810681 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:09:38.815880 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a01e3f71-1bd1-4682-84cb-3637f22bf60c tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/4dbf84c3-f185-4565-9e8e-99beba05087d" status: 200 len: 1651 microversion: 2.1 time: 0.202109 Oct 04 19:09:38.816495 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3358/6700] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:38 2022] GET /compute/v2.1/servers/4dbf84c3-f185-4565-9e8e-99beba05087d => generated 1651 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:09:38.928552 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-96077499-177a-4802-b364-f190ff1dc32a tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-734448424", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "availability_zone": "nova:n-h2-850501-14", "networks": [{"uuid": "17277643-4ecb-4a0d-a8d2-a55ad252cf66"}]}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:09:38.991966 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-96077499-177a-4802-b364-f190ff1dc32a tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] validate_networks() for [('17277643-4ecb-4a0d-a8d2-a55ad252cf66', None, None, None, None, None)] {{(pid=123002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:09:39.003959 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-bc82f51e-c1d5-4a8f-815e-e9f19079ae5b tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:39.005122 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-bc82f51e-c1d5-4a8f-815e-e9f19079ae5b tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 2646dfcb-7213-4870-99eb-68311662d66b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:39.011651 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bc82f51e-c1d5-4a8f-815e-e9f19079ae5b tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:39.012172 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bc82f51e-c1d5-4a8f-815e-e9f19079ae5b tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:39.012624 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bc82f51e-c1d5-4a8f-815e-e9f19079ae5b tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:39.013342 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bc82f51e-c1d5-4a8f-815e-e9f19079ae5b tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:39.013808 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bc82f51e-c1d5-4a8f-815e-e9f19079ae5b tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:39.014241 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bc82f51e-c1d5-4a8f-815e-e9f19079ae5b tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:39.193335 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-bc82f51e-c1d5-4a8f-815e-e9f19079ae5b tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3060cdc6eeba47288205e107717a6980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a841124bf4392b54c3d6b0ea37e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:39.202822 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-bc82f51e-c1d5-4a8f-815e-e9f19079ae5b tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b" status: 200 len: 1723 microversion: 2.1 time: 0.203968 Oct 04 19:09:39.203702 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3359/6701] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:38 2022] GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b => generated 1723 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:09:39.546360 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-96077499-177a-4802-b364-f190ff1dc32a tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:09:39.546831 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-96077499-177a-4802-b364-f190ff1dc32a tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:09:39.547274 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-96077499-177a-4802-b364-f190ff1dc32a tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:09:39.547695 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-96077499-177a-4802-b364-f190ff1dc32a tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:09:39.548151 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-96077499-177a-4802-b364-f190ff1dc32a tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:09:39.557213 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-96077499-177a-4802-b364-f190ff1dc32a tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:39.557704 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-96077499-177a-4802-b364-f190ff1dc32a tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:39.558151 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-96077499-177a-4802-b364-f190ff1dc32a tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:39.558888 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-96077499-177a-4802-b364-f190ff1dc32a tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:39.559351 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-96077499-177a-4802-b364-f190ff1dc32a tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:39.559784 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-96077499-177a-4802-b364-f190ff1dc32a tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:39.578801 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-96077499-177a-4802-b364-f190ff1dc32a tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Getting quotas for project 66f955c3f7e64151a36b6ac1d7325406. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:09:39.585302 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-96077499-177a-4802-b364-f190ff1dc32a tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Getting quotas for user 7d24a34dd81741f384f1b2a748b9d528 and project 66f955c3f7e64151a36b6ac1d7325406. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:09:39.598007 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-96077499-177a-4802-b364-f190ff1dc32a tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Going to run 1 instances... {{(pid=123002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:09:39.600336 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-96077499-177a-4802-b364-f190ff1dc32a tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] [instance: 97925f5c-1aad-495a-85d7-164d520a0703] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:09:39.722112 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-96077499-177a-4802-b364-f190ff1dc32a tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.797199 Oct 04 19:09:39.723401 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3343/6702] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 19:09:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 800 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:09:39.734393 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-481406d2-d58f-4557-9809-54da91ab73d9 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:39.735016 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-481406d2-d58f-4557-9809-54da91ab73d9 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] [instance: 97925f5c-1aad-495a-85d7-164d520a0703] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:39.794646 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ce74a07f-ee1d-4830-92e8-814c16569c72 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:39.795767 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ce74a07f-ee1d-4830-92e8-814c16569c72 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] [instance: 641029fb-67ea-4632-96bd-4e11ed5bb256] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:39.805210 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ce74a07f-ee1d-4830-92e8-814c16569c72 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:39.806277 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ce74a07f-ee1d-4830-92e8-814c16569c72 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:39.806984 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ce74a07f-ee1d-4830-92e8-814c16569c72 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:39.808114 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ce74a07f-ee1d-4830-92e8-814c16569c72 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:39.808941 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ce74a07f-ee1d-4830-92e8-814c16569c72 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:39.809718 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ce74a07f-ee1d-4830-92e8-814c16569c72 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:39.813011 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-481406d2-d58f-4557-9809-54da91ab73d9 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/97925f5c-1aad-495a-85d7-164d520a0703" status: 200 len: 1328 microversion: 2.1 time: 0.082482 Oct 04 19:09:39.832597 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3360/6703] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:39 2022] GET /compute/v2.1/servers/97925f5c-1aad-495a-85d7-164d520a0703 => generated 1328 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:39.980792 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ce74a07f-ee1d-4830-92e8-814c16569c72 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f2888940414c0d9a690ad8c68b4da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42758fc2a182488489d9989e17beb026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:39.989598 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ce74a07f-ee1d-4830-92e8-814c16569c72 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] 10.222.0.20 "GET /compute/v2.1/servers/641029fb-67ea-4632-96bd-4e11ed5bb256" status: 200 len: 1372 microversion: 2.1 time: 0.199494 Oct 04 19:09:39.990180 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3344/6704] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:39 2022] GET /compute/v2.1/servers/641029fb-67ea-4632-96bd-4e11ed5bb256 => generated 1372 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:09:40.231738 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ef690828-6ad7-45e0-b62c-120f2d1d0bcf tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:40.232386 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ef690828-6ad7-45e0-b62c-120f2d1d0bcf tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 2646dfcb-7213-4870-99eb-68311662d66b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:40.241950 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ef690828-6ad7-45e0-b62c-120f2d1d0bcf tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:40.242543 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ef690828-6ad7-45e0-b62c-120f2d1d0bcf tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:40.243246 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ef690828-6ad7-45e0-b62c-120f2d1d0bcf tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:40.244043 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ef690828-6ad7-45e0-b62c-120f2d1d0bcf tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:40.244793 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ef690828-6ad7-45e0-b62c-120f2d1d0bcf tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:40.245298 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ef690828-6ad7-45e0-b62c-120f2d1d0bcf tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:40.411291 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ef690828-6ad7-45e0-b62c-120f2d1d0bcf tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3060cdc6eeba47288205e107717a6980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a841124bf4392b54c3d6b0ea37e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:40.421438 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ef690828-6ad7-45e0-b62c-120f2d1d0bcf tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b" status: 200 len: 1723 microversion: 2.1 time: 0.193561 Oct 04 19:09:40.429000 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3361/6705] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:40 2022] GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b => generated 1723 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:40.837419 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ff5f6182-b545-43a1-82e3-6db4a006380c tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:40.838060 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ff5f6182-b545-43a1-82e3-6db4a006380c tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] [instance: 97925f5c-1aad-495a-85d7-164d520a0703] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:40.844737 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ff5f6182-b545-43a1-82e3-6db4a006380c tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:40.847582 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ff5f6182-b545-43a1-82e3-6db4a006380c tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:40.847582 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ff5f6182-b545-43a1-82e3-6db4a006380c tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:40.847582 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ff5f6182-b545-43a1-82e3-6db4a006380c tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:40.847582 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ff5f6182-b545-43a1-82e3-6db4a006380c tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:40.847582 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ff5f6182-b545-43a1-82e3-6db4a006380c tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:40.925960 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ff5f6182-b545-43a1-82e3-6db4a006380c tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/97925f5c-1aad-495a-85d7-164d520a0703" status: 200 len: 1345 microversion: 2.1 time: 0.092220 Oct 04 19:09:40.926725 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3345/6706] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:40 2022] GET /compute/v2.1/servers/97925f5c-1aad-495a-85d7-164d520a0703 => generated 1345 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:41.013066 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5e748fd0-5c2a-4c87-a09a-279bc0e49516 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:41.013693 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5e748fd0-5c2a-4c87-a09a-279bc0e49516 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] [instance: 641029fb-67ea-4632-96bd-4e11ed5bb256] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:41.022576 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5e748fd0-5c2a-4c87-a09a-279bc0e49516 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:41.023079 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5e748fd0-5c2a-4c87-a09a-279bc0e49516 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:41.023527 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5e748fd0-5c2a-4c87-a09a-279bc0e49516 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:41.024337 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5e748fd0-5c2a-4c87-a09a-279bc0e49516 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:41.024802 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5e748fd0-5c2a-4c87-a09a-279bc0e49516 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:41.025232 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5e748fd0-5c2a-4c87-a09a-279bc0e49516 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:41.196692 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5e748fd0-5c2a-4c87-a09a-279bc0e49516 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f2888940414c0d9a690ad8c68b4da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42758fc2a182488489d9989e17beb026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:41.207424 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5e748fd0-5c2a-4c87-a09a-279bc0e49516 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] 10.222.0.20 "GET /compute/v2.1/servers/641029fb-67ea-4632-96bd-4e11ed5bb256" status: 200 len: 1372 microversion: 2.1 time: 0.198236 Oct 04 19:09:41.221001 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3362/6707] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:41 2022] GET /compute/v2.1/servers/641029fb-67ea-4632-96bd-4e11ed5bb256 => generated 1372 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:41.445861 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ff96c30c-4945-4c3b-8c51-0d93f9d7535e tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:41.446421 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ff96c30c-4945-4c3b-8c51-0d93f9d7535e tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 2646dfcb-7213-4870-99eb-68311662d66b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:41.452864 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ff96c30c-4945-4c3b-8c51-0d93f9d7535e tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:41.453366 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ff96c30c-4945-4c3b-8c51-0d93f9d7535e tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:41.453817 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ff96c30c-4945-4c3b-8c51-0d93f9d7535e tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:41.454528 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ff96c30c-4945-4c3b-8c51-0d93f9d7535e tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:41.455041 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ff96c30c-4945-4c3b-8c51-0d93f9d7535e tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:41.455479 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ff96c30c-4945-4c3b-8c51-0d93f9d7535e tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:41.598665 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ff96c30c-4945-4c3b-8c51-0d93f9d7535e tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3060cdc6eeba47288205e107717a6980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a841124bf4392b54c3d6b0ea37e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:41.608773 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ff96c30c-4945-4c3b-8c51-0d93f9d7535e tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b" status: 200 len: 1700 microversion: 2.1 time: 0.166537 Oct 04 19:09:41.609696 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3346/6708] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:41 2022] GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b => generated 1700 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:41.635009 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-14f5d586-877c-4098-9e26-93e641ab73e2 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:09:41.641300 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-14f5d586-877c-4098-9e26-93e641ab73e2 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:41.644743 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-14f5d586-877c-4098-9e26-93e641ab73e2 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:41.644743 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-14f5d586-877c-4098-9e26-93e641ab73e2 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:41.669502 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-14f5d586-877c-4098-9e26-93e641ab73e2 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 2646dfcb-7213-4870-99eb-68311662d66b] Going to try to start instance {{(pid=123001) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 04 19:09:41.890889 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-14f5d586-877c-4098-9e26-93e641ab73e2 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "POST /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b/action" status: 202 len: 0 microversion: 2.1 time: 0.259221 Oct 04 19:09:41.891542 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3363/6709] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 19:09:41 2022] POST /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b/action => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:09:41.900678 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-870f6296-57fd-497a-87f8-2f22a70065ef tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:41.901394 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-870f6296-57fd-497a-87f8-2f22a70065ef tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 2646dfcb-7213-4870-99eb-68311662d66b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:41.909337 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-870f6296-57fd-497a-87f8-2f22a70065ef tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:41.910184 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-870f6296-57fd-497a-87f8-2f22a70065ef tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:41.910644 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-870f6296-57fd-497a-87f8-2f22a70065ef tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:41.911368 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-870f6296-57fd-497a-87f8-2f22a70065ef tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:41.911842 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-870f6296-57fd-497a-87f8-2f22a70065ef tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:41.912309 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-870f6296-57fd-497a-87f8-2f22a70065ef tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:41.950334 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a3ea1cee-a861-4f2d-bac9-434dce3a4b73 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:41.951039 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a3ea1cee-a861-4f2d-bac9-434dce3a4b73 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] [instance: 97925f5c-1aad-495a-85d7-164d520a0703] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:41.958211 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a3ea1cee-a861-4f2d-bac9-434dce3a4b73 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:41.958706 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a3ea1cee-a861-4f2d-bac9-434dce3a4b73 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:41.959142 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a3ea1cee-a861-4f2d-bac9-434dce3a4b73 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:41.959847 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a3ea1cee-a861-4f2d-bac9-434dce3a4b73 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:41.960400 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a3ea1cee-a861-4f2d-bac9-434dce3a4b73 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:41.960831 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a3ea1cee-a861-4f2d-bac9-434dce3a4b73 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:42.079355 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a3ea1cee-a861-4f2d-bac9-434dce3a4b73 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/97925f5c-1aad-495a-85d7-164d520a0703" status: 200 len: 1425 microversion: 2.1 time: 0.133203 Oct 04 19:09:42.084261 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3364/6710] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:41 2022] GET /compute/v2.1/servers/97925f5c-1aad-495a-85d7-164d520a0703 => generated 1425 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:09:42.112068 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-870f6296-57fd-497a-87f8-2f22a70065ef tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3060cdc6eeba47288205e107717a6980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a841124bf4392b54c3d6b0ea37e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:42.120974 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-870f6296-57fd-497a-87f8-2f22a70065ef tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b" status: 200 len: 1709 microversion: 2.1 time: 0.224553 Oct 04 19:09:42.121565 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3347/6711] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:41 2022] GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b => generated 1709 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:09:42.233592 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6409970a-3d79-424c-9132-151e697c38d7 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:42.234241 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6409970a-3d79-424c-9132-151e697c38d7 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] [instance: 641029fb-67ea-4632-96bd-4e11ed5bb256] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:42.241182 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6409970a-3d79-424c-9132-151e697c38d7 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:42.241682 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6409970a-3d79-424c-9132-151e697c38d7 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:42.242121 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6409970a-3d79-424c-9132-151e697c38d7 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:42.242821 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6409970a-3d79-424c-9132-151e697c38d7 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:42.243496 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6409970a-3d79-424c-9132-151e697c38d7 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:42.244176 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6409970a-3d79-424c-9132-151e697c38d7 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:42.353467 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:09:42.413029 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6409970a-3d79-424c-9132-151e697c38d7 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f2888940414c0d9a690ad8c68b4da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42758fc2a182488489d9989e17beb026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:42.423713 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6409970a-3d79-424c-9132-151e697c38d7 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] 10.222.0.20 "GET /compute/v2.1/servers/641029fb-67ea-4632-96bd-4e11ed5bb256" status: 200 len: 1372 microversion: 2.1 time: 0.193794 Oct 04 19:09:42.426555 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3365/6712] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:42 2022] GET /compute/v2.1/servers/641029fb-67ea-4632-96bd-4e11ed5bb256 => generated 1372 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:42.636037 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-8f364109-afca-45fc-a578-02fb702369ca req-661a30a9-b837-412d-b455-8b62cea92557 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "641029fb-67ea-4632-96bd-4e11ed5bb256", "name": "network-vif-plugged", "status": "completed", "tag": "2b9c4d28-bbce-4ab4-a73e-8504622bd2ec"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:09:42.647646 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-8f364109-afca-45fc-a578-02fb702369ca req-661a30a9-b837-412d-b455-8b62cea92557 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:42.648405 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-8f364109-afca-45fc-a578-02fb702369ca req-661a30a9-b837-412d-b455-8b62cea92557 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:42.649075 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-8f364109-afca-45fc-a578-02fb702369ca req-661a30a9-b837-412d-b455-8b62cea92557 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:42.665512 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-8f364109-afca-45fc-a578-02fb702369ca req-661a30a9-b837-412d-b455-8b62cea92557 service nova] Creating event network-vif-plugged:2b9c4d28-bbce-4ab4-a73e-8504622bd2ec for instance 641029fb-67ea-4632-96bd-4e11ed5bb256 on n-h2-850501-14 Oct 04 19:09:42.671715 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-8f364109-afca-45fc-a578-02fb702369ca req-661a30a9-b837-412d-b455-8b62cea92557 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039603 Oct 04 19:09:42.677476 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3348/6713] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:09:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:09:43.103327 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-625d0c16-6162-4144-a74d-96a01fccbfb5 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:43.103898 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-625d0c16-6162-4144-a74d-96a01fccbfb5 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] [instance: 97925f5c-1aad-495a-85d7-164d520a0703] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:43.112022 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-625d0c16-6162-4144-a74d-96a01fccbfb5 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:43.112581 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-625d0c16-6162-4144-a74d-96a01fccbfb5 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:43.113022 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-625d0c16-6162-4144-a74d-96a01fccbfb5 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:43.113733 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-625d0c16-6162-4144-a74d-96a01fccbfb5 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:43.114215 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-625d0c16-6162-4144-a74d-96a01fccbfb5 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:43.114659 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-625d0c16-6162-4144-a74d-96a01fccbfb5 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:43.149469 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-16f7a898-a58d-4b5d-b0ae-251a5c426d14 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:43.151803 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-16f7a898-a58d-4b5d-b0ae-251a5c426d14 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 2646dfcb-7213-4870-99eb-68311662d66b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:43.171613 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-16f7a898-a58d-4b5d-b0ae-251a5c426d14 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:43.172372 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-16f7a898-a58d-4b5d-b0ae-251a5c426d14 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:43.179631 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-16f7a898-a58d-4b5d-b0ae-251a5c426d14 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:43.181052 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-16f7a898-a58d-4b5d-b0ae-251a5c426d14 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:43.181785 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-16f7a898-a58d-4b5d-b0ae-251a5c426d14 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:43.182311 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-16f7a898-a58d-4b5d-b0ae-251a5c426d14 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:43.439736 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-625d0c16-6162-4144-a74d-96a01fccbfb5 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/97925f5c-1aad-495a-85d7-164d520a0703" status: 200 len: 1465 microversion: 2.1 time: 0.340223 Oct 04 19:09:43.456252 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3366/6714] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:43 2022] GET /compute/v2.1/servers/97925f5c-1aad-495a-85d7-164d520a0703 => generated 1465 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:43.461810 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1d2399f3-2d93-45fe-9ecd-a67e37f9e08d tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:43.463610 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1d2399f3-2d93-45fe-9ecd-a67e37f9e08d tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] [instance: 641029fb-67ea-4632-96bd-4e11ed5bb256] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:43.466910 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-16f7a898-a58d-4b5d-b0ae-251a5c426d14 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3060cdc6eeba47288205e107717a6980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a841124bf4392b54c3d6b0ea37e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:43.469835 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1d2399f3-2d93-45fe-9ecd-a67e37f9e08d tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:43.470767 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1d2399f3-2d93-45fe-9ecd-a67e37f9e08d tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:43.471561 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1d2399f3-2d93-45fe-9ecd-a67e37f9e08d tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:43.472553 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1d2399f3-2d93-45fe-9ecd-a67e37f9e08d tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:43.473233 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1d2399f3-2d93-45fe-9ecd-a67e37f9e08d tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:43.473932 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1d2399f3-2d93-45fe-9ecd-a67e37f9e08d tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:43.483776 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-16f7a898-a58d-4b5d-b0ae-251a5c426d14 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b" status: 200 len: 1709 microversion: 2.1 time: 0.341697 Oct 04 19:09:43.484774 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3349/6715] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:43 2022] GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b => generated 1709 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:43.626375 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1d2399f3-2d93-45fe-9ecd-a67e37f9e08d tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f2888940414c0d9a690ad8c68b4da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42758fc2a182488489d9989e17beb026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:43.635231 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1d2399f3-2d93-45fe-9ecd-a67e37f9e08d tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] 10.222.0.20 "GET /compute/v2.1/servers/641029fb-67ea-4632-96bd-4e11ed5bb256" status: 200 len: 1372 microversion: 2.1 time: 0.177255 Oct 04 19:09:43.635810 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3367/6716] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:43 2022] GET /compute/v2.1/servers/641029fb-67ea-4632-96bd-4e11ed5bb256 => generated 1372 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:44.463722 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3bfdfa7b-f115-47c0-944b-fe6f16cfb82d tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:44.465300 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3bfdfa7b-f115-47c0-944b-fe6f16cfb82d tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] [instance: 97925f5c-1aad-495a-85d7-164d520a0703] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:44.474182 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3bfdfa7b-f115-47c0-944b-fe6f16cfb82d tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:44.475241 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3bfdfa7b-f115-47c0-944b-fe6f16cfb82d tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:44.475712 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3bfdfa7b-f115-47c0-944b-fe6f16cfb82d tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:44.476675 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3bfdfa7b-f115-47c0-944b-fe6f16cfb82d tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:44.477367 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3bfdfa7b-f115-47c0-944b-fe6f16cfb82d tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:44.481278 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3bfdfa7b-f115-47c0-944b-fe6f16cfb82d tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:44.508549 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-62b861ee-7a14-46e4-a9dc-f3081367ed8f tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:44.509762 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-62b861ee-7a14-46e4-a9dc-f3081367ed8f tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 2646dfcb-7213-4870-99eb-68311662d66b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:44.516257 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=6 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:09:44.518539 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-62b861ee-7a14-46e4-a9dc-f3081367ed8f tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:44.519038 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-62b861ee-7a14-46e4-a9dc-f3081367ed8f tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:44.519477 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-62b861ee-7a14-46e4-a9dc-f3081367ed8f tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:44.520209 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-62b861ee-7a14-46e4-a9dc-f3081367ed8f tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:44.520847 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-62b861ee-7a14-46e4-a9dc-f3081367ed8f tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:44.521845 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-62b861ee-7a14-46e4-a9dc-f3081367ed8f tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:44.676422 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3bfdfa7b-f115-47c0-944b-fe6f16cfb82d tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/97925f5c-1aad-495a-85d7-164d520a0703" status: 200 len: 1465 microversion: 2.1 time: 0.216924 Oct 04 19:09:44.692468 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3350/6717] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:44 2022] GET /compute/v2.1/servers/97925f5c-1aad-495a-85d7-164d520a0703 => generated 1465 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:44.698205 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-28c1ccb2-bf65-4a83-baf6-d8dbb3036338 req-d9e0b684-d6cd-4d8e-be8e-f559c4381133 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97925f5c-1aad-495a-85d7-164d520a0703", "tag": "dc8ad9b8-b5b9-4f74-a57e-81ff95daf627"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:09:44.710210 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-28c1ccb2-bf65-4a83-baf6-d8dbb3036338 req-d9e0b684-d6cd-4d8e-be8e-f559c4381133 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:44.711021 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-28c1ccb2-bf65-4a83-baf6-d8dbb3036338 req-d9e0b684-d6cd-4d8e-be8e-f559c4381133 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:44.711645 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-28c1ccb2-bf65-4a83-baf6-d8dbb3036338 req-d9e0b684-d6cd-4d8e-be8e-f559c4381133 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:44.728932 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-28c1ccb2-bf65-4a83-baf6-d8dbb3036338 req-d9e0b684-d6cd-4d8e-be8e-f559c4381133 service nova] Creating event network-changed:dc8ad9b8-b5b9-4f74-a57e-81ff95daf627 for instance 97925f5c-1aad-495a-85d7-164d520a0703 on n-h2-850501-14 Oct 04 19:09:44.734420 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-28c1ccb2-bf65-4a83-baf6-d8dbb3036338 req-d9e0b684-d6cd-4d8e-be8e-f559c4381133 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040254 Oct 04 19:09:44.735096 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3351/6718] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:09:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:09:44.737351 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-62b861ee-7a14-46e4-a9dc-f3081367ed8f tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3060cdc6eeba47288205e107717a6980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a841124bf4392b54c3d6b0ea37e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:44.740692 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0ad20b43-d05e-4723-bf1f-82fae7c72167 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:44.741453 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0ad20b43-d05e-4723-bf1f-82fae7c72167 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] [instance: 641029fb-67ea-4632-96bd-4e11ed5bb256] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:44.749365 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0ad20b43-d05e-4723-bf1f-82fae7c72167 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:44.749869 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0ad20b43-d05e-4723-bf1f-82fae7c72167 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:44.756251 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0ad20b43-d05e-4723-bf1f-82fae7c72167 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:44.756251 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0ad20b43-d05e-4723-bf1f-82fae7c72167 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:44.756251 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0ad20b43-d05e-4723-bf1f-82fae7c72167 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:44.756251 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0ad20b43-d05e-4723-bf1f-82fae7c72167 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:44.760456 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-62b861ee-7a14-46e4-a9dc-f3081367ed8f tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b" status: 200 len: 1709 microversion: 2.1 time: 0.255966 Oct 04 19:09:44.772727 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3368/6719] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:44 2022] GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b => generated 1709 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:44.910020 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0ad20b43-d05e-4723-bf1f-82fae7c72167 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f2888940414c0d9a690ad8c68b4da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42758fc2a182488489d9989e17beb026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:44.919339 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0ad20b43-d05e-4723-bf1f-82fae7c72167 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] 10.222.0.20 "GET /compute/v2.1/servers/641029fb-67ea-4632-96bd-4e11ed5bb256" status: 200 len: 1544 microversion: 2.1 time: 0.182602 Oct 04 19:09:44.919922 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3352/6720] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:44 2022] GET /compute/v2.1/servers/641029fb-67ea-4632-96bd-4e11ed5bb256 => generated 1544 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:44.943142 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-78ddd63c-9c1c-4bc2-869c-acc716110078 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:44.944556 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-78ddd63c-9c1c-4bc2-869c-acc716110078 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] [instance: 641029fb-67ea-4632-96bd-4e11ed5bb256] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:44.950630 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-78ddd63c-9c1c-4bc2-869c-acc716110078 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:44.951552 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-78ddd63c-9c1c-4bc2-869c-acc716110078 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:44.952409 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-78ddd63c-9c1c-4bc2-869c-acc716110078 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:44.953433 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-78ddd63c-9c1c-4bc2-869c-acc716110078 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:44.953904 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-78ddd63c-9c1c-4bc2-869c-acc716110078 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:44.954338 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-78ddd63c-9c1c-4bc2-869c-acc716110078 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:45.118826 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-78ddd63c-9c1c-4bc2-869c-acc716110078 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f2888940414c0d9a690ad8c68b4da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42758fc2a182488489d9989e17beb026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:45.129269 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-78ddd63c-9c1c-4bc2-869c-acc716110078 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] 10.222.0.20 "GET /compute/v2.1/servers/641029fb-67ea-4632-96bd-4e11ed5bb256" status: 200 len: 1544 microversion: 2.1 time: 0.190824 Oct 04 19:09:45.130136 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3369/6721] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:44 2022] GET /compute/v2.1/servers/641029fb-67ea-4632-96bd-4e11ed5bb256 => generated 1544 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:45.702740 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6ad70701-18e9-4111-bf77-ed8bc4c83893 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:45.703392 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-6ad70701-18e9-4111-bf77-ed8bc4c83893 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] [instance: 97925f5c-1aad-495a-85d7-164d520a0703] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:45.710925 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6ad70701-18e9-4111-bf77-ed8bc4c83893 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:45.711440 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6ad70701-18e9-4111-bf77-ed8bc4c83893 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:45.711908 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6ad70701-18e9-4111-bf77-ed8bc4c83893 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:45.712700 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6ad70701-18e9-4111-bf77-ed8bc4c83893 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:45.713183 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6ad70701-18e9-4111-bf77-ed8bc4c83893 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:45.713636 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6ad70701-18e9-4111-bf77-ed8bc4c83893 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:45.792995 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8fbeb094-d0f4-496d-91bf-fefcf694366b tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:45.794384 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8fbeb094-d0f4-496d-91bf-fefcf694366b tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 2646dfcb-7213-4870-99eb-68311662d66b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:45.802066 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8fbeb094-d0f4-496d-91bf-fefcf694366b tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:45.802475 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8fbeb094-d0f4-496d-91bf-fefcf694366b tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:45.802916 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8fbeb094-d0f4-496d-91bf-fefcf694366b tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:45.803629 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8fbeb094-d0f4-496d-91bf-fefcf694366b tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:45.804095 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8fbeb094-d0f4-496d-91bf-fefcf694366b tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:45.804508 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8fbeb094-d0f4-496d-91bf-fefcf694366b tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:45.851321 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6ad70701-18e9-4111-bf77-ed8bc4c83893 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/97925f5c-1aad-495a-85d7-164d520a0703" status: 200 len: 1465 microversion: 2.1 time: 0.152313 Oct 04 19:09:45.857799 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3353/6722] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:45 2022] GET /compute/v2.1/servers/97925f5c-1aad-495a-85d7-164d520a0703 => generated 1465 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:45.945399 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8fbeb094-d0f4-496d-91bf-fefcf694366b tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3060cdc6eeba47288205e107717a6980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a841124bf4392b54c3d6b0ea37e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:45.953729 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8fbeb094-d0f4-496d-91bf-fefcf694366b tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b" status: 200 len: 1713 microversion: 2.1 time: 0.164679 Oct 04 19:09:45.954300 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3370/6723] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:45 2022] GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b => generated 1713 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:46.881470 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0743fab2-7e92-4dd4-a81c-4a2f29fcd211 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:46.882117 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0743fab2-7e92-4dd4-a81c-4a2f29fcd211 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] [instance: 97925f5c-1aad-495a-85d7-164d520a0703] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:46.889860 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0743fab2-7e92-4dd4-a81c-4a2f29fcd211 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:46.890328 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0743fab2-7e92-4dd4-a81c-4a2f29fcd211 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:46.890884 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0743fab2-7e92-4dd4-a81c-4a2f29fcd211 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:46.891674 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0743fab2-7e92-4dd4-a81c-4a2f29fcd211 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:46.892098 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0743fab2-7e92-4dd4-a81c-4a2f29fcd211 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:46.893496 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0743fab2-7e92-4dd4-a81c-4a2f29fcd211 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:47.037900 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0743fab2-7e92-4dd4-a81c-4a2f29fcd211 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/97925f5c-1aad-495a-85d7-164d520a0703" status: 200 len: 1465 microversion: 2.1 time: 0.161356 Oct 04 19:09:47.038861 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3354/6724] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:46 2022] GET /compute/v2.1/servers/97925f5c-1aad-495a-85d7-164d520a0703 => generated 1465 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:48.063975 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a0fcd648-e2cc-4aab-aa66-583db96062af tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:48.065929 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a0fcd648-e2cc-4aab-aa66-583db96062af tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] [instance: 97925f5c-1aad-495a-85d7-164d520a0703] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:48.074711 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a0fcd648-e2cc-4aab-aa66-583db96062af tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:48.075598 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a0fcd648-e2cc-4aab-aa66-583db96062af tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:48.075908 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a0fcd648-e2cc-4aab-aa66-583db96062af tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:48.076854 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a0fcd648-e2cc-4aab-aa66-583db96062af tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:48.077416 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a0fcd648-e2cc-4aab-aa66-583db96062af tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:48.078056 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a0fcd648-e2cc-4aab-aa66-583db96062af tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:48.225499 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a0fcd648-e2cc-4aab-aa66-583db96062af tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/97925f5c-1aad-495a-85d7-164d520a0703" status: 200 len: 1465 microversion: 2.1 time: 0.167222 Oct 04 19:09:48.226171 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3371/6725] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:48 2022] GET /compute/v2.1/servers/97925f5c-1aad-495a-85d7-164d520a0703 => generated 1465 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:49.249219 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8923481c-4b0f-4a80-8ac7-c718e3c0cfd5 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:49.250545 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8923481c-4b0f-4a80-8ac7-c718e3c0cfd5 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] [instance: 97925f5c-1aad-495a-85d7-164d520a0703] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:49.257558 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:09:49.261505 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8923481c-4b0f-4a80-8ac7-c718e3c0cfd5 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:49.262179 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8923481c-4b0f-4a80-8ac7-c718e3c0cfd5 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:49.262995 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8923481c-4b0f-4a80-8ac7-c718e3c0cfd5 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:49.264586 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8923481c-4b0f-4a80-8ac7-c718e3c0cfd5 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:49.265235 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8923481c-4b0f-4a80-8ac7-c718e3c0cfd5 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:49.265862 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8923481c-4b0f-4a80-8ac7-c718e3c0cfd5 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:49.418975 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8923481c-4b0f-4a80-8ac7-c718e3c0cfd5 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/97925f5c-1aad-495a-85d7-164d520a0703" status: 200 len: 1465 microversion: 2.1 time: 0.173645 Oct 04 19:09:49.419861 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3355/6726] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:49 2022] GET /compute/v2.1/servers/97925f5c-1aad-495a-85d7-164d520a0703 => generated 1465 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:50.443067 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b2f02e92-ec55-46ed-91d9-2c74728f3c25 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:50.443622 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b2f02e92-ec55-46ed-91d9-2c74728f3c25 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] [instance: 97925f5c-1aad-495a-85d7-164d520a0703] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:50.446451 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=16 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:09:50.456477 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b2f02e92-ec55-46ed-91d9-2c74728f3c25 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:50.456477 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b2f02e92-ec55-46ed-91d9-2c74728f3c25 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:50.456477 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b2f02e92-ec55-46ed-91d9-2c74728f3c25 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:50.456477 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b2f02e92-ec55-46ed-91d9-2c74728f3c25 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:50.456477 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b2f02e92-ec55-46ed-91d9-2c74728f3c25 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:50.468282 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b2f02e92-ec55-46ed-91d9-2c74728f3c25 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:50.620167 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b2f02e92-ec55-46ed-91d9-2c74728f3c25 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/97925f5c-1aad-495a-85d7-164d520a0703" status: 200 len: 1465 microversion: 2.1 time: 0.181325 Oct 04 19:09:50.620761 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3372/6727] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:50 2022] GET /compute/v2.1/servers/97925f5c-1aad-495a-85d7-164d520a0703 => generated 1465 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:50.737596 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-357157b3-b42a-43af-8e0f-aca3dd96d372 req-00fe277a-2818-47a8-89b4-3f0ab50c4595 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97925f5c-1aad-495a-85d7-164d520a0703", "name": "network-vif-plugged", "status": "completed", "tag": "dc8ad9b8-b5b9-4f74-a57e-81ff95daf627"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:09:50.746236 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:09:50.746986 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=14 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:09:50.756544 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-357157b3-b42a-43af-8e0f-aca3dd96d372 req-00fe277a-2818-47a8-89b4-3f0ab50c4595 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:50.757121 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-357157b3-b42a-43af-8e0f-aca3dd96d372 req-00fe277a-2818-47a8-89b4-3f0ab50c4595 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:50.757802 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-357157b3-b42a-43af-8e0f-aca3dd96d372 req-00fe277a-2818-47a8-89b4-3f0ab50c4595 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:50.798300 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-357157b3-b42a-43af-8e0f-aca3dd96d372 req-00fe277a-2818-47a8-89b4-3f0ab50c4595 service nova] Creating event network-vif-plugged:dc8ad9b8-b5b9-4f74-a57e-81ff95daf627 for instance 97925f5c-1aad-495a-85d7-164d520a0703 on n-h2-850501-14 Oct 04 19:09:50.804534 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-357157b3-b42a-43af-8e0f-aca3dd96d372 req-00fe277a-2818-47a8-89b4-3f0ab50c4595 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081038 Oct 04 19:09:50.805237 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3356/6728] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:09:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:09:51.642662 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-97048ac9-5ce1-479e-b69a-08f290790fa7 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:51.643461 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-97048ac9-5ce1-479e-b69a-08f290790fa7 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] [instance: 97925f5c-1aad-495a-85d7-164d520a0703] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:51.650439 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-97048ac9-5ce1-479e-b69a-08f290790fa7 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:51.651141 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-97048ac9-5ce1-479e-b69a-08f290790fa7 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:51.651617 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-97048ac9-5ce1-479e-b69a-08f290790fa7 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:51.652349 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-97048ac9-5ce1-479e-b69a-08f290790fa7 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:51.652812 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-97048ac9-5ce1-479e-b69a-08f290790fa7 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:51.653244 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-97048ac9-5ce1-479e-b69a-08f290790fa7 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:51.798170 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-97048ac9-5ce1-479e-b69a-08f290790fa7 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/97925f5c-1aad-495a-85d7-164d520a0703" status: 200 len: 1465 microversion: 2.1 time: 0.159155 Oct 04 19:09:51.799004 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3373/6729] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:51 2022] GET /compute/v2.1/servers/97925f5c-1aad-495a-85d7-164d520a0703 => generated 1465 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:52.823046 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e1a959b5-bb29-4d92-b6d9-72b425da650a tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:52.823926 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e1a959b5-bb29-4d92-b6d9-72b425da650a tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] [instance: 97925f5c-1aad-495a-85d7-164d520a0703] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:52.831761 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e1a959b5-bb29-4d92-b6d9-72b425da650a tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:52.832555 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e1a959b5-bb29-4d92-b6d9-72b425da650a tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:52.833007 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e1a959b5-bb29-4d92-b6d9-72b425da650a tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:52.833748 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e1a959b5-bb29-4d92-b6d9-72b425da650a tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:52.834215 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e1a959b5-bb29-4d92-b6d9-72b425da650a tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:52.834655 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e1a959b5-bb29-4d92-b6d9-72b425da650a tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:52.964169 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e1a959b5-bb29-4d92-b6d9-72b425da650a tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/97925f5c-1aad-495a-85d7-164d520a0703" status: 200 len: 1651 microversion: 2.1 time: 0.146497 Oct 04 19:09:52.964847 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3357/6730] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:52 2022] GET /compute/v2.1/servers/97925f5c-1aad-495a-85d7-164d520a0703 => generated 1651 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:52.987492 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d047db2b-73a1-499b-8b2f-d36f24039950 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:52.988034 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d047db2b-73a1-499b-8b2f-d36f24039950 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] [instance: 97925f5c-1aad-495a-85d7-164d520a0703] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:52.995251 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d047db2b-73a1-499b-8b2f-d36f24039950 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:52.996348 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d047db2b-73a1-499b-8b2f-d36f24039950 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:52.996620 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d047db2b-73a1-499b-8b2f-d36f24039950 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:52.997332 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d047db2b-73a1-499b-8b2f-d36f24039950 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:52.997791 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d047db2b-73a1-499b-8b2f-d36f24039950 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:52.998217 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d047db2b-73a1-499b-8b2f-d36f24039950 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:53.137880 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d047db2b-73a1-499b-8b2f-d36f24039950 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/97925f5c-1aad-495a-85d7-164d520a0703" status: 200 len: 1651 microversion: 2.1 time: 0.154384 Oct 04 19:09:53.138517 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3374/6731] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:52 2022] GET /compute/v2.1/servers/97925f5c-1aad-495a-85d7-164d520a0703 => generated 1651 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:53.159546 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-65c96ab5-0af1-4f30-9ec7-d49ef75d13a8 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:53.160247 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-65c96ab5-0af1-4f30-9ec7-d49ef75d13a8 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] [instance: 97925f5c-1aad-495a-85d7-164d520a0703] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:53.166400 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-65c96ab5-0af1-4f30-9ec7-d49ef75d13a8 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:53.166906 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-65c96ab5-0af1-4f30-9ec7-d49ef75d13a8 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:53.167363 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-65c96ab5-0af1-4f30-9ec7-d49ef75d13a8 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:53.168101 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-65c96ab5-0af1-4f30-9ec7-d49ef75d13a8 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:53.168583 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-65c96ab5-0af1-4f30-9ec7-d49ef75d13a8 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:53.169044 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-65c96ab5-0af1-4f30-9ec7-d49ef75d13a8 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:53.308587 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-65c96ab5-0af1-4f30-9ec7-d49ef75d13a8 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/97925f5c-1aad-495a-85d7-164d520a0703" status: 200 len: 1651 microversion: 2.1 time: 0.152747 Oct 04 19:09:53.309355 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3358/6732] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:53 2022] GET /compute/v2.1/servers/97925f5c-1aad-495a-85d7-164d520a0703 => generated 1651 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:53.333035 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-fa8bcdbc-2cbd-4e7d-8324-0aeac49d6ea6 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:53.333827 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-fa8bcdbc-2cbd-4e7d-8324-0aeac49d6ea6 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] [instance: 97925f5c-1aad-495a-85d7-164d520a0703] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:53.340781 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fa8bcdbc-2cbd-4e7d-8324-0aeac49d6ea6 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:53.341539 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fa8bcdbc-2cbd-4e7d-8324-0aeac49d6ea6 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:53.342185 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fa8bcdbc-2cbd-4e7d-8324-0aeac49d6ea6 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:53.343235 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fa8bcdbc-2cbd-4e7d-8324-0aeac49d6ea6 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:53.343870 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fa8bcdbc-2cbd-4e7d-8324-0aeac49d6ea6 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:53.344483 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fa8bcdbc-2cbd-4e7d-8324-0aeac49d6ea6 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:53.367864 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:09:53.381210 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-fa8bcdbc-2cbd-4e7d-8324-0aeac49d6ea6 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] [instance: 97925f5c-1aad-495a-85d7-164d520a0703] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:09:53.757598 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-fa8bcdbc-2cbd-4e7d-8324-0aeac49d6ea6 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] 10.222.0.20 "DELETE /compute/v2.1/servers/97925f5c-1aad-495a-85d7-164d520a0703" status: 204 len: 0 microversion: 2.1 time: 0.429589 Oct 04 19:09:53.758185 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3375/6733] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 19:09:53 2022] DELETE /compute/v2.1/servers/97925f5c-1aad-495a-85d7-164d520a0703 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:09:53.766363 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b9220652-3e92-4803-a368-feba15dc9807 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:53.767097 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b9220652-3e92-4803-a368-feba15dc9807 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] [instance: 97925f5c-1aad-495a-85d7-164d520a0703] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:53.773844 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b9220652-3e92-4803-a368-feba15dc9807 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:53.777094 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b9220652-3e92-4803-a368-feba15dc9807 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:53.777094 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b9220652-3e92-4803-a368-feba15dc9807 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:53.777094 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b9220652-3e92-4803-a368-feba15dc9807 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:53.777094 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b9220652-3e92-4803-a368-feba15dc9807 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:53.777094 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b9220652-3e92-4803-a368-feba15dc9807 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:53.914328 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b9220652-3e92-4803-a368-feba15dc9807 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/97925f5c-1aad-495a-85d7-164d520a0703" status: 200 len: 1657 microversion: 2.1 time: 0.151641 Oct 04 19:09:53.915241 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3359/6734] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:53 2022] GET /compute/v2.1/servers/97925f5c-1aad-495a-85d7-164d520a0703 => generated 1657 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:54.940437 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-cd89e7a0-0316-4454-9e6f-da33cecaf17b tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:54.942554 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-cd89e7a0-0316-4454-9e6f-da33cecaf17b tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] [instance: 97925f5c-1aad-495a-85d7-164d520a0703] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:54.949996 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cd89e7a0-0316-4454-9e6f-da33cecaf17b tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:54.950434 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cd89e7a0-0316-4454-9e6f-da33cecaf17b tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:54.950896 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cd89e7a0-0316-4454-9e6f-da33cecaf17b tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:54.951660 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cd89e7a0-0316-4454-9e6f-da33cecaf17b tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:54.952144 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cd89e7a0-0316-4454-9e6f-da33cecaf17b tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:54.952592 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cd89e7a0-0316-4454-9e6f-da33cecaf17b tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:55.109926 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-cd89e7a0-0316-4454-9e6f-da33cecaf17b tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/97925f5c-1aad-495a-85d7-164d520a0703" status: 200 len: 1657 microversion: 2.1 time: 0.174424 Oct 04 19:09:55.110570 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3376/6735] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:54 2022] GET /compute/v2.1/servers/97925f5c-1aad-495a-85d7-164d520a0703 => generated 1657 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:09:56.136383 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8740bc10-1ca1-4cbf-86eb-344847804a5f tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:56.136383 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8740bc10-1ca1-4cbf-86eb-344847804a5f tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] [instance: 97925f5c-1aad-495a-85d7-164d520a0703] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:56.146749 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8740bc10-1ca1-4cbf-86eb-344847804a5f tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:56.147905 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8740bc10-1ca1-4cbf-86eb-344847804a5f tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:56.148833 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8740bc10-1ca1-4cbf-86eb-344847804a5f tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:56.149738 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8740bc10-1ca1-4cbf-86eb-344847804a5f tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:56.150294 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8740bc10-1ca1-4cbf-86eb-344847804a5f tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:56.150807 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8740bc10-1ca1-4cbf-86eb-344847804a5f tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:56.286527 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=100 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:09:56.291099 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8740bc10-1ca1-4cbf-86eb-344847804a5f tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/97925f5c-1aad-495a-85d7-164d520a0703" status: 200 len: 1657 microversion: 2.1 time: 0.161959 Oct 04 19:09:56.291710 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3360/6736] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:56 2022] GET /compute/v2.1/servers/97925f5c-1aad-495a-85d7-164d520a0703 => generated 1657 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:56.405813 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-2f716cfe-8580-4ee5-a50d-e9e1610e7c6e req-f200a9bc-87a5-4d8a-a290-c6e1fb4461e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97925f5c-1aad-495a-85d7-164d520a0703", "name": "network-vif-deleted", "tag": "dc8ad9b8-b5b9-4f74-a57e-81ff95daf627"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:09:56.419494 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-2f716cfe-8580-4ee5-a50d-e9e1610e7c6e req-f200a9bc-87a5-4d8a-a290-c6e1fb4461e3 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:56.420142 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-2f716cfe-8580-4ee5-a50d-e9e1610e7c6e req-f200a9bc-87a5-4d8a-a290-c6e1fb4461e3 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:56.420754 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-2f716cfe-8580-4ee5-a50d-e9e1610e7c6e req-f200a9bc-87a5-4d8a-a290-c6e1fb4461e3 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:56.434710 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-2f716cfe-8580-4ee5-a50d-e9e1610e7c6e req-f200a9bc-87a5-4d8a-a290-c6e1fb4461e3 service nova] Creating event network-vif-deleted:dc8ad9b8-b5b9-4f74-a57e-81ff95daf627 for instance 97925f5c-1aad-495a-85d7-164d520a0703 on n-h2-850501-14 Oct 04 19:09:56.440016 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-2f716cfe-8580-4ee5-a50d-e9e1610e7c6e req-f200a9bc-87a5-4d8a-a290-c6e1fb4461e3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039798 Oct 04 19:09:56.441190 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3377/6737] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:09:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:09:57.315409 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-eb44c6a6-6af1-4941-89a1-7246ed1a3d8a tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:57.316113 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-eb44c6a6-6af1-4941-89a1-7246ed1a3d8a tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] [instance: 97925f5c-1aad-495a-85d7-164d520a0703] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:57.323832 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eb44c6a6-6af1-4941-89a1-7246ed1a3d8a tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:57.324679 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eb44c6a6-6af1-4941-89a1-7246ed1a3d8a tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:57.325135 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eb44c6a6-6af1-4941-89a1-7246ed1a3d8a tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:57.325872 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eb44c6a6-6af1-4941-89a1-7246ed1a3d8a tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:57.326341 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eb44c6a6-6af1-4941-89a1-7246ed1a3d8a tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:57.326783 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eb44c6a6-6af1-4941-89a1-7246ed1a3d8a tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:57.362022 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eb44c6a6-6af1-4941-89a1-7246ed1a3d8a tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:57.362727 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eb44c6a6-6af1-4941-89a1-7246ed1a3d8a tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:57.363701 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eb44c6a6-6af1-4941-89a1-7246ed1a3d8a tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:57.364260 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-eb44c6a6-6af1-4941-89a1-7246ed1a3d8a tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lazy-loading 'fault' on Instance uuid 97925f5c-1aad-495a-85d7-164d520a0703 {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:09:57.414397 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-eb44c6a6-6af1-4941-89a1-7246ed1a3d8a tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/97925f5c-1aad-495a-85d7-164d520a0703" status: 200 len: 1455 microversion: 2.1 time: 0.103245 Oct 04 19:09:57.414978 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3361/6738] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:57 2022] GET /compute/v2.1/servers/97925f5c-1aad-495a-85d7-164d520a0703 => generated 1455 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:58.439132 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6d7ceaf6-ecd0-412b-b281-676457ede890 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:58.439851 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6d7ceaf6-ecd0-412b-b281-676457ede890 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] [instance: 97925f5c-1aad-495a-85d7-164d520a0703] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:58.446847 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6d7ceaf6-ecd0-412b-b281-676457ede890 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:58.447337 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6d7ceaf6-ecd0-412b-b281-676457ede890 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:58.447775 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6d7ceaf6-ecd0-412b-b281-676457ede890 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:58.448764 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6d7ceaf6-ecd0-412b-b281-676457ede890 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:58.449417 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6d7ceaf6-ecd0-412b-b281-676457ede890 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:58.449662 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6d7ceaf6-ecd0-412b-b281-676457ede890 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:58.463880 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-6d7ceaf6-ecd0-412b-b281-676457ede890 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] HTTP exception thrown: Instance 97925f5c-1aad-495a-85d7-164d520a0703 could not be found. Oct 04 19:09:58.465587 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6d7ceaf6-ecd0-412b-b281-676457ede890 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Request method failure captured: Oct 04 19:09:58.465587 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/97925f5c-1aad-495a-85d7-164d520a0703 HTTP/1.1 Oct 04 19:09:58.465587 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 19:09:58.465587 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 19:09:58.465587 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 19:09:58.465587 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 19:09:58.465587 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 19:09:58.465587 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 19:09:58.465587 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 19:09:58.465587 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 19:09:58.465587 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPITg2NKl-Hf_lDQ2pF53PsfQ0y12UqSDtr3LL21zjOuM-m3S9-h8DSfD8vNsgzS-scPPCTGc8QJuJ0SZy5udqXuXMKozJjfZ3f-Zxvfs6NAtt8miAd6D_Y75FQK_VHgB9qVvnpM1KLtaVQVWkllqLZr1LKbS2ujY_n7gLdWToH0R4x0 Oct 04 19:09:58.465587 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 19:09:58.465587 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 19:09:58.465587 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 19:09:58.465587 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 19:09:58.465587 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 19:09:58.465587 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 19:09:58.465587 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 66f955c3f7e64151a36b6ac1d7325406 Oct 04 19:09:58.465587 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-TestServerMultinode-1917040137 Oct 04 19:09:58.465587 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member,admin Oct 04 19:09:58.465587 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member,admin Oct 04 19:09:58.465587 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/66f955c3f7e64151a36b6ac1d7325406"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_66f955c3f7e64151a36b6ac1d7325406", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/66f955c3f7e64151a36b6ac1d7325406"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/66f955c3f7e64151a36b6ac1d7325406"}]}] Oct 04 19:09:58.465587 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-TestServerMultinode-1917040137 Oct 04 19:09:58.465587 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 66f955c3f7e64151a36b6ac1d7325406 Oct 04 19:09:58.465587 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-TestServerMultinode-1917040137 Oct 04 19:09:58.465587 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-TestServerMultinode-1917040137-project-admin Oct 04 19:09:58.465587 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 19:09:58.465587 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 19:09:58.465587 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 7d24a34dd81741f384f1b2a748b9d528 Oct 04 19:09:58.465587 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-TestServerMultinode-1917040137-project-admin Oct 04 19:09:58.465587 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 19:09:58.465587 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 97925f5c-1aad-495a-85d7-164d520a0703 could not be found. Oct 04 19:09:58.465587 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '97925f5c-1aad-495a-85d7-164d520a0703'} Oct 04 19:09:58.465587 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:09:58.465587 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:09:58.465587 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:09:58.465587 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:09:58.465587 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:09:58.465587 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:09:58.465587 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:09:58.465587 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:09:58.465587 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:09:58.465587 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:09:58.465587 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97925f5c-1aad-495a-85d7-164d520a0703 could not be found. Oct 04 19:09:58.465587 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:09:58.465587 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:09:58.465587 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:09:58.465587 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:09:58.465587 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:09:58.465587 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:09:58.465587 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:09:58.465587 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:09:58.465587 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:09:58.465587 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:09:58.465587 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:09:58.465587 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:09:58.465587 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:09:58.465587 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:09:58.465587 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:09:58.465587 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:09:58.465587 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97925f5c-1aad-495a-85d7-164d520a0703 could not be found. Oct 04 19:09:58.465587 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:09:58.465587 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:09:58.465587 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:09:58.474747 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:09:58.474747 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:09:58.474747 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:09:58.474747 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:09:58.474747 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:09:58.474747 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97925f5c-1aad-495a-85d7-164d520a0703 could not be found. Oct 04 19:09:58.474747 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:09:58.474747 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6d7ceaf6-ecd0-412b-b281-676457ede890 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Returning 404 to user: Instance 97925f5c-1aad-495a-85d7-164d520a0703 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:09:58.474747 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6d7ceaf6-ecd0-412b-b281-676457ede890 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/97925f5c-1aad-495a-85d7-164d520a0703" status: 404 len: 111 microversion: 2.1 time: 0.032995 Oct 04 19:09:58.474747 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3378/6739] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:58 2022] GET /compute/v2.1/servers/97925f5c-1aad-495a-85d7-164d520a0703 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:09:58.478775 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4ad5b4d7-85ec-49e8-a2ef-b4e1f82d5226 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:58.479297 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4ad5b4d7-85ec-49e8-a2ef-b4e1f82d5226 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] [instance: 4dbf84c3-f185-4565-9e8e-99beba05087d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:58.485969 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4ad5b4d7-85ec-49e8-a2ef-b4e1f82d5226 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:58.486471 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4ad5b4d7-85ec-49e8-a2ef-b4e1f82d5226 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:58.486927 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4ad5b4d7-85ec-49e8-a2ef-b4e1f82d5226 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:58.487725 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4ad5b4d7-85ec-49e8-a2ef-b4e1f82d5226 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:58.488640 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4ad5b4d7-85ec-49e8-a2ef-b4e1f82d5226 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:58.489490 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4ad5b4d7-85ec-49e8-a2ef-b4e1f82d5226 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:58.517615 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4ad5b4d7-85ec-49e8-a2ef-b4e1f82d5226 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] [instance: 4dbf84c3-f185-4565-9e8e-99beba05087d] Going to try to terminate instance {{(pid=123002) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:09:58.817889 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4ad5b4d7-85ec-49e8-a2ef-b4e1f82d5226 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] 10.222.0.20 "DELETE /compute/v2.1/servers/4dbf84c3-f185-4565-9e8e-99beba05087d" status: 204 len: 0 microversion: 2.1 time: 0.342600 Oct 04 19:09:58.818509 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3362/6740] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 19:09:58 2022] DELETE /compute/v2.1/servers/4dbf84c3-f185-4565-9e8e-99beba05087d => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:09:58.826645 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ebd75e28-bb1d-41c0-8531-f13d004aace5 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:58.827267 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ebd75e28-bb1d-41c0-8531-f13d004aace5 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] [instance: 4dbf84c3-f185-4565-9e8e-99beba05087d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:58.834161 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ebd75e28-bb1d-41c0-8531-f13d004aace5 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:58.834649 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ebd75e28-bb1d-41c0-8531-f13d004aace5 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:58.835090 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ebd75e28-bb1d-41c0-8531-f13d004aace5 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:58.835789 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ebd75e28-bb1d-41c0-8531-f13d004aace5 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:58.836285 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ebd75e28-bb1d-41c0-8531-f13d004aace5 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:58.836714 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ebd75e28-bb1d-41c0-8531-f13d004aace5 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:58.973431 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ebd75e28-bb1d-41c0-8531-f13d004aace5 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/4dbf84c3-f185-4565-9e8e-99beba05087d" status: 200 len: 1657 microversion: 2.1 time: 0.149846 Oct 04 19:09:58.973997 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3379/6741] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:58 2022] GET /compute/v2.1/servers/4dbf84c3-f185-4565-9e8e-99beba05087d => generated 1657 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:59.999914 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-41a1de75-dd09-42be-922f-bf23bb16fcc2 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:00.000739 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-41a1de75-dd09-42be-922f-bf23bb16fcc2 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] [instance: 4dbf84c3-f185-4565-9e8e-99beba05087d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:00.008622 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-41a1de75-dd09-42be-922f-bf23bb16fcc2 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:00.009139 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-41a1de75-dd09-42be-922f-bf23bb16fcc2 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:00.009591 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-41a1de75-dd09-42be-922f-bf23bb16fcc2 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:00.010311 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-41a1de75-dd09-42be-922f-bf23bb16fcc2 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:00.010781 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-41a1de75-dd09-42be-922f-bf23bb16fcc2 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:00.011527 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-41a1de75-dd09-42be-922f-bf23bb16fcc2 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:00.146414 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-41a1de75-dd09-42be-922f-bf23bb16fcc2 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/4dbf84c3-f185-4565-9e8e-99beba05087d" status: 200 len: 1657 microversion: 2.1 time: 0.150960 Oct 04 19:10:00.146995 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3363/6742] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:59 2022] GET /compute/v2.1/servers/4dbf84c3-f185-4565-9e8e-99beba05087d => generated 1657 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:00.743321 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-885e5024-45e2-452e-ab5c-42ab6a6275b0 req-21b529f0-3681-43d7-a5f8-cf65ae19c91b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dbf84c3-f185-4565-9e8e-99beba05087d", "name": "network-vif-deleted", "tag": "57105637-fd5c-401f-a764-b6dd2242d686"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:10:00.754677 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-885e5024-45e2-452e-ab5c-42ab6a6275b0 req-21b529f0-3681-43d7-a5f8-cf65ae19c91b service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:00.755162 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-885e5024-45e2-452e-ab5c-42ab6a6275b0 req-21b529f0-3681-43d7-a5f8-cf65ae19c91b service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:00.755598 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-885e5024-45e2-452e-ab5c-42ab6a6275b0 req-21b529f0-3681-43d7-a5f8-cf65ae19c91b service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:00.775971 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-885e5024-45e2-452e-ab5c-42ab6a6275b0 req-21b529f0-3681-43d7-a5f8-cf65ae19c91b service nova] Creating event network-vif-deleted:57105637-fd5c-401f-a764-b6dd2242d686 for instance 4dbf84c3-f185-4565-9e8e-99beba05087d on n-h1-850501-14 Oct 04 19:10:00.784497 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-885e5024-45e2-452e-ab5c-42ab6a6275b0 req-21b529f0-3681-43d7-a5f8-cf65ae19c91b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044953 Oct 04 19:10:00.787762 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3380/6743] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:10:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:10:01.170339 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-bbb5e210-736e-4673-9480-853db464739e tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:01.170905 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-bbb5e210-736e-4673-9480-853db464739e tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] [instance: 4dbf84c3-f185-4565-9e8e-99beba05087d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:01.178014 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bbb5e210-736e-4673-9480-853db464739e tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:01.178514 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bbb5e210-736e-4673-9480-853db464739e tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:01.179043 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bbb5e210-736e-4673-9480-853db464739e tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:01.179933 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bbb5e210-736e-4673-9480-853db464739e tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:01.180498 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bbb5e210-736e-4673-9480-853db464739e tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:01.181055 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bbb5e210-736e-4673-9480-853db464739e tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:01.221033 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bbb5e210-736e-4673-9480-853db464739e tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:01.221553 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bbb5e210-736e-4673-9480-853db464739e tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:01.222218 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bbb5e210-736e-4673-9480-853db464739e tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:01.222979 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-bbb5e210-736e-4673-9480-853db464739e tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lazy-loading 'fault' on Instance uuid 4dbf84c3-f185-4565-9e8e-99beba05087d {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:10:01.279032 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-bbb5e210-736e-4673-9480-853db464739e tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/4dbf84c3-f185-4565-9e8e-99beba05087d" status: 200 len: 1456 microversion: 2.1 time: 0.108303 Oct 04 19:10:01.279032 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3364/6744] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:01 2022] GET /compute/v2.1/servers/4dbf84c3-f185-4565-9e8e-99beba05087d => generated 1456 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:02.299246 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b02dcaf5-e3ce-4e0a-b5fe-bae3183a89b2 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:02.299946 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b02dcaf5-e3ce-4e0a-b5fe-bae3183a89b2 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] [instance: 4dbf84c3-f185-4565-9e8e-99beba05087d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:02.307489 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b02dcaf5-e3ce-4e0a-b5fe-bae3183a89b2 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:02.307975 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b02dcaf5-e3ce-4e0a-b5fe-bae3183a89b2 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:02.308443 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b02dcaf5-e3ce-4e0a-b5fe-bae3183a89b2 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:02.309140 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b02dcaf5-e3ce-4e0a-b5fe-bae3183a89b2 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:02.309599 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b02dcaf5-e3ce-4e0a-b5fe-bae3183a89b2 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:02.310026 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b02dcaf5-e3ce-4e0a-b5fe-bae3183a89b2 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:02.324204 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-b02dcaf5-e3ce-4e0a-b5fe-bae3183a89b2 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] HTTP exception thrown: Instance 4dbf84c3-f185-4565-9e8e-99beba05087d could not be found. Oct 04 19:10:02.325885 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b02dcaf5-e3ce-4e0a-b5fe-bae3183a89b2 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Request method failure captured: Oct 04 19:10:02.325885 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/4dbf84c3-f185-4565-9e8e-99beba05087d HTTP/1.1 Oct 04 19:10:02.325885 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 19:10:02.325885 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 19:10:02.325885 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 19:10:02.325885 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 19:10:02.325885 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 19:10:02.325885 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 19:10:02.325885 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 19:10:02.325885 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 19:10:02.325885 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPITg2NKl-Hf_lDQ2pF53PsfQ0y12UqSDtr3LL21zjOuM-m3S9-h8DSfD8vNsgzS-scPPCTGc8QJuJ0SZy5udqXuXMKozJjfZ3f-Zxvfs6NAtt8miAd6D_Y75FQK_VHgB9qVvnpM1KLtaVQVWkllqLZr1LKbS2ujY_n7gLdWToH0R4x0 Oct 04 19:10:02.325885 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 19:10:02.325885 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 19:10:02.325885 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 19:10:02.325885 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 19:10:02.325885 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 19:10:02.325885 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 19:10:02.325885 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 66f955c3f7e64151a36b6ac1d7325406 Oct 04 19:10:02.325885 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-TestServerMultinode-1917040137 Oct 04 19:10:02.325885 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member,admin Oct 04 19:10:02.325885 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member,admin Oct 04 19:10:02.325885 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/66f955c3f7e64151a36b6ac1d7325406"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_66f955c3f7e64151a36b6ac1d7325406", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/66f955c3f7e64151a36b6ac1d7325406"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/66f955c3f7e64151a36b6ac1d7325406"}]}] Oct 04 19:10:02.325885 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-TestServerMultinode-1917040137 Oct 04 19:10:02.325885 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 66f955c3f7e64151a36b6ac1d7325406 Oct 04 19:10:02.325885 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-TestServerMultinode-1917040137 Oct 04 19:10:02.325885 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-TestServerMultinode-1917040137-project-admin Oct 04 19:10:02.325885 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 19:10:02.325885 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 19:10:02.325885 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 7d24a34dd81741f384f1b2a748b9d528 Oct 04 19:10:02.325885 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-TestServerMultinode-1917040137-project-admin Oct 04 19:10:02.325885 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 19:10:02.325885 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 4dbf84c3-f185-4565-9e8e-99beba05087d could not be found. Oct 04 19:10:02.325885 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '4dbf84c3-f185-4565-9e8e-99beba05087d'} Oct 04 19:10:02.325885 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:10:02.325885 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:10:02.325885 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:10:02.325885 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:10:02.325885 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:10:02.325885 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:10:02.325885 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:10:02.325885 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:10:02.325885 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:10:02.325885 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:10:02.325885 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4dbf84c3-f185-4565-9e8e-99beba05087d could not be found. Oct 04 19:10:02.325885 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:10:02.325885 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:10:02.325885 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:10:02.325885 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:10:02.325885 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:10:02.325885 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:10:02.325885 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:10:02.325885 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:10:02.325885 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:10:02.325885 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:10:02.325885 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:10:02.325885 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:10:02.325885 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:10:02.325885 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:10:02.325885 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:10:02.325885 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:10:02.325885 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4dbf84c3-f185-4565-9e8e-99beba05087d could not be found. Oct 04 19:10:02.325885 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:10:02.325885 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:10:02.325885 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:10:02.330826 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:10:02.330826 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:10:02.330826 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:10:02.330826 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:10:02.330826 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:10:02.330826 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4dbf84c3-f185-4565-9e8e-99beba05087d could not be found. Oct 04 19:10:02.330826 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:10:02.330826 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b02dcaf5-e3ce-4e0a-b5fe-bae3183a89b2 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] Returning 404 to user: Instance 4dbf84c3-f185-4565-9e8e-99beba05087d could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:10:02.330826 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b02dcaf5-e3ce-4e0a-b5fe-bae3183a89b2 tempest-TestServerMultinode-1917040137 tempest-TestServerMultinode-1917040137-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/4dbf84c3-f185-4565-9e8e-99beba05087d" status: 404 len: 111 microversion: 2.1 time: 0.032952 Oct 04 19:10:02.330826 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3381/6745] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:02 2022] GET /compute/v2.1/servers/4dbf84c3-f185-4565-9e8e-99beba05087d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:10:10.467978 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-63763c05-0aca-4874-9305-681a443e124d tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1726561324", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:10:10.528091 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-63763c05-0aca-4874-9305-681a443e124d tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] validate_networks() for None {{(pid=123002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:10:10.734997 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-63763c05-0aca-4874-9305-681a443e124d tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:10:10.735439 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-63763c05-0aca-4874-9305-681a443e124d tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:10:10.735929 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-63763c05-0aca-4874-9305-681a443e124d tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:10:10.736394 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-63763c05-0aca-4874-9305-681a443e124d tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:10:10.736826 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-63763c05-0aca-4874-9305-681a443e124d tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:10:10.746101 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-63763c05-0aca-4874-9305-681a443e124d tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:10.746595 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-63763c05-0aca-4874-9305-681a443e124d tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:10.747045 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-63763c05-0aca-4874-9305-681a443e124d tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:10.747786 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-63763c05-0aca-4874-9305-681a443e124d tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:10.748299 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-63763c05-0aca-4874-9305-681a443e124d tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:10.748735 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-63763c05-0aca-4874-9305-681a443e124d tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:10.766889 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-63763c05-0aca-4874-9305-681a443e124d tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Getting quotas for project 3a9ff76235af4fe18e50ae21f9c48af8. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:10:10.772976 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-63763c05-0aca-4874-9305-681a443e124d tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Getting quotas for user faeb43ec71d149c8a9b2ecf5c190ff81 and project 3a9ff76235af4fe18e50ae21f9c48af8. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:10:10.785483 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-63763c05-0aca-4874-9305-681a443e124d tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Going to run 1 instances... {{(pid=123002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:10:10.788442 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-63763c05-0aca-4874-9305-681a443e124d tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] [instance: 4ef4defa-c86d-4354-9123-0fd63040609d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:10:10.908028 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-63763c05-0aca-4874-9305-681a443e124d tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.444088 Oct 04 19:10:10.908827 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3365/6746] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 19:10:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 446 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:10:10.920955 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-136ad668-ea9d-4b8f-af5d-8842e9c123b6 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:10.922159 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-136ad668-ea9d-4b8f-af5d-8842e9c123b6 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] [instance: 4ef4defa-c86d-4354-9123-0fd63040609d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:10.979211 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-136ad668-ea9d-4b8f-af5d-8842e9c123b6 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faeb43ec71d149c8a9b2ecf5c190ff81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a9ff76235af4fe18e50ae21f9c48af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:10.990738 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-136ad668-ea9d-4b8f-af5d-8842e9c123b6 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] 10.222.0.20 "GET /compute/v2.1/servers/4ef4defa-c86d-4354-9123-0fd63040609d" status: 200 len: 1214 microversion: 2.1 time: 0.073096 Oct 04 19:10:10.991914 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3382/6747] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:10 2022] GET /compute/v2.1/servers/4ef4defa-c86d-4354-9123-0fd63040609d => generated 1214 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:12.015623 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-78fcf34e-573e-4cba-af97-87000e4f1964 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:12.016429 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-78fcf34e-573e-4cba-af97-87000e4f1964 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] [instance: 4ef4defa-c86d-4354-9123-0fd63040609d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:12.070465 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-78fcf34e-573e-4cba-af97-87000e4f1964 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faeb43ec71d149c8a9b2ecf5c190ff81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a9ff76235af4fe18e50ae21f9c48af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:12.077903 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-78fcf34e-573e-4cba-af97-87000e4f1964 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] 10.222.0.20 "GET /compute/v2.1/servers/4ef4defa-c86d-4354-9123-0fd63040609d" status: 200 len: 1214 microversion: 2.1 time: 0.068123 Oct 04 19:10:12.078477 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3366/6748] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:12 2022] GET /compute/v2.1/servers/4ef4defa-c86d-4354-9123-0fd63040609d => generated 1214 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:13.101304 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-22c2cc51-ec61-4abb-8295-f38c3abafddc tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:13.101941 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-22c2cc51-ec61-4abb-8295-f38c3abafddc tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] [instance: 4ef4defa-c86d-4354-9123-0fd63040609d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:13.104731 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:10:13.109790 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-22c2cc51-ec61-4abb-8295-f38c3abafddc tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:13.114489 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-22c2cc51-ec61-4abb-8295-f38c3abafddc tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:13.114489 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-22c2cc51-ec61-4abb-8295-f38c3abafddc tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:13.114489 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-22c2cc51-ec61-4abb-8295-f38c3abafddc tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:13.114489 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-22c2cc51-ec61-4abb-8295-f38c3abafddc tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:13.114489 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-22c2cc51-ec61-4abb-8295-f38c3abafddc tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:13.181270 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-22c2cc51-ec61-4abb-8295-f38c3abafddc tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faeb43ec71d149c8a9b2ecf5c190ff81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a9ff76235af4fe18e50ae21f9c48af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:13.189193 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-22c2cc51-ec61-4abb-8295-f38c3abafddc tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] 10.222.0.20 "GET /compute/v2.1/servers/4ef4defa-c86d-4354-9123-0fd63040609d" status: 200 len: 1266 microversion: 2.1 time: 0.092270 Oct 04 19:10:13.190049 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3383/6749] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:13 2022] GET /compute/v2.1/servers/4ef4defa-c86d-4354-9123-0fd63040609d => generated 1266 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:14.214136 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-df785345-e862-4cff-bcfd-707327e8a82d tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:14.214983 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-df785345-e862-4cff-bcfd-707327e8a82d tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] [instance: 4ef4defa-c86d-4354-9123-0fd63040609d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:14.223154 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-df785345-e862-4cff-bcfd-707327e8a82d tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:14.223657 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-df785345-e862-4cff-bcfd-707327e8a82d tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:14.225486 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-df785345-e862-4cff-bcfd-707327e8a82d tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:14.226275 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-df785345-e862-4cff-bcfd-707327e8a82d tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:14.226762 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-df785345-e862-4cff-bcfd-707327e8a82d tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:14.227207 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-df785345-e862-4cff-bcfd-707327e8a82d tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:14.760532 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-df785345-e862-4cff-bcfd-707327e8a82d tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faeb43ec71d149c8a9b2ecf5c190ff81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a9ff76235af4fe18e50ae21f9c48af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:14.768644 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-df785345-e862-4cff-bcfd-707327e8a82d tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] 10.222.0.20 "GET /compute/v2.1/servers/4ef4defa-c86d-4354-9123-0fd63040609d" status: 200 len: 1314 microversion: 2.1 time: 0.560220 Oct 04 19:10:14.769239 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3367/6750] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:14 2022] GET /compute/v2.1/servers/4ef4defa-c86d-4354-9123-0fd63040609d => generated 1314 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:15.651327 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-6c6b88b0-5d21-44cc-9334-df4cc53b7e08 req-a0adc07c-8621-4c75-9401-aa336d974758 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ef4defa-c86d-4354-9123-0fd63040609d", "tag": "801c5b8e-0faa-41d1-87f3-6c28399e3985"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:10:15.657924 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:10:15.664412 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-6c6b88b0-5d21-44cc-9334-df4cc53b7e08 req-a0adc07c-8621-4c75-9401-aa336d974758 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:15.664898 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-6c6b88b0-5d21-44cc-9334-df4cc53b7e08 req-a0adc07c-8621-4c75-9401-aa336d974758 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:15.665353 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-6c6b88b0-5d21-44cc-9334-df4cc53b7e08 req-a0adc07c-8621-4c75-9401-aa336d974758 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:15.676446 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-6c6b88b0-5d21-44cc-9334-df4cc53b7e08 req-a0adc07c-8621-4c75-9401-aa336d974758 service nova] Creating event network-changed:801c5b8e-0faa-41d1-87f3-6c28399e3985 for instance 4ef4defa-c86d-4354-9123-0fd63040609d on n-h1-850501-14 Oct 04 19:10:15.681768 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-6c6b88b0-5d21-44cc-9334-df4cc53b7e08 req-a0adc07c-8621-4c75-9401-aa336d974758 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034747 Oct 04 19:10:15.682790 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3384/6751] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:10:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:10:15.796444 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e0245042-5e39-4e88-9192-703083914cbc tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:15.797164 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e0245042-5e39-4e88-9192-703083914cbc tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] [instance: 4ef4defa-c86d-4354-9123-0fd63040609d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:15.804345 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e0245042-5e39-4e88-9192-703083914cbc tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:15.804857 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e0245042-5e39-4e88-9192-703083914cbc tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:15.805313 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e0245042-5e39-4e88-9192-703083914cbc tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:15.806112 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e0245042-5e39-4e88-9192-703083914cbc tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:15.806592 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e0245042-5e39-4e88-9192-703083914cbc tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:15.807038 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e0245042-5e39-4e88-9192-703083914cbc tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:15.999676 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e0245042-5e39-4e88-9192-703083914cbc tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faeb43ec71d149c8a9b2ecf5c190ff81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a9ff76235af4fe18e50ae21f9c48af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:16.008467 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e0245042-5e39-4e88-9192-703083914cbc tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] 10.222.0.20 "GET /compute/v2.1/servers/4ef4defa-c86d-4354-9123-0fd63040609d" status: 200 len: 1314 microversion: 2.1 time: 0.215911 Oct 04 19:10:16.009049 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3368/6752] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:15 2022] GET /compute/v2.1/servers/4ef4defa-c86d-4354-9123-0fd63040609d => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:17.032735 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ed9f3860-5aa5-4e46-864d-43c37a7dc9af tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:17.033356 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ed9f3860-5aa5-4e46-864d-43c37a7dc9af tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] [instance: 4ef4defa-c86d-4354-9123-0fd63040609d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:17.041909 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ed9f3860-5aa5-4e46-864d-43c37a7dc9af tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:17.042389 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ed9f3860-5aa5-4e46-864d-43c37a7dc9af tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:17.042821 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ed9f3860-5aa5-4e46-864d-43c37a7dc9af tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:17.043503 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ed9f3860-5aa5-4e46-864d-43c37a7dc9af tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:17.043955 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ed9f3860-5aa5-4e46-864d-43c37a7dc9af tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:17.044401 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ed9f3860-5aa5-4e46-864d-43c37a7dc9af tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:17.176139 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ed9f3860-5aa5-4e46-864d-43c37a7dc9af tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faeb43ec71d149c8a9b2ecf5c190ff81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a9ff76235af4fe18e50ae21f9c48af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:17.184618 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ed9f3860-5aa5-4e46-864d-43c37a7dc9af tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] 10.222.0.20 "GET /compute/v2.1/servers/4ef4defa-c86d-4354-9123-0fd63040609d" status: 200 len: 1314 microversion: 2.1 time: 0.156722 Oct 04 19:10:17.185199 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3385/6753] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:17 2022] GET /compute/v2.1/servers/4ef4defa-c86d-4354-9123-0fd63040609d => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:18.207209 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-74c97129-dc2d-4b3a-a8be-756aacf120d3 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:18.208160 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-74c97129-dc2d-4b3a-a8be-756aacf120d3 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] [instance: 4ef4defa-c86d-4354-9123-0fd63040609d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:18.215279 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-74c97129-dc2d-4b3a-a8be-756aacf120d3 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:18.215783 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-74c97129-dc2d-4b3a-a8be-756aacf120d3 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:18.216275 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-74c97129-dc2d-4b3a-a8be-756aacf120d3 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:18.216987 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-74c97129-dc2d-4b3a-a8be-756aacf120d3 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:18.217449 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-74c97129-dc2d-4b3a-a8be-756aacf120d3 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:18.217883 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-74c97129-dc2d-4b3a-a8be-756aacf120d3 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:18.355572 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-74c97129-dc2d-4b3a-a8be-756aacf120d3 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faeb43ec71d149c8a9b2ecf5c190ff81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a9ff76235af4fe18e50ae21f9c48af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:18.363450 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-74c97129-dc2d-4b3a-a8be-756aacf120d3 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] 10.222.0.20 "GET /compute/v2.1/servers/4ef4defa-c86d-4354-9123-0fd63040609d" status: 200 len: 1314 microversion: 2.1 time: 0.160208 Oct 04 19:10:18.364018 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3369/6754] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:18 2022] GET /compute/v2.1/servers/4ef4defa-c86d-4354-9123-0fd63040609d => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:19.386850 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-509af2e3-3fd4-4fc0-b6f9-095a598229c8 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:19.387594 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-509af2e3-3fd4-4fc0-b6f9-095a598229c8 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] [instance: 4ef4defa-c86d-4354-9123-0fd63040609d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:19.394604 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-509af2e3-3fd4-4fc0-b6f9-095a598229c8 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:19.395094 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-509af2e3-3fd4-4fc0-b6f9-095a598229c8 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:19.396072 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-509af2e3-3fd4-4fc0-b6f9-095a598229c8 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:19.396912 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-509af2e3-3fd4-4fc0-b6f9-095a598229c8 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:19.397500 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-509af2e3-3fd4-4fc0-b6f9-095a598229c8 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:19.397926 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-509af2e3-3fd4-4fc0-b6f9-095a598229c8 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:19.531300 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-509af2e3-3fd4-4fc0-b6f9-095a598229c8 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faeb43ec71d149c8a9b2ecf5c190ff81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a9ff76235af4fe18e50ae21f9c48af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:19.539625 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-509af2e3-3fd4-4fc0-b6f9-095a598229c8 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] 10.222.0.20 "GET /compute/v2.1/servers/4ef4defa-c86d-4354-9123-0fd63040609d" status: 200 len: 1314 microversion: 2.1 time: 0.156749 Oct 04 19:10:19.540224 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3386/6755] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:19 2022] GET /compute/v2.1/servers/4ef4defa-c86d-4354-9123-0fd63040609d => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:20.562804 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-35e34634-1bec-463b-b5fa-1674e96a5fa6 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:20.563471 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-35e34634-1bec-463b-b5fa-1674e96a5fa6 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] [instance: 4ef4defa-c86d-4354-9123-0fd63040609d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:20.566293 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:10:20.571642 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-35e34634-1bec-463b-b5fa-1674e96a5fa6 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:20.572174 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-35e34634-1bec-463b-b5fa-1674e96a5fa6 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:20.572627 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-35e34634-1bec-463b-b5fa-1674e96a5fa6 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:20.573342 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-35e34634-1bec-463b-b5fa-1674e96a5fa6 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:20.573810 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-35e34634-1bec-463b-b5fa-1674e96a5fa6 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:20.574252 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-35e34634-1bec-463b-b5fa-1674e96a5fa6 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:20.707262 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-35e34634-1bec-463b-b5fa-1674e96a5fa6 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faeb43ec71d149c8a9b2ecf5c190ff81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a9ff76235af4fe18e50ae21f9c48af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:20.715973 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-35e34634-1bec-463b-b5fa-1674e96a5fa6 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] 10.222.0.20 "GET /compute/v2.1/servers/4ef4defa-c86d-4354-9123-0fd63040609d" status: 200 len: 1314 microversion: 2.1 time: 0.157094 Oct 04 19:10:20.722161 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3370/6756] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:20 2022] GET /compute/v2.1/servers/4ef4defa-c86d-4354-9123-0fd63040609d => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:21.738788 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-76f336fb-3386-4e78-b752-85432eb29ef7 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:21.739414 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-76f336fb-3386-4e78-b752-85432eb29ef7 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] [instance: 4ef4defa-c86d-4354-9123-0fd63040609d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:21.742147 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:10:21.746990 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-76f336fb-3386-4e78-b752-85432eb29ef7 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:21.747476 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-76f336fb-3386-4e78-b752-85432eb29ef7 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:21.747917 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-76f336fb-3386-4e78-b752-85432eb29ef7 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:21.748657 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-76f336fb-3386-4e78-b752-85432eb29ef7 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:21.749102 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-76f336fb-3386-4e78-b752-85432eb29ef7 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:21.749536 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-76f336fb-3386-4e78-b752-85432eb29ef7 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:21.886590 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-76f336fb-3386-4e78-b752-85432eb29ef7 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faeb43ec71d149c8a9b2ecf5c190ff81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a9ff76235af4fe18e50ae21f9c48af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:21.894393 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-76f336fb-3386-4e78-b752-85432eb29ef7 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] 10.222.0.20 "GET /compute/v2.1/servers/4ef4defa-c86d-4354-9123-0fd63040609d" status: 200 len: 1314 microversion: 2.1 time: 0.159565 Oct 04 19:10:21.895005 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3387/6757] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:21 2022] GET /compute/v2.1/servers/4ef4defa-c86d-4354-9123-0fd63040609d => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:22.027188 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-106898c8-728f-4129-a27f-504db9375539 req-12d97f76-5154-40f8-93ff-76e019128116 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ef4defa-c86d-4354-9123-0fd63040609d", "name": "network-vif-plugged", "status": "completed", "tag": "801c5b8e-0faa-41d1-87f3-6c28399e3985"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:10:22.036670 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:10:22.038831 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-106898c8-728f-4129-a27f-504db9375539 req-12d97f76-5154-40f8-93ff-76e019128116 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:22.039319 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-106898c8-728f-4129-a27f-504db9375539 req-12d97f76-5154-40f8-93ff-76e019128116 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:22.039758 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-106898c8-728f-4129-a27f-504db9375539 req-12d97f76-5154-40f8-93ff-76e019128116 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:22.050741 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-106898c8-728f-4129-a27f-504db9375539 req-12d97f76-5154-40f8-93ff-76e019128116 service nova] Creating event network-vif-plugged:801c5b8e-0faa-41d1-87f3-6c28399e3985 for instance 4ef4defa-c86d-4354-9123-0fd63040609d on n-h1-850501-14 Oct 04 19:10:22.056254 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-106898c8-728f-4129-a27f-504db9375539 req-12d97f76-5154-40f8-93ff-76e019128116 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032723 Oct 04 19:10:22.060367 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3371/6758] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:10:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:10:22.917763 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-81fc5a04-efa6-42f9-9c88-cbafe0ca63e2 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:22.918533 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-81fc5a04-efa6-42f9-9c88-cbafe0ca63e2 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] [instance: 4ef4defa-c86d-4354-9123-0fd63040609d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:22.925498 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-81fc5a04-efa6-42f9-9c88-cbafe0ca63e2 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:22.925979 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-81fc5a04-efa6-42f9-9c88-cbafe0ca63e2 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:22.926411 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-81fc5a04-efa6-42f9-9c88-cbafe0ca63e2 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:22.927261 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-81fc5a04-efa6-42f9-9c88-cbafe0ca63e2 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:22.927596 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-81fc5a04-efa6-42f9-9c88-cbafe0ca63e2 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:22.928298 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-81fc5a04-efa6-42f9-9c88-cbafe0ca63e2 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:23.066619 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-81fc5a04-efa6-42f9-9c88-cbafe0ca63e2 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faeb43ec71d149c8a9b2ecf5c190ff81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a9ff76235af4fe18e50ae21f9c48af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:23.075779 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-81fc5a04-efa6-42f9-9c88-cbafe0ca63e2 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] 10.222.0.20 "GET /compute/v2.1/servers/4ef4defa-c86d-4354-9123-0fd63040609d" status: 200 len: 1314 microversion: 2.1 time: 0.161844 Oct 04 19:10:23.076387 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3388/6759] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:22 2022] GET /compute/v2.1/servers/4ef4defa-c86d-4354-9123-0fd63040609d => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:24.096035 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=8 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:10:24.102122 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d9c50fc8-b3ee-40c4-9495-c25aa01513b4 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:24.102916 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d9c50fc8-b3ee-40c4-9495-c25aa01513b4 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] [instance: 4ef4defa-c86d-4354-9123-0fd63040609d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:24.109342 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d9c50fc8-b3ee-40c4-9495-c25aa01513b4 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:24.111142 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d9c50fc8-b3ee-40c4-9495-c25aa01513b4 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:24.111142 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d9c50fc8-b3ee-40c4-9495-c25aa01513b4 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:24.111142 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d9c50fc8-b3ee-40c4-9495-c25aa01513b4 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:24.111532 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d9c50fc8-b3ee-40c4-9495-c25aa01513b4 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:24.111954 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d9c50fc8-b3ee-40c4-9495-c25aa01513b4 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:24.248408 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d9c50fc8-b3ee-40c4-9495-c25aa01513b4 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faeb43ec71d149c8a9b2ecf5c190ff81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a9ff76235af4fe18e50ae21f9c48af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:24.257079 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d9c50fc8-b3ee-40c4-9495-c25aa01513b4 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] 10.222.0.20 "GET /compute/v2.1/servers/4ef4defa-c86d-4354-9123-0fd63040609d" status: 200 len: 1464 microversion: 2.1 time: 0.161864 Oct 04 19:10:24.257530 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3372/6760] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:24 2022] GET /compute/v2.1/servers/4ef4defa-c86d-4354-9123-0fd63040609d => generated 1464 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:24.280387 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-eeac5e8b-60be-418d-9ee7-09a70315b3dd tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3647f206-17c6-4751-b024-df2d5ed3d997", "device": "/dev/sdb"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:10:24.282809 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-eeac5e8b-60be-418d-9ee7-09a70315b3dd tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] [instance: 4ef4defa-c86d-4354-9123-0fd63040609d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:24.290109 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eeac5e8b-60be-418d-9ee7-09a70315b3dd tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:24.291927 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eeac5e8b-60be-418d-9ee7-09a70315b3dd tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:24.292499 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eeac5e8b-60be-418d-9ee7-09a70315b3dd tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:24.293258 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eeac5e8b-60be-418d-9ee7-09a70315b3dd tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:24.293722 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eeac5e8b-60be-418d-9ee7-09a70315b3dd tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:24.294163 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eeac5e8b-60be-418d-9ee7-09a70315b3dd tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:24.815220 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-139839b1-234c-40ea-9015-c2e68501035b tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:24.815792 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-139839b1-234c-40ea-9015-c2e68501035b tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] [instance: 641029fb-67ea-4632-96bd-4e11ed5bb256] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:24.823306 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-139839b1-234c-40ea-9015-c2e68501035b tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:24.823774 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-139839b1-234c-40ea-9015-c2e68501035b tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:24.824268 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-139839b1-234c-40ea-9015-c2e68501035b tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:24.824985 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-139839b1-234c-40ea-9015-c2e68501035b tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:24.825457 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-139839b1-234c-40ea-9015-c2e68501035b tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:24.825896 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-139839b1-234c-40ea-9015-c2e68501035b tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:24.855231 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-139839b1-234c-40ea-9015-c2e68501035b tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] [instance: 641029fb-67ea-4632-96bd-4e11ed5bb256] Going to try to terminate instance {{(pid=123002) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:10:25.110362 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-eeac5e8b-60be-418d-9ee7-09a70315b3dd tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] 10.222.0.20 "POST /compute/v2.1/servers/4ef4defa-c86d-4354-9123-0fd63040609d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.833785 Oct 04 19:10:25.111303 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3389/6761] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Oct 4 19:10:24 2022] POST /compute/v2.1/servers/4ef4defa-c86d-4354-9123-0fd63040609d/os-volume_attachments => generated 194 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:10:25.212774 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-139839b1-234c-40ea-9015-c2e68501035b tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] 10.222.0.20 "DELETE /compute/v2.1/servers/641029fb-67ea-4632-96bd-4e11ed5bb256" status: 204 len: 0 microversion: 2.1 time: 0.401223 Oct 04 19:10:25.213980 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3373/6762] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 19:10:24 2022] DELETE /compute/v2.1/servers/641029fb-67ea-4632-96bd-4e11ed5bb256 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 19:10:25.224959 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-544cb28d-2ba5-4632-932c-0417ce968651 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:25.225952 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-544cb28d-2ba5-4632-932c-0417ce968651 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] [instance: 641029fb-67ea-4632-96bd-4e11ed5bb256] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:25.232730 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-544cb28d-2ba5-4632-932c-0417ce968651 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:25.233819 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-544cb28d-2ba5-4632-932c-0417ce968651 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:25.234271 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-544cb28d-2ba5-4632-932c-0417ce968651 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:25.234986 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-544cb28d-2ba5-4632-932c-0417ce968651 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:25.235449 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-544cb28d-2ba5-4632-932c-0417ce968651 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:25.235879 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-544cb28d-2ba5-4632-932c-0417ce968651 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:25.389905 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-544cb28d-2ba5-4632-932c-0417ce968651 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f2888940414c0d9a690ad8c68b4da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42758fc2a182488489d9989e17beb026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:25.398907 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-544cb28d-2ba5-4632-932c-0417ce968651 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] 10.222.0.20 "GET /compute/v2.1/servers/641029fb-67ea-4632-96bd-4e11ed5bb256" status: 200 len: 1550 microversion: 2.1 time: 0.179090 Oct 04 19:10:25.414964 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3390/6763] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:25 2022] GET /compute/v2.1/servers/641029fb-67ea-4632-96bd-4e11ed5bb256 => generated 1550 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:26.422799 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8b28c846-8bee-4ae6-9db0-1ed48d65cf37 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:26.423567 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8b28c846-8bee-4ae6-9db0-1ed48d65cf37 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] [instance: 641029fb-67ea-4632-96bd-4e11ed5bb256] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:26.432185 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8b28c846-8bee-4ae6-9db0-1ed48d65cf37 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:26.432692 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8b28c846-8bee-4ae6-9db0-1ed48d65cf37 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:26.433150 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8b28c846-8bee-4ae6-9db0-1ed48d65cf37 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:26.433863 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8b28c846-8bee-4ae6-9db0-1ed48d65cf37 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:26.434361 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8b28c846-8bee-4ae6-9db0-1ed48d65cf37 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:26.434805 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8b28c846-8bee-4ae6-9db0-1ed48d65cf37 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:26.568900 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8b28c846-8bee-4ae6-9db0-1ed48d65cf37 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f2888940414c0d9a690ad8c68b4da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42758fc2a182488489d9989e17beb026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:26.576826 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8b28c846-8bee-4ae6-9db0-1ed48d65cf37 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] 10.222.0.20 "GET /compute/v2.1/servers/641029fb-67ea-4632-96bd-4e11ed5bb256" status: 200 len: 1550 microversion: 2.1 time: 0.158315 Oct 04 19:10:26.577400 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3374/6764] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:26 2022] GET /compute/v2.1/servers/641029fb-67ea-4632-96bd-4e11ed5bb256 => generated 1550 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:10:27.440705 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-17f2f2e6-207a-462a-b455-a30276b2e648 req-21b0730d-f5be-4376-99c3-9284b37db296 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "641029fb-67ea-4632-96bd-4e11ed5bb256", "name": "network-vif-deleted", "tag": "2b9c4d28-bbce-4ab4-a73e-8504622bd2ec"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:10:27.453031 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-17f2f2e6-207a-462a-b455-a30276b2e648 req-21b0730d-f5be-4376-99c3-9284b37db296 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:27.457372 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-17f2f2e6-207a-462a-b455-a30276b2e648 req-21b0730d-f5be-4376-99c3-9284b37db296 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:27.457372 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-17f2f2e6-207a-462a-b455-a30276b2e648 req-21b0730d-f5be-4376-99c3-9284b37db296 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:27.470881 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-17f2f2e6-207a-462a-b455-a30276b2e648 req-21b0730d-f5be-4376-99c3-9284b37db296 service nova] Creating event network-vif-deleted:2b9c4d28-bbce-4ab4-a73e-8504622bd2ec for instance 641029fb-67ea-4632-96bd-4e11ed5bb256 on n-h2-850501-14 Oct 04 19:10:27.481429 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-17f2f2e6-207a-462a-b455-a30276b2e648 req-21b0730d-f5be-4376-99c3-9284b37db296 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045308 Oct 04 19:10:27.486211 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3391/6765] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:10:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:10:27.600741 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-44b7c6d9-0543-4205-97f6-40900da00221 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:27.601634 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-44b7c6d9-0543-4205-97f6-40900da00221 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] [instance: 641029fb-67ea-4632-96bd-4e11ed5bb256] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:27.609585 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-44b7c6d9-0543-4205-97f6-40900da00221 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:27.610103 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-44b7c6d9-0543-4205-97f6-40900da00221 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:27.610578 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-44b7c6d9-0543-4205-97f6-40900da00221 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:27.611334 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-44b7c6d9-0543-4205-97f6-40900da00221 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:27.611788 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-44b7c6d9-0543-4205-97f6-40900da00221 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:27.612272 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-44b7c6d9-0543-4205-97f6-40900da00221 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:27.616132 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:10:27.685432 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-44b7c6d9-0543-4205-97f6-40900da00221 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f2888940414c0d9a690ad8c68b4da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42758fc2a182488489d9989e17beb026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:27.694174 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-44b7c6d9-0543-4205-97f6-40900da00221 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] 10.222.0.20 "GET /compute/v2.1/servers/641029fb-67ea-4632-96bd-4e11ed5bb256" status: 200 len: 1331 microversion: 2.1 time: 0.097404 Oct 04 19:10:27.694761 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3375/6766] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:27 2022] GET /compute/v2.1/servers/641029fb-67ea-4632-96bd-4e11ed5bb256 => generated 1331 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:28.717905 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8f89b85a-d462-4970-a7da-cda532fe5ec1 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:28.718620 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8f89b85a-d462-4970-a7da-cda532fe5ec1 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] [instance: 641029fb-67ea-4632-96bd-4e11ed5bb256] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:28.729196 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8f89b85a-d462-4970-a7da-cda532fe5ec1 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:28.729695 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8f89b85a-d462-4970-a7da-cda532fe5ec1 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:28.730138 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8f89b85a-d462-4970-a7da-cda532fe5ec1 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:28.730850 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8f89b85a-d462-4970-a7da-cda532fe5ec1 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:28.731328 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8f89b85a-d462-4970-a7da-cda532fe5ec1 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:28.731745 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8f89b85a-d462-4970-a7da-cda532fe5ec1 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:28.746181 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-8f89b85a-d462-4970-a7da-cda532fe5ec1 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] HTTP exception thrown: Instance 641029fb-67ea-4632-96bd-4e11ed5bb256 could not be found. Oct 04 19:10:28.747850 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8f89b85a-d462-4970-a7da-cda532fe5ec1 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Request method failure captured: Oct 04 19:10:28.747850 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/641029fb-67ea-4632-96bd-4e11ed5bb256 HTTP/1.1 Oct 04 19:10:28.747850 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 19:10:28.747850 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 19:10:28.747850 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 19:10:28.747850 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 19:10:28.747850 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 19:10:28.747850 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 19:10:28.747850 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 19:10:28.747850 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 19:10:28.747850 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPISjbepDD7DyFxPoxHaQZLVFHWoQ9KikGoZ2b8cEOBRXV9Y4lOfF-4VAJDCsGIPanNSeGFiSdJVMgGH5BOJ1QNwOaHaad6KH0lgudVytMc4b42PXPVd5IbxECN6iUeXPOBIQD4EuWybCdCaB4a9_LjPFHXR8jNy4f-Z7YJftYsncGI8 Oct 04 19:10:28.747850 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 19:10:28.747850 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 19:10:28.747850 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 19:10:28.747850 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 19:10:28.747850 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 19:10:28.747850 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 19:10:28.747850 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 42758fc2a182488489d9989e17beb026 Oct 04 19:10:28.747850 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-TestNetworkBasicOps-296728974 Oct 04 19:10:28.747850 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 19:10:28.747850 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 19:10:28.747850 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/42758fc2a182488489d9989e17beb026"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_42758fc2a182488489d9989e17beb026", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/42758fc2a182488489d9989e17beb026"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/42758fc2a182488489d9989e17beb026"}]}] Oct 04 19:10:28.747850 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-TestNetworkBasicOps-296728974 Oct 04 19:10:28.747850 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 42758fc2a182488489d9989e17beb026 Oct 04 19:10:28.747850 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-TestNetworkBasicOps-296728974 Oct 04 19:10:28.747850 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-TestNetworkBasicOps-296728974-project Oct 04 19:10:28.747850 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 19:10:28.747850 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 19:10:28.747850 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: f7f2888940414c0d9a690ad8c68b4da3 Oct 04 19:10:28.747850 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-TestNetworkBasicOps-296728974-project Oct 04 19:10:28.747850 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 19:10:28.747850 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 641029fb-67ea-4632-96bd-4e11ed5bb256 could not be found. Oct 04 19:10:28.747850 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '641029fb-67ea-4632-96bd-4e11ed5bb256'} Oct 04 19:10:28.747850 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:10:28.747850 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:10:28.747850 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:10:28.747850 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:10:28.747850 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:10:28.747850 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:10:28.747850 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:10:28.747850 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:10:28.747850 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:10:28.747850 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:10:28.747850 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 641029fb-67ea-4632-96bd-4e11ed5bb256 could not be found. Oct 04 19:10:28.747850 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:10:28.747850 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:10:28.747850 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:10:28.747850 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:10:28.747850 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:10:28.747850 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:10:28.747850 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:10:28.747850 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:10:28.747850 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:10:28.747850 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:10:28.747850 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:10:28.747850 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:10:28.747850 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:10:28.747850 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:10:28.747850 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:10:28.747850 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:10:28.747850 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 641029fb-67ea-4632-96bd-4e11ed5bb256 could not be found. Oct 04 19:10:28.747850 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:10:28.747850 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:10:28.747850 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:10:28.752971 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:10:28.752971 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:10:28.752971 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:10:28.752971 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:10:28.752971 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:10:28.752971 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 641029fb-67ea-4632-96bd-4e11ed5bb256 could not be found. Oct 04 19:10:28.752971 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:10:28.752971 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8f89b85a-d462-4970-a7da-cda532fe5ec1 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Returning 404 to user: Instance 641029fb-67ea-4632-96bd-4e11ed5bb256 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:10:28.752971 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8f89b85a-d462-4970-a7da-cda532fe5ec1 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] 10.222.0.20 "GET /compute/v2.1/servers/641029fb-67ea-4632-96bd-4e11ed5bb256" status: 404 len: 111 microversion: 2.1 time: 0.035671 Oct 04 19:10:28.752971 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3392/6767] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:28 2022] GET /compute/v2.1/servers/641029fb-67ea-4632-96bd-4e11ed5bb256 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 19:10:28.995172 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f6e084eb-bfa8-4ebd-8ffb-f9e57af816c8 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Calling method '.version_select at 0x7fe259400040>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:29.070159 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f6e084eb-bfa8-4ebd-8ffb-f9e57af816c8 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-41267450" status: 202 len: 0 microversion: 2.1 time: 0.080179 Oct 04 19:10:29.070709 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3376/6768] 10.222.0.20 () {58 vars in 1251 bytes} [Tue Oct 4 19:10:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-41267450 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:10:31.176291 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-709adb3b-a030-470c-9206-2b45fdf9a29e tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:31.176785 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-709adb3b-a030-470c-9206-2b45fdf9a29e tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] [instance: fa0d9a6f-0dbf-4a4c-9769-4b87e7a7fee2] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:31.180352 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-60f147e2-c9b7-461a-9d09-55dd53cda858 req-725db836-e544-498f-b845-4cc6322c9ecc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa0d9a6f-0dbf-4a4c-9769-4b87e7a7fee2", "tag": "ea09e1e6-c143-479c-a9c1-7631b3033288"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:10:31.185161 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-709adb3b-a030-470c-9206-2b45fdf9a29e tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:31.185658 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-709adb3b-a030-470c-9206-2b45fdf9a29e tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:31.186093 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-709adb3b-a030-470c-9206-2b45fdf9a29e tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:31.186802 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-709adb3b-a030-470c-9206-2b45fdf9a29e tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:31.187445 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-709adb3b-a030-470c-9206-2b45fdf9a29e tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:31.187873 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-709adb3b-a030-470c-9206-2b45fdf9a29e tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:31.192354 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-60f147e2-c9b7-461a-9d09-55dd53cda858 req-725db836-e544-498f-b845-4cc6322c9ecc service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:31.192851 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-60f147e2-c9b7-461a-9d09-55dd53cda858 req-725db836-e544-498f-b845-4cc6322c9ecc service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:31.193307 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-60f147e2-c9b7-461a-9d09-55dd53cda858 req-725db836-e544-498f-b845-4cc6322c9ecc service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:31.205071 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-60f147e2-c9b7-461a-9d09-55dd53cda858 req-725db836-e544-498f-b845-4cc6322c9ecc service nova] Creating event network-changed:ea09e1e6-c143-479c-a9c1-7631b3033288 for instance fa0d9a6f-0dbf-4a4c-9769-4b87e7a7fee2 on n-h1-850501-14 Oct 04 19:10:31.211400 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-60f147e2-c9b7-461a-9d09-55dd53cda858 req-725db836-e544-498f-b845-4cc6322c9ecc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036375 Oct 04 19:10:31.212015 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3377/6769] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:10:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:10:31.218298 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-709adb3b-a030-470c-9206-2b45fdf9a29e tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] [instance: fa0d9a6f-0dbf-4a4c-9769-4b87e7a7fee2] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:10:31.521314 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-709adb3b-a030-470c-9206-2b45fdf9a29e tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] 10.222.0.20 "DELETE /compute/v2.1/servers/fa0d9a6f-0dbf-4a4c-9769-4b87e7a7fee2" status: 204 len: 0 microversion: 2.1 time: 0.347570 Oct 04 19:10:31.523250 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3393/6770] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 19:10:31 2022] DELETE /compute/v2.1/servers/fa0d9a6f-0dbf-4a4c-9769-4b87e7a7fee2 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:10:31.534039 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3fb05bda-b0b3-4530-a068-f6bf841b4bd1 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:31.534039 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3fb05bda-b0b3-4530-a068-f6bf841b4bd1 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] [instance: fa0d9a6f-0dbf-4a4c-9769-4b87e7a7fee2] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:31.541203 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3fb05bda-b0b3-4530-a068-f6bf841b4bd1 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:31.541993 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3fb05bda-b0b3-4530-a068-f6bf841b4bd1 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:31.542627 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3fb05bda-b0b3-4530-a068-f6bf841b4bd1 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:31.543715 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3fb05bda-b0b3-4530-a068-f6bf841b4bd1 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:31.544388 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3fb05bda-b0b3-4530-a068-f6bf841b4bd1 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:31.544996 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3fb05bda-b0b3-4530-a068-f6bf841b4bd1 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:31.709476 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3fb05bda-b0b3-4530-a068-f6bf841b4bd1 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f2888940414c0d9a690ad8c68b4da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42758fc2a182488489d9989e17beb026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:31.718149 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3fb05bda-b0b3-4530-a068-f6bf841b4bd1 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] 10.222.0.20 "GET /compute/v2.1/servers/fa0d9a6f-0dbf-4a4c-9769-4b87e7a7fee2" status: 200 len: 1671 microversion: 2.1 time: 0.190577 Oct 04 19:10:31.718734 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3378/6771] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:31 2022] GET /compute/v2.1/servers/fa0d9a6f-0dbf-4a4c-9769-4b87e7a7fee2 => generated 1671 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:10:32.744047 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1eb4b7eb-6c4d-4c6a-a031-0ba7d8045a10 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:32.744787 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1eb4b7eb-6c4d-4c6a-a031-0ba7d8045a10 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] [instance: fa0d9a6f-0dbf-4a4c-9769-4b87e7a7fee2] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:32.751765 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1eb4b7eb-6c4d-4c6a-a031-0ba7d8045a10 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:32.758801 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1eb4b7eb-6c4d-4c6a-a031-0ba7d8045a10 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:32.758801 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1eb4b7eb-6c4d-4c6a-a031-0ba7d8045a10 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:32.758801 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1eb4b7eb-6c4d-4c6a-a031-0ba7d8045a10 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:32.758801 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1eb4b7eb-6c4d-4c6a-a031-0ba7d8045a10 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:32.758801 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1eb4b7eb-6c4d-4c6a-a031-0ba7d8045a10 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:32.972964 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1eb4b7eb-6c4d-4c6a-a031-0ba7d8045a10 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f2888940414c0d9a690ad8c68b4da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42758fc2a182488489d9989e17beb026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:32.981822 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1eb4b7eb-6c4d-4c6a-a031-0ba7d8045a10 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] 10.222.0.20 "GET /compute/v2.1/servers/fa0d9a6f-0dbf-4a4c-9769-4b87e7a7fee2" status: 200 len: 1671 microversion: 2.1 time: 0.243291 Oct 04 19:10:32.982495 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3394/6772] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:32 2022] GET /compute/v2.1/servers/fa0d9a6f-0dbf-4a4c-9769-4b87e7a7fee2 => generated 1671 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:33.440995 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-d5843e2d-4bbe-4dbe-86c0-e9e6855f34be req-39857113-b2be-47cd-8726-648405ff10fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa0d9a6f-0dbf-4a4c-9769-4b87e7a7fee2", "name": "network-vif-deleted", "tag": "ea09e1e6-c143-479c-a9c1-7631b3033288"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:10:33.453073 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-d5843e2d-4bbe-4dbe-86c0-e9e6855f34be req-39857113-b2be-47cd-8726-648405ff10fd service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:33.453582 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-d5843e2d-4bbe-4dbe-86c0-e9e6855f34be req-39857113-b2be-47cd-8726-648405ff10fd service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:33.454055 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-d5843e2d-4bbe-4dbe-86c0-e9e6855f34be req-39857113-b2be-47cd-8726-648405ff10fd service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:33.466490 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-d5843e2d-4bbe-4dbe-86c0-e9e6855f34be req-39857113-b2be-47cd-8726-648405ff10fd service nova] Creating event network-vif-deleted:ea09e1e6-c143-479c-a9c1-7631b3033288 for instance fa0d9a6f-0dbf-4a4c-9769-4b87e7a7fee2 on n-h1-850501-14 Oct 04 19:10:33.471714 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-d5843e2d-4bbe-4dbe-86c0-e9e6855f34be req-39857113-b2be-47cd-8726-648405ff10fd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034619 Oct 04 19:10:33.472416 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3379/6773] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:10:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:10:34.004900 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f616ce2c-ffe4-4879-8e47-cabc87f7c1bc tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:34.005550 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f616ce2c-ffe4-4879-8e47-cabc87f7c1bc tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] [instance: fa0d9a6f-0dbf-4a4c-9769-4b87e7a7fee2] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:34.012397 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f616ce2c-ffe4-4879-8e47-cabc87f7c1bc tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:34.012888 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f616ce2c-ffe4-4879-8e47-cabc87f7c1bc tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:34.013331 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f616ce2c-ffe4-4879-8e47-cabc87f7c1bc tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:34.014031 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f616ce2c-ffe4-4879-8e47-cabc87f7c1bc tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:34.014494 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f616ce2c-ffe4-4879-8e47-cabc87f7c1bc tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:34.014922 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f616ce2c-ffe4-4879-8e47-cabc87f7c1bc tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:34.047816 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f616ce2c-ffe4-4879-8e47-cabc87f7c1bc tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:34.048350 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f616ce2c-ffe4-4879-8e47-cabc87f7c1bc tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:34.048825 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f616ce2c-ffe4-4879-8e47-cabc87f7c1bc tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:34.049273 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-f616ce2c-ffe4-4879-8e47-cabc87f7c1bc tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lazy-loading 'fault' on Instance uuid fa0d9a6f-0dbf-4a4c-9769-4b87e7a7fee2 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:10:34.093320 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f616ce2c-ffe4-4879-8e47-cabc87f7c1bc tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f2888940414c0d9a690ad8c68b4da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42758fc2a182488489d9989e17beb026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:34.101423 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f616ce2c-ffe4-4879-8e47-cabc87f7c1bc tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] 10.222.0.20 "GET /compute/v2.1/servers/fa0d9a6f-0dbf-4a4c-9769-4b87e7a7fee2" status: 200 len: 1338 microversion: 2.1 time: 0.100484 Oct 04 19:10:34.102527 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3395/6774] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:33 2022] GET /compute/v2.1/servers/fa0d9a6f-0dbf-4a4c-9769-4b87e7a7fee2 => generated 1338 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:35.126643 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f9367021-8da9-4cbb-aef5-10ddfdd31970 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:35.127375 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f9367021-8da9-4cbb-aef5-10ddfdd31970 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] [instance: fa0d9a6f-0dbf-4a4c-9769-4b87e7a7fee2] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:35.135223 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f9367021-8da9-4cbb-aef5-10ddfdd31970 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:35.135726 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f9367021-8da9-4cbb-aef5-10ddfdd31970 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:35.136217 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f9367021-8da9-4cbb-aef5-10ddfdd31970 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:35.136932 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f9367021-8da9-4cbb-aef5-10ddfdd31970 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:35.137406 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f9367021-8da9-4cbb-aef5-10ddfdd31970 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:35.137851 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f9367021-8da9-4cbb-aef5-10ddfdd31970 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:35.151259 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-f9367021-8da9-4cbb-aef5-10ddfdd31970 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] HTTP exception thrown: Instance fa0d9a6f-0dbf-4a4c-9769-4b87e7a7fee2 could not be found. Oct 04 19:10:35.152950 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f9367021-8da9-4cbb-aef5-10ddfdd31970 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Request method failure captured: Oct 04 19:10:35.152950 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/fa0d9a6f-0dbf-4a4c-9769-4b87e7a7fee2 HTTP/1.1 Oct 04 19:10:35.152950 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 19:10:35.152950 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 19:10:35.152950 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 19:10:35.152950 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 19:10:35.152950 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 19:10:35.152950 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 19:10:35.152950 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 19:10:35.152950 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 19:10:35.152950 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPISjbepDD7DyFxPoxHaQZLVFHWoQ9KikGoZ2b8cEOBRXV9Y4lOfF-4VAJDCsGIPanNSeGFiSdJVMgGH5BOJ1QNwOaHaad6KH0lgudVytMc4b42PXPVd5IbxECN6iUeXPOBIQD4EuWybCdCaB4a9_LjPFHXR8jNy4f-Z7YJftYsncGI8 Oct 04 19:10:35.152950 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 19:10:35.152950 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 19:10:35.152950 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 19:10:35.152950 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 19:10:35.152950 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 19:10:35.152950 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 19:10:35.152950 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 42758fc2a182488489d9989e17beb026 Oct 04 19:10:35.152950 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-TestNetworkBasicOps-296728974 Oct 04 19:10:35.152950 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 19:10:35.152950 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 19:10:35.152950 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/42758fc2a182488489d9989e17beb026"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_42758fc2a182488489d9989e17beb026", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/42758fc2a182488489d9989e17beb026"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/42758fc2a182488489d9989e17beb026"}]}] Oct 04 19:10:35.152950 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-TestNetworkBasicOps-296728974 Oct 04 19:10:35.152950 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 42758fc2a182488489d9989e17beb026 Oct 04 19:10:35.152950 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-TestNetworkBasicOps-296728974 Oct 04 19:10:35.152950 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-TestNetworkBasicOps-296728974-project Oct 04 19:10:35.152950 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 19:10:35.152950 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 19:10:35.152950 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: f7f2888940414c0d9a690ad8c68b4da3 Oct 04 19:10:35.152950 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-TestNetworkBasicOps-296728974-project Oct 04 19:10:35.152950 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 19:10:35.152950 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance fa0d9a6f-0dbf-4a4c-9769-4b87e7a7fee2 could not be found. Oct 04 19:10:35.152950 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'fa0d9a6f-0dbf-4a4c-9769-4b87e7a7fee2'} Oct 04 19:10:35.152950 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:10:35.152950 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:10:35.152950 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:10:35.152950 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:10:35.152950 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:10:35.152950 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:10:35.152950 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:10:35.152950 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:10:35.152950 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:10:35.152950 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:10:35.152950 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa0d9a6f-0dbf-4a4c-9769-4b87e7a7fee2 could not be found. Oct 04 19:10:35.152950 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:10:35.152950 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:10:35.152950 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:10:35.152950 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:10:35.152950 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:10:35.152950 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:10:35.152950 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:10:35.152950 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:10:35.152950 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:10:35.152950 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:10:35.152950 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:10:35.152950 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:10:35.152950 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:10:35.152950 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:10:35.152950 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:10:35.152950 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:10:35.152950 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa0d9a6f-0dbf-4a4c-9769-4b87e7a7fee2 could not be found. Oct 04 19:10:35.152950 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:10:35.152950 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:10:35.152950 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:10:35.157795 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:10:35.157795 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:10:35.157795 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:10:35.157795 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:10:35.157795 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:10:35.157795 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa0d9a6f-0dbf-4a4c-9769-4b87e7a7fee2 could not be found. Oct 04 19:10:35.157795 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:10:35.157795 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f9367021-8da9-4cbb-aef5-10ddfdd31970 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Returning 404 to user: Instance fa0d9a6f-0dbf-4a4c-9769-4b87e7a7fee2 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:10:35.157795 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f9367021-8da9-4cbb-aef5-10ddfdd31970 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] 10.222.0.20 "GET /compute/v2.1/servers/fa0d9a6f-0dbf-4a4c-9769-4b87e7a7fee2" status: 404 len: 111 microversion: 2.1 time: 0.032116 Oct 04 19:10:35.157795 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3380/6775] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:35 2022] GET /compute/v2.1/servers/fa0d9a6f-0dbf-4a4c-9769-4b87e7a7fee2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:10:35.422535 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e8f8663b-2efd-49d3-9763-1cefa43c1922 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Calling method '.version_select at 0x7fe253c77a60>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:35.500554 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e8f8663b-2efd-49d3-9763-1cefa43c1922 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-835733101" status: 202 len: 0 microversion: 2.1 time: 0.081979 Oct 04 19:10:35.501156 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3396/6776] 10.222.0.20 () {58 vars in 1254 bytes} [Tue Oct 4 19:10:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-835733101 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:10:41.205613 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-aa19f738-e540-4691-a3e7-577e47d544c0 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:41.206126 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-aa19f738-e540-4691-a3e7-577e47d544c0 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 2646dfcb-7213-4870-99eb-68311662d66b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:41.214065 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aa19f738-e540-4691-a3e7-577e47d544c0 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:41.214651 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aa19f738-e540-4691-a3e7-577e47d544c0 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:41.215186 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aa19f738-e540-4691-a3e7-577e47d544c0 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:41.216077 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aa19f738-e540-4691-a3e7-577e47d544c0 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:41.216556 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aa19f738-e540-4691-a3e7-577e47d544c0 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:41.217067 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aa19f738-e540-4691-a3e7-577e47d544c0 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:41.311840 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-aa19f738-e540-4691-a3e7-577e47d544c0 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lazy-loading 'services' on Instance uuid 2646dfcb-7213-4870-99eb-68311662d66b {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:10:41.556255 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-aa19f738-e540-4691-a3e7-577e47d544c0 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b/os-volume_attachments/68dad1a7-0be7-4dc6-a2cd-036f897d260b" status: 202 len: 0 microversion: 2.1 time: 0.354798 Oct 04 19:10:41.562335 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3381/6777] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Oct 4 19:10:41 2022] DELETE /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b/os-volume_attachments/68dad1a7-0be7-4dc6-a2cd-036f897d260b => generated 0 bytes in 362 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:10:41.813048 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e9477450-4eba-434c-859b-0941ff0a9d70 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:41.813646 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e9477450-4eba-434c-859b-0941ff0a9d70 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 21361c85-1287-4754-8308-ef0f172d0e6f] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:41.825318 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e9477450-4eba-434c-859b-0941ff0a9d70 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:41.825656 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e9477450-4eba-434c-859b-0941ff0a9d70 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:41.826163 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e9477450-4eba-434c-859b-0941ff0a9d70 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:41.826885 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e9477450-4eba-434c-859b-0941ff0a9d70 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:41.827393 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e9477450-4eba-434c-859b-0941ff0a9d70 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:41.827827 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e9477450-4eba-434c-859b-0941ff0a9d70 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:41.855760 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e9477450-4eba-434c-859b-0941ff0a9d70 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 21361c85-1287-4754-8308-ef0f172d0e6f] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:10:41.957264 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:10:42.160233 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e9477450-4eba-434c-859b-0941ff0a9d70 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "DELETE /compute/v2.1/servers/21361c85-1287-4754-8308-ef0f172d0e6f" status: 204 len: 0 microversion: 2.1 time: 0.724080 Oct 04 19:10:42.160841 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3397/6778] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 19:10:41 2022] DELETE /compute/v2.1/servers/21361c85-1287-4754-8308-ef0f172d0e6f => generated 0 bytes in 726 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:10:42.170161 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-329a7737-1dab-46c2-8049-4123c067dbc8 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:42.171104 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-329a7737-1dab-46c2-8049-4123c067dbc8 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 21361c85-1287-4754-8308-ef0f172d0e6f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:42.177587 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-329a7737-1dab-46c2-8049-4123c067dbc8 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:42.178121 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-329a7737-1dab-46c2-8049-4123c067dbc8 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:42.178587 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-329a7737-1dab-46c2-8049-4123c067dbc8 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:42.179307 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-329a7737-1dab-46c2-8049-4123c067dbc8 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:42.179782 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-329a7737-1dab-46c2-8049-4123c067dbc8 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:42.180450 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-329a7737-1dab-46c2-8049-4123c067dbc8 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:42.413951 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-329a7737-1dab-46c2-8049-4123c067dbc8 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:42.426302 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-329a7737-1dab-46c2-8049-4123c067dbc8 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/21361c85-1287-4754-8308-ef0f172d0e6f" status: 200 len: 1577 microversion: 2.1 time: 0.258932 Oct 04 19:10:42.427618 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3382/6779] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:42 2022] GET /compute/v2.1/servers/21361c85-1287-4754-8308-ef0f172d0e6f => generated 1577 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:43.453372 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4190d84f-6766-439d-bff0-5d187d66960b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:43.454104 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-4190d84f-6766-439d-bff0-5d187d66960b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 21361c85-1287-4754-8308-ef0f172d0e6f] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:43.467678 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4190d84f-6766-439d-bff0-5d187d66960b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:43.468857 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4190d84f-6766-439d-bff0-5d187d66960b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:43.476814 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4190d84f-6766-439d-bff0-5d187d66960b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:43.476814 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4190d84f-6766-439d-bff0-5d187d66960b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:43.476814 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4190d84f-6766-439d-bff0-5d187d66960b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:43.476814 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4190d84f-6766-439d-bff0-5d187d66960b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:43.799704 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-4190d84f-6766-439d-bff0-5d187d66960b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:43.813484 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-4190d84f-6766-439d-bff0-5d187d66960b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/21361c85-1287-4754-8308-ef0f172d0e6f" status: 200 len: 1577 microversion: 2.1 time: 0.365897 Oct 04 19:10:43.815900 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3398/6780] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:43 2022] GET /compute/v2.1/servers/21361c85-1287-4754-8308-ef0f172d0e6f => generated 1577 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:44.849544 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5ee9c1a0-3e4f-409d-89ef-1650dffad57b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:44.851272 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5ee9c1a0-3e4f-409d-89ef-1650dffad57b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 21361c85-1287-4754-8308-ef0f172d0e6f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:44.875031 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5ee9c1a0-3e4f-409d-89ef-1650dffad57b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:44.875954 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5ee9c1a0-3e4f-409d-89ef-1650dffad57b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:44.876779 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5ee9c1a0-3e4f-409d-89ef-1650dffad57b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:44.880739 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5ee9c1a0-3e4f-409d-89ef-1650dffad57b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:44.881571 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5ee9c1a0-3e4f-409d-89ef-1650dffad57b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:44.882359 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5ee9c1a0-3e4f-409d-89ef-1650dffad57b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:45.456575 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5ee9c1a0-3e4f-409d-89ef-1650dffad57b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:45.496278 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5ee9c1a0-3e4f-409d-89ef-1650dffad57b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/21361c85-1287-4754-8308-ef0f172d0e6f" status: 200 len: 1577 microversion: 2.1 time: 0.654415 Oct 04 19:10:45.510525 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3383/6781] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:44 2022] GET /compute/v2.1/servers/21361c85-1287-4754-8308-ef0f172d0e6f => generated 1577 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:46.051463 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-bcb83b34-d645-4d24-a090-153787e8d684 req-e6e00752-186e-4b9c-8f03-ee302da008ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21361c85-1287-4754-8308-ef0f172d0e6f", "name": "network-vif-deleted", "tag": "55c2030e-c6da-4343-934f-0ec880fa90dc"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:10:46.076692 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-bcb83b34-d645-4d24-a090-153787e8d684 req-e6e00752-186e-4b9c-8f03-ee302da008ad service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:46.077508 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-bcb83b34-d645-4d24-a090-153787e8d684 req-e6e00752-186e-4b9c-8f03-ee302da008ad service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:46.078157 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-bcb83b34-d645-4d24-a090-153787e8d684 req-e6e00752-186e-4b9c-8f03-ee302da008ad service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:46.101084 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-bcb83b34-d645-4d24-a090-153787e8d684 req-e6e00752-186e-4b9c-8f03-ee302da008ad service nova] Creating event network-vif-deleted:55c2030e-c6da-4343-934f-0ec880fa90dc for instance 21361c85-1287-4754-8308-ef0f172d0e6f on n-h2-850501-14 Oct 04 19:10:46.122599 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-bcb83b34-d645-4d24-a090-153787e8d684 req-e6e00752-186e-4b9c-8f03-ee302da008ad service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070602 Oct 04 19:10:46.129170 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3399/6782] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:10:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:10:46.542131 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b336f0e8-8d2b-4745-aa66-fa97f807b1ff tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:46.543748 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b336f0e8-8d2b-4745-aa66-fa97f807b1ff tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 21361c85-1287-4754-8308-ef0f172d0e6f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:46.568989 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b336f0e8-8d2b-4745-aa66-fa97f807b1ff tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:46.569779 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b336f0e8-8d2b-4745-aa66-fa97f807b1ff tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:46.572356 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b336f0e8-8d2b-4745-aa66-fa97f807b1ff tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:46.573348 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b336f0e8-8d2b-4745-aa66-fa97f807b1ff tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:46.579317 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b336f0e8-8d2b-4745-aa66-fa97f807b1ff tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:46.580036 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b336f0e8-8d2b-4745-aa66-fa97f807b1ff tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:46.810743 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b336f0e8-8d2b-4745-aa66-fa97f807b1ff tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:46.825765 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b336f0e8-8d2b-4745-aa66-fa97f807b1ff tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/21361c85-1287-4754-8308-ef0f172d0e6f" status: 200 len: 1225 microversion: 2.1 time: 0.300630 Oct 04 19:10:46.831616 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3384/6783] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:46 2022] GET /compute/v2.1/servers/21361c85-1287-4754-8308-ef0f172d0e6f => generated 1225 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:47.860507 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a10514a6-b723-4a50-8aec-6af47fbe07ea tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:47.861379 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a10514a6-b723-4a50-8aec-6af47fbe07ea tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 21361c85-1287-4754-8308-ef0f172d0e6f] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:47.879159 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:10:47.883600 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a10514a6-b723-4a50-8aec-6af47fbe07ea tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:47.887577 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a10514a6-b723-4a50-8aec-6af47fbe07ea tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:47.889295 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a10514a6-b723-4a50-8aec-6af47fbe07ea tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:47.895221 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a10514a6-b723-4a50-8aec-6af47fbe07ea tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:47.895221 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a10514a6-b723-4a50-8aec-6af47fbe07ea tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:47.895221 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a10514a6-b723-4a50-8aec-6af47fbe07ea tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:48.033138 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a10514a6-b723-4a50-8aec-6af47fbe07ea tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:48.049049 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a10514a6-b723-4a50-8aec-6af47fbe07ea tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/21361c85-1287-4754-8308-ef0f172d0e6f" status: 200 len: 1225 microversion: 2.1 time: 0.193367 Oct 04 19:10:48.077488 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3400/6784] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:47 2022] GET /compute/v2.1/servers/21361c85-1287-4754-8308-ef0f172d0e6f => generated 1225 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:48.588406 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ff467ba5-3a51-4c13-8e4d-f47eea273c1c tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Action: 'create', calling method: .version_select at 0x7fe253d7f9d0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-731182279", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIZsmlKgC27LPq5lwhVCog4wGRBTpFOz3LprOrRaBLURQad20rAIfrO2cnnvFZvffwIjHTGmzjEpm5rCTMXOUykSFgavwElYSIA79L6ask/+f8Bphq3EcKUE3lCYEevJtA=="}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:10:48.608881 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-ff467ba5-3a51-4c13-8e4d-f47eea273c1c tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Getting quotas for project 42758fc2a182488489d9989e17beb026. Resources: {'key_pairs'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:10:48.615311 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-ff467ba5-3a51-4c13-8e4d-f47eea273c1c tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Getting quotas for user f7f2888940414c0d9a690ad8c68b4da3 and project 42758fc2a182488489d9989e17beb026. Resources: {'key_pairs'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:10:48.714298 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ff467ba5-3a51-4c13-8e4d-f47eea273c1c tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.130507 Oct 04 19:10:48.729052 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3385/6785] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Oct 4 19:10:48 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:10:49.082944 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-fdde8759-c61e-4116-87e1-7f1d19a7fca6 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:49.082944 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-fdde8759-c61e-4116-87e1-7f1d19a7fca6 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 21361c85-1287-4754-8308-ef0f172d0e6f] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:49.091124 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fdde8759-c61e-4116-87e1-7f1d19a7fca6 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:49.091840 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fdde8759-c61e-4116-87e1-7f1d19a7fca6 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:49.092499 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fdde8759-c61e-4116-87e1-7f1d19a7fca6 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:49.093471 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fdde8759-c61e-4116-87e1-7f1d19a7fca6 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:49.094228 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fdde8759-c61e-4116-87e1-7f1d19a7fca6 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:49.094816 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fdde8759-c61e-4116-87e1-7f1d19a7fca6 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:49.175481 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-fdde8759-c61e-4116-87e1-7f1d19a7fca6 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:49.186912 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-fdde8759-c61e-4116-87e1-7f1d19a7fca6 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/21361c85-1287-4754-8308-ef0f172d0e6f" status: 200 len: 1225 microversion: 2.1 time: 0.109759 Oct 04 19:10:49.187689 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3401/6786] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:49 2022] GET /compute/v2.1/servers/21361c85-1287-4754-8308-ef0f172d0e6f => generated 1225 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:50.104243 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d4e4b05d-065b-436a-bcf8-eadcbe78da53 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:10:50.115025 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d4e4b05d-065b-436a-bcf8-eadcbe78da53 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:50.115541 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d4e4b05d-065b-436a-bcf8-eadcbe78da53 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:50.116000 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d4e4b05d-065b-436a-bcf8-eadcbe78da53 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:50.153025 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d4e4b05d-065b-436a-bcf8-eadcbe78da53 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 2646dfcb-7213-4870-99eb-68311662d66b] Going to try to stop instance {{(pid=123002) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 19:10:50.237661 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9e0d6cde-3421-4bd9-a1fd-2b55b3bc3648 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:50.239642 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-9e0d6cde-3421-4bd9-a1fd-2b55b3bc3648 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 21361c85-1287-4754-8308-ef0f172d0e6f] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:50.269356 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9e0d6cde-3421-4bd9-a1fd-2b55b3bc3648 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:50.270140 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9e0d6cde-3421-4bd9-a1fd-2b55b3bc3648 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:50.271025 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9e0d6cde-3421-4bd9-a1fd-2b55b3bc3648 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:50.271916 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9e0d6cde-3421-4bd9-a1fd-2b55b3bc3648 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:50.272546 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9e0d6cde-3421-4bd9-a1fd-2b55b3bc3648 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:50.273136 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9e0d6cde-3421-4bd9-a1fd-2b55b3bc3648 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:50.350326 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9e0d6cde-3421-4bd9-a1fd-2b55b3bc3648 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:50.366395 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9e0d6cde-3421-4bd9-a1fd-2b55b3bc3648 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/21361c85-1287-4754-8308-ef0f172d0e6f" status: 200 len: 1225 microversion: 2.1 time: 0.150060 Oct 04 19:10:50.368374 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3402/6787] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:50 2022] GET /compute/v2.1/servers/21361c85-1287-4754-8308-ef0f172d0e6f => generated 1225 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:10:50.479353 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d4e4b05d-065b-436a-bcf8-eadcbe78da53 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "POST /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b/action" status: 202 len: 0 microversion: 2.1 time: 0.379250 Oct 04 19:10:50.480399 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3386/6788] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 19:10:50 2022] POST /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b/action => generated 0 bytes in 382 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:10:50.492210 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f8647719-ac4d-4df0-aeb4-7c570169d647 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:50.494246 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f8647719-ac4d-4df0-aeb4-7c570169d647 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 2646dfcb-7213-4870-99eb-68311662d66b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:50.509866 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f8647719-ac4d-4df0-aeb4-7c570169d647 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:50.510389 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f8647719-ac4d-4df0-aeb4-7c570169d647 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:50.510892 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f8647719-ac4d-4df0-aeb4-7c570169d647 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:50.511625 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f8647719-ac4d-4df0-aeb4-7c570169d647 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:50.512308 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f8647719-ac4d-4df0-aeb4-7c570169d647 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:50.512953 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f8647719-ac4d-4df0-aeb4-7c570169d647 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:50.711656 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f8647719-ac4d-4df0-aeb4-7c570169d647 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3060cdc6eeba47288205e107717a6980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a841124bf4392b54c3d6b0ea37e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:50.735000 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f8647719-ac4d-4df0-aeb4-7c570169d647 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b" status: 200 len: 1677 microversion: 2.1 time: 0.250295 Oct 04 19:10:50.735859 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3403/6789] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:50 2022] GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b => generated 1677 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:51.395944 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-354e8025-45f3-40d4-9d06-cae78ed2b40e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:51.396806 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-354e8025-45f3-40d4-9d06-cae78ed2b40e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 21361c85-1287-4754-8308-ef0f172d0e6f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:51.399465 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:10:51.405651 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-354e8025-45f3-40d4-9d06-cae78ed2b40e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:51.406243 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-354e8025-45f3-40d4-9d06-cae78ed2b40e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:51.406767 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-354e8025-45f3-40d4-9d06-cae78ed2b40e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:51.407605 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-354e8025-45f3-40d4-9d06-cae78ed2b40e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:51.408173 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-354e8025-45f3-40d4-9d06-cae78ed2b40e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:51.408682 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-354e8025-45f3-40d4-9d06-cae78ed2b40e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:51.517939 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-354e8025-45f3-40d4-9d06-cae78ed2b40e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:51.531517 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-354e8025-45f3-40d4-9d06-cae78ed2b40e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/21361c85-1287-4754-8308-ef0f172d0e6f" status: 200 len: 1225 microversion: 2.1 time: 0.137383 Oct 04 19:10:51.533798 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3387/6790] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:51 2022] GET /compute/v2.1/servers/21361c85-1287-4754-8308-ef0f172d0e6f => generated 1225 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:51.759502 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-12d9e9f3-8b4d-497c-88d2-ab2be1203323 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:51.760862 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-12d9e9f3-8b4d-497c-88d2-ab2be1203323 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 2646dfcb-7213-4870-99eb-68311662d66b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:51.777834 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-12d9e9f3-8b4d-497c-88d2-ab2be1203323 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:51.779794 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-12d9e9f3-8b4d-497c-88d2-ab2be1203323 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:51.779794 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-12d9e9f3-8b4d-497c-88d2-ab2be1203323 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:51.779794 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-12d9e9f3-8b4d-497c-88d2-ab2be1203323 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:51.784705 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-12d9e9f3-8b4d-497c-88d2-ab2be1203323 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:51.785158 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-12d9e9f3-8b4d-497c-88d2-ab2be1203323 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:51.954233 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-12d9e9f3-8b4d-497c-88d2-ab2be1203323 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3060cdc6eeba47288205e107717a6980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a841124bf4392b54c3d6b0ea37e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:51.963128 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-12d9e9f3-8b4d-497c-88d2-ab2be1203323 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b" status: 200 len: 1677 microversion: 2.1 time: 0.207980 Oct 04 19:10:51.963656 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3404/6791] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:51 2022] GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b => generated 1677 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:52.140187 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e14ca2fe-8a1e-4288-90b9-81f053b33fac tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1979767608", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": [{"uuid": "a655edbd-31a5-4a2a-bc7b-6c6ce1c7a5d7"}], "key_name": "tempest-TestNetworkBasicOps-731182279", "security_groups": [{"name": "tempest-secgroup-smoke-460611995"}]}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:10:52.269162 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-e14ca2fe-8a1e-4288-90b9-81f053b33fac tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] validate_networks() for [('a655edbd-31a5-4a2a-bc7b-6c6ce1c7a5d7', None, None, None, None, None)] {{(pid=123002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:10:52.559110 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a1f70249-2d38-47c2-93b0-dff1f2b8e16a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:52.559706 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a1f70249-2d38-47c2-93b0-dff1f2b8e16a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 21361c85-1287-4754-8308-ef0f172d0e6f] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:52.571733 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a1f70249-2d38-47c2-93b0-dff1f2b8e16a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:52.572271 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a1f70249-2d38-47c2-93b0-dff1f2b8e16a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:52.572880 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a1f70249-2d38-47c2-93b0-dff1f2b8e16a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:52.573618 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a1f70249-2d38-47c2-93b0-dff1f2b8e16a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:52.574075 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a1f70249-2d38-47c2-93b0-dff1f2b8e16a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:52.574688 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a1f70249-2d38-47c2-93b0-dff1f2b8e16a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:52.688299 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a1f70249-2d38-47c2-93b0-dff1f2b8e16a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:52.697394 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a1f70249-2d38-47c2-93b0-dff1f2b8e16a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/21361c85-1287-4754-8308-ef0f172d0e6f" status: 200 len: 1225 microversion: 2.1 time: 0.143697 Oct 04 19:10:52.713955 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3405/6792] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:52 2022] GET /compute/v2.1/servers/21361c85-1287-4754-8308-ef0f172d0e6f => generated 1225 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:52.760528 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-e14ca2fe-8a1e-4288-90b9-81f053b33fac tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:10:52.764321 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-e14ca2fe-8a1e-4288-90b9-81f053b33fac tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:10:52.764321 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-e14ca2fe-8a1e-4288-90b9-81f053b33fac tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:10:52.764321 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-e14ca2fe-8a1e-4288-90b9-81f053b33fac tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:10:52.764321 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-e14ca2fe-8a1e-4288-90b9-81f053b33fac tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:10:52.772729 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e14ca2fe-8a1e-4288-90b9-81f053b33fac tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:52.773508 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e14ca2fe-8a1e-4288-90b9-81f053b33fac tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:52.774143 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e14ca2fe-8a1e-4288-90b9-81f053b33fac tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:52.775257 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e14ca2fe-8a1e-4288-90b9-81f053b33fac tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:52.775933 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e14ca2fe-8a1e-4288-90b9-81f053b33fac tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:52.776577 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e14ca2fe-8a1e-4288-90b9-81f053b33fac tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:52.798271 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-e14ca2fe-8a1e-4288-90b9-81f053b33fac tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Getting quotas for project 42758fc2a182488489d9989e17beb026. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:10:52.806048 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-e14ca2fe-8a1e-4288-90b9-81f053b33fac tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Getting quotas for user f7f2888940414c0d9a690ad8c68b4da3 and project 42758fc2a182488489d9989e17beb026. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:10:52.823380 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e14ca2fe-8a1e-4288-90b9-81f053b33fac tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Going to run 1 instances... {{(pid=123002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:10:52.824442 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e14ca2fe-8a1e-4288-90b9-81f053b33fac tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] [instance: 1389042a-157a-456c-a87b-7797a17aa095] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:10:52.964965 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e14ca2fe-8a1e-4288-90b9-81f053b33fac tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.828732 Oct 04 19:10:52.965640 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3388/6793] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 19:10:52 2022] POST /compute/v2.1/servers => generated 405 bytes in 830 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:10:52.989296 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1e15f07e-3803-4794-a637-8d4c4b048712 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:52.989977 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1e15f07e-3803-4794-a637-8d4c4b048712 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] [instance: 1389042a-157a-456c-a87b-7797a17aa095] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:52.991099 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-15b2b79e-8d24-4cc9-b647-77731417abf8 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:52.993295 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-15b2b79e-8d24-4cc9-b647-77731417abf8 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 2646dfcb-7213-4870-99eb-68311662d66b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:53.001798 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-15b2b79e-8d24-4cc9-b647-77731417abf8 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:53.005105 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-15b2b79e-8d24-4cc9-b647-77731417abf8 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:53.005105 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-15b2b79e-8d24-4cc9-b647-77731417abf8 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:53.005105 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-15b2b79e-8d24-4cc9-b647-77731417abf8 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:53.005105 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-15b2b79e-8d24-4cc9-b647-77731417abf8 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:53.005105 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-15b2b79e-8d24-4cc9-b647-77731417abf8 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:53.116730 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1e15f07e-3803-4794-a637-8d4c4b048712 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f2888940414c0d9a690ad8c68b4da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42758fc2a182488489d9989e17beb026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:53.132680 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1e15f07e-3803-4794-a637-8d4c4b048712 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] 10.222.0.20 "GET /compute/v2.1/servers/1389042a-157a-456c-a87b-7797a17aa095" status: 200 len: 1248 microversion: 2.1 time: 0.147828 Oct 04 19:10:53.148077 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3406/6794] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:52 2022] GET /compute/v2.1/servers/1389042a-157a-456c-a87b-7797a17aa095 => generated 1248 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:53.208460 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-15b2b79e-8d24-4cc9-b647-77731417abf8 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3060cdc6eeba47288205e107717a6980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a841124bf4392b54c3d6b0ea37e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:53.230688 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-15b2b79e-8d24-4cc9-b647-77731417abf8 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b" status: 200 len: 1677 microversion: 2.1 time: 0.243845 Oct 04 19:10:53.253576 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3389/6795] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:52 2022] GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b => generated 1677 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:53.721727 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ef7f9bf8-1d8b-41ad-92b2-d8e26f999285 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:53.722335 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ef7f9bf8-1d8b-41ad-92b2-d8e26f999285 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 21361c85-1287-4754-8308-ef0f172d0e6f] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:53.730244 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ef7f9bf8-1d8b-41ad-92b2-d8e26f999285 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:53.730963 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ef7f9bf8-1d8b-41ad-92b2-d8e26f999285 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:53.731562 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ef7f9bf8-1d8b-41ad-92b2-d8e26f999285 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:53.732492 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ef7f9bf8-1d8b-41ad-92b2-d8e26f999285 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:53.733113 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ef7f9bf8-1d8b-41ad-92b2-d8e26f999285 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:53.733699 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ef7f9bf8-1d8b-41ad-92b2-d8e26f999285 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:53.801963 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ef7f9bf8-1d8b-41ad-92b2-d8e26f999285 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:53.812243 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ef7f9bf8-1d8b-41ad-92b2-d8e26f999285 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/21361c85-1287-4754-8308-ef0f172d0e6f" status: 200 len: 1225 microversion: 2.1 time: 0.094114 Oct 04 19:10:53.813299 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3407/6796] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:53 2022] GET /compute/v2.1/servers/21361c85-1287-4754-8308-ef0f172d0e6f => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:54.157916 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9ca64fe9-13c5-4901-9d0b-005a32f8d9c3 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:54.162017 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9ca64fe9-13c5-4901-9d0b-005a32f8d9c3 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] [instance: 1389042a-157a-456c-a87b-7797a17aa095] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:54.167378 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9ca64fe9-13c5-4901-9d0b-005a32f8d9c3 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:54.168177 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9ca64fe9-13c5-4901-9d0b-005a32f8d9c3 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:54.169121 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9ca64fe9-13c5-4901-9d0b-005a32f8d9c3 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:54.170060 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9ca64fe9-13c5-4901-9d0b-005a32f8d9c3 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:54.170699 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9ca64fe9-13c5-4901-9d0b-005a32f8d9c3 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:54.171302 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9ca64fe9-13c5-4901-9d0b-005a32f8d9c3 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:54.259961 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4fd4b4c2-30ca-4270-bf20-97b7256cac98 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:54.260957 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-4fd4b4c2-30ca-4270-bf20-97b7256cac98 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 2646dfcb-7213-4870-99eb-68311662d66b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:54.274877 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4fd4b4c2-30ca-4270-bf20-97b7256cac98 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:54.275499 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4fd4b4c2-30ca-4270-bf20-97b7256cac98 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:54.276798 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4fd4b4c2-30ca-4270-bf20-97b7256cac98 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:54.279738 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4fd4b4c2-30ca-4270-bf20-97b7256cac98 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:54.281316 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4fd4b4c2-30ca-4270-bf20-97b7256cac98 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:54.281834 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4fd4b4c2-30ca-4270-bf20-97b7256cac98 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:54.311882 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9ca64fe9-13c5-4901-9d0b-005a32f8d9c3 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f2888940414c0d9a690ad8c68b4da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42758fc2a182488489d9989e17beb026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:54.324023 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9ca64fe9-13c5-4901-9d0b-005a32f8d9c3 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] 10.222.0.20 "GET /compute/v2.1/servers/1389042a-157a-456c-a87b-7797a17aa095" status: 200 len: 1252 microversion: 2.1 time: 0.170862 Oct 04 19:10:54.325149 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3390/6797] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:54 2022] GET /compute/v2.1/servers/1389042a-157a-456c-a87b-7797a17aa095 => generated 1252 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:54.437965 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-4fd4b4c2-30ca-4270-bf20-97b7256cac98 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3060cdc6eeba47288205e107717a6980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a841124bf4392b54c3d6b0ea37e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:54.454415 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-4fd4b4c2-30ca-4270-bf20-97b7256cac98 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b" status: 200 len: 1677 microversion: 2.1 time: 0.198720 Oct 04 19:10:54.468989 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3408/6798] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:54 2022] GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b => generated 1677 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:10:54.837909 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3b2ac32d-186b-4d95-8333-0db4edbbfe70 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:54.838612 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3b2ac32d-186b-4d95-8333-0db4edbbfe70 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 21361c85-1287-4754-8308-ef0f172d0e6f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:54.844916 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3b2ac32d-186b-4d95-8333-0db4edbbfe70 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:54.845419 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3b2ac32d-186b-4d95-8333-0db4edbbfe70 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:54.845876 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3b2ac32d-186b-4d95-8333-0db4edbbfe70 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:54.846582 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3b2ac32d-186b-4d95-8333-0db4edbbfe70 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:54.847057 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3b2ac32d-186b-4d95-8333-0db4edbbfe70 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:54.847516 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3b2ac32d-186b-4d95-8333-0db4edbbfe70 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:54.880137 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3b2ac32d-186b-4d95-8333-0db4edbbfe70 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:54.880647 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3b2ac32d-186b-4d95-8333-0db4edbbfe70 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:54.881103 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3b2ac32d-186b-4d95-8333-0db4edbbfe70 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:54.881570 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-3b2ac32d-186b-4d95-8333-0db4edbbfe70 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lazy-loading 'fault' on Instance uuid 21361c85-1287-4754-8308-ef0f172d0e6f {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:10:54.927278 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3b2ac32d-186b-4d95-8333-0db4edbbfe70 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:54.935900 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3b2ac32d-186b-4d95-8333-0db4edbbfe70 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/21361c85-1287-4754-8308-ef0f172d0e6f" status: 200 len: 1230 microversion: 2.1 time: 0.103459 Oct 04 19:10:54.940796 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3391/6799] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:54 2022] GET /compute/v2.1/servers/21361c85-1287-4754-8308-ef0f172d0e6f => generated 1230 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:55.346830 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6128926e-897f-4247-8c7f-2563a8345a71 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:55.347449 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6128926e-897f-4247-8c7f-2563a8345a71 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] [instance: 1389042a-157a-456c-a87b-7797a17aa095] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:55.354817 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6128926e-897f-4247-8c7f-2563a8345a71 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:55.355315 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6128926e-897f-4247-8c7f-2563a8345a71 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:55.355753 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6128926e-897f-4247-8c7f-2563a8345a71 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:55.356492 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6128926e-897f-4247-8c7f-2563a8345a71 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:55.356946 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6128926e-897f-4247-8c7f-2563a8345a71 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:55.357590 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6128926e-897f-4247-8c7f-2563a8345a71 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:55.436228 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6128926e-897f-4247-8c7f-2563a8345a71 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f2888940414c0d9a690ad8c68b4da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42758fc2a182488489d9989e17beb026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:55.444281 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6128926e-897f-4247-8c7f-2563a8345a71 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] 10.222.0.20 "GET /compute/v2.1/servers/1389042a-157a-456c-a87b-7797a17aa095" status: 200 len: 1300 microversion: 2.1 time: 0.101245 Oct 04 19:10:55.444861 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3409/6800] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:55 2022] GET /compute/v2.1/servers/1389042a-157a-456c-a87b-7797a17aa095 => generated 1300 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:55.480176 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-67e51b39-bf85-4784-90d1-82a5754096a5 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:55.480814 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-67e51b39-bf85-4784-90d1-82a5754096a5 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 2646dfcb-7213-4870-99eb-68311662d66b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:55.487708 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-67e51b39-bf85-4784-90d1-82a5754096a5 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:55.488249 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-67e51b39-bf85-4784-90d1-82a5754096a5 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:55.488701 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-67e51b39-bf85-4784-90d1-82a5754096a5 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:55.489406 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-67e51b39-bf85-4784-90d1-82a5754096a5 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:55.490477 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-67e51b39-bf85-4784-90d1-82a5754096a5 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:55.490936 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-67e51b39-bf85-4784-90d1-82a5754096a5 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:55.642664 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-67e51b39-bf85-4784-90d1-82a5754096a5 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3060cdc6eeba47288205e107717a6980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a841124bf4392b54c3d6b0ea37e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:55.651636 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-67e51b39-bf85-4784-90d1-82a5754096a5 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b" status: 200 len: 1677 microversion: 2.1 time: 0.175391 Oct 04 19:10:55.652570 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3392/6801] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:55 2022] GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b => generated 1677 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:55.959278 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-40610ef3-8b8f-42d6-a764-ea96df9e6b9b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:55.959924 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-40610ef3-8b8f-42d6-a764-ea96df9e6b9b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 21361c85-1287-4754-8308-ef0f172d0e6f] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:55.967385 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-40610ef3-8b8f-42d6-a764-ea96df9e6b9b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:55.967879 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-40610ef3-8b8f-42d6-a764-ea96df9e6b9b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:55.968351 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-40610ef3-8b8f-42d6-a764-ea96df9e6b9b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:55.969063 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-40610ef3-8b8f-42d6-a764-ea96df9e6b9b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:55.969518 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-40610ef3-8b8f-42d6-a764-ea96df9e6b9b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:55.969949 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-40610ef3-8b8f-42d6-a764-ea96df9e6b9b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:56.007739 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-40610ef3-8b8f-42d6-a764-ea96df9e6b9b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:56.009179 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-40610ef3-8b8f-42d6-a764-ea96df9e6b9b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:56.009787 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-40610ef3-8b8f-42d6-a764-ea96df9e6b9b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:56.010431 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-40610ef3-8b8f-42d6-a764-ea96df9e6b9b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lazy-loading 'fault' on Instance uuid 21361c85-1287-4754-8308-ef0f172d0e6f {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:10:56.059815 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-40610ef3-8b8f-42d6-a764-ea96df9e6b9b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:56.067969 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-40610ef3-8b8f-42d6-a764-ea96df9e6b9b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/21361c85-1287-4754-8308-ef0f172d0e6f" status: 200 len: 1230 microversion: 2.1 time: 0.112883 Oct 04 19:10:56.069118 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3410/6802] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:55 2022] GET /compute/v2.1/servers/21361c85-1287-4754-8308-ef0f172d0e6f => generated 1230 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:56.469740 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-62e1630c-c3a2-4d37-af51-c20b367aac6a tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:56.470596 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-62e1630c-c3a2-4d37-af51-c20b367aac6a tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] [instance: 1389042a-157a-456c-a87b-7797a17aa095] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:56.478097 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-62e1630c-c3a2-4d37-af51-c20b367aac6a tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:56.478756 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-62e1630c-c3a2-4d37-af51-c20b367aac6a tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:56.479471 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-62e1630c-c3a2-4d37-af51-c20b367aac6a tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:56.480335 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-62e1630c-c3a2-4d37-af51-c20b367aac6a tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:56.480896 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-62e1630c-c3a2-4d37-af51-c20b367aac6a tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:56.481447 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-62e1630c-c3a2-4d37-af51-c20b367aac6a tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:56.550589 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-62e1630c-c3a2-4d37-af51-c20b367aac6a tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f2888940414c0d9a690ad8c68b4da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42758fc2a182488489d9989e17beb026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:56.568583 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-62e1630c-c3a2-4d37-af51-c20b367aac6a tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] 10.222.0.20 "GET /compute/v2.1/servers/1389042a-157a-456c-a87b-7797a17aa095" status: 200 len: 1306 microversion: 2.1 time: 0.103376 Oct 04 19:10:56.574642 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3393/6803] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:56 2022] GET /compute/v2.1/servers/1389042a-157a-456c-a87b-7797a17aa095 => generated 1306 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:56.678913 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b78ff8c3-1410-4d2f-8160-8c26d646cd84 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:56.682023 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b78ff8c3-1410-4d2f-8160-8c26d646cd84 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 2646dfcb-7213-4870-99eb-68311662d66b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:56.689892 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b78ff8c3-1410-4d2f-8160-8c26d646cd84 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:56.690543 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b78ff8c3-1410-4d2f-8160-8c26d646cd84 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:56.690982 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b78ff8c3-1410-4d2f-8160-8c26d646cd84 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:56.691692 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b78ff8c3-1410-4d2f-8160-8c26d646cd84 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:56.692185 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b78ff8c3-1410-4d2f-8160-8c26d646cd84 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:56.692621 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b78ff8c3-1410-4d2f-8160-8c26d646cd84 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:56.844949 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b78ff8c3-1410-4d2f-8160-8c26d646cd84 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3060cdc6eeba47288205e107717a6980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a841124bf4392b54c3d6b0ea37e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:56.853601 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b78ff8c3-1410-4d2f-8160-8c26d646cd84 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b" status: 200 len: 1677 microversion: 2.1 time: 0.180453 Oct 04 19:10:56.854205 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3411/6804] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:56 2022] GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b => generated 1677 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:57.092803 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-28891797-53a4-45ef-9814-2101b8b0d098 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:57.094152 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-28891797-53a4-45ef-9814-2101b8b0d098 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 21361c85-1287-4754-8308-ef0f172d0e6f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:57.100614 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-28891797-53a4-45ef-9814-2101b8b0d098 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:57.101945 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-28891797-53a4-45ef-9814-2101b8b0d098 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:57.102470 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-28891797-53a4-45ef-9814-2101b8b0d098 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:57.103254 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-28891797-53a4-45ef-9814-2101b8b0d098 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:57.104315 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-28891797-53a4-45ef-9814-2101b8b0d098 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:57.107081 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-28891797-53a4-45ef-9814-2101b8b0d098 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:57.124717 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-28891797-53a4-45ef-9814-2101b8b0d098 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] HTTP exception thrown: Instance 21361c85-1287-4754-8308-ef0f172d0e6f could not be found. Oct 04 19:10:57.126528 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-28891797-53a4-45ef-9814-2101b8b0d098 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Request method failure captured: Oct 04 19:10:57.126528 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/21361c85-1287-4754-8308-ef0f172d0e6f HTTP/1.1 Oct 04 19:10:57.126528 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 19:10:57.126528 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 19:10:57.126528 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 19:10:57.126528 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 19:10:57.126528 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 19:10:57.126528 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 19:10:57.126528 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 19:10:57.126528 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 19:10:57.126528 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPIJ4KptPiy5XyaUYG9pLSP7TnMEf-PY7yFvjaPGmW4DAHqC1kasy1bm5to10RwAF_dSHQb87b5amqQ9ZUna6URZpq6M0BGpvwENg84W1HvOZfHgDXT7E6YYTtPhmcCZbmf-MEJzIKVI741HwGnmdHx846U9v3mpOw6zsk7UNEsUijp4 Oct 04 19:10:57.126528 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 19:10:57.126528 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 19:10:57.126528 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 19:10:57.126528 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 19:10:57.126528 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 19:10:57.126528 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 19:10:57.126528 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 82d0cd3db371459db429cb770abde738 Oct 04 19:10:57.126528 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-TestVolumeBootPattern-1621879949 Oct 04 19:10:57.126528 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 19:10:57.126528 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 19:10:57.126528 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/82d0cd3db371459db429cb770abde738"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_82d0cd3db371459db429cb770abde738", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/82d0cd3db371459db429cb770abde738"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/82d0cd3db371459db429cb770abde738"}]}] Oct 04 19:10:57.126528 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-TestVolumeBootPattern-1621879949 Oct 04 19:10:57.126528 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 82d0cd3db371459db429cb770abde738 Oct 04 19:10:57.126528 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-TestVolumeBootPattern-1621879949 Oct 04 19:10:57.126528 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-TestVolumeBootPattern-1621879949-project Oct 04 19:10:57.126528 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 19:10:57.126528 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 19:10:57.126528 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: a65ae9c3fb3c46a2a393fe21ce21b9d4 Oct 04 19:10:57.126528 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-TestVolumeBootPattern-1621879949-project Oct 04 19:10:57.126528 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 19:10:57.126528 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 21361c85-1287-4754-8308-ef0f172d0e6f could not be found. Oct 04 19:10:57.126528 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '21361c85-1287-4754-8308-ef0f172d0e6f'} Oct 04 19:10:57.126528 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:10:57.126528 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:10:57.126528 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:10:57.126528 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:10:57.126528 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:10:57.126528 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:10:57.126528 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:10:57.126528 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:10:57.126528 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:10:57.126528 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:10:57.126528 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21361c85-1287-4754-8308-ef0f172d0e6f could not be found. Oct 04 19:10:57.126528 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:10:57.126528 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:10:57.126528 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:10:57.126528 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:10:57.126528 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:10:57.126528 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:10:57.126528 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:10:57.126528 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:10:57.126528 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:10:57.126528 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:10:57.126528 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:10:57.126528 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:10:57.126528 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:10:57.126528 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:10:57.126528 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:10:57.126528 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:10:57.126528 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21361c85-1287-4754-8308-ef0f172d0e6f could not be found. Oct 04 19:10:57.126528 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:10:57.126528 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:10:57.126528 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:10:57.131156 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:10:57.131156 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:10:57.131156 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:10:57.131156 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:10:57.131156 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:10:57.131156 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21361c85-1287-4754-8308-ef0f172d0e6f could not be found. Oct 04 19:10:57.131156 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:10:57.131156 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-28891797-53a4-45ef-9814-2101b8b0d098 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Returning 404 to user: Instance 21361c85-1287-4754-8308-ef0f172d0e6f could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:10:57.131156 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-28891797-53a4-45ef-9814-2101b8b0d098 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/21361c85-1287-4754-8308-ef0f172d0e6f" status: 404 len: 111 microversion: 2.1 time: 0.039997 Oct 04 19:10:57.131156 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3394/6805] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:57 2022] GET /compute/v2.1/servers/21361c85-1287-4754-8308-ef0f172d0e6f => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:10:57.196604 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-67b647e9-feae-4a11-8be4-8260b9bc92c0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-266262610", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1229993015", "security_groups": [{"name": "tempest-secgroup-smoke-722389711"}], "block_device_mapping_v2": [{"uuid": "7fa35fd9-dbda-4b69-a259-952999ba393b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "dbc89e1f-759d-4fcb-8e1c-542119e29e34"}]}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:10:57.345379 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.neutron [None req-67b647e9-feae-4a11-8be4-8260b9bc92c0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] validate_networks() for [('dbc89e1f-759d-4fcb-8e1c-542119e29e34', None, None, None, None, None)] {{(pid=123001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:10:57.625980 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-769f61b8-bfea-459f-9e19-6efefc887446 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:57.627985 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-769f61b8-bfea-459f-9e19-6efefc887446 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] [instance: 1389042a-157a-456c-a87b-7797a17aa095] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:57.639831 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-769f61b8-bfea-459f-9e19-6efefc887446 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:57.640722 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-769f61b8-bfea-459f-9e19-6efefc887446 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:57.642705 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-769f61b8-bfea-459f-9e19-6efefc887446 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:57.644257 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-769f61b8-bfea-459f-9e19-6efefc887446 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:57.645351 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-769f61b8-bfea-459f-9e19-6efefc887446 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:57.646074 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-769f61b8-bfea-459f-9e19-6efefc887446 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:57.654499 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:10:57.852658 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-67b647e9-feae-4a11-8be4-8260b9bc92c0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:10:57.859017 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-67b647e9-feae-4a11-8be4-8260b9bc92c0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:10:57.859017 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-67b647e9-feae-4a11-8be4-8260b9bc92c0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:10:57.859017 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-67b647e9-feae-4a11-8be4-8260b9bc92c0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:10:57.859017 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-67b647e9-feae-4a11-8be4-8260b9bc92c0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:10:57.864438 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-67b647e9-feae-4a11-8be4-8260b9bc92c0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:57.865338 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-67b647e9-feae-4a11-8be4-8260b9bc92c0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:57.865993 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-67b647e9-feae-4a11-8be4-8260b9bc92c0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:57.867127 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-67b647e9-feae-4a11-8be4-8260b9bc92c0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:57.867784 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-67b647e9-feae-4a11-8be4-8260b9bc92c0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:57.868225 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-67b647e9-feae-4a11-8be4-8260b9bc92c0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:57.878216 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-769f61b8-bfea-459f-9e19-6efefc887446 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f2888940414c0d9a690ad8c68b4da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42758fc2a182488489d9989e17beb026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:57.887434 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-67b647e9-feae-4a11-8be4-8260b9bc92c0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Getting quotas for project 82d0cd3db371459db429cb770abde738. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:10:57.887618 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-769f61b8-bfea-459f-9e19-6efefc887446 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] 10.222.0.20 "GET /compute/v2.1/servers/1389042a-157a-456c-a87b-7797a17aa095" status: 200 len: 1373 microversion: 2.1 time: 0.267475 Oct 04 19:10:57.888147 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3395/6806] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:57 2022] GET /compute/v2.1/servers/1389042a-157a-456c-a87b-7797a17aa095 => generated 1373 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:10:57.893517 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-67b647e9-feae-4a11-8be4-8260b9bc92c0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Getting quotas for user a65ae9c3fb3c46a2a393fe21ce21b9d4 and project 82d0cd3db371459db429cb770abde738. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:10:57.894096 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5ae8f033-9b9f-4537-a40a-41791828bc0f tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:57.901080 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5ae8f033-9b9f-4537-a40a-41791828bc0f tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 2646dfcb-7213-4870-99eb-68311662d66b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:57.910016 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5ae8f033-9b9f-4537-a40a-41791828bc0f tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:57.910746 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5ae8f033-9b9f-4537-a40a-41791828bc0f tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:57.911430 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5ae8f033-9b9f-4537-a40a-41791828bc0f tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:57.912376 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5ae8f033-9b9f-4537-a40a-41791828bc0f tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:57.913088 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5ae8f033-9b9f-4537-a40a-41791828bc0f tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:57.913782 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5ae8f033-9b9f-4537-a40a-41791828bc0f tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:57.981558 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-67b647e9-feae-4a11-8be4-8260b9bc92c0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Going to run 1 instances... {{(pid=123001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:10:57.983907 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-67b647e9-feae-4a11-8be4-8260b9bc92c0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 61421b3c-4c72-42c5-bbdc-793a4fb12b3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7fa35fd9-dbda-4b69-a259-952999ba393b',volume_size=None,volume_type=None)] {{(pid=123001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:10:58.089452 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5ae8f033-9b9f-4537-a40a-41791828bc0f tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3060cdc6eeba47288205e107717a6980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a841124bf4392b54c3d6b0ea37e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:58.098497 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5ae8f033-9b9f-4537-a40a-41791828bc0f tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b" status: 200 len: 1677 microversion: 2.1 time: 0.208688 Oct 04 19:10:58.099104 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3396/6807] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:57 2022] GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b => generated 1677 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:58.117969 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-467e9b70-7632-4222-9bc8-6d231ef0c5a3 req-98960479-7301-42c2-bbda-cc7440829ba4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1389042a-157a-456c-a87b-7797a17aa095", "tag": "e4f588ea-71f6-4a97-9faf-ef9eb6c45e8e"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:10:58.128075 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-467e9b70-7632-4222-9bc8-6d231ef0c5a3 req-98960479-7301-42c2-bbda-cc7440829ba4 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:58.128688 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-467e9b70-7632-4222-9bc8-6d231ef0c5a3 req-98960479-7301-42c2-bbda-cc7440829ba4 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:58.129200 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-467e9b70-7632-4222-9bc8-6d231ef0c5a3 req-98960479-7301-42c2-bbda-cc7440829ba4 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:58.142173 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-467e9b70-7632-4222-9bc8-6d231ef0c5a3 req-98960479-7301-42c2-bbda-cc7440829ba4 service nova] Creating event network-changed:e4f588ea-71f6-4a97-9faf-ef9eb6c45e8e for instance 1389042a-157a-456c-a87b-7797a17aa095 on n-h2-850501-14 Oct 04 19:10:58.147879 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-467e9b70-7632-4222-9bc8-6d231ef0c5a3 req-98960479-7301-42c2-bbda-cc7440829ba4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036849 Oct 04 19:10:58.149484 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3397/6808] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:10:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:10:58.377071 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-67b647e9-feae-4a11-8be4-8260b9bc92c0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.185851 Oct 04 19:10:58.378057 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3412/6809] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 19:10:57 2022] POST /compute/v2.1/servers => generated 405 bytes in 1188 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 19:10:58.392449 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-91173b7e-158b-43e5-b155-b8389d17f03f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:58.408202 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-91173b7e-158b-43e5-b155-b8389d17f03f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 61421b3c-4c72-42c5-bbdc-793a4fb12b3e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:58.486099 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-91173b7e-158b-43e5-b155-b8389d17f03f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:58.493998 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-91173b7e-158b-43e5-b155-b8389d17f03f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/61421b3c-4c72-42c5-bbdc-793a4fb12b3e" status: 200 len: 1094 microversion: 2.1 time: 0.106752 Oct 04 19:10:58.494585 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3398/6810] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:58 2022] GET /compute/v2.1/servers/61421b3c-4c72-42c5-bbdc-793a4fb12b3e => generated 1094 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:58.919052 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-37f5f7af-a7f1-4388-84b8-83223ed4c460 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:58.919052 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-37f5f7af-a7f1-4388-84b8-83223ed4c460 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] [instance: 1389042a-157a-456c-a87b-7797a17aa095] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:58.923260 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-37f5f7af-a7f1-4388-84b8-83223ed4c460 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:58.923947 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-37f5f7af-a7f1-4388-84b8-83223ed4c460 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:58.924424 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-37f5f7af-a7f1-4388-84b8-83223ed4c460 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:58.925170 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-37f5f7af-a7f1-4388-84b8-83223ed4c460 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:58.925635 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-37f5f7af-a7f1-4388-84b8-83223ed4c460 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:58.926094 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-37f5f7af-a7f1-4388-84b8-83223ed4c460 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:59.073232 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-37f5f7af-a7f1-4388-84b8-83223ed4c460 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f2888940414c0d9a690ad8c68b4da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42758fc2a182488489d9989e17beb026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:59.082537 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-37f5f7af-a7f1-4388-84b8-83223ed4c460 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] 10.222.0.20 "GET /compute/v2.1/servers/1389042a-157a-456c-a87b-7797a17aa095" status: 200 len: 1373 microversion: 2.1 time: 0.171777 Oct 04 19:10:59.082537 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3413/6811] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:58 2022] GET /compute/v2.1/servers/1389042a-157a-456c-a87b-7797a17aa095 => generated 1373 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:59.123500 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e6995650-c2ce-4355-b8b3-578f93b6566a tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:59.124182 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e6995650-c2ce-4355-b8b3-578f93b6566a tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 2646dfcb-7213-4870-99eb-68311662d66b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:59.131853 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e6995650-c2ce-4355-b8b3-578f93b6566a tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:59.132396 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e6995650-c2ce-4355-b8b3-578f93b6566a tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:59.133593 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e6995650-c2ce-4355-b8b3-578f93b6566a tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:59.134320 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e6995650-c2ce-4355-b8b3-578f93b6566a tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:59.134800 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e6995650-c2ce-4355-b8b3-578f93b6566a tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:59.135257 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e6995650-c2ce-4355-b8b3-578f93b6566a tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:59.271400 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e6995650-c2ce-4355-b8b3-578f93b6566a tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3060cdc6eeba47288205e107717a6980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a841124bf4392b54c3d6b0ea37e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:59.279486 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e6995650-c2ce-4355-b8b3-578f93b6566a tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b" status: 200 len: 1677 microversion: 2.1 time: 0.159980 Oct 04 19:10:59.280079 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3399/6812] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:59 2022] GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:59.518296 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-21257fc6-3815-4606-9507-ecf8fd034d8e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:59.519008 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-21257fc6-3815-4606-9507-ecf8fd034d8e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 61421b3c-4c72-42c5-bbdc-793a4fb12b3e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:59.526078 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-21257fc6-3815-4606-9507-ecf8fd034d8e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:59.526694 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-21257fc6-3815-4606-9507-ecf8fd034d8e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:59.527185 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-21257fc6-3815-4606-9507-ecf8fd034d8e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:59.531307 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-21257fc6-3815-4606-9507-ecf8fd034d8e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:59.531307 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-21257fc6-3815-4606-9507-ecf8fd034d8e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:59.531307 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-21257fc6-3815-4606-9507-ecf8fd034d8e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:59.592495 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-21257fc6-3815-4606-9507-ecf8fd034d8e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:59.601938 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-21257fc6-3815-4606-9507-ecf8fd034d8e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/61421b3c-4c72-42c5-bbdc-793a4fb12b3e" status: 200 len: 1144 microversion: 2.1 time: 0.087024 Oct 04 19:10:59.602667 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3414/6813] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:59 2022] GET /compute/v2.1/servers/61421b3c-4c72-42c5-bbdc-793a4fb12b3e => generated 1144 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:00.106838 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a7ae922c-2e75-4cb8-ac2f-5918496eeae7 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:00.125470 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a7ae922c-2e75-4cb8-ac2f-5918496eeae7 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] [instance: 1389042a-157a-456c-a87b-7797a17aa095] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:00.125470 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a7ae922c-2e75-4cb8-ac2f-5918496eeae7 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:00.125470 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a7ae922c-2e75-4cb8-ac2f-5918496eeae7 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:00.125470 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a7ae922c-2e75-4cb8-ac2f-5918496eeae7 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:00.125470 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a7ae922c-2e75-4cb8-ac2f-5918496eeae7 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:00.125470 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a7ae922c-2e75-4cb8-ac2f-5918496eeae7 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:00.125470 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a7ae922c-2e75-4cb8-ac2f-5918496eeae7 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:00.270392 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a7ae922c-2e75-4cb8-ac2f-5918496eeae7 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f2888940414c0d9a690ad8c68b4da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42758fc2a182488489d9989e17beb026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:00.279682 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a7ae922c-2e75-4cb8-ac2f-5918496eeae7 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] 10.222.0.20 "GET /compute/v2.1/servers/1389042a-157a-456c-a87b-7797a17aa095" status: 200 len: 1373 microversion: 2.1 time: 0.177951 Oct 04 19:11:00.280877 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3400/6814] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:00 2022] GET /compute/v2.1/servers/1389042a-157a-456c-a87b-7797a17aa095 => generated 1373 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:00.303392 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-10ed101f-b1f6-4784-87e1-bf3673859c2a tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:00.304009 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-10ed101f-b1f6-4784-87e1-bf3673859c2a tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 2646dfcb-7213-4870-99eb-68311662d66b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:00.314217 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-10ed101f-b1f6-4784-87e1-bf3673859c2a tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:00.314720 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-10ed101f-b1f6-4784-87e1-bf3673859c2a tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:00.315166 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-10ed101f-b1f6-4784-87e1-bf3673859c2a tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:00.316012 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-10ed101f-b1f6-4784-87e1-bf3673859c2a tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:00.316647 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-10ed101f-b1f6-4784-87e1-bf3673859c2a tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:00.317420 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-10ed101f-b1f6-4784-87e1-bf3673859c2a tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:00.463350 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-10ed101f-b1f6-4784-87e1-bf3673859c2a tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3060cdc6eeba47288205e107717a6980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a841124bf4392b54c3d6b0ea37e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:00.471409 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-10ed101f-b1f6-4784-87e1-bf3673859c2a tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b" status: 200 len: 1677 microversion: 2.1 time: 0.171963 Oct 04 19:11:00.471984 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3415/6815] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:00 2022] GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b => generated 1677 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:00.625842 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f821be62-3dbe-48b3-be8c-671292c79ccd tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:00.626408 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f821be62-3dbe-48b3-be8c-671292c79ccd tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 61421b3c-4c72-42c5-bbdc-793a4fb12b3e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:00.633122 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f821be62-3dbe-48b3-be8c-671292c79ccd tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:00.633749 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f821be62-3dbe-48b3-be8c-671292c79ccd tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:00.634207 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f821be62-3dbe-48b3-be8c-671292c79ccd tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:00.634927 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f821be62-3dbe-48b3-be8c-671292c79ccd tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:00.635404 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f821be62-3dbe-48b3-be8c-671292c79ccd tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:00.635846 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f821be62-3dbe-48b3-be8c-671292c79ccd tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:00.703465 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f821be62-3dbe-48b3-be8c-671292c79ccd tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:00.714363 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f821be62-3dbe-48b3-be8c-671292c79ccd tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/61421b3c-4c72-42c5-bbdc-793a4fb12b3e" status: 200 len: 1192 microversion: 2.1 time: 0.092571 Oct 04 19:11:00.715135 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3401/6816] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:00 2022] GET /compute/v2.1/servers/61421b3c-4c72-42c5-bbdc-793a4fb12b3e => generated 1192 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:01.308846 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0fa2cc77-9b3c-4198-a046-26311299f2cc tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:01.310507 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0fa2cc77-9b3c-4198-a046-26311299f2cc tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] [instance: 1389042a-157a-456c-a87b-7797a17aa095] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:01.319611 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0fa2cc77-9b3c-4198-a046-26311299f2cc tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:01.321258 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0fa2cc77-9b3c-4198-a046-26311299f2cc tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:01.321823 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0fa2cc77-9b3c-4198-a046-26311299f2cc tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:01.322620 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0fa2cc77-9b3c-4198-a046-26311299f2cc tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:01.326526 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0fa2cc77-9b3c-4198-a046-26311299f2cc tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:01.327366 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0fa2cc77-9b3c-4198-a046-26311299f2cc tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:01.340334 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:11:01.495864 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7f8a49e3-9da4-4ef8-9399-c1e6d3ff2d95 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:01.498798 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7f8a49e3-9da4-4ef8-9399-c1e6d3ff2d95 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 2646dfcb-7213-4870-99eb-68311662d66b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:01.509027 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7f8a49e3-9da4-4ef8-9399-c1e6d3ff2d95 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:01.509314 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7f8a49e3-9da4-4ef8-9399-c1e6d3ff2d95 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:01.509766 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7f8a49e3-9da4-4ef8-9399-c1e6d3ff2d95 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:01.510503 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7f8a49e3-9da4-4ef8-9399-c1e6d3ff2d95 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:01.510993 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7f8a49e3-9da4-4ef8-9399-c1e6d3ff2d95 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:01.511452 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7f8a49e3-9da4-4ef8-9399-c1e6d3ff2d95 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:01.659247 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0fa2cc77-9b3c-4198-a046-26311299f2cc tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f2888940414c0d9a690ad8c68b4da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42758fc2a182488489d9989e17beb026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:01.669957 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0fa2cc77-9b3c-4198-a046-26311299f2cc tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] 10.222.0.20 "GET /compute/v2.1/servers/1389042a-157a-456c-a87b-7797a17aa095" status: 200 len: 1373 microversion: 2.1 time: 0.366552 Oct 04 19:11:01.671611 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3416/6817] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:01 2022] GET /compute/v2.1/servers/1389042a-157a-456c-a87b-7797a17aa095 => generated 1373 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:01.739178 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-658522ae-d77c-4617-91da-0dc41c3a602a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:01.739806 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-658522ae-d77c-4617-91da-0dc41c3a602a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 61421b3c-4c72-42c5-bbdc-793a4fb12b3e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:01.754717 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-658522ae-d77c-4617-91da-0dc41c3a602a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:01.755644 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-658522ae-d77c-4617-91da-0dc41c3a602a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:01.756799 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-658522ae-d77c-4617-91da-0dc41c3a602a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:01.758298 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-658522ae-d77c-4617-91da-0dc41c3a602a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:01.759166 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-658522ae-d77c-4617-91da-0dc41c3a602a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:01.759908 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-658522ae-d77c-4617-91da-0dc41c3a602a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:01.844772 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7f8a49e3-9da4-4ef8-9399-c1e6d3ff2d95 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3060cdc6eeba47288205e107717a6980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a841124bf4392b54c3d6b0ea37e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:01.854697 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7f8a49e3-9da4-4ef8-9399-c1e6d3ff2d95 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b" status: 200 len: 1654 microversion: 2.1 time: 0.363666 Oct 04 19:11:01.857114 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3402/6818] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:01 2022] GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b => generated 1654 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:11:01.871604 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-658522ae-d77c-4617-91da-0dc41c3a602a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:01.884237 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-659016ab-5b6b-4466-8b37-b420c6a43eb2 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:11:01.893087 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-658522ae-d77c-4617-91da-0dc41c3a602a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/61421b3c-4c72-42c5-bbdc-793a4fb12b3e" status: 200 len: 1210 microversion: 2.1 time: 0.158071 Oct 04 19:11:01.897006 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3417/6819] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:01 2022] GET /compute/v2.1/servers/61421b3c-4c72-42c5-bbdc-793a4fb12b3e => generated 1210 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:11:01.900665 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-659016ab-5b6b-4466-8b37-b420c6a43eb2 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:01.901647 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-659016ab-5b6b-4466-8b37-b420c6a43eb2 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:01.902505 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-659016ab-5b6b-4466-8b37-b420c6a43eb2 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:01.939718 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-659016ab-5b6b-4466-8b37-b420c6a43eb2 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 2646dfcb-7213-4870-99eb-68311662d66b] Going to try to start instance {{(pid=123002) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 04 19:11:02.198359 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-659016ab-5b6b-4466-8b37-b420c6a43eb2 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "POST /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b/action" status: 202 len: 0 microversion: 2.1 time: 0.319276 Oct 04 19:11:02.199737 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3403/6820] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 19:11:01 2022] POST /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b/action => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 19:11:02.213503 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-dcd553e5-d4d2-404f-89f5-53e93f0da266 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:02.217154 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-dcd553e5-d4d2-404f-89f5-53e93f0da266 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 2646dfcb-7213-4870-99eb-68311662d66b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:02.231822 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dcd553e5-d4d2-404f-89f5-53e93f0da266 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:02.232498 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dcd553e5-d4d2-404f-89f5-53e93f0da266 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:02.233099 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dcd553e5-d4d2-404f-89f5-53e93f0da266 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:02.234062 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dcd553e5-d4d2-404f-89f5-53e93f0da266 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:02.234769 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dcd553e5-d4d2-404f-89f5-53e93f0da266 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:02.235291 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dcd553e5-d4d2-404f-89f5-53e93f0da266 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:02.478509 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-dcd553e5-d4d2-404f-89f5-53e93f0da266 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3060cdc6eeba47288205e107717a6980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a841124bf4392b54c3d6b0ea37e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:02.490947 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-dcd553e5-d4d2-404f-89f5-53e93f0da266 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b" status: 200 len: 1663 microversion: 2.1 time: 0.285670 Oct 04 19:11:02.493900 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3418/6821] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:02 2022] GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b => generated 1663 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:02.698196 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-371e243c-0f27-4d9a-a69a-b3b519bbacb4 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:02.700934 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-371e243c-0f27-4d9a-a69a-b3b519bbacb4 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] [instance: 1389042a-157a-456c-a87b-7797a17aa095] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:02.714037 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-371e243c-0f27-4d9a-a69a-b3b519bbacb4 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:02.714810 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-371e243c-0f27-4d9a-a69a-b3b519bbacb4 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:02.715996 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-371e243c-0f27-4d9a-a69a-b3b519bbacb4 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:02.720042 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-371e243c-0f27-4d9a-a69a-b3b519bbacb4 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:02.720895 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-371e243c-0f27-4d9a-a69a-b3b519bbacb4 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:02.721531 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-371e243c-0f27-4d9a-a69a-b3b519bbacb4 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:02.794473 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:11:02.921452 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-dc6eddec-6c1c-4f2c-9f39-fe164b54afa0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:02.922167 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-dc6eddec-6c1c-4f2c-9f39-fe164b54afa0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 61421b3c-4c72-42c5-bbdc-793a4fb12b3e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:02.930671 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dc6eddec-6c1c-4f2c-9f39-fe164b54afa0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:02.930671 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dc6eddec-6c1c-4f2c-9f39-fe164b54afa0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:02.930671 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dc6eddec-6c1c-4f2c-9f39-fe164b54afa0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:02.931324 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dc6eddec-6c1c-4f2c-9f39-fe164b54afa0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:02.933021 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dc6eddec-6c1c-4f2c-9f39-fe164b54afa0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:02.933883 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dc6eddec-6c1c-4f2c-9f39-fe164b54afa0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:03.241164 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-371e243c-0f27-4d9a-a69a-b3b519bbacb4 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f2888940414c0d9a690ad8c68b4da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42758fc2a182488489d9989e17beb026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:03.243346 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-dc6eddec-6c1c-4f2c-9f39-fe164b54afa0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:03.251634 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-dc6eddec-6c1c-4f2c-9f39-fe164b54afa0 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/61421b3c-4c72-42c5-bbdc-793a4fb12b3e" status: 200 len: 1277 microversion: 2.1 time: 0.334101 Oct 04 19:11:03.264186 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-371e243c-0f27-4d9a-a69a-b3b519bbacb4 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] 10.222.0.20 "GET /compute/v2.1/servers/1389042a-157a-456c-a87b-7797a17aa095" status: 200 len: 1373 microversion: 2.1 time: 0.573703 Oct 04 19:11:03.264592 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3419/6822] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:02 2022] GET /compute/v2.1/servers/61421b3c-4c72-42c5-bbdc-793a4fb12b3e => generated 1277 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:03.272205 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3404/6823] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:02 2022] GET /compute/v2.1/servers/1389042a-157a-456c-a87b-7797a17aa095 => generated 1373 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:03.515143 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1f32f072-a767-4d88-861d-e53689ea9650 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:03.516503 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1f32f072-a767-4d88-861d-e53689ea9650 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 2646dfcb-7213-4870-99eb-68311662d66b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:03.524917 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1f32f072-a767-4d88-861d-e53689ea9650 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:03.525420 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1f32f072-a767-4d88-861d-e53689ea9650 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:03.526077 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1f32f072-a767-4d88-861d-e53689ea9650 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:03.526840 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1f32f072-a767-4d88-861d-e53689ea9650 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:03.527496 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1f32f072-a767-4d88-861d-e53689ea9650 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:03.528043 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1f32f072-a767-4d88-861d-e53689ea9650 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:03.700073 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1f32f072-a767-4d88-861d-e53689ea9650 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3060cdc6eeba47288205e107717a6980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a841124bf4392b54c3d6b0ea37e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:03.712094 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1f32f072-a767-4d88-861d-e53689ea9650 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b" status: 200 len: 1663 microversion: 2.1 time: 0.198308 Oct 04 19:11:03.713474 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3420/6824] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:03 2022] GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b => generated 1663 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:03.745454 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-be51a303-42ec-41ca-8b5c-45315a1cb846 req-1d4498f1-1059-44a8-99ce-788fd24699a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61421b3c-4c72-42c5-bbdc-793a4fb12b3e", "tag": "79b4a303-9155-4741-b15f-1a2d746a7a89"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:11:03.778638 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-be51a303-42ec-41ca-8b5c-45315a1cb846 req-1d4498f1-1059-44a8-99ce-788fd24699a3 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:03.782731 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-be51a303-42ec-41ca-8b5c-45315a1cb846 req-1d4498f1-1059-44a8-99ce-788fd24699a3 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:03.783472 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-be51a303-42ec-41ca-8b5c-45315a1cb846 req-1d4498f1-1059-44a8-99ce-788fd24699a3 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:03.806152 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-be51a303-42ec-41ca-8b5c-45315a1cb846 req-1d4498f1-1059-44a8-99ce-788fd24699a3 service nova] Creating event network-changed:79b4a303-9155-4741-b15f-1a2d746a7a89 for instance 61421b3c-4c72-42c5-bbdc-793a4fb12b3e on n-h1-850501-14 Oct 04 19:11:03.812564 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-be51a303-42ec-41ca-8b5c-45315a1cb846 req-1d4498f1-1059-44a8-99ce-788fd24699a3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071344 Oct 04 19:11:03.813784 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3405/6825] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:11:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:11:04.276235 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d6ed869e-7b9d-4952-bfb8-7c00039c7752 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:04.277251 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d6ed869e-7b9d-4952-bfb8-7c00039c7752 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 61421b3c-4c72-42c5-bbdc-793a4fb12b3e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:04.283653 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d6ed869e-7b9d-4952-bfb8-7c00039c7752 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:04.284470 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d6ed869e-7b9d-4952-bfb8-7c00039c7752 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:04.285130 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d6ed869e-7b9d-4952-bfb8-7c00039c7752 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:04.286054 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d6ed869e-7b9d-4952-bfb8-7c00039c7752 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:04.293250 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a4b21556-c146-4565-9d8d-4591519ed74c tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:04.294311 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a4b21556-c146-4565-9d8d-4591519ed74c tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] [instance: 1389042a-157a-456c-a87b-7797a17aa095] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:04.297924 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d6ed869e-7b9d-4952-bfb8-7c00039c7752 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:04.299233 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d6ed869e-7b9d-4952-bfb8-7c00039c7752 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:04.302036 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a4b21556-c146-4565-9d8d-4591519ed74c tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:04.302778 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a4b21556-c146-4565-9d8d-4591519ed74c tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:04.303476 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a4b21556-c146-4565-9d8d-4591519ed74c tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:04.305639 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a4b21556-c146-4565-9d8d-4591519ed74c tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:04.306343 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a4b21556-c146-4565-9d8d-4591519ed74c tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:04.306905 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a4b21556-c146-4565-9d8d-4591519ed74c tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:04.625072 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d6ed869e-7b9d-4952-bfb8-7c00039c7752 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:04.644434 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d6ed869e-7b9d-4952-bfb8-7c00039c7752 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/61421b3c-4c72-42c5-bbdc-793a4fb12b3e" status: 200 len: 1277 microversion: 2.1 time: 0.371098 Oct 04 19:11:04.660098 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3421/6826] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:04 2022] GET /compute/v2.1/servers/61421b3c-4c72-42c5-bbdc-793a4fb12b3e => generated 1277 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:04.661628 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a4b21556-c146-4565-9d8d-4591519ed74c tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f2888940414c0d9a690ad8c68b4da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42758fc2a182488489d9989e17beb026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:04.667564 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a4b21556-c146-4565-9d8d-4591519ed74c tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] 10.222.0.20 "GET /compute/v2.1/servers/1389042a-157a-456c-a87b-7797a17aa095" status: 200 len: 1373 microversion: 2.1 time: 0.379196 Oct 04 19:11:04.675034 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3406/6827] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:04 2022] GET /compute/v2.1/servers/1389042a-157a-456c-a87b-7797a17aa095 => generated 1373 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:04.738716 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4ca0e807-2b71-4418-86aa-1bd70b45b12f tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:04.739450 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-4ca0e807-2b71-4418-86aa-1bd70b45b12f tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 2646dfcb-7213-4870-99eb-68311662d66b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:04.745910 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4ca0e807-2b71-4418-86aa-1bd70b45b12f tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:04.746631 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4ca0e807-2b71-4418-86aa-1bd70b45b12f tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:04.747279 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4ca0e807-2b71-4418-86aa-1bd70b45b12f tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:04.748160 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4ca0e807-2b71-4418-86aa-1bd70b45b12f tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:04.748788 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4ca0e807-2b71-4418-86aa-1bd70b45b12f tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:04.749508 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4ca0e807-2b71-4418-86aa-1bd70b45b12f tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:05.005193 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-1d984471-a38a-4ef4-af05-5336ce404f8c req-3c7efcb2-73c1-4e1b-bd22-53ec28708ee1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1389042a-157a-456c-a87b-7797a17aa095", "name": "network-vif-plugged", "status": "completed", "tag": "e4f588ea-71f6-4a97-9faf-ef9eb6c45e8e"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:11:05.018930 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-1d984471-a38a-4ef4-af05-5336ce404f8c req-3c7efcb2-73c1-4e1b-bd22-53ec28708ee1 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:05.020081 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-1d984471-a38a-4ef4-af05-5336ce404f8c req-3c7efcb2-73c1-4e1b-bd22-53ec28708ee1 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:05.024138 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-4ca0e807-2b71-4418-86aa-1bd70b45b12f tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3060cdc6eeba47288205e107717a6980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a841124bf4392b54c3d6b0ea37e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:05.027842 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-1d984471-a38a-4ef4-af05-5336ce404f8c req-3c7efcb2-73c1-4e1b-bd22-53ec28708ee1 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:05.034985 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-4ca0e807-2b71-4418-86aa-1bd70b45b12f tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b" status: 200 len: 1667 microversion: 2.1 time: 0.300223 Oct 04 19:11:05.036347 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3422/6828] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:04 2022] GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b => generated 1667 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:05.045401 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-1d984471-a38a-4ef4-af05-5336ce404f8c req-3c7efcb2-73c1-4e1b-bd22-53ec28708ee1 service nova] Creating event network-vif-plugged:e4f588ea-71f6-4a97-9faf-ef9eb6c45e8e for instance 1389042a-157a-456c-a87b-7797a17aa095 on n-h2-850501-14 Oct 04 19:11:05.057933 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-1d984471-a38a-4ef4-af05-5336ce404f8c req-3c7efcb2-73c1-4e1b-bd22-53ec28708ee1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056336 Oct 04 19:11:05.058561 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3407/6829] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:11:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:11:05.673182 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3622d442-45a4-4b61-8513-417a78b47fc2 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:05.673707 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3622d442-45a4-4b61-8513-417a78b47fc2 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 61421b3c-4c72-42c5-bbdc-793a4fb12b3e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:05.680872 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3622d442-45a4-4b61-8513-417a78b47fc2 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:05.681361 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3622d442-45a4-4b61-8513-417a78b47fc2 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:05.681829 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3622d442-45a4-4b61-8513-417a78b47fc2 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:05.682836 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3622d442-45a4-4b61-8513-417a78b47fc2 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:05.683342 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3622d442-45a4-4b61-8513-417a78b47fc2 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:05.683782 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3622d442-45a4-4b61-8513-417a78b47fc2 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:05.697915 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9ebbad77-70fb-439f-8180-720f75a65d1d tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:05.699278 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9ebbad77-70fb-439f-8180-720f75a65d1d tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] [instance: 1389042a-157a-456c-a87b-7797a17aa095] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:05.706372 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9ebbad77-70fb-439f-8180-720f75a65d1d tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:05.707237 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9ebbad77-70fb-439f-8180-720f75a65d1d tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:05.707862 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9ebbad77-70fb-439f-8180-720f75a65d1d tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:05.709035 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9ebbad77-70fb-439f-8180-720f75a65d1d tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:05.710181 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9ebbad77-70fb-439f-8180-720f75a65d1d tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:05.711293 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9ebbad77-70fb-439f-8180-720f75a65d1d tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:05.909412 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3622d442-45a4-4b61-8513-417a78b47fc2 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:05.921607 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3622d442-45a4-4b61-8513-417a78b47fc2 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/61421b3c-4c72-42c5-bbdc-793a4fb12b3e" status: 200 len: 1277 microversion: 2.1 time: 0.252119 Oct 04 19:11:05.922545 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3423/6830] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:05 2022] GET /compute/v2.1/servers/61421b3c-4c72-42c5-bbdc-793a4fb12b3e => generated 1277 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:05.939536 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9ebbad77-70fb-439f-8180-720f75a65d1d tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f2888940414c0d9a690ad8c68b4da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42758fc2a182488489d9989e17beb026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:05.947759 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9ebbad77-70fb-439f-8180-720f75a65d1d tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] 10.222.0.20 "GET /compute/v2.1/servers/1389042a-157a-456c-a87b-7797a17aa095" status: 200 len: 1373 microversion: 2.1 time: 0.254544 Oct 04 19:11:05.948375 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3408/6831] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:05 2022] GET /compute/v2.1/servers/1389042a-157a-456c-a87b-7797a17aa095 => generated 1373 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:06.946513 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-97e58797-a85d-4c58-ae50-51f4b9362413 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:06.947204 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-97e58797-a85d-4c58-ae50-51f4b9362413 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 61421b3c-4c72-42c5-bbdc-793a4fb12b3e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:06.956870 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-97e58797-a85d-4c58-ae50-51f4b9362413 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:06.957443 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-97e58797-a85d-4c58-ae50-51f4b9362413 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:06.957884 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-97e58797-a85d-4c58-ae50-51f4b9362413 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:06.958860 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-97e58797-a85d-4c58-ae50-51f4b9362413 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:06.959318 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-97e58797-a85d-4c58-ae50-51f4b9362413 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:06.959747 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-97e58797-a85d-4c58-ae50-51f4b9362413 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:06.971147 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ca973be9-ed09-4eac-b053-e8387b390d6e tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:06.971781 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ca973be9-ed09-4eac-b053-e8387b390d6e tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] [instance: 1389042a-157a-456c-a87b-7797a17aa095] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:06.979935 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ca973be9-ed09-4eac-b053-e8387b390d6e tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:06.980726 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ca973be9-ed09-4eac-b053-e8387b390d6e tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:06.982056 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ca973be9-ed09-4eac-b053-e8387b390d6e tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:06.983466 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ca973be9-ed09-4eac-b053-e8387b390d6e tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:06.984552 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ca973be9-ed09-4eac-b053-e8387b390d6e tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:06.985855 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ca973be9-ed09-4eac-b053-e8387b390d6e tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:07.233645 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-97e58797-a85d-4c58-ae50-51f4b9362413 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:07.241342 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ca973be9-ed09-4eac-b053-e8387b390d6e tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f2888940414c0d9a690ad8c68b4da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42758fc2a182488489d9989e17beb026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:07.244360 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-97e58797-a85d-4c58-ae50-51f4b9362413 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/61421b3c-4c72-42c5-bbdc-793a4fb12b3e" status: 200 len: 1277 microversion: 2.1 time: 0.302778 Oct 04 19:11:07.244948 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3424/6832] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:06 2022] GET /compute/v2.1/servers/61421b3c-4c72-42c5-bbdc-793a4fb12b3e => generated 1277 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:07.251224 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ca973be9-ed09-4eac-b053-e8387b390d6e tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] 10.222.0.20 "GET /compute/v2.1/servers/1389042a-157a-456c-a87b-7797a17aa095" status: 200 len: 1546 microversion: 2.1 time: 0.284096 Oct 04 19:11:07.251819 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3409/6833] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:06 2022] GET /compute/v2.1/servers/1389042a-157a-456c-a87b-7797a17aa095 => generated 1546 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:11:07.277424 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-54a8b2fa-c87a-490f-a191-cd3cf5fca3e0 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:07.278156 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-54a8b2fa-c87a-490f-a191-cd3cf5fca3e0 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] [instance: 1389042a-157a-456c-a87b-7797a17aa095] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:07.285598 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-54a8b2fa-c87a-490f-a191-cd3cf5fca3e0 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:07.286209 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-54a8b2fa-c87a-490f-a191-cd3cf5fca3e0 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:07.286736 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-54a8b2fa-c87a-490f-a191-cd3cf5fca3e0 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:07.288098 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-54a8b2fa-c87a-490f-a191-cd3cf5fca3e0 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:07.289427 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-54a8b2fa-c87a-490f-a191-cd3cf5fca3e0 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:07.289985 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-54a8b2fa-c87a-490f-a191-cd3cf5fca3e0 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:07.455537 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-54a8b2fa-c87a-490f-a191-cd3cf5fca3e0 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f2888940414c0d9a690ad8c68b4da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42758fc2a182488489d9989e17beb026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:07.467519 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-54a8b2fa-c87a-490f-a191-cd3cf5fca3e0 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] 10.222.0.20 "GET /compute/v2.1/servers/1389042a-157a-456c-a87b-7797a17aa095" status: 200 len: 1546 microversion: 2.1 time: 0.194751 Oct 04 19:11:07.468495 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3425/6834] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:07 2022] GET /compute/v2.1/servers/1389042a-157a-456c-a87b-7797a17aa095 => generated 1546 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:08.272453 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-215abb18-3652-4488-b1dd-3956fa1e8c7f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:08.273273 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-215abb18-3652-4488-b1dd-3956fa1e8c7f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 61421b3c-4c72-42c5-bbdc-793a4fb12b3e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:08.281244 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-215abb18-3652-4488-b1dd-3956fa1e8c7f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:08.282015 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-215abb18-3652-4488-b1dd-3956fa1e8c7f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:08.282644 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-215abb18-3652-4488-b1dd-3956fa1e8c7f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:08.283379 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-215abb18-3652-4488-b1dd-3956fa1e8c7f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:08.283919 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-215abb18-3652-4488-b1dd-3956fa1e8c7f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:08.284399 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-215abb18-3652-4488-b1dd-3956fa1e8c7f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:08.473897 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-215abb18-3652-4488-b1dd-3956fa1e8c7f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:08.484562 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-215abb18-3652-4488-b1dd-3956fa1e8c7f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/61421b3c-4c72-42c5-bbdc-793a4fb12b3e" status: 200 len: 1265 microversion: 2.1 time: 0.217816 Oct 04 19:11:08.485487 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3410/6835] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:08 2022] GET /compute/v2.1/servers/61421b3c-4c72-42c5-bbdc-793a4fb12b3e => generated 1265 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:09.510004 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-cf45e4da-f370-48ee-b4f2-2765bff2614a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:09.510620 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-cf45e4da-f370-48ee-b4f2-2765bff2614a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 61421b3c-4c72-42c5-bbdc-793a4fb12b3e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:09.512524 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:11:09.513208 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=8 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:11:09.518975 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cf45e4da-f370-48ee-b4f2-2765bff2614a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:09.519464 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cf45e4da-f370-48ee-b4f2-2765bff2614a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:09.519899 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cf45e4da-f370-48ee-b4f2-2765bff2614a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:09.520617 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cf45e4da-f370-48ee-b4f2-2765bff2614a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:09.521075 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cf45e4da-f370-48ee-b4f2-2765bff2614a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:09.521498 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cf45e4da-f370-48ee-b4f2-2765bff2614a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:09.678416 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-cf45e4da-f370-48ee-b4f2-2765bff2614a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:09.688026 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-cf45e4da-f370-48ee-b4f2-2765bff2614a tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/61421b3c-4c72-42c5-bbdc-793a4fb12b3e" status: 200 len: 1265 microversion: 2.1 time: 0.182558 Oct 04 19:11:09.688643 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3426/6836] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:09 2022] GET /compute/v2.1/servers/61421b3c-4c72-42c5-bbdc-793a4fb12b3e => generated 1265 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:10.095546 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-e3b036dd-6bf7-4d6c-8a89-dbf5590ce4b4 req-d1bb4fa5-75e3-4347-9495-8d70d9aed6fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1389042a-157a-456c-a87b-7797a17aa095", "tag": "e4f588ea-71f6-4a97-9faf-ef9eb6c45e8e"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:11:10.105662 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=12 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:11:10.109385 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-e3b036dd-6bf7-4d6c-8a89-dbf5590ce4b4 req-d1bb4fa5-75e3-4347-9495-8d70d9aed6fc service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:10.110202 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-e3b036dd-6bf7-4d6c-8a89-dbf5590ce4b4 req-d1bb4fa5-75e3-4347-9495-8d70d9aed6fc service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:10.110928 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-e3b036dd-6bf7-4d6c-8a89-dbf5590ce4b4 req-d1bb4fa5-75e3-4347-9495-8d70d9aed6fc service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:10.125184 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-e3b036dd-6bf7-4d6c-8a89-dbf5590ce4b4 req-d1bb4fa5-75e3-4347-9495-8d70d9aed6fc service nova] Creating event network-changed:e4f588ea-71f6-4a97-9faf-ef9eb6c45e8e for instance 1389042a-157a-456c-a87b-7797a17aa095 on n-h2-850501-14 Oct 04 19:11:10.130987 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-e3b036dd-6bf7-4d6c-8a89-dbf5590ce4b4 req-d1bb4fa5-75e3-4347-9495-8d70d9aed6fc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039764 Oct 04 19:11:10.133690 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3411/6837] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:11:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:11:10.711361 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b4c76da5-17ef-4893-8ccc-ac920f0159fa tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:10.713044 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b4c76da5-17ef-4893-8ccc-ac920f0159fa tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 61421b3c-4c72-42c5-bbdc-793a4fb12b3e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:10.730816 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b4c76da5-17ef-4893-8ccc-ac920f0159fa tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:10.731346 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b4c76da5-17ef-4893-8ccc-ac920f0159fa tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:10.732745 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b4c76da5-17ef-4893-8ccc-ac920f0159fa tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:10.733477 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b4c76da5-17ef-4893-8ccc-ac920f0159fa tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:10.734127 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b4c76da5-17ef-4893-8ccc-ac920f0159fa tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:10.734561 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b4c76da5-17ef-4893-8ccc-ac920f0159fa tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:10.897021 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b4c76da5-17ef-4893-8ccc-ac920f0159fa tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:10.919859 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b4c76da5-17ef-4893-8ccc-ac920f0159fa tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/61421b3c-4c72-42c5-bbdc-793a4fb12b3e" status: 200 len: 1265 microversion: 2.1 time: 0.212702 Oct 04 19:11:10.920483 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3427/6838] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:10 2022] GET /compute/v2.1/servers/61421b3c-4c72-42c5-bbdc-793a4fb12b3e => generated 1265 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:11.951871 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4da06403-0860-438c-a37c-2c82871dc95e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:11.952626 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4da06403-0860-438c-a37c-2c82871dc95e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 61421b3c-4c72-42c5-bbdc-793a4fb12b3e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:11.960853 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4da06403-0860-438c-a37c-2c82871dc95e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:11.961379 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4da06403-0860-438c-a37c-2c82871dc95e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:11.961841 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4da06403-0860-438c-a37c-2c82871dc95e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:11.962586 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4da06403-0860-438c-a37c-2c82871dc95e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:11.963061 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4da06403-0860-438c-a37c-2c82871dc95e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:11.963509 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4da06403-0860-438c-a37c-2c82871dc95e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:12.108907 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4da06403-0860-438c-a37c-2c82871dc95e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:12.117088 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4da06403-0860-438c-a37c-2c82871dc95e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/61421b3c-4c72-42c5-bbdc-793a4fb12b3e" status: 200 len: 1265 microversion: 2.1 time: 0.169402 Oct 04 19:11:12.118348 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3412/6839] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:11 2022] GET /compute/v2.1/servers/61421b3c-4c72-42c5-bbdc-793a4fb12b3e => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:13.141203 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1a291e7d-8a32-48aa-bc73-47f0e91a69fd tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:13.141836 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1a291e7d-8a32-48aa-bc73-47f0e91a69fd tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 61421b3c-4c72-42c5-bbdc-793a4fb12b3e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:13.148988 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1a291e7d-8a32-48aa-bc73-47f0e91a69fd tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:13.149635 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1a291e7d-8a32-48aa-bc73-47f0e91a69fd tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:13.149915 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1a291e7d-8a32-48aa-bc73-47f0e91a69fd tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:13.150624 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1a291e7d-8a32-48aa-bc73-47f0e91a69fd tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:13.151090 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1a291e7d-8a32-48aa-bc73-47f0e91a69fd tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:13.151523 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1a291e7d-8a32-48aa-bc73-47f0e91a69fd tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:13.290077 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1a291e7d-8a32-48aa-bc73-47f0e91a69fd tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:13.299244 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1a291e7d-8a32-48aa-bc73-47f0e91a69fd tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/61421b3c-4c72-42c5-bbdc-793a4fb12b3e" status: 200 len: 1265 microversion: 2.1 time: 0.161823 Oct 04 19:11:13.300129 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3428/6840] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:13 2022] GET /compute/v2.1/servers/61421b3c-4c72-42c5-bbdc-793a4fb12b3e => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:14.324040 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-cdccb876-969f-4abc-a07a-8332fa3087f1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:14.324812 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-cdccb876-969f-4abc-a07a-8332fa3087f1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 61421b3c-4c72-42c5-bbdc-793a4fb12b3e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:14.331859 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cdccb876-969f-4abc-a07a-8332fa3087f1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:14.332390 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cdccb876-969f-4abc-a07a-8332fa3087f1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:14.332840 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cdccb876-969f-4abc-a07a-8332fa3087f1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:14.333807 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cdccb876-969f-4abc-a07a-8332fa3087f1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:14.334278 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cdccb876-969f-4abc-a07a-8332fa3087f1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:14.334718 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cdccb876-969f-4abc-a07a-8332fa3087f1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:14.470444 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-cdccb876-969f-4abc-a07a-8332fa3087f1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:14.478415 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-cdccb876-969f-4abc-a07a-8332fa3087f1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/61421b3c-4c72-42c5-bbdc-793a4fb12b3e" status: 200 len: 1265 microversion: 2.1 time: 0.159432 Oct 04 19:11:14.478934 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3413/6841] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:14 2022] GET /compute/v2.1/servers/61421b3c-4c72-42c5-bbdc-793a4fb12b3e => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:15.502984 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-81df1cb8-ee6c-4072-8759-8bbf6e8b0fe6 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:15.503605 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-81df1cb8-ee6c-4072-8759-8bbf6e8b0fe6 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 61421b3c-4c72-42c5-bbdc-793a4fb12b3e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:15.512188 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-81df1cb8-ee6c-4072-8759-8bbf6e8b0fe6 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:15.512672 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-81df1cb8-ee6c-4072-8759-8bbf6e8b0fe6 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:15.513188 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-81df1cb8-ee6c-4072-8759-8bbf6e8b0fe6 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:15.513936 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-81df1cb8-ee6c-4072-8759-8bbf6e8b0fe6 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:15.514369 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-81df1cb8-ee6c-4072-8759-8bbf6e8b0fe6 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:15.514792 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-81df1cb8-ee6c-4072-8759-8bbf6e8b0fe6 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:15.730577 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-81df1cb8-ee6c-4072-8759-8bbf6e8b0fe6 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:15.740994 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-81df1cb8-ee6c-4072-8759-8bbf6e8b0fe6 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/61421b3c-4c72-42c5-bbdc-793a4fb12b3e" status: 200 len: 1265 microversion: 2.1 time: 0.243032 Oct 04 19:11:15.741791 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3429/6842] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:15 2022] GET /compute/v2.1/servers/61421b3c-4c72-42c5-bbdc-793a4fb12b3e => generated 1265 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:16.765221 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7968e824-b151-43a7-a0ac-971fabde05b1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:16.765861 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7968e824-b151-43a7-a0ac-971fabde05b1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 61421b3c-4c72-42c5-bbdc-793a4fb12b3e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:16.773197 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7968e824-b151-43a7-a0ac-971fabde05b1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:16.773709 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7968e824-b151-43a7-a0ac-971fabde05b1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:16.774164 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7968e824-b151-43a7-a0ac-971fabde05b1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:16.774875 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7968e824-b151-43a7-a0ac-971fabde05b1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:16.775351 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7968e824-b151-43a7-a0ac-971fabde05b1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:16.776456 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7968e824-b151-43a7-a0ac-971fabde05b1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:16.791694 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:11:16.913150 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7968e824-b151-43a7-a0ac-971fabde05b1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:16.921772 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7968e824-b151-43a7-a0ac-971fabde05b1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/61421b3c-4c72-42c5-bbdc-793a4fb12b3e" status: 200 len: 1265 microversion: 2.1 time: 0.160533 Oct 04 19:11:16.922372 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3414/6843] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:16 2022] GET /compute/v2.1/servers/61421b3c-4c72-42c5-bbdc-793a4fb12b3e => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:17.945734 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-21280134-5b78-439b-a3c8-32cc08b6b64e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:17.946398 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-21280134-5b78-439b-a3c8-32cc08b6b64e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 61421b3c-4c72-42c5-bbdc-793a4fb12b3e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:17.956584 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-21280134-5b78-439b-a3c8-32cc08b6b64e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:17.957082 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-21280134-5b78-439b-a3c8-32cc08b6b64e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:17.957520 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-21280134-5b78-439b-a3c8-32cc08b6b64e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:17.958233 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-21280134-5b78-439b-a3c8-32cc08b6b64e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:17.959147 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-21280134-5b78-439b-a3c8-32cc08b6b64e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:17.959573 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-21280134-5b78-439b-a3c8-32cc08b6b64e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:18.103723 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-21280134-5b78-439b-a3c8-32cc08b6b64e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:18.112911 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-21280134-5b78-439b-a3c8-32cc08b6b64e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/61421b3c-4c72-42c5-bbdc-793a4fb12b3e" status: 200 len: 1265 microversion: 2.1 time: 0.171731 Oct 04 19:11:18.128654 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3430/6844] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:17 2022] GET /compute/v2.1/servers/61421b3c-4c72-42c5-bbdc-793a4fb12b3e => generated 1265 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:18.265349 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-7468ba45-b544-40f8-81a6-d408e55d62e8 req-ddc8f05e-b1dd-4a8f-af80-1850dc1f0cf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61421b3c-4c72-42c5-bbdc-793a4fb12b3e", "name": "network-vif-plugged", "status": "completed", "tag": "79b4a303-9155-4741-b15f-1a2d746a7a89"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:11:18.276108 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-7468ba45-b544-40f8-81a6-d408e55d62e8 req-ddc8f05e-b1dd-4a8f-af80-1850dc1f0cf8 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:18.276618 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-7468ba45-b544-40f8-81a6-d408e55d62e8 req-ddc8f05e-b1dd-4a8f-af80-1850dc1f0cf8 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:18.277671 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-7468ba45-b544-40f8-81a6-d408e55d62e8 req-ddc8f05e-b1dd-4a8f-af80-1850dc1f0cf8 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:18.289508 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-7468ba45-b544-40f8-81a6-d408e55d62e8 req-ddc8f05e-b1dd-4a8f-af80-1850dc1f0cf8 service nova] Creating event network-vif-plugged:79b4a303-9155-4741-b15f-1a2d746a7a89 for instance 61421b3c-4c72-42c5-bbdc-793a4fb12b3e on n-h1-850501-14 Oct 04 19:11:18.294977 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-7468ba45-b544-40f8-81a6-d408e55d62e8 req-ddc8f05e-b1dd-4a8f-af80-1850dc1f0cf8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034122 Oct 04 19:11:18.295639 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3415/6845] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:11:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:11:19.137184 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1397b34f-90b8-4ecd-b9d6-2e526495e866 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:19.137951 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1397b34f-90b8-4ecd-b9d6-2e526495e866 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 61421b3c-4c72-42c5-bbdc-793a4fb12b3e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:19.141349 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:11:19.146676 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1397b34f-90b8-4ecd-b9d6-2e526495e866 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:19.147163 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1397b34f-90b8-4ecd-b9d6-2e526495e866 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:19.149392 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1397b34f-90b8-4ecd-b9d6-2e526495e866 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:19.149392 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1397b34f-90b8-4ecd-b9d6-2e526495e866 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:19.149392 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1397b34f-90b8-4ecd-b9d6-2e526495e866 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:19.152993 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1397b34f-90b8-4ecd-b9d6-2e526495e866 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:19.293822 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1397b34f-90b8-4ecd-b9d6-2e526495e866 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:19.303766 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1397b34f-90b8-4ecd-b9d6-2e526495e866 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/61421b3c-4c72-42c5-bbdc-793a4fb12b3e" status: 200 len: 1265 microversion: 2.1 time: 0.170498 Oct 04 19:11:19.304650 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3431/6846] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:19 2022] GET /compute/v2.1/servers/61421b3c-4c72-42c5-bbdc-793a4fb12b3e => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:20.331936 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7648da09-c8d6-4510-adf9-b3dd670cbb0f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:20.336705 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7648da09-c8d6-4510-adf9-b3dd670cbb0f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 61421b3c-4c72-42c5-bbdc-793a4fb12b3e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:20.346126 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7648da09-c8d6-4510-adf9-b3dd670cbb0f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:20.346967 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7648da09-c8d6-4510-adf9-b3dd670cbb0f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:20.347611 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7648da09-c8d6-4510-adf9-b3dd670cbb0f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:20.348458 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7648da09-c8d6-4510-adf9-b3dd670cbb0f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:20.348934 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7648da09-c8d6-4510-adf9-b3dd670cbb0f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:20.349380 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7648da09-c8d6-4510-adf9-b3dd670cbb0f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:20.494532 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7648da09-c8d6-4510-adf9-b3dd670cbb0f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:20.502648 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7648da09-c8d6-4510-adf9-b3dd670cbb0f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/61421b3c-4c72-42c5-bbdc-793a4fb12b3e" status: 200 len: 1451 microversion: 2.1 time: 0.177311 Oct 04 19:11:20.503453 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3416/6847] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:20 2022] GET /compute/v2.1/servers/61421b3c-4c72-42c5-bbdc-793a4fb12b3e => generated 1451 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:20.526492 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d8399f5c-0ee1-4aa2-9f91-64e037e697bf tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:20.529924 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d8399f5c-0ee1-4aa2-9f91-64e037e697bf tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 61421b3c-4c72-42c5-bbdc-793a4fb12b3e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:20.534530 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d8399f5c-0ee1-4aa2-9f91-64e037e697bf tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:20.535014 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d8399f5c-0ee1-4aa2-9f91-64e037e697bf tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:20.535453 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d8399f5c-0ee1-4aa2-9f91-64e037e697bf tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:20.536177 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d8399f5c-0ee1-4aa2-9f91-64e037e697bf tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:20.536638 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d8399f5c-0ee1-4aa2-9f91-64e037e697bf tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:20.537066 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d8399f5c-0ee1-4aa2-9f91-64e037e697bf tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:20.675607 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d8399f5c-0ee1-4aa2-9f91-64e037e697bf tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:20.679167 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=100 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:11:20.684494 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d8399f5c-0ee1-4aa2-9f91-64e037e697bf tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/61421b3c-4c72-42c5-bbdc-793a4fb12b3e" status: 200 len: 1451 microversion: 2.1 time: 0.162074 Oct 04 19:11:20.685079 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3432/6848] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:20 2022] GET /compute/v2.1/servers/61421b3c-4c72-42c5-bbdc-793a4fb12b3e => generated 1451 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:22.683522 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-2107652c-0f6c-42c9-9a99-5d71847d9dd0 req-d5a5371a-f4b6-4d06-9dd2-58c51486af3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61421b3c-4c72-42c5-bbdc-793a4fb12b3e", "tag": "79b4a303-9155-4741-b15f-1a2d746a7a89"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:11:22.691391 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:11:22.695258 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-2107652c-0f6c-42c9-9a99-5d71847d9dd0 req-d5a5371a-f4b6-4d06-9dd2-58c51486af3a service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:22.695757 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-2107652c-0f6c-42c9-9a99-5d71847d9dd0 req-d5a5371a-f4b6-4d06-9dd2-58c51486af3a service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:22.696251 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-2107652c-0f6c-42c9-9a99-5d71847d9dd0 req-d5a5371a-f4b6-4d06-9dd2-58c51486af3a service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:22.721606 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-2107652c-0f6c-42c9-9a99-5d71847d9dd0 req-d5a5371a-f4b6-4d06-9dd2-58c51486af3a service nova] Creating event network-changed:79b4a303-9155-4741-b15f-1a2d746a7a89 for instance 61421b3c-4c72-42c5-bbdc-793a4fb12b3e on n-h1-850501-14 Oct 04 19:11:22.729745 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-2107652c-0f6c-42c9-9a99-5d71847d9dd0 req-d5a5371a-f4b6-4d06-9dd2-58c51486af3a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049981 Oct 04 19:11:22.730746 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3417/6849] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:11:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:11:42.448449 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-bed9c4b0-886c-4a4f-80b9-4def30cf4d03 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:11:42.451040 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-bed9c4b0-886c-4a4f-80b9-4def30cf4d03 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] [instance: 1389042a-157a-456c-a87b-7797a17aa095] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:42.454221 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=3 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:11:42.459852 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bed9c4b0-886c-4a4f-80b9-4def30cf4d03 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:42.460481 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bed9c4b0-886c-4a4f-80b9-4def30cf4d03 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:42.460985 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bed9c4b0-886c-4a4f-80b9-4def30cf4d03 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:42.461703 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bed9c4b0-886c-4a4f-80b9-4def30cf4d03 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:42.462151 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bed9c4b0-886c-4a4f-80b9-4def30cf4d03 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:42.462569 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bed9c4b0-886c-4a4f-80b9-4def30cf4d03 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:42.542132 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-bed9c4b0-886c-4a4f-80b9-4def30cf4d03 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] 10.222.0.20 "POST /compute/v2.1/servers/1389042a-157a-456c-a87b-7797a17aa095/action" status: 200 len: 24566 microversion: 2.1 time: 0.097651 Oct 04 19:11:42.550055 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3433/6850] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 19:11:42 2022] POST /compute/v2.1/servers/1389042a-157a-456c-a87b-7797a17aa095/action => generated 24566 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:12:00.421034 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=13 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:12:00.425776 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5fbe9164-cfe2-4610-ac16-ea612f8f0d19 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:00.428821 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5fbe9164-cfe2-4610-ac16-ea612f8f0d19 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 2646dfcb-7213-4870-99eb-68311662d66b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:12:00.435532 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5fbe9164-cfe2-4610-ac16-ea612f8f0d19 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:00.436025 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5fbe9164-cfe2-4610-ac16-ea612f8f0d19 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:00.436497 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5fbe9164-cfe2-4610-ac16-ea612f8f0d19 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:00.437194 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5fbe9164-cfe2-4610-ac16-ea612f8f0d19 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:00.437660 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5fbe9164-cfe2-4610-ac16-ea612f8f0d19 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:00.438100 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5fbe9164-cfe2-4610-ac16-ea612f8f0d19 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:00.471383 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5fbe9164-cfe2-4610-ac16-ea612f8f0d19 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052766 Oct 04 19:12:00.474908 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3418/6851] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 19:12:00 2022] GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 19:12:00.539469 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ce7fdcca-5c20-486c-887b-ac83df13fed7 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:00.539993 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ce7fdcca-5c20-486c-887b-ac83df13fed7 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 2646dfcb-7213-4870-99eb-68311662d66b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:12:00.542754 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=4 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:12:00.543403 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:12:00.548544 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ce7fdcca-5c20-486c-887b-ac83df13fed7 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:00.553291 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ce7fdcca-5c20-486c-887b-ac83df13fed7 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:00.553291 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ce7fdcca-5c20-486c-887b-ac83df13fed7 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:00.553291 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ce7fdcca-5c20-486c-887b-ac83df13fed7 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:00.553291 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ce7fdcca-5c20-486c-887b-ac83df13fed7 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:00.553291 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ce7fdcca-5c20-486c-887b-ac83df13fed7 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:00.582602 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ce7fdcca-5c20-486c-887b-ac83df13fed7 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 2646dfcb-7213-4870-99eb-68311662d66b] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:12:00.885234 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ce7fdcca-5c20-486c-887b-ac83df13fed7 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b" status: 204 len: 0 microversion: 2.1 time: 0.350078 Oct 04 19:12:00.888335 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3434/6852] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 19:12:00 2022] DELETE /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:12:00.894045 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-31411cdc-38ac-4310-911c-2e3e0cd9c5b8 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:00.894673 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-31411cdc-38ac-4310-911c-2e3e0cd9c5b8 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 2646dfcb-7213-4870-99eb-68311662d66b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:12:00.901235 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-31411cdc-38ac-4310-911c-2e3e0cd9c5b8 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:00.901781 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-31411cdc-38ac-4310-911c-2e3e0cd9c5b8 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:00.902226 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-31411cdc-38ac-4310-911c-2e3e0cd9c5b8 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:00.902955 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-31411cdc-38ac-4310-911c-2e3e0cd9c5b8 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:00.903419 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-31411cdc-38ac-4310-911c-2e3e0cd9c5b8 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:00.903855 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-31411cdc-38ac-4310-911c-2e3e0cd9c5b8 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:01.042792 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-31411cdc-38ac-4310-911c-2e3e0cd9c5b8 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3060cdc6eeba47288205e107717a6980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a841124bf4392b54c3d6b0ea37e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:12:01.050681 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-31411cdc-38ac-4310-911c-2e3e0cd9c5b8 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b" status: 200 len: 1673 microversion: 2.1 time: 0.160559 Oct 04 19:12:01.051290 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3419/6853] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:12:00 2022] GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b => generated 1673 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:12:02.075242 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1b0456b0-f215-42df-ac49-43b93d00754e tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:02.075956 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1b0456b0-f215-42df-ac49-43b93d00754e tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 2646dfcb-7213-4870-99eb-68311662d66b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:12:02.084684 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1b0456b0-f215-42df-ac49-43b93d00754e tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:02.085178 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1b0456b0-f215-42df-ac49-43b93d00754e tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:02.085622 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1b0456b0-f215-42df-ac49-43b93d00754e tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:02.086319 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1b0456b0-f215-42df-ac49-43b93d00754e tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:02.086784 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1b0456b0-f215-42df-ac49-43b93d00754e tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:02.087216 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1b0456b0-f215-42df-ac49-43b93d00754e tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:02.228717 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1b0456b0-f215-42df-ac49-43b93d00754e tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3060cdc6eeba47288205e107717a6980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a841124bf4392b54c3d6b0ea37e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:12:02.236564 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1b0456b0-f215-42df-ac49-43b93d00754e tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b" status: 200 len: 1673 microversion: 2.1 time: 0.165609 Oct 04 19:12:02.237140 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3435/6854] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:12:02 2022] GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b => generated 1673 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:12:02.749977 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-758f699d-d140-40c0-903a-64f7c1da9487 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:02.750492 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-758f699d-d140-40c0-903a-64f7c1da9487 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] [instance: 4ef4defa-c86d-4354-9123-0fd63040609d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:12:02.757895 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-758f699d-d140-40c0-903a-64f7c1da9487 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:02.758402 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-758f699d-d140-40c0-903a-64f7c1da9487 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:02.758851 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-758f699d-d140-40c0-903a-64f7c1da9487 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:02.759564 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-758f699d-d140-40c0-903a-64f7c1da9487 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:02.760078 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-758f699d-d140-40c0-903a-64f7c1da9487 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:02.760525 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-758f699d-d140-40c0-903a-64f7c1da9487 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:02.841248 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-758f699d-d140-40c0-903a-64f7c1da9487 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Lazy-loading 'services' on Instance uuid 4ef4defa-c86d-4354-9123-0fd63040609d {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:12:03.049604 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-758f699d-d140-40c0-903a-64f7c1da9487 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4ef4defa-c86d-4354-9123-0fd63040609d/os-volume_attachments/3647f206-17c6-4751-b024-df2d5ed3d997" status: 202 len: 0 microversion: 2.1 time: 0.303343 Oct 04 19:12:03.050188 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3420/6855] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Oct 4 19:12:02 2022] DELETE /compute/v2.1/servers/4ef4defa-c86d-4354-9123-0fd63040609d/os-volume_attachments/3647f206-17c6-4751-b024-df2d5ed3d997 => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:12:03.259960 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0c9097e6-26ab-4341-98d0-cc2bae46ed22 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:03.260608 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0c9097e6-26ab-4341-98d0-cc2bae46ed22 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 2646dfcb-7213-4870-99eb-68311662d66b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:12:03.267528 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0c9097e6-26ab-4341-98d0-cc2bae46ed22 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:03.268021 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0c9097e6-26ab-4341-98d0-cc2bae46ed22 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:03.268614 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0c9097e6-26ab-4341-98d0-cc2bae46ed22 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:03.269316 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0c9097e6-26ab-4341-98d0-cc2bae46ed22 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:03.269775 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0c9097e6-26ab-4341-98d0-cc2bae46ed22 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:03.270203 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0c9097e6-26ab-4341-98d0-cc2bae46ed22 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:03.411284 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0c9097e6-26ab-4341-98d0-cc2bae46ed22 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3060cdc6eeba47288205e107717a6980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a841124bf4392b54c3d6b0ea37e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:12:03.421016 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0c9097e6-26ab-4341-98d0-cc2bae46ed22 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b" status: 200 len: 1673 microversion: 2.1 time: 0.165705 Oct 04 19:12:03.421971 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3436/6856] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:12:03 2022] GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b => generated 1673 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:12:03.956150 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-09a05002-3cc1-4208-ad03-8980f5fae784 req-e6ff1fb7-26e1-4478-9cdb-0502b9e6fb94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2646dfcb-7213-4870-99eb-68311662d66b", "name": "network-vif-deleted", "tag": "4060b5e6-c83b-436b-a8e4-fe4d200875b7"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:12:03.978833 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-09a05002-3cc1-4208-ad03-8980f5fae784 req-e6ff1fb7-26e1-4478-9cdb-0502b9e6fb94 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:03.979424 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-09a05002-3cc1-4208-ad03-8980f5fae784 req-e6ff1fb7-26e1-4478-9cdb-0502b9e6fb94 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:03.986026 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-09a05002-3cc1-4208-ad03-8980f5fae784 req-e6ff1fb7-26e1-4478-9cdb-0502b9e6fb94 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:03.998230 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-09a05002-3cc1-4208-ad03-8980f5fae784 req-e6ff1fb7-26e1-4478-9cdb-0502b9e6fb94 service nova] Creating event network-vif-deleted:4060b5e6-c83b-436b-a8e4-fe4d200875b7 for instance 2646dfcb-7213-4870-99eb-68311662d66b on n-h2-850501-14 Oct 04 19:12:04.004013 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-09a05002-3cc1-4208-ad03-8980f5fae784 req-e6ff1fb7-26e1-4478-9cdb-0502b9e6fb94 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051721 Oct 04 19:12:04.004772 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3421/6857] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:12:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:12:04.445727 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7df794d7-be77-438b-bdc4-d342b7e0397a tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:04.447141 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7df794d7-be77-438b-bdc4-d342b7e0397a tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 2646dfcb-7213-4870-99eb-68311662d66b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:12:04.454602 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7df794d7-be77-438b-bdc4-d342b7e0397a tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:04.455209 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7df794d7-be77-438b-bdc4-d342b7e0397a tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:04.455709 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7df794d7-be77-438b-bdc4-d342b7e0397a tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:04.456521 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7df794d7-be77-438b-bdc4-d342b7e0397a tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:04.457205 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7df794d7-be77-438b-bdc4-d342b7e0397a tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:04.457703 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7df794d7-be77-438b-bdc4-d342b7e0397a tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:04.495899 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7df794d7-be77-438b-bdc4-d342b7e0397a tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:04.496795 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7df794d7-be77-438b-bdc4-d342b7e0397a tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:04.497293 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7df794d7-be77-438b-bdc4-d342b7e0397a tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:04.497969 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-7df794d7-be77-438b-bdc4-d342b7e0397a tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lazy-loading 'fault' on Instance uuid 2646dfcb-7213-4870-99eb-68311662d66b {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:12:04.557137 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7df794d7-be77-438b-bdc4-d342b7e0397a tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3060cdc6eeba47288205e107717a6980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a841124bf4392b54c3d6b0ea37e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:12:04.565369 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7df794d7-be77-438b-bdc4-d342b7e0397a tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b" status: 200 len: 1326 microversion: 2.1 time: 0.123595 Oct 04 19:12:04.566007 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3437/6858] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:12:04 2022] GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b => generated 1326 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:12:05.590532 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1fa5e30a-0858-40d4-86c5-0a1f30a5214f tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:05.596813 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1fa5e30a-0858-40d4-86c5-0a1f30a5214f tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 2646dfcb-7213-4870-99eb-68311662d66b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:12:05.597651 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1fa5e30a-0858-40d4-86c5-0a1f30a5214f tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:05.598234 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1fa5e30a-0858-40d4-86c5-0a1f30a5214f tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:05.598701 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1fa5e30a-0858-40d4-86c5-0a1f30a5214f tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:05.599501 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1fa5e30a-0858-40d4-86c5-0a1f30a5214f tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:05.599887 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1fa5e30a-0858-40d4-86c5-0a1f30a5214f tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:05.600356 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1fa5e30a-0858-40d4-86c5-0a1f30a5214f tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:05.614187 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-1fa5e30a-0858-40d4-86c5-0a1f30a5214f tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] HTTP exception thrown: Instance 2646dfcb-7213-4870-99eb-68311662d66b could not be found. Oct 04 19:12:05.616632 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1fa5e30a-0858-40d4-86c5-0a1f30a5214f tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Request method failure captured: Oct 04 19:12:05.616632 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b HTTP/1.1 Oct 04 19:12:05.616632 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 19:12:05.616632 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 19:12:05.616632 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 19:12:05.616632 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 19:12:05.616632 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 19:12:05.616632 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 19:12:05.616632 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 19:12:05.616632 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 19:12:05.616632 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPIR4RY9D0k3JGqvsFlPIJiO2GKRONAQgqGmODvMCOD8pxLqdH79NOBzOUVnaiWjB0CvX_9w-IyvJLz24OI4vc9QZU7Ze8neG2w1RXO6mxcRXo9bs0JfQh9QOpTjfxlnebgXPwVJzuu-bco9w-K49uAGLDR5t7_-D5ubBap_WvMYT-VY Oct 04 19:12:05.616632 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 19:12:05.616632 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 19:12:05.616632 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 19:12:05.616632 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 19:12:05.616632 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 19:12:05.616632 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 19:12:05.616632 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 4e0a841124bf4392b54c3d6b0ea37e11 Oct 04 19:12:05.616632 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-AttachVolumeTestJSON-830715248 Oct 04 19:12:05.616632 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 19:12:05.616632 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 19:12:05.616632 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4e0a841124bf4392b54c3d6b0ea37e11"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4e0a841124bf4392b54c3d6b0ea37e11", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4e0a841124bf4392b54c3d6b0ea37e11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4e0a841124bf4392b54c3d6b0ea37e11"}]}] Oct 04 19:12:05.616632 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-AttachVolumeTestJSON-830715248 Oct 04 19:12:05.616632 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 4e0a841124bf4392b54c3d6b0ea37e11 Oct 04 19:12:05.616632 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-AttachVolumeTestJSON-830715248 Oct 04 19:12:05.616632 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-AttachVolumeTestJSON-830715248-project Oct 04 19:12:05.616632 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 19:12:05.616632 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 19:12:05.616632 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 3060cdc6eeba47288205e107717a6980 Oct 04 19:12:05.616632 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-AttachVolumeTestJSON-830715248-project Oct 04 19:12:05.616632 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 19:12:05.616632 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 2646dfcb-7213-4870-99eb-68311662d66b could not be found. Oct 04 19:12:05.616632 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '2646dfcb-7213-4870-99eb-68311662d66b'} Oct 04 19:12:05.616632 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:12:05.616632 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:12:05.616632 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:12:05.616632 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:12:05.616632 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:12:05.616632 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:12:05.616632 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:12:05.616632 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:12:05.616632 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:12:05.616632 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:12:05.616632 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2646dfcb-7213-4870-99eb-68311662d66b could not be found. Oct 04 19:12:05.616632 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:12:05.616632 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:12:05.616632 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:12:05.616632 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:12:05.616632 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:12:05.616632 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:12:05.616632 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:12:05.616632 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:12:05.616632 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:12:05.616632 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:12:05.616632 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:12:05.616632 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:12:05.616632 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:12:05.616632 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:12:05.616632 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:12:05.616632 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:12:05.616632 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2646dfcb-7213-4870-99eb-68311662d66b could not be found. Oct 04 19:12:05.616632 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:12:05.616632 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:12:05.616632 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:12:05.621757 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:12:05.621757 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:12:05.621757 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:12:05.621757 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:12:05.621757 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:12:05.621757 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2646dfcb-7213-4870-99eb-68311662d66b could not be found. Oct 04 19:12:05.621757 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:12:05.621757 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1fa5e30a-0858-40d4-86c5-0a1f30a5214f tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Returning 404 to user: Instance 2646dfcb-7213-4870-99eb-68311662d66b could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:12:05.621757 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1fa5e30a-0858-40d4-86c5-0a1f30a5214f tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b" status: 404 len: 111 microversion: 2.1 time: 0.032767 Oct 04 19:12:05.621757 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3422/6859] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:12:05 2022] GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:12:05.627182 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b623f766-82cf-4bb7-b46c-8f8a2a634151 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Calling method '.version_select at 0x7fe253a099d0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:05.703749 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b623f766-82cf-4bb7-b46c-8f8a2a634151 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-199550104" status: 202 len: 0 microversion: 2.1 time: 0.080316 Oct 04 19:12:05.704307 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3438/6860] 10.222.0.20 () {58 vars in 1218 bytes} [Tue Oct 4 19:12:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-199550104 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:12:06.564134 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0de73c52-60f1-4b0d-8940-d259f6d0132f tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Action: 'create', calling method: .version_select at 0x7fe25958b670>, body: {"keypair": {"name": "tempest-keypair-1926895545", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMNpgNVjIchFvdxT0rn4iu5xa1Rn1rraKAi3vzGypJfTclgeA1j1doZZmkiulxtAPA/WpvWQ6CgdIZC1sbOH5hJumha5BQBNHcUqIwZo8sksf/DEhowKjM1Njai27M+JA=="}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:12:06.585439 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-0de73c52-60f1-4b0d-8940-d259f6d0132f tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Getting quotas for project 4e0a841124bf4392b54c3d6b0ea37e11. Resources: {'key_pairs'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:12:06.594515 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-0de73c52-60f1-4b0d-8940-d259f6d0132f tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Getting quotas for user 3060cdc6eeba47288205e107717a6980 and project 4e0a841124bf4392b54c3d6b0ea37e11. Resources: {'key_pairs'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:12:06.692644 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0de73c52-60f1-4b0d-8940-d259f6d0132f tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.132161 Oct 04 19:12:06.693772 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3423/6861] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Oct 4 19:12:06 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:12:08.478345 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7693eaae-dfe0-46e5-81ee-acf4dbb74d19 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:08.479582 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7693eaae-dfe0-46e5-81ee-acf4dbb74d19 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] [instance: 4ef4defa-c86d-4354-9123-0fd63040609d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:12:08.486726 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7693eaae-dfe0-46e5-81ee-acf4dbb74d19 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:08.487298 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7693eaae-dfe0-46e5-81ee-acf4dbb74d19 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:08.487774 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7693eaae-dfe0-46e5-81ee-acf4dbb74d19 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:08.488536 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7693eaae-dfe0-46e5-81ee-acf4dbb74d19 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:08.488991 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7693eaae-dfe0-46e5-81ee-acf4dbb74d19 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:08.490510 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7693eaae-dfe0-46e5-81ee-acf4dbb74d19 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:08.519257 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7693eaae-dfe0-46e5-81ee-acf4dbb74d19 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] [instance: 4ef4defa-c86d-4354-9123-0fd63040609d] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:12:08.856716 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7693eaae-dfe0-46e5-81ee-acf4dbb74d19 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4ef4defa-c86d-4354-9123-0fd63040609d" status: 204 len: 0 microversion: 2.1 time: 0.383439 Oct 04 19:12:08.857328 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3439/6862] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 19:12:08 2022] DELETE /compute/v2.1/servers/4ef4defa-c86d-4354-9123-0fd63040609d => generated 0 bytes in 385 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:12:08.866666 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6ac300d8-7f44-4ce9-8a19-76d6a17017ae tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:08.867302 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-6ac300d8-7f44-4ce9-8a19-76d6a17017ae tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] [instance: 4ef4defa-c86d-4354-9123-0fd63040609d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:12:08.874261 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6ac300d8-7f44-4ce9-8a19-76d6a17017ae tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:08.874761 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6ac300d8-7f44-4ce9-8a19-76d6a17017ae tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:08.875204 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6ac300d8-7f44-4ce9-8a19-76d6a17017ae tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:08.875916 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6ac300d8-7f44-4ce9-8a19-76d6a17017ae tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:08.876518 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6ac300d8-7f44-4ce9-8a19-76d6a17017ae tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:08.876956 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6ac300d8-7f44-4ce9-8a19-76d6a17017ae tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:09.027341 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-6ac300d8-7f44-4ce9-8a19-76d6a17017ae tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faeb43ec71d149c8a9b2ecf5c190ff81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a9ff76235af4fe18e50ae21f9c48af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:12:09.027341 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6ac300d8-7f44-4ce9-8a19-76d6a17017ae tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] 10.222.0.20 "GET /compute/v2.1/servers/4ef4defa-c86d-4354-9123-0fd63040609d" status: 200 len: 1470 microversion: 2.1 time: 0.160899 Oct 04 19:12:09.027341 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3424/6863] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:12:08 2022] GET /compute/v2.1/servers/4ef4defa-c86d-4354-9123-0fd63040609d => generated 1470 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:12:09.085770 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-731f40fb-204d-4ed4-ad25-8c5abfa22557 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1939470294", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "29403f06-dbc8-4a61-bdee-e5376c8a931e"}], "security_groups": [{"name": "tempest-securitygroup--1558280097"}], "key_name": "tempest-keypair-1926895545", "user_data": "}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:12:09.191935 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.neutron [None req-731f40fb-204d-4ed4-ad25-8c5abfa22557 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] validate_networks() for [('29403f06-dbc8-4a61-bdee-e5376c8a931e', None, None, None, None, None)] {{(pid=123001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:12:09.570334 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-731f40fb-204d-4ed4-ad25-8c5abfa22557 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:12:09.570905 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-731f40fb-204d-4ed4-ad25-8c5abfa22557 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:12:09.571239 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-731f40fb-204d-4ed4-ad25-8c5abfa22557 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:12:09.571686 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-731f40fb-204d-4ed4-ad25-8c5abfa22557 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:12:09.572141 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-731f40fb-204d-4ed4-ad25-8c5abfa22557 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:12:09.581023 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-731f40fb-204d-4ed4-ad25-8c5abfa22557 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:09.581514 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-731f40fb-204d-4ed4-ad25-8c5abfa22557 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:09.581956 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-731f40fb-204d-4ed4-ad25-8c5abfa22557 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:09.582690 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-731f40fb-204d-4ed4-ad25-8c5abfa22557 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:09.583740 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-731f40fb-204d-4ed4-ad25-8c5abfa22557 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:09.584624 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-731f40fb-204d-4ed4-ad25-8c5abfa22557 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:09.601679 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-731f40fb-204d-4ed4-ad25-8c5abfa22557 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Getting quotas for project 4e0a841124bf4392b54c3d6b0ea37e11. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:12:09.606943 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-731f40fb-204d-4ed4-ad25-8c5abfa22557 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Getting quotas for user 3060cdc6eeba47288205e107717a6980 and project 4e0a841124bf4392b54c3d6b0ea37e11. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:12:09.619269 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-731f40fb-204d-4ed4-ad25-8c5abfa22557 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Going to run 1 instances... {{(pid=123001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:12:09.621705 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-731f40fb-204d-4ed4-ad25-8c5abfa22557 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 14e1e062-7b26-4e1f-85d5-1f411861bf00] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:12:09.774152 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-731f40fb-204d-4ed4-ad25-8c5abfa22557 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.693528 Oct 04 19:12:09.774755 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3440/6864] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 19:12:09 2022] POST /compute/v2.1/servers => generated 402 bytes in 695 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:12:09.785921 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-47551cc9-9032-4235-9fa0-6e3aac6dd27f tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:09.787246 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-47551cc9-9032-4235-9fa0-6e3aac6dd27f tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 14e1e062-7b26-4e1f-85d5-1f411861bf00] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:12:09.845428 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-47551cc9-9032-4235-9fa0-6e3aac6dd27f tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3060cdc6eeba47288205e107717a6980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a841124bf4392b54c3d6b0ea37e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:12:09.853270 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-47551cc9-9032-4235-9fa0-6e3aac6dd27f tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "GET /compute/v2.1/servers/14e1e062-7b26-4e1f-85d5-1f411861bf00" status: 200 len: 1238 microversion: 2.1 time: 0.071283 Oct 04 19:12:09.853860 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3425/6865] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:12:09 2022] GET /compute/v2.1/servers/14e1e062-7b26-4e1f-85d5-1f411861bf00 => generated 1238 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:12:10.046986 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d43715ea-8cd0-4185-bbc1-ab257aa28ce6 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:10.047535 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d43715ea-8cd0-4185-bbc1-ab257aa28ce6 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] [instance: 4ef4defa-c86d-4354-9123-0fd63040609d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:12:10.055087 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d43715ea-8cd0-4185-bbc1-ab257aa28ce6 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:10.055583 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d43715ea-8cd0-4185-bbc1-ab257aa28ce6 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:10.056434 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d43715ea-8cd0-4185-bbc1-ab257aa28ce6 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:10.057143 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d43715ea-8cd0-4185-bbc1-ab257aa28ce6 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:10.057609 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d43715ea-8cd0-4185-bbc1-ab257aa28ce6 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:10.058042 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d43715ea-8cd0-4185-bbc1-ab257aa28ce6 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:10.189321 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d43715ea-8cd0-4185-bbc1-ab257aa28ce6 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faeb43ec71d149c8a9b2ecf5c190ff81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a9ff76235af4fe18e50ae21f9c48af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:12:10.199630 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d43715ea-8cd0-4185-bbc1-ab257aa28ce6 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] 10.222.0.20 "GET /compute/v2.1/servers/4ef4defa-c86d-4354-9123-0fd63040609d" status: 200 len: 1470 microversion: 2.1 time: 0.156358 Oct 04 19:12:10.200844 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3441/6866] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:12:10 2022] GET /compute/v2.1/servers/4ef4defa-c86d-4354-9123-0fd63040609d => generated 1470 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:12:10.877239 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6c3776bb-cfff-481e-aa8b-5d2a68b409f1 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:10.878420 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-6c3776bb-cfff-481e-aa8b-5d2a68b409f1 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 14e1e062-7b26-4e1f-85d5-1f411861bf00] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:12:10.894601 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6c3776bb-cfff-481e-aa8b-5d2a68b409f1 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:10.894601 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6c3776bb-cfff-481e-aa8b-5d2a68b409f1 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:10.894601 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6c3776bb-cfff-481e-aa8b-5d2a68b409f1 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:10.894601 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6c3776bb-cfff-481e-aa8b-5d2a68b409f1 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:10.894601 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6c3776bb-cfff-481e-aa8b-5d2a68b409f1 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:10.894601 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6c3776bb-cfff-481e-aa8b-5d2a68b409f1 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:10.937821 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-431958db-17f4-44bc-8c2b-020c99d4c7c6 req-61ad64aa-8f7f-42a7-a20d-d97721c65b5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ef4defa-c86d-4354-9123-0fd63040609d", "name": "network-vif-deleted", "tag": "801c5b8e-0faa-41d1-87f3-6c28399e3985"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:12:10.952868 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-431958db-17f4-44bc-8c2b-020c99d4c7c6 req-61ad64aa-8f7f-42a7-a20d-d97721c65b5b service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:10.953348 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-431958db-17f4-44bc-8c2b-020c99d4c7c6 req-61ad64aa-8f7f-42a7-a20d-d97721c65b5b service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:10.953828 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-431958db-17f4-44bc-8c2b-020c99d4c7c6 req-61ad64aa-8f7f-42a7-a20d-d97721c65b5b service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:10.964834 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-6c3776bb-cfff-481e-aa8b-5d2a68b409f1 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3060cdc6eeba47288205e107717a6980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a841124bf4392b54c3d6b0ea37e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:12:10.968814 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-431958db-17f4-44bc-8c2b-020c99d4c7c6 req-61ad64aa-8f7f-42a7-a20d-d97721c65b5b service nova] Creating event network-vif-deleted:801c5b8e-0faa-41d1-87f3-6c28399e3985 for instance 4ef4defa-c86d-4354-9123-0fd63040609d on n-h1-850501-14 Oct 04 19:12:10.971574 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-431958db-17f4-44bc-8c2b-020c99d4c7c6 req-61ad64aa-8f7f-42a7-a20d-d97721c65b5b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038149 Oct 04 19:12:10.972192 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3442/6867] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:12:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:12:10.973012 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6c3776bb-cfff-481e-aa8b-5d2a68b409f1 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "GET /compute/v2.1/servers/14e1e062-7b26-4e1f-85d5-1f411861bf00" status: 200 len: 1242 microversion: 2.1 time: 0.099970 Oct 04 19:12:10.973659 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3426/6868] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:12:10 2022] GET /compute/v2.1/servers/14e1e062-7b26-4e1f-85d5-1f411861bf00 => generated 1242 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:12:11.225182 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-11839afa-7964-4a40-9145-edb7595bfe43 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:11.226064 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-11839afa-7964-4a40-9145-edb7595bfe43 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] [instance: 4ef4defa-c86d-4354-9123-0fd63040609d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:12:11.235315 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-11839afa-7964-4a40-9145-edb7595bfe43 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:11.236080 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-11839afa-7964-4a40-9145-edb7595bfe43 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:11.236798 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-11839afa-7964-4a40-9145-edb7595bfe43 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:11.237734 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-11839afa-7964-4a40-9145-edb7595bfe43 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:11.238448 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-11839afa-7964-4a40-9145-edb7595bfe43 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:11.239215 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-11839afa-7964-4a40-9145-edb7595bfe43 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:11.280007 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-11839afa-7964-4a40-9145-edb7595bfe43 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:11.280584 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-11839afa-7964-4a40-9145-edb7595bfe43 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:11.280994 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-11839afa-7964-4a40-9145-edb7595bfe43 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:11.281465 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-11839afa-7964-4a40-9145-edb7595bfe43 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Lazy-loading 'fault' on Instance uuid 4ef4defa-c86d-4354-9123-0fd63040609d {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:12:11.327896 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-11839afa-7964-4a40-9145-edb7595bfe43 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faeb43ec71d149c8a9b2ecf5c190ff81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a9ff76235af4fe18e50ae21f9c48af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:12:11.337498 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-11839afa-7964-4a40-9145-edb7595bfe43 tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] 10.222.0.20 "GET /compute/v2.1/servers/4ef4defa-c86d-4354-9123-0fd63040609d" status: 200 len: 1304 microversion: 2.1 time: 0.117222 Oct 04 19:12:11.337844 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3443/6869] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:12:11 2022] GET /compute/v2.1/servers/4ef4defa-c86d-4354-9123-0fd63040609d => generated 1304 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:12:11.997704 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-58446150-ec6e-4ff3-8401-ceeb96d5c213 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:11.998364 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-58446150-ec6e-4ff3-8401-ceeb96d5c213 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 14e1e062-7b26-4e1f-85d5-1f411861bf00] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:12:12.006578 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-58446150-ec6e-4ff3-8401-ceeb96d5c213 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:12.007089 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-58446150-ec6e-4ff3-8401-ceeb96d5c213 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:12.007546 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-58446150-ec6e-4ff3-8401-ceeb96d5c213 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:12.008337 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-58446150-ec6e-4ff3-8401-ceeb96d5c213 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:12.008818 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-58446150-ec6e-4ff3-8401-ceeb96d5c213 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:12.009270 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-58446150-ec6e-4ff3-8401-ceeb96d5c213 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:12.076392 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-58446150-ec6e-4ff3-8401-ceeb96d5c213 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3060cdc6eeba47288205e107717a6980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a841124bf4392b54c3d6b0ea37e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:12:12.086209 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-58446150-ec6e-4ff3-8401-ceeb96d5c213 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "GET /compute/v2.1/servers/14e1e062-7b26-4e1f-85d5-1f411861bf00" status: 200 len: 1298 microversion: 2.1 time: 0.093839 Oct 04 19:12:12.087242 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3427/6870] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:12:11 2022] GET /compute/v2.1/servers/14e1e062-7b26-4e1f-85d5-1f411861bf00 => generated 1298 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:12:12.361641 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-09666485-e999-447f-ba88-cc5fc6143dec tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:12.362475 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-09666485-e999-447f-ba88-cc5fc6143dec tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] [instance: 4ef4defa-c86d-4354-9123-0fd63040609d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:12:12.369828 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-09666485-e999-447f-ba88-cc5fc6143dec tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:12.370306 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-09666485-e999-447f-ba88-cc5fc6143dec tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:12.370738 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-09666485-e999-447f-ba88-cc5fc6143dec tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:12.371428 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-09666485-e999-447f-ba88-cc5fc6143dec tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:12.371879 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-09666485-e999-447f-ba88-cc5fc6143dec tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:12.372331 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-09666485-e999-447f-ba88-cc5fc6143dec tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:12.386572 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-09666485-e999-447f-ba88-cc5fc6143dec tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] HTTP exception thrown: Instance 4ef4defa-c86d-4354-9123-0fd63040609d could not be found. Oct 04 19:12:12.388352 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-09666485-e999-447f-ba88-cc5fc6143dec tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Request method failure captured: Oct 04 19:12:12.388352 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/4ef4defa-c86d-4354-9123-0fd63040609d HTTP/1.1 Oct 04 19:12:12.388352 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 19:12:12.388352 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 19:12:12.388352 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 19:12:12.388352 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 19:12:12.388352 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 19:12:12.388352 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 19:12:12.388352 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 19:12:12.388352 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 19:12:12.388352 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPIUPNmFyVFVK7ReYOOsrZQK0bgTshAGdqos5bz1dQosXs8bo68y2wWGLeB9lvcTWQ5d8U2I3zDOFP47QUUe86M_4hMXdUSeRkyLOUsIc6V747n0pqSVixWZpWan45EJjrbW3qDTwbpqz7ngUCQ8ToGwbTeXcbpwhoRF3DgT1D22TZsI Oct 04 19:12:12.388352 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 19:12:12.388352 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 19:12:12.388352 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 19:12:12.388352 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 19:12:12.388352 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 19:12:12.388352 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 19:12:12.388352 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 3a9ff76235af4fe18e50ae21f9c48af8 Oct 04 19:12:12.388352 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-VolumesBackupsTest-1456542859 Oct 04 19:12:12.388352 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 19:12:12.388352 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 19:12:12.388352 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3a9ff76235af4fe18e50ae21f9c48af8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3a9ff76235af4fe18e50ae21f9c48af8", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3a9ff76235af4fe18e50ae21f9c48af8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3a9ff76235af4fe18e50ae21f9c48af8"}]}] Oct 04 19:12:12.388352 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-VolumesBackupsTest-1456542859 Oct 04 19:12:12.388352 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 3a9ff76235af4fe18e50ae21f9c48af8 Oct 04 19:12:12.388352 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-VolumesBackupsTest-1456542859 Oct 04 19:12:12.388352 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-VolumesBackupsTest-1456542859-project Oct 04 19:12:12.388352 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 19:12:12.388352 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 19:12:12.388352 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: faeb43ec71d149c8a9b2ecf5c190ff81 Oct 04 19:12:12.388352 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-VolumesBackupsTest-1456542859-project Oct 04 19:12:12.388352 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 19:12:12.388352 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 4ef4defa-c86d-4354-9123-0fd63040609d could not be found. Oct 04 19:12:12.388352 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '4ef4defa-c86d-4354-9123-0fd63040609d'} Oct 04 19:12:12.388352 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:12:12.388352 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:12:12.388352 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:12:12.388352 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:12:12.388352 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:12:12.388352 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:12:12.388352 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:12:12.388352 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:12:12.388352 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:12:12.388352 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:12:12.388352 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ef4defa-c86d-4354-9123-0fd63040609d could not be found. Oct 04 19:12:12.388352 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:12:12.388352 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:12:12.388352 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:12:12.388352 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:12:12.388352 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:12:12.388352 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:12:12.388352 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:12:12.388352 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:12:12.388352 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:12:12.388352 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:12:12.388352 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:12:12.388352 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:12:12.388352 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:12:12.388352 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:12:12.388352 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:12:12.388352 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:12:12.388352 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ef4defa-c86d-4354-9123-0fd63040609d could not be found. Oct 04 19:12:12.388352 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:12:12.388352 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:12:12.388352 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:12:12.393013 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:12:12.393013 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:12:12.393013 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:12:12.393013 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:12:12.393013 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:12:12.393013 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ef4defa-c86d-4354-9123-0fd63040609d could not be found. Oct 04 19:12:12.393013 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:12:12.393013 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-09666485-e999-447f-ba88-cc5fc6143dec tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] Returning 404 to user: Instance 4ef4defa-c86d-4354-9123-0fd63040609d could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:12:12.393013 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-09666485-e999-447f-ba88-cc5fc6143dec tempest-VolumesBackupsTest-1456542859 tempest-VolumesBackupsTest-1456542859-project] 10.222.0.20 "GET /compute/v2.1/servers/4ef4defa-c86d-4354-9123-0fd63040609d" status: 404 len: 111 microversion: 2.1 time: 0.032042 Oct 04 19:12:12.393013 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3444/6871] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:12:12 2022] GET /compute/v2.1/servers/4ef4defa-c86d-4354-9123-0fd63040609d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:12:13.110137 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-19958a76-5d8e-46a6-a93c-07e862a4b22b tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:13.110740 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-19958a76-5d8e-46a6-a93c-07e862a4b22b tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 14e1e062-7b26-4e1f-85d5-1f411861bf00] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:12:13.120379 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-19958a76-5d8e-46a6-a93c-07e862a4b22b tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:13.121682 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-19958a76-5d8e-46a6-a93c-07e862a4b22b tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:13.122430 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-19958a76-5d8e-46a6-a93c-07e862a4b22b tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:13.124291 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-19958a76-5d8e-46a6-a93c-07e862a4b22b tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:13.125327 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-19958a76-5d8e-46a6-a93c-07e862a4b22b tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:13.126022 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-19958a76-5d8e-46a6-a93c-07e862a4b22b tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:13.275701 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-19958a76-5d8e-46a6-a93c-07e862a4b22b tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3060cdc6eeba47288205e107717a6980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a841124bf4392b54c3d6b0ea37e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:12:13.285301 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-19958a76-5d8e-46a6-a93c-07e862a4b22b tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "GET /compute/v2.1/servers/14e1e062-7b26-4e1f-85d5-1f411861bf00" status: 200 len: 1364 microversion: 2.1 time: 0.179346 Oct 04 19:12:13.286782 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3428/6872] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:12:13 2022] GET /compute/v2.1/servers/14e1e062-7b26-4e1f-85d5-1f411861bf00 => generated 1364 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:12:13.924856 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-2e1f81de-7ec8-4143-b2e9-5a8b0a451642 req-4b6aa88f-c746-49c5-8fa9-c3664f1cca35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14e1e062-7b26-4e1f-85d5-1f411861bf00", "tag": "1f26a8ff-7bbd-4d48-adc8-5202ee86eb8a"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:12:13.937369 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-2e1f81de-7ec8-4143-b2e9-5a8b0a451642 req-4b6aa88f-c746-49c5-8fa9-c3664f1cca35 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:13.938473 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-2e1f81de-7ec8-4143-b2e9-5a8b0a451642 req-4b6aa88f-c746-49c5-8fa9-c3664f1cca35 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:13.939253 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-2e1f81de-7ec8-4143-b2e9-5a8b0a451642 req-4b6aa88f-c746-49c5-8fa9-c3664f1cca35 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:13.954405 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-2e1f81de-7ec8-4143-b2e9-5a8b0a451642 req-4b6aa88f-c746-49c5-8fa9-c3664f1cca35 service nova] Creating event network-changed:1f26a8ff-7bbd-4d48-adc8-5202ee86eb8a for instance 14e1e062-7b26-4e1f-85d5-1f411861bf00 on n-h2-850501-14 Oct 04 19:12:13.961446 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-2e1f81de-7ec8-4143-b2e9-5a8b0a451642 req-4b6aa88f-c746-49c5-8fa9-c3664f1cca35 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040413 Oct 04 19:12:13.962792 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3445/6873] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:12:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:12:14.311052 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c0bce0a4-32a4-45ee-99a2-7e3323f0add0 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:14.311683 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c0bce0a4-32a4-45ee-99a2-7e3323f0add0 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 14e1e062-7b26-4e1f-85d5-1f411861bf00] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:12:14.321195 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c0bce0a4-32a4-45ee-99a2-7e3323f0add0 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:14.321698 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c0bce0a4-32a4-45ee-99a2-7e3323f0add0 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:14.322661 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c0bce0a4-32a4-45ee-99a2-7e3323f0add0 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:14.323405 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c0bce0a4-32a4-45ee-99a2-7e3323f0add0 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:14.323927 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c0bce0a4-32a4-45ee-99a2-7e3323f0add0 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:14.324684 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c0bce0a4-32a4-45ee-99a2-7e3323f0add0 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:14.466727 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c0bce0a4-32a4-45ee-99a2-7e3323f0add0 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3060cdc6eeba47288205e107717a6980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a841124bf4392b54c3d6b0ea37e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:12:14.481583 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c0bce0a4-32a4-45ee-99a2-7e3323f0add0 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "GET /compute/v2.1/servers/14e1e062-7b26-4e1f-85d5-1f411861bf00" status: 200 len: 1364 microversion: 2.1 time: 0.168948 Oct 04 19:12:14.481583 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3429/6874] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:12:14 2022] GET /compute/v2.1/servers/14e1e062-7b26-4e1f-85d5-1f411861bf00 => generated 1364 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:12:15.501626 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3c16bef4-5c29-4ea1-a14e-67de1ee81189 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:15.502869 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3c16bef4-5c29-4ea1-a14e-67de1ee81189 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 14e1e062-7b26-4e1f-85d5-1f411861bf00] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:12:15.509317 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3c16bef4-5c29-4ea1-a14e-67de1ee81189 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:15.509808 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3c16bef4-5c29-4ea1-a14e-67de1ee81189 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:15.510252 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3c16bef4-5c29-4ea1-a14e-67de1ee81189 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:15.510953 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3c16bef4-5c29-4ea1-a14e-67de1ee81189 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:15.511413 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3c16bef4-5c29-4ea1-a14e-67de1ee81189 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:15.511843 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3c16bef4-5c29-4ea1-a14e-67de1ee81189 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:15.655093 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3c16bef4-5c29-4ea1-a14e-67de1ee81189 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3060cdc6eeba47288205e107717a6980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a841124bf4392b54c3d6b0ea37e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:12:15.663181 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3c16bef4-5c29-4ea1-a14e-67de1ee81189 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "GET /compute/v2.1/servers/14e1e062-7b26-4e1f-85d5-1f411861bf00" status: 200 len: 1364 microversion: 2.1 time: 0.166868 Oct 04 19:12:15.663970 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3446/6875] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:12:15 2022] GET /compute/v2.1/servers/14e1e062-7b26-4e1f-85d5-1f411861bf00 => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:12:16.686518 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5a3ef10d-9424-483e-b696-9dd541efdb60 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:16.687153 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5a3ef10d-9424-483e-b696-9dd541efdb60 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 14e1e062-7b26-4e1f-85d5-1f411861bf00] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:12:16.695165 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5a3ef10d-9424-483e-b696-9dd541efdb60 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:16.695678 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5a3ef10d-9424-483e-b696-9dd541efdb60 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:16.696174 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5a3ef10d-9424-483e-b696-9dd541efdb60 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:16.696902 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5a3ef10d-9424-483e-b696-9dd541efdb60 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:16.697378 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5a3ef10d-9424-483e-b696-9dd541efdb60 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:16.697826 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5a3ef10d-9424-483e-b696-9dd541efdb60 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:16.843719 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5a3ef10d-9424-483e-b696-9dd541efdb60 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3060cdc6eeba47288205e107717a6980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a841124bf4392b54c3d6b0ea37e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:12:16.851915 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5a3ef10d-9424-483e-b696-9dd541efdb60 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "GET /compute/v2.1/servers/14e1e062-7b26-4e1f-85d5-1f411861bf00" status: 200 len: 1364 microversion: 2.1 time: 0.169304 Oct 04 19:12:16.852543 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3430/6876] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:12:16 2022] GET /compute/v2.1/servers/14e1e062-7b26-4e1f-85d5-1f411861bf00 => generated 1364 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:12:17.875463 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8ef78f52-f052-49cd-b7ac-d66d5bba48e7 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:17.876126 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8ef78f52-f052-49cd-b7ac-d66d5bba48e7 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 14e1e062-7b26-4e1f-85d5-1f411861bf00] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:12:17.884197 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8ef78f52-f052-49cd-b7ac-d66d5bba48e7 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:17.884765 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8ef78f52-f052-49cd-b7ac-d66d5bba48e7 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:17.887709 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8ef78f52-f052-49cd-b7ac-d66d5bba48e7 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:17.887709 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8ef78f52-f052-49cd-b7ac-d66d5bba48e7 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:17.887709 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8ef78f52-f052-49cd-b7ac-d66d5bba48e7 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:17.887709 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8ef78f52-f052-49cd-b7ac-d66d5bba48e7 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:18.406295 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8ef78f52-f052-49cd-b7ac-d66d5bba48e7 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3060cdc6eeba47288205e107717a6980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a841124bf4392b54c3d6b0ea37e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:12:18.417753 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8ef78f52-f052-49cd-b7ac-d66d5bba48e7 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "GET /compute/v2.1/servers/14e1e062-7b26-4e1f-85d5-1f411861bf00" status: 200 len: 1364 microversion: 2.1 time: 0.546203 Oct 04 19:12:18.418349 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3447/6877] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:12:17 2022] GET /compute/v2.1/servers/14e1e062-7b26-4e1f-85d5-1f411861bf00 => generated 1364 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:12:19.442629 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f3d3cae9-709b-4adb-ae2c-d9f0eca126c0 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:19.443285 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f3d3cae9-709b-4adb-ae2c-d9f0eca126c0 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 14e1e062-7b26-4e1f-85d5-1f411861bf00] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:12:19.451986 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f3d3cae9-709b-4adb-ae2c-d9f0eca126c0 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:19.452545 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f3d3cae9-709b-4adb-ae2c-d9f0eca126c0 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:19.453032 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f3d3cae9-709b-4adb-ae2c-d9f0eca126c0 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:19.453744 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f3d3cae9-709b-4adb-ae2c-d9f0eca126c0 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:19.454214 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f3d3cae9-709b-4adb-ae2c-d9f0eca126c0 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:19.454659 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f3d3cae9-709b-4adb-ae2c-d9f0eca126c0 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:19.597522 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f3d3cae9-709b-4adb-ae2c-d9f0eca126c0 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3060cdc6eeba47288205e107717a6980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a841124bf4392b54c3d6b0ea37e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:12:19.607212 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f3d3cae9-709b-4adb-ae2c-d9f0eca126c0 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "GET /compute/v2.1/servers/14e1e062-7b26-4e1f-85d5-1f411861bf00" status: 200 len: 1364 microversion: 2.1 time: 0.169098 Oct 04 19:12:19.607937 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3431/6878] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:12:19 2022] GET /compute/v2.1/servers/14e1e062-7b26-4e1f-85d5-1f411861bf00 => generated 1364 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:12:20.633851 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d1fe203f-3308-4a48-bf9e-5ff91ff83356 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:20.634468 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d1fe203f-3308-4a48-bf9e-5ff91ff83356 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 14e1e062-7b26-4e1f-85d5-1f411861bf00] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:12:20.641256 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:12:20.641955 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=6 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:12:20.644091 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d1fe203f-3308-4a48-bf9e-5ff91ff83356 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:20.644861 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d1fe203f-3308-4a48-bf9e-5ff91ff83356 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:20.645304 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d1fe203f-3308-4a48-bf9e-5ff91ff83356 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:20.646012 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d1fe203f-3308-4a48-bf9e-5ff91ff83356 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:20.646836 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d1fe203f-3308-4a48-bf9e-5ff91ff83356 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:20.647301 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d1fe203f-3308-4a48-bf9e-5ff91ff83356 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:20.793872 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d1fe203f-3308-4a48-bf9e-5ff91ff83356 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3060cdc6eeba47288205e107717a6980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a841124bf4392b54c3d6b0ea37e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:12:20.805725 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d1fe203f-3308-4a48-bf9e-5ff91ff83356 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "GET /compute/v2.1/servers/14e1e062-7b26-4e1f-85d5-1f411861bf00" status: 200 len: 1364 microversion: 2.1 time: 0.176936 Oct 04 19:12:20.806313 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3448/6879] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:12:20 2022] GET /compute/v2.1/servers/14e1e062-7b26-4e1f-85d5-1f411861bf00 => generated 1364 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:12:21.355608 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-e59f149c-8111-4318-983e-77f2da4a1fe9 req-3e0a423f-b941-4371-8487-0c85150ef7dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14e1e062-7b26-4e1f-85d5-1f411861bf00", "name": "network-vif-plugged", "status": "completed", "tag": "1f26a8ff-7bbd-4d48-adc8-5202ee86eb8a"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:12:21.360900 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-72b21246-def5-4b9e-a314-87fd3ee58aca tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:12:21.361786 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=6 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:12:21.365218 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-72b21246-def5-4b9e-a314-87fd3ee58aca tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] [instance: 1389042a-157a-456c-a87b-7797a17aa095] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:12:21.368745 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-e59f149c-8111-4318-983e-77f2da4a1fe9 req-3e0a423f-b941-4371-8487-0c85150ef7dc service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:21.369250 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-e59f149c-8111-4318-983e-77f2da4a1fe9 req-3e0a423f-b941-4371-8487-0c85150ef7dc service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:21.369422 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-72b21246-def5-4b9e-a314-87fd3ee58aca tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:21.369700 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-e59f149c-8111-4318-983e-77f2da4a1fe9 req-3e0a423f-b941-4371-8487-0c85150ef7dc service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:21.370162 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-72b21246-def5-4b9e-a314-87fd3ee58aca tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:21.370596 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-72b21246-def5-4b9e-a314-87fd3ee58aca tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:21.371904 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-72b21246-def5-4b9e-a314-87fd3ee58aca tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:21.371904 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-72b21246-def5-4b9e-a314-87fd3ee58aca tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:21.372218 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-72b21246-def5-4b9e-a314-87fd3ee58aca tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:21.382286 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-e59f149c-8111-4318-983e-77f2da4a1fe9 req-3e0a423f-b941-4371-8487-0c85150ef7dc service nova] Creating event network-vif-plugged:1f26a8ff-7bbd-4d48-adc8-5202ee86eb8a for instance 14e1e062-7b26-4e1f-85d5-1f411861bf00 on n-h2-850501-14 Oct 04 19:12:21.387918 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-e59f149c-8111-4318-983e-77f2da4a1fe9 req-3e0a423f-b941-4371-8487-0c85150ef7dc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037489 Oct 04 19:12:21.388582 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3432/6880] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:12:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:12:21.472280 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-72b21246-def5-4b9e-a314-87fd3ee58aca tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] 10.222.0.20 "POST /compute/v2.1/servers/1389042a-157a-456c-a87b-7797a17aa095/action" status: 200 len: 32634 microversion: 2.1 time: 0.116227 Oct 04 19:12:21.473105 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3449/6881] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 19:12:21 2022] POST /compute/v2.1/servers/1389042a-157a-456c-a87b-7797a17aa095/action => generated 32634 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 19:12:21.832817 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6fff105a-51fa-458f-83ad-8ebd7300f8b3 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:21.833540 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-6fff105a-51fa-458f-83ad-8ebd7300f8b3 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 14e1e062-7b26-4e1f-85d5-1f411861bf00] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:12:21.841980 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6fff105a-51fa-458f-83ad-8ebd7300f8b3 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:21.842593 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6fff105a-51fa-458f-83ad-8ebd7300f8b3 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:21.843053 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6fff105a-51fa-458f-83ad-8ebd7300f8b3 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:21.843792 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6fff105a-51fa-458f-83ad-8ebd7300f8b3 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:21.844299 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6fff105a-51fa-458f-83ad-8ebd7300f8b3 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:21.844743 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6fff105a-51fa-458f-83ad-8ebd7300f8b3 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:22.063199 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-6fff105a-51fa-458f-83ad-8ebd7300f8b3 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3060cdc6eeba47288205e107717a6980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a841124bf4392b54c3d6b0ea37e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:12:22.071506 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6fff105a-51fa-458f-83ad-8ebd7300f8b3 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "GET /compute/v2.1/servers/14e1e062-7b26-4e1f-85d5-1f411861bf00" status: 200 len: 1364 microversion: 2.1 time: 0.243232 Oct 04 19:12:22.072271 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3433/6882] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:12:21 2022] GET /compute/v2.1/servers/14e1e062-7b26-4e1f-85d5-1f411861bf00 => generated 1364 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:12:22.700973 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-4d548c4c-5431-4b91-8fd5-9a429ee1deb7 req-0074e47d-6034-49bd-b158-5208fef06feb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1389042a-157a-456c-a87b-7797a17aa095", "tag": "e4f588ea-71f6-4a97-9faf-ef9eb6c45e8e"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:12:22.705216 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8449ab40-bfda-4a24-a9d8-6f3e4e731ec4 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:22.705828 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8449ab40-bfda-4a24-a9d8-6f3e4e731ec4 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] [instance: 1389042a-157a-456c-a87b-7797a17aa095] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:12:22.722163 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8449ab40-bfda-4a24-a9d8-6f3e4e731ec4 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:22.722662 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8449ab40-bfda-4a24-a9d8-6f3e4e731ec4 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:22.723809 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-4d548c4c-5431-4b91-8fd5-9a429ee1deb7 req-0074e47d-6034-49bd-b158-5208fef06feb service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:22.724612 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-4d548c4c-5431-4b91-8fd5-9a429ee1deb7 req-0074e47d-6034-49bd-b158-5208fef06feb service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:22.725497 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-4d548c4c-5431-4b91-8fd5-9a429ee1deb7 req-0074e47d-6034-49bd-b158-5208fef06feb service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:22.730531 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8449ab40-bfda-4a24-a9d8-6f3e4e731ec4 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:22.731693 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8449ab40-bfda-4a24-a9d8-6f3e4e731ec4 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:22.732215 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8449ab40-bfda-4a24-a9d8-6f3e4e731ec4 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:22.732660 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8449ab40-bfda-4a24-a9d8-6f3e4e731ec4 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:22.758861 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-4d548c4c-5431-4b91-8fd5-9a429ee1deb7 req-0074e47d-6034-49bd-b158-5208fef06feb service nova] Creating event network-changed:e4f588ea-71f6-4a97-9faf-ef9eb6c45e8e for instance 1389042a-157a-456c-a87b-7797a17aa095 on n-h2-850501-14 Oct 04 19:12:22.764621 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:12:22.766766 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-4d548c4c-5431-4b91-8fd5-9a429ee1deb7 req-0074e47d-6034-49bd-b158-5208fef06feb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069302 Oct 04 19:12:22.767791 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3434/6883] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:12:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:12:22.777779 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8449ab40-bfda-4a24-a9d8-6f3e4e731ec4 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] [instance: 1389042a-157a-456c-a87b-7797a17aa095] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:12:23.098028 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9394993a-e3aa-492c-b3c7-f4118cebbfe2 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:23.098873 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9394993a-e3aa-492c-b3c7-f4118cebbfe2 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 14e1e062-7b26-4e1f-85d5-1f411861bf00] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:12:23.107980 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9394993a-e3aa-492c-b3c7-f4118cebbfe2 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:23.108520 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9394993a-e3aa-492c-b3c7-f4118cebbfe2 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:23.109025 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9394993a-e3aa-492c-b3c7-f4118cebbfe2 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:23.109753 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9394993a-e3aa-492c-b3c7-f4118cebbfe2 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:23.110314 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9394993a-e3aa-492c-b3c7-f4118cebbfe2 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:23.110995 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9394993a-e3aa-492c-b3c7-f4118cebbfe2 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:23.153716 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8449ab40-bfda-4a24-a9d8-6f3e4e731ec4 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1389042a-157a-456c-a87b-7797a17aa095" status: 204 len: 0 microversion: 2.1 time: 0.461654 Oct 04 19:12:23.154966 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3450/6884] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 19:12:22 2022] DELETE /compute/v2.1/servers/1389042a-157a-456c-a87b-7797a17aa095 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:12:23.166187 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-cde5a95d-5069-4706-bdf6-0218c8003a68 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:23.166997 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-cde5a95d-5069-4706-bdf6-0218c8003a68 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] [instance: 1389042a-157a-456c-a87b-7797a17aa095] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:12:23.173714 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cde5a95d-5069-4706-bdf6-0218c8003a68 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:23.174600 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cde5a95d-5069-4706-bdf6-0218c8003a68 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:23.175034 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cde5a95d-5069-4706-bdf6-0218c8003a68 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:23.175818 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cde5a95d-5069-4706-bdf6-0218c8003a68 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:23.176396 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cde5a95d-5069-4706-bdf6-0218c8003a68 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:23.176892 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cde5a95d-5069-4706-bdf6-0218c8003a68 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:23.359701 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9394993a-e3aa-492c-b3c7-f4118cebbfe2 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3060cdc6eeba47288205e107717a6980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a841124bf4392b54c3d6b0ea37e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:12:23.370969 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9394993a-e3aa-492c-b3c7-f4118cebbfe2 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "GET /compute/v2.1/servers/14e1e062-7b26-4e1f-85d5-1f411861bf00" status: 200 len: 1364 microversion: 2.1 time: 0.277917 Oct 04 19:12:23.371831 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3435/6885] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:12:23 2022] GET /compute/v2.1/servers/14e1e062-7b26-4e1f-85d5-1f411861bf00 => generated 1364 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:12:23.396855 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-cde5a95d-5069-4706-bdf6-0218c8003a68 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f2888940414c0d9a690ad8c68b4da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42758fc2a182488489d9989e17beb026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:12:23.406658 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-cde5a95d-5069-4706-bdf6-0218c8003a68 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] 10.222.0.20 "GET /compute/v2.1/servers/1389042a-157a-456c-a87b-7797a17aa095" status: 200 len: 1671 microversion: 2.1 time: 0.245822 Oct 04 19:12:23.407326 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3451/6886] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:12:23 2022] GET /compute/v2.1/servers/1389042a-157a-456c-a87b-7797a17aa095 => generated 1671 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:12:24.396142 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b180d695-392a-44d1-b618-ed09c082cabe tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:24.397272 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b180d695-392a-44d1-b618-ed09c082cabe tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 14e1e062-7b26-4e1f-85d5-1f411861bf00] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:12:24.404980 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b180d695-392a-44d1-b618-ed09c082cabe tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:24.407026 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b180d695-392a-44d1-b618-ed09c082cabe tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:24.407026 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b180d695-392a-44d1-b618-ed09c082cabe tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:24.407418 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b180d695-392a-44d1-b618-ed09c082cabe tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:24.408005 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b180d695-392a-44d1-b618-ed09c082cabe tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:24.408553 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b180d695-392a-44d1-b618-ed09c082cabe tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:24.435388 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-cfc0acd6-60a7-4dce-907e-6b46756d3002 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:24.436207 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-cfc0acd6-60a7-4dce-907e-6b46756d3002 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] [instance: 1389042a-157a-456c-a87b-7797a17aa095] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:12:24.444603 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cfc0acd6-60a7-4dce-907e-6b46756d3002 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:24.445105 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cfc0acd6-60a7-4dce-907e-6b46756d3002 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:24.445551 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cfc0acd6-60a7-4dce-907e-6b46756d3002 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:24.446271 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cfc0acd6-60a7-4dce-907e-6b46756d3002 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:24.446734 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cfc0acd6-60a7-4dce-907e-6b46756d3002 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:24.447445 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cfc0acd6-60a7-4dce-907e-6b46756d3002 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:24.630281 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b180d695-392a-44d1-b618-ed09c082cabe tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3060cdc6eeba47288205e107717a6980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a841124bf4392b54c3d6b0ea37e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:12:24.642132 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b180d695-392a-44d1-b618-ed09c082cabe tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "GET /compute/v2.1/servers/14e1e062-7b26-4e1f-85d5-1f411861bf00" status: 200 len: 1551 microversion: 2.1 time: 0.251229 Oct 04 19:12:24.642877 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3436/6887] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:12:24 2022] GET /compute/v2.1/servers/14e1e062-7b26-4e1f-85d5-1f411861bf00 => generated 1551 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:12:24.665136 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-cfc0acd6-60a7-4dce-907e-6b46756d3002 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f2888940414c0d9a690ad8c68b4da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42758fc2a182488489d9989e17beb026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:12:24.672472 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f00326af-d2a8-4cbb-86f5-0b0d62348f9a tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:24.672993 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f00326af-d2a8-4cbb-86f5-0b0d62348f9a tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 14e1e062-7b26-4e1f-85d5-1f411861bf00] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:12:24.681709 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f00326af-d2a8-4cbb-86f5-0b0d62348f9a tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:24.681911 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-cfc0acd6-60a7-4dce-907e-6b46756d3002 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] 10.222.0.20 "GET /compute/v2.1/servers/1389042a-157a-456c-a87b-7797a17aa095" status: 200 len: 1671 microversion: 2.1 time: 0.254222 Oct 04 19:12:24.682215 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f00326af-d2a8-4cbb-86f5-0b0d62348f9a tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:24.682687 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f00326af-d2a8-4cbb-86f5-0b0d62348f9a tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:24.683398 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f00326af-d2a8-4cbb-86f5-0b0d62348f9a tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:24.683781 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3452/6888] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:12:24 2022] GET /compute/v2.1/servers/1389042a-157a-456c-a87b-7797a17aa095 => generated 1671 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:12:24.683949 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f00326af-d2a8-4cbb-86f5-0b0d62348f9a tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:24.684408 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f00326af-d2a8-4cbb-86f5-0b0d62348f9a tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:24.774031 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f00326af-d2a8-4cbb-86f5-0b0d62348f9a tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "GET /compute/v2.1/servers/14e1e062-7b26-4e1f-85d5-1f411861bf00/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.105437 Oct 04 19:12:24.774671 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3437/6889] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Oct 4 19:12:24 2022] GET /compute/v2.1/servers/14e1e062-7b26-4e1f-85d5-1f411861bf00/os-interface => generated 285 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:12:25.717002 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-93963aa3-36bc-4b65-820f-fef088302698 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:25.718289 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-93963aa3-36bc-4b65-820f-fef088302698 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] [instance: 1389042a-157a-456c-a87b-7797a17aa095] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:12:25.725482 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-93963aa3-36bc-4b65-820f-fef088302698 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:25.725972 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-93963aa3-36bc-4b65-820f-fef088302698 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:25.726761 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-93963aa3-36bc-4b65-820f-fef088302698 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:25.727090 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-93963aa3-36bc-4b65-820f-fef088302698 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:25.727554 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-93963aa3-36bc-4b65-820f-fef088302698 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:25.727979 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-93963aa3-36bc-4b65-820f-fef088302698 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:25.877855 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-93963aa3-36bc-4b65-820f-fef088302698 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f2888940414c0d9a690ad8c68b4da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42758fc2a182488489d9989e17beb026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:12:25.886759 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-93963aa3-36bc-4b65-820f-fef088302698 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] 10.222.0.20 "GET /compute/v2.1/servers/1389042a-157a-456c-a87b-7797a17aa095" status: 200 len: 1552 microversion: 2.1 time: 0.173905 Oct 04 19:12:25.896216 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3453/6890] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:12:25 2022] GET /compute/v2.1/servers/1389042a-157a-456c-a87b-7797a17aa095 => generated 1552 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:12:26.309214 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-506a2b11-ae2f-4c86-9737-948d09a201cb req-bc78a6fb-230a-4654-968e-c8530b632e28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1389042a-157a-456c-a87b-7797a17aa095", "name": "network-vif-deleted", "tag": "e4f588ea-71f6-4a97-9faf-ef9eb6c45e8e"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:12:26.320421 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-506a2b11-ae2f-4c86-9737-948d09a201cb req-bc78a6fb-230a-4654-968e-c8530b632e28 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:26.321217 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-506a2b11-ae2f-4c86-9737-948d09a201cb req-bc78a6fb-230a-4654-968e-c8530b632e28 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:26.321669 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-506a2b11-ae2f-4c86-9737-948d09a201cb req-bc78a6fb-230a-4654-968e-c8530b632e28 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:26.341599 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-506a2b11-ae2f-4c86-9737-948d09a201cb req-bc78a6fb-230a-4654-968e-c8530b632e28 service nova] Creating event network-vif-deleted:e4f588ea-71f6-4a97-9faf-ef9eb6c45e8e for instance 1389042a-157a-456c-a87b-7797a17aa095 on n-h2-850501-14 Oct 04 19:12:26.346904 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-506a2b11-ae2f-4c86-9737-948d09a201cb req-bc78a6fb-230a-4654-968e-c8530b632e28 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041349 Oct 04 19:12:26.347518 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3438/6891] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:12:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:12:26.911118 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a4e68fce-0dbc-4705-9ecc-591eda10ca07 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:26.911769 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a4e68fce-0dbc-4705-9ecc-591eda10ca07 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] [instance: 1389042a-157a-456c-a87b-7797a17aa095] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:12:26.924959 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a4e68fce-0dbc-4705-9ecc-591eda10ca07 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:26.925455 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a4e68fce-0dbc-4705-9ecc-591eda10ca07 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:26.925896 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a4e68fce-0dbc-4705-9ecc-591eda10ca07 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:26.927975 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a4e68fce-0dbc-4705-9ecc-591eda10ca07 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:26.930266 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a4e68fce-0dbc-4705-9ecc-591eda10ca07 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:26.930713 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a4e68fce-0dbc-4705-9ecc-591eda10ca07 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:26.971441 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a4e68fce-0dbc-4705-9ecc-591eda10ca07 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:26.971935 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a4e68fce-0dbc-4705-9ecc-591eda10ca07 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:26.972422 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a4e68fce-0dbc-4705-9ecc-591eda10ca07 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:26.972877 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-a4e68fce-0dbc-4705-9ecc-591eda10ca07 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lazy-loading 'fault' on Instance uuid 1389042a-157a-456c-a87b-7797a17aa095 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:12:27.020515 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a4e68fce-0dbc-4705-9ecc-591eda10ca07 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f2888940414c0d9a690ad8c68b4da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42758fc2a182488489d9989e17beb026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:12:27.033998 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a4e68fce-0dbc-4705-9ecc-591eda10ca07 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] 10.222.0.20 "GET /compute/v2.1/servers/1389042a-157a-456c-a87b-7797a17aa095" status: 200 len: 1338 microversion: 2.1 time: 0.127014 Oct 04 19:12:27.035117 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3454/6892] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:12:26 2022] GET /compute/v2.1/servers/1389042a-157a-456c-a87b-7797a17aa095 => generated 1338 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:12:28.060256 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-abc99d93-5aad-4336-98c4-0b50d22215fa tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:28.060989 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-abc99d93-5aad-4336-98c4-0b50d22215fa tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] [instance: 1389042a-157a-456c-a87b-7797a17aa095] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:12:28.068498 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-abc99d93-5aad-4336-98c4-0b50d22215fa tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:28.069876 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-abc99d93-5aad-4336-98c4-0b50d22215fa tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:28.070487 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-abc99d93-5aad-4336-98c4-0b50d22215fa tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:28.071268 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-abc99d93-5aad-4336-98c4-0b50d22215fa tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:28.071978 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-abc99d93-5aad-4336-98c4-0b50d22215fa tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:28.073091 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-abc99d93-5aad-4336-98c4-0b50d22215fa tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:28.087724 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-abc99d93-5aad-4336-98c4-0b50d22215fa tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] HTTP exception thrown: Instance 1389042a-157a-456c-a87b-7797a17aa095 could not be found. Oct 04 19:12:28.091742 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-abc99d93-5aad-4336-98c4-0b50d22215fa tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Request method failure captured: Oct 04 19:12:28.091742 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/1389042a-157a-456c-a87b-7797a17aa095 HTTP/1.1 Oct 04 19:12:28.091742 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 19:12:28.091742 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 19:12:28.091742 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 19:12:28.091742 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 19:12:28.091742 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 19:12:28.091742 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 19:12:28.091742 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 19:12:28.091742 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 19:12:28.091742 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPISjbepDD7DyFxPoxHaQZLVFHWoQ9KikGoZ2b8cEOBRXV9Y4lOfF-4VAJDCsGIPanNSeGFiSdJVMgGH5BOJ1QNwOaHaad6KH0lgudVytMc4b42PXPVd5IbxECN6iUeXPOBIQD4EuWybCdCaB4a9_LjPFHXR8jNy4f-Z7YJftYsncGI8 Oct 04 19:12:28.091742 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 19:12:28.091742 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 19:12:28.091742 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 19:12:28.091742 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 19:12:28.091742 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 19:12:28.091742 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 19:12:28.091742 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 42758fc2a182488489d9989e17beb026 Oct 04 19:12:28.091742 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-TestNetworkBasicOps-296728974 Oct 04 19:12:28.091742 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 19:12:28.091742 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 19:12:28.091742 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/42758fc2a182488489d9989e17beb026"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_42758fc2a182488489d9989e17beb026", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/42758fc2a182488489d9989e17beb026"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/42758fc2a182488489d9989e17beb026"}]}] Oct 04 19:12:28.091742 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-TestNetworkBasicOps-296728974 Oct 04 19:12:28.091742 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 42758fc2a182488489d9989e17beb026 Oct 04 19:12:28.091742 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-TestNetworkBasicOps-296728974 Oct 04 19:12:28.091742 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-TestNetworkBasicOps-296728974-project Oct 04 19:12:28.091742 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 19:12:28.091742 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 19:12:28.091742 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: f7f2888940414c0d9a690ad8c68b4da3 Oct 04 19:12:28.091742 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-TestNetworkBasicOps-296728974-project Oct 04 19:12:28.091742 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 19:12:28.091742 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 1389042a-157a-456c-a87b-7797a17aa095 could not be found. Oct 04 19:12:28.091742 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '1389042a-157a-456c-a87b-7797a17aa095'} Oct 04 19:12:28.091742 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:12:28.091742 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:12:28.091742 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:12:28.091742 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:12:28.091742 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:12:28.091742 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:12:28.091742 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:12:28.091742 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:12:28.091742 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:12:28.091742 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:12:28.091742 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1389042a-157a-456c-a87b-7797a17aa095 could not be found. Oct 04 19:12:28.091742 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:12:28.091742 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:12:28.091742 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:12:28.091742 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:12:28.091742 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:12:28.091742 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:12:28.091742 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:12:28.091742 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:12:28.091742 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:12:28.091742 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:12:28.091742 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:12:28.091742 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:12:28.091742 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:12:28.091742 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:12:28.091742 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:12:28.091742 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:12:28.091742 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1389042a-157a-456c-a87b-7797a17aa095 could not be found. Oct 04 19:12:28.091742 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:12:28.091742 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:12:28.091742 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:12:28.096422 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:12:28.096422 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:12:28.096422 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:12:28.096422 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:12:28.096422 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:12:28.096422 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1389042a-157a-456c-a87b-7797a17aa095 could not be found. Oct 04 19:12:28.096422 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:12:28.096422 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-abc99d93-5aad-4336-98c4-0b50d22215fa tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Returning 404 to user: Instance 1389042a-157a-456c-a87b-7797a17aa095 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:12:28.096422 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-abc99d93-5aad-4336-98c4-0b50d22215fa tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] 10.222.0.20 "GET /compute/v2.1/servers/1389042a-157a-456c-a87b-7797a17aa095" status: 404 len: 111 microversion: 2.1 time: 0.035146 Oct 04 19:12:28.096422 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3439/6893] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:12:28 2022] GET /compute/v2.1/servers/1389042a-157a-456c-a87b-7797a17aa095 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:12:28.366991 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-d74b1f1b-3445-484c-802a-09aa9e645be7 req-edee9e3b-b73a-46b2-a603-b7abf3dc7821 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14e1e062-7b26-4e1f-85d5-1f411861bf00", "tag": "1f26a8ff-7bbd-4d48-adc8-5202ee86eb8a"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:12:28.387015 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7c5e9cc7-492e-4d21-a1c8-a05230a9e586 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] Calling method '.version_select at 0x7fe25d1cc5e0>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:12:28.389427 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-d74b1f1b-3445-484c-802a-09aa9e645be7 req-edee9e3b-b73a-46b2-a603-b7abf3dc7821 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:12:28.389941 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-d74b1f1b-3445-484c-802a-09aa9e645be7 req-edee9e3b-b73a-46b2-a603-b7abf3dc7821 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:12:28.390392 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-d74b1f1b-3445-484c-802a-09aa9e645be7 req-edee9e3b-b73a-46b2-a603-b7abf3dc7821 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:12:28.416492 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-d74b1f1b-3445-484c-802a-09aa9e645be7 req-edee9e3b-b73a-46b2-a603-b7abf3dc7821 service nova] Creating event network-changed:1f26a8ff-7bbd-4d48-adc8-5202ee86eb8a for instance 14e1e062-7b26-4e1f-85d5-1f411861bf00 on n-h2-850501-14 Oct 04 19:12:28.437222 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-d74b1f1b-3445-484c-802a-09aa9e645be7 req-edee9e3b-b73a-46b2-a603-b7abf3dc7821 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072958 Oct 04 19:12:28.437222 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3455/6894] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:12:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:12:28.487689 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7c5e9cc7-492e-4d21-a1c8-a05230a9e586 tempest-TestNetworkBasicOps-296728974 tempest-TestNetworkBasicOps-296728974-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-731182279" status: 202 len: 0 microversion: 2.1 time: 0.108788 Oct 04 19:12:28.488682 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3440/6895] 10.222.0.20 () {58 vars in 1254 bytes} [Tue Oct 4 19:12:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-731182279 => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 19:13:31.807623 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:13:31.808482 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:13:32.055326 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-16453b92-68cd-46f0-99d8-0ca709934ed1 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:13:32.055952 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-16453b92-68cd-46f0-99d8-0ca709934ed1 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 14e1e062-7b26-4e1f-85d5-1f411861bf00] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:13:32.067186 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-16453b92-68cd-46f0-99d8-0ca709934ed1 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:32.067186 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-16453b92-68cd-46f0-99d8-0ca709934ed1 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:32.067186 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-16453b92-68cd-46f0-99d8-0ca709934ed1 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:32.067186 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-16453b92-68cd-46f0-99d8-0ca709934ed1 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:32.067186 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-16453b92-68cd-46f0-99d8-0ca709934ed1 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:32.067186 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-16453b92-68cd-46f0-99d8-0ca709934ed1 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:32.090768 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-16453b92-68cd-46f0-99d8-0ca709934ed1 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "GET /compute/v2.1/servers/14e1e062-7b26-4e1f-85d5-1f411861bf00/ips" status: 200 len: 147 microversion: 2.1 time: 0.285788 Oct 04 19:13:32.091325 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3456/6896] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Oct 4 19:13:31 2022] GET /compute/v2.1/servers/14e1e062-7b26-4e1f-85d5-1f411861bf00/ips => generated 147 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:13:34.848641 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:13:34.849812 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:13:34.850587 n-d-850501-14 devstack@n-api.service[123002]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:13:34.850735 n-d-850501-14 devstack@n-api.service[123002]: Tue Oct 4 19:13:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/14e1e062-7b26-4e1f-85d5-1f411861bf00/os-volume_attachments (ip 10.222.0.20) !!! Oct 04 19:13:34.856749 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-66c2d4a4-52b5-479b-a93b-ecc985776755 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "61fcfd49-7af3-4262-ba9e-fa9eddcd7c7c"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:13:34.859185 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-66c2d4a4-52b5-479b-a93b-ecc985776755 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 14e1e062-7b26-4e1f-85d5-1f411861bf00] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:13:34.866691 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-66c2d4a4-52b5-479b-a93b-ecc985776755 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:34.867207 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-66c2d4a4-52b5-479b-a93b-ecc985776755 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:34.867639 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-66c2d4a4-52b5-479b-a93b-ecc985776755 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:34.868391 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-66c2d4a4-52b5-479b-a93b-ecc985776755 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:34.868867 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-66c2d4a4-52b5-479b-a93b-ecc985776755 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:34.869288 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-66c2d4a4-52b5-479b-a93b-ecc985776755 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:35.827838 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-66c2d4a4-52b5-479b-a93b-ecc985776755 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "POST /compute/v2.1/servers/14e1e062-7b26-4e1f-85d5-1f411861bf00/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.982339 Oct 04 19:13:35.835777 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3441/6897] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Oct 4 19:13:34 2022] POST /compute/v2.1/servers/14e1e062-7b26-4e1f-85d5-1f411861bf00/os-volume_attachments => generated 194 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:13:47.810714 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8649566d-7a7e-4431-85bd-ac8e730d6846 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:13:47.813849 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8649566d-7a7e-4431-85bd-ac8e730d6846 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 14e1e062-7b26-4e1f-85d5-1f411861bf00] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:13:47.817924 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=4 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:13:47.822961 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8649566d-7a7e-4431-85bd-ac8e730d6846 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:47.823492 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8649566d-7a7e-4431-85bd-ac8e730d6846 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:47.823928 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8649566d-7a7e-4431-85bd-ac8e730d6846 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:47.824716 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8649566d-7a7e-4431-85bd-ac8e730d6846 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:47.825171 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8649566d-7a7e-4431-85bd-ac8e730d6846 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:47.825913 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8649566d-7a7e-4431-85bd-ac8e730d6846 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:47.859676 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8649566d-7a7e-4431-85bd-ac8e730d6846 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "GET /compute/v2.1/servers/14e1e062-7b26-4e1f-85d5-1f411861bf00/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053148 Oct 04 19:13:47.860281 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3457/6898] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 19:13:47 2022] GET /compute/v2.1/servers/14e1e062-7b26-4e1f-85d5-1f411861bf00/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:13:47.869625 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:13:47.871865 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:13:47.875168 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-eb1aab24-e421-4524-9bfb-d38b039be86f tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:13:47.876037 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-eb1aab24-e421-4524-9bfb-d38b039be86f tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 14e1e062-7b26-4e1f-85d5-1f411861bf00] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:13:47.883288 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eb1aab24-e421-4524-9bfb-d38b039be86f tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:47.883794 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eb1aab24-e421-4524-9bfb-d38b039be86f tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:47.884280 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eb1aab24-e421-4524-9bfb-d38b039be86f tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:47.885008 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eb1aab24-e421-4524-9bfb-d38b039be86f tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:47.885481 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eb1aab24-e421-4524-9bfb-d38b039be86f tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:47.885925 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eb1aab24-e421-4524-9bfb-d38b039be86f tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:47.931888 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-eb1aab24-e421-4524-9bfb-d38b039be86f tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "GET /compute/v2.1/servers/14e1e062-7b26-4e1f-85d5-1f411861bf00/os-volume_attachments/61fcfd49-7af3-4262-ba9e-fa9eddcd7c7c" status: 200 len: 194 microversion: 2.1 time: 0.064220 Oct 04 19:13:47.932596 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3442/6899] 10.222.0.20 () {58 vars in 1413 bytes} [Tue Oct 4 19:13:47 2022] GET /compute/v2.1/servers/14e1e062-7b26-4e1f-85d5-1f411861bf00/os-volume_attachments/61fcfd49-7af3-4262-ba9e-fa9eddcd7c7c => generated 194 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:13:50.041426 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0a1a28ea-3512-4c1b-ba4b-70a63c233235 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-262812057", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1229993015", "security_groups": [{"name": "tempest-secgroup-smoke-722389711"}], "block_device_mapping_v2": [{"uuid": "e6cf08f9-16af-450a-b610-2ecf7dfac294", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "dbc89e1f-759d-4fcb-8e1c-542119e29e34"}]}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:13:50.230498 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.neutron [None req-0a1a28ea-3512-4c1b-ba4b-70a63c233235 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] validate_networks() for [('dbc89e1f-759d-4fcb-8e1c-542119e29e34', None, None, None, None, None)] {{(pid=123001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:13:50.747922 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a4446606-3f64-42a4-b751-805078603309 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cc7697e2-1c86-4992-9c37-394c62bffc5b"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:13:50.751102 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a4446606-3f64-42a4-b751-805078603309 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 14e1e062-7b26-4e1f-85d5-1f411861bf00] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:13:50.753198 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-0a1a28ea-3512-4c1b-ba4b-70a63c233235 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:13:50.753603 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-0a1a28ea-3512-4c1b-ba4b-70a63c233235 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:13:50.754656 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-0a1a28ea-3512-4c1b-ba4b-70a63c233235 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:13:50.755093 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-0a1a28ea-3512-4c1b-ba4b-70a63c233235 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:13:50.755503 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-0a1a28ea-3512-4c1b-ba4b-70a63c233235 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:13:50.759002 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a4446606-3f64-42a4-b751-805078603309 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:50.759507 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a4446606-3f64-42a4-b751-805078603309 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:50.759957 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a4446606-3f64-42a4-b751-805078603309 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:50.760694 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a4446606-3f64-42a4-b751-805078603309 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:50.761192 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a4446606-3f64-42a4-b751-805078603309 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:50.761630 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a4446606-3f64-42a4-b751-805078603309 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:50.764764 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0a1a28ea-3512-4c1b-ba4b-70a63c233235 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:50.765260 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0a1a28ea-3512-4c1b-ba4b-70a63c233235 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:50.765698 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0a1a28ea-3512-4c1b-ba4b-70a63c233235 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:50.769326 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0a1a28ea-3512-4c1b-ba4b-70a63c233235 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:50.769326 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0a1a28ea-3512-4c1b-ba4b-70a63c233235 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:50.769326 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0a1a28ea-3512-4c1b-ba4b-70a63c233235 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:50.786615 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-0a1a28ea-3512-4c1b-ba4b-70a63c233235 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Getting quotas for project 82d0cd3db371459db429cb770abde738. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:13:50.792047 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-0a1a28ea-3512-4c1b-ba4b-70a63c233235 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Getting quotas for user a65ae9c3fb3c46a2a393fe21ce21b9d4 and project 82d0cd3db371459db429cb770abde738. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:13:50.863949 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0a1a28ea-3512-4c1b-ba4b-70a63c233235 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Going to run 1 instances... {{(pid=123001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:13:50.866367 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0a1a28ea-3512-4c1b-ba4b-70a63c233235 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: a5d743fc-bedb-41a3-9348-14b57739482d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e6cf08f9-16af-450a-b610-2ecf7dfac294',volume_size=None,volume_type=None)] {{(pid=123001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:13:51.328698 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0a1a28ea-3512-4c1b-ba4b-70a63c233235 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.291153 Oct 04 19:13:51.330331 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3458/6900] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 19:13:50 2022] POST /compute/v2.1/servers => generated 405 bytes in 1294 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:13:51.346535 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e0da42ee-0085-4275-af17-6556eadb5b89 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:13:51.348334 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e0da42ee-0085-4275-af17-6556eadb5b89 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: a5d743fc-bedb-41a3-9348-14b57739482d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:13:51.411570 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e0da42ee-0085-4275-af17-6556eadb5b89 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:13:51.427098 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e0da42ee-0085-4275-af17-6556eadb5b89 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/a5d743fc-bedb-41a3-9348-14b57739482d" status: 200 len: 1094 microversion: 2.1 time: 0.083119 Oct 04 19:13:51.427710 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3459/6901] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:13:51 2022] GET /compute/v2.1/servers/a5d743fc-bedb-41a3-9348-14b57739482d => generated 1094 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:13:51.552991 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a4446606-3f64-42a4-b751-805078603309 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "POST /compute/v2.1/servers/14e1e062-7b26-4e1f-85d5-1f411861bf00/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.810290 Oct 04 19:13:51.553642 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3443/6902] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Oct 4 19:13:50 2022] POST /compute/v2.1/servers/14e1e062-7b26-4e1f-85d5-1f411861bf00/os-volume_attachments => generated 194 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:13:52.451974 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-78c5bf2d-dda7-48f0-b5f3-0551894d39db tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:13:52.452645 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-78c5bf2d-dda7-48f0-b5f3-0551894d39db tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: a5d743fc-bedb-41a3-9348-14b57739482d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:13:52.465463 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-78c5bf2d-dda7-48f0-b5f3-0551894d39db tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:52.466026 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-78c5bf2d-dda7-48f0-b5f3-0551894d39db tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:52.469128 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-78c5bf2d-dda7-48f0-b5f3-0551894d39db tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:52.469128 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-78c5bf2d-dda7-48f0-b5f3-0551894d39db tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:52.469128 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-78c5bf2d-dda7-48f0-b5f3-0551894d39db tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:52.469128 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-78c5bf2d-dda7-48f0-b5f3-0551894d39db tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:52.572678 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-78c5bf2d-dda7-48f0-b5f3-0551894d39db tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:13:52.581913 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-78c5bf2d-dda7-48f0-b5f3-0551894d39db tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/a5d743fc-bedb-41a3-9348-14b57739482d" status: 200 len: 1144 microversion: 2.1 time: 0.134990 Oct 04 19:13:52.582820 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3460/6903] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:13:52 2022] GET /compute/v2.1/servers/a5d743fc-bedb-41a3-9348-14b57739482d => generated 1144 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:13:53.606319 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2c19296b-3717-4e3d-99c4-003751ec23b1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:13:53.607047 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2c19296b-3717-4e3d-99c4-003751ec23b1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: a5d743fc-bedb-41a3-9348-14b57739482d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:13:53.614543 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2c19296b-3717-4e3d-99c4-003751ec23b1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:53.615395 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2c19296b-3717-4e3d-99c4-003751ec23b1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:53.616133 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2c19296b-3717-4e3d-99c4-003751ec23b1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:53.617115 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2c19296b-3717-4e3d-99c4-003751ec23b1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:53.617815 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2c19296b-3717-4e3d-99c4-003751ec23b1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:53.618478 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2c19296b-3717-4e3d-99c4-003751ec23b1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:53.701702 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2c19296b-3717-4e3d-99c4-003751ec23b1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:13:53.709932 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2c19296b-3717-4e3d-99c4-003751ec23b1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/a5d743fc-bedb-41a3-9348-14b57739482d" status: 200 len: 1200 microversion: 2.1 time: 0.108494 Oct 04 19:13:53.728756 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3444/6904] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:13:53 2022] GET /compute/v2.1/servers/a5d743fc-bedb-41a3-9348-14b57739482d => generated 1200 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:13:54.737507 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b0bdba11-caa5-4ded-bc3f-5f9531c22e88 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:13:54.738579 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b0bdba11-caa5-4ded-bc3f-5f9531c22e88 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: a5d743fc-bedb-41a3-9348-14b57739482d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:13:54.749172 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b0bdba11-caa5-4ded-bc3f-5f9531c22e88 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:54.749568 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b0bdba11-caa5-4ded-bc3f-5f9531c22e88 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:54.750009 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b0bdba11-caa5-4ded-bc3f-5f9531c22e88 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:54.750732 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b0bdba11-caa5-4ded-bc3f-5f9531c22e88 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:54.751194 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b0bdba11-caa5-4ded-bc3f-5f9531c22e88 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:54.751621 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b0bdba11-caa5-4ded-bc3f-5f9531c22e88 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:55.065021 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b0bdba11-caa5-4ded-bc3f-5f9531c22e88 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:13:55.074664 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b0bdba11-caa5-4ded-bc3f-5f9531c22e88 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/a5d743fc-bedb-41a3-9348-14b57739482d" status: 200 len: 1277 microversion: 2.1 time: 0.341208 Oct 04 19:13:55.075527 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3461/6905] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:13:54 2022] GET /compute/v2.1/servers/a5d743fc-bedb-41a3-9348-14b57739482d => generated 1277 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:13:55.889543 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-1ef547a7-8bef-4b80-8e45-b19f008ac5e4 req-88876642-0657-44be-b5ec-ca9129683500 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5d743fc-bedb-41a3-9348-14b57739482d", "tag": "b6571cb3-8371-4499-950b-18f12d9f8531"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:13:55.900009 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-1ef547a7-8bef-4b80-8e45-b19f008ac5e4 req-88876642-0657-44be-b5ec-ca9129683500 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:55.900819 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-1ef547a7-8bef-4b80-8e45-b19f008ac5e4 req-88876642-0657-44be-b5ec-ca9129683500 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:55.901268 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-1ef547a7-8bef-4b80-8e45-b19f008ac5e4 req-88876642-0657-44be-b5ec-ca9129683500 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:55.913886 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-1ef547a7-8bef-4b80-8e45-b19f008ac5e4 req-88876642-0657-44be-b5ec-ca9129683500 service nova] Creating event network-changed:b6571cb3-8371-4499-950b-18f12d9f8531 for instance a5d743fc-bedb-41a3-9348-14b57739482d on n-h1-850501-14 Oct 04 19:13:55.919210 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-1ef547a7-8bef-4b80-8e45-b19f008ac5e4 req-88876642-0657-44be-b5ec-ca9129683500 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107864 Oct 04 19:13:55.920230 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3445/6906] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:13:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:13:56.100787 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d94759b3-ae75-42f0-be75-f0d420fe01d4 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:13:56.109739 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d94759b3-ae75-42f0-be75-f0d420fe01d4 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: a5d743fc-bedb-41a3-9348-14b57739482d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:13:56.127671 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d94759b3-ae75-42f0-be75-f0d420fe01d4 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:56.128978 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d94759b3-ae75-42f0-be75-f0d420fe01d4 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:56.132485 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d94759b3-ae75-42f0-be75-f0d420fe01d4 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:56.132485 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d94759b3-ae75-42f0-be75-f0d420fe01d4 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:56.132485 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d94759b3-ae75-42f0-be75-f0d420fe01d4 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:56.132485 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d94759b3-ae75-42f0-be75-f0d420fe01d4 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:56.323287 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d94759b3-ae75-42f0-be75-f0d420fe01d4 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:13:56.338008 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d94759b3-ae75-42f0-be75-f0d420fe01d4 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/a5d743fc-bedb-41a3-9348-14b57739482d" status: 200 len: 1277 microversion: 2.1 time: 0.242923 Oct 04 19:13:56.339105 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3462/6907] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:13:56 2022] GET /compute/v2.1/servers/a5d743fc-bedb-41a3-9348-14b57739482d => generated 1277 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:13:57.363129 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a7935784-556d-43e3-a5d2-fe8ee7c81daa tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:13:57.364645 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a7935784-556d-43e3-a5d2-fe8ee7c81daa tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: a5d743fc-bedb-41a3-9348-14b57739482d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:13:57.371822 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a7935784-556d-43e3-a5d2-fe8ee7c81daa tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:57.372486 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a7935784-556d-43e3-a5d2-fe8ee7c81daa tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:57.372949 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a7935784-556d-43e3-a5d2-fe8ee7c81daa tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:57.373670 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a7935784-556d-43e3-a5d2-fe8ee7c81daa tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:57.374244 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a7935784-556d-43e3-a5d2-fe8ee7c81daa tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:57.374700 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a7935784-556d-43e3-a5d2-fe8ee7c81daa tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:57.522056 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a7935784-556d-43e3-a5d2-fe8ee7c81daa tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:13:57.532570 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a7935784-556d-43e3-a5d2-fe8ee7c81daa tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/a5d743fc-bedb-41a3-9348-14b57739482d" status: 200 len: 1277 microversion: 2.1 time: 0.173842 Oct 04 19:13:57.533792 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3446/6908] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:13:57 2022] GET /compute/v2.1/servers/a5d743fc-bedb-41a3-9348-14b57739482d => generated 1277 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:13:58.558660 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-16a2148c-4f56-4c5c-a9c8-fa67392e8732 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:13:58.559187 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-16a2148c-4f56-4c5c-a9c8-fa67392e8732 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: a5d743fc-bedb-41a3-9348-14b57739482d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:13:58.577990 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-16a2148c-4f56-4c5c-a9c8-fa67392e8732 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:58.578497 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-16a2148c-4f56-4c5c-a9c8-fa67392e8732 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:58.578977 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-16a2148c-4f56-4c5c-a9c8-fa67392e8732 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:58.579674 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-16a2148c-4f56-4c5c-a9c8-fa67392e8732 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:58.580162 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-16a2148c-4f56-4c5c-a9c8-fa67392e8732 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:58.580798 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-16a2148c-4f56-4c5c-a9c8-fa67392e8732 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:58.726700 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-16a2148c-4f56-4c5c-a9c8-fa67392e8732 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:13:58.734591 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-16a2148c-4f56-4c5c-a9c8-fa67392e8732 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/a5d743fc-bedb-41a3-9348-14b57739482d" status: 200 len: 1277 microversion: 2.1 time: 0.179833 Oct 04 19:13:58.735230 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3463/6909] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:13:58 2022] GET /compute/v2.1/servers/a5d743fc-bedb-41a3-9348-14b57739482d => generated 1277 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:13:59.760795 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-79f022ea-37c2-4598-9e94-af7ff52d42c3 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:13:59.761476 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-79f022ea-37c2-4598-9e94-af7ff52d42c3 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: a5d743fc-bedb-41a3-9348-14b57739482d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:13:59.767112 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-79f022ea-37c2-4598-9e94-af7ff52d42c3 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:59.767805 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-79f022ea-37c2-4598-9e94-af7ff52d42c3 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:59.768047 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-79f022ea-37c2-4598-9e94-af7ff52d42c3 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:59.769256 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-79f022ea-37c2-4598-9e94-af7ff52d42c3 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:59.769575 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-79f022ea-37c2-4598-9e94-af7ff52d42c3 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:59.769890 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-79f022ea-37c2-4598-9e94-af7ff52d42c3 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:59.917695 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-79f022ea-37c2-4598-9e94-af7ff52d42c3 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:13:59.927447 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-79f022ea-37c2-4598-9e94-af7ff52d42c3 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/a5d743fc-bedb-41a3-9348-14b57739482d" status: 200 len: 1277 microversion: 2.1 time: 0.172292 Oct 04 19:13:59.928847 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3447/6910] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:13:59 2022] GET /compute/v2.1/servers/a5d743fc-bedb-41a3-9348-14b57739482d => generated 1277 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:14:00.950948 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-89032d3e-2d3e-431f-a1a7-c351e7d0d712 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:14:00.951579 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-89032d3e-2d3e-431f-a1a7-c351e7d0d712 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: a5d743fc-bedb-41a3-9348-14b57739482d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:14:00.954317 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:14:00.959311 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-89032d3e-2d3e-431f-a1a7-c351e7d0d712 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:00.959801 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-89032d3e-2d3e-431f-a1a7-c351e7d0d712 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:00.960280 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-89032d3e-2d3e-431f-a1a7-c351e7d0d712 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:00.961243 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-89032d3e-2d3e-431f-a1a7-c351e7d0d712 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:00.961700 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-89032d3e-2d3e-431f-a1a7-c351e7d0d712 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:00.962134 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-89032d3e-2d3e-431f-a1a7-c351e7d0d712 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:01.122407 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-89032d3e-2d3e-431f-a1a7-c351e7d0d712 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:14:01.132543 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-89032d3e-2d3e-431f-a1a7-c351e7d0d712 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/a5d743fc-bedb-41a3-9348-14b57739482d" status: 200 len: 1277 microversion: 2.1 time: 0.185341 Oct 04 19:14:01.133203 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3464/6911] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:14:00 2022] GET /compute/v2.1/servers/a5d743fc-bedb-41a3-9348-14b57739482d => generated 1277 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:14:02.157764 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e922f7a7-7e9a-4474-947e-eb6a2c6ced84 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:14:02.158439 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e922f7a7-7e9a-4474-947e-eb6a2c6ced84 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: a5d743fc-bedb-41a3-9348-14b57739482d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:14:02.165775 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e922f7a7-7e9a-4474-947e-eb6a2c6ced84 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:02.166313 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e922f7a7-7e9a-4474-947e-eb6a2c6ced84 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:02.166767 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e922f7a7-7e9a-4474-947e-eb6a2c6ced84 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:02.167471 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e922f7a7-7e9a-4474-947e-eb6a2c6ced84 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:02.167942 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e922f7a7-7e9a-4474-947e-eb6a2c6ced84 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:02.168414 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e922f7a7-7e9a-4474-947e-eb6a2c6ced84 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:02.313187 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e922f7a7-7e9a-4474-947e-eb6a2c6ced84 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:14:02.322149 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e922f7a7-7e9a-4474-947e-eb6a2c6ced84 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/a5d743fc-bedb-41a3-9348-14b57739482d" status: 200 len: 1265 microversion: 2.1 time: 0.168914 Oct 04 19:14:02.322744 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3448/6912] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:14:02 2022] GET /compute/v2.1/servers/a5d743fc-bedb-41a3-9348-14b57739482d => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:14:03.347046 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7ce69910-cb97-4937-b6c2-5e0440ca3542 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:14:03.347659 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7ce69910-cb97-4937-b6c2-5e0440ca3542 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: a5d743fc-bedb-41a3-9348-14b57739482d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:14:03.349573 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=8 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:14:03.355260 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7ce69910-cb97-4937-b6c2-5e0440ca3542 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:03.355757 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7ce69910-cb97-4937-b6c2-5e0440ca3542 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:03.356231 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7ce69910-cb97-4937-b6c2-5e0440ca3542 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:03.356939 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7ce69910-cb97-4937-b6c2-5e0440ca3542 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:03.357734 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7ce69910-cb97-4937-b6c2-5e0440ca3542 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:03.357856 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7ce69910-cb97-4937-b6c2-5e0440ca3542 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:03.497687 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7ce69910-cb97-4937-b6c2-5e0440ca3542 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:14:03.505401 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7ce69910-cb97-4937-b6c2-5e0440ca3542 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/a5d743fc-bedb-41a3-9348-14b57739482d" status: 200 len: 1265 microversion: 2.1 time: 0.162450 Oct 04 19:14:03.505968 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3465/6913] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:14:03 2022] GET /compute/v2.1/servers/a5d743fc-bedb-41a3-9348-14b57739482d => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:14:04.529139 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-953b4854-8855-4088-836e-e55bfb1d5342 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:14:04.529788 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-953b4854-8855-4088-836e-e55bfb1d5342 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: a5d743fc-bedb-41a3-9348-14b57739482d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:14:04.537573 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-953b4854-8855-4088-836e-e55bfb1d5342 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:04.538192 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-953b4854-8855-4088-836e-e55bfb1d5342 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:04.538573 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-953b4854-8855-4088-836e-e55bfb1d5342 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:04.539291 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-953b4854-8855-4088-836e-e55bfb1d5342 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:04.539763 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-953b4854-8855-4088-836e-e55bfb1d5342 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:04.540240 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-953b4854-8855-4088-836e-e55bfb1d5342 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:04.678632 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-953b4854-8855-4088-836e-e55bfb1d5342 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:14:04.686794 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-953b4854-8855-4088-836e-e55bfb1d5342 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/a5d743fc-bedb-41a3-9348-14b57739482d" status: 200 len: 1265 microversion: 2.1 time: 0.161903 Oct 04 19:14:04.689318 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3449/6914] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:14:04 2022] GET /compute/v2.1/servers/a5d743fc-bedb-41a3-9348-14b57739482d => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:14:05.711166 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b0d60ca1-0d14-4035-855c-09d97a24fd79 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:14:05.711891 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b0d60ca1-0d14-4035-855c-09d97a24fd79 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: a5d743fc-bedb-41a3-9348-14b57739482d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:14:05.719344 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b0d60ca1-0d14-4035-855c-09d97a24fd79 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:05.721843 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b0d60ca1-0d14-4035-855c-09d97a24fd79 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:05.721843 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b0d60ca1-0d14-4035-855c-09d97a24fd79 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:05.721843 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b0d60ca1-0d14-4035-855c-09d97a24fd79 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:05.721843 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b0d60ca1-0d14-4035-855c-09d97a24fd79 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:05.722218 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b0d60ca1-0d14-4035-855c-09d97a24fd79 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:05.862496 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b0d60ca1-0d14-4035-855c-09d97a24fd79 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:14:05.870598 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b0d60ca1-0d14-4035-855c-09d97a24fd79 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/a5d743fc-bedb-41a3-9348-14b57739482d" status: 200 len: 1265 microversion: 2.1 time: 0.164320 Oct 04 19:14:05.871156 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3466/6915] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:14:05 2022] GET /compute/v2.1/servers/a5d743fc-bedb-41a3-9348-14b57739482d => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:14:06.562602 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3a6b9951-9df1-4026-800d-b23b428849c5 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:14:06.566942 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3a6b9951-9df1-4026-800d-b23b428849c5 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 14e1e062-7b26-4e1f-85d5-1f411861bf00] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:14:06.572159 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3a6b9951-9df1-4026-800d-b23b428849c5 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:06.572666 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3a6b9951-9df1-4026-800d-b23b428849c5 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:06.573128 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3a6b9951-9df1-4026-800d-b23b428849c5 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:06.573877 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3a6b9951-9df1-4026-800d-b23b428849c5 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:06.574352 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3a6b9951-9df1-4026-800d-b23b428849c5 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:06.574798 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3a6b9951-9df1-4026-800d-b23b428849c5 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:06.608304 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3a6b9951-9df1-4026-800d-b23b428849c5 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "GET /compute/v2.1/servers/14e1e062-7b26-4e1f-85d5-1f411861bf00/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049592 Oct 04 19:14:06.612805 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3450/6916] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 19:14:06 2022] GET /compute/v2.1/servers/14e1e062-7b26-4e1f-85d5-1f411861bf00/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:14:06.761947 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-728919f2-7469-41f7-8ab1-8c3b6a1e2f5f tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:14:06.762456 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-728919f2-7469-41f7-8ab1-8c3b6a1e2f5f tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 14e1e062-7b26-4e1f-85d5-1f411861bf00] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:14:06.769406 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-728919f2-7469-41f7-8ab1-8c3b6a1e2f5f tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:06.773911 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-728919f2-7469-41f7-8ab1-8c3b6a1e2f5f tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:06.773911 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-728919f2-7469-41f7-8ab1-8c3b6a1e2f5f tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:06.773911 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-728919f2-7469-41f7-8ab1-8c3b6a1e2f5f tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:06.773911 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-728919f2-7469-41f7-8ab1-8c3b6a1e2f5f tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:06.773911 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-728919f2-7469-41f7-8ab1-8c3b6a1e2f5f tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:06.808345 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-728919f2-7469-41f7-8ab1-8c3b6a1e2f5f tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "GET /compute/v2.1/servers/14e1e062-7b26-4e1f-85d5-1f411861bf00/os-volume_attachments/61fcfd49-7af3-4262-ba9e-fa9eddcd7c7c" status: 200 len: 194 microversion: 2.1 time: 0.050075 Oct 04 19:14:06.808976 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3467/6917] 10.222.0.20 () {58 vars in 1413 bytes} [Tue Oct 4 19:14:06 2022] GET /compute/v2.1/servers/14e1e062-7b26-4e1f-85d5-1f411861bf00/os-volume_attachments/61fcfd49-7af3-4262-ba9e-fa9eddcd7c7c => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:14:06.821874 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-fee9ae03-f793-4233-a3f4-9d06d8cbf6c3 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:14:06.822721 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-fee9ae03-f793-4233-a3f4-9d06d8cbf6c3 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 14e1e062-7b26-4e1f-85d5-1f411861bf00] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:14:06.830173 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fee9ae03-f793-4233-a3f4-9d06d8cbf6c3 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:06.833066 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fee9ae03-f793-4233-a3f4-9d06d8cbf6c3 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:06.833066 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fee9ae03-f793-4233-a3f4-9d06d8cbf6c3 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:06.834082 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fee9ae03-f793-4233-a3f4-9d06d8cbf6c3 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:06.834676 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fee9ae03-f793-4233-a3f4-9d06d8cbf6c3 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:06.835122 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fee9ae03-f793-4233-a3f4-9d06d8cbf6c3 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:06.903337 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ce2f27f2-3d12-4574-9874-856bfbe748e6 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:14:06.904132 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ce2f27f2-3d12-4574-9874-856bfbe748e6 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: a5d743fc-bedb-41a3-9348-14b57739482d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:14:06.912623 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ce2f27f2-3d12-4574-9874-856bfbe748e6 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:06.913127 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ce2f27f2-3d12-4574-9874-856bfbe748e6 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:06.913566 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ce2f27f2-3d12-4574-9874-856bfbe748e6 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:06.914692 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ce2f27f2-3d12-4574-9874-856bfbe748e6 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:06.915162 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ce2f27f2-3d12-4574-9874-856bfbe748e6 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:06.915666 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ce2f27f2-3d12-4574-9874-856bfbe748e6 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:06.923093 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-fee9ae03-f793-4233-a3f4-9d06d8cbf6c3 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lazy-loading 'services' on Instance uuid 14e1e062-7b26-4e1f-85d5-1f411861bf00 {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:14:07.053696 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ce2f27f2-3d12-4574-9874-856bfbe748e6 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:14:07.063171 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ce2f27f2-3d12-4574-9874-856bfbe748e6 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/a5d743fc-bedb-41a3-9348-14b57739482d" status: 200 len: 1265 microversion: 2.1 time: 0.164950 Oct 04 19:14:07.063935 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3468/6918] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:14:06 2022] GET /compute/v2.1/servers/a5d743fc-bedb-41a3-9348-14b57739482d => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:14:07.210458 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-fee9ae03-f793-4233-a3f4-9d06d8cbf6c3 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "DELETE /compute/v2.1/servers/14e1e062-7b26-4e1f-85d5-1f411861bf00/os-volume_attachments/61fcfd49-7af3-4262-ba9e-fa9eddcd7c7c" status: 202 len: 0 microversion: 2.1 time: 0.393326 Oct 04 19:14:07.211353 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3451/6919] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Oct 4 19:14:06 2022] DELETE /compute/v2.1/servers/14e1e062-7b26-4e1f-85d5-1f411861bf00/os-volume_attachments/61fcfd49-7af3-4262-ba9e-fa9eddcd7c7c => generated 0 bytes in 396 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:14:08.088878 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-46ef9b4c-e3ca-49f0-a760-36de6f3c3c02 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:14:08.090277 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-46ef9b4c-e3ca-49f0-a760-36de6f3c3c02 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: a5d743fc-bedb-41a3-9348-14b57739482d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:14:08.099536 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-46ef9b4c-e3ca-49f0-a760-36de6f3c3c02 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:08.100449 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-46ef9b4c-e3ca-49f0-a760-36de6f3c3c02 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:08.101067 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-46ef9b4c-e3ca-49f0-a760-36de6f3c3c02 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:08.101950 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-46ef9b4c-e3ca-49f0-a760-36de6f3c3c02 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:08.102605 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-46ef9b4c-e3ca-49f0-a760-36de6f3c3c02 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:08.103043 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-46ef9b4c-e3ca-49f0-a760-36de6f3c3c02 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:08.276373 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-46ef9b4c-e3ca-49f0-a760-36de6f3c3c02 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:14:08.290580 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-46ef9b4c-e3ca-49f0-a760-36de6f3c3c02 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/a5d743fc-bedb-41a3-9348-14b57739482d" status: 200 len: 1265 microversion: 2.1 time: 0.204482 Oct 04 19:14:08.290580 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3469/6920] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:14:08 2022] GET /compute/v2.1/servers/a5d743fc-bedb-41a3-9348-14b57739482d => generated 1265 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:14:09.317362 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-da4a21a7-1d8d-4e54-9d2e-ba308fbdc8a4 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:14:09.318078 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-da4a21a7-1d8d-4e54-9d2e-ba308fbdc8a4 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: a5d743fc-bedb-41a3-9348-14b57739482d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:14:09.324795 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-da4a21a7-1d8d-4e54-9d2e-ba308fbdc8a4 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:09.325511 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-da4a21a7-1d8d-4e54-9d2e-ba308fbdc8a4 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:09.325974 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-da4a21a7-1d8d-4e54-9d2e-ba308fbdc8a4 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:09.326751 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-da4a21a7-1d8d-4e54-9d2e-ba308fbdc8a4 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:09.327225 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-da4a21a7-1d8d-4e54-9d2e-ba308fbdc8a4 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:09.327668 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-da4a21a7-1d8d-4e54-9d2e-ba308fbdc8a4 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:09.501308 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-da4a21a7-1d8d-4e54-9d2e-ba308fbdc8a4 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:14:09.510177 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-da4a21a7-1d8d-4e54-9d2e-ba308fbdc8a4 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/a5d743fc-bedb-41a3-9348-14b57739482d" status: 200 len: 1265 microversion: 2.1 time: 0.199103 Oct 04 19:14:09.510757 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3452/6921] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:14:09 2022] GET /compute/v2.1/servers/a5d743fc-bedb-41a3-9348-14b57739482d => generated 1265 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:14:10.533712 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9390758f-271d-407a-b9b0-96ddc5c756da tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:14:10.541033 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-9390758f-271d-407a-b9b0-96ddc5c756da tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: a5d743fc-bedb-41a3-9348-14b57739482d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:14:10.542705 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9390758f-271d-407a-b9b0-96ddc5c756da tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:10.543280 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9390758f-271d-407a-b9b0-96ddc5c756da tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:10.543797 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9390758f-271d-407a-b9b0-96ddc5c756da tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:10.544542 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9390758f-271d-407a-b9b0-96ddc5c756da tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:10.545002 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9390758f-271d-407a-b9b0-96ddc5c756da tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:10.545429 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9390758f-271d-407a-b9b0-96ddc5c756da tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:10.695731 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9390758f-271d-407a-b9b0-96ddc5c756da tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:14:10.703674 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9390758f-271d-407a-b9b0-96ddc5c756da tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/a5d743fc-bedb-41a3-9348-14b57739482d" status: 200 len: 1265 microversion: 2.1 time: 0.174137 Oct 04 19:14:10.704272 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3470/6922] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:14:10 2022] GET /compute/v2.1/servers/a5d743fc-bedb-41a3-9348-14b57739482d => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:14:11.729296 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-17f48802-e13a-4ef0-95e0-1c0078d9fb28 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:14:11.729934 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-17f48802-e13a-4ef0-95e0-1c0078d9fb28 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: a5d743fc-bedb-41a3-9348-14b57739482d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:14:11.737559 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-17f48802-e13a-4ef0-95e0-1c0078d9fb28 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:11.738115 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-17f48802-e13a-4ef0-95e0-1c0078d9fb28 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:11.738802 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-17f48802-e13a-4ef0-95e0-1c0078d9fb28 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:11.739529 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-17f48802-e13a-4ef0-95e0-1c0078d9fb28 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:11.740006 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-17f48802-e13a-4ef0-95e0-1c0078d9fb28 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:11.740485 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-17f48802-e13a-4ef0-95e0-1c0078d9fb28 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:11.886554 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-17f48802-e13a-4ef0-95e0-1c0078d9fb28 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:14:11.897768 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-17f48802-e13a-4ef0-95e0-1c0078d9fb28 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/a5d743fc-bedb-41a3-9348-14b57739482d" status: 200 len: 1265 microversion: 2.1 time: 0.172304 Oct 04 19:14:11.898389 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3453/6923] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:14:11 2022] GET /compute/v2.1/servers/a5d743fc-bedb-41a3-9348-14b57739482d => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:14:12.670028 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0b2ade88-114e-459e-87c8-3d39b26a28ca tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:14:12.670519 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0b2ade88-114e-459e-87c8-3d39b26a28ca tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 14e1e062-7b26-4e1f-85d5-1f411861bf00] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:14:12.677763 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0b2ade88-114e-459e-87c8-3d39b26a28ca tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:12.678254 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0b2ade88-114e-459e-87c8-3d39b26a28ca tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:12.681344 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0b2ade88-114e-459e-87c8-3d39b26a28ca tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:12.681344 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0b2ade88-114e-459e-87c8-3d39b26a28ca tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:12.681344 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0b2ade88-114e-459e-87c8-3d39b26a28ca tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:12.681344 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0b2ade88-114e-459e-87c8-3d39b26a28ca tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:12.712436 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0b2ade88-114e-459e-87c8-3d39b26a28ca tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "GET /compute/v2.1/servers/14e1e062-7b26-4e1f-85d5-1f411861bf00/os-volume_attachments/cc7697e2-1c86-4992-9c37-394c62bffc5b" status: 200 len: 194 microversion: 2.1 time: 0.046473 Oct 04 19:14:12.713050 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3471/6924] 10.222.0.20 () {58 vars in 1413 bytes} [Tue Oct 4 19:14:12 2022] GET /compute/v2.1/servers/14e1e062-7b26-4e1f-85d5-1f411861bf00/os-volume_attachments/cc7697e2-1c86-4992-9c37-394c62bffc5b => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:14:12.725114 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-53d518a3-8f6a-4b40-a1e7-d7e77df4de4b tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:14:12.727325 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-53d518a3-8f6a-4b40-a1e7-d7e77df4de4b tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 14e1e062-7b26-4e1f-85d5-1f411861bf00] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:14:12.732317 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-53d518a3-8f6a-4b40-a1e7-d7e77df4de4b tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:12.732870 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-53d518a3-8f6a-4b40-a1e7-d7e77df4de4b tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:12.733268 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-53d518a3-8f6a-4b40-a1e7-d7e77df4de4b tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:12.734015 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-53d518a3-8f6a-4b40-a1e7-d7e77df4de4b tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:12.734478 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-53d518a3-8f6a-4b40-a1e7-d7e77df4de4b tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:12.734914 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-53d518a3-8f6a-4b40-a1e7-d7e77df4de4b tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:12.834606 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-53d518a3-8f6a-4b40-a1e7-d7e77df4de4b tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lazy-loading 'services' on Instance uuid 14e1e062-7b26-4e1f-85d5-1f411861bf00 {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:14:12.922416 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a6e79610-1f7f-42d5-99bf-425afa1dc1e7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:14:12.923113 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a6e79610-1f7f-42d5-99bf-425afa1dc1e7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: a5d743fc-bedb-41a3-9348-14b57739482d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:14:12.930135 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a6e79610-1f7f-42d5-99bf-425afa1dc1e7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:12.930845 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a6e79610-1f7f-42d5-99bf-425afa1dc1e7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:12.931288 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a6e79610-1f7f-42d5-99bf-425afa1dc1e7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:12.933450 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a6e79610-1f7f-42d5-99bf-425afa1dc1e7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:12.933450 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a6e79610-1f7f-42d5-99bf-425afa1dc1e7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:12.933450 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a6e79610-1f7f-42d5-99bf-425afa1dc1e7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:13.077169 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a6e79610-1f7f-42d5-99bf-425afa1dc1e7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:14:13.083027 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-53d518a3-8f6a-4b40-a1e7-d7e77df4de4b tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "DELETE /compute/v2.1/servers/14e1e062-7b26-4e1f-85d5-1f411861bf00/os-volume_attachments/cc7697e2-1c86-4992-9c37-394c62bffc5b" status: 202 len: 0 microversion: 2.1 time: 0.363206 Oct 04 19:14:13.087157 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3454/6925] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Oct 4 19:14:12 2022] DELETE /compute/v2.1/servers/14e1e062-7b26-4e1f-85d5-1f411861bf00/os-volume_attachments/cc7697e2-1c86-4992-9c37-394c62bffc5b => generated 0 bytes in 365 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:14:13.087296 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a6e79610-1f7f-42d5-99bf-425afa1dc1e7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/a5d743fc-bedb-41a3-9348-14b57739482d" status: 200 len: 1265 microversion: 2.1 time: 0.168785 Oct 04 19:14:13.089865 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-33c3ac67-bfe7-4f20-bc61-449f88dca17c req-228b40f8-24f1-4311-9db6-60e459571b23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5d743fc-bedb-41a3-9348-14b57739482d", "name": "network-vif-plugged", "status": "completed", "tag": "b6571cb3-8371-4499-950b-18f12d9f8531"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:14:13.090628 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3472/6926] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:14:12 2022] GET /compute/v2.1/servers/a5d743fc-bedb-41a3-9348-14b57739482d => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:14:13.101302 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-33c3ac67-bfe7-4f20-bc61-449f88dca17c req-228b40f8-24f1-4311-9db6-60e459571b23 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:13.101994 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-33c3ac67-bfe7-4f20-bc61-449f88dca17c req-228b40f8-24f1-4311-9db6-60e459571b23 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:13.102446 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-33c3ac67-bfe7-4f20-bc61-449f88dca17c req-228b40f8-24f1-4311-9db6-60e459571b23 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:13.116314 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-33c3ac67-bfe7-4f20-bc61-449f88dca17c req-228b40f8-24f1-4311-9db6-60e459571b23 service nova] Creating event network-vif-plugged:b6571cb3-8371-4499-950b-18f12d9f8531 for instance a5d743fc-bedb-41a3-9348-14b57739482d on n-h1-850501-14 Oct 04 19:14:13.122136 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-33c3ac67-bfe7-4f20-bc61-449f88dca17c req-228b40f8-24f1-4311-9db6-60e459571b23 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036063 Oct 04 19:14:13.122745 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3455/6927] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:14:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:14:14.114844 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5ea6254e-3d87-452c-bbb6-e783f8dabb3e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:14:14.115505 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5ea6254e-3d87-452c-bbb6-e783f8dabb3e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: a5d743fc-bedb-41a3-9348-14b57739482d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:14:14.125283 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5ea6254e-3d87-452c-bbb6-e783f8dabb3e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:14.125788 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5ea6254e-3d87-452c-bbb6-e783f8dabb3e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:14.126232 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5ea6254e-3d87-452c-bbb6-e783f8dabb3e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:14.126998 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5ea6254e-3d87-452c-bbb6-e783f8dabb3e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:14.127459 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5ea6254e-3d87-452c-bbb6-e783f8dabb3e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:14.127931 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5ea6254e-3d87-452c-bbb6-e783f8dabb3e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:14.274531 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5ea6254e-3d87-452c-bbb6-e783f8dabb3e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:14:14.282651 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5ea6254e-3d87-452c-bbb6-e783f8dabb3e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/a5d743fc-bedb-41a3-9348-14b57739482d" status: 200 len: 1265 microversion: 2.1 time: 0.172590 Oct 04 19:14:14.283228 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3473/6928] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:14:14 2022] GET /compute/v2.1/servers/a5d743fc-bedb-41a3-9348-14b57739482d => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:14:15.307314 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-17f68c8c-c97a-4654-8db8-0317fffa781d tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:14:15.308023 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-17f68c8c-c97a-4654-8db8-0317fffa781d tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: a5d743fc-bedb-41a3-9348-14b57739482d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:14:15.316204 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-17f68c8c-c97a-4654-8db8-0317fffa781d tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:15.320376 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-17f68c8c-c97a-4654-8db8-0317fffa781d tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:15.320376 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-17f68c8c-c97a-4654-8db8-0317fffa781d tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:15.320376 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-17f68c8c-c97a-4654-8db8-0317fffa781d tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:15.320376 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-17f68c8c-c97a-4654-8db8-0317fffa781d tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:15.320376 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-17f68c8c-c97a-4654-8db8-0317fffa781d tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:15.473369 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-17f68c8c-c97a-4654-8db8-0317fffa781d tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:14:15.482221 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-17f68c8c-c97a-4654-8db8-0317fffa781d tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/a5d743fc-bedb-41a3-9348-14b57739482d" status: 200 len: 1451 microversion: 2.1 time: 0.179276 Oct 04 19:14:15.482810 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3456/6929] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:14:15 2022] GET /compute/v2.1/servers/a5d743fc-bedb-41a3-9348-14b57739482d => generated 1451 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:14:15.505288 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-704d22de-12d0-42bf-b62f-c3d2691186d3 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:14:15.505896 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-704d22de-12d0-42bf-b62f-c3d2691186d3 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: a5d743fc-bedb-41a3-9348-14b57739482d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:14:15.513047 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-704d22de-12d0-42bf-b62f-c3d2691186d3 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:15.513533 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-704d22de-12d0-42bf-b62f-c3d2691186d3 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:15.514429 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-704d22de-12d0-42bf-b62f-c3d2691186d3 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:15.515061 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-704d22de-12d0-42bf-b62f-c3d2691186d3 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:15.515528 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-704d22de-12d0-42bf-b62f-c3d2691186d3 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:15.515863 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-704d22de-12d0-42bf-b62f-c3d2691186d3 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:15.655363 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-704d22de-12d0-42bf-b62f-c3d2691186d3 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:14:15.664131 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-704d22de-12d0-42bf-b62f-c3d2691186d3 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/a5d743fc-bedb-41a3-9348-14b57739482d" status: 200 len: 1451 microversion: 2.1 time: 0.163258 Oct 04 19:14:15.664710 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3474/6930] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:14:15 2022] GET /compute/v2.1/servers/a5d743fc-bedb-41a3-9348-14b57739482d => generated 1451 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:14:18.212947 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-50d8a68e-2c64-44bb-b956-c4ea6372e56f req-372979ef-1197-4e36-82ce-49c60cfd61c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5d743fc-bedb-41a3-9348-14b57739482d", "tag": "b6571cb3-8371-4499-950b-18f12d9f8531"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:14:18.223972 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=31 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:14:18.226452 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-50d8a68e-2c64-44bb-b956-c4ea6372e56f req-372979ef-1197-4e36-82ce-49c60cfd61c4 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:18.227109 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-50d8a68e-2c64-44bb-b956-c4ea6372e56f req-372979ef-1197-4e36-82ce-49c60cfd61c4 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:18.227775 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-50d8a68e-2c64-44bb-b956-c4ea6372e56f req-372979ef-1197-4e36-82ce-49c60cfd61c4 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:18.241125 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:14:18.244337 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-50d8a68e-2c64-44bb-b956-c4ea6372e56f req-372979ef-1197-4e36-82ce-49c60cfd61c4 service nova] Creating event network-changed:b6571cb3-8371-4499-950b-18f12d9f8531 for instance a5d743fc-bedb-41a3-9348-14b57739482d on n-h1-850501-14 Oct 04 19:14:18.250268 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-50d8a68e-2c64-44bb-b956-c4ea6372e56f req-372979ef-1197-4e36-82ce-49c60cfd61c4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042579 Oct 04 19:14:18.251935 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3457/6931] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:14:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:14:18.614123 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-467eaa16-aaf6-4c36-a17c-93af4081bc29 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:14:18.619129 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-467eaa16-aaf6-4c36-a17c-93af4081bc29 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 14e1e062-7b26-4e1f-85d5-1f411861bf00] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:14:18.635068 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:14:18.638258 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-467eaa16-aaf6-4c36-a17c-93af4081bc29 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:18.646924 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-467eaa16-aaf6-4c36-a17c-93af4081bc29 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:18.653042 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-467eaa16-aaf6-4c36-a17c-93af4081bc29 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:18.653042 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-467eaa16-aaf6-4c36-a17c-93af4081bc29 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:18.653042 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-467eaa16-aaf6-4c36-a17c-93af4081bc29 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:18.653042 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-467eaa16-aaf6-4c36-a17c-93af4081bc29 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:18.655003 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=100 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:14:18.690014 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-467eaa16-aaf6-4c36-a17c-93af4081bc29 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "GET /compute/v2.1/servers/14e1e062-7b26-4e1f-85d5-1f411861bf00/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.080685 Oct 04 19:14:18.697499 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3475/6932] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 19:14:18 2022] GET /compute/v2.1/servers/14e1e062-7b26-4e1f-85d5-1f411861bf00/os-volume_attachments => generated 25 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 19:14:18.870178 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-fb192579-d9c9-4397-bb4f-f2a07c7e86f2 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:14:18.873224 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-fb192579-d9c9-4397-bb4f-f2a07c7e86f2 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 14e1e062-7b26-4e1f-85d5-1f411861bf00] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:14:18.883022 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fb192579-d9c9-4397-bb4f-f2a07c7e86f2 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:18.883798 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fb192579-d9c9-4397-bb4f-f2a07c7e86f2 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:18.884580 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fb192579-d9c9-4397-bb4f-f2a07c7e86f2 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:18.886104 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fb192579-d9c9-4397-bb4f-f2a07c7e86f2 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:18.886748 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fb192579-d9c9-4397-bb4f-f2a07c7e86f2 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:18.887351 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fb192579-d9c9-4397-bb4f-f2a07c7e86f2 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:18.926002 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-fb192579-d9c9-4397-bb4f-f2a07c7e86f2 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "GET /compute/v2.1/servers/14e1e062-7b26-4e1f-85d5-1f411861bf00/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.067052 Oct 04 19:14:18.934108 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3458/6933] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 19:14:18 2022] GET /compute/v2.1/servers/14e1e062-7b26-4e1f-85d5-1f411861bf00/os-volume_attachments => generated 25 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 19:14:19.011340 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6abf939b-5adf-45f4-b482-27405d7cb67b tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:14:19.012161 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6abf939b-5adf-45f4-b482-27405d7cb67b tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 14e1e062-7b26-4e1f-85d5-1f411861bf00] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:14:19.020280 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6abf939b-5adf-45f4-b482-27405d7cb67b tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:19.021041 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6abf939b-5adf-45f4-b482-27405d7cb67b tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:19.021784 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6abf939b-5adf-45f4-b482-27405d7cb67b tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:19.023686 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6abf939b-5adf-45f4-b482-27405d7cb67b tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:19.024372 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6abf939b-5adf-45f4-b482-27405d7cb67b tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:19.025008 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6abf939b-5adf-45f4-b482-27405d7cb67b tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:19.055964 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6abf939b-5adf-45f4-b482-27405d7cb67b tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 14e1e062-7b26-4e1f-85d5-1f411861bf00] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:14:19.508206 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6abf939b-5adf-45f4-b482-27405d7cb67b tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "DELETE /compute/v2.1/servers/14e1e062-7b26-4e1f-85d5-1f411861bf00" status: 204 len: 0 microversion: 2.1 time: 0.502426 Oct 04 19:14:19.509068 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3476/6934] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 19:14:19 2022] DELETE /compute/v2.1/servers/14e1e062-7b26-4e1f-85d5-1f411861bf00 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:14:19.517645 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-cb5e3c4c-d48c-4a59-86be-e3aa33c062c0 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:14:19.518672 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-cb5e3c4c-d48c-4a59-86be-e3aa33c062c0 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 14e1e062-7b26-4e1f-85d5-1f411861bf00] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:14:19.529701 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cb5e3c4c-d48c-4a59-86be-e3aa33c062c0 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:19.534481 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cb5e3c4c-d48c-4a59-86be-e3aa33c062c0 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:19.534481 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cb5e3c4c-d48c-4a59-86be-e3aa33c062c0 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:19.534481 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cb5e3c4c-d48c-4a59-86be-e3aa33c062c0 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:19.534481 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cb5e3c4c-d48c-4a59-86be-e3aa33c062c0 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:19.534481 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cb5e3c4c-d48c-4a59-86be-e3aa33c062c0 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:19.705365 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-cb5e3c4c-d48c-4a59-86be-e3aa33c062c0 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3060cdc6eeba47288205e107717a6980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a841124bf4392b54c3d6b0ea37e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:14:19.719208 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-cb5e3c4c-d48c-4a59-86be-e3aa33c062c0 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "GET /compute/v2.1/servers/14e1e062-7b26-4e1f-85d5-1f411861bf00" status: 200 len: 1676 microversion: 2.1 time: 0.203108 Oct 04 19:14:19.720446 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3459/6935] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:14:19 2022] GET /compute/v2.1/servers/14e1e062-7b26-4e1f-85d5-1f411861bf00 => generated 1676 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:14:20.747091 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c2426739-b7db-4028-ad8a-9265d59a75ad tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:14:20.751169 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c2426739-b7db-4028-ad8a-9265d59a75ad tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 14e1e062-7b26-4e1f-85d5-1f411861bf00] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:14:20.758447 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c2426739-b7db-4028-ad8a-9265d59a75ad tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:20.758947 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c2426739-b7db-4028-ad8a-9265d59a75ad tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:20.759389 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c2426739-b7db-4028-ad8a-9265d59a75ad tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:20.760123 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c2426739-b7db-4028-ad8a-9265d59a75ad tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:20.760621 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c2426739-b7db-4028-ad8a-9265d59a75ad tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:20.761053 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c2426739-b7db-4028-ad8a-9265d59a75ad tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:21.248780 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c2426739-b7db-4028-ad8a-9265d59a75ad tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3060cdc6eeba47288205e107717a6980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a841124bf4392b54c3d6b0ea37e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:14:21.258010 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c2426739-b7db-4028-ad8a-9265d59a75ad tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "GET /compute/v2.1/servers/14e1e062-7b26-4e1f-85d5-1f411861bf00" status: 200 len: 1676 microversion: 2.1 time: 0.518062 Oct 04 19:14:21.259066 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3477/6936] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:14:20 2022] GET /compute/v2.1/servers/14e1e062-7b26-4e1f-85d5-1f411861bf00 => generated 1676 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:14:22.282938 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-af0197a1-3cdc-4af8-9da7-4800a1c3f9be tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:14:22.283536 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-af0197a1-3cdc-4af8-9da7-4800a1c3f9be tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 14e1e062-7b26-4e1f-85d5-1f411861bf00] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:14:22.292602 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-af0197a1-3cdc-4af8-9da7-4800a1c3f9be tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:22.293135 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-af0197a1-3cdc-4af8-9da7-4800a1c3f9be tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:22.293610 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-af0197a1-3cdc-4af8-9da7-4800a1c3f9be tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:22.294323 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-af0197a1-3cdc-4af8-9da7-4800a1c3f9be tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:22.294791 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-af0197a1-3cdc-4af8-9da7-4800a1c3f9be tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:22.295227 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-af0197a1-3cdc-4af8-9da7-4800a1c3f9be tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:22.458850 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-af0197a1-3cdc-4af8-9da7-4800a1c3f9be tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3060cdc6eeba47288205e107717a6980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a841124bf4392b54c3d6b0ea37e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:14:22.471444 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-af0197a1-3cdc-4af8-9da7-4800a1c3f9be tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "GET /compute/v2.1/servers/14e1e062-7b26-4e1f-85d5-1f411861bf00" status: 200 len: 1676 microversion: 2.1 time: 0.192286 Oct 04 19:14:22.472904 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3460/6937] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:14:22 2022] GET /compute/v2.1/servers/14e1e062-7b26-4e1f-85d5-1f411861bf00 => generated 1676 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:14:22.710503 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-a87ac64c-9313-482f-8967-7bfc30296708 req-bc30598d-eaa4-4721-83f5-15fad6e42357 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14e1e062-7b26-4e1f-85d5-1f411861bf00", "name": "network-vif-deleted", "tag": "1f26a8ff-7bbd-4d48-adc8-5202ee86eb8a"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:14:22.723041 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-a87ac64c-9313-482f-8967-7bfc30296708 req-bc30598d-eaa4-4721-83f5-15fad6e42357 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:22.726879 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-a87ac64c-9313-482f-8967-7bfc30296708 req-bc30598d-eaa4-4721-83f5-15fad6e42357 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:22.726879 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-a87ac64c-9313-482f-8967-7bfc30296708 req-bc30598d-eaa4-4721-83f5-15fad6e42357 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:22.736488 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-a87ac64c-9313-482f-8967-7bfc30296708 req-bc30598d-eaa4-4721-83f5-15fad6e42357 service nova] Creating event network-vif-deleted:1f26a8ff-7bbd-4d48-adc8-5202ee86eb8a for instance 14e1e062-7b26-4e1f-85d5-1f411861bf00 on n-h2-850501-14 Oct 04 19:14:22.742215 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-a87ac64c-9313-482f-8967-7bfc30296708 req-bc30598d-eaa4-4721-83f5-15fad6e42357 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036375 Oct 04 19:14:22.753385 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3478/6938] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:14:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:14:23.495223 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-327162c4-57c7-4841-97bb-ab877ac2aa0b tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:14:23.495836 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-327162c4-57c7-4841-97bb-ab877ac2aa0b tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 14e1e062-7b26-4e1f-85d5-1f411861bf00] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:14:23.503761 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-327162c4-57c7-4841-97bb-ab877ac2aa0b tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:23.504521 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-327162c4-57c7-4841-97bb-ab877ac2aa0b tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:23.504973 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-327162c4-57c7-4841-97bb-ab877ac2aa0b tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:23.505686 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-327162c4-57c7-4841-97bb-ab877ac2aa0b tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:23.506151 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-327162c4-57c7-4841-97bb-ab877ac2aa0b tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:23.506589 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-327162c4-57c7-4841-97bb-ab877ac2aa0b tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:23.542065 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-327162c4-57c7-4841-97bb-ab877ac2aa0b tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:23.542728 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-327162c4-57c7-4841-97bb-ab877ac2aa0b tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:23.543384 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-327162c4-57c7-4841-97bb-ab877ac2aa0b tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:23.544080 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-327162c4-57c7-4841-97bb-ab877ac2aa0b tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lazy-loading 'fault' on Instance uuid 14e1e062-7b26-4e1f-85d5-1f411861bf00 {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:14:23.588771 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-327162c4-57c7-4841-97bb-ab877ac2aa0b tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3060cdc6eeba47288205e107717a6980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a841124bf4392b54c3d6b0ea37e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:14:23.597121 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-327162c4-57c7-4841-97bb-ab877ac2aa0b tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "GET /compute/v2.1/servers/14e1e062-7b26-4e1f-85d5-1f411861bf00" status: 200 len: 1328 microversion: 2.1 time: 0.105690 Oct 04 19:14:23.597976 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3461/6939] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:14:23 2022] GET /compute/v2.1/servers/14e1e062-7b26-4e1f-85d5-1f411861bf00 => generated 1328 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:14:24.628660 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5f040441-fef2-4df0-b91f-22678d4d137e tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:14:24.629434 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5f040441-fef2-4df0-b91f-22678d4d137e tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 14e1e062-7b26-4e1f-85d5-1f411861bf00] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:14:24.635701 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5f040441-fef2-4df0-b91f-22678d4d137e tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:24.636224 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5f040441-fef2-4df0-b91f-22678d4d137e tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:24.636657 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5f040441-fef2-4df0-b91f-22678d4d137e tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:24.637374 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5f040441-fef2-4df0-b91f-22678d4d137e tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:24.637834 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5f040441-fef2-4df0-b91f-22678d4d137e tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:24.638320 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5f040441-fef2-4df0-b91f-22678d4d137e tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:24.653388 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-5f040441-fef2-4df0-b91f-22678d4d137e tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] HTTP exception thrown: Instance 14e1e062-7b26-4e1f-85d5-1f411861bf00 could not be found. Oct 04 19:14:24.657502 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5f040441-fef2-4df0-b91f-22678d4d137e tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Request method failure captured: Oct 04 19:14:24.657502 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/14e1e062-7b26-4e1f-85d5-1f411861bf00 HTTP/1.1 Oct 04 19:14:24.657502 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 19:14:24.657502 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 19:14:24.657502 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 19:14:24.657502 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 19:14:24.657502 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 19:14:24.657502 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 19:14:24.657502 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 19:14:24.657502 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 19:14:24.657502 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPIR4RY9D0k3JGqvsFlPIJiO2GKRONAQgqGmODvMCOD8pxLqdH79NOBzOUVnaiWjB0CvX_9w-IyvJLz24OI4vc9QZU7Ze8neG2w1RXO6mxcRXo9bs0JfQh9QOpTjfxlnebgXPwVJzuu-bco9w-K49uAGLDR5t7_-D5ubBap_WvMYT-VY Oct 04 19:14:24.657502 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 19:14:24.657502 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 19:14:24.657502 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 19:14:24.657502 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 19:14:24.657502 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 19:14:24.657502 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 19:14:24.657502 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 4e0a841124bf4392b54c3d6b0ea37e11 Oct 04 19:14:24.657502 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-AttachVolumeTestJSON-830715248 Oct 04 19:14:24.657502 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 19:14:24.657502 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 19:14:24.657502 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4e0a841124bf4392b54c3d6b0ea37e11"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4e0a841124bf4392b54c3d6b0ea37e11", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4e0a841124bf4392b54c3d6b0ea37e11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4e0a841124bf4392b54c3d6b0ea37e11"}]}] Oct 04 19:14:24.657502 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-AttachVolumeTestJSON-830715248 Oct 04 19:14:24.657502 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 4e0a841124bf4392b54c3d6b0ea37e11 Oct 04 19:14:24.657502 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-AttachVolumeTestJSON-830715248 Oct 04 19:14:24.657502 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-AttachVolumeTestJSON-830715248-project Oct 04 19:14:24.657502 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 19:14:24.657502 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 19:14:24.657502 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 3060cdc6eeba47288205e107717a6980 Oct 04 19:14:24.657502 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-AttachVolumeTestJSON-830715248-project Oct 04 19:14:24.657502 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 19:14:24.657502 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 14e1e062-7b26-4e1f-85d5-1f411861bf00 could not be found. Oct 04 19:14:24.657502 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '14e1e062-7b26-4e1f-85d5-1f411861bf00'} Oct 04 19:14:24.657502 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:14:24.657502 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:14:24.657502 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:14:24.657502 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:14:24.657502 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:14:24.657502 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:14:24.657502 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:14:24.657502 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:14:24.657502 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:14:24.657502 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:14:24.657502 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14e1e062-7b26-4e1f-85d5-1f411861bf00 could not be found. Oct 04 19:14:24.657502 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:14:24.657502 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:14:24.657502 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:14:24.657502 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:14:24.657502 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:14:24.657502 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:14:24.657502 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:14:24.657502 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:14:24.657502 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:14:24.657502 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:14:24.657502 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:14:24.657502 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:14:24.657502 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:14:24.657502 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:14:24.657502 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:14:24.657502 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:14:24.657502 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14e1e062-7b26-4e1f-85d5-1f411861bf00 could not be found. Oct 04 19:14:24.657502 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:14:24.657502 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:14:24.657502 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:14:24.662669 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:14:24.662669 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:14:24.662669 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:14:24.662669 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:14:24.662669 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:14:24.662669 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14e1e062-7b26-4e1f-85d5-1f411861bf00 could not be found. Oct 04 19:14:24.662669 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:14:24.662669 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5f040441-fef2-4df0-b91f-22678d4d137e tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Returning 404 to user: Instance 14e1e062-7b26-4e1f-85d5-1f411861bf00 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:14:24.662669 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5f040441-fef2-4df0-b91f-22678d4d137e tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "GET /compute/v2.1/servers/14e1e062-7b26-4e1f-85d5-1f411861bf00" status: 404 len: 111 microversion: 2.1 time: 0.033742 Oct 04 19:14:24.662669 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3479/6940] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:14:24 2022] GET /compute/v2.1/servers/14e1e062-7b26-4e1f-85d5-1f411861bf00 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:14:24.665481 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7286f0f6-9743-4bda-8568-3903b1d903af tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Calling method '.version_select at 0x7fe259ae75e0>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:14:24.811646 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7286f0f6-9743-4bda-8568-3903b1d903af tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1926895545" status: 202 len: 0 microversion: 2.1 time: 0.149854 Oct 04 19:14:24.812364 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3462/6941] 10.222.0.20 () {58 vars in 1221 bytes} [Tue Oct 4 19:14:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1926895545 => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:14:33.542035 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-807058c0-37b6-435a-afaf-f235cd3cad67 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:14:33.542652 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-807058c0-37b6-435a-afaf-f235cd3cad67 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 14e1e062-7b26-4e1f-85d5-1f411861bf00] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:14:33.549671 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-807058c0-37b6-435a-afaf-f235cd3cad67 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:33.550240 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-807058c0-37b6-435a-afaf-f235cd3cad67 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:33.551406 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-807058c0-37b6-435a-afaf-f235cd3cad67 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:33.552331 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-807058c0-37b6-435a-afaf-f235cd3cad67 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:33.552809 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-807058c0-37b6-435a-afaf-f235cd3cad67 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:33.553244 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-807058c0-37b6-435a-afaf-f235cd3cad67 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:33.567928 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-807058c0-37b6-435a-afaf-f235cd3cad67 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] HTTP exception thrown: Instance 14e1e062-7b26-4e1f-85d5-1f411861bf00 could not be found. Oct 04 19:14:33.569595 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-807058c0-37b6-435a-afaf-f235cd3cad67 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Request method failure captured: Oct 04 19:14:33.569595 n-d-850501-14 devstack@n-api.service[123001]: request: DELETE /compute/v2.1/servers/14e1e062-7b26-4e1f-85d5-1f411861bf00 HTTP/1.1 Oct 04 19:14:33.569595 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 19:14:33.569595 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 19:14:33.569595 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 19:14:33.569595 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 19:14:33.569595 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 19:14:33.569595 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 19:14:33.569595 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 19:14:33.569595 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 19:14:33.569595 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPIR4RY9D0k3JGqvsFlPIJiO2GKRONAQgqGmODvMCOD8pxLqdH79NOBzOUVnaiWjB0CvX_9w-IyvJLz24OI4vc9QZU7Ze8neG2w1RXO6mxcRXo9bs0JfQh9QOpTjfxlnebgXPwVJzuu-bco9w-K49uAGLDR5t7_-D5ubBap_WvMYT-VY Oct 04 19:14:33.569595 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 19:14:33.569595 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 19:14:33.569595 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 19:14:33.569595 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 19:14:33.569595 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 19:14:33.569595 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 19:14:33.569595 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 4e0a841124bf4392b54c3d6b0ea37e11 Oct 04 19:14:33.569595 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-AttachVolumeTestJSON-830715248 Oct 04 19:14:33.569595 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 19:14:33.569595 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 19:14:33.569595 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4e0a841124bf4392b54c3d6b0ea37e11"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4e0a841124bf4392b54c3d6b0ea37e11", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4e0a841124bf4392b54c3d6b0ea37e11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4e0a841124bf4392b54c3d6b0ea37e11"}]}] Oct 04 19:14:33.569595 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-AttachVolumeTestJSON-830715248 Oct 04 19:14:33.569595 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 4e0a841124bf4392b54c3d6b0ea37e11 Oct 04 19:14:33.569595 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-AttachVolumeTestJSON-830715248 Oct 04 19:14:33.569595 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-AttachVolumeTestJSON-830715248-project Oct 04 19:14:33.569595 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 19:14:33.569595 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 19:14:33.569595 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 3060cdc6eeba47288205e107717a6980 Oct 04 19:14:33.569595 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-AttachVolumeTestJSON-830715248-project Oct 04 19:14:33.569595 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 19:14:33.569595 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 14e1e062-7b26-4e1f-85d5-1f411861bf00 could not be found. Oct 04 19:14:33.569595 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '14e1e062-7b26-4e1f-85d5-1f411861bf00'} Oct 04 19:14:33.569595 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:14:33.569595 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:14:33.569595 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:14:33.569595 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:14:33.569595 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:14:33.569595 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:14:33.569595 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:14:33.569595 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:14:33.569595 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:14:33.569595 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:14:33.569595 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14e1e062-7b26-4e1f-85d5-1f411861bf00 could not be found. Oct 04 19:14:33.569595 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:14:33.569595 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:14:33.569595 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:14:33.569595 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:14:33.569595 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:14:33.569595 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:14:33.569595 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:14:33.569595 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:14:33.569595 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:14:33.569595 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:14:33.569595 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 19:14:33.569595 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 19:14:33.569595 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 19:14:33.569595 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 19:14:33.569595 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:14:33.569595 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:14:33.569595 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:14:33.569595 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:14:33.574342 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14e1e062-7b26-4e1f-85d5-1f411861bf00 could not be found. Oct 04 19:14:33.574342 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:14:33.574342 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:14:33.574342 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:14:33.574342 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:14:33.574342 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:14:33.574342 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:14:33.574342 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:14:33.574342 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:14:33.574342 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14e1e062-7b26-4e1f-85d5-1f411861bf00 could not be found. Oct 04 19:14:33.574342 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:14:33.574342 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-807058c0-37b6-435a-afaf-f235cd3cad67 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Returning 404 to user: Instance 14e1e062-7b26-4e1f-85d5-1f411861bf00 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:14:33.574342 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-807058c0-37b6-435a-afaf-f235cd3cad67 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "DELETE /compute/v2.1/servers/14e1e062-7b26-4e1f-85d5-1f411861bf00" status: 404 len: 111 microversion: 2.1 time: 0.032921 Oct 04 19:14:33.574342 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3480/6942] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 19:14:33 2022] DELETE /compute/v2.1/servers/14e1e062-7b26-4e1f-85d5-1f411861bf00 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:14:33.580880 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7b3abec2-b659-4bce-9df3-9be24436724a tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:14:33.581531 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7b3abec2-b659-4bce-9df3-9be24436724a tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 14e1e062-7b26-4e1f-85d5-1f411861bf00] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:14:33.591750 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7b3abec2-b659-4bce-9df3-9be24436724a tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:33.592324 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7b3abec2-b659-4bce-9df3-9be24436724a tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:33.592787 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7b3abec2-b659-4bce-9df3-9be24436724a tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:33.593522 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7b3abec2-b659-4bce-9df3-9be24436724a tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:33.593997 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7b3abec2-b659-4bce-9df3-9be24436724a tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:33.594443 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7b3abec2-b659-4bce-9df3-9be24436724a tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:33.595102 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=26 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:14:33.611371 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-7b3abec2-b659-4bce-9df3-9be24436724a tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] HTTP exception thrown: Instance 14e1e062-7b26-4e1f-85d5-1f411861bf00 could not be found. Oct 04 19:14:33.613988 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7b3abec2-b659-4bce-9df3-9be24436724a tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Request method failure captured: Oct 04 19:14:33.613988 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/14e1e062-7b26-4e1f-85d5-1f411861bf00 HTTP/1.1 Oct 04 19:14:33.613988 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 19:14:33.613988 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 19:14:33.613988 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 19:14:33.613988 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 19:14:33.613988 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 19:14:33.613988 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 19:14:33.613988 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 19:14:33.613988 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 19:14:33.613988 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPIR4RY9D0k3JGqvsFlPIJiO2GKRONAQgqGmODvMCOD8pxLqdH79NOBzOUVnaiWjB0CvX_9w-IyvJLz24OI4vc9QZU7Ze8neG2w1RXO6mxcRXo9bs0JfQh9QOpTjfxlnebgXPwVJzuu-bco9w-K49uAGLDR5t7_-D5ubBap_WvMYT-VY Oct 04 19:14:33.613988 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 19:14:33.613988 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 19:14:33.613988 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 19:14:33.613988 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 19:14:33.613988 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 19:14:33.613988 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 19:14:33.613988 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 4e0a841124bf4392b54c3d6b0ea37e11 Oct 04 19:14:33.613988 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-AttachVolumeTestJSON-830715248 Oct 04 19:14:33.613988 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 19:14:33.613988 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 19:14:33.613988 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4e0a841124bf4392b54c3d6b0ea37e11"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4e0a841124bf4392b54c3d6b0ea37e11", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4e0a841124bf4392b54c3d6b0ea37e11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4e0a841124bf4392b54c3d6b0ea37e11"}]}] Oct 04 19:14:33.613988 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-AttachVolumeTestJSON-830715248 Oct 04 19:14:33.613988 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 4e0a841124bf4392b54c3d6b0ea37e11 Oct 04 19:14:33.613988 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-AttachVolumeTestJSON-830715248 Oct 04 19:14:33.613988 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-AttachVolumeTestJSON-830715248-project Oct 04 19:14:33.613988 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 19:14:33.613988 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 19:14:33.613988 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 3060cdc6eeba47288205e107717a6980 Oct 04 19:14:33.613988 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-AttachVolumeTestJSON-830715248-project Oct 04 19:14:33.613988 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 19:14:33.613988 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 14e1e062-7b26-4e1f-85d5-1f411861bf00 could not be found. Oct 04 19:14:33.613988 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '14e1e062-7b26-4e1f-85d5-1f411861bf00'} Oct 04 19:14:33.613988 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:14:33.613988 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:14:33.613988 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:14:33.613988 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:14:33.613988 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:14:33.613988 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:14:33.613988 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:14:33.613988 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:14:33.613988 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:14:33.613988 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:14:33.613988 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14e1e062-7b26-4e1f-85d5-1f411861bf00 could not be found. Oct 04 19:14:33.613988 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:14:33.613988 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:14:33.613988 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:14:33.613988 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:14:33.613988 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:14:33.613988 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:14:33.613988 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:14:33.613988 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:14:33.613988 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:14:33.613988 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:14:33.613988 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:14:33.613988 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:14:33.613988 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:14:33.613988 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:14:33.613988 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:14:33.613988 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:14:33.613988 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14e1e062-7b26-4e1f-85d5-1f411861bf00 could not be found. Oct 04 19:14:33.613988 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:14:33.613988 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:14:33.613988 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:14:33.621436 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:14:33.621436 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:14:33.621436 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:14:33.621436 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:14:33.621436 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:14:33.621436 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14e1e062-7b26-4e1f-85d5-1f411861bf00 could not be found. Oct 04 19:14:33.621436 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:14:33.621436 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7b3abec2-b659-4bce-9df3-9be24436724a tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Returning 404 to user: Instance 14e1e062-7b26-4e1f-85d5-1f411861bf00 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:14:33.621436 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7b3abec2-b659-4bce-9df3-9be24436724a tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "GET /compute/v2.1/servers/14e1e062-7b26-4e1f-85d5-1f411861bf00" status: 404 len: 111 microversion: 2.1 time: 0.040653 Oct 04 19:14:33.621436 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3463/6943] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:14:33 2022] GET /compute/v2.1/servers/14e1e062-7b26-4e1f-85d5-1f411861bf00 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 19:14:38.121159 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6f129296-284a-4c25-997d-35730a1dfd39 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:14:38.121668 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6f129296-284a-4c25-997d-35730a1dfd39 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 2646dfcb-7213-4870-99eb-68311662d66b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:14:38.129983 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6f129296-284a-4c25-997d-35730a1dfd39 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:38.130467 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6f129296-284a-4c25-997d-35730a1dfd39 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:38.130901 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6f129296-284a-4c25-997d-35730a1dfd39 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:38.131610 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6f129296-284a-4c25-997d-35730a1dfd39 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:38.132083 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6f129296-284a-4c25-997d-35730a1dfd39 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:38.133432 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6f129296-284a-4c25-997d-35730a1dfd39 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:38.148844 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-6f129296-284a-4c25-997d-35730a1dfd39 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] HTTP exception thrown: Instance 2646dfcb-7213-4870-99eb-68311662d66b could not be found. Oct 04 19:14:38.150522 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6f129296-284a-4c25-997d-35730a1dfd39 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Request method failure captured: Oct 04 19:14:38.150522 n-d-850501-14 devstack@n-api.service[123001]: request: DELETE /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b HTTP/1.1 Oct 04 19:14:38.150522 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 19:14:38.150522 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 19:14:38.150522 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 19:14:38.150522 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 19:14:38.150522 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 19:14:38.150522 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 19:14:38.150522 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 19:14:38.150522 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 19:14:38.150522 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPIR4RY9D0k3JGqvsFlPIJiO2GKRONAQgqGmODvMCOD8pxLqdH79NOBzOUVnaiWjB0CvX_9w-IyvJLz24OI4vc9QZU7Ze8neG2w1RXO6mxcRXo9bs0JfQh9QOpTjfxlnebgXPwVJzuu-bco9w-K49uAGLDR5t7_-D5ubBap_WvMYT-VY Oct 04 19:14:38.150522 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 19:14:38.150522 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 19:14:38.150522 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 19:14:38.150522 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 19:14:38.150522 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 19:14:38.150522 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 19:14:38.150522 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 4e0a841124bf4392b54c3d6b0ea37e11 Oct 04 19:14:38.150522 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-AttachVolumeTestJSON-830715248 Oct 04 19:14:38.150522 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 19:14:38.150522 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 19:14:38.150522 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4e0a841124bf4392b54c3d6b0ea37e11"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4e0a841124bf4392b54c3d6b0ea37e11", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4e0a841124bf4392b54c3d6b0ea37e11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4e0a841124bf4392b54c3d6b0ea37e11"}]}] Oct 04 19:14:38.150522 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-AttachVolumeTestJSON-830715248 Oct 04 19:14:38.150522 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 4e0a841124bf4392b54c3d6b0ea37e11 Oct 04 19:14:38.150522 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-AttachVolumeTestJSON-830715248 Oct 04 19:14:38.150522 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-AttachVolumeTestJSON-830715248-project Oct 04 19:14:38.150522 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 19:14:38.150522 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 19:14:38.150522 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 3060cdc6eeba47288205e107717a6980 Oct 04 19:14:38.150522 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-AttachVolumeTestJSON-830715248-project Oct 04 19:14:38.150522 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 19:14:38.150522 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 2646dfcb-7213-4870-99eb-68311662d66b could not be found. Oct 04 19:14:38.150522 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '2646dfcb-7213-4870-99eb-68311662d66b'} Oct 04 19:14:38.150522 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:14:38.150522 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:14:38.150522 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:14:38.150522 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:14:38.150522 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:14:38.150522 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:14:38.150522 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:14:38.150522 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:14:38.150522 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:14:38.150522 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:14:38.150522 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2646dfcb-7213-4870-99eb-68311662d66b could not be found. Oct 04 19:14:38.150522 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:14:38.150522 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:14:38.150522 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:14:38.150522 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:14:38.150522 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:14:38.150522 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:14:38.150522 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:14:38.150522 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:14:38.150522 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:14:38.150522 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:14:38.150522 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 19:14:38.150522 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 19:14:38.150522 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 19:14:38.150522 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 19:14:38.150522 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:14:38.150522 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:14:38.150522 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:14:38.150522 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:14:38.156934 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2646dfcb-7213-4870-99eb-68311662d66b could not be found. Oct 04 19:14:38.156934 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:14:38.156934 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:14:38.156934 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:14:38.156934 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:14:38.156934 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:14:38.156934 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:14:38.156934 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:14:38.156934 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:14:38.156934 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2646dfcb-7213-4870-99eb-68311662d66b could not be found. Oct 04 19:14:38.156934 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:14:38.156934 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6f129296-284a-4c25-997d-35730a1dfd39 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Returning 404 to user: Instance 2646dfcb-7213-4870-99eb-68311662d66b could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:14:38.156934 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6f129296-284a-4c25-997d-35730a1dfd39 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b" status: 404 len: 111 microversion: 2.1 time: 0.035197 Oct 04 19:14:38.156934 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3481/6944] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 19:14:38 2022] DELETE /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:14:38.164930 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-fe4c43fc-29f8-4455-9bc4-b30bb8e18757 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:14:38.165620 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-fe4c43fc-29f8-4455-9bc4-b30bb8e18757 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] [instance: 2646dfcb-7213-4870-99eb-68311662d66b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:14:38.182209 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fe4c43fc-29f8-4455-9bc4-b30bb8e18757 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:38.192024 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fe4c43fc-29f8-4455-9bc4-b30bb8e18757 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:38.192024 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fe4c43fc-29f8-4455-9bc4-b30bb8e18757 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:38.192024 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fe4c43fc-29f8-4455-9bc4-b30bb8e18757 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:38.192024 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fe4c43fc-29f8-4455-9bc4-b30bb8e18757 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:38.192024 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fe4c43fc-29f8-4455-9bc4-b30bb8e18757 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:38.202260 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-fe4c43fc-29f8-4455-9bc4-b30bb8e18757 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] HTTP exception thrown: Instance 2646dfcb-7213-4870-99eb-68311662d66b could not be found. Oct 04 19:14:38.203852 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-fe4c43fc-29f8-4455-9bc4-b30bb8e18757 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Request method failure captured: Oct 04 19:14:38.203852 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b HTTP/1.1 Oct 04 19:14:38.203852 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 19:14:38.203852 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 19:14:38.203852 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 19:14:38.203852 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 19:14:38.203852 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 19:14:38.203852 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 19:14:38.203852 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 19:14:38.203852 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 19:14:38.203852 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPIR4RY9D0k3JGqvsFlPIJiO2GKRONAQgqGmODvMCOD8pxLqdH79NOBzOUVnaiWjB0CvX_9w-IyvJLz24OI4vc9QZU7Ze8neG2w1RXO6mxcRXo9bs0JfQh9QOpTjfxlnebgXPwVJzuu-bco9w-K49uAGLDR5t7_-D5ubBap_WvMYT-VY Oct 04 19:14:38.203852 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 19:14:38.203852 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 19:14:38.203852 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 19:14:38.203852 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 19:14:38.203852 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 19:14:38.203852 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 19:14:38.203852 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 4e0a841124bf4392b54c3d6b0ea37e11 Oct 04 19:14:38.203852 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-AttachVolumeTestJSON-830715248 Oct 04 19:14:38.203852 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 19:14:38.203852 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 19:14:38.203852 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4e0a841124bf4392b54c3d6b0ea37e11"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4e0a841124bf4392b54c3d6b0ea37e11", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4e0a841124bf4392b54c3d6b0ea37e11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4e0a841124bf4392b54c3d6b0ea37e11"}]}] Oct 04 19:14:38.203852 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-AttachVolumeTestJSON-830715248 Oct 04 19:14:38.203852 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 4e0a841124bf4392b54c3d6b0ea37e11 Oct 04 19:14:38.203852 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-AttachVolumeTestJSON-830715248 Oct 04 19:14:38.203852 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-AttachVolumeTestJSON-830715248-project Oct 04 19:14:38.203852 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 19:14:38.203852 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 19:14:38.203852 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 3060cdc6eeba47288205e107717a6980 Oct 04 19:14:38.203852 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-AttachVolumeTestJSON-830715248-project Oct 04 19:14:38.203852 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 19:14:38.203852 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 2646dfcb-7213-4870-99eb-68311662d66b could not be found. Oct 04 19:14:38.203852 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '2646dfcb-7213-4870-99eb-68311662d66b'} Oct 04 19:14:38.203852 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:14:38.203852 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:14:38.203852 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:14:38.203852 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:14:38.203852 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:14:38.203852 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:14:38.203852 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:14:38.203852 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:14:38.203852 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:14:38.203852 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:14:38.203852 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2646dfcb-7213-4870-99eb-68311662d66b could not be found. Oct 04 19:14:38.203852 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:14:38.203852 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:14:38.203852 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:14:38.203852 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:14:38.203852 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:14:38.203852 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:14:38.203852 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:14:38.203852 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:14:38.203852 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:14:38.203852 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:14:38.203852 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:14:38.203852 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:14:38.203852 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:14:38.203852 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:14:38.203852 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:14:38.203852 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:14:38.203852 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2646dfcb-7213-4870-99eb-68311662d66b could not be found. Oct 04 19:14:38.203852 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:14:38.203852 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:14:38.203852 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:14:38.211375 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:14:38.211375 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:14:38.211375 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:14:38.211375 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:14:38.211375 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:14:38.211375 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2646dfcb-7213-4870-99eb-68311662d66b could not be found. Oct 04 19:14:38.211375 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:14:38.211375 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-fe4c43fc-29f8-4455-9bc4-b30bb8e18757 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] Returning 404 to user: Instance 2646dfcb-7213-4870-99eb-68311662d66b could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:14:38.211375 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-fe4c43fc-29f8-4455-9bc4-b30bb8e18757 tempest-AttachVolumeTestJSON-830715248 tempest-AttachVolumeTestJSON-830715248-project] 10.222.0.20 "GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b" status: 404 len: 111 microversion: 2.1 time: 0.048605 Oct 04 19:14:38.211375 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3464/6945] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:14:38 2022] GET /compute/v2.1/servers/2646dfcb-7213-4870-99eb-68311662d66b => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:16:37.096645 n-d-850501-14 devstack@n-api.service[123001]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c9febe7b-97ce-4695-9d92-17a0f76701f3] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 19:16:37.101759 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-65b50109-3d23-4812-be18-da83d66326bc tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:16:37.102791 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-65b50109-3d23-4812-be18-da83d66326bc tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: a5d743fc-bedb-41a3-9348-14b57739482d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:16:37.108367 n-d-850501-14 devstack@n-api.service[123002]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9c4ba655-a850-4726-8db9-cffc7e0e245e] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 19:16:37.110030 n-d-850501-14 devstack@n-api.service[123002]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d2b44dc8-447f-4d0a-9186-943d7552c0ea] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 19:16:37.114813 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-879dc8ca-75ce-4303-bb1f-015babb56ced req-c6477b00-c1d7-461d-a7b3-6980e9ec9d68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5d743fc-bedb-41a3-9348-14b57739482d", "tag": "b6571cb3-8371-4499-950b-18f12d9f8531"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:16:37.123114 n-d-850501-14 devstack@n-api.service[123001]: ERROR oslo.messaging._drivers.impl_rabbit [-] [642656d8-a7cd-470f-ae32-a85e45bb523d] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 19:16:37.124386 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:16:37.127256 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:16:37.131302 n-d-850501-14 devstack@n-api.service[123001]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:16:37.131805 n-d-850501-14 devstack@n-api.service[123001]: Tue Oct 4 19:16:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a5d743fc-bedb-41a3-9348-14b57739482d (ip 10.222.0.20) !!! Oct 04 19:16:37.137446 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=18,nova_api:DELETE=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:16:37.140516 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=4 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:16:37.144804 n-d-850501-14 devstack@n-api.service[123002]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 19:16:37.145213 n-d-850501-14 devstack@n-api.service[123002]: Tue Oct 4 19:16:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.20) !!! Oct 04 19:16:37.150291 n-d-850501-14 devstack@n-api.service[123002]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 19:16:37.150606 n-d-850501-14 devstack@n-api.service[123002]: Tue Oct 4 19:16:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.20) !!! Oct 04 19:16:37.154697 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-65b50109-3d23-4812-be18-da83d66326bc tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:37.155255 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-65b50109-3d23-4812-be18-da83d66326bc tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:37.155699 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-65b50109-3d23-4812-be18-da83d66326bc tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:37.156457 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-65b50109-3d23-4812-be18-da83d66326bc tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:37.156915 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-65b50109-3d23-4812-be18-da83d66326bc tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:37.157349 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-65b50109-3d23-4812-be18-da83d66326bc tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:37.158014 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-879dc8ca-75ce-4303-bb1f-015babb56ced req-c6477b00-c1d7-461d-a7b3-6980e9ec9d68 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:37.158759 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-879dc8ca-75ce-4303-bb1f-015babb56ced req-c6477b00-c1d7-461d-a7b3-6980e9ec9d68 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:37.159586 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-879dc8ca-75ce-4303-bb1f-015babb56ced req-c6477b00-c1d7-461d-a7b3-6980e9ec9d68 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:37.192709 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-879dc8ca-75ce-4303-bb1f-015babb56ced req-c6477b00-c1d7-461d-a7b3-6980e9ec9d68 service nova] Creating event network-changed:b6571cb3-8371-4499-950b-18f12d9f8531 for instance a5d743fc-bedb-41a3-9348-14b57739482d on n-h1-850501-14 Oct 04 19:16:37.192932 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-879dc8ca-75ce-4303-bb1f-015babb56ced req-c6477b00-c1d7-461d-a7b3-6980e9ec9d68 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086441 Oct 04 19:16:37.194023 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3465/6946] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:16:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:16:37.261927 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-65b50109-3d23-4812-be18-da83d66326bc tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: a5d743fc-bedb-41a3-9348-14b57739482d] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:16:37.734978 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-65b50109-3d23-4812-be18-da83d66326bc tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a5d743fc-bedb-41a3-9348-14b57739482d" status: 204 len: 0 microversion: 2.1 time: 0.641271 Oct 04 19:16:37.740542 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3482/6947] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 19:16:37 2022] DELETE /compute/v2.1/servers/a5d743fc-bedb-41a3-9348-14b57739482d => generated 0 bytes in 645 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:16:37.746392 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a7e538de-4ec4-4810-9d20-45ca5a15c7d4 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:16:37.747360 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a7e538de-4ec4-4810-9d20-45ca5a15c7d4 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: a5d743fc-bedb-41a3-9348-14b57739482d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:16:37.757560 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a7e538de-4ec4-4810-9d20-45ca5a15c7d4 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:37.758425 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a7e538de-4ec4-4810-9d20-45ca5a15c7d4 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:37.759195 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a7e538de-4ec4-4810-9d20-45ca5a15c7d4 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:37.760188 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a7e538de-4ec4-4810-9d20-45ca5a15c7d4 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:37.760902 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a7e538de-4ec4-4810-9d20-45ca5a15c7d4 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:37.761550 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a7e538de-4ec4-4810-9d20-45ca5a15c7d4 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:38.015224 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a7e538de-4ec4-4810-9d20-45ca5a15c7d4 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:16:38.033681 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a7e538de-4ec4-4810-9d20-45ca5a15c7d4 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/a5d743fc-bedb-41a3-9348-14b57739482d" status: 200 len: 1576 microversion: 2.1 time: 0.292353 Oct 04 19:16:38.034661 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3466/6948] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:16:37 2022] GET /compute/v2.1/servers/a5d743fc-bedb-41a3-9348-14b57739482d => generated 1576 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:16:39.059087 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f2f5f9c2-1746-422b-9ada-8e0f89848967 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:16:39.059814 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f2f5f9c2-1746-422b-9ada-8e0f89848967 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: a5d743fc-bedb-41a3-9348-14b57739482d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:16:39.070078 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f2f5f9c2-1746-422b-9ada-8e0f89848967 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:39.070505 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f2f5f9c2-1746-422b-9ada-8e0f89848967 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:39.070943 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f2f5f9c2-1746-422b-9ada-8e0f89848967 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:39.071722 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f2f5f9c2-1746-422b-9ada-8e0f89848967 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:39.072106 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f2f5f9c2-1746-422b-9ada-8e0f89848967 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:39.072549 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f2f5f9c2-1746-422b-9ada-8e0f89848967 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:39.078194 n-d-850501-14 devstack@n-api.service[123001]: INFO oslo.messaging._drivers.impl_rabbit [-] [c9febe7b-97ce-4695-9d92-17a0f76701f3] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 44134. Oct 04 19:16:39.081397 n-d-850501-14 devstack@n-api.service[123001]: INFO oslo.messaging._drivers.impl_rabbit [-] [642656d8-a7cd-470f-ae32-a85e45bb523d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 44136. Oct 04 19:16:39.307708 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f2f5f9c2-1746-422b-9ada-8e0f89848967 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:16:39.324467 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f2f5f9c2-1746-422b-9ada-8e0f89848967 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/a5d743fc-bedb-41a3-9348-14b57739482d" status: 200 len: 1576 microversion: 2.1 time: 0.269276 Oct 04 19:16:39.325225 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3483/6949] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:16:39 2022] GET /compute/v2.1/servers/a5d743fc-bedb-41a3-9348-14b57739482d => generated 1576 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:16:39.879623 n-d-850501-14 devstack@n-api.service[123002]: INFO oslo.messaging._drivers.impl_rabbit [-] [9c4ba655-a850-4726-8db9-cffc7e0e245e] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 44148. Oct 04 19:16:39.886967 n-d-850501-14 devstack@n-api.service[123002]: INFO oslo.messaging._drivers.impl_rabbit [-] [d2b44dc8-447f-4d0a-9186-943d7552c0ea] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 44150. Oct 04 19:16:40.140040 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-be453961-dca6-49d7-a919-81e20a62564c req-de93a6b7-eef3-44ee-bec0-197031ce00d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5d743fc-bedb-41a3-9348-14b57739482d", "name": "network-vif-deleted", "tag": "b6571cb3-8371-4499-950b-18f12d9f8531"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:16:40.156003 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-be453961-dca6-49d7-a919-81e20a62564c req-de93a6b7-eef3-44ee-bec0-197031ce00d2 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:40.156783 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-be453961-dca6-49d7-a919-81e20a62564c req-de93a6b7-eef3-44ee-bec0-197031ce00d2 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:40.157488 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-be453961-dca6-49d7-a919-81e20a62564c req-de93a6b7-eef3-44ee-bec0-197031ce00d2 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:40.170049 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-be453961-dca6-49d7-a919-81e20a62564c req-de93a6b7-eef3-44ee-bec0-197031ce00d2 service nova] Creating event network-vif-deleted:b6571cb3-8371-4499-950b-18f12d9f8531 for instance a5d743fc-bedb-41a3-9348-14b57739482d on n-h1-850501-14 Oct 04 19:16:40.176286 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-be453961-dca6-49d7-a919-81e20a62564c req-de93a6b7-eef3-44ee-bec0-197031ce00d2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.319489 Oct 04 19:16:40.176906 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3467/6950] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:16:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:16:40.350052 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b2a6ae79-41c9-48f5-b29c-e3b5648b57ae tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:16:40.351898 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b2a6ae79-41c9-48f5-b29c-e3b5648b57ae tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: a5d743fc-bedb-41a3-9348-14b57739482d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:16:40.360086 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b2a6ae79-41c9-48f5-b29c-e3b5648b57ae tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:40.360814 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b2a6ae79-41c9-48f5-b29c-e3b5648b57ae tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:40.361433 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b2a6ae79-41c9-48f5-b29c-e3b5648b57ae tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:40.362604 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b2a6ae79-41c9-48f5-b29c-e3b5648b57ae tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:40.363240 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b2a6ae79-41c9-48f5-b29c-e3b5648b57ae tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:40.363847 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b2a6ae79-41c9-48f5-b29c-e3b5648b57ae tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:40.446873 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b2a6ae79-41c9-48f5-b29c-e3b5648b57ae tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:16:40.459025 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b2a6ae79-41c9-48f5-b29c-e3b5648b57ae tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/a5d743fc-bedb-41a3-9348-14b57739482d" status: 200 len: 1225 microversion: 2.1 time: 0.113124 Oct 04 19:16:40.459761 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3484/6951] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:16:40 2022] GET /compute/v2.1/servers/a5d743fc-bedb-41a3-9348-14b57739482d => generated 1225 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:16:41.490962 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a018298d-6073-4b20-8e84-9f6e6e1254f5 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:16:41.491763 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a018298d-6073-4b20-8e84-9f6e6e1254f5 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: a5d743fc-bedb-41a3-9348-14b57739482d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:16:41.500929 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a018298d-6073-4b20-8e84-9f6e6e1254f5 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:41.501429 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a018298d-6073-4b20-8e84-9f6e6e1254f5 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:41.501882 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a018298d-6073-4b20-8e84-9f6e6e1254f5 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:41.502649 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a018298d-6073-4b20-8e84-9f6e6e1254f5 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:41.503117 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a018298d-6073-4b20-8e84-9f6e6e1254f5 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:41.503606 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a018298d-6073-4b20-8e84-9f6e6e1254f5 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:41.570252 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a018298d-6073-4b20-8e84-9f6e6e1254f5 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:16:41.579040 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a018298d-6073-4b20-8e84-9f6e6e1254f5 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/a5d743fc-bedb-41a3-9348-14b57739482d" status: 200 len: 1225 microversion: 2.1 time: 0.092817 Oct 04 19:16:41.580099 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3468/6952] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:16:41 2022] GET /compute/v2.1/servers/a5d743fc-bedb-41a3-9348-14b57739482d => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:16:42.604110 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7cab1996-4697-4529-995c-c09fc59a63ed tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:16:42.604733 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7cab1996-4697-4529-995c-c09fc59a63ed tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: a5d743fc-bedb-41a3-9348-14b57739482d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:16:42.612047 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7cab1996-4697-4529-995c-c09fc59a63ed tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:42.612565 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7cab1996-4697-4529-995c-c09fc59a63ed tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:42.613056 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7cab1996-4697-4529-995c-c09fc59a63ed tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:42.614038 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7cab1996-4697-4529-995c-c09fc59a63ed tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:42.614586 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7cab1996-4697-4529-995c-c09fc59a63ed tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:42.615029 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7cab1996-4697-4529-995c-c09fc59a63ed tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:42.682227 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7cab1996-4697-4529-995c-c09fc59a63ed tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:16:42.692028 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7cab1996-4697-4529-995c-c09fc59a63ed tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/a5d743fc-bedb-41a3-9348-14b57739482d" status: 200 len: 1225 microversion: 2.1 time: 0.091807 Oct 04 19:16:42.693184 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3485/6953] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:16:42 2022] GET /compute/v2.1/servers/a5d743fc-bedb-41a3-9348-14b57739482d => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:16:43.723992 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f1c994b5-1d0a-4682-84b8-d9c2e5440f61 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:16:43.728210 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f1c994b5-1d0a-4682-84b8-d9c2e5440f61 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: a5d743fc-bedb-41a3-9348-14b57739482d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:16:43.741635 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f1c994b5-1d0a-4682-84b8-d9c2e5440f61 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:43.742156 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f1c994b5-1d0a-4682-84b8-d9c2e5440f61 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:43.742765 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f1c994b5-1d0a-4682-84b8-d9c2e5440f61 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:43.746273 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f1c994b5-1d0a-4682-84b8-d9c2e5440f61 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:43.746766 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f1c994b5-1d0a-4682-84b8-d9c2e5440f61 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:43.747198 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f1c994b5-1d0a-4682-84b8-d9c2e5440f61 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:43.833037 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f1c994b5-1d0a-4682-84b8-d9c2e5440f61 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:16:43.847738 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f1c994b5-1d0a-4682-84b8-d9c2e5440f61 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/a5d743fc-bedb-41a3-9348-14b57739482d" status: 200 len: 1225 microversion: 2.1 time: 0.123955 Oct 04 19:16:43.847738 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3469/6954] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:16:43 2022] GET /compute/v2.1/servers/a5d743fc-bedb-41a3-9348-14b57739482d => generated 1225 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:16:44.872953 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-21389385-452e-42c2-9b35-c404ba1da4d7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:16:44.873966 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-21389385-452e-42c2-9b35-c404ba1da4d7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: a5d743fc-bedb-41a3-9348-14b57739482d] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:16:44.881464 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-21389385-452e-42c2-9b35-c404ba1da4d7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:44.882006 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-21389385-452e-42c2-9b35-c404ba1da4d7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:44.882447 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-21389385-452e-42c2-9b35-c404ba1da4d7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:44.883143 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-21389385-452e-42c2-9b35-c404ba1da4d7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:44.883622 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-21389385-452e-42c2-9b35-c404ba1da4d7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:44.884034 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-21389385-452e-42c2-9b35-c404ba1da4d7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:44.917938 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-21389385-452e-42c2-9b35-c404ba1da4d7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:44.918418 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-21389385-452e-42c2-9b35-c404ba1da4d7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:44.918850 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-21389385-452e-42c2-9b35-c404ba1da4d7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:44.919950 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-21389385-452e-42c2-9b35-c404ba1da4d7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lazy-loading 'fault' on Instance uuid a5d743fc-bedb-41a3-9348-14b57739482d {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:16:44.968255 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-21389385-452e-42c2-9b35-c404ba1da4d7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:16:44.976360 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-21389385-452e-42c2-9b35-c404ba1da4d7 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/a5d743fc-bedb-41a3-9348-14b57739482d" status: 200 len: 1230 microversion: 2.1 time: 0.108282 Oct 04 19:16:44.976777 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3486/6955] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:16:44 2022] GET /compute/v2.1/servers/a5d743fc-bedb-41a3-9348-14b57739482d => generated 1230 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:16:45.999355 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-06221ee1-c10e-409e-9c88-7534bcef69ec tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:16:46.000191 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-06221ee1-c10e-409e-9c88-7534bcef69ec tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: a5d743fc-bedb-41a3-9348-14b57739482d] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:16:46.015133 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-06221ee1-c10e-409e-9c88-7534bcef69ec tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:46.015652 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-06221ee1-c10e-409e-9c88-7534bcef69ec tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:46.016144 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-06221ee1-c10e-409e-9c88-7534bcef69ec tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:46.016876 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-06221ee1-c10e-409e-9c88-7534bcef69ec tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:46.017357 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-06221ee1-c10e-409e-9c88-7534bcef69ec tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:46.017929 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-06221ee1-c10e-409e-9c88-7534bcef69ec tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:46.037664 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-06221ee1-c10e-409e-9c88-7534bcef69ec tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] HTTP exception thrown: Instance a5d743fc-bedb-41a3-9348-14b57739482d could not be found. Oct 04 19:16:46.037664 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-06221ee1-c10e-409e-9c88-7534bcef69ec tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Request method failure captured: Oct 04 19:16:46.037664 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/a5d743fc-bedb-41a3-9348-14b57739482d HTTP/1.1 Oct 04 19:16:46.037664 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 19:16:46.037664 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 19:16:46.037664 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 19:16:46.037664 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 19:16:46.037664 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 19:16:46.037664 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 19:16:46.037664 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 19:16:46.037664 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 19:16:46.037664 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPIJ4KptPiy5XyaUYG9pLSP7TnMEf-PY7yFvjaPGmW4DAHqC1kasy1bm5to10RwAF_dSHQb87b5amqQ9ZUna6URZpq6M0BGpvwENg84W1HvOZfHgDXT7E6YYTtPhmcCZbmf-MEJzIKVI741HwGnmdHx846U9v3mpOw6zsk7UNEsUijp4 Oct 04 19:16:46.037664 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 19:16:46.037664 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 19:16:46.037664 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 19:16:46.037664 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 19:16:46.037664 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 19:16:46.037664 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 19:16:46.037664 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 82d0cd3db371459db429cb770abde738 Oct 04 19:16:46.037664 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-TestVolumeBootPattern-1621879949 Oct 04 19:16:46.037664 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 19:16:46.037664 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 19:16:46.037664 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/82d0cd3db371459db429cb770abde738"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_82d0cd3db371459db429cb770abde738", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/82d0cd3db371459db429cb770abde738"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/82d0cd3db371459db429cb770abde738"}]}] Oct 04 19:16:46.037664 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-TestVolumeBootPattern-1621879949 Oct 04 19:16:46.037664 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 82d0cd3db371459db429cb770abde738 Oct 04 19:16:46.037664 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-TestVolumeBootPattern-1621879949 Oct 04 19:16:46.037664 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-TestVolumeBootPattern-1621879949-project Oct 04 19:16:46.037664 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 19:16:46.037664 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 19:16:46.037664 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: a65ae9c3fb3c46a2a393fe21ce21b9d4 Oct 04 19:16:46.037664 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-TestVolumeBootPattern-1621879949-project Oct 04 19:16:46.037664 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 19:16:46.037664 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance a5d743fc-bedb-41a3-9348-14b57739482d could not be found. Oct 04 19:16:46.037664 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'a5d743fc-bedb-41a3-9348-14b57739482d'} Oct 04 19:16:46.037664 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:16:46.037664 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:16:46.037664 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:16:46.037664 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:16:46.037664 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:16:46.037664 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:16:46.037664 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:16:46.037664 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:16:46.037664 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:16:46.037664 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:16:46.037664 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5d743fc-bedb-41a3-9348-14b57739482d could not be found. Oct 04 19:16:46.037664 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:16:46.037664 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:16:46.037664 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:16:46.037664 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:16:46.037664 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:16:46.037664 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:16:46.037664 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:16:46.037664 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:16:46.037664 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:16:46.037664 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:16:46.037664 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:16:46.037664 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:16:46.037664 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:16:46.037664 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:16:46.037664 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:16:46.037664 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:16:46.043138 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5d743fc-bedb-41a3-9348-14b57739482d could not be found. Oct 04 19:16:46.043138 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:16:46.043138 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:16:46.043138 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:16:46.043138 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:16:46.043138 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:16:46.043138 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:16:46.043138 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:16:46.043138 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:16:46.043138 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5d743fc-bedb-41a3-9348-14b57739482d could not be found. Oct 04 19:16:46.043138 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:16:46.043138 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-06221ee1-c10e-409e-9c88-7534bcef69ec tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Returning 404 to user: Instance a5d743fc-bedb-41a3-9348-14b57739482d could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:16:46.043138 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-06221ee1-c10e-409e-9c88-7534bcef69ec tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/a5d743fc-bedb-41a3-9348-14b57739482d" status: 404 len: 111 microversion: 2.1 time: 0.041464 Oct 04 19:16:46.043138 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3470/6956] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:16:45 2022] GET /compute/v2.1/servers/a5d743fc-bedb-41a3-9348-14b57739482d => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:16:55.049164 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5304849a-60d7-4ab5-82a7-2fbb7c933a06 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:16:55.049704 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5304849a-60d7-4ab5-82a7-2fbb7c933a06 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 61421b3c-4c72-42c5-bbdc-793a4fb12b3e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:16:55.052460 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-d509995b-29fe-4128-9c86-cdeb77973e5c req-250dc29c-a697-47e1-b194-086f2336c039 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61421b3c-4c72-42c5-bbdc-793a4fb12b3e", "tag": "79b4a303-9155-4741-b15f-1a2d746a7a89"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:16:55.056770 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:16:55.057454 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:16:55.059026 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5304849a-60d7-4ab5-82a7-2fbb7c933a06 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:55.059684 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5304849a-60d7-4ab5-82a7-2fbb7c933a06 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:55.060324 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5304849a-60d7-4ab5-82a7-2fbb7c933a06 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:55.061751 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5304849a-60d7-4ab5-82a7-2fbb7c933a06 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:55.062588 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5304849a-60d7-4ab5-82a7-2fbb7c933a06 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:55.063196 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5304849a-60d7-4ab5-82a7-2fbb7c933a06 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:55.077447 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-d509995b-29fe-4128-9c86-cdeb77973e5c req-250dc29c-a697-47e1-b194-086f2336c039 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:55.078316 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-d509995b-29fe-4128-9c86-cdeb77973e5c req-250dc29c-a697-47e1-b194-086f2336c039 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:55.079426 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-d509995b-29fe-4128-9c86-cdeb77973e5c req-250dc29c-a697-47e1-b194-086f2336c039 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:55.099825 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5304849a-60d7-4ab5-82a7-2fbb7c933a06 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 61421b3c-4c72-42c5-bbdc-793a4fb12b3e] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:16:55.104793 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-d509995b-29fe-4128-9c86-cdeb77973e5c req-250dc29c-a697-47e1-b194-086f2336c039 service nova] Creating event network-changed:79b4a303-9155-4741-b15f-1a2d746a7a89 for instance 61421b3c-4c72-42c5-bbdc-793a4fb12b3e on n-h1-850501-14 Oct 04 19:16:55.110904 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-d509995b-29fe-4128-9c86-cdeb77973e5c req-250dc29c-a697-47e1-b194-086f2336c039 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062239 Oct 04 19:16:55.113384 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3471/6957] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:16:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:16:55.448962 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5304849a-60d7-4ab5-82a7-2fbb7c933a06 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "DELETE /compute/v2.1/servers/61421b3c-4c72-42c5-bbdc-793a4fb12b3e" status: 204 len: 0 microversion: 2.1 time: 0.403719 Oct 04 19:16:55.450262 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3487/6958] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 19:16:55 2022] DELETE /compute/v2.1/servers/61421b3c-4c72-42c5-bbdc-793a4fb12b3e => generated 0 bytes in 406 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:16:55.460469 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-75a92051-0bc0-454f-a74a-fcff9da8b8b8 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:16:55.461475 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-75a92051-0bc0-454f-a74a-fcff9da8b8b8 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 61421b3c-4c72-42c5-bbdc-793a4fb12b3e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:16:55.468994 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-75a92051-0bc0-454f-a74a-fcff9da8b8b8 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:55.469815 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-75a92051-0bc0-454f-a74a-fcff9da8b8b8 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:55.470265 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-75a92051-0bc0-454f-a74a-fcff9da8b8b8 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:55.471176 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-75a92051-0bc0-454f-a74a-fcff9da8b8b8 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:55.471847 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-75a92051-0bc0-454f-a74a-fcff9da8b8b8 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:55.472525 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-75a92051-0bc0-454f-a74a-fcff9da8b8b8 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:55.660849 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-75a92051-0bc0-454f-a74a-fcff9da8b8b8 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:16:55.669875 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-75a92051-0bc0-454f-a74a-fcff9da8b8b8 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/61421b3c-4c72-42c5-bbdc-793a4fb12b3e" status: 200 len: 1575 microversion: 2.1 time: 0.215248 Oct 04 19:16:55.671831 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3472/6959] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:16:55 2022] GET /compute/v2.1/servers/61421b3c-4c72-42c5-bbdc-793a4fb12b3e => generated 1575 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:16:56.697407 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-50455063-823c-4d59-90ea-787066be143b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:16:56.698139 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-50455063-823c-4d59-90ea-787066be143b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 61421b3c-4c72-42c5-bbdc-793a4fb12b3e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:16:56.705929 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-50455063-823c-4d59-90ea-787066be143b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:56.706737 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-50455063-823c-4d59-90ea-787066be143b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:56.707356 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-50455063-823c-4d59-90ea-787066be143b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:56.708439 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-50455063-823c-4d59-90ea-787066be143b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:56.709098 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-50455063-823c-4d59-90ea-787066be143b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:56.737174 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-50455063-823c-4d59-90ea-787066be143b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:56.849267 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-50455063-823c-4d59-90ea-787066be143b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:16:56.860537 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-50455063-823c-4d59-90ea-787066be143b tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/61421b3c-4c72-42c5-bbdc-793a4fb12b3e" status: 200 len: 1390 microversion: 2.1 time: 0.167346 Oct 04 19:16:56.861256 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3488/6960] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:16:56 2022] GET /compute/v2.1/servers/61421b3c-4c72-42c5-bbdc-793a4fb12b3e => generated 1390 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:16:57.130413 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-1fc994ba-bcbb-41b6-a71a-61d33ee838d4 req-817dc6e9-9a39-489e-a894-d8e999ec21e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61421b3c-4c72-42c5-bbdc-793a4fb12b3e", "name": "network-vif-deleted", "tag": "79b4a303-9155-4741-b15f-1a2d746a7a89"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:16:57.143155 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-1fc994ba-bcbb-41b6-a71a-61d33ee838d4 req-817dc6e9-9a39-489e-a894-d8e999ec21e7 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:57.144353 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-1fc994ba-bcbb-41b6-a71a-61d33ee838d4 req-817dc6e9-9a39-489e-a894-d8e999ec21e7 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:57.145054 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-1fc994ba-bcbb-41b6-a71a-61d33ee838d4 req-817dc6e9-9a39-489e-a894-d8e999ec21e7 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:57.163702 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-1fc994ba-bcbb-41b6-a71a-61d33ee838d4 req-817dc6e9-9a39-489e-a894-d8e999ec21e7 service nova] Creating event network-vif-deleted:79b4a303-9155-4741-b15f-1a2d746a7a89 for instance 61421b3c-4c72-42c5-bbdc-793a4fb12b3e on n-h1-850501-14 Oct 04 19:16:57.179937 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-1fc994ba-bcbb-41b6-a71a-61d33ee838d4 req-817dc6e9-9a39-489e-a894-d8e999ec21e7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053257 Oct 04 19:16:57.185112 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3473/6961] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:16:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:16:57.892043 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a250b32c-5d28-428e-a83b-57b269532424 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:16:57.892043 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a250b32c-5d28-428e-a83b-57b269532424 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 61421b3c-4c72-42c5-bbdc-793a4fb12b3e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:16:57.901119 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a250b32c-5d28-428e-a83b-57b269532424 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:57.901742 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a250b32c-5d28-428e-a83b-57b269532424 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:57.902306 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a250b32c-5d28-428e-a83b-57b269532424 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:57.903164 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a250b32c-5d28-428e-a83b-57b269532424 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:57.903746 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a250b32c-5d28-428e-a83b-57b269532424 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:57.904470 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a250b32c-5d28-428e-a83b-57b269532424 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:58.019428 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a250b32c-5d28-428e-a83b-57b269532424 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:16:58.028341 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a250b32c-5d28-428e-a83b-57b269532424 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/61421b3c-4c72-42c5-bbdc-793a4fb12b3e" status: 200 len: 1225 microversion: 2.1 time: 0.142596 Oct 04 19:16:58.029452 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3489/6962] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:16:57 2022] GET /compute/v2.1/servers/61421b3c-4c72-42c5-bbdc-793a4fb12b3e => generated 1225 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:16:59.054632 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e926629e-d110-4da8-be71-fc5e305785e1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:16:59.055964 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e926629e-d110-4da8-be71-fc5e305785e1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 61421b3c-4c72-42c5-bbdc-793a4fb12b3e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:16:59.064522 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e926629e-d110-4da8-be71-fc5e305785e1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:59.065017 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e926629e-d110-4da8-be71-fc5e305785e1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:59.065463 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e926629e-d110-4da8-be71-fc5e305785e1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:59.066197 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e926629e-d110-4da8-be71-fc5e305785e1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:59.066660 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e926629e-d110-4da8-be71-fc5e305785e1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:59.067394 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e926629e-d110-4da8-be71-fc5e305785e1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:59.143901 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e926629e-d110-4da8-be71-fc5e305785e1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:16:59.156149 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e926629e-d110-4da8-be71-fc5e305785e1 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/61421b3c-4c72-42c5-bbdc-793a4fb12b3e" status: 200 len: 1225 microversion: 2.1 time: 0.101800 Oct 04 19:16:59.156149 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3474/6963] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:16:59 2022] GET /compute/v2.1/servers/61421b3c-4c72-42c5-bbdc-793a4fb12b3e => generated 1225 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:17:00.176879 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1ea888f3-e809-4b72-95ce-f86e2226d31c tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:17:00.181427 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1ea888f3-e809-4b72-95ce-f86e2226d31c tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 61421b3c-4c72-42c5-bbdc-793a4fb12b3e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:17:00.190467 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1ea888f3-e809-4b72-95ce-f86e2226d31c tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:00.191116 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1ea888f3-e809-4b72-95ce-f86e2226d31c tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:00.191660 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1ea888f3-e809-4b72-95ce-f86e2226d31c tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:00.192670 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1ea888f3-e809-4b72-95ce-f86e2226d31c tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:00.193199 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1ea888f3-e809-4b72-95ce-f86e2226d31c tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:00.193695 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1ea888f3-e809-4b72-95ce-f86e2226d31c tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:00.259639 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1ea888f3-e809-4b72-95ce-f86e2226d31c tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:17:00.268209 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1ea888f3-e809-4b72-95ce-f86e2226d31c tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/61421b3c-4c72-42c5-bbdc-793a4fb12b3e" status: 200 len: 1225 microversion: 2.1 time: 0.095839 Oct 04 19:17:00.268799 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3490/6964] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:17:00 2022] GET /compute/v2.1/servers/61421b3c-4c72-42c5-bbdc-793a4fb12b3e => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:17:01.291987 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1ed9bf19-2dae-4924-a951-b4dbf96ea333 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:17:01.292731 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1ed9bf19-2dae-4924-a951-b4dbf96ea333 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 61421b3c-4c72-42c5-bbdc-793a4fb12b3e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:17:01.320253 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1ed9bf19-2dae-4924-a951-b4dbf96ea333 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:01.321790 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1ed9bf19-2dae-4924-a951-b4dbf96ea333 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:01.321992 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1ed9bf19-2dae-4924-a951-b4dbf96ea333 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:01.324831 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1ed9bf19-2dae-4924-a951-b4dbf96ea333 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:01.325503 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1ed9bf19-2dae-4924-a951-b4dbf96ea333 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:01.326694 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1ed9bf19-2dae-4924-a951-b4dbf96ea333 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:01.394859 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1ed9bf19-2dae-4924-a951-b4dbf96ea333 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:17:01.406365 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1ed9bf19-2dae-4924-a951-b4dbf96ea333 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/61421b3c-4c72-42c5-bbdc-793a4fb12b3e" status: 200 len: 1225 microversion: 2.1 time: 0.118976 Oct 04 19:17:01.407387 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3475/6965] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:17:01 2022] GET /compute/v2.1/servers/61421b3c-4c72-42c5-bbdc-793a4fb12b3e => generated 1225 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:17:02.429101 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3b7582f4-70f9-441c-aad0-8422f1b95a1e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:17:02.429826 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3b7582f4-70f9-441c-aad0-8422f1b95a1e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 61421b3c-4c72-42c5-bbdc-793a4fb12b3e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:17:02.438055 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3b7582f4-70f9-441c-aad0-8422f1b95a1e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:02.438645 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3b7582f4-70f9-441c-aad0-8422f1b95a1e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:02.439202 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3b7582f4-70f9-441c-aad0-8422f1b95a1e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:02.441583 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3b7582f4-70f9-441c-aad0-8422f1b95a1e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:02.442158 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3b7582f4-70f9-441c-aad0-8422f1b95a1e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:02.442682 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3b7582f4-70f9-441c-aad0-8422f1b95a1e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:02.479497 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3b7582f4-70f9-441c-aad0-8422f1b95a1e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:02.480274 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3b7582f4-70f9-441c-aad0-8422f1b95a1e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:02.480721 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3b7582f4-70f9-441c-aad0-8422f1b95a1e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:02.481181 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-3b7582f4-70f9-441c-aad0-8422f1b95a1e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lazy-loading 'fault' on Instance uuid 61421b3c-4c72-42c5-bbdc-793a4fb12b3e {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:17:02.534950 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3b7582f4-70f9-441c-aad0-8422f1b95a1e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a65ae9c3fb3c46a2a393fe21ce21b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d0cd3db371459db429cb770abde738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:17:02.540484 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3b7582f4-70f9-441c-aad0-8422f1b95a1e tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/61421b3c-4c72-42c5-bbdc-793a4fb12b3e" status: 200 len: 1184 microversion: 2.1 time: 0.115274 Oct 04 19:17:02.541073 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3491/6966] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:17:02 2022] GET /compute/v2.1/servers/61421b3c-4c72-42c5-bbdc-793a4fb12b3e => generated 1184 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:17:03.564648 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f08b7ae9-9717-40c3-80d8-9279884b84da tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:17:03.565383 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f08b7ae9-9717-40c3-80d8-9279884b84da tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 61421b3c-4c72-42c5-bbdc-793a4fb12b3e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:17:03.572453 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f08b7ae9-9717-40c3-80d8-9279884b84da tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:03.572957 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f08b7ae9-9717-40c3-80d8-9279884b84da tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:03.573414 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f08b7ae9-9717-40c3-80d8-9279884b84da tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:03.574158 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f08b7ae9-9717-40c3-80d8-9279884b84da tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:03.574703 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f08b7ae9-9717-40c3-80d8-9279884b84da tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:03.575150 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f08b7ae9-9717-40c3-80d8-9279884b84da tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:03.597628 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-f08b7ae9-9717-40c3-80d8-9279884b84da tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] HTTP exception thrown: Instance 61421b3c-4c72-42c5-bbdc-793a4fb12b3e could not be found. Oct 04 19:17:03.599349 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f08b7ae9-9717-40c3-80d8-9279884b84da tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Request method failure captured: Oct 04 19:17:03.599349 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/61421b3c-4c72-42c5-bbdc-793a4fb12b3e HTTP/1.1 Oct 04 19:17:03.599349 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 19:17:03.599349 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 19:17:03.599349 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 19:17:03.599349 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 19:17:03.599349 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 19:17:03.599349 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 19:17:03.599349 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 19:17:03.599349 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 19:17:03.599349 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPIJ4KptPiy5XyaUYG9pLSP7TnMEf-PY7yFvjaPGmW4DAHqC1kasy1bm5to10RwAF_dSHQb87b5amqQ9ZUna6URZpq6M0BGpvwENg84W1HvOZfHgDXT7E6YYTtPhmcCZbmf-MEJzIKVI741HwGnmdHx846U9v3mpOw6zsk7UNEsUijp4 Oct 04 19:17:03.599349 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 19:17:03.599349 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 19:17:03.599349 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 19:17:03.599349 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 19:17:03.599349 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 19:17:03.599349 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 19:17:03.599349 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 82d0cd3db371459db429cb770abde738 Oct 04 19:17:03.599349 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-TestVolumeBootPattern-1621879949 Oct 04 19:17:03.599349 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 19:17:03.599349 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 19:17:03.599349 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/82d0cd3db371459db429cb770abde738"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_82d0cd3db371459db429cb770abde738", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/82d0cd3db371459db429cb770abde738"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/82d0cd3db371459db429cb770abde738"}]}] Oct 04 19:17:03.599349 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-TestVolumeBootPattern-1621879949 Oct 04 19:17:03.599349 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 82d0cd3db371459db429cb770abde738 Oct 04 19:17:03.599349 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-TestVolumeBootPattern-1621879949 Oct 04 19:17:03.599349 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-TestVolumeBootPattern-1621879949-project Oct 04 19:17:03.599349 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 19:17:03.599349 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 19:17:03.599349 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: a65ae9c3fb3c46a2a393fe21ce21b9d4 Oct 04 19:17:03.599349 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-TestVolumeBootPattern-1621879949-project Oct 04 19:17:03.599349 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 19:17:03.599349 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 61421b3c-4c72-42c5-bbdc-793a4fb12b3e could not be found. Oct 04 19:17:03.599349 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '61421b3c-4c72-42c5-bbdc-793a4fb12b3e'} Oct 04 19:17:03.599349 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:17:03.599349 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:17:03.599349 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:17:03.599349 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:17:03.599349 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:17:03.599349 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:17:03.599349 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:17:03.599349 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:17:03.599349 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:17:03.599349 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:17:03.599349 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61421b3c-4c72-42c5-bbdc-793a4fb12b3e could not be found. Oct 04 19:17:03.599349 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:17:03.599349 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:17:03.599349 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:17:03.599349 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:17:03.599349 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:17:03.599349 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:17:03.599349 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:17:03.599349 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:17:03.599349 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:17:03.599349 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:17:03.599349 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:17:03.599349 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:17:03.599349 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:17:03.599349 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:17:03.599349 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:17:03.599349 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:17:03.599349 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61421b3c-4c72-42c5-bbdc-793a4fb12b3e could not be found. Oct 04 19:17:03.599349 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:17:03.599349 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:17:03.599349 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:17:03.604535 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:17:03.604535 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:17:03.604535 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:17:03.604535 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:17:03.604535 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:17:03.604535 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61421b3c-4c72-42c5-bbdc-793a4fb12b3e could not be found. Oct 04 19:17:03.604535 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:17:03.604535 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f08b7ae9-9717-40c3-80d8-9279884b84da tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Returning 404 to user: Instance 61421b3c-4c72-42c5-bbdc-793a4fb12b3e could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:17:03.604535 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f08b7ae9-9717-40c3-80d8-9279884b84da tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/61421b3c-4c72-42c5-bbdc-793a4fb12b3e" status: 404 len: 111 microversion: 2.1 time: 0.040923 Oct 04 19:17:03.604535 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3476/6967] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:17:03 2022] GET /compute/v2.1/servers/61421b3c-4c72-42c5-bbdc-793a4fb12b3e => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:17:04.130911 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-099b96b2-73ef-40fd-bd59-0074afdd1083 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:17:04.131474 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-099b96b2-73ef-40fd-bd59-0074afdd1083 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 21361c85-1287-4754-8308-ef0f172d0e6f] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:17:04.138398 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-099b96b2-73ef-40fd-bd59-0074afdd1083 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:04.139088 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-099b96b2-73ef-40fd-bd59-0074afdd1083 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:04.139330 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-099b96b2-73ef-40fd-bd59-0074afdd1083 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:04.140284 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-099b96b2-73ef-40fd-bd59-0074afdd1083 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:04.140941 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-099b96b2-73ef-40fd-bd59-0074afdd1083 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:04.141377 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-099b96b2-73ef-40fd-bd59-0074afdd1083 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:04.155068 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-099b96b2-73ef-40fd-bd59-0074afdd1083 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] HTTP exception thrown: Instance 21361c85-1287-4754-8308-ef0f172d0e6f could not be found. Oct 04 19:17:04.157326 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-099b96b2-73ef-40fd-bd59-0074afdd1083 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Request method failure captured: Oct 04 19:17:04.157326 n-d-850501-14 devstack@n-api.service[123001]: request: DELETE /compute/v2.1/servers/21361c85-1287-4754-8308-ef0f172d0e6f HTTP/1.1 Oct 04 19:17:04.157326 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 19:17:04.157326 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 19:17:04.157326 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 19:17:04.157326 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 19:17:04.157326 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 19:17:04.157326 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 19:17:04.157326 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 19:17:04.157326 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 19:17:04.157326 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPIJ4KptPiy5XyaUYG9pLSP7TnMEf-PY7yFvjaPGmW4DAHqC1kasy1bm5to10RwAF_dSHQb87b5amqQ9ZUna6URZpq6M0BGpvwENg84W1HvOZfHgDXT7E6YYTtPhmcCZbmf-MEJzIKVI741HwGnmdHx846U9v3mpOw6zsk7UNEsUijp4 Oct 04 19:17:04.157326 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 19:17:04.157326 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 19:17:04.157326 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 19:17:04.157326 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 19:17:04.157326 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 19:17:04.157326 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 19:17:04.157326 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 82d0cd3db371459db429cb770abde738 Oct 04 19:17:04.157326 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-TestVolumeBootPattern-1621879949 Oct 04 19:17:04.157326 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 19:17:04.157326 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 19:17:04.157326 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/82d0cd3db371459db429cb770abde738"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_82d0cd3db371459db429cb770abde738", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/82d0cd3db371459db429cb770abde738"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/82d0cd3db371459db429cb770abde738"}]}] Oct 04 19:17:04.157326 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-TestVolumeBootPattern-1621879949 Oct 04 19:17:04.157326 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 82d0cd3db371459db429cb770abde738 Oct 04 19:17:04.157326 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-TestVolumeBootPattern-1621879949 Oct 04 19:17:04.157326 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-TestVolumeBootPattern-1621879949-project Oct 04 19:17:04.157326 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 19:17:04.157326 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 19:17:04.157326 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: a65ae9c3fb3c46a2a393fe21ce21b9d4 Oct 04 19:17:04.157326 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-TestVolumeBootPattern-1621879949-project Oct 04 19:17:04.157326 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 19:17:04.157326 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 21361c85-1287-4754-8308-ef0f172d0e6f could not be found. Oct 04 19:17:04.157326 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '21361c85-1287-4754-8308-ef0f172d0e6f'} Oct 04 19:17:04.157326 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:17:04.157326 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:17:04.157326 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:17:04.157326 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:17:04.157326 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:17:04.157326 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:17:04.157326 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:17:04.157326 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:17:04.157326 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:17:04.157326 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:17:04.157326 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21361c85-1287-4754-8308-ef0f172d0e6f could not be found. Oct 04 19:17:04.157326 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:17:04.157326 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:17:04.157326 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:17:04.157326 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:17:04.157326 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:17:04.157326 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:17:04.157326 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:17:04.157326 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:17:04.157326 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:17:04.157326 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:17:04.157326 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 19:17:04.157326 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 19:17:04.157326 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 19:17:04.157326 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 19:17:04.157326 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:17:04.157326 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:17:04.157326 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:17:04.157326 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:17:04.163188 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21361c85-1287-4754-8308-ef0f172d0e6f could not be found. Oct 04 19:17:04.163188 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:17:04.163188 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:17:04.163188 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:17:04.163188 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:17:04.163188 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:17:04.163188 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:17:04.163188 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:17:04.163188 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:17:04.163188 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21361c85-1287-4754-8308-ef0f172d0e6f could not be found. Oct 04 19:17:04.163188 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:17:04.163188 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-099b96b2-73ef-40fd-bd59-0074afdd1083 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Returning 404 to user: Instance 21361c85-1287-4754-8308-ef0f172d0e6f could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:17:04.163188 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-099b96b2-73ef-40fd-bd59-0074afdd1083 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "DELETE /compute/v2.1/servers/21361c85-1287-4754-8308-ef0f172d0e6f" status: 404 len: 111 microversion: 2.1 time: 0.031773 Oct 04 19:17:04.167820 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e8aea359-7ac5-407e-b25a-94592526d955 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:17:04.168501 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e8aea359-7ac5-407e-b25a-94592526d955 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] [instance: 21361c85-1287-4754-8308-ef0f172d0e6f] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:17:04.171973 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3492/6968] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 19:17:04 2022] DELETE /compute/v2.1/servers/21361c85-1287-4754-8308-ef0f172d0e6f => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:17:04.176767 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e8aea359-7ac5-407e-b25a-94592526d955 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:04.177272 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e8aea359-7ac5-407e-b25a-94592526d955 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:04.177732 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e8aea359-7ac5-407e-b25a-94592526d955 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:04.178457 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e8aea359-7ac5-407e-b25a-94592526d955 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:04.178935 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e8aea359-7ac5-407e-b25a-94592526d955 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:04.179381 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e8aea359-7ac5-407e-b25a-94592526d955 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:04.196474 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-e8aea359-7ac5-407e-b25a-94592526d955 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] HTTP exception thrown: Instance 21361c85-1287-4754-8308-ef0f172d0e6f could not be found. Oct 04 19:17:04.198067 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e8aea359-7ac5-407e-b25a-94592526d955 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Request method failure captured: Oct 04 19:17:04.198067 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/21361c85-1287-4754-8308-ef0f172d0e6f HTTP/1.1 Oct 04 19:17:04.198067 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 19:17:04.198067 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 19:17:04.198067 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 19:17:04.198067 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 19:17:04.198067 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 19:17:04.198067 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 19:17:04.198067 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 19:17:04.198067 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 19:17:04.198067 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPIJ4KptPiy5XyaUYG9pLSP7TnMEf-PY7yFvjaPGmW4DAHqC1kasy1bm5to10RwAF_dSHQb87b5amqQ9ZUna6URZpq6M0BGpvwENg84W1HvOZfHgDXT7E6YYTtPhmcCZbmf-MEJzIKVI741HwGnmdHx846U9v3mpOw6zsk7UNEsUijp4 Oct 04 19:17:04.198067 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 19:17:04.198067 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 19:17:04.198067 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 19:17:04.198067 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 19:17:04.198067 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 19:17:04.198067 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 19:17:04.198067 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 82d0cd3db371459db429cb770abde738 Oct 04 19:17:04.198067 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-TestVolumeBootPattern-1621879949 Oct 04 19:17:04.198067 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 19:17:04.198067 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 19:17:04.198067 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/82d0cd3db371459db429cb770abde738"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_82d0cd3db371459db429cb770abde738", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/82d0cd3db371459db429cb770abde738"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/82d0cd3db371459db429cb770abde738"}]}] Oct 04 19:17:04.198067 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-TestVolumeBootPattern-1621879949 Oct 04 19:17:04.198067 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 82d0cd3db371459db429cb770abde738 Oct 04 19:17:04.198067 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-TestVolumeBootPattern-1621879949 Oct 04 19:17:04.198067 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-TestVolumeBootPattern-1621879949-project Oct 04 19:17:04.198067 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 19:17:04.198067 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 19:17:04.198067 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: a65ae9c3fb3c46a2a393fe21ce21b9d4 Oct 04 19:17:04.198067 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-TestVolumeBootPattern-1621879949-project Oct 04 19:17:04.198067 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 19:17:04.198067 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 21361c85-1287-4754-8308-ef0f172d0e6f could not be found. Oct 04 19:17:04.198067 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '21361c85-1287-4754-8308-ef0f172d0e6f'} Oct 04 19:17:04.198067 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:17:04.198067 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:17:04.198067 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:17:04.198067 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:17:04.198067 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:17:04.198067 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:17:04.198067 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:17:04.198067 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:17:04.198067 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:17:04.198067 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:17:04.198067 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21361c85-1287-4754-8308-ef0f172d0e6f could not be found. Oct 04 19:17:04.198067 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:17:04.198067 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:17:04.198067 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:17:04.198067 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:17:04.198067 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:17:04.198067 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:17:04.198067 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:17:04.198067 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:17:04.198067 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:17:04.198067 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:17:04.198067 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:17:04.198067 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:17:04.198067 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:17:04.198067 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:17:04.198067 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:17:04.198067 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:17:04.198067 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21361c85-1287-4754-8308-ef0f172d0e6f could not be found. Oct 04 19:17:04.198067 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:17:04.198067 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:17:04.198067 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:17:04.203438 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:17:04.203438 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:17:04.203438 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:17:04.203438 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:17:04.203438 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:17:04.203438 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21361c85-1287-4754-8308-ef0f172d0e6f could not be found. Oct 04 19:17:04.203438 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:17:04.205046 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e8aea359-7ac5-407e-b25a-94592526d955 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Returning 404 to user: Instance 21361c85-1287-4754-8308-ef0f172d0e6f could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:17:04.205929 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e8aea359-7ac5-407e-b25a-94592526d955 tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "GET /compute/v2.1/servers/21361c85-1287-4754-8308-ef0f172d0e6f" status: 404 len: 111 microversion: 2.1 time: 0.042299 Oct 04 19:17:04.209617 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3477/6969] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:17:04 2022] GET /compute/v2.1/servers/21361c85-1287-4754-8308-ef0f172d0e6f => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:17:09.136119 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-98c6f9c5-426f-4e88-a047-c3129107656f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] Calling method '.version_select at 0x7fe253a5f3a0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:17:09.232085 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-98c6f9c5-426f-4e88-a047-c3129107656f tempest-TestVolumeBootPattern-1621879949 tempest-TestVolumeBootPattern-1621879949-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1229993015" status: 202 len: 0 microversion: 2.1 time: 0.100247 Oct 04 19:17:09.232692 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3493/6970] 10.222.0.20 () {58 vars in 1263 bytes} [Tue Oct 4 19:17:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1229993015 => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 19:18:55.625769 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=26 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:18:55.628082 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=50 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:18:55.788206 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d539cae4-bb2a-4930-8777-257136315e6f tempest-TestAggregatesBasicOps-1246530603 tempest-TestAggregatesBasicOps-1246530603-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-1633192130", "availability_zone": "foo_zone"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:18:55.792803 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.aggregate [None req-d539cae4-bb2a-4930-8777-257136315e6f tempest-TestAggregatesBasicOps-1246530603 tempest-TestAggregatesBasicOps-1246530603-project-admin] Generated uuid e1b1c940-5e12-4d78-8268-07f85cd47bd7 for aggregate {{(pid=123002) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 19:18:55.905732 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d539cae4-bb2a-4930-8777-257136315e6f tempest-TestAggregatesBasicOps-1246530603 tempest-TestAggregatesBasicOps-1246530603-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 209 microversion: 2.1 time: 0.282010 Oct 04 19:18:55.912735 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3478/6971] 10.222.0.20 () {60 vars in 1164 bytes} [Tue Oct 4 19:18:55 2022] POST /compute/v2.1/os-aggregates => generated 209 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:18:55.918877 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:18:55.920519 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:18:55.924097 n-d-850501-14 devstack@n-api.service[123001]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:18:55.924097 n-d-850501-14 devstack@n-api.service[123001]: Tue Oct 4 19:18:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-aggregates/19/action (ip 10.222.0.20) !!! Oct 04 19:18:55.929140 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b3d3287e-e9e8-4762-a5ef-22e10ae878bf tempest-TestAggregatesBasicOps-1246530603 tempest-TestAggregatesBasicOps-1246530603-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:18:56.059947 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b3d3287e-e9e8-4762-a5ef-22e10ae878bf tempest-TestAggregatesBasicOps-1246530603 tempest-TestAggregatesBasicOps-1246530603-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 319 microversion: 2.1 time: 0.145122 Oct 04 19:18:56.060633 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3494/6972] 10.222.0.20 () {60 vars in 1194 bytes} [Tue Oct 4 19:18:55 2022] POST /compute/v2.1/os-aggregates/19/action => generated 319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:18:56.077422 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-175e6ebb-6150-47fd-b17c-92f70376bf99 tempest-TestAggregatesBasicOps-1246530603 tempest-TestAggregatesBasicOps-1246530603-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:56.083317 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-175e6ebb-6150-47fd-b17c-92f70376bf99 tempest-TestAggregatesBasicOps-1246530603 tempest-TestAggregatesBasicOps-1246530603-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:56.084020 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-175e6ebb-6150-47fd-b17c-92f70376bf99 tempest-TestAggregatesBasicOps-1246530603 tempest-TestAggregatesBasicOps-1246530603-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:56.084716 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-175e6ebb-6150-47fd-b17c-92f70376bf99 tempest-TestAggregatesBasicOps-1246530603 tempest-TestAggregatesBasicOps-1246530603-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:56.085652 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-175e6ebb-6150-47fd-b17c-92f70376bf99 tempest-TestAggregatesBasicOps-1246530603 tempest-TestAggregatesBasicOps-1246530603-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:56.086195 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-175e6ebb-6150-47fd-b17c-92f70376bf99 tempest-TestAggregatesBasicOps-1246530603 tempest-TestAggregatesBasicOps-1246530603-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:56.086871 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-175e6ebb-6150-47fd-b17c-92f70376bf99 tempest-TestAggregatesBasicOps-1246530603 tempest-TestAggregatesBasicOps-1246530603-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:56.115116 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-175e6ebb-6150-47fd-b17c-92f70376bf99 tempest-TestAggregatesBasicOps-1246530603 tempest-TestAggregatesBasicOps-1246530603-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.046569 Oct 04 19:18:56.115856 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3479/6973] 10.222.0.20 () {58 vars in 1176 bytes} [Tue Oct 4 19:18:56 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:18:56.129628 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a2482d16-4bba-46f9-9a2d-418d47929358 tempest-TestAggregatesBasicOps-1246530603 tempest-TestAggregatesBasicOps-1246530603-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:56.139015 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a2482d16-4bba-46f9-9a2d-418d47929358 tempest-TestAggregatesBasicOps-1246530603 tempest-TestAggregatesBasicOps-1246530603-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.013406 Oct 04 19:18:56.140137 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3495/6974] 10.222.0.20 () {58 vars in 1143 bytes} [Tue Oct 4 19:18:56 2022] GET /compute/v2.1/os-aggregates => generated 298 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:18:56.154027 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-cb5dca83-930e-47fb-a630-428639e47075 tempest-TestAggregatesBasicOps-1246530603 tempest-TestAggregatesBasicOps-1246530603-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-850501-14"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:18:56.416572 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cb5dca83-930e-47fb-a630-428639e47075 tempest-TestAggregatesBasicOps-1246530603 tempest-TestAggregatesBasicOps-1246530603-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:56.416572 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cb5dca83-930e-47fb-a630-428639e47075 tempest-TestAggregatesBasicOps-1246530603 tempest-TestAggregatesBasicOps-1246530603-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:56.416572 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cb5dca83-930e-47fb-a630-428639e47075 tempest-TestAggregatesBasicOps-1246530603 tempest-TestAggregatesBasicOps-1246530603-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:56.670396 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-cb5dca83-930e-47fb-a630-428639e47075 tempest-TestAggregatesBasicOps-1246530603 tempest-TestAggregatesBasicOps-1246530603-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 311 microversion: 2.1 time: 0.521646 Oct 04 19:18:56.671925 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3480/6975] 10.222.0.20 () {60 vars in 1194 bytes} [Tue Oct 4 19:18:56 2022] POST /compute/v2.1/os-aggregates/19/action => generated 311 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:18:56.683131 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-54dde323-f1ab-429a-8d77-63251a0340e9 tempest-TestAggregatesBasicOps-1246530603 tempest-TestAggregatesBasicOps-1246530603-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:56.693119 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-54dde323-f1ab-429a-8d77-63251a0340e9 tempest-TestAggregatesBasicOps-1246530603 tempest-TestAggregatesBasicOps-1246530603-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 311 microversion: 2.1 time: 0.014448 Oct 04 19:18:56.693683 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3496/6976] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Oct 4 19:18:56 2022] GET /compute/v2.1/os-aggregates/19 => generated 311 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:18:56.705910 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a62913eb-57fd-4b5f-99e0-14f00d5b049e tempest-TestAggregatesBasicOps-1246530603 tempest-TestAggregatesBasicOps-1246530603-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-347225788", "availability_zone": "foo_zone"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:18:56.931604 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a62913eb-57fd-4b5f-99e0-14f00d5b049e tempest-TestAggregatesBasicOps-1246530603 tempest-TestAggregatesBasicOps-1246530603-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.228684 Oct 04 19:18:56.932414 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3481/6977] 10.222.0.20 () {60 vars in 1173 bytes} [Tue Oct 4 19:18:56 2022] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:18:56.944350 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3bfa8c38-3275-4c31-a71b-c1839b511763 tempest-TestAggregatesBasicOps-1246530603 tempest-TestAggregatesBasicOps-1246530603-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:18:57.037863 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3bfa8c38-3275-4c31-a71b-c1839b511763 tempest-TestAggregatesBasicOps-1246530603 tempest-TestAggregatesBasicOps-1246530603-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.097913 Oct 04 19:18:57.039389 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3497/6978] 10.222.0.20 () {60 vars in 1194 bytes} [Tue Oct 4 19:18:56 2022] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:18:57.050430 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0da6e631-9640-4ae7-947c-c19bd41248c4 tempest-TestAggregatesBasicOps-1246530603 tempest-TestAggregatesBasicOps-1246530603-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:57.060193 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0da6e631-9640-4ae7-947c-c19bd41248c4 tempest-TestAggregatesBasicOps-1246530603 tempest-TestAggregatesBasicOps-1246530603-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.013435 Oct 04 19:18:57.060878 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3482/6979] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Oct 4 19:18:57 2022] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:18:57.076642 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-33db93c5-3b63-4ae3-81c0-31e63c3556d5 tempest-TestAggregatesBasicOps-1246530603 tempest-TestAggregatesBasicOps-1246530603-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-850501-14"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:18:57.088208 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-33db93c5-3b63-4ae3-81c0-31e63c3556d5 tempest-TestAggregatesBasicOps-1246530603 tempest-TestAggregatesBasicOps-1246530603-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:57.088972 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-33db93c5-3b63-4ae3-81c0-31e63c3556d5 tempest-TestAggregatesBasicOps-1246530603 tempest-TestAggregatesBasicOps-1246530603-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:57.089415 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-33db93c5-3b63-4ae3-81c0-31e63c3556d5 tempest-TestAggregatesBasicOps-1246530603 tempest-TestAggregatesBasicOps-1246530603-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:57.411287 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-33db93c5-3b63-4ae3-81c0-31e63c3556d5 tempest-TestAggregatesBasicOps-1246530603 tempest-TestAggregatesBasicOps-1246530603-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 340 microversion: 2.1 time: 0.338499 Oct 04 19:18:57.411897 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3498/6980] 10.222.0.20 () {60 vars in 1194 bytes} [Tue Oct 4 19:18:57 2022] POST /compute/v2.1/os-aggregates/19/action => generated 340 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:18:57.423959 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6b3abed1-a45e-4ec4-b3c6-ce97938fa9bd tempest-TestAggregatesBasicOps-1246530603 tempest-TestAggregatesBasicOps-1246530603-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:57.524206 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6b3abed1-a45e-4ec4-b3c6-ce97938fa9bd tempest-TestAggregatesBasicOps-1246530603 tempest-TestAggregatesBasicOps-1246530603-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.103832 Oct 04 19:18:57.526314 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3483/6981] 10.222.0.20 () {58 vars in 1155 bytes} [Tue Oct 4 19:18:57 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 19:19:08.420828 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=4 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:19:08.421594 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=20,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:19:08.589968 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-82343034-0ed3-4ead-80d8-da8e7d9e9c20 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Action: 'create', calling method: .version_select at 0x7fe253b87e50>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-272123518", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLRP/FDi20V7WcQ8GJSK4yLTpcUBaQCjUc8s2UvUnjbJH8feuoQkC/LUMcvu3QkDAWO4anhEogjMjiB/1v63rvGG0hZEtjZoLH+8EJaESXXgGKTgjch9Nn1M8eBN/P349w=="}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:19:08.608244 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-82343034-0ed3-4ead-80d8-da8e7d9e9c20 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Getting quotas for project 81e34eff3bda4651aece03d213439a2b. Resources: {'key_pairs'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:19:08.613282 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-82343034-0ed3-4ead-80d8-da8e7d9e9c20 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Getting quotas for user e66faeb21cd44d9e927e436096f49e26 and project 81e34eff3bda4651aece03d213439a2b. Resources: {'key_pairs'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:19:08.692356 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-82343034-0ed3-4ead-80d8-da8e7d9e9c20 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.272973 Oct 04 19:19:08.692902 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3499/6982] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Oct 4 19:19:08 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:19:17.216573 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c2b9ec37-c1ac-46ee-8b48-6a4a4ee2b4ec tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-800798606", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": [{"uuid": "184dd3cc-6689-4708-9372-3f06e9ed6ccf"}], "key_name": "tempest-TestNetworkAdvancedServerOps-272123518", "security_groups": [{"name": "tempest-secgroup-smoke-1304534603"}]}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:19:17.226824 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:19:17.227535 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=6 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:19:17.228743 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:19:17.658409 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-c2b9ec37-c1ac-46ee-8b48-6a4a4ee2b4ec tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] validate_networks() for [('184dd3cc-6689-4708-9372-3f06e9ed6ccf', None, None, None, None, None)] {{(pid=123002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:19:18.249811 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-c2b9ec37-c1ac-46ee-8b48-6a4a4ee2b4ec tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:19:18.250430 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-c2b9ec37-c1ac-46ee-8b48-6a4a4ee2b4ec tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:19:18.250739 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-c2b9ec37-c1ac-46ee-8b48-6a4a4ee2b4ec tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:19:18.251437 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-c2b9ec37-c1ac-46ee-8b48-6a4a4ee2b4ec tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:19:18.251880 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-c2b9ec37-c1ac-46ee-8b48-6a4a4ee2b4ec tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:19:18.267111 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c2b9ec37-c1ac-46ee-8b48-6a4a4ee2b4ec tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:18.267629 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c2b9ec37-c1ac-46ee-8b48-6a4a4ee2b4ec tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:18.268264 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c2b9ec37-c1ac-46ee-8b48-6a4a4ee2b4ec tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:18.269037 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c2b9ec37-c1ac-46ee-8b48-6a4a4ee2b4ec tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:18.269518 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c2b9ec37-c1ac-46ee-8b48-6a4a4ee2b4ec tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:18.269965 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c2b9ec37-c1ac-46ee-8b48-6a4a4ee2b4ec tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:18.294021 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-c2b9ec37-c1ac-46ee-8b48-6a4a4ee2b4ec tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Getting quotas for project 81e34eff3bda4651aece03d213439a2b. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:19:18.300936 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-c2b9ec37-c1ac-46ee-8b48-6a4a4ee2b4ec tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Getting quotas for user e66faeb21cd44d9e927e436096f49e26 and project 81e34eff3bda4651aece03d213439a2b. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:19:18.317919 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c2b9ec37-c1ac-46ee-8b48-6a4a4ee2b4ec tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Going to run 1 instances... {{(pid=123002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:19:18.320596 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c2b9ec37-c1ac-46ee-8b48-6a4a4ee2b4ec tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: dc5ffce6-cecc-4268-b307-e4e96eeb222c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:19:18.478235 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c2b9ec37-c1ac-46ee-8b48-6a4a4ee2b4ec tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.266490 Oct 04 19:19:18.479415 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3484/6983] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 19:19:17 2022] POST /compute/v2.1/servers => generated 406 bytes in 1268 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 19:19:18.492359 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f9f49cd5-3a74-464e-adf9-6a6afa9be444 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:18.493046 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f9f49cd5-3a74-464e-adf9-6a6afa9be444 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: dc5ffce6-cecc-4268-b307-e4e96eeb222c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:18.620198 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=4 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:19:18.641790 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f9f49cd5-3a74-464e-adf9-6a6afa9be444 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:18.651090 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f9f49cd5-3a74-464e-adf9-6a6afa9be444 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c" status: 200 len: 1265 microversion: 2.1 time: 0.164118 Oct 04 19:19:18.651886 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3500/6984] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:18 2022] GET /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:19.674779 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c70d1501-f8d0-482d-bd3f-545e8e771744 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:19.675410 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c70d1501-f8d0-482d-bd3f-545e8e771744 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: dc5ffce6-cecc-4268-b307-e4e96eeb222c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:19.733960 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c70d1501-f8d0-482d-bd3f-545e8e771744 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:19.741504 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c70d1501-f8d0-482d-bd3f-545e8e771744 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c" status: 200 len: 1265 microversion: 2.1 time: 0.070638 Oct 04 19:19:19.742102 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3485/6985] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:19 2022] GET /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c => generated 1265 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:20.765169 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-62934a02-1678-44b6-ba50-eb0d332d349c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:20.765798 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-62934a02-1678-44b6-ba50-eb0d332d349c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: dc5ffce6-cecc-4268-b307-e4e96eeb222c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:20.773874 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-62934a02-1678-44b6-ba50-eb0d332d349c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:20.774373 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-62934a02-1678-44b6-ba50-eb0d332d349c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:20.774807 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-62934a02-1678-44b6-ba50-eb0d332d349c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:20.778005 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-62934a02-1678-44b6-ba50-eb0d332d349c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:20.778005 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-62934a02-1678-44b6-ba50-eb0d332d349c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:20.778005 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-62934a02-1678-44b6-ba50-eb0d332d349c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:20.859128 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-62934a02-1678-44b6-ba50-eb0d332d349c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:20.866960 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-62934a02-1678-44b6-ba50-eb0d332d349c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c" status: 200 len: 1325 microversion: 2.1 time: 0.105844 Oct 04 19:19:20.867625 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3501/6986] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:20 2022] GET /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c => generated 1325 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:19:21.891997 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5761568d-6a32-4548-adbe-ee27c947d49a tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:21.892812 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5761568d-6a32-4548-adbe-ee27c947d49a tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: dc5ffce6-cecc-4268-b307-e4e96eeb222c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:21.910228 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5761568d-6a32-4548-adbe-ee27c947d49a tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:21.910747 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5761568d-6a32-4548-adbe-ee27c947d49a tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:21.911212 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5761568d-6a32-4548-adbe-ee27c947d49a tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:21.912177 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5761568d-6a32-4548-adbe-ee27c947d49a tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:21.912655 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5761568d-6a32-4548-adbe-ee27c947d49a tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:21.913273 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5761568d-6a32-4548-adbe-ee27c947d49a tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:22.149520 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5761568d-6a32-4548-adbe-ee27c947d49a tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:22.157921 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5761568d-6a32-4548-adbe-ee27c947d49a tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c" status: 200 len: 1391 microversion: 2.1 time: 0.269703 Oct 04 19:19:22.158516 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3486/6987] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:21 2022] GET /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c => generated 1391 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:22.757921 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-59d3d109-221e-426d-a6ad-f33e3667dca2 req-6ba8b351-04a3-4316-a147-14e99f1e9066 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc5ffce6-cecc-4268-b307-e4e96eeb222c", "tag": "25664e6d-4108-414f-95fa-c9e8086c70fd"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:19:22.767365 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-59d3d109-221e-426d-a6ad-f33e3667dca2 req-6ba8b351-04a3-4316-a147-14e99f1e9066 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:22.767839 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-59d3d109-221e-426d-a6ad-f33e3667dca2 req-6ba8b351-04a3-4316-a147-14e99f1e9066 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:22.768292 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-59d3d109-221e-426d-a6ad-f33e3667dca2 req-6ba8b351-04a3-4316-a147-14e99f1e9066 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:22.779656 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-59d3d109-221e-426d-a6ad-f33e3667dca2 req-6ba8b351-04a3-4316-a147-14e99f1e9066 service nova] Creating event network-changed:25664e6d-4108-414f-95fa-c9e8086c70fd for instance dc5ffce6-cecc-4268-b307-e4e96eeb222c on n-h1-850501-14 Oct 04 19:19:22.783000 n-d-850501-14 devstack@n-api.service[123001]: ERROR oslo.messaging._drivers.impl_rabbit [req-59d3d109-221e-426d-a6ad-f33e3667dca2 req-6ba8b351-04a3-4316-a147-14e99f1e9066 service nova] [580cf7e4-41c9-4bd1-a5cd-0c25952f7cac] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 19:19:23.181375 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f5914e75-9a4b-4a46-a88d-093b143bb5e6 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:23.182296 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f5914e75-9a4b-4a46-a88d-093b143bb5e6 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: dc5ffce6-cecc-4268-b307-e4e96eeb222c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:23.188845 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f5914e75-9a4b-4a46-a88d-093b143bb5e6 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:23.189352 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f5914e75-9a4b-4a46-a88d-093b143bb5e6 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:23.189805 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f5914e75-9a4b-4a46-a88d-093b143bb5e6 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:23.190523 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f5914e75-9a4b-4a46-a88d-093b143bb5e6 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:23.193946 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f5914e75-9a4b-4a46-a88d-093b143bb5e6 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:23.193946 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f5914e75-9a4b-4a46-a88d-093b143bb5e6 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:23.330981 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f5914e75-9a4b-4a46-a88d-093b143bb5e6 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:23.338739 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f5914e75-9a4b-4a46-a88d-093b143bb5e6 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c" status: 200 len: 1391 microversion: 2.1 time: 0.161320 Oct 04 19:19:23.339582 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3487/6988] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:23 2022] GET /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c => generated 1391 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:19:23.789793 n-d-850501-14 devstack@n-api.service[123001]: INFO oslo.messaging._drivers.impl_rabbit [req-59d3d109-221e-426d-a6ad-f33e3667dca2 req-6ba8b351-04a3-4316-a147-14e99f1e9066 service nova] [580cf7e4-41c9-4bd1-a5cd-0c25952f7cac] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 46732. Oct 04 19:19:23.794015 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-59d3d109-221e-426d-a6ad-f33e3667dca2 req-6ba8b351-04a3-4316-a147-14e99f1e9066 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.118145 Oct 04 19:19:23.794624 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3502/6989] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:19:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:19:24.362111 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a74c8103-68a0-467d-8523-f0824f3ff899 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:24.362746 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a74c8103-68a0-467d-8523-f0824f3ff899 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: dc5ffce6-cecc-4268-b307-e4e96eeb222c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:24.370434 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a74c8103-68a0-467d-8523-f0824f3ff899 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:24.370972 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a74c8103-68a0-467d-8523-f0824f3ff899 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:24.371425 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a74c8103-68a0-467d-8523-f0824f3ff899 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:24.372189 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a74c8103-68a0-467d-8523-f0824f3ff899 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:24.372648 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a74c8103-68a0-467d-8523-f0824f3ff899 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:24.373095 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a74c8103-68a0-467d-8523-f0824f3ff899 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:24.579316 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a74c8103-68a0-467d-8523-f0824f3ff899 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:24.587340 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a74c8103-68a0-467d-8523-f0824f3ff899 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c" status: 200 len: 1391 microversion: 2.1 time: 0.229037 Oct 04 19:19:24.589477 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3488/6990] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:24 2022] GET /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c => generated 1391 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:25.613701 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-25715ff0-07a8-4f87-93a4-727e117c9904 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:25.614694 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-25715ff0-07a8-4f87-93a4-727e117c9904 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: dc5ffce6-cecc-4268-b307-e4e96eeb222c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:25.620943 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-25715ff0-07a8-4f87-93a4-727e117c9904 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:25.621433 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-25715ff0-07a8-4f87-93a4-727e117c9904 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:25.621897 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-25715ff0-07a8-4f87-93a4-727e117c9904 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:25.622582 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-25715ff0-07a8-4f87-93a4-727e117c9904 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:25.623040 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-25715ff0-07a8-4f87-93a4-727e117c9904 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:25.623470 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-25715ff0-07a8-4f87-93a4-727e117c9904 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:25.755149 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-25715ff0-07a8-4f87-93a4-727e117c9904 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:25.763780 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-25715ff0-07a8-4f87-93a4-727e117c9904 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c" status: 200 len: 1391 microversion: 2.1 time: 0.155302 Oct 04 19:19:25.764394 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3503/6991] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:25 2022] GET /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:26.786991 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b4111005-7f76-4724-b010-21f24270918b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:26.787728 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b4111005-7f76-4724-b010-21f24270918b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: dc5ffce6-cecc-4268-b307-e4e96eeb222c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:26.795435 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b4111005-7f76-4724-b010-21f24270918b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:26.795931 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b4111005-7f76-4724-b010-21f24270918b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:26.796402 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b4111005-7f76-4724-b010-21f24270918b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:26.797110 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b4111005-7f76-4724-b010-21f24270918b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:26.797578 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b4111005-7f76-4724-b010-21f24270918b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:26.798017 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b4111005-7f76-4724-b010-21f24270918b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:26.938793 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b4111005-7f76-4724-b010-21f24270918b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:26.946587 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b4111005-7f76-4724-b010-21f24270918b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c" status: 200 len: 1391 microversion: 2.1 time: 0.163698 Oct 04 19:19:26.947375 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3489/6992] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:26 2022] GET /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c => generated 1391 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:27.969609 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6312d395-c8c6-4cda-9c64-7dd0ac7b5b5d tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:27.970215 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6312d395-c8c6-4cda-9c64-7dd0ac7b5b5d tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: dc5ffce6-cecc-4268-b307-e4e96eeb222c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:27.977044 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6312d395-c8c6-4cda-9c64-7dd0ac7b5b5d tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:27.977537 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6312d395-c8c6-4cda-9c64-7dd0ac7b5b5d tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:27.977954 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6312d395-c8c6-4cda-9c64-7dd0ac7b5b5d tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:27.978636 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6312d395-c8c6-4cda-9c64-7dd0ac7b5b5d tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:27.979124 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6312d395-c8c6-4cda-9c64-7dd0ac7b5b5d tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:27.979546 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6312d395-c8c6-4cda-9c64-7dd0ac7b5b5d tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:28.115478 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6312d395-c8c6-4cda-9c64-7dd0ac7b5b5d tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:28.123452 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6312d395-c8c6-4cda-9c64-7dd0ac7b5b5d tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c" status: 200 len: 1391 microversion: 2.1 time: 0.157654 Oct 04 19:19:28.124040 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3504/6993] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:27 2022] GET /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:28.549966 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:19:28.617266 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-9a95b4bc-abdc-445a-b059-727448da93e5 req-f01fcecb-f043-481c-b37d-6ef408834ee9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc5ffce6-cecc-4268-b307-e4e96eeb222c", "name": "network-vif-plugged", "status": "completed", "tag": "25664e6d-4108-414f-95fa-c9e8086c70fd"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:19:28.627544 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-9a95b4bc-abdc-445a-b059-727448da93e5 req-f01fcecb-f043-481c-b37d-6ef408834ee9 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:28.628066 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-9a95b4bc-abdc-445a-b059-727448da93e5 req-f01fcecb-f043-481c-b37d-6ef408834ee9 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:28.628522 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-9a95b4bc-abdc-445a-b059-727448da93e5 req-f01fcecb-f043-481c-b37d-6ef408834ee9 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:28.640456 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-9a95b4bc-abdc-445a-b059-727448da93e5 req-f01fcecb-f043-481c-b37d-6ef408834ee9 service nova] Creating event network-vif-plugged:25664e6d-4108-414f-95fa-c9e8086c70fd for instance dc5ffce6-cecc-4268-b307-e4e96eeb222c on n-h1-850501-14 Oct 04 19:19:28.643957 n-d-850501-14 devstack@n-api.service[123002]: ERROR oslo.messaging._drivers.impl_rabbit [req-9a95b4bc-abdc-445a-b059-727448da93e5 req-f01fcecb-f043-481c-b37d-6ef408834ee9 service nova] [7e1cdd54-d494-488a-b2b2-b89c0bca72f3] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 19:19:29.146543 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f325f4ac-c964-4f9b-86d2-96bd8b573e54 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:29.147235 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f325f4ac-c964-4f9b-86d2-96bd8b573e54 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: dc5ffce6-cecc-4268-b307-e4e96eeb222c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:29.154726 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f325f4ac-c964-4f9b-86d2-96bd8b573e54 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:29.155297 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f325f4ac-c964-4f9b-86d2-96bd8b573e54 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:29.155686 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f325f4ac-c964-4f9b-86d2-96bd8b573e54 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:29.156414 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f325f4ac-c964-4f9b-86d2-96bd8b573e54 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:29.156929 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f325f4ac-c964-4f9b-86d2-96bd8b573e54 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:29.157361 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f325f4ac-c964-4f9b-86d2-96bd8b573e54 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:29.291934 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f325f4ac-c964-4f9b-86d2-96bd8b573e54 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:29.299938 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f325f4ac-c964-4f9b-86d2-96bd8b573e54 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c" status: 200 len: 1391 microversion: 2.1 time: 0.157257 Oct 04 19:19:29.300548 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3505/6994] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:29 2022] GET /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:19:29.651298 n-d-850501-14 devstack@n-api.service[123002]: INFO oslo.messaging._drivers.impl_rabbit [req-9a95b4bc-abdc-445a-b059-727448da93e5 req-f01fcecb-f043-481c-b37d-6ef408834ee9 service nova] [7e1cdd54-d494-488a-b2b2-b89c0bca72f3] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 46750. Oct 04 19:19:29.655070 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-9a95b4bc-abdc-445a-b059-727448da93e5 req-f01fcecb-f043-481c-b37d-6ef408834ee9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.110525 Oct 04 19:19:29.655690 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3490/6995] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:19:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:19:30.322385 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-41155bd6-691e-46b4-9b30-9bc7d0abb1a8 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:30.323681 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-41155bd6-691e-46b4-9b30-9bc7d0abb1a8 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: dc5ffce6-cecc-4268-b307-e4e96eeb222c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:30.330425 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-41155bd6-691e-46b4-9b30-9bc7d0abb1a8 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:30.330906 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-41155bd6-691e-46b4-9b30-9bc7d0abb1a8 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:30.331341 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-41155bd6-691e-46b4-9b30-9bc7d0abb1a8 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:30.332021 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-41155bd6-691e-46b4-9b30-9bc7d0abb1a8 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:30.332503 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-41155bd6-691e-46b4-9b30-9bc7d0abb1a8 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:30.332924 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-41155bd6-691e-46b4-9b30-9bc7d0abb1a8 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:30.464787 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-41155bd6-691e-46b4-9b30-9bc7d0abb1a8 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:30.472522 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-41155bd6-691e-46b4-9b30-9bc7d0abb1a8 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c" status: 200 len: 1391 microversion: 2.1 time: 0.154167 Oct 04 19:19:30.475283 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3506/6996] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:30 2022] GET /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c => generated 1391 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:31.493564 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=8 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:19:31.499389 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f5c92ae4-9138-4979-bfc3-a0525133cb63 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:31.500144 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f5c92ae4-9138-4979-bfc3-a0525133cb63 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: dc5ffce6-cecc-4268-b307-e4e96eeb222c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:31.506445 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f5c92ae4-9138-4979-bfc3-a0525133cb63 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:31.506934 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f5c92ae4-9138-4979-bfc3-a0525133cb63 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:31.507379 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f5c92ae4-9138-4979-bfc3-a0525133cb63 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:31.508087 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f5c92ae4-9138-4979-bfc3-a0525133cb63 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:31.508553 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f5c92ae4-9138-4979-bfc3-a0525133cb63 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:31.509018 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f5c92ae4-9138-4979-bfc3-a0525133cb63 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:31.650692 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f5c92ae4-9138-4979-bfc3-a0525133cb63 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:31.659189 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f5c92ae4-9138-4979-bfc3-a0525133cb63 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c" status: 200 len: 1564 microversion: 2.1 time: 0.166617 Oct 04 19:19:31.659768 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3491/6997] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:31 2022] GET /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c => generated 1564 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:31.681152 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2f752667-3e3c-4825-a76d-bd45567a8a15 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:31.681773 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2f752667-3e3c-4825-a76d-bd45567a8a15 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: dc5ffce6-cecc-4268-b307-e4e96eeb222c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:31.684486 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:19:31.690149 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2f752667-3e3c-4825-a76d-bd45567a8a15 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:31.692629 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2f752667-3e3c-4825-a76d-bd45567a8a15 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:31.692629 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2f752667-3e3c-4825-a76d-bd45567a8a15 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:31.692629 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2f752667-3e3c-4825-a76d-bd45567a8a15 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:31.692629 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2f752667-3e3c-4825-a76d-bd45567a8a15 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:31.692629 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2f752667-3e3c-4825-a76d-bd45567a8a15 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:31.830621 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-2f752667-3e3c-4825-a76d-bd45567a8a15 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:31.838379 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2f752667-3e3c-4825-a76d-bd45567a8a15 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c" status: 200 len: 1564 microversion: 2.1 time: 0.161119 Oct 04 19:19:31.839330 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3507/6998] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:31 2022] GET /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c => generated 1564 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:34.090740 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-835dc558-12ed-42c9-a7f4-876323df2a3f tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:34.091375 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-835dc558-12ed-42c9-a7f4-876323df2a3f tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: dc5ffce6-cecc-4268-b307-e4e96eeb222c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:34.099059 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-50504b2b-d88c-4bc8-b737-68f163976322 req-1783e237-88aa-44fd-92ed-b17a8a6789af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc5ffce6-cecc-4268-b307-e4e96eeb222c", "tag": "25664e6d-4108-414f-95fa-c9e8086c70fd"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:19:34.110309 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-835dc558-12ed-42c9-a7f4-876323df2a3f tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:34.110818 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-835dc558-12ed-42c9-a7f4-876323df2a3f tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:34.111268 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-835dc558-12ed-42c9-a7f4-876323df2a3f tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:34.111983 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-835dc558-12ed-42c9-a7f4-876323df2a3f tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:34.112479 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-835dc558-12ed-42c9-a7f4-876323df2a3f tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:34.112919 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-835dc558-12ed-42c9-a7f4-876323df2a3f tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:34.119624 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-50504b2b-d88c-4bc8-b737-68f163976322 req-1783e237-88aa-44fd-92ed-b17a8a6789af service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:34.120122 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-50504b2b-d88c-4bc8-b737-68f163976322 req-1783e237-88aa-44fd-92ed-b17a8a6789af service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:34.121089 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-50504b2b-d88c-4bc8-b737-68f163976322 req-1783e237-88aa-44fd-92ed-b17a8a6789af service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:34.133002 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-50504b2b-d88c-4bc8-b737-68f163976322 req-1783e237-88aa-44fd-92ed-b17a8a6789af service nova] Creating event network-changed:25664e6d-4108-414f-95fa-c9e8086c70fd for instance dc5ffce6-cecc-4268-b307-e4e96eeb222c on n-h1-850501-14 Oct 04 19:19:34.140068 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-50504b2b-d88c-4bc8-b737-68f163976322 req-1783e237-88aa-44fd-92ed-b17a8a6789af service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044513 Oct 04 19:19:34.141125 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3508/6999] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:19:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:19:34.362351 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-835dc558-12ed-42c9-a7f4-876323df2a3f tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:34.371149 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-835dc558-12ed-42c9-a7f4-876323df2a3f tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c" status: 200 len: 1564 microversion: 2.1 time: 0.284109 Oct 04 19:19:34.371745 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3492/7000] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:34 2022] GET /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c => generated 1564 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:19:55.623032 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ee4cf947-aa41-4877-a8f8-6296d6a02db9 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:19:55.625304 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ee4cf947-aa41-4877-a8f8-6296d6a02db9 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: dc5ffce6-cecc-4268-b307-e4e96eeb222c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:55.628323 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:19:55.628983 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=40 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:19:55.633863 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ee4cf947-aa41-4877-a8f8-6296d6a02db9 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:55.634337 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ee4cf947-aa41-4877-a8f8-6296d6a02db9 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:55.634773 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ee4cf947-aa41-4877-a8f8-6296d6a02db9 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:55.635459 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ee4cf947-aa41-4877-a8f8-6296d6a02db9 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:55.635908 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ee4cf947-aa41-4877-a8f8-6296d6a02db9 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:55.636375 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ee4cf947-aa41-4877-a8f8-6296d6a02db9 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:55.686616 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ee4cf947-aa41-4877-a8f8-6296d6a02db9 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "POST /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c/action" status: 200 len: 24564 microversion: 2.1 time: 0.067789 Oct 04 19:19:55.687528 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3509/7001] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 19:19:55 2022] POST /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c/action => generated 24564 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:20:06.712421 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-41f4b703-990d-4b3d-94da-6c7d9ebfd298 tempest-TestNetworkAdvancedServerOps-443223969 tempest-TestNetworkAdvancedServerOps-443223969-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:06.745223 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-41f4b703-990d-4b3d-94da-6c7d9ebfd298 tempest-TestNetworkAdvancedServerOps-443223969 tempest-TestNetworkAdvancedServerOps-443223969-project-admin] [instance: dc5ffce6-cecc-4268-b307-e4e96eeb222c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:06.745223 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:20:06.745223 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=40 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:20:06.745223 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-41f4b703-990d-4b3d-94da-6c7d9ebfd298 tempest-TestNetworkAdvancedServerOps-443223969 tempest-TestNetworkAdvancedServerOps-443223969-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:06.745223 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-41f4b703-990d-4b3d-94da-6c7d9ebfd298 tempest-TestNetworkAdvancedServerOps-443223969 tempest-TestNetworkAdvancedServerOps-443223969-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:06.745223 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-41f4b703-990d-4b3d-94da-6c7d9ebfd298 tempest-TestNetworkAdvancedServerOps-443223969 tempest-TestNetworkAdvancedServerOps-443223969-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:06.745223 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-41f4b703-990d-4b3d-94da-6c7d9ebfd298 tempest-TestNetworkAdvancedServerOps-443223969 tempest-TestNetworkAdvancedServerOps-443223969-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:06.745223 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-41f4b703-990d-4b3d-94da-6c7d9ebfd298 tempest-TestNetworkAdvancedServerOps-443223969 tempest-TestNetworkAdvancedServerOps-443223969-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:06.745223 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-41f4b703-990d-4b3d-94da-6c7d9ebfd298 tempest-TestNetworkAdvancedServerOps-443223969 tempest-TestNetworkAdvancedServerOps-443223969-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:07.018124 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-41f4b703-990d-4b3d-94da-6c7d9ebfd298 tempest-TestNetworkAdvancedServerOps-443223969 tempest-TestNetworkAdvancedServerOps-443223969-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c" status: 200 len: 1836 microversion: 2.1 time: 0.310333 Oct 04 19:20:07.018710 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3493/7002] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:06 2022] GET /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c => generated 1836 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:07.043150 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-338479f8-b7ed-4a4b-b8b5-08a1cb3e4887 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:07.043853 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-338479f8-b7ed-4a4b-b8b5-08a1cb3e4887 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: dc5ffce6-cecc-4268-b307-e4e96eeb222c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:07.052354 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-338479f8-b7ed-4a4b-b8b5-08a1cb3e4887 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:07.052849 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-338479f8-b7ed-4a4b-b8b5-08a1cb3e4887 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:07.053291 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-338479f8-b7ed-4a4b-b8b5-08a1cb3e4887 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:07.054012 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-338479f8-b7ed-4a4b-b8b5-08a1cb3e4887 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:07.054471 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-338479f8-b7ed-4a4b-b8b5-08a1cb3e4887 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:07.054905 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-338479f8-b7ed-4a4b-b8b5-08a1cb3e4887 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:07.194207 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-338479f8-b7ed-4a4b-b8b5-08a1cb3e4887 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:07.201993 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-338479f8-b7ed-4a4b-b8b5-08a1cb3e4887 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c" status: 200 len: 1683 microversion: 2.1 time: 0.163751 Oct 04 19:20:07.202565 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3510/7003] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:07 2022] GET /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c => generated 1683 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:07.302647 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a0a4ff48-b264-4d77-be9b-fdd6cf28e2b6 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:20:07.304988 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a0a4ff48-b264-4d77-be9b-fdd6cf28e2b6 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: dc5ffce6-cecc-4268-b307-e4e96eeb222c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:07.311005 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a0a4ff48-b264-4d77-be9b-fdd6cf28e2b6 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:07.311506 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a0a4ff48-b264-4d77-be9b-fdd6cf28e2b6 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:07.311963 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a0a4ff48-b264-4d77-be9b-fdd6cf28e2b6 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:07.312711 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a0a4ff48-b264-4d77-be9b-fdd6cf28e2b6 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:07.313185 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a0a4ff48-b264-4d77-be9b-fdd6cf28e2b6 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:07.313630 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a0a4ff48-b264-4d77-be9b-fdd6cf28e2b6 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:07.375475 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a0a4ff48-b264-4d77-be9b-fdd6cf28e2b6 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "POST /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c/action" status: 200 len: 32641 microversion: 2.1 time: 0.077218 Oct 04 19:20:07.376164 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3494/7004] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 19:20:07 2022] POST /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c/action => generated 32641 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:20:07.541284 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ce0ed856-5829-4575-addc-d8ad0e87b337 tempest-TestNetworkAdvancedServerOps-443223969 tempest-TestNetworkAdvancedServerOps-443223969-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:20:07.541780 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ce0ed856-5829-4575-addc-d8ad0e87b337 tempest-TestNetworkAdvancedServerOps-443223969 tempest-TestNetworkAdvancedServerOps-443223969-project-admin] [instance: dc5ffce6-cecc-4268-b307-e4e96eeb222c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:07.548330 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ce0ed856-5829-4575-addc-d8ad0e87b337 tempest-TestNetworkAdvancedServerOps-443223969 tempest-TestNetworkAdvancedServerOps-443223969-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:07.548824 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ce0ed856-5829-4575-addc-d8ad0e87b337 tempest-TestNetworkAdvancedServerOps-443223969 tempest-TestNetworkAdvancedServerOps-443223969-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:07.549264 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ce0ed856-5829-4575-addc-d8ad0e87b337 tempest-TestNetworkAdvancedServerOps-443223969 tempest-TestNetworkAdvancedServerOps-443223969-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:07.549965 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ce0ed856-5829-4575-addc-d8ad0e87b337 tempest-TestNetworkAdvancedServerOps-443223969 tempest-TestNetworkAdvancedServerOps-443223969-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:07.550425 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ce0ed856-5829-4575-addc-d8ad0e87b337 tempest-TestNetworkAdvancedServerOps-443223969 tempest-TestNetworkAdvancedServerOps-443223969-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:07.550851 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ce0ed856-5829-4575-addc-d8ad0e87b337 tempest-TestNetworkAdvancedServerOps-443223969 tempest-TestNetworkAdvancedServerOps-443223969-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:07.641993 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ce0ed856-5829-4575-addc-d8ad0e87b337 tempest-TestNetworkAdvancedServerOps-443223969 tempest-TestNetworkAdvancedServerOps-443223969-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'd29a9d6b7b8b43758194340a1879594a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12de74ab9ebf41b7b3509b1f1db4feb1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:07.642666 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ce0ed856-5829-4575-addc-d8ad0e87b337 tempest-TestNetworkAdvancedServerOps-443223969 tempest-TestNetworkAdvancedServerOps-443223969-project-admin] [instance: dc5ffce6-cecc-4268-b307-e4e96eeb222c] flavor_id is None. Assuming migration. {{(pid=123001) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 04 19:20:07.643130 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ce0ed856-5829-4575-addc-d8ad0e87b337 tempest-TestNetworkAdvancedServerOps-443223969 tempest-TestNetworkAdvancedServerOps-443223969-project-admin] [instance: dc5ffce6-cecc-4268-b307-e4e96eeb222c] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=123001) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 19:20:07.856785 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ce0ed856-5829-4575-addc-d8ad0e87b337 tempest-TestNetworkAdvancedServerOps-443223969 tempest-TestNetworkAdvancedServerOps-443223969-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c/action" status: 202 len: 0 microversion: 2.1 time: 0.319472 Oct 04 19:20:07.857407 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3511/7005] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 19:20:07 2022] POST /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c/action => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:20:07.866365 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9cf992d1-9b97-48d6-ba68-f5fd7d9bda72 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:07.867081 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9cf992d1-9b97-48d6-ba68-f5fd7d9bda72 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: dc5ffce6-cecc-4268-b307-e4e96eeb222c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:07.874408 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9cf992d1-9b97-48d6-ba68-f5fd7d9bda72 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:07.874933 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9cf992d1-9b97-48d6-ba68-f5fd7d9bda72 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:07.875388 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9cf992d1-9b97-48d6-ba68-f5fd7d9bda72 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:07.876120 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9cf992d1-9b97-48d6-ba68-f5fd7d9bda72 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:07.876590 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9cf992d1-9b97-48d6-ba68-f5fd7d9bda72 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:07.877374 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9cf992d1-9b97-48d6-ba68-f5fd7d9bda72 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:08.014924 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9cf992d1-9b97-48d6-ba68-f5fd7d9bda72 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:08.023396 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9cf992d1-9b97-48d6-ba68-f5fd7d9bda72 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c" status: 200 len: 1692 microversion: 2.1 time: 0.161406 Oct 04 19:20:08.023978 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3495/7006] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:07 2022] GET /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c => generated 1692 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:09.047389 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d3438e35-d966-40f4-91a3-f92c432261a5 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:09.047913 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d3438e35-d966-40f4-91a3-f92c432261a5 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: dc5ffce6-cecc-4268-b307-e4e96eeb222c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:09.055135 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d3438e35-d966-40f4-91a3-f92c432261a5 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:09.055623 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d3438e35-d966-40f4-91a3-f92c432261a5 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:09.056076 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d3438e35-d966-40f4-91a3-f92c432261a5 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:09.056792 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d3438e35-d966-40f4-91a3-f92c432261a5 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:09.057254 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d3438e35-d966-40f4-91a3-f92c432261a5 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:09.057857 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d3438e35-d966-40f4-91a3-f92c432261a5 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:09.199268 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d3438e35-d966-40f4-91a3-f92c432261a5 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:09.207209 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d3438e35-d966-40f4-91a3-f92c432261a5 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c" status: 200 len: 1692 microversion: 2.1 time: 0.164616 Oct 04 19:20:09.207752 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3512/7007] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:09 2022] GET /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c => generated 1692 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:10.231983 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-de3d4233-d1ec-461b-8e22-8119b03a7e1c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:10.232565 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-de3d4233-d1ec-461b-8e22-8119b03a7e1c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: dc5ffce6-cecc-4268-b307-e4e96eeb222c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:10.239206 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-de3d4233-d1ec-461b-8e22-8119b03a7e1c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:10.239707 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-de3d4233-d1ec-461b-8e22-8119b03a7e1c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:10.240214 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-de3d4233-d1ec-461b-8e22-8119b03a7e1c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:10.241013 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-de3d4233-d1ec-461b-8e22-8119b03a7e1c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:10.241968 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-de3d4233-d1ec-461b-8e22-8119b03a7e1c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:10.242414 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-de3d4233-d1ec-461b-8e22-8119b03a7e1c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:10.409539 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-de3d4233-d1ec-461b-8e22-8119b03a7e1c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:10.418375 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-de3d4233-d1ec-461b-8e22-8119b03a7e1c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c" status: 200 len: 1692 microversion: 2.1 time: 0.190587 Oct 04 19:20:10.418972 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3496/7008] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:10 2022] GET /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c => generated 1692 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:11.441667 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ee9b1da4-eaf2-43a9-b336-2577b9832345 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:11.442283 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ee9b1da4-eaf2-43a9-b336-2577b9832345 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: dc5ffce6-cecc-4268-b307-e4e96eeb222c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:11.449767 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ee9b1da4-eaf2-43a9-b336-2577b9832345 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:11.450260 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ee9b1da4-eaf2-43a9-b336-2577b9832345 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:11.450701 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ee9b1da4-eaf2-43a9-b336-2577b9832345 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:11.451669 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ee9b1da4-eaf2-43a9-b336-2577b9832345 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:11.452178 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ee9b1da4-eaf2-43a9-b336-2577b9832345 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:11.452615 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ee9b1da4-eaf2-43a9-b336-2577b9832345 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:11.590336 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ee9b1da4-eaf2-43a9-b336-2577b9832345 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:11.598102 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ee9b1da4-eaf2-43a9-b336-2577b9832345 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c" status: 200 len: 1697 microversion: 2.1 time: 0.160344 Oct 04 19:20:11.598665 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3513/7009] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:11 2022] GET /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c => generated 1697 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:12.623258 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7f561436-ab05-4f2e-909b-52f2b7b34e09 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:12.623895 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7f561436-ab05-4f2e-909b-52f2b7b34e09 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: dc5ffce6-cecc-4268-b307-e4e96eeb222c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:12.630752 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7f561436-ab05-4f2e-909b-52f2b7b34e09 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:12.631259 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7f561436-ab05-4f2e-909b-52f2b7b34e09 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:12.631715 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7f561436-ab05-4f2e-909b-52f2b7b34e09 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:12.632463 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7f561436-ab05-4f2e-909b-52f2b7b34e09 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:12.633846 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7f561436-ab05-4f2e-909b-52f2b7b34e09 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:12.634309 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7f561436-ab05-4f2e-909b-52f2b7b34e09 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:12.774973 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7f561436-ab05-4f2e-909b-52f2b7b34e09 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:12.783037 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7f561436-ab05-4f2e-909b-52f2b7b34e09 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c" status: 200 len: 1697 microversion: 2.1 time: 0.163728 Oct 04 19:20:12.783620 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3497/7010] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:12 2022] GET /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c => generated 1697 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:13.806901 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f430fc3b-50f2-4567-b31d-cf97043c1ccb tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:13.807509 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f430fc3b-50f2-4567-b31d-cf97043c1ccb tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: dc5ffce6-cecc-4268-b307-e4e96eeb222c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:13.814358 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f430fc3b-50f2-4567-b31d-cf97043c1ccb tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:13.814847 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f430fc3b-50f2-4567-b31d-cf97043c1ccb tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:13.815289 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f430fc3b-50f2-4567-b31d-cf97043c1ccb tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:13.815981 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f430fc3b-50f2-4567-b31d-cf97043c1ccb tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:13.816477 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f430fc3b-50f2-4567-b31d-cf97043c1ccb tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:13.816914 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f430fc3b-50f2-4567-b31d-cf97043c1ccb tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:13.950735 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f430fc3b-50f2-4567-b31d-cf97043c1ccb tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:13.958884 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f430fc3b-50f2-4567-b31d-cf97043c1ccb tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c" status: 200 len: 1697 microversion: 2.1 time: 0.156010 Oct 04 19:20:13.970228 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3514/7011] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:13 2022] GET /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c => generated 1697 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:14.993092 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-754d7c64-c8ed-484e-b0cb-0b0338fe2712 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:14.993651 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-754d7c64-c8ed-484e-b0cb-0b0338fe2712 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: dc5ffce6-cecc-4268-b307-e4e96eeb222c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:15.000469 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-754d7c64-c8ed-484e-b0cb-0b0338fe2712 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:15.000963 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-754d7c64-c8ed-484e-b0cb-0b0338fe2712 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:15.001410 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-754d7c64-c8ed-484e-b0cb-0b0338fe2712 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:15.002107 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-754d7c64-c8ed-484e-b0cb-0b0338fe2712 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:15.002574 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-754d7c64-c8ed-484e-b0cb-0b0338fe2712 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:15.003011 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-754d7c64-c8ed-484e-b0cb-0b0338fe2712 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:15.139789 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-754d7c64-c8ed-484e-b0cb-0b0338fe2712 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:15.147425 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-754d7c64-c8ed-484e-b0cb-0b0338fe2712 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c" status: 200 len: 1697 microversion: 2.1 time: 0.159197 Oct 04 19:20:15.148021 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3498/7012] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:14 2022] GET /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c => generated 1697 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:16.170872 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-13c9f664-b6db-4a47-9e02-ce7445a425aa tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:16.171532 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-13c9f664-b6db-4a47-9e02-ce7445a425aa tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: dc5ffce6-cecc-4268-b307-e4e96eeb222c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:16.178417 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-13c9f664-b6db-4a47-9e02-ce7445a425aa tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:16.178899 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-13c9f664-b6db-4a47-9e02-ce7445a425aa tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:16.179898 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-13c9f664-b6db-4a47-9e02-ce7445a425aa tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:16.180630 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-13c9f664-b6db-4a47-9e02-ce7445a425aa tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:16.181091 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-13c9f664-b6db-4a47-9e02-ce7445a425aa tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:16.181522 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-13c9f664-b6db-4a47-9e02-ce7445a425aa tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:16.324541 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-13c9f664-b6db-4a47-9e02-ce7445a425aa tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:16.332233 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-13c9f664-b6db-4a47-9e02-ce7445a425aa tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c" status: 200 len: 1697 microversion: 2.1 time: 0.165259 Oct 04 19:20:16.332803 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3515/7013] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:16 2022] GET /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c => generated 1697 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:17.366435 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-802b1be0-805a-4f7c-ad8e-8d9703588047 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:17.368009 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-802b1be0-805a-4f7c-ad8e-8d9703588047 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: dc5ffce6-cecc-4268-b307-e4e96eeb222c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:17.375244 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-802b1be0-805a-4f7c-ad8e-8d9703588047 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:17.375751 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-802b1be0-805a-4f7c-ad8e-8d9703588047 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:17.376252 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-802b1be0-805a-4f7c-ad8e-8d9703588047 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:17.376968 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-802b1be0-805a-4f7c-ad8e-8d9703588047 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:17.377448 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-802b1be0-805a-4f7c-ad8e-8d9703588047 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:17.377896 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-802b1be0-805a-4f7c-ad8e-8d9703588047 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:17.515681 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-802b1be0-805a-4f7c-ad8e-8d9703588047 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:17.523660 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-802b1be0-805a-4f7c-ad8e-8d9703588047 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c" status: 200 len: 1697 microversion: 2.1 time: 0.161128 Oct 04 19:20:17.524276 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3499/7014] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:17 2022] GET /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c => generated 1697 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:18.547111 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-499e2aef-8a77-474b-afcd-077fbcbe3892 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:18.547813 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-499e2aef-8a77-474b-afcd-077fbcbe3892 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: dc5ffce6-cecc-4268-b307-e4e96eeb222c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:18.556468 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-499e2aef-8a77-474b-afcd-077fbcbe3892 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:18.556957 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-499e2aef-8a77-474b-afcd-077fbcbe3892 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:18.557388 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-499e2aef-8a77-474b-afcd-077fbcbe3892 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:18.558087 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-499e2aef-8a77-474b-afcd-077fbcbe3892 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:18.558579 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-499e2aef-8a77-474b-afcd-077fbcbe3892 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:18.559064 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-499e2aef-8a77-474b-afcd-077fbcbe3892 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:18.726758 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-499e2aef-8a77-474b-afcd-077fbcbe3892 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:18.737194 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-499e2aef-8a77-474b-afcd-077fbcbe3892 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c" status: 200 len: 1697 microversion: 2.1 time: 0.194107 Oct 04 19:20:18.737804 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3516/7015] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:18 2022] GET /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c => generated 1697 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:19.764112 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-823ea244-7673-4f0f-93cf-820e474fae3e tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:19.764679 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-823ea244-7673-4f0f-93cf-820e474fae3e tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: dc5ffce6-cecc-4268-b307-e4e96eeb222c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:19.772023 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-823ea244-7673-4f0f-93cf-820e474fae3e tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:19.772565 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-823ea244-7673-4f0f-93cf-820e474fae3e tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:19.773659 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-823ea244-7673-4f0f-93cf-820e474fae3e tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:19.774371 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-823ea244-7673-4f0f-93cf-820e474fae3e tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:19.774846 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-823ea244-7673-4f0f-93cf-820e474fae3e tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:19.775293 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-823ea244-7673-4f0f-93cf-820e474fae3e tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:19.907575 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-823ea244-7673-4f0f-93cf-820e474fae3e tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:19.916835 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-823ea244-7673-4f0f-93cf-820e474fae3e tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c" status: 200 len: 1697 microversion: 2.1 time: 0.156819 Oct 04 19:20:19.917430 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3500/7016] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:19 2022] GET /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c => generated 1697 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:20.940792 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-41b2e2f2-6de3-4221-b2c0-a2ee039113b6 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:20.941411 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-41b2e2f2-6de3-4221-b2c0-a2ee039113b6 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: dc5ffce6-cecc-4268-b307-e4e96eeb222c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:20.948442 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-41b2e2f2-6de3-4221-b2c0-a2ee039113b6 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:20.948930 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-41b2e2f2-6de3-4221-b2c0-a2ee039113b6 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:20.949368 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-41b2e2f2-6de3-4221-b2c0-a2ee039113b6 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:20.950058 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-41b2e2f2-6de3-4221-b2c0-a2ee039113b6 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:20.950529 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-41b2e2f2-6de3-4221-b2c0-a2ee039113b6 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:20.950963 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-41b2e2f2-6de3-4221-b2c0-a2ee039113b6 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:21.096732 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-41b2e2f2-6de3-4221-b2c0-a2ee039113b6 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:21.106111 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-41b2e2f2-6de3-4221-b2c0-a2ee039113b6 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c" status: 200 len: 1697 microversion: 2.1 time: 0.169192 Oct 04 19:20:21.106689 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3517/7017] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:20 2022] GET /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c => generated 1697 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:22.129619 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-39ec2b1a-3933-46cd-ba77-75008bf3ab4c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:22.130253 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-39ec2b1a-3933-46cd-ba77-75008bf3ab4c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: dc5ffce6-cecc-4268-b307-e4e96eeb222c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:22.138177 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-39ec2b1a-3933-46cd-ba77-75008bf3ab4c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:22.138677 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-39ec2b1a-3933-46cd-ba77-75008bf3ab4c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:22.139126 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-39ec2b1a-3933-46cd-ba77-75008bf3ab4c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:22.139828 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-39ec2b1a-3933-46cd-ba77-75008bf3ab4c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:22.140329 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-39ec2b1a-3933-46cd-ba77-75008bf3ab4c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:22.140771 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-39ec2b1a-3933-46cd-ba77-75008bf3ab4c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:22.274757 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-39ec2b1a-3933-46cd-ba77-75008bf3ab4c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:22.282567 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-39ec2b1a-3933-46cd-ba77-75008bf3ab4c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c" status: 200 len: 1697 microversion: 2.1 time: 0.156898 Oct 04 19:20:22.283148 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3501/7018] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:22 2022] GET /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c => generated 1697 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:23.306656 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ce9833e0-29e2-4ad8-8ea8-e380d305b486 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:23.307266 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ce9833e0-29e2-4ad8-8ea8-e380d305b486 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: dc5ffce6-cecc-4268-b307-e4e96eeb222c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:23.314182 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ce9833e0-29e2-4ad8-8ea8-e380d305b486 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:23.314677 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ce9833e0-29e2-4ad8-8ea8-e380d305b486 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:23.315113 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ce9833e0-29e2-4ad8-8ea8-e380d305b486 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:23.315813 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ce9833e0-29e2-4ad8-8ea8-e380d305b486 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:23.316300 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ce9833e0-29e2-4ad8-8ea8-e380d305b486 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:23.316733 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ce9833e0-29e2-4ad8-8ea8-e380d305b486 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:23.455688 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ce9833e0-29e2-4ad8-8ea8-e380d305b486 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:23.464188 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ce9833e0-29e2-4ad8-8ea8-e380d305b486 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c" status: 200 len: 1697 microversion: 2.1 time: 0.162348 Oct 04 19:20:23.465018 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3518/7019] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:23 2022] GET /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c => generated 1697 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:24.486840 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4060c87d-c9c1-4f28-884c-66e16e236c2f tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:24.487474 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4060c87d-c9c1-4f28-884c-66e16e236c2f tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: dc5ffce6-cecc-4268-b307-e4e96eeb222c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:24.495120 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4060c87d-c9c1-4f28-884c-66e16e236c2f tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:24.495621 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4060c87d-c9c1-4f28-884c-66e16e236c2f tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:24.496099 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4060c87d-c9c1-4f28-884c-66e16e236c2f tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:24.496848 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4060c87d-c9c1-4f28-884c-66e16e236c2f tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:24.497351 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4060c87d-c9c1-4f28-884c-66e16e236c2f tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:24.497793 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4060c87d-c9c1-4f28-884c-66e16e236c2f tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:24.633404 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4060c87d-c9c1-4f28-884c-66e16e236c2f tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:24.642151 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4060c87d-c9c1-4f28-884c-66e16e236c2f tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c" status: 200 len: 1697 microversion: 2.1 time: 0.159290 Oct 04 19:20:24.642737 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3502/7020] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:24 2022] GET /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c => generated 1697 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:25.666674 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-29642094-5bfb-4aa9-ba53-61e4200fa431 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:25.667332 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-29642094-5bfb-4aa9-ba53-61e4200fa431 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: dc5ffce6-cecc-4268-b307-e4e96eeb222c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:25.674258 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-29642094-5bfb-4aa9-ba53-61e4200fa431 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:25.674745 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-29642094-5bfb-4aa9-ba53-61e4200fa431 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:25.675189 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-29642094-5bfb-4aa9-ba53-61e4200fa431 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:25.675885 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-29642094-5bfb-4aa9-ba53-61e4200fa431 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:25.676386 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-29642094-5bfb-4aa9-ba53-61e4200fa431 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:25.676840 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-29642094-5bfb-4aa9-ba53-61e4200fa431 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:25.809583 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-29642094-5bfb-4aa9-ba53-61e4200fa431 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:25.817349 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-29642094-5bfb-4aa9-ba53-61e4200fa431 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c" status: 200 len: 1697 microversion: 2.1 time: 0.155193 Oct 04 19:20:25.817942 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3519/7021] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:25 2022] GET /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c => generated 1697 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:26.841626 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b3e75af7-06c8-4b8a-858d-4682d59885a1 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:26.842189 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b3e75af7-06c8-4b8a-858d-4682d59885a1 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: dc5ffce6-cecc-4268-b307-e4e96eeb222c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:26.849227 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b3e75af7-06c8-4b8a-858d-4682d59885a1 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:26.849733 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b3e75af7-06c8-4b8a-858d-4682d59885a1 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:26.850221 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b3e75af7-06c8-4b8a-858d-4682d59885a1 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:26.850935 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b3e75af7-06c8-4b8a-858d-4682d59885a1 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:26.851406 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b3e75af7-06c8-4b8a-858d-4682d59885a1 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:26.852410 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b3e75af7-06c8-4b8a-858d-4682d59885a1 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:26.987309 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b3e75af7-06c8-4b8a-858d-4682d59885a1 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:26.995173 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b3e75af7-06c8-4b8a-858d-4682d59885a1 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c" status: 200 len: 1697 microversion: 2.1 time: 0.157841 Oct 04 19:20:26.995746 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3503/7022] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:26 2022] GET /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c => generated 1697 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:20:28.019060 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-900e708c-84ba-479a-a06f-1b9e298044cb tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:28.020319 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-900e708c-84ba-479a-a06f-1b9e298044cb tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: dc5ffce6-cecc-4268-b307-e4e96eeb222c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:28.028122 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-900e708c-84ba-479a-a06f-1b9e298044cb tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:28.033456 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-900e708c-84ba-479a-a06f-1b9e298044cb tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:28.033456 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-900e708c-84ba-479a-a06f-1b9e298044cb tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:28.033456 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-900e708c-84ba-479a-a06f-1b9e298044cb tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:28.033456 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-900e708c-84ba-479a-a06f-1b9e298044cb tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:28.033456 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-900e708c-84ba-479a-a06f-1b9e298044cb tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:28.252237 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-900e708c-84ba-479a-a06f-1b9e298044cb tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:28.261216 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-900e708c-84ba-479a-a06f-1b9e298044cb tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c" status: 200 len: 1697 microversion: 2.1 time: 0.246310 Oct 04 19:20:28.261805 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3520/7023] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:28 2022] GET /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c => generated 1697 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:29.006310 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-34032060-3d43-4bf3-9b20-a3a9784edc4b req-4501a128-2f0e-4ac8-b58a-76eb9a195d78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc5ffce6-cecc-4268-b307-e4e96eeb222c", "name": "network-vif-unplugged", "status": "completed", "tag": "25664e6d-4108-414f-95fa-c9e8086c70fd"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:20:29.016980 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-34032060-3d43-4bf3-9b20-a3a9784edc4b req-4501a128-2f0e-4ac8-b58a-76eb9a195d78 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:29.017480 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-34032060-3d43-4bf3-9b20-a3a9784edc4b req-4501a128-2f0e-4ac8-b58a-76eb9a195d78 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:29.017929 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-34032060-3d43-4bf3-9b20-a3a9784edc4b req-4501a128-2f0e-4ac8-b58a-76eb9a195d78 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:29.029809 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-34032060-3d43-4bf3-9b20-a3a9784edc4b req-4501a128-2f0e-4ac8-b58a-76eb9a195d78 service nova] Creating event network-vif-unplugged:25664e6d-4108-414f-95fa-c9e8086c70fd for instance dc5ffce6-cecc-4268-b307-e4e96eeb222c on n-h2-850501-14 Oct 04 19:20:29.035201 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [req-34032060-3d43-4bf3-9b20-a3a9784edc4b req-4501a128-2f0e-4ac8-b58a-76eb9a195d78 service nova] Instance dc5ffce6-cecc-4268-b307-e4e96eeb222c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850501-14', 'n-h2-850501-14'} {{(pid=123002) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:20:29.048028 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-34032060-3d43-4bf3-9b20-a3a9784edc4b req-4501a128-2f0e-4ac8-b58a-76eb9a195d78 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045433 Oct 04 19:20:29.048674 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3504/7024] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:20:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:20:29.285347 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f498ba94-ef97-4905-9dad-699d74efccfe tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:29.285951 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f498ba94-ef97-4905-9dad-699d74efccfe tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: dc5ffce6-cecc-4268-b307-e4e96eeb222c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:29.293137 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f498ba94-ef97-4905-9dad-699d74efccfe tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:29.293616 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f498ba94-ef97-4905-9dad-699d74efccfe tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:29.294049 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f498ba94-ef97-4905-9dad-699d74efccfe tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:29.294736 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f498ba94-ef97-4905-9dad-699d74efccfe tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:29.295186 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f498ba94-ef97-4905-9dad-699d74efccfe tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:29.295607 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f498ba94-ef97-4905-9dad-699d74efccfe tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:29.434100 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f498ba94-ef97-4905-9dad-699d74efccfe tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:29.442197 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f498ba94-ef97-4905-9dad-699d74efccfe tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c" status: 200 len: 1696 microversion: 2.1 time: 0.160799 Oct 04 19:20:29.442793 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3521/7025] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:29 2022] GET /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c => generated 1696 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:30.467814 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-400c5b23-2a93-4b46-93ff-537b29e4484b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:30.468577 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-400c5b23-2a93-4b46-93ff-537b29e4484b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: dc5ffce6-cecc-4268-b307-e4e96eeb222c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:30.474760 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-400c5b23-2a93-4b46-93ff-537b29e4484b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:30.475263 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-400c5b23-2a93-4b46-93ff-537b29e4484b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:30.475717 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-400c5b23-2a93-4b46-93ff-537b29e4484b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:30.477038 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-400c5b23-2a93-4b46-93ff-537b29e4484b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:30.477708 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-400c5b23-2a93-4b46-93ff-537b29e4484b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:30.478159 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-400c5b23-2a93-4b46-93ff-537b29e4484b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:30.615958 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-400c5b23-2a93-4b46-93ff-537b29e4484b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:30.624885 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-400c5b23-2a93-4b46-93ff-537b29e4484b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c" status: 200 len: 1696 microversion: 2.1 time: 0.162627 Oct 04 19:20:30.625468 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3505/7026] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:30 2022] GET /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c => generated 1696 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:31.064353 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-9064f527-349e-462b-bf31-3fa35cfe3f99 req-981cb140-dd37-44c9-888e-7298e541e845 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc5ffce6-cecc-4268-b307-e4e96eeb222c", "tag": "25664e6d-4108-414f-95fa-c9e8086c70fd"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:20:31.075418 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-9064f527-349e-462b-bf31-3fa35cfe3f99 req-981cb140-dd37-44c9-888e-7298e541e845 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:31.075921 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-9064f527-349e-462b-bf31-3fa35cfe3f99 req-981cb140-dd37-44c9-888e-7298e541e845 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:31.076399 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-9064f527-349e-462b-bf31-3fa35cfe3f99 req-981cb140-dd37-44c9-888e-7298e541e845 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:31.088642 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-9064f527-349e-462b-bf31-3fa35cfe3f99 req-981cb140-dd37-44c9-888e-7298e541e845 service nova] Creating event network-changed:25664e6d-4108-414f-95fa-c9e8086c70fd for instance dc5ffce6-cecc-4268-b307-e4e96eeb222c on n-h2-850501-14 Oct 04 19:20:31.094270 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [req-9064f527-349e-462b-bf31-3fa35cfe3f99 req-981cb140-dd37-44c9-888e-7298e541e845 service nova] Instance dc5ffce6-cecc-4268-b307-e4e96eeb222c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850501-14', 'n-h2-850501-14'} {{(pid=123001) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:20:31.105970 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-9064f527-349e-462b-bf31-3fa35cfe3f99 req-981cb140-dd37-44c9-888e-7298e541e845 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045310 Oct 04 19:20:31.106567 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3522/7027] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:20:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:20:31.649453 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2dbe7152-3ac0-4888-83a0-99a4bfe43374 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:31.650194 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2dbe7152-3ac0-4888-83a0-99a4bfe43374 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: dc5ffce6-cecc-4268-b307-e4e96eeb222c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:31.657486 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2dbe7152-3ac0-4888-83a0-99a4bfe43374 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:31.658008 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2dbe7152-3ac0-4888-83a0-99a4bfe43374 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:31.658462 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2dbe7152-3ac0-4888-83a0-99a4bfe43374 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:31.659193 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2dbe7152-3ac0-4888-83a0-99a4bfe43374 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:31.659675 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2dbe7152-3ac0-4888-83a0-99a4bfe43374 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:31.660150 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2dbe7152-3ac0-4888-83a0-99a4bfe43374 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:31.887173 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2dbe7152-3ac0-4888-83a0-99a4bfe43374 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:31.894982 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2dbe7152-3ac0-4888-83a0-99a4bfe43374 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c" status: 200 len: 1694 microversion: 2.1 time: 0.250249 Oct 04 19:20:31.895756 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3506/7028] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:31 2022] GET /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c => generated 1694 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:32.923189 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-aa3a00d5-b8ce-4d28-920d-43f61088752e tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:32.925934 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-aa3a00d5-b8ce-4d28-920d-43f61088752e tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: dc5ffce6-cecc-4268-b307-e4e96eeb222c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:32.931771 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aa3a00d5-b8ce-4d28-920d-43f61088752e tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:32.932307 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aa3a00d5-b8ce-4d28-920d-43f61088752e tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:32.932744 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aa3a00d5-b8ce-4d28-920d-43f61088752e tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:32.933460 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aa3a00d5-b8ce-4d28-920d-43f61088752e tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:32.933913 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aa3a00d5-b8ce-4d28-920d-43f61088752e tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:32.934342 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aa3a00d5-b8ce-4d28-920d-43f61088752e tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:33.069253 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-aa3a00d5-b8ce-4d28-920d-43f61088752e tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:33.077889 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-aa3a00d5-b8ce-4d28-920d-43f61088752e tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c" status: 200 len: 1694 microversion: 2.1 time: 0.161851 Oct 04 19:20:33.078482 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3523/7029] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:32 2022] GET /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c => generated 1694 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:34.102185 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f6b140c2-dc49-4d0c-8d09-c319a0ff3e66 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:34.102916 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f6b140c2-dc49-4d0c-8d09-c319a0ff3e66 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: dc5ffce6-cecc-4268-b307-e4e96eeb222c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:34.109908 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f6b140c2-dc49-4d0c-8d09-c319a0ff3e66 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:34.110455 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f6b140c2-dc49-4d0c-8d09-c319a0ff3e66 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:34.110912 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f6b140c2-dc49-4d0c-8d09-c319a0ff3e66 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:34.111621 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f6b140c2-dc49-4d0c-8d09-c319a0ff3e66 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:34.112122 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f6b140c2-dc49-4d0c-8d09-c319a0ff3e66 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:34.112568 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f6b140c2-dc49-4d0c-8d09-c319a0ff3e66 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:34.251205 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f6b140c2-dc49-4d0c-8d09-c319a0ff3e66 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:34.260344 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f6b140c2-dc49-4d0c-8d09-c319a0ff3e66 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c" status: 200 len: 1691 microversion: 2.1 time: 0.162719 Oct 04 19:20:34.260948 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3507/7030] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:34 2022] GET /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c => generated 1691 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:34.286706 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2a73bff9-44ba-40d7-ae57-e0bc7eb892b5 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:20:34.287250 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2a73bff9-44ba-40d7-ae57-e0bc7eb892b5 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: dc5ffce6-cecc-4268-b307-e4e96eeb222c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:34.295756 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2a73bff9-44ba-40d7-ae57-e0bc7eb892b5 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:34.296276 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2a73bff9-44ba-40d7-ae57-e0bc7eb892b5 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:34.296722 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2a73bff9-44ba-40d7-ae57-e0bc7eb892b5 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:34.297424 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2a73bff9-44ba-40d7-ae57-e0bc7eb892b5 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:34.297874 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2a73bff9-44ba-40d7-ae57-e0bc7eb892b5 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:34.298434 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2a73bff9-44ba-40d7-ae57-e0bc7eb892b5 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:34.318108 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:20:34.473113 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2a73bff9-44ba-40d7-ae57-e0bc7eb892b5 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "POST /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c/action" status: 204 len: 0 microversion: 2.1 time: 0.190485 Oct 04 19:20:34.473794 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3524/7031] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 19:20:34 2022] POST /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c/action => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:20:34.482618 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5a03fc47-8bc4-4751-938c-81bd496611f5 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:34.484133 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5a03fc47-8bc4-4751-938c-81bd496611f5 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: dc5ffce6-cecc-4268-b307-e4e96eeb222c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:34.489687 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5a03fc47-8bc4-4751-938c-81bd496611f5 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:34.490184 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5a03fc47-8bc4-4751-938c-81bd496611f5 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:34.490898 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5a03fc47-8bc4-4751-938c-81bd496611f5 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:34.492485 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5a03fc47-8bc4-4751-938c-81bd496611f5 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:34.493433 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5a03fc47-8bc4-4751-938c-81bd496611f5 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:34.493433 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5a03fc47-8bc4-4751-938c-81bd496611f5 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:34.740016 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5a03fc47-8bc4-4751-938c-81bd496611f5 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:34.749078 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5a03fc47-8bc4-4751-938c-81bd496611f5 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c" status: 200 len: 1691 microversion: 2.1 time: 0.270787 Oct 04 19:20:34.750698 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3508/7032] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:34 2022] GET /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c => generated 1691 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:35.779598 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-68dda3d2-a8cd-4dc1-8539-3cfafee4e809 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:35.780332 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-68dda3d2-a8cd-4dc1-8539-3cfafee4e809 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: dc5ffce6-cecc-4268-b307-e4e96eeb222c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:35.786600 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-68dda3d2-a8cd-4dc1-8539-3cfafee4e809 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:35.787093 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-68dda3d2-a8cd-4dc1-8539-3cfafee4e809 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:35.787535 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-68dda3d2-a8cd-4dc1-8539-3cfafee4e809 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:35.788266 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-68dda3d2-a8cd-4dc1-8539-3cfafee4e809 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:35.789032 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-68dda3d2-a8cd-4dc1-8539-3cfafee4e809 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:35.789662 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-68dda3d2-a8cd-4dc1-8539-3cfafee4e809 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:35.880071 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-0923d93b-5cba-49e8-a5f5-e22e8ef1a28e req-717599f5-16a0-416d-9184-e958759a3898 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc5ffce6-cecc-4268-b307-e4e96eeb222c", "name": "network-vif-plugged", "status": "completed", "tag": "25664e6d-4108-414f-95fa-c9e8086c70fd"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:20:35.903185 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-0923d93b-5cba-49e8-a5f5-e22e8ef1a28e req-717599f5-16a0-416d-9184-e958759a3898 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:35.903712 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-0923d93b-5cba-49e8-a5f5-e22e8ef1a28e req-717599f5-16a0-416d-9184-e958759a3898 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:35.904240 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-0923d93b-5cba-49e8-a5f5-e22e8ef1a28e req-717599f5-16a0-416d-9184-e958759a3898 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:35.918350 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-0923d93b-5cba-49e8-a5f5-e22e8ef1a28e req-717599f5-16a0-416d-9184-e958759a3898 service nova] Creating event network-vif-plugged:25664e6d-4108-414f-95fa-c9e8086c70fd for instance dc5ffce6-cecc-4268-b307-e4e96eeb222c on n-h2-850501-14 Oct 04 19:20:35.924776 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [req-0923d93b-5cba-49e8-a5f5-e22e8ef1a28e req-717599f5-16a0-416d-9184-e958759a3898 service nova] Instance dc5ffce6-cecc-4268-b307-e4e96eeb222c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850501-14', 'n-h2-850501-14'} {{(pid=123002) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:20:35.938525 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-0923d93b-5cba-49e8-a5f5-e22e8ef1a28e req-717599f5-16a0-416d-9184-e958759a3898 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062423 Oct 04 19:20:35.939207 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3509/7033] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:20:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:20:35.959654 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-68dda3d2-a8cd-4dc1-8539-3cfafee4e809 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:35.973653 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-68dda3d2-a8cd-4dc1-8539-3cfafee4e809 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c" status: 200 len: 1691 microversion: 2.1 time: 0.200370 Oct 04 19:20:35.974249 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3525/7034] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:35 2022] GET /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c => generated 1691 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:36.998678 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6c944f2c-1e64-4a01-a8b6-5767760d1294 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:36.999352 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-6c944f2c-1e64-4a01-a8b6-5767760d1294 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: dc5ffce6-cecc-4268-b307-e4e96eeb222c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:37.001331 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=35 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:20:37.006267 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6c944f2c-1e64-4a01-a8b6-5767760d1294 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:37.006770 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6c944f2c-1e64-4a01-a8b6-5767760d1294 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:37.007299 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6c944f2c-1e64-4a01-a8b6-5767760d1294 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:37.008605 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6c944f2c-1e64-4a01-a8b6-5767760d1294 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:37.011994 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6c944f2c-1e64-4a01-a8b6-5767760d1294 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:37.011994 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6c944f2c-1e64-4a01-a8b6-5767760d1294 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:37.012211 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=97 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:20:37.144442 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-6c944f2c-1e64-4a01-a8b6-5767760d1294 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:37.152757 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6c944f2c-1e64-4a01-a8b6-5767760d1294 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c" status: 200 len: 1683 microversion: 2.1 time: 0.159265 Oct 04 19:20:37.153334 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3510/7035] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:36 2022] GET /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:21:07.396498 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c8e98523-b95c-46d5-b6e5-b12dba47c626 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:21:07.398655 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c8e98523-b95c-46d5-b6e5-b12dba47c626 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: dc5ffce6-cecc-4268-b307-e4e96eeb222c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:07.401535 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=36 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:21:07.402202 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=13,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:21:07.406904 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c8e98523-b95c-46d5-b6e5-b12dba47c626 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:07.407485 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c8e98523-b95c-46d5-b6e5-b12dba47c626 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:07.407922 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c8e98523-b95c-46d5-b6e5-b12dba47c626 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:07.408632 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c8e98523-b95c-46d5-b6e5-b12dba47c626 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:07.409086 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c8e98523-b95c-46d5-b6e5-b12dba47c626 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:07.409507 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c8e98523-b95c-46d5-b6e5-b12dba47c626 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:07.482869 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c8e98523-b95c-46d5-b6e5-b12dba47c626 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "POST /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c/action" status: 200 len: 24580 microversion: 2.1 time: 0.090671 Oct 04 19:21:07.483535 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3526/7036] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 19:21:07 2022] POST /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c/action => generated 24580 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:21:23.835044 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0c619056-3d1c-47f7-a633-fc96422af264 tempest-TestNetworkAdvancedServerOps-443223969 tempest-TestNetworkAdvancedServerOps-443223969-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:23.835833 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0c619056-3d1c-47f7-a633-fc96422af264 tempest-TestNetworkAdvancedServerOps-443223969 tempest-TestNetworkAdvancedServerOps-443223969-project-admin] [instance: dc5ffce6-cecc-4268-b307-e4e96eeb222c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:23.838130 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:21:23.838987 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=5 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:21:23.844568 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0c619056-3d1c-47f7-a633-fc96422af264 tempest-TestNetworkAdvancedServerOps-443223969 tempest-TestNetworkAdvancedServerOps-443223969-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:23.845138 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0c619056-3d1c-47f7-a633-fc96422af264 tempest-TestNetworkAdvancedServerOps-443223969 tempest-TestNetworkAdvancedServerOps-443223969-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:23.845573 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0c619056-3d1c-47f7-a633-fc96422af264 tempest-TestNetworkAdvancedServerOps-443223969 tempest-TestNetworkAdvancedServerOps-443223969-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:23.846282 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0c619056-3d1c-47f7-a633-fc96422af264 tempest-TestNetworkAdvancedServerOps-443223969 tempest-TestNetworkAdvancedServerOps-443223969-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:23.846754 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0c619056-3d1c-47f7-a633-fc96422af264 tempest-TestNetworkAdvancedServerOps-443223969 tempest-TestNetworkAdvancedServerOps-443223969-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:23.847194 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0c619056-3d1c-47f7-a633-fc96422af264 tempest-TestNetworkAdvancedServerOps-443223969 tempest-TestNetworkAdvancedServerOps-443223969-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:23.982147 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0c619056-3d1c-47f7-a633-fc96422af264 tempest-TestNetworkAdvancedServerOps-443223969 tempest-TestNetworkAdvancedServerOps-443223969-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c" status: 200 len: 1836 microversion: 2.1 time: 0.151137 Oct 04 19:21:23.982726 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3511/7037] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:23 2022] GET /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c => generated 1836 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:21:24.947471 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-26f7c03f-9234-4110-926c-6bba9c4923ca tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:24.948160 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-26f7c03f-9234-4110-926c-6bba9c4923ca tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: dc5ffce6-cecc-4268-b307-e4e96eeb222c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:24.953154 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:21:24.954834 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-ee007eba-fafe-409a-971c-1a317cc39df7 req-6d2cbae7-6086-4340-8805-16effceee97b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc5ffce6-cecc-4268-b307-e4e96eeb222c", "tag": "25664e6d-4108-414f-95fa-c9e8086c70fd"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:21:24.958268 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-26f7c03f-9234-4110-926c-6bba9c4923ca tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:24.958818 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-26f7c03f-9234-4110-926c-6bba9c4923ca tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:24.959312 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-26f7c03f-9234-4110-926c-6bba9c4923ca tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:24.959966 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-26f7c03f-9234-4110-926c-6bba9c4923ca tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:24.960888 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-26f7c03f-9234-4110-926c-6bba9c4923ca tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:24.961012 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-26f7c03f-9234-4110-926c-6bba9c4923ca tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:24.964401 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-ee007eba-fafe-409a-971c-1a317cc39df7 req-6d2cbae7-6086-4340-8805-16effceee97b service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:24.965204 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-ee007eba-fafe-409a-971c-1a317cc39df7 req-6d2cbae7-6086-4340-8805-16effceee97b service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:24.965702 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-ee007eba-fafe-409a-971c-1a317cc39df7 req-6d2cbae7-6086-4340-8805-16effceee97b service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:24.981901 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-ee007eba-fafe-409a-971c-1a317cc39df7 req-6d2cbae7-6086-4340-8805-16effceee97b service nova] Creating event network-changed:25664e6d-4108-414f-95fa-c9e8086c70fd for instance dc5ffce6-cecc-4268-b307-e4e96eeb222c on n-h2-850501-14 Oct 04 19:21:24.987992 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-ee007eba-fafe-409a-971c-1a317cc39df7 req-6d2cbae7-6086-4340-8805-16effceee97b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038516 Oct 04 19:21:24.988876 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3512/7038] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:21:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:21:24.991610 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-26f7c03f-9234-4110-926c-6bba9c4923ca tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: dc5ffce6-cecc-4268-b307-e4e96eeb222c] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:21:25.328548 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-26f7c03f-9234-4110-926c-6bba9c4923ca tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "DELETE /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c" status: 204 len: 0 microversion: 2.1 time: 0.385248 Oct 04 19:21:25.332398 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3527/7039] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 19:21:24 2022] DELETE /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c => generated 0 bytes in 387 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:21:25.338701 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-efe6d94c-76f9-4221-b7d5-b8389ee23b12 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:25.339366 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-efe6d94c-76f9-4221-b7d5-b8389ee23b12 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: dc5ffce6-cecc-4268-b307-e4e96eeb222c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:25.346254 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-efe6d94c-76f9-4221-b7d5-b8389ee23b12 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:25.346757 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-efe6d94c-76f9-4221-b7d5-b8389ee23b12 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:25.347209 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-efe6d94c-76f9-4221-b7d5-b8389ee23b12 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:25.347924 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-efe6d94c-76f9-4221-b7d5-b8389ee23b12 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:25.348434 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-efe6d94c-76f9-4221-b7d5-b8389ee23b12 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:25.348886 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-efe6d94c-76f9-4221-b7d5-b8389ee23b12 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:25.493038 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-efe6d94c-76f9-4221-b7d5-b8389ee23b12 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:25.501076 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-efe6d94c-76f9-4221-b7d5-b8389ee23b12 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c" status: 200 len: 1689 microversion: 2.1 time: 0.166906 Oct 04 19:21:25.501690 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3513/7040] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:25 2022] GET /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c => generated 1689 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:21:26.528214 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-823478b9-173c-4255-947e-8f05dcc769bb tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:26.529382 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-823478b9-173c-4255-947e-8f05dcc769bb tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: dc5ffce6-cecc-4268-b307-e4e96eeb222c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:26.536875 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-823478b9-173c-4255-947e-8f05dcc769bb tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:26.537368 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-823478b9-173c-4255-947e-8f05dcc769bb tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:26.537827 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-823478b9-173c-4255-947e-8f05dcc769bb tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:26.538509 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-823478b9-173c-4255-947e-8f05dcc769bb tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:26.538967 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-823478b9-173c-4255-947e-8f05dcc769bb tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:26.539393 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-823478b9-173c-4255-947e-8f05dcc769bb tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:26.676611 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-823478b9-173c-4255-947e-8f05dcc769bb tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:26.685196 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-823478b9-173c-4255-947e-8f05dcc769bb tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c" status: 200 len: 1689 microversion: 2.1 time: 0.161932 Oct 04 19:21:26.685769 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3528/7041] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:26 2022] GET /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c => generated 1689 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:21:27.446846 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-bb48d5c2-6969-42e1-9cbe-87fd54b674a2 req-a1397ad9-97d9-4f0b-bc8d-43004444bb95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc5ffce6-cecc-4268-b307-e4e96eeb222c", "name": "network-vif-deleted", "tag": "25664e6d-4108-414f-95fa-c9e8086c70fd"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:21:27.457639 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-bb48d5c2-6969-42e1-9cbe-87fd54b674a2 req-a1397ad9-97d9-4f0b-bc8d-43004444bb95 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:27.458569 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-bb48d5c2-6969-42e1-9cbe-87fd54b674a2 req-a1397ad9-97d9-4f0b-bc8d-43004444bb95 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:27.458674 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-bb48d5c2-6969-42e1-9cbe-87fd54b674a2 req-a1397ad9-97d9-4f0b-bc8d-43004444bb95 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:27.470572 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-bb48d5c2-6969-42e1-9cbe-87fd54b674a2 req-a1397ad9-97d9-4f0b-bc8d-43004444bb95 service nova] Creating event network-vif-deleted:25664e6d-4108-414f-95fa-c9e8086c70fd for instance dc5ffce6-cecc-4268-b307-e4e96eeb222c on n-h2-850501-14 Oct 04 19:21:27.476042 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-bb48d5c2-6969-42e1-9cbe-87fd54b674a2 req-a1397ad9-97d9-4f0b-bc8d-43004444bb95 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033353 Oct 04 19:21:27.476779 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3514/7042] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:21:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:21:27.719875 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f4e50a94-396d-4fd4-af03-896f442f5724 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:27.719875 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f4e50a94-396d-4fd4-af03-896f442f5724 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: dc5ffce6-cecc-4268-b307-e4e96eeb222c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:27.719875 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f4e50a94-396d-4fd4-af03-896f442f5724 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:27.719875 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f4e50a94-396d-4fd4-af03-896f442f5724 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:27.719875 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f4e50a94-396d-4fd4-af03-896f442f5724 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:27.719875 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f4e50a94-396d-4fd4-af03-896f442f5724 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:27.721011 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f4e50a94-396d-4fd4-af03-896f442f5724 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:27.721011 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f4e50a94-396d-4fd4-af03-896f442f5724 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:27.758067 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f4e50a94-396d-4fd4-af03-896f442f5724 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:27.758719 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f4e50a94-396d-4fd4-af03-896f442f5724 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:27.759330 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f4e50a94-396d-4fd4-af03-896f442f5724 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:27.759830 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-f4e50a94-396d-4fd4-af03-896f442f5724 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lazy-loading 'fault' on Instance uuid dc5ffce6-cecc-4268-b307-e4e96eeb222c {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:21:27.803099 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f4e50a94-396d-4fd4-af03-896f442f5724 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:27.811328 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f4e50a94-396d-4fd4-af03-896f442f5724 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c" status: 200 len: 1355 microversion: 2.1 time: 0.105735 Oct 04 19:21:27.811917 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3529/7043] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:27 2022] GET /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c => generated 1355 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:21:28.835475 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-55247c87-c16d-4dc2-9215-e371458b834c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:28.836448 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-55247c87-c16d-4dc2-9215-e371458b834c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: dc5ffce6-cecc-4268-b307-e4e96eeb222c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:28.844039 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-55247c87-c16d-4dc2-9215-e371458b834c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:28.846993 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-55247c87-c16d-4dc2-9215-e371458b834c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:28.846993 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-55247c87-c16d-4dc2-9215-e371458b834c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:28.846993 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-55247c87-c16d-4dc2-9215-e371458b834c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:28.846993 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-55247c87-c16d-4dc2-9215-e371458b834c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:28.846993 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-55247c87-c16d-4dc2-9215-e371458b834c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:28.860189 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-55247c87-c16d-4dc2-9215-e371458b834c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] HTTP exception thrown: Instance dc5ffce6-cecc-4268-b307-e4e96eeb222c could not be found. Oct 04 19:21:28.861886 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-55247c87-c16d-4dc2-9215-e371458b834c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Request method failure captured: Oct 04 19:21:28.861886 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c HTTP/1.1 Oct 04 19:21:28.861886 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 19:21:28.861886 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 19:21:28.861886 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 19:21:28.861886 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 19:21:28.861886 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 19:21:28.861886 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 19:21:28.861886 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 19:21:28.861886 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 19:21:28.861886 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPIcrTIoZmU9MC83P2pr9ihdde_O34kT-H-5oj2NnEUHxZ7u6d0iVUulFYuyLpCenTbNTzDECz-ja0Upgm5x505nJ4VYUuS8arG8yRvvAazBWadpmzk8tZWcFQnwqYgCdSmdZmyUlhN1rUbAZJtGPYmlMzSSC1eYEi1Aha5rPMaRu8oI Oct 04 19:21:28.861886 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 19:21:28.861886 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 19:21:28.861886 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 19:21:28.861886 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 19:21:28.861886 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 19:21:28.861886 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 19:21:28.861886 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 81e34eff3bda4651aece03d213439a2b Oct 04 19:21:28.861886 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1051949435 Oct 04 19:21:28.861886 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 19:21:28.861886 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 19:21:28.861886 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/81e34eff3bda4651aece03d213439a2b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_81e34eff3bda4651aece03d213439a2b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/81e34eff3bda4651aece03d213439a2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/81e34eff3bda4651aece03d213439a2b"}]}] Oct 04 19:21:28.861886 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1051949435 Oct 04 19:21:28.861886 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 81e34eff3bda4651aece03d213439a2b Oct 04 19:21:28.861886 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1051949435 Oct 04 19:21:28.861886 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-TestNetworkAdvancedServerOps-1051949435-project Oct 04 19:21:28.861886 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 19:21:28.861886 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 19:21:28.861886 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: e66faeb21cd44d9e927e436096f49e26 Oct 04 19:21:28.861886 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1051949435-project Oct 04 19:21:28.861886 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 19:21:28.861886 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance dc5ffce6-cecc-4268-b307-e4e96eeb222c could not be found. Oct 04 19:21:28.861886 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'dc5ffce6-cecc-4268-b307-e4e96eeb222c'} Oct 04 19:21:28.861886 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:21:28.861886 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:21:28.861886 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:21:28.861886 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:21:28.861886 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:21:28.861886 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:21:28.861886 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:21:28.861886 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:21:28.861886 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:21:28.861886 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:21:28.861886 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc5ffce6-cecc-4268-b307-e4e96eeb222c could not be found. Oct 04 19:21:28.861886 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:21:28.861886 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:21:28.861886 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:21:28.861886 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:21:28.861886 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:21:28.861886 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:21:28.861886 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:21:28.861886 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:21:28.861886 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:21:28.861886 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:21:28.861886 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:21:28.861886 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:21:28.861886 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:21:28.861886 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:21:28.861886 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:21:28.861886 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:21:28.861886 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc5ffce6-cecc-4268-b307-e4e96eeb222c could not be found. Oct 04 19:21:28.861886 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:21:28.861886 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:21:28.872112 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:21:28.872112 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:21:28.872112 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:21:28.872112 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:21:28.872112 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:21:28.872112 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:21:28.872112 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc5ffce6-cecc-4268-b307-e4e96eeb222c could not be found. Oct 04 19:21:28.872112 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:21:28.872112 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-55247c87-c16d-4dc2-9215-e371458b834c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Returning 404 to user: Instance dc5ffce6-cecc-4268-b307-e4e96eeb222c could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:21:28.872112 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-55247c87-c16d-4dc2-9215-e371458b834c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c" status: 404 len: 111 microversion: 2.1 time: 0.032229 Oct 04 19:21:28.872112 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3515/7044] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:28 2022] GET /compute/v2.1/servers/dc5ffce6-cecc-4268-b307-e4e96eeb222c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:21:32.636767 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-575ace1d-2bc7-4dea-9398-872df549de5d tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '.version_select at 0x7fe253c0bca0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:32.718851 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-575ace1d-2bc7-4dea-9398-872df549de5d tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-272123518" status: 202 len: 0 microversion: 2.1 time: 0.085823 Oct 04 19:21:32.719680 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3530/7045] 10.222.0.20 () {58 vars in 1281 bytes} [Tue Oct 4 19:21:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-272123518 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:21:32.755342 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6046d085-c194-47a4-bc24-d7c579276645 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Action: 'create', calling method: .version_select at 0x7fe2588b3c10>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1008140681", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMaTkr8j9XvF2OcsRtZiOLnfUVkRFnTE/YjIFEnmvVyeCG5sWlEwV07723s0hE6HNGVHZ9XrsEdeLWJSYIS5fGuGOjccEnSiFPSepdvlZGiiGwmefEeCIlRBCYmN1jHXBg=="}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:21:32.778172 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-6046d085-c194-47a4-bc24-d7c579276645 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Getting quotas for project 81e34eff3bda4651aece03d213439a2b. Resources: {'key_pairs'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:21:32.785333 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-6046d085-c194-47a4-bc24-d7c579276645 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Getting quotas for user e66faeb21cd44d9e927e436096f49e26 and project 81e34eff3bda4651aece03d213439a2b. Resources: {'key_pairs'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:21:32.878555 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6046d085-c194-47a4-bc24-d7c579276645 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.127206 Oct 04 19:21:32.879168 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3516/7046] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Oct 4 19:21:32 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:21:41.170771 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:21:41.175103 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-28d2d137-21a1-4cb9-9135-0e6622eefaee tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1339110366", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": [{"uuid": "a7d7ce88-300c-4672-9a76-895cd69f3323"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1008140681", "security_groups": [{"name": "tempest-secgroup-smoke-1777210368"}]}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:21:41.297592 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.neutron [None req-28d2d137-21a1-4cb9-9135-0e6622eefaee tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] validate_networks() for [('a7d7ce88-300c-4672-9a76-895cd69f3323', None, None, None, None, None)] {{(pid=123001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:21:41.712988 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-28d2d137-21a1-4cb9-9135-0e6622eefaee tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:21:41.713573 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-28d2d137-21a1-4cb9-9135-0e6622eefaee tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:21:41.716017 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-28d2d137-21a1-4cb9-9135-0e6622eefaee tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:21:41.718608 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-28d2d137-21a1-4cb9-9135-0e6622eefaee tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:21:41.719392 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-28d2d137-21a1-4cb9-9135-0e6622eefaee tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:21:41.731055 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-28d2d137-21a1-4cb9-9135-0e6622eefaee tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:41.731660 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-28d2d137-21a1-4cb9-9135-0e6622eefaee tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:41.732140 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-28d2d137-21a1-4cb9-9135-0e6622eefaee tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:41.732888 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-28d2d137-21a1-4cb9-9135-0e6622eefaee tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:41.733352 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-28d2d137-21a1-4cb9-9135-0e6622eefaee tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:41.733788 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-28d2d137-21a1-4cb9-9135-0e6622eefaee tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:41.754153 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-28d2d137-21a1-4cb9-9135-0e6622eefaee tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Getting quotas for project 81e34eff3bda4651aece03d213439a2b. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:21:41.759365 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-28d2d137-21a1-4cb9-9135-0e6622eefaee tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Getting quotas for user e66faeb21cd44d9e927e436096f49e26 and project 81e34eff3bda4651aece03d213439a2b. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:21:41.773315 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-28d2d137-21a1-4cb9-9135-0e6622eefaee tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Going to run 1 instances... {{(pid=123001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:21:41.775649 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-28d2d137-21a1-4cb9-9135-0e6622eefaee tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: 7cde3fb7-477a-4428-aef7-1ffe15a0920b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:21:41.887502 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-28d2d137-21a1-4cb9-9135-0e6622eefaee tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.718534 Oct 04 19:21:41.889958 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3531/7047] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 19:21:41 2022] POST /compute/v2.1/servers => generated 406 bytes in 722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:21:41.900276 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=18 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:21:41.914152 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d6b6058e-ab38-4bad-acc9-f592b1c74461 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:41.921587 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d6b6058e-ab38-4bad-acc9-f592b1c74461 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: 7cde3fb7-477a-4428-aef7-1ffe15a0920b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:42.018969 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d6b6058e-ab38-4bad-acc9-f592b1c74461 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:42.029729 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d6b6058e-ab38-4bad-acc9-f592b1c74461 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b" status: 200 len: 1267 microversion: 2.1 time: 0.132076 Oct 04 19:21:42.030924 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3517/7048] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:41 2022] GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b => generated 1267 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:21:43.055356 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-24cf56f3-aed5-4e69-8e3c-19eb1c56eee4 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:43.055977 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-24cf56f3-aed5-4e69-8e3c-19eb1c56eee4 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: 7cde3fb7-477a-4428-aef7-1ffe15a0920b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:43.064478 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-24cf56f3-aed5-4e69-8e3c-19eb1c56eee4 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:43.064964 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-24cf56f3-aed5-4e69-8e3c-19eb1c56eee4 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:43.065410 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-24cf56f3-aed5-4e69-8e3c-19eb1c56eee4 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:43.066115 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-24cf56f3-aed5-4e69-8e3c-19eb1c56eee4 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:43.066569 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-24cf56f3-aed5-4e69-8e3c-19eb1c56eee4 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:43.067001 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-24cf56f3-aed5-4e69-8e3c-19eb1c56eee4 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:43.137536 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-24cf56f3-aed5-4e69-8e3c-19eb1c56eee4 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:43.146572 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-24cf56f3-aed5-4e69-8e3c-19eb1c56eee4 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b" status: 200 len: 1263 microversion: 2.1 time: 0.095472 Oct 04 19:21:43.162661 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3532/7049] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:43 2022] GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b => generated 1263 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:21:44.172104 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-289fc421-5f0f-4e07-9097-7593387e47a8 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:44.174007 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-289fc421-5f0f-4e07-9097-7593387e47a8 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: 7cde3fb7-477a-4428-aef7-1ffe15a0920b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:44.187001 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-289fc421-5f0f-4e07-9097-7593387e47a8 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:44.187751 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-289fc421-5f0f-4e07-9097-7593387e47a8 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:44.188557 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-289fc421-5f0f-4e07-9097-7593387e47a8 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:44.189292 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-289fc421-5f0f-4e07-9097-7593387e47a8 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:44.189774 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-289fc421-5f0f-4e07-9097-7593387e47a8 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:44.190216 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-289fc421-5f0f-4e07-9097-7593387e47a8 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:44.261744 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-289fc421-5f0f-4e07-9097-7593387e47a8 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:44.270473 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-289fc421-5f0f-4e07-9097-7593387e47a8 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b" status: 200 len: 1337 microversion: 2.1 time: 0.103807 Oct 04 19:21:44.271161 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3518/7050] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:44 2022] GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b => generated 1337 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:21:45.295114 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-144c4da9-1480-447c-a785-3138f7552855 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:45.295729 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-144c4da9-1480-447c-a785-3138f7552855 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: 7cde3fb7-477a-4428-aef7-1ffe15a0920b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:45.303034 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-144c4da9-1480-447c-a785-3138f7552855 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:45.303526 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-144c4da9-1480-447c-a785-3138f7552855 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:45.304189 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-144c4da9-1480-447c-a785-3138f7552855 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:45.305008 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-144c4da9-1480-447c-a785-3138f7552855 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:45.305634 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-144c4da9-1480-447c-a785-3138f7552855 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:45.306072 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-144c4da9-1480-447c-a785-3138f7552855 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:45.575516 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-144c4da9-1480-447c-a785-3138f7552855 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:45.583321 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-144c4da9-1480-447c-a785-3138f7552855 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b" status: 200 len: 1393 microversion: 2.1 time: 0.293339 Oct 04 19:21:45.583917 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3533/7051] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:45 2022] GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b => generated 1393 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:21:45.737634 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-66b12621-c111-41d7-a133-c855ce389301 req-f033b422-595f-4b1e-a51b-b397d983c7fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cde3fb7-477a-4428-aef7-1ffe15a0920b", "tag": "1dabf904-1386-42b0-8090-091cabf42f07"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:21:45.748198 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-66b12621-c111-41d7-a133-c855ce389301 req-f033b422-595f-4b1e-a51b-b397d983c7fc service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:45.748700 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-66b12621-c111-41d7-a133-c855ce389301 req-f033b422-595f-4b1e-a51b-b397d983c7fc service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:45.749152 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-66b12621-c111-41d7-a133-c855ce389301 req-f033b422-595f-4b1e-a51b-b397d983c7fc service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:45.763402 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-66b12621-c111-41d7-a133-c855ce389301 req-f033b422-595f-4b1e-a51b-b397d983c7fc service nova] Creating event network-changed:1dabf904-1386-42b0-8090-091cabf42f07 for instance 7cde3fb7-477a-4428-aef7-1ffe15a0920b on n-h1-850501-14 Oct 04 19:21:45.768593 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-66b12621-c111-41d7-a133-c855ce389301 req-f033b422-595f-4b1e-a51b-b397d983c7fc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034806 Oct 04 19:21:45.769223 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3519/7052] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:21:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:21:46.607376 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6c94b38e-97be-484f-a141-88aac6df9905 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:46.607988 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6c94b38e-97be-484f-a141-88aac6df9905 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: 7cde3fb7-477a-4428-aef7-1ffe15a0920b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:46.614918 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6c94b38e-97be-484f-a141-88aac6df9905 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:46.615401 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6c94b38e-97be-484f-a141-88aac6df9905 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:46.615834 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6c94b38e-97be-484f-a141-88aac6df9905 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:46.616608 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6c94b38e-97be-484f-a141-88aac6df9905 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:46.617061 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6c94b38e-97be-484f-a141-88aac6df9905 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:46.617486 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6c94b38e-97be-484f-a141-88aac6df9905 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:46.759159 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6c94b38e-97be-484f-a141-88aac6df9905 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:46.767695 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6c94b38e-97be-484f-a141-88aac6df9905 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b" status: 200 len: 1393 microversion: 2.1 time: 0.164706 Oct 04 19:21:46.768303 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3534/7053] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:46 2022] GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b => generated 1393 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:21:47.791711 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-60a4198c-f6ba-4c5f-a3f4-faac55c41086 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:47.792451 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-60a4198c-f6ba-4c5f-a3f4-faac55c41086 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: 7cde3fb7-477a-4428-aef7-1ffe15a0920b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:47.798663 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-60a4198c-f6ba-4c5f-a3f4-faac55c41086 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:47.799191 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-60a4198c-f6ba-4c5f-a3f4-faac55c41086 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:47.799644 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-60a4198c-f6ba-4c5f-a3f4-faac55c41086 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:47.800382 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-60a4198c-f6ba-4c5f-a3f4-faac55c41086 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:47.800858 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-60a4198c-f6ba-4c5f-a3f4-faac55c41086 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:47.801300 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-60a4198c-f6ba-4c5f-a3f4-faac55c41086 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:47.934310 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-60a4198c-f6ba-4c5f-a3f4-faac55c41086 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:47.942083 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-60a4198c-f6ba-4c5f-a3f4-faac55c41086 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b" status: 200 len: 1393 microversion: 2.1 time: 0.155510 Oct 04 19:21:47.942658 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3520/7054] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:47 2022] GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b => generated 1393 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:21:48.965777 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c2b4467e-569d-49e0-92e2-4b6f8a4843ca tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:48.966390 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c2b4467e-569d-49e0-92e2-4b6f8a4843ca tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: 7cde3fb7-477a-4428-aef7-1ffe15a0920b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:48.973176 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c2b4467e-569d-49e0-92e2-4b6f8a4843ca tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:48.973657 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c2b4467e-569d-49e0-92e2-4b6f8a4843ca tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:48.974091 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c2b4467e-569d-49e0-92e2-4b6f8a4843ca tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:48.974776 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c2b4467e-569d-49e0-92e2-4b6f8a4843ca tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:48.975230 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c2b4467e-569d-49e0-92e2-4b6f8a4843ca tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:48.975653 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c2b4467e-569d-49e0-92e2-4b6f8a4843ca tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:49.113249 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c2b4467e-569d-49e0-92e2-4b6f8a4843ca tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:49.121235 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c2b4467e-569d-49e0-92e2-4b6f8a4843ca tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b" status: 200 len: 1393 microversion: 2.1 time: 0.160222 Oct 04 19:21:49.121803 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3535/7055] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:48 2022] GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b => generated 1393 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:21:50.144555 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-88484d6a-874e-4f87-acb4-c91913619914 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:50.145187 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-88484d6a-874e-4f87-acb4-c91913619914 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: 7cde3fb7-477a-4428-aef7-1ffe15a0920b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:50.153209 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-88484d6a-874e-4f87-acb4-c91913619914 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:50.153713 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-88484d6a-874e-4f87-acb4-c91913619914 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:50.154169 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-88484d6a-874e-4f87-acb4-c91913619914 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:50.154881 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-88484d6a-874e-4f87-acb4-c91913619914 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:50.155355 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-88484d6a-874e-4f87-acb4-c91913619914 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:50.155799 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-88484d6a-874e-4f87-acb4-c91913619914 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:50.288237 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-88484d6a-874e-4f87-acb4-c91913619914 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:50.296640 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-88484d6a-874e-4f87-acb4-c91913619914 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b" status: 200 len: 1393 microversion: 2.1 time: 0.156207 Oct 04 19:21:50.297226 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3521/7056] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:50 2022] GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b => generated 1393 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:21:51.305608 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-d3e07888-6156-4037-8797-c18c634c7f43 req-d58f9275-8b08-4150-b964-d76c134688c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cde3fb7-477a-4428-aef7-1ffe15a0920b", "name": "network-vif-plugged", "status": "completed", "tag": "1dabf904-1386-42b0-8090-091cabf42f07"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:21:51.317313 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-d3e07888-6156-4037-8797-c18c634c7f43 req-d58f9275-8b08-4150-b964-d76c134688c0 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:51.317797 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-d3e07888-6156-4037-8797-c18c634c7f43 req-d58f9275-8b08-4150-b964-d76c134688c0 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:51.318304 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-d3e07888-6156-4037-8797-c18c634c7f43 req-d58f9275-8b08-4150-b964-d76c134688c0 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:51.319867 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4d3c9ca6-0ce8-4bf8-bd51-d0d433726120 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:51.320584 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4d3c9ca6-0ce8-4bf8-bd51-d0d433726120 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: 7cde3fb7-477a-4428-aef7-1ffe15a0920b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:51.327769 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4d3c9ca6-0ce8-4bf8-bd51-d0d433726120 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:51.328304 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4d3c9ca6-0ce8-4bf8-bd51-d0d433726120 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:51.329178 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4d3c9ca6-0ce8-4bf8-bd51-d0d433726120 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:51.330351 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4d3c9ca6-0ce8-4bf8-bd51-d0d433726120 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:51.330480 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4d3c9ca6-0ce8-4bf8-bd51-d0d433726120 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:51.330816 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4d3c9ca6-0ce8-4bf8-bd51-d0d433726120 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:51.332392 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-d3e07888-6156-4037-8797-c18c634c7f43 req-d58f9275-8b08-4150-b964-d76c134688c0 service nova] Creating event network-vif-plugged:1dabf904-1386-42b0-8090-091cabf42f07 for instance 7cde3fb7-477a-4428-aef7-1ffe15a0920b on n-h1-850501-14 Oct 04 19:21:51.337393 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-d3e07888-6156-4037-8797-c18c634c7f43 req-d58f9275-8b08-4150-b964-d76c134688c0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035548 Oct 04 19:21:51.338020 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3536/7057] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:21:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:21:51.518089 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4d3c9ca6-0ce8-4bf8-bd51-d0d433726120 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:51.526371 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4d3c9ca6-0ce8-4bf8-bd51-d0d433726120 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b" status: 200 len: 1393 microversion: 2.1 time: 0.210153 Oct 04 19:21:51.527121 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3522/7058] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:51 2022] GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b => generated 1393 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:21:52.548292 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:21:52.549062 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=6 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:21:52.553958 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-57022641-4a16-4e71-8e6c-4bdd6e71cdd3 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:52.554799 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-57022641-4a16-4e71-8e6c-4bdd6e71cdd3 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: 7cde3fb7-477a-4428-aef7-1ffe15a0920b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:52.561944 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-57022641-4a16-4e71-8e6c-4bdd6e71cdd3 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:52.562438 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-57022641-4a16-4e71-8e6c-4bdd6e71cdd3 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:52.562872 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-57022641-4a16-4e71-8e6c-4bdd6e71cdd3 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:52.563575 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-57022641-4a16-4e71-8e6c-4bdd6e71cdd3 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:52.564027 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-57022641-4a16-4e71-8e6c-4bdd6e71cdd3 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:52.564478 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-57022641-4a16-4e71-8e6c-4bdd6e71cdd3 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:52.704864 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-57022641-4a16-4e71-8e6c-4bdd6e71cdd3 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:52.712811 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-57022641-4a16-4e71-8e6c-4bdd6e71cdd3 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b" status: 200 len: 1393 microversion: 2.1 time: 0.165472 Oct 04 19:21:52.713393 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3537/7059] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:52 2022] GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b => generated 1393 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:21:53.737062 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b77996b1-f046-443d-a625-d77db5f7c465 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:53.737731 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b77996b1-f046-443d-a625-d77db5f7c465 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: 7cde3fb7-477a-4428-aef7-1ffe15a0920b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:53.739811 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=6 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:21:53.745579 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b77996b1-f046-443d-a625-d77db5f7c465 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:53.746392 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b77996b1-f046-443d-a625-d77db5f7c465 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:53.746654 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b77996b1-f046-443d-a625-d77db5f7c465 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:53.747365 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b77996b1-f046-443d-a625-d77db5f7c465 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:53.747904 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b77996b1-f046-443d-a625-d77db5f7c465 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:53.748378 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b77996b1-f046-443d-a625-d77db5f7c465 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:53.887947 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b77996b1-f046-443d-a625-d77db5f7c465 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:53.896034 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b77996b1-f046-443d-a625-d77db5f7c465 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b" status: 200 len: 1565 microversion: 2.1 time: 0.162929 Oct 04 19:21:53.896657 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3523/7060] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:53 2022] GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b => generated 1565 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:21:53.919337 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-22f8597d-2a0e-4ca0-a6a7-062838ca7ae3 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:53.919946 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-22f8597d-2a0e-4ca0-a6a7-062838ca7ae3 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: 7cde3fb7-477a-4428-aef7-1ffe15a0920b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:53.926749 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-22f8597d-2a0e-4ca0-a6a7-062838ca7ae3 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:53.927229 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-22f8597d-2a0e-4ca0-a6a7-062838ca7ae3 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:53.927669 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-22f8597d-2a0e-4ca0-a6a7-062838ca7ae3 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:53.928416 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-22f8597d-2a0e-4ca0-a6a7-062838ca7ae3 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:53.928876 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-22f8597d-2a0e-4ca0-a6a7-062838ca7ae3 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:53.929300 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-22f8597d-2a0e-4ca0-a6a7-062838ca7ae3 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:54.062563 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-22f8597d-2a0e-4ca0-a6a7-062838ca7ae3 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:54.070321 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-22f8597d-2a0e-4ca0-a6a7-062838ca7ae3 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b" status: 200 len: 1565 microversion: 2.1 time: 0.155411 Oct 04 19:21:54.070890 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3538/7061] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:53 2022] GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b => generated 1565 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:21:55.941598 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-28a4af3d-b7d4-4c0a-80b7-bf7c6aad4720 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:55.942251 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-28a4af3d-b7d4-4c0a-80b7-bf7c6aad4720 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: 7cde3fb7-477a-4428-aef7-1ffe15a0920b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:55.946245 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:21:55.951061 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-28a4af3d-b7d4-4c0a-80b7-bf7c6aad4720 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:55.952942 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-28a4af3d-b7d4-4c0a-80b7-bf7c6aad4720 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:55.952942 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-28a4af3d-b7d4-4c0a-80b7-bf7c6aad4720 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:55.954115 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-28a4af3d-b7d4-4c0a-80b7-bf7c6aad4720 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:55.954788 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-28a4af3d-b7d4-4c0a-80b7-bf7c6aad4720 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:55.955918 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-28a4af3d-b7d4-4c0a-80b7-bf7c6aad4720 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:56.028632 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-86b7f5d9-bd38-4b55-a6af-fa7e4f2bbed4 req-589c6c5b-fe1a-486a-bae5-7ec49667cc9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cde3fb7-477a-4428-aef7-1ffe15a0920b", "tag": "1dabf904-1386-42b0-8090-091cabf42f07"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:21:56.033524 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:21:56.040094 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-86b7f5d9-bd38-4b55-a6af-fa7e4f2bbed4 req-589c6c5b-fe1a-486a-bae5-7ec49667cc9d service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:56.040774 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-86b7f5d9-bd38-4b55-a6af-fa7e4f2bbed4 req-589c6c5b-fe1a-486a-bae5-7ec49667cc9d service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:56.041205 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-86b7f5d9-bd38-4b55-a6af-fa7e4f2bbed4 req-589c6c5b-fe1a-486a-bae5-7ec49667cc9d service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:56.052985 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-86b7f5d9-bd38-4b55-a6af-fa7e4f2bbed4 req-589c6c5b-fe1a-486a-bae5-7ec49667cc9d service nova] Creating event network-changed:1dabf904-1386-42b0-8090-091cabf42f07 for instance 7cde3fb7-477a-4428-aef7-1ffe15a0920b on n-h1-850501-14 Oct 04 19:21:56.059217 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-86b7f5d9-bd38-4b55-a6af-fa7e4f2bbed4 req-589c6c5b-fe1a-486a-bae5-7ec49667cc9d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112912 Oct 04 19:21:56.059908 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3539/7062] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:21:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:21:56.151577 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-28a4af3d-b7d4-4c0a-80b7-bf7c6aad4720 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:56.160250 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-28a4af3d-b7d4-4c0a-80b7-bf7c6aad4720 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b" status: 200 len: 1565 microversion: 2.1 time: 0.222477 Oct 04 19:21:56.161047 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3524/7063] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:55 2022] GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b => generated 1565 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:17.406826 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=42 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:22:17.412950 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4b02b7b3-1b29-4401-86bd-0ea941b2c8f8 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:22:17.416960 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-4b02b7b3-1b29-4401-86bd-0ea941b2c8f8 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: 7cde3fb7-477a-4428-aef7-1ffe15a0920b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:17.426077 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4b02b7b3-1b29-4401-86bd-0ea941b2c8f8 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:17.426560 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4b02b7b3-1b29-4401-86bd-0ea941b2c8f8 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:17.426998 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4b02b7b3-1b29-4401-86bd-0ea941b2c8f8 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:17.427687 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4b02b7b3-1b29-4401-86bd-0ea941b2c8f8 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:17.428167 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4b02b7b3-1b29-4401-86bd-0ea941b2c8f8 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:17.428731 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4b02b7b3-1b29-4401-86bd-0ea941b2c8f8 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:17.480813 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-4b02b7b3-1b29-4401-86bd-0ea941b2c8f8 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "POST /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b/action" status: 200 len: 24574 microversion: 2.1 time: 0.075860 Oct 04 19:22:17.481497 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3540/7064] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 19:22:17 2022] POST /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b/action => generated 24574 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:22:28.533937 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:22:28.534711 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=38 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:22:28.535853 n-d-850501-14 devstack@n-api.service[123002]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:22:28.536008 n-d-850501-14 devstack@n-api.service[123002]: Tue Oct 4 19:22:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b (ip 10.222.0.20) !!! Oct 04 19:22:28.540354 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1fd85700-8f3d-4ba4-8a91-52a31cbd92fc tempest-TestNetworkAdvancedServerOps-443223969 tempest-TestNetworkAdvancedServerOps-443223969-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:28.540980 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1fd85700-8f3d-4ba4-8a91-52a31cbd92fc tempest-TestNetworkAdvancedServerOps-443223969 tempest-TestNetworkAdvancedServerOps-443223969-project-admin] [instance: 7cde3fb7-477a-4428-aef7-1ffe15a0920b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:28.547583 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1fd85700-8f3d-4ba4-8a91-52a31cbd92fc tempest-TestNetworkAdvancedServerOps-443223969 tempest-TestNetworkAdvancedServerOps-443223969-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:28.548098 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1fd85700-8f3d-4ba4-8a91-52a31cbd92fc tempest-TestNetworkAdvancedServerOps-443223969 tempest-TestNetworkAdvancedServerOps-443223969-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:28.548564 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1fd85700-8f3d-4ba4-8a91-52a31cbd92fc tempest-TestNetworkAdvancedServerOps-443223969 tempest-TestNetworkAdvancedServerOps-443223969-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:28.549257 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1fd85700-8f3d-4ba4-8a91-52a31cbd92fc tempest-TestNetworkAdvancedServerOps-443223969 tempest-TestNetworkAdvancedServerOps-443223969-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:28.549716 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1fd85700-8f3d-4ba4-8a91-52a31cbd92fc tempest-TestNetworkAdvancedServerOps-443223969 tempest-TestNetworkAdvancedServerOps-443223969-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:28.550149 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1fd85700-8f3d-4ba4-8a91-52a31cbd92fc tempest-TestNetworkAdvancedServerOps-443223969 tempest-TestNetworkAdvancedServerOps-443223969-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:28.756545 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1fd85700-8f3d-4ba4-8a91-52a31cbd92fc tempest-TestNetworkAdvancedServerOps-443223969 tempest-TestNetworkAdvancedServerOps-443223969-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b" status: 200 len: 1836 microversion: 2.1 time: 0.223825 Oct 04 19:22:28.757220 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3525/7065] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:28 2022] GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b => generated 1836 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:28.781867 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-50047ed6-495c-4e3c-a08e-1a6d7d24837c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:28.782618 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-50047ed6-495c-4e3c-a08e-1a6d7d24837c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: 7cde3fb7-477a-4428-aef7-1ffe15a0920b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:28.785605 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=4 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:22:28.791373 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-50047ed6-495c-4e3c-a08e-1a6d7d24837c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:28.796695 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-50047ed6-495c-4e3c-a08e-1a6d7d24837c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:28.796695 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-50047ed6-495c-4e3c-a08e-1a6d7d24837c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:28.796695 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-50047ed6-495c-4e3c-a08e-1a6d7d24837c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:28.796695 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-50047ed6-495c-4e3c-a08e-1a6d7d24837c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:28.796695 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-50047ed6-495c-4e3c-a08e-1a6d7d24837c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:29.009177 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-50047ed6-495c-4e3c-a08e-1a6d7d24837c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:29.017598 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-50047ed6-495c-4e3c-a08e-1a6d7d24837c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b" status: 200 len: 1683 microversion: 2.1 time: 0.239707 Oct 04 19:22:29.018211 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3541/7066] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:28 2022] GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b => generated 1683 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:29.120767 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5042b8d2-fe96-4b2c-91bc-72d558791280 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:22:29.122955 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5042b8d2-fe96-4b2c-91bc-72d558791280 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: 7cde3fb7-477a-4428-aef7-1ffe15a0920b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:29.130139 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5042b8d2-fe96-4b2c-91bc-72d558791280 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:29.130636 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5042b8d2-fe96-4b2c-91bc-72d558791280 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:29.131088 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5042b8d2-fe96-4b2c-91bc-72d558791280 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:29.131791 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5042b8d2-fe96-4b2c-91bc-72d558791280 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:29.132294 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5042b8d2-fe96-4b2c-91bc-72d558791280 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:29.132734 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5042b8d2-fe96-4b2c-91bc-72d558791280 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:29.184922 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5042b8d2-fe96-4b2c-91bc-72d558791280 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "POST /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b/action" status: 200 len: 32637 microversion: 2.1 time: 0.067810 Oct 04 19:22:29.185573 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3526/7067] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 19:22:29 2022] POST /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b/action => generated 32637 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:22:29.337628 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a221128d-0c8b-4f90-9f8a-06b7f5daab41 tempest-TestNetworkAdvancedServerOps-443223969 tempest-TestNetworkAdvancedServerOps-443223969-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:22:29.338140 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a221128d-0c8b-4f90-9f8a-06b7f5daab41 tempest-TestNetworkAdvancedServerOps-443223969 tempest-TestNetworkAdvancedServerOps-443223969-project-admin] [instance: 7cde3fb7-477a-4428-aef7-1ffe15a0920b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:29.345465 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a221128d-0c8b-4f90-9f8a-06b7f5daab41 tempest-TestNetworkAdvancedServerOps-443223969 tempest-TestNetworkAdvancedServerOps-443223969-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:29.345956 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a221128d-0c8b-4f90-9f8a-06b7f5daab41 tempest-TestNetworkAdvancedServerOps-443223969 tempest-TestNetworkAdvancedServerOps-443223969-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:29.346399 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a221128d-0c8b-4f90-9f8a-06b7f5daab41 tempest-TestNetworkAdvancedServerOps-443223969 tempest-TestNetworkAdvancedServerOps-443223969-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:29.347125 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a221128d-0c8b-4f90-9f8a-06b7f5daab41 tempest-TestNetworkAdvancedServerOps-443223969 tempest-TestNetworkAdvancedServerOps-443223969-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:29.347584 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a221128d-0c8b-4f90-9f8a-06b7f5daab41 tempest-TestNetworkAdvancedServerOps-443223969 tempest-TestNetworkAdvancedServerOps-443223969-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:29.348014 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a221128d-0c8b-4f90-9f8a-06b7f5daab41 tempest-TestNetworkAdvancedServerOps-443223969 tempest-TestNetworkAdvancedServerOps-443223969-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:29.375274 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a221128d-0c8b-4f90-9f8a-06b7f5daab41 tempest-TestNetworkAdvancedServerOps-443223969 tempest-TestNetworkAdvancedServerOps-443223969-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'd29a9d6b7b8b43758194340a1879594a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12de74ab9ebf41b7b3509b1f1db4feb1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:29.375854 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a221128d-0c8b-4f90-9f8a-06b7f5daab41 tempest-TestNetworkAdvancedServerOps-443223969 tempest-TestNetworkAdvancedServerOps-443223969-project-admin] [instance: 7cde3fb7-477a-4428-aef7-1ffe15a0920b] flavor_id is None. Assuming migration. {{(pid=123001) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 04 19:22:29.376451 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a221128d-0c8b-4f90-9f8a-06b7f5daab41 tempest-TestNetworkAdvancedServerOps-443223969 tempest-TestNetworkAdvancedServerOps-443223969-project-admin] [instance: 7cde3fb7-477a-4428-aef7-1ffe15a0920b] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=123001) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 19:22:29.635282 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a221128d-0c8b-4f90-9f8a-06b7f5daab41 tempest-TestNetworkAdvancedServerOps-443223969 tempest-TestNetworkAdvancedServerOps-443223969-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b/action" status: 202 len: 0 microversion: 2.1 time: 0.301282 Oct 04 19:22:29.635910 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3542/7068] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 19:22:29 2022] POST /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b/action => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:22:29.644896 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6b275969-b16b-4961-bf85-79521f465e64 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:29.646243 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-6b275969-b16b-4961-bf85-79521f465e64 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: 7cde3fb7-477a-4428-aef7-1ffe15a0920b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:29.653879 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6b275969-b16b-4961-bf85-79521f465e64 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:29.654387 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6b275969-b16b-4961-bf85-79521f465e64 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:29.654846 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6b275969-b16b-4961-bf85-79521f465e64 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:29.655566 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6b275969-b16b-4961-bf85-79521f465e64 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:29.656042 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6b275969-b16b-4961-bf85-79521f465e64 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:29.656511 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6b275969-b16b-4961-bf85-79521f465e64 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:29.794054 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-6b275969-b16b-4961-bf85-79521f465e64 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:29.802113 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6b275969-b16b-4961-bf85-79521f465e64 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b" status: 200 len: 1692 microversion: 2.1 time: 0.161670 Oct 04 19:22:29.802699 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3527/7069] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:29 2022] GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b => generated 1692 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:30.826217 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7a3046db-b5f9-46c3-832d-dbd1f701e13f tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:30.826838 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7a3046db-b5f9-46c3-832d-dbd1f701e13f tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: 7cde3fb7-477a-4428-aef7-1ffe15a0920b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:30.834898 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7a3046db-b5f9-46c3-832d-dbd1f701e13f tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:30.835388 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7a3046db-b5f9-46c3-832d-dbd1f701e13f tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:30.835830 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7a3046db-b5f9-46c3-832d-dbd1f701e13f tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:30.836572 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7a3046db-b5f9-46c3-832d-dbd1f701e13f tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:30.837033 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7a3046db-b5f9-46c3-832d-dbd1f701e13f tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:30.837463 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7a3046db-b5f9-46c3-832d-dbd1f701e13f tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:30.971666 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7a3046db-b5f9-46c3-832d-dbd1f701e13f tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:30.979395 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7a3046db-b5f9-46c3-832d-dbd1f701e13f tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b" status: 200 len: 1692 microversion: 2.1 time: 0.157143 Oct 04 19:22:30.979960 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3543/7070] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:30 2022] GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b => generated 1692 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:22:32.003916 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2133a2e9-3a4c-4109-8e82-b8e1fdccbd87 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:32.004570 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2133a2e9-3a4c-4109-8e82-b8e1fdccbd87 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: 7cde3fb7-477a-4428-aef7-1ffe15a0920b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:32.011382 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2133a2e9-3a4c-4109-8e82-b8e1fdccbd87 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:32.011890 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2133a2e9-3a4c-4109-8e82-b8e1fdccbd87 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:32.012450 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2133a2e9-3a4c-4109-8e82-b8e1fdccbd87 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:32.013167 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2133a2e9-3a4c-4109-8e82-b8e1fdccbd87 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:32.013649 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2133a2e9-3a4c-4109-8e82-b8e1fdccbd87 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:32.014099 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2133a2e9-3a4c-4109-8e82-b8e1fdccbd87 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:32.145263 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2133a2e9-3a4c-4109-8e82-b8e1fdccbd87 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:32.153059 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2133a2e9-3a4c-4109-8e82-b8e1fdccbd87 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b" status: 200 len: 1692 microversion: 2.1 time: 0.153731 Oct 04 19:22:32.153629 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3528/7071] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:31 2022] GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b => generated 1692 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:33.178884 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-44cef0a6-a690-4771-9dd8-15a9d5a1af47 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:33.179405 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-44cef0a6-a690-4771-9dd8-15a9d5a1af47 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: 7cde3fb7-477a-4428-aef7-1ffe15a0920b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:33.186491 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-44cef0a6-a690-4771-9dd8-15a9d5a1af47 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:33.186988 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-44cef0a6-a690-4771-9dd8-15a9d5a1af47 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:33.187427 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-44cef0a6-a690-4771-9dd8-15a9d5a1af47 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:33.188218 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-44cef0a6-a690-4771-9dd8-15a9d5a1af47 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:33.188869 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-44cef0a6-a690-4771-9dd8-15a9d5a1af47 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:33.189149 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-44cef0a6-a690-4771-9dd8-15a9d5a1af47 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:33.325622 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-44cef0a6-a690-4771-9dd8-15a9d5a1af47 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:33.333648 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-44cef0a6-a690-4771-9dd8-15a9d5a1af47 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b" status: 200 len: 1692 microversion: 2.1 time: 0.159830 Oct 04 19:22:33.334222 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3544/7072] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:33 2022] GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b => generated 1692 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:34.358524 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2e4f2093-fc35-4010-8fed-8d565fa136a2 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:34.359354 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2e4f2093-fc35-4010-8fed-8d565fa136a2 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: 7cde3fb7-477a-4428-aef7-1ffe15a0920b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:34.367439 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e4f2093-fc35-4010-8fed-8d565fa136a2 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:34.368168 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e4f2093-fc35-4010-8fed-8d565fa136a2 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:34.368618 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e4f2093-fc35-4010-8fed-8d565fa136a2 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:34.369332 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e4f2093-fc35-4010-8fed-8d565fa136a2 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:34.369800 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e4f2093-fc35-4010-8fed-8d565fa136a2 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:34.370234 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e4f2093-fc35-4010-8fed-8d565fa136a2 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:34.610892 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2e4f2093-fc35-4010-8fed-8d565fa136a2 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:34.619556 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2e4f2093-fc35-4010-8fed-8d565fa136a2 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b" status: 200 len: 1692 microversion: 2.1 time: 0.265096 Oct 04 19:22:34.620301 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3529/7073] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:34 2022] GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b => generated 1692 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:35.642829 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6ec0efc4-2088-4cc7-8634-7136613cc345 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:35.643442 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6ec0efc4-2088-4cc7-8634-7136613cc345 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: 7cde3fb7-477a-4428-aef7-1ffe15a0920b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:35.651034 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6ec0efc4-2088-4cc7-8634-7136613cc345 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:35.651520 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6ec0efc4-2088-4cc7-8634-7136613cc345 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:35.651957 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6ec0efc4-2088-4cc7-8634-7136613cc345 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:35.652678 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6ec0efc4-2088-4cc7-8634-7136613cc345 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:35.653133 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6ec0efc4-2088-4cc7-8634-7136613cc345 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:35.653562 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6ec0efc4-2088-4cc7-8634-7136613cc345 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:35.793623 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6ec0efc4-2088-4cc7-8634-7136613cc345 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:35.802159 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6ec0efc4-2088-4cc7-8634-7136613cc345 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b" status: 200 len: 1697 microversion: 2.1 time: 0.163251 Oct 04 19:22:35.802730 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3545/7074] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:35 2022] GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b => generated 1697 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:36.826453 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-208dc3c8-6c75-4aae-bdef-ed0985046db7 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:36.827081 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-208dc3c8-6c75-4aae-bdef-ed0985046db7 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: 7cde3fb7-477a-4428-aef7-1ffe15a0920b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:36.834408 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-208dc3c8-6c75-4aae-bdef-ed0985046db7 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:36.834912 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-208dc3c8-6c75-4aae-bdef-ed0985046db7 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:36.835368 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-208dc3c8-6c75-4aae-bdef-ed0985046db7 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:36.836094 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-208dc3c8-6c75-4aae-bdef-ed0985046db7 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:36.836569 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-208dc3c8-6c75-4aae-bdef-ed0985046db7 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:36.837011 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-208dc3c8-6c75-4aae-bdef-ed0985046db7 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:36.967407 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-208dc3c8-6c75-4aae-bdef-ed0985046db7 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:36.976227 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-208dc3c8-6c75-4aae-bdef-ed0985046db7 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b" status: 200 len: 1697 microversion: 2.1 time: 0.153750 Oct 04 19:22:36.976742 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3530/7075] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:36 2022] GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b => generated 1697 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:37.998761 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9a1c5aed-548c-4466-b145-29ad5d5e0595 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:37.999616 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-9a1c5aed-548c-4466-b145-29ad5d5e0595 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: 7cde3fb7-477a-4428-aef7-1ffe15a0920b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:38.009186 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9a1c5aed-548c-4466-b145-29ad5d5e0595 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:38.009689 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9a1c5aed-548c-4466-b145-29ad5d5e0595 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:38.010136 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9a1c5aed-548c-4466-b145-29ad5d5e0595 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:38.010882 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9a1c5aed-548c-4466-b145-29ad5d5e0595 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:38.011365 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9a1c5aed-548c-4466-b145-29ad5d5e0595 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:38.011782 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9a1c5aed-548c-4466-b145-29ad5d5e0595 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:38.159835 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9a1c5aed-548c-4466-b145-29ad5d5e0595 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:38.161554 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9a1c5aed-548c-4466-b145-29ad5d5e0595 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b" status: 200 len: 1697 microversion: 2.1 time: 0.166765 Oct 04 19:22:38.162115 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3546/7076] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:37 2022] GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b => generated 1697 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:39.184628 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-92ae43a3-98bd-4cea-b4b2-a3162ebb720f tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:39.185259 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-92ae43a3-98bd-4cea-b4b2-a3162ebb720f tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: 7cde3fb7-477a-4428-aef7-1ffe15a0920b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:39.192277 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-92ae43a3-98bd-4cea-b4b2-a3162ebb720f tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:39.192780 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-92ae43a3-98bd-4cea-b4b2-a3162ebb720f tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:39.193236 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-92ae43a3-98bd-4cea-b4b2-a3162ebb720f tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:39.193944 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-92ae43a3-98bd-4cea-b4b2-a3162ebb720f tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:39.194533 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-92ae43a3-98bd-4cea-b4b2-a3162ebb720f tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:39.194987 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-92ae43a3-98bd-4cea-b4b2-a3162ebb720f tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:39.329990 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-92ae43a3-98bd-4cea-b4b2-a3162ebb720f tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:39.338724 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-92ae43a3-98bd-4cea-b4b2-a3162ebb720f tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b" status: 200 len: 1697 microversion: 2.1 time: 0.158016 Oct 04 19:22:39.339297 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3531/7077] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:39 2022] GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b => generated 1697 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:40.362333 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-62d0dfd2-9ad7-43d1-be96-307f504e7b50 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:40.362982 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-62d0dfd2-9ad7-43d1-be96-307f504e7b50 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: 7cde3fb7-477a-4428-aef7-1ffe15a0920b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:40.370428 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-62d0dfd2-9ad7-43d1-be96-307f504e7b50 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:40.370919 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-62d0dfd2-9ad7-43d1-be96-307f504e7b50 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:40.371370 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-62d0dfd2-9ad7-43d1-be96-307f504e7b50 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:40.372077 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-62d0dfd2-9ad7-43d1-be96-307f504e7b50 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:40.372551 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-62d0dfd2-9ad7-43d1-be96-307f504e7b50 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:40.372981 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-62d0dfd2-9ad7-43d1-be96-307f504e7b50 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:40.507258 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-62d0dfd2-9ad7-43d1-be96-307f504e7b50 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:40.515177 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-62d0dfd2-9ad7-43d1-be96-307f504e7b50 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b" status: 200 len: 1697 microversion: 2.1 time: 0.156955 Oct 04 19:22:40.517811 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3547/7078] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:40 2022] GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b => generated 1697 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:41.539580 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a8db8ab9-a232-4935-9e85-46462278e8b4 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:41.540160 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a8db8ab9-a232-4935-9e85-46462278e8b4 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: 7cde3fb7-477a-4428-aef7-1ffe15a0920b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:41.546650 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a8db8ab9-a232-4935-9e85-46462278e8b4 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:41.547148 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a8db8ab9-a232-4935-9e85-46462278e8b4 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:41.547603 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a8db8ab9-a232-4935-9e85-46462278e8b4 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:41.548365 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a8db8ab9-a232-4935-9e85-46462278e8b4 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:41.548838 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a8db8ab9-a232-4935-9e85-46462278e8b4 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:41.549290 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a8db8ab9-a232-4935-9e85-46462278e8b4 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:41.692191 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a8db8ab9-a232-4935-9e85-46462278e8b4 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:41.699899 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a8db8ab9-a232-4935-9e85-46462278e8b4 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b" status: 200 len: 1697 microversion: 2.1 time: 0.165105 Oct 04 19:22:41.700521 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3532/7079] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:41 2022] GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b => generated 1697 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:22:42.723562 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-cbee289e-ce31-47f7-b8fb-c924c3065705 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:42.724486 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-cbee289e-ce31-47f7-b8fb-c924c3065705 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: 7cde3fb7-477a-4428-aef7-1ffe15a0920b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:42.731018 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cbee289e-ce31-47f7-b8fb-c924c3065705 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:42.731538 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cbee289e-ce31-47f7-b8fb-c924c3065705 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:42.731972 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cbee289e-ce31-47f7-b8fb-c924c3065705 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:42.732686 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cbee289e-ce31-47f7-b8fb-c924c3065705 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:42.733136 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cbee289e-ce31-47f7-b8fb-c924c3065705 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:42.733559 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cbee289e-ce31-47f7-b8fb-c924c3065705 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:42.867673 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-cbee289e-ce31-47f7-b8fb-c924c3065705 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:42.875626 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-cbee289e-ce31-47f7-b8fb-c924c3065705 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b" status: 200 len: 1697 microversion: 2.1 time: 0.156718 Oct 04 19:22:42.876220 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3548/7080] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:42 2022] GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b => generated 1697 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:43.899674 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3d137741-2aa7-491d-a6d2-e14988fb664a tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:43.900331 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3d137741-2aa7-491d-a6d2-e14988fb664a tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: 7cde3fb7-477a-4428-aef7-1ffe15a0920b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:43.907207 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3d137741-2aa7-491d-a6d2-e14988fb664a tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:43.907710 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3d137741-2aa7-491d-a6d2-e14988fb664a tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:43.908197 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3d137741-2aa7-491d-a6d2-e14988fb664a tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:43.908906 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3d137741-2aa7-491d-a6d2-e14988fb664a tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:43.909382 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3d137741-2aa7-491d-a6d2-e14988fb664a tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:43.909829 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3d137741-2aa7-491d-a6d2-e14988fb664a tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:44.044890 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3d137741-2aa7-491d-a6d2-e14988fb664a tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:44.052829 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3d137741-2aa7-491d-a6d2-e14988fb664a tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b" status: 200 len: 1697 microversion: 2.1 time: 0.157087 Oct 04 19:22:44.053408 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3533/7081] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:43 2022] GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b => generated 1697 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:45.076507 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b99d8947-ea60-4b5e-bc02-e9b53b6cf230 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:45.077129 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b99d8947-ea60-4b5e-bc02-e9b53b6cf230 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: 7cde3fb7-477a-4428-aef7-1ffe15a0920b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:45.084840 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b99d8947-ea60-4b5e-bc02-e9b53b6cf230 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:45.085335 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b99d8947-ea60-4b5e-bc02-e9b53b6cf230 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:45.085824 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b99d8947-ea60-4b5e-bc02-e9b53b6cf230 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:45.086513 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b99d8947-ea60-4b5e-bc02-e9b53b6cf230 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:45.086973 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b99d8947-ea60-4b5e-bc02-e9b53b6cf230 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:45.087410 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b99d8947-ea60-4b5e-bc02-e9b53b6cf230 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:45.222453 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b99d8947-ea60-4b5e-bc02-e9b53b6cf230 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:45.230272 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b99d8947-ea60-4b5e-bc02-e9b53b6cf230 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b" status: 200 len: 1697 microversion: 2.1 time: 0.157922 Oct 04 19:22:45.230843 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3549/7082] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:45 2022] GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b => generated 1697 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:46.254486 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0371fd55-32fb-447b-b02b-078ababcc001 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:46.255038 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0371fd55-32fb-447b-b02b-078ababcc001 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: 7cde3fb7-477a-4428-aef7-1ffe15a0920b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:46.261852 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0371fd55-32fb-447b-b02b-078ababcc001 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:46.262353 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0371fd55-32fb-447b-b02b-078ababcc001 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:46.262810 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0371fd55-32fb-447b-b02b-078ababcc001 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:46.263730 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0371fd55-32fb-447b-b02b-078ababcc001 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:46.264228 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0371fd55-32fb-447b-b02b-078ababcc001 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:46.264668 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0371fd55-32fb-447b-b02b-078ababcc001 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:46.401826 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0371fd55-32fb-447b-b02b-078ababcc001 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:46.409578 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0371fd55-32fb-447b-b02b-078ababcc001 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b" status: 200 len: 1697 microversion: 2.1 time: 0.159284 Oct 04 19:22:46.410176 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3534/7083] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:46 2022] GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b => generated 1697 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:47.432739 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c4ff2351-7c1b-434a-beef-176294a2efab tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:47.433281 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c4ff2351-7c1b-434a-beef-176294a2efab tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: 7cde3fb7-477a-4428-aef7-1ffe15a0920b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:47.440394 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c4ff2351-7c1b-434a-beef-176294a2efab tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:47.440895 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c4ff2351-7c1b-434a-beef-176294a2efab tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:47.441839 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c4ff2351-7c1b-434a-beef-176294a2efab tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:47.442797 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c4ff2351-7c1b-434a-beef-176294a2efab tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:47.443167 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c4ff2351-7c1b-434a-beef-176294a2efab tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:47.443628 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c4ff2351-7c1b-434a-beef-176294a2efab tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:47.579703 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c4ff2351-7c1b-434a-beef-176294a2efab tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:47.587869 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c4ff2351-7c1b-434a-beef-176294a2efab tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b" status: 200 len: 1696 microversion: 2.1 time: 0.159113 Oct 04 19:22:47.588486 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3550/7084] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:47 2022] GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b => generated 1696 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:47.810347 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-46398c26-3af9-4801-80e3-1ef7f56625de req-5d5acde9-f63a-4895-ba54-cbadddef5362 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cde3fb7-477a-4428-aef7-1ffe15a0920b", "name": "network-vif-unplugged", "status": "completed", "tag": "1dabf904-1386-42b0-8090-091cabf42f07"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:22:47.821623 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-46398c26-3af9-4801-80e3-1ef7f56625de req-5d5acde9-f63a-4895-ba54-cbadddef5362 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:47.822116 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-46398c26-3af9-4801-80e3-1ef7f56625de req-5d5acde9-f63a-4895-ba54-cbadddef5362 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:47.822557 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-46398c26-3af9-4801-80e3-1ef7f56625de req-5d5acde9-f63a-4895-ba54-cbadddef5362 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:47.834334 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-46398c26-3af9-4801-80e3-1ef7f56625de req-5d5acde9-f63a-4895-ba54-cbadddef5362 service nova] Creating event network-vif-unplugged:1dabf904-1386-42b0-8090-091cabf42f07 for instance 7cde3fb7-477a-4428-aef7-1ffe15a0920b on n-h2-850501-14 Oct 04 19:22:47.839785 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [req-46398c26-3af9-4801-80e3-1ef7f56625de req-5d5acde9-f63a-4895-ba54-cbadddef5362 service nova] Instance 7cde3fb7-477a-4428-aef7-1ffe15a0920b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850501-14', 'n-h2-850501-14'} {{(pid=123002) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:22:47.851654 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-46398c26-3af9-4801-80e3-1ef7f56625de req-5d5acde9-f63a-4895-ba54-cbadddef5362 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045172 Oct 04 19:22:47.852359 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3535/7085] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:22:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:22:48.611798 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-39f73aa9-89fb-4c47-8494-c5bae2dd5305 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:48.612441 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-39f73aa9-89fb-4c47-8494-c5bae2dd5305 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: 7cde3fb7-477a-4428-aef7-1ffe15a0920b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:48.619966 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-39f73aa9-89fb-4c47-8494-c5bae2dd5305 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:48.620485 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-39f73aa9-89fb-4c47-8494-c5bae2dd5305 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:48.620916 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-39f73aa9-89fb-4c47-8494-c5bae2dd5305 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:48.621615 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-39f73aa9-89fb-4c47-8494-c5bae2dd5305 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:48.622069 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-39f73aa9-89fb-4c47-8494-c5bae2dd5305 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:48.622487 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-39f73aa9-89fb-4c47-8494-c5bae2dd5305 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:48.764867 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-39f73aa9-89fb-4c47-8494-c5bae2dd5305 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:48.772930 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-39f73aa9-89fb-4c47-8494-c5bae2dd5305 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b" status: 200 len: 1696 microversion: 2.1 time: 0.165081 Oct 04 19:22:48.773516 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3551/7086] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:48 2022] GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b => generated 1696 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:49.800186 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-54aa70a5-8a55-4274-b95e-d53f58ff72d6 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:49.800804 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-54aa70a5-8a55-4274-b95e-d53f58ff72d6 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: 7cde3fb7-477a-4428-aef7-1ffe15a0920b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:49.808191 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-54aa70a5-8a55-4274-b95e-d53f58ff72d6 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:49.808691 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-54aa70a5-8a55-4274-b95e-d53f58ff72d6 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:49.809141 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-54aa70a5-8a55-4274-b95e-d53f58ff72d6 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:49.809847 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-54aa70a5-8a55-4274-b95e-d53f58ff72d6 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:49.810313 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-54aa70a5-8a55-4274-b95e-d53f58ff72d6 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:49.810752 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-54aa70a5-8a55-4274-b95e-d53f58ff72d6 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:49.867032 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-00fbfa52-7487-4466-9bc1-452dcb7944d9 req-e76d990c-dfa1-4d19-9225-771ebf895847 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cde3fb7-477a-4428-aef7-1ffe15a0920b", "tag": "1dabf904-1386-42b0-8090-091cabf42f07"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:22:49.877591 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-00fbfa52-7487-4466-9bc1-452dcb7944d9 req-e76d990c-dfa1-4d19-9225-771ebf895847 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:49.878075 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-00fbfa52-7487-4466-9bc1-452dcb7944d9 req-e76d990c-dfa1-4d19-9225-771ebf895847 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:49.878507 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-00fbfa52-7487-4466-9bc1-452dcb7944d9 req-e76d990c-dfa1-4d19-9225-771ebf895847 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:49.891361 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-00fbfa52-7487-4466-9bc1-452dcb7944d9 req-e76d990c-dfa1-4d19-9225-771ebf895847 service nova] Creating event network-changed:1dabf904-1386-42b0-8090-091cabf42f07 for instance 7cde3fb7-477a-4428-aef7-1ffe15a0920b on n-h2-850501-14 Oct 04 19:22:49.897557 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [req-00fbfa52-7487-4466-9bc1-452dcb7944d9 req-e76d990c-dfa1-4d19-9225-771ebf895847 service nova] Instance 7cde3fb7-477a-4428-aef7-1ffe15a0920b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850501-14', 'n-h2-850501-14'} {{(pid=123001) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:22:49.908438 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-00fbfa52-7487-4466-9bc1-452dcb7944d9 req-e76d990c-dfa1-4d19-9225-771ebf895847 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045618 Oct 04 19:22:49.909051 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3552/7087] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:22:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:22:49.981998 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-54aa70a5-8a55-4274-b95e-d53f58ff72d6 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:49.990433 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-54aa70a5-8a55-4274-b95e-d53f58ff72d6 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b" status: 200 len: 1694 microversion: 2.1 time: 0.197125 Oct 04 19:22:49.991027 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3536/7088] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:49 2022] GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b => generated 1694 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:51.015665 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-02c80017-41df-457a-be16-65b7b2227d18 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:51.016304 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-02c80017-41df-457a-be16-65b7b2227d18 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: 7cde3fb7-477a-4428-aef7-1ffe15a0920b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:51.022585 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-02c80017-41df-457a-be16-65b7b2227d18 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:51.023099 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-02c80017-41df-457a-be16-65b7b2227d18 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:51.023534 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-02c80017-41df-457a-be16-65b7b2227d18 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:51.024259 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-02c80017-41df-457a-be16-65b7b2227d18 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:51.024713 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-02c80017-41df-457a-be16-65b7b2227d18 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:51.025134 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-02c80017-41df-457a-be16-65b7b2227d18 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:51.161537 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-02c80017-41df-457a-be16-65b7b2227d18 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:51.169875 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-02c80017-41df-457a-be16-65b7b2227d18 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b" status: 200 len: 1694 microversion: 2.1 time: 0.159341 Oct 04 19:22:51.171748 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3553/7089] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:51 2022] GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b => generated 1694 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:52.194762 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-48babdd9-7cd3-46f2-a977-f46413e3c001 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:52.195383 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-48babdd9-7cd3-46f2-a977-f46413e3c001 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: 7cde3fb7-477a-4428-aef7-1ffe15a0920b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:52.202428 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-48babdd9-7cd3-46f2-a977-f46413e3c001 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:52.202923 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-48babdd9-7cd3-46f2-a977-f46413e3c001 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:52.203369 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-48babdd9-7cd3-46f2-a977-f46413e3c001 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:52.204078 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-48babdd9-7cd3-46f2-a977-f46413e3c001 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:52.204557 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-48babdd9-7cd3-46f2-a977-f46413e3c001 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:52.204993 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-48babdd9-7cd3-46f2-a977-f46413e3c001 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:52.361905 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-48babdd9-7cd3-46f2-a977-f46413e3c001 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:52.371966 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-48babdd9-7cd3-46f2-a977-f46413e3c001 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b" status: 200 len: 1694 microversion: 2.1 time: 0.181857 Oct 04 19:22:52.372728 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3537/7090] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:52 2022] GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b => generated 1694 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:22:53.396475 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-cceaa7c1-aa39-40f5-a3e7-5ad6ff61f3b1 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:53.397103 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-cceaa7c1-aa39-40f5-a3e7-5ad6ff61f3b1 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: 7cde3fb7-477a-4428-aef7-1ffe15a0920b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:53.404007 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cceaa7c1-aa39-40f5-a3e7-5ad6ff61f3b1 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:53.411226 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cceaa7c1-aa39-40f5-a3e7-5ad6ff61f3b1 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:53.411226 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cceaa7c1-aa39-40f5-a3e7-5ad6ff61f3b1 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:53.411226 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cceaa7c1-aa39-40f5-a3e7-5ad6ff61f3b1 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:53.411226 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cceaa7c1-aa39-40f5-a3e7-5ad6ff61f3b1 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:53.411226 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cceaa7c1-aa39-40f5-a3e7-5ad6ff61f3b1 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:53.548545 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-cceaa7c1-aa39-40f5-a3e7-5ad6ff61f3b1 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:53.556820 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-cceaa7c1-aa39-40f5-a3e7-5ad6ff61f3b1 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b" status: 200 len: 1691 microversion: 2.1 time: 0.164504 Oct 04 19:22:53.557399 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3554/7091] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:53 2022] GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b => generated 1691 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:53.580852 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c1f703bf-b17c-46d8-8eb5-02ce7ee1488c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:22:53.582357 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c1f703bf-b17c-46d8-8eb5-02ce7ee1488c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: 7cde3fb7-477a-4428-aef7-1ffe15a0920b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:53.589349 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c1f703bf-b17c-46d8-8eb5-02ce7ee1488c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:53.589860 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c1f703bf-b17c-46d8-8eb5-02ce7ee1488c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:53.590612 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c1f703bf-b17c-46d8-8eb5-02ce7ee1488c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:53.591331 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c1f703bf-b17c-46d8-8eb5-02ce7ee1488c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:53.591814 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c1f703bf-b17c-46d8-8eb5-02ce7ee1488c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:53.592300 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c1f703bf-b17c-46d8-8eb5-02ce7ee1488c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:53.886833 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c1f703bf-b17c-46d8-8eb5-02ce7ee1488c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "POST /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b/action" status: 202 len: 0 microversion: 2.1 time: 0.309691 Oct 04 19:22:53.887517 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3538/7092] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 19:22:53 2022] POST /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b/action => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:22:53.896321 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8d5116b6-a5a3-499e-b3c2-edea13a645f0 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:53.896946 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8d5116b6-a5a3-499e-b3c2-edea13a645f0 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: 7cde3fb7-477a-4428-aef7-1ffe15a0920b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:53.903095 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8d5116b6-a5a3-499e-b3c2-edea13a645f0 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:53.903580 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8d5116b6-a5a3-499e-b3c2-edea13a645f0 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:53.904078 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8d5116b6-a5a3-499e-b3c2-edea13a645f0 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:53.904775 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8d5116b6-a5a3-499e-b3c2-edea13a645f0 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:53.905228 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8d5116b6-a5a3-499e-b3c2-edea13a645f0 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:53.905655 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8d5116b6-a5a3-499e-b3c2-edea13a645f0 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:54.048785 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8d5116b6-a5a3-499e-b3c2-edea13a645f0 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:54.056888 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8d5116b6-a5a3-499e-b3c2-edea13a645f0 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b" status: 200 len: 1690 microversion: 2.1 time: 0.165129 Oct 04 19:22:54.057468 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3555/7093] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:53 2022] GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b => generated 1690 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:54.743137 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-65a00914-5fb2-4858-8f68-f24efe970bd4 req-5ba67828-7467-4d0a-9b4d-d62ee4e92b13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cde3fb7-477a-4428-aef7-1ffe15a0920b", "name": "network-vif-plugged", "status": "completed", "tag": "1dabf904-1386-42b0-8090-091cabf42f07"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:22:54.753407 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-65a00914-5fb2-4858-8f68-f24efe970bd4 req-5ba67828-7467-4d0a-9b4d-d62ee4e92b13 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:54.753990 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-65a00914-5fb2-4858-8f68-f24efe970bd4 req-5ba67828-7467-4d0a-9b4d-d62ee4e92b13 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:54.754650 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-65a00914-5fb2-4858-8f68-f24efe970bd4 req-5ba67828-7467-4d0a-9b4d-d62ee4e92b13 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:54.766772 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-65a00914-5fb2-4858-8f68-f24efe970bd4 req-5ba67828-7467-4d0a-9b4d-d62ee4e92b13 service nova] Creating event network-vif-plugged:1dabf904-1386-42b0-8090-091cabf42f07 for instance 7cde3fb7-477a-4428-aef7-1ffe15a0920b on n-h2-850501-14 Oct 04 19:22:54.772769 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [req-65a00914-5fb2-4858-8f68-f24efe970bd4 req-5ba67828-7467-4d0a-9b4d-d62ee4e92b13 service nova] Instance 7cde3fb7-477a-4428-aef7-1ffe15a0920b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850501-14', 'n-h2-850501-14'} {{(pid=123002) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:22:54.783495 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-65a00914-5fb2-4858-8f68-f24efe970bd4 req-5ba67828-7467-4d0a-9b4d-d62ee4e92b13 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046446 Oct 04 19:22:54.784283 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3539/7094] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:22:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:22:55.081116 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-eca8735c-954e-4255-8f7c-b8f7ef558844 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:55.081629 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-eca8735c-954e-4255-8f7c-b8f7ef558844 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: 7cde3fb7-477a-4428-aef7-1ffe15a0920b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:55.089127 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eca8735c-954e-4255-8f7c-b8f7ef558844 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:55.089610 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eca8735c-954e-4255-8f7c-b8f7ef558844 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:55.090058 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eca8735c-954e-4255-8f7c-b8f7ef558844 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:55.091009 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eca8735c-954e-4255-8f7c-b8f7ef558844 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:55.091469 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eca8735c-954e-4255-8f7c-b8f7ef558844 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:55.091900 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eca8735c-954e-4255-8f7c-b8f7ef558844 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:55.096048 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:22:55.228069 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-eca8735c-954e-4255-8f7c-b8f7ef558844 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:55.235895 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-eca8735c-954e-4255-8f7c-b8f7ef558844 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b" status: 200 len: 1690 microversion: 2.1 time: 0.158845 Oct 04 19:22:55.236505 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3556/7095] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:55 2022] GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b => generated 1690 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:56.260662 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7bdb8052-6bd9-4c36-8917-d16df8ebd8a8 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:56.261292 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7bdb8052-6bd9-4c36-8917-d16df8ebd8a8 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: 7cde3fb7-477a-4428-aef7-1ffe15a0920b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:56.267537 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7bdb8052-6bd9-4c36-8917-d16df8ebd8a8 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:56.268041 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7bdb8052-6bd9-4c36-8917-d16df8ebd8a8 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:56.268607 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7bdb8052-6bd9-4c36-8917-d16df8ebd8a8 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:56.269323 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7bdb8052-6bd9-4c36-8917-d16df8ebd8a8 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:56.269803 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7bdb8052-6bd9-4c36-8917-d16df8ebd8a8 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:56.270250 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7bdb8052-6bd9-4c36-8917-d16df8ebd8a8 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:56.410239 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7bdb8052-6bd9-4c36-8917-d16df8ebd8a8 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:56.413143 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:22:56.419260 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7bdb8052-6bd9-4c36-8917-d16df8ebd8a8 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b" status: 200 len: 1690 microversion: 2.1 time: 0.164202 Oct 04 19:22:56.419838 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3540/7096] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:56 2022] GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b => generated 1690 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:57.445070 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-63b0f9c0-d768-47be-a866-d06bf9b598f9 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:57.445693 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-63b0f9c0-d768-47be-a866-d06bf9b598f9 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: 7cde3fb7-477a-4428-aef7-1ffe15a0920b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:57.453174 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-63b0f9c0-d768-47be-a866-d06bf9b598f9 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:57.456964 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-63b0f9c0-d768-47be-a866-d06bf9b598f9 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:57.456964 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-63b0f9c0-d768-47be-a866-d06bf9b598f9 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:57.456964 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-63b0f9c0-d768-47be-a866-d06bf9b598f9 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:57.456964 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-63b0f9c0-d768-47be-a866-d06bf9b598f9 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:57.456964 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-63b0f9c0-d768-47be-a866-d06bf9b598f9 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:57.714155 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-63b0f9c0-d768-47be-a866-d06bf9b598f9 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:57.722580 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-63b0f9c0-d768-47be-a866-d06bf9b598f9 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b" status: 200 len: 1690 microversion: 2.1 time: 0.282657 Oct 04 19:22:57.723161 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3557/7097] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:57 2022] GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b => generated 1690 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:57.817937 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-bd9274b7-313e-4697-aa0b-396635355a48 req-130f812e-0d8e-41c8-97f0-9b896433e7f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cde3fb7-477a-4428-aef7-1ffe15a0920b", "name": "network-vif-unplugged", "status": "completed", "tag": "1dabf904-1386-42b0-8090-091cabf42f07"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:22:57.829631 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-bd9274b7-313e-4697-aa0b-396635355a48 req-130f812e-0d8e-41c8-97f0-9b896433e7f9 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:57.830127 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-bd9274b7-313e-4697-aa0b-396635355a48 req-130f812e-0d8e-41c8-97f0-9b896433e7f9 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:57.830573 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-bd9274b7-313e-4697-aa0b-396635355a48 req-130f812e-0d8e-41c8-97f0-9b896433e7f9 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:57.843200 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-bd9274b7-313e-4697-aa0b-396635355a48 req-130f812e-0d8e-41c8-97f0-9b896433e7f9 service nova] Creating event network-vif-unplugged:1dabf904-1386-42b0-8090-091cabf42f07 for instance 7cde3fb7-477a-4428-aef7-1ffe15a0920b on n-h1-850501-14 Oct 04 19:22:57.848556 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [req-bd9274b7-313e-4697-aa0b-396635355a48 req-130f812e-0d8e-41c8-97f0-9b896433e7f9 service nova] Instance 7cde3fb7-477a-4428-aef7-1ffe15a0920b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850501-14', 'n-h2-850501-14'} {{(pid=123002) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:22:57.861184 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-bd9274b7-313e-4697-aa0b-396635355a48 req-130f812e-0d8e-41c8-97f0-9b896433e7f9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047026 Oct 04 19:22:57.861818 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3541/7098] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:22:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:22:58.746791 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-909a06a7-5538-4153-babb-8b040dc218ab tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:58.747406 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-909a06a7-5538-4153-babb-8b040dc218ab tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: 7cde3fb7-477a-4428-aef7-1ffe15a0920b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:58.754262 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-909a06a7-5538-4153-babb-8b040dc218ab tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:58.754744 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-909a06a7-5538-4153-babb-8b040dc218ab tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:58.755180 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-909a06a7-5538-4153-babb-8b040dc218ab tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:58.756815 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-909a06a7-5538-4153-babb-8b040dc218ab tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:58.757289 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-909a06a7-5538-4153-babb-8b040dc218ab tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:58.757715 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-909a06a7-5538-4153-babb-8b040dc218ab tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:58.976889 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-909a06a7-5538-4153-babb-8b040dc218ab tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:58.984572 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-909a06a7-5538-4153-babb-8b040dc218ab tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b" status: 200 len: 1690 microversion: 2.1 time: 0.241751 Oct 04 19:22:58.985161 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3558/7099] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:58 2022] GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b => generated 1690 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:59.876775 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-19570283-77f1-4e96-9623-8e0a265c36d4 req-2dfaa596-64d6-4a17-b19a-a2fe246ee955 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cde3fb7-477a-4428-aef7-1ffe15a0920b", "tag": "1dabf904-1386-42b0-8090-091cabf42f07"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:22:59.883190 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=39 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:22:59.889144 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-19570283-77f1-4e96-9623-8e0a265c36d4 req-2dfaa596-64d6-4a17-b19a-a2fe246ee955 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:59.889629 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-19570283-77f1-4e96-9623-8e0a265c36d4 req-2dfaa596-64d6-4a17-b19a-a2fe246ee955 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:59.890067 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-19570283-77f1-4e96-9623-8e0a265c36d4 req-2dfaa596-64d6-4a17-b19a-a2fe246ee955 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:59.902261 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-19570283-77f1-4e96-9623-8e0a265c36d4 req-2dfaa596-64d6-4a17-b19a-a2fe246ee955 service nova] Creating event network-changed:1dabf904-1386-42b0-8090-091cabf42f07 for instance 7cde3fb7-477a-4428-aef7-1ffe15a0920b on n-h1-850501-14 Oct 04 19:22:59.907426 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [req-19570283-77f1-4e96-9623-8e0a265c36d4 req-2dfaa596-64d6-4a17-b19a-a2fe246ee955 service nova] Instance 7cde3fb7-477a-4428-aef7-1ffe15a0920b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850501-14', 'n-h2-850501-14'} {{(pid=123002) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:22:59.918282 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-19570283-77f1-4e96-9623-8e0a265c36d4 req-2dfaa596-64d6-4a17-b19a-a2fe246ee955 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046229 Oct 04 19:22:59.918925 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3542/7100] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:22:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:23:00.009023 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1bf6e08f-981b-4f4a-a3a5-73cc5951034e tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:00.009634 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1bf6e08f-981b-4f4a-a3a5-73cc5951034e tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: 7cde3fb7-477a-4428-aef7-1ffe15a0920b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:00.012345 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=42 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:23:00.017289 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1bf6e08f-981b-4f4a-a3a5-73cc5951034e tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:00.017775 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1bf6e08f-981b-4f4a-a3a5-73cc5951034e tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:00.018212 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1bf6e08f-981b-4f4a-a3a5-73cc5951034e tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:00.018907 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1bf6e08f-981b-4f4a-a3a5-73cc5951034e tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:00.019449 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1bf6e08f-981b-4f4a-a3a5-73cc5951034e tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:00.019873 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1bf6e08f-981b-4f4a-a3a5-73cc5951034e tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:00.244086 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1bf6e08f-981b-4f4a-a3a5-73cc5951034e tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:23:00.252010 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1bf6e08f-981b-4f4a-a3a5-73cc5951034e tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b" status: 200 len: 1690 microversion: 2.1 time: 0.247544 Oct 04 19:23:00.252633 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3559/7101] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:00 2022] GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b => generated 1690 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:23:01.276367 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7b3f3d19-ab4e-48e7-93de-ffce7ea60b04 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:01.277081 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7b3f3d19-ab4e-48e7-93de-ffce7ea60b04 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: 7cde3fb7-477a-4428-aef7-1ffe15a0920b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:01.285207 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7b3f3d19-ab4e-48e7-93de-ffce7ea60b04 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:01.285699 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7b3f3d19-ab4e-48e7-93de-ffce7ea60b04 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:01.286148 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7b3f3d19-ab4e-48e7-93de-ffce7ea60b04 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:01.286845 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7b3f3d19-ab4e-48e7-93de-ffce7ea60b04 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:01.288160 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7b3f3d19-ab4e-48e7-93de-ffce7ea60b04 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:01.288624 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7b3f3d19-ab4e-48e7-93de-ffce7ea60b04 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:01.423838 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7b3f3d19-ab4e-48e7-93de-ffce7ea60b04 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:23:01.433072 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7b3f3d19-ab4e-48e7-93de-ffce7ea60b04 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b" status: 200 len: 1683 microversion: 2.1 time: 0.161256 Oct 04 19:23:01.433664 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3543/7102] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:01 2022] GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:23:03.699735 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-82af10ad-e063-43ab-8c39-ecba3f57540e req-e65ae3be-2ea2-4fd8-b8b0-d5edc4739974 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cde3fb7-477a-4428-aef7-1ffe15a0920b", "name": "network-vif-plugged", "status": "completed", "tag": "1dabf904-1386-42b0-8090-091cabf42f07"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:23:03.710425 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-82af10ad-e063-43ab-8c39-ecba3f57540e req-e65ae3be-2ea2-4fd8-b8b0-d5edc4739974 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:03.710916 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-82af10ad-e063-43ab-8c39-ecba3f57540e req-e65ae3be-2ea2-4fd8-b8b0-d5edc4739974 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:03.711363 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-82af10ad-e063-43ab-8c39-ecba3f57540e req-e65ae3be-2ea2-4fd8-b8b0-d5edc4739974 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:03.723388 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-82af10ad-e063-43ab-8c39-ecba3f57540e req-e65ae3be-2ea2-4fd8-b8b0-d5edc4739974 service nova] Creating event network-vif-plugged:1dabf904-1386-42b0-8090-091cabf42f07 for instance 7cde3fb7-477a-4428-aef7-1ffe15a0920b on n-h1-850501-14 Oct 04 19:23:03.729065 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-82af10ad-e063-43ab-8c39-ecba3f57540e req-e65ae3be-2ea2-4fd8-b8b0-d5edc4739974 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033038 Oct 04 19:23:03.729760 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3560/7103] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:23:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:23:25.628291 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-912e52fa-cbd9-49fa-97d4-b3009dee3fdd tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:23:25.630549 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-912e52fa-cbd9-49fa-97d4-b3009dee3fdd tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: 7cde3fb7-477a-4428-aef7-1ffe15a0920b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:25.633802 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=3 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:23:25.634488 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=15 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:23:25.639255 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-912e52fa-cbd9-49fa-97d4-b3009dee3fdd tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:25.639764 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-912e52fa-cbd9-49fa-97d4-b3009dee3fdd tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:25.640254 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-912e52fa-cbd9-49fa-97d4-b3009dee3fdd tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:25.640970 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-912e52fa-cbd9-49fa-97d4-b3009dee3fdd tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:25.641442 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-912e52fa-cbd9-49fa-97d4-b3009dee3fdd tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:25.641889 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-912e52fa-cbd9-49fa-97d4-b3009dee3fdd tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:25.700958 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-912e52fa-cbd9-49fa-97d4-b3009dee3fdd tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "POST /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b/action" status: 200 len: 63226 microversion: 2.1 time: 0.076459 Oct 04 19:23:25.701666 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3544/7104] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 19:23:25 2022] POST /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b/action => generated 63226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:23:32.115231 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=3 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:23:32.116449 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=24 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:23:32.120385 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5690e9b6-dc3b-41af-819c-d1d7f41f84a9 tempest-TestNetworkAdvancedServerOps-443223969 tempest-TestNetworkAdvancedServerOps-443223969-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:32.121094 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5690e9b6-dc3b-41af-819c-d1d7f41f84a9 tempest-TestNetworkAdvancedServerOps-443223969 tempest-TestNetworkAdvancedServerOps-443223969-project-admin] [instance: 7cde3fb7-477a-4428-aef7-1ffe15a0920b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:32.127089 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5690e9b6-dc3b-41af-819c-d1d7f41f84a9 tempest-TestNetworkAdvancedServerOps-443223969 tempest-TestNetworkAdvancedServerOps-443223969-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:32.132817 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5690e9b6-dc3b-41af-819c-d1d7f41f84a9 tempest-TestNetworkAdvancedServerOps-443223969 tempest-TestNetworkAdvancedServerOps-443223969-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:32.132817 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5690e9b6-dc3b-41af-819c-d1d7f41f84a9 tempest-TestNetworkAdvancedServerOps-443223969 tempest-TestNetworkAdvancedServerOps-443223969-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:32.132817 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5690e9b6-dc3b-41af-819c-d1d7f41f84a9 tempest-TestNetworkAdvancedServerOps-443223969 tempest-TestNetworkAdvancedServerOps-443223969-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:32.132817 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5690e9b6-dc3b-41af-819c-d1d7f41f84a9 tempest-TestNetworkAdvancedServerOps-443223969 tempest-TestNetworkAdvancedServerOps-443223969-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:32.132817 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5690e9b6-dc3b-41af-819c-d1d7f41f84a9 tempest-TestNetworkAdvancedServerOps-443223969 tempest-TestNetworkAdvancedServerOps-443223969-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:32.264929 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5690e9b6-dc3b-41af-819c-d1d7f41f84a9 tempest-TestNetworkAdvancedServerOps-443223969 tempest-TestNetworkAdvancedServerOps-443223969-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b" status: 200 len: 1836 microversion: 2.1 time: 0.151874 Oct 04 19:23:32.265508 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3561/7105] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:32 2022] GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b => generated 1836 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:23:33.523701 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-12271b34-48df-4641-bdc8-28c850f71aac req-6146372f-ab74-4e2c-8881-a4891fda1672 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cde3fb7-477a-4428-aef7-1ffe15a0920b", "tag": "1dabf904-1386-42b0-8090-091cabf42f07"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:23:33.528929 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-52f752d0-30ea-4149-aa3a-c66cfdfd6056 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:33.535592 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-52f752d0-30ea-4149-aa3a-c66cfdfd6056 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: 7cde3fb7-477a-4428-aef7-1ffe15a0920b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:33.543028 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-12271b34-48df-4641-bdc8-28c850f71aac req-6146372f-ab74-4e2c-8881-a4891fda1672 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:33.543521 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-12271b34-48df-4641-bdc8-28c850f71aac req-6146372f-ab74-4e2c-8881-a4891fda1672 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:33.543956 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-12271b34-48df-4641-bdc8-28c850f71aac req-6146372f-ab74-4e2c-8881-a4891fda1672 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:33.544480 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-52f752d0-30ea-4149-aa3a-c66cfdfd6056 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:33.544987 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-52f752d0-30ea-4149-aa3a-c66cfdfd6056 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:33.545436 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-52f752d0-30ea-4149-aa3a-c66cfdfd6056 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:33.546145 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-52f752d0-30ea-4149-aa3a-c66cfdfd6056 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:33.546825 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-52f752d0-30ea-4149-aa3a-c66cfdfd6056 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:33.547266 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-52f752d0-30ea-4149-aa3a-c66cfdfd6056 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:33.556620 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-12271b34-48df-4641-bdc8-28c850f71aac req-6146372f-ab74-4e2c-8881-a4891fda1672 service nova] Creating event network-changed:1dabf904-1386-42b0-8090-091cabf42f07 for instance 7cde3fb7-477a-4428-aef7-1ffe15a0920b on n-h1-850501-14 Oct 04 19:23:33.561894 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-12271b34-48df-4641-bdc8-28c850f71aac req-6146372f-ab74-4e2c-8881-a4891fda1672 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042289 Oct 04 19:23:33.562881 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3562/7106] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:23:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:23:33.575916 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-52f752d0-30ea-4149-aa3a-c66cfdfd6056 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: 7cde3fb7-477a-4428-aef7-1ffe15a0920b] Going to try to terminate instance {{(pid=123002) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:23:33.813893 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-52f752d0-30ea-4149-aa3a-c66cfdfd6056 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b" status: 204 len: 0 microversion: 2.1 time: 0.295945 Oct 04 19:23:33.814535 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3545/7107] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 19:23:33 2022] DELETE /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:23:33.823584 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f582089a-7387-4388-addb-fc8fe8e13550 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:33.824569 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f582089a-7387-4388-addb-fc8fe8e13550 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: 7cde3fb7-477a-4428-aef7-1ffe15a0920b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:33.831268 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f582089a-7387-4388-addb-fc8fe8e13550 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:33.832093 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f582089a-7387-4388-addb-fc8fe8e13550 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:33.832760 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f582089a-7387-4388-addb-fc8fe8e13550 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:33.833702 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f582089a-7387-4388-addb-fc8fe8e13550 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:33.834494 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f582089a-7387-4388-addb-fc8fe8e13550 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:33.835176 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f582089a-7387-4388-addb-fc8fe8e13550 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:33.978291 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f582089a-7387-4388-addb-fc8fe8e13550 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:23:33.989541 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f582089a-7387-4388-addb-fc8fe8e13550 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b" status: 200 len: 1689 microversion: 2.1 time: 0.170130 Oct 04 19:23:33.990333 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3563/7108] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:33 2022] GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b => generated 1689 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:23:35.014094 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-85079654-e8b0-4232-94d0-527d7205368b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:35.014861 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-85079654-e8b0-4232-94d0-527d7205368b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: 7cde3fb7-477a-4428-aef7-1ffe15a0920b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:35.026716 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-85079654-e8b0-4232-94d0-527d7205368b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:35.027220 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-85079654-e8b0-4232-94d0-527d7205368b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:35.027673 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-85079654-e8b0-4232-94d0-527d7205368b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:35.028410 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-85079654-e8b0-4232-94d0-527d7205368b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:35.028875 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-85079654-e8b0-4232-94d0-527d7205368b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:35.029309 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-85079654-e8b0-4232-94d0-527d7205368b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:35.171944 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-85079654-e8b0-4232-94d0-527d7205368b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:23:35.180586 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-85079654-e8b0-4232-94d0-527d7205368b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b" status: 200 len: 1689 microversion: 2.1 time: 0.170783 Oct 04 19:23:35.181187 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3546/7109] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:35 2022] GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b => generated 1689 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:23:35.601034 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-2c0213e4-857a-4e68-b15f-53db08709ec3 req-e503d677-8367-4eed-b87c-47543aea5e45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cde3fb7-477a-4428-aef7-1ffe15a0920b", "name": "network-vif-deleted", "tag": "1dabf904-1386-42b0-8090-091cabf42f07"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:23:35.611346 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-2c0213e4-857a-4e68-b15f-53db08709ec3 req-e503d677-8367-4eed-b87c-47543aea5e45 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:35.611825 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-2c0213e4-857a-4e68-b15f-53db08709ec3 req-e503d677-8367-4eed-b87c-47543aea5e45 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:35.612305 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-2c0213e4-857a-4e68-b15f-53db08709ec3 req-e503d677-8367-4eed-b87c-47543aea5e45 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:35.623547 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-2c0213e4-857a-4e68-b15f-53db08709ec3 req-e503d677-8367-4eed-b87c-47543aea5e45 service nova] Creating event network-vif-deleted:1dabf904-1386-42b0-8090-091cabf42f07 for instance 7cde3fb7-477a-4428-aef7-1ffe15a0920b on n-h1-850501-14 Oct 04 19:23:35.628611 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-2c0213e4-857a-4e68-b15f-53db08709ec3 req-e503d677-8367-4eed-b87c-47543aea5e45 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031945 Oct 04 19:23:35.629272 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3564/7110] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:23:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:23:36.204728 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d7e36171-53ad-4b2f-aaa0-9f51f5d03338 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:36.205347 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d7e36171-53ad-4b2f-aaa0-9f51f5d03338 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: 7cde3fb7-477a-4428-aef7-1ffe15a0920b] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:36.213720 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d7e36171-53ad-4b2f-aaa0-9f51f5d03338 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:36.214215 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d7e36171-53ad-4b2f-aaa0-9f51f5d03338 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:36.214671 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d7e36171-53ad-4b2f-aaa0-9f51f5d03338 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:36.215381 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d7e36171-53ad-4b2f-aaa0-9f51f5d03338 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:36.216126 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d7e36171-53ad-4b2f-aaa0-9f51f5d03338 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:36.216572 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d7e36171-53ad-4b2f-aaa0-9f51f5d03338 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:36.250543 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d7e36171-53ad-4b2f-aaa0-9f51f5d03338 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:36.251088 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d7e36171-53ad-4b2f-aaa0-9f51f5d03338 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:36.251543 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d7e36171-53ad-4b2f-aaa0-9f51f5d03338 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:36.252014 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-d7e36171-53ad-4b2f-aaa0-9f51f5d03338 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lazy-loading 'fault' on Instance uuid 7cde3fb7-477a-4428-aef7-1ffe15a0920b {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:23:36.299225 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d7e36171-53ad-4b2f-aaa0-9f51f5d03338 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:23:36.307760 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d7e36171-53ad-4b2f-aaa0-9f51f5d03338 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b" status: 200 len: 1357 microversion: 2.1 time: 0.106927 Oct 04 19:23:36.308360 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3547/7111] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:36 2022] GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b => generated 1357 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:23:37.333140 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c012ca4e-0246-489d-a31a-987ace2ee688 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:37.333846 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c012ca4e-0246-489d-a31a-987ace2ee688 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: 7cde3fb7-477a-4428-aef7-1ffe15a0920b] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:37.340796 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c012ca4e-0246-489d-a31a-987ace2ee688 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:37.341295 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c012ca4e-0246-489d-a31a-987ace2ee688 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:37.341734 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c012ca4e-0246-489d-a31a-987ace2ee688 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:37.342422 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c012ca4e-0246-489d-a31a-987ace2ee688 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:37.342878 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c012ca4e-0246-489d-a31a-987ace2ee688 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:37.343304 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c012ca4e-0246-489d-a31a-987ace2ee688 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:37.357722 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-c012ca4e-0246-489d-a31a-987ace2ee688 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] HTTP exception thrown: Instance 7cde3fb7-477a-4428-aef7-1ffe15a0920b could not be found. Oct 04 19:23:37.359332 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c012ca4e-0246-489d-a31a-987ace2ee688 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Request method failure captured: Oct 04 19:23:37.359332 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b HTTP/1.1 Oct 04 19:23:37.359332 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 19:23:37.359332 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 19:23:37.359332 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 19:23:37.359332 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 19:23:37.359332 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 19:23:37.359332 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 19:23:37.359332 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 19:23:37.359332 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 19:23:37.359332 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPIcrTIoZmU9MC83P2pr9ihdde_O34kT-H-5oj2NnEUHxZ7u6d0iVUulFYuyLpCenTbNTzDECz-ja0Upgm5x505nJ4VYUuS8arG8yRvvAazBWadpmzk8tZWcFQnwqYgCdSmdZmyUlhN1rUbAZJtGPYmlMzSSC1eYEi1Aha5rPMaRu8oI Oct 04 19:23:37.359332 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 19:23:37.359332 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 19:23:37.359332 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 19:23:37.359332 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 19:23:37.359332 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 19:23:37.359332 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 19:23:37.359332 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 81e34eff3bda4651aece03d213439a2b Oct 04 19:23:37.359332 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1051949435 Oct 04 19:23:37.359332 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 19:23:37.359332 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 19:23:37.359332 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/81e34eff3bda4651aece03d213439a2b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_81e34eff3bda4651aece03d213439a2b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/81e34eff3bda4651aece03d213439a2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/81e34eff3bda4651aece03d213439a2b"}]}] Oct 04 19:23:37.359332 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1051949435 Oct 04 19:23:37.359332 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 81e34eff3bda4651aece03d213439a2b Oct 04 19:23:37.359332 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1051949435 Oct 04 19:23:37.359332 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-TestNetworkAdvancedServerOps-1051949435-project Oct 04 19:23:37.359332 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 19:23:37.359332 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 19:23:37.359332 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: e66faeb21cd44d9e927e436096f49e26 Oct 04 19:23:37.359332 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1051949435-project Oct 04 19:23:37.359332 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 19:23:37.359332 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 7cde3fb7-477a-4428-aef7-1ffe15a0920b could not be found. Oct 04 19:23:37.359332 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '7cde3fb7-477a-4428-aef7-1ffe15a0920b'} Oct 04 19:23:37.359332 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:23:37.359332 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:23:37.359332 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:23:37.359332 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:23:37.359332 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:23:37.359332 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:23:37.359332 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:23:37.359332 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:23:37.359332 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:23:37.359332 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:23:37.359332 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cde3fb7-477a-4428-aef7-1ffe15a0920b could not be found. Oct 04 19:23:37.359332 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:23:37.359332 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:23:37.359332 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:23:37.359332 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:23:37.359332 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:23:37.359332 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:23:37.359332 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:23:37.359332 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:23:37.359332 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:23:37.359332 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:23:37.359332 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:23:37.359332 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:23:37.359332 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:23:37.359332 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:23:37.359332 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:23:37.359332 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:23:37.359332 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cde3fb7-477a-4428-aef7-1ffe15a0920b could not be found. Oct 04 19:23:37.359332 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:23:37.359332 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:23:37.362998 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:23:37.362998 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:23:37.362998 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:23:37.362998 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:23:37.362998 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:23:37.362998 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:23:37.362998 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cde3fb7-477a-4428-aef7-1ffe15a0920b could not be found. Oct 04 19:23:37.362998 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:23:37.362998 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c012ca4e-0246-489d-a31a-987ace2ee688 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Returning 404 to user: Instance 7cde3fb7-477a-4428-aef7-1ffe15a0920b could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:23:37.362998 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c012ca4e-0246-489d-a31a-987ace2ee688 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b" status: 404 len: 111 microversion: 2.1 time: 0.032743 Oct 04 19:23:37.362998 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3565/7112] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:37 2022] GET /compute/v2.1/servers/7cde3fb7-477a-4428-aef7-1ffe15a0920b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:23:41.087321 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-48ba9661-2a4b-4b92-8e38-c715e04ac498 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '.version_select at 0x7fe2592d7ca0>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:41.092260 n-d-850501-14 devstack@n-api.service[123002]: ERROR oslo.messaging._drivers.impl_rabbit [None req-48ba9661-2a4b-4b92-8e38-c715e04ac498 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [aa8a6026-a0ad-4edc-b247-1eb6230d8784] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 19:23:42.101015 n-d-850501-14 devstack@n-api.service[123002]: INFO oslo.messaging._drivers.impl_rabbit [None req-48ba9661-2a4b-4b92-8e38-c715e04ac498 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [aa8a6026-a0ad-4edc-b247-1eb6230d8784] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 47210. Oct 04 19:23:42.180383 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-48ba9661-2a4b-4b92-8e38-c715e04ac498 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1008140681" status: 202 len: 0 microversion: 2.1 time: 1.097878 Oct 04 19:23:42.180929 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3548/7113] 10.222.0.20 () {58 vars in 1284 bytes} [Tue Oct 4 19:23:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1008140681 => generated 0 bytes in 1099 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:23:42.221159 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c8e1c488-f08b-4c60-b652-f1735edf9dd3 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Action: 'create', calling method: .version_select at 0x7fe253a8e3a0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-501138083", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBACF8w+/xJQY57tCwf17ibU7jjDMwsBYt3IdlP0OZZzv06ZjkXXJzMOpgZjJJNhA5Ap458rtJq1ZmEv3DdZauYEwFI1WleHCGqvsfnxrUEMbDKhPMYmGecBPyX70XUQ+IA=="}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:23:42.237835 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-c8e1c488-f08b-4c60-b652-f1735edf9dd3 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Getting quotas for project 81e34eff3bda4651aece03d213439a2b. Resources: {'key_pairs'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:23:42.248854 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-c8e1c488-f08b-4c60-b652-f1735edf9dd3 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Getting quotas for user e66faeb21cd44d9e927e436096f49e26 and project 81e34eff3bda4651aece03d213439a2b. Resources: {'key_pairs'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:23:42.263274 n-d-850501-14 devstack@n-api.service[123001]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c8e1c488-f08b-4c60-b652-f1735edf9dd3 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [6c8ce3ae-b440-4b28-996b-33b11441f461] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 19:23:43.270596 n-d-850501-14 devstack@n-api.service[123001]: INFO oslo.messaging._drivers.impl_rabbit [None req-c8e1c488-f08b-4c60-b652-f1735edf9dd3 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [6c8ce3ae-b440-4b28-996b-33b11441f461] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 47216. Oct 04 19:23:43.339739 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c8e1c488-f08b-4c60-b652-f1735edf9dd3 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 1.123202 Oct 04 19:23:43.340375 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3566/7114] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Oct 4 19:23:42 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:23:51.472483 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-47eddf07-1071-4441-ac36-744bc42deb46 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-869956745", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": [{"uuid": "c5d5e36b-c347-433c-a604-3cec79652013"}], "key_name": "tempest-TestNetworkAdvancedServerOps-501138083", "security_groups": [{"name": "tempest-secgroup-smoke-1292806845"}]}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:23:51.483611 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:23:51.619581 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-47eddf07-1071-4441-ac36-744bc42deb46 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] validate_networks() for [('c5d5e36b-c347-433c-a604-3cec79652013', None, None, None, None, None)] {{(pid=123002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:23:52.058619 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-47eddf07-1071-4441-ac36-744bc42deb46 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:23:52.062223 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-47eddf07-1071-4441-ac36-744bc42deb46 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:23:52.062776 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-47eddf07-1071-4441-ac36-744bc42deb46 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:23:52.063209 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-47eddf07-1071-4441-ac36-744bc42deb46 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:23:52.063690 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-47eddf07-1071-4441-ac36-744bc42deb46 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:23:52.078156 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-47eddf07-1071-4441-ac36-744bc42deb46 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:52.078924 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-47eddf07-1071-4441-ac36-744bc42deb46 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:52.079663 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-47eddf07-1071-4441-ac36-744bc42deb46 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:52.081313 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-47eddf07-1071-4441-ac36-744bc42deb46 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:52.081976 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-47eddf07-1071-4441-ac36-744bc42deb46 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:52.082656 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-47eddf07-1071-4441-ac36-744bc42deb46 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:52.108807 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-47eddf07-1071-4441-ac36-744bc42deb46 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Getting quotas for project 81e34eff3bda4651aece03d213439a2b. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:23:52.115099 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-47eddf07-1071-4441-ac36-744bc42deb46 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Getting quotas for user e66faeb21cd44d9e927e436096f49e26 and project 81e34eff3bda4651aece03d213439a2b. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:23:52.130434 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-47eddf07-1071-4441-ac36-744bc42deb46 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Going to run 1 instances... {{(pid=123002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:23:52.133005 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-47eddf07-1071-4441-ac36-744bc42deb46 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:23:52.278284 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-47eddf07-1071-4441-ac36-744bc42deb46 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.809682 Oct 04 19:23:52.279141 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3549/7115] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 19:23:51 2022] POST /compute/v2.1/servers => generated 406 bytes in 812 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:23:52.294776 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=18 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:23:52.296834 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=4 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:23:52.303283 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-91a87091-0bbf-4fd3-8593-4cd8eb5adb51 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:52.304565 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-91a87091-0bbf-4fd3-8593-4cd8eb5adb51 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:52.409115 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-91a87091-0bbf-4fd3-8593-4cd8eb5adb51 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:23:52.420877 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-91a87091-0bbf-4fd3-8593-4cd8eb5adb51 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a" status: 200 len: 1265 microversion: 2.1 time: 0.129320 Oct 04 19:23:52.421113 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3567/7116] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:52 2022] GET /compute/v2.1/servers/f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a => generated 1265 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:23:53.446533 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-97f96b44-fc5b-4b62-a8af-771ad4706c26 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:53.449898 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-97f96b44-fc5b-4b62-a8af-771ad4706c26 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:53.505561 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-97f96b44-fc5b-4b62-a8af-771ad4706c26 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:23:53.513851 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-97f96b44-fc5b-4b62-a8af-771ad4706c26 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a" status: 200 len: 1265 microversion: 2.1 time: 0.073298 Oct 04 19:23:53.514814 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3550/7117] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:53 2022] GET /compute/v2.1/servers/f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a => generated 1265 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:23:54.537352 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-344f9d6c-3d17-4da6-9cf0-e48ce2306f41 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:54.537964 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-344f9d6c-3d17-4da6-9cf0-e48ce2306f41 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:54.607627 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-344f9d6c-3d17-4da6-9cf0-e48ce2306f41 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:23:54.614894 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-344f9d6c-3d17-4da6-9cf0-e48ce2306f41 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a" status: 200 len: 1265 microversion: 2.1 time: 0.081833 Oct 04 19:23:54.615469 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3568/7118] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:54 2022] GET /compute/v2.1/servers/f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a => generated 1265 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:23:55.638435 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7376ab57-2299-4151-9bd6-84d88b33b671 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:55.639083 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7376ab57-2299-4151-9bd6-84d88b33b671 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:55.646095 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7376ab57-2299-4151-9bd6-84d88b33b671 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:55.646597 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7376ab57-2299-4151-9bd6-84d88b33b671 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:55.647095 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7376ab57-2299-4151-9bd6-84d88b33b671 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:55.648569 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7376ab57-2299-4151-9bd6-84d88b33b671 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:55.649174 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7376ab57-2299-4151-9bd6-84d88b33b671 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:55.649615 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7376ab57-2299-4151-9bd6-84d88b33b671 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:55.717687 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7376ab57-2299-4151-9bd6-84d88b33b671 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:23:55.725623 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7376ab57-2299-4151-9bd6-84d88b33b671 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a" status: 200 len: 1261 microversion: 2.1 time: 0.091199 Oct 04 19:23:55.726843 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3551/7119] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:55 2022] GET /compute/v2.1/servers/f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a => generated 1261 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:23:56.753708 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-935ab148-ee4c-4b7f-bbd6-289ee03bc39d tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:56.754340 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-935ab148-ee4c-4b7f-bbd6-289ee03bc39d tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:56.762225 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-935ab148-ee4c-4b7f-bbd6-289ee03bc39d tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:56.762722 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-935ab148-ee4c-4b7f-bbd6-289ee03bc39d tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:56.763170 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-935ab148-ee4c-4b7f-bbd6-289ee03bc39d tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:56.763889 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-935ab148-ee4c-4b7f-bbd6-289ee03bc39d tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:56.764387 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-935ab148-ee4c-4b7f-bbd6-289ee03bc39d tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:56.764820 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-935ab148-ee4c-4b7f-bbd6-289ee03bc39d tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:56.831970 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-935ab148-ee4c-4b7f-bbd6-289ee03bc39d tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:23:56.840253 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-935ab148-ee4c-4b7f-bbd6-289ee03bc39d tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a" status: 200 len: 1323 microversion: 2.1 time: 0.090426 Oct 04 19:23:56.841185 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3569/7120] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:56 2022] GET /compute/v2.1/servers/f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a => generated 1323 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:23:57.865466 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7eb5f2f0-bcdb-4463-985c-afc4ef8c22f2 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:57.866098 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7eb5f2f0-bcdb-4463-985c-afc4ef8c22f2 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:57.871725 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:23:57.875451 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7eb5f2f0-bcdb-4463-985c-afc4ef8c22f2 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:57.875964 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7eb5f2f0-bcdb-4463-985c-afc4ef8c22f2 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:57.876443 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7eb5f2f0-bcdb-4463-985c-afc4ef8c22f2 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:57.877166 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7eb5f2f0-bcdb-4463-985c-afc4ef8c22f2 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:57.877638 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7eb5f2f0-bcdb-4463-985c-afc4ef8c22f2 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:57.878080 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7eb5f2f0-bcdb-4463-985c-afc4ef8c22f2 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:58.017017 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7eb5f2f0-bcdb-4463-985c-afc4ef8c22f2 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:23:58.025774 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7eb5f2f0-bcdb-4463-985c-afc4ef8c22f2 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a" status: 200 len: 1391 microversion: 2.1 time: 0.164387 Oct 04 19:23:58.026777 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3552/7121] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:57 2022] GET /compute/v2.1/servers/f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a => generated 1391 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:23:58.385393 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-72e0ab4d-0a85-4a05-b03d-a66d2b9a7b1a req-549cc5c7-408a-4dd4-a67e-598be195b15c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a", "tag": "da897552-6c69-4ab4-8e75-37d70149b4d2"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:23:58.397090 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-72e0ab4d-0a85-4a05-b03d-a66d2b9a7b1a req-549cc5c7-408a-4dd4-a67e-598be195b15c service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:58.397579 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-72e0ab4d-0a85-4a05-b03d-a66d2b9a7b1a req-549cc5c7-408a-4dd4-a67e-598be195b15c service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:58.400662 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-72e0ab4d-0a85-4a05-b03d-a66d2b9a7b1a req-549cc5c7-408a-4dd4-a67e-598be195b15c service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:58.410704 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-72e0ab4d-0a85-4a05-b03d-a66d2b9a7b1a req-549cc5c7-408a-4dd4-a67e-598be195b15c service nova] Creating event network-changed:da897552-6c69-4ab4-8e75-37d70149b4d2 for instance f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a on n-h1-850501-14 Oct 04 19:23:58.416993 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-72e0ab4d-0a85-4a05-b03d-a66d2b9a7b1a req-549cc5c7-408a-4dd4-a67e-598be195b15c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037698 Oct 04 19:23:58.417604 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3570/7122] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:23:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:23:59.049566 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e60dcbb2-b3b8-479b-afad-2fc3c0292cb8 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:59.050255 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e60dcbb2-b3b8-479b-afad-2fc3c0292cb8 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:59.058006 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e60dcbb2-b3b8-479b-afad-2fc3c0292cb8 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:59.058512 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e60dcbb2-b3b8-479b-afad-2fc3c0292cb8 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:59.058977 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e60dcbb2-b3b8-479b-afad-2fc3c0292cb8 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:59.059697 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e60dcbb2-b3b8-479b-afad-2fc3c0292cb8 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:59.060204 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e60dcbb2-b3b8-479b-afad-2fc3c0292cb8 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:59.060716 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e60dcbb2-b3b8-479b-afad-2fc3c0292cb8 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:59.208177 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e60dcbb2-b3b8-479b-afad-2fc3c0292cb8 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:23:59.217068 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e60dcbb2-b3b8-479b-afad-2fc3c0292cb8 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a" status: 200 len: 1391 microversion: 2.1 time: 0.171743 Oct 04 19:23:59.217678 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3553/7123] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:59 2022] GET /compute/v2.1/servers/f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a => generated 1391 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:24:00.245559 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-125e9d43-b9c1-499c-972c-f920720efd21 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:24:00.246287 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-125e9d43-b9c1-499c-972c-f920720efd21 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:24:00.252485 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-125e9d43-b9c1-499c-972c-f920720efd21 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:00.252969 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-125e9d43-b9c1-499c-972c-f920720efd21 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:00.253405 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-125e9d43-b9c1-499c-972c-f920720efd21 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:00.254096 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-125e9d43-b9c1-499c-972c-f920720efd21 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:00.254553 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-125e9d43-b9c1-499c-972c-f920720efd21 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:00.254978 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-125e9d43-b9c1-499c-972c-f920720efd21 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:00.386670 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-125e9d43-b9c1-499c-972c-f920720efd21 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:24:00.394397 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-125e9d43-b9c1-499c-972c-f920720efd21 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a" status: 200 len: 1391 microversion: 2.1 time: 0.154718 Oct 04 19:24:00.394964 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3571/7124] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:24:00 2022] GET /compute/v2.1/servers/f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a => generated 1391 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:24:01.418924 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-16a744b0-7c0c-4814-a7fd-a8b0fed69c2a tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:24:01.419590 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-16a744b0-7c0c-4814-a7fd-a8b0fed69c2a tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:24:01.426544 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-16a744b0-7c0c-4814-a7fd-a8b0fed69c2a tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:01.427050 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-16a744b0-7c0c-4814-a7fd-a8b0fed69c2a tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:01.427505 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-16a744b0-7c0c-4814-a7fd-a8b0fed69c2a tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:01.428246 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-16a744b0-7c0c-4814-a7fd-a8b0fed69c2a tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:01.428724 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-16a744b0-7c0c-4814-a7fd-a8b0fed69c2a tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:01.429172 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-16a744b0-7c0c-4814-a7fd-a8b0fed69c2a tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:01.563473 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-16a744b0-7c0c-4814-a7fd-a8b0fed69c2a tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:24:01.571488 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-16a744b0-7c0c-4814-a7fd-a8b0fed69c2a tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a" status: 200 len: 1391 microversion: 2.1 time: 0.156995 Oct 04 19:24:01.571855 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3554/7125] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:24:01 2022] GET /compute/v2.1/servers/f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:24:02.600934 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1a86dd1f-51db-45d0-98a7-79bb998bc680 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:24:02.601482 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1a86dd1f-51db-45d0-98a7-79bb998bc680 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:24:02.604930 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:24:02.609757 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1a86dd1f-51db-45d0-98a7-79bb998bc680 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:02.610286 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1a86dd1f-51db-45d0-98a7-79bb998bc680 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:02.610720 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1a86dd1f-51db-45d0-98a7-79bb998bc680 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:02.618460 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1a86dd1f-51db-45d0-98a7-79bb998bc680 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:02.618460 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1a86dd1f-51db-45d0-98a7-79bb998bc680 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:02.618460 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1a86dd1f-51db-45d0-98a7-79bb998bc680 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:02.749291 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1a86dd1f-51db-45d0-98a7-79bb998bc680 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:24:02.756932 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1a86dd1f-51db-45d0-98a7-79bb998bc680 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a" status: 200 len: 1391 microversion: 2.1 time: 0.166010 Oct 04 19:24:02.757503 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3572/7126] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:24:02 2022] GET /compute/v2.1/servers/f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a => generated 1391 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:24:03.779584 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-26631a1c-45db-4311-91cc-08e7fa9cb4d7 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:24:03.780295 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-26631a1c-45db-4311-91cc-08e7fa9cb4d7 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:24:03.788893 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:24:03.788893 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=8 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:24:03.788893 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-26631a1c-45db-4311-91cc-08e7fa9cb4d7 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:03.789191 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-26631a1c-45db-4311-91cc-08e7fa9cb4d7 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:03.790221 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-26631a1c-45db-4311-91cc-08e7fa9cb4d7 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:03.791401 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-26631a1c-45db-4311-91cc-08e7fa9cb4d7 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:03.791883 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-26631a1c-45db-4311-91cc-08e7fa9cb4d7 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:03.792353 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-26631a1c-45db-4311-91cc-08e7fa9cb4d7 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:03.932591 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-26631a1c-45db-4311-91cc-08e7fa9cb4d7 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:24:03.941227 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-26631a1c-45db-4311-91cc-08e7fa9cb4d7 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a" status: 200 len: 1391 microversion: 2.1 time: 0.165541 Oct 04 19:24:03.941826 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3555/7127] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:24:03 2022] GET /compute/v2.1/servers/f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a => generated 1391 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:24:03.986936 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-228b3c5a-1f8a-4795-b749-e1b7232347f0 req-c5c84dba-4a1c-4d62-9d5b-27026906572a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a", "name": "network-vif-plugged", "status": "completed", "tag": "da897552-6c69-4ab4-8e75-37d70149b4d2"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:24:03.997219 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-228b3c5a-1f8a-4795-b749-e1b7232347f0 req-c5c84dba-4a1c-4d62-9d5b-27026906572a service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:03.997702 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-228b3c5a-1f8a-4795-b749-e1b7232347f0 req-c5c84dba-4a1c-4d62-9d5b-27026906572a service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:03.998142 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-228b3c5a-1f8a-4795-b749-e1b7232347f0 req-c5c84dba-4a1c-4d62-9d5b-27026906572a service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:04.009979 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-228b3c5a-1f8a-4795-b749-e1b7232347f0 req-c5c84dba-4a1c-4d62-9d5b-27026906572a service nova] Creating event network-vif-plugged:da897552-6c69-4ab4-8e75-37d70149b4d2 for instance f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a on n-h1-850501-14 Oct 04 19:24:04.015086 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-228b3c5a-1f8a-4795-b749-e1b7232347f0 req-c5c84dba-4a1c-4d62-9d5b-27026906572a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031786 Oct 04 19:24:04.015718 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3573/7128] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:24:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:24:04.968014 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1f9ad066-c83f-47de-9d2e-74ad97a7b3b5 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:24:04.968669 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1f9ad066-c83f-47de-9d2e-74ad97a7b3b5 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:24:04.975814 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1f9ad066-c83f-47de-9d2e-74ad97a7b3b5 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:04.976295 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1f9ad066-c83f-47de-9d2e-74ad97a7b3b5 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:04.976749 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1f9ad066-c83f-47de-9d2e-74ad97a7b3b5 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:04.977543 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1f9ad066-c83f-47de-9d2e-74ad97a7b3b5 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:04.978016 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1f9ad066-c83f-47de-9d2e-74ad97a7b3b5 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:04.978463 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1f9ad066-c83f-47de-9d2e-74ad97a7b3b5 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:05.118462 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1f9ad066-c83f-47de-9d2e-74ad97a7b3b5 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:24:05.126335 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1f9ad066-c83f-47de-9d2e-74ad97a7b3b5 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a" status: 200 len: 1391 microversion: 2.1 time: 0.162941 Oct 04 19:24:05.126916 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3556/7129] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:24:04 2022] GET /compute/v2.1/servers/f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a => generated 1391 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:24:06.147642 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=4 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:24:06.152991 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f36e15aa-e4f8-4711-8783-013291a9fcf4 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:24:06.153706 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f36e15aa-e4f8-4711-8783-013291a9fcf4 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:24:06.159935 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f36e15aa-e4f8-4711-8783-013291a9fcf4 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:06.160457 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f36e15aa-e4f8-4711-8783-013291a9fcf4 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:06.160901 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f36e15aa-e4f8-4711-8783-013291a9fcf4 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:06.161596 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f36e15aa-e4f8-4711-8783-013291a9fcf4 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:06.162058 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f36e15aa-e4f8-4711-8783-013291a9fcf4 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:06.162491 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f36e15aa-e4f8-4711-8783-013291a9fcf4 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:06.294099 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f36e15aa-e4f8-4711-8783-013291a9fcf4 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:24:06.301849 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f36e15aa-e4f8-4711-8783-013291a9fcf4 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a" status: 200 len: 1563 microversion: 2.1 time: 0.155150 Oct 04 19:24:06.302421 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3574/7130] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:24:06 2022] GET /compute/v2.1/servers/f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a => generated 1563 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:24:06.324273 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-aff4fe53-a316-4a20-bcd0-b787d2ce16bf tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:24:06.324907 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-aff4fe53-a316-4a20-bcd0-b787d2ce16bf tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:24:06.331680 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aff4fe53-a316-4a20-bcd0-b787d2ce16bf tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:06.332220 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aff4fe53-a316-4a20-bcd0-b787d2ce16bf tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:06.332677 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aff4fe53-a316-4a20-bcd0-b787d2ce16bf tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:06.333415 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aff4fe53-a316-4a20-bcd0-b787d2ce16bf tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:06.333887 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aff4fe53-a316-4a20-bcd0-b787d2ce16bf tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:06.334332 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aff4fe53-a316-4a20-bcd0-b787d2ce16bf tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:06.471298 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-aff4fe53-a316-4a20-bcd0-b787d2ce16bf tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:24:06.479225 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-aff4fe53-a316-4a20-bcd0-b787d2ce16bf tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a" status: 200 len: 1563 microversion: 2.1 time: 0.159374 Oct 04 19:24:06.479799 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3557/7131] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:24:06 2022] GET /compute/v2.1/servers/f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a => generated 1563 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:24:08.712092 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-f1054356-8296-48f1-9854-87322f5232fb req-77bb41e3-f686-446c-a803-dacb43019c6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a", "tag": "da897552-6c69-4ab4-8e75-37d70149b4d2"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:24:08.724860 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-f1054356-8296-48f1-9854-87322f5232fb req-77bb41e3-f686-446c-a803-dacb43019c6d service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:08.725457 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-f1054356-8296-48f1-9854-87322f5232fb req-77bb41e3-f686-446c-a803-dacb43019c6d service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:08.726144 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-f1054356-8296-48f1-9854-87322f5232fb req-77bb41e3-f686-446c-a803-dacb43019c6d service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:08.739205 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-f1054356-8296-48f1-9854-87322f5232fb req-77bb41e3-f686-446c-a803-dacb43019c6d service nova] Creating event network-changed:da897552-6c69-4ab4-8e75-37d70149b4d2 for instance f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a on n-h1-850501-14 Oct 04 19:24:08.745449 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-f1054356-8296-48f1-9854-87322f5232fb req-77bb41e3-f686-446c-a803-dacb43019c6d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037529 Oct 04 19:24:08.746313 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3558/7132] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:24:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:24:08.780968 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-656c22b0-1800-46e5-a80e-8cf0e45fc230 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:24:08.782547 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-656c22b0-1800-46e5-a80e-8cf0e45fc230 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:24:08.793806 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-656c22b0-1800-46e5-a80e-8cf0e45fc230 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:08.794302 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-656c22b0-1800-46e5-a80e-8cf0e45fc230 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:08.794737 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-656c22b0-1800-46e5-a80e-8cf0e45fc230 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:08.795627 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-656c22b0-1800-46e5-a80e-8cf0e45fc230 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:08.796102 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-656c22b0-1800-46e5-a80e-8cf0e45fc230 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:08.796528 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-656c22b0-1800-46e5-a80e-8cf0e45fc230 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:08.948483 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-656c22b0-1800-46e5-a80e-8cf0e45fc230 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:24:08.956346 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-656c22b0-1800-46e5-a80e-8cf0e45fc230 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a" status: 200 len: 1563 microversion: 2.1 time: 0.251679 Oct 04 19:24:08.957248 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3575/7133] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:24:08 2022] GET /compute/v2.1/servers/f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a => generated 1563 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:24:30.204277 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=13 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:24:30.205033 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=46 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:24:30.209253 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ffbb4ae5-349a-4143-b851-71a60944bc6c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:24:30.212264 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ffbb4ae5-349a-4143-b851-71a60944bc6c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:24:30.218484 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ffbb4ae5-349a-4143-b851-71a60944bc6c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:30.218976 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ffbb4ae5-349a-4143-b851-71a60944bc6c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:30.219423 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ffbb4ae5-349a-4143-b851-71a60944bc6c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:30.220166 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ffbb4ae5-349a-4143-b851-71a60944bc6c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:30.220636 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ffbb4ae5-349a-4143-b851-71a60944bc6c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:30.221069 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ffbb4ae5-349a-4143-b851-71a60944bc6c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:30.271751 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ffbb4ae5-349a-4143-b851-71a60944bc6c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "POST /compute/v2.1/servers/f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a/action" status: 200 len: 24569 microversion: 2.1 time: 0.069322 Oct 04 19:24:30.272454 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3559/7134] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 19:24:30 2022] POST /compute/v2.1/servers/f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a/action => generated 24569 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:24:41.339498 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-038881b2-9144-401f-8cbb-f9325b6ef490 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:24:41.340137 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-038881b2-9144-401f-8cbb-f9325b6ef490 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:24:41.342767 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=7 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:24:41.343429 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=34 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:24:41.348348 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-038881b2-9144-401f-8cbb-f9325b6ef490 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:41.348839 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-038881b2-9144-401f-8cbb-f9325b6ef490 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:41.349288 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-038881b2-9144-401f-8cbb-f9325b6ef490 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:41.349970 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-038881b2-9144-401f-8cbb-f9325b6ef490 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:41.350427 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-038881b2-9144-401f-8cbb-f9325b6ef490 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:41.350854 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-038881b2-9144-401f-8cbb-f9325b6ef490 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:41.553949 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-038881b2-9144-401f-8cbb-f9325b6ef490 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:24:41.562539 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-038881b2-9144-401f-8cbb-f9325b6ef490 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a" status: 200 len: 1681 microversion: 2.1 time: 0.227347 Oct 04 19:24:41.563114 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3576/7135] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:24:41 2022] GET /compute/v2.1/servers/f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a => generated 1681 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:24:41.663035 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4705a82d-6dba-4a61-a11f-03d6474c4a3d tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:24:41.666004 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4705a82d-6dba-4a61-a11f-03d6474c4a3d tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:24:41.668551 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:24:41.669218 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=4 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:24:41.674197 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4705a82d-6dba-4a61-a11f-03d6474c4a3d tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:41.680394 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4705a82d-6dba-4a61-a11f-03d6474c4a3d tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:41.680394 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4705a82d-6dba-4a61-a11f-03d6474c4a3d tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:41.680394 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4705a82d-6dba-4a61-a11f-03d6474c4a3d tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:41.680394 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4705a82d-6dba-4a61-a11f-03d6474c4a3d tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:41.680394 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4705a82d-6dba-4a61-a11f-03d6474c4a3d tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:41.743525 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4705a82d-6dba-4a61-a11f-03d6474c4a3d tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "POST /compute/v2.1/servers/f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a/action" status: 200 len: 32646 microversion: 2.1 time: 0.084509 Oct 04 19:24:41.744409 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3560/7136] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 19:24:41 2022] POST /compute/v2.1/servers/f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a/action => generated 32646 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:24:41.955103 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f726521e-229e-40fa-bf6a-51ca7f5e7bfb tempest-TestNetworkAdvancedServerOps-443223969 tempest-TestNetworkAdvancedServerOps-443223969-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:24:41.955771 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f726521e-229e-40fa-bf6a-51ca7f5e7bfb tempest-TestNetworkAdvancedServerOps-443223969 tempest-TestNetworkAdvancedServerOps-443223969-project-admin] [instance: f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:24:41.963072 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f726521e-229e-40fa-bf6a-51ca7f5e7bfb tempest-TestNetworkAdvancedServerOps-443223969 tempest-TestNetworkAdvancedServerOps-443223969-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:41.963647 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f726521e-229e-40fa-bf6a-51ca7f5e7bfb tempest-TestNetworkAdvancedServerOps-443223969 tempest-TestNetworkAdvancedServerOps-443223969-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:41.964112 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f726521e-229e-40fa-bf6a-51ca7f5e7bfb tempest-TestNetworkAdvancedServerOps-443223969 tempest-TestNetworkAdvancedServerOps-443223969-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:41.964816 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f726521e-229e-40fa-bf6a-51ca7f5e7bfb tempest-TestNetworkAdvancedServerOps-443223969 tempest-TestNetworkAdvancedServerOps-443223969-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:41.965277 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f726521e-229e-40fa-bf6a-51ca7f5e7bfb tempest-TestNetworkAdvancedServerOps-443223969 tempest-TestNetworkAdvancedServerOps-443223969-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:41.965708 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f726521e-229e-40fa-bf6a-51ca7f5e7bfb tempest-TestNetworkAdvancedServerOps-443223969 tempest-TestNetworkAdvancedServerOps-443223969-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:42.110070 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f726521e-229e-40fa-bf6a-51ca7f5e7bfb tempest-TestNetworkAdvancedServerOps-443223969 tempest-TestNetworkAdvancedServerOps-443223969-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a" status: 200 len: 1834 microversion: 2.1 time: 0.208915 Oct 04 19:24:42.110847 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3577/7137] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:24:41 2022] GET /compute/v2.1/servers/f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a => generated 1834 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:24:42.141099 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-21237c25-22fa-4182-b0f5-e75dadb18233 tempest-TestNetworkAdvancedServerOps-443223969 tempest-TestNetworkAdvancedServerOps-443223969-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:24:42.143750 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-21237c25-22fa-4182-b0f5-e75dadb18233 tempest-TestNetworkAdvancedServerOps-443223969 tempest-TestNetworkAdvancedServerOps-443223969-project-admin] [instance: f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:24:42.151811 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-21237c25-22fa-4182-b0f5-e75dadb18233 tempest-TestNetworkAdvancedServerOps-443223969 tempest-TestNetworkAdvancedServerOps-443223969-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:42.152463 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-21237c25-22fa-4182-b0f5-e75dadb18233 tempest-TestNetworkAdvancedServerOps-443223969 tempest-TestNetworkAdvancedServerOps-443223969-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:42.152920 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-21237c25-22fa-4182-b0f5-e75dadb18233 tempest-TestNetworkAdvancedServerOps-443223969 tempest-TestNetworkAdvancedServerOps-443223969-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:42.153642 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-21237c25-22fa-4182-b0f5-e75dadb18233 tempest-TestNetworkAdvancedServerOps-443223969 tempest-TestNetworkAdvancedServerOps-443223969-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:42.154112 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-21237c25-22fa-4182-b0f5-e75dadb18233 tempest-TestNetworkAdvancedServerOps-443223969 tempest-TestNetworkAdvancedServerOps-443223969-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:42.154552 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-21237c25-22fa-4182-b0f5-e75dadb18233 tempest-TestNetworkAdvancedServerOps-443223969 tempest-TestNetworkAdvancedServerOps-443223969-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:42.236891 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-21237c25-22fa-4182-b0f5-e75dadb18233 tempest-TestNetworkAdvancedServerOps-443223969 tempest-TestNetworkAdvancedServerOps-443223969-project-admin] Lazy-loading 'flavor' on Instance uuid f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:24:42.251442 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-21237c25-22fa-4182-b0f5-e75dadb18233 tempest-TestNetworkAdvancedServerOps-443223969 tempest-TestNetworkAdvancedServerOps-443223969-project-admin] [instance: f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a] Going to try to live migrate instance to another host {{(pid=123002) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 19:24:44.532449 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-21237c25-22fa-4182-b0f5-e75dadb18233 tempest-TestNetworkAdvancedServerOps-443223969 tempest-TestNetworkAdvancedServerOps-443223969-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a/action" status: 202 len: 0 microversion: 2.1 time: 2.395500 Oct 04 19:24:44.533122 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3561/7138] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 19:24:42 2022] POST /compute/v2.1/servers/f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a/action => generated 0 bytes in 2397 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:24:44.541947 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2baaf41b-327e-4141-8ccd-bdb79789f49c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:24:44.542558 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2baaf41b-327e-4141-8ccd-bdb79789f49c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:24:44.550538 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2baaf41b-327e-4141-8ccd-bdb79789f49c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:44.551019 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2baaf41b-327e-4141-8ccd-bdb79789f49c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:44.551451 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2baaf41b-327e-4141-8ccd-bdb79789f49c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:44.552169 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2baaf41b-327e-4141-8ccd-bdb79789f49c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:44.552619 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2baaf41b-327e-4141-8ccd-bdb79789f49c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:44.553039 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2baaf41b-327e-4141-8ccd-bdb79789f49c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:44.692918 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-2baaf41b-327e-4141-8ccd-bdb79789f49c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:24:44.701846 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2baaf41b-327e-4141-8ccd-bdb79789f49c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a" status: 200 len: 1691 microversion: 2.1 time: 0.163523 Oct 04 19:24:44.702438 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3578/7139] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:24:44 2022] GET /compute/v2.1/servers/f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a => generated 1691 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:24:45.727163 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b886126c-e056-4b4c-a18d-7dafea1460d8 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:24:45.727796 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b886126c-e056-4b4c-a18d-7dafea1460d8 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:24:45.736645 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b886126c-e056-4b4c-a18d-7dafea1460d8 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:45.740117 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b886126c-e056-4b4c-a18d-7dafea1460d8 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:45.740117 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b886126c-e056-4b4c-a18d-7dafea1460d8 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:45.740117 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b886126c-e056-4b4c-a18d-7dafea1460d8 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:45.740117 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b886126c-e056-4b4c-a18d-7dafea1460d8 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:45.740117 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b886126c-e056-4b4c-a18d-7dafea1460d8 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:45.927899 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-d3a20a54-8154-4ee3-bcae-51bcf213cd21 req-1b834db1-79b2-4f15-8b67-ee06e3c46208 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a", "name": "network-vif-unplugged", "status": "completed", "tag": "da897552-6c69-4ab4-8e75-37d70149b4d2"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:24:45.928464 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b886126c-e056-4b4c-a18d-7dafea1460d8 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:24:45.936938 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b886126c-e056-4b4c-a18d-7dafea1460d8 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a" status: 200 len: 1691 microversion: 2.1 time: 0.213784 Oct 04 19:24:45.937744 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3562/7140] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:24:45 2022] GET /compute/v2.1/servers/f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a => generated 1691 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:24:45.938645 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-d3a20a54-8154-4ee3-bcae-51bcf213cd21 req-1b834db1-79b2-4f15-8b67-ee06e3c46208 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:45.939136 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-d3a20a54-8154-4ee3-bcae-51bcf213cd21 req-1b834db1-79b2-4f15-8b67-ee06e3c46208 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:45.939573 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-d3a20a54-8154-4ee3-bcae-51bcf213cd21 req-1b834db1-79b2-4f15-8b67-ee06e3c46208 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:45.951524 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-d3a20a54-8154-4ee3-bcae-51bcf213cd21 req-1b834db1-79b2-4f15-8b67-ee06e3c46208 service nova] Creating event network-vif-unplugged:da897552-6c69-4ab4-8e75-37d70149b4d2 for instance f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a on n-h1-850501-14 Oct 04 19:24:45.956510 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-d3a20a54-8154-4ee3-bcae-51bcf213cd21 req-1b834db1-79b2-4f15-8b67-ee06e3c46208 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033054 Oct 04 19:24:45.957183 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3579/7141] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:24:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:24:46.961546 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8c2aefa6-d539-4030-adc9-984d75016f62 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:24:46.962183 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8c2aefa6-d539-4030-adc9-984d75016f62 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:24:46.970805 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8c2aefa6-d539-4030-adc9-984d75016f62 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:46.971307 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8c2aefa6-d539-4030-adc9-984d75016f62 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:46.971759 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8c2aefa6-d539-4030-adc9-984d75016f62 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:46.972503 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8c2aefa6-d539-4030-adc9-984d75016f62 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:46.972974 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8c2aefa6-d539-4030-adc9-984d75016f62 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:46.973415 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8c2aefa6-d539-4030-adc9-984d75016f62 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:47.105676 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8c2aefa6-d539-4030-adc9-984d75016f62 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:24:47.113867 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8c2aefa6-d539-4030-adc9-984d75016f62 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a" status: 200 len: 1691 microversion: 2.1 time: 0.156269 Oct 04 19:24:47.114442 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3563/7142] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:24:46 2022] GET /compute/v2.1/servers/f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a => generated 1691 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:24:47.972772 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-c9acf221-d624-4009-9664-446581b56bea req-fedb228f-980c-4c65-9739-7185b6f2b037 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a", "tag": "da897552-6c69-4ab4-8e75-37d70149b4d2"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:24:47.982877 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-c9acf221-d624-4009-9664-446581b56bea req-fedb228f-980c-4c65-9739-7185b6f2b037 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:47.983344 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-c9acf221-d624-4009-9664-446581b56bea req-fedb228f-980c-4c65-9739-7185b6f2b037 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:47.983771 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-c9acf221-d624-4009-9664-446581b56bea req-fedb228f-980c-4c65-9739-7185b6f2b037 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:47.994432 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-c9acf221-d624-4009-9664-446581b56bea req-fedb228f-980c-4c65-9739-7185b6f2b037 service nova] Creating event network-changed:da897552-6c69-4ab4-8e75-37d70149b4d2 for instance f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a on n-h1-850501-14 Oct 04 19:24:47.999370 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-c9acf221-d624-4009-9664-446581b56bea req-fedb228f-980c-4c65-9739-7185b6f2b037 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031553 Oct 04 19:24:47.999943 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3580/7143] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:24:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:24:48.139571 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-fcec1bf6-9f72-4abb-ab0a-cb203b6535df tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:24:48.140239 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-fcec1bf6-9f72-4abb-ab0a-cb203b6535df tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:24:48.146977 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fcec1bf6-9f72-4abb-ab0a-cb203b6535df tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:48.147487 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fcec1bf6-9f72-4abb-ab0a-cb203b6535df tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:48.147937 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fcec1bf6-9f72-4abb-ab0a-cb203b6535df tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:48.148673 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fcec1bf6-9f72-4abb-ab0a-cb203b6535df tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:48.149146 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fcec1bf6-9f72-4abb-ab0a-cb203b6535df tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:48.149591 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fcec1bf6-9f72-4abb-ab0a-cb203b6535df tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:48.291911 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-fcec1bf6-9f72-4abb-ab0a-cb203b6535df tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:24:48.300316 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-fcec1bf6-9f72-4abb-ab0a-cb203b6535df tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a" status: 200 len: 1691 microversion: 2.1 time: 0.165410 Oct 04 19:24:48.308825 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3564/7144] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:24:48 2022] GET /compute/v2.1/servers/f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a => generated 1691 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:24:49.326214 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3189ce78-4813-4f9c-9cdc-6fcb584f6b8b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:24:49.326954 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3189ce78-4813-4f9c-9cdc-6fcb584f6b8b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:24:49.333445 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3189ce78-4813-4f9c-9cdc-6fcb584f6b8b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:49.333925 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3189ce78-4813-4f9c-9cdc-6fcb584f6b8b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:49.334362 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3189ce78-4813-4f9c-9cdc-6fcb584f6b8b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:49.335050 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3189ce78-4813-4f9c-9cdc-6fcb584f6b8b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:49.335506 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3189ce78-4813-4f9c-9cdc-6fcb584f6b8b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:49.335934 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3189ce78-4813-4f9c-9cdc-6fcb584f6b8b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:49.472634 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3189ce78-4813-4f9c-9cdc-6fcb584f6b8b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:24:49.480522 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3189ce78-4813-4f9c-9cdc-6fcb584f6b8b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a" status: 200 len: 1691 microversion: 2.1 time: 0.159794 Oct 04 19:24:49.482911 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3581/7145] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:24:49 2022] GET /compute/v2.1/servers/f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a => generated 1691 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:24:50.505111 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-47a842ac-19a5-490a-b2da-0f36ebfa256b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:24:50.505740 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-47a842ac-19a5-490a-b2da-0f36ebfa256b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:24:50.512835 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-47a842ac-19a5-490a-b2da-0f36ebfa256b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:50.513559 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-47a842ac-19a5-490a-b2da-0f36ebfa256b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:50.514028 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-47a842ac-19a5-490a-b2da-0f36ebfa256b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:50.514732 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-47a842ac-19a5-490a-b2da-0f36ebfa256b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:50.515204 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-47a842ac-19a5-490a-b2da-0f36ebfa256b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:50.515644 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-47a842ac-19a5-490a-b2da-0f36ebfa256b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:50.653290 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-47a842ac-19a5-490a-b2da-0f36ebfa256b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:24:50.661264 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-47a842ac-19a5-490a-b2da-0f36ebfa256b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a" status: 200 len: 1691 microversion: 2.1 time: 0.160071 Oct 04 19:24:50.661850 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3565/7146] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:24:50 2022] GET /compute/v2.1/servers/f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a => generated 1691 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:24:51.685458 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7fca091f-0b86-4cdd-80b2-4268d2a75c05 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:24:51.686075 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7fca091f-0b86-4cdd-80b2-4268d2a75c05 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:24:51.692990 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7fca091f-0b86-4cdd-80b2-4268d2a75c05 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:51.693468 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7fca091f-0b86-4cdd-80b2-4268d2a75c05 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:51.693897 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7fca091f-0b86-4cdd-80b2-4268d2a75c05 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:51.694580 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7fca091f-0b86-4cdd-80b2-4268d2a75c05 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:51.695028 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7fca091f-0b86-4cdd-80b2-4268d2a75c05 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:51.695446 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7fca091f-0b86-4cdd-80b2-4268d2a75c05 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:51.827943 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7fca091f-0b86-4cdd-80b2-4268d2a75c05 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:24:51.835624 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7fca091f-0b86-4cdd-80b2-4268d2a75c05 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a" status: 200 len: 1691 microversion: 2.1 time: 0.154756 Oct 04 19:24:51.836204 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3582/7147] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:24:51 2022] GET /compute/v2.1/servers/f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a => generated 1691 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:24:52.859814 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-86d140b0-b8ea-4be4-b4ef-2c0678a2e6d0 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:24:52.860473 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-86d140b0-b8ea-4be4-b4ef-2c0678a2e6d0 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:24:52.867420 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-86d140b0-b8ea-4be4-b4ef-2c0678a2e6d0 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:52.867918 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-86d140b0-b8ea-4be4-b4ef-2c0678a2e6d0 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:52.868404 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-86d140b0-b8ea-4be4-b4ef-2c0678a2e6d0 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:52.869100 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-86d140b0-b8ea-4be4-b4ef-2c0678a2e6d0 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:52.869567 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-86d140b0-b8ea-4be4-b4ef-2c0678a2e6d0 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:52.870006 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-86d140b0-b8ea-4be4-b4ef-2c0678a2e6d0 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:53.005581 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-86d140b0-b8ea-4be4-b4ef-2c0678a2e6d0 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:24:53.014076 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-86d140b0-b8ea-4be4-b4ef-2c0678a2e6d0 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a" status: 200 len: 1691 microversion: 2.1 time: 0.158427 Oct 04 19:24:53.014644 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3566/7148] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:24:52 2022] GET /compute/v2.1/servers/f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a => generated 1691 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:24:54.037566 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e4b2cfe8-3e3f-41cb-b4c3-66b88304ded7 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:24:54.038220 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e4b2cfe8-3e3f-41cb-b4c3-66b88304ded7 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:24:54.045738 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e4b2cfe8-3e3f-41cb-b4c3-66b88304ded7 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:54.046226 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e4b2cfe8-3e3f-41cb-b4c3-66b88304ded7 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:54.046688 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e4b2cfe8-3e3f-41cb-b4c3-66b88304ded7 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:54.047366 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e4b2cfe8-3e3f-41cb-b4c3-66b88304ded7 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:54.047857 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e4b2cfe8-3e3f-41cb-b4c3-66b88304ded7 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:54.048602 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e4b2cfe8-3e3f-41cb-b4c3-66b88304ded7 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:54.202179 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e4b2cfe8-3e3f-41cb-b4c3-66b88304ded7 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:24:54.209972 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e4b2cfe8-3e3f-41cb-b4c3-66b88304ded7 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a" status: 200 len: 1691 microversion: 2.1 time: 0.176411 Oct 04 19:24:54.210599 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3583/7149] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:24:54 2022] GET /compute/v2.1/servers/f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a => generated 1691 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:24:55.233954 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-daf05e48-cfb7-4004-b98f-da08511c87b7 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:24:55.234594 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-daf05e48-cfb7-4004-b98f-da08511c87b7 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:24:55.241804 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-daf05e48-cfb7-4004-b98f-da08511c87b7 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:55.242303 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-daf05e48-cfb7-4004-b98f-da08511c87b7 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:55.242993 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-daf05e48-cfb7-4004-b98f-da08511c87b7 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:55.243725 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-daf05e48-cfb7-4004-b98f-da08511c87b7 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:55.244232 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-daf05e48-cfb7-4004-b98f-da08511c87b7 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:55.244680 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-daf05e48-cfb7-4004-b98f-da08511c87b7 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:55.387283 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-daf05e48-cfb7-4004-b98f-da08511c87b7 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:24:55.397304 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-daf05e48-cfb7-4004-b98f-da08511c87b7 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a" status: 200 len: 1691 microversion: 2.1 time: 0.167535 Oct 04 19:24:55.397875 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3567/7150] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:24:55 2022] GET /compute/v2.1/servers/f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a => generated 1691 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:24:56.421781 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-98153c44-14cf-4c29-b42b-cddcea8d688d tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:24:56.422638 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-98153c44-14cf-4c29-b42b-cddcea8d688d tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:24:56.429258 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-98153c44-14cf-4c29-b42b-cddcea8d688d tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:56.429752 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-98153c44-14cf-4c29-b42b-cddcea8d688d tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:56.430213 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-98153c44-14cf-4c29-b42b-cddcea8d688d tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:56.430907 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-98153c44-14cf-4c29-b42b-cddcea8d688d tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:56.431463 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-98153c44-14cf-4c29-b42b-cddcea8d688d tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:56.431946 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-98153c44-14cf-4c29-b42b-cddcea8d688d tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:56.587509 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-98153c44-14cf-4c29-b42b-cddcea8d688d tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:24:56.596824 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-98153c44-14cf-4c29-b42b-cddcea8d688d tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a" status: 200 len: 1691 microversion: 2.1 time: 0.179259 Oct 04 19:24:56.599045 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3584/7151] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:24:56 2022] GET /compute/v2.1/servers/f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a => generated 1691 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:24:57.422448 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-e55a5534-a1b2-4f5f-91ff-b89ec64ab33c req-ee01fe55-d17b-4ae6-b7ec-711e29fef6e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a", "name": "network-vif-plugged", "status": "completed", "tag": "da897552-6c69-4ab4-8e75-37d70149b4d2"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:24:57.432027 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-e55a5534-a1b2-4f5f-91ff-b89ec64ab33c req-ee01fe55-d17b-4ae6-b7ec-711e29fef6e2 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:57.432610 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-e55a5534-a1b2-4f5f-91ff-b89ec64ab33c req-ee01fe55-d17b-4ae6-b7ec-711e29fef6e2 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:57.433055 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-e55a5534-a1b2-4f5f-91ff-b89ec64ab33c req-ee01fe55-d17b-4ae6-b7ec-711e29fef6e2 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:57.445133 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-e55a5534-a1b2-4f5f-91ff-b89ec64ab33c req-ee01fe55-d17b-4ae6-b7ec-711e29fef6e2 service nova] Creating event network-vif-plugged:da897552-6c69-4ab4-8e75-37d70149b4d2 for instance f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a on n-h2-850501-14 Oct 04 19:24:57.450190 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-e55a5534-a1b2-4f5f-91ff-b89ec64ab33c req-ee01fe55-d17b-4ae6-b7ec-711e29fef6e2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092387 Oct 04 19:24:57.450951 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3568/7152] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:24:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:24:57.623688 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4b9d6f4e-e8c6-426f-8bcb-f839d30b3c6d tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:24:57.624478 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-4b9d6f4e-e8c6-426f-8bcb-f839d30b3c6d tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:24:57.631553 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4b9d6f4e-e8c6-426f-8bcb-f839d30b3c6d tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:57.632044 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4b9d6f4e-e8c6-426f-8bcb-f839d30b3c6d tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:57.632520 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4b9d6f4e-e8c6-426f-8bcb-f839d30b3c6d tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:57.633222 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4b9d6f4e-e8c6-426f-8bcb-f839d30b3c6d tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:57.633689 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4b9d6f4e-e8c6-426f-8bcb-f839d30b3c6d tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:57.634122 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4b9d6f4e-e8c6-426f-8bcb-f839d30b3c6d tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:57.773247 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-4b9d6f4e-e8c6-426f-8bcb-f839d30b3c6d tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:24:57.781775 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-4b9d6f4e-e8c6-426f-8bcb-f839d30b3c6d tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a" status: 200 len: 1681 microversion: 2.1 time: 0.162874 Oct 04 19:24:57.782348 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3585/7153] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:24:57 2022] GET /compute/v2.1/servers/f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:24:57.806023 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e9b6b102-cbc2-4419-88d8-14fafa37ed02 tempest-TestNetworkAdvancedServerOps-443223969 tempest-TestNetworkAdvancedServerOps-443223969-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:24:57.806725 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e9b6b102-cbc2-4419-88d8-14fafa37ed02 tempest-TestNetworkAdvancedServerOps-443223969 tempest-TestNetworkAdvancedServerOps-443223969-project-admin] [instance: f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:24:57.813588 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e9b6b102-cbc2-4419-88d8-14fafa37ed02 tempest-TestNetworkAdvancedServerOps-443223969 tempest-TestNetworkAdvancedServerOps-443223969-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:57.814091 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e9b6b102-cbc2-4419-88d8-14fafa37ed02 tempest-TestNetworkAdvancedServerOps-443223969 tempest-TestNetworkAdvancedServerOps-443223969-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:57.814543 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e9b6b102-cbc2-4419-88d8-14fafa37ed02 tempest-TestNetworkAdvancedServerOps-443223969 tempest-TestNetworkAdvancedServerOps-443223969-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:57.815248 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e9b6b102-cbc2-4419-88d8-14fafa37ed02 tempest-TestNetworkAdvancedServerOps-443223969 tempest-TestNetworkAdvancedServerOps-443223969-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:57.815714 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e9b6b102-cbc2-4419-88d8-14fafa37ed02 tempest-TestNetworkAdvancedServerOps-443223969 tempest-TestNetworkAdvancedServerOps-443223969-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:57.816179 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e9b6b102-cbc2-4419-88d8-14fafa37ed02 tempest-TestNetworkAdvancedServerOps-443223969 tempest-TestNetworkAdvancedServerOps-443223969-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:57.949584 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e9b6b102-cbc2-4419-88d8-14fafa37ed02 tempest-TestNetworkAdvancedServerOps-443223969 tempest-TestNetworkAdvancedServerOps-443223969-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a" status: 200 len: 1834 microversion: 2.1 time: 0.147616 Oct 04 19:24:57.950172 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3569/7154] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:24:57 2022] GET /compute/v2.1/servers/f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a => generated 1834 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:24:57.974060 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-cb9195a3-1c23-456d-a128-126a1f01ad5e tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:24:57.974682 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-cb9195a3-1c23-456d-a128-126a1f01ad5e tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:24:57.980703 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cb9195a3-1c23-456d-a128-126a1f01ad5e tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:57.981201 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cb9195a3-1c23-456d-a128-126a1f01ad5e tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:57.981640 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cb9195a3-1c23-456d-a128-126a1f01ad5e tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:57.982393 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cb9195a3-1c23-456d-a128-126a1f01ad5e tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:57.982910 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cb9195a3-1c23-456d-a128-126a1f01ad5e tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:57.983265 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cb9195a3-1c23-456d-a128-126a1f01ad5e tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:58.116101 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-cb9195a3-1c23-456d-a128-126a1f01ad5e tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:24:58.124499 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-cb9195a3-1c23-456d-a128-126a1f01ad5e tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a" status: 200 len: 1681 microversion: 2.1 time: 0.154270 Oct 04 19:24:58.125272 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3586/7155] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:24:57 2022] GET /compute/v2.1/servers/f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:24:58.222835 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-551d27b8-e7bf-4c79-9e28-8da7c154494b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:24:58.225226 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-551d27b8-e7bf-4c79-9e28-8da7c154494b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:24:58.231334 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-551d27b8-e7bf-4c79-9e28-8da7c154494b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:58.231835 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-551d27b8-e7bf-4c79-9e28-8da7c154494b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:58.232470 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-551d27b8-e7bf-4c79-9e28-8da7c154494b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:58.233210 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-551d27b8-e7bf-4c79-9e28-8da7c154494b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:58.233688 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-551d27b8-e7bf-4c79-9e28-8da7c154494b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:58.234136 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-551d27b8-e7bf-4c79-9e28-8da7c154494b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:58.295613 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-551d27b8-e7bf-4c79-9e28-8da7c154494b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "POST /compute/v2.1/servers/f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a/action" status: 200 len: 38623 microversion: 2.1 time: 0.076418 Oct 04 19:24:58.296301 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3570/7156] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 19:24:58 2022] POST /compute/v2.1/servers/f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a/action => generated 38623 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 19:24:59.347985 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0b05d900-a917-4feb-9c4e-9a0b08dd1ac8 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:24:59.348590 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0b05d900-a917-4feb-9c4e-9a0b08dd1ac8 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:24:59.360107 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0b05d900-a917-4feb-9c4e-9a0b08dd1ac8 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:59.360860 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0b05d900-a917-4feb-9c4e-9a0b08dd1ac8 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:59.361305 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0b05d900-a917-4feb-9c4e-9a0b08dd1ac8 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:59.362026 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0b05d900-a917-4feb-9c4e-9a0b08dd1ac8 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:59.362490 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0b05d900-a917-4feb-9c4e-9a0b08dd1ac8 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:59.362924 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0b05d900-a917-4feb-9c4e-9a0b08dd1ac8 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:59.391989 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0b05d900-a917-4feb-9c4e-9a0b08dd1ac8 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:24:59.415639 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-2303a731-7b93-4964-af9d-dbd5c685803e req-2226e480-3aa0-42fd-8e94-9cc65ac3a810 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a", "tag": "da897552-6c69-4ab4-8e75-37d70149b4d2"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:24:59.428094 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-2303a731-7b93-4964-af9d-dbd5c685803e req-2226e480-3aa0-42fd-8e94-9cc65ac3a810 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:59.428700 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-2303a731-7b93-4964-af9d-dbd5c685803e req-2226e480-3aa0-42fd-8e94-9cc65ac3a810 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:59.429221 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-2303a731-7b93-4964-af9d-dbd5c685803e req-2226e480-3aa0-42fd-8e94-9cc65ac3a810 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:59.441123 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-2303a731-7b93-4964-af9d-dbd5c685803e req-2226e480-3aa0-42fd-8e94-9cc65ac3a810 service nova] Creating event network-changed:da897552-6c69-4ab4-8e75-37d70149b4d2 for instance f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a on n-h2-850501-14 Oct 04 19:24:59.446515 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-2303a731-7b93-4964-af9d-dbd5c685803e req-2226e480-3aa0-42fd-8e94-9cc65ac3a810 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103588 Oct 04 19:24:59.447191 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3571/7157] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:24:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:24:59.684205 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0b05d900-a917-4feb-9c4e-9a0b08dd1ac8 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a" status: 204 len: 0 microversion: 2.1 time: 0.344145 Oct 04 19:24:59.685128 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3587/7158] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 19:24:59 2022] DELETE /compute/v2.1/servers/f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:24:59.695449 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-30f2f966-f6d9-4fbe-82e6-51d79ef2a40c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:24:59.696202 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-30f2f966-f6d9-4fbe-82e6-51d79ef2a40c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:24:59.703088 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-30f2f966-f6d9-4fbe-82e6-51d79ef2a40c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:59.703699 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-30f2f966-f6d9-4fbe-82e6-51d79ef2a40c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:59.704197 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-30f2f966-f6d9-4fbe-82e6-51d79ef2a40c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:59.704926 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-30f2f966-f6d9-4fbe-82e6-51d79ef2a40c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:59.705400 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-30f2f966-f6d9-4fbe-82e6-51d79ef2a40c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:59.705846 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-30f2f966-f6d9-4fbe-82e6-51d79ef2a40c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:59.848820 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-30f2f966-f6d9-4fbe-82e6-51d79ef2a40c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:24:59.857020 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-30f2f966-f6d9-4fbe-82e6-51d79ef2a40c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a" status: 200 len: 1687 microversion: 2.1 time: 0.166488 Oct 04 19:24:59.858274 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3572/7159] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:24:59 2022] GET /compute/v2.1/servers/f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a => generated 1687 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:25:00.883498 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e6fbee2d-de60-461e-b265-34e453204979 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:25:00.884285 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e6fbee2d-de60-461e-b265-34e453204979 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:25:00.892039 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e6fbee2d-de60-461e-b265-34e453204979 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:00.892571 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e6fbee2d-de60-461e-b265-34e453204979 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:00.893010 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e6fbee2d-de60-461e-b265-34e453204979 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:00.893768 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e6fbee2d-de60-461e-b265-34e453204979 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:00.894166 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e6fbee2d-de60-461e-b265-34e453204979 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:00.894591 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e6fbee2d-de60-461e-b265-34e453204979 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:01.034319 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e6fbee2d-de60-461e-b265-34e453204979 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:25:01.051750 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e6fbee2d-de60-461e-b265-34e453204979 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a" status: 200 len: 1569 microversion: 2.1 time: 0.172619 Oct 04 19:25:01.052609 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3588/7160] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:25:00 2022] GET /compute/v2.1/servers/f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a => generated 1569 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:25:01.096085 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-8a8ead1b-8031-46bf-a44f-14ae0d723cc1 req-2e93fcc1-28e0-4128-a1b3-5ae4018a60fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a", "name": "network-vif-deleted", "tag": "da897552-6c69-4ab4-8e75-37d70149b4d2"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:25:01.106522 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-8a8ead1b-8031-46bf-a44f-14ae0d723cc1 req-2e93fcc1-28e0-4128-a1b3-5ae4018a60fe service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:01.107019 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-8a8ead1b-8031-46bf-a44f-14ae0d723cc1 req-2e93fcc1-28e0-4128-a1b3-5ae4018a60fe service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:01.108090 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-8a8ead1b-8031-46bf-a44f-14ae0d723cc1 req-2e93fcc1-28e0-4128-a1b3-5ae4018a60fe service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:01.119548 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-8a8ead1b-8031-46bf-a44f-14ae0d723cc1 req-2e93fcc1-28e0-4128-a1b3-5ae4018a60fe service nova] Creating event network-vif-deleted:da897552-6c69-4ab4-8e75-37d70149b4d2 for instance f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a on n-h2-850501-14 Oct 04 19:25:01.124646 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-8a8ead1b-8031-46bf-a44f-14ae0d723cc1 req-2e93fcc1-28e0-4128-a1b3-5ae4018a60fe service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033296 Oct 04 19:25:01.125248 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3573/7161] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:25:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:25:02.076429 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-06eb849c-4f8f-4725-b5f5-908adb84b7f9 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:25:02.077507 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-06eb849c-4f8f-4725-b5f5-908adb84b7f9 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:25:02.086805 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-06eb849c-4f8f-4725-b5f5-908adb84b7f9 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:02.087302 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-06eb849c-4f8f-4725-b5f5-908adb84b7f9 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:02.087745 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-06eb849c-4f8f-4725-b5f5-908adb84b7f9 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:02.088481 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-06eb849c-4f8f-4725-b5f5-908adb84b7f9 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:02.088946 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-06eb849c-4f8f-4725-b5f5-908adb84b7f9 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:02.089377 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-06eb849c-4f8f-4725-b5f5-908adb84b7f9 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:02.108102 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-06eb849c-4f8f-4725-b5f5-908adb84b7f9 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] HTTP exception thrown: Instance f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a could not be found. Oct 04 19:25:02.109863 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-06eb849c-4f8f-4725-b5f5-908adb84b7f9 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Request method failure captured: Oct 04 19:25:02.109863 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a HTTP/1.1 Oct 04 19:25:02.109863 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 19:25:02.109863 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 19:25:02.109863 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 19:25:02.109863 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 19:25:02.109863 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 19:25:02.109863 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 19:25:02.109863 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 19:25:02.109863 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 19:25:02.109863 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPIcrTIoZmU9MC83P2pr9ihdde_O34kT-H-5oj2NnEUHxZ7u6d0iVUulFYuyLpCenTbNTzDECz-ja0Upgm5x505nJ4VYUuS8arG8yRvvAazBWadpmzk8tZWcFQnwqYgCdSmdZmyUlhN1rUbAZJtGPYmlMzSSC1eYEi1Aha5rPMaRu8oI Oct 04 19:25:02.109863 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 19:25:02.109863 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 19:25:02.109863 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 19:25:02.109863 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 19:25:02.109863 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 19:25:02.109863 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 19:25:02.109863 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 81e34eff3bda4651aece03d213439a2b Oct 04 19:25:02.109863 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1051949435 Oct 04 19:25:02.109863 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 19:25:02.109863 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 19:25:02.109863 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/81e34eff3bda4651aece03d213439a2b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_81e34eff3bda4651aece03d213439a2b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/81e34eff3bda4651aece03d213439a2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/81e34eff3bda4651aece03d213439a2b"}]}] Oct 04 19:25:02.109863 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1051949435 Oct 04 19:25:02.109863 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 81e34eff3bda4651aece03d213439a2b Oct 04 19:25:02.109863 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1051949435 Oct 04 19:25:02.109863 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-TestNetworkAdvancedServerOps-1051949435-project Oct 04 19:25:02.109863 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 19:25:02.109863 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 19:25:02.109863 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: e66faeb21cd44d9e927e436096f49e26 Oct 04 19:25:02.109863 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1051949435-project Oct 04 19:25:02.109863 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 19:25:02.109863 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a could not be found. Oct 04 19:25:02.109863 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': 'f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a'} Oct 04 19:25:02.109863 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:25:02.109863 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:25:02.109863 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:25:02.109863 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:25:02.109863 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:25:02.109863 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:25:02.109863 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:25:02.109863 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:25:02.109863 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:25:02.109863 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:25:02.109863 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a could not be found. Oct 04 19:25:02.109863 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:25:02.109863 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:25:02.109863 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:25:02.109863 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:25:02.109863 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:25:02.109863 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:25:02.109863 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:25:02.109863 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:25:02.109863 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:25:02.109863 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:25:02.109863 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:25:02.109863 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:25:02.109863 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:25:02.109863 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:25:02.109863 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:25:02.109863 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:25:02.109863 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a could not be found. Oct 04 19:25:02.109863 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:25:02.109863 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:25:02.113951 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:25:02.113951 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:25:02.113951 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:25:02.113951 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:25:02.113951 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:25:02.113951 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:25:02.113951 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a could not be found. Oct 04 19:25:02.113951 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:25:02.113951 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-06eb849c-4f8f-4725-b5f5-908adb84b7f9 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Returning 404 to user: Instance f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:25:02.113951 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-06eb849c-4f8f-4725-b5f5-908adb84b7f9 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a" status: 404 len: 111 microversion: 2.1 time: 0.038916 Oct 04 19:25:02.113951 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3589/7162] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:25:02 2022] GET /compute/v2.1/servers/f40cb3e7-1808-4ee0-b034-8dfc9aeeb30a => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:25:05.974031 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f2672ca8-ee09-4069-9fb7-3d3660da5dd8 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '.version_select at 0x7fe259599940>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:25:06.041668 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f2672ca8-ee09-4069-9fb7-3d3660da5dd8 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-501138083" status: 202 len: 0 microversion: 2.1 time: 0.072809 Oct 04 19:25:06.042207 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3574/7163] 10.222.0.20 () {58 vars in 1281 bytes} [Tue Oct 4 19:25:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-501138083 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:25:06.073031 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e5a81848-2e83-4336-b576-510cfc31591f tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Action: 'create', calling method: .version_select at 0x7fe253abd670>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-999910672", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAPQq7NJ0yYXlWHAglF7D5xG6/70AXxvXusW54cgolMZHyw5dgb80c9s7RSssFuqP+aDQzlhgauaENyshV71pdk4RY1AxSC0NH7y+uMPUTJIH/Ilnjq83HNjOAsE3O33mw=="}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:25:06.090209 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-e5a81848-2e83-4336-b576-510cfc31591f tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Getting quotas for project 81e34eff3bda4651aece03d213439a2b. Resources: {'key_pairs'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:25:06.101904 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-e5a81848-2e83-4336-b576-510cfc31591f tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Getting quotas for user e66faeb21cd44d9e927e436096f49e26 and project 81e34eff3bda4651aece03d213439a2b. Resources: {'key_pairs'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:25:06.184304 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e5a81848-2e83-4336-b576-510cfc31591f tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.115360 Oct 04 19:25:06.184918 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3590/7164] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Oct 4 19:25:06 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:25:14.862909 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:25:14.868488 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-85bc8647-b018-4aea-a33b-d2faf054b70d tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-220316550", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": [{"uuid": "5b536d11-a92f-4eef-a25b-7d0890a29e80"}], "key_name": "tempest-TestNetworkAdvancedServerOps-999910672", "security_groups": [{"name": "tempest-secgroup-smoke-251520982"}]}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:25:14.882449 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=34,nova_api:DELETE=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:25:15.003902 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-85bc8647-b018-4aea-a33b-d2faf054b70d tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] validate_networks() for [('5b536d11-a92f-4eef-a25b-7d0890a29e80', None, None, None, None, None)] {{(pid=123002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:25:15.807214 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-85bc8647-b018-4aea-a33b-d2faf054b70d tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:25:15.807654 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-85bc8647-b018-4aea-a33b-d2faf054b70d tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:25:15.808178 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-85bc8647-b018-4aea-a33b-d2faf054b70d tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:25:15.808595 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-85bc8647-b018-4aea-a33b-d2faf054b70d tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:25:15.809072 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-85bc8647-b018-4aea-a33b-d2faf054b70d tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:25:15.818820 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-85bc8647-b018-4aea-a33b-d2faf054b70d tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:15.819389 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-85bc8647-b018-4aea-a33b-d2faf054b70d tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:15.822798 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-85bc8647-b018-4aea-a33b-d2faf054b70d tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:15.822798 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-85bc8647-b018-4aea-a33b-d2faf054b70d tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:15.822798 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-85bc8647-b018-4aea-a33b-d2faf054b70d tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:15.822798 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-85bc8647-b018-4aea-a33b-d2faf054b70d tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:15.846903 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-85bc8647-b018-4aea-a33b-d2faf054b70d tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Getting quotas for project 81e34eff3bda4651aece03d213439a2b. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:25:15.857601 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-85bc8647-b018-4aea-a33b-d2faf054b70d tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Getting quotas for user e66faeb21cd44d9e927e436096f49e26 and project 81e34eff3bda4651aece03d213439a2b. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:25:15.878834 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-85bc8647-b018-4aea-a33b-d2faf054b70d tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Going to run 1 instances... {{(pid=123002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:25:15.881354 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-85bc8647-b018-4aea-a33b-d2faf054b70d tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: 8b781a40-7d51-415d-8ea4-6de848202ee6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:25:16.049484 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-85bc8647-b018-4aea-a33b-d2faf054b70d tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.188184 Oct 04 19:25:16.050152 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3575/7165] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 19:25:14 2022] POST /compute/v2.1/servers => generated 405 bytes in 1190 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:25:16.059573 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:25:16.065880 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c659bc65-aa4d-4005-88f5-790aa27bfb1b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:25:16.066507 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c659bc65-aa4d-4005-88f5-790aa27bfb1b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: 8b781a40-7d51-415d-8ea4-6de848202ee6] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:25:16.068415 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:25:16.115326 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=4 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:25:16.144627 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c659bc65-aa4d-4005-88f5-790aa27bfb1b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:25:16.157497 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c659bc65-aa4d-4005-88f5-790aa27bfb1b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/8b781a40-7d51-415d-8ea4-6de848202ee6" status: 200 len: 1265 microversion: 2.1 time: 0.099501 Oct 04 19:25:16.158099 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3591/7166] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:25:16 2022] GET /compute/v2.1/servers/8b781a40-7d51-415d-8ea4-6de848202ee6 => generated 1265 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:25:17.180798 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7c755da1-737f-4cc2-b1d8-da3f297a105d tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:25:17.182040 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7c755da1-737f-4cc2-b1d8-da3f297a105d tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: 8b781a40-7d51-415d-8ea4-6de848202ee6] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:25:17.190313 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c755da1-737f-4cc2-b1d8-da3f297a105d tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:17.190851 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c755da1-737f-4cc2-b1d8-da3f297a105d tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:17.193264 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c755da1-737f-4cc2-b1d8-da3f297a105d tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:17.193264 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c755da1-737f-4cc2-b1d8-da3f297a105d tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:17.193264 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c755da1-737f-4cc2-b1d8-da3f297a105d tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:17.193264 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c755da1-737f-4cc2-b1d8-da3f297a105d tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:17.263734 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7c755da1-737f-4cc2-b1d8-da3f297a105d tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:25:17.272645 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7c755da1-737f-4cc2-b1d8-da3f297a105d tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/8b781a40-7d51-415d-8ea4-6de848202ee6" status: 200 len: 1269 microversion: 2.1 time: 0.095826 Oct 04 19:25:17.273229 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3576/7167] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:25:17 2022] GET /compute/v2.1/servers/8b781a40-7d51-415d-8ea4-6de848202ee6 => generated 1269 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:25:18.297752 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a64c39a6-52d8-493d-b3d4-8d9dad9f8c98 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:25:18.299201 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a64c39a6-52d8-493d-b3d4-8d9dad9f8c98 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: 8b781a40-7d51-415d-8ea4-6de848202ee6] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:25:18.321476 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a64c39a6-52d8-493d-b3d4-8d9dad9f8c98 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:18.324814 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a64c39a6-52d8-493d-b3d4-8d9dad9f8c98 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:18.325461 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a64c39a6-52d8-493d-b3d4-8d9dad9f8c98 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:18.327416 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a64c39a6-52d8-493d-b3d4-8d9dad9f8c98 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:18.329332 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a64c39a6-52d8-493d-b3d4-8d9dad9f8c98 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:18.330817 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a64c39a6-52d8-493d-b3d4-8d9dad9f8c98 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:18.411137 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a64c39a6-52d8-493d-b3d4-8d9dad9f8c98 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:25:18.419309 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a64c39a6-52d8-493d-b3d4-8d9dad9f8c98 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/8b781a40-7d51-415d-8ea4-6de848202ee6" status: 200 len: 1325 microversion: 2.1 time: 0.126576 Oct 04 19:25:18.420039 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3592/7168] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:25:18 2022] GET /compute/v2.1/servers/8b781a40-7d51-415d-8ea4-6de848202ee6 => generated 1325 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:25:19.444483 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-923b9bc5-4ef5-4647-8d2b-7f9fb0b56208 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:25:19.450524 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-923b9bc5-4ef5-4647-8d2b-7f9fb0b56208 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: 8b781a40-7d51-415d-8ea4-6de848202ee6] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:25:19.459780 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-923b9bc5-4ef5-4647-8d2b-7f9fb0b56208 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:19.460602 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-923b9bc5-4ef5-4647-8d2b-7f9fb0b56208 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:19.460920 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-923b9bc5-4ef5-4647-8d2b-7f9fb0b56208 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:19.461880 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-923b9bc5-4ef5-4647-8d2b-7f9fb0b56208 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:19.462429 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-923b9bc5-4ef5-4647-8d2b-7f9fb0b56208 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:19.462947 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-923b9bc5-4ef5-4647-8d2b-7f9fb0b56208 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:19.606236 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-923b9bc5-4ef5-4647-8d2b-7f9fb0b56208 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:25:19.615182 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-923b9bc5-4ef5-4647-8d2b-7f9fb0b56208 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/8b781a40-7d51-415d-8ea4-6de848202ee6" status: 200 len: 1390 microversion: 2.1 time: 0.174589 Oct 04 19:25:19.621098 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3577/7169] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:25:19 2022] GET /compute/v2.1/servers/8b781a40-7d51-415d-8ea4-6de848202ee6 => generated 1390 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:25:20.114810 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-7685146d-8e26-46af-aecd-38193db8e016 req-475b9099-f704-49b7-b1d5-ebfb84c2e694 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b781a40-7d51-415d-8ea4-6de848202ee6", "tag": "d98a37e3-f614-41c5-9e13-dbe9227b349e"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:25:20.127971 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-7685146d-8e26-46af-aecd-38193db8e016 req-475b9099-f704-49b7-b1d5-ebfb84c2e694 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:20.128519 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-7685146d-8e26-46af-aecd-38193db8e016 req-475b9099-f704-49b7-b1d5-ebfb84c2e694 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:20.128954 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-7685146d-8e26-46af-aecd-38193db8e016 req-475b9099-f704-49b7-b1d5-ebfb84c2e694 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:20.140619 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-7685146d-8e26-46af-aecd-38193db8e016 req-475b9099-f704-49b7-b1d5-ebfb84c2e694 service nova] Creating event network-changed:d98a37e3-f614-41c5-9e13-dbe9227b349e for instance 8b781a40-7d51-415d-8ea4-6de848202ee6 on n-h1-850501-14 Oct 04 19:25:20.151945 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-7685146d-8e26-46af-aecd-38193db8e016 req-475b9099-f704-49b7-b1d5-ebfb84c2e694 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041102 Oct 04 19:25:20.152596 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3593/7170] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:25:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:25:20.638923 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-361e8d35-08f3-4b5b-9ffc-49ca4ffb32d5 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:25:20.639619 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-361e8d35-08f3-4b5b-9ffc-49ca4ffb32d5 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: 8b781a40-7d51-415d-8ea4-6de848202ee6] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:25:20.646957 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-361e8d35-08f3-4b5b-9ffc-49ca4ffb32d5 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:20.647472 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-361e8d35-08f3-4b5b-9ffc-49ca4ffb32d5 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:20.647934 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-361e8d35-08f3-4b5b-9ffc-49ca4ffb32d5 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:20.648688 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-361e8d35-08f3-4b5b-9ffc-49ca4ffb32d5 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:20.649165 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-361e8d35-08f3-4b5b-9ffc-49ca4ffb32d5 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:20.649618 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-361e8d35-08f3-4b5b-9ffc-49ca4ffb32d5 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:20.793163 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-361e8d35-08f3-4b5b-9ffc-49ca4ffb32d5 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:25:20.802688 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-361e8d35-08f3-4b5b-9ffc-49ca4ffb32d5 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/8b781a40-7d51-415d-8ea4-6de848202ee6" status: 200 len: 1390 microversion: 2.1 time: 0.167669 Oct 04 19:25:20.803291 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3578/7171] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:25:20 2022] GET /compute/v2.1/servers/8b781a40-7d51-415d-8ea4-6de848202ee6 => generated 1390 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:25:21.826621 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e3e1f2c8-f753-4a51-b47a-7363e18218ef tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:25:21.827887 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e3e1f2c8-f753-4a51-b47a-7363e18218ef tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: 8b781a40-7d51-415d-8ea4-6de848202ee6] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:25:21.834515 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e3e1f2c8-f753-4a51-b47a-7363e18218ef tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:21.834993 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e3e1f2c8-f753-4a51-b47a-7363e18218ef tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:21.835493 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e3e1f2c8-f753-4a51-b47a-7363e18218ef tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:21.836225 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e3e1f2c8-f753-4a51-b47a-7363e18218ef tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:21.836688 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e3e1f2c8-f753-4a51-b47a-7363e18218ef tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:21.837122 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e3e1f2c8-f753-4a51-b47a-7363e18218ef tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:21.975393 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e3e1f2c8-f753-4a51-b47a-7363e18218ef tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:25:21.983157 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e3e1f2c8-f753-4a51-b47a-7363e18218ef tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/8b781a40-7d51-415d-8ea4-6de848202ee6" status: 200 len: 1390 microversion: 2.1 time: 0.161664 Oct 04 19:25:21.983773 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3594/7172] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:25:21 2022] GET /compute/v2.1/servers/8b781a40-7d51-415d-8ea4-6de848202ee6 => generated 1390 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:25:23.005860 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-80e031c5-2a63-444f-9d3f-042f23a5206b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:25:23.006514 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-80e031c5-2a63-444f-9d3f-042f23a5206b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: 8b781a40-7d51-415d-8ea4-6de848202ee6] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:25:23.013557 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-80e031c5-2a63-444f-9d3f-042f23a5206b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:23.014062 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-80e031c5-2a63-444f-9d3f-042f23a5206b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:23.014524 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-80e031c5-2a63-444f-9d3f-042f23a5206b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:23.015239 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-80e031c5-2a63-444f-9d3f-042f23a5206b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:23.015710 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-80e031c5-2a63-444f-9d3f-042f23a5206b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:23.016265 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-80e031c5-2a63-444f-9d3f-042f23a5206b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:23.160798 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-80e031c5-2a63-444f-9d3f-042f23a5206b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:25:23.168516 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-80e031c5-2a63-444f-9d3f-042f23a5206b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/8b781a40-7d51-415d-8ea4-6de848202ee6" status: 200 len: 1390 microversion: 2.1 time: 0.166543 Oct 04 19:25:23.169161 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3579/7173] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:25:23 2022] GET /compute/v2.1/servers/8b781a40-7d51-415d-8ea4-6de848202ee6 => generated 1390 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:25:24.192466 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c85317bc-4ecd-4daf-9908-d9a47d1aabfa tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:25:24.193207 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c85317bc-4ecd-4daf-9908-d9a47d1aabfa tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: 8b781a40-7d51-415d-8ea4-6de848202ee6] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:25:24.200342 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c85317bc-4ecd-4daf-9908-d9a47d1aabfa tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:24.200833 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c85317bc-4ecd-4daf-9908-d9a47d1aabfa tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:24.201272 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c85317bc-4ecd-4daf-9908-d9a47d1aabfa tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:24.201999 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c85317bc-4ecd-4daf-9908-d9a47d1aabfa tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:24.202622 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c85317bc-4ecd-4daf-9908-d9a47d1aabfa tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:24.203260 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c85317bc-4ecd-4daf-9908-d9a47d1aabfa tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:24.351576 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c85317bc-4ecd-4daf-9908-d9a47d1aabfa tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:25:24.359491 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c85317bc-4ecd-4daf-9908-d9a47d1aabfa tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/8b781a40-7d51-415d-8ea4-6de848202ee6" status: 200 len: 1390 microversion: 2.1 time: 0.171016 Oct 04 19:25:24.360216 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3595/7174] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:25:24 2022] GET /compute/v2.1/servers/8b781a40-7d51-415d-8ea4-6de848202ee6 => generated 1390 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:25:25.382899 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4ca32665-ff82-4c99-9c94-672a2f956275 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:25:25.383541 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4ca32665-ff82-4c99-9c94-672a2f956275 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: 8b781a40-7d51-415d-8ea4-6de848202ee6] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:25:25.390582 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4ca32665-ff82-4c99-9c94-672a2f956275 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:25.391086 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4ca32665-ff82-4c99-9c94-672a2f956275 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:25.391544 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4ca32665-ff82-4c99-9c94-672a2f956275 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:25.392293 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4ca32665-ff82-4c99-9c94-672a2f956275 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:25.392773 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4ca32665-ff82-4c99-9c94-672a2f956275 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:25.393221 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4ca32665-ff82-4c99-9c94-672a2f956275 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:25.533500 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4ca32665-ff82-4c99-9c94-672a2f956275 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:25:25.541526 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4ca32665-ff82-4c99-9c94-672a2f956275 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/8b781a40-7d51-415d-8ea4-6de848202ee6" status: 200 len: 1390 microversion: 2.1 time: 0.162528 Oct 04 19:25:25.542117 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3580/7175] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:25:25 2022] GET /compute/v2.1/servers/8b781a40-7d51-415d-8ea4-6de848202ee6 => generated 1390 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:25:26.355901 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-80a84688-0cf6-481e-88d3-fcc67bc1a829 req-211c7ce2-8a66-44a7-a1cb-13495a2066f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b781a40-7d51-415d-8ea4-6de848202ee6", "name": "network-vif-plugged", "status": "completed", "tag": "d98a37e3-f614-41c5-9e13-dbe9227b349e"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:25:26.368194 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-80a84688-0cf6-481e-88d3-fcc67bc1a829 req-211c7ce2-8a66-44a7-a1cb-13495a2066f8 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:26.368842 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-80a84688-0cf6-481e-88d3-fcc67bc1a829 req-211c7ce2-8a66-44a7-a1cb-13495a2066f8 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:26.369667 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-80a84688-0cf6-481e-88d3-fcc67bc1a829 req-211c7ce2-8a66-44a7-a1cb-13495a2066f8 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:26.384414 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-80a84688-0cf6-481e-88d3-fcc67bc1a829 req-211c7ce2-8a66-44a7-a1cb-13495a2066f8 service nova] Creating event network-vif-plugged:d98a37e3-f614-41c5-9e13-dbe9227b349e for instance 8b781a40-7d51-415d-8ea4-6de848202ee6 on n-h1-850501-14 Oct 04 19:25:26.390644 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-80a84688-0cf6-481e-88d3-fcc67bc1a829 req-211c7ce2-8a66-44a7-a1cb-13495a2066f8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039194 Oct 04 19:25:26.391260 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3596/7176] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:25:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:25:26.565631 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-953162b4-a998-4706-b8b4-17098f79099a tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:25:26.566269 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-953162b4-a998-4706-b8b4-17098f79099a tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: 8b781a40-7d51-415d-8ea4-6de848202ee6] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:25:26.568183 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:25:26.568887 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=6 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:25:26.574825 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-953162b4-a998-4706-b8b4-17098f79099a tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:26.575329 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-953162b4-a998-4706-b8b4-17098f79099a tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:26.575788 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-953162b4-a998-4706-b8b4-17098f79099a tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:26.576550 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-953162b4-a998-4706-b8b4-17098f79099a tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:26.577720 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-953162b4-a998-4706-b8b4-17098f79099a tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:26.578170 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-953162b4-a998-4706-b8b4-17098f79099a tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:26.726627 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-953162b4-a998-4706-b8b4-17098f79099a tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:25:26.734769 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-953162b4-a998-4706-b8b4-17098f79099a tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/8b781a40-7d51-415d-8ea4-6de848202ee6" status: 200 len: 1390 microversion: 2.1 time: 0.173654 Oct 04 19:25:26.735346 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3581/7177] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:25:26 2022] GET /compute/v2.1/servers/8b781a40-7d51-415d-8ea4-6de848202ee6 => generated 1390 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:25:27.760823 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4fdb9921-bc69-4f8b-a721-52ebd8647377 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:25:27.761575 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-4fdb9921-bc69-4f8b-a721-52ebd8647377 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: 8b781a40-7d51-415d-8ea4-6de848202ee6] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:25:27.769379 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4fdb9921-bc69-4f8b-a721-52ebd8647377 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:27.769894 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4fdb9921-bc69-4f8b-a721-52ebd8647377 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:27.770289 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4fdb9921-bc69-4f8b-a721-52ebd8647377 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:27.770981 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4fdb9921-bc69-4f8b-a721-52ebd8647377 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:27.771435 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4fdb9921-bc69-4f8b-a721-52ebd8647377 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:27.771895 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4fdb9921-bc69-4f8b-a721-52ebd8647377 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:27.923050 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-4fdb9921-bc69-4f8b-a721-52ebd8647377 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:25:27.931009 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-4fdb9921-bc69-4f8b-a721-52ebd8647377 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/8b781a40-7d51-415d-8ea4-6de848202ee6" status: 200 len: 1561 microversion: 2.1 time: 0.175557 Oct 04 19:25:27.931705 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3597/7178] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:25:27 2022] GET /compute/v2.1/servers/8b781a40-7d51-415d-8ea4-6de848202ee6 => generated 1561 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:25:27.953876 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ac68f87a-12f2-44dc-b510-59c76d5bece6 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:25:27.955255 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ac68f87a-12f2-44dc-b510-59c76d5bece6 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: 8b781a40-7d51-415d-8ea4-6de848202ee6] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:25:27.962939 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ac68f87a-12f2-44dc-b510-59c76d5bece6 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:27.962939 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ac68f87a-12f2-44dc-b510-59c76d5bece6 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:27.963246 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ac68f87a-12f2-44dc-b510-59c76d5bece6 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:27.963881 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ac68f87a-12f2-44dc-b510-59c76d5bece6 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:27.964377 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ac68f87a-12f2-44dc-b510-59c76d5bece6 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:27.964821 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ac68f87a-12f2-44dc-b510-59c76d5bece6 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:28.106036 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ac68f87a-12f2-44dc-b510-59c76d5bece6 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:25:28.118297 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ac68f87a-12f2-44dc-b510-59c76d5bece6 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/8b781a40-7d51-415d-8ea4-6de848202ee6" status: 200 len: 1561 microversion: 2.1 time: 0.168165 Oct 04 19:25:28.119411 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3582/7179] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:25:27 2022] GET /compute/v2.1/servers/8b781a40-7d51-415d-8ea4-6de848202ee6 => generated 1561 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:25:30.028985 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-f88487ce-e0b2-4916-a55b-582d6fca5e51 req-cd342108-e074-4584-ba7d-e95741c0f140 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b781a40-7d51-415d-8ea4-6de848202ee6", "tag": "d98a37e3-f614-41c5-9e13-dbe9227b349e"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:25:30.036192 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-68e1175b-c245-4f3c-b66a-6d3c324e4a6a tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:25:30.036824 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-68e1175b-c245-4f3c-b66a-6d3c324e4a6a tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: 8b781a40-7d51-415d-8ea4-6de848202ee6] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:25:30.039888 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:25:30.044270 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-68e1175b-c245-4f3c-b66a-6d3c324e4a6a tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:30.044766 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-68e1175b-c245-4f3c-b66a-6d3c324e4a6a tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:30.045203 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-68e1175b-c245-4f3c-b66a-6d3c324e4a6a tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:30.045905 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-68e1175b-c245-4f3c-b66a-6d3c324e4a6a tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:30.046362 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-68e1175b-c245-4f3c-b66a-6d3c324e4a6a tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:30.046807 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-68e1175b-c245-4f3c-b66a-6d3c324e4a6a tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:30.054654 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-f88487ce-e0b2-4916-a55b-582d6fca5e51 req-cd342108-e074-4584-ba7d-e95741c0f140 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:30.055375 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-f88487ce-e0b2-4916-a55b-582d6fca5e51 req-cd342108-e074-4584-ba7d-e95741c0f140 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:30.055895 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-f88487ce-e0b2-4916-a55b-582d6fca5e51 req-cd342108-e074-4584-ba7d-e95741c0f140 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:30.068718 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-f88487ce-e0b2-4916-a55b-582d6fca5e51 req-cd342108-e074-4584-ba7d-e95741c0f140 service nova] Creating event network-changed:d98a37e3-f614-41c5-9e13-dbe9227b349e for instance 8b781a40-7d51-415d-8ea4-6de848202ee6 on n-h1-850501-14 Oct 04 19:25:30.075225 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-f88487ce-e0b2-4916-a55b-582d6fca5e51 req-cd342108-e074-4584-ba7d-e95741c0f140 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049356 Oct 04 19:25:30.076046 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3583/7180] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:25:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:25:30.205652 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-68e1175b-c245-4f3c-b66a-6d3c324e4a6a tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:25:30.213929 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-68e1175b-c245-4f3c-b66a-6d3c324e4a6a tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/8b781a40-7d51-415d-8ea4-6de848202ee6" status: 200 len: 1561 microversion: 2.1 time: 0.192513 Oct 04 19:25:30.214473 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3598/7181] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:25:30 2022] GET /compute/v2.1/servers/8b781a40-7d51-415d-8ea4-6de848202ee6 => generated 1561 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:25:51.498655 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-85ea780c-55cf-44d1-802f-eb93b320acfc tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:25:51.500972 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-85ea780c-55cf-44d1-802f-eb93b320acfc tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: 8b781a40-7d51-415d-8ea4-6de848202ee6] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:25:51.503178 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:25:51.503866 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=46 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:25:51.509696 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-85ea780c-55cf-44d1-802f-eb93b320acfc tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:51.510200 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-85ea780c-55cf-44d1-802f-eb93b320acfc tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:51.510659 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-85ea780c-55cf-44d1-802f-eb93b320acfc tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:51.511374 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-85ea780c-55cf-44d1-802f-eb93b320acfc tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:51.511893 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-85ea780c-55cf-44d1-802f-eb93b320acfc tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:51.512378 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-85ea780c-55cf-44d1-802f-eb93b320acfc tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:51.565218 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-85ea780c-55cf-44d1-802f-eb93b320acfc tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "POST /compute/v2.1/servers/8b781a40-7d51-415d-8ea4-6de848202ee6/action" status: 200 len: 24565 microversion: 2.1 time: 0.071174 Oct 04 19:25:51.565876 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3584/7182] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 19:25:51 2022] POST /compute/v2.1/servers/8b781a40-7d51-415d-8ea4-6de848202ee6/action => generated 24565 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:26:02.602297 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9379e385-cb2d-4029-9647-8eeb044659ef tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:26:02.605045 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-9379e385-cb2d-4029-9647-8eeb044659ef tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: 8b781a40-7d51-415d-8ea4-6de848202ee6] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:26:02.607882 n-d-850501-14 devstack@n-api.service[123001]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:26:02.608121 n-d-850501-14 devstack@n-api.service[123001]: Tue Oct 4 19:26:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8b781a40-7d51-415d-8ea4-6de848202ee6/action (ip 10.222.0.20) !!! Oct 04 19:26:02.609060 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=17 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:26:02.609781 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=34 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:26:02.615952 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9379e385-cb2d-4029-9647-8eeb044659ef tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:02.616456 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9379e385-cb2d-4029-9647-8eeb044659ef tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:02.616892 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9379e385-cb2d-4029-9647-8eeb044659ef tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:02.620120 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9379e385-cb2d-4029-9647-8eeb044659ef tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:02.620120 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9379e385-cb2d-4029-9647-8eeb044659ef tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:02.620120 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9379e385-cb2d-4029-9647-8eeb044659ef tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:02.868071 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-9379e385-cb2d-4029-9647-8eeb044659ef tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:26:02.868507 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-9379e385-cb2d-4029-9647-8eeb044659ef tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:26:02.868985 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-9379e385-cb2d-4029-9647-8eeb044659ef tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:26:02.869396 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-9379e385-cb2d-4029-9647-8eeb044659ef tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:26:02.869811 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-9379e385-cb2d-4029-9647-8eeb044659ef tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:26:03.075857 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-9379e385-cb2d-4029-9647-8eeb044659ef tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: 8b781a40-7d51-415d-8ea4-6de848202ee6] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:26:03.081814 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9379e385-cb2d-4029-9647-8eeb044659ef tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:03.082305 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9379e385-cb2d-4029-9647-8eeb044659ef tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:03.082746 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9379e385-cb2d-4029-9647-8eeb044659ef tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:03.083446 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9379e385-cb2d-4029-9647-8eeb044659ef tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:03.083905 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9379e385-cb2d-4029-9647-8eeb044659ef tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:03.084360 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9379e385-cb2d-4029-9647-8eeb044659ef tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:03.111317 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9379e385-cb2d-4029-9647-8eeb044659ef tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "POST /compute/v2.1/servers/8b781a40-7d51-415d-8ea4-6de848202ee6/action" status: 202 len: 1136 microversion: 2.1 time: 0.513021 Oct 04 19:26:03.111956 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3599/7183] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 19:26:02 2022] POST /compute/v2.1/servers/8b781a40-7d51-415d-8ea4-6de848202ee6/action => generated 1136 bytes in 514 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Oct 04 19:26:03.134208 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2b0b92c0-6500-4e9a-a4b4-4a0017249c7f tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:26:03.134910 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2b0b92c0-6500-4e9a-a4b4-4a0017249c7f tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: 8b781a40-7d51-415d-8ea4-6de848202ee6] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:26:03.138287 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=4 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:26:03.143639 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2b0b92c0-6500-4e9a-a4b4-4a0017249c7f tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:03.144169 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2b0b92c0-6500-4e9a-a4b4-4a0017249c7f tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:03.144623 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2b0b92c0-6500-4e9a-a4b4-4a0017249c7f tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:03.145387 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2b0b92c0-6500-4e9a-a4b4-4a0017249c7f tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:03.145856 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2b0b92c0-6500-4e9a-a4b4-4a0017249c7f tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:03.146297 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2b0b92c0-6500-4e9a-a4b4-4a0017249c7f tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:03.412517 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2b0b92c0-6500-4e9a-a4b4-4a0017249c7f tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:26:03.420885 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2b0b92c0-6500-4e9a-a4b4-4a0017249c7f tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/8b781a40-7d51-415d-8ea4-6de848202ee6" status: 200 len: 1689 microversion: 2.1 time: 0.291605 Oct 04 19:26:03.421455 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3585/7184] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:26:03 2022] GET /compute/v2.1/servers/8b781a40-7d51-415d-8ea4-6de848202ee6 => generated 1689 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:26:04.444977 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-312f5900-4260-42d0-a96c-111b0e2c8978 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:26:04.445595 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-312f5900-4260-42d0-a96c-111b0e2c8978 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: 8b781a40-7d51-415d-8ea4-6de848202ee6] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:26:04.453164 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-312f5900-4260-42d0-a96c-111b0e2c8978 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:04.453644 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-312f5900-4260-42d0-a96c-111b0e2c8978 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:04.454108 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-312f5900-4260-42d0-a96c-111b0e2c8978 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:04.454798 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-312f5900-4260-42d0-a96c-111b0e2c8978 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:04.455250 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-312f5900-4260-42d0-a96c-111b0e2c8978 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:04.455670 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-312f5900-4260-42d0-a96c-111b0e2c8978 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:04.592800 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-312f5900-4260-42d0-a96c-111b0e2c8978 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:26:04.600506 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-312f5900-4260-42d0-a96c-111b0e2c8978 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/8b781a40-7d51-415d-8ea4-6de848202ee6" status: 200 len: 1689 microversion: 2.1 time: 0.159506 Oct 04 19:26:04.601080 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3600/7185] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:26:04 2022] GET /compute/v2.1/servers/8b781a40-7d51-415d-8ea4-6de848202ee6 => generated 1689 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:26:05.624983 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9f280e00-43f3-43cd-b17e-669b2fed552f tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:26:05.625609 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9f280e00-43f3-43cd-b17e-669b2fed552f tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: 8b781a40-7d51-415d-8ea4-6de848202ee6] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:26:05.636094 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9f280e00-43f3-43cd-b17e-669b2fed552f tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:05.636595 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9f280e00-43f3-43cd-b17e-669b2fed552f tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:05.637045 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9f280e00-43f3-43cd-b17e-669b2fed552f tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:05.637747 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9f280e00-43f3-43cd-b17e-669b2fed552f tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:05.638324 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9f280e00-43f3-43cd-b17e-669b2fed552f tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:05.638751 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9f280e00-43f3-43cd-b17e-669b2fed552f tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:05.770976 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9f280e00-43f3-43cd-b17e-669b2fed552f tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:26:05.779850 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9f280e00-43f3-43cd-b17e-669b2fed552f tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/8b781a40-7d51-415d-8ea4-6de848202ee6" status: 200 len: 1689 microversion: 2.1 time: 0.158831 Oct 04 19:26:05.780471 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3586/7186] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:26:05 2022] GET /compute/v2.1/servers/8b781a40-7d51-415d-8ea4-6de848202ee6 => generated 1689 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:26:06.804027 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-bf32feb7-647c-459e-b344-6568ac178684 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:26:06.804664 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-bf32feb7-647c-459e-b344-6568ac178684 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: 8b781a40-7d51-415d-8ea4-6de848202ee6] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:26:06.811689 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bf32feb7-647c-459e-b344-6568ac178684 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:06.812211 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bf32feb7-647c-459e-b344-6568ac178684 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:06.812655 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bf32feb7-647c-459e-b344-6568ac178684 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:06.813342 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bf32feb7-647c-459e-b344-6568ac178684 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:06.813808 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bf32feb7-647c-459e-b344-6568ac178684 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:06.814234 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bf32feb7-647c-459e-b344-6568ac178684 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:06.945291 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-bf32feb7-647c-459e-b344-6568ac178684 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:26:06.954255 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-bf32feb7-647c-459e-b344-6568ac178684 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/8b781a40-7d51-415d-8ea4-6de848202ee6" status: 200 len: 1689 microversion: 2.1 time: 0.154032 Oct 04 19:26:06.954838 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3601/7187] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:26:06 2022] GET /compute/v2.1/servers/8b781a40-7d51-415d-8ea4-6de848202ee6 => generated 1689 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:26:07.979342 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-798b2ba2-496d-4564-8102-51ece2c7ce0b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:26:07.979922 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-798b2ba2-496d-4564-8102-51ece2c7ce0b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: 8b781a40-7d51-415d-8ea4-6de848202ee6] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:26:07.986867 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-798b2ba2-496d-4564-8102-51ece2c7ce0b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:07.987371 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-798b2ba2-496d-4564-8102-51ece2c7ce0b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:07.987831 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-798b2ba2-496d-4564-8102-51ece2c7ce0b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:07.988587 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-798b2ba2-496d-4564-8102-51ece2c7ce0b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:07.989065 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-798b2ba2-496d-4564-8102-51ece2c7ce0b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:07.989511 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-798b2ba2-496d-4564-8102-51ece2c7ce0b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:08.125982 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-798b2ba2-496d-4564-8102-51ece2c7ce0b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:26:08.133666 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-798b2ba2-496d-4564-8102-51ece2c7ce0b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/8b781a40-7d51-415d-8ea4-6de848202ee6" status: 200 len: 1689 microversion: 2.1 time: 0.158938 Oct 04 19:26:08.134754 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3587/7188] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:26:07 2022] GET /compute/v2.1/servers/8b781a40-7d51-415d-8ea4-6de848202ee6 => generated 1689 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:26:09.158706 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d9f15aac-f30c-4256-9e8b-df2df3ad8dba tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:26:09.159327 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d9f15aac-f30c-4256-9e8b-df2df3ad8dba tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: 8b781a40-7d51-415d-8ea4-6de848202ee6] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:26:09.166036 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d9f15aac-f30c-4256-9e8b-df2df3ad8dba tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:09.166533 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d9f15aac-f30c-4256-9e8b-df2df3ad8dba tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:09.166973 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d9f15aac-f30c-4256-9e8b-df2df3ad8dba tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:09.167668 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d9f15aac-f30c-4256-9e8b-df2df3ad8dba tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:09.168159 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d9f15aac-f30c-4256-9e8b-df2df3ad8dba tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:09.168596 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d9f15aac-f30c-4256-9e8b-df2df3ad8dba tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:09.310373 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d9f15aac-f30c-4256-9e8b-df2df3ad8dba tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:26:09.318132 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d9f15aac-f30c-4256-9e8b-df2df3ad8dba tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/8b781a40-7d51-415d-8ea4-6de848202ee6" status: 200 len: 1689 microversion: 2.1 time: 0.163635 Oct 04 19:26:09.318703 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3602/7189] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:26:09 2022] GET /compute/v2.1/servers/8b781a40-7d51-415d-8ea4-6de848202ee6 => generated 1689 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:26:10.345074 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-56ac2891-843d-4849-bce6-4a826ee99513 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:26:10.345631 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-56ac2891-843d-4849-bce6-4a826ee99513 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: 8b781a40-7d51-415d-8ea4-6de848202ee6] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:26:10.352072 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-56ac2891-843d-4849-bce6-4a826ee99513 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:10.353190 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-56ac2891-843d-4849-bce6-4a826ee99513 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:10.353638 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-56ac2891-843d-4849-bce6-4a826ee99513 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:10.354340 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-56ac2891-843d-4849-bce6-4a826ee99513 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:10.354805 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-56ac2891-843d-4849-bce6-4a826ee99513 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:10.355240 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-56ac2891-843d-4849-bce6-4a826ee99513 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:10.492085 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-56ac2891-843d-4849-bce6-4a826ee99513 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:26:10.500131 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-56ac2891-843d-4849-bce6-4a826ee99513 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/8b781a40-7d51-415d-8ea4-6de848202ee6" status: 200 len: 1689 microversion: 2.1 time: 0.159435 Oct 04 19:26:10.500731 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3588/7190] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:26:10 2022] GET /compute/v2.1/servers/8b781a40-7d51-415d-8ea4-6de848202ee6 => generated 1689 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:26:11.527572 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-13ce84f7-0e07-48a6-9d21-c5a09174dd04 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:26:11.528218 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-13ce84f7-0e07-48a6-9d21-c5a09174dd04 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: 8b781a40-7d51-415d-8ea4-6de848202ee6] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:26:11.535143 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-13ce84f7-0e07-48a6-9d21-c5a09174dd04 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:11.535630 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-13ce84f7-0e07-48a6-9d21-c5a09174dd04 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:11.536096 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-13ce84f7-0e07-48a6-9d21-c5a09174dd04 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:11.536795 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-13ce84f7-0e07-48a6-9d21-c5a09174dd04 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:11.537255 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-13ce84f7-0e07-48a6-9d21-c5a09174dd04 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:11.537685 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-13ce84f7-0e07-48a6-9d21-c5a09174dd04 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:11.677908 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-13ce84f7-0e07-48a6-9d21-c5a09174dd04 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:26:11.686233 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-13ce84f7-0e07-48a6-9d21-c5a09174dd04 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/8b781a40-7d51-415d-8ea4-6de848202ee6" status: 200 len: 1689 microversion: 2.1 time: 0.163406 Oct 04 19:26:11.686815 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3603/7191] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:26:11 2022] GET /compute/v2.1/servers/8b781a40-7d51-415d-8ea4-6de848202ee6 => generated 1689 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:26:12.710682 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-911e204e-c4fb-457e-a17a-224a6084a79e tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:26:12.711328 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-911e204e-c4fb-457e-a17a-224a6084a79e tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: 8b781a40-7d51-415d-8ea4-6de848202ee6] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:26:12.719332 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-911e204e-c4fb-457e-a17a-224a6084a79e tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:12.719916 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-911e204e-c4fb-457e-a17a-224a6084a79e tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:12.720402 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-911e204e-c4fb-457e-a17a-224a6084a79e tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:12.721129 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-911e204e-c4fb-457e-a17a-224a6084a79e tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:12.721603 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-911e204e-c4fb-457e-a17a-224a6084a79e tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:12.722213 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-911e204e-c4fb-457e-a17a-224a6084a79e tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:12.858862 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-911e204e-c4fb-457e-a17a-224a6084a79e tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:26:12.866633 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-911e204e-c4fb-457e-a17a-224a6084a79e tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/8b781a40-7d51-415d-8ea4-6de848202ee6" status: 200 len: 1689 microversion: 2.1 time: 0.160016 Oct 04 19:26:12.867212 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3589/7192] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:26:12 2022] GET /compute/v2.1/servers/8b781a40-7d51-415d-8ea4-6de848202ee6 => generated 1689 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:26:13.889030 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4fbd1e17-d395-424b-ac59-a843acc4a562 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:26:13.889640 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-4fbd1e17-d395-424b-ac59-a843acc4a562 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: 8b781a40-7d51-415d-8ea4-6de848202ee6] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:26:13.896623 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4fbd1e17-d395-424b-ac59-a843acc4a562 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:13.897098 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4fbd1e17-d395-424b-ac59-a843acc4a562 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:13.897526 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4fbd1e17-d395-424b-ac59-a843acc4a562 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:13.898240 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4fbd1e17-d395-424b-ac59-a843acc4a562 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:13.898691 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4fbd1e17-d395-424b-ac59-a843acc4a562 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:13.899112 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4fbd1e17-d395-424b-ac59-a843acc4a562 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:14.039767 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-4fbd1e17-d395-424b-ac59-a843acc4a562 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:26:14.048591 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-4fbd1e17-d395-424b-ac59-a843acc4a562 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/8b781a40-7d51-415d-8ea4-6de848202ee6" status: 200 len: 1689 microversion: 2.1 time: 0.163474 Oct 04 19:26:14.049183 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3604/7193] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:26:13 2022] GET /compute/v2.1/servers/8b781a40-7d51-415d-8ea4-6de848202ee6 => generated 1689 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:26:15.072932 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e848e9cb-9ff4-420a-b81a-9f299c7ef1d6 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:26:15.073577 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e848e9cb-9ff4-420a-b81a-9f299c7ef1d6 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: 8b781a40-7d51-415d-8ea4-6de848202ee6] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:26:15.080619 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e848e9cb-9ff4-420a-b81a-9f299c7ef1d6 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:15.081129 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e848e9cb-9ff4-420a-b81a-9f299c7ef1d6 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:15.081591 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e848e9cb-9ff4-420a-b81a-9f299c7ef1d6 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:15.082305 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e848e9cb-9ff4-420a-b81a-9f299c7ef1d6 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:15.082782 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e848e9cb-9ff4-420a-b81a-9f299c7ef1d6 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:15.083233 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e848e9cb-9ff4-420a-b81a-9f299c7ef1d6 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:15.217297 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e848e9cb-9ff4-420a-b81a-9f299c7ef1d6 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:26:15.225249 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e848e9cb-9ff4-420a-b81a-9f299c7ef1d6 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/8b781a40-7d51-415d-8ea4-6de848202ee6" status: 200 len: 1689 microversion: 2.1 time: 0.157014 Oct 04 19:26:15.225862 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3590/7194] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:26:15 2022] GET /compute/v2.1/servers/8b781a40-7d51-415d-8ea4-6de848202ee6 => generated 1689 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:26:16.250616 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6275ff47-4563-4e8f-b8ea-59905b519e4f tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:26:16.251232 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6275ff47-4563-4e8f-b8ea-59905b519e4f tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: 8b781a40-7d51-415d-8ea4-6de848202ee6] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:26:16.258926 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6275ff47-4563-4e8f-b8ea-59905b519e4f tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:16.261452 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6275ff47-4563-4e8f-b8ea-59905b519e4f tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:16.262284 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6275ff47-4563-4e8f-b8ea-59905b519e4f tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:16.263094 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6275ff47-4563-4e8f-b8ea-59905b519e4f tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:16.263564 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6275ff47-4563-4e8f-b8ea-59905b519e4f tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:16.264010 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6275ff47-4563-4e8f-b8ea-59905b519e4f tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:16.413565 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6275ff47-4563-4e8f-b8ea-59905b519e4f tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:26:16.421616 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6275ff47-4563-4e8f-b8ea-59905b519e4f tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/8b781a40-7d51-415d-8ea4-6de848202ee6" status: 200 len: 1689 microversion: 2.1 time: 0.174933 Oct 04 19:26:16.422201 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3605/7195] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:26:16 2022] GET /compute/v2.1/servers/8b781a40-7d51-415d-8ea4-6de848202ee6 => generated 1689 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:26:17.446974 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1dd5823d-fdaf-42ac-9784-76872f2417ea tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:26:17.447658 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1dd5823d-fdaf-42ac-9784-76872f2417ea tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: 8b781a40-7d51-415d-8ea4-6de848202ee6] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:26:17.454711 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1dd5823d-fdaf-42ac-9784-76872f2417ea tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:17.455217 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1dd5823d-fdaf-42ac-9784-76872f2417ea tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:17.455684 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1dd5823d-fdaf-42ac-9784-76872f2417ea tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:17.456424 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1dd5823d-fdaf-42ac-9784-76872f2417ea tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:17.456897 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1dd5823d-fdaf-42ac-9784-76872f2417ea tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:17.457345 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1dd5823d-fdaf-42ac-9784-76872f2417ea tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:17.595277 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1dd5823d-fdaf-42ac-9784-76872f2417ea tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:26:17.605462 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1dd5823d-fdaf-42ac-9784-76872f2417ea tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/8b781a40-7d51-415d-8ea4-6de848202ee6" status: 200 len: 1689 microversion: 2.1 time: 0.162530 Oct 04 19:26:17.606057 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3591/7196] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:26:17 2022] GET /compute/v2.1/servers/8b781a40-7d51-415d-8ea4-6de848202ee6 => generated 1689 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:26:18.630648 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0da9d0f1-567b-409a-9a88-373fef6f805c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:26:18.631542 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0da9d0f1-567b-409a-9a88-373fef6f805c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: 8b781a40-7d51-415d-8ea4-6de848202ee6] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:26:18.642614 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0da9d0f1-567b-409a-9a88-373fef6f805c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:18.643406 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0da9d0f1-567b-409a-9a88-373fef6f805c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:18.644119 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0da9d0f1-567b-409a-9a88-373fef6f805c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:18.644967 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0da9d0f1-567b-409a-9a88-373fef6f805c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:18.645533 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0da9d0f1-567b-409a-9a88-373fef6f805c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:18.646065 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0da9d0f1-567b-409a-9a88-373fef6f805c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:18.838973 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0da9d0f1-567b-409a-9a88-373fef6f805c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:26:18.849691 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0da9d0f1-567b-409a-9a88-373fef6f805c tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/8b781a40-7d51-415d-8ea4-6de848202ee6" status: 200 len: 1689 microversion: 2.1 time: 0.223954 Oct 04 19:26:18.850320 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3606/7197] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:26:18 2022] GET /compute/v2.1/servers/8b781a40-7d51-415d-8ea4-6de848202ee6 => generated 1689 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:26:19.873957 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c9930568-c6ae-49eb-824e-5ba9435de360 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:26:19.874589 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c9930568-c6ae-49eb-824e-5ba9435de360 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: 8b781a40-7d51-415d-8ea4-6de848202ee6] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:26:19.881601 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c9930568-c6ae-49eb-824e-5ba9435de360 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:19.882133 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c9930568-c6ae-49eb-824e-5ba9435de360 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:19.882587 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c9930568-c6ae-49eb-824e-5ba9435de360 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:19.883301 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c9930568-c6ae-49eb-824e-5ba9435de360 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:19.883773 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c9930568-c6ae-49eb-824e-5ba9435de360 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:19.884248 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c9930568-c6ae-49eb-824e-5ba9435de360 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:20.024479 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c9930568-c6ae-49eb-824e-5ba9435de360 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:26:20.032973 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c9930568-c6ae-49eb-824e-5ba9435de360 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/8b781a40-7d51-415d-8ea4-6de848202ee6" status: 200 len: 1689 microversion: 2.1 time: 0.163650 Oct 04 19:26:20.033561 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3592/7198] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:26:19 2022] GET /compute/v2.1/servers/8b781a40-7d51-415d-8ea4-6de848202ee6 => generated 1689 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:26:21.057642 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5578f3d7-42ff-4155-9891-36016a742498 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:26:21.058167 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5578f3d7-42ff-4155-9891-36016a742498 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: 8b781a40-7d51-415d-8ea4-6de848202ee6] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:26:21.065029 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5578f3d7-42ff-4155-9891-36016a742498 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:21.065511 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5578f3d7-42ff-4155-9891-36016a742498 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:21.065947 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5578f3d7-42ff-4155-9891-36016a742498 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:21.066636 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5578f3d7-42ff-4155-9891-36016a742498 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:21.067100 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5578f3d7-42ff-4155-9891-36016a742498 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:21.067527 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5578f3d7-42ff-4155-9891-36016a742498 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:21.200905 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5578f3d7-42ff-4155-9891-36016a742498 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:26:21.208619 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5578f3d7-42ff-4155-9891-36016a742498 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/8b781a40-7d51-415d-8ea4-6de848202ee6" status: 200 len: 1695 microversion: 2.1 time: 0.155171 Oct 04 19:26:21.209217 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3607/7199] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:26:21 2022] GET /compute/v2.1/servers/8b781a40-7d51-415d-8ea4-6de848202ee6 => generated 1695 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:26:22.238909 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6cc831ea-cbeb-472e-8753-e906dd721de2 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:26:22.239542 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-6cc831ea-cbeb-472e-8753-e906dd721de2 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: 8b781a40-7d51-415d-8ea4-6de848202ee6] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:26:22.247406 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6cc831ea-cbeb-472e-8753-e906dd721de2 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:22.247948 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6cc831ea-cbeb-472e-8753-e906dd721de2 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:22.248433 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6cc831ea-cbeb-472e-8753-e906dd721de2 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:22.249140 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6cc831ea-cbeb-472e-8753-e906dd721de2 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:22.249609 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6cc831ea-cbeb-472e-8753-e906dd721de2 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:22.250048 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6cc831ea-cbeb-472e-8753-e906dd721de2 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:22.402676 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-6cc831ea-cbeb-472e-8753-e906dd721de2 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:26:22.410967 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6cc831ea-cbeb-472e-8753-e906dd721de2 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/8b781a40-7d51-415d-8ea4-6de848202ee6" status: 200 len: 1695 microversion: 2.1 time: 0.176075 Oct 04 19:26:22.411551 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3593/7200] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:26:22 2022] GET /compute/v2.1/servers/8b781a40-7d51-415d-8ea4-6de848202ee6 => generated 1695 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:26:23.434443 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-17e84abd-57a2-4f86-910e-8f8a4ff8b870 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:26:23.435107 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-17e84abd-57a2-4f86-910e-8f8a4ff8b870 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: 8b781a40-7d51-415d-8ea4-6de848202ee6] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:26:23.442018 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-17e84abd-57a2-4f86-910e-8f8a4ff8b870 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:23.442499 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-17e84abd-57a2-4f86-910e-8f8a4ff8b870 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:23.442933 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-17e84abd-57a2-4f86-910e-8f8a4ff8b870 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:23.443628 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-17e84abd-57a2-4f86-910e-8f8a4ff8b870 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:23.444099 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-17e84abd-57a2-4f86-910e-8f8a4ff8b870 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:23.444526 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-17e84abd-57a2-4f86-910e-8f8a4ff8b870 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:23.606570 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-17e84abd-57a2-4f86-910e-8f8a4ff8b870 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:26:23.614475 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-17e84abd-57a2-4f86-910e-8f8a4ff8b870 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/8b781a40-7d51-415d-8ea4-6de848202ee6" status: 200 len: 1680 microversion: 2.1 time: 0.184089 Oct 04 19:26:23.615066 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3608/7201] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:26:23 2022] GET /compute/v2.1/servers/8b781a40-7d51-415d-8ea4-6de848202ee6 => generated 1680 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:26:24.754444 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-50433cb4-8305-480d-9d37-c8b5eaf58016 req-e0366e95-e9e0-4cf7-bc54-66265c29b736 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b781a40-7d51-415d-8ea4-6de848202ee6", "name": "network-vif-plugged", "status": "completed", "tag": "d98a37e3-f614-41c5-9e13-dbe9227b349e"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:26:24.768310 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-50433cb4-8305-480d-9d37-c8b5eaf58016 req-e0366e95-e9e0-4cf7-bc54-66265c29b736 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:24.768904 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-50433cb4-8305-480d-9d37-c8b5eaf58016 req-e0366e95-e9e0-4cf7-bc54-66265c29b736 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:24.769418 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-50433cb4-8305-480d-9d37-c8b5eaf58016 req-e0366e95-e9e0-4cf7-bc54-66265c29b736 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:24.786016 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-50433cb4-8305-480d-9d37-c8b5eaf58016 req-e0366e95-e9e0-4cf7-bc54-66265c29b736 service nova] Creating event network-vif-plugged:d98a37e3-f614-41c5-9e13-dbe9227b349e for instance 8b781a40-7d51-415d-8ea4-6de848202ee6 on n-h1-850501-14 Oct 04 19:26:24.792998 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-50433cb4-8305-480d-9d37-c8b5eaf58016 req-e0366e95-e9e0-4cf7-bc54-66265c29b736 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109018 Oct 04 19:26:24.793621 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3594/7202] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:26:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:26:47.827866 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-55e3a70a-1121-45f2-8ea2-ce71de79939b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:26:47.830174 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-55e3a70a-1121-45f2-8ea2-ce71de79939b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: 8b781a40-7d51-415d-8ea4-6de848202ee6] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:26:47.832518 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=24 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:26:47.833318 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:26:47.837877 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-55e3a70a-1121-45f2-8ea2-ce71de79939b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:47.838357 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-55e3a70a-1121-45f2-8ea2-ce71de79939b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:47.838907 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-55e3a70a-1121-45f2-8ea2-ce71de79939b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:47.839588 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-55e3a70a-1121-45f2-8ea2-ce71de79939b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:47.840046 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-55e3a70a-1121-45f2-8ea2-ce71de79939b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:47.840517 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-55e3a70a-1121-45f2-8ea2-ce71de79939b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:47.891152 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-55e3a70a-1121-45f2-8ea2-ce71de79939b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "POST /compute/v2.1/servers/8b781a40-7d51-415d-8ea4-6de848202ee6/action" status: 200 len: 24574 microversion: 2.1 time: 0.066975 Oct 04 19:26:47.891802 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3609/7203] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 19:26:47 2022] POST /compute/v2.1/servers/8b781a40-7d51-415d-8ea4-6de848202ee6/action => generated 24574 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:27:00.152330 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=22 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:27:00.152330 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=56 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:27:00.152330 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-76c3927b-59b8-4218-9dcd-41d187a7cd92 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:27:00.153611 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-76c3927b-59b8-4218-9dcd-41d187a7cd92 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: 8b781a40-7d51-415d-8ea4-6de848202ee6] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:27:00.160380 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-76c3927b-59b8-4218-9dcd-41d187a7cd92 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:00.160886 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-76c3927b-59b8-4218-9dcd-41d187a7cd92 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:00.161339 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-76c3927b-59b8-4218-9dcd-41d187a7cd92 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:00.162052 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-76c3927b-59b8-4218-9dcd-41d187a7cd92 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:00.162517 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-76c3927b-59b8-4218-9dcd-41d187a7cd92 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:00.162952 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-76c3927b-59b8-4218-9dcd-41d187a7cd92 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:00.189735 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-76c3927b-59b8-4218-9dcd-41d187a7cd92 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: 8b781a40-7d51-415d-8ea4-6de848202ee6] Going to try to terminate instance {{(pid=123002) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:27:00.248162 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-aa5825c9-d9ac-4e55-8db3-69f1928c2834 req-15c0954d-a610-4a27-b8f4-c9c61fcf6e65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b781a40-7d51-415d-8ea4-6de848202ee6", "tag": "d98a37e3-f614-41c5-9e13-dbe9227b349e"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:27:00.259081 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-aa5825c9-d9ac-4e55-8db3-69f1928c2834 req-15c0954d-a610-4a27-b8f4-c9c61fcf6e65 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:00.259566 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-aa5825c9-d9ac-4e55-8db3-69f1928c2834 req-15c0954d-a610-4a27-b8f4-c9c61fcf6e65 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:00.260005 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-aa5825c9-d9ac-4e55-8db3-69f1928c2834 req-15c0954d-a610-4a27-b8f4-c9c61fcf6e65 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:00.271199 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-aa5825c9-d9ac-4e55-8db3-69f1928c2834 req-15c0954d-a610-4a27-b8f4-c9c61fcf6e65 service nova] Creating event network-changed:d98a37e3-f614-41c5-9e13-dbe9227b349e for instance 8b781a40-7d51-415d-8ea4-6de848202ee6 on n-h1-850501-14 Oct 04 19:27:00.276500 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-aa5825c9-d9ac-4e55-8db3-69f1928c2834 req-15c0954d-a610-4a27-b8f4-c9c61fcf6e65 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084900 Oct 04 19:27:00.277284 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3610/7204] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:27:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:27:00.525811 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-76c3927b-59b8-4218-9dcd-41d187a7cd92 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8b781a40-7d51-415d-8ea4-6de848202ee6" status: 204 len: 0 microversion: 2.1 time: 0.380289 Oct 04 19:27:00.526717 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3595/7205] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 19:27:00 2022] DELETE /compute/v2.1/servers/8b781a40-7d51-415d-8ea4-6de848202ee6 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:27:00.537306 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2a5f8089-e4be-45c4-a022-61a07668fbb3 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:27:00.538529 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2a5f8089-e4be-45c4-a022-61a07668fbb3 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: 8b781a40-7d51-415d-8ea4-6de848202ee6] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:27:00.546826 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2a5f8089-e4be-45c4-a022-61a07668fbb3 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:00.547315 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2a5f8089-e4be-45c4-a022-61a07668fbb3 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:00.547756 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2a5f8089-e4be-45c4-a022-61a07668fbb3 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:00.549125 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2a5f8089-e4be-45c4-a022-61a07668fbb3 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:00.549614 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2a5f8089-e4be-45c4-a022-61a07668fbb3 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:00.550044 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2a5f8089-e4be-45c4-a022-61a07668fbb3 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:00.702333 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-2a5f8089-e4be-45c4-a022-61a07668fbb3 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:27:00.711226 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2a5f8089-e4be-45c4-a022-61a07668fbb3 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/8b781a40-7d51-415d-8ea4-6de848202ee6" status: 200 len: 1686 microversion: 2.1 time: 0.179177 Oct 04 19:27:00.714475 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3611/7206] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:27:00 2022] GET /compute/v2.1/servers/8b781a40-7d51-415d-8ea4-6de848202ee6 => generated 1686 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:27:01.739518 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-cc40a6c7-14bb-46b1-a26c-3d7732645a9a tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:27:01.740274 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-cc40a6c7-14bb-46b1-a26c-3d7732645a9a tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: 8b781a40-7d51-415d-8ea4-6de848202ee6] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:27:01.748093 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cc40a6c7-14bb-46b1-a26c-3d7732645a9a tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:01.748698 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cc40a6c7-14bb-46b1-a26c-3d7732645a9a tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:01.749167 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cc40a6c7-14bb-46b1-a26c-3d7732645a9a tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:01.749873 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cc40a6c7-14bb-46b1-a26c-3d7732645a9a tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:01.750448 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cc40a6c7-14bb-46b1-a26c-3d7732645a9a tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:01.750781 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cc40a6c7-14bb-46b1-a26c-3d7732645a9a tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:01.932691 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-cc40a6c7-14bb-46b1-a26c-3d7732645a9a tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:27:01.941461 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-cc40a6c7-14bb-46b1-a26c-3d7732645a9a tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/8b781a40-7d51-415d-8ea4-6de848202ee6" status: 200 len: 1686 microversion: 2.1 time: 0.206209 Oct 04 19:27:01.943601 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3596/7207] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:27:01 2022] GET /compute/v2.1/servers/8b781a40-7d51-415d-8ea4-6de848202ee6 => generated 1686 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:27:02.451078 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-0baa7c3e-f07b-45c5-9be1-19f920f3d41c req-7c5fdec1-e450-47d7-9afe-40b48137eecf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b781a40-7d51-415d-8ea4-6de848202ee6", "name": "network-vif-deleted", "tag": "d98a37e3-f614-41c5-9e13-dbe9227b349e"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:27:02.461208 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-0baa7c3e-f07b-45c5-9be1-19f920f3d41c req-7c5fdec1-e450-47d7-9afe-40b48137eecf service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:02.463921 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-0baa7c3e-f07b-45c5-9be1-19f920f3d41c req-7c5fdec1-e450-47d7-9afe-40b48137eecf service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:02.463921 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-0baa7c3e-f07b-45c5-9be1-19f920f3d41c req-7c5fdec1-e450-47d7-9afe-40b48137eecf service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:02.474079 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-0baa7c3e-f07b-45c5-9be1-19f920f3d41c req-7c5fdec1-e450-47d7-9afe-40b48137eecf service nova] Creating event network-vif-deleted:d98a37e3-f614-41c5-9e13-dbe9227b349e for instance 8b781a40-7d51-415d-8ea4-6de848202ee6 on n-h1-850501-14 Oct 04 19:27:02.478976 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-0baa7c3e-f07b-45c5-9be1-19f920f3d41c req-7c5fdec1-e450-47d7-9afe-40b48137eecf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032103 Oct 04 19:27:02.479644 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3612/7208] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:27:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:27:02.965291 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5ecf142c-163a-423c-9ecd-ad6bc3a1b305 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:27:02.965915 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5ecf142c-163a-423c-9ecd-ad6bc3a1b305 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: 8b781a40-7d51-415d-8ea4-6de848202ee6] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:27:02.973116 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5ecf142c-163a-423c-9ecd-ad6bc3a1b305 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:02.973579 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5ecf142c-163a-423c-9ecd-ad6bc3a1b305 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:02.974073 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5ecf142c-163a-423c-9ecd-ad6bc3a1b305 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:02.974780 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5ecf142c-163a-423c-9ecd-ad6bc3a1b305 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:02.975257 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5ecf142c-163a-423c-9ecd-ad6bc3a1b305 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:02.975703 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5ecf142c-163a-423c-9ecd-ad6bc3a1b305 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:03.011127 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5ecf142c-163a-423c-9ecd-ad6bc3a1b305 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:03.011633 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5ecf142c-163a-423c-9ecd-ad6bc3a1b305 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:03.012284 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5ecf142c-163a-423c-9ecd-ad6bc3a1b305 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:03.012757 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-5ecf142c-163a-423c-9ecd-ad6bc3a1b305 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lazy-loading 'fault' on Instance uuid 8b781a40-7d51-415d-8ea4-6de848202ee6 {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:27:03.056474 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5ecf142c-163a-423c-9ecd-ad6bc3a1b305 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66faeb21cd44d9e927e436096f49e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e34eff3bda4651aece03d213439a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:27:03.065128 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5ecf142c-163a-423c-9ecd-ad6bc3a1b305 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/8b781a40-7d51-415d-8ea4-6de848202ee6" status: 200 len: 1355 microversion: 2.1 time: 0.103863 Oct 04 19:27:03.065701 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3597/7209] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:27:02 2022] GET /compute/v2.1/servers/8b781a40-7d51-415d-8ea4-6de848202ee6 => generated 1355 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:27:04.090061 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-dc5ca92d-255c-4951-9e47-1539a5ffa08b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:27:04.090688 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-dc5ca92d-255c-4951-9e47-1539a5ffa08b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] [instance: 8b781a40-7d51-415d-8ea4-6de848202ee6] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:27:04.097227 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dc5ca92d-255c-4951-9e47-1539a5ffa08b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:04.097704 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dc5ca92d-255c-4951-9e47-1539a5ffa08b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:04.098134 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dc5ca92d-255c-4951-9e47-1539a5ffa08b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:04.098817 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dc5ca92d-255c-4951-9e47-1539a5ffa08b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:04.099267 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dc5ca92d-255c-4951-9e47-1539a5ffa08b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:04.099690 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dc5ca92d-255c-4951-9e47-1539a5ffa08b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:04.116596 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-dc5ca92d-255c-4951-9e47-1539a5ffa08b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] HTTP exception thrown: Instance 8b781a40-7d51-415d-8ea4-6de848202ee6 could not be found. Oct 04 19:27:04.118247 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-dc5ca92d-255c-4951-9e47-1539a5ffa08b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Request method failure captured: Oct 04 19:27:04.118247 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/8b781a40-7d51-415d-8ea4-6de848202ee6 HTTP/1.1 Oct 04 19:27:04.118247 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 19:27:04.118247 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 19:27:04.118247 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 19:27:04.118247 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 19:27:04.118247 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 19:27:04.118247 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 19:27:04.118247 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 19:27:04.118247 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 19:27:04.118247 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPIcrTIoZmU9MC83P2pr9ihdde_O34kT-H-5oj2NnEUHxZ7u6d0iVUulFYuyLpCenTbNTzDECz-ja0Upgm5x505nJ4VYUuS8arG8yRvvAazBWadpmzk8tZWcFQnwqYgCdSmdZmyUlhN1rUbAZJtGPYmlMzSSC1eYEi1Aha5rPMaRu8oI Oct 04 19:27:04.118247 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 19:27:04.118247 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 19:27:04.118247 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 19:27:04.118247 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 19:27:04.118247 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 19:27:04.118247 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 19:27:04.118247 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 81e34eff3bda4651aece03d213439a2b Oct 04 19:27:04.118247 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1051949435 Oct 04 19:27:04.118247 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 19:27:04.118247 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 19:27:04.118247 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/81e34eff3bda4651aece03d213439a2b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_81e34eff3bda4651aece03d213439a2b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/81e34eff3bda4651aece03d213439a2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/81e34eff3bda4651aece03d213439a2b"}]}] Oct 04 19:27:04.118247 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1051949435 Oct 04 19:27:04.118247 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 81e34eff3bda4651aece03d213439a2b Oct 04 19:27:04.118247 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1051949435 Oct 04 19:27:04.118247 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-TestNetworkAdvancedServerOps-1051949435-project Oct 04 19:27:04.118247 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 19:27:04.118247 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 19:27:04.118247 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: e66faeb21cd44d9e927e436096f49e26 Oct 04 19:27:04.118247 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1051949435-project Oct 04 19:27:04.118247 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 19:27:04.118247 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 8b781a40-7d51-415d-8ea4-6de848202ee6 could not be found. Oct 04 19:27:04.118247 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '8b781a40-7d51-415d-8ea4-6de848202ee6'} Oct 04 19:27:04.118247 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:27:04.118247 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:27:04.118247 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:27:04.118247 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:27:04.118247 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:27:04.118247 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:27:04.118247 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:27:04.118247 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:27:04.118247 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:27:04.118247 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:27:04.118247 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b781a40-7d51-415d-8ea4-6de848202ee6 could not be found. Oct 04 19:27:04.118247 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:27:04.118247 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:27:04.118247 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:27:04.118247 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:27:04.118247 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:27:04.118247 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:27:04.118247 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:27:04.118247 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:27:04.118247 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:27:04.118247 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:27:04.118247 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:27:04.118247 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:27:04.118247 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:27:04.118247 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:27:04.118247 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:27:04.118247 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:27:04.118247 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b781a40-7d51-415d-8ea4-6de848202ee6 could not be found. Oct 04 19:27:04.118247 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:27:04.118247 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:27:04.123177 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:27:04.123177 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:27:04.123177 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:27:04.123177 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:27:04.123177 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:27:04.123177 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:27:04.123177 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b781a40-7d51-415d-8ea4-6de848202ee6 could not be found. Oct 04 19:27:04.123177 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:27:04.123177 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-dc5ca92d-255c-4951-9e47-1539a5ffa08b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Returning 404 to user: Instance 8b781a40-7d51-415d-8ea4-6de848202ee6 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:27:04.123177 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-dc5ca92d-255c-4951-9e47-1539a5ffa08b tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "GET /compute/v2.1/servers/8b781a40-7d51-415d-8ea4-6de848202ee6" status: 404 len: 111 microversion: 2.1 time: 0.034800 Oct 04 19:27:04.123177 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3613/7210] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:27:04 2022] GET /compute/v2.1/servers/8b781a40-7d51-415d-8ea4-6de848202ee6 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:27:07.626605 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8fbd291b-e8c7-4220-8311-ef4fd95b0b28 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] Calling method '.version_select at 0x7fe258062e50>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:27:07.702518 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8fbd291b-e8c7-4220-8311-ef4fd95b0b28 tempest-TestNetworkAdvancedServerOps-1051949435 tempest-TestNetworkAdvancedServerOps-1051949435-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-999910672" status: 202 len: 0 microversion: 2.1 time: 0.080753 Oct 04 19:27:07.703051 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3598/7211] 10.222.0.20 () {58 vars in 1281 bytes} [Tue Oct 4 19:27:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-999910672 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:29:41.697397 n-d-850501-14 devstack@n-api.service[123001]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c9febe7b-97ce-4695-9d92-17a0f76701f3] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 19:29:41.698605 n-d-850501-14 devstack@n-api.service[123001]: ERROR oslo.messaging._drivers.impl_rabbit [-] [642656d8-a7cd-470f-ae32-a85e45bb523d] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 19:29:41.699137 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=10 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:29:41.699887 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=16 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:29:41.701108 n-d-850501-14 devstack@n-api.service[123001]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 19:29:41.701254 n-d-850501-14 devstack@n-api.service[123001]: Tue Oct 4 19:29:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.20) !!! Oct 04 19:29:41.702380 n-d-850501-14 devstack@n-api.service[123001]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:29:41.702525 n-d-850501-14 devstack@n-api.service[123001]: Tue Oct 4 19:29:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.20) !!! Oct 04 19:29:41.703527 n-d-850501-14 devstack@n-api.service[123001]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 19:29:41.703688 n-d-850501-14 devstack@n-api.service[123001]: Tue Oct 4 19:29:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.20) !!! Oct 04 19:29:41.708405 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-fc35ac38-7291-4fa9-8cf0-4c8f1fe6148a tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Action: 'create', calling method: .version_select at 0x7fe253a5f040>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-1848700643", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB1ZYgtLe22ZwmpAVc3/WgRlfkJYCk8u9xQv19BoVEuGCNEQxUSQTvYduD+wxBXBzhPtqopE2Cnt3IOKtCcdShe7ATf7CR4D+a+KY3ggk5vnkJs/bP6+NOlHVRDXOv0jpQ=="}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:29:41.747843 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-fc35ac38-7291-4fa9-8cf0-4c8f1fe6148a tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Getting quotas for project 3490ae78798d4b97bc4d3376a3ae1526. Resources: {'key_pairs'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:29:41.755274 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-fc35ac38-7291-4fa9-8cf0-4c8f1fe6148a tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Getting quotas for user 8895fd439e9c4a7aabb75e9fb23eb64b and project 3490ae78798d4b97bc4d3376a3ae1526. Resources: {'key_pairs'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:29:41.851058 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-fc35ac38-7291-4fa9-8cf0-4c8f1fe6148a tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.155530 Oct 04 19:29:41.851586 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3614/7212] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Oct 4 19:29:41 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:29:44.147750 n-d-850501-14 devstack@n-api.service[123002]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d2b44dc8-447f-4d0a-9186-943d7552c0ea] AMQP server on 10.222.0.20:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 04 19:29:44.148625 n-d-850501-14 devstack@n-api.service[123002]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9c4ba655-a850-4726-8db9-cffc7e0e245e] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 19:29:44.149156 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:29:44.149945 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:29:44.150858 n-d-850501-14 devstack@n-api.service[123002]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 19:29:44.151001 n-d-850501-14 devstack@n-api.service[123002]: Tue Oct 4 19:29:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.20) !!! Oct 04 19:29:44.157235 n-d-850501-14 devstack@n-api.service[123002]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 19:29:44.157355 n-d-850501-14 devstack@n-api.service[123002]: Tue Oct 4 19:29:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.20) !!! Oct 04 19:29:44.158349 n-d-850501-14 devstack@n-api.service[123002]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:29:44.158490 n-d-850501-14 devstack@n-api.service[123002]: Tue Oct 4 19:29:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.20) !!! Oct 04 19:29:44.172571 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-cb953511-3c8a-4fba-9c9f-d2e41bb5b651 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1527514377", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "4f39acc3-83a7-402e-af4e-1dc3bb6041cd", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-1848700643", "security_groups": [{"name": "tempest-secgroup-smoke-856107277"}], "networks": [{"uuid": "c0378054-6acc-4d29-a7e8-add3a00f02f5"}]}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:29:44.293596 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-cb953511-3c8a-4fba-9c9f-d2e41bb5b651 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] validate_networks() for [('c0378054-6acc-4d29-a7e8-add3a00f02f5', None, None, None, None, None)] {{(pid=123002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:29:44.823541 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-cb953511-3c8a-4fba-9c9f-d2e41bb5b651 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:29:44.823974 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-cb953511-3c8a-4fba-9c9f-d2e41bb5b651 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:29:44.824525 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-cb953511-3c8a-4fba-9c9f-d2e41bb5b651 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:29:44.824952 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-cb953511-3c8a-4fba-9c9f-d2e41bb5b651 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:29:44.825404 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-cb953511-3c8a-4fba-9c9f-d2e41bb5b651 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:29:44.839635 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cb953511-3c8a-4fba-9c9f-d2e41bb5b651 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:44.844398 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cb953511-3c8a-4fba-9c9f-d2e41bb5b651 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:44.844398 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cb953511-3c8a-4fba-9c9f-d2e41bb5b651 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:44.844398 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cb953511-3c8a-4fba-9c9f-d2e41bb5b651 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:44.844398 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cb953511-3c8a-4fba-9c9f-d2e41bb5b651 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:44.844398 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cb953511-3c8a-4fba-9c9f-d2e41bb5b651 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:44.863173 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-cb953511-3c8a-4fba-9c9f-d2e41bb5b651 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Getting quotas for project 3490ae78798d4b97bc4d3376a3ae1526. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:29:44.868672 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-cb953511-3c8a-4fba-9c9f-d2e41bb5b651 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Getting quotas for user 8895fd439e9c4a7aabb75e9fb23eb64b and project 3490ae78798d4b97bc4d3376a3ae1526. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:29:44.928495 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-cb953511-3c8a-4fba-9c9f-d2e41bb5b651 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Going to run 1 instances... {{(pid=123002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:29:44.930713 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-cb953511-3c8a-4fba-9c9f-d2e41bb5b651 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] [instance: fd567aaa-ad47-4cdf-b852-6aff41b084e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4f39acc3-83a7-402e-af4e-1dc3bb6041cd',volume_size=None,volume_type=None)] {{(pid=123002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:29:45.159360 n-d-850501-14 devstack@n-api.service[123002]: INFO oslo.messaging._drivers.impl_rabbit [-] [d2b44dc8-447f-4d0a-9186-943d7552c0ea] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 48928. Oct 04 19:29:45.162065 n-d-850501-14 devstack@n-api.service[123002]: INFO oslo.messaging._drivers.impl_rabbit [-] [9c4ba655-a850-4726-8db9-cffc7e0e245e] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 48930. Oct 04 19:29:45.333195 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-cb953511-3c8a-4fba-9c9f-d2e41bb5b651 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.187071 Oct 04 19:29:45.334018 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3599/7213] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 19:29:44 2022] POST /compute/v2.1/servers => generated 405 bytes in 1189 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:29:45.348189 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-04cbf41a-9dd0-4a68-a020-d18409e7bc5a tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:29:45.348822 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-04cbf41a-9dd0-4a68-a020-d18409e7bc5a tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] [instance: fd567aaa-ad47-4cdf-b852-6aff41b084e3] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:29:45.372127 n-d-850501-14 devstack@n-api.service[123001]: INFO oslo.messaging._drivers.impl_rabbit [-] [c9febe7b-97ce-4695-9d92-17a0f76701f3] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 48936. Oct 04 19:29:45.373466 n-d-850501-14 devstack@n-api.service[123001]: INFO oslo.messaging._drivers.impl_rabbit [-] [642656d8-a7cd-470f-ae32-a85e45bb523d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 48938. Oct 04 19:29:45.420595 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-04cbf41a-9dd0-4a68-a020-d18409e7bc5a tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8895fd439e9c4a7aabb75e9fb23eb64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3490ae78798d4b97bc4d3376a3ae1526', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:29:45.427873 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-04cbf41a-9dd0-4a68-a020-d18409e7bc5a tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] 10.222.0.20 "GET /compute/v2.1/servers/fd567aaa-ad47-4cdf-b852-6aff41b084e3" status: 200 len: 1099 microversion: 2.1 time: 0.086211 Oct 04 19:29:45.428473 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3615/7214] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:29:45 2022] GET /compute/v2.1/servers/fd567aaa-ad47-4cdf-b852-6aff41b084e3 => generated 1099 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:29:46.451167 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c9defb9c-f7da-4114-9d46-7fa1411196c3 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:29:46.455803 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c9defb9c-f7da-4114-9d46-7fa1411196c3 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] [instance: fd567aaa-ad47-4cdf-b852-6aff41b084e3] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:29:46.459681 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c9defb9c-f7da-4114-9d46-7fa1411196c3 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:46.460255 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c9defb9c-f7da-4114-9d46-7fa1411196c3 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:46.460715 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c9defb9c-f7da-4114-9d46-7fa1411196c3 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:46.461430 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c9defb9c-f7da-4114-9d46-7fa1411196c3 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:46.461913 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c9defb9c-f7da-4114-9d46-7fa1411196c3 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:46.462353 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c9defb9c-f7da-4114-9d46-7fa1411196c3 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:46.525696 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c9defb9c-f7da-4114-9d46-7fa1411196c3 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8895fd439e9c4a7aabb75e9fb23eb64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3490ae78798d4b97bc4d3376a3ae1526', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:29:46.533615 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c9defb9c-f7da-4114-9d46-7fa1411196c3 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] 10.222.0.20 "GET /compute/v2.1/servers/fd567aaa-ad47-4cdf-b852-6aff41b084e3" status: 200 len: 1149 microversion: 2.1 time: 0.087304 Oct 04 19:29:46.534801 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3600/7215] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:29:46 2022] GET /compute/v2.1/servers/fd567aaa-ad47-4cdf-b852-6aff41b084e3 => generated 1149 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:29:47.556935 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2efc93ba-c2ce-4fc2-968f-12788015a93f tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:29:47.557669 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2efc93ba-c2ce-4fc2-968f-12788015a93f tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] [instance: fd567aaa-ad47-4cdf-b852-6aff41b084e3] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:29:47.566255 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2efc93ba-c2ce-4fc2-968f-12788015a93f tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:47.566255 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2efc93ba-c2ce-4fc2-968f-12788015a93f tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:47.566255 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2efc93ba-c2ce-4fc2-968f-12788015a93f tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:47.566927 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2efc93ba-c2ce-4fc2-968f-12788015a93f tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:47.567397 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2efc93ba-c2ce-4fc2-968f-12788015a93f tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:47.567848 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2efc93ba-c2ce-4fc2-968f-12788015a93f tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:47.638696 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-2efc93ba-c2ce-4fc2-968f-12788015a93f tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8895fd439e9c4a7aabb75e9fb23eb64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3490ae78798d4b97bc4d3376a3ae1526', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:29:47.647049 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2efc93ba-c2ce-4fc2-968f-12788015a93f tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] 10.222.0.20 "GET /compute/v2.1/servers/fd567aaa-ad47-4cdf-b852-6aff41b084e3" status: 200 len: 1205 microversion: 2.1 time: 0.093940 Oct 04 19:29:47.647636 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3616/7216] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:29:47 2022] GET /compute/v2.1/servers/fd567aaa-ad47-4cdf-b852-6aff41b084e3 => generated 1205 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:29:48.673566 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-52aedc56-9055-49fc-aacb-a319df8b9da4 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:29:48.675482 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-52aedc56-9055-49fc-aacb-a319df8b9da4 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] [instance: fd567aaa-ad47-4cdf-b852-6aff41b084e3] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:29:48.684618 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-52aedc56-9055-49fc-aacb-a319df8b9da4 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:48.685660 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-52aedc56-9055-49fc-aacb-a319df8b9da4 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:48.686304 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-52aedc56-9055-49fc-aacb-a319df8b9da4 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:48.687315 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-52aedc56-9055-49fc-aacb-a319df8b9da4 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:48.687975 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-52aedc56-9055-49fc-aacb-a319df8b9da4 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:48.688621 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-52aedc56-9055-49fc-aacb-a319df8b9da4 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:49.261097 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-52aedc56-9055-49fc-aacb-a319df8b9da4 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8895fd439e9c4a7aabb75e9fb23eb64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3490ae78798d4b97bc4d3376a3ae1526', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:29:49.273389 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-52aedc56-9055-49fc-aacb-a319df8b9da4 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] 10.222.0.20 "GET /compute/v2.1/servers/fd567aaa-ad47-4cdf-b852-6aff41b084e3" status: 200 len: 1282 microversion: 2.1 time: 0.603357 Oct 04 19:29:49.274326 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3601/7217] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:29:48 2022] GET /compute/v2.1/servers/fd567aaa-ad47-4cdf-b852-6aff41b084e3 => generated 1282 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:29:49.793358 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-be9dccfb-b22c-4c71-bad2-2dc8e5e14c6d req-57619af6-9c9b-4431-9fc6-d95c7465ca73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd567aaa-ad47-4cdf-b852-6aff41b084e3", "tag": "f6bd5cca-15dc-42ad-b489-6d66c5560601"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:29:49.806098 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-be9dccfb-b22c-4c71-bad2-2dc8e5e14c6d req-57619af6-9c9b-4431-9fc6-d95c7465ca73 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:49.806748 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-be9dccfb-b22c-4c71-bad2-2dc8e5e14c6d req-57619af6-9c9b-4431-9fc6-d95c7465ca73 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:49.807295 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-be9dccfb-b22c-4c71-bad2-2dc8e5e14c6d req-57619af6-9c9b-4431-9fc6-d95c7465ca73 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:49.819678 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-be9dccfb-b22c-4c71-bad2-2dc8e5e14c6d req-57619af6-9c9b-4431-9fc6-d95c7465ca73 service nova] Creating event network-changed:f6bd5cca-15dc-42ad-b489-6d66c5560601 for instance fd567aaa-ad47-4cdf-b852-6aff41b084e3 on n-h1-850501-14 Oct 04 19:29:49.827281 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-be9dccfb-b22c-4c71-bad2-2dc8e5e14c6d req-57619af6-9c9b-4431-9fc6-d95c7465ca73 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039891 Oct 04 19:29:49.828779 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3617/7218] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:29:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:29:50.301364 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a2ec7651-7466-4f29-82bb-bec367d52a87 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:29:50.302294 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a2ec7651-7466-4f29-82bb-bec367d52a87 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] [instance: fd567aaa-ad47-4cdf-b852-6aff41b084e3] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:29:50.309313 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a2ec7651-7466-4f29-82bb-bec367d52a87 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:50.309936 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a2ec7651-7466-4f29-82bb-bec367d52a87 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:50.310584 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a2ec7651-7466-4f29-82bb-bec367d52a87 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:50.311407 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a2ec7651-7466-4f29-82bb-bec367d52a87 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:50.312127 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a2ec7651-7466-4f29-82bb-bec367d52a87 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:50.313181 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a2ec7651-7466-4f29-82bb-bec367d52a87 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:50.531579 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a2ec7651-7466-4f29-82bb-bec367d52a87 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8895fd439e9c4a7aabb75e9fb23eb64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3490ae78798d4b97bc4d3376a3ae1526', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:29:50.540201 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a2ec7651-7466-4f29-82bb-bec367d52a87 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] 10.222.0.20 "GET /compute/v2.1/servers/fd567aaa-ad47-4cdf-b852-6aff41b084e3" status: 200 len: 1282 microversion: 2.1 time: 0.243749 Oct 04 19:29:50.556151 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3602/7219] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:29:50 2022] GET /compute/v2.1/servers/fd567aaa-ad47-4cdf-b852-6aff41b084e3 => generated 1282 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:29:51.566765 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-bde090ba-ccf9-4866-b5cb-a379fdf17392 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:29:51.567636 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-bde090ba-ccf9-4866-b5cb-a379fdf17392 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] [instance: fd567aaa-ad47-4cdf-b852-6aff41b084e3] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:29:51.574694 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bde090ba-ccf9-4866-b5cb-a379fdf17392 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:51.575182 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bde090ba-ccf9-4866-b5cb-a379fdf17392 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:51.575624 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bde090ba-ccf9-4866-b5cb-a379fdf17392 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:51.576355 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bde090ba-ccf9-4866-b5cb-a379fdf17392 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:51.576818 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bde090ba-ccf9-4866-b5cb-a379fdf17392 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:51.577247 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bde090ba-ccf9-4866-b5cb-a379fdf17392 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:51.751685 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-bde090ba-ccf9-4866-b5cb-a379fdf17392 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8895fd439e9c4a7aabb75e9fb23eb64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3490ae78798d4b97bc4d3376a3ae1526', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:29:51.760333 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-bde090ba-ccf9-4866-b5cb-a379fdf17392 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] 10.222.0.20 "GET /compute/v2.1/servers/fd567aaa-ad47-4cdf-b852-6aff41b084e3" status: 200 len: 1282 microversion: 2.1 time: 0.199905 Oct 04 19:29:51.760927 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3618/7220] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:29:51 2022] GET /compute/v2.1/servers/fd567aaa-ad47-4cdf-b852-6aff41b084e3 => generated 1282 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:29:52.787629 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4a0d14b1-945c-47cc-9ecd-7944049e0cfc tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:29:52.788307 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4a0d14b1-945c-47cc-9ecd-7944049e0cfc tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] [instance: fd567aaa-ad47-4cdf-b852-6aff41b084e3] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:29:52.795339 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4a0d14b1-945c-47cc-9ecd-7944049e0cfc tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:52.795868 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4a0d14b1-945c-47cc-9ecd-7944049e0cfc tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:52.796336 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4a0d14b1-945c-47cc-9ecd-7944049e0cfc tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:52.797064 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4a0d14b1-945c-47cc-9ecd-7944049e0cfc tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:52.797534 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4a0d14b1-945c-47cc-9ecd-7944049e0cfc tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:52.797978 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4a0d14b1-945c-47cc-9ecd-7944049e0cfc tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:52.933282 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4a0d14b1-945c-47cc-9ecd-7944049e0cfc tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8895fd439e9c4a7aabb75e9fb23eb64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3490ae78798d4b97bc4d3376a3ae1526', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:29:52.942459 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4a0d14b1-945c-47cc-9ecd-7944049e0cfc tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] 10.222.0.20 "GET /compute/v2.1/servers/fd567aaa-ad47-4cdf-b852-6aff41b084e3" status: 200 len: 1282 microversion: 2.1 time: 0.158839 Oct 04 19:29:52.947816 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3603/7221] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:29:52 2022] GET /compute/v2.1/servers/fd567aaa-ad47-4cdf-b852-6aff41b084e3 => generated 1282 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:29:53.966303 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d14ca855-bd19-4522-9008-e058c905b783 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:29:53.966930 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d14ca855-bd19-4522-9008-e058c905b783 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] [instance: fd567aaa-ad47-4cdf-b852-6aff41b084e3] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:29:53.975172 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d14ca855-bd19-4522-9008-e058c905b783 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:53.975599 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d14ca855-bd19-4522-9008-e058c905b783 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:53.976043 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d14ca855-bd19-4522-9008-e058c905b783 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:53.976774 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d14ca855-bd19-4522-9008-e058c905b783 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:53.977234 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d14ca855-bd19-4522-9008-e058c905b783 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:53.977663 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d14ca855-bd19-4522-9008-e058c905b783 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:54.126743 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d14ca855-bd19-4522-9008-e058c905b783 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8895fd439e9c4a7aabb75e9fb23eb64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3490ae78798d4b97bc4d3376a3ae1526', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:29:54.135628 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d14ca855-bd19-4522-9008-e058c905b783 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] 10.222.0.20 "GET /compute/v2.1/servers/fd567aaa-ad47-4cdf-b852-6aff41b084e3" status: 200 len: 1270 microversion: 2.1 time: 0.173148 Oct 04 19:29:54.136252 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3619/7222] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:29:53 2022] GET /compute/v2.1/servers/fd567aaa-ad47-4cdf-b852-6aff41b084e3 => generated 1270 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:29:55.162879 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-67a5a560-71a4-4fe5-bc71-b0bc2b4fbc2b tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:29:55.163501 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-67a5a560-71a4-4fe5-bc71-b0bc2b4fbc2b tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] [instance: fd567aaa-ad47-4cdf-b852-6aff41b084e3] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:29:55.166303 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:29:55.166989 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=6 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:29:55.171854 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-67a5a560-71a4-4fe5-bc71-b0bc2b4fbc2b tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:55.172427 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-67a5a560-71a4-4fe5-bc71-b0bc2b4fbc2b tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:55.172878 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-67a5a560-71a4-4fe5-bc71-b0bc2b4fbc2b tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:55.173576 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-67a5a560-71a4-4fe5-bc71-b0bc2b4fbc2b tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:55.174568 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-67a5a560-71a4-4fe5-bc71-b0bc2b4fbc2b tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:55.175180 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-67a5a560-71a4-4fe5-bc71-b0bc2b4fbc2b tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:55.312439 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-67a5a560-71a4-4fe5-bc71-b0bc2b4fbc2b tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8895fd439e9c4a7aabb75e9fb23eb64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3490ae78798d4b97bc4d3376a3ae1526', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:29:55.321059 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-67a5a560-71a4-4fe5-bc71-b0bc2b4fbc2b tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] 10.222.0.20 "GET /compute/v2.1/servers/fd567aaa-ad47-4cdf-b852-6aff41b084e3" status: 200 len: 1270 microversion: 2.1 time: 0.162212 Oct 04 19:29:55.321659 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3604/7223] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:29:55 2022] GET /compute/v2.1/servers/fd567aaa-ad47-4cdf-b852-6aff41b084e3 => generated 1270 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:29:56.344461 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-21a6b10f-7d85-45da-b6b7-0773c62bfbd4 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:29:56.345069 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-21a6b10f-7d85-45da-b6b7-0773c62bfbd4 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] [instance: fd567aaa-ad47-4cdf-b852-6aff41b084e3] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:29:56.347893 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=6 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:29:56.353094 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-21a6b10f-7d85-45da-b6b7-0773c62bfbd4 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:56.353615 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-21a6b10f-7d85-45da-b6b7-0773c62bfbd4 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:56.354050 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-21a6b10f-7d85-45da-b6b7-0773c62bfbd4 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:56.354738 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-21a6b10f-7d85-45da-b6b7-0773c62bfbd4 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:56.355244 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-21a6b10f-7d85-45da-b6b7-0773c62bfbd4 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:56.355665 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-21a6b10f-7d85-45da-b6b7-0773c62bfbd4 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:56.494704 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-21a6b10f-7d85-45da-b6b7-0773c62bfbd4 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8895fd439e9c4a7aabb75e9fb23eb64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3490ae78798d4b97bc4d3376a3ae1526', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:29:56.502556 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-21a6b10f-7d85-45da-b6b7-0773c62bfbd4 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] 10.222.0.20 "GET /compute/v2.1/servers/fd567aaa-ad47-4cdf-b852-6aff41b084e3" status: 200 len: 1270 microversion: 2.1 time: 0.162356 Oct 04 19:29:56.503122 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3620/7224] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:29:56 2022] GET /compute/v2.1/servers/fd567aaa-ad47-4cdf-b852-6aff41b084e3 => generated 1270 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:29:57.526112 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-dee20849-624d-4fd9-8799-17c79e98c6c1 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:29:57.526746 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-dee20849-624d-4fd9-8799-17c79e98c6c1 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] [instance: fd567aaa-ad47-4cdf-b852-6aff41b084e3] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:29:57.533557 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dee20849-624d-4fd9-8799-17c79e98c6c1 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:57.534052 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dee20849-624d-4fd9-8799-17c79e98c6c1 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:57.534502 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dee20849-624d-4fd9-8799-17c79e98c6c1 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:57.535491 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dee20849-624d-4fd9-8799-17c79e98c6c1 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:57.535993 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dee20849-624d-4fd9-8799-17c79e98c6c1 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:57.536468 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dee20849-624d-4fd9-8799-17c79e98c6c1 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:57.671013 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-dee20849-624d-4fd9-8799-17c79e98c6c1 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8895fd439e9c4a7aabb75e9fb23eb64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3490ae78798d4b97bc4d3376a3ae1526', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:29:57.679409 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-dee20849-624d-4fd9-8799-17c79e98c6c1 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] 10.222.0.20 "GET /compute/v2.1/servers/fd567aaa-ad47-4cdf-b852-6aff41b084e3" status: 200 len: 1270 microversion: 2.1 time: 0.157325 Oct 04 19:29:57.679986 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3605/7225] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:29:57 2022] GET /compute/v2.1/servers/fd567aaa-ad47-4cdf-b852-6aff41b084e3 => generated 1270 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:29:58.702635 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-fadc8720-34cb-4e91-a64f-624ffd9638be tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:29:58.703244 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-fadc8720-34cb-4e91-a64f-624ffd9638be tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] [instance: fd567aaa-ad47-4cdf-b852-6aff41b084e3] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:29:58.710157 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fadc8720-34cb-4e91-a64f-624ffd9638be tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:58.710651 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fadc8720-34cb-4e91-a64f-624ffd9638be tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:58.711356 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fadc8720-34cb-4e91-a64f-624ffd9638be tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:58.711863 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fadc8720-34cb-4e91-a64f-624ffd9638be tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:58.712346 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fadc8720-34cb-4e91-a64f-624ffd9638be tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:58.713895 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fadc8720-34cb-4e91-a64f-624ffd9638be tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:58.849326 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-fadc8720-34cb-4e91-a64f-624ffd9638be tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8895fd439e9c4a7aabb75e9fb23eb64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3490ae78798d4b97bc4d3376a3ae1526', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:29:58.856937 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-fadc8720-34cb-4e91-a64f-624ffd9638be tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] 10.222.0.20 "GET /compute/v2.1/servers/fd567aaa-ad47-4cdf-b852-6aff41b084e3" status: 200 len: 1270 microversion: 2.1 time: 0.158169 Oct 04 19:29:58.857596 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3621/7226] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:29:58 2022] GET /compute/v2.1/servers/fd567aaa-ad47-4cdf-b852-6aff41b084e3 => generated 1270 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:29:59.879783 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c7030862-0e16-4698-9aa6-20766d907dd8 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:29:59.880435 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c7030862-0e16-4698-9aa6-20766d907dd8 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] [instance: fd567aaa-ad47-4cdf-b852-6aff41b084e3] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:29:59.887175 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c7030862-0e16-4698-9aa6-20766d907dd8 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:59.887676 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c7030862-0e16-4698-9aa6-20766d907dd8 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:59.888151 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c7030862-0e16-4698-9aa6-20766d907dd8 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:59.888853 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c7030862-0e16-4698-9aa6-20766d907dd8 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:59.889326 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c7030862-0e16-4698-9aa6-20766d907dd8 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:59.889766 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c7030862-0e16-4698-9aa6-20766d907dd8 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:00.027679 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c7030862-0e16-4698-9aa6-20766d907dd8 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8895fd439e9c4a7aabb75e9fb23eb64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3490ae78798d4b97bc4d3376a3ae1526', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:30:00.035595 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c7030862-0e16-4698-9aa6-20766d907dd8 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] 10.222.0.20 "GET /compute/v2.1/servers/fd567aaa-ad47-4cdf-b852-6aff41b084e3" status: 200 len: 1270 microversion: 2.1 time: 0.159861 Oct 04 19:30:00.036199 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3606/7227] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:29:59 2022] GET /compute/v2.1/servers/fd567aaa-ad47-4cdf-b852-6aff41b084e3 => generated 1270 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:30:01.058196 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c43f70d8-00c6-4831-9512-21a7462ccc3c tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:30:01.058735 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c43f70d8-00c6-4831-9512-21a7462ccc3c tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] [instance: fd567aaa-ad47-4cdf-b852-6aff41b084e3] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:30:01.065603 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c43f70d8-00c6-4831-9512-21a7462ccc3c tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:01.066167 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c43f70d8-00c6-4831-9512-21a7462ccc3c tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:01.066759 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c43f70d8-00c6-4831-9512-21a7462ccc3c tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:01.067218 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c43f70d8-00c6-4831-9512-21a7462ccc3c tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:01.067680 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c43f70d8-00c6-4831-9512-21a7462ccc3c tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:01.068131 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c43f70d8-00c6-4831-9512-21a7462ccc3c tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:01.204136 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c43f70d8-00c6-4831-9512-21a7462ccc3c tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8895fd439e9c4a7aabb75e9fb23eb64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3490ae78798d4b97bc4d3376a3ae1526', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:30:01.213092 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c43f70d8-00c6-4831-9512-21a7462ccc3c tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] 10.222.0.20 "GET /compute/v2.1/servers/fd567aaa-ad47-4cdf-b852-6aff41b084e3" status: 200 len: 1270 microversion: 2.1 time: 0.158936 Oct 04 19:30:01.213673 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3622/7228] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:30:01 2022] GET /compute/v2.1/servers/fd567aaa-ad47-4cdf-b852-6aff41b084e3 => generated 1270 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:30:02.248715 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-aa40de03-f3d5-41f1-b241-ee3fad65c9c1 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:30:02.249339 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-aa40de03-f3d5-41f1-b241-ee3fad65c9c1 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] [instance: fd567aaa-ad47-4cdf-b852-6aff41b084e3] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:30:02.256152 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aa40de03-f3d5-41f1-b241-ee3fad65c9c1 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:02.256651 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aa40de03-f3d5-41f1-b241-ee3fad65c9c1 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:02.257095 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aa40de03-f3d5-41f1-b241-ee3fad65c9c1 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:02.257905 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aa40de03-f3d5-41f1-b241-ee3fad65c9c1 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:02.258432 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aa40de03-f3d5-41f1-b241-ee3fad65c9c1 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:02.258891 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aa40de03-f3d5-41f1-b241-ee3fad65c9c1 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:02.400510 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-aa40de03-f3d5-41f1-b241-ee3fad65c9c1 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8895fd439e9c4a7aabb75e9fb23eb64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3490ae78798d4b97bc4d3376a3ae1526', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:30:02.408439 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-aa40de03-f3d5-41f1-b241-ee3fad65c9c1 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] 10.222.0.20 "GET /compute/v2.1/servers/fd567aaa-ad47-4cdf-b852-6aff41b084e3" status: 200 len: 1270 microversion: 2.1 time: 0.163682 Oct 04 19:30:02.409026 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3607/7229] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:30:02 2022] GET /compute/v2.1/servers/fd567aaa-ad47-4cdf-b852-6aff41b084e3 => generated 1270 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:30:03.433052 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6687c7e8-723c-40b4-8028-7f772b470ab2 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:30:03.433677 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6687c7e8-723c-40b4-8028-7f772b470ab2 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] [instance: fd567aaa-ad47-4cdf-b852-6aff41b084e3] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:30:03.440643 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6687c7e8-723c-40b4-8028-7f772b470ab2 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:03.441133 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6687c7e8-723c-40b4-8028-7f772b470ab2 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:03.441573 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6687c7e8-723c-40b4-8028-7f772b470ab2 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:03.443158 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6687c7e8-723c-40b4-8028-7f772b470ab2 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:03.443696 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6687c7e8-723c-40b4-8028-7f772b470ab2 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:03.444138 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6687c7e8-723c-40b4-8028-7f772b470ab2 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:03.579412 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6687c7e8-723c-40b4-8028-7f772b470ab2 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8895fd439e9c4a7aabb75e9fb23eb64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3490ae78798d4b97bc4d3376a3ae1526', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:30:03.587960 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6687c7e8-723c-40b4-8028-7f772b470ab2 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] 10.222.0.20 "GET /compute/v2.1/servers/fd567aaa-ad47-4cdf-b852-6aff41b084e3" status: 200 len: 1270 microversion: 2.1 time: 0.158864 Oct 04 19:30:03.588580 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3623/7230] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:30:03 2022] GET /compute/v2.1/servers/fd567aaa-ad47-4cdf-b852-6aff41b084e3 => generated 1270 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:30:03.891649 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-449b597c-9075-4ab2-afdf-e550005015be req-89b91d2b-2df2-46df-8915-76f634950d9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd567aaa-ad47-4cdf-b852-6aff41b084e3", "name": "network-vif-plugged", "status": "completed", "tag": "f6bd5cca-15dc-42ad-b489-6d66c5560601"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:30:03.903420 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-449b597c-9075-4ab2-afdf-e550005015be req-89b91d2b-2df2-46df-8915-76f634950d9b service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:03.903916 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-449b597c-9075-4ab2-afdf-e550005015be req-89b91d2b-2df2-46df-8915-76f634950d9b service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:03.904390 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-449b597c-9075-4ab2-afdf-e550005015be req-89b91d2b-2df2-46df-8915-76f634950d9b service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:03.916158 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-449b597c-9075-4ab2-afdf-e550005015be req-89b91d2b-2df2-46df-8915-76f634950d9b service nova] Creating event network-vif-plugged:f6bd5cca-15dc-42ad-b489-6d66c5560601 for instance fd567aaa-ad47-4cdf-b852-6aff41b084e3 on n-h1-850501-14 Oct 04 19:30:03.922692 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-449b597c-9075-4ab2-afdf-e550005015be req-89b91d2b-2df2-46df-8915-76f634950d9b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034948 Oct 04 19:30:03.923348 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3608/7231] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:30:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:30:04.610987 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0b96f391-a689-4cee-b51c-55b2e9fd92c4 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:30:04.611602 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0b96f391-a689-4cee-b51c-55b2e9fd92c4 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] [instance: fd567aaa-ad47-4cdf-b852-6aff41b084e3] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:30:04.619084 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0b96f391-a689-4cee-b51c-55b2e9fd92c4 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:04.619568 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0b96f391-a689-4cee-b51c-55b2e9fd92c4 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:04.620005 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0b96f391-a689-4cee-b51c-55b2e9fd92c4 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:04.620715 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0b96f391-a689-4cee-b51c-55b2e9fd92c4 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:04.621173 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0b96f391-a689-4cee-b51c-55b2e9fd92c4 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:04.621599 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0b96f391-a689-4cee-b51c-55b2e9fd92c4 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:04.757114 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0b96f391-a689-4cee-b51c-55b2e9fd92c4 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8895fd439e9c4a7aabb75e9fb23eb64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3490ae78798d4b97bc4d3376a3ae1526', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:30:04.765018 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0b96f391-a689-4cee-b51c-55b2e9fd92c4 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] 10.222.0.20 "GET /compute/v2.1/servers/fd567aaa-ad47-4cdf-b852-6aff41b084e3" status: 200 len: 1270 microversion: 2.1 time: 0.158076 Oct 04 19:30:04.765595 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3624/7232] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:30:04 2022] GET /compute/v2.1/servers/fd567aaa-ad47-4cdf-b852-6aff41b084e3 => generated 1270 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:30:05.790954 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-296221fd-bd32-43fb-9bcd-a4f3d021d747 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:30:05.791677 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-296221fd-bd32-43fb-9bcd-a4f3d021d747 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] [instance: fd567aaa-ad47-4cdf-b852-6aff41b084e3] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:30:05.797887 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-296221fd-bd32-43fb-9bcd-a4f3d021d747 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:05.798391 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-296221fd-bd32-43fb-9bcd-a4f3d021d747 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:05.798849 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-296221fd-bd32-43fb-9bcd-a4f3d021d747 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:05.799557 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-296221fd-bd32-43fb-9bcd-a4f3d021d747 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:05.800031 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-296221fd-bd32-43fb-9bcd-a4f3d021d747 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:05.800500 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-296221fd-bd32-43fb-9bcd-a4f3d021d747 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:05.933812 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-296221fd-bd32-43fb-9bcd-a4f3d021d747 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8895fd439e9c4a7aabb75e9fb23eb64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3490ae78798d4b97bc4d3376a3ae1526', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:30:05.942271 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-296221fd-bd32-43fb-9bcd-a4f3d021d747 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] 10.222.0.20 "GET /compute/v2.1/servers/fd567aaa-ad47-4cdf-b852-6aff41b084e3" status: 200 len: 1459 microversion: 2.1 time: 0.156567 Oct 04 19:30:05.943684 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3609/7233] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:30:05 2022] GET /compute/v2.1/servers/fd567aaa-ad47-4cdf-b852-6aff41b084e3 => generated 1459 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:30:05.964701 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-db2c87c0-ec2a-4a89-b927-01b9555284ca tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:30:05.965319 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-db2c87c0-ec2a-4a89-b927-01b9555284ca tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] [instance: fd567aaa-ad47-4cdf-b852-6aff41b084e3] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:30:05.972307 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-db2c87c0-ec2a-4a89-b927-01b9555284ca tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:05.972735 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-db2c87c0-ec2a-4a89-b927-01b9555284ca tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:05.973732 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-db2c87c0-ec2a-4a89-b927-01b9555284ca tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:05.974425 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-db2c87c0-ec2a-4a89-b927-01b9555284ca tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:05.974880 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-db2c87c0-ec2a-4a89-b927-01b9555284ca tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:05.975304 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-db2c87c0-ec2a-4a89-b927-01b9555284ca tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:06.112477 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-db2c87c0-ec2a-4a89-b927-01b9555284ca tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8895fd439e9c4a7aabb75e9fb23eb64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3490ae78798d4b97bc4d3376a3ae1526', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:30:06.120184 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-db2c87c0-ec2a-4a89-b927-01b9555284ca tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] 10.222.0.20 "GET /compute/v2.1/servers/fd567aaa-ad47-4cdf-b852-6aff41b084e3" status: 200 len: 1459 microversion: 2.1 time: 0.159283 Oct 04 19:30:06.120748 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3625/7234] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:30:05 2022] GET /compute/v2.1/servers/fd567aaa-ad47-4cdf-b852-6aff41b084e3 => generated 1459 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:30:08.086381 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-09149b5a-0ef1-4e35-8322-a1da48a10410 req-30cde7e0-db2b-4fe6-9c6d-5500ed8bc245 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd567aaa-ad47-4cdf-b852-6aff41b084e3", "tag": "f6bd5cca-15dc-42ad-b489-6d66c5560601"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:30:08.097129 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-09149b5a-0ef1-4e35-8322-a1da48a10410 req-30cde7e0-db2b-4fe6-9c6d-5500ed8bc245 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:08.097643 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-09149b5a-0ef1-4e35-8322-a1da48a10410 req-30cde7e0-db2b-4fe6-9c6d-5500ed8bc245 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:08.099123 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-09149b5a-0ef1-4e35-8322-a1da48a10410 req-30cde7e0-db2b-4fe6-9c6d-5500ed8bc245 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:08.111081 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-09149b5a-0ef1-4e35-8322-a1da48a10410 req-30cde7e0-db2b-4fe6-9c6d-5500ed8bc245 service nova] Creating event network-changed:f6bd5cca-15dc-42ad-b489-6d66c5560601 for instance fd567aaa-ad47-4cdf-b852-6aff41b084e3 on n-h1-850501-14 Oct 04 19:30:08.117712 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-09149b5a-0ef1-4e35-8322-a1da48a10410 req-30cde7e0-db2b-4fe6-9c6d-5500ed8bc245 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035403 Oct 04 19:30:08.118787 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3610/7235] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:30:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:30:09.389986 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-1c9f97f3-b724-48ae-9e04-d584a97978ba req-2af31e1b-0604-48d3-99c4-833f7298785a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd567aaa-ad47-4cdf-b852-6aff41b084e3", "tag": "f6bd5cca-15dc-42ad-b489-6d66c5560601"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:30:09.400538 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-1c9f97f3-b724-48ae-9e04-d584a97978ba req-2af31e1b-0604-48d3-99c4-833f7298785a service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:09.401090 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-1c9f97f3-b724-48ae-9e04-d584a97978ba req-2af31e1b-0604-48d3-99c4-833f7298785a service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:09.403032 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-1c9f97f3-b724-48ae-9e04-d584a97978ba req-2af31e1b-0604-48d3-99c4-833f7298785a service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:09.413519 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-1c9f97f3-b724-48ae-9e04-d584a97978ba req-2af31e1b-0604-48d3-99c4-833f7298785a service nova] Creating event network-changed:f6bd5cca-15dc-42ad-b489-6d66c5560601 for instance fd567aaa-ad47-4cdf-b852-6aff41b084e3 on n-h1-850501-14 Oct 04 19:30:09.418798 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-1c9f97f3-b724-48ae-9e04-d584a97978ba req-2af31e1b-0604-48d3-99c4-833f7298785a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094306 Oct 04 19:30:09.419421 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3626/7236] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:30:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:30:11.435781 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-a810feb8-8de9-4d98-8b7e-3c3c7653f5ca req-74b9bdb3-63cf-4bc7-b866-2585e46fd646 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd567aaa-ad47-4cdf-b852-6aff41b084e3", "tag": "f6bd5cca-15dc-42ad-b489-6d66c5560601"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:30:11.445760 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-a810feb8-8de9-4d98-8b7e-3c3c7653f5ca req-74b9bdb3-63cf-4bc7-b866-2585e46fd646 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:11.446188 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-a810feb8-8de9-4d98-8b7e-3c3c7653f5ca req-74b9bdb3-63cf-4bc7-b866-2585e46fd646 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:11.446631 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-a810feb8-8de9-4d98-8b7e-3c3c7653f5ca req-74b9bdb3-63cf-4bc7-b866-2585e46fd646 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:11.457861 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-a810feb8-8de9-4d98-8b7e-3c3c7653f5ca req-74b9bdb3-63cf-4bc7-b866-2585e46fd646 service nova] Creating event network-changed:f6bd5cca-15dc-42ad-b489-6d66c5560601 for instance fd567aaa-ad47-4cdf-b852-6aff41b084e3 on n-h1-850501-14 Oct 04 19:30:11.462988 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-a810feb8-8de9-4d98-8b7e-3c3c7653f5ca req-74b9bdb3-63cf-4bc7-b866-2585e46fd646 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032123 Oct 04 19:30:11.463604 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3611/7237] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:30:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:31:12.972131 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:31:12.973069 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=58 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:31:12.973830 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:31:12.974758 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=62 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:31:12.977846 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-10e2676c-448e-44f0-af27-a7343adca3f3 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:12.981111 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-10e2676c-448e-44f0-af27-a7343adca3f3 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] [instance: fd567aaa-ad47-4cdf-b852-6aff41b084e3] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:12.981244 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-8b92555a-498e-42bd-9b56-67d1be48847a req-859b0b0d-0e18-4a16-8afa-1b242d8dd580 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd567aaa-ad47-4cdf-b852-6aff41b084e3", "tag": "f6bd5cca-15dc-42ad-b489-6d66c5560601"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:31:12.985079 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-10e2676c-448e-44f0-af27-a7343adca3f3 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:12.985566 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-10e2676c-448e-44f0-af27-a7343adca3f3 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:12.985999 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-10e2676c-448e-44f0-af27-a7343adca3f3 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:12.986690 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-10e2676c-448e-44f0-af27-a7343adca3f3 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:12.987655 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-10e2676c-448e-44f0-af27-a7343adca3f3 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:12.988009 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-10e2676c-448e-44f0-af27-a7343adca3f3 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:12.989737 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-8b92555a-498e-42bd-9b56-67d1be48847a req-859b0b0d-0e18-4a16-8afa-1b242d8dd580 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:12.990435 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-8b92555a-498e-42bd-9b56-67d1be48847a req-859b0b0d-0e18-4a16-8afa-1b242d8dd580 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:12.991121 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-8b92555a-498e-42bd-9b56-67d1be48847a req-859b0b0d-0e18-4a16-8afa-1b242d8dd580 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:13.006358 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-8b92555a-498e-42bd-9b56-67d1be48847a req-859b0b0d-0e18-4a16-8afa-1b242d8dd580 service nova] Creating event network-changed:f6bd5cca-15dc-42ad-b489-6d66c5560601 for instance fd567aaa-ad47-4cdf-b852-6aff41b084e3 on n-h1-850501-14 Oct 04 19:31:13.012866 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-8b92555a-498e-42bd-9b56-67d1be48847a req-859b0b0d-0e18-4a16-8afa-1b242d8dd580 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041932 Oct 04 19:31:13.013862 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3612/7238] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:31:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:31:13.018856 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-10e2676c-448e-44f0-af27-a7343adca3f3 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] [instance: fd567aaa-ad47-4cdf-b852-6aff41b084e3] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:31:13.334669 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-10e2676c-448e-44f0-af27-a7343adca3f3 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] 10.222.0.20 "DELETE /compute/v2.1/servers/fd567aaa-ad47-4cdf-b852-6aff41b084e3" status: 204 len: 0 microversion: 2.1 time: 0.365592 Oct 04 19:31:13.343828 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3627/7239] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 19:31:12 2022] DELETE /compute/v2.1/servers/fd567aaa-ad47-4cdf-b852-6aff41b084e3 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:31:13.344618 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d927cfdc-3950-4a85-8d34-62e728f99fd4 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:13.345653 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d927cfdc-3950-4a85-8d34-62e728f99fd4 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] [instance: fd567aaa-ad47-4cdf-b852-6aff41b084e3] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:13.354196 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d927cfdc-3950-4a85-8d34-62e728f99fd4 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:13.354792 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d927cfdc-3950-4a85-8d34-62e728f99fd4 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:13.355335 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d927cfdc-3950-4a85-8d34-62e728f99fd4 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:13.356195 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d927cfdc-3950-4a85-8d34-62e728f99fd4 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:13.356863 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d927cfdc-3950-4a85-8d34-62e728f99fd4 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:13.357248 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d927cfdc-3950-4a85-8d34-62e728f99fd4 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:13.598378 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d927cfdc-3950-4a85-8d34-62e728f99fd4 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8895fd439e9c4a7aabb75e9fb23eb64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3490ae78798d4b97bc4d3376a3ae1526', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:31:13.608257 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d927cfdc-3950-4a85-8d34-62e728f99fd4 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] 10.222.0.20 "GET /compute/v2.1/servers/fd567aaa-ad47-4cdf-b852-6aff41b084e3" status: 200 len: 1584 microversion: 2.1 time: 0.267972 Oct 04 19:31:13.608821 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3613/7240] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:31:13 2022] GET /compute/v2.1/servers/fd567aaa-ad47-4cdf-b852-6aff41b084e3 => generated 1584 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:31:14.635976 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0c557f23-2cf5-4c7d-9d06-d5ceebea8d3a tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:14.636707 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0c557f23-2cf5-4c7d-9d06-d5ceebea8d3a tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] [instance: fd567aaa-ad47-4cdf-b852-6aff41b084e3] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:14.643318 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0c557f23-2cf5-4c7d-9d06-d5ceebea8d3a tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:14.643798 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0c557f23-2cf5-4c7d-9d06-d5ceebea8d3a tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:14.644256 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0c557f23-2cf5-4c7d-9d06-d5ceebea8d3a tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:14.644945 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0c557f23-2cf5-4c7d-9d06-d5ceebea8d3a tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:14.645403 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0c557f23-2cf5-4c7d-9d06-d5ceebea8d3a tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:14.645820 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0c557f23-2cf5-4c7d-9d06-d5ceebea8d3a tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:14.832757 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0c557f23-2cf5-4c7d-9d06-d5ceebea8d3a tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8895fd439e9c4a7aabb75e9fb23eb64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3490ae78798d4b97bc4d3376a3ae1526', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:31:14.840570 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0c557f23-2cf5-4c7d-9d06-d5ceebea8d3a tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] 10.222.0.20 "GET /compute/v2.1/servers/fd567aaa-ad47-4cdf-b852-6aff41b084e3" status: 200 len: 1465 microversion: 2.1 time: 0.209872 Oct 04 19:31:14.841142 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3628/7241] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:31:14 2022] GET /compute/v2.1/servers/fd567aaa-ad47-4cdf-b852-6aff41b084e3 => generated 1465 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:31:15.543668 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-23e2209b-d981-43ee-95ca-ebe9a932edb4 req-134c726f-0b62-47af-8646-6ce2a9fb9659 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd567aaa-ad47-4cdf-b852-6aff41b084e3", "name": "network-vif-deleted", "tag": "f6bd5cca-15dc-42ad-b489-6d66c5560601"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:31:15.553405 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-23e2209b-d981-43ee-95ca-ebe9a932edb4 req-134c726f-0b62-47af-8646-6ce2a9fb9659 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:15.556347 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-23e2209b-d981-43ee-95ca-ebe9a932edb4 req-134c726f-0b62-47af-8646-6ce2a9fb9659 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:15.556347 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-23e2209b-d981-43ee-95ca-ebe9a932edb4 req-134c726f-0b62-47af-8646-6ce2a9fb9659 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:15.565682 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-23e2209b-d981-43ee-95ca-ebe9a932edb4 req-134c726f-0b62-47af-8646-6ce2a9fb9659 service nova] Creating event network-vif-deleted:f6bd5cca-15dc-42ad-b489-6d66c5560601 for instance fd567aaa-ad47-4cdf-b852-6aff41b084e3 on n-h1-850501-14 Oct 04 19:31:15.570783 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-23e2209b-d981-43ee-95ca-ebe9a932edb4 req-134c726f-0b62-47af-8646-6ce2a9fb9659 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031057 Oct 04 19:31:15.571368 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3614/7242] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:31:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:31:15.864948 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1b7a5644-1a41-4ac1-92db-0c9c362544c0 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:15.865571 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1b7a5644-1a41-4ac1-92db-0c9c362544c0 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] [instance: fd567aaa-ad47-4cdf-b852-6aff41b084e3] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:15.872985 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1b7a5644-1a41-4ac1-92db-0c9c362544c0 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:15.873492 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1b7a5644-1a41-4ac1-92db-0c9c362544c0 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:15.873931 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1b7a5644-1a41-4ac1-92db-0c9c362544c0 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:15.874817 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1b7a5644-1a41-4ac1-92db-0c9c362544c0 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:15.875495 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1b7a5644-1a41-4ac1-92db-0c9c362544c0 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:15.876102 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1b7a5644-1a41-4ac1-92db-0c9c362544c0 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:15.944213 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1b7a5644-1a41-4ac1-92db-0c9c362544c0 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8895fd439e9c4a7aabb75e9fb23eb64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3490ae78798d4b97bc4d3376a3ae1526', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:31:15.953356 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1b7a5644-1a41-4ac1-92db-0c9c362544c0 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] 10.222.0.20 "GET /compute/v2.1/servers/fd567aaa-ad47-4cdf-b852-6aff41b084e3" status: 200 len: 1230 microversion: 2.1 time: 0.092391 Oct 04 19:31:15.954209 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3629/7243] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:31:15 2022] GET /compute/v2.1/servers/fd567aaa-ad47-4cdf-b852-6aff41b084e3 => generated 1230 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:31:16.980849 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-93f766f3-d2f9-4199-960d-5b2cd0956e13 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:16.981603 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-93f766f3-d2f9-4199-960d-5b2cd0956e13 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] [instance: fd567aaa-ad47-4cdf-b852-6aff41b084e3] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:16.987856 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-93f766f3-d2f9-4199-960d-5b2cd0956e13 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:16.988395 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-93f766f3-d2f9-4199-960d-5b2cd0956e13 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:16.988852 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-93f766f3-d2f9-4199-960d-5b2cd0956e13 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:16.989563 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-93f766f3-d2f9-4199-960d-5b2cd0956e13 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:16.990035 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-93f766f3-d2f9-4199-960d-5b2cd0956e13 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:16.990478 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-93f766f3-d2f9-4199-960d-5b2cd0956e13 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:17.055333 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-93f766f3-d2f9-4199-960d-5b2cd0956e13 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8895fd439e9c4a7aabb75e9fb23eb64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3490ae78798d4b97bc4d3376a3ae1526', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:31:17.064400 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-93f766f3-d2f9-4199-960d-5b2cd0956e13 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] 10.222.0.20 "GET /compute/v2.1/servers/fd567aaa-ad47-4cdf-b852-6aff41b084e3" status: 200 len: 1230 microversion: 2.1 time: 0.089195 Oct 04 19:31:17.065123 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3615/7244] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:31:16 2022] GET /compute/v2.1/servers/fd567aaa-ad47-4cdf-b852-6aff41b084e3 => generated 1230 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:31:18.087050 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d7433d80-82b1-4621-8813-e41f32469356 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:18.088876 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d7433d80-82b1-4621-8813-e41f32469356 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] [instance: fd567aaa-ad47-4cdf-b852-6aff41b084e3] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:18.097613 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d7433d80-82b1-4621-8813-e41f32469356 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:18.098118 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d7433d80-82b1-4621-8813-e41f32469356 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:18.098587 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d7433d80-82b1-4621-8813-e41f32469356 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:18.099311 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d7433d80-82b1-4621-8813-e41f32469356 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:18.099990 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d7433d80-82b1-4621-8813-e41f32469356 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:18.100668 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d7433d80-82b1-4621-8813-e41f32469356 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:18.171119 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d7433d80-82b1-4621-8813-e41f32469356 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8895fd439e9c4a7aabb75e9fb23eb64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3490ae78798d4b97bc4d3376a3ae1526', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:31:18.181380 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d7433d80-82b1-4621-8813-e41f32469356 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] 10.222.0.20 "GET /compute/v2.1/servers/fd567aaa-ad47-4cdf-b852-6aff41b084e3" status: 200 len: 1230 microversion: 2.1 time: 0.097677 Oct 04 19:31:18.182651 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3630/7245] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:31:18 2022] GET /compute/v2.1/servers/fd567aaa-ad47-4cdf-b852-6aff41b084e3 => generated 1230 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:31:19.205364 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-47c761e5-cadf-49f0-bb2c-485a2295fb58 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:19.205999 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-47c761e5-cadf-49f0-bb2c-485a2295fb58 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] [instance: fd567aaa-ad47-4cdf-b852-6aff41b084e3] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:19.214560 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-47c761e5-cadf-49f0-bb2c-485a2295fb58 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:19.215066 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-47c761e5-cadf-49f0-bb2c-485a2295fb58 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:19.215516 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-47c761e5-cadf-49f0-bb2c-485a2295fb58 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:19.216261 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-47c761e5-cadf-49f0-bb2c-485a2295fb58 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:19.216739 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-47c761e5-cadf-49f0-bb2c-485a2295fb58 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:19.217181 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-47c761e5-cadf-49f0-bb2c-485a2295fb58 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:19.285848 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-47c761e5-cadf-49f0-bb2c-485a2295fb58 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8895fd439e9c4a7aabb75e9fb23eb64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3490ae78798d4b97bc4d3376a3ae1526', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:31:19.295927 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-47c761e5-cadf-49f0-bb2c-485a2295fb58 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] 10.222.0.20 "GET /compute/v2.1/servers/fd567aaa-ad47-4cdf-b852-6aff41b084e3" status: 200 len: 1230 microversion: 2.1 time: 0.094509 Oct 04 19:31:19.296785 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3616/7246] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:31:19 2022] GET /compute/v2.1/servers/fd567aaa-ad47-4cdf-b852-6aff41b084e3 => generated 1230 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:31:20.319898 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d15c14cd-9e21-4b0b-acd6-eaa14a187e6c tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:20.320570 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d15c14cd-9e21-4b0b-acd6-eaa14a187e6c tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] [instance: fd567aaa-ad47-4cdf-b852-6aff41b084e3] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:20.329055 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d15c14cd-9e21-4b0b-acd6-eaa14a187e6c tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:20.329594 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d15c14cd-9e21-4b0b-acd6-eaa14a187e6c tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:20.330032 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d15c14cd-9e21-4b0b-acd6-eaa14a187e6c tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:20.330833 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d15c14cd-9e21-4b0b-acd6-eaa14a187e6c tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:20.331291 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d15c14cd-9e21-4b0b-acd6-eaa14a187e6c tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:20.331708 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d15c14cd-9e21-4b0b-acd6-eaa14a187e6c tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:20.365594 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d15c14cd-9e21-4b0b-acd6-eaa14a187e6c tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:20.366070 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d15c14cd-9e21-4b0b-acd6-eaa14a187e6c tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:20.366503 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d15c14cd-9e21-4b0b-acd6-eaa14a187e6c tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:20.366948 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-d15c14cd-9e21-4b0b-acd6-eaa14a187e6c tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lazy-loading 'fault' on Instance uuid fd567aaa-ad47-4cdf-b852-6aff41b084e3 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:31:20.408046 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d15c14cd-9e21-4b0b-acd6-eaa14a187e6c tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8895fd439e9c4a7aabb75e9fb23eb64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3490ae78798d4b97bc4d3376a3ae1526', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:31:20.415661 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d15c14cd-9e21-4b0b-acd6-eaa14a187e6c tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] 10.222.0.20 "GET /compute/v2.1/servers/fd567aaa-ad47-4cdf-b852-6aff41b084e3" status: 200 len: 1235 microversion: 2.1 time: 0.099544 Oct 04 19:31:20.416320 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3631/7247] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:31:20 2022] GET /compute/v2.1/servers/fd567aaa-ad47-4cdf-b852-6aff41b084e3 => generated 1235 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:31:21.438483 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-bfd4f7f7-9e9e-459a-a1fe-2c1d39c5f799 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:21.439112 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-bfd4f7f7-9e9e-459a-a1fe-2c1d39c5f799 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] [instance: fd567aaa-ad47-4cdf-b852-6aff41b084e3] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:21.445932 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bfd4f7f7-9e9e-459a-a1fe-2c1d39c5f799 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:21.447113 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bfd4f7f7-9e9e-459a-a1fe-2c1d39c5f799 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:21.447564 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bfd4f7f7-9e9e-459a-a1fe-2c1d39c5f799 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:21.448308 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bfd4f7f7-9e9e-459a-a1fe-2c1d39c5f799 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:21.448834 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bfd4f7f7-9e9e-459a-a1fe-2c1d39c5f799 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:21.449224 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bfd4f7f7-9e9e-459a-a1fe-2c1d39c5f799 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:21.462556 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-bfd4f7f7-9e9e-459a-a1fe-2c1d39c5f799 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] HTTP exception thrown: Instance fd567aaa-ad47-4cdf-b852-6aff41b084e3 could not be found. Oct 04 19:31:21.464239 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-bfd4f7f7-9e9e-459a-a1fe-2c1d39c5f799 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Request method failure captured: Oct 04 19:31:21.464239 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/fd567aaa-ad47-4cdf-b852-6aff41b084e3 HTTP/1.1 Oct 04 19:31:21.464239 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 19:31:21.464239 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 19:31:21.464239 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 19:31:21.464239 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 19:31:21.464239 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 19:31:21.464239 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 19:31:21.464239 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 19:31:21.464239 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 19:31:21.464239 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPIkUSxnMawMIXNW1HsDeboKdRGbS14sxxXXK4IWToVtzIMsnS3jrAhBrFwnLLaw-ZV0nSbVo-mnowuFyhiCLhn7uIPZ_leYyItKGOtQ_f6etkgEr7OUFDH5TwiWNE5AokLPYAlwXoKmCkcUd0MyeesazYnsfGMOs3ZOhjRgoktayd7c Oct 04 19:31:21.464239 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 19:31:21.464239 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 19:31:21.464239 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 19:31:21.464239 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 19:31:21.464239 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 19:31:21.464239 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 19:31:21.464239 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 3490ae78798d4b97bc4d3376a3ae1526 Oct 04 19:31:21.464239 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-TestVolumeBackupRestore-203926073 Oct 04 19:31:21.464239 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 19:31:21.464239 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 19:31:21.464239 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3490ae78798d4b97bc4d3376a3ae1526"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3490ae78798d4b97bc4d3376a3ae1526", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3490ae78798d4b97bc4d3376a3ae1526"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3490ae78798d4b97bc4d3376a3ae1526"}]}] Oct 04 19:31:21.464239 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-TestVolumeBackupRestore-203926073 Oct 04 19:31:21.464239 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 3490ae78798d4b97bc4d3376a3ae1526 Oct 04 19:31:21.464239 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-TestVolumeBackupRestore-203926073 Oct 04 19:31:21.464239 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-TestVolumeBackupRestore-203926073-project Oct 04 19:31:21.464239 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 19:31:21.464239 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 19:31:21.464239 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 8895fd439e9c4a7aabb75e9fb23eb64b Oct 04 19:31:21.464239 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-TestVolumeBackupRestore-203926073-project Oct 04 19:31:21.464239 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 19:31:21.464239 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance fd567aaa-ad47-4cdf-b852-6aff41b084e3 could not be found. Oct 04 19:31:21.464239 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'fd567aaa-ad47-4cdf-b852-6aff41b084e3'} Oct 04 19:31:21.464239 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:31:21.464239 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:31:21.464239 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:31:21.464239 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:31:21.464239 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:31:21.464239 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:31:21.464239 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:31:21.464239 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:31:21.464239 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:31:21.464239 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:31:21.464239 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd567aaa-ad47-4cdf-b852-6aff41b084e3 could not be found. Oct 04 19:31:21.464239 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:31:21.464239 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:31:21.464239 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:31:21.464239 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:31:21.464239 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:31:21.464239 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:31:21.464239 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:31:21.464239 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:31:21.464239 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:31:21.464239 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:31:21.464239 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:31:21.464239 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:31:21.464239 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:31:21.464239 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:31:21.464239 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:31:21.464239 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:31:21.464239 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd567aaa-ad47-4cdf-b852-6aff41b084e3 could not be found. Oct 04 19:31:21.464239 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:31:21.464239 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:31:21.464239 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:31:21.468984 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:31:21.468984 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:31:21.468984 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:31:21.468984 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:31:21.468984 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:31:21.468984 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd567aaa-ad47-4cdf-b852-6aff41b084e3 could not be found. Oct 04 19:31:21.468984 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:31:21.468984 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-bfd4f7f7-9e9e-459a-a1fe-2c1d39c5f799 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Returning 404 to user: Instance fd567aaa-ad47-4cdf-b852-6aff41b084e3 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:31:21.468984 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-bfd4f7f7-9e9e-459a-a1fe-2c1d39c5f799 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] 10.222.0.20 "GET /compute/v2.1/servers/fd567aaa-ad47-4cdf-b852-6aff41b084e3" status: 404 len: 111 microversion: 2.1 time: 0.031288 Oct 04 19:31:21.468984 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3617/7248] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:31:21 2022] GET /compute/v2.1/servers/fd567aaa-ad47-4cdf-b852-6aff41b084e3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:31:21.684920 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6479731a-02fa-49e2-b1e8-5cecdecae1f9 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] Calling method '.version_select at 0x7fe253ac3c10>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:21.774599 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6479731a-02fa-49e2-b1e8-5cecdecae1f9 tempest-TestVolumeBackupRestore-203926073 tempest-TestVolumeBackupRestore-203926073-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1848700643" status: 202 len: 0 microversion: 2.1 time: 0.094077 Oct 04 19:31:21.775284 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3632/7249] 10.222.0.20 () {58 vars in 1269 bytes} [Tue Oct 4 19:31:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1848700643 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:31:47.959314 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=12 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:31:47.960237 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=24 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:31:48.069413 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a9c222a4-f4a2-4e7d-ad35-0235bdcaa2ae tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1474028711", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:31:48.125634 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-a9c222a4-f4a2-4e7d-ad35-0235bdcaa2ae tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] validate_networks() for None {{(pid=123002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:31:48.318483 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-a9c222a4-f4a2-4e7d-ad35-0235bdcaa2ae tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:31:48.318924 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-a9c222a4-f4a2-4e7d-ad35-0235bdcaa2ae tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:31:48.319422 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-a9c222a4-f4a2-4e7d-ad35-0235bdcaa2ae tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:31:48.319846 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-a9c222a4-f4a2-4e7d-ad35-0235bdcaa2ae tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:31:48.321484 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-a9c222a4-f4a2-4e7d-ad35-0235bdcaa2ae tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:31:48.330328 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a9c222a4-f4a2-4e7d-ad35-0235bdcaa2ae tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:48.330825 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a9c222a4-f4a2-4e7d-ad35-0235bdcaa2ae tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:48.331274 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a9c222a4-f4a2-4e7d-ad35-0235bdcaa2ae tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:48.332020 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a9c222a4-f4a2-4e7d-ad35-0235bdcaa2ae tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:48.332525 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a9c222a4-f4a2-4e7d-ad35-0235bdcaa2ae tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:48.332969 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a9c222a4-f4a2-4e7d-ad35-0235bdcaa2ae tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:48.352488 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-a9c222a4-f4a2-4e7d-ad35-0235bdcaa2ae tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Getting quotas for project 99846eb96e9f4f20b34043430a5bc001. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:31:48.357743 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-a9c222a4-f4a2-4e7d-ad35-0235bdcaa2ae tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Getting quotas for user e66e3765a2ee466683d53e0bce535179 and project 99846eb96e9f4f20b34043430a5bc001. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:31:48.371174 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a9c222a4-f4a2-4e7d-ad35-0235bdcaa2ae tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Going to run 1 instances... {{(pid=123002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:31:48.373543 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a9c222a4-f4a2-4e7d-ad35-0235bdcaa2ae tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] [instance: 2dff3c1d-00e4-4128-bb38-d1c134301f78] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:31:48.520852 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a9c222a4-f4a2-4e7d-ad35-0235bdcaa2ae tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.567629 Oct 04 19:31:48.521536 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3618/7250] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 19:31:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 569 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:31:48.534576 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e70242c7-3807-458c-b7ff-e02316d1c7cb tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:48.535202 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e70242c7-3807-458c-b7ff-e02316d1c7cb tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] [instance: 2dff3c1d-00e4-4128-bb38-d1c134301f78] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:48.537391 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:31:48.538060 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:31:48.592926 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e70242c7-3807-458c-b7ff-e02316d1c7cb tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66e3765a2ee466683d53e0bce535179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99846eb96e9f4f20b34043430a5bc001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:31:48.600432 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e70242c7-3807-458c-b7ff-e02316d1c7cb tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] 10.222.0.20 "GET /compute/v2.1/servers/2dff3c1d-00e4-4128-bb38-d1c134301f78" status: 200 len: 1222 microversion: 2.1 time: 0.069929 Oct 04 19:31:48.601096 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3633/7251] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:31:48 2022] GET /compute/v2.1/servers/2dff3c1d-00e4-4128-bb38-d1c134301f78 => generated 1222 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:31:49.626063 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-63aa017b-c03c-4f85-b9bd-d251ad8e7040 tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:49.626843 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-63aa017b-c03c-4f85-b9bd-d251ad8e7040 tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] [instance: 2dff3c1d-00e4-4128-bb38-d1c134301f78] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:49.682969 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-63aa017b-c03c-4f85-b9bd-d251ad8e7040 tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66e3765a2ee466683d53e0bce535179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99846eb96e9f4f20b34043430a5bc001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:31:49.690361 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-63aa017b-c03c-4f85-b9bd-d251ad8e7040 tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] 10.222.0.20 "GET /compute/v2.1/servers/2dff3c1d-00e4-4128-bb38-d1c134301f78" status: 200 len: 1222 microversion: 2.1 time: 0.069358 Oct 04 19:31:49.690929 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3619/7252] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:31:49 2022] GET /compute/v2.1/servers/2dff3c1d-00e4-4128-bb38-d1c134301f78 => generated 1222 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:31:50.714576 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-fe8caa9d-00d8-4f13-9cf5-b88787fec757 tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:50.715200 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-fe8caa9d-00d8-4f13-9cf5-b88787fec757 tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] [instance: 2dff3c1d-00e4-4128-bb38-d1c134301f78] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:50.726179 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fe8caa9d-00d8-4f13-9cf5-b88787fec757 tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:50.726179 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fe8caa9d-00d8-4f13-9cf5-b88787fec757 tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:50.726179 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fe8caa9d-00d8-4f13-9cf5-b88787fec757 tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:50.726179 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fe8caa9d-00d8-4f13-9cf5-b88787fec757 tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:50.726179 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fe8caa9d-00d8-4f13-9cf5-b88787fec757 tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:50.726179 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fe8caa9d-00d8-4f13-9cf5-b88787fec757 tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:50.793913 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-fe8caa9d-00d8-4f13-9cf5-b88787fec757 tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66e3765a2ee466683d53e0bce535179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99846eb96e9f4f20b34043430a5bc001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:31:50.801763 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-fe8caa9d-00d8-4f13-9cf5-b88787fec757 tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] 10.222.0.20 "GET /compute/v2.1/servers/2dff3c1d-00e4-4128-bb38-d1c134301f78" status: 200 len: 1274 microversion: 2.1 time: 0.092040 Oct 04 19:31:50.802356 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3634/7253] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:31:50 2022] GET /compute/v2.1/servers/2dff3c1d-00e4-4128-bb38-d1c134301f78 => generated 1274 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:31:51.829225 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ddc91307-a02a-4424-8a93-2ad4c18a629e tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:51.830526 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ddc91307-a02a-4424-8a93-2ad4c18a629e tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] [instance: 2dff3c1d-00e4-4128-bb38-d1c134301f78] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:51.839218 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ddc91307-a02a-4424-8a93-2ad4c18a629e tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:51.840884 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ddc91307-a02a-4424-8a93-2ad4c18a629e tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:51.840884 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ddc91307-a02a-4424-8a93-2ad4c18a629e tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:51.841512 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ddc91307-a02a-4424-8a93-2ad4c18a629e tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:51.842139 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ddc91307-a02a-4424-8a93-2ad4c18a629e tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:51.842746 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ddc91307-a02a-4424-8a93-2ad4c18a629e tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:52.003048 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ddc91307-a02a-4424-8a93-2ad4c18a629e tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66e3765a2ee466683d53e0bce535179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99846eb96e9f4f20b34043430a5bc001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:31:52.011863 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ddc91307-a02a-4424-8a93-2ad4c18a629e tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] 10.222.0.20 "GET /compute/v2.1/servers/2dff3c1d-00e4-4128-bb38-d1c134301f78" status: 200 len: 1322 microversion: 2.1 time: 0.187491 Oct 04 19:31:52.012481 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3620/7254] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:31:51 2022] GET /compute/v2.1/servers/2dff3c1d-00e4-4128-bb38-d1c134301f78 => generated 1322 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:31:52.904367 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-d3d8dce4-1b7a-4505-b0ed-2b547abf5677 req-9168a5cc-c797-41aa-8e3d-ca22df201d62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2dff3c1d-00e4-4128-bb38-d1c134301f78", "tag": "4060a9f6-f370-449a-9ef3-c9c93545436a"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:31:52.917776 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-d3d8dce4-1b7a-4505-b0ed-2b547abf5677 req-9168a5cc-c797-41aa-8e3d-ca22df201d62 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:52.918297 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-d3d8dce4-1b7a-4505-b0ed-2b547abf5677 req-9168a5cc-c797-41aa-8e3d-ca22df201d62 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:52.918789 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-d3d8dce4-1b7a-4505-b0ed-2b547abf5677 req-9168a5cc-c797-41aa-8e3d-ca22df201d62 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:52.930073 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-d3d8dce4-1b7a-4505-b0ed-2b547abf5677 req-9168a5cc-c797-41aa-8e3d-ca22df201d62 service nova] Creating event network-changed:4060a9f6-f370-449a-9ef3-c9c93545436a for instance 2dff3c1d-00e4-4128-bb38-d1c134301f78 on n-h1-850501-14 Oct 04 19:31:52.936455 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-d3d8dce4-1b7a-4505-b0ed-2b547abf5677 req-9168a5cc-c797-41aa-8e3d-ca22df201d62 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036873 Oct 04 19:31:52.937068 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3635/7255] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:31:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:31:53.035015 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-92508aa3-7321-4cb2-a1ba-2eb75bc0e15c tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:53.035711 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-92508aa3-7321-4cb2-a1ba-2eb75bc0e15c tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] [instance: 2dff3c1d-00e4-4128-bb38-d1c134301f78] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:53.042830 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-92508aa3-7321-4cb2-a1ba-2eb75bc0e15c tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:53.043330 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-92508aa3-7321-4cb2-a1ba-2eb75bc0e15c tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:53.043777 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-92508aa3-7321-4cb2-a1ba-2eb75bc0e15c tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:53.044528 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-92508aa3-7321-4cb2-a1ba-2eb75bc0e15c tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:53.045003 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-92508aa3-7321-4cb2-a1ba-2eb75bc0e15c tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:53.045437 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-92508aa3-7321-4cb2-a1ba-2eb75bc0e15c tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:53.229627 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-92508aa3-7321-4cb2-a1ba-2eb75bc0e15c tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66e3765a2ee466683d53e0bce535179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99846eb96e9f4f20b34043430a5bc001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:31:53.238359 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-92508aa3-7321-4cb2-a1ba-2eb75bc0e15c tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] 10.222.0.20 "GET /compute/v2.1/servers/2dff3c1d-00e4-4128-bb38-d1c134301f78" status: 200 len: 1322 microversion: 2.1 time: 0.207177 Oct 04 19:31:53.239135 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3621/7256] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:31:53 2022] GET /compute/v2.1/servers/2dff3c1d-00e4-4128-bb38-d1c134301f78 => generated 1322 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:31:54.264274 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6a0edc28-d6fb-4a51-aff7-90611e3a0eeb tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:54.264974 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6a0edc28-d6fb-4a51-aff7-90611e3a0eeb tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] [instance: 2dff3c1d-00e4-4128-bb38-d1c134301f78] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:54.271019 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6a0edc28-d6fb-4a51-aff7-90611e3a0eeb tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:54.271532 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6a0edc28-d6fb-4a51-aff7-90611e3a0eeb tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:54.272096 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6a0edc28-d6fb-4a51-aff7-90611e3a0eeb tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:54.272784 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6a0edc28-d6fb-4a51-aff7-90611e3a0eeb tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:54.273235 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6a0edc28-d6fb-4a51-aff7-90611e3a0eeb tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:54.273656 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6a0edc28-d6fb-4a51-aff7-90611e3a0eeb tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:54.411837 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6a0edc28-d6fb-4a51-aff7-90611e3a0eeb tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66e3765a2ee466683d53e0bce535179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99846eb96e9f4f20b34043430a5bc001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:31:54.420344 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6a0edc28-d6fb-4a51-aff7-90611e3a0eeb tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] 10.222.0.20 "GET /compute/v2.1/servers/2dff3c1d-00e4-4128-bb38-d1c134301f78" status: 200 len: 1322 microversion: 2.1 time: 0.162005 Oct 04 19:31:54.420911 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3636/7257] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:31:54 2022] GET /compute/v2.1/servers/2dff3c1d-00e4-4128-bb38-d1c134301f78 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:31:55.446004 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-65a241be-7743-4e1e-a355-502b18509b3e tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:55.447239 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-65a241be-7743-4e1e-a355-502b18509b3e tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] [instance: 2dff3c1d-00e4-4128-bb38-d1c134301f78] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:55.454335 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-65a241be-7743-4e1e-a355-502b18509b3e tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:55.454838 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-65a241be-7743-4e1e-a355-502b18509b3e tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:55.455295 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-65a241be-7743-4e1e-a355-502b18509b3e tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:55.456011 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-65a241be-7743-4e1e-a355-502b18509b3e tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:55.456510 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-65a241be-7743-4e1e-a355-502b18509b3e tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:55.456955 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-65a241be-7743-4e1e-a355-502b18509b3e tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:55.587205 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-65a241be-7743-4e1e-a355-502b18509b3e tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66e3765a2ee466683d53e0bce535179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99846eb96e9f4f20b34043430a5bc001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:31:55.596324 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-65a241be-7743-4e1e-a355-502b18509b3e tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] 10.222.0.20 "GET /compute/v2.1/servers/2dff3c1d-00e4-4128-bb38-d1c134301f78" status: 200 len: 1322 microversion: 2.1 time: 0.154205 Oct 04 19:31:55.596912 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3622/7258] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:31:55 2022] GET /compute/v2.1/servers/2dff3c1d-00e4-4128-bb38-d1c134301f78 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:31:56.619911 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0f365fd9-a1ba-4b86-9a36-ad08b28b8e2e tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:56.620893 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0f365fd9-a1ba-4b86-9a36-ad08b28b8e2e tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] [instance: 2dff3c1d-00e4-4128-bb38-d1c134301f78] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:56.627592 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0f365fd9-a1ba-4b86-9a36-ad08b28b8e2e tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:56.628155 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0f365fd9-a1ba-4b86-9a36-ad08b28b8e2e tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:56.628566 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0f365fd9-a1ba-4b86-9a36-ad08b28b8e2e tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:56.629273 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0f365fd9-a1ba-4b86-9a36-ad08b28b8e2e tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:56.630180 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0f365fd9-a1ba-4b86-9a36-ad08b28b8e2e tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:56.630180 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0f365fd9-a1ba-4b86-9a36-ad08b28b8e2e tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:56.766524 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0f365fd9-a1ba-4b86-9a36-ad08b28b8e2e tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66e3765a2ee466683d53e0bce535179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99846eb96e9f4f20b34043430a5bc001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:31:56.774335 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0f365fd9-a1ba-4b86-9a36-ad08b28b8e2e tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] 10.222.0.20 "GET /compute/v2.1/servers/2dff3c1d-00e4-4128-bb38-d1c134301f78" status: 200 len: 1322 microversion: 2.1 time: 0.159299 Oct 04 19:31:56.774903 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3637/7259] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:31:56 2022] GET /compute/v2.1/servers/2dff3c1d-00e4-4128-bb38-d1c134301f78 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:31:57.797797 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-698288e7-8c0e-4b01-9509-b15fec6dcbd1 tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:57.798427 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-698288e7-8c0e-4b01-9509-b15fec6dcbd1 tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] [instance: 2dff3c1d-00e4-4128-bb38-d1c134301f78] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:57.805299 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-698288e7-8c0e-4b01-9509-b15fec6dcbd1 tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:57.805799 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-698288e7-8c0e-4b01-9509-b15fec6dcbd1 tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:57.806253 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-698288e7-8c0e-4b01-9509-b15fec6dcbd1 tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:57.806956 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-698288e7-8c0e-4b01-9509-b15fec6dcbd1 tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:57.807970 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-698288e7-8c0e-4b01-9509-b15fec6dcbd1 tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:57.808940 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-698288e7-8c0e-4b01-9509-b15fec6dcbd1 tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:57.950750 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-698288e7-8c0e-4b01-9509-b15fec6dcbd1 tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66e3765a2ee466683d53e0bce535179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99846eb96e9f4f20b34043430a5bc001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:31:57.958557 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-698288e7-8c0e-4b01-9509-b15fec6dcbd1 tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] 10.222.0.20 "GET /compute/v2.1/servers/2dff3c1d-00e4-4128-bb38-d1c134301f78" status: 200 len: 1322 microversion: 2.1 time: 0.164674 Oct 04 19:31:57.959121 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3623/7260] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:31:57 2022] GET /compute/v2.1/servers/2dff3c1d-00e4-4128-bb38-d1c134301f78 => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:31:58.384495 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-4b5cb239-4382-424a-97e2-21d652c57673 req-061bd9dc-1e73-4633-a64e-32255dce5b7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dff3c1d-00e4-4128-bb38-d1c134301f78", "name": "network-vif-plugged", "status": "completed", "tag": "4060a9f6-f370-449a-9ef3-c9c93545436a"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:31:58.391705 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-4b5cb239-4382-424a-97e2-21d652c57673 req-061bd9dc-1e73-4633-a64e-32255dce5b7e service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:58.392215 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-4b5cb239-4382-424a-97e2-21d652c57673 req-061bd9dc-1e73-4633-a64e-32255dce5b7e service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:58.392646 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-4b5cb239-4382-424a-97e2-21d652c57673 req-061bd9dc-1e73-4633-a64e-32255dce5b7e service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:58.403444 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-4b5cb239-4382-424a-97e2-21d652c57673 req-061bd9dc-1e73-4633-a64e-32255dce5b7e service nova] Creating event network-vif-plugged:4060a9f6-f370-449a-9ef3-c9c93545436a for instance 2dff3c1d-00e4-4128-bb38-d1c134301f78 on n-h1-850501-14 Oct 04 19:31:58.408547 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-4b5cb239-4382-424a-97e2-21d652c57673 req-061bd9dc-1e73-4633-a64e-32255dce5b7e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090366 Oct 04 19:31:58.409157 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3638/7261] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:31:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:31:58.982475 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-908e8ffa-8f37-4df9-bd50-a35d753d9c96 tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:58.983142 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-908e8ffa-8f37-4df9-bd50-a35d753d9c96 tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] [instance: 2dff3c1d-00e4-4128-bb38-d1c134301f78] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:58.985137 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:31:58.990918 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-908e8ffa-8f37-4df9-bd50-a35d753d9c96 tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:58.991449 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-908e8ffa-8f37-4df9-bd50-a35d753d9c96 tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:58.991905 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-908e8ffa-8f37-4df9-bd50-a35d753d9c96 tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:58.992800 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-908e8ffa-8f37-4df9-bd50-a35d753d9c96 tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:58.993278 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-908e8ffa-8f37-4df9-bd50-a35d753d9c96 tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:58.993751 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-908e8ffa-8f37-4df9-bd50-a35d753d9c96 tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:59.128284 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-908e8ffa-8f37-4df9-bd50-a35d753d9c96 tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66e3765a2ee466683d53e0bce535179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99846eb96e9f4f20b34043430a5bc001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:31:59.136822 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-908e8ffa-8f37-4df9-bd50-a35d753d9c96 tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] 10.222.0.20 "GET /compute/v2.1/servers/2dff3c1d-00e4-4128-bb38-d1c134301f78" status: 200 len: 1322 microversion: 2.1 time: 0.158848 Oct 04 19:31:59.137397 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3624/7262] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:31:58 2022] GET /compute/v2.1/servers/2dff3c1d-00e4-4128-bb38-d1c134301f78 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:00.157616 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:32:00.162591 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2f2594db-9087-4ff9-bf90-7e913ac37496 tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:00.163303 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2f2594db-9087-4ff9-bf90-7e913ac37496 tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] [instance: 2dff3c1d-00e4-4128-bb38-d1c134301f78] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:00.170043 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2f2594db-9087-4ff9-bf90-7e913ac37496 tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:00.170528 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2f2594db-9087-4ff9-bf90-7e913ac37496 tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:00.170974 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2f2594db-9087-4ff9-bf90-7e913ac37496 tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:00.171668 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2f2594db-9087-4ff9-bf90-7e913ac37496 tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:00.183638 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2f2594db-9087-4ff9-bf90-7e913ac37496 tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:00.183638 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2f2594db-9087-4ff9-bf90-7e913ac37496 tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:00.308651 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-2f2594db-9087-4ff9-bf90-7e913ac37496 tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66e3765a2ee466683d53e0bce535179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99846eb96e9f4f20b34043430a5bc001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:00.316608 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2f2594db-9087-4ff9-bf90-7e913ac37496 tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] 10.222.0.20 "GET /compute/v2.1/servers/2dff3c1d-00e4-4128-bb38-d1c134301f78" status: 200 len: 1471 microversion: 2.1 time: 0.160042 Oct 04 19:32:00.317200 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3639/7263] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:00 2022] GET /compute/v2.1/servers/2dff3c1d-00e4-4128-bb38-d1c134301f78 => generated 1471 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:00.342998 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=8 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:32:00.392117 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-88ae6204-65c5-435c-b777-5bb5fd268560 tempest-ServersAdminNegativeTestJSON-1731731332 tempest-ServersAdminNegativeTestJSON-1731731332-project-admin] Calling method '.version_select at 0x7fe253a97040>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:00.456537 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-88ae6204-65c5-435c-b777-5bb5fd268560 tempest-ServersAdminNegativeTestJSON-1731731332 tempest-ServersAdminNegativeTestJSON-1731731332-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/dde6de2c3d98463bb602f3a746db8b0f" status: 200 len: 371 microversion: 2.1 time: 0.118625 Oct 04 19:32:00.457134 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3625/7264] 10.222.0.20 () {58 vars in 1242 bytes} [Tue Oct 4 19:32:00 2022] GET /compute/v2.1/os-quota-sets/dde6de2c3d98463bb602f3a746db8b0f => generated 371 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:32:00.470597 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c74316e0-abf4-4df1-be7b-2cd129a93503 tempest-ServersAdminNegativeTestJSON-1731731332 tempest-ServersAdminNegativeTestJSON-1731731332-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-480570593", "id": 1733067522, "os-flavor-access:is_public": "True"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:32:00.542179 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c74316e0-abf4-4df1-be7b-2cd129a93503 tempest-ServersAdminNegativeTestJSON-1731731332 tempest-ServersAdminNegativeTestJSON-1731731332-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.075356 Oct 04 19:32:00.542909 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3640/7265] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 19:32:00 2022] POST /compute/v2.1/flavors => generated 437 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:32:00.555164 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3cdaccd8-5e0f-47a8-9f49-7e7a6371124a tempest-ServersAdminNegativeTestJSON-1731731332 tempest-ServersAdminNegativeTestJSON-1731731332-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1733067522"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:32:00.557735 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3cdaccd8-5e0f-47a8-9f49-7e7a6371124a tempest-ServersAdminNegativeTestJSON-1731731332 tempest-ServersAdminNegativeTestJSON-1731731332-project-admin] [instance: 2dff3c1d-00e4-4128-bb38-d1c134301f78] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:00.563760 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3cdaccd8-5e0f-47a8-9f49-7e7a6371124a tempest-ServersAdminNegativeTestJSON-1731731332 tempest-ServersAdminNegativeTestJSON-1731731332-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:00.564308 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3cdaccd8-5e0f-47a8-9f49-7e7a6371124a tempest-ServersAdminNegativeTestJSON-1731731332 tempest-ServersAdminNegativeTestJSON-1731731332-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:00.564766 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3cdaccd8-5e0f-47a8-9f49-7e7a6371124a tempest-ServersAdminNegativeTestJSON-1731731332 tempest-ServersAdminNegativeTestJSON-1731731332-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:00.565481 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3cdaccd8-5e0f-47a8-9f49-7e7a6371124a tempest-ServersAdminNegativeTestJSON-1731731332 tempest-ServersAdminNegativeTestJSON-1731731332-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:00.565952 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3cdaccd8-5e0f-47a8-9f49-7e7a6371124a tempest-ServersAdminNegativeTestJSON-1731731332 tempest-ServersAdminNegativeTestJSON-1731731332-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:00.566402 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3cdaccd8-5e0f-47a8-9f49-7e7a6371124a tempest-ServersAdminNegativeTestJSON-1731731332 tempest-ServersAdminNegativeTestJSON-1731731332-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:00.656454 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3cdaccd8-5e0f-47a8-9f49-7e7a6371124a tempest-ServersAdminNegativeTestJSON-1731731332 tempest-ServersAdminNegativeTestJSON-1731731332-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'ccad478da50543d3b650116eba49c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde6de2c3d98463bb602f3a746db8b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:00.662694 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3cdaccd8-5e0f-47a8-9f49-7e7a6371124a tempest-ServersAdminNegativeTestJSON-1731731332 tempest-ServersAdminNegativeTestJSON-1731731332-project-admin] [instance: 2dff3c1d-00e4-4128-bb38-d1c134301f78] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-480570593 {{(pid=123002) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 19:32:00.669856 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3cdaccd8-5e0f-47a8-9f49-7e7a6371124a tempest-ServersAdminNegativeTestJSON-1731731332 tempest-ServersAdminNegativeTestJSON-1731731332-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:00.670386 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3cdaccd8-5e0f-47a8-9f49-7e7a6371124a tempest-ServersAdminNegativeTestJSON-1731731332 tempest-ServersAdminNegativeTestJSON-1731731332-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:00.670833 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3cdaccd8-5e0f-47a8-9f49-7e7a6371124a tempest-ServersAdminNegativeTestJSON-1731731332 tempest-ServersAdminNegativeTestJSON-1731731332-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:00.671574 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3cdaccd8-5e0f-47a8-9f49-7e7a6371124a tempest-ServersAdminNegativeTestJSON-1731731332 tempest-ServersAdminNegativeTestJSON-1731731332-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:00.672040 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3cdaccd8-5e0f-47a8-9f49-7e7a6371124a tempest-ServersAdminNegativeTestJSON-1731731332 tempest-ServersAdminNegativeTestJSON-1731731332-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:00.672579 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3cdaccd8-5e0f-47a8-9f49-7e7a6371124a tempest-ServersAdminNegativeTestJSON-1731731332 tempest-ServersAdminNegativeTestJSON-1731731332-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:00.692919 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-3cdaccd8-5e0f-47a8-9f49-7e7a6371124a tempest-ServersAdminNegativeTestJSON-1731731332 tempest-ServersAdminNegativeTestJSON-1731731332-project-admin] Getting quotas for project 99846eb96e9f4f20b34043430a5bc001. Resources: {'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:32:00.698466 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-3cdaccd8-5e0f-47a8-9f49-7e7a6371124a tempest-ServersAdminNegativeTestJSON-1731731332 tempest-ServersAdminNegativeTestJSON-1731731332-project-admin] Getting quotas for user e66e3765a2ee466683d53e0bce535179 and project 99846eb96e9f4f20b34043430a5bc001. Resources: {'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:32:00.710762 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.compute.api [None req-3cdaccd8-5e0f-47a8-9f49-7e7a6371124a tempest-ServersAdminNegativeTestJSON-1731731332 tempest-ServersAdminNegativeTestJSON-1731731332-project-admin] ram quota exceeded for dde6de2c3d98463bb602f3a746db8b0f, tried to resize instance. Oct 04 19:32:00.711329 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-3cdaccd8-5e0f-47a8-9f49-7e7a6371124a tempest-ServersAdminNegativeTestJSON-1731731332 tempest-ServersAdminNegativeTestJSON-1731731332-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 04 19:32:00.722147 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3cdaccd8-5e0f-47a8-9f49-7e7a6371124a tempest-ServersAdminNegativeTestJSON-1731731332 tempest-ServersAdminNegativeTestJSON-1731731332-project-admin] Request method failure captured: Oct 04 19:32:00.722147 n-d-850501-14 devstack@n-api.service[123002]: request: POST /compute/v2.1/servers/2dff3c1d-00e4-4128-bb38-d1c134301f78/action HTTP/1.1 Oct 04 19:32:00.722147 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 19:32:00.722147 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 19:32:00.722147 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 19:32:00.722147 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 39 Oct 04 19:32:00.722147 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 19:32:00.722147 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 19:32:00.722147 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 19:32:00.722147 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 19:32:00.722147 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPIoj5I4Z8iHEC-mZSL6Pe1_ALNsNJVcHTvRG7T87zn-1y9QJNT5IIzqHggRmcoMOw11Rg1t2fkjJcnNaQ9_1a1sIA_wxnIpDy1ioOa-aV5lJSDkmusArs7OVmXCdICpCk_5k-tasllYx20BQXtvMoTJkJspf2s9s5F0YQzF9-HlGsAM Oct 04 19:32:00.722147 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 19:32:00.722147 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 19:32:00.722147 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 19:32:00.722147 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 19:32:00.722147 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 19:32:00.722147 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 19:32:00.722147 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: dde6de2c3d98463bb602f3a746db8b0f Oct 04 19:32:00.722147 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1731731332 Oct 04 19:32:00.722147 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member,admin Oct 04 19:32:00.722147 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member,admin Oct 04 19:32:00.722147 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dde6de2c3d98463bb602f3a746db8b0f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dde6de2c3d98463bb602f3a746db8b0f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dde6de2c3d98463bb602f3a746db8b0f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dde6de2c3d98463bb602f3a746db8b0f"}]}] Oct 04 19:32:00.722147 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1731731332 Oct 04 19:32:00.722147 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: dde6de2c3d98463bb602f3a746db8b0f Oct 04 19:32:00.722147 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1731731332 Oct 04 19:32:00.722147 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServersAdminNegativeTestJSON-1731731332-project-admin Oct 04 19:32:00.722147 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 19:32:00.722147 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 19:32:00.722147 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: ccad478da50543d3b650116eba49c850 Oct 04 19:32:00.722147 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1731731332-project-admin Oct 04 19:32:00.722147 n-d-850501-14 devstack@n-api.service[123002]: Oct 04 19:32:00.722147 n-d-850501-14 devstack@n-api.service[123002]: {"resize": {"flavorRef": "1733067522"}} Oct 04 19:32:00.722147 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 19:32:00.722147 n-d-850501-14 devstack@n-api.service[123002]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 04 19:32:00.722147 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '2dff3c1d-00e4-4128-bb38-d1c134301f78', 'body': {'resize': {'flavorRef': '1733067522'}}} Oct 04 19:32:00.722147 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:32:00.722147 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:32:00.722147 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 04 19:32:00.722147 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 04 19:32:00.722147 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 19:32:00.722147 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 19:32:00.722147 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 04 19:32:00.722147 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc Oct 04 19:32:00.722147 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 04 19:32:00.722147 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 04 19:32:00.722147 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 19:32:00.722147 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 19:32:00.722147 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 04 19:32:00.722147 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 04 19:32:00.722147 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 04 19:32:00.722147 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 04 19:32:00.722147 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 04 19:32:00.722147 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 04 19:32:00.722147 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 04 19:32:00.722147 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:32:00.722147 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:32:00.722147 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:32:00.722147 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:32:00.722147 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 04 19:32:00.722147 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 04 19:32:00.722147 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 04 19:32:00.722147 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 19:32:00.722147 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 04 19:32:00.726746 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 19:32:00.726746 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 19:32:00.726746 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 19:32:00.726746 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 19:32:00.726746 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 19:32:00.726746 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 04 19:32:00.726746 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 19:32:00.726746 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 04 19:32:00.726746 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 19:32:00.726746 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 04 19:32:00.726746 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 04 19:32:00.726746 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 04 19:32:00.726746 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 04 19:32:00.726746 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 04 19:32:00.726746 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:32:00.726746 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:32:00.726746 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:32:00.726746 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:32:00.726746 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:32:00.726746 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:32:00.726746 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:32:00.726746 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:32:00.726746 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:32:00.726746 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:32:00.726746 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 19:32:00.726746 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 19:32:00.726746 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 04 19:32:00.726746 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 04 19:32:00.726746 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 04 19:32:00.726746 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 04 19:32:00.726746 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 04 19:32:00.726746 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:32:00.726746 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:32:00.726746 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:32:00.726746 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:32:00.726746 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:32:00.726746 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:32:00.726746 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:32:00.726746 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:32:00.726746 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 04 19:32:00.726746 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:32:00.726746 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3cdaccd8-5e0f-47a8-9f49-7e7a6371124a tempest-ServersAdminNegativeTestJSON-1731731332 tempest-ServersAdminNegativeTestJSON-1731731332-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:32:00.726746 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3cdaccd8-5e0f-47a8-9f49-7e7a6371124a tempest-ServersAdminNegativeTestJSON-1731731332 tempest-ServersAdminNegativeTestJSON-1731731332-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/2dff3c1d-00e4-4128-bb38-d1c134301f78/action" status: 403 len: 118 microversion: 2.1 time: 0.172377 Oct 04 19:32:00.726746 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3626/7266] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 19:32:00 2022] POST /compute/v2.1/servers/2dff3c1d-00e4-4128-bb38-d1c134301f78/action => generated 118 bytes in 174 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:32:00.732851 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a3f27e4d-1445-4721-bda7-71bb8610c8a8 tempest-ServersAdminNegativeTestJSON-1731731332 tempest-ServersAdminNegativeTestJSON-1731731332-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:00.874746 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a3f27e4d-1445-4721-bda7-71bb8610c8a8 tempest-ServersAdminNegativeTestJSON-1731731332 tempest-ServersAdminNegativeTestJSON-1731731332-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1733067522" status: 202 len: 0 microversion: 2.1 time: 0.145697 Oct 04 19:32:00.875335 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3641/7267] 10.222.0.20 () {58 vars in 1161 bytes} [Tue Oct 4 19:32:00 2022] DELETE /compute/v2.1/flavors/1733067522 => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:32:00.883344 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3bc7e4e8-ec95-420c-9abb-c79c519bca10 tempest-ServersAdminNegativeTestJSON-1731731332 tempest-ServersAdminNegativeTestJSON-1731731332-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:00.905917 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3bc7e4e8-ec95-420c-9abb-c79c519bca10 tempest-ServersAdminNegativeTestJSON-1731731332 tempest-ServersAdminNegativeTestJSON-1731731332-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026210 Oct 04 19:32:00.906483 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3627/7268] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Oct 4 19:32:00 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:00.929600 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0b18dbac-767d-4366-99db-a55bd99f9d3c tempest-ServersAdminNegativeTestJSON-1731731332 tempest-ServersAdminNegativeTestJSON-1731731332-project-admin] Calling method '.version_select at 0x7fe253a64700>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:00.993704 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0b18dbac-767d-4366-99db-a55bd99f9d3c tempest-ServersAdminNegativeTestJSON-1731731332 tempest-ServersAdminNegativeTestJSON-1731731332-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/dde6de2c3d98463bb602f3a746db8b0f" status: 200 len: 371 microversion: 2.1 time: 0.070753 Oct 04 19:32:00.994275 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3642/7269] 10.222.0.20 () {58 vars in 1242 bytes} [Tue Oct 4 19:32:00 2022] GET /compute/v2.1/os-quota-sets/dde6de2c3d98463bb602f3a746db8b0f => generated 371 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:32:01.006444 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-55972ffa-4125-4260-a7f2-9b76165ab343 tempest-ServersAdminNegativeTestJSON-1731731332 tempest-ServersAdminNegativeTestJSON-1731731332-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-2039968469", "id": 1972519652, "os-flavor-access:is_public": "True"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:32:01.092552 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-55972ffa-4125-4260-a7f2-9b76165ab343 tempest-ServersAdminNegativeTestJSON-1731731332 tempest-ServersAdminNegativeTestJSON-1731731332-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.089687 Oct 04 19:32:01.093149 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3628/7270] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 19:32:01 2022] POST /compute/v2.1/flavors => generated 437 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:32:01.105864 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b3b18c2d-d7a3-43bc-9650-8fcea7aa6b66 tempest-ServersAdminNegativeTestJSON-1731731332 tempest-ServersAdminNegativeTestJSON-1731731332-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1972519652"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:32:01.108314 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b3b18c2d-d7a3-43bc-9650-8fcea7aa6b66 tempest-ServersAdminNegativeTestJSON-1731731332 tempest-ServersAdminNegativeTestJSON-1731731332-project-admin] [instance: 2dff3c1d-00e4-4128-bb38-d1c134301f78] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:01.114756 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b3b18c2d-d7a3-43bc-9650-8fcea7aa6b66 tempest-ServersAdminNegativeTestJSON-1731731332 tempest-ServersAdminNegativeTestJSON-1731731332-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:01.115240 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b3b18c2d-d7a3-43bc-9650-8fcea7aa6b66 tempest-ServersAdminNegativeTestJSON-1731731332 tempest-ServersAdminNegativeTestJSON-1731731332-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:01.115676 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b3b18c2d-d7a3-43bc-9650-8fcea7aa6b66 tempest-ServersAdminNegativeTestJSON-1731731332 tempest-ServersAdminNegativeTestJSON-1731731332-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:01.116397 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b3b18c2d-d7a3-43bc-9650-8fcea7aa6b66 tempest-ServersAdminNegativeTestJSON-1731731332 tempest-ServersAdminNegativeTestJSON-1731731332-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:01.116850 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b3b18c2d-d7a3-43bc-9650-8fcea7aa6b66 tempest-ServersAdminNegativeTestJSON-1731731332 tempest-ServersAdminNegativeTestJSON-1731731332-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:01.117308 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b3b18c2d-d7a3-43bc-9650-8fcea7aa6b66 tempest-ServersAdminNegativeTestJSON-1731731332 tempest-ServersAdminNegativeTestJSON-1731731332-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:01.276029 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b3b18c2d-d7a3-43bc-9650-8fcea7aa6b66 tempest-ServersAdminNegativeTestJSON-1731731332 tempest-ServersAdminNegativeTestJSON-1731731332-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'ccad478da50543d3b650116eba49c850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde6de2c3d98463bb602f3a746db8b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:01.282283 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b3b18c2d-d7a3-43bc-9650-8fcea7aa6b66 tempest-ServersAdminNegativeTestJSON-1731731332 tempest-ServersAdminNegativeTestJSON-1731731332-project-admin] [instance: 2dff3c1d-00e4-4128-bb38-d1c134301f78] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-2039968469 {{(pid=123001) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 19:32:01.288869 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b3b18c2d-d7a3-43bc-9650-8fcea7aa6b66 tempest-ServersAdminNegativeTestJSON-1731731332 tempest-ServersAdminNegativeTestJSON-1731731332-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:01.289344 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b3b18c2d-d7a3-43bc-9650-8fcea7aa6b66 tempest-ServersAdminNegativeTestJSON-1731731332 tempest-ServersAdminNegativeTestJSON-1731731332-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:01.289772 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b3b18c2d-d7a3-43bc-9650-8fcea7aa6b66 tempest-ServersAdminNegativeTestJSON-1731731332 tempest-ServersAdminNegativeTestJSON-1731731332-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:01.290487 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b3b18c2d-d7a3-43bc-9650-8fcea7aa6b66 tempest-ServersAdminNegativeTestJSON-1731731332 tempest-ServersAdminNegativeTestJSON-1731731332-project-admin] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:01.290935 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b3b18c2d-d7a3-43bc-9650-8fcea7aa6b66 tempest-ServersAdminNegativeTestJSON-1731731332 tempest-ServersAdminNegativeTestJSON-1731731332-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:01.291355 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b3b18c2d-d7a3-43bc-9650-8fcea7aa6b66 tempest-ServersAdminNegativeTestJSON-1731731332 tempest-ServersAdminNegativeTestJSON-1731731332-project-admin] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:01.321239 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-b3b18c2d-d7a3-43bc-9650-8fcea7aa6b66 tempest-ServersAdminNegativeTestJSON-1731731332 tempest-ServersAdminNegativeTestJSON-1731731332-project-admin] Getting quotas for project 99846eb96e9f4f20b34043430a5bc001. Resources: {'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:32:01.326633 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-b3b18c2d-d7a3-43bc-9650-8fcea7aa6b66 tempest-ServersAdminNegativeTestJSON-1731731332 tempest-ServersAdminNegativeTestJSON-1731731332-project-admin] Getting quotas for user e66e3765a2ee466683d53e0bce535179 and project 99846eb96e9f4f20b34043430a5bc001. Resources: {'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:32:01.338586 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.compute.api [None req-b3b18c2d-d7a3-43bc-9650-8fcea7aa6b66 tempest-ServersAdminNegativeTestJSON-1731731332 tempest-ServersAdminNegativeTestJSON-1731731332-project-admin] cores quota exceeded for dde6de2c3d98463bb602f3a746db8b0f, tried to resize instance. Oct 04 19:32:01.339129 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-b3b18c2d-d7a3-43bc-9650-8fcea7aa6b66 tempest-ServersAdminNegativeTestJSON-1731731332 tempest-ServersAdminNegativeTestJSON-1731731332-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 04 19:32:01.341272 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b3b18c2d-d7a3-43bc-9650-8fcea7aa6b66 tempest-ServersAdminNegativeTestJSON-1731731332 tempest-ServersAdminNegativeTestJSON-1731731332-project-admin] Request method failure captured: Oct 04 19:32:01.341272 n-d-850501-14 devstack@n-api.service[123001]: request: POST /compute/v2.1/servers/2dff3c1d-00e4-4128-bb38-d1c134301f78/action HTTP/1.1 Oct 04 19:32:01.341272 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 19:32:01.341272 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 19:32:01.341272 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 19:32:01.341272 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 39 Oct 04 19:32:01.341272 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 19:32:01.341272 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 19:32:01.341272 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 19:32:01.341272 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 19:32:01.341272 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPIoj5I4Z8iHEC-mZSL6Pe1_ALNsNJVcHTvRG7T87zn-1y9QJNT5IIzqHggRmcoMOw11Rg1t2fkjJcnNaQ9_1a1sIA_wxnIpDy1ioOa-aV5lJSDkmusArs7OVmXCdICpCk_5k-tasllYx20BQXtvMoTJkJspf2s9s5F0YQzF9-HlGsAM Oct 04 19:32:01.341272 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 19:32:01.341272 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 19:32:01.341272 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 19:32:01.341272 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 19:32:01.341272 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 19:32:01.341272 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 19:32:01.341272 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: dde6de2c3d98463bb602f3a746db8b0f Oct 04 19:32:01.341272 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1731731332 Oct 04 19:32:01.341272 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member,admin Oct 04 19:32:01.341272 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member,admin Oct 04 19:32:01.341272 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dde6de2c3d98463bb602f3a746db8b0f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dde6de2c3d98463bb602f3a746db8b0f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dde6de2c3d98463bb602f3a746db8b0f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dde6de2c3d98463bb602f3a746db8b0f"}]}] Oct 04 19:32:01.341272 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1731731332 Oct 04 19:32:01.341272 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: dde6de2c3d98463bb602f3a746db8b0f Oct 04 19:32:01.341272 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1731731332 Oct 04 19:32:01.341272 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ServersAdminNegativeTestJSON-1731731332-project-admin Oct 04 19:32:01.341272 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 19:32:01.341272 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 19:32:01.341272 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: ccad478da50543d3b650116eba49c850 Oct 04 19:32:01.341272 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1731731332-project-admin Oct 04 19:32:01.341272 n-d-850501-14 devstack@n-api.service[123001]: Oct 04 19:32:01.341272 n-d-850501-14 devstack@n-api.service[123001]: {"resize": {"flavorRef": "1972519652"}} Oct 04 19:32:01.341272 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 19:32:01.341272 n-d-850501-14 devstack@n-api.service[123001]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 04 19:32:01.341272 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '2dff3c1d-00e4-4128-bb38-d1c134301f78', 'body': {'resize': {'flavorRef': '1972519652'}}} Oct 04 19:32:01.341272 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:32:01.341272 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:32:01.341272 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 04 19:32:01.341272 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 04 19:32:01.341272 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 19:32:01.341272 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 19:32:01.341272 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 04 19:32:01.341272 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc Oct 04 19:32:01.341272 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 04 19:32:01.341272 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 04 19:32:01.341272 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 19:32:01.341272 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 19:32:01.341272 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 04 19:32:01.341272 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 04 19:32:01.341272 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 04 19:32:01.341272 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 04 19:32:01.341272 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 04 19:32:01.341272 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 04 19:32:01.341272 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 04 19:32:01.341272 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:32:01.341272 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:32:01.341272 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:32:01.341272 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:32:01.341272 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 04 19:32:01.341272 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 04 19:32:01.341272 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 04 19:32:01.341272 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 19:32:01.341272 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 04 19:32:01.346124 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 19:32:01.346124 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 19:32:01.346124 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 19:32:01.346124 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 19:32:01.346124 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 19:32:01.346124 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 04 19:32:01.346124 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 19:32:01.346124 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 04 19:32:01.346124 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 19:32:01.346124 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 04 19:32:01.346124 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 04 19:32:01.346124 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 04 19:32:01.346124 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 04 19:32:01.346124 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 04 19:32:01.346124 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:32:01.346124 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:32:01.346124 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:32:01.346124 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:32:01.346124 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:32:01.346124 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:32:01.346124 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:32:01.346124 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:32:01.346124 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:32:01.346124 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:32:01.346124 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 19:32:01.346124 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 19:32:01.346124 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 04 19:32:01.346124 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 04 19:32:01.346124 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 04 19:32:01.346124 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 04 19:32:01.346124 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 04 19:32:01.346124 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:32:01.346124 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:32:01.346124 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:32:01.346124 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:32:01.346124 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:32:01.346124 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:32:01.346124 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:32:01.346124 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:32:01.346124 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 04 19:32:01.346124 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:32:01.346124 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b3b18c2d-d7a3-43bc-9650-8fcea7aa6b66 tempest-ServersAdminNegativeTestJSON-1731731332 tempest-ServersAdminNegativeTestJSON-1731731332-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:32:01.346124 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b3b18c2d-d7a3-43bc-9650-8fcea7aa6b66 tempest-ServersAdminNegativeTestJSON-1731731332 tempest-ServersAdminNegativeTestJSON-1731731332-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/2dff3c1d-00e4-4128-bb38-d1c134301f78/action" status: 403 len: 113 microversion: 2.1 time: 0.240977 Oct 04 19:32:01.346124 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3643/7271] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 19:32:01 2022] POST /compute/v2.1/servers/2dff3c1d-00e4-4128-bb38-d1c134301f78/action => generated 113 bytes in 242 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:32:01.351631 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e11e4eaf-5962-4e49-add0-7651b5cc2116 tempest-ServersAdminNegativeTestJSON-1731731332 tempest-ServersAdminNegativeTestJSON-1731731332-project-admin] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:01.435543 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e11e4eaf-5962-4e49-add0-7651b5cc2116 tempest-ServersAdminNegativeTestJSON-1731731332 tempest-ServersAdminNegativeTestJSON-1731731332-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1972519652" status: 202 len: 0 microversion: 2.1 time: 0.087572 Oct 04 19:32:01.436133 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3629/7272] 10.222.0.20 () {58 vars in 1161 bytes} [Tue Oct 4 19:32:01 2022] DELETE /compute/v2.1/flavors/1972519652 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:32:01.444273 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b67425d9-6d86-4362-9fed-a0813535e154 tempest-ServersAdminNegativeTestJSON-1731731332 tempest-ServersAdminNegativeTestJSON-1731731332-project-admin] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:01.464479 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b67425d9-6d86-4362-9fed-a0813535e154 tempest-ServersAdminNegativeTestJSON-1731731332 tempest-ServersAdminNegativeTestJSON-1731731332-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023753 Oct 04 19:32:01.465050 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3644/7273] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Oct 4 19:32:01 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:01.486410 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c3156457-7256-4727-8532-106564a8fe83 tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:01.486919 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c3156457-7256-4727-8532-106564a8fe83 tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] [instance: 2dff3c1d-00e4-4128-bb38-d1c134301f78] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:01.492880 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c3156457-7256-4727-8532-106564a8fe83 tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:01.493375 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c3156457-7256-4727-8532-106564a8fe83 tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:01.493820 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c3156457-7256-4727-8532-106564a8fe83 tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:01.494513 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c3156457-7256-4727-8532-106564a8fe83 tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:01.495703 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c3156457-7256-4727-8532-106564a8fe83 tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:01.496170 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c3156457-7256-4727-8532-106564a8fe83 tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:01.520932 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c3156457-7256-4727-8532-106564a8fe83 tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] [instance: 2dff3c1d-00e4-4128-bb38-d1c134301f78] Going to try to terminate instance {{(pid=123002) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:32:01.799226 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c3156457-7256-4727-8532-106564a8fe83 tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2dff3c1d-00e4-4128-bb38-d1c134301f78" status: 204 len: 0 microversion: 2.1 time: 0.316347 Oct 04 19:32:01.799828 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3630/7274] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 19:32:01 2022] DELETE /compute/v2.1/servers/2dff3c1d-00e4-4128-bb38-d1c134301f78 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:32:01.808146 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5867f3ee-4203-42cb-8520-d0dd3a70f916 tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:01.808775 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5867f3ee-4203-42cb-8520-d0dd3a70f916 tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] [instance: 2dff3c1d-00e4-4128-bb38-d1c134301f78] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:01.814845 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5867f3ee-4203-42cb-8520-d0dd3a70f916 tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:01.820406 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5867f3ee-4203-42cb-8520-d0dd3a70f916 tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:01.820406 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5867f3ee-4203-42cb-8520-d0dd3a70f916 tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:01.820406 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5867f3ee-4203-42cb-8520-d0dd3a70f916 tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:01.820406 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5867f3ee-4203-42cb-8520-d0dd3a70f916 tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:01.820406 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5867f3ee-4203-42cb-8520-d0dd3a70f916 tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:01.950668 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5867f3ee-4203-42cb-8520-d0dd3a70f916 tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66e3765a2ee466683d53e0bce535179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99846eb96e9f4f20b34043430a5bc001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:01.958500 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5867f3ee-4203-42cb-8520-d0dd3a70f916 tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] 10.222.0.20 "GET /compute/v2.1/servers/2dff3c1d-00e4-4128-bb38-d1c134301f78" status: 200 len: 1477 microversion: 2.1 time: 0.154500 Oct 04 19:32:01.959071 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3645/7275] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:01 2022] GET /compute/v2.1/servers/2dff3c1d-00e4-4128-bb38-d1c134301f78 => generated 1477 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:02.984341 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b84f8cbd-98cb-4fa9-8fe7-4891a5cbeb55 tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:02.984978 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b84f8cbd-98cb-4fa9-8fe7-4891a5cbeb55 tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] [instance: 2dff3c1d-00e4-4128-bb38-d1c134301f78] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:02.992016 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b84f8cbd-98cb-4fa9-8fe7-4891a5cbeb55 tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:02.992555 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b84f8cbd-98cb-4fa9-8fe7-4891a5cbeb55 tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:02.993011 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b84f8cbd-98cb-4fa9-8fe7-4891a5cbeb55 tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:02.993826 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b84f8cbd-98cb-4fa9-8fe7-4891a5cbeb55 tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:02.994344 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b84f8cbd-98cb-4fa9-8fe7-4891a5cbeb55 tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:02.994786 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b84f8cbd-98cb-4fa9-8fe7-4891a5cbeb55 tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:03.159512 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b84f8cbd-98cb-4fa9-8fe7-4891a5cbeb55 tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66e3765a2ee466683d53e0bce535179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99846eb96e9f4f20b34043430a5bc001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:03.167388 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b84f8cbd-98cb-4fa9-8fe7-4891a5cbeb55 tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] 10.222.0.20 "GET /compute/v2.1/servers/2dff3c1d-00e4-4128-bb38-d1c134301f78" status: 200 len: 1477 microversion: 2.1 time: 0.188537 Oct 04 19:32:03.168103 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3631/7276] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:02 2022] GET /compute/v2.1/servers/2dff3c1d-00e4-4128-bb38-d1c134301f78 => generated 1477 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:03.726610 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-7a609885-5167-4331-846b-f93eccce8aef req-98200f79-81a6-467b-bb18-e5baae37d1db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dff3c1d-00e4-4128-bb38-d1c134301f78", "name": "network-vif-deleted", "tag": "4060a9f6-f370-449a-9ef3-c9c93545436a"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:32:03.736857 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-7a609885-5167-4331-846b-f93eccce8aef req-98200f79-81a6-467b-bb18-e5baae37d1db service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:03.737340 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-7a609885-5167-4331-846b-f93eccce8aef req-98200f79-81a6-467b-bb18-e5baae37d1db service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:03.737769 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-7a609885-5167-4331-846b-f93eccce8aef req-98200f79-81a6-467b-bb18-e5baae37d1db service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:03.749970 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-7a609885-5167-4331-846b-f93eccce8aef req-98200f79-81a6-467b-bb18-e5baae37d1db service nova] Creating event network-vif-deleted:4060a9f6-f370-449a-9ef3-c9c93545436a for instance 2dff3c1d-00e4-4128-bb38-d1c134301f78 on n-h1-850501-14 Oct 04 19:32:03.755863 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-7a609885-5167-4331-846b-f93eccce8aef req-98200f79-81a6-467b-bb18-e5baae37d1db service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096339 Oct 04 19:32:03.756535 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3646/7277] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:32:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:32:04.190181 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9e494119-f346-4cef-ba7f-d2b6fd7d1ffa tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:04.190821 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9e494119-f346-4cef-ba7f-d2b6fd7d1ffa tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] [instance: 2dff3c1d-00e4-4128-bb38-d1c134301f78] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:04.197870 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9e494119-f346-4cef-ba7f-d2b6fd7d1ffa tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:04.198339 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9e494119-f346-4cef-ba7f-d2b6fd7d1ffa tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:04.198826 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9e494119-f346-4cef-ba7f-d2b6fd7d1ffa tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:04.199530 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9e494119-f346-4cef-ba7f-d2b6fd7d1ffa tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:04.200004 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9e494119-f346-4cef-ba7f-d2b6fd7d1ffa tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:04.200495 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9e494119-f346-4cef-ba7f-d2b6fd7d1ffa tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:04.233177 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9e494119-f346-4cef-ba7f-d2b6fd7d1ffa tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:04.233663 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9e494119-f346-4cef-ba7f-d2b6fd7d1ffa tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:04.234119 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9e494119-f346-4cef-ba7f-d2b6fd7d1ffa tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:04.234585 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-9e494119-f346-4cef-ba7f-d2b6fd7d1ffa tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Lazy-loading 'fault' on Instance uuid 2dff3c1d-00e4-4128-bb38-d1c134301f78 {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:32:04.274964 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9e494119-f346-4cef-ba7f-d2b6fd7d1ffa tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e66e3765a2ee466683d53e0bce535179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99846eb96e9f4f20b34043430a5bc001', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:04.283210 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9e494119-f346-4cef-ba7f-d2b6fd7d1ffa tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] 10.222.0.20 "GET /compute/v2.1/servers/2dff3c1d-00e4-4128-bb38-d1c134301f78" status: 200 len: 1312 microversion: 2.1 time: 0.097032 Oct 04 19:32:04.283786 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3632/7278] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:04 2022] GET /compute/v2.1/servers/2dff3c1d-00e4-4128-bb38-d1c134301f78 => generated 1312 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:05.307187 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ee136b28-c64a-42d3-a09c-19ab3afbf4ad tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:05.307886 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ee136b28-c64a-42d3-a09c-19ab3afbf4ad tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] [instance: 2dff3c1d-00e4-4128-bb38-d1c134301f78] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:05.315618 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ee136b28-c64a-42d3-a09c-19ab3afbf4ad tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:05.316119 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ee136b28-c64a-42d3-a09c-19ab3afbf4ad tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:05.316556 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ee136b28-c64a-42d3-a09c-19ab3afbf4ad tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:05.317245 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ee136b28-c64a-42d3-a09c-19ab3afbf4ad tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:05.317694 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ee136b28-c64a-42d3-a09c-19ab3afbf4ad tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:05.318117 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ee136b28-c64a-42d3-a09c-19ab3afbf4ad tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:05.332461 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-ee136b28-c64a-42d3-a09c-19ab3afbf4ad tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] HTTP exception thrown: Instance 2dff3c1d-00e4-4128-bb38-d1c134301f78 could not be found. Oct 04 19:32:05.334149 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ee136b28-c64a-42d3-a09c-19ab3afbf4ad tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Request method failure captured: Oct 04 19:32:05.334149 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/2dff3c1d-00e4-4128-bb38-d1c134301f78 HTTP/1.1 Oct 04 19:32:05.334149 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 19:32:05.334149 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 19:32:05.334149 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 19:32:05.334149 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 19:32:05.334149 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 19:32:05.334149 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 19:32:05.334149 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 19:32:05.334149 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 19:32:05.334149 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPIojIkkyQQdwT0-HXe3vZHUKshoDG-wzFyc-Gz9Fz1nIbOBrgY6GXLjBM-4EuNPtPmkRWYU1ywFqI6InMVRbg9BQbWQOhZrpQTOJf4DcbnY4hsX6ed1wPT1YBkwO0O0l0F-Gkgd5fjbXd9dpzJ1g4XsSRVlJsFhh28yeCPTW-uyVxTg Oct 04 19:32:05.334149 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 19:32:05.334149 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 19:32:05.334149 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 19:32:05.334149 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 19:32:05.334149 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 19:32:05.334149 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 19:32:05.334149 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 99846eb96e9f4f20b34043430a5bc001 Oct 04 19:32:05.334149 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-843978286 Oct 04 19:32:05.334149 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 19:32:05.334149 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 19:32:05.334149 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/99846eb96e9f4f20b34043430a5bc001"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_99846eb96e9f4f20b34043430a5bc001", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/99846eb96e9f4f20b34043430a5bc001"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/99846eb96e9f4f20b34043430a5bc001"}]}] Oct 04 19:32:05.334149 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ServersAdminNegativeTestJSON-843978286 Oct 04 19:32:05.334149 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 99846eb96e9f4f20b34043430a5bc001 Oct 04 19:32:05.334149 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-843978286 Oct 04 19:32:05.334149 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ServersAdminNegativeTestJSON-843978286-project Oct 04 19:32:05.334149 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 19:32:05.334149 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 19:32:05.334149 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: e66e3765a2ee466683d53e0bce535179 Oct 04 19:32:05.334149 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ServersAdminNegativeTestJSON-843978286-project Oct 04 19:32:05.334149 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 19:32:05.334149 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 2dff3c1d-00e4-4128-bb38-d1c134301f78 could not be found. Oct 04 19:32:05.334149 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '2dff3c1d-00e4-4128-bb38-d1c134301f78'} Oct 04 19:32:05.334149 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:32:05.334149 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:32:05.334149 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:32:05.334149 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:32:05.334149 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:32:05.334149 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:32:05.334149 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:32:05.334149 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:32:05.334149 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:32:05.334149 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:32:05.334149 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2dff3c1d-00e4-4128-bb38-d1c134301f78 could not be found. Oct 04 19:32:05.334149 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:32:05.334149 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:32:05.334149 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:32:05.334149 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:32:05.334149 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:32:05.334149 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:32:05.334149 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:32:05.334149 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:32:05.334149 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:32:05.334149 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:32:05.334149 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:32:05.334149 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:32:05.334149 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:32:05.334149 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:32:05.334149 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:32:05.334149 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:32:05.334149 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2dff3c1d-00e4-4128-bb38-d1c134301f78 could not be found. Oct 04 19:32:05.334149 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:32:05.334149 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:32:05.343519 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:32:05.343519 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:32:05.343519 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:32:05.343519 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:32:05.343519 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:32:05.343519 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:32:05.343519 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2dff3c1d-00e4-4128-bb38-d1c134301f78 could not be found. Oct 04 19:32:05.343519 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:32:05.343519 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ee136b28-c64a-42d3-a09c-19ab3afbf4ad tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] Returning 404 to user: Instance 2dff3c1d-00e4-4128-bb38-d1c134301f78 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:32:05.343519 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ee136b28-c64a-42d3-a09c-19ab3afbf4ad tempest-ServersAdminNegativeTestJSON-843978286 tempest-ServersAdminNegativeTestJSON-843978286-project] 10.222.0.20 "GET /compute/v2.1/servers/2dff3c1d-00e4-4128-bb38-d1c134301f78" status: 404 len: 111 microversion: 2.1 time: 0.032552 Oct 04 19:32:05.343519 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3647/7279] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:05 2022] GET /compute/v2.1/servers/2dff3c1d-00e4-4128-bb38-d1c134301f78 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:32:14.621536 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:32:14.622367 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=3 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:32:14.623280 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:32:14.624091 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:32:14.745436 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f128cc04-f114-4d83-8589-bbe61fc12301 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1386012001", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": [{"uuid": "af56fd9c-9b0f-4ba6-b871-dc69df3da4ac"}]}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:32:14.812079 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-f128cc04-f114-4d83-8589-bbe61fc12301 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] validate_networks() for [('af56fd9c-9b0f-4ba6-b871-dc69df3da4ac', None, None, None, None, None)] {{(pid=123002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:32:15.196189 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-f128cc04-f114-4d83-8589-bbe61fc12301 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:32:15.196823 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-f128cc04-f114-4d83-8589-bbe61fc12301 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:32:15.197327 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-f128cc04-f114-4d83-8589-bbe61fc12301 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:32:15.197763 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-f128cc04-f114-4d83-8589-bbe61fc12301 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:32:15.198198 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-f128cc04-f114-4d83-8589-bbe61fc12301 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:32:15.208459 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f128cc04-f114-4d83-8589-bbe61fc12301 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:15.210216 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f128cc04-f114-4d83-8589-bbe61fc12301 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:15.210216 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f128cc04-f114-4d83-8589-bbe61fc12301 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:15.210216 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f128cc04-f114-4d83-8589-bbe61fc12301 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:15.210731 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f128cc04-f114-4d83-8589-bbe61fc12301 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:15.211183 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f128cc04-f114-4d83-8589-bbe61fc12301 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:15.229801 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-f128cc04-f114-4d83-8589-bbe61fc12301 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Getting quotas for project 0a290c8241f64ad4bde2d3027f1f880a. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:32:15.236088 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-f128cc04-f114-4d83-8589-bbe61fc12301 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Getting quotas for user 853edbd2be6744118e1f54842bd6d94d and project 0a290c8241f64ad4bde2d3027f1f880a. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:32:15.248700 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f128cc04-f114-4d83-8589-bbe61fc12301 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Going to run 1 instances... {{(pid=123002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:32:15.251093 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f128cc04-f114-4d83-8589-bbe61fc12301 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] [instance: 409594a8-f4cb-4da6-8c19-85ab4dbb09c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:32:15.392502 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f128cc04-f114-4d83-8589-bbe61fc12301 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.776822 Oct 04 19:32:15.393778 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3633/7280] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 19:32:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 779 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:32:15.406244 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1e0485cd-6b2b-4dc9-88a8-d61af24215db tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:15.406877 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1e0485cd-6b2b-4dc9-88a8-d61af24215db tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] [instance: 409594a8-f4cb-4da6-8c19-85ab4dbb09c4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:15.409137 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:32:15.410220 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=3 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:32:15.410699 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=1,nova_api:DELETE=3 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:32:15.411344 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=51 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:32:15.463810 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1e0485cd-6b2b-4dc9-88a8-d61af24215db tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853edbd2be6744118e1f54842bd6d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a290c8241f64ad4bde2d3027f1f880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:15.472046 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1e0485cd-6b2b-4dc9-88a8-d61af24215db tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] 10.222.0.20 "GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4" status: 200 len: 1215 microversion: 2.1 time: 0.070727 Oct 04 19:32:15.474037 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3648/7281] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:15 2022] GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4 => generated 1215 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:16.497959 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-982e2031-c6a5-4fbb-9363-9c856c008d03 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:16.498606 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-982e2031-c6a5-4fbb-9363-9c856c008d03 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] [instance: 409594a8-f4cb-4da6-8c19-85ab4dbb09c4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:16.558941 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-982e2031-c6a5-4fbb-9363-9c856c008d03 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853edbd2be6744118e1f54842bd6d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a290c8241f64ad4bde2d3027f1f880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:16.566718 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-982e2031-c6a5-4fbb-9363-9c856c008d03 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] 10.222.0.20 "GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4" status: 200 len: 1215 microversion: 2.1 time: 0.075159 Oct 04 19:32:16.567676 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3634/7282] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:16 2022] GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4 => generated 1215 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:17.592351 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-31cedbbc-1054-4067-a9e5-ec9590c93081 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:17.593035 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-31cedbbc-1054-4067-a9e5-ec9590c93081 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] [instance: 409594a8-f4cb-4da6-8c19-85ab4dbb09c4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:17.657224 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-31cedbbc-1054-4067-a9e5-ec9590c93081 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853edbd2be6744118e1f54842bd6d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a290c8241f64ad4bde2d3027f1f880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:17.665509 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-31cedbbc-1054-4067-a9e5-ec9590c93081 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] 10.222.0.20 "GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4" status: 200 len: 1215 microversion: 2.1 time: 0.078782 Oct 04 19:32:17.666147 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3649/7283] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:17 2022] GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4 => generated 1215 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:18.691636 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5eb1aa37-4d3f-4dcc-97a2-8beda5fab5ea tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:18.692784 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5eb1aa37-4d3f-4dcc-97a2-8beda5fab5ea tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] [instance: 409594a8-f4cb-4da6-8c19-85ab4dbb09c4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:18.755708 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5eb1aa37-4d3f-4dcc-97a2-8beda5fab5ea tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853edbd2be6744118e1f54842bd6d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a290c8241f64ad4bde2d3027f1f880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:18.763540 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5eb1aa37-4d3f-4dcc-97a2-8beda5fab5ea tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] 10.222.0.20 "GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4" status: 200 len: 1215 microversion: 2.1 time: 0.076628 Oct 04 19:32:18.764167 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3635/7284] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:18 2022] GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4 => generated 1215 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:19.789126 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-726af6ca-8eac-4c47-99e6-0dd8932a7563 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:19.789773 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-726af6ca-8eac-4c47-99e6-0dd8932a7563 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] [instance: 409594a8-f4cb-4da6-8c19-85ab4dbb09c4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:19.797521 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-726af6ca-8eac-4c47-99e6-0dd8932a7563 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:19.798024 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-726af6ca-8eac-4c47-99e6-0dd8932a7563 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:19.798450 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-726af6ca-8eac-4c47-99e6-0dd8932a7563 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:19.799149 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-726af6ca-8eac-4c47-99e6-0dd8932a7563 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:19.799609 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-726af6ca-8eac-4c47-99e6-0dd8932a7563 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:19.800038 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-726af6ca-8eac-4c47-99e6-0dd8932a7563 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:20.125014 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-726af6ca-8eac-4c47-99e6-0dd8932a7563 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853edbd2be6744118e1f54842bd6d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a290c8241f64ad4bde2d3027f1f880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:20.130743 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-726af6ca-8eac-4c47-99e6-0dd8932a7563 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] 10.222.0.20 "GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4" status: 200 len: 1219 microversion: 2.1 time: 0.346968 Oct 04 19:32:20.131321 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3650/7285] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:19 2022] GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4 => generated 1219 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:21.154187 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-164a2d0b-cfe3-45b2-b2c3-f6abc36391c5 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:21.154809 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-164a2d0b-cfe3-45b2-b2c3-f6abc36391c5 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] [instance: 409594a8-f4cb-4da6-8c19-85ab4dbb09c4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:21.165800 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-164a2d0b-cfe3-45b2-b2c3-f6abc36391c5 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:21.166298 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-164a2d0b-cfe3-45b2-b2c3-f6abc36391c5 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:21.166743 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-164a2d0b-cfe3-45b2-b2c3-f6abc36391c5 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:21.167477 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-164a2d0b-cfe3-45b2-b2c3-f6abc36391c5 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:21.167944 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-164a2d0b-cfe3-45b2-b2c3-f6abc36391c5 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:21.168409 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-164a2d0b-cfe3-45b2-b2c3-f6abc36391c5 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:21.230104 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-164a2d0b-cfe3-45b2-b2c3-f6abc36391c5 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853edbd2be6744118e1f54842bd6d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a290c8241f64ad4bde2d3027f1f880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:21.237903 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-164a2d0b-cfe3-45b2-b2c3-f6abc36391c5 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] 10.222.0.20 "GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4" status: 200 len: 1211 microversion: 2.1 time: 0.087745 Oct 04 19:32:21.238494 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3636/7286] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:21 2022] GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4 => generated 1211 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:22.260948 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-edaf7f63-d661-4941-90a7-098842c18eb5 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:22.261562 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-edaf7f63-d661-4941-90a7-098842c18eb5 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] [instance: 409594a8-f4cb-4da6-8c19-85ab4dbb09c4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:22.269101 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-edaf7f63-d661-4941-90a7-098842c18eb5 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:22.269588 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-edaf7f63-d661-4941-90a7-098842c18eb5 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:22.270029 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-edaf7f63-d661-4941-90a7-098842c18eb5 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:22.270807 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-edaf7f63-d661-4941-90a7-098842c18eb5 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:22.271382 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-edaf7f63-d661-4941-90a7-098842c18eb5 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:22.271820 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-edaf7f63-d661-4941-90a7-098842c18eb5 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:22.345768 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-edaf7f63-d661-4941-90a7-098842c18eb5 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853edbd2be6744118e1f54842bd6d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a290c8241f64ad4bde2d3027f1f880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:22.353854 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-edaf7f63-d661-4941-90a7-098842c18eb5 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] 10.222.0.20 "GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4" status: 200 len: 1285 microversion: 2.1 time: 0.096809 Oct 04 19:32:22.354422 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3651/7287] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:22 2022] GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4 => generated 1285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:23.379392 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-51b65a58-0457-4556-8f3c-b1b2bd69d7b0 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:23.380045 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-51b65a58-0457-4556-8f3c-b1b2bd69d7b0 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] [instance: 409594a8-f4cb-4da6-8c19-85ab4dbb09c4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:23.387207 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-51b65a58-0457-4556-8f3c-b1b2bd69d7b0 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:23.388441 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-51b65a58-0457-4556-8f3c-b1b2bd69d7b0 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:23.388920 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-51b65a58-0457-4556-8f3c-b1b2bd69d7b0 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:23.389658 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-51b65a58-0457-4556-8f3c-b1b2bd69d7b0 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:23.390177 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-51b65a58-0457-4556-8f3c-b1b2bd69d7b0 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:23.390640 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-51b65a58-0457-4556-8f3c-b1b2bd69d7b0 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:23.587200 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-51b65a58-0457-4556-8f3c-b1b2bd69d7b0 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853edbd2be6744118e1f54842bd6d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a290c8241f64ad4bde2d3027f1f880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:23.596252 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-51b65a58-0457-4556-8f3c-b1b2bd69d7b0 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] 10.222.0.20 "GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4" status: 200 len: 1315 microversion: 2.1 time: 0.220744 Oct 04 19:32:23.596825 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3637/7288] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:23 2022] GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4 => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:23.932006 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-a76aab84-c1c3-4b67-a7d1-3da8cd986bc2 req-7e6a375f-653e-46d8-bc32-d61244af4aaf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "409594a8-f4cb-4da6-8c19-85ab4dbb09c4", "tag": "e7ab6992-880f-4927-bb9a-1723dd8cb0a8"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:32:23.944644 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-a76aab84-c1c3-4b67-a7d1-3da8cd986bc2 req-7e6a375f-653e-46d8-bc32-d61244af4aaf service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:23.945386 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-a76aab84-c1c3-4b67-a7d1-3da8cd986bc2 req-7e6a375f-653e-46d8-bc32-d61244af4aaf service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:23.946034 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-a76aab84-c1c3-4b67-a7d1-3da8cd986bc2 req-7e6a375f-653e-46d8-bc32-d61244af4aaf service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:23.958583 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-a76aab84-c1c3-4b67-a7d1-3da8cd986bc2 req-7e6a375f-653e-46d8-bc32-d61244af4aaf service nova] Creating event network-changed:e7ab6992-880f-4927-bb9a-1723dd8cb0a8 for instance 409594a8-f4cb-4da6-8c19-85ab4dbb09c4 on n-h1-850501-14 Oct 04 19:32:23.963900 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-a76aab84-c1c3-4b67-a7d1-3da8cd986bc2 req-7e6a375f-653e-46d8-bc32-d61244af4aaf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035482 Oct 04 19:32:23.964551 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3652/7289] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:32:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:32:24.621340 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f81e1e90-3b62-49d9-b345-91ddffd27c1b tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:24.622605 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f81e1e90-3b62-49d9-b345-91ddffd27c1b tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] [instance: 409594a8-f4cb-4da6-8c19-85ab4dbb09c4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:24.629565 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f81e1e90-3b62-49d9-b345-91ddffd27c1b tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:24.630070 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f81e1e90-3b62-49d9-b345-91ddffd27c1b tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:24.630522 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f81e1e90-3b62-49d9-b345-91ddffd27c1b tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:24.631230 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f81e1e90-3b62-49d9-b345-91ddffd27c1b tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:24.631693 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f81e1e90-3b62-49d9-b345-91ddffd27c1b tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:24.632153 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f81e1e90-3b62-49d9-b345-91ddffd27c1b tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:24.851128 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f81e1e90-3b62-49d9-b345-91ddffd27c1b tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853edbd2be6744118e1f54842bd6d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a290c8241f64ad4bde2d3027f1f880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:24.859081 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f81e1e90-3b62-49d9-b345-91ddffd27c1b tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] 10.222.0.20 "GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4" status: 200 len: 1315 microversion: 2.1 time: 0.241615 Oct 04 19:32:24.859666 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3638/7290] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:24 2022] GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4 => generated 1315 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:25.883198 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b1fc2c80-0871-4a26-a552-41087e8f4925 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:25.883901 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b1fc2c80-0871-4a26-a552-41087e8f4925 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] [instance: 409594a8-f4cb-4da6-8c19-85ab4dbb09c4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:25.892317 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b1fc2c80-0871-4a26-a552-41087e8f4925 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:25.892809 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b1fc2c80-0871-4a26-a552-41087e8f4925 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:25.893246 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b1fc2c80-0871-4a26-a552-41087e8f4925 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:25.893980 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b1fc2c80-0871-4a26-a552-41087e8f4925 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:25.894440 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b1fc2c80-0871-4a26-a552-41087e8f4925 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:25.894865 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b1fc2c80-0871-4a26-a552-41087e8f4925 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:26.031677 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b1fc2c80-0871-4a26-a552-41087e8f4925 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853edbd2be6744118e1f54842bd6d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a290c8241f64ad4bde2d3027f1f880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:26.039518 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b1fc2c80-0871-4a26-a552-41087e8f4925 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] 10.222.0.20 "GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4" status: 200 len: 1315 microversion: 2.1 time: 0.160595 Oct 04 19:32:26.040106 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3653/7291] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:25 2022] GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:27.063807 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0cc821b7-6600-4950-b5af-3efb95bfaea0 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:27.064473 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0cc821b7-6600-4950-b5af-3efb95bfaea0 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] [instance: 409594a8-f4cb-4da6-8c19-85ab4dbb09c4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:27.066404 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:32:27.072131 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0cc821b7-6600-4950-b5af-3efb95bfaea0 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:27.072628 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0cc821b7-6600-4950-b5af-3efb95bfaea0 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:27.073079 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0cc821b7-6600-4950-b5af-3efb95bfaea0 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:27.073774 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0cc821b7-6600-4950-b5af-3efb95bfaea0 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:27.074239 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0cc821b7-6600-4950-b5af-3efb95bfaea0 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:27.074672 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0cc821b7-6600-4950-b5af-3efb95bfaea0 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:27.207539 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0cc821b7-6600-4950-b5af-3efb95bfaea0 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853edbd2be6744118e1f54842bd6d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a290c8241f64ad4bde2d3027f1f880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:27.215148 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0cc821b7-6600-4950-b5af-3efb95bfaea0 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] 10.222.0.20 "GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4" status: 200 len: 1315 microversion: 2.1 time: 0.156180 Oct 04 19:32:27.215718 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3639/7292] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:27 2022] GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:28.239697 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-058e3012-7f36-4138-9bb6-6ba88bb70bb4 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:28.240740 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-058e3012-7f36-4138-9bb6-6ba88bb70bb4 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] [instance: 409594a8-f4cb-4da6-8c19-85ab4dbb09c4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:28.243608 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=4 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:32:28.249176 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-058e3012-7f36-4138-9bb6-6ba88bb70bb4 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:28.249676 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-058e3012-7f36-4138-9bb6-6ba88bb70bb4 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:28.250119 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-058e3012-7f36-4138-9bb6-6ba88bb70bb4 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:28.250925 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-058e3012-7f36-4138-9bb6-6ba88bb70bb4 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:28.251347 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-058e3012-7f36-4138-9bb6-6ba88bb70bb4 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:28.251775 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-058e3012-7f36-4138-9bb6-6ba88bb70bb4 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:28.357077 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-f79f71ea-c12c-4f96-b270-39357e717702 req-54ba7f74-a6ce-4cd8-99e5-1cc43df43c8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "409594a8-f4cb-4da6-8c19-85ab4dbb09c4", "name": "network-vif-plugged", "status": "completed", "tag": "e7ab6992-880f-4927-bb9a-1723dd8cb0a8"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:32:28.368782 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-f79f71ea-c12c-4f96-b270-39357e717702 req-54ba7f74-a6ce-4cd8-99e5-1cc43df43c8b service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:28.369468 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-f79f71ea-c12c-4f96-b270-39357e717702 req-54ba7f74-a6ce-4cd8-99e5-1cc43df43c8b service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:28.369922 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-f79f71ea-c12c-4f96-b270-39357e717702 req-54ba7f74-a6ce-4cd8-99e5-1cc43df43c8b service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:28.384666 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-f79f71ea-c12c-4f96-b270-39357e717702 req-54ba7f74-a6ce-4cd8-99e5-1cc43df43c8b service nova] Creating event network-vif-plugged:e7ab6992-880f-4927-bb9a-1723dd8cb0a8 for instance 409594a8-f4cb-4da6-8c19-85ab4dbb09c4 on n-h1-850501-14 Oct 04 19:32:28.391232 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-f79f71ea-c12c-4f96-b270-39357e717702 req-54ba7f74-a6ce-4cd8-99e5-1cc43df43c8b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038634 Oct 04 19:32:28.392097 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3640/7293] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:32:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:32:28.397070 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-058e3012-7f36-4138-9bb6-6ba88bb70bb4 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853edbd2be6744118e1f54842bd6d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a290c8241f64ad4bde2d3027f1f880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:28.406619 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-058e3012-7f36-4138-9bb6-6ba88bb70bb4 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] 10.222.0.20 "GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4" status: 200 len: 1315 microversion: 2.1 time: 0.171283 Oct 04 19:32:28.407232 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3654/7294] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:28 2022] GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:29.428936 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=10 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:32:29.433976 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-06382d4c-05be-442f-a0f3-19196f0a28f7 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:29.434771 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-06382d4c-05be-442f-a0f3-19196f0a28f7 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] [instance: 409594a8-f4cb-4da6-8c19-85ab4dbb09c4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:29.440967 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-06382d4c-05be-442f-a0f3-19196f0a28f7 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:29.441468 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-06382d4c-05be-442f-a0f3-19196f0a28f7 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:29.441952 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-06382d4c-05be-442f-a0f3-19196f0a28f7 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:29.442662 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-06382d4c-05be-442f-a0f3-19196f0a28f7 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:29.443136 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-06382d4c-05be-442f-a0f3-19196f0a28f7 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:29.443579 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-06382d4c-05be-442f-a0f3-19196f0a28f7 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:29.582129 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-06382d4c-05be-442f-a0f3-19196f0a28f7 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853edbd2be6744118e1f54842bd6d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a290c8241f64ad4bde2d3027f1f880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:29.590210 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-06382d4c-05be-442f-a0f3-19196f0a28f7 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] 10.222.0.20 "GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4" status: 200 len: 1315 microversion: 2.1 time: 0.162137 Oct 04 19:32:29.590795 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3641/7295] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:29 2022] GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:30.616744 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ee72b34c-102c-48a2-858e-1073668f697d tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:30.617364 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ee72b34c-102c-48a2-858e-1073668f697d tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] [instance: 409594a8-f4cb-4da6-8c19-85ab4dbb09c4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:30.624298 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ee72b34c-102c-48a2-858e-1073668f697d tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:30.624786 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ee72b34c-102c-48a2-858e-1073668f697d tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:30.625226 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ee72b34c-102c-48a2-858e-1073668f697d tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:30.625951 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ee72b34c-102c-48a2-858e-1073668f697d tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:30.626405 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ee72b34c-102c-48a2-858e-1073668f697d tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:30.626830 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ee72b34c-102c-48a2-858e-1073668f697d tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:30.762285 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ee72b34c-102c-48a2-858e-1073668f697d tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853edbd2be6744118e1f54842bd6d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a290c8241f64ad4bde2d3027f1f880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:30.770805 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ee72b34c-102c-48a2-858e-1073668f697d tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] 10.222.0.20 "GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4" status: 200 len: 1502 microversion: 2.1 time: 0.158041 Oct 04 19:32:30.771381 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3655/7296] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:30 2022] GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4 => generated 1502 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:30.792890 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a5476db3-a15d-492a-8e77-abf223df8cf6 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:32:30.795445 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a5476db3-a15d-492a-8e77-abf223df8cf6 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] [instance: 409594a8-f4cb-4da6-8c19-85ab4dbb09c4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:30.802122 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a5476db3-a15d-492a-8e77-abf223df8cf6 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:30.802615 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a5476db3-a15d-492a-8e77-abf223df8cf6 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:30.803069 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a5476db3-a15d-492a-8e77-abf223df8cf6 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:30.803767 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a5476db3-a15d-492a-8e77-abf223df8cf6 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:30.804256 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a5476db3-a15d-492a-8e77-abf223df8cf6 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:30.804688 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a5476db3-a15d-492a-8e77-abf223df8cf6 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:30.838252 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a5476db3-a15d-492a-8e77-abf223df8cf6 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '853edbd2be6744118e1f54842bd6d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a290c8241f64ad4bde2d3027f1f880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:30.844531 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a5476db3-a15d-492a-8e77-abf223df8cf6 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] [instance: 409594a8-f4cb-4da6-8c19-85ab4dbb09c4] Old instance type m1.heat2, new instance type m1.heat {{(pid=123002) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 19:32:30.851052 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-a5476db3-a15d-492a-8e77-abf223df8cf6 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:32:30.851502 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-a5476db3-a15d-492a-8e77-abf223df8cf6 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:32:30.851992 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-a5476db3-a15d-492a-8e77-abf223df8cf6 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:32:30.852445 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-a5476db3-a15d-492a-8e77-abf223df8cf6 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:32:30.852882 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-a5476db3-a15d-492a-8e77-abf223df8cf6 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:32:31.053603 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a5476db3-a15d-492a-8e77-abf223df8cf6 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] 10.222.0.20 "POST /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4/action" status: 202 len: 0 microversion: 2.1 time: 0.264529 Oct 04 19:32:31.054154 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3642/7297] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 19:32:30 2022] POST /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4/action => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 19:32:31.062708 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-fa539491-ed57-4b42-a36a-670bdc53281e tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:31.063362 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-fa539491-ed57-4b42-a36a-670bdc53281e tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] [instance: 409594a8-f4cb-4da6-8c19-85ab4dbb09c4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:31.069318 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fa539491-ed57-4b42-a36a-670bdc53281e tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:31.069799 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fa539491-ed57-4b42-a36a-670bdc53281e tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:31.070395 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fa539491-ed57-4b42-a36a-670bdc53281e tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:31.071087 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fa539491-ed57-4b42-a36a-670bdc53281e tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:31.071600 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fa539491-ed57-4b42-a36a-670bdc53281e tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:31.072029 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fa539491-ed57-4b42-a36a-670bdc53281e tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:31.205817 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-fa539491-ed57-4b42-a36a-670bdc53281e tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853edbd2be6744118e1f54842bd6d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a290c8241f64ad4bde2d3027f1f880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:31.213588 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-fa539491-ed57-4b42-a36a-670bdc53281e tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] 10.222.0.20 "GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4" status: 200 len: 1511 microversion: 2.1 time: 0.155265 Oct 04 19:32:31.214157 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3656/7298] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:31 2022] GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4 => generated 1511 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:32.238769 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-731fefd0-4ceb-41f5-b08f-5f13433c4d3e tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:32.239548 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-731fefd0-4ceb-41f5-b08f-5f13433c4d3e tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] [instance: 409594a8-f4cb-4da6-8c19-85ab4dbb09c4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:32.248000 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-731fefd0-4ceb-41f5-b08f-5f13433c4d3e tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:32.248623 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-731fefd0-4ceb-41f5-b08f-5f13433c4d3e tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:32.249170 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-731fefd0-4ceb-41f5-b08f-5f13433c4d3e tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:32.249885 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-731fefd0-4ceb-41f5-b08f-5f13433c4d3e tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:32.250360 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-731fefd0-4ceb-41f5-b08f-5f13433c4d3e tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:32.250804 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-731fefd0-4ceb-41f5-b08f-5f13433c4d3e tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:32.386369 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-731fefd0-4ceb-41f5-b08f-5f13433c4d3e tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853edbd2be6744118e1f54842bd6d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a290c8241f64ad4bde2d3027f1f880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:32.396482 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-731fefd0-4ceb-41f5-b08f-5f13433c4d3e tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] 10.222.0.20 "GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4" status: 200 len: 1511 microversion: 2.1 time: 0.162367 Oct 04 19:32:32.397079 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3643/7299] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:32 2022] GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4 => generated 1511 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:33.422311 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4029cd5c-914c-4944-be5e-2e38bfd06b35 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:33.422911 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-4029cd5c-914c-4944-be5e-2e38bfd06b35 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] [instance: 409594a8-f4cb-4da6-8c19-85ab4dbb09c4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:33.430503 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4029cd5c-914c-4944-be5e-2e38bfd06b35 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:33.430503 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4029cd5c-914c-4944-be5e-2e38bfd06b35 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:33.430861 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4029cd5c-914c-4944-be5e-2e38bfd06b35 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:33.431552 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4029cd5c-914c-4944-be5e-2e38bfd06b35 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:33.432005 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4029cd5c-914c-4944-be5e-2e38bfd06b35 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:33.432454 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4029cd5c-914c-4944-be5e-2e38bfd06b35 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:33.575421 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-4029cd5c-914c-4944-be5e-2e38bfd06b35 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853edbd2be6744118e1f54842bd6d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a290c8241f64ad4bde2d3027f1f880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:33.584080 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-4029cd5c-914c-4944-be5e-2e38bfd06b35 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] 10.222.0.20 "GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4" status: 200 len: 1511 microversion: 2.1 time: 0.166264 Oct 04 19:32:33.584662 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3657/7300] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:33 2022] GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4 => generated 1511 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:34.608508 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a76c0a59-89b8-49d9-b018-6c054fcef026 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:34.609141 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a76c0a59-89b8-49d9-b018-6c054fcef026 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] [instance: 409594a8-f4cb-4da6-8c19-85ab4dbb09c4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:34.616404 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a76c0a59-89b8-49d9-b018-6c054fcef026 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:34.616916 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a76c0a59-89b8-49d9-b018-6c054fcef026 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:34.617374 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a76c0a59-89b8-49d9-b018-6c054fcef026 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:34.618094 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a76c0a59-89b8-49d9-b018-6c054fcef026 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:34.618572 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a76c0a59-89b8-49d9-b018-6c054fcef026 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:34.619020 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a76c0a59-89b8-49d9-b018-6c054fcef026 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:34.753570 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a76c0a59-89b8-49d9-b018-6c054fcef026 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853edbd2be6744118e1f54842bd6d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a290c8241f64ad4bde2d3027f1f880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:34.761385 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a76c0a59-89b8-49d9-b018-6c054fcef026 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] 10.222.0.20 "GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4" status: 200 len: 1511 microversion: 2.1 time: 0.157252 Oct 04 19:32:34.761957 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3644/7301] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:34 2022] GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4 => generated 1511 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:35.786379 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-017fd70f-fead-42ca-8d33-d0a9c11f93d3 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:35.787224 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-017fd70f-fead-42ca-8d33-d0a9c11f93d3 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] [instance: 409594a8-f4cb-4da6-8c19-85ab4dbb09c4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:35.794517 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-017fd70f-fead-42ca-8d33-d0a9c11f93d3 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:35.795000 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-017fd70f-fead-42ca-8d33-d0a9c11f93d3 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:35.795539 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-017fd70f-fead-42ca-8d33-d0a9c11f93d3 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:35.796267 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-017fd70f-fead-42ca-8d33-d0a9c11f93d3 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:35.796733 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-017fd70f-fead-42ca-8d33-d0a9c11f93d3 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:35.797237 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-017fd70f-fead-42ca-8d33-d0a9c11f93d3 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:35.948278 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-017fd70f-fead-42ca-8d33-d0a9c11f93d3 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853edbd2be6744118e1f54842bd6d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a290c8241f64ad4bde2d3027f1f880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:35.958410 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-017fd70f-fead-42ca-8d33-d0a9c11f93d3 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] 10.222.0.20 "GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4" status: 200 len: 1516 microversion: 2.1 time: 0.175912 Oct 04 19:32:35.959031 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3658/7302] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:35 2022] GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4 => generated 1516 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:36.986975 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-33f8df21-0cbb-44b5-b344-d68a70a0f86a tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:36.987523 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-33f8df21-0cbb-44b5-b344-d68a70a0f86a tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] [instance: 409594a8-f4cb-4da6-8c19-85ab4dbb09c4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:36.994334 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-33f8df21-0cbb-44b5-b344-d68a70a0f86a tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:36.994825 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-33f8df21-0cbb-44b5-b344-d68a70a0f86a tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:36.995272 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-33f8df21-0cbb-44b5-b344-d68a70a0f86a tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:36.995965 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-33f8df21-0cbb-44b5-b344-d68a70a0f86a tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:36.996514 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-33f8df21-0cbb-44b5-b344-d68a70a0f86a tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:36.997463 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-33f8df21-0cbb-44b5-b344-d68a70a0f86a tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:37.128019 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-33f8df21-0cbb-44b5-b344-d68a70a0f86a tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853edbd2be6744118e1f54842bd6d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a290c8241f64ad4bde2d3027f1f880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:37.135760 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-33f8df21-0cbb-44b5-b344-d68a70a0f86a tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] 10.222.0.20 "GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4" status: 200 len: 1516 microversion: 2.1 time: 0.152811 Oct 04 19:32:37.136373 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3645/7303] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:36 2022] GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4 => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:38.159030 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-63aecef8-e761-495d-a056-0f8dce59af3c tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:38.159652 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-63aecef8-e761-495d-a056-0f8dce59af3c tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] [instance: 409594a8-f4cb-4da6-8c19-85ab4dbb09c4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:38.166486 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-63aecef8-e761-495d-a056-0f8dce59af3c tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:38.166998 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-63aecef8-e761-495d-a056-0f8dce59af3c tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:38.167552 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-63aecef8-e761-495d-a056-0f8dce59af3c tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:38.168275 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-63aecef8-e761-495d-a056-0f8dce59af3c tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:38.168738 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-63aecef8-e761-495d-a056-0f8dce59af3c tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:38.169789 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-63aecef8-e761-495d-a056-0f8dce59af3c tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:38.310518 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-63aecef8-e761-495d-a056-0f8dce59af3c tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853edbd2be6744118e1f54842bd6d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a290c8241f64ad4bde2d3027f1f880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:38.319596 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-63aecef8-e761-495d-a056-0f8dce59af3c tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] 10.222.0.20 "GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4" status: 200 len: 1516 microversion: 2.1 time: 0.164507 Oct 04 19:32:38.320201 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3659/7304] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:38 2022] GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4 => generated 1516 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:39.344187 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-15e6805d-2da1-4208-8613-725706aa6d6d tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:39.344875 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-15e6805d-2da1-4208-8613-725706aa6d6d tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] [instance: 409594a8-f4cb-4da6-8c19-85ab4dbb09c4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:39.352010 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-15e6805d-2da1-4208-8613-725706aa6d6d tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:39.352552 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-15e6805d-2da1-4208-8613-725706aa6d6d tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:39.353076 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-15e6805d-2da1-4208-8613-725706aa6d6d tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:39.353951 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-15e6805d-2da1-4208-8613-725706aa6d6d tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:39.354210 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-15e6805d-2da1-4208-8613-725706aa6d6d tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:39.354668 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-15e6805d-2da1-4208-8613-725706aa6d6d tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:39.492898 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-15e6805d-2da1-4208-8613-725706aa6d6d tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853edbd2be6744118e1f54842bd6d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a290c8241f64ad4bde2d3027f1f880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:39.495909 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-15e6805d-2da1-4208-8613-725706aa6d6d tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] 10.222.0.20 "GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4" status: 200 len: 1516 microversion: 2.1 time: 0.156040 Oct 04 19:32:39.496528 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3646/7305] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:39 2022] GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4 => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:40.519908 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1a250e78-d0c4-4c29-9ebf-c3de901c4cb5 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:40.520649 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1a250e78-d0c4-4c29-9ebf-c3de901c4cb5 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] [instance: 409594a8-f4cb-4da6-8c19-85ab4dbb09c4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:40.527428 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1a250e78-d0c4-4c29-9ebf-c3de901c4cb5 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:40.527917 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1a250e78-d0c4-4c29-9ebf-c3de901c4cb5 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:40.529407 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1a250e78-d0c4-4c29-9ebf-c3de901c4cb5 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:40.530113 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1a250e78-d0c4-4c29-9ebf-c3de901c4cb5 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:40.530575 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1a250e78-d0c4-4c29-9ebf-c3de901c4cb5 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:40.531005 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1a250e78-d0c4-4c29-9ebf-c3de901c4cb5 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:40.661605 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1a250e78-d0c4-4c29-9ebf-c3de901c4cb5 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853edbd2be6744118e1f54842bd6d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a290c8241f64ad4bde2d3027f1f880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:40.670100 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1a250e78-d0c4-4c29-9ebf-c3de901c4cb5 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] 10.222.0.20 "GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4" status: 200 len: 1516 microversion: 2.1 time: 0.154150 Oct 04 19:32:40.670673 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3660/7306] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:40 2022] GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4 => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:41.693201 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2350695d-355a-4bf3-92b7-8edd665f46d1 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:41.693835 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2350695d-355a-4bf3-92b7-8edd665f46d1 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] [instance: 409594a8-f4cb-4da6-8c19-85ab4dbb09c4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:41.701410 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2350695d-355a-4bf3-92b7-8edd665f46d1 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:41.701905 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2350695d-355a-4bf3-92b7-8edd665f46d1 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:41.702354 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2350695d-355a-4bf3-92b7-8edd665f46d1 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:41.703057 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2350695d-355a-4bf3-92b7-8edd665f46d1 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:41.703532 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2350695d-355a-4bf3-92b7-8edd665f46d1 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:41.703970 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2350695d-355a-4bf3-92b7-8edd665f46d1 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:41.842423 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2350695d-355a-4bf3-92b7-8edd665f46d1 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853edbd2be6744118e1f54842bd6d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a290c8241f64ad4bde2d3027f1f880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:41.850257 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2350695d-355a-4bf3-92b7-8edd665f46d1 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] 10.222.0.20 "GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4" status: 200 len: 1516 microversion: 2.1 time: 0.161013 Oct 04 19:32:41.850831 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3647/7307] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:41 2022] GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4 => generated 1516 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:42.874066 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-938f7d1a-6882-4c9f-b740-9c2006d5e319 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:42.874670 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-938f7d1a-6882-4c9f-b740-9c2006d5e319 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] [instance: 409594a8-f4cb-4da6-8c19-85ab4dbb09c4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:42.881679 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-938f7d1a-6882-4c9f-b740-9c2006d5e319 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:42.882169 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-938f7d1a-6882-4c9f-b740-9c2006d5e319 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:42.882606 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-938f7d1a-6882-4c9f-b740-9c2006d5e319 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:42.883351 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-938f7d1a-6882-4c9f-b740-9c2006d5e319 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:42.883809 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-938f7d1a-6882-4c9f-b740-9c2006d5e319 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:42.884278 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-938f7d1a-6882-4c9f-b740-9c2006d5e319 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:43.022531 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-938f7d1a-6882-4c9f-b740-9c2006d5e319 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853edbd2be6744118e1f54842bd6d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a290c8241f64ad4bde2d3027f1f880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:43.030753 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-938f7d1a-6882-4c9f-b740-9c2006d5e319 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] 10.222.0.20 "GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4" status: 200 len: 1516 microversion: 2.1 time: 0.161252 Oct 04 19:32:43.031327 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3661/7308] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:42 2022] GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4 => generated 1516 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:44.053724 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-edc7d76a-422e-4684-94a4-63209db859d9 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:44.054971 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-edc7d76a-422e-4684-94a4-63209db859d9 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] [instance: 409594a8-f4cb-4da6-8c19-85ab4dbb09c4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:44.062785 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-edc7d76a-422e-4684-94a4-63209db859d9 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:44.063292 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-edc7d76a-422e-4684-94a4-63209db859d9 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:44.063784 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-edc7d76a-422e-4684-94a4-63209db859d9 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:44.064531 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-edc7d76a-422e-4684-94a4-63209db859d9 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:44.065020 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-edc7d76a-422e-4684-94a4-63209db859d9 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:44.065449 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-edc7d76a-422e-4684-94a4-63209db859d9 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:44.209370 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-edc7d76a-422e-4684-94a4-63209db859d9 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853edbd2be6744118e1f54842bd6d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a290c8241f64ad4bde2d3027f1f880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:44.217659 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-edc7d76a-422e-4684-94a4-63209db859d9 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] 10.222.0.20 "GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4" status: 200 len: 1516 microversion: 2.1 time: 0.168116 Oct 04 19:32:44.218232 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3648/7309] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:44 2022] GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4 => generated 1516 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:45.241631 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-319031b2-694c-4b21-9691-e37ff3bf4f17 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:45.242281 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-319031b2-694c-4b21-9691-e37ff3bf4f17 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] [instance: 409594a8-f4cb-4da6-8c19-85ab4dbb09c4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:45.249692 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-319031b2-694c-4b21-9691-e37ff3bf4f17 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:45.250182 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-319031b2-694c-4b21-9691-e37ff3bf4f17 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:45.250671 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-319031b2-694c-4b21-9691-e37ff3bf4f17 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:45.251375 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-319031b2-694c-4b21-9691-e37ff3bf4f17 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:45.251837 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-319031b2-694c-4b21-9691-e37ff3bf4f17 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:45.252298 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-319031b2-694c-4b21-9691-e37ff3bf4f17 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:45.384550 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-319031b2-694c-4b21-9691-e37ff3bf4f17 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853edbd2be6744118e1f54842bd6d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a290c8241f64ad4bde2d3027f1f880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:45.393305 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-319031b2-694c-4b21-9691-e37ff3bf4f17 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] 10.222.0.20 "GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4" status: 200 len: 1516 microversion: 2.1 time: 0.155631 Oct 04 19:32:45.393890 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3662/7310] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:45 2022] GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4 => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:46.417438 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-248c1d11-ab0e-49b3-9207-e3d8fab54111 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:46.418081 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-248c1d11-ab0e-49b3-9207-e3d8fab54111 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] [instance: 409594a8-f4cb-4da6-8c19-85ab4dbb09c4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:46.424420 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-248c1d11-ab0e-49b3-9207-e3d8fab54111 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:46.424922 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-248c1d11-ab0e-49b3-9207-e3d8fab54111 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:46.425380 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-248c1d11-ab0e-49b3-9207-e3d8fab54111 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:46.426089 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-248c1d11-ab0e-49b3-9207-e3d8fab54111 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:46.426563 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-248c1d11-ab0e-49b3-9207-e3d8fab54111 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:46.427006 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-248c1d11-ab0e-49b3-9207-e3d8fab54111 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:46.556400 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-248c1d11-ab0e-49b3-9207-e3d8fab54111 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853edbd2be6744118e1f54842bd6d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a290c8241f64ad4bde2d3027f1f880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:46.558580 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:32:46.566334 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-248c1d11-ab0e-49b3-9207-e3d8fab54111 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] 10.222.0.20 "GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4" status: 200 len: 1516 microversion: 2.1 time: 0.152009 Oct 04 19:32:46.566904 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3649/7311] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:46 2022] GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4 => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:47.593158 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-854cb929-f3c7-47ef-8cad-b90dad4640d2 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:47.593954 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-854cb929-f3c7-47ef-8cad-b90dad4640d2 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] [instance: 409594a8-f4cb-4da6-8c19-85ab4dbb09c4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:47.600793 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-854cb929-f3c7-47ef-8cad-b90dad4640d2 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:47.601276 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-854cb929-f3c7-47ef-8cad-b90dad4640d2 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:47.601717 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-854cb929-f3c7-47ef-8cad-b90dad4640d2 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:47.602433 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-854cb929-f3c7-47ef-8cad-b90dad4640d2 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:47.602889 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-854cb929-f3c7-47ef-8cad-b90dad4640d2 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:47.603315 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-854cb929-f3c7-47ef-8cad-b90dad4640d2 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:47.605883 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=75 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:32:47.738985 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-854cb929-f3c7-47ef-8cad-b90dad4640d2 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853edbd2be6744118e1f54842bd6d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a290c8241f64ad4bde2d3027f1f880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:47.747989 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-854cb929-f3c7-47ef-8cad-b90dad4640d2 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] 10.222.0.20 "GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4" status: 200 len: 1516 microversion: 2.1 time: 0.158840 Oct 04 19:32:47.748936 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3663/7312] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:47 2022] GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4 => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:48.772512 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-62c28b8f-6e0e-4f17-94fc-318b8299bae6 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:48.773187 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-62c28b8f-6e0e-4f17-94fc-318b8299bae6 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] [instance: 409594a8-f4cb-4da6-8c19-85ab4dbb09c4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:48.776498 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:32:48.783666 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-62c28b8f-6e0e-4f17-94fc-318b8299bae6 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:48.784247 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-62c28b8f-6e0e-4f17-94fc-318b8299bae6 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:48.784747 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-62c28b8f-6e0e-4f17-94fc-318b8299bae6 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:48.785511 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-62c28b8f-6e0e-4f17-94fc-318b8299bae6 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:48.786000 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-62c28b8f-6e0e-4f17-94fc-318b8299bae6 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:48.786479 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-62c28b8f-6e0e-4f17-94fc-318b8299bae6 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:48.926176 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-62c28b8f-6e0e-4f17-94fc-318b8299bae6 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853edbd2be6744118e1f54842bd6d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a290c8241f64ad4bde2d3027f1f880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:48.934346 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-62c28b8f-6e0e-4f17-94fc-318b8299bae6 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] 10.222.0.20 "GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4" status: 200 len: 1516 microversion: 2.1 time: 0.166854 Oct 04 19:32:48.935440 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3650/7313] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:48 2022] GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4 => generated 1516 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:49.958074 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8cba94a2-9d06-4dfe-a68f-64520fa4ae59 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:49.958682 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8cba94a2-9d06-4dfe-a68f-64520fa4ae59 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] [instance: 409594a8-f4cb-4da6-8c19-85ab4dbb09c4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:49.961477 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=37 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:32:49.966190 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8cba94a2-9d06-4dfe-a68f-64520fa4ae59 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:49.966905 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8cba94a2-9d06-4dfe-a68f-64520fa4ae59 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:49.967143 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8cba94a2-9d06-4dfe-a68f-64520fa4ae59 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:49.967831 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8cba94a2-9d06-4dfe-a68f-64520fa4ae59 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:49.968307 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8cba94a2-9d06-4dfe-a68f-64520fa4ae59 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:49.974154 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8cba94a2-9d06-4dfe-a68f-64520fa4ae59 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:50.106321 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8cba94a2-9d06-4dfe-a68f-64520fa4ae59 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853edbd2be6744118e1f54842bd6d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a290c8241f64ad4bde2d3027f1f880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:50.114361 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8cba94a2-9d06-4dfe-a68f-64520fa4ae59 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] 10.222.0.20 "GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4" status: 200 len: 1516 microversion: 2.1 time: 0.160203 Oct 04 19:32:50.114975 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3664/7314] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:49 2022] GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4 => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:51.139829 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-fcae6dd7-69e5-443a-a61f-8b70eb44aa96 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:51.140726 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-fcae6dd7-69e5-443a-a61f-8b70eb44aa96 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] [instance: 409594a8-f4cb-4da6-8c19-85ab4dbb09c4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:51.148443 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fcae6dd7-69e5-443a-a61f-8b70eb44aa96 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:51.149533 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fcae6dd7-69e5-443a-a61f-8b70eb44aa96 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:51.150001 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fcae6dd7-69e5-443a-a61f-8b70eb44aa96 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:51.150764 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fcae6dd7-69e5-443a-a61f-8b70eb44aa96 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:51.151297 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fcae6dd7-69e5-443a-a61f-8b70eb44aa96 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:51.151924 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fcae6dd7-69e5-443a-a61f-8b70eb44aa96 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:51.285908 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-fcae6dd7-69e5-443a-a61f-8b70eb44aa96 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853edbd2be6744118e1f54842bd6d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a290c8241f64ad4bde2d3027f1f880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:51.294372 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-fcae6dd7-69e5-443a-a61f-8b70eb44aa96 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] 10.222.0.20 "GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4" status: 200 len: 1516 microversion: 2.1 time: 0.160241 Oct 04 19:32:51.295742 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3651/7315] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:51 2022] GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4 => generated 1516 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:52.318519 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-71c1c7f5-dba2-4a5b-8aab-a2249199e105 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:52.319135 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-71c1c7f5-dba2-4a5b-8aab-a2249199e105 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] [instance: 409594a8-f4cb-4da6-8c19-85ab4dbb09c4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:52.325990 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-71c1c7f5-dba2-4a5b-8aab-a2249199e105 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:52.326469 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-71c1c7f5-dba2-4a5b-8aab-a2249199e105 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:52.326903 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-71c1c7f5-dba2-4a5b-8aab-a2249199e105 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:52.327585 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-71c1c7f5-dba2-4a5b-8aab-a2249199e105 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:52.328041 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-71c1c7f5-dba2-4a5b-8aab-a2249199e105 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:52.328481 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-71c1c7f5-dba2-4a5b-8aab-a2249199e105 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:52.465832 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-71c1c7f5-dba2-4a5b-8aab-a2249199e105 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853edbd2be6744118e1f54842bd6d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a290c8241f64ad4bde2d3027f1f880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:52.474246 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-71c1c7f5-dba2-4a5b-8aab-a2249199e105 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] 10.222.0.20 "GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4" status: 200 len: 1516 microversion: 2.1 time: 0.159575 Oct 04 19:32:52.474826 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3665/7316] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:52 2022] GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4 => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:53.497836 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-cc8f5343-6f7d-42d8-99a3-9c52a8af0e27 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:53.498622 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-cc8f5343-6f7d-42d8-99a3-9c52a8af0e27 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] [instance: 409594a8-f4cb-4da6-8c19-85ab4dbb09c4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:53.505860 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cc8f5343-6f7d-42d8-99a3-9c52a8af0e27 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:53.506361 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cc8f5343-6f7d-42d8-99a3-9c52a8af0e27 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:53.506817 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cc8f5343-6f7d-42d8-99a3-9c52a8af0e27 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:53.507545 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cc8f5343-6f7d-42d8-99a3-9c52a8af0e27 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:53.508099 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cc8f5343-6f7d-42d8-99a3-9c52a8af0e27 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:53.513185 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cc8f5343-6f7d-42d8-99a3-9c52a8af0e27 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:53.644535 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-cc8f5343-6f7d-42d8-99a3-9c52a8af0e27 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853edbd2be6744118e1f54842bd6d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a290c8241f64ad4bde2d3027f1f880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:53.652782 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-cc8f5343-6f7d-42d8-99a3-9c52a8af0e27 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] 10.222.0.20 "GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4" status: 200 len: 1516 microversion: 2.1 time: 0.159104 Oct 04 19:32:53.653357 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3652/7317] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:53 2022] GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4 => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:54.677346 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b648e19b-9b5c-42e7-a243-c6a4b82bffac tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:54.677993 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b648e19b-9b5c-42e7-a243-c6a4b82bffac tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] [instance: 409594a8-f4cb-4da6-8c19-85ab4dbb09c4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:54.684832 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b648e19b-9b5c-42e7-a243-c6a4b82bffac tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:54.689076 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b648e19b-9b5c-42e7-a243-c6a4b82bffac tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:54.689076 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b648e19b-9b5c-42e7-a243-c6a4b82bffac tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:54.689076 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b648e19b-9b5c-42e7-a243-c6a4b82bffac tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:54.689076 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b648e19b-9b5c-42e7-a243-c6a4b82bffac tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:54.689076 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b648e19b-9b5c-42e7-a243-c6a4b82bffac tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:54.821882 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b648e19b-9b5c-42e7-a243-c6a4b82bffac tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853edbd2be6744118e1f54842bd6d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a290c8241f64ad4bde2d3027f1f880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:54.830383 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b648e19b-9b5c-42e7-a243-c6a4b82bffac tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] 10.222.0.20 "GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4" status: 200 len: 1516 microversion: 2.1 time: 0.157448 Oct 04 19:32:54.830964 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3666/7318] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:54 2022] GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4 => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:55.854149 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d1dd2ef0-7946-4d3d-9c3f-52dfd34895e1 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:55.854779 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d1dd2ef0-7946-4d3d-9c3f-52dfd34895e1 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] [instance: 409594a8-f4cb-4da6-8c19-85ab4dbb09c4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:55.862016 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d1dd2ef0-7946-4d3d-9c3f-52dfd34895e1 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:55.862515 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d1dd2ef0-7946-4d3d-9c3f-52dfd34895e1 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:55.863693 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d1dd2ef0-7946-4d3d-9c3f-52dfd34895e1 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:55.864460 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d1dd2ef0-7946-4d3d-9c3f-52dfd34895e1 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:55.864941 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d1dd2ef0-7946-4d3d-9c3f-52dfd34895e1 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:55.865380 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d1dd2ef0-7946-4d3d-9c3f-52dfd34895e1 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:56.003288 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d1dd2ef0-7946-4d3d-9c3f-52dfd34895e1 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853edbd2be6744118e1f54842bd6d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a290c8241f64ad4bde2d3027f1f880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:56.011125 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d1dd2ef0-7946-4d3d-9c3f-52dfd34895e1 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] 10.222.0.20 "GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4" status: 200 len: 1516 microversion: 2.1 time: 0.160960 Oct 04 19:32:56.011702 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3653/7319] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:55 2022] GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4 => generated 1516 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:57.035891 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7b253588-7c49-45d3-b1e5-19aa4abcc329 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:57.036504 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7b253588-7c49-45d3-b1e5-19aa4abcc329 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] [instance: 409594a8-f4cb-4da6-8c19-85ab4dbb09c4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:57.043290 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7b253588-7c49-45d3-b1e5-19aa4abcc329 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:57.043773 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7b253588-7c49-45d3-b1e5-19aa4abcc329 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:57.045001 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7b253588-7c49-45d3-b1e5-19aa4abcc329 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:57.045765 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7b253588-7c49-45d3-b1e5-19aa4abcc329 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:57.046231 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7b253588-7c49-45d3-b1e5-19aa4abcc329 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:57.046665 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7b253588-7c49-45d3-b1e5-19aa4abcc329 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:57.187960 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7b253588-7c49-45d3-b1e5-19aa4abcc329 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853edbd2be6744118e1f54842bd6d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a290c8241f64ad4bde2d3027f1f880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:57.196757 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7b253588-7c49-45d3-b1e5-19aa4abcc329 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] 10.222.0.20 "GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4" status: 200 len: 1516 microversion: 2.1 time: 0.164819 Oct 04 19:32:57.197410 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3667/7320] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:57 2022] GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4 => generated 1516 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:58.222218 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-77c0fbb0-fbc8-43a6-ace2-c74ece7cdaa2 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:58.222857 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-77c0fbb0-fbc8-43a6-ace2-c74ece7cdaa2 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] [instance: 409594a8-f4cb-4da6-8c19-85ab4dbb09c4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:58.228871 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-77c0fbb0-fbc8-43a6-ace2-c74ece7cdaa2 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:58.229376 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-77c0fbb0-fbc8-43a6-ace2-c74ece7cdaa2 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:58.229833 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-77c0fbb0-fbc8-43a6-ace2-c74ece7cdaa2 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:58.230545 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-77c0fbb0-fbc8-43a6-ace2-c74ece7cdaa2 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:58.231018 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-77c0fbb0-fbc8-43a6-ace2-c74ece7cdaa2 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:58.231464 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-77c0fbb0-fbc8-43a6-ace2-c74ece7cdaa2 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:58.368978 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-77c0fbb0-fbc8-43a6-ace2-c74ece7cdaa2 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853edbd2be6744118e1f54842bd6d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a290c8241f64ad4bde2d3027f1f880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:58.376694 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-77c0fbb0-fbc8-43a6-ace2-c74ece7cdaa2 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] 10.222.0.20 "GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4" status: 200 len: 1516 microversion: 2.1 time: 0.159704 Oct 04 19:32:58.377285 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3654/7321] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:58 2022] GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4 => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:59.400675 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b0072b78-a82b-409b-9593-b5a8a1c3ea30 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:59.401296 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b0072b78-a82b-409b-9593-b5a8a1c3ea30 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] [instance: 409594a8-f4cb-4da6-8c19-85ab4dbb09c4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:59.408768 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b0072b78-a82b-409b-9593-b5a8a1c3ea30 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:59.409256 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b0072b78-a82b-409b-9593-b5a8a1c3ea30 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:59.409698 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b0072b78-a82b-409b-9593-b5a8a1c3ea30 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:59.410389 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b0072b78-a82b-409b-9593-b5a8a1c3ea30 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:59.410845 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b0072b78-a82b-409b-9593-b5a8a1c3ea30 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:59.411271 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b0072b78-a82b-409b-9593-b5a8a1c3ea30 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:59.547172 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b0072b78-a82b-409b-9593-b5a8a1c3ea30 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853edbd2be6744118e1f54842bd6d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a290c8241f64ad4bde2d3027f1f880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:59.559930 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b0072b78-a82b-409b-9593-b5a8a1c3ea30 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] 10.222.0.20 "GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4" status: 200 len: 1516 microversion: 2.1 time: 0.163054 Oct 04 19:32:59.560588 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3668/7322] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:59 2022] GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4 => generated 1516 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:33:00.586919 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-618c8ae5-fbe5-477c-af16-5118829e34f2 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:33:00.587478 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-618c8ae5-fbe5-477c-af16-5118829e34f2 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] [instance: 409594a8-f4cb-4da6-8c19-85ab4dbb09c4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:33:00.596088 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-618c8ae5-fbe5-477c-af16-5118829e34f2 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:00.596634 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-618c8ae5-fbe5-477c-af16-5118829e34f2 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:00.597094 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-618c8ae5-fbe5-477c-af16-5118829e34f2 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:00.597846 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-618c8ae5-fbe5-477c-af16-5118829e34f2 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:00.598325 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-618c8ae5-fbe5-477c-af16-5118829e34f2 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:00.598772 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-618c8ae5-fbe5-477c-af16-5118829e34f2 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:00.734511 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-618c8ae5-fbe5-477c-af16-5118829e34f2 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853edbd2be6744118e1f54842bd6d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a290c8241f64ad4bde2d3027f1f880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:33:00.742421 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-618c8ae5-fbe5-477c-af16-5118829e34f2 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] 10.222.0.20 "GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4" status: 200 len: 1516 microversion: 2.1 time: 0.159600 Oct 04 19:33:00.743004 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3655/7323] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:33:00 2022] GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4 => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:33:01.766855 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-fd08d4e6-92dc-485b-b283-b901be3d90cd tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:33:01.767519 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-fd08d4e6-92dc-485b-b283-b901be3d90cd tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] [instance: 409594a8-f4cb-4da6-8c19-85ab4dbb09c4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:33:01.770927 n-d-850501-14 devstack@n-api.service[123001]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:33:01.771058 n-d-850501-14 devstack@n-api.service[123001]: Tue Oct 4 19:33:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4 (ip 10.222.0.20) !!! Oct 04 19:33:01.778580 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fd08d4e6-92dc-485b-b283-b901be3d90cd tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:01.779107 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fd08d4e6-92dc-485b-b283-b901be3d90cd tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:01.779605 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fd08d4e6-92dc-485b-b283-b901be3d90cd tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:01.780952 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fd08d4e6-92dc-485b-b283-b901be3d90cd tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:01.781420 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fd08d4e6-92dc-485b-b283-b901be3d90cd tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:01.781909 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fd08d4e6-92dc-485b-b283-b901be3d90cd tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:01.919698 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-fd08d4e6-92dc-485b-b283-b901be3d90cd tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853edbd2be6744118e1f54842bd6d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a290c8241f64ad4bde2d3027f1f880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:33:01.928409 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-fd08d4e6-92dc-485b-b283-b901be3d90cd tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] 10.222.0.20 "GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4" status: 200 len: 1516 microversion: 2.1 time: 0.165717 Oct 04 19:33:01.928985 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3669/7324] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:33:01 2022] GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4 => generated 1516 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:33:02.951260 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f3a308f1-4127-401a-a0c7-2c0fb9facd83 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:33:02.951894 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f3a308f1-4127-401a-a0c7-2c0fb9facd83 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] [instance: 409594a8-f4cb-4da6-8c19-85ab4dbb09c4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:33:02.958864 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f3a308f1-4127-401a-a0c7-2c0fb9facd83 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:02.959403 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f3a308f1-4127-401a-a0c7-2c0fb9facd83 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:02.959932 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f3a308f1-4127-401a-a0c7-2c0fb9facd83 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:02.960770 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f3a308f1-4127-401a-a0c7-2c0fb9facd83 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:02.961248 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f3a308f1-4127-401a-a0c7-2c0fb9facd83 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:02.961697 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f3a308f1-4127-401a-a0c7-2c0fb9facd83 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:03.090739 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f3a308f1-4127-401a-a0c7-2c0fb9facd83 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853edbd2be6744118e1f54842bd6d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a290c8241f64ad4bde2d3027f1f880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:33:03.099451 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f3a308f1-4127-401a-a0c7-2c0fb9facd83 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] 10.222.0.20 "GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4" status: 200 len: 1516 microversion: 2.1 time: 0.152128 Oct 04 19:33:03.100020 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3656/7325] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:33:02 2022] GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4 => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:33:04.123184 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-415bc15b-de65-47ed-babd-061761d85700 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:33:04.123832 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-415bc15b-de65-47ed-babd-061761d85700 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] [instance: 409594a8-f4cb-4da6-8c19-85ab4dbb09c4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:33:04.131339 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-415bc15b-de65-47ed-babd-061761d85700 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:04.131829 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-415bc15b-de65-47ed-babd-061761d85700 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:04.132304 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-415bc15b-de65-47ed-babd-061761d85700 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:04.132999 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-415bc15b-de65-47ed-babd-061761d85700 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:04.133460 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-415bc15b-de65-47ed-babd-061761d85700 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:04.133891 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-415bc15b-de65-47ed-babd-061761d85700 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:04.267934 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-415bc15b-de65-47ed-babd-061761d85700 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853edbd2be6744118e1f54842bd6d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a290c8241f64ad4bde2d3027f1f880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:33:04.275731 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-415bc15b-de65-47ed-babd-061761d85700 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] 10.222.0.20 "GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4" status: 200 len: 1516 microversion: 2.1 time: 0.156468 Oct 04 19:33:04.276349 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3670/7326] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:33:04 2022] GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4 => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:33:05.300523 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f72ac46f-f07e-470e-9be9-6483845ec208 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:33:05.301157 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f72ac46f-f07e-470e-9be9-6483845ec208 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] [instance: 409594a8-f4cb-4da6-8c19-85ab4dbb09c4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:33:05.308126 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f72ac46f-f07e-470e-9be9-6483845ec208 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:05.308628 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f72ac46f-f07e-470e-9be9-6483845ec208 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:05.309081 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f72ac46f-f07e-470e-9be9-6483845ec208 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:05.309815 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f72ac46f-f07e-470e-9be9-6483845ec208 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:05.310322 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f72ac46f-f07e-470e-9be9-6483845ec208 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:05.310734 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f72ac46f-f07e-470e-9be9-6483845ec208 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:05.452374 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f72ac46f-f07e-470e-9be9-6483845ec208 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853edbd2be6744118e1f54842bd6d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a290c8241f64ad4bde2d3027f1f880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:33:05.460004 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f72ac46f-f07e-470e-9be9-6483845ec208 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] 10.222.0.20 "GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4" status: 200 len: 1516 microversion: 2.1 time: 0.164118 Oct 04 19:33:05.460598 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3657/7327] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:33:05 2022] GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4 => generated 1516 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:33:06.484842 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ec8354a2-8624-422e-8952-fc63212a92fe tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:33:06.485454 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ec8354a2-8624-422e-8952-fc63212a92fe tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] [instance: 409594a8-f4cb-4da6-8c19-85ab4dbb09c4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:33:06.492395 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec8354a2-8624-422e-8952-fc63212a92fe tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:06.492880 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec8354a2-8624-422e-8952-fc63212a92fe tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:06.493383 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec8354a2-8624-422e-8952-fc63212a92fe tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:06.494127 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec8354a2-8624-422e-8952-fc63212a92fe tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:06.494578 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec8354a2-8624-422e-8952-fc63212a92fe tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:06.495000 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec8354a2-8624-422e-8952-fc63212a92fe tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:06.634725 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ec8354a2-8624-422e-8952-fc63212a92fe tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853edbd2be6744118e1f54842bd6d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a290c8241f64ad4bde2d3027f1f880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:33:06.642933 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ec8354a2-8624-422e-8952-fc63212a92fe tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] 10.222.0.20 "GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4" status: 200 len: 1516 microversion: 2.1 time: 0.162099 Oct 04 19:33:06.643516 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3671/7328] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:33:06 2022] GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4 => generated 1516 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:33:07.613717 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-b6c171a0-69e1-4d72-b6bb-47c78c88a2c8 req-a4341a79-57f7-4671-a068-01d1f8236cc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "409594a8-f4cb-4da6-8c19-85ab4dbb09c4", "name": "network-vif-unplugged", "status": "completed", "tag": "e7ab6992-880f-4927-bb9a-1723dd8cb0a8"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:33:07.624133 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-b6c171a0-69e1-4d72-b6bb-47c78c88a2c8 req-a4341a79-57f7-4671-a068-01d1f8236cc2 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:07.624694 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-b6c171a0-69e1-4d72-b6bb-47c78c88a2c8 req-a4341a79-57f7-4671-a068-01d1f8236cc2 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:07.625431 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-b6c171a0-69e1-4d72-b6bb-47c78c88a2c8 req-a4341a79-57f7-4671-a068-01d1f8236cc2 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:07.637353 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-b6c171a0-69e1-4d72-b6bb-47c78c88a2c8 req-a4341a79-57f7-4671-a068-01d1f8236cc2 service nova] Creating event network-vif-unplugged:e7ab6992-880f-4927-bb9a-1723dd8cb0a8 for instance 409594a8-f4cb-4da6-8c19-85ab4dbb09c4 on n-h2-850501-14 Oct 04 19:33:07.643232 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [req-b6c171a0-69e1-4d72-b6bb-47c78c88a2c8 req-a4341a79-57f7-4671-a068-01d1f8236cc2 service nova] Instance 409594a8-f4cb-4da6-8c19-85ab4dbb09c4 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850501-14', 'n-h2-850501-14'} {{(pid=123002) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:33:07.654517 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-b6c171a0-69e1-4d72-b6bb-47c78c88a2c8 req-a4341a79-57f7-4671-a068-01d1f8236cc2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046621 Oct 04 19:33:07.655143 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3658/7329] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:33:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:33:07.665930 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d8e096eb-8177-4cfc-8b04-f0bff70886fe tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:33:07.666542 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d8e096eb-8177-4cfc-8b04-f0bff70886fe tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] [instance: 409594a8-f4cb-4da6-8c19-85ab4dbb09c4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:33:07.674374 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d8e096eb-8177-4cfc-8b04-f0bff70886fe tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:07.687437 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d8e096eb-8177-4cfc-8b04-f0bff70886fe tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:07.687437 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d8e096eb-8177-4cfc-8b04-f0bff70886fe tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:07.687437 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d8e096eb-8177-4cfc-8b04-f0bff70886fe tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:07.687437 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d8e096eb-8177-4cfc-8b04-f0bff70886fe tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:07.687437 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d8e096eb-8177-4cfc-8b04-f0bff70886fe tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:07.809286 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d8e096eb-8177-4cfc-8b04-f0bff70886fe tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853edbd2be6744118e1f54842bd6d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a290c8241f64ad4bde2d3027f1f880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:33:07.817574 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d8e096eb-8177-4cfc-8b04-f0bff70886fe tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] 10.222.0.20 "GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4" status: 200 len: 1515 microversion: 2.1 time: 0.155405 Oct 04 19:33:07.818175 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3672/7330] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:33:07 2022] GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:33:08.842632 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8c624e29-3ae3-45e5-9a1c-5363d3441500 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:33:08.844219 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8c624e29-3ae3-45e5-9a1c-5363d3441500 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] [instance: 409594a8-f4cb-4da6-8c19-85ab4dbb09c4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:33:08.850472 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8c624e29-3ae3-45e5-9a1c-5363d3441500 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:08.850988 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8c624e29-3ae3-45e5-9a1c-5363d3441500 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:08.851429 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8c624e29-3ae3-45e5-9a1c-5363d3441500 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:08.852170 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8c624e29-3ae3-45e5-9a1c-5363d3441500 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:08.852654 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8c624e29-3ae3-45e5-9a1c-5363d3441500 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:08.853099 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8c624e29-3ae3-45e5-9a1c-5363d3441500 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:08.990618 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8c624e29-3ae3-45e5-9a1c-5363d3441500 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853edbd2be6744118e1f54842bd6d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a290c8241f64ad4bde2d3027f1f880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:33:08.998325 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8c624e29-3ae3-45e5-9a1c-5363d3441500 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] 10.222.0.20 "GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4" status: 200 len: 1515 microversion: 2.1 time: 0.160962 Oct 04 19:33:08.998901 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3659/7331] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:33:08 2022] GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4 => generated 1515 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:33:09.670357 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-fd3195c8-15a3-4b87-904d-1326f602a6da req-26eda829-bd08-42a1-aefb-24832527aa04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "409594a8-f4cb-4da6-8c19-85ab4dbb09c4", "tag": "e7ab6992-880f-4927-bb9a-1723dd8cb0a8"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:33:09.681351 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-fd3195c8-15a3-4b87-904d-1326f602a6da req-26eda829-bd08-42a1-aefb-24832527aa04 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:09.681832 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-fd3195c8-15a3-4b87-904d-1326f602a6da req-26eda829-bd08-42a1-aefb-24832527aa04 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:09.682267 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-fd3195c8-15a3-4b87-904d-1326f602a6da req-26eda829-bd08-42a1-aefb-24832527aa04 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:09.693971 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-fd3195c8-15a3-4b87-904d-1326f602a6da req-26eda829-bd08-42a1-aefb-24832527aa04 service nova] Creating event network-changed:e7ab6992-880f-4927-bb9a-1723dd8cb0a8 for instance 409594a8-f4cb-4da6-8c19-85ab4dbb09c4 on n-h2-850501-14 Oct 04 19:33:09.699522 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [req-fd3195c8-15a3-4b87-904d-1326f602a6da req-26eda829-bd08-42a1-aefb-24832527aa04 service nova] Instance 409594a8-f4cb-4da6-8c19-85ab4dbb09c4 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850501-14', 'n-h2-850501-14'} {{(pid=123001) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:33:09.710552 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-fd3195c8-15a3-4b87-904d-1326f602a6da req-26eda829-bd08-42a1-aefb-24832527aa04 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043877 Oct 04 19:33:09.711158 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3673/7332] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:33:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:33:10.022684 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f005d4df-10a3-4148-aca3-57123efbb661 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:33:10.023288 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f005d4df-10a3-4148-aca3-57123efbb661 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] [instance: 409594a8-f4cb-4da6-8c19-85ab4dbb09c4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:33:10.030121 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f005d4df-10a3-4148-aca3-57123efbb661 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:10.030619 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f005d4df-10a3-4148-aca3-57123efbb661 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:10.031067 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f005d4df-10a3-4148-aca3-57123efbb661 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:10.031782 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f005d4df-10a3-4148-aca3-57123efbb661 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:10.032282 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f005d4df-10a3-4148-aca3-57123efbb661 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:10.032722 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f005d4df-10a3-4148-aca3-57123efbb661 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:10.240946 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f005d4df-10a3-4148-aca3-57123efbb661 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853edbd2be6744118e1f54842bd6d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a290c8241f64ad4bde2d3027f1f880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:33:10.248684 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f005d4df-10a3-4148-aca3-57123efbb661 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] 10.222.0.20 "GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4" status: 200 len: 1513 microversion: 2.1 time: 0.230037 Oct 04 19:33:10.251749 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3660/7333] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:33:10 2022] GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4 => generated 1513 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:33:11.277549 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e5149c58-faa8-4fe4-8266-ca1096fe49a9 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:33:11.278251 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e5149c58-faa8-4fe4-8266-ca1096fe49a9 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] [instance: 409594a8-f4cb-4da6-8c19-85ab4dbb09c4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:33:11.284967 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e5149c58-faa8-4fe4-8266-ca1096fe49a9 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:11.285449 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e5149c58-faa8-4fe4-8266-ca1096fe49a9 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:11.285886 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e5149c58-faa8-4fe4-8266-ca1096fe49a9 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:11.286570 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e5149c58-faa8-4fe4-8266-ca1096fe49a9 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:11.287022 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e5149c58-faa8-4fe4-8266-ca1096fe49a9 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:11.287500 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e5149c58-faa8-4fe4-8266-ca1096fe49a9 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:11.419648 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e5149c58-faa8-4fe4-8266-ca1096fe49a9 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853edbd2be6744118e1f54842bd6d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a290c8241f64ad4bde2d3027f1f880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:33:11.428396 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e5149c58-faa8-4fe4-8266-ca1096fe49a9 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] 10.222.0.20 "GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4" status: 200 len: 1513 microversion: 2.1 time: 0.155934 Oct 04 19:33:11.429007 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3674/7334] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:33:11 2022] GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4 => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:33:12.451129 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3277a468-01ab-4f4e-bda5-87dda930ff27 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:33:12.451759 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3277a468-01ab-4f4e-bda5-87dda930ff27 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] [instance: 409594a8-f4cb-4da6-8c19-85ab4dbb09c4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:33:12.459358 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3277a468-01ab-4f4e-bda5-87dda930ff27 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:12.459874 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3277a468-01ab-4f4e-bda5-87dda930ff27 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:12.460379 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3277a468-01ab-4f4e-bda5-87dda930ff27 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:12.461096 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3277a468-01ab-4f4e-bda5-87dda930ff27 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:12.461570 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3277a468-01ab-4f4e-bda5-87dda930ff27 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:12.462015 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3277a468-01ab-4f4e-bda5-87dda930ff27 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:12.611177 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3277a468-01ab-4f4e-bda5-87dda930ff27 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853edbd2be6744118e1f54842bd6d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a290c8241f64ad4bde2d3027f1f880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:33:12.614927 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3277a468-01ab-4f4e-bda5-87dda930ff27 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] 10.222.0.20 "GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4" status: 200 len: 1513 microversion: 2.1 time: 0.167652 Oct 04 19:33:12.615734 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3661/7335] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:33:12 2022] GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4 => generated 1513 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:33:13.639087 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7d75ebae-9303-42d1-9204-ba22e9bc9920 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:33:13.639626 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7d75ebae-9303-42d1-9204-ba22e9bc9920 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] [instance: 409594a8-f4cb-4da6-8c19-85ab4dbb09c4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:33:13.647532 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7d75ebae-9303-42d1-9204-ba22e9bc9920 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:13.648021 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7d75ebae-9303-42d1-9204-ba22e9bc9920 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:13.648496 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7d75ebae-9303-42d1-9204-ba22e9bc9920 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:13.649193 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7d75ebae-9303-42d1-9204-ba22e9bc9920 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:13.649653 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7d75ebae-9303-42d1-9204-ba22e9bc9920 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:13.650082 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7d75ebae-9303-42d1-9204-ba22e9bc9920 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:13.785963 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7d75ebae-9303-42d1-9204-ba22e9bc9920 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853edbd2be6744118e1f54842bd6d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a290c8241f64ad4bde2d3027f1f880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:33:13.793817 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7d75ebae-9303-42d1-9204-ba22e9bc9920 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] 10.222.0.20 "GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4" status: 200 len: 1510 microversion: 2.1 time: 0.158823 Oct 04 19:33:13.794409 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3675/7336] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:33:13 2022] GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4 => generated 1510 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:33:13.816524 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-76e3283e-ce69-4655-a49e-26490d91b2ec tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:33:13.817044 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-76e3283e-ce69-4655-a49e-26490d91b2ec tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] [instance: 409594a8-f4cb-4da6-8c19-85ab4dbb09c4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:33:13.823815 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-76e3283e-ce69-4655-a49e-26490d91b2ec tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:13.824375 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-76e3283e-ce69-4655-a49e-26490d91b2ec tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:13.824877 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-76e3283e-ce69-4655-a49e-26490d91b2ec tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:13.825593 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-76e3283e-ce69-4655-a49e-26490d91b2ec tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:13.826069 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-76e3283e-ce69-4655-a49e-26490d91b2ec tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:13.826514 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-76e3283e-ce69-4655-a49e-26490d91b2ec tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:13.853902 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-76e3283e-ce69-4655-a49e-26490d91b2ec tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] [instance: 409594a8-f4cb-4da6-8c19-85ab4dbb09c4] Going to try to terminate instance {{(pid=123002) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:33:13.995498 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.compute.api [None req-76e3283e-ce69-4655-a49e-26490d91b2ec tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] [instance: 409594a8-f4cb-4da6-8c19-85ab4dbb09c4] Found an unconfirmed migration during delete, id: 16, status: finished Oct 04 19:33:15.324250 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-677f5dd8-5ae5-411a-89a4-743a60f291fd req-6c382f30-71a6-4659-a715-71592c55550e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "409594a8-f4cb-4da6-8c19-85ab4dbb09c4", "name": "network-vif-plugged", "status": "completed", "tag": "e7ab6992-880f-4927-bb9a-1723dd8cb0a8"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:33:15.334881 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-677f5dd8-5ae5-411a-89a4-743a60f291fd req-6c382f30-71a6-4659-a715-71592c55550e service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:15.335358 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-677f5dd8-5ae5-411a-89a4-743a60f291fd req-6c382f30-71a6-4659-a715-71592c55550e service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:15.335784 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-677f5dd8-5ae5-411a-89a4-743a60f291fd req-6c382f30-71a6-4659-a715-71592c55550e service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:15.347848 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-677f5dd8-5ae5-411a-89a4-743a60f291fd req-6c382f30-71a6-4659-a715-71592c55550e service nova] Creating event network-vif-plugged:e7ab6992-880f-4927-bb9a-1723dd8cb0a8 for instance 409594a8-f4cb-4da6-8c19-85ab4dbb09c4 on n-h2-850501-14 Oct 04 19:33:15.353591 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [req-677f5dd8-5ae5-411a-89a4-743a60f291fd req-6c382f30-71a6-4659-a715-71592c55550e service nova] Instance 409594a8-f4cb-4da6-8c19-85ab4dbb09c4 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850501-14', 'n-h2-850501-14'} {{(pid=123001) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:33:15.365152 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-677f5dd8-5ae5-411a-89a4-743a60f291fd req-6c382f30-71a6-4659-a715-71592c55550e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044549 Oct 04 19:33:15.365852 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3676/7337] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:33:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:33:16.331098 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-76e3283e-ce69-4655-a49e-26490d91b2ec tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] 10.222.0.20 "DELETE /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4" status: 204 len: 0 microversion: 2.1 time: 2.518196 Oct 04 19:33:16.335685 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3662/7338] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 19:33:13 2022] DELETE /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4 => generated 0 bytes in 2520 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:33:16.341133 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f44902fd-7e01-4f6c-af32-c6d156882370 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:33:16.341842 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f44902fd-7e01-4f6c-af32-c6d156882370 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] [instance: 409594a8-f4cb-4da6-8c19-85ab4dbb09c4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:33:16.348974 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f44902fd-7e01-4f6c-af32-c6d156882370 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:16.349473 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f44902fd-7e01-4f6c-af32-c6d156882370 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:16.349908 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f44902fd-7e01-4f6c-af32-c6d156882370 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:16.350657 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f44902fd-7e01-4f6c-af32-c6d156882370 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:16.352794 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f44902fd-7e01-4f6c-af32-c6d156882370 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:16.353270 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f44902fd-7e01-4f6c-af32-c6d156882370 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:16.484472 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f44902fd-7e01-4f6c-af32-c6d156882370 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853edbd2be6744118e1f54842bd6d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a290c8241f64ad4bde2d3027f1f880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:33:16.495484 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f44902fd-7e01-4f6c-af32-c6d156882370 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] 10.222.0.20 "GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4" status: 200 len: 1502 microversion: 2.1 time: 0.158802 Oct 04 19:33:16.496253 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3677/7339] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:33:16 2022] GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4 => generated 1502 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:33:17.521007 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-89f105e1-d1aa-4199-bc77-78cdf4135b4e tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:33:17.521759 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-89f105e1-d1aa-4199-bc77-78cdf4135b4e tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] [instance: 409594a8-f4cb-4da6-8c19-85ab4dbb09c4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:33:17.528728 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-89f105e1-d1aa-4199-bc77-78cdf4135b4e tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:17.529236 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-89f105e1-d1aa-4199-bc77-78cdf4135b4e tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:17.529687 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-89f105e1-d1aa-4199-bc77-78cdf4135b4e tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:17.530397 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-89f105e1-d1aa-4199-bc77-78cdf4135b4e tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:17.530868 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-89f105e1-d1aa-4199-bc77-78cdf4135b4e tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:17.531311 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-89f105e1-d1aa-4199-bc77-78cdf4135b4e tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:17.662088 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-89f105e1-d1aa-4199-bc77-78cdf4135b4e tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853edbd2be6744118e1f54842bd6d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a290c8241f64ad4bde2d3027f1f880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:33:17.669841 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-89f105e1-d1aa-4199-bc77-78cdf4135b4e tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] 10.222.0.20 "GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4" status: 200 len: 1502 microversion: 2.1 time: 0.153996 Oct 04 19:33:17.670419 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3663/7340] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:33:17 2022] GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4 => generated 1502 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:33:18.528477 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-50468211-01c9-4917-b054-1a58401f08e2 req-d1f06534-ba64-4245-a592-d0b5b5962952 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "409594a8-f4cb-4da6-8c19-85ab4dbb09c4", "name": "network-vif-deleted", "tag": "e7ab6992-880f-4927-bb9a-1723dd8cb0a8"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:33:18.540113 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-50468211-01c9-4917-b054-1a58401f08e2 req-d1f06534-ba64-4245-a592-d0b5b5962952 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:18.540598 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-50468211-01c9-4917-b054-1a58401f08e2 req-d1f06534-ba64-4245-a592-d0b5b5962952 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:18.541245 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-50468211-01c9-4917-b054-1a58401f08e2 req-d1f06534-ba64-4245-a592-d0b5b5962952 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:18.544428 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=86 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:33:18.554476 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-50468211-01c9-4917-b054-1a58401f08e2 req-d1f06534-ba64-4245-a592-d0b5b5962952 service nova] Creating event network-vif-deleted:e7ab6992-880f-4927-bb9a-1723dd8cb0a8 for instance 409594a8-f4cb-4da6-8c19-85ab4dbb09c4 on n-h2-850501-14 Oct 04 19:33:18.559600 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-50468211-01c9-4917-b054-1a58401f08e2 req-d1f06534-ba64-4245-a592-d0b5b5962952 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036995 Oct 04 19:33:18.560253 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3678/7341] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:33:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:33:18.694214 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-cec3dea5-9497-4b37-af79-e01d98497e05 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:33:18.694843 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-cec3dea5-9497-4b37-af79-e01d98497e05 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] [instance: 409594a8-f4cb-4da6-8c19-85ab4dbb09c4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:33:18.701798 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cec3dea5-9497-4b37-af79-e01d98497e05 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:18.702295 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cec3dea5-9497-4b37-af79-e01d98497e05 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:18.702747 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cec3dea5-9497-4b37-af79-e01d98497e05 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:18.703497 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cec3dea5-9497-4b37-af79-e01d98497e05 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:18.704018 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cec3dea5-9497-4b37-af79-e01d98497e05 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:18.706572 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cec3dea5-9497-4b37-af79-e01d98497e05 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:18.727398 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:33:18.782564 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-cec3dea5-9497-4b37-af79-e01d98497e05 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853edbd2be6744118e1f54842bd6d94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a290c8241f64ad4bde2d3027f1f880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:33:18.792365 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-cec3dea5-9497-4b37-af79-e01d98497e05 tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] 10.222.0.20 "GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4" status: 200 len: 1294 microversion: 2.1 time: 0.102942 Oct 04 19:33:18.792963 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3664/7342] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:33:18 2022] GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4 => generated 1294 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:33:19.818069 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a54309db-fdb8-4251-be19-77144b3f263a tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:33:19.818748 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a54309db-fdb8-4251-be19-77144b3f263a tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] [instance: 409594a8-f4cb-4da6-8c19-85ab4dbb09c4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:33:19.825139 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a54309db-fdb8-4251-be19-77144b3f263a tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:19.825629 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a54309db-fdb8-4251-be19-77144b3f263a tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:19.826075 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a54309db-fdb8-4251-be19-77144b3f263a tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:19.826773 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a54309db-fdb8-4251-be19-77144b3f263a tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:19.827236 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a54309db-fdb8-4251-be19-77144b3f263a tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:19.827668 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a54309db-fdb8-4251-be19-77144b3f263a tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:19.841702 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-a54309db-fdb8-4251-be19-77144b3f263a tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] HTTP exception thrown: Instance 409594a8-f4cb-4da6-8c19-85ab4dbb09c4 could not be found. Oct 04 19:33:19.843384 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a54309db-fdb8-4251-be19-77144b3f263a tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Request method failure captured: Oct 04 19:33:19.843384 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4 HTTP/1.1 Oct 04 19:33:19.843384 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 19:33:19.843384 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 19:33:19.843384 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 19:33:19.843384 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 19:33:19.843384 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 19:33:19.843384 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 19:33:19.843384 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 19:33:19.843384 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 19:33:19.843384 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPIo-gMgyv7uC2567mnwDlj-BxbEpCIoUo4JQNbVkOu6jun35BA61nOCz2WssXIlEwhYxHtBqXBhj9L45LnclvU8sLG3oEl717R5-uaMm_gq6cTTSgwEUAWAPraxoJTagC6VGRewsdwYV_l8U0WXbS1HYS5KJOyf7T6PyIwtS7s9unUY Oct 04 19:33:19.843384 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 19:33:19.843384 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 19:33:19.843384 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 19:33:19.843384 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 19:33:19.843384 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 19:33:19.843384 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 19:33:19.843384 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 0a290c8241f64ad4bde2d3027f1f880a Oct 04 19:33:19.843384 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-DeleteServersTestJSON-1896009472 Oct 04 19:33:19.843384 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 19:33:19.843384 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 19:33:19.843384 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0a290c8241f64ad4bde2d3027f1f880a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0a290c8241f64ad4bde2d3027f1f880a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0a290c8241f64ad4bde2d3027f1f880a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0a290c8241f64ad4bde2d3027f1f880a"}]}] Oct 04 19:33:19.843384 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-DeleteServersTestJSON-1896009472 Oct 04 19:33:19.843384 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 0a290c8241f64ad4bde2d3027f1f880a Oct 04 19:33:19.843384 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-DeleteServersTestJSON-1896009472 Oct 04 19:33:19.843384 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-DeleteServersTestJSON-1896009472-project Oct 04 19:33:19.843384 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 19:33:19.843384 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 19:33:19.843384 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 853edbd2be6744118e1f54842bd6d94d Oct 04 19:33:19.843384 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-DeleteServersTestJSON-1896009472-project Oct 04 19:33:19.843384 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 19:33:19.843384 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 409594a8-f4cb-4da6-8c19-85ab4dbb09c4 could not be found. Oct 04 19:33:19.843384 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '409594a8-f4cb-4da6-8c19-85ab4dbb09c4'} Oct 04 19:33:19.843384 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:33:19.843384 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:33:19.843384 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:33:19.843384 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:33:19.843384 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:33:19.843384 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:33:19.843384 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:33:19.843384 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:33:19.843384 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:33:19.843384 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:33:19.843384 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 409594a8-f4cb-4da6-8c19-85ab4dbb09c4 could not be found. Oct 04 19:33:19.843384 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:33:19.843384 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:33:19.843384 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:33:19.843384 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:33:19.843384 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:33:19.843384 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:33:19.843384 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:33:19.843384 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:33:19.843384 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:33:19.843384 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:33:19.843384 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:33:19.843384 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:33:19.843384 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:33:19.843384 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:33:19.843384 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:33:19.843384 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:33:19.843384 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 409594a8-f4cb-4da6-8c19-85ab4dbb09c4 could not be found. Oct 04 19:33:19.843384 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:33:19.843384 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:33:19.843384 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:33:19.849124 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:33:19.849124 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:33:19.849124 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:33:19.849124 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:33:19.849124 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:33:19.849124 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 409594a8-f4cb-4da6-8c19-85ab4dbb09c4 could not be found. Oct 04 19:33:19.849124 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:33:19.849124 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a54309db-fdb8-4251-be19-77144b3f263a tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Returning 404 to user: Instance 409594a8-f4cb-4da6-8c19-85ab4dbb09c4 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:33:19.849124 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a54309db-fdb8-4251-be19-77144b3f263a tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] 10.222.0.20 "GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4" status: 404 len: 111 microversion: 2.1 time: 0.032947 Oct 04 19:33:19.849124 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3679/7343] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:33:19 2022] GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:33:19.862720 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-83e0b5ea-0307-4729-b788-fb080909187b tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:33:19.863301 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-83e0b5ea-0307-4729-b788-fb080909187b tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] [instance: 409594a8-f4cb-4da6-8c19-85ab4dbb09c4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:33:19.865986 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:33:19.871043 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-83e0b5ea-0307-4729-b788-fb080909187b tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:19.871548 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-83e0b5ea-0307-4729-b788-fb080909187b tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:19.872008 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-83e0b5ea-0307-4729-b788-fb080909187b tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:19.872745 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-83e0b5ea-0307-4729-b788-fb080909187b tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:19.873259 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-83e0b5ea-0307-4729-b788-fb080909187b tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:19.877473 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-83e0b5ea-0307-4729-b788-fb080909187b tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:19.887084 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-83e0b5ea-0307-4729-b788-fb080909187b tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] HTTP exception thrown: Instance 409594a8-f4cb-4da6-8c19-85ab4dbb09c4 could not be found. Oct 04 19:33:19.888858 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-83e0b5ea-0307-4729-b788-fb080909187b tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Request method failure captured: Oct 04 19:33:19.888858 n-d-850501-14 devstack@n-api.service[123002]: request: DELETE /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4 HTTP/1.1 Oct 04 19:33:19.888858 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 19:33:19.888858 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 19:33:19.888858 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 19:33:19.888858 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 19:33:19.888858 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 19:33:19.888858 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 19:33:19.888858 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 19:33:19.888858 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 19:33:19.888858 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPIo-gMgyv7uC2567mnwDlj-BxbEpCIoUo4JQNbVkOu6jun35BA61nOCz2WssXIlEwhYxHtBqXBhj9L45LnclvU8sLG3oEl717R5-uaMm_gq6cTTSgwEUAWAPraxoJTagC6VGRewsdwYV_l8U0WXbS1HYS5KJOyf7T6PyIwtS7s9unUY Oct 04 19:33:19.888858 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 19:33:19.888858 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 19:33:19.888858 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 19:33:19.888858 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 19:33:19.888858 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 19:33:19.888858 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 19:33:19.888858 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 0a290c8241f64ad4bde2d3027f1f880a Oct 04 19:33:19.888858 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-DeleteServersTestJSON-1896009472 Oct 04 19:33:19.888858 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 19:33:19.888858 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 19:33:19.888858 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0a290c8241f64ad4bde2d3027f1f880a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0a290c8241f64ad4bde2d3027f1f880a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0a290c8241f64ad4bde2d3027f1f880a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0a290c8241f64ad4bde2d3027f1f880a"}]}] Oct 04 19:33:19.888858 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-DeleteServersTestJSON-1896009472 Oct 04 19:33:19.888858 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 0a290c8241f64ad4bde2d3027f1f880a Oct 04 19:33:19.888858 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-DeleteServersTestJSON-1896009472 Oct 04 19:33:19.888858 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-DeleteServersTestJSON-1896009472-project Oct 04 19:33:19.888858 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 19:33:19.888858 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 19:33:19.888858 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 853edbd2be6744118e1f54842bd6d94d Oct 04 19:33:19.888858 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-DeleteServersTestJSON-1896009472-project Oct 04 19:33:19.888858 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 19:33:19.888858 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 409594a8-f4cb-4da6-8c19-85ab4dbb09c4 could not be found. Oct 04 19:33:19.888858 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '409594a8-f4cb-4da6-8c19-85ab4dbb09c4'} Oct 04 19:33:19.888858 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:33:19.888858 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:33:19.888858 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:33:19.888858 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:33:19.888858 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:33:19.888858 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:33:19.888858 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:33:19.888858 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:33:19.888858 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:33:19.888858 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:33:19.888858 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 409594a8-f4cb-4da6-8c19-85ab4dbb09c4 could not be found. Oct 04 19:33:19.888858 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:33:19.888858 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:33:19.888858 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:33:19.888858 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:33:19.888858 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:33:19.888858 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:33:19.888858 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:33:19.888858 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:33:19.888858 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:33:19.888858 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:33:19.888858 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 19:33:19.888858 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 19:33:19.888858 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 19:33:19.888858 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 19:33:19.888858 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:33:19.888858 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:33:19.888858 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:33:19.888858 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:33:19.894682 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 409594a8-f4cb-4da6-8c19-85ab4dbb09c4 could not be found. Oct 04 19:33:19.894682 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:33:19.894682 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:33:19.894682 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:33:19.894682 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:33:19.894682 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:33:19.894682 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:33:19.894682 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:33:19.894682 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:33:19.894682 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 409594a8-f4cb-4da6-8c19-85ab4dbb09c4 could not be found. Oct 04 19:33:19.894682 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:33:19.894682 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-83e0b5ea-0307-4729-b788-fb080909187b tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Returning 404 to user: Instance 409594a8-f4cb-4da6-8c19-85ab4dbb09c4 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:33:19.894682 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-83e0b5ea-0307-4729-b788-fb080909187b tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] 10.222.0.20 "DELETE /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4" status: 404 len: 111 microversion: 2.1 time: 0.031900 Oct 04 19:33:19.894682 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3665/7344] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 19:33:19 2022] DELETE /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:33:19.899359 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-85929309-5dcf-4a4d-bdd4-dc9ea14f814c tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:33:19.900451 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-85929309-5dcf-4a4d-bdd4-dc9ea14f814c tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] [instance: 409594a8-f4cb-4da6-8c19-85ab4dbb09c4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:33:19.905968 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-85929309-5dcf-4a4d-bdd4-dc9ea14f814c tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:19.906488 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-85929309-5dcf-4a4d-bdd4-dc9ea14f814c tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:19.906922 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-85929309-5dcf-4a4d-bdd4-dc9ea14f814c tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:19.908527 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-85929309-5dcf-4a4d-bdd4-dc9ea14f814c tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:19.909049 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-85929309-5dcf-4a4d-bdd4-dc9ea14f814c tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:19.909353 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-85929309-5dcf-4a4d-bdd4-dc9ea14f814c tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:19.922604 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-85929309-5dcf-4a4d-bdd4-dc9ea14f814c tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] HTTP exception thrown: Instance 409594a8-f4cb-4da6-8c19-85ab4dbb09c4 could not be found. Oct 04 19:33:19.924395 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-85929309-5dcf-4a4d-bdd4-dc9ea14f814c tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Request method failure captured: Oct 04 19:33:19.924395 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4 HTTP/1.1 Oct 04 19:33:19.924395 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 19:33:19.924395 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 19:33:19.924395 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 19:33:19.924395 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 19:33:19.924395 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 19:33:19.924395 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 19:33:19.924395 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 19:33:19.924395 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 19:33:19.924395 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPIo-gMgyv7uC2567mnwDlj-BxbEpCIoUo4JQNbVkOu6jun35BA61nOCz2WssXIlEwhYxHtBqXBhj9L45LnclvU8sLG3oEl717R5-uaMm_gq6cTTSgwEUAWAPraxoJTagC6VGRewsdwYV_l8U0WXbS1HYS5KJOyf7T6PyIwtS7s9unUY Oct 04 19:33:19.924395 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 19:33:19.924395 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 19:33:19.924395 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 19:33:19.924395 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 19:33:19.924395 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 19:33:19.924395 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 19:33:19.924395 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 0a290c8241f64ad4bde2d3027f1f880a Oct 04 19:33:19.924395 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-DeleteServersTestJSON-1896009472 Oct 04 19:33:19.924395 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 19:33:19.924395 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 19:33:19.924395 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0a290c8241f64ad4bde2d3027f1f880a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0a290c8241f64ad4bde2d3027f1f880a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0a290c8241f64ad4bde2d3027f1f880a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0a290c8241f64ad4bde2d3027f1f880a"}]}] Oct 04 19:33:19.924395 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-DeleteServersTestJSON-1896009472 Oct 04 19:33:19.924395 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 0a290c8241f64ad4bde2d3027f1f880a Oct 04 19:33:19.924395 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-DeleteServersTestJSON-1896009472 Oct 04 19:33:19.924395 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-DeleteServersTestJSON-1896009472-project Oct 04 19:33:19.924395 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 19:33:19.924395 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 19:33:19.924395 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 853edbd2be6744118e1f54842bd6d94d Oct 04 19:33:19.924395 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-DeleteServersTestJSON-1896009472-project Oct 04 19:33:19.924395 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 19:33:19.924395 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 409594a8-f4cb-4da6-8c19-85ab4dbb09c4 could not be found. Oct 04 19:33:19.924395 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '409594a8-f4cb-4da6-8c19-85ab4dbb09c4'} Oct 04 19:33:19.924395 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:33:19.924395 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:33:19.924395 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:33:19.924395 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:33:19.924395 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:33:19.924395 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:33:19.924395 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:33:19.924395 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:33:19.924395 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:33:19.924395 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:33:19.924395 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 409594a8-f4cb-4da6-8c19-85ab4dbb09c4 could not be found. Oct 04 19:33:19.924395 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:33:19.924395 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:33:19.924395 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:33:19.924395 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:33:19.924395 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:33:19.924395 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:33:19.924395 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:33:19.924395 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:33:19.924395 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:33:19.924395 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:33:19.924395 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:33:19.924395 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:33:19.924395 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:33:19.924395 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:33:19.924395 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:33:19.924395 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:33:19.924395 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 409594a8-f4cb-4da6-8c19-85ab4dbb09c4 could not be found. Oct 04 19:33:19.924395 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:33:19.924395 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:33:19.924395 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:33:19.928705 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:33:19.928705 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:33:19.928705 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:33:19.928705 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:33:19.928705 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:33:19.928705 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 409594a8-f4cb-4da6-8c19-85ab4dbb09c4 could not be found. Oct 04 19:33:19.928705 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:33:19.928705 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-85929309-5dcf-4a4d-bdd4-dc9ea14f814c tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] Returning 404 to user: Instance 409594a8-f4cb-4da6-8c19-85ab4dbb09c4 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:33:19.928705 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-85929309-5dcf-4a4d-bdd4-dc9ea14f814c tempest-DeleteServersTestJSON-1896009472 tempest-DeleteServersTestJSON-1896009472-project] 10.222.0.20 "GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4" status: 404 len: 111 microversion: 2.1 time: 0.030329 Oct 04 19:33:19.928705 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3680/7345] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:33:19 2022] GET /compute/v2.1/servers/409594a8-f4cb-4da6-8c19-85ab4dbb09c4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:33:31.853880 n-d-850501-14 devstack@n-api.service[123002]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:33:31.854448 n-d-850501-14 devstack@n-api.service[123002]: Tue Oct 4 19:33:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.20) !!! Oct 04 19:33:31.981170 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5b47ff31-3540-43a9-8ace-6ca1cfa05b32 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1714924931", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": [{"uuid": "85e1bf8e-ea55-469a-99ed-8172579b5395"}]}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:33:32.037389 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-5b47ff31-3540-43a9-8ace-6ca1cfa05b32 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] validate_networks() for [('85e1bf8e-ea55-469a-99ed-8172579b5395', None, None, None, None, None)] {{(pid=123002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:33:32.419017 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-5b47ff31-3540-43a9-8ace-6ca1cfa05b32 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:33:32.419486 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-5b47ff31-3540-43a9-8ace-6ca1cfa05b32 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:33:32.420006 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-5b47ff31-3540-43a9-8ace-6ca1cfa05b32 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:33:32.420632 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-5b47ff31-3540-43a9-8ace-6ca1cfa05b32 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:33:32.420851 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-5b47ff31-3540-43a9-8ace-6ca1cfa05b32 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:33:32.430492 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5b47ff31-3540-43a9-8ace-6ca1cfa05b32 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:32.430990 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5b47ff31-3540-43a9-8ace-6ca1cfa05b32 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:32.433509 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5b47ff31-3540-43a9-8ace-6ca1cfa05b32 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:32.433509 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5b47ff31-3540-43a9-8ace-6ca1cfa05b32 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:32.433509 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5b47ff31-3540-43a9-8ace-6ca1cfa05b32 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:32.433509 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5b47ff31-3540-43a9-8ace-6ca1cfa05b32 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:32.455197 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-5b47ff31-3540-43a9-8ace-6ca1cfa05b32 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Getting quotas for project 1ca71f9591344456835761dc8045b825. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:33:32.461174 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-5b47ff31-3540-43a9-8ace-6ca1cfa05b32 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Getting quotas for user 1dedbd53c8584342a20523734518e591 and project 1ca71f9591344456835761dc8045b825. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:33:32.475932 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5b47ff31-3540-43a9-8ace-6ca1cfa05b32 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Going to run 1 instances... {{(pid=123002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:33:32.478465 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5b47ff31-3540-43a9-8ace-6ca1cfa05b32 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: aa3449d4-ab06-4f06-af64-0ab74bf57b50] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:33:32.641123 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5b47ff31-3540-43a9-8ace-6ca1cfa05b32 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.793800 Oct 04 19:33:32.642667 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3666/7346] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 19:33:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 796 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:33:32.655935 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e821fb1c-9773-4e23-9aaf-51be658fa4bc tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:33:32.656608 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e821fb1c-9773-4e23-9aaf-51be658fa4bc tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: aa3449d4-ab06-4f06-af64-0ab74bf57b50] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:33:32.660467 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=33 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:33:32.661160 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=5 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:33:32.733677 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e821fb1c-9773-4e23-9aaf-51be658fa4bc tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:33:32.746892 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e821fb1c-9773-4e23-9aaf-51be658fa4bc tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50" status: 200 len: 1218 microversion: 2.1 time: 0.095125 Oct 04 19:33:32.747497 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3681/7347] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:33:32 2022] GET /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50 => generated 1218 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:33:33.774291 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ad046cba-368c-424e-942d-8d63fd11f926 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:33:33.774921 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ad046cba-368c-424e-942d-8d63fd11f926 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: aa3449d4-ab06-4f06-af64-0ab74bf57b50] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:33:33.832097 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ad046cba-368c-424e-942d-8d63fd11f926 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:33:33.839127 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ad046cba-368c-424e-942d-8d63fd11f926 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50" status: 200 len: 1218 microversion: 2.1 time: 0.070125 Oct 04 19:33:33.839700 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3667/7348] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:33:33 2022] GET /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50 => generated 1218 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:33:34.863637 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a027a72d-2f5a-4cbc-a669-f438cac5d1ff tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:33:34.864303 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a027a72d-2f5a-4cbc-a669-f438cac5d1ff tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: aa3449d4-ab06-4f06-af64-0ab74bf57b50] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:33:34.872242 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a027a72d-2f5a-4cbc-a669-f438cac5d1ff tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:34.872744 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a027a72d-2f5a-4cbc-a669-f438cac5d1ff tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:34.873189 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a027a72d-2f5a-4cbc-a669-f438cac5d1ff tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:34.873905 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a027a72d-2f5a-4cbc-a669-f438cac5d1ff tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:34.874529 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a027a72d-2f5a-4cbc-a669-f438cac5d1ff tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:34.874805 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a027a72d-2f5a-4cbc-a669-f438cac5d1ff tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:34.946850 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a027a72d-2f5a-4cbc-a669-f438cac5d1ff tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:33:34.955686 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a027a72d-2f5a-4cbc-a669-f438cac5d1ff tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50" status: 200 len: 1270 microversion: 2.1 time: 0.096663 Oct 04 19:33:34.956317 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3682/7349] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:33:34 2022] GET /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50 => generated 1270 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:33:35.979342 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b23dd79c-87ec-47b4-a858-a2c7825f3e74 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:33:35.980141 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b23dd79c-87ec-47b4-a858-a2c7825f3e74 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: aa3449d4-ab06-4f06-af64-0ab74bf57b50] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:33:35.988336 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b23dd79c-87ec-47b4-a858-a2c7825f3e74 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:35.988848 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b23dd79c-87ec-47b4-a858-a2c7825f3e74 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:35.989308 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b23dd79c-87ec-47b4-a858-a2c7825f3e74 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:35.990180 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b23dd79c-87ec-47b4-a858-a2c7825f3e74 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:35.990648 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b23dd79c-87ec-47b4-a858-a2c7825f3e74 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:35.991096 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b23dd79c-87ec-47b4-a858-a2c7825f3e74 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:36.096142 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b23dd79c-87ec-47b4-a858-a2c7825f3e74 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:33:36.105018 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b23dd79c-87ec-47b4-a858-a2c7825f3e74 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50" status: 200 len: 1276 microversion: 2.1 time: 0.129736 Oct 04 19:33:36.106934 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3668/7350] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:33:35 2022] GET /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50 => generated 1276 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:33:37.135460 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c649fb02-9a10-4f1e-808c-79924ba04dff tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:33:37.136236 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c649fb02-9a10-4f1e-808c-79924ba04dff tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: aa3449d4-ab06-4f06-af64-0ab74bf57b50] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:33:37.143849 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c649fb02-9a10-4f1e-808c-79924ba04dff tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:37.144421 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c649fb02-9a10-4f1e-808c-79924ba04dff tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:37.144906 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c649fb02-9a10-4f1e-808c-79924ba04dff tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:37.145631 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c649fb02-9a10-4f1e-808c-79924ba04dff tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:37.146100 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c649fb02-9a10-4f1e-808c-79924ba04dff tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:37.146532 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c649fb02-9a10-4f1e-808c-79924ba04dff tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:37.361197 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c649fb02-9a10-4f1e-808c-79924ba04dff tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:33:37.369219 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c649fb02-9a10-4f1e-808c-79924ba04dff tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50" status: 200 len: 1318 microversion: 2.1 time: 0.237776 Oct 04 19:33:37.369817 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3683/7351] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:33:37 2022] GET /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50 => generated 1318 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:33:37.820290 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-ef32f318-bbcb-4bce-9ef2-3254cde4322a req-7457c899-9198-4374-836b-50d8d794ca04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa3449d4-ab06-4f06-af64-0ab74bf57b50", "tag": "f011e11b-228c-4121-980c-b83994ab63ac"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:33:37.830633 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-ef32f318-bbcb-4bce-9ef2-3254cde4322a req-7457c899-9198-4374-836b-50d8d794ca04 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:37.831118 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-ef32f318-bbcb-4bce-9ef2-3254cde4322a req-7457c899-9198-4374-836b-50d8d794ca04 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:37.831565 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-ef32f318-bbcb-4bce-9ef2-3254cde4322a req-7457c899-9198-4374-836b-50d8d794ca04 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:37.843160 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-ef32f318-bbcb-4bce-9ef2-3254cde4322a req-7457c899-9198-4374-836b-50d8d794ca04 service nova] Creating event network-changed:f011e11b-228c-4121-980c-b83994ab63ac for instance aa3449d4-ab06-4f06-af64-0ab74bf57b50 on n-h1-850501-14 Oct 04 19:33:37.849090 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-ef32f318-bbcb-4bce-9ef2-3254cde4322a req-7457c899-9198-4374-836b-50d8d794ca04 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032682 Oct 04 19:33:37.849849 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3669/7352] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:33:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:33:38.392857 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-34fd349a-aab1-4ee1-8718-78807d44383a tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:33:38.393499 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-34fd349a-aab1-4ee1-8718-78807d44383a tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: aa3449d4-ab06-4f06-af64-0ab74bf57b50] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:33:38.400793 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-34fd349a-aab1-4ee1-8718-78807d44383a tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:38.401277 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-34fd349a-aab1-4ee1-8718-78807d44383a tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:38.401708 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-34fd349a-aab1-4ee1-8718-78807d44383a tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:38.402403 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-34fd349a-aab1-4ee1-8718-78807d44383a tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:38.402854 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-34fd349a-aab1-4ee1-8718-78807d44383a tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:38.403280 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-34fd349a-aab1-4ee1-8718-78807d44383a tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:38.612873 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-34fd349a-aab1-4ee1-8718-78807d44383a tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:33:38.620422 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-34fd349a-aab1-4ee1-8718-78807d44383a tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50" status: 200 len: 1318 microversion: 2.1 time: 0.231397 Oct 04 19:33:38.620992 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3684/7353] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:33:38 2022] GET /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50 => generated 1318 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:33:39.646039 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f1f2ae5d-2722-4700-9e13-86d50f2ee219 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:33:39.646758 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f1f2ae5d-2722-4700-9e13-86d50f2ee219 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: aa3449d4-ab06-4f06-af64-0ab74bf57b50] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:33:39.653003 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f1f2ae5d-2722-4700-9e13-86d50f2ee219 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:39.653505 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f1f2ae5d-2722-4700-9e13-86d50f2ee219 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:39.653957 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f1f2ae5d-2722-4700-9e13-86d50f2ee219 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:39.654664 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f1f2ae5d-2722-4700-9e13-86d50f2ee219 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:39.655131 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f1f2ae5d-2722-4700-9e13-86d50f2ee219 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:39.655580 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f1f2ae5d-2722-4700-9e13-86d50f2ee219 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:39.788615 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f1f2ae5d-2722-4700-9e13-86d50f2ee219 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:33:39.796330 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f1f2ae5d-2722-4700-9e13-86d50f2ee219 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50" status: 200 len: 1318 microversion: 2.1 time: 0.156214 Oct 04 19:33:39.796902 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3670/7354] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:33:39 2022] GET /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:33:40.820500 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2eae4bf7-07c9-4f55-8228-97b93fa64c9c tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:33:40.821513 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2eae4bf7-07c9-4f55-8228-97b93fa64c9c tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: aa3449d4-ab06-4f06-af64-0ab74bf57b50] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:33:40.829874 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2eae4bf7-07c9-4f55-8228-97b93fa64c9c tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:40.830421 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2eae4bf7-07c9-4f55-8228-97b93fa64c9c tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:40.830917 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2eae4bf7-07c9-4f55-8228-97b93fa64c9c tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:40.831666 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2eae4bf7-07c9-4f55-8228-97b93fa64c9c tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:40.832191 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2eae4bf7-07c9-4f55-8228-97b93fa64c9c tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:40.832668 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2eae4bf7-07c9-4f55-8228-97b93fa64c9c tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:40.970337 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-2eae4bf7-07c9-4f55-8228-97b93fa64c9c tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:33:40.978553 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2eae4bf7-07c9-4f55-8228-97b93fa64c9c tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50" status: 200 len: 1318 microversion: 2.1 time: 0.163169 Oct 04 19:33:40.979125 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3685/7355] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:33:40 2022] GET /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:33:42.003701 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-aaacc4dd-2b29-4811-86a9-7a5e5dbf01f4 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:33:42.004330 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-aaacc4dd-2b29-4811-86a9-7a5e5dbf01f4 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: aa3449d4-ab06-4f06-af64-0ab74bf57b50] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:33:42.011091 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aaacc4dd-2b29-4811-86a9-7a5e5dbf01f4 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:42.011594 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aaacc4dd-2b29-4811-86a9-7a5e5dbf01f4 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:42.012068 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aaacc4dd-2b29-4811-86a9-7a5e5dbf01f4 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:42.012784 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aaacc4dd-2b29-4811-86a9-7a5e5dbf01f4 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:42.013258 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aaacc4dd-2b29-4811-86a9-7a5e5dbf01f4 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:42.013706 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aaacc4dd-2b29-4811-86a9-7a5e5dbf01f4 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:42.145024 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-aaacc4dd-2b29-4811-86a9-7a5e5dbf01f4 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:33:42.152724 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-aaacc4dd-2b29-4811-86a9-7a5e5dbf01f4 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50" status: 200 len: 1318 microversion: 2.1 time: 0.153905 Oct 04 19:33:42.153286 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3671/7356] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:33:41 2022] GET /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:33:43.174847 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2e63dc0c-0592-44a4-8718-04466055fd95 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:33:43.175485 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2e63dc0c-0592-44a4-8718-04466055fd95 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: aa3449d4-ab06-4f06-af64-0ab74bf57b50] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:33:43.178239 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:33:43.183032 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2e63dc0c-0592-44a4-8718-04466055fd95 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:43.183523 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2e63dc0c-0592-44a4-8718-04466055fd95 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:43.183965 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2e63dc0c-0592-44a4-8718-04466055fd95 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:43.184693 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2e63dc0c-0592-44a4-8718-04466055fd95 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:43.185151 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2e63dc0c-0592-44a4-8718-04466055fd95 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:43.185585 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2e63dc0c-0592-44a4-8718-04466055fd95 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:43.316177 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-2e63dc0c-0592-44a4-8718-04466055fd95 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:33:43.323970 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2e63dc0c-0592-44a4-8718-04466055fd95 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50" status: 200 len: 1318 microversion: 2.1 time: 0.153078 Oct 04 19:33:43.324569 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3686/7357] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:33:43 2022] GET /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:33:44.353896 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a5eafb50-081f-44de-85a3-030cad503732 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:33:44.354553 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a5eafb50-081f-44de-85a3-030cad503732 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: aa3449d4-ab06-4f06-af64-0ab74bf57b50] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:33:44.356721 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:33:44.358288 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=8 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:33:44.363694 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a5eafb50-081f-44de-85a3-030cad503732 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:44.368837 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a5eafb50-081f-44de-85a3-030cad503732 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:44.368837 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a5eafb50-081f-44de-85a3-030cad503732 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:44.368837 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a5eafb50-081f-44de-85a3-030cad503732 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:44.368837 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a5eafb50-081f-44de-85a3-030cad503732 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:44.368837 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a5eafb50-081f-44de-85a3-030cad503732 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:44.502614 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a5eafb50-081f-44de-85a3-030cad503732 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:33:44.511132 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a5eafb50-081f-44de-85a3-030cad503732 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50" status: 200 len: 1318 microversion: 2.1 time: 0.161061 Oct 04 19:33:44.511712 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3672/7358] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:33:44 2022] GET /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:33:44.747987 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-e63e9ed1-e072-45b9-a5fd-831a14a178c3 req-b596dc08-4d4f-4f1f-81d7-efcb86fe6e6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa3449d4-ab06-4f06-af64-0ab74bf57b50", "name": "network-vif-plugged", "status": "completed", "tag": "f011e11b-228c-4121-980c-b83994ab63ac"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:33:44.758542 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-e63e9ed1-e072-45b9-a5fd-831a14a178c3 req-b596dc08-4d4f-4f1f-81d7-efcb86fe6e6b service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:44.759032 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-e63e9ed1-e072-45b9-a5fd-831a14a178c3 req-b596dc08-4d4f-4f1f-81d7-efcb86fe6e6b service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:44.759475 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-e63e9ed1-e072-45b9-a5fd-831a14a178c3 req-b596dc08-4d4f-4f1f-81d7-efcb86fe6e6b service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:44.771063 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-e63e9ed1-e072-45b9-a5fd-831a14a178c3 req-b596dc08-4d4f-4f1f-81d7-efcb86fe6e6b service nova] Creating event network-vif-plugged:f011e11b-228c-4121-980c-b83994ab63ac for instance aa3449d4-ab06-4f06-af64-0ab74bf57b50 on n-h1-850501-14 Oct 04 19:33:44.776253 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-e63e9ed1-e072-45b9-a5fd-831a14a178c3 req-b596dc08-4d4f-4f1f-81d7-efcb86fe6e6b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032023 Oct 04 19:33:44.776900 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3687/7359] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:33:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:33:45.534905 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d3621c7b-dd20-46a5-b3bb-c2d10bcd7242 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:33:45.535541 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d3621c7b-dd20-46a5-b3bb-c2d10bcd7242 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: aa3449d4-ab06-4f06-af64-0ab74bf57b50] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:33:45.542304 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d3621c7b-dd20-46a5-b3bb-c2d10bcd7242 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:45.542836 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d3621c7b-dd20-46a5-b3bb-c2d10bcd7242 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:45.543294 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d3621c7b-dd20-46a5-b3bb-c2d10bcd7242 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:45.544005 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d3621c7b-dd20-46a5-b3bb-c2d10bcd7242 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:45.544509 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d3621c7b-dd20-46a5-b3bb-c2d10bcd7242 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:45.544955 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d3621c7b-dd20-46a5-b3bb-c2d10bcd7242 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:45.683806 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d3621c7b-dd20-46a5-b3bb-c2d10bcd7242 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:33:45.691767 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d3621c7b-dd20-46a5-b3bb-c2d10bcd7242 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50" status: 200 len: 1318 microversion: 2.1 time: 0.161072 Oct 04 19:33:45.692386 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3673/7360] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:33:45 2022] GET /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:33:46.716226 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f55b6463-195b-4871-8dff-f4c4d855920a tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:33:46.716944 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f55b6463-195b-4871-8dff-f4c4d855920a tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: aa3449d4-ab06-4f06-af64-0ab74bf57b50] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:33:46.723673 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f55b6463-195b-4871-8dff-f4c4d855920a tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:46.724199 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f55b6463-195b-4871-8dff-f4c4d855920a tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:46.724649 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f55b6463-195b-4871-8dff-f4c4d855920a tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:46.725352 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f55b6463-195b-4871-8dff-f4c4d855920a tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:46.725818 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f55b6463-195b-4871-8dff-f4c4d855920a tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:46.726249 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f55b6463-195b-4871-8dff-f4c4d855920a tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:46.860362 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f55b6463-195b-4871-8dff-f4c4d855920a tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:33:46.868769 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f55b6463-195b-4871-8dff-f4c4d855920a tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50" status: 200 len: 1509 microversion: 2.1 time: 0.157985 Oct 04 19:33:46.869339 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3688/7361] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:33:46 2022] GET /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50 => generated 1509 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:33:46.891609 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9a1053e5-304a-4766-9d89-a99a58f488e5 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:33:46.892266 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9a1053e5-304a-4766-9d89-a99a58f488e5 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: aa3449d4-ab06-4f06-af64-0ab74bf57b50] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:33:46.899216 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9a1053e5-304a-4766-9d89-a99a58f488e5 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:46.899706 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9a1053e5-304a-4766-9d89-a99a58f488e5 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:46.900208 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9a1053e5-304a-4766-9d89-a99a58f488e5 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:46.900907 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9a1053e5-304a-4766-9d89-a99a58f488e5 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:46.901371 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9a1053e5-304a-4766-9d89-a99a58f488e5 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:46.901803 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9a1053e5-304a-4766-9d89-a99a58f488e5 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:47.035146 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9a1053e5-304a-4766-9d89-a99a58f488e5 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:33:47.042890 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9a1053e5-304a-4766-9d89-a99a58f488e5 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50" status: 200 len: 1509 microversion: 2.1 time: 0.155087 Oct 04 19:33:47.043475 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3674/7362] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:33:46 2022] GET /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50 => generated 1509 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:33:47.065087 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c83c72dd-0974-4067-b496-a5a510e4bc78 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:33:47.068099 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c83c72dd-0974-4067-b496-a5a510e4bc78 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: aa3449d4-ab06-4f06-af64-0ab74bf57b50] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:33:47.074043 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c83c72dd-0974-4067-b496-a5a510e4bc78 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:47.074522 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c83c72dd-0974-4067-b496-a5a510e4bc78 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:47.074958 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c83c72dd-0974-4067-b496-a5a510e4bc78 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:47.075642 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c83c72dd-0974-4067-b496-a5a510e4bc78 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:47.076120 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c83c72dd-0974-4067-b496-a5a510e4bc78 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:47.076550 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c83c72dd-0974-4067-b496-a5a510e4bc78 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:47.191055 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c83c72dd-0974-4067-b496-a5a510e4bc78 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "PUT /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50" status: 200 len: 1081 microversion: 2.1 time: 0.129229 Oct 04 19:33:47.191694 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3689/7363] 10.222.0.20 () {60 vars in 1256 bytes} [Tue Oct 4 19:33:47 2022] PUT /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50 => generated 1081 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:33:47.210835 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-90521d78-0a2c-45a1-80d2-4db8a021ff85 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:33:47.211468 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-90521d78-0a2c-45a1-80d2-4db8a021ff85 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: aa3449d4-ab06-4f06-af64-0ab74bf57b50] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:33:47.217416 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-90521d78-0a2c-45a1-80d2-4db8a021ff85 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:47.217949 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-90521d78-0a2c-45a1-80d2-4db8a021ff85 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:47.218403 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-90521d78-0a2c-45a1-80d2-4db8a021ff85 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:47.219380 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-90521d78-0a2c-45a1-80d2-4db8a021ff85 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:47.219853 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-90521d78-0a2c-45a1-80d2-4db8a021ff85 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:47.220674 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-90521d78-0a2c-45a1-80d2-4db8a021ff85 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:47.354694 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-90521d78-0a2c-45a1-80d2-4db8a021ff85 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:33:47.362726 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-90521d78-0a2c-45a1-80d2-4db8a021ff85 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50" status: 200 len: 1507 microversion: 2.1 time: 0.156341 Oct 04 19:33:47.368436 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3675/7364] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:33:47 2022] GET /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50 => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:33:47.385196 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0eb17331-5189-47de-84a9-cb1e77c5b31b tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:33:47.385814 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0eb17331-5189-47de-84a9-cb1e77c5b31b tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: aa3449d4-ab06-4f06-af64-0ab74bf57b50] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:33:47.391783 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0eb17331-5189-47de-84a9-cb1e77c5b31b tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:47.392314 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0eb17331-5189-47de-84a9-cb1e77c5b31b tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:47.392760 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0eb17331-5189-47de-84a9-cb1e77c5b31b tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:47.394115 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0eb17331-5189-47de-84a9-cb1e77c5b31b tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:47.394579 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0eb17331-5189-47de-84a9-cb1e77c5b31b tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:47.395013 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0eb17331-5189-47de-84a9-cb1e77c5b31b tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:47.526085 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0eb17331-5189-47de-84a9-cb1e77c5b31b tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:33:47.533933 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0eb17331-5189-47de-84a9-cb1e77c5b31b tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50" status: 200 len: 1507 microversion: 2.1 time: 0.152580 Oct 04 19:33:47.534731 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3690/7365] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:33:47 2022] GET /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50 => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:33:47.557515 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ead85a5a-267f-4580-9435-925314433f36 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:33:47.559787 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ead85a5a-267f-4580-9435-925314433f36 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: aa3449d4-ab06-4f06-af64-0ab74bf57b50] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:33:47.566604 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ead85a5a-267f-4580-9435-925314433f36 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:47.567104 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ead85a5a-267f-4580-9435-925314433f36 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:47.567548 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ead85a5a-267f-4580-9435-925314433f36 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:47.568297 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ead85a5a-267f-4580-9435-925314433f36 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:47.568760 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ead85a5a-267f-4580-9435-925314433f36 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:47.569192 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ead85a5a-267f-4580-9435-925314433f36 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:47.597453 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ead85a5a-267f-4580-9435-925314433f36 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:33:47.602804 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ead85a5a-267f-4580-9435-925314433f36 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: aa3449d4-ab06-4f06-af64-0ab74bf57b50] Old instance type m1.heat2, new instance type m1.heat {{(pid=123002) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 19:33:47.609131 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-ead85a5a-267f-4580-9435-925314433f36 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:33:47.609561 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-ead85a5a-267f-4580-9435-925314433f36 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:33:47.610073 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-ead85a5a-267f-4580-9435-925314433f36 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:33:47.610496 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-ead85a5a-267f-4580-9435-925314433f36 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:33:47.610918 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-ead85a5a-267f-4580-9435-925314433f36 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:33:47.808164 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ead85a5a-267f-4580-9435-925314433f36 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "POST /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50/action" status: 202 len: 0 microversion: 2.1 time: 0.254960 Oct 04 19:33:47.809136 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3676/7366] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 19:33:47 2022] POST /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50/action => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:33:47.817622 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5ef65e2b-c268-4012-8cdc-0bcab65c37d7 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:33:47.818490 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5ef65e2b-c268-4012-8cdc-0bcab65c37d7 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: aa3449d4-ab06-4f06-af64-0ab74bf57b50] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:33:47.825583 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5ef65e2b-c268-4012-8cdc-0bcab65c37d7 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:47.826075 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5ef65e2b-c268-4012-8cdc-0bcab65c37d7 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:47.826518 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5ef65e2b-c268-4012-8cdc-0bcab65c37d7 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:47.827264 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5ef65e2b-c268-4012-8cdc-0bcab65c37d7 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:47.827727 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5ef65e2b-c268-4012-8cdc-0bcab65c37d7 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:47.828192 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5ef65e2b-c268-4012-8cdc-0bcab65c37d7 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:47.965022 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5ef65e2b-c268-4012-8cdc-0bcab65c37d7 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:33:47.973219 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5ef65e2b-c268-4012-8cdc-0bcab65c37d7 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50" status: 200 len: 1518 microversion: 2.1 time: 0.160188 Oct 04 19:33:47.973802 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3691/7367] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:33:47 2022] GET /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50 => generated 1518 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:33:48.998401 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-10f40d6e-72df-4fdf-a12c-b15648f8d73e tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:33:48.999006 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-10f40d6e-72df-4fdf-a12c-b15648f8d73e tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: aa3449d4-ab06-4f06-af64-0ab74bf57b50] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:33:49.006822 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-10f40d6e-72df-4fdf-a12c-b15648f8d73e tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:49.007342 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-10f40d6e-72df-4fdf-a12c-b15648f8d73e tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:49.007787 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-10f40d6e-72df-4fdf-a12c-b15648f8d73e tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:49.008540 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-10f40d6e-72df-4fdf-a12c-b15648f8d73e tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:49.009018 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-10f40d6e-72df-4fdf-a12c-b15648f8d73e tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:49.009461 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-10f40d6e-72df-4fdf-a12c-b15648f8d73e tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:49.142503 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-10f40d6e-72df-4fdf-a12c-b15648f8d73e tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:33:49.150822 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-10f40d6e-72df-4fdf-a12c-b15648f8d73e tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50" status: 200 len: 1518 microversion: 2.1 time: 0.158034 Oct 04 19:33:49.151408 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3677/7368] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:33:48 2022] GET /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50 => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:33:50.175526 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a442b87a-ed6b-440d-9dd4-5504b7ee7fa3 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:33:50.176797 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a442b87a-ed6b-440d-9dd4-5504b7ee7fa3 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: aa3449d4-ab06-4f06-af64-0ab74bf57b50] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:33:50.183768 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a442b87a-ed6b-440d-9dd4-5504b7ee7fa3 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:50.184325 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a442b87a-ed6b-440d-9dd4-5504b7ee7fa3 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:50.184774 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a442b87a-ed6b-440d-9dd4-5504b7ee7fa3 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:50.185472 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a442b87a-ed6b-440d-9dd4-5504b7ee7fa3 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:50.185932 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a442b87a-ed6b-440d-9dd4-5504b7ee7fa3 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:50.186367 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a442b87a-ed6b-440d-9dd4-5504b7ee7fa3 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:50.319146 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a442b87a-ed6b-440d-9dd4-5504b7ee7fa3 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:33:50.328044 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a442b87a-ed6b-440d-9dd4-5504b7ee7fa3 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50" status: 200 len: 1518 microversion: 2.1 time: 0.156429 Oct 04 19:33:50.328719 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3692/7369] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:33:50 2022] GET /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50 => generated 1518 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:33:51.352363 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4e860ebc-9ecd-4b53-a874-5cf38af012a3 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:33:51.353001 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4e860ebc-9ecd-4b53-a874-5cf38af012a3 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: aa3449d4-ab06-4f06-af64-0ab74bf57b50] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:33:51.359930 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4e860ebc-9ecd-4b53-a874-5cf38af012a3 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:51.360486 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4e860ebc-9ecd-4b53-a874-5cf38af012a3 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:51.360942 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4e860ebc-9ecd-4b53-a874-5cf38af012a3 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:51.361663 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4e860ebc-9ecd-4b53-a874-5cf38af012a3 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:51.362142 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4e860ebc-9ecd-4b53-a874-5cf38af012a3 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:51.362589 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4e860ebc-9ecd-4b53-a874-5cf38af012a3 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:51.500868 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4e860ebc-9ecd-4b53-a874-5cf38af012a3 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:33:51.509443 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4e860ebc-9ecd-4b53-a874-5cf38af012a3 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50" status: 200 len: 1518 microversion: 2.1 time: 0.161274 Oct 04 19:33:51.510015 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3678/7370] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:33:51 2022] GET /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50 => generated 1518 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:33:52.532512 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4b4f0e3a-acbb-4ffc-9ad0-9b3def619aec tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:33:52.533138 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-4b4f0e3a-acbb-4ffc-9ad0-9b3def619aec tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: aa3449d4-ab06-4f06-af64-0ab74bf57b50] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:33:52.540633 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4b4f0e3a-acbb-4ffc-9ad0-9b3def619aec tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:52.541249 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4b4f0e3a-acbb-4ffc-9ad0-9b3def619aec tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:52.541770 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4b4f0e3a-acbb-4ffc-9ad0-9b3def619aec tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:52.549452 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4b4f0e3a-acbb-4ffc-9ad0-9b3def619aec tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:52.549452 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4b4f0e3a-acbb-4ffc-9ad0-9b3def619aec tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:52.549452 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4b4f0e3a-acbb-4ffc-9ad0-9b3def619aec tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:52.676350 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-4b4f0e3a-acbb-4ffc-9ad0-9b3def619aec tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:33:52.684393 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-4b4f0e3a-acbb-4ffc-9ad0-9b3def619aec tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50" status: 200 len: 1523 microversion: 2.1 time: 0.155976 Oct 04 19:33:52.684971 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3693/7371] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:33:52 2022] GET /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:33:53.709007 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-445254a0-f247-41a1-a17d-e6a0f0625699 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:33:53.709908 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-445254a0-f247-41a1-a17d-e6a0f0625699 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: aa3449d4-ab06-4f06-af64-0ab74bf57b50] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:33:53.717179 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-445254a0-f247-41a1-a17d-e6a0f0625699 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:53.717686 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-445254a0-f247-41a1-a17d-e6a0f0625699 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:53.718135 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-445254a0-f247-41a1-a17d-e6a0f0625699 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:53.719108 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-445254a0-f247-41a1-a17d-e6a0f0625699 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:53.719571 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-445254a0-f247-41a1-a17d-e6a0f0625699 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:53.720005 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-445254a0-f247-41a1-a17d-e6a0f0625699 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:53.860568 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-445254a0-f247-41a1-a17d-e6a0f0625699 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:33:53.864307 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-445254a0-f247-41a1-a17d-e6a0f0625699 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50" status: 200 len: 1523 microversion: 2.1 time: 0.159260 Oct 04 19:33:53.864888 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3679/7372] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:33:53 2022] GET /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:33:54.888204 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8cc7a146-8fed-446d-8643-901d9e59dafd tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:33:54.888823 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8cc7a146-8fed-446d-8643-901d9e59dafd tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: aa3449d4-ab06-4f06-af64-0ab74bf57b50] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:33:54.895890 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8cc7a146-8fed-446d-8643-901d9e59dafd tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:54.896451 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8cc7a146-8fed-446d-8643-901d9e59dafd tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:54.896982 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8cc7a146-8fed-446d-8643-901d9e59dafd tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:54.897673 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8cc7a146-8fed-446d-8643-901d9e59dafd tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:54.898230 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8cc7a146-8fed-446d-8643-901d9e59dafd tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:54.898662 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8cc7a146-8fed-446d-8643-901d9e59dafd tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:55.028943 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8cc7a146-8fed-446d-8643-901d9e59dafd tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:33:55.036664 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8cc7a146-8fed-446d-8643-901d9e59dafd tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50" status: 200 len: 1523 microversion: 2.1 time: 0.152466 Oct 04 19:33:55.037938 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3694/7373] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:33:54 2022] GET /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:33:56.061406 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e97b87fc-3de5-448f-a5b9-8f2a1e7add2d tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:33:56.062196 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e97b87fc-3de5-448f-a5b9-8f2a1e7add2d tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: aa3449d4-ab06-4f06-af64-0ab74bf57b50] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:33:56.069890 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e97b87fc-3de5-448f-a5b9-8f2a1e7add2d tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:56.070404 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e97b87fc-3de5-448f-a5b9-8f2a1e7add2d tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:56.070855 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e97b87fc-3de5-448f-a5b9-8f2a1e7add2d tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:56.071696 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e97b87fc-3de5-448f-a5b9-8f2a1e7add2d tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:56.072034 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e97b87fc-3de5-448f-a5b9-8f2a1e7add2d tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:56.072501 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e97b87fc-3de5-448f-a5b9-8f2a1e7add2d tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:56.208091 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e97b87fc-3de5-448f-a5b9-8f2a1e7add2d tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:33:56.216040 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e97b87fc-3de5-448f-a5b9-8f2a1e7add2d tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50" status: 200 len: 1523 microversion: 2.1 time: 0.158684 Oct 04 19:33:56.216633 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3680/7374] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:33:56 2022] GET /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:33:57.239765 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6c6b8128-09f2-4b01-9c89-0b064b2a7b73 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:33:57.240941 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6c6b8128-09f2-4b01-9c89-0b064b2a7b73 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: aa3449d4-ab06-4f06-af64-0ab74bf57b50] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:33:57.248006 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6c6b8128-09f2-4b01-9c89-0b064b2a7b73 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:57.248573 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6c6b8128-09f2-4b01-9c89-0b064b2a7b73 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:57.249054 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6c6b8128-09f2-4b01-9c89-0b064b2a7b73 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:57.249759 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6c6b8128-09f2-4b01-9c89-0b064b2a7b73 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:57.250221 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6c6b8128-09f2-4b01-9c89-0b064b2a7b73 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:57.250658 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6c6b8128-09f2-4b01-9c89-0b064b2a7b73 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:57.381680 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6c6b8128-09f2-4b01-9c89-0b064b2a7b73 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:33:57.389399 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6c6b8128-09f2-4b01-9c89-0b064b2a7b73 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50" status: 200 len: 1523 microversion: 2.1 time: 0.153554 Oct 04 19:33:57.389982 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3695/7375] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:33:57 2022] GET /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:33:58.413738 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1b39057f-ba1d-45da-aa69-e5990a80c1f6 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:33:58.414371 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1b39057f-ba1d-45da-aa69-e5990a80c1f6 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: aa3449d4-ab06-4f06-af64-0ab74bf57b50] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:33:58.421304 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1b39057f-ba1d-45da-aa69-e5990a80c1f6 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:58.421817 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1b39057f-ba1d-45da-aa69-e5990a80c1f6 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:58.422288 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1b39057f-ba1d-45da-aa69-e5990a80c1f6 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:58.422994 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1b39057f-ba1d-45da-aa69-e5990a80c1f6 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:58.423464 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1b39057f-ba1d-45da-aa69-e5990a80c1f6 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:58.423905 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1b39057f-ba1d-45da-aa69-e5990a80c1f6 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:58.571967 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1b39057f-ba1d-45da-aa69-e5990a80c1f6 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:33:58.579650 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1b39057f-ba1d-45da-aa69-e5990a80c1f6 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50" status: 200 len: 1523 microversion: 2.1 time: 0.170218 Oct 04 19:33:58.580241 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3681/7376] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:33:58 2022] GET /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50 => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:33:59.602187 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-46135aa9-f54f-43a5-8c2a-7cf4b7462ccd tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:33:59.602809 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-46135aa9-f54f-43a5-8c2a-7cf4b7462ccd tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: aa3449d4-ab06-4f06-af64-0ab74bf57b50] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:33:59.609739 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-46135aa9-f54f-43a5-8c2a-7cf4b7462ccd tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:59.610241 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-46135aa9-f54f-43a5-8c2a-7cf4b7462ccd tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:59.610746 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-46135aa9-f54f-43a5-8c2a-7cf4b7462ccd tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:59.611450 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-46135aa9-f54f-43a5-8c2a-7cf4b7462ccd tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:59.611911 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-46135aa9-f54f-43a5-8c2a-7cf4b7462ccd tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:59.612377 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-46135aa9-f54f-43a5-8c2a-7cf4b7462ccd tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:59.749005 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-46135aa9-f54f-43a5-8c2a-7cf4b7462ccd tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:33:59.757720 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-46135aa9-f54f-43a5-8c2a-7cf4b7462ccd tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50" status: 200 len: 1523 microversion: 2.1 time: 0.159541 Oct 04 19:33:59.758347 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3696/7377] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:33:59 2022] GET /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:34:00.781330 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7bef0b2c-2d13-4d38-91f3-19927055c161 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:34:00.781954 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7bef0b2c-2d13-4d38-91f3-19927055c161 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: aa3449d4-ab06-4f06-af64-0ab74bf57b50] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:00.789488 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7bef0b2c-2d13-4d38-91f3-19927055c161 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:00.789980 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7bef0b2c-2d13-4d38-91f3-19927055c161 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:00.790424 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7bef0b2c-2d13-4d38-91f3-19927055c161 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:00.791114 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7bef0b2c-2d13-4d38-91f3-19927055c161 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:00.791585 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7bef0b2c-2d13-4d38-91f3-19927055c161 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:00.792015 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7bef0b2c-2d13-4d38-91f3-19927055c161 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:00.922798 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7bef0b2c-2d13-4d38-91f3-19927055c161 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:34:00.925026 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:34:00.931294 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7bef0b2c-2d13-4d38-91f3-19927055c161 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50" status: 200 len: 1523 microversion: 2.1 time: 0.153923 Oct 04 19:34:00.931866 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3682/7378] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:34:00 2022] GET /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:34:01.954786 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0ed91656-c364-472b-9b6a-0f11fb22993c tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:34:01.955402 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0ed91656-c364-472b-9b6a-0f11fb22993c tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: aa3449d4-ab06-4f06-af64-0ab74bf57b50] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:01.962722 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0ed91656-c364-472b-9b6a-0f11fb22993c tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:01.963215 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0ed91656-c364-472b-9b6a-0f11fb22993c tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:01.963657 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0ed91656-c364-472b-9b6a-0f11fb22993c tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:01.964370 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0ed91656-c364-472b-9b6a-0f11fb22993c tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:01.964832 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0ed91656-c364-472b-9b6a-0f11fb22993c tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:01.965259 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0ed91656-c364-472b-9b6a-0f11fb22993c tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:02.098235 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0ed91656-c364-472b-9b6a-0f11fb22993c tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:34:02.106698 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0ed91656-c364-472b-9b6a-0f11fb22993c tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50" status: 200 len: 1523 microversion: 2.1 time: 0.155888 Oct 04 19:34:02.107276 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3697/7379] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:34:01 2022] GET /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:34:03.130891 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-50614e06-0fc5-4d91-bf1d-c9f9fc55c462 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:34:03.131652 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-50614e06-0fc5-4d91-bf1d-c9f9fc55c462 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: aa3449d4-ab06-4f06-af64-0ab74bf57b50] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:03.134332 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:34:03.139406 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-50614e06-0fc5-4d91-bf1d-c9f9fc55c462 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:03.146596 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-50614e06-0fc5-4d91-bf1d-c9f9fc55c462 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:03.146596 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-50614e06-0fc5-4d91-bf1d-c9f9fc55c462 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:03.146596 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-50614e06-0fc5-4d91-bf1d-c9f9fc55c462 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:03.146596 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-50614e06-0fc5-4d91-bf1d-c9f9fc55c462 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:03.146596 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-50614e06-0fc5-4d91-bf1d-c9f9fc55c462 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:03.274619 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-50614e06-0fc5-4d91-bf1d-c9f9fc55c462 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:34:03.282320 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-50614e06-0fc5-4d91-bf1d-c9f9fc55c462 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50" status: 200 len: 1523 microversion: 2.1 time: 0.156298 Oct 04 19:34:03.282898 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3683/7380] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:34:03 2022] GET /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:34:04.306844 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0ee5422b-0904-4db8-a1f6-935b2db26db6 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:34:04.307484 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0ee5422b-0904-4db8-a1f6-935b2db26db6 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: aa3449d4-ab06-4f06-af64-0ab74bf57b50] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:04.314332 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0ee5422b-0904-4db8-a1f6-935b2db26db6 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:04.314813 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0ee5422b-0904-4db8-a1f6-935b2db26db6 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:04.315302 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0ee5422b-0904-4db8-a1f6-935b2db26db6 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:04.315934 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0ee5422b-0904-4db8-a1f6-935b2db26db6 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:04.316424 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0ee5422b-0904-4db8-a1f6-935b2db26db6 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:04.316848 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0ee5422b-0904-4db8-a1f6-935b2db26db6 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:04.335312 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:34:04.448595 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0ee5422b-0904-4db8-a1f6-935b2db26db6 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:34:04.456275 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0ee5422b-0904-4db8-a1f6-935b2db26db6 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50" status: 200 len: 1523 microversion: 2.1 time: 0.153851 Oct 04 19:34:04.456848 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3698/7381] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:34:04 2022] GET /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:34:05.479881 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ce3b1828-37d8-47a1-87a6-6256b0014a48 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:34:05.480535 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ce3b1828-37d8-47a1-87a6-6256b0014a48 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: aa3449d4-ab06-4f06-af64-0ab74bf57b50] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:05.487390 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ce3b1828-37d8-47a1-87a6-6256b0014a48 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:05.487888 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ce3b1828-37d8-47a1-87a6-6256b0014a48 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:05.488392 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ce3b1828-37d8-47a1-87a6-6256b0014a48 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:05.489101 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ce3b1828-37d8-47a1-87a6-6256b0014a48 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:05.489572 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ce3b1828-37d8-47a1-87a6-6256b0014a48 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:05.490023 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ce3b1828-37d8-47a1-87a6-6256b0014a48 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:05.623558 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ce3b1828-37d8-47a1-87a6-6256b0014a48 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:34:05.631300 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ce3b1828-37d8-47a1-87a6-6256b0014a48 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50" status: 200 len: 1523 microversion: 2.1 time: 0.155496 Oct 04 19:34:05.632458 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3684/7382] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:34:05 2022] GET /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:34:06.655043 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-dbb9a9c7-8b8c-46bd-a174-9f7032db7bc5 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:34:06.655667 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-dbb9a9c7-8b8c-46bd-a174-9f7032db7bc5 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: aa3449d4-ab06-4f06-af64-0ab74bf57b50] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:06.658521 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=39 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:34:06.663271 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dbb9a9c7-8b8c-46bd-a174-9f7032db7bc5 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:06.663758 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dbb9a9c7-8b8c-46bd-a174-9f7032db7bc5 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:06.664232 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dbb9a9c7-8b8c-46bd-a174-9f7032db7bc5 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:06.665586 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dbb9a9c7-8b8c-46bd-a174-9f7032db7bc5 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:06.666048 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dbb9a9c7-8b8c-46bd-a174-9f7032db7bc5 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:06.666480 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dbb9a9c7-8b8c-46bd-a174-9f7032db7bc5 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:06.799246 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-dbb9a9c7-8b8c-46bd-a174-9f7032db7bc5 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:34:06.807198 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-dbb9a9c7-8b8c-46bd-a174-9f7032db7bc5 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50" status: 200 len: 1523 microversion: 2.1 time: 0.156085 Oct 04 19:34:06.807766 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3699/7383] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:34:06 2022] GET /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:34:07.831000 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-cfc47671-0e05-417a-94a9-352734ef282f tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:34:07.831625 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-cfc47671-0e05-417a-94a9-352734ef282f tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: aa3449d4-ab06-4f06-af64-0ab74bf57b50] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:07.840374 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cfc47671-0e05-417a-94a9-352734ef282f tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:07.841276 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cfc47671-0e05-417a-94a9-352734ef282f tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:07.841739 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cfc47671-0e05-417a-94a9-352734ef282f tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:07.842445 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cfc47671-0e05-417a-94a9-352734ef282f tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:07.842910 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cfc47671-0e05-417a-94a9-352734ef282f tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:07.843347 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cfc47671-0e05-417a-94a9-352734ef282f tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:08.032656 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-cfc47671-0e05-417a-94a9-352734ef282f tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:34:08.041029 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-cfc47671-0e05-417a-94a9-352734ef282f tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50" status: 200 len: 1523 microversion: 2.1 time: 0.214265 Oct 04 19:34:08.041600 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3685/7384] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:34:07 2022] GET /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50 => generated 1523 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:34:09.034499 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-9d9cce3d-7d4d-438c-8ebc-0c313b6f54e6 req-b723f8e6-0732-46fd-a22d-5ae185015950 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa3449d4-ab06-4f06-af64-0ab74bf57b50", "name": "network-vif-unplugged", "status": "completed", "tag": "f011e11b-228c-4121-980c-b83994ab63ac"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:34:09.045942 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-9d9cce3d-7d4d-438c-8ebc-0c313b6f54e6 req-b723f8e6-0732-46fd-a22d-5ae185015950 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:09.046428 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-9d9cce3d-7d4d-438c-8ebc-0c313b6f54e6 req-b723f8e6-0732-46fd-a22d-5ae185015950 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:09.048318 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-9d9cce3d-7d4d-438c-8ebc-0c313b6f54e6 req-b723f8e6-0732-46fd-a22d-5ae185015950 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:09.059179 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-9d9cce3d-7d4d-438c-8ebc-0c313b6f54e6 req-b723f8e6-0732-46fd-a22d-5ae185015950 service nova] Creating event network-vif-unplugged:f011e11b-228c-4121-980c-b83994ab63ac for instance aa3449d4-ab06-4f06-af64-0ab74bf57b50 on n-h2-850501-14 Oct 04 19:34:09.064885 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [req-9d9cce3d-7d4d-438c-8ebc-0c313b6f54e6 req-b723f8e6-0732-46fd-a22d-5ae185015950 service nova] Instance aa3449d4-ab06-4f06-af64-0ab74bf57b50 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850501-14', 'n-h2-850501-14'} {{(pid=123001) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:34:09.065041 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e232f9e4-355a-499b-9799-f880868216be tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:34:09.065517 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e232f9e4-355a-499b-9799-f880868216be tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: aa3449d4-ab06-4f06-af64-0ab74bf57b50] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:09.072983 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e232f9e4-355a-499b-9799-f880868216be tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:09.078406 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e232f9e4-355a-499b-9799-f880868216be tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:09.078406 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e232f9e4-355a-499b-9799-f880868216be tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:09.078406 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e232f9e4-355a-499b-9799-f880868216be tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:09.078406 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e232f9e4-355a-499b-9799-f880868216be tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:09.078406 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e232f9e4-355a-499b-9799-f880868216be tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:09.079052 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-9d9cce3d-7d4d-438c-8ebc-0c313b6f54e6 req-b723f8e6-0732-46fd-a22d-5ae185015950 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046056 Oct 04 19:34:09.079052 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3700/7385] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:34:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:34:09.218604 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e232f9e4-355a-499b-9799-f880868216be tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:34:09.228528 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e232f9e4-355a-499b-9799-f880868216be tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50" status: 200 len: 1522 microversion: 2.1 time: 0.167372 Oct 04 19:34:09.229120 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3686/7386] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:34:09 2022] GET /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:34:10.253593 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-50579bf5-0602-4494-a6f5-a7b3a1ad856c tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:34:10.254233 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-50579bf5-0602-4494-a6f5-a7b3a1ad856c tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: aa3449d4-ab06-4f06-af64-0ab74bf57b50] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:10.261380 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-50579bf5-0602-4494-a6f5-a7b3a1ad856c tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:10.261870 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-50579bf5-0602-4494-a6f5-a7b3a1ad856c tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:10.262313 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-50579bf5-0602-4494-a6f5-a7b3a1ad856c tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:10.263009 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-50579bf5-0602-4494-a6f5-a7b3a1ad856c tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:10.263469 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-50579bf5-0602-4494-a6f5-a7b3a1ad856c tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:10.263896 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-50579bf5-0602-4494-a6f5-a7b3a1ad856c tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:10.399170 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-50579bf5-0602-4494-a6f5-a7b3a1ad856c tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:34:10.407245 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-50579bf5-0602-4494-a6f5-a7b3a1ad856c tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50" status: 200 len: 1522 microversion: 2.1 time: 0.158227 Oct 04 19:34:10.407825 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3701/7387] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:34:10 2022] GET /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:34:11.092969 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-7b744521-a063-4be9-9cf0-a83702ceceb7 req-d8b4956a-3a80-45c7-8a5f-5cef7775071c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa3449d4-ab06-4f06-af64-0ab74bf57b50", "tag": "f011e11b-228c-4121-980c-b83994ab63ac"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:34:11.103928 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-7b744521-a063-4be9-9cf0-a83702ceceb7 req-d8b4956a-3a80-45c7-8a5f-5cef7775071c service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:11.104448 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-7b744521-a063-4be9-9cf0-a83702ceceb7 req-d8b4956a-3a80-45c7-8a5f-5cef7775071c service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:11.104885 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-7b744521-a063-4be9-9cf0-a83702ceceb7 req-d8b4956a-3a80-45c7-8a5f-5cef7775071c service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:11.116353 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-7b744521-a063-4be9-9cf0-a83702ceceb7 req-d8b4956a-3a80-45c7-8a5f-5cef7775071c service nova] Creating event network-changed:f011e11b-228c-4121-980c-b83994ab63ac for instance aa3449d4-ab06-4f06-af64-0ab74bf57b50 on n-h2-850501-14 Oct 04 19:34:11.122283 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [req-7b744521-a063-4be9-9cf0-a83702ceceb7 req-d8b4956a-3a80-45c7-8a5f-5cef7775071c service nova] Instance aa3449d4-ab06-4f06-af64-0ab74bf57b50 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850501-14', 'n-h2-850501-14'} {{(pid=123002) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:34:11.133407 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-7b744521-a063-4be9-9cf0-a83702ceceb7 req-d8b4956a-3a80-45c7-8a5f-5cef7775071c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043989 Oct 04 19:34:11.134016 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3687/7388] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:34:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:34:11.430732 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-222fec45-f375-4c12-be9d-fff603e2ccab tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:34:11.431889 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-222fec45-f375-4c12-be9d-fff603e2ccab tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: aa3449d4-ab06-4f06-af64-0ab74bf57b50] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:11.438722 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-222fec45-f375-4c12-be9d-fff603e2ccab tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:11.439209 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-222fec45-f375-4c12-be9d-fff603e2ccab tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:11.439642 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-222fec45-f375-4c12-be9d-fff603e2ccab tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:11.440361 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-222fec45-f375-4c12-be9d-fff603e2ccab tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:11.440814 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-222fec45-f375-4c12-be9d-fff603e2ccab tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:11.441233 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-222fec45-f375-4c12-be9d-fff603e2ccab tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:11.681057 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-222fec45-f375-4c12-be9d-fff603e2ccab tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:34:11.688886 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-222fec45-f375-4c12-be9d-fff603e2ccab tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50" status: 200 len: 1520 microversion: 2.1 time: 0.262315 Oct 04 19:34:11.689488 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3702/7389] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:34:11 2022] GET /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50 => generated 1520 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:34:12.715678 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-84a11037-e984-4935-99bd-bd108223d74e tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:34:12.716440 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-84a11037-e984-4935-99bd-bd108223d74e tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: aa3449d4-ab06-4f06-af64-0ab74bf57b50] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:12.723359 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-84a11037-e984-4935-99bd-bd108223d74e tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:12.723871 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-84a11037-e984-4935-99bd-bd108223d74e tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:12.724353 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-84a11037-e984-4935-99bd-bd108223d74e tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:12.725074 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-84a11037-e984-4935-99bd-bd108223d74e tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:12.725549 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-84a11037-e984-4935-99bd-bd108223d74e tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:12.725993 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-84a11037-e984-4935-99bd-bd108223d74e tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:12.860795 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-84a11037-e984-4935-99bd-bd108223d74e tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:34:12.868884 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-84a11037-e984-4935-99bd-bd108223d74e tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50" status: 200 len: 1520 microversion: 2.1 time: 0.158582 Oct 04 19:34:12.869467 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3688/7390] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:34:12 2022] GET /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:34:13.892913 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4f09a4d9-8bc2-4a06-b647-4d3350d35d80 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:34:13.893446 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-4f09a4d9-8bc2-4a06-b647-4d3350d35d80 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: aa3449d4-ab06-4f06-af64-0ab74bf57b50] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:13.902243 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4f09a4d9-8bc2-4a06-b647-4d3350d35d80 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:13.902979 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4f09a4d9-8bc2-4a06-b647-4d3350d35d80 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:13.903645 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4f09a4d9-8bc2-4a06-b647-4d3350d35d80 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:13.904782 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4f09a4d9-8bc2-4a06-b647-4d3350d35d80 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:13.905488 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4f09a4d9-8bc2-4a06-b647-4d3350d35d80 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:13.906140 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4f09a4d9-8bc2-4a06-b647-4d3350d35d80 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:14.048571 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-4f09a4d9-8bc2-4a06-b647-4d3350d35d80 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:34:14.057394 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-4f09a4d9-8bc2-4a06-b647-4d3350d35d80 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50" status: 200 len: 1517 microversion: 2.1 time: 0.168644 Oct 04 19:34:14.057966 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3703/7391] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:34:13 2022] GET /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50 => generated 1517 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:34:14.081164 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-320147d5-9854-46fc-b7bd-b6ced37f5214 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:34:14.081698 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-320147d5-9854-46fc-b7bd-b6ced37f5214 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: aa3449d4-ab06-4f06-af64-0ab74bf57b50] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:14.089408 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-320147d5-9854-46fc-b7bd-b6ced37f5214 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:14.091125 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-320147d5-9854-46fc-b7bd-b6ced37f5214 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:14.091125 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-320147d5-9854-46fc-b7bd-b6ced37f5214 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:14.091125 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-320147d5-9854-46fc-b7bd-b6ced37f5214 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:14.091570 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-320147d5-9854-46fc-b7bd-b6ced37f5214 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:14.092006 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-320147d5-9854-46fc-b7bd-b6ced37f5214 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:14.362811 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-320147d5-9854-46fc-b7bd-b6ced37f5214 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "POST /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50/action" status: 204 len: 0 microversion: 2.1 time: 0.285331 Oct 04 19:34:14.363557 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3689/7392] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 19:34:14 2022] POST /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50/action => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:34:14.372856 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-faaccf34-c9e1-4e75-972e-a5f4ad74ed77 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:34:14.378670 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-faaccf34-c9e1-4e75-972e-a5f4ad74ed77 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: aa3449d4-ab06-4f06-af64-0ab74bf57b50] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:14.379636 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-faaccf34-c9e1-4e75-972e-a5f4ad74ed77 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:14.380286 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-faaccf34-c9e1-4e75-972e-a5f4ad74ed77 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:14.380733 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-faaccf34-c9e1-4e75-972e-a5f4ad74ed77 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:14.381425 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-faaccf34-c9e1-4e75-972e-a5f4ad74ed77 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:14.381878 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-faaccf34-c9e1-4e75-972e-a5f4ad74ed77 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:14.382301 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-faaccf34-c9e1-4e75-972e-a5f4ad74ed77 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:14.529999 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-faaccf34-c9e1-4e75-972e-a5f4ad74ed77 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:34:14.537707 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-faaccf34-c9e1-4e75-972e-a5f4ad74ed77 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50" status: 200 len: 1517 microversion: 2.1 time: 0.169022 Oct 04 19:34:14.538277 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3704/7393] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:34:14 2022] GET /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50 => generated 1517 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:34:15.562904 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d36ea50d-c8d7-4901-bd79-42a572dcacf2 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:34:15.563701 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d36ea50d-c8d7-4901-bd79-42a572dcacf2 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: aa3449d4-ab06-4f06-af64-0ab74bf57b50] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:15.569779 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d36ea50d-c8d7-4901-bd79-42a572dcacf2 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:15.570666 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d36ea50d-c8d7-4901-bd79-42a572dcacf2 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:15.571118 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d36ea50d-c8d7-4901-bd79-42a572dcacf2 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:15.571820 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d36ea50d-c8d7-4901-bd79-42a572dcacf2 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:15.572315 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d36ea50d-c8d7-4901-bd79-42a572dcacf2 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:15.572751 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d36ea50d-c8d7-4901-bd79-42a572dcacf2 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:15.724978 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d36ea50d-c8d7-4901-bd79-42a572dcacf2 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:34:15.734165 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d36ea50d-c8d7-4901-bd79-42a572dcacf2 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50" status: 200 len: 1517 microversion: 2.1 time: 0.176456 Oct 04 19:34:15.734767 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3690/7394] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:34:15 2022] GET /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50 => generated 1517 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:34:16.759444 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6fa1a00a-84ad-4d44-b478-3d5c55907126 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:34:16.760134 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6fa1a00a-84ad-4d44-b478-3d5c55907126 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: aa3449d4-ab06-4f06-af64-0ab74bf57b50] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:16.766218 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6fa1a00a-84ad-4d44-b478-3d5c55907126 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:16.766701 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6fa1a00a-84ad-4d44-b478-3d5c55907126 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:16.767132 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6fa1a00a-84ad-4d44-b478-3d5c55907126 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:16.767817 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6fa1a00a-84ad-4d44-b478-3d5c55907126 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:16.768295 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6fa1a00a-84ad-4d44-b478-3d5c55907126 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:16.768717 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6fa1a00a-84ad-4d44-b478-3d5c55907126 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:16.899949 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6fa1a00a-84ad-4d44-b478-3d5c55907126 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:34:16.907668 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6fa1a00a-84ad-4d44-b478-3d5c55907126 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50" status: 200 len: 1509 microversion: 2.1 time: 0.152694 Oct 04 19:34:16.908265 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3705/7395] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:34:16 2022] GET /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50 => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:34:16.930549 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1315de6c-14c1-40df-bd4f-ac90b6f9cae6 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:34:16.931168 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1315de6c-14c1-40df-bd4f-ac90b6f9cae6 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: aa3449d4-ab06-4f06-af64-0ab74bf57b50] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:16.938252 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1315de6c-14c1-40df-bd4f-ac90b6f9cae6 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:16.938754 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1315de6c-14c1-40df-bd4f-ac90b6f9cae6 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:16.939199 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1315de6c-14c1-40df-bd4f-ac90b6f9cae6 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:16.939892 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1315de6c-14c1-40df-bd4f-ac90b6f9cae6 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:16.940385 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1315de6c-14c1-40df-bd4f-ac90b6f9cae6 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:16.940820 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1315de6c-14c1-40df-bd4f-ac90b6f9cae6 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:17.073672 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1315de6c-14c1-40df-bd4f-ac90b6f9cae6 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:34:17.081404 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1315de6c-14c1-40df-bd4f-ac90b6f9cae6 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50" status: 200 len: 1509 microversion: 2.1 time: 0.155241 Oct 04 19:34:17.082071 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3691/7396] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:34:16 2022] GET /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50 => generated 1509 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:34:17.107825 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2399c120-2ec5-4c87-b788-15da37b34466 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Action: 'create', calling method: .version_select at 0x7fe253a85a60>, body: {"keypair": {"name": "tempest-keypair-114045705", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKXrBp9Gz+CAHpIQGK6REG6nYvnURgtu6V3mMbIBgXI9e4E9akt81hx5L7hwJm52guiwrW38PRbvYdJa/fE4Y8XSG58KLaWpnYvMbxJ2yblYVPDWgcEfVV1wcFhZ59D2CA=="}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:34:17.123976 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-2399c120-2ec5-4c87-b788-15da37b34466 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Getting quotas for project 1ca71f9591344456835761dc8045b825. Resources: {'key_pairs'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:34:17.129188 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-2399c120-2ec5-4c87-b788-15da37b34466 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Getting quotas for user 1dedbd53c8584342a20523734518e591 and project 1ca71f9591344456835761dc8045b825. Resources: {'key_pairs'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:34:17.143488 n-d-850501-14 devstack@n-api.service[123001]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2399c120-2ec5-4c87-b788-15da37b34466 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [6c8ce3ae-b440-4b28-996b-33b11441f461] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 19:34:17.659877 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-3dd5f4bd-791d-4e40-825c-b23255a3a1b8 req-3ea4c3a8-d579-4557-830b-4fc9ba729bc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa3449d4-ab06-4f06-af64-0ab74bf57b50", "name": "network-vif-plugged", "status": "completed", "tag": "f011e11b-228c-4121-980c-b83994ab63ac"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:34:17.670183 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-3dd5f4bd-791d-4e40-825c-b23255a3a1b8 req-3ea4c3a8-d579-4557-830b-4fc9ba729bc4 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:17.670693 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-3dd5f4bd-791d-4e40-825c-b23255a3a1b8 req-3ea4c3a8-d579-4557-830b-4fc9ba729bc4 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:17.671178 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-3dd5f4bd-791d-4e40-825c-b23255a3a1b8 req-3ea4c3a8-d579-4557-830b-4fc9ba729bc4 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:17.684276 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-3dd5f4bd-791d-4e40-825c-b23255a3a1b8 req-3ea4c3a8-d579-4557-830b-4fc9ba729bc4 service nova] Creating event network-vif-plugged:f011e11b-228c-4121-980c-b83994ab63ac for instance aa3449d4-ab06-4f06-af64-0ab74bf57b50 on n-h2-850501-14 Oct 04 19:34:17.691569 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-3dd5f4bd-791d-4e40-825c-b23255a3a1b8 req-3ea4c3a8-d579-4557-830b-4fc9ba729bc4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035738 Oct 04 19:34:17.694973 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3692/7397] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:34:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:34:18.152773 n-d-850501-14 devstack@n-api.service[123001]: INFO oslo.messaging._drivers.impl_rabbit [None req-2399c120-2ec5-4c87-b788-15da37b34466 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [6c8ce3ae-b440-4b28-996b-33b11441f461] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 50196. Oct 04 19:34:18.221062 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2399c120-2ec5-4c87-b788-15da37b34466 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.117179 Oct 04 19:34:18.221680 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3706/7398] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Oct 4 19:34:17 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:34:20.525027 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f246a937-35d4-47ab-84f6-25680ca4e9d9 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:34:20.533990 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f246a937-35d4-47ab-84f6-25680ca4e9d9 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: aa3449d4-ab06-4f06-af64-0ab74bf57b50] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:20.533990 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f246a937-35d4-47ab-84f6-25680ca4e9d9 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:20.533990 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f246a937-35d4-47ab-84f6-25680ca4e9d9 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:20.533990 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f246a937-35d4-47ab-84f6-25680ca4e9d9 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:20.533990 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f246a937-35d4-47ab-84f6-25680ca4e9d9 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:20.533990 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f246a937-35d4-47ab-84f6-25680ca4e9d9 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:20.534784 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f246a937-35d4-47ab-84f6-25680ca4e9d9 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:20.668559 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f246a937-35d4-47ab-84f6-25680ca4e9d9 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:34:20.676211 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f246a937-35d4-47ab-84f6-25680ca4e9d9 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50" status: 200 len: 1509 microversion: 2.1 time: 0.156684 Oct 04 19:34:20.676782 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3693/7399] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:34:20 2022] GET /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50 => generated 1509 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:34:20.700838 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9de21980-a3a8-4c36-95cf-f00acc4f17cf tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:34:20.701354 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-9de21980-a3a8-4c36-95cf-f00acc4f17cf tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: aa3449d4-ab06-4f06-af64-0ab74bf57b50] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:20.707238 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9de21980-a3a8-4c36-95cf-f00acc4f17cf tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:20.707726 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9de21980-a3a8-4c36-95cf-f00acc4f17cf tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:20.708194 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9de21980-a3a8-4c36-95cf-f00acc4f17cf tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:20.708895 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9de21980-a3a8-4c36-95cf-f00acc4f17cf tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:20.709358 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9de21980-a3a8-4c36-95cf-f00acc4f17cf tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:20.709795 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9de21980-a3a8-4c36-95cf-f00acc4f17cf tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:20.736258 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-9de21980-a3a8-4c36-95cf-f00acc4f17cf tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: aa3449d4-ab06-4f06-af64-0ab74bf57b50] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:34:21.020674 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9de21980-a3a8-4c36-95cf-f00acc4f17cf tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "DELETE /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50" status: 204 len: 0 microversion: 2.1 time: 0.325572 Oct 04 19:34:21.021198 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3707/7400] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 19:34:20 2022] DELETE /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:34:21.082161 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3a2404a6-5859-437f-8d33-5e6d2b8ed9c7 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-60274542", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": [{"uuid": "85e1bf8e-ea55-469a-99ed-8172579b5395"}]}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:34:21.137344 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-3a2404a6-5859-437f-8d33-5e6d2b8ed9c7 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] validate_networks() for [('85e1bf8e-ea55-469a-99ed-8172579b5395', None, None, None, None, None)] {{(pid=123002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:34:21.512716 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-3a2404a6-5859-437f-8d33-5e6d2b8ed9c7 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:34:21.513168 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-3a2404a6-5859-437f-8d33-5e6d2b8ed9c7 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:34:21.513667 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-3a2404a6-5859-437f-8d33-5e6d2b8ed9c7 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:34:21.514097 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-3a2404a6-5859-437f-8d33-5e6d2b8ed9c7 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:34:21.514561 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-3a2404a6-5859-437f-8d33-5e6d2b8ed9c7 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:34:21.524524 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3a2404a6-5859-437f-8d33-5e6d2b8ed9c7 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:21.525020 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3a2404a6-5859-437f-8d33-5e6d2b8ed9c7 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:21.525475 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3a2404a6-5859-437f-8d33-5e6d2b8ed9c7 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:21.526220 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3a2404a6-5859-437f-8d33-5e6d2b8ed9c7 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:21.526717 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3a2404a6-5859-437f-8d33-5e6d2b8ed9c7 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:21.527161 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3a2404a6-5859-437f-8d33-5e6d2b8ed9c7 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:21.544474 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-3a2404a6-5859-437f-8d33-5e6d2b8ed9c7 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Getting quotas for project 1ca71f9591344456835761dc8045b825. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:34:21.549822 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-3a2404a6-5859-437f-8d33-5e6d2b8ed9c7 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Getting quotas for user 1dedbd53c8584342a20523734518e591 and project 1ca71f9591344456835761dc8045b825. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:34:21.562214 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3a2404a6-5859-437f-8d33-5e6d2b8ed9c7 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Going to run 1 instances... {{(pid=123002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:34:21.564558 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3a2404a6-5859-437f-8d33-5e6d2b8ed9c7 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: bd692ac2-9881-4bb6-b50f-f596a12b1eb1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:34:21.696372 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3a2404a6-5859-437f-8d33-5e6d2b8ed9c7 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.618037 Oct 04 19:34:21.697043 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3694/7401] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 19:34:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 620 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:34:21.708917 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d9229cbe-2a76-4fbf-901d-5849ecd0db73 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:34:21.709799 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d9229cbe-2a76-4fbf-901d-5849ecd0db73 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: bd692ac2-9881-4bb6-b50f-f596a12b1eb1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:21.772402 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d9229cbe-2a76-4fbf-901d-5849ecd0db73 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:34:21.780092 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d9229cbe-2a76-4fbf-901d-5849ecd0db73 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1" status: 200 len: 1216 microversion: 2.1 time: 0.075393 Oct 04 19:34:21.780665 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3708/7402] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:34:21 2022] GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1 => generated 1216 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:34:22.804212 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ccc774f4-f557-4f91-b125-ed510f4d4007 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:34:22.806004 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ccc774f4-f557-4f91-b125-ed510f4d4007 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: bd692ac2-9881-4bb6-b50f-f596a12b1eb1] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:22.824996 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ccc774f4-f557-4f91-b125-ed510f4d4007 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:22.825488 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ccc774f4-f557-4f91-b125-ed510f4d4007 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:22.825985 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ccc774f4-f557-4f91-b125-ed510f4d4007 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:22.826947 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ccc774f4-f557-4f91-b125-ed510f4d4007 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:22.827466 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ccc774f4-f557-4f91-b125-ed510f4d4007 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:22.828005 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ccc774f4-f557-4f91-b125-ed510f4d4007 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:22.892985 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ccc774f4-f557-4f91-b125-ed510f4d4007 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:34:22.901105 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ccc774f4-f557-4f91-b125-ed510f4d4007 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1" status: 200 len: 1220 microversion: 2.1 time: 0.101990 Oct 04 19:34:22.901697 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3695/7403] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:34:22 2022] GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1 => generated 1220 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:34:23.250214 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-65aa7aa9-2dd8-4823-b039-a7071ecf2c2c req-b1292ff7-df07-49f4-9871-f265efa20d10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa3449d4-ab06-4f06-af64-0ab74bf57b50", "name": "network-vif-deleted", "tag": "f011e11b-228c-4121-980c-b83994ab63ac"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:34:23.262732 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-65aa7aa9-2dd8-4823-b039-a7071ecf2c2c req-b1292ff7-df07-49f4-9871-f265efa20d10 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:23.263331 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-65aa7aa9-2dd8-4823-b039-a7071ecf2c2c req-b1292ff7-df07-49f4-9871-f265efa20d10 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:23.263960 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-65aa7aa9-2dd8-4823-b039-a7071ecf2c2c req-b1292ff7-df07-49f4-9871-f265efa20d10 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:23.278591 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-65aa7aa9-2dd8-4823-b039-a7071ecf2c2c req-b1292ff7-df07-49f4-9871-f265efa20d10 service nova] Creating event network-vif-deleted:f011e11b-228c-4121-980c-b83994ab63ac for instance aa3449d4-ab06-4f06-af64-0ab74bf57b50 on n-h2-850501-14 Oct 04 19:34:23.283707 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-65aa7aa9-2dd8-4823-b039-a7071ecf2c2c req-b1292ff7-df07-49f4-9871-f265efa20d10 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037399 Oct 04 19:34:23.284365 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3709/7404] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:34:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:34:23.924734 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6876e7c9-0eee-490f-ad67-5a6012110a06 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:34:23.925370 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-6876e7c9-0eee-490f-ad67-5a6012110a06 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: bd692ac2-9881-4bb6-b50f-f596a12b1eb1] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:23.932664 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6876e7c9-0eee-490f-ad67-5a6012110a06 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:23.933615 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6876e7c9-0eee-490f-ad67-5a6012110a06 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:23.933615 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6876e7c9-0eee-490f-ad67-5a6012110a06 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:23.934377 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6876e7c9-0eee-490f-ad67-5a6012110a06 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:23.934849 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6876e7c9-0eee-490f-ad67-5a6012110a06 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:23.935293 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6876e7c9-0eee-490f-ad67-5a6012110a06 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:23.998390 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-6876e7c9-0eee-490f-ad67-5a6012110a06 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:34:24.011452 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6876e7c9-0eee-490f-ad67-5a6012110a06 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1" status: 200 len: 1268 microversion: 2.1 time: 0.090233 Oct 04 19:34:24.013518 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3696/7405] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:34:23 2022] GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1 => generated 1268 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:34:25.037392 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9407c6ea-568d-4745-8fda-23626f4f1edd tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:34:25.038104 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-9407c6ea-568d-4745-8fda-23626f4f1edd tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: bd692ac2-9881-4bb6-b50f-f596a12b1eb1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:25.045807 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9407c6ea-568d-4745-8fda-23626f4f1edd tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:25.046371 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9407c6ea-568d-4745-8fda-23626f4f1edd tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:25.046815 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9407c6ea-568d-4745-8fda-23626f4f1edd tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:25.047511 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9407c6ea-568d-4745-8fda-23626f4f1edd tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:25.047973 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9407c6ea-568d-4745-8fda-23626f4f1edd tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:25.048434 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9407c6ea-568d-4745-8fda-23626f4f1edd tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:25.214057 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9407c6ea-568d-4745-8fda-23626f4f1edd tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:34:25.222391 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9407c6ea-568d-4745-8fda-23626f4f1edd tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1" status: 200 len: 1316 microversion: 2.1 time: 0.189393 Oct 04 19:34:25.223027 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3710/7406] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:34:25 2022] GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1 => generated 1316 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:34:26.095132 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-732359a0-d26f-4eeb-8fee-f8b59778bb3c req-14eb7873-9ce1-4bf9-9433-359cdde37754 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd692ac2-9881-4bb6-b50f-f596a12b1eb1", "tag": "97479abc-70fe-44a9-ad3c-defbaea02284"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:34:26.107976 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-732359a0-d26f-4eeb-8fee-f8b59778bb3c req-14eb7873-9ce1-4bf9-9433-359cdde37754 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:26.108678 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-732359a0-d26f-4eeb-8fee-f8b59778bb3c req-14eb7873-9ce1-4bf9-9433-359cdde37754 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:26.109216 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-732359a0-d26f-4eeb-8fee-f8b59778bb3c req-14eb7873-9ce1-4bf9-9433-359cdde37754 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:26.122382 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-732359a0-d26f-4eeb-8fee-f8b59778bb3c req-14eb7873-9ce1-4bf9-9433-359cdde37754 service nova] Creating event network-changed:97479abc-70fe-44a9-ad3c-defbaea02284 for instance bd692ac2-9881-4bb6-b50f-f596a12b1eb1 on n-h2-850501-14 Oct 04 19:34:26.127893 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-732359a0-d26f-4eeb-8fee-f8b59778bb3c req-14eb7873-9ce1-4bf9-9433-359cdde37754 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042006 Oct 04 19:34:26.131268 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3697/7407] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:34:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:34:26.246795 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b7abb76a-26ed-4251-9ff9-a7bd03efb4d7 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:34:26.247511 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b7abb76a-26ed-4251-9ff9-a7bd03efb4d7 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: bd692ac2-9881-4bb6-b50f-f596a12b1eb1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:26.254399 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b7abb76a-26ed-4251-9ff9-a7bd03efb4d7 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:26.254994 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b7abb76a-26ed-4251-9ff9-a7bd03efb4d7 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:26.255507 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b7abb76a-26ed-4251-9ff9-a7bd03efb4d7 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:26.256315 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b7abb76a-26ed-4251-9ff9-a7bd03efb4d7 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:26.256846 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b7abb76a-26ed-4251-9ff9-a7bd03efb4d7 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:26.257287 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b7abb76a-26ed-4251-9ff9-a7bd03efb4d7 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:26.394804 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b7abb76a-26ed-4251-9ff9-a7bd03efb4d7 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:34:26.403479 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b7abb76a-26ed-4251-9ff9-a7bd03efb4d7 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1" status: 200 len: 1316 microversion: 2.1 time: 0.161230 Oct 04 19:34:26.403993 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3711/7408] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:34:26 2022] GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1 => generated 1316 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:34:27.426751 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d44a895f-98ab-4b88-ad48-ee921a9dc818 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:34:27.427462 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d44a895f-98ab-4b88-ad48-ee921a9dc818 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: bd692ac2-9881-4bb6-b50f-f596a12b1eb1] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:27.435103 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d44a895f-98ab-4b88-ad48-ee921a9dc818 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:27.435599 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d44a895f-98ab-4b88-ad48-ee921a9dc818 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:27.436044 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d44a895f-98ab-4b88-ad48-ee921a9dc818 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:27.436763 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d44a895f-98ab-4b88-ad48-ee921a9dc818 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:27.437225 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d44a895f-98ab-4b88-ad48-ee921a9dc818 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:27.437656 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d44a895f-98ab-4b88-ad48-ee921a9dc818 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:27.565852 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d44a895f-98ab-4b88-ad48-ee921a9dc818 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:34:27.574046 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d44a895f-98ab-4b88-ad48-ee921a9dc818 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1" status: 200 len: 1316 microversion: 2.1 time: 0.151562 Oct 04 19:34:27.574623 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3698/7409] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:34:27 2022] GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1 => generated 1316 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:34:28.598404 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-69ef57d3-0e55-437e-836b-d9c29e1237e9 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:34:28.599028 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-69ef57d3-0e55-437e-836b-d9c29e1237e9 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: bd692ac2-9881-4bb6-b50f-f596a12b1eb1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:28.606785 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-69ef57d3-0e55-437e-836b-d9c29e1237e9 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:28.607216 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-69ef57d3-0e55-437e-836b-d9c29e1237e9 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:28.607660 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-69ef57d3-0e55-437e-836b-d9c29e1237e9 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:28.608397 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-69ef57d3-0e55-437e-836b-d9c29e1237e9 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:28.608863 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-69ef57d3-0e55-437e-836b-d9c29e1237e9 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:28.609295 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-69ef57d3-0e55-437e-836b-d9c29e1237e9 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:28.741192 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-69ef57d3-0e55-437e-836b-d9c29e1237e9 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:34:28.749684 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-69ef57d3-0e55-437e-836b-d9c29e1237e9 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1" status: 200 len: 1316 microversion: 2.1 time: 0.155517 Oct 04 19:34:28.750269 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3712/7410] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:34:28 2022] GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1 => generated 1316 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:34:29.772805 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-46e55681-1b66-4af3-acc8-9e0180eca75e tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:34:29.773643 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-46e55681-1b66-4af3-acc8-9e0180eca75e tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: bd692ac2-9881-4bb6-b50f-f596a12b1eb1] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:29.780562 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-46e55681-1b66-4af3-acc8-9e0180eca75e tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:29.781056 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-46e55681-1b66-4af3-acc8-9e0180eca75e tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:29.781501 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-46e55681-1b66-4af3-acc8-9e0180eca75e tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:29.782193 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-46e55681-1b66-4af3-acc8-9e0180eca75e tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:29.782655 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-46e55681-1b66-4af3-acc8-9e0180eca75e tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:29.783088 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-46e55681-1b66-4af3-acc8-9e0180eca75e tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:29.910196 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-46e55681-1b66-4af3-acc8-9e0180eca75e tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:34:29.917901 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-46e55681-1b66-4af3-acc8-9e0180eca75e tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1" status: 200 len: 1316 microversion: 2.1 time: 0.149100 Oct 04 19:34:29.918516 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3699/7411] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:34:29 2022] GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1 => generated 1316 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:34:30.941291 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-95204275-c300-4023-98a5-a213369bc44a tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:34:30.941909 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-95204275-c300-4023-98a5-a213369bc44a tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: bd692ac2-9881-4bb6-b50f-f596a12b1eb1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:30.949235 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-95204275-c300-4023-98a5-a213369bc44a tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:30.949720 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-95204275-c300-4023-98a5-a213369bc44a tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:30.950161 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-95204275-c300-4023-98a5-a213369bc44a tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:30.950854 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-95204275-c300-4023-98a5-a213369bc44a tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:30.951308 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-95204275-c300-4023-98a5-a213369bc44a tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:30.951734 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-95204275-c300-4023-98a5-a213369bc44a tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:31.084845 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-95204275-c300-4023-98a5-a213369bc44a tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:34:31.093543 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-95204275-c300-4023-98a5-a213369bc44a tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1" status: 200 len: 1316 microversion: 2.1 time: 0.156159 Oct 04 19:34:31.094374 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3713/7412] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:34:30 2022] GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1 => generated 1316 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:34:32.124393 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-93c50fab-ef04-404b-adeb-b04ff8bbf2ba tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:34:32.125274 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-93c50fab-ef04-404b-adeb-b04ff8bbf2ba tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: bd692ac2-9881-4bb6-b50f-f596a12b1eb1] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:32.128691 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:34:32.129453 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=6 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:34:32.135182 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-93c50fab-ef04-404b-adeb-b04ff8bbf2ba tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:32.143627 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-93c50fab-ef04-404b-adeb-b04ff8bbf2ba tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:32.143627 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-93c50fab-ef04-404b-adeb-b04ff8bbf2ba tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:32.143627 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-93c50fab-ef04-404b-adeb-b04ff8bbf2ba tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:32.143627 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-93c50fab-ef04-404b-adeb-b04ff8bbf2ba tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:32.143627 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-93c50fab-ef04-404b-adeb-b04ff8bbf2ba tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:32.166310 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:34:32.290695 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-93c50fab-ef04-404b-adeb-b04ff8bbf2ba tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:34:32.299288 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-93c50fab-ef04-404b-adeb-b04ff8bbf2ba tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1" status: 200 len: 1316 microversion: 2.1 time: 0.180928 Oct 04 19:34:32.299985 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3700/7413] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:34:32 2022] GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1 => generated 1316 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:34:33.322383 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-976197cf-20f9-4943-95a3-f815eda9ce68 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:34:33.322995 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-976197cf-20f9-4943-95a3-f815eda9ce68 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: bd692ac2-9881-4bb6-b50f-f596a12b1eb1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:33.324999 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=6 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:34:33.330836 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-976197cf-20f9-4943-95a3-f815eda9ce68 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:33.331315 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-976197cf-20f9-4943-95a3-f815eda9ce68 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:33.331751 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-976197cf-20f9-4943-95a3-f815eda9ce68 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:33.332468 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-976197cf-20f9-4943-95a3-f815eda9ce68 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:33.332948 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-976197cf-20f9-4943-95a3-f815eda9ce68 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:33.333370 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-976197cf-20f9-4943-95a3-f815eda9ce68 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:33.465465 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-976197cf-20f9-4943-95a3-f815eda9ce68 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:34:33.473461 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-976197cf-20f9-4943-95a3-f815eda9ce68 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1" status: 200 len: 1316 microversion: 2.1 time: 0.155674 Oct 04 19:34:33.474070 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3714/7414] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:34:33 2022] GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1 => generated 1316 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:34:33.762045 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-4946e151-38b4-41f6-8013-adfe31391a2f req-f2cad60b-876a-4b7b-a100-6b42ea9028bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd692ac2-9881-4bb6-b50f-f596a12b1eb1", "name": "network-vif-plugged", "status": "completed", "tag": "97479abc-70fe-44a9-ad3c-defbaea02284"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:34:33.774264 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:34:33.774264 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-4946e151-38b4-41f6-8013-adfe31391a2f req-f2cad60b-876a-4b7b-a100-6b42ea9028bd service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:33.774264 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-4946e151-38b4-41f6-8013-adfe31391a2f req-f2cad60b-876a-4b7b-a100-6b42ea9028bd service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:33.775350 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-4946e151-38b4-41f6-8013-adfe31391a2f req-f2cad60b-876a-4b7b-a100-6b42ea9028bd service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:33.785266 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-4946e151-38b4-41f6-8013-adfe31391a2f req-f2cad60b-876a-4b7b-a100-6b42ea9028bd service nova] Creating event network-vif-plugged:97479abc-70fe-44a9-ad3c-defbaea02284 for instance bd692ac2-9881-4bb6-b50f-f596a12b1eb1 on n-h2-850501-14 Oct 04 19:34:33.791303 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-4946e151-38b4-41f6-8013-adfe31391a2f req-f2cad60b-876a-4b7b-a100-6b42ea9028bd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032988 Oct 04 19:34:33.791949 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3701/7415] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:34:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:34:34.497949 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ebea3be3-e9b9-4a83-a0b9-58a3b491dfe9 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:34:34.498567 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ebea3be3-e9b9-4a83-a0b9-58a3b491dfe9 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: bd692ac2-9881-4bb6-b50f-f596a12b1eb1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:34.505454 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ebea3be3-e9b9-4a83-a0b9-58a3b491dfe9 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:34.505941 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ebea3be3-e9b9-4a83-a0b9-58a3b491dfe9 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:34.506383 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ebea3be3-e9b9-4a83-a0b9-58a3b491dfe9 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:34.507088 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ebea3be3-e9b9-4a83-a0b9-58a3b491dfe9 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:34.507549 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ebea3be3-e9b9-4a83-a0b9-58a3b491dfe9 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:34.507983 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ebea3be3-e9b9-4a83-a0b9-58a3b491dfe9 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:34.512777 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:34:34.957424 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ebea3be3-e9b9-4a83-a0b9-58a3b491dfe9 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:34:34.965739 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ebea3be3-e9b9-4a83-a0b9-58a3b491dfe9 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1" status: 200 len: 1316 microversion: 2.1 time: 0.472488 Oct 04 19:34:34.966311 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3715/7416] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:34:34 2022] GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1 => generated 1316 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:34:35.990562 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c3f325af-bbe0-4f8b-9210-6df063e15f3b tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:34:35.991402 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c3f325af-bbe0-4f8b-9210-6df063e15f3b tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: bd692ac2-9881-4bb6-b50f-f596a12b1eb1] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:35.999848 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c3f325af-bbe0-4f8b-9210-6df063e15f3b tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:36.000382 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c3f325af-bbe0-4f8b-9210-6df063e15f3b tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:36.000840 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c3f325af-bbe0-4f8b-9210-6df063e15f3b tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:36.001573 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c3f325af-bbe0-4f8b-9210-6df063e15f3b tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:36.002043 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c3f325af-bbe0-4f8b-9210-6df063e15f3b tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:36.002483 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c3f325af-bbe0-4f8b-9210-6df063e15f3b tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:36.133513 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c3f325af-bbe0-4f8b-9210-6df063e15f3b tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:34:36.142031 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c3f325af-bbe0-4f8b-9210-6df063e15f3b tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1" status: 200 len: 1507 microversion: 2.1 time: 0.156235 Oct 04 19:34:36.142608 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3702/7417] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:34:35 2022] GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1 => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:34:36.165108 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d24a6007-4251-4f10-8ed7-5f1b23242833 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:34:36.165729 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d24a6007-4251-4f10-8ed7-5f1b23242833 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: bd692ac2-9881-4bb6-b50f-f596a12b1eb1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:36.176100 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d24a6007-4251-4f10-8ed7-5f1b23242833 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:36.176602 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d24a6007-4251-4f10-8ed7-5f1b23242833 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:36.177092 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d24a6007-4251-4f10-8ed7-5f1b23242833 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:36.177807 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d24a6007-4251-4f10-8ed7-5f1b23242833 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:36.178270 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d24a6007-4251-4f10-8ed7-5f1b23242833 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:36.178707 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d24a6007-4251-4f10-8ed7-5f1b23242833 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:36.317442 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d24a6007-4251-4f10-8ed7-5f1b23242833 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:34:36.325832 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d24a6007-4251-4f10-8ed7-5f1b23242833 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1" status: 200 len: 1507 microversion: 2.1 time: 0.164602 Oct 04 19:34:36.326413 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3716/7418] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:34:36 2022] GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1 => generated 1507 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:34:36.348610 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-bade1064-2ea2-4d96-ac36-2c3cbe004fd9 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:34:36.351066 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-bade1064-2ea2-4d96-ac36-2c3cbe004fd9 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: bd692ac2-9881-4bb6-b50f-f596a12b1eb1] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:36.357619 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bade1064-2ea2-4d96-ac36-2c3cbe004fd9 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:36.358123 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bade1064-2ea2-4d96-ac36-2c3cbe004fd9 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:36.358610 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bade1064-2ea2-4d96-ac36-2c3cbe004fd9 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:36.359402 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bade1064-2ea2-4d96-ac36-2c3cbe004fd9 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:36.359786 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bade1064-2ea2-4d96-ac36-2c3cbe004fd9 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:36.360261 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bade1064-2ea2-4d96-ac36-2c3cbe004fd9 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:36.389007 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-bade1064-2ea2-4d96-ac36-2c3cbe004fd9 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:34:36.394375 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-bade1064-2ea2-4d96-ac36-2c3cbe004fd9 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: bd692ac2-9881-4bb6-b50f-f596a12b1eb1] Old instance type m1.heat2, new instance type m1.heat {{(pid=123002) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 19:34:36.401315 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-bade1064-2ea2-4d96-ac36-2c3cbe004fd9 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:34:36.401754 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-bade1064-2ea2-4d96-ac36-2c3cbe004fd9 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:34:36.402279 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-bade1064-2ea2-4d96-ac36-2c3cbe004fd9 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:34:36.402708 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-bade1064-2ea2-4d96-ac36-2c3cbe004fd9 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:34:36.403141 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-bade1064-2ea2-4d96-ac36-2c3cbe004fd9 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:34:36.664007 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-bade1064-2ea2-4d96-ac36-2c3cbe004fd9 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "POST /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1/action" status: 202 len: 0 microversion: 2.1 time: 0.319604 Oct 04 19:34:36.664674 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3703/7419] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 19:34:36 2022] POST /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1/action => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 19:34:36.673664 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8ba7d897-9d2d-429a-af27-1ff940a0bc3d tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:34:36.674461 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8ba7d897-9d2d-429a-af27-1ff940a0bc3d tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: bd692ac2-9881-4bb6-b50f-f596a12b1eb1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:36.681135 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8ba7d897-9d2d-429a-af27-1ff940a0bc3d tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:36.681135 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8ba7d897-9d2d-429a-af27-1ff940a0bc3d tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:36.681578 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8ba7d897-9d2d-429a-af27-1ff940a0bc3d tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:36.682541 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8ba7d897-9d2d-429a-af27-1ff940a0bc3d tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:36.682916 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8ba7d897-9d2d-429a-af27-1ff940a0bc3d tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:36.683350 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8ba7d897-9d2d-429a-af27-1ff940a0bc3d tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:36.816899 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8ba7d897-9d2d-429a-af27-1ff940a0bc3d tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:34:36.824563 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8ba7d897-9d2d-429a-af27-1ff940a0bc3d tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1" status: 200 len: 1514 microversion: 2.1 time: 0.154979 Oct 04 19:34:36.825128 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3717/7420] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:34:36 2022] GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:34:37.850796 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b8e53c7e-f6e3-4b63-ae4a-5c5e35b6625e tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:34:37.851935 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b8e53c7e-f6e3-4b63-ae4a-5c5e35b6625e tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: bd692ac2-9881-4bb6-b50f-f596a12b1eb1] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:37.860373 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b8e53c7e-f6e3-4b63-ae4a-5c5e35b6625e tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:37.860872 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b8e53c7e-f6e3-4b63-ae4a-5c5e35b6625e tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:37.861627 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b8e53c7e-f6e3-4b63-ae4a-5c5e35b6625e tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:37.862790 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b8e53c7e-f6e3-4b63-ae4a-5c5e35b6625e tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:37.863267 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b8e53c7e-f6e3-4b63-ae4a-5c5e35b6625e tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:37.863985 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b8e53c7e-f6e3-4b63-ae4a-5c5e35b6625e tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:38.028904 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b8e53c7e-f6e3-4b63-ae4a-5c5e35b6625e tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:34:38.045284 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b8e53c7e-f6e3-4b63-ae4a-5c5e35b6625e tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1" status: 200 len: 1514 microversion: 2.1 time: 0.201383 Oct 04 19:34:38.045916 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3704/7421] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:34:37 2022] GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1 => generated 1514 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:34:39.073980 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-cab9592b-640f-4a66-a415-a6c9c74c444f tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:34:39.074685 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-cab9592b-640f-4a66-a415-a6c9c74c444f tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: bd692ac2-9881-4bb6-b50f-f596a12b1eb1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:39.077827 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:34:39.082773 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cab9592b-640f-4a66-a415-a6c9c74c444f tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:39.083267 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cab9592b-640f-4a66-a415-a6c9c74c444f tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:39.083712 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cab9592b-640f-4a66-a415-a6c9c74c444f tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:39.084458 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cab9592b-640f-4a66-a415-a6c9c74c444f tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:39.094419 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cab9592b-640f-4a66-a415-a6c9c74c444f tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:39.094419 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cab9592b-640f-4a66-a415-a6c9c74c444f tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:39.223242 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-cab9592b-640f-4a66-a415-a6c9c74c444f tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:34:39.232634 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-cab9592b-640f-4a66-a415-a6c9c74c444f tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1" status: 200 len: 1514 microversion: 2.1 time: 0.163297 Oct 04 19:34:39.233441 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3718/7422] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:34:39 2022] GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1 => generated 1514 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:34:40.256876 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-01ab504e-a9be-47fe-a4c3-55a780b4c40f tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:34:40.257517 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-01ab504e-a9be-47fe-a4c3-55a780b4c40f tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: bd692ac2-9881-4bb6-b50f-f596a12b1eb1] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:40.265040 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-01ab504e-a9be-47fe-a4c3-55a780b4c40f tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:40.265547 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-01ab504e-a9be-47fe-a4c3-55a780b4c40f tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:40.266022 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-01ab504e-a9be-47fe-a4c3-55a780b4c40f tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:40.266735 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-01ab504e-a9be-47fe-a4c3-55a780b4c40f tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:40.267208 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-01ab504e-a9be-47fe-a4c3-55a780b4c40f tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:40.267652 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-01ab504e-a9be-47fe-a4c3-55a780b4c40f tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:40.408497 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-01ab504e-a9be-47fe-a4c3-55a780b4c40f tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:34:40.416938 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-01ab504e-a9be-47fe-a4c3-55a780b4c40f tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1" status: 200 len: 1519 microversion: 2.1 time: 0.163219 Oct 04 19:34:40.417771 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3705/7423] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:34:40 2022] GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1 => generated 1519 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:34:41.440630 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-46f3a238-e142-4867-b66d-59f21e57c323 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:34:41.441250 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-46f3a238-e142-4867-b66d-59f21e57c323 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: bd692ac2-9881-4bb6-b50f-f596a12b1eb1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:41.448991 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-46f3a238-e142-4867-b66d-59f21e57c323 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:41.449483 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-46f3a238-e142-4867-b66d-59f21e57c323 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:41.449924 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-46f3a238-e142-4867-b66d-59f21e57c323 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:41.450615 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-46f3a238-e142-4867-b66d-59f21e57c323 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:41.451073 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-46f3a238-e142-4867-b66d-59f21e57c323 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:41.451503 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-46f3a238-e142-4867-b66d-59f21e57c323 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:41.581647 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-46f3a238-e142-4867-b66d-59f21e57c323 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:34:41.590194 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-46f3a238-e142-4867-b66d-59f21e57c323 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1" status: 200 len: 1519 microversion: 2.1 time: 0.153501 Oct 04 19:34:41.591042 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3719/7424] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:34:41 2022] GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:34:42.613948 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-786ab86a-ef2f-44c7-8bcf-420af73ca0e8 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:34:42.614569 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-786ab86a-ef2f-44c7-8bcf-420af73ca0e8 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: bd692ac2-9881-4bb6-b50f-f596a12b1eb1] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:42.621712 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-786ab86a-ef2f-44c7-8bcf-420af73ca0e8 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:42.622294 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-786ab86a-ef2f-44c7-8bcf-420af73ca0e8 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:42.622771 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-786ab86a-ef2f-44c7-8bcf-420af73ca0e8 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:42.623489 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-786ab86a-ef2f-44c7-8bcf-420af73ca0e8 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:42.623953 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-786ab86a-ef2f-44c7-8bcf-420af73ca0e8 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:42.624417 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-786ab86a-ef2f-44c7-8bcf-420af73ca0e8 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:42.757299 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-786ab86a-ef2f-44c7-8bcf-420af73ca0e8 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:34:42.765430 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-786ab86a-ef2f-44c7-8bcf-420af73ca0e8 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1" status: 200 len: 1519 microversion: 2.1 time: 0.155674 Oct 04 19:34:42.766006 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3706/7425] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:34:42 2022] GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:34:43.788750 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8a800efa-98f0-4628-a286-0d626a00bc2d tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:34:43.789346 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8a800efa-98f0-4628-a286-0d626a00bc2d tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: bd692ac2-9881-4bb6-b50f-f596a12b1eb1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:43.796974 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8a800efa-98f0-4628-a286-0d626a00bc2d tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:43.797450 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8a800efa-98f0-4628-a286-0d626a00bc2d tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:43.797883 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8a800efa-98f0-4628-a286-0d626a00bc2d tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:43.798568 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8a800efa-98f0-4628-a286-0d626a00bc2d tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:43.799016 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8a800efa-98f0-4628-a286-0d626a00bc2d tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:43.799438 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8a800efa-98f0-4628-a286-0d626a00bc2d tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:43.940227 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8a800efa-98f0-4628-a286-0d626a00bc2d tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:34:43.947922 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8a800efa-98f0-4628-a286-0d626a00bc2d tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1" status: 200 len: 1519 microversion: 2.1 time: 0.163217 Oct 04 19:34:43.949316 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3720/7426] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:34:43 2022] GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1 => generated 1519 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:34:44.972643 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7115bc46-3bab-4daa-8198-1d8a8830a199 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:34:44.973184 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7115bc46-3bab-4daa-8198-1d8a8830a199 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: bd692ac2-9881-4bb6-b50f-f596a12b1eb1] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:44.980919 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7115bc46-3bab-4daa-8198-1d8a8830a199 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:44.981427 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7115bc46-3bab-4daa-8198-1d8a8830a199 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:44.981914 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7115bc46-3bab-4daa-8198-1d8a8830a199 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:44.982627 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7115bc46-3bab-4daa-8198-1d8a8830a199 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:44.983104 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7115bc46-3bab-4daa-8198-1d8a8830a199 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:44.983547 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7115bc46-3bab-4daa-8198-1d8a8830a199 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:45.119405 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7115bc46-3bab-4daa-8198-1d8a8830a199 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:34:45.127896 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7115bc46-3bab-4daa-8198-1d8a8830a199 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1" status: 200 len: 1519 microversion: 2.1 time: 0.159636 Oct 04 19:34:45.129393 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3707/7427] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:34:44 2022] GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1 => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:34:46.150825 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-44f4f18b-3b2c-4c37-9234-006dc3a58109 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:34:46.152032 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-44f4f18b-3b2c-4c37-9234-006dc3a58109 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: bd692ac2-9881-4bb6-b50f-f596a12b1eb1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:46.158351 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-44f4f18b-3b2c-4c37-9234-006dc3a58109 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:46.158839 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-44f4f18b-3b2c-4c37-9234-006dc3a58109 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:46.159283 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-44f4f18b-3b2c-4c37-9234-006dc3a58109 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:46.159981 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-44f4f18b-3b2c-4c37-9234-006dc3a58109 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:46.160467 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-44f4f18b-3b2c-4c37-9234-006dc3a58109 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:46.160899 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-44f4f18b-3b2c-4c37-9234-006dc3a58109 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:46.296883 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-44f4f18b-3b2c-4c37-9234-006dc3a58109 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:34:46.304762 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-44f4f18b-3b2c-4c37-9234-006dc3a58109 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1" status: 200 len: 1519 microversion: 2.1 time: 0.157910 Oct 04 19:34:46.305338 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3721/7428] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:34:46 2022] GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:34:47.329293 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-71977dc2-9a4d-40f6-8a6c-1739022ed690 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:34:47.335260 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-71977dc2-9a4d-40f6-8a6c-1739022ed690 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: bd692ac2-9881-4bb6-b50f-f596a12b1eb1] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:47.336490 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-71977dc2-9a4d-40f6-8a6c-1739022ed690 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:47.337060 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-71977dc2-9a4d-40f6-8a6c-1739022ed690 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:47.337538 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-71977dc2-9a4d-40f6-8a6c-1739022ed690 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:47.338389 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-71977dc2-9a4d-40f6-8a6c-1739022ed690 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:47.339114 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-71977dc2-9a4d-40f6-8a6c-1739022ed690 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:47.339592 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-71977dc2-9a4d-40f6-8a6c-1739022ed690 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:47.471677 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-71977dc2-9a4d-40f6-8a6c-1739022ed690 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:34:47.480289 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-71977dc2-9a4d-40f6-8a6c-1739022ed690 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1" status: 200 len: 1519 microversion: 2.1 time: 0.155050 Oct 04 19:34:47.480885 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3708/7429] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:34:47 2022] GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:34:48.504452 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e1d623ac-53ad-4f08-9801-725219f276d5 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:34:48.505070 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e1d623ac-53ad-4f08-9801-725219f276d5 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: bd692ac2-9881-4bb6-b50f-f596a12b1eb1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:48.512784 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e1d623ac-53ad-4f08-9801-725219f276d5 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:48.513314 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e1d623ac-53ad-4f08-9801-725219f276d5 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:48.513756 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e1d623ac-53ad-4f08-9801-725219f276d5 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:48.514450 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e1d623ac-53ad-4f08-9801-725219f276d5 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:48.514904 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e1d623ac-53ad-4f08-9801-725219f276d5 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:48.515331 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e1d623ac-53ad-4f08-9801-725219f276d5 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:48.644939 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e1d623ac-53ad-4f08-9801-725219f276d5 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:34:48.653728 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e1d623ac-53ad-4f08-9801-725219f276d5 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1" status: 200 len: 1519 microversion: 2.1 time: 0.153264 Oct 04 19:34:48.654312 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3722/7430] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:34:48 2022] GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:34:49.677570 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-70500fd2-aace-48f8-a81b-14a4c6c3f8fd tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:34:49.678224 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-70500fd2-aace-48f8-a81b-14a4c6c3f8fd tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: bd692ac2-9881-4bb6-b50f-f596a12b1eb1] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:49.685113 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-70500fd2-aace-48f8-a81b-14a4c6c3f8fd tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:49.685611 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-70500fd2-aace-48f8-a81b-14a4c6c3f8fd tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:49.686109 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-70500fd2-aace-48f8-a81b-14a4c6c3f8fd tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:49.686812 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-70500fd2-aace-48f8-a81b-14a4c6c3f8fd tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:49.687269 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-70500fd2-aace-48f8-a81b-14a4c6c3f8fd tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:49.687700 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-70500fd2-aace-48f8-a81b-14a4c6c3f8fd tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:49.823598 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-70500fd2-aace-48f8-a81b-14a4c6c3f8fd tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:34:49.831410 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-70500fd2-aace-48f8-a81b-14a4c6c3f8fd tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1" status: 200 len: 1519 microversion: 2.1 time: 0.157741 Oct 04 19:34:49.832001 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3709/7431] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:34:49 2022] GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:34:50.856363 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-325f90db-64ef-40da-9e99-e69950507097 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:34:50.857109 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-325f90db-64ef-40da-9e99-e69950507097 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: bd692ac2-9881-4bb6-b50f-f596a12b1eb1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:50.864093 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-325f90db-64ef-40da-9e99-e69950507097 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:50.864681 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-325f90db-64ef-40da-9e99-e69950507097 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:50.865104 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-325f90db-64ef-40da-9e99-e69950507097 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:50.865798 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-325f90db-64ef-40da-9e99-e69950507097 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:50.866255 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-325f90db-64ef-40da-9e99-e69950507097 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:50.866685 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-325f90db-64ef-40da-9e99-e69950507097 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:50.999779 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-325f90db-64ef-40da-9e99-e69950507097 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:34:51.007475 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-325f90db-64ef-40da-9e99-e69950507097 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1" status: 200 len: 1519 microversion: 2.1 time: 0.155862 Oct 04 19:34:51.008039 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3723/7432] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:34:50 2022] GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:34:52.031254 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-78045656-036e-40ee-b013-a790205b3992 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:34:52.031891 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-78045656-036e-40ee-b013-a790205b3992 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: bd692ac2-9881-4bb6-b50f-f596a12b1eb1] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:52.038753 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-78045656-036e-40ee-b013-a790205b3992 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:52.039249 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-78045656-036e-40ee-b013-a790205b3992 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:52.039696 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-78045656-036e-40ee-b013-a790205b3992 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:52.040421 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-78045656-036e-40ee-b013-a790205b3992 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:52.040890 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-78045656-036e-40ee-b013-a790205b3992 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:52.041838 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-78045656-036e-40ee-b013-a790205b3992 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:52.177917 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-78045656-036e-40ee-b013-a790205b3992 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:34:52.185921 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-78045656-036e-40ee-b013-a790205b3992 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1" status: 200 len: 1519 microversion: 2.1 time: 0.158588 Oct 04 19:34:52.186503 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3710/7433] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:34:52 2022] GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:34:53.208189 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0488271c-a57e-458d-8aaf-301e12d6aac6 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:34:53.208904 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0488271c-a57e-458d-8aaf-301e12d6aac6 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: bd692ac2-9881-4bb6-b50f-f596a12b1eb1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:53.217099 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0488271c-a57e-458d-8aaf-301e12d6aac6 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:53.218360 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0488271c-a57e-458d-8aaf-301e12d6aac6 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:53.218360 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0488271c-a57e-458d-8aaf-301e12d6aac6 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:53.218831 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0488271c-a57e-458d-8aaf-301e12d6aac6 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:53.219473 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0488271c-a57e-458d-8aaf-301e12d6aac6 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:53.219897 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0488271c-a57e-458d-8aaf-301e12d6aac6 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:53.361262 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0488271c-a57e-458d-8aaf-301e12d6aac6 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:34:53.370172 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0488271c-a57e-458d-8aaf-301e12d6aac6 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1" status: 200 len: 1519 microversion: 2.1 time: 0.165313 Oct 04 19:34:53.370979 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3724/7434] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:34:53 2022] GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1 => generated 1519 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:34:54.394821 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f16e4879-5807-4c98-923f-21ad9358ab1e tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:34:54.395382 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f16e4879-5807-4c98-923f-21ad9358ab1e tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: bd692ac2-9881-4bb6-b50f-f596a12b1eb1] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:54.402679 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f16e4879-5807-4c98-923f-21ad9358ab1e tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:54.403179 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f16e4879-5807-4c98-923f-21ad9358ab1e tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:54.403636 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f16e4879-5807-4c98-923f-21ad9358ab1e tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:54.404382 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f16e4879-5807-4c98-923f-21ad9358ab1e tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:54.404851 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f16e4879-5807-4c98-923f-21ad9358ab1e tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:54.405303 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f16e4879-5807-4c98-923f-21ad9358ab1e tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:54.541331 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f16e4879-5807-4c98-923f-21ad9358ab1e tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:34:54.549376 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f16e4879-5807-4c98-923f-21ad9358ab1e tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1" status: 200 len: 1519 microversion: 2.1 time: 0.158763 Oct 04 19:34:54.549954 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3711/7435] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:34:54 2022] GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:34:55.574351 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-839cbdda-fbc0-4aff-8b13-01d056379973 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:34:55.574988 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-839cbdda-fbc0-4aff-8b13-01d056379973 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: bd692ac2-9881-4bb6-b50f-f596a12b1eb1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:55.581962 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-839cbdda-fbc0-4aff-8b13-01d056379973 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:55.582453 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-839cbdda-fbc0-4aff-8b13-01d056379973 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:55.582894 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-839cbdda-fbc0-4aff-8b13-01d056379973 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:55.583587 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-839cbdda-fbc0-4aff-8b13-01d056379973 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:55.584042 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-839cbdda-fbc0-4aff-8b13-01d056379973 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:55.584497 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-839cbdda-fbc0-4aff-8b13-01d056379973 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:55.718718 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-839cbdda-fbc0-4aff-8b13-01d056379973 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:34:55.726895 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-839cbdda-fbc0-4aff-8b13-01d056379973 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1" status: 200 len: 1519 microversion: 2.1 time: 0.157376 Oct 04 19:34:55.727536 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3725/7436] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:34:55 2022] GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:34:56.753448 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-abd5ac90-8ad9-40b6-8486-30e5030eea5e tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:34:56.754108 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-abd5ac90-8ad9-40b6-8486-30e5030eea5e tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: bd692ac2-9881-4bb6-b50f-f596a12b1eb1] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:56.763134 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-abd5ac90-8ad9-40b6-8486-30e5030eea5e tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:56.763931 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-abd5ac90-8ad9-40b6-8486-30e5030eea5e tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:56.764426 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-abd5ac90-8ad9-40b6-8486-30e5030eea5e tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:56.765151 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-abd5ac90-8ad9-40b6-8486-30e5030eea5e tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:56.765620 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-abd5ac90-8ad9-40b6-8486-30e5030eea5e tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:56.766065 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-abd5ac90-8ad9-40b6-8486-30e5030eea5e tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:56.902667 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-abd5ac90-8ad9-40b6-8486-30e5030eea5e tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:34:56.910339 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-abd5ac90-8ad9-40b6-8486-30e5030eea5e tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1" status: 200 len: 1519 microversion: 2.1 time: 0.162942 Oct 04 19:34:56.910909 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3712/7437] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:34:56 2022] GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1 => generated 1519 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:34:57.933725 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-00635cb0-0be4-4c77-893a-9a0b457d45bc tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:34:57.934361 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-00635cb0-0be4-4c77-893a-9a0b457d45bc tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: bd692ac2-9881-4bb6-b50f-f596a12b1eb1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:57.941205 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-00635cb0-0be4-4c77-893a-9a0b457d45bc tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:57.941701 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-00635cb0-0be4-4c77-893a-9a0b457d45bc tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:57.942132 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-00635cb0-0be4-4c77-893a-9a0b457d45bc tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:57.942818 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-00635cb0-0be4-4c77-893a-9a0b457d45bc tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:57.943269 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-00635cb0-0be4-4c77-893a-9a0b457d45bc tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:57.943691 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-00635cb0-0be4-4c77-893a-9a0b457d45bc tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:58.078319 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-00635cb0-0be4-4c77-893a-9a0b457d45bc tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:34:58.092201 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-00635cb0-0be4-4c77-893a-9a0b457d45bc tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1" status: 200 len: 1519 microversion: 2.1 time: 0.161698 Oct 04 19:34:58.092693 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3726/7438] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:34:57 2022] GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1 => generated 1519 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:34:59.115946 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2403c005-61de-4e4d-b369-1cb13d21a9f5 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:34:59.116608 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2403c005-61de-4e4d-b369-1cb13d21a9f5 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: bd692ac2-9881-4bb6-b50f-f596a12b1eb1] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:59.123872 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2403c005-61de-4e4d-b369-1cb13d21a9f5 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:59.126034 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2403c005-61de-4e4d-b369-1cb13d21a9f5 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:59.126034 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2403c005-61de-4e4d-b369-1cb13d21a9f5 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:59.126034 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2403c005-61de-4e4d-b369-1cb13d21a9f5 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:59.126034 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2403c005-61de-4e4d-b369-1cb13d21a9f5 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:59.126476 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2403c005-61de-4e4d-b369-1cb13d21a9f5 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:59.269457 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2403c005-61de-4e4d-b369-1cb13d21a9f5 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:34:59.278302 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2403c005-61de-4e4d-b369-1cb13d21a9f5 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1" status: 200 len: 1519 microversion: 2.1 time: 0.166239 Oct 04 19:34:59.278906 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3713/7439] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:34:59 2022] GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1 => generated 1519 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:35:00.302692 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-86c181de-b29f-4828-b8ff-e896bbebc02d tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:35:00.303302 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-86c181de-b29f-4828-b8ff-e896bbebc02d tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: bd692ac2-9881-4bb6-b50f-f596a12b1eb1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:35:00.310306 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-86c181de-b29f-4828-b8ff-e896bbebc02d tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:00.310784 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-86c181de-b29f-4828-b8ff-e896bbebc02d tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:00.311217 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-86c181de-b29f-4828-b8ff-e896bbebc02d tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:00.311910 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-86c181de-b29f-4828-b8ff-e896bbebc02d tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:00.312385 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-86c181de-b29f-4828-b8ff-e896bbebc02d tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:00.312809 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-86c181de-b29f-4828-b8ff-e896bbebc02d tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:00.457736 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-86c181de-b29f-4828-b8ff-e896bbebc02d tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:35:00.466340 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-86c181de-b29f-4828-b8ff-e896bbebc02d tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1" status: 200 len: 1519 microversion: 2.1 time: 0.167589 Oct 04 19:35:00.466918 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3727/7440] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:35:00 2022] GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1 => generated 1519 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:35:01.490081 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5a4cd262-6cb2-41a8-859c-3747cc4f2f43 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:35:01.490714 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5a4cd262-6cb2-41a8-859c-3747cc4f2f43 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: bd692ac2-9881-4bb6-b50f-f596a12b1eb1] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:35:01.497904 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5a4cd262-6cb2-41a8-859c-3747cc4f2f43 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:01.498405 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5a4cd262-6cb2-41a8-859c-3747cc4f2f43 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:01.498855 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5a4cd262-6cb2-41a8-859c-3747cc4f2f43 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:01.499557 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5a4cd262-6cb2-41a8-859c-3747cc4f2f43 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:01.500025 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5a4cd262-6cb2-41a8-859c-3747cc4f2f43 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:01.500491 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5a4cd262-6cb2-41a8-859c-3747cc4f2f43 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:01.632232 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5a4cd262-6cb2-41a8-859c-3747cc4f2f43 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:35:01.640608 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5a4cd262-6cb2-41a8-859c-3747cc4f2f43 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1" status: 200 len: 1519 microversion: 2.1 time: 0.154506 Oct 04 19:35:01.641189 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3714/7441] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:35:01 2022] GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:35:02.663692 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8905b096-1118-47c5-8985-800b1642e542 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:35:02.664289 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8905b096-1118-47c5-8985-800b1642e542 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: bd692ac2-9881-4bb6-b50f-f596a12b1eb1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:35:02.671231 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8905b096-1118-47c5-8985-800b1642e542 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:02.671725 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8905b096-1118-47c5-8985-800b1642e542 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:02.672199 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8905b096-1118-47c5-8985-800b1642e542 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:02.672906 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8905b096-1118-47c5-8985-800b1642e542 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:02.673383 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8905b096-1118-47c5-8985-800b1642e542 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:02.673799 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8905b096-1118-47c5-8985-800b1642e542 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:02.805545 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8905b096-1118-47c5-8985-800b1642e542 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:35:02.813914 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8905b096-1118-47c5-8985-800b1642e542 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1" status: 200 len: 1519 microversion: 2.1 time: 0.154236 Oct 04 19:35:02.814502 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3728/7442] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:35:02 2022] GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:35:03.837242 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-cf289909-7584-43f2-9fad-1c11eade6456 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:35:03.838170 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-cf289909-7584-43f2-9fad-1c11eade6456 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: bd692ac2-9881-4bb6-b50f-f596a12b1eb1] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:35:03.845286 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cf289909-7584-43f2-9fad-1c11eade6456 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:03.845789 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cf289909-7584-43f2-9fad-1c11eade6456 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:03.846242 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cf289909-7584-43f2-9fad-1c11eade6456 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:03.846957 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cf289909-7584-43f2-9fad-1c11eade6456 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:03.847425 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cf289909-7584-43f2-9fad-1c11eade6456 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:03.847869 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cf289909-7584-43f2-9fad-1c11eade6456 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:03.851936 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:35:03.998640 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-cf289909-7584-43f2-9fad-1c11eade6456 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:35:04.006576 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-cf289909-7584-43f2-9fad-1c11eade6456 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1" status: 200 len: 1519 microversion: 2.1 time: 0.173257 Oct 04 19:35:04.007160 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3715/7443] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:35:03 2022] GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1 => generated 1519 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:35:05.031689 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b8094216-c45c-4557-ace8-a3d408e42192 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:35:05.032265 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b8094216-c45c-4557-ace8-a3d408e42192 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: bd692ac2-9881-4bb6-b50f-f596a12b1eb1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:35:05.039117 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b8094216-c45c-4557-ace8-a3d408e42192 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:05.039615 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b8094216-c45c-4557-ace8-a3d408e42192 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:05.040086 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b8094216-c45c-4557-ace8-a3d408e42192 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:05.040784 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b8094216-c45c-4557-ace8-a3d408e42192 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:05.041306 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b8094216-c45c-4557-ace8-a3d408e42192 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:05.041735 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b8094216-c45c-4557-ace8-a3d408e42192 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:05.044326 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=84 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:35:05.175612 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b8094216-c45c-4557-ace8-a3d408e42192 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:35:05.184104 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b8094216-c45c-4557-ace8-a3d408e42192 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1" status: 200 len: 1519 microversion: 2.1 time: 0.156518 Oct 04 19:35:05.184698 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3729/7444] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:35:05 2022] GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:35:06.207154 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9f4c0aa5-9b03-4a95-b43a-445f2d8b85af tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:35:06.207827 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9f4c0aa5-9b03-4a95-b43a-445f2d8b85af tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: bd692ac2-9881-4bb6-b50f-f596a12b1eb1] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:35:06.210714 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=34 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:35:06.215613 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9f4c0aa5-9b03-4a95-b43a-445f2d8b85af tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:06.227491 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9f4c0aa5-9b03-4a95-b43a-445f2d8b85af tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:06.227491 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9f4c0aa5-9b03-4a95-b43a-445f2d8b85af tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:06.227491 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9f4c0aa5-9b03-4a95-b43a-445f2d8b85af tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:06.227491 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9f4c0aa5-9b03-4a95-b43a-445f2d8b85af tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:06.227491 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9f4c0aa5-9b03-4a95-b43a-445f2d8b85af tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:06.351984 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9f4c0aa5-9b03-4a95-b43a-445f2d8b85af tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:35:06.359913 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9f4c0aa5-9b03-4a95-b43a-445f2d8b85af tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1" status: 200 len: 1519 microversion: 2.1 time: 0.156682 Oct 04 19:35:06.360525 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3716/7445] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:35:06 2022] GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:35:07.387229 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3ff1c4e1-85f9-4ab2-aec2-519c88e0040b tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:35:07.387882 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3ff1c4e1-85f9-4ab2-aec2-519c88e0040b tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: bd692ac2-9881-4bb6-b50f-f596a12b1eb1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:35:07.395320 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3ff1c4e1-85f9-4ab2-aec2-519c88e0040b tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:07.395805 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3ff1c4e1-85f9-4ab2-aec2-519c88e0040b tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:07.396277 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3ff1c4e1-85f9-4ab2-aec2-519c88e0040b tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:07.396972 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3ff1c4e1-85f9-4ab2-aec2-519c88e0040b tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:07.397427 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3ff1c4e1-85f9-4ab2-aec2-519c88e0040b tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:07.397848 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3ff1c4e1-85f9-4ab2-aec2-519c88e0040b tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:07.532529 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3ff1c4e1-85f9-4ab2-aec2-519c88e0040b tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:35:07.540430 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3ff1c4e1-85f9-4ab2-aec2-519c88e0040b tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1" status: 200 len: 1519 microversion: 2.1 time: 0.159887 Oct 04 19:35:07.541080 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3730/7446] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:35:07 2022] GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1 => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:35:07.977112 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-df5427e5-2218-4fa9-a4a8-0c153e7fddb3 req-ac5e898f-2e77-44d6-8179-50c2fe9f6b0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd692ac2-9881-4bb6-b50f-f596a12b1eb1", "name": "network-vif-unplugged", "status": "completed", "tag": "97479abc-70fe-44a9-ad3c-defbaea02284"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:35:07.988569 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-df5427e5-2218-4fa9-a4a8-0c153e7fddb3 req-ac5e898f-2e77-44d6-8179-50c2fe9f6b0b service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:07.989073 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-df5427e5-2218-4fa9-a4a8-0c153e7fddb3 req-ac5e898f-2e77-44d6-8179-50c2fe9f6b0b service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:07.989515 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-df5427e5-2218-4fa9-a4a8-0c153e7fddb3 req-ac5e898f-2e77-44d6-8179-50c2fe9f6b0b service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:08.002413 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-df5427e5-2218-4fa9-a4a8-0c153e7fddb3 req-ac5e898f-2e77-44d6-8179-50c2fe9f6b0b service nova] Creating event network-vif-unplugged:97479abc-70fe-44a9-ad3c-defbaea02284 for instance bd692ac2-9881-4bb6-b50f-f596a12b1eb1 on n-h1-850501-14 Oct 04 19:35:08.007785 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [req-df5427e5-2218-4fa9-a4a8-0c153e7fddb3 req-ac5e898f-2e77-44d6-8179-50c2fe9f6b0b service nova] Instance bd692ac2-9881-4bb6-b50f-f596a12b1eb1 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850501-14', 'n-h2-850501-14'} {{(pid=123002) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:35:08.020109 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-df5427e5-2218-4fa9-a4a8-0c153e7fddb3 req-ac5e898f-2e77-44d6-8179-50c2fe9f6b0b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046835 Oct 04 19:35:08.020737 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3717/7447] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:35:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:35:08.563320 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5ff5f608-2237-45bd-8835-c819e641b045 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:35:08.563894 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5ff5f608-2237-45bd-8835-c819e641b045 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: bd692ac2-9881-4bb6-b50f-f596a12b1eb1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:35:08.570655 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5ff5f608-2237-45bd-8835-c819e641b045 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:08.571146 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5ff5f608-2237-45bd-8835-c819e641b045 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:08.571586 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5ff5f608-2237-45bd-8835-c819e641b045 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:08.572523 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5ff5f608-2237-45bd-8835-c819e641b045 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:08.572991 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5ff5f608-2237-45bd-8835-c819e641b045 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:08.573427 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5ff5f608-2237-45bd-8835-c819e641b045 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:08.806679 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5ff5f608-2237-45bd-8835-c819e641b045 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:35:08.814541 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5ff5f608-2237-45bd-8835-c819e641b045 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1" status: 200 len: 1518 microversion: 2.1 time: 0.255414 Oct 04 19:35:08.815071 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3731/7448] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:35:08 2022] GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1 => generated 1518 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:35:09.839877 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-adb6495f-69ce-437e-9eb8-c4f5f8ed6476 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:35:09.840620 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-adb6495f-69ce-437e-9eb8-c4f5f8ed6476 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: bd692ac2-9881-4bb6-b50f-f596a12b1eb1] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:35:09.847886 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-adb6495f-69ce-437e-9eb8-c4f5f8ed6476 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:09.848431 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-adb6495f-69ce-437e-9eb8-c4f5f8ed6476 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:09.848887 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-adb6495f-69ce-437e-9eb8-c4f5f8ed6476 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:09.849602 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-adb6495f-69ce-437e-9eb8-c4f5f8ed6476 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:09.850075 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-adb6495f-69ce-437e-9eb8-c4f5f8ed6476 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:09.850521 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-adb6495f-69ce-437e-9eb8-c4f5f8ed6476 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:09.992717 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-adb6495f-69ce-437e-9eb8-c4f5f8ed6476 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:35:10.000934 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-adb6495f-69ce-437e-9eb8-c4f5f8ed6476 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1" status: 200 len: 1516 microversion: 2.1 time: 0.165958 Oct 04 19:35:10.001508 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3718/7449] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:35:09 2022] GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1 => generated 1516 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:35:10.034892 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-5fed4e3a-9560-4f37-9dc1-de0cdac26e1c req-52e01ade-b780-48dd-9632-92ca8cb6d05d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd692ac2-9881-4bb6-b50f-f596a12b1eb1", "tag": "97479abc-70fe-44a9-ad3c-defbaea02284"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:35:10.045834 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-5fed4e3a-9560-4f37-9dc1-de0cdac26e1c req-52e01ade-b780-48dd-9632-92ca8cb6d05d service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:10.046308 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-5fed4e3a-9560-4f37-9dc1-de0cdac26e1c req-52e01ade-b780-48dd-9632-92ca8cb6d05d service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:10.046737 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-5fed4e3a-9560-4f37-9dc1-de0cdac26e1c req-52e01ade-b780-48dd-9632-92ca8cb6d05d service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:10.058324 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-5fed4e3a-9560-4f37-9dc1-de0cdac26e1c req-52e01ade-b780-48dd-9632-92ca8cb6d05d service nova] Creating event network-changed:97479abc-70fe-44a9-ad3c-defbaea02284 for instance bd692ac2-9881-4bb6-b50f-f596a12b1eb1 on n-h1-850501-14 Oct 04 19:35:10.063503 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [req-5fed4e3a-9560-4f37-9dc1-de0cdac26e1c req-52e01ade-b780-48dd-9632-92ca8cb6d05d service nova] Instance bd692ac2-9881-4bb6-b50f-f596a12b1eb1 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850501-14', 'n-h2-850501-14'} {{(pid=123001) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:35:10.074062 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-5fed4e3a-9560-4f37-9dc1-de0cdac26e1c req-52e01ade-b780-48dd-9632-92ca8cb6d05d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042874 Oct 04 19:35:10.074747 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3732/7450] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:35:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:35:11.024766 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2e148289-1cef-4d54-87c2-64afc251528f tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:35:11.026010 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2e148289-1cef-4d54-87c2-64afc251528f tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: bd692ac2-9881-4bb6-b50f-f596a12b1eb1] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:35:11.032871 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e148289-1cef-4d54-87c2-64afc251528f tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:11.033368 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e148289-1cef-4d54-87c2-64afc251528f tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:11.033842 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e148289-1cef-4d54-87c2-64afc251528f tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:11.034579 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e148289-1cef-4d54-87c2-64afc251528f tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:11.035047 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e148289-1cef-4d54-87c2-64afc251528f tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:11.035484 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e148289-1cef-4d54-87c2-64afc251528f tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:11.169963 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2e148289-1cef-4d54-87c2-64afc251528f tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:35:11.177847 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2e148289-1cef-4d54-87c2-64afc251528f tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1" status: 200 len: 1513 microversion: 2.1 time: 0.157011 Oct 04 19:35:11.180524 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3719/7451] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:35:11 2022] GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1 => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:35:11.202353 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-aaddab1a-064d-42cb-ab53-3d4794161c4c tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:35:11.202915 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-aaddab1a-064d-42cb-ab53-3d4794161c4c tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: bd692ac2-9881-4bb6-b50f-f596a12b1eb1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:35:11.209166 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aaddab1a-064d-42cb-ab53-3d4794161c4c tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:11.209656 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aaddab1a-064d-42cb-ab53-3d4794161c4c tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:11.210208 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aaddab1a-064d-42cb-ab53-3d4794161c4c tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:11.210791 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aaddab1a-064d-42cb-ab53-3d4794161c4c tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:11.211262 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aaddab1a-064d-42cb-ab53-3d4794161c4c tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:11.211697 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aaddab1a-064d-42cb-ab53-3d4794161c4c tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:11.458656 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-aaddab1a-064d-42cb-ab53-3d4794161c4c tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "POST /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1/action" status: 204 len: 0 microversion: 2.1 time: 0.261911 Oct 04 19:35:11.459233 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3733/7452] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 19:35:11 2022] POST /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1/action => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:35:11.468740 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-db392383-9c5f-4fe6-b5a6-308f826948bb tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:35:11.469643 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-db392383-9c5f-4fe6-b5a6-308f826948bb tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: bd692ac2-9881-4bb6-b50f-f596a12b1eb1] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:35:11.475721 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-db392383-9c5f-4fe6-b5a6-308f826948bb tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:11.476279 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-db392383-9c5f-4fe6-b5a6-308f826948bb tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:11.476737 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-db392383-9c5f-4fe6-b5a6-308f826948bb tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:11.477480 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-db392383-9c5f-4fe6-b5a6-308f826948bb tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:11.477970 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-db392383-9c5f-4fe6-b5a6-308f826948bb tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:11.478403 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-db392383-9c5f-4fe6-b5a6-308f826948bb tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:11.615688 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-db392383-9c5f-4fe6-b5a6-308f826948bb tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:35:11.626950 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-db392383-9c5f-4fe6-b5a6-308f826948bb tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1" status: 200 len: 1513 microversion: 2.1 time: 0.163171 Oct 04 19:35:11.627743 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3720/7453] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:35:11 2022] GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1 => generated 1513 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:35:12.653030 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8e332606-23d2-4a84-835d-d7f35dd49826 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:35:12.653726 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8e332606-23d2-4a84-835d-d7f35dd49826 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: bd692ac2-9881-4bb6-b50f-f596a12b1eb1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:35:12.655761 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=32 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:35:12.660780 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8e332606-23d2-4a84-835d-d7f35dd49826 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:12.661265 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8e332606-23d2-4a84-835d-d7f35dd49826 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:12.661698 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8e332606-23d2-4a84-835d-d7f35dd49826 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:12.662392 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8e332606-23d2-4a84-835d-d7f35dd49826 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:12.662840 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8e332606-23d2-4a84-835d-d7f35dd49826 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:12.663278 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8e332606-23d2-4a84-835d-d7f35dd49826 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:12.798425 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8e332606-23d2-4a84-835d-d7f35dd49826 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:35:12.806615 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8e332606-23d2-4a84-835d-d7f35dd49826 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1" status: 200 len: 1513 microversion: 2.1 time: 0.159099 Oct 04 19:35:12.807427 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3734/7454] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:35:12 2022] GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1 => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:35:13.831703 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-df8ad6e9-046d-4ee0-bd6f-7ecb1637e062 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:35:13.832424 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-df8ad6e9-046d-4ee0-bd6f-7ecb1637e062 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: bd692ac2-9881-4bb6-b50f-f596a12b1eb1] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:35:13.840541 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-df8ad6e9-046d-4ee0-bd6f-7ecb1637e062 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:13.841069 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-df8ad6e9-046d-4ee0-bd6f-7ecb1637e062 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:13.841524 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-df8ad6e9-046d-4ee0-bd6f-7ecb1637e062 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:13.842235 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-df8ad6e9-046d-4ee0-bd6f-7ecb1637e062 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:13.842708 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-df8ad6e9-046d-4ee0-bd6f-7ecb1637e062 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:13.843168 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-df8ad6e9-046d-4ee0-bd6f-7ecb1637e062 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:13.976774 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-df8ad6e9-046d-4ee0-bd6f-7ecb1637e062 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:35:13.984858 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-df8ad6e9-046d-4ee0-bd6f-7ecb1637e062 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1" status: 200 len: 1505 microversion: 2.1 time: 0.157485 Oct 04 19:35:13.985436 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3721/7455] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:35:13 2022] GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1 => generated 1505 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:35:14.007229 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d7baed95-7288-46cb-b10a-939c2cd1a1a0 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:35:14.007850 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d7baed95-7288-46cb-b10a-939c2cd1a1a0 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: bd692ac2-9881-4bb6-b50f-f596a12b1eb1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:35:14.015408 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d7baed95-7288-46cb-b10a-939c2cd1a1a0 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:14.015894 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d7baed95-7288-46cb-b10a-939c2cd1a1a0 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:14.016370 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d7baed95-7288-46cb-b10a-939c2cd1a1a0 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:14.017060 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d7baed95-7288-46cb-b10a-939c2cd1a1a0 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:14.017517 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d7baed95-7288-46cb-b10a-939c2cd1a1a0 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:14.017945 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d7baed95-7288-46cb-b10a-939c2cd1a1a0 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:14.158115 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d7baed95-7288-46cb-b10a-939c2cd1a1a0 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:35:14.167094 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d7baed95-7288-46cb-b10a-939c2cd1a1a0 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1" status: 200 len: 1505 microversion: 2.1 time: 0.162893 Oct 04 19:35:14.167696 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3735/7456] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:35:14 2022] GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1 => generated 1505 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:35:14.189650 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-20915175-65f7-4956-a174-39ddafe8b755 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:35:14.190282 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-20915175-65f7-4956-a174-39ddafe8b755 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: bd692ac2-9881-4bb6-b50f-f596a12b1eb1] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:35:14.197598 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-20915175-65f7-4956-a174-39ddafe8b755 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:14.207564 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-20915175-65f7-4956-a174-39ddafe8b755 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:14.207564 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-20915175-65f7-4956-a174-39ddafe8b755 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:14.207564 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-20915175-65f7-4956-a174-39ddafe8b755 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:14.207564 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-20915175-65f7-4956-a174-39ddafe8b755 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:14.207564 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-20915175-65f7-4956-a174-39ddafe8b755 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:14.333309 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-20915175-65f7-4956-a174-39ddafe8b755 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:35:14.341082 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-20915175-65f7-4956-a174-39ddafe8b755 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1" status: 200 len: 1505 microversion: 2.1 time: 0.155582 Oct 04 19:35:14.341666 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3722/7457] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:35:14 2022] GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1 => generated 1505 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:35:14.364579 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-eb42e33d-4a9c-4726-ab5b-4099a1428c60 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:35:14.365124 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-eb42e33d-4a9c-4726-ab5b-4099a1428c60 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: bd692ac2-9881-4bb6-b50f-f596a12b1eb1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:35:14.371687 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eb42e33d-4a9c-4726-ab5b-4099a1428c60 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:14.372213 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eb42e33d-4a9c-4726-ab5b-4099a1428c60 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:14.372648 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eb42e33d-4a9c-4726-ab5b-4099a1428c60 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:14.373338 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eb42e33d-4a9c-4726-ab5b-4099a1428c60 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:14.373793 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eb42e33d-4a9c-4726-ab5b-4099a1428c60 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:14.374222 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eb42e33d-4a9c-4726-ab5b-4099a1428c60 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:14.400229 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-eb42e33d-4a9c-4726-ab5b-4099a1428c60 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: bd692ac2-9881-4bb6-b50f-f596a12b1eb1] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:35:14.664799 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-eb42e33d-4a9c-4726-ab5b-4099a1428c60 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "DELETE /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1" status: 204 len: 0 microversion: 2.1 time: 0.303667 Oct 04 19:35:14.665947 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3736/7458] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 19:35:14 2022] DELETE /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:35:14.684898 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1fd3f778-b1f0-42fa-98e7-594b6978e516 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:35:14.685422 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1fd3f778-b1f0-42fa-98e7-594b6978e516 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: bd692ac2-9881-4bb6-b50f-f596a12b1eb1] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:35:14.691573 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1fd3f778-b1f0-42fa-98e7-594b6978e516 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:14.692089 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1fd3f778-b1f0-42fa-98e7-594b6978e516 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:14.692557 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1fd3f778-b1f0-42fa-98e7-594b6978e516 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:14.693268 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1fd3f778-b1f0-42fa-98e7-594b6978e516 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:14.693735 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1fd3f778-b1f0-42fa-98e7-594b6978e516 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:14.694179 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1fd3f778-b1f0-42fa-98e7-594b6978e516 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:14.722191 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1fd3f778-b1f0-42fa-98e7-594b6978e516 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: bd692ac2-9881-4bb6-b50f-f596a12b1eb1] Going to try to terminate instance {{(pid=123002) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:35:14.840009 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.compute.api [None req-1fd3f778-b1f0-42fa-98e7-594b6978e516 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: bd692ac2-9881-4bb6-b50f-f596a12b1eb1] Instance is already in deleting state, ignoring this request Oct 04 19:35:14.840996 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1fd3f778-b1f0-42fa-98e7-594b6978e516 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "DELETE /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1" status: 204 len: 0 microversion: 2.1 time: 0.161308 Oct 04 19:35:14.841631 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3723/7459] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 19:35:14 2022] DELETE /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:35:14.850913 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a1754f88-e8d9-4267-a531-842650adb31b tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:35:14.851617 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a1754f88-e8d9-4267-a531-842650adb31b tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: bd692ac2-9881-4bb6-b50f-f596a12b1eb1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:35:14.858354 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a1754f88-e8d9-4267-a531-842650adb31b tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:14.860795 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a1754f88-e8d9-4267-a531-842650adb31b tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:14.860795 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a1754f88-e8d9-4267-a531-842650adb31b tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:14.860795 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a1754f88-e8d9-4267-a531-842650adb31b tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:14.860795 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a1754f88-e8d9-4267-a531-842650adb31b tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:14.861161 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a1754f88-e8d9-4267-a531-842650adb31b tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:15.002225 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a1754f88-e8d9-4267-a531-842650adb31b tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:35:15.010621 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a1754f88-e8d9-4267-a531-842650adb31b tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1" status: 200 len: 1511 microversion: 2.1 time: 0.164280 Oct 04 19:35:15.011281 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3737/7460] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:35:14 2022] GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1 => generated 1511 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:35:15.098526 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-c325ecc1-e753-4ac8-9beb-54e633def85b req-0534c570-93df-4aef-90d0-4edc8bf05b88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd692ac2-9881-4bb6-b50f-f596a12b1eb1", "name": "network-vif-plugged", "status": "completed", "tag": "97479abc-70fe-44a9-ad3c-defbaea02284"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:35:15.109127 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-c325ecc1-e753-4ac8-9beb-54e633def85b req-0534c570-93df-4aef-90d0-4edc8bf05b88 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:15.109631 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-c325ecc1-e753-4ac8-9beb-54e633def85b req-0534c570-93df-4aef-90d0-4edc8bf05b88 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:15.110074 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-c325ecc1-e753-4ac8-9beb-54e633def85b req-0534c570-93df-4aef-90d0-4edc8bf05b88 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:15.121751 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-c325ecc1-e753-4ac8-9beb-54e633def85b req-0534c570-93df-4aef-90d0-4edc8bf05b88 service nova] Creating event network-vif-plugged:97479abc-70fe-44a9-ad3c-defbaea02284 for instance bd692ac2-9881-4bb6-b50f-f596a12b1eb1 on n-h1-850501-14 Oct 04 19:35:15.126772 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-c325ecc1-e753-4ac8-9beb-54e633def85b req-0534c570-93df-4aef-90d0-4edc8bf05b88 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032404 Oct 04 19:35:15.127367 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3724/7461] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:35:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:35:16.034856 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b043c660-1929-48dd-ba36-06afcc5a71a5 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:35:16.035432 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b043c660-1929-48dd-ba36-06afcc5a71a5 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: bd692ac2-9881-4bb6-b50f-f596a12b1eb1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:35:16.042470 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b043c660-1929-48dd-ba36-06afcc5a71a5 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:16.042952 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b043c660-1929-48dd-ba36-06afcc5a71a5 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:16.043401 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b043c660-1929-48dd-ba36-06afcc5a71a5 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:16.044175 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b043c660-1929-48dd-ba36-06afcc5a71a5 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:16.044632 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b043c660-1929-48dd-ba36-06afcc5a71a5 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:16.045113 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b043c660-1929-48dd-ba36-06afcc5a71a5 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:16.306663 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b043c660-1929-48dd-ba36-06afcc5a71a5 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:35:16.316175 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b043c660-1929-48dd-ba36-06afcc5a71a5 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1" status: 200 len: 1511 microversion: 2.1 time: 0.285300 Oct 04 19:35:16.316778 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3738/7462] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:35:16 2022] GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1 => generated 1511 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:35:16.756409 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-02da2f3b-05f4-456f-83ce-c500145e5896 req-0236eb42-5901-4ce1-8539-5607cb20d1e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd692ac2-9881-4bb6-b50f-f596a12b1eb1", "name": "network-vif-deleted", "tag": "97479abc-70fe-44a9-ad3c-defbaea02284"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:35:16.766894 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-02da2f3b-05f4-456f-83ce-c500145e5896 req-0236eb42-5901-4ce1-8539-5607cb20d1e5 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:16.767390 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-02da2f3b-05f4-456f-83ce-c500145e5896 req-0236eb42-5901-4ce1-8539-5607cb20d1e5 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:16.767840 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-02da2f3b-05f4-456f-83ce-c500145e5896 req-0236eb42-5901-4ce1-8539-5607cb20d1e5 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:16.780787 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-02da2f3b-05f4-456f-83ce-c500145e5896 req-0236eb42-5901-4ce1-8539-5607cb20d1e5 service nova] Creating event network-vif-deleted:97479abc-70fe-44a9-ad3c-defbaea02284 for instance bd692ac2-9881-4bb6-b50f-f596a12b1eb1 on n-h1-850501-14 Oct 04 19:35:16.786080 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-02da2f3b-05f4-456f-83ce-c500145e5896 req-0236eb42-5901-4ce1-8539-5607cb20d1e5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034860 Oct 04 19:35:16.786745 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3725/7463] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:35:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:35:17.346156 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1b39138d-129f-4650-82a1-c8e87f4eb57c tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:35:17.346861 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1b39138d-129f-4650-82a1-c8e87f4eb57c tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: bd692ac2-9881-4bb6-b50f-f596a12b1eb1] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:35:17.353983 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1b39138d-129f-4650-82a1-c8e87f4eb57c tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:17.354475 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1b39138d-129f-4650-82a1-c8e87f4eb57c tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:17.354921 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1b39138d-129f-4650-82a1-c8e87f4eb57c tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:17.355628 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1b39138d-129f-4650-82a1-c8e87f4eb57c tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:17.356121 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1b39138d-129f-4650-82a1-c8e87f4eb57c tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:17.356558 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1b39138d-129f-4650-82a1-c8e87f4eb57c tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:17.393058 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1b39138d-129f-4650-82a1-c8e87f4eb57c tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:17.393811 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1b39138d-129f-4650-82a1-c8e87f4eb57c tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:17.394571 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1b39138d-129f-4650-82a1-c8e87f4eb57c tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:17.395197 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-1b39138d-129f-4650-82a1-c8e87f4eb57c tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lazy-loading 'fault' on Instance uuid bd692ac2-9881-4bb6-b50f-f596a12b1eb1 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:35:17.438815 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1b39138d-129f-4650-82a1-c8e87f4eb57c tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dedbd53c8584342a20523734518e591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca71f9591344456835761dc8045b825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:35:17.448110 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1b39138d-129f-4650-82a1-c8e87f4eb57c tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1" status: 200 len: 1304 microversion: 2.1 time: 0.106312 Oct 04 19:35:17.448745 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3739/7464] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:35:17 2022] GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1 => generated 1304 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:35:18.472783 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f86dd452-6e7c-4389-b5ec-22f4d9906f7e tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:35:18.473443 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f86dd452-6e7c-4389-b5ec-22f4d9906f7e tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: bd692ac2-9881-4bb6-b50f-f596a12b1eb1] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:35:18.480373 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f86dd452-6e7c-4389-b5ec-22f4d9906f7e tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:18.480871 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f86dd452-6e7c-4389-b5ec-22f4d9906f7e tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:18.481318 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f86dd452-6e7c-4389-b5ec-22f4d9906f7e tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:18.482027 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f86dd452-6e7c-4389-b5ec-22f4d9906f7e tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:18.482491 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f86dd452-6e7c-4389-b5ec-22f4d9906f7e tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:18.482929 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f86dd452-6e7c-4389-b5ec-22f4d9906f7e tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:18.496821 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-f86dd452-6e7c-4389-b5ec-22f4d9906f7e tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] HTTP exception thrown: Instance bd692ac2-9881-4bb6-b50f-f596a12b1eb1 could not be found. Oct 04 19:35:18.498527 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f86dd452-6e7c-4389-b5ec-22f4d9906f7e tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Request method failure captured: Oct 04 19:35:18.498527 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1 HTTP/1.1 Oct 04 19:35:18.498527 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 19:35:18.498527 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 19:35:18.498527 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 19:35:18.498527 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 19:35:18.498527 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 19:35:18.498527 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 19:35:18.498527 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 19:35:18.498527 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 19:35:18.498527 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPIqLtjQmDfvx3o8OvPsiCQbhDYV3wG7IUN1Q6XRFeUs1UQM6B716KLx1Th_9sf3JzkK9hIY3QUxUSBUPG3iIWWSqUEGh7GhjVUoAuf1n_GUd3LR7wmjmbtyso9iRwQU_h9zhUB49zcpvuFGqVOFKA6aIoIdgDchUtYwzzD3_jAZFUg4 Oct 04 19:35:18.498527 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 19:35:18.498527 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 19:35:18.498527 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 19:35:18.498527 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 19:35:18.498527 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 19:35:18.498527 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 19:35:18.498527 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 1ca71f9591344456835761dc8045b825 Oct 04 19:35:18.498527 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1514919053 Oct 04 19:35:18.498527 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 19:35:18.498527 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 19:35:18.498527 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1ca71f9591344456835761dc8045b825"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1ca71f9591344456835761dc8045b825", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1ca71f9591344456835761dc8045b825"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1ca71f9591344456835761dc8045b825"}]}] Oct 04 19:35:18.498527 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServerDiskConfigTestJSON-1514919053 Oct 04 19:35:18.498527 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 1ca71f9591344456835761dc8045b825 Oct 04 19:35:18.498527 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1514919053 Oct 04 19:35:18.498527 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServerDiskConfigTestJSON-1514919053-project Oct 04 19:35:18.498527 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 19:35:18.498527 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 19:35:18.498527 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 1dedbd53c8584342a20523734518e591 Oct 04 19:35:18.498527 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServerDiskConfigTestJSON-1514919053-project Oct 04 19:35:18.498527 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 19:35:18.498527 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance bd692ac2-9881-4bb6-b50f-f596a12b1eb1 could not be found. Oct 04 19:35:18.498527 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'bd692ac2-9881-4bb6-b50f-f596a12b1eb1'} Oct 04 19:35:18.498527 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:35:18.498527 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:35:18.498527 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:35:18.498527 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:35:18.498527 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:35:18.498527 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:35:18.498527 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:35:18.498527 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:35:18.498527 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:35:18.498527 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:35:18.498527 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd692ac2-9881-4bb6-b50f-f596a12b1eb1 could not be found. Oct 04 19:35:18.498527 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:35:18.498527 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:35:18.498527 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:35:18.498527 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:35:18.498527 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:35:18.498527 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:35:18.498527 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:35:18.498527 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:35:18.498527 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:35:18.498527 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:35:18.498527 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:35:18.498527 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:35:18.498527 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:35:18.498527 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:35:18.498527 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:35:18.498527 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:35:18.498527 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd692ac2-9881-4bb6-b50f-f596a12b1eb1 could not be found. Oct 04 19:35:18.498527 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:35:18.498527 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:35:18.498527 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:35:18.502683 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:35:18.502683 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:35:18.502683 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:35:18.502683 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:35:18.502683 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:35:18.502683 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd692ac2-9881-4bb6-b50f-f596a12b1eb1 could not be found. Oct 04 19:35:18.502683 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:35:18.502683 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f86dd452-6e7c-4389-b5ec-22f4d9906f7e tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Returning 404 to user: Instance bd692ac2-9881-4bb6-b50f-f596a12b1eb1 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:35:18.502683 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f86dd452-6e7c-4389-b5ec-22f4d9906f7e tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1" status: 404 len: 111 microversion: 2.1 time: 0.032764 Oct 04 19:35:18.502683 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3726/7465] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:35:18 2022] GET /compute/v2.1/servers/bd692ac2-9881-4bb6-b50f-f596a12b1eb1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:35:18.510271 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4d308d22-5577-4523-aac0-a161e7435235 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '.version_select at 0x7fe253ae69d0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:35:18.626409 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-4d308d22-5577-4523-aac0-a161e7435235 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-114045705" status: 202 len: 0 microversion: 2.1 time: 0.121032 Oct 04 19:35:18.627010 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3740/7466] 10.222.0.20 () {58 vars in 1218 bytes} [Tue Oct 4 19:35:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-114045705 => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:35:19.438645 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-bc918627-8db3-4717-84ca-a16ceab02da8 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:35:19.439175 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-bc918627-8db3-4717-84ca-a16ceab02da8 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: aa3449d4-ab06-4f06-af64-0ab74bf57b50] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:35:19.446104 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bc918627-8db3-4717-84ca-a16ceab02da8 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:19.447175 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bc918627-8db3-4717-84ca-a16ceab02da8 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:19.447645 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bc918627-8db3-4717-84ca-a16ceab02da8 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:19.449189 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bc918627-8db3-4717-84ca-a16ceab02da8 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:19.449189 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bc918627-8db3-4717-84ca-a16ceab02da8 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:19.450004 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bc918627-8db3-4717-84ca-a16ceab02da8 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:19.468192 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-bc918627-8db3-4717-84ca-a16ceab02da8 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] HTTP exception thrown: Instance aa3449d4-ab06-4f06-af64-0ab74bf57b50 could not be found. Oct 04 19:35:19.470042 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-bc918627-8db3-4717-84ca-a16ceab02da8 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Request method failure captured: Oct 04 19:35:19.470042 n-d-850501-14 devstack@n-api.service[123002]: request: DELETE /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50 HTTP/1.1 Oct 04 19:35:19.470042 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 19:35:19.470042 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 19:35:19.470042 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 19:35:19.470042 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 19:35:19.470042 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 19:35:19.470042 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 19:35:19.470042 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 19:35:19.470042 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 19:35:19.470042 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPIqLtjQmDfvx3o8OvPsiCQbhDYV3wG7IUN1Q6XRFeUs1UQM6B716KLx1Th_9sf3JzkK9hIY3QUxUSBUPG3iIWWSqUEGh7GhjVUoAuf1n_GUd3LR7wmjmbtyso9iRwQU_h9zhUB49zcpvuFGqVOFKA6aIoIdgDchUtYwzzD3_jAZFUg4 Oct 04 19:35:19.470042 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 19:35:19.470042 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 19:35:19.470042 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 19:35:19.470042 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 19:35:19.470042 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 19:35:19.470042 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 19:35:19.470042 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 1ca71f9591344456835761dc8045b825 Oct 04 19:35:19.470042 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1514919053 Oct 04 19:35:19.470042 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 19:35:19.470042 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 19:35:19.470042 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1ca71f9591344456835761dc8045b825"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1ca71f9591344456835761dc8045b825", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1ca71f9591344456835761dc8045b825"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1ca71f9591344456835761dc8045b825"}]}] Oct 04 19:35:19.470042 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServerDiskConfigTestJSON-1514919053 Oct 04 19:35:19.470042 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 1ca71f9591344456835761dc8045b825 Oct 04 19:35:19.470042 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1514919053 Oct 04 19:35:19.470042 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServerDiskConfigTestJSON-1514919053-project Oct 04 19:35:19.470042 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 19:35:19.470042 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 19:35:19.470042 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 1dedbd53c8584342a20523734518e591 Oct 04 19:35:19.470042 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServerDiskConfigTestJSON-1514919053-project Oct 04 19:35:19.470042 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 19:35:19.470042 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance aa3449d4-ab06-4f06-af64-0ab74bf57b50 could not be found. Oct 04 19:35:19.470042 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'aa3449d4-ab06-4f06-af64-0ab74bf57b50'} Oct 04 19:35:19.470042 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:35:19.470042 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:35:19.470042 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:35:19.470042 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:35:19.470042 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:35:19.470042 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:35:19.470042 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:35:19.470042 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:35:19.470042 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:35:19.470042 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:35:19.470042 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa3449d4-ab06-4f06-af64-0ab74bf57b50 could not be found. Oct 04 19:35:19.470042 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:35:19.470042 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:35:19.470042 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:35:19.470042 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:35:19.470042 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:35:19.470042 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:35:19.470042 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:35:19.470042 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:35:19.470042 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:35:19.470042 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:35:19.470042 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 19:35:19.470042 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 19:35:19.470042 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 19:35:19.470042 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 19:35:19.470042 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:35:19.470042 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:35:19.470042 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:35:19.470042 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:35:19.476961 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa3449d4-ab06-4f06-af64-0ab74bf57b50 could not be found. Oct 04 19:35:19.476961 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:35:19.476961 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:35:19.476961 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:35:19.476961 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:35:19.476961 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:35:19.476961 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:35:19.476961 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:35:19.476961 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:35:19.476961 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa3449d4-ab06-4f06-af64-0ab74bf57b50 could not be found. Oct 04 19:35:19.476961 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:35:19.476961 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-bc918627-8db3-4717-84ca-a16ceab02da8 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Returning 404 to user: Instance aa3449d4-ab06-4f06-af64-0ab74bf57b50 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:35:19.476961 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-bc918627-8db3-4717-84ca-a16ceab02da8 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "DELETE /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50" status: 404 len: 111 microversion: 2.1 time: 0.036870 Oct 04 19:35:19.476961 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3727/7467] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 19:35:19 2022] DELETE /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:35:19.484341 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-af6ab5e2-af42-4280-923f-82a92e9caea7 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:35:19.484973 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-af6ab5e2-af42-4280-923f-82a92e9caea7 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] [instance: aa3449d4-ab06-4f06-af64-0ab74bf57b50] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:35:19.491773 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-af6ab5e2-af42-4280-923f-82a92e9caea7 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:19.492762 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-af6ab5e2-af42-4280-923f-82a92e9caea7 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:19.493383 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-af6ab5e2-af42-4280-923f-82a92e9caea7 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:19.493960 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-af6ab5e2-af42-4280-923f-82a92e9caea7 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:19.494424 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-af6ab5e2-af42-4280-923f-82a92e9caea7 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:19.495028 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-af6ab5e2-af42-4280-923f-82a92e9caea7 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:19.510034 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-af6ab5e2-af42-4280-923f-82a92e9caea7 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] HTTP exception thrown: Instance aa3449d4-ab06-4f06-af64-0ab74bf57b50 could not be found. Oct 04 19:35:19.511768 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-af6ab5e2-af42-4280-923f-82a92e9caea7 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Request method failure captured: Oct 04 19:35:19.511768 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50 HTTP/1.1 Oct 04 19:35:19.511768 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 19:35:19.511768 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 19:35:19.511768 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 19:35:19.511768 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 19:35:19.511768 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 19:35:19.511768 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 19:35:19.511768 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 19:35:19.511768 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 19:35:19.511768 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPIqLtjQmDfvx3o8OvPsiCQbhDYV3wG7IUN1Q6XRFeUs1UQM6B716KLx1Th_9sf3JzkK9hIY3QUxUSBUPG3iIWWSqUEGh7GhjVUoAuf1n_GUd3LR7wmjmbtyso9iRwQU_h9zhUB49zcpvuFGqVOFKA6aIoIdgDchUtYwzzD3_jAZFUg4 Oct 04 19:35:19.511768 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 19:35:19.511768 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 19:35:19.511768 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 19:35:19.511768 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 19:35:19.511768 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 19:35:19.511768 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 19:35:19.511768 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 1ca71f9591344456835761dc8045b825 Oct 04 19:35:19.511768 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1514919053 Oct 04 19:35:19.511768 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 19:35:19.511768 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 19:35:19.511768 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1ca71f9591344456835761dc8045b825"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1ca71f9591344456835761dc8045b825", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1ca71f9591344456835761dc8045b825"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1ca71f9591344456835761dc8045b825"}]}] Oct 04 19:35:19.511768 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ServerDiskConfigTestJSON-1514919053 Oct 04 19:35:19.511768 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 1ca71f9591344456835761dc8045b825 Oct 04 19:35:19.511768 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1514919053 Oct 04 19:35:19.511768 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ServerDiskConfigTestJSON-1514919053-project Oct 04 19:35:19.511768 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 19:35:19.511768 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 19:35:19.511768 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 1dedbd53c8584342a20523734518e591 Oct 04 19:35:19.511768 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ServerDiskConfigTestJSON-1514919053-project Oct 04 19:35:19.511768 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 19:35:19.511768 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance aa3449d4-ab06-4f06-af64-0ab74bf57b50 could not be found. Oct 04 19:35:19.511768 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': 'aa3449d4-ab06-4f06-af64-0ab74bf57b50'} Oct 04 19:35:19.511768 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:35:19.511768 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:35:19.511768 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:35:19.511768 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:35:19.511768 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:35:19.511768 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:35:19.511768 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:35:19.511768 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:35:19.511768 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:35:19.511768 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:35:19.511768 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa3449d4-ab06-4f06-af64-0ab74bf57b50 could not be found. Oct 04 19:35:19.511768 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:35:19.511768 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:35:19.511768 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:35:19.511768 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:35:19.511768 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:35:19.511768 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:35:19.511768 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:35:19.511768 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:35:19.511768 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:35:19.511768 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:35:19.511768 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:35:19.511768 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:35:19.511768 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:35:19.511768 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:35:19.511768 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:35:19.511768 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:35:19.511768 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa3449d4-ab06-4f06-af64-0ab74bf57b50 could not be found. Oct 04 19:35:19.511768 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:35:19.511768 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:35:19.511768 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:35:19.519268 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:35:19.519268 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:35:19.519268 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:35:19.519268 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:35:19.519268 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:35:19.519268 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa3449d4-ab06-4f06-af64-0ab74bf57b50 could not be found. Oct 04 19:35:19.519268 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:35:19.519268 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-af6ab5e2-af42-4280-923f-82a92e9caea7 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] Returning 404 to user: Instance aa3449d4-ab06-4f06-af64-0ab74bf57b50 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:35:19.519268 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-af6ab5e2-af42-4280-923f-82a92e9caea7 tempest-ServerDiskConfigTestJSON-1514919053 tempest-ServerDiskConfigTestJSON-1514919053-project] 10.222.0.20 "GET /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50" status: 404 len: 111 microversion: 2.1 time: 0.033151 Oct 04 19:35:19.519268 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3741/7468] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:35:19 2022] GET /compute/v2.1/servers/aa3449d4-ab06-4f06-af64-0ab74bf57b50 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:35:30.804100 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=23 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:35:30.804882 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:35:30.914650 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f6ca3d7e-3782-4b3d-b60c-b132e60d1bc0 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Action: 'create', calling method: .version_select at 0x7fe2539e3160>, body: {"keypair": {"name": "tempest-keypair-980628313", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJBmqt2LdXrKLpCuwz4a3Crps92ENPLpRtlsGnZOok8uuPon05W3r4bD0CZnFt+4gUY4q36evO2Qy65zJmjUyE1G7PtkdsYjEOlboNURx0er5dqIdAOiOLDQqjkNxmuoMw=="}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:35:30.935004 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-f6ca3d7e-3782-4b3d-b60c-b132e60d1bc0 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Getting quotas for project 56eff05b035a45e0afc0f92d9d85e136. Resources: {'key_pairs'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:35:30.940820 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-f6ca3d7e-3782-4b3d-b60c-b132e60d1bc0 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Getting quotas for user 6970aa4f091c49e382c86a487d25d524 and project 56eff05b035a45e0afc0f92d9d85e136. Resources: {'key_pairs'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:35:31.043615 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f6ca3d7e-3782-4b3d-b60c-b132e60d1bc0 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.245697 Oct 04 19:35:31.044259 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3728/7469] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Oct 4 19:35:30 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:35:33.439391 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-28485f39-1e49-4294-bf90-b65c2b17c46c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-289915065", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "da1c0bb1-0fcf-4915-8cd0-57095c8c6e9c"}], "security_groups": [{"name": "tempest-securitygroup--729491688"}], "key_name": "tempest-keypair-980628313", "user_data": "}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:35:33.452235 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:35:33.453077 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:35:33.585440 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.neutron [None req-28485f39-1e49-4294-bf90-b65c2b17c46c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] validate_networks() for [('da1c0bb1-0fcf-4915-8cd0-57095c8c6e9c', None, None, None, None, None)] {{(pid=123001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:35:34.059854 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-28485f39-1e49-4294-bf90-b65c2b17c46c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:35:34.060381 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-28485f39-1e49-4294-bf90-b65c2b17c46c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:35:34.060843 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-28485f39-1e49-4294-bf90-b65c2b17c46c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:35:34.061336 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-28485f39-1e49-4294-bf90-b65c2b17c46c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:35:34.061687 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-28485f39-1e49-4294-bf90-b65c2b17c46c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:35:34.071557 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-28485f39-1e49-4294-bf90-b65c2b17c46c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:34.072132 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-28485f39-1e49-4294-bf90-b65c2b17c46c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:34.072589 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-28485f39-1e49-4294-bf90-b65c2b17c46c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:34.074511 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-28485f39-1e49-4294-bf90-b65c2b17c46c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:34.074992 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-28485f39-1e49-4294-bf90-b65c2b17c46c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:34.075437 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-28485f39-1e49-4294-bf90-b65c2b17c46c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:34.094156 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-28485f39-1e49-4294-bf90-b65c2b17c46c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Getting quotas for project 56eff05b035a45e0afc0f92d9d85e136. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:35:34.100155 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-28485f39-1e49-4294-bf90-b65c2b17c46c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Getting quotas for user 6970aa4f091c49e382c86a487d25d524 and project 56eff05b035a45e0afc0f92d9d85e136. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:35:34.113589 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-28485f39-1e49-4294-bf90-b65c2b17c46c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Going to run 1 instances... {{(pid=123001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:35:34.115947 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-28485f39-1e49-4294-bf90-b65c2b17c46c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 9eebfa95-bb07-411a-a10e-c31182df3062] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:35:34.316334 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-28485f39-1e49-4294-bf90-b65c2b17c46c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.880792 Oct 04 19:35:34.316978 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3742/7470] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 19:35:33 2022] POST /compute/v2.1/servers => generated 408 bytes in 883 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:35:34.331984 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a67c34f3-6ddd-4e9d-bfca-7d43a72cc27a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:35:34.333207 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a67c34f3-6ddd-4e9d-bfca-7d43a72cc27a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 9eebfa95-bb07-411a-a10e-c31182df3062] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:35:34.398828 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a67c34f3-6ddd-4e9d-bfca-7d43a72cc27a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:35:34.407340 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a67c34f3-6ddd-4e9d-bfca-7d43a72cc27a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062" status: 200 len: 1237 microversion: 2.1 time: 0.082259 Oct 04 19:35:34.408434 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3729/7471] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:35:34 2022] GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062 => generated 1237 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:35:35.442936 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-09e54073-9d06-4f5e-8f47-6e6e8bfa3f36 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:35:35.443642 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-09e54073-9d06-4f5e-8f47-6e6e8bfa3f36 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 9eebfa95-bb07-411a-a10e-c31182df3062] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:35:35.503457 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-09e54073-9d06-4f5e-8f47-6e6e8bfa3f36 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:35:35.511763 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-09e54073-9d06-4f5e-8f47-6e6e8bfa3f36 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062" status: 200 len: 1237 microversion: 2.1 time: 0.072747 Oct 04 19:35:35.512392 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3743/7472] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:35:35 2022] GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062 => generated 1237 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:35:36.535081 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c0bc3481-54b2-4443-a78e-5ad62ec343a2 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:35:36.535718 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c0bc3481-54b2-4443-a78e-5ad62ec343a2 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 9eebfa95-bb07-411a-a10e-c31182df3062] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:35:36.543848 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c0bc3481-54b2-4443-a78e-5ad62ec343a2 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:36.544633 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c0bc3481-54b2-4443-a78e-5ad62ec343a2 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:36.545328 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c0bc3481-54b2-4443-a78e-5ad62ec343a2 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:36.546368 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c0bc3481-54b2-4443-a78e-5ad62ec343a2 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:36.547056 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c0bc3481-54b2-4443-a78e-5ad62ec343a2 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:36.547898 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c0bc3481-54b2-4443-a78e-5ad62ec343a2 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:36.617769 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c0bc3481-54b2-4443-a78e-5ad62ec343a2 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:35:36.626253 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c0bc3481-54b2-4443-a78e-5ad62ec343a2 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062" status: 200 len: 1289 microversion: 2.1 time: 0.095094 Oct 04 19:35:36.626831 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3730/7473] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:35:36 2022] GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062 => generated 1289 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:35:37.652402 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-22ce6830-1482-44b4-82f3-832896b4ae38 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:35:37.654151 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-22ce6830-1482-44b4-82f3-832896b4ae38 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 9eebfa95-bb07-411a-a10e-c31182df3062] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:35:37.661585 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-22ce6830-1482-44b4-82f3-832896b4ae38 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:37.662082 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-22ce6830-1482-44b4-82f3-832896b4ae38 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:37.662694 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-22ce6830-1482-44b4-82f3-832896b4ae38 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:37.663735 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-22ce6830-1482-44b4-82f3-832896b4ae38 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:37.664234 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-22ce6830-1482-44b4-82f3-832896b4ae38 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:37.664662 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-22ce6830-1482-44b4-82f3-832896b4ae38 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:37.851065 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-22ce6830-1482-44b4-82f3-832896b4ae38 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:35:37.860104 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-22ce6830-1482-44b4-82f3-832896b4ae38 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062" status: 200 len: 1362 microversion: 2.1 time: 0.213250 Oct 04 19:35:37.860795 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3744/7474] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:35:37 2022] GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062 => generated 1362 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:35:38.734362 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-28325d84-357a-46b7-90f3-5a81b930d747 req-9c6975c7-ace9-469b-b9ce-419ae2602971 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9eebfa95-bb07-411a-a10e-c31182df3062", "tag": "6a091412-7879-43c5-a597-189bde835b66"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:35:38.745985 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-28325d84-357a-46b7-90f3-5a81b930d747 req-9c6975c7-ace9-469b-b9ce-419ae2602971 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:38.746503 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-28325d84-357a-46b7-90f3-5a81b930d747 req-9c6975c7-ace9-469b-b9ce-419ae2602971 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:38.747027 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-28325d84-357a-46b7-90f3-5a81b930d747 req-9c6975c7-ace9-469b-b9ce-419ae2602971 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:38.758082 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-28325d84-357a-46b7-90f3-5a81b930d747 req-9c6975c7-ace9-469b-b9ce-419ae2602971 service nova] Creating event network-changed:6a091412-7879-43c5-a597-189bde835b66 for instance 9eebfa95-bb07-411a-a10e-c31182df3062 on n-h1-850501-14 Oct 04 19:35:38.763479 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-28325d84-357a-46b7-90f3-5a81b930d747 req-9c6975c7-ace9-469b-b9ce-419ae2602971 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033114 Oct 04 19:35:38.764113 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3731/7475] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:35:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:35:38.893789 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5e330de8-b346-47b5-a16b-30fcc63fbac2 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:35:38.895004 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5e330de8-b346-47b5-a16b-30fcc63fbac2 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 9eebfa95-bb07-411a-a10e-c31182df3062] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:35:38.902021 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5e330de8-b346-47b5-a16b-30fcc63fbac2 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:38.902508 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5e330de8-b346-47b5-a16b-30fcc63fbac2 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:38.902967 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5e330de8-b346-47b5-a16b-30fcc63fbac2 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:38.903667 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5e330de8-b346-47b5-a16b-30fcc63fbac2 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:38.904151 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5e330de8-b346-47b5-a16b-30fcc63fbac2 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:38.904580 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5e330de8-b346-47b5-a16b-30fcc63fbac2 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:39.112608 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5e330de8-b346-47b5-a16b-30fcc63fbac2 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:35:39.120635 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5e330de8-b346-47b5-a16b-30fcc63fbac2 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062" status: 200 len: 1362 microversion: 2.1 time: 0.230878 Oct 04 19:35:39.121218 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3745/7476] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:35:38 2022] GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062 => generated 1362 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:35:40.144898 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6aa894d7-8c69-4ee3-8de8-127dd156a0a5 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:35:40.145622 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-6aa894d7-8c69-4ee3-8de8-127dd156a0a5 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 9eebfa95-bb07-411a-a10e-c31182df3062] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:35:40.151860 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6aa894d7-8c69-4ee3-8de8-127dd156a0a5 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:40.152517 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6aa894d7-8c69-4ee3-8de8-127dd156a0a5 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:40.152980 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6aa894d7-8c69-4ee3-8de8-127dd156a0a5 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:40.153690 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6aa894d7-8c69-4ee3-8de8-127dd156a0a5 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:40.154169 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6aa894d7-8c69-4ee3-8de8-127dd156a0a5 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:40.154612 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6aa894d7-8c69-4ee3-8de8-127dd156a0a5 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:40.281760 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-6aa894d7-8c69-4ee3-8de8-127dd156a0a5 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:35:40.289538 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6aa894d7-8c69-4ee3-8de8-127dd156a0a5 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062" status: 200 len: 1362 microversion: 2.1 time: 0.149781 Oct 04 19:35:40.290116 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3732/7477] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:35:40 2022] GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:35:41.312993 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-181dc3bb-500c-461c-9737-7f9c56ac364a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:35:41.313611 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-181dc3bb-500c-461c-9737-7f9c56ac364a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 9eebfa95-bb07-411a-a10e-c31182df3062] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:35:41.320499 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-181dc3bb-500c-461c-9737-7f9c56ac364a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:41.320982 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-181dc3bb-500c-461c-9737-7f9c56ac364a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:41.321419 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-181dc3bb-500c-461c-9737-7f9c56ac364a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:41.322112 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-181dc3bb-500c-461c-9737-7f9c56ac364a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:41.322568 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-181dc3bb-500c-461c-9737-7f9c56ac364a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:41.322997 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-181dc3bb-500c-461c-9737-7f9c56ac364a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:41.453061 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-181dc3bb-500c-461c-9737-7f9c56ac364a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:35:41.460868 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-181dc3bb-500c-461c-9737-7f9c56ac364a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062" status: 200 len: 1362 microversion: 2.1 time: 0.151804 Oct 04 19:35:41.461434 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3746/7478] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:35:41 2022] GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:35:42.485459 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-04bf0467-ab46-4c39-b97c-35d87b9074e0 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:35:42.486138 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-04bf0467-ab46-4c39-b97c-35d87b9074e0 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 9eebfa95-bb07-411a-a10e-c31182df3062] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:35:42.493175 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-04bf0467-ab46-4c39-b97c-35d87b9074e0 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:42.496179 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-04bf0467-ab46-4c39-b97c-35d87b9074e0 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:42.496179 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-04bf0467-ab46-4c39-b97c-35d87b9074e0 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:42.496179 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-04bf0467-ab46-4c39-b97c-35d87b9074e0 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:42.496179 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-04bf0467-ab46-4c39-b97c-35d87b9074e0 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:42.496179 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-04bf0467-ab46-4c39-b97c-35d87b9074e0 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:42.627718 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-04bf0467-ab46-4c39-b97c-35d87b9074e0 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:35:42.635516 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-04bf0467-ab46-4c39-b97c-35d87b9074e0 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062" status: 200 len: 1362 microversion: 2.1 time: 0.154947 Oct 04 19:35:42.636100 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3733/7479] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:35:42 2022] GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:35:43.658260 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5b4dbf96-bb51-408c-a893-1ab8e67425d0 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:35:43.658871 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5b4dbf96-bb51-408c-a893-1ab8e67425d0 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 9eebfa95-bb07-411a-a10e-c31182df3062] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:35:43.670485 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5b4dbf96-bb51-408c-a893-1ab8e67425d0 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:43.671375 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5b4dbf96-bb51-408c-a893-1ab8e67425d0 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:43.672206 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5b4dbf96-bb51-408c-a893-1ab8e67425d0 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:43.673496 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5b4dbf96-bb51-408c-a893-1ab8e67425d0 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:43.674336 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5b4dbf96-bb51-408c-a893-1ab8e67425d0 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:43.675138 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5b4dbf96-bb51-408c-a893-1ab8e67425d0 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:43.820635 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5b4dbf96-bb51-408c-a893-1ab8e67425d0 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:35:43.828682 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5b4dbf96-bb51-408c-a893-1ab8e67425d0 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062" status: 200 len: 1362 microversion: 2.1 time: 0.174403 Oct 04 19:35:43.829258 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3747/7480] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:35:43 2022] GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062 => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:35:44.852537 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2af0f559-0624-4467-a061-b54e2fbaf208 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:35:44.853159 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2af0f559-0624-4467-a061-b54e2fbaf208 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 9eebfa95-bb07-411a-a10e-c31182df3062] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:35:44.855924 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=6 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:35:44.861372 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2af0f559-0624-4467-a061-b54e2fbaf208 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:44.861874 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2af0f559-0624-4467-a061-b54e2fbaf208 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:44.862325 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2af0f559-0624-4467-a061-b54e2fbaf208 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:44.863031 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2af0f559-0624-4467-a061-b54e2fbaf208 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:44.863507 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2af0f559-0624-4467-a061-b54e2fbaf208 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:44.863947 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2af0f559-0624-4467-a061-b54e2fbaf208 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:44.998457 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2af0f559-0624-4467-a061-b54e2fbaf208 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:35:45.006283 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2af0f559-0624-4467-a061-b54e2fbaf208 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062" status: 200 len: 1362 microversion: 2.1 time: 0.157646 Oct 04 19:35:45.007113 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3734/7481] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:35:44 2022] GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:35:45.228514 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-95f9c66c-8904-45c6-afe2-58484a6d9ca2 req-9a55ed89-c906-49c3-9d80-e73996ab6a76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9eebfa95-bb07-411a-a10e-c31182df3062", "name": "network-vif-plugged", "status": "completed", "tag": "6a091412-7879-43c5-a597-189bde835b66"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:35:45.233515 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:35:45.239714 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-95f9c66c-8904-45c6-afe2-58484a6d9ca2 req-9a55ed89-c906-49c3-9d80-e73996ab6a76 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:45.240240 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-95f9c66c-8904-45c6-afe2-58484a6d9ca2 req-9a55ed89-c906-49c3-9d80-e73996ab6a76 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:45.240681 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-95f9c66c-8904-45c6-afe2-58484a6d9ca2 req-9a55ed89-c906-49c3-9d80-e73996ab6a76 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:45.252243 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-95f9c66c-8904-45c6-afe2-58484a6d9ca2 req-9a55ed89-c906-49c3-9d80-e73996ab6a76 service nova] Creating event network-vif-plugged:6a091412-7879-43c5-a597-189bde835b66 for instance 9eebfa95-bb07-411a-a10e-c31182df3062 on n-h1-850501-14 Oct 04 19:35:45.257320 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-95f9c66c-8904-45c6-afe2-58484a6d9ca2 req-9a55ed89-c906-49c3-9d80-e73996ab6a76 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032811 Oct 04 19:35:45.261586 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3748/7482] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:35:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:35:46.030770 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0ba56e91-8ff0-41f6-b39c-e6ce3a3d9805 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:35:46.031312 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0ba56e91-8ff0-41f6-b39c-e6ce3a3d9805 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 9eebfa95-bb07-411a-a10e-c31182df3062] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:35:46.037455 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0ba56e91-8ff0-41f6-b39c-e6ce3a3d9805 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:46.037955 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0ba56e91-8ff0-41f6-b39c-e6ce3a3d9805 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:46.038410 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0ba56e91-8ff0-41f6-b39c-e6ce3a3d9805 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:46.039114 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0ba56e91-8ff0-41f6-b39c-e6ce3a3d9805 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:46.039582 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0ba56e91-8ff0-41f6-b39c-e6ce3a3d9805 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:46.040023 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0ba56e91-8ff0-41f6-b39c-e6ce3a3d9805 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:46.174949 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0ba56e91-8ff0-41f6-b39c-e6ce3a3d9805 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:35:46.182599 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0ba56e91-8ff0-41f6-b39c-e6ce3a3d9805 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062" status: 200 len: 1362 microversion: 2.1 time: 0.156881 Oct 04 19:35:46.183165 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3735/7483] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:35:46 2022] GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:35:47.203402 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=8 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:35:47.209025 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7ad47a7c-6fe2-48d0-a473-bec7f7a2da57 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:35:47.213521 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7ad47a7c-6fe2-48d0-a473-bec7f7a2da57 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 9eebfa95-bb07-411a-a10e-c31182df3062] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:35:47.215926 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7ad47a7c-6fe2-48d0-a473-bec7f7a2da57 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:47.217568 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7ad47a7c-6fe2-48d0-a473-bec7f7a2da57 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:47.218055 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7ad47a7c-6fe2-48d0-a473-bec7f7a2da57 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:47.218753 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7ad47a7c-6fe2-48d0-a473-bec7f7a2da57 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:47.219216 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7ad47a7c-6fe2-48d0-a473-bec7f7a2da57 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:47.219898 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7ad47a7c-6fe2-48d0-a473-bec7f7a2da57 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:47.352484 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7ad47a7c-6fe2-48d0-a473-bec7f7a2da57 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:35:47.360805 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7ad47a7c-6fe2-48d0-a473-bec7f7a2da57 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062" status: 200 len: 1549 microversion: 2.1 time: 0.158342 Oct 04 19:35:47.361375 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3749/7484] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:35:47 2022] GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062 => generated 1549 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:35:47.385239 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c46aaeeb-d080-42c8-8a37-7eb1f5ddfcf1 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:35:47.385239 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c46aaeeb-d080-42c8-8a37-7eb1f5ddfcf1 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 9eebfa95-bb07-411a-a10e-c31182df3062] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:35:47.391700 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c46aaeeb-d080-42c8-8a37-7eb1f5ddfcf1 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:47.392233 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c46aaeeb-d080-42c8-8a37-7eb1f5ddfcf1 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:47.392686 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c46aaeeb-d080-42c8-8a37-7eb1f5ddfcf1 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:47.393399 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c46aaeeb-d080-42c8-8a37-7eb1f5ddfcf1 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:47.393867 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c46aaeeb-d080-42c8-8a37-7eb1f5ddfcf1 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:47.394309 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c46aaeeb-d080-42c8-8a37-7eb1f5ddfcf1 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:47.474444 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c46aaeeb-d080-42c8-8a37-7eb1f5ddfcf1 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094783 Oct 04 19:35:47.475066 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3736/7485] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Oct 4 19:35:47 2022] GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:35:48.817550 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-9c33c9d1-1b09-4aef-a8ab-9f86edf12004 req-2b0bc1d1-426b-4b87-bf4f-540b1fe67c83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9eebfa95-bb07-411a-a10e-c31182df3062", "tag": "6a091412-7879-43c5-a597-189bde835b66"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:35:48.828046 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-9c33c9d1-1b09-4aef-a8ab-9f86edf12004 req-2b0bc1d1-426b-4b87-bf4f-540b1fe67c83 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:35:48.828550 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-9c33c9d1-1b09-4aef-a8ab-9f86edf12004 req-2b0bc1d1-426b-4b87-bf4f-540b1fe67c83 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:35:48.828986 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-9c33c9d1-1b09-4aef-a8ab-9f86edf12004 req-2b0bc1d1-426b-4b87-bf4f-540b1fe67c83 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:35:48.840099 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-9c33c9d1-1b09-4aef-a8ab-9f86edf12004 req-2b0bc1d1-426b-4b87-bf4f-540b1fe67c83 service nova] Creating event network-changed:6a091412-7879-43c5-a597-189bde835b66 for instance 9eebfa95-bb07-411a-a10e-c31182df3062 on n-h1-850501-14 Oct 04 19:35:48.845861 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-9c33c9d1-1b09-4aef-a8ab-9f86edf12004 req-2b0bc1d1-426b-4b87-bf4f-540b1fe67c83 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031930 Oct 04 19:35:48.846566 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3750/7486] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:35:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:36:18.520104 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:36:18.520903 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=36 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:36:18.524891 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7e7f9a0a-0c4c-436a-9363-7267718cd9ac tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:18.525535 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7e7f9a0a-0c4c-436a-9363-7267718cd9ac tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 9eebfa95-bb07-411a-a10e-c31182df3062] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:18.532310 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7e7f9a0a-0c4c-436a-9363-7267718cd9ac tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:18.538567 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7e7f9a0a-0c4c-436a-9363-7267718cd9ac tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:18.538567 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7e7f9a0a-0c4c-436a-9363-7267718cd9ac tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:18.538567 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7e7f9a0a-0c4c-436a-9363-7267718cd9ac tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:18.538567 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7e7f9a0a-0c4c-436a-9363-7267718cd9ac tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:18.538567 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7e7f9a0a-0c4c-436a-9363-7267718cd9ac tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:18.732426 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7e7f9a0a-0c4c-436a-9363-7267718cd9ac tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:18.740835 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7e7f9a0a-0c4c-436a-9363-7267718cd9ac tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062" status: 200 len: 1668 microversion: 2.1 time: 0.222660 Oct 04 19:36:18.741437 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3737/7487] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:18 2022] GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062 => generated 1668 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:18.762760 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:36:18.766276 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=36 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:36:18.768714 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d20ad332-8125-4bb9-8d44-0c4f72f9471e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:18.769425 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d20ad332-8125-4bb9-8d44-0c4f72f9471e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 9eebfa95-bb07-411a-a10e-c31182df3062] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:18.775705 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d20ad332-8125-4bb9-8d44-0c4f72f9471e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:18.776226 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d20ad332-8125-4bb9-8d44-0c4f72f9471e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:18.776663 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d20ad332-8125-4bb9-8d44-0c4f72f9471e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:18.777368 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d20ad332-8125-4bb9-8d44-0c4f72f9471e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:18.777823 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d20ad332-8125-4bb9-8d44-0c4f72f9471e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:18.778249 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d20ad332-8125-4bb9-8d44-0c4f72f9471e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:18.982797 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d20ad332-8125-4bb9-8d44-0c4f72f9471e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:18.990892 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d20ad332-8125-4bb9-8d44-0c4f72f9471e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062" status: 200 len: 1668 microversion: 2.1 time: 0.230421 Oct 04 19:36:18.991489 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3751/7488] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:18 2022] GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062 => generated 1668 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:19.016084 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1ac549ca-367d-47e1-b407-c521775f9c82 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:19.016793 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1ac549ca-367d-47e1-b407-c521775f9c82 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 9eebfa95-bb07-411a-a10e-c31182df3062] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:19.022868 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1ac549ca-367d-47e1-b407-c521775f9c82 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:19.023376 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1ac549ca-367d-47e1-b407-c521775f9c82 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:19.023835 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1ac549ca-367d-47e1-b407-c521775f9c82 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:19.024579 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1ac549ca-367d-47e1-b407-c521775f9c82 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:19.025054 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1ac549ca-367d-47e1-b407-c521775f9c82 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:19.025619 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1ac549ca-367d-47e1-b407-c521775f9c82 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:19.164466 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1ac549ca-367d-47e1-b407-c521775f9c82 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:19.173147 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1ac549ca-367d-47e1-b407-c521775f9c82 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062" status: 200 len: 1668 microversion: 2.1 time: 0.161743 Oct 04 19:36:19.173739 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3738/7489] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:19 2022] GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062 => generated 1668 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:19.196657 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-af2fcd70-ef81-485a-9324-6513453ec241 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:36:19.198950 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-af2fcd70-ef81-485a-9324-6513453ec241 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 9eebfa95-bb07-411a-a10e-c31182df3062] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:19.205742 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-af2fcd70-ef81-485a-9324-6513453ec241 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:19.206232 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-af2fcd70-ef81-485a-9324-6513453ec241 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:19.206670 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-af2fcd70-ef81-485a-9324-6513453ec241 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:19.207366 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-af2fcd70-ef81-485a-9324-6513453ec241 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:19.207821 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-af2fcd70-ef81-485a-9324-6513453ec241 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:19.208292 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-af2fcd70-ef81-485a-9324-6513453ec241 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:19.239519 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-af2fcd70-ef81-485a-9324-6513453ec241 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:19.245699 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-af2fcd70-ef81-485a-9324-6513453ec241 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 9eebfa95-bb07-411a-a10e-c31182df3062] Old instance type m1.heat2, new instance type m1.heat {{(pid=123001) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 19:36:19.253402 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-af2fcd70-ef81-485a-9324-6513453ec241 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:36:19.253865 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-af2fcd70-ef81-485a-9324-6513453ec241 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:36:19.254421 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-af2fcd70-ef81-485a-9324-6513453ec241 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:36:19.254872 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-af2fcd70-ef81-485a-9324-6513453ec241 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:36:19.255355 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-af2fcd70-ef81-485a-9324-6513453ec241 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:36:19.422922 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-af2fcd70-ef81-485a-9324-6513453ec241 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "POST /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062/action" status: 202 len: 0 microversion: 2.1 time: 0.229938 Oct 04 19:36:19.423625 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3752/7490] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 19:36:19 2022] POST /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062/action => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:36:19.432314 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7e108f22-5c35-4159-8d5c-456300adba0a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:19.432642 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7e108f22-5c35-4159-8d5c-456300adba0a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 9eebfa95-bb07-411a-a10e-c31182df3062] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:19.443504 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7e108f22-5c35-4159-8d5c-456300adba0a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:19.443913 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7e108f22-5c35-4159-8d5c-456300adba0a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:19.444508 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7e108f22-5c35-4159-8d5c-456300adba0a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:19.445342 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7e108f22-5c35-4159-8d5c-456300adba0a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:19.445909 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7e108f22-5c35-4159-8d5c-456300adba0a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:19.446431 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7e108f22-5c35-4159-8d5c-456300adba0a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:19.586877 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7e108f22-5c35-4159-8d5c-456300adba0a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:19.595215 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7e108f22-5c35-4159-8d5c-456300adba0a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062" status: 200 len: 1677 microversion: 2.1 time: 0.166915 Oct 04 19:36:19.595806 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3739/7491] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:19 2022] GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062 => generated 1677 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:20.619407 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a8183a0d-fc57-43ca-afd4-b3339a038e47 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:20.620132 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a8183a0d-fc57-43ca-afd4-b3339a038e47 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 9eebfa95-bb07-411a-a10e-c31182df3062] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:20.629464 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a8183a0d-fc57-43ca-afd4-b3339a038e47 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:20.629961 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a8183a0d-fc57-43ca-afd4-b3339a038e47 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:20.630435 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a8183a0d-fc57-43ca-afd4-b3339a038e47 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:20.631147 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a8183a0d-fc57-43ca-afd4-b3339a038e47 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:20.631606 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a8183a0d-fc57-43ca-afd4-b3339a038e47 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:20.632040 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a8183a0d-fc57-43ca-afd4-b3339a038e47 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:20.775303 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a8183a0d-fc57-43ca-afd4-b3339a038e47 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:20.785038 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a8183a0d-fc57-43ca-afd4-b3339a038e47 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062" status: 200 len: 1677 microversion: 2.1 time: 0.170259 Oct 04 19:36:20.785865 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3753/7492] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:20 2022] GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062 => generated 1677 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:21.810231 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-13ab60f5-d877-43fa-9361-1ec0cbc5e130 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:21.810930 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-13ab60f5-d877-43fa-9361-1ec0cbc5e130 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 9eebfa95-bb07-411a-a10e-c31182df3062] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:21.819268 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-13ab60f5-d877-43fa-9361-1ec0cbc5e130 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:21.819841 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-13ab60f5-d877-43fa-9361-1ec0cbc5e130 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:21.820345 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-13ab60f5-d877-43fa-9361-1ec0cbc5e130 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:21.821050 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-13ab60f5-d877-43fa-9361-1ec0cbc5e130 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:21.821514 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-13ab60f5-d877-43fa-9361-1ec0cbc5e130 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:21.821992 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-13ab60f5-d877-43fa-9361-1ec0cbc5e130 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:21.966793 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-13ab60f5-d877-43fa-9361-1ec0cbc5e130 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:21.974964 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-13ab60f5-d877-43fa-9361-1ec0cbc5e130 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062" status: 200 len: 1677 microversion: 2.1 time: 0.169010 Oct 04 19:36:21.975488 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3740/7493] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:21 2022] GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062 => generated 1677 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:22.998392 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3c3e11d4-9c47-4dcb-91d9-d3641d30d3f9 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:22.999826 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3c3e11d4-9c47-4dcb-91d9-d3641d30d3f9 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 9eebfa95-bb07-411a-a10e-c31182df3062] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:23.007958 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3c3e11d4-9c47-4dcb-91d9-d3641d30d3f9 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:23.010702 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3c3e11d4-9c47-4dcb-91d9-d3641d30d3f9 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:23.010702 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3c3e11d4-9c47-4dcb-91d9-d3641d30d3f9 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:23.010702 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3c3e11d4-9c47-4dcb-91d9-d3641d30d3f9 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:23.010702 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3c3e11d4-9c47-4dcb-91d9-d3641d30d3f9 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:23.011082 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3c3e11d4-9c47-4dcb-91d9-d3641d30d3f9 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:23.154410 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3c3e11d4-9c47-4dcb-91d9-d3641d30d3f9 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:23.162710 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3c3e11d4-9c47-4dcb-91d9-d3641d30d3f9 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062" status: 200 len: 1682 microversion: 2.1 time: 0.168885 Oct 04 19:36:23.163273 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3754/7494] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:22 2022] GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062 => generated 1682 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:24.186377 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a851472b-281a-4d3c-967c-8b32a14fa0e6 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:24.186999 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a851472b-281a-4d3c-967c-8b32a14fa0e6 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 9eebfa95-bb07-411a-a10e-c31182df3062] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:24.194183 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a851472b-281a-4d3c-967c-8b32a14fa0e6 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:24.194676 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a851472b-281a-4d3c-967c-8b32a14fa0e6 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:24.195120 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a851472b-281a-4d3c-967c-8b32a14fa0e6 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:24.195815 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a851472b-281a-4d3c-967c-8b32a14fa0e6 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:24.196311 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a851472b-281a-4d3c-967c-8b32a14fa0e6 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:24.196746 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a851472b-281a-4d3c-967c-8b32a14fa0e6 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:24.334867 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a851472b-281a-4d3c-967c-8b32a14fa0e6 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:24.344461 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a851472b-281a-4d3c-967c-8b32a14fa0e6 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062" status: 200 len: 1682 microversion: 2.1 time: 0.161931 Oct 04 19:36:24.345344 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3741/7495] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:24 2022] GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062 => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:25.368402 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0f015871-cdf4-4013-a041-319635d502d9 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:25.369085 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0f015871-cdf4-4013-a041-319635d502d9 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 9eebfa95-bb07-411a-a10e-c31182df3062] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:25.377572 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0f015871-cdf4-4013-a041-319635d502d9 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:25.378073 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0f015871-cdf4-4013-a041-319635d502d9 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:25.378510 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0f015871-cdf4-4013-a041-319635d502d9 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:25.379209 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0f015871-cdf4-4013-a041-319635d502d9 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:25.379678 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0f015871-cdf4-4013-a041-319635d502d9 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:25.380113 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0f015871-cdf4-4013-a041-319635d502d9 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:25.509246 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0f015871-cdf4-4013-a041-319635d502d9 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:25.517253 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0f015871-cdf4-4013-a041-319635d502d9 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062" status: 200 len: 1682 microversion: 2.1 time: 0.152992 Oct 04 19:36:25.517826 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3755/7496] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:25 2022] GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:26.541634 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-bd3207ed-965c-47cd-8f87-e516a2d915e4 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:26.542304 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-bd3207ed-965c-47cd-8f87-e516a2d915e4 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 9eebfa95-bb07-411a-a10e-c31182df3062] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:26.549893 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bd3207ed-965c-47cd-8f87-e516a2d915e4 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:26.550382 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bd3207ed-965c-47cd-8f87-e516a2d915e4 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:26.550826 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bd3207ed-965c-47cd-8f87-e516a2d915e4 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:26.551558 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bd3207ed-965c-47cd-8f87-e516a2d915e4 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:26.552022 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bd3207ed-965c-47cd-8f87-e516a2d915e4 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:26.552511 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bd3207ed-965c-47cd-8f87-e516a2d915e4 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:26.691211 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-bd3207ed-965c-47cd-8f87-e516a2d915e4 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:26.699025 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-bd3207ed-965c-47cd-8f87-e516a2d915e4 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062" status: 200 len: 1682 microversion: 2.1 time: 0.161676 Oct 04 19:36:26.699611 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3742/7497] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:26 2022] GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062 => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:27.722379 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5c6b8a96-9c02-494f-896e-bf1609e4f51f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:27.723035 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5c6b8a96-9c02-494f-896e-bf1609e4f51f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 9eebfa95-bb07-411a-a10e-c31182df3062] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:27.729834 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5c6b8a96-9c02-494f-896e-bf1609e4f51f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:27.730321 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5c6b8a96-9c02-494f-896e-bf1609e4f51f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:27.730758 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5c6b8a96-9c02-494f-896e-bf1609e4f51f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:27.731449 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5c6b8a96-9c02-494f-896e-bf1609e4f51f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:27.731904 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5c6b8a96-9c02-494f-896e-bf1609e4f51f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:27.732357 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5c6b8a96-9c02-494f-896e-bf1609e4f51f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:27.867980 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5c6b8a96-9c02-494f-896e-bf1609e4f51f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:27.876389 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5c6b8a96-9c02-494f-896e-bf1609e4f51f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062" status: 200 len: 1682 microversion: 2.1 time: 0.157952 Oct 04 19:36:27.877200 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3756/7498] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:27 2022] GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:28.900837 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-695c4e7f-36b4-4c4c-bcbf-64032e6133e5 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:28.901417 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-695c4e7f-36b4-4c4c-bcbf-64032e6133e5 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 9eebfa95-bb07-411a-a10e-c31182df3062] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:28.909353 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-695c4e7f-36b4-4c4c-bcbf-64032e6133e5 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:28.909863 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-695c4e7f-36b4-4c4c-bcbf-64032e6133e5 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:28.910324 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-695c4e7f-36b4-4c4c-bcbf-64032e6133e5 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:28.911042 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-695c4e7f-36b4-4c4c-bcbf-64032e6133e5 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:28.911520 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-695c4e7f-36b4-4c4c-bcbf-64032e6133e5 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:28.911968 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-695c4e7f-36b4-4c4c-bcbf-64032e6133e5 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:29.061412 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-695c4e7f-36b4-4c4c-bcbf-64032e6133e5 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:29.070539 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-695c4e7f-36b4-4c4c-bcbf-64032e6133e5 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062" status: 200 len: 1682 microversion: 2.1 time: 0.173440 Oct 04 19:36:29.071112 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3743/7499] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:28 2022] GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062 => generated 1682 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:30.095588 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-33fed04a-6d38-40a1-a763-6d4532a9f1b8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:30.096172 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-33fed04a-6d38-40a1-a763-6d4532a9f1b8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 9eebfa95-bb07-411a-a10e-c31182df3062] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:30.103091 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-33fed04a-6d38-40a1-a763-6d4532a9f1b8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:30.103576 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-33fed04a-6d38-40a1-a763-6d4532a9f1b8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:30.104015 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-33fed04a-6d38-40a1-a763-6d4532a9f1b8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:30.104725 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-33fed04a-6d38-40a1-a763-6d4532a9f1b8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:30.105182 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-33fed04a-6d38-40a1-a763-6d4532a9f1b8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:30.105612 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-33fed04a-6d38-40a1-a763-6d4532a9f1b8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:30.247318 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-33fed04a-6d38-40a1-a763-6d4532a9f1b8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:30.255262 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-33fed04a-6d38-40a1-a763-6d4532a9f1b8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062" status: 200 len: 1682 microversion: 2.1 time: 0.164584 Oct 04 19:36:30.255827 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3757/7500] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:30 2022] GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062 => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:31.279907 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ac02c43f-ad8f-4be3-8553-ffd321ec97e5 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:31.280577 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ac02c43f-ad8f-4be3-8553-ffd321ec97e5 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 9eebfa95-bb07-411a-a10e-c31182df3062] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:31.287631 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ac02c43f-ad8f-4be3-8553-ffd321ec97e5 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:31.288175 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ac02c43f-ad8f-4be3-8553-ffd321ec97e5 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:31.288634 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ac02c43f-ad8f-4be3-8553-ffd321ec97e5 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:31.289346 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ac02c43f-ad8f-4be3-8553-ffd321ec97e5 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:31.289822 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ac02c43f-ad8f-4be3-8553-ffd321ec97e5 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:31.290265 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ac02c43f-ad8f-4be3-8553-ffd321ec97e5 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:31.422082 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ac02c43f-ad8f-4be3-8553-ffd321ec97e5 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:31.430534 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ac02c43f-ad8f-4be3-8553-ffd321ec97e5 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062" status: 200 len: 1682 microversion: 2.1 time: 0.154564 Oct 04 19:36:31.431182 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3744/7501] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:31 2022] GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:32.456876 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-44d34ba8-7a25-45e0-b03d-ca5a74442826 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:32.457606 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-44d34ba8-7a25-45e0-b03d-ca5a74442826 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 9eebfa95-bb07-411a-a10e-c31182df3062] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:32.464436 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-44d34ba8-7a25-45e0-b03d-ca5a74442826 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:32.464917 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-44d34ba8-7a25-45e0-b03d-ca5a74442826 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:32.465348 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-44d34ba8-7a25-45e0-b03d-ca5a74442826 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:32.466069 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-44d34ba8-7a25-45e0-b03d-ca5a74442826 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:32.466525 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-44d34ba8-7a25-45e0-b03d-ca5a74442826 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:32.466945 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-44d34ba8-7a25-45e0-b03d-ca5a74442826 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:32.604182 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-44d34ba8-7a25-45e0-b03d-ca5a74442826 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:32.612215 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-44d34ba8-7a25-45e0-b03d-ca5a74442826 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062" status: 200 len: 1682 microversion: 2.1 time: 0.160048 Oct 04 19:36:32.612798 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3758/7502] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:32 2022] GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062 => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:33.634878 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-00ac1dd9-9073-482b-831d-c981d58557fc tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:33.635491 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-00ac1dd9-9073-482b-831d-c981d58557fc tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 9eebfa95-bb07-411a-a10e-c31182df3062] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:33.643511 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-00ac1dd9-9073-482b-831d-c981d58557fc tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:33.644014 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-00ac1dd9-9073-482b-831d-c981d58557fc tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:33.644499 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-00ac1dd9-9073-482b-831d-c981d58557fc tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:33.645202 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-00ac1dd9-9073-482b-831d-c981d58557fc tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:33.645668 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-00ac1dd9-9073-482b-831d-c981d58557fc tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:33.646114 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-00ac1dd9-9073-482b-831d-c981d58557fc tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:33.776996 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-00ac1dd9-9073-482b-831d-c981d58557fc tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:33.785963 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-00ac1dd9-9073-482b-831d-c981d58557fc tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062" status: 200 len: 1682 microversion: 2.1 time: 0.155033 Oct 04 19:36:33.786543 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3745/7503] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:33 2022] GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:34.811893 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6e96501e-7d7e-480d-9124-8c73fe3b5de1 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:34.812689 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6e96501e-7d7e-480d-9124-8c73fe3b5de1 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 9eebfa95-bb07-411a-a10e-c31182df3062] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:34.821838 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6e96501e-7d7e-480d-9124-8c73fe3b5de1 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:34.822911 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6e96501e-7d7e-480d-9124-8c73fe3b5de1 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:34.823422 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6e96501e-7d7e-480d-9124-8c73fe3b5de1 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:34.824321 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6e96501e-7d7e-480d-9124-8c73fe3b5de1 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:34.824902 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6e96501e-7d7e-480d-9124-8c73fe3b5de1 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:34.825399 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6e96501e-7d7e-480d-9124-8c73fe3b5de1 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:34.962841 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6e96501e-7d7e-480d-9124-8c73fe3b5de1 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:34.971058 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6e96501e-7d7e-480d-9124-8c73fe3b5de1 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062" status: 200 len: 1682 microversion: 2.1 time: 0.164041 Oct 04 19:36:34.971576 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3759/7504] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:34 2022] GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062 => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:35.995006 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8e39bfdf-cfb4-4258-a763-42bd4c3457b3 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:35.995563 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8e39bfdf-cfb4-4258-a763-42bd4c3457b3 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 9eebfa95-bb07-411a-a10e-c31182df3062] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:36.003115 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8e39bfdf-cfb4-4258-a763-42bd4c3457b3 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:36.003621 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8e39bfdf-cfb4-4258-a763-42bd4c3457b3 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:36.004095 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8e39bfdf-cfb4-4258-a763-42bd4c3457b3 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:36.004820 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8e39bfdf-cfb4-4258-a763-42bd4c3457b3 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:36.005295 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8e39bfdf-cfb4-4258-a763-42bd4c3457b3 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:36.005744 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8e39bfdf-cfb4-4258-a763-42bd4c3457b3 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:36.139756 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8e39bfdf-cfb4-4258-a763-42bd4c3457b3 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:36.150574 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8e39bfdf-cfb4-4258-a763-42bd4c3457b3 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062" status: 200 len: 1682 microversion: 2.1 time: 0.159206 Oct 04 19:36:36.151600 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3746/7505] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:35 2022] GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062 => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:37.179783 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5eed9ecb-6fa1-4141-82e7-648899b7d6e1 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:37.180437 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5eed9ecb-6fa1-4141-82e7-648899b7d6e1 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 9eebfa95-bb07-411a-a10e-c31182df3062] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:37.187279 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5eed9ecb-6fa1-4141-82e7-648899b7d6e1 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:37.188387 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5eed9ecb-6fa1-4141-82e7-648899b7d6e1 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:37.188836 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5eed9ecb-6fa1-4141-82e7-648899b7d6e1 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:37.189538 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5eed9ecb-6fa1-4141-82e7-648899b7d6e1 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:37.190001 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5eed9ecb-6fa1-4141-82e7-648899b7d6e1 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:37.190434 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5eed9ecb-6fa1-4141-82e7-648899b7d6e1 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:37.324873 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5eed9ecb-6fa1-4141-82e7-648899b7d6e1 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:37.332809 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5eed9ecb-6fa1-4141-82e7-648899b7d6e1 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062" status: 200 len: 1682 microversion: 2.1 time: 0.156945 Oct 04 19:36:37.333372 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3760/7506] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:37 2022] GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:38.357291 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5f53113f-d3f2-4fa7-93b9-044792b0605e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:38.357948 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5f53113f-d3f2-4fa7-93b9-044792b0605e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 9eebfa95-bb07-411a-a10e-c31182df3062] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:38.366222 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5f53113f-d3f2-4fa7-93b9-044792b0605e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:38.366728 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5f53113f-d3f2-4fa7-93b9-044792b0605e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:38.367185 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5f53113f-d3f2-4fa7-93b9-044792b0605e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:38.367911 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5f53113f-d3f2-4fa7-93b9-044792b0605e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:38.368439 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5f53113f-d3f2-4fa7-93b9-044792b0605e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:38.368891 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5f53113f-d3f2-4fa7-93b9-044792b0605e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:38.499878 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5f53113f-d3f2-4fa7-93b9-044792b0605e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:38.507999 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5f53113f-d3f2-4fa7-93b9-044792b0605e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062" status: 200 len: 1682 microversion: 2.1 time: 0.154625 Oct 04 19:36:38.508604 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3747/7507] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:38 2022] GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:39.532081 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8cd84bcd-bf34-4e8c-8c47-84f033602553 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:39.532831 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8cd84bcd-bf34-4e8c-8c47-84f033602553 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 9eebfa95-bb07-411a-a10e-c31182df3062] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:39.542003 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8cd84bcd-bf34-4e8c-8c47-84f033602553 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:39.542680 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8cd84bcd-bf34-4e8c-8c47-84f033602553 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:39.543280 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8cd84bcd-bf34-4e8c-8c47-84f033602553 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:39.544006 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8cd84bcd-bf34-4e8c-8c47-84f033602553 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:39.544521 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8cd84bcd-bf34-4e8c-8c47-84f033602553 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:39.544958 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8cd84bcd-bf34-4e8c-8c47-84f033602553 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:39.711449 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8cd84bcd-bf34-4e8c-8c47-84f033602553 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:39.722048 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8cd84bcd-bf34-4e8c-8c47-84f033602553 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062" status: 200 len: 1682 microversion: 2.1 time: 0.193765 Oct 04 19:36:39.722683 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3761/7508] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:39 2022] GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062 => generated 1682 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:40.534530 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-6e022f50-a855-441f-945b-0711f5aeefac req-903c85b8-2de1-4452-95e0-a2737b79ac69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9eebfa95-bb07-411a-a10e-c31182df3062", "name": "network-vif-unplugged", "status": "completed", "tag": "6a091412-7879-43c5-a597-189bde835b66"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:36:40.543953 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-6e022f50-a855-441f-945b-0711f5aeefac req-903c85b8-2de1-4452-95e0-a2737b79ac69 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:40.544473 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-6e022f50-a855-441f-945b-0711f5aeefac req-903c85b8-2de1-4452-95e0-a2737b79ac69 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:40.544915 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-6e022f50-a855-441f-945b-0711f5aeefac req-903c85b8-2de1-4452-95e0-a2737b79ac69 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:40.556341 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-6e022f50-a855-441f-945b-0711f5aeefac req-903c85b8-2de1-4452-95e0-a2737b79ac69 service nova] Creating event network-vif-unplugged:6a091412-7879-43c5-a597-189bde835b66 for instance 9eebfa95-bb07-411a-a10e-c31182df3062 on n-h2-850501-14 Oct 04 19:36:40.561485 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [req-6e022f50-a855-441f-945b-0711f5aeefac req-903c85b8-2de1-4452-95e0-a2737b79ac69 service nova] Instance 9eebfa95-bb07-411a-a10e-c31182df3062 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850501-14', 'n-h2-850501-14'} {{(pid=123002) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:36:40.574097 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-6e022f50-a855-441f-945b-0711f5aeefac req-903c85b8-2de1-4452-95e0-a2737b79ac69 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.103463 Oct 04 19:36:40.574935 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3748/7509] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:36:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:36:40.756408 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-63a9c969-6f0b-4de5-838b-8a61eb46c383 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:40.768264 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-63a9c969-6f0b-4de5-838b-8a61eb46c383 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 9eebfa95-bb07-411a-a10e-c31182df3062] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:40.770197 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-63a9c969-6f0b-4de5-838b-8a61eb46c383 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:40.770896 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-63a9c969-6f0b-4de5-838b-8a61eb46c383 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:40.771359 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-63a9c969-6f0b-4de5-838b-8a61eb46c383 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:40.772136 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-63a9c969-6f0b-4de5-838b-8a61eb46c383 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:40.772607 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-63a9c969-6f0b-4de5-838b-8a61eb46c383 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:40.773039 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-63a9c969-6f0b-4de5-838b-8a61eb46c383 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:40.923471 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-63a9c969-6f0b-4de5-838b-8a61eb46c383 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:40.931849 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-63a9c969-6f0b-4de5-838b-8a61eb46c383 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062" status: 200 len: 1681 microversion: 2.1 time: 0.180774 Oct 04 19:36:40.932475 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3762/7510] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:40 2022] GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062 => generated 1681 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:41.957069 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1187e795-a665-4598-a285-ea2f017d9729 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:41.957785 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1187e795-a665-4598-a285-ea2f017d9729 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 9eebfa95-bb07-411a-a10e-c31182df3062] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:41.965341 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1187e795-a665-4598-a285-ea2f017d9729 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:41.965882 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1187e795-a665-4598-a285-ea2f017d9729 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:41.966369 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1187e795-a665-4598-a285-ea2f017d9729 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:41.967083 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1187e795-a665-4598-a285-ea2f017d9729 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:41.967559 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1187e795-a665-4598-a285-ea2f017d9729 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:41.968004 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1187e795-a665-4598-a285-ea2f017d9729 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:42.106599 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1187e795-a665-4598-a285-ea2f017d9729 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:42.115074 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1187e795-a665-4598-a285-ea2f017d9729 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062" status: 200 len: 1681 microversion: 2.1 time: 0.162758 Oct 04 19:36:42.115675 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3749/7511] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:41 2022] GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062 => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:42.603647 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-2121c949-906e-47d6-9e66-b340c0ec67ea req-90fb4efd-9a92-43c4-a6e6-893f7b572c14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9eebfa95-bb07-411a-a10e-c31182df3062", "tag": "6a091412-7879-43c5-a597-189bde835b66"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:36:42.614627 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-2121c949-906e-47d6-9e66-b340c0ec67ea req-90fb4efd-9a92-43c4-a6e6-893f7b572c14 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:42.615116 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-2121c949-906e-47d6-9e66-b340c0ec67ea req-90fb4efd-9a92-43c4-a6e6-893f7b572c14 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:42.615549 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-2121c949-906e-47d6-9e66-b340c0ec67ea req-90fb4efd-9a92-43c4-a6e6-893f7b572c14 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:42.628299 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-2121c949-906e-47d6-9e66-b340c0ec67ea req-90fb4efd-9a92-43c4-a6e6-893f7b572c14 service nova] Creating event network-changed:6a091412-7879-43c5-a597-189bde835b66 for instance 9eebfa95-bb07-411a-a10e-c31182df3062 on n-h2-850501-14 Oct 04 19:36:42.633728 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [req-2121c949-906e-47d6-9e66-b340c0ec67ea req-90fb4efd-9a92-43c4-a6e6-893f7b572c14 service nova] Instance 9eebfa95-bb07-411a-a10e-c31182df3062 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850501-14', 'n-h2-850501-14'} {{(pid=123001) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:36:42.645592 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-2121c949-906e-47d6-9e66-b340c0ec67ea req-90fb4efd-9a92-43c4-a6e6-893f7b572c14 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045667 Oct 04 19:36:42.646191 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3763/7512] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:36:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:36:43.139098 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7802e239-e2fc-40c0-a1f7-f31233229238 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:43.139790 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7802e239-e2fc-40c0-a1f7-f31233229238 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 9eebfa95-bb07-411a-a10e-c31182df3062] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:43.146854 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7802e239-e2fc-40c0-a1f7-f31233229238 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:43.147362 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7802e239-e2fc-40c0-a1f7-f31233229238 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:43.147820 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7802e239-e2fc-40c0-a1f7-f31233229238 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:43.148568 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7802e239-e2fc-40c0-a1f7-f31233229238 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:43.149037 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7802e239-e2fc-40c0-a1f7-f31233229238 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:43.149483 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7802e239-e2fc-40c0-a1f7-f31233229238 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:43.568467 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7802e239-e2fc-40c0-a1f7-f31233229238 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:43.581521 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7802e239-e2fc-40c0-a1f7-f31233229238 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062" status: 200 len: 1679 microversion: 2.1 time: 0.446148 Oct 04 19:36:43.583070 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3750/7513] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:43 2022] GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062 => generated 1679 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:44.608173 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-24da7264-a1c9-4a97-a2df-72e2e501841c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:44.608885 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-24da7264-a1c9-4a97-a2df-72e2e501841c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 9eebfa95-bb07-411a-a10e-c31182df3062] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:44.615073 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-24da7264-a1c9-4a97-a2df-72e2e501841c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:44.615558 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-24da7264-a1c9-4a97-a2df-72e2e501841c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:44.616001 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-24da7264-a1c9-4a97-a2df-72e2e501841c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:44.616720 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-24da7264-a1c9-4a97-a2df-72e2e501841c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:44.617187 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-24da7264-a1c9-4a97-a2df-72e2e501841c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:44.617615 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-24da7264-a1c9-4a97-a2df-72e2e501841c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:44.747683 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-24da7264-a1c9-4a97-a2df-72e2e501841c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:44.756087 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-24da7264-a1c9-4a97-a2df-72e2e501841c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062" status: 200 len: 1679 microversion: 2.1 time: 0.153006 Oct 04 19:36:44.756672 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3764/7514] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:44 2022] GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:45.780888 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6f35078d-bec5-48e7-994c-de1e975d5aa2 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:45.781520 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-6f35078d-bec5-48e7-994c-de1e975d5aa2 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 9eebfa95-bb07-411a-a10e-c31182df3062] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:45.788317 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6f35078d-bec5-48e7-994c-de1e975d5aa2 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:45.788822 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6f35078d-bec5-48e7-994c-de1e975d5aa2 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:45.789395 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6f35078d-bec5-48e7-994c-de1e975d5aa2 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:45.790106 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6f35078d-bec5-48e7-994c-de1e975d5aa2 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:45.790580 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6f35078d-bec5-48e7-994c-de1e975d5aa2 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:45.791022 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6f35078d-bec5-48e7-994c-de1e975d5aa2 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:45.938622 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-6f35078d-bec5-48e7-994c-de1e975d5aa2 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:45.946705 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6f35078d-bec5-48e7-994c-de1e975d5aa2 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062" status: 200 len: 1679 microversion: 2.1 time: 0.170182 Oct 04 19:36:45.947303 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3751/7515] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:45 2022] GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062 => generated 1679 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:46.970648 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d9977e89-1013-4fbc-bd4f-9f375621af6d tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:46.971260 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d9977e89-1013-4fbc-bd4f-9f375621af6d tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 9eebfa95-bb07-411a-a10e-c31182df3062] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:46.977594 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d9977e89-1013-4fbc-bd4f-9f375621af6d tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:46.978078 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d9977e89-1013-4fbc-bd4f-9f375621af6d tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:46.978516 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d9977e89-1013-4fbc-bd4f-9f375621af6d tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:46.979201 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d9977e89-1013-4fbc-bd4f-9f375621af6d tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:46.979658 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d9977e89-1013-4fbc-bd4f-9f375621af6d tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:46.980115 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d9977e89-1013-4fbc-bd4f-9f375621af6d tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:47.113707 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d9977e89-1013-4fbc-bd4f-9f375621af6d tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:47.121556 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d9977e89-1013-4fbc-bd4f-9f375621af6d tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062" status: 200 len: 1676 microversion: 2.1 time: 0.155591 Oct 04 19:36:47.122227 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3765/7516] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:46 2022] GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:47.145634 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-dc291664-d2a7-46fe-9dcd-b69f0d9d20e0 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:36:47.146202 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-dc291664-d2a7-46fe-9dcd-b69f0d9d20e0 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 9eebfa95-bb07-411a-a10e-c31182df3062] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:47.153228 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dc291664-d2a7-46fe-9dcd-b69f0d9d20e0 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:47.153742 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dc291664-d2a7-46fe-9dcd-b69f0d9d20e0 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:47.154202 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dc291664-d2a7-46fe-9dcd-b69f0d9d20e0 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:47.154928 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dc291664-d2a7-46fe-9dcd-b69f0d9d20e0 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:47.155404 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dc291664-d2a7-46fe-9dcd-b69f0d9d20e0 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:47.155849 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dc291664-d2a7-46fe-9dcd-b69f0d9d20e0 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:47.322218 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:36:47.395189 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-dc291664-d2a7-46fe-9dcd-b69f0d9d20e0 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "POST /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062/action" status: 204 len: 0 microversion: 2.1 time: 0.253930 Oct 04 19:36:47.395872 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3752/7517] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 19:36:47 2022] POST /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062/action => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:36:47.404202 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-857eaaf3-4ab6-4228-8c82-b1a2d5395eda tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:47.404822 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-857eaaf3-4ab6-4228-8c82-b1a2d5395eda tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 9eebfa95-bb07-411a-a10e-c31182df3062] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:47.411428 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-857eaaf3-4ab6-4228-8c82-b1a2d5395eda tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:47.411917 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-857eaaf3-4ab6-4228-8c82-b1a2d5395eda tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:47.412377 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-857eaaf3-4ab6-4228-8c82-b1a2d5395eda tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:47.413076 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-857eaaf3-4ab6-4228-8c82-b1a2d5395eda tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:47.413532 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-857eaaf3-4ab6-4228-8c82-b1a2d5395eda tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:47.413959 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-857eaaf3-4ab6-4228-8c82-b1a2d5395eda tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:47.432358 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:36:47.614409 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-857eaaf3-4ab6-4228-8c82-b1a2d5395eda tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:47.622857 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-857eaaf3-4ab6-4228-8c82-b1a2d5395eda tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062" status: 200 len: 1676 microversion: 2.1 time: 0.222452 Oct 04 19:36:47.623447 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3766/7518] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:47 2022] GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062 => generated 1676 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:48.507839 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-f336fc97-7242-46fb-9c66-6331ad01f1bc req-83b6b679-c72c-4204-af67-6f32f102f01a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9eebfa95-bb07-411a-a10e-c31182df3062", "name": "network-vif-plugged", "status": "completed", "tag": "6a091412-7879-43c5-a597-189bde835b66"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:36:48.520043 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-f336fc97-7242-46fb-9c66-6331ad01f1bc req-83b6b679-c72c-4204-af67-6f32f102f01a service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:48.520731 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-f336fc97-7242-46fb-9c66-6331ad01f1bc req-83b6b679-c72c-4204-af67-6f32f102f01a service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:48.521186 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-f336fc97-7242-46fb-9c66-6331ad01f1bc req-83b6b679-c72c-4204-af67-6f32f102f01a service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:48.534265 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-f336fc97-7242-46fb-9c66-6331ad01f1bc req-83b6b679-c72c-4204-af67-6f32f102f01a service nova] Creating event network-vif-plugged:6a091412-7879-43c5-a597-189bde835b66 for instance 9eebfa95-bb07-411a-a10e-c31182df3062 on n-h2-850501-14 Oct 04 19:36:48.540079 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [req-f336fc97-7242-46fb-9c66-6331ad01f1bc req-83b6b679-c72c-4204-af67-6f32f102f01a service nova] Instance 9eebfa95-bb07-411a-a10e-c31182df3062 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850501-14', 'n-h2-850501-14'} {{(pid=123002) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:36:48.551556 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-f336fc97-7242-46fb-9c66-6331ad01f1bc req-83b6b679-c72c-4204-af67-6f32f102f01a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048150 Oct 04 19:36:48.552577 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3753/7519] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:36:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:36:48.649014 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-44458da2-9ba5-4e32-8894-a015fba90ae6 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:48.650040 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-44458da2-9ba5-4e32-8894-a015fba90ae6 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 9eebfa95-bb07-411a-a10e-c31182df3062] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:48.657189 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-44458da2-9ba5-4e32-8894-a015fba90ae6 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:48.657784 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-44458da2-9ba5-4e32-8894-a015fba90ae6 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:48.658243 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-44458da2-9ba5-4e32-8894-a015fba90ae6 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:48.658946 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-44458da2-9ba5-4e32-8894-a015fba90ae6 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:48.659406 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-44458da2-9ba5-4e32-8894-a015fba90ae6 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:48.659840 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-44458da2-9ba5-4e32-8894-a015fba90ae6 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:48.798398 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-44458da2-9ba5-4e32-8894-a015fba90ae6 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:48.806756 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-44458da2-9ba5-4e32-8894-a015fba90ae6 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062" status: 200 len: 1676 microversion: 2.1 time: 0.161329 Oct 04 19:36:48.807339 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3767/7520] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:48 2022] GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062 => generated 1676 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:49.833473 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ecdd71fc-8127-41ae-b169-528740eb27e4 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:49.834119 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ecdd71fc-8127-41ae-b169-528740eb27e4 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 9eebfa95-bb07-411a-a10e-c31182df3062] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:49.838668 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=35 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:36:49.843655 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ecdd71fc-8127-41ae-b169-528740eb27e4 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:49.844182 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ecdd71fc-8127-41ae-b169-528740eb27e4 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:49.844643 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ecdd71fc-8127-41ae-b169-528740eb27e4 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:49.845760 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ecdd71fc-8127-41ae-b169-528740eb27e4 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:49.846234 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ecdd71fc-8127-41ae-b169-528740eb27e4 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:49.846676 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ecdd71fc-8127-41ae-b169-528740eb27e4 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:49.977456 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ecdd71fc-8127-41ae-b169-528740eb27e4 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:49.985176 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ecdd71fc-8127-41ae-b169-528740eb27e4 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062" status: 200 len: 1668 microversion: 2.1 time: 0.157438 Oct 04 19:36:49.986279 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3754/7521] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:49 2022] GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062 => generated 1668 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:50.008735 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0d0a1805-d564-4e97-9fc5-605312c18a4a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:50.009358 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0d0a1805-d564-4e97-9fc5-605312c18a4a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 9eebfa95-bb07-411a-a10e-c31182df3062] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:50.012017 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=39 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:36:50.016774 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0d0a1805-d564-4e97-9fc5-605312c18a4a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:50.017266 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0d0a1805-d564-4e97-9fc5-605312c18a4a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:50.017707 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0d0a1805-d564-4e97-9fc5-605312c18a4a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:50.018703 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0d0a1805-d564-4e97-9fc5-605312c18a4a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:50.019213 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0d0a1805-d564-4e97-9fc5-605312c18a4a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:50.019647 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0d0a1805-d564-4e97-9fc5-605312c18a4a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:50.150790 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0d0a1805-d564-4e97-9fc5-605312c18a4a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:50.159367 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0d0a1805-d564-4e97-9fc5-605312c18a4a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062" status: 200 len: 1668 microversion: 2.1 time: 0.154571 Oct 04 19:36:50.159943 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3768/7522] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:50 2022] GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062 => generated 1668 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:50.182257 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-75e9da00-f1e1-4ae1-97e9-f9d55acd3db9 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:50.182887 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-75e9da00-f1e1-4ae1-97e9-f9d55acd3db9 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 9eebfa95-bb07-411a-a10e-c31182df3062] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:50.189244 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-75e9da00-f1e1-4ae1-97e9-f9d55acd3db9 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:50.189750 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-75e9da00-f1e1-4ae1-97e9-f9d55acd3db9 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:50.190202 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-75e9da00-f1e1-4ae1-97e9-f9d55acd3db9 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:50.190908 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-75e9da00-f1e1-4ae1-97e9-f9d55acd3db9 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:50.191380 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-75e9da00-f1e1-4ae1-97e9-f9d55acd3db9 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:50.191821 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-75e9da00-f1e1-4ae1-97e9-f9d55acd3db9 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:50.322945 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-75e9da00-f1e1-4ae1-97e9-f9d55acd3db9 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:50.330618 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-75e9da00-f1e1-4ae1-97e9-f9d55acd3db9 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062" status: 200 len: 1668 microversion: 2.1 time: 0.152231 Oct 04 19:36:50.331182 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3755/7523] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:50 2022] GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062 => generated 1668 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:50.353106 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2b68bd3e-2317-42c3-b288-4f0ee7f73510 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:50.353533 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2b68bd3e-2317-42c3-b288-4f0ee7f73510 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 9eebfa95-bb07-411a-a10e-c31182df3062] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:50.359470 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2b68bd3e-2317-42c3-b288-4f0ee7f73510 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:50.359959 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2b68bd3e-2317-42c3-b288-4f0ee7f73510 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:50.361053 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2b68bd3e-2317-42c3-b288-4f0ee7f73510 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:50.361713 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2b68bd3e-2317-42c3-b288-4f0ee7f73510 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:50.362171 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2b68bd3e-2317-42c3-b288-4f0ee7f73510 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:50.362606 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2b68bd3e-2317-42c3-b288-4f0ee7f73510 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:50.390026 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2b68bd3e-2317-42c3-b288-4f0ee7f73510 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 9eebfa95-bb07-411a-a10e-c31182df3062] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:36:50.702643 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2b68bd3e-2317-42c3-b288-4f0ee7f73510 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062" status: 204 len: 0 microversion: 2.1 time: 0.353157 Oct 04 19:36:50.703276 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3769/7524] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 19:36:50 2022] DELETE /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:36:50.712304 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-52d8a11c-4779-43e6-8d48-2f54ac15b221 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:50.719313 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-52d8a11c-4779-43e6-8d48-2f54ac15b221 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 9eebfa95-bb07-411a-a10e-c31182df3062] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:50.719313 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-52d8a11c-4779-43e6-8d48-2f54ac15b221 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:50.721178 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-52d8a11c-4779-43e6-8d48-2f54ac15b221 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:50.721691 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-52d8a11c-4779-43e6-8d48-2f54ac15b221 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:50.722429 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-52d8a11c-4779-43e6-8d48-2f54ac15b221 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:50.723386 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-52d8a11c-4779-43e6-8d48-2f54ac15b221 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:50.723386 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-52d8a11c-4779-43e6-8d48-2f54ac15b221 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:50.853888 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-52d8a11c-4779-43e6-8d48-2f54ac15b221 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:50.862148 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-52d8a11c-4779-43e6-8d48-2f54ac15b221 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062" status: 200 len: 1674 microversion: 2.1 time: 0.153877 Oct 04 19:36:50.862723 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3756/7525] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:50 2022] GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062 => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:51.887178 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d261e27c-1d06-4e20-8da9-805fbfc1814d tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:51.887892 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d261e27c-1d06-4e20-8da9-805fbfc1814d tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 9eebfa95-bb07-411a-a10e-c31182df3062] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:51.895293 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d261e27c-1d06-4e20-8da9-805fbfc1814d tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:51.895789 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d261e27c-1d06-4e20-8da9-805fbfc1814d tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:51.896255 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d261e27c-1d06-4e20-8da9-805fbfc1814d tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:51.896956 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d261e27c-1d06-4e20-8da9-805fbfc1814d tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:51.897414 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d261e27c-1d06-4e20-8da9-805fbfc1814d tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:51.897846 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d261e27c-1d06-4e20-8da9-805fbfc1814d tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:52.037834 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d261e27c-1d06-4e20-8da9-805fbfc1814d tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:52.045623 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d261e27c-1d06-4e20-8da9-805fbfc1814d tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062" status: 200 len: 1674 microversion: 2.1 time: 0.162733 Oct 04 19:36:52.046189 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3770/7526] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:51 2022] GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062 => generated 1674 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:53.069707 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-503c9637-0631-4c5d-926b-01b544f28098 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:53.070328 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-503c9637-0631-4c5d-926b-01b544f28098 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 9eebfa95-bb07-411a-a10e-c31182df3062] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:53.077363 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-503c9637-0631-4c5d-926b-01b544f28098 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:53.077840 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-503c9637-0631-4c5d-926b-01b544f28098 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:53.078284 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-503c9637-0631-4c5d-926b-01b544f28098 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:53.079066 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-503c9637-0631-4c5d-926b-01b544f28098 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:53.079714 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-503c9637-0631-4c5d-926b-01b544f28098 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:53.080181 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-503c9637-0631-4c5d-926b-01b544f28098 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:53.209879 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-503c9637-0631-4c5d-926b-01b544f28098 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:53.220198 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-503c9637-0631-4c5d-926b-01b544f28098 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062" status: 200 len: 1674 microversion: 2.1 time: 0.153750 Oct 04 19:36:53.220910 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3757/7527] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:53 2022] GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062 => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:53.527916 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-a125bc06-7899-406b-9524-cfa69ddfa54c req-80f06813-c984-4927-b660-ab6dcac45f47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9eebfa95-bb07-411a-a10e-c31182df3062", "name": "network-vif-deleted", "tag": "6a091412-7879-43c5-a597-189bde835b66"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:36:53.539608 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-a125bc06-7899-406b-9524-cfa69ddfa54c req-80f06813-c984-4927-b660-ab6dcac45f47 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:53.540513 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-a125bc06-7899-406b-9524-cfa69ddfa54c req-80f06813-c984-4927-b660-ab6dcac45f47 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:53.545041 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-a125bc06-7899-406b-9524-cfa69ddfa54c req-80f06813-c984-4927-b660-ab6dcac45f47 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:53.552760 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-a125bc06-7899-406b-9524-cfa69ddfa54c req-80f06813-c984-4927-b660-ab6dcac45f47 service nova] Creating event network-vif-deleted:6a091412-7879-43c5-a597-189bde835b66 for instance 9eebfa95-bb07-411a-a10e-c31182df3062 on n-h2-850501-14 Oct 04 19:36:53.557710 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-a125bc06-7899-406b-9524-cfa69ddfa54c req-80f06813-c984-4927-b660-ab6dcac45f47 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034097 Oct 04 19:36:53.558341 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3771/7528] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:36:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:36:54.244647 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b06feee3-f57a-4aed-bdc9-d6a043a608ef tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:54.245381 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b06feee3-f57a-4aed-bdc9-d6a043a608ef tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 9eebfa95-bb07-411a-a10e-c31182df3062] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:54.247672 n-d-850501-14 devstack@n-api.service[123002]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:36:54.247811 n-d-850501-14 devstack@n-api.service[123002]: Tue Oct 4 19:36:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062 (ip 10.222.0.20) !!! Oct 04 19:36:54.254926 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b06feee3-f57a-4aed-bdc9-d6a043a608ef tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:54.255429 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b06feee3-f57a-4aed-bdc9-d6a043a608ef tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:54.255888 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b06feee3-f57a-4aed-bdc9-d6a043a608ef tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:54.256635 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b06feee3-f57a-4aed-bdc9-d6a043a608ef tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:54.257113 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b06feee3-f57a-4aed-bdc9-d6a043a608ef tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:54.257559 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b06feee3-f57a-4aed-bdc9-d6a043a608ef tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:54.273139 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-b06feee3-f57a-4aed-bdc9-d6a043a608ef tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] HTTP exception thrown: Instance 9eebfa95-bb07-411a-a10e-c31182df3062 could not be found. Oct 04 19:36:54.274885 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b06feee3-f57a-4aed-bdc9-d6a043a608ef tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Request method failure captured: Oct 04 19:36:54.274885 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062 HTTP/1.1 Oct 04 19:36:54.274885 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 19:36:54.274885 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 19:36:54.274885 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 19:36:54.274885 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 19:36:54.274885 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 19:36:54.274885 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 19:36:54.274885 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 19:36:54.274885 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 19:36:54.274885 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPIsCyZ9ujYHj7xAc9v5FsVDNBnhQXdRu3HrD7Tq5GQWPtceXFx7qoWJz7lP8l4zGdRoz3AIMETvWSaNf7C0jkbsq4Fdp5SR34bQhmUN7dN-TqhYTJpmcPItgyv3Ip6rfSesFJ9T-vVra0xTUsrYnfVdo1LIR9dDYTmgb9RW4N3wBj3M Oct 04 19:36:54.274885 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 19:36:54.274885 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 19:36:54.274885 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 19:36:54.274885 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 19:36:54.274885 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 19:36:54.274885 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 19:36:54.274885 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 56eff05b035a45e0afc0f92d9d85e136 Oct 04 19:36:54.274885 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServerActionsTestJSON-2139592700 Oct 04 19:36:54.274885 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 19:36:54.274885 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 19:36:54.274885 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/56eff05b035a45e0afc0f92d9d85e136"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_56eff05b035a45e0afc0f92d9d85e136", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/56eff05b035a45e0afc0f92d9d85e136"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/56eff05b035a45e0afc0f92d9d85e136"}]}] Oct 04 19:36:54.274885 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServerActionsTestJSON-2139592700 Oct 04 19:36:54.274885 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 56eff05b035a45e0afc0f92d9d85e136 Oct 04 19:36:54.274885 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServerActionsTestJSON-2139592700 Oct 04 19:36:54.274885 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServerActionsTestJSON-2139592700-project Oct 04 19:36:54.274885 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 19:36:54.274885 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 19:36:54.274885 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 6970aa4f091c49e382c86a487d25d524 Oct 04 19:36:54.274885 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServerActionsTestJSON-2139592700-project Oct 04 19:36:54.274885 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 19:36:54.274885 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 9eebfa95-bb07-411a-a10e-c31182df3062 could not be found. Oct 04 19:36:54.274885 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '9eebfa95-bb07-411a-a10e-c31182df3062'} Oct 04 19:36:54.274885 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:36:54.274885 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:36:54.274885 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:36:54.274885 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:36:54.274885 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:36:54.274885 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:36:54.274885 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:36:54.274885 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:36:54.274885 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:36:54.274885 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:36:54.274885 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9eebfa95-bb07-411a-a10e-c31182df3062 could not be found. Oct 04 19:36:54.274885 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:36:54.274885 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:36:54.274885 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:36:54.274885 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:36:54.274885 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:36:54.274885 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:36:54.274885 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:36:54.274885 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:36:54.274885 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:36:54.274885 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:36:54.274885 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:36:54.274885 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:36:54.274885 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:36:54.274885 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:36:54.274885 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:36:54.274885 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:36:54.274885 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9eebfa95-bb07-411a-a10e-c31182df3062 could not be found. Oct 04 19:36:54.274885 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:36:54.274885 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:36:54.274885 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:36:54.279634 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:36:54.279634 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:36:54.279634 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:36:54.279634 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:36:54.279634 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:36:54.279634 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9eebfa95-bb07-411a-a10e-c31182df3062 could not be found. Oct 04 19:36:54.279634 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:36:54.279634 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b06feee3-f57a-4aed-bdc9-d6a043a608ef tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Returning 404 to user: Instance 9eebfa95-bb07-411a-a10e-c31182df3062 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:36:54.279634 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b06feee3-f57a-4aed-bdc9-d6a043a608ef tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062" status: 404 len: 111 microversion: 2.1 time: 0.035750 Oct 04 19:36:54.280551 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3758/7529] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:54 2022] GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:36:54.295731 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-052bd114-caae-42c9-bf6d-a5609941bcab tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:54.296408 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-052bd114-caae-42c9-bf6d-a5609941bcab tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 9eebfa95-bb07-411a-a10e-c31182df3062] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:54.302994 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-052bd114-caae-42c9-bf6d-a5609941bcab tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:54.303490 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-052bd114-caae-42c9-bf6d-a5609941bcab tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:54.303934 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-052bd114-caae-42c9-bf6d-a5609941bcab tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:54.304880 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-052bd114-caae-42c9-bf6d-a5609941bcab tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:54.305343 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-052bd114-caae-42c9-bf6d-a5609941bcab tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:54.305780 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-052bd114-caae-42c9-bf6d-a5609941bcab tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:54.319899 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-052bd114-caae-42c9-bf6d-a5609941bcab tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] HTTP exception thrown: Instance 9eebfa95-bb07-411a-a10e-c31182df3062 could not be found. Oct 04 19:36:54.321835 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-052bd114-caae-42c9-bf6d-a5609941bcab tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Request method failure captured: Oct 04 19:36:54.321835 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062 HTTP/1.1 Oct 04 19:36:54.321835 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 19:36:54.321835 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 19:36:54.321835 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 19:36:54.321835 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 19:36:54.321835 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 19:36:54.321835 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 19:36:54.321835 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 19:36:54.321835 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 19:36:54.321835 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPIsCyZ9ujYHj7xAc9v5FsVDNBnhQXdRu3HrD7Tq5GQWPtceXFx7qoWJz7lP8l4zGdRoz3AIMETvWSaNf7C0jkbsq4Fdp5SR34bQhmUN7dN-TqhYTJpmcPItgyv3Ip6rfSesFJ9T-vVra0xTUsrYnfVdo1LIR9dDYTmgb9RW4N3wBj3M Oct 04 19:36:54.321835 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 19:36:54.321835 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 19:36:54.321835 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 19:36:54.321835 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 19:36:54.321835 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 19:36:54.321835 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 19:36:54.321835 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 56eff05b035a45e0afc0f92d9d85e136 Oct 04 19:36:54.321835 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ServerActionsTestJSON-2139592700 Oct 04 19:36:54.321835 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 19:36:54.321835 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 19:36:54.321835 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/56eff05b035a45e0afc0f92d9d85e136"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_56eff05b035a45e0afc0f92d9d85e136", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/56eff05b035a45e0afc0f92d9d85e136"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/56eff05b035a45e0afc0f92d9d85e136"}]}] Oct 04 19:36:54.321835 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ServerActionsTestJSON-2139592700 Oct 04 19:36:54.321835 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 56eff05b035a45e0afc0f92d9d85e136 Oct 04 19:36:54.321835 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ServerActionsTestJSON-2139592700 Oct 04 19:36:54.321835 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ServerActionsTestJSON-2139592700-project Oct 04 19:36:54.321835 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 19:36:54.321835 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 19:36:54.321835 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 6970aa4f091c49e382c86a487d25d524 Oct 04 19:36:54.321835 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ServerActionsTestJSON-2139592700-project Oct 04 19:36:54.321835 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 19:36:54.321835 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 9eebfa95-bb07-411a-a10e-c31182df3062 could not be found. Oct 04 19:36:54.321835 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '9eebfa95-bb07-411a-a10e-c31182df3062'} Oct 04 19:36:54.321835 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:36:54.321835 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:36:54.321835 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:36:54.321835 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:36:54.321835 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:36:54.321835 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:36:54.321835 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:36:54.321835 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:36:54.321835 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:36:54.321835 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:36:54.321835 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9eebfa95-bb07-411a-a10e-c31182df3062 could not be found. Oct 04 19:36:54.321835 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:36:54.321835 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:36:54.321835 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:36:54.321835 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:36:54.321835 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:36:54.321835 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:36:54.321835 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:36:54.321835 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:36:54.321835 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:36:54.321835 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:36:54.321835 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:36:54.321835 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:36:54.321835 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:36:54.321835 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:36:54.321835 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:36:54.321835 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:36:54.321835 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9eebfa95-bb07-411a-a10e-c31182df3062 could not be found. Oct 04 19:36:54.321835 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:36:54.321835 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:36:54.321835 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:36:54.326161 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:36:54.326161 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:36:54.326161 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:36:54.326161 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:36:54.326161 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:36:54.326161 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9eebfa95-bb07-411a-a10e-c31182df3062 could not be found. Oct 04 19:36:54.326161 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:36:54.326161 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-052bd114-caae-42c9-bf6d-a5609941bcab tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Returning 404 to user: Instance 9eebfa95-bb07-411a-a10e-c31182df3062 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:36:54.326161 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-052bd114-caae-42c9-bf6d-a5609941bcab tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062" status: 404 len: 111 microversion: 2.1 time: 0.032265 Oct 04 19:36:54.332449 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3772/7530] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:54 2022] GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:36:54.375929 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-78f73194-8da1-435f-9e7f-1b8a82c1af0c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1001932176", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": [{"uuid": "da1c0bb1-0fcf-4915-8cd0-57095c8c6e9c"}], "security_groups": [{"name": "tempest-securitygroup--729491688"}], "key_name": "tempest-keypair-980628313", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:36:54.483060 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-78f73194-8da1-435f-9e7f-1b8a82c1af0c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] validate_networks() for [('da1c0bb1-0fcf-4915-8cd0-57095c8c6e9c', None, None, None, None, None)] {{(pid=123002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:36:54.944774 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-78f73194-8da1-435f-9e7f-1b8a82c1af0c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:36:54.945222 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-78f73194-8da1-435f-9e7f-1b8a82c1af0c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:36:54.945722 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-78f73194-8da1-435f-9e7f-1b8a82c1af0c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:36:54.946234 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-78f73194-8da1-435f-9e7f-1b8a82c1af0c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:36:54.946672 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-78f73194-8da1-435f-9e7f-1b8a82c1af0c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:36:54.957062 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-78f73194-8da1-435f-9e7f-1b8a82c1af0c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:54.957612 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-78f73194-8da1-435f-9e7f-1b8a82c1af0c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:54.958059 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-78f73194-8da1-435f-9e7f-1b8a82c1af0c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:54.958844 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-78f73194-8da1-435f-9e7f-1b8a82c1af0c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:54.959314 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-78f73194-8da1-435f-9e7f-1b8a82c1af0c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:54.959754 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-78f73194-8da1-435f-9e7f-1b8a82c1af0c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:54.977420 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-78f73194-8da1-435f-9e7f-1b8a82c1af0c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Getting quotas for project 56eff05b035a45e0afc0f92d9d85e136. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:36:54.982640 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-78f73194-8da1-435f-9e7f-1b8a82c1af0c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Getting quotas for user 6970aa4f091c49e382c86a487d25d524 and project 56eff05b035a45e0afc0f92d9d85e136. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:36:54.995409 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-78f73194-8da1-435f-9e7f-1b8a82c1af0c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Going to run 1 instances... {{(pid=123002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:36:54.997769 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-78f73194-8da1-435f-9e7f-1b8a82c1af0c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: fb263540-8e7c-43b1-9fb6-b92afe7ff384] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:36:55.134623 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-78f73194-8da1-435f-9e7f-1b8a82c1af0c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.762550 Oct 04 19:36:55.135281 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3759/7531] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 19:36:54 2022] POST /compute/v2.1/servers => generated 405 bytes in 764 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:36:55.147687 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-aef4d9be-4c49-446c-95d8-7d4f185e718f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:55.148336 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-aef4d9be-4c49-446c-95d8-7d4f185e718f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: fb263540-8e7c-43b1-9fb6-b92afe7ff384] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:55.203758 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-aef4d9be-4c49-446c-95d8-7d4f185e718f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:55.212580 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-aef4d9be-4c49-446c-95d8-7d4f185e718f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384" status: 200 len: 1238 microversion: 2.1 time: 0.068697 Oct 04 19:36:55.213136 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3773/7532] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:55 2022] GET /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384 => generated 1238 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:56.238968 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d22a8a94-c297-4a5f-9621-67aa72d8dba8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:56.239592 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d22a8a94-c297-4a5f-9621-67aa72d8dba8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: fb263540-8e7c-43b1-9fb6-b92afe7ff384] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:56.245836 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d22a8a94-c297-4a5f-9621-67aa72d8dba8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:56.246920 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d22a8a94-c297-4a5f-9621-67aa72d8dba8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:56.247400 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d22a8a94-c297-4a5f-9621-67aa72d8dba8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:56.248316 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d22a8a94-c297-4a5f-9621-67aa72d8dba8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:56.248787 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d22a8a94-c297-4a5f-9621-67aa72d8dba8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:56.249228 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d22a8a94-c297-4a5f-9621-67aa72d8dba8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:56.313081 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d22a8a94-c297-4a5f-9621-67aa72d8dba8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:56.323724 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d22a8a94-c297-4a5f-9621-67aa72d8dba8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384" status: 200 len: 1242 microversion: 2.1 time: 0.088281 Oct 04 19:36:56.323724 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3760/7533] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:56 2022] GET /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384 => generated 1242 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:57.345873 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7267d01d-ade4-4f99-8ba5-f39ca6a83f68 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:57.346576 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7267d01d-ade4-4f99-8ba5-f39ca6a83f68 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: fb263540-8e7c-43b1-9fb6-b92afe7ff384] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:57.353372 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7267d01d-ade4-4f99-8ba5-f39ca6a83f68 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:57.353853 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7267d01d-ade4-4f99-8ba5-f39ca6a83f68 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:57.354287 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7267d01d-ade4-4f99-8ba5-f39ca6a83f68 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:57.354993 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7267d01d-ade4-4f99-8ba5-f39ca6a83f68 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:57.355449 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7267d01d-ade4-4f99-8ba5-f39ca6a83f68 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:57.355869 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7267d01d-ade4-4f99-8ba5-f39ca6a83f68 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:57.421763 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7267d01d-ade4-4f99-8ba5-f39ca6a83f68 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:57.429648 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7267d01d-ade4-4f99-8ba5-f39ca6a83f68 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384" status: 200 len: 1290 microversion: 2.1 time: 0.088599 Oct 04 19:36:57.430216 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3774/7534] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:57 2022] GET /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384 => generated 1290 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:58.455341 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4f624168-d072-4df1-8ff3-362524f17386 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:58.456097 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4f624168-d072-4df1-8ff3-362524f17386 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: fb263540-8e7c-43b1-9fb6-b92afe7ff384] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:58.463253 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4f624168-d072-4df1-8ff3-362524f17386 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:58.463825 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4f624168-d072-4df1-8ff3-362524f17386 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:58.464300 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4f624168-d072-4df1-8ff3-362524f17386 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:58.465020 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4f624168-d072-4df1-8ff3-362524f17386 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:58.465541 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4f624168-d072-4df1-8ff3-362524f17386 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:58.465972 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4f624168-d072-4df1-8ff3-362524f17386 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:58.618650 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4f624168-d072-4df1-8ff3-362524f17386 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:58.629663 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4f624168-d072-4df1-8ff3-362524f17386 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384" status: 200 len: 1363 microversion: 2.1 time: 0.180136 Oct 04 19:36:58.630257 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3761/7535] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:58 2022] GET /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384 => generated 1363 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:59.422221 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-d513bf99-8a92-4c18-8dba-3ecb4a656c60 req-ba9a5e1a-e838-4a76-92f6-21d8148ccef5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb263540-8e7c-43b1-9fb6-b92afe7ff384", "tag": "ba20c09f-33b9-4c62-bde2-f186305ee1ba"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:36:59.433703 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-d513bf99-8a92-4c18-8dba-3ecb4a656c60 req-ba9a5e1a-e838-4a76-92f6-21d8148ccef5 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:59.434197 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-d513bf99-8a92-4c18-8dba-3ecb4a656c60 req-ba9a5e1a-e838-4a76-92f6-21d8148ccef5 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:59.434639 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-d513bf99-8a92-4c18-8dba-3ecb4a656c60 req-ba9a5e1a-e838-4a76-92f6-21d8148ccef5 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:59.446661 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-d513bf99-8a92-4c18-8dba-3ecb4a656c60 req-ba9a5e1a-e838-4a76-92f6-21d8148ccef5 service nova] Creating event network-changed:ba20c09f-33b9-4c62-bde2-f186305ee1ba for instance fb263540-8e7c-43b1-9fb6-b92afe7ff384 on n-h2-850501-14 Oct 04 19:36:59.451536 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-d513bf99-8a92-4c18-8dba-3ecb4a656c60 req-ba9a5e1a-e838-4a76-92f6-21d8148ccef5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033402 Oct 04 19:36:59.452177 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3775/7536] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:36:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:36:59.658849 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a6a22878-75f8-4777-82d1-f2472838fced tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:59.659685 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a6a22878-75f8-4777-82d1-f2472838fced tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: fb263540-8e7c-43b1-9fb6-b92afe7ff384] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:59.666572 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a6a22878-75f8-4777-82d1-f2472838fced tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:59.667087 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a6a22878-75f8-4777-82d1-f2472838fced tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:59.667549 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a6a22878-75f8-4777-82d1-f2472838fced tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:59.668304 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a6a22878-75f8-4777-82d1-f2472838fced tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:59.668784 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a6a22878-75f8-4777-82d1-f2472838fced tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:59.669232 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a6a22878-75f8-4777-82d1-f2472838fced tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:59.803929 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a6a22878-75f8-4777-82d1-f2472838fced tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:59.811895 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a6a22878-75f8-4777-82d1-f2472838fced tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384" status: 200 len: 1363 microversion: 2.1 time: 0.156920 Oct 04 19:36:59.812588 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3762/7537] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:59 2022] GET /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:37:00.837499 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-26cec5f4-1e49-4566-98e5-e081eb717eb9 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:37:00.838208 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-26cec5f4-1e49-4566-98e5-e081eb717eb9 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: fb263540-8e7c-43b1-9fb6-b92afe7ff384] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:37:00.844565 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-26cec5f4-1e49-4566-98e5-e081eb717eb9 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:37:00.845310 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-26cec5f4-1e49-4566-98e5-e081eb717eb9 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:37:00.845771 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-26cec5f4-1e49-4566-98e5-e081eb717eb9 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:37:00.846967 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-26cec5f4-1e49-4566-98e5-e081eb717eb9 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:37:00.847565 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-26cec5f4-1e49-4566-98e5-e081eb717eb9 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:37:00.847917 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-26cec5f4-1e49-4566-98e5-e081eb717eb9 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:37:00.979936 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-26cec5f4-1e49-4566-98e5-e081eb717eb9 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:37:00.987810 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-26cec5f4-1e49-4566-98e5-e081eb717eb9 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384" status: 200 len: 1363 microversion: 2.1 time: 0.155747 Oct 04 19:37:00.988418 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3776/7538] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:37:00 2022] GET /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:37:02.011007 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2835282c-c0c2-4155-b791-5361746ea9c8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:37:02.011641 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2835282c-c0c2-4155-b791-5361746ea9c8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: fb263540-8e7c-43b1-9fb6-b92afe7ff384] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:37:02.018764 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2835282c-c0c2-4155-b791-5361746ea9c8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:37:02.019263 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2835282c-c0c2-4155-b791-5361746ea9c8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:37:02.019714 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2835282c-c0c2-4155-b791-5361746ea9c8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:37:02.020445 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2835282c-c0c2-4155-b791-5361746ea9c8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:37:02.020917 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2835282c-c0c2-4155-b791-5361746ea9c8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:37:02.021368 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2835282c-c0c2-4155-b791-5361746ea9c8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:37:02.152688 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2835282c-c0c2-4155-b791-5361746ea9c8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:37:02.160788 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2835282c-c0c2-4155-b791-5361746ea9c8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384" status: 200 len: 1363 microversion: 2.1 time: 0.153911 Oct 04 19:37:02.161364 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3763/7539] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:37:02 2022] GET /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:37:03.185604 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e154c344-c9c8-4cc0-8d64-ed7b4ad23ef1 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:37:03.186217 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e154c344-c9c8-4cc0-8d64-ed7b4ad23ef1 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: fb263540-8e7c-43b1-9fb6-b92afe7ff384] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:37:03.193760 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e154c344-c9c8-4cc0-8d64-ed7b4ad23ef1 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:37:03.194252 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e154c344-c9c8-4cc0-8d64-ed7b4ad23ef1 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:37:03.194696 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e154c344-c9c8-4cc0-8d64-ed7b4ad23ef1 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:37:03.195397 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e154c344-c9c8-4cc0-8d64-ed7b4ad23ef1 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:37:03.195860 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e154c344-c9c8-4cc0-8d64-ed7b4ad23ef1 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:37:03.196321 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e154c344-c9c8-4cc0-8d64-ed7b4ad23ef1 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:37:03.325643 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e154c344-c9c8-4cc0-8d64-ed7b4ad23ef1 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:37:03.333603 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e154c344-c9c8-4cc0-8d64-ed7b4ad23ef1 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384" status: 200 len: 1363 microversion: 2.1 time: 0.151966 Oct 04 19:37:03.334185 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3777/7540] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:37:03 2022] GET /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:37:04.357315 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3738bee8-3623-4273-acaa-c732fbaade02 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:37:04.362339 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3738bee8-3623-4273-acaa-c732fbaade02 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: fb263540-8e7c-43b1-9fb6-b92afe7ff384] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:37:04.365415 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3738bee8-3623-4273-acaa-c732fbaade02 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:37:04.365922 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3738bee8-3623-4273-acaa-c732fbaade02 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:37:04.366373 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3738bee8-3623-4273-acaa-c732fbaade02 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:37:04.367084 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3738bee8-3623-4273-acaa-c732fbaade02 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:37:04.367551 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3738bee8-3623-4273-acaa-c732fbaade02 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:37:04.367991 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3738bee8-3623-4273-acaa-c732fbaade02 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:37:04.504424 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3738bee8-3623-4273-acaa-c732fbaade02 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:37:04.512096 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3738bee8-3623-4273-acaa-c732fbaade02 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384" status: 200 len: 1363 microversion: 2.1 time: 0.158834 Oct 04 19:37:04.516092 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3764/7541] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:37:04 2022] GET /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:37:05.537176 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-34923d35-5db1-4efb-8d2f-e70fe13c7fe5 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:37:05.537795 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-34923d35-5db1-4efb-8d2f-e70fe13c7fe5 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: fb263540-8e7c-43b1-9fb6-b92afe7ff384] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:37:05.540629 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:37:05.545500 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-34923d35-5db1-4efb-8d2f-e70fe13c7fe5 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:37:05.545986 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-34923d35-5db1-4efb-8d2f-e70fe13c7fe5 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:37:05.550043 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-34923d35-5db1-4efb-8d2f-e70fe13c7fe5 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:37:05.550043 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-34923d35-5db1-4efb-8d2f-e70fe13c7fe5 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:37:05.550043 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-34923d35-5db1-4efb-8d2f-e70fe13c7fe5 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:37:05.550043 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-34923d35-5db1-4efb-8d2f-e70fe13c7fe5 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:37:05.676928 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-34923d35-5db1-4efb-8d2f-e70fe13c7fe5 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:37:05.684688 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-34923d35-5db1-4efb-8d2f-e70fe13c7fe5 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384" status: 200 len: 1363 microversion: 2.1 time: 0.152298 Oct 04 19:37:05.685263 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3778/7542] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:37:05 2022] GET /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:37:06.628672 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:37:06.629544 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=6 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:37:06.685826 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-c6b762e1-fda1-4a50-b3ff-d7ce7b48e806 req-2ed16d68-61a5-44eb-be66-de4b8dece9b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb263540-8e7c-43b1-9fb6-b92afe7ff384", "name": "network-vif-plugged", "status": "completed", "tag": "ba20c09f-33b9-4c62-bde2-f186305ee1ba"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:37:06.696702 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-c6b762e1-fda1-4a50-b3ff-d7ce7b48e806 req-2ed16d68-61a5-44eb-be66-de4b8dece9b4 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:37:06.697201 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-c6b762e1-fda1-4a50-b3ff-d7ce7b48e806 req-2ed16d68-61a5-44eb-be66-de4b8dece9b4 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:37:06.697647 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-c6b762e1-fda1-4a50-b3ff-d7ce7b48e806 req-2ed16d68-61a5-44eb-be66-de4b8dece9b4 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:37:06.708808 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6bb047cf-b1cb-4e89-bdaa-5c805e7d2da5 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:37:06.709946 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6bb047cf-b1cb-4e89-bdaa-5c805e7d2da5 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: fb263540-8e7c-43b1-9fb6-b92afe7ff384] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:37:06.710161 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-c6b762e1-fda1-4a50-b3ff-d7ce7b48e806 req-2ed16d68-61a5-44eb-be66-de4b8dece9b4 service nova] Creating event network-vif-plugged:ba20c09f-33b9-4c62-bde2-f186305ee1ba for instance fb263540-8e7c-43b1-9fb6-b92afe7ff384 on n-h2-850501-14 Oct 04 19:37:06.716409 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-c6b762e1-fda1-4a50-b3ff-d7ce7b48e806 req-2ed16d68-61a5-44eb-be66-de4b8dece9b4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092597 Oct 04 19:37:06.716409 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3765/7543] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:37:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:37:06.718473 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6bb047cf-b1cb-4e89-bdaa-5c805e7d2da5 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:37:06.718798 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6bb047cf-b1cb-4e89-bdaa-5c805e7d2da5 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:37:06.719374 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6bb047cf-b1cb-4e89-bdaa-5c805e7d2da5 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:37:06.720639 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6bb047cf-b1cb-4e89-bdaa-5c805e7d2da5 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:37:06.721099 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6bb047cf-b1cb-4e89-bdaa-5c805e7d2da5 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:37:06.722124 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6bb047cf-b1cb-4e89-bdaa-5c805e7d2da5 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:37:07.210594 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6bb047cf-b1cb-4e89-bdaa-5c805e7d2da5 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:37:07.218537 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6bb047cf-b1cb-4e89-bdaa-5c805e7d2da5 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384" status: 200 len: 1363 microversion: 2.1 time: 0.514389 Oct 04 19:37:07.219117 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3779/7544] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:37:06 2022] GET /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384 => generated 1363 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:37:08.244848 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2e1cdb12-504f-4d71-bfd5-3a05bfe74ef1 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:37:08.245560 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2e1cdb12-504f-4d71-bfd5-3a05bfe74ef1 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: fb263540-8e7c-43b1-9fb6-b92afe7ff384] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:37:08.252094 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e1cdb12-504f-4d71-bfd5-3a05bfe74ef1 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:37:08.252618 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e1cdb12-504f-4d71-bfd5-3a05bfe74ef1 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:37:08.253595 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e1cdb12-504f-4d71-bfd5-3a05bfe74ef1 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:37:08.254534 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e1cdb12-504f-4d71-bfd5-3a05bfe74ef1 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:37:08.255049 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e1cdb12-504f-4d71-bfd5-3a05bfe74ef1 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:37:08.255566 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e1cdb12-504f-4d71-bfd5-3a05bfe74ef1 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:37:08.391489 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2e1cdb12-504f-4d71-bfd5-3a05bfe74ef1 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:37:08.399725 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2e1cdb12-504f-4d71-bfd5-3a05bfe74ef1 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384" status: 200 len: 1363 microversion: 2.1 time: 0.160075 Oct 04 19:37:08.400337 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3766/7545] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:37:08 2022] GET /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:37:09.423351 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1f1443c2-ae9b-4d72-a344-448aed4cc741 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:37:09.423969 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1f1443c2-ae9b-4d72-a344-448aed4cc741 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: fb263540-8e7c-43b1-9fb6-b92afe7ff384] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:37:09.431352 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1f1443c2-ae9b-4d72-a344-448aed4cc741 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:37:09.431838 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1f1443c2-ae9b-4d72-a344-448aed4cc741 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:37:09.432307 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1f1443c2-ae9b-4d72-a344-448aed4cc741 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:37:09.433009 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1f1443c2-ae9b-4d72-a344-448aed4cc741 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:37:09.433469 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1f1443c2-ae9b-4d72-a344-448aed4cc741 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:37:09.433897 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1f1443c2-ae9b-4d72-a344-448aed4cc741 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:37:09.568523 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1f1443c2-ae9b-4d72-a344-448aed4cc741 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:37:09.576332 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1f1443c2-ae9b-4d72-a344-448aed4cc741 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384" status: 200 len: 1549 microversion: 2.1 time: 0.156977 Oct 04 19:37:09.576902 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3780/7546] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:37:09 2022] GET /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384 => generated 1549 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:37:09.600714 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-828064a4-4014-41f5-9e32-aade8fb1c540 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:37:09.601253 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-828064a4-4014-41f5-9e32-aade8fb1c540 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: fb263540-8e7c-43b1-9fb6-b92afe7ff384] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:37:09.608635 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-828064a4-4014-41f5-9e32-aade8fb1c540 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:37:09.609140 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-828064a4-4014-41f5-9e32-aade8fb1c540 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:37:09.609610 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-828064a4-4014-41f5-9e32-aade8fb1c540 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:37:09.610307 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-828064a4-4014-41f5-9e32-aade8fb1c540 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:37:09.610779 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-828064a4-4014-41f5-9e32-aade8fb1c540 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:37:09.611222 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-828064a4-4014-41f5-9e32-aade8fb1c540 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:37:09.687851 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-828064a4-4014-41f5-9e32-aade8fb1c540 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091739 Oct 04 19:37:09.688514 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3767/7547] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Oct 4 19:37:09 2022] GET /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:37:10.974582 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-eac24c9e-b032-4380-ba42-8fc255199625 req-eff429d6-fb9b-4817-882e-906f81251c03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb263540-8e7c-43b1-9fb6-b92afe7ff384", "tag": "ba20c09f-33b9-4c62-bde2-f186305ee1ba"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:37:10.985210 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-eac24c9e-b032-4380-ba42-8fc255199625 req-eff429d6-fb9b-4817-882e-906f81251c03 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:37:10.985849 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-eac24c9e-b032-4380-ba42-8fc255199625 req-eff429d6-fb9b-4817-882e-906f81251c03 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:37:10.986291 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-eac24c9e-b032-4380-ba42-8fc255199625 req-eff429d6-fb9b-4817-882e-906f81251c03 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:37:10.998110 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-eac24c9e-b032-4380-ba42-8fc255199625 req-eff429d6-fb9b-4817-882e-906f81251c03 service nova] Creating event network-changed:ba20c09f-33b9-4c62-bde2-f186305ee1ba for instance fb263540-8e7c-43b1-9fb6-b92afe7ff384 on n-h2-850501-14 Oct 04 19:37:11.003238 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-eac24c9e-b032-4380-ba42-8fc255199625 req-eff429d6-fb9b-4817-882e-906f81251c03 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033565 Oct 04 19:37:11.003850 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3781/7548] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:37:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:38:24.214368 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:38:24.215173 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=74 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:38:24.219584 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0a382894-49a6-4c92-adb0-639be6836ded tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:38:24.225905 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0a382894-49a6-4c92-adb0-639be6836ded tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:24.226404 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0a382894-49a6-4c92-adb0-639be6836ded tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:24.226861 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0a382894-49a6-4c92-adb0-639be6836ded tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:24.249873 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0a382894-49a6-4c92-adb0-639be6836ded tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: fb263540-8e7c-43b1-9fb6-b92afe7ff384] Going to try to stop instance {{(pid=123002) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 19:38:24.378892 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0a382894-49a6-4c92-adb0-639be6836ded tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "POST /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384/action" status: 202 len: 0 microversion: 2.1 time: 0.167521 Oct 04 19:38:24.379563 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3768/7549] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 19:38:24 2022] POST /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384/action => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:38:24.389366 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:38:24.392610 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:38:24.392610 n-d-850501-14 devstack@n-api.service[123001]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:38:24.392610 n-d-850501-14 devstack@n-api.service[123001]: Tue Oct 4 19:38:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384 (ip 10.222.0.20) !!! Oct 04 19:38:24.405496 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-cfbb27d4-3ba4-4283-ab9b-0c4cd92194ed tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:24.406212 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-cfbb27d4-3ba4-4283-ab9b-0c4cd92194ed tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: fb263540-8e7c-43b1-9fb6-b92afe7ff384] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:24.414950 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cfbb27d4-3ba4-4283-ab9b-0c4cd92194ed tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:24.417180 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cfbb27d4-3ba4-4283-ab9b-0c4cd92194ed tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:24.417180 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cfbb27d4-3ba4-4283-ab9b-0c4cd92194ed tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:24.417180 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cfbb27d4-3ba4-4283-ab9b-0c4cd92194ed tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:24.417180 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cfbb27d4-3ba4-4283-ab9b-0c4cd92194ed tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:24.417599 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cfbb27d4-3ba4-4283-ab9b-0c4cd92194ed tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:24.549024 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-cfbb27d4-3ba4-4283-ab9b-0c4cd92194ed tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:24.556896 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-cfbb27d4-3ba4-4283-ab9b-0c4cd92194ed tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384" status: 200 len: 1678 microversion: 2.1 time: 0.171329 Oct 04 19:38:24.557480 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3782/7550] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:24 2022] GET /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384 => generated 1678 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:25.584789 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-89ed43de-9a3d-4f45-9cde-7f55a471a06b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:25.585532 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-89ed43de-9a3d-4f45-9cde-7f55a471a06b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: fb263540-8e7c-43b1-9fb6-b92afe7ff384] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:25.592726 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-89ed43de-9a3d-4f45-9cde-7f55a471a06b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:25.593219 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-89ed43de-9a3d-4f45-9cde-7f55a471a06b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:25.593666 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-89ed43de-9a3d-4f45-9cde-7f55a471a06b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:25.594361 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-89ed43de-9a3d-4f45-9cde-7f55a471a06b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:25.594825 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-89ed43de-9a3d-4f45-9cde-7f55a471a06b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:25.595263 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-89ed43de-9a3d-4f45-9cde-7f55a471a06b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:25.730040 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-89ed43de-9a3d-4f45-9cde-7f55a471a06b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:25.737741 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-89ed43de-9a3d-4f45-9cde-7f55a471a06b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384" status: 200 len: 1678 microversion: 2.1 time: 0.158321 Oct 04 19:38:25.738312 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3769/7551] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:25 2022] GET /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:26.762537 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-eff5d805-7a47-4f8d-ba5d-4ea969804d24 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:26.763047 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-eff5d805-7a47-4f8d-ba5d-4ea969804d24 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: fb263540-8e7c-43b1-9fb6-b92afe7ff384] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:26.770538 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eff5d805-7a47-4f8d-ba5d-4ea969804d24 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:26.771029 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eff5d805-7a47-4f8d-ba5d-4ea969804d24 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:26.771470 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eff5d805-7a47-4f8d-ba5d-4ea969804d24 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:26.772195 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eff5d805-7a47-4f8d-ba5d-4ea969804d24 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:26.772660 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eff5d805-7a47-4f8d-ba5d-4ea969804d24 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:26.773100 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eff5d805-7a47-4f8d-ba5d-4ea969804d24 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:26.906027 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-eff5d805-7a47-4f8d-ba5d-4ea969804d24 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:26.913756 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-eff5d805-7a47-4f8d-ba5d-4ea969804d24 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384" status: 200 len: 1678 microversion: 2.1 time: 0.155982 Oct 04 19:38:26.914344 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3783/7552] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:26 2022] GET /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:27.938077 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-01a2e17b-7059-4359-acae-66079e01981b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:27.938737 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-01a2e17b-7059-4359-acae-66079e01981b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: fb263540-8e7c-43b1-9fb6-b92afe7ff384] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:27.945649 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-01a2e17b-7059-4359-acae-66079e01981b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:27.946696 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-01a2e17b-7059-4359-acae-66079e01981b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:27.947156 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-01a2e17b-7059-4359-acae-66079e01981b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:27.947890 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-01a2e17b-7059-4359-acae-66079e01981b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:27.948395 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-01a2e17b-7059-4359-acae-66079e01981b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:27.948841 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-01a2e17b-7059-4359-acae-66079e01981b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:28.086739 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-01a2e17b-7059-4359-acae-66079e01981b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:28.097696 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-01a2e17b-7059-4359-acae-66079e01981b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384" status: 200 len: 1678 microversion: 2.1 time: 0.163303 Oct 04 19:38:28.098740 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3770/7553] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:27 2022] GET /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384 => generated 1678 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:29.122926 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0a457eb0-d4b9-4db9-9c9b-8b4067745145 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:29.123576 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0a457eb0-d4b9-4db9-9c9b-8b4067745145 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: fb263540-8e7c-43b1-9fb6-b92afe7ff384] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:29.130474 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0a457eb0-d4b9-4db9-9c9b-8b4067745145 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:29.130952 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0a457eb0-d4b9-4db9-9c9b-8b4067745145 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:29.131385 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0a457eb0-d4b9-4db9-9c9b-8b4067745145 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:29.132082 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0a457eb0-d4b9-4db9-9c9b-8b4067745145 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:29.132547 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0a457eb0-d4b9-4db9-9c9b-8b4067745145 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:29.132970 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0a457eb0-d4b9-4db9-9c9b-8b4067745145 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:29.261648 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0a457eb0-d4b9-4db9-9c9b-8b4067745145 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:29.269383 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0a457eb0-d4b9-4db9-9c9b-8b4067745145 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384" status: 200 len: 1678 microversion: 2.1 time: 0.150480 Oct 04 19:38:29.269964 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3784/7554] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:29 2022] GET /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384 => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:30.293651 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b14884e5-9715-47a9-8af8-611a6af0fb52 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:30.294273 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b14884e5-9715-47a9-8af8-611a6af0fb52 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: fb263540-8e7c-43b1-9fb6-b92afe7ff384] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:30.301061 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b14884e5-9715-47a9-8af8-611a6af0fb52 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:30.301552 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b14884e5-9715-47a9-8af8-611a6af0fb52 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:30.301996 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b14884e5-9715-47a9-8af8-611a6af0fb52 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:30.302694 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b14884e5-9715-47a9-8af8-611a6af0fb52 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:30.303157 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b14884e5-9715-47a9-8af8-611a6af0fb52 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:30.303592 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b14884e5-9715-47a9-8af8-611a6af0fb52 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:30.433980 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b14884e5-9715-47a9-8af8-611a6af0fb52 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:30.442121 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b14884e5-9715-47a9-8af8-611a6af0fb52 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384" status: 200 len: 1678 microversion: 2.1 time: 0.153156 Oct 04 19:38:30.442721 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3771/7555] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:30 2022] GET /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:31.466132 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-49ed4865-0ab5-4a36-8b74-a6ee469d845b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:31.466752 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-49ed4865-0ab5-4a36-8b74-a6ee469d845b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: fb263540-8e7c-43b1-9fb6-b92afe7ff384] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:31.473847 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-49ed4865-0ab5-4a36-8b74-a6ee469d845b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:31.474334 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-49ed4865-0ab5-4a36-8b74-a6ee469d845b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:31.475362 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-49ed4865-0ab5-4a36-8b74-a6ee469d845b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:31.476087 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-49ed4865-0ab5-4a36-8b74-a6ee469d845b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:31.476550 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-49ed4865-0ab5-4a36-8b74-a6ee469d845b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:31.477448 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-49ed4865-0ab5-4a36-8b74-a6ee469d845b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:31.619770 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-49ed4865-0ab5-4a36-8b74-a6ee469d845b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:31.627850 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-49ed4865-0ab5-4a36-8b74-a6ee469d845b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384" status: 200 len: 1678 microversion: 2.1 time: 0.165683 Oct 04 19:38:31.628449 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3785/7556] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:31 2022] GET /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384 => generated 1678 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:32.652731 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-02d54422-5436-4879-acb1-1c6c320d5fa5 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:32.653373 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-02d54422-5436-4879-acb1-1c6c320d5fa5 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: fb263540-8e7c-43b1-9fb6-b92afe7ff384] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:32.660289 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-02d54422-5436-4879-acb1-1c6c320d5fa5 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:32.660793 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-02d54422-5436-4879-acb1-1c6c320d5fa5 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:32.661256 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-02d54422-5436-4879-acb1-1c6c320d5fa5 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:32.661969 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-02d54422-5436-4879-acb1-1c6c320d5fa5 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:32.662443 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-02d54422-5436-4879-acb1-1c6c320d5fa5 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:32.662889 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-02d54422-5436-4879-acb1-1c6c320d5fa5 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:32.792527 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-02d54422-5436-4879-acb1-1c6c320d5fa5 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:32.800515 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-02d54422-5436-4879-acb1-1c6c320d5fa5 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384" status: 200 len: 1678 microversion: 2.1 time: 0.151680 Oct 04 19:38:32.801101 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3772/7557] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:32 2022] GET /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:33.827738 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-64460d22-08ca-4cf1-b5fd-efd5c38bc99b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:33.828309 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-64460d22-08ca-4cf1-b5fd-efd5c38bc99b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: fb263540-8e7c-43b1-9fb6-b92afe7ff384] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:33.835223 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-64460d22-08ca-4cf1-b5fd-efd5c38bc99b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:33.835712 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-64460d22-08ca-4cf1-b5fd-efd5c38bc99b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:33.836351 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-64460d22-08ca-4cf1-b5fd-efd5c38bc99b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:33.837088 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-64460d22-08ca-4cf1-b5fd-efd5c38bc99b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:33.837560 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-64460d22-08ca-4cf1-b5fd-efd5c38bc99b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:33.837997 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-64460d22-08ca-4cf1-b5fd-efd5c38bc99b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:33.971627 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-64460d22-08ca-4cf1-b5fd-efd5c38bc99b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:33.980269 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-64460d22-08ca-4cf1-b5fd-efd5c38bc99b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384" status: 200 len: 1678 microversion: 2.1 time: 0.156566 Oct 04 19:38:33.980859 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3786/7558] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:33 2022] GET /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:35.004574 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7af00f1a-82c4-4b76-b403-b6606f8fd202 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:35.005238 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7af00f1a-82c4-4b76-b403-b6606f8fd202 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: fb263540-8e7c-43b1-9fb6-b92afe7ff384] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:35.008517 n-d-850501-14 devstack@n-api.service[123002]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:38:35.011431 n-d-850501-14 devstack@n-api.service[123002]: Tue Oct 4 19:38:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384 (ip 10.222.0.20) !!! Oct 04 19:38:35.015600 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7af00f1a-82c4-4b76-b403-b6606f8fd202 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:35.016156 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7af00f1a-82c4-4b76-b403-b6606f8fd202 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:35.016604 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7af00f1a-82c4-4b76-b403-b6606f8fd202 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:35.017329 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7af00f1a-82c4-4b76-b403-b6606f8fd202 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:35.017811 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7af00f1a-82c4-4b76-b403-b6606f8fd202 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:35.018314 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7af00f1a-82c4-4b76-b403-b6606f8fd202 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:35.154311 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7af00f1a-82c4-4b76-b403-b6606f8fd202 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:35.162099 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7af00f1a-82c4-4b76-b403-b6606f8fd202 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384" status: 200 len: 1678 microversion: 2.1 time: 0.161536 Oct 04 19:38:35.162681 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3773/7559] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:34 2022] GET /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384 => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:36.186358 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-cb6b7634-7be7-43c2-a758-943dba6d5146 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:36.186978 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-cb6b7634-7be7-43c2-a758-943dba6d5146 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: fb263540-8e7c-43b1-9fb6-b92afe7ff384] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:36.194550 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cb6b7634-7be7-43c2-a758-943dba6d5146 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:36.195081 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cb6b7634-7be7-43c2-a758-943dba6d5146 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:36.196202 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cb6b7634-7be7-43c2-a758-943dba6d5146 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:36.196989 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cb6b7634-7be7-43c2-a758-943dba6d5146 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:36.197487 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cb6b7634-7be7-43c2-a758-943dba6d5146 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:36.197915 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cb6b7634-7be7-43c2-a758-943dba6d5146 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:36.328833 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-cb6b7634-7be7-43c2-a758-943dba6d5146 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:36.336709 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-cb6b7634-7be7-43c2-a758-943dba6d5146 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384" status: 200 len: 1655 microversion: 2.1 time: 0.154347 Oct 04 19:38:36.337285 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3787/7560] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:36 2022] GET /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384 => generated 1655 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:36.360878 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8d2d899b-078f-4f28-9d03-525afe47c616 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:38:36.363274 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8d2d899b-078f-4f28-9d03-525afe47c616 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: fb263540-8e7c-43b1-9fb6-b92afe7ff384] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:36.371277 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8d2d899b-078f-4f28-9d03-525afe47c616 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:36.371840 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8d2d899b-078f-4f28-9d03-525afe47c616 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:36.372327 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8d2d899b-078f-4f28-9d03-525afe47c616 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:36.373102 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8d2d899b-078f-4f28-9d03-525afe47c616 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:36.373617 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8d2d899b-078f-4f28-9d03-525afe47c616 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:36.374072 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8d2d899b-078f-4f28-9d03-525afe47c616 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:36.403512 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8d2d899b-078f-4f28-9d03-525afe47c616 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:36.408979 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8d2d899b-078f-4f28-9d03-525afe47c616 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: fb263540-8e7c-43b1-9fb6-b92afe7ff384] Old instance type m1.heat2, new instance type m1.heat {{(pid=123002) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 19:38:36.416470 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-8d2d899b-078f-4f28-9d03-525afe47c616 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:38:36.416909 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-8d2d899b-078f-4f28-9d03-525afe47c616 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:38:36.417407 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-8d2d899b-078f-4f28-9d03-525afe47c616 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:38:36.417834 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-8d2d899b-078f-4f28-9d03-525afe47c616 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:38:36.418261 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-8d2d899b-078f-4f28-9d03-525afe47c616 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:38:36.596550 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8d2d899b-078f-4f28-9d03-525afe47c616 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "POST /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384/action" status: 202 len: 0 microversion: 2.1 time: 0.239639 Oct 04 19:38:36.597092 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3774/7561] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 19:38:36 2022] POST /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384/action => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:38:36.607466 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b2a7c98c-7bfd-42db-999f-7336936f4b24 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:36.608397 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b2a7c98c-7bfd-42db-999f-7336936f4b24 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: fb263540-8e7c-43b1-9fb6-b92afe7ff384] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:36.614631 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b2a7c98c-7bfd-42db-999f-7336936f4b24 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:36.615169 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b2a7c98c-7bfd-42db-999f-7336936f4b24 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:36.615707 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b2a7c98c-7bfd-42db-999f-7336936f4b24 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:36.616515 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b2a7c98c-7bfd-42db-999f-7336936f4b24 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:36.617000 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b2a7c98c-7bfd-42db-999f-7336936f4b24 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:36.618228 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b2a7c98c-7bfd-42db-999f-7336936f4b24 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:36.755957 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b2a7c98c-7bfd-42db-999f-7336936f4b24 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:36.764328 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b2a7c98c-7bfd-42db-999f-7336936f4b24 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384" status: 200 len: 1678 microversion: 2.1 time: 0.161158 Oct 04 19:38:36.764992 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3788/7562] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:36 2022] GET /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384 => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:37.790066 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-be25eaf9-3876-4c7f-9c89-6cd4031adc5e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:37.790699 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-be25eaf9-3876-4c7f-9c89-6cd4031adc5e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: fb263540-8e7c-43b1-9fb6-b92afe7ff384] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:37.797670 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-be25eaf9-3876-4c7f-9c89-6cd4031adc5e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:37.798170 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-be25eaf9-3876-4c7f-9c89-6cd4031adc5e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:37.798618 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-be25eaf9-3876-4c7f-9c89-6cd4031adc5e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:37.799319 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-be25eaf9-3876-4c7f-9c89-6cd4031adc5e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:37.799783 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-be25eaf9-3876-4c7f-9c89-6cd4031adc5e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:37.800247 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-be25eaf9-3876-4c7f-9c89-6cd4031adc5e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:37.938417 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-be25eaf9-3876-4c7f-9c89-6cd4031adc5e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:37.946522 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-be25eaf9-3876-4c7f-9c89-6cd4031adc5e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384" status: 200 len: 1678 microversion: 2.1 time: 0.161905 Oct 04 19:38:37.947161 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3775/7563] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:37 2022] GET /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384 => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:38.970364 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-57a847f9-430e-4af0-958c-cc9fb9ac8e36 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:38.971242 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-57a847f9-430e-4af0-958c-cc9fb9ac8e36 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: fb263540-8e7c-43b1-9fb6-b92afe7ff384] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:38.979930 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-57a847f9-430e-4af0-958c-cc9fb9ac8e36 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:38.980474 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-57a847f9-430e-4af0-958c-cc9fb9ac8e36 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:38.980919 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-57a847f9-430e-4af0-958c-cc9fb9ac8e36 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:38.981666 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-57a847f9-430e-4af0-958c-cc9fb9ac8e36 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:38.982144 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-57a847f9-430e-4af0-958c-cc9fb9ac8e36 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:38.982571 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-57a847f9-430e-4af0-958c-cc9fb9ac8e36 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:39.123902 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-57a847f9-430e-4af0-958c-cc9fb9ac8e36 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:39.131921 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-57a847f9-430e-4af0-958c-cc9fb9ac8e36 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384" status: 200 len: 1678 microversion: 2.1 time: 0.165505 Oct 04 19:38:39.132596 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3789/7564] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:38 2022] GET /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384 => generated 1678 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:40.158318 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0fe40dca-4a34-43da-bbbb-0108f8563104 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:40.158957 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0fe40dca-4a34-43da-bbbb-0108f8563104 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: fb263540-8e7c-43b1-9fb6-b92afe7ff384] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:40.165858 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0fe40dca-4a34-43da-bbbb-0108f8563104 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:40.166357 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0fe40dca-4a34-43da-bbbb-0108f8563104 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:40.166812 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0fe40dca-4a34-43da-bbbb-0108f8563104 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:40.167512 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0fe40dca-4a34-43da-bbbb-0108f8563104 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:40.167984 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0fe40dca-4a34-43da-bbbb-0108f8563104 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:40.168451 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0fe40dca-4a34-43da-bbbb-0108f8563104 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:40.298821 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0fe40dca-4a34-43da-bbbb-0108f8563104 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:40.306688 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0fe40dca-4a34-43da-bbbb-0108f8563104 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384" status: 200 len: 1683 microversion: 2.1 time: 0.152320 Oct 04 19:38:40.307275 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3776/7565] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:40 2022] GET /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384 => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:41.330923 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e77065ae-4b4e-4d40-a347-5809e773973f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:41.331544 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e77065ae-4b4e-4d40-a347-5809e773973f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: fb263540-8e7c-43b1-9fb6-b92afe7ff384] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:41.338532 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e77065ae-4b4e-4d40-a347-5809e773973f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:41.339020 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e77065ae-4b4e-4d40-a347-5809e773973f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:41.339461 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e77065ae-4b4e-4d40-a347-5809e773973f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:41.340186 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e77065ae-4b4e-4d40-a347-5809e773973f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:41.340649 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e77065ae-4b4e-4d40-a347-5809e773973f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:41.341077 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e77065ae-4b4e-4d40-a347-5809e773973f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:41.493395 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e77065ae-4b4e-4d40-a347-5809e773973f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:41.497395 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e77065ae-4b4e-4d40-a347-5809e773973f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384" status: 200 len: 1683 microversion: 2.1 time: 0.170397 Oct 04 19:38:41.497981 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3790/7566] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:41 2022] GET /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384 => generated 1683 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:42.527126 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-04581b29-1576-4a16-a767-825ef04322ac tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:42.527756 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-04581b29-1576-4a16-a767-825ef04322ac tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: fb263540-8e7c-43b1-9fb6-b92afe7ff384] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:42.535265 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-04581b29-1576-4a16-a767-825ef04322ac tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:42.537138 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-04581b29-1576-4a16-a767-825ef04322ac tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:42.537138 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-04581b29-1576-4a16-a767-825ef04322ac tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:42.537359 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-04581b29-1576-4a16-a767-825ef04322ac tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:42.537836 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-04581b29-1576-4a16-a767-825ef04322ac tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:42.538282 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-04581b29-1576-4a16-a767-825ef04322ac tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:42.738347 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-04581b29-1576-4a16-a767-825ef04322ac tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:42.747149 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-04581b29-1576-4a16-a767-825ef04322ac tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384" status: 200 len: 1682 microversion: 2.1 time: 0.225266 Oct 04 19:38:42.747830 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3777/7567] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:42 2022] GET /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384 => generated 1682 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:42.753698 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-8d55c47b-f786-452d-9900-9229169bd9c7 req-cbc89600-7ec3-4d85-bd39-6b8a683a809c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb263540-8e7c-43b1-9fb6-b92afe7ff384", "name": "network-vif-unplugged", "status": "completed", "tag": "ba20c09f-33b9-4c62-bde2-f186305ee1ba"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:38:42.764007 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-8d55c47b-f786-452d-9900-9229169bd9c7 req-cbc89600-7ec3-4d85-bd39-6b8a683a809c service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:42.764660 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-8d55c47b-f786-452d-9900-9229169bd9c7 req-cbc89600-7ec3-4d85-bd39-6b8a683a809c service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:42.766125 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-8d55c47b-f786-452d-9900-9229169bd9c7 req-cbc89600-7ec3-4d85-bd39-6b8a683a809c service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:42.777068 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-8d55c47b-f786-452d-9900-9229169bd9c7 req-cbc89600-7ec3-4d85-bd39-6b8a683a809c service nova] Creating event network-vif-unplugged:ba20c09f-33b9-4c62-bde2-f186305ee1ba for instance fb263540-8e7c-43b1-9fb6-b92afe7ff384 on n-h1-850501-14 Oct 04 19:38:42.782526 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [req-8d55c47b-f786-452d-9900-9229169bd9c7 req-cbc89600-7ec3-4d85-bd39-6b8a683a809c service nova] Instance fb263540-8e7c-43b1-9fb6-b92afe7ff384 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850501-14', 'n-h2-850501-14'} {{(pid=123001) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:38:42.793628 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-8d55c47b-f786-452d-9900-9229169bd9c7 req-cbc89600-7ec3-4d85-bd39-6b8a683a809c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.106597 Oct 04 19:38:42.794222 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3791/7568] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:38:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:38:43.781225 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3a238356-07f7-453f-b1c7-556bf43d21b7 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:43.781861 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3a238356-07f7-453f-b1c7-556bf43d21b7 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: fb263540-8e7c-43b1-9fb6-b92afe7ff384] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:43.789554 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3a238356-07f7-453f-b1c7-556bf43d21b7 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:43.790479 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3a238356-07f7-453f-b1c7-556bf43d21b7 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:43.790936 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3a238356-07f7-453f-b1c7-556bf43d21b7 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:43.791667 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3a238356-07f7-453f-b1c7-556bf43d21b7 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:43.792163 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3a238356-07f7-453f-b1c7-556bf43d21b7 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:43.792612 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3a238356-07f7-453f-b1c7-556bf43d21b7 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:44.001990 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3a238356-07f7-453f-b1c7-556bf43d21b7 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:44.009926 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3a238356-07f7-453f-b1c7-556bf43d21b7 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384" status: 200 len: 1682 microversion: 2.1 time: 0.232716 Oct 04 19:38:44.010520 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3778/7569] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:43 2022] GET /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384 => generated 1682 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:44.810659 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-b9d93ffd-de62-4ab3-bb86-909377a0c353 req-fd6adb19-709d-4b33-bc26-8d1eaf3499df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb263540-8e7c-43b1-9fb6-b92afe7ff384", "tag": "ba20c09f-33b9-4c62-bde2-f186305ee1ba"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:38:44.820147 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-b9d93ffd-de62-4ab3-bb86-909377a0c353 req-fd6adb19-709d-4b33-bc26-8d1eaf3499df service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:44.820641 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-b9d93ffd-de62-4ab3-bb86-909377a0c353 req-fd6adb19-709d-4b33-bc26-8d1eaf3499df service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:44.821078 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-b9d93ffd-de62-4ab3-bb86-909377a0c353 req-fd6adb19-709d-4b33-bc26-8d1eaf3499df service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:44.832615 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-b9d93ffd-de62-4ab3-bb86-909377a0c353 req-fd6adb19-709d-4b33-bc26-8d1eaf3499df service nova] Creating event network-changed:ba20c09f-33b9-4c62-bde2-f186305ee1ba for instance fb263540-8e7c-43b1-9fb6-b92afe7ff384 on n-h1-850501-14 Oct 04 19:38:44.838124 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [req-b9d93ffd-de62-4ab3-bb86-909377a0c353 req-fd6adb19-709d-4b33-bc26-8d1eaf3499df service nova] Instance fb263540-8e7c-43b1-9fb6-b92afe7ff384 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850501-14', 'n-h2-850501-14'} {{(pid=123001) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:38:44.849278 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-b9d93ffd-de62-4ab3-bb86-909377a0c353 req-fd6adb19-709d-4b33-bc26-8d1eaf3499df service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043439 Oct 04 19:38:44.849959 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3792/7570] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:38:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:38:45.033489 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9862d2d7-d9cb-4ccf-b17a-2cd6982987a3 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:45.034129 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9862d2d7-d9cb-4ccf-b17a-2cd6982987a3 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: fb263540-8e7c-43b1-9fb6-b92afe7ff384] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:45.042215 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9862d2d7-d9cb-4ccf-b17a-2cd6982987a3 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:45.042717 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9862d2d7-d9cb-4ccf-b17a-2cd6982987a3 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:45.043176 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9862d2d7-d9cb-4ccf-b17a-2cd6982987a3 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:45.043894 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9862d2d7-d9cb-4ccf-b17a-2cd6982987a3 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:45.044520 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9862d2d7-d9cb-4ccf-b17a-2cd6982987a3 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:45.044973 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9862d2d7-d9cb-4ccf-b17a-2cd6982987a3 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:45.176737 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9862d2d7-d9cb-4ccf-b17a-2cd6982987a3 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:45.184840 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9862d2d7-d9cb-4ccf-b17a-2cd6982987a3 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384" status: 200 len: 1680 microversion: 2.1 time: 0.155375 Oct 04 19:38:45.185429 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3779/7571] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:45 2022] GET /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:46.211240 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6ea9aadf-f17f-470c-8a51-256ae39a961b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:46.212809 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6ea9aadf-f17f-470c-8a51-256ae39a961b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: fb263540-8e7c-43b1-9fb6-b92afe7ff384] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:46.218922 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6ea9aadf-f17f-470c-8a51-256ae39a961b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:46.219409 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6ea9aadf-f17f-470c-8a51-256ae39a961b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:46.219846 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6ea9aadf-f17f-470c-8a51-256ae39a961b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:46.220842 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6ea9aadf-f17f-470c-8a51-256ae39a961b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:46.221296 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6ea9aadf-f17f-470c-8a51-256ae39a961b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:46.221755 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6ea9aadf-f17f-470c-8a51-256ae39a961b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:46.423875 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6ea9aadf-f17f-470c-8a51-256ae39a961b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:46.434525 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6ea9aadf-f17f-470c-8a51-256ae39a961b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384" status: 200 len: 1676 microversion: 2.1 time: 0.229249 Oct 04 19:38:46.437493 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3793/7572] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:46 2022] GET /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384 => generated 1676 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:46.457466 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4f01de1c-49db-4547-9ea7-a45a67d58e78 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:38:46.458025 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4f01de1c-49db-4547-9ea7-a45a67d58e78 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: fb263540-8e7c-43b1-9fb6-b92afe7ff384] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:46.470031 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4f01de1c-49db-4547-9ea7-a45a67d58e78 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:46.470031 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4f01de1c-49db-4547-9ea7-a45a67d58e78 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:46.470031 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4f01de1c-49db-4547-9ea7-a45a67d58e78 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:46.470031 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4f01de1c-49db-4547-9ea7-a45a67d58e78 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:46.470031 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4f01de1c-49db-4547-9ea7-a45a67d58e78 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:46.470031 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4f01de1c-49db-4547-9ea7-a45a67d58e78 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:46.643333 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4f01de1c-49db-4547-9ea7-a45a67d58e78 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "POST /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384/action" status: 204 len: 0 microversion: 2.1 time: 0.189772 Oct 04 19:38:46.644037 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3780/7573] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 19:38:46 2022] POST /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384/action => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:38:46.654528 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ab389613-26ab-45ca-b4d1-10db289789c8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:46.655182 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ab389613-26ab-45ca-b4d1-10db289789c8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: fb263540-8e7c-43b1-9fb6-b92afe7ff384] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:46.661281 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ab389613-26ab-45ca-b4d1-10db289789c8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:46.661768 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ab389613-26ab-45ca-b4d1-10db289789c8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:46.662206 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ab389613-26ab-45ca-b4d1-10db289789c8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:46.662904 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ab389613-26ab-45ca-b4d1-10db289789c8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:46.663374 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ab389613-26ab-45ca-b4d1-10db289789c8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:46.664947 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ab389613-26ab-45ca-b4d1-10db289789c8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:46.803077 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ab389613-26ab-45ca-b4d1-10db289789c8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:46.811300 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ab389613-26ab-45ca-b4d1-10db289789c8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384" status: 200 len: 1676 microversion: 2.1 time: 0.161907 Oct 04 19:38:46.811898 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3794/7574] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:46 2022] GET /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384 => generated 1676 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:47.838124 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9e61a9a3-9b57-4afc-aaec-757c682fb611 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:47.838850 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9e61a9a3-9b57-4afc-aaec-757c682fb611 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: fb263540-8e7c-43b1-9fb6-b92afe7ff384] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:47.846222 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9e61a9a3-9b57-4afc-aaec-757c682fb611 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:47.846721 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9e61a9a3-9b57-4afc-aaec-757c682fb611 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:47.847171 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9e61a9a3-9b57-4afc-aaec-757c682fb611 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:47.847885 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9e61a9a3-9b57-4afc-aaec-757c682fb611 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:47.848386 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9e61a9a3-9b57-4afc-aaec-757c682fb611 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:47.848829 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9e61a9a3-9b57-4afc-aaec-757c682fb611 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:47.853474 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:38:48.021565 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9e61a9a3-9b57-4afc-aaec-757c682fb611 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:48.021565 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9e61a9a3-9b57-4afc-aaec-757c682fb611 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384" status: 200 len: 1676 microversion: 2.1 time: 0.182843 Oct 04 19:38:48.021565 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3781/7575] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:47 2022] GET /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384 => generated 1676 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:49.043147 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-659991ea-2c5e-4cc1-a683-03b1f6cd9b92 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:49.043785 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-659991ea-2c5e-4cc1-a683-03b1f6cd9b92 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: fb263540-8e7c-43b1-9fb6-b92afe7ff384] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:49.052349 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-659991ea-2c5e-4cc1-a683-03b1f6cd9b92 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:49.053882 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-659991ea-2c5e-4cc1-a683-03b1f6cd9b92 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:49.053882 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-659991ea-2c5e-4cc1-a683-03b1f6cd9b92 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:49.055348 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-659991ea-2c5e-4cc1-a683-03b1f6cd9b92 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:49.055462 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-659991ea-2c5e-4cc1-a683-03b1f6cd9b92 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:49.055912 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-659991ea-2c5e-4cc1-a683-03b1f6cd9b92 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:49.193579 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-659991ea-2c5e-4cc1-a683-03b1f6cd9b92 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:49.201919 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-659991ea-2c5e-4cc1-a683-03b1f6cd9b92 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384" status: 200 len: 1655 microversion: 2.1 time: 0.164520 Oct 04 19:38:49.202500 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3795/7576] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:49 2022] GET /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384 => generated 1655 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:49.225224 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f09e1715-5028-4276-92ee-5f10479245bd tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:49.225859 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f09e1715-5028-4276-92ee-5f10479245bd tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: fb263540-8e7c-43b1-9fb6-b92afe7ff384] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:49.232935 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f09e1715-5028-4276-92ee-5f10479245bd tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:49.233437 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f09e1715-5028-4276-92ee-5f10479245bd tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:49.233897 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f09e1715-5028-4276-92ee-5f10479245bd tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:49.234615 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f09e1715-5028-4276-92ee-5f10479245bd tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:49.235092 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f09e1715-5028-4276-92ee-5f10479245bd tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:49.235539 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f09e1715-5028-4276-92ee-5f10479245bd tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:49.368162 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f09e1715-5028-4276-92ee-5f10479245bd tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:49.376257 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f09e1715-5028-4276-92ee-5f10479245bd tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384" status: 200 len: 1655 microversion: 2.1 time: 0.154873 Oct 04 19:38:49.376963 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3782/7577] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:49 2022] GET /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384 => generated 1655 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:49.399040 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3e426ed9-3c76-4843-930e-a02ab543b870 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:38:49.405495 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3e426ed9-3c76-4843-930e-a02ab543b870 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:49.406069 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3e426ed9-3c76-4843-930e-a02ab543b870 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:49.406460 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3e426ed9-3c76-4843-930e-a02ab543b870 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:49.430921 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3e426ed9-3c76-4843-930e-a02ab543b870 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: fb263540-8e7c-43b1-9fb6-b92afe7ff384] Going to try to start instance {{(pid=123001) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 04 19:38:49.612358 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3e426ed9-3c76-4843-930e-a02ab543b870 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "POST /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384/action" status: 202 len: 0 microversion: 2.1 time: 0.217128 Oct 04 19:38:49.612971 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3796/7578] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 19:38:49 2022] POST /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:38:49.621243 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-93d32928-b2bd-40b3-bd35-bae73e5466fc tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:49.621901 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-93d32928-b2bd-40b3-bd35-bae73e5466fc tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: fb263540-8e7c-43b1-9fb6-b92afe7ff384] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:49.628016 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-93d32928-b2bd-40b3-bd35-bae73e5466fc tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:49.632506 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-93d32928-b2bd-40b3-bd35-bae73e5466fc tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:49.632506 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-93d32928-b2bd-40b3-bd35-bae73e5466fc tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:49.632506 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-93d32928-b2bd-40b3-bd35-bae73e5466fc tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:49.632506 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-93d32928-b2bd-40b3-bd35-bae73e5466fc tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:49.632506 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-93d32928-b2bd-40b3-bd35-bae73e5466fc tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:49.802872 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-93d32928-b2bd-40b3-bd35-bae73e5466fc tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:49.816364 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-93d32928-b2bd-40b3-bd35-bae73e5466fc tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384" status: 200 len: 1664 microversion: 2.1 time: 0.198723 Oct 04 19:38:49.816967 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3783/7579] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:49 2022] GET /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384 => generated 1664 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:38:50.065780 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-ff8600de-57d9-4c0d-8cd3-274f680b5e55 req-694f697f-78e3-4bd3-a399-c94e091dd97d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb263540-8e7c-43b1-9fb6-b92afe7ff384", "name": "network-vif-plugged", "status": "completed", "tag": "ba20c09f-33b9-4c62-bde2-f186305ee1ba"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:38:50.076531 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-ff8600de-57d9-4c0d-8cd3-274f680b5e55 req-694f697f-78e3-4bd3-a399-c94e091dd97d service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:50.077088 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-ff8600de-57d9-4c0d-8cd3-274f680b5e55 req-694f697f-78e3-4bd3-a399-c94e091dd97d service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:50.077524 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-ff8600de-57d9-4c0d-8cd3-274f680b5e55 req-694f697f-78e3-4bd3-a399-c94e091dd97d service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:50.092519 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-ff8600de-57d9-4c0d-8cd3-274f680b5e55 req-694f697f-78e3-4bd3-a399-c94e091dd97d service nova] Creating event network-vif-plugged:ba20c09f-33b9-4c62-bde2-f186305ee1ba for instance fb263540-8e7c-43b1-9fb6-b92afe7ff384 on n-h1-850501-14 Oct 04 19:38:50.097947 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-ff8600de-57d9-4c0d-8cd3-274f680b5e55 req-694f697f-78e3-4bd3-a399-c94e091dd97d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037426 Oct 04 19:38:50.098470 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3797/7580] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:38:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:38:50.840461 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a4adb28f-2d25-41a7-a92d-90dff920f1af tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:50.841061 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a4adb28f-2d25-41a7-a92d-90dff920f1af tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: fb263540-8e7c-43b1-9fb6-b92afe7ff384] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:50.848445 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a4adb28f-2d25-41a7-a92d-90dff920f1af tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:50.848952 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a4adb28f-2d25-41a7-a92d-90dff920f1af tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:50.849408 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a4adb28f-2d25-41a7-a92d-90dff920f1af tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:50.850126 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a4adb28f-2d25-41a7-a92d-90dff920f1af tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:50.850600 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a4adb28f-2d25-41a7-a92d-90dff920f1af tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:50.851620 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a4adb28f-2d25-41a7-a92d-90dff920f1af tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:50.985761 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a4adb28f-2d25-41a7-a92d-90dff920f1af tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:50.993513 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a4adb28f-2d25-41a7-a92d-90dff920f1af tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384" status: 200 len: 1668 microversion: 2.1 time: 0.157125 Oct 04 19:38:50.994213 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3784/7581] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:50 2022] GET /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384 => generated 1668 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:38:51.016613 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-cfb9d514-3350-46f0-b8b9-c5a12cc0973f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:51.017208 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-cfb9d514-3350-46f0-b8b9-c5a12cc0973f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: fb263540-8e7c-43b1-9fb6-b92afe7ff384] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:51.024388 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cfb9d514-3350-46f0-b8b9-c5a12cc0973f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:51.024876 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cfb9d514-3350-46f0-b8b9-c5a12cc0973f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:51.025324 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cfb9d514-3350-46f0-b8b9-c5a12cc0973f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:51.026019 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cfb9d514-3350-46f0-b8b9-c5a12cc0973f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:51.026509 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cfb9d514-3350-46f0-b8b9-c5a12cc0973f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:51.026946 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cfb9d514-3350-46f0-b8b9-c5a12cc0973f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:51.059705 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-cfb9d514-3350-46f0-b8b9-c5a12cc0973f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: fb263540-8e7c-43b1-9fb6-b92afe7ff384] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:38:51.065328 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:38:51.306092 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-cfb9d514-3350-46f0-b8b9-c5a12cc0973f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "DELETE /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384" status: 204 len: 0 microversion: 2.1 time: 0.293568 Oct 04 19:38:51.307473 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3798/7582] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 19:38:51 2022] DELETE /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:38:51.316110 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-16e2e5be-0c07-43ec-81cc-4dc9caf0fc02 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:51.317009 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-16e2e5be-0c07-43ec-81cc-4dc9caf0fc02 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: fb263540-8e7c-43b1-9fb6-b92afe7ff384] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:51.323875 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-16e2e5be-0c07-43ec-81cc-4dc9caf0fc02 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:51.324408 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-16e2e5be-0c07-43ec-81cc-4dc9caf0fc02 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:51.324864 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-16e2e5be-0c07-43ec-81cc-4dc9caf0fc02 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:51.325569 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-16e2e5be-0c07-43ec-81cc-4dc9caf0fc02 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:51.326047 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-16e2e5be-0c07-43ec-81cc-4dc9caf0fc02 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:51.326491 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-16e2e5be-0c07-43ec-81cc-4dc9caf0fc02 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:51.464207 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-16e2e5be-0c07-43ec-81cc-4dc9caf0fc02 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:51.472300 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-16e2e5be-0c07-43ec-81cc-4dc9caf0fc02 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384" status: 200 len: 1674 microversion: 2.1 time: 0.161168 Oct 04 19:38:51.472879 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3785/7583] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:51 2022] GET /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384 => generated 1674 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:52.502803 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-bf5348fc-26ba-4406-94bf-1ec6a6295277 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:52.502803 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-bf5348fc-26ba-4406-94bf-1ec6a6295277 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: fb263540-8e7c-43b1-9fb6-b92afe7ff384] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:52.504857 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bf5348fc-26ba-4406-94bf-1ec6a6295277 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:52.505349 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bf5348fc-26ba-4406-94bf-1ec6a6295277 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:52.505789 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bf5348fc-26ba-4406-94bf-1ec6a6295277 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:52.506484 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bf5348fc-26ba-4406-94bf-1ec6a6295277 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:52.506950 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bf5348fc-26ba-4406-94bf-1ec6a6295277 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:52.507531 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bf5348fc-26ba-4406-94bf-1ec6a6295277 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:52.735245 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-bf5348fc-26ba-4406-94bf-1ec6a6295277 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:52.743940 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-bf5348fc-26ba-4406-94bf-1ec6a6295277 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384" status: 200 len: 1674 microversion: 2.1 time: 0.250430 Oct 04 19:38:52.744323 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3799/7584] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:52 2022] GET /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384 => generated 1674 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:53.768903 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f67d097e-faf9-45d4-8b1d-77d0b68106e8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:53.769574 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f67d097e-faf9-45d4-8b1d-77d0b68106e8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: fb263540-8e7c-43b1-9fb6-b92afe7ff384] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:53.777789 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f67d097e-faf9-45d4-8b1d-77d0b68106e8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:53.778369 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f67d097e-faf9-45d4-8b1d-77d0b68106e8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:53.778826 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f67d097e-faf9-45d4-8b1d-77d0b68106e8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:53.779556 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f67d097e-faf9-45d4-8b1d-77d0b68106e8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:53.780028 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f67d097e-faf9-45d4-8b1d-77d0b68106e8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:53.780496 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f67d097e-faf9-45d4-8b1d-77d0b68106e8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:53.918658 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f67d097e-faf9-45d4-8b1d-77d0b68106e8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:53.927119 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f67d097e-faf9-45d4-8b1d-77d0b68106e8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384" status: 200 len: 1607 microversion: 2.1 time: 0.162338 Oct 04 19:38:53.927723 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3786/7585] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:53 2022] GET /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384 => generated 1607 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:53.988280 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-ae84a553-7d55-495d-a649-ea9c854a1d9a req-b8192bcd-c14c-4623-b95c-d59551e36090 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb263540-8e7c-43b1-9fb6-b92afe7ff384", "name": "network-vif-deleted", "tag": "ba20c09f-33b9-4c62-bde2-f186305ee1ba"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:38:53.999521 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-ae84a553-7d55-495d-a649-ea9c854a1d9a req-b8192bcd-c14c-4623-b95c-d59551e36090 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:54.000164 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-ae84a553-7d55-495d-a649-ea9c854a1d9a req-b8192bcd-c14c-4623-b95c-d59551e36090 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:54.000669 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-ae84a553-7d55-495d-a649-ea9c854a1d9a req-b8192bcd-c14c-4623-b95c-d59551e36090 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:54.014878 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-ae84a553-7d55-495d-a649-ea9c854a1d9a req-b8192bcd-c14c-4623-b95c-d59551e36090 service nova] Creating event network-vif-deleted:ba20c09f-33b9-4c62-bde2-f186305ee1ba for instance fb263540-8e7c-43b1-9fb6-b92afe7ff384 on n-h1-850501-14 Oct 04 19:38:54.020283 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-ae84a553-7d55-495d-a649-ea9c854a1d9a req-b8192bcd-c14c-4623-b95c-d59551e36090 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036115 Oct 04 19:38:54.020983 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3800/7586] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:38:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:38:54.953441 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f3b21bfe-c03b-40a4-8a81-4bf4fcccbb16 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:54.954002 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f3b21bfe-c03b-40a4-8a81-4bf4fcccbb16 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: fb263540-8e7c-43b1-9fb6-b92afe7ff384] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:54.956839 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=43 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:38:54.961992 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f3b21bfe-c03b-40a4-8a81-4bf4fcccbb16 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:54.962496 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f3b21bfe-c03b-40a4-8a81-4bf4fcccbb16 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:54.962952 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f3b21bfe-c03b-40a4-8a81-4bf4fcccbb16 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:54.964042 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f3b21bfe-c03b-40a4-8a81-4bf4fcccbb16 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:54.964546 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f3b21bfe-c03b-40a4-8a81-4bf4fcccbb16 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:54.964993 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f3b21bfe-c03b-40a4-8a81-4bf4fcccbb16 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:54.979722 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-f3b21bfe-c03b-40a4-8a81-4bf4fcccbb16 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] HTTP exception thrown: Instance fb263540-8e7c-43b1-9fb6-b92afe7ff384 could not be found. Oct 04 19:38:54.981449 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f3b21bfe-c03b-40a4-8a81-4bf4fcccbb16 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Request method failure captured: Oct 04 19:38:54.981449 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384 HTTP/1.1 Oct 04 19:38:54.981449 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 19:38:54.981449 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 19:38:54.981449 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 19:38:54.981449 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 19:38:54.981449 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 19:38:54.981449 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 19:38:54.981449 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 19:38:54.981449 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 19:38:54.981449 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPIsCyZ9ujYHj7xAc9v5FsVDNBnhQXdRu3HrD7Tq5GQWPtceXFx7qoWJz7lP8l4zGdRoz3AIMETvWSaNf7C0jkbsq4Fdp5SR34bQhmUN7dN-TqhYTJpmcPItgyv3Ip6rfSesFJ9T-vVra0xTUsrYnfVdo1LIR9dDYTmgb9RW4N3wBj3M Oct 04 19:38:54.981449 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 19:38:54.981449 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 19:38:54.981449 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 19:38:54.981449 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 19:38:54.981449 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 19:38:54.981449 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 19:38:54.981449 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 56eff05b035a45e0afc0f92d9d85e136 Oct 04 19:38:54.981449 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServerActionsTestJSON-2139592700 Oct 04 19:38:54.981449 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 19:38:54.981449 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 19:38:54.981449 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/56eff05b035a45e0afc0f92d9d85e136"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_56eff05b035a45e0afc0f92d9d85e136", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/56eff05b035a45e0afc0f92d9d85e136"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/56eff05b035a45e0afc0f92d9d85e136"}]}] Oct 04 19:38:54.981449 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServerActionsTestJSON-2139592700 Oct 04 19:38:54.981449 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 56eff05b035a45e0afc0f92d9d85e136 Oct 04 19:38:54.981449 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServerActionsTestJSON-2139592700 Oct 04 19:38:54.981449 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServerActionsTestJSON-2139592700-project Oct 04 19:38:54.981449 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 19:38:54.981449 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 19:38:54.981449 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 6970aa4f091c49e382c86a487d25d524 Oct 04 19:38:54.981449 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServerActionsTestJSON-2139592700-project Oct 04 19:38:54.981449 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 19:38:54.981449 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance fb263540-8e7c-43b1-9fb6-b92afe7ff384 could not be found. Oct 04 19:38:54.981449 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'fb263540-8e7c-43b1-9fb6-b92afe7ff384'} Oct 04 19:38:54.981449 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:38:54.981449 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:38:54.981449 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:38:54.981449 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:38:54.981449 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:38:54.981449 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:38:54.981449 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:38:54.981449 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:38:54.981449 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:38:54.981449 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:38:54.981449 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb263540-8e7c-43b1-9fb6-b92afe7ff384 could not be found. Oct 04 19:38:54.981449 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:38:54.981449 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:38:54.981449 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:38:54.981449 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:38:54.981449 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:38:54.981449 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:38:54.981449 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:38:54.981449 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:38:54.981449 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:38:54.981449 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:38:54.981449 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:38:54.981449 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:38:54.981449 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:38:54.981449 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:38:54.981449 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:38:54.981449 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:38:54.981449 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb263540-8e7c-43b1-9fb6-b92afe7ff384 could not be found. Oct 04 19:38:54.981449 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:38:54.981449 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:38:54.981449 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:38:54.986457 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:38:54.986457 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:38:54.986457 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:38:54.986457 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:38:54.986457 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:38:54.986457 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb263540-8e7c-43b1-9fb6-b92afe7ff384 could not be found. Oct 04 19:38:54.986457 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:38:54.986457 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f3b21bfe-c03b-40a4-8a81-4bf4fcccbb16 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Returning 404 to user: Instance fb263540-8e7c-43b1-9fb6-b92afe7ff384 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:38:54.986457 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f3b21bfe-c03b-40a4-8a81-4bf4fcccbb16 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384" status: 404 len: 111 microversion: 2.1 time: 0.034000 Oct 04 19:38:54.986457 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3787/7587] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:54 2022] GET /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:38:55.003270 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0ea3d4af-8912-4c5b-884f-4c5eb1745ab8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:55.016105 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0ea3d4af-8912-4c5b-884f-4c5eb1745ab8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: fb263540-8e7c-43b1-9fb6-b92afe7ff384] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:55.016105 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:38:55.016105 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0ea3d4af-8912-4c5b-884f-4c5eb1745ab8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:55.016105 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0ea3d4af-8912-4c5b-884f-4c5eb1745ab8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:55.016105 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0ea3d4af-8912-4c5b-884f-4c5eb1745ab8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:55.016105 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0ea3d4af-8912-4c5b-884f-4c5eb1745ab8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:55.016105 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0ea3d4af-8912-4c5b-884f-4c5eb1745ab8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:55.016105 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0ea3d4af-8912-4c5b-884f-4c5eb1745ab8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:55.028438 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-0ea3d4af-8912-4c5b-884f-4c5eb1745ab8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] HTTP exception thrown: Instance fb263540-8e7c-43b1-9fb6-b92afe7ff384 could not be found. Oct 04 19:38:55.029683 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0ea3d4af-8912-4c5b-884f-4c5eb1745ab8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Request method failure captured: Oct 04 19:38:55.029683 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384 HTTP/1.1 Oct 04 19:38:55.029683 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 19:38:55.029683 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 19:38:55.029683 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 19:38:55.029683 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 19:38:55.029683 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 19:38:55.029683 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 19:38:55.029683 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 19:38:55.029683 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 19:38:55.029683 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPIsCyZ9ujYHj7xAc9v5FsVDNBnhQXdRu3HrD7Tq5GQWPtceXFx7qoWJz7lP8l4zGdRoz3AIMETvWSaNf7C0jkbsq4Fdp5SR34bQhmUN7dN-TqhYTJpmcPItgyv3Ip6rfSesFJ9T-vVra0xTUsrYnfVdo1LIR9dDYTmgb9RW4N3wBj3M Oct 04 19:38:55.029683 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 19:38:55.029683 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 19:38:55.029683 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 19:38:55.029683 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 19:38:55.029683 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 19:38:55.029683 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 19:38:55.029683 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 56eff05b035a45e0afc0f92d9d85e136 Oct 04 19:38:55.029683 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ServerActionsTestJSON-2139592700 Oct 04 19:38:55.029683 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 19:38:55.029683 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 19:38:55.029683 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/56eff05b035a45e0afc0f92d9d85e136"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_56eff05b035a45e0afc0f92d9d85e136", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/56eff05b035a45e0afc0f92d9d85e136"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/56eff05b035a45e0afc0f92d9d85e136"}]}] Oct 04 19:38:55.029683 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ServerActionsTestJSON-2139592700 Oct 04 19:38:55.029683 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 56eff05b035a45e0afc0f92d9d85e136 Oct 04 19:38:55.029683 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ServerActionsTestJSON-2139592700 Oct 04 19:38:55.029683 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ServerActionsTestJSON-2139592700-project Oct 04 19:38:55.029683 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 19:38:55.029683 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 19:38:55.029683 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 6970aa4f091c49e382c86a487d25d524 Oct 04 19:38:55.029683 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ServerActionsTestJSON-2139592700-project Oct 04 19:38:55.029683 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 19:38:55.029683 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance fb263540-8e7c-43b1-9fb6-b92afe7ff384 could not be found. Oct 04 19:38:55.029683 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': 'fb263540-8e7c-43b1-9fb6-b92afe7ff384'} Oct 04 19:38:55.029683 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:38:55.029683 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:38:55.029683 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:38:55.029683 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:38:55.029683 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:38:55.029683 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:38:55.029683 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:38:55.029683 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:38:55.029683 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:38:55.029683 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:38:55.029683 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb263540-8e7c-43b1-9fb6-b92afe7ff384 could not be found. Oct 04 19:38:55.029683 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:38:55.029683 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:38:55.029683 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:38:55.029683 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:38:55.029683 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:38:55.029683 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:38:55.029683 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:38:55.029683 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:38:55.029683 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:38:55.029683 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:38:55.029683 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:38:55.029683 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:38:55.029683 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:38:55.029683 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:38:55.029683 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:38:55.029683 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:38:55.029683 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb263540-8e7c-43b1-9fb6-b92afe7ff384 could not be found. Oct 04 19:38:55.029683 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:38:55.029683 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:38:55.029683 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:38:55.034432 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:38:55.034432 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:38:55.034432 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:38:55.034432 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:38:55.034432 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:38:55.034432 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb263540-8e7c-43b1-9fb6-b92afe7ff384 could not be found. Oct 04 19:38:55.034432 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:38:55.034432 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0ea3d4af-8912-4c5b-884f-4c5eb1745ab8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Returning 404 to user: Instance fb263540-8e7c-43b1-9fb6-b92afe7ff384 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:38:55.034432 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0ea3d4af-8912-4c5b-884f-4c5eb1745ab8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384" status: 404 len: 111 microversion: 2.1 time: 0.033030 Oct 04 19:38:55.034432 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3801/7588] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:54 2022] GET /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:38:55.092492 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-916f7438-0293-49f2-b2ff-efa4db83f358 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1074212485", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": [{"uuid": "da1c0bb1-0fcf-4915-8cd0-57095c8c6e9c"}], "security_groups": [{"name": "tempest-securitygroup--729491688"}], "key_name": "tempest-keypair-980628313", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:38:55.199861 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-916f7438-0293-49f2-b2ff-efa4db83f358 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] validate_networks() for [('da1c0bb1-0fcf-4915-8cd0-57095c8c6e9c', None, None, None, None, None)] {{(pid=123002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:38:55.571661 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-916f7438-0293-49f2-b2ff-efa4db83f358 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:38:55.572168 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-916f7438-0293-49f2-b2ff-efa4db83f358 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:38:55.572668 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-916f7438-0293-49f2-b2ff-efa4db83f358 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:38:55.573125 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-916f7438-0293-49f2-b2ff-efa4db83f358 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:38:55.573552 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-916f7438-0293-49f2-b2ff-efa4db83f358 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:38:55.582414 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-916f7438-0293-49f2-b2ff-efa4db83f358 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:55.582909 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-916f7438-0293-49f2-b2ff-efa4db83f358 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:55.583356 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-916f7438-0293-49f2-b2ff-efa4db83f358 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:55.584143 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-916f7438-0293-49f2-b2ff-efa4db83f358 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:55.584621 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-916f7438-0293-49f2-b2ff-efa4db83f358 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:55.585562 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-916f7438-0293-49f2-b2ff-efa4db83f358 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:55.603832 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-916f7438-0293-49f2-b2ff-efa4db83f358 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Getting quotas for project 56eff05b035a45e0afc0f92d9d85e136. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:38:55.609271 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-916f7438-0293-49f2-b2ff-efa4db83f358 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Getting quotas for user 6970aa4f091c49e382c86a487d25d524 and project 56eff05b035a45e0afc0f92d9d85e136. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:38:55.621977 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-916f7438-0293-49f2-b2ff-efa4db83f358 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Going to run 1 instances... {{(pid=123002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:38:55.624332 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-916f7438-0293-49f2-b2ff-efa4db83f358 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 214e87c0-98fa-462e-a177-9780f1cc29ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:38:55.773412 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-916f7438-0293-49f2-b2ff-efa4db83f358 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.684768 Oct 04 19:38:55.774158 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3788/7589] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 19:38:55 2022] POST /compute/v2.1/servers => generated 405 bytes in 687 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:38:55.786342 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2a802db2-63c9-4a96-9633-c4f457700ddf tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:55.787040 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2a802db2-63c9-4a96-9633-c4f457700ddf tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 214e87c0-98fa-462e-a177-9780f1cc29ca] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:55.851415 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-2a802db2-63c9-4a96-9633-c4f457700ddf tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:55.863516 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2a802db2-63c9-4a96-9633-c4f457700ddf tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca" status: 200 len: 1238 microversion: 2.1 time: 0.081584 Oct 04 19:38:55.864408 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3802/7590] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:55 2022] GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca => generated 1238 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:38:56.888095 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-cfe112ac-25c2-40a5-9973-072ea60f03cd tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:56.888759 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-cfe112ac-25c2-40a5-9973-072ea60f03cd tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 214e87c0-98fa-462e-a177-9780f1cc29ca] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:56.895588 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cfe112ac-25c2-40a5-9973-072ea60f03cd tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:56.896132 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cfe112ac-25c2-40a5-9973-072ea60f03cd tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:56.896585 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cfe112ac-25c2-40a5-9973-072ea60f03cd tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:56.897283 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cfe112ac-25c2-40a5-9973-072ea60f03cd tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:56.897818 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cfe112ac-25c2-40a5-9973-072ea60f03cd tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:56.898263 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cfe112ac-25c2-40a5-9973-072ea60f03cd tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:56.962959 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-cfe112ac-25c2-40a5-9973-072ea60f03cd tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:56.971100 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-cfe112ac-25c2-40a5-9973-072ea60f03cd tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca" status: 200 len: 1234 microversion: 2.1 time: 0.087538 Oct 04 19:38:56.976362 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3789/7591] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:56 2022] GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca => generated 1234 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:38:57.997244 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1d2c95d6-71a6-4dec-a3bd-e1ea7d4bccd8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:57.997903 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1d2c95d6-71a6-4dec-a3bd-e1ea7d4bccd8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 214e87c0-98fa-462e-a177-9780f1cc29ca] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:58.005909 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1d2c95d6-71a6-4dec-a3bd-e1ea7d4bccd8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:58.006404 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1d2c95d6-71a6-4dec-a3bd-e1ea7d4bccd8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:58.006866 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1d2c95d6-71a6-4dec-a3bd-e1ea7d4bccd8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:58.008391 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1d2c95d6-71a6-4dec-a3bd-e1ea7d4bccd8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:58.008862 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1d2c95d6-71a6-4dec-a3bd-e1ea7d4bccd8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:58.009296 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1d2c95d6-71a6-4dec-a3bd-e1ea7d4bccd8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:58.078612 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1d2c95d6-71a6-4dec-a3bd-e1ea7d4bccd8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:58.086570 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1d2c95d6-71a6-4dec-a3bd-e1ea7d4bccd8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca" status: 200 len: 1296 microversion: 2.1 time: 0.093390 Oct 04 19:38:58.087139 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3803/7592] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:57 2022] GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca => generated 1296 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:38:59.110972 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1e038644-4658-4bc7-b54b-a48ddb814c94 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:59.111640 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1e038644-4658-4bc7-b54b-a48ddb814c94 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 214e87c0-98fa-462e-a177-9780f1cc29ca] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:59.118546 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1e038644-4658-4bc7-b54b-a48ddb814c94 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:59.119049 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1e038644-4658-4bc7-b54b-a48ddb814c94 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:59.119856 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1e038644-4658-4bc7-b54b-a48ddb814c94 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:59.120651 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1e038644-4658-4bc7-b54b-a48ddb814c94 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:59.121129 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1e038644-4658-4bc7-b54b-a48ddb814c94 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:59.121574 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1e038644-4658-4bc7-b54b-a48ddb814c94 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:59.155283 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-f802b58b-4c60-414a-b35c-75cc7a53eef0 req-f1772fc3-e142-44a6-b74c-fe05473ff707 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "214e87c0-98fa-462e-a177-9780f1cc29ca", "tag": "9698f15e-00fe-490a-841b-6fe40fa3be47"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:38:59.169678 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-f802b58b-4c60-414a-b35c-75cc7a53eef0 req-f1772fc3-e142-44a6-b74c-fe05473ff707 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:59.172550 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-f802b58b-4c60-414a-b35c-75cc7a53eef0 req-f1772fc3-e142-44a6-b74c-fe05473ff707 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:59.172550 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-f802b58b-4c60-414a-b35c-75cc7a53eef0 req-f1772fc3-e142-44a6-b74c-fe05473ff707 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:59.184662 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-f802b58b-4c60-414a-b35c-75cc7a53eef0 req-f1772fc3-e142-44a6-b74c-fe05473ff707 service nova] Creating event network-changed:9698f15e-00fe-490a-841b-6fe40fa3be47 for instance 214e87c0-98fa-462e-a177-9780f1cc29ca on n-h1-850501-14 Oct 04 19:38:59.189965 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-f802b58b-4c60-414a-b35c-75cc7a53eef0 req-f1772fc3-e142-44a6-b74c-fe05473ff707 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039029 Oct 04 19:38:59.196645 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3804/7593] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:38:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:38:59.387565 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1e038644-4658-4bc7-b54b-a48ddb814c94 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:59.395785 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1e038644-4658-4bc7-b54b-a48ddb814c94 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca" status: 200 len: 1363 microversion: 2.1 time: 0.288841 Oct 04 19:38:59.396406 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3790/7594] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:59 2022] GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca => generated 1363 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:39:00.421995 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-11e6abc1-5c30-4875-b005-006c306e0227 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:00.422698 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-11e6abc1-5c30-4875-b005-006c306e0227 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 214e87c0-98fa-462e-a177-9780f1cc29ca] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:00.429039 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-11e6abc1-5c30-4875-b005-006c306e0227 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:00.429522 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-11e6abc1-5c30-4875-b005-006c306e0227 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:00.429964 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-11e6abc1-5c30-4875-b005-006c306e0227 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:00.430656 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-11e6abc1-5c30-4875-b005-006c306e0227 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:00.431629 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-11e6abc1-5c30-4875-b005-006c306e0227 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:00.432086 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-11e6abc1-5c30-4875-b005-006c306e0227 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:00.567543 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-11e6abc1-5c30-4875-b005-006c306e0227 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:39:00.575691 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-11e6abc1-5c30-4875-b005-006c306e0227 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca" status: 200 len: 1363 microversion: 2.1 time: 0.159184 Oct 04 19:39:00.576315 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3805/7595] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:39:00 2022] GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:39:01.599689 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2c35babd-b96f-41d5-a486-89ea86759e61 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:01.600443 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2c35babd-b96f-41d5-a486-89ea86759e61 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 214e87c0-98fa-462e-a177-9780f1cc29ca] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:01.607536 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2c35babd-b96f-41d5-a486-89ea86759e61 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:01.608042 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2c35babd-b96f-41d5-a486-89ea86759e61 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:01.608529 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2c35babd-b96f-41d5-a486-89ea86759e61 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:01.609247 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2c35babd-b96f-41d5-a486-89ea86759e61 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:01.609720 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2c35babd-b96f-41d5-a486-89ea86759e61 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:01.610168 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2c35babd-b96f-41d5-a486-89ea86759e61 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:01.744885 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2c35babd-b96f-41d5-a486-89ea86759e61 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:39:01.752555 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2c35babd-b96f-41d5-a486-89ea86759e61 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca" status: 200 len: 1363 microversion: 2.1 time: 0.157121 Oct 04 19:39:01.753134 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3791/7596] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:39:01 2022] GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:39:02.777383 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0e1a345b-7014-4559-9c2e-502caa0c4be4 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:02.777897 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0e1a345b-7014-4559-9c2e-502caa0c4be4 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 214e87c0-98fa-462e-a177-9780f1cc29ca] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:02.784739 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0e1a345b-7014-4559-9c2e-502caa0c4be4 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:02.785218 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0e1a345b-7014-4559-9c2e-502caa0c4be4 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:02.785646 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0e1a345b-7014-4559-9c2e-502caa0c4be4 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:02.786326 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0e1a345b-7014-4559-9c2e-502caa0c4be4 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:02.786833 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0e1a345b-7014-4559-9c2e-502caa0c4be4 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:02.787256 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0e1a345b-7014-4559-9c2e-502caa0c4be4 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:02.915651 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0e1a345b-7014-4559-9c2e-502caa0c4be4 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:39:02.923257 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0e1a345b-7014-4559-9c2e-502caa0c4be4 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca" status: 200 len: 1363 microversion: 2.1 time: 0.149804 Oct 04 19:39:02.923818 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3806/7597] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:39:02 2022] GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:39:03.948532 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-79c57f54-3a39-42b4-8417-164b79022f68 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:03.949170 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-79c57f54-3a39-42b4-8417-164b79022f68 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 214e87c0-98fa-462e-a177-9780f1cc29ca] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:03.956174 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-79c57f54-3a39-42b4-8417-164b79022f68 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:03.956683 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-79c57f54-3a39-42b4-8417-164b79022f68 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:03.957142 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-79c57f54-3a39-42b4-8417-164b79022f68 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:03.957859 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-79c57f54-3a39-42b4-8417-164b79022f68 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:03.958331 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-79c57f54-3a39-42b4-8417-164b79022f68 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:03.958775 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-79c57f54-3a39-42b4-8417-164b79022f68 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:04.095183 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-79c57f54-3a39-42b4-8417-164b79022f68 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:39:04.103923 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-79c57f54-3a39-42b4-8417-164b79022f68 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca" status: 200 len: 1363 microversion: 2.1 time: 0.160562 Oct 04 19:39:04.104534 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3792/7598] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:39:03 2022] GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:39:05.128086 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-757af140-c14f-42a3-a301-3ec6b7f09cc5 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:05.128718 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-757af140-c14f-42a3-a301-3ec6b7f09cc5 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 214e87c0-98fa-462e-a177-9780f1cc29ca] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:05.135952 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-757af140-c14f-42a3-a301-3ec6b7f09cc5 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:05.144139 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-757af140-c14f-42a3-a301-3ec6b7f09cc5 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:05.144139 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-757af140-c14f-42a3-a301-3ec6b7f09cc5 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:05.144139 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-757af140-c14f-42a3-a301-3ec6b7f09cc5 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:05.144139 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-757af140-c14f-42a3-a301-3ec6b7f09cc5 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:05.144139 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-757af140-c14f-42a3-a301-3ec6b7f09cc5 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:05.274198 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-757af140-c14f-42a3-a301-3ec6b7f09cc5 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:39:05.281858 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-757af140-c14f-42a3-a301-3ec6b7f09cc5 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca" status: 200 len: 1363 microversion: 2.1 time: 0.157945 Oct 04 19:39:05.282425 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3807/7599] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:39:05 2022] GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:39:06.291488 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-e775688e-289d-4b8a-bdae-71a165eac21e req-f5d4063d-7a39-4534-ad93-a12258d00741 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "214e87c0-98fa-462e-a177-9780f1cc29ca", "name": "network-vif-plugged", "status": "completed", "tag": "9698f15e-00fe-490a-841b-6fe40fa3be47"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:39:06.298863 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:39:06.299563 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=6 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:39:06.303624 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-e775688e-289d-4b8a-bdae-71a165eac21e req-f5d4063d-7a39-4534-ad93-a12258d00741 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:06.304136 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-e775688e-289d-4b8a-bdae-71a165eac21e req-f5d4063d-7a39-4534-ad93-a12258d00741 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:06.309204 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-e775688e-289d-4b8a-bdae-71a165eac21e req-f5d4063d-7a39-4534-ad93-a12258d00741 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:06.309342 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-93daa1ae-e0cf-47e1-a590-a78419f5e8d1 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:06.309342 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-93daa1ae-e0cf-47e1-a590-a78419f5e8d1 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 214e87c0-98fa-462e-a177-9780f1cc29ca] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:06.309342 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:39:06.314794 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-93daa1ae-e0cf-47e1-a590-a78419f5e8d1 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:06.315284 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-93daa1ae-e0cf-47e1-a590-a78419f5e8d1 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:06.315722 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-93daa1ae-e0cf-47e1-a590-a78419f5e8d1 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:06.316453 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-93daa1ae-e0cf-47e1-a590-a78419f5e8d1 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:06.316851 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-e775688e-289d-4b8a-bdae-71a165eac21e req-f5d4063d-7a39-4534-ad93-a12258d00741 service nova] Creating event network-vif-plugged:9698f15e-00fe-490a-841b-6fe40fa3be47 for instance 214e87c0-98fa-462e-a177-9780f1cc29ca on n-h1-850501-14 Oct 04 19:39:06.316965 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-93daa1ae-e0cf-47e1-a590-a78419f5e8d1 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:06.317322 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-93daa1ae-e0cf-47e1-a590-a78419f5e8d1 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:06.322795 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-e775688e-289d-4b8a-bdae-71a165eac21e req-f5d4063d-7a39-4534-ad93-a12258d00741 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035858 Oct 04 19:39:06.323580 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3793/7600] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:39:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:39:06.527583 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-93daa1ae-e0cf-47e1-a590-a78419f5e8d1 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:39:06.535365 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-93daa1ae-e0cf-47e1-a590-a78419f5e8d1 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca" status: 200 len: 1363 microversion: 2.1 time: 0.233679 Oct 04 19:39:06.535960 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3808/7601] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:39:06 2022] GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca => generated 1363 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:39:07.561086 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ab3b4808-372b-4b5a-bb36-786ddd45993a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:07.561935 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ab3b4808-372b-4b5a-bb36-786ddd45993a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 214e87c0-98fa-462e-a177-9780f1cc29ca] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:07.569019 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ab3b4808-372b-4b5a-bb36-786ddd45993a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:07.569529 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ab3b4808-372b-4b5a-bb36-786ddd45993a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:07.570081 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ab3b4808-372b-4b5a-bb36-786ddd45993a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:07.570799 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ab3b4808-372b-4b5a-bb36-786ddd45993a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:07.571270 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ab3b4808-372b-4b5a-bb36-786ddd45993a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:07.571718 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ab3b4808-372b-4b5a-bb36-786ddd45993a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:07.705159 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ab3b4808-372b-4b5a-bb36-786ddd45993a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:39:07.713188 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ab3b4808-372b-4b5a-bb36-786ddd45993a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca" status: 200 len: 1363 microversion: 2.1 time: 0.158002 Oct 04 19:39:07.713778 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3794/7602] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:39:07 2022] GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:39:08.737989 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ce52fa34-8d76-4c8e-ab0c-f26982ee3d7a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:08.738672 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ce52fa34-8d76-4c8e-ab0c-f26982ee3d7a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 214e87c0-98fa-462e-a177-9780f1cc29ca] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:08.745626 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ce52fa34-8d76-4c8e-ab0c-f26982ee3d7a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:08.746108 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ce52fa34-8d76-4c8e-ab0c-f26982ee3d7a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:08.746542 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ce52fa34-8d76-4c8e-ab0c-f26982ee3d7a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:08.747228 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ce52fa34-8d76-4c8e-ab0c-f26982ee3d7a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:08.747688 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ce52fa34-8d76-4c8e-ab0c-f26982ee3d7a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:08.748136 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ce52fa34-8d76-4c8e-ab0c-f26982ee3d7a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:08.880500 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ce52fa34-8d76-4c8e-ab0c-f26982ee3d7a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:39:08.890088 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ce52fa34-8d76-4c8e-ab0c-f26982ee3d7a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca" status: 200 len: 1549 microversion: 2.1 time: 0.156119 Oct 04 19:39:08.890681 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3809/7603] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:39:08 2022] GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca => generated 1549 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:39:08.913892 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c2b2ba13-8214-4b98-8884-05fc2905854a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:08.914419 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c2b2ba13-8214-4b98-8884-05fc2905854a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 214e87c0-98fa-462e-a177-9780f1cc29ca] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:08.921252 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c2b2ba13-8214-4b98-8884-05fc2905854a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:08.921745 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c2b2ba13-8214-4b98-8884-05fc2905854a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:08.922201 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c2b2ba13-8214-4b98-8884-05fc2905854a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:08.922911 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c2b2ba13-8214-4b98-8884-05fc2905854a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:08.923383 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c2b2ba13-8214-4b98-8884-05fc2905854a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:08.923825 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c2b2ba13-8214-4b98-8884-05fc2905854a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:09.001065 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c2b2ba13-8214-4b98-8884-05fc2905854a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091084 Oct 04 19:39:09.001673 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3795/7604] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Oct 4 19:39:08 2022] GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:39:10.012703 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-81969845-c6a6-4602-8a0f-514edb1e2c4f req-efbb128e-7836-428c-b0ac-3a1905214eb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "214e87c0-98fa-462e-a177-9780f1cc29ca", "tag": "9698f15e-00fe-490a-841b-6fe40fa3be47"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:39:10.025513 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-81969845-c6a6-4602-8a0f-514edb1e2c4f req-efbb128e-7836-428c-b0ac-3a1905214eb0 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:10.026001 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-81969845-c6a6-4602-8a0f-514edb1e2c4f req-efbb128e-7836-428c-b0ac-3a1905214eb0 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:10.026436 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-81969845-c6a6-4602-8a0f-514edb1e2c4f req-efbb128e-7836-428c-b0ac-3a1905214eb0 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:10.039548 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-81969845-c6a6-4602-8a0f-514edb1e2c4f req-efbb128e-7836-428c-b0ac-3a1905214eb0 service nova] Creating event network-changed:9698f15e-00fe-490a-841b-6fe40fa3be47 for instance 214e87c0-98fa-462e-a177-9780f1cc29ca on n-h1-850501-14 Oct 04 19:39:10.044955 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-81969845-c6a6-4602-8a0f-514edb1e2c4f req-efbb128e-7836-428c-b0ac-3a1905214eb0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038395 Oct 04 19:39:10.045649 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3810/7605] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:39:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:39:42.906497 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:39:42.907303 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=75 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:39:42.911462 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-cf1297f6-6f9f-4e8f-b13f-1bc311655d85 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:39:42.913811 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-cf1297f6-6f9f-4e8f-b13f-1bc311655d85 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 214e87c0-98fa-462e-a177-9780f1cc29ca] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:42.920127 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cf1297f6-6f9f-4e8f-b13f-1bc311655d85 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:42.921267 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cf1297f6-6f9f-4e8f-b13f-1bc311655d85 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:42.921727 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cf1297f6-6f9f-4e8f-b13f-1bc311655d85 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:42.922446 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cf1297f6-6f9f-4e8f-b13f-1bc311655d85 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:42.922919 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cf1297f6-6f9f-4e8f-b13f-1bc311655d85 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:42.923362 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cf1297f6-6f9f-4e8f-b13f-1bc311655d85 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:42.963316 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-cf1297f6-6f9f-4e8f-b13f-1bc311655d85 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:39:42.970087 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-cf1297f6-6f9f-4e8f-b13f-1bc311655d85 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 214e87c0-98fa-462e-a177-9780f1cc29ca] Old instance type m1.heat2, new instance type m1.heat {{(pid=123002) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 19:39:42.977581 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-cf1297f6-6f9f-4e8f-b13f-1bc311655d85 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:39:42.978014 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-cf1297f6-6f9f-4e8f-b13f-1bc311655d85 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:39:42.978499 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-cf1297f6-6f9f-4e8f-b13f-1bc311655d85 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:39:42.978917 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-cf1297f6-6f9f-4e8f-b13f-1bc311655d85 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:39:42.979340 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-cf1297f6-6f9f-4e8f-b13f-1bc311655d85 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:39:43.164848 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-cf1297f6-6f9f-4e8f-b13f-1bc311655d85 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "POST /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca/action" status: 202 len: 0 microversion: 2.1 time: 0.264464 Oct 04 19:39:43.165815 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3796/7606] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 19:39:42 2022] POST /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca/action => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:39:43.175065 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=21 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:39:43.175681 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:39:43.180937 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-eecdd0b8-a3b8-4897-9544-8f9e75ae28ed tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:43.180937 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-eecdd0b8-a3b8-4897-9544-8f9e75ae28ed tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 214e87c0-98fa-462e-a177-9780f1cc29ca] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:43.193575 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eecdd0b8-a3b8-4897-9544-8f9e75ae28ed tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:43.194112 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eecdd0b8-a3b8-4897-9544-8f9e75ae28ed tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:43.194556 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eecdd0b8-a3b8-4897-9544-8f9e75ae28ed tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:43.195282 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eecdd0b8-a3b8-4897-9544-8f9e75ae28ed tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:43.195747 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eecdd0b8-a3b8-4897-9544-8f9e75ae28ed tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:43.196214 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eecdd0b8-a3b8-4897-9544-8f9e75ae28ed tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:43.368922 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-eecdd0b8-a3b8-4897-9544-8f9e75ae28ed tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:39:43.376947 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-eecdd0b8-a3b8-4897-9544-8f9e75ae28ed tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca" status: 200 len: 1677 microversion: 2.1 time: 0.204644 Oct 04 19:39:43.377522 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3811/7607] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:39:43 2022] GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca => generated 1677 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:39:44.400838 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ae87d358-1b61-470f-893d-2107f639b63b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:44.401463 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ae87d358-1b61-470f-893d-2107f639b63b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 214e87c0-98fa-462e-a177-9780f1cc29ca] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:44.409274 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ae87d358-1b61-470f-893d-2107f639b63b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:44.409770 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ae87d358-1b61-470f-893d-2107f639b63b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:44.410216 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ae87d358-1b61-470f-893d-2107f639b63b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:44.410917 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ae87d358-1b61-470f-893d-2107f639b63b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:44.411390 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ae87d358-1b61-470f-893d-2107f639b63b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:44.411830 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ae87d358-1b61-470f-893d-2107f639b63b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:44.544894 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ae87d358-1b61-470f-893d-2107f639b63b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:39:44.553444 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ae87d358-1b61-470f-893d-2107f639b63b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca" status: 200 len: 1677 microversion: 2.1 time: 0.156781 Oct 04 19:39:44.554025 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3797/7608] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:39:44 2022] GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:39:45.579044 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2cf028a1-4bb6-4f1a-8626-5e53a5d5052c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:45.579702 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2cf028a1-4bb6-4f1a-8626-5e53a5d5052c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 214e87c0-98fa-462e-a177-9780f1cc29ca] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:45.586807 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2cf028a1-4bb6-4f1a-8626-5e53a5d5052c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:45.587334 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2cf028a1-4bb6-4f1a-8626-5e53a5d5052c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:45.587781 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2cf028a1-4bb6-4f1a-8626-5e53a5d5052c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:45.588512 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2cf028a1-4bb6-4f1a-8626-5e53a5d5052c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:45.588989 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2cf028a1-4bb6-4f1a-8626-5e53a5d5052c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:45.589416 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2cf028a1-4bb6-4f1a-8626-5e53a5d5052c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:46.094189 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-2cf028a1-4bb6-4f1a-8626-5e53a5d5052c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:39:46.102374 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2cf028a1-4bb6-4f1a-8626-5e53a5d5052c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca" status: 200 len: 1677 microversion: 2.1 time: 0.527497 Oct 04 19:39:46.103174 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3812/7609] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:39:45 2022] GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca => generated 1677 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:39:47.126727 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9b53d55a-1f89-4205-b725-55728ae42892 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:47.127394 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9b53d55a-1f89-4205-b725-55728ae42892 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 214e87c0-98fa-462e-a177-9780f1cc29ca] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:47.133846 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9b53d55a-1f89-4205-b725-55728ae42892 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:47.134333 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9b53d55a-1f89-4205-b725-55728ae42892 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:47.134779 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9b53d55a-1f89-4205-b725-55728ae42892 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:47.135475 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9b53d55a-1f89-4205-b725-55728ae42892 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:47.135941 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9b53d55a-1f89-4205-b725-55728ae42892 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:47.136401 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9b53d55a-1f89-4205-b725-55728ae42892 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:47.267214 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9b53d55a-1f89-4205-b725-55728ae42892 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:39:47.275234 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9b53d55a-1f89-4205-b725-55728ae42892 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca" status: 200 len: 1682 microversion: 2.1 time: 0.152683 Oct 04 19:39:47.275831 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3798/7610] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:39:47 2022] GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:39:48.304583 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-508dae03-35f4-47be-babb-d2d8afc355e4 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:48.305198 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-508dae03-35f4-47be-babb-d2d8afc355e4 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 214e87c0-98fa-462e-a177-9780f1cc29ca] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:48.312653 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-508dae03-35f4-47be-babb-d2d8afc355e4 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:48.313138 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-508dae03-35f4-47be-babb-d2d8afc355e4 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:48.313578 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-508dae03-35f4-47be-babb-d2d8afc355e4 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:48.314273 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-508dae03-35f4-47be-babb-d2d8afc355e4 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:48.314731 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-508dae03-35f4-47be-babb-d2d8afc355e4 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:48.315159 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-508dae03-35f4-47be-babb-d2d8afc355e4 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:48.453743 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-508dae03-35f4-47be-babb-d2d8afc355e4 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:39:48.462409 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-508dae03-35f4-47be-babb-d2d8afc355e4 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca" status: 200 len: 1682 microversion: 2.1 time: 0.161752 Oct 04 19:39:48.462989 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3813/7611] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:39:48 2022] GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:39:49.486433 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d84294bb-3b8b-439b-83ec-833d1b462188 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:49.487117 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d84294bb-3b8b-439b-83ec-833d1b462188 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 214e87c0-98fa-462e-a177-9780f1cc29ca] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:49.494034 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d84294bb-3b8b-439b-83ec-833d1b462188 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:49.494539 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d84294bb-3b8b-439b-83ec-833d1b462188 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:49.494994 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d84294bb-3b8b-439b-83ec-833d1b462188 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:49.495706 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d84294bb-3b8b-439b-83ec-833d1b462188 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:49.496214 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d84294bb-3b8b-439b-83ec-833d1b462188 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:49.496664 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d84294bb-3b8b-439b-83ec-833d1b462188 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:49.627929 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d84294bb-3b8b-439b-83ec-833d1b462188 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:39:49.635670 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d84294bb-3b8b-439b-83ec-833d1b462188 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca" status: 200 len: 1682 microversion: 2.1 time: 0.154001 Oct 04 19:39:49.636273 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3799/7612] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:39:49 2022] GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:39:50.659600 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-bc4d7e90-d84a-4936-b867-186825d70350 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:50.660249 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-bc4d7e90-d84a-4936-b867-186825d70350 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 214e87c0-98fa-462e-a177-9780f1cc29ca] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:50.667139 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bc4d7e90-d84a-4936-b867-186825d70350 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:50.667636 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bc4d7e90-d84a-4936-b867-186825d70350 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:50.668102 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bc4d7e90-d84a-4936-b867-186825d70350 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:50.668802 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bc4d7e90-d84a-4936-b867-186825d70350 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:50.669266 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bc4d7e90-d84a-4936-b867-186825d70350 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:50.669700 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bc4d7e90-d84a-4936-b867-186825d70350 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:50.811338 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-bc4d7e90-d84a-4936-b867-186825d70350 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:39:50.819400 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-bc4d7e90-d84a-4936-b867-186825d70350 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca" status: 200 len: 1682 microversion: 2.1 time: 0.163807 Oct 04 19:39:50.819971 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3814/7613] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:39:50 2022] GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:39:51.843443 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9479ad24-ba4e-4292-9d0b-e8e91acc91a6 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:51.844104 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9479ad24-ba4e-4292-9d0b-e8e91acc91a6 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 214e87c0-98fa-462e-a177-9780f1cc29ca] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:51.851238 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9479ad24-ba4e-4292-9d0b-e8e91acc91a6 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:51.851744 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9479ad24-ba4e-4292-9d0b-e8e91acc91a6 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:51.852232 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9479ad24-ba4e-4292-9d0b-e8e91acc91a6 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:51.852950 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9479ad24-ba4e-4292-9d0b-e8e91acc91a6 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:51.853450 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9479ad24-ba4e-4292-9d0b-e8e91acc91a6 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:51.853899 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9479ad24-ba4e-4292-9d0b-e8e91acc91a6 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:51.984167 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9479ad24-ba4e-4292-9d0b-e8e91acc91a6 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:39:51.992043 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9479ad24-ba4e-4292-9d0b-e8e91acc91a6 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca" status: 200 len: 1682 microversion: 2.1 time: 0.153149 Oct 04 19:39:51.992690 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3800/7614] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:39:51 2022] GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:39:53.016004 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-32bd89a4-cf59-4f35-9e22-cc9a8c818853 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:53.016565 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-32bd89a4-cf59-4f35-9e22-cc9a8c818853 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 214e87c0-98fa-462e-a177-9780f1cc29ca] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:53.023437 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-32bd89a4-cf59-4f35-9e22-cc9a8c818853 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:53.023926 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-32bd89a4-cf59-4f35-9e22-cc9a8c818853 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:53.024473 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-32bd89a4-cf59-4f35-9e22-cc9a8c818853 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:53.025174 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-32bd89a4-cf59-4f35-9e22-cc9a8c818853 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:53.025635 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-32bd89a4-cf59-4f35-9e22-cc9a8c818853 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:53.026070 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-32bd89a4-cf59-4f35-9e22-cc9a8c818853 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:53.156147 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-32bd89a4-cf59-4f35-9e22-cc9a8c818853 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:39:53.163883 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-32bd89a4-cf59-4f35-9e22-cc9a8c818853 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca" status: 200 len: 1682 microversion: 2.1 time: 0.152553 Oct 04 19:39:53.164495 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3815/7615] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:39:53 2022] GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:39:54.188038 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7b051750-d775-4bf9-9ae9-0f0d67b9162f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:54.188691 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7b051750-d775-4bf9-9ae9-0f0d67b9162f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 214e87c0-98fa-462e-a177-9780f1cc29ca] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:54.196232 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7b051750-d775-4bf9-9ae9-0f0d67b9162f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:54.196751 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7b051750-d775-4bf9-9ae9-0f0d67b9162f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:54.197216 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7b051750-d775-4bf9-9ae9-0f0d67b9162f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:54.197948 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7b051750-d775-4bf9-9ae9-0f0d67b9162f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:54.198427 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7b051750-d775-4bf9-9ae9-0f0d67b9162f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:54.199171 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7b051750-d775-4bf9-9ae9-0f0d67b9162f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:54.343135 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7b051750-d775-4bf9-9ae9-0f0d67b9162f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:39:54.351157 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7b051750-d775-4bf9-9ae9-0f0d67b9162f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca" status: 200 len: 1682 microversion: 2.1 time: 0.167952 Oct 04 19:39:54.351736 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3801/7616] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:39:54 2022] GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca => generated 1682 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:39:55.376978 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6e05b8ad-9e87-44ec-a450-2be47d4c2dea tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:55.377610 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6e05b8ad-9e87-44ec-a450-2be47d4c2dea tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 214e87c0-98fa-462e-a177-9780f1cc29ca] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:55.384706 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6e05b8ad-9e87-44ec-a450-2be47d4c2dea tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:55.385197 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6e05b8ad-9e87-44ec-a450-2be47d4c2dea tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:55.385643 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6e05b8ad-9e87-44ec-a450-2be47d4c2dea tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:55.386342 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6e05b8ad-9e87-44ec-a450-2be47d4c2dea tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:55.386807 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6e05b8ad-9e87-44ec-a450-2be47d4c2dea tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:55.387239 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6e05b8ad-9e87-44ec-a450-2be47d4c2dea tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:55.516682 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6e05b8ad-9e87-44ec-a450-2be47d4c2dea tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:39:55.524474 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6e05b8ad-9e87-44ec-a450-2be47d4c2dea tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca" status: 200 len: 1682 microversion: 2.1 time: 0.151530 Oct 04 19:39:55.525047 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3816/7617] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:39:55 2022] GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:39:56.549475 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ece18e44-dca0-422b-b1d9-2da71846fdd7 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:56.550116 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ece18e44-dca0-422b-b1d9-2da71846fdd7 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 214e87c0-98fa-462e-a177-9780f1cc29ca] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:56.557091 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ece18e44-dca0-422b-b1d9-2da71846fdd7 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:56.557598 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ece18e44-dca0-422b-b1d9-2da71846fdd7 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:56.558058 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ece18e44-dca0-422b-b1d9-2da71846fdd7 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:56.558771 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ece18e44-dca0-422b-b1d9-2da71846fdd7 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:56.559250 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ece18e44-dca0-422b-b1d9-2da71846fdd7 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:56.559698 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ece18e44-dca0-422b-b1d9-2da71846fdd7 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:56.698843 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ece18e44-dca0-422b-b1d9-2da71846fdd7 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:39:56.707237 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ece18e44-dca0-422b-b1d9-2da71846fdd7 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca" status: 200 len: 1682 microversion: 2.1 time: 0.162862 Oct 04 19:39:56.708437 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3802/7618] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:39:56 2022] GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:39:57.731746 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f67cd06b-1ed1-4f94-89a2-5d0332651325 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:57.732435 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f67cd06b-1ed1-4f94-89a2-5d0332651325 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 214e87c0-98fa-462e-a177-9780f1cc29ca] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:57.739428 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f67cd06b-1ed1-4f94-89a2-5d0332651325 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:57.739917 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f67cd06b-1ed1-4f94-89a2-5d0332651325 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:57.740390 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f67cd06b-1ed1-4f94-89a2-5d0332651325 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:57.741088 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f67cd06b-1ed1-4f94-89a2-5d0332651325 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:57.741545 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f67cd06b-1ed1-4f94-89a2-5d0332651325 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:57.741973 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f67cd06b-1ed1-4f94-89a2-5d0332651325 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:57.882222 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f67cd06b-1ed1-4f94-89a2-5d0332651325 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:39:57.890500 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f67cd06b-1ed1-4f94-89a2-5d0332651325 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca" status: 200 len: 1682 microversion: 2.1 time: 0.162668 Oct 04 19:39:57.891075 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3817/7619] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:39:57 2022] GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:39:58.914519 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-db1aa9a1-498b-482b-8f45-141e5424c2e7 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:58.915142 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-db1aa9a1-498b-482b-8f45-141e5424c2e7 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 214e87c0-98fa-462e-a177-9780f1cc29ca] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:58.922081 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-db1aa9a1-498b-482b-8f45-141e5424c2e7 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:58.922575 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-db1aa9a1-498b-482b-8f45-141e5424c2e7 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:58.923024 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-db1aa9a1-498b-482b-8f45-141e5424c2e7 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:58.923723 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-db1aa9a1-498b-482b-8f45-141e5424c2e7 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:58.924224 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-db1aa9a1-498b-482b-8f45-141e5424c2e7 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:58.924664 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-db1aa9a1-498b-482b-8f45-141e5424c2e7 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:59.059972 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-db1aa9a1-498b-482b-8f45-141e5424c2e7 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:39:59.068489 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-db1aa9a1-498b-482b-8f45-141e5424c2e7 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca" status: 200 len: 1682 microversion: 2.1 time: 0.157880 Oct 04 19:39:59.069069 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3803/7620] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:39:58 2022] GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:40:00.093691 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-21c14371-c4e4-4002-96e2-2ac1ea45e898 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:40:00.094244 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-21c14371-c4e4-4002-96e2-2ac1ea45e898 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 214e87c0-98fa-462e-a177-9780f1cc29ca] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:40:00.101407 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-21c14371-c4e4-4002-96e2-2ac1ea45e898 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:00.101901 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-21c14371-c4e4-4002-96e2-2ac1ea45e898 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:00.102348 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-21c14371-c4e4-4002-96e2-2ac1ea45e898 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:00.103050 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-21c14371-c4e4-4002-96e2-2ac1ea45e898 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:00.103512 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-21c14371-c4e4-4002-96e2-2ac1ea45e898 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:00.103942 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-21c14371-c4e4-4002-96e2-2ac1ea45e898 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:00.238816 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-21c14371-c4e4-4002-96e2-2ac1ea45e898 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:40:00.246572 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-21c14371-c4e4-4002-96e2-2ac1ea45e898 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca" status: 200 len: 1682 microversion: 2.1 time: 0.157779 Oct 04 19:40:00.248577 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3818/7621] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:40:00 2022] GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:40:01.270864 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f41233cf-8fe9-4529-afbc-005061b8a9f8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:40:01.271617 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f41233cf-8fe9-4529-afbc-005061b8a9f8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 214e87c0-98fa-462e-a177-9780f1cc29ca] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:40:01.280208 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f41233cf-8fe9-4529-afbc-005061b8a9f8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:01.280717 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f41233cf-8fe9-4529-afbc-005061b8a9f8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:01.281196 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f41233cf-8fe9-4529-afbc-005061b8a9f8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:01.281898 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f41233cf-8fe9-4529-afbc-005061b8a9f8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:01.282367 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f41233cf-8fe9-4529-afbc-005061b8a9f8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:01.282806 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f41233cf-8fe9-4529-afbc-005061b8a9f8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:01.413292 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f41233cf-8fe9-4529-afbc-005061b8a9f8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:40:01.421026 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f41233cf-8fe9-4529-afbc-005061b8a9f8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca" status: 200 len: 1682 microversion: 2.1 time: 0.154376 Oct 04 19:40:01.421604 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3804/7622] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:40:01 2022] GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:40:02.444929 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a859395e-700b-485e-912e-0fd98d19aefe tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:40:02.445549 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a859395e-700b-485e-912e-0fd98d19aefe tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 214e87c0-98fa-462e-a177-9780f1cc29ca] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:40:02.453001 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a859395e-700b-485e-912e-0fd98d19aefe tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:02.453490 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a859395e-700b-485e-912e-0fd98d19aefe tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:02.453956 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a859395e-700b-485e-912e-0fd98d19aefe tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:02.454655 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a859395e-700b-485e-912e-0fd98d19aefe tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:02.455116 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a859395e-700b-485e-912e-0fd98d19aefe tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:02.455547 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a859395e-700b-485e-912e-0fd98d19aefe tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:02.590886 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a859395e-700b-485e-912e-0fd98d19aefe tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:40:02.599790 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a859395e-700b-485e-912e-0fd98d19aefe tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca" status: 200 len: 1682 microversion: 2.1 time: 0.158768 Oct 04 19:40:02.600390 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3819/7623] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:40:02 2022] GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:40:03.624176 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-fb4cf1fe-00be-4cb0-9f6f-05e176a78b0f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:40:03.624835 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-fb4cf1fe-00be-4cb0-9f6f-05e176a78b0f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 214e87c0-98fa-462e-a177-9780f1cc29ca] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:40:03.632438 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fb4cf1fe-00be-4cb0-9f6f-05e176a78b0f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:03.632945 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fb4cf1fe-00be-4cb0-9f6f-05e176a78b0f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:03.633619 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fb4cf1fe-00be-4cb0-9f6f-05e176a78b0f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:03.634372 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fb4cf1fe-00be-4cb0-9f6f-05e176a78b0f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:03.634856 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fb4cf1fe-00be-4cb0-9f6f-05e176a78b0f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:03.635352 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fb4cf1fe-00be-4cb0-9f6f-05e176a78b0f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:03.771424 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-fb4cf1fe-00be-4cb0-9f6f-05e176a78b0f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:40:03.779859 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-fb4cf1fe-00be-4cb0-9f6f-05e176a78b0f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca" status: 200 len: 1682 microversion: 2.1 time: 0.159839 Oct 04 19:40:03.780467 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3805/7624] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:40:03 2022] GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:40:04.782270 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-5a15cc1c-5be6-4834-8377-e51d4eb72096 req-528fc0ff-854b-44a5-aee6-1b2848711bbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "214e87c0-98fa-462e-a177-9780f1cc29ca", "name": "network-vif-unplugged", "status": "completed", "tag": "9698f15e-00fe-490a-841b-6fe40fa3be47"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:40:04.793349 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-5a15cc1c-5be6-4834-8377-e51d4eb72096 req-528fc0ff-854b-44a5-aee6-1b2848711bbb service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:04.793830 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-5a15cc1c-5be6-4834-8377-e51d4eb72096 req-528fc0ff-854b-44a5-aee6-1b2848711bbb service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:04.794267 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-5a15cc1c-5be6-4834-8377-e51d4eb72096 req-528fc0ff-854b-44a5-aee6-1b2848711bbb service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:04.804351 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6326160c-a49c-4dad-a456-24683dc05030 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:40:04.804989 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-6326160c-a49c-4dad-a456-24683dc05030 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 214e87c0-98fa-462e-a177-9780f1cc29ca] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:40:04.807384 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-5a15cc1c-5be6-4834-8377-e51d4eb72096 req-528fc0ff-854b-44a5-aee6-1b2848711bbb service nova] Creating event network-vif-unplugged:9698f15e-00fe-490a-841b-6fe40fa3be47 for instance 214e87c0-98fa-462e-a177-9780f1cc29ca on n-h2-850501-14 Oct 04 19:40:04.813152 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6326160c-a49c-4dad-a456-24683dc05030 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:04.813656 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6326160c-a49c-4dad-a456-24683dc05030 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:04.813869 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [req-5a15cc1c-5be6-4834-8377-e51d4eb72096 req-528fc0ff-854b-44a5-aee6-1b2848711bbb service nova] Instance 214e87c0-98fa-462e-a177-9780f1cc29ca is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850501-14', 'n-h2-850501-14'} {{(pid=123001) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:40:04.814107 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6326160c-a49c-4dad-a456-24683dc05030 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:04.814819 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6326160c-a49c-4dad-a456-24683dc05030 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:04.815285 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6326160c-a49c-4dad-a456-24683dc05030 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:04.815729 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6326160c-a49c-4dad-a456-24683dc05030 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:04.824819 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-5a15cc1c-5be6-4834-8377-e51d4eb72096 req-528fc0ff-854b-44a5-aee6-1b2848711bbb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046370 Oct 04 19:40:04.825461 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3820/7625] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:40:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:40:04.956022 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-6326160c-a49c-4dad-a456-24683dc05030 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:40:04.964065 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6326160c-a49c-4dad-a456-24683dc05030 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca" status: 200 len: 1681 microversion: 2.1 time: 0.163688 Oct 04 19:40:04.964982 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3806/7626] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:40:04 2022] GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:40:05.991001 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-78bda515-8565-4bdc-8c0f-b55b95d9e6dc tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:40:05.991727 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-78bda515-8565-4bdc-8c0f-b55b95d9e6dc tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 214e87c0-98fa-462e-a177-9780f1cc29ca] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:40:05.998622 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-78bda515-8565-4bdc-8c0f-b55b95d9e6dc tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:05.999104 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-78bda515-8565-4bdc-8c0f-b55b95d9e6dc tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:05.999583 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-78bda515-8565-4bdc-8c0f-b55b95d9e6dc tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:06.000307 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-78bda515-8565-4bdc-8c0f-b55b95d9e6dc tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:06.000762 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-78bda515-8565-4bdc-8c0f-b55b95d9e6dc tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:06.001187 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-78bda515-8565-4bdc-8c0f-b55b95d9e6dc tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:06.143652 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-78bda515-8565-4bdc-8c0f-b55b95d9e6dc tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:40:06.150285 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-78bda515-8565-4bdc-8c0f-b55b95d9e6dc tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca" status: 200 len: 1681 microversion: 2.1 time: 0.163783 Oct 04 19:40:06.151070 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3821/7627] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:40:05 2022] GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:40:06.839047 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-ed9f29f2-7d92-4e10-9dd1-3b13f99424a8 req-5fe5048f-3885-4c46-aaf9-b3a508805462 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "214e87c0-98fa-462e-a177-9780f1cc29ca", "tag": "9698f15e-00fe-490a-841b-6fe40fa3be47"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:40:06.850219 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-ed9f29f2-7d92-4e10-9dd1-3b13f99424a8 req-5fe5048f-3885-4c46-aaf9-b3a508805462 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:06.850711 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-ed9f29f2-7d92-4e10-9dd1-3b13f99424a8 req-5fe5048f-3885-4c46-aaf9-b3a508805462 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:06.851154 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-ed9f29f2-7d92-4e10-9dd1-3b13f99424a8 req-5fe5048f-3885-4c46-aaf9-b3a508805462 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:06.862993 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-ed9f29f2-7d92-4e10-9dd1-3b13f99424a8 req-5fe5048f-3885-4c46-aaf9-b3a508805462 service nova] Creating event network-changed:9698f15e-00fe-490a-841b-6fe40fa3be47 for instance 214e87c0-98fa-462e-a177-9780f1cc29ca on n-h2-850501-14 Oct 04 19:40:06.868250 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [req-ed9f29f2-7d92-4e10-9dd1-3b13f99424a8 req-5fe5048f-3885-4c46-aaf9-b3a508805462 service nova] Instance 214e87c0-98fa-462e-a177-9780f1cc29ca is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850501-14', 'n-h2-850501-14'} {{(pid=123002) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:40:06.879551 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-ed9f29f2-7d92-4e10-9dd1-3b13f99424a8 req-5fe5048f-3885-4c46-aaf9-b3a508805462 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044262 Oct 04 19:40:06.880174 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3807/7628] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:40:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:40:07.177253 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-32748da7-c875-4df9-9f62-80473fed12c2 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:40:07.177253 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-32748da7-c875-4df9-9f62-80473fed12c2 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 214e87c0-98fa-462e-a177-9780f1cc29ca] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:40:07.182205 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-32748da7-c875-4df9-9f62-80473fed12c2 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:07.182692 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-32748da7-c875-4df9-9f62-80473fed12c2 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:07.183130 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-32748da7-c875-4df9-9f62-80473fed12c2 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:07.183822 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-32748da7-c875-4df9-9f62-80473fed12c2 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:07.184300 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-32748da7-c875-4df9-9f62-80473fed12c2 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:07.184726 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-32748da7-c875-4df9-9f62-80473fed12c2 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:07.432957 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-32748da7-c875-4df9-9f62-80473fed12c2 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:40:07.440851 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-32748da7-c875-4df9-9f62-80473fed12c2 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca" status: 200 len: 1679 microversion: 2.1 time: 0.269784 Oct 04 19:40:07.441441 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3822/7629] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:40:07 2022] GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca => generated 1679 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:40:08.465249 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7d22c8fa-4805-40e6-ad95-3dd2962024c7 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:40:08.466100 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7d22c8fa-4805-40e6-ad95-3dd2962024c7 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 214e87c0-98fa-462e-a177-9780f1cc29ca] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:40:08.474130 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7d22c8fa-4805-40e6-ad95-3dd2962024c7 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:08.474632 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7d22c8fa-4805-40e6-ad95-3dd2962024c7 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:08.475091 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7d22c8fa-4805-40e6-ad95-3dd2962024c7 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:08.475798 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7d22c8fa-4805-40e6-ad95-3dd2962024c7 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:08.476325 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7d22c8fa-4805-40e6-ad95-3dd2962024c7 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:08.476770 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7d22c8fa-4805-40e6-ad95-3dd2962024c7 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:08.612384 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7d22c8fa-4805-40e6-ad95-3dd2962024c7 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:40:08.620299 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7d22c8fa-4805-40e6-ad95-3dd2962024c7 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca" status: 200 len: 1679 microversion: 2.1 time: 0.159374 Oct 04 19:40:08.620893 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3808/7630] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:40:08 2022] GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:40:09.643776 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a9ffc3a8-17d9-442c-9569-7e39c81af9da tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:40:09.644425 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a9ffc3a8-17d9-442c-9569-7e39c81af9da tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 214e87c0-98fa-462e-a177-9780f1cc29ca] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:40:09.651372 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a9ffc3a8-17d9-442c-9569-7e39c81af9da tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:09.651862 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a9ffc3a8-17d9-442c-9569-7e39c81af9da tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:09.652341 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a9ffc3a8-17d9-442c-9569-7e39c81af9da tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:09.653041 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a9ffc3a8-17d9-442c-9569-7e39c81af9da tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:09.653499 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a9ffc3a8-17d9-442c-9569-7e39c81af9da tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:09.654457 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a9ffc3a8-17d9-442c-9569-7e39c81af9da tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:09.803374 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a9ffc3a8-17d9-442c-9569-7e39c81af9da tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:40:09.814163 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a9ffc3a8-17d9-442c-9569-7e39c81af9da tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca" status: 200 len: 1679 microversion: 2.1 time: 0.174130 Oct 04 19:40:09.818731 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3823/7631] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:40:09 2022] GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca => generated 1679 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:40:10.839000 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-419fa8ce-5e86-4833-a322-25ba36eded04 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:40:10.839564 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-419fa8ce-5e86-4833-a322-25ba36eded04 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 214e87c0-98fa-462e-a177-9780f1cc29ca] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:40:10.846740 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-419fa8ce-5e86-4833-a322-25ba36eded04 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:10.847245 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-419fa8ce-5e86-4833-a322-25ba36eded04 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:10.847704 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-419fa8ce-5e86-4833-a322-25ba36eded04 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:10.848445 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-419fa8ce-5e86-4833-a322-25ba36eded04 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:10.848923 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-419fa8ce-5e86-4833-a322-25ba36eded04 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:10.849372 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-419fa8ce-5e86-4833-a322-25ba36eded04 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:10.978969 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-419fa8ce-5e86-4833-a322-25ba36eded04 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:40:10.987358 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-419fa8ce-5e86-4833-a322-25ba36eded04 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca" status: 200 len: 1676 microversion: 2.1 time: 0.152415 Oct 04 19:40:10.987940 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3809/7632] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:40:10 2022] GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:40:11.009970 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a3bb964a-ac3f-42b7-bc9c-dbb0612e80e3 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:40:11.010514 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a3bb964a-ac3f-42b7-bc9c-dbb0612e80e3 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 214e87c0-98fa-462e-a177-9780f1cc29ca] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:40:11.017470 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a3bb964a-ac3f-42b7-bc9c-dbb0612e80e3 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:11.017967 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a3bb964a-ac3f-42b7-bc9c-dbb0612e80e3 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:11.018410 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a3bb964a-ac3f-42b7-bc9c-dbb0612e80e3 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:11.019112 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a3bb964a-ac3f-42b7-bc9c-dbb0612e80e3 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:11.019570 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a3bb964a-ac3f-42b7-bc9c-dbb0612e80e3 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:11.020005 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a3bb964a-ac3f-42b7-bc9c-dbb0612e80e3 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:11.057908 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a3bb964a-ac3f-42b7-bc9c-dbb0612e80e3 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:11.058393 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a3bb964a-ac3f-42b7-bc9c-dbb0612e80e3 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:11.058834 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a3bb964a-ac3f-42b7-bc9c-dbb0612e80e3 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:11.059561 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a3bb964a-ac3f-42b7-bc9c-dbb0612e80e3 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:11.060423 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a3bb964a-ac3f-42b7-bc9c-dbb0612e80e3 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:11.060631 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a3bb964a-ac3f-42b7-bc9c-dbb0612e80e3 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:11.081158 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-a3bb964a-ac3f-42b7-bc9c-dbb0612e80e3 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Getting quotas for project 56eff05b035a45e0afc0f92d9d85e136. Resources: {'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:40:11.086344 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-a3bb964a-ac3f-42b7-bc9c-dbb0612e80e3 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Getting quotas for user 6970aa4f091c49e382c86a487d25d524 and project 56eff05b035a45e0afc0f92d9d85e136. Resources: {'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:40:11.323127 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:40:11.389448 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a3bb964a-ac3f-42b7-bc9c-dbb0612e80e3 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "POST /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca/action" status: 202 len: 0 microversion: 2.1 time: 0.383165 Oct 04 19:40:11.390072 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3824/7633] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 19:40:11 2022] POST /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca/action => generated 0 bytes in 385 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:40:11.398526 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c352f767-d0c1-4720-9cf1-5027acc1e4d3 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:40:11.399214 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c352f767-d0c1-4720-9cf1-5027acc1e4d3 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 214e87c0-98fa-462e-a177-9780f1cc29ca] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:40:11.405988 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c352f767-d0c1-4720-9cf1-5027acc1e4d3 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:11.406524 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c352f767-d0c1-4720-9cf1-5027acc1e4d3 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:11.406959 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c352f767-d0c1-4720-9cf1-5027acc1e4d3 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:11.407680 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c352f767-d0c1-4720-9cf1-5027acc1e4d3 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:11.408177 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c352f767-d0c1-4720-9cf1-5027acc1e4d3 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:11.408624 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c352f767-d0c1-4720-9cf1-5027acc1e4d3 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:11.552712 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c352f767-d0c1-4720-9cf1-5027acc1e4d3 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:40:11.560778 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c352f767-d0c1-4720-9cf1-5027acc1e4d3 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca" status: 200 len: 1675 microversion: 2.1 time: 0.166073 Oct 04 19:40:11.573300 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3810/7634] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:40:11 2022] GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca => generated 1675 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:40:11.786342 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-889d715d-2fbd-42f6-b1dc-fc4e567dffbf req-b2b256f9-25b9-482d-8923-a88d22d0b91e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "214e87c0-98fa-462e-a177-9780f1cc29ca", "name": "network-vif-plugged", "status": "completed", "tag": "9698f15e-00fe-490a-841b-6fe40fa3be47"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:40:11.797190 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-889d715d-2fbd-42f6-b1dc-fc4e567dffbf req-b2b256f9-25b9-482d-8923-a88d22d0b91e service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:11.797680 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-889d715d-2fbd-42f6-b1dc-fc4e567dffbf req-b2b256f9-25b9-482d-8923-a88d22d0b91e service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:11.798116 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-889d715d-2fbd-42f6-b1dc-fc4e567dffbf req-b2b256f9-25b9-482d-8923-a88d22d0b91e service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:11.810557 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-889d715d-2fbd-42f6-b1dc-fc4e567dffbf req-b2b256f9-25b9-482d-8923-a88d22d0b91e service nova] Creating event network-vif-plugged:9698f15e-00fe-490a-841b-6fe40fa3be47 for instance 214e87c0-98fa-462e-a177-9780f1cc29ca on n-h2-850501-14 Oct 04 19:40:11.816145 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [req-889d715d-2fbd-42f6-b1dc-fc4e567dffbf req-b2b256f9-25b9-482d-8923-a88d22d0b91e service nova] Instance 214e87c0-98fa-462e-a177-9780f1cc29ca is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850501-14', 'n-h2-850501-14'} {{(pid=123001) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:40:11.827687 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-889d715d-2fbd-42f6-b1dc-fc4e567dffbf req-b2b256f9-25b9-482d-8923-a88d22d0b91e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046082 Oct 04 19:40:11.828685 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3825/7635] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:40:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:40:12.585004 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c2eb54b1-648e-4b45-9614-d4dca5f62685 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:40:12.585640 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c2eb54b1-648e-4b45-9614-d4dca5f62685 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 214e87c0-98fa-462e-a177-9780f1cc29ca] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:40:12.592681 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c2eb54b1-648e-4b45-9614-d4dca5f62685 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:12.593190 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c2eb54b1-648e-4b45-9614-d4dca5f62685 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:12.593651 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c2eb54b1-648e-4b45-9614-d4dca5f62685 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:12.594383 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c2eb54b1-648e-4b45-9614-d4dca5f62685 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:12.594841 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c2eb54b1-648e-4b45-9614-d4dca5f62685 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:12.595290 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c2eb54b1-648e-4b45-9614-d4dca5f62685 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:12.614120 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:40:12.735838 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c2eb54b1-648e-4b45-9614-d4dca5f62685 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:40:12.746303 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c2eb54b1-648e-4b45-9614-d4dca5f62685 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca" status: 200 len: 1675 microversion: 2.1 time: 0.165301 Oct 04 19:40:12.746902 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3811/7636] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:40:12 2022] GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca => generated 1675 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:40:13.772222 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e751d201-776e-4864-a742-59bc1aee3e9a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:40:13.772908 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e751d201-776e-4864-a742-59bc1aee3e9a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 214e87c0-98fa-462e-a177-9780f1cc29ca] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:40:13.776355 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:40:13.782636 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e751d201-776e-4864-a742-59bc1aee3e9a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:13.783128 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e751d201-776e-4864-a742-59bc1aee3e9a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:13.783559 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e751d201-776e-4864-a742-59bc1aee3e9a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:13.784281 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e751d201-776e-4864-a742-59bc1aee3e9a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:13.784735 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e751d201-776e-4864-a742-59bc1aee3e9a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:13.785158 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e751d201-776e-4864-a742-59bc1aee3e9a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:13.925153 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e751d201-776e-4864-a742-59bc1aee3e9a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:40:13.932928 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e751d201-776e-4864-a742-59bc1aee3e9a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca" status: 200 len: 1675 microversion: 2.1 time: 0.165625 Oct 04 19:40:13.933505 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3826/7637] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:40:13 2022] GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca => generated 1675 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:40:14.961032 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3e3b2a0c-e953-4fc7-aac7-a7d70123b7fe tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:40:14.961670 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3e3b2a0c-e953-4fc7-aac7-a7d70123b7fe tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 214e87c0-98fa-462e-a177-9780f1cc29ca] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:40:14.965520 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=37 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:40:14.969524 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3e3b2a0c-e953-4fc7-aac7-a7d70123b7fe tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:14.970025 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3e3b2a0c-e953-4fc7-aac7-a7d70123b7fe tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:14.970482 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3e3b2a0c-e953-4fc7-aac7-a7d70123b7fe tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:14.971458 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3e3b2a0c-e953-4fc7-aac7-a7d70123b7fe tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:14.971935 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3e3b2a0c-e953-4fc7-aac7-a7d70123b7fe tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:14.972410 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3e3b2a0c-e953-4fc7-aac7-a7d70123b7fe tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:15.185196 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3e3b2a0c-e953-4fc7-aac7-a7d70123b7fe tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:40:15.194038 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3e3b2a0c-e953-4fc7-aac7-a7d70123b7fe tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca" status: 200 len: 1675 microversion: 2.1 time: 0.237114 Oct 04 19:40:15.198721 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3812/7638] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:40:14 2022] GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca => generated 1675 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:40:15.467722 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-9f37ff47-595a-47bc-8110-4952c4e75fc8 req-dfbee197-e2dd-4e18-a902-9da494ed1e8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "214e87c0-98fa-462e-a177-9780f1cc29ca", "name": "network-vif-unplugged", "status": "completed", "tag": "9698f15e-00fe-490a-841b-6fe40fa3be47"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:40:15.477840 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-9f37ff47-595a-47bc-8110-4952c4e75fc8 req-dfbee197-e2dd-4e18-a902-9da494ed1e8b service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:15.478337 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-9f37ff47-595a-47bc-8110-4952c4e75fc8 req-dfbee197-e2dd-4e18-a902-9da494ed1e8b service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:15.478781 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-9f37ff47-595a-47bc-8110-4952c4e75fc8 req-dfbee197-e2dd-4e18-a902-9da494ed1e8b service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:15.490767 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-9f37ff47-595a-47bc-8110-4952c4e75fc8 req-dfbee197-e2dd-4e18-a902-9da494ed1e8b service nova] Creating event network-vif-unplugged:9698f15e-00fe-490a-841b-6fe40fa3be47 for instance 214e87c0-98fa-462e-a177-9780f1cc29ca on n-h1-850501-14 Oct 04 19:40:15.496023 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [req-9f37ff47-595a-47bc-8110-4952c4e75fc8 req-dfbee197-e2dd-4e18-a902-9da494ed1e8b service nova] Instance 214e87c0-98fa-462e-a177-9780f1cc29ca is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850501-14', 'n-h2-850501-14'} {{(pid=123001) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:40:15.507424 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-9f37ff47-595a-47bc-8110-4952c4e75fc8 req-dfbee197-e2dd-4e18-a902-9da494ed1e8b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043528 Oct 04 19:40:15.508041 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3827/7639] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:40:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:40:16.218670 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-fb1d2918-6a0e-46ca-98c9-81054f21ddb8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:40:16.219308 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-fb1d2918-6a0e-46ca-98c9-81054f21ddb8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 214e87c0-98fa-462e-a177-9780f1cc29ca] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:40:16.227210 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fb1d2918-6a0e-46ca-98c9-81054f21ddb8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:16.227715 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fb1d2918-6a0e-46ca-98c9-81054f21ddb8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:16.228197 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fb1d2918-6a0e-46ca-98c9-81054f21ddb8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:16.228950 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fb1d2918-6a0e-46ca-98c9-81054f21ddb8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:16.229432 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fb1d2918-6a0e-46ca-98c9-81054f21ddb8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:16.229875 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fb1d2918-6a0e-46ca-98c9-81054f21ddb8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:16.443362 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-fb1d2918-6a0e-46ca-98c9-81054f21ddb8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:40:16.452190 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-fb1d2918-6a0e-46ca-98c9-81054f21ddb8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca" status: 200 len: 1675 microversion: 2.1 time: 0.237286 Oct 04 19:40:16.452918 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3813/7640] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:40:16 2022] GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca => generated 1675 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:40:17.478537 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-000c550d-331d-461a-adb5-d4042d4a159b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:40:17.479335 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-000c550d-331d-461a-adb5-d4042d4a159b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 214e87c0-98fa-462e-a177-9780f1cc29ca] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:40:17.486189 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-000c550d-331d-461a-adb5-d4042d4a159b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:17.486676 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-000c550d-331d-461a-adb5-d4042d4a159b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:17.487119 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-000c550d-331d-461a-adb5-d4042d4a159b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:17.487807 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-000c550d-331d-461a-adb5-d4042d4a159b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:17.488306 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-000c550d-331d-461a-adb5-d4042d4a159b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:17.488734 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-000c550d-331d-461a-adb5-d4042d4a159b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:17.522979 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-4bd295a2-16ec-45a2-bbe3-3ddd0bd3e1b4 req-4a07be41-a9fd-40f2-9418-6581f649a54b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "214e87c0-98fa-462e-a177-9780f1cc29ca", "tag": "9698f15e-00fe-490a-841b-6fe40fa3be47"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:40:17.534680 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-4bd295a2-16ec-45a2-bbe3-3ddd0bd3e1b4 req-4a07be41-a9fd-40f2-9418-6581f649a54b service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:17.535184 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-4bd295a2-16ec-45a2-bbe3-3ddd0bd3e1b4 req-4a07be41-a9fd-40f2-9418-6581f649a54b service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:17.535630 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-4bd295a2-16ec-45a2-bbe3-3ddd0bd3e1b4 req-4a07be41-a9fd-40f2-9418-6581f649a54b service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:17.548312 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-4bd295a2-16ec-45a2-bbe3-3ddd0bd3e1b4 req-4a07be41-a9fd-40f2-9418-6581f649a54b service nova] Creating event network-changed:9698f15e-00fe-490a-841b-6fe40fa3be47 for instance 214e87c0-98fa-462e-a177-9780f1cc29ca on n-h1-850501-14 Oct 04 19:40:17.553927 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [req-4bd295a2-16ec-45a2-bbe3-3ddd0bd3e1b4 req-4a07be41-a9fd-40f2-9418-6581f649a54b service nova] Instance 214e87c0-98fa-462e-a177-9780f1cc29ca is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850501-14', 'n-h2-850501-14'} {{(pid=123002) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:40:17.565465 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-4bd295a2-16ec-45a2-bbe3-3ddd0bd3e1b4 req-4a07be41-a9fd-40f2-9418-6581f649a54b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046170 Oct 04 19:40:17.566293 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3814/7641] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:40:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:40:17.631346 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-000c550d-331d-461a-adb5-d4042d4a159b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:40:17.639882 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-000c550d-331d-461a-adb5-d4042d4a159b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca" status: 200 len: 1675 microversion: 2.1 time: 0.166185 Oct 04 19:40:17.640515 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3828/7642] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:40:17 2022] GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca => generated 1675 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:40:18.666319 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d908b1a8-1293-43d3-85f4-ccc78de8d742 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:40:18.667070 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d908b1a8-1293-43d3-85f4-ccc78de8d742 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 214e87c0-98fa-462e-a177-9780f1cc29ca] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:40:18.673755 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d908b1a8-1293-43d3-85f4-ccc78de8d742 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:18.674258 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d908b1a8-1293-43d3-85f4-ccc78de8d742 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:18.674765 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d908b1a8-1293-43d3-85f4-ccc78de8d742 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:18.675522 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d908b1a8-1293-43d3-85f4-ccc78de8d742 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:18.676000 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d908b1a8-1293-43d3-85f4-ccc78de8d742 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:18.676466 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d908b1a8-1293-43d3-85f4-ccc78de8d742 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:18.823602 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d908b1a8-1293-43d3-85f4-ccc78de8d742 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:40:18.832221 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d908b1a8-1293-43d3-85f4-ccc78de8d742 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca" status: 200 len: 1668 microversion: 2.1 time: 0.171082 Oct 04 19:40:18.832823 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3815/7643] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:40:18 2022] GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca => generated 1668 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:40:18.856232 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a5449d07-324c-47cc-945b-0a30758a7482 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:40:18.856937 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a5449d07-324c-47cc-945b-0a30758a7482 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 214e87c0-98fa-462e-a177-9780f1cc29ca] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:40:18.864745 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a5449d07-324c-47cc-945b-0a30758a7482 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:18.865231 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a5449d07-324c-47cc-945b-0a30758a7482 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:18.865672 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a5449d07-324c-47cc-945b-0a30758a7482 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:18.866365 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a5449d07-324c-47cc-945b-0a30758a7482 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:18.866823 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a5449d07-324c-47cc-945b-0a30758a7482 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:18.867252 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a5449d07-324c-47cc-945b-0a30758a7482 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:19.002879 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a5449d07-324c-47cc-945b-0a30758a7482 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:40:19.011419 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a5449d07-324c-47cc-945b-0a30758a7482 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca" status: 200 len: 1668 microversion: 2.1 time: 0.159067 Oct 04 19:40:19.012288 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3829/7644] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:40:18 2022] GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca => generated 1668 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:40:19.034190 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8cfbc4b1-2224-479b-9a78-09f63d771d36 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:40:19.034815 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8cfbc4b1-2224-479b-9a78-09f63d771d36 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 214e87c0-98fa-462e-a177-9780f1cc29ca] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:40:19.040916 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8cfbc4b1-2224-479b-9a78-09f63d771d36 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:19.041413 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8cfbc4b1-2224-479b-9a78-09f63d771d36 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:19.041855 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8cfbc4b1-2224-479b-9a78-09f63d771d36 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:19.042557 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8cfbc4b1-2224-479b-9a78-09f63d771d36 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:19.043024 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8cfbc4b1-2224-479b-9a78-09f63d771d36 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:19.043462 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8cfbc4b1-2224-479b-9a78-09f63d771d36 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:19.180234 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8cfbc4b1-2224-479b-9a78-09f63d771d36 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:40:19.189157 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8cfbc4b1-2224-479b-9a78-09f63d771d36 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca" status: 200 len: 1668 microversion: 2.1 time: 0.158947 Oct 04 19:40:19.189877 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3816/7645] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:40:19 2022] GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca => generated 1668 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:40:19.216318 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ac7a71f5-07e7-401c-b735-042c55ea53b4 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:40:19.216821 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ac7a71f5-07e7-401c-b735-042c55ea53b4 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 214e87c0-98fa-462e-a177-9780f1cc29ca] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:40:19.224370 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ac7a71f5-07e7-401c-b735-042c55ea53b4 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:19.224856 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ac7a71f5-07e7-401c-b735-042c55ea53b4 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:19.225298 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ac7a71f5-07e7-401c-b735-042c55ea53b4 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:19.225988 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ac7a71f5-07e7-401c-b735-042c55ea53b4 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:19.226446 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ac7a71f5-07e7-401c-b735-042c55ea53b4 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:19.226870 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ac7a71f5-07e7-401c-b735-042c55ea53b4 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:19.253742 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ac7a71f5-07e7-401c-b735-042c55ea53b4 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 214e87c0-98fa-462e-a177-9780f1cc29ca] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:40:19.579939 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ac7a71f5-07e7-401c-b735-042c55ea53b4 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "DELETE /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca" status: 204 len: 0 microversion: 2.1 time: 0.367338 Oct 04 19:40:19.580596 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3830/7646] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 19:40:19 2022] DELETE /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:40:19.589009 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1983c1ab-3347-4fc7-882f-afa16189ef40 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:40:19.589642 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1983c1ab-3347-4fc7-882f-afa16189ef40 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 214e87c0-98fa-462e-a177-9780f1cc29ca] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:40:19.596308 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1983c1ab-3347-4fc7-882f-afa16189ef40 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:19.596801 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1983c1ab-3347-4fc7-882f-afa16189ef40 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:19.597252 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1983c1ab-3347-4fc7-882f-afa16189ef40 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:19.597949 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1983c1ab-3347-4fc7-882f-afa16189ef40 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:19.598413 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1983c1ab-3347-4fc7-882f-afa16189ef40 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:19.598847 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1983c1ab-3347-4fc7-882f-afa16189ef40 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:19.735289 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1983c1ab-3347-4fc7-882f-afa16189ef40 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:40:19.743738 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1983c1ab-3347-4fc7-882f-afa16189ef40 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca" status: 200 len: 1674 microversion: 2.1 time: 0.158482 Oct 04 19:40:19.744737 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3817/7647] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:40:19 2022] GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca => generated 1674 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:40:20.770747 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-bc2b14a5-327f-49a0-9afc-01d1d9af7f6e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:40:20.771368 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-bc2b14a5-327f-49a0-9afc-01d1d9af7f6e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 214e87c0-98fa-462e-a177-9780f1cc29ca] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:40:20.777890 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bc2b14a5-327f-49a0-9afc-01d1d9af7f6e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:20.778370 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bc2b14a5-327f-49a0-9afc-01d1d9af7f6e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:20.778801 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bc2b14a5-327f-49a0-9afc-01d1d9af7f6e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:20.780272 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bc2b14a5-327f-49a0-9afc-01d1d9af7f6e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:20.780770 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bc2b14a5-327f-49a0-9afc-01d1d9af7f6e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:20.781160 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bc2b14a5-327f-49a0-9afc-01d1d9af7f6e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:20.988615 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-bc2b14a5-327f-49a0-9afc-01d1d9af7f6e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:40:20.996587 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-bc2b14a5-327f-49a0-9afc-01d1d9af7f6e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca" status: 200 len: 1674 microversion: 2.1 time: 0.230438 Oct 04 19:40:20.997263 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3831/7648] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:40:20 2022] GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca => generated 1674 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:40:22.023451 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-82709a90-0877-4db3-bf7d-dbeff935b700 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:40:22.024238 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-82709a90-0877-4db3-bf7d-dbeff935b700 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 214e87c0-98fa-462e-a177-9780f1cc29ca] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:40:22.032027 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-82709a90-0877-4db3-bf7d-dbeff935b700 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:22.032564 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-82709a90-0877-4db3-bf7d-dbeff935b700 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:22.033024 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-82709a90-0877-4db3-bf7d-dbeff935b700 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:22.033752 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-82709a90-0877-4db3-bf7d-dbeff935b700 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:22.034392 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-82709a90-0877-4db3-bf7d-dbeff935b700 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:22.035078 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-82709a90-0877-4db3-bf7d-dbeff935b700 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:22.130594 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-82709a90-0877-4db3-bf7d-dbeff935b700 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:40:22.142136 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-514e82cd-1a3b-4621-9941-67e0fabd3445 req-5f071dc7-85f2-4bdc-823a-0a28b4ae3069 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "214e87c0-98fa-462e-a177-9780f1cc29ca", "name": "network-vif-deleted", "tag": "9698f15e-00fe-490a-841b-6fe40fa3be47"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:40:22.146793 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-82709a90-0877-4db3-bf7d-dbeff935b700 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca" status: 200 len: 1607 microversion: 2.1 time: 0.129517 Oct 04 19:40:22.149029 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3818/7649] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:40:22 2022] GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca => generated 1607 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:40:22.152323 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=3 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:40:22.156391 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-514e82cd-1a3b-4621-9941-67e0fabd3445 req-5f071dc7-85f2-4bdc-823a-0a28b4ae3069 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:22.156898 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-514e82cd-1a3b-4621-9941-67e0fabd3445 req-5f071dc7-85f2-4bdc-823a-0a28b4ae3069 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:22.160952 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-514e82cd-1a3b-4621-9941-67e0fabd3445 req-5f071dc7-85f2-4bdc-823a-0a28b4ae3069 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:22.169354 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-514e82cd-1a3b-4621-9941-67e0fabd3445 req-5f071dc7-85f2-4bdc-823a-0a28b4ae3069 service nova] Creating event network-vif-deleted:9698f15e-00fe-490a-841b-6fe40fa3be47 for instance 214e87c0-98fa-462e-a177-9780f1cc29ca on n-h1-850501-14 Oct 04 19:40:22.175288 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-514e82cd-1a3b-4621-9941-67e0fabd3445 req-5f071dc7-85f2-4bdc-823a-0a28b4ae3069 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037528 Oct 04 19:40:22.175887 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3832/7650] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:40:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:40:23.171854 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a681ef84-3185-4f03-8dd8-4e86245127f7 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:40:23.172615 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a681ef84-3185-4f03-8dd8-4e86245127f7 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 214e87c0-98fa-462e-a177-9780f1cc29ca] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:40:23.179810 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a681ef84-3185-4f03-8dd8-4e86245127f7 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:23.180337 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a681ef84-3185-4f03-8dd8-4e86245127f7 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:23.180803 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a681ef84-3185-4f03-8dd8-4e86245127f7 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:23.181518 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a681ef84-3185-4f03-8dd8-4e86245127f7 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:23.181985 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a681ef84-3185-4f03-8dd8-4e86245127f7 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:23.182427 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a681ef84-3185-4f03-8dd8-4e86245127f7 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:23.196983 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-a681ef84-3185-4f03-8dd8-4e86245127f7 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] HTTP exception thrown: Instance 214e87c0-98fa-462e-a177-9780f1cc29ca could not be found. Oct 04 19:40:23.198716 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a681ef84-3185-4f03-8dd8-4e86245127f7 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Request method failure captured: Oct 04 19:40:23.198716 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca HTTP/1.1 Oct 04 19:40:23.198716 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 19:40:23.198716 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 19:40:23.198716 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 19:40:23.198716 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 19:40:23.198716 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 19:40:23.198716 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 19:40:23.198716 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 19:40:23.198716 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 19:40:23.198716 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPIsCyZ9ujYHj7xAc9v5FsVDNBnhQXdRu3HrD7Tq5GQWPtceXFx7qoWJz7lP8l4zGdRoz3AIMETvWSaNf7C0jkbsq4Fdp5SR34bQhmUN7dN-TqhYTJpmcPItgyv3Ip6rfSesFJ9T-vVra0xTUsrYnfVdo1LIR9dDYTmgb9RW4N3wBj3M Oct 04 19:40:23.198716 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 19:40:23.198716 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 19:40:23.198716 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 19:40:23.198716 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 19:40:23.198716 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 19:40:23.198716 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 19:40:23.198716 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 56eff05b035a45e0afc0f92d9d85e136 Oct 04 19:40:23.198716 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServerActionsTestJSON-2139592700 Oct 04 19:40:23.198716 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 19:40:23.198716 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 19:40:23.198716 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/56eff05b035a45e0afc0f92d9d85e136"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_56eff05b035a45e0afc0f92d9d85e136", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/56eff05b035a45e0afc0f92d9d85e136"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/56eff05b035a45e0afc0f92d9d85e136"}]}] Oct 04 19:40:23.198716 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServerActionsTestJSON-2139592700 Oct 04 19:40:23.198716 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 56eff05b035a45e0afc0f92d9d85e136 Oct 04 19:40:23.198716 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServerActionsTestJSON-2139592700 Oct 04 19:40:23.198716 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServerActionsTestJSON-2139592700-project Oct 04 19:40:23.198716 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 19:40:23.198716 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 19:40:23.198716 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 6970aa4f091c49e382c86a487d25d524 Oct 04 19:40:23.198716 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServerActionsTestJSON-2139592700-project Oct 04 19:40:23.198716 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 19:40:23.198716 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 214e87c0-98fa-462e-a177-9780f1cc29ca could not be found. Oct 04 19:40:23.198716 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '214e87c0-98fa-462e-a177-9780f1cc29ca'} Oct 04 19:40:23.198716 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:40:23.198716 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:40:23.198716 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:40:23.198716 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:40:23.198716 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:40:23.198716 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:40:23.198716 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:40:23.198716 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:40:23.198716 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:40:23.198716 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:40:23.198716 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 214e87c0-98fa-462e-a177-9780f1cc29ca could not be found. Oct 04 19:40:23.198716 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:40:23.198716 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:40:23.198716 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:40:23.198716 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:40:23.198716 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:40:23.198716 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:40:23.198716 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:40:23.198716 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:40:23.198716 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:40:23.198716 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:40:23.198716 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:40:23.198716 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:40:23.198716 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:40:23.198716 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:40:23.198716 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:40:23.198716 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:40:23.198716 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 214e87c0-98fa-462e-a177-9780f1cc29ca could not be found. Oct 04 19:40:23.198716 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:40:23.198716 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:40:23.198716 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:40:23.203964 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:40:23.203964 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:40:23.203964 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:40:23.203964 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:40:23.203964 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:40:23.203964 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 214e87c0-98fa-462e-a177-9780f1cc29ca could not be found. Oct 04 19:40:23.203964 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:40:23.203964 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a681ef84-3185-4f03-8dd8-4e86245127f7 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Returning 404 to user: Instance 214e87c0-98fa-462e-a177-9780f1cc29ca could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:40:23.203964 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a681ef84-3185-4f03-8dd8-4e86245127f7 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca" status: 404 len: 111 microversion: 2.1 time: 0.033100 Oct 04 19:40:23.203964 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3819/7651] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:40:23 2022] GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:40:23.222770 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-76424535-6c5f-4876-826b-7bfe846118e9 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:40:23.223507 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-76424535-6c5f-4876-826b-7bfe846118e9 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 214e87c0-98fa-462e-a177-9780f1cc29ca] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:40:23.229794 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-76424535-6c5f-4876-826b-7bfe846118e9 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:23.230314 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-76424535-6c5f-4876-826b-7bfe846118e9 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:23.230760 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-76424535-6c5f-4876-826b-7bfe846118e9 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:23.231455 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-76424535-6c5f-4876-826b-7bfe846118e9 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:23.231914 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-76424535-6c5f-4876-826b-7bfe846118e9 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:23.232396 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-76424535-6c5f-4876-826b-7bfe846118e9 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:23.246858 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-76424535-6c5f-4876-826b-7bfe846118e9 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] HTTP exception thrown: Instance 214e87c0-98fa-462e-a177-9780f1cc29ca could not be found. Oct 04 19:40:23.249848 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-76424535-6c5f-4876-826b-7bfe846118e9 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Request method failure captured: Oct 04 19:40:23.249848 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca HTTP/1.1 Oct 04 19:40:23.249848 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 19:40:23.249848 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 19:40:23.249848 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 19:40:23.249848 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 19:40:23.249848 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 19:40:23.249848 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 19:40:23.249848 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 19:40:23.249848 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 19:40:23.249848 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPIsCyZ9ujYHj7xAc9v5FsVDNBnhQXdRu3HrD7Tq5GQWPtceXFx7qoWJz7lP8l4zGdRoz3AIMETvWSaNf7C0jkbsq4Fdp5SR34bQhmUN7dN-TqhYTJpmcPItgyv3Ip6rfSesFJ9T-vVra0xTUsrYnfVdo1LIR9dDYTmgb9RW4N3wBj3M Oct 04 19:40:23.249848 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 19:40:23.249848 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 19:40:23.249848 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 19:40:23.249848 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 19:40:23.249848 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 19:40:23.249848 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 19:40:23.249848 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 56eff05b035a45e0afc0f92d9d85e136 Oct 04 19:40:23.249848 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ServerActionsTestJSON-2139592700 Oct 04 19:40:23.249848 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 19:40:23.249848 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 19:40:23.249848 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/56eff05b035a45e0afc0f92d9d85e136"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_56eff05b035a45e0afc0f92d9d85e136", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/56eff05b035a45e0afc0f92d9d85e136"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/56eff05b035a45e0afc0f92d9d85e136"}]}] Oct 04 19:40:23.249848 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ServerActionsTestJSON-2139592700 Oct 04 19:40:23.249848 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 56eff05b035a45e0afc0f92d9d85e136 Oct 04 19:40:23.249848 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ServerActionsTestJSON-2139592700 Oct 04 19:40:23.249848 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ServerActionsTestJSON-2139592700-project Oct 04 19:40:23.249848 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 19:40:23.249848 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 19:40:23.249848 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 6970aa4f091c49e382c86a487d25d524 Oct 04 19:40:23.249848 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ServerActionsTestJSON-2139592700-project Oct 04 19:40:23.249848 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 19:40:23.249848 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 214e87c0-98fa-462e-a177-9780f1cc29ca could not be found. Oct 04 19:40:23.249848 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '214e87c0-98fa-462e-a177-9780f1cc29ca'} Oct 04 19:40:23.249848 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:40:23.249848 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:40:23.249848 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:40:23.249848 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:40:23.249848 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:40:23.249848 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:40:23.249848 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:40:23.249848 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:40:23.249848 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:40:23.249848 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:40:23.249848 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 214e87c0-98fa-462e-a177-9780f1cc29ca could not be found. Oct 04 19:40:23.249848 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:40:23.249848 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:40:23.249848 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:40:23.249848 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:40:23.249848 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:40:23.249848 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:40:23.249848 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:40:23.249848 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:40:23.249848 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:40:23.249848 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:40:23.249848 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:40:23.249848 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:40:23.249848 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:40:23.249848 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:40:23.249848 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:40:23.249848 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:40:23.249848 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 214e87c0-98fa-462e-a177-9780f1cc29ca could not be found. Oct 04 19:40:23.249848 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:40:23.249848 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:40:23.249848 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:40:23.254104 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:40:23.254104 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:40:23.254104 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:40:23.254104 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:40:23.254104 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:40:23.254104 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 214e87c0-98fa-462e-a177-9780f1cc29ca could not be found. Oct 04 19:40:23.254104 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:40:23.254104 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-76424535-6c5f-4876-826b-7bfe846118e9 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Returning 404 to user: Instance 214e87c0-98fa-462e-a177-9780f1cc29ca could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:40:23.254104 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-76424535-6c5f-4876-826b-7bfe846118e9 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca" status: 404 len: 111 microversion: 2.1 time: 0.035691 Oct 04 19:40:23.254104 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3833/7652] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:40:23 2022] GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:40:23.300499 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5b2f8aaf-ba60-4f24-800a-d45532987244 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1139255343", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": [{"uuid": "da1c0bb1-0fcf-4915-8cd0-57095c8c6e9c"}], "security_groups": [{"name": "tempest-securitygroup--729491688"}], "key_name": "tempest-keypair-980628313", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:40:23.406531 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-5b2f8aaf-ba60-4f24-800a-d45532987244 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] validate_networks() for [('da1c0bb1-0fcf-4915-8cd0-57095c8c6e9c', None, None, None, None, None)] {{(pid=123002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:40:23.797822 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-5b2f8aaf-ba60-4f24-800a-d45532987244 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:40:23.798260 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-5b2f8aaf-ba60-4f24-800a-d45532987244 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:40:23.798775 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-5b2f8aaf-ba60-4f24-800a-d45532987244 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:40:23.799227 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-5b2f8aaf-ba60-4f24-800a-d45532987244 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:40:23.799656 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-5b2f8aaf-ba60-4f24-800a-d45532987244 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:40:23.808484 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5b2f8aaf-ba60-4f24-800a-d45532987244 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:23.808978 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5b2f8aaf-ba60-4f24-800a-d45532987244 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:23.809427 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5b2f8aaf-ba60-4f24-800a-d45532987244 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:23.810161 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5b2f8aaf-ba60-4f24-800a-d45532987244 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:23.811442 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5b2f8aaf-ba60-4f24-800a-d45532987244 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:23.811955 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5b2f8aaf-ba60-4f24-800a-d45532987244 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:23.828820 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-5b2f8aaf-ba60-4f24-800a-d45532987244 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Getting quotas for project 56eff05b035a45e0afc0f92d9d85e136. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:40:23.834092 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-5b2f8aaf-ba60-4f24-800a-d45532987244 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Getting quotas for user 6970aa4f091c49e382c86a487d25d524 and project 56eff05b035a45e0afc0f92d9d85e136. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:40:23.846506 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5b2f8aaf-ba60-4f24-800a-d45532987244 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Going to run 1 instances... {{(pid=123002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:40:23.848862 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5b2f8aaf-ba60-4f24-800a-d45532987244 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:40:23.969597 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5b2f8aaf-ba60-4f24-800a-d45532987244 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.673106 Oct 04 19:40:23.970265 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3820/7653] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 19:40:23 2022] POST /compute/v2.1/servers => generated 405 bytes in 674 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:40:23.981992 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-901c328e-1d96-42e6-82a4-81b4ff69270f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:40:23.983150 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-901c328e-1d96-42e6-82a4-81b4ff69270f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:40:24.037571 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-901c328e-1d96-42e6-82a4-81b4ff69270f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:40:24.044645 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-901c328e-1d96-42e6-82a4-81b4ff69270f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e" status: 200 len: 1238 microversion: 2.1 time: 0.066556 Oct 04 19:40:24.046502 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3834/7654] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:40:23 2022] GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e => generated 1238 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:40:25.074092 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2e643ca9-f248-4b54-8b72-abd0ab17fb23 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:40:25.074734 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2e643ca9-f248-4b54-8b72-abd0ab17fb23 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:40:25.083405 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e643ca9-f248-4b54-8b72-abd0ab17fb23 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:25.083904 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e643ca9-f248-4b54-8b72-abd0ab17fb23 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:25.084376 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e643ca9-f248-4b54-8b72-abd0ab17fb23 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:25.085083 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e643ca9-f248-4b54-8b72-abd0ab17fb23 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:25.085547 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e643ca9-f248-4b54-8b72-abd0ab17fb23 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:25.085984 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e643ca9-f248-4b54-8b72-abd0ab17fb23 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:25.151808 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2e643ca9-f248-4b54-8b72-abd0ab17fb23 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:40:25.160556 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2e643ca9-f248-4b54-8b72-abd0ab17fb23 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e" status: 200 len: 1234 microversion: 2.1 time: 0.090509 Oct 04 19:40:25.161341 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3821/7655] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:40:25 2022] GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e => generated 1234 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:40:26.193298 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-64f962d6-45f8-4ec3-9900-f1359d1a049c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:40:26.193917 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-64f962d6-45f8-4ec3-9900-f1359d1a049c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:40:26.202291 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-64f962d6-45f8-4ec3-9900-f1359d1a049c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:26.202787 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-64f962d6-45f8-4ec3-9900-f1359d1a049c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:26.203228 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-64f962d6-45f8-4ec3-9900-f1359d1a049c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:26.203925 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-64f962d6-45f8-4ec3-9900-f1359d1a049c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:26.204413 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-64f962d6-45f8-4ec3-9900-f1359d1a049c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:26.204847 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-64f962d6-45f8-4ec3-9900-f1359d1a049c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:26.276012 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-64f962d6-45f8-4ec3-9900-f1359d1a049c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:40:26.285047 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-64f962d6-45f8-4ec3-9900-f1359d1a049c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e" status: 200 len: 1296 microversion: 2.1 time: 0.095700 Oct 04 19:40:26.285619 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3835/7656] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:40:26 2022] GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e => generated 1296 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:40:27.310237 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-cf69c507-adbb-4607-a253-fac9dad9b36b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:40:27.310961 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-cf69c507-adbb-4607-a253-fac9dad9b36b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:40:27.317939 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cf69c507-adbb-4607-a253-fac9dad9b36b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:27.318444 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cf69c507-adbb-4607-a253-fac9dad9b36b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:27.318901 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cf69c507-adbb-4607-a253-fac9dad9b36b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:27.319613 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cf69c507-adbb-4607-a253-fac9dad9b36b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:27.320111 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cf69c507-adbb-4607-a253-fac9dad9b36b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:27.320559 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cf69c507-adbb-4607-a253-fac9dad9b36b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:27.489988 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-cf69c507-adbb-4607-a253-fac9dad9b36b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:40:27.497778 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-cf69c507-adbb-4607-a253-fac9dad9b36b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e" status: 200 len: 1363 microversion: 2.1 time: 0.191540 Oct 04 19:40:27.498454 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3822/7657] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:40:27 2022] GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e => generated 1363 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:40:27.524969 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-fe838a2d-6ade-4c91-aab7-1de248b43553 req-55424110-61b0-417f-acae-9002500d4aad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a028dbea-ff74-4cb5-9965-d3b7c1ab628e", "tag": "be0ad70e-5c61-4d1f-8110-23f0ca79ca73"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:40:27.536711 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-fe838a2d-6ade-4c91-aab7-1de248b43553 req-55424110-61b0-417f-acae-9002500d4aad service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:27.537196 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-fe838a2d-6ade-4c91-aab7-1de248b43553 req-55424110-61b0-417f-acae-9002500d4aad service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:27.537660 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-fe838a2d-6ade-4c91-aab7-1de248b43553 req-55424110-61b0-417f-acae-9002500d4aad service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:27.549275 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-fe838a2d-6ade-4c91-aab7-1de248b43553 req-55424110-61b0-417f-acae-9002500d4aad service nova] Creating event network-changed:be0ad70e-5c61-4d1f-8110-23f0ca79ca73 for instance a028dbea-ff74-4cb5-9965-d3b7c1ab628e on n-h1-850501-14 Oct 04 19:40:27.554054 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-fe838a2d-6ade-4c91-aab7-1de248b43553 req-55424110-61b0-417f-acae-9002500d4aad service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032960 Oct 04 19:40:27.554701 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3836/7658] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:40:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:40:28.522227 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-02d4f395-69bc-44d8-9ea2-ef851c638d12 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:40:28.522959 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-02d4f395-69bc-44d8-9ea2-ef851c638d12 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:40:28.531876 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-02d4f395-69bc-44d8-9ea2-ef851c638d12 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:28.532699 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-02d4f395-69bc-44d8-9ea2-ef851c638d12 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:28.533391 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-02d4f395-69bc-44d8-9ea2-ef851c638d12 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:28.534541 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-02d4f395-69bc-44d8-9ea2-ef851c638d12 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:28.535317 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-02d4f395-69bc-44d8-9ea2-ef851c638d12 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:28.536028 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-02d4f395-69bc-44d8-9ea2-ef851c638d12 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:28.686620 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-02d4f395-69bc-44d8-9ea2-ef851c638d12 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:40:28.694415 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-02d4f395-69bc-44d8-9ea2-ef851c638d12 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e" status: 200 len: 1363 microversion: 2.1 time: 0.176287 Oct 04 19:40:28.694992 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3823/7659] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:40:28 2022] GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e => generated 1363 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:40:29.782279 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4a7663d0-799f-449b-a609-c1331ca1cec2 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:40:29.782998 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-4a7663d0-799f-449b-a609-c1331ca1cec2 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:40:29.789323 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4a7663d0-799f-449b-a609-c1331ca1cec2 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:29.789951 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4a7663d0-799f-449b-a609-c1331ca1cec2 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:29.790400 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4a7663d0-799f-449b-a609-c1331ca1cec2 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:29.791098 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4a7663d0-799f-449b-a609-c1331ca1cec2 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:29.791559 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4a7663d0-799f-449b-a609-c1331ca1cec2 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:29.791990 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4a7663d0-799f-449b-a609-c1331ca1cec2 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:29.922254 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-4a7663d0-799f-449b-a609-c1331ca1cec2 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:40:29.929977 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-4a7663d0-799f-449b-a609-c1331ca1cec2 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e" status: 200 len: 1363 microversion: 2.1 time: 0.216093 Oct 04 19:40:29.930560 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3837/7660] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:40:29 2022] GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e => generated 1363 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:40:30.953802 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-13d123fa-b3e6-41c8-87b2-e84d5fb04eca tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:40:30.954595 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-13d123fa-b3e6-41c8-87b2-e84d5fb04eca tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:40:30.963364 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-13d123fa-b3e6-41c8-87b2-e84d5fb04eca tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:30.963860 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-13d123fa-b3e6-41c8-87b2-e84d5fb04eca tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:30.964339 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-13d123fa-b3e6-41c8-87b2-e84d5fb04eca tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:30.965064 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-13d123fa-b3e6-41c8-87b2-e84d5fb04eca tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:30.965563 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-13d123fa-b3e6-41c8-87b2-e84d5fb04eca tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:30.966025 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-13d123fa-b3e6-41c8-87b2-e84d5fb04eca tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:31.100704 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-13d123fa-b3e6-41c8-87b2-e84d5fb04eca tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:40:31.109081 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-13d123fa-b3e6-41c8-87b2-e84d5fb04eca tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e" status: 200 len: 1363 microversion: 2.1 time: 0.159543 Oct 04 19:40:31.109649 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3824/7661] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:40:30 2022] GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:40:32.132504 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-98053472-6a5a-445b-a46a-0d16b873bc8f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:40:32.133154 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-98053472-6a5a-445b-a46a-0d16b873bc8f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:40:32.140881 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-98053472-6a5a-445b-a46a-0d16b873bc8f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:32.141368 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-98053472-6a5a-445b-a46a-0d16b873bc8f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:32.141808 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-98053472-6a5a-445b-a46a-0d16b873bc8f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:32.142501 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-98053472-6a5a-445b-a46a-0d16b873bc8f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:32.142961 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-98053472-6a5a-445b-a46a-0d16b873bc8f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:32.143390 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-98053472-6a5a-445b-a46a-0d16b873bc8f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:32.282987 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-98053472-6a5a-445b-a46a-0d16b873bc8f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:40:32.291077 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-98053472-6a5a-445b-a46a-0d16b873bc8f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e" status: 200 len: 1363 microversion: 2.1 time: 0.162504 Oct 04 19:40:32.291695 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3838/7662] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:40:32 2022] GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:40:33.315160 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d0873174-081b-42cb-989a-ba00b57483de tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:40:33.315795 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d0873174-081b-42cb-989a-ba00b57483de tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:40:33.322688 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d0873174-081b-42cb-989a-ba00b57483de tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:33.323187 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d0873174-081b-42cb-989a-ba00b57483de tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:33.323636 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d0873174-081b-42cb-989a-ba00b57483de tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:33.324376 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d0873174-081b-42cb-989a-ba00b57483de tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:33.324844 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d0873174-081b-42cb-989a-ba00b57483de tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:33.325286 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d0873174-081b-42cb-989a-ba00b57483de tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:33.458071 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d0873174-081b-42cb-989a-ba00b57483de tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:40:33.465684 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d0873174-081b-42cb-989a-ba00b57483de tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e" status: 200 len: 1363 microversion: 2.1 time: 0.154929 Oct 04 19:40:33.466267 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3825/7663] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:40:33 2022] GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:40:34.490667 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-950c6fef-a987-4166-b851-d1a474588cab tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:40:34.491289 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-950c6fef-a987-4166-b851-d1a474588cab tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:40:34.494396 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:40:34.500023 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-950c6fef-a987-4166-b851-d1a474588cab tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:34.500548 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-950c6fef-a987-4166-b851-d1a474588cab tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:34.500992 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-950c6fef-a987-4166-b851-d1a474588cab tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:34.501705 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-950c6fef-a987-4166-b851-d1a474588cab tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:34.502166 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-950c6fef-a987-4166-b851-d1a474588cab tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:34.502844 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-950c6fef-a987-4166-b851-d1a474588cab tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:34.504457 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-fa4d206e-4146-4b8b-bd55-17ce14bad92d req-90f150f8-15fc-4e58-ae15-baab2fbf5dea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a028dbea-ff74-4cb5-9965-d3b7c1ab628e", "name": "network-vif-plugged", "status": "completed", "tag": "be0ad70e-5c61-4d1f-8110-23f0ca79ca73"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:40:34.512150 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:40:34.512841 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=6 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:40:34.518318 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-fa4d206e-4146-4b8b-bd55-17ce14bad92d req-90f150f8-15fc-4e58-ae15-baab2fbf5dea service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:34.518817 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-fa4d206e-4146-4b8b-bd55-17ce14bad92d req-90f150f8-15fc-4e58-ae15-baab2fbf5dea service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:34.519325 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-fa4d206e-4146-4b8b-bd55-17ce14bad92d req-90f150f8-15fc-4e58-ae15-baab2fbf5dea service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:34.531851 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-fa4d206e-4146-4b8b-bd55-17ce14bad92d req-90f150f8-15fc-4e58-ae15-baab2fbf5dea service nova] Creating event network-vif-plugged:be0ad70e-5c61-4d1f-8110-23f0ca79ca73 for instance a028dbea-ff74-4cb5-9965-d3b7c1ab628e on n-h1-850501-14 Oct 04 19:40:34.537201 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-fa4d206e-4146-4b8b-bd55-17ce14bad92d req-90f150f8-15fc-4e58-ae15-baab2fbf5dea service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038065 Oct 04 19:40:34.538155 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3826/7664] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:40:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:40:34.694176 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-950c6fef-a987-4166-b851-d1a474588cab tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:40:34.702930 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-950c6fef-a987-4166-b851-d1a474588cab tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e" status: 200 len: 1363 microversion: 2.1 time: 0.216224 Oct 04 19:40:34.703619 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3839/7665] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:40:34 2022] GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e => generated 1363 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:40:35.729410 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-af829848-4293-4955-b8ae-616a9b3df73b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:40:35.730141 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-af829848-4293-4955-b8ae-616a9b3df73b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:40:35.736781 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-af829848-4293-4955-b8ae-616a9b3df73b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:35.737285 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-af829848-4293-4955-b8ae-616a9b3df73b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:35.737769 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-af829848-4293-4955-b8ae-616a9b3df73b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:35.738476 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-af829848-4293-4955-b8ae-616a9b3df73b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:35.738953 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-af829848-4293-4955-b8ae-616a9b3df73b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:35.742753 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-af829848-4293-4955-b8ae-616a9b3df73b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:35.875067 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-af829848-4293-4955-b8ae-616a9b3df73b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:40:35.883076 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-af829848-4293-4955-b8ae-616a9b3df73b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e" status: 200 len: 1363 microversion: 2.1 time: 0.159632 Oct 04 19:40:35.886160 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3827/7666] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:40:35 2022] GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:40:36.906949 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-84ee3aaf-a9da-4699-b543-eeef23703718 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:40:36.907567 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-84ee3aaf-a9da-4699-b543-eeef23703718 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:40:36.914439 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-84ee3aaf-a9da-4699-b543-eeef23703718 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:36.914922 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-84ee3aaf-a9da-4699-b543-eeef23703718 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:36.915360 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-84ee3aaf-a9da-4699-b543-eeef23703718 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:36.916088 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-84ee3aaf-a9da-4699-b543-eeef23703718 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:36.916544 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-84ee3aaf-a9da-4699-b543-eeef23703718 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:36.916972 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-84ee3aaf-a9da-4699-b543-eeef23703718 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:37.049144 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-84ee3aaf-a9da-4699-b543-eeef23703718 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:40:37.056971 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-84ee3aaf-a9da-4699-b543-eeef23703718 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e" status: 200 len: 1550 microversion: 2.1 time: 0.154043 Oct 04 19:40:37.057537 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3840/7667] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:40:36 2022] GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e => generated 1550 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:40:37.080759 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c9e0685b-c7c2-44e7-883a-dbed29a6df3f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:40:37.081270 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c9e0685b-c7c2-44e7-883a-dbed29a6df3f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:40:37.088188 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c9e0685b-c7c2-44e7-883a-dbed29a6df3f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:37.088700 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c9e0685b-c7c2-44e7-883a-dbed29a6df3f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:37.089156 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c9e0685b-c7c2-44e7-883a-dbed29a6df3f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:37.089872 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c9e0685b-c7c2-44e7-883a-dbed29a6df3f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:37.090355 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c9e0685b-c7c2-44e7-883a-dbed29a6df3f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:37.090806 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c9e0685b-c7c2-44e7-883a-dbed29a6df3f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:37.171663 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c9e0685b-c7c2-44e7-883a-dbed29a6df3f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094270 Oct 04 19:40:37.172194 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3828/7668] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Oct 4 19:40:37 2022] GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:40:38.187319 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-ea5cc616-6f66-49bf-98f6-1d7dcc76e637 req-4def7dd8-baa1-41c4-ab90-92ab2f326764 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a028dbea-ff74-4cb5-9965-d3b7c1ab628e", "tag": "be0ad70e-5c61-4d1f-8110-23f0ca79ca73"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:40:38.198184 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-ea5cc616-6f66-49bf-98f6-1d7dcc76e637 req-4def7dd8-baa1-41c4-ab90-92ab2f326764 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:38.198656 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-ea5cc616-6f66-49bf-98f6-1d7dcc76e637 req-4def7dd8-baa1-41c4-ab90-92ab2f326764 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:38.199268 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-ea5cc616-6f66-49bf-98f6-1d7dcc76e637 req-4def7dd8-baa1-41c4-ab90-92ab2f326764 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:38.211325 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-ea5cc616-6f66-49bf-98f6-1d7dcc76e637 req-4def7dd8-baa1-41c4-ab90-92ab2f326764 service nova] Creating event network-changed:be0ad70e-5c61-4d1f-8110-23f0ca79ca73 for instance a028dbea-ff74-4cb5-9965-d3b7c1ab628e on n-h1-850501-14 Oct 04 19:40:38.216469 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-ea5cc616-6f66-49bf-98f6-1d7dcc76e637 req-4def7dd8-baa1-41c4-ab90-92ab2f326764 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033306 Oct 04 19:40:38.217270 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3841/7669] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:40:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:41:13.891677 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:41:13.892481 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=88 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:41:13.896431 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f4f6b652-20c7-4f10-bc08-1cfb8ee7e8b3 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:13.900479 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f4f6b652-20c7-4f10-bc08-1cfb8ee7e8b3 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:13.902881 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f4f6b652-20c7-4f10-bc08-1cfb8ee7e8b3 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:13.903382 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f4f6b652-20c7-4f10-bc08-1cfb8ee7e8b3 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:13.903831 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f4f6b652-20c7-4f10-bc08-1cfb8ee7e8b3 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:13.904566 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f4f6b652-20c7-4f10-bc08-1cfb8ee7e8b3 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:13.905029 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f4f6b652-20c7-4f10-bc08-1cfb8ee7e8b3 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:13.905463 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f4f6b652-20c7-4f10-bc08-1cfb8ee7e8b3 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:14.038424 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f4f6b652-20c7-4f10-bc08-1cfb8ee7e8b3 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:14.046229 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f4f6b652-20c7-4f10-bc08-1cfb8ee7e8b3 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e" status: 200 len: 1669 microversion: 2.1 time: 0.156846 Oct 04 19:41:14.046825 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3829/7670] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:13 2022] GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e => generated 1669 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:41:14.070704 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-101377e3-dbf8-43af-98c7-425e52b43229 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5683d2d4-85c3-4b55-b94a-b68405ea9a8d"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:41:14.073350 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-101377e3-dbf8-43af-98c7-425e52b43229 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:14.075950 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:41:14.076743 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:41:14.081818 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-101377e3-dbf8-43af-98c7-425e52b43229 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:14.085083 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-101377e3-dbf8-43af-98c7-425e52b43229 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:14.085083 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-101377e3-dbf8-43af-98c7-425e52b43229 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:14.085083 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-101377e3-dbf8-43af-98c7-425e52b43229 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:14.085083 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-101377e3-dbf8-43af-98c7-425e52b43229 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:14.085083 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-101377e3-dbf8-43af-98c7-425e52b43229 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:14.964804 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-101377e3-dbf8-43af-98c7-425e52b43229 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "POST /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.898915 Oct 04 19:41:14.965381 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3842/7671] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Oct 4 19:41:14 2022] POST /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e/os-volume_attachments => generated 194 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:41:26.751657 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2f7b9906-a1a1-4180-a826-bf1bf326842a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:41:26.754224 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2f7b9906-a1a1-4180-a826-bf1bf326842a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:26.756469 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:41:26.757162 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=6 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:41:26.761943 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2f7b9906-a1a1-4180-a826-bf1bf326842a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:26.762450 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2f7b9906-a1a1-4180-a826-bf1bf326842a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:26.762910 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2f7b9906-a1a1-4180-a826-bf1bf326842a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:26.763632 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2f7b9906-a1a1-4180-a826-bf1bf326842a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:26.764134 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2f7b9906-a1a1-4180-a826-bf1bf326842a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:26.768751 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2f7b9906-a1a1-4180-a826-bf1bf326842a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:26.796459 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2f7b9906-a1a1-4180-a826-bf1bf326842a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:26.803123 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2f7b9906-a1a1-4180-a826-bf1bf326842a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Old instance type m1.heat2, new instance type m1.heat {{(pid=123002) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 19:41:26.810158 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-2f7b9906-a1a1-4180-a826-bf1bf326842a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:41:26.810603 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-2f7b9906-a1a1-4180-a826-bf1bf326842a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:41:26.811103 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-2f7b9906-a1a1-4180-a826-bf1bf326842a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:41:26.811536 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-2f7b9906-a1a1-4180-a826-bf1bf326842a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:41:26.811966 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-2f7b9906-a1a1-4180-a826-bf1bf326842a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:41:27.021889 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2f7b9906-a1a1-4180-a826-bf1bf326842a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "POST /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e/action" status: 202 len: 0 microversion: 2.1 time: 0.274393 Oct 04 19:41:27.022720 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3830/7672] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 19:41:26 2022] POST /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e/action => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:41:27.029096 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:41:27.029890 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:41:27.038858 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a479aaf0-f82e-4f04-b6ce-b8a21157f308 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:27.038858 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a479aaf0-f82e-4f04-b6ce-b8a21157f308 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:27.041757 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a479aaf0-f82e-4f04-b6ce-b8a21157f308 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:27.042254 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a479aaf0-f82e-4f04-b6ce-b8a21157f308 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:27.042697 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a479aaf0-f82e-4f04-b6ce-b8a21157f308 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:27.043400 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a479aaf0-f82e-4f04-b6ce-b8a21157f308 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:27.043865 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a479aaf0-f82e-4f04-b6ce-b8a21157f308 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:27.044334 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a479aaf0-f82e-4f04-b6ce-b8a21157f308 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:27.226190 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a479aaf0-f82e-4f04-b6ce-b8a21157f308 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:27.234689 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a479aaf0-f82e-4f04-b6ce-b8a21157f308 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e" status: 200 len: 1724 microversion: 2.1 time: 0.207641 Oct 04 19:41:27.235284 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3843/7673] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:27 2022] GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e => generated 1724 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:41:28.259127 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-bbc69a0a-9d9c-4577-8300-1549045b7b18 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:28.259699 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-bbc69a0a-9d9c-4577-8300-1549045b7b18 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:28.266660 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bbc69a0a-9d9c-4577-8300-1549045b7b18 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:28.267424 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bbc69a0a-9d9c-4577-8300-1549045b7b18 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:28.267686 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bbc69a0a-9d9c-4577-8300-1549045b7b18 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:28.268346 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bbc69a0a-9d9c-4577-8300-1549045b7b18 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:28.268825 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bbc69a0a-9d9c-4577-8300-1549045b7b18 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:28.269274 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bbc69a0a-9d9c-4577-8300-1549045b7b18 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:28.454605 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-bbc69a0a-9d9c-4577-8300-1549045b7b18 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:28.463320 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-bbc69a0a-9d9c-4577-8300-1549045b7b18 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e" status: 200 len: 1724 microversion: 2.1 time: 0.208218 Oct 04 19:41:28.466974 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3831/7674] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:28 2022] GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e => generated 1724 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:41:29.486779 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2a312f96-ea0d-46b7-afe7-8b4628ce7742 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:29.487490 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2a312f96-ea0d-46b7-afe7-8b4628ce7742 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:29.494782 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2a312f96-ea0d-46b7-afe7-8b4628ce7742 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:29.495274 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2a312f96-ea0d-46b7-afe7-8b4628ce7742 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:29.495715 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2a312f96-ea0d-46b7-afe7-8b4628ce7742 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:29.496451 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2a312f96-ea0d-46b7-afe7-8b4628ce7742 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:29.496910 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2a312f96-ea0d-46b7-afe7-8b4628ce7742 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:29.497339 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2a312f96-ea0d-46b7-afe7-8b4628ce7742 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:29.730764 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-2a312f96-ea0d-46b7-afe7-8b4628ce7742 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:29.740489 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2a312f96-ea0d-46b7-afe7-8b4628ce7742 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e" status: 200 len: 1724 microversion: 2.1 time: 0.257577 Oct 04 19:41:29.741212 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3844/7675] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:29 2022] GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e => generated 1724 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:41:30.764944 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-fc2014f5-c7a6-421d-90b9-b9d12e138ebb tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:30.765588 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-fc2014f5-c7a6-421d-90b9-b9d12e138ebb tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:30.772522 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fc2014f5-c7a6-421d-90b9-b9d12e138ebb tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:30.773028 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fc2014f5-c7a6-421d-90b9-b9d12e138ebb tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:30.773489 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fc2014f5-c7a6-421d-90b9-b9d12e138ebb tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:30.774203 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fc2014f5-c7a6-421d-90b9-b9d12e138ebb tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:30.774686 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fc2014f5-c7a6-421d-90b9-b9d12e138ebb tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:30.775136 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fc2014f5-c7a6-421d-90b9-b9d12e138ebb tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:30.911084 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-fc2014f5-c7a6-421d-90b9-b9d12e138ebb tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:30.919315 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-fc2014f5-c7a6-421d-90b9-b9d12e138ebb tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e" status: 200 len: 1729 microversion: 2.1 time: 0.158318 Oct 04 19:41:30.919894 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3832/7676] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:30 2022] GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:41:31.942867 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-932dc7f9-daaa-473d-be0a-83ccd49d1d45 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:31.943512 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-932dc7f9-daaa-473d-be0a-83ccd49d1d45 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:31.950320 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-932dc7f9-daaa-473d-be0a-83ccd49d1d45 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:31.950808 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-932dc7f9-daaa-473d-be0a-83ccd49d1d45 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:31.951247 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-932dc7f9-daaa-473d-be0a-83ccd49d1d45 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:31.951938 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-932dc7f9-daaa-473d-be0a-83ccd49d1d45 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:31.952424 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-932dc7f9-daaa-473d-be0a-83ccd49d1d45 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:31.952855 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-932dc7f9-daaa-473d-be0a-83ccd49d1d45 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:32.084021 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-932dc7f9-daaa-473d-be0a-83ccd49d1d45 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:32.093149 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-932dc7f9-daaa-473d-be0a-83ccd49d1d45 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e" status: 200 len: 1729 microversion: 2.1 time: 0.154252 Oct 04 19:41:32.093756 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3845/7677] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:31 2022] GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:41:33.117598 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2b14f78c-686b-444b-baf8-322944df482c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:33.118226 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2b14f78c-686b-444b-baf8-322944df482c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:33.125098 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2b14f78c-686b-444b-baf8-322944df482c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:33.125623 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2b14f78c-686b-444b-baf8-322944df482c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:33.126074 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2b14f78c-686b-444b-baf8-322944df482c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:33.126772 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2b14f78c-686b-444b-baf8-322944df482c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:33.127248 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2b14f78c-686b-444b-baf8-322944df482c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:33.127686 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2b14f78c-686b-444b-baf8-322944df482c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:33.260390 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2b14f78c-686b-444b-baf8-322944df482c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:33.269693 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2b14f78c-686b-444b-baf8-322944df482c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e" status: 200 len: 1729 microversion: 2.1 time: 0.155398 Oct 04 19:41:33.270290 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3833/7678] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:33 2022] GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:41:34.293589 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5884b037-2443-4beb-9b21-1b8ddaa03864 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:34.294209 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5884b037-2443-4beb-9b21-1b8ddaa03864 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:34.301904 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5884b037-2443-4beb-9b21-1b8ddaa03864 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:34.308460 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5884b037-2443-4beb-9b21-1b8ddaa03864 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:34.308460 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5884b037-2443-4beb-9b21-1b8ddaa03864 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:34.308460 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5884b037-2443-4beb-9b21-1b8ddaa03864 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:34.308460 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5884b037-2443-4beb-9b21-1b8ddaa03864 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:34.308460 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5884b037-2443-4beb-9b21-1b8ddaa03864 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:34.442277 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5884b037-2443-4beb-9b21-1b8ddaa03864 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:34.448856 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5884b037-2443-4beb-9b21-1b8ddaa03864 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e" status: 200 len: 1729 microversion: 2.1 time: 0.159155 Oct 04 19:41:34.449431 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3846/7679] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:34 2022] GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:41:35.473605 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9f8f6bb9-0e0a-42a4-bca7-211cb85636c1 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:35.474233 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9f8f6bb9-0e0a-42a4-bca7-211cb85636c1 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:35.481153 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9f8f6bb9-0e0a-42a4-bca7-211cb85636c1 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:35.481657 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9f8f6bb9-0e0a-42a4-bca7-211cb85636c1 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:35.482114 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9f8f6bb9-0e0a-42a4-bca7-211cb85636c1 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:35.482823 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9f8f6bb9-0e0a-42a4-bca7-211cb85636c1 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:35.483294 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9f8f6bb9-0e0a-42a4-bca7-211cb85636c1 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:35.483736 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9f8f6bb9-0e0a-42a4-bca7-211cb85636c1 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:35.615426 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9f8f6bb9-0e0a-42a4-bca7-211cb85636c1 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:35.623840 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9f8f6bb9-0e0a-42a4-bca7-211cb85636c1 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e" status: 200 len: 1729 microversion: 2.1 time: 0.154727 Oct 04 19:41:35.624462 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3834/7680] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:35 2022] GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:41:36.648697 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a9ff2adc-7499-4b7e-8596-e6724a928b08 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:36.649308 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a9ff2adc-7499-4b7e-8596-e6724a928b08 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:36.656199 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a9ff2adc-7499-4b7e-8596-e6724a928b08 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:36.656684 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a9ff2adc-7499-4b7e-8596-e6724a928b08 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:36.657120 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a9ff2adc-7499-4b7e-8596-e6724a928b08 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:36.657808 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a9ff2adc-7499-4b7e-8596-e6724a928b08 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:36.658265 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a9ff2adc-7499-4b7e-8596-e6724a928b08 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:36.658693 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a9ff2adc-7499-4b7e-8596-e6724a928b08 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:36.807101 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a9ff2adc-7499-4b7e-8596-e6724a928b08 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:36.815466 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a9ff2adc-7499-4b7e-8596-e6724a928b08 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e" status: 200 len: 1729 microversion: 2.1 time: 0.171635 Oct 04 19:41:36.817123 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3847/7681] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:36 2022] GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e => generated 1729 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:41:37.840761 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e7556aea-ef33-421e-af08-8318dcf21007 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:37.841404 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e7556aea-ef33-421e-af08-8318dcf21007 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:37.849520 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e7556aea-ef33-421e-af08-8318dcf21007 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:37.850026 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e7556aea-ef33-421e-af08-8318dcf21007 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:37.850488 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e7556aea-ef33-421e-af08-8318dcf21007 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:37.851204 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e7556aea-ef33-421e-af08-8318dcf21007 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:37.851683 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e7556aea-ef33-421e-af08-8318dcf21007 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:37.852166 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e7556aea-ef33-421e-af08-8318dcf21007 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:37.995490 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e7556aea-ef33-421e-af08-8318dcf21007 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:38.004490 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e7556aea-ef33-421e-af08-8318dcf21007 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e" status: 200 len: 1729 microversion: 2.1 time: 0.167667 Oct 04 19:41:38.005069 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3835/7682] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:37 2022] GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:41:39.027792 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-434306cf-e96e-49f5-9aea-db44499ccbd8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:39.028431 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-434306cf-e96e-49f5-9aea-db44499ccbd8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:39.035720 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-434306cf-e96e-49f5-9aea-db44499ccbd8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:39.038195 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-434306cf-e96e-49f5-9aea-db44499ccbd8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:39.038195 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-434306cf-e96e-49f5-9aea-db44499ccbd8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:39.038195 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-434306cf-e96e-49f5-9aea-db44499ccbd8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:39.038195 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-434306cf-e96e-49f5-9aea-db44499ccbd8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:39.038195 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-434306cf-e96e-49f5-9aea-db44499ccbd8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:39.173726 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-434306cf-e96e-49f5-9aea-db44499ccbd8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:39.182923 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-434306cf-e96e-49f5-9aea-db44499ccbd8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e" status: 200 len: 1729 microversion: 2.1 time: 0.159093 Oct 04 19:41:39.183507 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3848/7683] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:39 2022] GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:41:40.207004 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-bd6e4f3e-4f06-49d1-a0b7-fec1d47b2675 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:40.207652 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-bd6e4f3e-4f06-49d1-a0b7-fec1d47b2675 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:40.214564 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bd6e4f3e-4f06-49d1-a0b7-fec1d47b2675 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:40.215071 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bd6e4f3e-4f06-49d1-a0b7-fec1d47b2675 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:40.215526 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bd6e4f3e-4f06-49d1-a0b7-fec1d47b2675 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:40.216277 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bd6e4f3e-4f06-49d1-a0b7-fec1d47b2675 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:40.216756 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bd6e4f3e-4f06-49d1-a0b7-fec1d47b2675 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:40.217200 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bd6e4f3e-4f06-49d1-a0b7-fec1d47b2675 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:40.364266 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-bd6e4f3e-4f06-49d1-a0b7-fec1d47b2675 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:40.374009 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-bd6e4f3e-4f06-49d1-a0b7-fec1d47b2675 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e" status: 200 len: 1729 microversion: 2.1 time: 0.171115 Oct 04 19:41:40.379076 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3836/7684] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:40 2022] GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:41:41.399248 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-536b5902-230b-4a19-b93c-44456b7aaf72 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:41.400024 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-536b5902-230b-4a19-b93c-44456b7aaf72 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:41.407091 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-536b5902-230b-4a19-b93c-44456b7aaf72 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:41.407580 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-536b5902-230b-4a19-b93c-44456b7aaf72 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:41.408022 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-536b5902-230b-4a19-b93c-44456b7aaf72 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:41.408747 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-536b5902-230b-4a19-b93c-44456b7aaf72 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:41.409264 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-536b5902-230b-4a19-b93c-44456b7aaf72 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:41.409698 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-536b5902-230b-4a19-b93c-44456b7aaf72 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:41.539506 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-536b5902-230b-4a19-b93c-44456b7aaf72 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:41.547842 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-536b5902-230b-4a19-b93c-44456b7aaf72 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e" status: 200 len: 1729 microversion: 2.1 time: 0.152535 Oct 04 19:41:41.548472 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3849/7685] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:41 2022] GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:41:42.571643 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2a6193bd-9d50-491d-a643-aa1c33d94b59 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:42.572298 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2a6193bd-9d50-491d-a643-aa1c33d94b59 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:42.579298 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2a6193bd-9d50-491d-a643-aa1c33d94b59 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:42.579931 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2a6193bd-9d50-491d-a643-aa1c33d94b59 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:42.580258 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2a6193bd-9d50-491d-a643-aa1c33d94b59 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:42.581499 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2a6193bd-9d50-491d-a643-aa1c33d94b59 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:42.582026 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2a6193bd-9d50-491d-a643-aa1c33d94b59 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:42.582462 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2a6193bd-9d50-491d-a643-aa1c33d94b59 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:42.717418 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2a6193bd-9d50-491d-a643-aa1c33d94b59 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:42.727753 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2a6193bd-9d50-491d-a643-aa1c33d94b59 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e" status: 200 len: 1729 microversion: 2.1 time: 0.160517 Oct 04 19:41:42.728420 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3837/7686] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:42 2022] GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:41:43.752802 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9f82d872-8a6d-4bae-b94c-617fe316bcc4 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:43.753544 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-9f82d872-8a6d-4bae-b94c-617fe316bcc4 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:43.760508 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9f82d872-8a6d-4bae-b94c-617fe316bcc4 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:43.761000 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9f82d872-8a6d-4bae-b94c-617fe316bcc4 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:43.761443 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9f82d872-8a6d-4bae-b94c-617fe316bcc4 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:43.762142 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9f82d872-8a6d-4bae-b94c-617fe316bcc4 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:43.762608 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9f82d872-8a6d-4bae-b94c-617fe316bcc4 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:43.763037 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9f82d872-8a6d-4bae-b94c-617fe316bcc4 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:43.897858 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9f82d872-8a6d-4bae-b94c-617fe316bcc4 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:43.906118 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9f82d872-8a6d-4bae-b94c-617fe316bcc4 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e" status: 200 len: 1729 microversion: 2.1 time: 0.157399 Oct 04 19:41:43.906797 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3850/7687] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:43 2022] GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:41:44.930888 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ab8d3560-2072-44e2-8035-3ee2834c0e3b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:44.931527 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ab8d3560-2072-44e2-8035-3ee2834c0e3b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:44.938385 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ab8d3560-2072-44e2-8035-3ee2834c0e3b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:44.938884 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ab8d3560-2072-44e2-8035-3ee2834c0e3b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:44.939336 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ab8d3560-2072-44e2-8035-3ee2834c0e3b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:44.940040 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ab8d3560-2072-44e2-8035-3ee2834c0e3b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:44.941112 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ab8d3560-2072-44e2-8035-3ee2834c0e3b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:44.941667 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ab8d3560-2072-44e2-8035-3ee2834c0e3b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:45.078395 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ab8d3560-2072-44e2-8035-3ee2834c0e3b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:45.088677 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ab8d3560-2072-44e2-8035-3ee2834c0e3b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e" status: 200 len: 1729 microversion: 2.1 time: 0.161170 Oct 04 19:41:45.089724 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3838/7688] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:44 2022] GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:41:46.113446 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7e6d2295-5fba-4303-b011-2c23b6d80f51 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:46.114069 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7e6d2295-5fba-4303-b011-2c23b6d80f51 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:46.116412 n-d-850501-14 devstack@n-api.service[123001]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:41:46.116560 n-d-850501-14 devstack@n-api.service[123001]: Tue Oct 4 19:41:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e (ip 10.222.0.20) !!! Oct 04 19:41:46.118448 n-d-850501-14 devstack@n-api.service[123001]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:41:46.118563 n-d-850501-14 devstack@n-api.service[123001]: Tue Oct 4 19:41:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e (ip 10.222.0.20) !!! Oct 04 19:41:46.128464 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7e6d2295-5fba-4303-b011-2c23b6d80f51 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:46.128941 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7e6d2295-5fba-4303-b011-2c23b6d80f51 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:46.129379 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7e6d2295-5fba-4303-b011-2c23b6d80f51 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:46.130071 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7e6d2295-5fba-4303-b011-2c23b6d80f51 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:46.130524 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7e6d2295-5fba-4303-b011-2c23b6d80f51 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:46.130948 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7e6d2295-5fba-4303-b011-2c23b6d80f51 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:46.260021 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7e6d2295-5fba-4303-b011-2c23b6d80f51 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:46.268853 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7e6d2295-5fba-4303-b011-2c23b6d80f51 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e" status: 200 len: 1729 microversion: 2.1 time: 0.158779 Oct 04 19:41:46.269577 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3851/7689] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:46 2022] GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:41:47.292507 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d9f6a1bf-94f8-46f6-bf0e-67ac663fbf2c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:47.294666 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d9f6a1bf-94f8-46f6-bf0e-67ac663fbf2c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:47.304042 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d9f6a1bf-94f8-46f6-bf0e-67ac663fbf2c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:47.304597 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d9f6a1bf-94f8-46f6-bf0e-67ac663fbf2c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:47.305046 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d9f6a1bf-94f8-46f6-bf0e-67ac663fbf2c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:47.305764 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d9f6a1bf-94f8-46f6-bf0e-67ac663fbf2c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:47.306231 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d9f6a1bf-94f8-46f6-bf0e-67ac663fbf2c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:47.306703 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d9f6a1bf-94f8-46f6-bf0e-67ac663fbf2c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:47.448478 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d9f6a1bf-94f8-46f6-bf0e-67ac663fbf2c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:47.457770 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d9f6a1bf-94f8-46f6-bf0e-67ac663fbf2c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e" status: 200 len: 1729 microversion: 2.1 time: 0.169313 Oct 04 19:41:47.458358 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3839/7690] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:47 2022] GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:41:48.481715 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a8e0fd8d-5870-499d-a46f-54ff9531ea5f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:48.482335 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a8e0fd8d-5870-499d-a46f-54ff9531ea5f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:48.489688 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a8e0fd8d-5870-499d-a46f-54ff9531ea5f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:48.490176 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a8e0fd8d-5870-499d-a46f-54ff9531ea5f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:48.490615 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a8e0fd8d-5870-499d-a46f-54ff9531ea5f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:48.491308 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a8e0fd8d-5870-499d-a46f-54ff9531ea5f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:48.491763 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a8e0fd8d-5870-499d-a46f-54ff9531ea5f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:48.492226 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a8e0fd8d-5870-499d-a46f-54ff9531ea5f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:48.628980 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a8e0fd8d-5870-499d-a46f-54ff9531ea5f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:48.637216 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a8e0fd8d-5870-499d-a46f-54ff9531ea5f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e" status: 200 len: 1729 microversion: 2.1 time: 0.159503 Oct 04 19:41:48.637785 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3852/7691] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:48 2022] GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:41:49.660952 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-834f6d93-35bc-497a-ba54-06e78d955892 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:49.661583 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-834f6d93-35bc-497a-ba54-06e78d955892 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:49.668575 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-834f6d93-35bc-497a-ba54-06e78d955892 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:49.669073 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-834f6d93-35bc-497a-ba54-06e78d955892 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:49.669524 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-834f6d93-35bc-497a-ba54-06e78d955892 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:49.670222 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-834f6d93-35bc-497a-ba54-06e78d955892 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:49.670689 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-834f6d93-35bc-497a-ba54-06e78d955892 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:49.671127 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-834f6d93-35bc-497a-ba54-06e78d955892 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:49.801238 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-834f6d93-35bc-497a-ba54-06e78d955892 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:49.809492 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-834f6d93-35bc-497a-ba54-06e78d955892 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e" status: 200 len: 1729 microversion: 2.1 time: 0.152719 Oct 04 19:41:49.810067 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3840/7692] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:49 2022] GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:41:50.833725 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5c8b0e9c-c566-4a85-bb0c-4ace06810de9 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:50.834338 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5c8b0e9c-c566-4a85-bb0c-4ace06810de9 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:50.841330 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5c8b0e9c-c566-4a85-bb0c-4ace06810de9 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:50.841754 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5c8b0e9c-c566-4a85-bb0c-4ace06810de9 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:50.842191 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5c8b0e9c-c566-4a85-bb0c-4ace06810de9 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:50.842877 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5c8b0e9c-c566-4a85-bb0c-4ace06810de9 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:50.843335 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5c8b0e9c-c566-4a85-bb0c-4ace06810de9 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:50.843771 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5c8b0e9c-c566-4a85-bb0c-4ace06810de9 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:50.977678 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5c8b0e9c-c566-4a85-bb0c-4ace06810de9 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:50.985902 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5c8b0e9c-c566-4a85-bb0c-4ace06810de9 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e" status: 200 len: 1729 microversion: 2.1 time: 0.156688 Oct 04 19:41:50.986470 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3853/7693] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:50 2022] GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:41:52.009770 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5fb46f65-6fbf-43eb-a59f-55f1ae41e1e8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:52.010311 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5fb46f65-6fbf-43eb-a59f-55f1ae41e1e8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:52.017766 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5fb46f65-6fbf-43eb-a59f-55f1ae41e1e8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:52.018408 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5fb46f65-6fbf-43eb-a59f-55f1ae41e1e8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:52.018868 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5fb46f65-6fbf-43eb-a59f-55f1ae41e1e8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:52.019570 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5fb46f65-6fbf-43eb-a59f-55f1ae41e1e8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:52.020037 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5fb46f65-6fbf-43eb-a59f-55f1ae41e1e8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:52.020497 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5fb46f65-6fbf-43eb-a59f-55f1ae41e1e8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:52.155718 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5fb46f65-6fbf-43eb-a59f-55f1ae41e1e8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:52.164574 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5fb46f65-6fbf-43eb-a59f-55f1ae41e1e8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e" status: 200 len: 1729 microversion: 2.1 time: 0.158945 Oct 04 19:41:52.165145 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3841/7694] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:52 2022] GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:41:53.242916 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9003b60b-0a31-4cb0-a043-bb586445b69a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:53.243565 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-9003b60b-0a31-4cb0-a043-bb586445b69a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:53.250462 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9003b60b-0a31-4cb0-a043-bb586445b69a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:53.250947 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9003b60b-0a31-4cb0-a043-bb586445b69a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:53.251389 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9003b60b-0a31-4cb0-a043-bb586445b69a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:53.252101 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9003b60b-0a31-4cb0-a043-bb586445b69a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:53.253207 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9003b60b-0a31-4cb0-a043-bb586445b69a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:53.253645 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9003b60b-0a31-4cb0-a043-bb586445b69a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:53.385856 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9003b60b-0a31-4cb0-a043-bb586445b69a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:53.395940 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9003b60b-0a31-4cb0-a043-bb586445b69a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e" status: 200 len: 1729 microversion: 2.1 time: 0.156900 Oct 04 19:41:53.396545 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3854/7695] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:53 2022] GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:41:54.419738 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-194024cb-08ce-4b7e-ad13-c617078aeb89 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:54.420395 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-194024cb-08ce-4b7e-ad13-c617078aeb89 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:54.427746 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-194024cb-08ce-4b7e-ad13-c617078aeb89 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:54.428285 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-194024cb-08ce-4b7e-ad13-c617078aeb89 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:54.428739 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-194024cb-08ce-4b7e-ad13-c617078aeb89 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:54.429478 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-194024cb-08ce-4b7e-ad13-c617078aeb89 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:54.429949 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-194024cb-08ce-4b7e-ad13-c617078aeb89 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:54.430419 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-194024cb-08ce-4b7e-ad13-c617078aeb89 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:54.562643 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-194024cb-08ce-4b7e-ad13-c617078aeb89 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:54.570935 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-194024cb-08ce-4b7e-ad13-c617078aeb89 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e" status: 200 len: 1729 microversion: 2.1 time: 0.155193 Oct 04 19:41:54.571526 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3842/7696] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:54 2022] GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:41:55.594818 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-67c86f50-7332-4c73-adb1-289cf38b9e2f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:55.595447 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-67c86f50-7332-4c73-adb1-289cf38b9e2f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:55.603280 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-67c86f50-7332-4c73-adb1-289cf38b9e2f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:55.603781 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-67c86f50-7332-4c73-adb1-289cf38b9e2f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:55.604256 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-67c86f50-7332-4c73-adb1-289cf38b9e2f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:55.604955 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-67c86f50-7332-4c73-adb1-289cf38b9e2f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:55.605416 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-67c86f50-7332-4c73-adb1-289cf38b9e2f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:55.605846 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-67c86f50-7332-4c73-adb1-289cf38b9e2f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:55.740104 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-67c86f50-7332-4c73-adb1-289cf38b9e2f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:55.748466 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-67c86f50-7332-4c73-adb1-289cf38b9e2f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e" status: 200 len: 1729 microversion: 2.1 time: 0.157564 Oct 04 19:41:55.749047 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3855/7697] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:55 2022] GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:41:56.772575 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-cd234188-c8b3-48fd-a749-19a0250d2a1e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:56.773216 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-cd234188-c8b3-48fd-a749-19a0250d2a1e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:56.775613 n-d-850501-14 devstack@n-api.service[123002]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:41:56.775761 n-d-850501-14 devstack@n-api.service[123002]: Tue Oct 4 19:41:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e (ip 10.222.0.20) !!! Oct 04 19:41:56.782819 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cd234188-c8b3-48fd-a749-19a0250d2a1e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:56.783319 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cd234188-c8b3-48fd-a749-19a0250d2a1e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:56.784297 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cd234188-c8b3-48fd-a749-19a0250d2a1e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:56.785023 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cd234188-c8b3-48fd-a749-19a0250d2a1e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:56.785499 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cd234188-c8b3-48fd-a749-19a0250d2a1e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:56.785951 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cd234188-c8b3-48fd-a749-19a0250d2a1e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:56.920721 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-cd234188-c8b3-48fd-a749-19a0250d2a1e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:56.922939 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:41:56.930699 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-cd234188-c8b3-48fd-a749-19a0250d2a1e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e" status: 200 len: 1729 microversion: 2.1 time: 0.162782 Oct 04 19:41:56.931284 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3843/7698] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:56 2022] GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:41:57.955181 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-44d7a100-d879-47d3-a0f1-470d470ec81b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:57.955921 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-44d7a100-d879-47d3-a0f1-470d470ec81b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:57.958669 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=27 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:41:57.963410 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-44d7a100-d879-47d3-a0f1-470d470ec81b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:57.963899 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-44d7a100-d879-47d3-a0f1-470d470ec81b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:57.964389 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-44d7a100-d879-47d3-a0f1-470d470ec81b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:57.965090 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-44d7a100-d879-47d3-a0f1-470d470ec81b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:57.965554 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-44d7a100-d879-47d3-a0f1-470d470ec81b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:57.965989 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-44d7a100-d879-47d3-a0f1-470d470ec81b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:57.968596 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=79 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:41:58.106928 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-44d7a100-d879-47d3-a0f1-470d470ec81b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:58.116151 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-44d7a100-d879-47d3-a0f1-470d470ec81b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e" status: 200 len: 1729 microversion: 2.1 time: 0.164801 Oct 04 19:41:58.116733 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3856/7699] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:57 2022] GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:41:59.140788 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a1c078c9-6138-47f9-b98c-c17170c3d1a5 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:59.141436 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a1c078c9-6138-47f9-b98c-c17170c3d1a5 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:59.144624 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=33 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:41:59.149598 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a1c078c9-6138-47f9-b98c-c17170c3d1a5 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:59.150091 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a1c078c9-6138-47f9-b98c-c17170c3d1a5 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:59.150540 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a1c078c9-6138-47f9-b98c-c17170c3d1a5 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:59.151241 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a1c078c9-6138-47f9-b98c-c17170c3d1a5 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:59.151706 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a1c078c9-6138-47f9-b98c-c17170c3d1a5 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:59.152173 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a1c078c9-6138-47f9-b98c-c17170c3d1a5 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:59.287929 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a1c078c9-6138-47f9-b98c-c17170c3d1a5 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:59.296201 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a1c078c9-6138-47f9-b98c-c17170c3d1a5 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e" status: 200 len: 1729 microversion: 2.1 time: 0.159789 Oct 04 19:41:59.296785 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3844/7700] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:59 2022] GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:42:00.319324 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-bdc962b0-0126-49e4-ad65-1d24ffef2098 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:00.321032 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-bdc962b0-0126-49e4-ad65-1d24ffef2098 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:00.326813 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bdc962b0-0126-49e4-ad65-1d24ffef2098 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:00.327293 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bdc962b0-0126-49e4-ad65-1d24ffef2098 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:00.327726 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bdc962b0-0126-49e4-ad65-1d24ffef2098 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:00.328438 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bdc962b0-0126-49e4-ad65-1d24ffef2098 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:00.328892 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bdc962b0-0126-49e4-ad65-1d24ffef2098 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:00.329314 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bdc962b0-0126-49e4-ad65-1d24ffef2098 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:00.459155 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-bdc962b0-0126-49e4-ad65-1d24ffef2098 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:42:00.467454 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-bdc962b0-0126-49e4-ad65-1d24ffef2098 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e" status: 200 len: 1729 microversion: 2.1 time: 0.152568 Oct 04 19:42:00.468072 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3857/7701] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:42:00 2022] GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:42:01.492071 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-97439edb-de1c-4004-91ae-5961d76d3441 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:01.492712 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-97439edb-de1c-4004-91ae-5961d76d3441 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:01.499636 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-97439edb-de1c-4004-91ae-5961d76d3441 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:01.500172 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-97439edb-de1c-4004-91ae-5961d76d3441 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:01.500632 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-97439edb-de1c-4004-91ae-5961d76d3441 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:01.501340 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-97439edb-de1c-4004-91ae-5961d76d3441 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:01.501818 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-97439edb-de1c-4004-91ae-5961d76d3441 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:01.503338 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-97439edb-de1c-4004-91ae-5961d76d3441 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:01.630910 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-97439edb-de1c-4004-91ae-5961d76d3441 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:42:01.639124 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-97439edb-de1c-4004-91ae-5961d76d3441 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e" status: 200 len: 1729 microversion: 2.1 time: 0.151069 Oct 04 19:42:01.639699 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3845/7702] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:42:01 2022] GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:42:02.663649 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4aa54d54-3f54-45d4-8c33-7601593a16af tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:02.664316 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-4aa54d54-3f54-45d4-8c33-7601593a16af tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:02.671413 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4aa54d54-3f54-45d4-8c33-7601593a16af tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:02.671899 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4aa54d54-3f54-45d4-8c33-7601593a16af tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:02.672358 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4aa54d54-3f54-45d4-8c33-7601593a16af tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:02.673048 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4aa54d54-3f54-45d4-8c33-7601593a16af tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:02.673527 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4aa54d54-3f54-45d4-8c33-7601593a16af tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:02.673950 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4aa54d54-3f54-45d4-8c33-7601593a16af tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:02.817949 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-4aa54d54-3f54-45d4-8c33-7601593a16af tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:42:02.826298 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-4aa54d54-3f54-45d4-8c33-7601593a16af tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e" status: 200 len: 1729 microversion: 2.1 time: 0.166698 Oct 04 19:42:02.826873 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3858/7703] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:42:02 2022] GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:42:03.851477 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1f26b0cf-02ce-471f-a4ab-afe135910dc1 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:03.852302 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1f26b0cf-02ce-471f-a4ab-afe135910dc1 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:03.859355 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1f26b0cf-02ce-471f-a4ab-afe135910dc1 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:03.859861 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1f26b0cf-02ce-471f-a4ab-afe135910dc1 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:03.860348 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1f26b0cf-02ce-471f-a4ab-afe135910dc1 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:03.861101 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1f26b0cf-02ce-471f-a4ab-afe135910dc1 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:03.862424 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1f26b0cf-02ce-471f-a4ab-afe135910dc1 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:03.863253 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1f26b0cf-02ce-471f-a4ab-afe135910dc1 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:03.997739 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1f26b0cf-02ce-471f-a4ab-afe135910dc1 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:42:04.006687 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1f26b0cf-02ce-471f-a4ab-afe135910dc1 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e" status: 200 len: 1729 microversion: 2.1 time: 0.159700 Oct 04 19:42:04.007297 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3846/7704] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:42:03 2022] GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:42:05.030916 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d247876b-3461-474d-905e-b05070805378 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:05.031636 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d247876b-3461-474d-905e-b05070805378 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:05.038453 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d247876b-3461-474d-905e-b05070805378 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:05.039011 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d247876b-3461-474d-905e-b05070805378 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:05.039516 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d247876b-3461-474d-905e-b05070805378 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:05.040246 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d247876b-3461-474d-905e-b05070805378 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:05.040698 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d247876b-3461-474d-905e-b05070805378 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:05.041119 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d247876b-3461-474d-905e-b05070805378 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:05.172603 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d247876b-3461-474d-905e-b05070805378 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:42:05.181598 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d247876b-3461-474d-905e-b05070805378 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e" status: 200 len: 1728 microversion: 2.1 time: 0.154626 Oct 04 19:42:05.182118 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3859/7705] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:42:05 2022] GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:42:05.264758 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-73ed57a3-fe80-4e83-ae21-0bd9b1412916 req-54cb70cb-6d1b-4eb0-bca8-7f5d3b639ca6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a028dbea-ff74-4cb5-9965-d3b7c1ab628e", "name": "network-vif-unplugged", "status": "completed", "tag": "be0ad70e-5c61-4d1f-8110-23f0ca79ca73"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:42:05.274271 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-73ed57a3-fe80-4e83-ae21-0bd9b1412916 req-54cb70cb-6d1b-4eb0-bca8-7f5d3b639ca6 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:05.274759 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-73ed57a3-fe80-4e83-ae21-0bd9b1412916 req-54cb70cb-6d1b-4eb0-bca8-7f5d3b639ca6 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:05.275202 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-73ed57a3-fe80-4e83-ae21-0bd9b1412916 req-54cb70cb-6d1b-4eb0-bca8-7f5d3b639ca6 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:05.287078 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-73ed57a3-fe80-4e83-ae21-0bd9b1412916 req-54cb70cb-6d1b-4eb0-bca8-7f5d3b639ca6 service nova] Creating event network-vif-unplugged:be0ad70e-5c61-4d1f-8110-23f0ca79ca73 for instance a028dbea-ff74-4cb5-9965-d3b7c1ab628e on n-h2-850501-14 Oct 04 19:42:05.292412 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [req-73ed57a3-fe80-4e83-ae21-0bd9b1412916 req-54cb70cb-6d1b-4eb0-bca8-7f5d3b639ca6 service nova] Instance a028dbea-ff74-4cb5-9965-d3b7c1ab628e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850501-14', 'n-h2-850501-14'} {{(pid=123002) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:42:05.303950 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-73ed57a3-fe80-4e83-ae21-0bd9b1412916 req-54cb70cb-6d1b-4eb0-bca8-7f5d3b639ca6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.091163 Oct 04 19:42:05.304662 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3847/7706] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:42:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:42:06.211167 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d69561a2-0fb2-4e09-ad6a-89e6144f0a32 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:06.211940 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d69561a2-0fb2-4e09-ad6a-89e6144f0a32 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:06.219023 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d69561a2-0fb2-4e09-ad6a-89e6144f0a32 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:06.219517 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d69561a2-0fb2-4e09-ad6a-89e6144f0a32 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:06.219959 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d69561a2-0fb2-4e09-ad6a-89e6144f0a32 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:06.220799 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d69561a2-0fb2-4e09-ad6a-89e6144f0a32 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:06.221266 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d69561a2-0fb2-4e09-ad6a-89e6144f0a32 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:06.221963 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d69561a2-0fb2-4e09-ad6a-89e6144f0a32 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:06.352706 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d69561a2-0fb2-4e09-ad6a-89e6144f0a32 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:42:06.361685 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d69561a2-0fb2-4e09-ad6a-89e6144f0a32 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e" status: 200 len: 1728 microversion: 2.1 time: 0.154145 Oct 04 19:42:06.362292 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3860/7707] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:42:06 2022] GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:42:07.321539 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-867ebadf-d010-4f33-b235-51f91108e3d8 req-83dec0cd-2aa6-4b08-af9f-ecf6b5af1531 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a028dbea-ff74-4cb5-9965-d3b7c1ab628e", "tag": "be0ad70e-5c61-4d1f-8110-23f0ca79ca73"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:42:07.331814 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-867ebadf-d010-4f33-b235-51f91108e3d8 req-83dec0cd-2aa6-4b08-af9f-ecf6b5af1531 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:07.332344 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-867ebadf-d010-4f33-b235-51f91108e3d8 req-83dec0cd-2aa6-4b08-af9f-ecf6b5af1531 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:07.332794 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-867ebadf-d010-4f33-b235-51f91108e3d8 req-83dec0cd-2aa6-4b08-af9f-ecf6b5af1531 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:07.349802 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-867ebadf-d010-4f33-b235-51f91108e3d8 req-83dec0cd-2aa6-4b08-af9f-ecf6b5af1531 service nova] Creating event network-changed:be0ad70e-5c61-4d1f-8110-23f0ca79ca73 for instance a028dbea-ff74-4cb5-9965-d3b7c1ab628e on n-h2-850501-14 Oct 04 19:42:07.351757 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [req-867ebadf-d010-4f33-b235-51f91108e3d8 req-83dec0cd-2aa6-4b08-af9f-ecf6b5af1531 service nova] Instance a028dbea-ff74-4cb5-9965-d3b7c1ab628e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850501-14', 'n-h2-850501-14'} {{(pid=123002) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:42:07.363698 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-867ebadf-d010-4f33-b235-51f91108e3d8 req-83dec0cd-2aa6-4b08-af9f-ecf6b5af1531 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047267 Oct 04 19:42:07.364649 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3848/7708] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:42:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:42:07.387903 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4c60683b-7357-4a45-beae-e89efd282781 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:07.388877 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-4c60683b-7357-4a45-beae-e89efd282781 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:07.398459 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4c60683b-7357-4a45-beae-e89efd282781 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:07.399301 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4c60683b-7357-4a45-beae-e89efd282781 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:07.399934 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4c60683b-7357-4a45-beae-e89efd282781 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:07.400848 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4c60683b-7357-4a45-beae-e89efd282781 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:07.401471 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4c60683b-7357-4a45-beae-e89efd282781 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:07.402069 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4c60683b-7357-4a45-beae-e89efd282781 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:07.668786 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-4c60683b-7357-4a45-beae-e89efd282781 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:42:07.683532 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-4c60683b-7357-4a45-beae-e89efd282781 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e" status: 200 len: 1726 microversion: 2.1 time: 0.300633 Oct 04 19:42:07.684370 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3861/7709] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:42:07 2022] GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e => generated 1726 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:42:08.709179 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e35399a4-1b36-468f-bdb1-cfe36ee7b574 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:08.709902 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e35399a4-1b36-468f-bdb1-cfe36ee7b574 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:08.716426 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e35399a4-1b36-468f-bdb1-cfe36ee7b574 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:08.717016 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e35399a4-1b36-468f-bdb1-cfe36ee7b574 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:08.717650 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e35399a4-1b36-468f-bdb1-cfe36ee7b574 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:08.718360 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e35399a4-1b36-468f-bdb1-cfe36ee7b574 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:08.718825 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e35399a4-1b36-468f-bdb1-cfe36ee7b574 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:08.719259 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e35399a4-1b36-468f-bdb1-cfe36ee7b574 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:08.858027 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e35399a4-1b36-468f-bdb1-cfe36ee7b574 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:42:08.867704 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e35399a4-1b36-468f-bdb1-cfe36ee7b574 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e" status: 200 len: 1726 microversion: 2.1 time: 0.163902 Oct 04 19:42:08.868327 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3849/7710] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:42:08 2022] GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e => generated 1726 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:42:09.893319 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-350f1701-173c-4c50-9151-14fd3c6922ed tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:09.894417 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-350f1701-173c-4c50-9151-14fd3c6922ed tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:09.900938 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-350f1701-173c-4c50-9151-14fd3c6922ed tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:09.901426 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-350f1701-173c-4c50-9151-14fd3c6922ed tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:09.901869 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-350f1701-173c-4c50-9151-14fd3c6922ed tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:09.902567 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-350f1701-173c-4c50-9151-14fd3c6922ed tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:09.903027 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-350f1701-173c-4c50-9151-14fd3c6922ed tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:09.903460 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-350f1701-173c-4c50-9151-14fd3c6922ed tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:10.038982 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-350f1701-173c-4c50-9151-14fd3c6922ed tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:42:10.047334 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-350f1701-173c-4c50-9151-14fd3c6922ed tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e" status: 200 len: 1726 microversion: 2.1 time: 0.158834 Oct 04 19:42:10.047839 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3862/7711] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:42:09 2022] GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:42:11.071167 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-cd2f3417-7c3a-454f-a3e4-320c0a6a9f1e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:11.071749 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-cd2f3417-7c3a-454f-a3e4-320c0a6a9f1e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:11.078840 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cd2f3417-7c3a-454f-a3e4-320c0a6a9f1e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:11.079334 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cd2f3417-7c3a-454f-a3e4-320c0a6a9f1e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:11.080373 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cd2f3417-7c3a-454f-a3e4-320c0a6a9f1e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:11.081238 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cd2f3417-7c3a-454f-a3e4-320c0a6a9f1e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:11.081704 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cd2f3417-7c3a-454f-a3e4-320c0a6a9f1e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:11.082144 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cd2f3417-7c3a-454f-a3e4-320c0a6a9f1e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:11.217751 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-cd2f3417-7c3a-454f-a3e4-320c0a6a9f1e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:42:11.227071 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-cd2f3417-7c3a-454f-a3e4-320c0a6a9f1e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e" status: 200 len: 1726 microversion: 2.1 time: 0.159935 Oct 04 19:42:11.227882 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3850/7712] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:42:11 2022] GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:42:12.250668 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-868ac0e0-461d-4ae4-86c2-583eae7c3915 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:12.251274 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-868ac0e0-461d-4ae4-86c2-583eae7c3915 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:12.258729 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-868ac0e0-461d-4ae4-86c2-583eae7c3915 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:12.259185 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-868ac0e0-461d-4ae4-86c2-583eae7c3915 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:12.259619 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-868ac0e0-461d-4ae4-86c2-583eae7c3915 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:12.260328 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-868ac0e0-461d-4ae4-86c2-583eae7c3915 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:12.260785 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-868ac0e0-461d-4ae4-86c2-583eae7c3915 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:12.261209 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-868ac0e0-461d-4ae4-86c2-583eae7c3915 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:12.394145 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-868ac0e0-461d-4ae4-86c2-583eae7c3915 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:42:12.402373 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-868ac0e0-461d-4ae4-86c2-583eae7c3915 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e" status: 200 len: 1726 microversion: 2.1 time: 0.155639 Oct 04 19:42:12.402945 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3863/7713] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:42:12 2022] GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:42:13.426707 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d3596637-7971-4a50-ad2a-d577d8b8a412 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:13.427325 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d3596637-7971-4a50-ad2a-d577d8b8a412 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:13.434613 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d3596637-7971-4a50-ad2a-d577d8b8a412 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:13.435149 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d3596637-7971-4a50-ad2a-d577d8b8a412 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:13.435611 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d3596637-7971-4a50-ad2a-d577d8b8a412 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:13.436392 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d3596637-7971-4a50-ad2a-d577d8b8a412 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:13.436874 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d3596637-7971-4a50-ad2a-d577d8b8a412 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:13.437331 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d3596637-7971-4a50-ad2a-d577d8b8a412 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:13.577213 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d3596637-7971-4a50-ad2a-d577d8b8a412 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:42:13.586364 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d3596637-7971-4a50-ad2a-d577d8b8a412 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e" status: 200 len: 1726 microversion: 2.1 time: 0.164138 Oct 04 19:42:13.586953 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3851/7714] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:42:13 2022] GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e => generated 1726 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:42:14.610000 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-23a2614b-a3c8-499c-aaf3-1e68152e520c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:14.610625 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-23a2614b-a3c8-499c-aaf3-1e68152e520c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:14.618274 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-23a2614b-a3c8-499c-aaf3-1e68152e520c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:14.618778 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-23a2614b-a3c8-499c-aaf3-1e68152e520c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:14.619222 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-23a2614b-a3c8-499c-aaf3-1e68152e520c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:14.619922 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-23a2614b-a3c8-499c-aaf3-1e68152e520c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:14.620418 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-23a2614b-a3c8-499c-aaf3-1e68152e520c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:14.620855 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-23a2614b-a3c8-499c-aaf3-1e68152e520c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:14.755315 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-23a2614b-a3c8-499c-aaf3-1e68152e520c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:42:14.763742 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-23a2614b-a3c8-499c-aaf3-1e68152e520c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e" status: 200 len: 1726 microversion: 2.1 time: 0.157665 Oct 04 19:42:14.764350 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3864/7715] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:42:14 2022] GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:42:15.787479 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ce096ae8-368b-4003-a4fa-347a73e3188c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:15.788138 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ce096ae8-368b-4003-a4fa-347a73e3188c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:15.794468 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ce096ae8-368b-4003-a4fa-347a73e3188c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:15.794968 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ce096ae8-368b-4003-a4fa-347a73e3188c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:15.795417 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ce096ae8-368b-4003-a4fa-347a73e3188c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:15.796154 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ce096ae8-368b-4003-a4fa-347a73e3188c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:15.796622 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ce096ae8-368b-4003-a4fa-347a73e3188c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:15.797059 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ce096ae8-368b-4003-a4fa-347a73e3188c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:15.930239 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ce096ae8-368b-4003-a4fa-347a73e3188c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:42:15.938569 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ce096ae8-368b-4003-a4fa-347a73e3188c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e" status: 200 len: 1726 microversion: 2.1 time: 0.155006 Oct 04 19:42:15.939833 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3852/7716] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:42:15 2022] GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:42:16.962949 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-91ec6a4e-cbf4-46ae-8bae-b58b55e8feab tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:16.963573 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-91ec6a4e-cbf4-46ae-8bae-b58b55e8feab tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:16.969781 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-91ec6a4e-cbf4-46ae-8bae-b58b55e8feab tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:16.970754 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-91ec6a4e-cbf4-46ae-8bae-b58b55e8feab tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:16.971204 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-91ec6a4e-cbf4-46ae-8bae-b58b55e8feab tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:16.972184 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-91ec6a4e-cbf4-46ae-8bae-b58b55e8feab tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:16.972656 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-91ec6a4e-cbf4-46ae-8bae-b58b55e8feab tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:16.973115 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-91ec6a4e-cbf4-46ae-8bae-b58b55e8feab tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:17.101727 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-91ec6a4e-cbf4-46ae-8bae-b58b55e8feab tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:42:17.109906 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-91ec6a4e-cbf4-46ae-8bae-b58b55e8feab tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e" status: 200 len: 1726 microversion: 2.1 time: 0.151079 Oct 04 19:42:17.110484 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3865/7717] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:42:16 2022] GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:42:18.133665 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e49e913e-3325-4c64-acbe-d477b59c5fd2 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:18.134296 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e49e913e-3325-4c64-acbe-d477b59c5fd2 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:18.141176 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e49e913e-3325-4c64-acbe-d477b59c5fd2 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:18.141670 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e49e913e-3325-4c64-acbe-d477b59c5fd2 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:18.142122 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e49e913e-3325-4c64-acbe-d477b59c5fd2 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:18.142819 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e49e913e-3325-4c64-acbe-d477b59c5fd2 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:18.143284 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e49e913e-3325-4c64-acbe-d477b59c5fd2 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:18.143722 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e49e913e-3325-4c64-acbe-d477b59c5fd2 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:18.278997 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e49e913e-3325-4c64-acbe-d477b59c5fd2 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:42:18.288980 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e49e913e-3325-4c64-acbe-d477b59c5fd2 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e" status: 200 len: 1726 microversion: 2.1 time: 0.159214 Oct 04 19:42:18.304213 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3853/7718] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:42:18 2022] GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:42:19.313833 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-11ce7340-9dcb-4ac9-81a1-f44f647be2a3 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:19.315005 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-11ce7340-9dcb-4ac9-81a1-f44f647be2a3 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:19.322847 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-11ce7340-9dcb-4ac9-81a1-f44f647be2a3 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:19.323342 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-11ce7340-9dcb-4ac9-81a1-f44f647be2a3 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:19.323789 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-11ce7340-9dcb-4ac9-81a1-f44f647be2a3 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:19.324523 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-11ce7340-9dcb-4ac9-81a1-f44f647be2a3 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:19.324983 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-11ce7340-9dcb-4ac9-81a1-f44f647be2a3 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:19.325442 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-11ce7340-9dcb-4ac9-81a1-f44f647be2a3 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:19.461116 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-11ce7340-9dcb-4ac9-81a1-f44f647be2a3 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:42:19.469727 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-11ce7340-9dcb-4ac9-81a1-f44f647be2a3 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e" status: 200 len: 1726 microversion: 2.1 time: 0.160099 Oct 04 19:42:19.470531 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3866/7719] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:42:19 2022] GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e => generated 1726 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:42:20.494362 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2d6eeb37-d9bb-49b2-ae5f-f2e6e63ebd6b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:20.495003 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2d6eeb37-d9bb-49b2-ae5f-f2e6e63ebd6b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:20.501960 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2d6eeb37-d9bb-49b2-ae5f-f2e6e63ebd6b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:20.502465 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2d6eeb37-d9bb-49b2-ae5f-f2e6e63ebd6b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:20.502925 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2d6eeb37-d9bb-49b2-ae5f-f2e6e63ebd6b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:20.503648 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2d6eeb37-d9bb-49b2-ae5f-f2e6e63ebd6b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:20.504160 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2d6eeb37-d9bb-49b2-ae5f-f2e6e63ebd6b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:20.504611 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2d6eeb37-d9bb-49b2-ae5f-f2e6e63ebd6b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:20.636216 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2d6eeb37-d9bb-49b2-ae5f-f2e6e63ebd6b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:42:20.643725 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2d6eeb37-d9bb-49b2-ae5f-f2e6e63ebd6b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e" status: 200 len: 1726 microversion: 2.1 time: 0.153299 Oct 04 19:42:20.644333 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3854/7720] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:42:20 2022] GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:42:21.667984 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-10777a88-8a33-41bf-a27c-ebc852ccf530 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:21.668620 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-10777a88-8a33-41bf-a27c-ebc852ccf530 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:21.676038 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-10777a88-8a33-41bf-a27c-ebc852ccf530 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:21.676553 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-10777a88-8a33-41bf-a27c-ebc852ccf530 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:21.676990 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-10777a88-8a33-41bf-a27c-ebc852ccf530 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:21.677681 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-10777a88-8a33-41bf-a27c-ebc852ccf530 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:21.678140 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-10777a88-8a33-41bf-a27c-ebc852ccf530 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:21.678567 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-10777a88-8a33-41bf-a27c-ebc852ccf530 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:21.814117 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-10777a88-8a33-41bf-a27c-ebc852ccf530 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:42:21.822331 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-10777a88-8a33-41bf-a27c-ebc852ccf530 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e" status: 200 len: 1723 microversion: 2.1 time: 0.158231 Oct 04 19:42:21.822965 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3867/7721] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:42:21 2022] GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:42:21.844682 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-fd6deafc-1260-4fb7-8e71-feff1ab34895 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:42:21.845993 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-fd6deafc-1260-4fb7-8e71-feff1ab34895 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:21.853223 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fd6deafc-1260-4fb7-8e71-feff1ab34895 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:21.853726 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fd6deafc-1260-4fb7-8e71-feff1ab34895 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:21.854179 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fd6deafc-1260-4fb7-8e71-feff1ab34895 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:21.854886 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fd6deafc-1260-4fb7-8e71-feff1ab34895 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:21.855358 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fd6deafc-1260-4fb7-8e71-feff1ab34895 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:21.855802 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fd6deafc-1260-4fb7-8e71-feff1ab34895 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:21.896393 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fd6deafc-1260-4fb7-8e71-feff1ab34895 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:21.896887 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fd6deafc-1260-4fb7-8e71-feff1ab34895 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:21.897332 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fd6deafc-1260-4fb7-8e71-feff1ab34895 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:21.898065 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fd6deafc-1260-4fb7-8e71-feff1ab34895 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:21.898527 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fd6deafc-1260-4fb7-8e71-feff1ab34895 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:21.898964 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fd6deafc-1260-4fb7-8e71-feff1ab34895 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:21.919352 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-fd6deafc-1260-4fb7-8e71-feff1ab34895 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Getting quotas for project 56eff05b035a45e0afc0f92d9d85e136. Resources: {'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:42:21.925178 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-fd6deafc-1260-4fb7-8e71-feff1ab34895 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Getting quotas for user 6970aa4f091c49e382c86a487d25d524 and project 56eff05b035a45e0afc0f92d9d85e136. Resources: {'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:42:22.438427 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-fd6deafc-1260-4fb7-8e71-feff1ab34895 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "POST /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e/action" status: 202 len: 0 microversion: 2.1 time: 0.597472 Oct 04 19:42:22.439080 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3855/7722] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 19:42:21 2022] POST /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e/action => generated 0 bytes in 599 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:42:22.447608 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4f3592f5-9e3d-4c8d-95fa-012b75f8250e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:22.448283 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-4f3592f5-9e3d-4c8d-95fa-012b75f8250e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:22.454889 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4f3592f5-9e3d-4c8d-95fa-012b75f8250e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:22.455609 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4f3592f5-9e3d-4c8d-95fa-012b75f8250e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:22.455818 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4f3592f5-9e3d-4c8d-95fa-012b75f8250e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:22.456561 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4f3592f5-9e3d-4c8d-95fa-012b75f8250e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:22.457022 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4f3592f5-9e3d-4c8d-95fa-012b75f8250e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:22.457451 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4f3592f5-9e3d-4c8d-95fa-012b75f8250e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:22.591277 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-4f3592f5-9e3d-4c8d-95fa-012b75f8250e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:42:22.600147 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-4f3592f5-9e3d-4c8d-95fa-012b75f8250e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e" status: 200 len: 1722 microversion: 2.1 time: 0.156371 Oct 04 19:42:22.600841 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3868/7723] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:42:22 2022] GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:42:23.624503 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-41d315c2-3d8d-4f5a-b751-ac0559256d87 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:23.625272 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-41d315c2-3d8d-4f5a-b751-ac0559256d87 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:23.632855 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-41d315c2-3d8d-4f5a-b751-ac0559256d87 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:23.633354 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-41d315c2-3d8d-4f5a-b751-ac0559256d87 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:23.633800 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-41d315c2-3d8d-4f5a-b751-ac0559256d87 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:23.634510 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-41d315c2-3d8d-4f5a-b751-ac0559256d87 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:23.635328 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-41d315c2-3d8d-4f5a-b751-ac0559256d87 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:23.635769 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-41d315c2-3d8d-4f5a-b751-ac0559256d87 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:23.778568 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-41d315c2-3d8d-4f5a-b751-ac0559256d87 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:42:23.787004 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-41d315c2-3d8d-4f5a-b751-ac0559256d87 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e" status: 200 len: 1722 microversion: 2.1 time: 0.167719 Oct 04 19:42:23.787574 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3856/7724] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:42:23 2022] GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:42:24.361370 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-723f7e2e-f817-4c31-8e55-58ce13e991f8 req-bc59727e-8378-43d3-86e5-c67a19ad1533 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a028dbea-ff74-4cb5-9965-d3b7c1ab628e", "name": "network-vif-plugged", "status": "completed", "tag": "be0ad70e-5c61-4d1f-8110-23f0ca79ca73"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:42:24.370927 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-723f7e2e-f817-4c31-8e55-58ce13e991f8 req-bc59727e-8378-43d3-86e5-c67a19ad1533 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:24.371407 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-723f7e2e-f817-4c31-8e55-58ce13e991f8 req-bc59727e-8378-43d3-86e5-c67a19ad1533 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:24.371841 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-723f7e2e-f817-4c31-8e55-58ce13e991f8 req-bc59727e-8378-43d3-86e5-c67a19ad1533 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:24.384907 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-723f7e2e-f817-4c31-8e55-58ce13e991f8 req-bc59727e-8378-43d3-86e5-c67a19ad1533 service nova] Creating event network-vif-plugged:be0ad70e-5c61-4d1f-8110-23f0ca79ca73 for instance a028dbea-ff74-4cb5-9965-d3b7c1ab628e on n-h2-850501-14 Oct 04 19:42:24.390825 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [req-723f7e2e-f817-4c31-8e55-58ce13e991f8 req-bc59727e-8378-43d3-86e5-c67a19ad1533 service nova] Instance a028dbea-ff74-4cb5-9965-d3b7c1ab628e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850501-14', 'n-h2-850501-14'} {{(pid=123001) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:42:24.408433 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-723f7e2e-f817-4c31-8e55-58ce13e991f8 req-bc59727e-8378-43d3-86e5-c67a19ad1533 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095131 Oct 04 19:42:24.408433 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3869/7725] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:42:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:42:24.809841 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-bb73dd59-c8e3-4c01-a92b-6bb26331e28e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:24.810604 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-bb73dd59-c8e3-4c01-a92b-6bb26331e28e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:24.817884 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bb73dd59-c8e3-4c01-a92b-6bb26331e28e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:24.818385 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bb73dd59-c8e3-4c01-a92b-6bb26331e28e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:24.818840 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bb73dd59-c8e3-4c01-a92b-6bb26331e28e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:24.819575 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bb73dd59-c8e3-4c01-a92b-6bb26331e28e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:24.820047 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bb73dd59-c8e3-4c01-a92b-6bb26331e28e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:24.820510 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bb73dd59-c8e3-4c01-a92b-6bb26331e28e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:24.952393 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-bb73dd59-c8e3-4c01-a92b-6bb26331e28e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:42:24.961235 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-bb73dd59-c8e3-4c01-a92b-6bb26331e28e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e" status: 200 len: 1722 microversion: 2.1 time: 0.155364 Oct 04 19:42:24.961812 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3857/7726] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:42:24 2022] GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:42:25.988310 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-13abfe1d-efa6-4abb-bb15-bd35f9e20e9b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:25.989011 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-13abfe1d-efa6-4abb-bb15-bd35f9e20e9b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:25.995291 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-13abfe1d-efa6-4abb-bb15-bd35f9e20e9b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:25.995786 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-13abfe1d-efa6-4abb-bb15-bd35f9e20e9b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:25.996311 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-13abfe1d-efa6-4abb-bb15-bd35f9e20e9b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:25.997015 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-13abfe1d-efa6-4abb-bb15-bd35f9e20e9b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:25.997476 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-13abfe1d-efa6-4abb-bb15-bd35f9e20e9b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:25.997900 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-13abfe1d-efa6-4abb-bb15-bd35f9e20e9b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:26.135210 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-13abfe1d-efa6-4abb-bb15-bd35f9e20e9b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:42:26.144249 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-13abfe1d-efa6-4abb-bb15-bd35f9e20e9b tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e" status: 200 len: 1722 microversion: 2.1 time: 0.161810 Oct 04 19:42:26.144891 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3870/7727] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:42:25 2022] GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:42:27.167801 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-fb131efe-89e6-4f94-b224-3ca55dbec8bb tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:27.168641 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-fb131efe-89e6-4f94-b224-3ca55dbec8bb tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:27.175972 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fb131efe-89e6-4f94-b224-3ca55dbec8bb tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:27.176520 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fb131efe-89e6-4f94-b224-3ca55dbec8bb tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:27.176979 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fb131efe-89e6-4f94-b224-3ca55dbec8bb tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:27.177696 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fb131efe-89e6-4f94-b224-3ca55dbec8bb tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:27.178170 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fb131efe-89e6-4f94-b224-3ca55dbec8bb tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:27.178690 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fb131efe-89e6-4f94-b224-3ca55dbec8bb tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:27.181495 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:42:27.313133 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-fb131efe-89e6-4f94-b224-3ca55dbec8bb tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:42:27.321897 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-fb131efe-89e6-4f94-b224-3ca55dbec8bb tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e" status: 200 len: 1722 microversion: 2.1 time: 0.158067 Oct 04 19:42:27.322473 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3858/7728] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:42:27 2022] GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:42:28.190844 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-16db7127-5336-4f9e-bee4-53800baf80eb req-9622e18c-4967-426d-988c-34e75fc476c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a028dbea-ff74-4cb5-9965-d3b7c1ab628e", "name": "network-vif-unplugged", "status": "completed", "tag": "be0ad70e-5c61-4d1f-8110-23f0ca79ca73"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:42:28.196977 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=30 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:42:28.202043 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-16db7127-5336-4f9e-bee4-53800baf80eb req-9622e18c-4967-426d-988c-34e75fc476c5 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:28.206030 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-16db7127-5336-4f9e-bee4-53800baf80eb req-9622e18c-4967-426d-988c-34e75fc476c5 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:28.206030 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-16db7127-5336-4f9e-bee4-53800baf80eb req-9622e18c-4967-426d-988c-34e75fc476c5 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:28.207672 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=88 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:42:28.214895 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-16db7127-5336-4f9e-bee4-53800baf80eb req-9622e18c-4967-426d-988c-34e75fc476c5 service nova] Creating event network-vif-unplugged:be0ad70e-5c61-4d1f-8110-23f0ca79ca73 for instance a028dbea-ff74-4cb5-9965-d3b7c1ab628e on n-h2-850501-14 Oct 04 19:42:28.220221 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [req-16db7127-5336-4f9e-bee4-53800baf80eb req-9622e18c-4967-426d-988c-34e75fc476c5 service nova] Instance a028dbea-ff74-4cb5-9965-d3b7c1ab628e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850501-14', 'n-h2-850501-14'} {{(pid=123001) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:42:28.230938 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-16db7127-5336-4f9e-bee4-53800baf80eb req-9622e18c-4967-426d-988c-34e75fc476c5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044474 Oct 04 19:42:28.231876 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3871/7729] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:42:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:42:28.345812 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-beaf8093-a146-4913-8989-d4e77d807ae9 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:28.346408 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-beaf8093-a146-4913-8989-d4e77d807ae9 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:28.355111 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-beaf8093-a146-4913-8989-d4e77d807ae9 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:28.355631 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-beaf8093-a146-4913-8989-d4e77d807ae9 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:28.356109 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-beaf8093-a146-4913-8989-d4e77d807ae9 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:28.356834 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-beaf8093-a146-4913-8989-d4e77d807ae9 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:28.357397 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-beaf8093-a146-4913-8989-d4e77d807ae9 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:28.357846 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-beaf8093-a146-4913-8989-d4e77d807ae9 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:28.492213 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-beaf8093-a146-4913-8989-d4e77d807ae9 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:42:28.500636 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-beaf8093-a146-4913-8989-d4e77d807ae9 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e" status: 200 len: 1722 microversion: 2.1 time: 0.159338 Oct 04 19:42:28.502127 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3859/7730] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:42:28 2022] GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:42:29.527247 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1ef634e6-1c63-45ef-8033-8ce05ebda56f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:29.527867 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1ef634e6-1c63-45ef-8033-8ce05ebda56f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:29.535228 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1ef634e6-1c63-45ef-8033-8ce05ebda56f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:29.535724 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1ef634e6-1c63-45ef-8033-8ce05ebda56f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:29.536189 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1ef634e6-1c63-45ef-8033-8ce05ebda56f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:29.536898 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1ef634e6-1c63-45ef-8033-8ce05ebda56f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:29.537351 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1ef634e6-1c63-45ef-8033-8ce05ebda56f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:29.537773 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1ef634e6-1c63-45ef-8033-8ce05ebda56f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:29.909663 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1ef634e6-1c63-45ef-8033-8ce05ebda56f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:42:29.917943 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1ef634e6-1c63-45ef-8033-8ce05ebda56f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e" status: 200 len: 1722 microversion: 2.1 time: 0.396687 Oct 04 19:42:29.918530 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3872/7731] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:42:29 2022] GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e => generated 1722 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:42:30.079215 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-3b469a5b-5598-4b63-b766-ef867003df9c req-3913c946-dda3-4f1c-a7ea-f5fc541d2ef3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a028dbea-ff74-4cb5-9965-d3b7c1ab628e", "tag": "be0ad70e-5c61-4d1f-8110-23f0ca79ca73"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:42:30.085536 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:42:30.090832 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-3b469a5b-5598-4b63-b766-ef867003df9c req-3913c946-dda3-4f1c-a7ea-f5fc541d2ef3 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:30.091325 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-3b469a5b-5598-4b63-b766-ef867003df9c req-3913c946-dda3-4f1c-a7ea-f5fc541d2ef3 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:30.091766 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-3b469a5b-5598-4b63-b766-ef867003df9c req-3913c946-dda3-4f1c-a7ea-f5fc541d2ef3 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:30.104557 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-3b469a5b-5598-4b63-b766-ef867003df9c req-3913c946-dda3-4f1c-a7ea-f5fc541d2ef3 service nova] Creating event network-changed:be0ad70e-5c61-4d1f-8110-23f0ca79ca73 for instance a028dbea-ff74-4cb5-9965-d3b7c1ab628e on n-h1-850501-14 Oct 04 19:42:30.111407 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [req-3b469a5b-5598-4b63-b766-ef867003df9c req-3913c946-dda3-4f1c-a7ea-f5fc541d2ef3 service nova] Instance a028dbea-ff74-4cb5-9965-d3b7c1ab628e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850501-14', 'n-h2-850501-14'} {{(pid=123002) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:42:30.121822 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-3b469a5b-5598-4b63-b766-ef867003df9c req-3913c946-dda3-4f1c-a7ea-f5fc541d2ef3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046257 Oct 04 19:42:30.122440 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3860/7732] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:42:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:42:30.942625 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2c4e8152-937a-477b-a438-24ce3fa683ac tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:30.943817 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2c4e8152-937a-477b-a438-24ce3fa683ac tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:30.950729 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2c4e8152-937a-477b-a438-24ce3fa683ac tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:30.951217 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2c4e8152-937a-477b-a438-24ce3fa683ac tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:30.951854 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2c4e8152-937a-477b-a438-24ce3fa683ac tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:30.952773 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2c4e8152-937a-477b-a438-24ce3fa683ac tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:30.953240 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2c4e8152-937a-477b-a438-24ce3fa683ac tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:30.953670 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2c4e8152-937a-477b-a438-24ce3fa683ac tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:31.164326 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-2c4e8152-937a-477b-a438-24ce3fa683ac tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:42:31.172992 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2c4e8152-937a-477b-a438-24ce3fa683ac tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e" status: 200 len: 1722 microversion: 2.1 time: 0.234563 Oct 04 19:42:31.173912 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3873/7733] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:42:30 2022] GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e => generated 1722 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:42:32.196033 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=3 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:42:32.200849 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4ec654f7-9c32-4176-8515-1f7dba1ff984 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:32.201577 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4ec654f7-9c32-4176-8515-1f7dba1ff984 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:32.209186 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4ec654f7-9c32-4176-8515-1f7dba1ff984 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:32.223802 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4ec654f7-9c32-4176-8515-1f7dba1ff984 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:32.223802 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4ec654f7-9c32-4176-8515-1f7dba1ff984 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:32.223802 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4ec654f7-9c32-4176-8515-1f7dba1ff984 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:32.223802 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4ec654f7-9c32-4176-8515-1f7dba1ff984 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:32.223802 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4ec654f7-9c32-4176-8515-1f7dba1ff984 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:32.350512 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4ec654f7-9c32-4176-8515-1f7dba1ff984 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:42:32.358935 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4ec654f7-9c32-4176-8515-1f7dba1ff984 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e" status: 200 len: 1722 microversion: 2.1 time: 0.164765 Oct 04 19:42:32.359534 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3861/7734] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:42:32 2022] GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:42:33.382193 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-63644a3c-9486-4dcd-bcea-82b8a2a7dd30 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:33.382822 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-63644a3c-9486-4dcd-bcea-82b8a2a7dd30 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:33.390136 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-63644a3c-9486-4dcd-bcea-82b8a2a7dd30 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:33.390662 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-63644a3c-9486-4dcd-bcea-82b8a2a7dd30 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:33.391114 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-63644a3c-9486-4dcd-bcea-82b8a2a7dd30 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:33.392490 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-63644a3c-9486-4dcd-bcea-82b8a2a7dd30 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:33.392831 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-63644a3c-9486-4dcd-bcea-82b8a2a7dd30 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:33.393265 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-63644a3c-9486-4dcd-bcea-82b8a2a7dd30 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:33.533154 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-63644a3c-9486-4dcd-bcea-82b8a2a7dd30 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:42:33.543435 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-63644a3c-9486-4dcd-bcea-82b8a2a7dd30 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e" status: 200 len: 1722 microversion: 2.1 time: 0.164635 Oct 04 19:42:33.543820 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3874/7735] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:42:33 2022] GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:42:34.567264 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-210977e5-0d58-472e-b036-29f3f93b69f6 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:34.567898 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-210977e5-0d58-472e-b036-29f3f93b69f6 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:34.575568 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-210977e5-0d58-472e-b036-29f3f93b69f6 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:34.576105 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-210977e5-0d58-472e-b036-29f3f93b69f6 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:34.576564 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-210977e5-0d58-472e-b036-29f3f93b69f6 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:34.577305 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-210977e5-0d58-472e-b036-29f3f93b69f6 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:34.577814 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-210977e5-0d58-472e-b036-29f3f93b69f6 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:34.578262 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-210977e5-0d58-472e-b036-29f3f93b69f6 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:34.716348 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-210977e5-0d58-472e-b036-29f3f93b69f6 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:42:34.726272 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-210977e5-0d58-472e-b036-29f3f93b69f6 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e" status: 200 len: 1722 microversion: 2.1 time: 0.163662 Oct 04 19:42:34.726951 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3862/7736] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:42:34 2022] GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:42:35.751648 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-225eb75e-6a82-43af-8f69-b0de00e189d0 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:35.752615 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-225eb75e-6a82-43af-8f69-b0de00e189d0 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:35.759434 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-225eb75e-6a82-43af-8f69-b0de00e189d0 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:35.759925 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-225eb75e-6a82-43af-8f69-b0de00e189d0 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:35.760407 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-225eb75e-6a82-43af-8f69-b0de00e189d0 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:35.761840 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-225eb75e-6a82-43af-8f69-b0de00e189d0 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:35.762611 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-225eb75e-6a82-43af-8f69-b0de00e189d0 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:35.763053 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-225eb75e-6a82-43af-8f69-b0de00e189d0 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:35.898628 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-225eb75e-6a82-43af-8f69-b0de00e189d0 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:42:35.909330 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-225eb75e-6a82-43af-8f69-b0de00e189d0 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e" status: 200 len: 1722 microversion: 2.1 time: 0.162339 Oct 04 19:42:35.909906 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3875/7737] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:42:35 2022] GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:42:36.933908 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-753df251-e5a0-42ee-b050-619285e9b8bb tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:36.934455 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-753df251-e5a0-42ee-b050-619285e9b8bb tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:36.941731 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-753df251-e5a0-42ee-b050-619285e9b8bb tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:36.942259 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-753df251-e5a0-42ee-b050-619285e9b8bb tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:36.942708 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-753df251-e5a0-42ee-b050-619285e9b8bb tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:36.943410 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-753df251-e5a0-42ee-b050-619285e9b8bb tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:36.943877 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-753df251-e5a0-42ee-b050-619285e9b8bb tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:36.944341 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-753df251-e5a0-42ee-b050-619285e9b8bb tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:37.075993 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-753df251-e5a0-42ee-b050-619285e9b8bb tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:42:37.084444 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-753df251-e5a0-42ee-b050-619285e9b8bb tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e" status: 200 len: 1722 microversion: 2.1 time: 0.154630 Oct 04 19:42:37.085020 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3863/7738] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:42:36 2022] GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:42:38.108962 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1f55f49a-91dd-4548-b324-4c1898c67844 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:38.109586 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1f55f49a-91dd-4548-b324-4c1898c67844 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:38.117264 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1f55f49a-91dd-4548-b324-4c1898c67844 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:38.117757 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1f55f49a-91dd-4548-b324-4c1898c67844 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:38.118200 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1f55f49a-91dd-4548-b324-4c1898c67844 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:38.118899 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1f55f49a-91dd-4548-b324-4c1898c67844 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:38.119358 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1f55f49a-91dd-4548-b324-4c1898c67844 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:38.119788 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1f55f49a-91dd-4548-b324-4c1898c67844 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:38.254785 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1f55f49a-91dd-4548-b324-4c1898c67844 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:42:38.262957 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1f55f49a-91dd-4548-b324-4c1898c67844 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e" status: 200 len: 1722 microversion: 2.1 time: 0.157967 Oct 04 19:42:38.263548 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3876/7739] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:42:38 2022] GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:42:39.287497 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2e5bc863-f825-4639-9126-9247afd04463 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:39.288126 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2e5bc863-f825-4639-9126-9247afd04463 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:39.295134 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e5bc863-f825-4639-9126-9247afd04463 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:39.295631 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e5bc863-f825-4639-9126-9247afd04463 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:39.296182 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e5bc863-f825-4639-9126-9247afd04463 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:39.296905 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e5bc863-f825-4639-9126-9247afd04463 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:39.298014 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e5bc863-f825-4639-9126-9247afd04463 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:39.298470 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e5bc863-f825-4639-9126-9247afd04463 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:39.441940 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2e5bc863-f825-4639-9126-9247afd04463 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:42:39.450412 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2e5bc863-f825-4639-9126-9247afd04463 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e" status: 200 len: 1722 microversion: 2.1 time: 0.166917 Oct 04 19:42:39.451188 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3864/7740] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:42:39 2022] GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:42:40.474817 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-dfa5abe4-5824-463a-b6b6-6836a04e79a7 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:40.475454 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-dfa5abe4-5824-463a-b6b6-6836a04e79a7 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:40.482273 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dfa5abe4-5824-463a-b6b6-6836a04e79a7 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:40.483525 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dfa5abe4-5824-463a-b6b6-6836a04e79a7 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:40.483968 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dfa5abe4-5824-463a-b6b6-6836a04e79a7 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:40.485976 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dfa5abe4-5824-463a-b6b6-6836a04e79a7 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:40.486994 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dfa5abe4-5824-463a-b6b6-6836a04e79a7 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:40.486994 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dfa5abe4-5824-463a-b6b6-6836a04e79a7 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:40.622226 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-dfa5abe4-5824-463a-b6b6-6836a04e79a7 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:42:40.631600 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-dfa5abe4-5824-463a-b6b6-6836a04e79a7 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e" status: 200 len: 1722 microversion: 2.1 time: 0.160943 Oct 04 19:42:40.632215 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3877/7741] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:42:40 2022] GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:42:41.655003 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3e259d03-6910-4576-b8a0-beaacf4c09ef tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:41.655620 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3e259d03-6910-4576-b8a0-beaacf4c09ef tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:41.663083 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3e259d03-6910-4576-b8a0-beaacf4c09ef tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:41.663586 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3e259d03-6910-4576-b8a0-beaacf4c09ef tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:41.664040 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3e259d03-6910-4576-b8a0-beaacf4c09ef tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:41.664775 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3e259d03-6910-4576-b8a0-beaacf4c09ef tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:41.665248 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3e259d03-6910-4576-b8a0-beaacf4c09ef tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:41.665693 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3e259d03-6910-4576-b8a0-beaacf4c09ef tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:41.819939 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3e259d03-6910-4576-b8a0-beaacf4c09ef tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:42:41.830166 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3e259d03-6910-4576-b8a0-beaacf4c09ef tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e" status: 200 len: 1722 microversion: 2.1 time: 0.179133 Oct 04 19:42:41.830858 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3865/7742] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:42:41 2022] GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:42:42.854273 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1d3ddc31-48a0-413e-8299-b4b3e73a7746 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:42.854898 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1d3ddc31-48a0-413e-8299-b4b3e73a7746 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:42.862504 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1d3ddc31-48a0-413e-8299-b4b3e73a7746 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:42.862994 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1d3ddc31-48a0-413e-8299-b4b3e73a7746 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:42.863435 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1d3ddc31-48a0-413e-8299-b4b3e73a7746 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:42.864153 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1d3ddc31-48a0-413e-8299-b4b3e73a7746 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:42.864663 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1d3ddc31-48a0-413e-8299-b4b3e73a7746 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:42.865043 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1d3ddc31-48a0-413e-8299-b4b3e73a7746 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:43.004440 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1d3ddc31-48a0-413e-8299-b4b3e73a7746 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:42:43.012859 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1d3ddc31-48a0-413e-8299-b4b3e73a7746 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e" status: 200 len: 1722 microversion: 2.1 time: 0.162502 Oct 04 19:42:43.013440 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3878/7743] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:42:42 2022] GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:42:44.038544 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8ad1f5e1-72f7-4632-a40f-01a4af693dd6 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:44.039126 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8ad1f5e1-72f7-4632-a40f-01a4af693dd6 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:44.046172 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8ad1f5e1-72f7-4632-a40f-01a4af693dd6 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:44.046674 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8ad1f5e1-72f7-4632-a40f-01a4af693dd6 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:44.047125 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8ad1f5e1-72f7-4632-a40f-01a4af693dd6 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:44.047833 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8ad1f5e1-72f7-4632-a40f-01a4af693dd6 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:44.048388 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8ad1f5e1-72f7-4632-a40f-01a4af693dd6 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:44.049334 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8ad1f5e1-72f7-4632-a40f-01a4af693dd6 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:44.179295 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8ad1f5e1-72f7-4632-a40f-01a4af693dd6 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:42:44.187585 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8ad1f5e1-72f7-4632-a40f-01a4af693dd6 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e" status: 200 len: 1715 microversion: 2.1 time: 0.153155 Oct 04 19:42:44.188188 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3866/7744] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:42:44 2022] GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e => generated 1715 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:42:44.211706 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-87e4c433-c463-435c-b7b8-f10d2713202e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:44.212375 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-87e4c433-c463-435c-b7b8-f10d2713202e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:44.219140 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-87e4c433-c463-435c-b7b8-f10d2713202e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:44.225401 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-87e4c433-c463-435c-b7b8-f10d2713202e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:44.225401 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-87e4c433-c463-435c-b7b8-f10d2713202e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:44.225401 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-87e4c433-c463-435c-b7b8-f10d2713202e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:44.225401 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-87e4c433-c463-435c-b7b8-f10d2713202e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:44.225401 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-87e4c433-c463-435c-b7b8-f10d2713202e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:44.359591 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-87e4c433-c463-435c-b7b8-f10d2713202e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:42:44.368037 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-87e4c433-c463-435c-b7b8-f10d2713202e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e" status: 200 len: 1715 microversion: 2.1 time: 0.160823 Oct 04 19:42:44.368651 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3879/7745] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:42:44 2022] GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e => generated 1715 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:42:44.394831 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2e0518dc-957b-4530-a207-cb2820cf3b9e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:44.395614 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2e0518dc-957b-4530-a207-cb2820cf3b9e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:44.402540 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e0518dc-957b-4530-a207-cb2820cf3b9e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:44.403165 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e0518dc-957b-4530-a207-cb2820cf3b9e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:44.403716 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e0518dc-957b-4530-a207-cb2820cf3b9e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:44.404617 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e0518dc-957b-4530-a207-cb2820cf3b9e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:44.405233 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e0518dc-957b-4530-a207-cb2820cf3b9e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:44.405764 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e0518dc-957b-4530-a207-cb2820cf3b9e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:44.540928 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2e0518dc-957b-4530-a207-cb2820cf3b9e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:42:44.549372 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2e0518dc-957b-4530-a207-cb2820cf3b9e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e" status: 200 len: 1715 microversion: 2.1 time: 0.159518 Oct 04 19:42:44.549966 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3867/7746] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:42:44 2022] GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e => generated 1715 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:42:44.572192 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-286d3645-0004-4a47-bfb4-d9333569207f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:44.572624 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-286d3645-0004-4a47-bfb4-d9333569207f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:44.578530 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-286d3645-0004-4a47-bfb4-d9333569207f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:44.579005 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-286d3645-0004-4a47-bfb4-d9333569207f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:44.579437 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-286d3645-0004-4a47-bfb4-d9333569207f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:44.580751 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-286d3645-0004-4a47-bfb4-d9333569207f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:44.581203 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-286d3645-0004-4a47-bfb4-d9333569207f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:44.581623 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-286d3645-0004-4a47-bfb4-d9333569207f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:44.607670 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-286d3645-0004-4a47-bfb4-d9333569207f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:42:44.993150 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-286d3645-0004-4a47-bfb4-d9333569207f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e" status: 204 len: 0 microversion: 2.1 time: 0.424557 Oct 04 19:42:44.993783 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3880/7747] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 19:42:44 2022] DELETE /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e => generated 0 bytes in 426 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:42:45.002490 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-fe5a76fc-2c17-4674-ac0d-fed69ba51bd8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:45.003224 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-fe5a76fc-2c17-4674-ac0d-fed69ba51bd8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:45.014382 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fe5a76fc-2c17-4674-ac0d-fed69ba51bd8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:45.015291 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fe5a76fc-2c17-4674-ac0d-fed69ba51bd8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:45.016307 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fe5a76fc-2c17-4674-ac0d-fed69ba51bd8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:45.018293 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fe5a76fc-2c17-4674-ac0d-fed69ba51bd8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:45.019153 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fe5a76fc-2c17-4674-ac0d-fed69ba51bd8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:45.019957 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fe5a76fc-2c17-4674-ac0d-fed69ba51bd8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:45.164165 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-fe5a76fc-2c17-4674-ac0d-fed69ba51bd8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:42:45.172311 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-fe5a76fc-2c17-4674-ac0d-fed69ba51bd8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e" status: 200 len: 1721 microversion: 2.1 time: 0.174069 Oct 04 19:42:45.172877 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3868/7748] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:42:44 2022] GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e => generated 1721 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:42:46.198685 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-91224f15-18ff-45c0-a9c0-5e5d02132a2a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:46.199445 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-91224f15-18ff-45c0-a9c0-5e5d02132a2a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:46.205672 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-91224f15-18ff-45c0-a9c0-5e5d02132a2a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:46.206166 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-91224f15-18ff-45c0-a9c0-5e5d02132a2a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:46.206610 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-91224f15-18ff-45c0-a9c0-5e5d02132a2a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:46.207349 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-91224f15-18ff-45c0-a9c0-5e5d02132a2a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:46.207810 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-91224f15-18ff-45c0-a9c0-5e5d02132a2a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:46.208270 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-91224f15-18ff-45c0-a9c0-5e5d02132a2a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:46.340021 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-91224f15-18ff-45c0-a9c0-5e5d02132a2a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:42:46.349047 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-91224f15-18ff-45c0-a9c0-5e5d02132a2a tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e" status: 200 len: 1721 microversion: 2.1 time: 0.155681 Oct 04 19:42:46.349628 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3881/7749] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:42:46 2022] GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:42:47.374117 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-32c16362-cbe2-48ca-b793-a82c028df78c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:47.374831 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-32c16362-cbe2-48ca-b793-a82c028df78c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:47.382580 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-32c16362-cbe2-48ca-b793-a82c028df78c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:47.385560 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-32c16362-cbe2-48ca-b793-a82c028df78c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:47.385560 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-32c16362-cbe2-48ca-b793-a82c028df78c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:47.385560 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-32c16362-cbe2-48ca-b793-a82c028df78c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:47.385560 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-32c16362-cbe2-48ca-b793-a82c028df78c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:47.385560 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-32c16362-cbe2-48ca-b793-a82c028df78c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:47.474883 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-32c16362-cbe2-48ca-b793-a82c028df78c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:42:47.484441 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-32c16362-cbe2-48ca-b793-a82c028df78c tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e" status: 200 len: 1654 microversion: 2.1 time: 0.114601 Oct 04 19:42:47.495703 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3869/7750] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:42:47 2022] GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e => generated 1654 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:42:47.511037 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-51a94b1e-e25e-4670-8835-84c67edd398e req-ee8d5d54-9d04-4c43-a6fe-278d6fa861d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a028dbea-ff74-4cb5-9965-d3b7c1ab628e", "name": "network-vif-deleted", "tag": "be0ad70e-5c61-4d1f-8110-23f0ca79ca73"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:42:47.523942 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-51a94b1e-e25e-4670-8835-84c67edd398e req-ee8d5d54-9d04-4c43-a6fe-278d6fa861d6 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:47.524460 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-51a94b1e-e25e-4670-8835-84c67edd398e req-ee8d5d54-9d04-4c43-a6fe-278d6fa861d6 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:47.524897 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-51a94b1e-e25e-4670-8835-84c67edd398e req-ee8d5d54-9d04-4c43-a6fe-278d6fa861d6 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:47.537356 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-51a94b1e-e25e-4670-8835-84c67edd398e req-ee8d5d54-9d04-4c43-a6fe-278d6fa861d6 service nova] Creating event network-vif-deleted:be0ad70e-5c61-4d1f-8110-23f0ca79ca73 for instance a028dbea-ff74-4cb5-9965-d3b7c1ab628e on n-h1-850501-14 Oct 04 19:42:47.542997 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-51a94b1e-e25e-4670-8835-84c67edd398e req-ee8d5d54-9d04-4c43-a6fe-278d6fa861d6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035635 Oct 04 19:42:47.543612 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3882/7751] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:42:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:42:48.510272 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9fe5ca37-19a8-4d20-a264-480d4892fff8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:48.510823 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9fe5ca37-19a8-4d20-a264-480d4892fff8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:48.519238 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9fe5ca37-19a8-4d20-a264-480d4892fff8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:48.520070 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9fe5ca37-19a8-4d20-a264-480d4892fff8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:48.520902 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9fe5ca37-19a8-4d20-a264-480d4892fff8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:48.522182 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9fe5ca37-19a8-4d20-a264-480d4892fff8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:48.522889 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9fe5ca37-19a8-4d20-a264-480d4892fff8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:48.523348 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9fe5ca37-19a8-4d20-a264-480d4892fff8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:48.608041 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9fe5ca37-19a8-4d20-a264-480d4892fff8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:42:48.618242 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9fe5ca37-19a8-4d20-a264-480d4892fff8 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e" status: 200 len: 1369 microversion: 2.1 time: 0.111969 Oct 04 19:42:48.618933 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3870/7752] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:42:48 2022] GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e => generated 1369 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:42:49.641631 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e08b57c5-5c59-4e0d-a597-a5cac328483f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:49.642393 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e08b57c5-5c59-4e0d-a597-a5cac328483f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:49.650105 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e08b57c5-5c59-4e0d-a597-a5cac328483f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:49.650596 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e08b57c5-5c59-4e0d-a597-a5cac328483f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:49.651040 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e08b57c5-5c59-4e0d-a597-a5cac328483f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:49.651750 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e08b57c5-5c59-4e0d-a597-a5cac328483f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:49.652247 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e08b57c5-5c59-4e0d-a597-a5cac328483f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:49.652711 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e08b57c5-5c59-4e0d-a597-a5cac328483f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:49.721736 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e08b57c5-5c59-4e0d-a597-a5cac328483f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:42:49.731238 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e08b57c5-5c59-4e0d-a597-a5cac328483f tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e" status: 200 len: 1369 microversion: 2.1 time: 0.093817 Oct 04 19:42:49.731859 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3883/7753] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:42:49 2022] GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:42:50.756963 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-eec3a8d4-f621-4b4a-95e7-81ce9e0126c3 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:50.757679 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-eec3a8d4-f621-4b4a-95e7-81ce9e0126c3 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:50.766012 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eec3a8d4-f621-4b4a-95e7-81ce9e0126c3 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:50.766529 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eec3a8d4-f621-4b4a-95e7-81ce9e0126c3 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:50.767025 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eec3a8d4-f621-4b4a-95e7-81ce9e0126c3 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:50.767967 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eec3a8d4-f621-4b4a-95e7-81ce9e0126c3 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:50.768642 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eec3a8d4-f621-4b4a-95e7-81ce9e0126c3 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:50.769215 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eec3a8d4-f621-4b4a-95e7-81ce9e0126c3 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:50.838665 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-eec3a8d4-f621-4b4a-95e7-81ce9e0126c3 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:42:50.848422 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-eec3a8d4-f621-4b4a-95e7-81ce9e0126c3 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e" status: 200 len: 1369 microversion: 2.1 time: 0.097084 Oct 04 19:42:50.849114 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3871/7754] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:42:50 2022] GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:42:51.872172 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ecb1df74-cffd-4b52-bef7-0192438e0b89 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:51.872854 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ecb1df74-cffd-4b52-bef7-0192438e0b89 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:51.880515 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ecb1df74-cffd-4b52-bef7-0192438e0b89 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:51.881001 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ecb1df74-cffd-4b52-bef7-0192438e0b89 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:51.881437 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ecb1df74-cffd-4b52-bef7-0192438e0b89 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:51.882186 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ecb1df74-cffd-4b52-bef7-0192438e0b89 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:51.882579 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ecb1df74-cffd-4b52-bef7-0192438e0b89 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:51.883002 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ecb1df74-cffd-4b52-bef7-0192438e0b89 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:51.948127 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ecb1df74-cffd-4b52-bef7-0192438e0b89 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6970aa4f091c49e382c86a487d25d524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eff05b035a45e0afc0f92d9d85e136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:42:51.957152 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ecb1df74-cffd-4b52-bef7-0192438e0b89 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e" status: 200 len: 1369 microversion: 2.1 time: 0.088915 Oct 04 19:42:51.962675 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3884/7755] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:42:51 2022] GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:42:52.982707 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ace44af7-0187-4514-b110-3d8607dad6ae tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:52.983235 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ace44af7-0187-4514-b110-3d8607dad6ae tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:52.990730 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ace44af7-0187-4514-b110-3d8607dad6ae tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:52.991220 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ace44af7-0187-4514-b110-3d8607dad6ae tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:52.991672 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ace44af7-0187-4514-b110-3d8607dad6ae tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:52.992394 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ace44af7-0187-4514-b110-3d8607dad6ae tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:52.992862 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ace44af7-0187-4514-b110-3d8607dad6ae tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:52.993577 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ace44af7-0187-4514-b110-3d8607dad6ae tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:53.007773 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-ace44af7-0187-4514-b110-3d8607dad6ae tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] HTTP exception thrown: Instance a028dbea-ff74-4cb5-9965-d3b7c1ab628e could not be found. Oct 04 19:42:53.009470 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ace44af7-0187-4514-b110-3d8607dad6ae tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Request method failure captured: Oct 04 19:42:53.009470 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e HTTP/1.1 Oct 04 19:42:53.009470 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 19:42:53.009470 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 19:42:53.009470 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 19:42:53.009470 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 19:42:53.009470 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 19:42:53.009470 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 19:42:53.009470 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 19:42:53.009470 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 19:42:53.009470 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPIsCyZ9ujYHj7xAc9v5FsVDNBnhQXdRu3HrD7Tq5GQWPtceXFx7qoWJz7lP8l4zGdRoz3AIMETvWSaNf7C0jkbsq4Fdp5SR34bQhmUN7dN-TqhYTJpmcPItgyv3Ip6rfSesFJ9T-vVra0xTUsrYnfVdo1LIR9dDYTmgb9RW4N3wBj3M Oct 04 19:42:53.009470 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 19:42:53.009470 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 19:42:53.009470 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 19:42:53.009470 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 19:42:53.009470 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 19:42:53.009470 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 19:42:53.009470 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 56eff05b035a45e0afc0f92d9d85e136 Oct 04 19:42:53.009470 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServerActionsTestJSON-2139592700 Oct 04 19:42:53.009470 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 19:42:53.009470 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 19:42:53.009470 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/56eff05b035a45e0afc0f92d9d85e136"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_56eff05b035a45e0afc0f92d9d85e136", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/56eff05b035a45e0afc0f92d9d85e136"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/56eff05b035a45e0afc0f92d9d85e136"}]}] Oct 04 19:42:53.009470 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServerActionsTestJSON-2139592700 Oct 04 19:42:53.009470 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 56eff05b035a45e0afc0f92d9d85e136 Oct 04 19:42:53.009470 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServerActionsTestJSON-2139592700 Oct 04 19:42:53.009470 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServerActionsTestJSON-2139592700-project Oct 04 19:42:53.009470 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 19:42:53.009470 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 19:42:53.009470 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 6970aa4f091c49e382c86a487d25d524 Oct 04 19:42:53.009470 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServerActionsTestJSON-2139592700-project Oct 04 19:42:53.009470 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 19:42:53.009470 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance a028dbea-ff74-4cb5-9965-d3b7c1ab628e could not be found. Oct 04 19:42:53.009470 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'a028dbea-ff74-4cb5-9965-d3b7c1ab628e'} Oct 04 19:42:53.009470 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:42:53.009470 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:42:53.009470 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:42:53.009470 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:42:53.009470 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:42:53.009470 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:42:53.009470 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:42:53.009470 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:42:53.009470 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:42:53.009470 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:42:53.009470 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a028dbea-ff74-4cb5-9965-d3b7c1ab628e could not be found. Oct 04 19:42:53.009470 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:42:53.009470 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:42:53.009470 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:42:53.009470 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:42:53.009470 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:42:53.009470 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:42:53.009470 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:42:53.009470 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:42:53.009470 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:42:53.009470 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:42:53.009470 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:42:53.009470 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:42:53.009470 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:42:53.009470 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:42:53.009470 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:42:53.009470 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:42:53.009470 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a028dbea-ff74-4cb5-9965-d3b7c1ab628e could not be found. Oct 04 19:42:53.009470 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:42:53.009470 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:42:53.009470 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:42:53.014444 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:42:53.014444 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:42:53.014444 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:42:53.014444 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:42:53.014444 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:42:53.014444 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a028dbea-ff74-4cb5-9965-d3b7c1ab628e could not be found. Oct 04 19:42:53.014444 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:42:53.014444 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ace44af7-0187-4514-b110-3d8607dad6ae tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Returning 404 to user: Instance a028dbea-ff74-4cb5-9965-d3b7c1ab628e could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:42:53.014444 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ace44af7-0187-4514-b110-3d8607dad6ae tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e" status: 404 len: 111 microversion: 2.1 time: 0.032218 Oct 04 19:42:53.014444 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3872/7756] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:42:52 2022] GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:42:53.072891 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-bb794953-9815-4715-8657-897f2d824258 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:53.075142 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-bb794953-9815-4715-8657-897f2d824258 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:53.082646 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bb794953-9815-4715-8657-897f2d824258 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:53.083136 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bb794953-9815-4715-8657-897f2d824258 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:53.083584 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bb794953-9815-4715-8657-897f2d824258 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:53.084311 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bb794953-9815-4715-8657-897f2d824258 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:53.084776 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bb794953-9815-4715-8657-897f2d824258 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:53.085207 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bb794953-9815-4715-8657-897f2d824258 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:53.098560 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-bb794953-9815-4715-8657-897f2d824258 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] HTTP exception thrown: Instance a028dbea-ff74-4cb5-9965-d3b7c1ab628e could not be found. Oct 04 19:42:53.101712 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-bb794953-9815-4715-8657-897f2d824258 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Request method failure captured: Oct 04 19:42:53.101712 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e/os-volume_attachments HTTP/1.1 Oct 04 19:42:53.101712 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 19:42:53.101712 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 19:42:53.101712 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 19:42:53.101712 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 19:42:53.101712 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 19:42:53.101712 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 19:42:53.101712 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 19:42:53.101712 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 19:42:53.101712 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPIsCyZ9ujYHj7xAc9v5FsVDNBnhQXdRu3HrD7Tq5GQWPtceXFx7qoWJz7lP8l4zGdRoz3AIMETvWSaNf7C0jkbsq4Fdp5SR34bQhmUN7dN-TqhYTJpmcPItgyv3Ip6rfSesFJ9T-vVra0xTUsrYnfVdo1LIR9dDYTmgb9RW4N3wBj3M Oct 04 19:42:53.101712 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 19:42:53.101712 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 19:42:53.101712 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 19:42:53.101712 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 19:42:53.101712 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 19:42:53.101712 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 19:42:53.101712 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 56eff05b035a45e0afc0f92d9d85e136 Oct 04 19:42:53.101712 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ServerActionsTestJSON-2139592700 Oct 04 19:42:53.101712 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 19:42:53.101712 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 19:42:53.101712 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/56eff05b035a45e0afc0f92d9d85e136"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_56eff05b035a45e0afc0f92d9d85e136", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/56eff05b035a45e0afc0f92d9d85e136"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/56eff05b035a45e0afc0f92d9d85e136"}]}] Oct 04 19:42:53.101712 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ServerActionsTestJSON-2139592700 Oct 04 19:42:53.101712 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 56eff05b035a45e0afc0f92d9d85e136 Oct 04 19:42:53.101712 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ServerActionsTestJSON-2139592700 Oct 04 19:42:53.101712 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ServerActionsTestJSON-2139592700-project Oct 04 19:42:53.101712 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 19:42:53.101712 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 19:42:53.101712 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 6970aa4f091c49e382c86a487d25d524 Oct 04 19:42:53.101712 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ServerActionsTestJSON-2139592700-project Oct 04 19:42:53.101712 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 19:42:53.101712 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance a028dbea-ff74-4cb5-9965-d3b7c1ab628e could not be found. Oct 04 19:42:53.101712 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'server_id': 'a028dbea-ff74-4cb5-9965-d3b7c1ab628e'} Oct 04 19:42:53.101712 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:42:53.101712 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:42:53.101712 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:42:53.101712 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:42:53.101712 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:42:53.101712 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:42:53.101712 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:42:53.101712 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:42:53.101712 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:42:53.101712 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:42:53.101712 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a028dbea-ff74-4cb5-9965-d3b7c1ab628e could not be found. Oct 04 19:42:53.101712 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:42:53.101712 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:42:53.101712 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:42:53.101712 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:42:53.101712 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:42:53.101712 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:42:53.101712 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:42:53.101712 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:42:53.101712 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:42:53.101712 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:42:53.101712 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 19:42:53.101712 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 19:42:53.101712 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 19:42:53.101712 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 19:42:53.101712 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 04 19:42:53.101712 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 04 19:42:53.101712 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:42:53.101712 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:42:53.107745 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a028dbea-ff74-4cb5-9965-d3b7c1ab628e could not be found. Oct 04 19:42:53.107745 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:42:53.107745 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:42:53.107745 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:42:53.107745 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:42:53.107745 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:42:53.107745 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:42:53.107745 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:42:53.107745 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:42:53.107745 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a028dbea-ff74-4cb5-9965-d3b7c1ab628e could not be found. Oct 04 19:42:53.107745 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:42:53.107745 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-bb794953-9815-4715-8657-897f2d824258 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Returning 404 to user: Instance a028dbea-ff74-4cb5-9965-d3b7c1ab628e could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:42:53.107745 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-bb794953-9815-4715-8657-897f2d824258 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.034354 Oct 04 19:42:53.107745 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3885/7757] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 19:42:53 2022] GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e/os-volume_attachments => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:42:56.565874 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-89707ff0-9692-41f3-9f02-e64dd4c8f733 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:56.566490 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-89707ff0-9692-41f3-9f02-e64dd4c8f733 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:56.573488 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-89707ff0-9692-41f3-9f02-e64dd4c8f733 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:56.573991 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-89707ff0-9692-41f3-9f02-e64dd4c8f733 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:56.574445 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-89707ff0-9692-41f3-9f02-e64dd4c8f733 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:56.575192 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-89707ff0-9692-41f3-9f02-e64dd4c8f733 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:56.575630 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-89707ff0-9692-41f3-9f02-e64dd4c8f733 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:56.576087 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-89707ff0-9692-41f3-9f02-e64dd4c8f733 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:56.591323 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-89707ff0-9692-41f3-9f02-e64dd4c8f733 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] HTTP exception thrown: Instance a028dbea-ff74-4cb5-9965-d3b7c1ab628e could not be found. Oct 04 19:42:56.592732 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-89707ff0-9692-41f3-9f02-e64dd4c8f733 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Request method failure captured: Oct 04 19:42:56.592732 n-d-850501-14 devstack@n-api.service[123002]: request: DELETE /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e HTTP/1.1 Oct 04 19:42:56.592732 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 19:42:56.592732 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 19:42:56.592732 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 19:42:56.592732 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 19:42:56.592732 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 19:42:56.592732 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 19:42:56.592732 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 19:42:56.592732 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 19:42:56.592732 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPIsCyZ9ujYHj7xAc9v5FsVDNBnhQXdRu3HrD7Tq5GQWPtceXFx7qoWJz7lP8l4zGdRoz3AIMETvWSaNf7C0jkbsq4Fdp5SR34bQhmUN7dN-TqhYTJpmcPItgyv3Ip6rfSesFJ9T-vVra0xTUsrYnfVdo1LIR9dDYTmgb9RW4N3wBj3M Oct 04 19:42:56.592732 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 19:42:56.592732 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 19:42:56.592732 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 19:42:56.592732 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 19:42:56.592732 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 19:42:56.592732 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 19:42:56.592732 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 56eff05b035a45e0afc0f92d9d85e136 Oct 04 19:42:56.592732 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServerActionsTestJSON-2139592700 Oct 04 19:42:56.592732 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 19:42:56.592732 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 19:42:56.592732 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/56eff05b035a45e0afc0f92d9d85e136"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_56eff05b035a45e0afc0f92d9d85e136", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/56eff05b035a45e0afc0f92d9d85e136"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/56eff05b035a45e0afc0f92d9d85e136"}]}] Oct 04 19:42:56.592732 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServerActionsTestJSON-2139592700 Oct 04 19:42:56.592732 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 56eff05b035a45e0afc0f92d9d85e136 Oct 04 19:42:56.592732 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServerActionsTestJSON-2139592700 Oct 04 19:42:56.592732 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServerActionsTestJSON-2139592700-project Oct 04 19:42:56.592732 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 19:42:56.592732 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 19:42:56.592732 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 6970aa4f091c49e382c86a487d25d524 Oct 04 19:42:56.592732 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServerActionsTestJSON-2139592700-project Oct 04 19:42:56.592732 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 19:42:56.592732 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance a028dbea-ff74-4cb5-9965-d3b7c1ab628e could not be found. Oct 04 19:42:56.592732 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'a028dbea-ff74-4cb5-9965-d3b7c1ab628e'} Oct 04 19:42:56.592732 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:42:56.592732 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:42:56.592732 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:42:56.592732 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:42:56.592732 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:42:56.592732 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:42:56.592732 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:42:56.592732 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:42:56.592732 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:42:56.592732 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:42:56.592732 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a028dbea-ff74-4cb5-9965-d3b7c1ab628e could not be found. Oct 04 19:42:56.592732 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:42:56.592732 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:42:56.592732 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:42:56.592732 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:42:56.592732 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:42:56.592732 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:42:56.592732 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:42:56.592732 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:42:56.592732 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:42:56.592732 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:42:56.592732 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 19:42:56.592732 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 19:42:56.592732 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 19:42:56.592732 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 19:42:56.592732 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:42:56.592732 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:42:56.592732 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:42:56.592732 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:42:56.597827 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a028dbea-ff74-4cb5-9965-d3b7c1ab628e could not be found. Oct 04 19:42:56.597827 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:42:56.597827 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:42:56.597827 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:42:56.597827 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:42:56.597827 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:42:56.597827 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:42:56.597827 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:42:56.597827 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:42:56.597827 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a028dbea-ff74-4cb5-9965-d3b7c1ab628e could not be found. Oct 04 19:42:56.597827 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:42:56.597827 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-89707ff0-9692-41f3-9f02-e64dd4c8f733 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Returning 404 to user: Instance a028dbea-ff74-4cb5-9965-d3b7c1ab628e could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:42:56.597827 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-89707ff0-9692-41f3-9f02-e64dd4c8f733 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e" status: 404 len: 111 microversion: 2.1 time: 0.033311 Oct 04 19:42:56.597827 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3873/7758] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 19:42:56 2022] DELETE /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:42:56.604155 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-588cc1dd-c554-4887-8995-967b68cabcf3 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:56.604867 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-588cc1dd-c554-4887-8995-967b68cabcf3 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: a028dbea-ff74-4cb5-9965-d3b7c1ab628e] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:56.613395 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-588cc1dd-c554-4887-8995-967b68cabcf3 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:56.613890 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-588cc1dd-c554-4887-8995-967b68cabcf3 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:56.614335 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-588cc1dd-c554-4887-8995-967b68cabcf3 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:56.615049 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-588cc1dd-c554-4887-8995-967b68cabcf3 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:56.615509 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-588cc1dd-c554-4887-8995-967b68cabcf3 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:56.615939 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-588cc1dd-c554-4887-8995-967b68cabcf3 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:56.631778 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-588cc1dd-c554-4887-8995-967b68cabcf3 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] HTTP exception thrown: Instance a028dbea-ff74-4cb5-9965-d3b7c1ab628e could not be found. Oct 04 19:42:56.633405 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-588cc1dd-c554-4887-8995-967b68cabcf3 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Request method failure captured: Oct 04 19:42:56.633405 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e HTTP/1.1 Oct 04 19:42:56.633405 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 19:42:56.633405 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 19:42:56.633405 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 19:42:56.633405 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 19:42:56.633405 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 19:42:56.633405 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 19:42:56.633405 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 19:42:56.633405 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 19:42:56.633405 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPIsCyZ9ujYHj7xAc9v5FsVDNBnhQXdRu3HrD7Tq5GQWPtceXFx7qoWJz7lP8l4zGdRoz3AIMETvWSaNf7C0jkbsq4Fdp5SR34bQhmUN7dN-TqhYTJpmcPItgyv3Ip6rfSesFJ9T-vVra0xTUsrYnfVdo1LIR9dDYTmgb9RW4N3wBj3M Oct 04 19:42:56.633405 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 19:42:56.633405 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 19:42:56.633405 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 19:42:56.633405 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 19:42:56.633405 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 19:42:56.633405 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 19:42:56.633405 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 56eff05b035a45e0afc0f92d9d85e136 Oct 04 19:42:56.633405 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ServerActionsTestJSON-2139592700 Oct 04 19:42:56.633405 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 19:42:56.633405 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 19:42:56.633405 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/56eff05b035a45e0afc0f92d9d85e136"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_56eff05b035a45e0afc0f92d9d85e136", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/56eff05b035a45e0afc0f92d9d85e136"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/56eff05b035a45e0afc0f92d9d85e136"}]}] Oct 04 19:42:56.633405 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ServerActionsTestJSON-2139592700 Oct 04 19:42:56.633405 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 56eff05b035a45e0afc0f92d9d85e136 Oct 04 19:42:56.633405 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ServerActionsTestJSON-2139592700 Oct 04 19:42:56.633405 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ServerActionsTestJSON-2139592700-project Oct 04 19:42:56.633405 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 19:42:56.633405 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 19:42:56.633405 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 6970aa4f091c49e382c86a487d25d524 Oct 04 19:42:56.633405 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ServerActionsTestJSON-2139592700-project Oct 04 19:42:56.633405 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 19:42:56.633405 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance a028dbea-ff74-4cb5-9965-d3b7c1ab628e could not be found. Oct 04 19:42:56.633405 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': 'a028dbea-ff74-4cb5-9965-d3b7c1ab628e'} Oct 04 19:42:56.633405 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:42:56.633405 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:42:56.633405 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:42:56.633405 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:42:56.633405 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:42:56.633405 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:42:56.633405 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:42:56.633405 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:42:56.633405 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:42:56.633405 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:42:56.633405 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a028dbea-ff74-4cb5-9965-d3b7c1ab628e could not be found. Oct 04 19:42:56.633405 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:42:56.633405 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:42:56.633405 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:42:56.633405 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:42:56.633405 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:42:56.633405 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:42:56.633405 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:42:56.633405 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:42:56.633405 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:42:56.633405 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:42:56.633405 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:42:56.633405 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:42:56.633405 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:42:56.633405 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:42:56.633405 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:42:56.633405 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:42:56.633405 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a028dbea-ff74-4cb5-9965-d3b7c1ab628e could not be found. Oct 04 19:42:56.633405 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:42:56.633405 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:42:56.633405 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:42:56.638091 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:42:56.638091 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:42:56.638091 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:42:56.638091 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:42:56.638091 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:42:56.638091 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a028dbea-ff74-4cb5-9965-d3b7c1ab628e could not be found. Oct 04 19:42:56.638091 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:42:56.638091 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-588cc1dd-c554-4887-8995-967b68cabcf3 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Returning 404 to user: Instance a028dbea-ff74-4cb5-9965-d3b7c1ab628e could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:42:56.638091 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-588cc1dd-c554-4887-8995-967b68cabcf3 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e" status: 404 len: 111 microversion: 2.1 time: 0.035038 Oct 04 19:42:56.639986 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3886/7759] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:42:56 2022] GET /compute/v2.1/servers/a028dbea-ff74-4cb5-9965-d3b7c1ab628e => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:42:56.645469 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1fbb6cda-030d-4aee-9cc1-659581ca5093 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:56.646177 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1fbb6cda-030d-4aee-9cc1-659581ca5093 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 214e87c0-98fa-462e-a177-9780f1cc29ca] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:56.652409 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1fbb6cda-030d-4aee-9cc1-659581ca5093 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:56.652991 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1fbb6cda-030d-4aee-9cc1-659581ca5093 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:56.653520 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1fbb6cda-030d-4aee-9cc1-659581ca5093 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:56.654308 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1fbb6cda-030d-4aee-9cc1-659581ca5093 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:56.654961 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1fbb6cda-030d-4aee-9cc1-659581ca5093 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:56.655498 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1fbb6cda-030d-4aee-9cc1-659581ca5093 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:56.670160 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-1fbb6cda-030d-4aee-9cc1-659581ca5093 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] HTTP exception thrown: Instance 214e87c0-98fa-462e-a177-9780f1cc29ca could not be found. Oct 04 19:42:56.671872 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1fbb6cda-030d-4aee-9cc1-659581ca5093 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Request method failure captured: Oct 04 19:42:56.671872 n-d-850501-14 devstack@n-api.service[123002]: request: DELETE /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca HTTP/1.1 Oct 04 19:42:56.671872 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 19:42:56.671872 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 19:42:56.671872 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 19:42:56.671872 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 19:42:56.671872 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 19:42:56.671872 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 19:42:56.671872 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 19:42:56.671872 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 19:42:56.671872 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPIsCyZ9ujYHj7xAc9v5FsVDNBnhQXdRu3HrD7Tq5GQWPtceXFx7qoWJz7lP8l4zGdRoz3AIMETvWSaNf7C0jkbsq4Fdp5SR34bQhmUN7dN-TqhYTJpmcPItgyv3Ip6rfSesFJ9T-vVra0xTUsrYnfVdo1LIR9dDYTmgb9RW4N3wBj3M Oct 04 19:42:56.671872 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 19:42:56.671872 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 19:42:56.671872 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 19:42:56.671872 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 19:42:56.671872 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 19:42:56.671872 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 19:42:56.671872 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 56eff05b035a45e0afc0f92d9d85e136 Oct 04 19:42:56.671872 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServerActionsTestJSON-2139592700 Oct 04 19:42:56.671872 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 19:42:56.671872 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 19:42:56.671872 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/56eff05b035a45e0afc0f92d9d85e136"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_56eff05b035a45e0afc0f92d9d85e136", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/56eff05b035a45e0afc0f92d9d85e136"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/56eff05b035a45e0afc0f92d9d85e136"}]}] Oct 04 19:42:56.671872 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServerActionsTestJSON-2139592700 Oct 04 19:42:56.671872 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 56eff05b035a45e0afc0f92d9d85e136 Oct 04 19:42:56.671872 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServerActionsTestJSON-2139592700 Oct 04 19:42:56.671872 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServerActionsTestJSON-2139592700-project Oct 04 19:42:56.671872 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 19:42:56.671872 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 19:42:56.671872 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 6970aa4f091c49e382c86a487d25d524 Oct 04 19:42:56.671872 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServerActionsTestJSON-2139592700-project Oct 04 19:42:56.671872 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 19:42:56.671872 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 214e87c0-98fa-462e-a177-9780f1cc29ca could not be found. Oct 04 19:42:56.671872 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '214e87c0-98fa-462e-a177-9780f1cc29ca'} Oct 04 19:42:56.671872 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:42:56.671872 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:42:56.671872 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:42:56.671872 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:42:56.671872 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:42:56.671872 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:42:56.671872 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:42:56.671872 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:42:56.671872 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:42:56.671872 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:42:56.671872 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 214e87c0-98fa-462e-a177-9780f1cc29ca could not be found. Oct 04 19:42:56.671872 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:42:56.671872 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:42:56.671872 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:42:56.671872 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:42:56.671872 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:42:56.671872 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:42:56.671872 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:42:56.671872 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:42:56.671872 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:42:56.671872 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:42:56.671872 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 19:42:56.671872 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 19:42:56.671872 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 19:42:56.671872 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 19:42:56.671872 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:42:56.671872 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:42:56.671872 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:42:56.671872 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:42:56.677117 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 214e87c0-98fa-462e-a177-9780f1cc29ca could not be found. Oct 04 19:42:56.677117 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:42:56.677117 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:42:56.677117 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:42:56.677117 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:42:56.677117 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:42:56.677117 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:42:56.677117 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:42:56.677117 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:42:56.677117 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 214e87c0-98fa-462e-a177-9780f1cc29ca could not be found. Oct 04 19:42:56.677117 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:42:56.677117 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1fbb6cda-030d-4aee-9cc1-659581ca5093 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Returning 404 to user: Instance 214e87c0-98fa-462e-a177-9780f1cc29ca could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:42:56.677117 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1fbb6cda-030d-4aee-9cc1-659581ca5093 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "DELETE /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca" status: 404 len: 111 microversion: 2.1 time: 0.033876 Oct 04 19:42:56.677117 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3874/7760] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 19:42:56 2022] DELETE /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:42:56.683128 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3e72ee15-f1bf-438b-a742-d6a4fe62eaec tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:56.683842 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3e72ee15-f1bf-438b-a742-d6a4fe62eaec tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 214e87c0-98fa-462e-a177-9780f1cc29ca] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:56.690426 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3e72ee15-f1bf-438b-a742-d6a4fe62eaec tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:56.690914 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3e72ee15-f1bf-438b-a742-d6a4fe62eaec tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:56.691358 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3e72ee15-f1bf-438b-a742-d6a4fe62eaec tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:56.692109 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3e72ee15-f1bf-438b-a742-d6a4fe62eaec tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:56.692554 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3e72ee15-f1bf-438b-a742-d6a4fe62eaec tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:56.692986 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3e72ee15-f1bf-438b-a742-d6a4fe62eaec tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:56.707374 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-3e72ee15-f1bf-438b-a742-d6a4fe62eaec tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] HTTP exception thrown: Instance 214e87c0-98fa-462e-a177-9780f1cc29ca could not be found. Oct 04 19:42:56.708950 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3e72ee15-f1bf-438b-a742-d6a4fe62eaec tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Request method failure captured: Oct 04 19:42:56.708950 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca HTTP/1.1 Oct 04 19:42:56.708950 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 19:42:56.708950 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 19:42:56.708950 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 19:42:56.708950 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 19:42:56.708950 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 19:42:56.708950 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 19:42:56.708950 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 19:42:56.708950 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 19:42:56.708950 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPIsCyZ9ujYHj7xAc9v5FsVDNBnhQXdRu3HrD7Tq5GQWPtceXFx7qoWJz7lP8l4zGdRoz3AIMETvWSaNf7C0jkbsq4Fdp5SR34bQhmUN7dN-TqhYTJpmcPItgyv3Ip6rfSesFJ9T-vVra0xTUsrYnfVdo1LIR9dDYTmgb9RW4N3wBj3M Oct 04 19:42:56.708950 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 19:42:56.708950 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 19:42:56.708950 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 19:42:56.708950 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 19:42:56.708950 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 19:42:56.708950 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 19:42:56.708950 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 56eff05b035a45e0afc0f92d9d85e136 Oct 04 19:42:56.708950 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ServerActionsTestJSON-2139592700 Oct 04 19:42:56.708950 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 19:42:56.708950 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 19:42:56.708950 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/56eff05b035a45e0afc0f92d9d85e136"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_56eff05b035a45e0afc0f92d9d85e136", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/56eff05b035a45e0afc0f92d9d85e136"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/56eff05b035a45e0afc0f92d9d85e136"}]}] Oct 04 19:42:56.708950 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ServerActionsTestJSON-2139592700 Oct 04 19:42:56.708950 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 56eff05b035a45e0afc0f92d9d85e136 Oct 04 19:42:56.708950 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ServerActionsTestJSON-2139592700 Oct 04 19:42:56.708950 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ServerActionsTestJSON-2139592700-project Oct 04 19:42:56.708950 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 19:42:56.708950 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 19:42:56.708950 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 6970aa4f091c49e382c86a487d25d524 Oct 04 19:42:56.708950 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ServerActionsTestJSON-2139592700-project Oct 04 19:42:56.708950 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 19:42:56.708950 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 214e87c0-98fa-462e-a177-9780f1cc29ca could not be found. Oct 04 19:42:56.708950 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '214e87c0-98fa-462e-a177-9780f1cc29ca'} Oct 04 19:42:56.708950 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:42:56.708950 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:42:56.708950 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:42:56.708950 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:42:56.708950 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:42:56.708950 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:42:56.708950 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:42:56.708950 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:42:56.708950 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:42:56.708950 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:42:56.708950 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 214e87c0-98fa-462e-a177-9780f1cc29ca could not be found. Oct 04 19:42:56.708950 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:42:56.708950 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:42:56.708950 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:42:56.708950 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:42:56.708950 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:42:56.708950 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:42:56.708950 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:42:56.708950 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:42:56.708950 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:42:56.708950 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:42:56.708950 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:42:56.708950 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:42:56.708950 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:42:56.708950 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:42:56.708950 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:42:56.708950 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:42:56.708950 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 214e87c0-98fa-462e-a177-9780f1cc29ca could not be found. Oct 04 19:42:56.708950 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:42:56.708950 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:42:56.708950 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:42:56.713244 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:42:56.713244 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:42:56.713244 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:42:56.713244 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:42:56.713244 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:42:56.713244 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 214e87c0-98fa-462e-a177-9780f1cc29ca could not be found. Oct 04 19:42:56.713244 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:42:56.713244 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3e72ee15-f1bf-438b-a742-d6a4fe62eaec tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Returning 404 to user: Instance 214e87c0-98fa-462e-a177-9780f1cc29ca could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:42:56.713244 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3e72ee15-f1bf-438b-a742-d6a4fe62eaec tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca" status: 404 len: 111 microversion: 2.1 time: 0.031551 Oct 04 19:42:56.713244 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3887/7761] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:42:56 2022] GET /compute/v2.1/servers/214e87c0-98fa-462e-a177-9780f1cc29ca => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:42:56.722220 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f9d9613f-55cc-444f-84ef-cfac1f62f4ce tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:56.722950 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f9d9613f-55cc-444f-84ef-cfac1f62f4ce tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: fb263540-8e7c-43b1-9fb6-b92afe7ff384] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:56.730041 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f9d9613f-55cc-444f-84ef-cfac1f62f4ce tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:56.730694 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f9d9613f-55cc-444f-84ef-cfac1f62f4ce tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:56.731252 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f9d9613f-55cc-444f-84ef-cfac1f62f4ce tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:56.732079 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f9d9613f-55cc-444f-84ef-cfac1f62f4ce tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:56.732700 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f9d9613f-55cc-444f-84ef-cfac1f62f4ce tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:56.733214 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f9d9613f-55cc-444f-84ef-cfac1f62f4ce tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:56.748243 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-f9d9613f-55cc-444f-84ef-cfac1f62f4ce tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] HTTP exception thrown: Instance fb263540-8e7c-43b1-9fb6-b92afe7ff384 could not be found. Oct 04 19:42:56.749920 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f9d9613f-55cc-444f-84ef-cfac1f62f4ce tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Request method failure captured: Oct 04 19:42:56.749920 n-d-850501-14 devstack@n-api.service[123002]: request: DELETE /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384 HTTP/1.1 Oct 04 19:42:56.749920 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 19:42:56.749920 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 19:42:56.749920 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 19:42:56.749920 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 19:42:56.749920 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 19:42:56.749920 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 19:42:56.749920 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 19:42:56.749920 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 19:42:56.749920 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPIsCyZ9ujYHj7xAc9v5FsVDNBnhQXdRu3HrD7Tq5GQWPtceXFx7qoWJz7lP8l4zGdRoz3AIMETvWSaNf7C0jkbsq4Fdp5SR34bQhmUN7dN-TqhYTJpmcPItgyv3Ip6rfSesFJ9T-vVra0xTUsrYnfVdo1LIR9dDYTmgb9RW4N3wBj3M Oct 04 19:42:56.749920 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 19:42:56.749920 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 19:42:56.749920 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 19:42:56.749920 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 19:42:56.749920 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 19:42:56.749920 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 19:42:56.749920 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 56eff05b035a45e0afc0f92d9d85e136 Oct 04 19:42:56.749920 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServerActionsTestJSON-2139592700 Oct 04 19:42:56.749920 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 19:42:56.749920 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 19:42:56.749920 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/56eff05b035a45e0afc0f92d9d85e136"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_56eff05b035a45e0afc0f92d9d85e136", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/56eff05b035a45e0afc0f92d9d85e136"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/56eff05b035a45e0afc0f92d9d85e136"}]}] Oct 04 19:42:56.749920 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServerActionsTestJSON-2139592700 Oct 04 19:42:56.749920 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 56eff05b035a45e0afc0f92d9d85e136 Oct 04 19:42:56.749920 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServerActionsTestJSON-2139592700 Oct 04 19:42:56.749920 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServerActionsTestJSON-2139592700-project Oct 04 19:42:56.749920 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 19:42:56.749920 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 19:42:56.749920 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 6970aa4f091c49e382c86a487d25d524 Oct 04 19:42:56.749920 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServerActionsTestJSON-2139592700-project Oct 04 19:42:56.749920 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 19:42:56.749920 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance fb263540-8e7c-43b1-9fb6-b92afe7ff384 could not be found. Oct 04 19:42:56.749920 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'fb263540-8e7c-43b1-9fb6-b92afe7ff384'} Oct 04 19:42:56.749920 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:42:56.749920 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:42:56.749920 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:42:56.749920 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:42:56.749920 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:42:56.749920 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:42:56.749920 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:42:56.749920 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:42:56.749920 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:42:56.749920 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:42:56.749920 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb263540-8e7c-43b1-9fb6-b92afe7ff384 could not be found. Oct 04 19:42:56.749920 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:42:56.749920 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:42:56.749920 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:42:56.749920 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:42:56.749920 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:42:56.749920 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:42:56.749920 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:42:56.749920 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:42:56.749920 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:42:56.749920 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:42:56.749920 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 19:42:56.749920 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 19:42:56.749920 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 19:42:56.749920 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 19:42:56.749920 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:42:56.749920 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:42:56.749920 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:42:56.749920 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:42:56.755284 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb263540-8e7c-43b1-9fb6-b92afe7ff384 could not be found. Oct 04 19:42:56.755284 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:42:56.755284 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:42:56.755284 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:42:56.755284 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:42:56.755284 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:42:56.755284 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:42:56.755284 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:42:56.755284 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:42:56.755284 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb263540-8e7c-43b1-9fb6-b92afe7ff384 could not be found. Oct 04 19:42:56.755284 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:42:56.755284 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f9d9613f-55cc-444f-84ef-cfac1f62f4ce tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Returning 404 to user: Instance fb263540-8e7c-43b1-9fb6-b92afe7ff384 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:42:56.755284 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f9d9613f-55cc-444f-84ef-cfac1f62f4ce tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "DELETE /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384" status: 404 len: 111 microversion: 2.1 time: 0.037898 Oct 04 19:42:56.757102 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3875/7762] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 19:42:56 2022] DELETE /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:42:56.763590 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-11baffcd-9453-437a-9e31-c7b9923dd954 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:56.764208 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-11baffcd-9453-437a-9e31-c7b9923dd954 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: fb263540-8e7c-43b1-9fb6-b92afe7ff384] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:56.770507 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-11baffcd-9453-437a-9e31-c7b9923dd954 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:56.770993 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-11baffcd-9453-437a-9e31-c7b9923dd954 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:56.771434 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-11baffcd-9453-437a-9e31-c7b9923dd954 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:56.772158 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-11baffcd-9453-437a-9e31-c7b9923dd954 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:56.772620 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-11baffcd-9453-437a-9e31-c7b9923dd954 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:56.773052 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-11baffcd-9453-437a-9e31-c7b9923dd954 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:56.787384 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-11baffcd-9453-437a-9e31-c7b9923dd954 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] HTTP exception thrown: Instance fb263540-8e7c-43b1-9fb6-b92afe7ff384 could not be found. Oct 04 19:42:56.788895 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-11baffcd-9453-437a-9e31-c7b9923dd954 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Request method failure captured: Oct 04 19:42:56.788895 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384 HTTP/1.1 Oct 04 19:42:56.788895 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 19:42:56.788895 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 19:42:56.788895 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 19:42:56.788895 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 19:42:56.788895 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 19:42:56.788895 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 19:42:56.788895 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 19:42:56.788895 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 19:42:56.788895 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPIsCyZ9ujYHj7xAc9v5FsVDNBnhQXdRu3HrD7Tq5GQWPtceXFx7qoWJz7lP8l4zGdRoz3AIMETvWSaNf7C0jkbsq4Fdp5SR34bQhmUN7dN-TqhYTJpmcPItgyv3Ip6rfSesFJ9T-vVra0xTUsrYnfVdo1LIR9dDYTmgb9RW4N3wBj3M Oct 04 19:42:56.788895 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 19:42:56.788895 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 19:42:56.788895 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 19:42:56.788895 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 19:42:56.788895 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 19:42:56.788895 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 19:42:56.788895 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 56eff05b035a45e0afc0f92d9d85e136 Oct 04 19:42:56.788895 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ServerActionsTestJSON-2139592700 Oct 04 19:42:56.788895 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 19:42:56.788895 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 19:42:56.788895 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/56eff05b035a45e0afc0f92d9d85e136"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_56eff05b035a45e0afc0f92d9d85e136", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/56eff05b035a45e0afc0f92d9d85e136"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/56eff05b035a45e0afc0f92d9d85e136"}]}] Oct 04 19:42:56.788895 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ServerActionsTestJSON-2139592700 Oct 04 19:42:56.788895 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 56eff05b035a45e0afc0f92d9d85e136 Oct 04 19:42:56.788895 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ServerActionsTestJSON-2139592700 Oct 04 19:42:56.788895 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ServerActionsTestJSON-2139592700-project Oct 04 19:42:56.788895 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 19:42:56.788895 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 19:42:56.788895 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 6970aa4f091c49e382c86a487d25d524 Oct 04 19:42:56.788895 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ServerActionsTestJSON-2139592700-project Oct 04 19:42:56.788895 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 19:42:56.788895 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance fb263540-8e7c-43b1-9fb6-b92afe7ff384 could not be found. Oct 04 19:42:56.788895 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': 'fb263540-8e7c-43b1-9fb6-b92afe7ff384'} Oct 04 19:42:56.788895 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:42:56.788895 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:42:56.788895 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:42:56.788895 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:42:56.788895 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:42:56.788895 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:42:56.788895 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:42:56.788895 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:42:56.788895 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:42:56.788895 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:42:56.788895 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb263540-8e7c-43b1-9fb6-b92afe7ff384 could not be found. Oct 04 19:42:56.788895 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:42:56.788895 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:42:56.788895 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:42:56.788895 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:42:56.788895 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:42:56.788895 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:42:56.788895 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:42:56.788895 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:42:56.788895 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:42:56.788895 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:42:56.788895 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:42:56.788895 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:42:56.788895 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:42:56.788895 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:42:56.788895 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:42:56.788895 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:42:56.788895 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb263540-8e7c-43b1-9fb6-b92afe7ff384 could not be found. Oct 04 19:42:56.788895 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:42:56.788895 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:42:56.788895 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:42:56.793927 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:42:56.793927 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:42:56.793927 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:42:56.793927 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:42:56.793927 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:42:56.793927 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb263540-8e7c-43b1-9fb6-b92afe7ff384 could not be found. Oct 04 19:42:56.793927 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:42:56.793927 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-11baffcd-9453-437a-9e31-c7b9923dd954 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Returning 404 to user: Instance fb263540-8e7c-43b1-9fb6-b92afe7ff384 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:42:56.793927 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-11baffcd-9453-437a-9e31-c7b9923dd954 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384" status: 404 len: 111 microversion: 2.1 time: 0.030592 Oct 04 19:42:56.794773 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3888/7763] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:42:56 2022] GET /compute/v2.1/servers/fb263540-8e7c-43b1-9fb6-b92afe7ff384 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:42:56.800465 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-aa8da60d-46c7-4134-b665-8aebe04394c0 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:56.801090 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-aa8da60d-46c7-4134-b665-8aebe04394c0 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 9eebfa95-bb07-411a-a10e-c31182df3062] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:56.809626 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aa8da60d-46c7-4134-b665-8aebe04394c0 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:56.810150 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aa8da60d-46c7-4134-b665-8aebe04394c0 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:56.810611 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aa8da60d-46c7-4134-b665-8aebe04394c0 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:56.811382 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aa8da60d-46c7-4134-b665-8aebe04394c0 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:56.811863 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aa8da60d-46c7-4134-b665-8aebe04394c0 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:56.812336 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aa8da60d-46c7-4134-b665-8aebe04394c0 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:56.830468 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-aa8da60d-46c7-4134-b665-8aebe04394c0 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] HTTP exception thrown: Instance 9eebfa95-bb07-411a-a10e-c31182df3062 could not be found. Oct 04 19:42:56.832310 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-aa8da60d-46c7-4134-b665-8aebe04394c0 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Request method failure captured: Oct 04 19:42:56.832310 n-d-850501-14 devstack@n-api.service[123002]: request: DELETE /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062 HTTP/1.1 Oct 04 19:42:56.832310 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 19:42:56.832310 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 19:42:56.832310 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 19:42:56.832310 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 19:42:56.832310 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 19:42:56.832310 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 19:42:56.832310 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 19:42:56.832310 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 19:42:56.832310 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPIsCyZ9ujYHj7xAc9v5FsVDNBnhQXdRu3HrD7Tq5GQWPtceXFx7qoWJz7lP8l4zGdRoz3AIMETvWSaNf7C0jkbsq4Fdp5SR34bQhmUN7dN-TqhYTJpmcPItgyv3Ip6rfSesFJ9T-vVra0xTUsrYnfVdo1LIR9dDYTmgb9RW4N3wBj3M Oct 04 19:42:56.832310 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 19:42:56.832310 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 19:42:56.832310 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 19:42:56.832310 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 19:42:56.832310 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 19:42:56.832310 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 19:42:56.832310 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 56eff05b035a45e0afc0f92d9d85e136 Oct 04 19:42:56.832310 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServerActionsTestJSON-2139592700 Oct 04 19:42:56.832310 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 19:42:56.832310 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 19:42:56.832310 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/56eff05b035a45e0afc0f92d9d85e136"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_56eff05b035a45e0afc0f92d9d85e136", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/56eff05b035a45e0afc0f92d9d85e136"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/56eff05b035a45e0afc0f92d9d85e136"}]}] Oct 04 19:42:56.832310 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServerActionsTestJSON-2139592700 Oct 04 19:42:56.832310 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 56eff05b035a45e0afc0f92d9d85e136 Oct 04 19:42:56.832310 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServerActionsTestJSON-2139592700 Oct 04 19:42:56.832310 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServerActionsTestJSON-2139592700-project Oct 04 19:42:56.832310 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 19:42:56.832310 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 19:42:56.832310 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 6970aa4f091c49e382c86a487d25d524 Oct 04 19:42:56.832310 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServerActionsTestJSON-2139592700-project Oct 04 19:42:56.832310 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 19:42:56.832310 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 9eebfa95-bb07-411a-a10e-c31182df3062 could not be found. Oct 04 19:42:56.832310 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '9eebfa95-bb07-411a-a10e-c31182df3062'} Oct 04 19:42:56.832310 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:42:56.832310 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:42:56.832310 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:42:56.832310 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:42:56.832310 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:42:56.832310 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:42:56.832310 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:42:56.832310 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:42:56.832310 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:42:56.832310 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:42:56.832310 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9eebfa95-bb07-411a-a10e-c31182df3062 could not be found. Oct 04 19:42:56.832310 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:42:56.832310 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:42:56.832310 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:42:56.832310 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:42:56.832310 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:42:56.832310 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:42:56.832310 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:42:56.832310 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:42:56.832310 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:42:56.832310 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:42:56.832310 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 19:42:56.832310 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 19:42:56.832310 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 19:42:56.832310 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 19:42:56.832310 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:42:56.832310 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:42:56.832310 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:42:56.832310 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:42:56.836703 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9eebfa95-bb07-411a-a10e-c31182df3062 could not be found. Oct 04 19:42:56.836703 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:42:56.836703 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:42:56.836703 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:42:56.836703 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:42:56.836703 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:42:56.836703 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:42:56.836703 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:42:56.836703 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:42:56.836703 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9eebfa95-bb07-411a-a10e-c31182df3062 could not be found. Oct 04 19:42:56.836703 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:42:56.836703 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-aa8da60d-46c7-4134-b665-8aebe04394c0 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Returning 404 to user: Instance 9eebfa95-bb07-411a-a10e-c31182df3062 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:42:56.836703 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-aa8da60d-46c7-4134-b665-8aebe04394c0 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062" status: 404 len: 111 microversion: 2.1 time: 0.038104 Oct 04 19:42:56.836703 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3876/7764] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 19:42:56 2022] DELETE /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:42:56.842829 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-be176616-ca5c-4f5f-8b36-b8e8f2c0a020 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:56.843446 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-be176616-ca5c-4f5f-8b36-b8e8f2c0a020 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] [instance: 9eebfa95-bb07-411a-a10e-c31182df3062] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:56.849891 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-be176616-ca5c-4f5f-8b36-b8e8f2c0a020 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:56.850383 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-be176616-ca5c-4f5f-8b36-b8e8f2c0a020 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:56.850868 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-be176616-ca5c-4f5f-8b36-b8e8f2c0a020 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:56.851564 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-be176616-ca5c-4f5f-8b36-b8e8f2c0a020 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:56.852023 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-be176616-ca5c-4f5f-8b36-b8e8f2c0a020 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:56.852467 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-be176616-ca5c-4f5f-8b36-b8e8f2c0a020 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:56.867007 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-be176616-ca5c-4f5f-8b36-b8e8f2c0a020 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] HTTP exception thrown: Instance 9eebfa95-bb07-411a-a10e-c31182df3062 could not be found. Oct 04 19:42:56.868611 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-be176616-ca5c-4f5f-8b36-b8e8f2c0a020 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Request method failure captured: Oct 04 19:42:56.868611 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062 HTTP/1.1 Oct 04 19:42:56.868611 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 19:42:56.868611 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 19:42:56.868611 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 19:42:56.868611 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 19:42:56.868611 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 19:42:56.868611 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 19:42:56.868611 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 19:42:56.868611 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 19:42:56.868611 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPIsCyZ9ujYHj7xAc9v5FsVDNBnhQXdRu3HrD7Tq5GQWPtceXFx7qoWJz7lP8l4zGdRoz3AIMETvWSaNf7C0jkbsq4Fdp5SR34bQhmUN7dN-TqhYTJpmcPItgyv3Ip6rfSesFJ9T-vVra0xTUsrYnfVdo1LIR9dDYTmgb9RW4N3wBj3M Oct 04 19:42:56.868611 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 19:42:56.868611 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 19:42:56.868611 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 19:42:56.868611 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 19:42:56.868611 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 19:42:56.868611 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 19:42:56.868611 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 56eff05b035a45e0afc0f92d9d85e136 Oct 04 19:42:56.868611 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ServerActionsTestJSON-2139592700 Oct 04 19:42:56.868611 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 19:42:56.868611 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 19:42:56.868611 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/56eff05b035a45e0afc0f92d9d85e136"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_56eff05b035a45e0afc0f92d9d85e136", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/56eff05b035a45e0afc0f92d9d85e136"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/56eff05b035a45e0afc0f92d9d85e136"}]}] Oct 04 19:42:56.868611 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ServerActionsTestJSON-2139592700 Oct 04 19:42:56.868611 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 56eff05b035a45e0afc0f92d9d85e136 Oct 04 19:42:56.868611 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ServerActionsTestJSON-2139592700 Oct 04 19:42:56.868611 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ServerActionsTestJSON-2139592700-project Oct 04 19:42:56.868611 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 19:42:56.868611 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 19:42:56.868611 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 6970aa4f091c49e382c86a487d25d524 Oct 04 19:42:56.868611 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ServerActionsTestJSON-2139592700-project Oct 04 19:42:56.868611 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 19:42:56.868611 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 9eebfa95-bb07-411a-a10e-c31182df3062 could not be found. Oct 04 19:42:56.868611 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '9eebfa95-bb07-411a-a10e-c31182df3062'} Oct 04 19:42:56.868611 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:42:56.868611 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:42:56.868611 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:42:56.868611 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:42:56.868611 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:42:56.868611 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:42:56.868611 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:42:56.868611 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:42:56.868611 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:42:56.868611 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:42:56.868611 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9eebfa95-bb07-411a-a10e-c31182df3062 could not be found. Oct 04 19:42:56.868611 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:42:56.868611 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:42:56.868611 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:42:56.868611 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:42:56.868611 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:42:56.868611 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:42:56.868611 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:42:56.868611 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:42:56.868611 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:42:56.868611 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:42:56.868611 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:42:56.868611 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:42:56.868611 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:42:56.868611 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:42:56.868611 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:42:56.868611 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:42:56.868611 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9eebfa95-bb07-411a-a10e-c31182df3062 could not be found. Oct 04 19:42:56.868611 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:42:56.868611 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:42:56.868611 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:42:56.872906 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:42:56.872906 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:42:56.872906 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:42:56.872906 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:42:56.872906 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:42:56.872906 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9eebfa95-bb07-411a-a10e-c31182df3062 could not be found. Oct 04 19:42:56.872906 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:42:56.872906 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-be176616-ca5c-4f5f-8b36-b8e8f2c0a020 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Returning 404 to user: Instance 9eebfa95-bb07-411a-a10e-c31182df3062 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:42:56.872906 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-be176616-ca5c-4f5f-8b36-b8e8f2c0a020 tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062" status: 404 len: 111 microversion: 2.1 time: 0.031029 Oct 04 19:42:56.872906 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3889/7765] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:42:56 2022] GET /compute/v2.1/servers/9eebfa95-bb07-411a-a10e-c31182df3062 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:42:56.879059 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-07d058e3-4110-4b2f-b631-820f2b7e361e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] Calling method '.version_select at 0x7fe25d349c10>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:56.971425 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-07d058e3-4110-4b2f-b631-820f2b7e361e tempest-ServerActionsTestJSON-2139592700 tempest-ServerActionsTestJSON-2139592700-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-980628313" status: 202 len: 0 microversion: 2.1 time: 0.096303 Oct 04 19:42:56.972307 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3877/7766] 10.222.0.20 () {58 vars in 1218 bytes} [Tue Oct 4 19:42:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-980628313 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:43:08.885171 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:43:08.886312 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:43:09.027101 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0254bc7f-b7b8-4668-ac8d-dd61b982d349 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2121942852", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": [{"uuid": "7716be19-9a4c-4427-bdc9-80380e832fc6"}]}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:43:09.086662 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.neutron [None req-0254bc7f-b7b8-4668-ac8d-dd61b982d349 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] validate_networks() for [('7716be19-9a4c-4427-bdc9-80380e832fc6', None, None, None, None, None)] {{(pid=123001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:43:09.558153 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-0254bc7f-b7b8-4668-ac8d-dd61b982d349 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:43:09.558581 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-0254bc7f-b7b8-4668-ac8d-dd61b982d349 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:43:09.559069 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-0254bc7f-b7b8-4668-ac8d-dd61b982d349 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:43:09.559485 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-0254bc7f-b7b8-4668-ac8d-dd61b982d349 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:43:09.559902 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-0254bc7f-b7b8-4668-ac8d-dd61b982d349 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:43:09.569678 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0254bc7f-b7b8-4668-ac8d-dd61b982d349 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:09.570163 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0254bc7f-b7b8-4668-ac8d-dd61b982d349 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:09.570604 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0254bc7f-b7b8-4668-ac8d-dd61b982d349 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:09.571333 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0254bc7f-b7b8-4668-ac8d-dd61b982d349 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:09.571789 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0254bc7f-b7b8-4668-ac8d-dd61b982d349 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:09.572247 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0254bc7f-b7b8-4668-ac8d-dd61b982d349 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:09.590445 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-0254bc7f-b7b8-4668-ac8d-dd61b982d349 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Getting quotas for project b4008b0bcf5a48b48259ae8430e7b281. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:43:09.596667 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-0254bc7f-b7b8-4668-ac8d-dd61b982d349 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Getting quotas for user 362e50a631884c4ca7f6d94d89523cc8 and project b4008b0bcf5a48b48259ae8430e7b281. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:43:09.613647 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0254bc7f-b7b8-4668-ac8d-dd61b982d349 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Going to run 1 instances... {{(pid=123001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:43:09.615998 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0254bc7f-b7b8-4668-ac8d-dd61b982d349 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] [instance: 91dfe89b-dee9-460a-be0e-1db736b43ccd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:43:09.739117 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0254bc7f-b7b8-4668-ac8d-dd61b982d349 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.859776 Oct 04 19:43:09.739907 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3890/7767] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 19:43:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 861 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:43:09.749165 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=91 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:43:09.749986 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=36,nova_api:DELETE=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:43:09.755041 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7a781346-535b-41cf-b6f1-39b255d0fab5 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:43:09.755696 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7a781346-535b-41cf-b6f1-39b255d0fab5 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] [instance: 91dfe89b-dee9-460a-be0e-1db736b43ccd] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:43:09.812537 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7a781346-535b-41cf-b6f1-39b255d0fab5 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362e50a631884c4ca7f6d94d89523cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4008b0bcf5a48b48259ae8430e7b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:43:09.821039 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7a781346-535b-41cf-b6f1-39b255d0fab5 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] 10.222.0.20 "GET /compute/v2.1/servers/91dfe89b-dee9-460a-be0e-1db736b43ccd" status: 200 len: 1217 microversion: 2.1 time: 0.073709 Oct 04 19:43:09.821628 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3878/7768] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:43:09 2022] GET /compute/v2.1/servers/91dfe89b-dee9-460a-be0e-1db736b43ccd => generated 1217 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:43:10.843397 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a06ea609-5e10-4ab0-9797-4c6e90cd7c12 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:43:10.844066 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a06ea609-5e10-4ab0-9797-4c6e90cd7c12 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] [instance: 91dfe89b-dee9-460a-be0e-1db736b43ccd] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:43:10.901518 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a06ea609-5e10-4ab0-9797-4c6e90cd7c12 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362e50a631884c4ca7f6d94d89523cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4008b0bcf5a48b48259ae8430e7b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:43:10.909162 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a06ea609-5e10-4ab0-9797-4c6e90cd7c12 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] 10.222.0.20 "GET /compute/v2.1/servers/91dfe89b-dee9-460a-be0e-1db736b43ccd" status: 200 len: 1217 microversion: 2.1 time: 0.069685 Oct 04 19:43:10.909745 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3891/7769] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:43:10 2022] GET /compute/v2.1/servers/91dfe89b-dee9-460a-be0e-1db736b43ccd => generated 1217 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:43:11.933889 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-890e9444-4eec-4095-9305-b1f924d11aa0 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:43:11.935383 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-890e9444-4eec-4095-9305-b1f924d11aa0 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] [instance: 91dfe89b-dee9-460a-be0e-1db736b43ccd] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:43:11.945164 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-890e9444-4eec-4095-9305-b1f924d11aa0 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:11.945897 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-890e9444-4eec-4095-9305-b1f924d11aa0 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:11.946541 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-890e9444-4eec-4095-9305-b1f924d11aa0 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:11.947398 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-890e9444-4eec-4095-9305-b1f924d11aa0 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:11.948031 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-890e9444-4eec-4095-9305-b1f924d11aa0 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:11.948750 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-890e9444-4eec-4095-9305-b1f924d11aa0 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:12.017585 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-890e9444-4eec-4095-9305-b1f924d11aa0 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362e50a631884c4ca7f6d94d89523cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4008b0bcf5a48b48259ae8430e7b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:43:12.025604 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-890e9444-4eec-4095-9305-b1f924d11aa0 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] 10.222.0.20 "GET /compute/v2.1/servers/91dfe89b-dee9-460a-be0e-1db736b43ccd" status: 200 len: 1269 microversion: 2.1 time: 0.096322 Oct 04 19:43:12.026276 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3879/7770] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:43:11 2022] GET /compute/v2.1/servers/91dfe89b-dee9-460a-be0e-1db736b43ccd => generated 1269 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:43:13.050986 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0877709b-281a-46e5-ab62-a3fd9dcaf4c5 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:43:13.051613 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0877709b-281a-46e5-ab62-a3fd9dcaf4c5 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] [instance: 91dfe89b-dee9-460a-be0e-1db736b43ccd] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:43:13.058772 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0877709b-281a-46e5-ab62-a3fd9dcaf4c5 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:13.063671 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0877709b-281a-46e5-ab62-a3fd9dcaf4c5 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:13.063671 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0877709b-281a-46e5-ab62-a3fd9dcaf4c5 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:13.063671 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0877709b-281a-46e5-ab62-a3fd9dcaf4c5 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:13.063671 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0877709b-281a-46e5-ab62-a3fd9dcaf4c5 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:13.063671 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0877709b-281a-46e5-ab62-a3fd9dcaf4c5 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:13.280924 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0877709b-281a-46e5-ab62-a3fd9dcaf4c5 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362e50a631884c4ca7f6d94d89523cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4008b0bcf5a48b48259ae8430e7b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:43:13.293601 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0877709b-281a-46e5-ab62-a3fd9dcaf4c5 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] 10.222.0.20 "GET /compute/v2.1/servers/91dfe89b-dee9-460a-be0e-1db736b43ccd" status: 200 len: 1317 microversion: 2.1 time: 0.243886 Oct 04 19:43:13.293601 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3892/7771] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:43:13 2022] GET /compute/v2.1/servers/91dfe89b-dee9-460a-be0e-1db736b43ccd => generated 1317 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:43:14.119853 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-155985ab-7883-406e-8279-586d7ed7de6a req-177f20fb-99e3-469c-ab02-4471a9edb4b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91dfe89b-dee9-460a-be0e-1db736b43ccd", "tag": "2e25b805-39a4-4097-833d-e97c43c9ea35"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:43:14.131202 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-155985ab-7883-406e-8279-586d7ed7de6a req-177f20fb-99e3-469c-ab02-4471a9edb4b3 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:14.131722 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-155985ab-7883-406e-8279-586d7ed7de6a req-177f20fb-99e3-469c-ab02-4471a9edb4b3 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:14.132184 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-155985ab-7883-406e-8279-586d7ed7de6a req-177f20fb-99e3-469c-ab02-4471a9edb4b3 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:14.144460 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-155985ab-7883-406e-8279-586d7ed7de6a req-177f20fb-99e3-469c-ab02-4471a9edb4b3 service nova] Creating event network-changed:2e25b805-39a4-4097-833d-e97c43c9ea35 for instance 91dfe89b-dee9-460a-be0e-1db736b43ccd on n-h1-850501-14 Oct 04 19:43:14.149428 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-155985ab-7883-406e-8279-586d7ed7de6a req-177f20fb-99e3-469c-ab02-4471a9edb4b3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033447 Oct 04 19:43:14.150050 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3880/7772] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:43:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:43:14.314312 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1bbae7ce-d73f-48b8-8ca3-323bfd1fdf77 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:43:14.314968 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1bbae7ce-d73f-48b8-8ca3-323bfd1fdf77 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] [instance: 91dfe89b-dee9-460a-be0e-1db736b43ccd] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:43:14.322166 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1bbae7ce-d73f-48b8-8ca3-323bfd1fdf77 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:14.322743 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1bbae7ce-d73f-48b8-8ca3-323bfd1fdf77 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:14.323257 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1bbae7ce-d73f-48b8-8ca3-323bfd1fdf77 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:14.323982 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1bbae7ce-d73f-48b8-8ca3-323bfd1fdf77 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:14.324465 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1bbae7ce-d73f-48b8-8ca3-323bfd1fdf77 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:14.324896 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1bbae7ce-d73f-48b8-8ca3-323bfd1fdf77 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:14.847210 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1bbae7ce-d73f-48b8-8ca3-323bfd1fdf77 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362e50a631884c4ca7f6d94d89523cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4008b0bcf5a48b48259ae8430e7b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:43:14.855951 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1bbae7ce-d73f-48b8-8ca3-323bfd1fdf77 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] 10.222.0.20 "GET /compute/v2.1/servers/91dfe89b-dee9-460a-be0e-1db736b43ccd" status: 200 len: 1317 microversion: 2.1 time: 0.546038 Oct 04 19:43:14.856577 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3893/7773] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:43:14 2022] GET /compute/v2.1/servers/91dfe89b-dee9-460a-be0e-1db736b43ccd => generated 1317 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:43:15.881635 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7c9d02e3-1836-4eaa-9892-d2d4a2279544 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:43:15.882350 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7c9d02e3-1836-4eaa-9892-d2d4a2279544 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] [instance: 91dfe89b-dee9-460a-be0e-1db736b43ccd] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:43:15.888607 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c9d02e3-1836-4eaa-9892-d2d4a2279544 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:15.889106 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c9d02e3-1836-4eaa-9892-d2d4a2279544 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:15.889551 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c9d02e3-1836-4eaa-9892-d2d4a2279544 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:15.890246 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c9d02e3-1836-4eaa-9892-d2d4a2279544 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:15.890722 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c9d02e3-1836-4eaa-9892-d2d4a2279544 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:15.891166 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c9d02e3-1836-4eaa-9892-d2d4a2279544 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:16.023890 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7c9d02e3-1836-4eaa-9892-d2d4a2279544 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362e50a631884c4ca7f6d94d89523cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4008b0bcf5a48b48259ae8430e7b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:43:16.031997 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7c9d02e3-1836-4eaa-9892-d2d4a2279544 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] 10.222.0.20 "GET /compute/v2.1/servers/91dfe89b-dee9-460a-be0e-1db736b43ccd" status: 200 len: 1317 microversion: 2.1 time: 0.155094 Oct 04 19:43:16.032659 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3881/7774] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:43:15 2022] GET /compute/v2.1/servers/91dfe89b-dee9-460a-be0e-1db736b43ccd => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:43:17.054645 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-22ba3666-e088-436b-803c-756f33134d42 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:43:17.055179 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-22ba3666-e088-436b-803c-756f33134d42 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] [instance: 91dfe89b-dee9-460a-be0e-1db736b43ccd] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:43:17.061103 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-22ba3666-e088-436b-803c-756f33134d42 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:17.061576 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-22ba3666-e088-436b-803c-756f33134d42 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:17.062002 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-22ba3666-e088-436b-803c-756f33134d42 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:17.063309 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-22ba3666-e088-436b-803c-756f33134d42 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:17.063786 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-22ba3666-e088-436b-803c-756f33134d42 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:17.064235 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-22ba3666-e088-436b-803c-756f33134d42 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:17.190780 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-22ba3666-e088-436b-803c-756f33134d42 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362e50a631884c4ca7f6d94d89523cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4008b0bcf5a48b48259ae8430e7b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:43:17.198622 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-22ba3666-e088-436b-803c-756f33134d42 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] 10.222.0.20 "GET /compute/v2.1/servers/91dfe89b-dee9-460a-be0e-1db736b43ccd" status: 200 len: 1317 microversion: 2.1 time: 0.148311 Oct 04 19:43:17.199187 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3894/7775] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:43:17 2022] GET /compute/v2.1/servers/91dfe89b-dee9-460a-be0e-1db736b43ccd => generated 1317 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:43:18.231955 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ceffc817-7d14-4b12-80bc-c6bb49ddbcdb tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:43:18.232636 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ceffc817-7d14-4b12-80bc-c6bb49ddbcdb tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] [instance: 91dfe89b-dee9-460a-be0e-1db736b43ccd] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:43:18.239608 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ceffc817-7d14-4b12-80bc-c6bb49ddbcdb tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:18.240200 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ceffc817-7d14-4b12-80bc-c6bb49ddbcdb tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:18.240650 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ceffc817-7d14-4b12-80bc-c6bb49ddbcdb tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:18.241354 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ceffc817-7d14-4b12-80bc-c6bb49ddbcdb tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:18.241819 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ceffc817-7d14-4b12-80bc-c6bb49ddbcdb tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:18.242268 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ceffc817-7d14-4b12-80bc-c6bb49ddbcdb tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:18.380340 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ceffc817-7d14-4b12-80bc-c6bb49ddbcdb tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362e50a631884c4ca7f6d94d89523cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4008b0bcf5a48b48259ae8430e7b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:43:18.388279 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ceffc817-7d14-4b12-80bc-c6bb49ddbcdb tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] 10.222.0.20 "GET /compute/v2.1/servers/91dfe89b-dee9-460a-be0e-1db736b43ccd" status: 200 len: 1317 microversion: 2.1 time: 0.160269 Oct 04 19:43:18.388867 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3882/7776] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:43:18 2022] GET /compute/v2.1/servers/91dfe89b-dee9-460a-be0e-1db736b43ccd => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:43:19.411141 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-97342fa8-1f50-4368-99bc-607e2ac05ce3 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:43:19.411768 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-97342fa8-1f50-4368-99bc-607e2ac05ce3 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] [instance: 91dfe89b-dee9-460a-be0e-1db736b43ccd] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:43:19.418966 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-97342fa8-1f50-4368-99bc-607e2ac05ce3 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:19.424766 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-97342fa8-1f50-4368-99bc-607e2ac05ce3 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:19.424766 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-97342fa8-1f50-4368-99bc-607e2ac05ce3 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:19.424766 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-97342fa8-1f50-4368-99bc-607e2ac05ce3 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:19.424766 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-97342fa8-1f50-4368-99bc-607e2ac05ce3 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:19.424766 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-97342fa8-1f50-4368-99bc-607e2ac05ce3 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:19.563357 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-97342fa8-1f50-4368-99bc-607e2ac05ce3 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362e50a631884c4ca7f6d94d89523cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4008b0bcf5a48b48259ae8430e7b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:43:19.571252 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-97342fa8-1f50-4368-99bc-607e2ac05ce3 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] 10.222.0.20 "GET /compute/v2.1/servers/91dfe89b-dee9-460a-be0e-1db736b43ccd" status: 200 len: 1317 microversion: 2.1 time: 0.164209 Oct 04 19:43:19.571828 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3895/7777] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:43:19 2022] GET /compute/v2.1/servers/91dfe89b-dee9-460a-be0e-1db736b43ccd => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:43:20.595882 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e785868e-4973-4e57-80c5-d2f49a7a77d8 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:43:20.596590 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e785868e-4973-4e57-80c5-d2f49a7a77d8 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] [instance: 91dfe89b-dee9-460a-be0e-1db736b43ccd] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:43:20.599658 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:43:20.604557 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e785868e-4973-4e57-80c5-d2f49a7a77d8 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:20.605057 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e785868e-4973-4e57-80c5-d2f49a7a77d8 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:20.605509 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e785868e-4973-4e57-80c5-d2f49a7a77d8 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:20.606222 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e785868e-4973-4e57-80c5-d2f49a7a77d8 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:20.606690 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e785868e-4973-4e57-80c5-d2f49a7a77d8 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:20.607133 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e785868e-4973-4e57-80c5-d2f49a7a77d8 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:20.764209 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e785868e-4973-4e57-80c5-d2f49a7a77d8 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362e50a631884c4ca7f6d94d89523cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4008b0bcf5a48b48259ae8430e7b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:43:20.764209 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e785868e-4973-4e57-80c5-d2f49a7a77d8 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] 10.222.0.20 "GET /compute/v2.1/servers/91dfe89b-dee9-460a-be0e-1db736b43ccd" status: 200 len: 1317 microversion: 2.1 time: 0.163212 Oct 04 19:43:20.764209 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3883/7778] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:43:20 2022] GET /compute/v2.1/servers/91dfe89b-dee9-460a-be0e-1db736b43ccd => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:43:21.298072 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-c00be887-d528-4b46-940c-263968cf6154 req-92a288c5-87c8-4001-bcaa-60c1568c3656 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91dfe89b-dee9-460a-be0e-1db736b43ccd", "name": "network-vif-plugged", "status": "completed", "tag": "2e25b805-39a4-4097-833d-e97c43c9ea35"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:43:21.303300 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:43:21.304897 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=8 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:43:21.310590 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-c00be887-d528-4b46-940c-263968cf6154 req-92a288c5-87c8-4001-bcaa-60c1568c3656 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:21.310590 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-c00be887-d528-4b46-940c-263968cf6154 req-92a288c5-87c8-4001-bcaa-60c1568c3656 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:21.311053 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-c00be887-d528-4b46-940c-263968cf6154 req-92a288c5-87c8-4001-bcaa-60c1568c3656 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:21.322512 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-c00be887-d528-4b46-940c-263968cf6154 req-92a288c5-87c8-4001-bcaa-60c1568c3656 service nova] Creating event network-vif-plugged:2e25b805-39a4-4097-833d-e97c43c9ea35 for instance 91dfe89b-dee9-460a-be0e-1db736b43ccd on n-h1-850501-14 Oct 04 19:43:21.327803 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-c00be887-d528-4b46-940c-263968cf6154 req-92a288c5-87c8-4001-bcaa-60c1568c3656 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033426 Oct 04 19:43:21.329262 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3896/7779] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:43:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:43:21.786430 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7b749bb2-8f36-4afb-b866-cb41be377ca6 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:43:21.787061 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7b749bb2-8f36-4afb-b866-cb41be377ca6 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] [instance: 91dfe89b-dee9-460a-be0e-1db736b43ccd] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:43:21.794191 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7b749bb2-8f36-4afb-b866-cb41be377ca6 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:21.794706 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7b749bb2-8f36-4afb-b866-cb41be377ca6 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:21.795163 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7b749bb2-8f36-4afb-b866-cb41be377ca6 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:21.795882 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7b749bb2-8f36-4afb-b866-cb41be377ca6 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:21.796500 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7b749bb2-8f36-4afb-b866-cb41be377ca6 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:21.797525 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7b749bb2-8f36-4afb-b866-cb41be377ca6 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:21.930000 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7b749bb2-8f36-4afb-b866-cb41be377ca6 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362e50a631884c4ca7f6d94d89523cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4008b0bcf5a48b48259ae8430e7b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:43:21.938214 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7b749bb2-8f36-4afb-b866-cb41be377ca6 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] 10.222.0.20 "GET /compute/v2.1/servers/91dfe89b-dee9-460a-be0e-1db736b43ccd" status: 200 len: 1317 microversion: 2.1 time: 0.155274 Oct 04 19:43:21.938798 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3884/7780] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:43:21 2022] GET /compute/v2.1/servers/91dfe89b-dee9-460a-be0e-1db736b43ccd => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:43:22.961201 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5db94535-2196-4666-9816-436fdf3a855c tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:43:22.961921 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5db94535-2196-4666-9816-436fdf3a855c tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] [instance: 91dfe89b-dee9-460a-be0e-1db736b43ccd] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:43:22.970517 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5db94535-2196-4666-9816-436fdf3a855c tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:22.971016 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5db94535-2196-4666-9816-436fdf3a855c tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:22.971458 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5db94535-2196-4666-9816-436fdf3a855c tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:22.972453 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5db94535-2196-4666-9816-436fdf3a855c tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:22.972918 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5db94535-2196-4666-9816-436fdf3a855c tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:22.973347 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5db94535-2196-4666-9816-436fdf3a855c tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:23.107301 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5db94535-2196-4666-9816-436fdf3a855c tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362e50a631884c4ca7f6d94d89523cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4008b0bcf5a48b48259ae8430e7b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:43:23.115068 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5db94535-2196-4666-9816-436fdf3a855c tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] 10.222.0.20 "GET /compute/v2.1/servers/91dfe89b-dee9-460a-be0e-1db736b43ccd" status: 200 len: 1505 microversion: 2.1 time: 0.158184 Oct 04 19:43:23.115634 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3897/7781] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:43:22 2022] GET /compute/v2.1/servers/91dfe89b-dee9-460a-be0e-1db736b43ccd => generated 1505 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:43:23.176677 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f8ed2b1c-15e1-49b5-a8e7-a031062014e8 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1139397976", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": [{"uuid": "7716be19-9a4c-4427-bdc9-80380e832fc6"}]}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:43:23.230295 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-f8ed2b1c-15e1-49b5-a8e7-a031062014e8 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] validate_networks() for [('7716be19-9a4c-4427-bdc9-80380e832fc6', None, None, None, None, None)] {{(pid=123002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:43:23.644375 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-f8ed2b1c-15e1-49b5-a8e7-a031062014e8 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:43:23.644817 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-f8ed2b1c-15e1-49b5-a8e7-a031062014e8 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:43:23.645309 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-f8ed2b1c-15e1-49b5-a8e7-a031062014e8 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:43:23.645743 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-f8ed2b1c-15e1-49b5-a8e7-a031062014e8 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:43:23.646173 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-f8ed2b1c-15e1-49b5-a8e7-a031062014e8 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:43:23.655203 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f8ed2b1c-15e1-49b5-a8e7-a031062014e8 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:23.655699 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f8ed2b1c-15e1-49b5-a8e7-a031062014e8 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:23.656195 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f8ed2b1c-15e1-49b5-a8e7-a031062014e8 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:23.657038 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f8ed2b1c-15e1-49b5-a8e7-a031062014e8 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:23.657512 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f8ed2b1c-15e1-49b5-a8e7-a031062014e8 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:23.657970 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f8ed2b1c-15e1-49b5-a8e7-a031062014e8 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:23.675423 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-f8ed2b1c-15e1-49b5-a8e7-a031062014e8 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Getting quotas for project b4008b0bcf5a48b48259ae8430e7b281. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:43:23.680818 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-f8ed2b1c-15e1-49b5-a8e7-a031062014e8 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Getting quotas for user 362e50a631884c4ca7f6d94d89523cc8 and project b4008b0bcf5a48b48259ae8430e7b281. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:43:23.694061 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f8ed2b1c-15e1-49b5-a8e7-a031062014e8 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Going to run 1 instances... {{(pid=123002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:43:23.696417 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f8ed2b1c-15e1-49b5-a8e7-a031062014e8 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] [instance: acfa9489-e79b-4b1f-90fb-34619a9000fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:43:23.818730 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f8ed2b1c-15e1-49b5-a8e7-a031062014e8 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.645763 Oct 04 19:43:23.819370 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3885/7782] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 19:43:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 647 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 19:43:23.831260 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b94ea4c4-f7dd-4fbb-bc5a-d533b39a1ab3 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:43:23.831967 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b94ea4c4-f7dd-4fbb-bc5a-d533b39a1ab3 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] [instance: acfa9489-e79b-4b1f-90fb-34619a9000fd] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:43:23.886464 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b94ea4c4-f7dd-4fbb-bc5a-d533b39a1ab3 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362e50a631884c4ca7f6d94d89523cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4008b0bcf5a48b48259ae8430e7b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:43:23.894117 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b94ea4c4-f7dd-4fbb-bc5a-d533b39a1ab3 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] 10.222.0.20 "GET /compute/v2.1/servers/acfa9489-e79b-4b1f-90fb-34619a9000fd" status: 200 len: 1217 microversion: 2.1 time: 0.067549 Oct 04 19:43:23.894697 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3898/7783] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:43:23 2022] GET /compute/v2.1/servers/acfa9489-e79b-4b1f-90fb-34619a9000fd => generated 1217 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:43:24.918137 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-21d4d73a-9845-401b-95c2-f395b391839f tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:43:24.918771 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-21d4d73a-9845-401b-95c2-f395b391839f tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] [instance: acfa9489-e79b-4b1f-90fb-34619a9000fd] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:43:24.926030 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-21d4d73a-9845-401b-95c2-f395b391839f tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:24.930480 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-21d4d73a-9845-401b-95c2-f395b391839f tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:24.930480 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-21d4d73a-9845-401b-95c2-f395b391839f tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:24.930480 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-21d4d73a-9845-401b-95c2-f395b391839f tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:24.930480 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-21d4d73a-9845-401b-95c2-f395b391839f tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:24.930480 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-21d4d73a-9845-401b-95c2-f395b391839f tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:24.991400 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-21d4d73a-9845-401b-95c2-f395b391839f tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362e50a631884c4ca7f6d94d89523cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4008b0bcf5a48b48259ae8430e7b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:43:24.999341 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-21d4d73a-9845-401b-95c2-f395b391839f tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] 10.222.0.20 "GET /compute/v2.1/servers/acfa9489-e79b-4b1f-90fb-34619a9000fd" status: 200 len: 1221 microversion: 2.1 time: 0.086007 Oct 04 19:43:25.000907 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3886/7784] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:43:24 2022] GET /compute/v2.1/servers/acfa9489-e79b-4b1f-90fb-34619a9000fd => generated 1221 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:43:26.024332 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-690aed8e-1f57-4ede-88ed-108b004093b9 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:43:26.024925 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-690aed8e-1f57-4ede-88ed-108b004093b9 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] [instance: acfa9489-e79b-4b1f-90fb-34619a9000fd] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:43:26.032440 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-690aed8e-1f57-4ede-88ed-108b004093b9 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:26.032919 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-690aed8e-1f57-4ede-88ed-108b004093b9 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:26.033355 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-690aed8e-1f57-4ede-88ed-108b004093b9 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:26.034070 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-690aed8e-1f57-4ede-88ed-108b004093b9 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:26.034524 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-690aed8e-1f57-4ede-88ed-108b004093b9 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:26.034948 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-690aed8e-1f57-4ede-88ed-108b004093b9 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:26.097861 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-690aed8e-1f57-4ede-88ed-108b004093b9 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362e50a631884c4ca7f6d94d89523cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4008b0bcf5a48b48259ae8430e7b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:43:26.106450 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-690aed8e-1f57-4ede-88ed-108b004093b9 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] 10.222.0.20 "GET /compute/v2.1/servers/acfa9489-e79b-4b1f-90fb-34619a9000fd" status: 200 len: 1269 microversion: 2.1 time: 0.086060 Oct 04 19:43:26.107039 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3899/7785] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:43:26 2022] GET /compute/v2.1/servers/acfa9489-e79b-4b1f-90fb-34619a9000fd => generated 1269 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:43:27.130971 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-29a14731-3434-4b0a-a8bb-32505b776480 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:43:27.132300 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-29a14731-3434-4b0a-a8bb-32505b776480 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] [instance: acfa9489-e79b-4b1f-90fb-34619a9000fd] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:43:27.139619 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-29a14731-3434-4b0a-a8bb-32505b776480 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:27.140152 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-29a14731-3434-4b0a-a8bb-32505b776480 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:27.141637 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-29a14731-3434-4b0a-a8bb-32505b776480 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:27.142895 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-29a14731-3434-4b0a-a8bb-32505b776480 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:27.143677 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-29a14731-3434-4b0a-a8bb-32505b776480 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:27.144398 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-29a14731-3434-4b0a-a8bb-32505b776480 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:27.284528 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-29a14731-3434-4b0a-a8bb-32505b776480 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362e50a631884c4ca7f6d94d89523cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4008b0bcf5a48b48259ae8430e7b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:43:27.292499 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-29a14731-3434-4b0a-a8bb-32505b776480 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] 10.222.0.20 "GET /compute/v2.1/servers/acfa9489-e79b-4b1f-90fb-34619a9000fd" status: 200 len: 1317 microversion: 2.1 time: 0.165495 Oct 04 19:43:27.293084 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3887/7786] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:43:27 2022] GET /compute/v2.1/servers/acfa9489-e79b-4b1f-90fb-34619a9000fd => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:43:27.871823 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-0db22613-db97-4a62-859a-9e83dbcd67cb req-09e8996e-25b5-4e0b-bf86-e13c67decff6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acfa9489-e79b-4b1f-90fb-34619a9000fd", "tag": "5a522e13-0c86-47fb-bed9-0db5ada5524b"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:43:27.884967 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-0db22613-db97-4a62-859a-9e83dbcd67cb req-09e8996e-25b5-4e0b-bf86-e13c67decff6 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:27.889164 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-0db22613-db97-4a62-859a-9e83dbcd67cb req-09e8996e-25b5-4e0b-bf86-e13c67decff6 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:27.889164 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-0db22613-db97-4a62-859a-9e83dbcd67cb req-09e8996e-25b5-4e0b-bf86-e13c67decff6 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:27.897156 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-0db22613-db97-4a62-859a-9e83dbcd67cb req-09e8996e-25b5-4e0b-bf86-e13c67decff6 service nova] Creating event network-changed:5a522e13-0c86-47fb-bed9-0db5ada5524b for instance acfa9489-e79b-4b1f-90fb-34619a9000fd on n-h2-850501-14 Oct 04 19:43:27.902060 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-0db22613-db97-4a62-859a-9e83dbcd67cb req-09e8996e-25b5-4e0b-bf86-e13c67decff6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034060 Oct 04 19:43:27.902667 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3900/7787] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:43:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:43:28.340933 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c611bbe0-f24c-4291-a318-7be2427154c2 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:43:28.340933 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c611bbe0-f24c-4291-a318-7be2427154c2 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] [instance: acfa9489-e79b-4b1f-90fb-34619a9000fd] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:43:28.340933 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c611bbe0-f24c-4291-a318-7be2427154c2 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:28.340933 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c611bbe0-f24c-4291-a318-7be2427154c2 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:28.340933 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c611bbe0-f24c-4291-a318-7be2427154c2 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:28.340933 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c611bbe0-f24c-4291-a318-7be2427154c2 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:28.340933 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c611bbe0-f24c-4291-a318-7be2427154c2 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:28.340933 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c611bbe0-f24c-4291-a318-7be2427154c2 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:28.485552 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c611bbe0-f24c-4291-a318-7be2427154c2 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362e50a631884c4ca7f6d94d89523cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4008b0bcf5a48b48259ae8430e7b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:43:28.493716 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c611bbe0-f24c-4291-a318-7be2427154c2 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] 10.222.0.20 "GET /compute/v2.1/servers/acfa9489-e79b-4b1f-90fb-34619a9000fd" status: 200 len: 1317 microversion: 2.1 time: 0.178459 Oct 04 19:43:28.494322 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3888/7788] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:43:28 2022] GET /compute/v2.1/servers/acfa9489-e79b-4b1f-90fb-34619a9000fd => generated 1317 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:43:29.518444 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a4f9f186-d1af-49e4-b794-5cec3f359b59 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:43:29.519191 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a4f9f186-d1af-49e4-b794-5cec3f359b59 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] [instance: acfa9489-e79b-4b1f-90fb-34619a9000fd] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:43:29.525422 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a4f9f186-d1af-49e4-b794-5cec3f359b59 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:29.525943 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a4f9f186-d1af-49e4-b794-5cec3f359b59 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:29.526389 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a4f9f186-d1af-49e4-b794-5cec3f359b59 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:29.527086 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a4f9f186-d1af-49e4-b794-5cec3f359b59 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:29.527556 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a4f9f186-d1af-49e4-b794-5cec3f359b59 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:29.527987 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a4f9f186-d1af-49e4-b794-5cec3f359b59 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:29.664208 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a4f9f186-d1af-49e4-b794-5cec3f359b59 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362e50a631884c4ca7f6d94d89523cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4008b0bcf5a48b48259ae8430e7b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:43:29.672990 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a4f9f186-d1af-49e4-b794-5cec3f359b59 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] 10.222.0.20 "GET /compute/v2.1/servers/acfa9489-e79b-4b1f-90fb-34619a9000fd" status: 200 len: 1317 microversion: 2.1 time: 0.159678 Oct 04 19:43:29.673568 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3901/7789] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:43:29 2022] GET /compute/v2.1/servers/acfa9489-e79b-4b1f-90fb-34619a9000fd => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:43:30.696156 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0dc43568-0d13-4279-9588-c0ef95884eb3 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:43:30.696789 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0dc43568-0d13-4279-9588-c0ef95884eb3 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] [instance: acfa9489-e79b-4b1f-90fb-34619a9000fd] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:43:30.704589 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0dc43568-0d13-4279-9588-c0ef95884eb3 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:30.705091 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0dc43568-0d13-4279-9588-c0ef95884eb3 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:30.705546 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0dc43568-0d13-4279-9588-c0ef95884eb3 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:30.706252 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0dc43568-0d13-4279-9588-c0ef95884eb3 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:30.706722 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0dc43568-0d13-4279-9588-c0ef95884eb3 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:30.707166 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0dc43568-0d13-4279-9588-c0ef95884eb3 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:30.839078 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0dc43568-0d13-4279-9588-c0ef95884eb3 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362e50a631884c4ca7f6d94d89523cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4008b0bcf5a48b48259ae8430e7b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:43:30.847649 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0dc43568-0d13-4279-9588-c0ef95884eb3 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] 10.222.0.20 "GET /compute/v2.1/servers/acfa9489-e79b-4b1f-90fb-34619a9000fd" status: 200 len: 1317 microversion: 2.1 time: 0.155297 Oct 04 19:43:30.848262 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3889/7790] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:43:30 2022] GET /compute/v2.1/servers/acfa9489-e79b-4b1f-90fb-34619a9000fd => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:43:31.871000 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-62c352a5-831a-4e47-850c-b84f25ecbf91 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:43:31.871619 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-62c352a5-831a-4e47-850c-b84f25ecbf91 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] [instance: acfa9489-e79b-4b1f-90fb-34619a9000fd] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:43:31.879397 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-62c352a5-831a-4e47-850c-b84f25ecbf91 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:31.879877 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-62c352a5-831a-4e47-850c-b84f25ecbf91 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:31.880349 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-62c352a5-831a-4e47-850c-b84f25ecbf91 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:31.881032 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-62c352a5-831a-4e47-850c-b84f25ecbf91 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:31.881482 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-62c352a5-831a-4e47-850c-b84f25ecbf91 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:31.881902 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-62c352a5-831a-4e47-850c-b84f25ecbf91 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:32.021390 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-62c352a5-831a-4e47-850c-b84f25ecbf91 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362e50a631884c4ca7f6d94d89523cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4008b0bcf5a48b48259ae8430e7b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:43:32.029180 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-62c352a5-831a-4e47-850c-b84f25ecbf91 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] 10.222.0.20 "GET /compute/v2.1/servers/acfa9489-e79b-4b1f-90fb-34619a9000fd" status: 200 len: 1317 microversion: 2.1 time: 0.162085 Oct 04 19:43:32.029775 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3902/7791] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:43:31 2022] GET /compute/v2.1/servers/acfa9489-e79b-4b1f-90fb-34619a9000fd => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:43:33.053197 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6b2feb79-5701-4c37-8c18-12af1def415e tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:43:33.053758 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-6b2feb79-5701-4c37-8c18-12af1def415e tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] [instance: acfa9489-e79b-4b1f-90fb-34619a9000fd] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:43:33.060551 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6b2feb79-5701-4c37-8c18-12af1def415e tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:33.061043 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6b2feb79-5701-4c37-8c18-12af1def415e tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:33.061491 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6b2feb79-5701-4c37-8c18-12af1def415e tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:33.062217 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6b2feb79-5701-4c37-8c18-12af1def415e tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:33.062680 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6b2feb79-5701-4c37-8c18-12af1def415e tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:33.063367 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6b2feb79-5701-4c37-8c18-12af1def415e tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:33.198158 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-6b2feb79-5701-4c37-8c18-12af1def415e tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362e50a631884c4ca7f6d94d89523cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4008b0bcf5a48b48259ae8430e7b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:43:33.206471 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6b2feb79-5701-4c37-8c18-12af1def415e tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] 10.222.0.20 "GET /compute/v2.1/servers/acfa9489-e79b-4b1f-90fb-34619a9000fd" status: 200 len: 1317 microversion: 2.1 time: 0.157380 Oct 04 19:43:33.207062 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3890/7792] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:43:33 2022] GET /compute/v2.1/servers/acfa9489-e79b-4b1f-90fb-34619a9000fd => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:43:34.230573 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ca22a4a5-221d-45f2-a562-542207148326 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:43:34.231164 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ca22a4a5-221d-45f2-a562-542207148326 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] [instance: acfa9489-e79b-4b1f-90fb-34619a9000fd] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:43:34.234096 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:43:34.239614 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ca22a4a5-221d-45f2-a562-542207148326 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:34.240127 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ca22a4a5-221d-45f2-a562-542207148326 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:34.240568 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ca22a4a5-221d-45f2-a562-542207148326 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:34.241283 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ca22a4a5-221d-45f2-a562-542207148326 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:34.241722 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ca22a4a5-221d-45f2-a562-542207148326 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:34.242150 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ca22a4a5-221d-45f2-a562-542207148326 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:34.376988 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ca22a4a5-221d-45f2-a562-542207148326 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362e50a631884c4ca7f6d94d89523cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4008b0bcf5a48b48259ae8430e7b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:43:34.384673 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ca22a4a5-221d-45f2-a562-542207148326 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] 10.222.0.20 "GET /compute/v2.1/servers/acfa9489-e79b-4b1f-90fb-34619a9000fd" status: 200 len: 1317 microversion: 2.1 time: 0.158215 Oct 04 19:43:34.385251 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3903/7793] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:43:34 2022] GET /compute/v2.1/servers/acfa9489-e79b-4b1f-90fb-34619a9000fd => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:43:34.642337 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-892b85a9-3d3d-4cc2-9272-d7af622d179d req-e97c5461-2e64-49d0-85b9-6aa57da7ced8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acfa9489-e79b-4b1f-90fb-34619a9000fd", "name": "network-vif-plugged", "status": "completed", "tag": "5a522e13-0c86-47fb-bed9-0db5ada5524b"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:43:34.648129 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:43:34.648831 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=6 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:43:34.654974 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-892b85a9-3d3d-4cc2-9272-d7af622d179d req-e97c5461-2e64-49d0-85b9-6aa57da7ced8 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:34.659844 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-892b85a9-3d3d-4cc2-9272-d7af622d179d req-e97c5461-2e64-49d0-85b9-6aa57da7ced8 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:34.659844 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-892b85a9-3d3d-4cc2-9272-d7af622d179d req-e97c5461-2e64-49d0-85b9-6aa57da7ced8 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:34.671607 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-892b85a9-3d3d-4cc2-9272-d7af622d179d req-e97c5461-2e64-49d0-85b9-6aa57da7ced8 service nova] Creating event network-vif-plugged:5a522e13-0c86-47fb-bed9-0db5ada5524b for instance acfa9489-e79b-4b1f-90fb-34619a9000fd on n-h2-850501-14 Oct 04 19:43:34.678111 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-892b85a9-3d3d-4cc2-9272-d7af622d179d req-e97c5461-2e64-49d0-85b9-6aa57da7ced8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040438 Oct 04 19:43:34.682777 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3891/7794] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:43:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:43:35.407210 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-fd867e0c-0769-4011-ba11-2e72b6eff23d tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:43:35.407890 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-fd867e0c-0769-4011-ba11-2e72b6eff23d tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] [instance: acfa9489-e79b-4b1f-90fb-34619a9000fd] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:43:35.414704 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fd867e0c-0769-4011-ba11-2e72b6eff23d tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:35.415183 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fd867e0c-0769-4011-ba11-2e72b6eff23d tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:35.415613 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fd867e0c-0769-4011-ba11-2e72b6eff23d tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:35.416321 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fd867e0c-0769-4011-ba11-2e72b6eff23d tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:35.416796 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fd867e0c-0769-4011-ba11-2e72b6eff23d tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:35.417215 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fd867e0c-0769-4011-ba11-2e72b6eff23d tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:35.551874 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-fd867e0c-0769-4011-ba11-2e72b6eff23d tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362e50a631884c4ca7f6d94d89523cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4008b0bcf5a48b48259ae8430e7b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:43:35.559624 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-fd867e0c-0769-4011-ba11-2e72b6eff23d tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] 10.222.0.20 "GET /compute/v2.1/servers/acfa9489-e79b-4b1f-90fb-34619a9000fd" status: 200 len: 1317 microversion: 2.1 time: 0.156404 Oct 04 19:43:35.560219 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3904/7795] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:43:35 2022] GET /compute/v2.1/servers/acfa9489-e79b-4b1f-90fb-34619a9000fd => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:43:36.584913 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d38bd3dc-4bbc-4099-853f-81312a1d1cf5 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:43:36.585641 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d38bd3dc-4bbc-4099-853f-81312a1d1cf5 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] [instance: acfa9489-e79b-4b1f-90fb-34619a9000fd] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:43:36.593599 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d38bd3dc-4bbc-4099-853f-81312a1d1cf5 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:36.594698 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d38bd3dc-4bbc-4099-853f-81312a1d1cf5 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:36.595512 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d38bd3dc-4bbc-4099-853f-81312a1d1cf5 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:36.596303 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d38bd3dc-4bbc-4099-853f-81312a1d1cf5 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:36.596776 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d38bd3dc-4bbc-4099-853f-81312a1d1cf5 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:36.597478 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d38bd3dc-4bbc-4099-853f-81312a1d1cf5 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:36.732139 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d38bd3dc-4bbc-4099-853f-81312a1d1cf5 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362e50a631884c4ca7f6d94d89523cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4008b0bcf5a48b48259ae8430e7b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:43:36.740155 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d38bd3dc-4bbc-4099-853f-81312a1d1cf5 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] 10.222.0.20 "GET /compute/v2.1/servers/acfa9489-e79b-4b1f-90fb-34619a9000fd" status: 200 len: 1505 microversion: 2.1 time: 0.160276 Oct 04 19:43:36.740741 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3892/7796] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:43:36 2022] GET /compute/v2.1/servers/acfa9489-e79b-4b1f-90fb-34619a9000fd => generated 1505 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:43:36.762617 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b8ae620f-9fa0-45f0-a938-62718f030e5f tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:43:36.763152 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b8ae620f-9fa0-45f0-a938-62718f030e5f tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] [instance: acfa9489-e79b-4b1f-90fb-34619a9000fd] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:43:36.770703 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b8ae620f-9fa0-45f0-a938-62718f030e5f tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:36.771188 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b8ae620f-9fa0-45f0-a938-62718f030e5f tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:36.771630 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b8ae620f-9fa0-45f0-a938-62718f030e5f tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:36.772354 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b8ae620f-9fa0-45f0-a938-62718f030e5f tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:36.772819 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b8ae620f-9fa0-45f0-a938-62718f030e5f tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:36.773251 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b8ae620f-9fa0-45f0-a938-62718f030e5f tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:36.799423 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b8ae620f-9fa0-45f0-a938-62718f030e5f tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] [instance: acfa9489-e79b-4b1f-90fb-34619a9000fd] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:43:37.089904 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b8ae620f-9fa0-45f0-a938-62718f030e5f tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] 10.222.0.20 "DELETE /compute/v2.1/servers/acfa9489-e79b-4b1f-90fb-34619a9000fd" status: 204 len: 0 microversion: 2.1 time: 0.330856 Oct 04 19:43:37.090509 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3905/7797] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 19:43:36 2022] DELETE /compute/v2.1/servers/acfa9489-e79b-4b1f-90fb-34619a9000fd => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:43:37.100400 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2619df5a-29ef-40a5-b09e-ef39e27f9ad7 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:43:37.101111 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2619df5a-29ef-40a5-b09e-ef39e27f9ad7 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] [instance: acfa9489-e79b-4b1f-90fb-34619a9000fd] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:43:37.107988 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2619df5a-29ef-40a5-b09e-ef39e27f9ad7 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:37.108516 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2619df5a-29ef-40a5-b09e-ef39e27f9ad7 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:37.108972 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2619df5a-29ef-40a5-b09e-ef39e27f9ad7 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:37.110165 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2619df5a-29ef-40a5-b09e-ef39e27f9ad7 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:37.110467 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2619df5a-29ef-40a5-b09e-ef39e27f9ad7 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:37.110915 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2619df5a-29ef-40a5-b09e-ef39e27f9ad7 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:37.245119 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2619df5a-29ef-40a5-b09e-ef39e27f9ad7 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362e50a631884c4ca7f6d94d89523cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4008b0bcf5a48b48259ae8430e7b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:43:37.252944 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2619df5a-29ef-40a5-b09e-ef39e27f9ad7 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] 10.222.0.20 "GET /compute/v2.1/servers/acfa9489-e79b-4b1f-90fb-34619a9000fd" status: 200 len: 1511 microversion: 2.1 time: 0.158238 Oct 04 19:43:37.253497 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3893/7798] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:43:37 2022] GET /compute/v2.1/servers/acfa9489-e79b-4b1f-90fb-34619a9000fd => generated 1511 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:43:38.277262 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-237c4a6a-85ac-4eb6-815c-7caa636bd198 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:43:38.277968 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-237c4a6a-85ac-4eb6-815c-7caa636bd198 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] [instance: acfa9489-e79b-4b1f-90fb-34619a9000fd] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:43:38.285740 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-237c4a6a-85ac-4eb6-815c-7caa636bd198 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:38.286223 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-237c4a6a-85ac-4eb6-815c-7caa636bd198 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:38.286662 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-237c4a6a-85ac-4eb6-815c-7caa636bd198 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:38.287352 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-237c4a6a-85ac-4eb6-815c-7caa636bd198 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:38.287809 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-237c4a6a-85ac-4eb6-815c-7caa636bd198 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:38.288274 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-237c4a6a-85ac-4eb6-815c-7caa636bd198 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:38.419431 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-237c4a6a-85ac-4eb6-815c-7caa636bd198 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362e50a631884c4ca7f6d94d89523cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4008b0bcf5a48b48259ae8430e7b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:43:38.428408 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-237c4a6a-85ac-4eb6-815c-7caa636bd198 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] 10.222.0.20 "GET /compute/v2.1/servers/acfa9489-e79b-4b1f-90fb-34619a9000fd" status: 200 len: 1511 microversion: 2.1 time: 0.155470 Oct 04 19:43:38.428979 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3906/7799] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:43:38 2022] GET /compute/v2.1/servers/acfa9489-e79b-4b1f-90fb-34619a9000fd => generated 1511 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:43:39.247588 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-e0bc8653-a2c4-499b-8766-32e1d430e8d2 req-68b44946-032c-4aa6-89a4-e8c7cfd930ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acfa9489-e79b-4b1f-90fb-34619a9000fd", "name": "network-vif-deleted", "tag": "5a522e13-0c86-47fb-bed9-0db5ada5524b"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:43:39.259939 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-e0bc8653-a2c4-499b-8766-32e1d430e8d2 req-68b44946-032c-4aa6-89a4-e8c7cfd930ad service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:39.260744 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-e0bc8653-a2c4-499b-8766-32e1d430e8d2 req-68b44946-032c-4aa6-89a4-e8c7cfd930ad service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:39.261455 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-e0bc8653-a2c4-499b-8766-32e1d430e8d2 req-68b44946-032c-4aa6-89a4-e8c7cfd930ad service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:39.275465 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-e0bc8653-a2c4-499b-8766-32e1d430e8d2 req-68b44946-032c-4aa6-89a4-e8c7cfd930ad service nova] Creating event network-vif-deleted:5a522e13-0c86-47fb-bed9-0db5ada5524b for instance acfa9489-e79b-4b1f-90fb-34619a9000fd on n-h2-850501-14 Oct 04 19:43:39.281303 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-e0bc8653-a2c4-499b-8766-32e1d430e8d2 req-68b44946-032c-4aa6-89a4-e8c7cfd930ad service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037378 Oct 04 19:43:39.282847 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3894/7800] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:43:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:43:39.452280 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ee7b290a-9e31-4109-9141-8da77737822f tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:43:39.453664 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ee7b290a-9e31-4109-9141-8da77737822f tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] [instance: acfa9489-e79b-4b1f-90fb-34619a9000fd] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:43:39.456847 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:43:39.461780 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ee7b290a-9e31-4109-9141-8da77737822f tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:39.462284 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ee7b290a-9e31-4109-9141-8da77737822f tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:39.462729 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ee7b290a-9e31-4109-9141-8da77737822f tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:39.463443 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ee7b290a-9e31-4109-9141-8da77737822f tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:39.463930 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ee7b290a-9e31-4109-9141-8da77737822f tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:39.464416 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ee7b290a-9e31-4109-9141-8da77737822f tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:39.467372 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:43:39.542080 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ee7b290a-9e31-4109-9141-8da77737822f tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362e50a631884c4ca7f6d94d89523cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4008b0bcf5a48b48259ae8430e7b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:43:39.544331 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ee7b290a-9e31-4109-9141-8da77737822f tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] 10.222.0.20 "GET /compute/v2.1/servers/acfa9489-e79b-4b1f-90fb-34619a9000fd" status: 200 len: 1302 microversion: 2.1 time: 0.096111 Oct 04 19:43:39.544900 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3907/7801] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:43:39 2022] GET /compute/v2.1/servers/acfa9489-e79b-4b1f-90fb-34619a9000fd => generated 1302 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:43:40.568139 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-97c4a99f-b97b-4445-91e1-ba6044a23f1b tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:43:40.568871 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-97c4a99f-b97b-4445-91e1-ba6044a23f1b tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] [instance: acfa9489-e79b-4b1f-90fb-34619a9000fd] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:43:40.576417 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-97c4a99f-b97b-4445-91e1-ba6044a23f1b tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:40.576924 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-97c4a99f-b97b-4445-91e1-ba6044a23f1b tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:40.577525 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-97c4a99f-b97b-4445-91e1-ba6044a23f1b tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:40.578850 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-97c4a99f-b97b-4445-91e1-ba6044a23f1b tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:40.579462 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-97c4a99f-b97b-4445-91e1-ba6044a23f1b tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:40.579913 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-97c4a99f-b97b-4445-91e1-ba6044a23f1b tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:40.584030 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=81 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:43:40.593476 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-97c4a99f-b97b-4445-91e1-ba6044a23f1b tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] HTTP exception thrown: Instance acfa9489-e79b-4b1f-90fb-34619a9000fd could not be found. Oct 04 19:43:40.595608 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-97c4a99f-b97b-4445-91e1-ba6044a23f1b tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Request method failure captured: Oct 04 19:43:40.595608 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/acfa9489-e79b-4b1f-90fb-34619a9000fd HTTP/1.1 Oct 04 19:43:40.595608 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 19:43:40.595608 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 19:43:40.595608 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 19:43:40.595608 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 19:43:40.595608 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 19:43:40.595608 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 19:43:40.595608 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 19:43:40.595608 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 19:43:40.595608 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPIzMkq1APgOx7dM_uc10xtjQzdlow0Vj92bn9Ktj8Kh7f3oAERpNWHOPEeFEoj7nQMxh3Y8ri1Ug4YI0P_Ot4_CGhwpC5xIWeF-RMescPPuXUYxODjl3-JP4tiOt11eVlrYykXVyuCynLzIK2iTEKxOnL-FVDxjWtICZoI2b8GWt1S4 Oct 04 19:43:40.595608 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 19:43:40.595608 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 19:43:40.595608 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 19:43:40.595608 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 19:43:40.595608 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 19:43:40.595608 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 19:43:40.595608 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: b4008b0bcf5a48b48259ae8430e7b281 Oct 04 19:43:40.595608 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServersNegativeTestJSON-1983752407 Oct 04 19:43:40.595608 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 19:43:40.595608 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 19:43:40.595608 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b4008b0bcf5a48b48259ae8430e7b281"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b4008b0bcf5a48b48259ae8430e7b281", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b4008b0bcf5a48b48259ae8430e7b281"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b4008b0bcf5a48b48259ae8430e7b281"}]}] Oct 04 19:43:40.595608 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServersNegativeTestJSON-1983752407 Oct 04 19:43:40.595608 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: b4008b0bcf5a48b48259ae8430e7b281 Oct 04 19:43:40.595608 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1983752407 Oct 04 19:43:40.595608 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServersNegativeTestJSON-1983752407-project Oct 04 19:43:40.595608 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 19:43:40.595608 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 19:43:40.595608 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 362e50a631884c4ca7f6d94d89523cc8 Oct 04 19:43:40.595608 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServersNegativeTestJSON-1983752407-project Oct 04 19:43:40.595608 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 19:43:40.595608 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance acfa9489-e79b-4b1f-90fb-34619a9000fd could not be found. Oct 04 19:43:40.595608 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'acfa9489-e79b-4b1f-90fb-34619a9000fd'} Oct 04 19:43:40.595608 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:43:40.595608 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:43:40.595608 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:43:40.595608 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:43:40.595608 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:43:40.595608 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:43:40.595608 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:43:40.595608 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:43:40.595608 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:43:40.595608 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:43:40.595608 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acfa9489-e79b-4b1f-90fb-34619a9000fd could not be found. Oct 04 19:43:40.595608 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:43:40.595608 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:43:40.595608 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:43:40.595608 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:43:40.595608 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:43:40.595608 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:43:40.595608 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:43:40.595608 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:43:40.595608 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:43:40.595608 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:43:40.595608 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:43:40.595608 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:43:40.595608 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:43:40.595608 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:43:40.595608 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:43:40.595608 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:43:40.595608 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acfa9489-e79b-4b1f-90fb-34619a9000fd could not be found. Oct 04 19:43:40.595608 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:43:40.595608 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:43:40.595608 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:43:40.600890 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:43:40.600890 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:43:40.600890 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:43:40.600890 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:43:40.600890 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:43:40.600890 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acfa9489-e79b-4b1f-90fb-34619a9000fd could not be found. Oct 04 19:43:40.600890 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:43:40.600890 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-97c4a99f-b97b-4445-91e1-ba6044a23f1b tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Returning 404 to user: Instance acfa9489-e79b-4b1f-90fb-34619a9000fd could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:43:40.600890 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-97c4a99f-b97b-4445-91e1-ba6044a23f1b tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] 10.222.0.20 "GET /compute/v2.1/servers/acfa9489-e79b-4b1f-90fb-34619a9000fd" status: 404 len: 111 microversion: 2.1 time: 0.033439 Oct 04 19:43:40.600890 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3895/7802] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:43:40 2022] GET /compute/v2.1/servers/acfa9489-e79b-4b1f-90fb-34619a9000fd => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:43:40.606647 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7261821a-542e-454e-a0ca-0853931b094e tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:43:40.607268 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7261821a-542e-454e-a0ca-0853931b094e tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] [instance: 91dfe89b-dee9-460a-be0e-1db736b43ccd] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:43:40.615611 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7261821a-542e-454e-a0ca-0853931b094e tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:40.616180 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7261821a-542e-454e-a0ca-0853931b094e tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:40.616652 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7261821a-542e-454e-a0ca-0853931b094e tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:40.617352 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7261821a-542e-454e-a0ca-0853931b094e tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:40.617815 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7261821a-542e-454e-a0ca-0853931b094e tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:40.618243 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7261821a-542e-454e-a0ca-0853931b094e tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:40.757604 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7261821a-542e-454e-a0ca-0853931b094e tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362e50a631884c4ca7f6d94d89523cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4008b0bcf5a48b48259ae8430e7b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:43:40.765332 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7261821a-542e-454e-a0ca-0853931b094e tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] 10.222.0.20 "GET /compute/v2.1/servers/91dfe89b-dee9-460a-be0e-1db736b43ccd" status: 200 len: 1505 microversion: 2.1 time: 0.162637 Oct 04 19:43:40.765933 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3908/7803] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:43:40 2022] GET /compute/v2.1/servers/91dfe89b-dee9-460a-be0e-1db736b43ccd => generated 1505 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:43:40.788894 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-fd17f68a-5bf7-4317-8b68-8cc1ecb33ad7 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:43:40.791198 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-fd17f68a-5bf7-4317-8b68-8cc1ecb33ad7 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] [instance: 4f3ef63f-851f-4936-9ff5-43d2878ae060] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:43:40.796904 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-fd17f68a-5bf7-4317-8b68-8cc1ecb33ad7 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] HTTP exception thrown: Instance 4f3ef63f-851f-4936-9ff5-43d2878ae060 could not be found. Oct 04 19:43:40.799632 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-fd17f68a-5bf7-4317-8b68-8cc1ecb33ad7 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Request method failure captured: Oct 04 19:43:40.799632 n-d-850501-14 devstack@n-api.service[123002]: request: POST /compute/v2.1/servers/4f3ef63f-851f-4936-9ff5-43d2878ae060/action HTTP/1.1 Oct 04 19:43:40.799632 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 19:43:40.799632 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 19:43:40.799632 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 19:43:40.799632 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 32 Oct 04 19:43:40.799632 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 19:43:40.799632 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 19:43:40.799632 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 19:43:40.799632 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 19:43:40.799632 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPIzMkq1APgOx7dM_uc10xtjQzdlow0Vj92bn9Ktj8Kh7f3oAERpNWHOPEeFEoj7nQMxh3Y8ri1Ug4YI0P_Ot4_CGhwpC5xIWeF-RMescPPuXUYxODjl3-JP4tiOt11eVlrYykXVyuCynLzIK2iTEKxOnL-FVDxjWtICZoI2b8GWt1S4 Oct 04 19:43:40.799632 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 19:43:40.799632 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 19:43:40.799632 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 19:43:40.799632 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 19:43:40.799632 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 19:43:40.799632 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 19:43:40.799632 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: b4008b0bcf5a48b48259ae8430e7b281 Oct 04 19:43:40.799632 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServersNegativeTestJSON-1983752407 Oct 04 19:43:40.799632 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 19:43:40.799632 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 19:43:40.799632 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b4008b0bcf5a48b48259ae8430e7b281"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b4008b0bcf5a48b48259ae8430e7b281", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b4008b0bcf5a48b48259ae8430e7b281"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b4008b0bcf5a48b48259ae8430e7b281"}]}] Oct 04 19:43:40.799632 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServersNegativeTestJSON-1983752407 Oct 04 19:43:40.799632 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: b4008b0bcf5a48b48259ae8430e7b281 Oct 04 19:43:40.799632 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1983752407 Oct 04 19:43:40.799632 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServersNegativeTestJSON-1983752407-project Oct 04 19:43:40.799632 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 19:43:40.799632 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 19:43:40.799632 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 362e50a631884c4ca7f6d94d89523cc8 Oct 04 19:43:40.799632 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServersNegativeTestJSON-1983752407-project Oct 04 19:43:40.799632 n-d-850501-14 devstack@n-api.service[123002]: Oct 04 19:43:40.799632 n-d-850501-14 devstack@n-api.service[123002]: {"resize": {"flavorRef": "452"}} Oct 04 19:43:40.799632 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 19:43:40.799632 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 4f3ef63f-851f-4936-9ff5-43d2878ae060 could not be found. Oct 04 19:43:40.799632 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '4f3ef63f-851f-4936-9ff5-43d2878ae060', 'body': {'resize': {'flavorRef': '452'}}} Oct 04 19:43:40.799632 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:43:40.799632 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:43:40.799632 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:43:40.799632 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:43:40.799632 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:43:40.799632 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:43:40.799632 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 19:43:40.799632 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 19:43:40.799632 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f3ef63f-851f-4936-9ff5-43d2878ae060 could not be found. Oct 04 19:43:40.799632 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:43:40.799632 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:43:40.799632 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:43:40.799632 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:43:40.799632 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:43:40.799632 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:43:40.799632 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:43:40.799632 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:43:40.799632 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:43:40.799632 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:43:40.799632 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 19:43:40.799632 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 19:43:40.799632 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 04 19:43:40.799632 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 04 19:43:40.799632 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Oct 04 19:43:40.799632 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Oct 04 19:43:40.799632 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:43:40.799632 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:43:40.799632 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:43:40.799632 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:43:40.804580 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f3ef63f-851f-4936-9ff5-43d2878ae060 could not be found. Oct 04 19:43:40.804580 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:43:40.804580 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:43:40.804580 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:43:40.804580 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:43:40.804580 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:43:40.804580 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:43:40.804580 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:43:40.804580 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:43:40.804580 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f3ef63f-851f-4936-9ff5-43d2878ae060 could not be found. Oct 04 19:43:40.804580 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:43:40.804580 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-fd17f68a-5bf7-4317-8b68-8cc1ecb33ad7 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Returning 404 to user: Instance 4f3ef63f-851f-4936-9ff5-43d2878ae060 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:43:40.804580 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-fd17f68a-5bf7-4317-8b68-8cc1ecb33ad7 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] 10.222.0.20 "POST /compute/v2.1/servers/4f3ef63f-851f-4936-9ff5-43d2878ae060/action" status: 404 len: 111 microversion: 2.1 time: 0.016709 Oct 04 19:43:40.804580 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3896/7804] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 19:43:40 2022] POST /compute/v2.1/servers/4f3ef63f-851f-4936-9ff5-43d2878ae060/action => generated 111 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:43:40.809710 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ec01a743-d463-4c03-bb39-5537e6f7fc10 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:43:40.810326 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ec01a743-d463-4c03-bb39-5537e6f7fc10 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] [instance: 91dfe89b-dee9-460a-be0e-1db736b43ccd] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:43:40.816732 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec01a743-d463-4c03-bb39-5537e6f7fc10 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:40.817217 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec01a743-d463-4c03-bb39-5537e6f7fc10 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:40.817651 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec01a743-d463-4c03-bb39-5537e6f7fc10 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:40.818376 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec01a743-d463-4c03-bb39-5537e6f7fc10 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:40.818826 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec01a743-d463-4c03-bb39-5537e6f7fc10 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:40.819253 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec01a743-d463-4c03-bb39-5537e6f7fc10 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:40.946512 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ec01a743-d463-4c03-bb39-5537e6f7fc10 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362e50a631884c4ca7f6d94d89523cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4008b0bcf5a48b48259ae8430e7b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:43:40.954930 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ec01a743-d463-4c03-bb39-5537e6f7fc10 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] 10.222.0.20 "GET /compute/v2.1/servers/91dfe89b-dee9-460a-be0e-1db736b43ccd" status: 200 len: 1505 microversion: 2.1 time: 0.149091 Oct 04 19:43:40.955499 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3909/7805] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:43:40 2022] GET /compute/v2.1/servers/91dfe89b-dee9-460a-be0e-1db736b43ccd => generated 1505 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:43:40.978809 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-96289992-dc7b-4eee-9aa3-ee98478fcb27 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:43:40.979467 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-96289992-dc7b-4eee-9aa3-ee98478fcb27 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] [instance: 91dfe89b-dee9-460a-be0e-1db736b43ccd] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:43:40.986920 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-96289992-dc7b-4eee-9aa3-ee98478fcb27 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:40.987418 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-96289992-dc7b-4eee-9aa3-ee98478fcb27 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:40.987872 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-96289992-dc7b-4eee-9aa3-ee98478fcb27 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:40.988611 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-96289992-dc7b-4eee-9aa3-ee98478fcb27 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:40.989083 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-96289992-dc7b-4eee-9aa3-ee98478fcb27 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:40.989555 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-96289992-dc7b-4eee-9aa3-ee98478fcb27 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:41.124702 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-96289992-dc7b-4eee-9aa3-ee98478fcb27 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362e50a631884c4ca7f6d94d89523cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4008b0bcf5a48b48259ae8430e7b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:43:41.132757 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-96289992-dc7b-4eee-9aa3-ee98478fcb27 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] 10.222.0.20 "GET /compute/v2.1/servers/91dfe89b-dee9-460a-be0e-1db736b43ccd" status: 200 len: 1505 microversion: 2.1 time: 0.157895 Oct 04 19:43:41.133330 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3897/7806] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:43:40 2022] GET /compute/v2.1/servers/91dfe89b-dee9-460a-be0e-1db736b43ccd => generated 1505 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:43:41.155751 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a14b3e21-8592-403e-87b5-cdb0b103418e tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "9816ef42-5544-41ec-b79f-ada81e31a823"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:43:41.158184 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a14b3e21-8592-403e-87b5-cdb0b103418e tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] [instance: 91dfe89b-dee9-460a-be0e-1db736b43ccd] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:43:41.164166 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a14b3e21-8592-403e-87b5-cdb0b103418e tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:41.164676 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a14b3e21-8592-403e-87b5-cdb0b103418e tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:41.165103 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a14b3e21-8592-403e-87b5-cdb0b103418e tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:41.165797 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a14b3e21-8592-403e-87b5-cdb0b103418e tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:41.166255 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a14b3e21-8592-403e-87b5-cdb0b103418e tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:41.166685 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a14b3e21-8592-403e-87b5-cdb0b103418e tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:41.207032 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a14b3e21-8592-403e-87b5-cdb0b103418e tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '362e50a631884c4ca7f6d94d89523cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4008b0bcf5a48b48259ae8430e7b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:43:41.212223 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-a14b3e21-8592-403e-87b5-cdb0b103418e tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] HTTP exception thrown: Flavor 9816ef42-5544-41ec-b79f-ada81e31a823 could not be found. Oct 04 19:43:41.220165 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a14b3e21-8592-403e-87b5-cdb0b103418e tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Request method failure captured: Oct 04 19:43:41.220165 n-d-850501-14 devstack@n-api.service[123001]: request: POST /compute/v2.1/servers/91dfe89b-dee9-460a-be0e-1db736b43ccd/action HTTP/1.1 Oct 04 19:43:41.220165 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 19:43:41.220165 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 19:43:41.220165 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 19:43:41.220165 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 65 Oct 04 19:43:41.220165 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 19:43:41.220165 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 19:43:41.220165 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 19:43:41.220165 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 19:43:41.220165 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPIzMkq1APgOx7dM_uc10xtjQzdlow0Vj92bn9Ktj8Kh7f3oAERpNWHOPEeFEoj7nQMxh3Y8ri1Ug4YI0P_Ot4_CGhwpC5xIWeF-RMescPPuXUYxODjl3-JP4tiOt11eVlrYykXVyuCynLzIK2iTEKxOnL-FVDxjWtICZoI2b8GWt1S4 Oct 04 19:43:41.220165 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 19:43:41.220165 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 19:43:41.220165 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 19:43:41.220165 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 19:43:41.220165 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 19:43:41.220165 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 19:43:41.220165 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: b4008b0bcf5a48b48259ae8430e7b281 Oct 04 19:43:41.220165 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ServersNegativeTestJSON-1983752407 Oct 04 19:43:41.220165 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 19:43:41.220165 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 19:43:41.220165 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b4008b0bcf5a48b48259ae8430e7b281"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b4008b0bcf5a48b48259ae8430e7b281", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b4008b0bcf5a48b48259ae8430e7b281"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b4008b0bcf5a48b48259ae8430e7b281"}]}] Oct 04 19:43:41.220165 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ServersNegativeTestJSON-1983752407 Oct 04 19:43:41.220165 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: b4008b0bcf5a48b48259ae8430e7b281 Oct 04 19:43:41.220165 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1983752407 Oct 04 19:43:41.220165 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ServersNegativeTestJSON-1983752407-project Oct 04 19:43:41.220165 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 19:43:41.220165 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 19:43:41.220165 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 362e50a631884c4ca7f6d94d89523cc8 Oct 04 19:43:41.220165 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ServersNegativeTestJSON-1983752407-project Oct 04 19:43:41.220165 n-d-850501-14 devstack@n-api.service[123001]: Oct 04 19:43:41.220165 n-d-850501-14 devstack@n-api.service[123001]: {"resize": {"flavorRef": "9816ef42-5544-41ec-b79f-ada81e31a823"}} Oct 04 19:43:41.220165 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 19:43:41.220165 n-d-850501-14 devstack@n-api.service[123001]: exception: Flavor 9816ef42-5544-41ec-b79f-ada81e31a823 could not be found. Oct 04 19:43:41.220165 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '91dfe89b-dee9-460a-be0e-1db736b43ccd', 'body': {'resize': {'flavorRef': '9816ef42-5544-41ec-b79f-ada81e31a823'}}} Oct 04 19:43:41.220165 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:43:41.220165 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:43:41.220165 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 04 19:43:41.220165 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 04 19:43:41.220165 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 04 19:43:41.220165 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 19:43:41.220165 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 04 19:43:41.220165 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 19:43:41.220165 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 19:43:41.220165 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 19:43:41.220165 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 19:43:41.220165 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 19:43:41.220165 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 04 19:43:41.220165 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 19:43:41.220165 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 04 19:43:41.220165 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 19:43:41.220165 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4200, in resize Oct 04 19:43:41.220165 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Oct 04 19:43:41.220165 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 19:43:41.220165 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 19:43:41.220165 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 19:43:41.220165 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 19:43:41.220165 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 19:43:41.220165 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 19:43:41.220165 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 19:43:41.220165 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:43:41.220165 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 19:43:41.225326 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 19:43:41.225326 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 9816ef42-5544-41ec-b79f-ada81e31a823 could not be found. Oct 04 19:43:41.225326 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:43:41.225326 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:43:41.225326 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:43:41.225326 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:43:41.225326 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:43:41.225326 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:43:41.225326 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:43:41.225326 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:43:41.225326 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:43:41.225326 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:43:41.225326 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 19:43:41.225326 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 19:43:41.225326 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 04 19:43:41.225326 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 04 19:43:41.225326 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Oct 04 19:43:41.225326 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 04 19:43:41.225326 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 9816ef42-5544-41ec-b79f-ada81e31a823 could not be found. Oct 04 19:43:41.225326 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:43:41.225326 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:43:41.225326 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:43:41.225326 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:43:41.225326 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:43:41.225326 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:43:41.225326 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:43:41.225326 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:43:41.225326 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 9816ef42-5544-41ec-b79f-ada81e31a823 could not be found. Oct 04 19:43:41.225326 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:43:41.225326 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a14b3e21-8592-403e-87b5-cdb0b103418e tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Returning 400 to user: Flavor 9816ef42-5544-41ec-b79f-ada81e31a823 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:43:41.225326 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a14b3e21-8592-403e-87b5-cdb0b103418e tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] 10.222.0.20 "POST /compute/v2.1/servers/91dfe89b-dee9-460a-be0e-1db736b43ccd/action" status: 400 len: 107 microversion: 2.1 time: 0.069913 Oct 04 19:43:41.225326 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3910/7807] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 19:43:41 2022] POST /compute/v2.1/servers/91dfe89b-dee9-460a-be0e-1db736b43ccd/action => generated 107 bytes in 71 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 19:43:41.230949 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-41f42a0d-2b18-4929-86a5-39698319f150 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:43:41.231589 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-41f42a0d-2b18-4929-86a5-39698319f150 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] [instance: 91dfe89b-dee9-460a-be0e-1db736b43ccd] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:43:41.238213 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-41f42a0d-2b18-4929-86a5-39698319f150 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:41.238715 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-41f42a0d-2b18-4929-86a5-39698319f150 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:41.239171 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-41f42a0d-2b18-4929-86a5-39698319f150 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:41.239880 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-41f42a0d-2b18-4929-86a5-39698319f150 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:41.240387 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-41f42a0d-2b18-4929-86a5-39698319f150 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:41.240837 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-41f42a0d-2b18-4929-86a5-39698319f150 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:41.407791 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-41f42a0d-2b18-4929-86a5-39698319f150 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362e50a631884c4ca7f6d94d89523cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4008b0bcf5a48b48259ae8430e7b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:43:41.415911 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-41f42a0d-2b18-4929-86a5-39698319f150 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] 10.222.0.20 "GET /compute/v2.1/servers/91dfe89b-dee9-460a-be0e-1db736b43ccd" status: 200 len: 1505 microversion: 2.1 time: 0.188833 Oct 04 19:43:41.416529 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3898/7808] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:43:41 2022] GET /compute/v2.1/servers/91dfe89b-dee9-460a-be0e-1db736b43ccd => generated 1505 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:43:41.440049 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d8933fe9-52d6-4f0f-b76b-00db87eb75de tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:43:41.440691 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d8933fe9-52d6-4f0f-b76b-00db87eb75de tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] [instance: 91dfe89b-dee9-460a-be0e-1db736b43ccd] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:43:41.446626 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d8933fe9-52d6-4f0f-b76b-00db87eb75de tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:41.447109 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d8933fe9-52d6-4f0f-b76b-00db87eb75de tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:41.447546 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d8933fe9-52d6-4f0f-b76b-00db87eb75de tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:41.448305 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d8933fe9-52d6-4f0f-b76b-00db87eb75de tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:41.448759 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d8933fe9-52d6-4f0f-b76b-00db87eb75de tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:41.449183 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d8933fe9-52d6-4f0f-b76b-00db87eb75de tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:41.580816 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d8933fe9-52d6-4f0f-b76b-00db87eb75de tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362e50a631884c4ca7f6d94d89523cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4008b0bcf5a48b48259ae8430e7b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:43:41.588558 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d8933fe9-52d6-4f0f-b76b-00db87eb75de tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] 10.222.0.20 "GET /compute/v2.1/servers/91dfe89b-dee9-460a-be0e-1db736b43ccd" status: 200 len: 1505 microversion: 2.1 time: 0.153051 Oct 04 19:43:41.589062 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3911/7809] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:43:41 2022] GET /compute/v2.1/servers/91dfe89b-dee9-460a-be0e-1db736b43ccd => generated 1505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:43:41.612105 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4fc463cb-c3de-4f4c-bc8c-d82d850ca5ad tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:43:41.619357 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4fc463cb-c3de-4f4c-bc8c-d82d850ca5ad tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Request method failure captured: Oct 04 19:43:41.619357 n-d-850501-14 devstack@n-api.service[123002]: request: POST /compute/v2.1/servers/91dfe89b-dee9-460a-be0e-1db736b43ccd/action HTTP/1.1 Oct 04 19:43:41.619357 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 19:43:41.619357 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 19:43:41.619357 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 19:43:41.619357 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 29 Oct 04 19:43:41.619357 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 19:43:41.619357 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 19:43:41.619357 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 19:43:41.619357 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 19:43:41.619357 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPIzMkq1APgOx7dM_uc10xtjQzdlow0Vj92bn9Ktj8Kh7f3oAERpNWHOPEeFEoj7nQMxh3Y8ri1Ug4YI0P_Ot4_CGhwpC5xIWeF-RMescPPuXUYxODjl3-JP4tiOt11eVlrYykXVyuCynLzIK2iTEKxOnL-FVDxjWtICZoI2b8GWt1S4 Oct 04 19:43:41.619357 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 19:43:41.619357 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 19:43:41.619357 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 19:43:41.619357 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 19:43:41.619357 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 19:43:41.619357 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 19:43:41.619357 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: b4008b0bcf5a48b48259ae8430e7b281 Oct 04 19:43:41.619357 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServersNegativeTestJSON-1983752407 Oct 04 19:43:41.619357 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 19:43:41.619357 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 19:43:41.619357 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b4008b0bcf5a48b48259ae8430e7b281"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b4008b0bcf5a48b48259ae8430e7b281", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b4008b0bcf5a48b48259ae8430e7b281"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b4008b0bcf5a48b48259ae8430e7b281"}]}] Oct 04 19:43:41.619357 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServersNegativeTestJSON-1983752407 Oct 04 19:43:41.619357 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: b4008b0bcf5a48b48259ae8430e7b281 Oct 04 19:43:41.619357 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1983752407 Oct 04 19:43:41.619357 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServersNegativeTestJSON-1983752407-project Oct 04 19:43:41.619357 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 19:43:41.619357 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 19:43:41.619357 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 362e50a631884c4ca7f6d94d89523cc8 Oct 04 19:43:41.619357 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServersNegativeTestJSON-1983752407-project Oct 04 19:43:41.619357 n-d-850501-14 devstack@n-api.service[123002]: Oct 04 19:43:41.619357 n-d-850501-14 devstack@n-api.service[123002]: {"resize": {"flavorRef": ""}} Oct 04 19:43:41.619357 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 19:43:41.619357 n-d-850501-14 devstack@n-api.service[123002]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 04 19:43:41.619357 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '91dfe89b-dee9-460a-be0e-1db736b43ccd', 'body': {'resize': {'flavorRef': ''}}} Oct 04 19:43:41.619357 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:43:41.619357 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:43:41.619357 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 19:43:41.619357 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 19:43:41.619357 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 19:43:41.619357 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise error Oct 04 19:43:41.619357 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 04 19:43:41.619357 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:43:41.619357 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Oct 04 19:43:41.619357 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Oct 04 19:43:41.619357 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:43:41.619357 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi On instance['resize']: Oct 04 19:43:41.619357 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi '' Oct 04 19:43:41.619357 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:43:41.619357 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:43:41.619357 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:43:41.619357 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:43:41.619357 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:43:41.619357 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:43:41.619357 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:43:41.619357 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:43:41.619357 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:43:41.619357 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:43:41.619357 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 19:43:41.619357 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 19:43:41.619357 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 19:43:41.619357 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 19:43:41.619357 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 19:43:41.619357 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 19:43:41.619357 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 04 19:43:41.619357 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:43:41.619357 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:43:41.624711 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:43:41.624711 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:43:41.624711 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:43:41.624711 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:43:41.624711 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 19:43:41.624711 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 19:43:41.624711 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 04 19:43:41.624711 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:43:41.624711 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4fc463cb-c3de-4f4c-bc8c-d82d850ca5ad tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:43:41.624711 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4fc463cb-c3de-4f4c-bc8c-d82d850ca5ad tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] 10.222.0.20 "POST /compute/v2.1/servers/91dfe89b-dee9-460a-be0e-1db736b43ccd/action" status: 400 len: 113 microversion: 2.1 time: 0.013728 Oct 04 19:43:41.624711 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3899/7810] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 19:43:41 2022] POST /compute/v2.1/servers/91dfe89b-dee9-460a-be0e-1db736b43ccd/action => generated 113 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 19:43:41.630633 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-51f72917-19af-41d1-94fd-ce8d7ca71760 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:43:41.631249 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-51f72917-19af-41d1-94fd-ce8d7ca71760 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] [instance: 91dfe89b-dee9-460a-be0e-1db736b43ccd] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:43:41.638050 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-51f72917-19af-41d1-94fd-ce8d7ca71760 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:41.638711 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-51f72917-19af-41d1-94fd-ce8d7ca71760 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:41.639151 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-51f72917-19af-41d1-94fd-ce8d7ca71760 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:41.639844 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-51f72917-19af-41d1-94fd-ce8d7ca71760 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:41.640333 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-51f72917-19af-41d1-94fd-ce8d7ca71760 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:41.641307 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-51f72917-19af-41d1-94fd-ce8d7ca71760 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:41.776535 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-51f72917-19af-41d1-94fd-ce8d7ca71760 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362e50a631884c4ca7f6d94d89523cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4008b0bcf5a48b48259ae8430e7b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:43:41.785028 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-51f72917-19af-41d1-94fd-ce8d7ca71760 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] 10.222.0.20 "GET /compute/v2.1/servers/91dfe89b-dee9-460a-be0e-1db736b43ccd" status: 200 len: 1505 microversion: 2.1 time: 0.158129 Oct 04 19:43:41.785605 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3912/7811] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:43:41 2022] GET /compute/v2.1/servers/91dfe89b-dee9-460a-be0e-1db736b43ccd => generated 1505 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:43:41.812254 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-592b1020-1deb-46d0-8b15-f44e993652c0 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:43:41.812777 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-592b1020-1deb-46d0-8b15-f44e993652c0 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] [instance: acfa9489-e79b-4b1f-90fb-34619a9000fd] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:43:41.819954 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-592b1020-1deb-46d0-8b15-f44e993652c0 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:41.820505 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-592b1020-1deb-46d0-8b15-f44e993652c0 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:41.820955 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-592b1020-1deb-46d0-8b15-f44e993652c0 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:41.821686 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-592b1020-1deb-46d0-8b15-f44e993652c0 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:41.822154 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-592b1020-1deb-46d0-8b15-f44e993652c0 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:41.822597 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-592b1020-1deb-46d0-8b15-f44e993652c0 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:41.835977 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-592b1020-1deb-46d0-8b15-f44e993652c0 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] HTTP exception thrown: Instance acfa9489-e79b-4b1f-90fb-34619a9000fd could not be found. Oct 04 19:43:41.837624 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-592b1020-1deb-46d0-8b15-f44e993652c0 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Request method failure captured: Oct 04 19:43:41.837624 n-d-850501-14 devstack@n-api.service[123002]: request: DELETE /compute/v2.1/servers/acfa9489-e79b-4b1f-90fb-34619a9000fd HTTP/1.1 Oct 04 19:43:41.837624 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 19:43:41.837624 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 19:43:41.837624 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 19:43:41.837624 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 19:43:41.837624 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 19:43:41.837624 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 19:43:41.837624 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 19:43:41.837624 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 19:43:41.837624 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPIzMkq1APgOx7dM_uc10xtjQzdlow0Vj92bn9Ktj8Kh7f3oAERpNWHOPEeFEoj7nQMxh3Y8ri1Ug4YI0P_Ot4_CGhwpC5xIWeF-RMescPPuXUYxODjl3-JP4tiOt11eVlrYykXVyuCynLzIK2iTEKxOnL-FVDxjWtICZoI2b8GWt1S4 Oct 04 19:43:41.837624 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 19:43:41.837624 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 19:43:41.837624 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 19:43:41.837624 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 19:43:41.837624 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 19:43:41.837624 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 19:43:41.837624 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: b4008b0bcf5a48b48259ae8430e7b281 Oct 04 19:43:41.837624 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-ServersNegativeTestJSON-1983752407 Oct 04 19:43:41.837624 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 19:43:41.837624 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 19:43:41.837624 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b4008b0bcf5a48b48259ae8430e7b281"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b4008b0bcf5a48b48259ae8430e7b281", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b4008b0bcf5a48b48259ae8430e7b281"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b4008b0bcf5a48b48259ae8430e7b281"}]}] Oct 04 19:43:41.837624 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-ServersNegativeTestJSON-1983752407 Oct 04 19:43:41.837624 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: b4008b0bcf5a48b48259ae8430e7b281 Oct 04 19:43:41.837624 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1983752407 Oct 04 19:43:41.837624 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-ServersNegativeTestJSON-1983752407-project Oct 04 19:43:41.837624 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 19:43:41.837624 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 19:43:41.837624 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 362e50a631884c4ca7f6d94d89523cc8 Oct 04 19:43:41.837624 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-ServersNegativeTestJSON-1983752407-project Oct 04 19:43:41.837624 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 19:43:41.837624 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance acfa9489-e79b-4b1f-90fb-34619a9000fd could not be found. Oct 04 19:43:41.837624 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'acfa9489-e79b-4b1f-90fb-34619a9000fd'} Oct 04 19:43:41.837624 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:43:41.837624 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:43:41.837624 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:43:41.837624 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:43:41.837624 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:43:41.837624 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:43:41.837624 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:43:41.837624 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:43:41.837624 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:43:41.837624 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:43:41.837624 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acfa9489-e79b-4b1f-90fb-34619a9000fd could not be found. Oct 04 19:43:41.837624 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:43:41.837624 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:43:41.837624 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:43:41.837624 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:43:41.837624 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:43:41.837624 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:43:41.837624 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:43:41.837624 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:43:41.837624 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:43:41.837624 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:43:41.837624 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 19:43:41.837624 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 19:43:41.837624 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 19:43:41.837624 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 19:43:41.837624 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:43:41.837624 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:43:41.837624 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:43:41.837624 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:43:41.841693 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acfa9489-e79b-4b1f-90fb-34619a9000fd could not be found. Oct 04 19:43:41.841693 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:43:41.841693 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:43:41.841693 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:43:41.841693 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:43:41.841693 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:43:41.841693 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:43:41.841693 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:43:41.841693 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:43:41.841693 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acfa9489-e79b-4b1f-90fb-34619a9000fd could not be found. Oct 04 19:43:41.841693 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:43:41.841693 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-592b1020-1deb-46d0-8b15-f44e993652c0 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Returning 404 to user: Instance acfa9489-e79b-4b1f-90fb-34619a9000fd could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:43:41.841693 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-592b1020-1deb-46d0-8b15-f44e993652c0 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] 10.222.0.20 "DELETE /compute/v2.1/servers/acfa9489-e79b-4b1f-90fb-34619a9000fd" status: 404 len: 111 microversion: 2.1 time: 0.031667 Oct 04 19:43:41.841693 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3900/7812] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 19:43:41 2022] DELETE /compute/v2.1/servers/acfa9489-e79b-4b1f-90fb-34619a9000fd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:43:41.848123 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b9810d62-1f99-4d9e-922d-d752ceff2cef tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:43:41.848763 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b9810d62-1f99-4d9e-922d-d752ceff2cef tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] [instance: acfa9489-e79b-4b1f-90fb-34619a9000fd] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:43:41.854675 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b9810d62-1f99-4d9e-922d-d752ceff2cef tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:41.855157 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b9810d62-1f99-4d9e-922d-d752ceff2cef tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:41.855590 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b9810d62-1f99-4d9e-922d-d752ceff2cef tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:41.856374 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b9810d62-1f99-4d9e-922d-d752ceff2cef tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:41.856826 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b9810d62-1f99-4d9e-922d-d752ceff2cef tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:41.857248 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b9810d62-1f99-4d9e-922d-d752ceff2cef tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:41.871076 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-b9810d62-1f99-4d9e-922d-d752ceff2cef tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] HTTP exception thrown: Instance acfa9489-e79b-4b1f-90fb-34619a9000fd could not be found. Oct 04 19:43:41.872614 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b9810d62-1f99-4d9e-922d-d752ceff2cef tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Request method failure captured: Oct 04 19:43:41.872614 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/acfa9489-e79b-4b1f-90fb-34619a9000fd HTTP/1.1 Oct 04 19:43:41.872614 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 19:43:41.872614 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 19:43:41.872614 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 19:43:41.872614 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 19:43:41.872614 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 19:43:41.872614 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 19:43:41.872614 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 19:43:41.872614 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 19:43:41.872614 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPIzMkq1APgOx7dM_uc10xtjQzdlow0Vj92bn9Ktj8Kh7f3oAERpNWHOPEeFEoj7nQMxh3Y8ri1Ug4YI0P_Ot4_CGhwpC5xIWeF-RMescPPuXUYxODjl3-JP4tiOt11eVlrYykXVyuCynLzIK2iTEKxOnL-FVDxjWtICZoI2b8GWt1S4 Oct 04 19:43:41.872614 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 19:43:41.872614 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 19:43:41.872614 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 19:43:41.872614 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 19:43:41.872614 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 19:43:41.872614 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 19:43:41.872614 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: b4008b0bcf5a48b48259ae8430e7b281 Oct 04 19:43:41.872614 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ServersNegativeTestJSON-1983752407 Oct 04 19:43:41.872614 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 19:43:41.872614 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 19:43:41.872614 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b4008b0bcf5a48b48259ae8430e7b281"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b4008b0bcf5a48b48259ae8430e7b281", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b4008b0bcf5a48b48259ae8430e7b281"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b4008b0bcf5a48b48259ae8430e7b281"}]}] Oct 04 19:43:41.872614 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ServersNegativeTestJSON-1983752407 Oct 04 19:43:41.872614 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: b4008b0bcf5a48b48259ae8430e7b281 Oct 04 19:43:41.872614 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1983752407 Oct 04 19:43:41.872614 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ServersNegativeTestJSON-1983752407-project Oct 04 19:43:41.872614 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 19:43:41.872614 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 19:43:41.872614 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 362e50a631884c4ca7f6d94d89523cc8 Oct 04 19:43:41.872614 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ServersNegativeTestJSON-1983752407-project Oct 04 19:43:41.872614 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 19:43:41.872614 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance acfa9489-e79b-4b1f-90fb-34619a9000fd could not be found. Oct 04 19:43:41.872614 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': 'acfa9489-e79b-4b1f-90fb-34619a9000fd'} Oct 04 19:43:41.872614 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:43:41.872614 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:43:41.872614 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:43:41.872614 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:43:41.872614 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:43:41.872614 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:43:41.872614 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:43:41.872614 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:43:41.872614 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:43:41.872614 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:43:41.872614 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acfa9489-e79b-4b1f-90fb-34619a9000fd could not be found. Oct 04 19:43:41.872614 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:43:41.872614 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:43:41.872614 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:43:41.872614 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:43:41.872614 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:43:41.872614 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:43:41.872614 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:43:41.872614 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:43:41.872614 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:43:41.872614 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:43:41.872614 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:43:41.872614 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:43:41.872614 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:43:41.872614 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:43:41.872614 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:43:41.872614 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:43:41.872614 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acfa9489-e79b-4b1f-90fb-34619a9000fd could not be found. Oct 04 19:43:41.872614 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:43:41.872614 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:43:41.872614 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:43:41.878026 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:43:41.878026 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:43:41.878026 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:43:41.878026 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:43:41.878026 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:43:41.878026 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acfa9489-e79b-4b1f-90fb-34619a9000fd could not be found. Oct 04 19:43:41.878026 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:43:41.878026 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b9810d62-1f99-4d9e-922d-d752ceff2cef tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Returning 404 to user: Instance acfa9489-e79b-4b1f-90fb-34619a9000fd could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:43:41.878026 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b9810d62-1f99-4d9e-922d-d752ceff2cef tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] 10.222.0.20 "GET /compute/v2.1/servers/acfa9489-e79b-4b1f-90fb-34619a9000fd" status: 404 len: 111 microversion: 2.1 time: 0.030158 Oct 04 19:43:41.878026 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3913/7813] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:43:41 2022] GET /compute/v2.1/servers/acfa9489-e79b-4b1f-90fb-34619a9000fd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:43:41.883334 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9b1b8cdf-434f-41fb-86af-fdd27da17146 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:43:41.883849 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9b1b8cdf-434f-41fb-86af-fdd27da17146 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] [instance: 91dfe89b-dee9-460a-be0e-1db736b43ccd] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:43:41.889845 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9b1b8cdf-434f-41fb-86af-fdd27da17146 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:41.890334 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9b1b8cdf-434f-41fb-86af-fdd27da17146 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:41.890934 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9b1b8cdf-434f-41fb-86af-fdd27da17146 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:41.891640 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9b1b8cdf-434f-41fb-86af-fdd27da17146 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:41.892141 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9b1b8cdf-434f-41fb-86af-fdd27da17146 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:41.892584 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9b1b8cdf-434f-41fb-86af-fdd27da17146 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:41.920133 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9b1b8cdf-434f-41fb-86af-fdd27da17146 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] [instance: 91dfe89b-dee9-460a-be0e-1db736b43ccd] Going to try to terminate instance {{(pid=123002) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:43:42.122192 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:43:42.251642 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9b1b8cdf-434f-41fb-86af-fdd27da17146 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] 10.222.0.20 "DELETE /compute/v2.1/servers/91dfe89b-dee9-460a-be0e-1db736b43ccd" status: 204 len: 0 microversion: 2.1 time: 0.371692 Oct 04 19:43:42.252606 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3901/7814] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 19:43:41 2022] DELETE /compute/v2.1/servers/91dfe89b-dee9-460a-be0e-1db736b43ccd => generated 0 bytes in 374 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 19:43:42.260747 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-24b541ad-b0ef-4d90-9140-535e7fa39596 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:43:42.261362 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-24b541ad-b0ef-4d90-9140-535e7fa39596 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] [instance: 91dfe89b-dee9-460a-be0e-1db736b43ccd] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:43:42.268563 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-24b541ad-b0ef-4d90-9140-535e7fa39596 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:42.269046 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-24b541ad-b0ef-4d90-9140-535e7fa39596 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:42.269486 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-24b541ad-b0ef-4d90-9140-535e7fa39596 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:42.270173 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-24b541ad-b0ef-4d90-9140-535e7fa39596 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:42.270633 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-24b541ad-b0ef-4d90-9140-535e7fa39596 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:42.271059 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-24b541ad-b0ef-4d90-9140-535e7fa39596 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:42.403570 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-24b541ad-b0ef-4d90-9140-535e7fa39596 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362e50a631884c4ca7f6d94d89523cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4008b0bcf5a48b48259ae8430e7b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:43:42.411655 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-24b541ad-b0ef-4d90-9140-535e7fa39596 tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] 10.222.0.20 "GET /compute/v2.1/servers/91dfe89b-dee9-460a-be0e-1db736b43ccd" status: 200 len: 1511 microversion: 2.1 time: 0.154788 Oct 04 19:43:42.412430 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3914/7815] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:43:42 2022] GET /compute/v2.1/servers/91dfe89b-dee9-460a-be0e-1db736b43ccd => generated 1511 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:43:43.435474 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8f3c2395-786d-49d8-968b-991cfa128a7d tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:43:43.436277 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8f3c2395-786d-49d8-968b-991cfa128a7d tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] [instance: 91dfe89b-dee9-460a-be0e-1db736b43ccd] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:43:43.444015 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8f3c2395-786d-49d8-968b-991cfa128a7d tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:43.444540 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8f3c2395-786d-49d8-968b-991cfa128a7d tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:43.444996 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8f3c2395-786d-49d8-968b-991cfa128a7d tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:43.445702 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8f3c2395-786d-49d8-968b-991cfa128a7d tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:43.446174 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8f3c2395-786d-49d8-968b-991cfa128a7d tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:43.446617 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8f3c2395-786d-49d8-968b-991cfa128a7d tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:43.590495 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8f3c2395-786d-49d8-968b-991cfa128a7d tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362e50a631884c4ca7f6d94d89523cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4008b0bcf5a48b48259ae8430e7b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:43:43.599611 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8f3c2395-786d-49d8-968b-991cfa128a7d tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] 10.222.0.20 "GET /compute/v2.1/servers/91dfe89b-dee9-460a-be0e-1db736b43ccd" status: 200 len: 1511 microversion: 2.1 time: 0.168360 Oct 04 19:43:43.600234 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3902/7816] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:43:43 2022] GET /compute/v2.1/servers/91dfe89b-dee9-460a-be0e-1db736b43ccd => generated 1511 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:43:44.184273 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-56a3dbca-775d-483c-9afe-ecbccc1aa824 req-300946e7-e22f-40f4-b68a-8dcd4695e944 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91dfe89b-dee9-460a-be0e-1db736b43ccd", "name": "network-vif-deleted", "tag": "2e25b805-39a4-4097-833d-e97c43c9ea35"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:43:44.194604 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-56a3dbca-775d-483c-9afe-ecbccc1aa824 req-300946e7-e22f-40f4-b68a-8dcd4695e944 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:44.195371 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-56a3dbca-775d-483c-9afe-ecbccc1aa824 req-300946e7-e22f-40f4-b68a-8dcd4695e944 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:44.196477 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-56a3dbca-775d-483c-9afe-ecbccc1aa824 req-300946e7-e22f-40f4-b68a-8dcd4695e944 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:44.207963 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-56a3dbca-775d-483c-9afe-ecbccc1aa824 req-300946e7-e22f-40f4-b68a-8dcd4695e944 service nova] Creating event network-vif-deleted:2e25b805-39a4-4097-833d-e97c43c9ea35 for instance 91dfe89b-dee9-460a-be0e-1db736b43ccd on n-h1-850501-14 Oct 04 19:43:44.213579 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-56a3dbca-775d-483c-9afe-ecbccc1aa824 req-300946e7-e22f-40f4-b68a-8dcd4695e944 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093774 Oct 04 19:43:44.214194 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3915/7817] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:43:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:43:44.623253 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1346a032-746e-4ad1-875f-9c34f3a5520e tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:43:44.623914 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1346a032-746e-4ad1-875f-9c34f3a5520e tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] [instance: 91dfe89b-dee9-460a-be0e-1db736b43ccd] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:43:44.631793 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1346a032-746e-4ad1-875f-9c34f3a5520e tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:44.632336 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1346a032-746e-4ad1-875f-9c34f3a5520e tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:44.632793 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1346a032-746e-4ad1-875f-9c34f3a5520e tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:44.633530 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1346a032-746e-4ad1-875f-9c34f3a5520e tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:44.634000 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1346a032-746e-4ad1-875f-9c34f3a5520e tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:44.634438 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1346a032-746e-4ad1-875f-9c34f3a5520e tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:44.666452 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1346a032-746e-4ad1-875f-9c34f3a5520e tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:44.666955 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1346a032-746e-4ad1-875f-9c34f3a5520e tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:44.667403 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1346a032-746e-4ad1-875f-9c34f3a5520e tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:44.667867 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-1346a032-746e-4ad1-875f-9c34f3a5520e tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lazy-loading 'fault' on Instance uuid 91dfe89b-dee9-460a-be0e-1db736b43ccd {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:43:44.709354 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1346a032-746e-4ad1-875f-9c34f3a5520e tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362e50a631884c4ca7f6d94d89523cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4008b0bcf5a48b48259ae8430e7b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:43:44.717255 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1346a032-746e-4ad1-875f-9c34f3a5520e tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] 10.222.0.20 "GET /compute/v2.1/servers/91dfe89b-dee9-460a-be0e-1db736b43ccd" status: 200 len: 1307 microversion: 2.1 time: 0.098054 Oct 04 19:43:44.717841 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3903/7818] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:43:44 2022] GET /compute/v2.1/servers/91dfe89b-dee9-460a-be0e-1db736b43ccd => generated 1307 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:43:45.742639 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1957d950-7841-4a63-b972-8210b62a099c tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:43:45.743340 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1957d950-7841-4a63-b972-8210b62a099c tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] [instance: 91dfe89b-dee9-460a-be0e-1db736b43ccd] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:43:45.749487 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1957d950-7841-4a63-b972-8210b62a099c tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:45.749997 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1957d950-7841-4a63-b972-8210b62a099c tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:45.750432 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1957d950-7841-4a63-b972-8210b62a099c tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:45.751106 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1957d950-7841-4a63-b972-8210b62a099c tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:45.751556 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1957d950-7841-4a63-b972-8210b62a099c tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:45.751977 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1957d950-7841-4a63-b972-8210b62a099c tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:45.765143 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-1957d950-7841-4a63-b972-8210b62a099c tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] HTTP exception thrown: Instance 91dfe89b-dee9-460a-be0e-1db736b43ccd could not be found. Oct 04 19:43:45.767053 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1957d950-7841-4a63-b972-8210b62a099c tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Request method failure captured: Oct 04 19:43:45.767053 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/91dfe89b-dee9-460a-be0e-1db736b43ccd HTTP/1.1 Oct 04 19:43:45.767053 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 19:43:45.767053 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 19:43:45.767053 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 19:43:45.767053 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 19:43:45.767053 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 19:43:45.767053 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 19:43:45.767053 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 19:43:45.767053 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 19:43:45.767053 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPIzMkq1APgOx7dM_uc10xtjQzdlow0Vj92bn9Ktj8Kh7f3oAERpNWHOPEeFEoj7nQMxh3Y8ri1Ug4YI0P_Ot4_CGhwpC5xIWeF-RMescPPuXUYxODjl3-JP4tiOt11eVlrYykXVyuCynLzIK2iTEKxOnL-FVDxjWtICZoI2b8GWt1S4 Oct 04 19:43:45.767053 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 19:43:45.767053 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 19:43:45.767053 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 19:43:45.767053 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 19:43:45.767053 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 19:43:45.767053 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 19:43:45.767053 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: b4008b0bcf5a48b48259ae8430e7b281 Oct 04 19:43:45.767053 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-ServersNegativeTestJSON-1983752407 Oct 04 19:43:45.767053 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 19:43:45.767053 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 19:43:45.767053 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b4008b0bcf5a48b48259ae8430e7b281"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b4008b0bcf5a48b48259ae8430e7b281", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b4008b0bcf5a48b48259ae8430e7b281"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b4008b0bcf5a48b48259ae8430e7b281"}]}] Oct 04 19:43:45.767053 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-ServersNegativeTestJSON-1983752407 Oct 04 19:43:45.767053 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: b4008b0bcf5a48b48259ae8430e7b281 Oct 04 19:43:45.767053 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1983752407 Oct 04 19:43:45.767053 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-ServersNegativeTestJSON-1983752407-project Oct 04 19:43:45.767053 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 19:43:45.767053 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 19:43:45.767053 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 362e50a631884c4ca7f6d94d89523cc8 Oct 04 19:43:45.767053 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-ServersNegativeTestJSON-1983752407-project Oct 04 19:43:45.767053 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 19:43:45.767053 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 91dfe89b-dee9-460a-be0e-1db736b43ccd could not be found. Oct 04 19:43:45.767053 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '91dfe89b-dee9-460a-be0e-1db736b43ccd'} Oct 04 19:43:45.767053 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:43:45.767053 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:43:45.767053 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:43:45.767053 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:43:45.767053 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:43:45.767053 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:43:45.767053 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:43:45.767053 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:43:45.767053 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:43:45.767053 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:43:45.767053 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91dfe89b-dee9-460a-be0e-1db736b43ccd could not be found. Oct 04 19:43:45.767053 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:43:45.767053 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:43:45.767053 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:43:45.767053 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:43:45.767053 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:43:45.767053 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:43:45.767053 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:43:45.767053 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:43:45.767053 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:43:45.767053 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:43:45.767053 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:43:45.767053 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:43:45.767053 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:43:45.767053 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:43:45.767053 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:43:45.767053 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:43:45.767053 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91dfe89b-dee9-460a-be0e-1db736b43ccd could not be found. Oct 04 19:43:45.767053 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:43:45.767053 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:43:45.767053 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:43:45.771494 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:43:45.771494 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:43:45.771494 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:43:45.771494 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:43:45.771494 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:43:45.771494 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91dfe89b-dee9-460a-be0e-1db736b43ccd could not be found. Oct 04 19:43:45.771494 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:43:45.771494 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1957d950-7841-4a63-b972-8210b62a099c tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] Returning 404 to user: Instance 91dfe89b-dee9-460a-be0e-1db736b43ccd could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:43:45.771494 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1957d950-7841-4a63-b972-8210b62a099c tempest-ServersNegativeTestJSON-1983752407 tempest-ServersNegativeTestJSON-1983752407-project] 10.222.0.20 "GET /compute/v2.1/servers/91dfe89b-dee9-460a-be0e-1db736b43ccd" status: 404 len: 111 microversion: 2.1 time: 0.031106 Oct 04 19:43:45.771494 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3916/7819] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:43:45 2022] GET /compute/v2.1/servers/91dfe89b-dee9-460a-be0e-1db736b43ccd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:44:32.369217 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=10,nova_api:UPDATE=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:44:32.372038 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:44:32.537134 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8f6b399b-8169-4e39-98c9-e2f8ada79a1e tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Action: 'create', calling method: .version_select at 0x7fe253cb89d0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-748648829", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPXiZRlOY5CtnMkAxt7BMbN7z/pJNNB98F3trXe1ny7oki6q5HiLjmTbzI9lGLP/vJ1QK0ma5dPZc7N4DR5JSWO/bmIBmi8Zc4mUcZSJW4vudl5SBbC20vnkG9+FcBtRJw=="}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:44:32.553185 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-8f6b399b-8169-4e39-98c9-e2f8ada79a1e tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Getting quotas for project 9e7e5bbf1a1a408cb25c117ba070f965. Resources: {'key_pairs'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:44:32.558422 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-8f6b399b-8169-4e39-98c9-e2f8ada79a1e tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Getting quotas for user 4f47ba234baf476aafa923d18266f4c8 and project 9e7e5bbf1a1a408cb25c117ba070f965. Resources: {'key_pairs'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:44:32.680118 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8f6b399b-8169-4e39-98c9-e2f8ada79a1e tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.315903 Oct 04 19:44:32.695367 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3904/7820] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Oct 4 19:44:32 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:44:32.741240 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1d77b4c1-f621-4a3b-85b3-f510d4a3eef2 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1888110353", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-748648829", "networks": [{"uuid": "f42e273e-d5f1-48ac-b887-f81bd956f13b"}]}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:44:32.754026 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=21 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:44:32.754971 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=45 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:44:32.805900 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.neutron [None req-1d77b4c1-f621-4a3b-85b3-f510d4a3eef2 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] validate_networks() for [('f42e273e-d5f1-48ac-b887-f81bd956f13b', None, None, None, None, None)] {{(pid=123001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:44:33.214439 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-1d77b4c1-f621-4a3b-85b3-f510d4a3eef2 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:44:33.214906 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-1d77b4c1-f621-4a3b-85b3-f510d4a3eef2 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:44:33.215396 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-1d77b4c1-f621-4a3b-85b3-f510d4a3eef2 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:44:33.215816 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-1d77b4c1-f621-4a3b-85b3-f510d4a3eef2 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:44:33.216287 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-1d77b4c1-f621-4a3b-85b3-f510d4a3eef2 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:44:33.225806 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1d77b4c1-f621-4a3b-85b3-f510d4a3eef2 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:44:33.226421 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1d77b4c1-f621-4a3b-85b3-f510d4a3eef2 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:44:33.226891 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1d77b4c1-f621-4a3b-85b3-f510d4a3eef2 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:44:33.227614 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1d77b4c1-f621-4a3b-85b3-f510d4a3eef2 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:44:33.228095 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1d77b4c1-f621-4a3b-85b3-f510d4a3eef2 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:44:33.228539 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1d77b4c1-f621-4a3b-85b3-f510d4a3eef2 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:44:33.246174 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-1d77b4c1-f621-4a3b-85b3-f510d4a3eef2 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Getting quotas for project 9e7e5bbf1a1a408cb25c117ba070f965. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:44:33.252431 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-1d77b4c1-f621-4a3b-85b3-f510d4a3eef2 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Getting quotas for user 4f47ba234baf476aafa923d18266f4c8 and project 9e7e5bbf1a1a408cb25c117ba070f965. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:44:33.265925 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1d77b4c1-f621-4a3b-85b3-f510d4a3eef2 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Going to run 1 instances... {{(pid=123001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:44:33.268327 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1d77b4c1-f621-4a3b-85b3-f510d4a3eef2 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] [instance: 732ad313-c3f1-4ac3-943e-5aa5d48b36ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:44:33.384037 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1d77b4c1-f621-4a3b-85b3-f510d4a3eef2 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.647105 Oct 04 19:44:33.385012 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3917/7821] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 19:44:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:44:33.397740 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5c13d9a7-b32f-4eb8-8e8b-228ac05bf4de tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:44:33.398378 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5c13d9a7-b32f-4eb8-8e8b-228ac05bf4de tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] [instance: 732ad313-c3f1-4ac3-943e-5aa5d48b36ea] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:44:33.456369 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5c13d9a7-b32f-4eb8-8e8b-228ac05bf4de tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f47ba234baf476aafa923d18266f4c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7e5bbf1a1a408cb25c117ba070f965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:44:33.465156 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5c13d9a7-b32f-4eb8-8e8b-228ac05bf4de tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] 10.222.0.20 "GET /compute/v2.1/servers/732ad313-c3f1-4ac3-943e-5aa5d48b36ea" status: 200 len: 1262 microversion: 2.1 time: 0.073045 Oct 04 19:44:33.465763 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3905/7822] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:44:33 2022] GET /compute/v2.1/servers/732ad313-c3f1-4ac3-943e-5aa5d48b36ea => generated 1262 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:44:34.490143 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5f5ceba6-9eee-44cb-8846-c7c1921bf689 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:44:34.490759 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5f5ceba6-9eee-44cb-8846-c7c1921bf689 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] [instance: 732ad313-c3f1-4ac3-943e-5aa5d48b36ea] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:44:34.555416 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5f5ceba6-9eee-44cb-8846-c7c1921bf689 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f47ba234baf476aafa923d18266f4c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7e5bbf1a1a408cb25c117ba070f965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:44:34.566596 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5f5ceba6-9eee-44cb-8846-c7c1921bf689 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] 10.222.0.20 "GET /compute/v2.1/servers/732ad313-c3f1-4ac3-943e-5aa5d48b36ea" status: 200 len: 1262 microversion: 2.1 time: 0.080034 Oct 04 19:44:34.566596 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3918/7823] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:44:34 2022] GET /compute/v2.1/servers/732ad313-c3f1-4ac3-943e-5aa5d48b36ea => generated 1262 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:44:35.588100 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6f64c46a-1291-47c6-b716-261e22ba9bfa tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:44:35.588724 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-6f64c46a-1291-47c6-b716-261e22ba9bfa tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] [instance: 732ad313-c3f1-4ac3-943e-5aa5d48b36ea] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:44:35.597042 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6f64c46a-1291-47c6-b716-261e22ba9bfa tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:44:35.597628 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6f64c46a-1291-47c6-b716-261e22ba9bfa tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:44:35.598078 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6f64c46a-1291-47c6-b716-261e22ba9bfa tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:44:35.598797 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6f64c46a-1291-47c6-b716-261e22ba9bfa tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:44:35.599291 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6f64c46a-1291-47c6-b716-261e22ba9bfa tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:44:35.599730 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6f64c46a-1291-47c6-b716-261e22ba9bfa tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:44:35.666767 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-6f64c46a-1291-47c6-b716-261e22ba9bfa tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f47ba234baf476aafa923d18266f4c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7e5bbf1a1a408cb25c117ba070f965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:44:35.675489 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6f64c46a-1291-47c6-b716-261e22ba9bfa tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] 10.222.0.20 "GET /compute/v2.1/servers/732ad313-c3f1-4ac3-943e-5aa5d48b36ea" status: 200 len: 1314 microversion: 2.1 time: 0.091255 Oct 04 19:44:35.676103 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3906/7824] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:44:35 2022] GET /compute/v2.1/servers/732ad313-c3f1-4ac3-943e-5aa5d48b36ea => generated 1314 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:44:36.698910 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6eb0411e-8723-4604-a2ee-9d096377d26b tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:44:36.699866 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6eb0411e-8723-4604-a2ee-9d096377d26b tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] [instance: 732ad313-c3f1-4ac3-943e-5aa5d48b36ea] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:44:36.707509 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6eb0411e-8723-4604-a2ee-9d096377d26b tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:44:36.708336 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6eb0411e-8723-4604-a2ee-9d096377d26b tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:44:36.708538 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6eb0411e-8723-4604-a2ee-9d096377d26b tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:44:36.709227 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6eb0411e-8723-4604-a2ee-9d096377d26b tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:44:36.709708 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6eb0411e-8723-4604-a2ee-9d096377d26b tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:44:36.710143 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6eb0411e-8723-4604-a2ee-9d096377d26b tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:44:36.908563 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6eb0411e-8723-4604-a2ee-9d096377d26b tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f47ba234baf476aafa923d18266f4c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7e5bbf1a1a408cb25c117ba070f965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:44:36.916506 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6eb0411e-8723-4604-a2ee-9d096377d26b tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] 10.222.0.20 "GET /compute/v2.1/servers/732ad313-c3f1-4ac3-943e-5aa5d48b36ea" status: 200 len: 1362 microversion: 2.1 time: 0.221456 Oct 04 19:44:36.917309 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3919/7825] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:44:36 2022] GET /compute/v2.1/servers/732ad313-c3f1-4ac3-943e-5aa5d48b36ea => generated 1362 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:44:37.695320 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-d222e26f-a7c4-4bca-96f3-aa9cefbeb64e req-f3f6eb19-5fe8-4118-9135-3c2e132c6899 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "732ad313-c3f1-4ac3-943e-5aa5d48b36ea", "tag": "8ae6ff9d-ec09-49b0-a5a9-d6661174fb2d"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:44:37.706435 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-d222e26f-a7c4-4bca-96f3-aa9cefbeb64e req-f3f6eb19-5fe8-4118-9135-3c2e132c6899 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:44:37.706925 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-d222e26f-a7c4-4bca-96f3-aa9cefbeb64e req-f3f6eb19-5fe8-4118-9135-3c2e132c6899 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:44:37.707399 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-d222e26f-a7c4-4bca-96f3-aa9cefbeb64e req-f3f6eb19-5fe8-4118-9135-3c2e132c6899 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:44:37.719329 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-d222e26f-a7c4-4bca-96f3-aa9cefbeb64e req-f3f6eb19-5fe8-4118-9135-3c2e132c6899 service nova] Creating event network-changed:8ae6ff9d-ec09-49b0-a5a9-d6661174fb2d for instance 732ad313-c3f1-4ac3-943e-5aa5d48b36ea on n-h1-850501-14 Oct 04 19:44:37.726923 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-d222e26f-a7c4-4bca-96f3-aa9cefbeb64e req-f3f6eb19-5fe8-4118-9135-3c2e132c6899 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033235 Oct 04 19:44:37.726923 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3907/7826] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:44:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:44:37.940917 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-940a3ef0-939a-4112-bf63-0a9f1355b02c tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:44:37.941657 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-940a3ef0-939a-4112-bf63-0a9f1355b02c tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] [instance: 732ad313-c3f1-4ac3-943e-5aa5d48b36ea] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:44:37.948615 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-940a3ef0-939a-4112-bf63-0a9f1355b02c tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:44:37.949101 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-940a3ef0-939a-4112-bf63-0a9f1355b02c tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:44:37.949537 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-940a3ef0-939a-4112-bf63-0a9f1355b02c tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:44:37.950232 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-940a3ef0-939a-4112-bf63-0a9f1355b02c tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:44:37.950690 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-940a3ef0-939a-4112-bf63-0a9f1355b02c tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:44:37.951116 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-940a3ef0-939a-4112-bf63-0a9f1355b02c tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:44:38.140195 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-940a3ef0-939a-4112-bf63-0a9f1355b02c tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f47ba234baf476aafa923d18266f4c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7e5bbf1a1a408cb25c117ba070f965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:44:38.148773 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-940a3ef0-939a-4112-bf63-0a9f1355b02c tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] 10.222.0.20 "GET /compute/v2.1/servers/732ad313-c3f1-4ac3-943e-5aa5d48b36ea" status: 200 len: 1362 microversion: 2.1 time: 0.212670 Oct 04 19:44:38.149340 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3920/7827] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:44:37 2022] GET /compute/v2.1/servers/732ad313-c3f1-4ac3-943e-5aa5d48b36ea => generated 1362 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:44:39.174829 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-67cd6451-2594-4b22-86fa-ee636c2736be tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:44:39.175661 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-67cd6451-2594-4b22-86fa-ee636c2736be tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] [instance: 732ad313-c3f1-4ac3-943e-5aa5d48b36ea] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:44:39.182608 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-67cd6451-2594-4b22-86fa-ee636c2736be tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:44:39.183210 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-67cd6451-2594-4b22-86fa-ee636c2736be tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:44:39.183708 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-67cd6451-2594-4b22-86fa-ee636c2736be tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:44:39.184484 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-67cd6451-2594-4b22-86fa-ee636c2736be tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:44:39.185021 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-67cd6451-2594-4b22-86fa-ee636c2736be tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:44:39.185529 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-67cd6451-2594-4b22-86fa-ee636c2736be tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:44:39.325631 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-67cd6451-2594-4b22-86fa-ee636c2736be tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f47ba234baf476aafa923d18266f4c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7e5bbf1a1a408cb25c117ba070f965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:44:39.334129 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-67cd6451-2594-4b22-86fa-ee636c2736be tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] 10.222.0.20 "GET /compute/v2.1/servers/732ad313-c3f1-4ac3-943e-5aa5d48b36ea" status: 200 len: 1362 microversion: 2.1 time: 0.165894 Oct 04 19:44:39.335881 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3908/7828] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:44:39 2022] GET /compute/v2.1/servers/732ad313-c3f1-4ac3-943e-5aa5d48b36ea => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:44:40.358534 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-db9c72b6-03f1-4755-a914-d1870317d63c tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:44:40.359150 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-db9c72b6-03f1-4755-a914-d1870317d63c tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] [instance: 732ad313-c3f1-4ac3-943e-5aa5d48b36ea] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:44:40.365949 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-db9c72b6-03f1-4755-a914-d1870317d63c tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:44:40.366426 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-db9c72b6-03f1-4755-a914-d1870317d63c tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:44:40.366864 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-db9c72b6-03f1-4755-a914-d1870317d63c tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:44:40.367551 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-db9c72b6-03f1-4755-a914-d1870317d63c tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:44:40.368001 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-db9c72b6-03f1-4755-a914-d1870317d63c tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:44:40.368449 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-db9c72b6-03f1-4755-a914-d1870317d63c tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:44:40.499313 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-db9c72b6-03f1-4755-a914-d1870317d63c tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f47ba234baf476aafa923d18266f4c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7e5bbf1a1a408cb25c117ba070f965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:44:40.507358 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-db9c72b6-03f1-4755-a914-d1870317d63c tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] 10.222.0.20 "GET /compute/v2.1/servers/732ad313-c3f1-4ac3-943e-5aa5d48b36ea" status: 200 len: 1362 microversion: 2.1 time: 0.153033 Oct 04 19:44:40.507930 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3921/7829] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:44:40 2022] GET /compute/v2.1/servers/732ad313-c3f1-4ac3-943e-5aa5d48b36ea => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:44:41.534312 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3a053ed5-8691-421f-9d22-cfd455baed50 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:44:41.534951 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3a053ed5-8691-421f-9d22-cfd455baed50 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] [instance: 732ad313-c3f1-4ac3-943e-5aa5d48b36ea] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:44:41.542178 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3a053ed5-8691-421f-9d22-cfd455baed50 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:44:41.542685 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3a053ed5-8691-421f-9d22-cfd455baed50 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:44:41.543141 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3a053ed5-8691-421f-9d22-cfd455baed50 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:44:41.543915 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3a053ed5-8691-421f-9d22-cfd455baed50 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:44:41.544418 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3a053ed5-8691-421f-9d22-cfd455baed50 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:44:41.544868 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3a053ed5-8691-421f-9d22-cfd455baed50 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:44:41.681971 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3a053ed5-8691-421f-9d22-cfd455baed50 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f47ba234baf476aafa923d18266f4c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7e5bbf1a1a408cb25c117ba070f965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:44:41.689863 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3a053ed5-8691-421f-9d22-cfd455baed50 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] 10.222.0.20 "GET /compute/v2.1/servers/732ad313-c3f1-4ac3-943e-5aa5d48b36ea" status: 200 len: 1362 microversion: 2.1 time: 0.160043 Oct 04 19:44:41.690452 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3909/7830] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:44:41 2022] GET /compute/v2.1/servers/732ad313-c3f1-4ac3-943e-5aa5d48b36ea => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:44:42.716519 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-528667d9-af9d-489d-80a6-ef23321d5fd0 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:44:42.717185 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-528667d9-af9d-489d-80a6-ef23321d5fd0 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] [instance: 732ad313-c3f1-4ac3-943e-5aa5d48b36ea] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:44:42.725341 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-528667d9-af9d-489d-80a6-ef23321d5fd0 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:44:42.725872 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-528667d9-af9d-489d-80a6-ef23321d5fd0 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:44:42.726259 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-528667d9-af9d-489d-80a6-ef23321d5fd0 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:44:42.726969 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-528667d9-af9d-489d-80a6-ef23321d5fd0 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:44:42.727480 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-528667d9-af9d-489d-80a6-ef23321d5fd0 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:44:42.727856 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-528667d9-af9d-489d-80a6-ef23321d5fd0 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:44:42.865223 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-528667d9-af9d-489d-80a6-ef23321d5fd0 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f47ba234baf476aafa923d18266f4c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7e5bbf1a1a408cb25c117ba070f965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:44:42.873037 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-528667d9-af9d-489d-80a6-ef23321d5fd0 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] 10.222.0.20 "GET /compute/v2.1/servers/732ad313-c3f1-4ac3-943e-5aa5d48b36ea" status: 200 len: 1362 microversion: 2.1 time: 0.160460 Oct 04 19:44:42.873604 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3922/7831] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:44:42 2022] GET /compute/v2.1/servers/732ad313-c3f1-4ac3-943e-5aa5d48b36ea => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:44:43.743493 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-b5fb0b3e-2e73-4387-91dd-b44589aadbad req-f50a2f49-ec51-4f87-9afb-66c9e597bf3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "732ad313-c3f1-4ac3-943e-5aa5d48b36ea", "name": "network-vif-plugged", "status": "completed", "tag": "8ae6ff9d-ec09-49b0-a5a9-d6661174fb2d"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:44:43.749873 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=6 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:44:43.755895 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-b5fb0b3e-2e73-4387-91dd-b44589aadbad req-f50a2f49-ec51-4f87-9afb-66c9e597bf3e service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:44:43.760857 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-b5fb0b3e-2e73-4387-91dd-b44589aadbad req-f50a2f49-ec51-4f87-9afb-66c9e597bf3e service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:44:43.760857 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-b5fb0b3e-2e73-4387-91dd-b44589aadbad req-f50a2f49-ec51-4f87-9afb-66c9e597bf3e service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:44:43.768753 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-b5fb0b3e-2e73-4387-91dd-b44589aadbad req-f50a2f49-ec51-4f87-9afb-66c9e597bf3e service nova] Creating event network-vif-plugged:8ae6ff9d-ec09-49b0-a5a9-d6661174fb2d for instance 732ad313-c3f1-4ac3-943e-5aa5d48b36ea on n-h1-850501-14 Oct 04 19:44:43.773882 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-b5fb0b3e-2e73-4387-91dd-b44589aadbad req-f50a2f49-ec51-4f87-9afb-66c9e597bf3e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034380 Oct 04 19:44:43.774716 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3910/7832] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:44:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:44:43.897639 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d6231475-bb1d-479b-987e-cf9e0d50ea05 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:44:43.898347 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d6231475-bb1d-479b-987e-cf9e0d50ea05 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] [instance: 732ad313-c3f1-4ac3-943e-5aa5d48b36ea] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:44:43.904647 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:44:43.907451 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d6231475-bb1d-479b-987e-cf9e0d50ea05 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:44:43.908250 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d6231475-bb1d-479b-987e-cf9e0d50ea05 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:44:43.908784 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d6231475-bb1d-479b-987e-cf9e0d50ea05 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:44:43.909690 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d6231475-bb1d-479b-987e-cf9e0d50ea05 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:44:43.910241 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d6231475-bb1d-479b-987e-cf9e0d50ea05 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:44:43.910681 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d6231475-bb1d-479b-987e-cf9e0d50ea05 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:44:44.042028 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d6231475-bb1d-479b-987e-cf9e0d50ea05 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f47ba234baf476aafa923d18266f4c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7e5bbf1a1a408cb25c117ba070f965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:44:44.050682 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d6231475-bb1d-479b-987e-cf9e0d50ea05 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] 10.222.0.20 "GET /compute/v2.1/servers/732ad313-c3f1-4ac3-943e-5aa5d48b36ea" status: 200 len: 1362 microversion: 2.1 time: 0.157604 Oct 04 19:44:44.051250 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3923/7833] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:44:43 2022] GET /compute/v2.1/servers/732ad313-c3f1-4ac3-943e-5aa5d48b36ea => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:44:45.074437 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2cb55439-d29e-42a0-92e5-fb8d352ed500 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:44:45.075095 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2cb55439-d29e-42a0-92e5-fb8d352ed500 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] [instance: 732ad313-c3f1-4ac3-943e-5aa5d48b36ea] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:44:45.084294 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2cb55439-d29e-42a0-92e5-fb8d352ed500 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:44:45.084810 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2cb55439-d29e-42a0-92e5-fb8d352ed500 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:44:45.085268 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2cb55439-d29e-42a0-92e5-fb8d352ed500 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:44:45.085987 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2cb55439-d29e-42a0-92e5-fb8d352ed500 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:44:45.086552 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2cb55439-d29e-42a0-92e5-fb8d352ed500 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:44:45.087005 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2cb55439-d29e-42a0-92e5-fb8d352ed500 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:44:45.218074 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2cb55439-d29e-42a0-92e5-fb8d352ed500 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f47ba234baf476aafa923d18266f4c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7e5bbf1a1a408cb25c117ba070f965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:44:45.226244 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2cb55439-d29e-42a0-92e5-fb8d352ed500 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] 10.222.0.20 "GET /compute/v2.1/servers/732ad313-c3f1-4ac3-943e-5aa5d48b36ea" status: 200 len: 1554 microversion: 2.1 time: 0.156301 Oct 04 19:44:45.226822 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3911/7834] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:44:45 2022] GET /compute/v2.1/servers/732ad313-c3f1-4ac3-943e-5aa5d48b36ea => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:44:45.248280 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-46e8a3fe-71a8-421a-8e77-39529197f5b6 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:44:45.248921 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-46e8a3fe-71a8-421a-8e77-39529197f5b6 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] [instance: 732ad313-c3f1-4ac3-943e-5aa5d48b36ea] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:44:45.250770 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=8 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:44:45.257406 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-46e8a3fe-71a8-421a-8e77-39529197f5b6 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:44:45.257891 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-46e8a3fe-71a8-421a-8e77-39529197f5b6 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:44:45.258387 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-46e8a3fe-71a8-421a-8e77-39529197f5b6 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:44:45.262099 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-46e8a3fe-71a8-421a-8e77-39529197f5b6 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:44:45.262099 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-46e8a3fe-71a8-421a-8e77-39529197f5b6 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:44:45.262099 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-46e8a3fe-71a8-421a-8e77-39529197f5b6 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:44:45.404290 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-46e8a3fe-71a8-421a-8e77-39529197f5b6 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f47ba234baf476aafa923d18266f4c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7e5bbf1a1a408cb25c117ba070f965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:44:45.412312 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-46e8a3fe-71a8-421a-8e77-39529197f5b6 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] 10.222.0.20 "GET /compute/v2.1/servers/732ad313-c3f1-4ac3-943e-5aa5d48b36ea" status: 200 len: 1554 microversion: 2.1 time: 0.167884 Oct 04 19:44:45.412882 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3924/7835] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:44:45 2022] GET /compute/v2.1/servers/732ad313-c3f1-4ac3-943e-5aa5d48b36ea => generated 1554 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:44:48.691373 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-40a5116b-8872-4511-9f9a-445bfb340b35 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b61dcefa-8f73-4373-9d2c-888571d3d484"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:44:48.693808 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-40a5116b-8872-4511-9f9a-445bfb340b35 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] [instance: 732ad313-c3f1-4ac3-943e-5aa5d48b36ea] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:44:48.700711 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-40a5116b-8872-4511-9f9a-445bfb340b35 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:44:48.701211 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-40a5116b-8872-4511-9f9a-445bfb340b35 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:44:48.701664 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-40a5116b-8872-4511-9f9a-445bfb340b35 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:44:48.702372 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-40a5116b-8872-4511-9f9a-445bfb340b35 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:44:48.702841 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-40a5116b-8872-4511-9f9a-445bfb340b35 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:44:48.703285 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-40a5116b-8872-4511-9f9a-445bfb340b35 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:44:49.377127 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-40a5116b-8872-4511-9f9a-445bfb340b35 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] 10.222.0.20 "POST /compute/v2.1/servers/732ad313-c3f1-4ac3-943e-5aa5d48b36ea/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.689905 Oct 04 19:44:49.378895 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3912/7836] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Oct 4 19:44:48 2022] POST /compute/v2.1/servers/732ad313-c3f1-4ac3-943e-5aa5d48b36ea/os-volume_attachments => generated 194 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:45:01.181020 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-de332509-5019-4efc-a951-fc19438695dd tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:45:01.181812 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-de332509-5019-4efc-a951-fc19438695dd tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] [instance: 732ad313-c3f1-4ac3-943e-5aa5d48b36ea] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:45:01.185533 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:45:01.186260 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=38 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:45:01.189789 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-de332509-5019-4efc-a951-fc19438695dd tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:01.206096 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-de332509-5019-4efc-a951-fc19438695dd tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:01.206096 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-de332509-5019-4efc-a951-fc19438695dd tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:01.206096 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-de332509-5019-4efc-a951-fc19438695dd tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:01.206096 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-de332509-5019-4efc-a951-fc19438695dd tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:01.206096 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-de332509-5019-4efc-a951-fc19438695dd tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:01.273831 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-de332509-5019-4efc-a951-fc19438695dd tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lazy-loading 'services' on Instance uuid 732ad313-c3f1-4ac3-943e-5aa5d48b36ea {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:45:01.641255 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-de332509-5019-4efc-a951-fc19438695dd tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] 10.222.0.20 "DELETE /compute/v2.1/servers/732ad313-c3f1-4ac3-943e-5aa5d48b36ea/os-volume_attachments/b61dcefa-8f73-4373-9d2c-888571d3d484" status: 202 len: 0 microversion: 2.1 time: 0.464620 Oct 04 19:45:01.641870 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3925/7837] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Oct 4 19:45:01 2022] DELETE /compute/v2.1/servers/732ad313-c3f1-4ac3-943e-5aa5d48b36ea/os-volume_attachments/b61dcefa-8f73-4373-9d2c-888571d3d484 => generated 0 bytes in 466 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:45:01.648796 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:45:01.656386 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:45:01.656386 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c6f86c63-b246-4803-b860-7fbd09db3c0d tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:45:01.656634 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c6f86c63-b246-4803-b860-7fbd09db3c0d tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] [instance: 732ad313-c3f1-4ac3-943e-5aa5d48b36ea] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:45:01.663981 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c6f86c63-b246-4803-b860-7fbd09db3c0d tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:01.664512 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c6f86c63-b246-4803-b860-7fbd09db3c0d tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:01.664966 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c6f86c63-b246-4803-b860-7fbd09db3c0d tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:01.665684 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c6f86c63-b246-4803-b860-7fbd09db3c0d tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:01.666156 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c6f86c63-b246-4803-b860-7fbd09db3c0d tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:01.666599 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c6f86c63-b246-4803-b860-7fbd09db3c0d tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:01.696696 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c6f86c63-b246-4803-b860-7fbd09db3c0d tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] 10.222.0.20 "GET /compute/v2.1/servers/732ad313-c3f1-4ac3-943e-5aa5d48b36ea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049943 Oct 04 19:45:01.697276 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3913/7838] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 19:45:01 2022] GET /compute/v2.1/servers/732ad313-c3f1-4ac3-943e-5aa5d48b36ea/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:45:02.711834 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9b0e8183-decc-44e9-bf57-817dce528e9a tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:45:02.714511 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-9b0e8183-decc-44e9-bf57-817dce528e9a tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] [instance: 732ad313-c3f1-4ac3-943e-5aa5d48b36ea] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:45:02.722139 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9b0e8183-decc-44e9-bf57-817dce528e9a tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:02.722902 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9b0e8183-decc-44e9-bf57-817dce528e9a tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:02.723339 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9b0e8183-decc-44e9-bf57-817dce528e9a tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:02.724670 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9b0e8183-decc-44e9-bf57-817dce528e9a tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:02.725162 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9b0e8183-decc-44e9-bf57-817dce528e9a tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:02.725595 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9b0e8183-decc-44e9-bf57-817dce528e9a tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:02.757956 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9b0e8183-decc-44e9-bf57-817dce528e9a tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] 10.222.0.20 "GET /compute/v2.1/servers/732ad313-c3f1-4ac3-943e-5aa5d48b36ea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051822 Oct 04 19:45:02.759095 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3926/7839] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 19:45:02 2022] GET /compute/v2.1/servers/732ad313-c3f1-4ac3-943e-5aa5d48b36ea/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:45:03.771506 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b7072d2a-95fb-47f7-a0e1-6891fd8cb7fa tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:45:03.774011 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b7072d2a-95fb-47f7-a0e1-6891fd8cb7fa tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] [instance: 732ad313-c3f1-4ac3-943e-5aa5d48b36ea] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:45:03.782765 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b7072d2a-95fb-47f7-a0e1-6891fd8cb7fa tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:03.783276 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b7072d2a-95fb-47f7-a0e1-6891fd8cb7fa tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:03.783732 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b7072d2a-95fb-47f7-a0e1-6891fd8cb7fa tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:03.784491 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b7072d2a-95fb-47f7-a0e1-6891fd8cb7fa tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:03.784964 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b7072d2a-95fb-47f7-a0e1-6891fd8cb7fa tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:03.785406 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b7072d2a-95fb-47f7-a0e1-6891fd8cb7fa tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:03.823055 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b7072d2a-95fb-47f7-a0e1-6891fd8cb7fa tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] 10.222.0.20 "GET /compute/v2.1/servers/732ad313-c3f1-4ac3-943e-5aa5d48b36ea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055957 Oct 04 19:45:03.828419 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3914/7840] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 19:45:03 2022] GET /compute/v2.1/servers/732ad313-c3f1-4ac3-943e-5aa5d48b36ea/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:45:04.837008 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0ebdf328-f83a-46a1-b657-23ffd4aa0546 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:45:04.839291 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0ebdf328-f83a-46a1-b657-23ffd4aa0546 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] [instance: 732ad313-c3f1-4ac3-943e-5aa5d48b36ea] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:45:04.846197 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0ebdf328-f83a-46a1-b657-23ffd4aa0546 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:04.846687 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0ebdf328-f83a-46a1-b657-23ffd4aa0546 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:04.847124 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0ebdf328-f83a-46a1-b657-23ffd4aa0546 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:04.848109 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0ebdf328-f83a-46a1-b657-23ffd4aa0546 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:04.849204 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0ebdf328-f83a-46a1-b657-23ffd4aa0546 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:04.850218 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0ebdf328-f83a-46a1-b657-23ffd4aa0546 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:04.882889 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0ebdf328-f83a-46a1-b657-23ffd4aa0546 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] 10.222.0.20 "GET /compute/v2.1/servers/732ad313-c3f1-4ac3-943e-5aa5d48b36ea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050827 Oct 04 19:45:04.883390 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3927/7841] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 19:45:04 2022] GET /compute/v2.1/servers/732ad313-c3f1-4ac3-943e-5aa5d48b36ea/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:45:05.896104 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0f1a6f3c-48dc-41d8-a61f-0963fc98dfdc tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:45:05.899129 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0f1a6f3c-48dc-41d8-a61f-0963fc98dfdc tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] [instance: 732ad313-c3f1-4ac3-943e-5aa5d48b36ea] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:45:05.907992 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0f1a6f3c-48dc-41d8-a61f-0963fc98dfdc tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:05.908541 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0f1a6f3c-48dc-41d8-a61f-0963fc98dfdc tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:05.908997 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0f1a6f3c-48dc-41d8-a61f-0963fc98dfdc tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:05.909717 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0f1a6f3c-48dc-41d8-a61f-0963fc98dfdc tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:05.910267 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0f1a6f3c-48dc-41d8-a61f-0963fc98dfdc tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:05.910709 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0f1a6f3c-48dc-41d8-a61f-0963fc98dfdc tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:05.943691 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0f1a6f3c-48dc-41d8-a61f-0963fc98dfdc tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] 10.222.0.20 "GET /compute/v2.1/servers/732ad313-c3f1-4ac3-943e-5aa5d48b36ea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052344 Oct 04 19:45:05.944551 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3915/7842] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 19:45:05 2022] GET /compute/v2.1/servers/732ad313-c3f1-4ac3-943e-5aa5d48b36ea/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:45:06.956231 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-50b7e7b2-d308-4e3c-b030-95b797a104e6 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:45:06.958977 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-50b7e7b2-d308-4e3c-b030-95b797a104e6 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] [instance: 732ad313-c3f1-4ac3-943e-5aa5d48b36ea] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:45:06.965795 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-50b7e7b2-d308-4e3c-b030-95b797a104e6 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:06.966287 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-50b7e7b2-d308-4e3c-b030-95b797a104e6 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:06.966732 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-50b7e7b2-d308-4e3c-b030-95b797a104e6 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:06.967699 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-50b7e7b2-d308-4e3c-b030-95b797a104e6 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:06.968193 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-50b7e7b2-d308-4e3c-b030-95b797a104e6 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:06.968626 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-50b7e7b2-d308-4e3c-b030-95b797a104e6 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:07.000613 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-50b7e7b2-d308-4e3c-b030-95b797a104e6 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] 10.222.0.20 "GET /compute/v2.1/servers/732ad313-c3f1-4ac3-943e-5aa5d48b36ea/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048444 Oct 04 19:45:07.001171 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3928/7843] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 19:45:06 2022] GET /compute/v2.1/servers/732ad313-c3f1-4ac3-943e-5aa5d48b36ea/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 19:45:07.011832 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-624c8a5d-bcf6-4b37-bb5d-1ca5f9577ee8 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:45:07.012376 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-624c8a5d-bcf6-4b37-bb5d-1ca5f9577ee8 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] [instance: 732ad313-c3f1-4ac3-943e-5aa5d48b36ea] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:45:07.019201 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-624c8a5d-bcf6-4b37-bb5d-1ca5f9577ee8 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:07.019688 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-624c8a5d-bcf6-4b37-bb5d-1ca5f9577ee8 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:07.020161 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-624c8a5d-bcf6-4b37-bb5d-1ca5f9577ee8 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:07.021517 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-624c8a5d-bcf6-4b37-bb5d-1ca5f9577ee8 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:07.021982 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-624c8a5d-bcf6-4b37-bb5d-1ca5f9577ee8 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:07.022417 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-624c8a5d-bcf6-4b37-bb5d-1ca5f9577ee8 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:07.187379 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-624c8a5d-bcf6-4b37-bb5d-1ca5f9577ee8 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] HTTP exception thrown: Instance 732ad313-c3f1-4ac3-943e-5aa5d48b36ea is not attached to volume b61dcefa-8f73-4373-9d2c-888571d3d484 Oct 04 19:45:07.187379 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-624c8a5d-bcf6-4b37-bb5d-1ca5f9577ee8 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Request method failure captured: Oct 04 19:45:07.187379 n-d-850501-14 devstack@n-api.service[123002]: request: DELETE /compute/v2.1/servers/732ad313-c3f1-4ac3-943e-5aa5d48b36ea/os-volume_attachments/b61dcefa-8f73-4373-9d2c-888571d3d484 HTTP/1.1 Oct 04 19:45:07.187379 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 19:45:07.187379 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 19:45:07.187379 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 19:45:07.187379 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 19:45:07.187379 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 19:45:07.187379 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 19:45:07.187379 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 19:45:07.187379 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 19:45:07.187379 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPI0ZjIuZNmctjk_257U0oVHkHOn25x6hSJOyoYjlQ76bCmmbr71JmNxFoTaVYixGauvA8TRbKl_h7ailGynxtR0Nyce9i_PS4mg4c1Z0OwTxz01XgWOmkYa8cS9xc0qZJdaaHxuUhln5SUFHHFQVbrpPHAVk62PKDA5EUBmyHTTJZWY Oct 04 19:45:07.187379 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 19:45:07.187379 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 19:45:07.187379 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 19:45:07.187379 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 19:45:07.187379 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 19:45:07.187379 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 19:45:07.187379 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 9e7e5bbf1a1a408cb25c117ba070f965 Oct 04 19:45:07.187379 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1899659525 Oct 04 19:45:07.187379 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 19:45:07.187379 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 19:45:07.187379 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9e7e5bbf1a1a408cb25c117ba070f965"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9e7e5bbf1a1a408cb25c117ba070f965", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9e7e5bbf1a1a408cb25c117ba070f965"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9e7e5bbf1a1a408cb25c117ba070f965"}]}] Oct 04 19:45:07.187379 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-TestEncryptedCinderVolumes-1899659525 Oct 04 19:45:07.187379 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 9e7e5bbf1a1a408cb25c117ba070f965 Oct 04 19:45:07.187379 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1899659525 Oct 04 19:45:07.187379 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-TestEncryptedCinderVolumes-1899659525-project Oct 04 19:45:07.187379 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 19:45:07.187379 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 19:45:07.187379 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 4f47ba234baf476aafa923d18266f4c8 Oct 04 19:45:07.187379 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-TestEncryptedCinderVolumes-1899659525-project Oct 04 19:45:07.187379 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 19:45:07.187379 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 732ad313-c3f1-4ac3-943e-5aa5d48b36ea is not attached to volume b61dcefa-8f73-4373-9d2c-888571d3d484 Oct 04 19:45:07.187379 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'server_id': '732ad313-c3f1-4ac3-943e-5aa5d48b36ea', 'id': 'b61dcefa-8f73-4373-9d2c-888571d3d484'} Oct 04 19:45:07.187379 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:45:07.187379 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:45:07.187379 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 04 19:45:07.187379 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 04 19:45:07.187379 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 19:45:07.187379 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 19:45:07.187379 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 04 19:45:07.187379 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 04 19:45:07.187379 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id b61dcefa-8f73-4373-9d2c-888571d3d484. Oct 04 19:45:07.187379 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:45:07.187379 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:45:07.187379 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:45:07.187379 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:45:07.187379 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:45:07.187379 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:45:07.187379 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:45:07.187379 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:45:07.187379 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:45:07.187379 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:45:07.187379 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 04 19:45:07.187379 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 19:45:07.187379 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 732ad313-c3f1-4ac3-943e-5aa5d48b36ea is not attached to volume b61dcefa-8f73-4373-9d2c-888571d3d484 Oct 04 19:45:07.187379 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:45:07.187379 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:45:07.187379 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:45:07.192940 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:45:07.192940 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:45:07.192940 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:45:07.192940 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:45:07.192940 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:45:07.192940 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 732ad313-c3f1-4ac3-943e-5aa5d48b36ea is not attached to volume b61dcefa-8f73-4373-9d2c-888571d3d484 Oct 04 19:45:07.192940 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:45:07.192940 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-624c8a5d-bcf6-4b37-bb5d-1ca5f9577ee8 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Returning 404 to user: Instance 732ad313-c3f1-4ac3-943e-5aa5d48b36ea is not attached to volume b61dcefa-8f73-4373-9d2c-888571d3d484 {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:45:07.192940 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-624c8a5d-bcf6-4b37-bb5d-1ca5f9577ee8 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] 10.222.0.20 "DELETE /compute/v2.1/servers/732ad313-c3f1-4ac3-943e-5aa5d48b36ea/os-volume_attachments/b61dcefa-8f73-4373-9d2c-888571d3d484" status: 404 len: 154 microversion: 2.1 time: 0.114389 Oct 04 19:45:07.192940 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3916/7844] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Oct 4 19:45:07 2022] DELETE /compute/v2.1/servers/732ad313-c3f1-4ac3-943e-5aa5d48b36ea/os-volume_attachments/b61dcefa-8f73-4373-9d2c-888571d3d484 => generated 154 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:45:10.776672 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e7aa7755-23a4-47db-a873-065669ce0d9b tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:45:10.777215 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e7aa7755-23a4-47db-a873-065669ce0d9b tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] [instance: 732ad313-c3f1-4ac3-943e-5aa5d48b36ea] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:45:10.779752 n-d-850501-14 devstack@n-api.service[123001]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:45:10.779903 n-d-850501-14 devstack@n-api.service[123001]: Tue Oct 4 19:45:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/732ad313-c3f1-4ac3-943e-5aa5d48b36ea (ip 10.222.0.20) !!! Oct 04 19:45:10.787776 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e7aa7755-23a4-47db-a873-065669ce0d9b tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:10.788308 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e7aa7755-23a4-47db-a873-065669ce0d9b tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:10.788759 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e7aa7755-23a4-47db-a873-065669ce0d9b tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:10.789479 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e7aa7755-23a4-47db-a873-065669ce0d9b tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:10.789936 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e7aa7755-23a4-47db-a873-065669ce0d9b tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:10.790372 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e7aa7755-23a4-47db-a873-065669ce0d9b tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:10.817402 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e7aa7755-23a4-47db-a873-065669ce0d9b tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] [instance: 732ad313-c3f1-4ac3-943e-5aa5d48b36ea] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:45:11.163975 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e7aa7755-23a4-47db-a873-065669ce0d9b tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] 10.222.0.20 "DELETE /compute/v2.1/servers/732ad313-c3f1-4ac3-943e-5aa5d48b36ea" status: 204 len: 0 microversion: 2.1 time: 0.390949 Oct 04 19:45:11.164602 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3929/7845] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 19:45:10 2022] DELETE /compute/v2.1/servers/732ad313-c3f1-4ac3-943e-5aa5d48b36ea => generated 0 bytes in 392 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:45:11.173042 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f13e858b-b792-42fd-bd12-605607111222 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:45:11.173681 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f13e858b-b792-42fd-bd12-605607111222 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] [instance: 732ad313-c3f1-4ac3-943e-5aa5d48b36ea] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:45:11.182277 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f13e858b-b792-42fd-bd12-605607111222 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:11.182808 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f13e858b-b792-42fd-bd12-605607111222 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:11.183257 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f13e858b-b792-42fd-bd12-605607111222 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:11.184002 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f13e858b-b792-42fd-bd12-605607111222 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:11.184478 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f13e858b-b792-42fd-bd12-605607111222 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:11.184926 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f13e858b-b792-42fd-bd12-605607111222 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:11.322118 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f13e858b-b792-42fd-bd12-605607111222 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f47ba234baf476aafa923d18266f4c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7e5bbf1a1a408cb25c117ba070f965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:45:11.330073 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f13e858b-b792-42fd-bd12-605607111222 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] 10.222.0.20 "GET /compute/v2.1/servers/732ad313-c3f1-4ac3-943e-5aa5d48b36ea" status: 200 len: 1560 microversion: 2.1 time: 0.160979 Oct 04 19:45:11.330654 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3917/7846] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:45:11 2022] GET /compute/v2.1/servers/732ad313-c3f1-4ac3-943e-5aa5d48b36ea => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:45:12.355018 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6bd50c35-f142-4220-8898-c45b61215ea2 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:45:12.355739 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6bd50c35-f142-4220-8898-c45b61215ea2 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] [instance: 732ad313-c3f1-4ac3-943e-5aa5d48b36ea] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:45:12.362782 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6bd50c35-f142-4220-8898-c45b61215ea2 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:12.363270 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6bd50c35-f142-4220-8898-c45b61215ea2 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:12.363713 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6bd50c35-f142-4220-8898-c45b61215ea2 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:12.364466 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6bd50c35-f142-4220-8898-c45b61215ea2 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:12.365270 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6bd50c35-f142-4220-8898-c45b61215ea2 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:12.366028 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6bd50c35-f142-4220-8898-c45b61215ea2 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:12.502810 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6bd50c35-f142-4220-8898-c45b61215ea2 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f47ba234baf476aafa923d18266f4c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7e5bbf1a1a408cb25c117ba070f965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:45:12.510806 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6bd50c35-f142-4220-8898-c45b61215ea2 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] 10.222.0.20 "GET /compute/v2.1/servers/732ad313-c3f1-4ac3-943e-5aa5d48b36ea" status: 200 len: 1560 microversion: 2.1 time: 0.160125 Oct 04 19:45:12.511390 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3930/7847] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:45:12 2022] GET /compute/v2.1/servers/732ad313-c3f1-4ac3-943e-5aa5d48b36ea => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:45:13.302394 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-31392810-7bb2-45e7-b82c-2a8a875c83c4 req-e4c24133-754a-43b1-88da-ee1c2324b948 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "732ad313-c3f1-4ac3-943e-5aa5d48b36ea", "name": "network-vif-deleted", "tag": "8ae6ff9d-ec09-49b0-a5a9-d6661174fb2d"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:45:13.315164 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-31392810-7bb2-45e7-b82c-2a8a875c83c4 req-e4c24133-754a-43b1-88da-ee1c2324b948 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:13.315549 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-31392810-7bb2-45e7-b82c-2a8a875c83c4 req-e4c24133-754a-43b1-88da-ee1c2324b948 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:13.315996 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-31392810-7bb2-45e7-b82c-2a8a875c83c4 req-e4c24133-754a-43b1-88da-ee1c2324b948 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:13.328358 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-31392810-7bb2-45e7-b82c-2a8a875c83c4 req-e4c24133-754a-43b1-88da-ee1c2324b948 service nova] Creating event network-vif-deleted:8ae6ff9d-ec09-49b0-a5a9-d6661174fb2d for instance 732ad313-c3f1-4ac3-943e-5aa5d48b36ea on n-h1-850501-14 Oct 04 19:45:13.334235 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-31392810-7bb2-45e7-b82c-2a8a875c83c4 req-e4c24133-754a-43b1-88da-ee1c2324b948 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035562 Oct 04 19:45:13.334973 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3918/7848] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:45:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:45:13.534873 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5fcb72f1-b6d4-4660-a6af-ceff56867901 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:45:13.535469 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5fcb72f1-b6d4-4660-a6af-ceff56867901 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] [instance: 732ad313-c3f1-4ac3-943e-5aa5d48b36ea] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:45:13.542306 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5fcb72f1-b6d4-4660-a6af-ceff56867901 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:13.542796 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5fcb72f1-b6d4-4660-a6af-ceff56867901 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:13.543241 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5fcb72f1-b6d4-4660-a6af-ceff56867901 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:13.543944 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5fcb72f1-b6d4-4660-a6af-ceff56867901 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:13.544440 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5fcb72f1-b6d4-4660-a6af-ceff56867901 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:13.544859 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5fcb72f1-b6d4-4660-a6af-ceff56867901 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:13.618249 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5fcb72f1-b6d4-4660-a6af-ceff56867901 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f47ba234baf476aafa923d18266f4c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7e5bbf1a1a408cb25c117ba070f965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:45:13.626638 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5fcb72f1-b6d4-4660-a6af-ceff56867901 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] 10.222.0.20 "GET /compute/v2.1/servers/732ad313-c3f1-4ac3-943e-5aa5d48b36ea" status: 200 len: 1347 microversion: 2.1 time: 0.095842 Oct 04 19:45:13.633079 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3931/7849] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:45:13 2022] GET /compute/v2.1/servers/732ad313-c3f1-4ac3-943e-5aa5d48b36ea => generated 1347 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:45:14.652800 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b7ccb8d0-33e0-4758-aa1d-83d593eb0bcd tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:45:14.653638 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b7ccb8d0-33e0-4758-aa1d-83d593eb0bcd tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] [instance: 732ad313-c3f1-4ac3-943e-5aa5d48b36ea] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:45:14.660001 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b7ccb8d0-33e0-4758-aa1d-83d593eb0bcd tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:14.660533 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b7ccb8d0-33e0-4758-aa1d-83d593eb0bcd tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:14.660988 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b7ccb8d0-33e0-4758-aa1d-83d593eb0bcd tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:14.662415 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b7ccb8d0-33e0-4758-aa1d-83d593eb0bcd tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:14.662909 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b7ccb8d0-33e0-4758-aa1d-83d593eb0bcd tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:14.663381 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b7ccb8d0-33e0-4758-aa1d-83d593eb0bcd tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:14.676722 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-b7ccb8d0-33e0-4758-aa1d-83d593eb0bcd tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] HTTP exception thrown: Instance 732ad313-c3f1-4ac3-943e-5aa5d48b36ea could not be found. Oct 04 19:45:14.678507 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b7ccb8d0-33e0-4758-aa1d-83d593eb0bcd tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Request method failure captured: Oct 04 19:45:14.678507 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/732ad313-c3f1-4ac3-943e-5aa5d48b36ea HTTP/1.1 Oct 04 19:45:14.678507 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 19:45:14.678507 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 19:45:14.678507 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 19:45:14.678507 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 19:45:14.678507 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 19:45:14.678507 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 19:45:14.678507 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 19:45:14.678507 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 19:45:14.678507 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPI0ZjIuZNmctjk_257U0oVHkHOn25x6hSJOyoYjlQ76bCmmbr71JmNxFoTaVYixGauvA8TRbKl_h7ailGynxtR0Nyce9i_PS4mg4c1Z0OwTxz01XgWOmkYa8cS9xc0qZJdaaHxuUhln5SUFHHFQVbrpPHAVk62PKDA5EUBmyHTTJZWY Oct 04 19:45:14.678507 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 19:45:14.678507 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 19:45:14.678507 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 19:45:14.678507 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 19:45:14.678507 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 19:45:14.678507 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 19:45:14.678507 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 9e7e5bbf1a1a408cb25c117ba070f965 Oct 04 19:45:14.678507 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1899659525 Oct 04 19:45:14.678507 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 19:45:14.678507 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 19:45:14.678507 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9e7e5bbf1a1a408cb25c117ba070f965"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9e7e5bbf1a1a408cb25c117ba070f965", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9e7e5bbf1a1a408cb25c117ba070f965"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9e7e5bbf1a1a408cb25c117ba070f965"}]}] Oct 04 19:45:14.678507 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-TestEncryptedCinderVolumes-1899659525 Oct 04 19:45:14.678507 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 9e7e5bbf1a1a408cb25c117ba070f965 Oct 04 19:45:14.678507 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1899659525 Oct 04 19:45:14.678507 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-TestEncryptedCinderVolumes-1899659525-project Oct 04 19:45:14.678507 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 19:45:14.678507 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 19:45:14.678507 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 4f47ba234baf476aafa923d18266f4c8 Oct 04 19:45:14.678507 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-TestEncryptedCinderVolumes-1899659525-project Oct 04 19:45:14.678507 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 19:45:14.678507 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 732ad313-c3f1-4ac3-943e-5aa5d48b36ea could not be found. Oct 04 19:45:14.678507 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '732ad313-c3f1-4ac3-943e-5aa5d48b36ea'} Oct 04 19:45:14.678507 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:45:14.678507 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:45:14.678507 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:45:14.678507 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:45:14.678507 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:45:14.678507 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:45:14.678507 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:45:14.678507 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:45:14.678507 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:45:14.678507 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:45:14.678507 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 732ad313-c3f1-4ac3-943e-5aa5d48b36ea could not be found. Oct 04 19:45:14.678507 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:45:14.678507 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:45:14.678507 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:45:14.678507 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:45:14.678507 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:45:14.678507 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:45:14.678507 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:45:14.678507 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:45:14.678507 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:45:14.678507 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:45:14.678507 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:45:14.678507 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:45:14.678507 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:45:14.678507 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:45:14.678507 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:45:14.678507 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:45:14.678507 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 732ad313-c3f1-4ac3-943e-5aa5d48b36ea could not be found. Oct 04 19:45:14.678507 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:45:14.678507 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:45:14.682650 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:45:14.682650 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:45:14.682650 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:45:14.682650 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:45:14.682650 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:45:14.682650 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:45:14.682650 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 732ad313-c3f1-4ac3-943e-5aa5d48b36ea could not be found. Oct 04 19:45:14.682650 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:45:14.682650 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b7ccb8d0-33e0-4758-aa1d-83d593eb0bcd tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Returning 404 to user: Instance 732ad313-c3f1-4ac3-943e-5aa5d48b36ea could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:45:14.682650 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b7ccb8d0-33e0-4758-aa1d-83d593eb0bcd tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] 10.222.0.20 "GET /compute/v2.1/servers/732ad313-c3f1-4ac3-943e-5aa5d48b36ea" status: 404 len: 111 microversion: 2.1 time: 0.032430 Oct 04 19:45:14.682650 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3919/7850] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:45:14 2022] GET /compute/v2.1/servers/732ad313-c3f1-4ac3-943e-5aa5d48b36ea => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 19:45:14.689075 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-282d02fb-3543-4567-b9d8-e1dc527522bb tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Calling method '.version_select at 0x7fe25831f1f0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:45:14.780817 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-282d02fb-3543-4567-b9d8-e1dc527522bb tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-748648829" status: 202 len: 0 microversion: 2.1 time: 0.095630 Oct 04 19:45:14.781447 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3932/7851] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Oct 4 19:45:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-748648829 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:45:14.800197 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ba3b790a-60f6-4378-a1c1-48bba24e1ed6 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Action: 'create', calling method: .version_select at 0x7fe259588820>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1666568945", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBmstFr5SZ/idWKNHSZXwC8JSu7JumEFkjJAZHex4MKzBO07Or0HQpMUkfBMksPotlwoXPak1IDJY6rCSv0NHiVY1A2Ksc92VyPfBU7T/KlKvZDISLDQK7hTFbWxcrT52A=="}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:45:14.815925 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-ba3b790a-60f6-4378-a1c1-48bba24e1ed6 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Getting quotas for project 9e7e5bbf1a1a408cb25c117ba070f965. Resources: {'key_pairs'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:45:14.822513 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-ba3b790a-60f6-4378-a1c1-48bba24e1ed6 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Getting quotas for user 4f47ba234baf476aafa923d18266f4c8 and project 9e7e5bbf1a1a408cb25c117ba070f965. Resources: {'key_pairs'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:45:14.906871 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ba3b790a-60f6-4378-a1c1-48bba24e1ed6 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.110557 Oct 04 19:45:14.907405 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3920/7852] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Oct 4 19:45:14 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:45:14.957766 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c97ae929-43b2-42fb-9587-8f790e2dbf52 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1136399347", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1666568945", "networks": [{"uuid": "f42e273e-d5f1-48ac-b887-f81bd956f13b"}]}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:45:15.011893 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.neutron [None req-c97ae929-43b2-42fb-9587-8f790e2dbf52 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] validate_networks() for [('f42e273e-d5f1-48ac-b887-f81bd956f13b', None, None, None, None, None)] {{(pid=123001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:45:15.379813 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-c97ae929-43b2-42fb-9587-8f790e2dbf52 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:45:15.390752 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-c97ae929-43b2-42fb-9587-8f790e2dbf52 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:45:15.390752 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-c97ae929-43b2-42fb-9587-8f790e2dbf52 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:45:15.390752 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-c97ae929-43b2-42fb-9587-8f790e2dbf52 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:45:15.390752 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-c97ae929-43b2-42fb-9587-8f790e2dbf52 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:45:15.391181 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c97ae929-43b2-42fb-9587-8f790e2dbf52 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:15.391572 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c97ae929-43b2-42fb-9587-8f790e2dbf52 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:15.392008 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c97ae929-43b2-42fb-9587-8f790e2dbf52 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:15.392778 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c97ae929-43b2-42fb-9587-8f790e2dbf52 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:15.393236 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c97ae929-43b2-42fb-9587-8f790e2dbf52 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:15.393667 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c97ae929-43b2-42fb-9587-8f790e2dbf52 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:15.411823 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-c97ae929-43b2-42fb-9587-8f790e2dbf52 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Getting quotas for project 9e7e5bbf1a1a408cb25c117ba070f965. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:45:15.416695 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-c97ae929-43b2-42fb-9587-8f790e2dbf52 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Getting quotas for user 4f47ba234baf476aafa923d18266f4c8 and project 9e7e5bbf1a1a408cb25c117ba070f965. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:45:15.429777 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c97ae929-43b2-42fb-9587-8f790e2dbf52 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Going to run 1 instances... {{(pid=123001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:45:15.432132 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c97ae929-43b2-42fb-9587-8f790e2dbf52 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] [instance: a1398009-bef2-46e7-9323-7a8a29f2ffcb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:45:15.552217 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c97ae929-43b2-42fb-9587-8f790e2dbf52 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.598117 Oct 04 19:45:15.552692 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3933/7853] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 19:45:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 599 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:45:15.564152 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-548bb658-0dc3-4aa9-9181-24de8f309089 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:45:15.564816 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-548bb658-0dc3-4aa9-9181-24de8f309089 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] [instance: a1398009-bef2-46e7-9323-7a8a29f2ffcb] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:45:15.622418 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-548bb658-0dc3-4aa9-9181-24de8f309089 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f47ba234baf476aafa923d18266f4c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7e5bbf1a1a408cb25c117ba070f965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:45:15.629563 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-548bb658-0dc3-4aa9-9181-24de8f309089 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] 10.222.0.20 "GET /compute/v2.1/servers/a1398009-bef2-46e7-9323-7a8a29f2ffcb" status: 200 len: 1263 microversion: 2.1 time: 0.069537 Oct 04 19:45:15.630645 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3921/7854] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:45:15 2022] GET /compute/v2.1/servers/a1398009-bef2-46e7-9323-7a8a29f2ffcb => generated 1263 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:45:16.654941 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8f46e455-e81c-4897-80b0-c85f312d2ad9 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:45:16.655616 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8f46e455-e81c-4897-80b0-c85f312d2ad9 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] [instance: a1398009-bef2-46e7-9323-7a8a29f2ffcb] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:45:16.663358 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8f46e455-e81c-4897-80b0-c85f312d2ad9 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:16.669739 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8f46e455-e81c-4897-80b0-c85f312d2ad9 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:16.669739 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8f46e455-e81c-4897-80b0-c85f312d2ad9 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:16.669739 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8f46e455-e81c-4897-80b0-c85f312d2ad9 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:16.669739 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8f46e455-e81c-4897-80b0-c85f312d2ad9 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:16.669739 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8f46e455-e81c-4897-80b0-c85f312d2ad9 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:16.736136 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8f46e455-e81c-4897-80b0-c85f312d2ad9 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f47ba234baf476aafa923d18266f4c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7e5bbf1a1a408cb25c117ba070f965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:45:16.746078 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8f46e455-e81c-4897-80b0-c85f312d2ad9 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] 10.222.0.20 "GET /compute/v2.1/servers/a1398009-bef2-46e7-9323-7a8a29f2ffcb" status: 200 len: 1267 microversion: 2.1 time: 0.095968 Oct 04 19:45:16.746845 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3934/7855] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:45:16 2022] GET /compute/v2.1/servers/a1398009-bef2-46e7-9323-7a8a29f2ffcb => generated 1267 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:45:17.779442 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-870ab10e-62e6-4591-8a9b-cce4d1e38486 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:45:17.780136 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-870ab10e-62e6-4591-8a9b-cce4d1e38486 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] [instance: a1398009-bef2-46e7-9323-7a8a29f2ffcb] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:45:17.789536 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-870ab10e-62e6-4591-8a9b-cce4d1e38486 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:17.790035 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-870ab10e-62e6-4591-8a9b-cce4d1e38486 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:17.790492 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-870ab10e-62e6-4591-8a9b-cce4d1e38486 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:17.791205 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-870ab10e-62e6-4591-8a9b-cce4d1e38486 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:17.791678 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-870ab10e-62e6-4591-8a9b-cce4d1e38486 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:17.792156 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-870ab10e-62e6-4591-8a9b-cce4d1e38486 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:17.858339 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-870ab10e-62e6-4591-8a9b-cce4d1e38486 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f47ba234baf476aafa923d18266f4c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7e5bbf1a1a408cb25c117ba070f965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:45:17.866616 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-870ab10e-62e6-4591-8a9b-cce4d1e38486 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] 10.222.0.20 "GET /compute/v2.1/servers/a1398009-bef2-46e7-9323-7a8a29f2ffcb" status: 200 len: 1315 microversion: 2.1 time: 0.091083 Oct 04 19:45:17.869597 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3922/7856] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:45:17 2022] GET /compute/v2.1/servers/a1398009-bef2-46e7-9323-7a8a29f2ffcb => generated 1315 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:45:18.891398 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2dfac864-0177-4c18-895a-eb248edc0a87 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:45:18.892011 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2dfac864-0177-4c18-895a-eb248edc0a87 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] [instance: a1398009-bef2-46e7-9323-7a8a29f2ffcb] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:45:18.905701 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2dfac864-0177-4c18-895a-eb248edc0a87 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:18.906228 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2dfac864-0177-4c18-895a-eb248edc0a87 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:18.906667 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2dfac864-0177-4c18-895a-eb248edc0a87 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:18.908761 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2dfac864-0177-4c18-895a-eb248edc0a87 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:18.908761 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2dfac864-0177-4c18-895a-eb248edc0a87 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:18.908761 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2dfac864-0177-4c18-895a-eb248edc0a87 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:19.493927 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-2dfac864-0177-4c18-895a-eb248edc0a87 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f47ba234baf476aafa923d18266f4c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7e5bbf1a1a408cb25c117ba070f965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:45:19.501671 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2dfac864-0177-4c18-895a-eb248edc0a87 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] 10.222.0.20 "GET /compute/v2.1/servers/a1398009-bef2-46e7-9323-7a8a29f2ffcb" status: 200 len: 1363 microversion: 2.1 time: 0.615153 Oct 04 19:45:19.502251 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3935/7857] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:45:18 2022] GET /compute/v2.1/servers/a1398009-bef2-46e7-9323-7a8a29f2ffcb => generated 1363 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:45:20.215055 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-a8a4dfcd-6e04-433b-ae46-cedf15d84ed7 req-91a1927a-16a2-4ef5-a78d-3eae2ecba388 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1398009-bef2-46e7-9323-7a8a29f2ffcb", "tag": "7520676c-b88b-4627-93ea-65f593418c4b"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:45:20.225955 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-a8a4dfcd-6e04-433b-ae46-cedf15d84ed7 req-91a1927a-16a2-4ef5-a78d-3eae2ecba388 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:20.226480 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-a8a4dfcd-6e04-433b-ae46-cedf15d84ed7 req-91a1927a-16a2-4ef5-a78d-3eae2ecba388 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:20.226925 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-a8a4dfcd-6e04-433b-ae46-cedf15d84ed7 req-91a1927a-16a2-4ef5-a78d-3eae2ecba388 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:20.238042 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-a8a4dfcd-6e04-433b-ae46-cedf15d84ed7 req-91a1927a-16a2-4ef5-a78d-3eae2ecba388 service nova] Creating event network-changed:7520676c-b88b-4627-93ea-65f593418c4b for instance a1398009-bef2-46e7-9323-7a8a29f2ffcb on n-h1-850501-14 Oct 04 19:45:20.243289 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-a8a4dfcd-6e04-433b-ae46-cedf15d84ed7 req-91a1927a-16a2-4ef5-a78d-3eae2ecba388 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032300 Oct 04 19:45:20.243899 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3923/7858] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:45:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:45:20.525896 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d6d89a35-4783-426c-8832-c142cf4141a2 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:45:20.526509 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d6d89a35-4783-426c-8832-c142cf4141a2 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] [instance: a1398009-bef2-46e7-9323-7a8a29f2ffcb] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:45:20.533563 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d6d89a35-4783-426c-8832-c142cf4141a2 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:20.534045 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d6d89a35-4783-426c-8832-c142cf4141a2 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:20.534481 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d6d89a35-4783-426c-8832-c142cf4141a2 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:20.535171 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d6d89a35-4783-426c-8832-c142cf4141a2 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:20.535622 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d6d89a35-4783-426c-8832-c142cf4141a2 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:20.536099 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d6d89a35-4783-426c-8832-c142cf4141a2 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:20.755088 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d6d89a35-4783-426c-8832-c142cf4141a2 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f47ba234baf476aafa923d18266f4c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7e5bbf1a1a408cb25c117ba070f965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:45:20.757046 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d6d89a35-4783-426c-8832-c142cf4141a2 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] 10.222.0.20 "GET /compute/v2.1/servers/a1398009-bef2-46e7-9323-7a8a29f2ffcb" status: 200 len: 1363 microversion: 2.1 time: 0.234819 Oct 04 19:45:20.757645 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3936/7859] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:45:20 2022] GET /compute/v2.1/servers/a1398009-bef2-46e7-9323-7a8a29f2ffcb => generated 1363 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:45:21.782262 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-319f5c45-42d7-4707-8821-ef554b92b35d tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:45:21.782984 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-319f5c45-42d7-4707-8821-ef554b92b35d tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] [instance: a1398009-bef2-46e7-9323-7a8a29f2ffcb] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:45:21.789720 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-319f5c45-42d7-4707-8821-ef554b92b35d tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:21.790227 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-319f5c45-42d7-4707-8821-ef554b92b35d tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:21.790682 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-319f5c45-42d7-4707-8821-ef554b92b35d tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:21.791382 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-319f5c45-42d7-4707-8821-ef554b92b35d tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:21.791851 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-319f5c45-42d7-4707-8821-ef554b92b35d tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:21.792634 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-319f5c45-42d7-4707-8821-ef554b92b35d tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:21.929415 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-319f5c45-42d7-4707-8821-ef554b92b35d tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f47ba234baf476aafa923d18266f4c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7e5bbf1a1a408cb25c117ba070f965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:45:21.937076 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-319f5c45-42d7-4707-8821-ef554b92b35d tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] 10.222.0.20 "GET /compute/v2.1/servers/a1398009-bef2-46e7-9323-7a8a29f2ffcb" status: 200 len: 1363 microversion: 2.1 time: 0.159981 Oct 04 19:45:21.937668 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3924/7860] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:45:21 2022] GET /compute/v2.1/servers/a1398009-bef2-46e7-9323-7a8a29f2ffcb => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:45:22.960550 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c45a9962-d0b1-45c4-93c1-829529d367f7 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:45:22.961164 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c45a9962-d0b1-45c4-93c1-829529d367f7 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] [instance: a1398009-bef2-46e7-9323-7a8a29f2ffcb] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:45:22.968243 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c45a9962-d0b1-45c4-93c1-829529d367f7 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:22.968736 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c45a9962-d0b1-45c4-93c1-829529d367f7 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:22.969207 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c45a9962-d0b1-45c4-93c1-829529d367f7 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:22.969963 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c45a9962-d0b1-45c4-93c1-829529d367f7 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:22.970423 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c45a9962-d0b1-45c4-93c1-829529d367f7 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:22.970853 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c45a9962-d0b1-45c4-93c1-829529d367f7 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:23.103121 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c45a9962-d0b1-45c4-93c1-829529d367f7 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f47ba234baf476aafa923d18266f4c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7e5bbf1a1a408cb25c117ba070f965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:45:23.110910 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c45a9962-d0b1-45c4-93c1-829529d367f7 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] 10.222.0.20 "GET /compute/v2.1/servers/a1398009-bef2-46e7-9323-7a8a29f2ffcb" status: 200 len: 1363 microversion: 2.1 time: 0.154297 Oct 04 19:45:23.111490 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3937/7861] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:45:22 2022] GET /compute/v2.1/servers/a1398009-bef2-46e7-9323-7a8a29f2ffcb => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:45:24.134356 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b63cbbe2-8705-4a14-8d83-d6d18fa1a089 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:45:24.134996 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b63cbbe2-8705-4a14-8d83-d6d18fa1a089 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] [instance: a1398009-bef2-46e7-9323-7a8a29f2ffcb] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:45:24.141879 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b63cbbe2-8705-4a14-8d83-d6d18fa1a089 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:24.142387 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b63cbbe2-8705-4a14-8d83-d6d18fa1a089 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:24.142840 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b63cbbe2-8705-4a14-8d83-d6d18fa1a089 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:24.143701 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b63cbbe2-8705-4a14-8d83-d6d18fa1a089 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:24.144200 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b63cbbe2-8705-4a14-8d83-d6d18fa1a089 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:24.144650 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b63cbbe2-8705-4a14-8d83-d6d18fa1a089 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:24.282931 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b63cbbe2-8705-4a14-8d83-d6d18fa1a089 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f47ba234baf476aafa923d18266f4c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7e5bbf1a1a408cb25c117ba070f965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:45:24.291130 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b63cbbe2-8705-4a14-8d83-d6d18fa1a089 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] 10.222.0.20 "GET /compute/v2.1/servers/a1398009-bef2-46e7-9323-7a8a29f2ffcb" status: 200 len: 1363 microversion: 2.1 time: 0.161883 Oct 04 19:45:24.291715 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3925/7862] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:45:24 2022] GET /compute/v2.1/servers/a1398009-bef2-46e7-9323-7a8a29f2ffcb => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:45:25.315023 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3520277c-854a-4b70-95c4-0654d3100eb1 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:45:25.315561 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3520277c-854a-4b70-95c4-0654d3100eb1 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] [instance: a1398009-bef2-46e7-9323-7a8a29f2ffcb] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:45:25.323439 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3520277c-854a-4b70-95c4-0654d3100eb1 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:25.323974 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3520277c-854a-4b70-95c4-0654d3100eb1 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:25.324444 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3520277c-854a-4b70-95c4-0654d3100eb1 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:25.325157 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3520277c-854a-4b70-95c4-0654d3100eb1 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:25.325642 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3520277c-854a-4b70-95c4-0654d3100eb1 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:25.326098 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3520277c-854a-4b70-95c4-0654d3100eb1 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:25.402393 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:45:25.422916 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=6 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:45:25.458125 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3520277c-854a-4b70-95c4-0654d3100eb1 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f47ba234baf476aafa923d18266f4c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7e5bbf1a1a408cb25c117ba070f965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:45:25.466225 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3520277c-854a-4b70-95c4-0654d3100eb1 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] 10.222.0.20 "GET /compute/v2.1/servers/a1398009-bef2-46e7-9323-7a8a29f2ffcb" status: 200 len: 1363 microversion: 2.1 time: 0.155511 Oct 04 19:45:25.466788 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3938/7863] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:45:25 2022] GET /compute/v2.1/servers/a1398009-bef2-46e7-9323-7a8a29f2ffcb => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:45:25.844483 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-7f242853-157c-4077-98d7-202bd446423a req-830296e4-b37e-4b52-b5db-5a58546ba5e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1398009-bef2-46e7-9323-7a8a29f2ffcb", "name": "network-vif-plugged", "status": "completed", "tag": "7520676c-b88b-4627-93ea-65f593418c4b"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:45:25.850850 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=6 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:45:25.856042 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-7f242853-157c-4077-98d7-202bd446423a req-830296e4-b37e-4b52-b5db-5a58546ba5e8 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:25.856564 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-7f242853-157c-4077-98d7-202bd446423a req-830296e4-b37e-4b52-b5db-5a58546ba5e8 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:25.857006 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-7f242853-157c-4077-98d7-202bd446423a req-830296e4-b37e-4b52-b5db-5a58546ba5e8 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:25.868577 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-7f242853-157c-4077-98d7-202bd446423a req-830296e4-b37e-4b52-b5db-5a58546ba5e8 service nova] Creating event network-vif-plugged:7520676c-b88b-4627-93ea-65f593418c4b for instance a1398009-bef2-46e7-9323-7a8a29f2ffcb on n-h1-850501-14 Oct 04 19:45:25.873454 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-7f242853-157c-4077-98d7-202bd446423a req-830296e4-b37e-4b52-b5db-5a58546ba5e8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032956 Oct 04 19:45:25.874039 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3926/7864] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:45:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:45:26.490038 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2b89d7f9-518b-4eeb-9162-101787d2f2be tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:45:26.490657 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2b89d7f9-518b-4eeb-9162-101787d2f2be tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] [instance: a1398009-bef2-46e7-9323-7a8a29f2ffcb] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:45:26.499965 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2b89d7f9-518b-4eeb-9162-101787d2f2be tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:26.504677 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2b89d7f9-518b-4eeb-9162-101787d2f2be tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:26.504677 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2b89d7f9-518b-4eeb-9162-101787d2f2be tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:26.504677 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2b89d7f9-518b-4eeb-9162-101787d2f2be tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:26.504677 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2b89d7f9-518b-4eeb-9162-101787d2f2be tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:26.504677 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2b89d7f9-518b-4eeb-9162-101787d2f2be tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:26.633710 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-2b89d7f9-518b-4eeb-9162-101787d2f2be tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f47ba234baf476aafa923d18266f4c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7e5bbf1a1a408cb25c117ba070f965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:45:26.641508 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2b89d7f9-518b-4eeb-9162-101787d2f2be tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] 10.222.0.20 "GET /compute/v2.1/servers/a1398009-bef2-46e7-9323-7a8a29f2ffcb" status: 200 len: 1363 microversion: 2.1 time: 0.155406 Oct 04 19:45:26.642082 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3939/7865] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:45:26 2022] GET /compute/v2.1/servers/a1398009-bef2-46e7-9323-7a8a29f2ffcb => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:45:27.667727 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b02634ff-bd34-45df-8232-befdb04b94cf tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:45:27.668518 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b02634ff-bd34-45df-8232-befdb04b94cf tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] [instance: a1398009-bef2-46e7-9323-7a8a29f2ffcb] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:45:27.674892 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b02634ff-bd34-45df-8232-befdb04b94cf tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:27.678553 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b02634ff-bd34-45df-8232-befdb04b94cf tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:27.678553 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b02634ff-bd34-45df-8232-befdb04b94cf tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:27.678553 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b02634ff-bd34-45df-8232-befdb04b94cf tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:27.678553 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b02634ff-bd34-45df-8232-befdb04b94cf tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:27.678553 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b02634ff-bd34-45df-8232-befdb04b94cf tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:27.809423 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b02634ff-bd34-45df-8232-befdb04b94cf tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f47ba234baf476aafa923d18266f4c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7e5bbf1a1a408cb25c117ba070f965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:45:27.817198 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b02634ff-bd34-45df-8232-befdb04b94cf tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] 10.222.0.20 "GET /compute/v2.1/servers/a1398009-bef2-46e7-9323-7a8a29f2ffcb" status: 200 len: 1555 microversion: 2.1 time: 0.155544 Oct 04 19:45:27.818294 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3927/7866] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:45:27 2022] GET /compute/v2.1/servers/a1398009-bef2-46e7-9323-7a8a29f2ffcb => generated 1555 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:45:27.840457 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-aa5ae839-4cf7-4d28-8420-e9d2e92292bc tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:45:27.841075 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-aa5ae839-4cf7-4d28-8420-e9d2e92292bc tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] [instance: a1398009-bef2-46e7-9323-7a8a29f2ffcb] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:45:27.848129 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aa5ae839-4cf7-4d28-8420-e9d2e92292bc tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:27.848614 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aa5ae839-4cf7-4d28-8420-e9d2e92292bc tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:27.849124 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aa5ae839-4cf7-4d28-8420-e9d2e92292bc tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:27.849982 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aa5ae839-4cf7-4d28-8420-e9d2e92292bc tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:27.850436 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aa5ae839-4cf7-4d28-8420-e9d2e92292bc tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:27.850864 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aa5ae839-4cf7-4d28-8420-e9d2e92292bc tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:27.986688 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-aa5ae839-4cf7-4d28-8420-e9d2e92292bc tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f47ba234baf476aafa923d18266f4c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7e5bbf1a1a408cb25c117ba070f965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:45:27.990941 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:45:27.995455 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-aa5ae839-4cf7-4d28-8420-e9d2e92292bc tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] 10.222.0.20 "GET /compute/v2.1/servers/a1398009-bef2-46e7-9323-7a8a29f2ffcb" status: 200 len: 1555 microversion: 2.1 time: 0.158825 Oct 04 19:45:27.996029 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3940/7867] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:45:27 2022] GET /compute/v2.1/servers/a1398009-bef2-46e7-9323-7a8a29f2ffcb => generated 1555 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:45:31.303588 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-fcbd54b8-c27d-45e7-a8d4-3c59d9b792ca tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "82689655-a2c0-49ce-bef7-f666d6e42856"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:45:31.306454 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-fcbd54b8-c27d-45e7-a8d4-3c59d9b792ca tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] [instance: a1398009-bef2-46e7-9323-7a8a29f2ffcb] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:45:31.313259 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fcbd54b8-c27d-45e7-a8d4-3c59d9b792ca tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:31.313757 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fcbd54b8-c27d-45e7-a8d4-3c59d9b792ca tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:31.314210 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fcbd54b8-c27d-45e7-a8d4-3c59d9b792ca tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:31.314909 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fcbd54b8-c27d-45e7-a8d4-3c59d9b792ca tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:31.315379 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fcbd54b8-c27d-45e7-a8d4-3c59d9b792ca tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:31.315817 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fcbd54b8-c27d-45e7-a8d4-3c59d9b792ca tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:32.143749 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-fcbd54b8-c27d-45e7-a8d4-3c59d9b792ca tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] 10.222.0.20 "POST /compute/v2.1/servers/a1398009-bef2-46e7-9323-7a8a29f2ffcb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.843518 Oct 04 19:45:32.144730 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3928/7868] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Oct 4 19:45:31 2022] POST /compute/v2.1/servers/a1398009-bef2-46e7-9323-7a8a29f2ffcb/os-volume_attachments => generated 194 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:45:43.933253 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9b3f111c-e687-4528-b5fa-f501e71a428e tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:45:43.933763 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-9b3f111c-e687-4528-b5fa-f501e71a428e tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] [instance: a1398009-bef2-46e7-9323-7a8a29f2ffcb] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:45:43.937694 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:45:43.942768 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9b3f111c-e687-4528-b5fa-f501e71a428e tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:43.943301 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9b3f111c-e687-4528-b5fa-f501e71a428e tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:43.943748 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9b3f111c-e687-4528-b5fa-f501e71a428e tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:43.944497 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9b3f111c-e687-4528-b5fa-f501e71a428e tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:43.944962 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9b3f111c-e687-4528-b5fa-f501e71a428e tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:43.945676 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9b3f111c-e687-4528-b5fa-f501e71a428e tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:44.035784 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-9b3f111c-e687-4528-b5fa-f501e71a428e tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lazy-loading 'services' on Instance uuid a1398009-bef2-46e7-9323-7a8a29f2ffcb {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:45:44.282090 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9b3f111c-e687-4528-b5fa-f501e71a428e tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a1398009-bef2-46e7-9323-7a8a29f2ffcb/os-volume_attachments/82689655-a2c0-49ce-bef7-f666d6e42856" status: 202 len: 0 microversion: 2.1 time: 0.353006 Oct 04 19:45:44.282607 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3941/7869] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Oct 4 19:45:43 2022] DELETE /compute/v2.1/servers/a1398009-bef2-46e7-9323-7a8a29f2ffcb/os-volume_attachments/82689655-a2c0-49ce-bef7-f666d6e42856 => generated 0 bytes in 355 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:45:44.289325 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:45:44.290134 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:45:44.295252 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-da0cefa3-fa6f-42d5-80e0-48f0809d2e25 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:45:44.297783 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-da0cefa3-fa6f-42d5-80e0-48f0809d2e25 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] [instance: a1398009-bef2-46e7-9323-7a8a29f2ffcb] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:45:44.304835 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-da0cefa3-fa6f-42d5-80e0-48f0809d2e25 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:44.305348 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-da0cefa3-fa6f-42d5-80e0-48f0809d2e25 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:44.306324 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-da0cefa3-fa6f-42d5-80e0-48f0809d2e25 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:44.307608 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-da0cefa3-fa6f-42d5-80e0-48f0809d2e25 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:44.308179 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-da0cefa3-fa6f-42d5-80e0-48f0809d2e25 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:44.308577 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-da0cefa3-fa6f-42d5-80e0-48f0809d2e25 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:44.339871 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-da0cefa3-fa6f-42d5-80e0-48f0809d2e25 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] 10.222.0.20 "GET /compute/v2.1/servers/a1398009-bef2-46e7-9323-7a8a29f2ffcb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052161 Oct 04 19:45:44.340796 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3929/7870] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 19:45:44 2022] GET /compute/v2.1/servers/a1398009-bef2-46e7-9323-7a8a29f2ffcb/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:45:45.355779 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c4bae1ff-1204-46b1-bba4-d0991f7bce1f tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:45:45.358460 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c4bae1ff-1204-46b1-bba4-d0991f7bce1f tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] [instance: a1398009-bef2-46e7-9323-7a8a29f2ffcb] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:45:45.365414 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c4bae1ff-1204-46b1-bba4-d0991f7bce1f tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:45.365934 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c4bae1ff-1204-46b1-bba4-d0991f7bce1f tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:45.366438 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c4bae1ff-1204-46b1-bba4-d0991f7bce1f tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:45.367145 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c4bae1ff-1204-46b1-bba4-d0991f7bce1f tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:45.367610 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c4bae1ff-1204-46b1-bba4-d0991f7bce1f tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:45.368096 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c4bae1ff-1204-46b1-bba4-d0991f7bce1f tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:45.402787 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c4bae1ff-1204-46b1-bba4-d0991f7bce1f tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] 10.222.0.20 "GET /compute/v2.1/servers/a1398009-bef2-46e7-9323-7a8a29f2ffcb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052671 Oct 04 19:45:45.403366 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3942/7871] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 19:45:45 2022] GET /compute/v2.1/servers/a1398009-bef2-46e7-9323-7a8a29f2ffcb/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:45:46.414848 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9437de65-80d6-4e2d-ae78-ca1da0715441 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:45:46.417346 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9437de65-80d6-4e2d-ae78-ca1da0715441 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] [instance: a1398009-bef2-46e7-9323-7a8a29f2ffcb] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:45:46.425843 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9437de65-80d6-4e2d-ae78-ca1da0715441 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:46.426353 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9437de65-80d6-4e2d-ae78-ca1da0715441 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:46.426811 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9437de65-80d6-4e2d-ae78-ca1da0715441 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:46.427535 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9437de65-80d6-4e2d-ae78-ca1da0715441 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:46.428013 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9437de65-80d6-4e2d-ae78-ca1da0715441 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:46.428516 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9437de65-80d6-4e2d-ae78-ca1da0715441 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:46.465584 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9437de65-80d6-4e2d-ae78-ca1da0715441 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] 10.222.0.20 "GET /compute/v2.1/servers/a1398009-bef2-46e7-9323-7a8a29f2ffcb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055157 Oct 04 19:45:46.466276 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3930/7872] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 19:45:46 2022] GET /compute/v2.1/servers/a1398009-bef2-46e7-9323-7a8a29f2ffcb/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:45:47.479098 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c6e41cd5-c627-4bd7-8e18-62d7f5fd1289 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:45:47.481256 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c6e41cd5-c627-4bd7-8e18-62d7f5fd1289 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] [instance: a1398009-bef2-46e7-9323-7a8a29f2ffcb] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:45:47.488157 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c6e41cd5-c627-4bd7-8e18-62d7f5fd1289 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:47.488652 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c6e41cd5-c627-4bd7-8e18-62d7f5fd1289 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:47.489089 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c6e41cd5-c627-4bd7-8e18-62d7f5fd1289 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:47.489792 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c6e41cd5-c627-4bd7-8e18-62d7f5fd1289 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:47.490240 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c6e41cd5-c627-4bd7-8e18-62d7f5fd1289 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:47.490664 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c6e41cd5-c627-4bd7-8e18-62d7f5fd1289 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:47.520872 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c6e41cd5-c627-4bd7-8e18-62d7f5fd1289 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] 10.222.0.20 "GET /compute/v2.1/servers/a1398009-bef2-46e7-9323-7a8a29f2ffcb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046580 Oct 04 19:45:47.521438 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3943/7873] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 19:45:47 2022] GET /compute/v2.1/servers/a1398009-bef2-46e7-9323-7a8a29f2ffcb/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:45:48.535282 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1a8e7799-7b0d-46eb-ab13-5d7e1d2c3637 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:45:48.537479 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1a8e7799-7b0d-46eb-ab13-5d7e1d2c3637 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] [instance: a1398009-bef2-46e7-9323-7a8a29f2ffcb] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:45:48.546322 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1a8e7799-7b0d-46eb-ab13-5d7e1d2c3637 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:48.546897 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1a8e7799-7b0d-46eb-ab13-5d7e1d2c3637 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:48.547350 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1a8e7799-7b0d-46eb-ab13-5d7e1d2c3637 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:48.548193 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1a8e7799-7b0d-46eb-ab13-5d7e1d2c3637 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:48.548671 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1a8e7799-7b0d-46eb-ab13-5d7e1d2c3637 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:48.549157 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1a8e7799-7b0d-46eb-ab13-5d7e1d2c3637 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:48.582760 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1a8e7799-7b0d-46eb-ab13-5d7e1d2c3637 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] 10.222.0.20 "GET /compute/v2.1/servers/a1398009-bef2-46e7-9323-7a8a29f2ffcb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052109 Oct 04 19:45:48.583330 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3931/7874] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 19:45:48 2022] GET /compute/v2.1/servers/a1398009-bef2-46e7-9323-7a8a29f2ffcb/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:45:49.595160 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4c4cb43c-4512-4f44-b9b2-809c7d19307a tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:45:49.597393 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-4c4cb43c-4512-4f44-b9b2-809c7d19307a tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] [instance: a1398009-bef2-46e7-9323-7a8a29f2ffcb] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:45:49.606176 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4c4cb43c-4512-4f44-b9b2-809c7d19307a tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:49.606665 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4c4cb43c-4512-4f44-b9b2-809c7d19307a tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:49.607107 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4c4cb43c-4512-4f44-b9b2-809c7d19307a tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:49.607811 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4c4cb43c-4512-4f44-b9b2-809c7d19307a tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:49.608300 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4c4cb43c-4512-4f44-b9b2-809c7d19307a tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:49.609040 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4c4cb43c-4512-4f44-b9b2-809c7d19307a tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:49.640351 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-4c4cb43c-4512-4f44-b9b2-809c7d19307a tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] 10.222.0.20 "GET /compute/v2.1/servers/a1398009-bef2-46e7-9323-7a8a29f2ffcb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049249 Oct 04 19:45:49.640923 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3944/7875] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 19:45:49 2022] GET /compute/v2.1/servers/a1398009-bef2-46e7-9323-7a8a29f2ffcb/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 19:45:49.652574 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a390fb46-a3d5-4fe6-9304-ff30cd95099c tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:45:49.653075 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a390fb46-a3d5-4fe6-9304-ff30cd95099c tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] [instance: a1398009-bef2-46e7-9323-7a8a29f2ffcb] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:45:49.659989 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a390fb46-a3d5-4fe6-9304-ff30cd95099c tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:49.660567 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a390fb46-a3d5-4fe6-9304-ff30cd95099c tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:49.661006 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a390fb46-a3d5-4fe6-9304-ff30cd95099c tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:49.661732 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a390fb46-a3d5-4fe6-9304-ff30cd95099c tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:49.662198 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a390fb46-a3d5-4fe6-9304-ff30cd95099c tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:49.662679 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a390fb46-a3d5-4fe6-9304-ff30cd95099c tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:49.740078 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-a390fb46-a3d5-4fe6-9304-ff30cd95099c tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] HTTP exception thrown: Instance a1398009-bef2-46e7-9323-7a8a29f2ffcb is not attached to volume 82689655-a2c0-49ce-bef7-f666d6e42856 Oct 04 19:45:49.744651 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a390fb46-a3d5-4fe6-9304-ff30cd95099c tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Request method failure captured: Oct 04 19:45:49.744651 n-d-850501-14 devstack@n-api.service[123002]: request: DELETE /compute/v2.1/servers/a1398009-bef2-46e7-9323-7a8a29f2ffcb/os-volume_attachments/82689655-a2c0-49ce-bef7-f666d6e42856 HTTP/1.1 Oct 04 19:45:49.744651 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 19:45:49.744651 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 19:45:49.744651 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 19:45:49.744651 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 19:45:49.744651 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 19:45:49.744651 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 19:45:49.744651 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 19:45:49.744651 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 19:45:49.744651 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPI0ZjIuZNmctjk_257U0oVHkHOn25x6hSJOyoYjlQ76bCmmbr71JmNxFoTaVYixGauvA8TRbKl_h7ailGynxtR0Nyce9i_PS4mg4c1Z0OwTxz01XgWOmkYa8cS9xc0qZJdaaHxuUhln5SUFHHFQVbrpPHAVk62PKDA5EUBmyHTTJZWY Oct 04 19:45:49.744651 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 19:45:49.744651 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 19:45:49.744651 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 19:45:49.744651 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 19:45:49.744651 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 19:45:49.744651 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 19:45:49.744651 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 9e7e5bbf1a1a408cb25c117ba070f965 Oct 04 19:45:49.744651 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1899659525 Oct 04 19:45:49.744651 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 19:45:49.744651 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 19:45:49.744651 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9e7e5bbf1a1a408cb25c117ba070f965"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9e7e5bbf1a1a408cb25c117ba070f965", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9e7e5bbf1a1a408cb25c117ba070f965"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9e7e5bbf1a1a408cb25c117ba070f965"}]}] Oct 04 19:45:49.744651 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-TestEncryptedCinderVolumes-1899659525 Oct 04 19:45:49.744651 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 9e7e5bbf1a1a408cb25c117ba070f965 Oct 04 19:45:49.744651 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1899659525 Oct 04 19:45:49.744651 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-TestEncryptedCinderVolumes-1899659525-project Oct 04 19:45:49.744651 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 19:45:49.744651 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 19:45:49.744651 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 4f47ba234baf476aafa923d18266f4c8 Oct 04 19:45:49.744651 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-TestEncryptedCinderVolumes-1899659525-project Oct 04 19:45:49.744651 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 19:45:49.744651 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance a1398009-bef2-46e7-9323-7a8a29f2ffcb is not attached to volume 82689655-a2c0-49ce-bef7-f666d6e42856 Oct 04 19:45:49.744651 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'server_id': 'a1398009-bef2-46e7-9323-7a8a29f2ffcb', 'id': '82689655-a2c0-49ce-bef7-f666d6e42856'} Oct 04 19:45:49.744651 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:45:49.744651 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:45:49.744651 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 04 19:45:49.744651 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 04 19:45:49.744651 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 19:45:49.744651 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 19:45:49.744651 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 04 19:45:49.744651 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 04 19:45:49.744651 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 82689655-a2c0-49ce-bef7-f666d6e42856. Oct 04 19:45:49.744651 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:45:49.744651 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:45:49.744651 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:45:49.744651 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:45:49.744651 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:45:49.744651 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:45:49.744651 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:45:49.744651 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:45:49.744651 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:45:49.744651 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:45:49.744651 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 04 19:45:49.744651 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 19:45:49.744651 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1398009-bef2-46e7-9323-7a8a29f2ffcb is not attached to volume 82689655-a2c0-49ce-bef7-f666d6e42856 Oct 04 19:45:49.744651 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:45:49.744651 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:45:49.744651 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:45:49.744651 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:45:49.744651 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:45:49.744651 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:45:49.749808 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:45:49.749808 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:45:49.749808 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1398009-bef2-46e7-9323-7a8a29f2ffcb is not attached to volume 82689655-a2c0-49ce-bef7-f666d6e42856 Oct 04 19:45:49.749808 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:45:49.749808 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a390fb46-a3d5-4fe6-9304-ff30cd95099c tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Returning 404 to user: Instance a1398009-bef2-46e7-9323-7a8a29f2ffcb is not attached to volume 82689655-a2c0-49ce-bef7-f666d6e42856 {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:45:49.749808 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a390fb46-a3d5-4fe6-9304-ff30cd95099c tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a1398009-bef2-46e7-9323-7a8a29f2ffcb/os-volume_attachments/82689655-a2c0-49ce-bef7-f666d6e42856" status: 404 len: 154 microversion: 2.1 time: 0.095501 Oct 04 19:45:49.749808 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3932/7876] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Oct 4 19:45:49 2022] DELETE /compute/v2.1/servers/a1398009-bef2-46e7-9323-7a8a29f2ffcb/os-volume_attachments/82689655-a2c0-49ce-bef7-f666d6e42856 => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:45:54.476591 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-632455fb-7d53-4e82-9305-4cea4025cb8a tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:45:54.477092 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-632455fb-7d53-4e82-9305-4cea4025cb8a tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] [instance: a1398009-bef2-46e7-9323-7a8a29f2ffcb] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:45:54.485512 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-632455fb-7d53-4e82-9305-4cea4025cb8a tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:54.485943 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-632455fb-7d53-4e82-9305-4cea4025cb8a tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:54.486445 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-632455fb-7d53-4e82-9305-4cea4025cb8a tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:54.487117 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-632455fb-7d53-4e82-9305-4cea4025cb8a tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:54.487580 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-632455fb-7d53-4e82-9305-4cea4025cb8a tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:54.488011 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-632455fb-7d53-4e82-9305-4cea4025cb8a tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:54.514378 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-632455fb-7d53-4e82-9305-4cea4025cb8a tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] [instance: a1398009-bef2-46e7-9323-7a8a29f2ffcb] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:45:54.873348 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-632455fb-7d53-4e82-9305-4cea4025cb8a tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a1398009-bef2-46e7-9323-7a8a29f2ffcb" status: 204 len: 0 microversion: 2.1 time: 0.399697 Oct 04 19:45:54.874467 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3945/7877] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 19:45:54 2022] DELETE /compute/v2.1/servers/a1398009-bef2-46e7-9323-7a8a29f2ffcb => generated 0 bytes in 403 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:45:54.889544 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-bd5f3e9e-ba5d-4083-9149-c213e28b1118 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:45:54.893409 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-bd5f3e9e-ba5d-4083-9149-c213e28b1118 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] [instance: a1398009-bef2-46e7-9323-7a8a29f2ffcb] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:45:54.898938 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bd5f3e9e-ba5d-4083-9149-c213e28b1118 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:54.900036 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bd5f3e9e-ba5d-4083-9149-c213e28b1118 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:54.900484 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bd5f3e9e-ba5d-4083-9149-c213e28b1118 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:54.901196 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bd5f3e9e-ba5d-4083-9149-c213e28b1118 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:54.901658 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bd5f3e9e-ba5d-4083-9149-c213e28b1118 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:54.902095 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bd5f3e9e-ba5d-4083-9149-c213e28b1118 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:55.038948 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-bd5f3e9e-ba5d-4083-9149-c213e28b1118 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f47ba234baf476aafa923d18266f4c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7e5bbf1a1a408cb25c117ba070f965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:45:55.047635 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-bd5f3e9e-ba5d-4083-9149-c213e28b1118 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] 10.222.0.20 "GET /compute/v2.1/servers/a1398009-bef2-46e7-9323-7a8a29f2ffcb" status: 200 len: 1561 microversion: 2.1 time: 0.165832 Oct 04 19:45:55.048236 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3933/7878] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:45:54 2022] GET /compute/v2.1/servers/a1398009-bef2-46e7-9323-7a8a29f2ffcb => generated 1561 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:45:56.072200 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6caff617-048a-4158-9e7a-254d877366ed tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:45:56.072925 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6caff617-048a-4158-9e7a-254d877366ed tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] [instance: a1398009-bef2-46e7-9323-7a8a29f2ffcb] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:45:56.079712 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6caff617-048a-4158-9e7a-254d877366ed tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:56.080223 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6caff617-048a-4158-9e7a-254d877366ed tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:56.080666 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6caff617-048a-4158-9e7a-254d877366ed tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:56.081358 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6caff617-048a-4158-9e7a-254d877366ed tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:56.081810 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6caff617-048a-4158-9e7a-254d877366ed tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:56.082236 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6caff617-048a-4158-9e7a-254d877366ed tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:56.226828 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6caff617-048a-4158-9e7a-254d877366ed tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f47ba234baf476aafa923d18266f4c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7e5bbf1a1a408cb25c117ba070f965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:45:56.236307 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6caff617-048a-4158-9e7a-254d877366ed tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] 10.222.0.20 "GET /compute/v2.1/servers/a1398009-bef2-46e7-9323-7a8a29f2ffcb" status: 200 len: 1561 microversion: 2.1 time: 0.168877 Oct 04 19:45:56.236896 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3946/7879] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:45:56 2022] GET /compute/v2.1/servers/a1398009-bef2-46e7-9323-7a8a29f2ffcb => generated 1561 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:45:56.983236 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-d9cec62f-8861-446a-8c1f-f915591997db req-27f13c9e-a7fd-42f5-b75c-f69ccc263066 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1398009-bef2-46e7-9323-7a8a29f2ffcb", "name": "network-vif-deleted", "tag": "7520676c-b88b-4627-93ea-65f593418c4b"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:45:56.993910 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-d9cec62f-8861-446a-8c1f-f915591997db req-27f13c9e-a7fd-42f5-b75c-f69ccc263066 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:56.994404 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-d9cec62f-8861-446a-8c1f-f915591997db req-27f13c9e-a7fd-42f5-b75c-f69ccc263066 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:56.994856 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-d9cec62f-8861-446a-8c1f-f915591997db req-27f13c9e-a7fd-42f5-b75c-f69ccc263066 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:57.006009 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-d9cec62f-8861-446a-8c1f-f915591997db req-27f13c9e-a7fd-42f5-b75c-f69ccc263066 service nova] Creating event network-vif-deleted:7520676c-b88b-4627-93ea-65f593418c4b for instance a1398009-bef2-46e7-9323-7a8a29f2ffcb on n-h1-850501-14 Oct 04 19:45:57.011559 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-d9cec62f-8861-446a-8c1f-f915591997db req-27f13c9e-a7fd-42f5-b75c-f69ccc263066 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032083 Oct 04 19:45:57.012181 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3934/7880] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:45:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:45:57.263891 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4cf1ec72-007a-405e-b83a-9ea8ee014588 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:45:57.264744 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-4cf1ec72-007a-405e-b83a-9ea8ee014588 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] [instance: a1398009-bef2-46e7-9323-7a8a29f2ffcb] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:45:57.271745 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4cf1ec72-007a-405e-b83a-9ea8ee014588 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:57.272336 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4cf1ec72-007a-405e-b83a-9ea8ee014588 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:57.272771 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4cf1ec72-007a-405e-b83a-9ea8ee014588 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:57.273471 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4cf1ec72-007a-405e-b83a-9ea8ee014588 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:57.273925 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4cf1ec72-007a-405e-b83a-9ea8ee014588 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:57.274443 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4cf1ec72-007a-405e-b83a-9ea8ee014588 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:57.350329 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-4cf1ec72-007a-405e-b83a-9ea8ee014588 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f47ba234baf476aafa923d18266f4c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7e5bbf1a1a408cb25c117ba070f965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:45:57.358675 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-4cf1ec72-007a-405e-b83a-9ea8ee014588 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] 10.222.0.20 "GET /compute/v2.1/servers/a1398009-bef2-46e7-9323-7a8a29f2ffcb" status: 200 len: 1348 microversion: 2.1 time: 0.099914 Oct 04 19:45:57.359275 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3947/7881] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:45:57 2022] GET /compute/v2.1/servers/a1398009-bef2-46e7-9323-7a8a29f2ffcb => generated 1348 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:45:58.383857 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-57e97914-2d56-40fe-a804-a6691d7b07df tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:45:58.385674 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-57e97914-2d56-40fe-a804-a6691d7b07df tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] [instance: a1398009-bef2-46e7-9323-7a8a29f2ffcb] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:45:58.392009 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-57e97914-2d56-40fe-a804-a6691d7b07df tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:58.392532 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-57e97914-2d56-40fe-a804-a6691d7b07df tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:58.392985 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-57e97914-2d56-40fe-a804-a6691d7b07df tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:58.393690 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-57e97914-2d56-40fe-a804-a6691d7b07df tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:58.394157 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-57e97914-2d56-40fe-a804-a6691d7b07df tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:58.394592 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-57e97914-2d56-40fe-a804-a6691d7b07df tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:58.408609 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-57e97914-2d56-40fe-a804-a6691d7b07df tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] HTTP exception thrown: Instance a1398009-bef2-46e7-9323-7a8a29f2ffcb could not be found. Oct 04 19:45:58.410238 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-57e97914-2d56-40fe-a804-a6691d7b07df tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Request method failure captured: Oct 04 19:45:58.410238 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/a1398009-bef2-46e7-9323-7a8a29f2ffcb HTTP/1.1 Oct 04 19:45:58.410238 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 19:45:58.410238 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 19:45:58.410238 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 19:45:58.410238 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 19:45:58.410238 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 19:45:58.410238 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 19:45:58.410238 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 19:45:58.410238 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 19:45:58.410238 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPI0ZjIuZNmctjk_257U0oVHkHOn25x6hSJOyoYjlQ76bCmmbr71JmNxFoTaVYixGauvA8TRbKl_h7ailGynxtR0Nyce9i_PS4mg4c1Z0OwTxz01XgWOmkYa8cS9xc0qZJdaaHxuUhln5SUFHHFQVbrpPHAVk62PKDA5EUBmyHTTJZWY Oct 04 19:45:58.410238 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 19:45:58.410238 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 19:45:58.410238 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 19:45:58.410238 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 19:45:58.410238 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 19:45:58.410238 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 19:45:58.410238 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 9e7e5bbf1a1a408cb25c117ba070f965 Oct 04 19:45:58.410238 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1899659525 Oct 04 19:45:58.410238 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 19:45:58.410238 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 19:45:58.410238 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9e7e5bbf1a1a408cb25c117ba070f965"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9e7e5bbf1a1a408cb25c117ba070f965", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9e7e5bbf1a1a408cb25c117ba070f965"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9e7e5bbf1a1a408cb25c117ba070f965"}]}] Oct 04 19:45:58.410238 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-TestEncryptedCinderVolumes-1899659525 Oct 04 19:45:58.410238 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 9e7e5bbf1a1a408cb25c117ba070f965 Oct 04 19:45:58.410238 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1899659525 Oct 04 19:45:58.410238 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-TestEncryptedCinderVolumes-1899659525-project Oct 04 19:45:58.410238 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 19:45:58.410238 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 19:45:58.410238 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 4f47ba234baf476aafa923d18266f4c8 Oct 04 19:45:58.410238 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-TestEncryptedCinderVolumes-1899659525-project Oct 04 19:45:58.410238 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 19:45:58.410238 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance a1398009-bef2-46e7-9323-7a8a29f2ffcb could not be found. Oct 04 19:45:58.410238 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': 'a1398009-bef2-46e7-9323-7a8a29f2ffcb'} Oct 04 19:45:58.410238 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:45:58.410238 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:45:58.410238 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:45:58.410238 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:45:58.410238 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:45:58.410238 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:45:58.410238 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:45:58.410238 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:45:58.410238 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:45:58.410238 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:45:58.410238 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1398009-bef2-46e7-9323-7a8a29f2ffcb could not be found. Oct 04 19:45:58.410238 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:45:58.410238 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:45:58.410238 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:45:58.410238 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:45:58.410238 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:45:58.410238 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:45:58.410238 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:45:58.410238 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:45:58.410238 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:45:58.410238 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:45:58.410238 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:45:58.410238 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:45:58.410238 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:45:58.410238 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:45:58.410238 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:45:58.410238 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:45:58.410238 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1398009-bef2-46e7-9323-7a8a29f2ffcb could not be found. Oct 04 19:45:58.410238 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:45:58.410238 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:45:58.415049 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:45:58.415049 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:45:58.415049 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:45:58.415049 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:45:58.415049 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:45:58.415049 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:45:58.415049 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1398009-bef2-46e7-9323-7a8a29f2ffcb could not be found. Oct 04 19:45:58.415049 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:45:58.415049 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-57e97914-2d56-40fe-a804-a6691d7b07df tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Returning 404 to user: Instance a1398009-bef2-46e7-9323-7a8a29f2ffcb could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:45:58.415049 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-57e97914-2d56-40fe-a804-a6691d7b07df tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] 10.222.0.20 "GET /compute/v2.1/servers/a1398009-bef2-46e7-9323-7a8a29f2ffcb" status: 404 len: 111 microversion: 2.1 time: 0.033189 Oct 04 19:45:58.415049 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3935/7882] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:45:58 2022] GET /compute/v2.1/servers/a1398009-bef2-46e7-9323-7a8a29f2ffcb => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 19:45:58.422506 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c30dff61-4b14-49f5-b413-3a5bd53e37dd tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Calling method '.version_select at 0x7fe2590dac10>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:45:58.509816 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c30dff61-4b14-49f5-b413-3a5bd53e37dd tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1666568945" status: 202 len: 0 microversion: 2.1 time: 0.090764 Oct 04 19:45:58.510519 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3948/7883] 10.222.0.20 () {58 vars in 1278 bytes} [Tue Oct 4 19:45:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1666568945 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:45:58.529556 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c95f59b0-9b50-4bdb-be00-978c4c856d46 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Action: 'create', calling method: .version_select at 0x7fe2596ebee0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-588873962", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHRV63lRr8JyGYfNhgi5HSNj1fWdAhqLX2Rpu/MPYYWtqJzBg7zBcAUmz6t+OgE7+EF3C21XJh9DgP8sX+KCP/O4JGgxvp9elg5mqWGtNFDo78d6ILPYcralpLkyoyTilw=="}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:45:58.545939 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-c95f59b0-9b50-4bdb-be00-978c4c856d46 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Getting quotas for project 9e7e5bbf1a1a408cb25c117ba070f965. Resources: {'key_pairs'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:45:58.551869 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-c95f59b0-9b50-4bdb-be00-978c4c856d46 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Getting quotas for user 4f47ba234baf476aafa923d18266f4c8 and project 9e7e5bbf1a1a408cb25c117ba070f965. Resources: {'key_pairs'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:45:58.640767 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c95f59b0-9b50-4bdb-be00-978c4c856d46 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.116177 Oct 04 19:45:58.641296 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3936/7884] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Oct 4 19:45:58 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:45:58.693276 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7cc33bc1-53cb-41bb-b5b0-2a35f6087c40 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-437873114", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-588873962", "networks": [{"uuid": "f42e273e-d5f1-48ac-b887-f81bd956f13b"}]}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:45:58.748448 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.neutron [None req-7cc33bc1-53cb-41bb-b5b0-2a35f6087c40 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] validate_networks() for [('f42e273e-d5f1-48ac-b887-f81bd956f13b', None, None, None, None, None)] {{(pid=123001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:45:59.135630 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-7cc33bc1-53cb-41bb-b5b0-2a35f6087c40 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:45:59.136074 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-7cc33bc1-53cb-41bb-b5b0-2a35f6087c40 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:45:59.136582 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-7cc33bc1-53cb-41bb-b5b0-2a35f6087c40 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:45:59.137000 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-7cc33bc1-53cb-41bb-b5b0-2a35f6087c40 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:45:59.137453 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-7cc33bc1-53cb-41bb-b5b0-2a35f6087c40 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:45:59.146217 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7cc33bc1-53cb-41bb-b5b0-2a35f6087c40 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:59.146702 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7cc33bc1-53cb-41bb-b5b0-2a35f6087c40 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:59.147141 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7cc33bc1-53cb-41bb-b5b0-2a35f6087c40 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:59.147878 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7cc33bc1-53cb-41bb-b5b0-2a35f6087c40 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:59.148377 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7cc33bc1-53cb-41bb-b5b0-2a35f6087c40 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:59.148810 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7cc33bc1-53cb-41bb-b5b0-2a35f6087c40 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:59.166619 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-7cc33bc1-53cb-41bb-b5b0-2a35f6087c40 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Getting quotas for project 9e7e5bbf1a1a408cb25c117ba070f965. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:45:59.171940 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-7cc33bc1-53cb-41bb-b5b0-2a35f6087c40 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Getting quotas for user 4f47ba234baf476aafa923d18266f4c8 and project 9e7e5bbf1a1a408cb25c117ba070f965. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:45:59.184339 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7cc33bc1-53cb-41bb-b5b0-2a35f6087c40 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Going to run 1 instances... {{(pid=123001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:45:59.186634 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7cc33bc1-53cb-41bb-b5b0-2a35f6087c40 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] [instance: 6fe8d9a6-4cef-4503-866a-be1d337a872c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:45:59.316194 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7cc33bc1-53cb-41bb-b5b0-2a35f6087c40 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.626884 Oct 04 19:45:59.317034 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3949/7885] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 19:45:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 628 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:45:59.329243 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-da98c17a-851a-43e7-ad06-88a814e31669 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:45:59.329888 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-da98c17a-851a-43e7-ad06-88a814e31669 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] [instance: 6fe8d9a6-4cef-4503-866a-be1d337a872c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:45:59.393091 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-da98c17a-851a-43e7-ad06-88a814e31669 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f47ba234baf476aafa923d18266f4c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7e5bbf1a1a408cb25c117ba070f965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:45:59.400173 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-da98c17a-851a-43e7-ad06-88a814e31669 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] 10.222.0.20 "GET /compute/v2.1/servers/6fe8d9a6-4cef-4503-866a-be1d337a872c" status: 200 len: 1261 microversion: 2.1 time: 0.075223 Oct 04 19:45:59.400922 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3937/7886] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:45:59 2022] GET /compute/v2.1/servers/6fe8d9a6-4cef-4503-866a-be1d337a872c => generated 1261 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:46:00.425193 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-cb84b3d0-d44e-4998-9d18-18b3985fd817 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:00.425806 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-cb84b3d0-d44e-4998-9d18-18b3985fd817 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] [instance: 6fe8d9a6-4cef-4503-866a-be1d337a872c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:00.433326 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cb84b3d0-d44e-4998-9d18-18b3985fd817 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:00.433820 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cb84b3d0-d44e-4998-9d18-18b3985fd817 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:00.434264 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cb84b3d0-d44e-4998-9d18-18b3985fd817 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:00.434967 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cb84b3d0-d44e-4998-9d18-18b3985fd817 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:00.435426 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cb84b3d0-d44e-4998-9d18-18b3985fd817 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:00.435857 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cb84b3d0-d44e-4998-9d18-18b3985fd817 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:00.498232 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-cb84b3d0-d44e-4998-9d18-18b3985fd817 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f47ba234baf476aafa923d18266f4c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7e5bbf1a1a408cb25c117ba070f965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:46:00.506257 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-cb84b3d0-d44e-4998-9d18-18b3985fd817 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] 10.222.0.20 "GET /compute/v2.1/servers/6fe8d9a6-4cef-4503-866a-be1d337a872c" status: 200 len: 1265 microversion: 2.1 time: 0.086753 Oct 04 19:46:00.506823 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3950/7887] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:46:00 2022] GET /compute/v2.1/servers/6fe8d9a6-4cef-4503-866a-be1d337a872c => generated 1265 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:46:01.530566 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-862b296f-291c-4eaa-98f2-5a7740fb4424 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:01.531129 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-862b296f-291c-4eaa-98f2-5a7740fb4424 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] [instance: 6fe8d9a6-4cef-4503-866a-be1d337a872c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:01.538639 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-862b296f-291c-4eaa-98f2-5a7740fb4424 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:01.539253 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-862b296f-291c-4eaa-98f2-5a7740fb4424 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:01.539707 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-862b296f-291c-4eaa-98f2-5a7740fb4424 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:01.541765 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-862b296f-291c-4eaa-98f2-5a7740fb4424 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:01.542245 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-862b296f-291c-4eaa-98f2-5a7740fb4424 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:01.542696 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-862b296f-291c-4eaa-98f2-5a7740fb4424 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:01.605892 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-862b296f-291c-4eaa-98f2-5a7740fb4424 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f47ba234baf476aafa923d18266f4c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7e5bbf1a1a408cb25c117ba070f965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:46:01.613678 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-862b296f-291c-4eaa-98f2-5a7740fb4424 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] 10.222.0.20 "GET /compute/v2.1/servers/6fe8d9a6-4cef-4503-866a-be1d337a872c" status: 200 len: 1313 microversion: 2.1 time: 0.087258 Oct 04 19:46:01.614242 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3938/7888] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:46:01 2022] GET /compute/v2.1/servers/6fe8d9a6-4cef-4503-866a-be1d337a872c => generated 1313 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:46:02.638170 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-243c045c-6d8a-4331-ab5e-f3273c09cb79 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:02.667709 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-243c045c-6d8a-4331-ab5e-f3273c09cb79 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] [instance: 6fe8d9a6-4cef-4503-866a-be1d337a872c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:02.667709 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-243c045c-6d8a-4331-ab5e-f3273c09cb79 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:02.667709 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-243c045c-6d8a-4331-ab5e-f3273c09cb79 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:02.667709 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-243c045c-6d8a-4331-ab5e-f3273c09cb79 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:02.667709 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-243c045c-6d8a-4331-ab5e-f3273c09cb79 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:02.667709 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-243c045c-6d8a-4331-ab5e-f3273c09cb79 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:02.667709 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-243c045c-6d8a-4331-ab5e-f3273c09cb79 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:02.846383 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-243c045c-6d8a-4331-ab5e-f3273c09cb79 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f47ba234baf476aafa923d18266f4c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7e5bbf1a1a408cb25c117ba070f965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:46:02.854523 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-243c045c-6d8a-4331-ab5e-f3273c09cb79 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] 10.222.0.20 "GET /compute/v2.1/servers/6fe8d9a6-4cef-4503-866a-be1d337a872c" status: 200 len: 1361 microversion: 2.1 time: 0.221040 Oct 04 19:46:02.855104 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3951/7889] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:46:02 2022] GET /compute/v2.1/servers/6fe8d9a6-4cef-4503-866a-be1d337a872c => generated 1361 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:46:03.599463 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-3e52ea34-b621-4180-86da-8a8ec4a57e58 req-2e49578f-cdbe-4d11-a39e-833c024300b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fe8d9a6-4cef-4503-866a-be1d337a872c", "tag": "34a69006-305d-44ba-8528-41f8d2462546"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:46:03.611125 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-3e52ea34-b621-4180-86da-8a8ec4a57e58 req-2e49578f-cdbe-4d11-a39e-833c024300b5 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:03.611895 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-3e52ea34-b621-4180-86da-8a8ec4a57e58 req-2e49578f-cdbe-4d11-a39e-833c024300b5 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:03.612578 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-3e52ea34-b621-4180-86da-8a8ec4a57e58 req-2e49578f-cdbe-4d11-a39e-833c024300b5 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:03.624579 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-3e52ea34-b621-4180-86da-8a8ec4a57e58 req-2e49578f-cdbe-4d11-a39e-833c024300b5 service nova] Creating event network-changed:34a69006-305d-44ba-8528-41f8d2462546 for instance 6fe8d9a6-4cef-4503-866a-be1d337a872c on n-h1-850501-14 Oct 04 19:46:03.629654 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-3e52ea34-b621-4180-86da-8a8ec4a57e58 req-2e49578f-cdbe-4d11-a39e-833c024300b5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034326 Oct 04 19:46:03.630269 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3939/7890] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:46:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:46:03.877898 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-516119b1-cb3a-4612-b692-b073cad15dbe tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:03.878447 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-516119b1-cb3a-4612-b692-b073cad15dbe tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] [instance: 6fe8d9a6-4cef-4503-866a-be1d337a872c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:03.886617 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-516119b1-cb3a-4612-b692-b073cad15dbe tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:03.887114 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-516119b1-cb3a-4612-b692-b073cad15dbe tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:03.887554 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-516119b1-cb3a-4612-b692-b073cad15dbe tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:03.888311 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-516119b1-cb3a-4612-b692-b073cad15dbe tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:03.888773 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-516119b1-cb3a-4612-b692-b073cad15dbe tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:03.889203 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-516119b1-cb3a-4612-b692-b073cad15dbe tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:04.117660 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-516119b1-cb3a-4612-b692-b073cad15dbe tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f47ba234baf476aafa923d18266f4c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7e5bbf1a1a408cb25c117ba070f965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:46:04.126944 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-516119b1-cb3a-4612-b692-b073cad15dbe tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] 10.222.0.20 "GET /compute/v2.1/servers/6fe8d9a6-4cef-4503-866a-be1d337a872c" status: 200 len: 1361 microversion: 2.1 time: 0.253067 Oct 04 19:46:04.127530 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3952/7891] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:46:03 2022] GET /compute/v2.1/servers/6fe8d9a6-4cef-4503-866a-be1d337a872c => generated 1361 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:46:05.152545 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-db82e8a3-b68d-4473-8d07-b853d0580597 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:05.153273 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-db82e8a3-b68d-4473-8d07-b853d0580597 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] [instance: 6fe8d9a6-4cef-4503-866a-be1d337a872c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:05.159544 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-db82e8a3-b68d-4473-8d07-b853d0580597 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:05.160038 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-db82e8a3-b68d-4473-8d07-b853d0580597 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:05.160525 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-db82e8a3-b68d-4473-8d07-b853d0580597 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:05.161236 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-db82e8a3-b68d-4473-8d07-b853d0580597 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:05.161708 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-db82e8a3-b68d-4473-8d07-b853d0580597 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:05.162155 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-db82e8a3-b68d-4473-8d07-b853d0580597 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:05.297534 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-db82e8a3-b68d-4473-8d07-b853d0580597 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f47ba234baf476aafa923d18266f4c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7e5bbf1a1a408cb25c117ba070f965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:46:05.305249 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-db82e8a3-b68d-4473-8d07-b853d0580597 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] 10.222.0.20 "GET /compute/v2.1/servers/6fe8d9a6-4cef-4503-866a-be1d337a872c" status: 200 len: 1361 microversion: 2.1 time: 0.158075 Oct 04 19:46:05.305963 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3940/7892] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:46:05 2022] GET /compute/v2.1/servers/6fe8d9a6-4cef-4503-866a-be1d337a872c => generated 1361 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:46:06.328979 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-703c33ac-9bc1-4fe6-b733-cdb1d2154cc0 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:06.329615 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-703c33ac-9bc1-4fe6-b733-cdb1d2154cc0 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] [instance: 6fe8d9a6-4cef-4503-866a-be1d337a872c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:06.336503 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-703c33ac-9bc1-4fe6-b733-cdb1d2154cc0 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:06.336992 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-703c33ac-9bc1-4fe6-b733-cdb1d2154cc0 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:06.337503 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-703c33ac-9bc1-4fe6-b733-cdb1d2154cc0 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:06.338361 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-703c33ac-9bc1-4fe6-b733-cdb1d2154cc0 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:06.338820 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-703c33ac-9bc1-4fe6-b733-cdb1d2154cc0 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:06.339244 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-703c33ac-9bc1-4fe6-b733-cdb1d2154cc0 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:06.470170 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-703c33ac-9bc1-4fe6-b733-cdb1d2154cc0 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f47ba234baf476aafa923d18266f4c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7e5bbf1a1a408cb25c117ba070f965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:46:06.478088 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-703c33ac-9bc1-4fe6-b733-cdb1d2154cc0 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] 10.222.0.20 "GET /compute/v2.1/servers/6fe8d9a6-4cef-4503-866a-be1d337a872c" status: 200 len: 1361 microversion: 2.1 time: 0.152993 Oct 04 19:46:06.479384 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3953/7893] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:46:06 2022] GET /compute/v2.1/servers/6fe8d9a6-4cef-4503-866a-be1d337a872c => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:46:07.502620 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e5b84ed6-216f-455b-8ff2-dc22c86a2f65 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:07.503290 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e5b84ed6-216f-455b-8ff2-dc22c86a2f65 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] [instance: 6fe8d9a6-4cef-4503-866a-be1d337a872c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:07.510823 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e5b84ed6-216f-455b-8ff2-dc22c86a2f65 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:07.511324 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e5b84ed6-216f-455b-8ff2-dc22c86a2f65 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:07.511782 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e5b84ed6-216f-455b-8ff2-dc22c86a2f65 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:07.512520 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e5b84ed6-216f-455b-8ff2-dc22c86a2f65 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:07.512993 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e5b84ed6-216f-455b-8ff2-dc22c86a2f65 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:07.513437 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e5b84ed6-216f-455b-8ff2-dc22c86a2f65 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:07.648010 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e5b84ed6-216f-455b-8ff2-dc22c86a2f65 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f47ba234baf476aafa923d18266f4c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7e5bbf1a1a408cb25c117ba070f965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:46:07.656009 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e5b84ed6-216f-455b-8ff2-dc22c86a2f65 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] 10.222.0.20 "GET /compute/v2.1/servers/6fe8d9a6-4cef-4503-866a-be1d337a872c" status: 200 len: 1361 microversion: 2.1 time: 0.157318 Oct 04 19:46:07.656603 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3941/7894] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:46:07 2022] GET /compute/v2.1/servers/6fe8d9a6-4cef-4503-866a-be1d337a872c => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:46:08.678766 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-61ffa103-cfa9-4f23-a613-62a61b4a6310 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:08.683662 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-61ffa103-cfa9-4f23-a613-62a61b4a6310 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] [instance: 6fe8d9a6-4cef-4503-866a-be1d337a872c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:08.686789 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-61ffa103-cfa9-4f23-a613-62a61b4a6310 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:08.687272 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-61ffa103-cfa9-4f23-a613-62a61b4a6310 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:08.687736 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-61ffa103-cfa9-4f23-a613-62a61b4a6310 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:08.688542 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-61ffa103-cfa9-4f23-a613-62a61b4a6310 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:08.688999 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-61ffa103-cfa9-4f23-a613-62a61b4a6310 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:08.689424 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-61ffa103-cfa9-4f23-a613-62a61b4a6310 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:08.821319 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-61ffa103-cfa9-4f23-a613-62a61b4a6310 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f47ba234baf476aafa923d18266f4c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7e5bbf1a1a408cb25c117ba070f965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:46:08.829811 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-61ffa103-cfa9-4f23-a613-62a61b4a6310 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] 10.222.0.20 "GET /compute/v2.1/servers/6fe8d9a6-4cef-4503-866a-be1d337a872c" status: 200 len: 1361 microversion: 2.1 time: 0.154876 Oct 04 19:46:08.830389 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3954/7895] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:46:08 2022] GET /compute/v2.1/servers/6fe8d9a6-4cef-4503-866a-be1d337a872c => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:46:09.854721 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d8f6afb9-0aeb-4e90-b61c-6a98b0e16bd5 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:09.855357 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d8f6afb9-0aeb-4e90-b61c-6a98b0e16bd5 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] [instance: 6fe8d9a6-4cef-4503-866a-be1d337a872c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:09.858244 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=6 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:46:09.863083 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d8f6afb9-0aeb-4e90-b61c-6a98b0e16bd5 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:09.864199 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d8f6afb9-0aeb-4e90-b61c-6a98b0e16bd5 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:09.864199 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d8f6afb9-0aeb-4e90-b61c-6a98b0e16bd5 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:09.864802 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d8f6afb9-0aeb-4e90-b61c-6a98b0e16bd5 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:09.865303 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d8f6afb9-0aeb-4e90-b61c-6a98b0e16bd5 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:09.865756 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d8f6afb9-0aeb-4e90-b61c-6a98b0e16bd5 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:09.996277 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d8f6afb9-0aeb-4e90-b61c-6a98b0e16bd5 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f47ba234baf476aafa923d18266f4c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7e5bbf1a1a408cb25c117ba070f965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:46:10.003963 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d8f6afb9-0aeb-4e90-b61c-6a98b0e16bd5 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] 10.222.0.20 "GET /compute/v2.1/servers/6fe8d9a6-4cef-4503-866a-be1d337a872c" status: 200 len: 1361 microversion: 2.1 time: 0.153819 Oct 04 19:46:10.004585 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3942/7896] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:46:09 2022] GET /compute/v2.1/servers/6fe8d9a6-4cef-4503-866a-be1d337a872c => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:46:10.064109 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-ddeaecd8-16e3-4cdd-87af-be96dfb69569 req-f3790657-f77c-45f0-a205-2646181a5ed4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fe8d9a6-4cef-4503-866a-be1d337a872c", "name": "network-vif-plugged", "status": "completed", "tag": "34a69006-305d-44ba-8528-41f8d2462546"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:46:10.069647 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:46:10.070322 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=6 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:46:10.076598 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-ddeaecd8-16e3-4cdd-87af-be96dfb69569 req-f3790657-f77c-45f0-a205-2646181a5ed4 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:10.077079 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-ddeaecd8-16e3-4cdd-87af-be96dfb69569 req-f3790657-f77c-45f0-a205-2646181a5ed4 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:10.077509 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-ddeaecd8-16e3-4cdd-87af-be96dfb69569 req-f3790657-f77c-45f0-a205-2646181a5ed4 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:10.089250 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-ddeaecd8-16e3-4cdd-87af-be96dfb69569 req-f3790657-f77c-45f0-a205-2646181a5ed4 service nova] Creating event network-vif-plugged:34a69006-305d-44ba-8528-41f8d2462546 for instance 6fe8d9a6-4cef-4503-866a-be1d337a872c on n-h1-850501-14 Oct 04 19:46:10.094261 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-ddeaecd8-16e3-4cdd-87af-be96dfb69569 req-f3790657-f77c-45f0-a205-2646181a5ed4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034040 Oct 04 19:46:10.099927 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3955/7897] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:46:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:46:11.028319 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-baac510f-7ae8-4841-ac9f-18d7b100125b tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:11.028901 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-baac510f-7ae8-4841-ac9f-18d7b100125b tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] [instance: 6fe8d9a6-4cef-4503-866a-be1d337a872c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:11.036078 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-baac510f-7ae8-4841-ac9f-18d7b100125b tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:11.038314 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-baac510f-7ae8-4841-ac9f-18d7b100125b tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:11.038314 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-baac510f-7ae8-4841-ac9f-18d7b100125b tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:11.038314 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-baac510f-7ae8-4841-ac9f-18d7b100125b tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:11.038314 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-baac510f-7ae8-4841-ac9f-18d7b100125b tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:11.038709 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-baac510f-7ae8-4841-ac9f-18d7b100125b tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:11.174438 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-baac510f-7ae8-4841-ac9f-18d7b100125b tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f47ba234baf476aafa923d18266f4c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7e5bbf1a1a408cb25c117ba070f965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:46:11.182866 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-baac510f-7ae8-4841-ac9f-18d7b100125b tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] 10.222.0.20 "GET /compute/v2.1/servers/6fe8d9a6-4cef-4503-866a-be1d337a872c" status: 200 len: 1361 microversion: 2.1 time: 0.158644 Oct 04 19:46:11.183452 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3943/7898] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:46:11 2022] GET /compute/v2.1/servers/6fe8d9a6-4cef-4503-866a-be1d337a872c => generated 1361 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:46:12.208932 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3c76e606-1b27-4592-be91-cdfa43a6e908 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:12.209639 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3c76e606-1b27-4592-be91-cdfa43a6e908 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] [instance: 6fe8d9a6-4cef-4503-866a-be1d337a872c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:12.216688 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3c76e606-1b27-4592-be91-cdfa43a6e908 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:12.217177 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3c76e606-1b27-4592-be91-cdfa43a6e908 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:12.217620 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3c76e606-1b27-4592-be91-cdfa43a6e908 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:12.218316 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3c76e606-1b27-4592-be91-cdfa43a6e908 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:12.218775 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3c76e606-1b27-4592-be91-cdfa43a6e908 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:12.219205 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3c76e606-1b27-4592-be91-cdfa43a6e908 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:12.353874 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3c76e606-1b27-4592-be91-cdfa43a6e908 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f47ba234baf476aafa923d18266f4c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7e5bbf1a1a408cb25c117ba070f965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:46:12.362292 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3c76e606-1b27-4592-be91-cdfa43a6e908 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] 10.222.0.20 "GET /compute/v2.1/servers/6fe8d9a6-4cef-4503-866a-be1d337a872c" status: 200 len: 1553 microversion: 2.1 time: 0.158962 Oct 04 19:46:12.362872 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3956/7899] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:46:12 2022] GET /compute/v2.1/servers/6fe8d9a6-4cef-4503-866a-be1d337a872c => generated 1553 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:46:12.385195 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-07ffadd9-1e8a-40d3-a9ff-08524006e1c6 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:12.385828 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-07ffadd9-1e8a-40d3-a9ff-08524006e1c6 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] [instance: 6fe8d9a6-4cef-4503-866a-be1d337a872c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:12.392924 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-07ffadd9-1e8a-40d3-a9ff-08524006e1c6 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:12.393422 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-07ffadd9-1e8a-40d3-a9ff-08524006e1c6 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:12.393877 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-07ffadd9-1e8a-40d3-a9ff-08524006e1c6 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:12.394582 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-07ffadd9-1e8a-40d3-a9ff-08524006e1c6 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:12.395050 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-07ffadd9-1e8a-40d3-a9ff-08524006e1c6 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:12.395525 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-07ffadd9-1e8a-40d3-a9ff-08524006e1c6 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:12.523751 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-07ffadd9-1e8a-40d3-a9ff-08524006e1c6 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f47ba234baf476aafa923d18266f4c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7e5bbf1a1a408cb25c117ba070f965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:46:12.531539 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-07ffadd9-1e8a-40d3-a9ff-08524006e1c6 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] 10.222.0.20 "GET /compute/v2.1/servers/6fe8d9a6-4cef-4503-866a-be1d337a872c" status: 200 len: 1553 microversion: 2.1 time: 0.150305 Oct 04 19:46:12.532148 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3944/7900] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:46:12 2022] GET /compute/v2.1/servers/6fe8d9a6-4cef-4503-866a-be1d337a872c => generated 1553 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:46:15.663800 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f0a97e3f-2f3f-42bb-90c4-5bfdf638a807 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b14da4d3-3621-4fa1-b1d0-6999354c72bd"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:46:15.666261 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f0a97e3f-2f3f-42bb-90c4-5bfdf638a807 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] [instance: 6fe8d9a6-4cef-4503-866a-be1d337a872c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:15.669189 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:46:15.673792 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f0a97e3f-2f3f-42bb-90c4-5bfdf638a807 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:15.674268 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f0a97e3f-2f3f-42bb-90c4-5bfdf638a807 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:15.674701 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f0a97e3f-2f3f-42bb-90c4-5bfdf638a807 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:15.675382 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f0a97e3f-2f3f-42bb-90c4-5bfdf638a807 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:15.675832 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f0a97e3f-2f3f-42bb-90c4-5bfdf638a807 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:15.676279 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f0a97e3f-2f3f-42bb-90c4-5bfdf638a807 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:15.679908 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:46:16.651537 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f0a97e3f-2f3f-42bb-90c4-5bfdf638a807 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] 10.222.0.20 "POST /compute/v2.1/servers/6fe8d9a6-4cef-4503-866a-be1d337a872c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.991805 Oct 04 19:46:16.652497 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3957/7901] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Oct 4 19:46:15 2022] POST /compute/v2.1/servers/6fe8d9a6-4cef-4503-866a-be1d337a872c/os-volume_attachments => generated 194 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:46:28.436360 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2304c020-7406-4a8e-924f-07c1ba5c6d04 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:28.436879 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2304c020-7406-4a8e-924f-07c1ba5c6d04 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] [instance: 6fe8d9a6-4cef-4503-866a-be1d337a872c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:28.439205 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:46:28.439893 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=72 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:46:28.444702 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2304c020-7406-4a8e-924f-07c1ba5c6d04 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:28.445191 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2304c020-7406-4a8e-924f-07c1ba5c6d04 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:28.445698 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2304c020-7406-4a8e-924f-07c1ba5c6d04 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:28.446410 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2304c020-7406-4a8e-924f-07c1ba5c6d04 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:28.446874 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2304c020-7406-4a8e-924f-07c1ba5c6d04 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:28.447315 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2304c020-7406-4a8e-924f-07c1ba5c6d04 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:28.579545 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-2304c020-7406-4a8e-924f-07c1ba5c6d04 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lazy-loading 'services' on Instance uuid 6fe8d9a6-4cef-4503-866a-be1d337a872c {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:46:28.776908 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2304c020-7406-4a8e-924f-07c1ba5c6d04 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6fe8d9a6-4cef-4503-866a-be1d337a872c/os-volume_attachments/b14da4d3-3621-4fa1-b1d0-6999354c72bd" status: 202 len: 0 microversion: 2.1 time: 0.345221 Oct 04 19:46:28.778117 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3945/7902] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Oct 4 19:46:28 2022] DELETE /compute/v2.1/servers/6fe8d9a6-4cef-4503-866a-be1d337a872c/os-volume_attachments/b14da4d3-3621-4fa1-b1d0-6999354c72bd => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:46:28.788130 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c5b73bc3-04ad-4e32-810f-b1c489df1089 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:28.810830 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c5b73bc3-04ad-4e32-810f-b1c489df1089 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] [instance: 6fe8d9a6-4cef-4503-866a-be1d337a872c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:28.810830 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:46:28.810830 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=10,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:46:28.810830 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c5b73bc3-04ad-4e32-810f-b1c489df1089 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:28.810830 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c5b73bc3-04ad-4e32-810f-b1c489df1089 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:28.810830 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c5b73bc3-04ad-4e32-810f-b1c489df1089 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:28.810830 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c5b73bc3-04ad-4e32-810f-b1c489df1089 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:28.810830 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c5b73bc3-04ad-4e32-810f-b1c489df1089 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:28.810830 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c5b73bc3-04ad-4e32-810f-b1c489df1089 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:28.837084 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c5b73bc3-04ad-4e32-810f-b1c489df1089 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] 10.222.0.20 "GET /compute/v2.1/servers/6fe8d9a6-4cef-4503-866a-be1d337a872c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053954 Oct 04 19:46:28.837578 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3958/7903] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 19:46:28 2022] GET /compute/v2.1/servers/6fe8d9a6-4cef-4503-866a-be1d337a872c/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:46:29.852217 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a73b199b-4905-4e78-9b1b-342e4113681d tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:29.854513 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a73b199b-4905-4e78-9b1b-342e4113681d tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] [instance: 6fe8d9a6-4cef-4503-866a-be1d337a872c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:29.862045 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a73b199b-4905-4e78-9b1b-342e4113681d tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:29.862543 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a73b199b-4905-4e78-9b1b-342e4113681d tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:29.862990 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a73b199b-4905-4e78-9b1b-342e4113681d tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:29.863691 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a73b199b-4905-4e78-9b1b-342e4113681d tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:29.864195 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a73b199b-4905-4e78-9b1b-342e4113681d tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:29.864639 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a73b199b-4905-4e78-9b1b-342e4113681d tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:29.898481 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a73b199b-4905-4e78-9b1b-342e4113681d tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] 10.222.0.20 "GET /compute/v2.1/servers/6fe8d9a6-4cef-4503-866a-be1d337a872c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051869 Oct 04 19:46:29.899050 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3946/7904] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 19:46:29 2022] GET /compute/v2.1/servers/6fe8d9a6-4cef-4503-866a-be1d337a872c/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:46:30.912095 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2791d455-1b1a-41ec-8171-4a54b8309cd9 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:30.914369 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2791d455-1b1a-41ec-8171-4a54b8309cd9 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] [instance: 6fe8d9a6-4cef-4503-866a-be1d337a872c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:30.922777 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2791d455-1b1a-41ec-8171-4a54b8309cd9 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:30.923269 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2791d455-1b1a-41ec-8171-4a54b8309cd9 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:30.923709 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2791d455-1b1a-41ec-8171-4a54b8309cd9 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:30.924431 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2791d455-1b1a-41ec-8171-4a54b8309cd9 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:30.924891 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2791d455-1b1a-41ec-8171-4a54b8309cd9 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:30.925314 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2791d455-1b1a-41ec-8171-4a54b8309cd9 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:30.960283 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2791d455-1b1a-41ec-8171-4a54b8309cd9 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] 10.222.0.20 "GET /compute/v2.1/servers/6fe8d9a6-4cef-4503-866a-be1d337a872c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052968 Oct 04 19:46:30.960846 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3959/7905] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 19:46:30 2022] GET /compute/v2.1/servers/6fe8d9a6-4cef-4503-866a-be1d337a872c/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:46:31.974498 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-060da742-ccc3-497a-bff8-dbf5be0f816d tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:31.976721 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-060da742-ccc3-497a-bff8-dbf5be0f816d tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] [instance: 6fe8d9a6-4cef-4503-866a-be1d337a872c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:31.984254 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-060da742-ccc3-497a-bff8-dbf5be0f816d tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:31.984750 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-060da742-ccc3-497a-bff8-dbf5be0f816d tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:31.985195 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-060da742-ccc3-497a-bff8-dbf5be0f816d tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:31.985904 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-060da742-ccc3-497a-bff8-dbf5be0f816d tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:31.986372 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-060da742-ccc3-497a-bff8-dbf5be0f816d tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:31.986808 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-060da742-ccc3-497a-bff8-dbf5be0f816d tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:32.017538 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-060da742-ccc3-497a-bff8-dbf5be0f816d tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] 10.222.0.20 "GET /compute/v2.1/servers/6fe8d9a6-4cef-4503-866a-be1d337a872c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047348 Oct 04 19:46:32.018124 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3947/7906] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 19:46:31 2022] GET /compute/v2.1/servers/6fe8d9a6-4cef-4503-866a-be1d337a872c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:46:33.030491 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-982f5343-fd43-4553-a473-9656d51301b8 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:33.032615 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-982f5343-fd43-4553-a473-9656d51301b8 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] [instance: 6fe8d9a6-4cef-4503-866a-be1d337a872c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:33.039599 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-982f5343-fd43-4553-a473-9656d51301b8 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:33.040108 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-982f5343-fd43-4553-a473-9656d51301b8 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:33.040555 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-982f5343-fd43-4553-a473-9656d51301b8 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:33.041261 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-982f5343-fd43-4553-a473-9656d51301b8 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:33.041721 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-982f5343-fd43-4553-a473-9656d51301b8 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:33.042154 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-982f5343-fd43-4553-a473-9656d51301b8 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:33.073064 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-982f5343-fd43-4553-a473-9656d51301b8 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] 10.222.0.20 "GET /compute/v2.1/servers/6fe8d9a6-4cef-4503-866a-be1d337a872c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047397 Oct 04 19:46:33.073633 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3960/7907] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 19:46:33 2022] GET /compute/v2.1/servers/6fe8d9a6-4cef-4503-866a-be1d337a872c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:46:34.085617 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d4947bce-62d4-4d19-a874-f569dd8a9491 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:34.087794 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d4947bce-62d4-4d19-a874-f569dd8a9491 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] [instance: 6fe8d9a6-4cef-4503-866a-be1d337a872c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:34.094699 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d4947bce-62d4-4d19-a874-f569dd8a9491 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:34.095224 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d4947bce-62d4-4d19-a874-f569dd8a9491 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:34.095675 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d4947bce-62d4-4d19-a874-f569dd8a9491 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:34.096404 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d4947bce-62d4-4d19-a874-f569dd8a9491 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:34.096875 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d4947bce-62d4-4d19-a874-f569dd8a9491 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:34.097314 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d4947bce-62d4-4d19-a874-f569dd8a9491 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:34.127355 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d4947bce-62d4-4d19-a874-f569dd8a9491 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] 10.222.0.20 "GET /compute/v2.1/servers/6fe8d9a6-4cef-4503-866a-be1d337a872c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045781 Oct 04 19:46:34.127919 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3948/7908] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 19:46:34 2022] GET /compute/v2.1/servers/6fe8d9a6-4cef-4503-866a-be1d337a872c/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 19:46:34.139566 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-76344fa4-1b17-4f30-a6b8-14e1679e0158 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:34.140130 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-76344fa4-1b17-4f30-a6b8-14e1679e0158 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] [instance: 6fe8d9a6-4cef-4503-866a-be1d337a872c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:34.146685 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-76344fa4-1b17-4f30-a6b8-14e1679e0158 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:34.151310 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-76344fa4-1b17-4f30-a6b8-14e1679e0158 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:34.151310 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-76344fa4-1b17-4f30-a6b8-14e1679e0158 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:34.151310 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-76344fa4-1b17-4f30-a6b8-14e1679e0158 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:34.151310 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-76344fa4-1b17-4f30-a6b8-14e1679e0158 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:34.151310 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-76344fa4-1b17-4f30-a6b8-14e1679e0158 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:34.298687 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-76344fa4-1b17-4f30-a6b8-14e1679e0158 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] HTTP exception thrown: Instance 6fe8d9a6-4cef-4503-866a-be1d337a872c is not attached to volume b14da4d3-3621-4fa1-b1d0-6999354c72bd Oct 04 19:46:34.300764 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-76344fa4-1b17-4f30-a6b8-14e1679e0158 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Request method failure captured: Oct 04 19:46:34.300764 n-d-850501-14 devstack@n-api.service[123001]: request: DELETE /compute/v2.1/servers/6fe8d9a6-4cef-4503-866a-be1d337a872c/os-volume_attachments/b14da4d3-3621-4fa1-b1d0-6999354c72bd HTTP/1.1 Oct 04 19:46:34.300764 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 19:46:34.300764 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 19:46:34.300764 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 19:46:34.300764 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 19:46:34.300764 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 19:46:34.300764 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 19:46:34.300764 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 19:46:34.300764 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 19:46:34.300764 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPI0ZjIuZNmctjk_257U0oVHkHOn25x6hSJOyoYjlQ76bCmmbr71JmNxFoTaVYixGauvA8TRbKl_h7ailGynxtR0Nyce9i_PS4mg4c1Z0OwTxz01XgWOmkYa8cS9xc0qZJdaaHxuUhln5SUFHHFQVbrpPHAVk62PKDA5EUBmyHTTJZWY Oct 04 19:46:34.300764 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 19:46:34.300764 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 19:46:34.300764 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 19:46:34.300764 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 19:46:34.300764 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 19:46:34.300764 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 19:46:34.300764 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 9e7e5bbf1a1a408cb25c117ba070f965 Oct 04 19:46:34.300764 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1899659525 Oct 04 19:46:34.300764 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 19:46:34.300764 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 19:46:34.300764 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9e7e5bbf1a1a408cb25c117ba070f965"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9e7e5bbf1a1a408cb25c117ba070f965", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9e7e5bbf1a1a408cb25c117ba070f965"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9e7e5bbf1a1a408cb25c117ba070f965"}]}] Oct 04 19:46:34.300764 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-TestEncryptedCinderVolumes-1899659525 Oct 04 19:46:34.300764 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 9e7e5bbf1a1a408cb25c117ba070f965 Oct 04 19:46:34.300764 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1899659525 Oct 04 19:46:34.300764 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-TestEncryptedCinderVolumes-1899659525-project Oct 04 19:46:34.300764 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 19:46:34.300764 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 19:46:34.300764 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 4f47ba234baf476aafa923d18266f4c8 Oct 04 19:46:34.300764 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-TestEncryptedCinderVolumes-1899659525-project Oct 04 19:46:34.300764 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 19:46:34.300764 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 6fe8d9a6-4cef-4503-866a-be1d337a872c is not attached to volume b14da4d3-3621-4fa1-b1d0-6999354c72bd Oct 04 19:46:34.300764 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'server_id': '6fe8d9a6-4cef-4503-866a-be1d337a872c', 'id': 'b14da4d3-3621-4fa1-b1d0-6999354c72bd'} Oct 04 19:46:34.300764 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:46:34.300764 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:46:34.300764 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 04 19:46:34.300764 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 04 19:46:34.300764 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 19:46:34.300764 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 19:46:34.300764 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 04 19:46:34.300764 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 04 19:46:34.300764 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id b14da4d3-3621-4fa1-b1d0-6999354c72bd. Oct 04 19:46:34.300764 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:46:34.300764 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:46:34.300764 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:46:34.300764 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:46:34.300764 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:46:34.300764 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:46:34.300764 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:46:34.300764 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:46:34.300764 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:46:34.300764 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:46:34.300764 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 04 19:46:34.300764 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 19:46:34.300764 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fe8d9a6-4cef-4503-866a-be1d337a872c is not attached to volume b14da4d3-3621-4fa1-b1d0-6999354c72bd Oct 04 19:46:34.300764 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:46:34.300764 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:46:34.300764 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:46:34.300764 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:46:34.300764 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:46:34.300764 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:46:34.305953 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:46:34.305953 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:46:34.305953 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fe8d9a6-4cef-4503-866a-be1d337a872c is not attached to volume b14da4d3-3621-4fa1-b1d0-6999354c72bd Oct 04 19:46:34.305953 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:46:34.305953 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-76344fa4-1b17-4f30-a6b8-14e1679e0158 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Returning 404 to user: Instance 6fe8d9a6-4cef-4503-866a-be1d337a872c is not attached to volume b14da4d3-3621-4fa1-b1d0-6999354c72bd {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:46:34.305953 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-76344fa4-1b17-4f30-a6b8-14e1679e0158 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6fe8d9a6-4cef-4503-866a-be1d337a872c/os-volume_attachments/b14da4d3-3621-4fa1-b1d0-6999354c72bd" status: 404 len: 154 microversion: 2.1 time: 0.167599 Oct 04 19:46:34.305953 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3961/7909] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Oct 4 19:46:34 2022] DELETE /compute/v2.1/servers/6fe8d9a6-4cef-4503-866a-be1d337a872c/os-volume_attachments/b14da4d3-3621-4fa1-b1d0-6999354c72bd => generated 154 bytes in 169 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:46:37.963864 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7ad9feea-25da-48dd-9f8b-62ebda86ed2f tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:37.964998 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7ad9feea-25da-48dd-9f8b-62ebda86ed2f tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] [instance: 6fe8d9a6-4cef-4503-866a-be1d337a872c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:37.972417 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7ad9feea-25da-48dd-9f8b-62ebda86ed2f tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:37.972870 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7ad9feea-25da-48dd-9f8b-62ebda86ed2f tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:37.973646 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7ad9feea-25da-48dd-9f8b-62ebda86ed2f tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:37.974373 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7ad9feea-25da-48dd-9f8b-62ebda86ed2f tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:37.974854 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7ad9feea-25da-48dd-9f8b-62ebda86ed2f tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:37.975306 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7ad9feea-25da-48dd-9f8b-62ebda86ed2f tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:38.002120 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7ad9feea-25da-48dd-9f8b-62ebda86ed2f tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] [instance: 6fe8d9a6-4cef-4503-866a-be1d337a872c] Going to try to terminate instance {{(pid=123002) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:46:38.315223 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7ad9feea-25da-48dd-9f8b-62ebda86ed2f tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6fe8d9a6-4cef-4503-866a-be1d337a872c" status: 204 len: 0 microversion: 2.1 time: 0.354878 Oct 04 19:46:38.315797 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3949/7910] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 19:46:37 2022] DELETE /compute/v2.1/servers/6fe8d9a6-4cef-4503-866a-be1d337a872c => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:46:38.326020 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4417787b-7bb3-4ac6-82d0-d79cfdbe72a0 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:38.326647 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-4417787b-7bb3-4ac6-82d0-d79cfdbe72a0 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] [instance: 6fe8d9a6-4cef-4503-866a-be1d337a872c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:38.334375 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4417787b-7bb3-4ac6-82d0-d79cfdbe72a0 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:38.334859 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4417787b-7bb3-4ac6-82d0-d79cfdbe72a0 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:38.335297 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4417787b-7bb3-4ac6-82d0-d79cfdbe72a0 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:38.335990 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4417787b-7bb3-4ac6-82d0-d79cfdbe72a0 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:38.336518 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4417787b-7bb3-4ac6-82d0-d79cfdbe72a0 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:38.336948 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4417787b-7bb3-4ac6-82d0-d79cfdbe72a0 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:38.481786 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-4417787b-7bb3-4ac6-82d0-d79cfdbe72a0 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f47ba234baf476aafa923d18266f4c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7e5bbf1a1a408cb25c117ba070f965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:46:38.489660 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-4417787b-7bb3-4ac6-82d0-d79cfdbe72a0 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] 10.222.0.20 "GET /compute/v2.1/servers/6fe8d9a6-4cef-4503-866a-be1d337a872c" status: 200 len: 1559 microversion: 2.1 time: 0.167799 Oct 04 19:46:38.490292 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3962/7911] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:46:38 2022] GET /compute/v2.1/servers/6fe8d9a6-4cef-4503-866a-be1d337a872c => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:46:39.514182 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-013b3b2e-95e9-45c4-a85c-877267f79765 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:39.514912 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-013b3b2e-95e9-45c4-a85c-877267f79765 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] [instance: 6fe8d9a6-4cef-4503-866a-be1d337a872c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:39.521937 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-013b3b2e-95e9-45c4-a85c-877267f79765 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:39.522440 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-013b3b2e-95e9-45c4-a85c-877267f79765 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:39.522896 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-013b3b2e-95e9-45c4-a85c-877267f79765 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:39.523610 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-013b3b2e-95e9-45c4-a85c-877267f79765 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:39.524108 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-013b3b2e-95e9-45c4-a85c-877267f79765 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:39.524557 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-013b3b2e-95e9-45c4-a85c-877267f79765 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:39.656272 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-013b3b2e-95e9-45c4-a85c-877267f79765 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f47ba234baf476aafa923d18266f4c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7e5bbf1a1a408cb25c117ba070f965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:46:39.665454 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-013b3b2e-95e9-45c4-a85c-877267f79765 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] 10.222.0.20 "GET /compute/v2.1/servers/6fe8d9a6-4cef-4503-866a-be1d337a872c" status: 200 len: 1559 microversion: 2.1 time: 0.155555 Oct 04 19:46:39.666041 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3950/7912] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:46:39 2022] GET /compute/v2.1/servers/6fe8d9a6-4cef-4503-866a-be1d337a872c => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:46:40.690616 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ba7c4feb-f7a2-4b2a-ae51-ce5a4f8501c3 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:40.691258 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ba7c4feb-f7a2-4b2a-ae51-ce5a4f8501c3 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] [instance: 6fe8d9a6-4cef-4503-866a-be1d337a872c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:40.699752 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ba7c4feb-f7a2-4b2a-ae51-ce5a4f8501c3 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:40.700669 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ba7c4feb-f7a2-4b2a-ae51-ce5a4f8501c3 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:40.701108 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ba7c4feb-f7a2-4b2a-ae51-ce5a4f8501c3 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:40.701842 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ba7c4feb-f7a2-4b2a-ae51-ce5a4f8501c3 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:40.702299 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ba7c4feb-f7a2-4b2a-ae51-ce5a4f8501c3 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:40.702726 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ba7c4feb-f7a2-4b2a-ae51-ce5a4f8501c3 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:40.770177 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-59c94e09-e489-4d78-9e38-165836aae5e6 req-77add72a-914f-4d76-a6f3-e39033b5ad12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fe8d9a6-4cef-4503-866a-be1d337a872c", "name": "network-vif-deleted", "tag": "34a69006-305d-44ba-8528-41f8d2462546"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:46:40.781620 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-59c94e09-e489-4d78-9e38-165836aae5e6 req-77add72a-914f-4d76-a6f3-e39033b5ad12 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:40.782113 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-59c94e09-e489-4d78-9e38-165836aae5e6 req-77add72a-914f-4d76-a6f3-e39033b5ad12 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:40.782560 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-59c94e09-e489-4d78-9e38-165836aae5e6 req-77add72a-914f-4d76-a6f3-e39033b5ad12 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:40.785805 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ba7c4feb-f7a2-4b2a-ae51-ce5a4f8501c3 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f47ba234baf476aafa923d18266f4c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7e5bbf1a1a408cb25c117ba070f965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:46:40.794396 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-59c94e09-e489-4d78-9e38-165836aae5e6 req-77add72a-914f-4d76-a6f3-e39033b5ad12 service nova] Creating event network-vif-deleted:34a69006-305d-44ba-8528-41f8d2462546 for instance 6fe8d9a6-4cef-4503-866a-be1d337a872c on n-h1-850501-14 Oct 04 19:46:40.795263 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ba7c4feb-f7a2-4b2a-ae51-ce5a4f8501c3 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] 10.222.0.20 "GET /compute/v2.1/servers/6fe8d9a6-4cef-4503-866a-be1d337a872c" status: 200 len: 1517 microversion: 2.1 time: 0.108696 Oct 04 19:46:40.795867 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3963/7913] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:46:40 2022] GET /compute/v2.1/servers/6fe8d9a6-4cef-4503-866a-be1d337a872c => generated 1517 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:46:40.810907 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-59c94e09-e489-4d78-9e38-165836aae5e6 req-77add72a-914f-4d76-a6f3-e39033b5ad12 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046020 Oct 04 19:46:40.811518 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3951/7914] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:46:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:46:41.820169 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6e702e95-7004-4d91-873e-1c5d0af27727 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:41.820769 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6e702e95-7004-4d91-873e-1c5d0af27727 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] [instance: 6fe8d9a6-4cef-4503-866a-be1d337a872c] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:41.827698 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6e702e95-7004-4d91-873e-1c5d0af27727 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:41.835183 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6e702e95-7004-4d91-873e-1c5d0af27727 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:41.835183 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6e702e95-7004-4d91-873e-1c5d0af27727 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:41.835183 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6e702e95-7004-4d91-873e-1c5d0af27727 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:41.835183 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6e702e95-7004-4d91-873e-1c5d0af27727 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:41.835183 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6e702e95-7004-4d91-873e-1c5d0af27727 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:41.863526 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6e702e95-7004-4d91-873e-1c5d0af27727 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:41.864079 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6e702e95-7004-4d91-873e-1c5d0af27727 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:41.864528 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6e702e95-7004-4d91-873e-1c5d0af27727 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:41.864980 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-6e702e95-7004-4d91-873e-1c5d0af27727 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lazy-loading 'fault' on Instance uuid 6fe8d9a6-4cef-4503-866a-be1d337a872c {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:46:41.906750 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6e702e95-7004-4d91-873e-1c5d0af27727 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f47ba234baf476aafa923d18266f4c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7e5bbf1a1a408cb25c117ba070f965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:46:41.913650 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6e702e95-7004-4d91-873e-1c5d0af27727 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] 10.222.0.20 "GET /compute/v2.1/servers/6fe8d9a6-4cef-4503-866a-be1d337a872c" status: 200 len: 1351 microversion: 2.1 time: 0.097427 Oct 04 19:46:41.914228 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3964/7915] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:46:41 2022] GET /compute/v2.1/servers/6fe8d9a6-4cef-4503-866a-be1d337a872c => generated 1351 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:46:42.940093 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-eb600057-323d-4223-b94d-1bb31a370934 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:42.940743 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-eb600057-323d-4223-b94d-1bb31a370934 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] [instance: 6fe8d9a6-4cef-4503-866a-be1d337a872c] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:42.946962 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eb600057-323d-4223-b94d-1bb31a370934 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:42.947480 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eb600057-323d-4223-b94d-1bb31a370934 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:42.947931 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eb600057-323d-4223-b94d-1bb31a370934 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:42.949186 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eb600057-323d-4223-b94d-1bb31a370934 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:42.949667 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eb600057-323d-4223-b94d-1bb31a370934 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:42.950112 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eb600057-323d-4223-b94d-1bb31a370934 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:42.966832 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-eb600057-323d-4223-b94d-1bb31a370934 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] HTTP exception thrown: Instance 6fe8d9a6-4cef-4503-866a-be1d337a872c could not be found. Oct 04 19:46:42.968514 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-eb600057-323d-4223-b94d-1bb31a370934 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Request method failure captured: Oct 04 19:46:42.968514 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/6fe8d9a6-4cef-4503-866a-be1d337a872c HTTP/1.1 Oct 04 19:46:42.968514 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 19:46:42.968514 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 19:46:42.968514 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 19:46:42.968514 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 19:46:42.968514 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 19:46:42.968514 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 19:46:42.968514 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 19:46:42.968514 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 19:46:42.968514 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPI0ZjIuZNmctjk_257U0oVHkHOn25x6hSJOyoYjlQ76bCmmbr71JmNxFoTaVYixGauvA8TRbKl_h7ailGynxtR0Nyce9i_PS4mg4c1Z0OwTxz01XgWOmkYa8cS9xc0qZJdaaHxuUhln5SUFHHFQVbrpPHAVk62PKDA5EUBmyHTTJZWY Oct 04 19:46:42.968514 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 19:46:42.968514 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 19:46:42.968514 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 19:46:42.968514 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 19:46:42.968514 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 19:46:42.968514 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 19:46:42.968514 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 9e7e5bbf1a1a408cb25c117ba070f965 Oct 04 19:46:42.968514 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1899659525 Oct 04 19:46:42.968514 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 19:46:42.968514 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 19:46:42.968514 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9e7e5bbf1a1a408cb25c117ba070f965"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9e7e5bbf1a1a408cb25c117ba070f965", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9e7e5bbf1a1a408cb25c117ba070f965"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9e7e5bbf1a1a408cb25c117ba070f965"}]}] Oct 04 19:46:42.968514 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-TestEncryptedCinderVolumes-1899659525 Oct 04 19:46:42.968514 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 9e7e5bbf1a1a408cb25c117ba070f965 Oct 04 19:46:42.968514 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1899659525 Oct 04 19:46:42.968514 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-TestEncryptedCinderVolumes-1899659525-project Oct 04 19:46:42.968514 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 19:46:42.968514 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 19:46:42.968514 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: 4f47ba234baf476aafa923d18266f4c8 Oct 04 19:46:42.968514 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-TestEncryptedCinderVolumes-1899659525-project Oct 04 19:46:42.968514 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 19:46:42.968514 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 6fe8d9a6-4cef-4503-866a-be1d337a872c could not be found. Oct 04 19:46:42.968514 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '6fe8d9a6-4cef-4503-866a-be1d337a872c'} Oct 04 19:46:42.968514 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:46:42.968514 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:46:42.968514 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:46:42.968514 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:46:42.968514 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:46:42.968514 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:46:42.968514 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:46:42.968514 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:46:42.968514 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:46:42.968514 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:46:42.968514 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fe8d9a6-4cef-4503-866a-be1d337a872c could not be found. Oct 04 19:46:42.968514 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:46:42.968514 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:46:42.968514 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:46:42.968514 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:46:42.968514 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:46:42.968514 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:46:42.968514 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:46:42.968514 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:46:42.968514 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:46:42.968514 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:46:42.968514 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:46:42.968514 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:46:42.968514 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:46:42.968514 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:46:42.968514 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:46:42.968514 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:46:42.968514 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fe8d9a6-4cef-4503-866a-be1d337a872c could not be found. Oct 04 19:46:42.968514 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:46:42.968514 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:46:42.972852 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:46:42.972852 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:46:42.972852 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:46:42.972852 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:46:42.972852 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:46:42.972852 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:46:42.972852 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fe8d9a6-4cef-4503-866a-be1d337a872c could not be found. Oct 04 19:46:42.972852 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 19:46:42.972852 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-eb600057-323d-4223-b94d-1bb31a370934 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Returning 404 to user: Instance 6fe8d9a6-4cef-4503-866a-be1d337a872c could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:46:42.972852 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-eb600057-323d-4223-b94d-1bb31a370934 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] 10.222.0.20 "GET /compute/v2.1/servers/6fe8d9a6-4cef-4503-866a-be1d337a872c" status: 404 len: 111 microversion: 2.1 time: 0.035213 Oct 04 19:46:42.972852 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3952/7916] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:46:42 2022] GET /compute/v2.1/servers/6fe8d9a6-4cef-4503-866a-be1d337a872c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:46:42.978934 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-bd1a8feb-1197-4685-a45f-c250d3649b54 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] Calling method '.version_select at 0x7fe2580b4ee0>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:43.099808 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-bd1a8feb-1197-4685-a45f-c250d3649b54 tempest-TestEncryptedCinderVolumes-1899659525 tempest-TestEncryptedCinderVolumes-1899659525-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-588873962" status: 202 len: 0 microversion: 2.1 time: 0.124725 Oct 04 19:46:43.100428 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3965/7917] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Oct 4 19:46:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-588873962 => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:47:18.142670 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8d07c455-2abd-4609-b425-7f6c74cdde2d tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Action: 'create', calling method: .version_select at 0x7fe253d91c10>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-900176658", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEnsTX0OOzN5fEmzSfxQZldy1zDdHznZ2slsHnlWRWR26Ns/Q06Rqm/moE425G0uue3MMTiTwoJ3t2FEjVMpX1ugASprvTzFMZSNLgvAY0s+ViohoO5AKcw6QXW7lCZgYQ=="}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:47:18.148509 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:47:18.149189 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:47:18.161551 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-8d07c455-2abd-4609-b425-7f6c74cdde2d tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Getting quotas for project 9ccdc7fa868e497e9bc1b3e32fd09da8. Resources: {'key_pairs'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:47:18.167120 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-8d07c455-2abd-4609-b425-7f6c74cdde2d tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Getting quotas for user cd393b496ef146b2a4eb784f8b314259 and project 9ccdc7fa868e497e9bc1b3e32fd09da8. Resources: {'key_pairs'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:47:18.351217 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8d07c455-2abd-4609-b425-7f6c74cdde2d tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.212891 Oct 04 19:47:18.351834 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3953/7918] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Oct 4 19:47:18 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:47:18.404621 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=44 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:47:18.407484 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:47:18.410338 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-82f00f30-7999-447a-9374-12c246c069f6 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-200777653", "imageRef": "9d43234b-4a4b-4e53-a22f-b8bd0f873082", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-900176658", "networks": [{"uuid": "45a325ef-e382-4005-8320-cf5eb87f1be8"}]}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:47:18.464959 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.neutron [None req-82f00f30-7999-447a-9374-12c246c069f6 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] validate_networks() for [('45a325ef-e382-4005-8320-cf5eb87f1be8', None, None, None, None, None)] {{(pid=123001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:47:18.855820 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-82f00f30-7999-447a-9374-12c246c069f6 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:47:18.856295 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-82f00f30-7999-447a-9374-12c246c069f6 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:47:18.856783 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-82f00f30-7999-447a-9374-12c246c069f6 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:47:18.857221 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-82f00f30-7999-447a-9374-12c246c069f6 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:47:18.857638 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-82f00f30-7999-447a-9374-12c246c069f6 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:47:18.866534 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-82f00f30-7999-447a-9374-12c246c069f6 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:18.867017 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-82f00f30-7999-447a-9374-12c246c069f6 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:18.867451 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-82f00f30-7999-447a-9374-12c246c069f6 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:18.868220 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-82f00f30-7999-447a-9374-12c246c069f6 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:18.868704 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-82f00f30-7999-447a-9374-12c246c069f6 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:18.869177 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-82f00f30-7999-447a-9374-12c246c069f6 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:18.886716 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-82f00f30-7999-447a-9374-12c246c069f6 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Getting quotas for project 9ccdc7fa868e497e9bc1b3e32fd09da8. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:47:18.891974 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-82f00f30-7999-447a-9374-12c246c069f6 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Getting quotas for user cd393b496ef146b2a4eb784f8b314259 and project 9ccdc7fa868e497e9bc1b3e32fd09da8. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:47:18.912874 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-82f00f30-7999-447a-9374-12c246c069f6 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Going to run 1 instances... {{(pid=123001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:47:18.912874 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-82f00f30-7999-447a-9374-12c246c069f6 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9d43234b-4a4b-4e53-a22f-b8bd0f873082',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:47:19.074762 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-82f00f30-7999-447a-9374-12c246c069f6 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.673834 Oct 04 19:47:19.097224 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3966/7919] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 19:47:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 681 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:47:19.097434 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e313857e-ce6d-4a85-87fe-187731a2c7fb tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:47:19.097434 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e313857e-ce6d-4a85-87fe-187731a2c7fb tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:47:19.161035 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e313857e-ce6d-4a85-87fe-187731a2c7fb tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd393b496ef146b2a4eb784f8b314259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccdc7fa868e497e9bc1b3e32fd09da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:47:19.168818 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e313857e-ce6d-4a85-87fe-187731a2c7fb tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "GET /compute/v2.1/servers/a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a" status: 200 len: 1257 microversion: 2.1 time: 0.086175 Oct 04 19:47:19.189619 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3954/7920] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:47:19 2022] GET /compute/v2.1/servers/a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a => generated 1257 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:47:20.193293 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6ffe15cb-8f0e-452b-ae64-669ae39f7e73 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:47:20.193888 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6ffe15cb-8f0e-452b-ae64-669ae39f7e73 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:47:20.254342 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6ffe15cb-8f0e-452b-ae64-669ae39f7e73 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd393b496ef146b2a4eb784f8b314259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccdc7fa868e497e9bc1b3e32fd09da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:47:20.261561 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6ffe15cb-8f0e-452b-ae64-669ae39f7e73 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "GET /compute/v2.1/servers/a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a" status: 200 len: 1257 microversion: 2.1 time: 0.073123 Oct 04 19:47:20.262147 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3967/7921] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:47:20 2022] GET /compute/v2.1/servers/a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a => generated 1257 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:47:21.285294 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c18108d0-2bda-4d58-992b-aff60ff244ad tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:47:21.286080 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c18108d0-2bda-4d58-992b-aff60ff244ad tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:47:21.296980 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c18108d0-2bda-4d58-992b-aff60ff244ad tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:21.297484 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c18108d0-2bda-4d58-992b-aff60ff244ad tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:21.297937 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c18108d0-2bda-4d58-992b-aff60ff244ad tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:21.298662 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c18108d0-2bda-4d58-992b-aff60ff244ad tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:21.299131 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c18108d0-2bda-4d58-992b-aff60ff244ad tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:21.299574 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c18108d0-2bda-4d58-992b-aff60ff244ad tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:21.362320 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c18108d0-2bda-4d58-992b-aff60ff244ad tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd393b496ef146b2a4eb784f8b314259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccdc7fa868e497e9bc1b3e32fd09da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:47:21.371176 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c18108d0-2bda-4d58-992b-aff60ff244ad tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "GET /compute/v2.1/servers/a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a" status: 200 len: 1253 microversion: 2.1 time: 0.090058 Oct 04 19:47:21.372159 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3955/7922] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:47:21 2022] GET /compute/v2.1/servers/a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a => generated 1253 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:47:22.395120 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-324a576e-b3b3-444a-9056-92945c0a0168 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:47:22.395850 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-324a576e-b3b3-444a-9056-92945c0a0168 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:47:22.403072 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-324a576e-b3b3-444a-9056-92945c0a0168 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:22.403568 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-324a576e-b3b3-444a-9056-92945c0a0168 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:22.404006 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-324a576e-b3b3-444a-9056-92945c0a0168 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:22.405649 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-324a576e-b3b3-444a-9056-92945c0a0168 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:22.406173 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-324a576e-b3b3-444a-9056-92945c0a0168 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:22.406672 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-324a576e-b3b3-444a-9056-92945c0a0168 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:22.476956 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-324a576e-b3b3-444a-9056-92945c0a0168 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd393b496ef146b2a4eb784f8b314259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccdc7fa868e497e9bc1b3e32fd09da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:47:22.485852 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-324a576e-b3b3-444a-9056-92945c0a0168 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "GET /compute/v2.1/servers/a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a" status: 200 len: 1327 microversion: 2.1 time: 0.094768 Oct 04 19:47:22.488273 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3968/7923] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:47:22 2022] GET /compute/v2.1/servers/a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a => generated 1327 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:47:23.522977 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-54691cb3-5ae2-46e4-a9d5-5aa09ec987db tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:47:23.522977 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-54691cb3-5ae2-46e4-a9d5-5aa09ec987db tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:47:23.541949 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-54691cb3-5ae2-46e4-a9d5-5aa09ec987db tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:23.542467 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-54691cb3-5ae2-46e4-a9d5-5aa09ec987db tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:23.546244 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-54691cb3-5ae2-46e4-a9d5-5aa09ec987db tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:23.547403 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-54691cb3-5ae2-46e4-a9d5-5aa09ec987db tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:23.548219 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-54691cb3-5ae2-46e4-a9d5-5aa09ec987db tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:23.548953 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-54691cb3-5ae2-46e4-a9d5-5aa09ec987db tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:23.838968 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-54691cb3-5ae2-46e4-a9d5-5aa09ec987db tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd393b496ef146b2a4eb784f8b314259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccdc7fa868e497e9bc1b3e32fd09da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:47:23.850439 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-54691cb3-5ae2-46e4-a9d5-5aa09ec987db tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "GET /compute/v2.1/servers/a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a" status: 200 len: 1357 microversion: 2.1 time: 0.336336 Oct 04 19:47:23.851721 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3956/7924] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:47:23 2022] GET /compute/v2.1/servers/a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a => generated 1357 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:47:24.874572 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c4cd3ad8-6a50-41dc-a8a8-72f3f25233ba tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:47:24.875198 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c4cd3ad8-6a50-41dc-a8a8-72f3f25233ba tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:47:24.893824 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c4cd3ad8-6a50-41dc-a8a8-72f3f25233ba tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:24.894322 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c4cd3ad8-6a50-41dc-a8a8-72f3f25233ba tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:24.896570 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c4cd3ad8-6a50-41dc-a8a8-72f3f25233ba tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:24.896570 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c4cd3ad8-6a50-41dc-a8a8-72f3f25233ba tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:24.896570 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c4cd3ad8-6a50-41dc-a8a8-72f3f25233ba tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:24.896570 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c4cd3ad8-6a50-41dc-a8a8-72f3f25233ba tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:25.062884 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c4cd3ad8-6a50-41dc-a8a8-72f3f25233ba tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd393b496ef146b2a4eb784f8b314259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccdc7fa868e497e9bc1b3e32fd09da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:47:25.070965 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c4cd3ad8-6a50-41dc-a8a8-72f3f25233ba tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "GET /compute/v2.1/servers/a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a" status: 200 len: 1357 microversion: 2.1 time: 0.200252 Oct 04 19:47:25.075658 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3969/7925] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:47:24 2022] GET /compute/v2.1/servers/a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a => generated 1357 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:47:26.094829 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1f7fdd9e-fcaa-4de8-af0f-dc8dc01dd77d tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:47:26.095372 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1f7fdd9e-fcaa-4de8-af0f-dc8dc01dd77d tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:47:26.103262 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1f7fdd9e-fcaa-4de8-af0f-dc8dc01dd77d tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:26.104167 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1f7fdd9e-fcaa-4de8-af0f-dc8dc01dd77d tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:26.104642 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1f7fdd9e-fcaa-4de8-af0f-dc8dc01dd77d tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:26.105384 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1f7fdd9e-fcaa-4de8-af0f-dc8dc01dd77d tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:26.105859 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1f7fdd9e-fcaa-4de8-af0f-dc8dc01dd77d tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:26.106606 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1f7fdd9e-fcaa-4de8-af0f-dc8dc01dd77d tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:26.253264 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1f7fdd9e-fcaa-4de8-af0f-dc8dc01dd77d tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd393b496ef146b2a4eb784f8b314259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccdc7fa868e497e9bc1b3e32fd09da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:47:26.261563 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1f7fdd9e-fcaa-4de8-af0f-dc8dc01dd77d tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "GET /compute/v2.1/servers/a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a" status: 200 len: 1357 microversion: 2.1 time: 0.170743 Oct 04 19:47:26.262228 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3957/7926] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:47:26 2022] GET /compute/v2.1/servers/a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a => generated 1357 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:47:27.286725 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-bf6fcd3d-1798-423c-abd5-74168e35170c tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:47:27.288235 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-bf6fcd3d-1798-423c-abd5-74168e35170c tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:47:27.297706 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bf6fcd3d-1798-423c-abd5-74168e35170c tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:27.298298 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bf6fcd3d-1798-423c-abd5-74168e35170c tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:27.298811 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bf6fcd3d-1798-423c-abd5-74168e35170c tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:27.299596 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bf6fcd3d-1798-423c-abd5-74168e35170c tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:27.300173 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bf6fcd3d-1798-423c-abd5-74168e35170c tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:27.300955 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-bf6fcd3d-1798-423c-abd5-74168e35170c tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:27.441727 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-bf6fcd3d-1798-423c-abd5-74168e35170c tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd393b496ef146b2a4eb784f8b314259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccdc7fa868e497e9bc1b3e32fd09da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:47:27.450506 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-bf6fcd3d-1798-423c-abd5-74168e35170c tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "GET /compute/v2.1/servers/a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a" status: 200 len: 1357 microversion: 2.1 time: 0.168574 Oct 04 19:47:27.451100 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3970/7927] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:47:27 2022] GET /compute/v2.1/servers/a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a => generated 1357 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:47:28.477110 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-95820132-15b5-4087-b020-34f77ee703f4 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:47:28.477912 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-95820132-15b5-4087-b020-34f77ee703f4 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:47:28.485852 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-95820132-15b5-4087-b020-34f77ee703f4 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:28.486369 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-95820132-15b5-4087-b020-34f77ee703f4 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:28.486830 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-95820132-15b5-4087-b020-34f77ee703f4 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:28.487563 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-95820132-15b5-4087-b020-34f77ee703f4 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:28.488078 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-95820132-15b5-4087-b020-34f77ee703f4 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:28.488683 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-95820132-15b5-4087-b020-34f77ee703f4 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:28.663398 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-95820132-15b5-4087-b020-34f77ee703f4 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd393b496ef146b2a4eb784f8b314259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccdc7fa868e497e9bc1b3e32fd09da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:47:28.672347 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-95820132-15b5-4087-b020-34f77ee703f4 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "GET /compute/v2.1/servers/a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a" status: 200 len: 1357 microversion: 2.1 time: 0.199296 Oct 04 19:47:28.673025 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3958/7928] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:47:28 2022] GET /compute/v2.1/servers/a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a => generated 1357 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:47:29.698827 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-86bd9603-f94b-464d-9c47-5f99ce604332 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:47:29.700332 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-86bd9603-f94b-464d-9c47-5f99ce604332 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:47:29.707524 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:47:29.709575 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-86bd9603-f94b-464d-9c47-5f99ce604332 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:29.710311 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-86bd9603-f94b-464d-9c47-5f99ce604332 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:29.711017 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-86bd9603-f94b-464d-9c47-5f99ce604332 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:29.713215 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-86bd9603-f94b-464d-9c47-5f99ce604332 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:29.713943 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-86bd9603-f94b-464d-9c47-5f99ce604332 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:29.714694 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-86bd9603-f94b-464d-9c47-5f99ce604332 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:29.855069 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-86bd9603-f94b-464d-9c47-5f99ce604332 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd393b496ef146b2a4eb784f8b314259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccdc7fa868e497e9bc1b3e32fd09da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:47:29.862746 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-86bd9603-f94b-464d-9c47-5f99ce604332 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "GET /compute/v2.1/servers/a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a" status: 200 len: 1357 microversion: 2.1 time: 0.168895 Oct 04 19:47:29.863310 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3971/7929] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:47:29 2022] GET /compute/v2.1/servers/a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a => generated 1357 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:47:30.888078 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-56f8e9db-2752-4cc4-a66e-99bdd4b72de3 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:47:30.888707 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-56f8e9db-2752-4cc4-a66e-99bdd4b72de3 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:47:30.890644 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=6 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:47:30.896397 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-56f8e9db-2752-4cc4-a66e-99bdd4b72de3 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:30.896900 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-56f8e9db-2752-4cc4-a66e-99bdd4b72de3 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:30.897351 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-56f8e9db-2752-4cc4-a66e-99bdd4b72de3 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:30.898065 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-56f8e9db-2752-4cc4-a66e-99bdd4b72de3 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:30.898572 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-56f8e9db-2752-4cc4-a66e-99bdd4b72de3 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:30.899093 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-56f8e9db-2752-4cc4-a66e-99bdd4b72de3 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:31.048869 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-56f8e9db-2752-4cc4-a66e-99bdd4b72de3 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd393b496ef146b2a4eb784f8b314259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccdc7fa868e497e9bc1b3e32fd09da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:47:31.056738 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-56f8e9db-2752-4cc4-a66e-99bdd4b72de3 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "GET /compute/v2.1/servers/a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a" status: 200 len: 1357 microversion: 2.1 time: 0.173679 Oct 04 19:47:31.057301 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3959/7930] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:47:30 2022] GET /compute/v2.1/servers/a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a => generated 1357 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:47:31.528712 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=8 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:47:31.532939 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-0efd7c6e-d3ae-4b6c-865b-128db06e6bcf req-bb4e811c-fbc8-4b38-b7e3-0a40a505c441 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a", "tag": "855da15d-fabd-4db6-a786-54fa8ecb06d3"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:47:31.542877 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-0efd7c6e-d3ae-4b6c-865b-128db06e6bcf req-bb4e811c-fbc8-4b38-b7e3-0a40a505c441 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:31.545634 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-0efd7c6e-d3ae-4b6c-865b-128db06e6bcf req-bb4e811c-fbc8-4b38-b7e3-0a40a505c441 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:31.545634 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-0efd7c6e-d3ae-4b6c-865b-128db06e6bcf req-bb4e811c-fbc8-4b38-b7e3-0a40a505c441 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:31.554845 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-0efd7c6e-d3ae-4b6c-865b-128db06e6bcf req-bb4e811c-fbc8-4b38-b7e3-0a40a505c441 service nova] Creating event network-changed:855da15d-fabd-4db6-a786-54fa8ecb06d3 for instance a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a on n-h1-850501-14 Oct 04 19:47:31.561075 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-0efd7c6e-d3ae-4b6c-865b-128db06e6bcf req-bb4e811c-fbc8-4b38-b7e3-0a40a505c441 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033666 Oct 04 19:47:31.561617 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3972/7931] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:47:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:47:32.079027 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-bbf43a26-c25c-455e-a6a9-66f963a70e2e tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:47:32.079656 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-bbf43a26-c25c-455e-a6a9-66f963a70e2e tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:47:32.087715 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bbf43a26-c25c-455e-a6a9-66f963a70e2e tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:32.088253 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bbf43a26-c25c-455e-a6a9-66f963a70e2e tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:32.088798 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bbf43a26-c25c-455e-a6a9-66f963a70e2e tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:32.089565 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bbf43a26-c25c-455e-a6a9-66f963a70e2e tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:32.090014 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bbf43a26-c25c-455e-a6a9-66f963a70e2e tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:32.090448 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bbf43a26-c25c-455e-a6a9-66f963a70e2e tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:32.306377 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-bbf43a26-c25c-455e-a6a9-66f963a70e2e tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd393b496ef146b2a4eb784f8b314259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccdc7fa868e497e9bc1b3e32fd09da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:47:32.314451 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-bbf43a26-c25c-455e-a6a9-66f963a70e2e tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "GET /compute/v2.1/servers/a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a" status: 200 len: 1357 microversion: 2.1 time: 0.239334 Oct 04 19:47:32.315039 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3960/7932] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:47:32 2022] GET /compute/v2.1/servers/a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a => generated 1357 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:47:33.339226 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ae22c44a-09cc-434d-849a-7d6a782ce7ef tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:47:33.339933 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ae22c44a-09cc-434d-849a-7d6a782ce7ef tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:47:33.347176 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ae22c44a-09cc-434d-849a-7d6a782ce7ef tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:33.347659 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ae22c44a-09cc-434d-849a-7d6a782ce7ef tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:33.348124 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ae22c44a-09cc-434d-849a-7d6a782ce7ef tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:33.349070 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ae22c44a-09cc-434d-849a-7d6a782ce7ef tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:33.349525 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ae22c44a-09cc-434d-849a-7d6a782ce7ef tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:33.349951 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ae22c44a-09cc-434d-849a-7d6a782ce7ef tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:33.482259 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ae22c44a-09cc-434d-849a-7d6a782ce7ef tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd393b496ef146b2a4eb784f8b314259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccdc7fa868e497e9bc1b3e32fd09da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:47:33.490524 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ae22c44a-09cc-434d-849a-7d6a782ce7ef tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "GET /compute/v2.1/servers/a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a" status: 200 len: 1357 microversion: 2.1 time: 0.156560 Oct 04 19:47:33.491106 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3973/7933] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:47:33 2022] GET /compute/v2.1/servers/a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:47:34.514217 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f2a184c4-1f28-438e-97c1-42ef8de0ad4b tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:47:34.514843 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f2a184c4-1f28-438e-97c1-42ef8de0ad4b tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:47:34.522019 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f2a184c4-1f28-438e-97c1-42ef8de0ad4b tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:34.522508 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f2a184c4-1f28-438e-97c1-42ef8de0ad4b tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:34.522955 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f2a184c4-1f28-438e-97c1-42ef8de0ad4b tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:34.523651 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f2a184c4-1f28-438e-97c1-42ef8de0ad4b tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:34.524147 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f2a184c4-1f28-438e-97c1-42ef8de0ad4b tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:34.525610 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f2a184c4-1f28-438e-97c1-42ef8de0ad4b tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:34.656605 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f2a184c4-1f28-438e-97c1-42ef8de0ad4b tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd393b496ef146b2a4eb784f8b314259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccdc7fa868e497e9bc1b3e32fd09da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:47:34.664279 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f2a184c4-1f28-438e-97c1-42ef8de0ad4b tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "GET /compute/v2.1/servers/a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a" status: 200 len: 1357 microversion: 2.1 time: 0.153968 Oct 04 19:47:34.664882 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3961/7934] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:47:34 2022] GET /compute/v2.1/servers/a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:47:35.686836 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-72f50eb1-993b-4571-99dd-47736afdca91 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:47:35.687434 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-72f50eb1-993b-4571-99dd-47736afdca91 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:47:35.694316 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-72f50eb1-993b-4571-99dd-47736afdca91 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:35.694807 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-72f50eb1-993b-4571-99dd-47736afdca91 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:35.695249 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-72f50eb1-993b-4571-99dd-47736afdca91 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:35.695948 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-72f50eb1-993b-4571-99dd-47736afdca91 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:35.696967 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-72f50eb1-993b-4571-99dd-47736afdca91 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:35.697405 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-72f50eb1-993b-4571-99dd-47736afdca91 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:35.835823 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-72f50eb1-993b-4571-99dd-47736afdca91 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd393b496ef146b2a4eb784f8b314259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccdc7fa868e497e9bc1b3e32fd09da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:47:35.844156 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-72f50eb1-993b-4571-99dd-47736afdca91 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "GET /compute/v2.1/servers/a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a" status: 200 len: 1357 microversion: 2.1 time: 0.161181 Oct 04 19:47:35.844743 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3974/7935] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:47:35 2022] GET /compute/v2.1/servers/a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:47:36.600942 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-5aab24bd-3102-4408-80e4-d78cc7101180 req-8913c576-83ca-455c-a07f-d17f2927d7be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a", "name": "network-vif-plugged", "status": "completed", "tag": "855da15d-fabd-4db6-a786-54fa8ecb06d3"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:47:36.612459 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-5aab24bd-3102-4408-80e4-d78cc7101180 req-8913c576-83ca-455c-a07f-d17f2927d7be service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:36.617191 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-5aab24bd-3102-4408-80e4-d78cc7101180 req-8913c576-83ca-455c-a07f-d17f2927d7be service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:36.617191 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-5aab24bd-3102-4408-80e4-d78cc7101180 req-8913c576-83ca-455c-a07f-d17f2927d7be service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:36.625632 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-5aab24bd-3102-4408-80e4-d78cc7101180 req-8913c576-83ca-455c-a07f-d17f2927d7be service nova] Creating event network-vif-plugged:855da15d-fabd-4db6-a786-54fa8ecb06d3 for instance a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a on n-h1-850501-14 Oct 04 19:47:36.631109 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-5aab24bd-3102-4408-80e4-d78cc7101180 req-8913c576-83ca-455c-a07f-d17f2927d7be service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159454 Oct 04 19:47:36.631713 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3962/7936] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:47:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:47:36.867646 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9cd1902b-44f1-44b9-bc13-c7a87a79db80 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:47:36.868319 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-9cd1902b-44f1-44b9-bc13-c7a87a79db80 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:47:36.875016 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9cd1902b-44f1-44b9-bc13-c7a87a79db80 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:36.875498 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9cd1902b-44f1-44b9-bc13-c7a87a79db80 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:36.875931 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9cd1902b-44f1-44b9-bc13-c7a87a79db80 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:36.876639 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9cd1902b-44f1-44b9-bc13-c7a87a79db80 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:36.877089 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9cd1902b-44f1-44b9-bc13-c7a87a79db80 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:36.877510 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9cd1902b-44f1-44b9-bc13-c7a87a79db80 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:37.016338 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9cd1902b-44f1-44b9-bc13-c7a87a79db80 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd393b496ef146b2a4eb784f8b314259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccdc7fa868e497e9bc1b3e32fd09da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:47:37.024026 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9cd1902b-44f1-44b9-bc13-c7a87a79db80 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "GET /compute/v2.1/servers/a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a" status: 200 len: 1357 microversion: 2.1 time: 0.160701 Oct 04 19:47:37.024614 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3975/7937] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:47:36 2022] GET /compute/v2.1/servers/a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:47:38.049090 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-cd7cfe90-3420-4f2d-b9d2-735893240f00 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:47:38.049760 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-cd7cfe90-3420-4f2d-b9d2-735893240f00 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:47:38.056888 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cd7cfe90-3420-4f2d-b9d2-735893240f00 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:38.067644 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cd7cfe90-3420-4f2d-b9d2-735893240f00 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:38.067644 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cd7cfe90-3420-4f2d-b9d2-735893240f00 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:38.067644 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cd7cfe90-3420-4f2d-b9d2-735893240f00 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:38.067644 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cd7cfe90-3420-4f2d-b9d2-735893240f00 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:38.067644 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cd7cfe90-3420-4f2d-b9d2-735893240f00 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:38.194209 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-cd7cfe90-3420-4f2d-b9d2-735893240f00 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd393b496ef146b2a4eb784f8b314259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccdc7fa868e497e9bc1b3e32fd09da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:47:38.202500 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-cd7cfe90-3420-4f2d-b9d2-735893240f00 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "GET /compute/v2.1/servers/a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a" status: 200 len: 1357 microversion: 2.1 time: 0.159250 Oct 04 19:47:38.203070 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3963/7938] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:47:38 2022] GET /compute/v2.1/servers/a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:47:39.226435 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d2d8ba4d-15eb-4508-96e9-c47f21a9450c tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:47:39.227036 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d2d8ba4d-15eb-4508-96e9-c47f21a9450c tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:47:39.234899 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d2d8ba4d-15eb-4508-96e9-c47f21a9450c tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:39.235386 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d2d8ba4d-15eb-4508-96e9-c47f21a9450c tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:39.235829 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d2d8ba4d-15eb-4508-96e9-c47f21a9450c tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:39.236550 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d2d8ba4d-15eb-4508-96e9-c47f21a9450c tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:39.237014 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d2d8ba4d-15eb-4508-96e9-c47f21a9450c tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:39.237535 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d2d8ba4d-15eb-4508-96e9-c47f21a9450c tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:39.381849 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d2d8ba4d-15eb-4508-96e9-c47f21a9450c tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd393b496ef146b2a4eb784f8b314259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccdc7fa868e497e9bc1b3e32fd09da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:47:39.390034 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d2d8ba4d-15eb-4508-96e9-c47f21a9450c tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "GET /compute/v2.1/servers/a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a" status: 200 len: 1547 microversion: 2.1 time: 0.167831 Oct 04 19:47:39.390602 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3976/7939] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:47:39 2022] GET /compute/v2.1/servers/a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a => generated 1547 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:47:39.413083 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-af2036bd-9e61-4a44-87c9-5ec8f8b680b1 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:47:39.413718 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-af2036bd-9e61-4a44-87c9-5ec8f8b680b1 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:47:39.420923 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-af2036bd-9e61-4a44-87c9-5ec8f8b680b1 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:39.421419 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-af2036bd-9e61-4a44-87c9-5ec8f8b680b1 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:39.421868 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-af2036bd-9e61-4a44-87c9-5ec8f8b680b1 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:39.422572 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-af2036bd-9e61-4a44-87c9-5ec8f8b680b1 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:39.423040 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-af2036bd-9e61-4a44-87c9-5ec8f8b680b1 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:39.423481 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-af2036bd-9e61-4a44-87c9-5ec8f8b680b1 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:39.555257 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-af2036bd-9e61-4a44-87c9-5ec8f8b680b1 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd393b496ef146b2a4eb784f8b314259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccdc7fa868e497e9bc1b3e32fd09da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:47:39.563030 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-af2036bd-9e61-4a44-87c9-5ec8f8b680b1 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "GET /compute/v2.1/servers/a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a" status: 200 len: 1547 microversion: 2.1 time: 0.153857 Oct 04 19:47:39.563612 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3964/7940] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:47:39 2022] GET /compute/v2.1/servers/a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a => generated 1547 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:47:39.585600 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8f4919c9-8025-43f4-ab2e-2df176c6a0cd tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:47:39.590932 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8f4919c9-8025-43f4-ab2e-2df176c6a0cd tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cd393b496ef146b2a4eb784f8b314259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccdc7fa868e497e9bc1b3e32fd09da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:47:39.591694 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8f4919c9-8025-43f4-ab2e-2df176c6a0cd tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Searching by: {'deleted': False, 'project_id': '9ccdc7fa868e497e9bc1b3e32fd09da8'} {{(pid=123001) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 19:47:39.596981 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8f4919c9-8025-43f4-ab2e-2df176c6a0cd tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:39.597453 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8f4919c9-8025-43f4-ab2e-2df176c6a0cd tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:39.597880 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8f4919c9-8025-43f4-ab2e-2df176c6a0cd tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:39.598856 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8f4919c9-8025-43f4-ab2e-2df176c6a0cd tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:39.599302 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8f4919c9-8025-43f4-ab2e-2df176c6a0cd tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:39.599724 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8f4919c9-8025-43f4-ab2e-2df176c6a0cd tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:39.623276 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.multi_cell_list [None req-8f4919c9-8025-43f4-ab2e-2df176c6a0cd tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123001) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 19:47:39.650180 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8f4919c9-8025-43f4-ab2e-2df176c6a0cd tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.068405 Oct 04 19:47:39.650766 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3977/7941] 10.222.0.20 () {58 vars in 1125 bytes} [Tue Oct 4 19:47:39 2022] GET /compute/v2.1/servers => generated 342 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:47:39.663148 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-fdfd57cb-1ff5-46fa-aefb-f95010fe5d21 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:47:39.663777 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-fdfd57cb-1ff5-46fa-aefb-f95010fe5d21 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:47:39.670256 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fdfd57cb-1ff5-46fa-aefb-f95010fe5d21 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:39.670748 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fdfd57cb-1ff5-46fa-aefb-f95010fe5d21 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:39.671198 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fdfd57cb-1ff5-46fa-aefb-f95010fe5d21 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:39.671898 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fdfd57cb-1ff5-46fa-aefb-f95010fe5d21 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:39.672401 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fdfd57cb-1ff5-46fa-aefb-f95010fe5d21 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:39.672845 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fdfd57cb-1ff5-46fa-aefb-f95010fe5d21 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:39.801227 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-fdfd57cb-1ff5-46fa-aefb-f95010fe5d21 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd393b496ef146b2a4eb784f8b314259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccdc7fa868e497e9bc1b3e32fd09da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:47:39.809932 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-fdfd57cb-1ff5-46fa-aefb-f95010fe5d21 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "GET /compute/v2.1/servers/a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a" status: 200 len: 1547 microversion: 2.1 time: 0.150690 Oct 04 19:47:39.810524 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3965/7942] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:47:39 2022] GET /compute/v2.1/servers/a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a => generated 1547 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:47:43.171120 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-12caa6e3-f749-472b-b85b-26f807b33de1 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "58829128-591a-445f-b5d9-75e75587a09d"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:47:43.173626 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-12caa6e3-f749-472b-b85b-26f807b33de1 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:47:43.180485 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-12caa6e3-f749-472b-b85b-26f807b33de1 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:43.180975 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-12caa6e3-f749-472b-b85b-26f807b33de1 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:43.181418 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-12caa6e3-f749-472b-b85b-26f807b33de1 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:43.182112 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-12caa6e3-f749-472b-b85b-26f807b33de1 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:43.182571 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-12caa6e3-f749-472b-b85b-26f807b33de1 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:43.182999 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-12caa6e3-f749-472b-b85b-26f807b33de1 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:44.060868 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-12caa6e3-f749-472b-b85b-26f807b33de1 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "POST /compute/v2.1/servers/a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.893569 Oct 04 19:47:44.061523 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3978/7943] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Oct 4 19:47:43 2022] POST /compute/v2.1/servers/a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a/os-volume_attachments => generated 194 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:47:58.589204 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-736ad853-b539-46f7-90c5-9688ddc32650 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:47:58.589846 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-736ad853-b539-46f7-90c5-9688ddc32650 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:47:58.592351 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:47:58.593705 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=62 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:47:58.598845 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-736ad853-b539-46f7-90c5-9688ddc32650 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:58.599348 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-736ad853-b539-46f7-90c5-9688ddc32650 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:58.599805 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-736ad853-b539-46f7-90c5-9688ddc32650 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:58.600542 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-736ad853-b539-46f7-90c5-9688ddc32650 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:58.601016 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-736ad853-b539-46f7-90c5-9688ddc32650 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:58.601459 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-736ad853-b539-46f7-90c5-9688ddc32650 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:58.738124 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-736ad853-b539-46f7-90c5-9688ddc32650 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd393b496ef146b2a4eb784f8b314259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccdc7fa868e497e9bc1b3e32fd09da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:47:58.746640 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-736ad853-b539-46f7-90c5-9688ddc32650 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "GET /compute/v2.1/servers/a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a" status: 200 len: 1593 microversion: 2.1 time: 0.161407 Oct 04 19:47:58.747213 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3966/7944] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:47:58 2022] GET /compute/v2.1/servers/a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a => generated 1593 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:48:00.887405 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-c88c2f79-7f60-410d-9be3-379574a6a0a4 req-ddf76d22-681d-4e4c-882a-35ed980fd388 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a", "tag": "855da15d-fabd-4db6-a786-54fa8ecb06d3"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:48:00.895232 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:48:00.896205 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:48:00.896998 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:48:00.901693 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-c88c2f79-7f60-410d-9be3-379574a6a0a4 req-ddf76d22-681d-4e4c-882a-35ed980fd388 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:00.907853 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-c88c2f79-7f60-410d-9be3-379574a6a0a4 req-ddf76d22-681d-4e4c-882a-35ed980fd388 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:00.907853 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-c88c2f79-7f60-410d-9be3-379574a6a0a4 req-ddf76d22-681d-4e4c-882a-35ed980fd388 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:00.914734 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-c88c2f79-7f60-410d-9be3-379574a6a0a4 req-ddf76d22-681d-4e4c-882a-35ed980fd388 service nova] Creating event network-changed:855da15d-fabd-4db6-a786-54fa8ecb06d3 for instance a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a on n-h1-850501-14 Oct 04 19:48:00.919893 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-c88c2f79-7f60-410d-9be3-379574a6a0a4 req-ddf76d22-681d-4e4c-882a-35ed980fd388 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036583 Oct 04 19:48:00.921019 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3979/7945] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:48:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:48:04.123805 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-fdb9d499-c67e-4f46-851a-463ec35d39fd tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-747956066"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:48:04.125160 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-fdb9d499-c67e-4f46-851a-463ec35d39fd tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:48:04.131339 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fdb9d499-c67e-4f46-851a-463ec35d39fd tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:04.131832 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fdb9d499-c67e-4f46-851a-463ec35d39fd tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:04.132308 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fdb9d499-c67e-4f46-851a-463ec35d39fd tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:04.133007 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fdb9d499-c67e-4f46-851a-463ec35d39fd tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:04.133470 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fdb9d499-c67e-4f46-851a-463ec35d39fd tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:04.133906 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fdb9d499-c67e-4f46-851a-463ec35d39fd tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:04.609540 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.network.security_group_api [None req-fdb9d499-c67e-4f46-851a-463ec35d39fd tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Adding security group 3aa6294a-26b9-47db-b5a9-6d99f98348ae to port 855da15d-fabd-4db6-a786-54fa8ecb06d3 Oct 04 19:48:05.036039 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-fdb9d499-c67e-4f46-851a-463ec35d39fd tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "POST /compute/v2.1/servers/a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a/action" status: 202 len: 0 microversion: 2.1 time: 0.916029 Oct 04 19:48:05.037095 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3967/7946] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 19:48:04 2022] POST /compute/v2.1/servers/a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a/action => generated 0 bytes in 918 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:48:05.045353 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-57122f31-78f1-47ad-af6e-98d95f76168f tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:48:05.045986 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-57122f31-78f1-47ad-af6e-98d95f76168f tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:48:05.047019 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-03432236-8e65-4b70-9bea-45b70031c3cb req-22357502-0b20-4921-bc3a-6a22683a96a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a", "tag": "855da15d-fabd-4db6-a786-54fa8ecb06d3"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:48:05.053415 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-57122f31-78f1-47ad-af6e-98d95f76168f tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:05.054467 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-57122f31-78f1-47ad-af6e-98d95f76168f tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:05.055075 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-57122f31-78f1-47ad-af6e-98d95f76168f tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:05.056221 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-57122f31-78f1-47ad-af6e-98d95f76168f tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:05.056829 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-57122f31-78f1-47ad-af6e-98d95f76168f tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:05.057430 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-57122f31-78f1-47ad-af6e-98d95f76168f tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:05.062771 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-03432236-8e65-4b70-9bea-45b70031c3cb req-22357502-0b20-4921-bc3a-6a22683a96a3 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:05.063769 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-03432236-8e65-4b70-9bea-45b70031c3cb req-22357502-0b20-4921-bc3a-6a22683a96a3 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:05.064445 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-03432236-8e65-4b70-9bea-45b70031c3cb req-22357502-0b20-4921-bc3a-6a22683a96a3 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:05.083337 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-03432236-8e65-4b70-9bea-45b70031c3cb req-22357502-0b20-4921-bc3a-6a22683a96a3 service nova] Creating event network-changed:855da15d-fabd-4db6-a786-54fa8ecb06d3 for instance a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a on n-h1-850501-14 Oct 04 19:48:05.091295 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-03432236-8e65-4b70-9bea-45b70031c3cb req-22357502-0b20-4921-bc3a-6a22683a96a3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050929 Oct 04 19:48:05.092846 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3980/7947] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:48:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:48:05.335990 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-57122f31-78f1-47ad-af6e-98d95f76168f tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd393b496ef146b2a4eb784f8b314259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccdc7fa868e497e9bc1b3e32fd09da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:48:05.345615 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-57122f31-78f1-47ad-af6e-98d95f76168f tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "GET /compute/v2.1/servers/a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a" status: 200 len: 1758 microversion: 2.1 time: 0.304080 Oct 04 19:48:05.346557 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3968/7948] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:48:05 2022] GET /compute/v2.1/servers/a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a => generated 1758 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:49:36.666358 n-d-850501-14 devstack@n-api.service[123001]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:49:36.666864 n-d-850501-14 devstack@n-api.service[123001]: Tue Oct 4 19:49:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a/action (ip 10.222.0.20) !!! Oct 04 19:49:36.672331 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-48efac0f-3bf0-47c4-9ec9-212babacde60 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:49:36.674617 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-48efac0f-3bf0-47c4-9ec9-212babacde60 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:49:36.691346 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-48efac0f-3bf0-47c4-9ec9-212babacde60 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:36.691346 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-48efac0f-3bf0-47c4-9ec9-212babacde60 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:36.691346 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-48efac0f-3bf0-47c4-9ec9-212babacde60 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:36.691346 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-48efac0f-3bf0-47c4-9ec9-212babacde60 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:36.691346 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-48efac0f-3bf0-47c4-9ec9-212babacde60 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:36.691346 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-48efac0f-3bf0-47c4-9ec9-212babacde60 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:36.890426 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-48efac0f-3bf0-47c4-9ec9-212babacde60 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "POST /compute/v2.1/servers/a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a/action" status: 202 len: 0 microversion: 2.1 time: 0.226930 Oct 04 19:49:36.891085 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3981/7949] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 19:49:36 2022] POST /compute/v2.1/servers/a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:49:36.898896 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=6 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:49:36.901726 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=16 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:49:36.901726 n-d-850501-14 devstack@n-api.service[123002]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:49:36.901726 n-d-850501-14 devstack@n-api.service[123002]: Tue Oct 4 19:49:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a (ip 10.222.0.20) !!! Oct 04 19:49:36.906757 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-674ccd36-dc72-4ccc-85ff-545738af967c tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:49:36.907400 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-674ccd36-dc72-4ccc-85ff-545738af967c tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:49:36.921864 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-674ccd36-dc72-4ccc-85ff-545738af967c tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:36.922377 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-674ccd36-dc72-4ccc-85ff-545738af967c tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:36.922842 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-674ccd36-dc72-4ccc-85ff-545738af967c tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:36.923565 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-674ccd36-dc72-4ccc-85ff-545738af967c tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:36.924184 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-674ccd36-dc72-4ccc-85ff-545738af967c tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:36.924638 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-674ccd36-dc72-4ccc-85ff-545738af967c tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:37.080620 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-674ccd36-dc72-4ccc-85ff-545738af967c tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd393b496ef146b2a4eb784f8b314259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccdc7fa868e497e9bc1b3e32fd09da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:49:37.090052 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-674ccd36-dc72-4ccc-85ff-545738af967c tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "GET /compute/v2.1/servers/a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a" status: 200 len: 1760 microversion: 2.1 time: 0.193588 Oct 04 19:49:37.090648 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3969/7950] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:49:36 2022] GET /compute/v2.1/servers/a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a => generated 1760 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:49:38.115604 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-700c436d-2bd6-4dad-9de1-130c3a77f081 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:49:38.116436 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-700c436d-2bd6-4dad-9de1-130c3a77f081 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:49:38.122503 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-700c436d-2bd6-4dad-9de1-130c3a77f081 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:38.122983 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-700c436d-2bd6-4dad-9de1-130c3a77f081 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:38.123414 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-700c436d-2bd6-4dad-9de1-130c3a77f081 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:38.124118 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-700c436d-2bd6-4dad-9de1-130c3a77f081 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:38.124571 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-700c436d-2bd6-4dad-9de1-130c3a77f081 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:38.124994 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-700c436d-2bd6-4dad-9de1-130c3a77f081 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:38.273162 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-700c436d-2bd6-4dad-9de1-130c3a77f081 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd393b496ef146b2a4eb784f8b314259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccdc7fa868e497e9bc1b3e32fd09da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:49:38.281674 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-700c436d-2bd6-4dad-9de1-130c3a77f081 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "GET /compute/v2.1/servers/a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a" status: 200 len: 1765 microversion: 2.1 time: 0.171108 Oct 04 19:49:38.282249 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3982/7951] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:49:38 2022] GET /compute/v2.1/servers/a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a => generated 1765 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:49:39.306362 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c682d725-5655-45ef-bf59-b7d0065ffaf5 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:49:39.306940 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c682d725-5655-45ef-bf59-b7d0065ffaf5 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:49:39.313992 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c682d725-5655-45ef-bf59-b7d0065ffaf5 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:39.314992 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c682d725-5655-45ef-bf59-b7d0065ffaf5 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:39.315521 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c682d725-5655-45ef-bf59-b7d0065ffaf5 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:39.316191 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c682d725-5655-45ef-bf59-b7d0065ffaf5 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:39.316671 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c682d725-5655-45ef-bf59-b7d0065ffaf5 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:39.317116 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c682d725-5655-45ef-bf59-b7d0065ffaf5 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:39.476348 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c682d725-5655-45ef-bf59-b7d0065ffaf5 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd393b496ef146b2a4eb784f8b314259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccdc7fa868e497e9bc1b3e32fd09da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:49:39.484538 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c682d725-5655-45ef-bf59-b7d0065ffaf5 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "GET /compute/v2.1/servers/a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a" status: 200 len: 1758 microversion: 2.1 time: 0.182230 Oct 04 19:49:39.485106 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3970/7952] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:49:39 2022] GET /compute/v2.1/servers/a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a => generated 1758 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:50:52.184232 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=8 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:50:52.185000 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=20,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:50:52.188996 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-37d0b70f-efa3-4f63-a126-5786e7e971fc tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-747956066"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:50:52.189542 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-37d0b70f-efa3-4f63-a126-5786e7e971fc tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:50:52.196326 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-37d0b70f-efa3-4f63-a126-5786e7e971fc tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:50:52.196816 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-37d0b70f-efa3-4f63-a126-5786e7e971fc tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:50:52.197258 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-37d0b70f-efa3-4f63-a126-5786e7e971fc tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:50:52.197956 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-37d0b70f-efa3-4f63-a126-5786e7e971fc tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:50:52.198424 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-37d0b70f-efa3-4f63-a126-5786e7e971fc tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:50:52.198861 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-37d0b70f-efa3-4f63-a126-5786e7e971fc tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:50:52.331013 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.network.security_group_api [None req-37d0b70f-efa3-4f63-a126-5786e7e971fc tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Removing security group 3aa6294a-26b9-47db-b5a9-6d99f98348ae from port 855da15d-fabd-4db6-a786-54fa8ecb06d3 Oct 04 19:50:52.726247 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-37d0b70f-efa3-4f63-a126-5786e7e971fc tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "POST /compute/v2.1/servers/a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a/action" status: 202 len: 0 microversion: 2.1 time: 0.543980 Oct 04 19:50:52.726868 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3983/7953] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 19:50:52 2022] POST /compute/v2.1/servers/a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a/action => generated 0 bytes in 545 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:50:52.746748 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=4 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:50:52.748310 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=12 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:50:52.839492 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-49656a0d-e088-48bb-b08a-8e9dee46f1a4 req-7a950dcc-a62d-4450-aacb-d97d75c70933 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a", "tag": "855da15d-fabd-4db6-a786-54fa8ecb06d3"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:50:52.853326 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-49656a0d-e088-48bb-b08a-8e9dee46f1a4 req-7a950dcc-a62d-4450-aacb-d97d75c70933 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:50:52.853934 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-49656a0d-e088-48bb-b08a-8e9dee46f1a4 req-7a950dcc-a62d-4450-aacb-d97d75c70933 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:50:52.854919 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-49656a0d-e088-48bb-b08a-8e9dee46f1a4 req-7a950dcc-a62d-4450-aacb-d97d75c70933 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:50:52.868471 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-49656a0d-e088-48bb-b08a-8e9dee46f1a4 req-7a950dcc-a62d-4450-aacb-d97d75c70933 service nova] Creating event network-changed:855da15d-fabd-4db6-a786-54fa8ecb06d3 for instance a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a on n-h1-850501-14 Oct 04 19:50:52.872624 n-d-850501-14 devstack@n-api.service[123002]: ERROR oslo.messaging._drivers.impl_rabbit [req-49656a0d-e088-48bb-b08a-8e9dee46f1a4 req-7a950dcc-a62d-4450-aacb-d97d75c70933 service nova] [7e1cdd54-d494-488a-b2b2-b89c0bca72f3] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 19:50:53.881552 n-d-850501-14 devstack@n-api.service[123002]: INFO oslo.messaging._drivers.impl_rabbit [req-49656a0d-e088-48bb-b08a-8e9dee46f1a4 req-7a950dcc-a62d-4450-aacb-d97d75c70933 service nova] [7e1cdd54-d494-488a-b2b2-b89c0bca72f3] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 52756. Oct 04 19:50:53.885153 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-49656a0d-e088-48bb-b08a-8e9dee46f1a4 req-7a950dcc-a62d-4450-aacb-d97d75c70933 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.148446 Oct 04 19:50:53.885790 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3971/7954] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:50:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:50:54.008366 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-89b96dbf-0de4-430a-ad88-6dc050b2cd5a tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:50:54.009006 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-89b96dbf-0de4-430a-ad88-6dc050b2cd5a tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:50:54.015715 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-89b96dbf-0de4-430a-ad88-6dc050b2cd5a tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:50:54.016352 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-89b96dbf-0de4-430a-ad88-6dc050b2cd5a tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:50:54.016892 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-89b96dbf-0de4-430a-ad88-6dc050b2cd5a tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:50:54.017686 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-89b96dbf-0de4-430a-ad88-6dc050b2cd5a tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:50:54.018218 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-89b96dbf-0de4-430a-ad88-6dc050b2cd5a tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:50:54.018723 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-89b96dbf-0de4-430a-ad88-6dc050b2cd5a tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:50:54.107419 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-89b96dbf-0de4-430a-ad88-6dc050b2cd5a tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lazy-loading 'services' on Instance uuid a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:50:54.391664 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-89b96dbf-0de4-430a-ad88-6dc050b2cd5a tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a/os-volume_attachments/58829128-591a-445f-b5d9-75e75587a09d" status: 202 len: 0 microversion: 2.1 time: 0.388904 Oct 04 19:50:54.392312 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3984/7955] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Oct 4 19:50:54 2022] DELETE /compute/v2.1/servers/a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a/os-volume_attachments/58829128-591a-445f-b5d9-75e75587a09d => generated 0 bytes in 391 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:50:54.404121 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b02399af-c5ba-4a3b-9722-590e11486a8d tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:50:54.406893 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b02399af-c5ba-4a3b-9722-590e11486a8d tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:50:54.416045 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b02399af-c5ba-4a3b-9722-590e11486a8d tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:50:54.416767 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b02399af-c5ba-4a3b-9722-590e11486a8d tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:50:54.417217 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b02399af-c5ba-4a3b-9722-590e11486a8d tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:50:54.417943 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b02399af-c5ba-4a3b-9722-590e11486a8d tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:50:54.418429 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b02399af-c5ba-4a3b-9722-590e11486a8d tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:50:54.419063 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b02399af-c5ba-4a3b-9722-590e11486a8d tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:50:54.451001 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b02399af-c5ba-4a3b-9722-590e11486a8d tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "GET /compute/v2.1/servers/a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052997 Oct 04 19:50:54.451592 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3972/7956] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 19:50:54 2022] GET /compute/v2.1/servers/a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:50:55.467531 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-86e22d7d-7247-4007-b020-623f723b6a9e tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:50:55.470199 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-86e22d7d-7247-4007-b020-623f723b6a9e tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:50:55.477791 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-86e22d7d-7247-4007-b020-623f723b6a9e tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:50:55.478433 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-86e22d7d-7247-4007-b020-623f723b6a9e tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:50:55.478941 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-86e22d7d-7247-4007-b020-623f723b6a9e tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:50:55.479811 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-86e22d7d-7247-4007-b020-623f723b6a9e tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:50:55.480322 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-86e22d7d-7247-4007-b020-623f723b6a9e tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:50:55.481450 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-86e22d7d-7247-4007-b020-623f723b6a9e tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:50:55.515085 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-86e22d7d-7247-4007-b020-623f723b6a9e tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "GET /compute/v2.1/servers/a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052944 Oct 04 19:50:55.515662 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3985/7957] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 19:50:55 2022] GET /compute/v2.1/servers/a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:50:55.903553 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-3613060e-efe8-4e7a-8def-528df38c753d req-8e5d1811-1efd-4a99-9ec3-645cd26470c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a", "tag": "855da15d-fabd-4db6-a786-54fa8ecb06d3"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:50:55.922916 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-3613060e-efe8-4e7a-8def-528df38c753d req-8e5d1811-1efd-4a99-9ec3-645cd26470c2 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:50:55.923431 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-3613060e-efe8-4e7a-8def-528df38c753d req-8e5d1811-1efd-4a99-9ec3-645cd26470c2 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:50:55.923925 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-3613060e-efe8-4e7a-8def-528df38c753d req-8e5d1811-1efd-4a99-9ec3-645cd26470c2 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:50:55.942157 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-3613060e-efe8-4e7a-8def-528df38c753d req-8e5d1811-1efd-4a99-9ec3-645cd26470c2 service nova] Creating event network-changed:855da15d-fabd-4db6-a786-54fa8ecb06d3 for instance a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a on n-h1-850501-14 Oct 04 19:50:55.949648 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-3613060e-efe8-4e7a-8def-528df38c753d req-8e5d1811-1efd-4a99-9ec3-645cd26470c2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049425 Oct 04 19:50:55.950339 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3973/7958] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:50:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:50:56.527269 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-aa97ee27-ec58-402e-bff1-304891043621 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:50:56.531175 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-aa97ee27-ec58-402e-bff1-304891043621 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:50:56.539088 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aa97ee27-ec58-402e-bff1-304891043621 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:50:56.539668 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aa97ee27-ec58-402e-bff1-304891043621 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:50:56.540226 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aa97ee27-ec58-402e-bff1-304891043621 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:50:56.541018 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aa97ee27-ec58-402e-bff1-304891043621 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:50:56.541486 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aa97ee27-ec58-402e-bff1-304891043621 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:50:56.541914 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-aa97ee27-ec58-402e-bff1-304891043621 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:50:56.578410 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-aa97ee27-ec58-402e-bff1-304891043621 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "GET /compute/v2.1/servers/a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055171 Oct 04 19:50:56.579044 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3986/7959] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 19:50:56 2022] GET /compute/v2.1/servers/a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:50:57.592562 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8e1a456c-c258-48f4-840a-4fdb34a1aea6 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:50:57.595730 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8e1a456c-c258-48f4-840a-4fdb34a1aea6 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:50:57.603577 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8e1a456c-c258-48f4-840a-4fdb34a1aea6 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:50:57.604131 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8e1a456c-c258-48f4-840a-4fdb34a1aea6 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:50:57.604557 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8e1a456c-c258-48f4-840a-4fdb34a1aea6 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:50:57.605271 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8e1a456c-c258-48f4-840a-4fdb34a1aea6 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:50:57.605738 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8e1a456c-c258-48f4-840a-4fdb34a1aea6 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:50:57.606177 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8e1a456c-c258-48f4-840a-4fdb34a1aea6 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:50:57.647250 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8e1a456c-c258-48f4-840a-4fdb34a1aea6 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "GET /compute/v2.1/servers/a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059400 Oct 04 19:50:57.647840 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3974/7960] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 19:50:57 2022] GET /compute/v2.1/servers/a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:50:58.660213 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-561535af-8b78-47e7-9ba0-7f172b1cb6b0 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:50:58.662816 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-561535af-8b78-47e7-9ba0-7f172b1cb6b0 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:50:58.669835 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-561535af-8b78-47e7-9ba0-7f172b1cb6b0 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:50:58.670316 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-561535af-8b78-47e7-9ba0-7f172b1cb6b0 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:50:58.670751 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-561535af-8b78-47e7-9ba0-7f172b1cb6b0 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:50:58.671447 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-561535af-8b78-47e7-9ba0-7f172b1cb6b0 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:50:58.671906 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-561535af-8b78-47e7-9ba0-7f172b1cb6b0 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:50:58.672358 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-561535af-8b78-47e7-9ba0-7f172b1cb6b0 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:50:58.704638 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-561535af-8b78-47e7-9ba0-7f172b1cb6b0 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "GET /compute/v2.1/servers/a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048424 Oct 04 19:50:58.705200 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3987/7961] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 19:50:58 2022] GET /compute/v2.1/servers/a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:50:59.719166 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ea64e49c-2e41-47a4-9a59-c1f047b53581 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:50:59.722256 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ea64e49c-2e41-47a4-9a59-c1f047b53581 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:50:59.730139 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ea64e49c-2e41-47a4-9a59-c1f047b53581 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:50:59.730647 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ea64e49c-2e41-47a4-9a59-c1f047b53581 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:50:59.731105 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ea64e49c-2e41-47a4-9a59-c1f047b53581 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:50:59.731887 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ea64e49c-2e41-47a4-9a59-c1f047b53581 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:50:59.732401 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ea64e49c-2e41-47a4-9a59-c1f047b53581 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:50:59.732888 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ea64e49c-2e41-47a4-9a59-c1f047b53581 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:50:59.763751 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ea64e49c-2e41-47a4-9a59-c1f047b53581 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "GET /compute/v2.1/servers/a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049837 Oct 04 19:50:59.764352 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3975/7962] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 19:50:59 2022] GET /compute/v2.1/servers/a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 19:50:59.775788 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a5467e2a-1eac-4102-9a56-b1344f884195 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:50:59.776339 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a5467e2a-1eac-4102-9a56-b1344f884195 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:50:59.783115 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a5467e2a-1eac-4102-9a56-b1344f884195 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:50:59.783644 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a5467e2a-1eac-4102-9a56-b1344f884195 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:50:59.784105 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a5467e2a-1eac-4102-9a56-b1344f884195 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:50:59.784802 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a5467e2a-1eac-4102-9a56-b1344f884195 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:50:59.785259 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a5467e2a-1eac-4102-9a56-b1344f884195 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:50:59.785687 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a5467e2a-1eac-4102-9a56-b1344f884195 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:50:59.861411 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-a5467e2a-1eac-4102-9a56-b1344f884195 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] HTTP exception thrown: Instance a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a is not attached to volume 58829128-591a-445f-b5d9-75e75587a09d Oct 04 19:50:59.863034 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a5467e2a-1eac-4102-9a56-b1344f884195 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Request method failure captured: Oct 04 19:50:59.863034 n-d-850501-14 devstack@n-api.service[123001]: request: DELETE /compute/v2.1/servers/a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a/os-volume_attachments/58829128-591a-445f-b5d9-75e75587a09d HTTP/1.1 Oct 04 19:50:59.863034 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 19:50:59.863034 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 19:50:59.863034 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 19:50:59.863034 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 19:50:59.863034 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 19:50:59.863034 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 19:50:59.863034 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 19:50:59.863034 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 19:50:59.863034 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPI2zlegKSbZ0cFPghJWeoLYYgKhy8ReHaL4xP_gfcg46CNy-mQPMGixGZ0B2DaWv-pDzqS5kFeSe0cVGpQ5cVUTA0Gi4s_31WIampxIFZmvVB-4IEGJf54TMwhcKyRuM6UlnU9AzK-NgAxH8wzFeWKIcSpTOZTgDwwtQoqtbu-YGpDg Oct 04 19:50:59.863034 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 19:50:59.863034 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 19:50:59.863034 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 19:50:59.863034 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 19:50:59.863034 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 19:50:59.863034 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 19:50:59.863034 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 9ccdc7fa868e497e9bc1b3e32fd09da8 Oct 04 19:50:59.863034 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-TestMinimumBasicScenario-1244571287 Oct 04 19:50:59.863034 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 19:50:59.863034 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 19:50:59.863034 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9ccdc7fa868e497e9bc1b3e32fd09da8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9ccdc7fa868e497e9bc1b3e32fd09da8", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9ccdc7fa868e497e9bc1b3e32fd09da8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9ccdc7fa868e497e9bc1b3e32fd09da8"}]}] Oct 04 19:50:59.863034 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-TestMinimumBasicScenario-1244571287 Oct 04 19:50:59.863034 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 9ccdc7fa868e497e9bc1b3e32fd09da8 Oct 04 19:50:59.863034 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1244571287 Oct 04 19:50:59.863034 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-TestMinimumBasicScenario-1244571287-project Oct 04 19:50:59.863034 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 19:50:59.863034 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 19:50:59.863034 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: cd393b496ef146b2a4eb784f8b314259 Oct 04 19:50:59.863034 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-TestMinimumBasicScenario-1244571287-project Oct 04 19:50:59.863034 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 19:50:59.863034 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a is not attached to volume 58829128-591a-445f-b5d9-75e75587a09d Oct 04 19:50:59.863034 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'server_id': 'a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a', 'id': '58829128-591a-445f-b5d9-75e75587a09d'} Oct 04 19:50:59.863034 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:50:59.863034 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:50:59.863034 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 04 19:50:59.863034 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 04 19:50:59.863034 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 19:50:59.863034 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 19:50:59.863034 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 04 19:50:59.863034 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 04 19:50:59.863034 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 58829128-591a-445f-b5d9-75e75587a09d. Oct 04 19:50:59.863034 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:50:59.863034 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:50:59.863034 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:50:59.863034 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:50:59.863034 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:50:59.863034 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:50:59.863034 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:50:59.863034 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:50:59.863034 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:50:59.863034 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:50:59.863034 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 04 19:50:59.863034 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 19:50:59.863034 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a is not attached to volume 58829128-591a-445f-b5d9-75e75587a09d Oct 04 19:50:59.863034 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:50:59.863034 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:50:59.863034 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:50:59.863034 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:50:59.863034 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:50:59.863034 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:50:59.868634 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:50:59.868634 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:50:59.868634 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a is not attached to volume 58829128-591a-445f-b5d9-75e75587a09d Oct 04 19:50:59.868634 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:50:59.868634 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a5467e2a-1eac-4102-9a56-b1344f884195 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Returning 404 to user: Instance a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a is not attached to volume 58829128-591a-445f-b5d9-75e75587a09d {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:50:59.868634 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a5467e2a-1eac-4102-9a56-b1344f884195 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a/os-volume_attachments/58829128-591a-445f-b5d9-75e75587a09d" status: 404 len: 154 microversion: 2.1 time: 0.093422 Oct 04 19:50:59.868634 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3988/7963] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Oct 4 19:50:59 2022] DELETE /compute/v2.1/servers/a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a/os-volume_attachments/58829128-591a-445f-b5d9-75e75587a09d => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:51:03.255127 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c7277e7c-fa33-4b55-84a1-22d4b268239a tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:51:03.255636 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c7277e7c-fa33-4b55-84a1-22d4b268239a tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:51:03.263016 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c7277e7c-fa33-4b55-84a1-22d4b268239a tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:51:03.263550 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c7277e7c-fa33-4b55-84a1-22d4b268239a tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:51:03.264005 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c7277e7c-fa33-4b55-84a1-22d4b268239a tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:51:03.264767 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c7277e7c-fa33-4b55-84a1-22d4b268239a tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:51:03.266179 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c7277e7c-fa33-4b55-84a1-22d4b268239a tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:51:03.266179 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c7277e7c-fa33-4b55-84a1-22d4b268239a tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:51:03.295590 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c7277e7c-fa33-4b55-84a1-22d4b268239a tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a] Going to try to terminate instance {{(pid=123002) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:51:03.581762 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c7277e7c-fa33-4b55-84a1-22d4b268239a tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a" status: 204 len: 0 microversion: 2.1 time: 0.330266 Oct 04 19:51:03.582300 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3976/7964] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 19:51:03 2022] DELETE /compute/v2.1/servers/a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:51:03.591510 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f1e1268e-4352-4530-a08d-c024816e5f7a tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:51:03.592768 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f1e1268e-4352-4530-a08d-c024816e5f7a tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:51:03.601820 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f1e1268e-4352-4530-a08d-c024816e5f7a tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:51:03.602320 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f1e1268e-4352-4530-a08d-c024816e5f7a tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:51:03.602759 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f1e1268e-4352-4530-a08d-c024816e5f7a tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:51:03.603467 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f1e1268e-4352-4530-a08d-c024816e5f7a tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:51:03.603931 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f1e1268e-4352-4530-a08d-c024816e5f7a tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:51:03.604389 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f1e1268e-4352-4530-a08d-c024816e5f7a tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:51:03.738580 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f1e1268e-4352-4530-a08d-c024816e5f7a tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd393b496ef146b2a4eb784f8b314259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccdc7fa868e497e9bc1b3e32fd09da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:51:03.746864 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f1e1268e-4352-4530-a08d-c024816e5f7a tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "GET /compute/v2.1/servers/a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a" status: 200 len: 1553 microversion: 2.1 time: 0.159347 Oct 04 19:51:03.747425 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3989/7965] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:51:03 2022] GET /compute/v2.1/servers/a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a => generated 1553 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:51:04.772086 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-bb82fc1d-75b2-4f87-b9b3-a0169150d946 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:51:04.772816 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-bb82fc1d-75b2-4f87-b9b3-a0169150d946 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:51:04.779663 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bb82fc1d-75b2-4f87-b9b3-a0169150d946 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:51:04.780203 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bb82fc1d-75b2-4f87-b9b3-a0169150d946 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:51:04.780662 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bb82fc1d-75b2-4f87-b9b3-a0169150d946 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:51:04.781424 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bb82fc1d-75b2-4f87-b9b3-a0169150d946 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:51:04.781964 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bb82fc1d-75b2-4f87-b9b3-a0169150d946 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:51:04.782413 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bb82fc1d-75b2-4f87-b9b3-a0169150d946 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:51:04.920406 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-bb82fc1d-75b2-4f87-b9b3-a0169150d946 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd393b496ef146b2a4eb784f8b314259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccdc7fa868e497e9bc1b3e32fd09da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:51:04.929217 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-bb82fc1d-75b2-4f87-b9b3-a0169150d946 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "GET /compute/v2.1/servers/a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a" status: 200 len: 1553 microversion: 2.1 time: 0.161786 Oct 04 19:51:04.929804 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3977/7966] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:51:04 2022] GET /compute/v2.1/servers/a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a => generated 1553 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:51:05.702752 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-265dd5c5-398a-42a3-abe7-3a2c80a10330 req-c6c60632-edba-4222-9e48-6867d3b8b1be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a", "name": "network-vif-deleted", "tag": "855da15d-fabd-4db6-a786-54fa8ecb06d3"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:51:05.713858 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-265dd5c5-398a-42a3-abe7-3a2c80a10330 req-c6c60632-edba-4222-9e48-6867d3b8b1be service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:51:05.714348 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-265dd5c5-398a-42a3-abe7-3a2c80a10330 req-c6c60632-edba-4222-9e48-6867d3b8b1be service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:51:05.714789 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-265dd5c5-398a-42a3-abe7-3a2c80a10330 req-c6c60632-edba-4222-9e48-6867d3b8b1be service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:51:05.727720 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-265dd5c5-398a-42a3-abe7-3a2c80a10330 req-c6c60632-edba-4222-9e48-6867d3b8b1be service nova] Creating event network-vif-deleted:855da15d-fabd-4db6-a786-54fa8ecb06d3 for instance a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a on n-h1-850501-14 Oct 04 19:51:05.733135 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-265dd5c5-398a-42a3-abe7-3a2c80a10330 req-c6c60632-edba-4222-9e48-6867d3b8b1be service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034203 Oct 04 19:51:05.733673 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3990/7967] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:51:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:51:05.953340 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2fee9006-d672-403f-bf79-7ac0039884e2 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:51:05.953878 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2fee9006-d672-403f-bf79-7ac0039884e2 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:51:05.961420 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2fee9006-d672-403f-bf79-7ac0039884e2 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:51:05.961896 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2fee9006-d672-403f-bf79-7ac0039884e2 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:51:05.962347 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2fee9006-d672-403f-bf79-7ac0039884e2 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:51:05.963067 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2fee9006-d672-403f-bf79-7ac0039884e2 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:51:05.963504 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2fee9006-d672-403f-bf79-7ac0039884e2 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:51:05.963942 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2fee9006-d672-403f-bf79-7ac0039884e2 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:51:06.035036 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2fee9006-d672-403f-bf79-7ac0039884e2 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd393b496ef146b2a4eb784f8b314259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccdc7fa868e497e9bc1b3e32fd09da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:51:06.043257 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2fee9006-d672-403f-bf79-7ac0039884e2 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "GET /compute/v2.1/servers/a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a" status: 200 len: 1342 microversion: 2.1 time: 0.093898 Oct 04 19:51:06.043842 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3978/7968] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:51:05 2022] GET /compute/v2.1/servers/a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a => generated 1342 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:51:07.068445 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-36cb19d6-0ab0-45b7-b6f8-ec961222c800 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:51:07.069079 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-36cb19d6-0ab0-45b7-b6f8-ec961222c800 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:51:07.075476 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-36cb19d6-0ab0-45b7-b6f8-ec961222c800 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:51:07.076000 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-36cb19d6-0ab0-45b7-b6f8-ec961222c800 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:51:07.076473 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-36cb19d6-0ab0-45b7-b6f8-ec961222c800 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:51:07.077174 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-36cb19d6-0ab0-45b7-b6f8-ec961222c800 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:51:07.077663 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-36cb19d6-0ab0-45b7-b6f8-ec961222c800 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:51:07.078097 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-36cb19d6-0ab0-45b7-b6f8-ec961222c800 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:51:07.092618 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-36cb19d6-0ab0-45b7-b6f8-ec961222c800 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] HTTP exception thrown: Instance a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a could not be found. Oct 04 19:51:07.094268 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-36cb19d6-0ab0-45b7-b6f8-ec961222c800 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Request method failure captured: Oct 04 19:51:07.094268 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a HTTP/1.1 Oct 04 19:51:07.094268 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 19:51:07.094268 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 19:51:07.094268 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 19:51:07.094268 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 19:51:07.094268 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 19:51:07.094268 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 19:51:07.094268 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 19:51:07.094268 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 19:51:07.094268 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPI2zlegKSbZ0cFPghJWeoLYYgKhy8ReHaL4xP_gfcg46CNy-mQPMGixGZ0B2DaWv-pDzqS5kFeSe0cVGpQ5cVUTA0Gi4s_31WIampxIFZmvVB-4IEGJf54TMwhcKyRuM6UlnU9AzK-NgAxH8wzFeWKIcSpTOZTgDwwtQoqtbu-YGpDg Oct 04 19:51:07.094268 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 19:51:07.094268 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 19:51:07.094268 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 19:51:07.094268 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 19:51:07.094268 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 19:51:07.094268 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 19:51:07.094268 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 9ccdc7fa868e497e9bc1b3e32fd09da8 Oct 04 19:51:07.094268 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-TestMinimumBasicScenario-1244571287 Oct 04 19:51:07.094268 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 19:51:07.094268 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 19:51:07.094268 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9ccdc7fa868e497e9bc1b3e32fd09da8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9ccdc7fa868e497e9bc1b3e32fd09da8", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9ccdc7fa868e497e9bc1b3e32fd09da8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9ccdc7fa868e497e9bc1b3e32fd09da8"}]}] Oct 04 19:51:07.094268 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-TestMinimumBasicScenario-1244571287 Oct 04 19:51:07.094268 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 9ccdc7fa868e497e9bc1b3e32fd09da8 Oct 04 19:51:07.094268 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1244571287 Oct 04 19:51:07.094268 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-TestMinimumBasicScenario-1244571287-project Oct 04 19:51:07.094268 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 19:51:07.094268 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 19:51:07.094268 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: cd393b496ef146b2a4eb784f8b314259 Oct 04 19:51:07.094268 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-TestMinimumBasicScenario-1244571287-project Oct 04 19:51:07.094268 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 19:51:07.094268 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a could not be found. Oct 04 19:51:07.094268 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': 'a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a'} Oct 04 19:51:07.094268 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:51:07.094268 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:51:07.094268 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:51:07.094268 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:51:07.094268 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:51:07.094268 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:51:07.094268 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:51:07.094268 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:51:07.094268 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:51:07.094268 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:51:07.094268 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a could not be found. Oct 04 19:51:07.094268 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:51:07.094268 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:51:07.094268 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:51:07.094268 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:51:07.094268 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:51:07.094268 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:51:07.094268 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:51:07.094268 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:51:07.094268 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:51:07.094268 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:51:07.094268 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:51:07.094268 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:51:07.094268 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:51:07.094268 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:51:07.094268 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:51:07.094268 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:51:07.094268 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a could not be found. Oct 04 19:51:07.094268 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:51:07.094268 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:51:07.094268 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:51:07.100652 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:51:07.100652 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:51:07.100652 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:51:07.100652 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:51:07.100652 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:51:07.100652 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a could not be found. Oct 04 19:51:07.100652 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:51:07.100652 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-36cb19d6-0ab0-45b7-b6f8-ec961222c800 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Returning 404 to user: Instance a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:51:07.100652 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-36cb19d6-0ab0-45b7-b6f8-ec961222c800 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "GET /compute/v2.1/servers/a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a" status: 404 len: 111 microversion: 2.1 time: 0.032594 Oct 04 19:51:07.100652 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3991/7969] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:51:07 2022] GET /compute/v2.1/servers/a4e2b6e1-7b6f-4d9b-9387-abde3e09d11a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:51:07.105650 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-bc610156-1b93-4b9a-ae0e-339947b8efd0 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Calling method '.version_select at 0x7fe253d781f0>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:51:07.110231 n-d-850501-14 devstack@n-api.service[123002]: ERROR oslo.messaging._drivers.impl_rabbit [None req-bc610156-1b93-4b9a-ae0e-339947b8efd0 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [aa8a6026-a0ad-4edc-b247-1eb6230d8784] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 19:51:08.118383 n-d-850501-14 devstack@n-api.service[123002]: INFO oslo.messaging._drivers.impl_rabbit [None req-bc610156-1b93-4b9a-ae0e-339947b8efd0 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [aa8a6026-a0ad-4edc-b247-1eb6230d8784] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 52816. Oct 04 19:51:08.202957 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-bc610156-1b93-4b9a-ae0e-339947b8efd0 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-900176658" status: 202 len: 0 microversion: 2.1 time: 1.101117 Oct 04 19:51:08.203547 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3979/7970] 10.222.0.20 () {58 vars in 1269 bytes} [Tue Oct 4 19:51:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-900176658 => generated 0 bytes in 1102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:51:19.867127 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d193afe6-8cd6-41ea-a59d-113025708fe3 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Action: 'create', calling method: .version_select at 0x7fe253d56940>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-155971340", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMuZCJbLqfx5aZcD5AFQozXXXZMN5o2tbKAGZ2YYOanDmIpJ1ofToHLAKhYF5Mv91QuYiuJfbBmINK//HSSLhOET/xrtVHdAQZDiekpwE95jkfPe0/S4fTPHuThrBKStEw=="}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:51:19.873307 n-d-850501-14 devstack@n-api.service[123001]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:51:19.873458 n-d-850501-14 devstack@n-api.service[123001]: Tue Oct 4 19:51:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.20) !!! Oct 04 19:51:19.875562 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=18 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:51:19.876260 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:51:19.893400 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-d193afe6-8cd6-41ea-a59d-113025708fe3 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Getting quotas for project 9ccdc7fa868e497e9bc1b3e32fd09da8. Resources: {'key_pairs'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:51:19.899211 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-d193afe6-8cd6-41ea-a59d-113025708fe3 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Getting quotas for user cd393b496ef146b2a4eb784f8b314259 and project 9ccdc7fa868e497e9bc1b3e32fd09da8. Resources: {'key_pairs'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:51:19.999242 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d193afe6-8cd6-41ea-a59d-113025708fe3 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.136333 Oct 04 19:51:19.999895 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3992/7971] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Oct 4 19:51:19 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:51:20.048429 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:51:20.049794 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:51:20.054481 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-972aa711-7b96-4c38-83c1-38b60536fc1d tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1940401973", "imageRef": "1cbc1cdb-7083-4dfc-98d3-d7be454abc29", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-155971340", "networks": [{"uuid": "45a325ef-e382-4005-8320-cf5eb87f1be8"}]}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:51:20.107227 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-972aa711-7b96-4c38-83c1-38b60536fc1d tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] validate_networks() for [('45a325ef-e382-4005-8320-cf5eb87f1be8', None, None, None, None, None)] {{(pid=123002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:51:20.870112 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-972aa711-7b96-4c38-83c1-38b60536fc1d tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:51:20.870590 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-972aa711-7b96-4c38-83c1-38b60536fc1d tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:51:20.871087 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-972aa711-7b96-4c38-83c1-38b60536fc1d tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:51:20.871519 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-972aa711-7b96-4c38-83c1-38b60536fc1d tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:51:20.871947 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-972aa711-7b96-4c38-83c1-38b60536fc1d tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:51:20.882498 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-972aa711-7b96-4c38-83c1-38b60536fc1d tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:51:20.883003 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-972aa711-7b96-4c38-83c1-38b60536fc1d tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:51:20.883760 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-972aa711-7b96-4c38-83c1-38b60536fc1d tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:51:20.884922 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-972aa711-7b96-4c38-83c1-38b60536fc1d tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:51:20.885282 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-972aa711-7b96-4c38-83c1-38b60536fc1d tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:51:20.885788 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-972aa711-7b96-4c38-83c1-38b60536fc1d tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:51:20.903047 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-972aa711-7b96-4c38-83c1-38b60536fc1d tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Getting quotas for project 9ccdc7fa868e497e9bc1b3e32fd09da8. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:51:20.908746 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-972aa711-7b96-4c38-83c1-38b60536fc1d tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Getting quotas for user cd393b496ef146b2a4eb784f8b314259 and project 9ccdc7fa868e497e9bc1b3e32fd09da8. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:51:20.921355 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-972aa711-7b96-4c38-83c1-38b60536fc1d tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Going to run 1 instances... {{(pid=123002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:51:20.923650 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-972aa711-7b96-4c38-83c1-38b60536fc1d tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: d43d8ac5-175b-40a3-b2cc-812551ccc646] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1cbc1cdb-7083-4dfc-98d3-d7be454abc29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:51:21.034751 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-972aa711-7b96-4c38-83c1-38b60536fc1d tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.988110 Oct 04 19:51:21.036080 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3980/7972] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 19:51:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 990 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:51:21.047438 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3419048f-49cc-49b6-86a5-7ed8b86f9baf tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:51:21.048075 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3419048f-49cc-49b6-86a5-7ed8b86f9baf tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: d43d8ac5-175b-40a3-b2cc-812551ccc646] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:51:21.107106 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3419048f-49cc-49b6-86a5-7ed8b86f9baf tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd393b496ef146b2a4eb784f8b314259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccdc7fa868e497e9bc1b3e32fd09da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:51:21.115484 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3419048f-49cc-49b6-86a5-7ed8b86f9baf tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "GET /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646" status: 200 len: 1258 microversion: 2.1 time: 0.072123 Oct 04 19:51:21.116461 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3993/7973] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:51:21 2022] GET /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646 => generated 1258 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:51:22.138818 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0b921e9f-2c53-4398-b608-59419942adbb tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:51:22.139513 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0b921e9f-2c53-4398-b608-59419942adbb tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: d43d8ac5-175b-40a3-b2cc-812551ccc646] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:51:22.193871 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0b921e9f-2c53-4398-b608-59419942adbb tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd393b496ef146b2a4eb784f8b314259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccdc7fa868e497e9bc1b3e32fd09da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:51:22.201260 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0b921e9f-2c53-4398-b608-59419942adbb tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "GET /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646" status: 200 len: 1258 microversion: 2.1 time: 0.067154 Oct 04 19:51:22.201915 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3981/7974] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:51:22 2022] GET /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646 => generated 1258 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:51:23.225058 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e1dab446-e2ac-4bb0-a13b-a0184cc1ef59 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:51:23.225805 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e1dab446-e2ac-4bb0-a13b-a0184cc1ef59 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: d43d8ac5-175b-40a3-b2cc-812551ccc646] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:51:23.234604 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e1dab446-e2ac-4bb0-a13b-a0184cc1ef59 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:51:23.235086 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e1dab446-e2ac-4bb0-a13b-a0184cc1ef59 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:51:23.235520 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e1dab446-e2ac-4bb0-a13b-a0184cc1ef59 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:51:23.236248 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e1dab446-e2ac-4bb0-a13b-a0184cc1ef59 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:51:23.236697 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e1dab446-e2ac-4bb0-a13b-a0184cc1ef59 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:51:23.237117 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e1dab446-e2ac-4bb0-a13b-a0184cc1ef59 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:51:23.300463 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e1dab446-e2ac-4bb0-a13b-a0184cc1ef59 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd393b496ef146b2a4eb784f8b314259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccdc7fa868e497e9bc1b3e32fd09da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:51:23.308067 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e1dab446-e2ac-4bb0-a13b-a0184cc1ef59 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "GET /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646" status: 200 len: 1310 microversion: 2.1 time: 0.087398 Oct 04 19:51:23.308639 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3994/7975] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:51:23 2022] GET /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646 => generated 1310 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:51:24.332892 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-52fe6a61-3ca9-4a73-93cc-09e2ebfd321a tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:51:24.333521 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-52fe6a61-3ca9-4a73-93cc-09e2ebfd321a tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: d43d8ac5-175b-40a3-b2cc-812551ccc646] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:51:24.349210 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-52fe6a61-3ca9-4a73-93cc-09e2ebfd321a tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:51:24.349210 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-52fe6a61-3ca9-4a73-93cc-09e2ebfd321a tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:51:24.349210 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-52fe6a61-3ca9-4a73-93cc-09e2ebfd321a tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:51:24.349210 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-52fe6a61-3ca9-4a73-93cc-09e2ebfd321a tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:51:24.349210 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-52fe6a61-3ca9-4a73-93cc-09e2ebfd321a tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:51:24.349210 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-52fe6a61-3ca9-4a73-93cc-09e2ebfd321a tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:51:24.524669 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-52fe6a61-3ca9-4a73-93cc-09e2ebfd321a tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd393b496ef146b2a4eb784f8b314259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccdc7fa868e497e9bc1b3e32fd09da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:51:24.543465 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-52fe6a61-3ca9-4a73-93cc-09e2ebfd321a tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "GET /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646" status: 200 len: 1358 microversion: 2.1 time: 0.213384 Oct 04 19:51:24.565078 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3982/7976] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:51:24 2022] GET /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646 => generated 1358 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:51:25.574113 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ecb6cf50-97c8-4d81-931d-79285c28ce6c tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:51:25.574824 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ecb6cf50-97c8-4d81-931d-79285c28ce6c tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: d43d8ac5-175b-40a3-b2cc-812551ccc646] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:51:25.583401 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ecb6cf50-97c8-4d81-931d-79285c28ce6c tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:51:25.584313 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ecb6cf50-97c8-4d81-931d-79285c28ce6c tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:51:25.584975 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ecb6cf50-97c8-4d81-931d-79285c28ce6c tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:51:25.586488 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ecb6cf50-97c8-4d81-931d-79285c28ce6c tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:51:25.587647 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ecb6cf50-97c8-4d81-931d-79285c28ce6c tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:51:25.588980 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ecb6cf50-97c8-4d81-931d-79285c28ce6c tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:51:25.747265 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ecb6cf50-97c8-4d81-931d-79285c28ce6c tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd393b496ef146b2a4eb784f8b314259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccdc7fa868e497e9bc1b3e32fd09da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:51:25.757470 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ecb6cf50-97c8-4d81-931d-79285c28ce6c tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "GET /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646" status: 200 len: 1358 microversion: 2.1 time: 0.187352 Oct 04 19:51:25.758531 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3995/7977] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:51:25 2022] GET /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646 => generated 1358 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:51:26.781721 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-069e977f-94af-435f-9304-b4a282f5c82c tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:51:26.782471 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-069e977f-94af-435f-9304-b4a282f5c82c tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: d43d8ac5-175b-40a3-b2cc-812551ccc646] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:51:26.790903 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-069e977f-94af-435f-9304-b4a282f5c82c tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:51:26.791409 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-069e977f-94af-435f-9304-b4a282f5c82c tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:51:26.791865 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-069e977f-94af-435f-9304-b4a282f5c82c tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:51:26.792620 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-069e977f-94af-435f-9304-b4a282f5c82c tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:51:26.793096 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-069e977f-94af-435f-9304-b4a282f5c82c tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:51:26.793540 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-069e977f-94af-435f-9304-b4a282f5c82c tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:51:26.951062 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-069e977f-94af-435f-9304-b4a282f5c82c tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd393b496ef146b2a4eb784f8b314259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccdc7fa868e497e9bc1b3e32fd09da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:51:26.959809 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-069e977f-94af-435f-9304-b4a282f5c82c tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "GET /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646" status: 200 len: 1358 microversion: 2.1 time: 0.182132 Oct 04 19:51:26.960733 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3983/7978] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:51:26 2022] GET /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646 => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:51:27.983514 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3728a760-c1df-4612-a8c4-9adc1e18d1ff tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:51:27.984250 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3728a760-c1df-4612-a8c4-9adc1e18d1ff tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: d43d8ac5-175b-40a3-b2cc-812551ccc646] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:51:27.993125 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3728a760-c1df-4612-a8c4-9adc1e18d1ff tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:51:27.993625 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3728a760-c1df-4612-a8c4-9adc1e18d1ff tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:51:27.994068 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3728a760-c1df-4612-a8c4-9adc1e18d1ff tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:51:27.995001 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3728a760-c1df-4612-a8c4-9adc1e18d1ff tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:51:27.995458 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3728a760-c1df-4612-a8c4-9adc1e18d1ff tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:51:27.997708 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3728a760-c1df-4612-a8c4-9adc1e18d1ff tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:51:28.144877 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3728a760-c1df-4612-a8c4-9adc1e18d1ff tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd393b496ef146b2a4eb784f8b314259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccdc7fa868e497e9bc1b3e32fd09da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:51:28.153830 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3728a760-c1df-4612-a8c4-9adc1e18d1ff tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "GET /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646" status: 200 len: 1358 microversion: 2.1 time: 0.174493 Oct 04 19:51:28.154415 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3996/7979] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:51:27 2022] GET /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:51:29.179492 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a61c01f3-09a5-424f-92f8-049d8b181fe9 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:51:29.180240 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a61c01f3-09a5-424f-92f8-049d8b181fe9 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: d43d8ac5-175b-40a3-b2cc-812551ccc646] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:51:29.188838 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a61c01f3-09a5-424f-92f8-049d8b181fe9 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:51:29.189404 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a61c01f3-09a5-424f-92f8-049d8b181fe9 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:51:29.189895 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a61c01f3-09a5-424f-92f8-049d8b181fe9 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:51:29.190822 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a61c01f3-09a5-424f-92f8-049d8b181fe9 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:51:29.191863 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a61c01f3-09a5-424f-92f8-049d8b181fe9 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:51:29.192427 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a61c01f3-09a5-424f-92f8-049d8b181fe9 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:51:29.437762 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a61c01f3-09a5-424f-92f8-049d8b181fe9 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd393b496ef146b2a4eb784f8b314259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccdc7fa868e497e9bc1b3e32fd09da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:51:29.446910 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a61c01f3-09a5-424f-92f8-049d8b181fe9 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "GET /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646" status: 200 len: 1358 microversion: 2.1 time: 0.271747 Oct 04 19:51:29.469403 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3984/7980] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:51:29 2022] GET /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646 => generated 1358 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:51:30.478008 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5a90865a-58b6-4ce8-af39-0f1028a339f5 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:51:30.478710 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5a90865a-58b6-4ce8-af39-0f1028a339f5 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: d43d8ac5-175b-40a3-b2cc-812551ccc646] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:51:30.485422 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5a90865a-58b6-4ce8-af39-0f1028a339f5 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:51:30.485902 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5a90865a-58b6-4ce8-af39-0f1028a339f5 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:51:30.486342 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5a90865a-58b6-4ce8-af39-0f1028a339f5 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:51:30.487035 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5a90865a-58b6-4ce8-af39-0f1028a339f5 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:51:30.487492 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5a90865a-58b6-4ce8-af39-0f1028a339f5 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:51:30.488506 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5a90865a-58b6-4ce8-af39-0f1028a339f5 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:51:30.635042 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5a90865a-58b6-4ce8-af39-0f1028a339f5 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd393b496ef146b2a4eb784f8b314259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccdc7fa868e497e9bc1b3e32fd09da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:51:30.643716 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5a90865a-58b6-4ce8-af39-0f1028a339f5 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "GET /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646" status: 200 len: 1358 microversion: 2.1 time: 0.169687 Oct 04 19:51:30.652099 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3997/7981] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:51:30 2022] GET /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:51:31.667604 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-60d61c98-2410-4be1-b58c-c350bff69b40 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:51:31.668275 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-60d61c98-2410-4be1-b58c-c350bff69b40 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: d43d8ac5-175b-40a3-b2cc-812551ccc646] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:51:31.671067 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:51:31.676716 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-60d61c98-2410-4be1-b58c-c350bff69b40 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:51:31.682618 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-60d61c98-2410-4be1-b58c-c350bff69b40 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:51:31.682618 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-60d61c98-2410-4be1-b58c-c350bff69b40 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:51:31.682618 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-60d61c98-2410-4be1-b58c-c350bff69b40 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:51:31.682618 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-60d61c98-2410-4be1-b58c-c350bff69b40 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:51:31.682618 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-60d61c98-2410-4be1-b58c-c350bff69b40 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:51:31.826646 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-60d61c98-2410-4be1-b58c-c350bff69b40 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd393b496ef146b2a4eb784f8b314259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccdc7fa868e497e9bc1b3e32fd09da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:51:31.836223 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-60d61c98-2410-4be1-b58c-c350bff69b40 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "GET /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646" status: 200 len: 1358 microversion: 2.1 time: 0.172374 Oct 04 19:51:31.837056 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3985/7982] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:51:31 2022] GET /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:51:32.860868 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ea26fcb1-68d4-43c1-88cd-e4ddd867de33 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:51:32.861472 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ea26fcb1-68d4-43c1-88cd-e4ddd867de33 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: d43d8ac5-175b-40a3-b2cc-812551ccc646] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:51:32.863948 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=6 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:51:32.870131 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ea26fcb1-68d4-43c1-88cd-e4ddd867de33 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:51:32.870632 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ea26fcb1-68d4-43c1-88cd-e4ddd867de33 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:51:32.871076 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ea26fcb1-68d4-43c1-88cd-e4ddd867de33 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:51:32.871787 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ea26fcb1-68d4-43c1-88cd-e4ddd867de33 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:51:32.872287 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ea26fcb1-68d4-43c1-88cd-e4ddd867de33 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:51:32.872722 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ea26fcb1-68d4-43c1-88cd-e4ddd867de33 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:51:33.062453 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ea26fcb1-68d4-43c1-88cd-e4ddd867de33 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd393b496ef146b2a4eb784f8b314259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccdc7fa868e497e9bc1b3e32fd09da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:51:33.071399 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ea26fcb1-68d4-43c1-88cd-e4ddd867de33 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "GET /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646" status: 200 len: 1358 microversion: 2.1 time: 0.214594 Oct 04 19:51:33.071976 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3998/7983] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:51:32 2022] GET /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646 => generated 1358 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:51:33.231483 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-678558b0-4637-4268-9daf-094acd23e240 req-5d21c22b-2103-4303-a163-22962ae3c76b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d43d8ac5-175b-40a3-b2cc-812551ccc646", "tag": "f3dce3db-75f5-405e-84e9-f9eee39d2a2c"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:51:33.236778 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=8 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:51:33.243312 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-678558b0-4637-4268-9daf-094acd23e240 req-5d21c22b-2103-4303-a163-22962ae3c76b service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:51:33.243816 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-678558b0-4637-4268-9daf-094acd23e240 req-5d21c22b-2103-4303-a163-22962ae3c76b service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:51:33.244313 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-678558b0-4637-4268-9daf-094acd23e240 req-5d21c22b-2103-4303-a163-22962ae3c76b service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:51:33.256425 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-678558b0-4637-4268-9daf-094acd23e240 req-5d21c22b-2103-4303-a163-22962ae3c76b service nova] Creating event network-changed:f3dce3db-75f5-405e-84e9-f9eee39d2a2c for instance d43d8ac5-175b-40a3-b2cc-812551ccc646 on n-h1-850501-14 Oct 04 19:51:33.261621 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-678558b0-4637-4268-9daf-094acd23e240 req-5d21c22b-2103-4303-a163-22962ae3c76b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033926 Oct 04 19:51:33.262230 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3986/7984] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:51:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:51:34.094764 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5515731d-4056-444c-b344-e6827dde0495 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:51:34.095310 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5515731d-4056-444c-b344-e6827dde0495 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: d43d8ac5-175b-40a3-b2cc-812551ccc646] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:51:34.103027 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5515731d-4056-444c-b344-e6827dde0495 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:51:34.103506 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5515731d-4056-444c-b344-e6827dde0495 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:51:34.103938 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5515731d-4056-444c-b344-e6827dde0495 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:51:34.104654 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5515731d-4056-444c-b344-e6827dde0495 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:51:34.105107 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5515731d-4056-444c-b344-e6827dde0495 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:51:34.105531 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5515731d-4056-444c-b344-e6827dde0495 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:51:34.286743 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5515731d-4056-444c-b344-e6827dde0495 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd393b496ef146b2a4eb784f8b314259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccdc7fa868e497e9bc1b3e32fd09da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:51:34.294326 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5515731d-4056-444c-b344-e6827dde0495 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "GET /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646" status: 200 len: 1358 microversion: 2.1 time: 0.203565 Oct 04 19:51:34.294884 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 3999/7985] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:51:34 2022] GET /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646 => generated 1358 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:51:35.319224 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f8bd7819-9538-4ad1-aa31-cebe4303c5e5 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:51:35.319968 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f8bd7819-9538-4ad1-aa31-cebe4303c5e5 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: d43d8ac5-175b-40a3-b2cc-812551ccc646] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:51:35.326471 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f8bd7819-9538-4ad1-aa31-cebe4303c5e5 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:51:35.326973 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f8bd7819-9538-4ad1-aa31-cebe4303c5e5 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:51:35.327432 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f8bd7819-9538-4ad1-aa31-cebe4303c5e5 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:51:35.328271 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f8bd7819-9538-4ad1-aa31-cebe4303c5e5 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:51:35.328745 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f8bd7819-9538-4ad1-aa31-cebe4303c5e5 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:51:35.329192 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f8bd7819-9538-4ad1-aa31-cebe4303c5e5 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:51:35.463824 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f8bd7819-9538-4ad1-aa31-cebe4303c5e5 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd393b496ef146b2a4eb784f8b314259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccdc7fa868e497e9bc1b3e32fd09da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:51:35.471528 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f8bd7819-9538-4ad1-aa31-cebe4303c5e5 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "GET /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646" status: 200 len: 1358 microversion: 2.1 time: 0.157876 Oct 04 19:51:35.472204 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3987/7986] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:51:35 2022] GET /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:51:36.494974 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-034c1e3d-8332-4809-9cc8-f2cd8f658a61 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:51:36.495622 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-034c1e3d-8332-4809-9cc8-f2cd8f658a61 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: d43d8ac5-175b-40a3-b2cc-812551ccc646] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:51:36.502481 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-034c1e3d-8332-4809-9cc8-f2cd8f658a61 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:51:36.502970 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-034c1e3d-8332-4809-9cc8-f2cd8f658a61 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:51:36.503442 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-034c1e3d-8332-4809-9cc8-f2cd8f658a61 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:51:36.504166 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-034c1e3d-8332-4809-9cc8-f2cd8f658a61 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:51:36.504643 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-034c1e3d-8332-4809-9cc8-f2cd8f658a61 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:51:36.505073 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-034c1e3d-8332-4809-9cc8-f2cd8f658a61 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:51:36.633126 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-034c1e3d-8332-4809-9cc8-f2cd8f658a61 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd393b496ef146b2a4eb784f8b314259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccdc7fa868e497e9bc1b3e32fd09da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:51:36.640850 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-034c1e3d-8332-4809-9cc8-f2cd8f658a61 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "GET /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646" status: 200 len: 1358 microversion: 2.1 time: 0.149849 Oct 04 19:51:36.641428 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4000/7987] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:51:36 2022] GET /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:51:37.665224 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9ad4b158-dfe4-486a-b74d-79c02da5f64e tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:51:37.665797 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9ad4b158-dfe4-486a-b74d-79c02da5f64e tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: d43d8ac5-175b-40a3-b2cc-812551ccc646] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:51:37.672878 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9ad4b158-dfe4-486a-b74d-79c02da5f64e tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:51:37.673380 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9ad4b158-dfe4-486a-b74d-79c02da5f64e tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:51:37.673834 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9ad4b158-dfe4-486a-b74d-79c02da5f64e tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:51:37.674550 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9ad4b158-dfe4-486a-b74d-79c02da5f64e tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:51:37.675014 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9ad4b158-dfe4-486a-b74d-79c02da5f64e tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:51:37.675452 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9ad4b158-dfe4-486a-b74d-79c02da5f64e tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:51:37.771179 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-4704be2d-af91-4be2-8a8c-2a8571496d3a req-28c40599-8a01-4cf9-b8bc-f77039a202e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d43d8ac5-175b-40a3-b2cc-812551ccc646", "name": "network-vif-plugged", "status": "completed", "tag": "f3dce3db-75f5-405e-84e9-f9eee39d2a2c"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:51:37.781748 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-4704be2d-af91-4be2-8a8c-2a8571496d3a req-28c40599-8a01-4cf9-b8bc-f77039a202e0 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:51:37.785736 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-4704be2d-af91-4be2-8a8c-2a8571496d3a req-28c40599-8a01-4cf9-b8bc-f77039a202e0 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:51:37.785736 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-4704be2d-af91-4be2-8a8c-2a8571496d3a req-28c40599-8a01-4cf9-b8bc-f77039a202e0 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:51:37.793967 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-4704be2d-af91-4be2-8a8c-2a8571496d3a req-28c40599-8a01-4cf9-b8bc-f77039a202e0 service nova] Creating event network-vif-plugged:f3dce3db-75f5-405e-84e9-f9eee39d2a2c for instance d43d8ac5-175b-40a3-b2cc-812551ccc646 on n-h1-850501-14 Oct 04 19:51:37.799297 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-4704be2d-af91-4be2-8a8c-2a8571496d3a req-28c40599-8a01-4cf9-b8bc-f77039a202e0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032986 Oct 04 19:51:37.799905 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4001/7988] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:51:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:51:37.817572 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9ad4b158-dfe4-486a-b74d-79c02da5f64e tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd393b496ef146b2a4eb784f8b314259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccdc7fa868e497e9bc1b3e32fd09da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:51:37.827117 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9ad4b158-dfe4-486a-b74d-79c02da5f64e tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "GET /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646" status: 200 len: 1358 microversion: 2.1 time: 0.165879 Oct 04 19:51:37.827719 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3988/7989] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:51:37 2022] GET /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:51:38.852607 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-808e8bf3-0e24-4491-8fcf-6710a5de2372 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:51:38.853325 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-808e8bf3-0e24-4491-8fcf-6710a5de2372 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: d43d8ac5-175b-40a3-b2cc-812551ccc646] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:51:38.859517 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-808e8bf3-0e24-4491-8fcf-6710a5de2372 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:51:38.860001 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-808e8bf3-0e24-4491-8fcf-6710a5de2372 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:51:38.860484 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-808e8bf3-0e24-4491-8fcf-6710a5de2372 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:51:38.861180 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-808e8bf3-0e24-4491-8fcf-6710a5de2372 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:51:38.861645 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-808e8bf3-0e24-4491-8fcf-6710a5de2372 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:51:38.862075 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-808e8bf3-0e24-4491-8fcf-6710a5de2372 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:51:39.000609 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-808e8bf3-0e24-4491-8fcf-6710a5de2372 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd393b496ef146b2a4eb784f8b314259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccdc7fa868e497e9bc1b3e32fd09da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:51:39.009436 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-808e8bf3-0e24-4491-8fcf-6710a5de2372 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "GET /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646" status: 200 len: 1358 microversion: 2.1 time: 0.162338 Oct 04 19:51:39.010031 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4002/7990] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:51:38 2022] GET /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:51:40.032694 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9e2a4e95-4c8b-4ed5-8e4a-62cf29076bb4 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:51:40.033240 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9e2a4e95-4c8b-4ed5-8e4a-62cf29076bb4 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: d43d8ac5-175b-40a3-b2cc-812551ccc646] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:51:40.040747 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9e2a4e95-4c8b-4ed5-8e4a-62cf29076bb4 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:51:40.041251 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9e2a4e95-4c8b-4ed5-8e4a-62cf29076bb4 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:51:40.041707 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9e2a4e95-4c8b-4ed5-8e4a-62cf29076bb4 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:51:40.042422 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9e2a4e95-4c8b-4ed5-8e4a-62cf29076bb4 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:51:40.042893 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9e2a4e95-4c8b-4ed5-8e4a-62cf29076bb4 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:51:40.043338 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9e2a4e95-4c8b-4ed5-8e4a-62cf29076bb4 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:51:40.178080 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9e2a4e95-4c8b-4ed5-8e4a-62cf29076bb4 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd393b496ef146b2a4eb784f8b314259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccdc7fa868e497e9bc1b3e32fd09da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:51:40.186006 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9e2a4e95-4c8b-4ed5-8e4a-62cf29076bb4 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "GET /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646" status: 200 len: 1549 microversion: 2.1 time: 0.157380 Oct 04 19:51:40.186585 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3989/7991] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:51:40 2022] GET /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646 => generated 1549 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:51:40.208887 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b1fc9383-8a20-4494-a693-b0f6c7e8cab4 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:51:40.209520 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b1fc9383-8a20-4494-a693-b0f6c7e8cab4 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: d43d8ac5-175b-40a3-b2cc-812551ccc646] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:51:40.216409 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b1fc9383-8a20-4494-a693-b0f6c7e8cab4 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:51:40.216900 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b1fc9383-8a20-4494-a693-b0f6c7e8cab4 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:51:40.217343 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b1fc9383-8a20-4494-a693-b0f6c7e8cab4 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:51:40.218035 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b1fc9383-8a20-4494-a693-b0f6c7e8cab4 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:51:40.218493 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b1fc9383-8a20-4494-a693-b0f6c7e8cab4 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:51:40.218926 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b1fc9383-8a20-4494-a693-b0f6c7e8cab4 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:51:40.346336 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b1fc9383-8a20-4494-a693-b0f6c7e8cab4 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd393b496ef146b2a4eb784f8b314259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccdc7fa868e497e9bc1b3e32fd09da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:51:40.354691 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b1fc9383-8a20-4494-a693-b0f6c7e8cab4 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "GET /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646" status: 200 len: 1549 microversion: 2.1 time: 0.150394 Oct 04 19:51:40.355269 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4003/7992] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:51:40 2022] GET /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646 => generated 1549 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:51:40.377719 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-86f35b2e-a84d-4408-a75c-fd3297f7ea58 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:51:40.382574 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-86f35b2e-a84d-4408-a75c-fd3297f7ea58 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cd393b496ef146b2a4eb784f8b314259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccdc7fa868e497e9bc1b3e32fd09da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:51:40.383923 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-86f35b2e-a84d-4408-a75c-fd3297f7ea58 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Searching by: {'deleted': False, 'project_id': '9ccdc7fa868e497e9bc1b3e32fd09da8'} {{(pid=123002) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 19:51:40.389558 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-86f35b2e-a84d-4408-a75c-fd3297f7ea58 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:51:40.390047 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-86f35b2e-a84d-4408-a75c-fd3297f7ea58 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:51:40.390517 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-86f35b2e-a84d-4408-a75c-fd3297f7ea58 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:51:40.391234 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-86f35b2e-a84d-4408-a75c-fd3297f7ea58 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:51:40.391702 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-86f35b2e-a84d-4408-a75c-fd3297f7ea58 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:51:40.392194 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-86f35b2e-a84d-4408-a75c-fd3297f7ea58 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:51:40.419484 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.multi_cell_list [None req-86f35b2e-a84d-4408-a75c-fd3297f7ea58 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123002) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 19:51:40.446217 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-86f35b2e-a84d-4408-a75c-fd3297f7ea58 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.072327 Oct 04 19:51:40.446808 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3990/7993] 10.222.0.20 () {58 vars in 1125 bytes} [Tue Oct 4 19:51:40 2022] GET /compute/v2.1/servers => generated 343 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:51:40.458529 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0f4c6509-f063-42f0-b08e-656dc7cef20d tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:51:40.459140 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0f4c6509-f063-42f0-b08e-656dc7cef20d tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: d43d8ac5-175b-40a3-b2cc-812551ccc646] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:51:40.465052 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0f4c6509-f063-42f0-b08e-656dc7cef20d tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:51:40.465533 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0f4c6509-f063-42f0-b08e-656dc7cef20d tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:51:40.465957 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0f4c6509-f063-42f0-b08e-656dc7cef20d tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:51:40.466635 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0f4c6509-f063-42f0-b08e-656dc7cef20d tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:51:40.467082 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0f4c6509-f063-42f0-b08e-656dc7cef20d tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:51:40.467503 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0f4c6509-f063-42f0-b08e-656dc7cef20d tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:51:40.599642 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0f4c6509-f063-42f0-b08e-656dc7cef20d tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd393b496ef146b2a4eb784f8b314259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccdc7fa868e497e9bc1b3e32fd09da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:51:40.607731 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0f4c6509-f063-42f0-b08e-656dc7cef20d tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "GET /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646" status: 200 len: 1549 microversion: 2.1 time: 0.153116 Oct 04 19:51:40.608403 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4004/7994] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:51:40 2022] GET /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646 => generated 1549 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:51:43.568908 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-902d77fa-f8b8-4ace-95d6-6b1eef4f98b0 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0745c2d2-5e06-4972-bdf0-62f2353d7809"}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:51:43.571652 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-902d77fa-f8b8-4ace-95d6-6b1eef4f98b0 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: d43d8ac5-175b-40a3-b2cc-812551ccc646] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:51:43.578650 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-902d77fa-f8b8-4ace-95d6-6b1eef4f98b0 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:51:43.579487 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-902d77fa-f8b8-4ace-95d6-6b1eef4f98b0 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:51:43.579630 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-902d77fa-f8b8-4ace-95d6-6b1eef4f98b0 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:51:43.580355 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-902d77fa-f8b8-4ace-95d6-6b1eef4f98b0 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:51:43.580828 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-902d77fa-f8b8-4ace-95d6-6b1eef4f98b0 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:51:43.581278 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-902d77fa-f8b8-4ace-95d6-6b1eef4f98b0 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:51:44.453292 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-902d77fa-f8b8-4ace-95d6-6b1eef4f98b0 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "POST /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.888560 Oct 04 19:51:44.453875 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3991/7995] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Oct 4 19:51:43 2022] POST /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646/os-volume_attachments => generated 194 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:51:56.305139 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0eb66980-642f-4d7c-91e9-45107a06dd06 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:51:56.305748 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0eb66980-642f-4d7c-91e9-45107a06dd06 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: d43d8ac5-175b-40a3-b2cc-812551ccc646] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:51:56.307836 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:51:56.308576 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=62 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:51:56.313171 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0eb66980-642f-4d7c-91e9-45107a06dd06 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:51:56.313657 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0eb66980-642f-4d7c-91e9-45107a06dd06 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:51:56.314091 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0eb66980-642f-4d7c-91e9-45107a06dd06 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:51:56.314766 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0eb66980-642f-4d7c-91e9-45107a06dd06 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:51:56.315222 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0eb66980-642f-4d7c-91e9-45107a06dd06 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:51:56.315658 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0eb66980-642f-4d7c-91e9-45107a06dd06 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:51:56.455542 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0eb66980-642f-4d7c-91e9-45107a06dd06 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd393b496ef146b2a4eb784f8b314259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccdc7fa868e497e9bc1b3e32fd09da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:51:56.470430 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0eb66980-642f-4d7c-91e9-45107a06dd06 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "GET /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646" status: 200 len: 1595 microversion: 2.1 time: 0.169324 Oct 04 19:51:56.471229 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4005/7996] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:51:56 2022] GET /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646 => generated 1595 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:51:58.557469 n-d-850501-14 devstack@n-api.service[123002]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d2b44dc8-447f-4d0a-9186-943d7552c0ea] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 19:51:58.558573 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:51:58.559571 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:51:58.561445 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:51:58.623063 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-4d72fbb5-9360-4a43-aaf7-fea2947ca238 req-ea7b5fa3-9bb1-4cf9-b5ed-8a7b30626332 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d43d8ac5-175b-40a3-b2cc-812551ccc646", "tag": "f3dce3db-75f5-405e-84e9-f9eee39d2a2c"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:51:58.633307 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-4d72fbb5-9360-4a43-aaf7-fea2947ca238 req-ea7b5fa3-9bb1-4cf9-b5ed-8a7b30626332 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:51:58.633803 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-4d72fbb5-9360-4a43-aaf7-fea2947ca238 req-ea7b5fa3-9bb1-4cf9-b5ed-8a7b30626332 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:51:58.638067 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-4d72fbb5-9360-4a43-aaf7-fea2947ca238 req-ea7b5fa3-9bb1-4cf9-b5ed-8a7b30626332 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:51:58.646298 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-4d72fbb5-9360-4a43-aaf7-fea2947ca238 req-ea7b5fa3-9bb1-4cf9-b5ed-8a7b30626332 service nova] Creating event network-changed:f3dce3db-75f5-405e-84e9-f9eee39d2a2c for instance d43d8ac5-175b-40a3-b2cc-812551ccc646 on n-h1-850501-14 Oct 04 19:51:58.651560 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-4d72fbb5-9360-4a43-aaf7-fea2947ca238 req-ea7b5fa3-9bb1-4cf9-b5ed-8a7b30626332 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095566 Oct 04 19:51:58.652546 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3992/7997] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:51:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:52:01.910886 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-37d6f419-31d6-45cc-81f8-91e9f60de0e2 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1333214103"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:52:01.911502 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-37d6f419-31d6-45cc-81f8-91e9f60de0e2 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: d43d8ac5-175b-40a3-b2cc-812551ccc646] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:52:01.918617 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-37d6f419-31d6-45cc-81f8-91e9f60de0e2 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:01.919099 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-37d6f419-31d6-45cc-81f8-91e9f60de0e2 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:01.919535 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-37d6f419-31d6-45cc-81f8-91e9f60de0e2 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:01.920259 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-37d6f419-31d6-45cc-81f8-91e9f60de0e2 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:01.920711 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-37d6f419-31d6-45cc-81f8-91e9f60de0e2 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:01.921137 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-37d6f419-31d6-45cc-81f8-91e9f60de0e2 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:02.049445 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.network.security_group_api [None req-37d6f419-31d6-45cc-81f8-91e9f60de0e2 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Adding security group f54fce96-2cab-4e81-b848-8eea052e5d18 to port f3dce3db-75f5-405e-84e9-f9eee39d2a2c Oct 04 19:52:02.454961 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-37d6f419-31d6-45cc-81f8-91e9f60de0e2 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "POST /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646/action" status: 202 len: 0 microversion: 2.1 time: 0.548723 Oct 04 19:52:02.459314 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4006/7998] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 19:52:01 2022] POST /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646/action => generated 0 bytes in 550 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:52:02.465965 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-7615f92a-0322-4232-81fb-74f148f594b2 req-93cccf95-9d7e-4e5e-84e0-5d6beb364a55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d43d8ac5-175b-40a3-b2cc-812551ccc646", "tag": "f3dce3db-75f5-405e-84e9-f9eee39d2a2c"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:52:02.469002 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8725348b-3e57-44e0-b492-ed1c00580104 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:52:02.469727 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8725348b-3e57-44e0-b492-ed1c00580104 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: d43d8ac5-175b-40a3-b2cc-812551ccc646] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:52:02.479254 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8725348b-3e57-44e0-b492-ed1c00580104 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:02.479748 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8725348b-3e57-44e0-b492-ed1c00580104 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:02.480250 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8725348b-3e57-44e0-b492-ed1c00580104 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:02.480956 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8725348b-3e57-44e0-b492-ed1c00580104 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:02.481834 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8725348b-3e57-44e0-b492-ed1c00580104 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:02.482276 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8725348b-3e57-44e0-b492-ed1c00580104 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:02.487563 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-7615f92a-0322-4232-81fb-74f148f594b2 req-93cccf95-9d7e-4e5e-84e0-5d6beb364a55 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:02.487563 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-7615f92a-0322-4232-81fb-74f148f594b2 req-93cccf95-9d7e-4e5e-84e0-5d6beb364a55 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:02.488691 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-7615f92a-0322-4232-81fb-74f148f594b2 req-93cccf95-9d7e-4e5e-84e0-5d6beb364a55 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:02.506270 n-d-850501-14 devstack@n-api.service[123002]: INFO oslo.messaging._drivers.impl_rabbit [-] [d2b44dc8-447f-4d0a-9186-943d7552c0ea] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 53090. Oct 04 19:52:02.512775 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-7615f92a-0322-4232-81fb-74f148f594b2 req-93cccf95-9d7e-4e5e-84e0-5d6beb364a55 service nova] Creating event network-changed:f3dce3db-75f5-405e-84e9-f9eee39d2a2c for instance d43d8ac5-175b-40a3-b2cc-812551ccc646 on n-h1-850501-14 Oct 04 19:52:02.521588 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-7615f92a-0322-4232-81fb-74f148f594b2 req-93cccf95-9d7e-4e5e-84e0-5d6beb364a55 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059150 Oct 04 19:52:02.525892 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4007/7999] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:52:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:52:02.760752 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8725348b-3e57-44e0-b492-ed1c00580104 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd393b496ef146b2a4eb784f8b314259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccdc7fa868e497e9bc1b3e32fd09da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:52:02.770720 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8725348b-3e57-44e0-b492-ed1c00580104 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "GET /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646" status: 200 len: 1761 microversion: 2.1 time: 0.309324 Oct 04 19:52:02.771147 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3993/8000] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:52:02 2022] GET /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646 => generated 1761 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:52:14.905676 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=6 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:52:14.906409 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=12 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:52:14.955757 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-183a31c7-b679-4885-a158-f83fb6934e2a tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:52:14.958441 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-183a31c7-b679-4885-a158-f83fb6934e2a tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: d43d8ac5-175b-40a3-b2cc-812551ccc646] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:52:14.964863 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-183a31c7-b679-4885-a158-f83fb6934e2a tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:14.965341 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-183a31c7-b679-4885-a158-f83fb6934e2a tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:14.965776 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-183a31c7-b679-4885-a158-f83fb6934e2a tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:14.966455 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-183a31c7-b679-4885-a158-f83fb6934e2a tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:14.966906 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-183a31c7-b679-4885-a158-f83fb6934e2a tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:14.967328 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-183a31c7-b679-4885-a158-f83fb6934e2a tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:15.183713 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-183a31c7-b679-4885-a158-f83fb6934e2a tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "POST /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646/action" status: 202 len: 0 microversion: 2.1 time: 0.283613 Oct 04 19:52:15.184373 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4008/8001] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 19:52:14 2022] POST /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646/action => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:52:15.194656 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-78ef6148-7b8d-426b-99a3-063ab7b9ab73 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:52:15.195288 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-78ef6148-7b8d-426b-99a3-063ab7b9ab73 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: d43d8ac5-175b-40a3-b2cc-812551ccc646] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:52:15.198103 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=4 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:52:15.203430 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-78ef6148-7b8d-426b-99a3-063ab7b9ab73 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:15.203974 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-78ef6148-7b8d-426b-99a3-063ab7b9ab73 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:15.204467 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-78ef6148-7b8d-426b-99a3-063ab7b9ab73 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:15.205178 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-78ef6148-7b8d-426b-99a3-063ab7b9ab73 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:15.205646 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-78ef6148-7b8d-426b-99a3-063ab7b9ab73 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:15.206278 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-78ef6148-7b8d-426b-99a3-063ab7b9ab73 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:15.391334 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-78ef6148-7b8d-426b-99a3-063ab7b9ab73 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd393b496ef146b2a4eb784f8b314259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccdc7fa868e497e9bc1b3e32fd09da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:52:15.400519 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-78ef6148-7b8d-426b-99a3-063ab7b9ab73 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "GET /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646" status: 200 len: 1753 microversion: 2.1 time: 0.210730 Oct 04 19:52:15.401324 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3994/8002] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:52:15 2022] GET /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646 => generated 1753 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:52:16.428074 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c7535315-f1be-4f49-ba06-a4d5102257e3 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:52:16.428794 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c7535315-f1be-4f49-ba06-a4d5102257e3 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: d43d8ac5-175b-40a3-b2cc-812551ccc646] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:52:16.434947 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c7535315-f1be-4f49-ba06-a4d5102257e3 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:16.435432 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c7535315-f1be-4f49-ba06-a4d5102257e3 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:16.435872 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c7535315-f1be-4f49-ba06-a4d5102257e3 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:16.436593 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c7535315-f1be-4f49-ba06-a4d5102257e3 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:16.437052 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c7535315-f1be-4f49-ba06-a4d5102257e3 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:16.437485 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c7535315-f1be-4f49-ba06-a4d5102257e3 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:16.585348 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c7535315-f1be-4f49-ba06-a4d5102257e3 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd393b496ef146b2a4eb784f8b314259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccdc7fa868e497e9bc1b3e32fd09da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:52:16.593591 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c7535315-f1be-4f49-ba06-a4d5102257e3 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "GET /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646" status: 200 len: 1758 microversion: 2.1 time: 0.171426 Oct 04 19:52:16.594163 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4009/8003] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:52:16 2022] GET /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646 => generated 1758 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:52:17.618576 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c925e5ca-daf4-4f0f-be03-838c8f3a6342 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:52:17.619210 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c925e5ca-daf4-4f0f-be03-838c8f3a6342 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: d43d8ac5-175b-40a3-b2cc-812551ccc646] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:52:17.626129 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c925e5ca-daf4-4f0f-be03-838c8f3a6342 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:17.626638 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c925e5ca-daf4-4f0f-be03-838c8f3a6342 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:17.627143 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c925e5ca-daf4-4f0f-be03-838c8f3a6342 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:17.628449 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c925e5ca-daf4-4f0f-be03-838c8f3a6342 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:17.628921 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c925e5ca-daf4-4f0f-be03-838c8f3a6342 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:17.629371 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c925e5ca-daf4-4f0f-be03-838c8f3a6342 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:17.777026 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c925e5ca-daf4-4f0f-be03-838c8f3a6342 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd393b496ef146b2a4eb784f8b314259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccdc7fa868e497e9bc1b3e32fd09da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:52:17.785556 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c925e5ca-daf4-4f0f-be03-838c8f3a6342 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "GET /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646" status: 200 len: 1758 microversion: 2.1 time: 0.170899 Oct 04 19:52:17.786142 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3995/8004] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:52:17 2022] GET /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646 => generated 1758 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:52:18.810587 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-180f18f9-c7ab-4de8-8281-69a912a067a9 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:52:18.811314 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-180f18f9-c7ab-4de8-8281-69a912a067a9 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: d43d8ac5-175b-40a3-b2cc-812551ccc646] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:52:18.820219 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-180f18f9-c7ab-4de8-8281-69a912a067a9 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:18.820781 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-180f18f9-c7ab-4de8-8281-69a912a067a9 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:18.821296 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-180f18f9-c7ab-4de8-8281-69a912a067a9 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:18.821997 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-180f18f9-c7ab-4de8-8281-69a912a067a9 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:18.822482 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-180f18f9-c7ab-4de8-8281-69a912a067a9 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:18.822909 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-180f18f9-c7ab-4de8-8281-69a912a067a9 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:18.966230 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-180f18f9-c7ab-4de8-8281-69a912a067a9 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd393b496ef146b2a4eb784f8b314259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccdc7fa868e497e9bc1b3e32fd09da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:52:18.975572 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-180f18f9-c7ab-4de8-8281-69a912a067a9 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "GET /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646" status: 200 len: 1758 microversion: 2.1 time: 0.168895 Oct 04 19:52:18.976170 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4010/8005] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:52:18 2022] GET /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646 => generated 1758 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:52:19.998870 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3f2cbfe6-1671-4aae-88c3-c8ca2ddcfbeb tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:52:19.999460 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3f2cbfe6-1671-4aae-88c3-c8ca2ddcfbeb tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: d43d8ac5-175b-40a3-b2cc-812551ccc646] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:52:20.007421 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f2cbfe6-1671-4aae-88c3-c8ca2ddcfbeb tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:20.007931 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f2cbfe6-1671-4aae-88c3-c8ca2ddcfbeb tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:20.008448 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f2cbfe6-1671-4aae-88c3-c8ca2ddcfbeb tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:20.009165 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f2cbfe6-1671-4aae-88c3-c8ca2ddcfbeb tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:20.009647 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f2cbfe6-1671-4aae-88c3-c8ca2ddcfbeb tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:20.010096 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3f2cbfe6-1671-4aae-88c3-c8ca2ddcfbeb tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:20.160640 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3f2cbfe6-1671-4aae-88c3-c8ca2ddcfbeb tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd393b496ef146b2a4eb784f8b314259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccdc7fa868e497e9bc1b3e32fd09da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:52:20.168918 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3f2cbfe6-1671-4aae-88c3-c8ca2ddcfbeb tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "GET /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646" status: 200 len: 1758 microversion: 2.1 time: 0.174135 Oct 04 19:52:20.169501 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3996/8006] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:52:19 2022] GET /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646 => generated 1758 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:52:21.193690 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6e7047a7-dfdc-4b6d-a6aa-e6bca0caa6ec tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:52:21.194334 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6e7047a7-dfdc-4b6d-a6aa-e6bca0caa6ec tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: d43d8ac5-175b-40a3-b2cc-812551ccc646] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:52:21.201723 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6e7047a7-dfdc-4b6d-a6aa-e6bca0caa6ec tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:21.202307 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6e7047a7-dfdc-4b6d-a6aa-e6bca0caa6ec tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:21.202770 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6e7047a7-dfdc-4b6d-a6aa-e6bca0caa6ec tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:21.203580 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6e7047a7-dfdc-4b6d-a6aa-e6bca0caa6ec tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:21.204083 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6e7047a7-dfdc-4b6d-a6aa-e6bca0caa6ec tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:21.204531 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6e7047a7-dfdc-4b6d-a6aa-e6bca0caa6ec tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:21.355514 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6e7047a7-dfdc-4b6d-a6aa-e6bca0caa6ec tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd393b496ef146b2a4eb784f8b314259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccdc7fa868e497e9bc1b3e32fd09da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:52:21.365118 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6e7047a7-dfdc-4b6d-a6aa-e6bca0caa6ec tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "GET /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646" status: 200 len: 1758 microversion: 2.1 time: 0.176215 Oct 04 19:52:21.365715 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4011/8007] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:52:21 2022] GET /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646 => generated 1758 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:52:22.389215 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-bb44a31f-6f9f-4d25-bbe8-fdbe47b73a1f tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:52:22.389880 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-bb44a31f-6f9f-4d25-bbe8-fdbe47b73a1f tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: d43d8ac5-175b-40a3-b2cc-812551ccc646] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:52:22.397295 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bb44a31f-6f9f-4d25-bbe8-fdbe47b73a1f tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:22.397795 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bb44a31f-6f9f-4d25-bbe8-fdbe47b73a1f tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:22.398247 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bb44a31f-6f9f-4d25-bbe8-fdbe47b73a1f tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:22.398962 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bb44a31f-6f9f-4d25-bbe8-fdbe47b73a1f tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:22.399434 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bb44a31f-6f9f-4d25-bbe8-fdbe47b73a1f tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:22.399876 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bb44a31f-6f9f-4d25-bbe8-fdbe47b73a1f tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:22.553132 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-bb44a31f-6f9f-4d25-bbe8-fdbe47b73a1f tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd393b496ef146b2a4eb784f8b314259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccdc7fa868e497e9bc1b3e32fd09da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:52:22.561554 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-bb44a31f-6f9f-4d25-bbe8-fdbe47b73a1f tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "GET /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646" status: 200 len: 1758 microversion: 2.1 time: 0.176249 Oct 04 19:52:22.562141 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3997/8008] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:52:22 2022] GET /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646 => generated 1758 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:52:23.584808 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7971cf0b-3b7a-4ae5-bfb6-c4e7a576ef2a tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:52:23.585429 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7971cf0b-3b7a-4ae5-bfb6-c4e7a576ef2a tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: d43d8ac5-175b-40a3-b2cc-812551ccc646] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:52:23.592273 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7971cf0b-3b7a-4ae5-bfb6-c4e7a576ef2a tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:23.592760 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7971cf0b-3b7a-4ae5-bfb6-c4e7a576ef2a tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:23.593238 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7971cf0b-3b7a-4ae5-bfb6-c4e7a576ef2a tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:23.593938 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7971cf0b-3b7a-4ae5-bfb6-c4e7a576ef2a tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:23.594402 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7971cf0b-3b7a-4ae5-bfb6-c4e7a576ef2a tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:23.594885 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7971cf0b-3b7a-4ae5-bfb6-c4e7a576ef2a tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:23.748491 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7971cf0b-3b7a-4ae5-bfb6-c4e7a576ef2a tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd393b496ef146b2a4eb784f8b314259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccdc7fa868e497e9bc1b3e32fd09da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:52:23.757941 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7971cf0b-3b7a-4ae5-bfb6-c4e7a576ef2a tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "GET /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646" status: 200 len: 1758 microversion: 2.1 time: 0.177142 Oct 04 19:52:23.758513 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4012/8009] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:52:23 2022] GET /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646 => generated 1758 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:52:24.781180 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8e3eef36-e7b7-48b3-b796-dbe1228909d1 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:52:24.781812 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8e3eef36-e7b7-48b3-b796-dbe1228909d1 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: d43d8ac5-175b-40a3-b2cc-812551ccc646] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:52:24.788814 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8e3eef36-e7b7-48b3-b796-dbe1228909d1 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:24.789312 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8e3eef36-e7b7-48b3-b796-dbe1228909d1 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:24.789760 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8e3eef36-e7b7-48b3-b796-dbe1228909d1 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:24.790509 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8e3eef36-e7b7-48b3-b796-dbe1228909d1 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:24.791008 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8e3eef36-e7b7-48b3-b796-dbe1228909d1 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:24.791457 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8e3eef36-e7b7-48b3-b796-dbe1228909d1 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:24.950679 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8e3eef36-e7b7-48b3-b796-dbe1228909d1 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd393b496ef146b2a4eb784f8b314259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccdc7fa868e497e9bc1b3e32fd09da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:52:24.950679 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8e3eef36-e7b7-48b3-b796-dbe1228909d1 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "GET /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646" status: 200 len: 1758 microversion: 2.1 time: 0.168276 Oct 04 19:52:24.950679 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3998/8010] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:52:24 2022] GET /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646 => generated 1758 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:52:25.970008 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-fb58aee9-57a3-4717-8767-2828bd4ff3c9 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:52:25.970646 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-fb58aee9-57a3-4717-8767-2828bd4ff3c9 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: d43d8ac5-175b-40a3-b2cc-812551ccc646] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:52:25.978349 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fb58aee9-57a3-4717-8767-2828bd4ff3c9 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:25.978772 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fb58aee9-57a3-4717-8767-2828bd4ff3c9 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:25.979210 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fb58aee9-57a3-4717-8767-2828bd4ff3c9 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:25.979895 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fb58aee9-57a3-4717-8767-2828bd4ff3c9 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:25.980386 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fb58aee9-57a3-4717-8767-2828bd4ff3c9 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:25.980813 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fb58aee9-57a3-4717-8767-2828bd4ff3c9 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:26.130930 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-fb58aee9-57a3-4717-8767-2828bd4ff3c9 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd393b496ef146b2a4eb784f8b314259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccdc7fa868e497e9bc1b3e32fd09da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:52:26.139300 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-fb58aee9-57a3-4717-8767-2828bd4ff3c9 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "GET /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646" status: 200 len: 1758 microversion: 2.1 time: 0.173206 Oct 04 19:52:26.139877 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4013/8011] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:52:25 2022] GET /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646 => generated 1758 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:52:27.162791 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0da1ede8-85a2-4e02-b8a8-aee473a2f4dc tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:52:27.163457 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0da1ede8-85a2-4e02-b8a8-aee473a2f4dc tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: d43d8ac5-175b-40a3-b2cc-812551ccc646] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:52:27.170575 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0da1ede8-85a2-4e02-b8a8-aee473a2f4dc tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:27.171078 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0da1ede8-85a2-4e02-b8a8-aee473a2f4dc tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:27.171531 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0da1ede8-85a2-4e02-b8a8-aee473a2f4dc tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:27.172274 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0da1ede8-85a2-4e02-b8a8-aee473a2f4dc tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:27.172749 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0da1ede8-85a2-4e02-b8a8-aee473a2f4dc tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:27.173194 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0da1ede8-85a2-4e02-b8a8-aee473a2f4dc tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:27.314555 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0da1ede8-85a2-4e02-b8a8-aee473a2f4dc tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd393b496ef146b2a4eb784f8b314259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccdc7fa868e497e9bc1b3e32fd09da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:52:27.323828 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0da1ede8-85a2-4e02-b8a8-aee473a2f4dc tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "GET /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646" status: 200 len: 1758 microversion: 2.1 time: 0.165055 Oct 04 19:52:27.324442 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 3999/8012] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:52:27 2022] GET /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646 => generated 1758 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:52:28.348931 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b4a3cac9-fb4d-4070-804e-8beb3039e76c tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:52:28.349798 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b4a3cac9-fb4d-4070-804e-8beb3039e76c tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: d43d8ac5-175b-40a3-b2cc-812551ccc646] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:52:28.356873 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b4a3cac9-fb4d-4070-804e-8beb3039e76c tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:28.357365 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b4a3cac9-fb4d-4070-804e-8beb3039e76c tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:28.357807 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b4a3cac9-fb4d-4070-804e-8beb3039e76c tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:28.358506 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b4a3cac9-fb4d-4070-804e-8beb3039e76c tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:28.358968 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b4a3cac9-fb4d-4070-804e-8beb3039e76c tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:28.359401 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b4a3cac9-fb4d-4070-804e-8beb3039e76c tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:28.506948 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b4a3cac9-fb4d-4070-804e-8beb3039e76c tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd393b496ef146b2a4eb784f8b314259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccdc7fa868e497e9bc1b3e32fd09da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:52:28.516549 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b4a3cac9-fb4d-4070-804e-8beb3039e76c tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "GET /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646" status: 200 len: 1758 microversion: 2.1 time: 0.172016 Oct 04 19:52:28.517124 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4014/8013] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:52:28 2022] GET /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646 => generated 1758 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:52:29.541813 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-875f5d71-3123-4b55-b398-074efdf17602 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:52:29.542448 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-875f5d71-3123-4b55-b398-074efdf17602 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: d43d8ac5-175b-40a3-b2cc-812551ccc646] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:52:29.549423 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-875f5d71-3123-4b55-b398-074efdf17602 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:29.549933 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-875f5d71-3123-4b55-b398-074efdf17602 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:29.550650 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-875f5d71-3123-4b55-b398-074efdf17602 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:29.551784 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-875f5d71-3123-4b55-b398-074efdf17602 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:29.552641 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-875f5d71-3123-4b55-b398-074efdf17602 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:29.553398 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-875f5d71-3123-4b55-b398-074efdf17602 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:29.705987 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-875f5d71-3123-4b55-b398-074efdf17602 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd393b496ef146b2a4eb784f8b314259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccdc7fa868e497e9bc1b3e32fd09da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:52:29.715232 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-875f5d71-3123-4b55-b398-074efdf17602 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "GET /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646" status: 200 len: 1758 microversion: 2.1 time: 0.177679 Oct 04 19:52:29.716020 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4000/8014] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:52:29 2022] GET /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646 => generated 1758 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:52:30.740170 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e3927409-ad37-4ca0-8e89-a691afae471a tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:52:30.740791 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e3927409-ad37-4ca0-8e89-a691afae471a tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: d43d8ac5-175b-40a3-b2cc-812551ccc646] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:52:30.748370 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e3927409-ad37-4ca0-8e89-a691afae471a tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:30.748855 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e3927409-ad37-4ca0-8e89-a691afae471a tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:30.749295 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e3927409-ad37-4ca0-8e89-a691afae471a tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:30.749991 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e3927409-ad37-4ca0-8e89-a691afae471a tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:30.750448 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e3927409-ad37-4ca0-8e89-a691afae471a tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:30.750881 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e3927409-ad37-4ca0-8e89-a691afae471a tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:30.900420 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e3927409-ad37-4ca0-8e89-a691afae471a tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd393b496ef146b2a4eb784f8b314259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccdc7fa868e497e9bc1b3e32fd09da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:52:30.908986 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e3927409-ad37-4ca0-8e89-a691afae471a tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "GET /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646" status: 200 len: 1758 microversion: 2.1 time: 0.173081 Oct 04 19:52:30.909950 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4015/8015] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:52:30 2022] GET /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646 => generated 1758 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:52:31.932625 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-46733fa1-8016-49bf-82f3-62f523d5a1aa tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:52:31.933255 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-46733fa1-8016-49bf-82f3-62f523d5a1aa tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: d43d8ac5-175b-40a3-b2cc-812551ccc646] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:52:31.940409 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-46733fa1-8016-49bf-82f3-62f523d5a1aa tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:31.941031 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-46733fa1-8016-49bf-82f3-62f523d5a1aa tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:31.941487 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-46733fa1-8016-49bf-82f3-62f523d5a1aa tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:31.942201 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-46733fa1-8016-49bf-82f3-62f523d5a1aa tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:31.942675 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-46733fa1-8016-49bf-82f3-62f523d5a1aa tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:31.943119 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-46733fa1-8016-49bf-82f3-62f523d5a1aa tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:32.098653 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-46733fa1-8016-49bf-82f3-62f523d5a1aa tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd393b496ef146b2a4eb784f8b314259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccdc7fa868e497e9bc1b3e32fd09da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:52:32.107238 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-46733fa1-8016-49bf-82f3-62f523d5a1aa tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "GET /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646" status: 200 len: 1761 microversion: 2.1 time: 0.178658 Oct 04 19:52:32.107808 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4001/8016] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:52:31 2022] GET /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646 => generated 1761 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:53:04.128666 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6fec2b27-1bee-4bb5-bfa0-340d070e1ca3 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1333214103"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:53:04.129279 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6fec2b27-1bee-4bb5-bfa0-340d070e1ca3 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: d43d8ac5-175b-40a3-b2cc-812551ccc646] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:53:04.131546 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=16 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:53:04.132251 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:53:04.137776 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6fec2b27-1bee-4bb5-bfa0-340d070e1ca3 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:04.138267 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6fec2b27-1bee-4bb5-bfa0-340d070e1ca3 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:04.138711 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6fec2b27-1bee-4bb5-bfa0-340d070e1ca3 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:04.139410 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6fec2b27-1bee-4bb5-bfa0-340d070e1ca3 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:04.139917 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6fec2b27-1bee-4bb5-bfa0-340d070e1ca3 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:04.140381 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6fec2b27-1bee-4bb5-bfa0-340d070e1ca3 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:04.279330 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.network.security_group_api [None req-6fec2b27-1bee-4bb5-bfa0-340d070e1ca3 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Removing security group f54fce96-2cab-4e81-b848-8eea052e5d18 from port f3dce3db-75f5-405e-84e9-f9eee39d2a2c Oct 04 19:53:04.694822 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6fec2b27-1bee-4bb5-bfa0-340d070e1ca3 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "POST /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646/action" status: 202 len: 0 microversion: 2.1 time: 0.570310 Oct 04 19:53:04.699655 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4016/8017] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 19:53:04 2022] POST /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646/action => generated 0 bytes in 572 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:53:04.714650 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-b7d05bbf-e0f3-4520-a3d9-2c53a0b3a5f3 req-03f1d12a-b133-4763-b3ab-63888e9ee63d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d43d8ac5-175b-40a3-b2cc-812551ccc646", "tag": "f3dce3db-75f5-405e-84e9-f9eee39d2a2c"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:53:04.720024 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=16 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:53:04.723805 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=56 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:53:04.731802 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-b7d05bbf-e0f3-4520-a3d9-2c53a0b3a5f3 req-03f1d12a-b133-4763-b3ab-63888e9ee63d service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:04.732339 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-b7d05bbf-e0f3-4520-a3d9-2c53a0b3a5f3 req-03f1d12a-b133-4763-b3ab-63888e9ee63d service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:04.732793 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-b7d05bbf-e0f3-4520-a3d9-2c53a0b3a5f3 req-03f1d12a-b133-4763-b3ab-63888e9ee63d service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:04.749951 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-b7d05bbf-e0f3-4520-a3d9-2c53a0b3a5f3 req-03f1d12a-b133-4763-b3ab-63888e9ee63d service nova] Creating event network-changed:f3dce3db-75f5-405e-84e9-f9eee39d2a2c for instance d43d8ac5-175b-40a3-b2cc-812551ccc646 on n-h1-850501-14 Oct 04 19:53:04.757632 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-b7d05bbf-e0f3-4520-a3d9-2c53a0b3a5f3 req-03f1d12a-b133-4763-b3ab-63888e9ee63d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056092 Oct 04 19:53:04.759019 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4002/8018] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:53:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:53:06.165145 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d92ff6b5-c19f-41b9-8b4c-cd3c01a9f8aa tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:53:06.165687 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d92ff6b5-c19f-41b9-8b4c-cd3c01a9f8aa tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: d43d8ac5-175b-40a3-b2cc-812551ccc646] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:53:06.171589 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d92ff6b5-c19f-41b9-8b4c-cd3c01a9f8aa tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:06.172105 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d92ff6b5-c19f-41b9-8b4c-cd3c01a9f8aa tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:06.172552 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d92ff6b5-c19f-41b9-8b4c-cd3c01a9f8aa tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:06.173251 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d92ff6b5-c19f-41b9-8b4c-cd3c01a9f8aa tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:06.173713 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d92ff6b5-c19f-41b9-8b4c-cd3c01a9f8aa tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:06.174149 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d92ff6b5-c19f-41b9-8b4c-cd3c01a9f8aa tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:06.257516 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-d92ff6b5-c19f-41b9-8b4c-cd3c01a9f8aa tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lazy-loading 'services' on Instance uuid d43d8ac5-175b-40a3-b2cc-812551ccc646 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:53:06.503004 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d92ff6b5-c19f-41b9-8b4c-cd3c01a9f8aa tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646/os-volume_attachments/0745c2d2-5e06-4972-bdf0-62f2353d7809" status: 202 len: 0 microversion: 2.1 time: 0.342574 Oct 04 19:53:06.503639 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4017/8019] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Oct 4 19:53:06 2022] DELETE /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646/os-volume_attachments/0745c2d2-5e06-4972-bdf0-62f2353d7809 => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:53:06.512866 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-bb0fefd0-e7bb-4e84-a1ce-01bf0b7d8faa tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:53:06.516294 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-bb0fefd0-e7bb-4e84-a1ce-01bf0b7d8faa tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: d43d8ac5-175b-40a3-b2cc-812551ccc646] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:53:06.525778 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bb0fefd0-e7bb-4e84-a1ce-01bf0b7d8faa tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:06.526289 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bb0fefd0-e7bb-4e84-a1ce-01bf0b7d8faa tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:06.526746 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bb0fefd0-e7bb-4e84-a1ce-01bf0b7d8faa tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:06.527777 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bb0fefd0-e7bb-4e84-a1ce-01bf0b7d8faa tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:06.528207 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bb0fefd0-e7bb-4e84-a1ce-01bf0b7d8faa tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:06.528653 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bb0fefd0-e7bb-4e84-a1ce-01bf0b7d8faa tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:06.559475 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-bb0fefd0-e7bb-4e84-a1ce-01bf0b7d8faa tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "GET /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050995 Oct 04 19:53:06.560106 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4003/8020] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 19:53:06 2022] GET /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:53:06.791897 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-152f79f8-57b8-4ab0-88ee-8c4ca99fb155 req-804443cb-71dc-4d98-bf51-6cad21036dc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d43d8ac5-175b-40a3-b2cc-812551ccc646", "tag": "f3dce3db-75f5-405e-84e9-f9eee39d2a2c"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:53:06.802239 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-152f79f8-57b8-4ab0-88ee-8c4ca99fb155 req-804443cb-71dc-4d98-bf51-6cad21036dc9 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:06.802732 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-152f79f8-57b8-4ab0-88ee-8c4ca99fb155 req-804443cb-71dc-4d98-bf51-6cad21036dc9 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:06.803208 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-152f79f8-57b8-4ab0-88ee-8c4ca99fb155 req-804443cb-71dc-4d98-bf51-6cad21036dc9 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:06.814583 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-152f79f8-57b8-4ab0-88ee-8c4ca99fb155 req-804443cb-71dc-4d98-bf51-6cad21036dc9 service nova] Creating event network-changed:f3dce3db-75f5-405e-84e9-f9eee39d2a2c for instance d43d8ac5-175b-40a3-b2cc-812551ccc646 on n-h1-850501-14 Oct 04 19:53:06.820503 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-152f79f8-57b8-4ab0-88ee-8c4ca99fb155 req-804443cb-71dc-4d98-bf51-6cad21036dc9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032649 Oct 04 19:53:06.821113 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4018/8021] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:53:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:53:07.572939 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3cb989ea-2293-4af0-9bf8-9e7d8d37eb9b tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:53:07.575187 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3cb989ea-2293-4af0-9bf8-9e7d8d37eb9b tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: d43d8ac5-175b-40a3-b2cc-812551ccc646] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:53:07.582338 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3cb989ea-2293-4af0-9bf8-9e7d8d37eb9b tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:07.586730 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3cb989ea-2293-4af0-9bf8-9e7d8d37eb9b tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:07.586730 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3cb989ea-2293-4af0-9bf8-9e7d8d37eb9b tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:07.586730 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3cb989ea-2293-4af0-9bf8-9e7d8d37eb9b tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:07.586730 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3cb989ea-2293-4af0-9bf8-9e7d8d37eb9b tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:07.586730 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3cb989ea-2293-4af0-9bf8-9e7d8d37eb9b tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:07.617668 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3cb989ea-2293-4af0-9bf8-9e7d8d37eb9b tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "GET /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049047 Oct 04 19:53:07.621153 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4004/8022] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 19:53:07 2022] GET /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:53:08.632917 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-dcff6cc6-5a92-49ed-98e8-e0a97e3422aa tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:53:08.635296 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-dcff6cc6-5a92-49ed-98e8-e0a97e3422aa tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: d43d8ac5-175b-40a3-b2cc-812551ccc646] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:53:08.641993 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dcff6cc6-5a92-49ed-98e8-e0a97e3422aa tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:08.642484 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dcff6cc6-5a92-49ed-98e8-e0a97e3422aa tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:08.643033 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dcff6cc6-5a92-49ed-98e8-e0a97e3422aa tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:08.643892 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dcff6cc6-5a92-49ed-98e8-e0a97e3422aa tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:08.644376 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dcff6cc6-5a92-49ed-98e8-e0a97e3422aa tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:08.644809 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dcff6cc6-5a92-49ed-98e8-e0a97e3422aa tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:08.678466 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-dcff6cc6-5a92-49ed-98e8-e0a97e3422aa tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "GET /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051539 Oct 04 19:53:08.679064 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4019/8023] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 19:53:08 2022] GET /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:53:09.691024 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ed0c4a38-723f-44d3-aeda-33368e9c445c tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:53:09.693386 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ed0c4a38-723f-44d3-aeda-33368e9c445c tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: d43d8ac5-175b-40a3-b2cc-812551ccc646] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:53:09.700216 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ed0c4a38-723f-44d3-aeda-33368e9c445c tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:09.700762 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ed0c4a38-723f-44d3-aeda-33368e9c445c tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:09.701159 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ed0c4a38-723f-44d3-aeda-33368e9c445c tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:09.701866 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ed0c4a38-723f-44d3-aeda-33368e9c445c tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:09.702328 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ed0c4a38-723f-44d3-aeda-33368e9c445c tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:09.702801 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ed0c4a38-723f-44d3-aeda-33368e9c445c tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:09.732933 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ed0c4a38-723f-44d3-aeda-33368e9c445c tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "GET /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045917 Oct 04 19:53:09.733502 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4005/8024] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 19:53:09 2022] GET /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:53:10.746415 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0a3c3b07-72a3-464d-b102-3787f5f22fde tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:53:10.748629 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0a3c3b07-72a3-464d-b102-3787f5f22fde tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: d43d8ac5-175b-40a3-b2cc-812551ccc646] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:53:10.756576 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0a3c3b07-72a3-464d-b102-3787f5f22fde tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:10.757072 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0a3c3b07-72a3-464d-b102-3787f5f22fde tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:10.757523 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0a3c3b07-72a3-464d-b102-3787f5f22fde tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:10.758244 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0a3c3b07-72a3-464d-b102-3787f5f22fde tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:10.758704 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0a3c3b07-72a3-464d-b102-3787f5f22fde tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:10.759135 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0a3c3b07-72a3-464d-b102-3787f5f22fde tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:10.792576 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0a3c3b07-72a3-464d-b102-3787f5f22fde tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "GET /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050172 Oct 04 19:53:10.793344 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4020/8025] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 19:53:10 2022] GET /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:53:11.806014 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-35d23643-103e-46df-912a-6c1e942b996d tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:53:11.808269 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-35d23643-103e-46df-912a-6c1e942b996d tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: d43d8ac5-175b-40a3-b2cc-812551ccc646] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:53:11.816302 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-35d23643-103e-46df-912a-6c1e942b996d tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:11.816801 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-35d23643-103e-46df-912a-6c1e942b996d tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:11.817253 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-35d23643-103e-46df-912a-6c1e942b996d tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:11.817958 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-35d23643-103e-46df-912a-6c1e942b996d tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:11.818426 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-35d23643-103e-46df-912a-6c1e942b996d tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:11.818868 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-35d23643-103e-46df-912a-6c1e942b996d tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:11.849522 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-35d23643-103e-46df-912a-6c1e942b996d tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "GET /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047578 Oct 04 19:53:11.866069 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4006/8026] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Oct 4 19:53:11 2022] GET /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 19:53:11.875685 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-821d5a80-95c6-4d4c-a9ce-c34eaa263e78 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:53:11.876253 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-821d5a80-95c6-4d4c-a9ce-c34eaa263e78 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: d43d8ac5-175b-40a3-b2cc-812551ccc646] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:53:11.883293 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-821d5a80-95c6-4d4c-a9ce-c34eaa263e78 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:11.883781 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-821d5a80-95c6-4d4c-a9ce-c34eaa263e78 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:11.884310 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-821d5a80-95c6-4d4c-a9ce-c34eaa263e78 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:11.885006 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-821d5a80-95c6-4d4c-a9ce-c34eaa263e78 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:11.885462 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-821d5a80-95c6-4d4c-a9ce-c34eaa263e78 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:11.885890 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-821d5a80-95c6-4d4c-a9ce-c34eaa263e78 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:11.965531 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-821d5a80-95c6-4d4c-a9ce-c34eaa263e78 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] HTTP exception thrown: Instance d43d8ac5-175b-40a3-b2cc-812551ccc646 is not attached to volume 0745c2d2-5e06-4972-bdf0-62f2353d7809 Oct 04 19:53:11.967179 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-821d5a80-95c6-4d4c-a9ce-c34eaa263e78 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Request method failure captured: Oct 04 19:53:11.967179 n-d-850501-14 devstack@n-api.service[123001]: request: DELETE /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646/os-volume_attachments/0745c2d2-5e06-4972-bdf0-62f2353d7809 HTTP/1.1 Oct 04 19:53:11.967179 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 19:53:11.967179 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 19:53:11.967179 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 19:53:11.967179 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 19:53:11.967179 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 19:53:11.967179 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 19:53:11.967179 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 19:53:11.967179 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 19:53:11.967179 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPI2zlegKSbZ0cFPghJWeoLYYgKhy8ReHaL4xP_gfcg46CNy-mQPMGixGZ0B2DaWv-pDzqS5kFeSe0cVGpQ5cVUTA0Gi4s_31WIampxIFZmvVB-4IEGJf54TMwhcKyRuM6UlnU9AzK-NgAxH8wzFeWKIcSpTOZTgDwwtQoqtbu-YGpDg Oct 04 19:53:11.967179 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 19:53:11.967179 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 19:53:11.967179 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 19:53:11.967179 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 19:53:11.967179 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 19:53:11.967179 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 19:53:11.967179 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 9ccdc7fa868e497e9bc1b3e32fd09da8 Oct 04 19:53:11.967179 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-TestMinimumBasicScenario-1244571287 Oct 04 19:53:11.967179 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 19:53:11.967179 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 19:53:11.967179 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9ccdc7fa868e497e9bc1b3e32fd09da8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9ccdc7fa868e497e9bc1b3e32fd09da8", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9ccdc7fa868e497e9bc1b3e32fd09da8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9ccdc7fa868e497e9bc1b3e32fd09da8"}]}] Oct 04 19:53:11.967179 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-TestMinimumBasicScenario-1244571287 Oct 04 19:53:11.967179 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 9ccdc7fa868e497e9bc1b3e32fd09da8 Oct 04 19:53:11.967179 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1244571287 Oct 04 19:53:11.967179 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-TestMinimumBasicScenario-1244571287-project Oct 04 19:53:11.967179 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 19:53:11.967179 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 19:53:11.967179 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: cd393b496ef146b2a4eb784f8b314259 Oct 04 19:53:11.967179 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-TestMinimumBasicScenario-1244571287-project Oct 04 19:53:11.967179 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 19:53:11.967179 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance d43d8ac5-175b-40a3-b2cc-812551ccc646 is not attached to volume 0745c2d2-5e06-4972-bdf0-62f2353d7809 Oct 04 19:53:11.967179 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'server_id': 'd43d8ac5-175b-40a3-b2cc-812551ccc646', 'id': '0745c2d2-5e06-4972-bdf0-62f2353d7809'} Oct 04 19:53:11.967179 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:53:11.967179 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:53:11.967179 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 04 19:53:11.967179 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 04 19:53:11.967179 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 19:53:11.967179 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 19:53:11.967179 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 04 19:53:11.967179 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 04 19:53:11.967179 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 0745c2d2-5e06-4972-bdf0-62f2353d7809. Oct 04 19:53:11.967179 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:53:11.967179 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:53:11.967179 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:53:11.967179 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:53:11.967179 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:53:11.967179 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:53:11.967179 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:53:11.967179 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:53:11.967179 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:53:11.967179 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:53:11.967179 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 04 19:53:11.967179 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 19:53:11.967179 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d43d8ac5-175b-40a3-b2cc-812551ccc646 is not attached to volume 0745c2d2-5e06-4972-bdf0-62f2353d7809 Oct 04 19:53:11.967179 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:53:11.967179 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:53:11.967179 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:53:11.967179 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:53:11.967179 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:53:11.967179 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:53:11.972586 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:53:11.972586 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:53:11.972586 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d43d8ac5-175b-40a3-b2cc-812551ccc646 is not attached to volume 0745c2d2-5e06-4972-bdf0-62f2353d7809 Oct 04 19:53:11.972586 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:53:11.972586 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-821d5a80-95c6-4d4c-a9ce-c34eaa263e78 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Returning 404 to user: Instance d43d8ac5-175b-40a3-b2cc-812551ccc646 is not attached to volume 0745c2d2-5e06-4972-bdf0-62f2353d7809 {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:53:11.972586 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-821d5a80-95c6-4d4c-a9ce-c34eaa263e78 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646/os-volume_attachments/0745c2d2-5e06-4972-bdf0-62f2353d7809" status: 404 len: 154 microversion: 2.1 time: 0.097192 Oct 04 19:53:11.972586 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4021/8027] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Oct 4 19:53:11 2022] DELETE /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646/os-volume_attachments/0745c2d2-5e06-4972-bdf0-62f2353d7809 => generated 154 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:53:15.437038 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-fe9c8407-a9c3-48c1-964f-b29bc8e410b3 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:53:15.437558 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-fe9c8407-a9c3-48c1-964f-b29bc8e410b3 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: d43d8ac5-175b-40a3-b2cc-812551ccc646] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:53:15.444740 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fe9c8407-a9c3-48c1-964f-b29bc8e410b3 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:15.445457 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fe9c8407-a9c3-48c1-964f-b29bc8e410b3 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:15.445917 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fe9c8407-a9c3-48c1-964f-b29bc8e410b3 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:15.446663 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fe9c8407-a9c3-48c1-964f-b29bc8e410b3 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:15.447139 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fe9c8407-a9c3-48c1-964f-b29bc8e410b3 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:15.447589 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fe9c8407-a9c3-48c1-964f-b29bc8e410b3 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:15.472645 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-fe9c8407-a9c3-48c1-964f-b29bc8e410b3 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: d43d8ac5-175b-40a3-b2cc-812551ccc646] Going to try to terminate instance {{(pid=123002) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:53:15.760338 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-fe9c8407-a9c3-48c1-964f-b29bc8e410b3 tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646" status: 204 len: 0 microversion: 2.1 time: 0.326912 Oct 04 19:53:15.760881 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4007/8028] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 19:53:15 2022] DELETE /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 19:53:15.770117 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f292507e-6c74-4c53-8a63-d95cb23e158b tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:53:15.770737 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f292507e-6c74-4c53-8a63-d95cb23e158b tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: d43d8ac5-175b-40a3-b2cc-812551ccc646] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:53:15.777169 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f292507e-6c74-4c53-8a63-d95cb23e158b tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:15.777658 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f292507e-6c74-4c53-8a63-d95cb23e158b tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:15.778098 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f292507e-6c74-4c53-8a63-d95cb23e158b tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:15.778796 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f292507e-6c74-4c53-8a63-d95cb23e158b tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:15.779253 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f292507e-6c74-4c53-8a63-d95cb23e158b tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:15.779685 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f292507e-6c74-4c53-8a63-d95cb23e158b tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:15.917660 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f292507e-6c74-4c53-8a63-d95cb23e158b tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd393b496ef146b2a4eb784f8b314259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccdc7fa868e497e9bc1b3e32fd09da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:53:15.926437 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f292507e-6c74-4c53-8a63-d95cb23e158b tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "GET /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646" status: 200 len: 1555 microversion: 2.1 time: 0.161194 Oct 04 19:53:15.927035 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4022/8029] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:53:15 2022] GET /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646 => generated 1555 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:53:16.950631 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f078ec88-cf54-46be-aec3-e59d43ecf31e tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:53:16.951358 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f078ec88-cf54-46be-aec3-e59d43ecf31e tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: d43d8ac5-175b-40a3-b2cc-812551ccc646] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:53:16.959548 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f078ec88-cf54-46be-aec3-e59d43ecf31e tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:16.960068 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f078ec88-cf54-46be-aec3-e59d43ecf31e tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:16.960537 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f078ec88-cf54-46be-aec3-e59d43ecf31e tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:16.961295 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f078ec88-cf54-46be-aec3-e59d43ecf31e tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:16.961727 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f078ec88-cf54-46be-aec3-e59d43ecf31e tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:16.962277 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f078ec88-cf54-46be-aec3-e59d43ecf31e tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:17.093749 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f078ec88-cf54-46be-aec3-e59d43ecf31e tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd393b496ef146b2a4eb784f8b314259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccdc7fa868e497e9bc1b3e32fd09da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:53:17.102640 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f078ec88-cf54-46be-aec3-e59d43ecf31e tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "GET /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646" status: 200 len: 1555 microversion: 2.1 time: 0.156346 Oct 04 19:53:17.103221 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4008/8030] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:53:16 2022] GET /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646 => generated 1555 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:53:18.036797 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-8dbe042b-9d6d-42aa-818f-ebea5b3b15e6 req-c0385309-9e53-4548-84fb-b4d7c63213bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d43d8ac5-175b-40a3-b2cc-812551ccc646", "name": "network-vif-deleted", "tag": "f3dce3db-75f5-405e-84e9-f9eee39d2a2c"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:53:18.047450 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-8dbe042b-9d6d-42aa-818f-ebea5b3b15e6 req-c0385309-9e53-4548-84fb-b4d7c63213bd service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:18.049413 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-8dbe042b-9d6d-42aa-818f-ebea5b3b15e6 req-c0385309-9e53-4548-84fb-b4d7c63213bd service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:18.049413 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-8dbe042b-9d6d-42aa-818f-ebea5b3b15e6 req-c0385309-9e53-4548-84fb-b4d7c63213bd service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:18.060945 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-8dbe042b-9d6d-42aa-818f-ebea5b3b15e6 req-c0385309-9e53-4548-84fb-b4d7c63213bd service nova] Creating event network-vif-deleted:f3dce3db-75f5-405e-84e9-f9eee39d2a2c for instance d43d8ac5-175b-40a3-b2cc-812551ccc646 on n-h1-850501-14 Oct 04 19:53:18.066684 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-8dbe042b-9d6d-42aa-818f-ebea5b3b15e6 req-c0385309-9e53-4548-84fb-b4d7c63213bd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034451 Oct 04 19:53:18.067513 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4023/8031] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:53:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:53:18.125752 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9a17e7e1-e075-414d-ae6e-766f7fdaad4b tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:53:18.126437 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9a17e7e1-e075-414d-ae6e-766f7fdaad4b tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: d43d8ac5-175b-40a3-b2cc-812551ccc646] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:53:18.134463 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9a17e7e1-e075-414d-ae6e-766f7fdaad4b tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:18.134970 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9a17e7e1-e075-414d-ae6e-766f7fdaad4b tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:18.137163 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9a17e7e1-e075-414d-ae6e-766f7fdaad4b tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:18.137163 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9a17e7e1-e075-414d-ae6e-766f7fdaad4b tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:18.137163 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9a17e7e1-e075-414d-ae6e-766f7fdaad4b tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:18.137163 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9a17e7e1-e075-414d-ae6e-766f7fdaad4b tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:18.205278 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9a17e7e1-e075-414d-ae6e-766f7fdaad4b tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd393b496ef146b2a4eb784f8b314259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccdc7fa868e497e9bc1b3e32fd09da8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:53:18.214667 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9a17e7e1-e075-414d-ae6e-766f7fdaad4b tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "GET /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646" status: 200 len: 1513 microversion: 2.1 time: 0.093012 Oct 04 19:53:18.215248 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4009/8032] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:53:18 2022] GET /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646 => generated 1513 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:53:19.240542 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-18d2e7b0-d878-41ba-82f1-69838af262ce tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:53:19.241180 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-18d2e7b0-d878-41ba-82f1-69838af262ce tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] [instance: d43d8ac5-175b-40a3-b2cc-812551ccc646] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:53:19.248449 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-18d2e7b0-d878-41ba-82f1-69838af262ce tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:19.248941 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-18d2e7b0-d878-41ba-82f1-69838af262ce tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:19.249390 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-18d2e7b0-d878-41ba-82f1-69838af262ce tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:19.250163 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-18d2e7b0-d878-41ba-82f1-69838af262ce tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:19.250614 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-18d2e7b0-d878-41ba-82f1-69838af262ce tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:19.251048 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-18d2e7b0-d878-41ba-82f1-69838af262ce tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:19.265262 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-18d2e7b0-d878-41ba-82f1-69838af262ce tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] HTTP exception thrown: Instance d43d8ac5-175b-40a3-b2cc-812551ccc646 could not be found. Oct 04 19:53:19.266966 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-18d2e7b0-d878-41ba-82f1-69838af262ce tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Request method failure captured: Oct 04 19:53:19.266966 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646 HTTP/1.1 Oct 04 19:53:19.266966 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 19:53:19.266966 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 19:53:19.266966 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 19:53:19.266966 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 19:53:19.266966 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 19:53:19.266966 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 19:53:19.266966 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 19:53:19.266966 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 19:53:19.266966 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPI2zlegKSbZ0cFPghJWeoLYYgKhy8ReHaL4xP_gfcg46CNy-mQPMGixGZ0B2DaWv-pDzqS5kFeSe0cVGpQ5cVUTA0Gi4s_31WIampxIFZmvVB-4IEGJf54TMwhcKyRuM6UlnU9AzK-NgAxH8wzFeWKIcSpTOZTgDwwtQoqtbu-YGpDg Oct 04 19:53:19.266966 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 19:53:19.266966 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 19:53:19.266966 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 19:53:19.266966 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 19:53:19.266966 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 19:53:19.266966 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 19:53:19.266966 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 9ccdc7fa868e497e9bc1b3e32fd09da8 Oct 04 19:53:19.266966 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-TestMinimumBasicScenario-1244571287 Oct 04 19:53:19.266966 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 19:53:19.266966 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 19:53:19.266966 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9ccdc7fa868e497e9bc1b3e32fd09da8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9ccdc7fa868e497e9bc1b3e32fd09da8", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9ccdc7fa868e497e9bc1b3e32fd09da8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9ccdc7fa868e497e9bc1b3e32fd09da8"}]}] Oct 04 19:53:19.266966 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-TestMinimumBasicScenario-1244571287 Oct 04 19:53:19.266966 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 9ccdc7fa868e497e9bc1b3e32fd09da8 Oct 04 19:53:19.266966 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1244571287 Oct 04 19:53:19.266966 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-TestMinimumBasicScenario-1244571287-project Oct 04 19:53:19.266966 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 19:53:19.266966 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 19:53:19.266966 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: cd393b496ef146b2a4eb784f8b314259 Oct 04 19:53:19.266966 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-TestMinimumBasicScenario-1244571287-project Oct 04 19:53:19.266966 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 19:53:19.266966 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance d43d8ac5-175b-40a3-b2cc-812551ccc646 could not be found. Oct 04 19:53:19.266966 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': 'd43d8ac5-175b-40a3-b2cc-812551ccc646'} Oct 04 19:53:19.266966 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:53:19.266966 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:53:19.266966 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:53:19.266966 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:53:19.266966 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:53:19.266966 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:53:19.266966 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:53:19.266966 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:53:19.266966 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:53:19.266966 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:53:19.266966 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d43d8ac5-175b-40a3-b2cc-812551ccc646 could not be found. Oct 04 19:53:19.266966 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:53:19.266966 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:53:19.266966 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:53:19.266966 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:53:19.266966 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:53:19.266966 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:53:19.266966 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:53:19.266966 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:53:19.266966 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:53:19.266966 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:53:19.266966 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:53:19.266966 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:53:19.266966 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:53:19.266966 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:53:19.266966 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:53:19.266966 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:53:19.266966 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d43d8ac5-175b-40a3-b2cc-812551ccc646 could not be found. Oct 04 19:53:19.266966 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:53:19.266966 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:53:19.266966 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:53:19.277929 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:53:19.277929 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:53:19.277929 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:53:19.277929 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:53:19.277929 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:53:19.277929 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d43d8ac5-175b-40a3-b2cc-812551ccc646 could not be found. Oct 04 19:53:19.277929 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:53:19.277929 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-18d2e7b0-d878-41ba-82f1-69838af262ce tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Returning 404 to user: Instance d43d8ac5-175b-40a3-b2cc-812551ccc646 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:53:19.277929 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-18d2e7b0-d878-41ba-82f1-69838af262ce tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "GET /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646" status: 404 len: 111 microversion: 2.1 time: 0.033086 Oct 04 19:53:19.277929 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4024/8033] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:53:19 2022] GET /compute/v2.1/servers/d43d8ac5-175b-40a3-b2cc-812551ccc646 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:53:19.278717 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-914cfd26-f7ec-405c-9a24-05f0b4eb38be tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] Calling method '.version_select at 0x7fe253e11040>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:53:19.369254 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-914cfd26-f7ec-405c-9a24-05f0b4eb38be tempest-TestMinimumBasicScenario-1244571287 tempest-TestMinimumBasicScenario-1244571287-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-155971340" status: 202 len: 0 microversion: 2.1 time: 0.095299 Oct 04 19:53:19.370080 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4010/8034] 10.222.0.20 () {58 vars in 1269 bytes} [Tue Oct 4 19:53:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-155971340 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:53:33.193498 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=18 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:53:33.194258 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:53:33.365380 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-09c13555-3cc2-480c-bf88-84817a8eeb56 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Action: 'create', calling method: .version_select at 0x7fe253a75f70>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1361756875", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOnaaDwxKWjiG2ApGxSr6g8Yd3BcfAMqu2UXJKwsBxZS5ZINqLE1xn6JiodxMqkSDrUpseqS/o/RB6+3g2tpQDGZh9RY60vERAdOwkXT1L/wCm7h4VWaz466XBX792VvWg=="}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:53:33.381146 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-09c13555-3cc2-480c-bf88-84817a8eeb56 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Getting quotas for project 7112e2b246a44297876ee6d279e8f655. Resources: {'key_pairs'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:53:33.387202 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-09c13555-3cc2-480c-bf88-84817a8eeb56 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Getting quotas for user deb5459af175415da4825e6078eba908 and project 7112e2b246a44297876ee6d279e8f655. Resources: {'key_pairs'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:53:33.677235 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-09c13555-3cc2-480c-bf88-84817a8eeb56 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.490286 Oct 04 19:53:33.677843 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4025/8035] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Oct 4 19:53:33 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:53:43.671411 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:53:43.672216 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:53:43.676305 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-763d66e9-fed9-49e8-99c0-22450e7a8bef tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-20201635", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": [{"uuid": "5fade5d3-7912-4134-b7f7-43478cc8c96e"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1361756875", "security_groups": [{"name": "tempest-secgroup-smoke-45860508"}]}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:53:43.818432 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-763d66e9-fed9-49e8-99c0-22450e7a8bef tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] validate_networks() for [('5fade5d3-7912-4134-b7f7-43478cc8c96e', None, None, None, None, None)] {{(pid=123002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:53:44.220655 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-763d66e9-fed9-49e8-99c0-22450e7a8bef tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:53:44.222874 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-763d66e9-fed9-49e8-99c0-22450e7a8bef tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:53:44.222874 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-763d66e9-fed9-49e8-99c0-22450e7a8bef tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:53:44.222874 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-763d66e9-fed9-49e8-99c0-22450e7a8bef tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:53:44.222874 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-763d66e9-fed9-49e8-99c0-22450e7a8bef tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:53:44.231524 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-763d66e9-fed9-49e8-99c0-22450e7a8bef tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:44.232028 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-763d66e9-fed9-49e8-99c0-22450e7a8bef tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:44.232504 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-763d66e9-fed9-49e8-99c0-22450e7a8bef tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:44.233238 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-763d66e9-fed9-49e8-99c0-22450e7a8bef tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:44.233704 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-763d66e9-fed9-49e8-99c0-22450e7a8bef tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:44.234135 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-763d66e9-fed9-49e8-99c0-22450e7a8bef tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:44.255075 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-763d66e9-fed9-49e8-99c0-22450e7a8bef tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Getting quotas for project 7112e2b246a44297876ee6d279e8f655. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:53:44.261878 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-763d66e9-fed9-49e8-99c0-22450e7a8bef tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Getting quotas for user deb5459af175415da4825e6078eba908 and project 7112e2b246a44297876ee6d279e8f655. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:53:44.274859 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-763d66e9-fed9-49e8-99c0-22450e7a8bef tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Going to run 1 instances... {{(pid=123002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:53:44.277250 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-763d66e9-fed9-49e8-99c0-22450e7a8bef tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 427eb234-68ae-49c0-946c-4fd3eccbadef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:53:44.424265 n-d-850501-14 devstack@n-api.service[123002]: ERROR oslo.messaging._drivers.impl_rabbit [None req-763d66e9-fed9-49e8-99c0-22450e7a8bef tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [dcd3de5e-bba6-4468-b8a4-2b05a921d453] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 19:53:45.431747 n-d-850501-14 devstack@n-api.service[123002]: INFO oslo.messaging._drivers.impl_rabbit [None req-763d66e9-fed9-49e8-99c0-22450e7a8bef tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [dcd3de5e-bba6-4468-b8a4-2b05a921d453] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 53382. Oct 04 19:53:45.443291 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-763d66e9-fed9-49e8-99c0-22450e7a8bef tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.768125 Oct 04 19:53:45.443291 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4011/8036] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 19:53:43 2022] POST /compute/v2.1/servers => generated 404 bytes in 1775 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 19:53:45.448821 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=4 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:53:45.449912 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:53:45.459202 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-510da451-6ab1-42cc-a361-beaa3d6151cc tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:53:45.459202 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-510da451-6ab1-42cc-a361-beaa3d6151cc tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 427eb234-68ae-49c0-946c-4fd3eccbadef] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:53:45.543109 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-510da451-6ab1-42cc-a361-beaa3d6151cc tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:53:45.554416 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-510da451-6ab1-42cc-a361-beaa3d6151cc tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/427eb234-68ae-49c0-946c-4fd3eccbadef" status: 200 len: 1265 microversion: 2.1 time: 0.107279 Oct 04 19:53:45.555434 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4026/8037] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:53:45 2022] GET /compute/v2.1/servers/427eb234-68ae-49c0-946c-4fd3eccbadef => generated 1265 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:53:46.579554 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8b040158-f631-4f1e-b591-de5a80d33de5 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:53:46.580159 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8b040158-f631-4f1e-b591-de5a80d33de5 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 427eb234-68ae-49c0-946c-4fd3eccbadef] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:53:46.644808 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8b040158-f631-4f1e-b591-de5a80d33de5 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:53:46.644808 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8b040158-f631-4f1e-b591-de5a80d33de5 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/427eb234-68ae-49c0-946c-4fd3eccbadef" status: 200 len: 1265 microversion: 2.1 time: 0.068980 Oct 04 19:53:46.644808 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4012/8038] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:53:46 2022] GET /compute/v2.1/servers/427eb234-68ae-49c0-946c-4fd3eccbadef => generated 1265 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:53:47.668398 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c72fb35e-18ec-4ca5-93a0-9f8b8ce23a2c tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:53:47.668972 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c72fb35e-18ec-4ca5-93a0-9f8b8ce23a2c tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 427eb234-68ae-49c0-946c-4fd3eccbadef] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:53:47.677016 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c72fb35e-18ec-4ca5-93a0-9f8b8ce23a2c tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:47.677505 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c72fb35e-18ec-4ca5-93a0-9f8b8ce23a2c tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:47.678508 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c72fb35e-18ec-4ca5-93a0-9f8b8ce23a2c tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:47.679927 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c72fb35e-18ec-4ca5-93a0-9f8b8ce23a2c tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:47.680419 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c72fb35e-18ec-4ca5-93a0-9f8b8ce23a2c tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:47.680852 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c72fb35e-18ec-4ca5-93a0-9f8b8ce23a2c tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:47.743139 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c72fb35e-18ec-4ca5-93a0-9f8b8ce23a2c tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:53:47.750983 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c72fb35e-18ec-4ca5-93a0-9f8b8ce23a2c tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/427eb234-68ae-49c0-946c-4fd3eccbadef" status: 200 len: 1261 microversion: 2.1 time: 0.087040 Oct 04 19:53:47.751555 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4027/8039] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:53:47 2022] GET /compute/v2.1/servers/427eb234-68ae-49c0-946c-4fd3eccbadef => generated 1261 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:53:48.774416 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0cf51d9d-9800-4d50-b9f3-eced43944e17 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:53:48.775121 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0cf51d9d-9800-4d50-b9f3-eced43944e17 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 427eb234-68ae-49c0-946c-4fd3eccbadef] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:53:48.782362 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0cf51d9d-9800-4d50-b9f3-eced43944e17 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:48.782872 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0cf51d9d-9800-4d50-b9f3-eced43944e17 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:48.783369 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0cf51d9d-9800-4d50-b9f3-eced43944e17 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:48.784077 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0cf51d9d-9800-4d50-b9f3-eced43944e17 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:48.784557 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0cf51d9d-9800-4d50-b9f3-eced43944e17 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:48.785006 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0cf51d9d-9800-4d50-b9f3-eced43944e17 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:48.946722 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0cf51d9d-9800-4d50-b9f3-eced43944e17 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:53:48.954406 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0cf51d9d-9800-4d50-b9f3-eced43944e17 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/427eb234-68ae-49c0-946c-4fd3eccbadef" status: 200 len: 1335 microversion: 2.1 time: 0.184013 Oct 04 19:53:48.954982 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4013/8040] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:53:48 2022] GET /compute/v2.1/servers/427eb234-68ae-49c0-946c-4fd3eccbadef => generated 1335 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:53:49.977922 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5392fa88-2b7c-4646-a940-4dcd347067bf tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:53:49.978575 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5392fa88-2b7c-4646-a940-4dcd347067bf tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 427eb234-68ae-49c0-946c-4fd3eccbadef] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:53:49.985448 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5392fa88-2b7c-4646-a940-4dcd347067bf tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:49.985935 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5392fa88-2b7c-4646-a940-4dcd347067bf tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:49.986373 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5392fa88-2b7c-4646-a940-4dcd347067bf tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:49.987135 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5392fa88-2b7c-4646-a940-4dcd347067bf tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:49.987593 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5392fa88-2b7c-4646-a940-4dcd347067bf tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:49.988029 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5392fa88-2b7c-4646-a940-4dcd347067bf tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:50.195509 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5392fa88-2b7c-4646-a940-4dcd347067bf tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:53:50.203587 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5392fa88-2b7c-4646-a940-4dcd347067bf tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/427eb234-68ae-49c0-946c-4fd3eccbadef" status: 200 len: 1389 microversion: 2.1 time: 0.230332 Oct 04 19:53:50.204191 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4028/8041] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:53:49 2022] GET /compute/v2.1/servers/427eb234-68ae-49c0-946c-4fd3eccbadef => generated 1389 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:53:50.744727 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-b410cce2-d3cc-4bbe-ba4b-47b94602678e req-d4227812-6bc7-47e5-b40f-2e4aa82b2487 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "427eb234-68ae-49c0-946c-4fd3eccbadef", "tag": "f5a56d42-74cb-4583-82ef-5d9683c0fd85"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:53:50.755362 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-b410cce2-d3cc-4bbe-ba4b-47b94602678e req-d4227812-6bc7-47e5-b40f-2e4aa82b2487 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:50.755914 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-b410cce2-d3cc-4bbe-ba4b-47b94602678e req-d4227812-6bc7-47e5-b40f-2e4aa82b2487 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:50.756413 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-b410cce2-d3cc-4bbe-ba4b-47b94602678e req-d4227812-6bc7-47e5-b40f-2e4aa82b2487 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:50.767356 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-b410cce2-d3cc-4bbe-ba4b-47b94602678e req-d4227812-6bc7-47e5-b40f-2e4aa82b2487 service nova] Creating event network-changed:f5a56d42-74cb-4583-82ef-5d9683c0fd85 for instance 427eb234-68ae-49c0-946c-4fd3eccbadef on n-h1-850501-14 Oct 04 19:53:50.773194 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-b410cce2-d3cc-4bbe-ba4b-47b94602678e req-d4227812-6bc7-47e5-b40f-2e4aa82b2487 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032784 Oct 04 19:53:50.773822 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4014/8042] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:53:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:53:51.228847 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4d9aa538-6cec-4ce7-b8b9-4779c30f4f70 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:53:51.229462 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-4d9aa538-6cec-4ce7-b8b9-4779c30f4f70 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 427eb234-68ae-49c0-946c-4fd3eccbadef] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:53:51.236728 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4d9aa538-6cec-4ce7-b8b9-4779c30f4f70 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:51.237337 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4d9aa538-6cec-4ce7-b8b9-4779c30f4f70 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:51.237788 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4d9aa538-6cec-4ce7-b8b9-4779c30f4f70 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:51.238531 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4d9aa538-6cec-4ce7-b8b9-4779c30f4f70 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:51.238998 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4d9aa538-6cec-4ce7-b8b9-4779c30f4f70 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:51.239432 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4d9aa538-6cec-4ce7-b8b9-4779c30f4f70 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:51.482671 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-4d9aa538-6cec-4ce7-b8b9-4779c30f4f70 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:53:51.491024 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-4d9aa538-6cec-4ce7-b8b9-4779c30f4f70 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/427eb234-68ae-49c0-946c-4fd3eccbadef" status: 200 len: 1389 microversion: 2.1 time: 0.266077 Oct 04 19:53:51.491598 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4029/8043] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:53:51 2022] GET /compute/v2.1/servers/427eb234-68ae-49c0-946c-4fd3eccbadef => generated 1389 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:53:52.515255 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-526d7e69-7c77-41a1-a7bd-9a386f6b576d tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:53:52.515970 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-526d7e69-7c77-41a1-a7bd-9a386f6b576d tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 427eb234-68ae-49c0-946c-4fd3eccbadef] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:53:52.523384 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-526d7e69-7c77-41a1-a7bd-9a386f6b576d tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:52.523913 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-526d7e69-7c77-41a1-a7bd-9a386f6b576d tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:52.525453 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-526d7e69-7c77-41a1-a7bd-9a386f6b576d tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:52.525453 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-526d7e69-7c77-41a1-a7bd-9a386f6b576d tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:52.525900 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-526d7e69-7c77-41a1-a7bd-9a386f6b576d tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:52.526337 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-526d7e69-7c77-41a1-a7bd-9a386f6b576d tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:52.665648 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-526d7e69-7c77-41a1-a7bd-9a386f6b576d tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:53:52.673621 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-526d7e69-7c77-41a1-a7bd-9a386f6b576d tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/427eb234-68ae-49c0-946c-4fd3eccbadef" status: 200 len: 1389 microversion: 2.1 time: 0.162745 Oct 04 19:53:52.674198 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4015/8044] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:53:52 2022] GET /compute/v2.1/servers/427eb234-68ae-49c0-946c-4fd3eccbadef => generated 1389 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:53:53.697264 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-43810123-2afa-4997-9642-47c783d05e4e tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:53:53.697885 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-43810123-2afa-4997-9642-47c783d05e4e tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 427eb234-68ae-49c0-946c-4fd3eccbadef] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:53:53.705013 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-43810123-2afa-4997-9642-47c783d05e4e tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:53.705508 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-43810123-2afa-4997-9642-47c783d05e4e tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:53.705951 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-43810123-2afa-4997-9642-47c783d05e4e tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:53.706666 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-43810123-2afa-4997-9642-47c783d05e4e tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:53.707118 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-43810123-2afa-4997-9642-47c783d05e4e tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:53.707551 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-43810123-2afa-4997-9642-47c783d05e4e tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:53.841980 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-43810123-2afa-4997-9642-47c783d05e4e tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:53:53.849698 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-43810123-2afa-4997-9642-47c783d05e4e tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/427eb234-68ae-49c0-946c-4fd3eccbadef" status: 200 len: 1389 microversion: 2.1 time: 0.156588 Oct 04 19:53:53.850534 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4030/8045] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:53:53 2022] GET /compute/v2.1/servers/427eb234-68ae-49c0-946c-4fd3eccbadef => generated 1389 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:53:54.874170 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3b0812d2-7cee-40d1-a586-439ee9cb7a9b tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:53:54.874804 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3b0812d2-7cee-40d1-a586-439ee9cb7a9b tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 427eb234-68ae-49c0-946c-4fd3eccbadef] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:53:54.877613 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:53:54.882432 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3b0812d2-7cee-40d1-a586-439ee9cb7a9b tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:54.883465 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3b0812d2-7cee-40d1-a586-439ee9cb7a9b tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:54.884044 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3b0812d2-7cee-40d1-a586-439ee9cb7a9b tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:54.884890 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3b0812d2-7cee-40d1-a586-439ee9cb7a9b tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:54.885371 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3b0812d2-7cee-40d1-a586-439ee9cb7a9b tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:54.885821 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3b0812d2-7cee-40d1-a586-439ee9cb7a9b tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:55.022511 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3b0812d2-7cee-40d1-a586-439ee9cb7a9b tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:53:55.030514 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3b0812d2-7cee-40d1-a586-439ee9cb7a9b tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/427eb234-68ae-49c0-946c-4fd3eccbadef" status: 200 len: 1389 microversion: 2.1 time: 0.160356 Oct 04 19:53:55.031089 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4016/8046] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:53:54 2022] GET /compute/v2.1/servers/427eb234-68ae-49c0-946c-4fd3eccbadef => generated 1389 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:53:56.054164 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ad6fbdfd-373b-4a47-8b49-c76912581a50 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:53:56.054867 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ad6fbdfd-373b-4a47-8b49-c76912581a50 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 427eb234-68ae-49c0-946c-4fd3eccbadef] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:53:56.061922 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ad6fbdfd-373b-4a47-8b49-c76912581a50 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:56.062414 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ad6fbdfd-373b-4a47-8b49-c76912581a50 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:56.062856 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ad6fbdfd-373b-4a47-8b49-c76912581a50 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:56.063562 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ad6fbdfd-373b-4a47-8b49-c76912581a50 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:56.064027 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ad6fbdfd-373b-4a47-8b49-c76912581a50 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:56.064486 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ad6fbdfd-373b-4a47-8b49-c76912581a50 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:56.200521 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ad6fbdfd-373b-4a47-8b49-c76912581a50 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:53:56.208446 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ad6fbdfd-373b-4a47-8b49-c76912581a50 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/427eb234-68ae-49c0-946c-4fd3eccbadef" status: 200 len: 1389 microversion: 2.1 time: 0.158166 Oct 04 19:53:56.209036 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4031/8047] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:53:56 2022] GET /compute/v2.1/servers/427eb234-68ae-49c0-946c-4fd3eccbadef => generated 1389 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:53:57.232141 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2d3cbdd1-9975-4aeb-a4d3-43d0a5341242 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:53:57.232773 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2d3cbdd1-9975-4aeb-a4d3-43d0a5341242 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 427eb234-68ae-49c0-946c-4fd3eccbadef] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:53:57.235508 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=8 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:53:57.240342 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2d3cbdd1-9975-4aeb-a4d3-43d0a5341242 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:57.240842 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2d3cbdd1-9975-4aeb-a4d3-43d0a5341242 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:57.241339 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2d3cbdd1-9975-4aeb-a4d3-43d0a5341242 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:57.242035 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2d3cbdd1-9975-4aeb-a4d3-43d0a5341242 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:57.247888 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2d3cbdd1-9975-4aeb-a4d3-43d0a5341242 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:57.247888 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2d3cbdd1-9975-4aeb-a4d3-43d0a5341242 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:57.382147 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2d3cbdd1-9975-4aeb-a4d3-43d0a5341242 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:53:57.393062 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2d3cbdd1-9975-4aeb-a4d3-43d0a5341242 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/427eb234-68ae-49c0-946c-4fd3eccbadef" status: 200 len: 1389 microversion: 2.1 time: 0.164874 Oct 04 19:53:57.393648 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4017/8048] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:53:57 2022] GET /compute/v2.1/servers/427eb234-68ae-49c0-946c-4fd3eccbadef => generated 1389 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:53:58.347944 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:53:58.420801 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3dae7f52-f797-490e-aa1e-46ffbccf7b66 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:53:58.421465 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3dae7f52-f797-490e-aa1e-46ffbccf7b66 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 427eb234-68ae-49c0-946c-4fd3eccbadef] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:53:58.427575 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3dae7f52-f797-490e-aa1e-46ffbccf7b66 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:58.428115 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3dae7f52-f797-490e-aa1e-46ffbccf7b66 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:58.428579 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3dae7f52-f797-490e-aa1e-46ffbccf7b66 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:58.429309 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3dae7f52-f797-490e-aa1e-46ffbccf7b66 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:58.430421 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3dae7f52-f797-490e-aa1e-46ffbccf7b66 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:58.431174 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3dae7f52-f797-490e-aa1e-46ffbccf7b66 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:58.465666 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-f6ed110b-a144-4ceb-957b-a92a6cf7dfe6 req-0e506ff9-5e56-4dd9-b7ff-9ba6004ab341 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "427eb234-68ae-49c0-946c-4fd3eccbadef", "name": "network-vif-plugged", "status": "completed", "tag": "f5a56d42-74cb-4583-82ef-5d9683c0fd85"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:53:58.476170 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-f6ed110b-a144-4ceb-957b-a92a6cf7dfe6 req-0e506ff9-5e56-4dd9-b7ff-9ba6004ab341 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:58.476858 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-f6ed110b-a144-4ceb-957b-a92a6cf7dfe6 req-0e506ff9-5e56-4dd9-b7ff-9ba6004ab341 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:58.477292 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-f6ed110b-a144-4ceb-957b-a92a6cf7dfe6 req-0e506ff9-5e56-4dd9-b7ff-9ba6004ab341 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:58.488667 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-f6ed110b-a144-4ceb-957b-a92a6cf7dfe6 req-0e506ff9-5e56-4dd9-b7ff-9ba6004ab341 service nova] Creating event network-vif-plugged:f5a56d42-74cb-4583-82ef-5d9683c0fd85 for instance 427eb234-68ae-49c0-946c-4fd3eccbadef on n-h1-850501-14 Oct 04 19:53:58.494413 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-f6ed110b-a144-4ceb-957b-a92a6cf7dfe6 req-0e506ff9-5e56-4dd9-b7ff-9ba6004ab341 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153095 Oct 04 19:53:58.495542 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4032/8049] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:53:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:53:58.620974 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3dae7f52-f797-490e-aa1e-46ffbccf7b66 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:53:58.628849 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3dae7f52-f797-490e-aa1e-46ffbccf7b66 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/427eb234-68ae-49c0-946c-4fd3eccbadef" status: 200 len: 1389 microversion: 2.1 time: 0.214764 Oct 04 19:53:58.629466 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4018/8050] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:53:58 2022] GET /compute/v2.1/servers/427eb234-68ae-49c0-946c-4fd3eccbadef => generated 1389 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:53:59.653573 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-cc66cf41-62af-4736-8c78-b1f8f913870f tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:53:59.654307 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-cc66cf41-62af-4736-8c78-b1f8f913870f tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 427eb234-68ae-49c0-946c-4fd3eccbadef] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:53:59.661880 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cc66cf41-62af-4736-8c78-b1f8f913870f tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:59.662665 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cc66cf41-62af-4736-8c78-b1f8f913870f tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:59.663106 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cc66cf41-62af-4736-8c78-b1f8f913870f tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:59.663814 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cc66cf41-62af-4736-8c78-b1f8f913870f tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:59.664947 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cc66cf41-62af-4736-8c78-b1f8f913870f tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:59.665394 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cc66cf41-62af-4736-8c78-b1f8f913870f tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:59.811615 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-cc66cf41-62af-4736-8c78-b1f8f913870f tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:53:59.819549 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-cc66cf41-62af-4736-8c78-b1f8f913870f tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/427eb234-68ae-49c0-946c-4fd3eccbadef" status: 200 len: 1389 microversion: 2.1 time: 0.171386 Oct 04 19:53:59.820150 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4033/8051] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:53:59 2022] GET /compute/v2.1/servers/427eb234-68ae-49c0-946c-4fd3eccbadef => generated 1389 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:54:00.842869 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5d58a96b-6826-4fad-99a7-1d1b48c96632 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:54:00.843507 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5d58a96b-6826-4fad-99a7-1d1b48c96632 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 427eb234-68ae-49c0-946c-4fd3eccbadef] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:54:00.850810 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5d58a96b-6826-4fad-99a7-1d1b48c96632 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:00.851347 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5d58a96b-6826-4fad-99a7-1d1b48c96632 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:00.851820 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5d58a96b-6826-4fad-99a7-1d1b48c96632 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:00.852632 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5d58a96b-6826-4fad-99a7-1d1b48c96632 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:00.853129 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5d58a96b-6826-4fad-99a7-1d1b48c96632 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:00.853557 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5d58a96b-6826-4fad-99a7-1d1b48c96632 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:00.991060 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5d58a96b-6826-4fad-99a7-1d1b48c96632 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:54:00.999015 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5d58a96b-6826-4fad-99a7-1d1b48c96632 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/427eb234-68ae-49c0-946c-4fd3eccbadef" status: 200 len: 1560 microversion: 2.1 time: 0.160087 Oct 04 19:54:00.999589 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4019/8052] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:54:00 2022] GET /compute/v2.1/servers/427eb234-68ae-49c0-946c-4fd3eccbadef => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:54:01.021332 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ec35272f-c70e-4fb9-bb97-548cdb606f70 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:54:01.021952 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ec35272f-c70e-4fb9-bb97-548cdb606f70 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 427eb234-68ae-49c0-946c-4fd3eccbadef] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:54:01.029306 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec35272f-c70e-4fb9-bb97-548cdb606f70 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:01.029796 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec35272f-c70e-4fb9-bb97-548cdb606f70 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:01.030239 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec35272f-c70e-4fb9-bb97-548cdb606f70 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:01.030935 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec35272f-c70e-4fb9-bb97-548cdb606f70 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:01.031401 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec35272f-c70e-4fb9-bb97-548cdb606f70 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:01.031829 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec35272f-c70e-4fb9-bb97-548cdb606f70 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:01.164845 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ec35272f-c70e-4fb9-bb97-548cdb606f70 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:54:01.172666 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ec35272f-c70e-4fb9-bb97-548cdb606f70 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/427eb234-68ae-49c0-946c-4fd3eccbadef" status: 200 len: 1560 microversion: 2.1 time: 0.155235 Oct 04 19:54:01.173240 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4034/8053] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:54:01 2022] GET /compute/v2.1/servers/427eb234-68ae-49c0-946c-4fd3eccbadef => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:54:03.105633 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b6d35f87-0f05-4dd9-b52d-46351c09db4e tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:54:03.106353 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b6d35f87-0f05-4dd9-b52d-46351c09db4e tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 427eb234-68ae-49c0-946c-4fd3eccbadef] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:54:03.107798 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-e734fe70-0a62-4d1c-b729-dedf50c5d4ef req-3f14e030-1025-4bb2-9b16-d1589f24b219 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "427eb234-68ae-49c0-946c-4fd3eccbadef", "tag": "f5a56d42-74cb-4583-82ef-5d9683c0fd85"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:54:03.113043 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b6d35f87-0f05-4dd9-b52d-46351c09db4e tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:03.113687 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b6d35f87-0f05-4dd9-b52d-46351c09db4e tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:03.114379 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b6d35f87-0f05-4dd9-b52d-46351c09db4e tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:03.115109 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b6d35f87-0f05-4dd9-b52d-46351c09db4e tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:03.115590 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b6d35f87-0f05-4dd9-b52d-46351c09db4e tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:03.116041 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b6d35f87-0f05-4dd9-b52d-46351c09db4e tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:03.119865 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-e734fe70-0a62-4d1c-b729-dedf50c5d4ef req-3f14e030-1025-4bb2-9b16-d1589f24b219 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:03.120388 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-e734fe70-0a62-4d1c-b729-dedf50c5d4ef req-3f14e030-1025-4bb2-9b16-d1589f24b219 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:03.122043 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-e734fe70-0a62-4d1c-b729-dedf50c5d4ef req-3f14e030-1025-4bb2-9b16-d1589f24b219 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:03.132479 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-e734fe70-0a62-4d1c-b729-dedf50c5d4ef req-3f14e030-1025-4bb2-9b16-d1589f24b219 service nova] Creating event network-changed:f5a56d42-74cb-4583-82ef-5d9683c0fd85 for instance 427eb234-68ae-49c0-946c-4fd3eccbadef on n-h1-850501-14 Oct 04 19:54:03.138760 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-e734fe70-0a62-4d1c-b729-dedf50c5d4ef req-3f14e030-1025-4bb2-9b16-d1589f24b219 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034400 Oct 04 19:54:03.139371 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4035/8054] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:54:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:54:03.341460 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b6d35f87-0f05-4dd9-b52d-46351c09db4e tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:54:03.349876 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b6d35f87-0f05-4dd9-b52d-46351c09db4e tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/427eb234-68ae-49c0-946c-4fd3eccbadef" status: 200 len: 1560 microversion: 2.1 time: 0.249050 Oct 04 19:54:03.350790 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4020/8055] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:54:03 2022] GET /compute/v2.1/servers/427eb234-68ae-49c0-946c-4fd3eccbadef => generated 1560 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:54:25.711837 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=22 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:54:25.713060 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=46 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:54:25.717311 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d9159c15-e69f-48bb-8783-827bdfc85892 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:54:25.726083 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d9159c15-e69f-48bb-8783-827bdfc85892 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 427eb234-68ae-49c0-946c-4fd3eccbadef] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:54:25.727111 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d9159c15-e69f-48bb-8783-827bdfc85892 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:25.727260 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d9159c15-e69f-48bb-8783-827bdfc85892 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:25.727600 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d9159c15-e69f-48bb-8783-827bdfc85892 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:25.728335 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d9159c15-e69f-48bb-8783-827bdfc85892 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:25.728800 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d9159c15-e69f-48bb-8783-827bdfc85892 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:25.729237 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d9159c15-e69f-48bb-8783-827bdfc85892 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:25.782491 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d9159c15-e69f-48bb-8783-827bdfc85892 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "POST /compute/v2.1/servers/427eb234-68ae-49c0-946c-4fd3eccbadef/action" status: 200 len: 24573 microversion: 2.1 time: 0.072761 Oct 04 19:54:25.783339 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4036/8056] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 19:54:25 2022] POST /compute/v2.1/servers/427eb234-68ae-49c0-946c-4fd3eccbadef/action => generated 24573 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:54:32.205200 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b7b3c783-68ce-4849-abc3-2cb002a231bc tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:54:32.205830 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b7b3c783-68ce-4849-abc3-2cb002a231bc tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 427eb234-68ae-49c0-946c-4fd3eccbadef] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:54:32.208335 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:54:32.209036 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=46 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:54:32.214230 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b7b3c783-68ce-4849-abc3-2cb002a231bc tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:32.218877 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b7b3c783-68ce-4849-abc3-2cb002a231bc tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:32.218877 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b7b3c783-68ce-4849-abc3-2cb002a231bc tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:32.218877 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b7b3c783-68ce-4849-abc3-2cb002a231bc tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:32.218877 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b7b3c783-68ce-4849-abc3-2cb002a231bc tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:32.218877 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b7b3c783-68ce-4849-abc3-2cb002a231bc tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:32.408824 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b7b3c783-68ce-4849-abc3-2cb002a231bc tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "POST /compute/v2.1/servers/427eb234-68ae-49c0-946c-4fd3eccbadef/action" status: 202 len: 0 microversion: 2.1 time: 0.207445 Oct 04 19:54:32.409481 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4021/8057] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 19:54:32 2022] POST /compute/v2.1/servers/427eb234-68ae-49c0-946c-4fd3eccbadef/action => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:54:32.418607 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-33152a5f-3960-4093-91be-278ce9dfa48a tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:54:32.424370 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-33152a5f-3960-4093-91be-278ce9dfa48a tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 427eb234-68ae-49c0-946c-4fd3eccbadef] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:54:32.426921 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-33152a5f-3960-4093-91be-278ce9dfa48a tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:32.427404 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-33152a5f-3960-4093-91be-278ce9dfa48a tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:32.427839 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-33152a5f-3960-4093-91be-278ce9dfa48a tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:32.428660 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-33152a5f-3960-4093-91be-278ce9dfa48a tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:32.429260 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-33152a5f-3960-4093-91be-278ce9dfa48a tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:32.429687 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-33152a5f-3960-4093-91be-278ce9dfa48a tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:32.580350 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-33152a5f-3960-4093-91be-278ce9dfa48a tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:54:32.588709 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-33152a5f-3960-4093-91be-278ce9dfa48a tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/427eb234-68ae-49c0-946c-4fd3eccbadef" status: 200 len: 1684 microversion: 2.1 time: 0.174686 Oct 04 19:54:32.589463 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4037/8058] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:54:32 2022] GET /compute/v2.1/servers/427eb234-68ae-49c0-946c-4fd3eccbadef => generated 1684 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:54:33.614534 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9b48f830-372c-47ff-8a31-45c42b7b714a tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:54:33.615256 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9b48f830-372c-47ff-8a31-45c42b7b714a tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 427eb234-68ae-49c0-946c-4fd3eccbadef] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:54:33.621609 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9b48f830-372c-47ff-8a31-45c42b7b714a tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:33.622115 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9b48f830-372c-47ff-8a31-45c42b7b714a tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:33.622568 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9b48f830-372c-47ff-8a31-45c42b7b714a tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:33.623271 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9b48f830-372c-47ff-8a31-45c42b7b714a tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:33.623744 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9b48f830-372c-47ff-8a31-45c42b7b714a tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:33.624214 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9b48f830-372c-47ff-8a31-45c42b7b714a tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:33.756506 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9b48f830-372c-47ff-8a31-45c42b7b714a tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:54:33.764568 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9b48f830-372c-47ff-8a31-45c42b7b714a tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/427eb234-68ae-49c0-946c-4fd3eccbadef" status: 200 len: 1664 microversion: 2.1 time: 0.155760 Oct 04 19:54:33.769922 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4022/8059] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:54:33 2022] GET /compute/v2.1/servers/427eb234-68ae-49c0-946c-4fd3eccbadef => generated 1664 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:54:34.871587 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a49667e3-a791-4425-87ee-e66d83fa4e08 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:54:34.873898 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a49667e3-a791-4425-87ee-e66d83fa4e08 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 427eb234-68ae-49c0-946c-4fd3eccbadef] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:54:34.885957 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a49667e3-a791-4425-87ee-e66d83fa4e08 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:34.886647 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a49667e3-a791-4425-87ee-e66d83fa4e08 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:34.887088 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a49667e3-a791-4425-87ee-e66d83fa4e08 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:34.887799 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a49667e3-a791-4425-87ee-e66d83fa4e08 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:34.888286 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a49667e3-a791-4425-87ee-e66d83fa4e08 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:34.888712 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a49667e3-a791-4425-87ee-e66d83fa4e08 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:34.948803 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a49667e3-a791-4425-87ee-e66d83fa4e08 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "POST /compute/v2.1/servers/427eb234-68ae-49c0-946c-4fd3eccbadef/action" status: 200 len: 32642 microversion: 2.1 time: 0.080889 Oct 04 19:54:34.949458 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4038/8060] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 19:54:34 2022] POST /compute/v2.1/servers/427eb234-68ae-49c0-946c-4fd3eccbadef/action => generated 32642 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:54:34.962031 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4ad82056-2e15-43dd-84ac-75532949b8a7 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:54:34.962596 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4ad82056-2e15-43dd-84ac-75532949b8a7 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 427eb234-68ae-49c0-946c-4fd3eccbadef] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:54:34.969488 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4ad82056-2e15-43dd-84ac-75532949b8a7 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:34.971590 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4ad82056-2e15-43dd-84ac-75532949b8a7 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:34.971590 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4ad82056-2e15-43dd-84ac-75532949b8a7 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:34.971590 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4ad82056-2e15-43dd-84ac-75532949b8a7 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:34.971590 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4ad82056-2e15-43dd-84ac-75532949b8a7 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:34.972035 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4ad82056-2e15-43dd-84ac-75532949b8a7 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:35.175497 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4ad82056-2e15-43dd-84ac-75532949b8a7 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "POST /compute/v2.1/servers/427eb234-68ae-49c0-946c-4fd3eccbadef/action" status: 202 len: 0 microversion: 2.1 time: 0.217920 Oct 04 19:54:35.184301 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4023/8061] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 19:54:34 2022] POST /compute/v2.1/servers/427eb234-68ae-49c0-946c-4fd3eccbadef/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:54:35.194594 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c1bb86a2-19a1-491c-a974-19c385085258 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:54:35.195300 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c1bb86a2-19a1-491c-a974-19c385085258 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 427eb234-68ae-49c0-946c-4fd3eccbadef] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:54:35.202967 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c1bb86a2-19a1-491c-a974-19c385085258 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:35.203463 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c1bb86a2-19a1-491c-a974-19c385085258 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:35.204006 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c1bb86a2-19a1-491c-a974-19c385085258 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:35.204758 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c1bb86a2-19a1-491c-a974-19c385085258 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:35.205245 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c1bb86a2-19a1-491c-a974-19c385085258 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:35.205676 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c1bb86a2-19a1-491c-a974-19c385085258 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:35.346488 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c1bb86a2-19a1-491c-a974-19c385085258 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:54:35.355251 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c1bb86a2-19a1-491c-a974-19c385085258 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/427eb234-68ae-49c0-946c-4fd3eccbadef" status: 200 len: 1671 microversion: 2.1 time: 0.165729 Oct 04 19:54:35.355825 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4039/8062] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:54:35 2022] GET /compute/v2.1/servers/427eb234-68ae-49c0-946c-4fd3eccbadef => generated 1671 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:54:36.382813 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-fd1971cc-ab80-47de-9a14-85ddeada6fff tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:54:36.383534 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-fd1971cc-ab80-47de-9a14-85ddeada6fff tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 427eb234-68ae-49c0-946c-4fd3eccbadef] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:54:36.389729 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fd1971cc-ab80-47de-9a14-85ddeada6fff tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:36.390247 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fd1971cc-ab80-47de-9a14-85ddeada6fff tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:36.390696 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fd1971cc-ab80-47de-9a14-85ddeada6fff tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:36.391405 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fd1971cc-ab80-47de-9a14-85ddeada6fff tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:36.391880 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fd1971cc-ab80-47de-9a14-85ddeada6fff tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:36.392364 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fd1971cc-ab80-47de-9a14-85ddeada6fff tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:36.526623 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-fd1971cc-ab80-47de-9a14-85ddeada6fff tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:54:36.534435 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-fd1971cc-ab80-47de-9a14-85ddeada6fff tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/427eb234-68ae-49c0-946c-4fd3eccbadef" status: 200 len: 1679 microversion: 2.1 time: 0.157317 Oct 04 19:54:36.535010 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4024/8063] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:54:36 2022] GET /compute/v2.1/servers/427eb234-68ae-49c0-946c-4fd3eccbadef => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:54:36.639894 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-eee3d869-c150-443f-8cb3-0b564e6b1b25 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:54:36.642122 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-eee3d869-c150-443f-8cb3-0b564e6b1b25 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 427eb234-68ae-49c0-946c-4fd3eccbadef] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:54:36.650557 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eee3d869-c150-443f-8cb3-0b564e6b1b25 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:36.651043 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eee3d869-c150-443f-8cb3-0b564e6b1b25 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:36.651482 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eee3d869-c150-443f-8cb3-0b564e6b1b25 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:36.652203 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eee3d869-c150-443f-8cb3-0b564e6b1b25 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:36.652660 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eee3d869-c150-443f-8cb3-0b564e6b1b25 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:36.653085 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eee3d869-c150-443f-8cb3-0b564e6b1b25 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:37.577794 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-eee3d869-c150-443f-8cb3-0b564e6b1b25 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "POST /compute/v2.1/servers/427eb234-68ae-49c0-946c-4fd3eccbadef/action" status: 200 len: 35670 microversion: 2.1 time: 0.941632 Oct 04 19:54:37.587234 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4040/8064] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 19:54:36 2022] POST /compute/v2.1/servers/427eb234-68ae-49c0-946c-4fd3eccbadef/action => generated 35670 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:54:38.627283 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7bfa5875-bc85-4539-a00e-73469c646725 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:54:38.627990 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7bfa5875-bc85-4539-a00e-73469c646725 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 427eb234-68ae-49c0-946c-4fd3eccbadef] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:54:38.629693 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-918d6743-98e4-42a5-a45e-72f76444e39a req-c1335210-c033-47dd-847a-6a9020950251 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "427eb234-68ae-49c0-946c-4fd3eccbadef", "tag": "f5a56d42-74cb-4583-82ef-5d9683c0fd85"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:54:38.635217 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7bfa5875-bc85-4539-a00e-73469c646725 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:38.635791 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7bfa5875-bc85-4539-a00e-73469c646725 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:38.636487 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7bfa5875-bc85-4539-a00e-73469c646725 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:38.637347 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7bfa5875-bc85-4539-a00e-73469c646725 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:38.638842 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7bfa5875-bc85-4539-a00e-73469c646725 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:38.639396 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7bfa5875-bc85-4539-a00e-73469c646725 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:38.643333 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-918d6743-98e4-42a5-a45e-72f76444e39a req-c1335210-c033-47dd-847a-6a9020950251 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:38.644142 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-918d6743-98e4-42a5-a45e-72f76444e39a req-c1335210-c033-47dd-847a-6a9020950251 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:38.644846 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-918d6743-98e4-42a5-a45e-72f76444e39a req-c1335210-c033-47dd-847a-6a9020950251 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:38.657467 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-918d6743-98e4-42a5-a45e-72f76444e39a req-c1335210-c033-47dd-847a-6a9020950251 service nova] Creating event network-changed:f5a56d42-74cb-4583-82ef-5d9683c0fd85 for instance 427eb234-68ae-49c0-946c-4fd3eccbadef on n-h1-850501-14 Oct 04 19:54:38.662936 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-918d6743-98e4-42a5-a45e-72f76444e39a req-c1335210-c033-47dd-847a-6a9020950251 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036931 Oct 04 19:54:38.663843 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4041/8065] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:54:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:54:38.668736 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7bfa5875-bc85-4539-a00e-73469c646725 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 427eb234-68ae-49c0-946c-4fd3eccbadef] Going to try to terminate instance {{(pid=123002) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:54:38.965714 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7bfa5875-bc85-4539-a00e-73469c646725 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "DELETE /compute/v2.1/servers/427eb234-68ae-49c0-946c-4fd3eccbadef" status: 204 len: 0 microversion: 2.1 time: 0.342366 Oct 04 19:54:38.966677 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4025/8066] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 19:54:38 2022] DELETE /compute/v2.1/servers/427eb234-68ae-49c0-946c-4fd3eccbadef => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:54:38.977027 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0052d5e4-3b5b-4a1a-8035-a787f1f7b399 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:54:38.977754 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0052d5e4-3b5b-4a1a-8035-a787f1f7b399 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 427eb234-68ae-49c0-946c-4fd3eccbadef] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:54:38.984460 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0052d5e4-3b5b-4a1a-8035-a787f1f7b399 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:38.984879 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0052d5e4-3b5b-4a1a-8035-a787f1f7b399 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:38.985580 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0052d5e4-3b5b-4a1a-8035-a787f1f7b399 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:38.986111 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0052d5e4-3b5b-4a1a-8035-a787f1f7b399 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:38.986577 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0052d5e4-3b5b-4a1a-8035-a787f1f7b399 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:38.987014 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0052d5e4-3b5b-4a1a-8035-a787f1f7b399 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:39.134267 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0052d5e4-3b5b-4a1a-8035-a787f1f7b399 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:54:39.143946 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0052d5e4-3b5b-4a1a-8035-a787f1f7b399 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/427eb234-68ae-49c0-946c-4fd3eccbadef" status: 200 len: 1685 microversion: 2.1 time: 0.172866 Oct 04 19:54:39.144559 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4042/8067] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:54:38 2022] GET /compute/v2.1/servers/427eb234-68ae-49c0-946c-4fd3eccbadef => generated 1685 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:54:40.170014 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2671cce8-838f-4093-a36c-f593477f550d tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:54:40.170736 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2671cce8-838f-4093-a36c-f593477f550d tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 427eb234-68ae-49c0-946c-4fd3eccbadef] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:54:40.177587 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2671cce8-838f-4093-a36c-f593477f550d tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:40.178151 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2671cce8-838f-4093-a36c-f593477f550d tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:40.178611 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2671cce8-838f-4093-a36c-f593477f550d tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:40.179317 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2671cce8-838f-4093-a36c-f593477f550d tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:40.179788 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2671cce8-838f-4093-a36c-f593477f550d tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:40.180267 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2671cce8-838f-4093-a36c-f593477f550d tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:40.404506 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2671cce8-838f-4093-a36c-f593477f550d tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:54:40.412318 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2671cce8-838f-4093-a36c-f593477f550d tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/427eb234-68ae-49c0-946c-4fd3eccbadef" status: 200 len: 1685 microversion: 2.1 time: 0.246538 Oct 04 19:54:40.413131 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4026/8068] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:54:40 2022] GET /compute/v2.1/servers/427eb234-68ae-49c0-946c-4fd3eccbadef => generated 1685 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:54:41.127228 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-724ef4c8-b4b8-4554-9bb4-96e4e71ff49f req-455d2933-d8b3-4b50-99df-9f588f6a2ace service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "427eb234-68ae-49c0-946c-4fd3eccbadef", "name": "network-vif-deleted", "tag": "f5a56d42-74cb-4583-82ef-5d9683c0fd85"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:54:41.138661 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-724ef4c8-b4b8-4554-9bb4-96e4e71ff49f req-455d2933-d8b3-4b50-99df-9f588f6a2ace service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:41.139149 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-724ef4c8-b4b8-4554-9bb4-96e4e71ff49f req-455d2933-d8b3-4b50-99df-9f588f6a2ace service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:41.139741 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-724ef4c8-b4b8-4554-9bb4-96e4e71ff49f req-455d2933-d8b3-4b50-99df-9f588f6a2ace service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:41.150657 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-724ef4c8-b4b8-4554-9bb4-96e4e71ff49f req-455d2933-d8b3-4b50-99df-9f588f6a2ace service nova] Creating event network-vif-deleted:f5a56d42-74cb-4583-82ef-5d9683c0fd85 for instance 427eb234-68ae-49c0-946c-4fd3eccbadef on n-h1-850501-14 Oct 04 19:54:41.155735 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-724ef4c8-b4b8-4554-9bb4-96e4e71ff49f req-455d2933-d8b3-4b50-99df-9f588f6a2ace service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032241 Oct 04 19:54:41.156352 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4043/8069] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:54:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:54:41.436548 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-44daa53e-0c81-47f7-afc1-d60081cedc1d tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:54:41.440769 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-44daa53e-0c81-47f7-afc1-d60081cedc1d tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 427eb234-68ae-49c0-946c-4fd3eccbadef] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:54:41.444819 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-44daa53e-0c81-47f7-afc1-d60081cedc1d tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:41.445328 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-44daa53e-0c81-47f7-afc1-d60081cedc1d tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:41.445786 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-44daa53e-0c81-47f7-afc1-d60081cedc1d tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:41.446518 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-44daa53e-0c81-47f7-afc1-d60081cedc1d tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:41.446997 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-44daa53e-0c81-47f7-afc1-d60081cedc1d tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:41.447445 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-44daa53e-0c81-47f7-afc1-d60081cedc1d tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:41.484026 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-44daa53e-0c81-47f7-afc1-d60081cedc1d tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:41.484568 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-44daa53e-0c81-47f7-afc1-d60081cedc1d tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:41.485023 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-44daa53e-0c81-47f7-afc1-d60081cedc1d tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:41.485494 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-44daa53e-0c81-47f7-afc1-d60081cedc1d tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lazy-loading 'fault' on Instance uuid 427eb234-68ae-49c0-946c-4fd3eccbadef {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:54:41.539003 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-44daa53e-0c81-47f7-afc1-d60081cedc1d tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:54:41.547239 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-44daa53e-0c81-47f7-afc1-d60081cedc1d tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/427eb234-68ae-49c0-946c-4fd3eccbadef" status: 200 len: 1355 microversion: 2.1 time: 0.114615 Oct 04 19:54:41.547831 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4027/8070] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:54:41 2022] GET /compute/v2.1/servers/427eb234-68ae-49c0-946c-4fd3eccbadef => generated 1355 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:54:42.571785 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1f22689f-3324-4b34-9db2-21ed33dc45f6 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:54:42.572534 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1f22689f-3324-4b34-9db2-21ed33dc45f6 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 427eb234-68ae-49c0-946c-4fd3eccbadef] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:54:42.579579 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1f22689f-3324-4b34-9db2-21ed33dc45f6 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:42.580091 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1f22689f-3324-4b34-9db2-21ed33dc45f6 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:42.580542 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1f22689f-3324-4b34-9db2-21ed33dc45f6 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:42.581249 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1f22689f-3324-4b34-9db2-21ed33dc45f6 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:42.581715 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1f22689f-3324-4b34-9db2-21ed33dc45f6 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:42.582152 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1f22689f-3324-4b34-9db2-21ed33dc45f6 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:42.597034 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-1f22689f-3324-4b34-9db2-21ed33dc45f6 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] HTTP exception thrown: Instance 427eb234-68ae-49c0-946c-4fd3eccbadef could not be found. Oct 04 19:54:42.598715 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1f22689f-3324-4b34-9db2-21ed33dc45f6 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Request method failure captured: Oct 04 19:54:42.598715 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/427eb234-68ae-49c0-946c-4fd3eccbadef HTTP/1.1 Oct 04 19:54:42.598715 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 19:54:42.598715 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 19:54:42.598715 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 19:54:42.598715 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 19:54:42.598715 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 19:54:42.598715 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 19:54:42.598715 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 19:54:42.598715 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 19:54:42.598715 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPI88jPqPFF3foNds79FcB9aFEPQ4j2aE77udaYKTwax2C5JHCysGdgy0FMgNwDOy13EsNaR0GwTaNiwC4DOXbgoj1xNuPI5o717aLLx16xkDOI9Y9C18IHU35Ip47q038B2FBqXcNSHdcfF09wzWairlH5Vr7NhdGSOsyjDGcd-usGY Oct 04 19:54:42.598715 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 19:54:42.598715 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 19:54:42.598715 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 19:54:42.598715 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 19:54:42.598715 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 19:54:42.598715 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 19:54:42.598715 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 7112e2b246a44297876ee6d279e8f655 Oct 04 19:54:42.598715 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1045305417 Oct 04 19:54:42.598715 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 19:54:42.598715 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 19:54:42.598715 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7112e2b246a44297876ee6d279e8f655"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7112e2b246a44297876ee6d279e8f655", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7112e2b246a44297876ee6d279e8f655"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7112e2b246a44297876ee6d279e8f655"}]}] Oct 04 19:54:42.598715 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1045305417 Oct 04 19:54:42.598715 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 7112e2b246a44297876ee6d279e8f655 Oct 04 19:54:42.598715 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1045305417 Oct 04 19:54:42.598715 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-TestNetworkAdvancedServerOps-1045305417-project Oct 04 19:54:42.598715 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 19:54:42.598715 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 19:54:42.598715 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: deb5459af175415da4825e6078eba908 Oct 04 19:54:42.598715 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1045305417-project Oct 04 19:54:42.598715 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 19:54:42.598715 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 427eb234-68ae-49c0-946c-4fd3eccbadef could not be found. Oct 04 19:54:42.598715 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '427eb234-68ae-49c0-946c-4fd3eccbadef'} Oct 04 19:54:42.598715 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:54:42.598715 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:54:42.598715 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:54:42.598715 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:54:42.598715 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:54:42.598715 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:54:42.598715 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:54:42.598715 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:54:42.598715 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:54:42.598715 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:54:42.598715 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 427eb234-68ae-49c0-946c-4fd3eccbadef could not be found. Oct 04 19:54:42.598715 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:54:42.598715 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:54:42.598715 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:54:42.598715 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:54:42.598715 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:54:42.598715 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:54:42.598715 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:54:42.598715 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:54:42.598715 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:54:42.598715 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:54:42.598715 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:54:42.598715 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:54:42.598715 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:54:42.598715 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:54:42.598715 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:54:42.598715 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:54:42.598715 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 427eb234-68ae-49c0-946c-4fd3eccbadef could not be found. Oct 04 19:54:42.598715 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:54:42.598715 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:54:42.605576 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:54:42.605576 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:54:42.605576 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:54:42.605576 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:54:42.605576 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:54:42.605576 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:54:42.605576 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 427eb234-68ae-49c0-946c-4fd3eccbadef could not be found. Oct 04 19:54:42.605576 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:54:42.605576 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1f22689f-3324-4b34-9db2-21ed33dc45f6 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Returning 404 to user: Instance 427eb234-68ae-49c0-946c-4fd3eccbadef could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:54:42.605576 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1f22689f-3324-4b34-9db2-21ed33dc45f6 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/427eb234-68ae-49c0-946c-4fd3eccbadef" status: 404 len: 111 microversion: 2.1 time: 0.033756 Oct 04 19:54:42.605576 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4044/8071] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:54:42 2022] GET /compute/v2.1/servers/427eb234-68ae-49c0-946c-4fd3eccbadef => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:54:46.107629 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d3552b9b-5806-47a5-8d5b-05e1d8ddfaf4 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '.version_select at 0x7fe2596ebee0>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:54:46.171977 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d3552b9b-5806-47a5-8d5b-05e1d8ddfaf4 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1361756875" status: 202 len: 0 microversion: 2.1 time: 0.068310 Oct 04 19:54:46.172653 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4028/8072] 10.222.0.20 () {58 vars in 1284 bytes} [Tue Oct 4 19:54:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1361756875 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 19:54:46.202177 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5ad1cace-ca80-4c1a-abc5-5b43d84f3eb7 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Action: 'create', calling method: .version_select at 0x7fe253bc0dc0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2055886335", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLR4YXAzzsJqikNCBqWCl7cZSc7c3u2goWuyX5zerC+2byfsk91I8cQLxI7GxtEndzi/mCKFSoebovrqBK8A93dq6NRK6PmBm+dA1GUSSX3QJVXV3cnC9ScRhbokvn4VhQ=="}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:54:46.208715 n-d-850501-14 devstack@n-api.service[123001]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:54:46.209393 n-d-850501-14 devstack@n-api.service[123001]: Tue Oct 4 19:54:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.20) !!! Oct 04 19:54:46.222999 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-5ad1cace-ca80-4c1a-abc5-5b43d84f3eb7 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Getting quotas for project 7112e2b246a44297876ee6d279e8f655. Resources: {'key_pairs'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:54:46.229245 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-5ad1cace-ca80-4c1a-abc5-5b43d84f3eb7 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Getting quotas for user deb5459af175415da4825e6078eba908 and project 7112e2b246a44297876ee6d279e8f655. Resources: {'key_pairs'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:54:46.314792 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5ad1cace-ca80-4c1a-abc5-5b43d84f3eb7 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.116357 Oct 04 19:54:46.315343 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4045/8073] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Oct 4 19:54:46 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:54:54.805224 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-bb636171-d83b-4aa8-8664-9e5dc6a70d43 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-410195952", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": [{"uuid": "0cbe1f0b-5559-4e8e-90e5-2dc3919e18ee"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2055886335", "security_groups": [{"name": "tempest-secgroup-smoke-1851089589"}]}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:54:54.835652 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:54:54.962445 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-bb636171-d83b-4aa8-8664-9e5dc6a70d43 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] validate_networks() for [('0cbe1f0b-5559-4e8e-90e5-2dc3919e18ee', None, None, None, None, None)] {{(pid=123002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:54:55.767488 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-bb636171-d83b-4aa8-8664-9e5dc6a70d43 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:54:55.769818 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-bb636171-d83b-4aa8-8664-9e5dc6a70d43 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:54:55.769818 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-bb636171-d83b-4aa8-8664-9e5dc6a70d43 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:54:55.769818 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-bb636171-d83b-4aa8-8664-9e5dc6a70d43 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:54:55.769818 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-bb636171-d83b-4aa8-8664-9e5dc6a70d43 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:54:55.780502 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bb636171-d83b-4aa8-8664-9e5dc6a70d43 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:55.781008 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bb636171-d83b-4aa8-8664-9e5dc6a70d43 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:55.787182 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bb636171-d83b-4aa8-8664-9e5dc6a70d43 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:55.787182 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bb636171-d83b-4aa8-8664-9e5dc6a70d43 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:55.787182 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bb636171-d83b-4aa8-8664-9e5dc6a70d43 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:55.787182 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bb636171-d83b-4aa8-8664-9e5dc6a70d43 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:55.802345 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-bb636171-d83b-4aa8-8664-9e5dc6a70d43 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Getting quotas for project 7112e2b246a44297876ee6d279e8f655. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:54:55.809214 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-bb636171-d83b-4aa8-8664-9e5dc6a70d43 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Getting quotas for user deb5459af175415da4825e6078eba908 and project 7112e2b246a44297876ee6d279e8f655. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:54:55.823119 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-bb636171-d83b-4aa8-8664-9e5dc6a70d43 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Going to run 1 instances... {{(pid=123002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:54:55.825559 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-bb636171-d83b-4aa8-8664-9e5dc6a70d43 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 6493f5b0-e58d-490d-a641-b7adc2ddb9d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:54:55.992977 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-bb636171-d83b-4aa8-8664-9e5dc6a70d43 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.192221 Oct 04 19:54:55.999210 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4029/8074] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 19:54:54 2022] POST /compute/v2.1/servers => generated 406 bytes in 1194 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:54:56.006590 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7688bc66-69a1-4ebd-a860-6ed8a3244f58 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:54:56.007259 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7688bc66-69a1-4ebd-a860-6ed8a3244f58 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 6493f5b0-e58d-490d-a641-b7adc2ddb9d0] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:54:56.011786 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=36 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:54:56.016103 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:54:56.074365 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7688bc66-69a1-4ebd-a860-6ed8a3244f58 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:54:56.081415 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7688bc66-69a1-4ebd-a860-6ed8a3244f58 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/6493f5b0-e58d-490d-a641-b7adc2ddb9d0" status: 200 len: 1266 microversion: 2.1 time: 0.080062 Oct 04 19:54:56.082349 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4046/8075] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:54:56 2022] GET /compute/v2.1/servers/6493f5b0-e58d-490d-a641-b7adc2ddb9d0 => generated 1266 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:54:57.106683 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2bc04625-467a-4d10-8928-44eb1d10556c tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:54:57.107309 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2bc04625-467a-4d10-8928-44eb1d10556c tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 6493f5b0-e58d-490d-a641-b7adc2ddb9d0] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:54:57.116398 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2bc04625-467a-4d10-8928-44eb1d10556c tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:57.117196 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2bc04625-467a-4d10-8928-44eb1d10556c tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:57.117645 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2bc04625-467a-4d10-8928-44eb1d10556c tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:57.118360 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2bc04625-467a-4d10-8928-44eb1d10556c tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:57.119423 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2bc04625-467a-4d10-8928-44eb1d10556c tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:57.119875 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2bc04625-467a-4d10-8928-44eb1d10556c tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:57.200820 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2bc04625-467a-4d10-8928-44eb1d10556c tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:54:57.210943 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2bc04625-467a-4d10-8928-44eb1d10556c tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/6493f5b0-e58d-490d-a641-b7adc2ddb9d0" status: 200 len: 1270 microversion: 2.1 time: 0.108925 Oct 04 19:54:57.212001 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4030/8076] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:54:57 2022] GET /compute/v2.1/servers/6493f5b0-e58d-490d-a641-b7adc2ddb9d0 => generated 1270 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:54:58.235029 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e8cd0f63-ba4f-4d5c-b8bd-c1661e599344 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:54:58.235712 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e8cd0f63-ba4f-4d5c-b8bd-c1661e599344 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 6493f5b0-e58d-490d-a641-b7adc2ddb9d0] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:54:58.248554 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e8cd0f63-ba4f-4d5c-b8bd-c1661e599344 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:58.249047 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e8cd0f63-ba4f-4d5c-b8bd-c1661e599344 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:58.249485 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e8cd0f63-ba4f-4d5c-b8bd-c1661e599344 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:58.250989 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e8cd0f63-ba4f-4d5c-b8bd-c1661e599344 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:58.251821 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e8cd0f63-ba4f-4d5c-b8bd-c1661e599344 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:58.252286 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e8cd0f63-ba4f-4d5c-b8bd-c1661e599344 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:58.332854 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e8cd0f63-ba4f-4d5c-b8bd-c1661e599344 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:54:58.344388 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e8cd0f63-ba4f-4d5c-b8bd-c1661e599344 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/6493f5b0-e58d-490d-a641-b7adc2ddb9d0" status: 200 len: 1336 microversion: 2.1 time: 0.113385 Oct 04 19:54:58.359159 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4047/8077] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:54:58 2022] GET /compute/v2.1/servers/6493f5b0-e58d-490d-a641-b7adc2ddb9d0 => generated 1336 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:54:59.373776 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6bb6248c-5dd3-4c64-a73b-aaca02d61bdf tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:54:59.374415 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-6bb6248c-5dd3-4c64-a73b-aaca02d61bdf tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 6493f5b0-e58d-490d-a641-b7adc2ddb9d0] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:54:59.383684 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6bb6248c-5dd3-4c64-a73b-aaca02d61bdf tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:59.384542 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6bb6248c-5dd3-4c64-a73b-aaca02d61bdf tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:59.385299 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6bb6248c-5dd3-4c64-a73b-aaca02d61bdf tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:59.386515 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6bb6248c-5dd3-4c64-a73b-aaca02d61bdf tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:59.387338 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6bb6248c-5dd3-4c64-a73b-aaca02d61bdf tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:59.388121 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6bb6248c-5dd3-4c64-a73b-aaca02d61bdf tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:59.562863 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-6bb6248c-5dd3-4c64-a73b-aaca02d61bdf tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:54:59.571517 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6bb6248c-5dd3-4c64-a73b-aaca02d61bdf tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/6493f5b0-e58d-490d-a641-b7adc2ddb9d0" status: 200 len: 1392 microversion: 2.1 time: 0.201895 Oct 04 19:54:59.572131 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4031/8078] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:54:59 2022] GET /compute/v2.1/servers/6493f5b0-e58d-490d-a641-b7adc2ddb9d0 => generated 1392 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:55:00.015107 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-6994835b-a91c-467b-8da3-5b796eb38ab4 req-983be62e-bab2-47d7-a6ed-9a13fc4035a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6493f5b0-e58d-490d-a641-b7adc2ddb9d0", "tag": "6e6ef792-15cf-4273-9782-4bd65ef92424"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:55:00.026161 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-6994835b-a91c-467b-8da3-5b796eb38ab4 req-983be62e-bab2-47d7-a6ed-9a13fc4035a4 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:00.026639 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-6994835b-a91c-467b-8da3-5b796eb38ab4 req-983be62e-bab2-47d7-a6ed-9a13fc4035a4 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:00.027065 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-6994835b-a91c-467b-8da3-5b796eb38ab4 req-983be62e-bab2-47d7-a6ed-9a13fc4035a4 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:00.039456 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-6994835b-a91c-467b-8da3-5b796eb38ab4 req-983be62e-bab2-47d7-a6ed-9a13fc4035a4 service nova] Creating event network-changed:6e6ef792-15cf-4273-9782-4bd65ef92424 for instance 6493f5b0-e58d-490d-a641-b7adc2ddb9d0 on n-h1-850501-14 Oct 04 19:55:00.044625 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-6994835b-a91c-467b-8da3-5b796eb38ab4 req-983be62e-bab2-47d7-a6ed-9a13fc4035a4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033140 Oct 04 19:55:00.045260 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4048/8079] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:55:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:55:00.605043 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-65c558f8-f112-4878-9606-9598e8d33f78 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:55:00.605678 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-65c558f8-f112-4878-9606-9598e8d33f78 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 6493f5b0-e58d-490d-a641-b7adc2ddb9d0] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:55:00.612651 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-65c558f8-f112-4878-9606-9598e8d33f78 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:00.613149 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-65c558f8-f112-4878-9606-9598e8d33f78 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:00.613603 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-65c558f8-f112-4878-9606-9598e8d33f78 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:00.614319 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-65c558f8-f112-4878-9606-9598e8d33f78 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:00.614976 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-65c558f8-f112-4878-9606-9598e8d33f78 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:00.615439 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-65c558f8-f112-4878-9606-9598e8d33f78 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:00.755213 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-65c558f8-f112-4878-9606-9598e8d33f78 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:55:00.763625 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-65c558f8-f112-4878-9606-9598e8d33f78 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/6493f5b0-e58d-490d-a641-b7adc2ddb9d0" status: 200 len: 1392 microversion: 2.1 time: 0.162557 Oct 04 19:55:00.764234 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4032/8080] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:55:00 2022] GET /compute/v2.1/servers/6493f5b0-e58d-490d-a641-b7adc2ddb9d0 => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:55:01.787943 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8994b2c5-b92f-4cab-8968-0790dad660d2 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:55:01.788690 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8994b2c5-b92f-4cab-8968-0790dad660d2 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 6493f5b0-e58d-490d-a641-b7adc2ddb9d0] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:55:01.795856 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8994b2c5-b92f-4cab-8968-0790dad660d2 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:01.796415 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8994b2c5-b92f-4cab-8968-0790dad660d2 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:01.796860 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8994b2c5-b92f-4cab-8968-0790dad660d2 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:01.797559 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8994b2c5-b92f-4cab-8968-0790dad660d2 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:01.798030 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8994b2c5-b92f-4cab-8968-0790dad660d2 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:01.798464 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8994b2c5-b92f-4cab-8968-0790dad660d2 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:01.932135 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8994b2c5-b92f-4cab-8968-0790dad660d2 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:55:01.940033 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8994b2c5-b92f-4cab-8968-0790dad660d2 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/6493f5b0-e58d-490d-a641-b7adc2ddb9d0" status: 200 len: 1392 microversion: 2.1 time: 0.157035 Oct 04 19:55:01.940613 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4049/8081] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:55:01 2022] GET /compute/v2.1/servers/6493f5b0-e58d-490d-a641-b7adc2ddb9d0 => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:55:02.962904 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a0fdd460-405a-4a92-9727-d3efbc854205 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:55:02.963623 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a0fdd460-405a-4a92-9727-d3efbc854205 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 6493f5b0-e58d-490d-a641-b7adc2ddb9d0] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:55:02.966193 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:55:02.971049 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a0fdd460-405a-4a92-9727-d3efbc854205 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:02.971494 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a0fdd460-405a-4a92-9727-d3efbc854205 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:02.971948 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a0fdd460-405a-4a92-9727-d3efbc854205 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:02.972718 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a0fdd460-405a-4a92-9727-d3efbc854205 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:02.973202 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a0fdd460-405a-4a92-9727-d3efbc854205 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:02.973651 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a0fdd460-405a-4a92-9727-d3efbc854205 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:03.106590 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a0fdd460-405a-4a92-9727-d3efbc854205 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:55:03.117698 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a0fdd460-405a-4a92-9727-d3efbc854205 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/6493f5b0-e58d-490d-a641-b7adc2ddb9d0" status: 200 len: 1392 microversion: 2.1 time: 0.158702 Oct 04 19:55:03.118286 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4033/8082] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:55:02 2022] GET /compute/v2.1/servers/6493f5b0-e58d-490d-a641-b7adc2ddb9d0 => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:55:04.146945 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4ae00b61-4ac1-44b4-acac-7df7efc7edf6 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:55:04.147577 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-4ae00b61-4ac1-44b4-acac-7df7efc7edf6 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 6493f5b0-e58d-490d-a641-b7adc2ddb9d0] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:55:04.154442 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4ae00b61-4ac1-44b4-acac-7df7efc7edf6 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:04.154928 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4ae00b61-4ac1-44b4-acac-7df7efc7edf6 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:04.155368 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4ae00b61-4ac1-44b4-acac-7df7efc7edf6 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:04.156079 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4ae00b61-4ac1-44b4-acac-7df7efc7edf6 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:04.156537 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4ae00b61-4ac1-44b4-acac-7df7efc7edf6 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:04.156963 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4ae00b61-4ac1-44b4-acac-7df7efc7edf6 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:04.297595 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-4ae00b61-4ac1-44b4-acac-7df7efc7edf6 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:55:04.306337 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-4ae00b61-4ac1-44b4-acac-7df7efc7edf6 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/6493f5b0-e58d-490d-a641-b7adc2ddb9d0" status: 200 len: 1392 microversion: 2.1 time: 0.164317 Oct 04 19:55:04.307056 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4050/8083] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:55:04 2022] GET /compute/v2.1/servers/6493f5b0-e58d-490d-a641-b7adc2ddb9d0 => generated 1392 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:55:05.330648 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5f00632f-b0cc-4782-83c8-d9bf389d9270 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:55:05.331177 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5f00632f-b0cc-4782-83c8-d9bf389d9270 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 6493f5b0-e58d-490d-a641-b7adc2ddb9d0] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:55:05.338563 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5f00632f-b0cc-4782-83c8-d9bf389d9270 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:05.339059 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5f00632f-b0cc-4782-83c8-d9bf389d9270 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:05.339506 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5f00632f-b0cc-4782-83c8-d9bf389d9270 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:05.340240 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5f00632f-b0cc-4782-83c8-d9bf389d9270 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:05.340710 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5f00632f-b0cc-4782-83c8-d9bf389d9270 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:05.341149 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5f00632f-b0cc-4782-83c8-d9bf389d9270 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:05.472427 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5f00632f-b0cc-4782-83c8-d9bf389d9270 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:55:05.481393 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5f00632f-b0cc-4782-83c8-d9bf389d9270 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/6493f5b0-e58d-490d-a641-b7adc2ddb9d0" status: 200 len: 1392 microversion: 2.1 time: 0.154795 Oct 04 19:55:05.481977 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4034/8084] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:55:05 2022] GET /compute/v2.1/servers/6493f5b0-e58d-490d-a641-b7adc2ddb9d0 => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:55:06.506737 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-683746d1-d374-423f-a116-9a1f0099510f tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:55:06.507366 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-683746d1-d374-423f-a116-9a1f0099510f tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 6493f5b0-e58d-490d-a641-b7adc2ddb9d0] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:55:06.510336 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=6 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:55:06.515287 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-683746d1-d374-423f-a116-9a1f0099510f tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:06.515720 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-683746d1-d374-423f-a116-9a1f0099510f tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:06.516194 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-683746d1-d374-423f-a116-9a1f0099510f tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:06.516906 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-683746d1-d374-423f-a116-9a1f0099510f tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:06.517373 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-683746d1-d374-423f-a116-9a1f0099510f tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:06.517804 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-683746d1-d374-423f-a116-9a1f0099510f tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:06.534967 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-0663235e-1fbc-47a9-98bd-3c893d454c8e req-cf924d00-db7d-49fa-b00e-b4619f99f396 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6493f5b0-e58d-490d-a641-b7adc2ddb9d0", "name": "network-vif-plugged", "status": "completed", "tag": "6e6ef792-15cf-4273-9782-4bd65ef92424"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:55:06.541758 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:55:06.542541 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=6 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:55:06.549607 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-0663235e-1fbc-47a9-98bd-3c893d454c8e req-cf924d00-db7d-49fa-b00e-b4619f99f396 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:06.555418 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-0663235e-1fbc-47a9-98bd-3c893d454c8e req-cf924d00-db7d-49fa-b00e-b4619f99f396 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:06.555418 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-0663235e-1fbc-47a9-98bd-3c893d454c8e req-cf924d00-db7d-49fa-b00e-b4619f99f396 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:06.564108 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-0663235e-1fbc-47a9-98bd-3c893d454c8e req-cf924d00-db7d-49fa-b00e-b4619f99f396 service nova] Creating event network-vif-plugged:6e6ef792-15cf-4273-9782-4bd65ef92424 for instance 6493f5b0-e58d-490d-a641-b7adc2ddb9d0 on n-h1-850501-14 Oct 04 19:55:06.570234 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-0663235e-1fbc-47a9-98bd-3c893d454c8e req-cf924d00-db7d-49fa-b00e-b4619f99f396 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039210 Oct 04 19:55:06.570852 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4035/8085] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:55:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:55:06.671332 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-683746d1-d374-423f-a116-9a1f0099510f tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:55:06.680799 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-683746d1-d374-423f-a116-9a1f0099510f tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/6493f5b0-e58d-490d-a641-b7adc2ddb9d0" status: 200 len: 1392 microversion: 2.1 time: 0.178955 Oct 04 19:55:06.682042 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4051/8086] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:55:06 2022] GET /compute/v2.1/servers/6493f5b0-e58d-490d-a641-b7adc2ddb9d0 => generated 1392 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:55:07.706817 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ecc0cfc9-d3a5-40cb-b74f-1a93dace519a tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:55:07.707587 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ecc0cfc9-d3a5-40cb-b74f-1a93dace519a tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 6493f5b0-e58d-490d-a641-b7adc2ddb9d0] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:55:07.715808 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ecc0cfc9-d3a5-40cb-b74f-1a93dace519a tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:07.716365 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ecc0cfc9-d3a5-40cb-b74f-1a93dace519a tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:07.717463 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ecc0cfc9-d3a5-40cb-b74f-1a93dace519a tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:07.718179 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ecc0cfc9-d3a5-40cb-b74f-1a93dace519a tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:07.718648 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ecc0cfc9-d3a5-40cb-b74f-1a93dace519a tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:07.719088 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ecc0cfc9-d3a5-40cb-b74f-1a93dace519a tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:07.890081 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ecc0cfc9-d3a5-40cb-b74f-1a93dace519a tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:55:07.890081 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ecc0cfc9-d3a5-40cb-b74f-1a93dace519a tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/6493f5b0-e58d-490d-a641-b7adc2ddb9d0" status: 200 len: 1392 microversion: 2.1 time: 0.168771 Oct 04 19:55:07.890081 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4036/8087] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:55:07 2022] GET /compute/v2.1/servers/6493f5b0-e58d-490d-a641-b7adc2ddb9d0 => generated 1392 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:55:08.892876 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-406e42f5-dd99-4149-bd10-8ff284cca479 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:55:08.893650 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-406e42f5-dd99-4149-bd10-8ff284cca479 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 6493f5b0-e58d-490d-a641-b7adc2ddb9d0] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:55:08.900851 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-406e42f5-dd99-4149-bd10-8ff284cca479 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:08.901337 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-406e42f5-dd99-4149-bd10-8ff284cca479 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:08.901772 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-406e42f5-dd99-4149-bd10-8ff284cca479 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:08.902462 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-406e42f5-dd99-4149-bd10-8ff284cca479 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:08.902917 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-406e42f5-dd99-4149-bd10-8ff284cca479 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:08.903341 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-406e42f5-dd99-4149-bd10-8ff284cca479 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:09.037053 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-406e42f5-dd99-4149-bd10-8ff284cca479 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:55:09.044858 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-406e42f5-dd99-4149-bd10-8ff284cca479 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/6493f5b0-e58d-490d-a641-b7adc2ddb9d0" status: 200 len: 1565 microversion: 2.1 time: 0.156160 Oct 04 19:55:09.045427 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4052/8088] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:55:08 2022] GET /compute/v2.1/servers/6493f5b0-e58d-490d-a641-b7adc2ddb9d0 => generated 1565 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:55:09.068698 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f22dbd93-762e-438b-adda-22d2afd444b8 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:55:09.069348 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f22dbd93-762e-438b-adda-22d2afd444b8 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 6493f5b0-e58d-490d-a641-b7adc2ddb9d0] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:55:09.076227 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f22dbd93-762e-438b-adda-22d2afd444b8 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:09.076734 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f22dbd93-762e-438b-adda-22d2afd444b8 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:09.077193 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f22dbd93-762e-438b-adda-22d2afd444b8 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:09.077912 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f22dbd93-762e-438b-adda-22d2afd444b8 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:09.078395 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f22dbd93-762e-438b-adda-22d2afd444b8 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:09.078840 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f22dbd93-762e-438b-adda-22d2afd444b8 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:09.213394 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f22dbd93-762e-438b-adda-22d2afd444b8 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:55:09.221221 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f22dbd93-762e-438b-adda-22d2afd444b8 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/6493f5b0-e58d-490d-a641-b7adc2ddb9d0" status: 200 len: 1565 microversion: 2.1 time: 0.157104 Oct 04 19:55:09.221823 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4037/8089] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:55:09 2022] GET /compute/v2.1/servers/6493f5b0-e58d-490d-a641-b7adc2ddb9d0 => generated 1565 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:55:11.567449 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-8cde5a53-1e2a-4b02-81c3-6181758d3dca req-66fa8ab8-3c03-4527-8eee-7dfdcef6efee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6493f5b0-e58d-490d-a641-b7adc2ddb9d0", "tag": "6e6ef792-15cf-4273-9782-4bd65ef92424"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:55:11.573956 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-66525495-5a4d-4968-9e2f-ed78ccd59451 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:55:11.574582 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-66525495-5a4d-4968-9e2f-ed78ccd59451 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 6493f5b0-e58d-490d-a641-b7adc2ddb9d0] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:55:11.581912 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-66525495-5a4d-4968-9e2f-ed78ccd59451 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:11.582419 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-66525495-5a4d-4968-9e2f-ed78ccd59451 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:11.582921 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-66525495-5a4d-4968-9e2f-ed78ccd59451 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:11.584145 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-66525495-5a4d-4968-9e2f-ed78ccd59451 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:11.584579 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-66525495-5a4d-4968-9e2f-ed78ccd59451 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:11.585014 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-66525495-5a4d-4968-9e2f-ed78ccd59451 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:11.585742 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-8cde5a53-1e2a-4b02-81c3-6181758d3dca req-66fa8ab8-3c03-4527-8eee-7dfdcef6efee service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:11.586254 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-8cde5a53-1e2a-4b02-81c3-6181758d3dca req-66fa8ab8-3c03-4527-8eee-7dfdcef6efee service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:11.586739 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-8cde5a53-1e2a-4b02-81c3-6181758d3dca req-66fa8ab8-3c03-4527-8eee-7dfdcef6efee service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:11.599826 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-8cde5a53-1e2a-4b02-81c3-6181758d3dca req-66fa8ab8-3c03-4527-8eee-7dfdcef6efee service nova] Creating event network-changed:6e6ef792-15cf-4273-9782-4bd65ef92424 for instance 6493f5b0-e58d-490d-a641-b7adc2ddb9d0 on n-h1-850501-14 Oct 04 19:55:11.605913 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-8cde5a53-1e2a-4b02-81c3-6181758d3dca req-66fa8ab8-3c03-4527-8eee-7dfdcef6efee service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042476 Oct 04 19:55:11.607063 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4038/8090] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:55:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:55:11.759733 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-66525495-5a4d-4968-9e2f-ed78ccd59451 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:55:11.759733 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-66525495-5a4d-4968-9e2f-ed78ccd59451 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/6493f5b0-e58d-490d-a641-b7adc2ddb9d0" status: 200 len: 1565 microversion: 2.1 time: 0.186913 Oct 04 19:55:11.759733 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4053/8091] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:55:11 2022] GET /compute/v2.1/servers/6493f5b0-e58d-490d-a641-b7adc2ddb9d0 => generated 1565 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:55:32.996775 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=11 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:55:32.997548 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=48 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:55:33.001705 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0d43a75e-fc52-491c-a7a0-dd2f876bd9ba tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:55:33.008963 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0d43a75e-fc52-491c-a7a0-dd2f876bd9ba tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 6493f5b0-e58d-490d-a641-b7adc2ddb9d0] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:55:33.011271 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0d43a75e-fc52-491c-a7a0-dd2f876bd9ba tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:33.011775 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0d43a75e-fc52-491c-a7a0-dd2f876bd9ba tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:33.012265 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0d43a75e-fc52-491c-a7a0-dd2f876bd9ba tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:33.013027 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0d43a75e-fc52-491c-a7a0-dd2f876bd9ba tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:33.013498 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0d43a75e-fc52-491c-a7a0-dd2f876bd9ba tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:33.013940 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0d43a75e-fc52-491c-a7a0-dd2f876bd9ba tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:33.068337 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0d43a75e-fc52-491c-a7a0-dd2f876bd9ba tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "POST /compute/v2.1/servers/6493f5b0-e58d-490d-a641-b7adc2ddb9d0/action" status: 200 len: 24569 microversion: 2.1 time: 0.073364 Oct 04 19:55:33.069279 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4039/8092] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 19:55:32 2022] POST /compute/v2.1/servers/6493f5b0-e58d-490d-a641-b7adc2ddb9d0/action => generated 24569 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:55:39.469345 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-43f4c2f3-2a0d-4958-bcd7-f60e9160c7e4 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:55:39.471562 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-43f4c2f3-2a0d-4958-bcd7-f60e9160c7e4 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 6493f5b0-e58d-490d-a641-b7adc2ddb9d0] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:55:39.473918 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=17 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:55:39.474580 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=38 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:55:39.479596 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-43f4c2f3-2a0d-4958-bcd7-f60e9160c7e4 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:39.485316 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-43f4c2f3-2a0d-4958-bcd7-f60e9160c7e4 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:39.485316 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-43f4c2f3-2a0d-4958-bcd7-f60e9160c7e4 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:39.485316 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-43f4c2f3-2a0d-4958-bcd7-f60e9160c7e4 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:39.485316 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-43f4c2f3-2a0d-4958-bcd7-f60e9160c7e4 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:39.485316 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-43f4c2f3-2a0d-4958-bcd7-f60e9160c7e4 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:39.669968 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-43f4c2f3-2a0d-4958-bcd7-f60e9160c7e4 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "POST /compute/v2.1/servers/6493f5b0-e58d-490d-a641-b7adc2ddb9d0/action" status: 202 len: 0 microversion: 2.1 time: 0.204356 Oct 04 19:55:39.670646 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4054/8093] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 19:55:39 2022] POST /compute/v2.1/servers/6493f5b0-e58d-490d-a641-b7adc2ddb9d0/action => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:55:39.679974 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9382659e-9d58-46ff-9a8c-f26d2e316941 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:55:39.680788 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9382659e-9d58-46ff-9a8c-f26d2e316941 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 6493f5b0-e58d-490d-a641-b7adc2ddb9d0] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:55:39.688522 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9382659e-9d58-46ff-9a8c-f26d2e316941 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:39.689023 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9382659e-9d58-46ff-9a8c-f26d2e316941 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:39.689481 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9382659e-9d58-46ff-9a8c-f26d2e316941 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:39.690202 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9382659e-9d58-46ff-9a8c-f26d2e316941 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:39.690679 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9382659e-9d58-46ff-9a8c-f26d2e316941 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:39.691126 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9382659e-9d58-46ff-9a8c-f26d2e316941 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:39.829991 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9382659e-9d58-46ff-9a8c-f26d2e316941 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:55:39.838069 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9382659e-9d58-46ff-9a8c-f26d2e316941 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/6493f5b0-e58d-490d-a641-b7adc2ddb9d0" status: 200 len: 1675 microversion: 2.1 time: 0.162961 Oct 04 19:55:39.838647 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4040/8094] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:55:39 2022] GET /compute/v2.1/servers/6493f5b0-e58d-490d-a641-b7adc2ddb9d0 => generated 1675 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:55:40.869591 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c36d804e-8821-4156-a3f1-1eeac91057ab tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:55:40.870285 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c36d804e-8821-4156-a3f1-1eeac91057ab tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 6493f5b0-e58d-490d-a641-b7adc2ddb9d0] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:55:40.876628 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c36d804e-8821-4156-a3f1-1eeac91057ab tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:40.877113 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c36d804e-8821-4156-a3f1-1eeac91057ab tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:40.877546 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c36d804e-8821-4156-a3f1-1eeac91057ab tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:40.878229 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c36d804e-8821-4156-a3f1-1eeac91057ab tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:40.878675 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c36d804e-8821-4156-a3f1-1eeac91057ab tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:40.879091 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c36d804e-8821-4156-a3f1-1eeac91057ab tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:41.015848 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c36d804e-8821-4156-a3f1-1eeac91057ab tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:55:41.024196 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c36d804e-8821-4156-a3f1-1eeac91057ab tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/6493f5b0-e58d-490d-a641-b7adc2ddb9d0" status: 200 len: 1680 microversion: 2.1 time: 0.160399 Oct 04 19:55:41.024770 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4055/8095] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:55:40 2022] GET /compute/v2.1/servers/6493f5b0-e58d-490d-a641-b7adc2ddb9d0 => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:55:42.047165 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a60309c3-560c-427b-8805-40da1cffedf5 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:55:42.047714 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a60309c3-560c-427b-8805-40da1cffedf5 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 6493f5b0-e58d-490d-a641-b7adc2ddb9d0] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:55:42.055948 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a60309c3-560c-427b-8805-40da1cffedf5 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:42.057948 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a60309c3-560c-427b-8805-40da1cffedf5 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:42.057948 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a60309c3-560c-427b-8805-40da1cffedf5 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:42.057948 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a60309c3-560c-427b-8805-40da1cffedf5 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:42.058376 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a60309c3-560c-427b-8805-40da1cffedf5 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:42.058592 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a60309c3-560c-427b-8805-40da1cffedf5 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:42.189250 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a60309c3-560c-427b-8805-40da1cffedf5 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:55:42.197212 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a60309c3-560c-427b-8805-40da1cffedf5 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/6493f5b0-e58d-490d-a641-b7adc2ddb9d0" status: 200 len: 1680 microversion: 2.1 time: 0.154135 Oct 04 19:55:42.197780 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4041/8096] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:55:42 2022] GET /compute/v2.1/servers/6493f5b0-e58d-490d-a641-b7adc2ddb9d0 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:55:43.220077 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-fc1bc780-dc48-4ebd-91de-7681c01e46de tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:55:43.220700 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-fc1bc780-dc48-4ebd-91de-7681c01e46de tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 6493f5b0-e58d-490d-a641-b7adc2ddb9d0] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:55:43.227801 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fc1bc780-dc48-4ebd-91de-7681c01e46de tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:43.228309 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fc1bc780-dc48-4ebd-91de-7681c01e46de tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:43.228753 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fc1bc780-dc48-4ebd-91de-7681c01e46de tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:43.229446 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fc1bc780-dc48-4ebd-91de-7681c01e46de tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:43.229907 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fc1bc780-dc48-4ebd-91de-7681c01e46de tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:43.230341 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fc1bc780-dc48-4ebd-91de-7681c01e46de tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:43.364312 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-fc1bc780-dc48-4ebd-91de-7681c01e46de tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:55:43.372568 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-fc1bc780-dc48-4ebd-91de-7681c01e46de tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/6493f5b0-e58d-490d-a641-b7adc2ddb9d0" status: 200 len: 1680 microversion: 2.1 time: 0.156550 Oct 04 19:55:43.373139 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4056/8097] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:55:43 2022] GET /compute/v2.1/servers/6493f5b0-e58d-490d-a641-b7adc2ddb9d0 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:55:44.397177 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-57157693-0e7e-414c-9a19-031e796e2fad tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:55:44.398162 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-57157693-0e7e-414c-9a19-031e796e2fad tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 6493f5b0-e58d-490d-a641-b7adc2ddb9d0] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:55:44.405905 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-57157693-0e7e-414c-9a19-031e796e2fad tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:44.406402 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-57157693-0e7e-414c-9a19-031e796e2fad tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:44.406902 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-57157693-0e7e-414c-9a19-031e796e2fad tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:44.407595 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-57157693-0e7e-414c-9a19-031e796e2fad tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:44.408083 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-57157693-0e7e-414c-9a19-031e796e2fad tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:44.408522 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-57157693-0e7e-414c-9a19-031e796e2fad tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:44.538590 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-57157693-0e7e-414c-9a19-031e796e2fad tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:55:44.546435 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-57157693-0e7e-414c-9a19-031e796e2fad tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/6493f5b0-e58d-490d-a641-b7adc2ddb9d0" status: 200 len: 1680 microversion: 2.1 time: 0.153831 Oct 04 19:55:44.546936 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4042/8098] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:55:44 2022] GET /compute/v2.1/servers/6493f5b0-e58d-490d-a641-b7adc2ddb9d0 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:55:45.570171 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8cd8f166-3a75-460b-a717-3de6869aa430 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:55:45.570816 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8cd8f166-3a75-460b-a717-3de6869aa430 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 6493f5b0-e58d-490d-a641-b7adc2ddb9d0] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:55:45.577064 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8cd8f166-3a75-460b-a717-3de6869aa430 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:45.577553 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8cd8f166-3a75-460b-a717-3de6869aa430 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:45.577989 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8cd8f166-3a75-460b-a717-3de6869aa430 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:45.578677 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8cd8f166-3a75-460b-a717-3de6869aa430 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:45.579129 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8cd8f166-3a75-460b-a717-3de6869aa430 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:45.579549 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8cd8f166-3a75-460b-a717-3de6869aa430 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:45.722662 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8cd8f166-3a75-460b-a717-3de6869aa430 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:55:45.730713 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8cd8f166-3a75-460b-a717-3de6869aa430 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/6493f5b0-e58d-490d-a641-b7adc2ddb9d0" status: 200 len: 1680 microversion: 2.1 time: 0.164671 Oct 04 19:55:45.735264 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4057/8099] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:55:45 2022] GET /compute/v2.1/servers/6493f5b0-e58d-490d-a641-b7adc2ddb9d0 => generated 1680 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:55:46.754503 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d1415fda-9903-448b-b99a-347a75fedfbb tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:55:46.755137 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d1415fda-9903-448b-b99a-347a75fedfbb tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 6493f5b0-e58d-490d-a641-b7adc2ddb9d0] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:55:46.762579 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d1415fda-9903-448b-b99a-347a75fedfbb tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:46.763083 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d1415fda-9903-448b-b99a-347a75fedfbb tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:46.763544 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d1415fda-9903-448b-b99a-347a75fedfbb tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:46.764290 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d1415fda-9903-448b-b99a-347a75fedfbb tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:46.764769 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d1415fda-9903-448b-b99a-347a75fedfbb tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:46.765220 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d1415fda-9903-448b-b99a-347a75fedfbb tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:46.898480 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d1415fda-9903-448b-b99a-347a75fedfbb tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:55:46.906469 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d1415fda-9903-448b-b99a-347a75fedfbb tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/6493f5b0-e58d-490d-a641-b7adc2ddb9d0" status: 200 len: 1680 microversion: 2.1 time: 0.155922 Oct 04 19:55:46.907052 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4043/8100] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:55:46 2022] GET /compute/v2.1/servers/6493f5b0-e58d-490d-a641-b7adc2ddb9d0 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:55:47.930479 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0e4f3643-8bb3-482d-8d64-0d1eec3f29ec tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:55:47.931098 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0e4f3643-8bb3-482d-8d64-0d1eec3f29ec tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 6493f5b0-e58d-490d-a641-b7adc2ddb9d0] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:55:47.937941 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0e4f3643-8bb3-482d-8d64-0d1eec3f29ec tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:47.938423 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0e4f3643-8bb3-482d-8d64-0d1eec3f29ec tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:47.938860 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0e4f3643-8bb3-482d-8d64-0d1eec3f29ec tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:47.939550 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0e4f3643-8bb3-482d-8d64-0d1eec3f29ec tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:47.940013 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0e4f3643-8bb3-482d-8d64-0d1eec3f29ec tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:47.940462 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0e4f3643-8bb3-482d-8d64-0d1eec3f29ec tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:48.074321 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0e4f3643-8bb3-482d-8d64-0d1eec3f29ec tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:55:48.082173 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0e4f3643-8bb3-482d-8d64-0d1eec3f29ec tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/6493f5b0-e58d-490d-a641-b7adc2ddb9d0" status: 200 len: 1680 microversion: 2.1 time: 0.156186 Oct 04 19:55:48.082738 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4058/8101] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:55:47 2022] GET /compute/v2.1/servers/6493f5b0-e58d-490d-a641-b7adc2ddb9d0 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:55:49.111969 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0da345eb-97fb-4848-95a5-d5cb144c755c tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:55:49.118571 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0da345eb-97fb-4848-95a5-d5cb144c755c tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 6493f5b0-e58d-490d-a641-b7adc2ddb9d0] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:55:49.120230 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0da345eb-97fb-4848-95a5-d5cb144c755c tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:49.120743 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0da345eb-97fb-4848-95a5-d5cb144c755c tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:49.121244 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0da345eb-97fb-4848-95a5-d5cb144c755c tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:49.121960 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0da345eb-97fb-4848-95a5-d5cb144c755c tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:49.122428 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0da345eb-97fb-4848-95a5-d5cb144c755c tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:49.122871 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0da345eb-97fb-4848-95a5-d5cb144c755c tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:49.264653 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0da345eb-97fb-4848-95a5-d5cb144c755c tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:55:49.272369 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0da345eb-97fb-4848-95a5-d5cb144c755c tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/6493f5b0-e58d-490d-a641-b7adc2ddb9d0" status: 200 len: 1680 microversion: 2.1 time: 0.165836 Oct 04 19:55:49.272953 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4044/8102] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:55:49 2022] GET /compute/v2.1/servers/6493f5b0-e58d-490d-a641-b7adc2ddb9d0 => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:55:50.296344 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-428f2f80-0428-4e89-a00b-26d4fc482320 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:55:50.296970 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-428f2f80-0428-4e89-a00b-26d4fc482320 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 6493f5b0-e58d-490d-a641-b7adc2ddb9d0] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:55:50.304280 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-428f2f80-0428-4e89-a00b-26d4fc482320 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:50.304699 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-428f2f80-0428-4e89-a00b-26d4fc482320 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:50.305650 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-428f2f80-0428-4e89-a00b-26d4fc482320 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:50.306352 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-428f2f80-0428-4e89-a00b-26d4fc482320 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:50.306812 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-428f2f80-0428-4e89-a00b-26d4fc482320 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:50.307244 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-428f2f80-0428-4e89-a00b-26d4fc482320 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:50.439436 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-428f2f80-0428-4e89-a00b-26d4fc482320 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:55:50.447773 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-428f2f80-0428-4e89-a00b-26d4fc482320 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/6493f5b0-e58d-490d-a641-b7adc2ddb9d0" status: 200 len: 1680 microversion: 2.1 time: 0.155819 Oct 04 19:55:50.448366 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4059/8103] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:55:50 2022] GET /compute/v2.1/servers/6493f5b0-e58d-490d-a641-b7adc2ddb9d0 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:55:51.471767 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-25f7a481-8c9b-48b0-b1c3-6bd477cdf497 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:55:51.472434 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-25f7a481-8c9b-48b0-b1c3-6bd477cdf497 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 6493f5b0-e58d-490d-a641-b7adc2ddb9d0] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:55:51.480333 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-25f7a481-8c9b-48b0-b1c3-6bd477cdf497 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:51.480842 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-25f7a481-8c9b-48b0-b1c3-6bd477cdf497 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:51.481294 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-25f7a481-8c9b-48b0-b1c3-6bd477cdf497 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:51.481995 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-25f7a481-8c9b-48b0-b1c3-6bd477cdf497 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:51.482459 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-25f7a481-8c9b-48b0-b1c3-6bd477cdf497 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:51.482897 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-25f7a481-8c9b-48b0-b1c3-6bd477cdf497 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:51.620336 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-25f7a481-8c9b-48b0-b1c3-6bd477cdf497 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:55:51.628381 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-25f7a481-8c9b-48b0-b1c3-6bd477cdf497 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/6493f5b0-e58d-490d-a641-b7adc2ddb9d0" status: 200 len: 1683 microversion: 2.1 time: 0.160531 Oct 04 19:55:51.628957 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4045/8104] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:55:51 2022] GET /compute/v2.1/servers/6493f5b0-e58d-490d-a641-b7adc2ddb9d0 => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:56:15.830173 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2f7f92d4-89c1-4e15-bdbb-5873ff3a9d2a tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:56:15.832515 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2f7f92d4-89c1-4e15-bdbb-5873ff3a9d2a tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 6493f5b0-e58d-490d-a641-b7adc2ddb9d0] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:56:15.834847 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=12 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:56:15.836170 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:56:15.840883 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2f7f92d4-89c1-4e15-bdbb-5873ff3a9d2a tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:56:15.847304 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2f7f92d4-89c1-4e15-bdbb-5873ff3a9d2a tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:56:15.847304 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2f7f92d4-89c1-4e15-bdbb-5873ff3a9d2a tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:56:15.847304 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2f7f92d4-89c1-4e15-bdbb-5873ff3a9d2a tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:56:15.847304 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2f7f92d4-89c1-4e15-bdbb-5873ff3a9d2a tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:56:15.847304 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2f7f92d4-89c1-4e15-bdbb-5873ff3a9d2a tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:56:15.907070 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2f7f92d4-89c1-4e15-bdbb-5873ff3a9d2a tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "POST /compute/v2.1/servers/6493f5b0-e58d-490d-a641-b7adc2ddb9d0/action" status: 200 len: 69093 microversion: 2.1 time: 0.080751 Oct 04 19:56:15.907710 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4060/8105] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 19:56:15 2022] POST /compute/v2.1/servers/6493f5b0-e58d-490d-a641-b7adc2ddb9d0/action => generated 69093 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:56:23.013815 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6a1002ff-704d-4ce8-a6cc-27a1d5cdf9d6 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:56:23.014342 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-6a1002ff-704d-4ce8-a6cc-27a1d5cdf9d6 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 6493f5b0-e58d-490d-a641-b7adc2ddb9d0] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:56:23.016801 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=14 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:56:23.017568 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=40 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:56:23.024237 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6a1002ff-704d-4ce8-a6cc-27a1d5cdf9d6 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:56:23.026497 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6a1002ff-704d-4ce8-a6cc-27a1d5cdf9d6 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:56:23.026497 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6a1002ff-704d-4ce8-a6cc-27a1d5cdf9d6 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:56:23.026497 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6a1002ff-704d-4ce8-a6cc-27a1d5cdf9d6 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:56:23.026943 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6a1002ff-704d-4ce8-a6cc-27a1d5cdf9d6 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:56:23.027433 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6a1002ff-704d-4ce8-a6cc-27a1d5cdf9d6 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:56:23.058241 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-6a1002ff-704d-4ce8-a6cc-27a1d5cdf9d6 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 6493f5b0-e58d-490d-a641-b7adc2ddb9d0] Going to try to terminate instance {{(pid=123002) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:56:23.078874 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-a6533428-7082-4e8b-8331-3569c067ee55 req-a329977c-4e89-4876-a024-ff4a08219242 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6493f5b0-e58d-490d-a641-b7adc2ddb9d0", "tag": "6e6ef792-15cf-4273-9782-4bd65ef92424"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:56:23.097675 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-a6533428-7082-4e8b-8331-3569c067ee55 req-a329977c-4e89-4876-a024-ff4a08219242 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:56:23.097675 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-a6533428-7082-4e8b-8331-3569c067ee55 req-a329977c-4e89-4876-a024-ff4a08219242 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:56:23.097675 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-a6533428-7082-4e8b-8331-3569c067ee55 req-a329977c-4e89-4876-a024-ff4a08219242 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:56:23.110441 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-a6533428-7082-4e8b-8331-3569c067ee55 req-a329977c-4e89-4876-a024-ff4a08219242 service nova] Creating event network-changed:6e6ef792-15cf-4273-9782-4bd65ef92424 for instance 6493f5b0-e58d-490d-a641-b7adc2ddb9d0 on n-h1-850501-14 Oct 04 19:56:23.115610 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-a6533428-7082-4e8b-8331-3569c067ee55 req-a329977c-4e89-4876-a024-ff4a08219242 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103046 Oct 04 19:56:23.116343 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4061/8106] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:56:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:56:23.352577 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6a1002ff-704d-4ce8-a6cc-27a1d5cdf9d6 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6493f5b0-e58d-490d-a641-b7adc2ddb9d0" status: 204 len: 0 microversion: 2.1 time: 0.342278 Oct 04 19:56:23.353636 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4046/8107] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 19:56:23 2022] DELETE /compute/v2.1/servers/6493f5b0-e58d-490d-a641-b7adc2ddb9d0 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:56:23.363195 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a795d9a8-6031-456d-a791-087c3e4f4ad9 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:56:23.363844 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a795d9a8-6031-456d-a791-087c3e4f4ad9 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 6493f5b0-e58d-490d-a641-b7adc2ddb9d0] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:56:23.371983 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a795d9a8-6031-456d-a791-087c3e4f4ad9 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:56:23.372533 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a795d9a8-6031-456d-a791-087c3e4f4ad9 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:56:23.372969 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a795d9a8-6031-456d-a791-087c3e4f4ad9 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:56:23.373678 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a795d9a8-6031-456d-a791-087c3e4f4ad9 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:56:23.374142 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a795d9a8-6031-456d-a791-087c3e4f4ad9 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:56:23.374710 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a795d9a8-6031-456d-a791-087c3e4f4ad9 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:56:23.518102 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a795d9a8-6031-456d-a791-087c3e4f4ad9 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:56:23.527234 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a795d9a8-6031-456d-a791-087c3e4f4ad9 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/6493f5b0-e58d-490d-a641-b7adc2ddb9d0" status: 200 len: 1689 microversion: 2.1 time: 0.168627 Oct 04 19:56:23.535885 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4062/8108] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:56:23 2022] GET /compute/v2.1/servers/6493f5b0-e58d-490d-a641-b7adc2ddb9d0 => generated 1689 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:56:24.551205 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0c11b7e8-7706-490d-8840-ad77be8f955a tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:56:24.551953 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0c11b7e8-7706-490d-8840-ad77be8f955a tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 6493f5b0-e58d-490d-a641-b7adc2ddb9d0] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:56:24.559558 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0c11b7e8-7706-490d-8840-ad77be8f955a tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:56:24.560079 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0c11b7e8-7706-490d-8840-ad77be8f955a tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:56:24.560544 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0c11b7e8-7706-490d-8840-ad77be8f955a tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:56:24.561253 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0c11b7e8-7706-490d-8840-ad77be8f955a tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:56:24.561874 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0c11b7e8-7706-490d-8840-ad77be8f955a tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:56:24.562317 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0c11b7e8-7706-490d-8840-ad77be8f955a tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:56:24.696305 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0c11b7e8-7706-490d-8840-ad77be8f955a tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:56:24.704270 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0c11b7e8-7706-490d-8840-ad77be8f955a tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/6493f5b0-e58d-490d-a641-b7adc2ddb9d0" status: 200 len: 1689 microversion: 2.1 time: 0.157437 Oct 04 19:56:24.704855 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4047/8109] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:56:24 2022] GET /compute/v2.1/servers/6493f5b0-e58d-490d-a641-b7adc2ddb9d0 => generated 1689 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:56:25.383984 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-3d39ef7e-504a-4ac0-8e26-b43ea0feb5db req-02e1fda4-13b6-43d1-b0c1-8f12f4db7730 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6493f5b0-e58d-490d-a641-b7adc2ddb9d0", "name": "network-vif-deleted", "tag": "6e6ef792-15cf-4273-9782-4bd65ef92424"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:56:25.394070 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-3d39ef7e-504a-4ac0-8e26-b43ea0feb5db req-02e1fda4-13b6-43d1-b0c1-8f12f4db7730 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:56:25.394669 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-3d39ef7e-504a-4ac0-8e26-b43ea0feb5db req-02e1fda4-13b6-43d1-b0c1-8f12f4db7730 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:56:25.395107 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-3d39ef7e-504a-4ac0-8e26-b43ea0feb5db req-02e1fda4-13b6-43d1-b0c1-8f12f4db7730 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:56:25.407341 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-3d39ef7e-504a-4ac0-8e26-b43ea0feb5db req-02e1fda4-13b6-43d1-b0c1-8f12f4db7730 service nova] Creating event network-vif-deleted:6e6ef792-15cf-4273-9782-4bd65ef92424 for instance 6493f5b0-e58d-490d-a641-b7adc2ddb9d0 on n-h1-850501-14 Oct 04 19:56:25.412479 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-3d39ef7e-504a-4ac0-8e26-b43ea0feb5db req-02e1fda4-13b6-43d1-b0c1-8f12f4db7730 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032628 Oct 04 19:56:25.413136 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4063/8110] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:56:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:56:25.730526 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-141042e5-d2dc-41e1-a967-7524dcc9ee23 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:56:25.731273 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-141042e5-d2dc-41e1-a967-7524dcc9ee23 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 6493f5b0-e58d-490d-a641-b7adc2ddb9d0] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:56:25.738568 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-141042e5-d2dc-41e1-a967-7524dcc9ee23 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:56:25.739084 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-141042e5-d2dc-41e1-a967-7524dcc9ee23 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:56:25.739546 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-141042e5-d2dc-41e1-a967-7524dcc9ee23 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:56:25.740304 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-141042e5-d2dc-41e1-a967-7524dcc9ee23 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:56:25.740793 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-141042e5-d2dc-41e1-a967-7524dcc9ee23 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:56:25.741249 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-141042e5-d2dc-41e1-a967-7524dcc9ee23 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:56:25.775377 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-141042e5-d2dc-41e1-a967-7524dcc9ee23 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:56:25.775904 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-141042e5-d2dc-41e1-a967-7524dcc9ee23 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:56:25.776371 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-141042e5-d2dc-41e1-a967-7524dcc9ee23 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:56:25.776844 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-141042e5-d2dc-41e1-a967-7524dcc9ee23 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lazy-loading 'fault' on Instance uuid 6493f5b0-e58d-490d-a641-b7adc2ddb9d0 {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:56:25.819385 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-141042e5-d2dc-41e1-a967-7524dcc9ee23 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:56:25.827609 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-141042e5-d2dc-41e1-a967-7524dcc9ee23 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/6493f5b0-e58d-490d-a641-b7adc2ddb9d0" status: 200 len: 1356 microversion: 2.1 time: 0.101020 Oct 04 19:56:25.828305 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4048/8111] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:56:25 2022] GET /compute/v2.1/servers/6493f5b0-e58d-490d-a641-b7adc2ddb9d0 => generated 1356 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:56:26.854742 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b8a9428e-4b7e-446c-96a0-2233d2f13428 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:56:26.855485 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b8a9428e-4b7e-446c-96a0-2233d2f13428 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 6493f5b0-e58d-490d-a641-b7adc2ddb9d0] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:56:26.862045 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b8a9428e-4b7e-446c-96a0-2233d2f13428 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:56:26.862533 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b8a9428e-4b7e-446c-96a0-2233d2f13428 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:56:26.862977 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b8a9428e-4b7e-446c-96a0-2233d2f13428 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:56:26.863677 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b8a9428e-4b7e-446c-96a0-2233d2f13428 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:56:26.864162 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b8a9428e-4b7e-446c-96a0-2233d2f13428 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:56:26.864593 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b8a9428e-4b7e-446c-96a0-2233d2f13428 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:56:26.878389 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-b8a9428e-4b7e-446c-96a0-2233d2f13428 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] HTTP exception thrown: Instance 6493f5b0-e58d-490d-a641-b7adc2ddb9d0 could not be found. Oct 04 19:56:26.879998 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b8a9428e-4b7e-446c-96a0-2233d2f13428 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Request method failure captured: Oct 04 19:56:26.879998 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/6493f5b0-e58d-490d-a641-b7adc2ddb9d0 HTTP/1.1 Oct 04 19:56:26.879998 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 19:56:26.879998 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 19:56:26.879998 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 19:56:26.879998 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 19:56:26.879998 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 19:56:26.879998 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 19:56:26.879998 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 19:56:26.879998 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 19:56:26.879998 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPI88jPqPFF3foNds79FcB9aFEPQ4j2aE77udaYKTwax2C5JHCysGdgy0FMgNwDOy13EsNaR0GwTaNiwC4DOXbgoj1xNuPI5o717aLLx16xkDOI9Y9C18IHU35Ip47q038B2FBqXcNSHdcfF09wzWairlH5Vr7NhdGSOsyjDGcd-usGY Oct 04 19:56:26.879998 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 19:56:26.879998 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 19:56:26.879998 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 19:56:26.879998 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 19:56:26.879998 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 19:56:26.879998 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 19:56:26.879998 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 7112e2b246a44297876ee6d279e8f655 Oct 04 19:56:26.879998 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1045305417 Oct 04 19:56:26.879998 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 19:56:26.879998 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 19:56:26.879998 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7112e2b246a44297876ee6d279e8f655"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7112e2b246a44297876ee6d279e8f655", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7112e2b246a44297876ee6d279e8f655"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7112e2b246a44297876ee6d279e8f655"}]}] Oct 04 19:56:26.879998 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1045305417 Oct 04 19:56:26.879998 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 7112e2b246a44297876ee6d279e8f655 Oct 04 19:56:26.879998 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1045305417 Oct 04 19:56:26.879998 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-TestNetworkAdvancedServerOps-1045305417-project Oct 04 19:56:26.879998 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 19:56:26.879998 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 19:56:26.879998 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: deb5459af175415da4825e6078eba908 Oct 04 19:56:26.879998 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1045305417-project Oct 04 19:56:26.879998 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 19:56:26.879998 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 6493f5b0-e58d-490d-a641-b7adc2ddb9d0 could not be found. Oct 04 19:56:26.879998 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '6493f5b0-e58d-490d-a641-b7adc2ddb9d0'} Oct 04 19:56:26.879998 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:56:26.879998 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:56:26.879998 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:56:26.879998 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:56:26.879998 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:56:26.879998 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:56:26.879998 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:56:26.879998 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:56:26.879998 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:56:26.879998 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:56:26.879998 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6493f5b0-e58d-490d-a641-b7adc2ddb9d0 could not be found. Oct 04 19:56:26.879998 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:56:26.879998 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:56:26.879998 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:56:26.879998 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:56:26.879998 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:56:26.879998 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:56:26.879998 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:56:26.879998 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:56:26.879998 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:56:26.879998 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:56:26.879998 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:56:26.879998 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:56:26.879998 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:56:26.879998 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:56:26.879998 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:56:26.879998 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:56:26.879998 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6493f5b0-e58d-490d-a641-b7adc2ddb9d0 could not be found. Oct 04 19:56:26.879998 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:56:26.879998 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:56:26.885983 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:56:26.885983 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:56:26.885983 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:56:26.885983 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:56:26.885983 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:56:26.885983 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:56:26.885983 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6493f5b0-e58d-490d-a641-b7adc2ddb9d0 could not be found. Oct 04 19:56:26.885983 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:56:26.885983 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b8a9428e-4b7e-446c-96a0-2233d2f13428 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Returning 404 to user: Instance 6493f5b0-e58d-490d-a641-b7adc2ddb9d0 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:56:26.885983 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b8a9428e-4b7e-446c-96a0-2233d2f13428 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/6493f5b0-e58d-490d-a641-b7adc2ddb9d0" status: 404 len: 111 microversion: 2.1 time: 0.032997 Oct 04 19:56:26.885983 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4064/8112] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:56:26 2022] GET /compute/v2.1/servers/6493f5b0-e58d-490d-a641-b7adc2ddb9d0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:56:30.493260 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-13551a0a-e7d3-49f2-907f-0e1a520a2140 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '.version_select at 0x7fe253e11c10>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:56:30.592808 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-13551a0a-e7d3-49f2-907f-0e1a520a2140 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2055886335" status: 202 len: 0 microversion: 2.1 time: 0.103371 Oct 04 19:56:30.593297 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4049/8113] 10.222.0.20 () {58 vars in 1284 bytes} [Tue Oct 4 19:56:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2055886335 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:56:30.622777 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b869a51c-24d4-4fa1-babd-91e6b1840020 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Action: 'create', calling method: .version_select at 0x7fe2591020d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-570885244", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPx9LN/a8hNbaX8YF5Wbze+s5JAh0+UvNkOBAvcIz5ylJ5ndOHiDe7aNP9BuHbpmrZFyAOYvtd5BGBavK7BXcdu+Q1QubBiI+ShBfF32C5QpZDbPKC8jo9vLQJNYAzgu6Q=="}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:56:30.639907 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-b869a51c-24d4-4fa1-babd-91e6b1840020 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Getting quotas for project 7112e2b246a44297876ee6d279e8f655. Resources: {'key_pairs'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:56:30.645336 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-b869a51c-24d4-4fa1-babd-91e6b1840020 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Getting quotas for user deb5459af175415da4825e6078eba908 and project 7112e2b246a44297876ee6d279e8f655. Resources: {'key_pairs'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:56:30.787267 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b869a51c-24d4-4fa1-babd-91e6b1840020 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.168344 Oct 04 19:56:30.787828 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4065/8114] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Oct 4 19:56:30 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:56:39.903439 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f7e05ab0-281e-4393-86e4-8f293b32251b tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2127096556", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": [{"uuid": "34c56196-752e-45e6-9bbd-d5cd72d42246"}], "key_name": "tempest-TestNetworkAdvancedServerOps-570885244", "security_groups": [{"name": "tempest-secgroup-smoke-236297669"}]}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:56:39.914826 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:56:40.129070 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-f7e05ab0-281e-4393-86e4-8f293b32251b tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] validate_networks() for [('34c56196-752e-45e6-9bbd-d5cd72d42246', None, None, None, None, None)] {{(pid=123002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:56:40.575981 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-f7e05ab0-281e-4393-86e4-8f293b32251b tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:56:40.576461 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-f7e05ab0-281e-4393-86e4-8f293b32251b tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:56:40.576961 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-f7e05ab0-281e-4393-86e4-8f293b32251b tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:56:40.577392 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-f7e05ab0-281e-4393-86e4-8f293b32251b tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:56:40.578431 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-f7e05ab0-281e-4393-86e4-8f293b32251b tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:56:40.588109 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f7e05ab0-281e-4393-86e4-8f293b32251b tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:56:40.589146 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f7e05ab0-281e-4393-86e4-8f293b32251b tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:56:40.589146 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f7e05ab0-281e-4393-86e4-8f293b32251b tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:56:40.589831 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f7e05ab0-281e-4393-86e4-8f293b32251b tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:56:40.590305 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f7e05ab0-281e-4393-86e4-8f293b32251b tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:56:40.590747 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f7e05ab0-281e-4393-86e4-8f293b32251b tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:56:40.612590 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-f7e05ab0-281e-4393-86e4-8f293b32251b tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Getting quotas for project 7112e2b246a44297876ee6d279e8f655. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:56:40.618081 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-f7e05ab0-281e-4393-86e4-8f293b32251b tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Getting quotas for user deb5459af175415da4825e6078eba908 and project 7112e2b246a44297876ee6d279e8f655. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:56:40.630766 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f7e05ab0-281e-4393-86e4-8f293b32251b tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Going to run 1 instances... {{(pid=123002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:56:40.633940 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f7e05ab0-281e-4393-86e4-8f293b32251b tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 2799b992-234f-4f41-b0b5-902c64084482] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:56:40.760226 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f7e05ab0-281e-4393-86e4-8f293b32251b tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.860844 Oct 04 19:56:40.767269 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4050/8115] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 19:56:39 2022] POST /compute/v2.1/servers => generated 405 bytes in 863 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:56:40.774622 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=16 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:56:40.774622 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=4 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:56:40.774622 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:56:40.777207 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ffb2c963-57de-4194-a79d-f14d2d4f8c08 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:56:40.777935 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ffb2c963-57de-4194-a79d-f14d2d4f8c08 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 2799b992-234f-4f41-b0b5-902c64084482] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:56:40.901015 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ffb2c963-57de-4194-a79d-f14d2d4f8c08 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:56:40.910698 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ffb2c963-57de-4194-a79d-f14d2d4f8c08 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/2799b992-234f-4f41-b0b5-902c64084482" status: 200 len: 1266 microversion: 2.1 time: 0.139616 Oct 04 19:56:40.910698 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4066/8116] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:56:40 2022] GET /compute/v2.1/servers/2799b992-234f-4f41-b0b5-902c64084482 => generated 1266 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:56:41.932082 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3fdf6b2c-ba82-447f-94db-61e9d0da627e tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:56:41.933396 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3fdf6b2c-ba82-447f-94db-61e9d0da627e tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 2799b992-234f-4f41-b0b5-902c64084482] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:56:41.940124 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3fdf6b2c-ba82-447f-94db-61e9d0da627e tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:56:41.940638 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3fdf6b2c-ba82-447f-94db-61e9d0da627e tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:56:41.941098 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3fdf6b2c-ba82-447f-94db-61e9d0da627e tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:56:41.941823 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3fdf6b2c-ba82-447f-94db-61e9d0da627e tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:56:41.942300 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3fdf6b2c-ba82-447f-94db-61e9d0da627e tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:56:41.942741 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3fdf6b2c-ba82-447f-94db-61e9d0da627e tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:56:42.014117 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3fdf6b2c-ba82-447f-94db-61e9d0da627e tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:56:42.034524 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3fdf6b2c-ba82-447f-94db-61e9d0da627e tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/2799b992-234f-4f41-b0b5-902c64084482" status: 200 len: 1270 microversion: 2.1 time: 0.107425 Oct 04 19:56:42.035127 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4051/8117] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:56:41 2022] GET /compute/v2.1/servers/2799b992-234f-4f41-b0b5-902c64084482 => generated 1270 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:56:43.059441 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a25420a7-7a1d-4e91-9f5d-b0deca701da8 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:56:43.060041 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a25420a7-7a1d-4e91-9f5d-b0deca701da8 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 2799b992-234f-4f41-b0b5-902c64084482] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:56:43.068391 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a25420a7-7a1d-4e91-9f5d-b0deca701da8 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:56:43.068942 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a25420a7-7a1d-4e91-9f5d-b0deca701da8 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:56:43.070602 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a25420a7-7a1d-4e91-9f5d-b0deca701da8 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:56:43.070602 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a25420a7-7a1d-4e91-9f5d-b0deca701da8 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:56:43.070602 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a25420a7-7a1d-4e91-9f5d-b0deca701da8 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:56:43.071040 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a25420a7-7a1d-4e91-9f5d-b0deca701da8 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:56:43.383320 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a25420a7-7a1d-4e91-9f5d-b0deca701da8 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:56:43.391242 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a25420a7-7a1d-4e91-9f5d-b0deca701da8 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/2799b992-234f-4f41-b0b5-902c64084482" status: 200 len: 1326 microversion: 2.1 time: 0.336525 Oct 04 19:56:43.397098 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4067/8118] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:56:43 2022] GET /compute/v2.1/servers/2799b992-234f-4f41-b0b5-902c64084482 => generated 1326 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:56:44.415117 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8c115995-c257-4493-9f00-e91d65d27a19 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:56:44.415675 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8c115995-c257-4493-9f00-e91d65d27a19 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 2799b992-234f-4f41-b0b5-902c64084482] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:56:44.422835 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8c115995-c257-4493-9f00-e91d65d27a19 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:56:44.423342 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8c115995-c257-4493-9f00-e91d65d27a19 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:56:44.424030 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8c115995-c257-4493-9f00-e91d65d27a19 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:56:44.424525 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8c115995-c257-4493-9f00-e91d65d27a19 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:56:44.424997 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8c115995-c257-4493-9f00-e91d65d27a19 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:56:44.425438 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8c115995-c257-4493-9f00-e91d65d27a19 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:56:44.669800 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8c115995-c257-4493-9f00-e91d65d27a19 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:56:44.677507 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8c115995-c257-4493-9f00-e91d65d27a19 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/2799b992-234f-4f41-b0b5-902c64084482" status: 200 len: 1391 microversion: 2.1 time: 0.267030 Oct 04 19:56:44.678775 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4052/8119] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:56:44 2022] GET /compute/v2.1/servers/2799b992-234f-4f41-b0b5-902c64084482 => generated 1391 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:56:45.263744 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-fd7592d5-2852-434f-b2f1-bbdf4dfc0244 req-d053c754-2436-4a2a-b2da-f8bf0d302c67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2799b992-234f-4f41-b0b5-902c64084482", "tag": "6befd1ff-c1b5-4676-8121-ba31258580f6"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:56:45.277127 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-fd7592d5-2852-434f-b2f1-bbdf4dfc0244 req-d053c754-2436-4a2a-b2da-f8bf0d302c67 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:56:45.277868 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-fd7592d5-2852-434f-b2f1-bbdf4dfc0244 req-d053c754-2436-4a2a-b2da-f8bf0d302c67 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:56:45.278757 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-fd7592d5-2852-434f-b2f1-bbdf4dfc0244 req-d053c754-2436-4a2a-b2da-f8bf0d302c67 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:56:45.296007 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-fd7592d5-2852-434f-b2f1-bbdf4dfc0244 req-d053c754-2436-4a2a-b2da-f8bf0d302c67 service nova] Creating event network-changed:6befd1ff-c1b5-4676-8121-ba31258580f6 for instance 2799b992-234f-4f41-b0b5-902c64084482 on n-h1-850501-14 Oct 04 19:56:45.299381 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-fd7592d5-2852-434f-b2f1-bbdf4dfc0244 req-d053c754-2436-4a2a-b2da-f8bf0d302c67 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042169 Oct 04 19:56:45.300001 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4068/8120] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:56:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:56:45.701447 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a6807d5a-698d-4113-8520-1bc991980632 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:56:45.702117 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a6807d5a-698d-4113-8520-1bc991980632 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 2799b992-234f-4f41-b0b5-902c64084482] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:56:45.708820 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a6807d5a-698d-4113-8520-1bc991980632 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:56:45.709902 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a6807d5a-698d-4113-8520-1bc991980632 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:56:45.710378 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a6807d5a-698d-4113-8520-1bc991980632 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:56:45.711107 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a6807d5a-698d-4113-8520-1bc991980632 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:56:45.711587 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a6807d5a-698d-4113-8520-1bc991980632 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:56:45.712037 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a6807d5a-698d-4113-8520-1bc991980632 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:56:45.933973 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a6807d5a-698d-4113-8520-1bc991980632 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:56:45.941723 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a6807d5a-698d-4113-8520-1bc991980632 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/2799b992-234f-4f41-b0b5-902c64084482" status: 200 len: 1391 microversion: 2.1 time: 0.244236 Oct 04 19:56:45.942304 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4053/8121] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:56:45 2022] GET /compute/v2.1/servers/2799b992-234f-4f41-b0b5-902c64084482 => generated 1391 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:56:46.966592 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-943d74a0-f9fe-4d67-a016-e0d763840434 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:56:46.967288 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-943d74a0-f9fe-4d67-a016-e0d763840434 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 2799b992-234f-4f41-b0b5-902c64084482] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:56:46.973576 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-943d74a0-f9fe-4d67-a016-e0d763840434 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:56:46.973991 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-943d74a0-f9fe-4d67-a016-e0d763840434 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:56:46.974426 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-943d74a0-f9fe-4d67-a016-e0d763840434 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:56:46.975119 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-943d74a0-f9fe-4d67-a016-e0d763840434 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:56:46.975573 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-943d74a0-f9fe-4d67-a016-e0d763840434 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:56:46.976276 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-943d74a0-f9fe-4d67-a016-e0d763840434 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:56:47.112278 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-943d74a0-f9fe-4d67-a016-e0d763840434 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:56:47.120816 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-943d74a0-f9fe-4d67-a016-e0d763840434 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/2799b992-234f-4f41-b0b5-902c64084482" status: 200 len: 1391 microversion: 2.1 time: 0.159334 Oct 04 19:56:47.121389 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4069/8122] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:56:46 2022] GET /compute/v2.1/servers/2799b992-234f-4f41-b0b5-902c64084482 => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:56:48.144669 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e16f1095-9d8e-4f29-855c-887d73d1478f tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:56:48.145293 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e16f1095-9d8e-4f29-855c-887d73d1478f tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 2799b992-234f-4f41-b0b5-902c64084482] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:56:48.153005 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e16f1095-9d8e-4f29-855c-887d73d1478f tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:56:48.153502 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e16f1095-9d8e-4f29-855c-887d73d1478f tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:56:48.153958 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e16f1095-9d8e-4f29-855c-887d73d1478f tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:56:48.154651 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e16f1095-9d8e-4f29-855c-887d73d1478f tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:56:48.155116 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e16f1095-9d8e-4f29-855c-887d73d1478f tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:56:48.155556 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e16f1095-9d8e-4f29-855c-887d73d1478f tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:56:48.291514 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e16f1095-9d8e-4f29-855c-887d73d1478f tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:56:48.299094 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e16f1095-9d8e-4f29-855c-887d73d1478f tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/2799b992-234f-4f41-b0b5-902c64084482" status: 200 len: 1391 microversion: 2.1 time: 0.158371 Oct 04 19:56:48.299657 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4054/8123] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:56:48 2022] GET /compute/v2.1/servers/2799b992-234f-4f41-b0b5-902c64084482 => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:56:49.322019 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1533c4aa-ebfe-4a56-a07e-c4358219dfed tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:56:49.322636 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1533c4aa-ebfe-4a56-a07e-c4358219dfed tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 2799b992-234f-4f41-b0b5-902c64084482] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:56:49.329639 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1533c4aa-ebfe-4a56-a07e-c4358219dfed tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:56:49.330134 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1533c4aa-ebfe-4a56-a07e-c4358219dfed tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:56:49.330573 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1533c4aa-ebfe-4a56-a07e-c4358219dfed tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:56:49.331321 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1533c4aa-ebfe-4a56-a07e-c4358219dfed tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:56:49.331784 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1533c4aa-ebfe-4a56-a07e-c4358219dfed tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:56:49.332276 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1533c4aa-ebfe-4a56-a07e-c4358219dfed tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:56:49.474929 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1533c4aa-ebfe-4a56-a07e-c4358219dfed tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:56:49.483295 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1533c4aa-ebfe-4a56-a07e-c4358219dfed tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/2799b992-234f-4f41-b0b5-902c64084482" status: 200 len: 1391 microversion: 2.1 time: 0.165199 Oct 04 19:56:49.483889 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4070/8124] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:56:49 2022] GET /compute/v2.1/servers/2799b992-234f-4f41-b0b5-902c64084482 => generated 1391 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:56:50.507482 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-85822c42-86e9-403a-8443-30f2c32ba66e tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:56:50.508124 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-85822c42-86e9-403a-8443-30f2c32ba66e tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 2799b992-234f-4f41-b0b5-902c64084482] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:56:50.514943 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-85822c42-86e9-403a-8443-30f2c32ba66e tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:56:50.515437 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-85822c42-86e9-403a-8443-30f2c32ba66e tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:56:50.515884 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-85822c42-86e9-403a-8443-30f2c32ba66e tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:56:50.516647 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-85822c42-86e9-403a-8443-30f2c32ba66e tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:56:50.517114 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-85822c42-86e9-403a-8443-30f2c32ba66e tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:56:50.517552 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-85822c42-86e9-403a-8443-30f2c32ba66e tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:56:50.602665 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:56:50.624798 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=6 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:56:50.652304 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-85822c42-86e9-403a-8443-30f2c32ba66e tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:56:50.659840 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-85822c42-86e9-403a-8443-30f2c32ba66e tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/2799b992-234f-4f41-b0b5-902c64084482" status: 200 len: 1391 microversion: 2.1 time: 0.156574 Oct 04 19:56:50.660459 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4055/8125] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:56:50 2022] GET /compute/v2.1/servers/2799b992-234f-4f41-b0b5-902c64084482 => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:56:51.076035 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-9294bb16-1f27-42b4-8224-70d9f461ddf9 req-a9468040-735f-4716-9971-c48e8f5ff0b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2799b992-234f-4f41-b0b5-902c64084482", "name": "network-vif-plugged", "status": "completed", "tag": "6befd1ff-c1b5-4676-8121-ba31258580f6"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:56:51.082119 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:56:51.088934 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-9294bb16-1f27-42b4-8224-70d9f461ddf9 req-a9468040-735f-4716-9971-c48e8f5ff0b9 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:56:51.102253 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-9294bb16-1f27-42b4-8224-70d9f461ddf9 req-a9468040-735f-4716-9971-c48e8f5ff0b9 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:56:51.102253 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-9294bb16-1f27-42b4-8224-70d9f461ddf9 req-a9468040-735f-4716-9971-c48e8f5ff0b9 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:56:51.102253 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-9294bb16-1f27-42b4-8224-70d9f461ddf9 req-a9468040-735f-4716-9971-c48e8f5ff0b9 service nova] Creating event network-vif-plugged:6befd1ff-c1b5-4676-8121-ba31258580f6 for instance 2799b992-234f-4f41-b0b5-902c64084482 on n-h1-850501-14 Oct 04 19:56:51.107145 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-9294bb16-1f27-42b4-8224-70d9f461ddf9 req-a9468040-735f-4716-9971-c48e8f5ff0b9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034958 Oct 04 19:56:51.108349 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4071/8126] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:56:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:56:51.684139 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-956ea605-49f5-4614-a5b1-12f50fc1a656 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:56:51.684781 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-956ea605-49f5-4614-a5b1-12f50fc1a656 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 2799b992-234f-4f41-b0b5-902c64084482] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:56:51.691546 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-956ea605-49f5-4614-a5b1-12f50fc1a656 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:56:51.692044 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-956ea605-49f5-4614-a5b1-12f50fc1a656 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:56:51.692546 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-956ea605-49f5-4614-a5b1-12f50fc1a656 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:56:51.693253 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-956ea605-49f5-4614-a5b1-12f50fc1a656 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:56:51.694414 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-956ea605-49f5-4614-a5b1-12f50fc1a656 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:56:51.694866 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-956ea605-49f5-4614-a5b1-12f50fc1a656 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:56:51.835835 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-956ea605-49f5-4614-a5b1-12f50fc1a656 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:56:51.843578 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-956ea605-49f5-4614-a5b1-12f50fc1a656 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/2799b992-234f-4f41-b0b5-902c64084482" status: 200 len: 1391 microversion: 2.1 time: 0.164084 Oct 04 19:56:51.844175 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4056/8127] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:56:51 2022] GET /compute/v2.1/servers/2799b992-234f-4f41-b0b5-902c64084482 => generated 1391 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:56:52.868819 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3f431185-f401-4ee5-8a83-dadfba91b9ae tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:56:52.869567 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3f431185-f401-4ee5-8a83-dadfba91b9ae tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 2799b992-234f-4f41-b0b5-902c64084482] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:56:52.877480 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3f431185-f401-4ee5-8a83-dadfba91b9ae tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:56:52.877480 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3f431185-f401-4ee5-8a83-dadfba91b9ae tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:56:52.877840 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3f431185-f401-4ee5-8a83-dadfba91b9ae tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:56:52.878537 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3f431185-f401-4ee5-8a83-dadfba91b9ae tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:56:52.879000 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3f431185-f401-4ee5-8a83-dadfba91b9ae tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:56:52.879433 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3f431185-f401-4ee5-8a83-dadfba91b9ae tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:56:53.017025 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3f431185-f401-4ee5-8a83-dadfba91b9ae tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:56:53.025268 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3f431185-f401-4ee5-8a83-dadfba91b9ae tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/2799b992-234f-4f41-b0b5-902c64084482" status: 200 len: 1563 microversion: 2.1 time: 0.161756 Oct 04 19:56:53.025843 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4072/8128] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:56:52 2022] GET /compute/v2.1/servers/2799b992-234f-4f41-b0b5-902c64084482 => generated 1563 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:56:53.048287 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-63097c00-efad-468b-ba55-e20b3169e61f tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:56:53.048921 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-63097c00-efad-468b-ba55-e20b3169e61f tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 2799b992-234f-4f41-b0b5-902c64084482] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:56:53.053788 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:56:53.057271 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-63097c00-efad-468b-ba55-e20b3169e61f tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:56:53.057772 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-63097c00-efad-468b-ba55-e20b3169e61f tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:56:53.058227 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-63097c00-efad-468b-ba55-e20b3169e61f tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:56:53.058933 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-63097c00-efad-468b-ba55-e20b3169e61f tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:56:53.059403 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-63097c00-efad-468b-ba55-e20b3169e61f tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:56:53.059845 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-63097c00-efad-468b-ba55-e20b3169e61f tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:56:53.195509 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-63097c00-efad-468b-ba55-e20b3169e61f tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:56:53.203268 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-63097c00-efad-468b-ba55-e20b3169e61f tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/2799b992-234f-4f41-b0b5-902c64084482" status: 200 len: 1563 microversion: 2.1 time: 0.158949 Oct 04 19:56:53.203853 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4057/8129] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:56:53 2022] GET /compute/v2.1/servers/2799b992-234f-4f41-b0b5-902c64084482 => generated 1563 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:56:55.414156 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c8f9695d-a87f-4db6-8a3b-ee57343079e3 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:56:55.415501 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c8f9695d-a87f-4db6-8a3b-ee57343079e3 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 2799b992-234f-4f41-b0b5-902c64084482] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:56:55.416746 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-b204ba29-8717-4735-8ef5-0e3db7e52f48 req-197efebe-ade2-4378-9df8-9c9d3098c15b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2799b992-234f-4f41-b0b5-902c64084482", "tag": "6befd1ff-c1b5-4676-8121-ba31258580f6"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:56:55.423264 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c8f9695d-a87f-4db6-8a3b-ee57343079e3 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:56:55.423923 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c8f9695d-a87f-4db6-8a3b-ee57343079e3 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:56:55.424396 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c8f9695d-a87f-4db6-8a3b-ee57343079e3 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:56:55.425240 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c8f9695d-a87f-4db6-8a3b-ee57343079e3 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:56:55.425931 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c8f9695d-a87f-4db6-8a3b-ee57343079e3 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:56:55.426550 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c8f9695d-a87f-4db6-8a3b-ee57343079e3 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:56:55.429594 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-b204ba29-8717-4735-8ef5-0e3db7e52f48 req-197efebe-ade2-4378-9df8-9c9d3098c15b service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:56:55.430161 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-b204ba29-8717-4735-8ef5-0e3db7e52f48 req-197efebe-ade2-4378-9df8-9c9d3098c15b service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:56:55.430680 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-b204ba29-8717-4735-8ef5-0e3db7e52f48 req-197efebe-ade2-4378-9df8-9c9d3098c15b service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:56:55.442546 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-b204ba29-8717-4735-8ef5-0e3db7e52f48 req-197efebe-ade2-4378-9df8-9c9d3098c15b service nova] Creating event network-changed:6befd1ff-c1b5-4676-8121-ba31258580f6 for instance 2799b992-234f-4f41-b0b5-902c64084482 on n-h1-850501-14 Oct 04 19:56:55.449476 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-b204ba29-8717-4735-8ef5-0e3db7e52f48 req-197efebe-ade2-4378-9df8-9c9d3098c15b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038013 Oct 04 19:56:55.450387 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4058/8130] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:56:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:56:55.663400 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c8f9695d-a87f-4db6-8a3b-ee57343079e3 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:56:55.672435 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c8f9695d-a87f-4db6-8a3b-ee57343079e3 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/2799b992-234f-4f41-b0b5-902c64084482" status: 200 len: 1563 microversion: 2.1 time: 0.263334 Oct 04 19:56:55.673406 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4073/8131] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:56:55 2022] GET /compute/v2.1/servers/2799b992-234f-4f41-b0b5-902c64084482 => generated 1563 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:57:16.929470 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-62c2d288-8b65-474b-a888-de9d65442f9d tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:57:16.931900 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-62c2d288-8b65-474b-a888-de9d65442f9d tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 2799b992-234f-4f41-b0b5-902c64084482] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:57:16.934098 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=46 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:57:16.940390 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-62c2d288-8b65-474b-a888-de9d65442f9d tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:57:16.940900 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-62c2d288-8b65-474b-a888-de9d65442f9d tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:57:16.941356 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-62c2d288-8b65-474b-a888-de9d65442f9d tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:57:16.942133 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-62c2d288-8b65-474b-a888-de9d65442f9d tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:57:16.942617 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-62c2d288-8b65-474b-a888-de9d65442f9d tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:57:16.943089 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-62c2d288-8b65-474b-a888-de9d65442f9d tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:57:17.001929 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-62c2d288-8b65-474b-a888-de9d65442f9d tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "POST /compute/v2.1/servers/2799b992-234f-4f41-b0b5-902c64084482/action" status: 200 len: 24565 microversion: 2.1 time: 0.077145 Oct 04 19:57:17.002527 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4059/8132] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 19:57:16 2022] POST /compute/v2.1/servers/2799b992-234f-4f41-b0b5-902c64084482/action => generated 24565 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:57:28.088829 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a0f26c0c-90f2-4c82-a739-4b51310ad95c tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:57:28.091523 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a0f26c0c-90f2-4c82-a739-4b51310ad95c tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 2799b992-234f-4f41-b0b5-902c64084482] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:57:28.094018 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=18 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:57:28.094687 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=34 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:57:28.099494 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a0f26c0c-90f2-4c82-a739-4b51310ad95c tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:57:28.099986 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a0f26c0c-90f2-4c82-a739-4b51310ad95c tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:57:28.100482 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a0f26c0c-90f2-4c82-a739-4b51310ad95c tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:57:28.101447 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a0f26c0c-90f2-4c82-a739-4b51310ad95c tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:57:28.101906 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a0f26c0c-90f2-4c82-a739-4b51310ad95c tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:57:28.102338 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a0f26c0c-90f2-4c82-a739-4b51310ad95c tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:57:28.189568 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a0f26c0c-90f2-4c82-a739-4b51310ad95c tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:57:28.195609 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a0f26c0c-90f2-4c82-a739-4b51310ad95c tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 2799b992-234f-4f41-b0b5-902c64084482] Old instance type m1.heat2, new instance type m1.heat {{(pid=123001) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 19:57:28.202195 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-a0f26c0c-90f2-4c82-a739-4b51310ad95c tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:57:28.202614 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-a0f26c0c-90f2-4c82-a739-4b51310ad95c tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:57:28.203084 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-a0f26c0c-90f2-4c82-a739-4b51310ad95c tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:57:28.203491 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-a0f26c0c-90f2-4c82-a739-4b51310ad95c tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:57:28.203903 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-a0f26c0c-90f2-4c82-a739-4b51310ad95c tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:57:28.360575 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a0f26c0c-90f2-4c82-a739-4b51310ad95c tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "POST /compute/v2.1/servers/2799b992-234f-4f41-b0b5-902c64084482/action" status: 202 len: 0 microversion: 2.1 time: 0.275953 Oct 04 19:57:28.361346 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4074/8133] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 19:57:28 2022] POST /compute/v2.1/servers/2799b992-234f-4f41-b0b5-902c64084482/action => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:57:28.370212 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0fa45552-5f22-4bca-8049-d1421447dbdc tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:57:28.370935 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0fa45552-5f22-4bca-8049-d1421447dbdc tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 2799b992-234f-4f41-b0b5-902c64084482] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:57:28.374265 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=4 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:57:28.375127 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=4 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:57:28.380606 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0fa45552-5f22-4bca-8049-d1421447dbdc tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:57:28.381109 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0fa45552-5f22-4bca-8049-d1421447dbdc tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:57:28.381562 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0fa45552-5f22-4bca-8049-d1421447dbdc tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:57:28.382315 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0fa45552-5f22-4bca-8049-d1421447dbdc tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:57:28.382785 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0fa45552-5f22-4bca-8049-d1421447dbdc tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:57:28.383257 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0fa45552-5f22-4bca-8049-d1421447dbdc tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:57:28.526511 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0fa45552-5f22-4bca-8049-d1421447dbdc tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:57:28.535439 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0fa45552-5f22-4bca-8049-d1421447dbdc tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/2799b992-234f-4f41-b0b5-902c64084482" status: 200 len: 1691 microversion: 2.1 time: 0.169534 Oct 04 19:57:28.541939 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4060/8134] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:57:28 2022] GET /compute/v2.1/servers/2799b992-234f-4f41-b0b5-902c64084482 => generated 1691 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:57:29.559498 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e113afbd-7987-4181-b612-4ce490b68b53 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:57:29.560774 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e113afbd-7987-4181-b612-4ce490b68b53 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 2799b992-234f-4f41-b0b5-902c64084482] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:57:29.568778 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e113afbd-7987-4181-b612-4ce490b68b53 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:57:29.569270 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e113afbd-7987-4181-b612-4ce490b68b53 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:57:29.569722 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e113afbd-7987-4181-b612-4ce490b68b53 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:57:29.570402 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e113afbd-7987-4181-b612-4ce490b68b53 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:57:29.570864 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e113afbd-7987-4181-b612-4ce490b68b53 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:57:29.571291 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e113afbd-7987-4181-b612-4ce490b68b53 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:57:29.706865 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e113afbd-7987-4181-b612-4ce490b68b53 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:57:29.715072 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e113afbd-7987-4181-b612-4ce490b68b53 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/2799b992-234f-4f41-b0b5-902c64084482" status: 200 len: 1691 microversion: 2.1 time: 0.159617 Oct 04 19:57:29.715795 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4075/8135] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:57:29 2022] GET /compute/v2.1/servers/2799b992-234f-4f41-b0b5-902c64084482 => generated 1691 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:57:30.738861 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3048034e-a1b4-408d-ab83-77c12ea975ce tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:57:30.739501 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3048034e-a1b4-408d-ab83-77c12ea975ce tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 2799b992-234f-4f41-b0b5-902c64084482] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:57:30.746485 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3048034e-a1b4-408d-ab83-77c12ea975ce tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:57:30.747000 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3048034e-a1b4-408d-ab83-77c12ea975ce tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:57:30.748031 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3048034e-a1b4-408d-ab83-77c12ea975ce tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:57:30.748780 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3048034e-a1b4-408d-ab83-77c12ea975ce tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:57:30.749257 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3048034e-a1b4-408d-ab83-77c12ea975ce tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:57:30.749709 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3048034e-a1b4-408d-ab83-77c12ea975ce tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:57:30.963659 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3048034e-a1b4-408d-ab83-77c12ea975ce tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:57:30.972130 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3048034e-a1b4-408d-ab83-77c12ea975ce tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/2799b992-234f-4f41-b0b5-902c64084482" status: 200 len: 1691 microversion: 2.1 time: 0.237189 Oct 04 19:57:30.972713 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4061/8136] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:57:30 2022] GET /compute/v2.1/servers/2799b992-234f-4f41-b0b5-902c64084482 => generated 1691 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:57:31.996091 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-12180e82-1d83-4199-95b5-3db8609000be tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:57:31.996621 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-12180e82-1d83-4199-95b5-3db8609000be tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 2799b992-234f-4f41-b0b5-902c64084482] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:57:32.003434 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-12180e82-1d83-4199-95b5-3db8609000be tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:57:32.003912 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-12180e82-1d83-4199-95b5-3db8609000be tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:57:32.004385 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-12180e82-1d83-4199-95b5-3db8609000be tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:57:32.005067 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-12180e82-1d83-4199-95b5-3db8609000be tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:57:32.005518 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-12180e82-1d83-4199-95b5-3db8609000be tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:57:32.005940 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-12180e82-1d83-4199-95b5-3db8609000be tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:57:32.139060 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-12180e82-1d83-4199-95b5-3db8609000be tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:57:32.146890 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-12180e82-1d83-4199-95b5-3db8609000be tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/2799b992-234f-4f41-b0b5-902c64084482" status: 200 len: 1696 microversion: 2.1 time: 0.154764 Oct 04 19:57:32.147468 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4076/8137] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:57:31 2022] GET /compute/v2.1/servers/2799b992-234f-4f41-b0b5-902c64084482 => generated 1696 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:57:33.174691 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4b795cb0-0bd2-44e1-8379-0f8985f91978 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:57:33.175330 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4b795cb0-0bd2-44e1-8379-0f8985f91978 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 2799b992-234f-4f41-b0b5-902c64084482] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:57:33.181940 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4b795cb0-0bd2-44e1-8379-0f8985f91978 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:57:33.182446 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4b795cb0-0bd2-44e1-8379-0f8985f91978 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:57:33.182902 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4b795cb0-0bd2-44e1-8379-0f8985f91978 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:57:33.183618 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4b795cb0-0bd2-44e1-8379-0f8985f91978 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:57:33.184125 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4b795cb0-0bd2-44e1-8379-0f8985f91978 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:57:33.185178 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4b795cb0-0bd2-44e1-8379-0f8985f91978 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:57:33.320779 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4b795cb0-0bd2-44e1-8379-0f8985f91978 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:57:33.329172 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4b795cb0-0bd2-44e1-8379-0f8985f91978 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/2799b992-234f-4f41-b0b5-902c64084482" status: 200 len: 1696 microversion: 2.1 time: 0.158674 Oct 04 19:57:33.329751 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4062/8138] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:57:33 2022] GET /compute/v2.1/servers/2799b992-234f-4f41-b0b5-902c64084482 => generated 1696 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:57:34.357707 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b9f5f927-853a-48d6-bedf-c18f36d26d01 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:57:34.358316 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b9f5f927-853a-48d6-bedf-c18f36d26d01 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 2799b992-234f-4f41-b0b5-902c64084482] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:57:34.365190 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b9f5f927-853a-48d6-bedf-c18f36d26d01 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:57:34.365705 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b9f5f927-853a-48d6-bedf-c18f36d26d01 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:57:34.366146 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b9f5f927-853a-48d6-bedf-c18f36d26d01 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:57:34.366832 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b9f5f927-853a-48d6-bedf-c18f36d26d01 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:57:34.367285 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b9f5f927-853a-48d6-bedf-c18f36d26d01 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:57:34.367705 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b9f5f927-853a-48d6-bedf-c18f36d26d01 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:57:34.501737 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b9f5f927-853a-48d6-bedf-c18f36d26d01 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:57:34.509559 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b9f5f927-853a-48d6-bedf-c18f36d26d01 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/2799b992-234f-4f41-b0b5-902c64084482" status: 200 len: 1696 microversion: 2.1 time: 0.156059 Oct 04 19:57:34.510140 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4077/8139] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:57:34 2022] GET /compute/v2.1/servers/2799b992-234f-4f41-b0b5-902c64084482 => generated 1696 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:57:35.534471 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ad0ba934-fab6-41c0-b314-26119e348542 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:57:35.535021 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ad0ba934-fab6-41c0-b314-26119e348542 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 2799b992-234f-4f41-b0b5-902c64084482] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:57:35.542057 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ad0ba934-fab6-41c0-b314-26119e348542 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:57:35.542563 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ad0ba934-fab6-41c0-b314-26119e348542 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:57:35.543023 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ad0ba934-fab6-41c0-b314-26119e348542 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:57:35.543738 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ad0ba934-fab6-41c0-b314-26119e348542 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:57:35.544847 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ad0ba934-fab6-41c0-b314-26119e348542 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:57:35.545298 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ad0ba934-fab6-41c0-b314-26119e348542 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:57:35.678644 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ad0ba934-fab6-41c0-b314-26119e348542 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:57:35.686964 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ad0ba934-fab6-41c0-b314-26119e348542 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/2799b992-234f-4f41-b0b5-902c64084482" status: 200 len: 1696 microversion: 2.1 time: 0.156512 Oct 04 19:57:35.687545 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4063/8140] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:57:35 2022] GET /compute/v2.1/servers/2799b992-234f-4f41-b0b5-902c64084482 => generated 1696 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:57:36.710756 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8a748661-f725-47cf-a36a-381b1d94cece tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:57:36.711399 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8a748661-f725-47cf-a36a-381b1d94cece tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 2799b992-234f-4f41-b0b5-902c64084482] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:57:36.723007 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8a748661-f725-47cf-a36a-381b1d94cece tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:57:36.723997 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8a748661-f725-47cf-a36a-381b1d94cece tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:57:36.724462 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8a748661-f725-47cf-a36a-381b1d94cece tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:57:36.725171 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8a748661-f725-47cf-a36a-381b1d94cece tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:57:36.725626 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8a748661-f725-47cf-a36a-381b1d94cece tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:57:36.726316 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8a748661-f725-47cf-a36a-381b1d94cece tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:57:36.869726 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8a748661-f725-47cf-a36a-381b1d94cece tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:57:36.877535 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8a748661-f725-47cf-a36a-381b1d94cece tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/2799b992-234f-4f41-b0b5-902c64084482" status: 200 len: 1696 microversion: 2.1 time: 0.170718 Oct 04 19:57:36.878106 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4078/8141] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:57:36 2022] GET /compute/v2.1/servers/2799b992-234f-4f41-b0b5-902c64084482 => generated 1696 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:57:37.901363 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4644da1d-a425-44c8-ac72-ec9bca440973 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:57:37.902022 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4644da1d-a425-44c8-ac72-ec9bca440973 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 2799b992-234f-4f41-b0b5-902c64084482] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:57:37.909315 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4644da1d-a425-44c8-ac72-ec9bca440973 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:57:37.909813 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4644da1d-a425-44c8-ac72-ec9bca440973 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:57:37.910269 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4644da1d-a425-44c8-ac72-ec9bca440973 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:57:37.910972 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4644da1d-a425-44c8-ac72-ec9bca440973 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:57:37.911442 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4644da1d-a425-44c8-ac72-ec9bca440973 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:57:37.911883 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4644da1d-a425-44c8-ac72-ec9bca440973 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:57:38.041336 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4644da1d-a425-44c8-ac72-ec9bca440973 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:57:38.050114 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4644da1d-a425-44c8-ac72-ec9bca440973 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/2799b992-234f-4f41-b0b5-902c64084482" status: 200 len: 1696 microversion: 2.1 time: 0.152771 Oct 04 19:57:38.050696 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4064/8142] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:57:37 2022] GET /compute/v2.1/servers/2799b992-234f-4f41-b0b5-902c64084482 => generated 1696 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:57:39.074545 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8f7e577e-7db1-4fc9-9326-7109abf15c37 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:57:39.075595 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8f7e577e-7db1-4fc9-9326-7109abf15c37 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 2799b992-234f-4f41-b0b5-902c64084482] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:57:39.083037 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8f7e577e-7db1-4fc9-9326-7109abf15c37 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:57:39.083522 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8f7e577e-7db1-4fc9-9326-7109abf15c37 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:57:39.083962 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8f7e577e-7db1-4fc9-9326-7109abf15c37 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:57:39.084677 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8f7e577e-7db1-4fc9-9326-7109abf15c37 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:57:39.085159 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8f7e577e-7db1-4fc9-9326-7109abf15c37 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:57:39.085581 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8f7e577e-7db1-4fc9-9326-7109abf15c37 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:57:39.220800 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8f7e577e-7db1-4fc9-9326-7109abf15c37 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:57:39.229215 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8f7e577e-7db1-4fc9-9326-7109abf15c37 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/2799b992-234f-4f41-b0b5-902c64084482" status: 200 len: 1696 microversion: 2.1 time: 0.158653 Oct 04 19:57:39.229908 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4079/8143] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:57:39 2022] GET /compute/v2.1/servers/2799b992-234f-4f41-b0b5-902c64084482 => generated 1696 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:57:40.253463 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4b7316b3-fe67-458f-80a3-dc07a2a56073 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:57:40.254045 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4b7316b3-fe67-458f-80a3-dc07a2a56073 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 2799b992-234f-4f41-b0b5-902c64084482] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:57:40.261133 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4b7316b3-fe67-458f-80a3-dc07a2a56073 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:57:40.261640 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4b7316b3-fe67-458f-80a3-dc07a2a56073 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:57:40.262094 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4b7316b3-fe67-458f-80a3-dc07a2a56073 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:57:40.263838 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4b7316b3-fe67-458f-80a3-dc07a2a56073 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:57:40.264340 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4b7316b3-fe67-458f-80a3-dc07a2a56073 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:57:40.264792 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4b7316b3-fe67-458f-80a3-dc07a2a56073 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:57:40.397982 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4b7316b3-fe67-458f-80a3-dc07a2a56073 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:57:40.406805 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4b7316b3-fe67-458f-80a3-dc07a2a56073 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/2799b992-234f-4f41-b0b5-902c64084482" status: 200 len: 1696 microversion: 2.1 time: 0.157489 Oct 04 19:57:40.412311 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4065/8144] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:57:40 2022] GET /compute/v2.1/servers/2799b992-234f-4f41-b0b5-902c64084482 => generated 1696 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:57:41.430523 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5770a048-1b28-4312-a33b-a2a81b30fa6c tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:57:41.431087 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5770a048-1b28-4312-a33b-a2a81b30fa6c tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 2799b992-234f-4f41-b0b5-902c64084482] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:57:41.438202 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5770a048-1b28-4312-a33b-a2a81b30fa6c tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:57:41.438696 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5770a048-1b28-4312-a33b-a2a81b30fa6c tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:57:41.439139 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5770a048-1b28-4312-a33b-a2a81b30fa6c tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:57:41.439836 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5770a048-1b28-4312-a33b-a2a81b30fa6c tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:57:41.440326 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5770a048-1b28-4312-a33b-a2a81b30fa6c tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:57:41.440765 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5770a048-1b28-4312-a33b-a2a81b30fa6c tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:57:41.571917 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5770a048-1b28-4312-a33b-a2a81b30fa6c tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:57:41.579613 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5770a048-1b28-4312-a33b-a2a81b30fa6c tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/2799b992-234f-4f41-b0b5-902c64084482" status: 200 len: 1696 microversion: 2.1 time: 0.153124 Oct 04 19:57:41.580255 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4080/8145] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:57:41 2022] GET /compute/v2.1/servers/2799b992-234f-4f41-b0b5-902c64084482 => generated 1696 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:57:42.604664 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d3894922-baba-4613-b0c4-d33583842bc8 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:57:42.605281 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d3894922-baba-4613-b0c4-d33583842bc8 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 2799b992-234f-4f41-b0b5-902c64084482] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:57:42.613167 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d3894922-baba-4613-b0c4-d33583842bc8 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:57:42.617890 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d3894922-baba-4613-b0c4-d33583842bc8 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:57:42.617890 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d3894922-baba-4613-b0c4-d33583842bc8 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:57:42.617890 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d3894922-baba-4613-b0c4-d33583842bc8 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:57:42.617890 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d3894922-baba-4613-b0c4-d33583842bc8 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:57:42.617890 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d3894922-baba-4613-b0c4-d33583842bc8 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:57:42.753593 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d3894922-baba-4613-b0c4-d33583842bc8 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:57:42.761614 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d3894922-baba-4613-b0c4-d33583842bc8 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/2799b992-234f-4f41-b0b5-902c64084482" status: 200 len: 1696 microversion: 2.1 time: 0.161199 Oct 04 19:57:42.762195 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4066/8146] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:57:42 2022] GET /compute/v2.1/servers/2799b992-234f-4f41-b0b5-902c64084482 => generated 1696 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:57:43.785447 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-92bacd5e-53ca-4b91-b769-66362bce2f12 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:57:43.786063 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-92bacd5e-53ca-4b91-b769-66362bce2f12 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 2799b992-234f-4f41-b0b5-902c64084482] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:57:43.793531 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-92bacd5e-53ca-4b91-b769-66362bce2f12 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:57:43.793762 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-92bacd5e-53ca-4b91-b769-66362bce2f12 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:57:43.794299 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-92bacd5e-53ca-4b91-b769-66362bce2f12 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:57:43.795015 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-92bacd5e-53ca-4b91-b769-66362bce2f12 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:57:43.795481 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-92bacd5e-53ca-4b91-b769-66362bce2f12 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:57:43.795915 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-92bacd5e-53ca-4b91-b769-66362bce2f12 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:57:43.938442 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-92bacd5e-53ca-4b91-b769-66362bce2f12 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:57:43.946193 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-92bacd5e-53ca-4b91-b769-66362bce2f12 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/2799b992-234f-4f41-b0b5-902c64084482" status: 200 len: 1695 microversion: 2.1 time: 0.164677 Oct 04 19:57:43.946769 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4081/8147] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:57:43 2022] GET /compute/v2.1/servers/2799b992-234f-4f41-b0b5-902c64084482 => generated 1695 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:57:44.312744 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-6a54dcd2-4e61-4f6d-806c-81dd83853631 req-0bf5d477-7416-4b85-acb1-a16fae2b7e7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2799b992-234f-4f41-b0b5-902c64084482", "name": "network-vif-unplugged", "status": "completed", "tag": "6befd1ff-c1b5-4676-8121-ba31258580f6"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:57:44.322409 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-6a54dcd2-4e61-4f6d-806c-81dd83853631 req-0bf5d477-7416-4b85-acb1-a16fae2b7e7f service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:57:44.322907 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-6a54dcd2-4e61-4f6d-806c-81dd83853631 req-0bf5d477-7416-4b85-acb1-a16fae2b7e7f service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:57:44.323353 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-6a54dcd2-4e61-4f6d-806c-81dd83853631 req-0bf5d477-7416-4b85-acb1-a16fae2b7e7f service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:57:44.339103 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-6a54dcd2-4e61-4f6d-806c-81dd83853631 req-0bf5d477-7416-4b85-acb1-a16fae2b7e7f service nova] Creating event network-vif-unplugged:6befd1ff-c1b5-4676-8121-ba31258580f6 for instance 2799b992-234f-4f41-b0b5-902c64084482 on n-h2-850501-14 Oct 04 19:57:44.342559 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [req-6a54dcd2-4e61-4f6d-806c-81dd83853631 req-0bf5d477-7416-4b85-acb1-a16fae2b7e7f service nova] Instance 2799b992-234f-4f41-b0b5-902c64084482 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850501-14', 'n-h2-850501-14'} {{(pid=123002) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:57:44.354156 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-6a54dcd2-4e61-4f6d-806c-81dd83853631 req-0bf5d477-7416-4b85-acb1-a16fae2b7e7f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.112419 Oct 04 19:57:44.354842 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4067/8148] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:57:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:57:44.971053 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-fbfadda8-ea0f-4531-ac9a-2b858e31a28d tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:57:44.971657 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-fbfadda8-ea0f-4531-ac9a-2b858e31a28d tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 2799b992-234f-4f41-b0b5-902c64084482] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:57:44.978764 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fbfadda8-ea0f-4531-ac9a-2b858e31a28d tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:57:44.979296 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fbfadda8-ea0f-4531-ac9a-2b858e31a28d tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:57:44.979817 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fbfadda8-ea0f-4531-ac9a-2b858e31a28d tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:57:44.980551 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fbfadda8-ea0f-4531-ac9a-2b858e31a28d tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:57:44.982015 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fbfadda8-ea0f-4531-ac9a-2b858e31a28d tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:57:44.987236 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fbfadda8-ea0f-4531-ac9a-2b858e31a28d tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:57:45.125082 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-fbfadda8-ea0f-4531-ac9a-2b858e31a28d tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:57:45.133272 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-fbfadda8-ea0f-4531-ac9a-2b858e31a28d tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/2799b992-234f-4f41-b0b5-902c64084482" status: 200 len: 1695 microversion: 2.1 time: 0.166106 Oct 04 19:57:45.133754 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4082/8149] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:57:44 2022] GET /compute/v2.1/servers/2799b992-234f-4f41-b0b5-902c64084482 => generated 1695 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:57:46.159369 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0481be14-6a5d-4ad2-b323-78c16f81c347 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:57:46.160111 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0481be14-6a5d-4ad2-b323-78c16f81c347 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 2799b992-234f-4f41-b0b5-902c64084482] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:57:46.166301 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0481be14-6a5d-4ad2-b323-78c16f81c347 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:57:46.166804 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0481be14-6a5d-4ad2-b323-78c16f81c347 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:57:46.167257 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0481be14-6a5d-4ad2-b323-78c16f81c347 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:57:46.167962 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0481be14-6a5d-4ad2-b323-78c16f81c347 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:57:46.168465 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0481be14-6a5d-4ad2-b323-78c16f81c347 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:57:46.170093 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0481be14-6a5d-4ad2-b323-78c16f81c347 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:57:46.304121 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0481be14-6a5d-4ad2-b323-78c16f81c347 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:57:46.312174 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0481be14-6a5d-4ad2-b323-78c16f81c347 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/2799b992-234f-4f41-b0b5-902c64084482" status: 200 len: 1693 microversion: 2.1 time: 0.158973 Oct 04 19:57:46.312756 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4068/8150] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:57:46 2022] GET /compute/v2.1/servers/2799b992-234f-4f41-b0b5-902c64084482 => generated 1693 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:57:46.374695 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-db808ae3-326b-4653-aa74-66eca3231c43 req-8f2368f5-c23d-49af-8e44-d60184d56473 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2799b992-234f-4f41-b0b5-902c64084482", "tag": "6befd1ff-c1b5-4676-8121-ba31258580f6"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:57:46.383993 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-db808ae3-326b-4653-aa74-66eca3231c43 req-8f2368f5-c23d-49af-8e44-d60184d56473 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:57:46.384508 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-db808ae3-326b-4653-aa74-66eca3231c43 req-8f2368f5-c23d-49af-8e44-d60184d56473 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:57:46.384946 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-db808ae3-326b-4653-aa74-66eca3231c43 req-8f2368f5-c23d-49af-8e44-d60184d56473 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:57:46.397050 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-db808ae3-326b-4653-aa74-66eca3231c43 req-8f2368f5-c23d-49af-8e44-d60184d56473 service nova] Creating event network-changed:6befd1ff-c1b5-4676-8121-ba31258580f6 for instance 2799b992-234f-4f41-b0b5-902c64084482 on n-h2-850501-14 Oct 04 19:57:46.402296 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [req-db808ae3-326b-4653-aa74-66eca3231c43 req-8f2368f5-c23d-49af-8e44-d60184d56473 service nova] Instance 2799b992-234f-4f41-b0b5-902c64084482 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850501-14', 'n-h2-850501-14'} {{(pid=123001) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:57:46.414924 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-db808ae3-326b-4653-aa74-66eca3231c43 req-8f2368f5-c23d-49af-8e44-d60184d56473 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044245 Oct 04 19:57:46.415455 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4083/8151] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:57:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:57:47.336363 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-30f8f5fb-a8b4-4612-a3a0-d4b387a18f7b tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:57:47.337001 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-30f8f5fb-a8b4-4612-a3a0-d4b387a18f7b tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 2799b992-234f-4f41-b0b5-902c64084482] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:57:47.344630 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-30f8f5fb-a8b4-4612-a3a0-d4b387a18f7b tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:57:47.345075 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-30f8f5fb-a8b4-4612-a3a0-d4b387a18f7b tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:57:47.345655 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-30f8f5fb-a8b4-4612-a3a0-d4b387a18f7b tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:57:47.346373 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-30f8f5fb-a8b4-4612-a3a0-d4b387a18f7b tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:57:47.346937 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-30f8f5fb-a8b4-4612-a3a0-d4b387a18f7b tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:57:47.347388 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-30f8f5fb-a8b4-4612-a3a0-d4b387a18f7b tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:57:47.485380 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-30f8f5fb-a8b4-4612-a3a0-d4b387a18f7b tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:57:47.493285 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-30f8f5fb-a8b4-4612-a3a0-d4b387a18f7b tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/2799b992-234f-4f41-b0b5-902c64084482" status: 200 len: 1693 microversion: 2.1 time: 0.161033 Oct 04 19:57:47.493898 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4069/8152] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:57:47 2022] GET /compute/v2.1/servers/2799b992-234f-4f41-b0b5-902c64084482 => generated 1693 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:57:48.518776 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ec7c407a-9096-428e-81b3-8a950684ed48 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:57:48.519483 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ec7c407a-9096-428e-81b3-8a950684ed48 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 2799b992-234f-4f41-b0b5-902c64084482] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:57:48.526606 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec7c407a-9096-428e-81b3-8a950684ed48 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:57:48.527092 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec7c407a-9096-428e-81b3-8a950684ed48 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:57:48.527532 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec7c407a-9096-428e-81b3-8a950684ed48 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:57:48.528274 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec7c407a-9096-428e-81b3-8a950684ed48 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:57:48.528732 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec7c407a-9096-428e-81b3-8a950684ed48 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:57:48.529157 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ec7c407a-9096-428e-81b3-8a950684ed48 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:57:48.661106 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ec7c407a-9096-428e-81b3-8a950684ed48 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:57:48.668884 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ec7c407a-9096-428e-81b3-8a950684ed48 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/2799b992-234f-4f41-b0b5-902c64084482" status: 200 len: 1693 microversion: 2.1 time: 0.154865 Oct 04 19:57:48.669459 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4084/8153] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:57:48 2022] GET /compute/v2.1/servers/2799b992-234f-4f41-b0b5-902c64084482 => generated 1693 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:57:49.692624 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a9f37cc5-84f3-4f0f-ac5b-b02f0a237de3 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:57:49.693401 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a9f37cc5-84f3-4f0f-ac5b-b02f0a237de3 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 2799b992-234f-4f41-b0b5-902c64084482] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:57:49.700319 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a9f37cc5-84f3-4f0f-ac5b-b02f0a237de3 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:57:49.700831 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a9f37cc5-84f3-4f0f-ac5b-b02f0a237de3 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:57:49.701296 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a9f37cc5-84f3-4f0f-ac5b-b02f0a237de3 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:57:49.702017 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a9f37cc5-84f3-4f0f-ac5b-b02f0a237de3 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:57:49.702497 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a9f37cc5-84f3-4f0f-ac5b-b02f0a237de3 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:57:49.702953 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a9f37cc5-84f3-4f0f-ac5b-b02f0a237de3 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:57:49.845986 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a9f37cc5-84f3-4f0f-ac5b-b02f0a237de3 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:57:49.854034 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a9f37cc5-84f3-4f0f-ac5b-b02f0a237de3 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/2799b992-234f-4f41-b0b5-902c64084482" status: 200 len: 1690 microversion: 2.1 time: 0.165431 Oct 04 19:57:49.854629 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4070/8154] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:57:49 2022] GET /compute/v2.1/servers/2799b992-234f-4f41-b0b5-902c64084482 => generated 1690 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:57:49.877741 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-cb8637f4-b341-4727-a8a5-ec191477d1ef tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:57:49.878287 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-cb8637f4-b341-4727-a8a5-ec191477d1ef tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 2799b992-234f-4f41-b0b5-902c64084482] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:57:49.885234 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cb8637f4-b341-4727-a8a5-ec191477d1ef tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:57:49.885725 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cb8637f4-b341-4727-a8a5-ec191477d1ef tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:57:49.886173 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cb8637f4-b341-4727-a8a5-ec191477d1ef tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:57:49.886869 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cb8637f4-b341-4727-a8a5-ec191477d1ef tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:57:49.887330 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cb8637f4-b341-4727-a8a5-ec191477d1ef tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:57:49.887761 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cb8637f4-b341-4727-a8a5-ec191477d1ef tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:57:50.074548 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-cb8637f4-b341-4727-a8a5-ec191477d1ef tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "POST /compute/v2.1/servers/2799b992-234f-4f41-b0b5-902c64084482/action" status: 204 len: 0 microversion: 2.1 time: 0.200578 Oct 04 19:57:50.075204 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4085/8155] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 19:57:49 2022] POST /compute/v2.1/servers/2799b992-234f-4f41-b0b5-902c64084482/action => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:57:50.085521 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6af89b2d-89fe-4d19-8a73-faa71bda0ae5 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:57:50.088964 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-6af89b2d-89fe-4d19-8a73-faa71bda0ae5 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 2799b992-234f-4f41-b0b5-902c64084482] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:57:50.093964 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6af89b2d-89fe-4d19-8a73-faa71bda0ae5 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:57:50.094407 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6af89b2d-89fe-4d19-8a73-faa71bda0ae5 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:57:50.094857 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6af89b2d-89fe-4d19-8a73-faa71bda0ae5 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:57:50.095579 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6af89b2d-89fe-4d19-8a73-faa71bda0ae5 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:57:50.096046 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6af89b2d-89fe-4d19-8a73-faa71bda0ae5 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:57:50.096508 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6af89b2d-89fe-4d19-8a73-faa71bda0ae5 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:57:50.260089 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-6af89b2d-89fe-4d19-8a73-faa71bda0ae5 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:57:50.267982 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6af89b2d-89fe-4d19-8a73-faa71bda0ae5 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/2799b992-234f-4f41-b0b5-902c64084482" status: 200 len: 1690 microversion: 2.1 time: 0.188488 Oct 04 19:57:50.268599 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4071/8156] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:57:50 2022] GET /compute/v2.1/servers/2799b992-234f-4f41-b0b5-902c64084482 => generated 1690 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:57:50.291719 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3a919bba-cc3b-4803-bd82-7732951ccf7c tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:57:50.292708 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3a919bba-cc3b-4803-bd82-7732951ccf7c tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 2799b992-234f-4f41-b0b5-902c64084482] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:57:50.299056 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3a919bba-cc3b-4803-bd82-7732951ccf7c tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:57:50.299710 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3a919bba-cc3b-4803-bd82-7732951ccf7c tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:57:50.300188 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3a919bba-cc3b-4803-bd82-7732951ccf7c tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:57:50.300897 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3a919bba-cc3b-4803-bd82-7732951ccf7c tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:57:50.301353 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3a919bba-cc3b-4803-bd82-7732951ccf7c tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:57:50.301782 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3a919bba-cc3b-4803-bd82-7732951ccf7c tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:57:50.474066 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3a919bba-cc3b-4803-bd82-7732951ccf7c tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:57:50.482319 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3a919bba-cc3b-4803-bd82-7732951ccf7c tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/2799b992-234f-4f41-b0b5-902c64084482" status: 200 len: 1690 microversion: 2.1 time: 0.195022 Oct 04 19:57:50.482894 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4086/8157] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:57:50 2022] GET /compute/v2.1/servers/2799b992-234f-4f41-b0b5-902c64084482 => generated 1690 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:57:51.113071 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-b67fee0c-4746-44e1-b01d-ad781ad1a4b3 req-1ae3fd59-d1c3-4772-8219-55c53da65cde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2799b992-234f-4f41-b0b5-902c64084482", "name": "network-vif-plugged", "status": "completed", "tag": "6befd1ff-c1b5-4676-8121-ba31258580f6"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:57:51.126281 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-b67fee0c-4746-44e1-b01d-ad781ad1a4b3 req-1ae3fd59-d1c3-4772-8219-55c53da65cde service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:57:51.126783 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-b67fee0c-4746-44e1-b01d-ad781ad1a4b3 req-1ae3fd59-d1c3-4772-8219-55c53da65cde service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:57:51.127234 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-b67fee0c-4746-44e1-b01d-ad781ad1a4b3 req-1ae3fd59-d1c3-4772-8219-55c53da65cde service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:57:51.146486 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-b67fee0c-4746-44e1-b01d-ad781ad1a4b3 req-1ae3fd59-d1c3-4772-8219-55c53da65cde service nova] Creating event network-vif-plugged:6befd1ff-c1b5-4676-8121-ba31258580f6 for instance 2799b992-234f-4f41-b0b5-902c64084482 on n-h2-850501-14 Oct 04 19:57:51.149446 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [req-b67fee0c-4746-44e1-b01d-ad781ad1a4b3 req-1ae3fd59-d1c3-4772-8219-55c53da65cde service nova] Instance 2799b992-234f-4f41-b0b5-902c64084482 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850501-14', 'n-h2-850501-14'} {{(pid=123002) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:57:51.161196 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-b67fee0c-4746-44e1-b01d-ad781ad1a4b3 req-1ae3fd59-d1c3-4772-8219-55c53da65cde service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052917 Oct 04 19:57:51.161942 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4072/8158] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:57:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:57:51.508581 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d39a6035-0c52-47d6-9bac-b5b66890ef31 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:57:51.509140 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d39a6035-0c52-47d6-9bac-b5b66890ef31 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 2799b992-234f-4f41-b0b5-902c64084482] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:57:51.517050 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d39a6035-0c52-47d6-9bac-b5b66890ef31 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:57:51.517576 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d39a6035-0c52-47d6-9bac-b5b66890ef31 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:57:51.518019 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d39a6035-0c52-47d6-9bac-b5b66890ef31 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:57:51.518727 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d39a6035-0c52-47d6-9bac-b5b66890ef31 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:57:51.519192 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d39a6035-0c52-47d6-9bac-b5b66890ef31 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:57:51.519623 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d39a6035-0c52-47d6-9bac-b5b66890ef31 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:57:51.658991 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d39a6035-0c52-47d6-9bac-b5b66890ef31 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:57:51.667068 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d39a6035-0c52-47d6-9bac-b5b66890ef31 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/2799b992-234f-4f41-b0b5-902c64084482" status: 200 len: 1690 microversion: 2.1 time: 0.162656 Oct 04 19:57:51.667637 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4087/8159] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:57:51 2022] GET /compute/v2.1/servers/2799b992-234f-4f41-b0b5-902c64084482 => generated 1690 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:57:52.692417 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-bd2706ea-15b1-4e1e-9422-c3362527cd0a tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:57:52.693145 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-bd2706ea-15b1-4e1e-9422-c3362527cd0a tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 2799b992-234f-4f41-b0b5-902c64084482] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:57:52.699323 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bd2706ea-15b1-4e1e-9422-c3362527cd0a tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:57:52.699830 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bd2706ea-15b1-4e1e-9422-c3362527cd0a tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:57:52.700316 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bd2706ea-15b1-4e1e-9422-c3362527cd0a tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:57:52.701122 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bd2706ea-15b1-4e1e-9422-c3362527cd0a tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:57:52.701552 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bd2706ea-15b1-4e1e-9422-c3362527cd0a tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:57:52.702000 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bd2706ea-15b1-4e1e-9422-c3362527cd0a tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:57:52.841080 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-bd2706ea-15b1-4e1e-9422-c3362527cd0a tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:57:52.846135 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-bd2706ea-15b1-4e1e-9422-c3362527cd0a tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/2799b992-234f-4f41-b0b5-902c64084482" status: 200 len: 1682 microversion: 2.1 time: 0.159101 Oct 04 19:57:52.846721 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4073/8160] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:57:52 2022] GET /compute/v2.1/servers/2799b992-234f-4f41-b0b5-902c64084482 => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:58:21.067527 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-adef314d-4735-4f7d-b3e7-34744d041955 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:58:21.069720 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-adef314d-4735-4f7d-b3e7-34744d041955 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 2799b992-234f-4f41-b0b5-902c64084482] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:58:21.072114 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=32 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:58:21.072932 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:58:21.078982 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-adef314d-4735-4f7d-b3e7-34744d041955 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:21.082675 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-adef314d-4735-4f7d-b3e7-34744d041955 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:21.082675 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-adef314d-4735-4f7d-b3e7-34744d041955 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:21.082675 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-adef314d-4735-4f7d-b3e7-34744d041955 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:21.082675 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-adef314d-4735-4f7d-b3e7-34744d041955 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:21.082675 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-adef314d-4735-4f7d-b3e7-34744d041955 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:21.151473 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-adef314d-4735-4f7d-b3e7-34744d041955 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "POST /compute/v2.1/servers/2799b992-234f-4f41-b0b5-902c64084482/action" status: 200 len: 24577 microversion: 2.1 time: 0.087770 Oct 04 19:58:21.152345 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4088/8161] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 19:58:21 2022] POST /compute/v2.1/servers/2799b992-234f-4f41-b0b5-902c64084482/action => generated 24577 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:58:38.876421 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-248b4b22-7cfe-4439-a833-afb1e506131c tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:58:38.876971 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-248b4b22-7cfe-4439-a833-afb1e506131c tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 2799b992-234f-4f41-b0b5-902c64084482] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:58:38.879498 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=28 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:58:38.885399 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-61ac0fa4-62cf-409f-8bab-0685101bb107 req-0ffc012b-40d5-4f92-b913-1989524ca491 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2799b992-234f-4f41-b0b5-902c64084482", "tag": "6befd1ff-c1b5-4676-8121-ba31258580f6"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:58:38.891345 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=80 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:58:38.892227 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:58:38.898381 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-248b4b22-7cfe-4439-a833-afb1e506131c tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:38.898895 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-248b4b22-7cfe-4439-a833-afb1e506131c tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:38.899346 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-248b4b22-7cfe-4439-a833-afb1e506131c tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:38.900087 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-248b4b22-7cfe-4439-a833-afb1e506131c tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:38.900570 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-248b4b22-7cfe-4439-a833-afb1e506131c tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:38.901015 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-248b4b22-7cfe-4439-a833-afb1e506131c tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:38.902163 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-61ac0fa4-62cf-409f-8bab-0685101bb107 req-0ffc012b-40d5-4f92-b913-1989524ca491 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:38.902642 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-61ac0fa4-62cf-409f-8bab-0685101bb107 req-0ffc012b-40d5-4f92-b913-1989524ca491 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:38.903064 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-61ac0fa4-62cf-409f-8bab-0685101bb107 req-0ffc012b-40d5-4f92-b913-1989524ca491 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:38.914530 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-61ac0fa4-62cf-409f-8bab-0685101bb107 req-0ffc012b-40d5-4f92-b913-1989524ca491 service nova] Creating event network-changed:6befd1ff-c1b5-4676-8121-ba31258580f6 for instance 2799b992-234f-4f41-b0b5-902c64084482 on n-h2-850501-14 Oct 04 19:58:38.919792 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-61ac0fa4-62cf-409f-8bab-0685101bb107 req-0ffc012b-40d5-4f92-b913-1989524ca491 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038138 Oct 04 19:58:38.920624 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4089/8162] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:58:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:58:38.929607 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-248b4b22-7cfe-4439-a833-afb1e506131c tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 2799b992-234f-4f41-b0b5-902c64084482] Going to try to terminate instance {{(pid=123002) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:58:39.308929 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-248b4b22-7cfe-4439-a833-afb1e506131c tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2799b992-234f-4f41-b0b5-902c64084482" status: 204 len: 0 microversion: 2.1 time: 0.436684 Oct 04 19:58:39.309682 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4074/8163] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 19:58:38 2022] DELETE /compute/v2.1/servers/2799b992-234f-4f41-b0b5-902c64084482 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 19:58:39.319609 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-50bcb471-516e-48a6-9efa-82f269ac9acd tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:58:39.320345 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-50bcb471-516e-48a6-9efa-82f269ac9acd tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 2799b992-234f-4f41-b0b5-902c64084482] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:58:39.327542 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-50bcb471-516e-48a6-9efa-82f269ac9acd tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:39.328036 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-50bcb471-516e-48a6-9efa-82f269ac9acd tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:39.328643 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-50bcb471-516e-48a6-9efa-82f269ac9acd tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:39.329295 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-50bcb471-516e-48a6-9efa-82f269ac9acd tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:39.329767 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-50bcb471-516e-48a6-9efa-82f269ac9acd tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:39.330200 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-50bcb471-516e-48a6-9efa-82f269ac9acd tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:39.494720 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-50bcb471-516e-48a6-9efa-82f269ac9acd tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:58:39.503214 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-50bcb471-516e-48a6-9efa-82f269ac9acd tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/2799b992-234f-4f41-b0b5-902c64084482" status: 200 len: 1688 microversion: 2.1 time: 0.188258 Oct 04 19:58:39.503793 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4090/8164] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:58:39 2022] GET /compute/v2.1/servers/2799b992-234f-4f41-b0b5-902c64084482 => generated 1688 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:58:40.529616 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a7a61d5d-f355-4182-949c-22b5429f1935 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:58:40.530458 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a7a61d5d-f355-4182-949c-22b5429f1935 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 2799b992-234f-4f41-b0b5-902c64084482] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:58:40.537407 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a7a61d5d-f355-4182-949c-22b5429f1935 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:40.537908 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a7a61d5d-f355-4182-949c-22b5429f1935 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:40.538413 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a7a61d5d-f355-4182-949c-22b5429f1935 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:40.539126 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a7a61d5d-f355-4182-949c-22b5429f1935 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:40.539595 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a7a61d5d-f355-4182-949c-22b5429f1935 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:40.540039 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a7a61d5d-f355-4182-949c-22b5429f1935 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:40.675278 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a7a61d5d-f355-4182-949c-22b5429f1935 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:58:40.683120 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a7a61d5d-f355-4182-949c-22b5429f1935 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/2799b992-234f-4f41-b0b5-902c64084482" status: 200 len: 1688 microversion: 2.1 time: 0.158315 Oct 04 19:58:40.683704 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4075/8165] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:58:40 2022] GET /compute/v2.1/servers/2799b992-234f-4f41-b0b5-902c64084482 => generated 1688 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:58:41.552866 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-275f1bb6-aaac-49a0-9de2-07b0a3a6ff73 req-ef5b7f16-de96-4e28-8f73-6ce276b7f24c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2799b992-234f-4f41-b0b5-902c64084482", "name": "network-vif-deleted", "tag": "6befd1ff-c1b5-4676-8121-ba31258580f6"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:58:41.563207 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-275f1bb6-aaac-49a0-9de2-07b0a3a6ff73 req-ef5b7f16-de96-4e28-8f73-6ce276b7f24c service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:41.563684 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-275f1bb6-aaac-49a0-9de2-07b0a3a6ff73 req-ef5b7f16-de96-4e28-8f73-6ce276b7f24c service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:41.564134 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-275f1bb6-aaac-49a0-9de2-07b0a3a6ff73 req-ef5b7f16-de96-4e28-8f73-6ce276b7f24c service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:41.575206 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-275f1bb6-aaac-49a0-9de2-07b0a3a6ff73 req-ef5b7f16-de96-4e28-8f73-6ce276b7f24c service nova] Creating event network-vif-deleted:6befd1ff-c1b5-4676-8121-ba31258580f6 for instance 2799b992-234f-4f41-b0b5-902c64084482 on n-h2-850501-14 Oct 04 19:58:41.580790 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-275f1bb6-aaac-49a0-9de2-07b0a3a6ff73 req-ef5b7f16-de96-4e28-8f73-6ce276b7f24c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031807 Oct 04 19:58:41.581376 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4091/8166] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:58:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:58:41.708402 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-eb29879f-c534-41d6-844a-aef9d02eae08 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:58:41.709161 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-eb29879f-c534-41d6-844a-aef9d02eae08 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 2799b992-234f-4f41-b0b5-902c64084482] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:58:41.716342 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eb29879f-c534-41d6-844a-aef9d02eae08 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:41.717488 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eb29879f-c534-41d6-844a-aef9d02eae08 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:41.717989 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eb29879f-c534-41d6-844a-aef9d02eae08 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:41.718704 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eb29879f-c534-41d6-844a-aef9d02eae08 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:41.719177 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eb29879f-c534-41d6-844a-aef9d02eae08 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:41.719608 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eb29879f-c534-41d6-844a-aef9d02eae08 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:41.786863 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-eb29879f-c534-41d6-844a-aef9d02eae08 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:58:41.794780 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-eb29879f-c534-41d6-844a-aef9d02eae08 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/2799b992-234f-4f41-b0b5-902c64084482" status: 200 len: 1351 microversion: 2.1 time: 0.091020 Oct 04 19:58:41.795401 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4076/8167] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:58:41 2022] GET /compute/v2.1/servers/2799b992-234f-4f41-b0b5-902c64084482 => generated 1351 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:58:42.819839 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b8ab25f3-76ba-43ea-b6e4-a8d35eab5d01 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:58:42.820570 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b8ab25f3-76ba-43ea-b6e4-a8d35eab5d01 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 2799b992-234f-4f41-b0b5-902c64084482] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:58:42.827119 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b8ab25f3-76ba-43ea-b6e4-a8d35eab5d01 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:42.827596 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b8ab25f3-76ba-43ea-b6e4-a8d35eab5d01 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:42.828808 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b8ab25f3-76ba-43ea-b6e4-a8d35eab5d01 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:42.829531 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b8ab25f3-76ba-43ea-b6e4-a8d35eab5d01 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:42.830323 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b8ab25f3-76ba-43ea-b6e4-a8d35eab5d01 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:42.830758 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b8ab25f3-76ba-43ea-b6e4-a8d35eab5d01 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:42.844767 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-b8ab25f3-76ba-43ea-b6e4-a8d35eab5d01 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] HTTP exception thrown: Instance 2799b992-234f-4f41-b0b5-902c64084482 could not be found. Oct 04 19:58:42.846414 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b8ab25f3-76ba-43ea-b6e4-a8d35eab5d01 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Request method failure captured: Oct 04 19:58:42.846414 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/2799b992-234f-4f41-b0b5-902c64084482 HTTP/1.1 Oct 04 19:58:42.846414 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 19:58:42.846414 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 19:58:42.846414 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 19:58:42.846414 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 19:58:42.846414 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 19:58:42.846414 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 19:58:42.846414 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 19:58:42.846414 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 19:58:42.846414 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPI88jPqPFF3foNds79FcB9aFEPQ4j2aE77udaYKTwax2C5JHCysGdgy0FMgNwDOy13EsNaR0GwTaNiwC4DOXbgoj1xNuPI5o717aLLx16xkDOI9Y9C18IHU35Ip47q038B2FBqXcNSHdcfF09wzWairlH5Vr7NhdGSOsyjDGcd-usGY Oct 04 19:58:42.846414 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 19:58:42.846414 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 19:58:42.846414 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 19:58:42.846414 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 19:58:42.846414 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 19:58:42.846414 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 19:58:42.846414 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 7112e2b246a44297876ee6d279e8f655 Oct 04 19:58:42.846414 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1045305417 Oct 04 19:58:42.846414 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 19:58:42.846414 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 19:58:42.846414 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7112e2b246a44297876ee6d279e8f655"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7112e2b246a44297876ee6d279e8f655", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7112e2b246a44297876ee6d279e8f655"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7112e2b246a44297876ee6d279e8f655"}]}] Oct 04 19:58:42.846414 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1045305417 Oct 04 19:58:42.846414 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 7112e2b246a44297876ee6d279e8f655 Oct 04 19:58:42.846414 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1045305417 Oct 04 19:58:42.846414 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-TestNetworkAdvancedServerOps-1045305417-project Oct 04 19:58:42.846414 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 19:58:42.846414 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 19:58:42.846414 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: deb5459af175415da4825e6078eba908 Oct 04 19:58:42.846414 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1045305417-project Oct 04 19:58:42.846414 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 19:58:42.846414 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 2799b992-234f-4f41-b0b5-902c64084482 could not be found. Oct 04 19:58:42.846414 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '2799b992-234f-4f41-b0b5-902c64084482'} Oct 04 19:58:42.846414 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:58:42.846414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:58:42.846414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:58:42.846414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:58:42.846414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:58:42.846414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:58:42.846414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:58:42.846414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:58:42.846414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:58:42.846414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:58:42.846414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2799b992-234f-4f41-b0b5-902c64084482 could not be found. Oct 04 19:58:42.846414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:58:42.846414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:58:42.846414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:58:42.846414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:58:42.846414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:58:42.846414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:58:42.846414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:58:42.846414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:58:42.846414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:58:42.846414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:58:42.846414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:58:42.846414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:58:42.846414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:58:42.846414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:58:42.846414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:58:42.846414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:58:42.846414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2799b992-234f-4f41-b0b5-902c64084482 could not be found. Oct 04 19:58:42.846414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:58:42.846414 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:58:42.852375 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:58:42.852375 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:58:42.852375 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:58:42.852375 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:58:42.852375 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:58:42.852375 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:58:42.852375 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2799b992-234f-4f41-b0b5-902c64084482 could not be found. Oct 04 19:58:42.852375 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 19:58:42.852375 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b8ab25f3-76ba-43ea-b6e4-a8d35eab5d01 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Returning 404 to user: Instance 2799b992-234f-4f41-b0b5-902c64084482 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:58:42.852375 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b8ab25f3-76ba-43ea-b6e4-a8d35eab5d01 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/2799b992-234f-4f41-b0b5-902c64084482" status: 404 len: 111 microversion: 2.1 time: 0.033220 Oct 04 19:58:42.852375 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4092/8168] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:58:42 2022] GET /compute/v2.1/servers/2799b992-234f-4f41-b0b5-902c64084482 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:58:46.342652 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-31dfecc8-3451-40e0-b072-2f8a6789de56 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '.version_select at 0x7fe253a8c0d0>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:58:46.412335 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-31dfecc8-3451-40e0-b072-2f8a6789de56 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-570885244" status: 202 len: 0 microversion: 2.1 time: 0.074640 Oct 04 19:58:46.412972 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4077/8169] 10.222.0.20 () {58 vars in 1281 bytes} [Tue Oct 4 19:58:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-570885244 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 19:58:46.442346 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3d5d02c4-91d3-41c1-9554-b199a255cfd9 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Action: 'create', calling method: .version_select at 0x7fe253fbc160>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-470470357", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHuY7hqHg4MrApYba1oISfzby6JqCCazzb9gNPrTh0oGJC7QNH2S+7h2ZGTxHdqX9d2726gjPz3lcbqATvctxCpAoDcyi6A91M2+kbUkNxtWt/h+bIhExTxCUtmnwDa4ug=="}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:58:46.459754 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-3d5d02c4-91d3-41c1-9554-b199a255cfd9 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Getting quotas for project 7112e2b246a44297876ee6d279e8f655. Resources: {'key_pairs'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:58:46.466598 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-3d5d02c4-91d3-41c1-9554-b199a255cfd9 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Getting quotas for user deb5459af175415da4825e6078eba908 and project 7112e2b246a44297876ee6d279e8f655. Resources: {'key_pairs'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:58:46.480275 n-d-850501-14 devstack@n-api.service[123001]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3d5d02c4-91d3-41c1-9554-b199a255cfd9 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [6c8ce3ae-b440-4b28-996b-33b11441f461] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 19:58:47.489083 n-d-850501-14 devstack@n-api.service[123001]: INFO oslo.messaging._drivers.impl_rabbit [None req-3d5d02c4-91d3-41c1-9554-b199a255cfd9 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [6c8ce3ae-b440-4b28-996b-33b11441f461] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 53966. Oct 04 19:58:47.607485 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3d5d02c4-91d3-41c1-9554-b199a255cfd9 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 1.169495 Oct 04 19:58:47.608155 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4093/8170] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Oct 4 19:58:46 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:58:56.139026 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:58:56.143461 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2e545ca2-e08c-4305-8048-f27a9ae8f047 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1650980981", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": [{"uuid": "11d59544-d956-45c4-90d7-2c4da55a362c"}], "key_name": "tempest-TestNetworkAdvancedServerOps-470470357", "security_groups": [{"name": "tempest-secgroup-smoke-834538727"}]}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:58:56.259862 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-2e545ca2-e08c-4305-8048-f27a9ae8f047 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] validate_networks() for [('11d59544-d956-45c4-90d7-2c4da55a362c', None, None, None, None, None)] {{(pid=123002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:58:56.684289 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-2e545ca2-e08c-4305-8048-f27a9ae8f047 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:58:56.686781 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-2e545ca2-e08c-4305-8048-f27a9ae8f047 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:58:56.687292 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-2e545ca2-e08c-4305-8048-f27a9ae8f047 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:58:56.687726 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-2e545ca2-e08c-4305-8048-f27a9ae8f047 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:58:56.688713 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-2e545ca2-e08c-4305-8048-f27a9ae8f047 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:58:56.698698 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e545ca2-e08c-4305-8048-f27a9ae8f047 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:56.699199 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e545ca2-e08c-4305-8048-f27a9ae8f047 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:56.700212 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e545ca2-e08c-4305-8048-f27a9ae8f047 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:56.701830 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e545ca2-e08c-4305-8048-f27a9ae8f047 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:56.702304 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e545ca2-e08c-4305-8048-f27a9ae8f047 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:56.702942 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2e545ca2-e08c-4305-8048-f27a9ae8f047 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:56.725506 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-2e545ca2-e08c-4305-8048-f27a9ae8f047 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Getting quotas for project 7112e2b246a44297876ee6d279e8f655. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:58:56.731810 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-2e545ca2-e08c-4305-8048-f27a9ae8f047 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Getting quotas for user deb5459af175415da4825e6078eba908 and project 7112e2b246a44297876ee6d279e8f655. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:58:56.748006 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2e545ca2-e08c-4305-8048-f27a9ae8f047 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Going to run 1 instances... {{(pid=123002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:58:56.750409 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2e545ca2-e08c-4305-8048-f27a9ae8f047 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 3a4d67cf-1eb8-49d5-af5f-1073711116e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:58:56.858647 n-d-850501-14 devstack@n-api.service[123002]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2e545ca2-e08c-4305-8048-f27a9ae8f047 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [dcd3de5e-bba6-4468-b8a4-2b05a921d453] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 19:58:57.867408 n-d-850501-14 devstack@n-api.service[123002]: INFO oslo.messaging._drivers.impl_rabbit [None req-2e545ca2-e08c-4305-8048-f27a9ae8f047 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [dcd3de5e-bba6-4468-b8a4-2b05a921d453] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 54014. Oct 04 19:58:57.871765 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2e545ca2-e08c-4305-8048-f27a9ae8f047 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.734658 Oct 04 19:58:57.873078 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4078/8171] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 19:58:56 2022] POST /compute/v2.1/servers => generated 405 bytes in 1737 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:58:57.882685 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=16 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:58:57.883436 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=4 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:58:57.884290 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:58:57.888493 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0fa8165b-487e-4c9f-9309-511b617b4744 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:58:57.889110 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0fa8165b-487e-4c9f-9309-511b617b4744 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 3a4d67cf-1eb8-49d5-af5f-1073711116e4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:58:57.950634 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0fa8165b-487e-4c9f-9309-511b617b4744 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:58:57.957895 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0fa8165b-487e-4c9f-9309-511b617b4744 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/3a4d67cf-1eb8-49d5-af5f-1073711116e4" status: 200 len: 1266 microversion: 2.1 time: 0.076979 Oct 04 19:58:57.960149 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4094/8172] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:58:57 2022] GET /compute/v2.1/servers/3a4d67cf-1eb8-49d5-af5f-1073711116e4 => generated 1266 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:58:58.983795 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1f6ad165-708c-4013-87b0-eb477bcde2da tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:58:58.985145 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1f6ad165-708c-4013-87b0-eb477bcde2da tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 3a4d67cf-1eb8-49d5-af5f-1073711116e4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:58:58.991764 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1f6ad165-708c-4013-87b0-eb477bcde2da tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:58.992328 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1f6ad165-708c-4013-87b0-eb477bcde2da tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:58.992786 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1f6ad165-708c-4013-87b0-eb477bcde2da tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:58.993512 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1f6ad165-708c-4013-87b0-eb477bcde2da tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:58.993989 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1f6ad165-708c-4013-87b0-eb477bcde2da tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:58.994434 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1f6ad165-708c-4013-87b0-eb477bcde2da tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:59.057817 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1f6ad165-708c-4013-87b0-eb477bcde2da tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:58:59.066743 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1f6ad165-708c-4013-87b0-eb477bcde2da tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/3a4d67cf-1eb8-49d5-af5f-1073711116e4" status: 200 len: 1262 microversion: 2.1 time: 0.087708 Oct 04 19:58:59.067352 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4079/8173] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:58:58 2022] GET /compute/v2.1/servers/3a4d67cf-1eb8-49d5-af5f-1073711116e4 => generated 1262 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:59:00.091385 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b39ea8d3-480b-42d5-99ac-d97cf2b9d466 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:59:00.092209 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b39ea8d3-480b-42d5-99ac-d97cf2b9d466 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 3a4d67cf-1eb8-49d5-af5f-1073711116e4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:59:00.099688 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b39ea8d3-480b-42d5-99ac-d97cf2b9d466 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:59:00.100236 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b39ea8d3-480b-42d5-99ac-d97cf2b9d466 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:59:00.100684 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b39ea8d3-480b-42d5-99ac-d97cf2b9d466 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:59:00.101691 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b39ea8d3-480b-42d5-99ac-d97cf2b9d466 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:59:00.102173 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b39ea8d3-480b-42d5-99ac-d97cf2b9d466 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:59:00.102586 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b39ea8d3-480b-42d5-99ac-d97cf2b9d466 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:59:00.180946 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b39ea8d3-480b-42d5-99ac-d97cf2b9d466 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:59:00.189122 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b39ea8d3-480b-42d5-99ac-d97cf2b9d466 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/3a4d67cf-1eb8-49d5-af5f-1073711116e4" status: 200 len: 1324 microversion: 2.1 time: 0.102282 Oct 04 19:59:00.189702 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4095/8174] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:59:00 2022] GET /compute/v2.1/servers/3a4d67cf-1eb8-49d5-af5f-1073711116e4 => generated 1324 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:59:01.212937 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-42180a1e-f42a-4f80-a4db-6e84d3258a37 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:59:01.213574 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-42180a1e-f42a-4f80-a4db-6e84d3258a37 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 3a4d67cf-1eb8-49d5-af5f-1073711116e4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:59:01.222450 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-42180a1e-f42a-4f80-a4db-6e84d3258a37 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:59:01.222961 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-42180a1e-f42a-4f80-a4db-6e84d3258a37 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:59:01.223417 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-42180a1e-f42a-4f80-a4db-6e84d3258a37 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:59:01.224174 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-42180a1e-f42a-4f80-a4db-6e84d3258a37 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:59:01.224648 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-42180a1e-f42a-4f80-a4db-6e84d3258a37 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:59:01.225123 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-42180a1e-f42a-4f80-a4db-6e84d3258a37 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:59:01.750943 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-42180a1e-f42a-4f80-a4db-6e84d3258a37 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:59:01.756295 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-42180a1e-f42a-4f80-a4db-6e84d3258a37 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/3a4d67cf-1eb8-49d5-af5f-1073711116e4" status: 200 len: 1391 microversion: 2.1 time: 0.547226 Oct 04 19:59:01.772082 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4080/8175] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:59:01 2022] GET /compute/v2.1/servers/3a4d67cf-1eb8-49d5-af5f-1073711116e4 => generated 1391 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:59:01.927908 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-e46a76e3-628a-4885-bffb-b800253c7557 req-7ddc1025-2143-4902-963a-6e317a1db9a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a4d67cf-1eb8-49d5-af5f-1073711116e4", "tag": "482544d1-3016-46b5-a798-d11d69fbac64"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:59:01.939490 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-e46a76e3-628a-4885-bffb-b800253c7557 req-7ddc1025-2143-4902-963a-6e317a1db9a9 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:59:01.940029 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-e46a76e3-628a-4885-bffb-b800253c7557 req-7ddc1025-2143-4902-963a-6e317a1db9a9 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:59:01.940494 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-e46a76e3-628a-4885-bffb-b800253c7557 req-7ddc1025-2143-4902-963a-6e317a1db9a9 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:59:01.952531 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-e46a76e3-628a-4885-bffb-b800253c7557 req-7ddc1025-2143-4902-963a-6e317a1db9a9 service nova] Creating event network-changed:482544d1-3016-46b5-a798-d11d69fbac64 for instance 3a4d67cf-1eb8-49d5-af5f-1073711116e4 on n-h1-850501-14 Oct 04 19:59:01.957706 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-e46a76e3-628a-4885-bffb-b800253c7557 req-7ddc1025-2143-4902-963a-6e317a1db9a9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033735 Oct 04 19:59:01.958617 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4096/8176] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:59:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:59:02.784071 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-abcabc8a-652d-48b4-8cf5-1a33719c6da5 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:59:02.784778 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-abcabc8a-652d-48b4-8cf5-1a33719c6da5 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 3a4d67cf-1eb8-49d5-af5f-1073711116e4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:59:02.791340 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-abcabc8a-652d-48b4-8cf5-1a33719c6da5 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:59:02.791841 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-abcabc8a-652d-48b4-8cf5-1a33719c6da5 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:59:02.792352 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-abcabc8a-652d-48b4-8cf5-1a33719c6da5 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:59:02.793049 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-abcabc8a-652d-48b4-8cf5-1a33719c6da5 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:59:02.799799 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-abcabc8a-652d-48b4-8cf5-1a33719c6da5 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:59:02.799799 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-abcabc8a-652d-48b4-8cf5-1a33719c6da5 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:59:02.930108 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-abcabc8a-652d-48b4-8cf5-1a33719c6da5 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:59:02.938685 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-abcabc8a-652d-48b4-8cf5-1a33719c6da5 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/3a4d67cf-1eb8-49d5-af5f-1073711116e4" status: 200 len: 1391 microversion: 2.1 time: 0.158560 Oct 04 19:59:02.939260 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4081/8177] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:59:02 2022] GET /compute/v2.1/servers/3a4d67cf-1eb8-49d5-af5f-1073711116e4 => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:59:03.962289 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ac29ab91-e2ca-4a63-8149-a69da269c288 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:59:03.962998 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ac29ab91-e2ca-4a63-8149-a69da269c288 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 3a4d67cf-1eb8-49d5-af5f-1073711116e4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:59:03.970327 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ac29ab91-e2ca-4a63-8149-a69da269c288 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:59:03.970761 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ac29ab91-e2ca-4a63-8149-a69da269c288 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:59:03.971205 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ac29ab91-e2ca-4a63-8149-a69da269c288 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:59:03.971904 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ac29ab91-e2ca-4a63-8149-a69da269c288 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:59:03.972392 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ac29ab91-e2ca-4a63-8149-a69da269c288 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:59:03.972824 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ac29ab91-e2ca-4a63-8149-a69da269c288 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:59:04.108861 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ac29ab91-e2ca-4a63-8149-a69da269c288 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:59:04.117950 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ac29ab91-e2ca-4a63-8149-a69da269c288 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/3a4d67cf-1eb8-49d5-af5f-1073711116e4" status: 200 len: 1391 microversion: 2.1 time: 0.159874 Oct 04 19:59:04.118536 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4097/8178] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:59:03 2022] GET /compute/v2.1/servers/3a4d67cf-1eb8-49d5-af5f-1073711116e4 => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:59:05.141961 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-cab47473-f1ec-4408-9390-9e7170f5d963 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:59:05.142596 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-cab47473-f1ec-4408-9390-9e7170f5d963 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 3a4d67cf-1eb8-49d5-af5f-1073711116e4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:59:05.149500 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cab47473-f1ec-4408-9390-9e7170f5d963 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:59:05.149998 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cab47473-f1ec-4408-9390-9e7170f5d963 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:59:05.150451 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cab47473-f1ec-4408-9390-9e7170f5d963 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:59:05.151178 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cab47473-f1ec-4408-9390-9e7170f5d963 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:59:05.151652 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cab47473-f1ec-4408-9390-9e7170f5d963 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:59:05.152125 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cab47473-f1ec-4408-9390-9e7170f5d963 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:59:05.289692 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-cab47473-f1ec-4408-9390-9e7170f5d963 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:59:05.297752 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-cab47473-f1ec-4408-9390-9e7170f5d963 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/3a4d67cf-1eb8-49d5-af5f-1073711116e4" status: 200 len: 1391 microversion: 2.1 time: 0.160468 Oct 04 19:59:05.298335 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4082/8179] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:59:05 2022] GET /compute/v2.1/servers/3a4d67cf-1eb8-49d5-af5f-1073711116e4 => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:59:06.320472 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1884a94c-d4ee-469f-ac90-4b7ff4cfe5d0 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:59:06.321078 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1884a94c-d4ee-469f-ac90-4b7ff4cfe5d0 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 3a4d67cf-1eb8-49d5-af5f-1073711116e4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:59:06.327818 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1884a94c-d4ee-469f-ac90-4b7ff4cfe5d0 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:59:06.328354 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1884a94c-d4ee-469f-ac90-4b7ff4cfe5d0 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:59:06.328793 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1884a94c-d4ee-469f-ac90-4b7ff4cfe5d0 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:59:06.329479 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1884a94c-d4ee-469f-ac90-4b7ff4cfe5d0 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:59:06.329931 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1884a94c-d4ee-469f-ac90-4b7ff4cfe5d0 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:59:06.330351 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1884a94c-d4ee-469f-ac90-4b7ff4cfe5d0 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:59:06.466618 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1884a94c-d4ee-469f-ac90-4b7ff4cfe5d0 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:59:06.474352 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1884a94c-d4ee-469f-ac90-4b7ff4cfe5d0 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/3a4d67cf-1eb8-49d5-af5f-1073711116e4" status: 200 len: 1391 microversion: 2.1 time: 0.157722 Oct 04 19:59:06.474928 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4098/8180] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:59:06 2022] GET /compute/v2.1/servers/3a4d67cf-1eb8-49d5-af5f-1073711116e4 => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:59:07.498961 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-428e1b92-798c-4395-bb60-cce2eab19122 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:59:07.499559 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-428e1b92-798c-4395-bb60-cce2eab19122 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 3a4d67cf-1eb8-49d5-af5f-1073711116e4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:59:07.502173 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:59:07.502934 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=6 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:59:07.507628 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-428e1b92-798c-4395-bb60-cce2eab19122 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:59:07.508150 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-428e1b92-798c-4395-bb60-cce2eab19122 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:59:07.508602 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-428e1b92-798c-4395-bb60-cce2eab19122 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:59:07.509307 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-428e1b92-798c-4395-bb60-cce2eab19122 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:59:07.509769 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-428e1b92-798c-4395-bb60-cce2eab19122 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:59:07.510207 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-428e1b92-798c-4395-bb60-cce2eab19122 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:59:07.661228 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-428e1b92-798c-4395-bb60-cce2eab19122 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:59:07.669338 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-428e1b92-798c-4395-bb60-cce2eab19122 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/3a4d67cf-1eb8-49d5-af5f-1073711116e4" status: 200 len: 1391 microversion: 2.1 time: 0.174832 Oct 04 19:59:07.669936 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4083/8181] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:59:07 2022] GET /compute/v2.1/servers/3a4d67cf-1eb8-49d5-af5f-1073711116e4 => generated 1391 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:59:07.940592 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-6ae38105-73df-497b-ba33-cb7414a152dd req-5c7fa3a9-c153-48c8-88e7-d35402331a20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a4d67cf-1eb8-49d5-af5f-1073711116e4", "name": "network-vif-plugged", "status": "completed", "tag": "482544d1-3016-46b5-a798-d11d69fbac64"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:59:07.951542 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-6ae38105-73df-497b-ba33-cb7414a152dd req-5c7fa3a9-c153-48c8-88e7-d35402331a20 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:59:07.952029 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-6ae38105-73df-497b-ba33-cb7414a152dd req-5c7fa3a9-c153-48c8-88e7-d35402331a20 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:59:07.952520 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-6ae38105-73df-497b-ba33-cb7414a152dd req-5c7fa3a9-c153-48c8-88e7-d35402331a20 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:59:07.961825 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:59:07.964256 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-6ae38105-73df-497b-ba33-cb7414a152dd req-5c7fa3a9-c153-48c8-88e7-d35402331a20 service nova] Creating event network-vif-plugged:482544d1-3016-46b5-a798-d11d69fbac64 for instance 3a4d67cf-1eb8-49d5-af5f-1073711116e4 on n-h1-850501-14 Oct 04 19:59:07.969891 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-6ae38105-73df-497b-ba33-cb7414a152dd req-5c7fa3a9-c153-48c8-88e7-d35402331a20 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084223 Oct 04 19:59:07.970495 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4099/8182] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:59:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:59:08.693128 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-354991ea-e5d1-48ac-a343-735fa0bae625 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:59:08.693756 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-354991ea-e5d1-48ac-a343-735fa0bae625 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 3a4d67cf-1eb8-49d5-af5f-1073711116e4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:59:08.701299 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-354991ea-e5d1-48ac-a343-735fa0bae625 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:59:08.701788 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-354991ea-e5d1-48ac-a343-735fa0bae625 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:59:08.702240 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-354991ea-e5d1-48ac-a343-735fa0bae625 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:59:08.702940 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-354991ea-e5d1-48ac-a343-735fa0bae625 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:59:08.703407 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-354991ea-e5d1-48ac-a343-735fa0bae625 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:59:08.703843 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-354991ea-e5d1-48ac-a343-735fa0bae625 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:59:08.842707 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-354991ea-e5d1-48ac-a343-735fa0bae625 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:59:08.850358 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-354991ea-e5d1-48ac-a343-735fa0bae625 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/3a4d67cf-1eb8-49d5-af5f-1073711116e4" status: 200 len: 1391 microversion: 2.1 time: 0.161277 Oct 04 19:59:08.850929 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4084/8183] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:59:08 2022] GET /compute/v2.1/servers/3a4d67cf-1eb8-49d5-af5f-1073711116e4 => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:59:09.875636 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-dcf2af50-19b2-46f4-b776-ad185e6f3334 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:59:09.876380 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-dcf2af50-19b2-46f4-b776-ad185e6f3334 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 3a4d67cf-1eb8-49d5-af5f-1073711116e4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:59:09.883125 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dcf2af50-19b2-46f4-b776-ad185e6f3334 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:59:09.883618 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dcf2af50-19b2-46f4-b776-ad185e6f3334 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:59:09.884072 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dcf2af50-19b2-46f4-b776-ad185e6f3334 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:59:09.884786 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dcf2af50-19b2-46f4-b776-ad185e6f3334 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:59:09.885249 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dcf2af50-19b2-46f4-b776-ad185e6f3334 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:59:09.885685 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dcf2af50-19b2-46f4-b776-ad185e6f3334 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:59:10.026587 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-dcf2af50-19b2-46f4-b776-ad185e6f3334 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:59:10.034508 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-dcf2af50-19b2-46f4-b776-ad185e6f3334 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/3a4d67cf-1eb8-49d5-af5f-1073711116e4" status: 200 len: 1563 microversion: 2.1 time: 0.164703 Oct 04 19:59:10.035080 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4100/8184] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:59:09 2022] GET /compute/v2.1/servers/3a4d67cf-1eb8-49d5-af5f-1073711116e4 => generated 1563 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:59:10.057390 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-61efa6de-9d18-4762-97d2-5bf9bdcb853e tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:59:10.058030 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-61efa6de-9d18-4762-97d2-5bf9bdcb853e tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 3a4d67cf-1eb8-49d5-af5f-1073711116e4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:59:10.061390 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:59:10.066141 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-61efa6de-9d18-4762-97d2-5bf9bdcb853e tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:59:10.066648 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-61efa6de-9d18-4762-97d2-5bf9bdcb853e tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:59:10.067107 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-61efa6de-9d18-4762-97d2-5bf9bdcb853e tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:59:10.067821 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-61efa6de-9d18-4762-97d2-5bf9bdcb853e tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:59:10.068322 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-61efa6de-9d18-4762-97d2-5bf9bdcb853e tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:59:10.068777 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-61efa6de-9d18-4762-97d2-5bf9bdcb853e tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:59:10.210497 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-61efa6de-9d18-4762-97d2-5bf9bdcb853e tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:59:10.218602 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-61efa6de-9d18-4762-97d2-5bf9bdcb853e tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/3a4d67cf-1eb8-49d5-af5f-1073711116e4" status: 200 len: 1563 microversion: 2.1 time: 0.165059 Oct 04 19:59:10.219203 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4085/8185] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:59:10 2022] GET /compute/v2.1/servers/3a4d67cf-1eb8-49d5-af5f-1073711116e4 => generated 1563 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:59:12.164135 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-da45a6d4-45a5-41c1-b173-af88f62306dc tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:59:12.165419 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-da45a6d4-45a5-41c1-b173-af88f62306dc tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 3a4d67cf-1eb8-49d5-af5f-1073711116e4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:59:12.167646 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-56e3661c-bc3d-42b8-96a9-1db7aade7e19 req-b16be28b-e2f2-4e6d-a47b-d216a054669b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a4d67cf-1eb8-49d5-af5f-1073711116e4", "tag": "482544d1-3016-46b5-a798-d11d69fbac64"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:59:12.172548 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-da45a6d4-45a5-41c1-b173-af88f62306dc tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:59:12.173529 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-da45a6d4-45a5-41c1-b173-af88f62306dc tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:59:12.173976 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-da45a6d4-45a5-41c1-b173-af88f62306dc tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:59:12.174906 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-da45a6d4-45a5-41c1-b173-af88f62306dc tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:59:12.175373 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-da45a6d4-45a5-41c1-b173-af88f62306dc tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:59:12.175810 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-da45a6d4-45a5-41c1-b173-af88f62306dc tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:59:12.178561 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-56e3661c-bc3d-42b8-96a9-1db7aade7e19 req-b16be28b-e2f2-4e6d-a47b-d216a054669b service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:59:12.179083 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-56e3661c-bc3d-42b8-96a9-1db7aade7e19 req-b16be28b-e2f2-4e6d-a47b-d216a054669b service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:59:12.180070 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-56e3661c-bc3d-42b8-96a9-1db7aade7e19 req-b16be28b-e2f2-4e6d-a47b-d216a054669b service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:59:12.192286 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-56e3661c-bc3d-42b8-96a9-1db7aade7e19 req-b16be28b-e2f2-4e6d-a47b-d216a054669b service nova] Creating event network-changed:482544d1-3016-46b5-a798-d11d69fbac64 for instance 3a4d67cf-1eb8-49d5-af5f-1073711116e4 on n-h1-850501-14 Oct 04 19:59:12.197387 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-56e3661c-bc3d-42b8-96a9-1db7aade7e19 req-b16be28b-e2f2-4e6d-a47b-d216a054669b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033491 Oct 04 19:59:12.198205 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4086/8186] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 19:59:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:59:12.406629 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-da45a6d4-45a5-41c1-b173-af88f62306dc tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:59:12.414605 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-da45a6d4-45a5-41c1-b173-af88f62306dc tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/3a4d67cf-1eb8-49d5-af5f-1073711116e4" status: 200 len: 1563 microversion: 2.1 time: 0.255118 Oct 04 19:59:12.415558 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4101/8187] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:59:12 2022] GET /compute/v2.1/servers/3a4d67cf-1eb8-49d5-af5f-1073711116e4 => generated 1563 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:59:35.679168 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=3 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:59:35.679931 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=46 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:59:35.685543 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4ae21161-2d61-45b9-9932-64f2511e20c2 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:59:35.687879 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4ae21161-2d61-45b9-9932-64f2511e20c2 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 3a4d67cf-1eb8-49d5-af5f-1073711116e4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:59:35.693997 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4ae21161-2d61-45b9-9932-64f2511e20c2 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:59:35.694503 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4ae21161-2d61-45b9-9932-64f2511e20c2 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:59:35.694960 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4ae21161-2d61-45b9-9932-64f2511e20c2 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:59:35.695674 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4ae21161-2d61-45b9-9932-64f2511e20c2 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:59:35.696179 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4ae21161-2d61-45b9-9932-64f2511e20c2 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:59:35.696628 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-4ae21161-2d61-45b9-9932-64f2511e20c2 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:59:35.750015 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4ae21161-2d61-45b9-9932-64f2511e20c2 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "POST /compute/v2.1/servers/3a4d67cf-1eb8-49d5-af5f-1073711116e4/action" status: 200 len: 24574 microversion: 2.1 time: 0.072592 Oct 04 19:59:35.750682 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4087/8188] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 19:59:35 2022] POST /compute/v2.1/servers/3a4d67cf-1eb8-49d5-af5f-1073711116e4/action => generated 24574 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:59:42.179922 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d41c62f7-1dae-4c30-81d5-b76ad982ad9e tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:59:42.182214 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=18 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:59:42.183289 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=34 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:59:42.187984 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d41c62f7-1dae-4c30-81d5-b76ad982ad9e tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:59:42.188500 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d41c62f7-1dae-4c30-81d5-b76ad982ad9e tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:59:42.188947 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d41c62f7-1dae-4c30-81d5-b76ad982ad9e tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:59:42.210952 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d41c62f7-1dae-4c30-81d5-b76ad982ad9e tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 3a4d67cf-1eb8-49d5-af5f-1073711116e4] Going to try to stop instance {{(pid=123001) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 19:59:42.442125 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d41c62f7-1dae-4c30-81d5-b76ad982ad9e tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "POST /compute/v2.1/servers/3a4d67cf-1eb8-49d5-af5f-1073711116e4/action" status: 202 len: 0 microversion: 2.1 time: 0.266202 Oct 04 19:59:42.442729 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4102/8189] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 19:59:42 2022] POST /compute/v2.1/servers/3a4d67cf-1eb8-49d5-af5f-1073711116e4/action => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:59:42.451983 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-23669596-b13e-4a90-a9d4-c685417f4079 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:59:42.452766 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-23669596-b13e-4a90-a9d4-c685417f4079 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 3a4d67cf-1eb8-49d5-af5f-1073711116e4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:59:42.460702 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-23669596-b13e-4a90-a9d4-c685417f4079 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:59:42.461215 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-23669596-b13e-4a90-a9d4-c685417f4079 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:59:42.461671 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-23669596-b13e-4a90-a9d4-c685417f4079 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:59:42.462394 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-23669596-b13e-4a90-a9d4-c685417f4079 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:59:42.462871 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-23669596-b13e-4a90-a9d4-c685417f4079 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:59:42.463317 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-23669596-b13e-4a90-a9d4-c685417f4079 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:59:42.608085 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-23669596-b13e-4a90-a9d4-c685417f4079 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:59:42.616241 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-23669596-b13e-4a90-a9d4-c685417f4079 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/3a4d67cf-1eb8-49d5-af5f-1073711116e4" status: 200 len: 1692 microversion: 2.1 time: 0.168990 Oct 04 19:59:42.616882 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4088/8190] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:59:42 2022] GET /compute/v2.1/servers/3a4d67cf-1eb8-49d5-af5f-1073711116e4 => generated 1692 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:59:43.643198 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5b86a570-56be-46e1-918a-58436f08147e tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:59:43.643914 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5b86a570-56be-46e1-918a-58436f08147e tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 3a4d67cf-1eb8-49d5-af5f-1073711116e4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:59:43.650251 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5b86a570-56be-46e1-918a-58436f08147e tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:59:43.650736 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5b86a570-56be-46e1-918a-58436f08147e tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:59:43.651685 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5b86a570-56be-46e1-918a-58436f08147e tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:59:43.652410 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5b86a570-56be-46e1-918a-58436f08147e tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:59:43.652871 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5b86a570-56be-46e1-918a-58436f08147e tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:59:43.653348 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5b86a570-56be-46e1-918a-58436f08147e tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:59:43.796207 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5b86a570-56be-46e1-918a-58436f08147e tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:59:43.804154 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5b86a570-56be-46e1-918a-58436f08147e tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/3a4d67cf-1eb8-49d5-af5f-1073711116e4" status: 200 len: 1692 microversion: 2.1 time: 0.166473 Oct 04 19:59:43.804753 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4103/8191] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:59:43 2022] GET /compute/v2.1/servers/3a4d67cf-1eb8-49d5-af5f-1073711116e4 => generated 1692 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:59:44.830189 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-54e114ed-c02a-4040-99f0-b824077913b2 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:59:44.830807 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-54e114ed-c02a-4040-99f0-b824077913b2 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 3a4d67cf-1eb8-49d5-af5f-1073711116e4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:59:44.838560 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-54e114ed-c02a-4040-99f0-b824077913b2 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:59:44.839760 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-54e114ed-c02a-4040-99f0-b824077913b2 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:59:44.840305 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-54e114ed-c02a-4040-99f0-b824077913b2 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:59:44.841013 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-54e114ed-c02a-4040-99f0-b824077913b2 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:59:44.841487 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-54e114ed-c02a-4040-99f0-b824077913b2 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:59:44.841938 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-54e114ed-c02a-4040-99f0-b824077913b2 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:59:44.979682 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-54e114ed-c02a-4040-99f0-b824077913b2 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:59:44.987676 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-54e114ed-c02a-4040-99f0-b824077913b2 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/3a4d67cf-1eb8-49d5-af5f-1073711116e4" status: 200 len: 1692 microversion: 2.1 time: 0.161451 Oct 04 19:59:44.988615 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4089/8192] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:59:44 2022] GET /compute/v2.1/servers/3a4d67cf-1eb8-49d5-af5f-1073711116e4 => generated 1692 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:59:46.012977 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-43c24cfb-39ba-460c-9ff9-9f3ec4a24471 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:59:46.013539 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-43c24cfb-39ba-460c-9ff9-9f3ec4a24471 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 3a4d67cf-1eb8-49d5-af5f-1073711116e4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:59:46.019634 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-43c24cfb-39ba-460c-9ff9-9f3ec4a24471 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:59:46.020162 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-43c24cfb-39ba-460c-9ff9-9f3ec4a24471 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:59:46.020614 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-43c24cfb-39ba-460c-9ff9-9f3ec4a24471 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:59:46.021312 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-43c24cfb-39ba-460c-9ff9-9f3ec4a24471 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:59:46.021775 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-43c24cfb-39ba-460c-9ff9-9f3ec4a24471 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:59:46.022207 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-43c24cfb-39ba-460c-9ff9-9f3ec4a24471 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:59:46.153647 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-43c24cfb-39ba-460c-9ff9-9f3ec4a24471 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:59:46.161334 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-43c24cfb-39ba-460c-9ff9-9f3ec4a24471 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/3a4d67cf-1eb8-49d5-af5f-1073711116e4" status: 200 len: 1692 microversion: 2.1 time: 0.153408 Oct 04 19:59:46.161959 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4104/8193] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:59:46 2022] GET /compute/v2.1/servers/3a4d67cf-1eb8-49d5-af5f-1073711116e4 => generated 1692 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:59:47.185119 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ec3b6f7d-c84e-4bce-a535-7e4735891323 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:59:47.185773 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ec3b6f7d-c84e-4bce-a535-7e4735891323 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 3a4d67cf-1eb8-49d5-af5f-1073711116e4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:59:47.192837 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ec3b6f7d-c84e-4bce-a535-7e4735891323 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:59:47.193343 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ec3b6f7d-c84e-4bce-a535-7e4735891323 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:59:47.193800 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ec3b6f7d-c84e-4bce-a535-7e4735891323 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:59:47.194513 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ec3b6f7d-c84e-4bce-a535-7e4735891323 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:59:47.194987 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ec3b6f7d-c84e-4bce-a535-7e4735891323 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:59:47.195435 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ec3b6f7d-c84e-4bce-a535-7e4735891323 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:59:47.336707 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ec3b6f7d-c84e-4bce-a535-7e4735891323 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:59:47.345347 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ec3b6f7d-c84e-4bce-a535-7e4735891323 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/3a4d67cf-1eb8-49d5-af5f-1073711116e4" status: 200 len: 1692 microversion: 2.1 time: 0.164262 Oct 04 19:59:47.345929 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4090/8194] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:59:47 2022] GET /compute/v2.1/servers/3a4d67cf-1eb8-49d5-af5f-1073711116e4 => generated 1692 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:59:48.370380 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1c54308d-6598-48fa-869f-343c188ab83e tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:59:48.371009 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1c54308d-6598-48fa-869f-343c188ab83e tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 3a4d67cf-1eb8-49d5-af5f-1073711116e4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:59:48.377754 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1c54308d-6598-48fa-869f-343c188ab83e tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:59:48.378234 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1c54308d-6598-48fa-869f-343c188ab83e tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:59:48.378672 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1c54308d-6598-48fa-869f-343c188ab83e tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:59:48.379355 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1c54308d-6598-48fa-869f-343c188ab83e tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:59:48.379806 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1c54308d-6598-48fa-869f-343c188ab83e tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:59:48.380261 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1c54308d-6598-48fa-869f-343c188ab83e tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:59:48.516937 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1c54308d-6598-48fa-869f-343c188ab83e tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:59:48.524682 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1c54308d-6598-48fa-869f-343c188ab83e tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/3a4d67cf-1eb8-49d5-af5f-1073711116e4" status: 200 len: 1692 microversion: 2.1 time: 0.158315 Oct 04 19:59:48.525280 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4105/8195] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:59:48 2022] GET /compute/v2.1/servers/3a4d67cf-1eb8-49d5-af5f-1073711116e4 => generated 1692 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:59:49.549684 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-fa8bb556-88d6-4e64-a8c0-e0ebf05d04e2 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:59:49.550340 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-fa8bb556-88d6-4e64-a8c0-e0ebf05d04e2 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 3a4d67cf-1eb8-49d5-af5f-1073711116e4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:59:49.557698 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fa8bb556-88d6-4e64-a8c0-e0ebf05d04e2 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:59:49.558256 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fa8bb556-88d6-4e64-a8c0-e0ebf05d04e2 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:59:49.558703 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fa8bb556-88d6-4e64-a8c0-e0ebf05d04e2 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:59:49.559403 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fa8bb556-88d6-4e64-a8c0-e0ebf05d04e2 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:59:49.559900 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fa8bb556-88d6-4e64-a8c0-e0ebf05d04e2 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:59:49.560365 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fa8bb556-88d6-4e64-a8c0-e0ebf05d04e2 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:59:49.702382 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-fa8bb556-88d6-4e64-a8c0-e0ebf05d04e2 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:59:49.702382 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-fa8bb556-88d6-4e64-a8c0-e0ebf05d04e2 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/3a4d67cf-1eb8-49d5-af5f-1073711116e4" status: 200 len: 1692 microversion: 2.1 time: 0.154168 Oct 04 19:59:49.702382 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4091/8196] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:59:49 2022] GET /compute/v2.1/servers/3a4d67cf-1eb8-49d5-af5f-1073711116e4 => generated 1692 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:59:50.726252 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a494c51f-ba9e-4f99-a730-9a98a7ff58a9 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:59:50.727211 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a494c51f-ba9e-4f99-a730-9a98a7ff58a9 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 3a4d67cf-1eb8-49d5-af5f-1073711116e4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:59:50.734527 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a494c51f-ba9e-4f99-a730-9a98a7ff58a9 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:59:50.734996 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a494c51f-ba9e-4f99-a730-9a98a7ff58a9 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:59:50.735421 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a494c51f-ba9e-4f99-a730-9a98a7ff58a9 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:59:50.736206 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a494c51f-ba9e-4f99-a730-9a98a7ff58a9 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:59:50.736962 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a494c51f-ba9e-4f99-a730-9a98a7ff58a9 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:59:50.737192 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a494c51f-ba9e-4f99-a730-9a98a7ff58a9 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:59:50.880848 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a494c51f-ba9e-4f99-a730-9a98a7ff58a9 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:59:50.890033 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a494c51f-ba9e-4f99-a730-9a98a7ff58a9 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/3a4d67cf-1eb8-49d5-af5f-1073711116e4" status: 200 len: 1692 microversion: 2.1 time: 0.170115 Oct 04 19:59:50.890616 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4106/8197] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:59:50 2022] GET /compute/v2.1/servers/3a4d67cf-1eb8-49d5-af5f-1073711116e4 => generated 1692 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:59:51.916029 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-eabf0de2-1ab1-4d09-a307-283af160df4c tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:59:51.916795 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-eabf0de2-1ab1-4d09-a307-283af160df4c tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 3a4d67cf-1eb8-49d5-af5f-1073711116e4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:59:51.923697 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eabf0de2-1ab1-4d09-a307-283af160df4c tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:59:51.924231 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eabf0de2-1ab1-4d09-a307-283af160df4c tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:59:51.924684 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eabf0de2-1ab1-4d09-a307-283af160df4c tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:59:51.925391 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eabf0de2-1ab1-4d09-a307-283af160df4c tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:59:51.925855 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eabf0de2-1ab1-4d09-a307-283af160df4c tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:59:51.926292 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eabf0de2-1ab1-4d09-a307-283af160df4c tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:59:52.066250 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-eabf0de2-1ab1-4d09-a307-283af160df4c tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:59:52.075127 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-eabf0de2-1ab1-4d09-a307-283af160df4c tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/3a4d67cf-1eb8-49d5-af5f-1073711116e4" status: 200 len: 1692 microversion: 2.1 time: 0.163007 Oct 04 19:59:52.075732 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4092/8198] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:59:51 2022] GET /compute/v2.1/servers/3a4d67cf-1eb8-49d5-af5f-1073711116e4 => generated 1692 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:59:53.098797 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-eaf5d28d-5553-4199-925e-d5530a0289cf tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:59:53.099381 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-eaf5d28d-5553-4199-925e-d5530a0289cf tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 3a4d67cf-1eb8-49d5-af5f-1073711116e4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:59:53.107255 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eaf5d28d-5553-4199-925e-d5530a0289cf tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:59:53.107762 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eaf5d28d-5553-4199-925e-d5530a0289cf tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:59:53.108227 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eaf5d28d-5553-4199-925e-d5530a0289cf tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:59:53.108912 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eaf5d28d-5553-4199-925e-d5530a0289cf tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:59:53.109365 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eaf5d28d-5553-4199-925e-d5530a0289cf tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:59:53.109786 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eaf5d28d-5553-4199-925e-d5530a0289cf tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:59:53.242787 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-eaf5d28d-5553-4199-925e-d5530a0289cf tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:59:53.250742 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-eaf5d28d-5553-4199-925e-d5530a0289cf tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/3a4d67cf-1eb8-49d5-af5f-1073711116e4" status: 200 len: 1669 microversion: 2.1 time: 0.156246 Oct 04 19:59:53.251517 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4107/8199] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:59:53 2022] GET /compute/v2.1/servers/3a4d67cf-1eb8-49d5-af5f-1073711116e4 => generated 1669 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:59:54.345644 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-19b69b2f-8dd3-41dd-95ff-a05721906fab tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:59:54.347973 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-19b69b2f-8dd3-41dd-95ff-a05721906fab tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 3a4d67cf-1eb8-49d5-af5f-1073711116e4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:59:54.355046 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-19b69b2f-8dd3-41dd-95ff-a05721906fab tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:59:54.355555 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-19b69b2f-8dd3-41dd-95ff-a05721906fab tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:59:54.356020 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-19b69b2f-8dd3-41dd-95ff-a05721906fab tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:59:54.356773 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-19b69b2f-8dd3-41dd-95ff-a05721906fab tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:59:54.357249 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-19b69b2f-8dd3-41dd-95ff-a05721906fab tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:59:54.357697 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-19b69b2f-8dd3-41dd-95ff-a05721906fab tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:59:54.408666 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-19b69b2f-8dd3-41dd-95ff-a05721906fab tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "POST /compute/v2.1/servers/3a4d67cf-1eb8-49d5-af5f-1073711116e4/action" status: 200 len: 36600 microversion: 2.1 time: 0.066820 Oct 04 19:59:54.409323 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4093/8200] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 19:59:54 2022] POST /compute/v2.1/servers/3a4d67cf-1eb8-49d5-af5f-1073711116e4/action => generated 36600 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:59:54.421288 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-754e13a9-908b-4860-ab00-d25d401bd4d0 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:59:54.428146 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-754e13a9-908b-4860-ab00-d25d401bd4d0 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:59:54.428642 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-754e13a9-908b-4860-ab00-d25d401bd4d0 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:59:54.429086 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-754e13a9-908b-4860-ab00-d25d401bd4d0 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:59:54.451778 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-754e13a9-908b-4860-ab00-d25d401bd4d0 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 3a4d67cf-1eb8-49d5-af5f-1073711116e4] Going to try to start instance {{(pid=123001) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 04 19:59:54.629953 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-754e13a9-908b-4860-ab00-d25d401bd4d0 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "POST /compute/v2.1/servers/3a4d67cf-1eb8-49d5-af5f-1073711116e4/action" status: 202 len: 0 microversion: 2.1 time: 0.212451 Oct 04 19:59:54.630582 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4108/8201] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 19:59:54 2022] POST /compute/v2.1/servers/3a4d67cf-1eb8-49d5-af5f-1073711116e4/action => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:59:54.640375 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b135616d-8a92-4f61-8446-495547c4dc7b tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:59:54.641258 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b135616d-8a92-4f61-8446-495547c4dc7b tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 3a4d67cf-1eb8-49d5-af5f-1073711116e4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:59:54.648363 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b135616d-8a92-4f61-8446-495547c4dc7b tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:59:54.648868 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b135616d-8a92-4f61-8446-495547c4dc7b tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:59:54.649325 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b135616d-8a92-4f61-8446-495547c4dc7b tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:59:54.650050 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b135616d-8a92-4f61-8446-495547c4dc7b tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:59:54.650521 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b135616d-8a92-4f61-8446-495547c4dc7b tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:59:54.651151 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b135616d-8a92-4f61-8446-495547c4dc7b tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:59:54.803552 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b135616d-8a92-4f61-8446-495547c4dc7b tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:59:54.812167 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b135616d-8a92-4f61-8446-495547c4dc7b tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/3a4d67cf-1eb8-49d5-af5f-1073711116e4" status: 200 len: 1678 microversion: 2.1 time: 0.176985 Oct 04 19:59:54.813427 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4094/8202] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:59:54 2022] GET /compute/v2.1/servers/3a4d67cf-1eb8-49d5-af5f-1073711116e4 => generated 1678 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:59:55.839248 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f300167d-5868-40ce-9c3b-20d56b4fcda1 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:59:55.839964 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f300167d-5868-40ce-9c3b-20d56b4fcda1 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 3a4d67cf-1eb8-49d5-af5f-1073711116e4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:59:55.846577 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f300167d-5868-40ce-9c3b-20d56b4fcda1 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:59:55.846704 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f300167d-5868-40ce-9c3b-20d56b4fcda1 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:59:55.847076 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f300167d-5868-40ce-9c3b-20d56b4fcda1 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:59:55.847774 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f300167d-5868-40ce-9c3b-20d56b4fcda1 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:59:55.848277 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f300167d-5868-40ce-9c3b-20d56b4fcda1 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:59:55.848708 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f300167d-5868-40ce-9c3b-20d56b4fcda1 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:59:55.998320 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f300167d-5868-40ce-9c3b-20d56b4fcda1 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:59:56.006374 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f300167d-5868-40ce-9c3b-20d56b4fcda1 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/3a4d67cf-1eb8-49d5-af5f-1073711116e4" status: 200 len: 1678 microversion: 2.1 time: 0.172986 Oct 04 19:59:56.006951 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4109/8203] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:59:55 2022] GET /compute/v2.1/servers/3a4d67cf-1eb8-49d5-af5f-1073711116e4 => generated 1678 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:59:57.030972 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7cbff5fa-0c6a-4189-b2f9-9e5f790186b6 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:59:57.031553 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7cbff5fa-0c6a-4189-b2f9-9e5f790186b6 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 3a4d67cf-1eb8-49d5-af5f-1073711116e4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:59:57.039267 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7cbff5fa-0c6a-4189-b2f9-9e5f790186b6 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:59:57.039773 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7cbff5fa-0c6a-4189-b2f9-9e5f790186b6 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:59:57.040264 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7cbff5fa-0c6a-4189-b2f9-9e5f790186b6 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:59:57.040978 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7cbff5fa-0c6a-4189-b2f9-9e5f790186b6 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:59:57.042224 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7cbff5fa-0c6a-4189-b2f9-9e5f790186b6 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:59:57.042675 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7cbff5fa-0c6a-4189-b2f9-9e5f790186b6 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:59:57.181036 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7cbff5fa-0c6a-4189-b2f9-9e5f790186b6 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:59:57.188704 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7cbff5fa-0c6a-4189-b2f9-9e5f790186b6 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/3a4d67cf-1eb8-49d5-af5f-1073711116e4" status: 200 len: 1682 microversion: 2.1 time: 0.161840 Oct 04 19:59:57.189286 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4095/8204] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 19:59:57 2022] GET /compute/v2.1/servers/3a4d67cf-1eb8-49d5-af5f-1073711116e4 => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:00:21.381079 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8fd46d44-8d05-44df-9a41-d5e055483f0e tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:00:21.383468 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8fd46d44-8d05-44df-9a41-d5e055483f0e tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 3a4d67cf-1eb8-49d5-af5f-1073711116e4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:00:21.386313 n-d-850501-14 devstack@n-api.service[123001]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 20:00:21.386458 n-d-850501-14 devstack@n-api.service[123001]: Tue Oct 4 20:00:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3a4d67cf-1eb8-49d5-af5f-1073711116e4/action (ip 10.222.0.20) !!! Oct 04 20:00:21.388724 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=16 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:00:21.389449 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:00:21.395128 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8fd46d44-8d05-44df-9a41-d5e055483f0e tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:00:21.395652 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8fd46d44-8d05-44df-9a41-d5e055483f0e tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:00:21.396119 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8fd46d44-8d05-44df-9a41-d5e055483f0e tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:00:21.396841 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8fd46d44-8d05-44df-9a41-d5e055483f0e tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:00:21.397299 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8fd46d44-8d05-44df-9a41-d5e055483f0e tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:00:21.397769 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8fd46d44-8d05-44df-9a41-d5e055483f0e tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:00:21.451942 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8fd46d44-8d05-44df-9a41-d5e055483f0e tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "POST /compute/v2.1/servers/3a4d67cf-1eb8-49d5-af5f-1073711116e4/action" status: 200 len: 61160 microversion: 2.1 time: 0.073828 Oct 04 20:00:21.452643 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4110/8205] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 20:00:21 2022] POST /compute/v2.1/servers/3a4d67cf-1eb8-49d5-af5f-1073711116e4/action => generated 61160 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:00:28.565949 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f95dbebc-b04f-4224-8e24-de25191f0a24 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:00:28.566472 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f95dbebc-b04f-4224-8e24-de25191f0a24 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 3a4d67cf-1eb8-49d5-af5f-1073711116e4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:00:28.568591 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-1ba981ab-53e2-4bed-aee8-ccb0a08876f3 req-74f0ed0b-449c-4943-995b-a8bed5b9920f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a4d67cf-1eb8-49d5-af5f-1073711116e4", "tag": "482544d1-3016-46b5-a798-d11d69fbac64"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:00:28.569868 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=18 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:00:28.570595 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=50 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:00:28.576832 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f95dbebc-b04f-4224-8e24-de25191f0a24 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:00:28.577639 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f95dbebc-b04f-4224-8e24-de25191f0a24 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:00:28.578305 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f95dbebc-b04f-4224-8e24-de25191f0a24 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:00:28.579283 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f95dbebc-b04f-4224-8e24-de25191f0a24 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:00:28.579939 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f95dbebc-b04f-4224-8e24-de25191f0a24 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:00:28.580415 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f95dbebc-b04f-4224-8e24-de25191f0a24 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:00:28.582949 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-1ba981ab-53e2-4bed-aee8-ccb0a08876f3 req-74f0ed0b-449c-4943-995b-a8bed5b9920f service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:00:28.583429 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-1ba981ab-53e2-4bed-aee8-ccb0a08876f3 req-74f0ed0b-449c-4943-995b-a8bed5b9920f service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:00:28.584255 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-1ba981ab-53e2-4bed-aee8-ccb0a08876f3 req-74f0ed0b-449c-4943-995b-a8bed5b9920f service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:00:28.599806 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-1ba981ab-53e2-4bed-aee8-ccb0a08876f3 req-74f0ed0b-449c-4943-995b-a8bed5b9920f service nova] Creating event network-changed:482544d1-3016-46b5-a798-d11d69fbac64 for instance 3a4d67cf-1eb8-49d5-af5f-1073711116e4 on n-h1-850501-14 Oct 04 20:00:28.605684 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-1ba981ab-53e2-4bed-aee8-ccb0a08876f3 req-74f0ed0b-449c-4943-995b-a8bed5b9920f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041540 Oct 04 20:00:28.607296 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4111/8206] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 20:00:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:00:28.609872 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f95dbebc-b04f-4224-8e24-de25191f0a24 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 3a4d67cf-1eb8-49d5-af5f-1073711116e4] Going to try to terminate instance {{(pid=123002) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:00:28.873358 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f95dbebc-b04f-4224-8e24-de25191f0a24 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3a4d67cf-1eb8-49d5-af5f-1073711116e4" status: 204 len: 0 microversion: 2.1 time: 0.310728 Oct 04 20:00:28.874096 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4096/8207] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 20:00:28 2022] DELETE /compute/v2.1/servers/3a4d67cf-1eb8-49d5-af5f-1073711116e4 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:00:28.883089 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-18689415-3da3-4c21-b917-c5e39dfe8a6f tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:00:28.883942 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-18689415-3da3-4c21-b917-c5e39dfe8a6f tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 3a4d67cf-1eb8-49d5-af5f-1073711116e4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:00:28.893791 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-18689415-3da3-4c21-b917-c5e39dfe8a6f tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:00:28.895617 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-18689415-3da3-4c21-b917-c5e39dfe8a6f tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:00:28.896198 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-18689415-3da3-4c21-b917-c5e39dfe8a6f tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:00:28.897080 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-18689415-3da3-4c21-b917-c5e39dfe8a6f tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:00:28.897618 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-18689415-3da3-4c21-b917-c5e39dfe8a6f tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:00:28.898289 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-18689415-3da3-4c21-b917-c5e39dfe8a6f tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:00:29.039830 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-18689415-3da3-4c21-b917-c5e39dfe8a6f tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:00:29.048421 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-18689415-3da3-4c21-b917-c5e39dfe8a6f tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/3a4d67cf-1eb8-49d5-af5f-1073711116e4" status: 200 len: 1688 microversion: 2.1 time: 0.169726 Oct 04 20:00:29.049004 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4112/8208] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:00:28 2022] GET /compute/v2.1/servers/3a4d67cf-1eb8-49d5-af5f-1073711116e4 => generated 1688 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:00:30.074699 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-57a5767b-fd77-4ac2-a581-db46a4e6d13b tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:00:30.076356 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-57a5767b-fd77-4ac2-a581-db46a4e6d13b tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 3a4d67cf-1eb8-49d5-af5f-1073711116e4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:00:30.083301 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-57a5767b-fd77-4ac2-a581-db46a4e6d13b tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:00:30.083803 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-57a5767b-fd77-4ac2-a581-db46a4e6d13b tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:00:30.084428 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-57a5767b-fd77-4ac2-a581-db46a4e6d13b tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:00:30.085149 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-57a5767b-fd77-4ac2-a581-db46a4e6d13b tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:00:30.085617 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-57a5767b-fd77-4ac2-a581-db46a4e6d13b tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:00:30.086062 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-57a5767b-fd77-4ac2-a581-db46a4e6d13b tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:00:30.239810 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-57a5767b-fd77-4ac2-a581-db46a4e6d13b tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:00:30.248306 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-57a5767b-fd77-4ac2-a581-db46a4e6d13b tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/3a4d67cf-1eb8-49d5-af5f-1073711116e4" status: 200 len: 1688 microversion: 2.1 time: 0.177958 Oct 04 20:00:30.248888 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4097/8209] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:00:30 2022] GET /compute/v2.1/servers/3a4d67cf-1eb8-49d5-af5f-1073711116e4 => generated 1688 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:00:30.891124 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-182f7bfe-feef-4fa2-96f2-c9c0ebc9735f req-8fb7a909-0ca8-43b5-9b95-af75a9b2adf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a4d67cf-1eb8-49d5-af5f-1073711116e4", "name": "network-vif-deleted", "tag": "482544d1-3016-46b5-a798-d11d69fbac64"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:00:30.901126 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-182f7bfe-feef-4fa2-96f2-c9c0ebc9735f req-8fb7a909-0ca8-43b5-9b95-af75a9b2adf6 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:00:30.903891 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-182f7bfe-feef-4fa2-96f2-c9c0ebc9735f req-8fb7a909-0ca8-43b5-9b95-af75a9b2adf6 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:00:30.903891 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-182f7bfe-feef-4fa2-96f2-c9c0ebc9735f req-8fb7a909-0ca8-43b5-9b95-af75a9b2adf6 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:00:30.913667 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-182f7bfe-feef-4fa2-96f2-c9c0ebc9735f req-8fb7a909-0ca8-43b5-9b95-af75a9b2adf6 service nova] Creating event network-vif-deleted:482544d1-3016-46b5-a798-d11d69fbac64 for instance 3a4d67cf-1eb8-49d5-af5f-1073711116e4 on n-h1-850501-14 Oct 04 20:00:30.918561 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-182f7bfe-feef-4fa2-96f2-c9c0ebc9735f req-8fb7a909-0ca8-43b5-9b95-af75a9b2adf6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031670 Oct 04 20:00:30.919415 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4113/8210] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 20:00:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:00:31.271088 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-64589e7f-f182-4bb4-91ae-d9e2374ced75 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:00:31.271734 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-64589e7f-f182-4bb4-91ae-d9e2374ced75 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 3a4d67cf-1eb8-49d5-af5f-1073711116e4] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:00:31.279697 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-64589e7f-f182-4bb4-91ae-d9e2374ced75 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:00:31.285533 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-64589e7f-f182-4bb4-91ae-d9e2374ced75 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:00:31.285533 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-64589e7f-f182-4bb4-91ae-d9e2374ced75 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:00:31.285533 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-64589e7f-f182-4bb4-91ae-d9e2374ced75 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:00:31.285533 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-64589e7f-f182-4bb4-91ae-d9e2374ced75 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:00:31.285533 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-64589e7f-f182-4bb4-91ae-d9e2374ced75 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:00:31.352386 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-64589e7f-f182-4bb4-91ae-d9e2374ced75 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:00:31.360799 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-64589e7f-f182-4bb4-91ae-d9e2374ced75 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/3a4d67cf-1eb8-49d5-af5f-1073711116e4" status: 200 len: 1351 microversion: 2.1 time: 0.093798 Oct 04 20:00:31.361376 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4098/8211] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:00:31 2022] GET /compute/v2.1/servers/3a4d67cf-1eb8-49d5-af5f-1073711116e4 => generated 1351 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:00:32.385535 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ba0e0252-befb-4755-82ec-22a845e0a6de tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:00:32.386808 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ba0e0252-befb-4755-82ec-22a845e0a6de tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 3a4d67cf-1eb8-49d5-af5f-1073711116e4] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:00:32.394026 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ba0e0252-befb-4755-82ec-22a845e0a6de tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:00:32.394775 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ba0e0252-befb-4755-82ec-22a845e0a6de tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:00:32.395337 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ba0e0252-befb-4755-82ec-22a845e0a6de tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:00:32.396046 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ba0e0252-befb-4755-82ec-22a845e0a6de tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:00:32.396536 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ba0e0252-befb-4755-82ec-22a845e0a6de tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:00:32.396964 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ba0e0252-befb-4755-82ec-22a845e0a6de tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:00:32.411782 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-ba0e0252-befb-4755-82ec-22a845e0a6de tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] HTTP exception thrown: Instance 3a4d67cf-1eb8-49d5-af5f-1073711116e4 could not be found. Oct 04 20:00:32.413598 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ba0e0252-befb-4755-82ec-22a845e0a6de tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Request method failure captured: Oct 04 20:00:32.413598 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/3a4d67cf-1eb8-49d5-af5f-1073711116e4 HTTP/1.1 Oct 04 20:00:32.413598 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 20:00:32.413598 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 20:00:32.413598 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 20:00:32.413598 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 20:00:32.413598 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 20:00:32.413598 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 20:00:32.413598 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 20:00:32.413598 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 20:00:32.413598 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPI88jPqPFF3foNds79FcB9aFEPQ4j2aE77udaYKTwax2C5JHCysGdgy0FMgNwDOy13EsNaR0GwTaNiwC4DOXbgoj1xNuPI5o717aLLx16xkDOI9Y9C18IHU35Ip47q038B2FBqXcNSHdcfF09wzWairlH5Vr7NhdGSOsyjDGcd-usGY Oct 04 20:00:32.413598 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 20:00:32.413598 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 20:00:32.413598 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 20:00:32.413598 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 20:00:32.413598 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 20:00:32.413598 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 20:00:32.413598 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 7112e2b246a44297876ee6d279e8f655 Oct 04 20:00:32.413598 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1045305417 Oct 04 20:00:32.413598 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 20:00:32.413598 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 20:00:32.413598 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7112e2b246a44297876ee6d279e8f655"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7112e2b246a44297876ee6d279e8f655", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7112e2b246a44297876ee6d279e8f655"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7112e2b246a44297876ee6d279e8f655"}]}] Oct 04 20:00:32.413598 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1045305417 Oct 04 20:00:32.413598 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 7112e2b246a44297876ee6d279e8f655 Oct 04 20:00:32.413598 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1045305417 Oct 04 20:00:32.413598 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-TestNetworkAdvancedServerOps-1045305417-project Oct 04 20:00:32.413598 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 20:00:32.413598 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 20:00:32.413598 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: deb5459af175415da4825e6078eba908 Oct 04 20:00:32.413598 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1045305417-project Oct 04 20:00:32.413598 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 20:00:32.413598 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 3a4d67cf-1eb8-49d5-af5f-1073711116e4 could not be found. Oct 04 20:00:32.413598 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '3a4d67cf-1eb8-49d5-af5f-1073711116e4'} Oct 04 20:00:32.413598 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:00:32.413598 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:00:32.413598 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:00:32.413598 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:00:32.413598 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:00:32.413598 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:00:32.413598 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:00:32.413598 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:00:32.413598 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:00:32.413598 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:00:32.413598 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a4d67cf-1eb8-49d5-af5f-1073711116e4 could not be found. Oct 04 20:00:32.413598 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 20:00:32.413598 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:00:32.413598 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 20:00:32.413598 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:00:32.413598 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:00:32.413598 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:00:32.413598 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:00:32.413598 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:00:32.413598 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:00:32.413598 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:00:32.413598 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:00:32.413598 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:00:32.413598 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:00:32.413598 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:00:32.413598 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:00:32.413598 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:00:32.413598 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a4d67cf-1eb8-49d5-af5f-1073711116e4 could not be found. Oct 04 20:00:32.413598 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 20:00:32.413598 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:00:32.419538 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 20:00:32.419538 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:00:32.419538 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:00:32.419538 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:00:32.419538 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:00:32.419538 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:00:32.419538 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a4d67cf-1eb8-49d5-af5f-1073711116e4 could not be found. Oct 04 20:00:32.419538 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 20:00:32.419538 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ba0e0252-befb-4755-82ec-22a845e0a6de tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Returning 404 to user: Instance 3a4d67cf-1eb8-49d5-af5f-1073711116e4 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:00:32.419538 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ba0e0252-befb-4755-82ec-22a845e0a6de tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/3a4d67cf-1eb8-49d5-af5f-1073711116e4" status: 404 len: 111 microversion: 2.1 time: 0.034885 Oct 04 20:00:32.419538 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4114/8212] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:00:32 2022] GET /compute/v2.1/servers/3a4d67cf-1eb8-49d5-af5f-1073711116e4 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:00:36.185628 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-07e2c210-9141-48ec-aba9-d0b77d7a7bb8 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '.version_select at 0x7fe259a41670>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:00:36.319032 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-07e2c210-9141-48ec-aba9-d0b77d7a7bb8 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-470470357" status: 202 len: 0 microversion: 2.1 time: 0.137505 Oct 04 20:00:36.319574 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4099/8213] 10.222.0.20 () {58 vars in 1281 bytes} [Tue Oct 4 20:00:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-470470357 => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:00:36.355743 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e0c040f6-a113-4157-8504-e0d74cc7ba17 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Action: 'create', calling method: .version_select at 0x7fe253b54040>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1896660805", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFq0dHI//RT6ap6TCvTjGdfxSPI1gRXg2sQCT53JC2JYyS7gefxfiNDGQ4KYQQaDxGsoZB86SnPBiksQtDnvRUbqoCDvPM9N7Eq4BXKXyAFp7Zv9mltzjQHZbhd95EDXtw=="}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:00:36.370062 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-e0c040f6-a113-4157-8504-e0d74cc7ba17 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Getting quotas for project 7112e2b246a44297876ee6d279e8f655. Resources: {'key_pairs'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:00:36.375467 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-e0c040f6-a113-4157-8504-e0d74cc7ba17 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Getting quotas for user deb5459af175415da4825e6078eba908 and project 7112e2b246a44297876ee6d279e8f655. Resources: {'key_pairs'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:00:36.473407 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e0c040f6-a113-4157-8504-e0d74cc7ba17 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.124885 Oct 04 20:00:36.474005 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4115/8214] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Oct 4 20:00:36 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:00:44.539225 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:00:44.545261 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2c0ebc10-19b2-4064-a9e4-d5d4ca262501 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-975308661", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "networks": [{"uuid": "b6f3d662-0fa3-466c-90ef-f6bc1b177b4b"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1896660805", "security_groups": [{"name": "tempest-secgroup-smoke-340064773"}]}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:00:44.666993 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-2c0ebc10-19b2-4064-a9e4-d5d4ca262501 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] validate_networks() for [('b6f3d662-0fa3-466c-90ef-f6bc1b177b4b', None, None, None, None, None)] {{(pid=123002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:00:45.125809 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-2c0ebc10-19b2-4064-a9e4-d5d4ca262501 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:00:45.126196 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-2c0ebc10-19b2-4064-a9e4-d5d4ca262501 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:00:45.126693 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-2c0ebc10-19b2-4064-a9e4-d5d4ca262501 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:00:45.127123 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-2c0ebc10-19b2-4064-a9e4-d5d4ca262501 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:00:45.127562 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-2c0ebc10-19b2-4064-a9e4-d5d4ca262501 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:00:45.136465 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2c0ebc10-19b2-4064-a9e4-d5d4ca262501 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:00:45.137512 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2c0ebc10-19b2-4064-a9e4-d5d4ca262501 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:00:45.138074 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2c0ebc10-19b2-4064-a9e4-d5d4ca262501 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:00:45.138766 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2c0ebc10-19b2-4064-a9e4-d5d4ca262501 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:00:45.139236 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2c0ebc10-19b2-4064-a9e4-d5d4ca262501 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:00:45.139678 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2c0ebc10-19b2-4064-a9e4-d5d4ca262501 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:00:45.157761 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-2c0ebc10-19b2-4064-a9e4-d5d4ca262501 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Getting quotas for project 7112e2b246a44297876ee6d279e8f655. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:00:45.163037 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-2c0ebc10-19b2-4064-a9e4-d5d4ca262501 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Getting quotas for user deb5459af175415da4825e6078eba908 and project 7112e2b246a44297876ee6d279e8f655. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:00:45.175478 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2c0ebc10-19b2-4064-a9e4-d5d4ca262501 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Going to run 1 instances... {{(pid=123002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:00:45.177884 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2c0ebc10-19b2-4064-a9e4-d5d4ca262501 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 7bf75f66-876f-4a9f-9902-d1f223d6eb12] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:00:45.459564 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2c0ebc10-19b2-4064-a9e4-d5d4ca262501 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.922716 Oct 04 20:00:45.460642 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4100/8215] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 20:00:44 2022] POST /compute/v2.1/servers => generated 405 bytes in 925 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:00:45.470080 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=16 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:00:45.474059 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-21427a2f-6fe6-452f-b5e0-95f356b962ff tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:00:45.474670 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-21427a2f-6fe6-452f-b5e0-95f356b962ff tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 7bf75f66-876f-4a9f-9902-d1f223d6eb12] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:00:45.536853 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-21427a2f-6fe6-452f-b5e0-95f356b962ff tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:00:45.549242 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-21427a2f-6fe6-452f-b5e0-95f356b962ff tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/7bf75f66-876f-4a9f-9902-d1f223d6eb12" status: 200 len: 1266 microversion: 2.1 time: 0.077174 Oct 04 20:00:45.549242 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4116/8216] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:00:45 2022] GET /compute/v2.1/servers/7bf75f66-876f-4a9f-9902-d1f223d6eb12 => generated 1266 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:00:46.571099 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b1a02a57-03cf-4b9e-bd30-232d79205192 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:00:46.571748 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b1a02a57-03cf-4b9e-bd30-232d79205192 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 7bf75f66-876f-4a9f-9902-d1f223d6eb12] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:00:46.582463 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b1a02a57-03cf-4b9e-bd30-232d79205192 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:00:46.583185 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b1a02a57-03cf-4b9e-bd30-232d79205192 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:00:46.583942 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b1a02a57-03cf-4b9e-bd30-232d79205192 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:00:46.585094 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b1a02a57-03cf-4b9e-bd30-232d79205192 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:00:46.585937 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b1a02a57-03cf-4b9e-bd30-232d79205192 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:00:46.586403 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b1a02a57-03cf-4b9e-bd30-232d79205192 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:00:46.653771 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b1a02a57-03cf-4b9e-bd30-232d79205192 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:00:46.661859 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b1a02a57-03cf-4b9e-bd30-232d79205192 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/7bf75f66-876f-4a9f-9902-d1f223d6eb12" status: 200 len: 1270 microversion: 2.1 time: 0.094711 Oct 04 20:00:46.662571 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4101/8217] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:00:46 2022] GET /compute/v2.1/servers/7bf75f66-876f-4a9f-9902-d1f223d6eb12 => generated 1270 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:00:47.685697 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-da7054cc-5ba3-4f0c-9171-4e68ca4b79bf tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:00:47.686324 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-da7054cc-5ba3-4f0c-9171-4e68ca4b79bf tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 7bf75f66-876f-4a9f-9902-d1f223d6eb12] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:00:47.694563 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-da7054cc-5ba3-4f0c-9171-4e68ca4b79bf tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:00:47.695063 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-da7054cc-5ba3-4f0c-9171-4e68ca4b79bf tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:00:47.695525 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-da7054cc-5ba3-4f0c-9171-4e68ca4b79bf tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:00:47.696273 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-da7054cc-5ba3-4f0c-9171-4e68ca4b79bf tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:00:47.696745 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-da7054cc-5ba3-4f0c-9171-4e68ca4b79bf tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:00:47.697186 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-da7054cc-5ba3-4f0c-9171-4e68ca4b79bf tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:00:47.775988 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-da7054cc-5ba3-4f0c-9171-4e68ca4b79bf tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:00:47.790784 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-da7054cc-5ba3-4f0c-9171-4e68ca4b79bf tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/7bf75f66-876f-4a9f-9902-d1f223d6eb12" status: 200 len: 1326 microversion: 2.1 time: 0.109603 Oct 04 20:00:47.791373 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4117/8218] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:00:47 2022] GET /compute/v2.1/servers/7bf75f66-876f-4a9f-9902-d1f223d6eb12 => generated 1326 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:00:48.815858 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6deea4c5-6d6a-4ecc-85df-93f68c494ec6 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:00:48.816529 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-6deea4c5-6d6a-4ecc-85df-93f68c494ec6 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 7bf75f66-876f-4a9f-9902-d1f223d6eb12] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:00:48.823974 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6deea4c5-6d6a-4ecc-85df-93f68c494ec6 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:00:48.824586 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6deea4c5-6d6a-4ecc-85df-93f68c494ec6 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:00:48.825057 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6deea4c5-6d6a-4ecc-85df-93f68c494ec6 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:00:48.825863 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6deea4c5-6d6a-4ecc-85df-93f68c494ec6 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:00:48.826343 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6deea4c5-6d6a-4ecc-85df-93f68c494ec6 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:00:48.826795 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6deea4c5-6d6a-4ecc-85df-93f68c494ec6 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:00:49.164945 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-6deea4c5-6d6a-4ecc-85df-93f68c494ec6 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:00:49.173486 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6deea4c5-6d6a-4ecc-85df-93f68c494ec6 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/7bf75f66-876f-4a9f-9902-d1f223d6eb12" status: 200 len: 1391 microversion: 2.1 time: 0.361911 Oct 04 20:00:49.174070 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4102/8219] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:00:48 2022] GET /compute/v2.1/servers/7bf75f66-876f-4a9f-9902-d1f223d6eb12 => generated 1391 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:00:49.877366 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-ce15c58f-df25-4094-b853-414b7dfdb755 req-4379809a-a14e-420e-b853-34de36af3044 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bf75f66-876f-4a9f-9902-d1f223d6eb12", "tag": "1b0f0cb3-7096-42af-81fe-bb225a65101e"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:00:49.890684 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-ce15c58f-df25-4094-b853-414b7dfdb755 req-4379809a-a14e-420e-b853-34de36af3044 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:00:49.898684 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-ce15c58f-df25-4094-b853-414b7dfdb755 req-4379809a-a14e-420e-b853-34de36af3044 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:00:49.898684 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-ce15c58f-df25-4094-b853-414b7dfdb755 req-4379809a-a14e-420e-b853-34de36af3044 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:00:49.905794 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-ce15c58f-df25-4094-b853-414b7dfdb755 req-4379809a-a14e-420e-b853-34de36af3044 service nova] Creating event network-changed:1b0f0cb3-7096-42af-81fe-bb225a65101e for instance 7bf75f66-876f-4a9f-9902-d1f223d6eb12 on n-h1-850501-14 Oct 04 20:00:49.910914 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-ce15c58f-df25-4094-b853-414b7dfdb755 req-4379809a-a14e-420e-b853-34de36af3044 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037364 Oct 04 20:00:49.911962 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4118/8220] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 20:00:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:00:50.197614 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-65795f20-737e-499e-94a7-0241badfeb97 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:00:50.198276 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-65795f20-737e-499e-94a7-0241badfeb97 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 7bf75f66-876f-4a9f-9902-d1f223d6eb12] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:00:50.207426 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-65795f20-737e-499e-94a7-0241badfeb97 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:00:50.207941 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-65795f20-737e-499e-94a7-0241badfeb97 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:00:50.208459 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-65795f20-737e-499e-94a7-0241badfeb97 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:00:50.209189 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-65795f20-737e-499e-94a7-0241badfeb97 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:00:50.209680 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-65795f20-737e-499e-94a7-0241badfeb97 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:00:50.210186 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-65795f20-737e-499e-94a7-0241badfeb97 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:00:50.425330 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-65795f20-737e-499e-94a7-0241badfeb97 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:00:50.433096 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-65795f20-737e-499e-94a7-0241badfeb97 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/7bf75f66-876f-4a9f-9902-d1f223d6eb12" status: 200 len: 1391 microversion: 2.1 time: 0.239455 Oct 04 20:00:50.433814 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4103/8221] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:00:50 2022] GET /compute/v2.1/servers/7bf75f66-876f-4a9f-9902-d1f223d6eb12 => generated 1391 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:00:51.457026 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-df3da4ef-a549-4229-8e59-b7c01100a6bb tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:00:51.457729 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-df3da4ef-a549-4229-8e59-b7c01100a6bb tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 7bf75f66-876f-4a9f-9902-d1f223d6eb12] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:00:51.464770 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-df3da4ef-a549-4229-8e59-b7c01100a6bb tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:00:51.465848 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-df3da4ef-a549-4229-8e59-b7c01100a6bb tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:00:51.466289 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-df3da4ef-a549-4229-8e59-b7c01100a6bb tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:00:51.466973 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-df3da4ef-a549-4229-8e59-b7c01100a6bb tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:00:51.467425 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-df3da4ef-a549-4229-8e59-b7c01100a6bb tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:00:51.467849 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-df3da4ef-a549-4229-8e59-b7c01100a6bb tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:00:51.602921 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-df3da4ef-a549-4229-8e59-b7c01100a6bb tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:00:51.610953 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-df3da4ef-a549-4229-8e59-b7c01100a6bb tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/7bf75f66-876f-4a9f-9902-d1f223d6eb12" status: 200 len: 1391 microversion: 2.1 time: 0.158253 Oct 04 20:00:51.611523 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4119/8222] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:00:51 2022] GET /compute/v2.1/servers/7bf75f66-876f-4a9f-9902-d1f223d6eb12 => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:00:52.634554 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d8a2bb75-5140-46d0-a5c7-4ce5e09e6c47 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:00:52.635182 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d8a2bb75-5140-46d0-a5c7-4ce5e09e6c47 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 7bf75f66-876f-4a9f-9902-d1f223d6eb12] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:00:52.643170 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d8a2bb75-5140-46d0-a5c7-4ce5e09e6c47 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:00:52.643671 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d8a2bb75-5140-46d0-a5c7-4ce5e09e6c47 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:00:52.644199 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d8a2bb75-5140-46d0-a5c7-4ce5e09e6c47 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:00:52.644922 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d8a2bb75-5140-46d0-a5c7-4ce5e09e6c47 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:00:52.645394 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d8a2bb75-5140-46d0-a5c7-4ce5e09e6c47 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:00:52.645835 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d8a2bb75-5140-46d0-a5c7-4ce5e09e6c47 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:00:52.781558 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d8a2bb75-5140-46d0-a5c7-4ce5e09e6c47 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:00:52.789210 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d8a2bb75-5140-46d0-a5c7-4ce5e09e6c47 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/7bf75f66-876f-4a9f-9902-d1f223d6eb12" status: 200 len: 1391 microversion: 2.1 time: 0.158555 Oct 04 20:00:52.789786 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4104/8223] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:00:52 2022] GET /compute/v2.1/servers/7bf75f66-876f-4a9f-9902-d1f223d6eb12 => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:00:53.814025 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ad02bef8-0828-42c8-b187-7dbb5aca7bd6 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:00:53.814669 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ad02bef8-0828-42c8-b187-7dbb5aca7bd6 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 7bf75f66-876f-4a9f-9902-d1f223d6eb12] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:00:53.821528 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ad02bef8-0828-42c8-b187-7dbb5aca7bd6 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:00:53.822017 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ad02bef8-0828-42c8-b187-7dbb5aca7bd6 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:00:53.822461 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ad02bef8-0828-42c8-b187-7dbb5aca7bd6 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:00:53.823208 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ad02bef8-0828-42c8-b187-7dbb5aca7bd6 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:00:53.823672 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ad02bef8-0828-42c8-b187-7dbb5aca7bd6 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:00:53.824703 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ad02bef8-0828-42c8-b187-7dbb5aca7bd6 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:00:53.955796 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ad02bef8-0828-42c8-b187-7dbb5aca7bd6 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:00:53.963489 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ad02bef8-0828-42c8-b187-7dbb5aca7bd6 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/7bf75f66-876f-4a9f-9902-d1f223d6eb12" status: 200 len: 1391 microversion: 2.1 time: 0.153528 Oct 04 20:00:53.964094 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4120/8224] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:00:53 2022] GET /compute/v2.1/servers/7bf75f66-876f-4a9f-9902-d1f223d6eb12 => generated 1391 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:00:54.987378 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b0e8c2ef-34a3-4e4e-aad6-96433ff1ea8f tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:00:54.987986 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b0e8c2ef-34a3-4e4e-aad6-96433ff1ea8f tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 7bf75f66-876f-4a9f-9902-d1f223d6eb12] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:00:54.994945 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b0e8c2ef-34a3-4e4e-aad6-96433ff1ea8f tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:00:54.995445 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b0e8c2ef-34a3-4e4e-aad6-96433ff1ea8f tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:00:54.996015 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b0e8c2ef-34a3-4e4e-aad6-96433ff1ea8f tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:00:54.997269 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b0e8c2ef-34a3-4e4e-aad6-96433ff1ea8f tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:00:54.997741 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b0e8c2ef-34a3-4e4e-aad6-96433ff1ea8f tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:00:54.998187 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b0e8c2ef-34a3-4e4e-aad6-96433ff1ea8f tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:00:55.141206 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b0e8c2ef-34a3-4e4e-aad6-96433ff1ea8f tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:00:55.147841 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b0e8c2ef-34a3-4e4e-aad6-96433ff1ea8f tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/7bf75f66-876f-4a9f-9902-d1f223d6eb12" status: 200 len: 1391 microversion: 2.1 time: 0.164428 Oct 04 20:00:55.148465 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4105/8225] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:00:54 2022] GET /compute/v2.1/servers/7bf75f66-876f-4a9f-9902-d1f223d6eb12 => generated 1391 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:00:56.173682 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-470d93ea-ed6c-4c80-bed4-617ac992cc19 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:00:56.174230 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-470d93ea-ed6c-4c80-bed4-617ac992cc19 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 7bf75f66-876f-4a9f-9902-d1f223d6eb12] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:00:56.177045 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=6 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:00:56.182005 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-470d93ea-ed6c-4c80-bed4-617ac992cc19 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:00:56.182499 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-470d93ea-ed6c-4c80-bed4-617ac992cc19 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:00:56.183011 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-470d93ea-ed6c-4c80-bed4-617ac992cc19 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:00:56.184037 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-470d93ea-ed6c-4c80-bed4-617ac992cc19 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:00:56.184678 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-470d93ea-ed6c-4c80-bed4-617ac992cc19 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:00:56.187840 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-470d93ea-ed6c-4c80-bed4-617ac992cc19 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:00:56.263393 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-7e4432ec-63b6-4053-8641-8a2629c6fa7f req-e1f3ac27-2e17-41f0-b38d-acb1f1042996 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bf75f66-876f-4a9f-9902-d1f223d6eb12", "name": "network-vif-plugged", "status": "completed", "tag": "1b0f0cb3-7096-42af-81fe-bb225a65101e"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:00:56.270042 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:00:56.270736 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=6 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:00:56.275673 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-7e4432ec-63b6-4053-8641-8a2629c6fa7f req-e1f3ac27-2e17-41f0-b38d-acb1f1042996 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:00:56.276199 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-7e4432ec-63b6-4053-8641-8a2629c6fa7f req-e1f3ac27-2e17-41f0-b38d-acb1f1042996 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:00:56.276647 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-7e4432ec-63b6-4053-8641-8a2629c6fa7f req-e1f3ac27-2e17-41f0-b38d-acb1f1042996 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:00:56.289476 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-7e4432ec-63b6-4053-8641-8a2629c6fa7f req-e1f3ac27-2e17-41f0-b38d-acb1f1042996 service nova] Creating event network-vif-plugged:1b0f0cb3-7096-42af-81fe-bb225a65101e for instance 7bf75f66-876f-4a9f-9902-d1f223d6eb12 on n-h1-850501-14 Oct 04 20:00:56.295256 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-7e4432ec-63b6-4053-8641-8a2629c6fa7f req-e1f3ac27-2e17-41f0-b38d-acb1f1042996 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036090 Oct 04 20:00:56.295878 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4106/8226] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 20:00:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:00:56.325617 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-470d93ea-ed6c-4c80-bed4-617ac992cc19 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:00:56.337098 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-470d93ea-ed6c-4c80-bed4-617ac992cc19 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/7bf75f66-876f-4a9f-9902-d1f223d6eb12" status: 200 len: 1391 microversion: 2.1 time: 0.165579 Oct 04 20:00:56.337098 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4121/8227] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:00:56 2022] GET /compute/v2.1/servers/7bf75f66-876f-4a9f-9902-d1f223d6eb12 => generated 1391 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:00:57.361845 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ab051b4c-ebc7-4c63-bad6-76e4dacc48e9 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:00:57.362599 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ab051b4c-ebc7-4c63-bad6-76e4dacc48e9 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 7bf75f66-876f-4a9f-9902-d1f223d6eb12] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:00:57.370690 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ab051b4c-ebc7-4c63-bad6-76e4dacc48e9 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:00:57.372312 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ab051b4c-ebc7-4c63-bad6-76e4dacc48e9 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:00:57.372772 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ab051b4c-ebc7-4c63-bad6-76e4dacc48e9 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:00:57.373484 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ab051b4c-ebc7-4c63-bad6-76e4dacc48e9 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:00:57.373957 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ab051b4c-ebc7-4c63-bad6-76e4dacc48e9 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:00:57.374399 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ab051b4c-ebc7-4c63-bad6-76e4dacc48e9 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:00:57.512896 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ab051b4c-ebc7-4c63-bad6-76e4dacc48e9 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:00:57.521223 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ab051b4c-ebc7-4c63-bad6-76e4dacc48e9 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/7bf75f66-876f-4a9f-9902-d1f223d6eb12" status: 200 len: 1391 microversion: 2.1 time: 0.163718 Oct 04 20:00:57.521820 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4107/8228] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:00:57 2022] GET /compute/v2.1/servers/7bf75f66-876f-4a9f-9902-d1f223d6eb12 => generated 1391 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:00:58.546292 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-08657629-e480-4efd-853d-26d6cd09c3ef tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:00:58.546909 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-08657629-e480-4efd-853d-26d6cd09c3ef tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 7bf75f66-876f-4a9f-9902-d1f223d6eb12] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:00:58.553881 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-08657629-e480-4efd-853d-26d6cd09c3ef tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:00:58.554372 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-08657629-e480-4efd-853d-26d6cd09c3ef tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:00:58.554811 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-08657629-e480-4efd-853d-26d6cd09c3ef tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:00:58.555547 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-08657629-e480-4efd-853d-26d6cd09c3ef tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:00:58.555999 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-08657629-e480-4efd-853d-26d6cd09c3ef tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:00:58.556465 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-08657629-e480-4efd-853d-26d6cd09c3ef tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:00:58.687729 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-08657629-e480-4efd-853d-26d6cd09c3ef tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:00:58.695403 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-08657629-e480-4efd-853d-26d6cd09c3ef tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/7bf75f66-876f-4a9f-9902-d1f223d6eb12" status: 200 len: 1563 microversion: 2.1 time: 0.154124 Oct 04 20:00:58.695965 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4122/8229] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:00:58 2022] GET /compute/v2.1/servers/7bf75f66-876f-4a9f-9902-d1f223d6eb12 => generated 1563 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:00:58.718885 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b54db35e-0173-4965-9c2a-d4eddec638ce tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:00:58.719527 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b54db35e-0173-4965-9c2a-d4eddec638ce tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 7bf75f66-876f-4a9f-9902-d1f223d6eb12] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:00:58.722433 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:00:58.727448 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b54db35e-0173-4965-9c2a-d4eddec638ce tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:00:58.727945 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b54db35e-0173-4965-9c2a-d4eddec638ce tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:00:58.728430 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b54db35e-0173-4965-9c2a-d4eddec638ce tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:00:58.729137 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b54db35e-0173-4965-9c2a-d4eddec638ce tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:00:58.729616 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b54db35e-0173-4965-9c2a-d4eddec638ce tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:00:58.730567 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b54db35e-0173-4965-9c2a-d4eddec638ce tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:00:58.873281 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b54db35e-0173-4965-9c2a-d4eddec638ce tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:00:58.880970 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b54db35e-0173-4965-9c2a-d4eddec638ce tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/7bf75f66-876f-4a9f-9902-d1f223d6eb12" status: 200 len: 1563 microversion: 2.1 time: 0.166685 Oct 04 20:00:58.881557 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4108/8230] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:00:58 2022] GET /compute/v2.1/servers/7bf75f66-876f-4a9f-9902-d1f223d6eb12 => generated 1563 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:01:00.765936 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-229cbafd-47ef-4947-8da9-7fef8f5358bb tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:01:00.766564 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-229cbafd-47ef-4947-8da9-7fef8f5358bb tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 7bf75f66-876f-4a9f-9902-d1f223d6eb12] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:01:00.768378 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-ef6436a5-6669-4c65-982e-0b127c6714df req-0fd5f60d-567c-48bb-ab45-74bd844e70da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bf75f66-876f-4a9f-9902-d1f223d6eb12", "tag": "1b0f0cb3-7096-42af-81fe-bb225a65101e"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:01:00.769288 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:01:00.774157 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-229cbafd-47ef-4947-8da9-7fef8f5358bb tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:01:00.774656 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-229cbafd-47ef-4947-8da9-7fef8f5358bb tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:01:00.775101 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-229cbafd-47ef-4947-8da9-7fef8f5358bb tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:01:00.776148 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-229cbafd-47ef-4947-8da9-7fef8f5358bb tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:01:00.776885 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-229cbafd-47ef-4947-8da9-7fef8f5358bb tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:01:00.777458 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-229cbafd-47ef-4947-8da9-7fef8f5358bb tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:01:00.782188 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-ef6436a5-6669-4c65-982e-0b127c6714df req-0fd5f60d-567c-48bb-ab45-74bd844e70da service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:01:00.783010 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-ef6436a5-6669-4c65-982e-0b127c6714df req-0fd5f60d-567c-48bb-ab45-74bd844e70da service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:01:00.784003 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-ef6436a5-6669-4c65-982e-0b127c6714df req-0fd5f60d-567c-48bb-ab45-74bd844e70da service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:01:00.810145 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-ef6436a5-6669-4c65-982e-0b127c6714df req-0fd5f60d-567c-48bb-ab45-74bd844e70da service nova] Creating event network-changed:1b0f0cb3-7096-42af-81fe-bb225a65101e for instance 7bf75f66-876f-4a9f-9902-d1f223d6eb12 on n-h1-850501-14 Oct 04 20:01:00.813456 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-ef6436a5-6669-4c65-982e-0b127c6714df req-0fd5f60d-567c-48bb-ab45-74bd844e70da service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048769 Oct 04 20:01:00.814516 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4109/8231] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 20:01:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:01:01.021008 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-229cbafd-47ef-4947-8da9-7fef8f5358bb tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:01:01.030390 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-229cbafd-47ef-4947-8da9-7fef8f5358bb tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/7bf75f66-876f-4a9f-9902-d1f223d6eb12" status: 200 len: 1563 microversion: 2.1 time: 0.268870 Oct 04 20:01:01.031302 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4123/8232] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:01:00 2022] GET /compute/v2.1/servers/7bf75f66-876f-4a9f-9902-d1f223d6eb12 => generated 1563 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:01:22.317815 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=3 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:01:22.318705 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=48 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:01:22.323491 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-aefcbfe5-a111-492c-b54c-16c878035af6 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:01:22.325903 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-aefcbfe5-a111-492c-b54c-16c878035af6 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 7bf75f66-876f-4a9f-9902-d1f223d6eb12] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:01:22.331933 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aefcbfe5-a111-492c-b54c-16c878035af6 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:01:22.332464 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aefcbfe5-a111-492c-b54c-16c878035af6 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:01:22.332921 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aefcbfe5-a111-492c-b54c-16c878035af6 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:01:22.333631 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aefcbfe5-a111-492c-b54c-16c878035af6 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:01:22.334118 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aefcbfe5-a111-492c-b54c-16c878035af6 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:01:22.334558 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aefcbfe5-a111-492c-b54c-16c878035af6 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:01:22.386709 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-aefcbfe5-a111-492c-b54c-16c878035af6 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "POST /compute/v2.1/servers/7bf75f66-876f-4a9f-9902-d1f223d6eb12/action" status: 200 len: 24572 microversion: 2.1 time: 0.070679 Oct 04 20:01:22.387354 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4110/8233] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 20:01:22 2022] POST /compute/v2.1/servers/7bf75f66-876f-4a9f-9902-d1f223d6eb12/action => generated 24572 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:01:28.747378 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-874fdc36-b0ea-468c-9466-12ff812ab255 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:01:28.747934 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-874fdc36-b0ea-468c-9466-12ff812ab255 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 7bf75f66-876f-4a9f-9902-d1f223d6eb12] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:01:28.750384 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:01:28.751069 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=38 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:01:28.755865 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-874fdc36-b0ea-468c-9466-12ff812ab255 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:01:28.756387 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-874fdc36-b0ea-468c-9466-12ff812ab255 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:01:28.756824 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-874fdc36-b0ea-468c-9466-12ff812ab255 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:01:28.757507 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-874fdc36-b0ea-468c-9466-12ff812ab255 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:01:28.758042 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-874fdc36-b0ea-468c-9466-12ff812ab255 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:01:28.758465 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-874fdc36-b0ea-468c-9466-12ff812ab255 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:01:28.781266 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-874fdc36-b0ea-468c-9466-12ff812ab255 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lazy-loading 'flavor' on Instance uuid 7bf75f66-876f-4a9f-9902-d1f223d6eb12 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:01:29.040246 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-874fdc36-b0ea-468c-9466-12ff812ab255 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "POST /compute/v2.1/servers/7bf75f66-876f-4a9f-9902-d1f223d6eb12/action" status: 202 len: 0 microversion: 2.1 time: 0.297429 Oct 04 20:01:29.040815 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4124/8234] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 20:01:28 2022] POST /compute/v2.1/servers/7bf75f66-876f-4a9f-9902-d1f223d6eb12/action => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:01:29.050266 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-81061359-a9a3-49f4-b23d-f6b9a8da3ca4 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:01:29.050996 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-81061359-a9a3-49f4-b23d-f6b9a8da3ca4 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 7bf75f66-876f-4a9f-9902-d1f223d6eb12] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:01:29.059184 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-81061359-a9a3-49f4-b23d-f6b9a8da3ca4 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:01:29.064244 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-81061359-a9a3-49f4-b23d-f6b9a8da3ca4 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:01:29.064244 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-81061359-a9a3-49f4-b23d-f6b9a8da3ca4 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:01:29.064244 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-81061359-a9a3-49f4-b23d-f6b9a8da3ca4 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:01:29.064244 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-81061359-a9a3-49f4-b23d-f6b9a8da3ca4 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:01:29.064244 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-81061359-a9a3-49f4-b23d-f6b9a8da3ca4 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:01:29.534646 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-81061359-a9a3-49f4-b23d-f6b9a8da3ca4 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:01:29.544296 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-81061359-a9a3-49f4-b23d-f6b9a8da3ca4 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/7bf75f66-876f-4a9f-9902-d1f223d6eb12" status: 200 len: 1690 microversion: 2.1 time: 0.498671 Oct 04 20:01:29.547664 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4111/8235] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:01:29 2022] GET /compute/v2.1/servers/7bf75f66-876f-4a9f-9902-d1f223d6eb12 => generated 1690 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:01:30.574904 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4ce87410-47f9-472e-bb4f-9592b9a61fa7 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:01:30.575607 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-4ce87410-47f9-472e-bb4f-9592b9a61fa7 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 7bf75f66-876f-4a9f-9902-d1f223d6eb12] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:01:30.581792 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4ce87410-47f9-472e-bb4f-9592b9a61fa7 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:01:30.582272 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4ce87410-47f9-472e-bb4f-9592b9a61fa7 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:01:30.582704 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4ce87410-47f9-472e-bb4f-9592b9a61fa7 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:01:30.583388 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4ce87410-47f9-472e-bb4f-9592b9a61fa7 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:01:30.583838 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4ce87410-47f9-472e-bb4f-9592b9a61fa7 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:01:30.584288 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4ce87410-47f9-472e-bb4f-9592b9a61fa7 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:01:30.716336 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-4ce87410-47f9-472e-bb4f-9592b9a61fa7 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:01:30.724351 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-4ce87410-47f9-472e-bb4f-9592b9a61fa7 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/7bf75f66-876f-4a9f-9902-d1f223d6eb12" status: 200 len: 1673 microversion: 2.1 time: 0.155373 Oct 04 20:01:30.724912 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4125/8236] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:01:30 2022] GET /compute/v2.1/servers/7bf75f66-876f-4a9f-9902-d1f223d6eb12 => generated 1673 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:01:31.820739 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7574f5ee-9d6c-4122-9c06-26a70fa0051b tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:01:31.823500 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7574f5ee-9d6c-4122-9c06-26a70fa0051b tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 7bf75f66-876f-4a9f-9902-d1f223d6eb12] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:01:31.831232 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7574f5ee-9d6c-4122-9c06-26a70fa0051b tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:01:31.831728 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7574f5ee-9d6c-4122-9c06-26a70fa0051b tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:01:31.832216 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7574f5ee-9d6c-4122-9c06-26a70fa0051b tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:01:31.832920 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7574f5ee-9d6c-4122-9c06-26a70fa0051b tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:01:31.833411 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7574f5ee-9d6c-4122-9c06-26a70fa0051b tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:01:31.833850 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7574f5ee-9d6c-4122-9c06-26a70fa0051b tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:01:31.884505 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7574f5ee-9d6c-4122-9c06-26a70fa0051b tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "POST /compute/v2.1/servers/7bf75f66-876f-4a9f-9902-d1f223d6eb12/action" status: 200 len: 35100 microversion: 2.1 time: 0.067438 Oct 04 20:01:31.885674 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4112/8237] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 20:01:31 2022] POST /compute/v2.1/servers/7bf75f66-876f-4a9f-9902-d1f223d6eb12/action => generated 35100 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:01:31.899065 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3a575be7-fb28-43e3-8939-be00ef011550 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:01:31.899699 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3a575be7-fb28-43e3-8939-be00ef011550 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 7bf75f66-876f-4a9f-9902-d1f223d6eb12] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:01:31.908217 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3a575be7-fb28-43e3-8939-be00ef011550 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:01:31.908722 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3a575be7-fb28-43e3-8939-be00ef011550 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:01:31.909157 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3a575be7-fb28-43e3-8939-be00ef011550 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:01:31.910150 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3a575be7-fb28-43e3-8939-be00ef011550 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:01:31.910327 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3a575be7-fb28-43e3-8939-be00ef011550 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:01:31.912046 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3a575be7-fb28-43e3-8939-be00ef011550 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:01:32.165534 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3a575be7-fb28-43e3-8939-be00ef011550 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "POST /compute/v2.1/servers/7bf75f66-876f-4a9f-9902-d1f223d6eb12/action" status: 202 len: 0 microversion: 2.1 time: 0.270095 Oct 04 20:01:32.166620 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4126/8238] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 20:01:31 2022] POST /compute/v2.1/servers/7bf75f66-876f-4a9f-9902-d1f223d6eb12/action => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:01:32.176006 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-792fe763-e526-47b3-8031-b8aae5b32e68 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:01:32.176762 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-792fe763-e526-47b3-8031-b8aae5b32e68 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 7bf75f66-876f-4a9f-9902-d1f223d6eb12] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:01:32.184242 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-792fe763-e526-47b3-8031-b8aae5b32e68 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:01:32.184747 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-792fe763-e526-47b3-8031-b8aae5b32e68 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:01:32.185198 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-792fe763-e526-47b3-8031-b8aae5b32e68 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:01:32.185900 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-792fe763-e526-47b3-8031-b8aae5b32e68 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:01:32.186371 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-792fe763-e526-47b3-8031-b8aae5b32e68 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:01:32.186807 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-792fe763-e526-47b3-8031-b8aae5b32e68 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:01:32.320754 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-792fe763-e526-47b3-8031-b8aae5b32e68 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:01:32.330363 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-792fe763-e526-47b3-8031-b8aae5b32e68 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/7bf75f66-876f-4a9f-9902-d1f223d6eb12" status: 200 len: 1679 microversion: 2.1 time: 0.158609 Oct 04 20:01:32.330958 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4113/8239] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:01:32 2022] GET /compute/v2.1/servers/7bf75f66-876f-4a9f-9902-d1f223d6eb12 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:01:33.357024 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-54dcc872-d5f1-4de2-bed8-73124bca46ac tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:01:33.357728 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-54dcc872-d5f1-4de2-bed8-73124bca46ac tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 7bf75f66-876f-4a9f-9902-d1f223d6eb12] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:01:33.363922 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-54dcc872-d5f1-4de2-bed8-73124bca46ac tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:01:33.364439 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-54dcc872-d5f1-4de2-bed8-73124bca46ac tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:01:33.364877 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-54dcc872-d5f1-4de2-bed8-73124bca46ac tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:01:33.365567 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-54dcc872-d5f1-4de2-bed8-73124bca46ac tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:01:33.366024 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-54dcc872-d5f1-4de2-bed8-73124bca46ac tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:01:33.366456 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-54dcc872-d5f1-4de2-bed8-73124bca46ac tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:01:33.501393 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-54dcc872-d5f1-4de2-bed8-73124bca46ac tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:01:33.509237 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-54dcc872-d5f1-4de2-bed8-73124bca46ac tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/7bf75f66-876f-4a9f-9902-d1f223d6eb12" status: 200 len: 1679 microversion: 2.1 time: 0.158147 Oct 04 20:01:33.509770 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4127/8240] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:01:33 2022] GET /compute/v2.1/servers/7bf75f66-876f-4a9f-9902-d1f223d6eb12 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:01:34.532907 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0fab8817-9d39-4be2-a783-790054b47bea tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:01:34.533534 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0fab8817-9d39-4be2-a783-790054b47bea tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 7bf75f66-876f-4a9f-9902-d1f223d6eb12] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:01:34.540223 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0fab8817-9d39-4be2-a783-790054b47bea tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:01:34.540719 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0fab8817-9d39-4be2-a783-790054b47bea tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:01:34.541214 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0fab8817-9d39-4be2-a783-790054b47bea tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:01:34.542100 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0fab8817-9d39-4be2-a783-790054b47bea tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:01:34.542564 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0fab8817-9d39-4be2-a783-790054b47bea tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:01:34.543049 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0fab8817-9d39-4be2-a783-790054b47bea tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:01:34.677761 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0fab8817-9d39-4be2-a783-790054b47bea tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:01:34.686220 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0fab8817-9d39-4be2-a783-790054b47bea tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/7bf75f66-876f-4a9f-9902-d1f223d6eb12" status: 200 len: 1682 microversion: 2.1 time: 0.157338 Oct 04 20:01:34.686797 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4114/8241] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:01:34 2022] GET /compute/v2.1/servers/7bf75f66-876f-4a9f-9902-d1f223d6eb12 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:01:34.787158 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-4c4461fe-368c-47d1-8d60-b7df955d2174 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:01:34.789402 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-4c4461fe-368c-47d1-8d60-b7df955d2174 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 7bf75f66-876f-4a9f-9902-d1f223d6eb12] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:01:34.796910 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4c4461fe-368c-47d1-8d60-b7df955d2174 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:01:34.797401 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4c4461fe-368c-47d1-8d60-b7df955d2174 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:01:34.797847 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4c4461fe-368c-47d1-8d60-b7df955d2174 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:01:34.798539 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4c4461fe-368c-47d1-8d60-b7df955d2174 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:01:34.799003 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4c4461fe-368c-47d1-8d60-b7df955d2174 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:01:34.799432 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-4c4461fe-368c-47d1-8d60-b7df955d2174 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:01:34.840736 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-4c4461fe-368c-47d1-8d60-b7df955d2174 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "POST /compute/v2.1/servers/7bf75f66-876f-4a9f-9902-d1f223d6eb12/action" status: 200 len: 35100 microversion: 2.1 time: 0.057324 Oct 04 20:01:34.841405 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4128/8242] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 20:01:34 2022] POST /compute/v2.1/servers/7bf75f66-876f-4a9f-9902-d1f223d6eb12/action => generated 35100 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:01:35.965736 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-20dcfe00-0057-4bc6-871f-21ffd3fa161d tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:01:35.971668 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-20dcfe00-0057-4bc6-871f-21ffd3fa161d tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 7bf75f66-876f-4a9f-9902-d1f223d6eb12] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:01:35.977468 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-20dcfe00-0057-4bc6-871f-21ffd3fa161d tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:01:35.978111 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-20dcfe00-0057-4bc6-871f-21ffd3fa161d tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:01:35.978783 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-20dcfe00-0057-4bc6-871f-21ffd3fa161d tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:01:35.980175 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-20dcfe00-0057-4bc6-871f-21ffd3fa161d tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:01:35.980691 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-20dcfe00-0057-4bc6-871f-21ffd3fa161d tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:01:35.981122 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-20dcfe00-0057-4bc6-871f-21ffd3fa161d tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:01:36.012363 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-20dcfe00-0057-4bc6-871f-21ffd3fa161d tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 7bf75f66-876f-4a9f-9902-d1f223d6eb12] Going to try to terminate instance {{(pid=123002) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:01:36.049962 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-6e599819-de2a-4b42-bd7e-af404c0a1d1c req-1396b409-392d-4bc1-b724-76061e83d750 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bf75f66-876f-4a9f-9902-d1f223d6eb12", "tag": "1b0f0cb3-7096-42af-81fe-bb225a65101e"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:01:36.062153 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-6e599819-de2a-4b42-bd7e-af404c0a1d1c req-1396b409-392d-4bc1-b724-76061e83d750 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:01:36.062907 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-6e599819-de2a-4b42-bd7e-af404c0a1d1c req-1396b409-392d-4bc1-b724-76061e83d750 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:01:36.063348 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-6e599819-de2a-4b42-bd7e-af404c0a1d1c req-1396b409-392d-4bc1-b724-76061e83d750 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:01:36.075314 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-6e599819-de2a-4b42-bd7e-af404c0a1d1c req-1396b409-392d-4bc1-b724-76061e83d750 service nova] Creating event network-changed:1b0f0cb3-7096-42af-81fe-bb225a65101e for instance 7bf75f66-876f-4a9f-9902-d1f223d6eb12 on n-h1-850501-14 Oct 04 20:01:36.081146 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-6e599819-de2a-4b42-bd7e-af404c0a1d1c req-1396b409-392d-4bc1-b724-76061e83d750 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115388 Oct 04 20:01:36.082130 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4129/8243] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 20:01:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:01:36.545349 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-20dcfe00-0057-4bc6-871f-21ffd3fa161d tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7bf75f66-876f-4a9f-9902-d1f223d6eb12" status: 204 len: 0 microversion: 2.1 time: 0.583262 Oct 04 20:01:36.546198 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4115/8244] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 20:01:35 2022] DELETE /compute/v2.1/servers/7bf75f66-876f-4a9f-9902-d1f223d6eb12 => generated 0 bytes in 585 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:01:36.554853 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-32d23f68-0da8-478c-9792-0e02799e006d tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:01:36.555927 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-32d23f68-0da8-478c-9792-0e02799e006d tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 7bf75f66-876f-4a9f-9902-d1f223d6eb12] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:01:36.562856 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-32d23f68-0da8-478c-9792-0e02799e006d tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:01:36.567182 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-32d23f68-0da8-478c-9792-0e02799e006d tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:01:36.567182 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-32d23f68-0da8-478c-9792-0e02799e006d tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:01:36.567182 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-32d23f68-0da8-478c-9792-0e02799e006d tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:01:36.567182 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-32d23f68-0da8-478c-9792-0e02799e006d tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:01:36.567182 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-32d23f68-0da8-478c-9792-0e02799e006d tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:01:36.733606 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-32d23f68-0da8-478c-9792-0e02799e006d tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:01:36.741802 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-32d23f68-0da8-478c-9792-0e02799e006d tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/7bf75f66-876f-4a9f-9902-d1f223d6eb12" status: 200 len: 1688 microversion: 2.1 time: 0.191155 Oct 04 20:01:36.742375 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4130/8245] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:01:36 2022] GET /compute/v2.1/servers/7bf75f66-876f-4a9f-9902-d1f223d6eb12 => generated 1688 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:01:37.768843 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-96299b2d-ebd5-4086-8e87-88823beac681 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:01:37.769598 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-96299b2d-ebd5-4086-8e87-88823beac681 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 7bf75f66-876f-4a9f-9902-d1f223d6eb12] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:01:37.777847 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-96299b2d-ebd5-4086-8e87-88823beac681 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:01:37.778348 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-96299b2d-ebd5-4086-8e87-88823beac681 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:01:37.778801 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-96299b2d-ebd5-4086-8e87-88823beac681 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:01:37.779511 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-96299b2d-ebd5-4086-8e87-88823beac681 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:01:37.779987 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-96299b2d-ebd5-4086-8e87-88823beac681 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:01:37.780464 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-96299b2d-ebd5-4086-8e87-88823beac681 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:01:37.914850 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-96299b2d-ebd5-4086-8e87-88823beac681 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:01:37.923430 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-96299b2d-ebd5-4086-8e87-88823beac681 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/7bf75f66-876f-4a9f-9902-d1f223d6eb12" status: 200 len: 1688 microversion: 2.1 time: 0.158916 Oct 04 20:01:37.924003 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4116/8246] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:01:37 2022] GET /compute/v2.1/servers/7bf75f66-876f-4a9f-9902-d1f223d6eb12 => generated 1688 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:01:38.765326 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-10e679ea-9189-470b-9dbf-f260c1e8cd3b req-d1049551-6a38-49ff-904d-e75272c1d7f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bf75f66-876f-4a9f-9902-d1f223d6eb12", "name": "network-vif-deleted", "tag": "1b0f0cb3-7096-42af-81fe-bb225a65101e"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:01:38.775690 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-10e679ea-9189-470b-9dbf-f260c1e8cd3b req-d1049551-6a38-49ff-904d-e75272c1d7f3 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:01:38.776216 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-10e679ea-9189-470b-9dbf-f260c1e8cd3b req-d1049551-6a38-49ff-904d-e75272c1d7f3 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:01:38.776638 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-10e679ea-9189-470b-9dbf-f260c1e8cd3b req-d1049551-6a38-49ff-904d-e75272c1d7f3 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:01:38.787547 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-10e679ea-9189-470b-9dbf-f260c1e8cd3b req-d1049551-6a38-49ff-904d-e75272c1d7f3 service nova] Creating event network-vif-deleted:1b0f0cb3-7096-42af-81fe-bb225a65101e for instance 7bf75f66-876f-4a9f-9902-d1f223d6eb12 on n-h1-850501-14 Oct 04 20:01:38.792369 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-10e679ea-9189-470b-9dbf-f260c1e8cd3b req-d1049551-6a38-49ff-904d-e75272c1d7f3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030735 Oct 04 20:01:38.792951 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4131/8247] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 20:01:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:01:38.949138 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-30941f19-800e-4aa9-a339-d2c697ef6024 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:01:38.949679 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-30941f19-800e-4aa9-a339-d2c697ef6024 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 7bf75f66-876f-4a9f-9902-d1f223d6eb12] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:01:38.956616 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-30941f19-800e-4aa9-a339-d2c697ef6024 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:01:38.957125 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-30941f19-800e-4aa9-a339-d2c697ef6024 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:01:38.957583 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-30941f19-800e-4aa9-a339-d2c697ef6024 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:01:38.958299 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-30941f19-800e-4aa9-a339-d2c697ef6024 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:01:38.958775 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-30941f19-800e-4aa9-a339-d2c697ef6024 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:01:38.959221 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-30941f19-800e-4aa9-a339-d2c697ef6024 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:01:39.027444 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-30941f19-800e-4aa9-a339-d2c697ef6024 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb5459af175415da4825e6078eba908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7112e2b246a44297876ee6d279e8f655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:01:39.035599 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-30941f19-800e-4aa9-a339-d2c697ef6024 tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/7bf75f66-876f-4a9f-9902-d1f223d6eb12" status: 200 len: 1351 microversion: 2.1 time: 0.091100 Oct 04 20:01:39.036486 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4117/8248] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:01:38 2022] GET /compute/v2.1/servers/7bf75f66-876f-4a9f-9902-d1f223d6eb12 => generated 1351 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:01:40.060985 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-abfb28ce-afab-4c26-baef-9dcf329d731d tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:01:40.061606 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-abfb28ce-afab-4c26-baef-9dcf329d731d tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] [instance: 7bf75f66-876f-4a9f-9902-d1f223d6eb12] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:01:40.067804 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-abfb28ce-afab-4c26-baef-9dcf329d731d tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:01:40.068358 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-abfb28ce-afab-4c26-baef-9dcf329d731d tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:01:40.068806 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-abfb28ce-afab-4c26-baef-9dcf329d731d tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:01:40.069536 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-abfb28ce-afab-4c26-baef-9dcf329d731d tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:01:40.069999 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-abfb28ce-afab-4c26-baef-9dcf329d731d tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:01:40.070432 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-abfb28ce-afab-4c26-baef-9dcf329d731d tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:01:40.084373 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-abfb28ce-afab-4c26-baef-9dcf329d731d tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] HTTP exception thrown: Instance 7bf75f66-876f-4a9f-9902-d1f223d6eb12 could not be found. Oct 04 20:01:40.085983 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-abfb28ce-afab-4c26-baef-9dcf329d731d tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Request method failure captured: Oct 04 20:01:40.085983 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/7bf75f66-876f-4a9f-9902-d1f223d6eb12 HTTP/1.1 Oct 04 20:01:40.085983 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 20:01:40.085983 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 20:01:40.085983 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 20:01:40.085983 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 20:01:40.085983 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 20:01:40.085983 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 20:01:40.085983 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 20:01:40.085983 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 20:01:40.085983 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPI88jPqPFF3foNds79FcB9aFEPQ4j2aE77udaYKTwax2C5JHCysGdgy0FMgNwDOy13EsNaR0GwTaNiwC4DOXbgoj1xNuPI5o717aLLx16xkDOI9Y9C18IHU35Ip47q038B2FBqXcNSHdcfF09wzWairlH5Vr7NhdGSOsyjDGcd-usGY Oct 04 20:01:40.085983 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 20:01:40.085983 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 20:01:40.085983 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 20:01:40.085983 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 20:01:40.085983 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 20:01:40.085983 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 20:01:40.085983 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 7112e2b246a44297876ee6d279e8f655 Oct 04 20:01:40.085983 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1045305417 Oct 04 20:01:40.085983 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 20:01:40.085983 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 20:01:40.085983 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7112e2b246a44297876ee6d279e8f655"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7112e2b246a44297876ee6d279e8f655", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7112e2b246a44297876ee6d279e8f655"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7112e2b246a44297876ee6d279e8f655"}]}] Oct 04 20:01:40.085983 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1045305417 Oct 04 20:01:40.085983 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 7112e2b246a44297876ee6d279e8f655 Oct 04 20:01:40.085983 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1045305417 Oct 04 20:01:40.085983 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-TestNetworkAdvancedServerOps-1045305417-project Oct 04 20:01:40.085983 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 20:01:40.085983 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 20:01:40.085983 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: deb5459af175415da4825e6078eba908 Oct 04 20:01:40.085983 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1045305417-project Oct 04 20:01:40.085983 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 20:01:40.085983 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 7bf75f66-876f-4a9f-9902-d1f223d6eb12 could not be found. Oct 04 20:01:40.085983 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '7bf75f66-876f-4a9f-9902-d1f223d6eb12'} Oct 04 20:01:40.085983 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:01:40.085983 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:01:40.085983 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:01:40.085983 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:01:40.085983 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:01:40.085983 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:01:40.085983 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:01:40.085983 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:01:40.085983 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:01:40.085983 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:01:40.085983 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bf75f66-876f-4a9f-9902-d1f223d6eb12 could not be found. Oct 04 20:01:40.085983 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 20:01:40.085983 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:01:40.085983 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 20:01:40.085983 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:01:40.085983 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:01:40.085983 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:01:40.085983 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:01:40.085983 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:01:40.085983 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:01:40.085983 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:01:40.085983 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:01:40.085983 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:01:40.085983 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:01:40.085983 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:01:40.085983 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:01:40.085983 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:01:40.085983 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bf75f66-876f-4a9f-9902-d1f223d6eb12 could not be found. Oct 04 20:01:40.085983 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 20:01:40.085983 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:01:40.091878 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 20:01:40.091878 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:01:40.091878 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:01:40.091878 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:01:40.091878 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:01:40.091878 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:01:40.091878 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bf75f66-876f-4a9f-9902-d1f223d6eb12 could not be found. Oct 04 20:01:40.091878 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 20:01:40.091878 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-abfb28ce-afab-4c26-baef-9dcf329d731d tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Returning 404 to user: Instance 7bf75f66-876f-4a9f-9902-d1f223d6eb12 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:01:40.091878 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-abfb28ce-afab-4c26-baef-9dcf329d731d tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "GET /compute/v2.1/servers/7bf75f66-876f-4a9f-9902-d1f223d6eb12" status: 404 len: 111 microversion: 2.1 time: 0.032355 Oct 04 20:01:40.091878 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4132/8249] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:01:40 2022] GET /compute/v2.1/servers/7bf75f66-876f-4a9f-9902-d1f223d6eb12 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:01:44.042441 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4beb2300-067e-482d-b061-57197ffffe1b tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] Calling method '.version_select at 0x7fe253d708b0>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:01:44.181505 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4beb2300-067e-482d-b061-57197ffffe1b tempest-TestNetworkAdvancedServerOps-1045305417 tempest-TestNetworkAdvancedServerOps-1045305417-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1896660805" status: 202 len: 0 microversion: 2.1 time: 0.143674 Oct 04 20:01:44.182103 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4118/8250] 10.222.0.20 () {58 vars in 1284 bytes} [Tue Oct 4 20:01:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1896660805 => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:02:01.366790 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=18 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:02:01.372164 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:02:01.554922 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9f22db7f-bf35-42ce-88bd-cbc029ffe727 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Action: 'create', calling method: .version_select at 0x7fe2539a2e50>, body: {"keypair": {"name": "tempest-TestShelveInstance-1573537177", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPTJ5keXdR/rdsd3vihlYmhqZu+mIShf/ebXLNxuHcOsjyAwOnJdiF0t5vqSe2COpmeZP1RmVwacE44fzzWgHxloPTD+FB9NVorAuGSOAZHT8JwHwGU55WiQ/LmLEWUcKQ=="}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:02:01.574395 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-9f22db7f-bf35-42ce-88bd-cbc029ffe727 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Getting quotas for project 92d5e2ecd4c34120afd16b7924267082. Resources: {'key_pairs'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:02:01.580479 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-9f22db7f-bf35-42ce-88bd-cbc029ffe727 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Getting quotas for user e363289512f8439bb0f2116f3e361e79 and project 92d5e2ecd4c34120afd16b7924267082. Resources: {'key_pairs'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:02:01.701696 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9f22db7f-bf35-42ce-88bd-cbc029ffe727 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.340451 Oct 04 20:02:01.702303 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4133/8251] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Oct 4 20:02:01 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:02:04.859673 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8045828f-09e3-4e13-bf00-8bfbaf1ac1da tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1160029256", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1573537177", "security_groups": [{"name": "tempest-secgroup-smoke-1642039715"}], "networks": [{"uuid": "275bc792-9a22-41d9-84cc-8a9097a610d0"}]}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:02:04.870241 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:02:04.871020 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:02:05.094263 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-8045828f-09e3-4e13-bf00-8bfbaf1ac1da tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] validate_networks() for [('275bc792-9a22-41d9-84cc-8a9097a610d0', None, None, None, None, None)] {{(pid=123002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:02:05.578986 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-8045828f-09e3-4e13-bf00-8bfbaf1ac1da tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:02:05.579428 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-8045828f-09e3-4e13-bf00-8bfbaf1ac1da tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:02:05.579921 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-8045828f-09e3-4e13-bf00-8bfbaf1ac1da tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:02:05.580388 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-8045828f-09e3-4e13-bf00-8bfbaf1ac1da tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:02:05.581003 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-8045828f-09e3-4e13-bf00-8bfbaf1ac1da tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:02:05.591122 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8045828f-09e3-4e13-bf00-8bfbaf1ac1da tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:02:05.592620 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8045828f-09e3-4e13-bf00-8bfbaf1ac1da tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:02:05.592620 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8045828f-09e3-4e13-bf00-8bfbaf1ac1da tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:02:05.593032 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8045828f-09e3-4e13-bf00-8bfbaf1ac1da tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:02:05.593505 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8045828f-09e3-4e13-bf00-8bfbaf1ac1da tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:02:05.593977 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8045828f-09e3-4e13-bf00-8bfbaf1ac1da tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:02:05.612667 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-8045828f-09e3-4e13-bf00-8bfbaf1ac1da tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Getting quotas for project 92d5e2ecd4c34120afd16b7924267082. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:02:05.618206 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-8045828f-09e3-4e13-bf00-8bfbaf1ac1da tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Getting quotas for user e363289512f8439bb0f2116f3e361e79 and project 92d5e2ecd4c34120afd16b7924267082. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:02:05.632935 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8045828f-09e3-4e13-bf00-8bfbaf1ac1da tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Going to run 1 instances... {{(pid=123002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:02:05.640947 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8045828f-09e3-4e13-bf00-8bfbaf1ac1da tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 310c55e1-be28-446a-9e6e-6b561316bec7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:02:05.771407 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8045828f-09e3-4e13-bf00-8bfbaf1ac1da tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.915824 Oct 04 20:02:05.772099 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4119/8252] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 20:02:04 2022] POST /compute/v2.1/servers => generated 406 bytes in 917 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:02:05.784252 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5bdb3b96-0fe8-431f-8abb-1c490ba0cb8b tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:02:05.784872 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5bdb3b96-0fe8-431f-8abb-1c490ba0cb8b tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 310c55e1-be28-446a-9e6e-6b561316bec7] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:02:05.892308 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5bdb3b96-0fe8-431f-8abb-1c490ba0cb8b tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:02:05.899522 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5bdb3b96-0fe8-431f-8abb-1c490ba0cb8b tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7" status: 200 len: 1247 microversion: 2.1 time: 0.119955 Oct 04 20:02:05.900730 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4134/8253] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:02:05 2022] GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7 => generated 1247 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:02:06.922812 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-970b76ad-2830-4fd6-80da-1713dba9b134 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:02:06.923442 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-970b76ad-2830-4fd6-80da-1713dba9b134 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 310c55e1-be28-446a-9e6e-6b561316bec7] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:02:06.934085 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-970b76ad-2830-4fd6-80da-1713dba9b134 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:02:06.934596 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-970b76ad-2830-4fd6-80da-1713dba9b134 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:02:06.935058 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-970b76ad-2830-4fd6-80da-1713dba9b134 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:02:06.935793 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-970b76ad-2830-4fd6-80da-1713dba9b134 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:02:06.936304 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-970b76ad-2830-4fd6-80da-1713dba9b134 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:02:06.936750 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-970b76ad-2830-4fd6-80da-1713dba9b134 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:02:07.010620 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-970b76ad-2830-4fd6-80da-1713dba9b134 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:02:07.019435 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-970b76ad-2830-4fd6-80da-1713dba9b134 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7" status: 200 len: 1251 microversion: 2.1 time: 0.100528 Oct 04 20:02:07.020554 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4120/8254] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:02:06 2022] GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7 => generated 1251 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:02:08.048854 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9f7e7556-039f-4a5e-94d7-1284a3f07abb tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:02:08.049409 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-9f7e7556-039f-4a5e-94d7-1284a3f07abb tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 310c55e1-be28-446a-9e6e-6b561316bec7] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:02:08.059770 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9f7e7556-039f-4a5e-94d7-1284a3f07abb tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:02:08.060296 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9f7e7556-039f-4a5e-94d7-1284a3f07abb tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:02:08.060732 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9f7e7556-039f-4a5e-94d7-1284a3f07abb tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:02:08.061429 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9f7e7556-039f-4a5e-94d7-1284a3f07abb tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:02:08.061892 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9f7e7556-039f-4a5e-94d7-1284a3f07abb tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:02:08.062335 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9f7e7556-039f-4a5e-94d7-1284a3f07abb tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:02:08.128165 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9f7e7556-039f-4a5e-94d7-1284a3f07abb tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:02:08.136547 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9f7e7556-039f-4a5e-94d7-1284a3f07abb tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7" status: 200 len: 1299 microversion: 2.1 time: 0.091637 Oct 04 20:02:08.137135 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4135/8255] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:02:08 2022] GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7 => generated 1299 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:02:09.160398 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-057104f9-79f2-487c-b702-98edaf187138 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:02:09.161037 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-057104f9-79f2-487c-b702-98edaf187138 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 310c55e1-be28-446a-9e6e-6b561316bec7] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:02:09.169603 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-057104f9-79f2-487c-b702-98edaf187138 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:02:09.170052 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-057104f9-79f2-487c-b702-98edaf187138 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:02:09.170507 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-057104f9-79f2-487c-b702-98edaf187138 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:02:09.171227 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-057104f9-79f2-487c-b702-98edaf187138 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:02:09.171696 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-057104f9-79f2-487c-b702-98edaf187138 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:02:09.172162 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-057104f9-79f2-487c-b702-98edaf187138 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:02:09.357331 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-057104f9-79f2-487c-b702-98edaf187138 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:02:09.365811 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-057104f9-79f2-487c-b702-98edaf187138 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7" status: 200 len: 1373 microversion: 2.1 time: 0.209451 Oct 04 20:02:09.366392 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4121/8256] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:02:09 2022] GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7 => generated 1373 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:02:10.063738 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-10bd61da-c222-4a7e-b756-770e6abcb510 req-9348ef1a-a222-4c08-a7bc-fc895423d16f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "310c55e1-be28-446a-9e6e-6b561316bec7", "tag": "a59528cf-cd20-452e-9a18-18847b4c683c"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:02:10.074887 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-10bd61da-c222-4a7e-b756-770e6abcb510 req-9348ef1a-a222-4c08-a7bc-fc895423d16f service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:02:10.075374 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-10bd61da-c222-4a7e-b756-770e6abcb510 req-9348ef1a-a222-4c08-a7bc-fc895423d16f service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:02:10.075815 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-10bd61da-c222-4a7e-b756-770e6abcb510 req-9348ef1a-a222-4c08-a7bc-fc895423d16f service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:02:10.087060 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-10bd61da-c222-4a7e-b756-770e6abcb510 req-9348ef1a-a222-4c08-a7bc-fc895423d16f service nova] Creating event network-changed:a59528cf-cd20-452e-9a18-18847b4c683c for instance 310c55e1-be28-446a-9e6e-6b561316bec7 on n-h1-850501-14 Oct 04 20:02:10.092768 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-10bd61da-c222-4a7e-b756-770e6abcb510 req-9348ef1a-a222-4c08-a7bc-fc895423d16f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033086 Oct 04 20:02:10.093372 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4136/8257] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 20:02:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:02:10.390700 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-dd0aa2fe-7b68-4c89-9e12-a65cce3f08b9 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:02:10.391624 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-dd0aa2fe-7b68-4c89-9e12-a65cce3f08b9 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 310c55e1-be28-446a-9e6e-6b561316bec7] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:02:10.399491 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dd0aa2fe-7b68-4c89-9e12-a65cce3f08b9 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:02:10.400015 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dd0aa2fe-7b68-4c89-9e12-a65cce3f08b9 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:02:10.400706 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dd0aa2fe-7b68-4c89-9e12-a65cce3f08b9 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:02:10.401693 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dd0aa2fe-7b68-4c89-9e12-a65cce3f08b9 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:02:10.402162 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dd0aa2fe-7b68-4c89-9e12-a65cce3f08b9 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:02:10.402599 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dd0aa2fe-7b68-4c89-9e12-a65cce3f08b9 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:02:10.643344 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-dd0aa2fe-7b68-4c89-9e12-a65cce3f08b9 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:02:10.652472 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-dd0aa2fe-7b68-4c89-9e12-a65cce3f08b9 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7" status: 200 len: 1373 microversion: 2.1 time: 0.265528 Oct 04 20:02:10.653074 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4122/8258] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:02:10 2022] GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7 => generated 1373 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:02:11.676262 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5c7fe165-2caf-4d70-b6e3-b57b920b1470 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:02:11.676964 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5c7fe165-2caf-4d70-b6e3-b57b920b1470 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 310c55e1-be28-446a-9e6e-6b561316bec7] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:02:11.684277 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5c7fe165-2caf-4d70-b6e3-b57b920b1470 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:02:11.684760 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5c7fe165-2caf-4d70-b6e3-b57b920b1470 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:02:11.685194 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5c7fe165-2caf-4d70-b6e3-b57b920b1470 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:02:11.685881 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5c7fe165-2caf-4d70-b6e3-b57b920b1470 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:02:11.686331 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5c7fe165-2caf-4d70-b6e3-b57b920b1470 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:02:11.686759 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5c7fe165-2caf-4d70-b6e3-b57b920b1470 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:02:11.817872 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5c7fe165-2caf-4d70-b6e3-b57b920b1470 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:02:11.826469 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5c7fe165-2caf-4d70-b6e3-b57b920b1470 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7" status: 200 len: 1373 microversion: 2.1 time: 0.154547 Oct 04 20:02:11.827040 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4137/8259] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:02:11 2022] GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7 => generated 1373 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:02:12.849594 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2716ed82-b9ca-485f-8626-a0c704040cfd tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:02:12.850223 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2716ed82-b9ca-485f-8626-a0c704040cfd tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 310c55e1-be28-446a-9e6e-6b561316bec7] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:02:12.857847 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2716ed82-b9ca-485f-8626-a0c704040cfd tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:02:12.858344 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2716ed82-b9ca-485f-8626-a0c704040cfd tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:02:12.858791 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2716ed82-b9ca-485f-8626-a0c704040cfd tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:02:12.859488 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2716ed82-b9ca-485f-8626-a0c704040cfd tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:02:12.859959 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2716ed82-b9ca-485f-8626-a0c704040cfd tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:02:12.860422 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2716ed82-b9ca-485f-8626-a0c704040cfd tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:02:12.991857 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2716ed82-b9ca-485f-8626-a0c704040cfd tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:02:13.000141 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2716ed82-b9ca-485f-8626-a0c704040cfd tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7" status: 200 len: 1373 microversion: 2.1 time: 0.154457 Oct 04 20:02:13.000719 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4123/8260] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:02:12 2022] GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7 => generated 1373 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:02:14.023526 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-33e1720d-7205-49a1-888b-661f100c2d79 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:02:14.024087 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-33e1720d-7205-49a1-888b-661f100c2d79 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 310c55e1-be28-446a-9e6e-6b561316bec7] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:02:14.031829 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-33e1720d-7205-49a1-888b-661f100c2d79 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:02:14.032446 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-33e1720d-7205-49a1-888b-661f100c2d79 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:02:14.032911 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-33e1720d-7205-49a1-888b-661f100c2d79 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:02:14.033613 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-33e1720d-7205-49a1-888b-661f100c2d79 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:02:14.034076 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-33e1720d-7205-49a1-888b-661f100c2d79 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:02:14.034508 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-33e1720d-7205-49a1-888b-661f100c2d79 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:02:14.168596 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-33e1720d-7205-49a1-888b-661f100c2d79 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:02:14.176274 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-33e1720d-7205-49a1-888b-661f100c2d79 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7" status: 200 len: 1373 microversion: 2.1 time: 0.156775 Oct 04 20:02:14.176844 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4138/8261] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:02:14 2022] GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7 => generated 1373 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:02:15.199082 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-bb1e7639-2ba0-4c9e-a310-c62b8af78801 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:02:15.199721 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-bb1e7639-2ba0-4c9e-a310-c62b8af78801 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 310c55e1-be28-446a-9e6e-6b561316bec7] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:02:15.206802 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bb1e7639-2ba0-4c9e-a310-c62b8af78801 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:02:15.207309 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bb1e7639-2ba0-4c9e-a310-c62b8af78801 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:02:15.207768 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bb1e7639-2ba0-4c9e-a310-c62b8af78801 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:02:15.208520 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bb1e7639-2ba0-4c9e-a310-c62b8af78801 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:02:15.208993 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bb1e7639-2ba0-4c9e-a310-c62b8af78801 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:02:15.209440 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-bb1e7639-2ba0-4c9e-a310-c62b8af78801 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:02:15.342327 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-bb1e7639-2ba0-4c9e-a310-c62b8af78801 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:02:15.350208 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-bb1e7639-2ba0-4c9e-a310-c62b8af78801 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7" status: 200 len: 1373 microversion: 2.1 time: 0.155290 Oct 04 20:02:15.350789 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4124/8262] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:02:15 2022] GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7 => generated 1373 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:02:16.374722 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3d5635ef-1af7-448a-93da-81db544586d9 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:02:16.375345 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3d5635ef-1af7-448a-93da-81db544586d9 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 310c55e1-be28-446a-9e6e-6b561316bec7] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:02:16.377596 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=6 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:02:16.382427 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3d5635ef-1af7-448a-93da-81db544586d9 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:02:16.382916 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3d5635ef-1af7-448a-93da-81db544586d9 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:02:16.383360 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3d5635ef-1af7-448a-93da-81db544586d9 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:02:16.384074 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3d5635ef-1af7-448a-93da-81db544586d9 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:02:16.384797 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3d5635ef-1af7-448a-93da-81db544586d9 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:02:16.385199 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3d5635ef-1af7-448a-93da-81db544586d9 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:02:16.532662 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3d5635ef-1af7-448a-93da-81db544586d9 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:02:16.542243 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3d5635ef-1af7-448a-93da-81db544586d9 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7" status: 200 len: 1373 microversion: 2.1 time: 0.171564 Oct 04 20:02:16.542832 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4139/8263] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:02:16 2022] GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7 => generated 1373 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:02:16.761174 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-3876f992-c582-43c6-b300-8dc62ee76a10 req-bdf031fd-6a71-4d5e-95ed-2f679221e66d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "310c55e1-be28-446a-9e6e-6b561316bec7", "name": "network-vif-plugged", "status": "completed", "tag": "a59528cf-cd20-452e-9a18-18847b4c683c"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:02:16.766450 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:02:16.767158 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=6 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:02:16.773235 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-3876f992-c582-43c6-b300-8dc62ee76a10 req-bdf031fd-6a71-4d5e-95ed-2f679221e66d service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:02:16.773732 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-3876f992-c582-43c6-b300-8dc62ee76a10 req-bdf031fd-6a71-4d5e-95ed-2f679221e66d service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:02:16.774178 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-3876f992-c582-43c6-b300-8dc62ee76a10 req-bdf031fd-6a71-4d5e-95ed-2f679221e66d service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:02:16.785976 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-3876f992-c582-43c6-b300-8dc62ee76a10 req-bdf031fd-6a71-4d5e-95ed-2f679221e66d service nova] Creating event network-vif-plugged:a59528cf-cd20-452e-9a18-18847b4c683c for instance 310c55e1-be28-446a-9e6e-6b561316bec7 on n-h1-850501-14 Oct 04 20:02:16.791511 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-3876f992-c582-43c6-b300-8dc62ee76a10 req-bdf031fd-6a71-4d5e-95ed-2f679221e66d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034850 Oct 04 20:02:16.793739 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4125/8264] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 20:02:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:02:17.566155 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-27a96821-5f24-4169-9864-f4ea31cd5e1d tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:02:17.566753 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-27a96821-5f24-4169-9864-f4ea31cd5e1d tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 310c55e1-be28-446a-9e6e-6b561316bec7] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:02:17.574441 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-27a96821-5f24-4169-9864-f4ea31cd5e1d tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:02:17.574930 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-27a96821-5f24-4169-9864-f4ea31cd5e1d tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:02:17.575366 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-27a96821-5f24-4169-9864-f4ea31cd5e1d tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:02:17.576080 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-27a96821-5f24-4169-9864-f4ea31cd5e1d tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:02:17.576555 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-27a96821-5f24-4169-9864-f4ea31cd5e1d tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:02:17.576989 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-27a96821-5f24-4169-9864-f4ea31cd5e1d tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:02:17.710692 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-27a96821-5f24-4169-9864-f4ea31cd5e1d tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:02:17.719916 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-27a96821-5f24-4169-9864-f4ea31cd5e1d tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7" status: 200 len: 1373 microversion: 2.1 time: 0.157672 Oct 04 20:02:17.720546 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4140/8265] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:02:17 2022] GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7 => generated 1373 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:02:18.744695 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-dd3367c7-7201-43ba-98f4-b3cbe4a63a7a tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:02:18.745313 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-dd3367c7-7201-43ba-98f4-b3cbe4a63a7a tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 310c55e1-be28-446a-9e6e-6b561316bec7] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:02:18.753739 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dd3367c7-7201-43ba-98f4-b3cbe4a63a7a tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:02:18.754251 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dd3367c7-7201-43ba-98f4-b3cbe4a63a7a tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:02:18.754709 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dd3367c7-7201-43ba-98f4-b3cbe4a63a7a tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:02:18.755437 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dd3367c7-7201-43ba-98f4-b3cbe4a63a7a tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:02:18.755972 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dd3367c7-7201-43ba-98f4-b3cbe4a63a7a tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:02:18.756448 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dd3367c7-7201-43ba-98f4-b3cbe4a63a7a tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:02:18.899791 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-dd3367c7-7201-43ba-98f4-b3cbe4a63a7a tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:02:18.908355 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-dd3367c7-7201-43ba-98f4-b3cbe4a63a7a tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7" status: 200 len: 1556 microversion: 2.1 time: 0.168960 Oct 04 20:02:18.908940 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4126/8266] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:02:18 2022] GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7 => generated 1556 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:02:18.931014 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-146ab7e5-1f77-4872-8fff-e0408448a9c8 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:02:18.932265 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-146ab7e5-1f77-4872-8fff-e0408448a9c8 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 310c55e1-be28-446a-9e6e-6b561316bec7] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:02:18.939237 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-146ab7e5-1f77-4872-8fff-e0408448a9c8 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:02:18.939726 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-146ab7e5-1f77-4872-8fff-e0408448a9c8 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:02:18.940193 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-146ab7e5-1f77-4872-8fff-e0408448a9c8 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:02:18.940895 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-146ab7e5-1f77-4872-8fff-e0408448a9c8 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:02:18.941350 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-146ab7e5-1f77-4872-8fff-e0408448a9c8 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:02:18.941774 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-146ab7e5-1f77-4872-8fff-e0408448a9c8 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:02:19.077760 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-146ab7e5-1f77-4872-8fff-e0408448a9c8 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:02:19.085482 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-146ab7e5-1f77-4872-8fff-e0408448a9c8 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7" status: 200 len: 1556 microversion: 2.1 time: 0.158362 Oct 04 20:02:19.086050 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4141/8267] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:02:18 2022] GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7 => generated 1556 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:02:21.192487 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-3c9ef67a-468c-46e0-8c0b-b695e650c35d req-f0f9c5b8-7a10-4efe-86e9-edbf2b20d607 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "310c55e1-be28-446a-9e6e-6b561316bec7", "tag": "a59528cf-cd20-452e-9a18-18847b4c683c"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:02:21.203543 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-3c9ef67a-468c-46e0-8c0b-b695e650c35d req-f0f9c5b8-7a10-4efe-86e9-edbf2b20d607 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:02:21.204138 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-3c9ef67a-468c-46e0-8c0b-b695e650c35d req-f0f9c5b8-7a10-4efe-86e9-edbf2b20d607 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:02:21.204677 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-3c9ef67a-468c-46e0-8c0b-b695e650c35d req-f0f9c5b8-7a10-4efe-86e9-edbf2b20d607 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:02:21.216137 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-3c9ef67a-468c-46e0-8c0b-b695e650c35d req-f0f9c5b8-7a10-4efe-86e9-edbf2b20d607 service nova] Creating event network-changed:a59528cf-cd20-452e-9a18-18847b4c683c for instance 310c55e1-be28-446a-9e6e-6b561316bec7 on n-h1-850501-14 Oct 04 20:02:21.222764 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-3c9ef67a-468c-46e0-8c0b-b695e650c35d req-f0f9c5b8-7a10-4efe-86e9-edbf2b20d607 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032309 Oct 04 20:02:21.222764 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4127/8268] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 20:02:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:04:16.188414 n-d-850501-14 devstack@n-api.service[123001]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c9febe7b-97ce-4695-9d92-17a0f76701f3] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 20:04:16.189353 n-d-850501-14 devstack@n-api.service[123001]: ERROR oslo.messaging._drivers.impl_rabbit [-] [642656d8-a7cd-470f-ae32-a85e45bb523d] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 20:04:16.190165 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:16.190935 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=38 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:16.192915 n-d-850501-14 devstack@n-api.service[123001]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 20:04:16.193083 n-d-850501-14 devstack@n-api.service[123001]: Tue Oct 4 20:04:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7/action (ip 10.222.0.20) !!! Oct 04 20:04:16.197311 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2a34a08c-9daf-4124-a2fe-fb6cce79ff50 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:04:16.204225 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2a34a08c-9daf-4124-a2fe-fb6cce79ff50 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 310c55e1-be28-446a-9e6e-6b561316bec7] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:04:16.204786 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2a34a08c-9daf-4124-a2fe-fb6cce79ff50 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:16.205276 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2a34a08c-9daf-4124-a2fe-fb6cce79ff50 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:16.205718 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2a34a08c-9daf-4124-a2fe-fb6cce79ff50 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:16.206414 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2a34a08c-9daf-4124-a2fe-fb6cce79ff50 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:16.206874 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2a34a08c-9daf-4124-a2fe-fb6cce79ff50 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:16.207943 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2a34a08c-9daf-4124-a2fe-fb6cce79ff50 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:16.231760 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-2a34a08c-9daf-4124-a2fe-fb6cce79ff50 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lazy-loading 'flavor' on Instance uuid 310c55e1-be28-446a-9e6e-6b561316bec7 {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:04:16.718023 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2a34a08c-9daf-4124-a2fe-fb6cce79ff50 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "POST /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7/action" status: 202 len: 0 microversion: 2.1 time: 0.531133 Oct 04 20:04:16.721038 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4142/8269] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 20:04:16 2022] POST /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7/action => generated 0 bytes in 533 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:04:16.726148 n-d-850501-14 devstack@n-api.service[123002]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d2b44dc8-447f-4d0a-9186-943d7552c0ea] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 20:04:16.726985 n-d-850501-14 devstack@n-api.service[123002]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9c4ba655-a850-4726-8db9-cffc7e0e245e] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 20:04:16.727864 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:16.728668 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=42 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:16.729959 n-d-850501-14 devstack@n-api.service[123002]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 20:04:16.730094 n-d-850501-14 devstack@n-api.service[123002]: Tue Oct 4 20:04:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7 (ip 10.222.0.20) !!! Oct 04 20:04:16.731731 n-d-850501-14 devstack@n-api.service[123002]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 04 20:04:16.737354 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-247198eb-1e76-46e3-ae3c-7736574efaef tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:04:16.738094 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-247198eb-1e76-46e3-ae3c-7736574efaef tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 310c55e1-be28-446a-9e6e-6b561316bec7] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:04:16.746749 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-247198eb-1e76-46e3-ae3c-7736574efaef tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:16.749731 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-247198eb-1e76-46e3-ae3c-7736574efaef tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:16.749731 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-247198eb-1e76-46e3-ae3c-7736574efaef tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:16.749731 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-247198eb-1e76-46e3-ae3c-7736574efaef tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:16.749731 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-247198eb-1e76-46e3-ae3c-7736574efaef tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:16.749731 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-247198eb-1e76-46e3-ae3c-7736574efaef tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:16.885187 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-247198eb-1e76-46e3-ae3c-7736574efaef tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:04:16.892877 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-247198eb-1e76-46e3-ae3c-7736574efaef tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7" status: 200 len: 1681 microversion: 2.1 time: 0.168712 Oct 04 20:04:16.893443 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4128/8270] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:04:16 2022] GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7 => generated 1681 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:04:17.922058 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0e54d510-8a83-49e6-a05c-16d54973f262 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:04:17.923583 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0e54d510-8a83-49e6-a05c-16d54973f262 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 310c55e1-be28-446a-9e6e-6b561316bec7] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:04:17.936852 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0e54d510-8a83-49e6-a05c-16d54973f262 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:17.937334 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0e54d510-8a83-49e6-a05c-16d54973f262 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:17.937766 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0e54d510-8a83-49e6-a05c-16d54973f262 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:17.938455 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0e54d510-8a83-49e6-a05c-16d54973f262 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:17.938935 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0e54d510-8a83-49e6-a05c-16d54973f262 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:17.939360 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0e54d510-8a83-49e6-a05c-16d54973f262 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:17.944330 n-d-850501-14 devstack@n-api.service[123001]: INFO oslo.messaging._drivers.impl_rabbit [-] [c9febe7b-97ce-4695-9d92-17a0f76701f3] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 54550. Oct 04 20:04:17.945009 n-d-850501-14 devstack@n-api.service[123001]: INFO oslo.messaging._drivers.impl_rabbit [-] [642656d8-a7cd-470f-ae32-a85e45bb523d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 54552. Oct 04 20:04:18.077385 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0e54d510-8a83-49e6-a05c-16d54973f262 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:04:18.085425 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0e54d510-8a83-49e6-a05c-16d54973f262 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7" status: 200 len: 1681 microversion: 2.1 time: 0.171760 Oct 04 20:04:18.086005 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4143/8271] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:04:17 2022] GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7 => generated 1681 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:04:19.109408 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-fbd4bc13-cad5-49d8-b7c8-34f46417089d tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:04:19.110077 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-fbd4bc13-cad5-49d8-b7c8-34f46417089d tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 310c55e1-be28-446a-9e6e-6b561316bec7] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:04:19.119658 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fbd4bc13-cad5-49d8-b7c8-34f46417089d tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:19.120202 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fbd4bc13-cad5-49d8-b7c8-34f46417089d tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:19.120668 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fbd4bc13-cad5-49d8-b7c8-34f46417089d tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:19.121389 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fbd4bc13-cad5-49d8-b7c8-34f46417089d tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:19.121864 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fbd4bc13-cad5-49d8-b7c8-34f46417089d tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:19.122309 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fbd4bc13-cad5-49d8-b7c8-34f46417089d tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:19.128592 n-d-850501-14 devstack@n-api.service[123002]: INFO oslo.messaging._drivers.impl_rabbit [-] [d2b44dc8-447f-4d0a-9186-943d7552c0ea] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 54556. Oct 04 20:04:19.145180 n-d-850501-14 devstack@n-api.service[123002]: INFO oslo.messaging._drivers.impl_rabbit [-] [9c4ba655-a850-4726-8db9-cffc7e0e245e] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 54558. Oct 04 20:04:19.264292 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-fbd4bc13-cad5-49d8-b7c8-34f46417089d tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:04:19.272782 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-fbd4bc13-cad5-49d8-b7c8-34f46417089d tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7" status: 200 len: 1681 microversion: 2.1 time: 0.167389 Oct 04 20:04:19.273911 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4129/8272] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:04:19 2022] GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7 => generated 1681 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:04:20.296548 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-864e6531-c07e-4a64-bfb7-95700698e1d6 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:04:20.297186 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-864e6531-c07e-4a64-bfb7-95700698e1d6 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 310c55e1-be28-446a-9e6e-6b561316bec7] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:04:20.304511 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-864e6531-c07e-4a64-bfb7-95700698e1d6 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:20.304996 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-864e6531-c07e-4a64-bfb7-95700698e1d6 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:20.305441 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-864e6531-c07e-4a64-bfb7-95700698e1d6 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:20.306141 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-864e6531-c07e-4a64-bfb7-95700698e1d6 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:20.306601 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-864e6531-c07e-4a64-bfb7-95700698e1d6 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:20.307032 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-864e6531-c07e-4a64-bfb7-95700698e1d6 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:20.436727 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-864e6531-c07e-4a64-bfb7-95700698e1d6 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:04:20.445017 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-864e6531-c07e-4a64-bfb7-95700698e1d6 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7" status: 200 len: 1681 microversion: 2.1 time: 0.152379 Oct 04 20:04:20.445635 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4144/8273] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:04:20 2022] GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:04:21.468545 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-dd9bda0b-d6c7-486b-94d0-1a6ae0fa8a5b tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:04:21.469174 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-dd9bda0b-d6c7-486b-94d0-1a6ae0fa8a5b tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 310c55e1-be28-446a-9e6e-6b561316bec7] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:04:21.476480 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dd9bda0b-d6c7-486b-94d0-1a6ae0fa8a5b tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:21.476978 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dd9bda0b-d6c7-486b-94d0-1a6ae0fa8a5b tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:21.477429 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dd9bda0b-d6c7-486b-94d0-1a6ae0fa8a5b tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:21.478397 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dd9bda0b-d6c7-486b-94d0-1a6ae0fa8a5b tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:21.478866 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dd9bda0b-d6c7-486b-94d0-1a6ae0fa8a5b tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:21.479305 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dd9bda0b-d6c7-486b-94d0-1a6ae0fa8a5b tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:21.615288 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-dd9bda0b-d6c7-486b-94d0-1a6ae0fa8a5b tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:04:21.623234 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-dd9bda0b-d6c7-486b-94d0-1a6ae0fa8a5b tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7" status: 200 len: 1681 microversion: 2.1 time: 0.158631 Oct 04 20:04:21.623814 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4130/8274] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:04:21 2022] GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:04:22.647350 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a74a7d3b-57f8-46eb-95b9-1b4cc6cbf01a tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:04:22.648230 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a74a7d3b-57f8-46eb-95b9-1b4cc6cbf01a tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 310c55e1-be28-446a-9e6e-6b561316bec7] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:04:22.655200 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a74a7d3b-57f8-46eb-95b9-1b4cc6cbf01a tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:22.655703 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a74a7d3b-57f8-46eb-95b9-1b4cc6cbf01a tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:22.656169 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a74a7d3b-57f8-46eb-95b9-1b4cc6cbf01a tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:22.656880 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a74a7d3b-57f8-46eb-95b9-1b4cc6cbf01a tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:22.657336 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a74a7d3b-57f8-46eb-95b9-1b4cc6cbf01a tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:22.657766 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a74a7d3b-57f8-46eb-95b9-1b4cc6cbf01a tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:22.791334 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a74a7d3b-57f8-46eb-95b9-1b4cc6cbf01a tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:04:22.799195 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a74a7d3b-57f8-46eb-95b9-1b4cc6cbf01a tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7" status: 200 len: 1681 microversion: 2.1 time: 0.156247 Oct 04 20:04:22.799773 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4145/8275] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:04:22 2022] GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:04:23.823940 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-da92a6ab-95a9-4bbf-ab2d-e26d8a7ae0a3 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:04:23.824604 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-da92a6ab-95a9-4bbf-ab2d-e26d8a7ae0a3 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 310c55e1-be28-446a-9e6e-6b561316bec7] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:04:23.831351 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-da92a6ab-95a9-4bbf-ab2d-e26d8a7ae0a3 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:23.832546 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-da92a6ab-95a9-4bbf-ab2d-e26d8a7ae0a3 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:23.833047 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-da92a6ab-95a9-4bbf-ab2d-e26d8a7ae0a3 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:23.833733 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-da92a6ab-95a9-4bbf-ab2d-e26d8a7ae0a3 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:23.834197 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-da92a6ab-95a9-4bbf-ab2d-e26d8a7ae0a3 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:23.834636 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-da92a6ab-95a9-4bbf-ab2d-e26d8a7ae0a3 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:23.968911 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-da92a6ab-95a9-4bbf-ab2d-e26d8a7ae0a3 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:04:23.978065 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-da92a6ab-95a9-4bbf-ab2d-e26d8a7ae0a3 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7" status: 200 len: 1681 microversion: 2.1 time: 0.158417 Oct 04 20:04:23.978585 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4131/8276] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:04:23 2022] GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:04:25.001057 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-25d7b8b0-e485-491f-b407-8308dd59e818 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:04:25.001606 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-25d7b8b0-e485-491f-b407-8308dd59e818 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 310c55e1-be28-446a-9e6e-6b561316bec7] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:04:25.009073 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-25d7b8b0-e485-491f-b407-8308dd59e818 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:25.009557 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-25d7b8b0-e485-491f-b407-8308dd59e818 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:25.009996 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-25d7b8b0-e485-491f-b407-8308dd59e818 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:25.010703 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-25d7b8b0-e485-491f-b407-8308dd59e818 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:25.011146 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-25d7b8b0-e485-491f-b407-8308dd59e818 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:25.011573 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-25d7b8b0-e485-491f-b407-8308dd59e818 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:25.142577 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-25d7b8b0-e485-491f-b407-8308dd59e818 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:04:25.151291 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-25d7b8b0-e485-491f-b407-8308dd59e818 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7" status: 200 len: 1681 microversion: 2.1 time: 0.154154 Oct 04 20:04:25.151872 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4146/8277] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:04:24 2022] GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:04:26.174954 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-23e23a62-ada0-45b8-86dc-f76003929b47 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:04:26.176165 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-23e23a62-ada0-45b8-86dc-f76003929b47 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 310c55e1-be28-446a-9e6e-6b561316bec7] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:04:26.182882 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-23e23a62-ada0-45b8-86dc-f76003929b47 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:26.183378 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-23e23a62-ada0-45b8-86dc-f76003929b47 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:26.183825 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-23e23a62-ada0-45b8-86dc-f76003929b47 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:26.184561 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-23e23a62-ada0-45b8-86dc-f76003929b47 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:26.185034 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-23e23a62-ada0-45b8-86dc-f76003929b47 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:26.185473 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-23e23a62-ada0-45b8-86dc-f76003929b47 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:26.313447 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-23e23a62-ada0-45b8-86dc-f76003929b47 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:04:26.321779 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-23e23a62-ada0-45b8-86dc-f76003929b47 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7" status: 200 len: 1681 microversion: 2.1 time: 0.150747 Oct 04 20:04:26.322372 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4132/8278] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:04:26 2022] GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7 => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:04:27.348996 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8ecdc2cb-9150-448d-bc69-ff7a6d6ab98b tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:04:27.349621 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8ecdc2cb-9150-448d-bc69-ff7a6d6ab98b tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 310c55e1-be28-446a-9e6e-6b561316bec7] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:04:27.357220 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8ecdc2cb-9150-448d-bc69-ff7a6d6ab98b tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:27.357733 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8ecdc2cb-9150-448d-bc69-ff7a6d6ab98b tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:27.358165 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8ecdc2cb-9150-448d-bc69-ff7a6d6ab98b tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:27.358845 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8ecdc2cb-9150-448d-bc69-ff7a6d6ab98b tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:27.359296 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8ecdc2cb-9150-448d-bc69-ff7a6d6ab98b tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:27.359717 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8ecdc2cb-9150-448d-bc69-ff7a6d6ab98b tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:27.495011 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8ecdc2cb-9150-448d-bc69-ff7a6d6ab98b tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:04:27.502661 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8ecdc2cb-9150-448d-bc69-ff7a6d6ab98b tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7" status: 200 len: 1702 microversion: 2.1 time: 0.157680 Oct 04 20:04:27.503227 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4147/8279] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:04:27 2022] GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7 => generated 1702 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:04:28.526885 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-33ba1cc1-8c8d-4fb8-95a2-bacfea4b6eff tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:04:28.527499 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-33ba1cc1-8c8d-4fb8-95a2-bacfea4b6eff tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 310c55e1-be28-446a-9e6e-6b561316bec7] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:04:28.534545 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-33ba1cc1-8c8d-4fb8-95a2-bacfea4b6eff tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:28.535889 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-33ba1cc1-8c8d-4fb8-95a2-bacfea4b6eff tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:28.536472 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-33ba1cc1-8c8d-4fb8-95a2-bacfea4b6eff tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:28.537188 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-33ba1cc1-8c8d-4fb8-95a2-bacfea4b6eff tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:28.537661 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-33ba1cc1-8c8d-4fb8-95a2-bacfea4b6eff tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:28.538107 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-33ba1cc1-8c8d-4fb8-95a2-bacfea4b6eff tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:28.670144 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-33ba1cc1-8c8d-4fb8-95a2-bacfea4b6eff tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:04:28.677858 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-33ba1cc1-8c8d-4fb8-95a2-bacfea4b6eff tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7" status: 200 len: 1702 microversion: 2.1 time: 0.154961 Oct 04 20:04:28.678443 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4133/8280] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:04:28 2022] GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7 => generated 1702 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:04:29.704173 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-674bdde0-1f54-4de8-919e-ac87544d582c tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:04:29.704808 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-674bdde0-1f54-4de8-919e-ac87544d582c tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 310c55e1-be28-446a-9e6e-6b561316bec7] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:04:29.713184 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-674bdde0-1f54-4de8-919e-ac87544d582c tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:29.713675 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-674bdde0-1f54-4de8-919e-ac87544d582c tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:29.714124 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-674bdde0-1f54-4de8-919e-ac87544d582c tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:29.715274 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-674bdde0-1f54-4de8-919e-ac87544d582c tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:29.715985 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-674bdde0-1f54-4de8-919e-ac87544d582c tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:29.716448 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-674bdde0-1f54-4de8-919e-ac87544d582c tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:29.857478 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-674bdde0-1f54-4de8-919e-ac87544d582c tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:04:29.866227 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-674bdde0-1f54-4de8-919e-ac87544d582c tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7" status: 200 len: 1697 microversion: 2.1 time: 0.167523 Oct 04 20:04:29.874252 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4148/8281] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:04:29 2022] GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7 => generated 1697 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:04:30.892188 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-cf9a0249-7b76-4cad-bb84-0a84df724918 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:04:30.893150 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-cf9a0249-7b76-4cad-bb84-0a84df724918 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 310c55e1-be28-446a-9e6e-6b561316bec7] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:04:30.900230 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cf9a0249-7b76-4cad-bb84-0a84df724918 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:30.900982 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cf9a0249-7b76-4cad-bb84-0a84df724918 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:30.901729 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cf9a0249-7b76-4cad-bb84-0a84df724918 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:30.902790 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cf9a0249-7b76-4cad-bb84-0a84df724918 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:30.903563 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cf9a0249-7b76-4cad-bb84-0a84df724918 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:30.904315 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cf9a0249-7b76-4cad-bb84-0a84df724918 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:31.100841 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-cf9a0249-7b76-4cad-bb84-0a84df724918 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:04:31.110395 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-cf9a0249-7b76-4cad-bb84-0a84df724918 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7" status: 200 len: 1697 microversion: 2.1 time: 0.223875 Oct 04 20:04:31.112551 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4134/8282] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:04:30 2022] GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7 => generated 1697 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:04:31.218384 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-a4dc2cc7-7662-408c-a28e-4c169c36eb9f req-a4881453-66ab-4bdd-9f7c-fe89daa251aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "310c55e1-be28-446a-9e6e-6b561316bec7", "name": "network-vif-plugged", "status": "completed", "tag": "a59528cf-cd20-452e-9a18-18847b4c683c"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:04:31.232090 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-a4dc2cc7-7662-408c-a28e-4c169c36eb9f req-a4881453-66ab-4bdd-9f7c-fe89daa251aa service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:31.232791 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-a4dc2cc7-7662-408c-a28e-4c169c36eb9f req-a4881453-66ab-4bdd-9f7c-fe89daa251aa service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:31.233426 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-a4dc2cc7-7662-408c-a28e-4c169c36eb9f req-a4881453-66ab-4bdd-9f7c-fe89daa251aa service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:31.247117 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-a4dc2cc7-7662-408c-a28e-4c169c36eb9f req-a4881453-66ab-4bdd-9f7c-fe89daa251aa service nova] Creating event network-vif-plugged:a59528cf-cd20-452e-9a18-18847b4c683c for instance 310c55e1-be28-446a-9e6e-6b561316bec7 on n-h1-850501-14 Oct 04 20:04:31.263965 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-a4dc2cc7-7662-408c-a28e-4c169c36eb9f req-a4881453-66ab-4bdd-9f7c-fe89daa251aa service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.180508 Oct 04 20:04:31.266462 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4149/8283] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 20:04:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:04:32.136291 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d9a29d03-c751-4b4f-afcd-527e95df5c80 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:04:32.137897 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d9a29d03-c751-4b4f-afcd-527e95df5c80 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 310c55e1-be28-446a-9e6e-6b561316bec7] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:04:32.149092 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d9a29d03-c751-4b4f-afcd-527e95df5c80 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:32.149681 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d9a29d03-c751-4b4f-afcd-527e95df5c80 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:32.151054 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d9a29d03-c751-4b4f-afcd-527e95df5c80 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:32.152183 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d9a29d03-c751-4b4f-afcd-527e95df5c80 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:32.152914 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d9a29d03-c751-4b4f-afcd-527e95df5c80 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:32.153553 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d9a29d03-c751-4b4f-afcd-527e95df5c80 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:32.319619 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-d9a29d03-c751-4b4f-afcd-527e95df5c80 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:04:32.328737 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d9a29d03-c751-4b4f-afcd-527e95df5c80 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7" status: 200 len: 1697 microversion: 2.1 time: 0.196398 Oct 04 20:04:32.329638 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4135/8284] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:04:32 2022] GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7 => generated 1697 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:04:33.355290 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f1f01011-f27c-447a-abb8-447580c98d2e tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:04:33.355987 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f1f01011-f27c-447a-abb8-447580c98d2e tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 310c55e1-be28-446a-9e6e-6b561316bec7] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:04:33.368486 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f1f01011-f27c-447a-abb8-447580c98d2e tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:33.368486 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f1f01011-f27c-447a-abb8-447580c98d2e tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:33.368486 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f1f01011-f27c-447a-abb8-447580c98d2e tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:33.369528 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f1f01011-f27c-447a-abb8-447580c98d2e tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:33.370112 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f1f01011-f27c-447a-abb8-447580c98d2e tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:33.370789 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f1f01011-f27c-447a-abb8-447580c98d2e tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:33.910151 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f1f01011-f27c-447a-abb8-447580c98d2e tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:04:33.919594 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f1f01011-f27c-447a-abb8-447580c98d2e tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7" status: 200 len: 1697 microversion: 2.1 time: 0.568499 Oct 04 20:04:33.930352 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4150/8285] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:04:33 2022] GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7 => generated 1697 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:04:34.948889 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-df7a3585-49f4-4150-8b6d-09e671c8fb06 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:04:34.950343 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-df7a3585-49f4-4150-8b6d-09e671c8fb06 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 310c55e1-be28-446a-9e6e-6b561316bec7] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:04:34.960000 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-df7a3585-49f4-4150-8b6d-09e671c8fb06 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:34.961434 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-df7a3585-49f4-4150-8b6d-09e671c8fb06 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:34.962327 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-df7a3585-49f4-4150-8b6d-09e671c8fb06 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:34.963168 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-df7a3585-49f4-4150-8b6d-09e671c8fb06 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:34.963718 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-df7a3585-49f4-4150-8b6d-09e671c8fb06 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:34.964265 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-df7a3585-49f4-4150-8b6d-09e671c8fb06 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:35.113334 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-df7a3585-49f4-4150-8b6d-09e671c8fb06 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:04:35.121777 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-df7a3585-49f4-4150-8b6d-09e671c8fb06 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7" status: 200 len: 1697 microversion: 2.1 time: 0.178644 Oct 04 20:04:35.122883 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4136/8286] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:04:34 2022] GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7 => generated 1697 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:04:36.150452 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-57c390ce-73ea-47a1-a5f2-ba1c5b934a6d tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:04:36.151283 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-57c390ce-73ea-47a1-a5f2-ba1c5b934a6d tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 310c55e1-be28-446a-9e6e-6b561316bec7] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:04:36.158146 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-57c390ce-73ea-47a1-a5f2-ba1c5b934a6d tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:36.158634 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-57c390ce-73ea-47a1-a5f2-ba1c5b934a6d tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:36.159078 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-57c390ce-73ea-47a1-a5f2-ba1c5b934a6d tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:36.159910 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-57c390ce-73ea-47a1-a5f2-ba1c5b934a6d tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:36.160438 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-57c390ce-73ea-47a1-a5f2-ba1c5b934a6d tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:36.160875 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-57c390ce-73ea-47a1-a5f2-ba1c5b934a6d tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:36.310442 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-57c390ce-73ea-47a1-a5f2-ba1c5b934a6d tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:04:36.319510 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-57c390ce-73ea-47a1-a5f2-ba1c5b934a6d tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7" status: 200 len: 1697 microversion: 2.1 time: 0.172944 Oct 04 20:04:36.320108 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4151/8287] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:04:36 2022] GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7 => generated 1697 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:04:37.342815 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-cd1b8f3d-9295-4555-86b9-0a181d2434f1 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:04:37.343594 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-cd1b8f3d-9295-4555-86b9-0a181d2434f1 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 310c55e1-be28-446a-9e6e-6b561316bec7] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:04:37.350883 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cd1b8f3d-9295-4555-86b9-0a181d2434f1 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:37.351969 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cd1b8f3d-9295-4555-86b9-0a181d2434f1 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:37.351969 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cd1b8f3d-9295-4555-86b9-0a181d2434f1 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:37.352827 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cd1b8f3d-9295-4555-86b9-0a181d2434f1 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:37.353542 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cd1b8f3d-9295-4555-86b9-0a181d2434f1 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:37.354198 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cd1b8f3d-9295-4555-86b9-0a181d2434f1 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:37.507142 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-cd1b8f3d-9295-4555-86b9-0a181d2434f1 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:04:37.519216 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-cd1b8f3d-9295-4555-86b9-0a181d2434f1 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7" status: 200 len: 1697 microversion: 2.1 time: 0.179665 Oct 04 20:04:37.532452 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4137/8288] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:04:37 2022] GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7 => generated 1697 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:04:38.542925 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8d654106-d36e-48a6-ac1b-1105134b7eab tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:04:38.544892 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8d654106-d36e-48a6-ac1b-1105134b7eab tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 310c55e1-be28-446a-9e6e-6b561316bec7] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:04:38.553321 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8d654106-d36e-48a6-ac1b-1105134b7eab tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:38.554264 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8d654106-d36e-48a6-ac1b-1105134b7eab tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:38.554933 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8d654106-d36e-48a6-ac1b-1105134b7eab tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:38.555867 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8d654106-d36e-48a6-ac1b-1105134b7eab tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:38.556346 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8d654106-d36e-48a6-ac1b-1105134b7eab tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:38.556773 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8d654106-d36e-48a6-ac1b-1105134b7eab tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:38.711585 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8d654106-d36e-48a6-ac1b-1105134b7eab tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:04:38.721949 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8d654106-d36e-48a6-ac1b-1105134b7eab tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7" status: 200 len: 1697 microversion: 2.1 time: 0.182853 Oct 04 20:04:38.722740 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4152/8289] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:04:38 2022] GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7 => generated 1697 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:04:39.747796 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-45f6b58f-45ce-4b34-be4a-12aefc67217f tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:04:39.748462 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-45f6b58f-45ce-4b34-be4a-12aefc67217f tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 310c55e1-be28-446a-9e6e-6b561316bec7] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:04:39.756089 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-45f6b58f-45ce-4b34-be4a-12aefc67217f tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:39.756698 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-45f6b58f-45ce-4b34-be4a-12aefc67217f tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:39.757150 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-45f6b58f-45ce-4b34-be4a-12aefc67217f tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:39.757867 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-45f6b58f-45ce-4b34-be4a-12aefc67217f tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:39.758335 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-45f6b58f-45ce-4b34-be4a-12aefc67217f tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:39.758772 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-45f6b58f-45ce-4b34-be4a-12aefc67217f tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:39.910328 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-45f6b58f-45ce-4b34-be4a-12aefc67217f tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:04:39.921717 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-45f6b58f-45ce-4b34-be4a-12aefc67217f tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7" status: 200 len: 1697 microversion: 2.1 time: 0.179386 Oct 04 20:04:39.922547 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4138/8290] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:04:39 2022] GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7 => generated 1697 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:04:40.945415 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3447765e-648a-4a24-81c0-8e20ed53578d tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:04:40.946093 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3447765e-648a-4a24-81c0-8e20ed53578d tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 310c55e1-be28-446a-9e6e-6b561316bec7] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:04:40.952807 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3447765e-648a-4a24-81c0-8e20ed53578d tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:40.953284 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3447765e-648a-4a24-81c0-8e20ed53578d tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:40.953713 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3447765e-648a-4a24-81c0-8e20ed53578d tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:40.954396 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3447765e-648a-4a24-81c0-8e20ed53578d tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:40.954846 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3447765e-648a-4a24-81c0-8e20ed53578d tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:40.955265 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3447765e-648a-4a24-81c0-8e20ed53578d tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:41.090336 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3447765e-648a-4a24-81c0-8e20ed53578d tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:04:41.098232 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3447765e-648a-4a24-81c0-8e20ed53578d tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7" status: 200 len: 1697 microversion: 2.1 time: 0.156690 Oct 04 20:04:41.098799 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4153/8291] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:04:40 2022] GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7 => generated 1697 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:04:42.122393 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ba551597-68cc-4eb5-8008-2c42117e4575 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:04:42.123026 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ba551597-68cc-4eb5-8008-2c42117e4575 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 310c55e1-be28-446a-9e6e-6b561316bec7] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:04:42.130398 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ba551597-68cc-4eb5-8008-2c42117e4575 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:42.130890 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ba551597-68cc-4eb5-8008-2c42117e4575 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:42.131339 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ba551597-68cc-4eb5-8008-2c42117e4575 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:42.132041 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ba551597-68cc-4eb5-8008-2c42117e4575 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:42.132525 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ba551597-68cc-4eb5-8008-2c42117e4575 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:42.132967 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ba551597-68cc-4eb5-8008-2c42117e4575 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:42.263203 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ba551597-68cc-4eb5-8008-2c42117e4575 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:04:42.271809 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ba551597-68cc-4eb5-8008-2c42117e4575 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7" status: 200 len: 1679 microversion: 2.1 time: 0.153268 Oct 04 20:04:42.272415 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4139/8292] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:04:42 2022] GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:04:43.297701 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9a18495f-ce8d-4e7e-8638-35dac21f89f0 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:04:43.298247 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-9a18495f-ce8d-4e7e-8638-35dac21f89f0 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 310c55e1-be28-446a-9e6e-6b561316bec7] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:04:43.305699 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9a18495f-ce8d-4e7e-8638-35dac21f89f0 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:43.306188 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9a18495f-ce8d-4e7e-8638-35dac21f89f0 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:43.306632 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9a18495f-ce8d-4e7e-8638-35dac21f89f0 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:43.307326 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9a18495f-ce8d-4e7e-8638-35dac21f89f0 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:43.307790 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9a18495f-ce8d-4e7e-8638-35dac21f89f0 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:43.308262 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9a18495f-ce8d-4e7e-8638-35dac21f89f0 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:43.450980 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9a18495f-ce8d-4e7e-8638-35dac21f89f0 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:04:43.459573 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9a18495f-ce8d-4e7e-8638-35dac21f89f0 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7" status: 200 len: 1679 microversion: 2.1 time: 0.165898 Oct 04 20:04:43.460179 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4154/8293] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:04:43 2022] GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7 => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:04:44.482960 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0813492e-5c2b-4a36-989a-06a65a272f12 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:04:44.483595 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0813492e-5c2b-4a36-989a-06a65a272f12 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 310c55e1-be28-446a-9e6e-6b561316bec7] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:04:44.490523 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0813492e-5c2b-4a36-989a-06a65a272f12 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:44.491024 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0813492e-5c2b-4a36-989a-06a65a272f12 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:44.491474 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0813492e-5c2b-4a36-989a-06a65a272f12 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:44.492228 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0813492e-5c2b-4a36-989a-06a65a272f12 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:44.492699 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0813492e-5c2b-4a36-989a-06a65a272f12 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:44.500341 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0813492e-5c2b-4a36-989a-06a65a272f12 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:44.628951 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0813492e-5c2b-4a36-989a-06a65a272f12 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:04:44.636672 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0813492e-5c2b-4a36-989a-06a65a272f12 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7" status: 200 len: 1622 microversion: 2.1 time: 0.157618 Oct 04 20:04:44.637287 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4140/8294] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:04:44 2022] GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7 => generated 1622 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:04:44.671994 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-cba2b462-28c1-4ae7-b2e1-52c328341663 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:04:44.671994 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-cba2b462-28c1-4ae7-b2e1-52c328341663 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 310c55e1-be28-446a-9e6e-6b561316bec7] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:04:44.671994 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cba2b462-28c1-4ae7-b2e1-52c328341663 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:44.671994 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cba2b462-28c1-4ae7-b2e1-52c328341663 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:44.671994 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cba2b462-28c1-4ae7-b2e1-52c328341663 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:44.671994 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cba2b462-28c1-4ae7-b2e1-52c328341663 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:44.671994 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cba2b462-28c1-4ae7-b2e1-52c328341663 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:44.671994 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cba2b462-28c1-4ae7-b2e1-52c328341663 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:44.757066 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-cba2b462-28c1-4ae7-b2e1-52c328341663 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 310c55e1-be28-446a-9e6e-6b561316bec7] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=123001) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 20:04:45.035206 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-96457e1c-a14e-4372-93e4-4dd386aa95ca req-ef80abaf-88c4-41b7-98a1-2eb850d05b4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "310c55e1-be28-446a-9e6e-6b561316bec7", "name": "network-vif-unplugged", "status": "completed", "tag": "a59528cf-cd20-452e-9a18-18847b4c683c"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:04:45.044861 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-96457e1c-a14e-4372-93e4-4dd386aa95ca req-ef80abaf-88c4-41b7-98a1-2eb850d05b4f service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:45.045362 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-96457e1c-a14e-4372-93e4-4dd386aa95ca req-ef80abaf-88c4-41b7-98a1-2eb850d05b4f service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:45.047391 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-96457e1c-a14e-4372-93e4-4dd386aa95ca req-ef80abaf-88c4-41b7-98a1-2eb850d05b4f service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:45.060228 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.compute.server_external_events [req-96457e1c-a14e-4372-93e4-4dd386aa95ca req-ef80abaf-88c4-41b7-98a1-2eb850d05b4f service nova] Unable to find a host for instance 310c55e1-be28-446a-9e6e-6b561316bec7. Dropping event network-vif-unplugged {{(pid=123002) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 04 20:04:45.061130 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-96457e1c-a14e-4372-93e4-4dd386aa95ca req-ef80abaf-88c4-41b7-98a1-2eb850d05b4f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029886 Oct 04 20:04:45.061718 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4141/8295] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 20:04:45 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 04 20:04:45.076347 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-cba2b462-28c1-4ae7-b2e1-52c328341663 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "POST /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7/action" status: 202 len: 0 microversion: 2.1 time: 0.420049 Oct 04 20:04:45.077054 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4155/8296] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 20:04:44 2022] POST /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7/action => generated 0 bytes in 421 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:04:45.085215 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-354008da-af84-41ad-b072-8539c5bc4793 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:04:45.085861 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-354008da-af84-41ad-b072-8539c5bc4793 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 310c55e1-be28-446a-9e6e-6b561316bec7] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:04:45.091881 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-354008da-af84-41ad-b072-8539c5bc4793 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:45.092438 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-354008da-af84-41ad-b072-8539c5bc4793 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:45.092897 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-354008da-af84-41ad-b072-8539c5bc4793 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:45.093637 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-354008da-af84-41ad-b072-8539c5bc4793 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:45.094191 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-354008da-af84-41ad-b072-8539c5bc4793 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:45.094549 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-354008da-af84-41ad-b072-8539c5bc4793 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:45.234837 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-354008da-af84-41ad-b072-8539c5bc4793 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:04:45.243866 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-354008da-af84-41ad-b072-8539c5bc4793 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7" status: 200 len: 1630 microversion: 2.1 time: 0.162545 Oct 04 20:04:45.244678 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4142/8297] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:04:45 2022] GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7 => generated 1630 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:04:46.268400 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5951f5a9-d2fa-4e89-9173-93c646933a8b tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:04:46.269532 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5951f5a9-d2fa-4e89-9173-93c646933a8b tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 310c55e1-be28-446a-9e6e-6b561316bec7] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:04:46.276245 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5951f5a9-d2fa-4e89-9173-93c646933a8b tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:46.276766 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5951f5a9-d2fa-4e89-9173-93c646933a8b tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:46.277212 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5951f5a9-d2fa-4e89-9173-93c646933a8b tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:46.277951 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5951f5a9-d2fa-4e89-9173-93c646933a8b tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:46.278422 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5951f5a9-d2fa-4e89-9173-93c646933a8b tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:46.278856 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5951f5a9-d2fa-4e89-9173-93c646933a8b tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:46.283041 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:46.419816 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5951f5a9-d2fa-4e89-9173-93c646933a8b tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:04:46.428737 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5951f5a9-d2fa-4e89-9173-93c646933a8b tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7" status: 200 len: 1630 microversion: 2.1 time: 0.165229 Oct 04 20:04:46.429326 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4156/8298] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:04:46 2022] GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7 => generated 1630 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:04:47.452275 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3a623dd2-fa95-41c3-93b4-929b96abd288 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:04:47.452856 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3a623dd2-fa95-41c3-93b4-929b96abd288 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 310c55e1-be28-446a-9e6e-6b561316bec7] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:04:47.455466 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=31 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:47.461161 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3a623dd2-fa95-41c3-93b4-929b96abd288 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:47.461673 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3a623dd2-fa95-41c3-93b4-929b96abd288 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:47.462124 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3a623dd2-fa95-41c3-93b4-929b96abd288 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:47.463110 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3a623dd2-fa95-41c3-93b4-929b96abd288 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:47.471006 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3a623dd2-fa95-41c3-93b4-929b96abd288 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:47.471006 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3a623dd2-fa95-41c3-93b4-929b96abd288 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:47.471006 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=87 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:47.601907 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3a623dd2-fa95-41c3-93b4-929b96abd288 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:04:47.610225 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3a623dd2-fa95-41c3-93b4-929b96abd288 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7" status: 200 len: 1688 microversion: 2.1 time: 0.162019 Oct 04 20:04:47.610799 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4143/8299] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:04:47 2022] GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7 => generated 1688 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:04:48.238073 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-35af0e1f-8e4a-43b3-aa5d-705441d5da3a req-8c81f396-eaba-46e1-b065-0dbfa5d4aaa3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "310c55e1-be28-446a-9e6e-6b561316bec7", "tag": "a59528cf-cd20-452e-9a18-18847b4c683c"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:04:48.243558 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:48.249448 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-35af0e1f-8e4a-43b3-aa5d-705441d5da3a req-8c81f396-eaba-46e1-b065-0dbfa5d4aaa3 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:48.251751 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-35af0e1f-8e4a-43b3-aa5d-705441d5da3a req-8c81f396-eaba-46e1-b065-0dbfa5d4aaa3 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:48.251751 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-35af0e1f-8e4a-43b3-aa5d-705441d5da3a req-8c81f396-eaba-46e1-b065-0dbfa5d4aaa3 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:48.262646 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-35af0e1f-8e4a-43b3-aa5d-705441d5da3a req-8c81f396-eaba-46e1-b065-0dbfa5d4aaa3 service nova] Creating event network-changed:a59528cf-cd20-452e-9a18-18847b4c683c for instance 310c55e1-be28-446a-9e6e-6b561316bec7 on n-h2-850501-14 Oct 04 20:04:48.269110 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-35af0e1f-8e4a-43b3-aa5d-705441d5da3a req-8c81f396-eaba-46e1-b065-0dbfa5d4aaa3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092978 Oct 04 20:04:48.270024 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4157/8300] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 20:04:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:04:48.635450 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-85157305-7a39-44e2-a255-d007412350cd tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:04:48.636071 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-85157305-7a39-44e2-a255-d007412350cd tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 310c55e1-be28-446a-9e6e-6b561316bec7] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:04:48.643120 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-85157305-7a39-44e2-a255-d007412350cd tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:48.643673 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-85157305-7a39-44e2-a255-d007412350cd tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:48.644153 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-85157305-7a39-44e2-a255-d007412350cd tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:48.644879 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-85157305-7a39-44e2-a255-d007412350cd tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:48.645354 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-85157305-7a39-44e2-a255-d007412350cd tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:48.645831 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-85157305-7a39-44e2-a255-d007412350cd tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:48.781755 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-85157305-7a39-44e2-a255-d007412350cd tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:04:48.789807 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-85157305-7a39-44e2-a255-d007412350cd tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7" status: 200 len: 1688 microversion: 2.1 time: 0.158309 Oct 04 20:04:48.790384 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4144/8301] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:04:48 2022] GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7 => generated 1688 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:04:49.817220 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7db527be-7270-45be-b942-582380259c55 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:04:49.817914 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7db527be-7270-45be-b942-582380259c55 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 310c55e1-be28-446a-9e6e-6b561316bec7] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:04:49.826104 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7db527be-7270-45be-b942-582380259c55 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:49.826606 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7db527be-7270-45be-b942-582380259c55 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:49.827053 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7db527be-7270-45be-b942-582380259c55 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:49.827763 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7db527be-7270-45be-b942-582380259c55 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:49.828257 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7db527be-7270-45be-b942-582380259c55 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:49.828690 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7db527be-7270-45be-b942-582380259c55 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:49.975497 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7db527be-7270-45be-b942-582380259c55 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:04:49.984175 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7db527be-7270-45be-b942-582380259c55 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7" status: 200 len: 1688 microversion: 2.1 time: 0.174000 Oct 04 20:04:49.994483 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4158/8302] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:04:49 2022] GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7 => generated 1688 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:04:51.008616 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-25793851-84a9-452a-9f4f-4f43dbfbe341 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:04:51.009273 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-25793851-84a9-452a-9f4f-4f43dbfbe341 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 310c55e1-be28-446a-9e6e-6b561316bec7] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:04:51.015729 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-25793851-84a9-452a-9f4f-4f43dbfbe341 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:51.016373 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-25793851-84a9-452a-9f4f-4f43dbfbe341 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:51.016904 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-25793851-84a9-452a-9f4f-4f43dbfbe341 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:51.017697 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-25793851-84a9-452a-9f4f-4f43dbfbe341 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:51.018990 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-25793851-84a9-452a-9f4f-4f43dbfbe341 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:51.019675 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-25793851-84a9-452a-9f4f-4f43dbfbe341 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:51.163440 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-25793851-84a9-452a-9f4f-4f43dbfbe341 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:04:51.172337 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-25793851-84a9-452a-9f4f-4f43dbfbe341 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7" status: 200 len: 1688 microversion: 2.1 time: 0.167912 Oct 04 20:04:51.173194 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4145/8303] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:04:51 2022] GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7 => generated 1688 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:04:52.196160 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ffb35655-b20f-445f-be18-199de926b341 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:04:52.197599 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ffb35655-b20f-445f-be18-199de926b341 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 310c55e1-be28-446a-9e6e-6b561316bec7] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:04:52.204707 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ffb35655-b20f-445f-be18-199de926b341 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:52.205201 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ffb35655-b20f-445f-be18-199de926b341 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:52.206311 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ffb35655-b20f-445f-be18-199de926b341 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:52.207156 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ffb35655-b20f-445f-be18-199de926b341 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:52.207597 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ffb35655-b20f-445f-be18-199de926b341 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:52.208124 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ffb35655-b20f-445f-be18-199de926b341 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:52.367582 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ffb35655-b20f-445f-be18-199de926b341 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:04:52.376928 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ffb35655-b20f-445f-be18-199de926b341 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7" status: 200 len: 1688 microversion: 2.1 time: 0.184582 Oct 04 20:04:52.388717 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4159/8304] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:04:52 2022] GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7 => generated 1688 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:04:53.402928 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1d21c5a9-45cf-4f88-8069-ad1cc9c9f3f4 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:04:53.403579 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1d21c5a9-45cf-4f88-8069-ad1cc9c9f3f4 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 310c55e1-be28-446a-9e6e-6b561316bec7] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:04:53.415550 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1d21c5a9-45cf-4f88-8069-ad1cc9c9f3f4 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:53.416090 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1d21c5a9-45cf-4f88-8069-ad1cc9c9f3f4 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:53.416592 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1d21c5a9-45cf-4f88-8069-ad1cc9c9f3f4 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:53.417319 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1d21c5a9-45cf-4f88-8069-ad1cc9c9f3f4 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:53.417797 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1d21c5a9-45cf-4f88-8069-ad1cc9c9f3f4 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:53.418244 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1d21c5a9-45cf-4f88-8069-ad1cc9c9f3f4 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:53.606432 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1d21c5a9-45cf-4f88-8069-ad1cc9c9f3f4 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:04:53.615340 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1d21c5a9-45cf-4f88-8069-ad1cc9c9f3f4 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7" status: 200 len: 1688 microversion: 2.1 time: 0.216388 Oct 04 20:04:53.632987 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4146/8305] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:04:53 2022] GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7 => generated 1688 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:04:54.644223 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f73e2465-f4ac-4ada-a811-dc8cc241411c tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:04:54.645155 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f73e2465-f4ac-4ada-a811-dc8cc241411c tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 310c55e1-be28-446a-9e6e-6b561316bec7] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:04:54.652228 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f73e2465-f4ac-4ada-a811-dc8cc241411c tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:54.652719 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f73e2465-f4ac-4ada-a811-dc8cc241411c tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:54.653160 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f73e2465-f4ac-4ada-a811-dc8cc241411c tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:54.653852 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f73e2465-f4ac-4ada-a811-dc8cc241411c tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:54.654441 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f73e2465-f4ac-4ada-a811-dc8cc241411c tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:54.654865 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f73e2465-f4ac-4ada-a811-dc8cc241411c tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:54.819471 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f73e2465-f4ac-4ada-a811-dc8cc241411c tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:04:54.828444 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f73e2465-f4ac-4ada-a811-dc8cc241411c tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7" status: 200 len: 1688 microversion: 2.1 time: 0.189481 Oct 04 20:04:54.831422 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4160/8306] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:04:54 2022] GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7 => generated 1688 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:04:55.854134 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-29850e7a-702d-46ce-8e00-8ee79723d8ec tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:04:55.855581 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-29850e7a-702d-46ce-8e00-8ee79723d8ec tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 310c55e1-be28-446a-9e6e-6b561316bec7] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:04:55.864266 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-29850e7a-702d-46ce-8e00-8ee79723d8ec tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:55.865871 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-29850e7a-702d-46ce-8e00-8ee79723d8ec tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:55.866422 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-29850e7a-702d-46ce-8e00-8ee79723d8ec tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:55.867238 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-29850e7a-702d-46ce-8e00-8ee79723d8ec tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:55.867789 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-29850e7a-702d-46ce-8e00-8ee79723d8ec tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:55.868334 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-29850e7a-702d-46ce-8e00-8ee79723d8ec tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:56.020943 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-29850e7a-702d-46ce-8e00-8ee79723d8ec tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:04:56.028957 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-29850e7a-702d-46ce-8e00-8ee79723d8ec tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7" status: 200 len: 1688 microversion: 2.1 time: 0.178976 Oct 04 20:04:56.029544 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4147/8307] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:04:55 2022] GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7 => generated 1688 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:04:57.053513 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-eab13896-76a5-4db5-bc49-37c2c6e4b290 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:04:57.054184 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-eab13896-76a5-4db5-bc49-37c2c6e4b290 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 310c55e1-be28-446a-9e6e-6b561316bec7] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:04:57.061456 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eab13896-76a5-4db5-bc49-37c2c6e4b290 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:57.061967 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eab13896-76a5-4db5-bc49-37c2c6e4b290 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:57.062466 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eab13896-76a5-4db5-bc49-37c2c6e4b290 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:57.063301 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eab13896-76a5-4db5-bc49-37c2c6e4b290 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:57.063768 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eab13896-76a5-4db5-bc49-37c2c6e4b290 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:57.064232 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-eab13896-76a5-4db5-bc49-37c2c6e4b290 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:57.465247 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-eab13896-76a5-4db5-bc49-37c2c6e4b290 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:04:57.473080 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-eab13896-76a5-4db5-bc49-37c2c6e4b290 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7" status: 200 len: 1688 microversion: 2.1 time: 0.424157 Oct 04 20:04:57.473644 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4161/8308] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:04:57 2022] GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7 => generated 1688 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:04:58.497460 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-6a84b6d8-197c-4ad8-bc5f-c73c56a9fcbc tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:04:58.498091 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-6a84b6d8-197c-4ad8-bc5f-c73c56a9fcbc tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 310c55e1-be28-446a-9e6e-6b561316bec7] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:04:58.505530 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6a84b6d8-197c-4ad8-bc5f-c73c56a9fcbc tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:58.506026 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6a84b6d8-197c-4ad8-bc5f-c73c56a9fcbc tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:58.506474 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6a84b6d8-197c-4ad8-bc5f-c73c56a9fcbc tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:58.507173 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6a84b6d8-197c-4ad8-bc5f-c73c56a9fcbc tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:58.507638 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6a84b6d8-197c-4ad8-bc5f-c73c56a9fcbc tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:58.508090 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-6a84b6d8-197c-4ad8-bc5f-c73c56a9fcbc tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:58.642963 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-6a84b6d8-197c-4ad8-bc5f-c73c56a9fcbc tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:04:58.650735 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-6a84b6d8-197c-4ad8-bc5f-c73c56a9fcbc tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7" status: 200 len: 1688 microversion: 2.1 time: 0.157246 Oct 04 20:04:58.651319 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4148/8309] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:04:58 2022] GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7 => generated 1688 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:04:59.674628 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a3e54cb6-9e8d-4b9c-9fc1-0281ab4d5aab tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:04:59.675258 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a3e54cb6-9e8d-4b9c-9fc1-0281ab4d5aab tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 310c55e1-be28-446a-9e6e-6b561316bec7] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:04:59.683452 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a3e54cb6-9e8d-4b9c-9fc1-0281ab4d5aab tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:59.683949 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a3e54cb6-9e8d-4b9c-9fc1-0281ab4d5aab tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:59.684421 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a3e54cb6-9e8d-4b9c-9fc1-0281ab4d5aab tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:59.685174 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a3e54cb6-9e8d-4b9c-9fc1-0281ab4d5aab tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:59.685858 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a3e54cb6-9e8d-4b9c-9fc1-0281ab4d5aab tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:59.686658 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a3e54cb6-9e8d-4b9c-9fc1-0281ab4d5aab tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:59.821805 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a3e54cb6-9e8d-4b9c-9fc1-0281ab4d5aab tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:04:59.829439 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a3e54cb6-9e8d-4b9c-9fc1-0281ab4d5aab tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7" status: 200 len: 1688 microversion: 2.1 time: 0.158771 Oct 04 20:04:59.829989 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4162/8310] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:04:59 2022] GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7 => generated 1688 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:05:00.853341 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8380dec1-281a-4abb-9636-02a5ab827e7e tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:05:00.853995 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8380dec1-281a-4abb-9636-02a5ab827e7e tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 310c55e1-be28-446a-9e6e-6b561316bec7] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:05:00.860910 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8380dec1-281a-4abb-9636-02a5ab827e7e tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:05:00.861456 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8380dec1-281a-4abb-9636-02a5ab827e7e tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:05:00.862444 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8380dec1-281a-4abb-9636-02a5ab827e7e tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:05:00.863160 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8380dec1-281a-4abb-9636-02a5ab827e7e tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:05:00.863629 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8380dec1-281a-4abb-9636-02a5ab827e7e tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:05:00.864093 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8380dec1-281a-4abb-9636-02a5ab827e7e tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:05:01.007884 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8380dec1-281a-4abb-9636-02a5ab827e7e tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:05:01.015787 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8380dec1-281a-4abb-9636-02a5ab827e7e tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7" status: 200 len: 1688 microversion: 2.1 time: 0.166658 Oct 04 20:05:01.016407 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4149/8311] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:05:00 2022] GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7 => generated 1688 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:05:02.040284 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f9c3b594-e217-42d3-ab38-e1f4fc7448ff tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:05:02.040909 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f9c3b594-e217-42d3-ab38-e1f4fc7448ff tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 310c55e1-be28-446a-9e6e-6b561316bec7] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:05:02.047678 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f9c3b594-e217-42d3-ab38-e1f4fc7448ff tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:05:02.048201 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f9c3b594-e217-42d3-ab38-e1f4fc7448ff tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:05:02.048668 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f9c3b594-e217-42d3-ab38-e1f4fc7448ff tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:05:02.050379 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f9c3b594-e217-42d3-ab38-e1f4fc7448ff tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:05:02.050849 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f9c3b594-e217-42d3-ab38-e1f4fc7448ff tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:05:02.051287 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f9c3b594-e217-42d3-ab38-e1f4fc7448ff tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:05:02.184874 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f9c3b594-e217-42d3-ab38-e1f4fc7448ff tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:05:02.193379 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f9c3b594-e217-42d3-ab38-e1f4fc7448ff tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7" status: 200 len: 1688 microversion: 2.1 time: 0.157055 Oct 04 20:05:02.194152 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4163/8312] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:05:02 2022] GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7 => generated 1688 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:05:03.217051 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3b3196cf-a2d8-4439-b355-67f2be43e560 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:05:03.217672 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3b3196cf-a2d8-4439-b355-67f2be43e560 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 310c55e1-be28-446a-9e6e-6b561316bec7] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:05:03.225216 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3b3196cf-a2d8-4439-b355-67f2be43e560 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:05:03.225717 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3b3196cf-a2d8-4439-b355-67f2be43e560 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:05:03.226170 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3b3196cf-a2d8-4439-b355-67f2be43e560 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:05:03.226877 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3b3196cf-a2d8-4439-b355-67f2be43e560 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:05:03.227348 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3b3196cf-a2d8-4439-b355-67f2be43e560 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:05:03.228070 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3b3196cf-a2d8-4439-b355-67f2be43e560 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:05:03.364849 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3b3196cf-a2d8-4439-b355-67f2be43e560 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:05:03.373104 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3b3196cf-a2d8-4439-b355-67f2be43e560 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7" status: 200 len: 1688 microversion: 2.1 time: 0.159933 Oct 04 20:05:03.373881 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4150/8313] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:05:03 2022] GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7 => generated 1688 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:05:03.585524 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-03f511d0-913d-45fd-ac30-07bbbed55f77 req-80bac20e-bb4e-42b7-aee1-0aa28b622fae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "310c55e1-be28-446a-9e6e-6b561316bec7", "name": "network-vif-plugged", "status": "completed", "tag": "a59528cf-cd20-452e-9a18-18847b4c683c"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:05:03.595761 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-03f511d0-913d-45fd-ac30-07bbbed55f77 req-80bac20e-bb4e-42b7-aee1-0aa28b622fae service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:05:03.596297 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-03f511d0-913d-45fd-ac30-07bbbed55f77 req-80bac20e-bb4e-42b7-aee1-0aa28b622fae service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:05:03.596739 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-03f511d0-913d-45fd-ac30-07bbbed55f77 req-80bac20e-bb4e-42b7-aee1-0aa28b622fae service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:05:03.607993 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-03f511d0-913d-45fd-ac30-07bbbed55f77 req-80bac20e-bb4e-42b7-aee1-0aa28b622fae service nova] Creating event network-vif-plugged:a59528cf-cd20-452e-9a18-18847b4c683c for instance 310c55e1-be28-446a-9e6e-6b561316bec7 on n-h2-850501-14 Oct 04 20:05:03.614076 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-03f511d0-913d-45fd-ac30-07bbbed55f77 req-80bac20e-bb4e-42b7-aee1-0aa28b622fae service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032336 Oct 04 20:05:03.614661 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4164/8314] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 20:05:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:05:04.397233 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9bc2df66-e9e2-4acf-837d-57ce3087bf93 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:05:04.397949 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9bc2df66-e9e2-4acf-837d-57ce3087bf93 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 310c55e1-be28-446a-9e6e-6b561316bec7] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:05:04.404836 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9bc2df66-e9e2-4acf-837d-57ce3087bf93 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:05:04.405338 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9bc2df66-e9e2-4acf-837d-57ce3087bf93 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:05:04.405787 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9bc2df66-e9e2-4acf-837d-57ce3087bf93 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:05:04.406494 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9bc2df66-e9e2-4acf-837d-57ce3087bf93 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:05:04.406967 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9bc2df66-e9e2-4acf-837d-57ce3087bf93 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:05:04.407411 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9bc2df66-e9e2-4acf-837d-57ce3087bf93 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:05:04.542023 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9bc2df66-e9e2-4acf-837d-57ce3087bf93 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:05:04.550753 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9bc2df66-e9e2-4acf-837d-57ce3087bf93 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7" status: 200 len: 1688 microversion: 2.1 time: 0.157387 Oct 04 20:05:04.551343 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4151/8315] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:05:04 2022] GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7 => generated 1688 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:05:05.575837 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-075f2b4d-d4b9-4aa6-b622-7e17c9ad0b25 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:05:05.576575 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-075f2b4d-d4b9-4aa6-b622-7e17c9ad0b25 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 310c55e1-be28-446a-9e6e-6b561316bec7] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:05:05.583812 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-075f2b4d-d4b9-4aa6-b622-7e17c9ad0b25 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:05:05.584349 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-075f2b4d-d4b9-4aa6-b622-7e17c9ad0b25 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:05:05.584815 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-075f2b4d-d4b9-4aa6-b622-7e17c9ad0b25 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:05:05.585509 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-075f2b4d-d4b9-4aa6-b622-7e17c9ad0b25 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:05:05.585969 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-075f2b4d-d4b9-4aa6-b622-7e17c9ad0b25 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:05:05.586391 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-075f2b4d-d4b9-4aa6-b622-7e17c9ad0b25 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:05:05.725269 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-075f2b4d-d4b9-4aa6-b622-7e17c9ad0b25 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:05:05.733392 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-075f2b4d-d4b9-4aa6-b622-7e17c9ad0b25 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7" status: 200 len: 1688 microversion: 2.1 time: 0.162790 Oct 04 20:05:05.733994 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4165/8316] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:05:05 2022] GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7 => generated 1688 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:05:06.758852 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5c0e06c1-1905-40df-b81f-5b9e7e1040af tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:05:06.759518 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5c0e06c1-1905-40df-b81f-5b9e7e1040af tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 310c55e1-be28-446a-9e6e-6b561316bec7] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:05:06.766505 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5c0e06c1-1905-40df-b81f-5b9e7e1040af tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:05:06.767011 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5c0e06c1-1905-40df-b81f-5b9e7e1040af tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:05:06.767515 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5c0e06c1-1905-40df-b81f-5b9e7e1040af tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:05:06.768289 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5c0e06c1-1905-40df-b81f-5b9e7e1040af tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:05:06.768772 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5c0e06c1-1905-40df-b81f-5b9e7e1040af tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:05:06.769214 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5c0e06c1-1905-40df-b81f-5b9e7e1040af tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:05:06.903413 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5c0e06c1-1905-40df-b81f-5b9e7e1040af tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:05:06.911717 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5c0e06c1-1905-40df-b81f-5b9e7e1040af tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7" status: 200 len: 1675 microversion: 2.1 time: 0.156774 Oct 04 20:05:06.912341 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4152/8317] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:05:06 2022] GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7 => generated 1675 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:06:52.192543 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=17 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:52.195817 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=51 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:52.195817 n-d-850501-14 devstack@n-api.service[123001]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 20:06:52.195817 n-d-850501-14 devstack@n-api.service[123001]: Tue Oct 4 20:06:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7 (ip 10.222.0.20) !!! Oct 04 20:06:52.199310 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=19 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:52.200306 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=59 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:52.202248 n-d-850501-14 devstack@n-api.service[123002]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 20:06:52.202467 n-d-850501-14 devstack@n-api.service[123002]: Tue Oct 4 20:06:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.20) !!! Oct 04 20:06:52.215913 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-4105302c-05a3-4995-99d5-c9ce3150abce req-738c2fa1-23d0-473e-be39-d272146b147a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "310c55e1-be28-446a-9e6e-6b561316bec7", "tag": "a59528cf-cd20-452e-9a18-18847b4c683c"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:06:52.224856 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9de349a3-a6c3-4bb0-8165-2e9b760deacf tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:06:52.225379 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-9de349a3-a6c3-4bb0-8165-2e9b760deacf tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 310c55e1-be28-446a-9e6e-6b561316bec7] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:06:52.231399 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-4105302c-05a3-4995-99d5-c9ce3150abce req-738c2fa1-23d0-473e-be39-d272146b147a service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:06:52.232740 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-4105302c-05a3-4995-99d5-c9ce3150abce req-738c2fa1-23d0-473e-be39-d272146b147a service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:06:52.233049 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-4105302c-05a3-4995-99d5-c9ce3150abce req-738c2fa1-23d0-473e-be39-d272146b147a service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:06:52.238893 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9de349a3-a6c3-4bb0-8165-2e9b760deacf tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:06:52.239394 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9de349a3-a6c3-4bb0-8165-2e9b760deacf tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:06:52.240296 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9de349a3-a6c3-4bb0-8165-2e9b760deacf tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:06:52.241021 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9de349a3-a6c3-4bb0-8165-2e9b760deacf tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:06:52.241487 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9de349a3-a6c3-4bb0-8165-2e9b760deacf tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:06:52.241922 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9de349a3-a6c3-4bb0-8165-2e9b760deacf tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:06:52.244695 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-4105302c-05a3-4995-99d5-c9ce3150abce req-738c2fa1-23d0-473e-be39-d272146b147a service nova] Creating event network-changed:a59528cf-cd20-452e-9a18-18847b4c683c for instance 310c55e1-be28-446a-9e6e-6b561316bec7 on n-h2-850501-14 Oct 04 20:06:52.252341 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-4105302c-05a3-4995-99d5-c9ce3150abce req-738c2fa1-23d0-473e-be39-d272146b147a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054706 Oct 04 20:06:52.256215 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4153/8318] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 20:06:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:06:52.269732 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-9de349a3-a6c3-4bb0-8165-2e9b760deacf tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 310c55e1-be28-446a-9e6e-6b561316bec7] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:06:52.584040 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9de349a3-a6c3-4bb0-8165-2e9b760deacf tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "DELETE /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7" status: 204 len: 0 microversion: 2.1 time: 0.387913 Oct 04 20:06:52.584040 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4166/8319] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 20:06:52 2022] DELETE /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:06:52.591025 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b94a4f3c-94ae-4988-9e0f-a870b710a2c9 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:06:52.592648 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b94a4f3c-94ae-4988-9e0f-a870b710a2c9 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 310c55e1-be28-446a-9e6e-6b561316bec7] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:06:52.600511 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b94a4f3c-94ae-4988-9e0f-a870b710a2c9 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:06:52.601025 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b94a4f3c-94ae-4988-9e0f-a870b710a2c9 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:06:52.601565 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b94a4f3c-94ae-4988-9e0f-a870b710a2c9 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:06:52.602276 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b94a4f3c-94ae-4988-9e0f-a870b710a2c9 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:06:52.603020 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b94a4f3c-94ae-4988-9e0f-a870b710a2c9 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:06:52.607523 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b94a4f3c-94ae-4988-9e0f-a870b710a2c9 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:06:52.752369 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b94a4f3c-94ae-4988-9e0f-a870b710a2c9 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:06:52.760349 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b94a4f3c-94ae-4988-9e0f-a870b710a2c9 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7" status: 200 len: 1681 microversion: 2.1 time: 0.175982 Oct 04 20:06:52.760950 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4154/8320] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:06:52 2022] GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7 => generated 1681 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:06:53.784687 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e480f5f5-d4af-4ccf-8cdd-69b1a52b51ac tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:06:53.785391 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e480f5f5-d4af-4ccf-8cdd-69b1a52b51ac tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 310c55e1-be28-446a-9e6e-6b561316bec7] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:06:53.792698 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e480f5f5-d4af-4ccf-8cdd-69b1a52b51ac tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:06:53.793183 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e480f5f5-d4af-4ccf-8cdd-69b1a52b51ac tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:06:53.793617 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e480f5f5-d4af-4ccf-8cdd-69b1a52b51ac tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:06:53.794902 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e480f5f5-d4af-4ccf-8cdd-69b1a52b51ac tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:06:53.795354 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e480f5f5-d4af-4ccf-8cdd-69b1a52b51ac tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:06:53.795771 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e480f5f5-d4af-4ccf-8cdd-69b1a52b51ac tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:06:53.942033 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e480f5f5-d4af-4ccf-8cdd-69b1a52b51ac tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:06:53.949887 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e480f5f5-d4af-4ccf-8cdd-69b1a52b51ac tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7" status: 200 len: 1681 microversion: 2.1 time: 0.169320 Oct 04 20:06:53.951095 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4167/8321] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:06:53 2022] GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7 => generated 1681 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:06:54.970458 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-b18d625d-785c-403e-a0bb-9f5dbe1daee4 req-9738bf77-2da7-4ceb-bd7c-b5965f14ec5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "310c55e1-be28-446a-9e6e-6b561316bec7", "name": "network-vif-deleted", "tag": "a59528cf-cd20-452e-9a18-18847b4c683c"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:06:54.975184 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6705be19-c482-42fe-b738-d149afc68d0d tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:06:54.979807 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6705be19-c482-42fe-b738-d149afc68d0d tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 310c55e1-be28-446a-9e6e-6b561316bec7] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:06:54.981295 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-b18d625d-785c-403e-a0bb-9f5dbe1daee4 req-9738bf77-2da7-4ceb-bd7c-b5965f14ec5d service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:06:54.982543 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-b18d625d-785c-403e-a0bb-9f5dbe1daee4 req-9738bf77-2da7-4ceb-bd7c-b5965f14ec5d service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:06:54.983182 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-b18d625d-785c-403e-a0bb-9f5dbe1daee4 req-9738bf77-2da7-4ceb-bd7c-b5965f14ec5d service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:06:54.985579 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6705be19-c482-42fe-b738-d149afc68d0d tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:06:54.986142 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6705be19-c482-42fe-b738-d149afc68d0d tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:06:54.986592 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6705be19-c482-42fe-b738-d149afc68d0d tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:06:54.987589 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6705be19-c482-42fe-b738-d149afc68d0d tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:06:54.988304 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6705be19-c482-42fe-b738-d149afc68d0d tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:06:54.988959 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6705be19-c482-42fe-b738-d149afc68d0d tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:06:54.995035 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-b18d625d-785c-403e-a0bb-9f5dbe1daee4 req-9738bf77-2da7-4ceb-bd7c-b5965f14ec5d service nova] Creating event network-vif-deleted:a59528cf-cd20-452e-9a18-18847b4c683c for instance 310c55e1-be28-446a-9e6e-6b561316bec7 on n-h2-850501-14 Oct 04 20:06:55.000554 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-b18d625d-785c-403e-a0bb-9f5dbe1daee4 req-9738bf77-2da7-4ceb-bd7c-b5965f14ec5d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034274 Oct 04 20:06:55.001212 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4155/8322] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 20:06:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:06:55.056393 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6705be19-c482-42fe-b738-d149afc68d0d tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:06:55.064459 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6705be19-c482-42fe-b738-d149afc68d0d tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7" status: 200 len: 1494 microversion: 2.1 time: 0.093528 Oct 04 20:06:55.065041 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4168/8323] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:06:54 2022] GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7 => generated 1494 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:06:56.089421 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3c8fdcf5-1727-4132-bed9-6ae06e94c945 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:06:56.090063 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3c8fdcf5-1727-4132-bed9-6ae06e94c945 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 310c55e1-be28-446a-9e6e-6b561316bec7] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:06:56.097078 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3c8fdcf5-1727-4132-bed9-6ae06e94c945 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:06:56.099235 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3c8fdcf5-1727-4132-bed9-6ae06e94c945 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:06:56.099235 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3c8fdcf5-1727-4132-bed9-6ae06e94c945 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:06:56.099235 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3c8fdcf5-1727-4132-bed9-6ae06e94c945 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:06:56.099235 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3c8fdcf5-1727-4132-bed9-6ae06e94c945 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:06:56.099657 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-3c8fdcf5-1727-4132-bed9-6ae06e94c945 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:06:56.113125 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.wsgi [None req-3c8fdcf5-1727-4132-bed9-6ae06e94c945 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] HTTP exception thrown: Instance 310c55e1-be28-446a-9e6e-6b561316bec7 could not be found. Oct 04 20:06:56.114790 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3c8fdcf5-1727-4132-bed9-6ae06e94c945 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Request method failure captured: Oct 04 20:06:56.114790 n-d-850501-14 devstack@n-api.service[123002]: request: GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7 HTTP/1.1 Oct 04 20:06:56.114790 n-d-850501-14 devstack@n-api.service[123002]: Accept: application/json Oct 04 20:06:56.114790 n-d-850501-14 devstack@n-api.service[123002]: Accept-Encoding: identity Oct 04 20:06:56.114790 n-d-850501-14 devstack@n-api.service[123002]: Connection: close Oct 04 20:06:56.114790 n-d-850501-14 devstack@n-api.service[123002]: Content-Length: 0 Oct 04 20:06:56.114790 n-d-850501-14 devstack@n-api.service[123002]: Content-Type: application/json Oct 04 20:06:56.114790 n-d-850501-14 devstack@n-api.service[123002]: Host: 10.222.0.20 Oct 04 20:06:56.114790 n-d-850501-14 devstack@n-api.service[123002]: Openstack-System-Scope: None Oct 04 20:06:56.114790 n-d-850501-14 devstack@n-api.service[123002]: User-Agent: python-urllib3/1.26.12 Oct 04 20:06:56.114790 n-d-850501-14 devstack@n-api.service[123002]: X-Auth-Token: gAAAAABjPJEy28g1KImpZQVU6Zt__dxS9u-6wDoUxhDOgsy_V7A07RIoCsM_PT9ZH3RpjFCyYIk9D7R-ahasHh-ZGV73sexhhpHLKeMbENO0c-JvOk0OaCq_vM7TyZILNpquNtRaAf9bHKXjSuDyJU2WANFynYLRjfn8WYqViXBdHsrQ1qXE3tI Oct 04 20:06:56.114790 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Id: None Oct 04 20:06:56.114790 n-d-850501-14 devstack@n-api.service[123002]: X-Domain-Name: None Oct 04 20:06:56.114790 n-d-850501-14 devstack@n-api.service[123002]: X-Identity-Status: Confirmed Oct 04 20:06:56.114790 n-d-850501-14 devstack@n-api.service[123002]: X-Is-Admin-Project: True Oct 04 20:06:56.114790 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Id: default Oct 04 20:06:56.114790 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Domain-Name: Default Oct 04 20:06:56.114790 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Id: 92d5e2ecd4c34120afd16b7924267082 Oct 04 20:06:56.114790 n-d-850501-14 devstack@n-api.service[123002]: X-Project-Name: tempest-TestShelveInstance-1707385160 Oct 04 20:06:56.114790 n-d-850501-14 devstack@n-api.service[123002]: X-Role: reader,member Oct 04 20:06:56.114790 n-d-850501-14 devstack@n-api.service[123002]: X-Roles: reader,member Oct 04 20:06:56.114790 n-d-850501-14 devstack@n-api.service[123002]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/92d5e2ecd4c34120afd16b7924267082"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_92d5e2ecd4c34120afd16b7924267082", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/92d5e2ecd4c34120afd16b7924267082"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/92d5e2ecd4c34120afd16b7924267082"}]}] Oct 04 20:06:56.114790 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant: tempest-TestShelveInstance-1707385160 Oct 04 20:06:56.114790 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Id: 92d5e2ecd4c34120afd16b7924267082 Oct 04 20:06:56.114790 n-d-850501-14 devstack@n-api.service[123002]: X-Tenant-Name: tempest-TestShelveInstance-1707385160 Oct 04 20:06:56.114790 n-d-850501-14 devstack@n-api.service[123002]: X-User: tempest-TestShelveInstance-1707385160-project Oct 04 20:06:56.114790 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Id: default Oct 04 20:06:56.114790 n-d-850501-14 devstack@n-api.service[123002]: X-User-Domain-Name: Default Oct 04 20:06:56.114790 n-d-850501-14 devstack@n-api.service[123002]: X-User-Id: e363289512f8439bb0f2116f3e361e79 Oct 04 20:06:56.114790 n-d-850501-14 devstack@n-api.service[123002]: X-User-Name: tempest-TestShelveInstance-1707385160-project Oct 04 20:06:56.114790 n-d-850501-14 devstack@n-api.service[123002]: method: > Oct 04 20:06:56.114790 n-d-850501-14 devstack@n-api.service[123002]: exception: Instance 310c55e1-be28-446a-9e6e-6b561316bec7 could not be found. Oct 04 20:06:56.114790 n-d-850501-14 devstack@n-api.service[123002]: action_args: {'id': '310c55e1-be28-446a-9e6e-6b561316bec7'} Oct 04 20:06:56.114790 n-d-850501-14 devstack@n-api.service[123002]: {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:06:56.114790 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:06:56.114790 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:06:56.114790 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:06:56.114790 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:06:56.114790 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:06:56.114790 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:06:56.114790 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:06:56.114790 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:06:56.114790 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:06:56.114790 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 310c55e1-be28-446a-9e6e-6b561316bec7 could not be found. Oct 04 20:06:56.114790 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 20:06:56.114790 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:06:56.114790 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 20:06:56.114790 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:06:56.114790 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:06:56.114790 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:06:56.114790 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:06:56.114790 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:06:56.114790 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:06:56.114790 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:06:56.114790 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:06:56.114790 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:06:56.114790 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:06:56.114790 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:06:56.114790 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:06:56.114790 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:06:56.114790 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 310c55e1-be28-446a-9e6e-6b561316bec7 could not be found. Oct 04 20:06:56.114790 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 20:06:56.114790 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:06:56.114790 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 20:06:56.120756 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:06:56.120756 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:06:56.120756 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:06:56.120756 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:06:56.120756 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:06:56.120756 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 310c55e1-be28-446a-9e6e-6b561316bec7 could not be found. Oct 04 20:06:56.120756 n-d-850501-14 devstack@n-api.service[123002]: ERROR nova.api.openstack.wsgi Oct 04 20:06:56.120756 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3c8fdcf5-1727-4132-bed9-6ae06e94c945 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Returning 404 to user: Instance 310c55e1-be28-446a-9e6e-6b561316bec7 could not be found. {{(pid=123002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:06:56.120756 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3c8fdcf5-1727-4132-bed9-6ae06e94c945 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7" status: 404 len: 111 microversion: 2.1 time: 0.032044 Oct 04 20:06:56.120756 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4156/8324] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:06:56 2022] GET /compute/v2.1/servers/310c55e1-be28-446a-9e6e-6b561316bec7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:06:56.348020 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-cdfe5428-8a0a-402a-855c-cd0e1b5c20f8 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '.version_select at 0x7fe253b54b80>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:06:56.429538 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-cdfe5428-8a0a-402a-855c-cd0e1b5c20f8 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1573537177" status: 202 len: 0 microversion: 2.1 time: 0.085444 Oct 04 20:06:56.430208 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4169/8325] 10.222.0.20 () {58 vars in 1254 bytes} [Tue Oct 4 20:06:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1573537177 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:06:56.456578 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-89742c83-36d6-4a5b-959c-be906bbb64f1 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Action: 'create', calling method: .version_select at 0x7fe253aadb80>, body: {"keypair": {"name": "tempest-TestShelveInstance-786309225", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMJ5q6pb3CGWoO7SNel+knqBCCB/1dJMqHSqLH3Vz9Pr1JjxGRkFASvomjmX8pMlAbxSL8bCwC6dN43GRWEcr0AndX0RuTR7sXayMl8Yb/frPg/LnxNavk8UcD1jIWUBQA=="}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:06:56.472320 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-89742c83-36d6-4a5b-959c-be906bbb64f1 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Getting quotas for project 92d5e2ecd4c34120afd16b7924267082. Resources: {'key_pairs'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:06:56.477550 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-89742c83-36d6-4a5b-959c-be906bbb64f1 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Getting quotas for user e363289512f8439bb0f2116f3e361e79 and project 92d5e2ecd4c34120afd16b7924267082. Resources: {'key_pairs'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:06:56.567201 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-89742c83-36d6-4a5b-959c-be906bbb64f1 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.114516 Oct 04 20:06:56.567836 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4157/8326] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Oct 4 20:06:56 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:07:26.461932 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:07:26.462609 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:07:26.466741 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-fecfea92-0854-4feb-a289-c97de8e895d9 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-452515544", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-786309225", "security_groups": [{"name": "tempest-secgroup-smoke-744416670"}], "networks": [{"uuid": "275bc792-9a22-41d9-84cc-8a9097a610d0"}], "block_device_mapping_v2": [{"uuid": "eaaa1d92-8506-4a93-8879-98d5e133451d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:07:26.628402 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.neutron [None req-fecfea92-0854-4feb-a289-c97de8e895d9 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] validate_networks() for [('275bc792-9a22-41d9-84cc-8a9097a610d0', None, None, None, None, None)] {{(pid=123001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:07:27.025510 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-fecfea92-0854-4feb-a289-c97de8e895d9 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:07:27.025948 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-fecfea92-0854-4feb-a289-c97de8e895d9 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:07:27.026436 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-fecfea92-0854-4feb-a289-c97de8e895d9 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:07:27.027594 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-fecfea92-0854-4feb-a289-c97de8e895d9 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:07:27.028075 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-fecfea92-0854-4feb-a289-c97de8e895d9 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:07:27.037495 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fecfea92-0854-4feb-a289-c97de8e895d9 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:07:27.037985 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fecfea92-0854-4feb-a289-c97de8e895d9 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:07:27.038477 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fecfea92-0854-4feb-a289-c97de8e895d9 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:07:27.039210 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fecfea92-0854-4feb-a289-c97de8e895d9 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:07:27.039669 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fecfea92-0854-4feb-a289-c97de8e895d9 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:07:27.040116 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fecfea92-0854-4feb-a289-c97de8e895d9 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:07:27.062965 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-fecfea92-0854-4feb-a289-c97de8e895d9 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Getting quotas for project 92d5e2ecd4c34120afd16b7924267082. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:07:27.068282 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-fecfea92-0854-4feb-a289-c97de8e895d9 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Getting quotas for user e363289512f8439bb0f2116f3e361e79 and project 92d5e2ecd4c34120afd16b7924267082. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:07:27.128454 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-fecfea92-0854-4feb-a289-c97de8e895d9 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Going to run 1 instances... {{(pid=123001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:07:27.130609 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-fecfea92-0854-4feb-a289-c97de8e895d9 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 1bd7692e-4876-4153-8471-85bb1c8ae2ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='eaaa1d92-8506-4a93-8879-98d5e133451d',volume_size=None,volume_type=None)] {{(pid=123001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:07:27.639382 n-d-850501-14 devstack@n-api.service[123001]: ERROR oslo.messaging._drivers.impl_rabbit [None req-fecfea92-0854-4feb-a289-c97de8e895d9 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [709b2d6c-c12c-40ee-960b-8ad1f1059fd5] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 20:07:28.646662 n-d-850501-14 devstack@n-api.service[123001]: INFO oslo.messaging._drivers.impl_rabbit [None req-fecfea92-0854-4feb-a289-c97de8e895d9 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [709b2d6c-c12c-40ee-960b-8ad1f1059fd5] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 55044. Oct 04 20:07:28.650478 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-fecfea92-0854-4feb-a289-c97de8e895d9 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.190560 Oct 04 20:07:28.651135 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4170/8327] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 20:07:26 2022] POST /compute/v2.1/servers => generated 405 bytes in 2192 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:07:28.660961 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=12 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:07:28.661749 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=4 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:07:28.662392 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:07:28.666240 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4f99bfaa-117d-42c6-8bff-694956b4d7c7 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:07:28.666871 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-4f99bfaa-117d-42c6-8bff-694956b4d7c7 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 1bd7692e-4876-4153-8471-85bb1c8ae2ae] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:07:28.770541 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-4f99bfaa-117d-42c6-8bff-694956b4d7c7 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:07:28.778312 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4f99bfaa-117d-42c6-8bff-694956b4d7c7 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae" status: 200 len: 1087 microversion: 2.1 time: 0.119153 Oct 04 20:07:28.778982 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4158/8328] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:07:28 2022] GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae => generated 1087 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:07:29.801899 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-60dd681e-db23-42c7-b6d0-4416147c27e5 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:07:29.802526 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-60dd681e-db23-42c7-b6d0-4416147c27e5 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 1bd7692e-4876-4153-8471-85bb1c8ae2ae] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:07:29.809215 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-60dd681e-db23-42c7-b6d0-4416147c27e5 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:07:29.809708 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-60dd681e-db23-42c7-b6d0-4416147c27e5 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:07:29.810246 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-60dd681e-db23-42c7-b6d0-4416147c27e5 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:07:29.810892 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-60dd681e-db23-42c7-b6d0-4416147c27e5 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:07:29.811361 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-60dd681e-db23-42c7-b6d0-4416147c27e5 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:07:29.811795 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-60dd681e-db23-42c7-b6d0-4416147c27e5 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:07:29.879058 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-60dd681e-db23-42c7-b6d0-4416147c27e5 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:07:29.886789 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-60dd681e-db23-42c7-b6d0-4416147c27e5 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae" status: 200 len: 1137 microversion: 2.1 time: 0.089766 Oct 04 20:07:29.887350 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4171/8329] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:07:29 2022] GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae => generated 1137 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:07:30.910265 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-84b50fef-7e9d-4094-858b-4b348cb092dd tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:07:30.917037 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-84b50fef-7e9d-4094-858b-4b348cb092dd tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 1bd7692e-4876-4153-8471-85bb1c8ae2ae] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:07:30.918142 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-84b50fef-7e9d-4094-858b-4b348cb092dd tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:07:30.918644 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-84b50fef-7e9d-4094-858b-4b348cb092dd tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:07:30.919089 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-84b50fef-7e9d-4094-858b-4b348cb092dd tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:07:30.919805 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-84b50fef-7e9d-4094-858b-4b348cb092dd tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:07:30.920294 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-84b50fef-7e9d-4094-858b-4b348cb092dd tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:07:30.920761 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-84b50fef-7e9d-4094-858b-4b348cb092dd tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:07:31.020236 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-84b50fef-7e9d-4094-858b-4b348cb092dd tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:07:31.028680 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-84b50fef-7e9d-4094-858b-4b348cb092dd tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae" status: 200 len: 1203 microversion: 2.1 time: 0.122613 Oct 04 20:07:31.029363 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4159/8330] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:07:30 2022] GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae => generated 1203 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:07:32.053301 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-cea3b14d-2b53-44d3-ba19-3bfa98150b19 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:07:32.053923 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-cea3b14d-2b53-44d3-ba19-3bfa98150b19 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 1bd7692e-4876-4153-8471-85bb1c8ae2ae] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:07:32.061051 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cea3b14d-2b53-44d3-ba19-3bfa98150b19 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:07:32.061536 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cea3b14d-2b53-44d3-ba19-3bfa98150b19 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:07:32.061970 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cea3b14d-2b53-44d3-ba19-3bfa98150b19 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:07:32.062666 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cea3b14d-2b53-44d3-ba19-3bfa98150b19 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:07:32.063120 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cea3b14d-2b53-44d3-ba19-3bfa98150b19 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:07:32.063542 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cea3b14d-2b53-44d3-ba19-3bfa98150b19 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:07:32.314917 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-cea3b14d-2b53-44d3-ba19-3bfa98150b19 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:07:32.323773 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-cea3b14d-2b53-44d3-ba19-3bfa98150b19 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae" status: 200 len: 1270 microversion: 2.1 time: 0.274241 Oct 04 20:07:32.324880 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4172/8331] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:07:32 2022] GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae => generated 1270 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:07:32.611112 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-1a36edd7-e267-4d07-b656-7ed1246c240d req-28a555fa-c6d1-493d-a84a-ffe31604209e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bd7692e-4876-4153-8471-85bb1c8ae2ae", "tag": "b6eb86fa-503b-42fb-859c-9a2da799dfe5"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:07:32.622270 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-1a36edd7-e267-4d07-b656-7ed1246c240d req-28a555fa-c6d1-493d-a84a-ffe31604209e service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:07:32.623217 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-1a36edd7-e267-4d07-b656-7ed1246c240d req-28a555fa-c6d1-493d-a84a-ffe31604209e service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:07:32.623780 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-1a36edd7-e267-4d07-b656-7ed1246c240d req-28a555fa-c6d1-493d-a84a-ffe31604209e service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:07:32.638755 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-1a36edd7-e267-4d07-b656-7ed1246c240d req-28a555fa-c6d1-493d-a84a-ffe31604209e service nova] Creating event network-changed:b6eb86fa-503b-42fb-859c-9a2da799dfe5 for instance 1bd7692e-4876-4153-8471-85bb1c8ae2ae on n-h1-850501-14 Oct 04 20:07:32.644224 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-1a36edd7-e267-4d07-b656-7ed1246c240d req-28a555fa-c6d1-493d-a84a-ffe31604209e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106759 Oct 04 20:07:32.645240 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4160/8332] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 20:07:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:07:33.346182 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8251fb33-d388-46b4-b9d8-8d5f1b968559 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:07:33.346809 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8251fb33-d388-46b4-b9d8-8d5f1b968559 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 1bd7692e-4876-4153-8471-85bb1c8ae2ae] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:07:33.354252 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8251fb33-d388-46b4-b9d8-8d5f1b968559 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:07:33.354844 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8251fb33-d388-46b4-b9d8-8d5f1b968559 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:07:33.355544 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8251fb33-d388-46b4-b9d8-8d5f1b968559 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:07:33.356393 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8251fb33-d388-46b4-b9d8-8d5f1b968559 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:07:33.356861 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8251fb33-d388-46b4-b9d8-8d5f1b968559 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:07:33.357301 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8251fb33-d388-46b4-b9d8-8d5f1b968559 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:07:33.617393 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8251fb33-d388-46b4-b9d8-8d5f1b968559 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:07:33.633619 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8251fb33-d388-46b4-b9d8-8d5f1b968559 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae" status: 200 len: 1270 microversion: 2.1 time: 0.291221 Oct 04 20:07:33.648620 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4173/8333] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:07:33 2022] GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae => generated 1270 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:07:34.659412 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-c890b8f5-68be-4dd2-b673-41c5a612695f tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:07:34.660170 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-c890b8f5-68be-4dd2-b673-41c5a612695f tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 1bd7692e-4876-4153-8471-85bb1c8ae2ae] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:07:34.666438 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c890b8f5-68be-4dd2-b673-41c5a612695f tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:07:34.666937 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c890b8f5-68be-4dd2-b673-41c5a612695f tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:07:34.668404 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c890b8f5-68be-4dd2-b673-41c5a612695f tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:07:34.669157 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c890b8f5-68be-4dd2-b673-41c5a612695f tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:07:34.669631 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c890b8f5-68be-4dd2-b673-41c5a612695f tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:07:34.670075 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-c890b8f5-68be-4dd2-b673-41c5a612695f tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:07:34.819791 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-c890b8f5-68be-4dd2-b673-41c5a612695f tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:07:34.828840 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-c890b8f5-68be-4dd2-b673-41c5a612695f tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae" status: 200 len: 1270 microversion: 2.1 time: 0.174539 Oct 04 20:07:34.830628 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4161/8334] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:07:34 2022] GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae => generated 1270 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:07:35.852776 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-79085cc2-bf78-43fe-ae02-775768acbf25 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:07:35.853644 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-79085cc2-bf78-43fe-ae02-775768acbf25 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 1bd7692e-4876-4153-8471-85bb1c8ae2ae] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:07:35.861049 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-79085cc2-bf78-43fe-ae02-775768acbf25 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:07:35.861544 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-79085cc2-bf78-43fe-ae02-775768acbf25 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:07:35.861986 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-79085cc2-bf78-43fe-ae02-775768acbf25 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:07:35.862685 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-79085cc2-bf78-43fe-ae02-775768acbf25 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:07:35.863147 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-79085cc2-bf78-43fe-ae02-775768acbf25 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:07:35.863579 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-79085cc2-bf78-43fe-ae02-775768acbf25 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:07:36.000847 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-79085cc2-bf78-43fe-ae02-775768acbf25 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:07:36.008753 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-79085cc2-bf78-43fe-ae02-775768acbf25 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae" status: 200 len: 1270 microversion: 2.1 time: 0.159841 Oct 04 20:07:36.009327 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4174/8335] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:07:35 2022] GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae => generated 1270 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:07:37.032963 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e8c970f2-d78a-4122-ba67-1fbd48dcff7e tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:07:37.033519 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e8c970f2-d78a-4122-ba67-1fbd48dcff7e tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 1bd7692e-4876-4153-8471-85bb1c8ae2ae] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:07:37.040337 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e8c970f2-d78a-4122-ba67-1fbd48dcff7e tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:07:37.040865 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e8c970f2-d78a-4122-ba67-1fbd48dcff7e tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:07:37.041311 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e8c970f2-d78a-4122-ba67-1fbd48dcff7e tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:07:37.042015 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e8c970f2-d78a-4122-ba67-1fbd48dcff7e tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:07:37.042964 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e8c970f2-d78a-4122-ba67-1fbd48dcff7e tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:07:37.043413 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e8c970f2-d78a-4122-ba67-1fbd48dcff7e tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:07:37.172800 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e8c970f2-d78a-4122-ba67-1fbd48dcff7e tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:07:37.180585 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e8c970f2-d78a-4122-ba67-1fbd48dcff7e tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae" status: 200 len: 1258 microversion: 2.1 time: 0.151632 Oct 04 20:07:37.181170 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4162/8336] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:07:37 2022] GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae => generated 1258 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:07:38.204784 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0a0c45ec-ebd5-438f-9330-a6acc213fd4c tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:07:38.205409 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0a0c45ec-ebd5-438f-9330-a6acc213fd4c tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 1bd7692e-4876-4153-8471-85bb1c8ae2ae] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:07:38.208445 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:07:38.209170 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=6 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:07:38.213995 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0a0c45ec-ebd5-438f-9330-a6acc213fd4c tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:07:38.214569 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0a0c45ec-ebd5-438f-9330-a6acc213fd4c tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:07:38.215018 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0a0c45ec-ebd5-438f-9330-a6acc213fd4c tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:07:38.215722 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0a0c45ec-ebd5-438f-9330-a6acc213fd4c tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:07:38.216229 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0a0c45ec-ebd5-438f-9330-a6acc213fd4c tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:07:38.216712 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0a0c45ec-ebd5-438f-9330-a6acc213fd4c tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:07:38.363375 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0a0c45ec-ebd5-438f-9330-a6acc213fd4c tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:07:38.372744 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0a0c45ec-ebd5-438f-9330-a6acc213fd4c tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae" status: 200 len: 1258 microversion: 2.1 time: 0.171806 Oct 04 20:07:38.373375 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4175/8337] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:07:38 2022] GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae => generated 1258 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:07:39.397462 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-345436cd-befa-4283-9616-2eea3851d535 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:07:39.398097 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-345436cd-befa-4283-9616-2eea3851d535 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 1bd7692e-4876-4153-8471-85bb1c8ae2ae] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:07:39.401034 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:07:39.406094 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-345436cd-befa-4283-9616-2eea3851d535 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:07:39.406599 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-345436cd-befa-4283-9616-2eea3851d535 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:07:39.407057 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-345436cd-befa-4283-9616-2eea3851d535 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:07:39.407773 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-345436cd-befa-4283-9616-2eea3851d535 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:07:39.408272 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-345436cd-befa-4283-9616-2eea3851d535 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:07:39.408718 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-345436cd-befa-4283-9616-2eea3851d535 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:07:39.549257 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-345436cd-befa-4283-9616-2eea3851d535 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:07:39.557023 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-345436cd-befa-4283-9616-2eea3851d535 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae" status: 200 len: 1258 microversion: 2.1 time: 0.163524 Oct 04 20:07:39.557613 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4163/8338] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:07:39 2022] GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae => generated 1258 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:07:40.581439 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7daa03b1-d317-4e66-9d5c-5ba1a8b1664a tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:07:40.582065 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7daa03b1-d317-4e66-9d5c-5ba1a8b1664a tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 1bd7692e-4876-4153-8471-85bb1c8ae2ae] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:07:40.589553 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7daa03b1-d317-4e66-9d5c-5ba1a8b1664a tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:07:40.590101 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7daa03b1-d317-4e66-9d5c-5ba1a8b1664a tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:07:40.590553 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7daa03b1-d317-4e66-9d5c-5ba1a8b1664a tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:07:40.591257 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7daa03b1-d317-4e66-9d5c-5ba1a8b1664a tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:07:40.591726 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7daa03b1-d317-4e66-9d5c-5ba1a8b1664a tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:07:40.592187 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7daa03b1-d317-4e66-9d5c-5ba1a8b1664a tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:07:40.725477 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7daa03b1-d317-4e66-9d5c-5ba1a8b1664a tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:07:40.734296 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7daa03b1-d317-4e66-9d5c-5ba1a8b1664a tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae" status: 200 len: 1258 microversion: 2.1 time: 0.156782 Oct 04 20:07:40.734878 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4176/8339] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:07:40 2022] GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae => generated 1258 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:07:41.756955 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8752d70a-0104-4d28-9c53-469346d1bf39 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:07:41.757595 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8752d70a-0104-4d28-9c53-469346d1bf39 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 1bd7692e-4876-4153-8471-85bb1c8ae2ae] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:07:41.764697 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8752d70a-0104-4d28-9c53-469346d1bf39 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:07:41.765200 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8752d70a-0104-4d28-9c53-469346d1bf39 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:07:41.765687 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8752d70a-0104-4d28-9c53-469346d1bf39 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:07:41.766405 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8752d70a-0104-4d28-9c53-469346d1bf39 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:07:41.766877 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8752d70a-0104-4d28-9c53-469346d1bf39 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:07:41.767324 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8752d70a-0104-4d28-9c53-469346d1bf39 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:07:41.955027 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8752d70a-0104-4d28-9c53-469346d1bf39 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:07:41.962755 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8752d70a-0104-4d28-9c53-469346d1bf39 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae" status: 200 len: 1258 microversion: 2.1 time: 0.209846 Oct 04 20:07:41.963329 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4164/8340] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:07:41 2022] GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae => generated 1258 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:07:42.986063 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0a3f109b-3176-408b-97d3-993eec133c0c tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:07:42.986711 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0a3f109b-3176-408b-97d3-993eec133c0c tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 1bd7692e-4876-4153-8471-85bb1c8ae2ae] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:07:42.993656 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0a3f109b-3176-408b-97d3-993eec133c0c tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:07:42.994127 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0a3f109b-3176-408b-97d3-993eec133c0c tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:07:42.994563 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0a3f109b-3176-408b-97d3-993eec133c0c tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:07:42.995837 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0a3f109b-3176-408b-97d3-993eec133c0c tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:07:42.996324 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0a3f109b-3176-408b-97d3-993eec133c0c tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:07:42.996753 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0a3f109b-3176-408b-97d3-993eec133c0c tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:07:43.127868 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0a3f109b-3176-408b-97d3-993eec133c0c tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:07:43.135500 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0a3f109b-3176-408b-97d3-993eec133c0c tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae" status: 200 len: 1258 microversion: 2.1 time: 0.153375 Oct 04 20:07:43.136668 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4177/8341] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:07:42 2022] GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae => generated 1258 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:07:44.160392 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-72140950-c88a-4296-a5c0-01fd42a6f0bd tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:07:44.161080 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-72140950-c88a-4296-a5c0-01fd42a6f0bd tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 1bd7692e-4876-4153-8471-85bb1c8ae2ae] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:07:44.168482 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-72140950-c88a-4296-a5c0-01fd42a6f0bd tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:07:44.168983 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-72140950-c88a-4296-a5c0-01fd42a6f0bd tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:07:44.169429 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-72140950-c88a-4296-a5c0-01fd42a6f0bd tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:07:44.170140 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-72140950-c88a-4296-a5c0-01fd42a6f0bd tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:07:44.170607 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-72140950-c88a-4296-a5c0-01fd42a6f0bd tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:07:44.171043 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-72140950-c88a-4296-a5c0-01fd42a6f0bd tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:07:44.310338 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-72140950-c88a-4296-a5c0-01fd42a6f0bd tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:07:44.318145 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-72140950-c88a-4296-a5c0-01fd42a6f0bd tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae" status: 200 len: 1258 microversion: 2.1 time: 0.163156 Oct 04 20:07:44.318735 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4165/8342] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:07:44 2022] GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae => generated 1258 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:07:45.342275 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-71b02129-eaa0-4534-94fa-461c86b78f70 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:07:45.343030 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-71b02129-eaa0-4534-94fa-461c86b78f70 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 1bd7692e-4876-4153-8471-85bb1c8ae2ae] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:07:45.350024 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-71b02129-eaa0-4534-94fa-461c86b78f70 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:07:45.354995 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-71b02129-eaa0-4534-94fa-461c86b78f70 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:07:45.354995 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-71b02129-eaa0-4534-94fa-461c86b78f70 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:07:45.354995 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-71b02129-eaa0-4534-94fa-461c86b78f70 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:07:45.354995 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-71b02129-eaa0-4534-94fa-461c86b78f70 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:07:45.354995 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-71b02129-eaa0-4534-94fa-461c86b78f70 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:07:45.484736 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-71b02129-eaa0-4534-94fa-461c86b78f70 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:07:45.492677 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-71b02129-eaa0-4534-94fa-461c86b78f70 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae" status: 200 len: 1258 microversion: 2.1 time: 0.154455 Oct 04 20:07:45.493254 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4178/8343] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:07:45 2022] GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae => generated 1258 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:07:45.891910 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-31a000ec-7088-495e-8e39-b0e4845876fa req-748ad09b-2a83-41b7-b844-ba90e60eadea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bd7692e-4876-4153-8471-85bb1c8ae2ae", "name": "network-vif-plugged", "status": "completed", "tag": "b6eb86fa-503b-42fb-859c-9a2da799dfe5"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:07:45.903025 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-31a000ec-7088-495e-8e39-b0e4845876fa req-748ad09b-2a83-41b7-b844-ba90e60eadea service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:07:45.903526 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-31a000ec-7088-495e-8e39-b0e4845876fa req-748ad09b-2a83-41b7-b844-ba90e60eadea service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:07:45.903979 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-31a000ec-7088-495e-8e39-b0e4845876fa req-748ad09b-2a83-41b7-b844-ba90e60eadea service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:07:45.915283 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-31a000ec-7088-495e-8e39-b0e4845876fa req-748ad09b-2a83-41b7-b844-ba90e60eadea service nova] Creating event network-vif-plugged:b6eb86fa-503b-42fb-859c-9a2da799dfe5 for instance 1bd7692e-4876-4153-8471-85bb1c8ae2ae on n-h1-850501-14 Oct 04 20:07:45.921329 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-31a000ec-7088-495e-8e39-b0e4845876fa req-748ad09b-2a83-41b7-b844-ba90e60eadea service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033209 Oct 04 20:07:45.925911 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4166/8344] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 20:07:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:07:46.516796 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d04420a1-47ae-4783-a79a-d945755a28b6 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:07:46.517432 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d04420a1-47ae-4783-a79a-d945755a28b6 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 1bd7692e-4876-4153-8471-85bb1c8ae2ae] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:07:46.524200 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d04420a1-47ae-4783-a79a-d945755a28b6 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:07:46.524691 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d04420a1-47ae-4783-a79a-d945755a28b6 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:07:46.525134 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d04420a1-47ae-4783-a79a-d945755a28b6 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:07:46.525836 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d04420a1-47ae-4783-a79a-d945755a28b6 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:07:46.526878 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d04420a1-47ae-4783-a79a-d945755a28b6 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:07:46.527280 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d04420a1-47ae-4783-a79a-d945755a28b6 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:07:46.659330 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d04420a1-47ae-4783-a79a-d945755a28b6 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:07:46.667123 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d04420a1-47ae-4783-a79a-d945755a28b6 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae" status: 200 len: 1258 microversion: 2.1 time: 0.154228 Oct 04 20:07:46.667809 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4179/8345] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:07:46 2022] GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae => generated 1258 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:07:47.691190 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-5dc46324-3f51-4e7e-a29f-295d0fbff1ee tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:07:47.691900 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-5dc46324-3f51-4e7e-a29f-295d0fbff1ee tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 1bd7692e-4876-4153-8471-85bb1c8ae2ae] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:07:47.699890 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5dc46324-3f51-4e7e-a29f-295d0fbff1ee tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:07:47.700661 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5dc46324-3f51-4e7e-a29f-295d0fbff1ee tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:07:47.701116 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5dc46324-3f51-4e7e-a29f-295d0fbff1ee tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:07:47.701815 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5dc46324-3f51-4e7e-a29f-295d0fbff1ee tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:07:47.702281 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5dc46324-3f51-4e7e-a29f-295d0fbff1ee tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:07:47.702718 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-5dc46324-3f51-4e7e-a29f-295d0fbff1ee tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:07:47.834434 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-5dc46324-3f51-4e7e-a29f-295d0fbff1ee tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:07:47.842999 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-5dc46324-3f51-4e7e-a29f-295d0fbff1ee tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae" status: 200 len: 1441 microversion: 2.1 time: 0.156088 Oct 04 20:07:47.843578 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4167/8346] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:07:47 2022] GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae => generated 1441 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:07:47.865441 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9dcfb3db-5113-4aba-9aa2-71aa78c4a151 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:07:47.866064 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-9dcfb3db-5113-4aba-9aa2-71aa78c4a151 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 1bd7692e-4876-4153-8471-85bb1c8ae2ae] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:07:47.872934 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9dcfb3db-5113-4aba-9aa2-71aa78c4a151 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:07:47.873430 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9dcfb3db-5113-4aba-9aa2-71aa78c4a151 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:07:47.873878 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9dcfb3db-5113-4aba-9aa2-71aa78c4a151 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:07:47.874579 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9dcfb3db-5113-4aba-9aa2-71aa78c4a151 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:07:47.875042 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9dcfb3db-5113-4aba-9aa2-71aa78c4a151 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:07:47.875477 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9dcfb3db-5113-4aba-9aa2-71aa78c4a151 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:07:48.007811 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9dcfb3db-5113-4aba-9aa2-71aa78c4a151 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:07:48.019185 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9dcfb3db-5113-4aba-9aa2-71aa78c4a151 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae" status: 200 len: 1441 microversion: 2.1 time: 0.157585 Oct 04 20:07:48.019771 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4180/8347] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:07:47 2022] GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae => generated 1441 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:07:50.171226 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-d56e9e41-f9a9-493c-af32-e2bf13b62913 req-c0909ba0-ddbe-45de-a5ea-6ce833091faa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bd7692e-4876-4153-8471-85bb1c8ae2ae", "tag": "b6eb86fa-503b-42fb-859c-9a2da799dfe5"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:07:50.181012 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-d56e9e41-f9a9-493c-af32-e2bf13b62913 req-c0909ba0-ddbe-45de-a5ea-6ce833091faa service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:07:50.181589 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-d56e9e41-f9a9-493c-af32-e2bf13b62913 req-c0909ba0-ddbe-45de-a5ea-6ce833091faa service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:07:50.182114 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-d56e9e41-f9a9-493c-af32-e2bf13b62913 req-c0909ba0-ddbe-45de-a5ea-6ce833091faa service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:07:50.193814 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-d56e9e41-f9a9-493c-af32-e2bf13b62913 req-c0909ba0-ddbe-45de-a5ea-6ce833091faa service nova] Creating event network-changed:b6eb86fa-503b-42fb-859c-9a2da799dfe5 for instance 1bd7692e-4876-4153-8471-85bb1c8ae2ae on n-h1-850501-14 Oct 04 20:07:50.207323 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-d56e9e41-f9a9-493c-af32-e2bf13b62913 req-c0909ba0-ddbe-45de-a5ea-6ce833091faa service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040724 Oct 04 20:07:50.208011 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4168/8348] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 20:07:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:10:26.160259 n-d-850501-14 devstack@n-api.service[123001]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c9febe7b-97ce-4695-9d92-17a0f76701f3] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 20:10:26.161129 n-d-850501-14 devstack@n-api.service[123001]: ERROR oslo.messaging._drivers.impl_rabbit [-] [642656d8-a7cd-470f-ae32-a85e45bb523d] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 20:10:26.161714 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:10:26.162482 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=62 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:10:26.163455 n-d-850501-14 devstack@n-api.service[123001]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 20:10:26.163588 n-d-850501-14 devstack@n-api.service[123001]: Tue Oct 4 20:10:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae/action (ip 10.222.0.20) !!! Oct 04 20:10:26.164828 n-d-850501-14 devstack@n-api.service[123001]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 20:10:26.167231 n-d-850501-14 devstack@n-api.service[123001]: Tue Oct 4 20:10:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae/action (ip 10.222.0.20) !!! Oct 04 20:10:26.170273 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ad9d096b-c88d-4c38-a0df-8feeb9d96b99 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:10:26.170828 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ad9d096b-c88d-4c38-a0df-8feeb9d96b99 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 1bd7692e-4876-4153-8471-85bb1c8ae2ae] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:10:26.179112 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ad9d096b-c88d-4c38-a0df-8feeb9d96b99 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:10:26.179608 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ad9d096b-c88d-4c38-a0df-8feeb9d96b99 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:10:26.180094 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ad9d096b-c88d-4c38-a0df-8feeb9d96b99 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:10:26.180815 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ad9d096b-c88d-4c38-a0df-8feeb9d96b99 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:10:26.181283 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ad9d096b-c88d-4c38-a0df-8feeb9d96b99 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:10:26.181719 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ad9d096b-c88d-4c38-a0df-8feeb9d96b99 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:10:26.211473 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.objects.instance [None req-ad9d096b-c88d-4c38-a0df-8feeb9d96b99 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lazy-loading 'flavor' on Instance uuid 1bd7692e-4876-4153-8471-85bb1c8ae2ae {{(pid=123001) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:10:26.593687 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ad9d096b-c88d-4c38-a0df-8feeb9d96b99 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "POST /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae/action" status: 202 len: 0 microversion: 2.1 time: 0.434906 Oct 04 20:10:26.594599 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4181/8349] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 20:10:26 2022] POST /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae/action => generated 0 bytes in 437 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:10:26.601895 n-d-850501-14 devstack@n-api.service[123002]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9c4ba655-a850-4726-8db9-cffc7e0e245e] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 20:10:26.602938 n-d-850501-14 devstack@n-api.service[123002]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d2b44dc8-447f-4d0a-9186-943d7552c0ea] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 20:10:26.603886 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=24 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:10:26.604963 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=48 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:10:26.605753 n-d-850501-14 devstack@n-api.service[123002]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 20:10:26.605931 n-d-850501-14 devstack@n-api.service[123002]: Tue Oct 4 20:10:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae (ip 10.222.0.20) !!! Oct 04 20:10:26.607977 n-d-850501-14 devstack@n-api.service[123002]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 20:10:26.608894 n-d-850501-14 devstack@n-api.service[123002]: Tue Oct 4 20:10:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae (ip 10.222.0.20) !!! Oct 04 20:10:26.610723 n-d-850501-14 devstack@n-api.service[123002]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 20:10:26.610866 n-d-850501-14 devstack@n-api.service[123002]: Tue Oct 4 20:10:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae (ip 10.222.0.20) !!! Oct 04 20:10:26.619212 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e5498be9-24f2-4039-bf26-ba11f3bee5f7 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:10:26.619922 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e5498be9-24f2-4039-bf26-ba11f3bee5f7 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 1bd7692e-4876-4153-8471-85bb1c8ae2ae] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:10:26.630062 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e5498be9-24f2-4039-bf26-ba11f3bee5f7 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:10:26.630558 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e5498be9-24f2-4039-bf26-ba11f3bee5f7 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:10:26.631002 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e5498be9-24f2-4039-bf26-ba11f3bee5f7 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:10:26.631780 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e5498be9-24f2-4039-bf26-ba11f3bee5f7 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:10:26.632188 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e5498be9-24f2-4039-bf26-ba11f3bee5f7 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:10:26.632627 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e5498be9-24f2-4039-bf26-ba11f3bee5f7 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:10:26.768202 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e5498be9-24f2-4039-bf26-ba11f3bee5f7 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:10:26.777095 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e5498be9-24f2-4039-bf26-ba11f3bee5f7 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae" status: 200 len: 1566 microversion: 2.1 time: 0.177317 Oct 04 20:10:26.777671 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4169/8350] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:10:26 2022] GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae => generated 1566 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:10:27.803739 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a9de951a-4628-45f8-a926-39a7868435a7 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:10:27.804399 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a9de951a-4628-45f8-a926-39a7868435a7 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 1bd7692e-4876-4153-8471-85bb1c8ae2ae] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:10:27.812513 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a9de951a-4628-45f8-a926-39a7868435a7 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:10:27.819420 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a9de951a-4628-45f8-a926-39a7868435a7 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:10:27.819420 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a9de951a-4628-45f8-a926-39a7868435a7 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:10:27.819420 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a9de951a-4628-45f8-a926-39a7868435a7 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:10:27.819420 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a9de951a-4628-45f8-a926-39a7868435a7 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:10:27.819420 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a9de951a-4628-45f8-a926-39a7868435a7 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:10:27.822060 n-d-850501-14 devstack@n-api.service[123001]: INFO oslo.messaging._drivers.impl_rabbit [-] [c9febe7b-97ce-4695-9d92-17a0f76701f3] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 55178. Oct 04 20:10:27.822856 n-d-850501-14 devstack@n-api.service[123001]: INFO oslo.messaging._drivers.impl_rabbit [-] [642656d8-a7cd-470f-ae32-a85e45bb523d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 55180. Oct 04 20:10:27.954446 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a9de951a-4628-45f8-a926-39a7868435a7 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:10:27.962827 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a9de951a-4628-45f8-a926-39a7868435a7 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae" status: 200 len: 1566 microversion: 2.1 time: 0.165668 Oct 04 20:10:27.963410 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4182/8351] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:10:27 2022] GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae => generated 1566 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:10:28.989724 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b0bd5483-ec1d-4964-b7bc-9020dacd030d tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:10:28.990272 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b0bd5483-ec1d-4964-b7bc-9020dacd030d tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 1bd7692e-4876-4153-8471-85bb1c8ae2ae] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:10:29.001971 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b0bd5483-ec1d-4964-b7bc-9020dacd030d tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:10:29.002497 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b0bd5483-ec1d-4964-b7bc-9020dacd030d tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:10:29.002942 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b0bd5483-ec1d-4964-b7bc-9020dacd030d tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:10:29.004243 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b0bd5483-ec1d-4964-b7bc-9020dacd030d tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:10:29.004744 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b0bd5483-ec1d-4964-b7bc-9020dacd030d tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:10:29.005183 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b0bd5483-ec1d-4964-b7bc-9020dacd030d tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:10:29.011594 n-d-850501-14 devstack@n-api.service[123002]: INFO oslo.messaging._drivers.impl_rabbit [-] [9c4ba655-a850-4726-8db9-cffc7e0e245e] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 55184. Oct 04 20:10:29.022618 n-d-850501-14 devstack@n-api.service[123002]: INFO oslo.messaging._drivers.impl_rabbit [-] [d2b44dc8-447f-4d0a-9186-943d7552c0ea] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 55186. Oct 04 20:10:29.145360 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b0bd5483-ec1d-4964-b7bc-9020dacd030d tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:10:29.153640 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b0bd5483-ec1d-4964-b7bc-9020dacd030d tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae" status: 200 len: 1566 microversion: 2.1 time: 0.168808 Oct 04 20:10:29.154267 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4170/8352] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:10:28 2022] GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae => generated 1566 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:10:30.177847 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c9682866-9c91-4b28-ac9b-0f02d2059bfd tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:10:30.178485 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c9682866-9c91-4b28-ac9b-0f02d2059bfd tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 1bd7692e-4876-4153-8471-85bb1c8ae2ae] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:10:30.185448 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c9682866-9c91-4b28-ac9b-0f02d2059bfd tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:10:30.186137 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c9682866-9c91-4b28-ac9b-0f02d2059bfd tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:10:30.186574 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c9682866-9c91-4b28-ac9b-0f02d2059bfd tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:10:30.187270 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c9682866-9c91-4b28-ac9b-0f02d2059bfd tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:10:30.187726 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c9682866-9c91-4b28-ac9b-0f02d2059bfd tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:10:30.188176 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c9682866-9c91-4b28-ac9b-0f02d2059bfd tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:10:30.325375 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c9682866-9c91-4b28-ac9b-0f02d2059bfd tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:10:30.333260 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c9682866-9c91-4b28-ac9b-0f02d2059bfd tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae" status: 200 len: 1566 microversion: 2.1 time: 0.160285 Oct 04 20:10:30.333828 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4183/8353] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:10:30 2022] GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:10:31.356790 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-a0fd9db0-3dc8-4c0d-b25b-ab8eb8ffc003 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:10:31.357426 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-a0fd9db0-3dc8-4c0d-b25b-ab8eb8ffc003 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 1bd7692e-4876-4153-8471-85bb1c8ae2ae] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:10:31.365295 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a0fd9db0-3dc8-4c0d-b25b-ab8eb8ffc003 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:10:31.365795 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a0fd9db0-3dc8-4c0d-b25b-ab8eb8ffc003 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:10:31.366252 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a0fd9db0-3dc8-4c0d-b25b-ab8eb8ffc003 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:10:31.366961 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a0fd9db0-3dc8-4c0d-b25b-ab8eb8ffc003 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:10:31.367437 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a0fd9db0-3dc8-4c0d-b25b-ab8eb8ffc003 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:10:31.367907 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-a0fd9db0-3dc8-4c0d-b25b-ab8eb8ffc003 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:10:31.501407 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-a0fd9db0-3dc8-4c0d-b25b-ab8eb8ffc003 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:10:31.509351 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-a0fd9db0-3dc8-4c0d-b25b-ab8eb8ffc003 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae" status: 200 len: 1566 microversion: 2.1 time: 0.156860 Oct 04 20:10:31.509937 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4171/8354] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:10:31 2022] GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:10:32.532984 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9a3a0caf-030b-4a3d-af4f-85cdcc6251b3 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:10:32.533588 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-9a3a0caf-030b-4a3d-af4f-85cdcc6251b3 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 1bd7692e-4876-4153-8471-85bb1c8ae2ae] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:10:32.541153 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9a3a0caf-030b-4a3d-af4f-85cdcc6251b3 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:10:32.541631 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9a3a0caf-030b-4a3d-af4f-85cdcc6251b3 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:10:32.542064 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9a3a0caf-030b-4a3d-af4f-85cdcc6251b3 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:10:32.542751 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9a3a0caf-030b-4a3d-af4f-85cdcc6251b3 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:10:32.543204 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9a3a0caf-030b-4a3d-af4f-85cdcc6251b3 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:10:32.543628 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9a3a0caf-030b-4a3d-af4f-85cdcc6251b3 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:10:32.681448 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9a3a0caf-030b-4a3d-af4f-85cdcc6251b3 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:10:32.689305 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9a3a0caf-030b-4a3d-af4f-85cdcc6251b3 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae" status: 200 len: 1566 microversion: 2.1 time: 0.160203 Oct 04 20:10:32.689891 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4184/8355] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:10:32 2022] GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:10:33.713026 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-efe64cc0-f440-4b77-8c75-17503d7db425 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:10:33.713646 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-efe64cc0-f440-4b77-8c75-17503d7db425 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 1bd7692e-4876-4153-8471-85bb1c8ae2ae] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:10:33.721050 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-efe64cc0-f440-4b77-8c75-17503d7db425 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:10:33.721243 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-efe64cc0-f440-4b77-8c75-17503d7db425 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:10:33.721693 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-efe64cc0-f440-4b77-8c75-17503d7db425 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:10:33.723041 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-efe64cc0-f440-4b77-8c75-17503d7db425 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:10:33.723573 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-efe64cc0-f440-4b77-8c75-17503d7db425 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:10:33.724014 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-efe64cc0-f440-4b77-8c75-17503d7db425 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:10:33.858632 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-efe64cc0-f440-4b77-8c75-17503d7db425 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:10:33.867434 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-efe64cc0-f440-4b77-8c75-17503d7db425 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae" status: 200 len: 1566 microversion: 2.1 time: 0.158432 Oct 04 20:10:33.868013 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4172/8356] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:10:33 2022] GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:10:34.890959 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ad7a7ee8-6a8a-4fbd-b162-3854bd53fad7 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:10:34.891583 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ad7a7ee8-6a8a-4fbd-b162-3854bd53fad7 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 1bd7692e-4876-4153-8471-85bb1c8ae2ae] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:10:34.898682 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ad7a7ee8-6a8a-4fbd-b162-3854bd53fad7 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:10:34.899175 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ad7a7ee8-6a8a-4fbd-b162-3854bd53fad7 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:10:34.899618 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ad7a7ee8-6a8a-4fbd-b162-3854bd53fad7 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:10:34.900342 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ad7a7ee8-6a8a-4fbd-b162-3854bd53fad7 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:10:34.900809 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ad7a7ee8-6a8a-4fbd-b162-3854bd53fad7 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:10:34.901245 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ad7a7ee8-6a8a-4fbd-b162-3854bd53fad7 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:10:35.035768 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ad7a7ee8-6a8a-4fbd-b162-3854bd53fad7 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:10:35.043679 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ad7a7ee8-6a8a-4fbd-b162-3854bd53fad7 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae" status: 200 len: 1566 microversion: 2.1 time: 0.156717 Oct 04 20:10:35.044807 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4185/8357] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:10:34 2022] GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:10:36.067669 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-213f2135-41ed-40fd-9f96-1e55807053fd tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:10:36.068331 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-213f2135-41ed-40fd-9f96-1e55807053fd tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 1bd7692e-4876-4153-8471-85bb1c8ae2ae] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:10:36.075278 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-213f2135-41ed-40fd-9f96-1e55807053fd tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:10:36.075790 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-213f2135-41ed-40fd-9f96-1e55807053fd tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:10:36.076279 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-213f2135-41ed-40fd-9f96-1e55807053fd tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:10:36.076993 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-213f2135-41ed-40fd-9f96-1e55807053fd tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:10:36.077464 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-213f2135-41ed-40fd-9f96-1e55807053fd tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:10:36.077909 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-213f2135-41ed-40fd-9f96-1e55807053fd tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:10:36.210656 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-213f2135-41ed-40fd-9f96-1e55807053fd tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:10:36.218449 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-213f2135-41ed-40fd-9f96-1e55807053fd tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae" status: 200 len: 1566 microversion: 2.1 time: 0.154755 Oct 04 20:10:36.219019 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4173/8358] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:10:36 2022] GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:10:37.243508 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-c0c2d067-526e-4161-9749-7cf5ac74843b tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:10:37.244164 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-c0c2d067-526e-4161-9749-7cf5ac74843b tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 1bd7692e-4876-4153-8471-85bb1c8ae2ae] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:10:37.251047 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c0c2d067-526e-4161-9749-7cf5ac74843b tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:10:37.251538 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c0c2d067-526e-4161-9749-7cf5ac74843b tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:10:37.251981 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c0c2d067-526e-4161-9749-7cf5ac74843b tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:10:37.252708 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c0c2d067-526e-4161-9749-7cf5ac74843b tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:10:37.253173 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c0c2d067-526e-4161-9749-7cf5ac74843b tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:10:37.254301 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-c0c2d067-526e-4161-9749-7cf5ac74843b tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:10:37.457843 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-c0c2d067-526e-4161-9749-7cf5ac74843b tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:10:37.465667 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-c0c2d067-526e-4161-9749-7cf5ac74843b tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae" status: 200 len: 1566 microversion: 2.1 time: 0.226015 Oct 04 20:10:37.466182 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4186/8359] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:10:37 2022] GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae => generated 1566 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:10:38.491845 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-01006e84-db9f-4f95-b09e-2e4998555d32 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:10:38.492620 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-01006e84-db9f-4f95-b09e-2e4998555d32 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 1bd7692e-4876-4153-8471-85bb1c8ae2ae] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:10:38.499471 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-01006e84-db9f-4f95-b09e-2e4998555d32 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:10:38.499970 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-01006e84-db9f-4f95-b09e-2e4998555d32 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:10:38.500461 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-01006e84-db9f-4f95-b09e-2e4998555d32 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:10:38.501167 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-01006e84-db9f-4f95-b09e-2e4998555d32 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:10:38.501638 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-01006e84-db9f-4f95-b09e-2e4998555d32 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:10:38.502079 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-01006e84-db9f-4f95-b09e-2e4998555d32 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:10:38.639137 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-01006e84-db9f-4f95-b09e-2e4998555d32 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:10:38.647594 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-01006e84-db9f-4f95-b09e-2e4998555d32 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae" status: 200 len: 1566 microversion: 2.1 time: 0.160946 Oct 04 20:10:38.648198 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4174/8360] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:10:38 2022] GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:10:39.670904 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-cf933824-39ab-4f55-9790-a22de9c712e4 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:10:39.671520 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-cf933824-39ab-4f55-9790-a22de9c712e4 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 1bd7692e-4876-4153-8471-85bb1c8ae2ae] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:10:39.678953 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cf933824-39ab-4f55-9790-a22de9c712e4 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:10:39.679447 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cf933824-39ab-4f55-9790-a22de9c712e4 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:10:39.679886 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cf933824-39ab-4f55-9790-a22de9c712e4 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:10:39.680633 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cf933824-39ab-4f55-9790-a22de9c712e4 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:10:39.681113 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cf933824-39ab-4f55-9790-a22de9c712e4 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:10:39.681540 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-cf933824-39ab-4f55-9790-a22de9c712e4 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:10:39.818325 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-cf933824-39ab-4f55-9790-a22de9c712e4 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:10:39.826242 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-cf933824-39ab-4f55-9790-a22de9c712e4 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae" status: 200 len: 1566 microversion: 2.1 time: 0.159271 Oct 04 20:10:39.831063 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4187/8361] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:10:39 2022] GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:10:40.850967 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b8b3fc50-64d8-4da0-b3d2-7d79189e65b2 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:10:40.851608 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b8b3fc50-64d8-4da0-b3d2-7d79189e65b2 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 1bd7692e-4876-4153-8471-85bb1c8ae2ae] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:10:40.858871 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b8b3fc50-64d8-4da0-b3d2-7d79189e65b2 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:10:40.859599 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b8b3fc50-64d8-4da0-b3d2-7d79189e65b2 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:10:40.860137 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b8b3fc50-64d8-4da0-b3d2-7d79189e65b2 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:10:40.860816 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b8b3fc50-64d8-4da0-b3d2-7d79189e65b2 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:10:40.861286 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b8b3fc50-64d8-4da0-b3d2-7d79189e65b2 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:10:40.861730 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b8b3fc50-64d8-4da0-b3d2-7d79189e65b2 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:10:40.997692 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b8b3fc50-64d8-4da0-b3d2-7d79189e65b2 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:10:41.006528 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b8b3fc50-64d8-4da0-b3d2-7d79189e65b2 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae" status: 200 len: 1566 microversion: 2.1 time: 0.160368 Oct 04 20:10:41.010178 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4175/8362] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:10:40 2022] GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:10:42.031190 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5595e261-a364-4317-bd5d-66639bdbfbae tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:10:42.031750 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5595e261-a364-4317-bd5d-66639bdbfbae tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 1bd7692e-4876-4153-8471-85bb1c8ae2ae] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:10:42.038592 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5595e261-a364-4317-bd5d-66639bdbfbae tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:10:42.039140 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5595e261-a364-4317-bd5d-66639bdbfbae tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:10:42.039593 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5595e261-a364-4317-bd5d-66639bdbfbae tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:10:42.040322 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5595e261-a364-4317-bd5d-66639bdbfbae tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:10:42.040827 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5595e261-a364-4317-bd5d-66639bdbfbae tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:10:42.041278 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5595e261-a364-4317-bd5d-66639bdbfbae tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:10:42.173437 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5595e261-a364-4317-bd5d-66639bdbfbae tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:10:42.181870 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5595e261-a364-4317-bd5d-66639bdbfbae tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae" status: 200 len: 1567 microversion: 2.1 time: 0.154830 Oct 04 20:10:42.182443 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4188/8363] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:10:42 2022] GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:10:42.205125 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-cc782192-02a3-442d-abcd-eeddc6d2f9db tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:10:42.205747 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-cc782192-02a3-442d-abcd-eeddc6d2f9db tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 1bd7692e-4876-4153-8471-85bb1c8ae2ae] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:10:42.212557 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cc782192-02a3-442d-abcd-eeddc6d2f9db tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:10:42.213060 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cc782192-02a3-442d-abcd-eeddc6d2f9db tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:10:42.213511 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cc782192-02a3-442d-abcd-eeddc6d2f9db tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:10:42.214223 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cc782192-02a3-442d-abcd-eeddc6d2f9db tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:10:42.214693 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cc782192-02a3-442d-abcd-eeddc6d2f9db tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:10:42.215139 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-cc782192-02a3-442d-abcd-eeddc6d2f9db tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:10:42.309005 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-cc782192-02a3-442d-abcd-eeddc6d2f9db tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 1bd7692e-4876-4153-8471-85bb1c8ae2ae] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=123002) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 20:10:42.495447 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-dcf6671f-e40e-4857-a0ca-fef5dc259643 req-94fe12e1-9852-4bde-a31f-c0c099b6846e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bd7692e-4876-4153-8471-85bb1c8ae2ae", "name": "network-vif-unplugged", "status": "completed", "tag": "b6eb86fa-503b-42fb-859c-9a2da799dfe5"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:10:42.505817 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-dcf6671f-e40e-4857-a0ca-fef5dc259643 req-94fe12e1-9852-4bde-a31f-c0c099b6846e service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:10:42.515387 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-dcf6671f-e40e-4857-a0ca-fef5dc259643 req-94fe12e1-9852-4bde-a31f-c0c099b6846e service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:10:42.515387 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-dcf6671f-e40e-4857-a0ca-fef5dc259643 req-94fe12e1-9852-4bde-a31f-c0c099b6846e service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:10:42.518007 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.compute.server_external_events [req-dcf6671f-e40e-4857-a0ca-fef5dc259643 req-94fe12e1-9852-4bde-a31f-c0c099b6846e service nova] Unable to find a host for instance 1bd7692e-4876-4153-8471-85bb1c8ae2ae. Dropping event network-vif-unplugged {{(pid=123001) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 04 20:10:42.518886 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-dcf6671f-e40e-4857-a0ca-fef5dc259643 req-94fe12e1-9852-4bde-a31f-c0c099b6846e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.077765 Oct 04 20:10:42.520190 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4189/8364] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 20:10:42 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 80 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 04 20:10:42.662147 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-cc782192-02a3-442d-abcd-eeddc6d2f9db tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "POST /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae/action" status: 202 len: 0 microversion: 2.1 time: 0.460889 Oct 04 20:10:42.665923 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4176/8365] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 20:10:42 2022] POST /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae/action => generated 0 bytes in 465 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:10:42.671353 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a8a6621c-b83f-470a-aac3-a6f107f58e5a tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:10:42.671977 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a8a6621c-b83f-470a-aac3-a6f107f58e5a tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 1bd7692e-4876-4153-8471-85bb1c8ae2ae] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:10:42.679274 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a8a6621c-b83f-470a-aac3-a6f107f58e5a tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:10:42.679768 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a8a6621c-b83f-470a-aac3-a6f107f58e5a tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:10:42.680239 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a8a6621c-b83f-470a-aac3-a6f107f58e5a tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:10:42.680943 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a8a6621c-b83f-470a-aac3-a6f107f58e5a tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:10:42.681402 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a8a6621c-b83f-470a-aac3-a6f107f58e5a tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:10:42.681834 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-a8a6621c-b83f-470a-aac3-a6f107f58e5a tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:10:42.818270 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a8a6621c-b83f-470a-aac3-a6f107f58e5a tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:10:42.826227 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a8a6621c-b83f-470a-aac3-a6f107f58e5a tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae" status: 200 len: 1515 microversion: 2.1 time: 0.158742 Oct 04 20:10:42.836553 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4190/8366] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:10:42 2022] GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:10:43.851242 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9f626022-2ff4-49b5-84b9-a7d2de8ea822 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:10:43.851878 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9f626022-2ff4-49b5-84b9-a7d2de8ea822 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 1bd7692e-4876-4153-8471-85bb1c8ae2ae] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:10:43.858313 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9f626022-2ff4-49b5-84b9-a7d2de8ea822 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:10:43.858812 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9f626022-2ff4-49b5-84b9-a7d2de8ea822 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:10:43.859257 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9f626022-2ff4-49b5-84b9-a7d2de8ea822 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:10:43.859964 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9f626022-2ff4-49b5-84b9-a7d2de8ea822 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:10:43.860452 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9f626022-2ff4-49b5-84b9-a7d2de8ea822 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:10:43.860893 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9f626022-2ff4-49b5-84b9-a7d2de8ea822 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:10:43.991392 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9f626022-2ff4-49b5-84b9-a7d2de8ea822 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:10:43.999254 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9f626022-2ff4-49b5-84b9-a7d2de8ea822 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae" status: 200 len: 1515 microversion: 2.1 time: 0.153563 Oct 04 20:10:43.999830 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4177/8367] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:10:43 2022] GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:10:45.024162 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-75463621-7f21-4737-9b28-1dc6a71361b2 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:10:45.024871 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-75463621-7f21-4737-9b28-1dc6a71361b2 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 1bd7692e-4876-4153-8471-85bb1c8ae2ae] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:10:45.031867 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-75463621-7f21-4737-9b28-1dc6a71361b2 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:10:45.032392 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-75463621-7f21-4737-9b28-1dc6a71361b2 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:10:45.032848 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-75463621-7f21-4737-9b28-1dc6a71361b2 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:10:45.033546 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-75463621-7f21-4737-9b28-1dc6a71361b2 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:10:45.034008 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-75463621-7f21-4737-9b28-1dc6a71361b2 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:10:45.034445 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-75463621-7f21-4737-9b28-1dc6a71361b2 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:10:45.174399 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-75463621-7f21-4737-9b28-1dc6a71361b2 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:10:45.182598 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-75463621-7f21-4737-9b28-1dc6a71361b2 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae" status: 200 len: 1517 microversion: 2.1 time: 0.163570 Oct 04 20:10:45.183176 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4191/8368] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:10:45 2022] GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae => generated 1517 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:10:46.205751 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-ae5736bf-38cd-4e13-8f7a-b570f47af7b9 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:10:46.207447 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-ae5736bf-38cd-4e13-8f7a-b570f47af7b9 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 1bd7692e-4876-4153-8471-85bb1c8ae2ae] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:10:46.214669 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ae5736bf-38cd-4e13-8f7a-b570f47af7b9 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:10:46.215173 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ae5736bf-38cd-4e13-8f7a-b570f47af7b9 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:10:46.215627 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ae5736bf-38cd-4e13-8f7a-b570f47af7b9 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:10:46.216370 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ae5736bf-38cd-4e13-8f7a-b570f47af7b9 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:10:46.216845 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ae5736bf-38cd-4e13-8f7a-b570f47af7b9 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:10:46.217287 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-ae5736bf-38cd-4e13-8f7a-b570f47af7b9 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:10:46.353523 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-ae5736bf-38cd-4e13-8f7a-b570f47af7b9 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:10:46.361921 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-ae5736bf-38cd-4e13-8f7a-b570f47af7b9 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae" status: 200 len: 1517 microversion: 2.1 time: 0.160137 Oct 04 20:10:46.362507 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4178/8369] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:10:46 2022] GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae => generated 1517 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:10:47.385945 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-adc6ca12-94fe-4f53-a7da-a801554bee37 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:10:47.386566 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-adc6ca12-94fe-4f53-a7da-a801554bee37 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 1bd7692e-4876-4153-8471-85bb1c8ae2ae] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:10:47.393812 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-adc6ca12-94fe-4f53-a7da-a801554bee37 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:10:47.395049 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-adc6ca12-94fe-4f53-a7da-a801554bee37 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:10:47.395487 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-adc6ca12-94fe-4f53-a7da-a801554bee37 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:10:47.396211 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-adc6ca12-94fe-4f53-a7da-a801554bee37 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:10:47.396672 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-adc6ca12-94fe-4f53-a7da-a801554bee37 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:10:47.397096 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-adc6ca12-94fe-4f53-a7da-a801554bee37 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:10:47.529533 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-adc6ca12-94fe-4f53-a7da-a801554bee37 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:10:47.538115 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-adc6ca12-94fe-4f53-a7da-a801554bee37 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae" status: 200 len: 1517 microversion: 2.1 time: 0.156052 Oct 04 20:10:47.552081 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4192/8370] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:10:47 2022] GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:10:48.563154 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f198122c-fadb-4269-8d0d-f0020b397e51 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:10:48.563775 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f198122c-fadb-4269-8d0d-f0020b397e51 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 1bd7692e-4876-4153-8471-85bb1c8ae2ae] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:10:48.571089 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f198122c-fadb-4269-8d0d-f0020b397e51 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:10:48.571593 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f198122c-fadb-4269-8d0d-f0020b397e51 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:10:48.572044 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f198122c-fadb-4269-8d0d-f0020b397e51 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:10:48.572775 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f198122c-fadb-4269-8d0d-f0020b397e51 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:10:48.573246 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f198122c-fadb-4269-8d0d-f0020b397e51 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:10:48.573691 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f198122c-fadb-4269-8d0d-f0020b397e51 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:10:48.713714 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f198122c-fadb-4269-8d0d-f0020b397e51 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:10:48.723021 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f198122c-fadb-4269-8d0d-f0020b397e51 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae" status: 200 len: 1517 microversion: 2.1 time: 0.163475 Oct 04 20:10:48.723775 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4179/8371] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:10:48 2022] GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae => generated 1517 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:10:49.747733 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-d1992e6e-6c29-4329-828a-7e5586f2cee1 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:10:49.748264 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-d1992e6e-6c29-4329-828a-7e5586f2cee1 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 1bd7692e-4876-4153-8471-85bb1c8ae2ae] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:10:49.755623 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d1992e6e-6c29-4329-828a-7e5586f2cee1 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:10:49.756140 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d1992e6e-6c29-4329-828a-7e5586f2cee1 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:10:49.756585 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d1992e6e-6c29-4329-828a-7e5586f2cee1 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:10:49.757286 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d1992e6e-6c29-4329-828a-7e5586f2cee1 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:10:49.757744 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d1992e6e-6c29-4329-828a-7e5586f2cee1 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:10:49.758170 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-d1992e6e-6c29-4329-828a-7e5586f2cee1 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:10:49.887908 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-d1992e6e-6c29-4329-828a-7e5586f2cee1 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:10:49.896456 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-d1992e6e-6c29-4329-828a-7e5586f2cee1 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae" status: 200 len: 1517 microversion: 2.1 time: 0.153211 Oct 04 20:10:49.896980 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4193/8372] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:10:49 2022] GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae => generated 1517 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:10:50.920540 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-98e9dd39-2c4a-4c3d-b2c1-33584a00e7e2 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:10:50.921181 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-98e9dd39-2c4a-4c3d-b2c1-33584a00e7e2 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 1bd7692e-4876-4153-8471-85bb1c8ae2ae] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:10:50.928957 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-98e9dd39-2c4a-4c3d-b2c1-33584a00e7e2 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:10:50.929401 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-98e9dd39-2c4a-4c3d-b2c1-33584a00e7e2 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:10:50.929860 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-98e9dd39-2c4a-4c3d-b2c1-33584a00e7e2 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:10:50.930576 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-98e9dd39-2c4a-4c3d-b2c1-33584a00e7e2 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:10:50.931056 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-98e9dd39-2c4a-4c3d-b2c1-33584a00e7e2 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:10:50.931503 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-98e9dd39-2c4a-4c3d-b2c1-33584a00e7e2 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:10:51.143167 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-98e9dd39-2c4a-4c3d-b2c1-33584a00e7e2 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:10:51.151616 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-98e9dd39-2c4a-4c3d-b2c1-33584a00e7e2 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae" status: 200 len: 1573 microversion: 2.1 time: 0.234971 Oct 04 20:10:51.152226 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4180/8373] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:10:50 2022] GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae => generated 1573 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:10:52.175297 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9d958250-abc9-4f5a-8598-a63ccec2f1ac tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:10:52.175909 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-9d958250-abc9-4f5a-8598-a63ccec2f1ac tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 1bd7692e-4876-4153-8471-85bb1c8ae2ae] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:10:52.182716 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9d958250-abc9-4f5a-8598-a63ccec2f1ac tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:10:52.183201 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9d958250-abc9-4f5a-8598-a63ccec2f1ac tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:10:52.183634 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9d958250-abc9-4f5a-8598-a63ccec2f1ac tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:10:52.184349 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9d958250-abc9-4f5a-8598-a63ccec2f1ac tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:10:52.184808 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9d958250-abc9-4f5a-8598-a63ccec2f1ac tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:10:52.185235 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9d958250-abc9-4f5a-8598-a63ccec2f1ac tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:10:52.313945 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9d958250-abc9-4f5a-8598-a63ccec2f1ac tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:10:52.322388 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9d958250-abc9-4f5a-8598-a63ccec2f1ac tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae" status: 200 len: 1573 microversion: 2.1 time: 0.150966 Oct 04 20:10:52.322962 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4194/8374] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:10:52 2022] GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae => generated 1573 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:10:53.346744 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7ca4e5df-2247-4959-a7a9-347e32ee2cf4 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:10:53.347923 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7ca4e5df-2247-4959-a7a9-347e32ee2cf4 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 1bd7692e-4876-4153-8471-85bb1c8ae2ae] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:10:53.354746 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7ca4e5df-2247-4959-a7a9-347e32ee2cf4 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:10:53.355243 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7ca4e5df-2247-4959-a7a9-347e32ee2cf4 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:10:53.355693 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7ca4e5df-2247-4959-a7a9-347e32ee2cf4 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:10:53.356420 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7ca4e5df-2247-4959-a7a9-347e32ee2cf4 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:10:53.356897 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7ca4e5df-2247-4959-a7a9-347e32ee2cf4 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:10:53.357594 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7ca4e5df-2247-4959-a7a9-347e32ee2cf4 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:10:53.486523 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7ca4e5df-2247-4959-a7a9-347e32ee2cf4 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:10:53.494802 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7ca4e5df-2247-4959-a7a9-347e32ee2cf4 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae" status: 200 len: 1573 microversion: 2.1 time: 0.152003 Oct 04 20:10:53.496494 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4181/8375] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:10:53 2022] GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae => generated 1573 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:10:54.518496 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-fd4f4e93-b2db-434f-b4f6-308df5554b8b tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:10:54.519191 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-fd4f4e93-b2db-434f-b4f6-308df5554b8b tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 1bd7692e-4876-4153-8471-85bb1c8ae2ae] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:10:54.525985 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fd4f4e93-b2db-434f-b4f6-308df5554b8b tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:10:54.526477 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fd4f4e93-b2db-434f-b4f6-308df5554b8b tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:10:54.526924 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fd4f4e93-b2db-434f-b4f6-308df5554b8b tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:10:54.527625 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fd4f4e93-b2db-434f-b4f6-308df5554b8b tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:10:54.528109 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fd4f4e93-b2db-434f-b4f6-308df5554b8b tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:10:54.528549 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-fd4f4e93-b2db-434f-b4f6-308df5554b8b tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:10:54.664727 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-fd4f4e93-b2db-434f-b4f6-308df5554b8b tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:10:54.672621 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-fd4f4e93-b2db-434f-b4f6-308df5554b8b tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae" status: 200 len: 1573 microversion: 2.1 time: 0.158046 Oct 04 20:10:54.673189 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4195/8376] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:10:54 2022] GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae => generated 1573 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:10:55.696616 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-183aee95-b982-458e-b843-7aa017b39ea6 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:10:55.697250 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-183aee95-b982-458e-b843-7aa017b39ea6 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 1bd7692e-4876-4153-8471-85bb1c8ae2ae] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:10:55.704345 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-183aee95-b982-458e-b843-7aa017b39ea6 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:10:55.704861 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-183aee95-b982-458e-b843-7aa017b39ea6 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:10:55.705322 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-183aee95-b982-458e-b843-7aa017b39ea6 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:10:55.706038 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-183aee95-b982-458e-b843-7aa017b39ea6 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:10:55.707055 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-183aee95-b982-458e-b843-7aa017b39ea6 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:10:55.707863 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-183aee95-b982-458e-b843-7aa017b39ea6 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:10:55.848211 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-183aee95-b982-458e-b843-7aa017b39ea6 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:10:55.856147 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-183aee95-b982-458e-b843-7aa017b39ea6 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae" status: 200 len: 1573 microversion: 2.1 time: 0.163439 Oct 04 20:10:55.856744 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4182/8377] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:10:55 2022] GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae => generated 1573 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:10:56.881201 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ee4de47a-660c-4eab-b05d-1306b801e04a tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:10:56.881824 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ee4de47a-660c-4eab-b05d-1306b801e04a tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 1bd7692e-4876-4153-8471-85bb1c8ae2ae] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:10:56.884884 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=31 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:10:56.889643 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ee4de47a-660c-4eab-b05d-1306b801e04a tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:10:56.890131 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ee4de47a-660c-4eab-b05d-1306b801e04a tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:10:56.890570 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ee4de47a-660c-4eab-b05d-1306b801e04a tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:10:56.891269 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ee4de47a-660c-4eab-b05d-1306b801e04a tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:10:56.891724 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ee4de47a-660c-4eab-b05d-1306b801e04a tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:10:56.892187 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ee4de47a-660c-4eab-b05d-1306b801e04a tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:10:56.895559 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:10:57.028183 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ee4de47a-660c-4eab-b05d-1306b801e04a tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:10:57.036279 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ee4de47a-660c-4eab-b05d-1306b801e04a tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae" status: 200 len: 1573 microversion: 2.1 time: 0.160092 Oct 04 20:10:57.036854 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4196/8378] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:10:56 2022] GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae => generated 1573 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:10:58.058853 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-243afe97-1a06-4c0b-882d-9275f6e00552 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:10:58.059483 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-243afe97-1a06-4c0b-882d-9275f6e00552 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 1bd7692e-4876-4153-8471-85bb1c8ae2ae] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:10:58.062174 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:10:58.067441 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-243afe97-1a06-4c0b-882d-9275f6e00552 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:10:58.067948 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-243afe97-1a06-4c0b-882d-9275f6e00552 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:10:58.068428 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-243afe97-1a06-4c0b-882d-9275f6e00552 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:10:58.075460 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-243afe97-1a06-4c0b-882d-9275f6e00552 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:10:58.075460 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-243afe97-1a06-4c0b-882d-9275f6e00552 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:10:58.075460 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-243afe97-1a06-4c0b-882d-9275f6e00552 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:10:58.201167 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-243afe97-1a06-4c0b-882d-9275f6e00552 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:10:58.209583 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-243afe97-1a06-4c0b-882d-9275f6e00552 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae" status: 200 len: 1573 microversion: 2.1 time: 0.154714 Oct 04 20:10:58.210162 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4183/8379] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:10:58 2022] GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae => generated 1573 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:10:59.234303 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f3199352-ce95-41d1-9421-befea70bafae tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:10:59.234920 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f3199352-ce95-41d1-9421-befea70bafae tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 1bd7692e-4876-4153-8471-85bb1c8ae2ae] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:10:59.241794 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f3199352-ce95-41d1-9421-befea70bafae tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:10:59.242277 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f3199352-ce95-41d1-9421-befea70bafae tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:10:59.242719 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f3199352-ce95-41d1-9421-befea70bafae tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:10:59.243403 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f3199352-ce95-41d1-9421-befea70bafae tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:10:59.243859 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f3199352-ce95-41d1-9421-befea70bafae tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:10:59.244318 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f3199352-ce95-41d1-9421-befea70bafae tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:10:59.380855 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f3199352-ce95-41d1-9421-befea70bafae tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:10:59.388652 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f3199352-ce95-41d1-9421-befea70bafae tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae" status: 200 len: 1573 microversion: 2.1 time: 0.158896 Oct 04 20:10:59.389237 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4197/8380] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:10:59 2022] GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae => generated 1573 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:11:00.412958 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-089d2d40-8573-48db-b75c-1d2e5e991cf0 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:11:00.413597 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-089d2d40-8573-48db-b75c-1d2e5e991cf0 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 1bd7692e-4876-4153-8471-85bb1c8ae2ae] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:11:00.419870 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-089d2d40-8573-48db-b75c-1d2e5e991cf0 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:11:00.420405 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-089d2d40-8573-48db-b75c-1d2e5e991cf0 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:11:00.420894 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-089d2d40-8573-48db-b75c-1d2e5e991cf0 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:11:00.421602 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-089d2d40-8573-48db-b75c-1d2e5e991cf0 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:11:00.422093 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-089d2d40-8573-48db-b75c-1d2e5e991cf0 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:11:00.422539 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-089d2d40-8573-48db-b75c-1d2e5e991cf0 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:11:00.425141 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:11:00.555871 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-089d2d40-8573-48db-b75c-1d2e5e991cf0 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:11:00.562576 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-089d2d40-8573-48db-b75c-1d2e5e991cf0 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae" status: 200 len: 1573 microversion: 2.1 time: 0.153866 Oct 04 20:11:00.563163 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4184/8381] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:11:00 2022] GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae => generated 1573 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:11:01.588940 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5e7d89f7-0b45-4331-b223-a4957817c016 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:11:01.589621 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5e7d89f7-0b45-4331-b223-a4957817c016 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 1bd7692e-4876-4153-8471-85bb1c8ae2ae] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:11:01.597549 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5e7d89f7-0b45-4331-b223-a4957817c016 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:11:01.599476 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5e7d89f7-0b45-4331-b223-a4957817c016 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:11:01.599927 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5e7d89f7-0b45-4331-b223-a4957817c016 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:11:01.600739 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5e7d89f7-0b45-4331-b223-a4957817c016 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:11:01.601205 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5e7d89f7-0b45-4331-b223-a4957817c016 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:11:01.601642 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5e7d89f7-0b45-4331-b223-a4957817c016 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:11:01.734739 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5e7d89f7-0b45-4331-b223-a4957817c016 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:11:01.742530 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5e7d89f7-0b45-4331-b223-a4957817c016 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae" status: 200 len: 1573 microversion: 2.1 time: 0.158746 Oct 04 20:11:01.743111 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4198/8382] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:11:01 2022] GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae => generated 1573 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:11:02.596222 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-c10f0d87-3d64-4893-af1b-ef3577e1b0b9 req-43bba447-43b5-45e4-8d1e-7ac4005f2b0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bd7692e-4876-4153-8471-85bb1c8ae2ae", "name": "network-vif-plugged", "status": "completed", "tag": "b6eb86fa-503b-42fb-859c-9a2da799dfe5"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:11:02.607486 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-c10f0d87-3d64-4893-af1b-ef3577e1b0b9 req-43bba447-43b5-45e4-8d1e-7ac4005f2b0f service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:11:02.608282 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-c10f0d87-3d64-4893-af1b-ef3577e1b0b9 req-43bba447-43b5-45e4-8d1e-7ac4005f2b0f service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:11:02.608823 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-c10f0d87-3d64-4893-af1b-ef3577e1b0b9 req-43bba447-43b5-45e4-8d1e-7ac4005f2b0f service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:11:02.620586 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-c10f0d87-3d64-4893-af1b-ef3577e1b0b9 req-43bba447-43b5-45e4-8d1e-7ac4005f2b0f service nova] Creating event network-vif-plugged:b6eb86fa-503b-42fb-859c-9a2da799dfe5 for instance 1bd7692e-4876-4153-8471-85bb1c8ae2ae on n-h1-850501-14 Oct 04 20:11:02.627018 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-c10f0d87-3d64-4893-af1b-ef3577e1b0b9 req-43bba447-43b5-45e4-8d1e-7ac4005f2b0f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034791 Oct 04 20:11:02.627640 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4185/8383] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 20:11:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:11:02.765043 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-82faf601-cc1c-4e91-8aed-4fead3b4b1dd tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:11:02.765652 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-82faf601-cc1c-4e91-8aed-4fead3b4b1dd tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 1bd7692e-4876-4153-8471-85bb1c8ae2ae] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:11:02.772773 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-82faf601-cc1c-4e91-8aed-4fead3b4b1dd tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:11:02.773268 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-82faf601-cc1c-4e91-8aed-4fead3b4b1dd tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:11:02.773706 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-82faf601-cc1c-4e91-8aed-4fead3b4b1dd tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:11:02.774412 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-82faf601-cc1c-4e91-8aed-4fead3b4b1dd tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:11:02.774872 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-82faf601-cc1c-4e91-8aed-4fead3b4b1dd tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:11:02.775302 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-82faf601-cc1c-4e91-8aed-4fead3b4b1dd tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:11:02.930614 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-82faf601-cc1c-4e91-8aed-4fead3b4b1dd tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:11:02.938435 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-82faf601-cc1c-4e91-8aed-4fead3b4b1dd tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae" status: 200 len: 1573 microversion: 2.1 time: 0.177324 Oct 04 20:11:02.939019 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4199/8384] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:11:02 2022] GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae => generated 1573 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:11:03.965099 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-80bc8dc6-c517-41a6-bae1-e1e45f4d4b7a tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:11:03.965829 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-80bc8dc6-c517-41a6-bae1-e1e45f4d4b7a tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 1bd7692e-4876-4153-8471-85bb1c8ae2ae] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:11:03.972221 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-80bc8dc6-c517-41a6-bae1-e1e45f4d4b7a tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:11:03.972722 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-80bc8dc6-c517-41a6-bae1-e1e45f4d4b7a tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:11:03.973752 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-80bc8dc6-c517-41a6-bae1-e1e45f4d4b7a tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:11:03.974976 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-80bc8dc6-c517-41a6-bae1-e1e45f4d4b7a tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:11:03.975456 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-80bc8dc6-c517-41a6-bae1-e1e45f4d4b7a tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:11:03.975908 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-80bc8dc6-c517-41a6-bae1-e1e45f4d4b7a tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:11:04.116637 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-80bc8dc6-c517-41a6-bae1-e1e45f4d4b7a tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:11:04.124446 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-80bc8dc6-c517-41a6-bae1-e1e45f4d4b7a tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae" status: 200 len: 1573 microversion: 2.1 time: 0.164957 Oct 04 20:11:04.125025 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4186/8385] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:11:03 2022] GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae => generated 1573 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:11:05.149363 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e1c435f0-f510-4d98-b6f6-c0d7e1cd4df9 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:11:05.149992 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e1c435f0-f510-4d98-b6f6-c0d7e1cd4df9 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 1bd7692e-4876-4153-8471-85bb1c8ae2ae] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:11:05.156881 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e1c435f0-f510-4d98-b6f6-c0d7e1cd4df9 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:11:05.157377 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e1c435f0-f510-4d98-b6f6-c0d7e1cd4df9 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:11:05.157823 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e1c435f0-f510-4d98-b6f6-c0d7e1cd4df9 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:11:05.158541 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e1c435f0-f510-4d98-b6f6-c0d7e1cd4df9 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:11:05.158988 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e1c435f0-f510-4d98-b6f6-c0d7e1cd4df9 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:11:05.159425 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e1c435f0-f510-4d98-b6f6-c0d7e1cd4df9 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:11:05.287774 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-e1c435f0-f510-4d98-b6f6-c0d7e1cd4df9 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:11:05.295776 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e1c435f0-f510-4d98-b6f6-c0d7e1cd4df9 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae" status: 200 len: 1560 microversion: 2.1 time: 0.150911 Oct 04 20:11:05.296582 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4200/8386] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:11:05 2022] GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:12:54.938373 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=7 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:12:54.939706 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=13 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:12:54.943648 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=9 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:12:54.949307 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=29 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:12:54.949307 n-d-850501-14 devstack@n-api.service[123001]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 20:12:54.949307 n-d-850501-14 devstack@n-api.service[123001]: Tue Oct 4 20:12:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.20) !!! Oct 04 20:12:54.950141 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-d10f7ab4-8f04-4d7a-b8cb-ce6f94393f8d tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:12:54.950141 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d10f7ab4-8f04-4d7a-b8cb-ce6f94393f8d tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 1bd7692e-4876-4153-8471-85bb1c8ae2ae] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:12:54.955411 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d10f7ab4-8f04-4d7a-b8cb-ce6f94393f8d tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:12:54.956935 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d10f7ab4-8f04-4d7a-b8cb-ce6f94393f8d tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:12:54.957442 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d10f7ab4-8f04-4d7a-b8cb-ce6f94393f8d tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:12:54.958400 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d10f7ab4-8f04-4d7a-b8cb-ce6f94393f8d tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:12:54.958889 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d10f7ab4-8f04-4d7a-b8cb-ce6f94393f8d tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:12:54.959339 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-d10f7ab4-8f04-4d7a-b8cb-ce6f94393f8d tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:12:54.988225 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-d10f7ab4-8f04-4d7a-b8cb-ce6f94393f8d tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 1bd7692e-4876-4153-8471-85bb1c8ae2ae] Going to try to terminate instance {{(pid=123002) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:12:55.094957 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-222c40df-8b30-497c-83d2-16a4db2b0ef7 req-252a2ffd-3be0-46d2-94fd-ced5c7879b4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bd7692e-4876-4153-8471-85bb1c8ae2ae", "tag": "b6eb86fa-503b-42fb-859c-9a2da799dfe5"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:12:55.105005 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-222c40df-8b30-497c-83d2-16a4db2b0ef7 req-252a2ffd-3be0-46d2-94fd-ced5c7879b4b service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:12:55.105584 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-222c40df-8b30-497c-83d2-16a4db2b0ef7 req-252a2ffd-3be0-46d2-94fd-ced5c7879b4b service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:12:55.106022 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-222c40df-8b30-497c-83d2-16a4db2b0ef7 req-252a2ffd-3be0-46d2-94fd-ced5c7879b4b service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:12:55.118071 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-222c40df-8b30-497c-83d2-16a4db2b0ef7 req-252a2ffd-3be0-46d2-94fd-ced5c7879b4b service nova] Creating event network-changed:b6eb86fa-503b-42fb-859c-9a2da799dfe5 for instance 1bd7692e-4876-4153-8471-85bb1c8ae2ae on n-h1-850501-14 Oct 04 20:12:55.123629 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-222c40df-8b30-497c-83d2-16a4db2b0ef7 req-252a2ffd-3be0-46d2-94fd-ced5c7879b4b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.186504 Oct 04 20:12:55.124248 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4201/8387] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 20:12:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:12:55.474335 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-d10f7ab4-8f04-4d7a-b8cb-ce6f94393f8d tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae" status: 204 len: 0 microversion: 2.1 time: 0.539243 Oct 04 20:12:55.474953 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4187/8388] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 20:12:54 2022] DELETE /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae => generated 0 bytes in 541 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:12:55.484008 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-088caa85-6953-4bf2-9ece-1bc9d80e144f tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:12:55.484754 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-088caa85-6953-4bf2-9ece-1bc9d80e144f tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 1bd7692e-4876-4153-8471-85bb1c8ae2ae] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:12:55.493110 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-088caa85-6953-4bf2-9ece-1bc9d80e144f tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:12:55.493896 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-088caa85-6953-4bf2-9ece-1bc9d80e144f tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:12:55.494340 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-088caa85-6953-4bf2-9ece-1bc9d80e144f tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:12:55.495051 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-088caa85-6953-4bf2-9ece-1bc9d80e144f tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:12:55.495510 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-088caa85-6953-4bf2-9ece-1bc9d80e144f tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:12:55.495944 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-088caa85-6953-4bf2-9ece-1bc9d80e144f tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:12:55.687185 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-088caa85-6953-4bf2-9ece-1bc9d80e144f tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:12:55.695684 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-088caa85-6953-4bf2-9ece-1bc9d80e144f tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae" status: 200 len: 1566 microversion: 2.1 time: 0.216140 Oct 04 20:12:55.696292 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4202/8389] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:12:55 2022] GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae => generated 1566 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:12:56.724431 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-aa68ad99-c305-4d44-b1d3-dabd1f70df65 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:12:56.725290 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-aa68ad99-c305-4d44-b1d3-dabd1f70df65 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 1bd7692e-4876-4153-8471-85bb1c8ae2ae] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:12:56.732748 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aa68ad99-c305-4d44-b1d3-dabd1f70df65 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:12:56.733270 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aa68ad99-c305-4d44-b1d3-dabd1f70df65 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:12:56.733735 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aa68ad99-c305-4d44-b1d3-dabd1f70df65 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:12:56.734421 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aa68ad99-c305-4d44-b1d3-dabd1f70df65 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:12:56.734883 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aa68ad99-c305-4d44-b1d3-dabd1f70df65 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:12:56.735339 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-aa68ad99-c305-4d44-b1d3-dabd1f70df65 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:12:56.943322 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-aa68ad99-c305-4d44-b1d3-dabd1f70df65 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:12:56.951137 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-aa68ad99-c305-4d44-b1d3-dabd1f70df65 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae" status: 200 len: 1566 microversion: 2.1 time: 0.235181 Oct 04 20:12:56.951740 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4188/8390] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:12:56 2022] GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae => generated 1566 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:12:57.528991 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-8f8d8c73-7c1a-4a36-80c7-21ee30a1fff0 req-97a152d4-4fae-453a-93d9-5ba62b1e6a99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bd7692e-4876-4153-8471-85bb1c8ae2ae", "name": "network-vif-deleted", "tag": "b6eb86fa-503b-42fb-859c-9a2da799dfe5"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:12:57.539826 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-8f8d8c73-7c1a-4a36-80c7-21ee30a1fff0 req-97a152d4-4fae-453a-93d9-5ba62b1e6a99 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:12:57.539826 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-8f8d8c73-7c1a-4a36-80c7-21ee30a1fff0 req-97a152d4-4fae-453a-93d9-5ba62b1e6a99 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:12:57.539826 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-8f8d8c73-7c1a-4a36-80c7-21ee30a1fff0 req-97a152d4-4fae-453a-93d9-5ba62b1e6a99 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:12:57.550944 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-8f8d8c73-7c1a-4a36-80c7-21ee30a1fff0 req-97a152d4-4fae-453a-93d9-5ba62b1e6a99 service nova] Creating event network-vif-deleted:b6eb86fa-503b-42fb-859c-9a2da799dfe5 for instance 1bd7692e-4876-4153-8471-85bb1c8ae2ae on n-h1-850501-14 Oct 04 20:12:57.555909 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-8f8d8c73-7c1a-4a36-80c7-21ee30a1fff0 req-97a152d4-4fae-453a-93d9-5ba62b1e6a99 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081441 Oct 04 20:12:57.556583 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4203/8391] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 20:12:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:12:57.976309 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-fd4e9f17-a360-4f0a-8bed-08bee7e3e237 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:12:57.976885 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-fd4e9f17-a360-4f0a-8bed-08bee7e3e237 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 1bd7692e-4876-4153-8471-85bb1c8ae2ae] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:12:57.984277 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fd4e9f17-a360-4f0a-8bed-08bee7e3e237 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:12:57.984776 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fd4e9f17-a360-4f0a-8bed-08bee7e3e237 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:12:57.985223 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fd4e9f17-a360-4f0a-8bed-08bee7e3e237 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:12:57.985954 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fd4e9f17-a360-4f0a-8bed-08bee7e3e237 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:12:57.987259 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fd4e9f17-a360-4f0a-8bed-08bee7e3e237 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:12:57.987704 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-fd4e9f17-a360-4f0a-8bed-08bee7e3e237 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:12:58.051255 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-fd4e9f17-a360-4f0a-8bed-08bee7e3e237 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:12:58.059174 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-fd4e9f17-a360-4f0a-8bed-08bee7e3e237 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae" status: 200 len: 1218 microversion: 2.1 time: 0.087010 Oct 04 20:12:58.059747 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4189/8392] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:12:57 2022] GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:12:59.085396 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-2a43331b-a1b8-4c31-bf20-23b82d08bc65 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:12:59.086113 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-2a43331b-a1b8-4c31-bf20-23b82d08bc65 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 1bd7692e-4876-4153-8471-85bb1c8ae2ae] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:12:59.092423 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2a43331b-a1b8-4c31-bf20-23b82d08bc65 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:12:59.092917 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2a43331b-a1b8-4c31-bf20-23b82d08bc65 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:12:59.093366 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2a43331b-a1b8-4c31-bf20-23b82d08bc65 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:12:59.094073 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2a43331b-a1b8-4c31-bf20-23b82d08bc65 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:12:59.094538 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2a43331b-a1b8-4c31-bf20-23b82d08bc65 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:12:59.094972 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-2a43331b-a1b8-4c31-bf20-23b82d08bc65 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:12:59.164744 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-2a43331b-a1b8-4c31-bf20-23b82d08bc65 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:12:59.172766 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-2a43331b-a1b8-4c31-bf20-23b82d08bc65 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae" status: 200 len: 1218 microversion: 2.1 time: 0.092695 Oct 04 20:12:59.173345 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4204/8393] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:12:59 2022] GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:13:00.195928 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-03e16259-f2ed-48ed-8675-beefc415192f tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:13:00.196614 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-03e16259-f2ed-48ed-8675-beefc415192f tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 1bd7692e-4876-4153-8471-85bb1c8ae2ae] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:13:00.202942 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-03e16259-f2ed-48ed-8675-beefc415192f tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:13:00.203444 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-03e16259-f2ed-48ed-8675-beefc415192f tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:13:00.203896 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-03e16259-f2ed-48ed-8675-beefc415192f tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:13:00.204632 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-03e16259-f2ed-48ed-8675-beefc415192f tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:13:00.205879 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-03e16259-f2ed-48ed-8675-beefc415192f tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:13:00.206391 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-03e16259-f2ed-48ed-8675-beefc415192f tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:13:00.269339 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-03e16259-f2ed-48ed-8675-beefc415192f tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:13:00.277270 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-03e16259-f2ed-48ed-8675-beefc415192f tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae" status: 200 len: 1218 microversion: 2.1 time: 0.085298 Oct 04 20:13:00.277848 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4190/8394] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:13:00 2022] GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:13:01.301500 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-761b2257-d1aa-4eee-ac3b-e2e596e51196 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:13:01.302063 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-761b2257-d1aa-4eee-ac3b-e2e596e51196 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 1bd7692e-4876-4153-8471-85bb1c8ae2ae] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:13:01.309025 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-761b2257-d1aa-4eee-ac3b-e2e596e51196 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:13:01.309517 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-761b2257-d1aa-4eee-ac3b-e2e596e51196 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:13:01.309957 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-761b2257-d1aa-4eee-ac3b-e2e596e51196 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:13:01.310663 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-761b2257-d1aa-4eee-ac3b-e2e596e51196 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:13:01.311125 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-761b2257-d1aa-4eee-ac3b-e2e596e51196 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:13:01.311557 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-761b2257-d1aa-4eee-ac3b-e2e596e51196 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:13:01.374076 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-761b2257-d1aa-4eee-ac3b-e2e596e51196 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:13:01.382565 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-761b2257-d1aa-4eee-ac3b-e2e596e51196 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae" status: 200 len: 1218 microversion: 2.1 time: 0.085207 Oct 04 20:13:01.383141 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4205/8395] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:13:01 2022] GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:13:02.407177 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-008b0abd-3654-4138-addc-bd78784b9afe tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:13:02.407778 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-008b0abd-3654-4138-addc-bd78784b9afe tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 1bd7692e-4876-4153-8471-85bb1c8ae2ae] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:13:02.415801 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-008b0abd-3654-4138-addc-bd78784b9afe tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:13:02.422115 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-008b0abd-3654-4138-addc-bd78784b9afe tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:13:02.422115 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-008b0abd-3654-4138-addc-bd78784b9afe tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:13:02.422115 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-008b0abd-3654-4138-addc-bd78784b9afe tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:13:02.422115 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-008b0abd-3654-4138-addc-bd78784b9afe tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:13:02.422115 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-008b0abd-3654-4138-addc-bd78784b9afe tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:13:02.452935 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-008b0abd-3654-4138-addc-bd78784b9afe tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:13:02.453450 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-008b0abd-3654-4138-addc-bd78784b9afe tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:13:02.453903 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-008b0abd-3654-4138-addc-bd78784b9afe tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:13:02.454371 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-008b0abd-3654-4138-addc-bd78784b9afe tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lazy-loading 'fault' on Instance uuid 1bd7692e-4876-4153-8471-85bb1c8ae2ae {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:13:02.498256 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-008b0abd-3654-4138-addc-bd78784b9afe tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e363289512f8439bb0f2116f3e361e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d5e2ecd4c34120afd16b7924267082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:13:02.506955 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-008b0abd-3654-4138-addc-bd78784b9afe tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae" status: 200 len: 1223 microversion: 2.1 time: 0.103926 Oct 04 20:13:02.507540 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4191/8396] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:13:02 2022] GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae => generated 1223 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:13:03.530762 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-06d49d6d-02ee-42d7-8afd-a87b03fdbb48 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:13:03.531387 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-06d49d6d-02ee-42d7-8afd-a87b03fdbb48 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] [instance: 1bd7692e-4876-4153-8471-85bb1c8ae2ae] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:13:03.538530 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-06d49d6d-02ee-42d7-8afd-a87b03fdbb48 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:13:03.539023 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-06d49d6d-02ee-42d7-8afd-a87b03fdbb48 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:13:03.539473 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-06d49d6d-02ee-42d7-8afd-a87b03fdbb48 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:13:03.540226 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-06d49d6d-02ee-42d7-8afd-a87b03fdbb48 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:13:03.540679 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-06d49d6d-02ee-42d7-8afd-a87b03fdbb48 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:13:03.541116 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-06d49d6d-02ee-42d7-8afd-a87b03fdbb48 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:13:03.554776 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-06d49d6d-02ee-42d7-8afd-a87b03fdbb48 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] HTTP exception thrown: Instance 1bd7692e-4876-4153-8471-85bb1c8ae2ae could not be found. Oct 04 20:13:03.556477 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-06d49d6d-02ee-42d7-8afd-a87b03fdbb48 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Request method failure captured: Oct 04 20:13:03.556477 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae HTTP/1.1 Oct 04 20:13:03.556477 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 20:13:03.556477 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 20:13:03.556477 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 20:13:03.556477 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 20:13:03.556477 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 20:13:03.556477 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 20:13:03.556477 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 20:13:03.556477 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 20:13:03.556477 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPJEy28g1KImpZQVU6Zt__dxS9u-6wDoUxhDOgsy_V7A07RIoCsM_PT9ZH3RpjFCyYIk9D7R-ahasHh-ZGV73sexhhpHLKeMbENO0c-JvOk0OaCq_vM7TyZILNpquNtRaAf9bHKXjSuDyJU2WANFynYLRjfn8WYqViXBdHsrQ1qXE3tI Oct 04 20:13:03.556477 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 20:13:03.556477 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 20:13:03.556477 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 20:13:03.556477 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 20:13:03.556477 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 20:13:03.556477 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 20:13:03.556477 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 92d5e2ecd4c34120afd16b7924267082 Oct 04 20:13:03.556477 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-TestShelveInstance-1707385160 Oct 04 20:13:03.556477 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 20:13:03.556477 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 20:13:03.556477 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/92d5e2ecd4c34120afd16b7924267082"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_92d5e2ecd4c34120afd16b7924267082", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/92d5e2ecd4c34120afd16b7924267082"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/92d5e2ecd4c34120afd16b7924267082"}]}] Oct 04 20:13:03.556477 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-TestShelveInstance-1707385160 Oct 04 20:13:03.556477 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 92d5e2ecd4c34120afd16b7924267082 Oct 04 20:13:03.556477 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-TestShelveInstance-1707385160 Oct 04 20:13:03.556477 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-TestShelveInstance-1707385160-project Oct 04 20:13:03.556477 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 20:13:03.556477 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 20:13:03.556477 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: e363289512f8439bb0f2116f3e361e79 Oct 04 20:13:03.556477 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-TestShelveInstance-1707385160-project Oct 04 20:13:03.556477 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 20:13:03.556477 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 1bd7692e-4876-4153-8471-85bb1c8ae2ae could not be found. Oct 04 20:13:03.556477 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '1bd7692e-4876-4153-8471-85bb1c8ae2ae'} Oct 04 20:13:03.556477 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:13:03.556477 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:13:03.556477 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:13:03.556477 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:13:03.556477 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:13:03.556477 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:13:03.556477 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:13:03.556477 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:13:03.556477 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:13:03.556477 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:13:03.556477 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bd7692e-4876-4153-8471-85bb1c8ae2ae could not be found. Oct 04 20:13:03.556477 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 20:13:03.556477 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:13:03.556477 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 20:13:03.556477 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:13:03.556477 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:13:03.556477 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:13:03.556477 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:13:03.556477 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:13:03.556477 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:13:03.556477 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:13:03.556477 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:13:03.556477 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:13:03.556477 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:13:03.556477 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:13:03.556477 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:13:03.556477 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:13:03.556477 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bd7692e-4876-4153-8471-85bb1c8ae2ae could not be found. Oct 04 20:13:03.556477 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 20:13:03.556477 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:13:03.556477 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 20:13:03.564210 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:13:03.564210 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:13:03.564210 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:13:03.564210 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:13:03.564210 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:13:03.564210 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bd7692e-4876-4153-8471-85bb1c8ae2ae could not be found. Oct 04 20:13:03.564210 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 20:13:03.564210 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-06d49d6d-02ee-42d7-8afd-a87b03fdbb48 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Returning 404 to user: Instance 1bd7692e-4876-4153-8471-85bb1c8ae2ae could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:13:03.564210 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-06d49d6d-02ee-42d7-8afd-a87b03fdbb48 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae" status: 404 len: 111 microversion: 2.1 time: 0.031096 Oct 04 20:13:03.564210 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4206/8397] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:13:03 2022] GET /compute/v2.1/servers/1bd7692e-4876-4153-8471-85bb1c8ae2ae => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:13:03.839547 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-fee3a379-3956-41dc-9225-3582b28bd544 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] Calling method '.version_select at 0x7fe253cf5790>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:13:04.007578 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-fee3a379-3956-41dc-9225-3582b28bd544 tempest-TestShelveInstance-1707385160 tempest-TestShelveInstance-1707385160-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-786309225" status: 202 len: 0 microversion: 2.1 time: 0.172184 Oct 04 20:13:04.008354 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4192/8398] 10.222.0.20 () {58 vars in 1251 bytes} [Tue Oct 4 20:13:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-786309225 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:13:28.552301 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=12 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:13:28.553086 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=24 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:13:28.727107 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ec26b795-6cf6-42d4-a872-e4db9f5e7579 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Action: 'create', calling method: .version_select at 0x7fe253b5fc10>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-663521482", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBErV9Fur5XlCsj5Z8llqtJ1Vjtw1L/WaCOZ308HksUf34f+conDUKtSM/BAW6z9BOyNb4XUT431sFbH4m2H52/P3Pqa0FXypliWtMAJOPFRVAIpowMMgwzm/DhTt1okfvg=="}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:13:28.751046 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-ec26b795-6cf6-42d4-a872-e4db9f5e7579 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Getting quotas for project 587458a3ad32433c80687dba9c5764ad. Resources: {'key_pairs'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:13:28.751046 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-ec26b795-6cf6-42d4-a872-e4db9f5e7579 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Getting quotas for user 985dc8b557234d239bf2e2ec8cc002c4 and project 587458a3ad32433c80687dba9c5764ad. Resources: {'key_pairs'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:13:28.764714 n-d-850501-14 devstack@n-api.service[123001]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ec26b795-6cf6-42d4-a872-e4db9f5e7579 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] [6c8ce3ae-b440-4b28-996b-33b11441f461] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 20:13:29.773649 n-d-850501-14 devstack@n-api.service[123001]: INFO oslo.messaging._drivers.impl_rabbit [None req-ec26b795-6cf6-42d4-a872-e4db9f5e7579 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] [6c8ce3ae-b440-4b28-996b-33b11441f461] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 55472. Oct 04 20:13:29.892437 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ec26b795-6cf6-42d4-a872-e4db9f5e7579 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 1.345504 Oct 04 20:13:29.893053 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4207/8399] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Oct 4 20:13:28 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 1347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:13:33.303650 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:13:33.304464 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:13:33.308535 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-dd27c455-c500-4df2-9ff1-23b90c522e68 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1472280448", "imageRef": "f545e662-10b3-46b1-88bb-6e66dd294559", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-663521482", "security_groups": [{"name": "tempest-secgroup-smoke-328983847"}], "networks": [{"uuid": "3f63a500-6308-47cc-8a52-311c96311bf4"}]}} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:13:33.417376 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.network.neutron [None req-dd27c455-c500-4df2-9ff1-23b90c522e68 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] validate_networks() for [('3f63a500-6308-47cc-8a52-311c96311bf4', None, None, None, None, None)] {{(pid=123002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:13:33.814352 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-dd27c455-c500-4df2-9ff1-23b90c522e68 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Flavor limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:13:33.814801 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-dd27c455-c500-4df2-9ff1-23b90c522e68 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Image limits 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:13:33.815331 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-dd27c455-c500-4df2-9ff1-23b90c522e68 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Flavor pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:13:33.815763 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-dd27c455-c500-4df2-9ff1-23b90c522e68 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Image pref 0:0:0 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:13:33.816377 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.virt.hardware [None req-dd27c455-c500-4df2-9ff1-23b90c522e68 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:13:33.825862 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dd27c455-c500-4df2-9ff1-23b90c522e68 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:13:33.826263 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dd27c455-c500-4df2-9ff1-23b90c522e68 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:13:33.826733 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dd27c455-c500-4df2-9ff1-23b90c522e68 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:13:33.827450 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dd27c455-c500-4df2-9ff1-23b90c522e68 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:13:33.827921 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dd27c455-c500-4df2-9ff1-23b90c522e68 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:13:33.828411 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-dd27c455-c500-4df2-9ff1-23b90c522e68 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:13:33.847014 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-dd27c455-c500-4df2-9ff1-23b90c522e68 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Getting quotas for project 587458a3ad32433c80687dba9c5764ad. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:13:33.852862 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.quota [None req-dd27c455-c500-4df2-9ff1-23b90c522e68 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Getting quotas for user 985dc8b557234d239bf2e2ec8cc002c4 and project 587458a3ad32433c80687dba9c5764ad. Resources: {'instances', 'cores', 'ram'} {{(pid=123002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:13:33.865366 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-dd27c455-c500-4df2-9ff1-23b90c522e68 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Going to run 1 instances... {{(pid=123002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:13:33.867681 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-dd27c455-c500-4df2-9ff1-23b90c522e68 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] [instance: 5db08838-334f-4de5-9030-c8a395c97aa3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f545e662-10b3-46b1-88bb-6e66dd294559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:13:33.976471 n-d-850501-14 devstack@n-api.service[123002]: ERROR oslo.messaging._drivers.impl_rabbit [None req-dd27c455-c500-4df2-9ff1-23b90c522e68 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] [dcd3de5e-bba6-4468-b8a4-2b05a921d453] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 20:13:34.984415 n-d-850501-14 devstack@n-api.service[123002]: INFO oslo.messaging._drivers.impl_rabbit [None req-dd27c455-c500-4df2-9ff1-23b90c522e68 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] [dcd3de5e-bba6-4468-b8a4-2b05a921d453] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 55504. Oct 04 20:13:34.989070 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-dd27c455-c500-4df2-9ff1-23b90c522e68 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.688028 Oct 04 20:13:34.989891 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4193/8400] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 20:13:33 2022] POST /compute/v2.1/servers => generated 405 bytes in 1689 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:13:35.003092 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6fc25114-f426-495d-8179-e00d2c475fdd tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:13:35.003716 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6fc25114-f426-495d-8179-e00d2c475fdd tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] [instance: 5db08838-334f-4de5-9030-c8a395c97aa3] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:13:35.065126 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6fc25114-f426-495d-8179-e00d2c475fdd tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dc8b557234d239bf2e2ec8cc002c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587458a3ad32433c80687dba9c5764ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:13:35.072406 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6fc25114-f426-495d-8179-e00d2c475fdd tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] 10.222.0.20 "GET /compute/v2.1/servers/5db08838-334f-4de5-9030-c8a395c97aa3" status: 200 len: 1248 microversion: 2.1 time: 0.073940 Oct 04 20:13:35.072991 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4208/8401] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:13:34 2022] GET /compute/v2.1/servers/5db08838-334f-4de5-9030-c8a395c97aa3 => generated 1248 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:13:36.095668 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-49951801-d59b-42a4-85c2-cc0323950630 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:13:36.096350 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-49951801-d59b-42a4-85c2-cc0323950630 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] [instance: 5db08838-334f-4de5-9030-c8a395c97aa3] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:13:36.160589 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-49951801-d59b-42a4-85c2-cc0323950630 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dc8b557234d239bf2e2ec8cc002c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587458a3ad32433c80687dba9c5764ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:13:36.168751 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-49951801-d59b-42a4-85c2-cc0323950630 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] 10.222.0.20 "GET /compute/v2.1/servers/5db08838-334f-4de5-9030-c8a395c97aa3" status: 200 len: 1248 microversion: 2.1 time: 0.077934 Oct 04 20:13:36.169336 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4194/8402] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:13:36 2022] GET /compute/v2.1/servers/5db08838-334f-4de5-9030-c8a395c97aa3 => generated 1248 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:13:37.192884 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-9fc7eaca-f225-45e8-a0cf-7450e103f926 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:13:37.193536 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-9fc7eaca-f225-45e8-a0cf-7450e103f926 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] [instance: 5db08838-334f-4de5-9030-c8a395c97aa3] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:13:37.201153 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9fc7eaca-f225-45e8-a0cf-7450e103f926 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:13:37.201643 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9fc7eaca-f225-45e8-a0cf-7450e103f926 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:13:37.202086 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9fc7eaca-f225-45e8-a0cf-7450e103f926 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:13:37.202781 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9fc7eaca-f225-45e8-a0cf-7450e103f926 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:13:37.203239 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9fc7eaca-f225-45e8-a0cf-7450e103f926 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:13:37.203671 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-9fc7eaca-f225-45e8-a0cf-7450e103f926 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:13:37.265396 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-9fc7eaca-f225-45e8-a0cf-7450e103f926 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dc8b557234d239bf2e2ec8cc002c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587458a3ad32433c80687dba9c5764ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:13:37.273933 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-9fc7eaca-f225-45e8-a0cf-7450e103f926 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] 10.222.0.20 "GET /compute/v2.1/servers/5db08838-334f-4de5-9030-c8a395c97aa3" status: 200 len: 1252 microversion: 2.1 time: 0.084999 Oct 04 20:13:37.274510 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4209/8403] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:13:37 2022] GET /compute/v2.1/servers/5db08838-334f-4de5-9030-c8a395c97aa3 => generated 1252 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:13:38.584674 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1c8697f3-2a34-437f-8335-7e5d7160a0b4 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:13:38.584674 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1c8697f3-2a34-437f-8335-7e5d7160a0b4 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] [instance: 5db08838-334f-4de5-9030-c8a395c97aa3] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:13:38.584674 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1c8697f3-2a34-437f-8335-7e5d7160a0b4 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:13:38.584674 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1c8697f3-2a34-437f-8335-7e5d7160a0b4 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:13:38.584674 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1c8697f3-2a34-437f-8335-7e5d7160a0b4 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:13:38.584674 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1c8697f3-2a34-437f-8335-7e5d7160a0b4 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:13:38.584674 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1c8697f3-2a34-437f-8335-7e5d7160a0b4 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:13:38.584674 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1c8697f3-2a34-437f-8335-7e5d7160a0b4 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:13:38.584674 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1c8697f3-2a34-437f-8335-7e5d7160a0b4 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dc8b557234d239bf2e2ec8cc002c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587458a3ad32433c80687dba9c5764ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:13:38.584674 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1c8697f3-2a34-437f-8335-7e5d7160a0b4 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] 10.222.0.20 "GET /compute/v2.1/servers/5db08838-334f-4de5-9030-c8a395c97aa3" status: 200 len: 1308 microversion: 2.1 time: 0.099328 Oct 04 20:13:38.584674 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4195/8404] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:13:38 2022] GET /compute/v2.1/servers/5db08838-334f-4de5-9030-c8a395c97aa3 => generated 1308 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:13:39.417511 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0a5f5b5b-6024-4395-925e-54eb7db27e6b tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:13:39.418750 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0a5f5b5b-6024-4395-925e-54eb7db27e6b tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] [instance: 5db08838-334f-4de5-9030-c8a395c97aa3] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:13:39.425718 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0a5f5b5b-6024-4395-925e-54eb7db27e6b tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:13:39.426208 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0a5f5b5b-6024-4395-925e-54eb7db27e6b tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:13:39.426651 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0a5f5b5b-6024-4395-925e-54eb7db27e6b tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:13:39.427509 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0a5f5b5b-6024-4395-925e-54eb7db27e6b tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:13:39.427977 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0a5f5b5b-6024-4395-925e-54eb7db27e6b tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:13:39.428442 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0a5f5b5b-6024-4395-925e-54eb7db27e6b tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:13:39.507274 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0a5f5b5b-6024-4395-925e-54eb7db27e6b tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dc8b557234d239bf2e2ec8cc002c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587458a3ad32433c80687dba9c5764ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:13:39.515645 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0a5f5b5b-6024-4395-925e-54eb7db27e6b tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] 10.222.0.20 "GET /compute/v2.1/servers/5db08838-334f-4de5-9030-c8a395c97aa3" status: 200 len: 1306 microversion: 2.1 time: 0.102936 Oct 04 20:13:39.516171 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4210/8405] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:13:39 2022] GET /compute/v2.1/servers/5db08838-334f-4de5-9030-c8a395c97aa3 => generated 1306 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:13:40.539000 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-23988234-88e1-43ca-9b48-1a4c6a583ddc tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:13:40.539794 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-23988234-88e1-43ca-9b48-1a4c6a583ddc tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] [instance: 5db08838-334f-4de5-9030-c8a395c97aa3] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:13:40.546655 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-23988234-88e1-43ca-9b48-1a4c6a583ddc tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:13:40.547156 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-23988234-88e1-43ca-9b48-1a4c6a583ddc tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:13:40.547608 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-23988234-88e1-43ca-9b48-1a4c6a583ddc tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:13:40.548364 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-23988234-88e1-43ca-9b48-1a4c6a583ddc tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:13:40.548836 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-23988234-88e1-43ca-9b48-1a4c6a583ddc tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:13:40.549276 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-23988234-88e1-43ca-9b48-1a4c6a583ddc tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:13:40.687233 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-23988234-88e1-43ca-9b48-1a4c6a583ddc tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dc8b557234d239bf2e2ec8cc002c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587458a3ad32433c80687dba9c5764ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:13:40.696462 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-23988234-88e1-43ca-9b48-1a4c6a583ddc tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] 10.222.0.20 "GET /compute/v2.1/servers/5db08838-334f-4de5-9030-c8a395c97aa3" status: 200 len: 1373 microversion: 2.1 time: 0.161287 Oct 04 20:13:40.697255 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4196/8406] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:13:40 2022] GET /compute/v2.1/servers/5db08838-334f-4de5-9030-c8a395c97aa3 => generated 1373 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:13:40.716761 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-d01290bd-07b8-4755-860e-61f2229ac420 req-5af9ea36-77fd-4be3-8828-ff6712269a9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5db08838-334f-4de5-9030-c8a395c97aa3", "tag": "9c3f8c56-e996-4399-a039-e3630d9bba4f"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:13:40.728032 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-d01290bd-07b8-4755-860e-61f2229ac420 req-5af9ea36-77fd-4be3-8828-ff6712269a9b service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:13:40.728539 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-d01290bd-07b8-4755-860e-61f2229ac420 req-5af9ea36-77fd-4be3-8828-ff6712269a9b service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:13:40.728969 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-d01290bd-07b8-4755-860e-61f2229ac420 req-5af9ea36-77fd-4be3-8828-ff6712269a9b service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:13:40.740275 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-d01290bd-07b8-4755-860e-61f2229ac420 req-5af9ea36-77fd-4be3-8828-ff6712269a9b service nova] Creating event network-changed:9c3f8c56-e996-4399-a039-e3630d9bba4f for instance 5db08838-334f-4de5-9030-c8a395c97aa3 on n-h1-850501-14 Oct 04 20:13:40.745979 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-d01290bd-07b8-4755-860e-61f2229ac420 req-5af9ea36-77fd-4be3-8828-ff6712269a9b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032824 Oct 04 20:13:40.746618 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4211/8407] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 20:13:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:13:41.722913 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8a091781-8e2a-4af5-b876-423b765ca03e tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:13:41.723546 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8a091781-8e2a-4af5-b876-423b765ca03e tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] [instance: 5db08838-334f-4de5-9030-c8a395c97aa3] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:13:41.731618 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8a091781-8e2a-4af5-b876-423b765ca03e tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:13:41.732150 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8a091781-8e2a-4af5-b876-423b765ca03e tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:13:41.732606 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8a091781-8e2a-4af5-b876-423b765ca03e tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:13:41.733314 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8a091781-8e2a-4af5-b876-423b765ca03e tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:13:41.733784 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8a091781-8e2a-4af5-b876-423b765ca03e tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:13:41.734227 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8a091781-8e2a-4af5-b876-423b765ca03e tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:13:41.867461 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8a091781-8e2a-4af5-b876-423b765ca03e tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dc8b557234d239bf2e2ec8cc002c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587458a3ad32433c80687dba9c5764ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:13:41.875073 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8a091781-8e2a-4af5-b876-423b765ca03e tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] 10.222.0.20 "GET /compute/v2.1/servers/5db08838-334f-4de5-9030-c8a395c97aa3" status: 200 len: 1373 microversion: 2.1 time: 0.156189 Oct 04 20:13:41.875643 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4197/8408] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:13:41 2022] GET /compute/v2.1/servers/5db08838-334f-4de5-9030-c8a395c97aa3 => generated 1373 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:13:42.900898 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-61cd006b-940d-43db-9063-e838570a56ef tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:13:42.901615 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-61cd006b-940d-43db-9063-e838570a56ef tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] [instance: 5db08838-334f-4de5-9030-c8a395c97aa3] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:13:42.907864 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-61cd006b-940d-43db-9063-e838570a56ef tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:13:42.908385 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-61cd006b-940d-43db-9063-e838570a56ef tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:13:42.908849 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-61cd006b-940d-43db-9063-e838570a56ef tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:13:42.909552 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-61cd006b-940d-43db-9063-e838570a56ef tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:13:42.910013 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-61cd006b-940d-43db-9063-e838570a56ef tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:13:42.910443 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-61cd006b-940d-43db-9063-e838570a56ef tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:13:43.043941 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-61cd006b-940d-43db-9063-e838570a56ef tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dc8b557234d239bf2e2ec8cc002c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587458a3ad32433c80687dba9c5764ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:13:43.051812 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-61cd006b-940d-43db-9063-e838570a56ef tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] 10.222.0.20 "GET /compute/v2.1/servers/5db08838-334f-4de5-9030-c8a395c97aa3" status: 200 len: 1373 microversion: 2.1 time: 0.156834 Oct 04 20:13:43.052497 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4212/8409] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:13:42 2022] GET /compute/v2.1/servers/5db08838-334f-4de5-9030-c8a395c97aa3 => generated 1373 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:13:44.075445 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-23eee15e-d57d-47cc-8625-8b68096f4cb2 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:13:44.076093 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-23eee15e-d57d-47cc-8625-8b68096f4cb2 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] [instance: 5db08838-334f-4de5-9030-c8a395c97aa3] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:13:44.078771 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=2 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:13:44.083670 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-23eee15e-d57d-47cc-8625-8b68096f4cb2 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:13:44.084208 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-23eee15e-d57d-47cc-8625-8b68096f4cb2 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:13:44.084670 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-23eee15e-d57d-47cc-8625-8b68096f4cb2 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:13:44.085391 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-23eee15e-d57d-47cc-8625-8b68096f4cb2 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:13:44.085866 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-23eee15e-d57d-47cc-8625-8b68096f4cb2 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:13:44.086357 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-23eee15e-d57d-47cc-8625-8b68096f4cb2 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:13:44.218656 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-23eee15e-d57d-47cc-8625-8b68096f4cb2 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dc8b557234d239bf2e2ec8cc002c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587458a3ad32433c80687dba9c5764ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:13:44.226255 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-23eee15e-d57d-47cc-8625-8b68096f4cb2 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] 10.222.0.20 "GET /compute/v2.1/servers/5db08838-334f-4de5-9030-c8a395c97aa3" status: 200 len: 1373 microversion: 2.1 time: 0.154738 Oct 04 20:13:44.227331 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4198/8410] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:13:44 2022] GET /compute/v2.1/servers/5db08838-334f-4de5-9030-c8a395c97aa3 => generated 1373 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:13:45.255062 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-b3d28267-1225-4cf8-ad63-501f13b72473 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:13:45.255062 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-b3d28267-1225-4cf8-ad63-501f13b72473 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] [instance: 5db08838-334f-4de5-9030-c8a395c97aa3] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:13:45.255062 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=6 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:13:45.258463 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b3d28267-1225-4cf8-ad63-501f13b72473 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:13:45.258963 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b3d28267-1225-4cf8-ad63-501f13b72473 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:13:45.259405 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b3d28267-1225-4cf8-ad63-501f13b72473 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:13:45.260134 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b3d28267-1225-4cf8-ad63-501f13b72473 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:13:45.260600 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b3d28267-1225-4cf8-ad63-501f13b72473 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:13:45.261029 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-b3d28267-1225-4cf8-ad63-501f13b72473 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:13:45.404960 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-b3d28267-1225-4cf8-ad63-501f13b72473 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dc8b557234d239bf2e2ec8cc002c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587458a3ad32433c80687dba9c5764ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:13:45.412996 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-b3d28267-1225-4cf8-ad63-501f13b72473 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] 10.222.0.20 "GET /compute/v2.1/servers/5db08838-334f-4de5-9030-c8a395c97aa3" status: 200 len: 1373 microversion: 2.1 time: 0.166869 Oct 04 20:13:45.413912 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4213/8411] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:13:45 2022] GET /compute/v2.1/servers/5db08838-334f-4de5-9030-c8a395c97aa3 => generated 1373 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:13:46.437191 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7a20ef66-3451-44fd-b6bd-ac581e7d219a tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:13:46.437862 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7a20ef66-3451-44fd-b6bd-ac581e7d219a tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] [instance: 5db08838-334f-4de5-9030-c8a395c97aa3] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:13:46.440673 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=8 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:13:46.446047 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7a20ef66-3451-44fd-b6bd-ac581e7d219a tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:13:46.446654 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7a20ef66-3451-44fd-b6bd-ac581e7d219a tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:13:46.447110 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7a20ef66-3451-44fd-b6bd-ac581e7d219a tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:13:46.447817 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7a20ef66-3451-44fd-b6bd-ac581e7d219a tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:13:46.448316 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7a20ef66-3451-44fd-b6bd-ac581e7d219a tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:13:46.448764 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7a20ef66-3451-44fd-b6bd-ac581e7d219a tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:13:46.582831 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7a20ef66-3451-44fd-b6bd-ac581e7d219a tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dc8b557234d239bf2e2ec8cc002c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587458a3ad32433c80687dba9c5764ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:13:46.591157 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7a20ef66-3451-44fd-b6bd-ac581e7d219a tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] 10.222.0.20 "GET /compute/v2.1/servers/5db08838-334f-4de5-9030-c8a395c97aa3" status: 200 len: 1373 microversion: 2.1 time: 0.157909 Oct 04 20:13:46.591740 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4199/8412] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:13:46 2022] GET /compute/v2.1/servers/5db08838-334f-4de5-9030-c8a395c97aa3 => generated 1373 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:13:47.559313 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-a773ec88-d6ff-4336-8b37-736cd117df6b req-8a6d6e38-b8d4-42e5-8510-cfe51c305a1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5db08838-334f-4de5-9030-c8a395c97aa3", "name": "network-vif-plugged", "status": "completed", "tag": "9c3f8c56-e996-4399-a039-e3630d9bba4f"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:13:47.570034 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-a773ec88-d6ff-4336-8b37-736cd117df6b req-8a6d6e38-b8d4-42e5-8510-cfe51c305a1a service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:13:47.571228 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-a773ec88-d6ff-4336-8b37-736cd117df6b req-8a6d6e38-b8d4-42e5-8510-cfe51c305a1a service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:13:47.572291 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-a773ec88-d6ff-4336-8b37-736cd117df6b req-8a6d6e38-b8d4-42e5-8510-cfe51c305a1a service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:13:47.583220 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-a773ec88-d6ff-4336-8b37-736cd117df6b req-8a6d6e38-b8d4-42e5-8510-cfe51c305a1a service nova] Creating event network-vif-plugged:9c3f8c56-e996-4399-a039-e3630d9bba4f for instance 5db08838-334f-4de5-9030-c8a395c97aa3 on n-h1-850501-14 Oct 04 20:13:47.588427 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-a773ec88-d6ff-4336-8b37-736cd117df6b req-8a6d6e38-b8d4-42e5-8510-cfe51c305a1a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034034 Oct 04 20:13:47.589205 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4214/8413] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 20:13:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:13:47.615054 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-748cd478-44f0-4dd0-9584-44e503d897dd tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:13:47.615686 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-748cd478-44f0-4dd0-9584-44e503d897dd tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] [instance: 5db08838-334f-4de5-9030-c8a395c97aa3] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:13:47.623262 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-748cd478-44f0-4dd0-9584-44e503d897dd tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:13:47.632796 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-748cd478-44f0-4dd0-9584-44e503d897dd tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:13:47.632796 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-748cd478-44f0-4dd0-9584-44e503d897dd tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:13:47.632796 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-748cd478-44f0-4dd0-9584-44e503d897dd tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:13:47.632796 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-748cd478-44f0-4dd0-9584-44e503d897dd tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:13:47.632796 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-748cd478-44f0-4dd0-9584-44e503d897dd tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:13:47.821470 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-748cd478-44f0-4dd0-9584-44e503d897dd tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dc8b557234d239bf2e2ec8cc002c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587458a3ad32433c80687dba9c5764ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:13:47.829274 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-748cd478-44f0-4dd0-9584-44e503d897dd tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] 10.222.0.20 "GET /compute/v2.1/servers/5db08838-334f-4de5-9030-c8a395c97aa3" status: 200 len: 1373 microversion: 2.1 time: 0.218525 Oct 04 20:13:47.829846 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4200/8414] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:13:47 2022] GET /compute/v2.1/servers/5db08838-334f-4de5-9030-c8a395c97aa3 => generated 1373 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:13:48.853286 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-476f4b52-2d5f-4800-8d13-f5f5cdf6d67f tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:13:48.854111 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-476f4b52-2d5f-4800-8d13-f5f5cdf6d67f tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] [instance: 5db08838-334f-4de5-9030-c8a395c97aa3] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:13:48.860708 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-476f4b52-2d5f-4800-8d13-f5f5cdf6d67f tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:13:48.861192 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-476f4b52-2d5f-4800-8d13-f5f5cdf6d67f tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:13:48.861631 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-476f4b52-2d5f-4800-8d13-f5f5cdf6d67f tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:13:48.862325 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-476f4b52-2d5f-4800-8d13-f5f5cdf6d67f tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:13:48.862782 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-476f4b52-2d5f-4800-8d13-f5f5cdf6d67f tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:13:48.863205 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-476f4b52-2d5f-4800-8d13-f5f5cdf6d67f tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:13:49.010368 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-476f4b52-2d5f-4800-8d13-f5f5cdf6d67f tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dc8b557234d239bf2e2ec8cc002c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587458a3ad32433c80687dba9c5764ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:13:49.018164 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-476f4b52-2d5f-4800-8d13-f5f5cdf6d67f tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] 10.222.0.20 "GET /compute/v2.1/servers/5db08838-334f-4de5-9030-c8a395c97aa3" status: 200 len: 1373 microversion: 2.1 time: 0.170275 Oct 04 20:13:49.018742 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4215/8415] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:13:48 2022] GET /compute/v2.1/servers/5db08838-334f-4de5-9030-c8a395c97aa3 => generated 1373 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:13:50.041201 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1a1d5053-cd92-49b1-ba35-f28b0519d73c tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:13:50.041837 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1a1d5053-cd92-49b1-ba35-f28b0519d73c tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] [instance: 5db08838-334f-4de5-9030-c8a395c97aa3] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:13:50.048937 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1a1d5053-cd92-49b1-ba35-f28b0519d73c tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:13:50.049437 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1a1d5053-cd92-49b1-ba35-f28b0519d73c tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:13:50.049881 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1a1d5053-cd92-49b1-ba35-f28b0519d73c tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:13:50.050573 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1a1d5053-cd92-49b1-ba35-f28b0519d73c tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:13:50.051037 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1a1d5053-cd92-49b1-ba35-f28b0519d73c tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:13:50.051465 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1a1d5053-cd92-49b1-ba35-f28b0519d73c tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:13:50.182973 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1a1d5053-cd92-49b1-ba35-f28b0519d73c tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dc8b557234d239bf2e2ec8cc002c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587458a3ad32433c80687dba9c5764ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:13:50.190789 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1a1d5053-cd92-49b1-ba35-f28b0519d73c tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] 10.222.0.20 "GET /compute/v2.1/servers/5db08838-334f-4de5-9030-c8a395c97aa3" status: 200 len: 1559 microversion: 2.1 time: 0.153554 Oct 04 20:13:50.191372 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4201/8416] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:13:50 2022] GET /compute/v2.1/servers/5db08838-334f-4de5-9030-c8a395c97aa3 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:13:50.222472 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5f0a98bd-cc41-4c80-8626-257c0cb4e61f tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:13:50.223094 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5f0a98bd-cc41-4c80-8626-257c0cb4e61f tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] [instance: 5db08838-334f-4de5-9030-c8a395c97aa3] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:13:50.230106 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5f0a98bd-cc41-4c80-8626-257c0cb4e61f tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:13:50.230591 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5f0a98bd-cc41-4c80-8626-257c0cb4e61f tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:13:50.231033 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5f0a98bd-cc41-4c80-8626-257c0cb4e61f tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:13:50.231735 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5f0a98bd-cc41-4c80-8626-257c0cb4e61f tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:13:50.232226 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5f0a98bd-cc41-4c80-8626-257c0cb4e61f tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:13:50.232663 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5f0a98bd-cc41-4c80-8626-257c0cb4e61f tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:13:50.363934 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5f0a98bd-cc41-4c80-8626-257c0cb4e61f tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dc8b557234d239bf2e2ec8cc002c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587458a3ad32433c80687dba9c5764ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:13:50.372316 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5f0a98bd-cc41-4c80-8626-257c0cb4e61f tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] 10.222.0.20 "GET /compute/v2.1/servers/5db08838-334f-4de5-9030-c8a395c97aa3" status: 200 len: 1559 microversion: 2.1 time: 0.153709 Oct 04 20:13:50.372888 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4216/8417] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:13:50 2022] GET /compute/v2.1/servers/5db08838-334f-4de5-9030-c8a395c97aa3 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:13:52.538801 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-1ed789a7-8513-40c4-819c-41d277d2ea6b req-f3ad65c1-879f-46f1-8ef1-3a7960179fb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5db08838-334f-4de5-9030-c8a395c97aa3", "tag": "9c3f8c56-e996-4399-a039-e3630d9bba4f"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:13:52.553426 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-1ed789a7-8513-40c4-819c-41d277d2ea6b req-f3ad65c1-879f-46f1-8ef1-3a7960179fb8 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:13:52.554600 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-1ed789a7-8513-40c4-819c-41d277d2ea6b req-f3ad65c1-879f-46f1-8ef1-3a7960179fb8 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:13:52.555421 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-1ed789a7-8513-40c4-819c-41d277d2ea6b req-f3ad65c1-879f-46f1-8ef1-3a7960179fb8 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:13:52.572937 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-1ed789a7-8513-40c4-819c-41d277d2ea6b req-f3ad65c1-879f-46f1-8ef1-3a7960179fb8 service nova] Creating event network-changed:9c3f8c56-e996-4399-a039-e3630d9bba4f for instance 5db08838-334f-4de5-9030-c8a395c97aa3 on n-h1-850501-14 Oct 04 20:13:52.578238 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-1ed789a7-8513-40c4-819c-41d277d2ea6b req-f3ad65c1-879f-46f1-8ef1-3a7960179fb8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043263 Oct 04 20:13:52.578922 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4202/8418] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 20:13:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:15:47.605508 n-d-850501-14 devstack@n-api.service[123001]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c9febe7b-97ce-4695-9d92-17a0f76701f3] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 20:15:47.606677 n-d-850501-14 devstack@n-api.service[123001]: ERROR oslo.messaging._drivers.impl_rabbit [-] [642656d8-a7cd-470f-ae32-a85e45bb523d] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 20:15:47.607281 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:15:47.608064 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=40 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:15:47.613086 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ed43f0d6-b17f-4cb8-9994-166f37151468 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-321331902"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:15:47.615617 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ed43f0d6-b17f-4cb8-9994-166f37151468 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] [instance: 5db08838-334f-4de5-9030-c8a395c97aa3] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:15:47.622455 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ed43f0d6-b17f-4cb8-9994-166f37151468 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:15:47.622936 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ed43f0d6-b17f-4cb8-9994-166f37151468 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:15:47.623453 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ed43f0d6-b17f-4cb8-9994-166f37151468 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:15:47.624168 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ed43f0d6-b17f-4cb8-9994-166f37151468 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:15:47.624632 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ed43f0d6-b17f-4cb8-9994-166f37151468 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:15:47.625059 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ed43f0d6-b17f-4cb8-9994-166f37151468 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:15:48.075186 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ed43f0d6-b17f-4cb8-9994-166f37151468 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] 10.222.0.20 "POST /compute/v2.1/servers/5db08838-334f-4de5-9030-c8a395c97aa3/action" status: 202 len: 0 microversion: 2.1 time: 0.471303 Oct 04 20:15:48.075872 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4217/8419] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 20:15:47 2022] POST /compute/v2.1/servers/5db08838-334f-4de5-9030-c8a395c97aa3/action => generated 0 bytes in 473 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 20:15:54.034598 n-d-850501-14 devstack@n-api.service[123002]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d2b44dc8-447f-4d0a-9186-943d7552c0ea] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 20:15:54.035702 n-d-850501-14 devstack@n-api.service[123002]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9c4ba655-a850-4726-8db9-cffc7e0e245e] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 20:15:54.037105 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:15:54.045257 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=46 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:15:54.045257 n-d-850501-14 devstack@n-api.service[123002]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 20:15:54.045257 n-d-850501-14 devstack@n-api.service[123002]: Tue Oct 4 20:15:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.20) !!! Oct 04 20:15:54.155508 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-7f0a39c9-6d59-476c-af44-4364e3afec06 req-9e056839-34e3-4108-bcb5-83cd428fe563 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5db08838-334f-4de5-9030-c8a395c97aa3", "name": "network-vif-plugged", "status": "completed", "tag": "9c3f8c56-e996-4399-a039-e3630d9bba4f"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:15:54.170649 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-7f0a39c9-6d59-476c-af44-4364e3afec06 req-9e056839-34e3-4108-bcb5-83cd428fe563 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:15:54.172514 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-7f0a39c9-6d59-476c-af44-4364e3afec06 req-9e056839-34e3-4108-bcb5-83cd428fe563 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:15:54.173259 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-7f0a39c9-6d59-476c-af44-4364e3afec06 req-9e056839-34e3-4108-bcb5-83cd428fe563 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:15:54.185508 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-7f0a39c9-6d59-476c-af44-4364e3afec06 req-9e056839-34e3-4108-bcb5-83cd428fe563 service nova] Creating event network-vif-plugged:9c3f8c56-e996-4399-a039-e3630d9bba4f for instance 5db08838-334f-4de5-9030-c8a395c97aa3 on n-h1-850501-14 Oct 04 20:15:54.192689 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-7f0a39c9-6d59-476c-af44-4364e3afec06 req-9e056839-34e3-4108-bcb5-83cd428fe563 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160223 Oct 04 20:15:54.194141 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4203/8420] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 20:15:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:16:03.801361 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:16:03.802282 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:16:03.807345 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3dbb190e-c92c-4801-9fb8-6a16962a2176 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-727352254", "imageRef": "46aaa8b4-9a14-4965-8956-e364de325179", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-663521482", "security_groups": [{"name": "tempest-secgroup-smoke-328983847"}], "networks": [{"uuid": "3f63a500-6308-47cc-8a52-311c96311bf4"}]}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:16:03.843303 n-d-850501-14 devstack@n-api.service[123001]: INFO oslo.messaging._drivers.impl_rabbit [-] [642656d8-a7cd-470f-ae32-a85e45bb523d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 55738. Oct 04 20:16:03.844034 n-d-850501-14 devstack@n-api.service[123001]: INFO oslo.messaging._drivers.impl_rabbit [-] [c9febe7b-97ce-4695-9d92-17a0f76701f3] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 55736. Oct 04 20:16:03.929052 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.network.neutron [None req-3dbb190e-c92c-4801-9fb8-6a16962a2176 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] validate_networks() for [('3f63a500-6308-47cc-8a52-311c96311bf4', None, None, None, None, None)] {{(pid=123001) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:16:04.675497 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-3dbb190e-c92c-4801-9fb8-6a16962a2176 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Flavor limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:16:04.675928 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-3dbb190e-c92c-4801-9fb8-6a16962a2176 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Image limits 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:16:04.676432 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-3dbb190e-c92c-4801-9fb8-6a16962a2176 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Flavor pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:16:04.676845 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-3dbb190e-c92c-4801-9fb8-6a16962a2176 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Image pref 0:0:0 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:16:04.677261 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.virt.hardware [None req-3dbb190e-c92c-4801-9fb8-6a16962a2176 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123001) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:16:04.686739 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3dbb190e-c92c-4801-9fb8-6a16962a2176 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:16:04.687154 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3dbb190e-c92c-4801-9fb8-6a16962a2176 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:16:04.687590 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3dbb190e-c92c-4801-9fb8-6a16962a2176 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:16:04.688437 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3dbb190e-c92c-4801-9fb8-6a16962a2176 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:16:04.688898 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3dbb190e-c92c-4801-9fb8-6a16962a2176 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:16:04.689325 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3dbb190e-c92c-4801-9fb8-6a16962a2176 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:16:04.706419 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-3dbb190e-c92c-4801-9fb8-6a16962a2176 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Getting quotas for project 587458a3ad32433c80687dba9c5764ad. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:16:04.711718 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.quota [None req-3dbb190e-c92c-4801-9fb8-6a16962a2176 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Getting quotas for user 985dc8b557234d239bf2e2ec8cc002c4 and project 587458a3ad32433c80687dba9c5764ad. Resources: {'instances', 'cores', 'ram'} {{(pid=123001) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:16:04.725065 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3dbb190e-c92c-4801-9fb8-6a16962a2176 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Going to run 1 instances... {{(pid=123001) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:16:04.729145 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3dbb190e-c92c-4801-9fb8-6a16962a2176 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] [instance: 68f5c269-7163-4600-9615-7287a4dae636] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='46aaa8b4-9a14-4965-8956-e364de325179',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123001) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:16:04.856187 n-d-850501-14 devstack@n-api.service[123001]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3dbb190e-c92c-4801-9fb8-6a16962a2176 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] [709b2d6c-c12c-40ee-960b-8ad1f1059fd5] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 20:16:05.866673 n-d-850501-14 devstack@n-api.service[123001]: INFO oslo.messaging._drivers.impl_rabbit [None req-3dbb190e-c92c-4801-9fb8-6a16962a2176 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] [709b2d6c-c12c-40ee-960b-8ad1f1059fd5] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 55750. Oct 04 20:16:05.871504 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3dbb190e-c92c-4801-9fb8-6a16962a2176 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.072327 Oct 04 20:16:05.872175 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4218/8421] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Oct 4 20:16:03 2022] POST /compute/v2.1/servers => generated 405 bytes in 2074 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 20:16:05.884465 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-3820d720-2e32-4f05-bc89-adea5c7d3f3b tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:16:05.885296 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-3820d720-2e32-4f05-bc89-adea5c7d3f3b tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] [instance: 68f5c269-7163-4600-9615-7287a4dae636] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:16:05.916376 n-d-850501-14 devstack@n-api.service[123002]: INFO oslo.messaging._drivers.impl_rabbit [-] [9c4ba655-a850-4726-8db9-cffc7e0e245e] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 55756. Oct 04 20:16:05.917073 n-d-850501-14 devstack@n-api.service[123002]: INFO oslo.messaging._drivers.impl_rabbit [-] [d2b44dc8-447f-4d0a-9186-943d7552c0ea] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 55754. Oct 04 20:16:05.949693 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-3820d720-2e32-4f05-bc89-adea5c7d3f3b tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dc8b557234d239bf2e2ec8cc002c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587458a3ad32433c80687dba9c5764ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:16:05.957273 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-3820d720-2e32-4f05-bc89-adea5c7d3f3b tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] 10.222.0.20 "GET /compute/v2.1/servers/68f5c269-7163-4600-9615-7287a4dae636" status: 200 len: 1247 microversion: 2.1 time: 0.077095 Oct 04 20:16:05.957857 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4204/8422] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:16:05 2022] GET /compute/v2.1/servers/68f5c269-7163-4600-9615-7287a4dae636 => generated 1247 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:16:06.980115 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-a9d72582-6587-4d4b-a13d-cf16abdd2c20 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:16:06.980741 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-a9d72582-6587-4d4b-a13d-cf16abdd2c20 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] [instance: 68f5c269-7163-4600-9615-7287a4dae636] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:16:07.034778 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-a9d72582-6587-4d4b-a13d-cf16abdd2c20 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dc8b557234d239bf2e2ec8cc002c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587458a3ad32433c80687dba9c5764ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:16:07.041867 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-a9d72582-6587-4d4b-a13d-cf16abdd2c20 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] 10.222.0.20 "GET /compute/v2.1/servers/68f5c269-7163-4600-9615-7287a4dae636" status: 200 len: 1247 microversion: 2.1 time: 0.066443 Oct 04 20:16:07.042476 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4219/8423] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:16:06 2022] GET /compute/v2.1/servers/68f5c269-7163-4600-9615-7287a4dae636 => generated 1247 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:16:08.066539 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7d17e070-9203-4743-ba94-906419acfa27 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:16:08.067891 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7d17e070-9203-4743-ba94-906419acfa27 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] [instance: 68f5c269-7163-4600-9615-7287a4dae636] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:16:08.072464 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-2bc69161-44b0-4ead-a0b5-84fd95efeb8e req-4c3f9b8a-5b14-474c-806e-85246bc55621 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5db08838-334f-4de5-9030-c8a395c97aa3", "name": "network-vif-unplugged", "status": "completed", "tag": "9c3f8c56-e996-4399-a039-e3630d9bba4f"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:16:08.130301 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-2bc69161-44b0-4ead-a0b5-84fd95efeb8e req-4c3f9b8a-5b14-474c-806e-85246bc55621 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:16:08.130301 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-2bc69161-44b0-4ead-a0b5-84fd95efeb8e req-4c3f9b8a-5b14-474c-806e-85246bc55621 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:16:08.130301 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-2bc69161-44b0-4ead-a0b5-84fd95efeb8e req-4c3f9b8a-5b14-474c-806e-85246bc55621 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:16:08.130301 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-2bc69161-44b0-4ead-a0b5-84fd95efeb8e req-4c3f9b8a-5b14-474c-806e-85246bc55621 service nova] Creating event network-vif-unplugged:9c3f8c56-e996-4399-a039-e3630d9bba4f for instance 5db08838-334f-4de5-9030-c8a395c97aa3 on n-h1-850501-14 Oct 04 20:16:08.130301 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-2bc69161-44b0-4ead-a0b5-84fd95efeb8e req-4c3f9b8a-5b14-474c-806e-85246bc55621 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034711 Oct 04 20:16:08.130301 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4220/8424] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 20:16:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:16:08.131660 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7d17e070-9203-4743-ba94-906419acfa27 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dc8b557234d239bf2e2ec8cc002c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587458a3ad32433c80687dba9c5764ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:16:08.137673 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7d17e070-9203-4743-ba94-906419acfa27 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] 10.222.0.20 "GET /compute/v2.1/servers/68f5c269-7163-4600-9615-7287a4dae636" status: 200 len: 1247 microversion: 2.1 time: 0.075684 Oct 04 20:16:08.138242 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4205/8425] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:16:08 2022] GET /compute/v2.1/servers/68f5c269-7163-4600-9615-7287a4dae636 => generated 1247 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:16:09.162119 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1c614834-2390-45e8-a0dc-27ece007773a tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:16:09.162828 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1c614834-2390-45e8-a0dc-27ece007773a tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] [instance: 68f5c269-7163-4600-9615-7287a4dae636] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:16:09.218126 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-1c614834-2390-45e8-a0dc-27ece007773a tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dc8b557234d239bf2e2ec8cc002c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587458a3ad32433c80687dba9c5764ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:16:09.225914 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1c614834-2390-45e8-a0dc-27ece007773a tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] 10.222.0.20 "GET /compute/v2.1/servers/68f5c269-7163-4600-9615-7287a4dae636" status: 200 len: 1247 microversion: 2.1 time: 0.068894 Oct 04 20:16:09.226494 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4221/8426] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:16:09 2022] GET /compute/v2.1/servers/68f5c269-7163-4600-9615-7287a4dae636 => generated 1247 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:16:10.249086 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-fa4055a8-a73b-4c0f-a602-75bcab952bee tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:16:10.249720 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-fa4055a8-a73b-4c0f-a602-75bcab952bee tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] [instance: 68f5c269-7163-4600-9615-7287a4dae636] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:16:10.311744 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-fa4055a8-a73b-4c0f-a602-75bcab952bee tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dc8b557234d239bf2e2ec8cc002c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587458a3ad32433c80687dba9c5764ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:16:10.319636 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-fa4055a8-a73b-4c0f-a602-75bcab952bee tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] 10.222.0.20 "GET /compute/v2.1/servers/68f5c269-7163-4600-9615-7287a4dae636" status: 200 len: 1247 microversion: 2.1 time: 0.074474 Oct 04 20:16:10.320239 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4206/8427] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:16:10 2022] GET /compute/v2.1/servers/68f5c269-7163-4600-9615-7287a4dae636 => generated 1247 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:16:11.342723 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7abf7625-52c4-49bf-a830-373789f40aff tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:16:11.343341 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7abf7625-52c4-49bf-a830-373789f40aff tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] [instance: 68f5c269-7163-4600-9615-7287a4dae636] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:16:11.351853 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7abf7625-52c4-49bf-a830-373789f40aff tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:16:11.352385 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7abf7625-52c4-49bf-a830-373789f40aff tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:16:11.352829 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7abf7625-52c4-49bf-a830-373789f40aff tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:16:11.353570 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7abf7625-52c4-49bf-a830-373789f40aff tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:16:11.354148 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7abf7625-52c4-49bf-a830-373789f40aff tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:16:11.354490 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7abf7625-52c4-49bf-a830-373789f40aff tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:16:11.417916 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7abf7625-52c4-49bf-a830-373789f40aff tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dc8b557234d239bf2e2ec8cc002c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587458a3ad32433c80687dba9c5764ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:16:11.426578 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7abf7625-52c4-49bf-a830-373789f40aff tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] 10.222.0.20 "GET /compute/v2.1/servers/68f5c269-7163-4600-9615-7287a4dae636" status: 200 len: 1251 microversion: 2.1 time: 0.087763 Oct 04 20:16:11.427146 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4222/8428] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:16:11 2022] GET /compute/v2.1/servers/68f5c269-7163-4600-9615-7287a4dae636 => generated 1251 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:16:12.450596 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-521941d8-4378-487c-8fbb-688530f440fe tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:16:12.451216 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-521941d8-4378-487c-8fbb-688530f440fe tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] [instance: 68f5c269-7163-4600-9615-7287a4dae636] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:16:12.459410 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-521941d8-4378-487c-8fbb-688530f440fe tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:16:12.459957 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-521941d8-4378-487c-8fbb-688530f440fe tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:16:12.460445 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-521941d8-4378-487c-8fbb-688530f440fe tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:16:12.461149 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-521941d8-4378-487c-8fbb-688530f440fe tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:16:12.461615 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-521941d8-4378-487c-8fbb-688530f440fe tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:16:12.462055 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-521941d8-4378-487c-8fbb-688530f440fe tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:16:12.527630 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-521941d8-4378-487c-8fbb-688530f440fe tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dc8b557234d239bf2e2ec8cc002c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587458a3ad32433c80687dba9c5764ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:16:12.536173 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-521941d8-4378-487c-8fbb-688530f440fe tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] 10.222.0.20 "GET /compute/v2.1/servers/68f5c269-7163-4600-9615-7287a4dae636" status: 200 len: 1299 microversion: 2.1 time: 0.089400 Oct 04 20:16:12.536758 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4207/8429] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:16:12 2022] GET /compute/v2.1/servers/68f5c269-7163-4600-9615-7287a4dae636 => generated 1299 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:16:13.561592 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-dbdd620d-8662-4700-b5fc-b53337fcef79 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:16:13.564247 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-dbdd620d-8662-4700-b5fc-b53337fcef79 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] [instance: 68f5c269-7163-4600-9615-7287a4dae636] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:16:13.575271 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dbdd620d-8662-4700-b5fc-b53337fcef79 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:16:13.576667 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dbdd620d-8662-4700-b5fc-b53337fcef79 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:16:13.577292 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dbdd620d-8662-4700-b5fc-b53337fcef79 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:16:13.581933 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dbdd620d-8662-4700-b5fc-b53337fcef79 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:16:13.582486 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dbdd620d-8662-4700-b5fc-b53337fcef79 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:16:13.582986 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-dbdd620d-8662-4700-b5fc-b53337fcef79 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:16:13.653224 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-dbdd620d-8662-4700-b5fc-b53337fcef79 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dc8b557234d239bf2e2ec8cc002c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587458a3ad32433c80687dba9c5764ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:16:13.661400 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-dbdd620d-8662-4700-b5fc-b53337fcef79 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] 10.222.0.20 "GET /compute/v2.1/servers/68f5c269-7163-4600-9615-7287a4dae636" status: 200 len: 1305 microversion: 2.1 time: 0.106461 Oct 04 20:16:13.661992 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4223/8430] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:16:13 2022] GET /compute/v2.1/servers/68f5c269-7163-4600-9615-7287a4dae636 => generated 1305 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:16:14.684558 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e25b4018-8e9b-4399-9df8-2e3989c5f09c tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:16:14.685277 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e25b4018-8e9b-4399-9df8-2e3989c5f09c tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] [instance: 68f5c269-7163-4600-9615-7287a4dae636] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:16:14.693301 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e25b4018-8e9b-4399-9df8-2e3989c5f09c tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:16:14.694163 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e25b4018-8e9b-4399-9df8-2e3989c5f09c tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:16:14.694832 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e25b4018-8e9b-4399-9df8-2e3989c5f09c tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:16:14.695748 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e25b4018-8e9b-4399-9df8-2e3989c5f09c tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:16:14.696476 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e25b4018-8e9b-4399-9df8-2e3989c5f09c tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:16:14.697144 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e25b4018-8e9b-4399-9df8-2e3989c5f09c tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:16:14.854550 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e25b4018-8e9b-4399-9df8-2e3989c5f09c tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dc8b557234d239bf2e2ec8cc002c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587458a3ad32433c80687dba9c5764ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:16:14.863557 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e25b4018-8e9b-4399-9df8-2e3989c5f09c tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] 10.222.0.20 "GET /compute/v2.1/servers/68f5c269-7163-4600-9615-7287a4dae636" status: 200 len: 1372 microversion: 2.1 time: 0.182263 Oct 04 20:16:14.866155 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4208/8431] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:16:14 2022] GET /compute/v2.1/servers/68f5c269-7163-4600-9615-7287a4dae636 => generated 1372 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:16:15.888680 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-f992ea0c-e6bd-4011-839f-99e84febda1b tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:16:15.889702 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-f992ea0c-e6bd-4011-839f-99e84febda1b tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] [instance: 68f5c269-7163-4600-9615-7287a4dae636] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:16:15.894546 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:16:15.898159 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f992ea0c-e6bd-4011-839f-99e84febda1b tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:16:15.898656 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f992ea0c-e6bd-4011-839f-99e84febda1b tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:16:15.899189 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f992ea0c-e6bd-4011-839f-99e84febda1b tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:16:15.899903 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f992ea0c-e6bd-4011-839f-99e84febda1b tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:16:15.900391 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f992ea0c-e6bd-4011-839f-99e84febda1b tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:16:15.900830 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-f992ea0c-e6bd-4011-839f-99e84febda1b tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:16:16.050831 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-f992ea0c-e6bd-4011-839f-99e84febda1b tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dc8b557234d239bf2e2ec8cc002c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587458a3ad32433c80687dba9c5764ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:16:16.059728 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-f992ea0c-e6bd-4011-839f-99e84febda1b tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] 10.222.0.20 "GET /compute/v2.1/servers/68f5c269-7163-4600-9615-7287a4dae636" status: 200 len: 1372 microversion: 2.1 time: 0.175034 Oct 04 20:16:16.060686 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4224/8432] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:16:15 2022] GET /compute/v2.1/servers/68f5c269-7163-4600-9615-7287a4dae636 => generated 1372 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:16:17.083737 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-8df58652-ab81-40d1-af69-939b40b982b5 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:16:17.084829 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-8df58652-ab81-40d1-af69-939b40b982b5 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] [instance: 68f5c269-7163-4600-9615-7287a4dae636] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:16:17.091859 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8df58652-ab81-40d1-af69-939b40b982b5 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:16:17.092545 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8df58652-ab81-40d1-af69-939b40b982b5 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:16:17.093012 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8df58652-ab81-40d1-af69-939b40b982b5 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:16:17.093817 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8df58652-ab81-40d1-af69-939b40b982b5 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:16:17.094358 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8df58652-ab81-40d1-af69-939b40b982b5 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:16:17.094872 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-8df58652-ab81-40d1-af69-939b40b982b5 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:16:17.261900 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-8df58652-ab81-40d1-af69-939b40b982b5 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dc8b557234d239bf2e2ec8cc002c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587458a3ad32433c80687dba9c5764ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:16:17.270152 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-8df58652-ab81-40d1-af69-939b40b982b5 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] 10.222.0.20 "GET /compute/v2.1/servers/68f5c269-7163-4600-9615-7287a4dae636" status: 200 len: 1372 microversion: 2.1 time: 0.191281 Oct 04 20:16:17.271013 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4209/8433] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:16:17 2022] GET /compute/v2.1/servers/68f5c269-7163-4600-9615-7287a4dae636 => generated 1372 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:16:18.295481 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-6cc631f7-bb56-4fa3-a15f-aada916931a5 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:16:18.297166 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-6cc631f7-bb56-4fa3-a15f-aada916931a5 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] [instance: 68f5c269-7163-4600-9615-7287a4dae636] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:16:18.306788 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6cc631f7-bb56-4fa3-a15f-aada916931a5 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:16:18.307961 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6cc631f7-bb56-4fa3-a15f-aada916931a5 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:16:18.308657 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6cc631f7-bb56-4fa3-a15f-aada916931a5 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:16:18.309586 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6cc631f7-bb56-4fa3-a15f-aada916931a5 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:16:18.310251 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6cc631f7-bb56-4fa3-a15f-aada916931a5 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:16:18.310883 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-6cc631f7-bb56-4fa3-a15f-aada916931a5 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:16:18.477126 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-6cc631f7-bb56-4fa3-a15f-aada916931a5 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dc8b557234d239bf2e2ec8cc002c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587458a3ad32433c80687dba9c5764ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:16:18.489404 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-6cc631f7-bb56-4fa3-a15f-aada916931a5 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] 10.222.0.20 "GET /compute/v2.1/servers/68f5c269-7163-4600-9615-7287a4dae636" status: 200 len: 1372 microversion: 2.1 time: 0.197975 Oct 04 20:16:18.496105 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4225/8434] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:16:18 2022] GET /compute/v2.1/servers/68f5c269-7163-4600-9615-7287a4dae636 => generated 1372 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:16:19.514142 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-1ee58f44-9897-43f6-8eff-26bf9dd7392d tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:16:19.515498 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-1ee58f44-9897-43f6-8eff-26bf9dd7392d tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] [instance: 68f5c269-7163-4600-9615-7287a4dae636] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:16:19.533202 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1ee58f44-9897-43f6-8eff-26bf9dd7392d tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:16:19.534647 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1ee58f44-9897-43f6-8eff-26bf9dd7392d tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:16:19.535390 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1ee58f44-9897-43f6-8eff-26bf9dd7392d tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:16:19.536565 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1ee58f44-9897-43f6-8eff-26bf9dd7392d tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:16:19.537256 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1ee58f44-9897-43f6-8eff-26bf9dd7392d tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:16:19.537923 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-1ee58f44-9897-43f6-8eff-26bf9dd7392d tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:16:19.782985 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-1ee58f44-9897-43f6-8eff-26bf9dd7392d tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dc8b557234d239bf2e2ec8cc002c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587458a3ad32433c80687dba9c5764ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:16:19.791404 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-1ee58f44-9897-43f6-8eff-26bf9dd7392d tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] 10.222.0.20 "GET /compute/v2.1/servers/68f5c269-7163-4600-9615-7287a4dae636" status: 200 len: 1372 microversion: 2.1 time: 0.281511 Oct 04 20:16:19.792267 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4210/8435] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:16:19 2022] GET /compute/v2.1/servers/68f5c269-7163-4600-9615-7287a4dae636 => generated 1372 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:16:20.815015 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-7a9d97f3-4b1e-4e54-afbd-c1d196c50a1a tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:16:20.816324 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-7a9d97f3-4b1e-4e54-afbd-c1d196c50a1a tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] [instance: 68f5c269-7163-4600-9615-7287a4dae636] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:16:20.819915 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell0:SELECT=10 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:16:20.825182 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7a9d97f3-4b1e-4e54-afbd-c1d196c50a1a tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:16:20.825755 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7a9d97f3-4b1e-4e54-afbd-c1d196c50a1a tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:16:20.826273 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7a9d97f3-4b1e-4e54-afbd-c1d196c50a1a tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:16:20.827061 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7a9d97f3-4b1e-4e54-afbd-c1d196c50a1a tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:16:20.827596 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7a9d97f3-4b1e-4e54-afbd-c1d196c50a1a tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:16:20.828148 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-7a9d97f3-4b1e-4e54-afbd-c1d196c50a1a tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:16:20.977904 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-7a9d97f3-4b1e-4e54-afbd-c1d196c50a1a tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dc8b557234d239bf2e2ec8cc002c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587458a3ad32433c80687dba9c5764ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:16:20.986990 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-7a9d97f3-4b1e-4e54-afbd-c1d196c50a1a tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] 10.222.0.20 "GET /compute/v2.1/servers/68f5c269-7163-4600-9615-7287a4dae636" status: 200 len: 1372 microversion: 2.1 time: 0.175787 Oct 04 20:16:20.987906 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4226/8436] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:16:20 2022] GET /compute/v2.1/servers/68f5c269-7163-4600-9615-7287a4dae636 => generated 1372 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:16:22.012153 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-9c51f4eb-0263-4441-ad1b-e3e27448b1a9 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:16:22.012944 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-9c51f4eb-0263-4441-ad1b-e3e27448b1a9 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] [instance: 68f5c269-7163-4600-9615-7287a4dae636] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:16:22.014823 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell0:SELECT=6 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:16:22.021743 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9c51f4eb-0263-4441-ad1b-e3e27448b1a9 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:16:22.022241 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9c51f4eb-0263-4441-ad1b-e3e27448b1a9 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:16:22.022701 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9c51f4eb-0263-4441-ad1b-e3e27448b1a9 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:16:22.024018 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9c51f4eb-0263-4441-ad1b-e3e27448b1a9 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:16:22.024740 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9c51f4eb-0263-4441-ad1b-e3e27448b1a9 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:16:22.025194 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-9c51f4eb-0263-4441-ad1b-e3e27448b1a9 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:16:22.186483 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-9c51f4eb-0263-4441-ad1b-e3e27448b1a9 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dc8b557234d239bf2e2ec8cc002c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587458a3ad32433c80687dba9c5764ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:16:22.194716 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-9c51f4eb-0263-4441-ad1b-e3e27448b1a9 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] 10.222.0.20 "GET /compute/v2.1/servers/68f5c269-7163-4600-9615-7287a4dae636" status: 200 len: 1372 microversion: 2.1 time: 0.186669 Oct 04 20:16:22.195294 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4211/8437] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:16:22 2022] GET /compute/v2.1/servers/68f5c269-7163-4600-9615-7287a4dae636 => generated 1372 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:16:23.217968 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-244930bf-5097-4f62-8ad7-fc9d4de2bb2d tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:16:23.218648 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-244930bf-5097-4f62-8ad7-fc9d4de2bb2d tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] [instance: 68f5c269-7163-4600-9615-7287a4dae636] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:16:23.226197 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-244930bf-5097-4f62-8ad7-fc9d4de2bb2d tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:16:23.226694 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-244930bf-5097-4f62-8ad7-fc9d4de2bb2d tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:16:23.227135 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-244930bf-5097-4f62-8ad7-fc9d4de2bb2d tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:16:23.227885 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-244930bf-5097-4f62-8ad7-fc9d4de2bb2d tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:16:23.228410 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-244930bf-5097-4f62-8ad7-fc9d4de2bb2d tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:16:23.228843 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-244930bf-5097-4f62-8ad7-fc9d4de2bb2d tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:16:23.372987 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-244930bf-5097-4f62-8ad7-fc9d4de2bb2d tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dc8b557234d239bf2e2ec8cc002c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587458a3ad32433c80687dba9c5764ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:16:23.382850 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-244930bf-5097-4f62-8ad7-fc9d4de2bb2d tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] 10.222.0.20 "GET /compute/v2.1/servers/68f5c269-7163-4600-9615-7287a4dae636" status: 200 len: 1372 microversion: 2.1 time: 0.168915 Oct 04 20:16:23.383813 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4227/8438] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:16:23 2022] GET /compute/v2.1/servers/68f5c269-7163-4600-9615-7287a4dae636 => generated 1372 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:16:24.194593 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-8df9af02-90af-4891-a7a2-507da19b4d97 req-69ec3733-8a39-4843-9a8d-2c387ccf40b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68f5c269-7163-4600-9615-7287a4dae636", "tag": "2ded26c2-cffe-4bc1-933b-fdcdb78879fb"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:16:24.204724 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-8df9af02-90af-4891-a7a2-507da19b4d97 req-69ec3733-8a39-4843-9a8d-2c387ccf40b8 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:16:24.205255 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-8df9af02-90af-4891-a7a2-507da19b4d97 req-69ec3733-8a39-4843-9a8d-2c387ccf40b8 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:16:24.205702 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-8df9af02-90af-4891-a7a2-507da19b4d97 req-69ec3733-8a39-4843-9a8d-2c387ccf40b8 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:16:24.220170 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-8df9af02-90af-4891-a7a2-507da19b4d97 req-69ec3733-8a39-4843-9a8d-2c387ccf40b8 service nova] Creating event network-changed:2ded26c2-cffe-4bc1-933b-fdcdb78879fb for instance 68f5c269-7163-4600-9615-7287a4dae636 on n-h2-850501-14 Oct 04 20:16:24.225412 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-8df9af02-90af-4891-a7a2-507da19b4d97 req-69ec3733-8a39-4843-9a8d-2c387ccf40b8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035387 Oct 04 20:16:24.226038 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4212/8439] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 20:16:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:16:24.408031 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-0c5a503f-a868-4cc6-a4ca-157ca0379662 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:16:24.413405 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-0c5a503f-a868-4cc6-a4ca-157ca0379662 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] [instance: 68f5c269-7163-4600-9615-7287a4dae636] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:16:24.415907 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0c5a503f-a868-4cc6-a4ca-157ca0379662 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:16:24.416537 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0c5a503f-a868-4cc6-a4ca-157ca0379662 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:16:24.417089 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0c5a503f-a868-4cc6-a4ca-157ca0379662 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:16:24.417938 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0c5a503f-a868-4cc6-a4ca-157ca0379662 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:16:24.418626 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0c5a503f-a868-4cc6-a4ca-157ca0379662 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:16:24.419160 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-0c5a503f-a868-4cc6-a4ca-157ca0379662 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:16:24.633741 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-0c5a503f-a868-4cc6-a4ca-157ca0379662 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dc8b557234d239bf2e2ec8cc002c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587458a3ad32433c80687dba9c5764ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:16:24.642366 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-0c5a503f-a868-4cc6-a4ca-157ca0379662 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] 10.222.0.20 "GET /compute/v2.1/servers/68f5c269-7163-4600-9615-7287a4dae636" status: 200 len: 1372 microversion: 2.1 time: 0.238221 Oct 04 20:16:24.643050 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4228/8440] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:16:24 2022] GET /compute/v2.1/servers/68f5c269-7163-4600-9615-7287a4dae636 => generated 1372 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:16:25.668676 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-39e004e9-4289-401f-8e86-a8fbacc00ae2 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:16:25.669422 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-39e004e9-4289-401f-8e86-a8fbacc00ae2 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] [instance: 68f5c269-7163-4600-9615-7287a4dae636] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:16:25.676368 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-39e004e9-4289-401f-8e86-a8fbacc00ae2 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:16:25.677026 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-39e004e9-4289-401f-8e86-a8fbacc00ae2 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:16:25.677515 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-39e004e9-4289-401f-8e86-a8fbacc00ae2 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:16:25.678203 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-39e004e9-4289-401f-8e86-a8fbacc00ae2 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:16:25.678674 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-39e004e9-4289-401f-8e86-a8fbacc00ae2 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:16:25.679120 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-39e004e9-4289-401f-8e86-a8fbacc00ae2 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:16:25.828528 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-39e004e9-4289-401f-8e86-a8fbacc00ae2 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dc8b557234d239bf2e2ec8cc002c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587458a3ad32433c80687dba9c5764ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:16:25.836853 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-39e004e9-4289-401f-8e86-a8fbacc00ae2 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] 10.222.0.20 "GET /compute/v2.1/servers/68f5c269-7163-4600-9615-7287a4dae636" status: 200 len: 1372 microversion: 2.1 time: 0.173341 Oct 04 20:16:25.837440 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4213/8441] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:16:25 2022] GET /compute/v2.1/servers/68f5c269-7163-4600-9615-7287a4dae636 => generated 1372 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:16:26.859660 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-3c39b44d-7eec-4b4c-b342-c9e60bef6f7b tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:16:26.860354 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-3c39b44d-7eec-4b4c-b342-c9e60bef6f7b tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] [instance: 68f5c269-7163-4600-9615-7287a4dae636] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:16:26.867545 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3c39b44d-7eec-4b4c-b342-c9e60bef6f7b tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:16:26.868044 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3c39b44d-7eec-4b4c-b342-c9e60bef6f7b tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:16:26.868768 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3c39b44d-7eec-4b4c-b342-c9e60bef6f7b tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:16:26.869469 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3c39b44d-7eec-4b4c-b342-c9e60bef6f7b tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:16:26.869950 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3c39b44d-7eec-4b4c-b342-c9e60bef6f7b tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:16:26.870382 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-3c39b44d-7eec-4b4c-b342-c9e60bef6f7b tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:16:27.005726 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-3c39b44d-7eec-4b4c-b342-c9e60bef6f7b tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dc8b557234d239bf2e2ec8cc002c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587458a3ad32433c80687dba9c5764ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:16:27.016079 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-3c39b44d-7eec-4b4c-b342-c9e60bef6f7b tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] 10.222.0.20 "GET /compute/v2.1/servers/68f5c269-7163-4600-9615-7287a4dae636" status: 200 len: 1372 microversion: 2.1 time: 0.160295 Oct 04 20:16:27.016678 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4229/8442] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:16:26 2022] GET /compute/v2.1/servers/68f5c269-7163-4600-9615-7287a4dae636 => generated 1372 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:16:28.040950 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-0861ecb0-2991-4e11-9729-c403c1a14eb4 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:16:28.041508 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-0861ecb0-2991-4e11-9729-c403c1a14eb4 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] [instance: 68f5c269-7163-4600-9615-7287a4dae636] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:16:28.048469 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0861ecb0-2991-4e11-9729-c403c1a14eb4 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:16:28.048973 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0861ecb0-2991-4e11-9729-c403c1a14eb4 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:16:28.049427 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0861ecb0-2991-4e11-9729-c403c1a14eb4 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:16:28.050136 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0861ecb0-2991-4e11-9729-c403c1a14eb4 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:16:28.050611 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0861ecb0-2991-4e11-9729-c403c1a14eb4 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:16:28.051237 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-0861ecb0-2991-4e11-9729-c403c1a14eb4 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:16:28.189313 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-0861ecb0-2991-4e11-9729-c403c1a14eb4 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dc8b557234d239bf2e2ec8cc002c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587458a3ad32433c80687dba9c5764ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:16:28.197726 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-0861ecb0-2991-4e11-9729-c403c1a14eb4 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] 10.222.0.20 "GET /compute/v2.1/servers/68f5c269-7163-4600-9615-7287a4dae636" status: 200 len: 1372 microversion: 2.1 time: 0.160804 Oct 04 20:16:28.198302 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4214/8443] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:16:28 2022] GET /compute/v2.1/servers/68f5c269-7163-4600-9615-7287a4dae636 => generated 1372 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:16:29.221435 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-41f25daa-56c7-4ab4-aec3-8cbb94386ee9 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:16:29.222576 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-41f25daa-56c7-4ab4-aec3-8cbb94386ee9 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] [instance: 68f5c269-7163-4600-9615-7287a4dae636] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:16:29.229771 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-41f25daa-56c7-4ab4-aec3-8cbb94386ee9 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:16:29.230265 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-41f25daa-56c7-4ab4-aec3-8cbb94386ee9 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:16:29.230706 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-41f25daa-56c7-4ab4-aec3-8cbb94386ee9 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:16:29.231437 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-41f25daa-56c7-4ab4-aec3-8cbb94386ee9 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:16:29.231898 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-41f25daa-56c7-4ab4-aec3-8cbb94386ee9 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:16:29.232358 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-41f25daa-56c7-4ab4-aec3-8cbb94386ee9 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:16:29.373719 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-41f25daa-56c7-4ab4-aec3-8cbb94386ee9 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dc8b557234d239bf2e2ec8cc002c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587458a3ad32433c80687dba9c5764ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:16:29.378048 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-41f25daa-56c7-4ab4-aec3-8cbb94386ee9 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] 10.222.0.20 "GET /compute/v2.1/servers/68f5c269-7163-4600-9615-7287a4dae636" status: 200 len: 1372 microversion: 2.1 time: 0.160619 Oct 04 20:16:29.378626 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4230/8444] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:16:29 2022] GET /compute/v2.1/servers/68f5c269-7163-4600-9615-7287a4dae636 => generated 1372 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:16:30.401312 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-b2671197-d636-4de1-b23c-3c6c7d886eef tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:16:30.401941 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-b2671197-d636-4de1-b23c-3c6c7d886eef tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] [instance: 68f5c269-7163-4600-9615-7287a4dae636] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:16:30.408803 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b2671197-d636-4de1-b23c-3c6c7d886eef tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:16:30.409304 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b2671197-d636-4de1-b23c-3c6c7d886eef tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:16:30.410293 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b2671197-d636-4de1-b23c-3c6c7d886eef tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:16:30.411018 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b2671197-d636-4de1-b23c-3c6c7d886eef tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:16:30.411490 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b2671197-d636-4de1-b23c-3c6c7d886eef tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:16:30.411935 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-b2671197-d636-4de1-b23c-3c6c7d886eef tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:16:30.543267 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-b2671197-d636-4de1-b23c-3c6c7d886eef tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dc8b557234d239bf2e2ec8cc002c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587458a3ad32433c80687dba9c5764ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:16:30.551990 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-b2671197-d636-4de1-b23c-3c6c7d886eef tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] 10.222.0.20 "GET /compute/v2.1/servers/68f5c269-7163-4600-9615-7287a4dae636" status: 200 len: 1372 microversion: 2.1 time: 0.154730 Oct 04 20:16:30.552595 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4215/8445] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:16:30 2022] GET /compute/v2.1/servers/68f5c269-7163-4600-9615-7287a4dae636 => generated 1372 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:16:31.574993 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-5c460b40-75ee-440c-b6bb-e00e5c2582ce tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:16:31.575648 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-5c460b40-75ee-440c-b6bb-e00e5c2582ce tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] [instance: 68f5c269-7163-4600-9615-7287a4dae636] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:16:31.582745 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5c460b40-75ee-440c-b6bb-e00e5c2582ce tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:16:31.586264 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5c460b40-75ee-440c-b6bb-e00e5c2582ce tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:16:31.586264 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5c460b40-75ee-440c-b6bb-e00e5c2582ce tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:16:31.586264 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5c460b40-75ee-440c-b6bb-e00e5c2582ce tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:16:31.586264 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5c460b40-75ee-440c-b6bb-e00e5c2582ce tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:16:31.586264 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-5c460b40-75ee-440c-b6bb-e00e5c2582ce tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:16:31.718345 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-5c460b40-75ee-440c-b6bb-e00e5c2582ce tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dc8b557234d239bf2e2ec8cc002c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587458a3ad32433c80687dba9c5764ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:16:31.726807 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-5c460b40-75ee-440c-b6bb-e00e5c2582ce tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] 10.222.0.20 "GET /compute/v2.1/servers/68f5c269-7163-4600-9615-7287a4dae636" status: 200 len: 1372 microversion: 2.1 time: 0.155763 Oct 04 20:16:31.727382 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4231/8446] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:16:31 2022] GET /compute/v2.1/servers/68f5c269-7163-4600-9615-7287a4dae636 => generated 1372 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:16:32.750811 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f9256e4c-fa57-4996-a1dd-3609988cc12e tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:16:32.751442 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f9256e4c-fa57-4996-a1dd-3609988cc12e tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] [instance: 68f5c269-7163-4600-9615-7287a4dae636] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:16:32.758609 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f9256e4c-fa57-4996-a1dd-3609988cc12e tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:16:32.759111 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f9256e4c-fa57-4996-a1dd-3609988cc12e tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:16:32.759574 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f9256e4c-fa57-4996-a1dd-3609988cc12e tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:16:32.760318 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f9256e4c-fa57-4996-a1dd-3609988cc12e tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:16:32.760802 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f9256e4c-fa57-4996-a1dd-3609988cc12e tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:16:32.761246 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f9256e4c-fa57-4996-a1dd-3609988cc12e tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:16:32.898765 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f9256e4c-fa57-4996-a1dd-3609988cc12e tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dc8b557234d239bf2e2ec8cc002c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587458a3ad32433c80687dba9c5764ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:16:32.906457 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f9256e4c-fa57-4996-a1dd-3609988cc12e tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] 10.222.0.20 "GET /compute/v2.1/servers/68f5c269-7163-4600-9615-7287a4dae636" status: 200 len: 1372 microversion: 2.1 time: 0.159567 Oct 04 20:16:32.907032 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4216/8447] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:16:32 2022] GET /compute/v2.1/servers/68f5c269-7163-4600-9615-7287a4dae636 => generated 1372 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:16:33.322803 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-c374a772-c5bc-45b1-b672-bb7c08ee3202 req-c8ac95b6-2379-41da-bb86-4e734b909134 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68f5c269-7163-4600-9615-7287a4dae636", "name": "network-vif-plugged", "status": "completed", "tag": "2ded26c2-cffe-4bc1-933b-fdcdb78879fb"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:16:33.333743 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-c374a772-c5bc-45b1-b672-bb7c08ee3202 req-c8ac95b6-2379-41da-bb86-4e734b909134 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:16:33.334234 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-c374a772-c5bc-45b1-b672-bb7c08ee3202 req-c8ac95b6-2379-41da-bb86-4e734b909134 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:16:33.334668 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-c374a772-c5bc-45b1-b672-bb7c08ee3202 req-c8ac95b6-2379-41da-bb86-4e734b909134 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:16:33.345516 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-c374a772-c5bc-45b1-b672-bb7c08ee3202 req-c8ac95b6-2379-41da-bb86-4e734b909134 service nova] Creating event network-vif-plugged:2ded26c2-cffe-4bc1-933b-fdcdb78879fb for instance 68f5c269-7163-4600-9615-7287a4dae636 on n-h2-850501-14 Oct 04 20:16:33.354876 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-c374a772-c5bc-45b1-b672-bb7c08ee3202 req-c8ac95b6-2379-41da-bb86-4e734b909134 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035924 Oct 04 20:16:33.355473 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4232/8448] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 20:16:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:16:33.929906 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-59ff8af4-2f5e-4053-bab4-d712b3ab10ab tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:16:33.930573 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-59ff8af4-2f5e-4053-bab4-d712b3ab10ab tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] [instance: 68f5c269-7163-4600-9615-7287a4dae636] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:16:33.937544 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-59ff8af4-2f5e-4053-bab4-d712b3ab10ab tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:16:33.937992 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-59ff8af4-2f5e-4053-bab4-d712b3ab10ab tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:16:33.938447 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-59ff8af4-2f5e-4053-bab4-d712b3ab10ab tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:16:33.939156 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-59ff8af4-2f5e-4053-bab4-d712b3ab10ab tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:16:33.939629 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-59ff8af4-2f5e-4053-bab4-d712b3ab10ab tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:16:33.940128 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-59ff8af4-2f5e-4053-bab4-d712b3ab10ab tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:16:34.070697 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-59ff8af4-2f5e-4053-bab4-d712b3ab10ab tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dc8b557234d239bf2e2ec8cc002c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587458a3ad32433c80687dba9c5764ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:16:34.078262 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-59ff8af4-2f5e-4053-bab4-d712b3ab10ab tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] 10.222.0.20 "GET /compute/v2.1/servers/68f5c269-7163-4600-9615-7287a4dae636" status: 200 len: 1372 microversion: 2.1 time: 0.153045 Oct 04 20:16:34.078836 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4217/8449] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:16:33 2022] GET /compute/v2.1/servers/68f5c269-7163-4600-9615-7287a4dae636 => generated 1372 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:16:35.104223 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8826050d-ded6-4ede-80e7-7c04ad47ef36 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:16:35.104762 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8826050d-ded6-4ede-80e7-7c04ad47ef36 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] [instance: 68f5c269-7163-4600-9615-7287a4dae636] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:16:35.107897 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:16:35.117463 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8826050d-ded6-4ede-80e7-7c04ad47ef36 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:16:35.129264 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8826050d-ded6-4ede-80e7-7c04ad47ef36 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:16:35.129264 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8826050d-ded6-4ede-80e7-7c04ad47ef36 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:16:35.129264 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8826050d-ded6-4ede-80e7-7c04ad47ef36 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:16:35.129264 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8826050d-ded6-4ede-80e7-7c04ad47ef36 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:16:35.129264 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8826050d-ded6-4ede-80e7-7c04ad47ef36 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:16:35.129264 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=67 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:16:35.262713 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8826050d-ded6-4ede-80e7-7c04ad47ef36 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dc8b557234d239bf2e2ec8cc002c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587458a3ad32433c80687dba9c5764ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:16:35.270413 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8826050d-ded6-4ede-80e7-7c04ad47ef36 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] 10.222.0.20 "GET /compute/v2.1/servers/68f5c269-7163-4600-9615-7287a4dae636" status: 200 len: 1372 microversion: 2.1 time: 0.171991 Oct 04 20:16:35.271030 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4233/8450] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:16:35 2022] GET /compute/v2.1/servers/68f5c269-7163-4600-9615-7287a4dae636 => generated 1372 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:16:36.294940 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-2c21a7e5-9c54-4413-8161-f54f13bff5a3 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:16:36.295496 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-2c21a7e5-9c54-4413-8161-f54f13bff5a3 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] [instance: 68f5c269-7163-4600-9615-7287a4dae636] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:16:36.297576 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=37 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:16:36.303141 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2c21a7e5-9c54-4413-8161-f54f13bff5a3 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:16:36.309499 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2c21a7e5-9c54-4413-8161-f54f13bff5a3 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:16:36.309499 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2c21a7e5-9c54-4413-8161-f54f13bff5a3 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:16:36.309499 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2c21a7e5-9c54-4413-8161-f54f13bff5a3 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:16:36.309499 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2c21a7e5-9c54-4413-8161-f54f13bff5a3 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:16:36.309499 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-2c21a7e5-9c54-4413-8161-f54f13bff5a3 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:16:36.309991 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=65 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:16:36.445973 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-2c21a7e5-9c54-4413-8161-f54f13bff5a3 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dc8b557234d239bf2e2ec8cc002c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587458a3ad32433c80687dba9c5764ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:16:36.454058 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-2c21a7e5-9c54-4413-8161-f54f13bff5a3 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] 10.222.0.20 "GET /compute/v2.1/servers/68f5c269-7163-4600-9615-7287a4dae636" status: 200 len: 1558 microversion: 2.1 time: 0.163416 Oct 04 20:16:36.454625 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4218/8451] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:16:36 2022] GET /compute/v2.1/servers/68f5c269-7163-4600-9615-7287a4dae636 => generated 1558 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:16:36.482737 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-8b4faf5a-93c2-4f5a-a6b0-0488afc868b9 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:16:36.483349 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-8b4faf5a-93c2-4f5a-a6b0-0488afc868b9 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] [instance: 68f5c269-7163-4600-9615-7287a4dae636] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:16:36.490909 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8b4faf5a-93c2-4f5a-a6b0-0488afc868b9 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:16:36.491399 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8b4faf5a-93c2-4f5a-a6b0-0488afc868b9 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:16:36.491836 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8b4faf5a-93c2-4f5a-a6b0-0488afc868b9 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:16:36.492564 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8b4faf5a-93c2-4f5a-a6b0-0488afc868b9 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:16:36.493189 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8b4faf5a-93c2-4f5a-a6b0-0488afc868b9 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:16:36.493874 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-8b4faf5a-93c2-4f5a-a6b0-0488afc868b9 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:16:36.628463 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-8b4faf5a-93c2-4f5a-a6b0-0488afc868b9 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dc8b557234d239bf2e2ec8cc002c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587458a3ad32433c80687dba9c5764ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:16:36.636999 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-8b4faf5a-93c2-4f5a-a6b0-0488afc868b9 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] 10.222.0.20 "GET /compute/v2.1/servers/68f5c269-7163-4600-9615-7287a4dae636" status: 200 len: 1558 microversion: 2.1 time: 0.158657 Oct 04 20:16:36.637593 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4234/8452] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:16:36 2022] GET /compute/v2.1/servers/68f5c269-7163-4600-9615-7287a4dae636 => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:16:38.893989 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-0518e012-2848-448b-9316-91f5c7348f2d req-dec7aac5-0579-4f8a-af11-70addae1ea1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68f5c269-7163-4600-9615-7287a4dae636", "tag": "2ded26c2-cffe-4bc1-933b-fdcdb78879fb"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:16:38.904525 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-0518e012-2848-448b-9316-91f5c7348f2d req-dec7aac5-0579-4f8a-af11-70addae1ea1a service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:16:38.905023 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-0518e012-2848-448b-9316-91f5c7348f2d req-dec7aac5-0579-4f8a-af11-70addae1ea1a service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:16:38.905474 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-0518e012-2848-448b-9316-91f5c7348f2d req-dec7aac5-0579-4f8a-af11-70addae1ea1a service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:16:38.917517 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-0518e012-2848-448b-9316-91f5c7348f2d req-dec7aac5-0579-4f8a-af11-70addae1ea1a service nova] Creating event network-changed:2ded26c2-cffe-4bc1-933b-fdcdb78879fb for instance 68f5c269-7163-4600-9615-7287a4dae636 on n-h2-850501-14 Oct 04 20:16:38.926347 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-0518e012-2848-448b-9316-91f5c7348f2d req-dec7aac5-0579-4f8a-af11-70addae1ea1a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032763 Oct 04 20:16:38.926347 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4219/8453] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 20:16:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:18:37.721862 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=3 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:18:37.722884 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=11 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:18:37.723989 n-d-850501-14 devstack@n-api.service[123001]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 20:18:37.724158 n-d-850501-14 devstack@n-api.service[123001]: Tue Oct 4 20:18:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/68f5c269-7163-4600-9615-7287a4dae636/action (ip 10.222.0.20) !!! Oct 04 20:18:37.781995 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-e5e6fed1-7961-4d94-82d1-d8dc239276a8 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-2142207635"}} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:18:37.784442 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-e5e6fed1-7961-4d94-82d1-d8dc239276a8 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] [instance: 68f5c269-7163-4600-9615-7287a4dae636] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:18:37.791145 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e5e6fed1-7961-4d94-82d1-d8dc239276a8 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:18:37.791639 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e5e6fed1-7961-4d94-82d1-d8dc239276a8 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:18:37.792177 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e5e6fed1-7961-4d94-82d1-d8dc239276a8 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:18:37.792881 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e5e6fed1-7961-4d94-82d1-d8dc239276a8 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:18:37.793349 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e5e6fed1-7961-4d94-82d1-d8dc239276a8 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:18:37.793783 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-e5e6fed1-7961-4d94-82d1-d8dc239276a8 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:18:38.440741 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-e5e6fed1-7961-4d94-82d1-d8dc239276a8 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] 10.222.0.20 "POST /compute/v2.1/servers/68f5c269-7163-4600-9615-7287a4dae636/action" status: 202 len: 0 microversion: 2.1 time: 0.720845 Oct 04 20:18:38.441554 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4235/8454] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Oct 4 20:18:37 2022] POST /compute/v2.1/servers/68f5c269-7163-4600-9615-7287a4dae636/action => generated 0 bytes in 723 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 20:18:45.972864 n-d-850501-14 devstack@n-api.service[123002]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9c4ba655-a850-4726-8db9-cffc7e0e245e] AMQP server on 10.222.0.20:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 04 20:18:45.974528 n-d-850501-14 devstack@n-api.service[123002]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d2b44dc8-447f-4d0a-9186-943d7552c0ea] AMQP server on 10.222.0.20:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 04 20:18:45.975185 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_api:SELECT=3 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:18:45.976048 n-d-850501-14 devstack@n-api.service[123002]: DEBUG dbcounter [-] [123002] Writing DB stats nova_cell1:SELECT=7 {{(pid=123002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:18:45.977101 n-d-850501-14 devstack@n-api.service[123002]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 20:18:45.977247 n-d-850501-14 devstack@n-api.service[123002]: Tue Oct 4 20:18:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.20) !!! Oct 04 20:18:45.983609 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-17e1acae-7903-4ed2-8aae-c78344b84858 req-1433427d-3ddd-4575-83ba-d26ae858a861 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68f5c269-7163-4600-9615-7287a4dae636", "name": "network-vif-plugged", "status": "completed", "tag": "2ded26c2-cffe-4bc1-933b-fdcdb78879fb"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:18:45.997178 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-17e1acae-7903-4ed2-8aae-c78344b84858 req-1433427d-3ddd-4575-83ba-d26ae858a861 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:18:45.997677 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-17e1acae-7903-4ed2-8aae-c78344b84858 req-1433427d-3ddd-4575-83ba-d26ae858a861 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:18:45.998128 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-17e1acae-7903-4ed2-8aae-c78344b84858 req-1433427d-3ddd-4575-83ba-d26ae858a861 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:18:46.009185 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-17e1acae-7903-4ed2-8aae-c78344b84858 req-1433427d-3ddd-4575-83ba-d26ae858a861 service nova] Creating event network-vif-plugged:2ded26c2-cffe-4bc1-933b-fdcdb78879fb for instance 68f5c269-7163-4600-9615-7287a4dae636 on n-h2-850501-14 Oct 04 20:18:46.014006 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-17e1acae-7903-4ed2-8aae-c78344b84858 req-1433427d-3ddd-4575-83ba-d26ae858a861 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044442 Oct 04 20:18:46.014595 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4220/8455] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 20:18:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:19:01.691164 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_api:SELECT=2 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:19:01.692105 n-d-850501-14 devstack@n-api.service[123001]: DEBUG dbcounter [-] [123001] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123001) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:19:01.697885 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-1aee28d8-0fde-42bd-91ef-7f947bfec12c tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:19:01.699123 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1aee28d8-0fde-42bd-91ef-7f947bfec12c tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] [instance: 68f5c269-7163-4600-9615-7287a4dae636] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:19:01.708380 n-d-850501-14 devstack@n-api.service[123002]: INFO oslo.messaging._drivers.impl_rabbit [-] [d2b44dc8-447f-4d0a-9186-943d7552c0ea] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 56154. Oct 04 20:19:01.709456 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1aee28d8-0fde-42bd-91ef-7f947bfec12c tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:19:01.709972 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1aee28d8-0fde-42bd-91ef-7f947bfec12c tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:19:01.715117 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1aee28d8-0fde-42bd-91ef-7f947bfec12c tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:19:01.715117 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1aee28d8-0fde-42bd-91ef-7f947bfec12c tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:19:01.715117 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1aee28d8-0fde-42bd-91ef-7f947bfec12c tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:19:01.715117 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-1aee28d8-0fde-42bd-91ef-7f947bfec12c tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:19:01.718816 n-d-850501-14 devstack@n-api.service[123002]: INFO oslo.messaging._drivers.impl_rabbit [-] [9c4ba655-a850-4726-8db9-cffc7e0e245e] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 56152. Oct 04 20:19:01.746196 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-1aee28d8-0fde-42bd-91ef-7f947bfec12c tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] [instance: 68f5c269-7163-4600-9615-7287a4dae636] Going to try to terminate instance {{(pid=123001) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:19:01.772986 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [req-dce2f46d-1d25-4e6f-af4f-a5b6f43b1307 req-e6540ad2-f8fa-494c-bcd1-17c40c6390e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68f5c269-7163-4600-9615-7287a4dae636", "tag": "2ded26c2-cffe-4bc1-933b-fdcdb78879fb"}]} {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:19:01.783056 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-dce2f46d-1d25-4e6f-af4f-a5b6f43b1307 req-e6540ad2-f8fa-494c-bcd1-17c40c6390e6 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:19:01.783859 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-dce2f46d-1d25-4e6f-af4f-a5b6f43b1307 req-e6540ad2-f8fa-494c-bcd1-17c40c6390e6 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:19:01.784914 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [req-dce2f46d-1d25-4e6f-af4f-a5b6f43b1307 req-e6540ad2-f8fa-494c-bcd1-17c40c6390e6 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:19:01.796753 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.compute.server_external_events [req-dce2f46d-1d25-4e6f-af4f-a5b6f43b1307 req-e6540ad2-f8fa-494c-bcd1-17c40c6390e6 service nova] Creating event network-changed:2ded26c2-cffe-4bc1-933b-fdcdb78879fb for instance 68f5c269-7163-4600-9615-7287a4dae636 on n-h2-850501-14 Oct 04 20:19:01.802516 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [req-dce2f46d-1d25-4e6f-af4f-a5b6f43b1307 req-e6540ad2-f8fa-494c-bcd1-17c40c6390e6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112354 Oct 04 20:19:01.803425 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4221/8456] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 20:19:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:19:02.057997 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-1aee28d8-0fde-42bd-91ef-7f947bfec12c tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] 10.222.0.20 "DELETE /compute/v2.1/servers/68f5c269-7163-4600-9615-7287a4dae636" status: 204 len: 0 microversion: 2.1 time: 0.370048 Oct 04 20:19:02.059046 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4236/8457] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 20:19:01 2022] DELETE /compute/v2.1/servers/68f5c269-7163-4600-9615-7287a4dae636 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:19:02.068647 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f6902c03-c1f2-4dd6-ac5e-4199fcb68bfc tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:19:02.069660 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f6902c03-c1f2-4dd6-ac5e-4199fcb68bfc tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] [instance: 68f5c269-7163-4600-9615-7287a4dae636] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:19:02.076462 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f6902c03-c1f2-4dd6-ac5e-4199fcb68bfc tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:19:02.076977 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f6902c03-c1f2-4dd6-ac5e-4199fcb68bfc tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:19:02.077430 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f6902c03-c1f2-4dd6-ac5e-4199fcb68bfc tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:19:02.078150 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f6902c03-c1f2-4dd6-ac5e-4199fcb68bfc tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:19:02.079196 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f6902c03-c1f2-4dd6-ac5e-4199fcb68bfc tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:19:02.079651 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f6902c03-c1f2-4dd6-ac5e-4199fcb68bfc tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:19:02.206029 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-50790e93-746f-4a6c-b2f5-f58f4e20e76f req-f54aaf70-5227-41bf-9e81-d86ed23db4ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68f5c269-7163-4600-9615-7287a4dae636", "name": "network-vif-unplugged", "status": "completed", "tag": "2ded26c2-cffe-4bc1-933b-fdcdb78879fb"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:19:02.216246 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-50790e93-746f-4a6c-b2f5-f58f4e20e76f req-f54aaf70-5227-41bf-9e81-d86ed23db4ca service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:19:02.216852 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-50790e93-746f-4a6c-b2f5-f58f4e20e76f req-f54aaf70-5227-41bf-9e81-d86ed23db4ca service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:19:02.217370 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-50790e93-746f-4a6c-b2f5-f58f4e20e76f req-f54aaf70-5227-41bf-9e81-d86ed23db4ca service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:19:02.229828 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-50790e93-746f-4a6c-b2f5-f58f4e20e76f req-f54aaf70-5227-41bf-9e81-d86ed23db4ca service nova] Creating event network-vif-unplugged:2ded26c2-cffe-4bc1-933b-fdcdb78879fb for instance 68f5c269-7163-4600-9615-7287a4dae636 on n-h2-850501-14 Oct 04 20:19:02.235183 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-50790e93-746f-4a6c-b2f5-f58f4e20e76f req-f54aaf70-5227-41bf-9e81-d86ed23db4ca service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033609 Oct 04 20:19:02.235886 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4237/8458] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 20:19:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:19:02.282027 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f6902c03-c1f2-4dd6-ac5e-4199fcb68bfc tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dc8b557234d239bf2e2ec8cc002c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587458a3ad32433c80687dba9c5764ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:19:02.290000 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f6902c03-c1f2-4dd6-ac5e-4199fcb68bfc tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] 10.222.0.20 "GET /compute/v2.1/servers/68f5c269-7163-4600-9615-7287a4dae636" status: 200 len: 1682 microversion: 2.1 time: 0.226358 Oct 04 20:19:02.290588 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4222/8459] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:19:02 2022] GET /compute/v2.1/servers/68f5c269-7163-4600-9615-7287a4dae636 => generated 1682 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:19:03.318562 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-ab28fb4c-baee-41cc-b331-086781f22214 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:19:03.319531 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-ab28fb4c-baee-41cc-b331-086781f22214 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] [instance: 68f5c269-7163-4600-9615-7287a4dae636] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:19:03.326859 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ab28fb4c-baee-41cc-b331-086781f22214 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:19:03.327745 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ab28fb4c-baee-41cc-b331-086781f22214 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:19:03.330483 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ab28fb4c-baee-41cc-b331-086781f22214 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:19:03.330483 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ab28fb4c-baee-41cc-b331-086781f22214 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:19:03.330483 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ab28fb4c-baee-41cc-b331-086781f22214 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:19:03.330483 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-ab28fb4c-baee-41cc-b331-086781f22214 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:19:03.476502 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-ab28fb4c-baee-41cc-b331-086781f22214 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dc8b557234d239bf2e2ec8cc002c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587458a3ad32433c80687dba9c5764ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:19:03.484559 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-ab28fb4c-baee-41cc-b331-086781f22214 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] 10.222.0.20 "GET /compute/v2.1/servers/68f5c269-7163-4600-9615-7287a4dae636" status: 200 len: 1682 microversion: 2.1 time: 0.171977 Oct 04 20:19:03.485135 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4238/8460] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:19:03 2022] GET /compute/v2.1/servers/68f5c269-7163-4600-9615-7287a4dae636 => generated 1682 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:19:04.511101 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-e3d11f69-13da-43e4-93fc-98143048a65f tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:19:04.511742 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-e3d11f69-13da-43e4-93fc-98143048a65f tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] [instance: 68f5c269-7163-4600-9615-7287a4dae636] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:19:04.522849 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e3d11f69-13da-43e4-93fc-98143048a65f tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:19:04.522849 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e3d11f69-13da-43e4-93fc-98143048a65f tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:19:04.522849 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e3d11f69-13da-43e4-93fc-98143048a65f tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:19:04.522849 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e3d11f69-13da-43e4-93fc-98143048a65f tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:19:04.522849 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e3d11f69-13da-43e4-93fc-98143048a65f tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:19:04.522849 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-e3d11f69-13da-43e4-93fc-98143048a65f tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:19:04.588798 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-e3d11f69-13da-43e4-93fc-98143048a65f tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dc8b557234d239bf2e2ec8cc002c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587458a3ad32433c80687dba9c5764ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:19:04.597045 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-e3d11f69-13da-43e4-93fc-98143048a65f tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] 10.222.0.20 "GET /compute/v2.1/servers/68f5c269-7163-4600-9615-7287a4dae636" status: 200 len: 1497 microversion: 2.1 time: 0.090647 Oct 04 20:19:04.597812 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4223/8461] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:19:04 2022] GET /compute/v2.1/servers/68f5c269-7163-4600-9615-7287a4dae636 => generated 1497 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:19:04.629927 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-8b1cc1fb-00bd-4f8f-a66b-4b573c9621e5 req-0528b04f-9ccd-409b-ab79-8fa28a3fe5d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68f5c269-7163-4600-9615-7287a4dae636", "name": "network-vif-deleted", "tag": "2ded26c2-cffe-4bc1-933b-fdcdb78879fb"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:19:04.639684 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-8b1cc1fb-00bd-4f8f-a66b-4b573c9621e5 req-0528b04f-9ccd-409b-ab79-8fa28a3fe5d5 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:19:04.640267 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-8b1cc1fb-00bd-4f8f-a66b-4b573c9621e5 req-0528b04f-9ccd-409b-ab79-8fa28a3fe5d5 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:19:04.640707 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-8b1cc1fb-00bd-4f8f-a66b-4b573c9621e5 req-0528b04f-9ccd-409b-ab79-8fa28a3fe5d5 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:19:04.655222 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-8b1cc1fb-00bd-4f8f-a66b-4b573c9621e5 req-0528b04f-9ccd-409b-ab79-8fa28a3fe5d5 service nova] Creating event network-vif-deleted:2ded26c2-cffe-4bc1-933b-fdcdb78879fb for instance 68f5c269-7163-4600-9615-7287a4dae636 on n-h2-850501-14 Oct 04 20:19:04.660907 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-8b1cc1fb-00bd-4f8f-a66b-4b573c9621e5 req-0528b04f-9ccd-409b-ab79-8fa28a3fe5d5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035279 Oct 04 20:19:04.661995 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4239/8462] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 20:19:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:19:05.622967 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-f9dd37f0-6908-43b3-acee-bdd96a6f89a4 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:19:05.623619 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-f9dd37f0-6908-43b3-acee-bdd96a6f89a4 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] [instance: 68f5c269-7163-4600-9615-7287a4dae636] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:19:05.631176 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f9dd37f0-6908-43b3-acee-bdd96a6f89a4 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:19:05.631773 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f9dd37f0-6908-43b3-acee-bdd96a6f89a4 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:19:05.632346 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f9dd37f0-6908-43b3-acee-bdd96a6f89a4 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:19:05.633066 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f9dd37f0-6908-43b3-acee-bdd96a6f89a4 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:19:05.633541 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f9dd37f0-6908-43b3-acee-bdd96a6f89a4 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:19:05.633988 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f9dd37f0-6908-43b3-acee-bdd96a6f89a4 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:19:05.666862 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f9dd37f0-6908-43b3-acee-bdd96a6f89a4 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:19:05.667391 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f9dd37f0-6908-43b3-acee-bdd96a6f89a4 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:19:05.672212 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-f9dd37f0-6908-43b3-acee-bdd96a6f89a4 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:19:05.672212 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-f9dd37f0-6908-43b3-acee-bdd96a6f89a4 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lazy-loading 'fault' on Instance uuid 68f5c269-7163-4600-9615-7287a4dae636 {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:19:05.709809 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-f9dd37f0-6908-43b3-acee-bdd96a6f89a4 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dc8b557234d239bf2e2ec8cc002c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587458a3ad32433c80687dba9c5764ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:19:05.717718 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-f9dd37f0-6908-43b3-acee-bdd96a6f89a4 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] 10.222.0.20 "GET /compute/v2.1/servers/68f5c269-7163-4600-9615-7287a4dae636" status: 200 len: 1337 microversion: 2.1 time: 0.098968 Oct 04 20:19:05.718306 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4224/8463] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:19:05 2022] GET /compute/v2.1/servers/68f5c269-7163-4600-9615-7287a4dae636 => generated 1337 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:19:06.746854 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-55f45b43-258e-4049-b8af-146c68ccb135 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:19:06.747821 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-55f45b43-258e-4049-b8af-146c68ccb135 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] [instance: 68f5c269-7163-4600-9615-7287a4dae636] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:19:06.755181 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-55f45b43-258e-4049-b8af-146c68ccb135 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:19:06.755688 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-55f45b43-258e-4049-b8af-146c68ccb135 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:19:06.756142 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-55f45b43-258e-4049-b8af-146c68ccb135 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:19:06.756843 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-55f45b43-258e-4049-b8af-146c68ccb135 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:19:06.757305 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-55f45b43-258e-4049-b8af-146c68ccb135 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:19:06.757737 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-55f45b43-258e-4049-b8af-146c68ccb135 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:19:06.772375 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-55f45b43-258e-4049-b8af-146c68ccb135 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] HTTP exception thrown: Instance 68f5c269-7163-4600-9615-7287a4dae636 could not be found. Oct 04 20:19:06.774053 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-55f45b43-258e-4049-b8af-146c68ccb135 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Request method failure captured: Oct 04 20:19:06.774053 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/68f5c269-7163-4600-9615-7287a4dae636 HTTP/1.1 Oct 04 20:19:06.774053 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 20:19:06.774053 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 20:19:06.774053 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 20:19:06.774053 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 20:19:06.774053 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 20:19:06.774053 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 20:19:06.774053 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 20:19:06.774053 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 20:19:06.774053 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPJPh5p24om_tZ-OtAvFmIDDZ8umvy1YpkAZE-DDlJhs5i_D9uERaUyX2AblHj3i2z1hryujrS5XBR_17sKFrGxdTgt4TF1ud8JWsFaPoZdRmRDqE9Eb-rupSD6pA8w6aYMHt_sK4U0d8luidA82ZUqG3KvlVmHhx_BtG-WDJ3Pwq5KQ Oct 04 20:19:06.774053 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 20:19:06.774053 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 20:19:06.774053 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 20:19:06.774053 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 20:19:06.774053 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 20:19:06.774053 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 20:19:06.774053 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 587458a3ad32433c80687dba9c5764ad Oct 04 20:19:06.774053 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-TestSnapshotPattern-1897399424 Oct 04 20:19:06.774053 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 20:19:06.774053 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 20:19:06.774053 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/587458a3ad32433c80687dba9c5764ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_587458a3ad32433c80687dba9c5764ad", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/587458a3ad32433c80687dba9c5764ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/587458a3ad32433c80687dba9c5764ad"}]}] Oct 04 20:19:06.774053 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-TestSnapshotPattern-1897399424 Oct 04 20:19:06.774053 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 587458a3ad32433c80687dba9c5764ad Oct 04 20:19:06.774053 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-TestSnapshotPattern-1897399424 Oct 04 20:19:06.774053 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-TestSnapshotPattern-1897399424-project Oct 04 20:19:06.774053 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 20:19:06.774053 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 20:19:06.774053 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 985dc8b557234d239bf2e2ec8cc002c4 Oct 04 20:19:06.774053 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-TestSnapshotPattern-1897399424-project Oct 04 20:19:06.774053 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 20:19:06.774053 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 68f5c269-7163-4600-9615-7287a4dae636 could not be found. Oct 04 20:19:06.774053 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '68f5c269-7163-4600-9615-7287a4dae636'} Oct 04 20:19:06.774053 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:19:06.774053 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:19:06.774053 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:19:06.774053 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:19:06.774053 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:19:06.774053 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:19:06.774053 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:19:06.774053 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:19:06.774053 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:19:06.774053 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:19:06.774053 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68f5c269-7163-4600-9615-7287a4dae636 could not be found. Oct 04 20:19:06.774053 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 20:19:06.774053 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:19:06.774053 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 20:19:06.774053 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:19:06.774053 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:19:06.774053 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:19:06.774053 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:19:06.774053 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:19:06.774053 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:19:06.774053 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:19:06.774053 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:19:06.774053 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:19:06.774053 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:19:06.774053 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:19:06.774053 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:19:06.774053 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:19:06.774053 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68f5c269-7163-4600-9615-7287a4dae636 could not be found. Oct 04 20:19:06.774053 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 20:19:06.774053 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:19:06.774053 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 20:19:06.778364 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:19:06.778364 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:19:06.778364 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:19:06.778364 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:19:06.778364 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:19:06.778364 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68f5c269-7163-4600-9615-7287a4dae636 could not be found. Oct 04 20:19:06.778364 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 20:19:06.778364 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-55f45b43-258e-4049-b8af-146c68ccb135 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Returning 404 to user: Instance 68f5c269-7163-4600-9615-7287a4dae636 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:19:06.778364 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-55f45b43-258e-4049-b8af-146c68ccb135 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] 10.222.0.20 "GET /compute/v2.1/servers/68f5c269-7163-4600-9615-7287a4dae636" status: 404 len: 111 microversion: 2.1 time: 0.033053 Oct 04 20:19:06.778364 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4240/8464] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:19:06 2022] GET /compute/v2.1/servers/68f5c269-7163-4600-9615-7287a4dae636 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:19:09.063283 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-577b6057-45ae-4e2f-b8b3-26f532317289 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:19:09.063992 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-577b6057-45ae-4e2f-b8b3-26f532317289 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] [instance: 5db08838-334f-4de5-9030-c8a395c97aa3] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:19:09.070237 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-51a0205f-f2c2-4993-97a9-de28a6e1be76 req-5e8ea0e4-8913-46c5-9160-dff4b3661b4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5db08838-334f-4de5-9030-c8a395c97aa3", "tag": "9c3f8c56-e996-4399-a039-e3630d9bba4f"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:19:09.071794 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-577b6057-45ae-4e2f-b8b3-26f532317289 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:19:09.072517 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-577b6057-45ae-4e2f-b8b3-26f532317289 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:19:09.072919 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-577b6057-45ae-4e2f-b8b3-26f532317289 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:19:09.073634 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-577b6057-45ae-4e2f-b8b3-26f532317289 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:19:09.074103 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-577b6057-45ae-4e2f-b8b3-26f532317289 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:19:09.074549 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-577b6057-45ae-4e2f-b8b3-26f532317289 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:19:09.082579 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-51a0205f-f2c2-4993-97a9-de28a6e1be76 req-5e8ea0e4-8913-46c5-9160-dff4b3661b4c service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:19:09.083456 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-51a0205f-f2c2-4993-97a9-de28a6e1be76 req-5e8ea0e4-8913-46c5-9160-dff4b3661b4c service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:19:09.084089 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-51a0205f-f2c2-4993-97a9-de28a6e1be76 req-5e8ea0e4-8913-46c5-9160-dff4b3661b4c service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:19:09.097703 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-51a0205f-f2c2-4993-97a9-de28a6e1be76 req-5e8ea0e4-8913-46c5-9160-dff4b3661b4c service nova] Creating event network-changed:9c3f8c56-e996-4399-a039-e3630d9bba4f for instance 5db08838-334f-4de5-9030-c8a395c97aa3 on n-h1-850501-14 Oct 04 20:19:09.103145 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-577b6057-45ae-4e2f-b8b3-26f532317289 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] [instance: 5db08838-334f-4de5-9030-c8a395c97aa3] Going to try to terminate instance {{(pid=123002) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:19:09.103820 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-51a0205f-f2c2-4993-97a9-de28a6e1be76 req-5e8ea0e4-8913-46c5-9160-dff4b3661b4c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038518 Oct 04 20:19:09.105057 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4241/8465] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 20:19:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:19:09.382535 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-577b6057-45ae-4e2f-b8b3-26f532317289 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5db08838-334f-4de5-9030-c8a395c97aa3" status: 204 len: 0 microversion: 2.1 time: 0.322925 Oct 04 20:19:09.383139 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4225/8466] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Oct 4 20:19:09 2022] DELETE /compute/v2.1/servers/5db08838-334f-4de5-9030-c8a395c97aa3 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 20:19:09.392215 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-286527e0-7bb3-425b-a66c-b7aa4ff73fe3 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:19:09.394488 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-286527e0-7bb3-425b-a66c-b7aa4ff73fe3 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] [instance: 5db08838-334f-4de5-9030-c8a395c97aa3] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:19:09.400633 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-286527e0-7bb3-425b-a66c-b7aa4ff73fe3 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:19:09.401135 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-286527e0-7bb3-425b-a66c-b7aa4ff73fe3 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:19:09.401577 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-286527e0-7bb3-425b-a66c-b7aa4ff73fe3 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:19:09.402324 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-286527e0-7bb3-425b-a66c-b7aa4ff73fe3 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:19:09.402779 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-286527e0-7bb3-425b-a66c-b7aa4ff73fe3 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:19:09.403208 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-286527e0-7bb3-425b-a66c-b7aa4ff73fe3 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:19:09.633356 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.policy [None req-286527e0-7bb3-425b-a66c-b7aa4ff73fe3 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dc8b557234d239bf2e2ec8cc002c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587458a3ad32433c80687dba9c5764ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123001) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:19:09.641573 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-286527e0-7bb3-425b-a66c-b7aa4ff73fe3 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] 10.222.0.20 "GET /compute/v2.1/servers/5db08838-334f-4de5-9030-c8a395c97aa3" status: 200 len: 1682 microversion: 2.1 time: 0.253826 Oct 04 20:19:09.642161 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4242/8467] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:19:09 2022] GET /compute/v2.1/servers/5db08838-334f-4de5-9030-c8a395c97aa3 => generated 1682 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:19:10.667677 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-eb525465-6c9b-492a-b5d5-69c6f85ebd24 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:19:10.668422 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-eb525465-6c9b-492a-b5d5-69c6f85ebd24 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] [instance: 5db08838-334f-4de5-9030-c8a395c97aa3] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:19:10.681157 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eb525465-6c9b-492a-b5d5-69c6f85ebd24 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:19:10.682054 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eb525465-6c9b-492a-b5d5-69c6f85ebd24 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:19:10.682161 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eb525465-6c9b-492a-b5d5-69c6f85ebd24 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:19:10.682877 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eb525465-6c9b-492a-b5d5-69c6f85ebd24 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:19:10.683345 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eb525465-6c9b-492a-b5d5-69c6f85ebd24 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:19:10.683788 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-eb525465-6c9b-492a-b5d5-69c6f85ebd24 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:19:10.858810 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-eb525465-6c9b-492a-b5d5-69c6f85ebd24 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dc8b557234d239bf2e2ec8cc002c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587458a3ad32433c80687dba9c5764ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:19:10.867231 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-eb525465-6c9b-492a-b5d5-69c6f85ebd24 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] 10.222.0.20 "GET /compute/v2.1/servers/5db08838-334f-4de5-9030-c8a395c97aa3" status: 200 len: 1565 microversion: 2.1 time: 0.203901 Oct 04 20:19:10.867797 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4226/8468] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:19:10 2022] GET /compute/v2.1/servers/5db08838-334f-4de5-9030-c8a395c97aa3 => generated 1565 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:19:11.080771 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [req-3b51410e-008b-4fc0-8c6c-b2bec05b8126 req-adebfeb1-fc65-43c7-b969-3abe2fa7abf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5db08838-334f-4de5-9030-c8a395c97aa3", "name": "network-vif-deleted", "tag": "9c3f8c56-e996-4399-a039-e3630d9bba4f"}]} {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:19:11.090376 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-3b51410e-008b-4fc0-8c6c-b2bec05b8126 req-adebfeb1-fc65-43c7-b969-3abe2fa7abf5 service nova] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:19:11.090857 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-3b51410e-008b-4fc0-8c6c-b2bec05b8126 req-adebfeb1-fc65-43c7-b969-3abe2fa7abf5 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:19:11.091285 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [req-3b51410e-008b-4fc0-8c6c-b2bec05b8126 req-adebfeb1-fc65-43c7-b969-3abe2fa7abf5 service nova] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:19:11.102744 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.compute.server_external_events [req-3b51410e-008b-4fc0-8c6c-b2bec05b8126 req-adebfeb1-fc65-43c7-b969-3abe2fa7abf5 service nova] Creating event network-vif-deleted:9c3f8c56-e996-4399-a039-e3630d9bba4f for instance 5db08838-334f-4de5-9030-c8a395c97aa3 on n-h1-850501-14 Oct 04 20:19:11.107705 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [req-3b51410e-008b-4fc0-8c6c-b2bec05b8126 req-adebfeb1-fc65-43c7-b969-3abe2fa7abf5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089711 Oct 04 20:19:11.108416 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4243/8469] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Oct 4 20:19:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:19:11.891608 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-7c31b8f2-7357-4768-a7d4-a4330e713fb8 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Calling method '>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:19:11.894007 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.compute.api [None req-7c31b8f2-7357-4768-a7d4-a4330e713fb8 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] [instance: 5db08838-334f-4de5-9030-c8a395c97aa3] Fetching instance by UUID {{(pid=123002) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:19:11.899643 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c31b8f2-7357-4768-a7d4-a4330e713fb8 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:19:11.900184 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c31b8f2-7357-4768-a7d4-a4330e713fb8 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:19:11.900741 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c31b8f2-7357-4768-a7d4-a4330e713fb8 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:19:11.901460 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c31b8f2-7357-4768-a7d4-a4330e713fb8 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:19:11.901940 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c31b8f2-7357-4768-a7d4-a4330e713fb8 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:19:11.902389 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c31b8f2-7357-4768-a7d4-a4330e713fb8 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:19:11.934221 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c31b8f2-7357-4768-a7d4-a4330e713fb8 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:19:11.934732 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c31b8f2-7357-4768-a7d4-a4330e713fb8 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:19:11.935346 n-d-850501-14 devstack@n-api.service[123002]: DEBUG oslo_concurrency.lockutils [None req-7c31b8f2-7357-4768-a7d4-a4330e713fb8 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:19:11.935847 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.objects.instance [None req-7c31b8f2-7357-4768-a7d4-a4330e713fb8 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lazy-loading 'fault' on Instance uuid 5db08838-334f-4de5-9030-c8a395c97aa3 {{(pid=123002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:19:11.977418 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.policy [None req-7c31b8f2-7357-4768-a7d4-a4330e713fb8 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dc8b557234d239bf2e2ec8cc002c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587458a3ad32433c80687dba9c5764ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123002) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:19:11.985490 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-7c31b8f2-7357-4768-a7d4-a4330e713fb8 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] 10.222.0.20 "GET /compute/v2.1/servers/5db08838-334f-4de5-9030-c8a395c97aa3" status: 200 len: 1338 microversion: 2.1 time: 0.097811 Oct 04 20:19:11.986081 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4227/8470] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:19:11 2022] GET /compute/v2.1/servers/5db08838-334f-4de5-9030-c8a395c97aa3 => generated 1338 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:19:13.011578 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-50201778-e22a-410d-a998-053476040db4 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Calling method '>' {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:19:13.012229 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.compute.api [None req-50201778-e22a-410d-a998-053476040db4 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] [instance: 5db08838-334f-4de5-9030-c8a395c97aa3] Fetching instance by UUID {{(pid=123001) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:19:13.019328 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-50201778-e22a-410d-a998-053476040db4 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:19:13.019820 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-50201778-e22a-410d-a998-053476040db4 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:19:13.020300 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-50201778-e22a-410d-a998-053476040db4 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:19:13.020990 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-50201778-e22a-410d-a998-053476040db4 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Acquiring lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:19:13.021442 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-50201778-e22a-410d-a998-053476040db4 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:19:13.021871 n-d-850501-14 devstack@n-api.service[123001]: DEBUG oslo_concurrency.lockutils [None req-50201778-e22a-410d-a998-053476040db4 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Lock "a6039a6d-a98c-44a9-819b-4eff388d8aa7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123001) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:19:13.035229 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.wsgi [None req-50201778-e22a-410d-a998-053476040db4 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] HTTP exception thrown: Instance 5db08838-334f-4de5-9030-c8a395c97aa3 could not be found. Oct 04 20:19:13.036868 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-50201778-e22a-410d-a998-053476040db4 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Request method failure captured: Oct 04 20:19:13.036868 n-d-850501-14 devstack@n-api.service[123001]: request: GET /compute/v2.1/servers/5db08838-334f-4de5-9030-c8a395c97aa3 HTTP/1.1 Oct 04 20:19:13.036868 n-d-850501-14 devstack@n-api.service[123001]: Accept: application/json Oct 04 20:19:13.036868 n-d-850501-14 devstack@n-api.service[123001]: Accept-Encoding: identity Oct 04 20:19:13.036868 n-d-850501-14 devstack@n-api.service[123001]: Connection: close Oct 04 20:19:13.036868 n-d-850501-14 devstack@n-api.service[123001]: Content-Length: 0 Oct 04 20:19:13.036868 n-d-850501-14 devstack@n-api.service[123001]: Content-Type: application/json Oct 04 20:19:13.036868 n-d-850501-14 devstack@n-api.service[123001]: Host: 10.222.0.20 Oct 04 20:19:13.036868 n-d-850501-14 devstack@n-api.service[123001]: Openstack-System-Scope: None Oct 04 20:19:13.036868 n-d-850501-14 devstack@n-api.service[123001]: User-Agent: python-urllib3/1.26.12 Oct 04 20:19:13.036868 n-d-850501-14 devstack@n-api.service[123001]: X-Auth-Token: gAAAAABjPJPh5p24om_tZ-OtAvFmIDDZ8umvy1YpkAZE-DDlJhs5i_D9uERaUyX2AblHj3i2z1hryujrS5XBR_17sKFrGxdTgt4TF1ud8JWsFaPoZdRmRDqE9Eb-rupSD6pA8w6aYMHt_sK4U0d8luidA82ZUqG3KvlVmHhx_BtG-WDJ3Pwq5KQ Oct 04 20:19:13.036868 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Id: None Oct 04 20:19:13.036868 n-d-850501-14 devstack@n-api.service[123001]: X-Domain-Name: None Oct 04 20:19:13.036868 n-d-850501-14 devstack@n-api.service[123001]: X-Identity-Status: Confirmed Oct 04 20:19:13.036868 n-d-850501-14 devstack@n-api.service[123001]: X-Is-Admin-Project: True Oct 04 20:19:13.036868 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Id: default Oct 04 20:19:13.036868 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Domain-Name: Default Oct 04 20:19:13.036868 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Id: 587458a3ad32433c80687dba9c5764ad Oct 04 20:19:13.036868 n-d-850501-14 devstack@n-api.service[123001]: X-Project-Name: tempest-TestSnapshotPattern-1897399424 Oct 04 20:19:13.036868 n-d-850501-14 devstack@n-api.service[123001]: X-Role: reader,member Oct 04 20:19:13.036868 n-d-850501-14 devstack@n-api.service[123001]: X-Roles: reader,member Oct 04 20:19:13.036868 n-d-850501-14 devstack@n-api.service[123001]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/587458a3ad32433c80687dba9c5764ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_587458a3ad32433c80687dba9c5764ad", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/587458a3ad32433c80687dba9c5764ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/587458a3ad32433c80687dba9c5764ad"}]}] Oct 04 20:19:13.036868 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant: tempest-TestSnapshotPattern-1897399424 Oct 04 20:19:13.036868 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Id: 587458a3ad32433c80687dba9c5764ad Oct 04 20:19:13.036868 n-d-850501-14 devstack@n-api.service[123001]: X-Tenant-Name: tempest-TestSnapshotPattern-1897399424 Oct 04 20:19:13.036868 n-d-850501-14 devstack@n-api.service[123001]: X-User: tempest-TestSnapshotPattern-1897399424-project Oct 04 20:19:13.036868 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Id: default Oct 04 20:19:13.036868 n-d-850501-14 devstack@n-api.service[123001]: X-User-Domain-Name: Default Oct 04 20:19:13.036868 n-d-850501-14 devstack@n-api.service[123001]: X-User-Id: 985dc8b557234d239bf2e2ec8cc002c4 Oct 04 20:19:13.036868 n-d-850501-14 devstack@n-api.service[123001]: X-User-Name: tempest-TestSnapshotPattern-1897399424-project Oct 04 20:19:13.036868 n-d-850501-14 devstack@n-api.service[123001]: method: > Oct 04 20:19:13.036868 n-d-850501-14 devstack@n-api.service[123001]: exception: Instance 5db08838-334f-4de5-9030-c8a395c97aa3 could not be found. Oct 04 20:19:13.036868 n-d-850501-14 devstack@n-api.service[123001]: action_args: {'id': '5db08838-334f-4de5-9030-c8a395c97aa3'} Oct 04 20:19:13.036868 n-d-850501-14 devstack@n-api.service[123001]: {{(pid=123001) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:19:13.036868 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:19:13.036868 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:19:13.036868 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:19:13.036868 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:19:13.036868 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:19:13.036868 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:19:13.036868 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:19:13.036868 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:19:13.036868 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:19:13.036868 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5db08838-334f-4de5-9030-c8a395c97aa3 could not be found. Oct 04 20:19:13.036868 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 20:19:13.036868 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:19:13.036868 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 20:19:13.036868 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:19:13.036868 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:19:13.036868 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:19:13.036868 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:19:13.036868 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:19:13.036868 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:19:13.036868 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:19:13.036868 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:19:13.036868 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:19:13.036868 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:19:13.036868 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:19:13.036868 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:19:13.036868 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:19:13.036868 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5db08838-334f-4de5-9030-c8a395c97aa3 could not be found. Oct 04 20:19:13.036868 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 20:19:13.036868 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:19:13.036868 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 20:19:13.040686 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:19:13.040686 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:19:13.040686 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:19:13.040686 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:19:13.040686 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:19:13.040686 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5db08838-334f-4de5-9030-c8a395c97aa3 could not be found. Oct 04 20:19:13.040686 n-d-850501-14 devstack@n-api.service[123001]: ERROR nova.api.openstack.wsgi Oct 04 20:19:13.040686 n-d-850501-14 devstack@n-api.service[123001]: DEBUG nova.api.openstack.wsgi [None req-50201778-e22a-410d-a998-053476040db4 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Returning 404 to user: Instance 5db08838-334f-4de5-9030-c8a395c97aa3 could not be found. {{(pid=123001) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:19:13.040686 n-d-850501-14 devstack@n-api.service[123001]: INFO nova.api.openstack.requestlog [None req-50201778-e22a-410d-a998-053476040db4 tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] 10.222.0.20 "GET /compute/v2.1/servers/5db08838-334f-4de5-9030-c8a395c97aa3" status: 404 len: 111 microversion: 2.1 time: 0.032076 Oct 04 20:19:13.040686 n-d-850501-14 devstack@n-api.service[123001]: [pid: 123001|app: 0|req: 4244/8471] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Oct 4 20:19:13 2022] GET /compute/v2.1/servers/5db08838-334f-4de5-9030-c8a395c97aa3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:19:13.300942 n-d-850501-14 devstack@n-api.service[123002]: DEBUG nova.api.openstack.wsgi [None req-4b21620f-da16-457d-8b41-6392f3a00a1e tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] Calling method '.version_select at 0x7fe253e648b0>' {{(pid=123002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:19:13.305761 n-d-850501-14 devstack@n-api.service[123002]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4b21620f-da16-457d-8b41-6392f3a00a1e tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] [aa8a6026-a0ad-4edc-b247-1eb6230d8784] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 20:19:14.315746 n-d-850501-14 devstack@n-api.service[123002]: INFO oslo.messaging._drivers.impl_rabbit [None req-4b21620f-da16-457d-8b41-6392f3a00a1e tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] [aa8a6026-a0ad-4edc-b247-1eb6230d8784] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 56234. Oct 04 20:19:14.412446 n-d-850501-14 devstack@n-api.service[123002]: INFO nova.api.openstack.requestlog [None req-4b21620f-da16-457d-8b41-6392f3a00a1e tempest-TestSnapshotPattern-1897399424 tempest-TestSnapshotPattern-1897399424-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-663521482" status: 202 len: 0 microversion: 2.1 time: 1.115323 Oct 04 20:19:14.413053 n-d-850501-14 devstack@n-api.service[123002]: [pid: 123002|app: 0|req: 4228/8472] 10.222.0.20 () {58 vars in 1254 bytes} [Tue Oct 4 20:19:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-663521482 => generated 0 bytes in 1117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)